-- Logs begin at Tue 2022-10-04 19:50:20 UTC, end at Tue 2022-10-04 22:20:04 UTC. -- Oct 04 20:22:45.259721 n-d-854823-8 systemd[1]: Starting Devstack devstack@n-api.service... Oct 04 20:22:45.268626 n-d-854823-8 devstack@n-api.service[106297]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 04 20:22:45.270630 n-d-854823-8 devstack@n-api.service[106297]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Oct 4 20:22:45 2022] *** Oct 04 20:22:45.270630 n-d-854823-8 devstack@n-api.service[106297]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 04 20:22:45.270630 n-d-854823-8 devstack@n-api.service[106297]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 04 20:22:45.270630 n-d-854823-8 devstack@n-api.service[106297]: nodename: n-d-854823-8 Oct 04 20:22:45.270630 n-d-854823-8 devstack@n-api.service[106297]: machine: x86_64 Oct 04 20:22:45.270630 n-d-854823-8 devstack@n-api.service[106297]: clock source: unix Oct 04 20:22:45.270630 n-d-854823-8 devstack@n-api.service[106297]: pcre jit disabled Oct 04 20:22:45.270630 n-d-854823-8 devstack@n-api.service[106297]: detected number of CPU cores: 4 Oct 04 20:22:45.270630 n-d-854823-8 devstack@n-api.service[106297]: current working directory: / Oct 04 20:22:45.270630 n-d-854823-8 devstack@n-api.service[106297]: detected binary path: /usr/bin/uwsgi-core Oct 04 20:22:45.271321 n-d-854823-8 devstack@n-api.service[106297]: your processes number limit is 47680 Oct 04 20:22:45.271321 n-d-854823-8 devstack@n-api.service[106297]: your memory page size is 4096 bytes Oct 04 20:22:45.271321 n-d-854823-8 devstack@n-api.service[106297]: detected max file descriptor number: 2048 Oct 04 20:22:45.271321 n-d-854823-8 devstack@n-api.service[106297]: lock engine: pthread robust mutexes Oct 04 20:22:45.271321 n-d-854823-8 devstack@n-api.service[106297]: thunder lock: enabled Oct 04 20:22:45.271321 n-d-854823-8 devstack@n-api.service[106297]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 04 20:22:45.271321 n-d-854823-8 devstack@n-api.service[106297]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 04 20:22:45.311281 n-d-854823-8 devstack@n-api.service[106297]: Python main interpreter initialized at 0x561110bd39c0 Oct 04 20:22:45.311281 n-d-854823-8 devstack@n-api.service[106297]: python threads support enabled Oct 04 20:22:45.311281 n-d-854823-8 devstack@n-api.service[106297]: your server socket listen backlog is limited to 100 connections Oct 04 20:22:45.311281 n-d-854823-8 devstack@n-api.service[106297]: your mercy for graceful operations on workers is 90 seconds Oct 04 20:22:45.311616 n-d-854823-8 devstack@n-api.service[106297]: mapped 403077 bytes (393 KB) for 2 cores Oct 04 20:22:45.311694 n-d-854823-8 devstack@n-api.service[106297]: *** Operational MODE: preforking *** Oct 04 20:22:45.311945 n-d-854823-8 devstack@n-api.service[106297]: *** uWSGI is running in multiple interpreter mode *** Oct 04 20:22:45.311945 n-d-854823-8 devstack@n-api.service[106297]: spawned uWSGI master process (pid: 106297) Oct 04 20:22:45.312123 n-d-854823-8 systemd[1]: Started Devstack devstack@n-api.service. Oct 04 20:22:45.312886 n-d-854823-8 devstack@n-api.service[106297]: spawned uWSGI worker 1 (pid: 106298, cores: 1) Oct 04 20:22:45.313062 n-d-854823-8 devstack@n-api.service[106297]: spawned uWSGI worker 2 (pid: 106299, cores: 1) Oct 04 20:22:45.313203 n-d-854823-8 devstack@n-api.service[106297]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 04 20:22:45.969992 n-d-854823-8 devstack@n-api.service[106299]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 04 20:22:45.971228 n-d-854823-8 devstack@n-api.service[106298]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 04 20:22:47.050469 n-d-854823-8 devstack@n-api.service[106299]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 04 20:22:47.050469 n-d-854823-8 devstack@n-api.service[106299]: from cryptography.utils import int_from_bytes Oct 04 20:22:47.051063 n-d-854823-8 devstack@n-api.service[106298]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 04 20:22:47.051063 n-d-854823-8 devstack@n-api.service[106298]: from cryptography.utils import int_from_bytes Oct 04 20:22:47.051458 n-d-854823-8 devstack@n-api.service[106299]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 04 20:22:47.051458 n-d-854823-8 devstack@n-api.service[106299]: from cryptography.utils import int_from_bytes Oct 04 20:22:47.051572 n-d-854823-8 devstack@n-api.service[106298]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 04 20:22:47.051572 n-d-854823-8 devstack@n-api.service[106298]: from cryptography.utils import int_from_bytes Oct 04 20:22:49.550963 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 04 20:22:49.551535 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 04 20:22:49.551712 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 04 20:22:49.552060 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 04 20:22:49.552142 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 04 20:22:49.552219 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 04 20:22:49.552306 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 04 20:22:49.552495 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 04 20:22:49.552684 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.552859 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 04 20:22:49.553006 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.553120 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 04 20:22:49.553322 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.553511 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.553640 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.553874 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.553977 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.554162 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.554255 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.554583 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.554695 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.554979 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.555067 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.555293 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.555385 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.555552 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.555651 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.555866 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.555951 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.556188 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-854823-8 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.556279 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.556502 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.556592 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.556810 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.556898 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.557124 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.557267 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-854823-8 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.557436 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.557532 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.557738 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.557825 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.558052 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.558213 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.558374 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.558457 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.558690 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.558861 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.559015 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.560010 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.560143 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.560254 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.560347 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.560449 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.560528 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.560662 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.560744 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.560819 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.560950 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.561038 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.561115 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.561235 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.561354 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.561439 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.561667 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.561794 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.561992 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.562076 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.562304 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.562438 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-854823-8 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.562732 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.562853 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.563029 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.563116 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.563339 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.563467 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-854823-8 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.563728 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.563813 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.564042 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.564139 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.564348 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.564434 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.564666 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.564801 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.564983 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.565068 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.565300 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.565402 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.565609 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.565694 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.565926 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.566018 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.566240 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.566333 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.566580 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.566675 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.566884 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.566974 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.567195 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.567315 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.567500 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.567598 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.567816 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.567908 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.568123 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.568279 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.568407 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.568540 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.568673 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.568804 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.568954 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.569086 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.569255 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.569391 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.569571 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.569660 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.569882 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.569974 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.570653 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.570760 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.570908 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.571092 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.571226 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.571534 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.571621 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.571794 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.571963 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.572044 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.572129 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.572362 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.572448 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.572688 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.572781 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.573001 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.573094 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.573303 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.573385 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.573609 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.573706 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.573913 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.574013 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.574223 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.574305 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.574559 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.574656 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.574868 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.574950 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.575171 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.575254 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.575489 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.575580 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.575805 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.575895 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.33 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.576114 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.33 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.576196 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.576417 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.576508 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.576738 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.576822 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.577055 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.577137 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.33 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.577364 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.577466 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.33 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.577673 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.577765 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.577989 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.578072 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.578294 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.578411 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.578620 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.578716 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.578924 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.579022 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.579240 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.579324 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.579555 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.579637 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.579859 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.579959 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.580106 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.580190 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.580404 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.580489 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.580705 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.580799 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.581019 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.581104 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.581321 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.581405 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.581622 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.581716 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.581921 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.582004 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.582217 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.582300 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.582541 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.582628 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.582842 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.582927 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.583143 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.583236 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.583443 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.583528 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.583744 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.583835 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.584045 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.584136 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.584343 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.584438 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.584643 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.584734 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.584942 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.585026 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.585240 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.585329 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.585544 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.585635 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.586494 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.586611 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.586861 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.586949 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.587193 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.587286 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.587501 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.587596 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.587802 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.587887 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.588120 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.588215 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.588424 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.588508 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.588727 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.588820 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.589043 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.589132 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.589342 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.589425 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.589643 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.589728 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.589956 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.590039 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.590262 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.590361 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.590592 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.590684 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.590901 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.591004 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.591198 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.591291 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.591501 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.591593 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.591814 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.591899 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.592118 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.592211 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.592422 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.592507 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.592723 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.592820 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.593024 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.593122 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.593323 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.593415 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.593624 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.593724 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.593923 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.594028 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.594221 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.594316 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.594544 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.594629 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.594851 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.594935 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.595156 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.595246 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.595458 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.595542 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.595760 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.595844 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.596061 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.596150 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.596375 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.596460 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.596688 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.596780 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.597000 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.597084 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.597308 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.597393 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.597635 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:22:49.597739 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.597970 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.598064 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.598298 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.598412 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.598642 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.598730 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.598954 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.599039 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.599267 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.599431 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.599591 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.599675 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.599899 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.599983 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.600207 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.600304 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.600515 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.600599 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.600830 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.600924 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.601148 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.601232 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.601486 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.601593 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.601821 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.602036 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.602321 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.602455 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.602666 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.602765 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.602977 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.603068 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.603295 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.603381 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.603624 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.603716 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.603946 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.604030 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.604260 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.604345 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.604594 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.604683 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.604932 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.605018 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.605243 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.605326 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.605565 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.605648 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.605884 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.605968 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.606195 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.606280 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.606530 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.606628 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.606840 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.606932 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.607186 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.607270 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.607496 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.607580 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.607808 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.608166 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.608386 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.608468 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.608695 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.608777 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.609014 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.609105 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.609325 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.609409 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.609631 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.609716 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.609941 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.610032 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.610250 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.610360 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.610590 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.610684 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.610905 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.610997 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.611218 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.611303 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.611531 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.611613 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.611841 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.611932 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.612151 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.612243 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.612465 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.612555 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.612774 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.612865 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.613083 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.613168 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.613391 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.613477 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.613695 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.613780 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.613995 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.614124 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.614297 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.614422 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.614627 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.614719 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.614930 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.615014 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.615235 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.615326 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.615546 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.615629 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.615848 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.615937 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.616155 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.616250 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.616467 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.616551 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.616775 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.616866 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.617128 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.617241 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.617449 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.617631 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.617760 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.617940 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.618075 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.618252 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.618410 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.618586 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.618728 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.618892 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.619038 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.619215 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.619353 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.619524 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.619668 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.619828 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.619977 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.620149 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.620305 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.620453 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.620618 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.620756 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.620930 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.621068 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.621256 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.621375 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.621564 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.621683 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.621873 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.621993 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.622193 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.622314 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.622533 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.622695 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.622846 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.622931 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.623163 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.623255 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.623476 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.623569 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.623806 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.623891 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.624120 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.624204 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.624435 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.624530 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.624768 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.624851 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.625082 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.625166 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.625384 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.625476 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.625691 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.625776 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.625992 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.626084 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.626292 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.626503 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.626616 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.626713 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.626921 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.627005 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.627220 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.627305 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.627525 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.627608 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.627826 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.627957 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.628127 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.628212 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.628428 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.628519 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.628734 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.628823 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.629037 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.629131 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.629336 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.629431 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.629636 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.629729 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.629935 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.630026 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.630253 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.630363 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.630583 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.630684 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.630891 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.630977 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.631201 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.631285 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.631539 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.631630 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.631847 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.631930 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.632158 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.632242 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.632470 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.632568 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.633345 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.633429 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.633675 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.633758 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.633992 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.634087 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.634313 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.634430 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.634650 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.634795 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.634967 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.635096 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.635282 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.635411 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.635597 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.635725 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.635919 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.636054 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.636233 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.636367 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.636554 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.636693 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.636858 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.636986 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.637172 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.637300 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.637484 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.637619 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.637810 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.637937 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.638119 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.638207 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.638460 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.638561 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.638771 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.638862 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.639085 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.639219 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.639391 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.639528 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.639699 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.639834 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.640004 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.640133 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.640308 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.640449 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.640627 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.640768 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.640934 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.641062 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.641247 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.641389 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.641551 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.641680 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.641868 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.641997 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.642175 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.642311 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.642515 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.642644 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.642818 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.642947 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.643131 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.643259 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.643440 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.643576 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.643764 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.643893 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.644070 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.644202 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.644379 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.644508 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.644698 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.644837 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.645009 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.645146 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.645317 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.645445 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.645623 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.645751 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.645926 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.646054 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.646226 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.646375 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.646564 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.646702 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.646875 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.647002 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.647181 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.647308 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.647485 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.647633 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.647773 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.647903 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.648089 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.648222 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.648519 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.648664 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.648798 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.648933 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.649110 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.649251 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.649386 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.649522 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.649705 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.649841 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.650016 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.650152 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.650326 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.650508 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.650664 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.650790 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.650968 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.651095 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.651274 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.651403 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.651595 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.651752 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.651905 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.652047 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.652249 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.652382 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.652521 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.652653 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.652790 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.652923 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.653110 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.653240 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.653419 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.653557 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.653722 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.653862 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.654028 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.654165 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.654361 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.654511 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.654675 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.654770 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.654985 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.655070 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.655295 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.655380 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.655603 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.655696 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.655915 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.655999 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.656226 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.656309 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.656532 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.656625 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.656842 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.656924 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.657148 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.657238 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.657456 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.657548 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.657769 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.657852 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.658086 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.658171 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.658426 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.658544 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.658739 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.658838 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.659049 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.659161 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.659352 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.659451 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.659661 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.659753 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.659974 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.660057 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.660290 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.660536 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.660622 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.660867 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.660951 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.661181 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.661266 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.661499 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.661762 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.661846 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.662102 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.662194 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.662451 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.662539 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.662777 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.662861 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.663097 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.663190 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.663403 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.663501 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.663716 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.663802 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.664608 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.664691 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.664931 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.665070 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.665241 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.665333 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.665546 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.665635 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.665852 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.665947 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.666158 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.666254 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.666497 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.666584 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.666801 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.666898 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.667107 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.667192 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.667410 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.667494 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.667714 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.667806 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.668020 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.668103 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.668328 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.668417 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.668635 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.668729 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.668936 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.669019 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.669250 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.669333 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.669554 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.669647 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.669857 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.669942 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.670159 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.670251 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.670485 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.670582 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.670814 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.670896 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.671117 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.671207 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.671423 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.671514 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.671731 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.671816 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.672084 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.672182 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.672386 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.672469 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.672689 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.672773 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.673010 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.673103 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.673312 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.673404 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.673614 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.673706 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.673915 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.674011 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.674222 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.674308 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.674551 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.674695 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.674853 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.674952 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.675159 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.675244 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.675467 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.675550 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.675772 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.675858 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.676077 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.676163 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.676377 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.676460 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.676683 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.676769 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.676983 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.677074 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.677293 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.677376 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.677599 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.677682 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.677902 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.678000 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.678207 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.678290 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.678538 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.678638 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.678845 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.678939 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.679147 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.679245 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.679453 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.679672 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.679821 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.679947 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.680104 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.680200 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.680407 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.680501 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.680707 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.680813 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.681008 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.681103 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.681314 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.681406 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.681619 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.681704 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.681918 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.682011 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.682237 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.682329 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.682570 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.682656 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.682872 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.682968 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.683173 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.683258 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.683478 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.683570 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.683778 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.683870 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.684077 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.684163 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.684382 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.684475 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.684702 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.684788 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.685007 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.685125 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.685314 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.685412 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.685621 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.685716 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.685920 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.686012 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.686221 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.686324 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.686547 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.686640 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.686855 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.686948 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.687159 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.687265 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.687460 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.687551 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.687765 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.687855 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.688069 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.688169 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.688369 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.688491 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.688679 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.688766 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.688985 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.689079 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.689290 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.689389 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.689592 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.689705 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.690264 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.690442 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.690442 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.690593 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.690671 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.690762 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.690843 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.690920 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.691116 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.691214 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.691462 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.691568 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.691770 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.691865 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.692086 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.692180 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.692394 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.692499 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.692703 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.692799 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.693006 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.693102 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.693316 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.693418 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.693623 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.693718 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.693932 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.694035 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.694235 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.694329 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.694556 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.694652 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.694876 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.694987 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.695700 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.695806 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.696010 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.696200 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.696332 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.696512 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.696650 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.696843 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.696970 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.697163 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.697271 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.697478 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.697578 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.697804 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.697898 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.698132 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.698223 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.698483 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.698573 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.698796 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.698906 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.701395 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.701499 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.701589 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.701667 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.701734 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.701806 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.701886 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.701953 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.702027 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.702100 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.702166 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.702230 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.702293 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.702382 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.702465 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.702540 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.702607 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.702671 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.702734 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.702811 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.702878 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.702942 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.703005 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.703070 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.703133 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.703205 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.703278 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.703344 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.703408 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.703478 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.703551 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.703625 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.704069 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.704170 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.704251 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.704328 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.704528 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.704633 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.704829 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.704930 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.705135 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.705230 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.705443 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.705558 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.705758 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.705859 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.706071 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.706167 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.706393 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.706485 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.706796 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.706880 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.707105 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.707188 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.707415 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.707501 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.707725 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.707819 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.708027 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.708112 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.708328 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.708444 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.708640 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.708761 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.708964 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.709066 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.709267 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.709373 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.709569 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.709681 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.709861 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.709992 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.710186 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.710290 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.710514 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.710659 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.710880 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.711080 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.711347 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.711487 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.711602 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.711687 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.711905 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.712001 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.712304 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.712387 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.712612 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.712697 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.712919 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.713037 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.713239 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.713353 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.713557 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.713662 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.713878 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.714082 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.714178 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.714417 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.714517 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.714734 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.714828 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.715065 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.715184 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.715392 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.715488 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.715713 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.715815 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.716022 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.716197 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.716323 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.716422 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.716637 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.716730 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.716956 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.717050 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.717268 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.717354 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.717582 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.717674 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.717902 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.717988 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.718211 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.718297 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.718560 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.718646 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.718890 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.719013 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.719209 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.719295 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.719534 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.719619 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.719836 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.719950 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.720145 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.720276 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.720446 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.720590 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.720748 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.720915 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.721066 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.721245 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.721369 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.721556 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.721677 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.721864 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.721983 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.722183 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.722289 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.722536 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.722641 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.722848 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.722940 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.723173 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.723258 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.723482 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.723569 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.723798 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.723891 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.724110 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.724193 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.724421 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.724514 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.724729 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.724815 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.725030 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.725146 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.725352 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.725442 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.725658 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.725753 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.725961 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.726055 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.726262 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.726885 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.727119 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.727299 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.727461 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.727738 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.727832 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.728071 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.728169 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.728401 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.728486 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.728714 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.728798 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.729029 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.729158 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.729336 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.729429 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.729646 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.729739 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.729973 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.730056 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.730282 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.730418 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.730620 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.730706 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.730942 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.731028 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.731244 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.731337 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.731544 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.731666 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.731850 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.731944 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.732150 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.732244 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.732453 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.732538 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.732752 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.732836 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.733321 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.733407 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.733621 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.733707 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.733922 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.734015 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.734223 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.734309 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.734578 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.734665 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.734881 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.734966 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.735202 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.735366 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.735506 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.735605 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.735807 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.735890 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.736110 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.736195 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.736409 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.736494 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.736713 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.736804 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.737038 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.737129 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.737345 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.737429 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.737658 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.737753 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.737971 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.738061 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.738281 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.738413 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.738614 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.738712 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.738922 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.739007 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.739237 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.739321 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.739551 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.739650 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.739865 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.739950 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.740178 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.740263 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.740486 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.740575 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.740798 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.740891 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.741112 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.741199 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.741427 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.741516 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.741748 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.741956 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.742159 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.742372 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.742701 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.742787 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.743014 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.743101 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.743326 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.743412 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.743638 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.743724 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.743948 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.744033 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.744259 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.744354 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.744570 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.744844 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.744931 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.745173 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.745264 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.745489 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.745588 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.745807 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.745893 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.746124 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.746213 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.746467 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.746556 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.746785 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.746869 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.747098 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.747195 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.747408 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.747491 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.747721 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.747804 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.748036 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.748130 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.748370 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.748454 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.748671 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.748755 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.748989 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.749075 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.749300 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.749386 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.749610 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.749695 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.749921 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.750014 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.750230 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.750315 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.750581 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.750704 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.750892 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.750988 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.751201 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.751286 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.751508 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.751601 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.751833 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.751927 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.752124 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.752209 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.752445 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.752539 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.752764 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.752848 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.753081 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.753174 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.753391 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.753475 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.753702 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.753786 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.754013 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.754098 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.754325 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.754550 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.754666 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.754865 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.754984 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.755197 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.755313 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.755525 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.755653 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.755846 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.755979 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.756161 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.756296 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.756480 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.756613 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.756804 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.756933 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.757109 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.757414 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.757505 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.758255 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.758456 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.758602 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.758863 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.758957 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.759197 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.759290 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.759519 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.759605 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.759822 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.759917 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.760142 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.760235 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.760450 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.760542 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.760773 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.760978 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.761085 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.761328 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.761412 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.761643 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.761736 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.761970 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.762064 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.762296 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.762409 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.762637 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.762721 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.762941 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.763026 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.763265 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.763351 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.763572 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.763665 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.763878 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.764110 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.764208 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.764464 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.764550 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.764784 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.764867 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.765089 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.765181 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.765402 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.765488 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.765712 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.765809 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.766015 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.766101 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.766324 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.766434 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.766659 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.766754 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.766968 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.767051 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.767272 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.767356 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.767576 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.767660 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.767878 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.767975 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.768188 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.768285 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.768488 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.768573 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.768792 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.768886 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.769094 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.769186 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.769401 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.769524 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.769706 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.769798 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.770010 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.770093 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.770316 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.770422 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.770641 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.770776 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.770946 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.771030 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.771264 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.771350 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.771572 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.771669 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.771873 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.771957 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.772179 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.772262 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.772483 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.772567 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.772786 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.772872 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.773097 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.773181 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.773522 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.773610 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.773838 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.773923 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.774155 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.774240 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.774540 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.774630 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.774860 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.774956 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.775172 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.775259 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.775503 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.775742 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.775835 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.776076 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.776161 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.776397 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.776484 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.776714 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.776798 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.777041 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.777134 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.777345 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.777429 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.777650 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.777735 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.777954 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.778039 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.778276 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.778426 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.778614 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.778856 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.778952 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.779197 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.779291 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.779522 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.779666 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.779830 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.779914 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.780139 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.780226 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.780446 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.780531 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.780756 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.780878 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.781064 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.781159 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.781373 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.781458 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.781681 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.781773 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.781989 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.782078 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.782295 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.782394 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.782626 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.782726 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.782939 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.783031 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.783260 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.783352 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.783574 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.783678 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.783890 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.783980 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.784201 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.784285 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.784513 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.784606 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.784820 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.784910 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.785126 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.785211 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.785434 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.785520 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.785745 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.785876 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.786058 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.786156 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.786410 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.786560 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.786709 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.786846 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.787010 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.787147 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.787351 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.787673 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.787806 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.787987 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.788121 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.788298 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.788430 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.788611 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.788763 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.789554 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.789702 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.789843 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.789978 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.790119 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.790260 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.790411 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.790588 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.790688 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.790914 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.791229 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.791364 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.791563 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.791686 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.791903 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.792011 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.792234 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.792326 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.792559 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.792654 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.792869 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.792977 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.793189 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.793288 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.793480 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.793588 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.793789 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.793886 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.794107 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.794203 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.794440 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.794537 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.794746 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.794876 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.795048 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.795212 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.795357 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.795541 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.795659 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.795851 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.795959 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.796162 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.796266 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.796486 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.796571 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.796782 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.796877 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.797102 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.797199 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.797417 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.797501 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.797716 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.797802 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.798017 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.798104 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.798319 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.798419 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.798652 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.798747 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.798955 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.799042 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.799255 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.799346 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.799557 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.799642 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.799865 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.799963 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.800164 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.800258 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.800466 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.800551 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.800771 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.800866 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.801150 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.801249 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.801385 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.801483 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.801690 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.801785 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.802001 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.802089 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.802308 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.802432 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.802637 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.802723 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.802943 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.803039 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.803251 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.803351 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.803563 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.803655 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.803872 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.803958 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.804202 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.804297 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.804532 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.804671 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.804884 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.804984 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.805231 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.805330 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.805492 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.805580 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.805799 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.805885 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.806108 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.806197 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.806453 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.806543 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.806773 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.806867 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.807075 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.807161 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.807398 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.807485 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.807709 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.807801 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.808022 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.808106 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.808335 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.808420 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.808642 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.808735 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.808953 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.809044 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.809262 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.809346 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.809572 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.809666 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.809882 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.809998 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.810189 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.810286 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.810521 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.810620 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.810836 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.810931 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.811144 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.811239 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.811452 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.811588 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.811762 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.811890 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.812071 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.812198 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.812397 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.812530 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.812711 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.812845 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.813015 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.813157 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.813327 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.813468 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.813647 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.813781 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.813967 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.814110 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.814281 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.814444 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.814620 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.814777 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.814942 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.815037 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.815255 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.815340 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.815563 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.815649 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.815865 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.816008 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.816121 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 04 20:22:49.816256 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.816514 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.816847 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.817195 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.817512 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.817859 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.818194 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.818533 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.818850 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.819160 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:22:49.819406 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 04 20:22:49.970293 n-d-854823-8 devstack@n-api.service[106299]: INFO dbcounter [None req-7ae1f98d-5102-467d-a3e0-48030cc26ac1 None None] Registered counter for database nova_api Oct 04 20:22:49.973636 n-d-854823-8 devstack@n-api.service[106298]: INFO dbcounter [None req-76c64e5e-6e6e-4cf0-bfbb-d537c8843146 None None] Registered counter for database nova_api Oct 04 20:22:49.992636 n-d-854823-8 devstack@n-api.service[106299]: DEBUG oslo_db.sqlalchemy.engines [None req-7ae1f98d-5102-467d-a3e0-48030cc26ac1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106299) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 20:22:49.994564 n-d-854823-8 devstack@n-api.service[106298]: DEBUG oslo_db.sqlalchemy.engines [None req-76c64e5e-6e6e-4cf0-bfbb-d537c8843146 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106298) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 20:22:49.999389 n-d-854823-8 devstack@n-api.service[106299]: DEBUG dbcounter [-] [106299] Writer thread running {{(pid=106299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 20:22:50.001044 n-d-854823-8 devstack@n-api.service[106298]: DEBUG dbcounter [-] [106298] Writer thread running {{(pid=106298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 20:22:50.055189 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.context [None req-7ae1f98d-5102-467d-a3e0-48030cc26ac1 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),189ff13b-7538-4a71-a71c-1e7f1d3e1b46(cell1) {{(pid=106299) load_cells /opt/stack/nova/nova/context.py:464}} Oct 04 20:22:50.057186 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.context [None req-76c64e5e-6e6e-4cf0-bfbb-d537c8843146 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),189ff13b-7538-4a71-a71c-1e7f1d3e1b46(cell1) {{(pid=106298) load_cells /opt/stack/nova/nova/context.py:464}} Oct 04 20:22:50.058938 n-d-854823-8 devstack@n-api.service[106299]: DEBUG oslo_concurrency.lockutils [None req-7ae1f98d-5102-467d-a3e0-48030cc26ac1 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:22:50.059422 n-d-854823-8 devstack@n-api.service[106299]: DEBUG oslo_concurrency.lockutils [None req-7ae1f98d-5102-467d-a3e0-48030cc26ac1 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:22:50.060998 n-d-854823-8 devstack@n-api.service[106299]: DEBUG oslo_concurrency.lockutils [None req-7ae1f98d-5102-467d-a3e0-48030cc26ac1 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:22:50.061098 n-d-854823-8 devstack@n-api.service[106298]: DEBUG oslo_concurrency.lockutils [None req-76c64e5e-6e6e-4cf0-bfbb-d537c8843146 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:22:50.061479 n-d-854823-8 devstack@n-api.service[106298]: DEBUG oslo_concurrency.lockutils [None req-76c64e5e-6e6e-4cf0-bfbb-d537c8843146 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:22:50.061708 n-d-854823-8 devstack@n-api.service[106299]: DEBUG oslo_concurrency.lockutils [None req-7ae1f98d-5102-467d-a3e0-48030cc26ac1 None None] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:22:50.062148 n-d-854823-8 devstack@n-api.service[106299]: DEBUG oslo_concurrency.lockutils [None req-7ae1f98d-5102-467d-a3e0-48030cc26ac1 None None] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:22:50.063084 n-d-854823-8 devstack@n-api.service[106298]: DEBUG oslo_concurrency.lockutils [None req-76c64e5e-6e6e-4cf0-bfbb-d537c8843146 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:22:50.063790 n-d-854823-8 devstack@n-api.service[106298]: DEBUG oslo_concurrency.lockutils [None req-76c64e5e-6e6e-4cf0-bfbb-d537c8843146 None None] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:22:50.064137 n-d-854823-8 devstack@n-api.service[106299]: DEBUG oslo_concurrency.lockutils [None req-7ae1f98d-5102-467d-a3e0-48030cc26ac1 None None] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:22:50.064242 n-d-854823-8 devstack@n-api.service[106298]: DEBUG oslo_concurrency.lockutils [None req-76c64e5e-6e6e-4cf0-bfbb-d537c8843146 None None] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:22:50.066108 n-d-854823-8 devstack@n-api.service[106299]: INFO dbcounter [None req-7ae1f98d-5102-467d-a3e0-48030cc26ac1 None None] Registered counter for database nova_cell0 Oct 04 20:22:50.066207 n-d-854823-8 devstack@n-api.service[106298]: DEBUG oslo_concurrency.lockutils [None req-76c64e5e-6e6e-4cf0-bfbb-d537c8843146 None None] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:22:50.068139 n-d-854823-8 devstack@n-api.service[106298]: INFO dbcounter [None req-76c64e5e-6e6e-4cf0-bfbb-d537c8843146 None None] Registered counter for database nova_cell0 Oct 04 20:22:50.070138 n-d-854823-8 devstack@n-api.service[106299]: INFO dbcounter [None req-7ae1f98d-5102-467d-a3e0-48030cc26ac1 None None] Registered counter for database nova_cell1 Oct 04 20:22:50.072072 n-d-854823-8 devstack@n-api.service[106298]: INFO dbcounter [None req-76c64e5e-6e6e-4cf0-bfbb-d537c8843146 None None] Registered counter for database nova_cell1 Oct 04 20:22:50.077644 n-d-854823-8 devstack@n-api.service[106299]: DEBUG oslo_db.sqlalchemy.engines [None req-7ae1f98d-5102-467d-a3e0-48030cc26ac1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106299) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 20:22:50.078921 n-d-854823-8 devstack@n-api.service[106299]: DEBUG oslo_db.sqlalchemy.engines [None req-7ae1f98d-5102-467d-a3e0-48030cc26ac1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106299) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 20:22:50.080711 n-d-854823-8 devstack@n-api.service[106298]: DEBUG oslo_db.sqlalchemy.engines [None req-76c64e5e-6e6e-4cf0-bfbb-d537c8843146 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106298) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 20:22:50.084262 n-d-854823-8 devstack@n-api.service[106298]: DEBUG oslo_db.sqlalchemy.engines [None req-76c64e5e-6e6e-4cf0-bfbb-d537c8843146 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106298) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 20:22:50.086923 n-d-854823-8 devstack@n-api.service[106299]: DEBUG dbcounter [-] [106299] Writer thread running {{(pid=106299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 20:22:50.087422 n-d-854823-8 devstack@n-api.service[106298]: DEBUG dbcounter [-] [106298] Writer thread running {{(pid=106298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 20:22:50.088521 n-d-854823-8 devstack@n-api.service[106299]: DEBUG dbcounter [-] [106299] Writer thread running {{(pid=106299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 20:22:50.230727 n-d-854823-8 devstack@n-api.service[106298]: DEBUG dbcounter [-] [106298] Writer thread running {{(pid=106298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 20:22:50.241020 n-d-854823-8 devstack@n-api.service[106298]: INFO dbcounter [None req-76c64e5e-6e6e-4cf0-bfbb-d537c8843146 None None] Registered counter for database nova_cell0 Oct 04 20:22:50.241957 n-d-854823-8 devstack@n-api.service[106299]: INFO dbcounter [None req-7ae1f98d-5102-467d-a3e0-48030cc26ac1 None None] Registered counter for database nova_cell0 Oct 04 20:22:50.248091 n-d-854823-8 devstack@n-api.service[106298]: DEBUG oslo_db.sqlalchemy.engines [None req-76c64e5e-6e6e-4cf0-bfbb-d537c8843146 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106298) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 20:22:50.251625 n-d-854823-8 devstack@n-api.service[106299]: DEBUG oslo_db.sqlalchemy.engines [None req-7ae1f98d-5102-467d-a3e0-48030cc26ac1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106299) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 20:22:50.252504 n-d-854823-8 devstack@n-api.service[106298]: DEBUG dbcounter [-] [106298] Writer thread running {{(pid=106298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 20:22:50.256107 n-d-854823-8 devstack@n-api.service[106299]: DEBUG dbcounter [-] [106299] Writer thread running {{(pid=106299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 20:22:50.588610 n-d-854823-8 devstack@n-api.service[106298]: WARNING keystonemiddleware.auth_token [None req-76c64e5e-6e6e-4cf0-bfbb-d537c8843146 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 04 20:22:50.595947 n-d-854823-8 devstack@n-api.service[106298]: WARNING keystonemiddleware.auth_token [None req-76c64e5e-6e6e-4cf0-bfbb-d537c8843146 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 04 20:22:50.596801 n-d-854823-8 devstack@n-api.service[106299]: WARNING keystonemiddleware.auth_token [None req-7ae1f98d-5102-467d-a3e0-48030cc26ac1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 04 20:22:50.604326 n-d-854823-8 devstack@n-api.service[106299]: WARNING keystonemiddleware.auth_token [None req-7ae1f98d-5102-467d-a3e0-48030cc26ac1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 04 20:22:50.938353 n-d-854823-8 devstack@n-api.service[106298]: WARNING keystonemiddleware.auth_token [None req-76c64e5e-6e6e-4cf0-bfbb-d537c8843146 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 04 20:22:50.944305 n-d-854823-8 devstack@n-api.service[106298]: WARNING keystonemiddleware.auth_token [None req-76c64e5e-6e6e-4cf0-bfbb-d537c8843146 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 04 20:22:50.948483 n-d-854823-8 devstack@n-api.service[106299]: WARNING keystonemiddleware.auth_token [None req-7ae1f98d-5102-467d-a3e0-48030cc26ac1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 04 20:22:50.949564 n-d-854823-8 devstack@n-api.service[106298]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x561110bd39c0 pid: 106298 (default app) Oct 04 20:22:50.951633 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi [None req-76c64e5e-6e6e-4cf0-bfbb-d537c8843146 None None] Calling method '>' {{(pid=106298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:22:50.952807 n-d-854823-8 devstack@n-api.service[106298]: INFO nova.api.openstack.requestlog [None req-76c64e5e-6e6e-4cf0-bfbb-d537c8843146 None None] 10.222.0.33 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001705 Oct 04 20:22:50.953492 n-d-854823-8 devstack@n-api.service[106298]: [pid: 106298|app: 0|req: 1/1] 10.222.0.33 () {50 vars in 788 bytes} [Tue Oct 4 20:22:50 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:22:50.954462 n-d-854823-8 devstack@n-api.service[106299]: WARNING keystonemiddleware.auth_token [None req-7ae1f98d-5102-467d-a3e0-48030cc26ac1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 04 20:22:50.959677 n-d-854823-8 devstack@n-api.service[106299]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x561110bd39c0 pid: 106299 (default app) Oct 04 20:24:12.864318 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi [None req-76c64e5e-6e6e-4cf0-bfbb-d537c8843146 None None] Calling method '>' {{(pid=106298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:24:12.865334 n-d-854823-8 devstack@n-api.service[106298]: INFO nova.api.openstack.requestlog [None req-76c64e5e-6e6e-4cf0-bfbb-d537c8843146 None None] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 Oct 04 20:24:12.865740 n-d-854823-8 devstack@n-api.service[106298]: [pid: 106298|app: 0|req: 2/2] 10.222.0.33 () {54 vars in 931 bytes} [Tue Oct 4 20:24:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:24:12.879257 n-d-854823-8 devstack@n-api.service[106299]: DEBUG dbcounter [-] [106299] Writing DB stats nova_api:SELECT=3 {{(pid=106299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:24:12.880280 n-d-854823-8 devstack@n-api.service[106299]: DEBUG dbcounter [-] [106299] Writing DB stats nova_cell1:SELECT=3 {{(pid=106299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:24:12.881210 n-d-854823-8 devstack@n-api.service[106299]: DEBUG dbcounter [-] [106299] Writing DB stats nova_cell0:SELECT=3 {{(pid=106299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:24:12.882657 n-d-854823-8 devstack@n-api.service[106299]: DEBUG dbcounter [-] [106299] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=106299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:24:13.756441 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi [None req-1c5b5389-1b4b-4939-8c86-dc412f87a196 admin admin] Calling method '>' {{(pid=106299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:24:13.789689 n-d-854823-8 devstack@n-api.service[106299]: INFO nova.api.openstack.requestlog [None req-1c5b5389-1b4b-4939-8c86-dc412f87a196 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.916646 Oct 04 20:24:13.790672 n-d-854823-8 devstack@n-api.service[106299]: [pid: 106299|app: 0|req: 1/3] 10.222.0.33 () {60 vars in 1292 bytes} [Tue Oct 4 20:24:12 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:24:16.416228 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi [None req-76c64e5e-6e6e-4cf0-bfbb-d537c8843146 None None] Calling method '>' {{(pid=106298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:24:16.417229 n-d-854823-8 devstack@n-api.service[106298]: INFO nova.api.openstack.requestlog [None req-76c64e5e-6e6e-4cf0-bfbb-d537c8843146 None None] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001405 Oct 04 20:24:16.417898 n-d-854823-8 devstack@n-api.service[106298]: [pid: 106298|app: 0|req: 3/4] 10.222.0.33 () {54 vars in 931 bytes} [Tue Oct 4 20:24:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:24:16.895546 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi [None req-926fc2ce-bc7c-49c9-b24f-25a9b748a76f admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "os-flavor-access:is_public": true, "name": "cirros256", "ram": 256, "disk": 1, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "id": "c1"}} {{(pid=106299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:24:16.949584 n-d-854823-8 devstack@n-api.service[106299]: INFO nova.api.openstack.requestlog [None req-926fc2ce-bc7c-49c9-b24f-25a9b748a76f admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.525629 Oct 04 20:24:16.950146 n-d-854823-8 devstack@n-api.service[106299]: [pid: 106299|app: 0|req: 2/5] 10.222.0.33 () {64 vars in 1283 bytes} [Tue Oct 4 20:24:16 2022] POST /compute/v2.1/flavors => generated 407 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 20:24:17.172451 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi [None req-52eda264-68ff-42ca-97c2-0ee7ac04331c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:24:17.179094 n-d-854823-8 devstack@n-api.service[106298]: DEBUG dbcounter [-] [106298] Writing DB stats nova_api:SELECT=3 {{(pid=106298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:24:17.180118 n-d-854823-8 devstack@n-api.service[106298]: DEBUG dbcounter [-] [106298] Writing DB stats nova_cell0:SELECT=3 {{(pid=106298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:24:17.181087 n-d-854823-8 devstack@n-api.service[106298]: DEBUG dbcounter [-] [106298] Writing DB stats nova_cell1:SELECT=3 {{(pid=106298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:24:17.181794 n-d-854823-8 devstack@n-api.service[106298]: DEBUG dbcounter [-] [106298] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=106298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:24:17.248091 n-d-854823-8 devstack@n-api.service[106298]: INFO nova.api.openstack.requestlog [None req-52eda264-68ff-42ca-97c2-0ee7ac04331c admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.289671 Oct 04 20:24:17.248882 n-d-854823-8 devstack@n-api.service[106298]: [pid: 106298|app: 0|req: 4/6] 10.222.0.33 () {64 vars in 1336 bytes} [Tue Oct 4 20:24:16 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:24:19.915378 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi [None req-926fc2ce-bc7c-49c9-b24f-25a9b748a76f admin admin] Calling method '>' {{(pid=106299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:24:19.916530 n-d-854823-8 devstack@n-api.service[106299]: INFO nova.api.openstack.requestlog [None req-926fc2ce-bc7c-49c9-b24f-25a9b748a76f admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001492 Oct 04 20:24:19.916905 n-d-854823-8 devstack@n-api.service[106299]: [pid: 106299|app: 0|req: 3/7] 10.222.0.33 () {54 vars in 931 bytes} [Tue Oct 4 20:24:19 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:24:20.763196 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi [None req-55b0b419-1f14-4edf-bea8-7a736a6cee1f admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "name": "ds512M", "ram": 512, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "d1", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "disk": 5}} {{(pid=106298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:24:20.816699 n-d-854823-8 devstack@n-api.service[106298]: INFO nova.api.openstack.requestlog [None req-55b0b419-1f14-4edf-bea8-7a736a6cee1f admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.892941 Oct 04 20:24:20.822810 n-d-854823-8 devstack@n-api.service[106298]: [pid: 106298|app: 0|req: 5/8] 10.222.0.33 () {64 vars in 1283 bytes} [Tue Oct 4 20:24:19 2022] POST /compute/v2.1/flavors => generated 404 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 04 20:24:20.832028 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi [None req-4f4f688c-8692-4f26-b475-f3158fa35683 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:24:20.882789 n-d-854823-8 devstack@n-api.service[106299]: INFO nova.api.openstack.requestlog [None req-4f4f688c-8692-4f26-b475-f3158fa35683 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.055093 Oct 04 20:24:20.884048 n-d-854823-8 devstack@n-api.service[106299]: [pid: 106299|app: 0|req: 4/9] 10.222.0.33 () {64 vars in 1336 bytes} [Tue Oct 4 20:24:20 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:24:23.649774 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi [None req-55b0b419-1f14-4edf-bea8-7a736a6cee1f admin admin] Calling method '>' {{(pid=106298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:24:23.650907 n-d-854823-8 devstack@n-api.service[106298]: INFO nova.api.openstack.requestlog [None req-55b0b419-1f14-4edf-bea8-7a736a6cee1f admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001502 Oct 04 20:24:23.656256 n-d-854823-8 devstack@n-api.service[106298]: [pid: 106298|app: 0|req: 6/10] 10.222.0.33 () {54 vars in 931 bytes} [Tue Oct 4 20:24:23 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:24:24.219861 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi [None req-f4bdbed2-0f08-4bb1-ad8b-d9cd4ba836b9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "id": "d2", "swap": 0, "disk": 10, "ram": 1024, "name": "ds1G", "rxtx_factor": 1.0, "vcpus": 1}} {{(pid=106299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:24:24.241089 n-d-854823-8 devstack@n-api.service[106299]: INFO nova.api.openstack.requestlog [None req-f4bdbed2-0f08-4bb1-ad8b-d9cd4ba836b9 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.583499 Oct 04 20:24:24.246817 n-d-854823-8 devstack@n-api.service[106299]: [pid: 106299|app: 0|req: 5/11] 10.222.0.33 () {64 vars in 1283 bytes} [Tue Oct 4 20:24:23 2022] POST /compute/v2.1/flavors => generated 404 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 20:24:24.254165 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi [None req-bb6294a9-f6a7-46f9-8efd-323570234751 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:24:24.282005 n-d-854823-8 devstack@n-api.service[106298]: INFO nova.api.openstack.requestlog [None req-bb6294a9-f6a7-46f9-8efd-323570234751 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031473 Oct 04 20:24:24.282801 n-d-854823-8 devstack@n-api.service[106298]: [pid: 106298|app: 0|req: 7/12] 10.222.0.33 () {64 vars in 1336 bytes} [Tue Oct 4 20:24:24 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:24:26.936379 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi [None req-f4bdbed2-0f08-4bb1-ad8b-d9cd4ba836b9 admin admin] Calling method '>' {{(pid=106299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:24:26.937987 n-d-854823-8 devstack@n-api.service[106299]: INFO nova.api.openstack.requestlog [None req-f4bdbed2-0f08-4bb1-ad8b-d9cd4ba836b9 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002116 Oct 04 20:24:26.938424 n-d-854823-8 devstack@n-api.service[106299]: [pid: 106299|app: 0|req: 6/13] 10.222.0.33 () {54 vars in 931 bytes} [Tue Oct 4 20:24:26 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:24:27.389878 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi [None req-3b2a6429-5172-4576-94bf-56a083b41a2e admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d3", "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds2G", "ram": 2048, "rxtx_factor": 1.0, "swap": 0, "os-flavor-access:is_public": true, "vcpus": 2, "disk": 10}} {{(pid=106298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:24:27.411925 n-d-854823-8 devstack@n-api.service[106298]: INFO nova.api.openstack.requestlog [None req-3b2a6429-5172-4576-94bf-56a083b41a2e admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.466720 Oct 04 20:24:27.414826 n-d-854823-8 devstack@n-api.service[106298]: [pid: 106298|app: 0|req: 8/14] 10.222.0.33 () {64 vars in 1283 bytes} [Tue Oct 4 20:24:26 2022] POST /compute/v2.1/flavors => generated 404 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 20:24:27.425228 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi [None req-0a988ddf-7f25-41e8-bc64-3cc0a0753e5d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:24:27.459891 n-d-854823-8 devstack@n-api.service[106299]: INFO nova.api.openstack.requestlog [None req-0a988ddf-7f25-41e8-bc64-3cc0a0753e5d admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.038704 Oct 04 20:24:27.461475 n-d-854823-8 devstack@n-api.service[106299]: [pid: 106299|app: 0|req: 7/15] 10.222.0.33 () {64 vars in 1336 bytes} [Tue Oct 4 20:24:27 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:24:30.177867 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi [None req-3b2a6429-5172-4576-94bf-56a083b41a2e admin admin] Calling method '>' {{(pid=106298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:24:30.179002 n-d-854823-8 devstack@n-api.service[106298]: INFO nova.api.openstack.requestlog [None req-3b2a6429-5172-4576-94bf-56a083b41a2e admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001489 Oct 04 20:24:30.179423 n-d-854823-8 devstack@n-api.service[106298]: [pid: 106298|app: 0|req: 9/16] 10.222.0.33 () {54 vars in 931 bytes} [Tue Oct 4 20:24:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:24:30.645020 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi [None req-51990879-9253-475c-8c8a-4dacdb19b312 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "name": "ds4G", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 20, "swap": 0, "id": "d4"}} {{(pid=106299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:24:30.669342 n-d-854823-8 devstack@n-api.service[106299]: INFO nova.api.openstack.requestlog [None req-51990879-9253-475c-8c8a-4dacdb19b312 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.483505 Oct 04 20:24:30.678474 n-d-854823-8 devstack@n-api.service[106299]: [pid: 106299|app: 0|req: 8/17] 10.222.0.33 () {64 vars in 1283 bytes} [Tue Oct 4 20:24:30 2022] POST /compute/v2.1/flavors => generated 404 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 20:24:30.682262 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi [None req-e88a24a3-265e-4a66-88f9-0c26d2e7b819 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:24:30.719519 n-d-854823-8 devstack@n-api.service[106298]: INFO nova.api.openstack.requestlog [None req-e88a24a3-265e-4a66-88f9-0c26d2e7b819 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.040575 Oct 04 20:24:30.720715 n-d-854823-8 devstack@n-api.service[106298]: [pid: 106298|app: 0|req: 10/18] 10.222.0.33 () {64 vars in 1336 bytes} [Tue Oct 4 20:24:30 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:24:33.380980 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi [None req-51990879-9253-475c-8c8a-4dacdb19b312 admin admin] Calling method '>' {{(pid=106299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:24:33.382663 n-d-854823-8 devstack@n-api.service[106299]: INFO nova.api.openstack.requestlog [None req-51990879-9253-475c-8c8a-4dacdb19b312 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001435 Oct 04 20:24:33.383442 n-d-854823-8 devstack@n-api.service[106299]: [pid: 106299|app: 0|req: 9/19] 10.222.0.33 () {54 vars in 931 bytes} [Tue Oct 4 20:24:33 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:24:33.861546 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi [None req-0572adf6-9f66-4169-b27c-2e5fe1d95628 admin admin] Calling method '>' {{(pid=106298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:24:33.887031 n-d-854823-8 devstack@n-api.service[106298]: INFO nova.api.openstack.requestlog [None req-0572adf6-9f66-4169-b27c-2e5fe1d95628 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.497543 Oct 04 20:24:33.887574 n-d-854823-8 devstack@n-api.service[106298]: [pid: 106298|app: 0|req: 11/20] 10.222.0.33 () {60 vars in 1292 bytes} [Tue Oct 4 20:24:33 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:24:37.197433 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi [None req-51990879-9253-475c-8c8a-4dacdb19b312 admin admin] Calling method '>' {{(pid=106299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:24:37.198506 n-d-854823-8 devstack@n-api.service[106299]: INFO nova.api.openstack.requestlog [None req-51990879-9253-475c-8c8a-4dacdb19b312 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001597 Oct 04 20:24:37.198906 n-d-854823-8 devstack@n-api.service[106299]: [pid: 106299|app: 0|req: 10/21] 10.222.0.33 () {54 vars in 931 bytes} [Tue Oct 4 20:24:37 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:24:37.634115 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi [None req-3956832d-c572-4a89-86e4-03f9d5de895b admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "name": "m1.tiny", "ram": 512, "os-flavor-access:is_public": true, "id": "1", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "rxtx_factor": 1.0, "disk": 1}} {{(pid=106298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:24:37.656349 n-d-854823-8 devstack@n-api.service[106298]: INFO nova.api.openstack.requestlog [None req-3956832d-c572-4a89-86e4-03f9d5de895b admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.450100 Oct 04 20:24:37.656905 n-d-854823-8 devstack@n-api.service[106298]: [pid: 106298|app: 0|req: 12/22] 10.222.0.33 () {64 vars in 1283 bytes} [Tue Oct 4 20:24:37 2022] POST /compute/v2.1/flavors => generated 402 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 20:24:37.668795 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi [None req-765fa8fd-3e57-4d27-83ca-6f53b2a466a3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:24:37.699488 n-d-854823-8 devstack@n-api.service[106299]: INFO nova.api.openstack.requestlog [None req-765fa8fd-3e57-4d27-83ca-6f53b2a466a3 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034082 Oct 04 20:24:37.700384 n-d-854823-8 devstack@n-api.service[106299]: [pid: 106299|app: 0|req: 11/23] 10.222.0.33 () {64 vars in 1333 bytes} [Tue Oct 4 20:24:37 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:24:40.343010 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi [None req-3956832d-c572-4a89-86e4-03f9d5de895b admin admin] Calling method '>' {{(pid=106298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:24:40.344132 n-d-854823-8 devstack@n-api.service[106298]: INFO nova.api.openstack.requestlog [None req-3956832d-c572-4a89-86e4-03f9d5de895b admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001789 Oct 04 20:24:40.344620 n-d-854823-8 devstack@n-api.service[106298]: [pid: 106298|app: 0|req: 13/24] 10.222.0.33 () {54 vars in 931 bytes} [Tue Oct 4 20:24:40 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:24:40.751351 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi [None req-01719b31-e50a-4386-863d-ace2b95372ff admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "id": "2", "os-flavor-access:is_public": true, "name": "m1.small", "disk": 20, "ram": 2048, "vcpus": 1, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=106299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:24:40.770694 n-d-854823-8 devstack@n-api.service[106299]: INFO nova.api.openstack.requestlog [None req-01719b31-e50a-4386-863d-ace2b95372ff admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.417844 Oct 04 20:24:40.771256 n-d-854823-8 devstack@n-api.service[106299]: [pid: 106299|app: 0|req: 12/25] 10.222.0.33 () {64 vars in 1283 bytes} [Tue Oct 4 20:24:40 2022] POST /compute/v2.1/flavors => generated 405 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 20:24:40.788397 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi [None req-783f3584-d915-4728-9842-309903a8cc43 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:24:40.820297 n-d-854823-8 devstack@n-api.service[106298]: INFO nova.api.openstack.requestlog [None req-783f3584-d915-4728-9842-309903a8cc43 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.039452 Oct 04 20:24:40.820891 n-d-854823-8 devstack@n-api.service[106298]: [pid: 106298|app: 0|req: 14/26] 10.222.0.33 () {64 vars in 1333 bytes} [Tue Oct 4 20:24:40 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:24:43.430366 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi [None req-01719b31-e50a-4386-863d-ace2b95372ff admin admin] Calling method '>' {{(pid=106299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:24:43.431378 n-d-854823-8 devstack@n-api.service[106299]: INFO nova.api.openstack.requestlog [None req-01719b31-e50a-4386-863d-ace2b95372ff admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Oct 04 20:24:43.431776 n-d-854823-8 devstack@n-api.service[106299]: [pid: 106299|app: 0|req: 13/27] 10.222.0.33 () {54 vars in 931 bytes} [Tue Oct 4 20:24:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:24:43.824727 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi [None req-35abbd36-f155-4e8b-8e92-b0ccaf4c7dcf admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.medium", "id": "3", "os-flavor-access:is_public": true, "disk": 40, "rxtx_factor": 1.0, "swap": 0}} {{(pid=106298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:24:43.845264 n-d-854823-8 devstack@n-api.service[106298]: INFO nova.api.openstack.requestlog [None req-35abbd36-f155-4e8b-8e92-b0ccaf4c7dcf admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.407447 Oct 04 20:24:43.845905 n-d-854823-8 devstack@n-api.service[106298]: [pid: 106298|app: 0|req: 15/28] 10.222.0.33 () {64 vars in 1283 bytes} [Tue Oct 4 20:24:43 2022] POST /compute/v2.1/flavors => generated 406 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 20:24:43.857945 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi [None req-fbd0f480-b407-4712-8034-11aec0615a61 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:24:43.862995 n-d-854823-8 devstack@n-api.service[106299]: DEBUG dbcounter [-] [106299] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=106299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:24:43.889741 n-d-854823-8 devstack@n-api.service[106299]: INFO nova.api.openstack.requestlog [None req-fbd0f480-b407-4712-8034-11aec0615a61 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035529 Oct 04 20:24:43.890353 n-d-854823-8 devstack@n-api.service[106299]: [pid: 106299|app: 0|req: 14/29] 10.222.0.33 () {64 vars in 1333 bytes} [Tue Oct 4 20:24:43 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:24:46.535182 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi [None req-35abbd36-f155-4e8b-8e92-b0ccaf4c7dcf admin admin] Calling method '>' {{(pid=106298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:24:46.536237 n-d-854823-8 devstack@n-api.service[106298]: INFO nova.api.openstack.requestlog [None req-35abbd36-f155-4e8b-8e92-b0ccaf4c7dcf admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001531 Oct 04 20:24:46.536649 n-d-854823-8 devstack@n-api.service[106298]: [pid: 106298|app: 0|req: 16/30] 10.222.0.33 () {54 vars in 931 bytes} [Tue Oct 4 20:24:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:24:46.981087 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi [None req-ab6b21e0-f105-4799-ad4d-6f031c358a62 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "disk": 80, "ram": 8192, "os-flavor-access:is_public": true, "swap": 0, "id": "4", "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.large"}} {{(pid=106299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:24:47.000449 n-d-854823-8 devstack@n-api.service[106299]: INFO nova.api.openstack.requestlog [None req-ab6b21e0-f105-4799-ad4d-6f031c358a62 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.457650 Oct 04 20:24:47.008807 n-d-854823-8 devstack@n-api.service[106299]: [pid: 106299|app: 0|req: 15/31] 10.222.0.33 () {64 vars in 1283 bytes} [Tue Oct 4 20:24:46 2022] POST /compute/v2.1/flavors => generated 405 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 20:24:47.013156 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi [None req-d9baf763-8cfb-40c2-8fd0-b2c34b65c858 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:24:47.044972 n-d-854823-8 devstack@n-api.service[106298]: INFO nova.api.openstack.requestlog [None req-d9baf763-8cfb-40c2-8fd0-b2c34b65c858 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035385 Oct 04 20:24:47.045839 n-d-854823-8 devstack@n-api.service[106298]: [pid: 106298|app: 0|req: 17/32] 10.222.0.33 () {64 vars in 1333 bytes} [Tue Oct 4 20:24:47 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:24:49.678591 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi [None req-ab6b21e0-f105-4799-ad4d-6f031c358a62 admin admin] Calling method '>' {{(pid=106299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:24:49.679613 n-d-854823-8 devstack@n-api.service[106299]: INFO nova.api.openstack.requestlog [None req-ab6b21e0-f105-4799-ad4d-6f031c358a62 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002107 Oct 04 20:24:49.680291 n-d-854823-8 devstack@n-api.service[106299]: [pid: 106299|app: 0|req: 16/33] 10.222.0.33 () {54 vars in 931 bytes} [Tue Oct 4 20:24:49 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:24:50.167735 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi [None req-59715905-4c0c-4e70-bc83-9856e1d95744 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.xlarge", "swap": 0, "os-flavor-access:is_public": true, "ram": 16384, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 8, "disk": 160, "id": "5"}} {{(pid=106298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:24:50.181032 n-d-854823-8 devstack@n-api.service[106298]: DEBUG dbcounter [-] [106298] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=106298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:24:50.225372 n-d-854823-8 devstack@n-api.service[106298]: INFO nova.api.openstack.requestlog [None req-59715905-4c0c-4e70-bc83-9856e1d95744 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.538718 Oct 04 20:24:50.226761 n-d-854823-8 devstack@n-api.service[106298]: [pid: 106298|app: 0|req: 18/34] 10.222.0.33 () {64 vars in 1283 bytes} [Tue Oct 4 20:24:49 2022] POST /compute/v2.1/flavors => generated 408 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 20:24:50.241267 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi [None req-714b7fc8-6ebd-4de6-ae30-73eb088c33e7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:24:50.265694 n-d-854823-8 devstack@n-api.service[106299]: INFO nova.api.openstack.requestlog [None req-714b7fc8-6ebd-4de6-ae30-73eb088c33e7 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028508 Oct 04 20:24:50.266481 n-d-854823-8 devstack@n-api.service[106299]: [pid: 106299|app: 0|req: 17/35] 10.222.0.33 () {64 vars in 1333 bytes} [Tue Oct 4 20:24:50 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:25:11.980480 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi [None req-59715905-4c0c-4e70-bc83-9856e1d95744 admin admin] Calling method '>' {{(pid=106298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:25:11.981792 n-d-854823-8 devstack@n-api.service[106298]: INFO nova.api.openstack.requestlog [None req-59715905-4c0c-4e70-bc83-9856e1d95744 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001786 Oct 04 20:25:11.982235 n-d-854823-8 devstack@n-api.service[106298]: [pid: 106298|app: 0|req: 19/36] 10.222.0.33 () {54 vars in 931 bytes} [Tue Oct 4 20:25:11 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:25:11.993033 n-d-854823-8 devstack@n-api.service[106299]: DEBUG dbcounter [-] [106299] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=106299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:25:12.375838 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi [None req-e63fdfed-c565-4aeb-9107-c0b5f49cfeb3 admin admin] Calling method '>' {{(pid=106299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:25:12.394129 n-d-854823-8 devstack@n-api.service[106299]: INFO nova.api.openstack.requestlog [None req-e63fdfed-c565-4aeb-9107-c0b5f49cfeb3 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.405545 Oct 04 20:25:12.394947 n-d-854823-8 devstack@n-api.service[106299]: [pid: 106299|app: 0|req: 18/37] 10.222.0.33 () {60 vars in 1292 bytes} [Tue Oct 4 20:25:11 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:25:13.725608 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi [None req-59715905-4c0c-4e70-bc83-9856e1d95744 admin admin] Calling method '>' {{(pid=106298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:25:13.726724 n-d-854823-8 devstack@n-api.service[106298]: INFO nova.api.openstack.requestlog [None req-59715905-4c0c-4e70-bc83-9856e1d95744 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001428 Oct 04 20:25:13.727131 n-d-854823-8 devstack@n-api.service[106298]: [pid: 106298|app: 0|req: 20/38] 10.222.0.33 () {56 vars in 1074 bytes} [Tue Oct 4 20:25:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:25:14.257729 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi [None req-095baee0-f964-496d-90e5-85376950d72c admin admin] Calling method '>' {{(pid=106299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:25:14.263032 n-d-854823-8 devstack@n-api.service[106299]: INFO nova.api.openstack.wsgi [None req-095baee0-f964-496d-90e5-85376950d72c admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 04 20:25:14.266231 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi [None req-095baee0-f964-496d-90e5-85376950d72c admin admin] Request method failure captured: Oct 04 20:25:14.266231 n-d-854823-8 devstack@n-api.service[106299]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 04 20:25:14.266231 n-d-854823-8 devstack@n-api.service[106299]: Accept: application/json Oct 04 20:25:14.266231 n-d-854823-8 devstack@n-api.service[106299]: Accept-Encoding: gzip, deflate Oct 04 20:25:14.266231 n-d-854823-8 devstack@n-api.service[106299]: Connection: keep-alive Oct 04 20:25:14.266231 n-d-854823-8 devstack@n-api.service[106299]: Content-Length: 0 Oct 04 20:25:14.266231 n-d-854823-8 devstack@n-api.service[106299]: Host: 10.222.0.33 Oct 04 20:25:14.266231 n-d-854823-8 devstack@n-api.service[106299]: Openstack-Api-Version: compute 2.92 Oct 04 20:25:14.266231 n-d-854823-8 devstack@n-api.service[106299]: Openstack-System-Scope: None Oct 04 20:25:14.266231 n-d-854823-8 devstack@n-api.service[106299]: User-Agent: python-novaclient Oct 04 20:25:14.266231 n-d-854823-8 devstack@n-api.service[106299]: X-Auth-Token: gAAAAABjPJap-YaTgRqSeJdAjWCs9YzLVDt7WgVwDI_DqW-_uR1g2_HGHnokvY6RuK4REpR4OFWZmsCw2Im6FyBeFZ5D6Bf2vJfc8z_7DcG8ySZurwRPaG0TmeFXevtU1zim8ZLqlMNWKRUX6jM6ImePkHYJvk6RZdR-n5V-rth3mtHhVdPa16U Oct 04 20:25:14.266231 n-d-854823-8 devstack@n-api.service[106299]: X-Domain-Id: None Oct 04 20:25:14.266231 n-d-854823-8 devstack@n-api.service[106299]: X-Domain-Name: None Oct 04 20:25:14.266231 n-d-854823-8 devstack@n-api.service[106299]: X-Identity-Status: Confirmed Oct 04 20:25:14.266231 n-d-854823-8 devstack@n-api.service[106299]: X-Is-Admin-Project: True Oct 04 20:25:14.266231 n-d-854823-8 devstack@n-api.service[106299]: X-Openstack-Nova-Api-Version: 2.92 Oct 04 20:25:14.266231 n-d-854823-8 devstack@n-api.service[106299]: X-Project-Domain-Id: default Oct 04 20:25:14.266231 n-d-854823-8 devstack@n-api.service[106299]: X-Project-Domain-Name: Default Oct 04 20:25:14.266231 n-d-854823-8 devstack@n-api.service[106299]: X-Project-Id: a8f446f6e7e14a62b5ba7037ccbfaad8 Oct 04 20:25:14.266231 n-d-854823-8 devstack@n-api.service[106299]: X-Project-Name: admin Oct 04 20:25:14.266231 n-d-854823-8 devstack@n-api.service[106299]: X-Role: admin,reader,member Oct 04 20:25:14.266231 n-d-854823-8 devstack@n-api.service[106299]: X-Roles: admin,reader,member Oct 04 20:25:14.267918 n-d-854823-8 devstack@n-api.service[106299]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a8f446f6e7e14a62b5ba7037ccbfaad8", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a8f446f6e7e14a62b5ba7037ccbfaad8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a8f446f6e7e14a62b5ba7037ccbfaad8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a8f446f6e7e14a62b5ba7037ccbfaad8"}]}] Oct 04 20:25:14.267918 n-d-854823-8 devstack@n-api.service[106299]: X-Tenant: admin Oct 04 20:25:14.267918 n-d-854823-8 devstack@n-api.service[106299]: X-Tenant-Id: a8f446f6e7e14a62b5ba7037ccbfaad8 Oct 04 20:25:14.267918 n-d-854823-8 devstack@n-api.service[106299]: X-Tenant-Name: admin Oct 04 20:25:14.267918 n-d-854823-8 devstack@n-api.service[106299]: X-User: admin Oct 04 20:25:14.267918 n-d-854823-8 devstack@n-api.service[106299]: X-User-Domain-Id: default Oct 04 20:25:14.267918 n-d-854823-8 devstack@n-api.service[106299]: X-User-Domain-Name: Default Oct 04 20:25:14.267918 n-d-854823-8 devstack@n-api.service[106299]: X-User-Id: 27ae2d3850d44e749f83eee469d54344 Oct 04 20:25:14.267918 n-d-854823-8 devstack@n-api.service[106299]: X-User-Name: admin Oct 04 20:25:14.267918 n-d-854823-8 devstack@n-api.service[106299]: method: > Oct 04 20:25:14.267918 n-d-854823-8 devstack@n-api.service[106299]: exception: Flavor 42 could not be found. Oct 04 20:25:14.267918 n-d-854823-8 devstack@n-api.service[106299]: action_args: {'id': '42'} Oct 04 20:25:14.267918 n-d-854823-8 devstack@n-api.service[106299]: {{(pid=106299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:25:14.267918 n-d-854823-8 devstack@n-api.service[106299]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:25:14.271216 n-d-854823-8 devstack@n-api.service[106299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 04 20:25:14.271216 n-d-854823-8 devstack@n-api.service[106299]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 04 20:25:14.271216 n-d-854823-8 devstack@n-api.service[106299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 04 20:25:14.271216 n-d-854823-8 devstack@n-api.service[106299]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 04 20:25:14.271216 n-d-854823-8 devstack@n-api.service[106299]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 20:25:14.271216 n-d-854823-8 devstack@n-api.service[106299]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 20:25:14.271216 n-d-854823-8 devstack@n-api.service[106299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 04 20:25:14.271216 n-d-854823-8 devstack@n-api.service[106299]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 04 20:25:14.271216 n-d-854823-8 devstack@n-api.service[106299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 04 20:25:14.271216 n-d-854823-8 devstack@n-api.service[106299]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:25:14.271216 n-d-854823-8 devstack@n-api.service[106299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 04 20:25:14.271216 n-d-854823-8 devstack@n-api.service[106299]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 04 20:25:14.271216 n-d-854823-8 devstack@n-api.service[106299]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 04 20:25:14.271216 n-d-854823-8 devstack@n-api.service[106299]: ERROR nova.api.openstack.wsgi Oct 04 20:25:14.271216 n-d-854823-8 devstack@n-api.service[106299]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:25:14.271216 n-d-854823-8 devstack@n-api.service[106299]: ERROR nova.api.openstack.wsgi Oct 04 20:25:14.271216 n-d-854823-8 devstack@n-api.service[106299]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:25:14.271216 n-d-854823-8 devstack@n-api.service[106299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:25:14.271216 n-d-854823-8 devstack@n-api.service[106299]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:25:14.272519 n-d-854823-8 devstack@n-api.service[106299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:25:14.272519 n-d-854823-8 devstack@n-api.service[106299]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:25:14.272519 n-d-854823-8 devstack@n-api.service[106299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:25:14.272519 n-d-854823-8 devstack@n-api.service[106299]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:25:14.272519 n-d-854823-8 devstack@n-api.service[106299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 04 20:25:14.272519 n-d-854823-8 devstack@n-api.service[106299]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:25:14.272519 n-d-854823-8 devstack@n-api.service[106299]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 04 20:25:14.272519 n-d-854823-8 devstack@n-api.service[106299]: ERROR nova.api.openstack.wsgi Oct 04 20:25:14.272519 n-d-854823-8 devstack@n-api.service[106299]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:25:14.272519 n-d-854823-8 devstack@n-api.service[106299]: ERROR nova.api.openstack.wsgi Oct 04 20:25:14.272519 n-d-854823-8 devstack@n-api.service[106299]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:25:14.272519 n-d-854823-8 devstack@n-api.service[106299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:25:14.272519 n-d-854823-8 devstack@n-api.service[106299]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:25:14.272519 n-d-854823-8 devstack@n-api.service[106299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:25:14.272519 n-d-854823-8 devstack@n-api.service[106299]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:25:14.272519 n-d-854823-8 devstack@n-api.service[106299]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 04 20:25:14.272519 n-d-854823-8 devstack@n-api.service[106299]: ERROR nova.api.openstack.wsgi Oct 04 20:25:14.272519 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi [None req-095baee0-f964-496d-90e5-85376950d72c admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=106299) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:25:14.273562 n-d-854823-8 devstack@n-api.service[106299]: INFO nova.api.openstack.requestlog [None req-095baee0-f964-496d-90e5-85376950d72c admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.393575 Oct 04 20:25:14.273562 n-d-854823-8 devstack@n-api.service[106299]: [pid: 106299|app: 0|req: 19/39] 10.222.0.33 () {60 vars in 1190 bytes} [Tue Oct 4 20:25:13 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 395 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 04 20:25:14.277811 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi [None req-061d3aa8-6b98-44e1-9211-66b1914b4ae5 admin admin] Calling method '>' {{(pid=106298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:25:14.281924 n-d-854823-8 devstack@n-api.service[106298]: DEBUG dbcounter [-] [106298] Writing DB stats nova_api:INSERT=1,nova_api:SELECT=2 {{(pid=106298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:25:14.301504 n-d-854823-8 devstack@n-api.service[106298]: INFO nova.api.openstack.requestlog [None req-061d3aa8-6b98-44e1-9211-66b1914b4ae5 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.027285 Oct 04 20:25:14.302044 n-d-854823-8 devstack@n-api.service[106298]: [pid: 106298|app: 0|req: 21/40] 10.222.0.33 () {60 vars in 1210 bytes} [Tue Oct 4 20:25:14 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:25:14.312663 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi [None req-8433f7de-58f1-4e4b-9a94-f9714250e4b3 admin admin] Calling method '>' {{(pid=106299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:25:14.336193 n-d-854823-8 devstack@n-api.service[106299]: INFO nova.api.openstack.requestlog [None req-8433f7de-58f1-4e4b-9a94-f9714250e4b3 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.028051 Oct 04 20:25:14.336736 n-d-854823-8 devstack@n-api.service[106299]: [pid: 106299|app: 0|req: 20/41] 10.222.0.33 () {60 vars in 1210 bytes} [Tue Oct 4 20:25:14 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:25:14.345990 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi [None req-1733b49b-c75d-431c-be06-39d7ff46764c admin admin] Calling method '>' {{(pid=106298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:25:14.351471 n-d-854823-8 devstack@n-api.service[106298]: INFO nova.api.openstack.wsgi [None req-1733b49b-c75d-431c-be06-39d7ff46764c admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 04 20:25:14.354807 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi [None req-1733b49b-c75d-431c-be06-39d7ff46764c admin admin] Request method failure captured: Oct 04 20:25:14.354807 n-d-854823-8 devstack@n-api.service[106298]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 04 20:25:14.354807 n-d-854823-8 devstack@n-api.service[106298]: Accept: application/json Oct 04 20:25:14.354807 n-d-854823-8 devstack@n-api.service[106298]: Accept-Encoding: gzip, deflate Oct 04 20:25:14.354807 n-d-854823-8 devstack@n-api.service[106298]: Connection: keep-alive Oct 04 20:25:14.354807 n-d-854823-8 devstack@n-api.service[106298]: Content-Length: 0 Oct 04 20:25:14.354807 n-d-854823-8 devstack@n-api.service[106298]: Host: 10.222.0.33 Oct 04 20:25:14.354807 n-d-854823-8 devstack@n-api.service[106298]: Openstack-Api-Version: compute 2.92 Oct 04 20:25:14.354807 n-d-854823-8 devstack@n-api.service[106298]: Openstack-System-Scope: None Oct 04 20:25:14.354807 n-d-854823-8 devstack@n-api.service[106298]: User-Agent: python-novaclient Oct 04 20:25:14.354807 n-d-854823-8 devstack@n-api.service[106298]: X-Auth-Token: gAAAAABjPJap-YaTgRqSeJdAjWCs9YzLVDt7WgVwDI_DqW-_uR1g2_HGHnokvY6RuK4REpR4OFWZmsCw2Im6FyBeFZ5D6Bf2vJfc8z_7DcG8ySZurwRPaG0TmeFXevtU1zim8ZLqlMNWKRUX6jM6ImePkHYJvk6RZdR-n5V-rth3mtHhVdPa16U Oct 04 20:25:14.354807 n-d-854823-8 devstack@n-api.service[106298]: X-Domain-Id: None Oct 04 20:25:14.354807 n-d-854823-8 devstack@n-api.service[106298]: X-Domain-Name: None Oct 04 20:25:14.354807 n-d-854823-8 devstack@n-api.service[106298]: X-Identity-Status: Confirmed Oct 04 20:25:14.354807 n-d-854823-8 devstack@n-api.service[106298]: X-Is-Admin-Project: True Oct 04 20:25:14.354807 n-d-854823-8 devstack@n-api.service[106298]: X-Openstack-Nova-Api-Version: 2.92 Oct 04 20:25:14.354807 n-d-854823-8 devstack@n-api.service[106298]: X-Project-Domain-Id: default Oct 04 20:25:14.354807 n-d-854823-8 devstack@n-api.service[106298]: X-Project-Domain-Name: Default Oct 04 20:25:14.354807 n-d-854823-8 devstack@n-api.service[106298]: X-Project-Id: a8f446f6e7e14a62b5ba7037ccbfaad8 Oct 04 20:25:14.354807 n-d-854823-8 devstack@n-api.service[106298]: X-Project-Name: admin Oct 04 20:25:14.354807 n-d-854823-8 devstack@n-api.service[106298]: X-Role: admin,reader,member Oct 04 20:25:14.354807 n-d-854823-8 devstack@n-api.service[106298]: X-Roles: admin,reader,member Oct 04 20:25:14.356576 n-d-854823-8 devstack@n-api.service[106298]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a8f446f6e7e14a62b5ba7037ccbfaad8", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a8f446f6e7e14a62b5ba7037ccbfaad8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a8f446f6e7e14a62b5ba7037ccbfaad8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a8f446f6e7e14a62b5ba7037ccbfaad8"}]}] Oct 04 20:25:14.356576 n-d-854823-8 devstack@n-api.service[106298]: X-Tenant: admin Oct 04 20:25:14.356576 n-d-854823-8 devstack@n-api.service[106298]: X-Tenant-Id: a8f446f6e7e14a62b5ba7037ccbfaad8 Oct 04 20:25:14.356576 n-d-854823-8 devstack@n-api.service[106298]: X-Tenant-Name: admin Oct 04 20:25:14.356576 n-d-854823-8 devstack@n-api.service[106298]: X-User: admin Oct 04 20:25:14.356576 n-d-854823-8 devstack@n-api.service[106298]: X-User-Domain-Id: default Oct 04 20:25:14.356576 n-d-854823-8 devstack@n-api.service[106298]: X-User-Domain-Name: Default Oct 04 20:25:14.356576 n-d-854823-8 devstack@n-api.service[106298]: X-User-Id: 27ae2d3850d44e749f83eee469d54344 Oct 04 20:25:14.356576 n-d-854823-8 devstack@n-api.service[106298]: X-User-Name: admin Oct 04 20:25:14.356576 n-d-854823-8 devstack@n-api.service[106298]: method: > Oct 04 20:25:14.356576 n-d-854823-8 devstack@n-api.service[106298]: exception: Flavor 42 could not be found. Oct 04 20:25:14.356576 n-d-854823-8 devstack@n-api.service[106298]: action_args: {'id': '42'} Oct 04 20:25:14.356576 n-d-854823-8 devstack@n-api.service[106298]: {{(pid=106298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:25:14.356576 n-d-854823-8 devstack@n-api.service[106298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:25:14.357453 n-d-854823-8 devstack@n-api.service[106298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 04 20:25:14.357453 n-d-854823-8 devstack@n-api.service[106298]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 04 20:25:14.357453 n-d-854823-8 devstack@n-api.service[106298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 04 20:25:14.357453 n-d-854823-8 devstack@n-api.service[106298]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 04 20:25:14.357453 n-d-854823-8 devstack@n-api.service[106298]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 20:25:14.357453 n-d-854823-8 devstack@n-api.service[106298]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 20:25:14.357453 n-d-854823-8 devstack@n-api.service[106298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 04 20:25:14.357453 n-d-854823-8 devstack@n-api.service[106298]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 04 20:25:14.357453 n-d-854823-8 devstack@n-api.service[106298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 04 20:25:14.357453 n-d-854823-8 devstack@n-api.service[106298]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:25:14.357453 n-d-854823-8 devstack@n-api.service[106298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 04 20:25:14.357453 n-d-854823-8 devstack@n-api.service[106298]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 04 20:25:14.357453 n-d-854823-8 devstack@n-api.service[106298]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 04 20:25:14.357453 n-d-854823-8 devstack@n-api.service[106298]: ERROR nova.api.openstack.wsgi Oct 04 20:25:14.357453 n-d-854823-8 devstack@n-api.service[106298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:25:14.357453 n-d-854823-8 devstack@n-api.service[106298]: ERROR nova.api.openstack.wsgi Oct 04 20:25:14.357453 n-d-854823-8 devstack@n-api.service[106298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:25:14.357453 n-d-854823-8 devstack@n-api.service[106298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:25:14.357453 n-d-854823-8 devstack@n-api.service[106298]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:25:14.358507 n-d-854823-8 devstack@n-api.service[106298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:25:14.358507 n-d-854823-8 devstack@n-api.service[106298]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:25:14.358507 n-d-854823-8 devstack@n-api.service[106298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:25:14.358507 n-d-854823-8 devstack@n-api.service[106298]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:25:14.358507 n-d-854823-8 devstack@n-api.service[106298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 04 20:25:14.358507 n-d-854823-8 devstack@n-api.service[106298]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:25:14.358507 n-d-854823-8 devstack@n-api.service[106298]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 04 20:25:14.358507 n-d-854823-8 devstack@n-api.service[106298]: ERROR nova.api.openstack.wsgi Oct 04 20:25:14.358507 n-d-854823-8 devstack@n-api.service[106298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:25:14.358507 n-d-854823-8 devstack@n-api.service[106298]: ERROR nova.api.openstack.wsgi Oct 04 20:25:14.358507 n-d-854823-8 devstack@n-api.service[106298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:25:14.358507 n-d-854823-8 devstack@n-api.service[106298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:25:14.358507 n-d-854823-8 devstack@n-api.service[106298]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:25:14.358507 n-d-854823-8 devstack@n-api.service[106298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:25:14.358507 n-d-854823-8 devstack@n-api.service[106298]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:25:14.358507 n-d-854823-8 devstack@n-api.service[106298]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 04 20:25:14.358507 n-d-854823-8 devstack@n-api.service[106298]: ERROR nova.api.openstack.wsgi Oct 04 20:25:14.358507 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi [None req-1733b49b-c75d-431c-be06-39d7ff46764c admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=106298) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:25:14.359499 n-d-854823-8 devstack@n-api.service[106298]: INFO nova.api.openstack.requestlog [None req-1733b49b-c75d-431c-be06-39d7ff46764c admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.014114 Oct 04 20:25:14.359499 n-d-854823-8 devstack@n-api.service[106298]: [pid: 106298|app: 0|req: 22/42] 10.222.0.33 () {60 vars in 1190 bytes} [Tue Oct 4 20:25:14 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 04 20:25:15.573440 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi [None req-8433f7de-58f1-4e4b-9a94-f9714250e4b3 admin admin] Calling method '>' {{(pid=106299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:25:15.574481 n-d-854823-8 devstack@n-api.service[106299]: INFO nova.api.openstack.requestlog [None req-8433f7de-58f1-4e4b-9a94-f9714250e4b3 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001443 Oct 04 20:25:15.574879 n-d-854823-8 devstack@n-api.service[106299]: [pid: 106299|app: 0|req: 21/43] 10.222.0.33 () {56 vars in 1074 bytes} [Tue Oct 4 20:25:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 20:25:16.227477 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi [None req-5484ca6d-3f89-4e85-b8e9-241b3e1a3cbd admin admin] Calling method '>' {{(pid=106298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:25:16.232614 n-d-854823-8 devstack@n-api.service[106298]: INFO nova.api.openstack.wsgi [None req-5484ca6d-3f89-4e85-b8e9-241b3e1a3cbd admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 04 20:25:16.234124 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi [None req-5484ca6d-3f89-4e85-b8e9-241b3e1a3cbd admin admin] Request method failure captured: Oct 04 20:25:16.234124 n-d-854823-8 devstack@n-api.service[106298]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 04 20:25:16.234124 n-d-854823-8 devstack@n-api.service[106298]: Accept: application/json Oct 04 20:25:16.234124 n-d-854823-8 devstack@n-api.service[106298]: Accept-Encoding: gzip, deflate Oct 04 20:25:16.234124 n-d-854823-8 devstack@n-api.service[106298]: Connection: keep-alive Oct 04 20:25:16.234124 n-d-854823-8 devstack@n-api.service[106298]: Content-Length: 0 Oct 04 20:25:16.234124 n-d-854823-8 devstack@n-api.service[106298]: Host: 10.222.0.33 Oct 04 20:25:16.234124 n-d-854823-8 devstack@n-api.service[106298]: Openstack-Api-Version: compute 2.92 Oct 04 20:25:16.234124 n-d-854823-8 devstack@n-api.service[106298]: Openstack-System-Scope: None Oct 04 20:25:16.234124 n-d-854823-8 devstack@n-api.service[106298]: User-Agent: python-novaclient Oct 04 20:25:16.234124 n-d-854823-8 devstack@n-api.service[106298]: X-Auth-Token: gAAAAABjPJarOPEjEwOmNf-qdgoS2r-AWVQFSXnlzKAm9TlueS1nnsp1RcQux6fqG9F5QRDhUJxBkWxj0SbWCWdMxO9cD2MjpNyb3W4y05Y26StzhV5HkuRffAHKdoJuzobjDUDRrKTfWUwMFjvz7ZSkUYc1_jz0e8AauJ0kUvkxJITKAdiysm0 Oct 04 20:25:16.234124 n-d-854823-8 devstack@n-api.service[106298]: X-Domain-Id: None Oct 04 20:25:16.234124 n-d-854823-8 devstack@n-api.service[106298]: X-Domain-Name: None Oct 04 20:25:16.234124 n-d-854823-8 devstack@n-api.service[106298]: X-Identity-Status: Confirmed Oct 04 20:25:16.234124 n-d-854823-8 devstack@n-api.service[106298]: X-Is-Admin-Project: True Oct 04 20:25:16.234124 n-d-854823-8 devstack@n-api.service[106298]: X-Openstack-Nova-Api-Version: 2.92 Oct 04 20:25:16.234124 n-d-854823-8 devstack@n-api.service[106298]: X-Project-Domain-Id: default Oct 04 20:25:16.234124 n-d-854823-8 devstack@n-api.service[106298]: X-Project-Domain-Name: Default Oct 04 20:25:16.234124 n-d-854823-8 devstack@n-api.service[106298]: X-Project-Id: a8f446f6e7e14a62b5ba7037ccbfaad8 Oct 04 20:25:16.234124 n-d-854823-8 devstack@n-api.service[106298]: X-Project-Name: admin Oct 04 20:25:16.234124 n-d-854823-8 devstack@n-api.service[106298]: X-Role: admin,reader,member Oct 04 20:25:16.234124 n-d-854823-8 devstack@n-api.service[106298]: X-Roles: admin,reader,member Oct 04 20:25:16.235683 n-d-854823-8 devstack@n-api.service[106298]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a8f446f6e7e14a62b5ba7037ccbfaad8", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a8f446f6e7e14a62b5ba7037ccbfaad8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a8f446f6e7e14a62b5ba7037ccbfaad8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a8f446f6e7e14a62b5ba7037ccbfaad8"}]}] Oct 04 20:25:16.235683 n-d-854823-8 devstack@n-api.service[106298]: X-Tenant: admin Oct 04 20:25:16.235683 n-d-854823-8 devstack@n-api.service[106298]: X-Tenant-Id: a8f446f6e7e14a62b5ba7037ccbfaad8 Oct 04 20:25:16.235683 n-d-854823-8 devstack@n-api.service[106298]: X-Tenant-Name: admin Oct 04 20:25:16.235683 n-d-854823-8 devstack@n-api.service[106298]: X-User: admin Oct 04 20:25:16.235683 n-d-854823-8 devstack@n-api.service[106298]: X-User-Domain-Id: default Oct 04 20:25:16.235683 n-d-854823-8 devstack@n-api.service[106298]: X-User-Domain-Name: Default Oct 04 20:25:16.235683 n-d-854823-8 devstack@n-api.service[106298]: X-User-Id: 27ae2d3850d44e749f83eee469d54344 Oct 04 20:25:16.235683 n-d-854823-8 devstack@n-api.service[106298]: X-User-Name: admin Oct 04 20:25:16.235683 n-d-854823-8 devstack@n-api.service[106298]: method: > Oct 04 20:25:16.235683 n-d-854823-8 devstack@n-api.service[106298]: exception: Flavor 84 could not be found. Oct 04 20:25:16.235683 n-d-854823-8 devstack@n-api.service[106298]: action_args: {'id': '84'} Oct 04 20:25:16.235683 n-d-854823-8 devstack@n-api.service[106298]: {{(pid=106298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:25:16.235683 n-d-854823-8 devstack@n-api.service[106298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:25:16.236756 n-d-854823-8 devstack@n-api.service[106298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 04 20:25:16.236756 n-d-854823-8 devstack@n-api.service[106298]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 04 20:25:16.236756 n-d-854823-8 devstack@n-api.service[106298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 04 20:25:16.236756 n-d-854823-8 devstack@n-api.service[106298]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 04 20:25:16.236756 n-d-854823-8 devstack@n-api.service[106298]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 20:25:16.236756 n-d-854823-8 devstack@n-api.service[106298]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 20:25:16.236756 n-d-854823-8 devstack@n-api.service[106298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 04 20:25:16.236756 n-d-854823-8 devstack@n-api.service[106298]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 04 20:25:16.236756 n-d-854823-8 devstack@n-api.service[106298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 04 20:25:16.236756 n-d-854823-8 devstack@n-api.service[106298]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:25:16.236756 n-d-854823-8 devstack@n-api.service[106298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 04 20:25:16.236756 n-d-854823-8 devstack@n-api.service[106298]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 04 20:25:16.236756 n-d-854823-8 devstack@n-api.service[106298]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 04 20:25:16.236756 n-d-854823-8 devstack@n-api.service[106298]: ERROR nova.api.openstack.wsgi Oct 04 20:25:16.236756 n-d-854823-8 devstack@n-api.service[106298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:25:16.236756 n-d-854823-8 devstack@n-api.service[106298]: ERROR nova.api.openstack.wsgi Oct 04 20:25:16.236756 n-d-854823-8 devstack@n-api.service[106298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:25:16.236756 n-d-854823-8 devstack@n-api.service[106298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:25:16.236756 n-d-854823-8 devstack@n-api.service[106298]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:25:16.238072 n-d-854823-8 devstack@n-api.service[106298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:25:16.238072 n-d-854823-8 devstack@n-api.service[106298]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:25:16.238072 n-d-854823-8 devstack@n-api.service[106298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:25:16.238072 n-d-854823-8 devstack@n-api.service[106298]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:25:16.238072 n-d-854823-8 devstack@n-api.service[106298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 04 20:25:16.238072 n-d-854823-8 devstack@n-api.service[106298]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:25:16.238072 n-d-854823-8 devstack@n-api.service[106298]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 04 20:25:16.238072 n-d-854823-8 devstack@n-api.service[106298]: ERROR nova.api.openstack.wsgi Oct 04 20:25:16.238072 n-d-854823-8 devstack@n-api.service[106298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:25:16.238072 n-d-854823-8 devstack@n-api.service[106298]: ERROR nova.api.openstack.wsgi Oct 04 20:25:16.238072 n-d-854823-8 devstack@n-api.service[106298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:25:16.238072 n-d-854823-8 devstack@n-api.service[106298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:25:16.238072 n-d-854823-8 devstack@n-api.service[106298]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:25:16.238072 n-d-854823-8 devstack@n-api.service[106298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:25:16.238072 n-d-854823-8 devstack@n-api.service[106298]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:25:16.238072 n-d-854823-8 devstack@n-api.service[106298]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 04 20:25:16.238072 n-d-854823-8 devstack@n-api.service[106298]: ERROR nova.api.openstack.wsgi Oct 04 20:25:16.238072 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi [None req-5484ca6d-3f89-4e85-b8e9-241b3e1a3cbd admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=106298) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:25:16.239355 n-d-854823-8 devstack@n-api.service[106298]: INFO nova.api.openstack.requestlog [None req-5484ca6d-3f89-4e85-b8e9-241b3e1a3cbd admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.523062 Oct 04 20:25:16.239355 n-d-854823-8 devstack@n-api.service[106298]: [pid: 106298|app: 0|req: 23/44] 10.222.0.33 () {60 vars in 1190 bytes} [Tue Oct 4 20:25:15 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 524 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 04 20:25:16.246255 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi [None req-fdeb348e-52fc-492f-87ab-762a49b6a1bb admin admin] Calling method '>' {{(pid=106299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:25:16.261304 n-d-854823-8 devstack@n-api.service[106299]: INFO nova.api.openstack.requestlog [None req-fdeb348e-52fc-492f-87ab-762a49b6a1bb admin admin] 10.222.0.33 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018691 Oct 04 20:25:16.261830 n-d-854823-8 devstack@n-api.service[106299]: [pid: 106299|app: 0|req: 22/45] 10.222.0.33 () {60 vars in 1210 bytes} [Tue Oct 4 20:25:16 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:25:16.271663 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi [None req-bf1a9298-8fd0-4d29-a440-de49b4ade839 admin admin] Calling method '>' {{(pid=106298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:25:16.287532 n-d-854823-8 devstack@n-api.service[106298]: INFO nova.api.openstack.requestlog [None req-bf1a9298-8fd0-4d29-a440-de49b4ade839 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.020033 Oct 04 20:25:16.288053 n-d-854823-8 devstack@n-api.service[106298]: [pid: 106298|app: 0|req: 24/46] 10.222.0.33 () {60 vars in 1210 bytes} [Tue Oct 4 20:25:16 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:25:16.297165 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi [None req-4dcc1dc1-9b64-4b4b-90b7-e479304a6d18 admin admin] Calling method '>' {{(pid=106299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:25:16.302094 n-d-854823-8 devstack@n-api.service[106299]: INFO nova.api.openstack.wsgi [None req-4dcc1dc1-9b64-4b4b-90b7-e479304a6d18 admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 04 20:25:16.303652 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi [None req-4dcc1dc1-9b64-4b4b-90b7-e479304a6d18 admin admin] Request method failure captured: Oct 04 20:25:16.303652 n-d-854823-8 devstack@n-api.service[106299]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 04 20:25:16.303652 n-d-854823-8 devstack@n-api.service[106299]: Accept: application/json Oct 04 20:25:16.303652 n-d-854823-8 devstack@n-api.service[106299]: Accept-Encoding: gzip, deflate Oct 04 20:25:16.303652 n-d-854823-8 devstack@n-api.service[106299]: Connection: keep-alive Oct 04 20:25:16.303652 n-d-854823-8 devstack@n-api.service[106299]: Content-Length: 0 Oct 04 20:25:16.303652 n-d-854823-8 devstack@n-api.service[106299]: Host: 10.222.0.33 Oct 04 20:25:16.303652 n-d-854823-8 devstack@n-api.service[106299]: Openstack-Api-Version: compute 2.92 Oct 04 20:25:16.303652 n-d-854823-8 devstack@n-api.service[106299]: Openstack-System-Scope: None Oct 04 20:25:16.303652 n-d-854823-8 devstack@n-api.service[106299]: User-Agent: python-novaclient Oct 04 20:25:16.303652 n-d-854823-8 devstack@n-api.service[106299]: X-Auth-Token: gAAAAABjPJarOPEjEwOmNf-qdgoS2r-AWVQFSXnlzKAm9TlueS1nnsp1RcQux6fqG9F5QRDhUJxBkWxj0SbWCWdMxO9cD2MjpNyb3W4y05Y26StzhV5HkuRffAHKdoJuzobjDUDRrKTfWUwMFjvz7ZSkUYc1_jz0e8AauJ0kUvkxJITKAdiysm0 Oct 04 20:25:16.303652 n-d-854823-8 devstack@n-api.service[106299]: X-Domain-Id: None Oct 04 20:25:16.303652 n-d-854823-8 devstack@n-api.service[106299]: X-Domain-Name: None Oct 04 20:25:16.303652 n-d-854823-8 devstack@n-api.service[106299]: X-Identity-Status: Confirmed Oct 04 20:25:16.303652 n-d-854823-8 devstack@n-api.service[106299]: X-Is-Admin-Project: True Oct 04 20:25:16.303652 n-d-854823-8 devstack@n-api.service[106299]: X-Openstack-Nova-Api-Version: 2.92 Oct 04 20:25:16.303652 n-d-854823-8 devstack@n-api.service[106299]: X-Project-Domain-Id: default Oct 04 20:25:16.303652 n-d-854823-8 devstack@n-api.service[106299]: X-Project-Domain-Name: Default Oct 04 20:25:16.303652 n-d-854823-8 devstack@n-api.service[106299]: X-Project-Id: a8f446f6e7e14a62b5ba7037ccbfaad8 Oct 04 20:25:16.303652 n-d-854823-8 devstack@n-api.service[106299]: X-Project-Name: admin Oct 04 20:25:16.303652 n-d-854823-8 devstack@n-api.service[106299]: X-Role: admin,reader,member Oct 04 20:25:16.303652 n-d-854823-8 devstack@n-api.service[106299]: X-Roles: admin,reader,member Oct 04 20:25:16.305165 n-d-854823-8 devstack@n-api.service[106299]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a8f446f6e7e14a62b5ba7037ccbfaad8", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a8f446f6e7e14a62b5ba7037ccbfaad8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a8f446f6e7e14a62b5ba7037ccbfaad8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a8f446f6e7e14a62b5ba7037ccbfaad8"}]}] Oct 04 20:25:16.305165 n-d-854823-8 devstack@n-api.service[106299]: X-Tenant: admin Oct 04 20:25:16.305165 n-d-854823-8 devstack@n-api.service[106299]: X-Tenant-Id: a8f446f6e7e14a62b5ba7037ccbfaad8 Oct 04 20:25:16.305165 n-d-854823-8 devstack@n-api.service[106299]: X-Tenant-Name: admin Oct 04 20:25:16.305165 n-d-854823-8 devstack@n-api.service[106299]: X-User: admin Oct 04 20:25:16.305165 n-d-854823-8 devstack@n-api.service[106299]: X-User-Domain-Id: default Oct 04 20:25:16.305165 n-d-854823-8 devstack@n-api.service[106299]: X-User-Domain-Name: Default Oct 04 20:25:16.305165 n-d-854823-8 devstack@n-api.service[106299]: X-User-Id: 27ae2d3850d44e749f83eee469d54344 Oct 04 20:25:16.305165 n-d-854823-8 devstack@n-api.service[106299]: X-User-Name: admin Oct 04 20:25:16.305165 n-d-854823-8 devstack@n-api.service[106299]: method: > Oct 04 20:25:16.305165 n-d-854823-8 devstack@n-api.service[106299]: exception: Flavor 84 could not be found. Oct 04 20:25:16.305165 n-d-854823-8 devstack@n-api.service[106299]: action_args: {'id': '84'} Oct 04 20:25:16.305165 n-d-854823-8 devstack@n-api.service[106299]: {{(pid=106299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:25:16.305165 n-d-854823-8 devstack@n-api.service[106299]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:25:16.306168 n-d-854823-8 devstack@n-api.service[106299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 04 20:25:16.306168 n-d-854823-8 devstack@n-api.service[106299]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 04 20:25:16.306168 n-d-854823-8 devstack@n-api.service[106299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 04 20:25:16.306168 n-d-854823-8 devstack@n-api.service[106299]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 04 20:25:16.306168 n-d-854823-8 devstack@n-api.service[106299]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 20:25:16.306168 n-d-854823-8 devstack@n-api.service[106299]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 20:25:16.306168 n-d-854823-8 devstack@n-api.service[106299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 04 20:25:16.306168 n-d-854823-8 devstack@n-api.service[106299]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 04 20:25:16.306168 n-d-854823-8 devstack@n-api.service[106299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 04 20:25:16.306168 n-d-854823-8 devstack@n-api.service[106299]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:25:16.306168 n-d-854823-8 devstack@n-api.service[106299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 04 20:25:16.306168 n-d-854823-8 devstack@n-api.service[106299]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 04 20:25:16.306168 n-d-854823-8 devstack@n-api.service[106299]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 04 20:25:16.306168 n-d-854823-8 devstack@n-api.service[106299]: ERROR nova.api.openstack.wsgi Oct 04 20:25:16.306168 n-d-854823-8 devstack@n-api.service[106299]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:25:16.306168 n-d-854823-8 devstack@n-api.service[106299]: ERROR nova.api.openstack.wsgi Oct 04 20:25:16.306168 n-d-854823-8 devstack@n-api.service[106299]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:25:16.306168 n-d-854823-8 devstack@n-api.service[106299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:25:16.306168 n-d-854823-8 devstack@n-api.service[106299]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:25:16.307708 n-d-854823-8 devstack@n-api.service[106299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:25:16.307708 n-d-854823-8 devstack@n-api.service[106299]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:25:16.307708 n-d-854823-8 devstack@n-api.service[106299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:25:16.307708 n-d-854823-8 devstack@n-api.service[106299]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:25:16.307708 n-d-854823-8 devstack@n-api.service[106299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 04 20:25:16.307708 n-d-854823-8 devstack@n-api.service[106299]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:25:16.307708 n-d-854823-8 devstack@n-api.service[106299]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 04 20:25:16.307708 n-d-854823-8 devstack@n-api.service[106299]: ERROR nova.api.openstack.wsgi Oct 04 20:25:16.307708 n-d-854823-8 devstack@n-api.service[106299]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:25:16.307708 n-d-854823-8 devstack@n-api.service[106299]: ERROR nova.api.openstack.wsgi Oct 04 20:25:16.307708 n-d-854823-8 devstack@n-api.service[106299]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:25:16.307708 n-d-854823-8 devstack@n-api.service[106299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:25:16.307708 n-d-854823-8 devstack@n-api.service[106299]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:25:16.307708 n-d-854823-8 devstack@n-api.service[106299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:25:16.307708 n-d-854823-8 devstack@n-api.service[106299]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:25:16.307708 n-d-854823-8 devstack@n-api.service[106299]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 04 20:25:16.307708 n-d-854823-8 devstack@n-api.service[106299]: ERROR nova.api.openstack.wsgi Oct 04 20:25:16.307708 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi [None req-4dcc1dc1-9b64-4b4b-90b7-e479304a6d18 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=106299) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:25:16.308904 n-d-854823-8 devstack@n-api.service[106299]: INFO nova.api.openstack.requestlog [None req-4dcc1dc1-9b64-4b4b-90b7-e479304a6d18 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.011334 Oct 04 20:25:16.308904 n-d-854823-8 devstack@n-api.service[106299]: [pid: 106299|app: 0|req: 23/47] 10.222.0.33 () {60 vars in 1190 bytes} [Tue Oct 4 20:25:16 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 04 20:25:17.513498 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi [None req-bf1a9298-8fd0-4d29-a440-de49b4ade839 admin admin] Calling method '>' {{(pid=106298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:25:17.514542 n-d-854823-8 devstack@n-api.service[106298]: INFO nova.api.openstack.requestlog [None req-bf1a9298-8fd0-4d29-a440-de49b4ade839 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 Oct 04 20:25:17.514941 n-d-854823-8 devstack@n-api.service[106298]: [pid: 106298|app: 0|req: 25/48] 10.222.0.33 () {56 vars in 1074 bytes} [Tue Oct 4 20:25:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:25:18.049306 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi [None req-9bf6f648-acc9-4ad1-9d89-5ffd415a2da5 admin admin] Calling method '>' {{(pid=106299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:25:18.055165 n-d-854823-8 devstack@n-api.service[106299]: INFO nova.api.openstack.wsgi [None req-9bf6f648-acc9-4ad1-9d89-5ffd415a2da5 admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 04 20:25:18.056659 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi [None req-9bf6f648-acc9-4ad1-9d89-5ffd415a2da5 admin admin] Request method failure captured: Oct 04 20:25:18.056659 n-d-854823-8 devstack@n-api.service[106299]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 04 20:25:18.056659 n-d-854823-8 devstack@n-api.service[106299]: Accept: application/json Oct 04 20:25:18.056659 n-d-854823-8 devstack@n-api.service[106299]: Accept-Encoding: gzip, deflate Oct 04 20:25:18.056659 n-d-854823-8 devstack@n-api.service[106299]: Connection: keep-alive Oct 04 20:25:18.056659 n-d-854823-8 devstack@n-api.service[106299]: Content-Length: 0 Oct 04 20:25:18.056659 n-d-854823-8 devstack@n-api.service[106299]: Host: 10.222.0.33 Oct 04 20:25:18.056659 n-d-854823-8 devstack@n-api.service[106299]: Openstack-Api-Version: compute 2.92 Oct 04 20:25:18.056659 n-d-854823-8 devstack@n-api.service[106299]: Openstack-System-Scope: None Oct 04 20:25:18.056659 n-d-854823-8 devstack@n-api.service[106299]: User-Agent: python-novaclient Oct 04 20:25:18.056659 n-d-854823-8 devstack@n-api.service[106299]: X-Auth-Token: gAAAAABjPJatv76vVsXpmalLzNyv9H2y-BTvf-S4ksw5sC_eIDSEn7rimxqNg8qGbu4u4aTbKG1H_3gU66iYYn3coQow8XbiZAGyRNIgh93tl7yBMc-fBVPOdoNOojmLug0mLutapvaD8981D8G2MpKlld5DNQd_0G02c2yLuu_jBs1yFYMhwb0 Oct 04 20:25:18.056659 n-d-854823-8 devstack@n-api.service[106299]: X-Domain-Id: None Oct 04 20:25:18.056659 n-d-854823-8 devstack@n-api.service[106299]: X-Domain-Name: None Oct 04 20:25:18.056659 n-d-854823-8 devstack@n-api.service[106299]: X-Identity-Status: Confirmed Oct 04 20:25:18.056659 n-d-854823-8 devstack@n-api.service[106299]: X-Is-Admin-Project: True Oct 04 20:25:18.056659 n-d-854823-8 devstack@n-api.service[106299]: X-Openstack-Nova-Api-Version: 2.92 Oct 04 20:25:18.056659 n-d-854823-8 devstack@n-api.service[106299]: X-Project-Domain-Id: default Oct 04 20:25:18.056659 n-d-854823-8 devstack@n-api.service[106299]: X-Project-Domain-Name: Default Oct 04 20:25:18.056659 n-d-854823-8 devstack@n-api.service[106299]: X-Project-Id: a8f446f6e7e14a62b5ba7037ccbfaad8 Oct 04 20:25:18.056659 n-d-854823-8 devstack@n-api.service[106299]: X-Project-Name: admin Oct 04 20:25:18.056659 n-d-854823-8 devstack@n-api.service[106299]: X-Role: admin,reader,member Oct 04 20:25:18.056659 n-d-854823-8 devstack@n-api.service[106299]: X-Roles: admin,reader,member Oct 04 20:25:18.058159 n-d-854823-8 devstack@n-api.service[106299]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a8f446f6e7e14a62b5ba7037ccbfaad8", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a8f446f6e7e14a62b5ba7037ccbfaad8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a8f446f6e7e14a62b5ba7037ccbfaad8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a8f446f6e7e14a62b5ba7037ccbfaad8"}]}] Oct 04 20:25:18.058159 n-d-854823-8 devstack@n-api.service[106299]: X-Tenant: admin Oct 04 20:25:18.058159 n-d-854823-8 devstack@n-api.service[106299]: X-Tenant-Id: a8f446f6e7e14a62b5ba7037ccbfaad8 Oct 04 20:25:18.058159 n-d-854823-8 devstack@n-api.service[106299]: X-Tenant-Name: admin Oct 04 20:25:18.058159 n-d-854823-8 devstack@n-api.service[106299]: X-User: admin Oct 04 20:25:18.058159 n-d-854823-8 devstack@n-api.service[106299]: X-User-Domain-Id: default Oct 04 20:25:18.058159 n-d-854823-8 devstack@n-api.service[106299]: X-User-Domain-Name: Default Oct 04 20:25:18.058159 n-d-854823-8 devstack@n-api.service[106299]: X-User-Id: 27ae2d3850d44e749f83eee469d54344 Oct 04 20:25:18.058159 n-d-854823-8 devstack@n-api.service[106299]: X-User-Name: admin Oct 04 20:25:18.058159 n-d-854823-8 devstack@n-api.service[106299]: method: > Oct 04 20:25:18.058159 n-d-854823-8 devstack@n-api.service[106299]: exception: Flavor 451 could not be found. Oct 04 20:25:18.058159 n-d-854823-8 devstack@n-api.service[106299]: action_args: {'id': '451'} Oct 04 20:25:18.058159 n-d-854823-8 devstack@n-api.service[106299]: {{(pid=106299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:25:18.058159 n-d-854823-8 devstack@n-api.service[106299]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:25:18.059200 n-d-854823-8 devstack@n-api.service[106299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 04 20:25:18.059200 n-d-854823-8 devstack@n-api.service[106299]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 04 20:25:18.059200 n-d-854823-8 devstack@n-api.service[106299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 04 20:25:18.059200 n-d-854823-8 devstack@n-api.service[106299]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 04 20:25:18.059200 n-d-854823-8 devstack@n-api.service[106299]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 20:25:18.059200 n-d-854823-8 devstack@n-api.service[106299]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 20:25:18.059200 n-d-854823-8 devstack@n-api.service[106299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 04 20:25:18.059200 n-d-854823-8 devstack@n-api.service[106299]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 04 20:25:18.059200 n-d-854823-8 devstack@n-api.service[106299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 04 20:25:18.059200 n-d-854823-8 devstack@n-api.service[106299]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:25:18.059200 n-d-854823-8 devstack@n-api.service[106299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 04 20:25:18.059200 n-d-854823-8 devstack@n-api.service[106299]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 04 20:25:18.059200 n-d-854823-8 devstack@n-api.service[106299]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 04 20:25:18.059200 n-d-854823-8 devstack@n-api.service[106299]: ERROR nova.api.openstack.wsgi Oct 04 20:25:18.059200 n-d-854823-8 devstack@n-api.service[106299]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:25:18.059200 n-d-854823-8 devstack@n-api.service[106299]: ERROR nova.api.openstack.wsgi Oct 04 20:25:18.059200 n-d-854823-8 devstack@n-api.service[106299]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:25:18.059200 n-d-854823-8 devstack@n-api.service[106299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:25:18.059200 n-d-854823-8 devstack@n-api.service[106299]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:25:18.060518 n-d-854823-8 devstack@n-api.service[106299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:25:18.060518 n-d-854823-8 devstack@n-api.service[106299]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:25:18.060518 n-d-854823-8 devstack@n-api.service[106299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:25:18.060518 n-d-854823-8 devstack@n-api.service[106299]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:25:18.060518 n-d-854823-8 devstack@n-api.service[106299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 04 20:25:18.060518 n-d-854823-8 devstack@n-api.service[106299]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:25:18.060518 n-d-854823-8 devstack@n-api.service[106299]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 04 20:25:18.060518 n-d-854823-8 devstack@n-api.service[106299]: ERROR nova.api.openstack.wsgi Oct 04 20:25:18.060518 n-d-854823-8 devstack@n-api.service[106299]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:25:18.060518 n-d-854823-8 devstack@n-api.service[106299]: ERROR nova.api.openstack.wsgi Oct 04 20:25:18.060518 n-d-854823-8 devstack@n-api.service[106299]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:25:18.060518 n-d-854823-8 devstack@n-api.service[106299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:25:18.060518 n-d-854823-8 devstack@n-api.service[106299]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:25:18.060518 n-d-854823-8 devstack@n-api.service[106299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:25:18.060518 n-d-854823-8 devstack@n-api.service[106299]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:25:18.060518 n-d-854823-8 devstack@n-api.service[106299]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 04 20:25:18.060518 n-d-854823-8 devstack@n-api.service[106299]: ERROR nova.api.openstack.wsgi Oct 04 20:25:18.060518 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi [None req-9bf6f648-acc9-4ad1-9d89-5ffd415a2da5 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=106299) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:25:18.061699 n-d-854823-8 devstack@n-api.service[106299]: INFO nova.api.openstack.requestlog [None req-9bf6f648-acc9-4ad1-9d89-5ffd415a2da5 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.406998 Oct 04 20:25:18.061699 n-d-854823-8 devstack@n-api.service[106299]: [pid: 106299|app: 0|req: 24/49] 10.222.0.33 () {60 vars in 1193 bytes} [Tue Oct 4 20:25:17 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 408 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 04 20:25:18.068537 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi [None req-e6f19b45-3135-4581-860c-9c9fa5507e5c admin admin] Calling method '>' {{(pid=106298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:25:18.083723 n-d-854823-8 devstack@n-api.service[106298]: INFO nova.api.openstack.requestlog [None req-e6f19b45-3135-4581-860c-9c9fa5507e5c admin admin] 10.222.0.33 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019201 Oct 04 20:25:18.084249 n-d-854823-8 devstack@n-api.service[106298]: [pid: 106298|app: 0|req: 26/50] 10.222.0.33 () {60 vars in 1210 bytes} [Tue Oct 4 20:25:18 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:25:18.093453 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi [None req-6dfd4feb-00cd-4ade-8bf8-1cd3fe4a61ac admin admin] Calling method '>' {{(pid=106299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:25:18.108555 n-d-854823-8 devstack@n-api.service[106299]: INFO nova.api.openstack.requestlog [None req-6dfd4feb-00cd-4ade-8bf8-1cd3fe4a61ac admin admin] 10.222.0.33 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018629 Oct 04 20:25:18.109089 n-d-854823-8 devstack@n-api.service[106299]: [pid: 106299|app: 0|req: 25/51] 10.222.0.33 () {60 vars in 1210 bytes} [Tue Oct 4 20:25:18 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 20:25:18.118324 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi [None req-203aed9f-2d1a-42bb-b7da-6326dffc832d admin admin] Calling method '>' {{(pid=106298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:25:18.123205 n-d-854823-8 devstack@n-api.service[106298]: INFO nova.api.openstack.wsgi [None req-203aed9f-2d1a-42bb-b7da-6326dffc832d admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 04 20:25:18.124695 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi [None req-203aed9f-2d1a-42bb-b7da-6326dffc832d admin admin] Request method failure captured: Oct 04 20:25:18.124695 n-d-854823-8 devstack@n-api.service[106298]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 04 20:25:18.124695 n-d-854823-8 devstack@n-api.service[106298]: Accept: application/json Oct 04 20:25:18.124695 n-d-854823-8 devstack@n-api.service[106298]: Accept-Encoding: gzip, deflate Oct 04 20:25:18.124695 n-d-854823-8 devstack@n-api.service[106298]: Connection: keep-alive Oct 04 20:25:18.124695 n-d-854823-8 devstack@n-api.service[106298]: Content-Length: 0 Oct 04 20:25:18.124695 n-d-854823-8 devstack@n-api.service[106298]: Host: 10.222.0.33 Oct 04 20:25:18.124695 n-d-854823-8 devstack@n-api.service[106298]: Openstack-Api-Version: compute 2.92 Oct 04 20:25:18.124695 n-d-854823-8 devstack@n-api.service[106298]: Openstack-System-Scope: None Oct 04 20:25:18.124695 n-d-854823-8 devstack@n-api.service[106298]: User-Agent: python-novaclient Oct 04 20:25:18.124695 n-d-854823-8 devstack@n-api.service[106298]: X-Auth-Token: gAAAAABjPJatv76vVsXpmalLzNyv9H2y-BTvf-S4ksw5sC_eIDSEn7rimxqNg8qGbu4u4aTbKG1H_3gU66iYYn3coQow8XbiZAGyRNIgh93tl7yBMc-fBVPOdoNOojmLug0mLutapvaD8981D8G2MpKlld5DNQd_0G02c2yLuu_jBs1yFYMhwb0 Oct 04 20:25:18.124695 n-d-854823-8 devstack@n-api.service[106298]: X-Domain-Id: None Oct 04 20:25:18.124695 n-d-854823-8 devstack@n-api.service[106298]: X-Domain-Name: None Oct 04 20:25:18.124695 n-d-854823-8 devstack@n-api.service[106298]: X-Identity-Status: Confirmed Oct 04 20:25:18.124695 n-d-854823-8 devstack@n-api.service[106298]: X-Is-Admin-Project: True Oct 04 20:25:18.124695 n-d-854823-8 devstack@n-api.service[106298]: X-Openstack-Nova-Api-Version: 2.92 Oct 04 20:25:18.124695 n-d-854823-8 devstack@n-api.service[106298]: X-Project-Domain-Id: default Oct 04 20:25:18.124695 n-d-854823-8 devstack@n-api.service[106298]: X-Project-Domain-Name: Default Oct 04 20:25:18.124695 n-d-854823-8 devstack@n-api.service[106298]: X-Project-Id: a8f446f6e7e14a62b5ba7037ccbfaad8 Oct 04 20:25:18.124695 n-d-854823-8 devstack@n-api.service[106298]: X-Project-Name: admin Oct 04 20:25:18.124695 n-d-854823-8 devstack@n-api.service[106298]: X-Role: admin,reader,member Oct 04 20:25:18.124695 n-d-854823-8 devstack@n-api.service[106298]: X-Roles: admin,reader,member Oct 04 20:25:18.125923 n-d-854823-8 devstack@n-api.service[106298]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a8f446f6e7e14a62b5ba7037ccbfaad8", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a8f446f6e7e14a62b5ba7037ccbfaad8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a8f446f6e7e14a62b5ba7037ccbfaad8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a8f446f6e7e14a62b5ba7037ccbfaad8"}]}] Oct 04 20:25:18.125923 n-d-854823-8 devstack@n-api.service[106298]: X-Tenant: admin Oct 04 20:25:18.125923 n-d-854823-8 devstack@n-api.service[106298]: X-Tenant-Id: a8f446f6e7e14a62b5ba7037ccbfaad8 Oct 04 20:25:18.125923 n-d-854823-8 devstack@n-api.service[106298]: X-Tenant-Name: admin Oct 04 20:25:18.125923 n-d-854823-8 devstack@n-api.service[106298]: X-User: admin Oct 04 20:25:18.125923 n-d-854823-8 devstack@n-api.service[106298]: X-User-Domain-Id: default Oct 04 20:25:18.125923 n-d-854823-8 devstack@n-api.service[106298]: X-User-Domain-Name: Default Oct 04 20:25:18.125923 n-d-854823-8 devstack@n-api.service[106298]: X-User-Id: 27ae2d3850d44e749f83eee469d54344 Oct 04 20:25:18.125923 n-d-854823-8 devstack@n-api.service[106298]: X-User-Name: admin Oct 04 20:25:18.125923 n-d-854823-8 devstack@n-api.service[106298]: method: > Oct 04 20:25:18.125923 n-d-854823-8 devstack@n-api.service[106298]: exception: Flavor 451 could not be found. Oct 04 20:25:18.125923 n-d-854823-8 devstack@n-api.service[106298]: action_args: {'id': '451'} Oct 04 20:25:18.125923 n-d-854823-8 devstack@n-api.service[106298]: {{(pid=106298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:25:18.125923 n-d-854823-8 devstack@n-api.service[106298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:25:18.126852 n-d-854823-8 devstack@n-api.service[106298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 04 20:25:18.126852 n-d-854823-8 devstack@n-api.service[106298]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 04 20:25:18.126852 n-d-854823-8 devstack@n-api.service[106298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 04 20:25:18.126852 n-d-854823-8 devstack@n-api.service[106298]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 04 20:25:18.126852 n-d-854823-8 devstack@n-api.service[106298]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 20:25:18.126852 n-d-854823-8 devstack@n-api.service[106298]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 20:25:18.126852 n-d-854823-8 devstack@n-api.service[106298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 04 20:25:18.126852 n-d-854823-8 devstack@n-api.service[106298]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 04 20:25:18.126852 n-d-854823-8 devstack@n-api.service[106298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 04 20:25:18.126852 n-d-854823-8 devstack@n-api.service[106298]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:25:18.126852 n-d-854823-8 devstack@n-api.service[106298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 04 20:25:18.126852 n-d-854823-8 devstack@n-api.service[106298]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 04 20:25:18.126852 n-d-854823-8 devstack@n-api.service[106298]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 04 20:25:18.126852 n-d-854823-8 devstack@n-api.service[106298]: ERROR nova.api.openstack.wsgi Oct 04 20:25:18.126852 n-d-854823-8 devstack@n-api.service[106298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:25:18.126852 n-d-854823-8 devstack@n-api.service[106298]: ERROR nova.api.openstack.wsgi Oct 04 20:25:18.126852 n-d-854823-8 devstack@n-api.service[106298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:25:18.126852 n-d-854823-8 devstack@n-api.service[106298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:25:18.126852 n-d-854823-8 devstack@n-api.service[106298]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:25:18.128772 n-d-854823-8 devstack@n-api.service[106298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:25:18.128772 n-d-854823-8 devstack@n-api.service[106298]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:25:18.128772 n-d-854823-8 devstack@n-api.service[106298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:25:18.128772 n-d-854823-8 devstack@n-api.service[106298]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:25:18.128772 n-d-854823-8 devstack@n-api.service[106298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 04 20:25:18.128772 n-d-854823-8 devstack@n-api.service[106298]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:25:18.128772 n-d-854823-8 devstack@n-api.service[106298]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 04 20:25:18.128772 n-d-854823-8 devstack@n-api.service[106298]: ERROR nova.api.openstack.wsgi Oct 04 20:25:18.128772 n-d-854823-8 devstack@n-api.service[106298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:25:18.128772 n-d-854823-8 devstack@n-api.service[106298]: ERROR nova.api.openstack.wsgi Oct 04 20:25:18.128772 n-d-854823-8 devstack@n-api.service[106298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:25:18.128772 n-d-854823-8 devstack@n-api.service[106298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:25:18.128772 n-d-854823-8 devstack@n-api.service[106298]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:25:18.128772 n-d-854823-8 devstack@n-api.service[106298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:25:18.128772 n-d-854823-8 devstack@n-api.service[106298]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:25:18.128772 n-d-854823-8 devstack@n-api.service[106298]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 04 20:25:18.128772 n-d-854823-8 devstack@n-api.service[106298]: ERROR nova.api.openstack.wsgi Oct 04 20:25:18.128772 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi [None req-203aed9f-2d1a-42bb-b7da-6326dffc832d admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=106298) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:25:18.129997 n-d-854823-8 devstack@n-api.service[106298]: INFO nova.api.openstack.requestlog [None req-203aed9f-2d1a-42bb-b7da-6326dffc832d admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.011175 Oct 04 20:25:18.129997 n-d-854823-8 devstack@n-api.service[106298]: [pid: 106298|app: 0|req: 27/52] 10.222.0.33 () {60 vars in 1193 bytes} [Tue Oct 4 20:25:18 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 04 20:25:19.345091 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi [None req-6dfd4feb-00cd-4ade-8bf8-1cd3fe4a61ac admin admin] Calling method '>' {{(pid=106299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:25:19.346186 n-d-854823-8 devstack@n-api.service[106299]: INFO nova.api.openstack.requestlog [None req-6dfd4feb-00cd-4ade-8bf8-1cd3fe4a61ac admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Oct 04 20:25:19.347301 n-d-854823-8 devstack@n-api.service[106299]: [pid: 106299|app: 0|req: 26/53] 10.222.0.33 () {56 vars in 1074 bytes} [Tue Oct 4 20:25:19 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:25:19.871851 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi [None req-ff61e913-b255-49ad-9561-7be140db7176 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:25:19.892004 n-d-854823-8 devstack@n-api.service[106298]: INFO nova.api.openstack.requestlog [None req-ff61e913-b255-49ad-9561-7be140db7176 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.404113 Oct 04 20:25:19.892577 n-d-854823-8 devstack@n-api.service[106298]: [pid: 106298|app: 0|req: 28/54] 10.222.0.33 () {64 vars in 1235 bytes} [Tue Oct 4 20:25:19 2022] POST /compute/v2.1/flavors => generated 404 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 20:25:21.102986 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi [None req-6dfd4feb-00cd-4ade-8bf8-1cd3fe4a61ac admin admin] Calling method '>' {{(pid=106299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:25:21.104004 n-d-854823-8 devstack@n-api.service[106299]: INFO nova.api.openstack.requestlog [None req-6dfd4feb-00cd-4ade-8bf8-1cd3fe4a61ac admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001474 Oct 04 20:25:21.104421 n-d-854823-8 devstack@n-api.service[106299]: [pid: 106299|app: 0|req: 27/55] 10.222.0.33 () {56 vars in 1074 bytes} [Tue Oct 4 20:25:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:25:21.748395 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi [None req-c12985fb-4595-4f4c-9983-0d56ab20fad0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:25:21.766281 n-d-854823-8 devstack@n-api.service[106298]: INFO nova.api.openstack.requestlog [None req-c12985fb-4595-4f4c-9983-0d56ab20fad0 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.522233 Oct 04 20:25:21.766788 n-d-854823-8 devstack@n-api.service[106298]: [pid: 106298|app: 0|req: 29/56] 10.222.0.33 () {64 vars in 1235 bytes} [Tue Oct 4 20:25:21 2022] POST /compute/v2.1/flavors => generated 405 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 04 20:25:22.994484 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi [None req-6dfd4feb-00cd-4ade-8bf8-1cd3fe4a61ac admin admin] Calling method '>' {{(pid=106299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:25:22.995533 n-d-854823-8 devstack@n-api.service[106299]: INFO nova.api.openstack.requestlog [None req-6dfd4feb-00cd-4ade-8bf8-1cd3fe4a61ac admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001537 Oct 04 20:25:22.995940 n-d-854823-8 devstack@n-api.service[106299]: [pid: 106299|app: 0|req: 28/57] 10.222.0.33 () {56 vars in 1074 bytes} [Tue Oct 4 20:25:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:25:23.513056 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi [None req-d4ae0224-aa52-4cfd-906b-725c99da6ffd admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:25:23.531571 n-d-854823-8 devstack@n-api.service[106298]: INFO nova.api.openstack.requestlog [None req-d4ae0224-aa52-4cfd-906b-725c99da6ffd admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.399590 Oct 04 20:25:23.532115 n-d-854823-8 devstack@n-api.service[106298]: [pid: 106298|app: 0|req: 30/58] 10.222.0.33 () {64 vars in 1235 bytes} [Tue Oct 4 20:25:23 2022] POST /compute/v2.1/flavors => generated 407 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 20:25:24.756691 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi [None req-6dfd4feb-00cd-4ade-8bf8-1cd3fe4a61ac admin admin] Calling method '>' {{(pid=106299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:25:24.757715 n-d-854823-8 devstack@n-api.service[106299]: INFO nova.api.openstack.requestlog [None req-6dfd4feb-00cd-4ade-8bf8-1cd3fe4a61ac admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001443 Oct 04 20:25:24.758119 n-d-854823-8 devstack@n-api.service[106299]: [pid: 106299|app: 0|req: 29/59] 10.222.0.33 () {56 vars in 1074 bytes} [Tue Oct 4 20:25:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:25:25.280802 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi [None req-e995e8db-790e-4551-9247-bc74498f023a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:25:25.299895 n-d-854823-8 devstack@n-api.service[106298]: INFO nova.api.openstack.requestlog [None req-e995e8db-790e-4551-9247-bc74498f023a admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.402228 Oct 04 20:25:25.300451 n-d-854823-8 devstack@n-api.service[106298]: [pid: 106298|app: 0|req: 31/60] 10.222.0.33 () {64 vars in 1235 bytes} [Tue Oct 4 20:25:24 2022] POST /compute/v2.1/flavors => generated 409 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 20:25:26.518005 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi [None req-6dfd4feb-00cd-4ade-8bf8-1cd3fe4a61ac admin admin] Calling method '>' {{(pid=106299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:25:26.519109 n-d-854823-8 devstack@n-api.service[106299]: INFO nova.api.openstack.requestlog [None req-6dfd4feb-00cd-4ade-8bf8-1cd3fe4a61ac admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001552 Oct 04 20:25:26.519508 n-d-854823-8 devstack@n-api.service[106299]: [pid: 106299|app: 0|req: 30/61] 10.222.0.33 () {56 vars in 1074 bytes} [Tue Oct 4 20:25:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:25:27.045800 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi [None req-2e0b2e1d-8a12-4dcb-bf47-f6baaa30a823 admin admin] Calling method '>' {{(pid=106298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:25:27.066649 n-d-854823-8 devstack@n-api.service[106298]: INFO nova.api.openstack.requestlog [None req-2e0b2e1d-8a12-4dcb-bf47-f6baaa30a823 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.396392 Oct 04 20:25:27.067192 n-d-854823-8 devstack@n-api.service[106298]: [pid: 106298|app: 0|req: 32/62] 10.222.0.33 () {60 vars in 1202 bytes} [Tue Oct 4 20:25:26 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:26:23.698368 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi [None req-6dfd4feb-00cd-4ade-8bf8-1cd3fe4a61ac admin admin] Calling method '>' {{(pid=106299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:26:23.699415 n-d-854823-8 devstack@n-api.service[106299]: INFO nova.api.openstack.requestlog [None req-6dfd4feb-00cd-4ade-8bf8-1cd3fe4a61ac admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001483 Oct 04 20:26:23.699814 n-d-854823-8 devstack@n-api.service[106299]: [pid: 106299|app: 0|req: 31/63] 10.222.0.33 () {54 vars in 931 bytes} [Tue Oct 4 20:26:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:26:23.710935 n-d-854823-8 devstack@n-api.service[106298]: DEBUG dbcounter [-] [106298] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=106298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:26:24.085933 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi [None req-8f3256a8-fc91-4087-9b4b-cb8ea84f9284 admin admin] Calling method '>' {{(pid=106298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:26:24.108005 n-d-854823-8 devstack@n-api.service[106298]: INFO nova.api.openstack.requestlog [None req-8f3256a8-fc91-4087-9b4b-cb8ea84f9284 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.400965 Oct 04 20:26:24.108550 n-d-854823-8 devstack@n-api.service[106298]: [pid: 106298|app: 0|req: 33/64] 10.222.0.33 () {60 vars in 1292 bytes} [Tue Oct 4 20:26:23 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:26:24.129433 n-d-854823-8 devstack@n-api.service[106299]: DEBUG dbcounter [-] [106299] Writing DB stats nova_api:SELECT=14 {{(pid=106299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:26:24.133092 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi [None req-c0d6cf96-50c9-4045-a58a-c34593e81a4a admin admin] Calling method '>' {{(pid=106299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:26:24.140583 n-d-854823-8 devstack@n-api.service[106299]: INFO nova.api.openstack.requestlog [None req-c0d6cf96-50c9-4045-a58a-c34593e81a4a admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012540 Oct 04 20:26:24.141109 n-d-854823-8 devstack@n-api.service[106299]: [pid: 106299|app: 0|req: 32/65] 10.222.0.33 () {60 vars in 1283 bytes} [Tue Oct 4 20:26:24 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:26:24.152603 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi [None req-371eb36a-1a1a-49ea-90d2-6d707d82ebbb admin admin] Calling method '>' {{(pid=106298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:26:24.160808 n-d-854823-8 devstack@n-api.service[106298]: INFO nova.api.openstack.requestlog [None req-371eb36a-1a1a-49ea-90d2-6d707d82ebbb admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011358 Oct 04 20:26:24.161296 n-d-854823-8 devstack@n-api.service[106298]: [pid: 106298|app: 0|req: 34/66] 10.222.0.33 () {60 vars in 1286 bytes} [Tue Oct 4 20:26:24 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:26:24.173644 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi [None req-9a445d7b-8fa4-4636-b1b5-897e01084919 admin admin] Calling method '>' {{(pid=106299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:26:24.181016 n-d-854823-8 devstack@n-api.service[106299]: INFO nova.api.openstack.requestlog [None req-9a445d7b-8fa4-4636-b1b5-897e01084919 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011940 Oct 04 20:26:24.181542 n-d-854823-8 devstack@n-api.service[106299]: [pid: 106299|app: 0|req: 33/67] 10.222.0.33 () {60 vars in 1286 bytes} [Tue Oct 4 20:26:24 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:26:24.193029 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi [None req-b98632de-8704-4c7c-8534-25093f5c11bd admin admin] Calling method '>' {{(pid=106298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:26:24.200193 n-d-854823-8 devstack@n-api.service[106298]: INFO nova.api.openstack.requestlog [None req-b98632de-8704-4c7c-8534-25093f5c11bd admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010692 Oct 04 20:26:24.200770 n-d-854823-8 devstack@n-api.service[106298]: [pid: 106298|app: 0|req: 35/68] 10.222.0.33 () {60 vars in 1283 bytes} [Tue Oct 4 20:26:24 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:31:48.455995 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi [None req-9a445d7b-8fa4-4636-b1b5-897e01084919 admin admin] Calling method '>' {{(pid=106299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:48.457012 n-d-854823-8 devstack@n-api.service[106299]: INFO nova.api.openstack.requestlog [None req-9a445d7b-8fa4-4636-b1b5-897e01084919 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Oct 04 20:31:48.457414 n-d-854823-8 devstack@n-api.service[106299]: [pid: 106299|app: 0|req: 34/69] 10.222.0.33 () {56 vars in 1074 bytes} [Tue Oct 4 20:31:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:31:48.599130 n-d-854823-8 devstack@n-api.service[106298]: DEBUG dbcounter [-] [106298] Writing DB stats nova_api:SELECT=6 {{(pid=106298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:31:48.743584 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi [None req-e9305119-64f8-4c3f-8858-da2d7df9b74f admin admin] Calling method '>' {{(pid=106298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:48.748885 n-d-854823-8 devstack@n-api.service[106298]: DEBUG oslo_concurrency.lockutils [None req-e9305119-64f8-4c3f-8858-da2d7df9b74f admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:48.749361 n-d-854823-8 devstack@n-api.service[106298]: DEBUG oslo_concurrency.lockutils [None req-e9305119-64f8-4c3f-8858-da2d7df9b74f admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:48.749793 n-d-854823-8 devstack@n-api.service[106298]: DEBUG oslo_concurrency.lockutils [None req-e9305119-64f8-4c3f-8858-da2d7df9b74f admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:48.750555 n-d-854823-8 devstack@n-api.service[106298]: DEBUG oslo_concurrency.lockutils [None req-e9305119-64f8-4c3f-8858-da2d7df9b74f admin admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:48.751009 n-d-854823-8 devstack@n-api.service[106298]: DEBUG oslo_concurrency.lockutils [None req-e9305119-64f8-4c3f-8858-da2d7df9b74f admin admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:48.751425 n-d-854823-8 devstack@n-api.service[106298]: DEBUG oslo_concurrency.lockutils [None req-e9305119-64f8-4c3f-8858-da2d7df9b74f admin admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:48.788773 n-d-854823-8 devstack@n-api.service[106298]: INFO nova.api.openstack.requestlog [None req-e9305119-64f8-4c3f-8858-da2d7df9b74f admin admin] 10.222.0.33 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.92 time: 0.190861 Oct 04 20:31:48.789331 n-d-854823-8 devstack@n-api.service[106298]: [pid: 106298|app: 0|req: 36/70] 10.222.0.33 () {60 vars in 1193 bytes} [Tue Oct 4 20:31:48 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:31:49.880562 n-d-854823-8 devstack@n-api.service[106299]: DEBUG nova.api.openstack.wsgi [None req-9a445d7b-8fa4-4636-b1b5-897e01084919 admin admin] Calling method '>' {{(pid=106299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:49.881586 n-d-854823-8 devstack@n-api.service[106299]: INFO nova.api.openstack.requestlog [None req-9a445d7b-8fa4-4636-b1b5-897e01084919 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001439 Oct 04 20:31:49.882001 n-d-854823-8 devstack@n-api.service[106299]: [pid: 106299|app: 0|req: 35/71] 10.222.0.33 () {56 vars in 1074 bytes} [Tue Oct 4 20:31:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:31:50.072993 n-d-854823-8 devstack@n-api.service[106298]: DEBUG nova.api.openstack.wsgi [None req-98b7bafe-076b-4e68-9ce8-f79c298d6b73 admin admin] Calling method '>' {{(pid=106298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:31:50.077401 n-d-854823-8 devstack@n-api.service[106298]: DEBUG oslo_concurrency.lockutils [None req-98b7bafe-076b-4e68-9ce8-f79c298d6b73 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:50.077881 n-d-854823-8 devstack@n-api.service[106298]: DEBUG oslo_concurrency.lockutils [None req-98b7bafe-076b-4e68-9ce8-f79c298d6b73 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:50.078308 n-d-854823-8 devstack@n-api.service[106298]: DEBUG oslo_concurrency.lockutils [None req-98b7bafe-076b-4e68-9ce8-f79c298d6b73 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:50.079050 n-d-854823-8 devstack@n-api.service[106298]: DEBUG oslo_concurrency.lockutils [None req-98b7bafe-076b-4e68-9ce8-f79c298d6b73 admin admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:31:50.079494 n-d-854823-8 devstack@n-api.service[106298]: DEBUG oslo_concurrency.lockutils [None req-98b7bafe-076b-4e68-9ce8-f79c298d6b73 admin admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:31:50.079910 n-d-854823-8 devstack@n-api.service[106298]: DEBUG oslo_concurrency.lockutils [None req-98b7bafe-076b-4e68-9ce8-f79c298d6b73 admin admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:31:50.102756 n-d-854823-8 devstack@n-api.service[106298]: INFO nova.api.openstack.requestlog [None req-98b7bafe-076b-4e68-9ce8-f79c298d6b73 admin admin] 10.222.0.33 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.92 time: 0.079978 Oct 04 20:31:50.103306 n-d-854823-8 devstack@n-api.service[106298]: [pid: 106298|app: 0|req: 37/72] 10.222.0.33 () {60 vars in 1193 bytes} [Tue Oct 4 20:31:50 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:32:39.750532 n-d-854823-8 devstack@n-api.service[106297]: Tue Oct 4 20:32:39 2022 - graceful shutdown triggered... Oct 04 20:32:39.750687 n-d-854823-8 systemd[1]: Stopping Devstack devstack@n-api.service... Oct 04 20:32:39.751667 n-d-854823-8 devstack@n-api.service[106298]: Gracefully killing worker 1 (pid: 106298)... Oct 04 20:32:39.752123 n-d-854823-8 devstack@n-api.service[106299]: Gracefully killing worker 2 (pid: 106299)... Oct 04 20:32:39.878839 n-d-854823-8 devstack@n-api.service[106299]: DEBUG dbcounter [-] [106299] Writing DB stats nova_api:SELECT=4 {{(pid=106299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:32:40.752362 n-d-854823-8 devstack@n-api.service[106297]: worker 1 buried after 1 seconds Oct 04 20:32:40.752857 n-d-854823-8 devstack@n-api.service[106297]: worker 2 buried after 1 seconds Oct 04 20:32:40.752857 n-d-854823-8 devstack@n-api.service[106297]: goodbye to uWSGI. Oct 04 20:32:40.753907 n-d-854823-8 systemd[1]: devstack@n-api.service: Succeeded. Oct 04 20:32:40.754555 n-d-854823-8 systemd[1]: Stopped Devstack devstack@n-api.service. Oct 04 20:32:40.757428 n-d-854823-8 systemd[1]: Starting Devstack devstack@n-api.service... Oct 04 20:32:40.772760 n-d-854823-8 devstack@n-api.service[128791]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 04 20:32:40.788814 n-d-854823-8 devstack@n-api.service[128791]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Oct 4 20:32:40 2022] *** Oct 04 20:32:40.788814 n-d-854823-8 devstack@n-api.service[128791]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 04 20:32:40.788814 n-d-854823-8 devstack@n-api.service[128791]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 04 20:32:40.788814 n-d-854823-8 devstack@n-api.service[128791]: nodename: n-d-854823-8 Oct 04 20:32:40.788814 n-d-854823-8 devstack@n-api.service[128791]: machine: x86_64 Oct 04 20:32:40.788814 n-d-854823-8 devstack@n-api.service[128791]: clock source: unix Oct 04 20:32:40.788814 n-d-854823-8 devstack@n-api.service[128791]: pcre jit disabled Oct 04 20:32:40.788814 n-d-854823-8 devstack@n-api.service[128791]: detected number of CPU cores: 4 Oct 04 20:32:40.788814 n-d-854823-8 devstack@n-api.service[128791]: current working directory: / Oct 04 20:32:40.788814 n-d-854823-8 devstack@n-api.service[128791]: detected binary path: /usr/bin/uwsgi-core Oct 04 20:32:40.789601 n-d-854823-8 devstack@n-api.service[128791]: your processes number limit is 47680 Oct 04 20:32:40.789601 n-d-854823-8 devstack@n-api.service[128791]: your memory page size is 4096 bytes Oct 04 20:32:40.789601 n-d-854823-8 devstack@n-api.service[128791]: detected max file descriptor number: 2048 Oct 04 20:32:40.789601 n-d-854823-8 devstack@n-api.service[128791]: lock engine: pthread robust mutexes Oct 04 20:32:40.789601 n-d-854823-8 devstack@n-api.service[128791]: thunder lock: enabled Oct 04 20:32:40.789601 n-d-854823-8 devstack@n-api.service[128791]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 04 20:32:40.789601 n-d-854823-8 devstack@n-api.service[128791]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 04 20:32:40.831454 n-d-854823-8 devstack@n-api.service[128791]: Python main interpreter initialized at 0x563b4a3149c0 Oct 04 20:32:40.831454 n-d-854823-8 devstack@n-api.service[128791]: python threads support enabled Oct 04 20:32:40.831454 n-d-854823-8 devstack@n-api.service[128791]: your server socket listen backlog is limited to 100 connections Oct 04 20:32:40.831454 n-d-854823-8 devstack@n-api.service[128791]: your mercy for graceful operations on workers is 90 seconds Oct 04 20:32:40.831904 n-d-854823-8 devstack@n-api.service[128791]: mapped 403077 bytes (393 KB) for 2 cores Oct 04 20:32:40.831904 n-d-854823-8 devstack@n-api.service[128791]: *** Operational MODE: preforking *** Oct 04 20:32:40.832161 n-d-854823-8 devstack@n-api.service[128791]: *** uWSGI is running in multiple interpreter mode *** Oct 04 20:32:40.832161 n-d-854823-8 devstack@n-api.service[128791]: spawned uWSGI master process (pid: 128791) Oct 04 20:32:40.832365 n-d-854823-8 systemd[1]: Started Devstack devstack@n-api.service. Oct 04 20:32:40.834376 n-d-854823-8 devstack@n-api.service[128791]: spawned uWSGI worker 1 (pid: 128801, cores: 1) Oct 04 20:32:40.835612 n-d-854823-8 devstack@n-api.service[128791]: spawned uWSGI worker 2 (pid: 128802, cores: 1) Oct 04 20:32:40.835848 n-d-854823-8 devstack@n-api.service[128791]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 04 20:32:41.508125 n-d-854823-8 devstack@n-api.service[128801]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 04 20:32:41.509426 n-d-854823-8 devstack@n-api.service[128802]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 04 20:32:42.696432 n-d-854823-8 devstack@n-api.service[128801]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 04 20:32:42.696432 n-d-854823-8 devstack@n-api.service[128801]: from cryptography.utils import int_from_bytes Oct 04 20:32:42.696952 n-d-854823-8 devstack@n-api.service[128801]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 04 20:32:42.696952 n-d-854823-8 devstack@n-api.service[128801]: from cryptography.utils import int_from_bytes Oct 04 20:32:42.704586 n-d-854823-8 devstack@n-api.service[128802]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 04 20:32:42.704586 n-d-854823-8 devstack@n-api.service[128802]: from cryptography.utils import int_from_bytes Oct 04 20:32:42.705557 n-d-854823-8 devstack@n-api.service[128802]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 04 20:32:42.705557 n-d-854823-8 devstack@n-api.service[128802]: from cryptography.utils import int_from_bytes Oct 04 20:32:45.191467 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 04 20:32:45.192104 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 04 20:32:45.192272 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 04 20:32:45.192639 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 04 20:32:45.192898 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 04 20:32:45.193293 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.193624 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.193950 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.194462 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.194804 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.195125 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.195458 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.195787 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.196122 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.196387 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.196710 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.197040 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-854823-8 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.197366 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.197682 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.197995 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.198319 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.198653 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.198981 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.200043 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.200606 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.201061 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.201381 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.201701 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.202048 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.202388 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.202706 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.203032 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.203343 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.203671 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.203986 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.204402 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-854823-8 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.204722 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.205040 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.205356 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.205765 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.206082 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.206428 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.206754 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.207027 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 04 20:32:45.207027 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 04 20:32:45.207566 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.207566 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.207814 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 04 20:32:45.207948 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.208099 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 04 20:32:45.208233 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.208358 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 04 20:32:45.208491 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.208581 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.208672 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.208826 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.208918 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.209147 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.209248 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.209512 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.209614 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.209834 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.209975 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.210141 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.210240 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.210542 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.210650 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.210799 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.210898 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.211150 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.211242 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.211476 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.211583 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.211791 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.211881 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.212113 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.212211 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-854823-8 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.212375 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.212513 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.212608 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.212732 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.212926 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.213028 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.213245 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.213335 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.213546 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.213689 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.213857 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.213960 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.214172 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.214270 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.214510 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.215059 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.215178 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.215419 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.215578 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.215728 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.216039 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.216181 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.216359 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.216458 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.216675 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.216957 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.217061 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.217157 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.217321 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.217425 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.217644 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.217792 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.217978 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.218090 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.33 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.218283 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.33 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.218431 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.218624 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.218733 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.218968 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.219086 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-854823-8 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.219287 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.219386 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.219600 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.219698 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.219920 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.220034 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.220246 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.220354 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.220557 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.220655 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.220865 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.220976 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.221200 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.221305 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.221518 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.221616 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.221852 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.221972 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.222164 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.222326 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.222487 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.222584 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.222734 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.222845 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.223043 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.223145 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.223364 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.223473 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.223673 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.223773 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.223982 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.224087 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.224298 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.224399 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.224598 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.224694 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.224898 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.224998 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.225149 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.225254 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.225456 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.225592 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.225780 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.225921 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.226086 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.226232 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.226420 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.226566 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.226703 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.226790 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.226909 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.227056 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.227225 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.227324 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.227542 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.227642 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.227851 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.227951 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.228158 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.228254 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.228471 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.228568 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.228775 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.228866 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.229081 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.229223 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.229388 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.229517 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.229692 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.229793 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.229998 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.230098 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.230306 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.230444 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.230777 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.230874 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.231217 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.231353 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.231534 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.231712 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.231862 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.232038 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.232179 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.232437 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.33 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.232534 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.232692 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.33 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.232803 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.233002 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.233100 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.233342 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.233432 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.233661 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.233763 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.233971 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.234071 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.234288 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.234421 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.234635 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.234733 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.234943 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.235042 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.235248 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.235337 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.235554 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.235649 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.235859 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.235949 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.236164 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.236295 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.236466 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.236566 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.236720 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.236818 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.237026 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.237159 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.237333 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.237425 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.237651 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.237815 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.237944 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.238077 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.238253 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.238382 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.238588 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.238687 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.238886 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.238992 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.239193 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.239293 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.239500 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.239597 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.239806 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.239897 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.240112 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.240234 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.240417 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.240555 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.240722 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.240870 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.241024 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.241189 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.241329 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.241516 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.241634 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.241832 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.241971 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.242186 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.242325 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.242472 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.242662 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.242804 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.242974 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.243079 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.243284 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.243389 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.243592 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.243699 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.243900 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.244021 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.244220 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.244345 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.244527 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.244661 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.244834 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.244983 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.245155 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.245314 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.245459 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.245637 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.245763 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.245950 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.246602 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.247007 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.247109 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.247424 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.247545 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.247785 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.247889 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.248124 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.248219 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.248457 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.248555 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.248776 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.248878 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.249090 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.249180 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.249399 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.249497 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.249703 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.249808 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.250008 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.250109 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.250312 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.250419 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.250641 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.250745 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.250946 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.251050 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.251250 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.251348 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.251551 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.251642 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.251869 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.251970 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.252189 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.252288 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.252496 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.252594 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.252804 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.252897 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.253109 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.253207 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.253428 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 20:32:45.253528 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.253764 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.253864 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.254083 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.254181 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.254427 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.254541 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.254747 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.254888 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.255064 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.255161 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.255379 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.255483 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.255695 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.255792 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.256004 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.256094 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.256311 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.256418 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.256618 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.256715 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.256933 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.257064 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.257238 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.257368 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.257548 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.257638 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.257868 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.257969 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.258182 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.258274 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.258556 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.258673 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.258869 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.259002 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.259188 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.259320 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.259504 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.259638 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.259818 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.259944 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.260127 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.260263 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.260444 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.260591 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.260759 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.260915 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.261069 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.261226 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.261396 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.261566 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.261755 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.262671 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.262774 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.263017 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.263126 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.263326 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.263460 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.263640 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.263795 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.263963 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.264115 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.264280 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.264432 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.264604 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.264748 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.264925 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.265090 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.265242 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.265408 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.265569 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.265724 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.265888 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.266045 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.266203 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.266378 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.266575 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.266709 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.266911 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.267047 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.267222 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.267363 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.267549 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.267650 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.267880 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.267981 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.268200 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.268343 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.268507 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.268599 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.268819 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.268917 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.269125 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.269223 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.269434 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.269534 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.269744 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.269835 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.270056 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.270156 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.270387 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.270492 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.270694 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.270786 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.271002 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.271100 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.271305 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.271401 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.271611 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.271708 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.271914 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.272011 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.272224 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.272321 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.272530 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.272641 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.272837 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.272932 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.273146 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.273243 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.273460 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.273558 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.273787 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.273880 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.274092 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.274182 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.274435 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.274550 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.274749 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.274877 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.275063 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.275205 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.275370 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.275524 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.275685 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.275846 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.275998 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.276162 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.276305 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.276478 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.276630 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.276795 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.276941 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.277111 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.277260 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.277485 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.277753 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.277872 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.278112 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.278305 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.278489 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.278653 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.278771 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.278986 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.279086 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.279308 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.279413 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.279629 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.279728 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.279949 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.280053 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.280268 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.280370 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.280596 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.280701 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.280915 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.281006 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.281231 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.281330 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.281568 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.281660 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.281885 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.281974 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.282194 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.282293 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.282537 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.282638 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.282856 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.282954 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.283173 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.283273 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.283477 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.283567 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.283789 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.283889 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.284094 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.284195 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.284400 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.284491 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.284707 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.284811 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.285016 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.285113 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.285321 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.285413 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.285624 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.285733 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.285929 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.286027 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.286233 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.286325 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.286562 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.286671 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.286887 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.286978 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.287200 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.287328 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.287507 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.287655 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.287812 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.287905 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.288115 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.288215 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.288445 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.288583 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.288748 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.288838 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.289058 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.289182 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.289376 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.289496 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.289698 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.289797 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.290013 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.290104 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.290330 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.290453 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.290663 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.290755 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.290974 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.291071 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.291285 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.291375 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.291594 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.291686 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.291902 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.292002 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.292218 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.292309 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.292529 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.292626 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.292845 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.292949 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.293304 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.293397 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.293640 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.293860 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.293999 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.294188 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.294283 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.294546 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.294647 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.294863 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.294955 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.295187 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.295276 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.295498 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.295588 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.295806 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.295910 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.296155 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.296246 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.296478 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.296599 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.296790 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.296905 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.297107 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.297213 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.297427 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.297582 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.297737 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.297876 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.298050 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.298141 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.298380 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.298474 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.298699 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.298806 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.299064 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.299156 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.299419 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.299517 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.299732 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.299898 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.300058 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.300203 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.300373 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.300465 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.300694 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.300785 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.301001 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.301096 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.301318 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.301423 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.301631 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.301721 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.301949 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.302051 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.302264 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.302397 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.302604 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.302730 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.302923 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.303048 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.303235 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.303352 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.303550 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.303818 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.303943 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.304159 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.304308 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.304467 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.304560 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.304782 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.304884 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.305101 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.305195 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.305415 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.305520 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.305729 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.305827 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.306037 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.306128 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.306368 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.306465 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.306684 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.306795 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.306993 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.307083 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.307299 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.307398 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.307618 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.307974 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.308131 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.308225 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.308317 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.308408 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.308523 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.309159 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.309390 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.309592 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.310133 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.310277 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.310490 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.310826 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.311148 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.311294 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.311464 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.311637 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.311813 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.311961 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.312083 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.312285 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.312433 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.312618 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.312751 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.312938 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.313061 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.313264 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.313383 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.313581 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.313709 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.313916 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.314025 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.314281 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.314424 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.314770 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.314888 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.315190 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.315551 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.316008 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.316108 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.316229 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.316311 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.316581 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.316671 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.316918 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.317007 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.317272 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.317362 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.317568 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.317690 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.317890 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.318009 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.318208 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.318386 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.318562 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.318711 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.318881 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.319025 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.319207 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.319338 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.319524 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.319643 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.319836 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.319960 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.320154 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.320270 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.320476 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.320579 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.320895 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.321058 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.321213 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.321410 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.321605 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.321770 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.321936 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.322103 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.322282 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.322482 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.322625 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.322783 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.322922 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.323057 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.323185 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.323354 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.323617 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.323773 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.323868 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.323955 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.324039 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.324891 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.325065 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.325350 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.325479 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.325716 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.325876 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.326104 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.326233 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.326460 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.326593 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.326780 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.326900 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.327097 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.327193 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.327410 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.327511 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.327721 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.327818 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.328028 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.328171 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.328336 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.328461 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.328646 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.328737 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.328964 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.329068 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.329274 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.329372 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.329585 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.329711 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.329890 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.329988 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.330199 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.330288 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.330540 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.330645 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.330850 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.330950 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.331159 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.331251 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.331469 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.331568 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.331783 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.331873 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.332101 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.332193 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.332414 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.332579 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.332728 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.332819 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.333039 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.333131 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.333352 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.333451 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.333660 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.333759 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.333970 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.334074 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.334276 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.334462 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.334613 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.334704 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.334917 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.335006 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.335232 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.335368 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.335545 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.335661 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.335849 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.335950 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.336159 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.336250 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.336466 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.336558 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.336779 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.336881 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.337090 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.337189 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.337398 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.337526 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.337709 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.337856 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.338015 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.338331 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.338663 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.338869 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.338996 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.339223 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.339342 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.339552 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.339918 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.340168 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.340293 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.340687 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.340850 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.341021 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.341139 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.341315 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.341435 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.341635 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.341761 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.341957 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.342084 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.342321 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.342524 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.342645 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.342845 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.342943 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.343177 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.343276 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.343499 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.343592 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.343820 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.343919 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.344149 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.344247 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.344452 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.344550 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.344759 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.344850 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.345072 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.345165 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.345379 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.345478 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.345683 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.345775 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.345995 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.346101 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.346316 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.346489 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.346754 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.346892 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.346984 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.347203 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.347294 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.347519 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.347617 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.347829 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.347921 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.348140 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.348277 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.348449 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.348572 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.348761 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.348856 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.349067 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.349160 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.349380 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.349480 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.349687 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.349787 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.349993 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.350092 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.350299 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.350437 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.350676 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.350989 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.351308 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.351619 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.352066 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.352454 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.352558 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.352666 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.352760 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.352853 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.353043 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.353175 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.353448 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.353618 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.353811 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.353930 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.354131 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.354312 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.354532 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.354664 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.354850 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.354986 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.355175 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.355412 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.355556 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.355805 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.356104 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.356205 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.356428 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.356604 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.356739 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.356936 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.357036 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.357257 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.357357 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.357586 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.357688 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.357908 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.358050 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.358233 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.358387 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.358576 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.358712 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.358889 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.358985 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.359213 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.359310 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.359534 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.359632 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.359854 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.359953 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.360180 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.360280 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.360511 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.360611 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.360842 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.360963 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.361153 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.361280 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.361469 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.361597 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.361789 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.361925 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.362105 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.362253 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.362446 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.362610 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.362765 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.362924 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.363084 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.363246 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.363404 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.363566 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.363721 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.363897 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.364039 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.364227 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.364354 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.364544 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.364665 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.364866 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.364964 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.365180 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.365279 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.365507 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.365599 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.365834 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.365939 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.366153 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.366251 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.366513 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.366606 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.366829 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.366936 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.367140 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.367239 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.367459 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.367554 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.367769 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.367876 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.368188 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.368279 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.368500 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.368592 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.368813 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.368950 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.369119 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.369210 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.369429 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.369533 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.369744 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.369844 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.370061 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.370158 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.370445 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.370558 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.370745 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.370837 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.371608 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.371766 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.371926 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.372212 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.372306 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.372537 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.372651 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.372870 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.372969 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.373183 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.373283 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.373512 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.373645 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.373832 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.373937 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.374160 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.374261 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.374511 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.374614 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.374823 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.374928 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.375130 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.375221 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.375458 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.375651 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.375768 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.375871 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.376083 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.376175 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.376393 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.376495 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.376741 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.376841 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.377049 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.377148 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.377376 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.377516 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.377729 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.377877 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.378065 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.378195 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.378401 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.378549 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.378742 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.378877 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.379076 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.379192 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.379446 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.379577 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.379784 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.379889 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.380120 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.380452 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.380782 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.380904 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.381102 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.381419 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.381729 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.382057 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.382410 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.382730 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.383059 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.383163 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.383457 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.383570 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.383790 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.383928 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.384110 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.384438 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.384543 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.384766 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.384877 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.385075 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.385237 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.385393 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.385569 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.385735 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.385843 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.386047 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.386172 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.386298 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.386681 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.387368 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.387653 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.390004 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.390103 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.390189 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.390273 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.390403 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.392646 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.392743 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.392838 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.392911 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.392982 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.393074 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.393159 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.395526 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.395621 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.395710 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.395710 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.395891 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.395977 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.396059 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.396140 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.396140 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.396388 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.396486 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.396579 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.396711 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.396823 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.396957 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.397056 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.397154 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.397239 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.397321 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.397403 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.397484 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.397572 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.397656 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.397656 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.397825 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.397916 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.398006 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.398103 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.398194 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.398278 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.398383 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.398510 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.398600 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.398697 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.398790 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.398881 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.399011 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.399121 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.399121 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.399322 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.399404 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.399404 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.399404 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.399622 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.399758 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.399845 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.399929 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.400011 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.400107 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.400191 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.400282 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.400366 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.400448 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.400530 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.400612 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.400693 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.400788 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.400879 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.400963 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.401045 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.401133 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.401215 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.401310 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.401310 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.401462 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.401543 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.401633 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.401725 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.401809 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.401890 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.401979 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.402062 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.402144 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.402234 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.420441 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.420677 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.420797 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.420797 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.420961 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.421074 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.421164 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.421233 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.421318 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.421392 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.421466 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.421574 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.421923 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.422047 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.422263 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.422626 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.422692 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.422746 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.422746 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.422840 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.422893 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.422954 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.423009 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.423062 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.423062 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.423153 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.423280 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.423338 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.423392 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.423444 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.423496 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.423555 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.423610 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.423662 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.423662 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.423753 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.423812 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.423866 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.423918 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.423994 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.424050 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.424104 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.424165 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.424220 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.424220 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.424313 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.424366 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.424419 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.424479 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.424534 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.424587 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.424640 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.424693 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.424747 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.424808 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.424863 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.424916 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.424916 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.425009 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.425130 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.425188 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.425241 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.425241 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.425336 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.425389 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.425449 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.425504 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.425557 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.425610 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.425663 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.425716 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.425716 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.425820 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.425873 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.425926 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.425979 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.426040 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.426095 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.426148 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.426202 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.426261 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.426316 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.426394 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.426469 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.426469 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.426621 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.426692 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.426818 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.426937 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.428368 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.428447 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.428507 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.428562 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.428616 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.428616 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.428616 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.428762 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.428762 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.428762 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.428762 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.428762 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.428762 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.428762 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.429064 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.429118 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.429171 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.429224 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.429286 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.429342 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.429342 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.429435 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.429487 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.429487 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.429487 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.429627 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.429681 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.429733 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.429824 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.429880 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.429942 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.429998 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.430052 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.430106 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.430160 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.430214 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.430274 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.430330 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.430411 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.430411 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.430508 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.430562 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.430628 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.430695 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.430752 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.430807 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.430860 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.430860 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.430988 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.431068 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.431140 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.431223 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.431293 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.431706 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.431955 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.432212 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.432378 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.432469 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.432556 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.432654 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.432742 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.432827 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.432905 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.433033 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.433163 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.433372 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.434162 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.434389 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.434498 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.434557 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.434613 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.434613 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.434730 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.434786 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.434841 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.434896 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.434896 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.435002 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.435002 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.435100 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.435273 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.435351 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.435569 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.435667 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.435895 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.436007 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.436236 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.436322 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.436563 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.436691 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.436895 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.437031 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.437247 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.437474 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.437712 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.438054 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.438521 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.438521 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.438521 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.439230 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.439482 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.439482 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.439979 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.440079 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.440079 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.440268 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.440398 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.440558 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.440918 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.441313 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.441485 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.441485 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.441873 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.442047 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.442668 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.442896 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.442896 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.443353 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.443709 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.443874 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.444028 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.444028 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.444548 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.445038 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.445452 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.445684 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.445684 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.445987 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.446088 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.446203 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.446433 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.446514 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.446656 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.446731 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.446802 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.446802 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.447029 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.447149 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.447294 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.447367 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.447367 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.447570 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.447644 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.447701 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.447842 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.447919 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.447986 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.448137 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.448270 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.448422 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.448577 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.448744 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.448872 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.449023 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.449190 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.449451 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.450035 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.450035 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.450261 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.450447 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.450540 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.450659 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.450943 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.451121 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.451291 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.451436 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.451603 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.451728 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.451920 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.452029 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.452236 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.452526 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.452606 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.452741 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.452894 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.453113 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.453263 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.453499 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.453690 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.453861 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.453974 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.454228 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.454310 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.454571 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.454887 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.454961 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.455202 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.455318 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.455516 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.455619 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.455837 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.455940 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.456170 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.456276 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.456571 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.456905 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.457229 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.457303 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.457562 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.457628 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.457882 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.458021 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.458218 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.458359 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.458595 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.458701 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.458933 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.459029 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.459263 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.459340 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.459578 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.459644 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.462429 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.462541 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.462642 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.462723 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.462798 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.462870 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.462940 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.463009 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.463087 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.463158 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.463228 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.463296 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.463365 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.463433 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.463511 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.463583 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.463652 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.463720 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.463720 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.463720 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.463720 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.463963 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.464104 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.464368 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.464516 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.465638 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.465802 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.465940 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.466072 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.466072 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.466315 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.466486 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.466620 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.466995 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.467151 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.467281 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.467410 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.467548 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.467678 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.467808 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.467936 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.468063 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.468199 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.468328 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.468457 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.468584 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.468712 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.468855 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.468993 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.469122 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.469319 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.469460 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.469591 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.469728 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.469917 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.470147 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.470286 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.470819 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.470963 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.470963 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.471235 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.471484 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.471627 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.471766 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.471914 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.472053 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.472190 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.472326 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.472481 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.472692 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.472844 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.472983 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.473131 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.473267 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.473412 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.473550 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.473695 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.473834 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.473970 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.474107 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.474252 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.474417 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.474574 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.474713 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.474849 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.474995 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.475132 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.475276 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.475422 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.475738 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.475889 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.476027 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.476164 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.476340 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.476479 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.476615 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.476752 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.477188 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.477338 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.477486 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.477624 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.477761 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.477897 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.478074 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.478228 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.478384 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.478529 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.478665 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.478801 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.478936 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.479094 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.479232 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.479369 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.479505 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.479641 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.479776 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.479966 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.480112 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.480350 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.480547 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.480968 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.481135 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.481286 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.481424 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.481660 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.481804 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.481942 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.481942 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.482210 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.482443 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.482592 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.483317 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.483434 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.483789 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.483951 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.484090 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.484226 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.484362 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.484499 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.484716 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.484856 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.484993 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.485129 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.485265 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.485410 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.485548 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.485685 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.485841 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.485979 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.486115 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.486259 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.486440 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.486582 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.486720 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=128801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 04 20:32:45.486856 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.486856 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.486856 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.486856 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 20:32:45.486856 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=128802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 04 20:32:45.549762 n-d-854823-8 devstack@n-api.service[128801]: INFO dbcounter [None req-67446b7f-d179-4b1e-9552-745c8ebe7b44 None None] Registered counter for database nova_api Oct 04 20:32:45.550879 n-d-854823-8 devstack@n-api.service[128802]: INFO dbcounter [None req-9941a912-4948-4bb2-9a01-e8b080f0c227 None None] Registered counter for database nova_api Oct 04 20:32:45.572147 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_db.sqlalchemy.engines [None req-67446b7f-d179-4b1e-9552-745c8ebe7b44 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128801) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 20:32:45.573629 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_db.sqlalchemy.engines [None req-9941a912-4948-4bb2-9a01-e8b080f0c227 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128802) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 20:32:45.579594 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writer thread running {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 20:32:45.580813 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writer thread running {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 20:32:45.638206 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.context [None req-67446b7f-d179-4b1e-9552-745c8ebe7b44 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),189ff13b-7538-4a71-a71c-1e7f1d3e1b46(cell1) {{(pid=128801) load_cells /opt/stack/nova/nova/context.py:464}} Oct 04 20:32:45.638547 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.context [None req-9941a912-4948-4bb2-9a01-e8b080f0c227 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),189ff13b-7538-4a71-a71c-1e7f1d3e1b46(cell1) {{(pid=128802) load_cells /opt/stack/nova/nova/context.py:464}} Oct 04 20:32:45.642278 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-67446b7f-d179-4b1e-9552-745c8ebe7b44 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:45.642402 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9941a912-4948-4bb2-9a01-e8b080f0c227 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:45.642783 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-67446b7f-d179-4b1e-9552-745c8ebe7b44 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:45.642902 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9941a912-4948-4bb2-9a01-e8b080f0c227 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:45.644363 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-67446b7f-d179-4b1e-9552-745c8ebe7b44 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:45.644461 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9941a912-4948-4bb2-9a01-e8b080f0c227 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:45.645100 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-67446b7f-d179-4b1e-9552-745c8ebe7b44 None None] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:45.645208 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9941a912-4948-4bb2-9a01-e8b080f0c227 None None] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:32:45.645551 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9941a912-4948-4bb2-9a01-e8b080f0c227 None None] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:45.645653 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-67446b7f-d179-4b1e-9552-745c8ebe7b44 None None] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:32:45.648180 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-67446b7f-d179-4b1e-9552-745c8ebe7b44 None None] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:45.648267 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9941a912-4948-4bb2-9a01-e8b080f0c227 None None] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:32:45.649618 n-d-854823-8 devstack@n-api.service[128801]: INFO dbcounter [None req-67446b7f-d179-4b1e-9552-745c8ebe7b44 None None] Registered counter for database nova_cell0 Oct 04 20:32:45.649732 n-d-854823-8 devstack@n-api.service[128802]: INFO dbcounter [None req-9941a912-4948-4bb2-9a01-e8b080f0c227 None None] Registered counter for database nova_cell0 Oct 04 20:32:45.654460 n-d-854823-8 devstack@n-api.service[128802]: INFO dbcounter [None req-9941a912-4948-4bb2-9a01-e8b080f0c227 None None] Registered counter for database nova_cell1 Oct 04 20:32:45.654574 n-d-854823-8 devstack@n-api.service[128801]: INFO dbcounter [None req-67446b7f-d179-4b1e-9552-745c8ebe7b44 None None] Registered counter for database nova_cell1 Oct 04 20:32:45.662112 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_db.sqlalchemy.engines [None req-67446b7f-d179-4b1e-9552-745c8ebe7b44 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128801) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 20:32:45.663710 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_db.sqlalchemy.engines [None req-9941a912-4948-4bb2-9a01-e8b080f0c227 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128802) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 20:32:45.666106 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_db.sqlalchemy.engines [None req-67446b7f-d179-4b1e-9552-745c8ebe7b44 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128801) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 20:32:45.667452 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_db.sqlalchemy.engines [None req-9941a912-4948-4bb2-9a01-e8b080f0c227 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128802) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 20:32:45.672839 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writer thread running {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 20:32:45.673901 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writer thread running {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 20:32:45.674983 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writer thread running {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 20:32:45.675228 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writer thread running {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 20:32:45.831487 n-d-854823-8 devstack@n-api.service[128801]: INFO dbcounter [None req-67446b7f-d179-4b1e-9552-745c8ebe7b44 None None] Registered counter for database nova_cell0 Oct 04 20:32:45.832568 n-d-854823-8 devstack@n-api.service[128802]: INFO dbcounter [None req-9941a912-4948-4bb2-9a01-e8b080f0c227 None None] Registered counter for database nova_cell0 Oct 04 20:32:45.838829 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_db.sqlalchemy.engines [None req-67446b7f-d179-4b1e-9552-745c8ebe7b44 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128801) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 20:32:45.842795 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_db.sqlalchemy.engines [None req-9941a912-4948-4bb2-9a01-e8b080f0c227 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128802) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 20:32:45.845490 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writer thread running {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 20:32:45.847341 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writer thread running {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 20:32:46.178913 n-d-854823-8 devstack@n-api.service[128802]: WARNING keystonemiddleware.auth_token [None req-9941a912-4948-4bb2-9a01-e8b080f0c227 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 04 20:32:46.186921 n-d-854823-8 devstack@n-api.service[128802]: WARNING keystonemiddleware.auth_token [None req-9941a912-4948-4bb2-9a01-e8b080f0c227 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 04 20:32:46.187727 n-d-854823-8 devstack@n-api.service[128801]: WARNING keystonemiddleware.auth_token [None req-67446b7f-d179-4b1e-9552-745c8ebe7b44 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 04 20:32:46.195046 n-d-854823-8 devstack@n-api.service[128801]: WARNING keystonemiddleware.auth_token [None req-67446b7f-d179-4b1e-9552-745c8ebe7b44 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 04 20:32:46.542392 n-d-854823-8 devstack@n-api.service[128802]: WARNING keystonemiddleware.auth_token [None req-9941a912-4948-4bb2-9a01-e8b080f0c227 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 04 20:32:46.550072 n-d-854823-8 devstack@n-api.service[128802]: WARNING keystonemiddleware.auth_token [None req-9941a912-4948-4bb2-9a01-e8b080f0c227 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 04 20:32:46.555499 n-d-854823-8 devstack@n-api.service[128802]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x563b4a3149c0 pid: 128802 (default app) Oct 04 20:32:46.559406 n-d-854823-8 devstack@n-api.service[128801]: WARNING keystonemiddleware.auth_token [None req-67446b7f-d179-4b1e-9552-745c8ebe7b44 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 04 20:32:46.565570 n-d-854823-8 devstack@n-api.service[128801]: WARNING keystonemiddleware.auth_token [None req-67446b7f-d179-4b1e-9552-745c8ebe7b44 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 04 20:32:46.571013 n-d-854823-8 devstack@n-api.service[128801]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x563b4a3149c0 pid: 128801 (default app) Oct 04 20:33:25.314666 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_api:SELECT=3 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:33:25.315870 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=3 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:33:25.317159 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell0:SELECT=3 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:33:25.317871 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell0:SELECT=3 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:33:26.654129 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-9bae9e55-fffd-4701-94fa-cc7be9762d35 tempest-AggregatesAdminTestJSON-1866202774 tempest-AggregatesAdminTestJSON-1866202774-project-admin] Calling method '.version_select at 0x7f3c761e3940>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:26.660777 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-9bae9e55-fffd-4701-94fa-cc7be9762d35 tempest-AggregatesAdminTestJSON-1866202774 tempest-AggregatesAdminTestJSON-1866202774-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),189ff13b-7538-4a71-a71c-1e7f1d3e1b46(cell1) {{(pid=128802) load_cells /opt/stack/nova/nova/compute/api.py:319}} Oct 04 20:33:26.661498 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9bae9e55-fffd-4701-94fa-cc7be9762d35 tempest-AggregatesAdminTestJSON-1866202774 tempest-AggregatesAdminTestJSON-1866202774-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:26.661970 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9bae9e55-fffd-4701-94fa-cc7be9762d35 tempest-AggregatesAdminTestJSON-1866202774 tempest-AggregatesAdminTestJSON-1866202774-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:26.662417 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9bae9e55-fffd-4701-94fa-cc7be9762d35 tempest-AggregatesAdminTestJSON-1866202774 tempest-AggregatesAdminTestJSON-1866202774-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:26.690039 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9bae9e55-fffd-4701-94fa-cc7be9762d35 tempest-AggregatesAdminTestJSON-1866202774 tempest-AggregatesAdminTestJSON-1866202774-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:26.690592 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9bae9e55-fffd-4701-94fa-cc7be9762d35 tempest-AggregatesAdminTestJSON-1866202774 tempest-AggregatesAdminTestJSON-1866202774-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:26.692738 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9bae9e55-fffd-4701-94fa-cc7be9762d35 tempest-AggregatesAdminTestJSON-1866202774 tempest-AggregatesAdminTestJSON-1866202774-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:26.706663 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9bae9e55-fffd-4701-94fa-cc7be9762d35 tempest-AggregatesAdminTestJSON-1866202774 tempest-AggregatesAdminTestJSON-1866202774-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:26.707142 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9bae9e55-fffd-4701-94fa-cc7be9762d35 tempest-AggregatesAdminTestJSON-1866202774 tempest-AggregatesAdminTestJSON-1866202774-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:26.707585 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9bae9e55-fffd-4701-94fa-cc7be9762d35 tempest-AggregatesAdminTestJSON-1866202774 tempest-AggregatesAdminTestJSON-1866202774-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:26.715021 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-9bae9e55-fffd-4701-94fa-cc7be9762d35 tempest-AggregatesAdminTestJSON-1866202774 tempest-AggregatesAdminTestJSON-1866202774-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1503 microversion: 2.1 time: 1.405399 Oct 04 20:33:26.716057 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1/1] 10.222.0.33 () {58 vars in 1167 bytes} [Tue Oct 4 20:33:25 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1503 bytes in 1409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:33:26.972109 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f40b2326-f7c8-4404-97b2-27bad2042f4b tempest-AggregatesAdminTestJSON-1866202774 tempest-AggregatesAdminTestJSON-1866202774-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-1823779456", "name": "tempest-test_aggregate-777852634"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:33:27.009623 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.objects.aggregate [None req-f40b2326-f7c8-4404-97b2-27bad2042f4b tempest-AggregatesAdminTestJSON-1866202774 tempest-AggregatesAdminTestJSON-1866202774-project-admin] Generated uuid 31303ca7-d2c6-4a9d-afb0-ef9abbcdd537 for aggregate {{(pid=128801) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 20:33:27.020035 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=3 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:33:27.021064 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=3 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:33:27.022184 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=3 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:33:27.022971 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=3 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:33:27.133829 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f40b2326-f7c8-4404-97b2-27bad2042f4b tempest-AggregatesAdminTestJSON-1866202774 tempest-AggregatesAdminTestJSON-1866202774-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates" status: 200 len: 221 microversion: 2.1 time: 0.401202 Oct 04 20:33:27.135014 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1/2] 10.222.0.33 () {60 vars in 1165 bytes} [Tue Oct 4 20:33:26 2022] POST /compute/v2.1/os-aggregates => generated 221 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:33:27.147050 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-c5e96fb8-3206-4cee-9890-e975e49c1057 tempest-AggregatesAdminTestJSON-1866202774 tempest-AggregatesAdminTestJSON-1866202774-project-admin] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:27.169578 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-c5e96fb8-3206-4cee-9890-e975e49c1057 tempest-AggregatesAdminTestJSON-1866202774 tempest-AggregatesAdminTestJSON-1866202774-project-admin] 10.222.0.33 "GET /compute/v2.1/os-aggregates" status: 200 len: 302 microversion: 2.1 time: 0.026031 Oct 04 20:33:27.170694 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2/3] 10.222.0.33 () {58 vars in 1143 bytes} [Tue Oct 4 20:33:27 2022] GET /compute/v2.1/os-aggregates => generated 302 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:33:27.185189 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-257e4090-a233-4bc0-9ea6-6738e55f56a7 tempest-AggregatesAdminTestJSON-1866202774 tempest-AggregatesAdminTestJSON-1866202774-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-854823-8"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:33:27.211706 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-257e4090-a233-4bc0-9ea6-6738e55f56a7 tempest-AggregatesAdminTestJSON-1866202774 tempest-AggregatesAdminTestJSON-1866202774-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:27.212639 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-257e4090-a233-4bc0-9ea6-6738e55f56a7 tempest-AggregatesAdminTestJSON-1866202774 tempest-AggregatesAdminTestJSON-1866202774-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:27.213314 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-257e4090-a233-4bc0-9ea6-6738e55f56a7 tempest-AggregatesAdminTestJSON-1866202774 tempest-AggregatesAdminTestJSON-1866202774-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:28.340184 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-98f9cf80-e905-451c-99a1-b37c1f70fd4d tempest-AggregatesAdminTestV241-744529003 tempest-AggregatesAdminTestV241-744529003-project-admin] Calling method '.version_select at 0x7f3c760addc0>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:28.347321 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-98f9cf80-e905-451c-99a1-b37c1f70fd4d tempest-AggregatesAdminTestV241-744529003 tempest-AggregatesAdminTestV241-744529003-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:28.348116 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-98f9cf80-e905-451c-99a1-b37c1f70fd4d tempest-AggregatesAdminTestV241-744529003 tempest-AggregatesAdminTestV241-744529003-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:28.348695 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-98f9cf80-e905-451c-99a1-b37c1f70fd4d tempest-AggregatesAdminTestV241-744529003 tempest-AggregatesAdminTestV241-744529003-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:28.370910 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-98f9cf80-e905-451c-99a1-b37c1f70fd4d tempest-AggregatesAdminTestV241-744529003 tempest-AggregatesAdminTestV241-744529003-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:28.371775 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-98f9cf80-e905-451c-99a1-b37c1f70fd4d tempest-AggregatesAdminTestV241-744529003 tempest-AggregatesAdminTestV241-744529003-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:28.372642 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-98f9cf80-e905-451c-99a1-b37c1f70fd4d tempest-AggregatesAdminTestV241-744529003 tempest-AggregatesAdminTestV241-744529003-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:28.385185 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-98f9cf80-e905-451c-99a1-b37c1f70fd4d tempest-AggregatesAdminTestV241-744529003 tempest-AggregatesAdminTestV241-744529003-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:28.386007 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-98f9cf80-e905-451c-99a1-b37c1f70fd4d tempest-AggregatesAdminTestV241-744529003 tempest-AggregatesAdminTestV241-744529003-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:28.386728 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-98f9cf80-e905-451c-99a1-b37c1f70fd4d tempest-AggregatesAdminTestV241-744529003 tempest-AggregatesAdminTestV241-744529003-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:28.395351 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-98f9cf80-e905-451c-99a1-b37c1f70fd4d tempest-AggregatesAdminTestV241-744529003 tempest-AggregatesAdminTestV241-744529003-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1423 microversion: 2.41 time: 0.573947 Oct 04 20:33:28.396122 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3/4] 10.222.0.33 () {60 vars in 1208 bytes} [Tue Oct 4 20:33:27 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1423 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:33:28.805075 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-257e4090-a233-4bc0-9ea6-6738e55f56a7 tempest-AggregatesAdminTestJSON-1866202774 tempest-AggregatesAdminTestJSON-1866202774-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 314 microversion: 2.1 time: 1.626045 Oct 04 20:33:28.808030 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2/5] 10.222.0.33 () {60 vars in 1191 bytes} [Tue Oct 4 20:33:27 2022] POST /compute/v2.1/os-aggregates/1/action => generated 314 bytes in 1630 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 20:33:29.151009 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-c468a604-e91f-44ce-9950-4880db91b8a0 tempest-FlavorsExtraSpecsNegativeTestJSON-1471772981 tempest-FlavorsExtraSpecsNegativeTestJSON-1471772981-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-1290068211", "ram": 512, "vcpus": 1, "disk": 10, "id": 748798454, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:33:29.248877 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-c468a604-e91f-44ce-9950-4880db91b8a0 tempest-FlavorsExtraSpecsNegativeTestJSON-1471772981 tempest-FlavorsExtraSpecsNegativeTestJSON-1471772981-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.836658 Oct 04 20:33:29.261534 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 4/6] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 20:33:28 2022] POST /compute/v2.1/flavors => generated 413 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:33:29.390894 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-a13a4b70-04c9-476c-aa59-8b18df450c6d tempest-FlavorsAdminTestJSON-334926784 tempest-FlavorsAdminTestJSON-334926784-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": "1024", "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-591274989", "id": 369085659, "os-flavor-access:is_public": "True"}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:33:29.391549 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-4184975b-2d58-4fcf-bd70-8ab15873cc10 tempest-AggregatesAdminNegativeTestJSON-907895620 tempest-AggregatesAdminNegativeTestJSON-907895620-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:29.396135 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4184975b-2d58-4fcf-bd70-8ab15873cc10 tempest-AggregatesAdminNegativeTestJSON-907895620 tempest-AggregatesAdminNegativeTestJSON-907895620-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:29.396759 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4184975b-2d58-4fcf-bd70-8ab15873cc10 tempest-AggregatesAdminNegativeTestJSON-907895620 tempest-AggregatesAdminNegativeTestJSON-907895620-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:29.397289 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4184975b-2d58-4fcf-bd70-8ab15873cc10 tempest-AggregatesAdminNegativeTestJSON-907895620 tempest-AggregatesAdminNegativeTestJSON-907895620-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:29.398090 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4184975b-2d58-4fcf-bd70-8ab15873cc10 tempest-AggregatesAdminNegativeTestJSON-907895620 tempest-AggregatesAdminNegativeTestJSON-907895620-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:29.398810 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4184975b-2d58-4fcf-bd70-8ab15873cc10 tempest-AggregatesAdminNegativeTestJSON-907895620 tempest-AggregatesAdminNegativeTestJSON-907895620-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:29.399308 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4184975b-2d58-4fcf-bd70-8ab15873cc10 tempest-AggregatesAdminNegativeTestJSON-907895620 tempest-AggregatesAdminNegativeTestJSON-907895620-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:29.421817 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-a13a4b70-04c9-476c-aa59-8b18df450c6d tempest-FlavorsAdminTestJSON-334926784 tempest-FlavorsAdminTestJSON-334926784-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 426 microversion: 2.1 time: 0.158073 Oct 04 20:33:29.423026 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 5/7] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 20:33:29 2022] POST /compute/v2.1/flavors => generated 426 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:33:29.436852 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-4184975b-2d58-4fcf-bd70-8ab15873cc10 tempest-AggregatesAdminNegativeTestJSON-907895620 tempest-AggregatesAdminNegativeTestJSON-907895620-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 402 microversion: 2.1 time: 0.625082 Oct 04 20:33:29.437982 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3/8] 10.222.0.33 () {58 vars in 1176 bytes} [Tue Oct 4 20:33:28 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 402 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:33:29.495356 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-8b70abe1-5176-4162-b62d-fc2e235e5e05 tempest-FlavorsAccessTestJSON-577610606 tempest-FlavorsAccessTestJSON-577610606-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-1173399971", "id": 123201874, "os-flavor-access:is_public": "False"}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:33:29.523249 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-8b70abe1-5176-4162-b62d-fc2e235e5e05 tempest-FlavorsAccessTestJSON-577610606 tempest-FlavorsAccessTestJSON-577610606-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 428 microversion: 2.1 time: 0.098861 Oct 04 20:33:29.526025 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 6/9] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 20:33:29 2022] POST /compute/v2.1/flavors => generated 428 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:33:29.613948 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-55116ae5-5f06-42b8-a061-25feaf84cab6 tempest-FlavorsExtraSpecsNegativeTestJSON-915050958 tempest-FlavorsExtraSpecsNegativeTestJSON-915050958-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:29.637834 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-55116ae5-5f06-42b8-a061-25feaf84cab6 tempest-FlavorsExtraSpecsNegativeTestJSON-915050958 tempest-FlavorsExtraSpecsNegativeTestJSON-915050958-project] HTTP exception thrown: Flavor 748798454 has no extra specs with key hw:cpu_thread_policy. Oct 04 20:33:29.640434 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-55116ae5-5f06-42b8-a061-25feaf84cab6 tempest-FlavorsExtraSpecsNegativeTestJSON-915050958 tempest-FlavorsExtraSpecsNegativeTestJSON-915050958-project] Request method failure captured: Oct 04 20:33:29.640434 n-d-854823-8 devstack@n-api.service[128801]: request: GET /compute/v2.1/flavors/748798454/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Oct 04 20:33:29.640434 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:33:29.640434 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:33:29.640434 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:33:29.640434 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 0 Oct 04 20:33:29.640434 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:33:29.640434 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:33:29.640434 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:33:29.640434 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:33:29.640434 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJiVeFka4cYhi8qztf_cW8xIsI1rLZC_ZvNxJMSEJROTyn5HGyv5dcsPdZJYSJOvlQweJ4i8PMzts-DGh0tT7FCeG4saiL3ADcE_tbQND6DWUk5UZMxChmczsVIKtLHsQNyAsPXQRaoSnKUG0CYRpGh8p-78aNutxeFLeCJ3eNg8n2c Oct 04 20:33:29.640434 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:33:29.640434 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:33:29.640434 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:33:29.640434 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:33:29.640434 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:33:29.640434 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:33:29.640434 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: 2844fc2857ef4a83a395969797ad3905 Oct 04 20:33:29.640434 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-915050958 Oct 04 20:33:29.640434 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 20:33:29.640434 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 20:33:29.641756 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_2844fc2857ef4a83a395969797ad3905", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2844fc2857ef4a83a395969797ad3905"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2844fc2857ef4a83a395969797ad3905"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/2844fc2857ef4a83a395969797ad3905"}]}] Oct 04 20:33:29.641756 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-915050958 Oct 04 20:33:29.641756 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: 2844fc2857ef4a83a395969797ad3905 Oct 04 20:33:29.641756 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-915050958 Oct 04 20:33:29.641756 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-915050958-project Oct 04 20:33:29.641756 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:33:29.641756 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:33:29.641756 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: 74f4f9411de04d6baa26137f08049851 Oct 04 20:33:29.641756 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-915050958-project Oct 04 20:33:29.641756 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 20:33:29.641756 n-d-854823-8 devstack@n-api.service[128801]: exception: Flavor 748798454 has no extra specs with key hw:cpu_thread_policy. Oct 04 20:33:29.642543 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'flavor_id': '748798454', 'id': 'hw:cpu_thread_policy'} Oct 04 20:33:29.642543 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:33:29.642543 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:33:29.642543 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 115, in show Oct 04 20:33:29.642543 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return {id: flavor.extra_specs[id]} Oct 04 20:33:29.642543 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Oct 04 20:33:29.642543 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:33:29.642543 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:33:29.642543 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:33:29.642543 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:33:29.642543 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:33:29.642543 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:33:29.642543 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:33:29.642543 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:33:29.642543 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:33:29.642543 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:33:29.642543 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 120, in show Oct 04 20:33:29.642543 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 04 20:33:29.642543 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 748798454 has no extra specs with key hw:cpu_thread_policy. Oct 04 20:33:29.642543 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:33:29.642543 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:33:29.642543 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:33:29.643736 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:33:29.643736 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:33:29.643736 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:33:29.643736 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:33:29.643736 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:33:29.643736 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 748798454 has no extra specs with key hw:cpu_thread_policy. Oct 04 20:33:29.643736 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:33:29.645045 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-55116ae5-5f06-42b8-a061-25feaf84cab6 tempest-FlavorsExtraSpecsNegativeTestJSON-915050958 tempest-FlavorsExtraSpecsNegativeTestJSON-915050958-project] Returning 404 to user: Flavor 748798454 has no extra specs with key hw:cpu_thread_policy. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:33:29.646074 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-55116ae5-5f06-42b8-a061-25feaf84cab6 tempest-FlavorsExtraSpecsNegativeTestJSON-915050958 tempest-FlavorsExtraSpecsNegativeTestJSON-915050958-project] 10.222.0.33 "GET /compute/v2.1/flavors/748798454/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 112 microversion: 2.1 time: 0.206786 Oct 04 20:33:29.647199 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 4/10] 10.222.0.33 () {58 vars in 1263 bytes} [Tue Oct 4 20:33:29 2022] GET /compute/v2.1/flavors/748798454/os-extra_specs/hw:cpu_thread_policy => generated 112 bytes in 208 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:33:29.656097 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2be840e7-7488-43f9-a8e2-ef2232e3f0bb tempest-FlavorsAdminTestJSON-334926784 tempest-FlavorsAdminTestJSON-334926784-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:29.692734 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-2be840e7-7488-43f9-a8e2-ef2232e3f0bb tempest-FlavorsAdminTestJSON-334926784 tempest-FlavorsAdminTestJSON-334926784-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/369085659" status: 202 len: 0 microversion: 2.1 time: 0.044290 Oct 04 20:33:29.697086 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 5/11] 10.222.0.33 () {58 vars in 1158 bytes} [Tue Oct 4 20:33:29 2022] DELETE /compute/v2.1/flavors/369085659 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:33:29.707285 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1f111f47-8760-4fba-ab26-73d026c033e3 tempest-FlavorsAccessTestJSON-577610606 tempest-FlavorsAccessTestJSON-577610606-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "d5977073350c4e92800dca8180ed5a4d"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:33:29.841436 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-c74c53f9-09e6-4ea1-a2da-e522098793aa tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AggregatesAdminTestJSON-server-1752105939", "imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63", "flavorRef": "452", "availability_zone": "tempest-test_az-1823779456"}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:33:29.885282 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c74c53f9-09e6-4ea1-a2da-e522098793aa tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:29.886524 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c74c53f9-09e6-4ea1-a2da-e522098793aa tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:29.887180 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c74c53f9-09e6-4ea1-a2da-e522098793aa tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:29.888076 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c74c53f9-09e6-4ea1-a2da-e522098793aa tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:29.888688 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c74c53f9-09e6-4ea1-a2da-e522098793aa tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:29.889557 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c74c53f9-09e6-4ea1-a2da-e522098793aa tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:29.988163 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-1f111f47-8760-4fba-ab26-73d026c033e3 tempest-FlavorsAccessTestJSON-577610606 tempest-FlavorsAccessTestJSON-577610606-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors/123201874/action" status: 200 len: 96 microversion: 2.1 time: 0.289463 Oct 04 20:33:29.993588 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 6/12] 10.222.0.33 () {60 vars in 1197 bytes} [Tue Oct 4 20:33:29 2022] POST /compute/v2.1/flavors/123201874/action => generated 96 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 20:33:29.994694 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8893cb87-c78b-4158-a15a-0abd96dc8f7e tempest-FlavorsExtraSpecsNegativeTestJSON-915050958 tempest-FlavorsExtraSpecsNegativeTestJSON-915050958-project] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:33:30.000555 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-8893cb87-c78b-4158-a15a-0abd96dc8f7e tempest-FlavorsExtraSpecsNegativeTestJSON-915050958 tempest-FlavorsExtraSpecsNegativeTestJSON-915050958-project] Policy check for os_compute_api:os-flavor-extra-specs:create failed with credentials {'is_admin': False, 'user_id': '74f4f9411de04d6baa26137f08049851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2844fc2857ef4a83a395969797ad3905', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:33:30.004310 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8893cb87-c78b-4158-a15a-0abd96dc8f7e tempest-FlavorsExtraSpecsNegativeTestJSON-915050958 tempest-FlavorsExtraSpecsNegativeTestJSON-915050958-project] Request method failure captured: Oct 04 20:33:30.004310 n-d-854823-8 devstack@n-api.service[128801]: request: POST /compute/v2.1/flavors/748798454/os-extra_specs HTTP/1.1 Oct 04 20:33:30.004310 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:33:30.004310 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:33:30.004310 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:33:30.004310 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 66 Oct 04 20:33:30.004310 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:33:30.004310 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:33:30.004310 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:33:30.004310 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:33:30.004310 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJiVeFka4cYhi8qztf_cW8xIsI1rLZC_ZvNxJMSEJROTyn5HGyv5dcsPdZJYSJOvlQweJ4i8PMzts-DGh0tT7FCeG4saiL3ADcE_tbQND6DWUk5UZMxChmczsVIKtLHsQNyAsPXQRaoSnKUG0CYRpGh8p-78aNutxeFLeCJ3eNg8n2c Oct 04 20:33:30.004310 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:33:30.004310 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:33:30.004310 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:33:30.004310 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:33:30.004310 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:33:30.004310 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:33:30.004310 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: 2844fc2857ef4a83a395969797ad3905 Oct 04 20:33:30.004310 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-915050958 Oct 04 20:33:30.004310 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 20:33:30.004310 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 20:33:30.005403 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_2844fc2857ef4a83a395969797ad3905", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2844fc2857ef4a83a395969797ad3905"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2844fc2857ef4a83a395969797ad3905"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/2844fc2857ef4a83a395969797ad3905"}]}] Oct 04 20:33:30.005403 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-915050958 Oct 04 20:33:30.005403 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: 2844fc2857ef4a83a395969797ad3905 Oct 04 20:33:30.005403 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-915050958 Oct 04 20:33:30.005403 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-915050958-project Oct 04 20:33:30.005403 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:33:30.005403 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:33:30.005403 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: 74f4f9411de04d6baa26137f08049851 Oct 04 20:33:30.005403 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-915050958-project Oct 04 20:33:30.005403 n-d-854823-8 devstack@n-api.service[128801]: Oct 04 20:33:30.005403 n-d-854823-8 devstack@n-api.service[128801]: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} Oct 04 20:33:30.005403 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 20:33:30.006007 n-d-854823-8 devstack@n-api.service[128801]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Oct 04 20:33:30.006007 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'flavor_id': '748798454', 'body': {'extra_specs': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}}} Oct 04 20:33:30.006007 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:33:30.006007 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:33:30.006007 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:33:30.006007 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:33:30.006007 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:33:30.006007 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:33:30.006007 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:33:30.006007 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:33:30.006007 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:33:30.006007 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:33:30.006007 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 73, in create Oct 04 20:33:30.006007 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'create', target={}) Oct 04 20:33:30.006007 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 20:33:30.006007 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 20:33:30.006007 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 20:33:30.006007 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 20:33:30.006007 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 20:33:30.006947 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 20:33:30.006947 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 20:33:30.006947 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 20:33:30.006947 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 20:33:30.006947 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 20:33:30.006947 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 20:33:30.006947 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 20:33:30.006947 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 20:33:30.006947 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 20:33:30.006947 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Oct 04 20:33:30.006947 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:33:30.006947 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:33:30.006947 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:33:30.006947 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:33:30.006947 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:33:30.006947 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:33:30.006947 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 20:33:30.006947 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 20:33:30.006947 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Oct 04 20:33:30.006947 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:33:30.011038 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8893cb87-c78b-4158-a15a-0abd96dc8f7e tempest-FlavorsExtraSpecsNegativeTestJSON-915050958 tempest-FlavorsExtraSpecsNegativeTestJSON-915050958-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:33:30.012641 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-8893cb87-c78b-4158-a15a-0abd96dc8f7e tempest-FlavorsExtraSpecsNegativeTestJSON-915050958 tempest-FlavorsExtraSpecsNegativeTestJSON-915050958-project] 10.222.0.33 "POST /compute/v2.1/flavors/748798454/os-extra_specs" status: 403 len: 124 microversion: 2.1 time: 0.022308 Oct 04 20:33:30.019166 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 7/13] 10.222.0.33 () {60 vars in 1221 bytes} [Tue Oct 4 20:33:29 2022] POST /compute/v2.1/flavors/748798454/os-extra_specs => generated 124 bytes in 29 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:33:30.028788 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-07536782-0b3c-40db-85f5-bf73e36d77b6 tempest-FlavorsAdminTestJSON-334926784 tempest-FlavorsAdminTestJSON-334926784-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:30.068152 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-07536782-0b3c-40db-85f5-bf73e36d77b6 tempest-FlavorsAdminTestJSON-334926784 tempest-FlavorsAdminTestJSON-334926784-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 5394 microversion: 2.1 time: 0.047303 Oct 04 20:33:30.068982 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 8/14] 10.222.0.33 () {58 vars in 1146 bytes} [Tue Oct 4 20:33:30 2022] GET /compute/v2.1/flavors/detail => generated 5394 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:33:30.271898 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e094c9b5-3978-4ec1-a77f-70f855fe22cc tempest-FlavorsAccessTestJSON-909923831 tempest-FlavorsAccessTestJSON-909923831-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:30.380491 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e094c9b5-3978-4ec1-a77f-70f855fe22cc tempest-FlavorsAccessTestJSON-909923831 tempest-FlavorsAccessTestJSON-909923831-project] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 5812 microversion: 2.1 time: 0.310036 Oct 04 20:33:30.381066 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 9/15] 10.222.0.33 () {58 vars in 1146 bytes} [Tue Oct 4 20:33:30 2022] GET /compute/v2.1/flavors/detail => generated 5812 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:33:30.381810 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.network.neutron [None req-c74c53f9-09e6-4ea1-a2da-e522098793aa tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] validate_networks() for None {{(pid=128802) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:33:30.418308 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f3981f86-18c3-4580-9371-eb0e41e07b77 tempest-FlavorsExtraSpecsNegativeTestJSON-1471772981 tempest-FlavorsExtraSpecsNegativeTestJSON-1471772981-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:33:30.495597 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f3981f86-18c3-4580-9371-eb0e41e07b77 tempest-FlavorsExtraSpecsNegativeTestJSON-1471772981 tempest-FlavorsExtraSpecsNegativeTestJSON-1471772981-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors/748798454/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.101774 Oct 04 20:33:30.501077 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 10/16] 10.222.0.33 () {60 vars in 1221 bytes} [Tue Oct 4 20:33:30 2022] POST /compute/v2.1/flavors/748798454/os-extra_specs => generated 66 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 20:33:30.513813 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5d2f5c94-3ca8-4cf9-a8b6-639016ec3b1e tempest-FlavorsAdminTestJSON-334926784 tempest-FlavorsAdminTestJSON-334926784-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1676251958", "id": 303985694, "swap": 1024, "rxtx_factor": 2, "OS-FLV-EXT-DATA:ephemeral": 10, "os-flavor-access:is_public": "True"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:33:30.548422 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5d2f5c94-3ca8-4cf9-a8b6-639016ec3b1e tempest-FlavorsAdminTestJSON-334926784 tempest-FlavorsAdminTestJSON-334926784-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.043813 Oct 04 20:33:30.549090 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 11/17] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 20:33:30 2022] POST /compute/v2.1/flavors => generated 414 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:33:30.556135 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-294421af-0f13-4f2e-8b61-c93de460f1f8 tempest-FlavorsAccessTestJSON-577610606 tempest-FlavorsAccessTestJSON-577610606-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "d5977073350c4e92800dca8180ed5a4d"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:33:31.006406 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-c74c53f9-09e6-4ea1-a2da-e522098793aa tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Flavor limits 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:33:31.006870 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-c74c53f9-09e6-4ea1-a2da-e522098793aa tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Image limits 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:33:31.007296 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-c74c53f9-09e6-4ea1-a2da-e522098793aa tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Flavor pref 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:33:31.007695 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-c74c53f9-09e6-4ea1-a2da-e522098793aa tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Image pref 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:33:31.008101 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-c74c53f9-09e6-4ea1-a2da-e522098793aa tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:33:31.025586 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c74c53f9-09e6-4ea1-a2da-e522098793aa tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:31.037487 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c74c53f9-09e6-4ea1-a2da-e522098793aa tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:31.037925 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c74c53f9-09e6-4ea1-a2da-e522098793aa tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:31.038714 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c74c53f9-09e6-4ea1-a2da-e522098793aa tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:31.039193 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c74c53f9-09e6-4ea1-a2da-e522098793aa tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:31.039727 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c74c53f9-09e6-4ea1-a2da-e522098793aa tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:31.060820 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-294421af-0f13-4f2e-8b61-c93de460f1f8 tempest-FlavorsAccessTestJSON-577610606 tempest-FlavorsAccessTestJSON-577610606-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors/123201874/action" status: 200 len: 21 microversion: 2.1 time: 0.510358 Oct 04 20:33:31.067577 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 12/18] 10.222.0.33 () {60 vars in 1197 bytes} [Tue Oct 4 20:33:30 2022] POST /compute/v2.1/flavors/123201874/action => generated 21 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 20:33:31.072360 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b13ad678-b9b8-4cbc-a96e-31b927639160 tempest-FlavorsExtraSpecsNegativeTestJSON-915050958 tempest-FlavorsExtraSpecsNegativeTestJSON-915050958-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:31.082970 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-b13ad678-b9b8-4cbc-a96e-31b927639160 tempest-FlavorsExtraSpecsNegativeTestJSON-915050958 tempest-FlavorsExtraSpecsNegativeTestJSON-915050958-project] Policy check for os_compute_api:os-flavor-extra-specs:delete failed with credentials {'is_admin': False, 'user_id': '74f4f9411de04d6baa26137f08049851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2844fc2857ef4a83a395969797ad3905', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:33:31.084714 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b13ad678-b9b8-4cbc-a96e-31b927639160 tempest-FlavorsExtraSpecsNegativeTestJSON-915050958 tempest-FlavorsExtraSpecsNegativeTestJSON-915050958-project] Request method failure captured: Oct 04 20:33:31.084714 n-d-854823-8 devstack@n-api.service[128801]: request: DELETE /compute/v2.1/flavors/748798454/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 04 20:33:31.084714 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:33:31.084714 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:33:31.084714 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:33:31.084714 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 0 Oct 04 20:33:31.084714 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:33:31.084714 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:33:31.084714 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:33:31.084714 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:33:31.084714 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJiVeFka4cYhi8qztf_cW8xIsI1rLZC_ZvNxJMSEJROTyn5HGyv5dcsPdZJYSJOvlQweJ4i8PMzts-DGh0tT7FCeG4saiL3ADcE_tbQND6DWUk5UZMxChmczsVIKtLHsQNyAsPXQRaoSnKUG0CYRpGh8p-78aNutxeFLeCJ3eNg8n2c Oct 04 20:33:31.084714 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:33:31.084714 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:33:31.084714 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:33:31.084714 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:33:31.084714 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:33:31.084714 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:33:31.084714 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: 2844fc2857ef4a83a395969797ad3905 Oct 04 20:33:31.084714 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-915050958 Oct 04 20:33:31.084714 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 20:33:31.084714 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 20:33:31.086017 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_2844fc2857ef4a83a395969797ad3905", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2844fc2857ef4a83a395969797ad3905"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2844fc2857ef4a83a395969797ad3905"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/2844fc2857ef4a83a395969797ad3905"}]}] Oct 04 20:33:31.086017 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-915050958 Oct 04 20:33:31.086017 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: 2844fc2857ef4a83a395969797ad3905 Oct 04 20:33:31.086017 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-915050958 Oct 04 20:33:31.086017 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-915050958-project Oct 04 20:33:31.086017 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:33:31.086017 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:33:31.086017 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: 74f4f9411de04d6baa26137f08049851 Oct 04 20:33:31.086017 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-915050958-project Oct 04 20:33:31.086017 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 20:33:31.086017 n-d-854823-8 devstack@n-api.service[128801]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Oct 04 20:33:31.086667 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'flavor_id': '748798454', 'id': 'hw:numa_nodes'} Oct 04 20:33:31.086667 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:33:31.086667 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:33:31.086667 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:33:31.086667 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:33:31.086667 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:33:31.086667 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:33:31.086667 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:33:31.086667 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:33:31.086667 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 129, in delete Oct 04 20:33:31.086667 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'delete', target={}) Oct 04 20:33:31.086667 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 20:33:31.086667 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 20:33:31.086667 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 20:33:31.086667 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 20:33:31.086667 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 20:33:31.086667 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 20:33:31.086667 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 20:33:31.086667 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 20:33:31.086667 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 20:33:31.087597 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 20:33:31.087597 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 20:33:31.087597 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 20:33:31.087597 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 20:33:31.087597 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 20:33:31.087597 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Oct 04 20:33:31.087597 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:33:31.087597 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:33:31.087597 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:33:31.087597 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:33:31.087597 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:33:31.087597 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:33:31.087597 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 20:33:31.087597 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 20:33:31.087597 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Oct 04 20:33:31.087597 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:33:31.089874 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b13ad678-b9b8-4cbc-a96e-31b927639160 tempest-FlavorsExtraSpecsNegativeTestJSON-915050958 tempest-FlavorsExtraSpecsNegativeTestJSON-915050958-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:33:31.091523 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b13ad678-b9b8-4cbc-a96e-31b927639160 tempest-FlavorsExtraSpecsNegativeTestJSON-915050958 tempest-FlavorsExtraSpecsNegativeTestJSON-915050958-project] 10.222.0.33 "DELETE /compute/v2.1/flavors/748798454/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.022741 Oct 04 20:33:31.092335 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 13/19] 10.222.0.33 () {58 vars in 1245 bytes} [Tue Oct 4 20:33:31 2022] DELETE /compute/v2.1/flavors/748798454/os-extra_specs/hw:numa_nodes => generated 124 bytes in 24 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:33:31.101098 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-584acc2e-c136-4f45-9a8c-1b666885d826 tempest-FlavorsAdminTestJSON-334926784 tempest-FlavorsAdminTestJSON-334926784-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:31.131014 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-c74c53f9-09e6-4ea1-a2da-e522098793aa tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Getting quotas for project 930b67acdd8f4d4ea2acf80bb5b28059. Resources: {'ram', 'instances', 'cores'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:33:31.138185 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-584acc2e-c136-4f45-9a8c-1b666885d826 tempest-FlavorsAdminTestJSON-334926784 tempest-FlavorsAdminTestJSON-334926784-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 5798 microversion: 2.1 time: 0.040489 Oct 04 20:33:31.139106 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 14/20] 10.222.0.33 () {58 vars in 1146 bytes} [Tue Oct 4 20:33:31 2022] GET /compute/v2.1/flavors/detail => generated 5798 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:33:31.144027 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b6e1f3be-c104-4bdf-9b8a-4d23987c0d43 tempest-FlavorsAccessTestJSON-909923831 tempest-FlavorsAccessTestJSON-909923831-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:31.157846 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-c74c53f9-09e6-4ea1-a2da-e522098793aa tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Getting quotas for user 24987e1b118a41169a1974dc40568156 and project 930b67acdd8f4d4ea2acf80bb5b28059. Resources: {'ram', 'instances', 'cores'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:33:31.185265 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-c74c53f9-09e6-4ea1-a2da-e522098793aa tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Going to run 1 instances... {{(pid=128802) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:33:31.188006 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b6e1f3be-c104-4bdf-9b8a-4d23987c0d43 tempest-FlavorsAccessTestJSON-909923831 tempest-FlavorsAccessTestJSON-909923831-project] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 5798 microversion: 2.1 time: 0.047468 Oct 04 20:33:31.191163 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-c74c53f9-09e6-4ea1-a2da-e522098793aa tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] [instance: f2ad1271-aaba-4fe4-8f6c-854cf8e80bb7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='15b24725-0c99-4bcf-b1fb-907cdf8e2d63',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128802) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:33:31.206641 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 15/21] 10.222.0.33 () {58 vars in 1146 bytes} [Tue Oct 4 20:33:31 2022] GET /compute/v2.1/flavors/detail => generated 5798 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:33:31.212255 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0aee5b5c-eaa7-4310-8e42-1b39be6e5f3f tempest-FlavorsExtraSpecsNegativeTestJSON-1471772981 tempest-FlavorsExtraSpecsNegativeTestJSON-1471772981-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:33:31.245846 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-0aee5b5c-eaa7-4310-8e42-1b39be6e5f3f tempest-FlavorsExtraSpecsNegativeTestJSON-1471772981 tempest-FlavorsExtraSpecsNegativeTestJSON-1471772981-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors/748798454/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.037125 Oct 04 20:33:31.251976 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 16/22] 10.222.0.33 () {60 vars in 1221 bytes} [Tue Oct 4 20:33:31 2022] POST /compute/v2.1/flavors/748798454/os-extra_specs => generated 66 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 20:33:31.256927 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-02d913e0-58ac-4b30-aaa0-16c0edc780c0 tempest-FlavorsAdminTestJSON-334926784 tempest-FlavorsAdminTestJSON-334926784-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:31.283601 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-02d913e0-58ac-4b30-aaa0-16c0edc780c0 tempest-FlavorsAdminTestJSON-334926784 tempest-FlavorsAdminTestJSON-334926784-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/303985694" status: 202 len: 0 microversion: 2.1 time: 0.030262 Oct 04 20:33:31.287285 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 17/23] 10.222.0.33 () {58 vars in 1158 bytes} [Tue Oct 4 20:33:31 2022] DELETE /compute/v2.1/flavors/303985694 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:33:31.295882 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ef21e7cc-1386-40f4-920d-db285fc51bae tempest-FlavorsAccessTestJSON-577610606 tempest-FlavorsAccessTestJSON-577610606-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:31.330461 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ef21e7cc-1386-40f4-920d-db285fc51bae tempest-FlavorsAccessTestJSON-577610606 tempest-FlavorsAccessTestJSON-577610606-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/123201874" status: 202 len: 0 microversion: 2.1 time: 0.044384 Oct 04 20:33:31.332168 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 18/24] 10.222.0.33 () {58 vars in 1158 bytes} [Tue Oct 4 20:33:31 2022] DELETE /compute/v2.1/flavors/123201874 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:33:31.344307 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5147f0ff-1f83-4fee-aaaf-09aa1bb33a68 tempest-FlavorsExtraSpecsNegativeTestJSON-915050958 tempest-FlavorsExtraSpecsNegativeTestJSON-915050958-project] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1"} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:33:31.353286 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-5147f0ff-1f83-4fee-aaaf-09aa1bb33a68 tempest-FlavorsExtraSpecsNegativeTestJSON-915050958 tempest-FlavorsExtraSpecsNegativeTestJSON-915050958-project] Policy check for os_compute_api:os-flavor-extra-specs:update failed with credentials {'is_admin': False, 'user_id': '74f4f9411de04d6baa26137f08049851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2844fc2857ef4a83a395969797ad3905', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:33:31.357670 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5147f0ff-1f83-4fee-aaaf-09aa1bb33a68 tempest-FlavorsExtraSpecsNegativeTestJSON-915050958 tempest-FlavorsExtraSpecsNegativeTestJSON-915050958-project] Request method failure captured: Oct 04 20:33:31.357670 n-d-854823-8 devstack@n-api.service[128801]: request: PUT /compute/v2.1/flavors/748798454/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 04 20:33:31.357670 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:33:31.357670 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:33:31.357670 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:33:31.357670 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 22 Oct 04 20:33:31.357670 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:33:31.357670 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:33:31.357670 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:33:31.357670 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:33:31.357670 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJiVeFka4cYhi8qztf_cW8xIsI1rLZC_ZvNxJMSEJROTyn5HGyv5dcsPdZJYSJOvlQweJ4i8PMzts-DGh0tT7FCeG4saiL3ADcE_tbQND6DWUk5UZMxChmczsVIKtLHsQNyAsPXQRaoSnKUG0CYRpGh8p-78aNutxeFLeCJ3eNg8n2c Oct 04 20:33:31.357670 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:33:31.357670 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:33:31.357670 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:33:31.357670 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:33:31.357670 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:33:31.357670 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:33:31.357670 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: 2844fc2857ef4a83a395969797ad3905 Oct 04 20:33:31.357670 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-915050958 Oct 04 20:33:31.357670 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 20:33:31.357670 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 20:33:31.359068 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_2844fc2857ef4a83a395969797ad3905", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2844fc2857ef4a83a395969797ad3905"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2844fc2857ef4a83a395969797ad3905"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/2844fc2857ef4a83a395969797ad3905"}]}] Oct 04 20:33:31.359068 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-915050958 Oct 04 20:33:31.359068 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: 2844fc2857ef4a83a395969797ad3905 Oct 04 20:33:31.359068 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-915050958 Oct 04 20:33:31.359068 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-915050958-project Oct 04 20:33:31.359068 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:33:31.359068 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:33:31.359068 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: 74f4f9411de04d6baa26137f08049851 Oct 04 20:33:31.359068 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-915050958-project Oct 04 20:33:31.359068 n-d-854823-8 devstack@n-api.service[128801]: Oct 04 20:33:31.359068 n-d-854823-8 devstack@n-api.service[128801]: {"hw:numa_nodes": "1"} Oct 04 20:33:31.359068 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 20:33:31.359068 n-d-854823-8 devstack@n-api.service[128801]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Oct 04 20:33:31.359698 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'flavor_id': '748798454', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1'}} Oct 04 20:33:31.359698 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:33:31.359698 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:33:31.359698 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:33:31.359698 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:33:31.359698 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:33:31.359698 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:33:31.359698 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:33:31.359698 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:33:31.359698 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:33:31.359698 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:33:31.359698 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 91, in update Oct 04 20:33:31.359698 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'update', target={}) Oct 04 20:33:31.359698 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 20:33:31.359698 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 20:33:31.359698 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 20:33:31.359698 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 20:33:31.359698 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 20:33:31.359698 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 20:33:31.360669 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 20:33:31.360669 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 20:33:31.360669 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 20:33:31.360669 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 20:33:31.360669 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 20:33:31.360669 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 20:33:31.360669 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 20:33:31.360669 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 20:33:31.360669 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Oct 04 20:33:31.360669 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:33:31.360669 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:33:31.360669 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:33:31.360669 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:33:31.360669 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:33:31.360669 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:33:31.360669 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 20:33:31.360669 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 20:33:31.360669 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Oct 04 20:33:31.360669 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:33:31.364677 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5147f0ff-1f83-4fee-aaaf-09aa1bb33a68 tempest-FlavorsExtraSpecsNegativeTestJSON-915050958 tempest-FlavorsExtraSpecsNegativeTestJSON-915050958-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:33:31.365222 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-c74c53f9-09e6-4ea1-a2da-e522098793aa tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.836031 Oct 04 20:33:31.368102 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5147f0ff-1f83-4fee-aaaf-09aa1bb33a68 tempest-FlavorsExtraSpecsNegativeTestJSON-915050958 tempest-FlavorsExtraSpecsNegativeTestJSON-915050958-project] 10.222.0.33 "PUT /compute/v2.1/flavors/748798454/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.034651 Oct 04 20:33:31.371885 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 7/25] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 20:33:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 1844 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 20:33:31.372636 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 19/26] 10.222.0.33 () {60 vars in 1262 bytes} [Tue Oct 4 20:33:31 2022] PUT /compute/v2.1/flavors/748798454/os-extra_specs/hw:numa_nodes => generated 124 bytes in 40 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:33:31.384270 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ea493831-046e-46e0-9885-87da629dc263 tempest-FlavorsAccessTestJSON-577610606 tempest-FlavorsAccessTestJSON-577610606-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:31.386587 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-a887047f-6d20-4a3d-a01e-27ba5283516f tempest-FlavorsAdminTestJSON-334926784 tempest-FlavorsAdminTestJSON-334926784-project-admin] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:31.432402 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ea493831-046e-46e0-9885-87da629dc263 tempest-FlavorsAccessTestJSON-577610606 tempest-FlavorsAccessTestJSON-577610606-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 5394 microversion: 2.1 time: 0.058031 Oct 04 20:33:31.435246 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 20/27] 10.222.0.33 () {58 vars in 1146 bytes} [Tue Oct 4 20:33:31 2022] GET /compute/v2.1/flavors/detail => generated 5394 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:33:31.444488 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-05a7e994-8421-41df-ba4c-62ae31c7e4bc tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:31.445271 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-a887047f-6d20-4a3d-a01e-27ba5283516f tempest-FlavorsAdminTestJSON-334926784 tempest-FlavorsAdminTestJSON-334926784-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 5394 microversion: 2.1 time: 0.071776 Oct 04 20:33:31.445923 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-05a7e994-8421-41df-ba4c-62ae31c7e4bc tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] [instance: f2ad1271-aaba-4fe4-8f6c-854cf8e80bb7] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:33:31.458783 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 8/28] 10.222.0.33 () {58 vars in 1146 bytes} [Tue Oct 4 20:33:31 2022] GET /compute/v2.1/flavors/detail => generated 5394 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:33:31.467631 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-9ec64835-997c-48f0-bcac-f8c284e8f7af tempest-FlavorsExtraSpecsNegativeTestJSON-1471772981 tempest-FlavorsExtraSpecsNegativeTestJSON-1471772981-project-admin] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:31.492600 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.wsgi [None req-9ec64835-997c-48f0-bcac-f8c284e8f7af tempest-FlavorsExtraSpecsNegativeTestJSON-1471772981 tempest-FlavorsExtraSpecsNegativeTestJSON-1471772981-project-admin] HTTP exception thrown: Flavor 748798454 has no extra specs with key hw:cpu_thread_policy. Oct 04 20:33:31.498650 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-9ec64835-997c-48f0-bcac-f8c284e8f7af tempest-FlavorsExtraSpecsNegativeTestJSON-1471772981 tempest-FlavorsExtraSpecsNegativeTestJSON-1471772981-project-admin] Request method failure captured: Oct 04 20:33:31.498650 n-d-854823-8 devstack@n-api.service[128802]: request: DELETE /compute/v2.1/flavors/748798454/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Oct 04 20:33:31.498650 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 20:33:31.498650 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 20:33:31.498650 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 20:33:31.498650 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 0 Oct 04 20:33:31.498650 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 20:33:31.498650 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 20:33:31.498650 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 20:33:31.498650 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 20:33:31.498650 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPJiY6_GBUL9ZO0umFQfhF-wydd7AHTRRgol7CKCT_nzFLbLf9H4wj5k7diRe4jCqNhSN7iUl9XbJcFtSouZpFXa9tLeijpqrbhVMBqGXObHjK11PTx2HlzesOpTWbKnQfLpyNF8YnxVClua-fjRl83_Gzyec2X2r6TxzxSLBcown5uY Oct 04 20:33:31.498650 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 20:33:31.498650 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 20:33:31.498650 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 20:33:31.498650 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 20:33:31.498650 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 20:33:31.498650 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 20:33:31.498650 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: c64b26efaf384a13a6fe2f3ddfa5a376 Oct 04 20:33:31.498650 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1471772981 Oct 04 20:33:31.498650 n-d-854823-8 devstack@n-api.service[128802]: X-Role: admin,reader,member Oct 04 20:33:31.498650 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: admin,reader,member Oct 04 20:33:31.499761 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_c64b26efaf384a13a6fe2f3ddfa5a376", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c64b26efaf384a13a6fe2f3ddfa5a376"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c64b26efaf384a13a6fe2f3ddfa5a376"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/c64b26efaf384a13a6fe2f3ddfa5a376"}]}] Oct 04 20:33:31.499761 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1471772981 Oct 04 20:33:31.499761 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: c64b26efaf384a13a6fe2f3ddfa5a376 Oct 04 20:33:31.499761 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1471772981 Oct 04 20:33:31.499761 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1471772981-project-admin Oct 04 20:33:31.499761 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 20:33:31.499761 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 20:33:31.499761 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: 2e49c9dc8b6e4a15b9559ccb2d24a92c Oct 04 20:33:31.499761 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1471772981-project-admin Oct 04 20:33:31.499761 n-d-854823-8 devstack@n-api.service[128802]: method: > Oct 04 20:33:31.499761 n-d-854823-8 devstack@n-api.service[128802]: exception: Flavor 748798454 has no extra specs with key hw:cpu_thread_policy. Oct 04 20:33:31.500334 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'flavor_id': '748798454', 'id': 'hw:cpu_thread_policy'} Oct 04 20:33:31.500334 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:33:31.500334 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:33:31.500334 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 132, in delete Oct 04 20:33:31.500334 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi del flavor.extra_specs[id] Oct 04 20:33:31.500334 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Oct 04 20:33:31.500334 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:33:31.500334 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:33:31.500334 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:33:31.500334 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:33:31.500334 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:33:31.500334 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:33:31.500334 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:33:31.500334 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:33:31.500334 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:33:31.500334 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:33:31.500334 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 141, in delete Oct 04 20:33:31.500334 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 04 20:33:31.500334 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 748798454 has no extra specs with key hw:cpu_thread_policy. Oct 04 20:33:31.500334 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:33:31.500334 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:33:31.500334 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:33:31.501349 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:33:31.501349 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:33:31.501349 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:33:31.501349 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:33:31.501349 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:33:31.501349 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 748798454 has no extra specs with key hw:cpu_thread_policy. Oct 04 20:33:31.501349 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:33:31.503606 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-9ec64835-997c-48f0-bcac-f8c284e8f7af tempest-FlavorsExtraSpecsNegativeTestJSON-1471772981 tempest-FlavorsExtraSpecsNegativeTestJSON-1471772981-project-admin] Returning 404 to user: Flavor 748798454 has no extra specs with key hw:cpu_thread_policy. {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:33:31.504945 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-9ec64835-997c-48f0-bcac-f8c284e8f7af tempest-FlavorsExtraSpecsNegativeTestJSON-1471772981 tempest-FlavorsExtraSpecsNegativeTestJSON-1471772981-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/748798454/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 112 microversion: 2.1 time: 0.042835 Oct 04 20:33:31.506330 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 9/29] 10.222.0.33 () {58 vars in 1266 bytes} [Tue Oct 4 20:33:31 2022] DELETE /compute/v2.1/flavors/748798454/os-extra_specs/hw:cpu_thread_policy => generated 112 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:33:31.513866 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-3cb6bba0-db8d-4a3f-8091-668a960e21b9 tempest-FlavorsAccessTestJSON-577610606 tempest-FlavorsAccessTestJSON-577610606-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-895158808", "id": 1326665957, "os-flavor-access:is_public": "False"}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:33:31.539837 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-3cb6bba0-db8d-4a3f-8091-668a960e21b9 tempest-FlavorsAccessTestJSON-577610606 tempest-FlavorsAccessTestJSON-577610606-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 0.032560 Oct 04 20:33:31.544838 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 10/30] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 20:33:31 2022] POST /compute/v2.1/flavors => generated 430 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:33:31.553976 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-3b81f51a-2f20-43b3-85af-364fdeeffe49 tempest-FlavorsAdminTestJSON-334926784 tempest-FlavorsAdminTestJSON-334926784-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1273239463", "id": 523299838, "os-flavor-access:is_public": "True"}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:33:31.594547 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-3b81f51a-2f20-43b3-85af-364fdeeffe49 tempest-FlavorsAdminTestJSON-334926784 tempest-FlavorsAdminTestJSON-334926784-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 426 microversion: 2.1 time: 0.047713 Oct 04 20:33:31.596174 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 11/31] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 20:33:31 2022] POST /compute/v2.1/flavors => generated 426 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:33:31.609734 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-aa6ccc11-b7a5-45ad-9f0c-39fe0c108a31 tempest-FlavorsExtraSpecsNegativeTestJSON-1471772981 tempest-FlavorsExtraSpecsNegativeTestJSON-1471772981-project-admin] Action: 'update', calling method: >, body: {"hw:cpu_policy": "shared"} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:33:31.617495 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.wsgi [None req-aa6ccc11-b7a5-45ad-9f0c-39fe0c108a31 tempest-FlavorsExtraSpecsNegativeTestJSON-1471772981 tempest-FlavorsExtraSpecsNegativeTestJSON-1471772981-project-admin] HTTP exception thrown: Request body and URI mismatch Oct 04 20:33:31.622741 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-aa6ccc11-b7a5-45ad-9f0c-39fe0c108a31 tempest-FlavorsExtraSpecsNegativeTestJSON-1471772981 tempest-FlavorsExtraSpecsNegativeTestJSON-1471772981-project-admin] Request method failure captured: Oct 04 20:33:31.622741 n-d-854823-8 devstack@n-api.service[128802]: request: PUT /compute/v2.1/flavors/748798454/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 04 20:33:31.622741 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 20:33:31.622741 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 20:33:31.622741 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 20:33:31.622741 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 27 Oct 04 20:33:31.622741 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 20:33:31.622741 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 20:33:31.622741 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 20:33:31.622741 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 20:33:31.622741 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPJiY6_GBUL9ZO0umFQfhF-wydd7AHTRRgol7CKCT_nzFLbLf9H4wj5k7diRe4jCqNhSN7iUl9XbJcFtSouZpFXa9tLeijpqrbhVMBqGXObHjK11PTx2HlzesOpTWbKnQfLpyNF8YnxVClua-fjRl83_Gzyec2X2r6TxzxSLBcown5uY Oct 04 20:33:31.622741 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 20:33:31.622741 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 20:33:31.622741 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 20:33:31.622741 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 20:33:31.622741 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 20:33:31.622741 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 20:33:31.622741 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: c64b26efaf384a13a6fe2f3ddfa5a376 Oct 04 20:33:31.622741 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1471772981 Oct 04 20:33:31.622741 n-d-854823-8 devstack@n-api.service[128802]: X-Role: admin,reader,member Oct 04 20:33:31.622741 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: admin,reader,member Oct 04 20:33:31.623890 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_c64b26efaf384a13a6fe2f3ddfa5a376", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c64b26efaf384a13a6fe2f3ddfa5a376"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c64b26efaf384a13a6fe2f3ddfa5a376"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/c64b26efaf384a13a6fe2f3ddfa5a376"}]}] Oct 04 20:33:31.623890 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1471772981 Oct 04 20:33:31.623890 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: c64b26efaf384a13a6fe2f3ddfa5a376 Oct 04 20:33:31.623890 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1471772981 Oct 04 20:33:31.623890 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1471772981-project-admin Oct 04 20:33:31.623890 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 20:33:31.623890 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 20:33:31.623890 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: 2e49c9dc8b6e4a15b9559ccb2d24a92c Oct 04 20:33:31.623890 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1471772981-project-admin Oct 04 20:33:31.623890 n-d-854823-8 devstack@n-api.service[128802]: Oct 04 20:33:31.623890 n-d-854823-8 devstack@n-api.service[128802]: {"hw:cpu_policy": "shared"} Oct 04 20:33:31.623890 n-d-854823-8 devstack@n-api.service[128802]: method: > Oct 04 20:33:31.623890 n-d-854823-8 devstack@n-api.service[128802]: exception: Request body and URI mismatch Oct 04 20:33:31.624518 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'flavor_id': '748798454', 'id': 'hw:numa_nodes', 'body': {'hw:cpu_policy': 'shared'}} Oct 04 20:33:31.624518 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:33:31.624518 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:33:31.624518 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:33:31.624518 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:33:31.624518 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:33:31.624518 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:33:31.624518 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:33:31.624518 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:33:31.624518 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:33:31.624518 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:33:31.624518 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 96, in update Oct 04 20:33:31.624518 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=expl) Oct 04 20:33:31.624518 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Request body and URI mismatch Oct 04 20:33:31.624518 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:33:31.624518 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:33:31.624518 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:33:31.624518 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:33:31.624518 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:33:31.624518 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:33:31.625589 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:33:31.625589 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:33:31.625589 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Request body and URI mismatch Oct 04 20:33:31.625589 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:33:31.625589 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-aa6ccc11-b7a5-45ad-9f0c-39fe0c108a31 tempest-FlavorsExtraSpecsNegativeTestJSON-1471772981 tempest-FlavorsExtraSpecsNegativeTestJSON-1471772981-project-admin] Returning 400 to user: Request body and URI mismatch {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:33:31.625589 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-aa6ccc11-b7a5-45ad-9f0c-39fe0c108a31 tempest-FlavorsExtraSpecsNegativeTestJSON-1471772981 tempest-FlavorsExtraSpecsNegativeTestJSON-1471772981-project-admin] 10.222.0.33 "PUT /compute/v2.1/flavors/748798454/os-extra_specs/hw:numa_nodes" status: 400 len: 73 microversion: 2.1 time: 0.026205 Oct 04 20:33:31.628110 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 12/32] 10.222.0.33 () {60 vars in 1262 bytes} [Tue Oct 4 20:33:31 2022] PUT /compute/v2.1/flavors/748798454/os-extra_specs/hw:numa_nodes => generated 73 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 04 20:33:31.643960 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-2af4dacf-b86d-4e2a-a694-ec4f52068aa7 tempest-FlavorsAccessTestJSON-577610606 tempest-FlavorsAccessTestJSON-577610606-project-admin] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:31.674385 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-2af4dacf-b86d-4e2a-a694-ec4f52068aa7 tempest-FlavorsAccessTestJSON-577610606 tempest-FlavorsAccessTestJSON-577610606-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/1326665957/os-flavor-access" status: 200 len: 21 microversion: 2.1 time: 0.045127 Oct 04 20:33:31.678783 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 13/33] 10.222.0.33 () {58 vars in 1209 bytes} [Tue Oct 4 20:33:31 2022] GET /compute/v2.1/flavors/1326665957/os-flavor-access => generated 21 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 20:33:31.705418 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-af3d3f0f-1608-4ad0-9c41-8df474de1ba0 tempest-FlavorsAdminTestJSON-334926784 tempest-FlavorsAdminTestJSON-334926784-project-admin] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:31.774988 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-af3d3f0f-1608-4ad0-9c41-8df474de1ba0 tempest-FlavorsAdminTestJSON-334926784 tempest-FlavorsAdminTestJSON-334926784-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/523299838" status: 202 len: 0 microversion: 2.1 time: 0.094546 Oct 04 20:33:31.776180 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 14/34] 10.222.0.33 () {58 vars in 1158 bytes} [Tue Oct 4 20:33:31 2022] DELETE /compute/v2.1/flavors/523299838 => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:33:31.786181 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-ca8cd404-13bf-4a2c-8e17-3a631311bc1e tempest-FlavorsExtraSpecsNegativeTestJSON-1471772981 tempest-FlavorsExtraSpecsNegativeTestJSON-1471772981-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:33:31.793259 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-ca8cd404-13bf-4a2c-8e17-3a631311bc1e tempest-FlavorsExtraSpecsNegativeTestJSON-1471772981 tempest-FlavorsExtraSpecsNegativeTestJSON-1471772981-project-admin] Request method failure captured: Oct 04 20:33:31.793259 n-d-854823-8 devstack@n-api.service[128802]: request: PUT /compute/v2.1/flavors/748798454/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 04 20:33:31.793259 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 20:33:31.793259 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 20:33:31.793259 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 20:33:31.793259 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 49 Oct 04 20:33:31.793259 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 20:33:31.793259 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 20:33:31.793259 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 20:33:31.793259 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 20:33:31.793259 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPJiY6_GBUL9ZO0umFQfhF-wydd7AHTRRgol7CKCT_nzFLbLf9H4wj5k7diRe4jCqNhSN7iUl9XbJcFtSouZpFXa9tLeijpqrbhVMBqGXObHjK11PTx2HlzesOpTWbKnQfLpyNF8YnxVClua-fjRl83_Gzyec2X2r6TxzxSLBcown5uY Oct 04 20:33:31.793259 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 20:33:31.793259 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 20:33:31.793259 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 20:33:31.793259 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 20:33:31.793259 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 20:33:31.793259 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 20:33:31.793259 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: c64b26efaf384a13a6fe2f3ddfa5a376 Oct 04 20:33:31.793259 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1471772981 Oct 04 20:33:31.793259 n-d-854823-8 devstack@n-api.service[128802]: X-Role: admin,reader,member Oct 04 20:33:31.793259 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: admin,reader,member Oct 04 20:33:31.794622 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_c64b26efaf384a13a6fe2f3ddfa5a376", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c64b26efaf384a13a6fe2f3ddfa5a376"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c64b26efaf384a13a6fe2f3ddfa5a376"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/c64b26efaf384a13a6fe2f3ddfa5a376"}]}] Oct 04 20:33:31.794622 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1471772981 Oct 04 20:33:31.794622 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: c64b26efaf384a13a6fe2f3ddfa5a376 Oct 04 20:33:31.794622 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1471772981 Oct 04 20:33:31.794622 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1471772981-project-admin Oct 04 20:33:31.794622 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 20:33:31.794622 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 20:33:31.794622 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: 2e49c9dc8b6e4a15b9559ccb2d24a92c Oct 04 20:33:31.794622 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1471772981-project-admin Oct 04 20:33:31.794622 n-d-854823-8 devstack@n-api.service[128802]: Oct 04 20:33:31.794622 n-d-854823-8 devstack@n-api.service[128802]: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} Oct 04 20:33:31.794622 n-d-854823-8 devstack@n-api.service[128802]: method: > Oct 04 20:33:31.795345 n-d-854823-8 devstack@n-api.service[128802]: exception: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 04 20:33:31.795345 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'flavor_id': '748798454', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}} Oct 04 20:33:31.795345 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:33:31.795345 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:33:31.795345 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 20:33:31.795345 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 20:33:31.795345 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 20:33:31.795345 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise error Oct 04 20:33:31.795345 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 04 20:33:31.795345 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:33:31.795345 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Failed validating 'maxProperties' in schema: Oct 04 20:33:31.795345 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 04 20:33:31.795345 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi 'maxProperties': 1, Oct 04 20:33:31.795345 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi 'minProperties': 1, Oct 04 20:33:31.795345 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 04 20:33:31.795345 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi 'type': ['string', Oct 04 20:33:31.795345 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi 'number']}}, Oct 04 20:33:31.795345 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 04 20:33:31.795345 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:33:31.795345 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi On instance: Oct 04 20:33:31.795345 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi {'hw:cpu_policy': 'shared', 'hw:numa_nodes': '1'} Oct 04 20:33:31.795345 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:33:31.796758 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:33:31.796758 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:33:31.796758 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:33:31.796758 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:33:31.796758 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:33:31.796758 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:33:31.796758 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:33:31.796758 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:33:31.796758 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:33:31.796758 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 20:33:31.796758 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 20:33:31.796758 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 20:33:31.796758 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 20:33:31.796758 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 20:33:31.796758 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 20:33:31.796758 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 04 20:33:31.796758 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:33:31.796758 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:33:31.796758 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:33:31.796758 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:33:31.797919 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:33:31.797919 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:33:31.797919 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 20:33:31.797919 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 20:33:31.797919 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 04 20:33:31.797919 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:33:31.799969 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-ca8cd404-13bf-4a2c-8e17-3a631311bc1e tempest-FlavorsExtraSpecsNegativeTestJSON-1471772981 tempest-FlavorsExtraSpecsNegativeTestJSON-1471772981-project-admin] Returning 400 to user: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:33:31.801951 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-ca8cd404-13bf-4a2c-8e17-3a631311bc1e tempest-FlavorsExtraSpecsNegativeTestJSON-1471772981 tempest-FlavorsExtraSpecsNegativeTestJSON-1471772981-project-admin] 10.222.0.33 "PUT /compute/v2.1/flavors/748798454/os-extra_specs/hw:numa_nodes" status: 400 len: 117 microversion: 2.1 time: 0.022002 Oct 04 20:33:31.803756 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 15/35] 10.222.0.33 () {60 vars in 1262 bytes} [Tue Oct 4 20:33:31 2022] PUT /compute/v2.1/flavors/748798454/os-extra_specs/hw:numa_nodes => generated 117 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 20:33:31.812241 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-aebbb651-dd72-4801-b415-5e48f4fcaf1c tempest-FlavorsAccessTestJSON-577610606 tempest-FlavorsAccessTestJSON-577610606-project-admin] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:31.844274 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-aebbb651-dd72-4801-b415-5e48f4fcaf1c tempest-FlavorsAccessTestJSON-577610606 tempest-FlavorsAccessTestJSON-577610606-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/1326665957" status: 202 len: 0 microversion: 2.1 time: 0.038995 Oct 04 20:33:31.845193 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 16/36] 10.222.0.33 () {58 vars in 1161 bytes} [Tue Oct 4 20:33:31 2022] DELETE /compute/v2.1/flavors/1326665957 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:33:31.852457 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-919c05c1-4c5e-4e7b-af5c-d75fd0084f18 tempest-FlavorsAdminTestJSON-334926784 tempest-FlavorsAdminTestJSON-334926784-project-admin] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:31.887772 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-919c05c1-4c5e-4e7b-af5c-d75fd0084f18 tempest-FlavorsAdminTestJSON-334926784 tempest-FlavorsAdminTestJSON-334926784-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 5394 microversion: 2.1 time: 0.039374 Oct 04 20:33:31.889306 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 17/37] 10.222.0.33 () {58 vars in 1146 bytes} [Tue Oct 4 20:33:31 2022] GET /compute/v2.1/flavors/detail => generated 5394 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:33:31.894436 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-f2ab9c7e-be58-4b96-ba11-c295b77ba5cd tempest-FlavorsExtraSpecsNegativeTestJSON-1471772981 tempest-FlavorsExtraSpecsNegativeTestJSON-1471772981-project-admin] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:31.920584 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-f2ab9c7e-be58-4b96-ba11-c295b77ba5cd tempest-FlavorsExtraSpecsNegativeTestJSON-1471772981 tempest-FlavorsExtraSpecsNegativeTestJSON-1471772981-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/748798454" status: 202 len: 0 microversion: 2.1 time: 0.030033 Oct 04 20:33:31.925375 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 18/38] 10.222.0.33 () {58 vars in 1158 bytes} [Tue Oct 4 20:33:31 2022] DELETE /compute/v2.1/flavors/748798454 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:33:31.937436 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-7963de6c-6793-48f8-838b-7b1a9a7a0868 tempest-FlavorsAccessTestJSON-577610606 tempest-FlavorsAccessTestJSON-577610606-project-admin] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:31.973513 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-7963de6c-6793-48f8-838b-7b1a9a7a0868 tempest-FlavorsAccessTestJSON-577610606 tempest-FlavorsAccessTestJSON-577610606-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.046731 Oct 04 20:33:31.974963 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 19/39] 10.222.0.33 () {58 vars in 1146 bytes} [Tue Oct 4 20:33:31 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:33:31.980321 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-df7dd218-3862-475b-a809-72a3118cc42e tempest-FlavorsAdminTestJSON-334926784 tempest-FlavorsAdminTestJSON-334926784-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-394309986", "id": null, "os-flavor-access:is_public": "True"}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:33:32.013842 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-df7dd218-3862-475b-a809-72a3118cc42e tempest-FlavorsAdminTestJSON-334926784 tempest-FlavorsAdminTestJSON-334926784-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 506 microversion: 2.1 time: 0.037506 Oct 04 20:33:32.023801 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 20/40] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 20:33:31 2022] POST /compute/v2.1/flavors => generated 506 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:33:32.029217 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-0e8effad-c5e1-4a9e-8b14-c371d5064c45 tempest-FlavorsExtraSpecsNegativeTestJSON-1471772981 tempest-FlavorsExtraSpecsNegativeTestJSON-1471772981-project-admin] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:32.069243 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-0e8effad-c5e1-4a9e-8b14-c371d5064c45 tempest-FlavorsExtraSpecsNegativeTestJSON-1471772981 tempest-FlavorsExtraSpecsNegativeTestJSON-1471772981-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 5487 microversion: 2.1 time: 0.044235 Oct 04 20:33:32.069853 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 21/41] 10.222.0.33 () {58 vars in 1146 bytes} [Tue Oct 4 20:33:32 2022] GET /compute/v2.1/flavors/detail => generated 5487 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:33:32.078000 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-ead7ac77-0153-43dd-b066-d516a72c5271 tempest-FlavorsAdminTestJSON-334926784 tempest-FlavorsAdminTestJSON-334926784-project-admin] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:32.125286 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-ead7ac77-0153-43dd-b066-d516a72c5271 tempest-FlavorsAdminTestJSON-334926784 tempest-FlavorsAdminTestJSON-334926784-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/5101372f-85cf-4d31-8be3-38bc04861dc6" status: 202 len: 0 microversion: 2.1 time: 0.050491 Oct 04 20:33:32.125884 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 22/42] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 20:33:32 2022] DELETE /compute/v2.1/flavors/5101372f-85cf-4d31-8be3-38bc04861dc6 => generated 0 bytes in 55 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:33:32.137686 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-b8783bc4-1879-4191-8722-03fcad3068f1 tempest-FlavorsAdminTestJSON-334926784 tempest-FlavorsAdminTestJSON-334926784-project-admin] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:32.155075 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=9,nova_api:DELETE=12 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:33:32.185847 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-b8783bc4-1879-4191-8722-03fcad3068f1 tempest-FlavorsAdminTestJSON-334926784 tempest-FlavorsAdminTestJSON-334926784-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.054959 Oct 04 20:33:32.199775 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 23/43] 10.222.0.33 () {58 vars in 1146 bytes} [Tue Oct 4 20:33:32 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:33:32.222827 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-9138bf0e-69eb-4e90-99b6-3d6ea1055efa tempest-FlavorsAdminTestJSON-334926784 tempest-FlavorsAdminTestJSON-334926784-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-590931684", "id": "14d7b065-f060-4a83-8b1b-1be021d2268a", "os-flavor-access:is_public": "True"}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:33:32.258132 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-9138bf0e-69eb-4e90-99b6-3d6ea1055efa tempest-FlavorsAdminTestJSON-334926784 tempest-FlavorsAdminTestJSON-334926784-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 506 microversion: 2.1 time: 0.046136 Oct 04 20:33:32.263622 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 24/44] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 20:33:32 2022] POST /compute/v2.1/flavors => generated 506 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:33:32.271469 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-b8afa064-f6b1-4bcf-8a66-038b5ee815eb tempest-FlavorsAdminTestJSON-334926784 tempest-FlavorsAdminTestJSON-334926784-project-admin] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:32.302881 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-b8afa064-f6b1-4bcf-8a66-038b5ee815eb tempest-FlavorsAdminTestJSON-334926784 tempest-FlavorsAdminTestJSON-334926784-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/14d7b065-f060-4a83-8b1b-1be021d2268a" status: 202 len: 0 microversion: 2.1 time: 0.034902 Oct 04 20:33:32.304216 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 25/45] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 20:33:32 2022] DELETE /compute/v2.1/flavors/14d7b065-f060-4a83-8b1b-1be021d2268a => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:33:32.312718 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-a2c31310-3622-4650-9e27-00cc8a4b9808 tempest-FlavorsAdminTestJSON-334926784 tempest-FlavorsAdminTestJSON-334926784-project-admin] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:32.342585 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-a2c31310-3622-4650-9e27-00cc8a4b9808 tempest-FlavorsAdminTestJSON-334926784 tempest-FlavorsAdminTestJSON-334926784-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.033284 Oct 04 20:33:32.354736 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 26/46] 10.222.0.33 () {58 vars in 1146 bytes} [Tue Oct 4 20:33:32 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:33:32.371088 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-d8a2ce27-85b2-4859-8875-9147fa05ee7d tempest-FlavorsAdminTestJSON-334926784 tempest-FlavorsAdminTestJSON-334926784-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-2070204538", "id": 295831036, "os-flavor-access:is_public": "True"}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:33:32.409767 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-d8a2ce27-85b2-4859-8875-9147fa05ee7d tempest-FlavorsAdminTestJSON-334926784 tempest-FlavorsAdminTestJSON-334926784-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.1 time: 0.048742 Oct 04 20:33:32.412729 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 27/47] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 20:33:32 2022] POST /compute/v2.1/flavors => generated 411 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:33:32.430851 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-cb5ef63a-3032-4494-ad34-7ee120a14ed0 tempest-FlavorsAdminTestJSON-334926784 tempest-FlavorsAdminTestJSON-334926784-project-admin] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:32.446383 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-cb5ef63a-3032-4494-ad34-7ee120a14ed0 tempest-FlavorsAdminTestJSON-334926784 tempest-FlavorsAdminTestJSON-334926784-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/295831036" status: 200 len: 411 microversion: 2.1 time: 0.024281 Oct 04 20:33:32.447726 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 28/48] 10.222.0.33 () {58 vars in 1155 bytes} [Tue Oct 4 20:33:32 2022] GET /compute/v2.1/flavors/295831036 => generated 411 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 20:33:32.715268 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-05a7e994-8421-41df-ba4c-62ae31c7e4bc tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24987e1b118a41169a1974dc40568156', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930b67acdd8f4d4ea2acf80bb5b28059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:33:32.753999 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-05a7e994-8421-41df-ba4c-62ae31c7e4bc tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] 10.222.0.33 "GET /compute/v2.1/servers/f2ad1271-aaba-4fe4-8f6c-854cf8e80bb7" status: 200 len: 1243 microversion: 2.1 time: 1.315541 Oct 04 20:33:32.754615 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 21/49] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:33:31 2022] GET /compute/v2.1/servers/f2ad1271-aaba-4fe4-8f6c-854cf8e80bb7 => generated 1243 bytes in 1318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:33:33.067027 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-bacc2680-a141-44af-a7e6-a1532b608145 tempest-FlavorsAdminTestJSON-1861389803 tempest-FlavorsAdminTestJSON-1861389803-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:33.158294 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-bacc2680-a141-44af-a7e6-a1532b608145 tempest-FlavorsAdminTestJSON-1861389803 tempest-FlavorsAdminTestJSON-1861389803-project] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 5392 microversion: 2.1 time: 0.700740 Oct 04 20:33:33.160599 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 29/50] 10.222.0.33 () {58 vars in 1146 bytes} [Tue Oct 4 20:33:32 2022] GET /compute/v2.1/flavors/detail => generated 5392 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:33:33.186317 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9465701f-7890-46ea-9eeb-bd52788a3ead tempest-FlavorsAdminTestJSON-334926784 tempest-FlavorsAdminTestJSON-334926784-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:33.190196 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=7,nova_api:DELETE=10,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:33:33.242980 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-9465701f-7890-46ea-9eeb-bd52788a3ead tempest-FlavorsAdminTestJSON-334926784 tempest-FlavorsAdminTestJSON-334926784-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/295831036" status: 202 len: 0 microversion: 2.1 time: 0.066439 Oct 04 20:33:33.243560 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 22/51] 10.222.0.33 () {58 vars in 1158 bytes} [Tue Oct 4 20:33:33 2022] DELETE /compute/v2.1/flavors/295831036 => generated 0 bytes in 68 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:33:33.253727 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-168830a1-81de-4817-a741-00629d3dd724 tempest-FlavorsAdminTestJSON-334926784 tempest-FlavorsAdminTestJSON-334926784-project-admin] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:33.287728 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-168830a1-81de-4817-a741-00629d3dd724 tempest-FlavorsAdminTestJSON-334926784 tempest-FlavorsAdminTestJSON-334926784-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.039591 Oct 04 20:33:33.289872 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 30/52] 10.222.0.33 () {58 vars in 1146 bytes} [Tue Oct 4 20:33:33 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:33:33.312924 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7db65d16-d9f5-479a-a64a-30c80d50da39 tempest-FlavorsAdminTestJSON-334926784 tempest-FlavorsAdminTestJSON-334926784-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-139853650", "id": 312127547, "os-flavor-access:is_public": "False"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:33:33.349521 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-7db65d16-d9f5-479a-a64a-30c80d50da39 tempest-FlavorsAdminTestJSON-334926784 tempest-FlavorsAdminTestJSON-334926784-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 426 microversion: 2.1 time: 0.041624 Oct 04 20:33:33.350705 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 23/53] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 20:33:33 2022] POST /compute/v2.1/flavors => generated 426 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:33:33.363871 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-dcb99d3b-cc46-43d4-a562-890c59fd6e19 tempest-FlavorsAdminTestJSON-1861389803 tempest-FlavorsAdminTestJSON-1861389803-project] Action: 'create', calling method: >, body: {"server": {"name": "test", "imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63", "flavorRef": "312127547"}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:33:33.381432 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.wsgi [None req-dcb99d3b-cc46-43d4-a562-890c59fd6e19 tempest-FlavorsAdminTestJSON-1861389803 tempest-FlavorsAdminTestJSON-1861389803-project] HTTP exception thrown: Flavor 312127547 could not be found. Oct 04 20:33:33.389032 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-dcb99d3b-cc46-43d4-a562-890c59fd6e19 tempest-FlavorsAdminTestJSON-1861389803 tempest-FlavorsAdminTestJSON-1861389803-project] Request method failure captured: Oct 04 20:33:33.389032 n-d-854823-8 devstack@n-api.service[128802]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 20:33:33.389032 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 20:33:33.389032 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 20:33:33.389032 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 20:33:33.389032 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 106 Oct 04 20:33:33.389032 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 20:33:33.389032 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 20:33:33.389032 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 20:33:33.389032 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 20:33:33.389032 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPJiWskJhSnha-28SpxVZHR95wX9VmtBjT7wmsmHvGXg26ymnRAg7OMvP0mWnIQr0z9EM0whpQaVRH_Lr82Fu8aoYA2jjAF0U9HNeOZBZlqbtD-U8LJ0WvRWjUAMwuxsWFbKGov9ymfrmnD0fEoR6mfUv5Op630f4VV6d0d8rAPxWK-Y Oct 04 20:33:33.389032 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 20:33:33.389032 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 20:33:33.389032 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 20:33:33.389032 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 20:33:33.389032 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 20:33:33.389032 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 20:33:33.389032 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: f8aaf44c5b364bfe8d1c12050200ff0a Oct 04 20:33:33.389032 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-FlavorsAdminTestJSON-1861389803 Oct 04 20:33:33.389032 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 20:33:33.389032 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 20:33:33.390159 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f8aaf44c5b364bfe8d1c12050200ff0a", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f8aaf44c5b364bfe8d1c12050200ff0a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f8aaf44c5b364bfe8d1c12050200ff0a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f8aaf44c5b364bfe8d1c12050200ff0a"}]}] Oct 04 20:33:33.390159 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-FlavorsAdminTestJSON-1861389803 Oct 04 20:33:33.390159 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: f8aaf44c5b364bfe8d1c12050200ff0a Oct 04 20:33:33.390159 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-FlavorsAdminTestJSON-1861389803 Oct 04 20:33:33.390159 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-FlavorsAdminTestJSON-1861389803-project Oct 04 20:33:33.390159 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 20:33:33.390159 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 20:33:33.390159 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: 4df646bbfa004f249df22978084a1e36 Oct 04 20:33:33.390159 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-FlavorsAdminTestJSON-1861389803-project Oct 04 20:33:33.390159 n-d-854823-8 devstack@n-api.service[128802]: Oct 04 20:33:33.390159 n-d-854823-8 devstack@n-api.service[128802]: {"server": {"name": "test", "imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63", "flavorRef": "312127547"}} Oct 04 20:33:33.390159 n-d-854823-8 devstack@n-api.service[128802]: method: > Oct 04 20:33:33.390159 n-d-854823-8 devstack@n-api.service[128802]: exception: Flavor 312127547 could not be found. Oct 04 20:33:33.391013 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'body': {'server': {'name': 'test', 'imageRef': '15b24725-0c99-4bcf-b1fb-907cdf8e2d63', 'flavorRef': '312127547'}}} Oct 04 20:33:33.391013 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:33:33.391013 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:33:33.391013 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Oct 04 20:33:33.391013 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Oct 04 20:33:33.391013 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 04 20:33:33.391013 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 04 20:33:33.391013 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 20:33:33.391013 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 20:33:33.391013 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 04 20:33:33.391013 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 04 20:33:33.391013 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 04 20:33:33.391013 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:33:33.391013 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 04 20:33:33.391013 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 04 20:33:33.391013 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 312127547 could not be found. Oct 04 20:33:33.391013 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:33:33.391013 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:33:33.391013 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:33:33.391013 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:33:33.391951 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:33:33.391951 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:33:33.391951 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:33:33.391951 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:33:33.391951 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:33:33.391951 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:33:33.391951 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:33:33.391951 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:33:33.391951 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:33:33.391951 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:33:33.391951 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:33:33.391951 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:33:33.391951 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 20:33:33.391951 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 04 20:33:33.391951 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 04 20:33:33.391951 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 312127547 could not be found. Oct 04 20:33:33.391951 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:33:33.391951 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:33:33.391951 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:33:33.391951 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:33:33.391951 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:33:33.392929 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:33:33.392929 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:33:33.392929 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:33:33.392929 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 312127547 could not be found. Oct 04 20:33:33.392929 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:33:33.393970 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-dcb99d3b-cc46-43d4-a562-890c59fd6e19 tempest-FlavorsAdminTestJSON-1861389803 tempest-FlavorsAdminTestJSON-1861389803-project] Returning 400 to user: Flavor 312127547 could not be found. {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:33:33.395366 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-dcb99d3b-cc46-43d4-a562-890c59fd6e19 tempest-FlavorsAdminTestJSON-1861389803 tempest-FlavorsAdminTestJSON-1861389803-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 400 len: 80 microversion: 2.1 time: 0.035053 Oct 04 20:33:33.396327 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 31/54] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 20:33:33 2022] POST /compute/v2.1/servers => generated 80 bytes in 37 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Oct 04 20:33:33.411836 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-2db1429b-6c5c-47fd-9add-a61dc4ea5ff3 tempest-FlavorsAdminTestJSON-334926784 tempest-FlavorsAdminTestJSON-334926784-project-admin] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:33.445808 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-2db1429b-6c5c-47fd-9add-a61dc4ea5ff3 tempest-FlavorsAdminTestJSON-334926784 tempest-FlavorsAdminTestJSON-334926784-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/312127547" status: 202 len: 0 microversion: 2.1 time: 0.044914 Oct 04 20:33:33.447236 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 32/55] 10.222.0.33 () {58 vars in 1158 bytes} [Tue Oct 4 20:33:33 2022] DELETE /compute/v2.1/flavors/312127547 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:33:33.455770 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-973a9e05-0373-4bab-bfe2-aaa78f748c8d tempest-FlavorsAdminTestJSON-334926784 tempest-FlavorsAdminTestJSON-334926784-project-admin] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:33.499023 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-973a9e05-0373-4bab-bfe2-aaa78f748c8d tempest-FlavorsAdminTestJSON-334926784 tempest-FlavorsAdminTestJSON-334926784-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.046961 Oct 04 20:33:33.499803 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 33/56] 10.222.0.33 () {58 vars in 1146 bytes} [Tue Oct 4 20:33:33 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:33:33.521992 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-1306713f-5ce2-4a91-9667-c1da59473b17 tempest-FlavorsAdminTestJSON-334926784 tempest-FlavorsAdminTestJSON-334926784-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1269455397", "id": 1508713634, "os-flavor-access:is_public": "False"}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:33:33.553888 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-1306713f-5ce2-4a91-9667-c1da59473b17 tempest-FlavorsAdminTestJSON-334926784 tempest-FlavorsAdminTestJSON-334926784-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 0.035658 Oct 04 20:33:33.563429 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 34/57] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 20:33:33 2022] POST /compute/v2.1/flavors => generated 415 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 20:33:33.569879 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-23a9e77b-24ae-40d6-add4-de725a73a323 tempest-FlavorsAdminTestJSON-334926784 tempest-FlavorsAdminTestJSON-334926784-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-777977941", "id": 1449035838, "os-flavor-access:is_public": "True"}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:33:33.596180 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-23a9e77b-24ae-40d6-add4-de725a73a323 tempest-FlavorsAdminTestJSON-334926784 tempest-FlavorsAdminTestJSON-334926784-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.031305 Oct 04 20:33:33.597012 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 35/58] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 20:33:33 2022] POST /compute/v2.1/flavors => generated 413 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:33:33.609878 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-b1dacf4c-6de6-4145-8929-ff927d5b8cc9 tempest-FlavorsAdminTestJSON-334926784 tempest-FlavorsAdminTestJSON-334926784-project-admin] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:33.638170 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-b1dacf4c-6de6-4145-8929-ff927d5b8cc9 tempest-FlavorsAdminTestJSON-334926784 tempest-FlavorsAdminTestJSON-334926784-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail?is_public=f" status: 200 len: 418 microversion: 2.1 time: 0.031980 Oct 04 20:33:33.639206 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 36/59] 10.222.0.33 () {58 vars in 1169 bytes} [Tue Oct 4 20:33:33 2022] GET /compute/v2.1/flavors/detail?is_public=f => generated 418 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 20:33:33.664059 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-00e0765c-8f3e-49ae-b60c-66d028afaab4 tempest-FlavorsAdminTestJSON-334926784 tempest-FlavorsAdminTestJSON-334926784-project-admin] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:33.680517 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-00e0765c-8f3e-49ae-b60c-66d028afaab4 tempest-FlavorsAdminTestJSON-334926784 tempest-FlavorsAdminTestJSON-334926784-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail?is_public=false" status: 200 len: 418 microversion: 2.1 time: 0.031847 Oct 04 20:33:33.692653 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 37/60] 10.222.0.33 () {58 vars in 1177 bytes} [Tue Oct 4 20:33:33 2022] GET /compute/v2.1/flavors/detail?is_public=false => generated 418 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:33:33.699763 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-b15e70f7-8d94-46cf-a07c-eaff4d32f252 tempest-FlavorsAdminTestJSON-334926784 tempest-FlavorsAdminTestJSON-334926784-project-admin] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:33.721181 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-b15e70f7-8d94-46cf-a07c-eaff4d32f252 tempest-FlavorsAdminTestJSON-334926784 tempest-FlavorsAdminTestJSON-334926784-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail?is_public=no" status: 200 len: 418 microversion: 2.1 time: 0.026222 Oct 04 20:33:33.722617 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 38/61] 10.222.0.33 () {58 vars in 1171 bytes} [Tue Oct 4 20:33:33 2022] GET /compute/v2.1/flavors/detail?is_public=no => generated 418 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:33:33.741026 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-6de0a32c-0626-478e-9cfd-7203b8f9843f tempest-FlavorsAdminTestJSON-334926784 tempest-FlavorsAdminTestJSON-334926784-project-admin] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:33.754399 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-6de0a32c-0626-478e-9cfd-7203b8f9843f tempest-FlavorsAdminTestJSON-334926784 tempest-FlavorsAdminTestJSON-334926784-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail?is_public=0" status: 200 len: 418 microversion: 2.1 time: 0.021526 Oct 04 20:33:33.756149 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 39/62] 10.222.0.33 () {58 vars in 1169 bytes} [Tue Oct 4 20:33:33 2022] GET /compute/v2.1/flavors/detail?is_public=0 => generated 418 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:33:33.780883 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-6df152b8-3ae9-42d2-bbd3-8e65e341e03f tempest-FlavorsAdminTestJSON-334926784 tempest-FlavorsAdminTestJSON-334926784-project-admin] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:33.801859 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-88262098-1a5f-48a2-b579-a020146a1631 tempest-FlavorsAccessNegativeTestJSON-845567461 tempest-FlavorsAccessNegativeTestJSON-845567461-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1086192361", "id": 1987983911, "os-flavor-access:is_public": "False"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:33:33.814829 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-6df152b8-3ae9-42d2-bbd3-8e65e341e03f tempest-FlavorsAdminTestJSON-334926784 tempest-FlavorsAdminTestJSON-334926784-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail?is_public=t" status: 200 len: 5394 microversion: 2.1 time: 0.043073 Oct 04 20:33:33.816272 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 40/63] 10.222.0.33 () {58 vars in 1169 bytes} [Tue Oct 4 20:33:33 2022] GET /compute/v2.1/flavors/detail?is_public=t => generated 5394 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:33:33.838638 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-721a524d-9bc5-41b5-babc-412486b1e615 tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:33.844307 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-721a524d-9bc5-41b5-babc-412486b1e615 tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] [instance: f2ad1271-aaba-4fe4-8f6c-854cf8e80bb7] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:33:33.852882 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-88262098-1a5f-48a2-b579-a020146a1631 tempest-FlavorsAccessNegativeTestJSON-845567461 tempest-FlavorsAccessNegativeTestJSON-845567461-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.461572 Oct 04 20:33:33.862977 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 24/64] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 20:33:33 2022] POST /compute/v2.1/flavors => generated 439 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:33:33.872591 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-908cf484-214b-49de-b88f-50392e699cb4 tempest-FlavorsAdminTestJSON-334926784 tempest-FlavorsAdminTestJSON-334926784-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:33.874377 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-721a524d-9bc5-41b5-babc-412486b1e615 tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:33.874985 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-721a524d-9bc5-41b5-babc-412486b1e615 tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:33.875518 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-721a524d-9bc5-41b5-babc-412486b1e615 tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:33.876329 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-721a524d-9bc5-41b5-babc-412486b1e615 tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:33.876906 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-721a524d-9bc5-41b5-babc-412486b1e615 tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:33.877430 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-721a524d-9bc5-41b5-babc-412486b1e615 tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:33.918201 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-908cf484-214b-49de-b88f-50392e699cb4 tempest-FlavorsAdminTestJSON-334926784 tempest-FlavorsAdminTestJSON-334926784-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail?is_public=true" status: 200 len: 5394 microversion: 2.1 time: 0.054009 Oct 04 20:33:33.922823 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 25/65] 10.222.0.33 () {58 vars in 1175 bytes} [Tue Oct 4 20:33:33 2022] GET /compute/v2.1/flavors/detail?is_public=true => generated 5394 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:33:33.935837 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7765eaf2-a15e-45f7-b7c7-319654e7b51c tempest-FlavorsAccessNegativeTestJSON-845567461 tempest-FlavorsAccessNegativeTestJSON-845567461-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "2366351eb3dc4c0a9771c89526c4debe"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:33:34.095686 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-7765eaf2-a15e-45f7-b7c7-319654e7b51c tempest-FlavorsAccessNegativeTestJSON-845567461 tempest-FlavorsAccessNegativeTestJSON-845567461-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors/1987983911/action" status: 200 len: 97 microversion: 2.1 time: 0.168020 Oct 04 20:33:34.096505 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 26/66] 10.222.0.33 () {60 vars in 1200 bytes} [Tue Oct 4 20:33:33 2022] POST /compute/v2.1/flavors/1987983911/action => generated 97 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 20:33:34.113403 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-fa9e0966-d5f1-4710-9fbb-061da90b0519 tempest-FlavorsAdminTestJSON-334926784 tempest-FlavorsAdminTestJSON-334926784-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:34.139485 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-721a524d-9bc5-41b5-babc-412486b1e615 tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24987e1b118a41169a1974dc40568156', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930b67acdd8f4d4ea2acf80bb5b28059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:33:34.180225 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-fa9e0966-d5f1-4710-9fbb-061da90b0519 tempest-FlavorsAdminTestJSON-334926784 tempest-FlavorsAdminTestJSON-334926784-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail?is_public=yes" status: 200 len: 5394 microversion: 2.1 time: 0.076879 Oct 04 20:33:34.181223 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 27/67] 10.222.0.33 () {58 vars in 1173 bytes} [Tue Oct 4 20:33:34 2022] GET /compute/v2.1/flavors/detail?is_public=yes => generated 5394 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:33:34.186585 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-97d1baf3-bde7-45d7-9285-a8903fca8877 tempest-FlavorsAccessNegativeTestJSON-845567461 tempest-FlavorsAccessNegativeTestJSON-845567461-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "2366351eb3dc4c0a9771c89526c4debe"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:33:34.191823 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-721a524d-9bc5-41b5-babc-412486b1e615 tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] 10.222.0.33 "GET /compute/v2.1/servers/f2ad1271-aaba-4fe4-8f6c-854cf8e80bb7" status: 200 len: 1235 microversion: 2.1 time: 0.374330 Oct 04 20:33:34.195925 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 41/68] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:33:33 2022] GET /compute/v2.1/servers/f2ad1271-aaba-4fe4-8f6c-854cf8e80bb7 => generated 1235 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:33:34.203295 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-41721bd6-6fe6-4a8c-9a40-b2cd892c10ee tempest-FlavorsAdminTestJSON-334926784 tempest-FlavorsAdminTestJSON-334926784-project-admin] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:34.274861 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-41721bd6-6fe6-4a8c-9a40-b2cd892c10ee tempest-FlavorsAdminTestJSON-334926784 tempest-FlavorsAdminTestJSON-334926784-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail?is_public=1" status: 200 len: 5394 microversion: 2.1 time: 0.075186 Oct 04 20:33:34.275800 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 42/69] 10.222.0.33 () {58 vars in 1169 bytes} [Tue Oct 4 20:33:34 2022] GET /compute/v2.1/flavors/detail?is_public=1 => generated 5394 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:33:34.299385 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-0fb8c6d3-57ba-41a6-adcb-e7b9d0b77c9e tempest-FlavorsAdminTestJSON-334926784 tempest-FlavorsAdminTestJSON-334926784-project-admin] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:34.320973 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-0fb8c6d3-57ba-41a6-adcb-e7b9d0b77c9e tempest-FlavorsAdminTestJSON-334926784 tempest-FlavorsAdminTestJSON-334926784-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/1449035838" status: 202 len: 0 microversion: 2.1 time: 0.025608 Oct 04 20:33:34.323916 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 43/70] 10.222.0.33 () {58 vars in 1161 bytes} [Tue Oct 4 20:33:34 2022] DELETE /compute/v2.1/flavors/1449035838 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:33:34.333066 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-fc863d02-27d4-4af2-83e8-bf6432ef245b tempest-FlavorsAdminTestJSON-334926784 tempest-FlavorsAdminTestJSON-334926784-project-admin] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:34.358943 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-fc863d02-27d4-4af2-83e8-bf6432ef245b tempest-FlavorsAdminTestJSON-334926784 tempest-FlavorsAdminTestJSON-334926784-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.030930 Oct 04 20:33:34.359654 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 44/71] 10.222.0.33 () {58 vars in 1146 bytes} [Tue Oct 4 20:33:34 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:33:34.379313 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-97d1baf3-bde7-45d7-9285-a8903fca8877 tempest-FlavorsAccessNegativeTestJSON-845567461 tempest-FlavorsAccessNegativeTestJSON-845567461-project-admin] HTTP exception thrown: Flavor access already exists for flavor 27 and project 2366351eb3dc4c0a9771c89526c4debe combination. Oct 04 20:33:34.384007 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-14b241b0-06f8-439b-b192-4b300e068836 tempest-FlavorsAdminTestJSON-334926784 tempest-FlavorsAdminTestJSON-334926784-project-admin] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:34.403780 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-97d1baf3-bde7-45d7-9285-a8903fca8877 tempest-FlavorsAccessNegativeTestJSON-845567461 tempest-FlavorsAccessNegativeTestJSON-845567461-project-admin] Request method failure captured: Oct 04 20:33:34.403780 n-d-854823-8 devstack@n-api.service[128801]: request: POST /compute/v2.1/flavors/1987983911/action HTTP/1.1 Oct 04 20:33:34.403780 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:33:34.403780 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:33:34.403780 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:33:34.403780 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 67 Oct 04 20:33:34.403780 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:33:34.403780 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:33:34.403780 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:33:34.403780 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:33:34.403780 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJibdmjPVawpo8UpmKvSmZB3dNMyJ7iI7g9nCklc7vsaLCw_gvlDhPkz9LXNoBZwJXXjYufWi6qnH0r4pI1GiQHtcDtM4T9u5xXbqQBMx5bA5qct9P4gZASZlbiXpAZCU4qgx2yr1UF6nzh3M-hWYM9IAp8EwhDWi3vu3BGIdsJ7TnY Oct 04 20:33:34.403780 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:33:34.403780 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:33:34.403780 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:33:34.403780 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:33:34.403780 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:33:34.403780 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:33:34.403780 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: d84ba64c1cec440dae60100d1506a174 Oct 04 20:33:34.403780 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-845567461 Oct 04 20:33:34.403780 n-d-854823-8 devstack@n-api.service[128801]: X-Role: admin,reader,member Oct 04 20:33:34.403780 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: admin,reader,member Oct 04 20:33:34.404901 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d84ba64c1cec440dae60100d1506a174", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d84ba64c1cec440dae60100d1506a174"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d84ba64c1cec440dae60100d1506a174"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d84ba64c1cec440dae60100d1506a174"}]}] Oct 04 20:33:34.404901 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-845567461 Oct 04 20:33:34.404901 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: d84ba64c1cec440dae60100d1506a174 Oct 04 20:33:34.404901 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-845567461 Oct 04 20:33:34.404901 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-FlavorsAccessNegativeTestJSON-845567461-project-admin Oct 04 20:33:34.404901 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:33:34.404901 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:33:34.404901 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: a2e94e649a8a4bcc9b38a27f90ff1168 Oct 04 20:33:34.404901 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-845567461-project-admin Oct 04 20:33:34.404901 n-d-854823-8 devstack@n-api.service[128801]: Oct 04 20:33:34.404901 n-d-854823-8 devstack@n-api.service[128801]: {"addTenantAccess": {"tenant": "2366351eb3dc4c0a9771c89526c4debe"}} Oct 04 20:33:34.404901 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 20:33:34.405489 n-d-854823-8 devstack@n-api.service[128801]: exception: Flavor access already exists for flavor 27 and project 2366351eb3dc4c0a9771c89526c4debe combination. Oct 04 20:33:34.405489 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': '1987983911', 'body': {'addTenantAccess': {'tenant': '2366351eb3dc4c0a9771c89526c4debe'}}} Oct 04 20:33:34.405489 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:33:34.405489 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:33:34.405489 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 04 20:33:34.405489 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 04 20:33:34.405489 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 04 20:33:34.405489 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 04 20:33:34.405489 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 04 20:33:34.405489 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 04 20:33:34.405489 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 04 20:33:34.405489 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 04 20:33:34.405489 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 04 20:33:34.405489 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 04 20:33:34.405489 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 04 20:33:34.405489 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi result.read() Oct 04 20:33:34.405489 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 04 20:33:34.405489 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 04 20:33:34.406443 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 04 20:33:34.406443 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 04 20:33:34.406443 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 04 20:33:34.406443 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 04 20:33:34.406443 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 04 20:33:34.406443 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 04 20:33:34.406443 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '27-2366351eb3dc4c0a9771c89526c4debe' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Oct 04 20:33:34.406443 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:33:34.406443 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 04 20:33:34.406443 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:33:34.406443 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:33:34.406443 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 73, in _flavor_add_project Oct 04 20:33:34.406443 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi project.save(context.session) Oct 04 20:33:34.406443 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Oct 04 20:33:34.406443 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi session.flush() Oct 04 20:33:34.406443 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 04 20:33:34.406443 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self._flush(objects) Oct 04 20:33:34.406443 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 04 20:33:34.406443 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Oct 04 20:33:34.407465 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 04 20:33:34.407465 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi compat.raise_( Oct 04 20:33:34.407465 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 04 20:33:34.407465 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception Oct 04 20:33:34.407465 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 04 20:33:34.407465 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi flush_context.execute() Oct 04 20:33:34.407465 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 04 20:33:34.407465 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi rec.execute(self) Oct 04 20:33:34.407465 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 04 20:33:34.407465 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Oct 04 20:33:34.407465 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 04 20:33:34.407465 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Oct 04 20:33:34.407465 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 04 20:33:34.407465 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Oct 04 20:33:34.407465 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 04 20:33:34.407465 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Oct 04 20:33:34.407465 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 04 20:33:34.407465 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Oct 04 20:33:34.408357 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 04 20:33:34.408357 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Oct 04 20:33:34.408357 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 04 20:33:34.408357 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Oct 04 20:33:34.408357 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 04 20:33:34.408357 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 04 20:33:34.408357 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 04 20:33:34.408357 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception Oct 04 20:33:34.408357 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 04 20:33:34.408357 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 04 20:33:34.408357 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 04 20:33:34.408357 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 04 20:33:34.408357 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 04 20:33:34.408357 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 04 20:33:34.408357 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 04 20:33:34.408357 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 04 20:33:34.408357 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 04 20:33:34.408357 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 04 20:33:34.409186 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 04 20:33:34.409186 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi result.read() Oct 04 20:33:34.409186 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 04 20:33:34.409186 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 04 20:33:34.409186 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 04 20:33:34.409186 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 04 20:33:34.409186 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 04 20:33:34.409186 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 04 20:33:34.409186 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 04 20:33:34.409186 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 04 20:33:34.409186 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '27-2366351eb3dc4c0a9771c89526c4debe' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Oct 04 20:33:34.409186 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO flavor_projects (created_at, updated_at, flavor_id, project_id) VALUES (%(created_at)s, %(updated_at)s, %(flavor_id)s, %(project_id)s)] Oct 04 20:33:34.409186 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 10, 4, 20, 33, 34, 372480), 'updated_at': None, 'flavor_id': 27, 'project_id': '2366351eb3dc4c0a9771c89526c4debe'}] Oct 04 20:33:34.409186 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 04 20:33:34.409186 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:33:34.409186 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:33:34.409186 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:33:34.412224 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:33:34.412224 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 79, in _add_tenant_access Oct 04 20:33:34.412224 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi flavor.add_access(tenant) Oct 04 20:33:34.412224 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 04 20:33:34.412224 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 04 20:33:34.412224 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 411, in add_access Oct 04 20:33:34.412224 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self._add_access(project_id) Oct 04 20:33:34.412224 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 404, in _add_access Oct 04 20:33:34.412224 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self._flavor_add_project(self._context, self.id, project_id) Oct 04 20:33:34.412224 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 397, in _flavor_add_project Oct 04 20:33:34.412224 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return _flavor_add_project(context, flavor_id, project_id) Oct 04 20:33:34.412224 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 20:33:34.412224 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 20:33:34.412224 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 75, in _flavor_add_project Oct 04 20:33:34.412224 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessExists(flavor_id=flavor_id, Oct 04 20:33:34.412224 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessExists: Flavor access already exists for flavor 27 and project 2366351eb3dc4c0a9771c89526c4debe combination. Oct 04 20:33:34.412224 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:33:34.412224 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:33:34.412224 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:33:34.414656 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:33:34.414656 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:33:34.414656 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:33:34.414656 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:33:34.414656 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:33:34.414656 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:33:34.414656 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:33:34.414656 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:33:34.414656 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:33:34.414656 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 83, in _add_tenant_access Oct 04 20:33:34.414656 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=err.format_message()) Oct 04 20:33:34.414656 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Flavor access already exists for flavor 27 and project 2366351eb3dc4c0a9771c89526c4debe combination. Oct 04 20:33:34.414656 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:33:34.414656 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:33:34.414656 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:33:34.414656 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:33:34.414656 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:33:34.414656 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:33:34.414656 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:33:34.414656 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:33:34.418411 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access already exists for flavor 27 and project 2366351eb3dc4c0a9771c89526c4debe combination. Oct 04 20:33:34.418411 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:33:34.418411 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-97d1baf3-bde7-45d7-9285-a8903fca8877 tempest-FlavorsAccessNegativeTestJSON-845567461 tempest-FlavorsAccessNegativeTestJSON-845567461-project-admin] Returning 409 to user: Flavor access already exists for flavor 27 and project 2366351eb3dc4c0a9771c89526c4debe combination. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:33:34.418411 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-97d1baf3-bde7-45d7-9285-a8903fca8877 tempest-FlavorsAccessNegativeTestJSON-845567461 tempest-FlavorsAccessNegativeTestJSON-845567461-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors/1987983911/action" status: 409 len: 152 microversion: 2.1 time: 0.223069 Oct 04 20:33:34.418411 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 28/72] 10.222.0.33 () {60 vars in 1200 bytes} [Tue Oct 4 20:33:34 2022] POST /compute/v2.1/flavors/1987983911/action => generated 152 bytes in 224 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 04 20:33:34.423855 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f980735f-8c35-41bb-8e80-d94802ff58e5 tempest-FlavorsAccessNegativeTestJSON-845567461 tempest-FlavorsAccessNegativeTestJSON-845567461-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "2366351eb3dc4c0a9771c89526c4debe"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:33:34.437059 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-14b241b0-06f8-439b-b192-4b300e068836 tempest-FlavorsAdminTestJSON-334926784 tempest-FlavorsAdminTestJSON-334926784-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/1508713634" status: 202 len: 0 microversion: 2.1 time: 0.061805 Oct 04 20:33:34.445368 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 45/73] 10.222.0.33 () {58 vars in 1161 bytes} [Tue Oct 4 20:33:34 2022] DELETE /compute/v2.1/flavors/1508713634 => generated 0 bytes in 72 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:33:34.451181 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-64db877c-51d3-4c78-a516-56a454b2a659 tempest-FlavorsAdminTestJSON-334926784 tempest-FlavorsAdminTestJSON-334926784-project-admin] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:34.474101 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-64db877c-51d3-4c78-a516-56a454b2a659 tempest-FlavorsAdminTestJSON-334926784 tempest-FlavorsAdminTestJSON-334926784-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.027296 Oct 04 20:33:34.488239 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 46/74] 10.222.0.33 () {58 vars in 1146 bytes} [Tue Oct 4 20:33:34 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:33:34.499417 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-2190f746-bcb1-433f-9f90-de68f8eec0a0 tempest-FlavorsAdminTestJSON-334926784 tempest-FlavorsAdminTestJSON-334926784-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-649264647", "id": 556437812, "os-flavor-access:is_public": "False"}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:33:34.522608 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-2190f746-bcb1-433f-9f90-de68f8eec0a0 tempest-FlavorsAdminTestJSON-334926784 tempest-FlavorsAdminTestJSON-334926784-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.1 time: 0.030252 Oct 04 20:33:34.523539 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 47/75] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 20:33:34 2022] POST /compute/v2.1/flavors => generated 411 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:33:34.545457 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-2651a92a-53c5-4ee1-82b0-58e4880a9fbd tempest-FlavorsAdminTestJSON-334926784 tempest-FlavorsAdminTestJSON-334926784-project-admin] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:34.582045 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-2651a92a-53c5-4ee1-82b0-58e4880a9fbd tempest-FlavorsAdminTestJSON-334926784 tempest-FlavorsAdminTestJSON-334926784-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.049137 Oct 04 20:33:34.595580 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 48/76] 10.222.0.33 () {58 vars in 1146 bytes} [Tue Oct 4 20:33:34 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:33:34.600968 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-3bb640ef-3ccd-424e-84e3-38d5482a783a tempest-FlavorsAdminTestJSON-1861389803 tempest-FlavorsAdminTestJSON-1861389803-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:34.632239 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-3bb640ef-3ccd-424e-84e3-38d5482a783a tempest-FlavorsAdminTestJSON-1861389803 tempest-FlavorsAdminTestJSON-1861389803-project] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.035258 Oct 04 20:33:34.643690 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 49/77] 10.222.0.33 () {58 vars in 1146 bytes} [Tue Oct 4 20:33:34 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:33:34.651749 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-941357c9-97ea-48f7-b660-9cdaa7c0dbce tempest-FlavorsAdminTestJSON-334926784 tempest-FlavorsAdminTestJSON-334926784-project-admin] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:34.673929 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-941357c9-97ea-48f7-b660-9cdaa7c0dbce tempest-FlavorsAdminTestJSON-334926784 tempest-FlavorsAdminTestJSON-334926784-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/556437812" status: 202 len: 0 microversion: 2.1 time: 0.026943 Oct 04 20:33:34.674823 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 50/78] 10.222.0.33 () {58 vars in 1158 bytes} [Tue Oct 4 20:33:34 2022] DELETE /compute/v2.1/flavors/556437812 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:33:34.683650 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-b2f1e8f9-8ad9-4e78-b5c2-d15491c3ae83 tempest-FlavorsAdminTestJSON-334926784 tempest-FlavorsAdminTestJSON-334926784-project-admin] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:34.738559 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-b2f1e8f9-8ad9-4e78-b5c2-d15491c3ae83 tempest-FlavorsAdminTestJSON-334926784 tempest-FlavorsAdminTestJSON-334926784-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.058627 Oct 04 20:33:34.740853 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 51/79] 10.222.0.33 () {58 vars in 1146 bytes} [Tue Oct 4 20:33:34 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:33:34.773155 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-450ee218-4965-473b-9101-3c36dccb73b6 tempest-FlavorsAdminTestJSON-334926784 tempest-FlavorsAdminTestJSON-334926784-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1720194889", "id": 779693294, "os-flavor-access:is_public": "True"}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:33:34.809706 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-450ee218-4965-473b-9101-3c36dccb73b6 tempest-FlavorsAdminTestJSON-334926784 tempest-FlavorsAdminTestJSON-334926784-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.1 time: 0.044305 Oct 04 20:33:34.810641 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 52/80] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 20:33:34 2022] POST /compute/v2.1/flavors => generated 411 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:33:34.827399 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-f06a2e80-2140-4e4d-9b90-e9377a36edb0 tempest-FlavorsAdminTestJSON-1861389803 tempest-FlavorsAdminTestJSON-1861389803-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:34.853124 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-f06a2e80-2140-4e4d-9b90-e9377a36edb0 tempest-FlavorsAdminTestJSON-1861389803 tempest-FlavorsAdminTestJSON-1861389803-project] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 5392 microversion: 2.1 time: 0.033901 Oct 04 20:33:34.855551 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 53/81] 10.222.0.33 () {58 vars in 1146 bytes} [Tue Oct 4 20:33:34 2022] GET /compute/v2.1/flavors/detail => generated 5392 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:33:34.873380 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-e4854e49-44f9-4ddb-b0d9-151b6fa6bbee tempest-FlavorsAdminTestJSON-334926784 tempest-FlavorsAdminTestJSON-334926784-project-admin] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:34.881347 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=6,nova_api:DELETE=16 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:33:34.895293 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-e4854e49-44f9-4ddb-b0d9-151b6fa6bbee tempest-FlavorsAdminTestJSON-334926784 tempest-FlavorsAdminTestJSON-334926784-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/779693294" status: 202 len: 0 microversion: 2.1 time: 0.025542 Oct 04 20:33:34.899875 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 54/82] 10.222.0.33 () {58 vars in 1158 bytes} [Tue Oct 4 20:33:34 2022] DELETE /compute/v2.1/flavors/779693294 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 20:33:34.905788 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-cf18413b-56e6-425a-91c4-588053eda218 tempest-FlavorsAdminTestJSON-334926784 tempest-FlavorsAdminTestJSON-334926784-project-admin] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:34.928386 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-cf18413b-56e6-425a-91c4-588053eda218 tempest-FlavorsAdminTestJSON-334926784 tempest-FlavorsAdminTestJSON-334926784-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.027256 Oct 04 20:33:34.929312 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 55/83] 10.222.0.33 () {58 vars in 1146 bytes} [Tue Oct 4 20:33:34 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:33:35.225060 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-27f46c48-4232-4f03-9b34-cde541acddaa tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:35.226559 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-27f46c48-4232-4f03-9b34-cde541acddaa tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] [instance: f2ad1271-aaba-4fe4-8f6c-854cf8e80bb7] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:33:35.239233 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-27f46c48-4232-4f03-9b34-cde541acddaa tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:35.240976 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-27f46c48-4232-4f03-9b34-cde541acddaa tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:35.241515 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-27f46c48-4232-4f03-9b34-cde541acddaa tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:35.243012 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-27f46c48-4232-4f03-9b34-cde541acddaa tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:35.244340 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-27f46c48-4232-4f03-9b34-cde541acddaa tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:35.245946 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-27f46c48-4232-4f03-9b34-cde541acddaa tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:35.289385 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f980735f-8c35-41bb-8e80-d94802ff58e5 tempest-FlavorsAccessNegativeTestJSON-845567461 tempest-FlavorsAccessNegativeTestJSON-845567461-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors/1987983911/action" status: 200 len: 21 microversion: 2.1 time: 0.871865 Oct 04 20:33:35.290309 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 29/84] 10.222.0.33 () {60 vars in 1200 bytes} [Tue Oct 4 20:33:34 2022] POST /compute/v2.1/flavors/1987983911/action => generated 21 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 20:33:35.301944 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-56010999-3773-4953-b339-52324cda1bbb tempest-FlavorsAccessNegativeTestJSON-845567461 tempest-FlavorsAccessNegativeTestJSON-845567461-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:35.349149 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-27f46c48-4232-4f03-9b34-cde541acddaa tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24987e1b118a41169a1974dc40568156', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930b67acdd8f4d4ea2acf80bb5b28059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:33:35.356474 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-56010999-3773-4953-b339-52324cda1bbb tempest-FlavorsAccessNegativeTestJSON-845567461 tempest-FlavorsAccessNegativeTestJSON-845567461-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/1987983911" status: 202 len: 0 microversion: 2.1 time: 0.059244 Oct 04 20:33:35.357645 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-27f46c48-4232-4f03-9b34-cde541acddaa tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] 10.222.0.33 "GET /compute/v2.1/servers/f2ad1271-aaba-4fe4-8f6c-854cf8e80bb7" status: 200 len: 1297 microversion: 2.1 time: 0.141477 Oct 04 20:33:35.357948 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 30/85] 10.222.0.33 () {58 vars in 1161 bytes} [Tue Oct 4 20:33:35 2022] DELETE /compute/v2.1/flavors/1987983911 => generated 0 bytes in 61 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 20:33:35.369146 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b0a02181-7306-458c-b6db-05a7a3a20105 tempest-FlavorsAccessNegativeTestJSON-845567461 tempest-FlavorsAccessNegativeTestJSON-845567461-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:35.377526 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 56/86] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:33:35 2022] GET /compute/v2.1/servers/f2ad1271-aaba-4fe4-8f6c-854cf8e80bb7 => generated 1297 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:33:35.401477 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b0a02181-7306-458c-b6db-05a7a3a20105 tempest-FlavorsAccessNegativeTestJSON-845567461 tempest-FlavorsAccessNegativeTestJSON-845567461-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.039609 Oct 04 20:33:35.407486 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 31/87] 10.222.0.33 () {58 vars in 1146 bytes} [Tue Oct 4 20:33:35 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:33:35.423995 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-43c398f4-4342-4dcb-8474-b1a95f23ed58 tempest-FlavorsAccessNegativeTestJSON-845567461 tempest-FlavorsAccessNegativeTestJSON-845567461-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1500521665", "id": 1490515702, "os-flavor-access:is_public": "True"}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:33:35.463005 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-43c398f4-4342-4dcb-8474-b1a95f23ed58 tempest-FlavorsAccessNegativeTestJSON-845567461 tempest-FlavorsAccessNegativeTestJSON-845567461-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.042629 Oct 04 20:33:35.464471 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 57/88] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 20:33:35 2022] POST /compute/v2.1/flavors => generated 438 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:33:35.478726 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1420d22c-fddb-4d2b-90ce-2860931afefe tempest-FlavorsAccessNegativeTestJSON-845567461 tempest-FlavorsAccessNegativeTestJSON-845567461-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:35.498591 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-1420d22c-fddb-4d2b-90ce-2860931afefe tempest-FlavorsAccessNegativeTestJSON-845567461 tempest-FlavorsAccessNegativeTestJSON-845567461-project-admin] HTTP exception thrown: Access list not available for public flavors. Oct 04 20:33:35.501423 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1420d22c-fddb-4d2b-90ce-2860931afefe tempest-FlavorsAccessNegativeTestJSON-845567461 tempest-FlavorsAccessNegativeTestJSON-845567461-project-admin] Request method failure captured: Oct 04 20:33:35.501423 n-d-854823-8 devstack@n-api.service[128801]: request: GET /compute/v2.1/flavors/1490515702/os-flavor-access HTTP/1.1 Oct 04 20:33:35.501423 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:33:35.501423 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:33:35.501423 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:33:35.501423 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 0 Oct 04 20:33:35.501423 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:33:35.501423 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:33:35.501423 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:33:35.501423 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:33:35.501423 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJibdmjPVawpo8UpmKvSmZB3dNMyJ7iI7g9nCklc7vsaLCw_gvlDhPkz9LXNoBZwJXXjYufWi6qnH0r4pI1GiQHtcDtM4T9u5xXbqQBMx5bA5qct9P4gZASZlbiXpAZCU4qgx2yr1UF6nzh3M-hWYM9IAp8EwhDWi3vu3BGIdsJ7TnY Oct 04 20:33:35.501423 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:33:35.501423 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:33:35.501423 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:33:35.501423 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:33:35.501423 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:33:35.501423 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:33:35.501423 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: d84ba64c1cec440dae60100d1506a174 Oct 04 20:33:35.501423 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-845567461 Oct 04 20:33:35.501423 n-d-854823-8 devstack@n-api.service[128801]: X-Role: admin,reader,member Oct 04 20:33:35.501423 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: admin,reader,member Oct 04 20:33:35.502530 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d84ba64c1cec440dae60100d1506a174", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d84ba64c1cec440dae60100d1506a174"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d84ba64c1cec440dae60100d1506a174"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d84ba64c1cec440dae60100d1506a174"}]}] Oct 04 20:33:35.502530 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-845567461 Oct 04 20:33:35.502530 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: d84ba64c1cec440dae60100d1506a174 Oct 04 20:33:35.502530 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-845567461 Oct 04 20:33:35.502530 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-FlavorsAccessNegativeTestJSON-845567461-project-admin Oct 04 20:33:35.502530 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:33:35.502530 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:33:35.502530 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: a2e94e649a8a4bcc9b38a27f90ff1168 Oct 04 20:33:35.502530 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-845567461-project-admin Oct 04 20:33:35.502530 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 20:33:35.502530 n-d-854823-8 devstack@n-api.service[128801]: exception: Access list not available for public flavors. Oct 04 20:33:35.502530 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'flavor_id': '1490515702'} Oct 04 20:33:35.503153 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:33:35.503153 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:33:35.503153 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:33:35.503153 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:33:35.503153 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:33:35.503153 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:33:35.503153 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:33:35.503153 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:33:35.503153 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 52, in index Oct 04 20:33:35.503153 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 04 20:33:35.503153 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Access list not available for public flavors. Oct 04 20:33:35.503153 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:33:35.503153 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:33:35.503153 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:33:35.503153 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:33:35.503153 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:33:35.503153 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:33:35.503153 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:33:35.503153 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:33:35.503153 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Access list not available for public flavors. Oct 04 20:33:35.503153 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:33:35.507445 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1420d22c-fddb-4d2b-90ce-2860931afefe tempest-FlavorsAccessNegativeTestJSON-845567461 tempest-FlavorsAccessNegativeTestJSON-845567461-project-admin] Returning 404 to user: Access list not available for public flavors. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:33:35.507445 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-1420d22c-fddb-4d2b-90ce-2860931afefe tempest-FlavorsAccessNegativeTestJSON-845567461 tempest-FlavorsAccessNegativeTestJSON-845567461-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/1490515702/os-flavor-access" status: 404 len: 91 microversion: 2.1 time: 0.029763 Oct 04 20:33:35.509891 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 32/89] 10.222.0.33 () {58 vars in 1209 bytes} [Tue Oct 4 20:33:35 2022] GET /compute/v2.1/flavors/1490515702/os-flavor-access => generated 91 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 20:33:35.513786 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-b42ccfd9-ca3b-4151-8414-79d46818b231 tempest-FlavorsAccessNegativeTestJSON-845567461 tempest-FlavorsAccessNegativeTestJSON-845567461-project-admin] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:35.562006 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-b42ccfd9-ca3b-4151-8414-79d46818b231 tempest-FlavorsAccessNegativeTestJSON-845567461 tempest-FlavorsAccessNegativeTestJSON-845567461-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/1490515702" status: 202 len: 0 microversion: 2.1 time: 0.053984 Oct 04 20:33:35.562632 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 58/90] 10.222.0.33 () {58 vars in 1161 bytes} [Tue Oct 4 20:33:35 2022] DELETE /compute/v2.1/flavors/1490515702 => generated 0 bytes in 55 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:33:35.585441 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1d73e803-5c60-4e70-9779-6ea7e8c9bfbc tempest-FlavorsAccessNegativeTestJSON-845567461 tempest-FlavorsAccessNegativeTestJSON-845567461-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:35.644962 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-1d73e803-5c60-4e70-9779-6ea7e8c9bfbc tempest-FlavorsAccessNegativeTestJSON-845567461 tempest-FlavorsAccessNegativeTestJSON-845567461-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.071822 Oct 04 20:33:35.662060 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 33/91] 10.222.0.33 () {58 vars in 1146 bytes} [Tue Oct 4 20:33:35 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:33:35.674598 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-37281178-6a14-4b67-9549-4a3abfccce9b tempest-FlavorsAccessNegativeTestJSON-845567461 tempest-FlavorsAccessNegativeTestJSON-845567461-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1596860081", "id": 2056705031, "os-flavor-access:is_public": "False"}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:33:35.728262 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-37281178-6a14-4b67-9549-4a3abfccce9b tempest-FlavorsAccessNegativeTestJSON-845567461 tempest-FlavorsAccessNegativeTestJSON-845567461-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.059095 Oct 04 20:33:35.728879 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 59/92] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 20:33:35 2022] POST /compute/v2.1/flavors => generated 439 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 20:33:36.348431 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f1fa6e09-c503-4ae3-9646-8690e01b8e9b tempest-FlavorsAccessNegativeTestJSON-1359200897 tempest-FlavorsAccessNegativeTestJSON-1359200897-project] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "2366351eb3dc4c0a9771c89526c4debe"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:33:36.357621 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f1fa6e09-c503-4ae3-9646-8690e01b8e9b tempest-FlavorsAccessNegativeTestJSON-1359200897 tempest-FlavorsAccessNegativeTestJSON-1359200897-project] Policy check for os_compute_api:os-flavor-access:add_tenant_access failed with credentials {'is_admin': False, 'user_id': '98d27a01fc3d4047b85cce95410e720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2366351eb3dc4c0a9771c89526c4debe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:33:36.361186 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f1fa6e09-c503-4ae3-9646-8690e01b8e9b tempest-FlavorsAccessNegativeTestJSON-1359200897 tempest-FlavorsAccessNegativeTestJSON-1359200897-project] Request method failure captured: Oct 04 20:33:36.361186 n-d-854823-8 devstack@n-api.service[128801]: request: POST /compute/v2.1/flavors/2056705031/action HTTP/1.1 Oct 04 20:33:36.361186 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:33:36.361186 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:33:36.361186 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:33:36.361186 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 67 Oct 04 20:33:36.361186 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:33:36.361186 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:33:36.361186 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:33:36.361186 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:33:36.361186 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJiaDGhZBl845N91o6jPOOmCyB8ZEmjyHylTAKUZc4WMA9P9lDv-uaV65LaMT3iN-gx8x2Lt5bTZDxmcU7O6pU3_nC1BtqsIY1Qej-PvsNy6m1lIcreGULjCNntZtVLDF376z2FBgtCU3Y3mkABelurFb6mDJ0_SetGzIEbltdrKqWQ Oct 04 20:33:36.361186 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:33:36.361186 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:33:36.361186 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:33:36.361186 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:33:36.361186 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:33:36.361186 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:33:36.361186 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: 2366351eb3dc4c0a9771c89526c4debe Oct 04 20:33:36.361186 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1359200897 Oct 04 20:33:36.361186 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 20:33:36.361186 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 20:33:36.362362 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_2366351eb3dc4c0a9771c89526c4debe", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2366351eb3dc4c0a9771c89526c4debe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2366351eb3dc4c0a9771c89526c4debe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/2366351eb3dc4c0a9771c89526c4debe"}]}] Oct 04 20:33:36.362362 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1359200897 Oct 04 20:33:36.362362 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: 2366351eb3dc4c0a9771c89526c4debe Oct 04 20:33:36.362362 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1359200897 Oct 04 20:33:36.362362 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-FlavorsAccessNegativeTestJSON-1359200897-project Oct 04 20:33:36.362362 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:33:36.362362 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:33:36.362362 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: 98d27a01fc3d4047b85cce95410e720b Oct 04 20:33:36.362362 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1359200897-project Oct 04 20:33:36.362362 n-d-854823-8 devstack@n-api.service[128801]: Oct 04 20:33:36.362362 n-d-854823-8 devstack@n-api.service[128801]: {"addTenantAccess": {"tenant": "2366351eb3dc4c0a9771c89526c4debe"}} Oct 04 20:33:36.362362 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 20:33:36.362970 n-d-854823-8 devstack@n-api.service[128801]: exception: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Oct 04 20:33:36.362970 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': '2056705031', 'body': {'addTenantAccess': {'tenant': '2366351eb3dc4c0a9771c89526c4debe'}}} Oct 04 20:33:36.362970 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:33:36.362970 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:33:36.362970 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:33:36.362970 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:33:36.362970 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:33:36.362970 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:33:36.362970 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:33:36.362970 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:33:36.362970 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:33:36.362970 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:33:36.362970 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 66, in _add_tenant_access Oct 04 20:33:36.362970 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi context.can(fa_policies.POLICY_ROOT % "add_tenant_access", target={}) Oct 04 20:33:36.362970 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 20:33:36.362970 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 20:33:36.362970 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 20:33:36.362970 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 20:33:36.362970 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 20:33:36.364449 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 20:33:36.364449 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 20:33:36.364449 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 20:33:36.364449 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 20:33:36.364449 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 20:33:36.364449 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 20:33:36.364449 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 20:33:36.364449 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 20:33:36.364449 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 20:33:36.364449 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Oct 04 20:33:36.364449 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:33:36.364449 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:33:36.364449 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:33:36.364449 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:33:36.364449 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:33:36.364449 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:33:36.364449 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 20:33:36.364449 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 20:33:36.364449 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Oct 04 20:33:36.364449 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:33:36.370840 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f1fa6e09-c503-4ae3-9646-8690e01b8e9b tempest-FlavorsAccessNegativeTestJSON-1359200897 tempest-FlavorsAccessNegativeTestJSON-1359200897-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:33:36.371978 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f1fa6e09-c503-4ae3-9646-8690e01b8e9b tempest-FlavorsAccessNegativeTestJSON-1359200897 tempest-FlavorsAccessNegativeTestJSON-1359200897-project] 10.222.0.33 "POST /compute/v2.1/flavors/2056705031/action" status: 403 len: 130 microversion: 2.1 time: 0.634059 Oct 04 20:33:36.384423 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-7849764a-5e91-4783-b55b-8b643098ef81 tempest-FlavorsAccessNegativeTestJSON-845567461 tempest-FlavorsAccessNegativeTestJSON-845567461-project-admin] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:36.390291 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 34/93] 10.222.0.33 () {60 vars in 1200 bytes} [Tue Oct 4 20:33:35 2022] POST /compute/v2.1/flavors/2056705031/action => generated 130 bytes in 643 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:33:36.402165 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1f647070-791d-451c-88da-d27b289ce7b0 tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:36.416000 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-1f647070-791d-451c-88da-d27b289ce7b0 tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] [instance: f2ad1271-aaba-4fe4-8f6c-854cf8e80bb7] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:33:36.431274 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-7849764a-5e91-4783-b55b-8b643098ef81 tempest-FlavorsAccessNegativeTestJSON-845567461 tempest-FlavorsAccessNegativeTestJSON-845567461-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/2056705031" status: 202 len: 0 microversion: 2.1 time: 0.050538 Oct 04 20:33:36.438562 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 60/94] 10.222.0.33 () {58 vars in 1161 bytes} [Tue Oct 4 20:33:36 2022] DELETE /compute/v2.1/flavors/2056705031 => generated 0 bytes in 59 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:33:36.464550 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-74d91f6d-4a79-4e18-8485-f143fd130cf2 tempest-FlavorsAccessNegativeTestJSON-845567461 tempest-FlavorsAccessNegativeTestJSON-845567461-project-admin] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:36.472958 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1f647070-791d-451c-88da-d27b289ce7b0 tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:36.474623 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1f647070-791d-451c-88da-d27b289ce7b0 tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:36.475670 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1f647070-791d-451c-88da-d27b289ce7b0 tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:36.477838 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1f647070-791d-451c-88da-d27b289ce7b0 tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:36.478720 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1f647070-791d-451c-88da-d27b289ce7b0 tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:36.482754 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1f647070-791d-451c-88da-d27b289ce7b0 tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:36.531098 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-74d91f6d-4a79-4e18-8485-f143fd130cf2 tempest-FlavorsAccessNegativeTestJSON-845567461 tempest-FlavorsAccessNegativeTestJSON-845567461-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.090355 Oct 04 20:33:36.553523 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 61/95] 10.222.0.33 () {58 vars in 1146 bytes} [Tue Oct 4 20:33:36 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:33:36.561025 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-7457b6d7-48ce-4ad9-9a5e-02a16e134abe tempest-FlavorsAccessNegativeTestJSON-845567461 tempest-FlavorsAccessNegativeTestJSON-845567461-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-693743050", "id": 1577530534, "os-flavor-access:is_public": "False"}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:33:36.595262 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-7457b6d7-48ce-4ad9-9a5e-02a16e134abe tempest-FlavorsAccessNegativeTestJSON-845567461 tempest-FlavorsAccessNegativeTestJSON-845567461-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.039813 Oct 04 20:33:36.616072 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 62/96] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 20:33:36 2022] POST /compute/v2.1/flavors => generated 438 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:33:36.622046 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-b01f07ba-8513-41e1-b62b-73b4c8fb8e42 tempest-FlavorsAccessNegativeTestJSON-845567461 tempest-FlavorsAccessNegativeTestJSON-845567461-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "2366351eb3dc4c0a9771c89526c4debe"}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:33:37.209936 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-1f647070-791d-451c-88da-d27b289ce7b0 tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24987e1b118a41169a1974dc40568156', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930b67acdd8f4d4ea2acf80bb5b28059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:33:37.250278 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-1f647070-791d-451c-88da-d27b289ce7b0 tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] 10.222.0.33 "GET /compute/v2.1/servers/f2ad1271-aaba-4fe4-8f6c-854cf8e80bb7" status: 200 len: 1339 microversion: 2.1 time: 0.850776 Oct 04 20:33:37.251334 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 35/97] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:33:36 2022] GET /compute/v2.1/servers/f2ad1271-aaba-4fe4-8f6c-854cf8e80bb7 => generated 1339 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:33:37.683801 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-b01f07ba-8513-41e1-b62b-73b4c8fb8e42 tempest-FlavorsAccessNegativeTestJSON-845567461 tempest-FlavorsAccessNegativeTestJSON-845567461-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors/1577530534/action" status: 200 len: 97 microversion: 2.1 time: 1.066320 Oct 04 20:33:37.687842 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 63/98] 10.222.0.33 () {60 vars in 1200 bytes} [Tue Oct 4 20:33:36 2022] POST /compute/v2.1/flavors/1577530534/action => generated 97 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 20:33:37.703615 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-eeb539f2-c725-487a-82e3-809f64aa8d7e tempest-FlavorsAccessNegativeTestJSON-1359200897 tempest-FlavorsAccessNegativeTestJSON-1359200897-project] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "2366351eb3dc4c0a9771c89526c4debe"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:33:37.707049 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-eeb539f2-c725-487a-82e3-809f64aa8d7e tempest-FlavorsAccessNegativeTestJSON-1359200897 tempest-FlavorsAccessNegativeTestJSON-1359200897-project] Policy check for os_compute_api:os-flavor-access:remove_tenant_access failed with credentials {'is_admin': False, 'user_id': '98d27a01fc3d4047b85cce95410e720b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2366351eb3dc4c0a9771c89526c4debe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:33:37.722624 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-eeb539f2-c725-487a-82e3-809f64aa8d7e tempest-FlavorsAccessNegativeTestJSON-1359200897 tempest-FlavorsAccessNegativeTestJSON-1359200897-project] Request method failure captured: Oct 04 20:33:37.722624 n-d-854823-8 devstack@n-api.service[128801]: request: POST /compute/v2.1/flavors/1577530534/action HTTP/1.1 Oct 04 20:33:37.722624 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:33:37.722624 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:33:37.722624 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:33:37.722624 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 70 Oct 04 20:33:37.722624 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:33:37.722624 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:33:37.722624 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:33:37.722624 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:33:37.722624 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJiaDGhZBl845N91o6jPOOmCyB8ZEmjyHylTAKUZc4WMA9P9lDv-uaV65LaMT3iN-gx8x2Lt5bTZDxmcU7O6pU3_nC1BtqsIY1Qej-PvsNy6m1lIcreGULjCNntZtVLDF376z2FBgtCU3Y3mkABelurFb6mDJ0_SetGzIEbltdrKqWQ Oct 04 20:33:37.722624 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:33:37.722624 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:33:37.722624 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:33:37.722624 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:33:37.722624 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:33:37.722624 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:33:37.722624 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: 2366351eb3dc4c0a9771c89526c4debe Oct 04 20:33:37.722624 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1359200897 Oct 04 20:33:37.722624 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 20:33:37.722624 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 20:33:37.723792 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_2366351eb3dc4c0a9771c89526c4debe", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2366351eb3dc4c0a9771c89526c4debe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2366351eb3dc4c0a9771c89526c4debe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/2366351eb3dc4c0a9771c89526c4debe"}]}] Oct 04 20:33:37.723792 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1359200897 Oct 04 20:33:37.723792 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: 2366351eb3dc4c0a9771c89526c4debe Oct 04 20:33:37.723792 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1359200897 Oct 04 20:33:37.723792 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-FlavorsAccessNegativeTestJSON-1359200897-project Oct 04 20:33:37.723792 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:33:37.723792 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:33:37.723792 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: 98d27a01fc3d4047b85cce95410e720b Oct 04 20:33:37.723792 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1359200897-project Oct 04 20:33:37.723792 n-d-854823-8 devstack@n-api.service[128801]: Oct 04 20:33:37.723792 n-d-854823-8 devstack@n-api.service[128801]: {"removeTenantAccess": {"tenant": "2366351eb3dc4c0a9771c89526c4debe"}} Oct 04 20:33:37.723792 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 20:33:37.724495 n-d-854823-8 devstack@n-api.service[128801]: exception: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Oct 04 20:33:37.724495 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': '1577530534', 'body': {'removeTenantAccess': {'tenant': '2366351eb3dc4c0a9771c89526c4debe'}}} Oct 04 20:33:37.724495 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:33:37.724495 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:33:37.724495 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:33:37.724495 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:33:37.724495 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:33:37.724495 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:33:37.724495 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:33:37.724495 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:33:37.724495 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:33:37.724495 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:33:37.724495 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 91, in _remove_tenant_access Oct 04 20:33:37.724495 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi context.can( Oct 04 20:33:37.724495 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 20:33:37.724495 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 20:33:37.724495 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 20:33:37.724495 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 20:33:37.724495 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 20:33:37.724495 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 20:33:37.725847 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 20:33:37.725847 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 20:33:37.725847 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 20:33:37.725847 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 20:33:37.725847 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 20:33:37.725847 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 20:33:37.725847 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 20:33:37.725847 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 20:33:37.725847 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Oct 04 20:33:37.725847 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:33:37.725847 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:33:37.725847 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:33:37.725847 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:33:37.725847 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:33:37.725847 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:33:37.725847 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 20:33:37.725847 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 20:33:37.725847 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Oct 04 20:33:37.725847 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:33:37.731564 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-eeb539f2-c725-487a-82e3-809f64aa8d7e tempest-FlavorsAccessNegativeTestJSON-1359200897 tempest-FlavorsAccessNegativeTestJSON-1359200897-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:33:37.731564 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-eeb539f2-c725-487a-82e3-809f64aa8d7e tempest-FlavorsAccessNegativeTestJSON-1359200897 tempest-FlavorsAccessNegativeTestJSON-1359200897-project] 10.222.0.33 "POST /compute/v2.1/flavors/1577530534/action" status: 403 len: 133 microversion: 2.1 time: 0.029082 Oct 04 20:33:37.731564 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 36/99] 10.222.0.33 () {60 vars in 1200 bytes} [Tue Oct 4 20:33:37 2022] POST /compute/v2.1/flavors/1577530534/action => generated 133 bytes in 31 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:33:37.735343 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-e651c077-5a88-4c42-b087-a1180449311d tempest-FlavorsAccessNegativeTestJSON-845567461 tempest-FlavorsAccessNegativeTestJSON-845567461-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "2366351eb3dc4c0a9771c89526c4debe"}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:33:38.279965 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-87aa2636-927c-4df4-9040-73802aca2cef tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:38.281014 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-87aa2636-927c-4df4-9040-73802aca2cef tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] [instance: f2ad1271-aaba-4fe4-8f6c-854cf8e80bb7] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:33:38.302003 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-87aa2636-927c-4df4-9040-73802aca2cef tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:38.302689 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-87aa2636-927c-4df4-9040-73802aca2cef tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:38.303177 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-87aa2636-927c-4df4-9040-73802aca2cef tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:38.307703 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-87aa2636-927c-4df4-9040-73802aca2cef tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:38.308639 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-87aa2636-927c-4df4-9040-73802aca2cef tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:38.309237 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-87aa2636-927c-4df4-9040-73802aca2cef tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:38.945359 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-e651c077-5a88-4c42-b087-a1180449311d tempest-FlavorsAccessNegativeTestJSON-845567461 tempest-FlavorsAccessNegativeTestJSON-845567461-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors/1577530534/action" status: 200 len: 21 microversion: 2.1 time: 1.214028 Oct 04 20:33:38.949507 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 64/100] 10.222.0.33 () {60 vars in 1200 bytes} [Tue Oct 4 20:33:37 2022] POST /compute/v2.1/flavors/1577530534/action => generated 21 bytes in 1219 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 20:33:38.981227 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-a6f72c29-93aa-4606-8808-f8faa823df77 tempest-FlavorsAccessNegativeTestJSON-845567461 tempest-FlavorsAccessNegativeTestJSON-845567461-project-admin] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:39.044171 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-a6f72c29-93aa-4606-8808-f8faa823df77 tempest-FlavorsAccessNegativeTestJSON-845567461 tempest-FlavorsAccessNegativeTestJSON-845567461-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/1577530534" status: 202 len: 0 microversion: 2.1 time: 0.080573 Oct 04 20:33:39.051653 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 65/101] 10.222.0.33 () {58 vars in 1161 bytes} [Tue Oct 4 20:33:38 2022] DELETE /compute/v2.1/flavors/1577530534 => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:33:39.069620 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-29aa0072-34df-4a9f-99e6-1658decb2fba tempest-FlavorsAccessNegativeTestJSON-845567461 tempest-FlavorsAccessNegativeTestJSON-845567461-project-admin] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:39.128578 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-29aa0072-34df-4a9f-99e6-1658decb2fba tempest-FlavorsAccessNegativeTestJSON-845567461 tempest-FlavorsAccessNegativeTestJSON-845567461-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.075474 Oct 04 20:33:39.145048 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 66/102] 10.222.0.33 () {58 vars in 1146 bytes} [Tue Oct 4 20:33:39 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:33:39.176117 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-77efa00d-2fdd-4c41-b89c-af2bbe6f7321 tempest-FlavorsAccessNegativeTestJSON-845567461 tempest-FlavorsAccessNegativeTestJSON-845567461-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1989278057", "id": 1965130153, "os-flavor-access:is_public": "False"}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:33:39.200603 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-87aa2636-927c-4df4-9040-73802aca2cef tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24987e1b118a41169a1974dc40568156', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930b67acdd8f4d4ea2acf80bb5b28059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:33:39.211119 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-87aa2636-927c-4df4-9040-73802aca2cef tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] 10.222.0.33 "GET /compute/v2.1/servers/f2ad1271-aaba-4fe4-8f6c-854cf8e80bb7" status: 200 len: 1339 microversion: 2.1 time: 0.937980 Oct 04 20:33:39.220766 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 37/103] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:33:38 2022] GET /compute/v2.1/servers/f2ad1271-aaba-4fe4-8f6c-854cf8e80bb7 => generated 1339 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:33:39.228307 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-77efa00d-2fdd-4c41-b89c-af2bbe6f7321 tempest-FlavorsAccessNegativeTestJSON-845567461 tempest-FlavorsAccessNegativeTestJSON-845567461-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.069592 Oct 04 20:33:39.229819 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 67/104] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 20:33:39 2022] POST /compute/v2.1/flavors => generated 439 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:33:39.242558 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-64076d15-29f6-4112-a146-f8611433261d tempest-FlavorsAccessNegativeTestJSON-845567461 tempest-FlavorsAccessNegativeTestJSON-845567461-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "7fb24d37aaa0414382c4978693dc9ea7"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:33:39.409812 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:33:39.811379 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-64076d15-29f6-4112-a146-f8611433261d tempest-FlavorsAccessNegativeTestJSON-845567461 tempest-FlavorsAccessNegativeTestJSON-845567461-project-admin] HTTP exception thrown: Flavor access not found for 33 / 7fb24d37aaa0414382c4978693dc9ea7 combination. Oct 04 20:33:39.820067 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-64076d15-29f6-4112-a146-f8611433261d tempest-FlavorsAccessNegativeTestJSON-845567461 tempest-FlavorsAccessNegativeTestJSON-845567461-project-admin] Request method failure captured: Oct 04 20:33:39.820067 n-d-854823-8 devstack@n-api.service[128801]: request: POST /compute/v2.1/flavors/1965130153/action HTTP/1.1 Oct 04 20:33:39.820067 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:33:39.820067 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:33:39.820067 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:33:39.820067 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 70 Oct 04 20:33:39.820067 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:33:39.820067 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:33:39.820067 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:33:39.820067 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:33:39.820067 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJibdmjPVawpo8UpmKvSmZB3dNMyJ7iI7g9nCklc7vsaLCw_gvlDhPkz9LXNoBZwJXXjYufWi6qnH0r4pI1GiQHtcDtM4T9u5xXbqQBMx5bA5qct9P4gZASZlbiXpAZCU4qgx2yr1UF6nzh3M-hWYM9IAp8EwhDWi3vu3BGIdsJ7TnY Oct 04 20:33:39.820067 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:33:39.820067 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:33:39.820067 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:33:39.820067 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:33:39.820067 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:33:39.820067 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:33:39.820067 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: d84ba64c1cec440dae60100d1506a174 Oct 04 20:33:39.820067 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-845567461 Oct 04 20:33:39.820067 n-d-854823-8 devstack@n-api.service[128801]: X-Role: admin,reader,member Oct 04 20:33:39.820067 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: admin,reader,member Oct 04 20:33:39.821209 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d84ba64c1cec440dae60100d1506a174", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d84ba64c1cec440dae60100d1506a174"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d84ba64c1cec440dae60100d1506a174"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d84ba64c1cec440dae60100d1506a174"}]}] Oct 04 20:33:39.821209 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-845567461 Oct 04 20:33:39.821209 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: d84ba64c1cec440dae60100d1506a174 Oct 04 20:33:39.821209 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-845567461 Oct 04 20:33:39.821209 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-FlavorsAccessNegativeTestJSON-845567461-project-admin Oct 04 20:33:39.821209 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:33:39.821209 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:33:39.821209 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: a2e94e649a8a4bcc9b38a27f90ff1168 Oct 04 20:33:39.821209 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-845567461-project-admin Oct 04 20:33:39.821209 n-d-854823-8 devstack@n-api.service[128801]: Oct 04 20:33:39.821209 n-d-854823-8 devstack@n-api.service[128801]: {"removeTenantAccess": {"tenant": "7fb24d37aaa0414382c4978693dc9ea7"}} Oct 04 20:33:39.821209 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 20:33:39.821812 n-d-854823-8 devstack@n-api.service[128801]: exception: Flavor access not found for 33 / 7fb24d37aaa0414382c4978693dc9ea7 combination. Oct 04 20:33:39.821812 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': '1965130153', 'body': {'removeTenantAccess': {'tenant': '7fb24d37aaa0414382c4978693dc9ea7'}}} Oct 04 20:33:39.821812 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:33:39.821812 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:33:39.821812 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 104, in _remove_tenant_access Oct 04 20:33:39.821812 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi flavor.remove_access(tenant) Oct 04 20:33:39.821812 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 04 20:33:39.821812 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 04 20:33:39.821812 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 423, in remove_access Oct 04 20:33:39.821812 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self._remove_access(project_id) Oct 04 20:33:39.821812 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 416, in _remove_access Oct 04 20:33:39.821812 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self._flavor_del_project(self._context, self.id, project_id) Oct 04 20:33:39.821812 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 401, in _flavor_del_project Oct 04 20:33:39.821812 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return _flavor_del_project(context, flavor_id, project_id) Oct 04 20:33:39.821812 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 20:33:39.821812 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 20:33:39.821812 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 86, in _flavor_del_project Oct 04 20:33:39.821812 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessNotFound(flavor_id=flavor_id, Oct 04 20:33:39.823522 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessNotFound: Flavor access not found for 33 / 7fb24d37aaa0414382c4978693dc9ea7 combination. Oct 04 20:33:39.823522 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:33:39.823522 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:33:39.823522 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:33:39.823522 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:33:39.823522 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:33:39.823522 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:33:39.823522 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:33:39.823522 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:33:39.823522 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:33:39.823522 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:33:39.823522 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:33:39.823522 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:33:39.823522 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 107, in _remove_tenant_access Oct 04 20:33:39.823522 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:33:39.823522 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor access not found for 33 / 7fb24d37aaa0414382c4978693dc9ea7 combination. Oct 04 20:33:39.823522 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:33:39.823522 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:33:39.823522 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:33:39.823522 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:33:39.824552 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:33:39.824552 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:33:39.824552 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:33:39.824552 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:33:39.824552 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access not found for 33 / 7fb24d37aaa0414382c4978693dc9ea7 combination. Oct 04 20:33:39.824552 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:33:39.828151 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-64076d15-29f6-4112-a146-f8611433261d tempest-FlavorsAccessNegativeTestJSON-845567461 tempest-FlavorsAccessNegativeTestJSON-845567461-project-admin] Returning 404 to user: Flavor access not found for 33 / 7fb24d37aaa0414382c4978693dc9ea7 combination. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:33:39.829280 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-64076d15-29f6-4112-a146-f8611433261d tempest-FlavorsAccessNegativeTestJSON-845567461 tempest-FlavorsAccessNegativeTestJSON-845567461-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors/1965130153/action" status: 404 len: 124 microversion: 2.1 time: 0.590674 Oct 04 20:33:39.832443 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 38/105] 10.222.0.33 () {60 vars in 1200 bytes} [Tue Oct 4 20:33:39 2022] POST /compute/v2.1/flavors/1965130153/action => generated 124 bytes in 594 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:33:39.841943 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-def61460-3482-4da9-91c7-6e73abc05c2e tempest-FlavorsAccessNegativeTestJSON-845567461 tempest-FlavorsAccessNegativeTestJSON-845567461-project-admin] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:39.899846 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-def61460-3482-4da9-91c7-6e73abc05c2e tempest-FlavorsAccessNegativeTestJSON-845567461 tempest-FlavorsAccessNegativeTestJSON-845567461-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/1965130153" status: 202 len: 0 microversion: 2.1 time: 0.058210 Oct 04 20:33:39.902268 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 68/106] 10.222.0.33 () {58 vars in 1161 bytes} [Tue Oct 4 20:33:39 2022] DELETE /compute/v2.1/flavors/1965130153 => generated 0 bytes in 65 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:33:39.911447 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6d821cf3-1294-444b-aa86-bf4a0b12329e tempest-FlavorsAccessNegativeTestJSON-845567461 tempest-FlavorsAccessNegativeTestJSON-845567461-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:39.971859 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-6d821cf3-1294-444b-aa86-bf4a0b12329e tempest-FlavorsAccessNegativeTestJSON-845567461 tempest-FlavorsAccessNegativeTestJSON-845567461-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.065009 Oct 04 20:33:39.978059 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 39/107] 10.222.0.33 () {58 vars in 1146 bytes} [Tue Oct 4 20:33:39 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:33:40.247697 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-451ddcda-14cf-4ed8-822e-e8a97d3f79a9 tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:40.248318 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-451ddcda-14cf-4ed8-822e-e8a97d3f79a9 tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] [instance: f2ad1271-aaba-4fe4-8f6c-854cf8e80bb7] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:33:40.266671 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-451ddcda-14cf-4ed8-822e-e8a97d3f79a9 tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:40.267499 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-451ddcda-14cf-4ed8-822e-e8a97d3f79a9 tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:40.270518 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-451ddcda-14cf-4ed8-822e-e8a97d3f79a9 tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:40.274303 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-451ddcda-14cf-4ed8-822e-e8a97d3f79a9 tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:40.274870 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-451ddcda-14cf-4ed8-822e-e8a97d3f79a9 tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:40.280583 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-451ddcda-14cf-4ed8-822e-e8a97d3f79a9 tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:41.077638 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell0:SELECT=4 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:33:41.144370 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-451ddcda-14cf-4ed8-822e-e8a97d3f79a9 tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24987e1b118a41169a1974dc40568156', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930b67acdd8f4d4ea2acf80bb5b28059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:33:41.158234 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-451ddcda-14cf-4ed8-822e-e8a97d3f79a9 tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] 10.222.0.33 "GET /compute/v2.1/servers/f2ad1271-aaba-4fe4-8f6c-854cf8e80bb7" status: 200 len: 1339 microversion: 2.1 time: 0.911075 Oct 04 20:33:41.159071 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 69/108] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:33:40 2022] GET /compute/v2.1/servers/f2ad1271-aaba-4fe4-8f6c-854cf8e80bb7 => generated 1339 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:33:41.911881 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-fac8b91c-edf9-4af0-94d3-d9936a6bb588 req-c5616202-d738-4ecb-ab93-693b8a117c39 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2ad1271-aaba-4fe4-8f6c-854cf8e80bb7", "tag": "733ba1a0-53ee-407f-9f93-1e7c55637523"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:33:41.947232 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-fac8b91c-edf9-4af0-94d3-d9936a6bb588 req-c5616202-d738-4ecb-ab93-693b8a117c39 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:41.948336 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-fac8b91c-edf9-4af0-94d3-d9936a6bb588 req-c5616202-d738-4ecb-ab93-693b8a117c39 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:41.966099 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-fac8b91c-edf9-4af0-94d3-d9936a6bb588 req-c5616202-d738-4ecb-ab93-693b8a117c39 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:42.029636 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-fac8b91c-edf9-4af0-94d3-d9936a6bb588 req-c5616202-d738-4ecb-ab93-693b8a117c39 service nova] Creating event network-changed:733ba1a0-53ee-407f-9f93-1e7c55637523 for instance f2ad1271-aaba-4fe4-8f6c-854cf8e80bb7 on n-h1-854823-8 Oct 04 20:33:42.030553 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-fac8b91c-edf9-4af0-94d3-d9936a6bb588 req-c5616202-d738-4ecb-ab93-693b8a117c39 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=128801) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 04 20:33:42.031090 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-fac8b91c-edf9-4af0-94d3-d9936a6bb588 req-c5616202-d738-4ecb-ab93-693b8a117c39 service nova] Acquired lock "compute-rpcapi-router" {{(pid=128801) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 04 20:33:42.032328 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5c0fd404-03a6-4010-93b1-1f2ed9e6a69a None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:42.035323 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5c0fd404-03a6-4010-93b1-1f2ed9e6a69a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:42.042872 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5c0fd404-03a6-4010-93b1-1f2ed9e6a69a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:42.044178 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5c0fd404-03a6-4010-93b1-1f2ed9e6a69a None None] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:42.045631 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5c0fd404-03a6-4010-93b1-1f2ed9e6a69a None None] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:42.046569 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5c0fd404-03a6-4010-93b1-1f2ed9e6a69a None None] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:42.059471 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.compute.rpcapi [None req-5c0fd404-03a6-4010-93b1-1f2ed9e6a69a None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 04 20:33:42.060968 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5c0fd404-03a6-4010-93b1-1f2ed9e6a69a None None] Releasing lock "compute-rpcapi-router" {{(pid=128801) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 04 20:33:42.086841 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5c0fd404-03a6-4010-93b1-1f2ed9e6a69a None None] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.329164 Oct 04 20:33:42.089574 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 40/109] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:33:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:33:42.188195 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-1ef3f5bd-4ad0-4453-ab35-da95399e9e74 tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:42.189517 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-1ef3f5bd-4ad0-4453-ab35-da95399e9e74 tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] [instance: f2ad1271-aaba-4fe4-8f6c-854cf8e80bb7] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:33:42.206084 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell0:SELECT=6 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:33:42.210083 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1ef3f5bd-4ad0-4453-ab35-da95399e9e74 tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:42.212353 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1ef3f5bd-4ad0-4453-ab35-da95399e9e74 tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:42.213627 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1ef3f5bd-4ad0-4453-ab35-da95399e9e74 tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:42.215149 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1ef3f5bd-4ad0-4453-ab35-da95399e9e74 tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:42.219730 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1ef3f5bd-4ad0-4453-ab35-da95399e9e74 tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:42.220390 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1ef3f5bd-4ad0-4453-ab35-da95399e9e74 tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:42.754088 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:33:42.951860 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-bcdea9a7-6b40-431f-b990-b8d9660b1378 tempest-FlavorsV255TestJSON-1409509300 tempest-FlavorsV255TestJSON-1409509300-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV255TestJSON-flavor-350746838", "id": 1090623141, "os-flavor-access:is_public": "True"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:33:43.076561 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-bcdea9a7-6b40-431f-b990-b8d9660b1378 tempest-FlavorsV255TestJSON-1409509300 tempest-FlavorsV255TestJSON-1409509300-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 448 microversion: 2.55 time: 0.444916 Oct 04 20:33:43.096033 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 41/110] 10.222.0.33 () {62 vars in 1188 bytes} [Tue Oct 4 20:33:42 2022] POST /compute/v2.1/flavors => generated 448 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 20:33:43.109506 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-1ef3f5bd-4ad0-4453-ab35-da95399e9e74 tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24987e1b118a41169a1974dc40568156', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930b67acdd8f4d4ea2acf80bb5b28059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:33:43.127322 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-1ef3f5bd-4ad0-4453-ab35-da95399e9e74 tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] 10.222.0.33 "GET /compute/v2.1/servers/f2ad1271-aaba-4fe4-8f6c-854cf8e80bb7" status: 200 len: 1339 microversion: 2.1 time: 0.941640 Oct 04 20:33:43.149694 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 70/111] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:33:42 2022] GET /compute/v2.1/servers/f2ad1271-aaba-4fe4-8f6c-854cf8e80bb7 => generated 1339 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:33:43.837953 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e214a9a0-4f19-40fd-8b9e-b624e2df5bca tempest-FlavorsV255TestJSON-1189041743 tempest-FlavorsV255TestJSON-1189041743-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:43.851111 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e214a9a0-4f19-40fd-8b9e-b624e2df5bca tempest-FlavorsV255TestJSON-1189041743 tempest-FlavorsV255TestJSON-1189041743-project] 10.222.0.33 "GET /compute/v2.1/flavors/1090623141" status: 200 len: 448 microversion: 2.55 time: 0.753579 Oct 04 20:33:43.875924 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-418f7b9e-f121-43a5-bd12-ea7b22d7dd18 tempest-FlavorsV255TestJSON-1409509300 tempest-FlavorsV255TestJSON-1409509300-project-admin] Action: 'update', calling method: .version_select at 0x7f3c764da670>, body: {"flavor": {"description": "new"}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:33:43.879919 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 42/112] 10.222.0.33 () {60 vars in 1199 bytes} [Tue Oct 4 20:33:43 2022] GET /compute/v2.1/flavors/1090623141 => generated 448 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 20:33:43.927890 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-418f7b9e-f121-43a5-bd12-ea7b22d7dd18 tempest-FlavorsV255TestJSON-1409509300 tempest-FlavorsV255TestJSON-1409509300-project-admin] 10.222.0.33 "PUT /compute/v2.1/flavors/1090623141" status: 200 len: 449 microversion: 2.55 time: 0.064489 Oct 04 20:33:43.938244 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 71/113] 10.222.0.33 () {62 vars in 1219 bytes} [Tue Oct 4 20:33:43 2022] PUT /compute/v2.1/flavors/1090623141 => generated 449 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 20:33:43.943076 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-52fb50c4-9809-4046-8a2d-08d4dfff5e87 tempest-FlavorsV255TestJSON-1189041743 tempest-FlavorsV255TestJSON-1189041743-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:44.030689 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-52fb50c4-9809-4046-8a2d-08d4dfff5e87 tempest-FlavorsV255TestJSON-1189041743 tempest-FlavorsV255TestJSON-1189041743-project] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 5724 microversion: 2.55 time: 0.091465 Oct 04 20:33:44.059099 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 43/114] 10.222.0.33 () {60 vars in 1187 bytes} [Tue Oct 4 20:33:43 2022] GET /compute/v2.1/flavors/detail => generated 5724 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:33:44.064531 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-77c461b0-8682-497d-8135-411d93f9aa3e tempest-FlavorsV255TestJSON-1189041743 tempest-FlavorsV255TestJSON-1189041743-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:44.140958 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-77c461b0-8682-497d-8135-411d93f9aa3e tempest-FlavorsV255TestJSON-1189041743 tempest-FlavorsV255TestJSON-1189041743-project] 10.222.0.33 "GET /compute/v2.1/flavors" status: 200 len: 3156 microversion: 2.55 time: 0.080772 Oct 04 20:33:44.144168 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 72/115] 10.222.0.33 () {60 vars in 1166 bytes} [Tue Oct 4 20:33:44 2022] GET /compute/v2.1/flavors => generated 3156 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:33:44.167924 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-249141a3-9238-4830-a7c5-03d3b8ca21ed tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:44.169908 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-e066585b-bc48-4d8a-bc44-22c504dcaa58 tempest-FlavorsV255TestJSON-1409509300 tempest-FlavorsV255TestJSON-1409509300-project-admin] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:44.173704 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-249141a3-9238-4830-a7c5-03d3b8ca21ed tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] [instance: f2ad1271-aaba-4fe4-8f6c-854cf8e80bb7] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:33:44.184595 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-249141a3-9238-4830-a7c5-03d3b8ca21ed tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:44.187818 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-249141a3-9238-4830-a7c5-03d3b8ca21ed tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:44.189296 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-249141a3-9238-4830-a7c5-03d3b8ca21ed tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:44.191329 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-249141a3-9238-4830-a7c5-03d3b8ca21ed tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:44.193519 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-249141a3-9238-4830-a7c5-03d3b8ca21ed tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:44.196183 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-249141a3-9238-4830-a7c5-03d3b8ca21ed tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:44.218059 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-e066585b-bc48-4d8a-bc44-22c504dcaa58 tempest-FlavorsV255TestJSON-1409509300 tempest-FlavorsV255TestJSON-1409509300-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/1090623141" status: 202 len: 0 microversion: 2.55 time: 0.054362 Oct 04 20:33:44.221546 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 73/116] 10.222.0.33 () {60 vars in 1202 bytes} [Tue Oct 4 20:33:44 2022] DELETE /compute/v2.1/flavors/1090623141 => generated 0 bytes in 61 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:33:44.234646 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-8abb667c-356b-40be-b1be-6a2729ef885c tempest-FlavorsV255TestJSON-1409509300 tempest-FlavorsV255TestJSON-1409509300-project-admin] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:44.314962 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-8abb667c-356b-40be-b1be-6a2729ef885c tempest-FlavorsV255TestJSON-1409509300 tempest-FlavorsV255TestJSON-1409509300-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 5285 microversion: 2.55 time: 0.088837 Oct 04 20:33:44.319055 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 74/117] 10.222.0.33 () {60 vars in 1187 bytes} [Tue Oct 4 20:33:44 2022] GET /compute/v2.1/flavors/detail => generated 5285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:33:45.199603 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-249141a3-9238-4830-a7c5-03d3b8ca21ed tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24987e1b118a41169a1974dc40568156', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930b67acdd8f4d4ea2acf80bb5b28059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:33:45.223282 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-249141a3-9238-4830-a7c5-03d3b8ca21ed tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] 10.222.0.33 "GET /compute/v2.1/servers/f2ad1271-aaba-4fe4-8f6c-854cf8e80bb7" status: 200 len: 1339 microversion: 2.1 time: 1.061766 Oct 04 20:33:45.224401 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 44/118] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:33:44 2022] GET /compute/v2.1/servers/f2ad1271-aaba-4fe4-8f6c-854cf8e80bb7 => generated 1339 bytes in 1064 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:33:45.263330 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-7922c12a-d78f-4be4-8f22-52a0b2420acb tempest-FlavorsExtraSpecsTestJSON-982590503 tempest-FlavorsExtraSpecsTestJSON-982590503-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-967633759", "ram": 512, "vcpus": 1, "disk": 10, "id": 766023046, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:33:45.302493 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-7922c12a-d78f-4be4-8f22-52a0b2420acb tempest-FlavorsExtraSpecsTestJSON-982590503 tempest-FlavorsExtraSpecsTestJSON-982590503-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 412 microversion: 2.1 time: 0.615175 Oct 04 20:33:45.304395 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 75/119] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 20:33:44 2022] POST /compute/v2.1/flavors => generated 412 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 20:33:45.326482 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-bae61a4a-af63-4e15-9e95-6610cb8ca165 tempest-FlavorsExtraSpecsTestJSON-982590503 tempest-FlavorsExtraSpecsTestJSON-982590503-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:33:45.394752 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-bae61a4a-af63-4e15-9e95-6610cb8ca165 tempest-FlavorsExtraSpecsTestJSON-982590503 tempest-FlavorsExtraSpecsTestJSON-982590503-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors/766023046/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.078485 Oct 04 20:33:45.402802 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 45/120] 10.222.0.33 () {60 vars in 1221 bytes} [Tue Oct 4 20:33:45 2022] POST /compute/v2.1/flavors/766023046/os-extra_specs => generated 66 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 20:33:45.669488 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-080f7f04-c8bf-4a30-920a-743645206fb2 tempest-FlavorsExtraSpecsTestJSON-43682649 tempest-FlavorsExtraSpecsTestJSON-43682649-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:45.684127 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-080f7f04-c8bf-4a30-920a-743645206fb2 tempest-FlavorsExtraSpecsTestJSON-43682649 tempest-FlavorsExtraSpecsTestJSON-43682649-project] 10.222.0.33 "GET /compute/v2.1/flavors/766023046/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.280105 Oct 04 20:33:45.694049 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 76/121] 10.222.0.33 () {58 vars in 1200 bytes} [Tue Oct 4 20:33:45 2022] GET /compute/v2.1/flavors/766023046/os-extra_specs => generated 66 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 04 20:33:45.708056 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b918059d-c0fe-485e-9992-4fe946aba97e tempest-FlavorsExtraSpecsTestJSON-982590503 tempest-FlavorsExtraSpecsTestJSON-982590503-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:33:45.791723 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b918059d-c0fe-485e-9992-4fe946aba97e tempest-FlavorsExtraSpecsTestJSON-982590503 tempest-FlavorsExtraSpecsTestJSON-982590503-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors/766023046/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.087689 Oct 04 20:33:45.799715 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 46/122] 10.222.0.33 () {60 vars in 1221 bytes} [Tue Oct 4 20:33:45 2022] POST /compute/v2.1/flavors/766023046/os-extra_specs => generated 66 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 20:33:45.805259 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-32014712-7a74-497c-938d-e155d5a2aef4 tempest-FlavorsExtraSpecsTestJSON-43682649 tempest-FlavorsExtraSpecsTestJSON-43682649-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:45.819589 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-32014712-7a74-497c-938d-e155d5a2aef4 tempest-FlavorsExtraSpecsTestJSON-43682649 tempest-FlavorsExtraSpecsTestJSON-43682649-project] 10.222.0.33 "GET /compute/v2.1/flavors/766023046/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.019263 Oct 04 20:33:45.831789 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 77/123] 10.222.0.33 () {58 vars in 1242 bytes} [Tue Oct 4 20:33:45 2022] GET /compute/v2.1/flavors/766023046/os-extra_specs/hw:numa_nodes => generated 22 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 20:33:45.842483 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-3404d4cc-14dd-4128-b390-2f8728410da8 tempest-FlavorsExtraSpecsTestJSON-982590503 tempest-FlavorsExtraSpecsTestJSON-982590503-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:33:45.901906 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:DELETE=8,nova_api:SELECT=73,nova_api:INSERT=7,nova_api:SAVEPOINT=6,nova_api:RELEASE=6 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:33:45.904142 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-3404d4cc-14dd-4128-b390-2f8728410da8 tempest-FlavorsExtraSpecsTestJSON-982590503 tempest-FlavorsExtraSpecsTestJSON-982590503-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors/766023046/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.066690 Oct 04 20:33:45.909908 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 47/124] 10.222.0.33 () {60 vars in 1221 bytes} [Tue Oct 4 20:33:45 2022] POST /compute/v2.1/flavors/766023046/os-extra_specs => generated 66 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 20:33:45.928192 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-f9d056a9-b815-4ed0-b417-2f802d798896 tempest-FlavorsExtraSpecsTestJSON-982590503 tempest-FlavorsExtraSpecsTestJSON-982590503-project-admin] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:45.943583 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_api:DELETE=18,nova_api:SELECT=75,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:33:45.963770 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-f9d056a9-b815-4ed0-b417-2f802d798896 tempest-FlavorsExtraSpecsTestJSON-982590503 tempest-FlavorsExtraSpecsTestJSON-982590503-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/766023046/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.043444 Oct 04 20:33:45.971887 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 78/125] 10.222.0.33 () {58 vars in 1200 bytes} [Tue Oct 4 20:33:45 2022] GET /compute/v2.1/flavors/766023046/os-extra_specs => generated 66 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 20:33:45.976566 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-75017a94-2922-4cef-af27-9a24e7b0698d tempest-FlavorsExtraSpecsTestJSON-982590503 tempest-FlavorsExtraSpecsTestJSON-982590503-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "2"} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:33:46.042032 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-75017a94-2922-4cef-af27-9a24e7b0698d tempest-FlavorsExtraSpecsTestJSON-982590503 tempest-FlavorsExtraSpecsTestJSON-982590503-project-admin] 10.222.0.33 "PUT /compute/v2.1/flavors/766023046/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.069259 Oct 04 20:33:46.043418 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 48/126] 10.222.0.33 () {60 vars in 1262 bytes} [Tue Oct 4 20:33:45 2022] PUT /compute/v2.1/flavors/766023046/os-extra_specs/hw:numa_nodes => generated 22 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 04 20:33:46.054251 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-3ac7d91c-8997-4ae5-9613-7fbdd37cd5a5 tempest-FlavorsExtraSpecsTestJSON-982590503 tempest-FlavorsExtraSpecsTestJSON-982590503-project-admin] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:46.094305 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-3ac7d91c-8997-4ae5-9613-7fbdd37cd5a5 tempest-FlavorsExtraSpecsTestJSON-982590503 tempest-FlavorsExtraSpecsTestJSON-982590503-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/766023046/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.042020 Oct 04 20:33:46.099829 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 79/127] 10.222.0.33 () {58 vars in 1200 bytes} [Tue Oct 4 20:33:46 2022] GET /compute/v2.1/flavors/766023046/os-extra_specs => generated 66 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 20:33:46.108659 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5814e18e-3785-4993-a688-c85d8080eb88 tempest-FlavorsExtraSpecsTestJSON-982590503 tempest-FlavorsExtraSpecsTestJSON-982590503-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:46.205062 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5814e18e-3785-4993-a688-c85d8080eb88 tempest-FlavorsExtraSpecsTestJSON-982590503 tempest-FlavorsExtraSpecsTestJSON-982590503-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/766023046/os-extra_specs/hw:numa_nodes" status: 200 len: 0 microversion: 2.1 time: 0.104048 Oct 04 20:33:46.206649 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 49/128] 10.222.0.33 () {58 vars in 1245 bytes} [Tue Oct 4 20:33:46 2022] DELETE /compute/v2.1/flavors/766023046/os-extra_specs/hw:numa_nodes => generated 0 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 04 20:33:46.220056 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-9e6956fd-e843-446d-91e5-636667595749 tempest-FlavorsExtraSpecsTestJSON-982590503 tempest-FlavorsExtraSpecsTestJSON-982590503-project-admin] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:46.255078 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-82db597e-2e2c-4243-896a-e98ce547586b tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:46.256289 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-82db597e-2e2c-4243-896a-e98ce547586b tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] [instance: f2ad1271-aaba-4fe4-8f6c-854cf8e80bb7] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:33:46.271279 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-9e6956fd-e843-446d-91e5-636667595749 tempest-FlavorsExtraSpecsTestJSON-982590503 tempest-FlavorsExtraSpecsTestJSON-982590503-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/766023046/os-extra_specs/hw:cpu_policy" status: 200 len: 0 microversion: 2.1 time: 0.058441 Oct 04 20:33:46.275265 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-82db597e-2e2c-4243-896a-e98ce547586b tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:46.277399 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-82db597e-2e2c-4243-896a-e98ce547586b tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:46.278001 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 80/129] 10.222.0.33 () {58 vars in 1245 bytes} [Tue Oct 4 20:33:46 2022] DELETE /compute/v2.1/flavors/766023046/os-extra_specs/hw:cpu_policy => generated 0 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 04 20:33:46.278711 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-82db597e-2e2c-4243-896a-e98ce547586b tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:46.280958 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-82db597e-2e2c-4243-896a-e98ce547586b tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:46.281589 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-82db597e-2e2c-4243-896a-e98ce547586b tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:46.282737 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-82db597e-2e2c-4243-896a-e98ce547586b tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:46.290461 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-58d25893-103a-4f03-b2d4-3ab96a2cb4ed tempest-FlavorsExtraSpecsTestJSON-982590503 tempest-FlavorsExtraSpecsTestJSON-982590503-project-admin] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:46.318566 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-58d25893-103a-4f03-b2d4-3ab96a2cb4ed tempest-FlavorsExtraSpecsTestJSON-982590503 tempest-FlavorsExtraSpecsTestJSON-982590503-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/766023046/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.035820 Oct 04 20:33:46.321182 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 81/130] 10.222.0.33 () {58 vars in 1200 bytes} [Tue Oct 4 20:33:46 2022] GET /compute/v2.1/flavors/766023046/os-extra_specs => generated 19 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 20:33:46.336190 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-678bc21c-7567-46f7-99b3-23debaca813a tempest-FlavorsExtraSpecsTestJSON-982590503 tempest-FlavorsExtraSpecsTestJSON-982590503-project-admin] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:46.394758 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-678bc21c-7567-46f7-99b3-23debaca813a tempest-FlavorsExtraSpecsTestJSON-982590503 tempest-FlavorsExtraSpecsTestJSON-982590503-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/766023046" status: 202 len: 0 microversion: 2.1 time: 0.065315 Oct 04 20:33:46.398577 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 82/131] 10.222.0.33 () {58 vars in 1158 bytes} [Tue Oct 4 20:33:46 2022] DELETE /compute/v2.1/flavors/766023046 => generated 0 bytes in 70 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:33:46.412202 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-03319ff2-9d20-4fd9-a4c7-28487815894b tempest-FlavorsExtraSpecsTestJSON-982590503 tempest-FlavorsExtraSpecsTestJSON-982590503-project-admin] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:46.461788 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-03319ff2-9d20-4fd9-a4c7-28487815894b tempest-FlavorsExtraSpecsTestJSON-982590503 tempest-FlavorsExtraSpecsTestJSON-982590503-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.057019 Oct 04 20:33:46.479710 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 83/132] 10.222.0.33 () {58 vars in 1146 bytes} [Tue Oct 4 20:33:46 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:33:46.958090 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-82db597e-2e2c-4243-896a-e98ce547586b tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24987e1b118a41169a1974dc40568156', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930b67acdd8f4d4ea2acf80bb5b28059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:33:46.989845 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-82db597e-2e2c-4243-896a-e98ce547586b tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] 10.222.0.33 "GET /compute/v2.1/servers/f2ad1271-aaba-4fe4-8f6c-854cf8e80bb7" status: 200 len: 1339 microversion: 2.1 time: 0.739375 Oct 04 20:33:46.991625 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 50/133] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:33:46 2022] GET /compute/v2.1/servers/f2ad1271-aaba-4fe4-8f6c-854cf8e80bb7 => generated 1339 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:33:48.023333 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-c3ff1e4c-4edc-4533-98b2-f54d9730c3f9 tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:48.024669 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-c3ff1e4c-4edc-4533-98b2-f54d9730c3f9 tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] [instance: f2ad1271-aaba-4fe4-8f6c-854cf8e80bb7] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:33:48.038918 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c3ff1e4c-4edc-4533-98b2-f54d9730c3f9 tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:48.042277 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c3ff1e4c-4edc-4533-98b2-f54d9730c3f9 tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:48.043366 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c3ff1e4c-4edc-4533-98b2-f54d9730c3f9 tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:48.044389 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c3ff1e4c-4edc-4533-98b2-f54d9730c3f9 tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:48.044895 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c3ff1e4c-4edc-4533-98b2-f54d9730c3f9 tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:48.045880 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c3ff1e4c-4edc-4533-98b2-f54d9730c3f9 tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:49.028636 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-c3ff1e4c-4edc-4533-98b2-f54d9730c3f9 tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24987e1b118a41169a1974dc40568156', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930b67acdd8f4d4ea2acf80bb5b28059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:33:49.076895 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-c3ff1e4c-4edc-4533-98b2-f54d9730c3f9 tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] 10.222.0.33 "GET /compute/v2.1/servers/f2ad1271-aaba-4fe4-8f6c-854cf8e80bb7" status: 200 len: 1339 microversion: 2.1 time: 1.059056 Oct 04 20:33:49.078418 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 84/134] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:33:48 2022] GET /compute/v2.1/servers/f2ad1271-aaba-4fe4-8f6c-854cf8e80bb7 => generated 1339 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:33:50.107143 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a0adfd15-bfc8-4322-84a2-edc46f0aab51 tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:50.107747 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a0adfd15-bfc8-4322-84a2-edc46f0aab51 tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] [instance: f2ad1271-aaba-4fe4-8f6c-854cf8e80bb7] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:33:50.114335 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a0adfd15-bfc8-4322-84a2-edc46f0aab51 tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:50.120469 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a0adfd15-bfc8-4322-84a2-edc46f0aab51 tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:50.122775 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a0adfd15-bfc8-4322-84a2-edc46f0aab51 tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:50.124943 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a0adfd15-bfc8-4322-84a2-edc46f0aab51 tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:50.127277 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a0adfd15-bfc8-4322-84a2-edc46f0aab51 tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:50.127960 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a0adfd15-bfc8-4322-84a2-edc46f0aab51 tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:50.503317 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-a0adfd15-bfc8-4322-84a2-edc46f0aab51 tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24987e1b118a41169a1974dc40568156', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930b67acdd8f4d4ea2acf80bb5b28059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:33:50.516167 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a0adfd15-bfc8-4322-84a2-edc46f0aab51 tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] 10.222.0.33 "GET /compute/v2.1/servers/f2ad1271-aaba-4fe4-8f6c-854cf8e80bb7" status: 200 len: 1339 microversion: 2.1 time: 0.411462 Oct 04 20:33:50.517085 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 51/135] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:33:50 2022] GET /compute/v2.1/servers/f2ad1271-aaba-4fe4-8f6c-854cf8e80bb7 => generated 1339 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:33:51.542126 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-c2c7f805-102d-4371-9da9-4d9f6e8a94e3 tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:51.542847 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-c2c7f805-102d-4371-9da9-4d9f6e8a94e3 tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] [instance: f2ad1271-aaba-4fe4-8f6c-854cf8e80bb7] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:33:51.555343 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c2c7f805-102d-4371-9da9-4d9f6e8a94e3 tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:51.555839 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c2c7f805-102d-4371-9da9-4d9f6e8a94e3 tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:51.556277 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c2c7f805-102d-4371-9da9-4d9f6e8a94e3 tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:51.557221 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c2c7f805-102d-4371-9da9-4d9f6e8a94e3 tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:51.562108 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c2c7f805-102d-4371-9da9-4d9f6e8a94e3 tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:51.562912 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c2c7f805-102d-4371-9da9-4d9f6e8a94e3 tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:51.840175 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-c2c7f805-102d-4371-9da9-4d9f6e8a94e3 tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24987e1b118a41169a1974dc40568156', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930b67acdd8f4d4ea2acf80bb5b28059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:33:51.852130 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-c2c7f805-102d-4371-9da9-4d9f6e8a94e3 tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] 10.222.0.33 "GET /compute/v2.1/servers/f2ad1271-aaba-4fe4-8f6c-854cf8e80bb7" status: 200 len: 1339 microversion: 2.1 time: 0.314660 Oct 04 20:33:51.857873 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 85/136] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:33:51 2022] GET /compute/v2.1/servers/f2ad1271-aaba-4fe4-8f6c-854cf8e80bb7 => generated 1339 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:33:52.059386 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:33:52.212669 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-57a6e8b8-38a5-452c-80a8-a3aaf62b1b1a tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:52.234361 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-57a6e8b8-38a5-452c-80a8-a3aaf62b1b1a tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] 10.222.0.33 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.445725 Oct 04 20:33:52.246882 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 52/137] 10.222.0.33 () {58 vars in 1137 bytes} [Tue Oct 4 20:33:51 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 20:33:52.781950 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-5c3d07c3-bfea-4648-ba5d-f8859fbd8a68 tempest-ServersWithSpecificFlavorTestJSON-1131962185 tempest-ServersWithSpecificFlavorTestJSON-1131962185-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_1-1709728029", "id": 560564508, "OS-FLV-EXT-DATA:ephemeral": 1, "os-flavor-access:is_public": "True"}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:33:52.832824 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-5c3d07c3-bfea-4648-ba5d-f8859fbd8a68 tempest-ServersWithSpecificFlavorTestJSON-1131962185 tempest-ServersWithSpecificFlavorTestJSON-1131962185-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 422 microversion: 2.1 time: 0.584103 Oct 04 20:33:52.835575 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 86/138] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 20:33:52 2022] POST /compute/v2.1/flavors => generated 422 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:33:52.851570 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5d25cf4f-954e-4c5e-92b7-32a0ccf49cd4 tempest-ServersWithSpecificFlavorTestJSON-1131962185 tempest-ServersWithSpecificFlavorTestJSON-1131962185-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:52.868840 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5d25cf4f-954e-4c5e-92b7-32a0ccf49cd4 tempest-ServersWithSpecificFlavorTestJSON-1131962185 tempest-ServersWithSpecificFlavorTestJSON-1131962185-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.026415 Oct 04 20:33:52.877291 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-a74d61c3-a23c-47f9-bc63-897ee1e31563 tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:52.878093 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-a74d61c3-a23c-47f9-bc63-897ee1e31563 tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] [instance: f2ad1271-aaba-4fe4-8f6c-854cf8e80bb7] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:33:52.887727 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 53/139] 10.222.0.33 () {58 vars in 1182 bytes} [Tue Oct 4 20:33:52 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 20:33:52.899453 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a74d61c3-a23c-47f9-bc63-897ee1e31563 tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:52.900229 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a74d61c3-a23c-47f9-bc63-897ee1e31563 tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:52.901410 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a74d61c3-a23c-47f9-bc63-897ee1e31563 tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:52.902618 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a74d61c3-a23c-47f9-bc63-897ee1e31563 tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:52.903537 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a74d61c3-a23c-47f9-bc63-897ee1e31563 tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:52.904190 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a74d61c3-a23c-47f9-bc63-897ee1e31563 tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:52.907456 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-848cb1a6-6892-44d5-9297-127cb696842a tempest-ServersWithSpecificFlavorTestJSON-1131962185 tempest-ServersWithSpecificFlavorTestJSON-1131962185-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_0-145816917", "id": 1464706422, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": "True"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:33:52.956164 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-848cb1a6-6892-44d5-9297-127cb696842a tempest-ServersWithSpecificFlavorTestJSON-1131962185 tempest-ServersWithSpecificFlavorTestJSON-1131962185-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 424 microversion: 2.1 time: 0.060202 Oct 04 20:33:52.958871 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 54/140] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 20:33:52 2022] POST /compute/v2.1/flavors => generated 424 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:33:53.077135 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-761252c3-c34d-4991-a76a-2e8075a0a965 tempest-FlavorsV261TestJSON-523758866 tempest-FlavorsV261TestJSON-523758866-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV261TestJSON-flavor-1107427818", "id": 1175025229, "os-flavor-access:is_public": "True"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:33:53.134208 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-761252c3-c34d-4991-a76a-2e8075a0a965 tempest-FlavorsV261TestJSON-523758866 tempest-FlavorsV261TestJSON-523758866-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 468 microversion: 2.61 time: 0.173317 Oct 04 20:33:53.135378 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 55/141] 10.222.0.33 () {62 vars in 1188 bytes} [Tue Oct 4 20:33:52 2022] POST /compute/v2.1/flavors => generated 468 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 20:33:53.157464 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c5e5f526-9bf1-4784-8f7c-ff890805655b tempest-ServersWithSpecificFlavorTestJSON-1131962185 tempest-ServersWithSpecificFlavorTestJSON-1131962185-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:53.173260 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c5e5f526-9bf1-4784-8f7c-ff890805655b tempest-ServersWithSpecificFlavorTestJSON-1131962185 tempest-ServersWithSpecificFlavorTestJSON-1131962185-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.026074 Oct 04 20:33:53.179236 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 56/142] 10.222.0.33 () {58 vars in 1182 bytes} [Tue Oct 4 20:33:53 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 20:33:53.258309 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-a74d61c3-a23c-47f9-bc63-897ee1e31563 tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24987e1b118a41169a1974dc40568156', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930b67acdd8f4d4ea2acf80bb5b28059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:33:53.271968 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-a74d61c3-a23c-47f9-bc63-897ee1e31563 tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] 10.222.0.33 "GET /compute/v2.1/servers/f2ad1271-aaba-4fe4-8f6c-854cf8e80bb7" status: 200 len: 1339 microversion: 2.1 time: 0.396527 Oct 04 20:33:53.284625 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 87/143] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:33:52 2022] GET /compute/v2.1/servers/f2ad1271-aaba-4fe4-8f6c-854cf8e80bb7 => generated 1339 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:33:53.299367 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-1675c3cd-4e28-46a2-93b0-75e260935551 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Action: 'create', calling method: .version_select at 0x7f3c75471e50>, body: {"keypair": {"name": "tempest-keypair-992469321", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMp7WPSSA8eRgVzntNVj9xrhsieNjHy8lpqq0i+Np7GHEX5N2KXOPOYIXLP8ecMrTJxJUff3XuGu50iPVO/qLLvi7tvU10mVQ2uFRHawhJoKE8GNMzYXTNbW4x0/uGIOiA=="}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:33:53.363754 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-1675c3cd-4e28-46a2-93b0-75e260935551 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Getting quotas for project 8f28e80977de42a892b84295ecf05141. Resources: {'key_pairs'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:33:53.376132 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-1675c3cd-4e28-46a2-93b0-75e260935551 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Getting quotas for user f5eda279f6034608b192839a54dda616 and project 8f28e80977de42a892b84295ecf05141. Resources: {'key_pairs'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:33:53.449968 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-1675c3cd-4e28-46a2-93b0-75e260935551 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.164019 Oct 04 20:33:53.451110 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 88/144] 10.222.0.33 () {60 vars in 1159 bytes} [Tue Oct 4 20:33:53 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:33:53.736962 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1bdeee04-5470-443c-a693-669fed9e7ac5 tempest-FlavorsV261TestJSON-1132063780 tempest-FlavorsV261TestJSON-1132063780-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:53.757329 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-1bdeee04-5470-443c-a693-669fed9e7ac5 tempest-FlavorsV261TestJSON-1132063780 tempest-FlavorsV261TestJSON-1132063780-project] 10.222.0.33 "GET /compute/v2.1/flavors/1175025229" status: 200 len: 468 microversion: 2.61 time: 0.575427 Oct 04 20:33:53.773454 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 57/145] 10.222.0.33 () {60 vars in 1199 bytes} [Tue Oct 4 20:33:53 2022] GET /compute/v2.1/flavors/1175025229 => generated 468 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 20:33:53.784007 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-2a8034ff-973b-4c56-966b-0609027e3874 tempest-FlavorsV261TestJSON-523758866 tempest-FlavorsV261TestJSON-523758866-project-admin] Action: 'update', calling method: , body: {"flavor": {"description": "new"}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:33:53.886763 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-2a8034ff-973b-4c56-966b-0609027e3874 tempest-FlavorsV261TestJSON-523758866 tempest-FlavorsV261TestJSON-523758866-project-admin] 10.222.0.33 "PUT /compute/v2.1/flavors/1175025229" status: 200 len: 469 microversion: 2.61 time: 0.111246 Oct 04 20:33:53.888301 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 89/146] 10.222.0.33 () {62 vars in 1219 bytes} [Tue Oct 4 20:33:53 2022] PUT /compute/v2.1/flavors/1175025229 => generated 469 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 04 20:33:53.923910 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5e9fe22f-d024-45ee-925a-f3a8121afb97 tempest-FlavorsV261TestJSON-1132063780 tempest-FlavorsV261TestJSON-1132063780-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:53.995305 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5e9fe22f-d024-45ee-925a-f3a8121afb97 tempest-FlavorsV261TestJSON-1132063780 tempest-FlavorsV261TestJSON-1132063780-project] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 7156 microversion: 2.61 time: 0.086908 Oct 04 20:33:53.997776 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 58/147] 10.222.0.33 () {60 vars in 1187 bytes} [Tue Oct 4 20:33:53 2022] GET /compute/v2.1/flavors/detail => generated 7156 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:33:54.024227 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-7926eb5d-9a9d-469d-91b8-bbac175b8e76 tempest-FlavorsV261TestJSON-1132063780 tempest-FlavorsV261TestJSON-1132063780-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:54.074620 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-7926eb5d-9a9d-469d-91b8-bbac175b8e76 tempest-FlavorsV261TestJSON-1132063780 tempest-FlavorsV261TestJSON-1132063780-project] 10.222.0.33 "GET /compute/v2.1/flavors" status: 200 len: 3683 microversion: 2.61 time: 0.056556 Oct 04 20:33:54.079930 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 90/148] 10.222.0.33 () {60 vars in 1166 bytes} [Tue Oct 4 20:33:54 2022] GET /compute/v2.1/flavors => generated 3683 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:33:54.098120 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7b86a06b-5c81-499e-ba28-99ba1fefde21 tempest-FlavorsV261TestJSON-523758866 tempest-FlavorsV261TestJSON-523758866-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:54.204729 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-7b86a06b-5c81-499e-ba28-99ba1fefde21 tempest-FlavorsV261TestJSON-523758866 tempest-FlavorsV261TestJSON-523758866-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/1175025229" status: 202 len: 0 microversion: 2.61 time: 0.102787 Oct 04 20:33:54.207880 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 59/149] 10.222.0.33 () {60 vars in 1202 bytes} [Tue Oct 4 20:33:54 2022] DELETE /compute/v2.1/flavors/1175025229 => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:33:54.221510 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-11e8edd7-4583-4575-bb83-2d4da0f57352 tempest-FlavorsV261TestJSON-523758866 tempest-FlavorsV261TestJSON-523758866-project-admin] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:54.285166 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-11e8edd7-4583-4575-bb83-2d4da0f57352 tempest-FlavorsV261TestJSON-523758866 tempest-FlavorsV261TestJSON-523758866-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 6697 microversion: 2.61 time: 0.072592 Oct 04 20:33:54.286171 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 91/150] 10.222.0.33 () {60 vars in 1187 bytes} [Tue Oct 4 20:33:54 2022] GET /compute/v2.1/flavors/detail => generated 6697 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:33:54.310604 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-875bb061-4e45-4b4a-b0dc-404736a23093 tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:54.311229 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-875bb061-4e45-4b4a-b0dc-404736a23093 tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] [instance: f2ad1271-aaba-4fe4-8f6c-854cf8e80bb7] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:33:54.326020 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-875bb061-4e45-4b4a-b0dc-404736a23093 tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:54.336775 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-875bb061-4e45-4b4a-b0dc-404736a23093 tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:54.337373 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-875bb061-4e45-4b4a-b0dc-404736a23093 tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:54.338200 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-875bb061-4e45-4b4a-b0dc-404736a23093 tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:54.340531 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-875bb061-4e45-4b4a-b0dc-404736a23093 tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:54.342963 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-875bb061-4e45-4b4a-b0dc-404736a23093 tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:54.720794 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-875bb061-4e45-4b4a-b0dc-404736a23093 tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24987e1b118a41169a1974dc40568156', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930b67acdd8f4d4ea2acf80bb5b28059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:33:54.732554 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-875bb061-4e45-4b4a-b0dc-404736a23093 tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] 10.222.0.33 "GET /compute/v2.1/servers/f2ad1271-aaba-4fe4-8f6c-854cf8e80bb7" status: 200 len: 1339 microversion: 2.1 time: 0.432355 Oct 04 20:33:54.752993 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 60/151] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:33:54 2022] GET /compute/v2.1/servers/f2ad1271-aaba-4fe4-8f6c-854cf8e80bb7 => generated 1339 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:33:55.481400 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-11e8edd7-4583-4575-bb83-2d4da0f57352 tempest-FlavorsV261TestJSON-523758866 tempest-FlavorsV261TestJSON-523758866-project-admin] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:55.487175 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-11e8edd7-4583-4575-bb83-2d4da0f57352 tempest-FlavorsV261TestJSON-523758866 tempest-FlavorsV261TestJSON-523758866-project-admin] 10.222.0.33 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001962 Oct 04 20:33:55.488701 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 92/152] 10.222.0.33 () {56 vars in 886 bytes} [Tue Oct 4 20:33:55 2022] GET /compute/ => generated 377 bytes in 8 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 04 20:33:55.769333 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7c252e6c-0977-44ec-a421-37916c66f358 tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:55.770218 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-7c252e6c-0977-44ec-a421-37916c66f358 tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] [instance: f2ad1271-aaba-4fe4-8f6c-854cf8e80bb7] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:33:55.789447 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7c252e6c-0977-44ec-a421-37916c66f358 tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:55.790141 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7c252e6c-0977-44ec-a421-37916c66f358 tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:55.793227 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7c252e6c-0977-44ec-a421-37916c66f358 tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:55.795697 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7c252e6c-0977-44ec-a421-37916c66f358 tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:55.797025 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7c252e6c-0977-44ec-a421-37916c66f358 tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:55.798757 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7c252e6c-0977-44ec-a421-37916c66f358 tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:56.246134 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-7c252e6c-0977-44ec-a421-37916c66f358 tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24987e1b118a41169a1974dc40568156', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930b67acdd8f4d4ea2acf80bb5b28059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:33:56.258006 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-7c252e6c-0977-44ec-a421-37916c66f358 tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] 10.222.0.33 "GET /compute/v2.1/servers/f2ad1271-aaba-4fe4-8f6c-854cf8e80bb7" status: 200 len: 1339 microversion: 2.1 time: 0.498324 Oct 04 20:33:56.258006 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 61/153] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:33:55 2022] GET /compute/v2.1/servers/f2ad1271-aaba-4fe4-8f6c-854cf8e80bb7 => generated 1339 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:33:56.477877 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-79bae654-7746-4736-a248-d6770f9066a4 tempest-InstanceUsageAuditLogTestJSON-973906225 tempest-InstanceUsageAuditLogTestJSON-973906225-project-admin] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:56.507080 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-79bae654-7746-4736-a248-d6770f9066a4 tempest-InstanceUsageAuditLogTestJSON-973906225 tempest-InstanceUsageAuditLogTestJSON-973906225-project-admin] 10.222.0.33 "GET /compute/v2.1/os-instance_usage_audit_log/2022-10-04 20:33:56" status: 200 len: 318 microversion: 2.1 time: 0.286451 Oct 04 20:33:56.508197 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 93/154] 10.222.0.33 () {58 vars in 1251 bytes} [Tue Oct 4 20:33:56 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-10-04%2020%3A33%3A56 => generated 318 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:33:56.508355 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0ce96c11-6c49-4b78-a0c6-e549c7fe6ed6 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-437723213", "imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63", "flavorRef": "1464706422", "adminPass": "***", "networks": [{"uuid": "106f4651-948b-4213-b058-26e9b0575dd1"}], "security_groups": [{"name": "tempest-securitygroup--688473469"}], "key_name": "tempest-keypair-992469321", "user_data": "}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:33:56.523954 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-34b31267-98c1-4655-8c8e-3c2058c6fea9 tempest-InstanceUsageAuditLogTestJSON-973906225 tempest-InstanceUsageAuditLogTestJSON-973906225-project-admin] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:56.543650 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-34b31267-98c1-4655-8c8e-3c2058c6fea9 tempest-InstanceUsageAuditLogTestJSON-973906225 tempest-InstanceUsageAuditLogTestJSON-973906225-project-admin] 10.222.0.33 "GET /compute/v2.1/os-instance_usage_audit_log" status: 200 len: 319 microversion: 2.1 time: 0.023046 Oct 04 20:33:56.544454 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 94/155] 10.222.0.33 () {58 vars in 1185 bytes} [Tue Oct 4 20:33:56 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 319 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:33:56.740031 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.network.neutron [None req-0ce96c11-6c49-4b78-a0c6-e549c7fe6ed6 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] validate_networks() for [('106f4651-948b-4213-b058-26e9b0575dd1', None, None, None, None, None)] {{(pid=128801) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:33:57.280707 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-fcb9ed90-920b-4c49-b578-2dffac34e9bf tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:57.281449 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-fcb9ed90-920b-4c49-b578-2dffac34e9bf tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] [instance: f2ad1271-aaba-4fe4-8f6c-854cf8e80bb7] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:33:57.293267 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fcb9ed90-920b-4c49-b578-2dffac34e9bf tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:57.294194 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fcb9ed90-920b-4c49-b578-2dffac34e9bf tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:57.295459 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fcb9ed90-920b-4c49-b578-2dffac34e9bf tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:57.297102 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fcb9ed90-920b-4c49-b578-2dffac34e9bf tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:57.299137 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fcb9ed90-920b-4c49-b578-2dffac34e9bf tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:57.300440 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fcb9ed90-920b-4c49-b578-2dffac34e9bf tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:57.305034 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=59 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:33:57.662739 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-fcb9ed90-920b-4c49-b578-2dffac34e9bf tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24987e1b118a41169a1974dc40568156', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930b67acdd8f4d4ea2acf80bb5b28059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:33:57.672848 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-fcb9ed90-920b-4c49-b578-2dffac34e9bf tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] 10.222.0.33 "GET /compute/v2.1/servers/f2ad1271-aaba-4fe4-8f6c-854cf8e80bb7" status: 200 len: 1339 microversion: 2.1 time: 0.397127 Oct 04 20:33:57.673433 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 95/156] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:33:57 2022] GET /compute/v2.1/servers/f2ad1271-aaba-4fe4-8f6c-854cf8e80bb7 => generated 1339 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:33:58.331675 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-0ce96c11-6c49-4b78-a0c6-e549c7fe6ed6 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Flavor limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:33:58.332189 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-0ce96c11-6c49-4b78-a0c6-e549c7fe6ed6 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Image limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:33:58.332590 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-0ce96c11-6c49-4b78-a0c6-e549c7fe6ed6 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Flavor pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:33:58.333323 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-0ce96c11-6c49-4b78-a0c6-e549c7fe6ed6 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Image pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:33:58.333912 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-0ce96c11-6c49-4b78-a0c6-e549c7fe6ed6 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:33:58.396488 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0ce96c11-6c49-4b78-a0c6-e549c7fe6ed6 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:58.397533 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0ce96c11-6c49-4b78-a0c6-e549c7fe6ed6 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:58.398191 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0ce96c11-6c49-4b78-a0c6-e549c7fe6ed6 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:58.399562 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0ce96c11-6c49-4b78-a0c6-e549c7fe6ed6 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:58.400224 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0ce96c11-6c49-4b78-a0c6-e549c7fe6ed6 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:58.400902 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0ce96c11-6c49-4b78-a0c6-e549c7fe6ed6 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:58.441382 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=53 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:33:58.486036 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-0ce96c11-6c49-4b78-a0c6-e549c7fe6ed6 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Getting quotas for project 8f28e80977de42a892b84295ecf05141. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:33:58.500261 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-0ce96c11-6c49-4b78-a0c6-e549c7fe6ed6 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Getting quotas for user f5eda279f6034608b192839a54dda616 and project 8f28e80977de42a892b84295ecf05141. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:33:58.527748 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-0ce96c11-6c49-4b78-a0c6-e549c7fe6ed6 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Going to run 1 instances... {{(pid=128801) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:33:58.531240 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-0ce96c11-6c49-4b78-a0c6-e549c7fe6ed6 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] [instance: 8fdcb1b0-65e9-45d1-b0da-5f603f22a8cf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='15b24725-0c99-4bcf-b1fb-907cdf8e2d63',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128801) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:33:58.707945 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-15c8c10f-d077-4466-a88b-fa44bcc96bfe tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:58.708725 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-15c8c10f-d077-4466-a88b-fa44bcc96bfe tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] [instance: f2ad1271-aaba-4fe4-8f6c-854cf8e80bb7] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:33:58.720061 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-0ce96c11-6c49-4b78-a0c6-e549c7fe6ed6 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.212140 Oct 04 20:33:58.722147 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-15c8c10f-d077-4466-a88b-fa44bcc96bfe tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:58.723610 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-15c8c10f-d077-4466-a88b-fa44bcc96bfe tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:58.725134 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-15c8c10f-d077-4466-a88b-fa44bcc96bfe tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:58.726556 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-15c8c10f-d077-4466-a88b-fa44bcc96bfe tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:33:58.729778 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-15c8c10f-d077-4466-a88b-fa44bcc96bfe tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:33:58.730062 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 62/157] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 20:33:56 2022] POST /compute/v2.1/servers => generated 401 bytes in 2227 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 20:33:58.731375 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-15c8c10f-d077-4466-a88b-fa44bcc96bfe tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:33:58.746725 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c5ed588c-a988-4404-a0df-3b50045fd459 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:58.753483 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c5ed588c-a988-4404-a0df-3b50045fd459 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] [instance: 8fdcb1b0-65e9-45d1-b0da-5f603f22a8cf] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:33:58.931217 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c5ed588c-a988-4404-a0df-3b50045fd459 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5eda279f6034608b192839a54dda616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f28e80977de42a892b84295ecf05141', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:33:58.944805 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c5ed588c-a988-4404-a0df-3b50045fd459 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] 10.222.0.33 "GET /compute/v2.1/servers/8fdcb1b0-65e9-45d1-b0da-5f603f22a8cf" status: 200 len: 1263 microversion: 2.1 time: 0.209510 Oct 04 20:33:58.947967 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 63/158] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:33:58 2022] GET /compute/v2.1/servers/8fdcb1b0-65e9-45d1-b0da-5f603f22a8cf => generated 1263 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:33:59.288032 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-15c8c10f-d077-4466-a88b-fa44bcc96bfe tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24987e1b118a41169a1974dc40568156', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930b67acdd8f4d4ea2acf80bb5b28059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:33:59.303386 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-15c8c10f-d077-4466-a88b-fa44bcc96bfe tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] 10.222.0.33 "GET /compute/v2.1/servers/f2ad1271-aaba-4fe4-8f6c-854cf8e80bb7" status: 200 len: 1339 microversion: 2.1 time: 0.609118 Oct 04 20:33:59.311084 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 96/159] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:33:58 2022] GET /compute/v2.1/servers/f2ad1271-aaba-4fe4-8f6c-854cf8e80bb7 => generated 1339 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:33:59.953013 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-52c0bcf1-cbd8-4cf6-8427-d08643322ad8 req-a14d7f81-7f15-47e6-83b0-56904da5fa41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2ad1271-aaba-4fe4-8f6c-854cf8e80bb7", "name": "network-vif-plugged", "status": "completed", "tag": "733ba1a0-53ee-407f-9f93-1e7c55637523"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:33:59.973855 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-3ed58275-ab45-4ca6-9d80-e2da58bd55b2 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:33:59.975608 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-3ed58275-ab45-4ca6-9d80-e2da58bd55b2 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] [instance: 8fdcb1b0-65e9-45d1-b0da-5f603f22a8cf] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:33:59.999906 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-52c0bcf1-cbd8-4cf6-8427-d08643322ad8 req-a14d7f81-7f15-47e6-83b0-56904da5fa41 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:00.000411 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-52c0bcf1-cbd8-4cf6-8427-d08643322ad8 req-a14d7f81-7f15-47e6-83b0-56904da5fa41 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:00.000848 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-52c0bcf1-cbd8-4cf6-8427-d08643322ad8 req-a14d7f81-7f15-47e6-83b0-56904da5fa41 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:00.029603 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-52c0bcf1-cbd8-4cf6-8427-d08643322ad8 req-a14d7f81-7f15-47e6-83b0-56904da5fa41 service nova] Creating event network-vif-plugged:733ba1a0-53ee-407f-9f93-1e7c55637523 for instance f2ad1271-aaba-4fe4-8f6c-854cf8e80bb7 on n-h1-854823-8 Oct 04 20:34:00.050935 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-52c0bcf1-cbd8-4cf6-8427-d08643322ad8 req-a14d7f81-7f15-47e6-83b0-56904da5fa41 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.792398 Oct 04 20:34:00.052126 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 64/160] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:33:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 20:34:00.189336 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-3ed58275-ab45-4ca6-9d80-e2da58bd55b2 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5eda279f6034608b192839a54dda616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f28e80977de42a892b84295ecf05141', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:00.205597 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-3ed58275-ab45-4ca6-9d80-e2da58bd55b2 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] 10.222.0.33 "GET /compute/v2.1/servers/8fdcb1b0-65e9-45d1-b0da-5f603f22a8cf" status: 200 len: 1263 microversion: 2.1 time: 0.236282 Oct 04 20:34:00.217019 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 97/161] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:33:59 2022] GET /compute/v2.1/servers/8fdcb1b0-65e9-45d1-b0da-5f603f22a8cf => generated 1263 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:34:00.332254 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-de93ff9a-fac4-4ca8-a51b-a5425e8e14c8 tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:00.332977 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-de93ff9a-fac4-4ca8-a51b-a5425e8e14c8 tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] [instance: f2ad1271-aaba-4fe4-8f6c-854cf8e80bb7] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:00.349004 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-de93ff9a-fac4-4ca8-a51b-a5425e8e14c8 tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:00.349857 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-de93ff9a-fac4-4ca8-a51b-a5425e8e14c8 tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:00.356489 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-de93ff9a-fac4-4ca8-a51b-a5425e8e14c8 tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:00.358144 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-de93ff9a-fac4-4ca8-a51b-a5425e8e14c8 tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:00.360194 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-de93ff9a-fac4-4ca8-a51b-a5425e8e14c8 tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:00.360290 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-de93ff9a-fac4-4ca8-a51b-a5425e8e14c8 tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:00.648225 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-de93ff9a-fac4-4ca8-a51b-a5425e8e14c8 tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24987e1b118a41169a1974dc40568156', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930b67acdd8f4d4ea2acf80bb5b28059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:00.662719 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-de93ff9a-fac4-4ca8-a51b-a5425e8e14c8 tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] 10.222.0.33 "GET /compute/v2.1/servers/f2ad1271-aaba-4fe4-8f6c-854cf8e80bb7" status: 200 len: 1339 microversion: 2.1 time: 0.336664 Oct 04 20:34:00.678371 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 65/162] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:00 2022] GET /compute/v2.1/servers/f2ad1271-aaba-4fe4-8f6c-854cf8e80bb7 => generated 1339 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:01.235550 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-3b1b3439-ba9b-4ec4-b84f-7f3d95704c6c tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:01.236780 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-3b1b3439-ba9b-4ec4-b84f-7f3d95704c6c tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] [instance: 8fdcb1b0-65e9-45d1-b0da-5f603f22a8cf] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:01.251360 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3b1b3439-ba9b-4ec4-b84f-7f3d95704c6c tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:01.251861 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3b1b3439-ba9b-4ec4-b84f-7f3d95704c6c tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:01.252475 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3b1b3439-ba9b-4ec4-b84f-7f3d95704c6c tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:01.255520 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3b1b3439-ba9b-4ec4-b84f-7f3d95704c6c tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:01.256097 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3b1b3439-ba9b-4ec4-b84f-7f3d95704c6c tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:01.256621 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3b1b3439-ba9b-4ec4-b84f-7f3d95704c6c tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:01.398864 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-3b1b3439-ba9b-4ec4-b84f-7f3d95704c6c tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5eda279f6034608b192839a54dda616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f28e80977de42a892b84295ecf05141', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:01.419230 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-3b1b3439-ba9b-4ec4-b84f-7f3d95704c6c tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] 10.222.0.33 "GET /compute/v2.1/servers/8fdcb1b0-65e9-45d1-b0da-5f603f22a8cf" status: 200 len: 1315 microversion: 2.1 time: 0.189190 Oct 04 20:34:01.434552 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 98/163] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:01 2022] GET /compute/v2.1/servers/8fdcb1b0-65e9-45d1-b0da-5f603f22a8cf => generated 1315 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:01.687021 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c3532e3a-6d6c-4364-9eff-9f4f46f08266 tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:01.687797 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c3532e3a-6d6c-4364-9eff-9f4f46f08266 tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] [instance: f2ad1271-aaba-4fe4-8f6c-854cf8e80bb7] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:01.720020 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c3532e3a-6d6c-4364-9eff-9f4f46f08266 tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:01.720844 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c3532e3a-6d6c-4364-9eff-9f4f46f08266 tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:01.731217 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c3532e3a-6d6c-4364-9eff-9f4f46f08266 tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:01.732310 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c3532e3a-6d6c-4364-9eff-9f4f46f08266 tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:01.737433 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c3532e3a-6d6c-4364-9eff-9f4f46f08266 tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:01.738892 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c3532e3a-6d6c-4364-9eff-9f4f46f08266 tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:02.290186 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c3532e3a-6d6c-4364-9eff-9f4f46f08266 tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24987e1b118a41169a1974dc40568156', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930b67acdd8f4d4ea2acf80bb5b28059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:02.322921 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c3532e3a-6d6c-4364-9eff-9f4f46f08266 tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] 10.222.0.33 "GET /compute/v2.1/servers/f2ad1271-aaba-4fe4-8f6c-854cf8e80bb7" status: 200 len: 1339 microversion: 2.1 time: 0.641188 Oct 04 20:34:02.323738 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 66/164] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:01 2022] GET /compute/v2.1/servers/f2ad1271-aaba-4fe4-8f6c-854cf8e80bb7 => generated 1339 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:02.445940 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-1ff6c28e-87b4-4bad-9c8c-319c5e46394f tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:02.446669 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-1ff6c28e-87b4-4bad-9c8c-319c5e46394f tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] [instance: 8fdcb1b0-65e9-45d1-b0da-5f603f22a8cf] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:02.458524 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1ff6c28e-87b4-4bad-9c8c-319c5e46394f tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:02.461129 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1ff6c28e-87b4-4bad-9c8c-319c5e46394f tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:02.461779 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1ff6c28e-87b4-4bad-9c8c-319c5e46394f tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:02.471030 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1ff6c28e-87b4-4bad-9c8c-319c5e46394f tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:02.471907 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1ff6c28e-87b4-4bad-9c8c-319c5e46394f tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:02.472738 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1ff6c28e-87b4-4bad-9c8c-319c5e46394f tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:03.154505 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-1ff6c28e-87b4-4bad-9c8c-319c5e46394f tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5eda279f6034608b192839a54dda616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f28e80977de42a892b84295ecf05141', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:03.195178 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-1ff6c28e-87b4-4bad-9c8c-319c5e46394f tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] 10.222.0.33 "GET /compute/v2.1/servers/8fdcb1b0-65e9-45d1-b0da-5f603f22a8cf" status: 200 len: 1321 microversion: 2.1 time: 0.747668 Oct 04 20:34:03.196796 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 99/165] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:02 2022] GET /compute/v2.1/servers/8fdcb1b0-65e9-45d1-b0da-5f603f22a8cf => generated 1321 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:03.357765 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-07eca45f-d956-48f0-a643-99f6994a6824 tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:03.358495 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-07eca45f-d956-48f0-a643-99f6994a6824 tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] [instance: f2ad1271-aaba-4fe4-8f6c-854cf8e80bb7] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:03.406722 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-07eca45f-d956-48f0-a643-99f6994a6824 tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:03.412749 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-07eca45f-d956-48f0-a643-99f6994a6824 tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:03.414279 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-07eca45f-d956-48f0-a643-99f6994a6824 tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:03.421075 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-07eca45f-d956-48f0-a643-99f6994a6824 tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:03.422709 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-07eca45f-d956-48f0-a643-99f6994a6824 tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:03.427875 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-07eca45f-d956-48f0-a643-99f6994a6824 tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:04.546750 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-4fc69c1f-b5cd-4424-b86b-50a5d3815f34 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1796161610", "imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63", "flavorRef": "452"}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:34:04.674244 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.network.neutron [None req-4fc69c1f-b5cd-4424-b86b-50a5d3815f34 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] validate_networks() for None {{(pid=128802) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:34:05.131949 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-07eca45f-d956-48f0-a643-99f6994a6824 tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24987e1b118a41169a1974dc40568156', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930b67acdd8f4d4ea2acf80bb5b28059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:05.155489 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-07eca45f-d956-48f0-a643-99f6994a6824 tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] 10.222.0.33 "GET /compute/v2.1/servers/f2ad1271-aaba-4fe4-8f6c-854cf8e80bb7" status: 200 len: 1488 microversion: 2.1 time: 1.809977 Oct 04 20:34:05.156429 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 67/166] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:03 2022] GET /compute/v2.1/servers/f2ad1271-aaba-4fe4-8f6c-854cf8e80bb7 => generated 1488 bytes in 1812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:05.184843 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2d94a74a-5e46-4c3e-af3a-e938f7bd493a tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:05.186006 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-2d94a74a-5e46-4c3e-af3a-e938f7bd493a tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] [instance: 8fdcb1b0-65e9-45d1-b0da-5f603f22a8cf] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:05.203053 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2d94a74a-5e46-4c3e-af3a-e938f7bd493a tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:05.203814 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2d94a74a-5e46-4c3e-af3a-e938f7bd493a tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:05.204577 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2d94a74a-5e46-4c3e-af3a-e938f7bd493a tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:05.206208 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2d94a74a-5e46-4c3e-af3a-e938f7bd493a tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:05.207041 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2d94a74a-5e46-4c3e-af3a-e938f7bd493a tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:05.207621 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2d94a74a-5e46-4c3e-af3a-e938f7bd493a tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:05.809003 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-2d94a74a-5e46-4c3e-af3a-e938f7bd493a tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5eda279f6034608b192839a54dda616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f28e80977de42a892b84295ecf05141', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:05.826055 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-2d94a74a-5e46-4c3e-af3a-e938f7bd493a tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] 10.222.0.33 "GET /compute/v2.1/servers/8fdcb1b0-65e9-45d1-b0da-5f603f22a8cf" status: 200 len: 1388 microversion: 2.1 time: 0.658159 Oct 04 20:34:05.828426 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 68/167] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:05 2022] GET /compute/v2.1/servers/8fdcb1b0-65e9-45d1-b0da-5f603f22a8cf => generated 1388 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:05.857015 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-4fc69c1f-b5cd-4424-b86b-50a5d3815f34 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Flavor limits 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:34:05.858263 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-4fc69c1f-b5cd-4424-b86b-50a5d3815f34 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Image limits 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:34:05.859820 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-4fc69c1f-b5cd-4424-b86b-50a5d3815f34 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Flavor pref 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:34:05.860435 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-4fc69c1f-b5cd-4424-b86b-50a5d3815f34 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Image pref 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:34:05.861147 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-4fc69c1f-b5cd-4424-b86b-50a5d3815f34 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:34:05.875829 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4fc69c1f-b5cd-4424-b86b-50a5d3815f34 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:05.876855 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4fc69c1f-b5cd-4424-b86b-50a5d3815f34 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:05.877458 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4fc69c1f-b5cd-4424-b86b-50a5d3815f34 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:05.878802 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4fc69c1f-b5cd-4424-b86b-50a5d3815f34 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:05.879442 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4fc69c1f-b5cd-4424-b86b-50a5d3815f34 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:05.881146 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4fc69c1f-b5cd-4424-b86b-50a5d3815f34 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:05.907203 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-4fc69c1f-b5cd-4424-b86b-50a5d3815f34 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Getting quotas for project dd3118a5d96843d3bede1ed94bd9717e. Resources: {'ram', 'instances', 'cores'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:34:05.913252 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-4fc69c1f-b5cd-4424-b86b-50a5d3815f34 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Getting quotas for user 3563efe2b8c94931a2a46c4e14811b3a and project dd3118a5d96843d3bede1ed94bd9717e. Resources: {'ram', 'instances', 'cores'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:34:05.935785 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-4fc69c1f-b5cd-4424-b86b-50a5d3815f34 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Going to run 1 instances... {{(pid=128802) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:34:05.939423 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-4fc69c1f-b5cd-4424-b86b-50a5d3815f34 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] [instance: 9e9f6289-9999-4188-9af1-6cf64a676eee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='15b24725-0c99-4bcf-b1fb-907cdf8e2d63',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128802) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:34:06.041097 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-4fc69c1f-b5cd-4424-b86b-50a5d3815f34 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.001140 Oct 04 20:34:06.042792 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 100/168] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 20:34:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 2004 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 20:34:06.048521 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-58151238-b2fe-4c0a-8465-d201e605efca tempest-AggregatesAdminTestJSON-1866202774 tempest-AggregatesAdminTestJSON-1866202774-project-admin] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:06.050318 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-58151238-b2fe-4c0a-8465-d201e605efca tempest-AggregatesAdminTestJSON-1866202774 tempest-AggregatesAdminTestJSON-1866202774-project-admin] [instance: f2ad1271-aaba-4fe4-8f6c-854cf8e80bb7] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:06.059576 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-58151238-b2fe-4c0a-8465-d201e605efca tempest-AggregatesAdminTestJSON-1866202774 tempest-AggregatesAdminTestJSON-1866202774-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:06.063140 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-58151238-b2fe-4c0a-8465-d201e605efca tempest-AggregatesAdminTestJSON-1866202774 tempest-AggregatesAdminTestJSON-1866202774-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:06.064684 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-58151238-b2fe-4c0a-8465-d201e605efca tempest-AggregatesAdminTestJSON-1866202774 tempest-AggregatesAdminTestJSON-1866202774-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:06.066677 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-58151238-b2fe-4c0a-8465-d201e605efca tempest-AggregatesAdminTestJSON-1866202774 tempest-AggregatesAdminTestJSON-1866202774-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:06.069002 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-58151238-b2fe-4c0a-8465-d201e605efca tempest-AggregatesAdminTestJSON-1866202774 tempest-AggregatesAdminTestJSON-1866202774-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:06.069852 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-58151238-b2fe-4c0a-8465-d201e605efca tempest-AggregatesAdminTestJSON-1866202774 tempest-AggregatesAdminTestJSON-1866202774-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:06.157970 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-aa555485-2a6d-4122-8387-ea12e2154ccb tempest-HypervisorAdminTestJSON-1321402737 tempest-HypervisorAdminTestJSON-1321402737-project-admin] Calling method '.version_select at 0x7f3c75279f70>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:06.171036 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-aa555485-2a6d-4122-8387-ea12e2154ccb tempest-HypervisorAdminTestJSON-1321402737 tempest-HypervisorAdminTestJSON-1321402737-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),189ff13b-7538-4a71-a71c-1e7f1d3e1b46(cell1) {{(pid=128801) load_cells /opt/stack/nova/nova/compute/api.py:319}} Oct 04 20:34:06.171788 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-aa555485-2a6d-4122-8387-ea12e2154ccb tempest-HypervisorAdminTestJSON-1321402737 tempest-HypervisorAdminTestJSON-1321402737-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:06.172266 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-aa555485-2a6d-4122-8387-ea12e2154ccb tempest-HypervisorAdminTestJSON-1321402737 tempest-HypervisorAdminTestJSON-1321402737-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:06.172695 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-aa555485-2a6d-4122-8387-ea12e2154ccb tempest-HypervisorAdminTestJSON-1321402737 tempest-HypervisorAdminTestJSON-1321402737-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:06.212767 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-aa555485-2a6d-4122-8387-ea12e2154ccb tempest-HypervisorAdminTestJSON-1321402737 tempest-HypervisorAdminTestJSON-1321402737-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:06.213658 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-aa555485-2a6d-4122-8387-ea12e2154ccb tempest-HypervisorAdminTestJSON-1321402737 tempest-HypervisorAdminTestJSON-1321402737-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:06.214925 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-aa555485-2a6d-4122-8387-ea12e2154ccb tempest-HypervisorAdminTestJSON-1321402737 tempest-HypervisorAdminTestJSON-1321402737-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:06.239116 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-aa555485-2a6d-4122-8387-ea12e2154ccb tempest-HypervisorAdminTestJSON-1321402737 tempest-HypervisorAdminTestJSON-1321402737-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:06.245021 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-aa555485-2a6d-4122-8387-ea12e2154ccb tempest-HypervisorAdminTestJSON-1321402737 tempest-HypervisorAdminTestJSON-1321402737-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:06.245701 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-aa555485-2a6d-4122-8387-ea12e2154ccb tempest-HypervisorAdminTestJSON-1321402737 tempest-HypervisorAdminTestJSON-1321402737-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:06.257861 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-aa555485-2a6d-4122-8387-ea12e2154ccb tempest-HypervisorAdminTestJSON-1321402737 tempest-HypervisorAdminTestJSON-1321402737-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.427302 Oct 04 20:34:06.261984 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 69/169] 10.222.0.33 () {58 vars in 1146 bytes} [Tue Oct 4 20:34:05 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:34:06.391710 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ff54c0d9-efeb-4479-b8a7-ae639f0250b7 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-200475530", "imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63", "flavorRef": "452"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:34:06.498840 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.network.neutron [None req-ff54c0d9-efeb-4479-b8a7-ae639f0250b7 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] validate_networks() for None {{(pid=128801) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:34:06.816346 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-58151238-b2fe-4c0a-8465-d201e605efca tempest-AggregatesAdminTestJSON-1866202774 tempest-AggregatesAdminTestJSON-1866202774-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/f2ad1271-aaba-4fe4-8f6c-854cf8e80bb7" status: 200 len: 1639 microversion: 2.1 time: 0.772020 Oct 04 20:34:06.830751 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 101/170] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:06 2022] GET /compute/v2.1/servers/f2ad1271-aaba-4fe4-8f6c-854cf8e80bb7 => generated 1639 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:06.840358 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-6fbd6fa4-8cc0-4b71-bc5e-f6060a9bf8fd tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:06.841316 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-6fbd6fa4-8cc0-4b71-bc5e-f6060a9bf8fd tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] [instance: 9e9f6289-9999-4188-9af1-6cf64a676eee] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:06.850367 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6fbd6fa4-8cc0-4b71-bc5e-f6060a9bf8fd tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:06.851117 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6fbd6fa4-8cc0-4b71-bc5e-f6060a9bf8fd tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:06.852223 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6fbd6fa4-8cc0-4b71-bc5e-f6060a9bf8fd tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:06.853837 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6fbd6fa4-8cc0-4b71-bc5e-f6060a9bf8fd tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:06.854790 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6fbd6fa4-8cc0-4b71-bc5e-f6060a9bf8fd tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:06.855545 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6fbd6fa4-8cc0-4b71-bc5e-f6060a9bf8fd tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:06.876863 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-ff54c0d9-efeb-4479-b8a7-ae639f0250b7 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Flavor limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:34:06.877365 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-ff54c0d9-efeb-4479-b8a7-ae639f0250b7 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Image limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:34:06.877908 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-ff54c0d9-efeb-4479-b8a7-ae639f0250b7 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Flavor pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:34:06.878417 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-ff54c0d9-efeb-4479-b8a7-ae639f0250b7 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Image pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:34:06.878909 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-ff54c0d9-efeb-4479-b8a7-ae639f0250b7 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:34:06.895171 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ff54c0d9-efeb-4479-b8a7-ae639f0250b7 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:06.895939 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ff54c0d9-efeb-4479-b8a7-ae639f0250b7 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:06.896371 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ff54c0d9-efeb-4479-b8a7-ae639f0250b7 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:06.897360 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ff54c0d9-efeb-4479-b8a7-ae639f0250b7 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:06.898147 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ff54c0d9-efeb-4479-b8a7-ae639f0250b7 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:06.898709 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ff54c0d9-efeb-4479-b8a7-ae639f0250b7 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:06.921847 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-ff54c0d9-efeb-4479-b8a7-ae639f0250b7 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Getting quotas for project b9928be759e34d208d835263d73a5ab5. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:34:06.926909 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=84,nova_api:SAVEPOINT=3,nova_api:RELEASE=3,nova_api:UPDATE=1,nova_api:DELETE=4,nova_api:INSERT=5 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:34:06.928775 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-ff54c0d9-efeb-4479-b8a7-ae639f0250b7 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Getting quotas for user 147d000a331f4a3ba47019fcbae40901 and project b9928be759e34d208d835263d73a5ab5. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:34:06.944677 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ff54c0d9-efeb-4479-b8a7-ae639f0250b7 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Going to run 1 instances... {{(pid=128801) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:34:06.948562 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ff54c0d9-efeb-4479-b8a7-ae639f0250b7 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] [instance: 854066a9-9adf-4932-b6a8-c7fe15d8b4da] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='15b24725-0c99-4bcf-b1fb-907cdf8e2d63',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128801) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:34:06.978143 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-6fbd6fa4-8cc0-4b71-bc5e-f6060a9bf8fd tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3563efe2b8c94931a2a46c4e14811b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3118a5d96843d3bede1ed94bd9717e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:06.993576 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-6fbd6fa4-8cc0-4b71-bc5e-f6060a9bf8fd tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] 10.222.0.33 "GET /compute/v2.1/servers/9e9f6289-9999-4188-9af1-6cf64a676eee" status: 200 len: 1239 microversion: 2.1 time: 0.161211 Oct 04 20:34:06.994231 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 102/171] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:06 2022] GET /compute/v2.1/servers/9e9f6289-9999-4188-9af1-6cf64a676eee => generated 1239 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:06.999412 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-e0b4960e-1602-4b92-88fe-4209d384a7d7 tempest-HypervisorAdminTestJSON-1321402737 tempest-HypervisorAdminTestJSON-1321402737-project-admin] Calling method '.version_select at 0x7f3c75414160>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:07.002486 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e0b4960e-1602-4b92-88fe-4209d384a7d7 tempest-HypervisorAdminTestJSON-1321402737 tempest-HypervisorAdminTestJSON-1321402737-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:07.003210 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e0b4960e-1602-4b92-88fe-4209d384a7d7 tempest-HypervisorAdminTestJSON-1321402737 tempest-HypervisorAdminTestJSON-1321402737-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:07.003830 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e0b4960e-1602-4b92-88fe-4209d384a7d7 tempest-HypervisorAdminTestJSON-1321402737 tempest-HypervisorAdminTestJSON-1321402737-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:07.019707 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e0b4960e-1602-4b92-88fe-4209d384a7d7 tempest-HypervisorAdminTestJSON-1321402737 tempest-HypervisorAdminTestJSON-1321402737-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:07.020292 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e0b4960e-1602-4b92-88fe-4209d384a7d7 tempest-HypervisorAdminTestJSON-1321402737 tempest-HypervisorAdminTestJSON-1321402737-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:07.020648 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e0b4960e-1602-4b92-88fe-4209d384a7d7 tempest-HypervisorAdminTestJSON-1321402737 tempest-HypervisorAdminTestJSON-1321402737-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:07.034188 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e0b4960e-1602-4b92-88fe-4209d384a7d7 tempest-HypervisorAdminTestJSON-1321402737 tempest-HypervisorAdminTestJSON-1321402737-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:07.034722 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e0b4960e-1602-4b92-88fe-4209d384a7d7 tempest-HypervisorAdminTestJSON-1321402737 tempest-HypervisorAdminTestJSON-1321402737-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:07.035388 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e0b4960e-1602-4b92-88fe-4209d384a7d7 tempest-HypervisorAdminTestJSON-1321402737 tempest-HypervisorAdminTestJSON-1321402737-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:07.043038 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-e0b4960e-1602-4b92-88fe-4209d384a7d7 tempest-HypervisorAdminTestJSON-1321402737 tempest-HypervisorAdminTestJSON-1321402737-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1505 microversion: 2.1 time: 0.047558 Oct 04 20:34:07.044057 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 103/172] 10.222.0.33 () {58 vars in 1167 bytes} [Tue Oct 4 20:34:06 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1505 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:07.062074 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-dcdc97d6-fbf4-4559-852e-d78304f1299e tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:07.074040 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ff54c0d9-efeb-4479-b8a7-ae639f0250b7 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.810780 Oct 04 20:34:07.075943 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 70/173] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 20:34:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 813 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 20:34:07.080054 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-dcdc97d6-fbf4-4559-852e-d78304f1299e tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] [instance: f2ad1271-aaba-4fe4-8f6c-854cf8e80bb7] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:07.089389 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8eeb6be7-7474-4356-b672-13967c417915 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:07.091746 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-8eeb6be7-7474-4356-b672-13967c417915 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] [instance: 8fdcb1b0-65e9-45d1-b0da-5f603f22a8cf] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:07.092901 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dcdc97d6-fbf4-4559-852e-d78304f1299e tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:07.093409 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dcdc97d6-fbf4-4559-852e-d78304f1299e tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:07.093883 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dcdc97d6-fbf4-4559-852e-d78304f1299e tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:07.094638 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dcdc97d6-fbf4-4559-852e-d78304f1299e tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:07.095103 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dcdc97d6-fbf4-4559-852e-d78304f1299e tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:07.098564 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dcdc97d6-fbf4-4559-852e-d78304f1299e tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:07.126559 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8eeb6be7-7474-4356-b672-13967c417915 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:07.130584 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8eeb6be7-7474-4356-b672-13967c417915 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:07.133664 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8eeb6be7-7474-4356-b672-13967c417915 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:07.136115 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8eeb6be7-7474-4356-b672-13967c417915 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:07.140782 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8eeb6be7-7474-4356-b672-13967c417915 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:07.141531 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8eeb6be7-7474-4356-b672-13967c417915 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:07.154507 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-dcdc97d6-fbf4-4559-852e-d78304f1299e tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] [instance: f2ad1271-aaba-4fe4-8f6c-854cf8e80bb7] Going to try to terminate instance {{(pid=128802) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:34:07.366536 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dcdc97d6-fbf4-4559-852e-d78304f1299e tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Acquiring lock "compute-rpcapi-router" {{(pid=128802) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 04 20:34:07.367423 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dcdc97d6-fbf4-4559-852e-d78304f1299e tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Acquired lock "compute-rpcapi-router" {{(pid=128802) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 04 20:34:07.370856 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1c2c6e06-5b87-4e37-9b0b-03732316e2b6 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:07.381351 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1c2c6e06-5b87-4e37-9b0b-03732316e2b6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:07.382757 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1c2c6e06-5b87-4e37-9b0b-03732316e2b6 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:07.388571 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1c2c6e06-5b87-4e37-9b0b-03732316e2b6 None None] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:07.389053 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1c2c6e06-5b87-4e37-9b0b-03732316e2b6 None None] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:07.389550 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1c2c6e06-5b87-4e37-9b0b-03732316e2b6 None None] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:07.406921 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.compute.rpcapi [None req-1c2c6e06-5b87-4e37-9b0b-03732316e2b6 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 04 20:34:07.407908 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1c2c6e06-5b87-4e37-9b0b-03732316e2b6 None None] Releasing lock "compute-rpcapi-router" {{(pid=128802) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 04 20:34:07.456208 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-1c2c6e06-5b87-4e37-9b0b-03732316e2b6 None None] 10.222.0.33 "DELETE /compute/v2.1/servers/f2ad1271-aaba-4fe4-8f6c-854cf8e80bb7" status: 204 len: 0 microversion: 2.1 time: 0.398875 Oct 04 20:34:07.459793 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 104/174] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 20:34:07 2022] DELETE /compute/v2.1/servers/f2ad1271-aaba-4fe4-8f6c-854cf8e80bb7 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:34:07.465480 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-bc8ba57a-ebda-4c99-b902-0500212a3213 tempest-HypervisorAdminTestJSON-1321402737 tempest-HypervisorAdminTestJSON-1321402737-project-admin] Calling method '.version_select at 0x7f3c75449940>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:07.467749 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bc8ba57a-ebda-4c99-b902-0500212a3213 tempest-HypervisorAdminTestJSON-1321402737 tempest-HypervisorAdminTestJSON-1321402737-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:07.468243 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bc8ba57a-ebda-4c99-b902-0500212a3213 tempest-HypervisorAdminTestJSON-1321402737 tempest-HypervisorAdminTestJSON-1321402737-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:07.468684 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bc8ba57a-ebda-4c99-b902-0500212a3213 tempest-HypervisorAdminTestJSON-1321402737 tempest-HypervisorAdminTestJSON-1321402737-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:07.486101 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bc8ba57a-ebda-4c99-b902-0500212a3213 tempest-HypervisorAdminTestJSON-1321402737 tempest-HypervisorAdminTestJSON-1321402737-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:07.487212 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bc8ba57a-ebda-4c99-b902-0500212a3213 tempest-HypervisorAdminTestJSON-1321402737 tempest-HypervisorAdminTestJSON-1321402737-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:07.487715 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bc8ba57a-ebda-4c99-b902-0500212a3213 tempest-HypervisorAdminTestJSON-1321402737 tempest-HypervisorAdminTestJSON-1321402737-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:07.513756 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_api:SELECT=89,nova_api:DELETE=4,nova_api:INSERT=5,nova_api:UPDATE=2 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:34:07.516958 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bc8ba57a-ebda-4c99-b902-0500212a3213 tempest-HypervisorAdminTestJSON-1321402737 tempest-HypervisorAdminTestJSON-1321402737-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:07.518819 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bc8ba57a-ebda-4c99-b902-0500212a3213 tempest-HypervisorAdminTestJSON-1321402737 tempest-HypervisorAdminTestJSON-1321402737-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:07.519304 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bc8ba57a-ebda-4c99-b902-0500212a3213 tempest-HypervisorAdminTestJSON-1321402737 tempest-HypervisorAdminTestJSON-1321402737-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:07.540034 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-bc8ba57a-ebda-4c99-b902-0500212a3213 tempest-HypervisorAdminTestJSON-1321402737 tempest-HypervisorAdminTestJSON-1321402737-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.081463 Oct 04 20:34:07.546694 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 105/175] 10.222.0.33 () {58 vars in 1146 bytes} [Tue Oct 4 20:34:07 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:34:07.549086 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-8eeb6be7-7474-4356-b672-13967c417915 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5eda279f6034608b192839a54dda616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f28e80977de42a892b84295ecf05141', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:07.553382 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-b538d85a-3033-4eff-ace4-4a8cb9d56580 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:07.554197 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-b538d85a-3033-4eff-ace4-4a8cb9d56580 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] [instance: 854066a9-9adf-4932-b6a8-c7fe15d8b4da] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:07.559442 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-8eeb6be7-7474-4356-b672-13967c417915 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] 10.222.0.33 "GET /compute/v2.1/servers/8fdcb1b0-65e9-45d1-b0da-5f603f22a8cf" status: 200 len: 1388 microversion: 2.1 time: 0.481683 Oct 04 20:34:07.560279 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 71/176] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:07 2022] GET /compute/v2.1/servers/8fdcb1b0-65e9-45d1-b0da-5f603f22a8cf => generated 1388 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:07.575458 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d5ccf6bc-08a9-4291-a988-ed184d8a91e0 tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:07.577678 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d5ccf6bc-08a9-4291-a988-ed184d8a91e0 tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] [instance: f2ad1271-aaba-4fe4-8f6c-854cf8e80bb7] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:07.594305 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d5ccf6bc-08a9-4291-a988-ed184d8a91e0 tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:07.597039 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d5ccf6bc-08a9-4291-a988-ed184d8a91e0 tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:07.597575 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d5ccf6bc-08a9-4291-a988-ed184d8a91e0 tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:07.598334 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d5ccf6bc-08a9-4291-a988-ed184d8a91e0 tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:07.598836 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d5ccf6bc-08a9-4291-a988-ed184d8a91e0 tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:07.601109 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d5ccf6bc-08a9-4291-a988-ed184d8a91e0 tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:07.769257 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-b538d85a-3033-4eff-ace4-4a8cb9d56580 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '147d000a331f4a3ba47019fcbae40901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9928be759e34d208d835263d73a5ab5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:07.779466 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-b538d85a-3033-4eff-ace4-4a8cb9d56580 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] 10.222.0.33 "GET /compute/v2.1/servers/854066a9-9adf-4932-b6a8-c7fe15d8b4da" status: 200 len: 1221 microversion: 2.1 time: 0.236104 Oct 04 20:34:07.782174 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 106/177] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:07 2022] GET /compute/v2.1/servers/854066a9-9adf-4932-b6a8-c7fe15d8b4da => generated 1221 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:07.787987 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-537766e6-bc31-41db-9471-71e83eba4f98 tempest-HypervisorAdminTestJSON-1321402737 tempest-HypervisorAdminTestJSON-1321402737-project-admin] Calling method '.version_select at 0x7f3c75414550>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:07.790325 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-537766e6-bc31-41db-9471-71e83eba4f98 tempest-HypervisorAdminTestJSON-1321402737 tempest-HypervisorAdminTestJSON-1321402737-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:07.791647 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-537766e6-bc31-41db-9471-71e83eba4f98 tempest-HypervisorAdminTestJSON-1321402737 tempest-HypervisorAdminTestJSON-1321402737-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:07.792341 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-537766e6-bc31-41db-9471-71e83eba4f98 tempest-HypervisorAdminTestJSON-1321402737 tempest-HypervisorAdminTestJSON-1321402737-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:07.825652 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-537766e6-bc31-41db-9471-71e83eba4f98 tempest-HypervisorAdminTestJSON-1321402737 tempest-HypervisorAdminTestJSON-1321402737-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:07.826301 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-537766e6-bc31-41db-9471-71e83eba4f98 tempest-HypervisorAdminTestJSON-1321402737 tempest-HypervisorAdminTestJSON-1321402737-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:07.827835 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-537766e6-bc31-41db-9471-71e83eba4f98 tempest-HypervisorAdminTestJSON-1321402737 tempest-HypervisorAdminTestJSON-1321402737-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:07.849409 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-537766e6-bc31-41db-9471-71e83eba4f98 tempest-HypervisorAdminTestJSON-1321402737 tempest-HypervisorAdminTestJSON-1321402737-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.065467 Oct 04 20:34:07.850184 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 107/178] 10.222.0.33 () {58 vars in 1152 bytes} [Tue Oct 4 20:34:07 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:34:07.868413 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-0b1e5f3b-b658-47ad-8e6d-6cdc47f892ec tempest-HypervisorAdminTestJSON-1321402737 tempest-HypervisorAdminTestJSON-1321402737-project-admin] Calling method '.version_select at 0x7f3c753d5b80>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:07.871330 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0b1e5f3b-b658-47ad-8e6d-6cdc47f892ec tempest-HypervisorAdminTestJSON-1321402737 tempest-HypervisorAdminTestJSON-1321402737-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:07.872104 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0b1e5f3b-b658-47ad-8e6d-6cdc47f892ec tempest-HypervisorAdminTestJSON-1321402737 tempest-HypervisorAdminTestJSON-1321402737-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:07.872906 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0b1e5f3b-b658-47ad-8e6d-6cdc47f892ec tempest-HypervisorAdminTestJSON-1321402737 tempest-HypervisorAdminTestJSON-1321402737-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:07.915374 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-0b1e5f3b-b658-47ad-8e6d-6cdc47f892ec tempest-HypervisorAdminTestJSON-1321402737 tempest-HypervisorAdminTestJSON-1321402737-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors/statistics" status: 200 len: 263 microversion: 2.1 time: 0.051245 Oct 04 20:34:07.919297 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 108/179] 10.222.0.33 () {58 vars in 1179 bytes} [Tue Oct 4 20:34:07 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 263 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:34:07.942897 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-e72c9697-7610-44d6-b395-32605d5f4c66 tempest-HypervisorAdminTestJSON-1321402737 tempest-HypervisorAdminTestJSON-1321402737-project-admin] Calling method '.version_select at 0x7f3c7552c1f0>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:07.945079 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e72c9697-7610-44d6-b395-32605d5f4c66 tempest-HypervisorAdminTestJSON-1321402737 tempest-HypervisorAdminTestJSON-1321402737-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:07.945755 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e72c9697-7610-44d6-b395-32605d5f4c66 tempest-HypervisorAdminTestJSON-1321402737 tempest-HypervisorAdminTestJSON-1321402737-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:07.946359 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e72c9697-7610-44d6-b395-32605d5f4c66 tempest-HypervisorAdminTestJSON-1321402737 tempest-HypervisorAdminTestJSON-1321402737-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:07.981759 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e72c9697-7610-44d6-b395-32605d5f4c66 tempest-HypervisorAdminTestJSON-1321402737 tempest-HypervisorAdminTestJSON-1321402737-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:07.982378 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e72c9697-7610-44d6-b395-32605d5f4c66 tempest-HypervisorAdminTestJSON-1321402737 tempest-HypervisorAdminTestJSON-1321402737-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:07.982907 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e72c9697-7610-44d6-b395-32605d5f4c66 tempest-HypervisorAdminTestJSON-1321402737 tempest-HypervisorAdminTestJSON-1321402737-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:08.008687 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e72c9697-7610-44d6-b395-32605d5f4c66 tempest-HypervisorAdminTestJSON-1321402737 tempest-HypervisorAdminTestJSON-1321402737-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:08.009301 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e72c9697-7610-44d6-b395-32605d5f4c66 tempest-HypervisorAdminTestJSON-1321402737 tempest-HypervisorAdminTestJSON-1321402737-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:08.010056 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e72c9697-7610-44d6-b395-32605d5f4c66 tempest-HypervisorAdminTestJSON-1321402737 tempest-HypervisorAdminTestJSON-1321402737-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:08.030255 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-e72c9697-7610-44d6-b395-32605d5f4c66 tempest-HypervisorAdminTestJSON-1321402737 tempest-HypervisorAdminTestJSON-1321402737-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.092752 Oct 04 20:34:08.030924 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 109/180] 10.222.0.33 () {58 vars in 1146 bytes} [Tue Oct 4 20:34:07 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 20:34:08.052911 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-693b7cce-54bd-47ba-84d8-701a6a43face tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:08.053881 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-693b7cce-54bd-47ba-84d8-701a6a43face tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] [instance: 9e9f6289-9999-4188-9af1-6cf64a676eee] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:08.063134 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-693b7cce-54bd-47ba-84d8-701a6a43face tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:08.063703 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-693b7cce-54bd-47ba-84d8-701a6a43face tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:08.064185 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-693b7cce-54bd-47ba-84d8-701a6a43face tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:08.065114 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-693b7cce-54bd-47ba-84d8-701a6a43face tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:08.065709 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-693b7cce-54bd-47ba-84d8-701a6a43face tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:08.066172 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-693b7cce-54bd-47ba-84d8-701a6a43face tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:08.154880 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d5ccf6bc-08a9-4291-a988-ed184d8a91e0 tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24987e1b118a41169a1974dc40568156', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930b67acdd8f4d4ea2acf80bb5b28059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:08.162867 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d5ccf6bc-08a9-4291-a988-ed184d8a91e0 tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] 10.222.0.33 "GET /compute/v2.1/servers/f2ad1271-aaba-4fe4-8f6c-854cf8e80bb7" status: 200 len: 1494 microversion: 2.1 time: 0.599472 Oct 04 20:34:08.179061 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 72/181] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:07 2022] GET /compute/v2.1/servers/f2ad1271-aaba-4fe4-8f6c-854cf8e80bb7 => generated 1494 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:08.180738 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-693b7cce-54bd-47ba-84d8-701a6a43face tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3563efe2b8c94931a2a46c4e14811b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3118a5d96843d3bede1ed94bd9717e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:08.186496 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ba35729d-3d1f-4d24-8a50-5bdfe8dd9612 tempest-HypervisorAdminTestJSON-1321402737 tempest-HypervisorAdminTestJSON-1321402737-project-admin] Calling method '.version_select at 0x7f3c75169700>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:08.188481 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ba35729d-3d1f-4d24-8a50-5bdfe8dd9612 tempest-HypervisorAdminTestJSON-1321402737 tempest-HypervisorAdminTestJSON-1321402737-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:08.189197 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ba35729d-3d1f-4d24-8a50-5bdfe8dd9612 tempest-HypervisorAdminTestJSON-1321402737 tempest-HypervisorAdminTestJSON-1321402737-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:08.189841 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ba35729d-3d1f-4d24-8a50-5bdfe8dd9612 tempest-HypervisorAdminTestJSON-1321402737 tempest-HypervisorAdminTestJSON-1321402737-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:08.189970 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-693b7cce-54bd-47ba-84d8-701a6a43face tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] 10.222.0.33 "GET /compute/v2.1/servers/9e9f6289-9999-4188-9af1-6cf64a676eee" status: 200 len: 1295 microversion: 2.1 time: 0.151143 Oct 04 20:34:08.190724 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 110/182] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:08 2022] GET /compute/v2.1/servers/9e9f6289-9999-4188-9af1-6cf64a676eee => generated 1295 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:08.230734 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ba35729d-3d1f-4d24-8a50-5bdfe8dd9612 tempest-HypervisorAdminTestJSON-1321402737 tempest-HypervisorAdminTestJSON-1321402737-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:08.231233 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ba35729d-3d1f-4d24-8a50-5bdfe8dd9612 tempest-HypervisorAdminTestJSON-1321402737 tempest-HypervisorAdminTestJSON-1321402737-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:08.231673 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ba35729d-3d1f-4d24-8a50-5bdfe8dd9612 tempest-HypervisorAdminTestJSON-1321402737 tempest-HypervisorAdminTestJSON-1321402737-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:08.238112 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ba35729d-3d1f-4d24-8a50-5bdfe8dd9612 tempest-HypervisorAdminTestJSON-1321402737 tempest-HypervisorAdminTestJSON-1321402737-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.057724 Oct 04 20:34:08.238752 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 73/183] 10.222.0.33 () {58 vars in 1152 bytes} [Tue Oct 4 20:34:08 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:34:08.257581 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-80ba1429-7e22-42c4-ae17-2a6feefedfe4 tempest-HypervisorAdminTestJSON-1321402737 tempest-HypervisorAdminTestJSON-1321402737-project-admin] Calling method '.version_select at 0x7f3c7536de50>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:08.261350 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-80ba1429-7e22-42c4-ae17-2a6feefedfe4 tempest-HypervisorAdminTestJSON-1321402737 tempest-HypervisorAdminTestJSON-1321402737-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:08.262742 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-80ba1429-7e22-42c4-ae17-2a6feefedfe4 tempest-HypervisorAdminTestJSON-1321402737 tempest-HypervisorAdminTestJSON-1321402737-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:08.263176 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-80ba1429-7e22-42c4-ae17-2a6feefedfe4 tempest-HypervisorAdminTestJSON-1321402737 tempest-HypervisorAdminTestJSON-1321402737-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:08.279836 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-80ba1429-7e22-42c4-ae17-2a6feefedfe4 tempest-HypervisorAdminTestJSON-1321402737 tempest-HypervisorAdminTestJSON-1321402737-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:08.280400 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-80ba1429-7e22-42c4-ae17-2a6feefedfe4 tempest-HypervisorAdminTestJSON-1321402737 tempest-HypervisorAdminTestJSON-1321402737-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:08.280994 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-80ba1429-7e22-42c4-ae17-2a6feefedfe4 tempest-HypervisorAdminTestJSON-1321402737 tempest-HypervisorAdminTestJSON-1321402737-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:08.288317 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-80ba1429-7e22-42c4-ae17-2a6feefedfe4 tempest-HypervisorAdminTestJSON-1321402737 tempest-HypervisorAdminTestJSON-1321402737-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors/2" status: 200 len: 758 microversion: 2.1 time: 0.036646 Oct 04 20:34:08.290643 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 111/184] 10.222.0.33 () {58 vars in 1152 bytes} [Tue Oct 4 20:34:08 2022] GET /compute/v2.1/os-hypervisors/2 => generated 758 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:34:08.304945 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1beec974-48f9-42c9-b837-2413c3169d4b tempest-HypervisorAdminTestJSON-1321402737 tempest-HypervisorAdminTestJSON-1321402737-project-admin] Calling method '.version_select at 0x7f3c75169f70>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:08.307853 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1beec974-48f9-42c9-b837-2413c3169d4b tempest-HypervisorAdminTestJSON-1321402737 tempest-HypervisorAdminTestJSON-1321402737-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:08.308679 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1beec974-48f9-42c9-b837-2413c3169d4b tempest-HypervisorAdminTestJSON-1321402737 tempest-HypervisorAdminTestJSON-1321402737-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:08.309415 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1beec974-48f9-42c9-b837-2413c3169d4b tempest-HypervisorAdminTestJSON-1321402737 tempest-HypervisorAdminTestJSON-1321402737-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:08.340181 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1beec974-48f9-42c9-b837-2413c3169d4b tempest-HypervisorAdminTestJSON-1321402737 tempest-HypervisorAdminTestJSON-1321402737-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:08.341108 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1beec974-48f9-42c9-b837-2413c3169d4b tempest-HypervisorAdminTestJSON-1321402737 tempest-HypervisorAdminTestJSON-1321402737-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:08.341748 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1beec974-48f9-42c9-b837-2413c3169d4b tempest-HypervisorAdminTestJSON-1321402737 tempest-HypervisorAdminTestJSON-1321402737-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:08.358878 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1beec974-48f9-42c9-b837-2413c3169d4b tempest-HypervisorAdminTestJSON-1321402737 tempest-HypervisorAdminTestJSON-1321402737-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:08.359737 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1beec974-48f9-42c9-b837-2413c3169d4b tempest-HypervisorAdminTestJSON-1321402737 tempest-HypervisorAdminTestJSON-1321402737-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:08.360444 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1beec974-48f9-42c9-b837-2413c3169d4b tempest-HypervisorAdminTestJSON-1321402737 tempest-HypervisorAdminTestJSON-1321402737-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:08.583691 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-19ee2288-c7bd-4dc5-b142-7bdc95edbf4e tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:08.584308 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-19ee2288-c7bd-4dc5-b142-7bdc95edbf4e tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] [instance: 8fdcb1b0-65e9-45d1-b0da-5f603f22a8cf] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:08.591132 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-19ee2288-c7bd-4dc5-b142-7bdc95edbf4e tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:08.591619 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-19ee2288-c7bd-4dc5-b142-7bdc95edbf4e tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:08.592052 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-19ee2288-c7bd-4dc5-b142-7bdc95edbf4e tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:08.592754 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-19ee2288-c7bd-4dc5-b142-7bdc95edbf4e tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:08.593210 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-19ee2288-c7bd-4dc5-b142-7bdc95edbf4e tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:08.593631 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-19ee2288-c7bd-4dc5-b142-7bdc95edbf4e tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:08.775717 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-1beec974-48f9-42c9-b837-2413c3169d4b tempest-HypervisorAdminTestJSON-1321402737 tempest-HypervisorAdminTestJSON-1321402737-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 200 len: 175 microversion: 2.1 time: 0.474123 Oct 04 20:34:08.785879 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 74/185] 10.222.0.33 () {58 vars in 1173 bytes} [Tue Oct 4 20:34:08 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 175 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:34:08.809574 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9aa343f2-09c4-45c1-a44a-931560572c07 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:08.811399 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-9aa343f2-09c4-45c1-a44a-931560572c07 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] [instance: 854066a9-9adf-4932-b6a8-c7fe15d8b4da] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:08.825677 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9aa343f2-09c4-45c1-a44a-931560572c07 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:08.826593 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9aa343f2-09c4-45c1-a44a-931560572c07 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:08.827235 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9aa343f2-09c4-45c1-a44a-931560572c07 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:08.828571 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9aa343f2-09c4-45c1-a44a-931560572c07 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:08.829830 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9aa343f2-09c4-45c1-a44a-931560572c07 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:08.830534 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9aa343f2-09c4-45c1-a44a-931560572c07 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:08.875397 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-19ee2288-c7bd-4dc5-b142-7bdc95edbf4e tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5eda279f6034608b192839a54dda616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f28e80977de42a892b84295ecf05141', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:08.891783 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-19ee2288-c7bd-4dc5-b142-7bdc95edbf4e tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] 10.222.0.33 "GET /compute/v2.1/servers/8fdcb1b0-65e9-45d1-b0da-5f603f22a8cf" status: 200 len: 1388 microversion: 2.1 time: 0.310280 Oct 04 20:34:08.892757 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 112/186] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:08 2022] GET /compute/v2.1/servers/8fdcb1b0-65e9-45d1-b0da-5f603f22a8cf => generated 1388 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:08.943375 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-9aa343f2-09c4-45c1-a44a-931560572c07 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '147d000a331f4a3ba47019fcbae40901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9928be759e34d208d835263d73a5ab5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:08.957067 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-9aa343f2-09c4-45c1-a44a-931560572c07 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] 10.222.0.33 "GET /compute/v2.1/servers/854066a9-9adf-4932-b6a8-c7fe15d8b4da" status: 200 len: 1273 microversion: 2.1 time: 0.153983 Oct 04 20:34:08.961145 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 75/187] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:08 2022] GET /compute/v2.1/servers/854066a9-9adf-4932-b6a8-c7fe15d8b4da => generated 1273 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:34:09.193053 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-7cc4d8d1-cb8b-4010-b077-acf3cd128c7c tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:09.194764 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-7cc4d8d1-cb8b-4010-b077-acf3cd128c7c tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] [instance: f2ad1271-aaba-4fe4-8f6c-854cf8e80bb7] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:09.207570 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7cc4d8d1-cb8b-4010-b077-acf3cd128c7c tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:09.208394 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7cc4d8d1-cb8b-4010-b077-acf3cd128c7c tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:09.209088 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7cc4d8d1-cb8b-4010-b077-acf3cd128c7c tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:09.217760 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0851ea84-2404-4509-9da6-e8f76e775083 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:09.219329 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-0851ea84-2404-4509-9da6-e8f76e775083 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] [instance: 9e9f6289-9999-4188-9af1-6cf64a676eee] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:09.225657 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7cc4d8d1-cb8b-4010-b077-acf3cd128c7c tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:09.227956 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7cc4d8d1-cb8b-4010-b077-acf3cd128c7c tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:09.230002 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7cc4d8d1-cb8b-4010-b077-acf3cd128c7c tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:09.232579 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0851ea84-2404-4509-9da6-e8f76e775083 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:09.233472 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0851ea84-2404-4509-9da6-e8f76e775083 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:09.236183 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0851ea84-2404-4509-9da6-e8f76e775083 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:09.238233 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0851ea84-2404-4509-9da6-e8f76e775083 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:09.239648 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0851ea84-2404-4509-9da6-e8f76e775083 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:09.240094 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0851ea84-2404-4509-9da6-e8f76e775083 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:09.393087 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-0851ea84-2404-4509-9da6-e8f76e775083 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3563efe2b8c94931a2a46c4e14811b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3118a5d96843d3bede1ed94bd9717e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:09.409304 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-0851ea84-2404-4509-9da6-e8f76e775083 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] 10.222.0.33 "GET /compute/v2.1/servers/9e9f6289-9999-4188-9af1-6cf64a676eee" status: 200 len: 1305 microversion: 2.1 time: 0.198350 Oct 04 20:34:09.410748 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 76/188] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:09 2022] GET /compute/v2.1/servers/9e9f6289-9999-4188-9af1-6cf64a676eee => generated 1305 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:34:09.924394 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a5794f7b-bc3c-438e-ba06-abf368095980 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:09.925028 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a5794f7b-bc3c-438e-ba06-abf368095980 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] [instance: 8fdcb1b0-65e9-45d1-b0da-5f603f22a8cf] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:09.945152 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a5794f7b-bc3c-438e-ba06-abf368095980 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:09.945659 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a5794f7b-bc3c-438e-ba06-abf368095980 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:09.951061 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a5794f7b-bc3c-438e-ba06-abf368095980 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:09.952085 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a5794f7b-bc3c-438e-ba06-abf368095980 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:09.952569 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a5794f7b-bc3c-438e-ba06-abf368095980 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:09.966119 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a5794f7b-bc3c-438e-ba06-abf368095980 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:10.599873 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-7cc4d8d1-cb8b-4010-b077-acf3cd128c7c tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24987e1b118a41169a1974dc40568156', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930b67acdd8f4d4ea2acf80bb5b28059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:10.602070 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:34:10.614160 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-7cc4d8d1-cb8b-4010-b077-acf3cd128c7c tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] 10.222.0.33 "GET /compute/v2.1/servers/f2ad1271-aaba-4fe4-8f6c-854cf8e80bb7" status: 200 len: 1494 microversion: 2.1 time: 1.425915 Oct 04 20:34:10.619288 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 113/189] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:09 2022] GET /compute/v2.1/servers/f2ad1271-aaba-4fe4-8f6c-854cf8e80bb7 => generated 1494 bytes in 1432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:10.638516 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-15c18391-db9b-4876-8341-e746997e9337 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:10.639124 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-15c18391-db9b-4876-8341-e746997e9337 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] [instance: 854066a9-9adf-4932-b6a8-c7fe15d8b4da] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:10.650404 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-15c18391-db9b-4876-8341-e746997e9337 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:10.651142 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-15c18391-db9b-4876-8341-e746997e9337 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:10.651727 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-15c18391-db9b-4876-8341-e746997e9337 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:10.652559 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-15c18391-db9b-4876-8341-e746997e9337 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:10.654502 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-15c18391-db9b-4876-8341-e746997e9337 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:10.655596 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-15c18391-db9b-4876-8341-e746997e9337 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:10.789950 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-a5794f7b-bc3c-438e-ba06-abf368095980 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5eda279f6034608b192839a54dda616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f28e80977de42a892b84295ecf05141', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:10.801541 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a5794f7b-bc3c-438e-ba06-abf368095980 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] 10.222.0.33 "GET /compute/v2.1/servers/8fdcb1b0-65e9-45d1-b0da-5f603f22a8cf" status: 200 len: 1388 microversion: 2.1 time: 0.886413 Oct 04 20:34:10.810871 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 77/190] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:09 2022] GET /compute/v2.1/servers/8fdcb1b0-65e9-45d1-b0da-5f603f22a8cf => generated 1388 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:10.903141 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-ba0311e1-1f6b-460a-9f8b-2b2f7d7af5a6 req-b3dd1afc-b719-4d11-8365-8e5086cc641c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8fdcb1b0-65e9-45d1-b0da-5f603f22a8cf", "tag": "b156b57a-987c-484d-9b1a-ed22e9a62872"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:34:10.914259 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-ba0311e1-1f6b-460a-9f8b-2b2f7d7af5a6 req-b3dd1afc-b719-4d11-8365-8e5086cc641c service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:10.914924 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-ba0311e1-1f6b-460a-9f8b-2b2f7d7af5a6 req-b3dd1afc-b719-4d11-8365-8e5086cc641c service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:10.915492 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-ba0311e1-1f6b-460a-9f8b-2b2f7d7af5a6 req-b3dd1afc-b719-4d11-8365-8e5086cc641c service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:10.947715 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-ba0311e1-1f6b-460a-9f8b-2b2f7d7af5a6 req-b3dd1afc-b719-4d11-8365-8e5086cc641c service nova] Creating event network-changed:b156b57a-987c-484d-9b1a-ed22e9a62872 for instance 8fdcb1b0-65e9-45d1-b0da-5f603f22a8cf on n-h2-854823-8 Oct 04 20:34:10.963539 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-ba0311e1-1f6b-460a-9f8b-2b2f7d7af5a6 req-b3dd1afc-b719-4d11-8365-8e5086cc641c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.139136 Oct 04 20:34:10.963539 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 78/191] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:34:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:34:10.993225 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-62694e90-c4f7-4ad8-a09f-321a4c8134dc tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:10.995446 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-62694e90-c4f7-4ad8-a09f-321a4c8134dc tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] [instance: 9e9f6289-9999-4188-9af1-6cf64a676eee] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:11.013946 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-62694e90-c4f7-4ad8-a09f-321a4c8134dc tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:11.014479 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-62694e90-c4f7-4ad8-a09f-321a4c8134dc tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:11.014912 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-62694e90-c4f7-4ad8-a09f-321a4c8134dc tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:11.015631 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-62694e90-c4f7-4ad8-a09f-321a4c8134dc tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:11.016099 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-62694e90-c4f7-4ad8-a09f-321a4c8134dc tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:11.031707 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-62694e90-c4f7-4ad8-a09f-321a4c8134dc tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:11.742272 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-15c18391-db9b-4876-8341-e746997e9337 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '147d000a331f4a3ba47019fcbae40901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9928be759e34d208d835263d73a5ab5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:11.773217 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-15c18391-db9b-4876-8341-e746997e9337 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] 10.222.0.33 "GET /compute/v2.1/servers/854066a9-9adf-4932-b6a8-c7fe15d8b4da" status: 200 len: 1279 microversion: 2.1 time: 1.149171 Oct 04 20:34:11.773928 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 114/192] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:10 2022] GET /compute/v2.1/servers/854066a9-9adf-4932-b6a8-c7fe15d8b4da => generated 1279 bytes in 1154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:11.785560 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-64080207-912f-4db0-afa1-a87b8bf271bd tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:11.786187 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-64080207-912f-4db0-afa1-a87b8bf271bd tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] [instance: f2ad1271-aaba-4fe4-8f6c-854cf8e80bb7] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:11.805603 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-64080207-912f-4db0-afa1-a87b8bf271bd tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:11.810535 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-64080207-912f-4db0-afa1-a87b8bf271bd tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:11.811006 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-64080207-912f-4db0-afa1-a87b8bf271bd tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:11.816206 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-64080207-912f-4db0-afa1-a87b8bf271bd tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:11.818551 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-64080207-912f-4db0-afa1-a87b8bf271bd tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:11.820512 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-64080207-912f-4db0-afa1-a87b8bf271bd tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:12.143243 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-62694e90-c4f7-4ad8-a09f-321a4c8134dc tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3563efe2b8c94931a2a46c4e14811b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3118a5d96843d3bede1ed94bd9717e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:12.153624 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-62694e90-c4f7-4ad8-a09f-321a4c8134dc tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] 10.222.0.33 "GET /compute/v2.1/servers/9e9f6289-9999-4188-9af1-6cf64a676eee" status: 200 len: 1335 microversion: 2.1 time: 1.196031 Oct 04 20:34:12.169448 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 79/193] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:10 2022] GET /compute/v2.1/servers/9e9f6289-9999-4188-9af1-6cf64a676eee => generated 1335 bytes in 1213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:12.181775 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9eb6c056-3b19-4165-a3cb-5e015f590ff3 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:12.184831 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-9eb6c056-3b19-4165-a3cb-5e015f590ff3 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] [instance: 8fdcb1b0-65e9-45d1-b0da-5f603f22a8cf] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:12.199043 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9eb6c056-3b19-4165-a3cb-5e015f590ff3 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:12.199557 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9eb6c056-3b19-4165-a3cb-5e015f590ff3 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:12.200291 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9eb6c056-3b19-4165-a3cb-5e015f590ff3 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:12.201030 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9eb6c056-3b19-4165-a3cb-5e015f590ff3 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:12.202034 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9eb6c056-3b19-4165-a3cb-5e015f590ff3 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:12.203013 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9eb6c056-3b19-4165-a3cb-5e015f590ff3 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:12.678481 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-64080207-912f-4db0-afa1-a87b8bf271bd tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24987e1b118a41169a1974dc40568156', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930b67acdd8f4d4ea2acf80bb5b28059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:12.697595 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-64080207-912f-4db0-afa1-a87b8bf271bd tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] 10.222.0.33 "GET /compute/v2.1/servers/f2ad1271-aaba-4fe4-8f6c-854cf8e80bb7" status: 200 len: 1494 microversion: 2.1 time: 0.919795 Oct 04 20:34:12.706841 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 115/194] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:11 2022] GET /compute/v2.1/servers/f2ad1271-aaba-4fe4-8f6c-854cf8e80bb7 => generated 1494 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:12.784855 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-9eb6c056-3b19-4165-a3cb-5e015f590ff3 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5eda279f6034608b192839a54dda616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f28e80977de42a892b84295ecf05141', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:12.793307 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-9eb6c056-3b19-4165-a3cb-5e015f590ff3 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] 10.222.0.33 "GET /compute/v2.1/servers/8fdcb1b0-65e9-45d1-b0da-5f603f22a8cf" status: 200 len: 1388 microversion: 2.1 time: 0.622524 Oct 04 20:34:12.801399 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-293f8ede-3c6c-47f8-aa73-51fec27912f4 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:12.802714 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-293f8ede-3c6c-47f8-aa73-51fec27912f4 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] [instance: 854066a9-9adf-4932-b6a8-c7fe15d8b4da] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:12.802929 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 80/195] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:12 2022] GET /compute/v2.1/servers/8fdcb1b0-65e9-45d1-b0da-5f603f22a8cf => generated 1388 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:12.820125 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-293f8ede-3c6c-47f8-aa73-51fec27912f4 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:12.820627 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-293f8ede-3c6c-47f8-aa73-51fec27912f4 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:12.821052 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-293f8ede-3c6c-47f8-aa73-51fec27912f4 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:12.822730 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-293f8ede-3c6c-47f8-aa73-51fec27912f4 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:12.823440 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-293f8ede-3c6c-47f8-aa73-51fec27912f4 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:12.824014 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-293f8ede-3c6c-47f8-aa73-51fec27912f4 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:12.997243 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-293f8ede-3c6c-47f8-aa73-51fec27912f4 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '147d000a331f4a3ba47019fcbae40901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9928be759e34d208d835263d73a5ab5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:13.020392 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-293f8ede-3c6c-47f8-aa73-51fec27912f4 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] 10.222.0.33 "GET /compute/v2.1/servers/854066a9-9adf-4932-b6a8-c7fe15d8b4da" status: 200 len: 1279 microversion: 2.1 time: 0.222218 Oct 04 20:34:13.021514 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 116/196] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:12 2022] GET /compute/v2.1/servers/854066a9-9adf-4932-b6a8-c7fe15d8b4da => generated 1279 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:13.180987 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ac1d6546-624b-44ea-b467-0234bce35aa8 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:13.182970 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ac1d6546-624b-44ea-b467-0234bce35aa8 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] [instance: 9e9f6289-9999-4188-9af1-6cf64a676eee] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:13.191247 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ac1d6546-624b-44ea-b467-0234bce35aa8 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:13.192082 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ac1d6546-624b-44ea-b467-0234bce35aa8 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:13.192875 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ac1d6546-624b-44ea-b467-0234bce35aa8 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:13.193732 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ac1d6546-624b-44ea-b467-0234bce35aa8 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:13.194328 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ac1d6546-624b-44ea-b467-0234bce35aa8 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:13.194915 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ac1d6546-624b-44ea-b467-0234bce35aa8 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:13.330109 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-24645ca8-8a69-4384-8a6e-51ee3735d683 req-d63a784e-81c4-4149-8614-aab85ac96127 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2ad1271-aaba-4fe4-8f6c-854cf8e80bb7", "name": "network-vif-deleted", "tag": "733ba1a0-53ee-407f-9f93-1e7c55637523"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:34:13.367822 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-24645ca8-8a69-4384-8a6e-51ee3735d683 req-d63a784e-81c4-4149-8614-aab85ac96127 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:13.372695 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-24645ca8-8a69-4384-8a6e-51ee3735d683 req-d63a784e-81c4-4149-8614-aab85ac96127 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:13.373321 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-24645ca8-8a69-4384-8a6e-51ee3735d683 req-d63a784e-81c4-4149-8614-aab85ac96127 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:13.434921 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-ac1d6546-624b-44ea-b467-0234bce35aa8 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3563efe2b8c94931a2a46c4e14811b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3118a5d96843d3bede1ed94bd9717e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:13.440672 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-24645ca8-8a69-4384-8a6e-51ee3735d683 req-d63a784e-81c4-4149-8614-aab85ac96127 service nova] Creating event network-vif-deleted:733ba1a0-53ee-407f-9f93-1e7c55637523 for instance f2ad1271-aaba-4fe4-8f6c-854cf8e80bb7 on n-h1-854823-8 Oct 04 20:34:13.445853 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ac1d6546-624b-44ea-b467-0234bce35aa8 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] 10.222.0.33 "GET /compute/v2.1/servers/9e9f6289-9999-4188-9af1-6cf64a676eee" status: 200 len: 1335 microversion: 2.1 time: 0.268953 Oct 04 20:34:13.447663 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 81/197] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:13 2022] GET /compute/v2.1/servers/9e9f6289-9999-4188-9af1-6cf64a676eee => generated 1335 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:13.460075 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-24645ca8-8a69-4384-8a6e-51ee3735d683 req-d63a784e-81c4-4149-8614-aab85ac96127 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.138629 Oct 04 20:34:13.466257 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 117/198] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:34:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 20:34:13.725584 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-860a5f71-e63a-4eb5-80d0-685c59746d29 tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:13.726672 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-860a5f71-e63a-4eb5-80d0-685c59746d29 tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] [instance: f2ad1271-aaba-4fe4-8f6c-854cf8e80bb7] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:13.738193 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-860a5f71-e63a-4eb5-80d0-685c59746d29 tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:13.738993 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-860a5f71-e63a-4eb5-80d0-685c59746d29 tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:13.739596 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-860a5f71-e63a-4eb5-80d0-685c59746d29 tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:13.741342 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-860a5f71-e63a-4eb5-80d0-685c59746d29 tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:13.742144 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-860a5f71-e63a-4eb5-80d0-685c59746d29 tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:13.742847 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-860a5f71-e63a-4eb5-80d0-685c59746d29 tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:13.777566 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-860a5f71-e63a-4eb5-80d0-685c59746d29 tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] HTTP exception thrown: Instance f2ad1271-aaba-4fe4-8f6c-854cf8e80bb7 could not be found. Oct 04 20:34:13.782608 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-860a5f71-e63a-4eb5-80d0-685c59746d29 tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Request method failure captured: Oct 04 20:34:13.782608 n-d-854823-8 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/f2ad1271-aaba-4fe4-8f6c-854cf8e80bb7 HTTP/1.1 Oct 04 20:34:13.782608 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:34:13.782608 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:34:13.782608 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:34:13.782608 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 0 Oct 04 20:34:13.782608 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:34:13.782608 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:34:13.782608 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:34:13.782608 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:34:13.782608 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJiTI8NBJwMHrgTAmlSfih33cdUd4OzyA-qww4slwI32MPD7j_fe4ns2owG7GR75U1C2uV81NzQvldg60AxfZ62zFHP4veM5kh2eaAyIHXAx-wIK1qnZ3Vn1VE6HF73mGNvILrNiVih26mSNYCQS6T_6JEDA_iPHvjak8QpWKSpU6As Oct 04 20:34:13.782608 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:34:13.782608 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:34:13.782608 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:34:13.782608 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:34:13.782608 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:34:13.782608 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:34:13.782608 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: 930b67acdd8f4d4ea2acf80bb5b28059 Oct 04 20:34:13.782608 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-AggregatesAdminTestJSON-527956270 Oct 04 20:34:13.782608 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 20:34:13.782608 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 20:34:13.784110 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_930b67acdd8f4d4ea2acf80bb5b28059", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/930b67acdd8f4d4ea2acf80bb5b28059"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/930b67acdd8f4d4ea2acf80bb5b28059"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/930b67acdd8f4d4ea2acf80bb5b28059"}]}] Oct 04 20:34:13.784110 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-AggregatesAdminTestJSON-527956270 Oct 04 20:34:13.784110 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: 930b67acdd8f4d4ea2acf80bb5b28059 Oct 04 20:34:13.784110 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-527956270 Oct 04 20:34:13.784110 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-AggregatesAdminTestJSON-527956270-project Oct 04 20:34:13.784110 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:34:13.784110 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:34:13.784110 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: 24987e1b118a41169a1974dc40568156 Oct 04 20:34:13.784110 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-AggregatesAdminTestJSON-527956270-project Oct 04 20:34:13.784110 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 20:34:13.784110 n-d-854823-8 devstack@n-api.service[128801]: exception: Instance f2ad1271-aaba-4fe4-8f6c-854cf8e80bb7 could not be found. Oct 04 20:34:13.784110 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': 'f2ad1271-aaba-4fe4-8f6c-854cf8e80bb7'} Oct 04 20:34:13.784932 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:34:13.784932 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:34:13.784932 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:34:13.784932 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:34:13.784932 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:34:13.784932 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:34:13.784932 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:34:13.784932 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:34:13.784932 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:34:13.784932 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:34:13.784932 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2ad1271-aaba-4fe4-8f6c-854cf8e80bb7 could not be found. Oct 04 20:34:13.784932 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:34:13.784932 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:34:13.784932 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:34:13.784932 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:34:13.784932 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:34:13.784932 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:34:13.784932 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:34:13.784932 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:34:13.784932 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:34:13.786223 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:34:13.786223 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:34:13.786223 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:34:13.786223 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:34:13.786223 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:34:13.786223 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:34:13.786223 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:34:13.786223 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2ad1271-aaba-4fe4-8f6c-854cf8e80bb7 could not be found. Oct 04 20:34:13.786223 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:34:13.786223 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:34:13.786223 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:34:13.786223 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:34:13.786223 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:34:13.786223 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:34:13.786223 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:34:13.786223 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:34:13.786223 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2ad1271-aaba-4fe4-8f6c-854cf8e80bb7 could not be found. Oct 04 20:34:13.786223 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:34:13.788161 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-860a5f71-e63a-4eb5-80d0-685c59746d29 tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Returning 404 to user: Instance f2ad1271-aaba-4fe4-8f6c-854cf8e80bb7 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:34:13.789403 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-860a5f71-e63a-4eb5-80d0-685c59746d29 tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] 10.222.0.33 "GET /compute/v2.1/servers/f2ad1271-aaba-4fe4-8f6c-854cf8e80bb7" status: 404 len: 111 microversion: 2.1 time: 0.071598 Oct 04 20:34:13.795521 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 82/199] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:13 2022] GET /compute/v2.1/servers/f2ad1271-aaba-4fe4-8f6c-854cf8e80bb7 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:34:13.800606 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-9c6da5ea-45b7-4b3a-8cd4-96d70be5b8d0 tempest-AggregatesAdminTestJSON-1866202774 tempest-AggregatesAdminTestJSON-1866202774-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-854823-8"}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:34:13.812210 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9c6da5ea-45b7-4b3a-8cd4-96d70be5b8d0 tempest-AggregatesAdminTestJSON-1866202774 tempest-AggregatesAdminTestJSON-1866202774-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:13.812862 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9c6da5ea-45b7-4b3a-8cd4-96d70be5b8d0 tempest-AggregatesAdminTestJSON-1866202774 tempest-AggregatesAdminTestJSON-1866202774-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:13.813292 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9c6da5ea-45b7-4b3a-8cd4-96d70be5b8d0 tempest-AggregatesAdminTestJSON-1866202774 tempest-AggregatesAdminTestJSON-1866202774-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:13.831916 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5eed1feb-8715-48ca-aaae-f3621694ea52 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:13.832552 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-5eed1feb-8715-48ca-aaae-f3621694ea52 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] [instance: 8fdcb1b0-65e9-45d1-b0da-5f603f22a8cf] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:13.838975 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5eed1feb-8715-48ca-aaae-f3621694ea52 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:13.839784 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5eed1feb-8715-48ca-aaae-f3621694ea52 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:13.840458 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5eed1feb-8715-48ca-aaae-f3621694ea52 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:13.841377 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5eed1feb-8715-48ca-aaae-f3621694ea52 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:13.842033 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5eed1feb-8715-48ca-aaae-f3621694ea52 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:13.842970 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5eed1feb-8715-48ca-aaae-f3621694ea52 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:13.865545 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=100 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:34:14.029273 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-5eed1feb-8715-48ca-aaae-f3621694ea52 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5eda279f6034608b192839a54dda616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f28e80977de42a892b84295ecf05141', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:14.040979 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5eed1feb-8715-48ca-aaae-f3621694ea52 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] 10.222.0.33 "GET /compute/v2.1/servers/8fdcb1b0-65e9-45d1-b0da-5f603f22a8cf" status: 200 len: 1388 microversion: 2.1 time: 0.212303 Oct 04 20:34:14.042546 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 83/200] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:13 2022] GET /compute/v2.1/servers/8fdcb1b0-65e9-45d1-b0da-5f603f22a8cf => generated 1388 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:34:14.058360 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-313c989b-034c-4c03-a459-af60480f7dd5 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:14.061694 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-313c989b-034c-4c03-a459-af60480f7dd5 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] [instance: 854066a9-9adf-4932-b6a8-c7fe15d8b4da] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:14.068479 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-313c989b-034c-4c03-a459-af60480f7dd5 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:14.068961 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-313c989b-034c-4c03-a459-af60480f7dd5 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:14.069452 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-313c989b-034c-4c03-a459-af60480f7dd5 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:14.070400 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-313c989b-034c-4c03-a459-af60480f7dd5 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:14.071028 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-313c989b-034c-4c03-a459-af60480f7dd5 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:14.071653 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-313c989b-034c-4c03-a459-af60480f7dd5 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:14.326235 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-9c6da5ea-45b7-4b3a-8cd4-96d70be5b8d0 tempest-AggregatesAdminTestJSON-1866202774 tempest-AggregatesAdminTestJSON-1866202774-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 299 microversion: 2.1 time: 0.529732 Oct 04 20:34:14.336367 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 118/201] 10.222.0.33 () {60 vars in 1191 bytes} [Tue Oct 4 20:34:13 2022] POST /compute/v2.1/os-aggregates/1/action => generated 299 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:34:14.352998 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-f966b909-4169-463a-a25b-3c0c2b2cfb26 tempest-AggregatesAdminTestJSON-1866202774 tempest-AggregatesAdminTestJSON-1866202774-project-admin] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:14.371455 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-313c989b-034c-4c03-a459-af60480f7dd5 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '147d000a331f4a3ba47019fcbae40901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9928be759e34d208d835263d73a5ab5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:14.381925 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-313c989b-034c-4c03-a459-af60480f7dd5 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] 10.222.0.33 "GET /compute/v2.1/servers/854066a9-9adf-4932-b6a8-c7fe15d8b4da" status: 200 len: 1321 microversion: 2.1 time: 0.337967 Oct 04 20:34:14.392188 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 84/202] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:14 2022] GET /compute/v2.1/servers/854066a9-9adf-4932-b6a8-c7fe15d8b4da => generated 1321 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:14.407582 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-f966b909-4169-463a-a25b-3c0c2b2cfb26 tempest-AggregatesAdminTestJSON-1866202774 tempest-AggregatesAdminTestJSON-1866202774-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-aggregates/1" status: 200 len: 0 microversion: 2.1 time: 0.068562 Oct 04 20:34:14.409326 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 119/203] 10.222.0.33 () {58 vars in 1152 bytes} [Tue Oct 4 20:34:14 2022] DELETE /compute/v2.1/os-aggregates/1 => generated 0 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 04 20:34:14.425560 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-35870d41-4bcc-4139-9b5d-e6f39ec49dde tempest-AggregatesAdminTestJSON-1866202774 tempest-AggregatesAdminTestJSON-1866202774-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-44721390"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:34:14.430117 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.objects.aggregate [None req-35870d41-4bcc-4139-9b5d-e6f39ec49dde tempest-AggregatesAdminTestJSON-1866202774 tempest-AggregatesAdminTestJSON-1866202774-project-admin] Generated uuid e6639cbc-277e-4839-a508-a1e5129ee418 for aggregate {{(pid=128801) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 20:34:14.459029 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-35870d41-4bcc-4139-9b5d-e6f39ec49dde tempest-AggregatesAdminTestJSON-1866202774 tempest-AggregatesAdminTestJSON-1866202774-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates" status: 200 len: 196 microversion: 2.1 time: 0.036990 Oct 04 20:34:14.460641 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 85/204] 10.222.0.33 () {60 vars in 1164 bytes} [Tue Oct 4 20:34:14 2022] POST /compute/v2.1/os-aggregates => generated 196 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:34:14.475613 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-0e7bb4a6-db0a-4799-afd3-5c114dd24a3f tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:14.476565 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-0e7bb4a6-db0a-4799-afd3-5c114dd24a3f tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] [instance: 9e9f6289-9999-4188-9af1-6cf64a676eee] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:14.485036 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d7ef389b-fbff-436b-9aa1-eee1f0563e2c tempest-AggregatesAdminTestJSON-1866202774 tempest-AggregatesAdminTestJSON-1866202774-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-854823-8"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:34:14.486199 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0e7bb4a6-db0a-4799-afd3-5c114dd24a3f tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:14.487664 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0e7bb4a6-db0a-4799-afd3-5c114dd24a3f tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:14.497744 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0e7bb4a6-db0a-4799-afd3-5c114dd24a3f tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:14.499118 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0e7bb4a6-db0a-4799-afd3-5c114dd24a3f tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:14.499837 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0e7bb4a6-db0a-4799-afd3-5c114dd24a3f tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:14.500888 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0e7bb4a6-db0a-4799-afd3-5c114dd24a3f tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:14.513553 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d7ef389b-fbff-436b-9aa1-eee1f0563e2c tempest-AggregatesAdminTestJSON-1866202774 tempest-AggregatesAdminTestJSON-1866202774-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:14.515823 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d7ef389b-fbff-436b-9aa1-eee1f0563e2c tempest-AggregatesAdminTestJSON-1866202774 tempest-AggregatesAdminTestJSON-1866202774-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:14.517250 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d7ef389b-fbff-436b-9aa1-eee1f0563e2c tempest-AggregatesAdminTestJSON-1866202774 tempest-AggregatesAdminTestJSON-1866202774-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:14.772530 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d7ef389b-fbff-436b-9aa1-eee1f0563e2c tempest-AggregatesAdminTestJSON-1866202774 tempest-AggregatesAdminTestJSON-1866202774-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 240 microversion: 2.1 time: 0.299130 Oct 04 20:34:14.773710 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 86/205] 10.222.0.33 () {60 vars in 1191 bytes} [Tue Oct 4 20:34:14 2022] POST /compute/v2.1/os-aggregates/2/action => generated 240 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:34:14.780154 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-ca695e7e-bd7d-456a-a49c-87dc07c0082f req-e681ff7f-3987-4beb-8d11-703956c5f571 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e9f6289-9999-4188-9af1-6cf64a676eee", "tag": "adebf0e2-e917-4865-9fef-2062cd63bdc7"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:34:14.795651 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-ca695e7e-bd7d-456a-a49c-87dc07c0082f req-e681ff7f-3987-4beb-8d11-703956c5f571 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:14.800938 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-ca695e7e-bd7d-456a-a49c-87dc07c0082f req-e681ff7f-3987-4beb-8d11-703956c5f571 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:14.801980 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-ca695e7e-bd7d-456a-a49c-87dc07c0082f req-e681ff7f-3987-4beb-8d11-703956c5f571 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:14.839756 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-ca695e7e-bd7d-456a-a49c-87dc07c0082f req-e681ff7f-3987-4beb-8d11-703956c5f571 service nova] Creating event network-changed:adebf0e2-e917-4865-9fef-2062cd63bdc7 for instance 9e9f6289-9999-4188-9af1-6cf64a676eee on n-h1-854823-8 Oct 04 20:34:14.845791 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-ca695e7e-bd7d-456a-a49c-87dc07c0082f req-e681ff7f-3987-4beb-8d11-703956c5f571 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070553 Oct 04 20:34:14.847162 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 87/206] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:34:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:34:14.853729 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0582273b-f588-45aa-b450-b10f6f208119 tempest-AggregatesAdminTestJSON-1866202774 tempest-AggregatesAdminTestJSON-1866202774-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:14.864263 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-0582273b-f588-45aa-b450-b10f6f208119 tempest-AggregatesAdminTestJSON-1866202774 tempest-AggregatesAdminTestJSON-1866202774-project-admin] 10.222.0.33 "GET /compute/v2.1/os-aggregates/2" status: 200 len: 240 microversion: 2.1 time: 0.016122 Oct 04 20:34:14.872837 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 88/207] 10.222.0.33 () {58 vars in 1149 bytes} [Tue Oct 4 20:34:14 2022] GET /compute/v2.1/os-aggregates/2 => generated 240 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:34:14.879594 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-20c0892e-9e86-49e3-a72b-43cb2e2d133c tempest-AggregatesAdminTestJSON-1866202774 tempest-AggregatesAdminTestJSON-1866202774-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-854823-8"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:34:14.898634 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-20c0892e-9e86-49e3-a72b-43cb2e2d133c tempest-AggregatesAdminTestJSON-1866202774 tempest-AggregatesAdminTestJSON-1866202774-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:14.899295 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-20c0892e-9e86-49e3-a72b-43cb2e2d133c tempest-AggregatesAdminTestJSON-1866202774 tempest-AggregatesAdminTestJSON-1866202774-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:14.900416 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-20c0892e-9e86-49e3-a72b-43cb2e2d133c tempest-AggregatesAdminTestJSON-1866202774 tempest-AggregatesAdminTestJSON-1866202774-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:15.047045 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-0e7bb4a6-db0a-4799-afd3-5c114dd24a3f tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3563efe2b8c94931a2a46c4e14811b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3118a5d96843d3bede1ed94bd9717e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:15.064069 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-0e7bb4a6-db0a-4799-afd3-5c114dd24a3f tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] 10.222.0.33 "GET /compute/v2.1/servers/9e9f6289-9999-4188-9af1-6cf64a676eee" status: 200 len: 1313 microversion: 2.1 time: 0.593120 Oct 04 20:34:15.079339 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 120/208] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:14 2022] GET /compute/v2.1/servers/9e9f6289-9999-4188-9af1-6cf64a676eee => generated 1313 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:15.082746 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-20c0892e-9e86-49e3-a72b-43cb2e2d133c tempest-AggregatesAdminTestJSON-1866202774 tempest-AggregatesAdminTestJSON-1866202774-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 225 microversion: 2.1 time: 0.208090 Oct 04 20:34:15.083984 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 89/209] 10.222.0.33 () {60 vars in 1191 bytes} [Tue Oct 4 20:34:14 2022] POST /compute/v2.1/os-aggregates/2/action => generated 225 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:34:15.090365 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-aea992f9-393d-4be0-9871-47f4db1b6565 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:15.091271 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-aea992f9-393d-4be0-9871-47f4db1b6565 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] [instance: 8fdcb1b0-65e9-45d1-b0da-5f603f22a8cf] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:15.097617 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-aea992f9-393d-4be0-9871-47f4db1b6565 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:15.098177 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-aea992f9-393d-4be0-9871-47f4db1b6565 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:15.099142 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-aea992f9-393d-4be0-9871-47f4db1b6565 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:15.100044 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-aea992f9-393d-4be0-9871-47f4db1b6565 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:15.100855 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-aea992f9-393d-4be0-9871-47f4db1b6565 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:15.102871 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-aea992f9-393d-4be0-9871-47f4db1b6565 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:15.104966 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-10b1a62a-4062-438a-bba1-3b5d7c01d20d tempest-AggregatesAdminTestJSON-1866202774 tempest-AggregatesAdminTestJSON-1866202774-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:15.171240 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-10b1a62a-4062-438a-bba1-3b5d7c01d20d tempest-AggregatesAdminTestJSON-1866202774 tempest-AggregatesAdminTestJSON-1866202774-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-aggregates/2" status: 200 len: 0 microversion: 2.1 time: 0.076968 Oct 04 20:34:15.172997 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 90/210] 10.222.0.33 () {58 vars in 1152 bytes} [Tue Oct 4 20:34:15 2022] DELETE /compute/v2.1/os-aggregates/2 => generated 0 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 04 20:34:15.194548 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-fe916192-7618-4782-b5ec-d5c90ab5f045 tempest-AggregatesAdminTestJSON-1866202774 tempest-AggregatesAdminTestJSON-1866202774-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1562216046"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:34:15.214845 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.objects.aggregate [None req-fe916192-7618-4782-b5ec-d5c90ab5f045 tempest-AggregatesAdminTestJSON-1866202774 tempest-AggregatesAdminTestJSON-1866202774-project-admin] Generated uuid 28f9b7bf-fef2-454f-8bca-b78bcb2354a3 for aggregate {{(pid=128801) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 20:34:15.278325 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-fe916192-7618-4782-b5ec-d5c90ab5f045 tempest-AggregatesAdminTestJSON-1866202774 tempest-AggregatesAdminTestJSON-1866202774-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.097705 Oct 04 20:34:15.279419 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 91/211] 10.222.0.33 () {60 vars in 1164 bytes} [Tue Oct 4 20:34:15 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:34:15.294897 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-3b66dbd0-f678-45d0-b0ee-0004cf277c41 tempest-AggregatesAdminTestJSON-1866202774 tempest-AggregatesAdminTestJSON-1866202774-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-854823-8"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:34:15.313578 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3b66dbd0-f678-45d0-b0ee-0004cf277c41 tempest-AggregatesAdminTestJSON-1866202774 tempest-AggregatesAdminTestJSON-1866202774-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:15.314231 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3b66dbd0-f678-45d0-b0ee-0004cf277c41 tempest-AggregatesAdminTestJSON-1866202774 tempest-AggregatesAdminTestJSON-1866202774-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:15.314829 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3b66dbd0-f678-45d0-b0ee-0004cf277c41 tempest-AggregatesAdminTestJSON-1866202774 tempest-AggregatesAdminTestJSON-1866202774-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:15.486466 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-3b66dbd0-f678-45d0-b0ee-0004cf277c41 tempest-AggregatesAdminTestJSON-1866202774 tempest-AggregatesAdminTestJSON-1866202774-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 242 microversion: 2.1 time: 0.197879 Oct 04 20:34:15.488106 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 92/212] 10.222.0.33 () {60 vars in 1191 bytes} [Tue Oct 4 20:34:15 2022] POST /compute/v2.1/os-aggregates/3/action => generated 242 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:34:15.499284 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ca8d2b2d-ea0e-4eb4-b08c-083a71686ebb tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:15.500388 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ca8d2b2d-ea0e-4eb4-b08c-083a71686ebb tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] [instance: 854066a9-9adf-4932-b6a8-c7fe15d8b4da] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:15.510947 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ca8d2b2d-ea0e-4eb4-b08c-083a71686ebb tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:15.511557 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ca8d2b2d-ea0e-4eb4-b08c-083a71686ebb tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:15.512102 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ca8d2b2d-ea0e-4eb4-b08c-083a71686ebb tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:15.513142 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ca8d2b2d-ea0e-4eb4-b08c-083a71686ebb tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:15.513694 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ca8d2b2d-ea0e-4eb4-b08c-083a71686ebb tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:15.514208 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ca8d2b2d-ea0e-4eb4-b08c-083a71686ebb tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:15.922136 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-aea992f9-393d-4be0-9871-47f4db1b6565 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5eda279f6034608b192839a54dda616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f28e80977de42a892b84295ecf05141', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:15.933975 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-aea992f9-393d-4be0-9871-47f4db1b6565 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] 10.222.0.33 "GET /compute/v2.1/servers/8fdcb1b0-65e9-45d1-b0da-5f603f22a8cf" status: 200 len: 1388 microversion: 2.1 time: 0.853292 Oct 04 20:34:15.940706 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 121/213] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:15 2022] GET /compute/v2.1/servers/8fdcb1b0-65e9-45d1-b0da-5f603f22a8cf => generated 1388 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:16.075088 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-ca8d2b2d-ea0e-4eb4-b08c-083a71686ebb tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '147d000a331f4a3ba47019fcbae40901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9928be759e34d208d835263d73a5ab5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:16.083851 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ca8d2b2d-ea0e-4eb4-b08c-083a71686ebb tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] 10.222.0.33 "GET /compute/v2.1/servers/854066a9-9adf-4932-b6a8-c7fe15d8b4da" status: 200 len: 1321 microversion: 2.1 time: 0.594694 Oct 04 20:34:16.093280 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 93/214] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:15 2022] GET /compute/v2.1/servers/854066a9-9adf-4932-b6a8-c7fe15d8b4da => generated 1321 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:16.104540 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-dc982ea0-9468-44a1-8566-642310734fde tempest-HypervisorAdminV228Test-827330780 tempest-HypervisorAdminV228Test-827330780-project-admin] Calling method '.version_select at 0x7f3c752e2790>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:16.106945 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dc982ea0-9468-44a1-8566-642310734fde tempest-HypervisorAdminV228Test-827330780 tempest-HypervisorAdminV228Test-827330780-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:16.107595 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dc982ea0-9468-44a1-8566-642310734fde tempest-HypervisorAdminV228Test-827330780 tempest-HypervisorAdminV228Test-827330780-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:16.108275 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dc982ea0-9468-44a1-8566-642310734fde tempest-HypervisorAdminV228Test-827330780 tempest-HypervisorAdminV228Test-827330780-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:16.113707 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a978099b-9efe-482b-b57a-bc6eaf2e2e64 tempest-AggregatesAdminTestJSON-1866202774 tempest-AggregatesAdminTestJSON-1866202774-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:16.127325 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a978099b-9efe-482b-b57a-bc6eaf2e2e64 tempest-AggregatesAdminTestJSON-1866202774 tempest-AggregatesAdminTestJSON-1866202774-project-admin] 10.222.0.33 "GET /compute/v2.1/os-aggregates" status: 200 len: 245 microversion: 2.1 time: 0.019119 Oct 04 20:34:16.127578 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dc982ea0-9468-44a1-8566-642310734fde tempest-HypervisorAdminV228Test-827330780 tempest-HypervisorAdminV228Test-827330780-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:16.128404 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dc982ea0-9468-44a1-8566-642310734fde tempest-HypervisorAdminV228Test-827330780 tempest-HypervisorAdminV228Test-827330780-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:16.136033 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 94/215] 10.222.0.33 () {58 vars in 1143 bytes} [Tue Oct 4 20:34:16 2022] GET /compute/v2.1/os-aggregates => generated 245 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:34:16.136433 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dc982ea0-9468-44a1-8566-642310734fde tempest-HypervisorAdminV228Test-827330780 tempest-HypervisorAdminV228Test-827330780-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:16.140501 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a542adb1-5fbe-4e33-98a9-cdb209621856 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:16.141491 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a542adb1-5fbe-4e33-98a9-cdb209621856 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] [instance: 9e9f6289-9999-4188-9af1-6cf64a676eee] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:16.149402 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a542adb1-5fbe-4e33-98a9-cdb209621856 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:16.150685 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a542adb1-5fbe-4e33-98a9-cdb209621856 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:16.151405 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dc982ea0-9468-44a1-8566-642310734fde tempest-HypervisorAdminV228Test-827330780 tempest-HypervisorAdminV228Test-827330780-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:16.151526 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a542adb1-5fbe-4e33-98a9-cdb209621856 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:16.152154 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dc982ea0-9468-44a1-8566-642310734fde tempest-HypervisorAdminV228Test-827330780 tempest-HypervisorAdminV228Test-827330780-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:16.152488 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a542adb1-5fbe-4e33-98a9-cdb209621856 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:16.152919 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dc982ea0-9468-44a1-8566-642310734fde tempest-HypervisorAdminV228Test-827330780 tempest-HypervisorAdminV228Test-827330780-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:16.153174 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a542adb1-5fbe-4e33-98a9-cdb209621856 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:16.153698 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a542adb1-5fbe-4e33-98a9-cdb209621856 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:16.160439 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-dc982ea0-9468-44a1-8566-642310734fde tempest-HypervisorAdminV228Test-827330780 tempest-HypervisorAdminV228Test-827330780-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.28 time: 0.218383 Oct 04 20:34:16.167716 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 122/216] 10.222.0.33 () {60 vars in 1187 bytes} [Tue Oct 4 20:34:15 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 20:34:16.172688 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-58e611cb-dcd9-4222-9af6-9578e18062ab tempest-AggregatesAdminTestJSON-1866202774 tempest-AggregatesAdminTestJSON-1866202774-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-854823-8"}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:34:16.184416 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-58e611cb-dcd9-4222-9af6-9578e18062ab tempest-AggregatesAdminTestJSON-1866202774 tempest-AggregatesAdminTestJSON-1866202774-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:16.185268 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-58e611cb-dcd9-4222-9af6-9578e18062ab tempest-AggregatesAdminTestJSON-1866202774 tempest-AggregatesAdminTestJSON-1866202774-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:16.185880 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-58e611cb-dcd9-4222-9af6-9578e18062ab tempest-AggregatesAdminTestJSON-1866202774 tempest-AggregatesAdminTestJSON-1866202774-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:16.325612 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-58e611cb-dcd9-4222-9af6-9578e18062ab tempest-AggregatesAdminTestJSON-1866202774 tempest-AggregatesAdminTestJSON-1866202774-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 227 microversion: 2.1 time: 0.156538 Oct 04 20:34:16.336711 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 123/217] 10.222.0.33 () {60 vars in 1191 bytes} [Tue Oct 4 20:34:16 2022] POST /compute/v2.1/os-aggregates/3/action => generated 227 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:34:16.343269 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-889b5187-7649-4cdc-869b-b8a2dbb89edc tempest-HypervisorAdminV228Test-827330780 tempest-HypervisorAdminV228Test-827330780-project-admin] Calling method '.version_select at 0x7f3c752e2af0>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:16.345560 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-889b5187-7649-4cdc-869b-b8a2dbb89edc tempest-HypervisorAdminV228Test-827330780 tempest-HypervisorAdminV228Test-827330780-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:16.346245 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-889b5187-7649-4cdc-869b-b8a2dbb89edc tempest-HypervisorAdminV228Test-827330780 tempest-HypervisorAdminV228Test-827330780-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:16.347252 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-889b5187-7649-4cdc-869b-b8a2dbb89edc tempest-HypervisorAdminV228Test-827330780 tempest-HypervisorAdminV228Test-827330780-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:16.372744 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-889b5187-7649-4cdc-869b-b8a2dbb89edc tempest-HypervisorAdminV228Test-827330780 tempest-HypervisorAdminV228Test-827330780-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:16.373520 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-889b5187-7649-4cdc-869b-b8a2dbb89edc tempest-HypervisorAdminV228Test-827330780 tempest-HypervisorAdminV228Test-827330780-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:16.374115 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-889b5187-7649-4cdc-869b-b8a2dbb89edc tempest-HypervisorAdminV228Test-827330780 tempest-HypervisorAdminV228Test-827330780-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:16.382063 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-889b5187-7649-4cdc-869b-b8a2dbb89edc tempest-HypervisorAdminV228Test-827330780 tempest-HypervisorAdminV228Test-827330780-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 718 microversion: 2.28 time: 0.044166 Oct 04 20:34:16.383428 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 124/218] 10.222.0.33 () {60 vars in 1193 bytes} [Tue Oct 4 20:34:16 2022] GET /compute/v2.1/os-hypervisors/1 => generated 718 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 20:34:16.398612 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-de3acb2a-b0ee-43a6-9bb8-a03cd9a8dcec tempest-AggregatesAdminTestJSON-1866202774 tempest-AggregatesAdminTestJSON-1866202774-project-admin] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:16.428019 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-de3acb2a-b0ee-43a6-9bb8-a03cd9a8dcec tempest-AggregatesAdminTestJSON-1866202774 tempest-AggregatesAdminTestJSON-1866202774-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-aggregates/3" status: 200 len: 0 microversion: 2.1 time: 0.039543 Oct 04 20:34:16.430630 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 125/219] 10.222.0.33 () {58 vars in 1152 bytes} [Tue Oct 4 20:34:16 2022] DELETE /compute/v2.1/os-aggregates/3 => generated 0 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 04 20:34:16.451757 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-2a2d9122-9a35-415c-82b4-ae7c3fdad098 tempest-AggregatesAdminTestJSON-1866202774 tempest-AggregatesAdminTestJSON-1866202774-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1373898152"}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:34:16.458451 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.objects.aggregate [None req-2a2d9122-9a35-415c-82b4-ae7c3fdad098 tempest-AggregatesAdminTestJSON-1866202774 tempest-AggregatesAdminTestJSON-1866202774-project-admin] Generated uuid 0f5a7fd2-bcab-4f0d-9943-094e1749d3a0 for aggregate {{(pid=128802) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 20:34:16.463230 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-a542adb1-5fbe-4e33-98a9-cdb209621856 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3563efe2b8c94931a2a46c4e14811b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3118a5d96843d3bede1ed94bd9717e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:16.476793 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a542adb1-5fbe-4e33-98a9-cdb209621856 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] 10.222.0.33 "GET /compute/v2.1/servers/9e9f6289-9999-4188-9af1-6cf64a676eee" status: 200 len: 1313 microversion: 2.1 time: 0.346421 Oct 04 20:34:16.480029 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 95/220] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:16 2022] GET /compute/v2.1/servers/9e9f6289-9999-4188-9af1-6cf64a676eee => generated 1313 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:16.506671 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-2a2d9122-9a35-415c-82b4-ae7c3fdad098 tempest-AggregatesAdminTestJSON-1866202774 tempest-AggregatesAdminTestJSON-1866202774-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.068049 Oct 04 20:34:16.508213 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 126/221] 10.222.0.33 () {60 vars in 1164 bytes} [Tue Oct 4 20:34:16 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:34:16.522276 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-31c9848c-4337-4e88-836d-747a9863d050 tempest-AggregatesAdminTestJSON-1866202774 tempest-AggregatesAdminTestJSON-1866202774-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-854823-8"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:34:16.549357 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-31c9848c-4337-4e88-836d-747a9863d050 tempest-AggregatesAdminTestJSON-1866202774 tempest-AggregatesAdminTestJSON-1866202774-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:16.550218 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-31c9848c-4337-4e88-836d-747a9863d050 tempest-AggregatesAdminTestJSON-1866202774 tempest-AggregatesAdminTestJSON-1866202774-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:16.550625 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-31c9848c-4337-4e88-836d-747a9863d050 tempest-AggregatesAdminTestJSON-1866202774 tempest-AggregatesAdminTestJSON-1866202774-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:16.692378 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-932e3f0e-23b3-46ae-be10-9d69ccb51c50 req-792a8b91-1815-4c28-bdf6-07aab01f18b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "854066a9-9adf-4932-b6a8-c7fe15d8b4da", "tag": "625db1ef-3c70-4d5f-9bbc-444eb15b7d8c"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:34:16.758897 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-932e3f0e-23b3-46ae-be10-9d69ccb51c50 req-792a8b91-1815-4c28-bdf6-07aab01f18b1 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:16.761063 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-932e3f0e-23b3-46ae-be10-9d69ccb51c50 req-792a8b91-1815-4c28-bdf6-07aab01f18b1 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:16.761515 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-932e3f0e-23b3-46ae-be10-9d69ccb51c50 req-792a8b91-1815-4c28-bdf6-07aab01f18b1 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:16.774077 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-932e3f0e-23b3-46ae-be10-9d69ccb51c50 req-792a8b91-1815-4c28-bdf6-07aab01f18b1 service nova] Creating event network-changed:625db1ef-3c70-4d5f-9bbc-444eb15b7d8c for instance 854066a9-9adf-4932-b6a8-c7fe15d8b4da on n-h2-854823-8 Oct 04 20:34:16.781175 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-932e3f0e-23b3-46ae-be10-9d69ccb51c50 req-792a8b91-1815-4c28-bdf6-07aab01f18b1 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093594 Oct 04 20:34:16.783161 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 127/222] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:34:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 20:34:16.824150 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-31c9848c-4337-4e88-836d-747a9863d050 tempest-AggregatesAdminTestJSON-1866202774 tempest-AggregatesAdminTestJSON-1866202774-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 242 microversion: 2.1 time: 0.306797 Oct 04 20:34:16.824816 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 96/223] 10.222.0.33 () {60 vars in 1191 bytes} [Tue Oct 4 20:34:16 2022] POST /compute/v2.1/os-aggregates/4/action => generated 242 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:34:16.836857 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-db9a3c34-3ab1-43df-80d5-9e2db407bfa8 tempest-AggregatesAdminTestJSON-1866202774 tempest-AggregatesAdminTestJSON-1866202774-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-854823-8"}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:34:16.860295 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-db9a3c34-3ab1-43df-80d5-9e2db407bfa8 tempest-AggregatesAdminTestJSON-1866202774 tempest-AggregatesAdminTestJSON-1866202774-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:16.862753 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-db9a3c34-3ab1-43df-80d5-9e2db407bfa8 tempest-AggregatesAdminTestJSON-1866202774 tempest-AggregatesAdminTestJSON-1866202774-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:16.865008 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-db9a3c34-3ab1-43df-80d5-9e2db407bfa8 tempest-AggregatesAdminTestJSON-1866202774 tempest-AggregatesAdminTestJSON-1866202774-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:16.958402 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=4 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:34:16.959404 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=14 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:34:16.966717 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5d4d3976-2100-43d3-b63c-9ab2e2a26fcd tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:16.969087 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-5d4d3976-2100-43d3-b63c-9ab2e2a26fcd tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] [instance: 8fdcb1b0-65e9-45d1-b0da-5f603f22a8cf] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:17.004610 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5d4d3976-2100-43d3-b63c-9ab2e2a26fcd tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:17.005916 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5d4d3976-2100-43d3-b63c-9ab2e2a26fcd tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:17.006626 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5d4d3976-2100-43d3-b63c-9ab2e2a26fcd tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:17.007575 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5d4d3976-2100-43d3-b63c-9ab2e2a26fcd tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:17.010049 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5d4d3976-2100-43d3-b63c-9ab2e2a26fcd tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:17.010759 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5d4d3976-2100-43d3-b63c-9ab2e2a26fcd tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:17.096792 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-db9a3c34-3ab1-43df-80d5-9e2db407bfa8 tempest-AggregatesAdminTestJSON-1866202774 tempest-AggregatesAdminTestJSON-1866202774-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 227 microversion: 2.1 time: 0.264062 Oct 04 20:34:17.097415 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 128/224] 10.222.0.33 () {60 vars in 1191 bytes} [Tue Oct 4 20:34:16 2022] POST /compute/v2.1/os-aggregates/4/action => generated 227 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:34:17.109313 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-a68ad36b-cae6-4ed1-961f-2289b1783af6 tempest-AggregatesAdminTestJSON-1866202774 tempest-AggregatesAdminTestJSON-1866202774-project-admin] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:17.146725 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-a68ad36b-cae6-4ed1-961f-2289b1783af6 tempest-AggregatesAdminTestJSON-1866202774 tempest-AggregatesAdminTestJSON-1866202774-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-aggregates/4" status: 200 len: 0 microversion: 2.1 time: 0.041022 Oct 04 20:34:17.148024 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 129/225] 10.222.0.33 () {58 vars in 1152 bytes} [Tue Oct 4 20:34:17 2022] DELETE /compute/v2.1/os-aggregates/4 => generated 0 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 04 20:34:17.156036 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-06e3fb57-d48e-478a-b000-0cf44b051255 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:17.156994 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-06e3fb57-d48e-478a-b000-0cf44b051255 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] [instance: 854066a9-9adf-4932-b6a8-c7fe15d8b4da] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:17.165188 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-06e3fb57-d48e-478a-b000-0cf44b051255 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:17.167087 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-06e3fb57-d48e-478a-b000-0cf44b051255 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:17.167708 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-06e3fb57-d48e-478a-b000-0cf44b051255 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:17.168757 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-06e3fb57-d48e-478a-b000-0cf44b051255 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:17.169363 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-06e3fb57-d48e-478a-b000-0cf44b051255 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:17.169956 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-06e3fb57-d48e-478a-b000-0cf44b051255 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:17.405131 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell0:SELECT=4 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:34:17.462122 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-5d4d3976-2100-43d3-b63c-9ab2e2a26fcd tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5eda279f6034608b192839a54dda616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f28e80977de42a892b84295ecf05141', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:17.480551 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5d4d3976-2100-43d3-b63c-9ab2e2a26fcd tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] 10.222.0.33 "GET /compute/v2.1/servers/8fdcb1b0-65e9-45d1-b0da-5f603f22a8cf" status: 200 len: 1388 microversion: 2.1 time: 0.523148 Oct 04 20:34:17.481419 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 97/226] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:16 2022] GET /compute/v2.1/servers/8fdcb1b0-65e9-45d1-b0da-5f603f22a8cf => generated 1388 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:17.500350 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0a4d5bac-241b-4048-849d-7886a4e5ff31 tempest-AggregatesAdminTestJSON-1866202774 tempest-AggregatesAdminTestJSON-1866202774-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1810120103"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:34:17.504582 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.objects.aggregate [None req-0a4d5bac-241b-4048-849d-7886a4e5ff31 tempest-AggregatesAdminTestJSON-1866202774 tempest-AggregatesAdminTestJSON-1866202774-project-admin] Generated uuid caab75e9-4d50-46c3-9665-45ae3fd9eb86 for aggregate {{(pid=128801) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 20:34:17.522694 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=9,nova_api:DELETE=3 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:34:17.543572 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-0a4d5bac-241b-4048-849d-7886a4e5ff31 tempest-AggregatesAdminTestJSON-1866202774 tempest-AggregatesAdminTestJSON-1866202774-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.060933 Oct 04 20:34:17.544415 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 98/227] 10.222.0.33 () {60 vars in 1164 bytes} [Tue Oct 4 20:34:17 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:34:17.553591 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-07751a52-238f-4c28-9716-372498b9b993 tempest-AggregatesAdminTestV241-744529003 tempest-AggregatesAdminTestV241-744529003-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-971567537"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:34:17.557301 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.objects.aggregate [None req-07751a52-238f-4c28-9716-372498b9b993 tempest-AggregatesAdminTestV241-744529003 tempest-AggregatesAdminTestV241-744529003-project-admin] Generated uuid 33812d50-4aef-4c3c-8635-15c03cc41b51 for aggregate {{(pid=128801) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 20:34:17.611620 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-07751a52-238f-4c28-9716-372498b9b993 tempest-AggregatesAdminTestV241-744529003 tempest-AggregatesAdminTestV241-744529003-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates" status: 200 len: 245 microversion: 2.41 time: 0.065977 Oct 04 20:34:17.618809 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 99/228] 10.222.0.33 () {62 vars in 1205 bytes} [Tue Oct 4 20:34:17 2022] POST /compute/v2.1/os-aggregates => generated 245 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 20:34:17.627786 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-21e1778d-065a-4ef1-94c0-138fecaf8a08 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:17.629905 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-21e1778d-065a-4ef1-94c0-138fecaf8a08 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] [instance: 9e9f6289-9999-4188-9af1-6cf64a676eee] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:17.649635 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-21e1778d-065a-4ef1-94c0-138fecaf8a08 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:17.651015 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-21e1778d-065a-4ef1-94c0-138fecaf8a08 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:17.651791 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-21e1778d-065a-4ef1-94c0-138fecaf8a08 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:17.652334 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-06e3fb57-d48e-478a-b000-0cf44b051255 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '147d000a331f4a3ba47019fcbae40901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9928be759e34d208d835263d73a5ab5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:17.653044 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-21e1778d-065a-4ef1-94c0-138fecaf8a08 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:17.653604 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-21e1778d-065a-4ef1-94c0-138fecaf8a08 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:17.654143 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-21e1778d-065a-4ef1-94c0-138fecaf8a08 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:17.663799 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-06e3fb57-d48e-478a-b000-0cf44b051255 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] 10.222.0.33 "GET /compute/v2.1/servers/854066a9-9adf-4932-b6a8-c7fe15d8b4da" status: 200 len: 1321 microversion: 2.1 time: 0.512064 Oct 04 20:34:17.667743 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 130/229] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:17 2022] GET /compute/v2.1/servers/854066a9-9adf-4932-b6a8-c7fe15d8b4da => generated 1321 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:17.699448 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-94d502a9-3250-4752-89fb-59a2dc3c4617 tempest-AggregatesAdminTestJSON-1866202774 tempest-AggregatesAdminTestJSON-1866202774-project-admin] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:17.755293 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-94d502a9-3250-4752-89fb-59a2dc3c4617 tempest-AggregatesAdminTestJSON-1866202774 tempest-AggregatesAdminTestJSON-1866202774-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-aggregates/5" status: 200 len: 0 microversion: 2.1 time: 0.086011 Oct 04 20:34:17.756226 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 131/230] 10.222.0.33 () {58 vars in 1152 bytes} [Tue Oct 4 20:34:17 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 0 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 04 20:34:17.762068 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-539526f6-918f-434a-87be-9a4ceac5c1a3 tempest-AggregatesAdminTestV241-744529003 tempest-AggregatesAdminTestV241-744529003-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1660219978"}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:34:17.854249 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell0:SELECT=22 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:34:17.891402 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-539526f6-918f-434a-87be-9a4ceac5c1a3 tempest-AggregatesAdminTestV241-744529003 tempest-AggregatesAdminTestV241-744529003-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-aggregates/6" status: 200 len: 299 microversion: 2.41 time: 0.133200 Oct 04 20:34:17.894410 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 132/231] 10.222.0.33 () {62 vars in 1210 bytes} [Tue Oct 4 20:34:17 2022] PUT /compute/v2.1/os-aggregates/6 => generated 299 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 20:34:17.929308 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-124287d4-142d-416a-acac-d0ffd398fa72 tempest-AggregatesAdminTestJSON-1866202774 tempest-AggregatesAdminTestJSON-1866202774-project-admin] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:17.941506 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.wsgi [None req-124287d4-142d-416a-acac-d0ffd398fa72 tempest-AggregatesAdminTestJSON-1866202774 tempest-AggregatesAdminTestJSON-1866202774-project-admin] HTTP exception thrown: Aggregate 5 could not be found. Oct 04 20:34:17.947350 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-124287d4-142d-416a-acac-d0ffd398fa72 tempest-AggregatesAdminTestJSON-1866202774 tempest-AggregatesAdminTestJSON-1866202774-project-admin] Request method failure captured: Oct 04 20:34:17.947350 n-d-854823-8 devstack@n-api.service[128802]: request: GET /compute/v2.1/os-aggregates/5 HTTP/1.1 Oct 04 20:34:17.947350 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 20:34:17.947350 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 20:34:17.947350 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 20:34:17.947350 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 0 Oct 04 20:34:17.947350 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 20:34:17.947350 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 20:34:17.947350 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 20:34:17.947350 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 20:34:17.947350 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPJiVq8ZUW5P_v0iVwKyYMb5-eXiSxpmI_f7aU-X9AgtdGoqKfPpr-Yw9oJTV6mFk4qFMv0ph3RWwZcT-_P46DAIUYL2JTnUiTcX5EPLbF9CPX_rvHVTTtBouJ1NgJYeIL2XsHmKGY3pQrMYqYDa1th_gaOPjl7B67dEhiAc4C-ef_OE Oct 04 20:34:17.947350 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 20:34:17.947350 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 20:34:17.947350 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 20:34:17.947350 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 20:34:17.947350 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 20:34:17.947350 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 20:34:17.947350 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: 7c170a47a78c409784b1654db886de6d Oct 04 20:34:17.947350 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-AggregatesAdminTestJSON-1866202774 Oct 04 20:34:17.947350 n-d-854823-8 devstack@n-api.service[128802]: X-Role: admin,reader,member Oct 04 20:34:17.947350 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: admin,reader,member Oct 04 20:34:17.948763 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_7c170a47a78c409784b1654db886de6d", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7c170a47a78c409784b1654db886de6d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7c170a47a78c409784b1654db886de6d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/7c170a47a78c409784b1654db886de6d"}]}] Oct 04 20:34:17.948763 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-AggregatesAdminTestJSON-1866202774 Oct 04 20:34:17.948763 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: 7c170a47a78c409784b1654db886de6d Oct 04 20:34:17.948763 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1866202774 Oct 04 20:34:17.948763 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-AggregatesAdminTestJSON-1866202774-project-admin Oct 04 20:34:17.948763 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 20:34:17.948763 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 20:34:17.948763 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: d9b8b53a940946958c3cc2c66cb1fe0b Oct 04 20:34:17.948763 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-AggregatesAdminTestJSON-1866202774-project-admin Oct 04 20:34:17.948763 n-d-854823-8 devstack@n-api.service[128802]: method: > Oct 04 20:34:17.948763 n-d-854823-8 devstack@n-api.service[128802]: exception: Aggregate 5 could not be found. Oct 04 20:34:17.948763 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'id': '5'} Oct 04 20:34:17.948763 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:34:17.949628 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:34:17.949628 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Oct 04 20:34:17.949628 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Oct 04 20:34:17.949628 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Oct 04 20:34:17.949628 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Oct 04 20:34:17.949628 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 20:34:17.949628 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 20:34:17.949628 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 04 20:34:17.949628 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 04 20:34:17.949628 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 20:34:17.949628 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 20:34:17.949628 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 04 20:34:17.949628 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 04 20:34:17.949628 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 5 could not be found. Oct 04 20:34:17.949628 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:34:17.949628 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:34:17.949628 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:34:17.949628 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:34:17.949628 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:34:17.950885 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:34:17.950885 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:34:17.950885 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:34:17.950885 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:34:17.950885 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:34:17.950885 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Oct 04 20:34:17.950885 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:34:17.950885 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 5 could not be found. Oct 04 20:34:17.950885 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:34:17.950885 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:34:17.950885 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:34:17.950885 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:34:17.950885 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:34:17.950885 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:34:17.950885 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:34:17.950885 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:34:17.950885 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 5 could not be found. Oct 04 20:34:17.950885 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:34:17.955757 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-124287d4-142d-416a-acac-d0ffd398fa72 tempest-AggregatesAdminTestJSON-1866202774 tempest-AggregatesAdminTestJSON-1866202774-project-admin] Returning 404 to user: Aggregate 5 could not be found. {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:34:17.956896 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-124287d4-142d-416a-acac-d0ffd398fa72 tempest-AggregatesAdminTestJSON-1866202774 tempest-AggregatesAdminTestJSON-1866202774-project-admin] 10.222.0.33 "GET /compute/v2.1/os-aggregates/5" status: 404 len: 77 microversion: 2.1 time: 0.061327 Oct 04 20:34:17.959081 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 133/232] 10.222.0.33 () {58 vars in 1149 bytes} [Tue Oct 4 20:34:17 2022] GET /compute/v2.1/os-aggregates/5 => generated 77 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 20:34:17.970215 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-312c5de6-6f6b-417f-8297-61d5df92a82e tempest-AggregatesAdminTestV241-744529003 tempest-AggregatesAdminTestV241-744529003-project-admin] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:17.980013 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_api:SELECT=87,nova_api:DELETE=11,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:34:17.982207 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-312c5de6-6f6b-417f-8297-61d5df92a82e tempest-AggregatesAdminTestV241-744529003 tempest-AggregatesAdminTestV241-744529003-project-admin] 10.222.0.33 "GET /compute/v2.1/os-aggregates/6" status: 200 len: 299 microversion: 2.41 time: 0.021271 Oct 04 20:34:17.990507 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 134/233] 10.222.0.33 () {60 vars in 1190 bytes} [Tue Oct 4 20:34:17 2022] GET /compute/v2.1/os-aggregates/6 => generated 299 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 20:34:17.996558 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-1e4f9df3-3696-44c9-91af-39341e1d564c tempest-AggregatesAdminTestJSON-1866202774 tempest-AggregatesAdminTestJSON-1866202774-project-admin] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:18.022796 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.wsgi [None req-1e4f9df3-3696-44c9-91af-39341e1d564c tempest-AggregatesAdminTestJSON-1866202774 tempest-AggregatesAdminTestJSON-1866202774-project-admin] HTTP exception thrown: Aggregate 5 could not be found. Oct 04 20:34:18.025944 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-1e4f9df3-3696-44c9-91af-39341e1d564c tempest-AggregatesAdminTestJSON-1866202774 tempest-AggregatesAdminTestJSON-1866202774-project-admin] Request method failure captured: Oct 04 20:34:18.025944 n-d-854823-8 devstack@n-api.service[128802]: request: DELETE /compute/v2.1/os-aggregates/5 HTTP/1.1 Oct 04 20:34:18.025944 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 20:34:18.025944 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 20:34:18.025944 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 20:34:18.025944 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 0 Oct 04 20:34:18.025944 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 20:34:18.025944 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 20:34:18.025944 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 20:34:18.025944 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 20:34:18.025944 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPJiVq8ZUW5P_v0iVwKyYMb5-eXiSxpmI_f7aU-X9AgtdGoqKfPpr-Yw9oJTV6mFk4qFMv0ph3RWwZcT-_P46DAIUYL2JTnUiTcX5EPLbF9CPX_rvHVTTtBouJ1NgJYeIL2XsHmKGY3pQrMYqYDa1th_gaOPjl7B67dEhiAc4C-ef_OE Oct 04 20:34:18.025944 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 20:34:18.025944 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 20:34:18.025944 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 20:34:18.025944 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 20:34:18.025944 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 20:34:18.025944 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 20:34:18.025944 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: 7c170a47a78c409784b1654db886de6d Oct 04 20:34:18.025944 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-AggregatesAdminTestJSON-1866202774 Oct 04 20:34:18.025944 n-d-854823-8 devstack@n-api.service[128802]: X-Role: admin,reader,member Oct 04 20:34:18.025944 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: admin,reader,member Oct 04 20:34:18.027678 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_7c170a47a78c409784b1654db886de6d", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7c170a47a78c409784b1654db886de6d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7c170a47a78c409784b1654db886de6d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/7c170a47a78c409784b1654db886de6d"}]}] Oct 04 20:34:18.027678 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-AggregatesAdminTestJSON-1866202774 Oct 04 20:34:18.027678 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: 7c170a47a78c409784b1654db886de6d Oct 04 20:34:18.027678 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1866202774 Oct 04 20:34:18.027678 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-AggregatesAdminTestJSON-1866202774-project-admin Oct 04 20:34:18.027678 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 20:34:18.027678 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 20:34:18.027678 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: d9b8b53a940946958c3cc2c66cb1fe0b Oct 04 20:34:18.027678 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-AggregatesAdminTestJSON-1866202774-project-admin Oct 04 20:34:18.027678 n-d-854823-8 devstack@n-api.service[128802]: method: > Oct 04 20:34:18.027678 n-d-854823-8 devstack@n-api.service[128802]: exception: Aggregate 5 could not be found. Oct 04 20:34:18.027678 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'id': '5'} Oct 04 20:34:18.027678 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:34:18.029057 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:34:18.029057 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Oct 04 20:34:18.029057 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Oct 04 20:34:18.029057 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 04 20:34:18.029057 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 04 20:34:18.029057 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 20:34:18.029057 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 20:34:18.029057 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 20:34:18.029057 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 20:34:18.029057 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 04 20:34:18.029057 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 04 20:34:18.029057 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Oct 04 20:34:18.029057 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Oct 04 20:34:18.029057 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 20:34:18.029057 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 20:34:18.029057 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 04 20:34:18.029057 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 04 20:34:18.029057 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 20:34:18.029057 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 20:34:18.030551 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 04 20:34:18.030551 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 04 20:34:18.030551 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 5 could not be found. Oct 04 20:34:18.030551 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:34:18.030551 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:34:18.030551 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:34:18.030551 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:34:18.030551 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:34:18.030551 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:34:18.030551 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:34:18.030551 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:34:18.030551 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:34:18.030551 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:34:18.030551 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Oct 04 20:34:18.030551 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:34:18.030551 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 5 could not be found. Oct 04 20:34:18.030551 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:34:18.030551 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:34:18.030551 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:34:18.030551 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:34:18.030551 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:34:18.033483 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:34:18.033483 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:34:18.033483 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:34:18.033483 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 5 could not be found. Oct 04 20:34:18.033483 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:34:18.035315 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-1e4f9df3-3696-44c9-91af-39341e1d564c tempest-AggregatesAdminTestJSON-1866202774 tempest-AggregatesAdminTestJSON-1866202774-project-admin] Returning 404 to user: Aggregate 5 could not be found. {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:34:18.036485 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-1e4f9df3-3696-44c9-91af-39341e1d564c tempest-AggregatesAdminTestJSON-1866202774 tempest-AggregatesAdminTestJSON-1866202774-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-aggregates/5" status: 404 len: 77 microversion: 2.1 time: 0.044649 Oct 04 20:34:18.041868 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 135/234] 10.222.0.33 () {58 vars in 1152 bytes} [Tue Oct 4 20:34:17 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 77 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 20:34:18.050168 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-07438055-10bb-4931-b3da-9544afec265a tempest-AggregatesAdminTestV241-744529003 tempest-AggregatesAdminTestV241-744529003-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-854823-8"}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:34:18.089391 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-07438055-10bb-4931-b3da-9544afec265a tempest-AggregatesAdminTestV241-744529003 tempest-AggregatesAdminTestV241-744529003-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:18.091281 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-21e1778d-065a-4ef1-94c0-138fecaf8a08 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3563efe2b8c94931a2a46c4e14811b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3118a5d96843d3bede1ed94bd9717e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:18.095733 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-07438055-10bb-4931-b3da-9544afec265a tempest-AggregatesAdminTestV241-744529003 tempest-AggregatesAdminTestV241-744529003-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:18.096385 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-07438055-10bb-4931-b3da-9544afec265a tempest-AggregatesAdminTestV241-744529003 tempest-AggregatesAdminTestV241-744529003-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:18.121333 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-21e1778d-065a-4ef1-94c0-138fecaf8a08 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] 10.222.0.33 "GET /compute/v2.1/servers/9e9f6289-9999-4188-9af1-6cf64a676eee" status: 200 len: 1313 microversion: 2.1 time: 0.501044 Oct 04 20:34:18.137651 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 100/235] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:17 2022] GET /compute/v2.1/servers/9e9f6289-9999-4188-9af1-6cf64a676eee => generated 1313 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:18.144655 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2cde9952-62e3-4d53-8b17-13171e6af425 tempest-AggregatesAdminTestJSON-1866202774 tempest-AggregatesAdminTestJSON-1866202774-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-1011079162", "name": "tempest-test_aggregate-1234548425"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:34:18.152371 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.objects.aggregate [None req-2cde9952-62e3-4d53-8b17-13171e6af425 tempest-AggregatesAdminTestJSON-1866202774 tempest-AggregatesAdminTestJSON-1866202774-project-admin] Generated uuid 62df5b9d-1481-4da8-ba57-7b30c2d8d2e5 for aggregate {{(pid=128801) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 20:34:18.216461 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-2cde9952-62e3-4d53-8b17-13171e6af425 tempest-AggregatesAdminTestJSON-1866202774 tempest-AggregatesAdminTestJSON-1866202774-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates" status: 200 len: 222 microversion: 2.1 time: 0.077606 Oct 04 20:34:18.217317 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 101/236] 10.222.0.33 () {60 vars in 1165 bytes} [Tue Oct 4 20:34:18 2022] POST /compute/v2.1/os-aggregates => generated 222 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:34:18.229888 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-dc96b196-ef71-447b-b26c-6cc170c65c5b tempest-AggregatesAdminTestJSON-1866202774 tempest-AggregatesAdminTestJSON-1866202774-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:18.276807 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-dc96b196-ef71-447b-b26c-6cc170c65c5b tempest-AggregatesAdminTestJSON-1866202774 tempest-AggregatesAdminTestJSON-1866202774-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-aggregates/7" status: 200 len: 0 microversion: 2.1 time: 0.051992 Oct 04 20:34:18.277654 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 102/237] 10.222.0.33 () {58 vars in 1152 bytes} [Tue Oct 4 20:34:18 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 0 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Oct 04 20:34:18.285634 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a7c2c395-2b4f-48ef-9f48-130805747680 tempest-AggregatesAdminTestJSON-1866202774 tempest-AggregatesAdminTestJSON-1866202774-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:18.307666 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-a7c2c395-2b4f-48ef-9f48-130805747680 tempest-AggregatesAdminTestJSON-1866202774 tempest-AggregatesAdminTestJSON-1866202774-project-admin] HTTP exception thrown: Aggregate 7 could not be found. Oct 04 20:34:18.310511 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a7c2c395-2b4f-48ef-9f48-130805747680 tempest-AggregatesAdminTestJSON-1866202774 tempest-AggregatesAdminTestJSON-1866202774-project-admin] Request method failure captured: Oct 04 20:34:18.310511 n-d-854823-8 devstack@n-api.service[128801]: request: GET /compute/v2.1/os-aggregates/7 HTTP/1.1 Oct 04 20:34:18.310511 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:34:18.310511 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:34:18.310511 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:34:18.310511 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 0 Oct 04 20:34:18.310511 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:34:18.310511 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:34:18.310511 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:34:18.310511 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:34:18.310511 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJiVq8ZUW5P_v0iVwKyYMb5-eXiSxpmI_f7aU-X9AgtdGoqKfPpr-Yw9oJTV6mFk4qFMv0ph3RWwZcT-_P46DAIUYL2JTnUiTcX5EPLbF9CPX_rvHVTTtBouJ1NgJYeIL2XsHmKGY3pQrMYqYDa1th_gaOPjl7B67dEhiAc4C-ef_OE Oct 04 20:34:18.310511 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:34:18.310511 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:34:18.310511 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:34:18.310511 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:34:18.310511 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:34:18.310511 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:34:18.310511 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: 7c170a47a78c409784b1654db886de6d Oct 04 20:34:18.310511 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-AggregatesAdminTestJSON-1866202774 Oct 04 20:34:18.310511 n-d-854823-8 devstack@n-api.service[128801]: X-Role: admin,reader,member Oct 04 20:34:18.310511 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: admin,reader,member Oct 04 20:34:18.312014 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_7c170a47a78c409784b1654db886de6d", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7c170a47a78c409784b1654db886de6d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7c170a47a78c409784b1654db886de6d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/7c170a47a78c409784b1654db886de6d"}]}] Oct 04 20:34:18.312014 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-AggregatesAdminTestJSON-1866202774 Oct 04 20:34:18.312014 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: 7c170a47a78c409784b1654db886de6d Oct 04 20:34:18.312014 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1866202774 Oct 04 20:34:18.312014 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-AggregatesAdminTestJSON-1866202774-project-admin Oct 04 20:34:18.312014 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:34:18.312014 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:34:18.312014 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: d9b8b53a940946958c3cc2c66cb1fe0b Oct 04 20:34:18.312014 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-AggregatesAdminTestJSON-1866202774-project-admin Oct 04 20:34:18.312014 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 20:34:18.312014 n-d-854823-8 devstack@n-api.service[128801]: exception: Aggregate 7 could not be found. Oct 04 20:34:18.312014 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': '7'} Oct 04 20:34:18.312014 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:34:18.312822 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:34:18.312822 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Oct 04 20:34:18.312822 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Oct 04 20:34:18.312822 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Oct 04 20:34:18.312822 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Oct 04 20:34:18.312822 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 20:34:18.312822 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 20:34:18.312822 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 04 20:34:18.312822 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 04 20:34:18.312822 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 20:34:18.312822 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 20:34:18.312822 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 04 20:34:18.312822 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 04 20:34:18.312822 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 7 could not be found. Oct 04 20:34:18.312822 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:34:18.312822 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:34:18.312822 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:34:18.312822 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:34:18.312822 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:34:18.313973 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:34:18.313973 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:34:18.313973 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:34:18.313973 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:34:18.313973 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:34:18.313973 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Oct 04 20:34:18.313973 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:34:18.313973 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 7 could not be found. Oct 04 20:34:18.313973 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:34:18.313973 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:34:18.313973 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:34:18.313973 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:34:18.313973 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:34:18.313973 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:34:18.313973 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:34:18.313973 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:34:18.313973 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 7 could not be found. Oct 04 20:34:18.313973 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:34:18.315969 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a7c2c395-2b4f-48ef-9f48-130805747680 tempest-AggregatesAdminTestJSON-1866202774 tempest-AggregatesAdminTestJSON-1866202774-project-admin] Returning 404 to user: Aggregate 7 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:34:18.316988 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a7c2c395-2b4f-48ef-9f48-130805747680 tempest-AggregatesAdminTestJSON-1866202774 tempest-AggregatesAdminTestJSON-1866202774-project-admin] 10.222.0.33 "GET /compute/v2.1/os-aggregates/7" status: 404 len: 77 microversion: 2.1 time: 0.035109 Oct 04 20:34:18.317876 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 103/238] 10.222.0.33 () {58 vars in 1149 bytes} [Tue Oct 4 20:34:18 2022] GET /compute/v2.1/os-aggregates/7 => generated 77 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 04 20:34:18.326809 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-38a59889-c4dc-45b4-a04a-756d1733e858 tempest-AggregatesAdminTestJSON-1866202774 tempest-AggregatesAdminTestJSON-1866202774-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:18.366128 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-38a59889-c4dc-45b4-a04a-756d1733e858 tempest-AggregatesAdminTestJSON-1866202774 tempest-AggregatesAdminTestJSON-1866202774-project-admin] HTTP exception thrown: Aggregate 7 could not be found. Oct 04 20:34:18.368643 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-38a59889-c4dc-45b4-a04a-756d1733e858 tempest-AggregatesAdminTestJSON-1866202774 tempest-AggregatesAdminTestJSON-1866202774-project-admin] Request method failure captured: Oct 04 20:34:18.368643 n-d-854823-8 devstack@n-api.service[128801]: request: DELETE /compute/v2.1/os-aggregates/7 HTTP/1.1 Oct 04 20:34:18.368643 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:34:18.368643 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:34:18.368643 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:34:18.368643 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 0 Oct 04 20:34:18.368643 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:34:18.368643 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:34:18.368643 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:34:18.368643 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:34:18.368643 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJiVq8ZUW5P_v0iVwKyYMb5-eXiSxpmI_f7aU-X9AgtdGoqKfPpr-Yw9oJTV6mFk4qFMv0ph3RWwZcT-_P46DAIUYL2JTnUiTcX5EPLbF9CPX_rvHVTTtBouJ1NgJYeIL2XsHmKGY3pQrMYqYDa1th_gaOPjl7B67dEhiAc4C-ef_OE Oct 04 20:34:18.368643 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:34:18.368643 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:34:18.368643 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:34:18.368643 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:34:18.368643 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:34:18.368643 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:34:18.368643 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: 7c170a47a78c409784b1654db886de6d Oct 04 20:34:18.368643 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-AggregatesAdminTestJSON-1866202774 Oct 04 20:34:18.368643 n-d-854823-8 devstack@n-api.service[128801]: X-Role: admin,reader,member Oct 04 20:34:18.368643 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: admin,reader,member Oct 04 20:34:18.370137 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_7c170a47a78c409784b1654db886de6d", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7c170a47a78c409784b1654db886de6d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7c170a47a78c409784b1654db886de6d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/7c170a47a78c409784b1654db886de6d"}]}] Oct 04 20:34:18.370137 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-AggregatesAdminTestJSON-1866202774 Oct 04 20:34:18.370137 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: 7c170a47a78c409784b1654db886de6d Oct 04 20:34:18.370137 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1866202774 Oct 04 20:34:18.370137 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-AggregatesAdminTestJSON-1866202774-project-admin Oct 04 20:34:18.370137 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:34:18.370137 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:34:18.370137 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: d9b8b53a940946958c3cc2c66cb1fe0b Oct 04 20:34:18.370137 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-AggregatesAdminTestJSON-1866202774-project-admin Oct 04 20:34:18.370137 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 20:34:18.370137 n-d-854823-8 devstack@n-api.service[128801]: exception: Aggregate 7 could not be found. Oct 04 20:34:18.370137 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': '7'} Oct 04 20:34:18.370137 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:34:18.371008 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:34:18.371008 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Oct 04 20:34:18.371008 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Oct 04 20:34:18.371008 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 04 20:34:18.371008 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 04 20:34:18.371008 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 20:34:18.371008 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 20:34:18.371008 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 20:34:18.371008 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 20:34:18.371008 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 04 20:34:18.371008 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 04 20:34:18.371008 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Oct 04 20:34:18.371008 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Oct 04 20:34:18.371008 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 20:34:18.371008 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 20:34:18.371008 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 04 20:34:18.371008 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 04 20:34:18.371008 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 20:34:18.371008 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 20:34:18.372112 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 04 20:34:18.372112 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 04 20:34:18.372112 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 7 could not be found. Oct 04 20:34:18.372112 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:34:18.372112 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:34:18.372112 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:34:18.372112 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:34:18.372112 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:34:18.372112 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:34:18.372112 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:34:18.372112 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:34:18.372112 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:34:18.372112 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:34:18.372112 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Oct 04 20:34:18.372112 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:34:18.372112 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 7 could not be found. Oct 04 20:34:18.372112 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:34:18.372112 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:34:18.372112 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:34:18.372112 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:34:18.372112 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:34:18.373373 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:34:18.373373 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:34:18.373373 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:34:18.373373 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 7 could not be found. Oct 04 20:34:18.373373 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:34:18.374708 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-38a59889-c4dc-45b4-a04a-756d1733e858 tempest-AggregatesAdminTestJSON-1866202774 tempest-AggregatesAdminTestJSON-1866202774-project-admin] Returning 404 to user: Aggregate 7 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:34:18.375717 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-38a59889-c4dc-45b4-a04a-756d1733e858 tempest-AggregatesAdminTestJSON-1866202774 tempest-AggregatesAdminTestJSON-1866202774-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-aggregates/7" status: 404 len: 77 microversion: 2.1 time: 0.052919 Oct 04 20:34:18.377348 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 104/239] 10.222.0.33 () {58 vars in 1152 bytes} [Tue Oct 4 20:34:18 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 77 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 04 20:34:18.389889 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-4a2d954d-2037-4710-8adb-e5fe8723c5cb tempest-AggregatesAdminTestJSON-1866202774 tempest-AggregatesAdminTestJSON-1866202774-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-557571334"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:34:18.395324 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.objects.aggregate [None req-4a2d954d-2037-4710-8adb-e5fe8723c5cb tempest-AggregatesAdminTestJSON-1866202774 tempest-AggregatesAdminTestJSON-1866202774-project-admin] Generated uuid d8f10802-f24f-497f-a741-fa375c8aa977 for aggregate {{(pid=128801) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 20:34:18.429147 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-4a2d954d-2037-4710-8adb-e5fe8723c5cb tempest-AggregatesAdminTestJSON-1866202774 tempest-AggregatesAdminTestJSON-1866202774-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.044730 Oct 04 20:34:18.439327 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 105/240] 10.222.0.33 () {60 vars in 1164 bytes} [Tue Oct 4 20:34:18 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:34:18.446595 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e4bf6bdc-a1f5-456f-8e0b-80cca15d950b tempest-AggregatesAdminTestJSON-1866202774 tempest-AggregatesAdminTestJSON-1866202774-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:18.460780 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e4bf6bdc-a1f5-456f-8e0b-80cca15d950b tempest-AggregatesAdminTestJSON-1866202774 tempest-AggregatesAdminTestJSON-1866202774-project-admin] 10.222.0.33 "GET /compute/v2.1/os-aggregates/8" status: 200 len: 226 microversion: 2.1 time: 0.019974 Oct 04 20:34:18.468397 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 106/241] 10.222.0.33 () {58 vars in 1149 bytes} [Tue Oct 4 20:34:18 2022] GET /compute/v2.1/os-aggregates/8 => generated 226 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:34:18.474151 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0a74a90d-c5c2-48bd-a54a-4c05c8aae204 tempest-AggregatesAdminTestJSON-1866202774 tempest-AggregatesAdminTestJSON-1866202774-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"key": "value"}}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:34:18.513866 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-07438055-10bb-4931-b3da-9544afec265a tempest-AggregatesAdminTestV241-744529003 tempest-AggregatesAdminTestV241-744529003-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates/6/action" status: 200 len: 314 microversion: 2.41 time: 0.473752 Oct 04 20:34:18.514586 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 136/242] 10.222.0.33 () {62 vars in 1232 bytes} [Tue Oct 4 20:34:18 2022] POST /compute/v2.1/os-aggregates/6/action => generated 314 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 20:34:18.527732 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-26402830-e43e-41c8-a9be-a1f017558136 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:18.530621 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-26402830-e43e-41c8-a9be-a1f017558136 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] [instance: 8fdcb1b0-65e9-45d1-b0da-5f603f22a8cf] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:18.552613 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-0a74a90d-c5c2-48bd-a54a-4c05c8aae204 tempest-AggregatesAdminTestJSON-1866202774 tempest-AggregatesAdminTestJSON-1866202774-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates/8/action" status: 200 len: 264 microversion: 2.1 time: 0.078721 Oct 04 20:34:18.553262 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 107/243] 10.222.0.33 () {60 vars in 1191 bytes} [Tue Oct 4 20:34:18 2022] POST /compute/v2.1/os-aggregates/8/action => generated 264 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 20:34:18.575234 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-26402830-e43e-41c8-a9be-a1f017558136 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:18.577351 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-26402830-e43e-41c8-a9be-a1f017558136 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:18.577813 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-26402830-e43e-41c8-a9be-a1f017558136 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:18.582248 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-26402830-e43e-41c8-a9be-a1f017558136 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:18.583826 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-26402830-e43e-41c8-a9be-a1f017558136 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:18.589975 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d36f3315-c3b8-489c-b4b6-c3554310fec9 tempest-AggregatesAdminTestV241-744529003 tempest-AggregatesAdminTestV241-744529003-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-854823-8"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:34:18.590482 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-26402830-e43e-41c8-a9be-a1f017558136 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:18.617932 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d36f3315-c3b8-489c-b4b6-c3554310fec9 tempest-AggregatesAdminTestV241-744529003 tempest-AggregatesAdminTestV241-744529003-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:18.620077 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d36f3315-c3b8-489c-b4b6-c3554310fec9 tempest-AggregatesAdminTestV241-744529003 tempest-AggregatesAdminTestV241-744529003-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:18.621598 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d36f3315-c3b8-489c-b4b6-c3554310fec9 tempest-AggregatesAdminTestV241-744529003 tempest-AggregatesAdminTestV241-744529003-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:18.873759 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d36f3315-c3b8-489c-b4b6-c3554310fec9 tempest-AggregatesAdminTestV241-744529003 tempest-AggregatesAdminTestV241-744529003-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates/6/action" status: 200 len: 299 microversion: 2.41 time: 0.308719 Oct 04 20:34:18.878147 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 108/244] 10.222.0.33 () {62 vars in 1232 bytes} [Tue Oct 4 20:34:18 2022] POST /compute/v2.1/os-aggregates/6/action => generated 299 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 20:34:18.887713 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-70012984-f21e-459f-95b0-bf024ae7fa9f tempest-AggregatesAdminTestJSON-1866202774 tempest-AggregatesAdminTestJSON-1866202774-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:18.898576 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-26402830-e43e-41c8-a9be-a1f017558136 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5eda279f6034608b192839a54dda616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f28e80977de42a892b84295ecf05141', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:18.910972 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-26402830-e43e-41c8-a9be-a1f017558136 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] 10.222.0.33 "GET /compute/v2.1/servers/8fdcb1b0-65e9-45d1-b0da-5f603f22a8cf" status: 200 len: 1388 microversion: 2.1 time: 0.395432 Oct 04 20:34:18.912160 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-70012984-f21e-459f-95b0-bf024ae7fa9f tempest-AggregatesAdminTestJSON-1866202774 tempest-AggregatesAdminTestJSON-1866202774-project-admin] 10.222.0.33 "GET /compute/v2.1/os-aggregates/8" status: 200 len: 240 microversion: 2.1 time: 0.032532 Oct 04 20:34:18.913312 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 109/245] 10.222.0.33 () {58 vars in 1149 bytes} [Tue Oct 4 20:34:18 2022] GET /compute/v2.1/os-aggregates/8 => generated 240 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:34:18.936055 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-be7faf5b-b92a-46f8-99ef-b20c9b9fbc2f tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:18.936972 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-be7faf5b-b92a-46f8-99ef-b20c9b9fbc2f tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] [instance: 854066a9-9adf-4932-b6a8-c7fe15d8b4da] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:18.937344 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 137/246] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:18 2022] GET /compute/v2.1/servers/8fdcb1b0-65e9-45d1-b0da-5f603f22a8cf => generated 1388 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:18.944037 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-fb138ebb-f1aa-4820-b7a2-3dd4f4e82a61 tempest-AggregatesAdminTestV241-744529003 tempest-AggregatesAdminTestV241-744529003-project-admin] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:18.951580 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-be7faf5b-b92a-46f8-99ef-b20c9b9fbc2f tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:18.952075 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-be7faf5b-b92a-46f8-99ef-b20c9b9fbc2f tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:18.953535 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-be7faf5b-b92a-46f8-99ef-b20c9b9fbc2f tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:18.954290 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-be7faf5b-b92a-46f8-99ef-b20c9b9fbc2f tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:18.954756 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-be7faf5b-b92a-46f8-99ef-b20c9b9fbc2f tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:18.955181 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-be7faf5b-b92a-46f8-99ef-b20c9b9fbc2f tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:18.984153 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-fb138ebb-f1aa-4820-b7a2-3dd4f4e82a61 tempest-AggregatesAdminTestV241-744529003 tempest-AggregatesAdminTestV241-744529003-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-aggregates/6" status: 200 len: 0 microversion: 2.41 time: 0.044966 Oct 04 20:34:18.986484 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 138/247] 10.222.0.33 () {60 vars in 1193 bytes} [Tue Oct 4 20:34:18 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 0 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:34:18.992465 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-38938781-4e2d-460d-ab33-007fa7289f26 tempest-AggregatesAdminTestJSON-1866202774 tempest-AggregatesAdminTestJSON-1866202774-project-admin] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:19.049750 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-38938781-4e2d-460d-ab33-007fa7289f26 tempest-AggregatesAdminTestJSON-1866202774 tempest-AggregatesAdminTestJSON-1866202774-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-aggregates/8" status: 200 len: 0 microversion: 2.1 time: 0.061444 Oct 04 20:34:19.058294 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 139/248] 10.222.0.33 () {58 vars in 1152 bytes} [Tue Oct 4 20:34:18 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 0 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 04 20:34:19.065175 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-9f810918-7ea2-4524-b14a-f42cb26e5490 tempest-AggregatesAdminNegativeTestJSON-907895620 tempest-AggregatesAdminNegativeTestJSON-907895620-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-470664862"}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:34:19.074907 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.objects.aggregate [None req-9f810918-7ea2-4524-b14a-f42cb26e5490 tempest-AggregatesAdminNegativeTestJSON-907895620 tempest-AggregatesAdminNegativeTestJSON-907895620-project-admin] Generated uuid a8410615-0ce5-4408-a0a2-c003474c370a for aggregate {{(pid=128802) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 20:34:19.108144 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-9f810918-7ea2-4524-b14a-f42cb26e5490 tempest-AggregatesAdminNegativeTestJSON-907895620 tempest-AggregatesAdminNegativeTestJSON-907895620-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.048026 Oct 04 20:34:19.124776 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 140/249] 10.222.0.33 () {60 vars in 1164 bytes} [Tue Oct 4 20:34:19 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:34:19.141539 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-e07205d1-3750-4370-9af4-d4224633a665 tempest-AggregatesAdminTestJSON-1866202774 tempest-AggregatesAdminTestJSON-1866202774-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1536062569", "availability_zone": "tempest-test_az-1865910050"}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:34:19.179226 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.objects.aggregate [None req-e07205d1-3750-4370-9af4-d4224633a665 tempest-AggregatesAdminTestJSON-1866202774 tempest-AggregatesAdminTestJSON-1866202774-project-admin] Generated uuid e0156a9a-c2a9-4dfa-b004-084d5a24633f for aggregate {{(pid=128802) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 20:34:19.235494 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-e07205d1-3750-4370-9af4-d4224633a665 tempest-AggregatesAdminTestJSON-1866202774 tempest-AggregatesAdminTestJSON-1866202774-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates" status: 200 len: 223 microversion: 2.1 time: 0.105834 Oct 04 20:34:19.254096 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 141/250] 10.222.0.33 () {60 vars in 1165 bytes} [Tue Oct 4 20:34:19 2022] POST /compute/v2.1/os-aggregates => generated 223 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:34:19.265032 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-b6e0bbae-c7ba-452a-915f-ee586d67a299 tempest-AggregatesAdminNegativeTestJSON-907895620 tempest-AggregatesAdminNegativeTestJSON-907895620-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-854823-8"}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:34:19.278231 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b6e0bbae-c7ba-452a-915f-ee586d67a299 tempest-AggregatesAdminNegativeTestJSON-907895620 tempest-AggregatesAdminNegativeTestJSON-907895620-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:19.278748 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b6e0bbae-c7ba-452a-915f-ee586d67a299 tempest-AggregatesAdminNegativeTestJSON-907895620 tempest-AggregatesAdminNegativeTestJSON-907895620-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:19.279842 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b6e0bbae-c7ba-452a-915f-ee586d67a299 tempest-AggregatesAdminNegativeTestJSON-907895620 tempest-AggregatesAdminNegativeTestJSON-907895620-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:19.566933 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-b6e0bbae-c7ba-452a-915f-ee586d67a299 tempest-AggregatesAdminNegativeTestJSON-907895620 tempest-AggregatesAdminNegativeTestJSON-907895620-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 241 microversion: 2.1 time: 0.311429 Oct 04 20:34:19.568346 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 142/251] 10.222.0.33 () {60 vars in 1191 bytes} [Tue Oct 4 20:34:19 2022] POST /compute/v2.1/os-aggregates/9/action => generated 241 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:34:19.580425 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-4a6aaf2a-daf1-4d7f-b676-39f91c7e539d tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:19.581898 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-4a6aaf2a-daf1-4d7f-b676-39f91c7e539d tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] [instance: 9e9f6289-9999-4188-9af1-6cf64a676eee] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:19.604368 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4a6aaf2a-daf1-4d7f-b676-39f91c7e539d tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:19.604786 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4a6aaf2a-daf1-4d7f-b676-39f91c7e539d tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:19.610563 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4a6aaf2a-daf1-4d7f-b676-39f91c7e539d tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:19.611502 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4a6aaf2a-daf1-4d7f-b676-39f91c7e539d tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:19.612994 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4a6aaf2a-daf1-4d7f-b676-39f91c7e539d tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:19.613454 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4a6aaf2a-daf1-4d7f-b676-39f91c7e539d tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:19.644960 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-be7faf5b-b92a-46f8-99ef-b20c9b9fbc2f tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '147d000a331f4a3ba47019fcbae40901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9928be759e34d208d835263d73a5ab5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:19.657833 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-be7faf5b-b92a-46f8-99ef-b20c9b9fbc2f tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] 10.222.0.33 "GET /compute/v2.1/servers/854066a9-9adf-4932-b6a8-c7fe15d8b4da" status: 200 len: 1321 microversion: 2.1 time: 0.743206 Oct 04 20:34:19.660516 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 110/252] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:18 2022] GET /compute/v2.1/servers/854066a9-9adf-4932-b6a8-c7fe15d8b4da => generated 1321 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:19.677000 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-4fd15405-accf-429f-8bbb-a2faf2f7ad2e tempest-AggregatesAdminTestJSON-1866202774 tempest-AggregatesAdminTestJSON-1866202774-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1536062569_new", "availability_zone": "tempest-test_az-1865910050_new"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:34:19.832268 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4fd15405-accf-429f-8bbb-a2faf2f7ad2e tempest-AggregatesAdminTestJSON-1866202774 tempest-AggregatesAdminTestJSON-1866202774-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:19.833283 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4fd15405-accf-429f-8bbb-a2faf2f7ad2e tempest-AggregatesAdminTestJSON-1866202774 tempest-AggregatesAdminTestJSON-1866202774-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:19.834503 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4fd15405-accf-429f-8bbb-a2faf2f7ad2e tempest-AggregatesAdminTestJSON-1866202774 tempest-AggregatesAdminTestJSON-1866202774-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:19.895529 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-4fd15405-accf-429f-8bbb-a2faf2f7ad2e tempest-AggregatesAdminTestJSON-1866202774 tempest-AggregatesAdminTestJSON-1866202774-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-aggregates/10" status: 200 len: 337 microversion: 2.1 time: 0.231895 Oct 04 20:34:19.896425 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 111/253] 10.222.0.33 () {60 vars in 1173 bytes} [Tue Oct 4 20:34:19 2022] PUT /compute/v2.1/os-aggregates/10 => generated 337 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:34:19.910210 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-0ec40f24-518d-49c7-abce-f31587ccaf83 req-52809c4d-bae4-402b-8750-91b33a13c93b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8fdcb1b0-65e9-45d1-b0da-5f603f22a8cf", "name": "network-vif-plugged", "status": "completed", "tag": "b156b57a-987c-484d-9b1a-ed22e9a62872"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:34:19.920877 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-0ec40f24-518d-49c7-abce-f31587ccaf83 req-52809c4d-bae4-402b-8750-91b33a13c93b service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:19.921562 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-0ec40f24-518d-49c7-abce-f31587ccaf83 req-52809c4d-bae4-402b-8750-91b33a13c93b service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:19.922248 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-0ec40f24-518d-49c7-abce-f31587ccaf83 req-52809c4d-bae4-402b-8750-91b33a13c93b service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:19.935142 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-0ec40f24-518d-49c7-abce-f31587ccaf83 req-52809c4d-bae4-402b-8750-91b33a13c93b service nova] Creating event network-vif-plugged:b156b57a-987c-484d-9b1a-ed22e9a62872 for instance 8fdcb1b0-65e9-45d1-b0da-5f603f22a8cf on n-h2-854823-8 Oct 04 20:34:19.940689 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-0ec40f24-518d-49c7-abce-f31587ccaf83 req-52809c4d-bae4-402b-8750-91b33a13c93b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042969 Oct 04 20:34:19.941367 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 112/254] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:34:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:34:19.949723 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b1458ff7-1f1e-4c71-9993-4d99cde211d1 tempest-AggregatesAdminNegativeTestJSON-907895620 tempest-AggregatesAdminNegativeTestJSON-907895620-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-854823-8"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:34:19.961816 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b1458ff7-1f1e-4c71-9993-4d99cde211d1 tempest-AggregatesAdminNegativeTestJSON-907895620 tempest-AggregatesAdminNegativeTestJSON-907895620-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:19.962964 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b1458ff7-1f1e-4c71-9993-4d99cde211d1 tempest-AggregatesAdminNegativeTestJSON-907895620 tempest-AggregatesAdminNegativeTestJSON-907895620-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:19.963901 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b1458ff7-1f1e-4c71-9993-4d99cde211d1 tempest-AggregatesAdminNegativeTestJSON-907895620 tempest-AggregatesAdminNegativeTestJSON-907895620-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:19.991105 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-b1458ff7-1f1e-4c71-9993-4d99cde211d1 tempest-AggregatesAdminNegativeTestJSON-907895620 tempest-AggregatesAdminNegativeTestJSON-907895620-project-admin] HTTP exception thrown: Aggregate 9 already has host n-h1-854823-8. Oct 04 20:34:19.996777 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b1458ff7-1f1e-4c71-9993-4d99cde211d1 tempest-AggregatesAdminNegativeTestJSON-907895620 tempest-AggregatesAdminNegativeTestJSON-907895620-project-admin] Request method failure captured: Oct 04 20:34:19.996777 n-d-854823-8 devstack@n-api.service[128801]: request: POST /compute/v2.1/os-aggregates/9/action HTTP/1.1 Oct 04 20:34:19.996777 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:34:19.996777 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:34:19.996777 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:34:19.996777 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 39 Oct 04 20:34:19.996777 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:34:19.996777 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:34:19.996777 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:34:19.996777 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:34:19.996777 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJiYwmgLnmZgU1MzYFnwRkduF0U-oNQQTh3pjRStSZ2TluywlUp5tPEuivpXska-qjYpSX-0WyCvYvVlvkppZlUvlo9yw-bcYbzS3R42h8Kfj0P9UglK76WxuBJznfgBC57agfmcBJ_-FPYi5ShkHc6jTym94bNQMwWHqn1QPQSkNoM Oct 04 20:34:19.996777 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:34:19.996777 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:34:19.996777 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:34:19.996777 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:34:19.996777 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:34:19.996777 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:34:19.996777 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: b573d94f756e4a648a155cd95e012741 Oct 04 20:34:19.996777 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-907895620 Oct 04 20:34:19.996777 n-d-854823-8 devstack@n-api.service[128801]: X-Role: admin,reader,member Oct 04 20:34:19.996777 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: admin,reader,member Oct 04 20:34:19.997977 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b573d94f756e4a648a155cd95e012741", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b573d94f756e4a648a155cd95e012741"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b573d94f756e4a648a155cd95e012741"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b573d94f756e4a648a155cd95e012741"}]}] Oct 04 20:34:19.997977 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-907895620 Oct 04 20:34:19.997977 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: b573d94f756e4a648a155cd95e012741 Oct 04 20:34:19.997977 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-907895620 Oct 04 20:34:19.997977 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-AggregatesAdminNegativeTestJSON-907895620-project-admin Oct 04 20:34:19.997977 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:34:19.997977 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:34:19.997977 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: eefa1a3068aa4287a72e53272745aa2f Oct 04 20:34:19.997977 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-907895620-project-admin Oct 04 20:34:19.997977 n-d-854823-8 devstack@n-api.service[128801]: Oct 04 20:34:19.997977 n-d-854823-8 devstack@n-api.service[128801]: {"add_host": {"host": "n-h1-854823-8"}} Oct 04 20:34:19.997977 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 20:34:19.997977 n-d-854823-8 devstack@n-api.service[128801]: exception: Aggregate 9 already has host n-h1-854823-8. Oct 04 20:34:19.998814 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': '9', 'body': {'add_host': {'host': 'n-h1-854823-8'}}} Oct 04 20:34:19.998814 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:34:19.998814 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:34:19.998814 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 04 20:34:19.998814 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 04 20:34:19.998814 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 04 20:34:19.998814 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 04 20:34:19.998814 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 04 20:34:19.998814 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 04 20:34:19.998814 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 04 20:34:19.998814 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 04 20:34:19.998814 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 04 20:34:19.998814 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 04 20:34:19.998814 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 04 20:34:19.998814 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi result.read() Oct 04 20:34:19.998814 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 04 20:34:19.998814 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 04 20:34:19.998814 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 04 20:34:19.998814 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 04 20:34:19.999858 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 04 20:34:19.999858 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 04 20:34:19.999858 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 04 20:34:19.999858 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 04 20:34:19.999858 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'n-h1-854823-8-9' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Oct 04 20:34:19.999858 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:34:19.999858 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 04 20:34:19.999858 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:34:19.999858 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:34:19.999858 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 73, in _host_add_to_db Oct 04 20:34:19.999858 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi host_ref.save(context.session) Oct 04 20:34:19.999858 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Oct 04 20:34:19.999858 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi session.flush() Oct 04 20:34:19.999858 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 04 20:34:19.999858 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self._flush(objects) Oct 04 20:34:19.999858 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 04 20:34:19.999858 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Oct 04 20:34:19.999858 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 04 20:34:19.999858 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi compat.raise_( Oct 04 20:34:20.000850 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 04 20:34:20.000850 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception Oct 04 20:34:20.000850 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 04 20:34:20.000850 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi flush_context.execute() Oct 04 20:34:20.000850 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 04 20:34:20.000850 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi rec.execute(self) Oct 04 20:34:20.000850 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 04 20:34:20.000850 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Oct 04 20:34:20.000850 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 04 20:34:20.000850 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Oct 04 20:34:20.000850 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 04 20:34:20.000850 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Oct 04 20:34:20.000850 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 04 20:34:20.000850 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Oct 04 20:34:20.000850 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 04 20:34:20.000850 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Oct 04 20:34:20.000850 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 04 20:34:20.000850 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Oct 04 20:34:20.001757 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 04 20:34:20.001757 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Oct 04 20:34:20.001757 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 04 20:34:20.001757 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 04 20:34:20.001757 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 04 20:34:20.001757 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception Oct 04 20:34:20.001757 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 04 20:34:20.001757 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 04 20:34:20.001757 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 04 20:34:20.001757 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 04 20:34:20.001757 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 04 20:34:20.001757 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 04 20:34:20.001757 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 04 20:34:20.001757 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 04 20:34:20.001757 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 04 20:34:20.001757 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 04 20:34:20.001757 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 04 20:34:20.001757 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi result.read() Oct 04 20:34:20.004116 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 04 20:34:20.004116 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 04 20:34:20.004116 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 04 20:34:20.004116 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 04 20:34:20.004116 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 04 20:34:20.004116 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 04 20:34:20.004116 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 04 20:34:20.004116 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 04 20:34:20.004116 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'n-h1-854823-8-9' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Oct 04 20:34:20.004116 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO aggregate_hosts (created_at, updated_at, host, aggregate_id) VALUES (%(created_at)s, %(updated_at)s, %(host)s, %(aggregate_id)s)] Oct 04 20:34:20.004116 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 10, 4, 20, 34, 19, 981741), 'updated_at': None, 'host': 'n-h1-854823-8', 'aggregate_id': 9}] Oct 04 20:34:20.004116 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 04 20:34:20.004116 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:34:20.004116 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:34:20.004116 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:34:20.004116 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:34:20.004116 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Oct 04 20:34:20.006478 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Oct 04 20:34:20.006478 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 04 20:34:20.006478 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 04 20:34:20.006478 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 20:34:20.006478 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 20:34:20.006478 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 20:34:20.006478 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 20:34:20.006478 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 04 20:34:20.006478 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 04 20:34:20.006478 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6641, in add_host_to_aggregate Oct 04 20:34:20.006478 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi aggregate.add_host(host_name) Oct 04 20:34:20.006478 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 04 20:34:20.006478 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 04 20:34:20.006478 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 395, in add_host Oct 04 20:34:20.006478 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi _host_add_to_db(self._context, self.id, host) Oct 04 20:34:20.006478 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 76, in _host_add_to_db Oct 04 20:34:20.006478 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.AggregateHostExists(host=host, Oct 04 20:34:20.006478 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.AggregateHostExists: Aggregate 9 already has host n-h1-854823-8. Oct 04 20:34:20.006478 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:34:20.006478 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:34:20.011579 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:34:20.011579 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:34:20.011579 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:34:20.011579 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:34:20.011579 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:34:20.011579 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:34:20.011579 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:34:20.011579 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:34:20.011579 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:34:20.011579 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:34:20.011579 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 187, in _add_host Oct 04 20:34:20.011579 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Oct 04 20:34:20.011579 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate 9 already has host n-h1-854823-8. Oct 04 20:34:20.011579 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:34:20.011579 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:34:20.011579 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:34:20.011579 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:34:20.011579 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:34:20.011579 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:34:20.011579 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:34:20.011579 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:34:20.014745 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 9 already has host n-h1-854823-8. Oct 04 20:34:20.014745 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:34:20.014745 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b1458ff7-1f1e-4c71-9993-4d99cde211d1 tempest-AggregatesAdminNegativeTestJSON-907895620 tempest-AggregatesAdminNegativeTestJSON-907895620-project-admin] Returning 409 to user: Aggregate 9 already has host n-h1-854823-8. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:34:20.014745 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b1458ff7-1f1e-4c71-9993-4d99cde211d1 tempest-AggregatesAdminNegativeTestJSON-907895620 tempest-AggregatesAdminNegativeTestJSON-907895620-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates/9/action" status: 409 len: 95 microversion: 2.1 time: 0.055706 Oct 04 20:34:20.014745 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 113/255] 10.222.0.33 () {60 vars in 1191 bytes} [Tue Oct 4 20:34:19 2022] POST /compute/v2.1/os-aggregates/9/action => generated 95 bytes in 58 msecs (HTTP/1.1 409) 9 headers in 377 bytes (1 switches on core 0) Oct 04 20:34:20.014745 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7070f7ab-aab7-43a5-a72c-7ea94d2d3b63 tempest-AggregatesAdminTestJSON-1866202774 tempest-AggregatesAdminTestJSON-1866202774-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:20.020143 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-7070f7ab-aab7-43a5-a72c-7ea94d2d3b63 tempest-AggregatesAdminTestJSON-1866202774 tempest-AggregatesAdminTestJSON-1866202774-project-admin] 10.222.0.33 "GET /compute/v2.1/os-aggregates" status: 200 len: 568 microversion: 2.1 time: 0.018244 Oct 04 20:34:20.020769 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 114/256] 10.222.0.33 () {58 vars in 1143 bytes} [Tue Oct 4 20:34:20 2022] GET /compute/v2.1/os-aggregates => generated 568 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:34:20.029391 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-608c473e-fce2-4013-b1e5-4e4aeb82020a tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:20.030501 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-608c473e-fce2-4013-b1e5-4e4aeb82020a tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] [instance: 8fdcb1b0-65e9-45d1-b0da-5f603f22a8cf] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:20.039247 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-608c473e-fce2-4013-b1e5-4e4aeb82020a tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:20.039987 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-608c473e-fce2-4013-b1e5-4e4aeb82020a tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:20.040670 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-608c473e-fce2-4013-b1e5-4e4aeb82020a tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:20.041909 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-608c473e-fce2-4013-b1e5-4e4aeb82020a tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:20.042551 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-608c473e-fce2-4013-b1e5-4e4aeb82020a tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:20.043545 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-608c473e-fce2-4013-b1e5-4e4aeb82020a tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:20.171902 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-4a6aaf2a-daf1-4d7f-b676-39f91c7e539d tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3563efe2b8c94931a2a46c4e14811b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3118a5d96843d3bede1ed94bd9717e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:20.183944 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-4a6aaf2a-daf1-4d7f-b676-39f91c7e539d tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] 10.222.0.33 "GET /compute/v2.1/servers/9e9f6289-9999-4188-9af1-6cf64a676eee" status: 200 len: 1313 microversion: 2.1 time: 0.614069 Oct 04 20:34:20.184523 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 143/257] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:19 2022] GET /compute/v2.1/servers/9e9f6289-9999-4188-9af1-6cf64a676eee => generated 1313 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:20.189248 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-30f29bae-c27f-4101-a7c6-c622ac7728fe tempest-AggregatesAdminNegativeTestJSON-907895620 tempest-AggregatesAdminNegativeTestJSON-907895620-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-854823-8"}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:34:20.200859 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-30f29bae-c27f-4101-a7c6-c622ac7728fe tempest-AggregatesAdminNegativeTestJSON-907895620 tempest-AggregatesAdminNegativeTestJSON-907895620-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:20.201342 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-30f29bae-c27f-4101-a7c6-c622ac7728fe tempest-AggregatesAdminNegativeTestJSON-907895620 tempest-AggregatesAdminNegativeTestJSON-907895620-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:20.201786 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-30f29bae-c27f-4101-a7c6-c622ac7728fe tempest-AggregatesAdminNegativeTestJSON-907895620 tempest-AggregatesAdminNegativeTestJSON-907895620-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:20.343085 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-30f29bae-c27f-4101-a7c6-c622ac7728fe tempest-AggregatesAdminNegativeTestJSON-907895620 tempest-AggregatesAdminNegativeTestJSON-907895620-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 226 microversion: 2.1 time: 0.157154 Oct 04 20:34:20.347727 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 144/258] 10.222.0.33 () {60 vars in 1191 bytes} [Tue Oct 4 20:34:20 2022] POST /compute/v2.1/os-aggregates/9/action => generated 226 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:34:20.354994 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-e2316a6e-13ae-4466-a447-f4a74142ccd5 tempest-AggregatesAdminTestJSON-1866202774 tempest-AggregatesAdminTestJSON-1866202774-project-admin] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:20.391283 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-e2316a6e-13ae-4466-a447-f4a74142ccd5 tempest-AggregatesAdminTestJSON-1866202774 tempest-AggregatesAdminTestJSON-1866202774-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-aggregates/10" status: 200 len: 0 microversion: 2.1 time: 0.041558 Oct 04 20:34:20.392137 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 145/259] 10.222.0.33 () {58 vars in 1155 bytes} [Tue Oct 4 20:34:20 2022] DELETE /compute/v2.1/os-aggregates/10 => generated 0 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 04 20:34:20.398886 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-1163268a-2ef3-419e-90b7-ceaf79473200 tempest-AggregatesAdminNegativeTestJSON-907895620 tempest-AggregatesAdminNegativeTestJSON-907895620-project-admin] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:20.431849 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-1163268a-2ef3-419e-90b7-ceaf79473200 tempest-AggregatesAdminNegativeTestJSON-907895620 tempest-AggregatesAdminNegativeTestJSON-907895620-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-aggregates/9" status: 200 len: 0 microversion: 2.1 time: 0.037398 Oct 04 20:34:20.432820 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 146/260] 10.222.0.33 () {58 vars in 1152 bytes} [Tue Oct 4 20:34:20 2022] DELETE /compute/v2.1/os-aggregates/9 => generated 0 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 04 20:34:20.440319 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-3626b3eb-7ad8-4153-ad3b-1f69ac6fd5b3 tempest-AggregatesAdminTestJSON-1866202774 tempest-AggregatesAdminTestJSON-1866202774-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-586028776"}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:34:20.447416 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.objects.aggregate [None req-3626b3eb-7ad8-4153-ad3b-1f69ac6fd5b3 tempest-AggregatesAdminTestJSON-1866202774 tempest-AggregatesAdminTestJSON-1866202774-project-admin] Generated uuid 92176650-e3ec-42c2-9b91-84af72e9bda6 for aggregate {{(pid=128802) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 20:34:20.498376 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-3626b3eb-7ad8-4153-ad3b-1f69ac6fd5b3 tempest-AggregatesAdminTestJSON-1866202774 tempest-AggregatesAdminTestJSON-1866202774-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.061460 Oct 04 20:34:20.511969 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 147/261] 10.222.0.33 () {60 vars in 1164 bytes} [Tue Oct 4 20:34:20 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:34:20.536282 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-cc0e0eaf-6cb2-4589-8d01-e308e3f04f25 tempest-AggregatesAdminNegativeTestJSON-907895620 tempest-AggregatesAdminNegativeTestJSON-907895620-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-282632890"}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:34:20.554467 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-608c473e-fce2-4013-b1e5-4e4aeb82020a tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5eda279f6034608b192839a54dda616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f28e80977de42a892b84295ecf05141', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:20.559566 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.objects.aggregate [None req-cc0e0eaf-6cb2-4589-8d01-e308e3f04f25 tempest-AggregatesAdminNegativeTestJSON-907895620 tempest-AggregatesAdminNegativeTestJSON-907895620-project-admin] Generated uuid ad6884cf-8ac5-48b4-a263-0e26c89396ac for aggregate {{(pid=128802) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 20:34:20.567857 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-608c473e-fce2-4013-b1e5-4e4aeb82020a tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] 10.222.0.33 "GET /compute/v2.1/servers/8fdcb1b0-65e9-45d1-b0da-5f603f22a8cf" status: 200 len: 1388 microversion: 2.1 time: 0.544716 Oct 04 20:34:20.568675 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 115/262] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:20 2022] GET /compute/v2.1/servers/8fdcb1b0-65e9-45d1-b0da-5f603f22a8cf => generated 1388 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:20.586115 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6e8e427f-fde9-4a25-80cb-08b8ffe12414 tempest-AggregatesAdminTestJSON-1866202774 tempest-AggregatesAdminTestJSON-1866202774-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:20.590094 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-cc0e0eaf-6cb2-4589-8d01-e308e3f04f25 tempest-AggregatesAdminNegativeTestJSON-907895620 tempest-AggregatesAdminNegativeTestJSON-907895620-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.065046 Oct 04 20:34:20.591466 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 148/263] 10.222.0.33 () {60 vars in 1164 bytes} [Tue Oct 4 20:34:20 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:34:20.600802 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-6e8e427f-fde9-4a25-80cb-08b8ffe12414 tempest-AggregatesAdminTestJSON-1866202774 tempest-AggregatesAdminTestJSON-1866202774-project-admin] 10.222.0.33 "GET /compute/v2.1/os-aggregates" status: 200 len: 444 microversion: 2.1 time: 0.030546 Oct 04 20:34:20.601377 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 116/264] 10.222.0.33 () {58 vars in 1143 bytes} [Tue Oct 4 20:34:20 2022] GET /compute/v2.1/os-aggregates => generated 444 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:34:20.613766 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-054be979-e733-4c06-a344-94abfdbe18e0 tempest-AggregatesAdminTestJSON-1866202774 tempest-AggregatesAdminTestJSON-1866202774-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:20.643881 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-054be979-e733-4c06-a344-94abfdbe18e0 tempest-AggregatesAdminTestJSON-1866202774 tempest-AggregatesAdminTestJSON-1866202774-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-aggregates/11" status: 200 len: 0 microversion: 2.1 time: 0.033901 Oct 04 20:34:20.644465 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 117/265] 10.222.0.33 () {58 vars in 1155 bytes} [Tue Oct 4 20:34:20 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 0 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 04 20:34:20.654054 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f1bcddbd-335e-43fd-8c71-b7ed0b470111 tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:20.655836 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f1bcddbd-335e-43fd-8c71-b7ed0b470111 tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] [instance: f2ad1271-aaba-4fe4-8f6c-854cf8e80bb7] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:20.664870 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f1bcddbd-335e-43fd-8c71-b7ed0b470111 tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:20.665894 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f1bcddbd-335e-43fd-8c71-b7ed0b470111 tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:20.666328 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f1bcddbd-335e-43fd-8c71-b7ed0b470111 tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:20.667240 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f1bcddbd-335e-43fd-8c71-b7ed0b470111 tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:20.667705 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f1bcddbd-335e-43fd-8c71-b7ed0b470111 tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:20.668179 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f1bcddbd-335e-43fd-8c71-b7ed0b470111 tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:20.685236 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-f1bcddbd-335e-43fd-8c71-b7ed0b470111 tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] HTTP exception thrown: Instance f2ad1271-aaba-4fe4-8f6c-854cf8e80bb7 could not be found. Oct 04 20:34:20.687038 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f1bcddbd-335e-43fd-8c71-b7ed0b470111 tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Request method failure captured: Oct 04 20:34:20.687038 n-d-854823-8 devstack@n-api.service[128801]: request: DELETE /compute/v2.1/servers/f2ad1271-aaba-4fe4-8f6c-854cf8e80bb7 HTTP/1.1 Oct 04 20:34:20.687038 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:34:20.687038 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:34:20.687038 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:34:20.687038 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 0 Oct 04 20:34:20.687038 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:34:20.687038 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:34:20.687038 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:34:20.687038 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:34:20.687038 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJiTI8NBJwMHrgTAmlSfih33cdUd4OzyA-qww4slwI32MPD7j_fe4ns2owG7GR75U1C2uV81NzQvldg60AxfZ62zFHP4veM5kh2eaAyIHXAx-wIK1qnZ3Vn1VE6HF73mGNvILrNiVih26mSNYCQS6T_6JEDA_iPHvjak8QpWKSpU6As Oct 04 20:34:20.687038 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:34:20.687038 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:34:20.687038 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:34:20.687038 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:34:20.687038 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:34:20.687038 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:34:20.687038 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: 930b67acdd8f4d4ea2acf80bb5b28059 Oct 04 20:34:20.687038 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-AggregatesAdminTestJSON-527956270 Oct 04 20:34:20.687038 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 20:34:20.687038 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 20:34:20.688178 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_930b67acdd8f4d4ea2acf80bb5b28059", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/930b67acdd8f4d4ea2acf80bb5b28059"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/930b67acdd8f4d4ea2acf80bb5b28059"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/930b67acdd8f4d4ea2acf80bb5b28059"}]}] Oct 04 20:34:20.688178 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-AggregatesAdminTestJSON-527956270 Oct 04 20:34:20.688178 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: 930b67acdd8f4d4ea2acf80bb5b28059 Oct 04 20:34:20.688178 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-527956270 Oct 04 20:34:20.688178 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-AggregatesAdminTestJSON-527956270-project Oct 04 20:34:20.688178 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:34:20.688178 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:34:20.688178 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: 24987e1b118a41169a1974dc40568156 Oct 04 20:34:20.688178 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-AggregatesAdminTestJSON-527956270-project Oct 04 20:34:20.688178 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 20:34:20.688178 n-d-854823-8 devstack@n-api.service[128801]: exception: Instance f2ad1271-aaba-4fe4-8f6c-854cf8e80bb7 could not be found. Oct 04 20:34:20.688178 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': 'f2ad1271-aaba-4fe4-8f6c-854cf8e80bb7'} Oct 04 20:34:20.688836 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:34:20.688836 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:34:20.688836 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:34:20.688836 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:34:20.688836 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:34:20.688836 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:34:20.688836 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:34:20.688836 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:34:20.688836 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:34:20.688836 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:34:20.688836 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2ad1271-aaba-4fe4-8f6c-854cf8e80bb7 could not be found. Oct 04 20:34:20.688836 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:34:20.688836 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:34:20.688836 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:34:20.688836 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:34:20.688836 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:34:20.688836 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:34:20.688836 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:34:20.688836 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:34:20.688836 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:34:20.689922 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:34:20.689922 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 20:34:20.689922 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 20:34:20.689922 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 20:34:20.689922 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 20:34:20.689922 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:34:20.689922 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:34:20.689922 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:34:20.689922 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:34:20.689922 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2ad1271-aaba-4fe4-8f6c-854cf8e80bb7 could not be found. Oct 04 20:34:20.689922 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:34:20.689922 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:34:20.689922 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:34:20.689922 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:34:20.689922 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:34:20.689922 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:34:20.689922 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:34:20.689922 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:34:20.689922 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2ad1271-aaba-4fe4-8f6c-854cf8e80bb7 could not be found. Oct 04 20:34:20.689922 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:34:20.691033 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f1bcddbd-335e-43fd-8c71-b7ed0b470111 tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Returning 404 to user: Instance f2ad1271-aaba-4fe4-8f6c-854cf8e80bb7 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:34:20.691033 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f1bcddbd-335e-43fd-8c71-b7ed0b470111 tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] 10.222.0.33 "DELETE /compute/v2.1/servers/f2ad1271-aaba-4fe4-8f6c-854cf8e80bb7" status: 404 len: 111 microversion: 2.1 time: 0.039091 Oct 04 20:34:20.692289 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 118/266] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 20:34:20 2022] DELETE /compute/v2.1/servers/f2ad1271-aaba-4fe4-8f6c-854cf8e80bb7 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:34:20.698819 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2c490aab-9c4a-4b11-a676-d35489801ef0 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:20.700119 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-2c490aab-9c4a-4b11-a676-d35489801ef0 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] [instance: 854066a9-9adf-4932-b6a8-c7fe15d8b4da] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:20.707475 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2c490aab-9c4a-4b11-a676-d35489801ef0 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:20.708197 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2c490aab-9c4a-4b11-a676-d35489801ef0 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:20.708836 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2c490aab-9c4a-4b11-a676-d35489801ef0 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:20.709707 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2c490aab-9c4a-4b11-a676-d35489801ef0 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:20.710577 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2c490aab-9c4a-4b11-a676-d35489801ef0 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:20.711466 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2c490aab-9c4a-4b11-a676-d35489801ef0 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:21.037068 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-723af226-a3c3-4a6b-9b4b-0012cfc7136e tempest-AggregatesAdminNegativeTestJSON-1603334861 tempest-AggregatesAdminNegativeTestJSON-1603334861-project] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-854823-8"}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:34:21.045651 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-723af226-a3c3-4a6b-9b4b-0012cfc7136e tempest-AggregatesAdminNegativeTestJSON-1603334861 tempest-AggregatesAdminNegativeTestJSON-1603334861-project] Policy check for os_compute_api:os-aggregates:add_host failed with credentials {'is_admin': False, 'user_id': '7f89d73547d743d098c9706777f4c4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0851ce7156234ec58401aad2babd6c5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:21.053653 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-723af226-a3c3-4a6b-9b4b-0012cfc7136e tempest-AggregatesAdminNegativeTestJSON-1603334861 tempest-AggregatesAdminNegativeTestJSON-1603334861-project] Request method failure captured: Oct 04 20:34:21.053653 n-d-854823-8 devstack@n-api.service[128802]: request: POST /compute/v2.1/os-aggregates/12/action HTTP/1.1 Oct 04 20:34:21.053653 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 20:34:21.053653 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 20:34:21.053653 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 20:34:21.053653 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 39 Oct 04 20:34:21.053653 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 20:34:21.053653 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 20:34:21.053653 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 20:34:21.053653 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 20:34:21.053653 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPJiVsViKjm23lrr4RtOtlmQLcsjihWr7qoJs7BOswvmzhIQDKomlsCdi-pG_XZZFkw-owWG9CediBb8OYe_sGzP6u7Ji-8uLf5mstoELjwXdu030sZ6v7ua0toFlXT7CBvyO0W3G0ZBAq228k-ksP32pvo1fnMGkgKUUFNLTDI0kZmI Oct 04 20:34:21.053653 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 20:34:21.053653 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 20:34:21.053653 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 20:34:21.053653 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 20:34:21.053653 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 20:34:21.053653 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 20:34:21.053653 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: 0851ce7156234ec58401aad2babd6c5f Oct 04 20:34:21.053653 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1603334861 Oct 04 20:34:21.053653 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 20:34:21.053653 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 20:34:21.055032 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0851ce7156234ec58401aad2babd6c5f", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0851ce7156234ec58401aad2babd6c5f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0851ce7156234ec58401aad2babd6c5f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0851ce7156234ec58401aad2babd6c5f"}]}] Oct 04 20:34:21.055032 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1603334861 Oct 04 20:34:21.055032 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: 0851ce7156234ec58401aad2babd6c5f Oct 04 20:34:21.055032 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1603334861 Oct 04 20:34:21.055032 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-AggregatesAdminNegativeTestJSON-1603334861-project Oct 04 20:34:21.055032 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 20:34:21.055032 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 20:34:21.055032 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: 7f89d73547d743d098c9706777f4c4f2 Oct 04 20:34:21.055032 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1603334861-project Oct 04 20:34:21.055032 n-d-854823-8 devstack@n-api.service[128802]: Oct 04 20:34:21.055032 n-d-854823-8 devstack@n-api.service[128802]: {"add_host": {"host": "n-h1-854823-8"}} Oct 04 20:34:21.055032 n-d-854823-8 devstack@n-api.service[128802]: method: > Oct 04 20:34:21.055032 n-d-854823-8 devstack@n-api.service[128802]: exception: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Oct 04 20:34:21.055825 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'id': '12', 'body': {'add_host': {'host': 'n-h1-854823-8'}}} Oct 04 20:34:21.055825 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:34:21.055825 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:34:21.055825 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:34:21.055825 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:34:21.055825 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:34:21.055825 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:34:21.055825 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:34:21.055825 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:34:21.055825 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:34:21.055825 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:34:21.055825 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 172, in _add_host Oct 04 20:34:21.055825 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'add_host', target={}) Oct 04 20:34:21.055825 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 20:34:21.055825 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 20:34:21.055825 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 20:34:21.055825 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 20:34:21.055825 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 20:34:21.055825 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 20:34:21.057557 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 20:34:21.057557 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 20:34:21.057557 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 20:34:21.057557 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 20:34:21.057557 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 20:34:21.057557 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 20:34:21.057557 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 20:34:21.057557 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 20:34:21.057557 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Oct 04 20:34:21.057557 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:34:21.057557 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:34:21.057557 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:34:21.057557 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:34:21.057557 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:34:21.057557 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:34:21.057557 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 20:34:21.057557 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 20:34:21.057557 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Oct 04 20:34:21.057557 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:34:21.061488 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-723af226-a3c3-4a6b-9b4b-0012cfc7136e tempest-AggregatesAdminNegativeTestJSON-1603334861 tempest-AggregatesAdminNegativeTestJSON-1603334861-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:34:21.063731 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-723af226-a3c3-4a6b-9b4b-0012cfc7136e tempest-AggregatesAdminNegativeTestJSON-1603334861 tempest-AggregatesAdminNegativeTestJSON-1603334861-project] 10.222.0.33 "POST /compute/v2.1/os-aggregates/12/action" status: 403 len: 118 microversion: 2.1 time: 0.464294 Oct 04 20:34:21.065151 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 149/267] 10.222.0.33 () {60 vars in 1194 bytes} [Tue Oct 4 20:34:20 2022] POST /compute/v2.1/os-aggregates/12/action => generated 118 bytes in 466 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:34:21.073366 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-08827d4d-b39d-4c72-acd0-54f316833a52 tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:21.074137 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-08827d4d-b39d-4c72-acd0-54f316833a52 tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] [instance: f2ad1271-aaba-4fe4-8f6c-854cf8e80bb7] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:21.083636 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-08827d4d-b39d-4c72-acd0-54f316833a52 tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:21.083636 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-08827d4d-b39d-4c72-acd0-54f316833a52 tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:21.084222 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-08827d4d-b39d-4c72-acd0-54f316833a52 tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:21.085109 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-08827d4d-b39d-4c72-acd0-54f316833a52 tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:21.085802 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-08827d4d-b39d-4c72-acd0-54f316833a52 tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:21.086629 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-08827d4d-b39d-4c72-acd0-54f316833a52 tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:21.106465 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.wsgi [None req-08827d4d-b39d-4c72-acd0-54f316833a52 tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] HTTP exception thrown: Instance f2ad1271-aaba-4fe4-8f6c-854cf8e80bb7 could not be found. Oct 04 20:34:21.109508 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-08827d4d-b39d-4c72-acd0-54f316833a52 tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Request method failure captured: Oct 04 20:34:21.109508 n-d-854823-8 devstack@n-api.service[128802]: request: GET /compute/v2.1/servers/f2ad1271-aaba-4fe4-8f6c-854cf8e80bb7 HTTP/1.1 Oct 04 20:34:21.109508 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 20:34:21.109508 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 20:34:21.109508 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 20:34:21.109508 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 0 Oct 04 20:34:21.109508 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 20:34:21.109508 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 20:34:21.109508 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 20:34:21.109508 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 20:34:21.109508 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPJiTI8NBJwMHrgTAmlSfih33cdUd4OzyA-qww4slwI32MPD7j_fe4ns2owG7GR75U1C2uV81NzQvldg60AxfZ62zFHP4veM5kh2eaAyIHXAx-wIK1qnZ3Vn1VE6HF73mGNvILrNiVih26mSNYCQS6T_6JEDA_iPHvjak8QpWKSpU6As Oct 04 20:34:21.109508 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 20:34:21.109508 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 20:34:21.109508 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 20:34:21.109508 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 20:34:21.109508 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 20:34:21.109508 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 20:34:21.109508 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: 930b67acdd8f4d4ea2acf80bb5b28059 Oct 04 20:34:21.109508 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-AggregatesAdminTestJSON-527956270 Oct 04 20:34:21.109508 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 20:34:21.109508 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 20:34:21.110898 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_930b67acdd8f4d4ea2acf80bb5b28059", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/930b67acdd8f4d4ea2acf80bb5b28059"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/930b67acdd8f4d4ea2acf80bb5b28059"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/930b67acdd8f4d4ea2acf80bb5b28059"}]}] Oct 04 20:34:21.110898 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-AggregatesAdminTestJSON-527956270 Oct 04 20:34:21.110898 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: 930b67acdd8f4d4ea2acf80bb5b28059 Oct 04 20:34:21.110898 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-527956270 Oct 04 20:34:21.110898 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-AggregatesAdminTestJSON-527956270-project Oct 04 20:34:21.110898 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 20:34:21.110898 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 20:34:21.110898 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: 24987e1b118a41169a1974dc40568156 Oct 04 20:34:21.110898 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-AggregatesAdminTestJSON-527956270-project Oct 04 20:34:21.110898 n-d-854823-8 devstack@n-api.service[128802]: method: > Oct 04 20:34:21.110898 n-d-854823-8 devstack@n-api.service[128802]: exception: Instance f2ad1271-aaba-4fe4-8f6c-854cf8e80bb7 could not be found. Oct 04 20:34:21.110898 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'id': 'f2ad1271-aaba-4fe4-8f6c-854cf8e80bb7'} Oct 04 20:34:21.111668 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:34:21.111668 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:34:21.111668 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:34:21.111668 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:34:21.111668 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:34:21.111668 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:34:21.111668 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:34:21.111668 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:34:21.111668 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:34:21.111668 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:34:21.111668 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2ad1271-aaba-4fe4-8f6c-854cf8e80bb7 could not be found. Oct 04 20:34:21.111668 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:34:21.111668 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:34:21.111668 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:34:21.111668 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:34:21.111668 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:34:21.111668 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:34:21.111668 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:34:21.111668 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:34:21.111668 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:34:21.112878 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:34:21.112878 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:34:21.112878 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:34:21.112878 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:34:21.112878 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:34:21.112878 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:34:21.112878 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:34:21.112878 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2ad1271-aaba-4fe4-8f6c-854cf8e80bb7 could not be found. Oct 04 20:34:21.112878 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:34:21.112878 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:34:21.112878 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:34:21.112878 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:34:21.112878 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:34:21.112878 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:34:21.112878 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:34:21.112878 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:34:21.112878 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2ad1271-aaba-4fe4-8f6c-854cf8e80bb7 could not be found. Oct 04 20:34:21.112878 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:34:21.115128 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-08827d4d-b39d-4c72-acd0-54f316833a52 tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] Returning 404 to user: Instance f2ad1271-aaba-4fe4-8f6c-854cf8e80bb7 could not be found. {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:34:21.116393 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-08827d4d-b39d-4c72-acd0-54f316833a52 tempest-AggregatesAdminTestJSON-527956270 tempest-AggregatesAdminTestJSON-527956270-project] 10.222.0.33 "GET /compute/v2.1/servers/f2ad1271-aaba-4fe4-8f6c-854cf8e80bb7" status: 404 len: 111 microversion: 2.1 time: 0.049058 Oct 04 20:34:21.118077 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 150/268] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:21 2022] GET /compute/v2.1/servers/f2ad1271-aaba-4fe4-8f6c-854cf8e80bb7 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:34:21.124697 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-3f0ad0de-49f6-4c9b-a280-705e93571a91 tempest-AggregatesAdminNegativeTestJSON-907895620 tempest-AggregatesAdminNegativeTestJSON-907895620-project-admin] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:21.135275 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-2c490aab-9c4a-4b11-a676-d35489801ef0 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '147d000a331f4a3ba47019fcbae40901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9928be759e34d208d835263d73a5ab5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:21.145531 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-2c490aab-9c4a-4b11-a676-d35489801ef0 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] 10.222.0.33 "GET /compute/v2.1/servers/854066a9-9adf-4932-b6a8-c7fe15d8b4da" status: 200 len: 1321 microversion: 2.1 time: 0.452003 Oct 04 20:34:21.146140 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 119/269] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:20 2022] GET /compute/v2.1/servers/854066a9-9adf-4932-b6a8-c7fe15d8b4da => generated 1321 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:21.158825 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-3f0ad0de-49f6-4c9b-a280-705e93571a91 tempest-AggregatesAdminNegativeTestJSON-907895620 tempest-AggregatesAdminNegativeTestJSON-907895620-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-aggregates/12" status: 200 len: 0 microversion: 2.1 time: 0.038374 Oct 04 20:34:21.159649 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 151/270] 10.222.0.33 () {58 vars in 1155 bytes} [Tue Oct 4 20:34:21 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 0 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 04 20:34:21.170183 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-80ce9fff-88c6-4c0d-92bd-612908b8ece5 tempest-AggregatesAdminNegativeTestJSON-907895620 tempest-AggregatesAdminNegativeTestJSON-907895620-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-333719672"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:34:21.173894 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.objects.aggregate [None req-80ce9fff-88c6-4c0d-92bd-612908b8ece5 tempest-AggregatesAdminNegativeTestJSON-907895620 tempest-AggregatesAdminNegativeTestJSON-907895620-project-admin] Generated uuid bcea5780-bda2-4abb-baa4-4fcf710e023e for aggregate {{(pid=128801) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 20:34:21.203833 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-80ce9fff-88c6-4c0d-92bd-612908b8ece5 tempest-AggregatesAdminNegativeTestJSON-907895620 tempest-AggregatesAdminNegativeTestJSON-907895620-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.038518 Oct 04 20:34:21.211938 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-2d8e0567-fbfb-462a-92f7-dbcb38e54fcc tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:21.212164 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 120/271] 10.222.0.33 () {60 vars in 1164 bytes} [Tue Oct 4 20:34:21 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:34:21.212333 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-2d8e0567-fbfb-462a-92f7-dbcb38e54fcc tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] [instance: 9e9f6289-9999-4188-9af1-6cf64a676eee] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:21.219009 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2d8e0567-fbfb-462a-92f7-dbcb38e54fcc tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:21.220076 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c0faf00e-8fd0-4760-a720-9fb5e2c7f9c3 tempest-AggregatesAdminNegativeTestJSON-907895620 tempest-AggregatesAdminNegativeTestJSON-907895620-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "tempest-nonexist_host-2033804020"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:34:21.220253 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2d8e0567-fbfb-462a-92f7-dbcb38e54fcc tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:21.221009 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2d8e0567-fbfb-462a-92f7-dbcb38e54fcc tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:21.222081 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2d8e0567-fbfb-462a-92f7-dbcb38e54fcc tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:21.222744 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2d8e0567-fbfb-462a-92f7-dbcb38e54fcc tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:21.224009 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2d8e0567-fbfb-462a-92f7-dbcb38e54fcc tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:21.233035 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c0faf00e-8fd0-4760-a720-9fb5e2c7f9c3 tempest-AggregatesAdminNegativeTestJSON-907895620 tempest-AggregatesAdminNegativeTestJSON-907895620-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:21.233524 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c0faf00e-8fd0-4760-a720-9fb5e2c7f9c3 tempest-AggregatesAdminNegativeTestJSON-907895620 tempest-AggregatesAdminNegativeTestJSON-907895620-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:21.234120 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c0faf00e-8fd0-4760-a720-9fb5e2c7f9c3 tempest-AggregatesAdminNegativeTestJSON-907895620 tempest-AggregatesAdminNegativeTestJSON-907895620-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:21.242212 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c0faf00e-8fd0-4760-a720-9fb5e2c7f9c3 tempest-AggregatesAdminNegativeTestJSON-907895620 tempest-AggregatesAdminNegativeTestJSON-907895620-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:21.242713 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c0faf00e-8fd0-4760-a720-9fb5e2c7f9c3 tempest-AggregatesAdminNegativeTestJSON-907895620 tempest-AggregatesAdminNegativeTestJSON-907895620-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:21.243155 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c0faf00e-8fd0-4760-a720-9fb5e2c7f9c3 tempest-AggregatesAdminNegativeTestJSON-907895620 tempest-AggregatesAdminNegativeTestJSON-907895620-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:21.252058 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-c0faf00e-8fd0-4760-a720-9fb5e2c7f9c3 tempest-AggregatesAdminNegativeTestJSON-907895620 tempest-AggregatesAdminNegativeTestJSON-907895620-project-admin] HTTP exception thrown: Compute host tempest-nonexist_host-2033804020 could not be found. Oct 04 20:34:21.255575 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c0faf00e-8fd0-4760-a720-9fb5e2c7f9c3 tempest-AggregatesAdminNegativeTestJSON-907895620 tempest-AggregatesAdminNegativeTestJSON-907895620-project-admin] Request method failure captured: Oct 04 20:34:21.255575 n-d-854823-8 devstack@n-api.service[128801]: request: POST /compute/v2.1/os-aggregates/13/action HTTP/1.1 Oct 04 20:34:21.255575 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:34:21.255575 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:34:21.255575 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:34:21.255575 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 58 Oct 04 20:34:21.255575 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:34:21.255575 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:34:21.255575 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:34:21.255575 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:34:21.255575 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJiYwmgLnmZgU1MzYFnwRkduF0U-oNQQTh3pjRStSZ2TluywlUp5tPEuivpXska-qjYpSX-0WyCvYvVlvkppZlUvlo9yw-bcYbzS3R42h8Kfj0P9UglK76WxuBJznfgBC57agfmcBJ_-FPYi5ShkHc6jTym94bNQMwWHqn1QPQSkNoM Oct 04 20:34:21.255575 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:34:21.255575 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:34:21.255575 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:34:21.255575 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:34:21.255575 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:34:21.255575 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:34:21.255575 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: b573d94f756e4a648a155cd95e012741 Oct 04 20:34:21.255575 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-907895620 Oct 04 20:34:21.255575 n-d-854823-8 devstack@n-api.service[128801]: X-Role: admin,reader,member Oct 04 20:34:21.255575 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: admin,reader,member Oct 04 20:34:21.256963 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b573d94f756e4a648a155cd95e012741", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b573d94f756e4a648a155cd95e012741"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b573d94f756e4a648a155cd95e012741"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b573d94f756e4a648a155cd95e012741"}]}] Oct 04 20:34:21.256963 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-907895620 Oct 04 20:34:21.256963 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: b573d94f756e4a648a155cd95e012741 Oct 04 20:34:21.256963 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-907895620 Oct 04 20:34:21.256963 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-AggregatesAdminNegativeTestJSON-907895620-project-admin Oct 04 20:34:21.256963 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:34:21.256963 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:34:21.256963 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: eefa1a3068aa4287a72e53272745aa2f Oct 04 20:34:21.256963 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-907895620-project-admin Oct 04 20:34:21.256963 n-d-854823-8 devstack@n-api.service[128801]: Oct 04 20:34:21.256963 n-d-854823-8 devstack@n-api.service[128801]: {"add_host": {"host": "tempest-nonexist_host-2033804020"}} Oct 04 20:34:21.256963 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 20:34:21.256963 n-d-854823-8 devstack@n-api.service[128801]: exception: Compute host tempest-nonexist_host-2033804020 could not be found. Oct 04 20:34:21.257777 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': '13', 'body': {'add_host': {'host': 'tempest-nonexist_host-2033804020'}}} Oct 04 20:34:21.257777 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:34:21.257777 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:34:21.257777 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5999, in _get_service_in_cell_by_host Oct 04 20:34:21.257777 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Oct 04 20:34:21.257777 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 20:34:21.257777 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 20:34:21.257777 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 04 20:34:21.257777 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 04 20:34:21.257777 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 20:34:21.257777 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 20:34:21.257777 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 04 20:34:21.257777 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 04 20:34:21.257777 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'tempest-nonexist_host-2033804020' is not mapped to any cell Oct 04 20:34:21.257777 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:34:21.257777 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:34:21.257777 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:34:21.257777 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:34:21.257777 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6005, in _get_service_in_cell_by_host Oct 04 20:34:21.259717 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Oct 04 20:34:21.259717 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 04 20:34:21.259717 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 04 20:34:21.259717 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 04 20:34:21.259717 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:34:21.259717 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:34:21.259717 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:34:21.259717 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:34:21.259717 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Oct 04 20:34:21.259717 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Oct 04 20:34:21.259717 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 04 20:34:21.259717 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 04 20:34:21.259717 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 20:34:21.259717 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 20:34:21.259717 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 20:34:21.259717 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 20:34:21.259717 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 04 20:34:21.259717 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 04 20:34:21.259717 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6621, in add_host_to_aggregate Oct 04 20:34:21.259717 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi service = _get_service_in_cell_by_host(context, host_name) Oct 04 20:34:21.261624 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6007, in _get_service_in_cell_by_host Oct 04 20:34:21.261624 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Oct 04 20:34:21.261624 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-nonexist_host-2033804020 could not be found. Oct 04 20:34:21.261624 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:34:21.261624 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:34:21.261624 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:34:21.261624 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:34:21.261624 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:34:21.261624 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:34:21.261624 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:34:21.261624 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:34:21.261624 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:34:21.261624 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:34:21.261624 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:34:21.261624 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:34:21.261624 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 184, in _add_host Oct 04 20:34:21.261624 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:34:21.261624 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Compute host tempest-nonexist_host-2033804020 could not be found. Oct 04 20:34:21.261624 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:34:21.261624 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:34:21.261624 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:34:21.262962 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:34:21.262962 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:34:21.262962 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:34:21.262962 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:34:21.262962 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:34:21.262962 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-nonexist_host-2033804020 could not be found. Oct 04 20:34:21.262962 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:34:21.262962 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c0faf00e-8fd0-4760-a720-9fb5e2c7f9c3 tempest-AggregatesAdminNegativeTestJSON-907895620 tempest-AggregatesAdminNegativeTestJSON-907895620-project-admin] Returning 404 to user: Compute host tempest-nonexist_host-2033804020 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:34:21.262962 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c0faf00e-8fd0-4760-a720-9fb5e2c7f9c3 tempest-AggregatesAdminNegativeTestJSON-907895620 tempest-AggregatesAdminNegativeTestJSON-907895620-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates/13/action" status: 404 len: 111 microversion: 2.1 time: 0.042455 Oct 04 20:34:21.262962 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 121/272] 10.222.0.33 () {60 vars in 1194 bytes} [Tue Oct 4 20:34:21 2022] POST /compute/v2.1/os-aggregates/13/action => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 20:34:21.266040 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-80a9325d-0f5a-4500-9f59-9a56ae560e1e tempest-AggregatesAdminNegativeTestJSON-907895620 tempest-AggregatesAdminNegativeTestJSON-907895620-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:21.290964 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-80a9325d-0f5a-4500-9f59-9a56ae560e1e tempest-AggregatesAdminNegativeTestJSON-907895620 tempest-AggregatesAdminNegativeTestJSON-907895620-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-aggregates/13" status: 200 len: 0 microversion: 2.1 time: 0.027670 Oct 04 20:34:21.292305 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 122/273] 10.222.0.33 () {58 vars in 1155 bytes} [Tue Oct 4 20:34:21 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 0 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 04 20:34:21.302922 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f2a7593b-5585-467b-9ce0-bb7d1fbc42a2 tempest-AggregatesAdminNegativeTestJSON-907895620 tempest-AggregatesAdminNegativeTestJSON-907895620-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:34:21.324891 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f2a7593b-5585-467b-9ce0-bb7d1fbc42a2 tempest-AggregatesAdminNegativeTestJSON-907895620 tempest-AggregatesAdminNegativeTestJSON-907895620-project-admin] Request method failure captured: Oct 04 20:34:21.324891 n-d-854823-8 devstack@n-api.service[128801]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 04 20:34:21.324891 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:34:21.324891 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:34:21.324891 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:34:21.324891 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 283 Oct 04 20:34:21.324891 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:34:21.324891 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:34:21.324891 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:34:21.324891 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:34:21.324891 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJiYwmgLnmZgU1MzYFnwRkduF0U-oNQQTh3pjRStSZ2TluywlUp5tPEuivpXska-qjYpSX-0WyCvYvVlvkppZlUvlo9yw-bcYbzS3R42h8Kfj0P9UglK76WxuBJznfgBC57agfmcBJ_-FPYi5ShkHc6jTym94bNQMwWHqn1QPQSkNoM Oct 04 20:34:21.324891 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:34:21.324891 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:34:21.324891 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:34:21.324891 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:34:21.324891 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:34:21.324891 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:34:21.324891 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: b573d94f756e4a648a155cd95e012741 Oct 04 20:34:21.324891 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-907895620 Oct 04 20:34:21.324891 n-d-854823-8 devstack@n-api.service[128801]: X-Role: admin,reader,member Oct 04 20:34:21.324891 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: admin,reader,member Oct 04 20:34:21.326251 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b573d94f756e4a648a155cd95e012741", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b573d94f756e4a648a155cd95e012741"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b573d94f756e4a648a155cd95e012741"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b573d94f756e4a648a155cd95e012741"}]}] Oct 04 20:34:21.326251 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-907895620 Oct 04 20:34:21.326251 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: b573d94f756e4a648a155cd95e012741 Oct 04 20:34:21.326251 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-907895620 Oct 04 20:34:21.326251 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-AggregatesAdminNegativeTestJSON-907895620-project-admin Oct 04 20:34:21.326251 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:34:21.326251 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:34:21.326251 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: eefa1a3068aa4287a72e53272745aa2f Oct 04 20:34:21.326251 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-907895620-project-admin Oct 04 20:34:21.326251 n-d-854823-8 devstack@n-api.service[128801]: Oct 04 20:34:21.326882 n-d-854823-8 devstack@n-api.service[128801]: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Oct 04 20:34:21.326882 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 20:34:21.326882 n-d-854823-8 devstack@n-api.service[128801]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 04 20:34:21.326882 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'body': {'aggregate': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Oct 04 20:34:21.326882 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:34:21.326882 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:34:21.326882 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 20:34:21.326882 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 20:34:21.326882 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 20:34:21.326882 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise error Oct 04 20:34:21.327597 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 04 20:34:21.327597 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:34:21.327597 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['aggregate']['properties']['name']: Oct 04 20:34:21.327597 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 04 20:34:21.327597 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:34:21.327597 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Oct 04 20:34:21.327597 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 04 20:34:21.327597 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:34:21.327597 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:34:21.327597 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:34:21.327597 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:34:21.327597 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:34:21.327597 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:34:21.327597 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:34:21.327597 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:34:21.327597 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:34:21.327597 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:34:21.328584 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:34:21.328584 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:34:21.328584 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 20:34:21.328584 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 20:34:21.328584 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 20:34:21.328584 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 20:34:21.328584 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 20:34:21.328584 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 20:34:21.328584 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 04 20:34:21.328584 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:34:21.328584 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:34:21.328584 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:34:21.328584 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:34:21.328584 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:34:21.328584 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:34:21.329484 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 20:34:21.329484 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 20:34:21.329484 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 04 20:34:21.329484 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:34:21.331254 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f2a7593b-5585-467b-9ce0-bb7d1fbc42a2 tempest-AggregatesAdminNegativeTestJSON-907895620 tempest-AggregatesAdminNegativeTestJSON-907895620-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:34:21.332352 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f2a7593b-5585-467b-9ce0-bb7d1fbc42a2 tempest-AggregatesAdminNegativeTestJSON-907895620 tempest-AggregatesAdminNegativeTestJSON-907895620-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates" status: 400 len: 619 microversion: 2.1 time: 0.034349 Oct 04 20:34:21.333543 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 123/274] 10.222.0.33 () {60 vars in 1165 bytes} [Tue Oct 4 20:34:21 2022] POST /compute/v2.1/os-aggregates => generated 619 bytes in 36 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 04 20:34:21.345160 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-75e56c6d-c157-41a3-8546-301f15da746c tempest-AggregatesAdminNegativeTestJSON-907895620 tempest-AggregatesAdminNegativeTestJSON-907895620-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": ""}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:34:21.349635 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-75e56c6d-c157-41a3-8546-301f15da746c tempest-AggregatesAdminNegativeTestJSON-907895620 tempest-AggregatesAdminNegativeTestJSON-907895620-project-admin] Request method failure captured: Oct 04 20:34:21.349635 n-d-854823-8 devstack@n-api.service[128801]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 04 20:34:21.349635 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:34:21.349635 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:34:21.349635 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:34:21.349635 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 27 Oct 04 20:34:21.349635 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:34:21.349635 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:34:21.349635 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:34:21.349635 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:34:21.349635 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJiYwmgLnmZgU1MzYFnwRkduF0U-oNQQTh3pjRStSZ2TluywlUp5tPEuivpXska-qjYpSX-0WyCvYvVlvkppZlUvlo9yw-bcYbzS3R42h8Kfj0P9UglK76WxuBJznfgBC57agfmcBJ_-FPYi5ShkHc6jTym94bNQMwWHqn1QPQSkNoM Oct 04 20:34:21.349635 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:34:21.349635 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:34:21.349635 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:34:21.349635 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:34:21.349635 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:34:21.349635 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:34:21.349635 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: b573d94f756e4a648a155cd95e012741 Oct 04 20:34:21.349635 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-907895620 Oct 04 20:34:21.349635 n-d-854823-8 devstack@n-api.service[128801]: X-Role: admin,reader,member Oct 04 20:34:21.349635 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: admin,reader,member Oct 04 20:34:21.350899 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b573d94f756e4a648a155cd95e012741", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b573d94f756e4a648a155cd95e012741"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b573d94f756e4a648a155cd95e012741"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b573d94f756e4a648a155cd95e012741"}]}] Oct 04 20:34:21.350899 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-907895620 Oct 04 20:34:21.350899 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: b573d94f756e4a648a155cd95e012741 Oct 04 20:34:21.350899 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-907895620 Oct 04 20:34:21.350899 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-AggregatesAdminNegativeTestJSON-907895620-project-admin Oct 04 20:34:21.350899 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:34:21.350899 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:34:21.350899 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: eefa1a3068aa4287a72e53272745aa2f Oct 04 20:34:21.350899 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-907895620-project-admin Oct 04 20:34:21.350899 n-d-854823-8 devstack@n-api.service[128801]: Oct 04 20:34:21.350899 n-d-854823-8 devstack@n-api.service[128801]: {"aggregate": {"name": ""}} Oct 04 20:34:21.350899 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 20:34:21.350899 n-d-854823-8 devstack@n-api.service[128801]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 04 20:34:21.351606 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'body': {'aggregate': {'name': ''}}} Oct 04 20:34:21.351606 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:34:21.351606 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:34:21.351606 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 20:34:21.351606 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 20:34:21.351606 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 20:34:21.351606 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise error Oct 04 20:34:21.351606 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 04 20:34:21.351606 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:34:21.351606 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['aggregate']['properties']['name']: Oct 04 20:34:21.351606 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 04 20:34:21.351606 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:34:21.351606 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Oct 04 20:34:21.351606 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi '' Oct 04 20:34:21.351606 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:34:21.351606 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:34:21.351606 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:34:21.351606 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:34:21.351606 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:34:21.351606 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:34:21.351606 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:34:21.351606 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:34:21.351606 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:34:21.352991 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:34:21.352991 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:34:21.352991 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:34:21.352991 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 20:34:21.352991 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 20:34:21.352991 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 20:34:21.352991 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 20:34:21.352991 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 20:34:21.352991 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 20:34:21.352991 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 04 20:34:21.352991 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:34:21.352991 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:34:21.352991 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:34:21.352991 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:34:21.352991 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:34:21.352991 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:34:21.352991 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 20:34:21.352991 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 20:34:21.352991 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 04 20:34:21.352991 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:34:21.355343 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-75e56c6d-c157-41a3-8546-301f15da746c tempest-AggregatesAdminNegativeTestJSON-907895620 tempest-AggregatesAdminNegativeTestJSON-907895620-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:34:21.362706 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-75e56c6d-c157-41a3-8546-301f15da746c tempest-AggregatesAdminNegativeTestJSON-907895620 tempest-AggregatesAdminNegativeTestJSON-907895620-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates" status: 400 len: 108 microversion: 2.1 time: 0.019617 Oct 04 20:34:21.363658 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 124/275] 10.222.0.33 () {60 vars in 1164 bytes} [Tue Oct 4 20:34:21 2022] POST /compute/v2.1/os-aggregates => generated 108 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 20:34:21.380329 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9759a948-a797-4593-81ad-30270426ef0c tempest-AggregatesAdminNegativeTestJSON-1603334861 tempest-AggregatesAdminNegativeTestJSON-1603334861-project] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-134671191"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:34:21.393883 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-9759a948-a797-4593-81ad-30270426ef0c tempest-AggregatesAdminNegativeTestJSON-1603334861 tempest-AggregatesAdminNegativeTestJSON-1603334861-project] Policy check for os_compute_api:os-aggregates:create failed with credentials {'is_admin': False, 'user_id': '7f89d73547d743d098c9706777f4c4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0851ce7156234ec58401aad2babd6c5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:21.398310 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9759a948-a797-4593-81ad-30270426ef0c tempest-AggregatesAdminNegativeTestJSON-1603334861 tempest-AggregatesAdminNegativeTestJSON-1603334861-project] Request method failure captured: Oct 04 20:34:21.398310 n-d-854823-8 devstack@n-api.service[128801]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 04 20:34:21.398310 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:34:21.398310 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:34:21.398310 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:34:21.398310 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 59 Oct 04 20:34:21.398310 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:34:21.398310 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:34:21.398310 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:34:21.398310 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:34:21.398310 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJiVsViKjm23lrr4RtOtlmQLcsjihWr7qoJs7BOswvmzhIQDKomlsCdi-pG_XZZFkw-owWG9CediBb8OYe_sGzP6u7Ji-8uLf5mstoELjwXdu030sZ6v7ua0toFlXT7CBvyO0W3G0ZBAq228k-ksP32pvo1fnMGkgKUUFNLTDI0kZmI Oct 04 20:34:21.398310 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:34:21.398310 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:34:21.398310 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:34:21.398310 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:34:21.398310 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:34:21.398310 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:34:21.398310 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: 0851ce7156234ec58401aad2babd6c5f Oct 04 20:34:21.398310 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1603334861 Oct 04 20:34:21.398310 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 20:34:21.398310 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 20:34:21.399558 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0851ce7156234ec58401aad2babd6c5f", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0851ce7156234ec58401aad2babd6c5f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0851ce7156234ec58401aad2babd6c5f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0851ce7156234ec58401aad2babd6c5f"}]}] Oct 04 20:34:21.399558 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1603334861 Oct 04 20:34:21.399558 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: 0851ce7156234ec58401aad2babd6c5f Oct 04 20:34:21.399558 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1603334861 Oct 04 20:34:21.399558 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-AggregatesAdminNegativeTestJSON-1603334861-project Oct 04 20:34:21.399558 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:34:21.399558 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:34:21.399558 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: 7f89d73547d743d098c9706777f4c4f2 Oct 04 20:34:21.399558 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1603334861-project Oct 04 20:34:21.399558 n-d-854823-8 devstack@n-api.service[128801]: Oct 04 20:34:21.399558 n-d-854823-8 devstack@n-api.service[128801]: {"aggregate": {"name": "tempest-test_aggregate-134671191"}} Oct 04 20:34:21.399558 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 20:34:21.399558 n-d-854823-8 devstack@n-api.service[128801]: exception: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Oct 04 20:34:21.400775 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-134671191'}}} Oct 04 20:34:21.400775 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:34:21.400775 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:34:21.400775 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:34:21.400775 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:34:21.400775 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:34:21.400775 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:34:21.400775 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:34:21.400775 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:34:21.400775 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:34:21.400775 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:34:21.400775 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:34:21.400775 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:34:21.400775 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 70, in create Oct 04 20:34:21.400775 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'create', target={}) Oct 04 20:34:21.400775 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 20:34:21.400775 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 20:34:21.400775 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 20:34:21.400775 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 20:34:21.401786 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 20:34:21.401786 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 20:34:21.401786 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 20:34:21.401786 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 20:34:21.401786 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 20:34:21.401786 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 20:34:21.401786 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 20:34:21.401786 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 20:34:21.401786 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 20:34:21.401786 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 20:34:21.401786 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Oct 04 20:34:21.401786 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:34:21.401786 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:34:21.401786 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:34:21.401786 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:34:21.401786 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:34:21.401786 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:34:21.401786 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 20:34:21.401786 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 20:34:21.401786 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Oct 04 20:34:21.403831 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:34:21.403831 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9759a948-a797-4593-81ad-30270426ef0c tempest-AggregatesAdminNegativeTestJSON-1603334861 tempest-AggregatesAdminNegativeTestJSON-1603334861-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:34:21.405237 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-9759a948-a797-4593-81ad-30270426ef0c tempest-AggregatesAdminNegativeTestJSON-1603334861 tempest-AggregatesAdminNegativeTestJSON-1603334861-project] 10.222.0.33 "POST /compute/v2.1/os-aggregates" status: 403 len: 116 microversion: 2.1 time: 0.029227 Oct 04 20:34:21.406313 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 125/276] 10.222.0.33 () {60 vars in 1164 bytes} [Tue Oct 4 20:34:21 2022] POST /compute/v2.1/os-aggregates => generated 116 bytes in 36 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:34:21.419818 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-962ef85f-5800-4f34-811b-235f62cc646b tempest-AggregatesAdminNegativeTestJSON-907895620 tempest-AggregatesAdminNegativeTestJSON-907895620-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1995657643"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:34:21.434000 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.objects.aggregate [None req-962ef85f-5800-4f34-811b-235f62cc646b tempest-AggregatesAdminNegativeTestJSON-907895620 tempest-AggregatesAdminNegativeTestJSON-907895620-project-admin] Generated uuid e6d3a456-0a9d-4469-9383-697bd3a9f04e for aggregate {{(pid=128801) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 20:34:21.453490 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=8,nova_api:DELETE=7,nova_api:UPDATE=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:34:21.479702 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-962ef85f-5800-4f34-811b-235f62cc646b tempest-AggregatesAdminNegativeTestJSON-907895620 tempest-AggregatesAdminNegativeTestJSON-907895620-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.066971 Oct 04 20:34:21.480712 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 126/277] 10.222.0.33 () {60 vars in 1164 bytes} [Tue Oct 4 20:34:21 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:34:21.498749 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-201e3020-46b6-4976-aaf0-b2059de31dec tempest-AggregatesAdminNegativeTestJSON-907895620 tempest-AggregatesAdminNegativeTestJSON-907895620-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1995657643"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:34:21.504334 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.objects.aggregate [None req-201e3020-46b6-4976-aaf0-b2059de31dec tempest-AggregatesAdminNegativeTestJSON-907895620 tempest-AggregatesAdminNegativeTestJSON-907895620-project-admin] Generated uuid 586dcd21-5bc0-4fa3-b899-f90f71bf7038 for aggregate {{(pid=128801) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 20:34:21.506880 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-2d8e0567-fbfb-462a-92f7-dbcb38e54fcc tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3563efe2b8c94931a2a46c4e14811b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3118a5d96843d3bede1ed94bd9717e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:21.518951 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-2d8e0567-fbfb-462a-92f7-dbcb38e54fcc tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] 10.222.0.33 "GET /compute/v2.1/servers/9e9f6289-9999-4188-9af1-6cf64a676eee" status: 200 len: 1313 microversion: 2.1 time: 0.314678 Oct 04 20:34:21.519393 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-201e3020-46b6-4976-aaf0-b2059de31dec tempest-AggregatesAdminNegativeTestJSON-907895620 tempest-AggregatesAdminNegativeTestJSON-907895620-project-admin] HTTP exception thrown: Aggregate tempest-test_aggregate-1995657643 already exists. Oct 04 20:34:21.520748 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 152/278] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:21 2022] GET /compute/v2.1/servers/9e9f6289-9999-4188-9af1-6cf64a676eee => generated 1313 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:34:21.524581 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-201e3020-46b6-4976-aaf0-b2059de31dec tempest-AggregatesAdminNegativeTestJSON-907895620 tempest-AggregatesAdminNegativeTestJSON-907895620-project-admin] Request method failure captured: Oct 04 20:34:21.524581 n-d-854823-8 devstack@n-api.service[128801]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 04 20:34:21.524581 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:34:21.524581 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:34:21.524581 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:34:21.524581 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 60 Oct 04 20:34:21.524581 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:34:21.524581 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:34:21.524581 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:34:21.524581 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:34:21.524581 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJiYwmgLnmZgU1MzYFnwRkduF0U-oNQQTh3pjRStSZ2TluywlUp5tPEuivpXska-qjYpSX-0WyCvYvVlvkppZlUvlo9yw-bcYbzS3R42h8Kfj0P9UglK76WxuBJznfgBC57agfmcBJ_-FPYi5ShkHc6jTym94bNQMwWHqn1QPQSkNoM Oct 04 20:34:21.524581 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:34:21.524581 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:34:21.524581 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:34:21.524581 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:34:21.524581 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:34:21.524581 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:34:21.524581 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: b573d94f756e4a648a155cd95e012741 Oct 04 20:34:21.524581 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-907895620 Oct 04 20:34:21.524581 n-d-854823-8 devstack@n-api.service[128801]: X-Role: admin,reader,member Oct 04 20:34:21.524581 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: admin,reader,member Oct 04 20:34:21.526288 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b573d94f756e4a648a155cd95e012741", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b573d94f756e4a648a155cd95e012741"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b573d94f756e4a648a155cd95e012741"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b573d94f756e4a648a155cd95e012741"}]}] Oct 04 20:34:21.526288 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-907895620 Oct 04 20:34:21.526288 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: b573d94f756e4a648a155cd95e012741 Oct 04 20:34:21.526288 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-907895620 Oct 04 20:34:21.526288 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-AggregatesAdminNegativeTestJSON-907895620-project-admin Oct 04 20:34:21.526288 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:34:21.526288 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:34:21.526288 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: eefa1a3068aa4287a72e53272745aa2f Oct 04 20:34:21.526288 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-907895620-project-admin Oct 04 20:34:21.526288 n-d-854823-8 devstack@n-api.service[128801]: Oct 04 20:34:21.526288 n-d-854823-8 devstack@n-api.service[128801]: {"aggregate": {"name": "tempest-test_aggregate-1995657643"}} Oct 04 20:34:21.526288 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 20:34:21.526288 n-d-854823-8 devstack@n-api.service[128801]: exception: Aggregate tempest-test_aggregate-1995657643 already exists. Oct 04 20:34:21.526990 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-1995657643'}}} Oct 04 20:34:21.526990 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:34:21.526990 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:34:21.526990 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 78, in create Oct 04 20:34:21.526990 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi aggregate = self.api.create_aggregate(context, name, avail_zone) Oct 04 20:34:21.526990 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 04 20:34:21.526990 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 04 20:34:21.526990 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 20:34:21.526990 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 20:34:21.526990 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 20:34:21.526990 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 20:34:21.526990 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 04 20:34:21.526990 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 04 20:34:21.526990 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6458, in create_aggregate Oct 04 20:34:21.526990 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi aggregate.create() Oct 04 20:34:21.526990 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 04 20:34:21.526990 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 04 20:34:21.526990 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 310, in create Oct 04 20:34:21.526990 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_create_in_db(self._context, updates, Oct 04 20:34:21.528773 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 20:34:21.528773 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 20:34:21.528773 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 175, in _aggregate_create_in_db Oct 04 20:34:21.528773 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.AggregateNameExists(aggregate_name=values['name']) Oct 04 20:34:21.528773 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNameExists: Aggregate tempest-test_aggregate-1995657643 already exists. Oct 04 20:34:21.528773 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:34:21.528773 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:34:21.528773 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:34:21.528773 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:34:21.528773 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:34:21.528773 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:34:21.528773 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:34:21.528773 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:34:21.528773 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:34:21.528773 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:34:21.528773 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:34:21.528773 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:34:21.528773 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:34:21.528773 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:34:21.528773 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 80, in create Oct 04 20:34:21.532440 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Oct 04 20:34:21.532440 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate tempest-test_aggregate-1995657643 already exists. Oct 04 20:34:21.532440 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:34:21.532440 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:34:21.532440 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:34:21.532440 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:34:21.532440 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:34:21.532440 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:34:21.532440 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:34:21.532440 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:34:21.532440 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate tempest-test_aggregate-1995657643 already exists. Oct 04 20:34:21.532440 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:34:21.535642 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-201e3020-46b6-4976-aaf0-b2059de31dec tempest-AggregatesAdminNegativeTestJSON-907895620 tempest-AggregatesAdminNegativeTestJSON-907895620-project-admin] Returning 409 to user: Aggregate tempest-test_aggregate-1995657643 already exists. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:34:21.536660 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-201e3020-46b6-4976-aaf0-b2059de31dec tempest-AggregatesAdminNegativeTestJSON-907895620 tempest-AggregatesAdminNegativeTestJSON-907895620-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates" status: 409 len: 111 microversion: 2.1 time: 0.048000 Oct 04 20:34:21.538564 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 127/279] 10.222.0.33 () {60 vars in 1164 bytes} [Tue Oct 4 20:34:21 2022] POST /compute/v2.1/os-aggregates => generated 111 bytes in 50 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 04 20:34:21.550450 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-87bd64b3-beba-4fa6-87b8-387e768daf0f tempest-AggregatesAdminNegativeTestJSON-907895620 tempest-AggregatesAdminNegativeTestJSON-907895620-project-admin] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:21.593318 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b5469ccf-529b-4e2e-b0ea-9b4f84b09056 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:21.594074 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b5469ccf-529b-4e2e-b0ea-9b4f84b09056 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] [instance: 8fdcb1b0-65e9-45d1-b0da-5f603f22a8cf] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:21.594186 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-87bd64b3-beba-4fa6-87b8-387e768daf0f tempest-AggregatesAdminNegativeTestJSON-907895620 tempest-AggregatesAdminNegativeTestJSON-907895620-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-aggregates/14" status: 200 len: 0 microversion: 2.1 time: 0.050799 Oct 04 20:34:21.596083 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 153/280] 10.222.0.33 () {58 vars in 1155 bytes} [Tue Oct 4 20:34:21 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 0 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 04 20:34:21.606719 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b5469ccf-529b-4e2e-b0ea-9b4f84b09056 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:21.607533 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b5469ccf-529b-4e2e-b0ea-9b4f84b09056 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:21.608296 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b5469ccf-529b-4e2e-b0ea-9b4f84b09056 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:21.609213 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b5469ccf-529b-4e2e-b0ea-9b4f84b09056 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:21.609762 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b5469ccf-529b-4e2e-b0ea-9b4f84b09056 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:21.610436 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b5469ccf-529b-4e2e-b0ea-9b4f84b09056 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:21.611789 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-83c04dcd-4125-4f49-95e9-e1851691c552 tempest-AggregatesAdminNegativeTestJSON-907895620 tempest-AggregatesAdminNegativeTestJSON-907895620-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1283319598"}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:34:21.620428 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.objects.aggregate [None req-83c04dcd-4125-4f49-95e9-e1851691c552 tempest-AggregatesAdminNegativeTestJSON-907895620 tempest-AggregatesAdminNegativeTestJSON-907895620-project-admin] Generated uuid bf5a75d4-ba83-44d6-871a-5ca207106764 for aggregate {{(pid=128802) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 20:34:21.663833 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-83c04dcd-4125-4f49-95e9-e1851691c552 tempest-AggregatesAdminNegativeTestJSON-907895620 tempest-AggregatesAdminNegativeTestJSON-907895620-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.063613 Oct 04 20:34:21.664465 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 154/281] 10.222.0.33 () {60 vars in 1164 bytes} [Tue Oct 4 20:34:21 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:34:21.702661 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-34812b24-7ee2-460d-9c99-e08eeee5d847 tempest-AggregatesAdminNegativeTestJSON-1603334861 tempest-AggregatesAdminNegativeTestJSON-1603334861-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:21.708282 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-34812b24-7ee2-460d-9c99-e08eeee5d847 tempest-AggregatesAdminNegativeTestJSON-1603334861 tempest-AggregatesAdminNegativeTestJSON-1603334861-project] Policy check for os_compute_api:os-aggregates:delete failed with credentials {'is_admin': False, 'user_id': '7f89d73547d743d098c9706777f4c4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0851ce7156234ec58401aad2babd6c5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:21.711498 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-34812b24-7ee2-460d-9c99-e08eeee5d847 tempest-AggregatesAdminNegativeTestJSON-1603334861 tempest-AggregatesAdminNegativeTestJSON-1603334861-project] Request method failure captured: Oct 04 20:34:21.711498 n-d-854823-8 devstack@n-api.service[128802]: request: DELETE /compute/v2.1/os-aggregates/15 HTTP/1.1 Oct 04 20:34:21.711498 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 20:34:21.711498 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 20:34:21.711498 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 20:34:21.711498 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 0 Oct 04 20:34:21.711498 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 20:34:21.711498 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 20:34:21.711498 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 20:34:21.711498 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 20:34:21.711498 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPJiVsViKjm23lrr4RtOtlmQLcsjihWr7qoJs7BOswvmzhIQDKomlsCdi-pG_XZZFkw-owWG9CediBb8OYe_sGzP6u7Ji-8uLf5mstoELjwXdu030sZ6v7ua0toFlXT7CBvyO0W3G0ZBAq228k-ksP32pvo1fnMGkgKUUFNLTDI0kZmI Oct 04 20:34:21.711498 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 20:34:21.711498 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 20:34:21.711498 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 20:34:21.711498 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 20:34:21.711498 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 20:34:21.711498 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 20:34:21.711498 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: 0851ce7156234ec58401aad2babd6c5f Oct 04 20:34:21.711498 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1603334861 Oct 04 20:34:21.711498 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 20:34:21.711498 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 20:34:21.713041 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0851ce7156234ec58401aad2babd6c5f", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0851ce7156234ec58401aad2babd6c5f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0851ce7156234ec58401aad2babd6c5f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0851ce7156234ec58401aad2babd6c5f"}]}] Oct 04 20:34:21.713041 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1603334861 Oct 04 20:34:21.713041 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: 0851ce7156234ec58401aad2babd6c5f Oct 04 20:34:21.713041 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1603334861 Oct 04 20:34:21.713041 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-AggregatesAdminNegativeTestJSON-1603334861-project Oct 04 20:34:21.713041 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 20:34:21.713041 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 20:34:21.713041 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: 7f89d73547d743d098c9706777f4c4f2 Oct 04 20:34:21.713041 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1603334861-project Oct 04 20:34:21.713041 n-d-854823-8 devstack@n-api.service[128802]: method: > Oct 04 20:34:21.713041 n-d-854823-8 devstack@n-api.service[128802]: exception: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Oct 04 20:34:21.713041 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'id': '15'} Oct 04 20:34:21.713929 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:34:21.713929 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:34:21.713929 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:34:21.713929 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:34:21.713929 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:34:21.713929 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:34:21.713929 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:34:21.713929 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:34:21.713929 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 147, in delete Oct 04 20:34:21.713929 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'delete', target={}) Oct 04 20:34:21.713929 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 20:34:21.713929 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 20:34:21.713929 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 20:34:21.713929 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 20:34:21.713929 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 20:34:21.713929 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 20:34:21.713929 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 20:34:21.713929 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 20:34:21.713929 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 20:34:21.715057 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 20:34:21.715057 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 20:34:21.715057 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 20:34:21.715057 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 20:34:21.715057 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 20:34:21.715057 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Oct 04 20:34:21.715057 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:34:21.715057 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:34:21.715057 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:34:21.715057 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:34:21.715057 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:34:21.715057 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:34:21.715057 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 20:34:21.715057 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 20:34:21.715057 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Oct 04 20:34:21.715057 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:34:21.715057 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-34812b24-7ee2-460d-9c99-e08eeee5d847 tempest-AggregatesAdminNegativeTestJSON-1603334861 tempest-AggregatesAdminNegativeTestJSON-1603334861-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:34:21.719960 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-34812b24-7ee2-460d-9c99-e08eeee5d847 tempest-AggregatesAdminNegativeTestJSON-1603334861 tempest-AggregatesAdminNegativeTestJSON-1603334861-project] 10.222.0.33 "DELETE /compute/v2.1/os-aggregates/15" status: 403 len: 116 microversion: 2.1 time: 0.041775 Oct 04 20:34:21.719960 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 155/282] 10.222.0.33 () {58 vars in 1155 bytes} [Tue Oct 4 20:34:21 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 116 bytes in 45 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:34:21.728029 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-9506dc19-168b-4802-a920-30b92a0f3637 tempest-AggregatesAdminNegativeTestJSON-907895620 tempest-AggregatesAdminNegativeTestJSON-907895620-project-admin] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:21.753312 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-9506dc19-168b-4802-a920-30b92a0f3637 tempest-AggregatesAdminNegativeTestJSON-907895620 tempest-AggregatesAdminNegativeTestJSON-907895620-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-aggregates/15" status: 200 len: 0 microversion: 2.1 time: 0.031734 Oct 04 20:34:21.755347 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 156/283] 10.222.0.33 () {58 vars in 1155 bytes} [Tue Oct 4 20:34:21 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 0 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 04 20:34:21.768036 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-4b74072a-0229-4ec7-9e9c-547e3a4b954f tempest-AggregatesAdminNegativeTestJSON-907895620 tempest-AggregatesAdminNegativeTestJSON-907895620-project-admin] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:21.775666 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=8,nova_api:DELETE=15 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:34:21.783273 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.wsgi [None req-4b74072a-0229-4ec7-9e9c-547e3a4b954f tempest-AggregatesAdminNegativeTestJSON-907895620 tempest-AggregatesAdminNegativeTestJSON-907895620-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Oct 04 20:34:21.785443 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-4b74072a-0229-4ec7-9e9c-547e3a4b954f tempest-AggregatesAdminNegativeTestJSON-907895620 tempest-AggregatesAdminNegativeTestJSON-907895620-project-admin] Request method failure captured: Oct 04 20:34:21.785443 n-d-854823-8 devstack@n-api.service[128802]: request: DELETE /compute/v2.1/os-aggregates/-1 HTTP/1.1 Oct 04 20:34:21.785443 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 20:34:21.785443 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 20:34:21.785443 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 20:34:21.785443 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 0 Oct 04 20:34:21.785443 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 20:34:21.785443 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 20:34:21.785443 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 20:34:21.785443 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 20:34:21.785443 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPJiYwmgLnmZgU1MzYFnwRkduF0U-oNQQTh3pjRStSZ2TluywlUp5tPEuivpXska-qjYpSX-0WyCvYvVlvkppZlUvlo9yw-bcYbzS3R42h8Kfj0P9UglK76WxuBJznfgBC57agfmcBJ_-FPYi5ShkHc6jTym94bNQMwWHqn1QPQSkNoM Oct 04 20:34:21.785443 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 20:34:21.785443 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 20:34:21.785443 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 20:34:21.785443 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 20:34:21.785443 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 20:34:21.785443 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 20:34:21.785443 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: b573d94f756e4a648a155cd95e012741 Oct 04 20:34:21.785443 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-907895620 Oct 04 20:34:21.785443 n-d-854823-8 devstack@n-api.service[128802]: X-Role: admin,reader,member Oct 04 20:34:21.785443 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: admin,reader,member Oct 04 20:34:21.786816 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b573d94f756e4a648a155cd95e012741", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b573d94f756e4a648a155cd95e012741"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b573d94f756e4a648a155cd95e012741"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b573d94f756e4a648a155cd95e012741"}]}] Oct 04 20:34:21.786816 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-907895620 Oct 04 20:34:21.786816 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: b573d94f756e4a648a155cd95e012741 Oct 04 20:34:21.786816 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-907895620 Oct 04 20:34:21.786816 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-AggregatesAdminNegativeTestJSON-907895620-project-admin Oct 04 20:34:21.786816 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 20:34:21.786816 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 20:34:21.786816 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: eefa1a3068aa4287a72e53272745aa2f Oct 04 20:34:21.786816 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-907895620-project-admin Oct 04 20:34:21.786816 n-d-854823-8 devstack@n-api.service[128802]: method: > Oct 04 20:34:21.786816 n-d-854823-8 devstack@n-api.service[128802]: exception: Aggregate -1 could not be found. Oct 04 20:34:21.786816 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'id': '-1'} Oct 04 20:34:21.787496 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:34:21.787496 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:34:21.787496 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Oct 04 20:34:21.787496 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Oct 04 20:34:21.787496 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 04 20:34:21.787496 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 04 20:34:21.787496 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 20:34:21.787496 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 20:34:21.787496 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 20:34:21.787496 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 20:34:21.787496 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 04 20:34:21.787496 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 04 20:34:21.787496 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Oct 04 20:34:21.787496 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Oct 04 20:34:21.787496 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 20:34:21.787496 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 20:34:21.787496 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 04 20:34:21.787496 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 04 20:34:21.787496 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 20:34:21.788487 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 20:34:21.788487 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 04 20:34:21.788487 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 04 20:34:21.788487 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Oct 04 20:34:21.788487 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:34:21.788487 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:34:21.788487 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:34:21.788487 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:34:21.788487 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:34:21.788487 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:34:21.788487 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:34:21.788487 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:34:21.788487 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:34:21.788487 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:34:21.788487 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Oct 04 20:34:21.788487 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:34:21.788487 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Oct 04 20:34:21.788487 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:34:21.788487 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:34:21.788487 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:34:21.788487 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:34:21.790954 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:34:21.790954 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:34:21.790954 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:34:21.790954 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:34:21.790954 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Oct 04 20:34:21.790954 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:34:21.792506 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-4b74072a-0229-4ec7-9e9c-547e3a4b954f tempest-AggregatesAdminNegativeTestJSON-907895620 tempest-AggregatesAdminNegativeTestJSON-907895620-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:34:21.793443 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-4b74072a-0229-4ec7-9e9c-547e3a4b954f tempest-AggregatesAdminNegativeTestJSON-907895620 tempest-AggregatesAdminNegativeTestJSON-907895620-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.031976 Oct 04 20:34:21.795071 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 157/284] 10.222.0.33 () {58 vars in 1155 bytes} [Tue Oct 4 20:34:21 2022] DELETE /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 20:34:21.809360 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-91c78e1f-a0a9-45e7-bea9-3bd35f905aaa tempest-AggregatesAdminNegativeTestJSON-907895620 tempest-AggregatesAdminNegativeTestJSON-907895620-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-573079993"}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:34:21.813200 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.objects.aggregate [None req-91c78e1f-a0a9-45e7-bea9-3bd35f905aaa tempest-AggregatesAdminNegativeTestJSON-907895620 tempest-AggregatesAdminNegativeTestJSON-907895620-project-admin] Generated uuid bd5af71f-5eb7-4d66-a887-625b3d4fc8ab for aggregate {{(pid=128802) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 20:34:21.836737 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-b5469ccf-529b-4e2e-b0ea-9b4f84b09056 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5eda279f6034608b192839a54dda616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f28e80977de42a892b84295ecf05141', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:21.845449 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b5469ccf-529b-4e2e-b0ea-9b4f84b09056 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] 10.222.0.33 "GET /compute/v2.1/servers/8fdcb1b0-65e9-45d1-b0da-5f603f22a8cf" status: 200 len: 1388 microversion: 2.1 time: 0.256988 Oct 04 20:34:21.848793 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 128/285] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:21 2022] GET /compute/v2.1/servers/8fdcb1b0-65e9-45d1-b0da-5f603f22a8cf => generated 1388 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:21.854173 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-91c78e1f-a0a9-45e7-bea9-3bd35f905aaa tempest-AggregatesAdminNegativeTestJSON-907895620 tempest-AggregatesAdminNegativeTestJSON-907895620-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.051864 Oct 04 20:34:21.855316 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 158/286] 10.222.0.33 () {60 vars in 1164 bytes} [Tue Oct 4 20:34:21 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 20:34:21.871601 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5022cc2d-6d56-4aa8-ae4d-c7c05c376673 tempest-AggregatesAdminNegativeTestJSON-1603334861 tempest-AggregatesAdminNegativeTestJSON-1603334861-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:21.873587 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-5022cc2d-6d56-4aa8-ae4d-c7c05c376673 tempest-AggregatesAdminNegativeTestJSON-1603334861 tempest-AggregatesAdminNegativeTestJSON-1603334861-project] Policy check for os_compute_api:os-aggregates:show failed with credentials {'is_admin': False, 'user_id': '7f89d73547d743d098c9706777f4c4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0851ce7156234ec58401aad2babd6c5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:21.875561 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5022cc2d-6d56-4aa8-ae4d-c7c05c376673 tempest-AggregatesAdminNegativeTestJSON-1603334861 tempest-AggregatesAdminNegativeTestJSON-1603334861-project] Request method failure captured: Oct 04 20:34:21.875561 n-d-854823-8 devstack@n-api.service[128801]: request: GET /compute/v2.1/os-aggregates/16 HTTP/1.1 Oct 04 20:34:21.875561 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:34:21.875561 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:34:21.875561 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:34:21.875561 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 0 Oct 04 20:34:21.875561 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:34:21.875561 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:34:21.875561 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:34:21.875561 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:34:21.875561 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJiVsViKjm23lrr4RtOtlmQLcsjihWr7qoJs7BOswvmzhIQDKomlsCdi-pG_XZZFkw-owWG9CediBb8OYe_sGzP6u7Ji-8uLf5mstoELjwXdu030sZ6v7ua0toFlXT7CBvyO0W3G0ZBAq228k-ksP32pvo1fnMGkgKUUFNLTDI0kZmI Oct 04 20:34:21.875561 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:34:21.875561 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:34:21.875561 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:34:21.875561 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:34:21.875561 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:34:21.875561 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:34:21.875561 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: 0851ce7156234ec58401aad2babd6c5f Oct 04 20:34:21.875561 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1603334861 Oct 04 20:34:21.875561 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 20:34:21.875561 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 20:34:21.876759 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0851ce7156234ec58401aad2babd6c5f", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0851ce7156234ec58401aad2babd6c5f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0851ce7156234ec58401aad2babd6c5f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0851ce7156234ec58401aad2babd6c5f"}]}] Oct 04 20:34:21.876759 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1603334861 Oct 04 20:34:21.876759 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: 0851ce7156234ec58401aad2babd6c5f Oct 04 20:34:21.876759 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1603334861 Oct 04 20:34:21.876759 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-AggregatesAdminNegativeTestJSON-1603334861-project Oct 04 20:34:21.876759 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:34:21.876759 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:34:21.876759 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: 7f89d73547d743d098c9706777f4c4f2 Oct 04 20:34:21.876759 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1603334861-project Oct 04 20:34:21.876759 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 20:34:21.876759 n-d-854823-8 devstack@n-api.service[128801]: exception: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Oct 04 20:34:21.876759 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': '16'} Oct 04 20:34:21.877422 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:34:21.877422 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:34:21.877422 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:34:21.877422 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:34:21.877422 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:34:21.877422 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:34:21.877422 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:34:21.877422 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:34:21.877422 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 100, in show Oct 04 20:34:21.877422 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'show', target={}) Oct 04 20:34:21.877422 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 20:34:21.877422 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 20:34:21.877422 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 20:34:21.877422 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 20:34:21.877422 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 20:34:21.877422 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 20:34:21.877422 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 20:34:21.877422 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 20:34:21.877422 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 20:34:21.879123 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 20:34:21.879123 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 20:34:21.879123 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 20:34:21.879123 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 20:34:21.879123 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 20:34:21.879123 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Oct 04 20:34:21.879123 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:34:21.879123 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:34:21.879123 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:34:21.879123 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:34:21.879123 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:34:21.879123 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:34:21.879123 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 20:34:21.879123 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 20:34:21.879123 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Oct 04 20:34:21.879123 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:34:21.879123 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5022cc2d-6d56-4aa8-ae4d-c7c05c376673 tempest-AggregatesAdminNegativeTestJSON-1603334861 tempest-AggregatesAdminNegativeTestJSON-1603334861-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:34:21.880812 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5022cc2d-6d56-4aa8-ae4d-c7c05c376673 tempest-AggregatesAdminNegativeTestJSON-1603334861 tempest-AggregatesAdminNegativeTestJSON-1603334861-project] 10.222.0.33 "GET /compute/v2.1/os-aggregates/16" status: 403 len: 114 microversion: 2.1 time: 0.011199 Oct 04 20:34:21.880812 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 129/287] 10.222.0.33 () {58 vars in 1152 bytes} [Tue Oct 4 20:34:21 2022] GET /compute/v2.1/os-aggregates/16 => generated 114 bytes in 12 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:34:21.887729 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-bd6a0090-2153-4376-bf58-cf6b25dd1188 tempest-AggregatesAdminNegativeTestJSON-907895620 tempest-AggregatesAdminNegativeTestJSON-907895620-project-admin] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:21.912133 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-bd6a0090-2153-4376-bf58-cf6b25dd1188 tempest-AggregatesAdminNegativeTestJSON-907895620 tempest-AggregatesAdminNegativeTestJSON-907895620-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-aggregates/16" status: 200 len: 0 microversion: 2.1 time: 0.029505 Oct 04 20:34:21.912877 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 159/288] 10.222.0.33 () {58 vars in 1155 bytes} [Tue Oct 4 20:34:21 2022] DELETE /compute/v2.1/os-aggregates/16 => generated 0 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 04 20:34:21.922398 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-465a5eb6-8f06-421f-bd51-61d150249e2b tempest-AggregatesAdminNegativeTestJSON-907895620 tempest-AggregatesAdminNegativeTestJSON-907895620-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:21.929695 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-465a5eb6-8f06-421f-bd51-61d150249e2b tempest-AggregatesAdminNegativeTestJSON-907895620 tempest-AggregatesAdminNegativeTestJSON-907895620-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Oct 04 20:34:21.931808 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-465a5eb6-8f06-421f-bd51-61d150249e2b tempest-AggregatesAdminNegativeTestJSON-907895620 tempest-AggregatesAdminNegativeTestJSON-907895620-project-admin] Request method failure captured: Oct 04 20:34:21.931808 n-d-854823-8 devstack@n-api.service[128801]: request: GET /compute/v2.1/os-aggregates/-1 HTTP/1.1 Oct 04 20:34:21.931808 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:34:21.931808 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:34:21.931808 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:34:21.931808 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 0 Oct 04 20:34:21.931808 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:34:21.931808 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:34:21.931808 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:34:21.931808 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:34:21.931808 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJiYwmgLnmZgU1MzYFnwRkduF0U-oNQQTh3pjRStSZ2TluywlUp5tPEuivpXska-qjYpSX-0WyCvYvVlvkppZlUvlo9yw-bcYbzS3R42h8Kfj0P9UglK76WxuBJznfgBC57agfmcBJ_-FPYi5ShkHc6jTym94bNQMwWHqn1QPQSkNoM Oct 04 20:34:21.931808 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:34:21.931808 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:34:21.931808 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:34:21.931808 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:34:21.931808 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:34:21.931808 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:34:21.931808 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: b573d94f756e4a648a155cd95e012741 Oct 04 20:34:21.931808 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-907895620 Oct 04 20:34:21.931808 n-d-854823-8 devstack@n-api.service[128801]: X-Role: admin,reader,member Oct 04 20:34:21.931808 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: admin,reader,member Oct 04 20:34:21.933281 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b573d94f756e4a648a155cd95e012741", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b573d94f756e4a648a155cd95e012741"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b573d94f756e4a648a155cd95e012741"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b573d94f756e4a648a155cd95e012741"}]}] Oct 04 20:34:21.933281 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-907895620 Oct 04 20:34:21.933281 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: b573d94f756e4a648a155cd95e012741 Oct 04 20:34:21.933281 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-907895620 Oct 04 20:34:21.933281 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-AggregatesAdminNegativeTestJSON-907895620-project-admin Oct 04 20:34:21.933281 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:34:21.933281 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:34:21.933281 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: eefa1a3068aa4287a72e53272745aa2f Oct 04 20:34:21.933281 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-907895620-project-admin Oct 04 20:34:21.933281 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 20:34:21.933281 n-d-854823-8 devstack@n-api.service[128801]: exception: Aggregate -1 could not be found. Oct 04 20:34:21.933281 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': '-1'} Oct 04 20:34:21.934018 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:34:21.934018 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:34:21.934018 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Oct 04 20:34:21.934018 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Oct 04 20:34:21.934018 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Oct 04 20:34:21.934018 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Oct 04 20:34:21.934018 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 20:34:21.934018 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 20:34:21.934018 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 04 20:34:21.934018 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 04 20:34:21.934018 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 20:34:21.934018 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 20:34:21.934018 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 04 20:34:21.934018 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 04 20:34:21.934018 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Oct 04 20:34:21.934018 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:34:21.934018 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:34:21.934018 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:34:21.934018 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:34:21.934018 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:34:21.935385 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:34:21.935385 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:34:21.935385 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:34:21.935385 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:34:21.935385 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:34:21.935385 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Oct 04 20:34:21.935385 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:34:21.935385 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Oct 04 20:34:21.935385 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:34:21.935385 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:34:21.935385 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:34:21.935385 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:34:21.935385 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:34:21.935385 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:34:21.935385 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:34:21.935385 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:34:21.935385 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Oct 04 20:34:21.935385 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:34:21.938527 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-465a5eb6-8f06-421f-bd51-61d150249e2b tempest-AggregatesAdminNegativeTestJSON-907895620 tempest-AggregatesAdminNegativeTestJSON-907895620-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:34:21.938527 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-465a5eb6-8f06-421f-bd51-61d150249e2b tempest-AggregatesAdminNegativeTestJSON-907895620 tempest-AggregatesAdminNegativeTestJSON-907895620-project-admin] 10.222.0.33 "GET /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.014706 Oct 04 20:34:21.938527 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 130/289] 10.222.0.33 () {58 vars in 1152 bytes} [Tue Oct 4 20:34:21 2022] GET /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 20:34:21.944494 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-d1141ed3-ef75-4c04-adcb-1eea2e528602 tempest-AggregatesAdminNegativeTestJSON-1603334861 tempest-AggregatesAdminNegativeTestJSON-1603334861-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:21.946076 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-d1141ed3-ef75-4c04-adcb-1eea2e528602 tempest-AggregatesAdminNegativeTestJSON-1603334861 tempest-AggregatesAdminNegativeTestJSON-1603334861-project] Policy check for os_compute_api:os-aggregates:index failed with credentials {'is_admin': False, 'user_id': '7f89d73547d743d098c9706777f4c4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0851ce7156234ec58401aad2babd6c5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:21.948844 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-d1141ed3-ef75-4c04-adcb-1eea2e528602 tempest-AggregatesAdminNegativeTestJSON-1603334861 tempest-AggregatesAdminNegativeTestJSON-1603334861-project] Request method failure captured: Oct 04 20:34:21.948844 n-d-854823-8 devstack@n-api.service[128802]: request: GET /compute/v2.1/os-aggregates HTTP/1.1 Oct 04 20:34:21.948844 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 20:34:21.948844 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 20:34:21.948844 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 20:34:21.948844 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 0 Oct 04 20:34:21.948844 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 20:34:21.948844 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 20:34:21.948844 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 20:34:21.948844 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 20:34:21.948844 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPJiVsViKjm23lrr4RtOtlmQLcsjihWr7qoJs7BOswvmzhIQDKomlsCdi-pG_XZZFkw-owWG9CediBb8OYe_sGzP6u7Ji-8uLf5mstoELjwXdu030sZ6v7ua0toFlXT7CBvyO0W3G0ZBAq228k-ksP32pvo1fnMGkgKUUFNLTDI0kZmI Oct 04 20:34:21.948844 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 20:34:21.948844 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 20:34:21.948844 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 20:34:21.948844 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 20:34:21.948844 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 20:34:21.948844 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 20:34:21.948844 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: 0851ce7156234ec58401aad2babd6c5f Oct 04 20:34:21.948844 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1603334861 Oct 04 20:34:21.948844 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 20:34:21.948844 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 20:34:21.950452 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0851ce7156234ec58401aad2babd6c5f", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0851ce7156234ec58401aad2babd6c5f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0851ce7156234ec58401aad2babd6c5f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0851ce7156234ec58401aad2babd6c5f"}]}] Oct 04 20:34:21.950452 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1603334861 Oct 04 20:34:21.950452 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: 0851ce7156234ec58401aad2babd6c5f Oct 04 20:34:21.950452 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1603334861 Oct 04 20:34:21.950452 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-AggregatesAdminNegativeTestJSON-1603334861-project Oct 04 20:34:21.950452 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 20:34:21.950452 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 20:34:21.950452 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: 7f89d73547d743d098c9706777f4c4f2 Oct 04 20:34:21.950452 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1603334861-project Oct 04 20:34:21.950452 n-d-854823-8 devstack@n-api.service[128802]: method: > Oct 04 20:34:21.950452 n-d-854823-8 devstack@n-api.service[128802]: exception: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Oct 04 20:34:21.950452 n-d-854823-8 devstack@n-api.service[128802]: action_args: {} Oct 04 20:34:21.951346 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:34:21.951346 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:34:21.951346 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:34:21.951346 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:34:21.951346 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:34:21.951346 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:34:21.951346 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:34:21.951346 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:34:21.951346 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 55, in index Oct 04 20:34:21.951346 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'index', target={}) Oct 04 20:34:21.951346 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 20:34:21.951346 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 20:34:21.951346 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 20:34:21.951346 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 20:34:21.951346 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 20:34:21.951346 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 20:34:21.951346 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 20:34:21.951346 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 20:34:21.951346 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 20:34:21.952805 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 20:34:21.952805 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 20:34:21.952805 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 20:34:21.952805 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 20:34:21.952805 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 20:34:21.952805 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Oct 04 20:34:21.952805 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:34:21.952805 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:34:21.952805 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:34:21.952805 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:34:21.952805 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:34:21.952805 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:34:21.952805 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 20:34:21.952805 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 20:34:21.952805 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Oct 04 20:34:21.952805 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:34:21.952805 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-d1141ed3-ef75-4c04-adcb-1eea2e528602 tempest-AggregatesAdminNegativeTestJSON-1603334861 tempest-AggregatesAdminNegativeTestJSON-1603334861-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:34:21.953683 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-d1141ed3-ef75-4c04-adcb-1eea2e528602 tempest-AggregatesAdminNegativeTestJSON-1603334861 tempest-AggregatesAdminNegativeTestJSON-1603334861-project] 10.222.0.33 "GET /compute/v2.1/os-aggregates" status: 403 len: 115 microversion: 2.1 time: 0.009776 Oct 04 20:34:21.957525 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 160/290] 10.222.0.33 () {58 vars in 1143 bytes} [Tue Oct 4 20:34:21 2022] GET /compute/v2.1/os-aggregates => generated 115 bytes in 15 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:34:21.961297 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-8d05d0b0-9b67-4ec5-849f-9ba388d62cef req-d50322ab-ca4b-4a14-85ef-5d5f24ca0110 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e9f6289-9999-4188-9af1-6cf64a676eee", "name": "network-vif-plugged", "status": "completed", "tag": "adebf0e2-e917-4865-9fef-2062cd63bdc7"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:34:21.963132 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-313e34dd-489a-4e0f-a0a8-a9637575f0a1 tempest-AggregatesAdminNegativeTestJSON-907895620 tempest-AggregatesAdminNegativeTestJSON-907895620-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-218333067"}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:34:21.967661 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.objects.aggregate [None req-313e34dd-489a-4e0f-a0a8-a9637575f0a1 tempest-AggregatesAdminNegativeTestJSON-907895620 tempest-AggregatesAdminNegativeTestJSON-907895620-project-admin] Generated uuid bcff37cb-7280-4827-894a-62f8725ce4a9 for aggregate {{(pid=128802) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 20:34:21.974598 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-8d05d0b0-9b67-4ec5-849f-9ba388d62cef req-d50322ab-ca4b-4a14-85ef-5d5f24ca0110 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:21.975352 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-8d05d0b0-9b67-4ec5-849f-9ba388d62cef req-d50322ab-ca4b-4a14-85ef-5d5f24ca0110 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:21.976016 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-8d05d0b0-9b67-4ec5-849f-9ba388d62cef req-d50322ab-ca4b-4a14-85ef-5d5f24ca0110 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:21.990642 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-313e34dd-489a-4e0f-a0a8-a9637575f0a1 tempest-AggregatesAdminNegativeTestJSON-907895620 tempest-AggregatesAdminNegativeTestJSON-907895620-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.030904 Oct 04 20:34:21.991414 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 161/291] 10.222.0.33 () {60 vars in 1164 bytes} [Tue Oct 4 20:34:21 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:34:21.997997 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-8d05d0b0-9b67-4ec5-849f-9ba388d62cef req-d50322ab-ca4b-4a14-85ef-5d5f24ca0110 service nova] Creating event network-vif-plugged:adebf0e2-e917-4865-9fef-2062cd63bdc7 for instance 9e9f6289-9999-4188-9af1-6cf64a676eee on n-h1-854823-8 Oct 04 20:34:22.007735 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-8d05d0b0-9b67-4ec5-849f-9ba388d62cef req-d50322ab-ca4b-4a14-85ef-5d5f24ca0110 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051378 Oct 04 20:34:22.008329 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 131/292] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:34:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:34:22.008544 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-5f79ef03-0e79-465f-b643-1a9152f07535 tempest-AggregatesAdminNegativeTestJSON-907895620 tempest-AggregatesAdminNegativeTestJSON-907895620-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-854823-8"}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:34:22.021335 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5f79ef03-0e79-465f-b643-1a9152f07535 tempest-AggregatesAdminNegativeTestJSON-907895620 tempest-AggregatesAdminNegativeTestJSON-907895620-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:22.022005 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5f79ef03-0e79-465f-b643-1a9152f07535 tempest-AggregatesAdminNegativeTestJSON-907895620 tempest-AggregatesAdminNegativeTestJSON-907895620-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:22.022467 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5f79ef03-0e79-465f-b643-1a9152f07535 tempest-AggregatesAdminNegativeTestJSON-907895620 tempest-AggregatesAdminNegativeTestJSON-907895620-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:22.172921 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1ce1ea88-9648-4004-980e-2870206a1e20 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:22.173541 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-1ce1ea88-9648-4004-980e-2870206a1e20 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] [instance: 854066a9-9adf-4932-b6a8-c7fe15d8b4da] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:22.185794 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1ce1ea88-9648-4004-980e-2870206a1e20 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:22.185946 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1ce1ea88-9648-4004-980e-2870206a1e20 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:22.186285 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1ce1ea88-9648-4004-980e-2870206a1e20 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:22.187268 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1ce1ea88-9648-4004-980e-2870206a1e20 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:22.187773 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1ce1ea88-9648-4004-980e-2870206a1e20 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:22.188185 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1ce1ea88-9648-4004-980e-2870206a1e20 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:22.206049 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-5f79ef03-0e79-465f-b643-1a9152f07535 tempest-AggregatesAdminNegativeTestJSON-907895620 tempest-AggregatesAdminNegativeTestJSON-907895620-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates/17/action" status: 200 len: 242 microversion: 2.1 time: 0.205228 Oct 04 20:34:22.208060 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 162/293] 10.222.0.33 () {60 vars in 1194 bytes} [Tue Oct 4 20:34:21 2022] POST /compute/v2.1/os-aggregates/17/action => generated 242 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:34:22.227414 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-5531390f-4c17-4fdf-89a2-dd268f1567a1 tempest-AggregatesAdminNegativeTestJSON-1603334861 tempest-AggregatesAdminNegativeTestJSON-1603334861-project] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-854823-8"}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:34:22.246228 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-5531390f-4c17-4fdf-89a2-dd268f1567a1 tempest-AggregatesAdminNegativeTestJSON-1603334861 tempest-AggregatesAdminNegativeTestJSON-1603334861-project] Policy check for os_compute_api:os-aggregates:remove_host failed with credentials {'is_admin': False, 'user_id': '7f89d73547d743d098c9706777f4c4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0851ce7156234ec58401aad2babd6c5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:22.248969 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-5531390f-4c17-4fdf-89a2-dd268f1567a1 tempest-AggregatesAdminNegativeTestJSON-1603334861 tempest-AggregatesAdminNegativeTestJSON-1603334861-project] Request method failure captured: Oct 04 20:34:22.248969 n-d-854823-8 devstack@n-api.service[128802]: request: POST /compute/v2.1/os-aggregates/17/action HTTP/1.1 Oct 04 20:34:22.248969 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 20:34:22.248969 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 20:34:22.248969 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 20:34:22.248969 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 42 Oct 04 20:34:22.248969 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 20:34:22.248969 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 20:34:22.248969 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 20:34:22.248969 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 20:34:22.248969 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPJiVsViKjm23lrr4RtOtlmQLcsjihWr7qoJs7BOswvmzhIQDKomlsCdi-pG_XZZFkw-owWG9CediBb8OYe_sGzP6u7Ji-8uLf5mstoELjwXdu030sZ6v7ua0toFlXT7CBvyO0W3G0ZBAq228k-ksP32pvo1fnMGkgKUUFNLTDI0kZmI Oct 04 20:34:22.248969 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 20:34:22.248969 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 20:34:22.248969 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 20:34:22.248969 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 20:34:22.248969 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 20:34:22.248969 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 20:34:22.248969 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: 0851ce7156234ec58401aad2babd6c5f Oct 04 20:34:22.248969 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1603334861 Oct 04 20:34:22.248969 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 20:34:22.248969 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 20:34:22.250274 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0851ce7156234ec58401aad2babd6c5f", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0851ce7156234ec58401aad2babd6c5f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0851ce7156234ec58401aad2babd6c5f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0851ce7156234ec58401aad2babd6c5f"}]}] Oct 04 20:34:22.250274 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1603334861 Oct 04 20:34:22.250274 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: 0851ce7156234ec58401aad2babd6c5f Oct 04 20:34:22.250274 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1603334861 Oct 04 20:34:22.250274 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-AggregatesAdminNegativeTestJSON-1603334861-project Oct 04 20:34:22.250274 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 20:34:22.250274 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 20:34:22.250274 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: 7f89d73547d743d098c9706777f4c4f2 Oct 04 20:34:22.250274 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1603334861-project Oct 04 20:34:22.250274 n-d-854823-8 devstack@n-api.service[128802]: Oct 04 20:34:22.250274 n-d-854823-8 devstack@n-api.service[128802]: {"remove_host": {"host": "n-h1-854823-8"}} Oct 04 20:34:22.250274 n-d-854823-8 devstack@n-api.service[128802]: method: > Oct 04 20:34:22.250274 n-d-854823-8 devstack@n-api.service[128802]: exception: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Oct 04 20:34:22.251269 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'id': '17', 'body': {'remove_host': {'host': 'n-h1-854823-8'}}} Oct 04 20:34:22.251269 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:34:22.251269 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:34:22.251269 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:34:22.251269 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:34:22.251269 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:34:22.251269 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:34:22.251269 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:34:22.251269 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:34:22.251269 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:34:22.251269 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:34:22.251269 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 201, in _remove_host Oct 04 20:34:22.251269 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'remove_host', target={}) Oct 04 20:34:22.251269 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 20:34:22.251269 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 20:34:22.251269 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 20:34:22.251269 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 20:34:22.251269 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 20:34:22.251269 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 20:34:22.252487 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 20:34:22.252487 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 20:34:22.252487 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 20:34:22.252487 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 20:34:22.252487 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 20:34:22.252487 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 20:34:22.252487 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 20:34:22.252487 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 20:34:22.252487 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Oct 04 20:34:22.252487 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:34:22.252487 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:34:22.252487 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:34:22.252487 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:34:22.252487 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:34:22.252487 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:34:22.252487 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 20:34:22.252487 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 20:34:22.252487 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Oct 04 20:34:22.252487 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:34:22.258665 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-5531390f-4c17-4fdf-89a2-dd268f1567a1 tempest-AggregatesAdminNegativeTestJSON-1603334861 tempest-AggregatesAdminNegativeTestJSON-1603334861-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:34:22.260746 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-5531390f-4c17-4fdf-89a2-dd268f1567a1 tempest-AggregatesAdminNegativeTestJSON-1603334861 tempest-AggregatesAdminNegativeTestJSON-1603334861-project] 10.222.0.33 "POST /compute/v2.1/os-aggregates/17/action" status: 403 len: 121 microversion: 2.1 time: 0.044888 Oct 04 20:34:22.262329 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 163/294] 10.222.0.33 () {60 vars in 1194 bytes} [Tue Oct 4 20:34:22 2022] POST /compute/v2.1/os-aggregates/17/action => generated 121 bytes in 47 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 04 20:34:22.270649 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-445b26f2-33c5-43d3-a611-296860ae5e44 tempest-AggregatesAdminNegativeTestJSON-907895620 tempest-AggregatesAdminNegativeTestJSON-907895620-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-854823-8"}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:34:22.287872 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-445b26f2-33c5-43d3-a611-296860ae5e44 tempest-AggregatesAdminNegativeTestJSON-907895620 tempest-AggregatesAdminNegativeTestJSON-907895620-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:22.288442 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-445b26f2-33c5-43d3-a611-296860ae5e44 tempest-AggregatesAdminNegativeTestJSON-907895620 tempest-AggregatesAdminNegativeTestJSON-907895620-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:22.288991 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-445b26f2-33c5-43d3-a611-296860ae5e44 tempest-AggregatesAdminNegativeTestJSON-907895620 tempest-AggregatesAdminNegativeTestJSON-907895620-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:22.295513 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=100 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:34:22.406536 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-1ce1ea88-9648-4004-980e-2870206a1e20 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '147d000a331f4a3ba47019fcbae40901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9928be759e34d208d835263d73a5ab5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:22.417418 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-1ce1ea88-9648-4004-980e-2870206a1e20 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] 10.222.0.33 "GET /compute/v2.1/servers/854066a9-9adf-4932-b6a8-c7fe15d8b4da" status: 200 len: 1321 microversion: 2.1 time: 0.250299 Oct 04 20:34:22.432715 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 132/295] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:22 2022] GET /compute/v2.1/servers/854066a9-9adf-4932-b6a8-c7fe15d8b4da => generated 1321 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:34:22.454874 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-445b26f2-33c5-43d3-a611-296860ae5e44 tempest-AggregatesAdminNegativeTestJSON-907895620 tempest-AggregatesAdminNegativeTestJSON-907895620-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates/17/action" status: 200 len: 227 microversion: 2.1 time: 0.188765 Oct 04 20:34:22.455723 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 164/296] 10.222.0.33 () {60 vars in 1194 bytes} [Tue Oct 4 20:34:22 2022] POST /compute/v2.1/os-aggregates/17/action => generated 227 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 20:34:22.468538 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f877ba8f-b987-43f2-b359-5996e5d79a61 tempest-AggregatesAdminNegativeTestJSON-907895620 tempest-AggregatesAdminNegativeTestJSON-907895620-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:22.496612 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f877ba8f-b987-43f2-b359-5996e5d79a61 tempest-AggregatesAdminNegativeTestJSON-907895620 tempest-AggregatesAdminNegativeTestJSON-907895620-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-aggregates/17" status: 200 len: 0 microversion: 2.1 time: 0.032438 Oct 04 20:34:22.497170 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 133/297] 10.222.0.33 () {58 vars in 1155 bytes} [Tue Oct 4 20:34:22 2022] DELETE /compute/v2.1/os-aggregates/17 => generated 0 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Oct 04 20:34:22.510987 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-ba0c090c-8e81-47cb-97c4-17de68695d64 tempest-AggregatesAdminNegativeTestJSON-907895620 tempest-AggregatesAdminNegativeTestJSON-907895620-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-850132000"}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:34:22.515660 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.objects.aggregate [None req-ba0c090c-8e81-47cb-97c4-17de68695d64 tempest-AggregatesAdminNegativeTestJSON-907895620 tempest-AggregatesAdminNegativeTestJSON-907895620-project-admin] Generated uuid 46407c90-3af4-4e3a-84ba-b72c18e91711 for aggregate {{(pid=128802) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 20:34:22.552624 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-ba0c090c-8e81-47cb-97c4-17de68695d64 tempest-AggregatesAdminNegativeTestJSON-907895620 tempest-AggregatesAdminNegativeTestJSON-907895620-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.048448 Oct 04 20:34:22.553509 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e95ff372-d2da-4c07-836b-341280a301ad tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:22.554388 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e95ff372-d2da-4c07-836b-341280a301ad tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] [instance: 9e9f6289-9999-4188-9af1-6cf64a676eee] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:22.558765 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 165/298] 10.222.0.33 () {60 vars in 1164 bytes} [Tue Oct 4 20:34:22 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:34:22.564275 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e95ff372-d2da-4c07-836b-341280a301ad tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:22.566415 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e95ff372-d2da-4c07-836b-341280a301ad tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:22.567291 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e95ff372-d2da-4c07-836b-341280a301ad tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:22.569020 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e95ff372-d2da-4c07-836b-341280a301ad tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:22.569704 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e95ff372-d2da-4c07-836b-341280a301ad tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:22.570364 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e95ff372-d2da-4c07-836b-341280a301ad tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:22.570880 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-1c8df109-3dcb-4d63-ac84-fd857e011e21 tempest-AggregatesAdminNegativeTestJSON-907895620 tempest-AggregatesAdminNegativeTestJSON-907895620-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nonexist_host"}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:34:22.597515 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1c8df109-3dcb-4d63-ac84-fd857e011e21 tempest-AggregatesAdminNegativeTestJSON-907895620 tempest-AggregatesAdminNegativeTestJSON-907895620-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:22.598704 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1c8df109-3dcb-4d63-ac84-fd857e011e21 tempest-AggregatesAdminNegativeTestJSON-907895620 tempest-AggregatesAdminNegativeTestJSON-907895620-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:22.599158 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1c8df109-3dcb-4d63-ac84-fd857e011e21 tempest-AggregatesAdminNegativeTestJSON-907895620 tempest-AggregatesAdminNegativeTestJSON-907895620-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:22.610859 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1c8df109-3dcb-4d63-ac84-fd857e011e21 tempest-AggregatesAdminNegativeTestJSON-907895620 tempest-AggregatesAdminNegativeTestJSON-907895620-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:22.611598 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1c8df109-3dcb-4d63-ac84-fd857e011e21 tempest-AggregatesAdminNegativeTestJSON-907895620 tempest-AggregatesAdminNegativeTestJSON-907895620-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:22.612165 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1c8df109-3dcb-4d63-ac84-fd857e011e21 tempest-AggregatesAdminNegativeTestJSON-907895620 tempest-AggregatesAdminNegativeTestJSON-907895620-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:22.638121 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.compute.aggregates [None req-1c8df109-3dcb-4d63-ac84-fd857e011e21 tempest-AggregatesAdminNegativeTestJSON-907895620 tempest-AggregatesAdminNegativeTestJSON-907895620-project-admin] Failed to remove host nonexist_host from aggregate 18. Error: Compute host nonexist_host could not be found.: nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Oct 04 20:34:22.639115 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=100 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:34:22.639649 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.wsgi [None req-1c8df109-3dcb-4d63-ac84-fd857e011e21 tempest-AggregatesAdminNegativeTestJSON-907895620 tempest-AggregatesAdminNegativeTestJSON-907895620-project-admin] HTTP exception thrown: Cannot remove host nonexist_host in aggregate 18 Oct 04 20:34:22.641882 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-1c8df109-3dcb-4d63-ac84-fd857e011e21 tempest-AggregatesAdminNegativeTestJSON-907895620 tempest-AggregatesAdminNegativeTestJSON-907895620-project-admin] Request method failure captured: Oct 04 20:34:22.641882 n-d-854823-8 devstack@n-api.service[128802]: request: POST /compute/v2.1/os-aggregates/18/action HTTP/1.1 Oct 04 20:34:22.641882 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 20:34:22.641882 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 20:34:22.641882 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 20:34:22.641882 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 42 Oct 04 20:34:22.641882 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 20:34:22.641882 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 20:34:22.641882 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 20:34:22.641882 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 20:34:22.641882 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPJiYwmgLnmZgU1MzYFnwRkduF0U-oNQQTh3pjRStSZ2TluywlUp5tPEuivpXska-qjYpSX-0WyCvYvVlvkppZlUvlo9yw-bcYbzS3R42h8Kfj0P9UglK76WxuBJznfgBC57agfmcBJ_-FPYi5ShkHc6jTym94bNQMwWHqn1QPQSkNoM Oct 04 20:34:22.641882 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 20:34:22.641882 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 20:34:22.641882 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 20:34:22.641882 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 20:34:22.641882 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 20:34:22.641882 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 20:34:22.641882 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: b573d94f756e4a648a155cd95e012741 Oct 04 20:34:22.641882 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-907895620 Oct 04 20:34:22.641882 n-d-854823-8 devstack@n-api.service[128802]: X-Role: admin,reader,member Oct 04 20:34:22.641882 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: admin,reader,member Oct 04 20:34:22.643320 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b573d94f756e4a648a155cd95e012741", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b573d94f756e4a648a155cd95e012741"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b573d94f756e4a648a155cd95e012741"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b573d94f756e4a648a155cd95e012741"}]}] Oct 04 20:34:22.643320 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-907895620 Oct 04 20:34:22.643320 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: b573d94f756e4a648a155cd95e012741 Oct 04 20:34:22.643320 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-907895620 Oct 04 20:34:22.643320 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-AggregatesAdminNegativeTestJSON-907895620-project-admin Oct 04 20:34:22.643320 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 20:34:22.643320 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 20:34:22.643320 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: eefa1a3068aa4287a72e53272745aa2f Oct 04 20:34:22.643320 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-907895620-project-admin Oct 04 20:34:22.643320 n-d-854823-8 devstack@n-api.service[128802]: Oct 04 20:34:22.643320 n-d-854823-8 devstack@n-api.service[128802]: {"remove_host": {"host": "nonexist_host"}} Oct 04 20:34:22.643320 n-d-854823-8 devstack@n-api.service[128802]: method: > Oct 04 20:34:22.643320 n-d-854823-8 devstack@n-api.service[128802]: exception: Cannot remove host nonexist_host in aggregate 18 Oct 04 20:34:22.644175 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'id': '18', 'body': {'remove_host': {'host': 'nonexist_host'}}} Oct 04 20:34:22.644175 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:34:22.644175 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:34:22.644175 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5999, in _get_service_in_cell_by_host Oct 04 20:34:22.644175 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Oct 04 20:34:22.644175 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 20:34:22.644175 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 20:34:22.644175 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 04 20:34:22.644175 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 04 20:34:22.644175 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 20:34:22.644175 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 20:34:22.644175 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 04 20:34:22.644175 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 04 20:34:22.644175 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexist_host' is not mapped to any cell Oct 04 20:34:22.644175 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:34:22.644175 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:34:22.644175 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:34:22.644175 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:34:22.644175 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6005, in _get_service_in_cell_by_host Oct 04 20:34:22.644175 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Oct 04 20:34:22.645469 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 04 20:34:22.645469 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 04 20:34:22.645469 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 04 20:34:22.645469 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:34:22.645469 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:34:22.645469 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:34:22.645469 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:34:22.645469 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 209, in _remove_host Oct 04 20:34:22.645469 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi aggregate = self.api.remove_host_from_aggregate(context, id, host) Oct 04 20:34:22.645469 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 04 20:34:22.645469 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 04 20:34:22.645469 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 20:34:22.645469 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 20:34:22.645469 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 20:34:22.645469 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 20:34:22.645469 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 04 20:34:22.645469 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 04 20:34:22.645469 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6683, in remove_host_from_aggregate Oct 04 20:34:22.645469 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi _get_service_in_cell_by_host(context, host_name) Oct 04 20:34:22.645469 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6007, in _get_service_in_cell_by_host Oct 04 20:34:22.646836 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Oct 04 20:34:22.646836 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Oct 04 20:34:22.646836 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:34:22.646836 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:34:22.646836 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:34:22.646836 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:34:22.646836 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:34:22.646836 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:34:22.646836 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:34:22.646836 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:34:22.646836 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:34:22.646836 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:34:22.646836 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:34:22.646836 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:34:22.646836 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 217, in _remove_host Oct 04 20:34:22.646836 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 04 20:34:22.646836 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Cannot remove host nonexist_host in aggregate 18 Oct 04 20:34:22.646836 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:34:22.646836 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:34:22.646836 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:34:22.646836 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:34:22.648224 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:34:22.648224 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:34:22.648224 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:34:22.648224 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:34:22.648224 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot remove host nonexist_host in aggregate 18 Oct 04 20:34:22.648224 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:34:22.649749 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-1c8df109-3dcb-4d63-ac84-fd857e011e21 tempest-AggregatesAdminNegativeTestJSON-907895620 tempest-AggregatesAdminNegativeTestJSON-907895620-project-admin] Returning 404 to user: Cannot remove host nonexist_host in aggregate 18 {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:34:22.651661 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-1c8df109-3dcb-4d63-ac84-fd857e011e21 tempest-AggregatesAdminNegativeTestJSON-907895620 tempest-AggregatesAdminNegativeTestJSON-907895620-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates/18/action" status: 404 len: 94 microversion: 2.1 time: 0.085105 Oct 04 20:34:22.652422 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 166/299] 10.222.0.33 () {60 vars in 1194 bytes} [Tue Oct 4 20:34:22 2022] POST /compute/v2.1/os-aggregates/18/action => generated 94 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 04 20:34:22.678887 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-9cbe7d34-08f2-49c3-a7d2-3ce11c538e0d tempest-AggregatesAdminNegativeTestJSON-907895620 tempest-AggregatesAdminNegativeTestJSON-907895620-project-admin] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:22.750798 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-9cbe7d34-08f2-49c3-a7d2-3ce11c538e0d tempest-AggregatesAdminNegativeTestJSON-907895620 tempest-AggregatesAdminNegativeTestJSON-907895620-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-aggregates/18" status: 200 len: 0 microversion: 2.1 time: 0.090367 Oct 04 20:34:22.751644 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 167/300] 10.222.0.33 () {58 vars in 1155 bytes} [Tue Oct 4 20:34:22 2022] DELETE /compute/v2.1/os-aggregates/18 => generated 0 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Oct 04 20:34:22.843991 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e95ff372-d2da-4c07-836b-341280a301ad tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3563efe2b8c94931a2a46c4e14811b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3118a5d96843d3bede1ed94bd9717e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:22.857119 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e95ff372-d2da-4c07-836b-341280a301ad tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] 10.222.0.33 "GET /compute/v2.1/servers/9e9f6289-9999-4188-9af1-6cf64a676eee" status: 200 len: 1313 microversion: 2.1 time: 0.313157 Oct 04 20:34:22.858721 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 134/301] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:22 2022] GET /compute/v2.1/servers/9e9f6289-9999-4188-9af1-6cf64a676eee => generated 1313 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:34:22.881708 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-54390b28-c09d-4bdd-aac1-e0855866c5e3 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:22.882378 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-54390b28-c09d-4bdd-aac1-e0855866c5e3 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] [instance: 8fdcb1b0-65e9-45d1-b0da-5f603f22a8cf] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:22.889862 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-54390b28-c09d-4bdd-aac1-e0855866c5e3 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:22.890659 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-54390b28-c09d-4bdd-aac1-e0855866c5e3 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:22.891275 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-54390b28-c09d-4bdd-aac1-e0855866c5e3 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:22.892143 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-54390b28-c09d-4bdd-aac1-e0855866c5e3 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:22.893039 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-54390b28-c09d-4bdd-aac1-e0855866c5e3 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:22.894061 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-54390b28-c09d-4bdd-aac1-e0855866c5e3 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:23.048759 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-54390b28-c09d-4bdd-aac1-e0855866c5e3 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5eda279f6034608b192839a54dda616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f28e80977de42a892b84295ecf05141', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:23.057800 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-54390b28-c09d-4bdd-aac1-e0855866c5e3 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] 10.222.0.33 "GET /compute/v2.1/servers/8fdcb1b0-65e9-45d1-b0da-5f603f22a8cf" status: 200 len: 1587 microversion: 2.1 time: 0.182518 Oct 04 20:34:23.058478 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 168/302] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:22 2022] GET /compute/v2.1/servers/8fdcb1b0-65e9-45d1-b0da-5f603f22a8cf => generated 1587 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:23.086853 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-bd9722f9-026f-46f6-8ef5-6c13f3779d34 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:23.087843 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-bd9722f9-026f-46f6-8ef5-6c13f3779d34 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] [instance: 8fdcb1b0-65e9-45d1-b0da-5f603f22a8cf] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:23.097238 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bd9722f9-026f-46f6-8ef5-6c13f3779d34 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:23.097720 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bd9722f9-026f-46f6-8ef5-6c13f3779d34 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:23.098147 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bd9722f9-026f-46f6-8ef5-6c13f3779d34 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:23.098866 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bd9722f9-026f-46f6-8ef5-6c13f3779d34 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:23.099311 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bd9722f9-026f-46f6-8ef5-6c13f3779d34 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:23.099732 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bd9722f9-026f-46f6-8ef5-6c13f3779d34 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:23.229488 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-bd9722f9-026f-46f6-8ef5-6c13f3779d34 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] 10.222.0.33 "GET /compute/v2.1/servers/8fdcb1b0-65e9-45d1-b0da-5f603f22a8cf/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.147043 Oct 04 20:34:23.230291 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 135/303] 10.222.0.33 () {58 vars in 1275 bytes} [Tue Oct 4 20:34:23 2022] GET /compute/v2.1/servers/8fdcb1b0-65e9-45d1-b0da-5f603f22a8cf/os-interface => generated 285 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:34:23.443979 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-b2aca9bc-bfaf-4a49-b041-eff071021890 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:23.444906 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-b2aca9bc-bfaf-4a49-b041-eff071021890 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] [instance: 854066a9-9adf-4932-b6a8-c7fe15d8b4da] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:23.455440 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b2aca9bc-bfaf-4a49-b041-eff071021890 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:23.456197 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b2aca9bc-bfaf-4a49-b041-eff071021890 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:23.456810 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b2aca9bc-bfaf-4a49-b041-eff071021890 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:23.457710 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b2aca9bc-bfaf-4a49-b041-eff071021890 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:23.458375 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b2aca9bc-bfaf-4a49-b041-eff071021890 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:23.458934 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b2aca9bc-bfaf-4a49-b041-eff071021890 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:23.699329 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-b2aca9bc-bfaf-4a49-b041-eff071021890 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '147d000a331f4a3ba47019fcbae40901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9928be759e34d208d835263d73a5ab5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:23.710253 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-b2aca9bc-bfaf-4a49-b041-eff071021890 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] 10.222.0.33 "GET /compute/v2.1/servers/854066a9-9adf-4932-b6a8-c7fe15d8b4da" status: 200 len: 1321 microversion: 2.1 time: 0.272883 Oct 04 20:34:23.727022 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 169/304] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:23 2022] GET /compute/v2.1/servers/854066a9-9adf-4932-b6a8-c7fe15d8b4da => generated 1321 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:23.881622 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-23b888e4-8bf9-4872-b073-1006936620b2 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:23.882227 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-23b888e4-8bf9-4872-b073-1006936620b2 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] [instance: 9e9f6289-9999-4188-9af1-6cf64a676eee] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:23.894569 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-23b888e4-8bf9-4872-b073-1006936620b2 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:23.895415 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-23b888e4-8bf9-4872-b073-1006936620b2 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:23.895998 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-23b888e4-8bf9-4872-b073-1006936620b2 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:23.896842 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-23b888e4-8bf9-4872-b073-1006936620b2 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:23.902033 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-23b888e4-8bf9-4872-b073-1006936620b2 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:23.902499 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-23b888e4-8bf9-4872-b073-1006936620b2 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:24.351124 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-23b888e4-8bf9-4872-b073-1006936620b2 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3563efe2b8c94931a2a46c4e14811b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3118a5d96843d3bede1ed94bd9717e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:24.369276 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-23b888e4-8bf9-4872-b073-1006936620b2 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] 10.222.0.33 "GET /compute/v2.1/servers/9e9f6289-9999-4188-9af1-6cf64a676eee" status: 200 len: 1463 microversion: 2.1 time: 0.492009 Oct 04 20:34:24.376191 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 136/305] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:23 2022] GET /compute/v2.1/servers/9e9f6289-9999-4188-9af1-6cf64a676eee => generated 1463 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:24.742198 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-af582cdb-5e01-4f52-aa76-52baa4fcbc13 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:24.742979 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-af582cdb-5e01-4f52-aa76-52baa4fcbc13 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] [instance: 854066a9-9adf-4932-b6a8-c7fe15d8b4da] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:24.754299 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-af582cdb-5e01-4f52-aa76-52baa4fcbc13 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:24.757250 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-af582cdb-5e01-4f52-aa76-52baa4fcbc13 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:24.761022 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-af582cdb-5e01-4f52-aa76-52baa4fcbc13 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:24.762085 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-af582cdb-5e01-4f52-aa76-52baa4fcbc13 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:24.764117 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-af582cdb-5e01-4f52-aa76-52baa4fcbc13 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:24.766158 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-af582cdb-5e01-4f52-aa76-52baa4fcbc13 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:24.842515 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-c35c78f1-ee19-4996-9fed-14b4a0961da9 tempest-MigrationsAdminTest-1312330847 tempest-MigrationsAdminTest-1312330847-project-admin] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:24.843784 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-c35c78f1-ee19-4996-9fed-14b4a0961da9 tempest-MigrationsAdminTest-1312330847 tempest-MigrationsAdminTest-1312330847-project-admin] [instance: 9e9f6289-9999-4188-9af1-6cf64a676eee] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:24.861993 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c35c78f1-ee19-4996-9fed-14b4a0961da9 tempest-MigrationsAdminTest-1312330847 tempest-MigrationsAdminTest-1312330847-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:24.862525 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c35c78f1-ee19-4996-9fed-14b4a0961da9 tempest-MigrationsAdminTest-1312330847 tempest-MigrationsAdminTest-1312330847-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:24.864185 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c35c78f1-ee19-4996-9fed-14b4a0961da9 tempest-MigrationsAdminTest-1312330847 tempest-MigrationsAdminTest-1312330847-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:24.866387 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c35c78f1-ee19-4996-9fed-14b4a0961da9 tempest-MigrationsAdminTest-1312330847 tempest-MigrationsAdminTest-1312330847-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:24.867783 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c35c78f1-ee19-4996-9fed-14b4a0961da9 tempest-MigrationsAdminTest-1312330847 tempest-MigrationsAdminTest-1312330847-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:24.869973 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c35c78f1-ee19-4996-9fed-14b4a0961da9 tempest-MigrationsAdminTest-1312330847 tempest-MigrationsAdminTest-1312330847-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:25.106385 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-af582cdb-5e01-4f52-aa76-52baa4fcbc13 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '147d000a331f4a3ba47019fcbae40901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9928be759e34d208d835263d73a5ab5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:25.117966 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-af582cdb-5e01-4f52-aa76-52baa4fcbc13 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] 10.222.0.33 "GET /compute/v2.1/servers/854066a9-9adf-4932-b6a8-c7fe15d8b4da" status: 200 len: 1321 microversion: 2.1 time: 0.380961 Oct 04 20:34:25.118842 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 137/306] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:24 2022] GET /compute/v2.1/servers/854066a9-9adf-4932-b6a8-c7fe15d8b4da => generated 1321 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:25.135024 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-a158979b-a3f0-4af5-8812-332642ed08bf req-361b6667-428e-4a8c-8074-0cb064211cd8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "854066a9-9adf-4932-b6a8-c7fe15d8b4da", "name": "network-vif-plugged", "status": "completed", "tag": "625db1ef-3c70-4d5f-9bbc-444eb15b7d8c"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:34:25.149571 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-a158979b-a3f0-4af5-8812-332642ed08bf req-361b6667-428e-4a8c-8074-0cb064211cd8 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:25.154502 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-a158979b-a3f0-4af5-8812-332642ed08bf req-361b6667-428e-4a8c-8074-0cb064211cd8 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:25.155090 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-a158979b-a3f0-4af5-8812-332642ed08bf req-361b6667-428e-4a8c-8074-0cb064211cd8 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:25.186500 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-a158979b-a3f0-4af5-8812-332642ed08bf req-361b6667-428e-4a8c-8074-0cb064211cd8 service nova] Creating event network-vif-plugged:625db1ef-3c70-4d5f-9bbc-444eb15b7d8c for instance 854066a9-9adf-4932-b6a8-c7fe15d8b4da on n-h2-854823-8 Oct 04 20:34:25.199872 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-a158979b-a3f0-4af5-8812-332642ed08bf req-361b6667-428e-4a8c-8074-0cb064211cd8 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079508 Oct 04 20:34:25.201718 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 138/307] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:34:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:34:25.484547 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-c35c78f1-ee19-4996-9fed-14b4a0961da9 tempest-MigrationsAdminTest-1312330847 tempest-MigrationsAdminTest-1312330847-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/9e9f6289-9999-4188-9af1-6cf64a676eee" status: 200 len: 1614 microversion: 2.1 time: 1.086033 Oct 04 20:34:25.487569 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 170/308] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:24 2022] GET /compute/v2.1/servers/9e9f6289-9999-4188-9af1-6cf64a676eee => generated 1614 bytes in 1091 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:25.497477 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-0d6f2b72-22e7-4061-a9b8-70b9455a1357 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:25.500250 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-0d6f2b72-22e7-4061-a9b8-70b9455a1357 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] [instance: 8fdcb1b0-65e9-45d1-b0da-5f603f22a8cf] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:25.517281 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0d6f2b72-22e7-4061-a9b8-70b9455a1357 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:25.518172 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0d6f2b72-22e7-4061-a9b8-70b9455a1357 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:25.519134 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0d6f2b72-22e7-4061-a9b8-70b9455a1357 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:25.520341 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0d6f2b72-22e7-4061-a9b8-70b9455a1357 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:25.520982 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0d6f2b72-22e7-4061-a9b8-70b9455a1357 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:25.521631 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0d6f2b72-22e7-4061-a9b8-70b9455a1357 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:25.714036 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-0d6f2b72-22e7-4061-a9b8-70b9455a1357 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5eda279f6034608b192839a54dda616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f28e80977de42a892b84295ecf05141', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:25.722191 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-0d6f2b72-22e7-4061-a9b8-70b9455a1357 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] 10.222.0.33 "GET /compute/v2.1/servers/8fdcb1b0-65e9-45d1-b0da-5f603f22a8cf" status: 200 len: 1587 microversion: 2.1 time: 0.233362 Oct 04 20:34:25.723315 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 171/309] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:25 2022] GET /compute/v2.1/servers/8fdcb1b0-65e9-45d1-b0da-5f603f22a8cf => generated 1587 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:25.742121 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-719000d9-fef8-4605-85db-b4a4229fe0a9 req-b23c45da-4874-4701-b599-ca9929ed1b73 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8fdcb1b0-65e9-45d1-b0da-5f603f22a8cf", "tag": "b156b57a-987c-484d-9b1a-ed22e9a62872"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:34:25.756636 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-719000d9-fef8-4605-85db-b4a4229fe0a9 req-b23c45da-4874-4701-b599-ca9929ed1b73 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:25.757537 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-719000d9-fef8-4605-85db-b4a4229fe0a9 req-b23c45da-4874-4701-b599-ca9929ed1b73 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:25.758255 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-719000d9-fef8-4605-85db-b4a4229fe0a9 req-b23c45da-4874-4701-b599-ca9929ed1b73 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:25.774185 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-719000d9-fef8-4605-85db-b4a4229fe0a9 req-b23c45da-4874-4701-b599-ca9929ed1b73 service nova] Creating event network-changed:b156b57a-987c-484d-9b1a-ed22e9a62872 for instance 8fdcb1b0-65e9-45d1-b0da-5f603f22a8cf on n-h2-854823-8 Oct 04 20:34:25.780418 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-719000d9-fef8-4605-85db-b4a4229fe0a9 req-b23c45da-4874-4701-b599-ca9929ed1b73 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055848 Oct 04 20:34:25.781135 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 172/310] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:34:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:34:25.786583 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-b4d9d394-e201-4638-8d17-8508ba8354c7 tempest-MigrationsAdminTest-1312330847 tempest-MigrationsAdminTest-1312330847-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:34:25.787464 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-b4d9d394-e201-4638-8d17-8508ba8354c7 tempest-MigrationsAdminTest-1312330847 tempest-MigrationsAdminTest-1312330847-project-admin] [instance: 9e9f6289-9999-4188-9af1-6cf64a676eee] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:25.795580 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b4d9d394-e201-4638-8d17-8508ba8354c7 tempest-MigrationsAdminTest-1312330847 tempest-MigrationsAdminTest-1312330847-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:25.796068 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b4d9d394-e201-4638-8d17-8508ba8354c7 tempest-MigrationsAdminTest-1312330847 tempest-MigrationsAdminTest-1312330847-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:25.800024 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b4d9d394-e201-4638-8d17-8508ba8354c7 tempest-MigrationsAdminTest-1312330847 tempest-MigrationsAdminTest-1312330847-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:25.800843 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b4d9d394-e201-4638-8d17-8508ba8354c7 tempest-MigrationsAdminTest-1312330847 tempest-MigrationsAdminTest-1312330847-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:25.801494 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b4d9d394-e201-4638-8d17-8508ba8354c7 tempest-MigrationsAdminTest-1312330847 tempest-MigrationsAdminTest-1312330847-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:25.802303 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b4d9d394-e201-4638-8d17-8508ba8354c7 tempest-MigrationsAdminTest-1312330847 tempest-MigrationsAdminTest-1312330847-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:25.864344 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9bf9bb3c-d177-41c0-b495-1ab1f9a32965 tempest-HypervisorAdminV253TestBase-2003230353 tempest-HypervisorAdminV253TestBase-2003230353-project-admin] Calling method '.version_select at 0x7f3c751da670>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:25.869498 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9bf9bb3c-d177-41c0-b495-1ab1f9a32965 tempest-HypervisorAdminV253TestBase-2003230353 tempest-HypervisorAdminV253TestBase-2003230353-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:25.869997 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9bf9bb3c-d177-41c0-b495-1ab1f9a32965 tempest-HypervisorAdminV253TestBase-2003230353 tempest-HypervisorAdminV253TestBase-2003230353-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:25.870460 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9bf9bb3c-d177-41c0-b495-1ab1f9a32965 tempest-HypervisorAdminV253TestBase-2003230353 tempest-HypervisorAdminV253TestBase-2003230353-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:25.915945 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9bf9bb3c-d177-41c0-b495-1ab1f9a32965 tempest-HypervisorAdminV253TestBase-2003230353 tempest-HypervisorAdminV253TestBase-2003230353-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:25.916427 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9bf9bb3c-d177-41c0-b495-1ab1f9a32965 tempest-HypervisorAdminV253TestBase-2003230353 tempest-HypervisorAdminV253TestBase-2003230353-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:25.916963 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9bf9bb3c-d177-41c0-b495-1ab1f9a32965 tempest-HypervisorAdminV253TestBase-2003230353 tempest-HypervisorAdminV253TestBase-2003230353-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:25.958159 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9bf9bb3c-d177-41c0-b495-1ab1f9a32965 tempest-HypervisorAdminV253TestBase-2003230353 tempest-HypervisorAdminV253TestBase-2003230353-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:25.959058 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9bf9bb3c-d177-41c0-b495-1ab1f9a32965 tempest-HypervisorAdminV253TestBase-2003230353 tempest-HypervisorAdminV253TestBase-2003230353-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:25.959497 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9bf9bb3c-d177-41c0-b495-1ab1f9a32965 tempest-HypervisorAdminV253TestBase-2003230353 tempest-HypervisorAdminV253TestBase-2003230353-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:25.977544 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9bf9bb3c-d177-41c0-b495-1ab1f9a32965 tempest-HypervisorAdminV253TestBase-2003230353 tempest-HypervisorAdminV253TestBase-2003230353-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:25.979015 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9bf9bb3c-d177-41c0-b495-1ab1f9a32965 tempest-HypervisorAdminV253TestBase-2003230353 tempest-HypervisorAdminV253TestBase-2003230353-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:25.979786 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9bf9bb3c-d177-41c0-b495-1ab1f9a32965 tempest-HypervisorAdminV253TestBase-2003230353 tempest-HypervisorAdminV253TestBase-2003230353-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:26.020543 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9bf9bb3c-d177-41c0-b495-1ab1f9a32965 tempest-HypervisorAdminV253TestBase-2003230353 tempest-HypervisorAdminV253TestBase-2003230353-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:26.021389 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9bf9bb3c-d177-41c0-b495-1ab1f9a32965 tempest-HypervisorAdminV253TestBase-2003230353 tempest-HypervisorAdminV253TestBase-2003230353-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:26.022846 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9bf9bb3c-d177-41c0-b495-1ab1f9a32965 tempest-HypervisorAdminV253TestBase-2003230353 tempest-HypervisorAdminV253TestBase-2003230353-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:26.032503 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-9bf9bb3c-d177-41c0-b495-1ab1f9a32965 tempest-HypervisorAdminV253TestBase-2003230353 tempest-HypervisorAdminV253TestBase-2003230353-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors/detail?with_servers=True" status: 200 len: 1836 microversion: 2.53 time: 0.661036 Oct 04 20:34:26.034278 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 139/311] 10.222.0.33 () {60 vars in 1243 bytes} [Tue Oct 4 20:34:25 2022] GET /compute/v2.1/os-hypervisors/detail?with_servers=True => generated 1836 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:34:26.052123 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-936a222f-c4bf-4f23-8e62-d5f59d7b4bc6 tempest-HypervisorAdminV253TestBase-2003230353 tempest-HypervisorAdminV253TestBase-2003230353-project-admin] Calling method '.version_select at 0x7f3c752554c0>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:26.057327 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-936a222f-c4bf-4f23-8e62-d5f59d7b4bc6 tempest-HypervisorAdminV253TestBase-2003230353 tempest-HypervisorAdminV253TestBase-2003230353-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:26.057972 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-936a222f-c4bf-4f23-8e62-d5f59d7b4bc6 tempest-HypervisorAdminV253TestBase-2003230353 tempest-HypervisorAdminV253TestBase-2003230353-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:26.058425 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-936a222f-c4bf-4f23-8e62-d5f59d7b4bc6 tempest-HypervisorAdminV253TestBase-2003230353 tempest-HypervisorAdminV253TestBase-2003230353-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:26.079472 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-936a222f-c4bf-4f23-8e62-d5f59d7b4bc6 tempest-HypervisorAdminV253TestBase-2003230353 tempest-HypervisorAdminV253TestBase-2003230353-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:26.079990 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-936a222f-c4bf-4f23-8e62-d5f59d7b4bc6 tempest-HypervisorAdminV253TestBase-2003230353 tempest-HypervisorAdminV253TestBase-2003230353-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:26.080417 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-936a222f-c4bf-4f23-8e62-d5f59d7b4bc6 tempest-HypervisorAdminV253TestBase-2003230353 tempest-HypervisorAdminV253TestBase-2003230353-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:26.104196 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-936a222f-c4bf-4f23-8e62-d5f59d7b4bc6 tempest-HypervisorAdminV253TestBase-2003230353 tempest-HypervisorAdminV253TestBase-2003230353-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:26.104928 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-936a222f-c4bf-4f23-8e62-d5f59d7b4bc6 tempest-HypervisorAdminV253TestBase-2003230353 tempest-HypervisorAdminV253TestBase-2003230353-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:26.106088 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-936a222f-c4bf-4f23-8e62-d5f59d7b4bc6 tempest-HypervisorAdminV253TestBase-2003230353 tempest-HypervisorAdminV253TestBase-2003230353-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:26.119022 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-936a222f-c4bf-4f23-8e62-d5f59d7b4bc6 tempest-HypervisorAdminV253TestBase-2003230353 tempest-HypervisorAdminV253TestBase-2003230353-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:26.120478 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-936a222f-c4bf-4f23-8e62-d5f59d7b4bc6 tempest-HypervisorAdminV253TestBase-2003230353 tempest-HypervisorAdminV253TestBase-2003230353-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:26.121091 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-936a222f-c4bf-4f23-8e62-d5f59d7b4bc6 tempest-HypervisorAdminV253TestBase-2003230353 tempest-HypervisorAdminV253TestBase-2003230353-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:26.144514 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-936a222f-c4bf-4f23-8e62-d5f59d7b4bc6 tempest-HypervisorAdminV253TestBase-2003230353 tempest-HypervisorAdminV253TestBase-2003230353-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:26.145347 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-936a222f-c4bf-4f23-8e62-d5f59d7b4bc6 tempest-HypervisorAdminV253TestBase-2003230353 tempest-HypervisorAdminV253TestBase-2003230353-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:26.145933 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-936a222f-c4bf-4f23-8e62-d5f59d7b4bc6 tempest-HypervisorAdminV253TestBase-2003230353 tempest-HypervisorAdminV253TestBase-2003230353-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:26.153174 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-936a222f-c4bf-4f23-8e62-d5f59d7b4bc6 tempest-HypervisorAdminV253TestBase-2003230353 tempest-HypervisorAdminV253TestBase-2003230353-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors?with_servers=True" status: 200 len: 528 microversion: 2.53 time: 0.104974 Oct 04 20:34:26.154889 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 140/312] 10.222.0.33 () {60 vars in 1222 bytes} [Tue Oct 4 20:34:26 2022] GET /compute/v2.1/os-hypervisors?with_servers=True => generated 528 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 04 20:34:26.159865 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-4d9d1fb1-601a-49ce-a8bb-1eff47043fc2 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:26.160764 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-4d9d1fb1-601a-49ce-a8bb-1eff47043fc2 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] [instance: 854066a9-9adf-4932-b6a8-c7fe15d8b4da] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:26.170865 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4d9d1fb1-601a-49ce-a8bb-1eff47043fc2 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:26.171600 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4d9d1fb1-601a-49ce-a8bb-1eff47043fc2 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:26.172217 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4d9d1fb1-601a-49ce-a8bb-1eff47043fc2 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:26.173095 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4d9d1fb1-601a-49ce-a8bb-1eff47043fc2 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:26.173721 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4d9d1fb1-601a-49ce-a8bb-1eff47043fc2 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:26.174443 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4d9d1fb1-601a-49ce-a8bb-1eff47043fc2 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:26.402243 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-4d9d1fb1-601a-49ce-a8bb-1eff47043fc2 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '147d000a331f4a3ba47019fcbae40901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9928be759e34d208d835263d73a5ab5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:26.413722 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-4d9d1fb1-601a-49ce-a8bb-1eff47043fc2 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] 10.222.0.33 "GET /compute/v2.1/servers/854066a9-9adf-4932-b6a8-c7fe15d8b4da" status: 200 len: 1321 microversion: 2.1 time: 0.257594 Oct 04 20:34:26.415899 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 141/313] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:26 2022] GET /compute/v2.1/servers/854066a9-9adf-4932-b6a8-c7fe15d8b4da => generated 1321 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:26.421694 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a0cf0628-4696-4211-8933-0c19d494f8a9 tempest-HypervisorAdminV253TestBase-2003230353 tempest-HypervisorAdminV253TestBase-2003230353-project-admin] Calling method '.version_select at 0x7f3c7517ad30>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:26.425320 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a0cf0628-4696-4211-8933-0c19d494f8a9 tempest-HypervisorAdminV253TestBase-2003230353 tempest-HypervisorAdminV253TestBase-2003230353-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:26.425822 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a0cf0628-4696-4211-8933-0c19d494f8a9 tempest-HypervisorAdminV253TestBase-2003230353 tempest-HypervisorAdminV253TestBase-2003230353-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:26.426394 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a0cf0628-4696-4211-8933-0c19d494f8a9 tempest-HypervisorAdminV253TestBase-2003230353 tempest-HypervisorAdminV253TestBase-2003230353-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:26.471996 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a0cf0628-4696-4211-8933-0c19d494f8a9 tempest-HypervisorAdminV253TestBase-2003230353 tempest-HypervisorAdminV253TestBase-2003230353-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:26.475315 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a0cf0628-4696-4211-8933-0c19d494f8a9 tempest-HypervisorAdminV253TestBase-2003230353 tempest-HypervisorAdminV253TestBase-2003230353-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:26.475847 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a0cf0628-4696-4211-8933-0c19d494f8a9 tempest-HypervisorAdminV253TestBase-2003230353 tempest-HypervisorAdminV253TestBase-2003230353-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:26.491039 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a0cf0628-4696-4211-8933-0c19d494f8a9 tempest-HypervisorAdminV253TestBase-2003230353 tempest-HypervisorAdminV253TestBase-2003230353-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors/8de326d3-3deb-471b-911d-3b44a5306325" status: 200 len: 792 microversion: 2.53 time: 0.073280 Oct 04 20:34:26.502933 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 142/314] 10.222.0.33 () {60 vars in 1298 bytes} [Tue Oct 4 20:34:26 2022] GET /compute/v2.1/os-hypervisors/8de326d3-3deb-471b-911d-3b44a5306325 => generated 792 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 20:34:26.785278 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-b4d9d394-e201-4638-8d17-8508ba8354c7 tempest-MigrationsAdminTest-1312330847 tempest-MigrationsAdminTest-1312330847-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'c99257ede776423ea801536531a3ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '469f672650854ebd85443dc8dffd96d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:26.786008 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-b4d9d394-e201-4638-8d17-8508ba8354c7 tempest-MigrationsAdminTest-1312330847 tempest-MigrationsAdminTest-1312330847-project-admin] [instance: 9e9f6289-9999-4188-9af1-6cf64a676eee] flavor_id is None. Assuming migration. {{(pid=128802) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 04 20:34:26.787234 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-b4d9d394-e201-4638-8d17-8508ba8354c7 tempest-MigrationsAdminTest-1312330847 tempest-MigrationsAdminTest-1312330847-project-admin] [instance: 9e9f6289-9999-4188-9af1-6cf64a676eee] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=128802) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 04 20:34:27.140054 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-b4d9d394-e201-4638-8d17-8508ba8354c7 tempest-MigrationsAdminTest-1312330847 tempest-MigrationsAdminTest-1312330847-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/9e9f6289-9999-4188-9af1-6cf64a676eee/action" status: 202 len: 0 microversion: 2.1 time: 1.357493 Oct 04 20:34:27.140771 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 173/315] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 20:34:25 2022] POST /compute/v2.1/servers/9e9f6289-9999-4188-9af1-6cf64a676eee/action => generated 0 bytes in 1359 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:34:27.152469 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-7081c1ba-7031-4775-9aeb-72bc71aa99f2 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:27.153215 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-7081c1ba-7031-4775-9aeb-72bc71aa99f2 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] [instance: 9e9f6289-9999-4188-9af1-6cf64a676eee] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:27.176751 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7081c1ba-7031-4775-9aeb-72bc71aa99f2 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:27.180323 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7081c1ba-7031-4775-9aeb-72bc71aa99f2 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:27.182030 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7081c1ba-7031-4775-9aeb-72bc71aa99f2 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:27.183367 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7081c1ba-7031-4775-9aeb-72bc71aa99f2 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:27.185711 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7081c1ba-7031-4775-9aeb-72bc71aa99f2 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:27.187418 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7081c1ba-7031-4775-9aeb-72bc71aa99f2 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:27.390873 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-bc9625b5-e87a-4ab5-a5f9-ad8634342873 tempest-AZAdminV2TestJSON-688392604 tempest-AZAdminV2TestJSON-688392604-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:27.392405 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bc9625b5-e87a-4ab5-a5f9-ad8634342873 tempest-AZAdminV2TestJSON-688392604 tempest-AZAdminV2TestJSON-688392604-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:27.392878 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bc9625b5-e87a-4ab5-a5f9-ad8634342873 tempest-AZAdminV2TestJSON-688392604 tempest-AZAdminV2TestJSON-688392604-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:27.393300 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bc9625b5-e87a-4ab5-a5f9-ad8634342873 tempest-AZAdminV2TestJSON-688392604 tempest-AZAdminV2TestJSON-688392604-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:27.394018 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bc9625b5-e87a-4ab5-a5f9-ad8634342873 tempest-AZAdminV2TestJSON-688392604 tempest-AZAdminV2TestJSON-688392604-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:27.394494 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bc9625b5-e87a-4ab5-a5f9-ad8634342873 tempest-AZAdminV2TestJSON-688392604 tempest-AZAdminV2TestJSON-688392604-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:27.394907 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bc9625b5-e87a-4ab5-a5f9-ad8634342873 tempest-AZAdminV2TestJSON-688392604 tempest-AZAdminV2TestJSON-688392604-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:27.395238 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-7081c1ba-7031-4775-9aeb-72bc71aa99f2 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3563efe2b8c94931a2a46c4e14811b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3118a5d96843d3bede1ed94bd9717e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:27.407603 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-7081c1ba-7031-4775-9aeb-72bc71aa99f2 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] 10.222.0.33 "GET /compute/v2.1/servers/9e9f6289-9999-4188-9af1-6cf64a676eee" status: 200 len: 1472 microversion: 2.1 time: 0.260957 Oct 04 20:34:27.408195 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 174/316] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:27 2022] GET /compute/v2.1/servers/9e9f6289-9999-4188-9af1-6cf64a676eee => generated 1472 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:27.419765 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-bc9625b5-e87a-4ab5-a5f9-ad8634342873 tempest-AZAdminV2TestJSON-688392604 tempest-AZAdminV2TestJSON-688392604-project-admin] 10.222.0.33 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.755622 Oct 04 20:34:27.427300 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 143/317] 10.222.0.33 () {58 vars in 1164 bytes} [Tue Oct 4 20:34:26 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 20:34:27.433547 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c342142d-8d59-4126-9b47-d6e8959a5ed1 tempest-AZAdminV2TestJSON-688392604 tempest-AZAdminV2TestJSON-688392604-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:27.435502 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c342142d-8d59-4126-9b47-d6e8959a5ed1 tempest-AZAdminV2TestJSON-688392604 tempest-AZAdminV2TestJSON-688392604-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:27.435966 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c342142d-8d59-4126-9b47-d6e8959a5ed1 tempest-AZAdminV2TestJSON-688392604 tempest-AZAdminV2TestJSON-688392604-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:27.436408 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c342142d-8d59-4126-9b47-d6e8959a5ed1 tempest-AZAdminV2TestJSON-688392604 tempest-AZAdminV2TestJSON-688392604-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:27.437218 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c342142d-8d59-4126-9b47-d6e8959a5ed1 tempest-AZAdminV2TestJSON-688392604 tempest-AZAdminV2TestJSON-688392604-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:27.437669 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c342142d-8d59-4126-9b47-d6e8959a5ed1 tempest-AZAdminV2TestJSON-688392604 tempest-AZAdminV2TestJSON-688392604-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:27.438084 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c342142d-8d59-4126-9b47-d6e8959a5ed1 tempest-AZAdminV2TestJSON-688392604 tempest-AZAdminV2TestJSON-688392604-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:27.462079 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c342142d-8d59-4126-9b47-d6e8959a5ed1 tempest-AZAdminV2TestJSON-688392604 tempest-AZAdminV2TestJSON-688392604-project-admin] 10.222.0.33 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 612 microversion: 2.1 time: 0.032736 Oct 04 20:34:27.463766 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 144/318] 10.222.0.33 () {58 vars in 1185 bytes} [Tue Oct 4 20:34:27 2022] GET /compute/v2.1/os-availability-zone/detail => generated 612 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:34:27.478878 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ebce2cec-60ce-4c0d-8508-bf08f7d9c382 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:27.479522 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ebce2cec-60ce-4c0d-8508-bf08f7d9c382 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] [instance: 854066a9-9adf-4932-b6a8-c7fe15d8b4da] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:27.487047 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ebce2cec-60ce-4c0d-8508-bf08f7d9c382 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:27.487534 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ebce2cec-60ce-4c0d-8508-bf08f7d9c382 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:27.488127 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ebce2cec-60ce-4c0d-8508-bf08f7d9c382 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:27.489134 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ebce2cec-60ce-4c0d-8508-bf08f7d9c382 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:27.489970 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ebce2cec-60ce-4c0d-8508-bf08f7d9c382 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:27.490577 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ebce2cec-60ce-4c0d-8508-bf08f7d9c382 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:27.768991 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-ebce2cec-60ce-4c0d-8508-bf08f7d9c382 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '147d000a331f4a3ba47019fcbae40901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9928be759e34d208d835263d73a5ab5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:27.770157 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-c086332a-9032-4251-bcb8-692d4ff65663 tempest-QuotasAdminTestV257-1665818662 tempest-QuotasAdminTestV257-1665818662-project-admin] Action: 'update', calling method: .version_select at 0x7f3c750feca0>, body: {"quota_set": {"ram": "5120"}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:34:27.780024 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ebce2cec-60ce-4c0d-8508-bf08f7d9c382 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] 10.222.0.33 "GET /compute/v2.1/servers/854066a9-9adf-4932-b6a8-c7fe15d8b4da" status: 200 len: 1471 microversion: 2.1 time: 0.315079 Oct 04 20:34:27.782618 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 145/319] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:27 2022] GET /compute/v2.1/servers/854066a9-9adf-4932-b6a8-c7fe15d8b4da => generated 1471 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:28.238771 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6270e43d-ea96-4511-a2ff-c2e7fa15dbe9 tempest-ServersAdminNegativeTestJSON-129976034 tempest-ServersAdminNegativeTestJSON-129976034-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:34:28.239775 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-6270e43d-ea96-4511-a2ff-c2e7fa15dbe9 tempest-ServersAdminNegativeTestJSON-129976034 tempest-ServersAdminNegativeTestJSON-129976034-project-admin] [instance: 8f914de4-3afd-4ca8-80b0-6fc656805970] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:28.266938 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-6270e43d-ea96-4511-a2ff-c2e7fa15dbe9 tempest-ServersAdminNegativeTestJSON-129976034 tempest-ServersAdminNegativeTestJSON-129976034-project-admin] HTTP exception thrown: Instance 8f914de4-3afd-4ca8-80b0-6fc656805970 could not be found. Oct 04 20:34:28.271872 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6270e43d-ea96-4511-a2ff-c2e7fa15dbe9 tempest-ServersAdminNegativeTestJSON-129976034 tempest-ServersAdminNegativeTestJSON-129976034-project-admin] Request method failure captured: Oct 04 20:34:28.271872 n-d-854823-8 devstack@n-api.service[128801]: request: POST /compute/v2.1/servers/8f914de4-3afd-4ca8-80b0-6fc656805970/action HTTP/1.1 Oct 04 20:34:28.271872 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:34:28.271872 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:34:28.271872 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:34:28.271872 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 15 Oct 04 20:34:28.271872 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:34:28.271872 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:34:28.271872 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:34:28.271872 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:34:28.271872 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJi90Cg5yc5SzRNIp7yXOltFlDkxRR_GNs4yqNCbELjV3iDGXYvk5AjD9rmeMVv09r8eOB_pjqbF1KTpLwCPg7Jhd8OW4fF12sT3DO51HCMgAWmPxUaHTwl52SMcROL4Soq4KAgzWokn8vfrxsnAZkFp05oPv85kRzgSv_X-PFrVJ5k Oct 04 20:34:28.271872 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:34:28.271872 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:34:28.271872 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:34:28.271872 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:34:28.271872 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:34:28.271872 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:34:28.271872 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: cb3cd184a54f4e29a216eb156027c8ff Oct 04 20:34:28.271872 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-129976034 Oct 04 20:34:28.271872 n-d-854823-8 devstack@n-api.service[128801]: X-Role: admin,reader,member Oct 04 20:34:28.271872 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: admin,reader,member Oct 04 20:34:28.272992 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_cb3cd184a54f4e29a216eb156027c8ff", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cb3cd184a54f4e29a216eb156027c8ff"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cb3cd184a54f4e29a216eb156027c8ff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/cb3cd184a54f4e29a216eb156027c8ff"}]}] Oct 04 20:34:28.272992 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-ServersAdminNegativeTestJSON-129976034 Oct 04 20:34:28.272992 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: cb3cd184a54f4e29a216eb156027c8ff Oct 04 20:34:28.272992 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-129976034 Oct 04 20:34:28.272992 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-ServersAdminNegativeTestJSON-129976034-project-admin Oct 04 20:34:28.272992 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:34:28.272992 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:34:28.272992 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: d1e3450803564757bad42c40de9fe6af Oct 04 20:34:28.272992 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-ServersAdminNegativeTestJSON-129976034-project-admin Oct 04 20:34:28.272992 n-d-854823-8 devstack@n-api.service[128801]: Oct 04 20:34:28.272992 n-d-854823-8 devstack@n-api.service[128801]: {"migrate": {}} Oct 04 20:34:28.272992 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 20:34:28.272992 n-d-854823-8 devstack@n-api.service[128801]: exception: Instance 8f914de4-3afd-4ca8-80b0-6fc656805970 could not be found. Oct 04 20:34:28.273805 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': '8f914de4-3afd-4ca8-80b0-6fc656805970', 'body': {'migrate': {}}} Oct 04 20:34:28.273805 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:34:28.273805 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:34:28.273805 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:34:28.273805 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:34:28.273805 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:34:28.273805 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:34:28.273805 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 20:34:28.273805 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 20:34:28.273805 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f914de4-3afd-4ca8-80b0-6fc656805970 could not be found. Oct 04 20:34:28.273805 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:34:28.273805 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:34:28.273805 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:34:28.273805 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:34:28.273805 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:34:28.273805 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:34:28.273805 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:34:28.273805 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:34:28.273805 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:34:28.273805 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:34:28.275568 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:34:28.275568 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:34:28.275568 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 47, in _migrate Oct 04 20:34:28.275568 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id, Oct 04 20:34:28.275568 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:34:28.275568 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:34:28.275568 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f914de4-3afd-4ca8-80b0-6fc656805970 could not be found. Oct 04 20:34:28.275568 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:34:28.275568 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:34:28.275568 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:34:28.275568 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:34:28.275568 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:34:28.275568 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:34:28.275568 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:34:28.275568 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:34:28.275568 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f914de4-3afd-4ca8-80b0-6fc656805970 could not be found. Oct 04 20:34:28.275568 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:34:28.276462 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6270e43d-ea96-4511-a2ff-c2e7fa15dbe9 tempest-ServersAdminNegativeTestJSON-129976034 tempest-ServersAdminNegativeTestJSON-129976034-project-admin] Returning 404 to user: Instance 8f914de4-3afd-4ca8-80b0-6fc656805970 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:34:28.277730 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-6270e43d-ea96-4511-a2ff-c2e7fa15dbe9 tempest-ServersAdminNegativeTestJSON-129976034 tempest-ServersAdminNegativeTestJSON-129976034-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/8f914de4-3afd-4ca8-80b0-6fc656805970/action" status: 404 len: 111 microversion: 2.1 time: 0.475644 Oct 04 20:34:28.279358 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 146/320] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 20:34:27 2022] POST /compute/v2.1/servers/8f914de4-3afd-4ca8-80b0-6fc656805970/action => generated 111 bytes in 479 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 20:34:28.437352 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-dd2c3b59-d022-440a-a8de-17873d0f7800 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:28.441142 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-dd2c3b59-d022-440a-a8de-17873d0f7800 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] [instance: 9e9f6289-9999-4188-9af1-6cf64a676eee] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:28.456689 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c086332a-9032-4251-bcb8-692d4ff65663 tempest-QuotasAdminTestV257-1665818662 tempest-QuotasAdminTestV257-1665818662-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:28.457534 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c086332a-9032-4251-bcb8-692d4ff65663 tempest-QuotasAdminTestV257-1665818662 tempest-QuotasAdminTestV257-1665818662-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:28.458065 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c086332a-9032-4251-bcb8-692d4ff65663 tempest-QuotasAdminTestV257-1665818662 tempest-QuotasAdminTestV257-1665818662-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:28.460070 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c086332a-9032-4251-bcb8-692d4ff65663 tempest-QuotasAdminTestV257-1665818662 tempest-QuotasAdminTestV257-1665818662-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:28.460604 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dd2c3b59-d022-440a-a8de-17873d0f7800 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:28.461360 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c086332a-9032-4251-bcb8-692d4ff65663 tempest-QuotasAdminTestV257-1665818662 tempest-QuotasAdminTestV257-1665818662-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:28.461971 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dd2c3b59-d022-440a-a8de-17873d0f7800 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:28.463037 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c086332a-9032-4251-bcb8-692d4ff65663 tempest-QuotasAdminTestV257-1665818662 tempest-QuotasAdminTestV257-1665818662-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:28.464529 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dd2c3b59-d022-440a-a8de-17873d0f7800 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:28.467003 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dd2c3b59-d022-440a-a8de-17873d0f7800 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:28.467518 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dd2c3b59-d022-440a-a8de-17873d0f7800 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:28.469338 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dd2c3b59-d022-440a-a8de-17873d0f7800 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:28.598643 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-c086332a-9032-4251-bcb8-692d4ff65663 tempest-QuotasAdminTestV257-1665818662 tempest-QuotasAdminTestV257-1665818662-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-quota-sets/d63c4b21b61d4d64bb7689e17821fa8a" status: 200 len: 148 microversion: 2.57 time: 1.188846 Oct 04 20:34:28.599268 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 175/321] 10.222.0.33 () {62 vars in 1303 bytes} [Tue Oct 4 20:34:27 2022] PUT /compute/v2.1/os-quota-sets/d63c4b21b61d4d64bb7689e17821fa8a => generated 148 bytes in 1190 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 20:34:28.611522 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-d1a9885a-d930-4cbe-8812-8093c459d757 tempest-QuotasAdminTestV257-1665818662 tempest-QuotasAdminTestV257-1665818662-project-admin] Calling method '.version_select at 0x7f3c752e2160>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:28.730773 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-dd2c3b59-d022-440a-a8de-17873d0f7800 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3563efe2b8c94931a2a46c4e14811b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3118a5d96843d3bede1ed94bd9717e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:28.741498 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-dd2c3b59-d022-440a-a8de-17873d0f7800 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] 10.222.0.33 "GET /compute/v2.1/servers/9e9f6289-9999-4188-9af1-6cf64a676eee" status: 200 len: 1472 microversion: 2.1 time: 0.310800 Oct 04 20:34:28.743020 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 147/322] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:28 2022] GET /compute/v2.1/servers/9e9f6289-9999-4188-9af1-6cf64a676eee => generated 1472 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:28.763662 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-217d2604-e78c-4ed2-8bc0-b93b198bc2c0 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-960222778", "imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63", "flavorRef": "452"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:34:28.848285 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.network.neutron [None req-217d2604-e78c-4ed2-8bc0-b93b198bc2c0 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] validate_networks() for None {{(pid=128801) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:34:29.145039 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-217d2604-e78c-4ed2-8bc0-b93b198bc2c0 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Flavor limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:34:29.145487 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-217d2604-e78c-4ed2-8bc0-b93b198bc2c0 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Image limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:34:29.145960 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-217d2604-e78c-4ed2-8bc0-b93b198bc2c0 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Flavor pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:34:29.146764 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-217d2604-e78c-4ed2-8bc0-b93b198bc2c0 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Image pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:34:29.147852 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-217d2604-e78c-4ed2-8bc0-b93b198bc2c0 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:34:29.159341 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-217d2604-e78c-4ed2-8bc0-b93b198bc2c0 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:29.160056 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-217d2604-e78c-4ed2-8bc0-b93b198bc2c0 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:29.160491 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-217d2604-e78c-4ed2-8bc0-b93b198bc2c0 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:29.161357 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-217d2604-e78c-4ed2-8bc0-b93b198bc2c0 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:29.161807 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-217d2604-e78c-4ed2-8bc0-b93b198bc2c0 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:29.162259 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-217d2604-e78c-4ed2-8bc0-b93b198bc2c0 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:29.179245 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-217d2604-e78c-4ed2-8bc0-b93b198bc2c0 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Getting quotas for project b9928be759e34d208d835263d73a5ab5. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:34:29.183899 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-217d2604-e78c-4ed2-8bc0-b93b198bc2c0 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Getting quotas for user 147d000a331f4a3ba47019fcbae40901 and project b9928be759e34d208d835263d73a5ab5. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:34:29.196377 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-217d2604-e78c-4ed2-8bc0-b93b198bc2c0 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Going to run 1 instances... {{(pid=128801) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:34:29.199435 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-217d2604-e78c-4ed2-8bc0-b93b198bc2c0 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] [instance: 63e16106-fc95-4fa8-bf7c-e70ff878a5ae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='15b24725-0c99-4bcf-b1fb-907cdf8e2d63',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128801) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:34:29.249875 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-217d2604-e78c-4ed2-8bc0-b93b198bc2c0 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.504524 Oct 04 20:34:29.250648 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 148/323] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 20:34:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 507 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 20:34:29.262684 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-81b2bfff-a941-4c76-8353-f0cc34c43d0a tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:29.263300 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-81b2bfff-a941-4c76-8353-f0cc34c43d0a tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] [instance: 63e16106-fc95-4fa8-bf7c-e70ff878a5ae] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:29.297933 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d1a9885a-d930-4cbe-8812-8093c459d757 tempest-QuotasAdminTestV257-1665818662 tempest-QuotasAdminTestV257-1665818662-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:29.299982 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d1a9885a-d930-4cbe-8812-8093c459d757 tempest-QuotasAdminTestV257-1665818662 tempest-QuotasAdminTestV257-1665818662-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:29.300302 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d1a9885a-d930-4cbe-8812-8093c459d757 tempest-QuotasAdminTestV257-1665818662 tempest-QuotasAdminTestV257-1665818662-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:29.301437 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d1a9885a-d930-4cbe-8812-8093c459d757 tempest-QuotasAdminTestV257-1665818662 tempest-QuotasAdminTestV257-1665818662-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:29.301893 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d1a9885a-d930-4cbe-8812-8093c459d757 tempest-QuotasAdminTestV257-1665818662 tempest-QuotasAdminTestV257-1665818662-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:29.303150 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d1a9885a-d930-4cbe-8812-8093c459d757 tempest-QuotasAdminTestV257-1665818662 tempest-QuotasAdminTestV257-1665818662-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:29.339467 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-d1a9885a-d930-4cbe-8812-8093c459d757 tempest-QuotasAdminTestV257-1665818662 tempest-QuotasAdminTestV257-1665818662-project-admin] 10.222.0.33 "GET /compute/v2.1/os-quota-sets/d63c4b21b61d4d64bb7689e17821fa8a/detail" status: 200 len: 463 microversion: 2.57 time: 0.732127 Oct 04 20:34:29.349491 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 176/324] 10.222.0.33 () {60 vars in 1304 bytes} [Tue Oct 4 20:34:28 2022] GET /compute/v2.1/os-quota-sets/d63c4b21b61d4d64bb7689e17821fa8a/detail => generated 463 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 20:34:29.351126 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-81b2bfff-a941-4c76-8353-f0cc34c43d0a tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '147d000a331f4a3ba47019fcbae40901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9928be759e34d208d835263d73a5ab5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:29.359684 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-81b2bfff-a941-4c76-8353-f0cc34c43d0a tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] 10.222.0.33 "GET /compute/v2.1/servers/63e16106-fc95-4fa8-bf7c-e70ff878a5ae" status: 200 len: 1221 microversion: 2.1 time: 0.101788 Oct 04 20:34:29.371092 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 149/325] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:29 2022] GET /compute/v2.1/servers/63e16106-fc95-4fa8-bf7c-e70ff878a5ae => generated 1221 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:29.767164 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-f1e45032-78ba-4cc8-902c-727c5f96553a tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:29.767963 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-f1e45032-78ba-4cc8-902c-727c5f96553a tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] [instance: 9e9f6289-9999-4188-9af1-6cf64a676eee] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:29.781789 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f1e45032-78ba-4cc8-902c-727c5f96553a tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:29.782456 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f1e45032-78ba-4cc8-902c-727c5f96553a tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:29.782726 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f1e45032-78ba-4cc8-902c-727c5f96553a tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:29.783696 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f1e45032-78ba-4cc8-902c-727c5f96553a tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:29.784208 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f1e45032-78ba-4cc8-902c-727c5f96553a tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:29.784634 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f1e45032-78ba-4cc8-902c-727c5f96553a tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:30.053371 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-f1e45032-78ba-4cc8-902c-727c5f96553a tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3563efe2b8c94931a2a46c4e14811b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3118a5d96843d3bede1ed94bd9717e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:30.070649 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-f1e45032-78ba-4cc8-902c-727c5f96553a tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] 10.222.0.33 "GET /compute/v2.1/servers/9e9f6289-9999-4188-9af1-6cf64a676eee" status: 200 len: 1472 microversion: 2.1 time: 0.306148 Oct 04 20:34:30.074866 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 177/326] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:29 2022] GET /compute/v2.1/servers/9e9f6289-9999-4188-9af1-6cf64a676eee => generated 1472 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:30.395960 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-d17bf4a9-e8c6-4278-81a5-50beaafab809 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:30.396639 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-d17bf4a9-e8c6-4278-81a5-50beaafab809 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] [instance: 63e16106-fc95-4fa8-bf7c-e70ff878a5ae] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:30.409937 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d17bf4a9-e8c6-4278-81a5-50beaafab809 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:30.410237 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d17bf4a9-e8c6-4278-81a5-50beaafab809 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:30.413966 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d17bf4a9-e8c6-4278-81a5-50beaafab809 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:30.414751 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d17bf4a9-e8c6-4278-81a5-50beaafab809 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:30.415874 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d17bf4a9-e8c6-4278-81a5-50beaafab809 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:30.416329 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d17bf4a9-e8c6-4278-81a5-50beaafab809 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:30.501896 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-d17bf4a9-e8c6-4278-81a5-50beaafab809 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '147d000a331f4a3ba47019fcbae40901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9928be759e34d208d835263d73a5ab5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:30.511359 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-d17bf4a9-e8c6-4278-81a5-50beaafab809 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] 10.222.0.33 "GET /compute/v2.1/servers/63e16106-fc95-4fa8-bf7c-e70ff878a5ae" status: 200 len: 1273 microversion: 2.1 time: 0.120901 Oct 04 20:34:30.512711 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 178/327] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:30 2022] GET /compute/v2.1/servers/63e16106-fc95-4fa8-bf7c-e70ff878a5ae => generated 1273 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:30.592647 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-706ea084-faab-4ef7-b452-2c514471d6aa tempest-QuotasAdminTestV257-1665818662 tempest-QuotasAdminTestV257-1665818662-project-admin] Action: 'update', calling method: .version_select at 0x7f3c74f874c0>, body: {"quota_set": {"ram": "2048"}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:34:31.017982 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d19c875f-54ac-4dfd-9d24-c89299e61a9c tempest-AZAdminNegativeTestJSON-2084501204 tempest-AZAdminNegativeTestJSON-2084501204-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:31.021006 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d19c875f-54ac-4dfd-9d24-c89299e61a9c tempest-AZAdminNegativeTestJSON-2084501204 tempest-AZAdminNegativeTestJSON-2084501204-project] Policy check for os_compute_api:os-availability-zone:detail failed with credentials {'is_admin': False, 'user_id': '21b0066ca97646eb9205bbd554c5bd2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e7932f622c4632a2ffa94bafe3a23f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:31.022718 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d19c875f-54ac-4dfd-9d24-c89299e61a9c tempest-AZAdminNegativeTestJSON-2084501204 tempest-AZAdminNegativeTestJSON-2084501204-project] Request method failure captured: Oct 04 20:34:31.022718 n-d-854823-8 devstack@n-api.service[128801]: request: GET /compute/v2.1/os-availability-zone/detail HTTP/1.1 Oct 04 20:34:31.022718 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:34:31.022718 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:34:31.022718 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:34:31.022718 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 0 Oct 04 20:34:31.022718 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:34:31.022718 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:34:31.022718 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:34:31.022718 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:34:31.022718 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJjTdGv0VTnLYWj4S1MwGRxmaOVWF88gFXHN_MTG8BHoCThIoGapRIbKzFEpfLjyqnKETFF2n0k0M3qQmJmpSWic820n5bOtp_hpsKTGhMCIfb50YOaFCaCbbKo1k4-YJnx4lWPl97HQFSuoBMno0wy_s7u9prfQY8mvoq2kvCkqlrs Oct 04 20:34:31.022718 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:34:31.022718 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:34:31.022718 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:34:31.022718 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:34:31.022718 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:34:31.022718 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:34:31.022718 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: b5e7932f622c4632a2ffa94bafe3a23f Oct 04 20:34:31.022718 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-AZAdminNegativeTestJSON-2084501204 Oct 04 20:34:31.022718 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 20:34:31.022718 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 20:34:31.024084 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b5e7932f622c4632a2ffa94bafe3a23f", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b5e7932f622c4632a2ffa94bafe3a23f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b5e7932f622c4632a2ffa94bafe3a23f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b5e7932f622c4632a2ffa94bafe3a23f"}]}] Oct 04 20:34:31.024084 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-AZAdminNegativeTestJSON-2084501204 Oct 04 20:34:31.024084 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: b5e7932f622c4632a2ffa94bafe3a23f Oct 04 20:34:31.024084 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-AZAdminNegativeTestJSON-2084501204 Oct 04 20:34:31.024084 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-AZAdminNegativeTestJSON-2084501204-project Oct 04 20:34:31.024084 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:34:31.024084 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:34:31.024084 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: 21b0066ca97646eb9205bbd554c5bd2f Oct 04 20:34:31.024084 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-AZAdminNegativeTestJSON-2084501204-project Oct 04 20:34:31.024084 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 20:34:31.024084 n-d-854823-8 devstack@n-api.service[128801]: exception: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Oct 04 20:34:31.024084 n-d-854823-8 devstack@n-api.service[128801]: action_args: {} Oct 04 20:34:31.025601 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:34:31.025601 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:34:31.025601 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:34:31.025601 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:34:31.025601 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:34:31.025601 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:34:31.025601 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:34:31.025601 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:34:31.025601 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/availability_zone.py", line 117, in detail Oct 04 20:34:31.025601 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi context.can(az_policies.POLICY_ROOT % 'detail', target={}) Oct 04 20:34:31.025601 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 20:34:31.025601 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 20:34:31.025601 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 20:34:31.025601 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 20:34:31.025601 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 20:34:31.025601 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 20:34:31.025601 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 20:34:31.025601 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 20:34:31.025601 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 20:34:31.026860 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 20:34:31.026860 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 20:34:31.026860 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 20:34:31.026860 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 20:34:31.026860 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 20:34:31.026860 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Oct 04 20:34:31.026860 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:34:31.026860 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:34:31.026860 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:34:31.026860 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:34:31.026860 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:34:31.026860 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:34:31.026860 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 20:34:31.026860 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 20:34:31.026860 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Oct 04 20:34:31.026860 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:34:31.027944 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d19c875f-54ac-4dfd-9d24-c89299e61a9c tempest-AZAdminNegativeTestJSON-2084501204 tempest-AZAdminNegativeTestJSON-2084501204-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:34:31.031141 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d19c875f-54ac-4dfd-9d24-c89299e61a9c tempest-AZAdminNegativeTestJSON-2084501204 tempest-AZAdminNegativeTestJSON-2084501204-project] 10.222.0.33 "GET /compute/v2.1/os-availability-zone/detail" status: 403 len: 123 microversion: 2.1 time: 0.677524 Oct 04 20:34:31.032236 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 150/328] 10.222.0.33 () {58 vars in 1185 bytes} [Tue Oct 4 20:34:30 2022] GET /compute/v2.1/os-availability-zone/detail => generated 123 bytes in 681 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:34:31.097003 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b3320e76-ba9f-4ae8-be7e-ff1bbb7a8349 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:31.097779 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b3320e76-ba9f-4ae8-be7e-ff1bbb7a8349 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] [instance: 9e9f6289-9999-4188-9af1-6cf64a676eee] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:31.108975 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b3320e76-ba9f-4ae8-be7e-ff1bbb7a8349 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:31.109825 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b3320e76-ba9f-4ae8-be7e-ff1bbb7a8349 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:31.110563 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b3320e76-ba9f-4ae8-be7e-ff1bbb7a8349 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:31.111790 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b3320e76-ba9f-4ae8-be7e-ff1bbb7a8349 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:31.112639 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b3320e76-ba9f-4ae8-be7e-ff1bbb7a8349 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:31.113215 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b3320e76-ba9f-4ae8-be7e-ff1bbb7a8349 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:31.281898 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-b3320e76-ba9f-4ae8-be7e-ff1bbb7a8349 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3563efe2b8c94931a2a46c4e14811b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3118a5d96843d3bede1ed94bd9717e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:31.292320 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b3320e76-ba9f-4ae8-be7e-ff1bbb7a8349 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] 10.222.0.33 "GET /compute/v2.1/servers/9e9f6289-9999-4188-9af1-6cf64a676eee" status: 200 len: 1472 microversion: 2.1 time: 0.199923 Oct 04 20:34:31.306593 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 151/329] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:31 2022] GET /compute/v2.1/servers/9e9f6289-9999-4188-9af1-6cf64a676eee => generated 1472 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:34:31.349950 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-706ea084-faab-4ef7-b452-2c514471d6aa tempest-QuotasAdminTestV257-1665818662 tempest-QuotasAdminTestV257-1665818662-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:31.352205 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-706ea084-faab-4ef7-b452-2c514471d6aa tempest-QuotasAdminTestV257-1665818662 tempest-QuotasAdminTestV257-1665818662-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:31.353906 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-706ea084-faab-4ef7-b452-2c514471d6aa tempest-QuotasAdminTestV257-1665818662 tempest-QuotasAdminTestV257-1665818662-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:31.355136 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-706ea084-faab-4ef7-b452-2c514471d6aa tempest-QuotasAdminTestV257-1665818662 tempest-QuotasAdminTestV257-1665818662-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:31.355749 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-706ea084-faab-4ef7-b452-2c514471d6aa tempest-QuotasAdminTestV257-1665818662 tempest-QuotasAdminTestV257-1665818662-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:31.356328 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-706ea084-faab-4ef7-b452-2c514471d6aa tempest-QuotasAdminTestV257-1665818662 tempest-QuotasAdminTestV257-1665818662-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:31.395117 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-706ea084-faab-4ef7-b452-2c514471d6aa tempest-QuotasAdminTestV257-1665818662 tempest-QuotasAdminTestV257-1665818662-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:31.395850 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-706ea084-faab-4ef7-b452-2c514471d6aa tempest-QuotasAdminTestV257-1665818662 tempest-QuotasAdminTestV257-1665818662-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:31.396286 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-706ea084-faab-4ef7-b452-2c514471d6aa tempest-QuotasAdminTestV257-1665818662 tempest-QuotasAdminTestV257-1665818662-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:31.397026 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-706ea084-faab-4ef7-b452-2c514471d6aa tempest-QuotasAdminTestV257-1665818662 tempest-QuotasAdminTestV257-1665818662-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:31.397482 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-706ea084-faab-4ef7-b452-2c514471d6aa tempest-QuotasAdminTestV257-1665818662 tempest-QuotasAdminTestV257-1665818662-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:31.397911 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-706ea084-faab-4ef7-b452-2c514471d6aa tempest-QuotasAdminTestV257-1665818662 tempest-QuotasAdminTestV257-1665818662-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:31.423839 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=5,nova_api:DELETE=5 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:34:31.475307 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-706ea084-faab-4ef7-b452-2c514471d6aa tempest-QuotasAdminTestV257-1665818662 tempest-QuotasAdminTestV257-1665818662-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-quota-sets/d63c4b21b61d4d64bb7689e17821fa8a?user_id=4f01d04cc68c4ffabe689ac5533a645d" status: 200 len: 148 microversion: 2.57 time: 0.889110 Oct 04 20:34:31.476015 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 179/330] 10.222.0.33 () {62 vars in 1384 bytes} [Tue Oct 4 20:34:30 2022] PUT /compute/v2.1/os-quota-sets/d63c4b21b61d4d64bb7689e17821fa8a?user_id=4f01d04cc68c4ffabe689ac5533a645d => generated 148 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 04 20:34:31.488786 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-859cd48f-3ab1-46e6-a428-0c1515939297 tempest-QuotasAdminTestV257-1665818662 tempest-QuotasAdminTestV257-1665818662-project-admin] Calling method '.version_select at 0x7f3c74ff1160>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:31.537526 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-fe4dd29d-43b8-471a-959b-c88e43cd2fb0 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:31.538402 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-fe4dd29d-43b8-471a-959b-c88e43cd2fb0 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] [instance: 63e16106-fc95-4fa8-bf7c-e70ff878a5ae] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:31.553415 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fe4dd29d-43b8-471a-959b-c88e43cd2fb0 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:31.554102 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fe4dd29d-43b8-471a-959b-c88e43cd2fb0 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:31.555576 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fe4dd29d-43b8-471a-959b-c88e43cd2fb0 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:31.556422 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fe4dd29d-43b8-471a-959b-c88e43cd2fb0 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:31.556880 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fe4dd29d-43b8-471a-959b-c88e43cd2fb0 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:31.558242 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fe4dd29d-43b8-471a-959b-c88e43cd2fb0 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:31.648211 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-fe4dd29d-43b8-471a-959b-c88e43cd2fb0 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '147d000a331f4a3ba47019fcbae40901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9928be759e34d208d835263d73a5ab5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:31.659114 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-fe4dd29d-43b8-471a-959b-c88e43cd2fb0 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] 10.222.0.33 "GET /compute/v2.1/servers/63e16106-fc95-4fa8-bf7c-e70ff878a5ae" status: 200 len: 1279 microversion: 2.1 time: 0.125580 Oct 04 20:34:31.660099 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 180/331] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:31 2022] GET /compute/v2.1/servers/63e16106-fc95-4fa8-bf7c-e70ff878a5ae => generated 1279 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:32.318815 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-7da71131-6b32-4085-8603-3ede1501e861 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:32.319835 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-7da71131-6b32-4085-8603-3ede1501e861 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] [instance: 9e9f6289-9999-4188-9af1-6cf64a676eee] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:32.344058 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7da71131-6b32-4085-8603-3ede1501e861 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:32.345165 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7da71131-6b32-4085-8603-3ede1501e861 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:32.346660 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7da71131-6b32-4085-8603-3ede1501e861 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:32.348971 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-859cd48f-3ab1-46e6-a428-0c1515939297 tempest-QuotasAdminTestV257-1665818662 tempest-QuotasAdminTestV257-1665818662-project-admin] 10.222.0.33 "GET /compute/v2.1/os-quota-sets/d63c4b21b61d4d64bb7689e17821fa8a?user_id=4f01d04cc68c4ffabe689ac5533a645d" status: 200 len: 190 microversion: 2.57 time: 0.864419 Oct 04 20:34:32.349552 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 152/332] 10.222.0.33 () {60 vars in 1364 bytes} [Tue Oct 4 20:34:31 2022] GET /compute/v2.1/os-quota-sets/d63c4b21b61d4d64bb7689e17821fa8a?user_id=4f01d04cc68c4ffabe689ac5533a645d => generated 190 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 20:34:32.350945 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7da71131-6b32-4085-8603-3ede1501e861 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:32.353563 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7da71131-6b32-4085-8603-3ede1501e861 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:32.354847 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7da71131-6b32-4085-8603-3ede1501e861 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:32.652150 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-7da71131-6b32-4085-8603-3ede1501e861 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3563efe2b8c94931a2a46c4e14811b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3118a5d96843d3bede1ed94bd9717e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:32.684916 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d25ae830-c7ff-4ebb-9fdf-27540a38c9de tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:32.685216 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-7da71131-6b32-4085-8603-3ede1501e861 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] 10.222.0.33 "GET /compute/v2.1/servers/9e9f6289-9999-4188-9af1-6cf64a676eee" status: 200 len: 1472 microversion: 2.1 time: 0.369641 Oct 04 20:34:32.685928 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d25ae830-c7ff-4ebb-9fdf-27540a38c9de tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] [instance: 63e16106-fc95-4fa8-bf7c-e70ff878a5ae] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:32.699983 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d25ae830-c7ff-4ebb-9fdf-27540a38c9de tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:32.699983 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d25ae830-c7ff-4ebb-9fdf-27540a38c9de tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:32.699983 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d25ae830-c7ff-4ebb-9fdf-27540a38c9de tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:32.699983 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d25ae830-c7ff-4ebb-9fdf-27540a38c9de tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:32.700321 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d25ae830-c7ff-4ebb-9fdf-27540a38c9de tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:32.700502 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d25ae830-c7ff-4ebb-9fdf-27540a38c9de tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:32.707400 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 181/333] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:32 2022] GET /compute/v2.1/servers/9e9f6289-9999-4188-9af1-6cf64a676eee => generated 1472 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:34:32.933398 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d25ae830-c7ff-4ebb-9fdf-27540a38c9de tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '147d000a331f4a3ba47019fcbae40901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9928be759e34d208d835263d73a5ab5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:32.943009 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d25ae830-c7ff-4ebb-9fdf-27540a38c9de tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] 10.222.0.33 "GET /compute/v2.1/servers/63e16106-fc95-4fa8-bf7c-e70ff878a5ae" status: 200 len: 1321 microversion: 2.1 time: 0.262521 Oct 04 20:34:32.944256 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 153/334] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:32 2022] GET /compute/v2.1/servers/63e16106-fc95-4fa8-bf7c-e70ff878a5ae => generated 1321 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:34:33.155516 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-262b30a3-12cf-4a31-8794-47cca9f24cc7 req-ca22ed83-134e-4a67-acf0-6c6f4a2b201f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "63e16106-fc95-4fa8-bf7c-e70ff878a5ae", "tag": "9d9e908b-6316-4180-a0db-a0f76d878158"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:34:33.185496 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-262b30a3-12cf-4a31-8794-47cca9f24cc7 req-ca22ed83-134e-4a67-acf0-6c6f4a2b201f service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:33.186594 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-262b30a3-12cf-4a31-8794-47cca9f24cc7 req-ca22ed83-134e-4a67-acf0-6c6f4a2b201f service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:33.187236 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-262b30a3-12cf-4a31-8794-47cca9f24cc7 req-ca22ed83-134e-4a67-acf0-6c6f4a2b201f service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:33.202685 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-262b30a3-12cf-4a31-8794-47cca9f24cc7 req-ca22ed83-134e-4a67-acf0-6c6f4a2b201f service nova] Creating event network-changed:9d9e908b-6316-4180-a0db-a0f76d878158 for instance 63e16106-fc95-4fa8-bf7c-e70ff878a5ae on n-h1-854823-8 Oct 04 20:34:33.209151 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-262b30a3-12cf-4a31-8794-47cca9f24cc7 req-ca22ed83-134e-4a67-acf0-6c6f4a2b201f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064605 Oct 04 20:34:33.210053 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 182/335] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:34:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:34:33.714957 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-b25a85c4-07b5-4431-bace-3fb7f1cc18be tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:33.715855 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-b25a85c4-07b5-4431-bace-3fb7f1cc18be tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] [instance: 9e9f6289-9999-4188-9af1-6cf64a676eee] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:33.722679 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b25a85c4-07b5-4431-bace-3fb7f1cc18be tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:33.723168 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b25a85c4-07b5-4431-bace-3fb7f1cc18be tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:33.723584 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b25a85c4-07b5-4431-bace-3fb7f1cc18be tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:33.724785 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b25a85c4-07b5-4431-bace-3fb7f1cc18be tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:33.725593 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b25a85c4-07b5-4431-bace-3fb7f1cc18be tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:33.726031 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b25a85c4-07b5-4431-bace-3fb7f1cc18be tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:33.910411 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-b25a85c4-07b5-4431-bace-3fb7f1cc18be tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3563efe2b8c94931a2a46c4e14811b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3118a5d96843d3bede1ed94bd9717e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:33.925706 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-b25a85c4-07b5-4431-bace-3fb7f1cc18be tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] 10.222.0.33 "GET /compute/v2.1/servers/9e9f6289-9999-4188-9af1-6cf64a676eee" status: 200 len: 1477 microversion: 2.1 time: 0.216340 Oct 04 20:34:33.927219 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 183/336] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:33 2022] GET /compute/v2.1/servers/9e9f6289-9999-4188-9af1-6cf64a676eee => generated 1477 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:33.968933 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-dd9a4291-b811-4c7b-9807-c552e13ac93a tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-982357275", "imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63", "flavorRef": "452"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:34:33.974911 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-69f70f89-7942-4294-b416-81fe7d2dbc1b tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:33.975612 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-69f70f89-7942-4294-b416-81fe7d2dbc1b tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] [instance: 63e16106-fc95-4fa8-bf7c-e70ff878a5ae] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:33.986296 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-69f70f89-7942-4294-b416-81fe7d2dbc1b tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:33.988302 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-69f70f89-7942-4294-b416-81fe7d2dbc1b tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:33.988827 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-69f70f89-7942-4294-b416-81fe7d2dbc1b tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:33.990636 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-69f70f89-7942-4294-b416-81fe7d2dbc1b tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:33.994950 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-69f70f89-7942-4294-b416-81fe7d2dbc1b tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:33.995702 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-69f70f89-7942-4294-b416-81fe7d2dbc1b tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:34.042176 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.network.neutron [None req-dd9a4291-b811-4c7b-9807-c552e13ac93a tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] validate_networks() for None {{(pid=128801) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:34:34.386779 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-69f70f89-7942-4294-b416-81fe7d2dbc1b tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '147d000a331f4a3ba47019fcbae40901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9928be759e34d208d835263d73a5ab5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:34.390326 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:34:34.404771 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-69f70f89-7942-4294-b416-81fe7d2dbc1b tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] 10.222.0.33 "GET /compute/v2.1/servers/63e16106-fc95-4fa8-bf7c-e70ff878a5ae" status: 200 len: 1321 microversion: 2.1 time: 0.430549 Oct 04 20:34:34.411980 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 184/337] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:33 2022] GET /compute/v2.1/servers/63e16106-fc95-4fa8-bf7c-e70ff878a5ae => generated 1321 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:34.482574 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-dd9a4291-b811-4c7b-9807-c552e13ac93a tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Flavor limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:34:34.483386 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-dd9a4291-b811-4c7b-9807-c552e13ac93a tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Image limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:34:34.484034 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-dd9a4291-b811-4c7b-9807-c552e13ac93a tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Flavor pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:34:34.484606 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-dd9a4291-b811-4c7b-9807-c552e13ac93a tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Image pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:34:34.485168 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-dd9a4291-b811-4c7b-9807-c552e13ac93a tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:34:34.491952 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:34:34.498811 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dd9a4291-b811-4c7b-9807-c552e13ac93a tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:34.499528 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dd9a4291-b811-4c7b-9807-c552e13ac93a tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:34.500296 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dd9a4291-b811-4c7b-9807-c552e13ac93a tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:34.502305 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dd9a4291-b811-4c7b-9807-c552e13ac93a tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:34.503039 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dd9a4291-b811-4c7b-9807-c552e13ac93a tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:34.503776 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dd9a4291-b811-4c7b-9807-c552e13ac93a tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:34.562680 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-dd9a4291-b811-4c7b-9807-c552e13ac93a tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Getting quotas for project 16a307499cf44d03a1e9bb61f614f099. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:34:34.576893 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-dd9a4291-b811-4c7b-9807-c552e13ac93a tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Getting quotas for user 5cbd31af13444cda97ba5f8c99d19437 and project 16a307499cf44d03a1e9bb61f614f099. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:34:34.600406 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-dd9a4291-b811-4c7b-9807-c552e13ac93a tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Going to run 1 instances... {{(pid=128801) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:34:34.609646 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-dd9a4291-b811-4c7b-9807-c552e13ac93a tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] [instance: b8cf32e5-d9cc-4e92-bd81-2c3449406c95] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='15b24725-0c99-4bcf-b1fb-907cdf8e2d63',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128801) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:34:34.703971 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-dd9a4291-b811-4c7b-9807-c552e13ac93a tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.264692 Oct 04 20:34:34.714728 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 154/338] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 20:34:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 1276 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 20:34:34.723569 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9274db09-f18c-498c-b3e5-874f49b4dcaf tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:34.724179 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-9274db09-f18c-498c-b3e5-874f49b4dcaf tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] [instance: b8cf32e5-d9cc-4e92-bd81-2c3449406c95] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:34.817747 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-9274db09-f18c-498c-b3e5-874f49b4dcaf tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cbd31af13444cda97ba5f8c99d19437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a307499cf44d03a1e9bb61f614f099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:34.827115 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-9274db09-f18c-498c-b3e5-874f49b4dcaf tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] 10.222.0.33 "GET /compute/v2.1/servers/b8cf32e5-d9cc-4e92-bd81-2c3449406c95" status: 200 len: 1219 microversion: 2.1 time: 0.111238 Oct 04 20:34:34.827670 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 155/339] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:34 2022] GET /compute/v2.1/servers/b8cf32e5-d9cc-4e92-bd81-2c3449406c95 => generated 1219 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:34.954148 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a0d6be3d-969d-47a6-a15a-c14b40014916 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:34.954825 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a0d6be3d-969d-47a6-a15a-c14b40014916 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] [instance: 9e9f6289-9999-4188-9af1-6cf64a676eee] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:34.968433 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a0d6be3d-969d-47a6-a15a-c14b40014916 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:34.968959 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a0d6be3d-969d-47a6-a15a-c14b40014916 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:34.969465 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a0d6be3d-969d-47a6-a15a-c14b40014916 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:34.970857 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a0d6be3d-969d-47a6-a15a-c14b40014916 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:34.971320 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a0d6be3d-969d-47a6-a15a-c14b40014916 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:34.971751 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a0d6be3d-969d-47a6-a15a-c14b40014916 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:35.154922 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-a0d6be3d-969d-47a6-a15a-c14b40014916 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3563efe2b8c94931a2a46c4e14811b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3118a5d96843d3bede1ed94bd9717e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:35.169648 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a0d6be3d-969d-47a6-a15a-c14b40014916 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] 10.222.0.33 "GET /compute/v2.1/servers/9e9f6289-9999-4188-9af1-6cf64a676eee" status: 200 len: 1477 microversion: 2.1 time: 0.218543 Oct 04 20:34:35.171966 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 156/340] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:34 2022] GET /compute/v2.1/servers/9e9f6289-9999-4188-9af1-6cf64a676eee => generated 1477 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:35.319549 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-1690f530-f35a-4727-8ef1-c914b5d2cd1d tempest-HypervisorAdminNegativeUnderV252Test-450131194 tempest-HypervisorAdminNegativeUnderV252Test-450131194-project-admin] Calling method '.version_select at 0x7f3c750fedc0>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:35.321718 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1690f530-f35a-4727-8ef1-c914b5d2cd1d tempest-HypervisorAdminNegativeUnderV252Test-450131194 tempest-HypervisorAdminNegativeUnderV252Test-450131194-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:35.322258 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1690f530-f35a-4727-8ef1-c914b5d2cd1d tempest-HypervisorAdminNegativeUnderV252Test-450131194 tempest-HypervisorAdminNegativeUnderV252Test-450131194-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:35.322800 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1690f530-f35a-4727-8ef1-c914b5d2cd1d tempest-HypervisorAdminNegativeUnderV252Test-450131194 tempest-HypervisorAdminNegativeUnderV252Test-450131194-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:35.342413 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1690f530-f35a-4727-8ef1-c914b5d2cd1d tempest-HypervisorAdminNegativeUnderV252Test-450131194 tempest-HypervisorAdminNegativeUnderV252Test-450131194-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:35.343104 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1690f530-f35a-4727-8ef1-c914b5d2cd1d tempest-HypervisorAdminNegativeUnderV252Test-450131194 tempest-HypervisorAdminNegativeUnderV252Test-450131194-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:35.343329 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1690f530-f35a-4727-8ef1-c914b5d2cd1d tempest-HypervisorAdminNegativeUnderV252Test-450131194 tempest-HypervisorAdminNegativeUnderV252Test-450131194-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:35.361822 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1690f530-f35a-4727-8ef1-c914b5d2cd1d tempest-HypervisorAdminNegativeUnderV252Test-450131194 tempest-HypervisorAdminNegativeUnderV252Test-450131194-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:35.362494 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1690f530-f35a-4727-8ef1-c914b5d2cd1d tempest-HypervisorAdminNegativeUnderV252Test-450131194 tempest-HypervisorAdminNegativeUnderV252Test-450131194-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:35.362975 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1690f530-f35a-4727-8ef1-c914b5d2cd1d tempest-HypervisorAdminNegativeUnderV252Test-450131194 tempest-HypervisorAdminNegativeUnderV252Test-450131194-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:35.369993 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-1690f530-f35a-4727-8ef1-c914b5d2cd1d tempest-HypervisorAdminNegativeUnderV252Test-450131194 tempest-HypervisorAdminNegativeUnderV252Test-450131194-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.708177 Oct 04 20:34:35.370861 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 185/341] 10.222.0.33 () {58 vars in 1146 bytes} [Tue Oct 4 20:34:34 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:34:35.438253 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-2c80882c-8f3a-4f8e-b7af-d663c82b81b1 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:35.439450 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-2c80882c-8f3a-4f8e-b7af-d663c82b81b1 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] [instance: 63e16106-fc95-4fa8-bf7c-e70ff878a5ae] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:35.453730 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2c80882c-8f3a-4f8e-b7af-d663c82b81b1 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:35.454535 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2c80882c-8f3a-4f8e-b7af-d663c82b81b1 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:35.455800 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2c80882c-8f3a-4f8e-b7af-d663c82b81b1 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:35.456843 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2c80882c-8f3a-4f8e-b7af-d663c82b81b1 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:35.457659 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2c80882c-8f3a-4f8e-b7af-d663c82b81b1 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:35.458288 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2c80882c-8f3a-4f8e-b7af-d663c82b81b1 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:35.639467 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-2c80882c-8f3a-4f8e-b7af-d663c82b81b1 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '147d000a331f4a3ba47019fcbae40901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9928be759e34d208d835263d73a5ab5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:35.652536 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-2c80882c-8f3a-4f8e-b7af-d663c82b81b1 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] 10.222.0.33 "GET /compute/v2.1/servers/63e16106-fc95-4fa8-bf7c-e70ff878a5ae" status: 200 len: 1321 microversion: 2.1 time: 0.224550 Oct 04 20:34:35.654062 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 186/342] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:35 2022] GET /compute/v2.1/servers/63e16106-fc95-4fa8-bf7c-e70ff878a5ae => generated 1321 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:35.810620 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1241c52b-396f-4b97-a59e-e06aca111984 tempest-HypervisorAdminNegativeUnderV252Test-1289530298 tempest-HypervisorAdminNegativeUnderV252Test-1289530298-project] Calling method '.version_select at 0x7f3c74f65a60>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:35.813478 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-1241c52b-396f-4b97-a59e-e06aca111984 tempest-HypervisorAdminNegativeUnderV252Test-1289530298 tempest-HypervisorAdminNegativeUnderV252Test-1289530298-project] Policy check for os_compute_api:os-hypervisors:search failed with credentials {'is_admin': False, 'user_id': 'd2a4a37bd0c44353a59a22b79b91dfc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fcfdc89648c4355ac4eb43ffad8c058', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:35.815621 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1241c52b-396f-4b97-a59e-e06aca111984 tempest-HypervisorAdminNegativeUnderV252Test-1289530298 tempest-HypervisorAdminNegativeUnderV252Test-1289530298-project] Request method failure captured: Oct 04 20:34:35.815621 n-d-854823-8 devstack@n-api.service[128801]: request: GET /compute/v2.1/os-hypervisors/n-h1-854823-8/search HTTP/1.1 Oct 04 20:34:35.815621 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:34:35.815621 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:34:35.815621 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:34:35.815621 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 0 Oct 04 20:34:35.815621 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:34:35.815621 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:34:35.815621 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:34:35.815621 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:34:35.815621 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJjZjb3YpiVLP3q4F0LbAT9uJk4xo75zVBHhPrfKLF7EnSNjaYmPwa9xYGl1NqIdZ8aYEYW-Z4m8DF2eZHQ8y5jRMM4pLDjIQxAQI1NVSxfvwAG417Ygfa4r96fDDrXL9xbdXpZMwtP-y8cafYKQNwpmuM3sXE3dXJwnoWskdPEN2x8 Oct 04 20:34:35.815621 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:34:35.815621 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:34:35.815621 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:34:35.815621 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:34:35.815621 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:34:35.815621 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:34:35.815621 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: 3fcfdc89648c4355ac4eb43ffad8c058 Oct 04 20:34:35.815621 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1289530298 Oct 04 20:34:35.815621 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 20:34:35.815621 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 20:34:35.817143 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_3fcfdc89648c4355ac4eb43ffad8c058", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3fcfdc89648c4355ac4eb43ffad8c058"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3fcfdc89648c4355ac4eb43ffad8c058"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/3fcfdc89648c4355ac4eb43ffad8c058"}]}] Oct 04 20:34:35.817143 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1289530298 Oct 04 20:34:35.817143 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: 3fcfdc89648c4355ac4eb43ffad8c058 Oct 04 20:34:35.817143 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1289530298 Oct 04 20:34:35.817143 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1289530298-project Oct 04 20:34:35.817143 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:34:35.817143 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:34:35.817143 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: d2a4a37bd0c44353a59a22b79b91dfc8 Oct 04 20:34:35.817143 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1289530298-project Oct 04 20:34:35.817143 n-d-854823-8 devstack@n-api.service[128801]: method: Oct 04 20:34:35.817143 n-d-854823-8 devstack@n-api.service[128801]: exception: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Oct 04 20:34:35.817143 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': 'n-h1-854823-8'} Oct 04 20:34:35.817852 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:34:35.817852 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:34:35.817852 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:34:35.817852 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:34:35.817852 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:34:35.817852 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:34:35.817852 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:34:35.817852 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:34:35.817852 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:34:35.817852 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:34:35.817852 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 439, in search Oct 04 20:34:35.817852 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'search', target={}) Oct 04 20:34:35.817852 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 20:34:35.817852 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 20:34:35.817852 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 20:34:35.817852 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 20:34:35.817852 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 20:34:35.817852 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 20:34:35.817852 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 20:34:35.819025 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 20:34:35.819025 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 20:34:35.819025 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 20:34:35.819025 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 20:34:35.819025 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 20:34:35.819025 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 20:34:35.819025 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 20:34:35.819025 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Oct 04 20:34:35.819025 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:34:35.819025 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:34:35.819025 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:34:35.819025 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:34:35.819025 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:34:35.819025 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:34:35.819025 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 20:34:35.819025 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 20:34:35.819025 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Oct 04 20:34:35.819025 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:34:35.823601 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1241c52b-396f-4b97-a59e-e06aca111984 tempest-HypervisorAdminNegativeUnderV252Test-1289530298 tempest-HypervisorAdminNegativeUnderV252Test-1289530298-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:34:35.825007 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-1241c52b-396f-4b97-a59e-e06aca111984 tempest-HypervisorAdminNegativeUnderV252Test-1289530298 tempest-HypervisorAdminNegativeUnderV252Test-1289530298-project] 10.222.0.33 "GET /compute/v2.1/os-hypervisors/n-h1-854823-8/search" status: 403 len: 117 microversion: 2.1 time: 0.446815 Oct 04 20:34:35.826550 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 157/343] 10.222.0.33 () {58 vars in 1209 bytes} [Tue Oct 4 20:34:35 2022] GET /compute/v2.1/os-hypervisors/n-h1-854823-8/search => generated 117 bytes in 449 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:34:35.837959 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8d7dfd07-7c6e-4334-aa87-b743d98a12a2 tempest-HypervisorAdminNegativeUnderV252Test-450131194 tempest-HypervisorAdminNegativeUnderV252Test-450131194-project-admin] Calling method '.version_select at 0x7f3c74ff1af0>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:35.849481 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8d7dfd07-7c6e-4334-aa87-b743d98a12a2 tempest-HypervisorAdminNegativeUnderV252Test-450131194 tempest-HypervisorAdminNegativeUnderV252Test-450131194-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:35.850054 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8d7dfd07-7c6e-4334-aa87-b743d98a12a2 tempest-HypervisorAdminNegativeUnderV252Test-450131194 tempest-HypervisorAdminNegativeUnderV252Test-450131194-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:35.850639 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8d7dfd07-7c6e-4334-aa87-b743d98a12a2 tempest-HypervisorAdminNegativeUnderV252Test-450131194 tempest-HypervisorAdminNegativeUnderV252Test-450131194-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:35.869975 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-8d7dfd07-7c6e-4334-aa87-b743d98a12a2 tempest-HypervisorAdminNegativeUnderV252Test-450131194 tempest-HypervisorAdminNegativeUnderV252Test-450131194-project-admin] HTTP exception thrown: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 04 20:34:35.871643 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8d7dfd07-7c6e-4334-aa87-b743d98a12a2 tempest-HypervisorAdminNegativeUnderV252Test-450131194 tempest-HypervisorAdminNegativeUnderV252Test-450131194-project-admin] Request method failure captured: Oct 04 20:34:35.871643 n-d-854823-8 devstack@n-api.service[128801]: request: GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search HTTP/1.1 Oct 04 20:34:35.871643 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:34:35.871643 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:34:35.871643 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:34:35.871643 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 0 Oct 04 20:34:35.871643 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:34:35.871643 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:34:35.871643 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:34:35.871643 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:34:35.871643 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJjaperQ2W5fOx6cjFlc48oVJgeao-KSU5ylHAtUJkPu-Ac7zWfzWZjqgUQWy3KZ_4CF39-JOJ2aaXdCz6ALDLMcd6NfvEAleZvHaQNtWcAePzcFbaqMXPW8lH6aHYuq7NVRpmbZz_Yk_oCu1VzCeiE9WxnXkoDdNgajOLE_i5W_jYA Oct 04 20:34:35.871643 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:34:35.871643 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:34:35.871643 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:34:35.871643 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:34:35.871643 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:34:35.871643 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:34:35.871643 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: f4119d05a101446e852e61da7c2ab45f Oct 04 20:34:35.871643 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-450131194 Oct 04 20:34:35.871643 n-d-854823-8 devstack@n-api.service[128801]: X-Role: admin,reader,member Oct 04 20:34:35.871643 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: admin,reader,member Oct 04 20:34:35.872854 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f4119d05a101446e852e61da7c2ab45f", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f4119d05a101446e852e61da7c2ab45f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f4119d05a101446e852e61da7c2ab45f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f4119d05a101446e852e61da7c2ab45f"}]}] Oct 04 20:34:35.872854 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-450131194 Oct 04 20:34:35.872854 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: f4119d05a101446e852e61da7c2ab45f Oct 04 20:34:35.872854 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-450131194 Oct 04 20:34:35.872854 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-450131194-project-admin Oct 04 20:34:35.872854 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:34:35.872854 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:34:35.872854 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: 80bfd2daae3645b4951c6aec9fc2e393 Oct 04 20:34:35.872854 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-450131194-project-admin Oct 04 20:34:35.872854 n-d-854823-8 devstack@n-api.service[128801]: method: Oct 04 20:34:35.872854 n-d-854823-8 devstack@n-api.service[128801]: exception: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 04 20:34:35.872854 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': 'nonexistent_hypervisor_name'} Oct 04 20:34:35.873500 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:34:35.873500 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:34:35.873500 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:34:35.873500 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:34:35.873500 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:34:35.873500 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:34:35.873500 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:34:35.873500 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:34:35.873500 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:34:35.873500 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:34:35.873500 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 443, in search Oct 04 20:34:35.873500 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Oct 04 20:34:35.873500 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Oct 04 20:34:35.873500 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 04 20:34:35.873500 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 04 20:34:35.873500 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:34:35.873500 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:34:35.873500 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:34:35.873500 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:34:35.873500 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:34:35.874560 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:34:35.874560 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:34:35.874560 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:34:35.874560 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 04 20:34:35.874560 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:34:35.876181 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8d7dfd07-7c6e-4334-aa87-b743d98a12a2 tempest-HypervisorAdminNegativeUnderV252Test-450131194 tempest-HypervisorAdminNegativeUnderV252Test-450131194-project-admin] Returning 404 to user: No hypervisor matching 'nonexistent_hypervisor_name' could be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:34:35.877040 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-8d7dfd07-7c6e-4334-aa87-b743d98a12a2 tempest-HypervisorAdminNegativeUnderV252Test-450131194 tempest-HypervisorAdminNegativeUnderV252Test-450131194-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search" status: 404 len: 114 microversion: 2.1 time: 0.045134 Oct 04 20:34:35.877910 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 158/344] 10.222.0.33 () {58 vars in 1251 bytes} [Tue Oct 4 20:34:35 2022] GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search => generated 114 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:34:35.896101 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-10aaf13a-5e5e-4a38-ab74-5066180e722a tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:35.896724 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-10aaf13a-5e5e-4a38-ab74-5066180e722a tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] [instance: b8cf32e5-d9cc-4e92-bd81-2c3449406c95] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:35.905327 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-10aaf13a-5e5e-4a38-ab74-5066180e722a tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:35.905817 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-10aaf13a-5e5e-4a38-ab74-5066180e722a tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:35.906326 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-10aaf13a-5e5e-4a38-ab74-5066180e722a tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:35.906959 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-10aaf13a-5e5e-4a38-ab74-5066180e722a tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:35.907694 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-10aaf13a-5e5e-4a38-ab74-5066180e722a tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:35.908332 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-10aaf13a-5e5e-4a38-ab74-5066180e722a tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:35.913999 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=100 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:34:36.000663 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-08edcfce-087f-4521-9653-d8df926b2f14 tempest-FlavorMetadataValidation-1569560908 tempest-FlavorMetadataValidation-1569560908-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_validate_metadata_-20683425", "id": 80776037, "os-flavor-access:is_public": "True"}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:34:36.033701 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-08edcfce-087f-4521-9653-d8df926b2f14 tempest-FlavorMetadataValidation-1569560908 tempest-FlavorMetadataValidation-1569560908-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 463 microversion: 2.86 time: 0.378119 Oct 04 20:34:36.035824 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 187/345] 10.222.0.33 () {62 vars in 1188 bytes} [Tue Oct 4 20:34:35 2022] POST /compute/v2.1/flavors => generated 463 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 20:34:36.043007 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-464949a7-4aab-4f9b-9821-be06bf5289f8 tempest-HypervisorAdminNegativeUnderV252Test-450131194 tempest-HypervisorAdminNegativeUnderV252Test-450131194-project-admin] Calling method '.version_select at 0x7f3c74f285e0>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:36.046181 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-464949a7-4aab-4f9b-9821-be06bf5289f8 tempest-HypervisorAdminNegativeUnderV252Test-450131194 tempest-HypervisorAdminNegativeUnderV252Test-450131194-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:36.046925 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-464949a7-4aab-4f9b-9821-be06bf5289f8 tempest-HypervisorAdminNegativeUnderV252Test-450131194 tempest-HypervisorAdminNegativeUnderV252Test-450131194-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:36.047638 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-464949a7-4aab-4f9b-9821-be06bf5289f8 tempest-HypervisorAdminNegativeUnderV252Test-450131194 tempest-HypervisorAdminNegativeUnderV252Test-450131194-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:36.064647 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-464949a7-4aab-4f9b-9821-be06bf5289f8 tempest-HypervisorAdminNegativeUnderV252Test-450131194 tempest-HypervisorAdminNegativeUnderV252Test-450131194-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:36.065248 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-464949a7-4aab-4f9b-9821-be06bf5289f8 tempest-HypervisorAdminNegativeUnderV252Test-450131194 tempest-HypervisorAdminNegativeUnderV252Test-450131194-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:36.065753 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-464949a7-4aab-4f9b-9821-be06bf5289f8 tempest-HypervisorAdminNegativeUnderV252Test-450131194 tempest-HypervisorAdminNegativeUnderV252Test-450131194-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:36.078978 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-464949a7-4aab-4f9b-9821-be06bf5289f8 tempest-HypervisorAdminNegativeUnderV252Test-450131194 tempest-HypervisorAdminNegativeUnderV252Test-450131194-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:36.079681 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-464949a7-4aab-4f9b-9821-be06bf5289f8 tempest-HypervisorAdminNegativeUnderV252Test-450131194 tempest-HypervisorAdminNegativeUnderV252Test-450131194-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:36.080453 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-464949a7-4aab-4f9b-9821-be06bf5289f8 tempest-HypervisorAdminNegativeUnderV252Test-450131194 tempest-HypervisorAdminNegativeUnderV252Test-450131194-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:36.088336 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-464949a7-4aab-4f9b-9821-be06bf5289f8 tempest-HypervisorAdminNegativeUnderV252Test-450131194 tempest-HypervisorAdminNegativeUnderV252Test-450131194-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.051085 Oct 04 20:34:36.089803 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 188/346] 10.222.0.33 () {58 vars in 1146 bytes} [Tue Oct 4 20:34:36 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:34:36.095337 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-01e874ff-88af-4495-bd16-dde3c8970c83 tempest-FlavorMetadataValidation-1569560908 tempest-FlavorMetadataValidation-1569560908-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:cpu_policy": "shared", "foo:bar": "baz"}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:34:36.210495 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-10aaf13a-5e5e-4a38-ab74-5066180e722a tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cbd31af13444cda97ba5f8c99d19437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a307499cf44d03a1e9bb61f614f099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:36.219029 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-10aaf13a-5e5e-4a38-ab74-5066180e722a tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] 10.222.0.33 "GET /compute/v2.1/servers/b8cf32e5-d9cc-4e92-bd81-2c3449406c95" status: 200 len: 1271 microversion: 2.1 time: 0.340008 Oct 04 20:34:36.230032 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 159/347] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:35 2022] GET /compute/v2.1/servers/b8cf32e5-d9cc-4e92-bd81-2c3449406c95 => generated 1271 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:36.237758 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-990a3a3c-ec02-4273-92c5-a70c2a16b8f8 tempest-HypervisorAdminNegativeUnderV252Test-1289530298 tempest-HypervisorAdminNegativeUnderV252Test-1289530298-project] Calling method '.version_select at 0x7f3c74ff1ca0>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:36.240053 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-990a3a3c-ec02-4273-92c5-a70c2a16b8f8 tempest-HypervisorAdminNegativeUnderV252Test-1289530298 tempest-HypervisorAdminNegativeUnderV252Test-1289530298-project] Policy check for os_compute_api:os-hypervisors:servers failed with credentials {'is_admin': False, 'user_id': 'd2a4a37bd0c44353a59a22b79b91dfc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fcfdc89648c4355ac4eb43ffad8c058', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:36.247137 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-990a3a3c-ec02-4273-92c5-a70c2a16b8f8 tempest-HypervisorAdminNegativeUnderV252Test-1289530298 tempest-HypervisorAdminNegativeUnderV252Test-1289530298-project] Request method failure captured: Oct 04 20:34:36.247137 n-d-854823-8 devstack@n-api.service[128801]: request: GET /compute/v2.1/os-hypervisors/1/servers HTTP/1.1 Oct 04 20:34:36.247137 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:34:36.247137 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:34:36.247137 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:34:36.247137 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 0 Oct 04 20:34:36.247137 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:34:36.247137 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:34:36.247137 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:34:36.247137 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:34:36.247137 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJjZjb3YpiVLP3q4F0LbAT9uJk4xo75zVBHhPrfKLF7EnSNjaYmPwa9xYGl1NqIdZ8aYEYW-Z4m8DF2eZHQ8y5jRMM4pLDjIQxAQI1NVSxfvwAG417Ygfa4r96fDDrXL9xbdXpZMwtP-y8cafYKQNwpmuM3sXE3dXJwnoWskdPEN2x8 Oct 04 20:34:36.247137 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:34:36.247137 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:34:36.247137 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:34:36.247137 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:34:36.247137 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:34:36.247137 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:34:36.247137 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: 3fcfdc89648c4355ac4eb43ffad8c058 Oct 04 20:34:36.247137 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1289530298 Oct 04 20:34:36.247137 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 20:34:36.247137 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 20:34:36.248569 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_3fcfdc89648c4355ac4eb43ffad8c058", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3fcfdc89648c4355ac4eb43ffad8c058"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3fcfdc89648c4355ac4eb43ffad8c058"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/3fcfdc89648c4355ac4eb43ffad8c058"}]}] Oct 04 20:34:36.248569 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1289530298 Oct 04 20:34:36.248569 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: 3fcfdc89648c4355ac4eb43ffad8c058 Oct 04 20:34:36.248569 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1289530298 Oct 04 20:34:36.248569 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1289530298-project Oct 04 20:34:36.248569 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:34:36.248569 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:34:36.248569 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: d2a4a37bd0c44353a59a22b79b91dfc8 Oct 04 20:34:36.248569 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1289530298-project Oct 04 20:34:36.248569 n-d-854823-8 devstack@n-api.service[128801]: method: Oct 04 20:34:36.248569 n-d-854823-8 devstack@n-api.service[128801]: exception: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Oct 04 20:34:36.248569 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': '1'} Oct 04 20:34:36.249224 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:34:36.249224 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:34:36.249224 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:34:36.249224 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:34:36.249224 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:34:36.249224 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:34:36.249224 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:34:36.249224 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:34:36.249224 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:34:36.249224 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:34:36.249224 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 478, in servers Oct 04 20:34:36.249224 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'servers', target={}) Oct 04 20:34:36.249224 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 20:34:36.249224 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 20:34:36.249224 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 20:34:36.249224 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 20:34:36.249224 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 20:34:36.249224 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 20:34:36.249224 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 20:34:36.250372 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 20:34:36.250372 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 20:34:36.250372 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 20:34:36.250372 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 20:34:36.250372 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 20:34:36.250372 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 20:34:36.250372 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 20:34:36.250372 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Oct 04 20:34:36.250372 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:34:36.250372 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:34:36.250372 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:34:36.250372 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:34:36.250372 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:34:36.250372 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:34:36.250372 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 20:34:36.250372 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 20:34:36.250372 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Oct 04 20:34:36.250372 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:34:36.254326 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-990a3a3c-ec02-4273-92c5-a70c2a16b8f8 tempest-HypervisorAdminNegativeUnderV252Test-1289530298 tempest-HypervisorAdminNegativeUnderV252Test-1289530298-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:34:36.255333 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-990a3a3c-ec02-4273-92c5-a70c2a16b8f8 tempest-HypervisorAdminNegativeUnderV252Test-1289530298 tempest-HypervisorAdminNegativeUnderV252Test-1289530298-project] 10.222.0.33 "GET /compute/v2.1/os-hypervisors/1/servers" status: 403 len: 118 microversion: 2.1 time: 0.023886 Oct 04 20:34:36.256055 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 160/348] 10.222.0.33 () {58 vars in 1176 bytes} [Tue Oct 4 20:34:36 2022] GET /compute/v2.1/os-hypervisors/1/servers => generated 118 bytes in 25 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:34:36.264805 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-840bf0f5-0604-4936-90f1-0b541503676b tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:36.265703 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-840bf0f5-0604-4936-90f1-0b541503676b tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] [instance: 9e9f6289-9999-4188-9af1-6cf64a676eee] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:36.293957 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-840bf0f5-0604-4936-90f1-0b541503676b tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:36.295855 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-840bf0f5-0604-4936-90f1-0b541503676b tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:36.296391 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-840bf0f5-0604-4936-90f1-0b541503676b tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:36.298438 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-840bf0f5-0604-4936-90f1-0b541503676b tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:36.298908 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-840bf0f5-0604-4936-90f1-0b541503676b tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:36.301346 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-840bf0f5-0604-4936-90f1-0b541503676b tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:36.358386 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-01e874ff-88af-4495-bd16-dde3c8970c83 tempest-FlavorMetadataValidation-1569560908 tempest-FlavorMetadataValidation-1569560908-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors/80776037/os-extra_specs" status: 200 len: 62 microversion: 2.86 time: 0.267146 Oct 04 20:34:36.364395 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 189/349] 10.222.0.33 () {62 vars in 1259 bytes} [Tue Oct 4 20:34:36 2022] POST /compute/v2.1/flavors/80776037/os-extra_specs => generated 62 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:36.378775 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-709dcc18-187f-4be4-93fb-0ac151d5c379 tempest-HypervisorAdminNegativeUnderV252Test-450131194 tempest-HypervisorAdminNegativeUnderV252Test-450131194-project-admin] Calling method '.version_select at 0x7f3c74f7a040>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:36.390422 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-709dcc18-187f-4be4-93fb-0ac151d5c379 tempest-HypervisorAdminNegativeUnderV252Test-450131194 tempest-HypervisorAdminNegativeUnderV252Test-450131194-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:36.390994 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-709dcc18-187f-4be4-93fb-0ac151d5c379 tempest-HypervisorAdminNegativeUnderV252Test-450131194 tempest-HypervisorAdminNegativeUnderV252Test-450131194-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:36.391399 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-709dcc18-187f-4be4-93fb-0ac151d5c379 tempest-HypervisorAdminNegativeUnderV252Test-450131194 tempest-HypervisorAdminNegativeUnderV252Test-450131194-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:36.420057 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.wsgi [None req-709dcc18-187f-4be4-93fb-0ac151d5c379 tempest-HypervisorAdminNegativeUnderV252Test-450131194 tempest-HypervisorAdminNegativeUnderV252Test-450131194-project-admin] HTTP exception thrown: No hypervisor matching 'f3274d34-b92b-41ee-8960-398549b529a3' could be found. Oct 04 20:34:36.421938 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-709dcc18-187f-4be4-93fb-0ac151d5c379 tempest-HypervisorAdminNegativeUnderV252Test-450131194 tempest-HypervisorAdminNegativeUnderV252Test-450131194-project-admin] Request method failure captured: Oct 04 20:34:36.421938 n-d-854823-8 devstack@n-api.service[128802]: request: GET /compute/v2.1/os-hypervisors/f3274d34-b92b-41ee-8960-398549b529a3/servers HTTP/1.1 Oct 04 20:34:36.421938 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 20:34:36.421938 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 20:34:36.421938 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 20:34:36.421938 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 0 Oct 04 20:34:36.421938 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 20:34:36.421938 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 20:34:36.421938 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 20:34:36.421938 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 20:34:36.421938 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPJjaperQ2W5fOx6cjFlc48oVJgeao-KSU5ylHAtUJkPu-Ac7zWfzWZjqgUQWy3KZ_4CF39-JOJ2aaXdCz6ALDLMcd6NfvEAleZvHaQNtWcAePzcFbaqMXPW8lH6aHYuq7NVRpmbZz_Yk_oCu1VzCeiE9WxnXkoDdNgajOLE_i5W_jYA Oct 04 20:34:36.421938 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 20:34:36.421938 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 20:34:36.421938 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 20:34:36.421938 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 20:34:36.421938 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 20:34:36.421938 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 20:34:36.421938 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: f4119d05a101446e852e61da7c2ab45f Oct 04 20:34:36.421938 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-450131194 Oct 04 20:34:36.421938 n-d-854823-8 devstack@n-api.service[128802]: X-Role: admin,reader,member Oct 04 20:34:36.421938 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: admin,reader,member Oct 04 20:34:36.423446 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f4119d05a101446e852e61da7c2ab45f", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f4119d05a101446e852e61da7c2ab45f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f4119d05a101446e852e61da7c2ab45f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f4119d05a101446e852e61da7c2ab45f"}]}] Oct 04 20:34:36.423446 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-450131194 Oct 04 20:34:36.423446 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: f4119d05a101446e852e61da7c2ab45f Oct 04 20:34:36.423446 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-450131194 Oct 04 20:34:36.423446 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-450131194-project-admin Oct 04 20:34:36.423446 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 20:34:36.423446 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 20:34:36.423446 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: 80bfd2daae3645b4951c6aec9fc2e393 Oct 04 20:34:36.423446 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-450131194-project-admin Oct 04 20:34:36.423446 n-d-854823-8 devstack@n-api.service[128802]: method: Oct 04 20:34:36.423446 n-d-854823-8 devstack@n-api.service[128802]: exception: No hypervisor matching 'f3274d34-b92b-41ee-8960-398549b529a3' could be found. Oct 04 20:34:36.423446 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'id': 'f3274d34-b92b-41ee-8960-398549b529a3'} Oct 04 20:34:36.424118 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:34:36.424118 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:34:36.424118 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:34:36.424118 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:34:36.424118 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:34:36.424118 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:34:36.424118 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:34:36.424118 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:34:36.424118 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:34:36.424118 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:34:36.424118 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 482, in servers Oct 04 20:34:36.424118 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Oct 04 20:34:36.424118 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Oct 04 20:34:36.424118 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 04 20:34:36.424118 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'f3274d34-b92b-41ee-8960-398549b529a3' could be found. Oct 04 20:34:36.424118 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:34:36.424118 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:34:36.424118 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:34:36.424118 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:34:36.425145 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:34:36.425145 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:34:36.425145 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:34:36.425145 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:34:36.425145 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'f3274d34-b92b-41ee-8960-398549b529a3' could be found. Oct 04 20:34:36.425145 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:34:36.425145 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-709dcc18-187f-4be4-93fb-0ac151d5c379 tempest-HypervisorAdminNegativeUnderV252Test-450131194 tempest-HypervisorAdminNegativeUnderV252Test-450131194-project-admin] Returning 404 to user: No hypervisor matching 'f3274d34-b92b-41ee-8960-398549b529a3' could be found. {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:34:36.425145 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-709dcc18-187f-4be4-93fb-0ac151d5c379 tempest-HypervisorAdminNegativeUnderV252Test-450131194 tempest-HypervisorAdminNegativeUnderV252Test-450131194-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors/f3274d34-b92b-41ee-8960-398549b529a3/servers" status: 404 len: 123 microversion: 2.1 time: 0.062032 Oct 04 20:34:36.434738 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 190/350] 10.222.0.33 () {58 vars in 1281 bytes} [Tue Oct 4 20:34:36 2022] GET /compute/v2.1/os-hypervisors/f3274d34-b92b-41ee-8960-398549b529a3/servers => generated 123 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:34:36.439545 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-cf503c20-fa17-4f10-b063-8db45cc79f2c tempest-FlavorMetadataValidation-1569560908 tempest-FlavorMetadataValidation-1569560908-project-admin] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:36.482968 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-cf503c20-fa17-4f10-b063-8db45cc79f2c tempest-FlavorMetadataValidation-1569560908 tempest-FlavorMetadataValidation-1569560908-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/80776037" status: 202 len: 0 microversion: 2.86 time: 0.046957 Oct 04 20:34:36.483696 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 191/351] 10.222.0.33 () {60 vars in 1196 bytes} [Tue Oct 4 20:34:36 2022] DELETE /compute/v2.1/flavors/80776037 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:34:36.495513 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-1d3fd3ac-6d68-4b87-a13d-139a596c122b tempest-FlavorMetadataValidation-1569560908 tempest-FlavorMetadataValidation-1569560908-project-admin] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:36.526633 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-1d3fd3ac-6d68-4b87-a13d-139a596c122b tempest-FlavorMetadataValidation-1569560908 tempest-FlavorMetadataValidation-1569560908-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 6681 microversion: 2.86 time: 0.038099 Oct 04 20:34:36.527410 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 192/352] 10.222.0.33 () {60 vars in 1187 bytes} [Tue Oct 4 20:34:36 2022] GET /compute/v2.1/flavors/detail => generated 6681 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:34:36.656893 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-840bf0f5-0604-4936-90f1-0b541503676b tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3563efe2b8c94931a2a46c4e14811b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3118a5d96843d3bede1ed94bd9717e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:36.675171 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-585e5609-7064-4836-b166-04b10ba8ca3a tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:36.676124 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-585e5609-7064-4836-b166-04b10ba8ca3a tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] [instance: 63e16106-fc95-4fa8-bf7c-e70ff878a5ae] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:36.683170 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-840bf0f5-0604-4936-90f1-0b541503676b tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] 10.222.0.33 "GET /compute/v2.1/servers/9e9f6289-9999-4188-9af1-6cf64a676eee" status: 200 len: 1477 microversion: 2.1 time: 0.412426 Oct 04 20:34:36.684762 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 161/353] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:36 2022] GET /compute/v2.1/servers/9e9f6289-9999-4188-9af1-6cf64a676eee => generated 1477 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:36.686117 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-585e5609-7064-4836-b166-04b10ba8ca3a tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:36.686979 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-585e5609-7064-4836-b166-04b10ba8ca3a tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:36.687846 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-585e5609-7064-4836-b166-04b10ba8ca3a tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:36.688923 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-585e5609-7064-4836-b166-04b10ba8ca3a tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:36.689628 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-585e5609-7064-4836-b166-04b10ba8ca3a tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:36.690411 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-585e5609-7064-4836-b166-04b10ba8ca3a tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:36.957960 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-585e5609-7064-4836-b166-04b10ba8ca3a tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '147d000a331f4a3ba47019fcbae40901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9928be759e34d208d835263d73a5ab5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:36.986248 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-585e5609-7064-4836-b166-04b10ba8ca3a tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] 10.222.0.33 "GET /compute/v2.1/servers/63e16106-fc95-4fa8-bf7c-e70ff878a5ae" status: 200 len: 1321 microversion: 2.1 time: 0.315691 Oct 04 20:34:36.986896 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 193/354] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:36 2022] GET /compute/v2.1/servers/63e16106-fc95-4fa8-bf7c-e70ff878a5ae => generated 1321 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:34:37.244514 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-bdedc11f-fe6c-4916-b3ae-805f0991aa1b tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:37.245126 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-bdedc11f-fe6c-4916-b3ae-805f0991aa1b tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] [instance: b8cf32e5-d9cc-4e92-bd81-2c3449406c95] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:37.261159 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bdedc11f-fe6c-4916-b3ae-805f0991aa1b tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:37.265181 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bdedc11f-fe6c-4916-b3ae-805f0991aa1b tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:37.265803 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bdedc11f-fe6c-4916-b3ae-805f0991aa1b tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:37.270229 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bdedc11f-fe6c-4916-b3ae-805f0991aa1b tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:37.270907 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bdedc11f-fe6c-4916-b3ae-805f0991aa1b tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:37.273793 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bdedc11f-fe6c-4916-b3ae-805f0991aa1b tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:37.426072 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-bdedc11f-fe6c-4916-b3ae-805f0991aa1b tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cbd31af13444cda97ba5f8c99d19437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a307499cf44d03a1e9bb61f614f099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:37.439962 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-bdedc11f-fe6c-4916-b3ae-805f0991aa1b tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] 10.222.0.33 "GET /compute/v2.1/servers/b8cf32e5-d9cc-4e92-bd81-2c3449406c95" status: 200 len: 1277 microversion: 2.1 time: 0.198477 Oct 04 20:34:37.442084 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 162/355] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:37 2022] GET /compute/v2.1/servers/b8cf32e5-d9cc-4e92-bd81-2c3449406c95 => generated 1277 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:37.709115 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-7e629e01-0e70-4887-9033-09045c9947c4 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:37.709726 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-7e629e01-0e70-4887-9033-09045c9947c4 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] [instance: 9e9f6289-9999-4188-9af1-6cf64a676eee] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:37.717154 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7e629e01-0e70-4887-9033-09045c9947c4 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:37.722814 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7e629e01-0e70-4887-9033-09045c9947c4 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:37.723481 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7e629e01-0e70-4887-9033-09045c9947c4 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:37.724466 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7e629e01-0e70-4887-9033-09045c9947c4 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:37.726431 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7e629e01-0e70-4887-9033-09045c9947c4 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:37.728120 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7e629e01-0e70-4887-9033-09045c9947c4 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:38.070886 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-475c3387-d527-4d78-b68f-9e95733ef0fd tempest-HypervisorAdminUnderV252Test-1597871631 tempest-HypervisorAdminUnderV252Test-1597871631-project-admin] Calling method '.version_select at 0x7f3c75061dc0>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:38.072878 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-475c3387-d527-4d78-b68f-9e95733ef0fd tempest-HypervisorAdminUnderV252Test-1597871631 tempest-HypervisorAdminUnderV252Test-1597871631-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:38.073345 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-475c3387-d527-4d78-b68f-9e95733ef0fd tempest-HypervisorAdminUnderV252Test-1597871631 tempest-HypervisorAdminUnderV252Test-1597871631-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:38.073903 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-475c3387-d527-4d78-b68f-9e95733ef0fd tempest-HypervisorAdminUnderV252Test-1597871631 tempest-HypervisorAdminUnderV252Test-1597871631-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:38.089391 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-475c3387-d527-4d78-b68f-9e95733ef0fd tempest-HypervisorAdminUnderV252Test-1597871631 tempest-HypervisorAdminUnderV252Test-1597871631-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:38.089985 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-475c3387-d527-4d78-b68f-9e95733ef0fd tempest-HypervisorAdminUnderV252Test-1597871631 tempest-HypervisorAdminUnderV252Test-1597871631-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:38.090535 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-475c3387-d527-4d78-b68f-9e95733ef0fd tempest-HypervisorAdminUnderV252Test-1597871631 tempest-HypervisorAdminUnderV252Test-1597871631-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:38.101282 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-475c3387-d527-4d78-b68f-9e95733ef0fd tempest-HypervisorAdminUnderV252Test-1597871631 tempest-HypervisorAdminUnderV252Test-1597871631-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:38.102072 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-475c3387-d527-4d78-b68f-9e95733ef0fd tempest-HypervisorAdminUnderV252Test-1597871631 tempest-HypervisorAdminUnderV252Test-1597871631-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:38.103325 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-475c3387-d527-4d78-b68f-9e95733ef0fd tempest-HypervisorAdminUnderV252Test-1597871631 tempest-HypervisorAdminUnderV252Test-1597871631-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:38.110409 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-475c3387-d527-4d78-b68f-9e95733ef0fd tempest-HypervisorAdminUnderV252Test-1597871631 tempest-HypervisorAdminUnderV252Test-1597871631-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.191166 Oct 04 20:34:38.111402 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 163/356] 10.222.0.33 () {58 vars in 1146 bytes} [Tue Oct 4 20:34:37 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 20:34:38.116278 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0fce3f00-cce5-4864-b86c-f66cfb558f5c tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:38.117024 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-0fce3f00-cce5-4864-b86c-f66cfb558f5c tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] [instance: 63e16106-fc95-4fa8-bf7c-e70ff878a5ae] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:38.124368 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0fce3f00-cce5-4864-b86c-f66cfb558f5c tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:38.125061 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0fce3f00-cce5-4864-b86c-f66cfb558f5c tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:38.125758 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0fce3f00-cce5-4864-b86c-f66cfb558f5c tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:38.126697 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0fce3f00-cce5-4864-b86c-f66cfb558f5c tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:38.127441 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0fce3f00-cce5-4864-b86c-f66cfb558f5c tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:38.128023 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0fce3f00-cce5-4864-b86c-f66cfb558f5c tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:38.136533 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-7e629e01-0e70-4887-9033-09045c9947c4 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3563efe2b8c94931a2a46c4e14811b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3118a5d96843d3bede1ed94bd9717e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:38.147742 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-7e629e01-0e70-4887-9033-09045c9947c4 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] 10.222.0.33 "GET /compute/v2.1/servers/9e9f6289-9999-4188-9af1-6cf64a676eee" status: 200 len: 1477 microversion: 2.1 time: 0.442237 Oct 04 20:34:38.150450 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 194/357] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:37 2022] GET /compute/v2.1/servers/9e9f6289-9999-4188-9af1-6cf64a676eee => generated 1477 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:38.165382 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-4f956d1b-13aa-473b-ac29-7f963cf67da1 tempest-HypervisorAdminUnderV252Test-1597871631 tempest-HypervisorAdminUnderV252Test-1597871631-project-admin] Calling method '.version_select at 0x7f3c74f4d9d0>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:38.168983 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4f956d1b-13aa-473b-ac29-7f963cf67da1 tempest-HypervisorAdminUnderV252Test-1597871631 tempest-HypervisorAdminUnderV252Test-1597871631-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:38.169617 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4f956d1b-13aa-473b-ac29-7f963cf67da1 tempest-HypervisorAdminUnderV252Test-1597871631 tempest-HypervisorAdminUnderV252Test-1597871631-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:38.170258 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4f956d1b-13aa-473b-ac29-7f963cf67da1 tempest-HypervisorAdminUnderV252Test-1597871631 tempest-HypervisorAdminUnderV252Test-1597871631-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:38.189840 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4f956d1b-13aa-473b-ac29-7f963cf67da1 tempest-HypervisorAdminUnderV252Test-1597871631 tempest-HypervisorAdminUnderV252Test-1597871631-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:38.190698 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4f956d1b-13aa-473b-ac29-7f963cf67da1 tempest-HypervisorAdminUnderV252Test-1597871631 tempest-HypervisorAdminUnderV252Test-1597871631-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:38.191374 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4f956d1b-13aa-473b-ac29-7f963cf67da1 tempest-HypervisorAdminUnderV252Test-1597871631 tempest-HypervisorAdminUnderV252Test-1597871631-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:38.233625 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4f956d1b-13aa-473b-ac29-7f963cf67da1 tempest-HypervisorAdminUnderV252Test-1597871631 tempest-HypervisorAdminUnderV252Test-1597871631-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:38.234105 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4f956d1b-13aa-473b-ac29-7f963cf67da1 tempest-HypervisorAdminUnderV252Test-1597871631 tempest-HypervisorAdminUnderV252Test-1597871631-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:38.235039 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4f956d1b-13aa-473b-ac29-7f963cf67da1 tempest-HypervisorAdminUnderV252Test-1597871631 tempest-HypervisorAdminUnderV252Test-1597871631-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:38.243537 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-4f956d1b-13aa-473b-ac29-7f963cf67da1 tempest-HypervisorAdminUnderV252Test-1597871631 tempest-HypervisorAdminUnderV252Test-1597871631-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors/n-h1-854823-8/servers" status: 200 len: 275 microversion: 2.1 time: 0.091261 Oct 04 20:34:38.250967 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 195/358] 10.222.0.33 () {58 vars in 1212 bytes} [Tue Oct 4 20:34:38 2022] GET /compute/v2.1/os-hypervisors/n-h1-854823-8/servers => generated 275 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:34:38.257438 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-2ef82c76-deeb-4e4e-9913-c1f926bd8f8c tempest-HypervisorAdminUnderV252Test-1597871631 tempest-HypervisorAdminUnderV252Test-1597871631-project-admin] Calling method '.version_select at 0x7f3c74f4dd30>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:38.260520 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2ef82c76-deeb-4e4e-9913-c1f926bd8f8c tempest-HypervisorAdminUnderV252Test-1597871631 tempest-HypervisorAdminUnderV252Test-1597871631-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:38.260844 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2ef82c76-deeb-4e4e-9913-c1f926bd8f8c tempest-HypervisorAdminUnderV252Test-1597871631 tempest-HypervisorAdminUnderV252Test-1597871631-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:38.261825 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2ef82c76-deeb-4e4e-9913-c1f926bd8f8c tempest-HypervisorAdminUnderV252Test-1597871631 tempest-HypervisorAdminUnderV252Test-1597871631-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:38.282030 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2ef82c76-deeb-4e4e-9913-c1f926bd8f8c tempest-HypervisorAdminUnderV252Test-1597871631 tempest-HypervisorAdminUnderV252Test-1597871631-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:38.283199 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2ef82c76-deeb-4e4e-9913-c1f926bd8f8c tempest-HypervisorAdminUnderV252Test-1597871631 tempest-HypervisorAdminUnderV252Test-1597871631-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:38.283637 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2ef82c76-deeb-4e4e-9913-c1f926bd8f8c tempest-HypervisorAdminUnderV252Test-1597871631 tempest-HypervisorAdminUnderV252Test-1597871631-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:38.299622 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2ef82c76-deeb-4e4e-9913-c1f926bd8f8c tempest-HypervisorAdminUnderV252Test-1597871631 tempest-HypervisorAdminUnderV252Test-1597871631-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:38.300360 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2ef82c76-deeb-4e4e-9913-c1f926bd8f8c tempest-HypervisorAdminUnderV252Test-1597871631 tempest-HypervisorAdminUnderV252Test-1597871631-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:38.301045 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2ef82c76-deeb-4e4e-9913-c1f926bd8f8c tempest-HypervisorAdminUnderV252Test-1597871631 tempest-HypervisorAdminUnderV252Test-1597871631-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:38.310948 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-2ef82c76-deeb-4e4e-9913-c1f926bd8f8c tempest-HypervisorAdminUnderV252Test-1597871631 tempest-HypervisorAdminUnderV252Test-1597871631-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.057712 Oct 04 20:34:38.312634 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 196/359] 10.222.0.33 () {58 vars in 1146 bytes} [Tue Oct 4 20:34:38 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:34:38.339477 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-d53d9167-e790-4e0b-a11f-c1df846931df tempest-HypervisorAdminUnderV252Test-1597871631 tempest-HypervisorAdminUnderV252Test-1597871631-project-admin] Calling method '.version_select at 0x7f3c74f4d5e0>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:38.343086 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d53d9167-e790-4e0b-a11f-c1df846931df tempest-HypervisorAdminUnderV252Test-1597871631 tempest-HypervisorAdminUnderV252Test-1597871631-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:38.343895 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d53d9167-e790-4e0b-a11f-c1df846931df tempest-HypervisorAdminUnderV252Test-1597871631 tempest-HypervisorAdminUnderV252Test-1597871631-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:38.344995 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d53d9167-e790-4e0b-a11f-c1df846931df tempest-HypervisorAdminUnderV252Test-1597871631 tempest-HypervisorAdminUnderV252Test-1597871631-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:38.363706 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d53d9167-e790-4e0b-a11f-c1df846931df tempest-HypervisorAdminUnderV252Test-1597871631 tempest-HypervisorAdminUnderV252Test-1597871631-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:38.364785 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d53d9167-e790-4e0b-a11f-c1df846931df tempest-HypervisorAdminUnderV252Test-1597871631 tempest-HypervisorAdminUnderV252Test-1597871631-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:38.365591 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d53d9167-e790-4e0b-a11f-c1df846931df tempest-HypervisorAdminUnderV252Test-1597871631 tempest-HypervisorAdminUnderV252Test-1597871631-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:38.375681 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-d53d9167-e790-4e0b-a11f-c1df846931df tempest-HypervisorAdminUnderV252Test-1597871631 tempest-HypervisorAdminUnderV252Test-1597871631-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors/n-h1-854823-8/search" status: 200 len: 104 microversion: 2.1 time: 0.049081 Oct 04 20:34:38.378611 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 197/360] 10.222.0.33 () {58 vars in 1209 bytes} [Tue Oct 4 20:34:38 2022] GET /compute/v2.1/os-hypervisors/n-h1-854823-8/search => generated 104 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:34:38.474922 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-c53a6d6e-6190-4b90-8b61-1bd76412e457 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:38.475875 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-c53a6d6e-6190-4b90-8b61-1bd76412e457 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] [instance: b8cf32e5-d9cc-4e92-bd81-2c3449406c95] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:38.485652 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c53a6d6e-6190-4b90-8b61-1bd76412e457 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:38.487233 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c53a6d6e-6190-4b90-8b61-1bd76412e457 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:38.488345 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c53a6d6e-6190-4b90-8b61-1bd76412e457 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:38.490078 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c53a6d6e-6190-4b90-8b61-1bd76412e457 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:38.491137 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c53a6d6e-6190-4b90-8b61-1bd76412e457 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:38.492297 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c53a6d6e-6190-4b90-8b61-1bd76412e457 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:38.504522 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-0fce3f00-cce5-4864-b86c-f66cfb558f5c tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '147d000a331f4a3ba47019fcbae40901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9928be759e34d208d835263d73a5ab5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:38.518739 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-0fce3f00-cce5-4864-b86c-f66cfb558f5c tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] 10.222.0.33 "GET /compute/v2.1/servers/63e16106-fc95-4fa8-bf7c-e70ff878a5ae" status: 200 len: 1321 microversion: 2.1 time: 0.405858 Oct 04 20:34:38.536010 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 164/361] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:38 2022] GET /compute/v2.1/servers/63e16106-fc95-4fa8-bf7c-e70ff878a5ae => generated 1321 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:38.602242 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-9ac1aaed-ccb8-4059-8521-50f248b67435 req-ca24a068-2e4c-40b4-be88-84e47b2cb839 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63e16106-fc95-4fa8-bf7c-e70ff878a5ae", "name": "network-vif-plugged", "status": "completed", "tag": "9d9e908b-6316-4180-a0db-a0f76d878158"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:34:38.623342 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-9ac1aaed-ccb8-4059-8521-50f248b67435 req-ca24a068-2e4c-40b4-be88-84e47b2cb839 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:38.624059 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-9ac1aaed-ccb8-4059-8521-50f248b67435 req-ca24a068-2e4c-40b4-be88-84e47b2cb839 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:38.624512 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-9ac1aaed-ccb8-4059-8521-50f248b67435 req-ca24a068-2e4c-40b4-be88-84e47b2cb839 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:38.639907 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-9ac1aaed-ccb8-4059-8521-50f248b67435 req-ca24a068-2e4c-40b4-be88-84e47b2cb839 service nova] Creating event network-vif-plugged:9d9e908b-6316-4180-a0db-a0f76d878158 for instance 63e16106-fc95-4fa8-bf7c-e70ff878a5ae on n-h1-854823-8 Oct 04 20:34:38.647609 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-9ac1aaed-ccb8-4059-8521-50f248b67435 req-ca24a068-2e4c-40b4-be88-84e47b2cb839 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050029 Oct 04 20:34:38.649377 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 165/362] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:34:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 20:34:38.862330 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-c53a6d6e-6190-4b90-8b61-1bd76412e457 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cbd31af13444cda97ba5f8c99d19437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a307499cf44d03a1e9bb61f614f099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:38.890191 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-c53a6d6e-6190-4b90-8b61-1bd76412e457 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] 10.222.0.33 "GET /compute/v2.1/servers/b8cf32e5-d9cc-4e92-bd81-2c3449406c95" status: 200 len: 1319 microversion: 2.1 time: 0.423446 Oct 04 20:34:38.892304 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 198/363] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:38 2022] GET /compute/v2.1/servers/b8cf32e5-d9cc-4e92-bd81-2c3449406c95 => generated 1319 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:39.176984 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e27a09df-e046-47d0-ab5e-3cab01fadc37 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:39.177809 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e27a09df-e046-47d0-ab5e-3cab01fadc37 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] [instance: 9e9f6289-9999-4188-9af1-6cf64a676eee] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:39.194921 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e27a09df-e046-47d0-ab5e-3cab01fadc37 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:39.195571 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e27a09df-e046-47d0-ab5e-3cab01fadc37 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:39.196166 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e27a09df-e046-47d0-ab5e-3cab01fadc37 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:39.199164 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e27a09df-e046-47d0-ab5e-3cab01fadc37 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:39.202256 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e27a09df-e046-47d0-ab5e-3cab01fadc37 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:39.204425 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e27a09df-e046-47d0-ab5e-3cab01fadc37 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:39.544715 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-f29b4a32-1e84-474a-bc02-588bf2867d57 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:39.545460 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-f29b4a32-1e84-474a-bc02-588bf2867d57 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] [instance: 63e16106-fc95-4fa8-bf7c-e70ff878a5ae] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:39.554500 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f29b4a32-1e84-474a-bc02-588bf2867d57 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:39.556591 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f29b4a32-1e84-474a-bc02-588bf2867d57 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:39.557935 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f29b4a32-1e84-474a-bc02-588bf2867d57 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:39.559149 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f29b4a32-1e84-474a-bc02-588bf2867d57 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:39.559899 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f29b4a32-1e84-474a-bc02-588bf2867d57 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:39.561107 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f29b4a32-1e84-474a-bc02-588bf2867d57 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:39.610673 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e27a09df-e046-47d0-ab5e-3cab01fadc37 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3563efe2b8c94931a2a46c4e14811b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3118a5d96843d3bede1ed94bd9717e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:39.637209 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e27a09df-e046-47d0-ab5e-3cab01fadc37 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] 10.222.0.33 "GET /compute/v2.1/servers/9e9f6289-9999-4188-9af1-6cf64a676eee" status: 200 len: 1477 microversion: 2.1 time: 0.466750 Oct 04 20:34:39.662353 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 166/364] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:39 2022] GET /compute/v2.1/servers/9e9f6289-9999-4188-9af1-6cf64a676eee => generated 1477 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:39.920821 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-fa65fa8a-372a-4642-b17e-b48cfb4c1751 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:39.924941 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-fa65fa8a-372a-4642-b17e-b48cfb4c1751 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] [instance: b8cf32e5-d9cc-4e92-bd81-2c3449406c95] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:39.947637 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fa65fa8a-372a-4642-b17e-b48cfb4c1751 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:39.950490 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fa65fa8a-372a-4642-b17e-b48cfb4c1751 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:39.953211 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fa65fa8a-372a-4642-b17e-b48cfb4c1751 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:39.956210 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fa65fa8a-372a-4642-b17e-b48cfb4c1751 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:39.956892 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fa65fa8a-372a-4642-b17e-b48cfb4c1751 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:39.957604 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fa65fa8a-372a-4642-b17e-b48cfb4c1751 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:40.131719 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-f29b4a32-1e84-474a-bc02-588bf2867d57 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '147d000a331f4a3ba47019fcbae40901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9928be759e34d208d835263d73a5ab5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:40.145126 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-f29b4a32-1e84-474a-bc02-588bf2867d57 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] 10.222.0.33 "GET /compute/v2.1/servers/63e16106-fc95-4fa8-bf7c-e70ff878a5ae" status: 200 len: 1321 microversion: 2.1 time: 0.605349 Oct 04 20:34:40.147161 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 199/365] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:39 2022] GET /compute/v2.1/servers/63e16106-fc95-4fa8-bf7c-e70ff878a5ae => generated 1321 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:40.153012 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-011e6ab1-69bd-4ed8-b63c-89582c1c6a60 req-e4e1fcf5-3225-4b59-b059-fd363204d36f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8cf32e5-d9cc-4e92-bd81-2c3449406c95", "tag": "f596121d-68e0-4a9f-b140-59dcfd3b23d4"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:34:40.184750 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-011e6ab1-69bd-4ed8-b63c-89582c1c6a60 req-e4e1fcf5-3225-4b59-b059-fd363204d36f service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:40.185770 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-011e6ab1-69bd-4ed8-b63c-89582c1c6a60 req-e4e1fcf5-3225-4b59-b059-fd363204d36f service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:40.187565 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-011e6ab1-69bd-4ed8-b63c-89582c1c6a60 req-e4e1fcf5-3225-4b59-b059-fd363204d36f service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:40.218381 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-011e6ab1-69bd-4ed8-b63c-89582c1c6a60 req-e4e1fcf5-3225-4b59-b059-fd363204d36f service nova] Creating event network-changed:f596121d-68e0-4a9f-b140-59dcfd3b23d4 for instance b8cf32e5-d9cc-4e92-bd81-2c3449406c95 on n-h2-854823-8 Oct 04 20:34:40.232563 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-011e6ab1-69bd-4ed8-b63c-89582c1c6a60 req-e4e1fcf5-3225-4b59-b059-fd363204d36f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083846 Oct 04 20:34:40.233427 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 200/366] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:34:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:34:40.455409 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-fa65fa8a-372a-4642-b17e-b48cfb4c1751 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cbd31af13444cda97ba5f8c99d19437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a307499cf44d03a1e9bb61f614f099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:40.470640 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-fa65fa8a-372a-4642-b17e-b48cfb4c1751 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] 10.222.0.33 "GET /compute/v2.1/servers/b8cf32e5-d9cc-4e92-bd81-2c3449406c95" status: 200 len: 1319 microversion: 2.1 time: 0.557643 Oct 04 20:34:40.471430 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 167/367] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:39 2022] GET /compute/v2.1/servers/b8cf32e5-d9cc-4e92-bd81-2c3449406c95 => generated 1319 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:40.672419 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-6830c56b-051f-46fe-968b-07e7a614d51b tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:40.673687 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-6830c56b-051f-46fe-968b-07e7a614d51b tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] [instance: 9e9f6289-9999-4188-9af1-6cf64a676eee] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:40.683572 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6830c56b-051f-46fe-968b-07e7a614d51b tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:40.684838 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6830c56b-051f-46fe-968b-07e7a614d51b tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:40.685501 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6830c56b-051f-46fe-968b-07e7a614d51b tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:40.686437 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6830c56b-051f-46fe-968b-07e7a614d51b tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:40.687082 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6830c56b-051f-46fe-968b-07e7a614d51b tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:40.688271 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6830c56b-051f-46fe-968b-07e7a614d51b tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:41.174210 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-92c7269e-dd76-4cb5-8248-0c0c7f981c87 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:41.175902 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-92c7269e-dd76-4cb5-8248-0c0c7f981c87 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] [instance: 63e16106-fc95-4fa8-bf7c-e70ff878a5ae] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:41.190451 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-92c7269e-dd76-4cb5-8248-0c0c7f981c87 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:41.192207 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-92c7269e-dd76-4cb5-8248-0c0c7f981c87 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:41.192944 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-92c7269e-dd76-4cb5-8248-0c0c7f981c87 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:41.194902 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-92c7269e-dd76-4cb5-8248-0c0c7f981c87 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:41.196737 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-92c7269e-dd76-4cb5-8248-0c0c7f981c87 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:41.199216 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-92c7269e-dd76-4cb5-8248-0c0c7f981c87 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:41.414726 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell0:SELECT=11 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:34:41.470038 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell0:SELECT=22 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:34:41.651931 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-6830c56b-051f-46fe-968b-07e7a614d51b tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3563efe2b8c94931a2a46c4e14811b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3118a5d96843d3bede1ed94bd9717e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:41.666016 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-6830c56b-051f-46fe-968b-07e7a614d51b tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] 10.222.0.33 "GET /compute/v2.1/servers/9e9f6289-9999-4188-9af1-6cf64a676eee" status: 200 len: 1477 microversion: 2.1 time: 0.998972 Oct 04 20:34:41.668396 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 201/368] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:40 2022] GET /compute/v2.1/servers/9e9f6289-9999-4188-9af1-6cf64a676eee => generated 1477 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:34:41.686052 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-86073283-384d-44cd-8e81-119c9a223bc7 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:41.688535 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-86073283-384d-44cd-8e81-119c9a223bc7 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] [instance: b8cf32e5-d9cc-4e92-bd81-2c3449406c95] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:41.704825 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-86073283-384d-44cd-8e81-119c9a223bc7 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:41.706471 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-86073283-384d-44cd-8e81-119c9a223bc7 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:41.707114 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-86073283-384d-44cd-8e81-119c9a223bc7 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:41.709112 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-86073283-384d-44cd-8e81-119c9a223bc7 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:41.709593 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-86073283-384d-44cd-8e81-119c9a223bc7 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:41.710029 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-86073283-384d-44cd-8e81-119c9a223bc7 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:41.895587 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-92c7269e-dd76-4cb5-8248-0c0c7f981c87 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '147d000a331f4a3ba47019fcbae40901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9928be759e34d208d835263d73a5ab5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:41.936289 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-92c7269e-dd76-4cb5-8248-0c0c7f981c87 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] 10.222.0.33 "GET /compute/v2.1/servers/63e16106-fc95-4fa8-bf7c-e70ff878a5ae" status: 200 len: 1470 microversion: 2.1 time: 0.767314 Oct 04 20:34:41.958864 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 168/369] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:41 2022] GET /compute/v2.1/servers/63e16106-fc95-4fa8-bf7c-e70ff878a5ae => generated 1470 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:41.971874 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a1941c0e-0e1c-4dc3-b0d6-a394399b3da9 tempest-ServersAdminNegativeTestJSON-129976034 tempest-ServersAdminNegativeTestJSON-129976034-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:34:41.979435 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a1941c0e-0e1c-4dc3-b0d6-a394399b3da9 tempest-ServersAdminNegativeTestJSON-129976034 tempest-ServersAdminNegativeTestJSON-129976034-project-admin] [instance: 63e16106-fc95-4fa8-bf7c-e70ff878a5ae] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:41.987619 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a1941c0e-0e1c-4dc3-b0d6-a394399b3da9 tempest-ServersAdminNegativeTestJSON-129976034 tempest-ServersAdminNegativeTestJSON-129976034-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:41.988812 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a1941c0e-0e1c-4dc3-b0d6-a394399b3da9 tempest-ServersAdminNegativeTestJSON-129976034 tempest-ServersAdminNegativeTestJSON-129976034-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:41.989476 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a1941c0e-0e1c-4dc3-b0d6-a394399b3da9 tempest-ServersAdminNegativeTestJSON-129976034 tempest-ServersAdminNegativeTestJSON-129976034-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:41.990746 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a1941c0e-0e1c-4dc3-b0d6-a394399b3da9 tempest-ServersAdminNegativeTestJSON-129976034 tempest-ServersAdminNegativeTestJSON-129976034-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:41.991484 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a1941c0e-0e1c-4dc3-b0d6-a394399b3da9 tempest-ServersAdminNegativeTestJSON-129976034 tempest-ServersAdminNegativeTestJSON-129976034-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:41.992219 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a1941c0e-0e1c-4dc3-b0d6-a394399b3da9 tempest-ServersAdminNegativeTestJSON-129976034 tempest-ServersAdminNegativeTestJSON-129976034-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:42.087328 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-a1941c0e-0e1c-4dc3-b0d6-a394399b3da9 tempest-ServersAdminNegativeTestJSON-129976034 tempest-ServersAdminNegativeTestJSON-129976034-project-admin] Lazy-loading 'flavor' on Instance uuid 63e16106-fc95-4fa8-bf7c-e70ff878a5ae {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:34:42.120408 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-86073283-384d-44cd-8e81-119c9a223bc7 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cbd31af13444cda97ba5f8c99d19437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a307499cf44d03a1e9bb61f614f099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:42.132655 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-86073283-384d-44cd-8e81-119c9a223bc7 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] 10.222.0.33 "GET /compute/v2.1/servers/b8cf32e5-d9cc-4e92-bd81-2c3449406c95" status: 200 len: 1319 microversion: 2.1 time: 0.460564 Oct 04 20:34:42.133230 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 202/370] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:41 2022] GET /compute/v2.1/servers/b8cf32e5-d9cc-4e92-bd81-2c3449406c95 => generated 1319 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:42.234681 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a1941c0e-0e1c-4dc3-b0d6-a394399b3da9 tempest-ServersAdminNegativeTestJSON-129976034 tempest-ServersAdminNegativeTestJSON-129976034-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/63e16106-fc95-4fa8-bf7c-e70ff878a5ae/action" status: 202 len: 0 microversion: 2.1 time: 0.269421 Oct 04 20:34:42.235784 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 169/371] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 20:34:41 2022] POST /compute/v2.1/servers/63e16106-fc95-4fa8-bf7c-e70ff878a5ae/action => generated 0 bytes in 272 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:34:42.244037 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-bad4a064-c62b-46fb-ab71-55a020cb62f2 tempest-ServersAdminNegativeTestJSON-129976034 tempest-ServersAdminNegativeTestJSON-129976034-project-admin] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:42.245044 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-bad4a064-c62b-46fb-ab71-55a020cb62f2 tempest-ServersAdminNegativeTestJSON-129976034 tempest-ServersAdminNegativeTestJSON-129976034-project-admin] [instance: 63e16106-fc95-4fa8-bf7c-e70ff878a5ae] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:42.252205 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bad4a064-c62b-46fb-ab71-55a020cb62f2 tempest-ServersAdminNegativeTestJSON-129976034 tempest-ServersAdminNegativeTestJSON-129976034-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:42.252879 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bad4a064-c62b-46fb-ab71-55a020cb62f2 tempest-ServersAdminNegativeTestJSON-129976034 tempest-ServersAdminNegativeTestJSON-129976034-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:42.253472 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bad4a064-c62b-46fb-ab71-55a020cb62f2 tempest-ServersAdminNegativeTestJSON-129976034 tempest-ServersAdminNegativeTestJSON-129976034-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:42.254332 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bad4a064-c62b-46fb-ab71-55a020cb62f2 tempest-ServersAdminNegativeTestJSON-129976034 tempest-ServersAdminNegativeTestJSON-129976034-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:42.255111 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bad4a064-c62b-46fb-ab71-55a020cb62f2 tempest-ServersAdminNegativeTestJSON-129976034 tempest-ServersAdminNegativeTestJSON-129976034-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:42.255685 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bad4a064-c62b-46fb-ab71-55a020cb62f2 tempest-ServersAdminNegativeTestJSON-129976034 tempest-ServersAdminNegativeTestJSON-129976034-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:42.797073 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-bad4a064-c62b-46fb-ab71-55a020cb62f2 tempest-ServersAdminNegativeTestJSON-129976034 tempest-ServersAdminNegativeTestJSON-129976034-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/63e16106-fc95-4fa8-bf7c-e70ff878a5ae" status: 200 len: 1629 microversion: 2.1 time: 0.556553 Oct 04 20:34:42.834583 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 203/372] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:42 2022] GET /compute/v2.1/servers/63e16106-fc95-4fa8-bf7c-e70ff878a5ae => generated 1629 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:42.854286 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-fa355b82-1adb-49ec-9fd4-304e8b6a6db4 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:42.854286 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-fa355b82-1adb-49ec-9fd4-304e8b6a6db4 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] [instance: 9e9f6289-9999-4188-9af1-6cf64a676eee] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:42.859759 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fa355b82-1adb-49ec-9fd4-304e8b6a6db4 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:42.860252 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fa355b82-1adb-49ec-9fd4-304e8b6a6db4 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:42.860951 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fa355b82-1adb-49ec-9fd4-304e8b6a6db4 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:42.861799 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fa355b82-1adb-49ec-9fd4-304e8b6a6db4 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:42.862501 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fa355b82-1adb-49ec-9fd4-304e8b6a6db4 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:42.862929 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fa355b82-1adb-49ec-9fd4-304e8b6a6db4 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:42.928671 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8a2507fe-df06-4996-8d1d-b15132376ed7 tempest-HypervisorAdminNegativeTestJSON-451740698 tempest-HypervisorAdminNegativeTestJSON-451740698-project] Calling method '.version_select at 0x7f3c75138d30>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:42.930630 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-8a2507fe-df06-4996-8d1d-b15132376ed7 tempest-HypervisorAdminNegativeTestJSON-451740698 tempest-HypervisorAdminNegativeTestJSON-451740698-project] Policy check for os_compute_api:os-hypervisors:list-detail failed with credentials {'is_admin': False, 'user_id': 'f1e5f459b034455796ad9ec830c9aede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e70f70d1a10419a8092fe68ece45519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:42.932673 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8a2507fe-df06-4996-8d1d-b15132376ed7 tempest-HypervisorAdminNegativeTestJSON-451740698 tempest-HypervisorAdminNegativeTestJSON-451740698-project] Request method failure captured: Oct 04 20:34:42.932673 n-d-854823-8 devstack@n-api.service[128801]: request: GET /compute/v2.1/os-hypervisors/detail HTTP/1.1 Oct 04 20:34:42.932673 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:34:42.932673 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:34:42.932673 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:34:42.932673 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 0 Oct 04 20:34:42.932673 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:34:42.932673 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:34:42.932673 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:34:42.932673 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:34:42.932673 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJjgqTbQoLBxdUxbCZMvxKE8C-WIbFbOLGmuq-n5mnjCaq1M_gkVc3vGmJvnBYU-ecxmX2Q_A4IPrNHn9dSUaY7eL9_dvdcIcbf5dINHfSpvlVAgvO_Tkq6nLn8k7cBqQp6KQmLZvPWiUvygoKsCXDQ2FZChSxFpLZqVIy4e7LDXZbs Oct 04 20:34:42.932673 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:34:42.932673 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:34:42.932673 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:34:42.932673 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:34:42.932673 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:34:42.932673 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:34:42.932673 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: 1e70f70d1a10419a8092fe68ece45519 Oct 04 20:34:42.932673 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-451740698 Oct 04 20:34:42.932673 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 20:34:42.932673 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 20:34:42.933837 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_1e70f70d1a10419a8092fe68ece45519", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1e70f70d1a10419a8092fe68ece45519"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1e70f70d1a10419a8092fe68ece45519"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/1e70f70d1a10419a8092fe68ece45519"}]}] Oct 04 20:34:42.933837 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-451740698 Oct 04 20:34:42.933837 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: 1e70f70d1a10419a8092fe68ece45519 Oct 04 20:34:42.933837 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-451740698 Oct 04 20:34:42.933837 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-HypervisorAdminNegativeTestJSON-451740698-project Oct 04 20:34:42.933837 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:34:42.933837 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:34:42.933837 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: f1e5f459b034455796ad9ec830c9aede Oct 04 20:34:42.933837 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-451740698-project Oct 04 20:34:42.933837 n-d-854823-8 devstack@n-api.service[128801]: method: Oct 04 20:34:42.933837 n-d-854823-8 devstack@n-api.service[128801]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Oct 04 20:34:42.933837 n-d-854823-8 devstack@n-api.service[128801]: action_args: {} Oct 04 20:34:42.933837 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:34:42.934592 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:34:42.934592 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:34:42.934592 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:34:42.934592 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:34:42.934592 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:34:42.934592 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:34:42.934592 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:34:42.934592 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:34:42.934592 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:34:42.934592 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 285, in detail Oct 04 20:34:42.934592 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self._detail(req) Oct 04 20:34:42.934592 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 289, in _detail Oct 04 20:34:42.934592 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list-detail', target={}) Oct 04 20:34:42.934592 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 20:34:42.934592 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 20:34:42.934592 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 20:34:42.934592 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 20:34:42.934592 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 20:34:42.934592 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 20:34:42.935636 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 20:34:42.935636 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 20:34:42.935636 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 20:34:42.935636 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 20:34:42.935636 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 20:34:42.935636 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 20:34:42.935636 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 20:34:42.935636 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 20:34:42.935636 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Oct 04 20:34:42.935636 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:34:42.935636 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:34:42.935636 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:34:42.935636 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:34:42.935636 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:34:42.935636 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:34:42.935636 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 20:34:42.935636 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 20:34:42.935636 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Oct 04 20:34:42.935636 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:34:42.940392 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8a2507fe-df06-4996-8d1d-b15132376ed7 tempest-HypervisorAdminNegativeTestJSON-451740698 tempest-HypervisorAdminNegativeTestJSON-451740698-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:34:42.942994 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-8a2507fe-df06-4996-8d1d-b15132376ed7 tempest-HypervisorAdminNegativeTestJSON-451740698 tempest-HypervisorAdminNegativeTestJSON-451740698-project] 10.222.0.33 "GET /compute/v2.1/os-hypervisors/detail" status: 403 len: 122 microversion: 2.1 time: 0.394679 Oct 04 20:34:42.945668 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 170/373] 10.222.0.33 () {58 vars in 1167 bytes} [Tue Oct 4 20:34:42 2022] GET /compute/v2.1/os-hypervisors/detail => generated 122 bytes in 398 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:34:42.960531 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f5e09511-d3a4-42f9-8daf-5ade0354892a tempest-HypervisorAdminNegativeTestJSON-451740698 tempest-HypervisorAdminNegativeTestJSON-451740698-project] Calling method '.version_select at 0x7f3c74f43700>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:42.962962 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f5e09511-d3a4-42f9-8daf-5ade0354892a tempest-HypervisorAdminNegativeTestJSON-451740698 tempest-HypervisorAdminNegativeTestJSON-451740698-project] Policy check for os_compute_api:os-hypervisors:list failed with credentials {'is_admin': False, 'user_id': 'f1e5f459b034455796ad9ec830c9aede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e70f70d1a10419a8092fe68ece45519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:42.964785 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f5e09511-d3a4-42f9-8daf-5ade0354892a tempest-HypervisorAdminNegativeTestJSON-451740698 tempest-HypervisorAdminNegativeTestJSON-451740698-project] Request method failure captured: Oct 04 20:34:42.964785 n-d-854823-8 devstack@n-api.service[128801]: request: GET /compute/v2.1/os-hypervisors HTTP/1.1 Oct 04 20:34:42.964785 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:34:42.964785 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:34:42.964785 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:34:42.964785 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 0 Oct 04 20:34:42.964785 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:34:42.964785 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:34:42.964785 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:34:42.964785 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:34:42.964785 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJjgqTbQoLBxdUxbCZMvxKE8C-WIbFbOLGmuq-n5mnjCaq1M_gkVc3vGmJvnBYU-ecxmX2Q_A4IPrNHn9dSUaY7eL9_dvdcIcbf5dINHfSpvlVAgvO_Tkq6nLn8k7cBqQp6KQmLZvPWiUvygoKsCXDQ2FZChSxFpLZqVIy4e7LDXZbs Oct 04 20:34:42.964785 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:34:42.964785 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:34:42.964785 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:34:42.964785 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:34:42.964785 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:34:42.964785 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:34:42.964785 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: 1e70f70d1a10419a8092fe68ece45519 Oct 04 20:34:42.964785 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-451740698 Oct 04 20:34:42.964785 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 20:34:42.964785 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 20:34:42.965987 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_1e70f70d1a10419a8092fe68ece45519", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1e70f70d1a10419a8092fe68ece45519"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1e70f70d1a10419a8092fe68ece45519"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/1e70f70d1a10419a8092fe68ece45519"}]}] Oct 04 20:34:42.965987 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-451740698 Oct 04 20:34:42.965987 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: 1e70f70d1a10419a8092fe68ece45519 Oct 04 20:34:42.965987 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-451740698 Oct 04 20:34:42.965987 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-HypervisorAdminNegativeTestJSON-451740698-project Oct 04 20:34:42.965987 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:34:42.965987 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:34:42.965987 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: f1e5f459b034455796ad9ec830c9aede Oct 04 20:34:42.965987 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-451740698-project Oct 04 20:34:42.965987 n-d-854823-8 devstack@n-api.service[128801]: method: Oct 04 20:34:42.965987 n-d-854823-8 devstack@n-api.service[128801]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Oct 04 20:34:42.965987 n-d-854823-8 devstack@n-api.service[128801]: action_args: {} Oct 04 20:34:42.965987 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:34:42.967011 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:34:42.967011 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:34:42.967011 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:34:42.967011 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:34:42.967011 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:34:42.967011 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:34:42.967011 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:34:42.967011 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:34:42.967011 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:34:42.967011 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 253, in index Oct 04 20:34:42.967011 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self._index(req) Oct 04 20:34:42.967011 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 257, in _index Oct 04 20:34:42.967011 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list', target={}) Oct 04 20:34:42.967011 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 20:34:42.967011 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 20:34:42.967011 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 20:34:42.967011 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 20:34:42.967011 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 20:34:42.967011 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 20:34:42.967998 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 20:34:42.967998 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 20:34:42.967998 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 20:34:42.967998 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 20:34:42.967998 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 20:34:42.967998 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 20:34:42.967998 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 20:34:42.967998 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 20:34:42.967998 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Oct 04 20:34:42.967998 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:34:42.967998 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:34:42.967998 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:34:42.967998 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:34:42.967998 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:34:42.967998 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:34:42.967998 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 20:34:42.967998 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 20:34:42.967998 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Oct 04 20:34:42.967998 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:34:42.969001 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f5e09511-d3a4-42f9-8daf-5ade0354892a tempest-HypervisorAdminNegativeTestJSON-451740698 tempest-HypervisorAdminNegativeTestJSON-451740698-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:34:42.974522 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f5e09511-d3a4-42f9-8daf-5ade0354892a tempest-HypervisorAdminNegativeTestJSON-451740698 tempest-HypervisorAdminNegativeTestJSON-451740698-project] 10.222.0.33 "GET /compute/v2.1/os-hypervisors" status: 403 len: 115 microversion: 2.1 time: 0.021660 Oct 04 20:34:42.975079 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 171/374] 10.222.0.33 () {58 vars in 1146 bytes} [Tue Oct 4 20:34:42 2022] GET /compute/v2.1/os-hypervisors => generated 115 bytes in 23 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:34:42.995896 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-15bb3597-354d-4ec7-a56c-e68ecfa561b4 tempest-HypervisorAdminNegativeTestJSON-451740698 tempest-HypervisorAdminNegativeTestJSON-451740698-project] Calling method '.version_select at 0x7f3c74f439d0>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:42.997662 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-15bb3597-354d-4ec7-a56c-e68ecfa561b4 tempest-HypervisorAdminNegativeTestJSON-451740698 tempest-HypervisorAdminNegativeTestJSON-451740698-project] Policy check for os_compute_api:os-hypervisors:statistics failed with credentials {'is_admin': False, 'user_id': 'f1e5f459b034455796ad9ec830c9aede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e70f70d1a10419a8092fe68ece45519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:42.999223 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-15bb3597-354d-4ec7-a56c-e68ecfa561b4 tempest-HypervisorAdminNegativeTestJSON-451740698 tempest-HypervisorAdminNegativeTestJSON-451740698-project] Request method failure captured: Oct 04 20:34:42.999223 n-d-854823-8 devstack@n-api.service[128801]: request: GET /compute/v2.1/os-hypervisors/statistics HTTP/1.1 Oct 04 20:34:42.999223 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:34:42.999223 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:34:42.999223 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:34:42.999223 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 0 Oct 04 20:34:42.999223 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:34:42.999223 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:34:42.999223 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:34:42.999223 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:34:42.999223 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJjgqTbQoLBxdUxbCZMvxKE8C-WIbFbOLGmuq-n5mnjCaq1M_gkVc3vGmJvnBYU-ecxmX2Q_A4IPrNHn9dSUaY7eL9_dvdcIcbf5dINHfSpvlVAgvO_Tkq6nLn8k7cBqQp6KQmLZvPWiUvygoKsCXDQ2FZChSxFpLZqVIy4e7LDXZbs Oct 04 20:34:42.999223 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:34:42.999223 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:34:42.999223 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:34:42.999223 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:34:42.999223 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:34:42.999223 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:34:42.999223 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: 1e70f70d1a10419a8092fe68ece45519 Oct 04 20:34:42.999223 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-451740698 Oct 04 20:34:42.999223 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 20:34:42.999223 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 20:34:43.000400 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_1e70f70d1a10419a8092fe68ece45519", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1e70f70d1a10419a8092fe68ece45519"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1e70f70d1a10419a8092fe68ece45519"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/1e70f70d1a10419a8092fe68ece45519"}]}] Oct 04 20:34:43.000400 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-451740698 Oct 04 20:34:43.000400 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: 1e70f70d1a10419a8092fe68ece45519 Oct 04 20:34:43.000400 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-451740698 Oct 04 20:34:43.000400 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-HypervisorAdminNegativeTestJSON-451740698-project Oct 04 20:34:43.000400 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:34:43.000400 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:34:43.000400 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: f1e5f459b034455796ad9ec830c9aede Oct 04 20:34:43.000400 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-451740698-project Oct 04 20:34:43.000400 n-d-854823-8 devstack@n-api.service[128801]: method: Oct 04 20:34:43.000400 n-d-854823-8 devstack@n-api.service[128801]: exception: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Oct 04 20:34:43.000400 n-d-854823-8 devstack@n-api.service[128801]: action_args: {} Oct 04 20:34:43.000400 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:34:43.001109 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:34:43.001109 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:34:43.001109 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:34:43.001109 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:34:43.001109 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:34:43.001109 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:34:43.001109 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:34:43.001109 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:34:43.001109 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:34:43.001109 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 521, in statistics Oct 04 20:34:43.001109 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'statistics', target={}) Oct 04 20:34:43.001109 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 20:34:43.001109 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 20:34:43.001109 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 20:34:43.001109 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 20:34:43.001109 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 20:34:43.001109 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 20:34:43.001109 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 20:34:43.001109 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 20:34:43.002843 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 20:34:43.002843 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 20:34:43.002843 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 20:34:43.002843 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 20:34:43.002843 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 20:34:43.002843 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 20:34:43.002843 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Oct 04 20:34:43.002843 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:34:43.002843 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:34:43.002843 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:34:43.002843 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:34:43.002843 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:34:43.002843 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:34:43.002843 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 20:34:43.002843 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 20:34:43.002843 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Oct 04 20:34:43.002843 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:34:43.005490 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-15bb3597-354d-4ec7-a56c-e68ecfa561b4 tempest-HypervisorAdminNegativeTestJSON-451740698 tempest-HypervisorAdminNegativeTestJSON-451740698-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:34:43.005490 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-15bb3597-354d-4ec7-a56c-e68ecfa561b4 tempest-HypervisorAdminNegativeTestJSON-451740698 tempest-HypervisorAdminNegativeTestJSON-451740698-project] 10.222.0.33 "GET /compute/v2.1/os-hypervisors/statistics" status: 403 len: 121 microversion: 2.1 time: 0.008422 Oct 04 20:34:43.005490 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 172/375] 10.222.0.33 () {58 vars in 1179 bytes} [Tue Oct 4 20:34:42 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 121 bytes in 10 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:34:43.164517 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2b26b27c-2b3c-482c-8b18-e84496871cd1 tempest-HypervisorAdminNegativeTestJSON-868153439 tempest-HypervisorAdminNegativeTestJSON-868153439-project-admin] Calling method '.version_select at 0x7f3c74efa700>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:43.167049 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2b26b27c-2b3c-482c-8b18-e84496871cd1 tempest-HypervisorAdminNegativeTestJSON-868153439 tempest-HypervisorAdminNegativeTestJSON-868153439-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:43.167744 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2b26b27c-2b3c-482c-8b18-e84496871cd1 tempest-HypervisorAdminNegativeTestJSON-868153439 tempest-HypervisorAdminNegativeTestJSON-868153439-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:43.168376 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2b26b27c-2b3c-482c-8b18-e84496871cd1 tempest-HypervisorAdminNegativeTestJSON-868153439 tempest-HypervisorAdminNegativeTestJSON-868153439-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:43.189005 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2b26b27c-2b3c-482c-8b18-e84496871cd1 tempest-HypervisorAdminNegativeTestJSON-868153439 tempest-HypervisorAdminNegativeTestJSON-868153439-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:43.189792 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2b26b27c-2b3c-482c-8b18-e84496871cd1 tempest-HypervisorAdminNegativeTestJSON-868153439 tempest-HypervisorAdminNegativeTestJSON-868153439-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:43.190476 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2b26b27c-2b3c-482c-8b18-e84496871cd1 tempest-HypervisorAdminNegativeTestJSON-868153439 tempest-HypervisorAdminNegativeTestJSON-868153439-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:43.202222 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2b26b27c-2b3c-482c-8b18-e84496871cd1 tempest-HypervisorAdminNegativeTestJSON-868153439 tempest-HypervisorAdminNegativeTestJSON-868153439-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:43.203126 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2b26b27c-2b3c-482c-8b18-e84496871cd1 tempest-HypervisorAdminNegativeTestJSON-868153439 tempest-HypervisorAdminNegativeTestJSON-868153439-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:43.203762 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2b26b27c-2b3c-482c-8b18-e84496871cd1 tempest-HypervisorAdminNegativeTestJSON-868153439 tempest-HypervisorAdminNegativeTestJSON-868153439-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:43.210068 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-2b26b27c-2b3c-482c-8b18-e84496871cd1 tempest-HypervisorAdminNegativeTestJSON-868153439 tempest-HypervisorAdminNegativeTestJSON-868153439-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.203304 Oct 04 20:34:43.211469 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 173/376] 10.222.0.33 () {58 vars in 1146 bytes} [Tue Oct 4 20:34:43 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:34:43.319293 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-fa355b82-1adb-49ec-9fd4-304e8b6a6db4 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3563efe2b8c94931a2a46c4e14811b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3118a5d96843d3bede1ed94bd9717e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:43.332180 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-fa355b82-1adb-49ec-9fd4-304e8b6a6db4 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] 10.222.0.33 "GET /compute/v2.1/servers/9e9f6289-9999-4188-9af1-6cf64a676eee" status: 200 len: 1477 microversion: 2.1 time: 0.493733 Oct 04 20:34:43.346369 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 204/377] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:42 2022] GET /compute/v2.1/servers/9e9f6289-9999-4188-9af1-6cf64a676eee => generated 1477 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:43.346369 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-c34db338-2f4e-4171-b48b-df9eb1b3dd1e tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:43.346369 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-c34db338-2f4e-4171-b48b-df9eb1b3dd1e tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] [instance: b8cf32e5-d9cc-4e92-bd81-2c3449406c95] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:43.353835 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c34db338-2f4e-4171-b48b-df9eb1b3dd1e tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:43.360390 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c34db338-2f4e-4171-b48b-df9eb1b3dd1e tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:43.360978 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c34db338-2f4e-4171-b48b-df9eb1b3dd1e tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:43.362232 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c34db338-2f4e-4171-b48b-df9eb1b3dd1e tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:43.362802 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c34db338-2f4e-4171-b48b-df9eb1b3dd1e tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:43.363286 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c34db338-2f4e-4171-b48b-df9eb1b3dd1e tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:43.551649 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5590b018-b0c2-4e13-af1c-41f84bda4661 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-1660260764", "imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63", "flavorRef": "452"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:34:43.634553 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.network.neutron [None req-5590b018-b0c2-4e13-af1c-41f84bda4661 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] validate_networks() for None {{(pid=128801) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:34:44.086080 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-c34db338-2f4e-4171-b48b-df9eb1b3dd1e tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cbd31af13444cda97ba5f8c99d19437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a307499cf44d03a1e9bb61f614f099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:44.097588 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-c34db338-2f4e-4171-b48b-df9eb1b3dd1e tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] 10.222.0.33 "GET /compute/v2.1/servers/b8cf32e5-d9cc-4e92-bd81-2c3449406c95" status: 200 len: 1319 microversion: 2.1 time: 0.761059 Oct 04 20:34:44.098762 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 205/378] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:43 2022] GET /compute/v2.1/servers/b8cf32e5-d9cc-4e92-bd81-2c3449406c95 => generated 1319 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:44.105284 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-592abd21-76ef-41c3-a37c-05f3dadaeefb tempest-HypervisorAdminNegativeTestJSON-451740698 tempest-HypervisorAdminNegativeTestJSON-451740698-project] Calling method '.version_select at 0x7f3c74f4cca0>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:44.107582 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-592abd21-76ef-41c3-a37c-05f3dadaeefb tempest-HypervisorAdminNegativeTestJSON-451740698 tempest-HypervisorAdminNegativeTestJSON-451740698-project] Policy check for os_compute_api:os-hypervisors:uptime failed with credentials {'is_admin': False, 'user_id': 'f1e5f459b034455796ad9ec830c9aede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e70f70d1a10419a8092fe68ece45519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:44.109439 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-592abd21-76ef-41c3-a37c-05f3dadaeefb tempest-HypervisorAdminNegativeTestJSON-451740698 tempest-HypervisorAdminNegativeTestJSON-451740698-project] Request method failure captured: Oct 04 20:34:44.109439 n-d-854823-8 devstack@n-api.service[128802]: request: GET /compute/v2.1/os-hypervisors/1/uptime HTTP/1.1 Oct 04 20:34:44.109439 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 20:34:44.109439 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 20:34:44.109439 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 20:34:44.109439 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 0 Oct 04 20:34:44.109439 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 20:34:44.109439 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 20:34:44.109439 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 20:34:44.109439 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 20:34:44.109439 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPJjgqTbQoLBxdUxbCZMvxKE8C-WIbFbOLGmuq-n5mnjCaq1M_gkVc3vGmJvnBYU-ecxmX2Q_A4IPrNHn9dSUaY7eL9_dvdcIcbf5dINHfSpvlVAgvO_Tkq6nLn8k7cBqQp6KQmLZvPWiUvygoKsCXDQ2FZChSxFpLZqVIy4e7LDXZbs Oct 04 20:34:44.109439 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 20:34:44.109439 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 20:34:44.109439 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 20:34:44.109439 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 20:34:44.109439 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 20:34:44.109439 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 20:34:44.109439 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: 1e70f70d1a10419a8092fe68ece45519 Oct 04 20:34:44.109439 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-451740698 Oct 04 20:34:44.109439 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 20:34:44.109439 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 20:34:44.110668 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_1e70f70d1a10419a8092fe68ece45519", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1e70f70d1a10419a8092fe68ece45519"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1e70f70d1a10419a8092fe68ece45519"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/1e70f70d1a10419a8092fe68ece45519"}]}] Oct 04 20:34:44.110668 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-451740698 Oct 04 20:34:44.110668 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: 1e70f70d1a10419a8092fe68ece45519 Oct 04 20:34:44.110668 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-451740698 Oct 04 20:34:44.110668 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-HypervisorAdminNegativeTestJSON-451740698-project Oct 04 20:34:44.110668 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 20:34:44.110668 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 20:34:44.110668 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: f1e5f459b034455796ad9ec830c9aede Oct 04 20:34:44.110668 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-451740698-project Oct 04 20:34:44.110668 n-d-854823-8 devstack@n-api.service[128802]: method: Oct 04 20:34:44.110668 n-d-854823-8 devstack@n-api.service[128802]: exception: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Oct 04 20:34:44.110668 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'id': '1'} Oct 04 20:34:44.110668 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:34:44.111402 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:34:44.111402 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:34:44.111402 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:34:44.111402 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:34:44.111402 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:34:44.111402 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:34:44.111402 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:34:44.111402 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:34:44.111402 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:34:44.111402 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 387, in uptime Oct 04 20:34:44.111402 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'uptime', target={}) Oct 04 20:34:44.111402 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 20:34:44.111402 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 20:34:44.111402 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 20:34:44.111402 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 20:34:44.111402 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 20:34:44.111402 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 20:34:44.111402 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 20:34:44.111402 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 20:34:44.112583 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 20:34:44.112583 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 20:34:44.112583 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 20:34:44.112583 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 20:34:44.112583 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 20:34:44.112583 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 20:34:44.112583 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Oct 04 20:34:44.112583 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:34:44.112583 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:34:44.112583 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:34:44.112583 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:34:44.112583 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:34:44.112583 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:34:44.112583 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 20:34:44.112583 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 20:34:44.112583 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Oct 04 20:34:44.112583 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:34:44.113713 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-592abd21-76ef-41c3-a37c-05f3dadaeefb tempest-HypervisorAdminNegativeTestJSON-451740698 tempest-HypervisorAdminNegativeTestJSON-451740698-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:34:44.113713 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-592abd21-76ef-41c3-a37c-05f3dadaeefb tempest-HypervisorAdminNegativeTestJSON-451740698 tempest-HypervisorAdminNegativeTestJSON-451740698-project] 10.222.0.33 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 403 len: 117 microversion: 2.1 time: 0.011254 Oct 04 20:34:44.113713 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 206/379] 10.222.0.33 () {58 vars in 1173 bytes} [Tue Oct 4 20:34:44 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 117 bytes in 12 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:34:44.124396 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-d5e49d37-7f25-4a26-9ee3-b9d26cb94378 tempest-ServersAdminNegativeTestJSON-129976034 tempest-ServersAdminNegativeTestJSON-129976034-project-admin] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:44.125000 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-d5e49d37-7f25-4a26-9ee3-b9d26cb94378 tempest-ServersAdminNegativeTestJSON-129976034 tempest-ServersAdminNegativeTestJSON-129976034-project-admin] [instance: 63e16106-fc95-4fa8-bf7c-e70ff878a5ae] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:44.136801 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d5e49d37-7f25-4a26-9ee3-b9d26cb94378 tempest-ServersAdminNegativeTestJSON-129976034 tempest-ServersAdminNegativeTestJSON-129976034-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:44.137298 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d5e49d37-7f25-4a26-9ee3-b9d26cb94378 tempest-ServersAdminNegativeTestJSON-129976034 tempest-ServersAdminNegativeTestJSON-129976034-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:44.137730 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d5e49d37-7f25-4a26-9ee3-b9d26cb94378 tempest-ServersAdminNegativeTestJSON-129976034 tempest-ServersAdminNegativeTestJSON-129976034-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:44.138461 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d5e49d37-7f25-4a26-9ee3-b9d26cb94378 tempest-ServersAdminNegativeTestJSON-129976034 tempest-ServersAdminNegativeTestJSON-129976034-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:44.139088 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d5e49d37-7f25-4a26-9ee3-b9d26cb94378 tempest-ServersAdminNegativeTestJSON-129976034 tempest-ServersAdminNegativeTestJSON-129976034-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:44.139856 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d5e49d37-7f25-4a26-9ee3-b9d26cb94378 tempest-ServersAdminNegativeTestJSON-129976034 tempest-ServersAdminNegativeTestJSON-129976034-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:44.504557 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-5590b018-b0c2-4e13-af1c-41f84bda4661 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Flavor limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:34:44.507574 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=100 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:34:44.507978 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-5590b018-b0c2-4e13-af1c-41f84bda4661 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Image limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:34:44.508591 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-5590b018-b0c2-4e13-af1c-41f84bda4661 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Flavor pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:34:44.509006 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-5590b018-b0c2-4e13-af1c-41f84bda4661 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Image pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:34:44.510020 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-5590b018-b0c2-4e13-af1c-41f84bda4661 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:34:44.512803 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-d5e49d37-7f25-4a26-9ee3-b9d26cb94378 tempest-ServersAdminNegativeTestJSON-129976034 tempest-ServersAdminNegativeTestJSON-129976034-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/63e16106-fc95-4fa8-bf7c-e70ff878a5ae" status: 200 len: 1612 microversion: 2.1 time: 0.394836 Oct 04 20:34:44.529971 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 207/380] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:44 2022] GET /compute/v2.1/servers/63e16106-fc95-4fa8-bf7c-e70ff878a5ae => generated 1612 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:44.529971 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-8ebe6732-af89-4d21-8a28-4a9d695c0901 tempest-HypervisorAdminNegativeTestJSON-868153439 tempest-HypervisorAdminNegativeTestJSON-868153439-project-admin] Calling method '.version_select at 0x7f3c74f4c0d0>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:44.529971 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.wsgi [None req-8ebe6732-af89-4d21-8a28-4a9d695c0901 tempest-HypervisorAdminNegativeTestJSON-868153439 tempest-HypervisorAdminNegativeTestJSON-868153439-project-admin] HTTP exception thrown: Hypervisor with ID '92f70dd2-66e2-4c61-923f-ad006a36a32d' could not be found. Oct 04 20:34:44.533007 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=10 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:34:44.536175 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5590b018-b0c2-4e13-af1c-41f84bda4661 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:44.537233 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5590b018-b0c2-4e13-af1c-41f84bda4661 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:44.537820 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5590b018-b0c2-4e13-af1c-41f84bda4661 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:44.539101 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5590b018-b0c2-4e13-af1c-41f84bda4661 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:44.540256 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5590b018-b0c2-4e13-af1c-41f84bda4661 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:44.541067 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5590b018-b0c2-4e13-af1c-41f84bda4661 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:44.541628 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-8ebe6732-af89-4d21-8a28-4a9d695c0901 tempest-HypervisorAdminNegativeTestJSON-868153439 tempest-HypervisorAdminNegativeTestJSON-868153439-project-admin] Request method failure captured: Oct 04 20:34:44.541628 n-d-854823-8 devstack@n-api.service[128802]: request: GET /compute/v2.1/os-hypervisors/92f70dd2-66e2-4c61-923f-ad006a36a32d/uptime HTTP/1.1 Oct 04 20:34:44.541628 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 20:34:44.541628 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 20:34:44.541628 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 20:34:44.541628 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 0 Oct 04 20:34:44.541628 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 20:34:44.541628 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 20:34:44.541628 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 20:34:44.541628 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 20:34:44.541628 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPJji5gNBRiFY8DDtMEK9NffEMAPnm2i9q71i7YX5ApC-AHS8_C-BlOSEOHWJ5Tib5ivsl2JAqmcrRArOxrMy_QufYRZpF7tranzRczw_5uZE9TXz_AvR3_3kMbCPXbnyyKVtRKOm7mnmMFim2pdG4MBGgWlMhrQZ9L6XyPv36IEwwso Oct 04 20:34:44.541628 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 20:34:44.541628 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 20:34:44.541628 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 20:34:44.541628 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 20:34:44.541628 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 20:34:44.541628 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 20:34:44.541628 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: ce3ee736bb08446ca8fced221c3620a3 Oct 04 20:34:44.541628 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-868153439 Oct 04 20:34:44.541628 n-d-854823-8 devstack@n-api.service[128802]: X-Role: admin,reader,member Oct 04 20:34:44.541628 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: admin,reader,member Oct 04 20:34:44.543086 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ce3ee736bb08446ca8fced221c3620a3", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ce3ee736bb08446ca8fced221c3620a3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ce3ee736bb08446ca8fced221c3620a3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ce3ee736bb08446ca8fced221c3620a3"}]}] Oct 04 20:34:44.543086 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-868153439 Oct 04 20:34:44.543086 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: ce3ee736bb08446ca8fced221c3620a3 Oct 04 20:34:44.543086 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-868153439 Oct 04 20:34:44.543086 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-HypervisorAdminNegativeTestJSON-868153439-project-admin Oct 04 20:34:44.543086 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 20:34:44.543086 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 20:34:44.543086 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: dc24fd933daa43ef96c736a0969dd718 Oct 04 20:34:44.543086 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-868153439-project-admin Oct 04 20:34:44.543086 n-d-854823-8 devstack@n-api.service[128802]: method: Oct 04 20:34:44.543086 n-d-854823-8 devstack@n-api.service[128802]: exception: Hypervisor with ID '92f70dd2-66e2-4c61-923f-ad006a36a32d' could not be found. Oct 04 20:34:44.543086 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'id': '92f70dd2-66e2-4c61-923f-ad006a36a32d'} Oct 04 20:34:44.543908 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:34:44.543908 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:34:44.543908 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Oct 04 20:34:44.543908 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi value = int(str(value)) Oct 04 20:34:44.543908 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '92f70dd2-66e2-4c61-923f-ad006a36a32d' Oct 04 20:34:44.543908 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:34:44.543908 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:34:44.543908 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:34:44.543908 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:34:44.543908 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Oct 04 20:34:44.543908 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Oct 04 20:34:44.543908 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Oct 04 20:34:44.543908 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Oct 04 20:34:44.543908 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Oct 04 20:34:44.543908 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:34:44.543908 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:34:44.543908 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:34:44.543908 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:34:44.543908 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Oct 04 20:34:44.543908 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Oct 04 20:34:44.543908 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Oct 04 20:34:44.543908 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Oct 04 20:34:44.545321 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Oct 04 20:34:44.545321 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:34:44.545321 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:34:44.545321 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:34:44.545321 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:34:44.545321 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:34:44.545321 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:34:44.545321 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:34:44.545321 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:34:44.545321 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:34:44.545321 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:34:44.545321 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:34:44.545321 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:34:44.545321 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 389, in uptime Oct 04 20:34:44.545321 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Oct 04 20:34:44.545321 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Oct 04 20:34:44.545321 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 04 20:34:44.545321 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '92f70dd2-66e2-4c61-923f-ad006a36a32d' could not be found. Oct 04 20:34:44.545321 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:34:44.545321 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:34:44.545321 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:34:44.546704 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:34:44.546704 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:34:44.546704 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:34:44.546704 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:34:44.546704 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:34:44.546704 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '92f70dd2-66e2-4c61-923f-ad006a36a32d' could not be found. Oct 04 20:34:44.546704 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:34:44.546704 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-8ebe6732-af89-4d21-8a28-4a9d695c0901 tempest-HypervisorAdminNegativeTestJSON-868153439 tempest-HypervisorAdminNegativeTestJSON-868153439-project-admin] Returning 404 to user: Hypervisor with ID '92f70dd2-66e2-4c61-923f-ad006a36a32d' could not be found. {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:34:44.546704 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-8ebe6732-af89-4d21-8a28-4a9d695c0901 tempest-HypervisorAdminNegativeTestJSON-868153439 tempest-HypervisorAdminNegativeTestJSON-868153439-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors/92f70dd2-66e2-4c61-923f-ad006a36a32d/uptime" status: 404 len: 123 microversion: 2.1 time: 0.024460 Oct 04 20:34:44.546704 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 208/381] 10.222.0.33 () {58 vars in 1278 bytes} [Tue Oct 4 20:34:44 2022] GET /compute/v2.1/os-hypervisors/92f70dd2-66e2-4c61-923f-ad006a36a32d/uptime => generated 123 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:34:44.554243 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-6bb38f1f-93f6-47ab-afca-88ec024238f6 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:44.554893 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-6bb38f1f-93f6-47ab-afca-88ec024238f6 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] [instance: 9e9f6289-9999-4188-9af1-6cf64a676eee] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:44.566388 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6bb38f1f-93f6-47ab-afca-88ec024238f6 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:44.566802 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6bb38f1f-93f6-47ab-afca-88ec024238f6 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:44.567240 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6bb38f1f-93f6-47ab-afca-88ec024238f6 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:44.568076 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6bb38f1f-93f6-47ab-afca-88ec024238f6 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:44.568489 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6bb38f1f-93f6-47ab-afca-88ec024238f6 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:44.569215 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6bb38f1f-93f6-47ab-afca-88ec024238f6 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:44.575511 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-5590b018-b0c2-4e13-af1c-41f84bda4661 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Getting quotas for project 18f0707d756b4ee085a19cccf3ab82c0. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:34:44.582094 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-5590b018-b0c2-4e13-af1c-41f84bda4661 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Getting quotas for user f051a291d59242469f8172a9c474ac89 and project 18f0707d756b4ee085a19cccf3ab82c0. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:34:44.597879 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-5590b018-b0c2-4e13-af1c-41f84bda4661 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Going to run 1 instances... {{(pid=128801) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:34:44.600637 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-5590b018-b0c2-4e13-af1c-41f84bda4661 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] [instance: 3961b3f4-aea9-4997-85aa-336b3f902533] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='15b24725-0c99-4bcf-b1fb-907cdf8e2d63',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128801) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:34:44.654847 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5590b018-b0c2-4e13-af1c-41f84bda4661 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.442001 Oct 04 20:34:44.656126 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 174/382] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 20:34:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 1444 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 20:34:44.660782 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d0bc6743-2311-4b1a-9c6b-dfa2eb1be6b1 tempest-ServersAdminNegativeTestJSON-129976034 tempest-ServersAdminNegativeTestJSON-129976034-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:34:44.661359 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d0bc6743-2311-4b1a-9c6b-dfa2eb1be6b1 tempest-ServersAdminNegativeTestJSON-129976034 tempest-ServersAdminNegativeTestJSON-129976034-project-admin] [instance: 63e16106-fc95-4fa8-bf7c-e70ff878a5ae] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:44.668842 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d0bc6743-2311-4b1a-9c6b-dfa2eb1be6b1 tempest-ServersAdminNegativeTestJSON-129976034 tempest-ServersAdminNegativeTestJSON-129976034-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:44.669255 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d0bc6743-2311-4b1a-9c6b-dfa2eb1be6b1 tempest-ServersAdminNegativeTestJSON-129976034 tempest-ServersAdminNegativeTestJSON-129976034-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:44.669689 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d0bc6743-2311-4b1a-9c6b-dfa2eb1be6b1 tempest-ServersAdminNegativeTestJSON-129976034 tempest-ServersAdminNegativeTestJSON-129976034-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:44.670408 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d0bc6743-2311-4b1a-9c6b-dfa2eb1be6b1 tempest-ServersAdminNegativeTestJSON-129976034 tempest-ServersAdminNegativeTestJSON-129976034-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:44.671080 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d0bc6743-2311-4b1a-9c6b-dfa2eb1be6b1 tempest-ServersAdminNegativeTestJSON-129976034 tempest-ServersAdminNegativeTestJSON-129976034-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:44.672557 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d0bc6743-2311-4b1a-9c6b-dfa2eb1be6b1 tempest-ServersAdminNegativeTestJSON-129976034 tempest-ServersAdminNegativeTestJSON-129976034-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:44.815968 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-d0bc6743-2311-4b1a-9c6b-dfa2eb1be6b1 tempest-ServersAdminNegativeTestJSON-129976034 tempest-ServersAdminNegativeTestJSON-129976034-project-admin] HTTP exception thrown: Cannot 'migrate' instance 63e16106-fc95-4fa8-bf7c-e70ff878a5ae while it is in vm_state suspended Oct 04 20:34:44.825436 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d0bc6743-2311-4b1a-9c6b-dfa2eb1be6b1 tempest-ServersAdminNegativeTestJSON-129976034 tempest-ServersAdminNegativeTestJSON-129976034-project-admin] Request method failure captured: Oct 04 20:34:44.825436 n-d-854823-8 devstack@n-api.service[128801]: request: POST /compute/v2.1/servers/63e16106-fc95-4fa8-bf7c-e70ff878a5ae/action HTTP/1.1 Oct 04 20:34:44.825436 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:34:44.825436 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:34:44.825436 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:34:44.825436 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 15 Oct 04 20:34:44.825436 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:34:44.825436 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:34:44.825436 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:34:44.825436 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:34:44.825436 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJi90Cg5yc5SzRNIp7yXOltFlDkxRR_GNs4yqNCbELjV3iDGXYvk5AjD9rmeMVv09r8eOB_pjqbF1KTpLwCPg7Jhd8OW4fF12sT3DO51HCMgAWmPxUaHTwl52SMcROL4Soq4KAgzWokn8vfrxsnAZkFp05oPv85kRzgSv_X-PFrVJ5k Oct 04 20:34:44.825436 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:34:44.825436 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:34:44.825436 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:34:44.825436 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:34:44.825436 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:34:44.825436 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:34:44.825436 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: cb3cd184a54f4e29a216eb156027c8ff Oct 04 20:34:44.825436 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-129976034 Oct 04 20:34:44.825436 n-d-854823-8 devstack@n-api.service[128801]: X-Role: admin,reader,member Oct 04 20:34:44.825436 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: admin,reader,member Oct 04 20:34:44.826980 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_cb3cd184a54f4e29a216eb156027c8ff", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cb3cd184a54f4e29a216eb156027c8ff"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cb3cd184a54f4e29a216eb156027c8ff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/cb3cd184a54f4e29a216eb156027c8ff"}]}] Oct 04 20:34:44.826980 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-ServersAdminNegativeTestJSON-129976034 Oct 04 20:34:44.826980 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: cb3cd184a54f4e29a216eb156027c8ff Oct 04 20:34:44.826980 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-129976034 Oct 04 20:34:44.826980 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-ServersAdminNegativeTestJSON-129976034-project-admin Oct 04 20:34:44.826980 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:34:44.826980 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:34:44.826980 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: d1e3450803564757bad42c40de9fe6af Oct 04 20:34:44.826980 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-ServersAdminNegativeTestJSON-129976034-project-admin Oct 04 20:34:44.826980 n-d-854823-8 devstack@n-api.service[128801]: Oct 04 20:34:44.826980 n-d-854823-8 devstack@n-api.service[128801]: {"migrate": {}} Oct 04 20:34:44.826980 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 20:34:44.826980 n-d-854823-8 devstack@n-api.service[128801]: exception: Cannot 'migrate' instance 63e16106-fc95-4fa8-bf7c-e70ff878a5ae while it is in vm_state suspended Oct 04 20:34:44.827772 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': '63e16106-fc95-4fa8-bf7c-e70ff878a5ae', 'body': {'migrate': {}}} Oct 04 20:34:44.827772 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:34:44.827772 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:34:44.827772 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 58, in _migrate Oct 04 20:34:44.827772 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self.compute_api.resize(req.environ['nova.context'], instance, Oct 04 20:34:44.827772 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 04 20:34:44.827772 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 20:34:44.827772 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 04 20:34:44.827772 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 04 20:34:44.827772 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 04 20:34:44.827772 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 04 20:34:44.827772 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 20:34:44.827772 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 20:34:44.827772 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 04 20:34:44.827772 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 04 20:34:44.827772 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 63e16106-fc95-4fa8-bf7c-e70ff878a5ae in vm_state suspended. Cannot resize while the instance is in this state. Oct 04 20:34:44.827772 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:34:44.827772 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:34:44.827772 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:34:44.827772 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:34:44.828812 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:34:44.828812 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:34:44.828812 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:34:44.828812 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:34:44.828812 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:34:44.828812 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:34:44.828812 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:34:44.828812 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:34:44.828812 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 69, in _migrate Oct 04 20:34:44.828812 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 04 20:34:44.828812 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 04 20:34:44.828812 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 04 20:34:44.828812 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'migrate' instance 63e16106-fc95-4fa8-bf7c-e70ff878a5ae while it is in vm_state suspended Oct 04 20:34:44.828812 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:34:44.828812 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:34:44.828812 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:34:44.828812 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:34:44.828812 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:34:44.828812 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:34:44.831280 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:34:44.831280 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:34:44.831280 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'migrate' instance 63e16106-fc95-4fa8-bf7c-e70ff878a5ae while it is in vm_state suspended Oct 04 20:34:44.831280 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:34:44.831280 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d0bc6743-2311-4b1a-9c6b-dfa2eb1be6b1 tempest-ServersAdminNegativeTestJSON-129976034 tempest-ServersAdminNegativeTestJSON-129976034-project-admin] Returning 409 to user: Cannot 'migrate' instance 63e16106-fc95-4fa8-bf7c-e70ff878a5ae while it is in vm_state suspended {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:34:44.831280 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d0bc6743-2311-4b1a-9c6b-dfa2eb1be6b1 tempest-ServersAdminNegativeTestJSON-129976034 tempest-ServersAdminNegativeTestJSON-129976034-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/63e16106-fc95-4fa8-bf7c-e70ff878a5ae/action" status: 409 len: 148 microversion: 2.1 time: 0.173522 Oct 04 20:34:44.831280 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 175/383] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 20:34:44 2022] POST /compute/v2.1/servers/63e16106-fc95-4fa8-bf7c-e70ff878a5ae/action => generated 148 bytes in 175 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 04 20:34:44.844032 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-adbb7b24-3860-4f60-bb13-4890aca6f6b5 tempest-HypervisorAdminNegativeTestJSON-868153439 tempest-HypervisorAdminNegativeTestJSON-868153439-project-admin] Calling method '.version_select at 0x7f3c74f43160>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:44.845816 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-adbb7b24-3860-4f60-bb13-4890aca6f6b5 tempest-HypervisorAdminNegativeTestJSON-868153439 tempest-HypervisorAdminNegativeTestJSON-868153439-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:44.846307 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-adbb7b24-3860-4f60-bb13-4890aca6f6b5 tempest-HypervisorAdminNegativeTestJSON-868153439 tempest-HypervisorAdminNegativeTestJSON-868153439-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:44.846972 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-adbb7b24-3860-4f60-bb13-4890aca6f6b5 tempest-HypervisorAdminNegativeTestJSON-868153439 tempest-HypervisorAdminNegativeTestJSON-868153439-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:44.870576 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-6bb38f1f-93f6-47ab-afca-88ec024238f6 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3563efe2b8c94931a2a46c4e14811b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3118a5d96843d3bede1ed94bd9717e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:44.885084 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-6bb38f1f-93f6-47ab-afca-88ec024238f6 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] 10.222.0.33 "GET /compute/v2.1/servers/9e9f6289-9999-4188-9af1-6cf64a676eee" status: 200 len: 1477 microversion: 2.1 time: 0.337267 Oct 04 20:34:44.887705 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 209/384] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:44 2022] GET /compute/v2.1/servers/9e9f6289-9999-4188-9af1-6cf64a676eee => generated 1477 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:44.903458 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-adbb7b24-3860-4f60-bb13-4890aca6f6b5 tempest-HypervisorAdminNegativeTestJSON-868153439 tempest-HypervisorAdminNegativeTestJSON-868153439-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:44.903458 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-adbb7b24-3860-4f60-bb13-4890aca6f6b5 tempest-HypervisorAdminNegativeTestJSON-868153439 tempest-HypervisorAdminNegativeTestJSON-868153439-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:44.903458 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-adbb7b24-3860-4f60-bb13-4890aca6f6b5 tempest-HypervisorAdminNegativeTestJSON-868153439 tempest-HypervisorAdminNegativeTestJSON-868153439-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:44.904106 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-c2770135-b582-466a-9ad1-30fff179253b tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:44.904733 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-c2770135-b582-466a-9ad1-30fff179253b tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] [instance: 3961b3f4-aea9-4997-85aa-336b3f902533] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:44.944505 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-adbb7b24-3860-4f60-bb13-4890aca6f6b5 tempest-HypervisorAdminNegativeTestJSON-868153439 tempest-HypervisorAdminNegativeTestJSON-868153439-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:44.945016 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-adbb7b24-3860-4f60-bb13-4890aca6f6b5 tempest-HypervisorAdminNegativeTestJSON-868153439 tempest-HypervisorAdminNegativeTestJSON-868153439-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:44.962761 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-adbb7b24-3860-4f60-bb13-4890aca6f6b5 tempest-HypervisorAdminNegativeTestJSON-868153439 tempest-HypervisorAdminNegativeTestJSON-868153439-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:44.973205 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-adbb7b24-3860-4f60-bb13-4890aca6f6b5 tempest-HypervisorAdminNegativeTestJSON-868153439 tempest-HypervisorAdminNegativeTestJSON-868153439-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.133271 Oct 04 20:34:44.986959 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 176/385] 10.222.0.33 () {58 vars in 1146 bytes} [Tue Oct 4 20:34:44 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:34:44.991870 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0c5d492e-cd84-48b9-aea2-80a7d00e7197 tempest-ServersAdminNegativeTestJSON-129976034 tempest-ServersAdminNegativeTestJSON-129976034-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "invalid"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:34:44.996366 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0c5d492e-cd84-48b9-aea2-80a7d00e7197 tempest-ServersAdminNegativeTestJSON-129976034 tempest-ServersAdminNegativeTestJSON-129976034-project-admin] Request method failure captured: Oct 04 20:34:44.996366 n-d-854823-8 devstack@n-api.service[128801]: request: POST /compute/v2.1/servers/854066a9-9adf-4932-b6a8-c7fe15d8b4da/action HTTP/1.1 Oct 04 20:34:44.996366 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:34:44.996366 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:34:44.996366 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:34:44.996366 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 39 Oct 04 20:34:44.996366 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:34:44.996366 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:34:44.996366 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:34:44.996366 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:34:44.996366 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJi90Cg5yc5SzRNIp7yXOltFlDkxRR_GNs4yqNCbELjV3iDGXYvk5AjD9rmeMVv09r8eOB_pjqbF1KTpLwCPg7Jhd8OW4fF12sT3DO51HCMgAWmPxUaHTwl52SMcROL4Soq4KAgzWokn8vfrxsnAZkFp05oPv85kRzgSv_X-PFrVJ5k Oct 04 20:34:44.996366 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:34:44.996366 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:34:44.996366 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:34:44.996366 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:34:44.996366 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:34:44.996366 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:34:44.996366 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: cb3cd184a54f4e29a216eb156027c8ff Oct 04 20:34:44.996366 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-129976034 Oct 04 20:34:44.996366 n-d-854823-8 devstack@n-api.service[128801]: X-Role: admin,reader,member Oct 04 20:34:44.996366 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: admin,reader,member Oct 04 20:34:44.997656 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_cb3cd184a54f4e29a216eb156027c8ff", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cb3cd184a54f4e29a216eb156027c8ff"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cb3cd184a54f4e29a216eb156027c8ff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/cb3cd184a54f4e29a216eb156027c8ff"}]}] Oct 04 20:34:44.997656 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-ServersAdminNegativeTestJSON-129976034 Oct 04 20:34:44.997656 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: cb3cd184a54f4e29a216eb156027c8ff Oct 04 20:34:44.997656 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-129976034 Oct 04 20:34:44.997656 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-ServersAdminNegativeTestJSON-129976034-project-admin Oct 04 20:34:44.997656 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:34:44.997656 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:34:44.997656 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: d1e3450803564757bad42c40de9fe6af Oct 04 20:34:44.997656 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-ServersAdminNegativeTestJSON-129976034-project-admin Oct 04 20:34:44.997656 n-d-854823-8 devstack@n-api.service[128801]: Oct 04 20:34:44.997656 n-d-854823-8 devstack@n-api.service[128801]: {"os-resetState": {"state": "invalid"}} Oct 04 20:34:44.997656 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 20:34:44.998321 n-d-854823-8 devstack@n-api.service[128801]: exception: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Oct 04 20:34:44.998321 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': '854066a9-9adf-4932-b6a8-c7fe15d8b4da', 'body': {'os-resetState': {'state': 'invalid'}}} Oct 04 20:34:44.998321 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:34:44.998321 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:34:44.998321 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 20:34:44.998321 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 20:34:44.998321 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 20:34:44.998321 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise error Oct 04 20:34:44.998321 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['active', 'error'] Oct 04 20:34:44.998321 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:34:44.998321 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['os-resetState']['properties']['state']: Oct 04 20:34:44.998321 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Oct 04 20:34:44.998321 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:34:44.998321 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Oct 04 20:34:44.998321 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi 'invalid' Oct 04 20:34:44.998321 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:34:44.998321 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:34:44.998321 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:34:44.998321 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:34:44.998321 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:34:44.998321 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:34:44.998321 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:34:44.999524 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:34:44.999524 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:34:44.999524 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:34:44.999524 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 20:34:44.999524 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 20:34:44.999524 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 20:34:44.999524 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 20:34:44.999524 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 20:34:44.999524 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 20:34:44.999524 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Oct 04 20:34:44.999524 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:34:44.999524 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:34:44.999524 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:34:44.999524 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:34:44.999524 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:34:44.999524 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:34:44.999524 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 20:34:44.999524 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 20:34:44.999524 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Oct 04 20:34:45.000544 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:34:45.000544 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0c5d492e-cd84-48b9-aea2-80a7d00e7197 tempest-ServersAdminNegativeTestJSON-129976034 tempest-ServersAdminNegativeTestJSON-129976034-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:34:45.000544 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-0c5d492e-cd84-48b9-aea2-80a7d00e7197 tempest-ServersAdminNegativeTestJSON-129976034 tempest-ServersAdminNegativeTestJSON-129976034-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/854066a9-9adf-4932-b6a8-c7fe15d8b4da/action" status: 400 len: 144 microversion: 2.1 time: 0.009749 Oct 04 20:34:45.000544 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 177/386] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 20:34:44 2022] POST /compute/v2.1/servers/854066a9-9adf-4932-b6a8-c7fe15d8b4da/action => generated 144 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 20:34:45.003439 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ab13c899-9c7f-43a9-940f-7d635f201612 tempest-HypervisorAdminNegativeTestJSON-451740698 tempest-HypervisorAdminNegativeTestJSON-451740698-project] Calling method '.version_select at 0x7f3c74deb4c0>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:45.005710 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-ab13c899-9c7f-43a9-940f-7d635f201612 tempest-HypervisorAdminNegativeTestJSON-451740698 tempest-HypervisorAdminNegativeTestJSON-451740698-project] Policy check for os_compute_api:os-hypervisors:show failed with credentials {'is_admin': False, 'user_id': 'f1e5f459b034455796ad9ec830c9aede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e70f70d1a10419a8092fe68ece45519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:45.007294 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ab13c899-9c7f-43a9-940f-7d635f201612 tempest-HypervisorAdminNegativeTestJSON-451740698 tempest-HypervisorAdminNegativeTestJSON-451740698-project] Request method failure captured: Oct 04 20:34:45.007294 n-d-854823-8 devstack@n-api.service[128801]: request: GET /compute/v2.1/os-hypervisors/1 HTTP/1.1 Oct 04 20:34:45.007294 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:34:45.007294 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:34:45.007294 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:34:45.007294 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 0 Oct 04 20:34:45.007294 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:34:45.007294 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:34:45.007294 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:34:45.007294 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:34:45.007294 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJjgqTbQoLBxdUxbCZMvxKE8C-WIbFbOLGmuq-n5mnjCaq1M_gkVc3vGmJvnBYU-ecxmX2Q_A4IPrNHn9dSUaY7eL9_dvdcIcbf5dINHfSpvlVAgvO_Tkq6nLn8k7cBqQp6KQmLZvPWiUvygoKsCXDQ2FZChSxFpLZqVIy4e7LDXZbs Oct 04 20:34:45.007294 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:34:45.007294 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:34:45.007294 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:34:45.007294 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:34:45.007294 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:34:45.007294 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:34:45.007294 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: 1e70f70d1a10419a8092fe68ece45519 Oct 04 20:34:45.007294 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-451740698 Oct 04 20:34:45.007294 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 20:34:45.007294 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 20:34:45.008518 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_1e70f70d1a10419a8092fe68ece45519", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1e70f70d1a10419a8092fe68ece45519"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1e70f70d1a10419a8092fe68ece45519"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/1e70f70d1a10419a8092fe68ece45519"}]}] Oct 04 20:34:45.008518 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-451740698 Oct 04 20:34:45.008518 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: 1e70f70d1a10419a8092fe68ece45519 Oct 04 20:34:45.008518 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-451740698 Oct 04 20:34:45.008518 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-HypervisorAdminNegativeTestJSON-451740698-project Oct 04 20:34:45.008518 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:34:45.008518 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:34:45.008518 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: f1e5f459b034455796ad9ec830c9aede Oct 04 20:34:45.008518 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-451740698-project Oct 04 20:34:45.008518 n-d-854823-8 devstack@n-api.service[128801]: method: Oct 04 20:34:45.008518 n-d-854823-8 devstack@n-api.service[128801]: exception: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Oct 04 20:34:45.008518 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': '1'} Oct 04 20:34:45.008518 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:34:45.009235 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:34:45.009235 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:34:45.009235 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:34:45.009235 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:34:45.009235 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:34:45.009235 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:34:45.009235 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:34:45.009235 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:34:45.009235 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:34:45.009235 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Oct 04 20:34:45.009235 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self._show(req, id) Oct 04 20:34:45.009235 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 341, in _show Oct 04 20:34:45.009235 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'show', target={}) Oct 04 20:34:45.009235 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 20:34:45.009235 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 20:34:45.009235 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 20:34:45.009235 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 20:34:45.009235 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 20:34:45.009235 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 20:34:45.010273 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 20:34:45.010273 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 20:34:45.010273 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 20:34:45.010273 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 20:34:45.010273 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 20:34:45.010273 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 20:34:45.010273 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 20:34:45.010273 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 20:34:45.010273 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Oct 04 20:34:45.010273 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:34:45.010273 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:34:45.010273 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:34:45.010273 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:34:45.010273 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:34:45.010273 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:34:45.010273 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 20:34:45.010273 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 20:34:45.010273 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Oct 04 20:34:45.010273 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:34:45.011298 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ab13c899-9c7f-43a9-940f-7d635f201612 tempest-HypervisorAdminNegativeTestJSON-451740698 tempest-HypervisorAdminNegativeTestJSON-451740698-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:34:45.011298 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ab13c899-9c7f-43a9-940f-7d635f201612 tempest-HypervisorAdminNegativeTestJSON-451740698 tempest-HypervisorAdminNegativeTestJSON-451740698-project] 10.222.0.33 "GET /compute/v2.1/os-hypervisors/1" status: 403 len: 115 microversion: 2.1 time: 0.009035 Oct 04 20:34:45.014195 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 178/387] 10.222.0.33 () {58 vars in 1152 bytes} [Tue Oct 4 20:34:44 2022] GET /compute/v2.1/os-hypervisors/1 => generated 115 bytes in 15 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:34:45.020724 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-fccc1471-32c8-4e78-89cb-427adae9dc91 tempest-ServersAdminNegativeTestJSON-129976034 tempest-ServersAdminNegativeTestJSON-129976034-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": 1}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:34:45.025232 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-fccc1471-32c8-4e78-89cb-427adae9dc91 tempest-ServersAdminNegativeTestJSON-129976034 tempest-ServersAdminNegativeTestJSON-129976034-project-admin] Request method failure captured: Oct 04 20:34:45.025232 n-d-854823-8 devstack@n-api.service[128801]: request: POST /compute/v2.1/servers/854066a9-9adf-4932-b6a8-c7fe15d8b4da/action HTTP/1.1 Oct 04 20:34:45.025232 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:34:45.025232 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:34:45.025232 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:34:45.025232 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 31 Oct 04 20:34:45.025232 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:34:45.025232 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:34:45.025232 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:34:45.025232 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:34:45.025232 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJi90Cg5yc5SzRNIp7yXOltFlDkxRR_GNs4yqNCbELjV3iDGXYvk5AjD9rmeMVv09r8eOB_pjqbF1KTpLwCPg7Jhd8OW4fF12sT3DO51HCMgAWmPxUaHTwl52SMcROL4Soq4KAgzWokn8vfrxsnAZkFp05oPv85kRzgSv_X-PFrVJ5k Oct 04 20:34:45.025232 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:34:45.025232 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:34:45.025232 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:34:45.025232 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:34:45.025232 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:34:45.025232 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:34:45.025232 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: cb3cd184a54f4e29a216eb156027c8ff Oct 04 20:34:45.025232 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-129976034 Oct 04 20:34:45.025232 n-d-854823-8 devstack@n-api.service[128801]: X-Role: admin,reader,member Oct 04 20:34:45.025232 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: admin,reader,member Oct 04 20:34:45.026740 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_cb3cd184a54f4e29a216eb156027c8ff", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cb3cd184a54f4e29a216eb156027c8ff"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cb3cd184a54f4e29a216eb156027c8ff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/cb3cd184a54f4e29a216eb156027c8ff"}]}] Oct 04 20:34:45.026740 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-ServersAdminNegativeTestJSON-129976034 Oct 04 20:34:45.026740 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: cb3cd184a54f4e29a216eb156027c8ff Oct 04 20:34:45.026740 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-129976034 Oct 04 20:34:45.026740 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-ServersAdminNegativeTestJSON-129976034-project-admin Oct 04 20:34:45.026740 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:34:45.026740 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:34:45.026740 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: d1e3450803564757bad42c40de9fe6af Oct 04 20:34:45.026740 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-ServersAdminNegativeTestJSON-129976034-project-admin Oct 04 20:34:45.026740 n-d-854823-8 devstack@n-api.service[128801]: Oct 04 20:34:45.026740 n-d-854823-8 devstack@n-api.service[128801]: {"os-resetState": {"state": 1}} Oct 04 20:34:45.026740 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 20:34:45.026740 n-d-854823-8 devstack@n-api.service[128801]: exception: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Oct 04 20:34:45.027456 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': '854066a9-9adf-4932-b6a8-c7fe15d8b4da', 'body': {'os-resetState': {'state': 1}}} Oct 04 20:34:45.027456 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:34:45.027456 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:34:45.027456 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 20:34:45.027456 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 20:34:45.027456 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 20:34:45.027456 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise error Oct 04 20:34:45.027456 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 1 is not of type 'string' Oct 04 20:34:45.027456 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:34:45.027456 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['os-resetState']['properties']['state']: Oct 04 20:34:45.027456 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Oct 04 20:34:45.027456 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:34:45.027456 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Oct 04 20:34:45.027456 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi 1 Oct 04 20:34:45.027456 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:34:45.027456 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:34:45.027456 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:34:45.027456 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:34:45.027456 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:34:45.027456 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:34:45.027456 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:34:45.027456 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:34:45.029510 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:34:45.029510 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:34:45.029510 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 20:34:45.029510 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 20:34:45.029510 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 20:34:45.029510 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 20:34:45.029510 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 20:34:45.029510 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 20:34:45.029510 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Oct 04 20:34:45.029510 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:34:45.029510 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:34:45.029510 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:34:45.029510 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:34:45.029510 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:34:45.029510 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:34:45.029510 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 20:34:45.029510 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 20:34:45.029510 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Oct 04 20:34:45.029510 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:34:45.031322 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-fccc1471-32c8-4e78-89cb-427adae9dc91 tempest-ServersAdminNegativeTestJSON-129976034 tempest-ServersAdminNegativeTestJSON-129976034-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:34:45.031322 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-fccc1471-32c8-4e78-89cb-427adae9dc91 tempest-ServersAdminNegativeTestJSON-129976034 tempest-ServersAdminNegativeTestJSON-129976034-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/854066a9-9adf-4932-b6a8-c7fe15d8b4da/action" status: 400 len: 120 microversion: 2.1 time: 0.010682 Oct 04 20:34:45.031322 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 179/388] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 20:34:45 2022] POST /compute/v2.1/servers/854066a9-9adf-4932-b6a8-c7fe15d8b4da/action => generated 120 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 20:34:45.032203 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1cd9779e-adea-4a65-aaae-45b6b6ad5634 tempest-HypervisorAdminNegativeTestJSON-868153439 tempest-HypervisorAdminNegativeTestJSON-868153439-project-admin] Calling method '.version_select at 0x7f3c75138820>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:45.034613 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-1cd9779e-adea-4a65-aaae-45b6b6ad5634 tempest-HypervisorAdminNegativeTestJSON-868153439 tempest-HypervisorAdminNegativeTestJSON-868153439-project-admin] HTTP exception thrown: Hypervisor with ID 'e51f8079-f49d-4a7e-a374-0b86363010b1' could not be found. Oct 04 20:34:45.037023 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1cd9779e-adea-4a65-aaae-45b6b6ad5634 tempest-HypervisorAdminNegativeTestJSON-868153439 tempest-HypervisorAdminNegativeTestJSON-868153439-project-admin] Request method failure captured: Oct 04 20:34:45.037023 n-d-854823-8 devstack@n-api.service[128801]: request: GET /compute/v2.1/os-hypervisors/e51f8079-f49d-4a7e-a374-0b86363010b1 HTTP/1.1 Oct 04 20:34:45.037023 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:34:45.037023 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:34:45.037023 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:34:45.037023 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 0 Oct 04 20:34:45.037023 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:34:45.037023 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:34:45.037023 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:34:45.037023 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:34:45.037023 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJji5gNBRiFY8DDtMEK9NffEMAPnm2i9q71i7YX5ApC-AHS8_C-BlOSEOHWJ5Tib5ivsl2JAqmcrRArOxrMy_QufYRZpF7tranzRczw_5uZE9TXz_AvR3_3kMbCPXbnyyKVtRKOm7mnmMFim2pdG4MBGgWlMhrQZ9L6XyPv36IEwwso Oct 04 20:34:45.037023 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:34:45.037023 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:34:45.037023 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:34:45.037023 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:34:45.037023 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:34:45.037023 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:34:45.037023 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: ce3ee736bb08446ca8fced221c3620a3 Oct 04 20:34:45.037023 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-868153439 Oct 04 20:34:45.037023 n-d-854823-8 devstack@n-api.service[128801]: X-Role: admin,reader,member Oct 04 20:34:45.037023 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: admin,reader,member Oct 04 20:34:45.038202 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ce3ee736bb08446ca8fced221c3620a3", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ce3ee736bb08446ca8fced221c3620a3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ce3ee736bb08446ca8fced221c3620a3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ce3ee736bb08446ca8fced221c3620a3"}]}] Oct 04 20:34:45.038202 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-868153439 Oct 04 20:34:45.038202 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: ce3ee736bb08446ca8fced221c3620a3 Oct 04 20:34:45.038202 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-868153439 Oct 04 20:34:45.038202 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-HypervisorAdminNegativeTestJSON-868153439-project-admin Oct 04 20:34:45.038202 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:34:45.038202 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:34:45.038202 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: dc24fd933daa43ef96c736a0969dd718 Oct 04 20:34:45.038202 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-868153439-project-admin Oct 04 20:34:45.038202 n-d-854823-8 devstack@n-api.service[128801]: method: Oct 04 20:34:45.038202 n-d-854823-8 devstack@n-api.service[128801]: exception: Hypervisor with ID 'e51f8079-f49d-4a7e-a374-0b86363010b1' could not be found. Oct 04 20:34:45.038202 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': 'e51f8079-f49d-4a7e-a374-0b86363010b1'} Oct 04 20:34:45.038970 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:34:45.038970 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:34:45.038970 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Oct 04 20:34:45.038970 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi value = int(str(value)) Oct 04 20:34:45.038970 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: 'e51f8079-f49d-4a7e-a374-0b86363010b1' Oct 04 20:34:45.038970 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:34:45.038970 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:34:45.038970 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:34:45.038970 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:34:45.038970 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Oct 04 20:34:45.038970 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Oct 04 20:34:45.038970 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Oct 04 20:34:45.038970 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Oct 04 20:34:45.038970 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Oct 04 20:34:45.038970 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:34:45.038970 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:34:45.038970 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:34:45.038970 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:34:45.038970 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Oct 04 20:34:45.038970 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Oct 04 20:34:45.038970 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Oct 04 20:34:45.038970 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Oct 04 20:34:45.040750 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Oct 04 20:34:45.040750 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:34:45.040750 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:34:45.040750 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:34:45.040750 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:34:45.040750 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:34:45.040750 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:34:45.040750 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:34:45.040750 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:34:45.040750 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:34:45.040750 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:34:45.040750 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:34:45.040750 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:34:45.040750 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Oct 04 20:34:45.040750 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self._show(req, id) Oct 04 20:34:45.040750 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 343, in _show Oct 04 20:34:45.040750 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Oct 04 20:34:45.040750 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Oct 04 20:34:45.040750 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 04 20:34:45.040750 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID 'e51f8079-f49d-4a7e-a374-0b86363010b1' could not be found. Oct 04 20:34:45.041783 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:34:45.041783 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:34:45.041783 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:34:45.041783 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:34:45.041783 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:34:45.041783 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:34:45.041783 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:34:45.041783 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:34:45.041783 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID 'e51f8079-f49d-4a7e-a374-0b86363010b1' could not be found. Oct 04 20:34:45.041783 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:34:45.041783 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1cd9779e-adea-4a65-aaae-45b6b6ad5634 tempest-HypervisorAdminNegativeTestJSON-868153439 tempest-HypervisorAdminNegativeTestJSON-868153439-project-admin] Returning 404 to user: Hypervisor with ID 'e51f8079-f49d-4a7e-a374-0b86363010b1' could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:34:45.041783 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-1cd9779e-adea-4a65-aaae-45b6b6ad5634 tempest-HypervisorAdminNegativeTestJSON-868153439 tempest-HypervisorAdminNegativeTestJSON-868153439-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors/e51f8079-f49d-4a7e-a374-0b86363010b1" status: 404 len: 123 microversion: 2.1 time: 0.009800 Oct 04 20:34:45.044447 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 180/389] 10.222.0.33 () {58 vars in 1257 bytes} [Tue Oct 4 20:34:45 2022] GET /compute/v2.1/os-hypervisors/e51f8079-f49d-4a7e-a374-0b86363010b1 => generated 123 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:34:45.049482 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-c2770135-b582-466a-9ad1-30fff179253b tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f051a291d59242469f8172a9c474ac89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f0707d756b4ee085a19cccf3ab82c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:45.058098 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-c2770135-b582-466a-9ad1-30fff179253b tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] 10.222.0.33 "GET /compute/v2.1/servers/3961b3f4-aea9-4997-85aa-336b3f902533" status: 200 len: 1219 microversion: 2.1 time: 0.166949 Oct 04 20:34:45.061066 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-801fda3e-d94a-4991-b9dd-b593b3c4dc35 tempest-ServersAdminNegativeTestJSON-129976034 tempest-ServersAdminNegativeTestJSON-129976034-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:34:45.061848 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 210/390] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:44 2022] GET /compute/v2.1/servers/3961b3f4-aea9-4997-85aa-336b3f902533 => generated 1219 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:45.066270 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-801fda3e-d94a-4991-b9dd-b593b3c4dc35 tempest-ServersAdminNegativeTestJSON-129976034 tempest-ServersAdminNegativeTestJSON-129976034-project-admin] Failed to fetch instance by id 999 {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 04 20:34:45.066988 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-801fda3e-d94a-4991-b9dd-b593b3c4dc35 tempest-ServersAdminNegativeTestJSON-129976034 tempest-ServersAdminNegativeTestJSON-129976034-project-admin] HTTP exception thrown: Instance 999 could not be found. Oct 04 20:34:45.070861 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-801fda3e-d94a-4991-b9dd-b593b3c4dc35 tempest-ServersAdminNegativeTestJSON-129976034 tempest-ServersAdminNegativeTestJSON-129976034-project-admin] Request method failure captured: Oct 04 20:34:45.070861 n-d-854823-8 devstack@n-api.service[128801]: request: POST /compute/v2.1/servers/999/action HTTP/1.1 Oct 04 20:34:45.070861 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:34:45.070861 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:34:45.070861 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:34:45.070861 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 37 Oct 04 20:34:45.070861 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:34:45.070861 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:34:45.070861 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:34:45.070861 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:34:45.070861 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJi90Cg5yc5SzRNIp7yXOltFlDkxRR_GNs4yqNCbELjV3iDGXYvk5AjD9rmeMVv09r8eOB_pjqbF1KTpLwCPg7Jhd8OW4fF12sT3DO51HCMgAWmPxUaHTwl52SMcROL4Soq4KAgzWokn8vfrxsnAZkFp05oPv85kRzgSv_X-PFrVJ5k Oct 04 20:34:45.070861 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:34:45.070861 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:34:45.070861 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:34:45.070861 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:34:45.070861 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:34:45.070861 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:34:45.070861 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: cb3cd184a54f4e29a216eb156027c8ff Oct 04 20:34:45.070861 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-129976034 Oct 04 20:34:45.070861 n-d-854823-8 devstack@n-api.service[128801]: X-Role: admin,reader,member Oct 04 20:34:45.070861 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: admin,reader,member Oct 04 20:34:45.072844 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_cb3cd184a54f4e29a216eb156027c8ff", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cb3cd184a54f4e29a216eb156027c8ff"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cb3cd184a54f4e29a216eb156027c8ff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/cb3cd184a54f4e29a216eb156027c8ff"}]}] Oct 04 20:34:45.072844 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-ServersAdminNegativeTestJSON-129976034 Oct 04 20:34:45.072844 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: cb3cd184a54f4e29a216eb156027c8ff Oct 04 20:34:45.072844 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-129976034 Oct 04 20:34:45.072844 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-ServersAdminNegativeTestJSON-129976034-project-admin Oct 04 20:34:45.072844 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:34:45.072844 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:34:45.072844 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: d1e3450803564757bad42c40de9fe6af Oct 04 20:34:45.072844 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-ServersAdminNegativeTestJSON-129976034-project-admin Oct 04 20:34:45.072844 n-d-854823-8 devstack@n-api.service[128801]: Oct 04 20:34:45.072844 n-d-854823-8 devstack@n-api.service[128801]: {"os-resetState": {"state": "error"}} Oct 04 20:34:45.072844 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 20:34:45.072844 n-d-854823-8 devstack@n-api.service[128801]: exception: Instance 999 could not be found. Oct 04 20:34:45.073729 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': '999', 'body': {'os-resetState': {'state': 'error'}}} Oct 04 20:34:45.073729 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:34:45.073729 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:34:45.073729 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:34:45.073729 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:34:45.073729 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 04 20:34:45.073729 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 04 20:34:45.073729 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Oct 04 20:34:45.073729 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:34:45.073729 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:34:45.073729 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:34:45.073729 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:34:45.073729 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:34:45.073729 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:34:45.073729 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:34:45.073729 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:34:45.073729 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:34:45.073729 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:34:45.073729 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:34:45.073729 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:34:45.073729 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/admin_actions.py", line 66, in _reset_state Oct 04 20:34:45.075757 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 04 20:34:45.075757 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:34:45.075757 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:34:45.075757 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Oct 04 20:34:45.075757 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:34:45.075757 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:34:45.075757 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:34:45.075757 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:34:45.075757 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:34:45.075757 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:34:45.075757 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:34:45.075757 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:34:45.075757 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Oct 04 20:34:45.075757 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:34:45.078533 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-801fda3e-d94a-4991-b9dd-b593b3c4dc35 tempest-ServersAdminNegativeTestJSON-129976034 tempest-ServersAdminNegativeTestJSON-129976034-project-admin] Returning 404 to user: Instance 999 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:34:45.080750 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-801fda3e-d94a-4991-b9dd-b593b3c4dc35 tempest-ServersAdminNegativeTestJSON-129976034 tempest-ServersAdminNegativeTestJSON-129976034-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/999/action" status: 404 len: 78 microversion: 2.1 time: 0.034555 Oct 04 20:34:45.085662 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 181/391] 10.222.0.33 () {60 vars in 1179 bytes} [Tue Oct 4 20:34:45 2022] POST /compute/v2.1/servers/999/action => generated 78 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 20:34:45.092843 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-7350b637-b53e-48f1-aa16-e508c44931af tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:45.094219 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-7350b637-b53e-48f1-aa16-e508c44931af tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] [instance: 63e16106-fc95-4fa8-bf7c-e70ff878a5ae] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:45.105791 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7350b637-b53e-48f1-aa16-e508c44931af tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:45.106994 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7350b637-b53e-48f1-aa16-e508c44931af tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:45.107661 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7350b637-b53e-48f1-aa16-e508c44931af tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:45.109768 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7350b637-b53e-48f1-aa16-e508c44931af tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:45.110500 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7350b637-b53e-48f1-aa16-e508c44931af tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:45.113181 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7350b637-b53e-48f1-aa16-e508c44931af tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:45.124762 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ee9a9837-f8ad-425d-9040-2b6703157ca3 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:45.125872 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ee9a9837-f8ad-425d-9040-2b6703157ca3 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] [instance: b8cf32e5-d9cc-4e92-bd81-2c3449406c95] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:45.139498 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ee9a9837-f8ad-425d-9040-2b6703157ca3 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:45.140338 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ee9a9837-f8ad-425d-9040-2b6703157ca3 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:45.144815 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ee9a9837-f8ad-425d-9040-2b6703157ca3 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:45.145832 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ee9a9837-f8ad-425d-9040-2b6703157ca3 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:45.150929 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ee9a9837-f8ad-425d-9040-2b6703157ca3 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:45.151612 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ee9a9837-f8ad-425d-9040-2b6703157ca3 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:45.226516 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-7350b637-b53e-48f1-aa16-e508c44931af tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] [instance: 63e16106-fc95-4fa8-bf7c-e70ff878a5ae] Going to try to terminate instance {{(pid=128802) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:34:45.491268 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=4,nova_api:SAVEPOINT=2,nova_api:RELEASE=2,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:34:45.515799 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-7350b637-b53e-48f1-aa16-e508c44931af tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] 10.222.0.33 "DELETE /compute/v2.1/servers/63e16106-fc95-4fa8-bf7c-e70ff878a5ae" status: 204 len: 0 microversion: 2.1 time: 0.428040 Oct 04 20:34:45.517368 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 211/392] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 20:34:45 2022] DELETE /compute/v2.1/servers/63e16106-fc95-4fa8-bf7c-e70ff878a5ae => generated 0 bytes in 430 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:34:45.527500 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-3bdb9e85-1bd8-486e-9ee1-a65bf77bfbb1 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:45.528484 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-3bdb9e85-1bd8-486e-9ee1-a65bf77bfbb1 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] [instance: 63e16106-fc95-4fa8-bf7c-e70ff878a5ae] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:45.543969 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3bdb9e85-1bd8-486e-9ee1-a65bf77bfbb1 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:45.547532 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3bdb9e85-1bd8-486e-9ee1-a65bf77bfbb1 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:45.548091 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3bdb9e85-1bd8-486e-9ee1-a65bf77bfbb1 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:45.548998 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3bdb9e85-1bd8-486e-9ee1-a65bf77bfbb1 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:45.549657 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3bdb9e85-1bd8-486e-9ee1-a65bf77bfbb1 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:45.551033 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3bdb9e85-1bd8-486e-9ee1-a65bf77bfbb1 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:45.694478 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-ee9a9837-f8ad-425d-9040-2b6703157ca3 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cbd31af13444cda97ba5f8c99d19437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a307499cf44d03a1e9bb61f614f099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:45.714742 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ee9a9837-f8ad-425d-9040-2b6703157ca3 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] 10.222.0.33 "GET /compute/v2.1/servers/b8cf32e5-d9cc-4e92-bd81-2c3449406c95" status: 200 len: 1319 microversion: 2.1 time: 0.592037 Oct 04 20:34:45.719072 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 182/393] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:45 2022] GET /compute/v2.1/servers/b8cf32e5-d9cc-4e92-bd81-2c3449406c95 => generated 1319 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:34:45.881313 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-3bdb9e85-1bd8-486e-9ee1-a65bf77bfbb1 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '147d000a331f4a3ba47019fcbae40901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9928be759e34d208d835263d73a5ab5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:45.890380 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-3bdb9e85-1bd8-486e-9ee1-a65bf77bfbb1 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] 10.222.0.33 "GET /compute/v2.1/servers/63e16106-fc95-4fa8-bf7c-e70ff878a5ae" status: 200 len: 1467 microversion: 2.1 time: 0.368876 Oct 04 20:34:45.893518 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 212/394] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:45 2022] GET /compute/v2.1/servers/63e16106-fc95-4fa8-bf7c-e70ff878a5ae => generated 1467 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:34:45.912896 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-42aad481-a9c6-445d-a496-e13b579dc9b6 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:45.914118 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-42aad481-a9c6-445d-a496-e13b579dc9b6 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] [instance: 9e9f6289-9999-4188-9af1-6cf64a676eee] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:45.923175 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-42aad481-a9c6-445d-a496-e13b579dc9b6 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:45.923986 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-42aad481-a9c6-445d-a496-e13b579dc9b6 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:45.924805 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-42aad481-a9c6-445d-a496-e13b579dc9b6 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:45.925700 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-42aad481-a9c6-445d-a496-e13b579dc9b6 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:45.927250 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-42aad481-a9c6-445d-a496-e13b579dc9b6 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:45.928026 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-42aad481-a9c6-445d-a496-e13b579dc9b6 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:46.095453 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-420d2c23-437b-40ff-9267-3084bff9b8f5 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:46.096064 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-420d2c23-437b-40ff-9267-3084bff9b8f5 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] [instance: 3961b3f4-aea9-4997-85aa-336b3f902533] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:46.105350 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-420d2c23-437b-40ff-9267-3084bff9b8f5 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:46.105845 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-420d2c23-437b-40ff-9267-3084bff9b8f5 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:46.106280 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-420d2c23-437b-40ff-9267-3084bff9b8f5 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:46.117684 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-420d2c23-437b-40ff-9267-3084bff9b8f5 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:46.118803 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-420d2c23-437b-40ff-9267-3084bff9b8f5 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:46.119248 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-420d2c23-437b-40ff-9267-3084bff9b8f5 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:46.292356 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-420d2c23-437b-40ff-9267-3084bff9b8f5 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f051a291d59242469f8172a9c474ac89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f0707d756b4ee085a19cccf3ab82c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:46.302771 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-420d2c23-437b-40ff-9267-3084bff9b8f5 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] 10.222.0.33 "GET /compute/v2.1/servers/3961b3f4-aea9-4997-85aa-336b3f902533" status: 200 len: 1223 microversion: 2.1 time: 0.211073 Oct 04 20:34:46.303875 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 213/395] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:46 2022] GET /compute/v2.1/servers/3961b3f4-aea9-4997-85aa-336b3f902533 => generated 1223 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:46.370359 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-42aad481-a9c6-445d-a496-e13b579dc9b6 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3563efe2b8c94931a2a46c4e14811b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3118a5d96843d3bede1ed94bd9717e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:46.383310 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-42aad481-a9c6-445d-a496-e13b579dc9b6 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] 10.222.0.33 "GET /compute/v2.1/servers/9e9f6289-9999-4188-9af1-6cf64a676eee" status: 200 len: 1477 microversion: 2.1 time: 0.474510 Oct 04 20:34:46.386446 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 183/396] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:45 2022] GET /compute/v2.1/servers/9e9f6289-9999-4188-9af1-6cf64a676eee => generated 1477 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:46.741612 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-3472ad46-b602-4c7d-98fc-9dba68745634 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:46.742779 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-3472ad46-b602-4c7d-98fc-9dba68745634 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] [instance: b8cf32e5-d9cc-4e92-bd81-2c3449406c95] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:46.754081 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3472ad46-b602-4c7d-98fc-9dba68745634 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:46.754612 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3472ad46-b602-4c7d-98fc-9dba68745634 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:46.755057 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3472ad46-b602-4c7d-98fc-9dba68745634 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:46.755776 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3472ad46-b602-4c7d-98fc-9dba68745634 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:46.756238 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3472ad46-b602-4c7d-98fc-9dba68745634 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:46.756662 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3472ad46-b602-4c7d-98fc-9dba68745634 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:46.923059 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d2518c1f-380a-43d9-8f0b-af4b81bee998 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:46.923902 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d2518c1f-380a-43d9-8f0b-af4b81bee998 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] [instance: 63e16106-fc95-4fa8-bf7c-e70ff878a5ae] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:46.934684 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d2518c1f-380a-43d9-8f0b-af4b81bee998 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:46.935772 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d2518c1f-380a-43d9-8f0b-af4b81bee998 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:46.937472 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d2518c1f-380a-43d9-8f0b-af4b81bee998 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:46.941615 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d2518c1f-380a-43d9-8f0b-af4b81bee998 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:46.943133 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d2518c1f-380a-43d9-8f0b-af4b81bee998 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:46.943798 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d2518c1f-380a-43d9-8f0b-af4b81bee998 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:47.050099 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-3472ad46-b602-4c7d-98fc-9dba68745634 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cbd31af13444cda97ba5f8c99d19437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a307499cf44d03a1e9bb61f614f099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:47.064455 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-3472ad46-b602-4c7d-98fc-9dba68745634 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] 10.222.0.33 "GET /compute/v2.1/servers/b8cf32e5-d9cc-4e92-bd81-2c3449406c95" status: 200 len: 1319 microversion: 2.1 time: 0.326552 Oct 04 20:34:47.065584 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 214/397] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:46 2022] GET /compute/v2.1/servers/b8cf32e5-d9cc-4e92-bd81-2c3449406c95 => generated 1319 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:47.222990 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d2518c1f-380a-43d9-8f0b-af4b81bee998 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '147d000a331f4a3ba47019fcbae40901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9928be759e34d208d835263d73a5ab5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:47.226554 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:34:47.240334 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d2518c1f-380a-43d9-8f0b-af4b81bee998 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] 10.222.0.33 "GET /compute/v2.1/servers/63e16106-fc95-4fa8-bf7c-e70ff878a5ae" status: 200 len: 1467 microversion: 2.1 time: 0.322590 Oct 04 20:34:47.241724 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 184/398] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:46 2022] GET /compute/v2.1/servers/63e16106-fc95-4fa8-bf7c-e70ff878a5ae => generated 1467 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:47.329500 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-393bf5d7-c407-4da1-90bc-a5992e116e89 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:47.330117 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-393bf5d7-c407-4da1-90bc-a5992e116e89 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] [instance: 3961b3f4-aea9-4997-85aa-336b3f902533] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:47.366932 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-b465e8b0-db0d-4265-a1d2-e7bc2af250f9 req-8188e827-80c5-4308-b0e5-0695bdfd74b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8cf32e5-d9cc-4e92-bd81-2c3449406c95", "name": "network-vif-plugged", "status": "completed", "tag": "f596121d-68e0-4a9f-b140-59dcfd3b23d4"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:34:47.381937 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-393bf5d7-c407-4da1-90bc-a5992e116e89 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:47.382859 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-393bf5d7-c407-4da1-90bc-a5992e116e89 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:47.388356 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-393bf5d7-c407-4da1-90bc-a5992e116e89 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:47.389998 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-393bf5d7-c407-4da1-90bc-a5992e116e89 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:47.391609 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-393bf5d7-c407-4da1-90bc-a5992e116e89 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:47.392220 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-393bf5d7-c407-4da1-90bc-a5992e116e89 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:47.395162 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-b465e8b0-db0d-4265-a1d2-e7bc2af250f9 req-8188e827-80c5-4308-b0e5-0695bdfd74b8 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:47.396176 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-b465e8b0-db0d-4265-a1d2-e7bc2af250f9 req-8188e827-80c5-4308-b0e5-0695bdfd74b8 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:47.396749 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-b465e8b0-db0d-4265-a1d2-e7bc2af250f9 req-8188e827-80c5-4308-b0e5-0695bdfd74b8 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:47.413106 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-b465e8b0-db0d-4265-a1d2-e7bc2af250f9 req-8188e827-80c5-4308-b0e5-0695bdfd74b8 service nova] Creating event network-vif-plugged:f596121d-68e0-4a9f-b140-59dcfd3b23d4 for instance b8cf32e5-d9cc-4e92-bd81-2c3449406c95 on n-h2-854823-8 Oct 04 20:34:47.422723 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-b465e8b0-db0d-4265-a1d2-e7bc2af250f9 req-8188e827-80c5-4308-b0e5-0695bdfd74b8 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075964 Oct 04 20:34:47.424499 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 185/399] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:34:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:34:47.442522 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a52d789f-0f0b-4936-9d74-1418d69052d8 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:47.444950 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a52d789f-0f0b-4936-9d74-1418d69052d8 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] [instance: 9e9f6289-9999-4188-9af1-6cf64a676eee] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:47.454584 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a52d789f-0f0b-4936-9d74-1418d69052d8 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:47.455345 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a52d789f-0f0b-4936-9d74-1418d69052d8 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:47.455968 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a52d789f-0f0b-4936-9d74-1418d69052d8 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:47.456878 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a52d789f-0f0b-4936-9d74-1418d69052d8 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:47.457942 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a52d789f-0f0b-4936-9d74-1418d69052d8 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:47.459111 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a52d789f-0f0b-4936-9d74-1418d69052d8 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:47.583167 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-393bf5d7-c407-4da1-90bc-a5992e116e89 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f051a291d59242469f8172a9c474ac89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f0707d756b4ee085a19cccf3ab82c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:47.608780 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-393bf5d7-c407-4da1-90bc-a5992e116e89 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] 10.222.0.33 "GET /compute/v2.1/servers/3961b3f4-aea9-4997-85aa-336b3f902533" status: 200 len: 1271 microversion: 2.1 time: 0.281196 Oct 04 20:34:47.609685 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 215/400] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:47 2022] GET /compute/v2.1/servers/3961b3f4-aea9-4997-85aa-336b3f902533 => generated 1271 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:48.090638 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-f473035c-a3cb-4d8a-9914-cc980046957a tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:48.091422 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-f473035c-a3cb-4d8a-9914-cc980046957a tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] [instance: b8cf32e5-d9cc-4e92-bd81-2c3449406c95] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:48.103303 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f473035c-a3cb-4d8a-9914-cc980046957a tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:48.104835 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f473035c-a3cb-4d8a-9914-cc980046957a tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:48.106122 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f473035c-a3cb-4d8a-9914-cc980046957a tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:48.106908 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f473035c-a3cb-4d8a-9914-cc980046957a tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:48.107370 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f473035c-a3cb-4d8a-9914-cc980046957a tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:48.111688 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f473035c-a3cb-4d8a-9914-cc980046957a tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:48.173432 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-a52d789f-0f0b-4936-9d74-1418d69052d8 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3563efe2b8c94931a2a46c4e14811b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3118a5d96843d3bede1ed94bd9717e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:48.192221 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a52d789f-0f0b-4936-9d74-1418d69052d8 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] 10.222.0.33 "GET /compute/v2.1/servers/9e9f6289-9999-4188-9af1-6cf64a676eee" status: 200 len: 1477 microversion: 2.1 time: 0.759817 Oct 04 20:34:48.195627 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 186/401] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:47 2022] GET /compute/v2.1/servers/9e9f6289-9999-4188-9af1-6cf64a676eee => generated 1477 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:48.267274 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-116d4d4d-e2e3-42b4-9bb6-24dcea34e2d9 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:48.268154 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-116d4d4d-e2e3-42b4-9bb6-24dcea34e2d9 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] [instance: 63e16106-fc95-4fa8-bf7c-e70ff878a5ae] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:48.281733 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-116d4d4d-e2e3-42b4-9bb6-24dcea34e2d9 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:48.282641 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-116d4d4d-e2e3-42b4-9bb6-24dcea34e2d9 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:48.283234 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-116d4d4d-e2e3-42b4-9bb6-24dcea34e2d9 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:48.284094 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-116d4d4d-e2e3-42b4-9bb6-24dcea34e2d9 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:48.284691 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-116d4d4d-e2e3-42b4-9bb6-24dcea34e2d9 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:48.285285 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-116d4d4d-e2e3-42b4-9bb6-24dcea34e2d9 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:48.639668 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-116d4d4d-e2e3-42b4-9bb6-24dcea34e2d9 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '147d000a331f4a3ba47019fcbae40901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9928be759e34d208d835263d73a5ab5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:48.647536 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-116d4d4d-e2e3-42b4-9bb6-24dcea34e2d9 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] 10.222.0.33 "GET /compute/v2.1/servers/63e16106-fc95-4fa8-bf7c-e70ff878a5ae" status: 200 len: 1467 microversion: 2.1 time: 0.383993 Oct 04 20:34:48.651101 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 187/402] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:48 2022] GET /compute/v2.1/servers/63e16106-fc95-4fa8-bf7c-e70ff878a5ae => generated 1467 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:34:48.663149 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-072b65cd-f8dd-40ec-a5ab-101a3bd6d529 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:48.664030 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-072b65cd-f8dd-40ec-a5ab-101a3bd6d529 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] [instance: 3961b3f4-aea9-4997-85aa-336b3f902533] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:48.688764 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-072b65cd-f8dd-40ec-a5ab-101a3bd6d529 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:48.689389 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-072b65cd-f8dd-40ec-a5ab-101a3bd6d529 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:48.690788 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-072b65cd-f8dd-40ec-a5ab-101a3bd6d529 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:48.691572 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-072b65cd-f8dd-40ec-a5ab-101a3bd6d529 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:48.698304 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-072b65cd-f8dd-40ec-a5ab-101a3bd6d529 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:48.698304 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-072b65cd-f8dd-40ec-a5ab-101a3bd6d529 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:48.917723 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-f473035c-a3cb-4d8a-9914-cc980046957a tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cbd31af13444cda97ba5f8c99d19437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a307499cf44d03a1e9bb61f614f099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:48.928743 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-f473035c-a3cb-4d8a-9914-cc980046957a tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] 10.222.0.33 "GET /compute/v2.1/servers/b8cf32e5-d9cc-4e92-bd81-2c3449406c95" status: 200 len: 1319 microversion: 2.1 time: 0.842669 Oct 04 20:34:48.957896 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 216/403] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:48 2022] GET /compute/v2.1/servers/b8cf32e5-d9cc-4e92-bd81-2c3449406c95 => generated 1319 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:34:49.109906 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-072b65cd-f8dd-40ec-a5ab-101a3bd6d529 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f051a291d59242469f8172a9c474ac89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f0707d756b4ee085a19cccf3ab82c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:49.122733 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-072b65cd-f8dd-40ec-a5ab-101a3bd6d529 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] 10.222.0.33 "GET /compute/v2.1/servers/3961b3f4-aea9-4997-85aa-336b3f902533" status: 200 len: 1277 microversion: 2.1 time: 0.464143 Oct 04 20:34:49.123486 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 188/404] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:48 2022] GET /compute/v2.1/servers/3961b3f4-aea9-4997-85aa-336b3f902533 => generated 1277 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:49.138325 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-b72572bb-b4ba-4afa-b393-fc5f9766835d req-2c7aa212-25d6-4419-91e7-97fda86529dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63e16106-fc95-4fa8-bf7c-e70ff878a5ae", "name": "network-vif-deleted", "tag": "9d9e908b-6316-4180-a0db-a0f76d878158"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:34:49.161862 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-b72572bb-b4ba-4afa-b393-fc5f9766835d req-2c7aa212-25d6-4419-91e7-97fda86529dc service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:49.162375 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-b72572bb-b4ba-4afa-b393-fc5f9766835d req-2c7aa212-25d6-4419-91e7-97fda86529dc service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:49.162810 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-b72572bb-b4ba-4afa-b393-fc5f9766835d req-2c7aa212-25d6-4419-91e7-97fda86529dc service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:49.198786 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-b72572bb-b4ba-4afa-b393-fc5f9766835d req-2c7aa212-25d6-4419-91e7-97fda86529dc service nova] Creating event network-vif-deleted:9d9e908b-6316-4180-a0db-a0f76d878158 for instance 63e16106-fc95-4fa8-bf7c-e70ff878a5ae on n-h1-854823-8 Oct 04 20:34:49.205768 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-b72572bb-b4ba-4afa-b393-fc5f9766835d req-2c7aa212-25d6-4419-91e7-97fda86529dc service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078615 Oct 04 20:34:49.208958 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 189/405] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:34:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:34:49.264666 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f292cfef-f993-4a3b-af75-a1743928b95b tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:49.269605 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f292cfef-f993-4a3b-af75-a1743928b95b tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] [instance: 9e9f6289-9999-4188-9af1-6cf64a676eee] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:49.285497 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f292cfef-f993-4a3b-af75-a1743928b95b tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:49.286487 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f292cfef-f993-4a3b-af75-a1743928b95b tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:49.287184 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f292cfef-f993-4a3b-af75-a1743928b95b tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:49.288135 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f292cfef-f993-4a3b-af75-a1743928b95b tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:49.288744 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f292cfef-f993-4a3b-af75-a1743928b95b tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:49.289454 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f292cfef-f993-4a3b-af75-a1743928b95b tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:49.320363 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-b43b8802-dbac-4922-949d-3f162f3ae5b6 tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationNegativeTestJSON-server-483506470", "imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63", "flavorRef": "452", "networks": [{"uuid": "c5d8f75c-af9c-48e0-b362-30fb1c3b9cc0"}]}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:34:49.459689 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.network.neutron [None req-b43b8802-dbac-4922-949d-3f162f3ae5b6 tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] validate_networks() for [('c5d8f75c-af9c-48e0-b362-30fb1c3b9cc0', None, None, None, None, None)] {{(pid=128802) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:34:49.877018 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f292cfef-f993-4a3b-af75-a1743928b95b tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3563efe2b8c94931a2a46c4e14811b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3118a5d96843d3bede1ed94bd9717e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:49.888322 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f292cfef-f993-4a3b-af75-a1743928b95b tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] 10.222.0.33 "GET /compute/v2.1/servers/9e9f6289-9999-4188-9af1-6cf64a676eee" status: 200 len: 1477 microversion: 2.1 time: 0.644609 Oct 04 20:34:49.889963 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 190/406] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:49 2022] GET /compute/v2.1/servers/9e9f6289-9999-4188-9af1-6cf64a676eee => generated 1477 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:34:50.202501 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-32d16c5a-7b7f-4859-b724-d6e858a45747 tempest-SecurityGroupsTestAdminJSON-1439866220 tempest-SecurityGroupsTestAdminJSON-1439866220-project] Action: 'create', calling method: .version_select at 0x7f3c74f5e8b0>, body: {"security_group": {"name": "tempest-securitygroup-225640211", "description": "tempest-description-2021691149"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:34:50.765954 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-b43b8802-dbac-4922-949d-3f162f3ae5b6 tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] Flavor limits 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:34:50.768004 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-b43b8802-dbac-4922-949d-3f162f3ae5b6 tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] Image limits 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:34:50.769656 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-b43b8802-dbac-4922-949d-3f162f3ae5b6 tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] Flavor pref 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:34:50.771715 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-b43b8802-dbac-4922-949d-3f162f3ae5b6 tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] Image pref 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:34:50.773021 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-b43b8802-dbac-4922-949d-3f162f3ae5b6 tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:34:50.787929 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b43b8802-dbac-4922-949d-3f162f3ae5b6 tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:50.788780 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b43b8802-dbac-4922-949d-3f162f3ae5b6 tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:50.789462 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b43b8802-dbac-4922-949d-3f162f3ae5b6 tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:50.792167 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b43b8802-dbac-4922-949d-3f162f3ae5b6 tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:50.792923 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b43b8802-dbac-4922-949d-3f162f3ae5b6 tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:50.793647 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b43b8802-dbac-4922-949d-3f162f3ae5b6 tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:50.818719 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-b43b8802-dbac-4922-949d-3f162f3ae5b6 tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] Getting quotas for project b0ca732ccf4d417ab1f7ba82a9c8c41e. Resources: {'ram', 'instances', 'cores'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:34:50.852179 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-b43b8802-dbac-4922-949d-3f162f3ae5b6 tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] Getting quotas for user f8f72b5b32ab457aaaa1c1ff7efdce5c and project b0ca732ccf4d417ab1f7ba82a9c8c41e. Resources: {'ram', 'instances', 'cores'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:34:50.876379 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-b43b8802-dbac-4922-949d-3f162f3ae5b6 tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] Going to run 1 instances... {{(pid=128802) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:34:50.880724 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-b43b8802-dbac-4922-949d-3f162f3ae5b6 tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] [instance: 486112b2-497b-4039-ac04-b23cf076d470] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='15b24725-0c99-4bcf-b1fb-907cdf8e2d63',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128802) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:34:50.957384 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-b43b8802-dbac-4922-949d-3f162f3ae5b6 tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.998111 Oct 04 20:34:50.959042 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 217/407] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 20:34:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 2000 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 20:34:50.965487 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-99dd4eaa-f9a8-43e7-bbc4-5bc221862fbf tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:50.966533 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-99dd4eaa-f9a8-43e7-bbc4-5bc221862fbf tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] [instance: 63e16106-fc95-4fa8-bf7c-e70ff878a5ae] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:50.974034 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-99dd4eaa-f9a8-43e7-bbc4-5bc221862fbf tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:50.975028 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-99dd4eaa-f9a8-43e7-bbc4-5bc221862fbf tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:50.975743 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-99dd4eaa-f9a8-43e7-bbc4-5bc221862fbf tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:50.976784 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-99dd4eaa-f9a8-43e7-bbc4-5bc221862fbf tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:50.978212 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-99dd4eaa-f9a8-43e7-bbc4-5bc221862fbf tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:50.978953 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-99dd4eaa-f9a8-43e7-bbc4-5bc221862fbf tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:50.997709 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.wsgi [None req-99dd4eaa-f9a8-43e7-bbc4-5bc221862fbf tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] HTTP exception thrown: Instance 63e16106-fc95-4fa8-bf7c-e70ff878a5ae could not be found. Oct 04 20:34:51.000302 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-99dd4eaa-f9a8-43e7-bbc4-5bc221862fbf tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Request method failure captured: Oct 04 20:34:51.000302 n-d-854823-8 devstack@n-api.service[128802]: request: GET /compute/v2.1/servers/63e16106-fc95-4fa8-bf7c-e70ff878a5ae HTTP/1.1 Oct 04 20:34:51.000302 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 20:34:51.000302 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 20:34:51.000302 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 20:34:51.000302 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 0 Oct 04 20:34:51.000302 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 20:34:51.000302 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 20:34:51.000302 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 20:34:51.000302 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 20:34:51.000302 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPJi6yhEgbYlr8WNBKldr31E_-QrHfL8ZtpmzvGoWM82dco0Xq3iTLqHp4bMHvKbdFZ1VjfiTyA3bolwTe09jAeXY0T2iJTHIzsFtQZ96Xj96-YLwQ_QUdpvlfr9s6QxwciquHtvq7H6tvPffv38-Ou4ANUy33PWj1gynHKZ2zE26dxM Oct 04 20:34:51.000302 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 20:34:51.000302 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 20:34:51.000302 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 20:34:51.000302 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 20:34:51.000302 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 20:34:51.000302 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 20:34:51.000302 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: b9928be759e34d208d835263d73a5ab5 Oct 04 20:34:51.000302 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-641399923 Oct 04 20:34:51.000302 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 20:34:51.000302 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 20:34:51.001565 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b9928be759e34d208d835263d73a5ab5", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b9928be759e34d208d835263d73a5ab5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b9928be759e34d208d835263d73a5ab5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b9928be759e34d208d835263d73a5ab5"}]}] Oct 04 20:34:51.001565 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-ServersAdminNegativeTestJSON-641399923 Oct 04 20:34:51.001565 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: b9928be759e34d208d835263d73a5ab5 Oct 04 20:34:51.001565 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-641399923 Oct 04 20:34:51.001565 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-ServersAdminNegativeTestJSON-641399923-project Oct 04 20:34:51.001565 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 20:34:51.001565 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 20:34:51.001565 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: 147d000a331f4a3ba47019fcbae40901 Oct 04 20:34:51.001565 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-ServersAdminNegativeTestJSON-641399923-project Oct 04 20:34:51.001565 n-d-854823-8 devstack@n-api.service[128802]: method: > Oct 04 20:34:51.001565 n-d-854823-8 devstack@n-api.service[128802]: exception: Instance 63e16106-fc95-4fa8-bf7c-e70ff878a5ae could not be found. Oct 04 20:34:51.001565 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'id': '63e16106-fc95-4fa8-bf7c-e70ff878a5ae'} Oct 04 20:34:51.002289 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:34:51.002289 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:34:51.002289 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:34:51.002289 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:34:51.002289 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:34:51.002289 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:34:51.002289 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:34:51.002289 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:34:51.002289 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:34:51.002289 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:34:51.002289 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 63e16106-fc95-4fa8-bf7c-e70ff878a5ae could not be found. Oct 04 20:34:51.002289 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:34:51.002289 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:34:51.002289 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:34:51.002289 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:34:51.002289 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:34:51.002289 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:34:51.002289 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:34:51.002289 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:34:51.002289 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:34:51.003478 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:34:51.003478 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:34:51.003478 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:34:51.003478 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:34:51.003478 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:34:51.003478 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:34:51.003478 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:34:51.003478 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 63e16106-fc95-4fa8-bf7c-e70ff878a5ae could not be found. Oct 04 20:34:51.003478 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:34:51.003478 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:34:51.003478 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:34:51.003478 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:34:51.003478 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:34:51.003478 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:34:51.003478 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:34:51.003478 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:34:51.003478 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 63e16106-fc95-4fa8-bf7c-e70ff878a5ae could not be found. Oct 04 20:34:51.003478 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:34:51.006121 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-99dd4eaa-f9a8-43e7-bbc4-5bc221862fbf tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Returning 404 to user: Instance 63e16106-fc95-4fa8-bf7c-e70ff878a5ae could not be found. {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:34:51.007453 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-99dd4eaa-f9a8-43e7-bbc4-5bc221862fbf tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] 10.222.0.33 "GET /compute/v2.1/servers/63e16106-fc95-4fa8-bf7c-e70ff878a5ae" status: 404 len: 111 microversion: 2.1 time: 0.047223 Oct 04 20:34:51.008589 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 218/408] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:50 2022] GET /compute/v2.1/servers/63e16106-fc95-4fa8-bf7c-e70ff878a5ae => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:34:51.031461 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-4016e171-4175-4e5e-9efe-3c10d395d0b7 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:51.033478 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-4016e171-4175-4e5e-9efe-3c10d395d0b7 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] [instance: b8cf32e5-d9cc-4e92-bd81-2c3449406c95] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:51.044199 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4016e171-4175-4e5e-9efe-3c10d395d0b7 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:51.045085 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4016e171-4175-4e5e-9efe-3c10d395d0b7 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:51.045848 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4016e171-4175-4e5e-9efe-3c10d395d0b7 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:51.046973 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4016e171-4175-4e5e-9efe-3c10d395d0b7 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:51.047896 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4016e171-4175-4e5e-9efe-3c10d395d0b7 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:51.048643 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4016e171-4175-4e5e-9efe-3c10d395d0b7 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:51.115524 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-32d16c5a-7b7f-4859-b724-d6e858a45747 tempest-SecurityGroupsTestAdminJSON-1439866220 tempest-SecurityGroupsTestAdminJSON-1439866220-project] 10.222.0.33 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 1.223717 Oct 04 20:34:51.116706 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 191/409] 10.222.0.33 () {60 vars in 1180 bytes} [Tue Oct 4 20:34:49 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 1226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:34:51.121944 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-eb7d90d3-89c5-4577-bc35-5860a00a234c tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:51.122867 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-eb7d90d3-89c5-4577-bc35-5860a00a234c tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] [instance: 3961b3f4-aea9-4997-85aa-336b3f902533] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:51.137160 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-eb7d90d3-89c5-4577-bc35-5860a00a234c tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:51.137872 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-eb7d90d3-89c5-4577-bc35-5860a00a234c tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:51.140923 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-eb7d90d3-89c5-4577-bc35-5860a00a234c tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:51.141821 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-eb7d90d3-89c5-4577-bc35-5860a00a234c tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:51.142292 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-eb7d90d3-89c5-4577-bc35-5860a00a234c tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:51.142745 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-eb7d90d3-89c5-4577-bc35-5860a00a234c tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:51.667328 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-4016e171-4175-4e5e-9efe-3c10d395d0b7 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cbd31af13444cda97ba5f8c99d19437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a307499cf44d03a1e9bb61f614f099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:51.677456 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-4016e171-4175-4e5e-9efe-3c10d395d0b7 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] 10.222.0.33 "GET /compute/v2.1/servers/b8cf32e5-d9cc-4e92-bd81-2c3449406c95" status: 200 len: 1468 microversion: 2.1 time: 0.667439 Oct 04 20:34:51.678052 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 219/410] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:51 2022] GET /compute/v2.1/servers/b8cf32e5-d9cc-4e92-bd81-2c3449406c95 => generated 1468 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:51.694294 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-420cbeaa-a102-4ae9-80bd-c61fef47dda0 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:51.705214 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-eb7d90d3-89c5-4577-bc35-5860a00a234c tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f051a291d59242469f8172a9c474ac89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f0707d756b4ee085a19cccf3ab82c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:51.714489 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-eb7d90d3-89c5-4577-bc35-5860a00a234c tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] 10.222.0.33 "GET /compute/v2.1/servers/3961b3f4-aea9-4997-85aa-336b3f902533" status: 200 len: 1319 microversion: 2.1 time: 0.596376 Oct 04 20:34:51.715070 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 192/411] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:51 2022] GET /compute/v2.1/servers/3961b3f4-aea9-4997-85aa-336b3f902533 => generated 1319 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:51.715523 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-420cbeaa-a102-4ae9-80bd-c61fef47dda0 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] [instance: 9e9f6289-9999-4188-9af1-6cf64a676eee] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:51.733205 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-be447ccd-2c3b-4362-97e0-5932cf6b2796 tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:51.733761 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-be447ccd-2c3b-4362-97e0-5932cf6b2796 tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] [instance: 486112b2-497b-4039-ac04-b23cf076d470] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:51.735665 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-420cbeaa-a102-4ae9-80bd-c61fef47dda0 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:51.736155 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-420cbeaa-a102-4ae9-80bd-c61fef47dda0 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:51.736668 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-420cbeaa-a102-4ae9-80bd-c61fef47dda0 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:51.737587 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-420cbeaa-a102-4ae9-80bd-c61fef47dda0 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:51.738227 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-420cbeaa-a102-4ae9-80bd-c61fef47dda0 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:51.738920 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-420cbeaa-a102-4ae9-80bd-c61fef47dda0 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:51.750193 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-be447ccd-2c3b-4362-97e0-5932cf6b2796 tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:51.751167 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-be447ccd-2c3b-4362-97e0-5932cf6b2796 tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:51.751818 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-be447ccd-2c3b-4362-97e0-5932cf6b2796 tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:51.753399 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-be447ccd-2c3b-4362-97e0-5932cf6b2796 tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:51.754073 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-be447ccd-2c3b-4362-97e0-5932cf6b2796 tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:51.754733 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-be447ccd-2c3b-4362-97e0-5932cf6b2796 tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:51.850066 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-be447ccd-2c3b-4362-97e0-5932cf6b2796 tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f72b5b32ab457aaaa1c1ff7efdce5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ca732ccf4d417ab1f7ba82a9c8c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:51.861219 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-be447ccd-2c3b-4362-97e0-5932cf6b2796 tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] 10.222.0.33 "GET /compute/v2.1/servers/486112b2-497b-4039-ac04-b23cf076d470" status: 200 len: 1235 microversion: 2.1 time: 0.134738 Oct 04 20:34:51.863049 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 193/412] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:51 2022] GET /compute/v2.1/servers/486112b2-497b-4039-ac04-b23cf076d470 => generated 1235 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:51.869277 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-caebc1de-808f-469b-b2fb-6dca71bdabda tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:51.870557 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-caebc1de-808f-469b-b2fb-6dca71bdabda tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] [instance: 854066a9-9adf-4932-b6a8-c7fe15d8b4da] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:51.878215 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-caebc1de-808f-469b-b2fb-6dca71bdabda tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:51.878844 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-caebc1de-808f-469b-b2fb-6dca71bdabda tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:51.879278 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-caebc1de-808f-469b-b2fb-6dca71bdabda tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:51.879997 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-caebc1de-808f-469b-b2fb-6dca71bdabda tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:51.881109 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-caebc1de-808f-469b-b2fb-6dca71bdabda tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:51.881541 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-caebc1de-808f-469b-b2fb-6dca71bdabda tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:51.910788 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-caebc1de-808f-469b-b2fb-6dca71bdabda tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] [instance: 854066a9-9adf-4932-b6a8-c7fe15d8b4da] Going to try to terminate instance {{(pid=128801) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:34:52.047388 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-caebc1de-808f-469b-b2fb-6dca71bdabda tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] 10.222.0.33 "DELETE /compute/v2.1/servers/854066a9-9adf-4932-b6a8-c7fe15d8b4da" status: 204 len: 0 microversion: 2.1 time: 0.182563 Oct 04 20:34:52.048588 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 194/413] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 20:34:51 2022] DELETE /compute/v2.1/servers/854066a9-9adf-4932-b6a8-c7fe15d8b4da => generated 0 bytes in 185 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:34:52.056865 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a7d15de1-5fcc-45e0-be6f-56969d463068 tempest-SecurityGroupsTestAdminJSON-1439866220 tempest-SecurityGroupsTestAdminJSON-1439866220-project] Action: 'create', calling method: .version_select at 0x7f3c74efae50>, body: {"security_group": {"name": "tempest-securitygroup-563358629", "description": "tempest-description-210781413"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:34:52.133942 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-420cbeaa-a102-4ae9-80bd-c61fef47dda0 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3563efe2b8c94931a2a46c4e14811b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3118a5d96843d3bede1ed94bd9717e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:52.144223 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-420cbeaa-a102-4ae9-80bd-c61fef47dda0 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] 10.222.0.33 "GET /compute/v2.1/servers/9e9f6289-9999-4188-9af1-6cf64a676eee" status: 200 len: 1477 microversion: 2.1 time: 0.465103 Oct 04 20:34:52.144957 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 220/414] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:51 2022] GET /compute/v2.1/servers/9e9f6289-9999-4188-9af1-6cf64a676eee => generated 1477 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:52.359229 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a7d15de1-5fcc-45e0-be6f-56969d463068 tempest-SecurityGroupsTestAdminJSON-1439866220 tempest-SecurityGroupsTestAdminJSON-1439866220-project] 10.222.0.33 "POST /compute/v2.1/os-security-groups" status: 200 len: 219 microversion: 2.1 time: 0.309099 Oct 04 20:34:52.360083 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 195/415] 10.222.0.33 () {60 vars in 1180 bytes} [Tue Oct 4 20:34:52 2022] POST /compute/v2.1/os-security-groups => generated 219 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:34:52.416803 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-ae93c42d-41fc-4f49-8c0c-cded44318aa3 tempest-DeleteServersAdminTestJSON-1986202439 tempest-DeleteServersAdminTestJSON-1986202439-project-admin] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:52.417382 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-ae93c42d-41fc-4f49-8c0c-cded44318aa3 tempest-DeleteServersAdminTestJSON-1986202439 tempest-DeleteServersAdminTestJSON-1986202439-project-admin] [instance: b8cf32e5-d9cc-4e92-bd81-2c3449406c95] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:52.424505 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ae93c42d-41fc-4f49-8c0c-cded44318aa3 tempest-DeleteServersAdminTestJSON-1986202439 tempest-DeleteServersAdminTestJSON-1986202439-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:52.425419 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ae93c42d-41fc-4f49-8c0c-cded44318aa3 tempest-DeleteServersAdminTestJSON-1986202439 tempest-DeleteServersAdminTestJSON-1986202439-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:52.426147 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ae93c42d-41fc-4f49-8c0c-cded44318aa3 tempest-DeleteServersAdminTestJSON-1986202439 tempest-DeleteServersAdminTestJSON-1986202439-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:52.427443 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ae93c42d-41fc-4f49-8c0c-cded44318aa3 tempest-DeleteServersAdminTestJSON-1986202439 tempest-DeleteServersAdminTestJSON-1986202439-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:52.428099 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ae93c42d-41fc-4f49-8c0c-cded44318aa3 tempest-DeleteServersAdminTestJSON-1986202439 tempest-DeleteServersAdminTestJSON-1986202439-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:52.428736 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ae93c42d-41fc-4f49-8c0c-cded44318aa3 tempest-DeleteServersAdminTestJSON-1986202439 tempest-DeleteServersAdminTestJSON-1986202439-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:52.438578 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-defa2f85-19e0-4630-99cc-8ecd88af9725 tempest-QuotasAdminTestV236-1235447618 tempest-QuotasAdminTestV236-1235447618-project-admin] Action: 'update', calling method: .version_select at 0x7f3c74d97310>, body: {"quota_set": {"ram": "5120"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:34:52.468592 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-ae93c42d-41fc-4f49-8c0c-cded44318aa3 tempest-DeleteServersAdminTestJSON-1986202439 tempest-DeleteServersAdminTestJSON-1986202439-project-admin] [instance: b8cf32e5-d9cc-4e92-bd81-2c3449406c95] Going to try to terminate instance {{(pid=128802) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:34:52.529955 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-defa2f85-19e0-4630-99cc-8ecd88af9725 tempest-QuotasAdminTestV236-1235447618 tempest-QuotasAdminTestV236-1235447618-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:52.530795 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-defa2f85-19e0-4630-99cc-8ecd88af9725 tempest-QuotasAdminTestV236-1235447618 tempest-QuotasAdminTestV236-1235447618-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:52.531391 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-defa2f85-19e0-4630-99cc-8ecd88af9725 tempest-QuotasAdminTestV236-1235447618 tempest-QuotasAdminTestV236-1235447618-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:52.532580 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-defa2f85-19e0-4630-99cc-8ecd88af9725 tempest-QuotasAdminTestV236-1235447618 tempest-QuotasAdminTestV236-1235447618-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:52.533201 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-defa2f85-19e0-4630-99cc-8ecd88af9725 tempest-QuotasAdminTestV236-1235447618 tempest-QuotasAdminTestV236-1235447618-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:52.533780 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-defa2f85-19e0-4630-99cc-8ecd88af9725 tempest-QuotasAdminTestV236-1235447618 tempest-QuotasAdminTestV236-1235447618-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:52.559111 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:34:52.631590 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-defa2f85-19e0-4630-99cc-8ecd88af9725 tempest-QuotasAdminTestV236-1235447618 tempest-QuotasAdminTestV236-1235447618-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-quota-sets/62a770a79a6c43cc88c2b7cf47c2d9ab" status: 200 len: 240 microversion: 2.36 time: 0.267548 Oct 04 20:34:52.633054 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 196/416] 10.222.0.33 () {62 vars in 1303 bytes} [Tue Oct 4 20:34:52 2022] PUT /compute/v2.1/os-quota-sets/62a770a79a6c43cc88c2b7cf47c2d9ab => generated 240 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 20:34:52.646151 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a26ec1f0-c8d9-414e-be41-5c2758484b74 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:52.647009 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a26ec1f0-c8d9-414e-be41-5c2758484b74 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] [instance: 854066a9-9adf-4932-b6a8-c7fe15d8b4da] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:52.657149 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a26ec1f0-c8d9-414e-be41-5c2758484b74 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:52.657735 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a26ec1f0-c8d9-414e-be41-5c2758484b74 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:52.658447 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a26ec1f0-c8d9-414e-be41-5c2758484b74 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:52.659361 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a26ec1f0-c8d9-414e-be41-5c2758484b74 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:52.660133 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a26ec1f0-c8d9-414e-be41-5c2758484b74 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:52.660737 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a26ec1f0-c8d9-414e-be41-5c2758484b74 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:52.719892 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-ae93c42d-41fc-4f49-8c0c-cded44318aa3 tempest-DeleteServersAdminTestJSON-1986202439 tempest-DeleteServersAdminTestJSON-1986202439-project-admin] 10.222.0.33 "DELETE /compute/v2.1/servers/b8cf32e5-d9cc-4e92-bd81-2c3449406c95" status: 204 len: 0 microversion: 2.1 time: 0.558890 Oct 04 20:34:52.723855 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 221/417] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 20:34:52 2022] DELETE /compute/v2.1/servers/b8cf32e5-d9cc-4e92-bd81-2c3449406c95 => generated 0 bytes in 575 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:34:52.919210 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-d77c3826-6870-4fd5-ad30-adb1bd3753cc tempest-SecurityGroupsTestAdminJSON-377823160 tempest-SecurityGroupsTestAdminJSON-377823160-project-admin] Action: 'create', calling method: .version_select at 0x7f3c74f7a040>, body: {"security_group": {"name": "tempest-securitygroup-1935130589", "description": "tempest-description-1405839441"}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:34:52.921059 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-a26ec1f0-c8d9-414e-be41-5c2758484b74 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '147d000a331f4a3ba47019fcbae40901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9928be759e34d208d835263d73a5ab5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:52.940983 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a26ec1f0-c8d9-414e-be41-5c2758484b74 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] 10.222.0.33 "GET /compute/v2.1/servers/854066a9-9adf-4932-b6a8-c7fe15d8b4da" status: 200 len: 1477 microversion: 2.1 time: 0.305862 Oct 04 20:34:52.941573 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 197/418] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:52 2022] GET /compute/v2.1/servers/854066a9-9adf-4932-b6a8-c7fe15d8b4da => generated 1477 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:52.956439 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-220457c7-1ad0-4e0b-9c42-a398ef12317b req-6b72a8d3-0d90-4039-b4ff-d6e55bc2db2e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3961b3f4-aea9-4997-85aa-336b3f902533", "tag": "6e9e362a-05ec-422d-9902-e146dc60ea86"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:34:52.973782 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-220457c7-1ad0-4e0b-9c42-a398ef12317b req-6b72a8d3-0d90-4039-b4ff-d6e55bc2db2e service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:52.974648 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-220457c7-1ad0-4e0b-9c42-a398ef12317b req-6b72a8d3-0d90-4039-b4ff-d6e55bc2db2e service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:52.980052 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-220457c7-1ad0-4e0b-9c42-a398ef12317b req-6b72a8d3-0d90-4039-b4ff-d6e55bc2db2e service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:52.996693 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-220457c7-1ad0-4e0b-9c42-a398ef12317b req-6b72a8d3-0d90-4039-b4ff-d6e55bc2db2e service nova] Creating event network-changed:6e9e362a-05ec-422d-9902-e146dc60ea86 for instance 3961b3f4-aea9-4997-85aa-336b3f902533 on n-h1-854823-8 Oct 04 20:34:53.002505 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-220457c7-1ad0-4e0b-9c42-a398ef12317b req-6b72a8d3-0d90-4039-b4ff-d6e55bc2db2e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053276 Oct 04 20:34:53.003863 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 198/419] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:34:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:34:53.010790 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-be28d339-415c-450f-aca0-c334b5dbb068 tempest-QuotasAdminTestV236-1235447618 tempest-QuotasAdminTestV236-1235447618-project-admin] Calling method '.version_select at 0x7f3c74de1790>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:53.084904 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-be28d339-415c-450f-aca0-c334b5dbb068 tempest-QuotasAdminTestV236-1235447618 tempest-QuotasAdminTestV236-1235447618-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:53.085264 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-be28d339-415c-450f-aca0-c334b5dbb068 tempest-QuotasAdminTestV236-1235447618 tempest-QuotasAdminTestV236-1235447618-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:53.085695 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-be28d339-415c-450f-aca0-c334b5dbb068 tempest-QuotasAdminTestV236-1235447618 tempest-QuotasAdminTestV236-1235447618-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:53.087039 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-be28d339-415c-450f-aca0-c334b5dbb068 tempest-QuotasAdminTestV236-1235447618 tempest-QuotasAdminTestV236-1235447618-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:53.087608 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-be28d339-415c-450f-aca0-c334b5dbb068 tempest-QuotasAdminTestV236-1235447618 tempest-QuotasAdminTestV236-1235447618-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:53.088037 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-be28d339-415c-450f-aca0-c334b5dbb068 tempest-QuotasAdminTestV236-1235447618 tempest-QuotasAdminTestV236-1235447618-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:53.110761 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-be28d339-415c-450f-aca0-c334b5dbb068 tempest-QuotasAdminTestV236-1235447618 tempest-QuotasAdminTestV236-1235447618-project-admin] 10.222.0.33 "GET /compute/v2.1/os-quota-sets/62a770a79a6c43cc88c2b7cf47c2d9ab/detail" status: 200 len: 672 microversion: 2.36 time: 0.105755 Oct 04 20:34:53.111873 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 199/420] 10.222.0.33 () {60 vars in 1304 bytes} [Tue Oct 4 20:34:53 2022] GET /compute/v2.1/os-quota-sets/62a770a79a6c43cc88c2b7cf47c2d9ab/detail => generated 672 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 20:34:53.119454 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-fee51ab8-652e-4505-8cb1-7deb216c55cd tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:53.120189 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-fee51ab8-652e-4505-8cb1-7deb216c55cd tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] [instance: b8cf32e5-d9cc-4e92-bd81-2c3449406c95] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:53.127712 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fee51ab8-652e-4505-8cb1-7deb216c55cd tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:53.128600 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fee51ab8-652e-4505-8cb1-7deb216c55cd tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:53.129081 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fee51ab8-652e-4505-8cb1-7deb216c55cd tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:53.129934 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fee51ab8-652e-4505-8cb1-7deb216c55cd tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:53.130401 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fee51ab8-652e-4505-8cb1-7deb216c55cd tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:53.130829 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fee51ab8-652e-4505-8cb1-7deb216c55cd tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:53.372830 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-fee51ab8-652e-4505-8cb1-7deb216c55cd tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cbd31af13444cda97ba5f8c99d19437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a307499cf44d03a1e9bb61f614f099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:53.381480 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-fee51ab8-652e-4505-8cb1-7deb216c55cd tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] 10.222.0.33 "GET /compute/v2.1/servers/b8cf32e5-d9cc-4e92-bd81-2c3449406c95" status: 200 len: 1474 microversion: 2.1 time: 0.269007 Oct 04 20:34:53.382334 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 200/421] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:53 2022] GET /compute/v2.1/servers/b8cf32e5-d9cc-4e92-bd81-2c3449406c95 => generated 1474 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:53.391694 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-fb241474-3d9d-4688-986b-049ebd1488c7 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:53.392612 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-fb241474-3d9d-4688-986b-049ebd1488c7 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] [instance: 3961b3f4-aea9-4997-85aa-336b3f902533] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:53.399325 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fb241474-3d9d-4688-986b-049ebd1488c7 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:53.399844 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fb241474-3d9d-4688-986b-049ebd1488c7 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:53.400338 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fb241474-3d9d-4688-986b-049ebd1488c7 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:53.401044 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fb241474-3d9d-4688-986b-049ebd1488c7 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:53.401496 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fb241474-3d9d-4688-986b-049ebd1488c7 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:53.402094 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fb241474-3d9d-4688-986b-049ebd1488c7 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:53.529361 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-d77c3826-6870-4fd5-ad30-adb1bd3753cc tempest-SecurityGroupsTestAdminJSON-377823160 tempest-SecurityGroupsTestAdminJSON-377823160-project-admin] 10.222.0.33 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 0.806116 Oct 04 20:34:53.531184 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 222/422] 10.222.0.33 () {60 vars in 1180 bytes} [Tue Oct 4 20:34:52 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:34:53.536813 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-17e9f8e3-0bee-4a13-8768-7bee26e2ca59 tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:53.537552 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-17e9f8e3-0bee-4a13-8768-7bee26e2ca59 tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] [instance: 486112b2-497b-4039-ac04-b23cf076d470] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:53.547184 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-17e9f8e3-0bee-4a13-8768-7bee26e2ca59 tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:53.547711 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-17e9f8e3-0bee-4a13-8768-7bee26e2ca59 tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:53.548158 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-17e9f8e3-0bee-4a13-8768-7bee26e2ca59 tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:53.549016 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-17e9f8e3-0bee-4a13-8768-7bee26e2ca59 tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:53.549511 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-17e9f8e3-0bee-4a13-8768-7bee26e2ca59 tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:53.549935 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-17e9f8e3-0bee-4a13-8768-7bee26e2ca59 tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:53.641306 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-17e9f8e3-0bee-4a13-8768-7bee26e2ca59 tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f72b5b32ab457aaaa1c1ff7efdce5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ca732ccf4d417ab1f7ba82a9c8c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:53.653854 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-fb241474-3d9d-4688-986b-049ebd1488c7 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f051a291d59242469f8172a9c474ac89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f0707d756b4ee085a19cccf3ab82c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:53.656450 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-17e9f8e3-0bee-4a13-8768-7bee26e2ca59 tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] 10.222.0.33 "GET /compute/v2.1/servers/486112b2-497b-4039-ac04-b23cf076d470" status: 200 len: 1289 microversion: 2.1 time: 0.123624 Oct 04 20:34:53.657431 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 223/423] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:53 2022] GET /compute/v2.1/servers/486112b2-497b-4039-ac04-b23cf076d470 => generated 1289 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:53.661698 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-fb241474-3d9d-4688-986b-049ebd1488c7 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] 10.222.0.33 "GET /compute/v2.1/servers/3961b3f4-aea9-4997-85aa-336b3f902533" status: 200 len: 1319 microversion: 2.1 time: 0.278015 Oct 04 20:34:53.662926 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 201/424] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:53 2022] GET /compute/v2.1/servers/3961b3f4-aea9-4997-85aa-336b3f902533 => generated 1319 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:53.681235 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e5ab631d-41e8-4f7a-a012-fdc4cf23cf04 tempest-QuotasAdminTestV236-1235447618 tempest-QuotasAdminTestV236-1235447618-project-admin] Action: 'update', calling method: .version_select at 0x7f3c74d97310>, body: {"quota_set": {"ram": "2048"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:34:53.687096 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-4fa117be-db7e-4b93-b2c4-43b6c89fd600 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:53.688305 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-4fa117be-db7e-4b93-b2c4-43b6c89fd600 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] [instance: 9e9f6289-9999-4188-9af1-6cf64a676eee] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:53.704522 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4fa117be-db7e-4b93-b2c4-43b6c89fd600 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:53.705604 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4fa117be-db7e-4b93-b2c4-43b6c89fd600 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:53.706233 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4fa117be-db7e-4b93-b2c4-43b6c89fd600 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:53.707323 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4fa117be-db7e-4b93-b2c4-43b6c89fd600 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:53.708090 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4fa117be-db7e-4b93-b2c4-43b6c89fd600 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:53.708735 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4fa117be-db7e-4b93-b2c4-43b6c89fd600 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:53.757497 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e5ab631d-41e8-4f7a-a012-fdc4cf23cf04 tempest-QuotasAdminTestV236-1235447618 tempest-QuotasAdminTestV236-1235447618-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:53.758071 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e5ab631d-41e8-4f7a-a012-fdc4cf23cf04 tempest-QuotasAdminTestV236-1235447618 tempest-QuotasAdminTestV236-1235447618-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:53.759022 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e5ab631d-41e8-4f7a-a012-fdc4cf23cf04 tempest-QuotasAdminTestV236-1235447618 tempest-QuotasAdminTestV236-1235447618-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:53.759836 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e5ab631d-41e8-4f7a-a012-fdc4cf23cf04 tempest-QuotasAdminTestV236-1235447618 tempest-QuotasAdminTestV236-1235447618-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:53.760361 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e5ab631d-41e8-4f7a-a012-fdc4cf23cf04 tempest-QuotasAdminTestV236-1235447618 tempest-QuotasAdminTestV236-1235447618-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:53.760852 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e5ab631d-41e8-4f7a-a012-fdc4cf23cf04 tempest-QuotasAdminTestV236-1235447618 tempest-QuotasAdminTestV236-1235447618-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:53.815485 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e5ab631d-41e8-4f7a-a012-fdc4cf23cf04 tempest-QuotasAdminTestV236-1235447618 tempest-QuotasAdminTestV236-1235447618-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:53.816065 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e5ab631d-41e8-4f7a-a012-fdc4cf23cf04 tempest-QuotasAdminTestV236-1235447618 tempest-QuotasAdminTestV236-1235447618-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:53.816566 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e5ab631d-41e8-4f7a-a012-fdc4cf23cf04 tempest-QuotasAdminTestV236-1235447618 tempest-QuotasAdminTestV236-1235447618-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:53.817931 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e5ab631d-41e8-4f7a-a012-fdc4cf23cf04 tempest-QuotasAdminTestV236-1235447618 tempest-QuotasAdminTestV236-1235447618-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:53.817931 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e5ab631d-41e8-4f7a-a012-fdc4cf23cf04 tempest-QuotasAdminTestV236-1235447618 tempest-QuotasAdminTestV236-1235447618-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:53.818538 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e5ab631d-41e8-4f7a-a012-fdc4cf23cf04 tempest-QuotasAdminTestV236-1235447618 tempest-QuotasAdminTestV236-1235447618-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:53.864170 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-4fa117be-db7e-4b93-b2c4-43b6c89fd600 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3563efe2b8c94931a2a46c4e14811b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3118a5d96843d3bede1ed94bd9717e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:53.874381 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-4fa117be-db7e-4b93-b2c4-43b6c89fd600 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] 10.222.0.33 "GET /compute/v2.1/servers/9e9f6289-9999-4188-9af1-6cf64a676eee" status: 200 len: 1477 microversion: 2.1 time: 0.215251 Oct 04 20:34:53.875253 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 224/425] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:53 2022] GET /compute/v2.1/servers/9e9f6289-9999-4188-9af1-6cf64a676eee => generated 1477 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:53.880674 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-f0b67852-65f5-4e6e-86cf-9db840c20b3a tempest-SecurityGroupsTestAdminJSON-377823160 tempest-SecurityGroupsTestAdminJSON-377823160-project-admin] Action: 'create', calling method: .version_select at 0x7f3c74eddb80>, body: {"security_group": {"name": "tempest-securitygroup-1156641469", "description": "tempest-description-832378864"}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:34:53.923916 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e5ab631d-41e8-4f7a-a012-fdc4cf23cf04 tempest-QuotasAdminTestV236-1235447618 tempest-QuotasAdminTestV236-1235447618-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-quota-sets/62a770a79a6c43cc88c2b7cf47c2d9ab?user_id=b5996a2276d34e2abb9dda476bffe3df" status: 200 len: 240 microversion: 2.36 time: 0.259697 Oct 04 20:34:53.926534 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 202/426] 10.222.0.33 () {62 vars in 1384 bytes} [Tue Oct 4 20:34:53 2022] PUT /compute/v2.1/os-quota-sets/62a770a79a6c43cc88c2b7cf47c2d9ab?user_id=b5996a2276d34e2abb9dda476bffe3df => generated 240 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 20:34:53.937754 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-74c67d5d-ac90-4a18-bba2-a2cd323249de tempest-QuotasAdminTestV236-1235447618 tempest-QuotasAdminTestV236-1235447618-project-admin] Calling method '.version_select at 0x7f3c74f43820>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:54.022529 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-74c67d5d-ac90-4a18-bba2-a2cd323249de tempest-QuotasAdminTestV236-1235447618 tempest-QuotasAdminTestV236-1235447618-project-admin] 10.222.0.33 "GET /compute/v2.1/os-quota-sets/62a770a79a6c43cc88c2b7cf47c2d9ab?user_id=b5996a2276d34e2abb9dda476bffe3df" status: 200 len: 282 microversion: 2.36 time: 0.088363 Oct 04 20:34:54.025377 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 203/427] 10.222.0.33 () {60 vars in 1364 bytes} [Tue Oct 4 20:34:53 2022] GET /compute/v2.1/os-quota-sets/62a770a79a6c43cc88c2b7cf47c2d9ab?user_id=b5996a2276d34e2abb9dda476bffe3df => generated 282 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 20:34:54.030747 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-09d7586e-7863-4376-b984-896d16da4928 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:54.031895 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-09d7586e-7863-4376-b984-896d16da4928 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] [instance: 854066a9-9adf-4932-b6a8-c7fe15d8b4da] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:54.041776 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-09d7586e-7863-4376-b984-896d16da4928 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:54.042277 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-09d7586e-7863-4376-b984-896d16da4928 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:54.042743 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-09d7586e-7863-4376-b984-896d16da4928 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:54.043457 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-09d7586e-7863-4376-b984-896d16da4928 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:54.043915 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-09d7586e-7863-4376-b984-896d16da4928 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:54.044945 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-09d7586e-7863-4376-b984-896d16da4928 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:54.065208 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-f0b67852-65f5-4e6e-86cf-9db840c20b3a tempest-SecurityGroupsTestAdminJSON-377823160 tempest-SecurityGroupsTestAdminJSON-377823160-project-admin] 10.222.0.33 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 0.188553 Oct 04 20:34:54.065813 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 225/428] 10.222.0.33 () {60 vars in 1180 bytes} [Tue Oct 4 20:34:53 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:34:54.080709 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-7555cec5-39b0-4325-b5e3-9b9ca65b97a5 tempest-SecurityGroupsTestAdminJSON-377823160 tempest-SecurityGroupsTestAdminJSON-377823160-project-admin] Calling method '.version_select at 0x7f3c74e7baf0>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:54.256492 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-09d7586e-7863-4376-b984-896d16da4928 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '147d000a331f4a3ba47019fcbae40901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9928be759e34d208d835263d73a5ab5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:54.264488 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-09d7586e-7863-4376-b984-896d16da4928 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] 10.222.0.33 "GET /compute/v2.1/servers/854066a9-9adf-4932-b6a8-c7fe15d8b4da" status: 200 len: 1477 microversion: 2.1 time: 0.237533 Oct 04 20:34:54.269057 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 204/429] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:54 2022] GET /compute/v2.1/servers/854066a9-9adf-4932-b6a8-c7fe15d8b4da => generated 1477 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:54.405642 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-3036d4a0-477d-485e-8121-6af47db3ef1e tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:54.406415 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-3036d4a0-477d-485e-8121-6af47db3ef1e tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] [instance: b8cf32e5-d9cc-4e92-bd81-2c3449406c95] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:54.413020 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3036d4a0-477d-485e-8121-6af47db3ef1e tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:54.413503 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3036d4a0-477d-485e-8121-6af47db3ef1e tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:54.413927 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3036d4a0-477d-485e-8121-6af47db3ef1e tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:54.415705 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3036d4a0-477d-485e-8121-6af47db3ef1e tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:54.416262 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3036d4a0-477d-485e-8121-6af47db3ef1e tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:54.416777 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3036d4a0-477d-485e-8121-6af47db3ef1e tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:54.600809 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-3036d4a0-477d-485e-8121-6af47db3ef1e tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cbd31af13444cda97ba5f8c99d19437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a307499cf44d03a1e9bb61f614f099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:54.609648 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-3036d4a0-477d-485e-8121-6af47db3ef1e tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] 10.222.0.33 "GET /compute/v2.1/servers/b8cf32e5-d9cc-4e92-bd81-2c3449406c95" status: 200 len: 1474 microversion: 2.1 time: 0.208138 Oct 04 20:34:54.622398 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 205/430] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:54 2022] GET /compute/v2.1/servers/b8cf32e5-d9cc-4e92-bd81-2c3449406c95 => generated 1474 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:34:54.683471 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-07059c7f-91b9-42f4-8cf7-aa03d7ede8fd tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:54.684121 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-07059c7f-91b9-42f4-8cf7-aa03d7ede8fd tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] [instance: 486112b2-497b-4039-ac04-b23cf076d470] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:54.691325 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-07059c7f-91b9-42f4-8cf7-aa03d7ede8fd tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:54.691449 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-07059c7f-91b9-42f4-8cf7-aa03d7ede8fd tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:54.691785 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-07059c7f-91b9-42f4-8cf7-aa03d7ede8fd tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:54.692498 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-07059c7f-91b9-42f4-8cf7-aa03d7ede8fd tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:54.692956 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-07059c7f-91b9-42f4-8cf7-aa03d7ede8fd tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:54.693384 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-07059c7f-91b9-42f4-8cf7-aa03d7ede8fd tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:54.698379 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:34:54.928232 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-07059c7f-91b9-42f4-8cf7-aa03d7ede8fd tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f72b5b32ab457aaaa1c1ff7efdce5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ca732ccf4d417ab1f7ba82a9c8c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:54.938180 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-07059c7f-91b9-42f4-8cf7-aa03d7ede8fd tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] 10.222.0.33 "GET /compute/v2.1/servers/486112b2-497b-4039-ac04-b23cf076d470" status: 200 len: 1331 microversion: 2.1 time: 0.260334 Oct 04 20:34:54.944550 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 206/431] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:54 2022] GET /compute/v2.1/servers/486112b2-497b-4039-ac04-b23cf076d470 => generated 1331 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:34:54.950280 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1ca90a5e-1914-47c7-896c-5add883975b9 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:54.950743 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-1ca90a5e-1914-47c7-896c-5add883975b9 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] [instance: 3961b3f4-aea9-4997-85aa-336b3f902533] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:54.957195 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1ca90a5e-1914-47c7-896c-5add883975b9 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:54.957753 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1ca90a5e-1914-47c7-896c-5add883975b9 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:54.958434 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1ca90a5e-1914-47c7-896c-5add883975b9 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:54.959372 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1ca90a5e-1914-47c7-896c-5add883975b9 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:54.960042 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1ca90a5e-1914-47c7-896c-5add883975b9 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:54.960242 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1ca90a5e-1914-47c7-896c-5add883975b9 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:55.678673 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-1ca90a5e-1914-47c7-896c-5add883975b9 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f051a291d59242469f8172a9c474ac89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f0707d756b4ee085a19cccf3ab82c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:55.687066 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-1ca90a5e-1914-47c7-896c-5add883975b9 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] 10.222.0.33 "GET /compute/v2.1/servers/3961b3f4-aea9-4997-85aa-336b3f902533" status: 200 len: 1319 microversion: 2.1 time: 0.741225 Oct 04 20:34:55.687563 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 207/432] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:54 2022] GET /compute/v2.1/servers/3961b3f4-aea9-4997-85aa-336b3f902533 => generated 1319 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:55.692763 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-41cbc812-fd70-43d5-b355-d758d86a3bfd tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:55.694154 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-41cbc812-fd70-43d5-b355-d758d86a3bfd tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] [instance: 9e9f6289-9999-4188-9af1-6cf64a676eee] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:55.702332 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-41cbc812-fd70-43d5-b355-d758d86a3bfd tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:55.702924 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-41cbc812-fd70-43d5-b355-d758d86a3bfd tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:55.703418 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-41cbc812-fd70-43d5-b355-d758d86a3bfd tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:55.704950 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-41cbc812-fd70-43d5-b355-d758d86a3bfd tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:55.706816 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-41cbc812-fd70-43d5-b355-d758d86a3bfd tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:55.707273 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-41cbc812-fd70-43d5-b355-d758d86a3bfd tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:56.146705 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-41cbc812-fd70-43d5-b355-d758d86a3bfd tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3563efe2b8c94931a2a46c4e14811b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3118a5d96843d3bede1ed94bd9717e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:56.155479 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-41cbc812-fd70-43d5-b355-d758d86a3bfd tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] 10.222.0.33 "GET /compute/v2.1/servers/9e9f6289-9999-4188-9af1-6cf64a676eee" status: 200 len: 1477 microversion: 2.1 time: 0.466753 Oct 04 20:34:56.156057 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 208/433] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:55 2022] GET /compute/v2.1/servers/9e9f6289-9999-4188-9af1-6cf64a676eee => generated 1477 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:56.164195 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-cea3beb1-529a-4a57-bda6-47eb16efb736 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:56.166127 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-cea3beb1-529a-4a57-bda6-47eb16efb736 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] [instance: 854066a9-9adf-4932-b6a8-c7fe15d8b4da] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:56.173053 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cea3beb1-529a-4a57-bda6-47eb16efb736 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:56.173756 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cea3beb1-529a-4a57-bda6-47eb16efb736 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:56.174420 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cea3beb1-529a-4a57-bda6-47eb16efb736 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:56.175322 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cea3beb1-529a-4a57-bda6-47eb16efb736 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:56.175930 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cea3beb1-529a-4a57-bda6-47eb16efb736 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:56.176517 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cea3beb1-529a-4a57-bda6-47eb16efb736 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:56.772949 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-cea3beb1-529a-4a57-bda6-47eb16efb736 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '147d000a331f4a3ba47019fcbae40901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9928be759e34d208d835263d73a5ab5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:56.782219 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-cea3beb1-529a-4a57-bda6-47eb16efb736 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] 10.222.0.33 "GET /compute/v2.1/servers/854066a9-9adf-4932-b6a8-c7fe15d8b4da" status: 200 len: 1477 microversion: 2.1 time: 0.624913 Oct 04 20:34:56.783622 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 209/434] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:56 2022] GET /compute/v2.1/servers/854066a9-9adf-4932-b6a8-c7fe15d8b4da => generated 1477 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:56.789502 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-8d957ccb-ae69-40f3-b73f-9437dc154ae9 req-c2c45f01-ff1e-43c5-bcdd-6929db972c48 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "486112b2-497b-4039-ac04-b23cf076d470", "tag": "b97b70cc-e857-429e-ad48-a973b62edd3e"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:34:56.806989 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-8d957ccb-ae69-40f3-b73f-9437dc154ae9 req-c2c45f01-ff1e-43c5-bcdd-6929db972c48 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:56.807917 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-8d957ccb-ae69-40f3-b73f-9437dc154ae9 req-c2c45f01-ff1e-43c5-bcdd-6929db972c48 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:56.808523 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-8d957ccb-ae69-40f3-b73f-9437dc154ae9 req-c2c45f01-ff1e-43c5-bcdd-6929db972c48 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:56.835737 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-8d957ccb-ae69-40f3-b73f-9437dc154ae9 req-c2c45f01-ff1e-43c5-bcdd-6929db972c48 service nova] Creating event network-changed:b97b70cc-e857-429e-ad48-a973b62edd3e for instance 486112b2-497b-4039-ac04-b23cf076d470 on n-h1-854823-8 Oct 04 20:34:56.843904 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-8d957ccb-ae69-40f3-b73f-9437dc154ae9 req-c2c45f01-ff1e-43c5-bcdd-6929db972c48 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058837 Oct 04 20:34:56.845134 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 210/435] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:34:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:34:56.854857 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-691b8470-6512-41c6-8aee-079361b15c8e tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:56.855983 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-691b8470-6512-41c6-8aee-079361b15c8e tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] [instance: b8cf32e5-d9cc-4e92-bd81-2c3449406c95] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:56.863714 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-691b8470-6512-41c6-8aee-079361b15c8e tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:56.864433 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-691b8470-6512-41c6-8aee-079361b15c8e tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:56.865225 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-691b8470-6512-41c6-8aee-079361b15c8e tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:56.866134 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-691b8470-6512-41c6-8aee-079361b15c8e tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:56.866824 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-691b8470-6512-41c6-8aee-079361b15c8e tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:56.867585 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-691b8470-6512-41c6-8aee-079361b15c8e tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:57.040095 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-691b8470-6512-41c6-8aee-079361b15c8e tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cbd31af13444cda97ba5f8c99d19437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a307499cf44d03a1e9bb61f614f099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:57.048721 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-691b8470-6512-41c6-8aee-079361b15c8e tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] 10.222.0.33 "GET /compute/v2.1/servers/b8cf32e5-d9cc-4e92-bd81-2c3449406c95" status: 200 len: 1432 microversion: 2.1 time: 0.202242 Oct 04 20:34:57.049308 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 211/436] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:56 2022] GET /compute/v2.1/servers/b8cf32e5-d9cc-4e92-bd81-2c3449406c95 => generated 1432 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:57.069732 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e7e90ee8-1e85-41f2-b4d8-8599be48a763 tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:57.070586 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e7e90ee8-1e85-41f2-b4d8-8599be48a763 tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] [instance: 486112b2-497b-4039-ac04-b23cf076d470] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:57.089042 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e7e90ee8-1e85-41f2-b4d8-8599be48a763 tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:57.089552 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e7e90ee8-1e85-41f2-b4d8-8599be48a763 tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:57.089991 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e7e90ee8-1e85-41f2-b4d8-8599be48a763 tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:57.092639 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e7e90ee8-1e85-41f2-b4d8-8599be48a763 tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:57.095498 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e7e90ee8-1e85-41f2-b4d8-8599be48a763 tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:57.096006 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e7e90ee8-1e85-41f2-b4d8-8599be48a763 tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:57.436991 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e7e90ee8-1e85-41f2-b4d8-8599be48a763 tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f72b5b32ab457aaaa1c1ff7efdce5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ca732ccf4d417ab1f7ba82a9c8c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:57.449625 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e7e90ee8-1e85-41f2-b4d8-8599be48a763 tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] 10.222.0.33 "GET /compute/v2.1/servers/486112b2-497b-4039-ac04-b23cf076d470" status: 200 len: 1331 microversion: 2.1 time: 0.394254 Oct 04 20:34:57.456688 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 212/437] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:57 2022] GET /compute/v2.1/servers/486112b2-497b-4039-ac04-b23cf076d470 => generated 1331 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:57.480517 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2e752963-5de0-43c8-89a0-2d84f5299ed6 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:57.481542 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-2e752963-5de0-43c8-89a0-2d84f5299ed6 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] [instance: 3961b3f4-aea9-4997-85aa-336b3f902533] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:57.490302 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2e752963-5de0-43c8-89a0-2d84f5299ed6 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:57.490955 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2e752963-5de0-43c8-89a0-2d84f5299ed6 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:57.491393 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2e752963-5de0-43c8-89a0-2d84f5299ed6 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:57.493503 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2e752963-5de0-43c8-89a0-2d84f5299ed6 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:57.494470 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2e752963-5de0-43c8-89a0-2d84f5299ed6 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:57.495063 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2e752963-5de0-43c8-89a0-2d84f5299ed6 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:57.936617 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-2e752963-5de0-43c8-89a0-2d84f5299ed6 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f051a291d59242469f8172a9c474ac89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f0707d756b4ee085a19cccf3ab82c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:57.948415 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-2e752963-5de0-43c8-89a0-2d84f5299ed6 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] 10.222.0.33 "GET /compute/v2.1/servers/3961b3f4-aea9-4997-85aa-336b3f902533" status: 200 len: 1319 microversion: 2.1 time: 0.477329 Oct 04 20:34:57.965721 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 213/438] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:57 2022] GET /compute/v2.1/servers/3961b3f4-aea9-4997-85aa-336b3f902533 => generated 1319 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:57.987395 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-bd1ce04a-6c51-4cac-b3a0-166ce1ca678c req-00fee344-8b11-4626-8d7e-8c59c4d1bba2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8cf32e5-d9cc-4e92-bd81-2c3449406c95", "name": "network-vif-deleted", "tag": "f596121d-68e0-4a9f-b140-59dcfd3b23d4"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:34:58.040926 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-bd1ce04a-6c51-4cac-b3a0-166ce1ca678c req-00fee344-8b11-4626-8d7e-8c59c4d1bba2 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:58.041916 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-bd1ce04a-6c51-4cac-b3a0-166ce1ca678c req-00fee344-8b11-4626-8d7e-8c59c4d1bba2 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:58.042770 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-bd1ce04a-6c51-4cac-b3a0-166ce1ca678c req-00fee344-8b11-4626-8d7e-8c59c4d1bba2 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:58.059316 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-bd1ce04a-6c51-4cac-b3a0-166ce1ca678c req-00fee344-8b11-4626-8d7e-8c59c4d1bba2 service nova] Creating event network-vif-deleted:f596121d-68e0-4a9f-b140-59dcfd3b23d4 for instance b8cf32e5-d9cc-4e92-bd81-2c3449406c95 on n-h2-854823-8 Oct 04 20:34:58.065672 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-bd1ce04a-6c51-4cac-b3a0-166ce1ca678c req-00fee344-8b11-4626-8d7e-8c59c4d1bba2 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094554 Oct 04 20:34:58.067193 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 214/439] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:34:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:34:58.080741 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-aa0e6973-6513-48ad-bd47-19991269f97e tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:58.081701 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-aa0e6973-6513-48ad-bd47-19991269f97e tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] [instance: 9e9f6289-9999-4188-9af1-6cf64a676eee] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:58.094626 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-aa0e6973-6513-48ad-bd47-19991269f97e tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:58.095343 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-aa0e6973-6513-48ad-bd47-19991269f97e tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:58.096006 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-aa0e6973-6513-48ad-bd47-19991269f97e tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:58.097005 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-aa0e6973-6513-48ad-bd47-19991269f97e tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:58.097845 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-aa0e6973-6513-48ad-bd47-19991269f97e tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:58.098516 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-aa0e6973-6513-48ad-bd47-19991269f97e tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:58.487903 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-aa0e6973-6513-48ad-bd47-19991269f97e tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3563efe2b8c94931a2a46c4e14811b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3118a5d96843d3bede1ed94bd9717e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:58.525763 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-aa0e6973-6513-48ad-bd47-19991269f97e tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] 10.222.0.33 "GET /compute/v2.1/servers/9e9f6289-9999-4188-9af1-6cf64a676eee" status: 200 len: 1476 microversion: 2.1 time: 0.454741 Oct 04 20:34:58.526901 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 215/440] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:58 2022] GET /compute/v2.1/servers/9e9f6289-9999-4188-9af1-6cf64a676eee => generated 1476 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:58.543820 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b1caa76b-4347-4295-ad5c-993d10a4a0a3 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:58.546484 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b1caa76b-4347-4295-ad5c-993d10a4a0a3 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] [instance: 854066a9-9adf-4932-b6a8-c7fe15d8b4da] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:58.561752 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b1caa76b-4347-4295-ad5c-993d10a4a0a3 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:58.562639 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b1caa76b-4347-4295-ad5c-993d10a4a0a3 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:58.563242 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b1caa76b-4347-4295-ad5c-993d10a4a0a3 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:58.565731 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b1caa76b-4347-4295-ad5c-993d10a4a0a3 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:58.566474 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b1caa76b-4347-4295-ad5c-993d10a4a0a3 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:58.568403 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b1caa76b-4347-4295-ad5c-993d10a4a0a3 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:58.636180 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b1caa76b-4347-4295-ad5c-993d10a4a0a3 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:58.637283 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b1caa76b-4347-4295-ad5c-993d10a4a0a3 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:58.638166 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b1caa76b-4347-4295-ad5c-993d10a4a0a3 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:58.638798 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-b1caa76b-4347-4295-ad5c-993d10a4a0a3 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Lazy-loading 'fault' on Instance uuid 854066a9-9adf-4932-b6a8-c7fe15d8b4da {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:34:58.709847 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-b1caa76b-4347-4295-ad5c-993d10a4a0a3 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '147d000a331f4a3ba47019fcbae40901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9928be759e34d208d835263d73a5ab5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:58.720450 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b1caa76b-4347-4295-ad5c-993d10a4a0a3 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] 10.222.0.33 "GET /compute/v2.1/servers/854066a9-9adf-4932-b6a8-c7fe15d8b4da" status: 200 len: 1311 microversion: 2.1 time: 0.189809 Oct 04 20:34:58.721455 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 216/441] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:58 2022] GET /compute/v2.1/servers/854066a9-9adf-4932-b6a8-c7fe15d8b4da => generated 1311 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:58.730726 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-90e73745-6060-4a13-af8d-ffcaddb84e3e tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:58.735902 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-90e73745-6060-4a13-af8d-ffcaddb84e3e tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] [instance: b8cf32e5-d9cc-4e92-bd81-2c3449406c95] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:58.746488 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-90e73745-6060-4a13-af8d-ffcaddb84e3e tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:58.749184 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-90e73745-6060-4a13-af8d-ffcaddb84e3e tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:58.749847 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-90e73745-6060-4a13-af8d-ffcaddb84e3e tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:58.750997 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-90e73745-6060-4a13-af8d-ffcaddb84e3e tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:58.754591 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-90e73745-6060-4a13-af8d-ffcaddb84e3e tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:58.755319 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-90e73745-6060-4a13-af8d-ffcaddb84e3e tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:58.802147 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-90e73745-6060-4a13-af8d-ffcaddb84e3e tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] HTTP exception thrown: Instance b8cf32e5-d9cc-4e92-bd81-2c3449406c95 could not be found. Oct 04 20:34:58.803982 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-90e73745-6060-4a13-af8d-ffcaddb84e3e tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Request method failure captured: Oct 04 20:34:58.803982 n-d-854823-8 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/b8cf32e5-d9cc-4e92-bd81-2c3449406c95 HTTP/1.1 Oct 04 20:34:58.803982 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:34:58.803982 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:34:58.803982 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:34:58.803982 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 0 Oct 04 20:34:58.803982 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:34:58.803982 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:34:58.803982 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:34:58.803982 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:34:58.803982 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJjWIa7W9QknWsaey-fCdR6Ih2cpvm1BeCjFGNfwWVocUF4xoE9dgg-X9_kMgOXOC52EiNgJAgUE_Nhfd5pK9mUE_qbSTDl_fqZZyRlt2yi4hkA43q0DeqZFC3W-KtBmUQyQPM4nO2v3hsP0wSLtlD1iifBpZyPjP88JQpmcEakiB0g Oct 04 20:34:58.803982 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:34:58.803982 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:34:58.803982 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:34:58.803982 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:34:58.803982 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:34:58.803982 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:34:58.803982 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: 16a307499cf44d03a1e9bb61f614f099 Oct 04 20:34:58.803982 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-DeleteServersAdminTestJSON-591228109 Oct 04 20:34:58.803982 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 20:34:58.803982 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 20:34:58.805660 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_16a307499cf44d03a1e9bb61f614f099", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/16a307499cf44d03a1e9bb61f614f099"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/16a307499cf44d03a1e9bb61f614f099"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/16a307499cf44d03a1e9bb61f614f099"}]}] Oct 04 20:34:58.805660 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-DeleteServersAdminTestJSON-591228109 Oct 04 20:34:58.805660 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: 16a307499cf44d03a1e9bb61f614f099 Oct 04 20:34:58.805660 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-591228109 Oct 04 20:34:58.805660 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-DeleteServersAdminTestJSON-591228109-project Oct 04 20:34:58.805660 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:34:58.805660 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:34:58.805660 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: 5cbd31af13444cda97ba5f8c99d19437 Oct 04 20:34:58.805660 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-DeleteServersAdminTestJSON-591228109-project Oct 04 20:34:58.805660 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 20:34:58.805660 n-d-854823-8 devstack@n-api.service[128801]: exception: Instance b8cf32e5-d9cc-4e92-bd81-2c3449406c95 could not be found. Oct 04 20:34:58.805660 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': 'b8cf32e5-d9cc-4e92-bd81-2c3449406c95'} Oct 04 20:34:58.806522 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:34:58.806522 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:34:58.806522 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:34:58.806522 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:34:58.806522 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:34:58.806522 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:34:58.806522 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:34:58.806522 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:34:58.806522 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:34:58.806522 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:34:58.806522 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b8cf32e5-d9cc-4e92-bd81-2c3449406c95 could not be found. Oct 04 20:34:58.806522 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:34:58.806522 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:34:58.806522 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:34:58.806522 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:34:58.806522 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:34:58.806522 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:34:58.806522 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:34:58.806522 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:34:58.806522 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:34:58.807724 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:34:58.807724 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:34:58.807724 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:34:58.807724 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:34:58.807724 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:34:58.807724 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:34:58.807724 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:34:58.807724 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b8cf32e5-d9cc-4e92-bd81-2c3449406c95 could not be found. Oct 04 20:34:58.807724 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:34:58.807724 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:34:58.807724 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:34:58.807724 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:34:58.807724 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:34:58.807724 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:34:58.807724 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:34:58.807724 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:34:58.807724 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b8cf32e5-d9cc-4e92-bd81-2c3449406c95 could not be found. Oct 04 20:34:58.807724 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:34:58.808642 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-90e73745-6060-4a13-af8d-ffcaddb84e3e tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Returning 404 to user: Instance b8cf32e5-d9cc-4e92-bd81-2c3449406c95 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:34:58.811759 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-90e73745-6060-4a13-af8d-ffcaddb84e3e tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] 10.222.0.33 "GET /compute/v2.1/servers/b8cf32e5-d9cc-4e92-bd81-2c3449406c95" status: 404 len: 111 microversion: 2.1 time: 0.085573 Oct 04 20:34:58.813308 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 217/442] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:58 2022] GET /compute/v2.1/servers/b8cf32e5-d9cc-4e92-bd81-2c3449406c95 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:34:58.824443 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1b98b146-402b-4119-bc40-d84c3150c622 tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:58.827611 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-1b98b146-402b-4119-bc40-d84c3150c622 tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] [instance: 486112b2-497b-4039-ac04-b23cf076d470] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:58.842549 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1b98b146-402b-4119-bc40-d84c3150c622 tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:58.845945 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1b98b146-402b-4119-bc40-d84c3150c622 tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:58.846578 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1b98b146-402b-4119-bc40-d84c3150c622 tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:58.847462 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1b98b146-402b-4119-bc40-d84c3150c622 tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:58.848030 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1b98b146-402b-4119-bc40-d84c3150c622 tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:58.857184 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1b98b146-402b-4119-bc40-d84c3150c622 tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:59.160603 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-1b98b146-402b-4119-bc40-d84c3150c622 tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f72b5b32ab457aaaa1c1ff7efdce5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ca732ccf4d417ab1f7ba82a9c8c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:34:59.172327 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-1b98b146-402b-4119-bc40-d84c3150c622 tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] 10.222.0.33 "GET /compute/v2.1/servers/486112b2-497b-4039-ac04-b23cf076d470" status: 200 len: 1331 microversion: 2.1 time: 0.357826 Oct 04 20:34:59.184096 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 218/443] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:58 2022] GET /compute/v2.1/servers/486112b2-497b-4039-ac04-b23cf076d470 => generated 1331 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:34:59.197498 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-c64794ff-1351-413f-8e00-c7be7316047d req-2a54ca09-edef-4e68-a40e-db247c2ff603 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e9f6289-9999-4188-9af1-6cf64a676eee", "name": "network-vif-unplugged", "status": "completed", "tag": "adebf0e2-e917-4865-9fef-2062cd63bdc7"}, {"name": "network-changed", "server_uuid": "9e9f6289-9999-4188-9af1-6cf64a676eee", "tag": "adebf0e2-e917-4865-9fef-2062cd63bdc7"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:34:59.211165 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-c64794ff-1351-413f-8e00-c7be7316047d req-2a54ca09-edef-4e68-a40e-db247c2ff603 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:59.211957 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-c64794ff-1351-413f-8e00-c7be7316047d req-2a54ca09-edef-4e68-a40e-db247c2ff603 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:59.212752 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-c64794ff-1351-413f-8e00-c7be7316047d req-2a54ca09-edef-4e68-a40e-db247c2ff603 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:59.245566 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-c64794ff-1351-413f-8e00-c7be7316047d req-2a54ca09-edef-4e68-a40e-db247c2ff603 service nova] Creating event network-vif-unplugged:adebf0e2-e917-4865-9fef-2062cd63bdc7 for instance 9e9f6289-9999-4188-9af1-6cf64a676eee on n-h2-854823-8 Oct 04 20:34:59.246587 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-c64794ff-1351-413f-8e00-c7be7316047d req-2a54ca09-edef-4e68-a40e-db247c2ff603 service nova] Creating event network-changed:adebf0e2-e917-4865-9fef-2062cd63bdc7 for instance 9e9f6289-9999-4188-9af1-6cf64a676eee on n-h2-854823-8 Oct 04 20:34:59.267964 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [req-c64794ff-1351-413f-8e00-c7be7316047d req-2a54ca09-edef-4e68-a40e-db247c2ff603 service nova] Instance 9e9f6289-9999-4188-9af1-6cf64a676eee is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854823-8', 'n-h2-854823-8'} {{(pid=128801) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 20:34:59.280762 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-c64794ff-1351-413f-8e00-c7be7316047d req-2a54ca09-edef-4e68-a40e-db247c2ff603 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.095107 Oct 04 20:34:59.281616 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 219/444] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:34:59 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:34:59.287773 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-65f792d8-be3b-4011-9425-d54b91f5ea9f tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-2084770736", "imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63", "flavorRef": "452"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:34:59.382826 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.network.neutron [None req-65f792d8-be3b-4011-9425-d54b91f5ea9f tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] validate_networks() for None {{(pid=128801) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:34:59.417956 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-7555cec5-39b0-4325-b5e3-9b9ca65b97a5 tempest-SecurityGroupsTestAdminJSON-377823160 tempest-SecurityGroupsTestAdminJSON-377823160-project-admin] 10.222.0.33 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 11054 microversion: 2.1 time: 5.342857 Oct 04 20:34:59.419216 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 226/445] 10.222.0.33 () {58 vars in 1191 bytes} [Tue Oct 4 20:34:54 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 11054 bytes in 5345 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 04 20:34:59.424584 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-6c022719-04e7-45f5-b40e-9f0abf73684c tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:34:59.425244 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-6c022719-04e7-45f5-b40e-9f0abf73684c tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] [instance: 3961b3f4-aea9-4997-85aa-336b3f902533] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:34:59.461278 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6c022719-04e7-45f5-b40e-9f0abf73684c tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:59.461935 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6c022719-04e7-45f5-b40e-9f0abf73684c tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:59.462428 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6c022719-04e7-45f5-b40e-9f0abf73684c tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:59.466092 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6c022719-04e7-45f5-b40e-9f0abf73684c tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:34:59.466755 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6c022719-04e7-45f5-b40e-9f0abf73684c tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:34:59.467506 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6c022719-04e7-45f5-b40e-9f0abf73684c tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:34:59.518442 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:35:00.032897 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-6c022719-04e7-45f5-b40e-9f0abf73684c tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f051a291d59242469f8172a9c474ac89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f0707d756b4ee085a19cccf3ab82c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:00.041508 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-6c022719-04e7-45f5-b40e-9f0abf73684c tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] 10.222.0.33 "GET /compute/v2.1/servers/3961b3f4-aea9-4997-85aa-336b3f902533" status: 200 len: 1319 microversion: 2.1 time: 0.621292 Oct 04 20:35:00.042199 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 227/446] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:34:59 2022] GET /compute/v2.1/servers/3961b3f4-aea9-4997-85aa-336b3f902533 => generated 1319 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:00.046550 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-8d61d758-4898-42e7-a6d3-145c5e7b18aa tempest-SecurityGroupsTestAdminJSON-1439866220 tempest-SecurityGroupsTestAdminJSON-1439866220-project] Calling method '.version_select at 0x7f3c74edd9d0>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:00.121205 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-65f792d8-be3b-4011-9425-d54b91f5ea9f tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Flavor limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:35:00.121712 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-65f792d8-be3b-4011-9425-d54b91f5ea9f tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Image limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:35:00.122088 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-65f792d8-be3b-4011-9425-d54b91f5ea9f tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Flavor pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:35:00.122538 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-65f792d8-be3b-4011-9425-d54b91f5ea9f tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Image pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:35:00.122950 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-65f792d8-be3b-4011-9425-d54b91f5ea9f tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:35:00.129921 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=53 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:35:00.132834 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-65f792d8-be3b-4011-9425-d54b91f5ea9f tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:00.133833 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-65f792d8-be3b-4011-9425-d54b91f5ea9f tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:00.134269 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-65f792d8-be3b-4011-9425-d54b91f5ea9f tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:00.135079 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-65f792d8-be3b-4011-9425-d54b91f5ea9f tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:00.135537 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-65f792d8-be3b-4011-9425-d54b91f5ea9f tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:00.135964 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-65f792d8-be3b-4011-9425-d54b91f5ea9f tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:00.155030 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-65f792d8-be3b-4011-9425-d54b91f5ea9f tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Getting quotas for project 16a307499cf44d03a1e9bb61f614f099. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:35:00.159062 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-65f792d8-be3b-4011-9425-d54b91f5ea9f tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Getting quotas for user 5cbd31af13444cda97ba5f8c99d19437 and project 16a307499cf44d03a1e9bb61f614f099. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:35:00.171275 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-65f792d8-be3b-4011-9425-d54b91f5ea9f tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Going to run 1 instances... {{(pid=128801) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:35:00.173901 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-65f792d8-be3b-4011-9425-d54b91f5ea9f tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] [instance: 2457c5d1-8842-4a2d-a5d4-fe97b53b64df] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='15b24725-0c99-4bcf-b1fb-907cdf8e2d63',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128801) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:35:00.185239 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:35:00.222418 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-65f792d8-be3b-4011-9425-d54b91f5ea9f tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.939286 Oct 04 20:35:00.229691 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 220/447] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 20:34:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 941 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 20:35:00.229691 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6322e520-ab54-4544-8618-4f76195ab790 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:00.229691 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-6322e520-ab54-4544-8618-4f76195ab790 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] [instance: 9e9f6289-9999-4188-9af1-6cf64a676eee] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:00.235367 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6322e520-ab54-4544-8618-4f76195ab790 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:00.235879 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6322e520-ab54-4544-8618-4f76195ab790 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:00.236309 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6322e520-ab54-4544-8618-4f76195ab790 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:00.237211 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6322e520-ab54-4544-8618-4f76195ab790 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:00.237658 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6322e520-ab54-4544-8618-4f76195ab790 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:00.238074 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6322e520-ab54-4544-8618-4f76195ab790 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:00.488107 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-8d61d758-4898-42e7-a6d3-145c5e7b18aa tempest-SecurityGroupsTestAdminJSON-1439866220 tempest-SecurityGroupsTestAdminJSON-1439866220-project] 10.222.0.33 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 1110 microversion: 2.1 time: 0.444834 Oct 04 20:35:00.488697 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 228/448] 10.222.0.33 () {58 vars in 1191 bytes} [Tue Oct 4 20:35:00 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 1110 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:00.495914 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-aff31a2f-33de-4332-a904-cc34d29e31e7 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:00.496842 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-aff31a2f-33de-4332-a904-cc34d29e31e7 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] [instance: 854066a9-9adf-4932-b6a8-c7fe15d8b4da] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:00.497465 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-6322e520-ab54-4544-8618-4f76195ab790 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3563efe2b8c94931a2a46c4e14811b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3118a5d96843d3bede1ed94bd9717e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:00.508880 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-6322e520-ab54-4544-8618-4f76195ab790 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] 10.222.0.33 "GET /compute/v2.1/servers/9e9f6289-9999-4188-9af1-6cf64a676eee" status: 200 len: 1474 microversion: 2.1 time: 0.284764 Oct 04 20:35:00.510747 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 221/449] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:00 2022] GET /compute/v2.1/servers/9e9f6289-9999-4188-9af1-6cf64a676eee => generated 1474 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:00.521237 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-aff31a2f-33de-4332-a904-cc34d29e31e7 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:00.522029 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-aff31a2f-33de-4332-a904-cc34d29e31e7 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:00.522737 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-aff31a2f-33de-4332-a904-cc34d29e31e7 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:00.524354 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-aff31a2f-33de-4332-a904-cc34d29e31e7 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:00.525967 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-aff31a2f-33de-4332-a904-cc34d29e31e7 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:00.527732 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-aff31a2f-33de-4332-a904-cc34d29e31e7 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:00.546372 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.wsgi [None req-aff31a2f-33de-4332-a904-cc34d29e31e7 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] HTTP exception thrown: Instance 854066a9-9adf-4932-b6a8-c7fe15d8b4da could not be found. Oct 04 20:35:00.552039 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-aff31a2f-33de-4332-a904-cc34d29e31e7 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Request method failure captured: Oct 04 20:35:00.552039 n-d-854823-8 devstack@n-api.service[128802]: request: GET /compute/v2.1/servers/854066a9-9adf-4932-b6a8-c7fe15d8b4da HTTP/1.1 Oct 04 20:35:00.552039 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 20:35:00.552039 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 20:35:00.552039 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 20:35:00.552039 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 0 Oct 04 20:35:00.552039 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 20:35:00.552039 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 20:35:00.552039 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 20:35:00.552039 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 20:35:00.552039 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPJi6yhEgbYlr8WNBKldr31E_-QrHfL8ZtpmzvGoWM82dco0Xq3iTLqHp4bMHvKbdFZ1VjfiTyA3bolwTe09jAeXY0T2iJTHIzsFtQZ96Xj96-YLwQ_QUdpvlfr9s6QxwciquHtvq7H6tvPffv38-Ou4ANUy33PWj1gynHKZ2zE26dxM Oct 04 20:35:00.552039 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 20:35:00.552039 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 20:35:00.552039 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 20:35:00.552039 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 20:35:00.552039 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 20:35:00.552039 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 20:35:00.552039 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: b9928be759e34d208d835263d73a5ab5 Oct 04 20:35:00.552039 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-641399923 Oct 04 20:35:00.552039 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 20:35:00.552039 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 20:35:00.553602 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b9928be759e34d208d835263d73a5ab5", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b9928be759e34d208d835263d73a5ab5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b9928be759e34d208d835263d73a5ab5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b9928be759e34d208d835263d73a5ab5"}]}] Oct 04 20:35:00.553602 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-ServersAdminNegativeTestJSON-641399923 Oct 04 20:35:00.553602 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: b9928be759e34d208d835263d73a5ab5 Oct 04 20:35:00.553602 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-641399923 Oct 04 20:35:00.553602 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-ServersAdminNegativeTestJSON-641399923-project Oct 04 20:35:00.553602 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 20:35:00.553602 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 20:35:00.553602 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: 147d000a331f4a3ba47019fcbae40901 Oct 04 20:35:00.553602 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-ServersAdminNegativeTestJSON-641399923-project Oct 04 20:35:00.553602 n-d-854823-8 devstack@n-api.service[128802]: method: > Oct 04 20:35:00.553602 n-d-854823-8 devstack@n-api.service[128802]: exception: Instance 854066a9-9adf-4932-b6a8-c7fe15d8b4da could not be found. Oct 04 20:35:00.553602 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'id': '854066a9-9adf-4932-b6a8-c7fe15d8b4da'} Oct 04 20:35:00.554473 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:35:00.554473 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:35:00.554473 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:35:00.554473 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:35:00.554473 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:35:00.554473 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:35:00.554473 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:35:00.554473 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:35:00.554473 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:35:00.554473 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:35:00.554473 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 854066a9-9adf-4932-b6a8-c7fe15d8b4da could not be found. Oct 04 20:35:00.554473 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:35:00.554473 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:35:00.554473 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:35:00.554473 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:35:00.554473 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:35:00.554473 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:35:00.554473 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:35:00.554473 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:35:00.554473 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:35:00.556394 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:35:00.556394 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:35:00.556394 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:35:00.556394 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:35:00.556394 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:35:00.556394 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:35:00.556394 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:35:00.556394 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 854066a9-9adf-4932-b6a8-c7fe15d8b4da could not be found. Oct 04 20:35:00.556394 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:35:00.556394 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:35:00.556394 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:35:00.556394 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:35:00.556394 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:35:00.556394 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:35:00.556394 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:35:00.556394 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:35:00.556394 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 854066a9-9adf-4932-b6a8-c7fe15d8b4da could not be found. Oct 04 20:35:00.556394 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:35:00.557599 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-aff31a2f-33de-4332-a904-cc34d29e31e7 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] Returning 404 to user: Instance 854066a9-9adf-4932-b6a8-c7fe15d8b4da could not be found. {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:35:00.558229 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-aff31a2f-33de-4332-a904-cc34d29e31e7 tempest-ServersAdminNegativeTestJSON-641399923 tempest-ServersAdminNegativeTestJSON-641399923-project] 10.222.0.33 "GET /compute/v2.1/servers/854066a9-9adf-4932-b6a8-c7fe15d8b4da" status: 404 len: 111 microversion: 2.1 time: 0.066931 Oct 04 20:35:00.559211 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 229/450] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:00 2022] GET /compute/v2.1/servers/854066a9-9adf-4932-b6a8-c7fe15d8b4da => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:35:00.573900 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-a371f68f-53e3-4bb2-b4ae-b33c8965c16b req-14d086ca-0aae-4fcc-aeb1-c7d2b3213c64 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "854066a9-9adf-4932-b6a8-c7fe15d8b4da", "name": "network-vif-deleted", "tag": "625db1ef-3c70-4d5f-9bbc-444eb15b7d8c"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:35:00.602652 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-a371f68f-53e3-4bb2-b4ae-b33c8965c16b req-14d086ca-0aae-4fcc-aeb1-c7d2b3213c64 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:00.605010 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-a371f68f-53e3-4bb2-b4ae-b33c8965c16b req-14d086ca-0aae-4fcc-aeb1-c7d2b3213c64 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:00.605877 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-a371f68f-53e3-4bb2-b4ae-b33c8965c16b req-14d086ca-0aae-4fcc-aeb1-c7d2b3213c64 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:00.629878 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-a371f68f-53e3-4bb2-b4ae-b33c8965c16b req-14d086ca-0aae-4fcc-aeb1-c7d2b3213c64 service nova] Creating event network-vif-deleted:625db1ef-3c70-4d5f-9bbc-444eb15b7d8c for instance 854066a9-9adf-4932-b6a8-c7fe15d8b4da on n-h2-854823-8 Oct 04 20:35:00.638114 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-a371f68f-53e3-4bb2-b4ae-b33c8965c16b req-14d086ca-0aae-4fcc-aeb1-c7d2b3213c64 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077508 Oct 04 20:35:00.639102 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 230/451] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:35:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:35:00.649405 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-aa8f0894-fb89-4e0d-8699-8adace5c9ff4 tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:00.651584 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-aa8f0894-fb89-4e0d-8699-8adace5c9ff4 tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] [instance: 486112b2-497b-4039-ac04-b23cf076d470] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:00.671027 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-aa8f0894-fb89-4e0d-8699-8adace5c9ff4 tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:00.671684 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-aa8f0894-fb89-4e0d-8699-8adace5c9ff4 tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:00.672216 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-aa8f0894-fb89-4e0d-8699-8adace5c9ff4 tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:00.674557 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-aa8f0894-fb89-4e0d-8699-8adace5c9ff4 tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:00.675287 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-aa8f0894-fb89-4e0d-8699-8adace5c9ff4 tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:00.677127 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-aa8f0894-fb89-4e0d-8699-8adace5c9ff4 tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:00.763415 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-878e5aef-bd23-4891-9240-0ba4bf89fc5f tempest-ServicesAdminTestJSON-1694087618 tempest-ServicesAdminTestJSON-1694087618-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:00.769619 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-878e5aef-bd23-4891-9240-0ba4bf89fc5f tempest-ServicesAdminTestJSON-1694087618 tempest-ServicesAdminTestJSON-1694087618-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:00.771227 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-878e5aef-bd23-4891-9240-0ba4bf89fc5f tempest-ServicesAdminTestJSON-1694087618 tempest-ServicesAdminTestJSON-1694087618-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:00.772225 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-878e5aef-bd23-4891-9240-0ba4bf89fc5f tempest-ServicesAdminTestJSON-1694087618 tempest-ServicesAdminTestJSON-1694087618-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:00.774195 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-878e5aef-bd23-4891-9240-0ba4bf89fc5f tempest-ServicesAdminTestJSON-1694087618 tempest-ServicesAdminTestJSON-1694087618-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:00.774922 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-878e5aef-bd23-4891-9240-0ba4bf89fc5f tempest-ServicesAdminTestJSON-1694087618 tempest-ServicesAdminTestJSON-1694087618-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:00.775438 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-878e5aef-bd23-4891-9240-0ba4bf89fc5f tempest-ServicesAdminTestJSON-1694087618 tempest-ServicesAdminTestJSON-1694087618-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:00.806379 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell0:SELECT=2 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:35:00.819381 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-878e5aef-bd23-4891-9240-0ba4bf89fc5f tempest-ServicesAdminTestJSON-1694087618 tempest-ServicesAdminTestJSON-1694087618-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.306276 Oct 04 20:35:00.820964 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 222/452] 10.222.0.33 () {58 vars in 1137 bytes} [Tue Oct 4 20:35:00 2022] GET /compute/v2.1/os-services => generated 944 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:35:00.825920 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ded70f92-8499-46ec-aea6-a37ed2c63825 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:00.826690 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ded70f92-8499-46ec-aea6-a37ed2c63825 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] [instance: 2457c5d1-8842-4a2d-a5d4-fe97b53b64df] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:00.870753 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell0:SELECT=8 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:35:00.937301 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-ded70f92-8499-46ec-aea6-a37ed2c63825 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cbd31af13444cda97ba5f8c99d19437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a307499cf44d03a1e9bb61f614f099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:00.944258 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ded70f92-8499-46ec-aea6-a37ed2c63825 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] 10.222.0.33 "GET /compute/v2.1/servers/2457c5d1-8842-4a2d-a5d4-fe97b53b64df" status: 200 len: 1220 microversion: 2.1 time: 0.121871 Oct 04 20:35:00.958466 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 223/453] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:00 2022] GET /compute/v2.1/servers/2457c5d1-8842-4a2d-a5d4-fe97b53b64df => generated 1220 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:00.958466 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d586b03c-5cc5-4168-9d76-b69d23965a3a tempest-SecurityGroupsTestAdminJSON-377823160 tempest-SecurityGroupsTestAdminJSON-377823160-project-admin] Calling method '.version_select at 0x7f3c74cbd940>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:01.027303 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-aa8f0894-fb89-4e0d-8699-8adace5c9ff4 tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f72b5b32ab457aaaa1c1ff7efdce5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ca732ccf4d417ab1f7ba82a9c8c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:01.035483 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-aa8f0894-fb89-4e0d-8699-8adace5c9ff4 tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] 10.222.0.33 "GET /compute/v2.1/servers/486112b2-497b-4039-ac04-b23cf076d470" status: 200 len: 1331 microversion: 2.1 time: 0.394589 Oct 04 20:35:01.036162 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 231/454] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:00 2022] GET /compute/v2.1/servers/486112b2-497b-4039-ac04-b23cf076d470 => generated 1331 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:01.041367 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-a738c1c5-37c5-4d01-a1bc-29384423dac5 req-9358442f-d522-4314-910b-45669d9eea97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3961b3f4-aea9-4997-85aa-336b3f902533", "name": "network-vif-plugged", "status": "completed", "tag": "6e9e362a-05ec-422d-9902-e146dc60ea86"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:35:01.050817 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-a738c1c5-37c5-4d01-a1bc-29384423dac5 req-9358442f-d522-4314-910b-45669d9eea97 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:01.051415 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-a738c1c5-37c5-4d01-a1bc-29384423dac5 req-9358442f-d522-4314-910b-45669d9eea97 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:01.051933 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-a738c1c5-37c5-4d01-a1bc-29384423dac5 req-9358442f-d522-4314-910b-45669d9eea97 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:01.064443 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-a738c1c5-37c5-4d01-a1bc-29384423dac5 req-9358442f-d522-4314-910b-45669d9eea97 service nova] Creating event network-vif-plugged:6e9e362a-05ec-422d-9902-e146dc60ea86 for instance 3961b3f4-aea9-4997-85aa-336b3f902533 on n-h1-854823-8 Oct 04 20:35:01.069773 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-a738c1c5-37c5-4d01-a1bc-29384423dac5 req-9358442f-d522-4314-910b-45669d9eea97 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032238 Oct 04 20:35:01.070685 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 232/455] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:35:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:35:01.075723 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-24744b02-cb66-4711-9f6d-7f36330fa86b tempest-ServicesAdminTestJSON-1694087618 tempest-ServicesAdminTestJSON-1694087618-project-admin] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:01.079217 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-24744b02-cb66-4711-9f6d-7f36330fa86b tempest-ServicesAdminTestJSON-1694087618 tempest-ServicesAdminTestJSON-1694087618-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:01.079956 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-24744b02-cb66-4711-9f6d-7f36330fa86b tempest-ServicesAdminTestJSON-1694087618 tempest-ServicesAdminTestJSON-1694087618-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:01.080594 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-24744b02-cb66-4711-9f6d-7f36330fa86b tempest-ServicesAdminTestJSON-1694087618 tempest-ServicesAdminTestJSON-1694087618-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:01.081326 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-24744b02-cb66-4711-9f6d-7f36330fa86b tempest-ServicesAdminTestJSON-1694087618 tempest-ServicesAdminTestJSON-1694087618-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:01.081931 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-24744b02-cb66-4711-9f6d-7f36330fa86b tempest-ServicesAdminTestJSON-1694087618 tempest-ServicesAdminTestJSON-1694087618-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:01.082366 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-24744b02-cb66-4711-9f6d-7f36330fa86b tempest-ServicesAdminTestJSON-1694087618 tempest-ServicesAdminTestJSON-1694087618-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:01.135437 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-24744b02-cb66-4711-9f6d-7f36330fa86b tempest-ServicesAdminTestJSON-1694087618 tempest-ServicesAdminTestJSON-1694087618-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services?host=n-d-854823-8" status: 200 len: 578 microversion: 2.1 time: 0.063485 Oct 04 20:35:01.136052 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 233/456] 10.222.0.33 () {58 vars in 1172 bytes} [Tue Oct 4 20:35:01 2022] GET /compute/v2.1/os-services?host=n-d-854823-8 => generated 578 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:35:01.148211 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-ca9d395f-88e0-47b3-ad6e-ad12eb2dbf54 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:01.154239 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-ca9d395f-88e0-47b3-ad6e-ad12eb2dbf54 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] [instance: 3961b3f4-aea9-4997-85aa-336b3f902533] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:01.166426 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ca9d395f-88e0-47b3-ad6e-ad12eb2dbf54 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:01.168748 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ca9d395f-88e0-47b3-ad6e-ad12eb2dbf54 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:01.169191 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ca9d395f-88e0-47b3-ad6e-ad12eb2dbf54 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:01.169922 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ca9d395f-88e0-47b3-ad6e-ad12eb2dbf54 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:01.171485 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ca9d395f-88e0-47b3-ad6e-ad12eb2dbf54 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:01.173124 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ca9d395f-88e0-47b3-ad6e-ad12eb2dbf54 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:01.383915 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d586b03c-5cc5-4168-9d76-b69d23965a3a tempest-SecurityGroupsTestAdminJSON-377823160 tempest-SecurityGroupsTestAdminJSON-377823160-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/49916535-b0cd-429e-9350-559347379c6b" status: 202 len: 0 microversion: 2.1 time: 0.436873 Oct 04 20:35:01.385020 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 224/457] 10.222.0.33 () {58 vars in 1272 bytes} [Tue Oct 4 20:35:00 2022] DELETE /compute/v2.1/os-security-groups/49916535-b0cd-429e-9350-559347379c6b => generated 0 bytes in 439 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:35:01.389786 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-42928fc4-a2db-4b11-a1c2-3c2b000f7684 tempest-ServicesAdminTestJSON-1694087618 tempest-ServicesAdminTestJSON-1694087618-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:01.393349 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-42928fc4-a2db-4b11-a1c2-3c2b000f7684 tempest-ServicesAdminTestJSON-1694087618 tempest-ServicesAdminTestJSON-1694087618-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:01.393827 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-42928fc4-a2db-4b11-a1c2-3c2b000f7684 tempest-ServicesAdminTestJSON-1694087618 tempest-ServicesAdminTestJSON-1694087618-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:01.394258 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-42928fc4-a2db-4b11-a1c2-3c2b000f7684 tempest-ServicesAdminTestJSON-1694087618 tempest-ServicesAdminTestJSON-1694087618-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:01.395009 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-42928fc4-a2db-4b11-a1c2-3c2b000f7684 tempest-ServicesAdminTestJSON-1694087618 tempest-ServicesAdminTestJSON-1694087618-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:01.395457 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-42928fc4-a2db-4b11-a1c2-3c2b000f7684 tempest-ServicesAdminTestJSON-1694087618 tempest-ServicesAdminTestJSON-1694087618-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:01.395873 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-42928fc4-a2db-4b11-a1c2-3c2b000f7684 tempest-ServicesAdminTestJSON-1694087618 tempest-ServicesAdminTestJSON-1694087618-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:01.422599 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-42928fc4-a2db-4b11-a1c2-3c2b000f7684 tempest-ServicesAdminTestJSON-1694087618 tempest-ServicesAdminTestJSON-1694087618-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.036311 Oct 04 20:35:01.423460 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 225/458] 10.222.0.33 () {58 vars in 1176 bytes} [Tue Oct 4 20:35:01 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:35:01.428278 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-4da1f5b8-3387-4a23-9bb0-d911f87d7716 tempest-SecurityGroupsTestAdminJSON-377823160 tempest-SecurityGroupsTestAdminJSON-377823160-project-admin] Calling method '.version_select at 0x7f3c74cceee0>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:01.538791 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-ca9d395f-88e0-47b3-ad6e-ad12eb2dbf54 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f051a291d59242469f8172a9c474ac89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f0707d756b4ee085a19cccf3ab82c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:01.549224 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-ca9d395f-88e0-47b3-ad6e-ad12eb2dbf54 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] 10.222.0.33 "GET /compute/v2.1/servers/3961b3f4-aea9-4997-85aa-336b3f902533" status: 200 len: 1319 microversion: 2.1 time: 0.409923 Oct 04 20:35:01.549798 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 234/459] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:01 2022] GET /compute/v2.1/servers/3961b3f4-aea9-4997-85aa-336b3f902533 => generated 1319 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:01.557460 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-a8561a8b-157a-4d9e-b88f-4577ee3f5232 tempest-ServicesAdminTestJSON-1694087618 tempest-ServicesAdminTestJSON-1694087618-project-admin] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:01.563712 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a8561a8b-157a-4d9e-b88f-4577ee3f5232 tempest-ServicesAdminTestJSON-1694087618 tempest-ServicesAdminTestJSON-1694087618-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:01.564382 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a8561a8b-157a-4d9e-b88f-4577ee3f5232 tempest-ServicesAdminTestJSON-1694087618 tempest-ServicesAdminTestJSON-1694087618-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:01.565020 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a8561a8b-157a-4d9e-b88f-4577ee3f5232 tempest-ServicesAdminTestJSON-1694087618 tempest-ServicesAdminTestJSON-1694087618-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:01.566052 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a8561a8b-157a-4d9e-b88f-4577ee3f5232 tempest-ServicesAdminTestJSON-1694087618 tempest-ServicesAdminTestJSON-1694087618-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:01.566717 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a8561a8b-157a-4d9e-b88f-4577ee3f5232 tempest-ServicesAdminTestJSON-1694087618 tempest-ServicesAdminTestJSON-1694087618-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:01.567276 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a8561a8b-157a-4d9e-b88f-4577ee3f5232 tempest-ServicesAdminTestJSON-1694087618 tempest-ServicesAdminTestJSON-1694087618-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:01.592273 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-a8561a8b-157a-4d9e-b88f-4577ee3f5232 tempest-ServicesAdminTestJSON-1694087618 tempest-ServicesAdminTestJSON-1694087618-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.041248 Oct 04 20:35:01.602797 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 235/460] 10.222.0.33 () {58 vars in 1137 bytes} [Tue Oct 4 20:35:01 2022] GET /compute/v2.1/os-services => generated 944 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:35:01.615317 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-8f85c5ee-06b6-44d9-8fbb-8ca28ed0ae05 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:01.615938 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-8f85c5ee-06b6-44d9-8fbb-8ca28ed0ae05 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] [instance: 9e9f6289-9999-4188-9af1-6cf64a676eee] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:01.625652 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8f85c5ee-06b6-44d9-8fbb-8ca28ed0ae05 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:01.626995 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8f85c5ee-06b6-44d9-8fbb-8ca28ed0ae05 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:01.627878 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8f85c5ee-06b6-44d9-8fbb-8ca28ed0ae05 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:01.629179 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8f85c5ee-06b6-44d9-8fbb-8ca28ed0ae05 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:01.629935 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8f85c5ee-06b6-44d9-8fbb-8ca28ed0ae05 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:01.631055 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8f85c5ee-06b6-44d9-8fbb-8ca28ed0ae05 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:01.769989 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-4da1f5b8-3387-4a23-9bb0-d911f87d7716 tempest-SecurityGroupsTestAdminJSON-377823160 tempest-SecurityGroupsTestAdminJSON-377823160-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/89e90f8e-08fb-4f46-accc-bf60d0ee615f" status: 202 len: 0 microversion: 2.1 time: 0.345115 Oct 04 20:35:01.770590 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 226/461] 10.222.0.33 () {58 vars in 1272 bytes} [Tue Oct 4 20:35:01 2022] DELETE /compute/v2.1/os-security-groups/89e90f8e-08fb-4f46-accc-bf60d0ee615f => generated 0 bytes in 346 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:35:01.779048 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2a89f981-a81e-494b-94ab-ffc8c291156e tempest-SecurityGroupsTestAdminJSON-1439866220 tempest-SecurityGroupsTestAdminJSON-1439866220-project] Calling method '.version_select at 0x7f3c74d5adc0>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:01.895982 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-8f85c5ee-06b6-44d9-8fbb-8ca28ed0ae05 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3563efe2b8c94931a2a46c4e14811b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3118a5d96843d3bede1ed94bd9717e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:01.906057 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-8f85c5ee-06b6-44d9-8fbb-8ca28ed0ae05 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] 10.222.0.33 "GET /compute/v2.1/servers/9e9f6289-9999-4188-9af1-6cf64a676eee" status: 200 len: 1471 microversion: 2.1 time: 0.311408 Oct 04 20:35:01.907034 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 236/462] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:01 2022] GET /compute/v2.1/servers/9e9f6289-9999-4188-9af1-6cf64a676eee => generated 1471 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:01.930033 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-b84f3762-1702-4df3-aafc-c834f91dc8a5 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:35:01.930630 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-b84f3762-1702-4df3-aafc-c834f91dc8a5 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] [instance: 9e9f6289-9999-4188-9af1-6cf64a676eee] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:01.941454 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b84f3762-1702-4df3-aafc-c834f91dc8a5 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:01.942045 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b84f3762-1702-4df3-aafc-c834f91dc8a5 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:01.942514 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b84f3762-1702-4df3-aafc-c834f91dc8a5 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:01.943224 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b84f3762-1702-4df3-aafc-c834f91dc8a5 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:01.943676 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b84f3762-1702-4df3-aafc-c834f91dc8a5 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:01.944101 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b84f3762-1702-4df3-aafc-c834f91dc8a5 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:02.068574 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-b84f3762-1702-4df3-aafc-c834f91dc8a5 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] 10.222.0.33 "POST /compute/v2.1/servers/9e9f6289-9999-4188-9af1-6cf64a676eee/action" status: 204 len: 0 microversion: 2.1 time: 0.142505 Oct 04 20:35:02.073863 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 237/463] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 20:35:01 2022] POST /compute/v2.1/servers/9e9f6289-9999-4188-9af1-6cf64a676eee/action => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 20:35:02.075796 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-2a89f981-a81e-494b-94ab-ffc8c291156e tempest-SecurityGroupsTestAdminJSON-1439866220 tempest-SecurityGroupsTestAdminJSON-1439866220-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/4d677177-5f4f-418e-8c80-7b0c9fdd4261" status: 202 len: 0 microversion: 2.1 time: 0.300389 Oct 04 20:35:02.080269 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 227/464] 10.222.0.33 () {58 vars in 1272 bytes} [Tue Oct 4 20:35:01 2022] DELETE /compute/v2.1/os-security-groups/4d677177-5f4f-418e-8c80-7b0c9fdd4261 => generated 0 bytes in 306 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:35:02.087334 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d19b9fe1-338c-477a-9d6a-f455df4b3837 tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:02.088607 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d19b9fe1-338c-477a-9d6a-f455df4b3837 tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] [instance: 486112b2-497b-4039-ac04-b23cf076d470] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:02.088738 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-5e3e0556-d6ca-41f8-aea7-44c72c6f3575 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:02.089410 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-5e3e0556-d6ca-41f8-aea7-44c72c6f3575 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] [instance: 2457c5d1-8842-4a2d-a5d4-fe97b53b64df] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:02.096091 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d19b9fe1-338c-477a-9d6a-f455df4b3837 tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:02.096854 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d19b9fe1-338c-477a-9d6a-f455df4b3837 tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:02.097503 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d19b9fe1-338c-477a-9d6a-f455df4b3837 tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:02.098698 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d19b9fe1-338c-477a-9d6a-f455df4b3837 tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:02.099472 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d19b9fe1-338c-477a-9d6a-f455df4b3837 tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:02.100284 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d19b9fe1-338c-477a-9d6a-f455df4b3837 tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:02.103498 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5e3e0556-d6ca-41f8-aea7-44c72c6f3575 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:02.104056 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5e3e0556-d6ca-41f8-aea7-44c72c6f3575 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:02.104502 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5e3e0556-d6ca-41f8-aea7-44c72c6f3575 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:02.105291 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5e3e0556-d6ca-41f8-aea7-44c72c6f3575 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:02.105747 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5e3e0556-d6ca-41f8-aea7-44c72c6f3575 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:02.106169 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5e3e0556-d6ca-41f8-aea7-44c72c6f3575 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:02.302802 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-5e3e0556-d6ca-41f8-aea7-44c72c6f3575 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cbd31af13444cda97ba5f8c99d19437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a307499cf44d03a1e9bb61f614f099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:02.318962 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-5e3e0556-d6ca-41f8-aea7-44c72c6f3575 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] 10.222.0.33 "GET /compute/v2.1/servers/2457c5d1-8842-4a2d-a5d4-fe97b53b64df" status: 200 len: 1280 microversion: 2.1 time: 0.240255 Oct 04 20:35:02.320273 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 238/465] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:02 2022] GET /compute/v2.1/servers/2457c5d1-8842-4a2d-a5d4-fe97b53b64df => generated 1280 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:02.332464 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-bb2e1882-8098-4e6b-82be-a401f34985ef tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:02.335777 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-bb2e1882-8098-4e6b-82be-a401f34985ef tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] [instance: 9e9f6289-9999-4188-9af1-6cf64a676eee] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:02.346083 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bb2e1882-8098-4e6b-82be-a401f34985ef tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:02.347277 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bb2e1882-8098-4e6b-82be-a401f34985ef tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:02.347935 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bb2e1882-8098-4e6b-82be-a401f34985ef tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:02.349233 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bb2e1882-8098-4e6b-82be-a401f34985ef tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:02.349988 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bb2e1882-8098-4e6b-82be-a401f34985ef tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:02.351207 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bb2e1882-8098-4e6b-82be-a401f34985ef tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:02.515133 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d19b9fe1-338c-477a-9d6a-f455df4b3837 tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f72b5b32ab457aaaa1c1ff7efdce5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ca732ccf4d417ab1f7ba82a9c8c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:02.529193 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d19b9fe1-338c-477a-9d6a-f455df4b3837 tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] 10.222.0.33 "GET /compute/v2.1/servers/486112b2-497b-4039-ac04-b23cf076d470" status: 200 len: 1331 microversion: 2.1 time: 0.444669 Oct 04 20:35:02.530637 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 228/466] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:02 2022] GET /compute/v2.1/servers/486112b2-497b-4039-ac04-b23cf076d470 => generated 1331 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:02.546126 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-783f12df-b901-41cb-a8bc-efa533230174 tempest-SecurityGroupsTestAdminJSON-1439866220 tempest-SecurityGroupsTestAdminJSON-1439866220-project] Calling method '.version_select at 0x7f3c74d1c940>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:02.735436 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-bb2e1882-8098-4e6b-82be-a401f34985ef tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3563efe2b8c94931a2a46c4e14811b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3118a5d96843d3bede1ed94bd9717e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:02.746103 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-bb2e1882-8098-4e6b-82be-a401f34985ef tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] 10.222.0.33 "GET /compute/v2.1/servers/9e9f6289-9999-4188-9af1-6cf64a676eee" status: 200 len: 1471 microversion: 2.1 time: 0.420741 Oct 04 20:35:02.747429 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 239/467] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:02 2022] GET /compute/v2.1/servers/9e9f6289-9999-4188-9af1-6cf64a676eee => generated 1471 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:02.769826 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-44092748-7c8b-4bd1-9240-8c91e6cf1b9e tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:02.770575 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-44092748-7c8b-4bd1-9240-8c91e6cf1b9e tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] [instance: 8fdcb1b0-65e9-45d1-b0da-5f603f22a8cf] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:02.783451 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-44092748-7c8b-4bd1-9240-8c91e6cf1b9e tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:02.784720 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-44092748-7c8b-4bd1-9240-8c91e6cf1b9e tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:02.785388 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-44092748-7c8b-4bd1-9240-8c91e6cf1b9e tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:02.796172 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-44092748-7c8b-4bd1-9240-8c91e6cf1b9e tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:02.797110 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-44092748-7c8b-4bd1-9240-8c91e6cf1b9e tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:02.797701 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-44092748-7c8b-4bd1-9240-8c91e6cf1b9e tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:02.830838 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-44092748-7c8b-4bd1-9240-8c91e6cf1b9e tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] [instance: 8fdcb1b0-65e9-45d1-b0da-5f603f22a8cf] Going to try to terminate instance {{(pid=128802) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:35:02.957307 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-44092748-7c8b-4bd1-9240-8c91e6cf1b9e tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] 10.222.0.33 "DELETE /compute/v2.1/servers/8fdcb1b0-65e9-45d1-b0da-5f603f22a8cf" status: 204 len: 0 microversion: 2.1 time: 0.191557 Oct 04 20:35:02.958327 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 240/468] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 20:35:02 2022] DELETE /compute/v2.1/servers/8fdcb1b0-65e9-45d1-b0da-5f603f22a8cf => generated 0 bytes in 195 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:35:02.965631 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-6d832950-8a1b-4051-ae5e-6ad33695f1fe tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:02.966704 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-6d832950-8a1b-4051-ae5e-6ad33695f1fe tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] [instance: 3961b3f4-aea9-4997-85aa-336b3f902533] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:02.977395 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6d832950-8a1b-4051-ae5e-6ad33695f1fe tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:02.977395 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6d832950-8a1b-4051-ae5e-6ad33695f1fe tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:02.977833 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6d832950-8a1b-4051-ae5e-6ad33695f1fe tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:02.978636 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6d832950-8a1b-4051-ae5e-6ad33695f1fe tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:02.979120 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6d832950-8a1b-4051-ae5e-6ad33695f1fe tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:02.979752 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6d832950-8a1b-4051-ae5e-6ad33695f1fe tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:03.257606 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-783f12df-b901-41cb-a8bc-efa533230174 tempest-SecurityGroupsTestAdminJSON-1439866220 tempest-SecurityGroupsTestAdminJSON-1439866220-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/819645cb-0d37-4f66-857b-feefd72484e7" status: 202 len: 0 microversion: 2.1 time: 0.725754 Oct 04 20:35:03.258790 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 229/469] 10.222.0.33 () {58 vars in 1272 bytes} [Tue Oct 4 20:35:02 2022] DELETE /compute/v2.1/os-security-groups/819645cb-0d37-4f66-857b-feefd72484e7 => generated 0 bytes in 728 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:35:03.264836 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-21478341-9d7a-4d9b-8c84-4014c8b475cd req-199e4acf-132e-4f41-b189-a541f6d900e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "486112b2-497b-4039-ac04-b23cf076d470", "name": "network-vif-plugged", "status": "completed", "tag": "b97b70cc-e857-429e-ad48-a973b62edd3e"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:35:03.286524 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-21478341-9d7a-4d9b-8c84-4014c8b475cd req-199e4acf-132e-4f41-b189-a541f6d900e1 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:03.287295 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-21478341-9d7a-4d9b-8c84-4014c8b475cd req-199e4acf-132e-4f41-b189-a541f6d900e1 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:03.287734 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-21478341-9d7a-4d9b-8c84-4014c8b475cd req-199e4acf-132e-4f41-b189-a541f6d900e1 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:03.303294 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-21478341-9d7a-4d9b-8c84-4014c8b475cd req-199e4acf-132e-4f41-b189-a541f6d900e1 service nova] Creating event network-vif-plugged:b97b70cc-e857-429e-ad48-a973b62edd3e for instance 486112b2-497b-4039-ac04-b23cf076d470 on n-h1-854823-8 Oct 04 20:35:03.312161 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-21478341-9d7a-4d9b-8c84-4014c8b475cd req-199e4acf-132e-4f41-b189-a541f6d900e1 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051339 Oct 04 20:35:03.313090 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 230/470] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:35:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:35:03.320359 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a12416e9-c30a-44db-b2ac-a7a13fb291f2 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-1226946323", "imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63", "flavorRef": "560564508", "adminPass": "***", "networks": [{"uuid": "106f4651-948b-4213-b058-26e9b0575dd1"}], "security_groups": [{"name": "tempest-securitygroup--688473469"}], "key_name": "tempest-keypair-992469321", "user_data": "}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:35:03.510311 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.network.neutron [None req-a12416e9-c30a-44db-b2ac-a7a13fb291f2 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] validate_networks() for [('106f4651-948b-4213-b058-26e9b0575dd1', None, None, None, None, None)] {{(pid=128801) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:35:03.533919 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-6d832950-8a1b-4051-ae5e-6ad33695f1fe tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f051a291d59242469f8172a9c474ac89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f0707d756b4ee085a19cccf3ab82c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:03.544039 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-6d832950-8a1b-4051-ae5e-6ad33695f1fe tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] 10.222.0.33 "GET /compute/v2.1/servers/3961b3f4-aea9-4997-85aa-336b3f902533" status: 200 len: 1468 microversion: 2.1 time: 0.584285 Oct 04 20:35:03.548339 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 241/471] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:02 2022] GET /compute/v2.1/servers/3961b3f4-aea9-4997-85aa-336b3f902533 => generated 1468 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:03.564494 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-378a652c-6232-4d9b-8565-3981c7ca4f28 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:03.565668 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-378a652c-6232-4d9b-8565-3981c7ca4f28 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] [instance: 2457c5d1-8842-4a2d-a5d4-fe97b53b64df] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:03.577976 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-378a652c-6232-4d9b-8565-3981c7ca4f28 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:03.579958 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-378a652c-6232-4d9b-8565-3981c7ca4f28 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:03.581664 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-378a652c-6232-4d9b-8565-3981c7ca4f28 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:03.583812 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-378a652c-6232-4d9b-8565-3981c7ca4f28 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:03.584980 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-378a652c-6232-4d9b-8565-3981c7ca4f28 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:03.585750 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-378a652c-6232-4d9b-8565-3981c7ca4f28 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:03.923001 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-378a652c-6232-4d9b-8565-3981c7ca4f28 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cbd31af13444cda97ba5f8c99d19437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a307499cf44d03a1e9bb61f614f099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:03.932623 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-378a652c-6232-4d9b-8565-3981c7ca4f28 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] 10.222.0.33 "GET /compute/v2.1/servers/2457c5d1-8842-4a2d-a5d4-fe97b53b64df" status: 200 len: 1320 microversion: 2.1 time: 0.382415 Oct 04 20:35:03.933320 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 242/472] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:03 2022] GET /compute/v2.1/servers/2457c5d1-8842-4a2d-a5d4-fe97b53b64df => generated 1320 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:03.939767 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-8d82a1a7-e7f0-4cec-b4ea-f8778a773370 tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:03.940536 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-8d82a1a7-e7f0-4cec-b4ea-f8778a773370 tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] [instance: 486112b2-497b-4039-ac04-b23cf076d470] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:03.948947 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8d82a1a7-e7f0-4cec-b4ea-f8778a773370 tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:03.949611 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8d82a1a7-e7f0-4cec-b4ea-f8778a773370 tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:03.950546 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8d82a1a7-e7f0-4cec-b4ea-f8778a773370 tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:03.951257 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8d82a1a7-e7f0-4cec-b4ea-f8778a773370 tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:03.951882 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8d82a1a7-e7f0-4cec-b4ea-f8778a773370 tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:03.969638 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8d82a1a7-e7f0-4cec-b4ea-f8778a773370 tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:04.312014 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-8d82a1a7-e7f0-4cec-b4ea-f8778a773370 tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f72b5b32ab457aaaa1c1ff7efdce5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ca732ccf4d417ab1f7ba82a9c8c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:04.323125 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-8d82a1a7-e7f0-4cec-b4ea-f8778a773370 tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] 10.222.0.33 "GET /compute/v2.1/servers/486112b2-497b-4039-ac04-b23cf076d470" status: 200 len: 1331 microversion: 2.1 time: 0.387856 Oct 04 20:35:04.324583 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 243/473] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:03 2022] GET /compute/v2.1/servers/486112b2-497b-4039-ac04-b23cf076d470 => generated 1331 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:04.549436 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-a12416e9-c30a-44db-b2ac-a7a13fb291f2 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Flavor limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:35:04.549892 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-a12416e9-c30a-44db-b2ac-a7a13fb291f2 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Image limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:35:04.550319 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-a12416e9-c30a-44db-b2ac-a7a13fb291f2 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Flavor pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:35:04.550756 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-a12416e9-c30a-44db-b2ac-a7a13fb291f2 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Image pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:35:04.551171 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-a12416e9-c30a-44db-b2ac-a7a13fb291f2 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:35:04.562631 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a12416e9-c30a-44db-b2ac-a7a13fb291f2 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:04.563460 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a12416e9-c30a-44db-b2ac-a7a13fb291f2 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:04.564485 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a12416e9-c30a-44db-b2ac-a7a13fb291f2 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:04.565432 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a12416e9-c30a-44db-b2ac-a7a13fb291f2 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:04.566050 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a12416e9-c30a-44db-b2ac-a7a13fb291f2 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:04.566783 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a12416e9-c30a-44db-b2ac-a7a13fb291f2 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:04.616192 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-a12416e9-c30a-44db-b2ac-a7a13fb291f2 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Getting quotas for project 8f28e80977de42a892b84295ecf05141. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:35:04.623899 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-a12416e9-c30a-44db-b2ac-a7a13fb291f2 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Getting quotas for user f5eda279f6034608b192839a54dda616 and project 8f28e80977de42a892b84295ecf05141. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:35:04.638453 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a12416e9-c30a-44db-b2ac-a7a13fb291f2 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Going to run 1 instances... {{(pid=128801) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:35:04.642243 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a12416e9-c30a-44db-b2ac-a7a13fb291f2 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] [instance: c6cdf5bb-821d-4438-9c05-f227c4ebbbcd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='15b24725-0c99-4bcf-b1fb-907cdf8e2d63',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=-1,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=128801) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:35:04.644987 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-c564631a-bb28-4bd5-8260-f8b3fd42d61d tempest-LiveMigrationNegativeTest-850045882 tempest-LiveMigrationNegativeTest-850045882-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "tempest-host-338356709", "block_migration": true, "disk_over_commit": false}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:35:04.647878 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-c564631a-bb28-4bd5-8260-f8b3fd42d61d tempest-LiveMigrationNegativeTest-850045882 tempest-LiveMigrationNegativeTest-850045882-project-admin] [instance: 3961b3f4-aea9-4997-85aa-336b3f902533] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:04.666796 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c564631a-bb28-4bd5-8260-f8b3fd42d61d tempest-LiveMigrationNegativeTest-850045882 tempest-LiveMigrationNegativeTest-850045882-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:04.667429 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c564631a-bb28-4bd5-8260-f8b3fd42d61d tempest-LiveMigrationNegativeTest-850045882 tempest-LiveMigrationNegativeTest-850045882-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:04.667958 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c564631a-bb28-4bd5-8260-f8b3fd42d61d tempest-LiveMigrationNegativeTest-850045882 tempest-LiveMigrationNegativeTest-850045882-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:04.668776 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c564631a-bb28-4bd5-8260-f8b3fd42d61d tempest-LiveMigrationNegativeTest-850045882 tempest-LiveMigrationNegativeTest-850045882-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:04.669325 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c564631a-bb28-4bd5-8260-f8b3fd42d61d tempest-LiveMigrationNegativeTest-850045882 tempest-LiveMigrationNegativeTest-850045882-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:04.669841 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c564631a-bb28-4bd5-8260-f8b3fd42d61d tempest-LiveMigrationNegativeTest-850045882 tempest-LiveMigrationNegativeTest-850045882-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:04.732978 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a12416e9-c30a-44db-b2ac-a7a13fb291f2 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.418108 Oct 04 20:35:04.740778 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 231/474] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 20:35:03 2022] POST /compute/v2.1/servers => generated 401 bytes in 1427 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 20:35:04.752170 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-92ec7ed1-d6ba-4da4-8de2-55fcad069d17 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:04.753155 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-92ec7ed1-d6ba-4da4-8de2-55fcad069d17 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] [instance: 9e9f6289-9999-4188-9af1-6cf64a676eee] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:04.763842 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-92ec7ed1-d6ba-4da4-8de2-55fcad069d17 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:04.764543 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-92ec7ed1-d6ba-4da4-8de2-55fcad069d17 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:04.765125 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-92ec7ed1-d6ba-4da4-8de2-55fcad069d17 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:04.765991 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-92ec7ed1-d6ba-4da4-8de2-55fcad069d17 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:04.767162 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-92ec7ed1-d6ba-4da4-8de2-55fcad069d17 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:04.767412 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-92ec7ed1-d6ba-4da4-8de2-55fcad069d17 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:04.816231 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.objects.instance [None req-c564631a-bb28-4bd5-8260-f8b3fd42d61d tempest-LiveMigrationNegativeTest-850045882 tempest-LiveMigrationNegativeTest-850045882-project-admin] Lazy-loading 'flavor' on Instance uuid 3961b3f4-aea9-4997-85aa-336b3f902533 {{(pid=128802) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:35:04.909184 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-c564631a-bb28-4bd5-8260-f8b3fd42d61d tempest-LiveMigrationNegativeTest-850045882 tempest-LiveMigrationNegativeTest-850045882-project-admin] [instance: 3961b3f4-aea9-4997-85aa-336b3f902533] Going to try to live migrate instance to tempest-host-338356709 {{(pid=128802) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 04 20:35:04.921142 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.wsgi [None req-c564631a-bb28-4bd5-8260-f8b3fd42d61d tempest-LiveMigrationNegativeTest-850045882 tempest-LiveMigrationNegativeTest-850045882-project-admin] HTTP exception thrown: Compute host tempest-host-338356709 could not be found. Oct 04 20:35:04.927278 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-c564631a-bb28-4bd5-8260-f8b3fd42d61d tempest-LiveMigrationNegativeTest-850045882 tempest-LiveMigrationNegativeTest-850045882-project-admin] Request method failure captured: Oct 04 20:35:04.927278 n-d-854823-8 devstack@n-api.service[128802]: request: POST /compute/v2.1/servers/3961b3f4-aea9-4997-85aa-336b3f902533/action HTTP/1.1 Oct 04 20:35:04.927278 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 20:35:04.927278 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 20:35:04.927278 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 20:35:04.927278 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 106 Oct 04 20:35:04.927278 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 20:35:04.927278 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 20:35:04.927278 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 20:35:04.927278 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 20:35:04.927278 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPJjicYdzO8XQcUdH20pP4dZnIE8_sEaoxLpcBk5Z2XZUDicT2CntSW4I1dWvbjTQoxatzQ8UzBaXAhmOhGjYue5lzLwWb1rgULQngK1AszR-WBixHJcsjjQPfMsiPnNBRPyocou0DiM31jRoC0SSuLyu_UOpV0On1ZHkvdiQPQSDAus Oct 04 20:35:04.927278 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 20:35:04.927278 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 20:35:04.927278 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 20:35:04.927278 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 20:35:04.927278 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 20:35:04.927278 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 20:35:04.927278 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: e5d03328b7cf4d0dbe73c003b90e951e Oct 04 20:35:04.927278 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-LiveMigrationNegativeTest-850045882 Oct 04 20:35:04.927278 n-d-854823-8 devstack@n-api.service[128802]: X-Role: admin,reader,member Oct 04 20:35:04.927278 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: admin,reader,member Oct 04 20:35:04.929244 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_e5d03328b7cf4d0dbe73c003b90e951e", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e5d03328b7cf4d0dbe73c003b90e951e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e5d03328b7cf4d0dbe73c003b90e951e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/e5d03328b7cf4d0dbe73c003b90e951e"}]}] Oct 04 20:35:04.929244 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-LiveMigrationNegativeTest-850045882 Oct 04 20:35:04.929244 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: e5d03328b7cf4d0dbe73c003b90e951e Oct 04 20:35:04.929244 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-850045882 Oct 04 20:35:04.929244 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-LiveMigrationNegativeTest-850045882-project-admin Oct 04 20:35:04.929244 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 20:35:04.929244 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 20:35:04.929244 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: 8380dc4657af47358da6a75a5844c659 Oct 04 20:35:04.929244 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-LiveMigrationNegativeTest-850045882-project-admin Oct 04 20:35:04.929244 n-d-854823-8 devstack@n-api.service[128802]: Oct 04 20:35:04.929244 n-d-854823-8 devstack@n-api.service[128802]: {"os-migrateLive": {"host": "tempest-host-338356709", "block_migration": true, "disk_over_commit": false}} Oct 04 20:35:04.929244 n-d-854823-8 devstack@n-api.service[128802]: method: > Oct 04 20:35:04.930741 n-d-854823-8 devstack@n-api.service[128802]: exception: Compute host tempest-host-338356709 could not be found. Oct 04 20:35:04.930741 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'id': '3961b3f4-aea9-4997-85aa-336b3f902533', 'body': {'os-migrateLive': {'host': 'tempest-host-338356709', 'block_migration': True, 'disk_over_commit': False}}} Oct 04 20:35:04.930741 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:35:04.930741 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:35:04.930741 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Oct 04 20:35:04.930741 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Oct 04 20:35:04.930741 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 04 20:35:04.930741 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 20:35:04.930741 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 04 20:35:04.930741 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 04 20:35:04.930741 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 04 20:35:04.930741 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 04 20:35:04.930741 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 04 20:35:04.930741 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 04 20:35:04.930741 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 04 20:35:04.930741 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 04 20:35:04.930741 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Oct 04 20:35:04.930741 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 04 20:35:04.930741 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 20:35:04.931995 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 20:35:04.931995 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 04 20:35:04.931995 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 04 20:35:04.931995 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5488, in live_migrate Oct 04 20:35:04.931995 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nodes = objects.ComputeNodeList.get_all_by_host(context, host_name) Oct 04 20:35:04.931995 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 20:35:04.931995 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 20:35:04.931995 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 476, in get_all_by_host Oct 04 20:35:04.931995 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi db_computes = cls._db_compute_node_get_all_by_host(context, host, Oct 04 20:35:04.931995 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 179, in wrapper Oct 04 20:35:04.931995 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:35:04.931995 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 472, in _db_compute_node_get_all_by_host Oct 04 20:35:04.931995 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return db.compute_node_get_all_by_host(context, host) Oct 04 20:35:04.931995 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 241, in wrapper Oct 04 20:35:04.931995 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(context, *args, **kwargs) Oct 04 20:35:04.931995 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 740, in compute_node_get_all_by_host Oct 04 20:35:04.931995 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host) Oct 04 20:35:04.931995 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-host-338356709 could not be found. Oct 04 20:35:04.931995 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:35:04.933040 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:35:04.933040 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:35:04.933040 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:35:04.933040 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:35:04.933040 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:35:04.933040 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:35:04.933040 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:35:04.933040 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:35:04.933040 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:35:04.933040 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:35:04.933040 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:35:04.933040 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:35:04.933040 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:35:04.933040 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:35:04.933040 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:35:04.933040 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 04 20:35:04.933040 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 150, in _migrate_live Oct 04 20:35:04.933040 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 04 20:35:04.933040 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Compute host tempest-host-338356709 could not be found. Oct 04 20:35:04.933040 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:35:04.934567 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:35:04.934567 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:35:04.934567 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:35:04.934567 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:35:04.934567 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:35:04.934567 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:35:04.934567 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:35:04.934567 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-host-338356709 could not be found. Oct 04 20:35:04.934567 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:35:04.936927 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-c564631a-bb28-4bd5-8260-f8b3fd42d61d tempest-LiveMigrationNegativeTest-850045882 tempest-LiveMigrationNegativeTest-850045882-project-admin] Returning 400 to user: Compute host tempest-host-338356709 could not be found. {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:35:04.938088 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-c564631a-bb28-4bd5-8260-f8b3fd42d61d tempest-LiveMigrationNegativeTest-850045882 tempest-LiveMigrationNegativeTest-850045882-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/3961b3f4-aea9-4997-85aa-336b3f902533/action" status: 400 len: 99 microversion: 2.1 time: 0.612013 Oct 04 20:35:04.938855 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 244/475] 10.222.0.33 () {60 vars in 1279 bytes} [Tue Oct 4 20:35:04 2022] POST /compute/v2.1/servers/3961b3f4-aea9-4997-85aa-336b3f902533/action => generated 99 bytes in 614 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 04 20:35:04.948523 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-27e707c9-8eda-43bd-b3f6-5c7746846ee7 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:04.949694 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-27e707c9-8eda-43bd-b3f6-5c7746846ee7 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] [instance: c6cdf5bb-821d-4438-9c05-f227c4ebbbcd] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:05.333687 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-27e707c9-8eda-43bd-b3f6-5c7746846ee7 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5eda279f6034608b192839a54dda616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f28e80977de42a892b84295ecf05141', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:05.348274 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-27e707c9-8eda-43bd-b3f6-5c7746846ee7 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] 10.222.0.33 "GET /compute/v2.1/servers/c6cdf5bb-821d-4438-9c05-f227c4ebbbcd" status: 200 len: 1262 microversion: 2.1 time: 0.408004 Oct 04 20:35:05.348869 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 245/476] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:04 2022] GET /compute/v2.1/servers/c6cdf5bb-821d-4438-9c05-f227c4ebbbcd => generated 1262 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:05.367955 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-6f4438a9-4712-4e01-a5c1-360250503fec tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:05.368758 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-6f4438a9-4712-4e01-a5c1-360250503fec tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] [instance: 3961b3f4-aea9-4997-85aa-336b3f902533] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:05.383806 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6f4438a9-4712-4e01-a5c1-360250503fec tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:05.384346 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6f4438a9-4712-4e01-a5c1-360250503fec tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:05.385693 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6f4438a9-4712-4e01-a5c1-360250503fec tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:05.388604 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6f4438a9-4712-4e01-a5c1-360250503fec tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:05.389084 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6f4438a9-4712-4e01-a5c1-360250503fec tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:05.389783 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6f4438a9-4712-4e01-a5c1-360250503fec tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:05.437338 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:35:05.499130 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-92ec7ed1-d6ba-4da4-8de2-55fcad069d17 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3563efe2b8c94931a2a46c4e14811b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3118a5d96843d3bede1ed94bd9717e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:05.515273 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-92ec7ed1-d6ba-4da4-8de2-55fcad069d17 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] 10.222.0.33 "GET /compute/v2.1/servers/9e9f6289-9999-4188-9af1-6cf64a676eee" status: 200 len: 1471 microversion: 2.1 time: 0.771644 Oct 04 20:35:05.518669 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 232/477] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:04 2022] GET /compute/v2.1/servers/9e9f6289-9999-4188-9af1-6cf64a676eee => generated 1471 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:05.541314 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7d0f6990-30b5-4dc0-83f9-728fcc2de412 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:05.541946 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-7d0f6990-30b5-4dc0-83f9-728fcc2de412 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] [instance: 2457c5d1-8842-4a2d-a5d4-fe97b53b64df] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:05.557307 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7d0f6990-30b5-4dc0-83f9-728fcc2de412 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:05.562264 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7d0f6990-30b5-4dc0-83f9-728fcc2de412 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:05.563024 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7d0f6990-30b5-4dc0-83f9-728fcc2de412 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:05.563771 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7d0f6990-30b5-4dc0-83f9-728fcc2de412 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:05.564228 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7d0f6990-30b5-4dc0-83f9-728fcc2de412 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:05.565052 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7d0f6990-30b5-4dc0-83f9-728fcc2de412 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:05.570927 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=100 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:35:06.206441 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-6f4438a9-4712-4e01-a5c1-360250503fec tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f051a291d59242469f8172a9c474ac89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f0707d756b4ee085a19cccf3ab82c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:06.223806 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-6f4438a9-4712-4e01-a5c1-360250503fec tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] 10.222.0.33 "GET /compute/v2.1/servers/3961b3f4-aea9-4997-85aa-336b3f902533" status: 200 len: 1468 microversion: 2.1 time: 0.871898 Oct 04 20:35:06.224564 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 246/478] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:05 2022] GET /compute/v2.1/servers/3961b3f4-aea9-4997-85aa-336b3f902533 => generated 1468 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:06.239835 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-88c274ae-be28-49cd-9e86-c3e78f426b3f tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:06.253781 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-88c274ae-be28-49cd-9e86-c3e78f426b3f tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] [instance: 486112b2-497b-4039-ac04-b23cf076d470] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:06.263738 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-88c274ae-be28-49cd-9e86-c3e78f426b3f tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:06.270806 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-88c274ae-be28-49cd-9e86-c3e78f426b3f tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:06.272428 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-88c274ae-be28-49cd-9e86-c3e78f426b3f tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:06.274917 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-88c274ae-be28-49cd-9e86-c3e78f426b3f tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:06.276571 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-88c274ae-be28-49cd-9e86-c3e78f426b3f tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:06.277144 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-88c274ae-be28-49cd-9e86-c3e78f426b3f tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:06.420867 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-7d0f6990-30b5-4dc0-83f9-728fcc2de412 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cbd31af13444cda97ba5f8c99d19437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a307499cf44d03a1e9bb61f614f099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:06.442006 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-7d0f6990-30b5-4dc0-83f9-728fcc2de412 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] 10.222.0.33 "GET /compute/v2.1/servers/2457c5d1-8842-4a2d-a5d4-fe97b53b64df" status: 200 len: 1320 microversion: 2.1 time: 0.920707 Oct 04 20:35:06.443883 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 233/479] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:05 2022] GET /compute/v2.1/servers/2457c5d1-8842-4a2d-a5d4-fe97b53b64df => generated 1320 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:06.464811 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-32ce961b-a6ee-4231-bf28-22d916091973 req-695bd910-e72d-43f3-8680-8201431ccf50 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2457c5d1-8842-4a2d-a5d4-fe97b53b64df", "tag": "b4fd2bf2-a03d-49a9-8fe6-db90f57c359d"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:35:06.490241 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-32ce961b-a6ee-4231-bf28-22d916091973 req-695bd910-e72d-43f3-8680-8201431ccf50 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:06.490506 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-32ce961b-a6ee-4231-bf28-22d916091973 req-695bd910-e72d-43f3-8680-8201431ccf50 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:06.491137 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-32ce961b-a6ee-4231-bf28-22d916091973 req-695bd910-e72d-43f3-8680-8201431ccf50 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:06.519582 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-32ce961b-a6ee-4231-bf28-22d916091973 req-695bd910-e72d-43f3-8680-8201431ccf50 service nova] Creating event network-changed:b4fd2bf2-a03d-49a9-8fe6-db90f57c359d for instance 2457c5d1-8842-4a2d-a5d4-fe97b53b64df on n-h2-854823-8 Oct 04 20:35:06.526898 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-32ce961b-a6ee-4231-bf28-22d916091973 req-695bd910-e72d-43f3-8680-8201431ccf50 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081556 Oct 04 20:35:06.528781 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 234/480] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:35:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:35:06.537888 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-600ce140-81ca-4853-a8d7-393fe4e57de8 req-c7f2dceb-191e-4e30-90dc-46ab8579aa2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e9f6289-9999-4188-9af1-6cf64a676eee", "name": "network-vif-plugged", "status": "completed", "tag": "adebf0e2-e917-4865-9fef-2062cd63bdc7"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:35:06.551054 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-600ce140-81ca-4853-a8d7-393fe4e57de8 req-c7f2dceb-191e-4e30-90dc-46ab8579aa2b service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:06.551762 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-600ce140-81ca-4853-a8d7-393fe4e57de8 req-c7f2dceb-191e-4e30-90dc-46ab8579aa2b service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:06.552363 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-600ce140-81ca-4853-a8d7-393fe4e57de8 req-c7f2dceb-191e-4e30-90dc-46ab8579aa2b service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:06.574503 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-600ce140-81ca-4853-a8d7-393fe4e57de8 req-c7f2dceb-191e-4e30-90dc-46ab8579aa2b service nova] Creating event network-vif-plugged:adebf0e2-e917-4865-9fef-2062cd63bdc7 for instance 9e9f6289-9999-4188-9af1-6cf64a676eee on n-h2-854823-8 Oct 04 20:35:06.590327 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [req-600ce140-81ca-4853-a8d7-393fe4e57de8 req-c7f2dceb-191e-4e30-90dc-46ab8579aa2b service nova] Instance 9e9f6289-9999-4188-9af1-6cf64a676eee is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854823-8', 'n-h2-854823-8'} {{(pid=128801) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 20:35:06.607644 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-600ce140-81ca-4853-a8d7-393fe4e57de8 req-c7f2dceb-191e-4e30-90dc-46ab8579aa2b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076221 Oct 04 20:35:06.608603 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 235/481] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:35:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:35:06.700313 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-88c274ae-be28-49cd-9e86-c3e78f426b3f tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f72b5b32ab457aaaa1c1ff7efdce5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ca732ccf4d417ab1f7ba82a9c8c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:06.735302 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-88c274ae-be28-49cd-9e86-c3e78f426b3f tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] 10.222.0.33 "GET /compute/v2.1/servers/486112b2-497b-4039-ac04-b23cf076d470" status: 200 len: 1536 microversion: 2.1 time: 0.508773 Oct 04 20:35:06.736715 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 247/482] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:06 2022] GET /compute/v2.1/servers/486112b2-497b-4039-ac04-b23cf076d470 => generated 1536 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:06.745424 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-8d5609d4-1849-423c-ada1-b7bc5cd012fa tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:06.746367 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-8d5609d4-1849-423c-ada1-b7bc5cd012fa tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] [instance: c6cdf5bb-821d-4438-9c05-f227c4ebbbcd] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:06.753443 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8d5609d4-1849-423c-ada1-b7bc5cd012fa tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:06.754248 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8d5609d4-1849-423c-ada1-b7bc5cd012fa tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:06.761272 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8d5609d4-1849-423c-ada1-b7bc5cd012fa tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:06.762499 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8d5609d4-1849-423c-ada1-b7bc5cd012fa tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:06.763395 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8d5609d4-1849-423c-ada1-b7bc5cd012fa tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:06.764046 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8d5609d4-1849-423c-ada1-b7bc5cd012fa tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:06.862104 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-8d5609d4-1849-423c-ada1-b7bc5cd012fa tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5eda279f6034608b192839a54dda616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f28e80977de42a892b84295ecf05141', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:06.871742 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-8d5609d4-1849-423c-ada1-b7bc5cd012fa tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] 10.222.0.33 "GET /compute/v2.1/servers/c6cdf5bb-821d-4438-9c05-f227c4ebbbcd" status: 200 len: 1314 microversion: 2.1 time: 0.133038 Oct 04 20:35:06.873951 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 248/483] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:06 2022] GET /compute/v2.1/servers/c6cdf5bb-821d-4438-9c05-f227c4ebbbcd => generated 1314 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:06.879703 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-676be3a9-667e-4678-852d-cb15592436f6 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:06.881012 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-676be3a9-667e-4678-852d-cb15592436f6 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] [instance: 9e9f6289-9999-4188-9af1-6cf64a676eee] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:06.888085 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:35:06.889675 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-676be3a9-667e-4678-852d-cb15592436f6 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:06.890427 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-676be3a9-667e-4678-852d-cb15592436f6 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:06.890914 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-676be3a9-667e-4678-852d-cb15592436f6 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:06.891878 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-676be3a9-667e-4678-852d-cb15592436f6 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:06.892670 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-676be3a9-667e-4678-852d-cb15592436f6 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:06.893443 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-676be3a9-667e-4678-852d-cb15592436f6 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:06.999690 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-3606aa9a-6ef4-4b4e-b4af-c5ab18be65ca tempest-ServicesAdminNegativeTestJSON-208783263 tempest-ServicesAdminNegativeTestJSON-208783263-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:07.003476 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3606aa9a-6ef4-4b4e-b4af-c5ab18be65ca tempest-ServicesAdminNegativeTestJSON-208783263 tempest-ServicesAdminNegativeTestJSON-208783263-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:07.003961 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3606aa9a-6ef4-4b4e-b4af-c5ab18be65ca tempest-ServicesAdminNegativeTestJSON-208783263 tempest-ServicesAdminNegativeTestJSON-208783263-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:07.011037 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3606aa9a-6ef4-4b4e-b4af-c5ab18be65ca tempest-ServicesAdminNegativeTestJSON-208783263 tempest-ServicesAdminNegativeTestJSON-208783263-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:07.012139 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3606aa9a-6ef4-4b4e-b4af-c5ab18be65ca tempest-ServicesAdminNegativeTestJSON-208783263 tempest-ServicesAdminNegativeTestJSON-208783263-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:07.012947 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3606aa9a-6ef4-4b4e-b4af-c5ab18be65ca tempest-ServicesAdminNegativeTestJSON-208783263 tempest-ServicesAdminNegativeTestJSON-208783263-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:07.013534 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3606aa9a-6ef4-4b4e-b4af-c5ab18be65ca tempest-ServicesAdminNegativeTestJSON-208783263 tempest-ServicesAdminNegativeTestJSON-208783263-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:07.042963 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-3606aa9a-6ef4-4b4e-b4af-c5ab18be65ca tempest-ServicesAdminNegativeTestJSON-208783263 tempest-ServicesAdminNegativeTestJSON-208783263-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.432858 Oct 04 20:35:07.043791 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 236/484] 10.222.0.33 () {58 vars in 1137 bytes} [Tue Oct 4 20:35:06 2022] GET /compute/v2.1/os-services => generated 944 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:35:07.058504 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-835982cb-ae18-4429-9a41-c330dcc7c5eb tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-619009497", "imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63", "flavorRef": "452"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:35:07.140316 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.network.neutron [None req-835982cb-ae18-4429-9a41-c330dcc7c5eb tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] validate_networks() for None {{(pid=128801) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:35:07.314241 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-676be3a9-667e-4678-852d-cb15592436f6 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3563efe2b8c94931a2a46c4e14811b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3118a5d96843d3bede1ed94bd9717e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:07.322914 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-676be3a9-667e-4678-852d-cb15592436f6 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] 10.222.0.33 "GET /compute/v2.1/servers/9e9f6289-9999-4188-9af1-6cf64a676eee" status: 200 len: 1471 microversion: 2.1 time: 0.447407 Oct 04 20:35:07.323747 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 249/485] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:06 2022] GET /compute/v2.1/servers/9e9f6289-9999-4188-9af1-6cf64a676eee => generated 1471 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:07.344956 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-b53c8727-8582-4ed9-b08d-2a1148ddff1a tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] Action: 'create', calling method: .version_select at 0x7f3c74e34e50>, body: {"pool": "7ace76e5-f8c6-495a-b11c-0ae1f7a6ece8"} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:35:07.920157 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-835982cb-ae18-4429-9a41-c330dcc7c5eb tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Flavor limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:35:07.922645 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-835982cb-ae18-4429-9a41-c330dcc7c5eb tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Image limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:35:07.926537 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-835982cb-ae18-4429-9a41-c330dcc7c5eb tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Flavor pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:35:07.929125 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-835982cb-ae18-4429-9a41-c330dcc7c5eb tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Image pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:35:07.932130 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-835982cb-ae18-4429-9a41-c330dcc7c5eb tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:35:07.953215 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-835982cb-ae18-4429-9a41-c330dcc7c5eb tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:07.956892 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-835982cb-ae18-4429-9a41-c330dcc7c5eb tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:07.957337 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-835982cb-ae18-4429-9a41-c330dcc7c5eb tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:07.960900 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-835982cb-ae18-4429-9a41-c330dcc7c5eb tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:07.962819 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-835982cb-ae18-4429-9a41-c330dcc7c5eb tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:07.965087 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-835982cb-ae18-4429-9a41-c330dcc7c5eb tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:08.017553 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-835982cb-ae18-4429-9a41-c330dcc7c5eb tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Getting quotas for project 18f0707d756b4ee085a19cccf3ab82c0. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:35:08.031284 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-835982cb-ae18-4429-9a41-c330dcc7c5eb tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Getting quotas for user f051a291d59242469f8172a9c474ac89 and project 18f0707d756b4ee085a19cccf3ab82c0. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:35:08.069842 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-835982cb-ae18-4429-9a41-c330dcc7c5eb tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Going to run 1 instances... {{(pid=128801) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:35:08.075463 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-835982cb-ae18-4429-9a41-c330dcc7c5eb tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] [instance: dd727dc7-96ee-4553-84ca-0f9b6ed59781] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='15b24725-0c99-4bcf-b1fb-907cdf8e2d63',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128801) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:35:08.185468 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-835982cb-ae18-4429-9a41-c330dcc7c5eb tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.132197 Oct 04 20:35:08.192037 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 237/486] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 20:35:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 1140 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 20:35:08.199626 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9dc0ba1a-cb3d-4ac3-856b-ed6841f18aff tempest-ServicesAdminNegativeTestJSON-208783263 tempest-ServicesAdminNegativeTestJSON-208783263-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:08.204416 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9dc0ba1a-cb3d-4ac3-856b-ed6841f18aff tempest-ServicesAdminNegativeTestJSON-208783263 tempest-ServicesAdminNegativeTestJSON-208783263-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:08.205068 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9dc0ba1a-cb3d-4ac3-856b-ed6841f18aff tempest-ServicesAdminNegativeTestJSON-208783263 tempest-ServicesAdminNegativeTestJSON-208783263-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:08.205648 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9dc0ba1a-cb3d-4ac3-856b-ed6841f18aff tempest-ServicesAdminNegativeTestJSON-208783263 tempest-ServicesAdminNegativeTestJSON-208783263-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:08.206657 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9dc0ba1a-cb3d-4ac3-856b-ed6841f18aff tempest-ServicesAdminNegativeTestJSON-208783263 tempest-ServicesAdminNegativeTestJSON-208783263-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:08.207254 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9dc0ba1a-cb3d-4ac3-856b-ed6841f18aff tempest-ServicesAdminNegativeTestJSON-208783263 tempest-ServicesAdminNegativeTestJSON-208783263-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:08.207779 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9dc0ba1a-cb3d-4ac3-856b-ed6841f18aff tempest-ServicesAdminNegativeTestJSON-208783263 tempest-ServicesAdminNegativeTestJSON-208783263-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:08.241566 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-9dc0ba1a-cb3d-4ac3-856b-ed6841f18aff tempest-ServicesAdminNegativeTestJSON-208783263 tempest-ServicesAdminNegativeTestJSON-208783263-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.048105 Oct 04 20:35:08.242205 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 238/487] 10.222.0.33 () {58 vars in 1170 bytes} [Tue Oct 4 20:35:08 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 944 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:35:08.255218 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c39a8138-0c08-4638-835b-a7d11c605244 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:08.255837 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c39a8138-0c08-4638-835b-a7d11c605244 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] [instance: 2457c5d1-8842-4a2d-a5d4-fe97b53b64df] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:08.270041 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c39a8138-0c08-4638-835b-a7d11c605244 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:08.280066 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c39a8138-0c08-4638-835b-a7d11c605244 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:08.280066 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c39a8138-0c08-4638-835b-a7d11c605244 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:08.280066 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c39a8138-0c08-4638-835b-a7d11c605244 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:08.280542 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c39a8138-0c08-4638-835b-a7d11c605244 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:08.280885 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c39a8138-0c08-4638-835b-a7d11c605244 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:08.728119 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c39a8138-0c08-4638-835b-a7d11c605244 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cbd31af13444cda97ba5f8c99d19437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a307499cf44d03a1e9bb61f614f099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:08.741209 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c39a8138-0c08-4638-835b-a7d11c605244 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] 10.222.0.33 "GET /compute/v2.1/servers/2457c5d1-8842-4a2d-a5d4-fe97b53b64df" status: 200 len: 1320 microversion: 2.1 time: 0.492368 Oct 04 20:35:08.746619 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 239/488] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:08 2022] GET /compute/v2.1/servers/2457c5d1-8842-4a2d-a5d4-fe97b53b64df => generated 1320 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:08.755964 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5d99e35a-596d-4f84-bcf1-2835314d1118 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:08.756836 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-5d99e35a-596d-4f84-bcf1-2835314d1118 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] [instance: c6cdf5bb-821d-4438-9c05-f227c4ebbbcd] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:08.766726 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5d99e35a-596d-4f84-bcf1-2835314d1118 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:08.767546 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5d99e35a-596d-4f84-bcf1-2835314d1118 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:08.768976 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5d99e35a-596d-4f84-bcf1-2835314d1118 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:08.770248 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5d99e35a-596d-4f84-bcf1-2835314d1118 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:08.771796 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5d99e35a-596d-4f84-bcf1-2835314d1118 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:08.774206 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5d99e35a-596d-4f84-bcf1-2835314d1118 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:08.930523 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-5d99e35a-596d-4f84-bcf1-2835314d1118 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5eda279f6034608b192839a54dda616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f28e80977de42a892b84295ecf05141', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:08.939998 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5d99e35a-596d-4f84-bcf1-2835314d1118 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] 10.222.0.33 "GET /compute/v2.1/servers/c6cdf5bb-821d-4438-9c05-f227c4ebbbcd" status: 200 len: 1320 microversion: 2.1 time: 0.192127 Oct 04 20:35:08.946178 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 240/489] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:08 2022] GET /compute/v2.1/servers/c6cdf5bb-821d-4438-9c05-f227c4ebbbcd => generated 1320 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:09.186782 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-eb3144e6-a5fe-487c-b7f6-c834338335fa tempest-ServicesAdminNegativeV253TestJSON-1306637215 tempest-ServicesAdminNegativeV253TestJSON-1306637215-project-admin] Action: 'update', calling method: .version_select at 0x7f3c74d2c160>, body: {"status": "disabled", "disabled_reason": "maintenance"} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:35:09.191069 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-eb3144e6-a5fe-487c-b7f6-c834338335fa tempest-ServicesAdminNegativeV253TestJSON-1306637215 tempest-ServicesAdminNegativeV253TestJSON-1306637215-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:09.191589 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-eb3144e6-a5fe-487c-b7f6-c834338335fa tempest-ServicesAdminNegativeV253TestJSON-1306637215 tempest-ServicesAdminNegativeV253TestJSON-1306637215-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:09.203248 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-eb3144e6-a5fe-487c-b7f6-c834338335fa tempest-ServicesAdminNegativeV253TestJSON-1306637215 tempest-ServicesAdminNegativeV253TestJSON-1306637215-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:09.226075 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-eb3144e6-a5fe-487c-b7f6-c834338335fa tempest-ServicesAdminNegativeV253TestJSON-1306637215 tempest-ServicesAdminNegativeV253TestJSON-1306637215-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:09.227157 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-eb3144e6-a5fe-487c-b7f6-c834338335fa tempest-ServicesAdminNegativeV253TestJSON-1306637215 tempest-ServicesAdminNegativeV253TestJSON-1306637215-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:09.230847 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-eb3144e6-a5fe-487c-b7f6-c834338335fa tempest-ServicesAdminNegativeV253TestJSON-1306637215 tempest-ServicesAdminNegativeV253TestJSON-1306637215-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:09.257349 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-eb3144e6-a5fe-487c-b7f6-c834338335fa tempest-ServicesAdminNegativeV253TestJSON-1306637215 tempest-ServicesAdminNegativeV253TestJSON-1306637215-project-admin] HTTP exception thrown: Service ba4a3272-ead1-41df-a01f-cd049fd91992 could not be found. Oct 04 20:35:09.260738 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-eb3144e6-a5fe-487c-b7f6-c834338335fa tempest-ServicesAdminNegativeV253TestJSON-1306637215 tempest-ServicesAdminNegativeV253TestJSON-1306637215-project-admin] Request method failure captured: Oct 04 20:35:09.260738 n-d-854823-8 devstack@n-api.service[128801]: request: PUT /compute/v2.1/os-services/ba4a3272-ead1-41df-a01f-cd049fd91992 HTTP/1.1 Oct 04 20:35:09.260738 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:35:09.260738 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:35:09.260738 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:35:09.260738 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 56 Oct 04 20:35:09.260738 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:35:09.260738 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:35:09.260738 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:35:09.260738 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:35:09.260738 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJj7DOYSgnf60R1Wt1_0C9FYr5kDNfsd6y1eqRpFWBg4HqnQZzizJh5L137zFeMfq3_4f1gCKe493llzw-Ph6eErQBpwApdr4DVxTAgtvgdjQs2Djly0TsG3_xq8VzkhI8hFeGpaCAu7rwe1dBU5F_25VTj5h5x9Ov9S4n3dFeMyaJk Oct 04 20:35:09.260738 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:35:09.260738 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:35:09.260738 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:35:09.260738 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:35:09.260738 n-d-854823-8 devstack@n-api.service[128801]: X-Openstack-Nova-Api-Version: 2.53 Oct 04 20:35:09.260738 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:35:09.260738 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:35:09.260738 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: 7833edb4d728414ca5a9a783ed8763b6 Oct 04 20:35:09.260738 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1306637215 Oct 04 20:35:09.260738 n-d-854823-8 devstack@n-api.service[128801]: X-Role: admin,reader,member Oct 04 20:35:09.260738 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: admin,reader,member Oct 04 20:35:09.262188 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_7833edb4d728414ca5a9a783ed8763b6", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7833edb4d728414ca5a9a783ed8763b6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7833edb4d728414ca5a9a783ed8763b6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/7833edb4d728414ca5a9a783ed8763b6"}]}] Oct 04 20:35:09.262188 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1306637215 Oct 04 20:35:09.262188 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: 7833edb4d728414ca5a9a783ed8763b6 Oct 04 20:35:09.262188 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1306637215 Oct 04 20:35:09.262188 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1306637215-project-admin Oct 04 20:35:09.262188 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:35:09.262188 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:35:09.262188 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: 76fdecaf5e524d2496c1e8adfc9ab634 Oct 04 20:35:09.262188 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1306637215-project-admin Oct 04 20:35:09.262188 n-d-854823-8 devstack@n-api.service[128801]: Oct 04 20:35:09.262188 n-d-854823-8 devstack@n-api.service[128801]: {"status": "disabled", "disabled_reason": "maintenance"} Oct 04 20:35:09.262188 n-d-854823-8 devstack@n-api.service[128801]: method: Oct 04 20:35:09.262188 n-d-854823-8 devstack@n-api.service[128801]: exception: Service ba4a3272-ead1-41df-a01f-cd049fd91992 could not be found. Oct 04 20:35:09.263062 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': 'ba4a3272-ead1-41df-a01f-cd049fd91992', 'body': {'status': 'disabled', 'disabled_reason': 'maintenance'}} Oct 04 20:35:09.263062 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:35:09.263062 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:35:09.263062 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Oct 04 20:35:09.263062 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Oct 04 20:35:09.263062 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 04 20:35:09.263062 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 04 20:35:09.263062 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 04 20:35:09.263062 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:35:09.263062 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:35:09.263062 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:35:09.263062 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:35:09.263062 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Oct 04 20:35:09.263062 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Oct 04 20:35:09.263062 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Oct 04 20:35:09.263062 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Oct 04 20:35:09.263062 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service ba4a3272-ead1-41df-a01f-cd049fd91992 could not be found. Oct 04 20:35:09.263062 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:35:09.263062 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:35:09.263062 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:35:09.263062 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:35:09.266732 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:35:09.266732 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:35:09.266732 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:35:09.266732 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:35:09.266732 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:35:09.266732 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:35:09.266732 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:35:09.266732 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:35:09.266732 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:35:09.266732 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:35:09.266732 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Oct 04 20:35:09.266732 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:35:09.266732 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service ba4a3272-ead1-41df-a01f-cd049fd91992 could not be found. Oct 04 20:35:09.266732 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:35:09.266732 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:35:09.266732 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:35:09.266732 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:35:09.266732 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:35:09.266732 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:35:09.266732 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:35:09.268704 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:35:09.268704 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service ba4a3272-ead1-41df-a01f-cd049fd91992 could not be found. Oct 04 20:35:09.268704 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:35:09.268704 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-eb3144e6-a5fe-487c-b7f6-c834338335fa tempest-ServicesAdminNegativeV253TestJSON-1306637215 tempest-ServicesAdminNegativeV253TestJSON-1306637215-project-admin] Returning 404 to user: Service ba4a3272-ead1-41df-a01f-cd049fd91992 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:35:09.268704 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-eb3144e6-a5fe-487c-b7f6-c834338335fa tempest-ServicesAdminNegativeV253TestJSON-1306637215 tempest-ServicesAdminNegativeV253TestJSON-1306637215-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-services/ba4a3272-ead1-41df-a01f-cd049fd91992" status: 404 len: 110 microversion: 2.53 time: 0.313245 Oct 04 20:35:09.268704 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 241/490] 10.222.0.33 () {62 vars in 1309 bytes} [Tue Oct 4 20:35:08 2022] PUT /compute/v2.1/os-services/ba4a3272-ead1-41df-a01f-cd049fd91992 => generated 110 bytes in 316 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 20:35:09.271631 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-bf820bd3-e4ec-4132-ab90-a372d59631f1 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:09.272542 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-bf820bd3-e4ec-4132-ab90-a372d59631f1 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] [instance: dd727dc7-96ee-4553-84ca-0f9b6ed59781] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:09.284917 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bf820bd3-e4ec-4132-ab90-a372d59631f1 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:09.287794 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bf820bd3-e4ec-4132-ab90-a372d59631f1 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:09.293418 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bf820bd3-e4ec-4132-ab90-a372d59631f1 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:09.295210 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bf820bd3-e4ec-4132-ab90-a372d59631f1 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:09.295994 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bf820bd3-e4ec-4132-ab90-a372d59631f1 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:09.301705 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bf820bd3-e4ec-4132-ab90-a372d59631f1 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:09.505841 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-bf820bd3-e4ec-4132-ab90-a372d59631f1 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f051a291d59242469f8172a9c474ac89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f0707d756b4ee085a19cccf3ab82c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:09.516469 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-bf820bd3-e4ec-4132-ab90-a372d59631f1 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] 10.222.0.33 "GET /compute/v2.1/servers/dd727dc7-96ee-4553-84ca-0f9b6ed59781" status: 200 len: 1214 microversion: 2.1 time: 0.252461 Oct 04 20:35:09.517166 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 242/491] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:09 2022] GET /compute/v2.1/servers/dd727dc7-96ee-4553-84ca-0f9b6ed59781 => generated 1214 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:09.522790 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-092d960d-7182-41a5-a336-28769e9d5ed4 tempest-ServicesAdminNegativeTestJSON-208783263 tempest-ServicesAdminNegativeTestJSON-208783263-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:09.527245 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-092d960d-7182-41a5-a336-28769e9d5ed4 tempest-ServicesAdminNegativeTestJSON-208783263 tempest-ServicesAdminNegativeTestJSON-208783263-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:09.528012 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-092d960d-7182-41a5-a336-28769e9d5ed4 tempest-ServicesAdminNegativeTestJSON-208783263 tempest-ServicesAdminNegativeTestJSON-208783263-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:09.528672 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-092d960d-7182-41a5-a336-28769e9d5ed4 tempest-ServicesAdminNegativeTestJSON-208783263 tempest-ServicesAdminNegativeTestJSON-208783263-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:09.529627 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-092d960d-7182-41a5-a336-28769e9d5ed4 tempest-ServicesAdminNegativeTestJSON-208783263 tempest-ServicesAdminNegativeTestJSON-208783263-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:09.530292 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-092d960d-7182-41a5-a336-28769e9d5ed4 tempest-ServicesAdminNegativeTestJSON-208783263 tempest-ServicesAdminNegativeTestJSON-208783263-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:09.531147 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-092d960d-7182-41a5-a336-28769e9d5ed4 tempest-ServicesAdminNegativeTestJSON-208783263 tempest-ServicesAdminNegativeTestJSON-208783263-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:09.566726 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-092d960d-7182-41a5-a336-28769e9d5ed4 tempest-ServicesAdminNegativeTestJSON-208783263 tempest-ServicesAdminNegativeTestJSON-208783263-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.048230 Oct 04 20:35:09.567559 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 243/492] 10.222.0.33 () {58 vars in 1137 bytes} [Tue Oct 4 20:35:09 2022] GET /compute/v2.1/os-services => generated 944 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:35:09.575062 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0de65fc4-d57f-41f6-ba2e-ad1b778f4f7a tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:09.576024 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-0de65fc4-d57f-41f6-ba2e-ad1b778f4f7a tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] [instance: 9e9f6289-9999-4188-9af1-6cf64a676eee] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:09.582242 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0de65fc4-d57f-41f6-ba2e-ad1b778f4f7a tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:09.583292 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0de65fc4-d57f-41f6-ba2e-ad1b778f4f7a tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:09.583838 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0de65fc4-d57f-41f6-ba2e-ad1b778f4f7a tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:09.584751 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0de65fc4-d57f-41f6-ba2e-ad1b778f4f7a tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:09.585438 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0de65fc4-d57f-41f6-ba2e-ad1b778f4f7a tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:09.585860 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0de65fc4-d57f-41f6-ba2e-ad1b778f4f7a tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:09.918159 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-0de65fc4-d57f-41f6-ba2e-ad1b778f4f7a tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3563efe2b8c94931a2a46c4e14811b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3118a5d96843d3bede1ed94bd9717e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:09.926467 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-0de65fc4-d57f-41f6-ba2e-ad1b778f4f7a tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] 10.222.0.33 "GET /compute/v2.1/servers/9e9f6289-9999-4188-9af1-6cf64a676eee" status: 200 len: 1463 microversion: 2.1 time: 0.357631 Oct 04 20:35:09.927379 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 244/493] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:09 2022] GET /compute/v2.1/servers/9e9f6289-9999-4188-9af1-6cf64a676eee => generated 1463 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:09.940536 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-631c1e8d-58db-447d-a11e-0d1b0079835b req-8cfa739c-8271-466f-a33b-6076954513f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8fdcb1b0-65e9-45d1-b0da-5f603f22a8cf", "name": "network-vif-deleted", "tag": "b156b57a-987c-484d-9b1a-ed22e9a62872"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:35:09.952765 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-631c1e8d-58db-447d-a11e-0d1b0079835b req-8cfa739c-8271-466f-a33b-6076954513f0 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:09.953239 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-631c1e8d-58db-447d-a11e-0d1b0079835b req-8cfa739c-8271-466f-a33b-6076954513f0 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:09.953857 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-631c1e8d-58db-447d-a11e-0d1b0079835b req-8cfa739c-8271-466f-a33b-6076954513f0 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:09.970139 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-631c1e8d-58db-447d-a11e-0d1b0079835b req-8cfa739c-8271-466f-a33b-6076954513f0 service nova] Creating event network-vif-deleted:b156b57a-987c-484d-9b1a-ed22e9a62872 for instance 8fdcb1b0-65e9-45d1-b0da-5f603f22a8cf on n-h2-854823-8 Oct 04 20:35:09.976198 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-631c1e8d-58db-447d-a11e-0d1b0079835b req-8cfa739c-8271-466f-a33b-6076954513f0 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047525 Oct 04 20:35:09.976931 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 245/494] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:35:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:35:10.053166 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ec96499f-e0e4-4351-b70a-b5a6f062c8f5 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-886895121", "imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63", "flavorRef": "452"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:35:10.135385 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.network.neutron [None req-ec96499f-e0e4-4351-b70a-b5a6f062c8f5 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] validate_networks() for None {{(pid=128801) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:35:10.629753 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-b53c8727-8582-4ed9-b08d-2a1148ddff1a tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] 10.222.0.33 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.289331 Oct 04 20:35:10.639563 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 250/495] 10.222.0.33 () {60 vars in 1170 bytes} [Tue Oct 4 20:35:07 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3300 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:35:10.644655 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-fdc28b5a-3f15-4231-98c7-842146f918bd tempest-ServicesAdminNegativeV253TestJSON-1306637215 tempest-ServicesAdminNegativeV253TestJSON-1306637215-project-admin] Action: 'update', calling method: .version_select at 0x7f3c74d873a0>, body: {"status": "disabled"} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:35:10.648523 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fdc28b5a-3f15-4231-98c7-842146f918bd tempest-ServicesAdminNegativeV253TestJSON-1306637215 tempest-ServicesAdminNegativeV253TestJSON-1306637215-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:10.649709 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fdc28b5a-3f15-4231-98c7-842146f918bd tempest-ServicesAdminNegativeV253TestJSON-1306637215 tempest-ServicesAdminNegativeV253TestJSON-1306637215-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:10.650371 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fdc28b5a-3f15-4231-98c7-842146f918bd tempest-ServicesAdminNegativeV253TestJSON-1306637215 tempest-ServicesAdminNegativeV253TestJSON-1306637215-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:10.659435 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fdc28b5a-3f15-4231-98c7-842146f918bd tempest-ServicesAdminNegativeV253TestJSON-1306637215 tempest-ServicesAdminNegativeV253TestJSON-1306637215-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:10.660204 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fdc28b5a-3f15-4231-98c7-842146f918bd tempest-ServicesAdminNegativeV253TestJSON-1306637215 tempest-ServicesAdminNegativeV253TestJSON-1306637215-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:10.660893 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fdc28b5a-3f15-4231-98c7-842146f918bd tempest-ServicesAdminNegativeV253TestJSON-1306637215 tempest-ServicesAdminNegativeV253TestJSON-1306637215-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:10.668175 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.wsgi [None req-fdc28b5a-3f15-4231-98c7-842146f918bd tempest-ServicesAdminNegativeV253TestJSON-1306637215 tempest-ServicesAdminNegativeV253TestJSON-1306637215-project-admin] HTTP exception thrown: Service ba4a3272-ead1-41df-a01f-cd049fd91992 could not be found. Oct 04 20:35:10.670413 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-fdc28b5a-3f15-4231-98c7-842146f918bd tempest-ServicesAdminNegativeV253TestJSON-1306637215 tempest-ServicesAdminNegativeV253TestJSON-1306637215-project-admin] Request method failure captured: Oct 04 20:35:10.670413 n-d-854823-8 devstack@n-api.service[128802]: request: PUT /compute/v2.1/os-services/ba4a3272-ead1-41df-a01f-cd049fd91992 HTTP/1.1 Oct 04 20:35:10.670413 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 20:35:10.670413 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 20:35:10.670413 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 20:35:10.670413 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 22 Oct 04 20:35:10.670413 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 20:35:10.670413 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 20:35:10.670413 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 20:35:10.670413 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 20:35:10.670413 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPJj7DOYSgnf60R1Wt1_0C9FYr5kDNfsd6y1eqRpFWBg4HqnQZzizJh5L137zFeMfq3_4f1gCKe493llzw-Ph6eErQBpwApdr4DVxTAgtvgdjQs2Djly0TsG3_xq8VzkhI8hFeGpaCAu7rwe1dBU5F_25VTj5h5x9Ov9S4n3dFeMyaJk Oct 04 20:35:10.670413 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 20:35:10.670413 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 20:35:10.670413 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 20:35:10.670413 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 20:35:10.670413 n-d-854823-8 devstack@n-api.service[128802]: X-Openstack-Nova-Api-Version: 2.53 Oct 04 20:35:10.670413 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 20:35:10.670413 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 20:35:10.670413 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: 7833edb4d728414ca5a9a783ed8763b6 Oct 04 20:35:10.670413 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1306637215 Oct 04 20:35:10.670413 n-d-854823-8 devstack@n-api.service[128802]: X-Role: admin,reader,member Oct 04 20:35:10.670413 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: admin,reader,member Oct 04 20:35:10.672020 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_7833edb4d728414ca5a9a783ed8763b6", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7833edb4d728414ca5a9a783ed8763b6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7833edb4d728414ca5a9a783ed8763b6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/7833edb4d728414ca5a9a783ed8763b6"}]}] Oct 04 20:35:10.672020 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1306637215 Oct 04 20:35:10.672020 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: 7833edb4d728414ca5a9a783ed8763b6 Oct 04 20:35:10.672020 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1306637215 Oct 04 20:35:10.672020 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1306637215-project-admin Oct 04 20:35:10.672020 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 20:35:10.672020 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 20:35:10.672020 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: 76fdecaf5e524d2496c1e8adfc9ab634 Oct 04 20:35:10.672020 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1306637215-project-admin Oct 04 20:35:10.672020 n-d-854823-8 devstack@n-api.service[128802]: Oct 04 20:35:10.672020 n-d-854823-8 devstack@n-api.service[128802]: {"status": "disabled"} Oct 04 20:35:10.672020 n-d-854823-8 devstack@n-api.service[128802]: method: Oct 04 20:35:10.672020 n-d-854823-8 devstack@n-api.service[128802]: exception: Service ba4a3272-ead1-41df-a01f-cd049fd91992 could not be found. Oct 04 20:35:10.672020 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'id': 'ba4a3272-ead1-41df-a01f-cd049fd91992', 'body': {'status': 'disabled'}} Oct 04 20:35:10.672972 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:35:10.672972 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:35:10.672972 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Oct 04 20:35:10.672972 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Oct 04 20:35:10.672972 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 04 20:35:10.672972 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 04 20:35:10.672972 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 04 20:35:10.672972 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:35:10.672972 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:35:10.672972 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:35:10.672972 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:35:10.672972 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Oct 04 20:35:10.672972 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Oct 04 20:35:10.672972 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Oct 04 20:35:10.672972 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Oct 04 20:35:10.672972 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service ba4a3272-ead1-41df-a01f-cd049fd91992 could not be found. Oct 04 20:35:10.672972 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:35:10.672972 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:35:10.672972 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:35:10.672972 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:35:10.672972 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:35:10.674320 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:35:10.674320 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:35:10.674320 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:35:10.674320 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:35:10.674320 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:35:10.674320 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:35:10.674320 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:35:10.674320 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:35:10.674320 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:35:10.674320 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Oct 04 20:35:10.674320 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:35:10.674320 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service ba4a3272-ead1-41df-a01f-cd049fd91992 could not be found. Oct 04 20:35:10.674320 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:35:10.674320 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:35:10.674320 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:35:10.674320 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:35:10.674320 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:35:10.674320 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:35:10.674320 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:35:10.674320 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:35:10.675699 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service ba4a3272-ead1-41df-a01f-cd049fd91992 could not be found. Oct 04 20:35:10.675699 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:35:10.676755 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-fdc28b5a-3f15-4231-98c7-842146f918bd tempest-ServicesAdminNegativeV253TestJSON-1306637215 tempest-ServicesAdminNegativeV253TestJSON-1306637215-project-admin] Returning 404 to user: Service ba4a3272-ead1-41df-a01f-cd049fd91992 could not be found. {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:35:10.677692 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-fdc28b5a-3f15-4231-98c7-842146f918bd tempest-ServicesAdminNegativeV253TestJSON-1306637215 tempest-ServicesAdminNegativeV253TestJSON-1306637215-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-services/ba4a3272-ead1-41df-a01f-cd049fd91992" status: 404 len: 110 microversion: 2.53 time: 0.036913 Oct 04 20:35:10.683708 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 251/496] 10.222.0.33 () {62 vars in 1309 bytes} [Tue Oct 4 20:35:10 2022] PUT /compute/v2.1/os-services/ba4a3272-ead1-41df-a01f-cd049fd91992 => generated 110 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 20:35:10.684297 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-468a0de5-b6e5-4559-8072-6edcd36e30ce tempest-ServicesAdminNegativeTestJSON-208783263 tempest-ServicesAdminNegativeTestJSON-208783263-project-admin] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:10.691896 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-ec96499f-e0e4-4351-b70a-b5a6f062c8f5 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Flavor limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:35:10.692580 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-ec96499f-e0e4-4351-b70a-b5a6f062c8f5 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Image limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:35:10.693400 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-ec96499f-e0e4-4351-b70a-b5a6f062c8f5 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Flavor pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:35:10.694332 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-ec96499f-e0e4-4351-b70a-b5a6f062c8f5 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Image pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:35:10.695062 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-ec96499f-e0e4-4351-b70a-b5a6f062c8f5 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:35:10.695194 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-468a0de5-b6e5-4559-8072-6edcd36e30ce tempest-ServicesAdminNegativeTestJSON-208783263 tempest-ServicesAdminNegativeTestJSON-208783263-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:10.695746 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-468a0de5-b6e5-4559-8072-6edcd36e30ce tempest-ServicesAdminNegativeTestJSON-208783263 tempest-ServicesAdminNegativeTestJSON-208783263-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:10.696265 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-468a0de5-b6e5-4559-8072-6edcd36e30ce tempest-ServicesAdminNegativeTestJSON-208783263 tempest-ServicesAdminNegativeTestJSON-208783263-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:10.697230 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-468a0de5-b6e5-4559-8072-6edcd36e30ce tempest-ServicesAdminNegativeTestJSON-208783263 tempest-ServicesAdminNegativeTestJSON-208783263-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:10.697877 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-468a0de5-b6e5-4559-8072-6edcd36e30ce tempest-ServicesAdminNegativeTestJSON-208783263 tempest-ServicesAdminNegativeTestJSON-208783263-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:10.706704 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-468a0de5-b6e5-4559-8072-6edcd36e30ce tempest-ServicesAdminNegativeTestJSON-208783263 tempest-ServicesAdminNegativeTestJSON-208783263-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:10.714611 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ec96499f-e0e4-4351-b70a-b5a6f062c8f5 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:10.715787 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ec96499f-e0e4-4351-b70a-b5a6f062c8f5 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:10.716296 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ec96499f-e0e4-4351-b70a-b5a6f062c8f5 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:10.719276 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ec96499f-e0e4-4351-b70a-b5a6f062c8f5 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:10.720475 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ec96499f-e0e4-4351-b70a-b5a6f062c8f5 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:10.720919 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ec96499f-e0e4-4351-b70a-b5a6f062c8f5 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:10.735304 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-468a0de5-b6e5-4559-8072-6edcd36e30ce tempest-ServicesAdminNegativeTestJSON-208783263 tempest-ServicesAdminNegativeTestJSON-208783263-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services?host=n-d-854823-8&binary=xxx" status: 200 len: 16 microversion: 2.1 time: 0.055415 Oct 04 20:35:10.736708 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 252/497] 10.222.0.33 () {58 vars in 1194 bytes} [Tue Oct 4 20:35:10 2022] GET /compute/v2.1/os-services?host=n-d-854823-8&binary=xxx => generated 16 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 20:35:10.741443 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-cba3300c-a2d1-41b9-ac0a-9cc55f474cec tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:10.742097 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-cba3300c-a2d1-41b9-ac0a-9cc55f474cec tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] [instance: 2457c5d1-8842-4a2d-a5d4-fe97b53b64df] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:10.749056 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cba3300c-a2d1-41b9-ac0a-9cc55f474cec tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:10.749755 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cba3300c-a2d1-41b9-ac0a-9cc55f474cec tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:10.750372 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cba3300c-a2d1-41b9-ac0a-9cc55f474cec tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:10.751261 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cba3300c-a2d1-41b9-ac0a-9cc55f474cec tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:10.751868 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cba3300c-a2d1-41b9-ac0a-9cc55f474cec tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:10.752443 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cba3300c-a2d1-41b9-ac0a-9cc55f474cec tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:10.760664 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-ec96499f-e0e4-4351-b70a-b5a6f062c8f5 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Getting quotas for project c288268acb30475bbc065a8f72cb21d5. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:35:10.766184 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-ec96499f-e0e4-4351-b70a-b5a6f062c8f5 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Getting quotas for user b4a24944aeb34a5ea228965be9bf4ce0 and project c288268acb30475bbc065a8f72cb21d5. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:35:10.793787 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ec96499f-e0e4-4351-b70a-b5a6f062c8f5 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Going to run 1 instances... {{(pid=128801) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:35:10.796450 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ec96499f-e0e4-4351-b70a-b5a6f062c8f5 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] [instance: 9f8cc082-0a37-4123-a680-1210a90b3ca9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='15b24725-0c99-4bcf-b1fb-907cdf8e2d63',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128801) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:35:10.839619 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:INSERT=11,nova_api:SELECT=89 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:35:10.872648 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ec96499f-e0e4-4351-b70a-b5a6f062c8f5 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.894161 Oct 04 20:35:10.875894 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 246/498] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 20:35:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 898 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 20:35:10.881947 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7b4d5347-8c9f-4b04-b312-04981786fc4e tempest-MigrationsAdminTest-1312330847 tempest-MigrationsAdminTest-1312330847-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:10.882672 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-7b4d5347-8c9f-4b04-b312-04981786fc4e tempest-MigrationsAdminTest-1312330847 tempest-MigrationsAdminTest-1312330847-project-admin] [instance: 9e9f6289-9999-4188-9af1-6cf64a676eee] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:10.906471 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7b4d5347-8c9f-4b04-b312-04981786fc4e tempest-MigrationsAdminTest-1312330847 tempest-MigrationsAdminTest-1312330847-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:10.907235 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7b4d5347-8c9f-4b04-b312-04981786fc4e tempest-MigrationsAdminTest-1312330847 tempest-MigrationsAdminTest-1312330847-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:10.908067 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7b4d5347-8c9f-4b04-b312-04981786fc4e tempest-MigrationsAdminTest-1312330847 tempest-MigrationsAdminTest-1312330847-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:10.909504 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7b4d5347-8c9f-4b04-b312-04981786fc4e tempest-MigrationsAdminTest-1312330847 tempest-MigrationsAdminTest-1312330847-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:10.910039 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7b4d5347-8c9f-4b04-b312-04981786fc4e tempest-MigrationsAdminTest-1312330847 tempest-MigrationsAdminTest-1312330847-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:10.910882 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7b4d5347-8c9f-4b04-b312-04981786fc4e tempest-MigrationsAdminTest-1312330847 tempest-MigrationsAdminTest-1312330847-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:11.161313 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-cba3300c-a2d1-41b9-ac0a-9cc55f474cec tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cbd31af13444cda97ba5f8c99d19437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a307499cf44d03a1e9bb61f614f099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:11.172263 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-cba3300c-a2d1-41b9-ac0a-9cc55f474cec tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] 10.222.0.33 "GET /compute/v2.1/servers/2457c5d1-8842-4a2d-a5d4-fe97b53b64df" status: 200 len: 1320 microversion: 2.1 time: 0.434152 Oct 04 20:35:11.190829 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 253/499] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:10 2022] GET /compute/v2.1/servers/2457c5d1-8842-4a2d-a5d4-fe97b53b64df => generated 1320 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:11.205893 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-f7fbbb70-9996-4d30-9de8-3b3fe39aaced tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:11.206785 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-f7fbbb70-9996-4d30-9de8-3b3fe39aaced tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] [instance: c6cdf5bb-821d-4438-9c05-f227c4ebbbcd] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:11.214177 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f7fbbb70-9996-4d30-9de8-3b3fe39aaced tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:11.214924 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f7fbbb70-9996-4d30-9de8-3b3fe39aaced tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:11.215667 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f7fbbb70-9996-4d30-9de8-3b3fe39aaced tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:11.216554 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f7fbbb70-9996-4d30-9de8-3b3fe39aaced tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:11.217099 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f7fbbb70-9996-4d30-9de8-3b3fe39aaced tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:11.217621 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f7fbbb70-9996-4d30-9de8-3b3fe39aaced tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:11.421968 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-7b4d5347-8c9f-4b04-b312-04981786fc4e tempest-MigrationsAdminTest-1312330847 tempest-MigrationsAdminTest-1312330847-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/9e9f6289-9999-4188-9af1-6cf64a676eee" status: 200 len: 1614 microversion: 2.1 time: 0.544800 Oct 04 20:35:11.425507 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 247/500] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:10 2022] GET /compute/v2.1/servers/9e9f6289-9999-4188-9af1-6cf64a676eee => generated 1614 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:11.432292 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f2c1fa90-7e3e-4f63-b7b2-862f45fb3180 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:11.433329 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f2c1fa90-7e3e-4f63-b7b2-862f45fb3180 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] [instance: dd727dc7-96ee-4553-84ca-0f9b6ed59781] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:11.441264 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f2c1fa90-7e3e-4f63-b7b2-862f45fb3180 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:11.442245 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f2c1fa90-7e3e-4f63-b7b2-862f45fb3180 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:11.442975 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f2c1fa90-7e3e-4f63-b7b2-862f45fb3180 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:11.445707 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f2c1fa90-7e3e-4f63-b7b2-862f45fb3180 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:11.446247 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-f7fbbb70-9996-4d30-9de8-3b3fe39aaced tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5eda279f6034608b192839a54dda616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f28e80977de42a892b84295ecf05141', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:11.447692 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f2c1fa90-7e3e-4f63-b7b2-862f45fb3180 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:11.448398 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f2c1fa90-7e3e-4f63-b7b2-862f45fb3180 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:11.463748 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-f7fbbb70-9996-4d30-9de8-3b3fe39aaced tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] 10.222.0.33 "GET /compute/v2.1/servers/c6cdf5bb-821d-4438-9c05-f227c4ebbbcd" status: 200 len: 1387 microversion: 2.1 time: 0.271075 Oct 04 20:35:11.467072 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 254/501] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:11 2022] GET /compute/v2.1/servers/c6cdf5bb-821d-4438-9c05-f227c4ebbbcd => generated 1387 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:11.475401 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-9484e2b0-b533-4a5b-8f8f-6f64df1d7056 tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] Action: 'action', calling method: .version_select at 0x7f3c76319d30>, body: {"addFloatingIp": {"address": "172.25.4.102"}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:35:11.480117 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-9484e2b0-b533-4a5b-8f8f-6f64df1d7056 tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] [instance: 486112b2-497b-4039-ac04-b23cf076d470] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:11.503365 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9484e2b0-b533-4a5b-8f8f-6f64df1d7056 tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:11.503885 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9484e2b0-b533-4a5b-8f8f-6f64df1d7056 tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:11.504291 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9484e2b0-b533-4a5b-8f8f-6f64df1d7056 tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:11.505005 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9484e2b0-b533-4a5b-8f8f-6f64df1d7056 tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:11.505523 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9484e2b0-b533-4a5b-8f8f-6f64df1d7056 tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:11.505880 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9484e2b0-b533-4a5b-8f8f-6f64df1d7056 tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:11.619027 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9484e2b0-b533-4a5b-8f8f-6f64df1d7056 tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] Acquiring lock "refresh_cache-486112b2-497b-4039-ac04-b23cf076d470" {{(pid=128802) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 04 20:35:11.619627 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9484e2b0-b533-4a5b-8f8f-6f64df1d7056 tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] Acquired lock "refresh_cache-486112b2-497b-4039-ac04-b23cf076d470" {{(pid=128802) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 04 20:35:12.206838 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f2c1fa90-7e3e-4f63-b7b2-862f45fb3180 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f051a291d59242469f8172a9c474ac89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f0707d756b4ee085a19cccf3ab82c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:12.223122 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f2c1fa90-7e3e-4f63-b7b2-862f45fb3180 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] 10.222.0.33 "GET /compute/v2.1/servers/dd727dc7-96ee-4553-84ca-0f9b6ed59781" status: 200 len: 1318 microversion: 2.1 time: 0.796143 Oct 04 20:35:12.224518 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 248/502] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:11 2022] GET /compute/v2.1/servers/dd727dc7-96ee-4553-84ca-0f9b6ed59781 => generated 1318 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:12.233258 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c67637de-660a-4943-9f71-a8af0c2c4dfa tempest-ServicesAdminNegativeV253TestJSON-1306637215 tempest-ServicesAdminNegativeV253TestJSON-1306637215-project-admin] Action: 'update', calling method: .version_select at 0x7f3c74d5a700>, body: {"status": "enabled"} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:35:12.244727 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c67637de-660a-4943-9f71-a8af0c2c4dfa tempest-ServicesAdminNegativeV253TestJSON-1306637215 tempest-ServicesAdminNegativeV253TestJSON-1306637215-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:12.247986 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c67637de-660a-4943-9f71-a8af0c2c4dfa tempest-ServicesAdminNegativeV253TestJSON-1306637215 tempest-ServicesAdminNegativeV253TestJSON-1306637215-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:12.248827 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c67637de-660a-4943-9f71-a8af0c2c4dfa tempest-ServicesAdminNegativeV253TestJSON-1306637215 tempest-ServicesAdminNegativeV253TestJSON-1306637215-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:12.267323 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c67637de-660a-4943-9f71-a8af0c2c4dfa tempest-ServicesAdminNegativeV253TestJSON-1306637215 tempest-ServicesAdminNegativeV253TestJSON-1306637215-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:12.268199 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c67637de-660a-4943-9f71-a8af0c2c4dfa tempest-ServicesAdminNegativeV253TestJSON-1306637215 tempest-ServicesAdminNegativeV253TestJSON-1306637215-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:12.269637 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c67637de-660a-4943-9f71-a8af0c2c4dfa tempest-ServicesAdminNegativeV253TestJSON-1306637215 tempest-ServicesAdminNegativeV253TestJSON-1306637215-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:12.278515 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-c67637de-660a-4943-9f71-a8af0c2c4dfa tempest-ServicesAdminNegativeV253TestJSON-1306637215 tempest-ServicesAdminNegativeV253TestJSON-1306637215-project-admin] HTTP exception thrown: Service ba4a3272-ead1-41df-a01f-cd049fd91992 could not be found. Oct 04 20:35:12.281221 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c67637de-660a-4943-9f71-a8af0c2c4dfa tempest-ServicesAdminNegativeV253TestJSON-1306637215 tempest-ServicesAdminNegativeV253TestJSON-1306637215-project-admin] Request method failure captured: Oct 04 20:35:12.281221 n-d-854823-8 devstack@n-api.service[128801]: request: PUT /compute/v2.1/os-services/ba4a3272-ead1-41df-a01f-cd049fd91992 HTTP/1.1 Oct 04 20:35:12.281221 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:35:12.281221 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:35:12.281221 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:35:12.281221 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 21 Oct 04 20:35:12.281221 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:35:12.281221 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:35:12.281221 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:35:12.281221 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:35:12.281221 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJj7DOYSgnf60R1Wt1_0C9FYr5kDNfsd6y1eqRpFWBg4HqnQZzizJh5L137zFeMfq3_4f1gCKe493llzw-Ph6eErQBpwApdr4DVxTAgtvgdjQs2Djly0TsG3_xq8VzkhI8hFeGpaCAu7rwe1dBU5F_25VTj5h5x9Ov9S4n3dFeMyaJk Oct 04 20:35:12.281221 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:35:12.281221 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:35:12.281221 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:35:12.281221 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:35:12.281221 n-d-854823-8 devstack@n-api.service[128801]: X-Openstack-Nova-Api-Version: 2.53 Oct 04 20:35:12.281221 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:35:12.281221 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:35:12.281221 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: 7833edb4d728414ca5a9a783ed8763b6 Oct 04 20:35:12.281221 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1306637215 Oct 04 20:35:12.281221 n-d-854823-8 devstack@n-api.service[128801]: X-Role: admin,reader,member Oct 04 20:35:12.281221 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: admin,reader,member Oct 04 20:35:12.282738 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_7833edb4d728414ca5a9a783ed8763b6", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7833edb4d728414ca5a9a783ed8763b6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7833edb4d728414ca5a9a783ed8763b6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/7833edb4d728414ca5a9a783ed8763b6"}]}] Oct 04 20:35:12.282738 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1306637215 Oct 04 20:35:12.282738 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: 7833edb4d728414ca5a9a783ed8763b6 Oct 04 20:35:12.282738 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1306637215 Oct 04 20:35:12.282738 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1306637215-project-admin Oct 04 20:35:12.282738 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:35:12.282738 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:35:12.282738 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: 76fdecaf5e524d2496c1e8adfc9ab634 Oct 04 20:35:12.282738 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1306637215-project-admin Oct 04 20:35:12.282738 n-d-854823-8 devstack@n-api.service[128801]: Oct 04 20:35:12.282738 n-d-854823-8 devstack@n-api.service[128801]: {"status": "enabled"} Oct 04 20:35:12.282738 n-d-854823-8 devstack@n-api.service[128801]: method: Oct 04 20:35:12.282738 n-d-854823-8 devstack@n-api.service[128801]: exception: Service ba4a3272-ead1-41df-a01f-cd049fd91992 could not be found. Oct 04 20:35:12.282738 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': 'ba4a3272-ead1-41df-a01f-cd049fd91992', 'body': {'status': 'enabled'}} Oct 04 20:35:12.283554 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:35:12.283554 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:35:12.283554 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Oct 04 20:35:12.283554 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Oct 04 20:35:12.283554 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 04 20:35:12.283554 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 04 20:35:12.283554 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 04 20:35:12.283554 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:35:12.283554 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:35:12.283554 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:35:12.283554 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:35:12.283554 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Oct 04 20:35:12.283554 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Oct 04 20:35:12.283554 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Oct 04 20:35:12.283554 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Oct 04 20:35:12.283554 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service ba4a3272-ead1-41df-a01f-cd049fd91992 could not be found. Oct 04 20:35:12.283554 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:35:12.283554 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:35:12.283554 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:35:12.283554 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:35:12.283554 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:35:12.284732 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:35:12.284732 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:35:12.284732 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:35:12.284732 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:35:12.284732 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:35:12.284732 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:35:12.284732 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:35:12.284732 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:35:12.284732 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:35:12.284732 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Oct 04 20:35:12.284732 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:35:12.284732 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service ba4a3272-ead1-41df-a01f-cd049fd91992 could not be found. Oct 04 20:35:12.284732 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:35:12.284732 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:35:12.284732 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:35:12.284732 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:35:12.284732 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:35:12.284732 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:35:12.284732 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:35:12.284732 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:35:12.285828 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service ba4a3272-ead1-41df-a01f-cd049fd91992 could not be found. Oct 04 20:35:12.285828 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:35:12.287855 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c67637de-660a-4943-9f71-a8af0c2c4dfa tempest-ServicesAdminNegativeV253TestJSON-1306637215 tempest-ServicesAdminNegativeV253TestJSON-1306637215-project-admin] Returning 404 to user: Service ba4a3272-ead1-41df-a01f-cd049fd91992 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:35:12.291015 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c67637de-660a-4943-9f71-a8af0c2c4dfa tempest-ServicesAdminNegativeV253TestJSON-1306637215 tempest-ServicesAdminNegativeV253TestJSON-1306637215-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-services/ba4a3272-ead1-41df-a01f-cd049fd91992" status: 404 len: 110 microversion: 2.53 time: 0.063030 Oct 04 20:35:12.293042 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 249/503] 10.222.0.33 () {62 vars in 1309 bytes} [Tue Oct 4 20:35:12 2022] PUT /compute/v2.1/os-services/ba4a3272-ead1-41df-a01f-cd049fd91992 => generated 110 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 20:35:12.299630 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5147dfec-978a-44f5-9f70-6d7f81a4aa4d tempest-ServicesAdminNegativeTestJSON-208783263 tempest-ServicesAdminNegativeTestJSON-208783263-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:12.309249 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5147dfec-978a-44f5-9f70-6d7f81a4aa4d tempest-ServicesAdminNegativeTestJSON-208783263 tempest-ServicesAdminNegativeTestJSON-208783263-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:12.309975 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5147dfec-978a-44f5-9f70-6d7f81a4aa4d tempest-ServicesAdminNegativeTestJSON-208783263 tempest-ServicesAdminNegativeTestJSON-208783263-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:12.310665 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5147dfec-978a-44f5-9f70-6d7f81a4aa4d tempest-ServicesAdminNegativeTestJSON-208783263 tempest-ServicesAdminNegativeTestJSON-208783263-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:12.311827 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5147dfec-978a-44f5-9f70-6d7f81a4aa4d tempest-ServicesAdminNegativeTestJSON-208783263 tempest-ServicesAdminNegativeTestJSON-208783263-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:12.313065 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5147dfec-978a-44f5-9f70-6d7f81a4aa4d tempest-ServicesAdminNegativeTestJSON-208783263 tempest-ServicesAdminNegativeTestJSON-208783263-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:12.314747 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5147dfec-978a-44f5-9f70-6d7f81a4aa4d tempest-ServicesAdminNegativeTestJSON-208783263 tempest-ServicesAdminNegativeTestJSON-208783263-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:12.347760 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5147dfec-978a-44f5-9f70-6d7f81a4aa4d tempest-ServicesAdminNegativeTestJSON-208783263 tempest-ServicesAdminNegativeTestJSON-208783263-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.053447 Oct 04 20:35:12.350430 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 250/504] 10.222.0.33 () {58 vars in 1137 bytes} [Tue Oct 4 20:35:12 2022] GET /compute/v2.1/os-services => generated 944 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:35:12.354744 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1384d8a9-53f1-48de-9d1d-a21a8c548cd8 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-651819318", "imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63", "flavorRef": "452"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:35:12.424874 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.network.neutron [None req-1384d8a9-53f1-48de-9d1d-a21a8c548cd8 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] validate_networks() for None {{(pid=128801) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:35:13.215062 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-1384d8a9-53f1-48de-9d1d-a21a8c548cd8 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Flavor limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:35:13.215522 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-1384d8a9-53f1-48de-9d1d-a21a8c548cd8 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Image limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:35:13.216048 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-1384d8a9-53f1-48de-9d1d-a21a8c548cd8 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Flavor pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:35:13.216531 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-1384d8a9-53f1-48de-9d1d-a21a8c548cd8 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Image pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:35:13.217257 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-1384d8a9-53f1-48de-9d1d-a21a8c548cd8 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:35:13.228087 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1384d8a9-53f1-48de-9d1d-a21a8c548cd8 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:13.228953 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1384d8a9-53f1-48de-9d1d-a21a8c548cd8 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:13.229712 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1384d8a9-53f1-48de-9d1d-a21a8c548cd8 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:13.230764 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1384d8a9-53f1-48de-9d1d-a21a8c548cd8 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:13.231446 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1384d8a9-53f1-48de-9d1d-a21a8c548cd8 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:13.232072 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1384d8a9-53f1-48de-9d1d-a21a8c548cd8 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:13.252744 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-1384d8a9-53f1-48de-9d1d-a21a8c548cd8 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Getting quotas for project c288268acb30475bbc065a8f72cb21d5. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:35:13.257484 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-1384d8a9-53f1-48de-9d1d-a21a8c548cd8 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Getting quotas for user b4a24944aeb34a5ea228965be9bf4ce0 and project c288268acb30475bbc065a8f72cb21d5. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:35:13.270805 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-1384d8a9-53f1-48de-9d1d-a21a8c548cd8 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Going to run 1 instances... {{(pid=128801) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:35:13.273078 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-1384d8a9-53f1-48de-9d1d-a21a8c548cd8 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] [instance: 1c6ffc0f-3aaa-41f8-9a9a-0040295fe064] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='15b24725-0c99-4bcf-b1fb-907cdf8e2d63',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128801) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:35:13.324100 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-1384d8a9-53f1-48de-9d1d-a21a8c548cd8 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.974075 Oct 04 20:35:13.327006 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 251/505] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 20:35:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 977 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 20:35:13.335295 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9c938bc5-ac1c-4dd5-bbb0-07a921896331 tempest-MigrationsAdminTest-1312330847 tempest-MigrationsAdminTest-1312330847-project-admin] Calling method '.version_select at 0x7f3c74ce09d0>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:13.345322 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9c938bc5-ac1c-4dd5-bbb0-07a921896331 tempest-MigrationsAdminTest-1312330847 tempest-MigrationsAdminTest-1312330847-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:13.345830 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9c938bc5-ac1c-4dd5-bbb0-07a921896331 tempest-MigrationsAdminTest-1312330847 tempest-MigrationsAdminTest-1312330847-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:13.346274 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9c938bc5-ac1c-4dd5-bbb0-07a921896331 tempest-MigrationsAdminTest-1312330847 tempest-MigrationsAdminTest-1312330847-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:13.362595 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-9c938bc5-ac1c-4dd5-bbb0-07a921896331 tempest-MigrationsAdminTest-1312330847 tempest-MigrationsAdminTest-1312330847-project-admin] 10.222.0.33 "GET /compute/v2.1/os-migrations" status: 200 len: 409 microversion: 2.1 time: 0.033500 Oct 04 20:35:13.363199 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 252/506] 10.222.0.33 () {58 vars in 1143 bytes} [Tue Oct 4 20:35:13 2022] GET /compute/v2.1/os-migrations => generated 409 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:35:13.368855 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-27daf2e2-b728-4945-8c71-486de8ede403 req-b1cf5dfa-d4ff-4739-aadb-629d5b0ed702 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c6cdf5bb-821d-4438-9c05-f227c4ebbbcd", "tag": "ad1d4490-762d-4d97-941f-671901ca0477"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:35:13.399912 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-27daf2e2-b728-4945-8c71-486de8ede403 req-b1cf5dfa-d4ff-4739-aadb-629d5b0ed702 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:13.403940 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-27daf2e2-b728-4945-8c71-486de8ede403 req-b1cf5dfa-d4ff-4739-aadb-629d5b0ed702 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:13.404560 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-27daf2e2-b728-4945-8c71-486de8ede403 req-b1cf5dfa-d4ff-4739-aadb-629d5b0ed702 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:13.431837 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-27daf2e2-b728-4945-8c71-486de8ede403 req-b1cf5dfa-d4ff-4739-aadb-629d5b0ed702 service nova] Creating event network-changed:ad1d4490-762d-4d97-941f-671901ca0477 for instance c6cdf5bb-821d-4438-9c05-f227c4ebbbcd on n-h2-854823-8 Oct 04 20:35:13.439459 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-27daf2e2-b728-4945-8c71-486de8ede403 req-b1cf5dfa-d4ff-4739-aadb-629d5b0ed702 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074933 Oct 04 20:35:13.440354 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 253/507] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:35:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:35:13.446275 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-32aabf91-dec5-4227-ac31-ce1c62896e62 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:13.447036 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-32aabf91-dec5-4227-ac31-ce1c62896e62 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] [instance: 2457c5d1-8842-4a2d-a5d4-fe97b53b64df] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:13.454255 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-32aabf91-dec5-4227-ac31-ce1c62896e62 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:13.454789 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-32aabf91-dec5-4227-ac31-ce1c62896e62 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:13.455225 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-32aabf91-dec5-4227-ac31-ce1c62896e62 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:13.455927 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-32aabf91-dec5-4227-ac31-ce1c62896e62 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:13.456385 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-32aabf91-dec5-4227-ac31-ce1c62896e62 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:13.456808 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-32aabf91-dec5-4227-ac31-ce1c62896e62 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:14.153929 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-32aabf91-dec5-4227-ac31-ce1c62896e62 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cbd31af13444cda97ba5f8c99d19437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a307499cf44d03a1e9bb61f614f099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:14.162103 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-32aabf91-dec5-4227-ac31-ce1c62896e62 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] 10.222.0.33 "GET /compute/v2.1/servers/2457c5d1-8842-4a2d-a5d4-fe97b53b64df" status: 200 len: 1320 microversion: 2.1 time: 0.720579 Oct 04 20:35:14.174924 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 254/508] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:13 2022] GET /compute/v2.1/servers/2457c5d1-8842-4a2d-a5d4-fe97b53b64df => generated 1320 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:14.184090 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-b812bf4d-36ba-4613-9d0b-ffcf6e73e766 req-fabc9269-de85-4572-b299-e1b376cb9be9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd727dc7-96ee-4553-84ca-0f9b6ed59781", "tag": "a00a0539-edd9-462f-b3eb-c0ff09e3dfb1"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:35:14.197812 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-b812bf4d-36ba-4613-9d0b-ffcf6e73e766 req-fabc9269-de85-4572-b299-e1b376cb9be9 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:14.198078 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-b812bf4d-36ba-4613-9d0b-ffcf6e73e766 req-fabc9269-de85-4572-b299-e1b376cb9be9 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:14.198566 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-b812bf4d-36ba-4613-9d0b-ffcf6e73e766 req-fabc9269-de85-4572-b299-e1b376cb9be9 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:14.209962 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-b812bf4d-36ba-4613-9d0b-ffcf6e73e766 req-fabc9269-de85-4572-b299-e1b376cb9be9 service nova] Creating event network-changed:a00a0539-edd9-462f-b3eb-c0ff09e3dfb1 for instance dd727dc7-96ee-4553-84ca-0f9b6ed59781 on n-h2-854823-8 Oct 04 20:35:14.216285 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-b812bf4d-36ba-4613-9d0b-ffcf6e73e766 req-fabc9269-de85-4572-b299-e1b376cb9be9 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040097 Oct 04 20:35:14.217248 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 255/509] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:35:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:35:14.222297 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e05ebd45-c4c7-4cca-a2d0-275f71928597 tempest-ServicesAdminNegativeV253TestJSON-1306637215 tempest-ServicesAdminNegativeV253TestJSON-1306637215-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:14.226150 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e05ebd45-c4c7-4cca-a2d0-275f71928597 tempest-ServicesAdminNegativeV253TestJSON-1306637215 tempest-ServicesAdminNegativeV253TestJSON-1306637215-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:14.227611 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e05ebd45-c4c7-4cca-a2d0-275f71928597 tempest-ServicesAdminNegativeV253TestJSON-1306637215 tempest-ServicesAdminNegativeV253TestJSON-1306637215-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:14.228433 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e05ebd45-c4c7-4cca-a2d0-275f71928597 tempest-ServicesAdminNegativeV253TestJSON-1306637215 tempest-ServicesAdminNegativeV253TestJSON-1306637215-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:14.229195 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e05ebd45-c4c7-4cca-a2d0-275f71928597 tempest-ServicesAdminNegativeV253TestJSON-1306637215 tempest-ServicesAdminNegativeV253TestJSON-1306637215-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:14.229654 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e05ebd45-c4c7-4cca-a2d0-275f71928597 tempest-ServicesAdminNegativeV253TestJSON-1306637215 tempest-ServicesAdminNegativeV253TestJSON-1306637215-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:14.230250 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e05ebd45-c4c7-4cca-a2d0-275f71928597 tempest-ServicesAdminNegativeV253TestJSON-1306637215 tempest-ServicesAdminNegativeV253TestJSON-1306637215-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:14.256193 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e05ebd45-c4c7-4cca-a2d0-275f71928597 tempest-ServicesAdminNegativeV253TestJSON-1306637215 tempest-ServicesAdminNegativeV253TestJSON-1306637215-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.037700 Oct 04 20:35:14.257365 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 256/510] 10.222.0.33 () {60 vars in 1178 bytes} [Tue Oct 4 20:35:14 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:35:14.262488 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-22473ec2-0c3c-4711-bec6-1f937af47879 tempest-ServicesAdminNegativeTestJSON-208783263 tempest-ServicesAdminNegativeTestJSON-208783263-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:14.266763 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-22473ec2-0c3c-4711-bec6-1f937af47879 tempest-ServicesAdminNegativeTestJSON-208783263 tempest-ServicesAdminNegativeTestJSON-208783263-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:14.267247 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-22473ec2-0c3c-4711-bec6-1f937af47879 tempest-ServicesAdminNegativeTestJSON-208783263 tempest-ServicesAdminNegativeTestJSON-208783263-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:14.267708 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-22473ec2-0c3c-4711-bec6-1f937af47879 tempest-ServicesAdminNegativeTestJSON-208783263 tempest-ServicesAdminNegativeTestJSON-208783263-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:14.268403 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-22473ec2-0c3c-4711-bec6-1f937af47879 tempest-ServicesAdminNegativeTestJSON-208783263 tempest-ServicesAdminNegativeTestJSON-208783263-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:14.268851 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-22473ec2-0c3c-4711-bec6-1f937af47879 tempest-ServicesAdminNegativeTestJSON-208783263 tempest-ServicesAdminNegativeTestJSON-208783263-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:14.269352 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-22473ec2-0c3c-4711-bec6-1f937af47879 tempest-ServicesAdminNegativeTestJSON-208783263 tempest-ServicesAdminNegativeTestJSON-208783263-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:14.294717 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-22473ec2-0c3c-4711-bec6-1f937af47879 tempest-ServicesAdminNegativeTestJSON-208783263 tempest-ServicesAdminNegativeTestJSON-208783263-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.1 time: 0.035985 Oct 04 20:35:14.295298 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 257/511] 10.222.0.33 () {58 vars in 1198 bytes} [Tue Oct 4 20:35:14 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 20:35:14.306376 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b53dd759-0359-47ec-bd1c-caf8696ceef6 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:14.308069 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b53dd759-0359-47ec-bd1c-caf8696ceef6 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] [instance: c6cdf5bb-821d-4438-9c05-f227c4ebbbcd] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:14.314470 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b53dd759-0359-47ec-bd1c-caf8696ceef6 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:14.315281 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b53dd759-0359-47ec-bd1c-caf8696ceef6 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:14.315994 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b53dd759-0359-47ec-bd1c-caf8696ceef6 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:14.316948 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b53dd759-0359-47ec-bd1c-caf8696ceef6 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:14.317434 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b53dd759-0359-47ec-bd1c-caf8696ceef6 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:14.317949 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b53dd759-0359-47ec-bd1c-caf8696ceef6 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:14.524141 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-b53dd759-0359-47ec-bd1c-caf8696ceef6 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5eda279f6034608b192839a54dda616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f28e80977de42a892b84295ecf05141', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:14.532532 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b53dd759-0359-47ec-bd1c-caf8696ceef6 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] 10.222.0.33 "GET /compute/v2.1/servers/c6cdf5bb-821d-4438-9c05-f227c4ebbbcd" status: 200 len: 1387 microversion: 2.1 time: 0.236265 Oct 04 20:35:14.533104 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 258/512] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:14 2022] GET /compute/v2.1/servers/c6cdf5bb-821d-4438-9c05-f227c4ebbbcd => generated 1387 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:14.552827 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-a4e854b9-acf0-4129-b998-cd7511d30467 req-1c4282db-3c0f-4027-8d82-070fb19278a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2457c5d1-8842-4a2d-a5d4-fe97b53b64df", "name": "network-vif-plugged", "status": "completed", "tag": "b4fd2bf2-a03d-49a9-8fe6-db90f57c359d"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:35:14.562920 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-a4e854b9-acf0-4129-b998-cd7511d30467 req-1c4282db-3c0f-4027-8d82-070fb19278a2 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:14.563393 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-a4e854b9-acf0-4129-b998-cd7511d30467 req-1c4282db-3c0f-4027-8d82-070fb19278a2 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:14.563846 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-a4e854b9-acf0-4129-b998-cd7511d30467 req-1c4282db-3c0f-4027-8d82-070fb19278a2 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:14.574748 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-a4e854b9-acf0-4129-b998-cd7511d30467 req-1c4282db-3c0f-4027-8d82-070fb19278a2 service nova] Creating event network-vif-plugged:b4fd2bf2-a03d-49a9-8fe6-db90f57c359d for instance 2457c5d1-8842-4a2d-a5d4-fe97b53b64df on n-h2-854823-8 Oct 04 20:35:14.579433 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-a4e854b9-acf0-4129-b998-cd7511d30467 req-1c4282db-3c0f-4027-8d82-070fb19278a2 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030072 Oct 04 20:35:14.580529 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 259/513] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:35:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:35:14.585671 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-608532dc-9c9c-4f80-bc42-d8f7b156ea02 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:14.586499 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-608532dc-9c9c-4f80-bc42-d8f7b156ea02 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] [instance: dd727dc7-96ee-4553-84ca-0f9b6ed59781] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:14.593190 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-608532dc-9c9c-4f80-bc42-d8f7b156ea02 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:14.593651 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-608532dc-9c9c-4f80-bc42-d8f7b156ea02 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:14.594085 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-608532dc-9c9c-4f80-bc42-d8f7b156ea02 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:14.594955 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-608532dc-9c9c-4f80-bc42-d8f7b156ea02 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:14.595354 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-608532dc-9c9c-4f80-bc42-d8f7b156ea02 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:14.595808 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-608532dc-9c9c-4f80-bc42-d8f7b156ea02 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:14.717024 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.network.neutron [None req-9484e2b0-b533-4a5b-8f8f-6f64df1d7056 tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] [instance: 486112b2-497b-4039-ac04-b23cf076d470] Building network info cache for instance {{(pid=128802) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 04 20:35:14.813877 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-608532dc-9c9c-4f80-bc42-d8f7b156ea02 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f051a291d59242469f8172a9c474ac89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f0707d756b4ee085a19cccf3ab82c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:14.823821 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-608532dc-9c9c-4f80-bc42-d8f7b156ea02 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] 10.222.0.33 "GET /compute/v2.1/servers/dd727dc7-96ee-4553-84ca-0f9b6ed59781" status: 200 len: 1318 microversion: 2.1 time: 0.241787 Oct 04 20:35:14.835172 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 260/514] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:14 2022] GET /compute/v2.1/servers/dd727dc7-96ee-4553-84ca-0f9b6ed59781 => generated 1318 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:14.847859 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a3effc6d-ed0f-405e-a46b-e9c8a18d4cd5 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:14.848809 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a3effc6d-ed0f-405e-a46b-e9c8a18d4cd5 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] [instance: 1c6ffc0f-3aaa-41f8-9a9a-0040295fe064] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:14.856850 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a3effc6d-ed0f-405e-a46b-e9c8a18d4cd5 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:14.857731 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a3effc6d-ed0f-405e-a46b-e9c8a18d4cd5 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:14.858329 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a3effc6d-ed0f-405e-a46b-e9c8a18d4cd5 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:14.859336 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a3effc6d-ed0f-405e-a46b-e9c8a18d4cd5 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:14.860045 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a3effc6d-ed0f-405e-a46b-e9c8a18d4cd5 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:14.860627 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a3effc6d-ed0f-405e-a46b-e9c8a18d4cd5 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:14.884759 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=100 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:35:14.954469 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-a3effc6d-ed0f-405e-a46b-e9c8a18d4cd5 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a24944aeb34a5ea228965be9bf4ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c288268acb30475bbc065a8f72cb21d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:14.965098 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a3effc6d-ed0f-405e-a46b-e9c8a18d4cd5 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] 10.222.0.33 "GET /compute/v2.1/servers/1c6ffc0f-3aaa-41f8-9a9a-0040295fe064" status: 200 len: 1217 microversion: 2.1 time: 0.128432 Oct 04 20:35:14.978652 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 261/515] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:14 2022] GET /compute/v2.1/servers/1c6ffc0f-3aaa-41f8-9a9a-0040295fe064 => generated 1217 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:14.992079 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-3648469c-1eda-4d4f-a57c-2e9a95fdc60f tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-334482950", "imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63", "flavorRef": "452"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:35:15.056051 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.network.neutron [None req-3648469c-1eda-4d4f-a57c-2e9a95fdc60f tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] validate_networks() for None {{(pid=128801) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:35:15.341036 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell0:SELECT=2 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:35:15.602785 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-3648469c-1eda-4d4f-a57c-2e9a95fdc60f tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Flavor limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:35:15.604041 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-3648469c-1eda-4d4f-a57c-2e9a95fdc60f tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Image limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:35:15.604687 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-3648469c-1eda-4d4f-a57c-2e9a95fdc60f tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Flavor pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:35:15.605252 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-3648469c-1eda-4d4f-a57c-2e9a95fdc60f tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Image pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:35:15.605948 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-3648469c-1eda-4d4f-a57c-2e9a95fdc60f tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:35:15.624050 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3648469c-1eda-4d4f-a57c-2e9a95fdc60f tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:15.624850 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3648469c-1eda-4d4f-a57c-2e9a95fdc60f tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:15.625547 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3648469c-1eda-4d4f-a57c-2e9a95fdc60f tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:15.626588 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3648469c-1eda-4d4f-a57c-2e9a95fdc60f tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:15.627404 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3648469c-1eda-4d4f-a57c-2e9a95fdc60f tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:15.627954 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3648469c-1eda-4d4f-a57c-2e9a95fdc60f tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:15.645229 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=42 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:35:15.667067 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-3648469c-1eda-4d4f-a57c-2e9a95fdc60f tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Getting quotas for project dd3118a5d96843d3bede1ed94bd9717e. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:35:15.672195 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-3648469c-1eda-4d4f-a57c-2e9a95fdc60f tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Getting quotas for user 3563efe2b8c94931a2a46c4e14811b3a and project dd3118a5d96843d3bede1ed94bd9717e. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:35:15.689059 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-3648469c-1eda-4d4f-a57c-2e9a95fdc60f tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Going to run 1 instances... {{(pid=128801) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:35:15.693863 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-3648469c-1eda-4d4f-a57c-2e9a95fdc60f tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] [instance: c7f3bb5b-e08b-4a3f-ba4d-40012179412e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='15b24725-0c99-4bcf-b1fb-907cdf8e2d63',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128801) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:35:15.764818 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-3648469c-1eda-4d4f-a57c-2e9a95fdc60f tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.789761 Oct 04 20:35:15.766319 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 262/516] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 20:35:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 792 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 20:35:15.772079 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e54053da-e5cf-4789-a951-06e08547da74 tempest-ServicesAdminNegativeV253TestJSON-1306637215 tempest-ServicesAdminNegativeV253TestJSON-1306637215-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:15.777017 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e54053da-e5cf-4789-a951-06e08547da74 tempest-ServicesAdminNegativeV253TestJSON-1306637215 tempest-ServicesAdminNegativeV253TestJSON-1306637215-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:15.777765 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e54053da-e5cf-4789-a951-06e08547da74 tempest-ServicesAdminNegativeV253TestJSON-1306637215 tempest-ServicesAdminNegativeV253TestJSON-1306637215-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:15.779340 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e54053da-e5cf-4789-a951-06e08547da74 tempest-ServicesAdminNegativeV253TestJSON-1306637215 tempest-ServicesAdminNegativeV253TestJSON-1306637215-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:15.780158 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e54053da-e5cf-4789-a951-06e08547da74 tempest-ServicesAdminNegativeV253TestJSON-1306637215 tempest-ServicesAdminNegativeV253TestJSON-1306637215-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:15.780739 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e54053da-e5cf-4789-a951-06e08547da74 tempest-ServicesAdminNegativeV253TestJSON-1306637215 tempest-ServicesAdminNegativeV253TestJSON-1306637215-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:15.781156 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e54053da-e5cf-4789-a951-06e08547da74 tempest-ServicesAdminNegativeV253TestJSON-1306637215 tempest-ServicesAdminNegativeV253TestJSON-1306637215-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:15.809043 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e54053da-e5cf-4789-a951-06e08547da74 tempest-ServicesAdminNegativeV253TestJSON-1306637215 tempest-ServicesAdminNegativeV253TestJSON-1306637215-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.041296 Oct 04 20:35:15.809901 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 263/517] 10.222.0.33 () {60 vars in 1211 bytes} [Tue Oct 4 20:35:15 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 1239 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:35:15.824116 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.network.neutron [None req-9484e2b0-b533-4a5b-8f8f-6f64df1d7056 tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] [instance: 486112b2-497b-4039-ac04-b23cf076d470] Updating instance_info_cache with network_info: [{"id": "b97b70cc-e857-429e-ad48-a973b62edd3e", "address": "fa:16:3e:78:62:c8", "network": {"id": "c5d8f75c-af9c-48e0-b362-30fb1c3b9cc0", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-1693341596-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "b0ca732ccf4d417ab1f7ba82a9c8c41e", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapb97b70cc-e8", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128802) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 04 20:35:15.854231 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9484e2b0-b533-4a5b-8f8f-6f64df1d7056 tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] Releasing lock "refresh_cache-486112b2-497b-4039-ac04-b23cf076d470" {{(pid=128802) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 04 20:35:15.856035 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-9484e2b0-b533-4a5b-8f8f-6f64df1d7056 tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] 10.222.0.33 "POST /compute/v2.1/servers/486112b2-497b-4039-ac04-b23cf076d470/action" status: 202 len: 0 microversion: 2.1 time: 4.387729 Oct 04 20:35:15.857516 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 255/518] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 20:35:11 2022] POST /compute/v2.1/servers/486112b2-497b-4039-ac04-b23cf076d470/action => generated 0 bytes in 4390 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 04 20:35:15.864200 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-8b7a06f5-4144-4a97-9532-9f5c9ae63325 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:15.864822 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-8b7a06f5-4144-4a97-9532-9f5c9ae63325 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] [instance: 2457c5d1-8842-4a2d-a5d4-fe97b53b64df] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:15.872958 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8b7a06f5-4144-4a97-9532-9f5c9ae63325 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:15.873457 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8b7a06f5-4144-4a97-9532-9f5c9ae63325 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:15.873889 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8b7a06f5-4144-4a97-9532-9f5c9ae63325 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:15.874630 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8b7a06f5-4144-4a97-9532-9f5c9ae63325 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:15.875228 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8b7a06f5-4144-4a97-9532-9f5c9ae63325 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:15.875660 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8b7a06f5-4144-4a97-9532-9f5c9ae63325 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:15.957207 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b88f1ec6-660a-4868-93b1-b48667ad93ad tempest-ServicesAdminNegativeTestJSON-339408700 tempest-ServicesAdminNegativeTestJSON-339408700-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:15.960963 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-b88f1ec6-660a-4868-93b1-b48667ad93ad tempest-ServicesAdminNegativeTestJSON-339408700 tempest-ServicesAdminNegativeTestJSON-339408700-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': 'eda0f67d37694b89bc0a277b6d7771b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ee86f8e106e484ab61b52bf9646f198', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:15.974695 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b88f1ec6-660a-4868-93b1-b48667ad93ad tempest-ServicesAdminNegativeTestJSON-339408700 tempest-ServicesAdminNegativeTestJSON-339408700-project] Request method failure captured: Oct 04 20:35:15.974695 n-d-854823-8 devstack@n-api.service[128801]: request: GET /compute/v2.1/os-services HTTP/1.1 Oct 04 20:35:15.974695 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:35:15.974695 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:35:15.974695 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:35:15.974695 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 0 Oct 04 20:35:15.974695 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:35:15.974695 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:35:15.974695 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:35:15.974695 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:35:15.974695 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJj4NSxzW2xjk6sd_4Li47yHntksOGDvRisr9Z_1glBgUwwQa8ncCSXTQJ_NxmEshdeqejydEVv-OvWX8adQc99XTyWKqWKwzLuG9IjLe7iVu0SBC6gs0ntE3kgbeUXwnHAt0rfQ7lphcfpgTm9rfA8r7yT80m1TsUB_-rEltUZCPeE Oct 04 20:35:15.974695 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:35:15.974695 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:35:15.974695 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:35:15.974695 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:35:15.974695 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:35:15.974695 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:35:15.974695 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: 2ee86f8e106e484ab61b52bf9646f198 Oct 04 20:35:15.974695 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-ServicesAdminNegativeTestJSON-339408700 Oct 04 20:35:15.974695 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 20:35:15.974695 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 20:35:15.976789 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_2ee86f8e106e484ab61b52bf9646f198", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2ee86f8e106e484ab61b52bf9646f198"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2ee86f8e106e484ab61b52bf9646f198"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/2ee86f8e106e484ab61b52bf9646f198"}]}] Oct 04 20:35:15.976789 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-ServicesAdminNegativeTestJSON-339408700 Oct 04 20:35:15.976789 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: 2ee86f8e106e484ab61b52bf9646f198 Oct 04 20:35:15.976789 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ServicesAdminNegativeTestJSON-339408700 Oct 04 20:35:15.976789 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-ServicesAdminNegativeTestJSON-339408700-project Oct 04 20:35:15.976789 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:35:15.976789 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:35:15.976789 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: eda0f67d37694b89bc0a277b6d7771b6 Oct 04 20:35:15.976789 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-ServicesAdminNegativeTestJSON-339408700-project Oct 04 20:35:15.976789 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 20:35:15.976789 n-d-854823-8 devstack@n-api.service[128801]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 04 20:35:15.976789 n-d-854823-8 devstack@n-api.service[128801]: action_args: {} Oct 04 20:35:15.977779 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:35:15.977779 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:35:15.977779 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:35:15.977779 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:35:15.977779 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:35:15.977779 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:35:15.977779 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 20:35:15.977779 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:35:15.977779 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 20:35:15.977779 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:35:15.977779 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:35:15.977779 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:35:15.977779 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Oct 04 20:35:15.977779 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Oct 04 20:35:15.977779 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 20:35:15.977779 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 20:35:15.977779 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 20:35:15.977779 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 20:35:15.977779 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 20:35:15.978907 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 20:35:15.978907 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 20:35:15.978907 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 20:35:15.978907 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 20:35:15.978907 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 20:35:15.978907 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 20:35:15.978907 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 20:35:15.978907 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 20:35:15.978907 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 20:35:15.978907 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 04 20:35:15.978907 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:35:15.978907 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:35:15.978907 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:35:15.978907 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:35:15.978907 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:35:15.978907 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:35:15.978907 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 20:35:15.978907 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 20:35:15.978907 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 04 20:35:15.978907 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:35:15.980246 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b88f1ec6-660a-4868-93b1-b48667ad93ad tempest-ServicesAdminNegativeTestJSON-339408700 tempest-ServicesAdminNegativeTestJSON-339408700-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:35:15.980246 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b88f1ec6-660a-4868-93b1-b48667ad93ad tempest-ServicesAdminNegativeTestJSON-339408700 tempest-ServicesAdminNegativeTestJSON-339408700-project] 10.222.0.33 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.1 time: 0.167397 Oct 04 20:35:15.986453 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 264/519] 10.222.0.33 () {58 vars in 1137 bytes} [Tue Oct 4 20:35:15 2022] GET /compute/v2.1/os-services => generated 112 bytes in 174 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:35:15.993904 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-0adb6480-d9bc-4cab-af57-8557f093c813 req-ae0e2fe5-b396-4f3b-a0fe-85a5f059c445 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "486112b2-497b-4039-ac04-b23cf076d470", "tag": "b97b70cc-e857-429e-ad48-a973b62edd3e"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:35:16.028909 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-0adb6480-d9bc-4cab-af57-8557f093c813 req-ae0e2fe5-b396-4f3b-a0fe-85a5f059c445 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:16.034415 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-0adb6480-d9bc-4cab-af57-8557f093c813 req-ae0e2fe5-b396-4f3b-a0fe-85a5f059c445 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:16.034938 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-0adb6480-d9bc-4cab-af57-8557f093c813 req-ae0e2fe5-b396-4f3b-a0fe-85a5f059c445 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:16.053631 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-0adb6480-d9bc-4cab-af57-8557f093c813 req-ae0e2fe5-b396-4f3b-a0fe-85a5f059c445 service nova] Creating event network-changed:b97b70cc-e857-429e-ad48-a973b62edd3e for instance 486112b2-497b-4039-ac04-b23cf076d470 on n-h1-854823-8 Oct 04 20:35:16.061801 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-0adb6480-d9bc-4cab-af57-8557f093c813 req-ae0e2fe5-b396-4f3b-a0fe-85a5f059c445 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074389 Oct 04 20:35:16.063163 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 265/520] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:35:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:35:16.068615 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-4d685a43-2d0c-41b3-85d3-99425dee8088 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:16.069314 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-4d685a43-2d0c-41b3-85d3-99425dee8088 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] [instance: c6cdf5bb-821d-4438-9c05-f227c4ebbbcd] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:16.075730 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4d685a43-2d0c-41b3-85d3-99425dee8088 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:16.076234 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4d685a43-2d0c-41b3-85d3-99425dee8088 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:16.076909 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4d685a43-2d0c-41b3-85d3-99425dee8088 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:16.077620 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4d685a43-2d0c-41b3-85d3-99425dee8088 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:16.078081 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4d685a43-2d0c-41b3-85d3-99425dee8088 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:16.078538 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4d685a43-2d0c-41b3-85d3-99425dee8088 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:16.190111 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-8b7a06f5-4144-4a97-9532-9f5c9ae63325 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cbd31af13444cda97ba5f8c99d19437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a307499cf44d03a1e9bb61f614f099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:16.199372 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-8b7a06f5-4144-4a97-9532-9f5c9ae63325 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] 10.222.0.33 "GET /compute/v2.1/servers/2457c5d1-8842-4a2d-a5d4-fe97b53b64df" status: 200 len: 1320 microversion: 2.1 time: 0.340128 Oct 04 20:35:16.200062 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 256/521] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:15 2022] GET /compute/v2.1/servers/2457c5d1-8842-4a2d-a5d4-fe97b53b64df => generated 1320 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:16.219826 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-7ff7e44b-703a-401c-a9d9-d2eee326756e tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:16.220577 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-7ff7e44b-703a-401c-a9d9-d2eee326756e tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] [instance: c7f3bb5b-e08b-4a3f-ba4d-40012179412e] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:16.299149 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-7ff7e44b-703a-401c-a9d9-d2eee326756e tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3563efe2b8c94931a2a46c4e14811b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3118a5d96843d3bede1ed94bd9717e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:16.305629 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-4d685a43-2d0c-41b3-85d3-99425dee8088 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5eda279f6034608b192839a54dda616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f28e80977de42a892b84295ecf05141', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:16.311052 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-7ff7e44b-703a-401c-a9d9-d2eee326756e tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] 10.222.0.33 "GET /compute/v2.1/servers/c7f3bb5b-e08b-4a3f-ba4d-40012179412e" status: 200 len: 1212 microversion: 2.1 time: 0.109651 Oct 04 20:35:16.312175 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 257/522] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:16 2022] GET /compute/v2.1/servers/c7f3bb5b-e08b-4a3f-ba4d-40012179412e => generated 1212 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:16.318462 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-92eedf9a-1494-4834-87ef-30c05faf494e tempest-ServicesAdminNegativeV253TestJSON-1306637215 tempest-ServicesAdminNegativeV253TestJSON-1306637215-project-admin] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:16.324686 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-92eedf9a-1494-4834-87ef-30c05faf494e tempest-ServicesAdminNegativeV253TestJSON-1306637215 tempest-ServicesAdminNegativeV253TestJSON-1306637215-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:16.325221 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-92eedf9a-1494-4834-87ef-30c05faf494e tempest-ServicesAdminNegativeV253TestJSON-1306637215 tempest-ServicesAdminNegativeV253TestJSON-1306637215-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:16.326018 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-92eedf9a-1494-4834-87ef-30c05faf494e tempest-ServicesAdminNegativeV253TestJSON-1306637215 tempest-ServicesAdminNegativeV253TestJSON-1306637215-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:16.327156 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-92eedf9a-1494-4834-87ef-30c05faf494e tempest-ServicesAdminNegativeV253TestJSON-1306637215 tempest-ServicesAdminNegativeV253TestJSON-1306637215-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:16.327894 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-92eedf9a-1494-4834-87ef-30c05faf494e tempest-ServicesAdminNegativeV253TestJSON-1306637215 tempest-ServicesAdminNegativeV253TestJSON-1306637215-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:16.328328 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-92eedf9a-1494-4834-87ef-30c05faf494e tempest-ServicesAdminNegativeV253TestJSON-1306637215 tempest-ServicesAdminNegativeV253TestJSON-1306637215-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:16.329059 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-4d685a43-2d0c-41b3-85d3-99425dee8088 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] 10.222.0.33 "GET /compute/v2.1/servers/c6cdf5bb-821d-4438-9c05-f227c4ebbbcd" status: 200 len: 1387 microversion: 2.1 time: 0.264681 Oct 04 20:35:16.338794 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 266/523] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:16 2022] GET /compute/v2.1/servers/c6cdf5bb-821d-4438-9c05-f227c4ebbbcd => generated 1387 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:16.348970 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8e2b699e-61c1-440d-b046-996a7aa4b867 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:16.349994 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-8e2b699e-61c1-440d-b046-996a7aa4b867 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] [instance: dd727dc7-96ee-4553-84ca-0f9b6ed59781] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:16.358535 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8e2b699e-61c1-440d-b046-996a7aa4b867 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:16.359306 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8e2b699e-61c1-440d-b046-996a7aa4b867 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:16.359897 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8e2b699e-61c1-440d-b046-996a7aa4b867 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:16.360849 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8e2b699e-61c1-440d-b046-996a7aa4b867 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:16.361676 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8e2b699e-61c1-440d-b046-996a7aa4b867 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:16.362603 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8e2b699e-61c1-440d-b046-996a7aa4b867 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:16.387207 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-92eedf9a-1494-4834-87ef-30c05faf494e tempest-ServicesAdminNegativeV253TestJSON-1306637215 tempest-ServicesAdminNegativeV253TestJSON-1306637215-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.073544 Oct 04 20:35:16.387813 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 258/524] 10.222.0.33 () {60 vars in 1178 bytes} [Tue Oct 4 20:35:16 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:35:16.404367 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-5de14ed7-b17d-44ec-b0ba-fa7e9cda02e2 tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] Action: 'create', calling method: .version_select at 0x7f3c74cdfee0>, body: {"pool": "7ace76e5-f8c6-495a-b11c-0ae1f7a6ece8"} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:35:16.715040 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-8e2b699e-61c1-440d-b046-996a7aa4b867 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f051a291d59242469f8172a9c474ac89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f0707d756b4ee085a19cccf3ab82c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:16.725772 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-8e2b699e-61c1-440d-b046-996a7aa4b867 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] 10.222.0.33 "GET /compute/v2.1/servers/dd727dc7-96ee-4553-84ca-0f9b6ed59781" status: 200 len: 1318 microversion: 2.1 time: 0.383975 Oct 04 20:35:16.742071 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 267/525] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:16 2022] GET /compute/v2.1/servers/dd727dc7-96ee-4553-84ca-0f9b6ed59781 => generated 1318 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:16.747433 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-4d9a30d3-95da-42df-9d0a-ae4ea5afcdb6 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:16.748342 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-4d9a30d3-95da-42df-9d0a-ae4ea5afcdb6 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] [instance: 1c6ffc0f-3aaa-41f8-9a9a-0040295fe064] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:16.755220 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4d9a30d3-95da-42df-9d0a-ae4ea5afcdb6 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:16.756056 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4d9a30d3-95da-42df-9d0a-ae4ea5afcdb6 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:16.756726 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4d9a30d3-95da-42df-9d0a-ae4ea5afcdb6 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:16.758416 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4d9a30d3-95da-42df-9d0a-ae4ea5afcdb6 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:16.759243 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4d9a30d3-95da-42df-9d0a-ae4ea5afcdb6 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:16.759900 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4d9a30d3-95da-42df-9d0a-ae4ea5afcdb6 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:16.848746 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-4d9a30d3-95da-42df-9d0a-ae4ea5afcdb6 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a24944aeb34a5ea228965be9bf4ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c288268acb30475bbc065a8f72cb21d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:16.862442 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-4d9a30d3-95da-42df-9d0a-ae4ea5afcdb6 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] 10.222.0.33 "GET /compute/v2.1/servers/1c6ffc0f-3aaa-41f8-9a9a-0040295fe064" status: 200 len: 1265 microversion: 2.1 time: 0.118550 Oct 04 20:35:16.877007 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 268/526] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:16 2022] GET /compute/v2.1/servers/1c6ffc0f-3aaa-41f8-9a9a-0040295fe064 => generated 1265 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:16.897725 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-e06b2ae8-f2de-454d-8660-46f93e4634a3 req-0f2acb35-d8e9-422e-ad5b-5f14254a0f0f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f8cc082-0a37-4123-a680-1210a90b3ca9", "tag": "b3d1f9a5-253e-4b89-ba8b-3d8135069ec1"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:35:16.914082 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-e06b2ae8-f2de-454d-8660-46f93e4634a3 req-0f2acb35-d8e9-422e-ad5b-5f14254a0f0f service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:16.915240 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-e06b2ae8-f2de-454d-8660-46f93e4634a3 req-0f2acb35-d8e9-422e-ad5b-5f14254a0f0f service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:16.916343 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-e06b2ae8-f2de-454d-8660-46f93e4634a3 req-0f2acb35-d8e9-422e-ad5b-5f14254a0f0f service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:16.937124 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-e06b2ae8-f2de-454d-8660-46f93e4634a3 req-0f2acb35-d8e9-422e-ad5b-5f14254a0f0f service nova] Creating event network-changed:b3d1f9a5-253e-4b89-ba8b-3d8135069ec1 for instance 9f8cc082-0a37-4123-a680-1210a90b3ca9 on n-h1-854823-8 Oct 04 20:35:16.947635 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-e06b2ae8-f2de-454d-8660-46f93e4634a3 req-0f2acb35-d8e9-422e-ad5b-5f14254a0f0f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068843 Oct 04 20:35:16.952293 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 269/527] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:35:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:35:16.961496 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b0afe8c3-c43b-4698-af16-411296a79489 tempest-ServicesAdminNegativeV253TestJSON-1306637215 tempest-ServicesAdminNegativeV253TestJSON-1306637215-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:16.974383 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b0afe8c3-c43b-4698-af16-411296a79489 tempest-ServicesAdminNegativeV253TestJSON-1306637215 tempest-ServicesAdminNegativeV253TestJSON-1306637215-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:16.975051 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b0afe8c3-c43b-4698-af16-411296a79489 tempest-ServicesAdminNegativeV253TestJSON-1306637215 tempest-ServicesAdminNegativeV253TestJSON-1306637215-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:16.978856 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b0afe8c3-c43b-4698-af16-411296a79489 tempest-ServicesAdminNegativeV253TestJSON-1306637215 tempest-ServicesAdminNegativeV253TestJSON-1306637215-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:16.979691 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b0afe8c3-c43b-4698-af16-411296a79489 tempest-ServicesAdminNegativeV253TestJSON-1306637215 tempest-ServicesAdminNegativeV253TestJSON-1306637215-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:16.986693 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b0afe8c3-c43b-4698-af16-411296a79489 tempest-ServicesAdminNegativeV253TestJSON-1306637215 tempest-ServicesAdminNegativeV253TestJSON-1306637215-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:16.987187 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b0afe8c3-c43b-4698-af16-411296a79489 tempest-ServicesAdminNegativeV253TestJSON-1306637215 tempest-ServicesAdminNegativeV253TestJSON-1306637215-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:17.085290 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b0afe8c3-c43b-4698-af16-411296a79489 tempest-ServicesAdminNegativeV253TestJSON-1306637215 tempest-ServicesAdminNegativeV253TestJSON-1306637215-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services?host=n-d-854823-8&binary=xxx" status: 200 len: 16 microversion: 2.53 time: 0.131368 Oct 04 20:35:17.086802 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 270/528] 10.222.0.33 () {60 vars in 1235 bytes} [Tue Oct 4 20:35:16 2022] GET /compute/v2.1/os-services?host=n-d-854823-8&binary=xxx => generated 16 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:17.101470 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-74e6ed84-9457-4e6c-a234-1c38ac8c5ee1 tempest-ServicesAdminNegativeV253TestJSON-1306637215 tempest-ServicesAdminNegativeV253TestJSON-1306637215-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:17.105639 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-74e6ed84-9457-4e6c-a234-1c38ac8c5ee1 tempest-ServicesAdminNegativeV253TestJSON-1306637215 tempest-ServicesAdminNegativeV253TestJSON-1306637215-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:17.106125 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-74e6ed84-9457-4e6c-a234-1c38ac8c5ee1 tempest-ServicesAdminNegativeV253TestJSON-1306637215 tempest-ServicesAdminNegativeV253TestJSON-1306637215-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:17.106588 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-74e6ed84-9457-4e6c-a234-1c38ac8c5ee1 tempest-ServicesAdminNegativeV253TestJSON-1306637215 tempest-ServicesAdminNegativeV253TestJSON-1306637215-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:17.107314 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-74e6ed84-9457-4e6c-a234-1c38ac8c5ee1 tempest-ServicesAdminNegativeV253TestJSON-1306637215 tempest-ServicesAdminNegativeV253TestJSON-1306637215-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:17.107766 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-74e6ed84-9457-4e6c-a234-1c38ac8c5ee1 tempest-ServicesAdminNegativeV253TestJSON-1306637215 tempest-ServicesAdminNegativeV253TestJSON-1306637215-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:17.108183 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-74e6ed84-9457-4e6c-a234-1c38ac8c5ee1 tempest-ServicesAdminNegativeV253TestJSON-1306637215 tempest-ServicesAdminNegativeV253TestJSON-1306637215-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:17.170403 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-74e6ed84-9457-4e6c-a234-1c38ac8c5ee1 tempest-ServicesAdminNegativeV253TestJSON-1306637215 tempest-ServicesAdminNegativeV253TestJSON-1306637215-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.073111 Oct 04 20:35:17.171329 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 271/529] 10.222.0.33 () {60 vars in 1178 bytes} [Tue Oct 4 20:35:17 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 20:35:17.184308 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c75e28cd-328c-4833-991a-a76c622df6c0 tempest-ServicesAdminNegativeV253TestJSON-1306637215 tempest-ServicesAdminNegativeV253TestJSON-1306637215-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:17.188515 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c75e28cd-328c-4833-991a-a76c622df6c0 tempest-ServicesAdminNegativeV253TestJSON-1306637215 tempest-ServicesAdminNegativeV253TestJSON-1306637215-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:17.188996 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c75e28cd-328c-4833-991a-a76c622df6c0 tempest-ServicesAdminNegativeV253TestJSON-1306637215 tempest-ServicesAdminNegativeV253TestJSON-1306637215-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:17.189998 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c75e28cd-328c-4833-991a-a76c622df6c0 tempest-ServicesAdminNegativeV253TestJSON-1306637215 tempest-ServicesAdminNegativeV253TestJSON-1306637215-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:17.190126 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c75e28cd-328c-4833-991a-a76c622df6c0 tempest-ServicesAdminNegativeV253TestJSON-1306637215 tempest-ServicesAdminNegativeV253TestJSON-1306637215-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:17.190606 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c75e28cd-328c-4833-991a-a76c622df6c0 tempest-ServicesAdminNegativeV253TestJSON-1306637215 tempest-ServicesAdminNegativeV253TestJSON-1306637215-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:17.191022 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c75e28cd-328c-4833-991a-a76c622df6c0 tempest-ServicesAdminNegativeV253TestJSON-1306637215 tempest-ServicesAdminNegativeV253TestJSON-1306637215-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:17.252946 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c75e28cd-328c-4833-991a-a76c622df6c0 tempest-ServicesAdminNegativeV253TestJSON-1306637215 tempest-ServicesAdminNegativeV253TestJSON-1306637215-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.53 time: 0.072232 Oct 04 20:35:17.263765 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 272/530] 10.222.0.33 () {60 vars in 1239 bytes} [Tue Oct 4 20:35:17 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:35:17.267468 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e44845e3-82ef-482c-b952-e22053adc363 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:17.268193 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e44845e3-82ef-482c-b952-e22053adc363 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] [instance: 2457c5d1-8842-4a2d-a5d4-fe97b53b64df] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:17.284488 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e44845e3-82ef-482c-b952-e22053adc363 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:17.284981 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e44845e3-82ef-482c-b952-e22053adc363 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:17.285416 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e44845e3-82ef-482c-b952-e22053adc363 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:17.286135 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e44845e3-82ef-482c-b952-e22053adc363 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:17.286615 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e44845e3-82ef-482c-b952-e22053adc363 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:17.287038 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e44845e3-82ef-482c-b952-e22053adc363 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:17.905704 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e44845e3-82ef-482c-b952-e22053adc363 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cbd31af13444cda97ba5f8c99d19437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a307499cf44d03a1e9bb61f614f099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:17.913620 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e44845e3-82ef-482c-b952-e22053adc363 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] 10.222.0.33 "GET /compute/v2.1/servers/2457c5d1-8842-4a2d-a5d4-fe97b53b64df" status: 200 len: 1469 microversion: 2.1 time: 0.652207 Oct 04 20:35:17.932177 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 273/531] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:17 2022] GET /compute/v2.1/servers/2457c5d1-8842-4a2d-a5d4-fe97b53b64df => generated 1469 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:18.150431 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-749df8e1-0c0e-44ff-8abd-eec2b1daa6b7 tempest-ServicesAdminNegativeV253TestJSON-2133146439 tempest-ServicesAdminNegativeV253TestJSON-2133146439-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:18.155876 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-749df8e1-0c0e-44ff-8abd-eec2b1daa6b7 tempest-ServicesAdminNegativeV253TestJSON-2133146439 tempest-ServicesAdminNegativeV253TestJSON-2133146439-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '10bb94ca1d50485fac73c9d184a359b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1551abd91e3142c897fad61995531a59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:18.157890 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-749df8e1-0c0e-44ff-8abd-eec2b1daa6b7 tempest-ServicesAdminNegativeV253TestJSON-2133146439 tempest-ServicesAdminNegativeV253TestJSON-2133146439-project] Request method failure captured: Oct 04 20:35:18.157890 n-d-854823-8 devstack@n-api.service[128801]: request: GET /compute/v2.1/os-services HTTP/1.1 Oct 04 20:35:18.157890 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:35:18.157890 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:35:18.157890 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:35:18.157890 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 0 Oct 04 20:35:18.157890 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:35:18.157890 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:35:18.157890 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:35:18.157890 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:35:18.157890 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJj76M4fgGFyu15-Il2FBLMeL73V_YqmW5Z3jyEG8rLF_7H0pxfCUFtnCvNaW1USrvzqn1OKaac8B0csq25wLJB9W1k6P1FT5ZaKLNotWf57o-wD8QL8vdbHPmYcZGbcb11nIv-15C_gAsxeu_fNtutEzI3uzTsYYGUQkb2jqfMdOQY Oct 04 20:35:18.157890 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:35:18.157890 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:35:18.157890 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:35:18.157890 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:35:18.157890 n-d-854823-8 devstack@n-api.service[128801]: X-Openstack-Nova-Api-Version: 2.53 Oct 04 20:35:18.157890 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:35:18.157890 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:35:18.157890 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: 1551abd91e3142c897fad61995531a59 Oct 04 20:35:18.157890 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-2133146439 Oct 04 20:35:18.157890 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 20:35:18.157890 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 20:35:18.159510 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_1551abd91e3142c897fad61995531a59", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1551abd91e3142c897fad61995531a59"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1551abd91e3142c897fad61995531a59"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/1551abd91e3142c897fad61995531a59"}]}] Oct 04 20:35:18.159510 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-2133146439 Oct 04 20:35:18.159510 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: 1551abd91e3142c897fad61995531a59 Oct 04 20:35:18.159510 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-2133146439 Oct 04 20:35:18.159510 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-ServicesAdminNegativeV253TestJSON-2133146439-project Oct 04 20:35:18.159510 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:35:18.159510 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:35:18.159510 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: 10bb94ca1d50485fac73c9d184a359b1 Oct 04 20:35:18.159510 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-2133146439-project Oct 04 20:35:18.159510 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 20:35:18.159510 n-d-854823-8 devstack@n-api.service[128801]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 04 20:35:18.159510 n-d-854823-8 devstack@n-api.service[128801]: action_args: {} Oct 04 20:35:18.160298 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:35:18.160298 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:35:18.160298 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:35:18.160298 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:35:18.160298 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:35:18.160298 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:35:18.160298 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 20:35:18.160298 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:35:18.160298 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 20:35:18.160298 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:35:18.160298 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:35:18.160298 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:35:18.160298 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Oct 04 20:35:18.160298 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Oct 04 20:35:18.160298 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 20:35:18.160298 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 20:35:18.160298 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 20:35:18.160298 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 20:35:18.160298 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 20:35:18.161565 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 20:35:18.161565 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 20:35:18.161565 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 20:35:18.161565 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 20:35:18.161565 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 20:35:18.161565 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 20:35:18.161565 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 20:35:18.161565 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 20:35:18.161565 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 20:35:18.161565 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 04 20:35:18.161565 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:35:18.161565 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:35:18.161565 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:35:18.161565 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:35:18.161565 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:35:18.161565 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:35:18.161565 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 20:35:18.161565 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 20:35:18.161565 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 04 20:35:18.161565 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:35:18.165698 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-749df8e1-0c0e-44ff-8abd-eec2b1daa6b7 tempest-ServicesAdminNegativeV253TestJSON-2133146439 tempest-ServicesAdminNegativeV253TestJSON-2133146439-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:35:18.166804 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-749df8e1-0c0e-44ff-8abd-eec2b1daa6b7 tempest-ServicesAdminNegativeV253TestJSON-2133146439 tempest-ServicesAdminNegativeV253TestJSON-2133146439-project] 10.222.0.33 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.53 time: 0.233484 Oct 04 20:35:18.167529 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 274/532] 10.222.0.33 () {60 vars in 1178 bytes} [Tue Oct 4 20:35:17 2022] GET /compute/v2.1/os-services => generated 112 bytes in 235 msecs (HTTP/1.1 403) 9 headers in 381 bytes (1 switches on core 0) Oct 04 20:35:18.186074 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-44d149e2-47bb-4fa6-8e42-887299b1d019 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:18.186821 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-44d149e2-47bb-4fa6-8e42-887299b1d019 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] [instance: c7f3bb5b-e08b-4a3f-ba4d-40012179412e] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:18.198288 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-44d149e2-47bb-4fa6-8e42-887299b1d019 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:18.199117 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-44d149e2-47bb-4fa6-8e42-887299b1d019 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:18.199627 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-44d149e2-47bb-4fa6-8e42-887299b1d019 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:18.204142 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-44d149e2-47bb-4fa6-8e42-887299b1d019 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:18.205732 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-44d149e2-47bb-4fa6-8e42-887299b1d019 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:18.206592 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-44d149e2-47bb-4fa6-8e42-887299b1d019 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:18.452007 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-44d149e2-47bb-4fa6-8e42-887299b1d019 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3563efe2b8c94931a2a46c4e14811b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3118a5d96843d3bede1ed94bd9717e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:18.462781 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-44d149e2-47bb-4fa6-8e42-887299b1d019 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] 10.222.0.33 "GET /compute/v2.1/servers/c7f3bb5b-e08b-4a3f-ba4d-40012179412e" status: 200 len: 1270 microversion: 2.1 time: 0.291943 Oct 04 20:35:18.467213 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 275/533] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:18 2022] GET /compute/v2.1/servers/c7f3bb5b-e08b-4a3f-ba4d-40012179412e => generated 1270 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:18.484458 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-cdec25df-eb00-44c1-bffe-9beaf12e41e1 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:18.485168 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-cdec25df-eb00-44c1-bffe-9beaf12e41e1 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] [instance: c6cdf5bb-821d-4438-9c05-f227c4ebbbcd] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:18.503990 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cdec25df-eb00-44c1-bffe-9beaf12e41e1 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:18.504492 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cdec25df-eb00-44c1-bffe-9beaf12e41e1 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:18.504953 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cdec25df-eb00-44c1-bffe-9beaf12e41e1 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:18.505916 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cdec25df-eb00-44c1-bffe-9beaf12e41e1 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:18.506434 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cdec25df-eb00-44c1-bffe-9beaf12e41e1 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:18.511121 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cdec25df-eb00-44c1-bffe-9beaf12e41e1 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:18.912476 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-cdec25df-eb00-44c1-bffe-9beaf12e41e1 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5eda279f6034608b192839a54dda616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f28e80977de42a892b84295ecf05141', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:18.929033 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-cdec25df-eb00-44c1-bffe-9beaf12e41e1 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] 10.222.0.33 "GET /compute/v2.1/servers/c6cdf5bb-821d-4438-9c05-f227c4ebbbcd" status: 200 len: 1387 microversion: 2.1 time: 0.457532 Oct 04 20:35:18.930811 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 276/534] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:18 2022] GET /compute/v2.1/servers/c6cdf5bb-821d-4438-9c05-f227c4ebbbcd => generated 1387 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:18.943213 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c5545317-1aed-4066-bab3-6915e035855b tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:18.950599 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c5545317-1aed-4066-bab3-6915e035855b tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] [instance: dd727dc7-96ee-4553-84ca-0f9b6ed59781] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:18.968828 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c5545317-1aed-4066-bab3-6915e035855b tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:18.969759 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c5545317-1aed-4066-bab3-6915e035855b tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:18.970296 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c5545317-1aed-4066-bab3-6915e035855b tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:18.972899 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c5545317-1aed-4066-bab3-6915e035855b tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:18.973662 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c5545317-1aed-4066-bab3-6915e035855b tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:18.974762 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c5545317-1aed-4066-bab3-6915e035855b tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:19.435283 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c5545317-1aed-4066-bab3-6915e035855b tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f051a291d59242469f8172a9c474ac89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f0707d756b4ee085a19cccf3ab82c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:19.448534 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c5545317-1aed-4066-bab3-6915e035855b tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] 10.222.0.33 "GET /compute/v2.1/servers/dd727dc7-96ee-4553-84ca-0f9b6ed59781" status: 200 len: 1318 microversion: 2.1 time: 0.515301 Oct 04 20:35:19.449656 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 277/535] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:18 2022] GET /compute/v2.1/servers/dd727dc7-96ee-4553-84ca-0f9b6ed59781 => generated 1318 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:19.456904 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0c10383e-2ef7-4fde-bc67-529fc28bcea1 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:19.457634 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-0c10383e-2ef7-4fde-bc67-529fc28bcea1 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] [instance: 1c6ffc0f-3aaa-41f8-9a9a-0040295fe064] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:19.469864 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0c10383e-2ef7-4fde-bc67-529fc28bcea1 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:19.470503 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0c10383e-2ef7-4fde-bc67-529fc28bcea1 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:19.471034 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0c10383e-2ef7-4fde-bc67-529fc28bcea1 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:19.472271 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0c10383e-2ef7-4fde-bc67-529fc28bcea1 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:19.473566 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0c10383e-2ef7-4fde-bc67-529fc28bcea1 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:19.474371 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0c10383e-2ef7-4fde-bc67-529fc28bcea1 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:19.958377 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-0c10383e-2ef7-4fde-bc67-529fc28bcea1 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a24944aeb34a5ea228965be9bf4ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c288268acb30475bbc065a8f72cb21d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:19.971200 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-0c10383e-2ef7-4fde-bc67-529fc28bcea1 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] 10.222.0.33 "GET /compute/v2.1/servers/1c6ffc0f-3aaa-41f8-9a9a-0040295fe064" status: 200 len: 1313 microversion: 2.1 time: 0.517017 Oct 04 20:35:19.975591 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 278/536] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:19 2022] GET /compute/v2.1/servers/1c6ffc0f-3aaa-41f8-9a9a-0040295fe064 => generated 1313 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:19.987296 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7f3bc0f2-27c3-4d1c-8df0-26ec43543e66 tempest-DeleteServersAdminTestJSON-1986202439 tempest-DeleteServersAdminTestJSON-1986202439-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:35:19.993320 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-7f3bc0f2-27c3-4d1c-8df0-26ec43543e66 tempest-DeleteServersAdminTestJSON-1986202439 tempest-DeleteServersAdminTestJSON-1986202439-project-admin] [instance: 2457c5d1-8842-4a2d-a5d4-fe97b53b64df] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:19.995519 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:INSERT=7,nova_api:SELECT=93 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:35:20.004795 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7f3bc0f2-27c3-4d1c-8df0-26ec43543e66 tempest-DeleteServersAdminTestJSON-1986202439 tempest-DeleteServersAdminTestJSON-1986202439-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:20.005387 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7f3bc0f2-27c3-4d1c-8df0-26ec43543e66 tempest-DeleteServersAdminTestJSON-1986202439 tempest-DeleteServersAdminTestJSON-1986202439-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:20.005955 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7f3bc0f2-27c3-4d1c-8df0-26ec43543e66 tempest-DeleteServersAdminTestJSON-1986202439 tempest-DeleteServersAdminTestJSON-1986202439-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:20.007066 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7f3bc0f2-27c3-4d1c-8df0-26ec43543e66 tempest-DeleteServersAdminTestJSON-1986202439 tempest-DeleteServersAdminTestJSON-1986202439-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:20.008512 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7f3bc0f2-27c3-4d1c-8df0-26ec43543e66 tempest-DeleteServersAdminTestJSON-1986202439 tempest-DeleteServersAdminTestJSON-1986202439-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:20.009182 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7f3bc0f2-27c3-4d1c-8df0-26ec43543e66 tempest-DeleteServersAdminTestJSON-1986202439 tempest-DeleteServersAdminTestJSON-1986202439-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:20.192608 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-7f3bc0f2-27c3-4d1c-8df0-26ec43543e66 tempest-DeleteServersAdminTestJSON-1986202439 tempest-DeleteServersAdminTestJSON-1986202439-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/2457c5d1-8842-4a2d-a5d4-fe97b53b64df/action" status: 202 len: 0 microversion: 2.1 time: 0.214908 Oct 04 20:35:20.193421 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 279/537] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 20:35:19 2022] POST /compute/v2.1/servers/2457c5d1-8842-4a2d-a5d4-fe97b53b64df/action => generated 0 bytes in 217 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:35:20.198553 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c9720924-0913-4828-b635-d4bebce66e84 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:20.199166 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c9720924-0913-4828-b635-d4bebce66e84 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] [instance: c7f3bb5b-e08b-4a3f-ba4d-40012179412e] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:20.205399 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c9720924-0913-4828-b635-d4bebce66e84 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:20.205894 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c9720924-0913-4828-b635-d4bebce66e84 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:20.206318 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c9720924-0913-4828-b635-d4bebce66e84 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:20.207063 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c9720924-0913-4828-b635-d4bebce66e84 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:20.207520 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c9720924-0913-4828-b635-d4bebce66e84 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:20.207940 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c9720924-0913-4828-b635-d4bebce66e84 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:20.244549 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-5de14ed7-b17d-44ec-b0ba-fa7e9cda02e2 tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] 10.222.0.33 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.844244 Oct 04 20:35:20.248709 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 259/538] 10.222.0.33 () {60 vars in 1170 bytes} [Tue Oct 4 20:35:16 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3849 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:35:20.261446 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-44fe520c-b5a9-4164-a29d-a28cea640b82 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:20.263463 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-44fe520c-b5a9-4164-a29d-a28cea640b82 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] [instance: c6cdf5bb-821d-4438-9c05-f227c4ebbbcd] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:20.317743 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-44fe520c-b5a9-4164-a29d-a28cea640b82 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:20.318851 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-44fe520c-b5a9-4164-a29d-a28cea640b82 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:20.320833 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-44fe520c-b5a9-4164-a29d-a28cea640b82 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:20.327736 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-44fe520c-b5a9-4164-a29d-a28cea640b82 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:20.329097 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-44fe520c-b5a9-4164-a29d-a28cea640b82 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:20.334835 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-44fe520c-b5a9-4164-a29d-a28cea640b82 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:20.796636 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c9720924-0913-4828-b635-d4bebce66e84 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3563efe2b8c94931a2a46c4e14811b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3118a5d96843d3bede1ed94bd9717e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:20.812230 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c9720924-0913-4828-b635-d4bebce66e84 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] 10.222.0.33 "GET /compute/v2.1/servers/c7f3bb5b-e08b-4a3f-ba4d-40012179412e" status: 200 len: 1312 microversion: 2.1 time: 0.617417 Oct 04 20:35:20.813267 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 280/539] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:20 2022] GET /compute/v2.1/servers/c7f3bb5b-e08b-4a3f-ba4d-40012179412e => generated 1312 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:20.822672 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-aa9ca165-1d4a-4355-8536-64457aa450d3 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:20.827260 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-aa9ca165-1d4a-4355-8536-64457aa450d3 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] [instance: 2457c5d1-8842-4a2d-a5d4-fe97b53b64df] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:20.847711 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-aa9ca165-1d4a-4355-8536-64457aa450d3 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:20.849027 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-aa9ca165-1d4a-4355-8536-64457aa450d3 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:20.853936 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-aa9ca165-1d4a-4355-8536-64457aa450d3 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:20.855062 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-aa9ca165-1d4a-4355-8536-64457aa450d3 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:20.859193 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-aa9ca165-1d4a-4355-8536-64457aa450d3 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:20.862012 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-aa9ca165-1d4a-4355-8536-64457aa450d3 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:20.924002 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-44fe520c-b5a9-4164-a29d-a28cea640b82 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5eda279f6034608b192839a54dda616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f28e80977de42a892b84295ecf05141', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:20.938358 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-44fe520c-b5a9-4164-a29d-a28cea640b82 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] 10.222.0.33 "GET /compute/v2.1/servers/c6cdf5bb-821d-4438-9c05-f227c4ebbbcd" status: 200 len: 1387 microversion: 2.1 time: 0.684275 Oct 04 20:35:20.942457 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 260/540] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:20 2022] GET /compute/v2.1/servers/c6cdf5bb-821d-4438-9c05-f227c4ebbbcd => generated 1387 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:20.945569 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-aa9ca165-1d4a-4355-8536-64457aa450d3 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:20.947250 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-aa9ca165-1d4a-4355-8536-64457aa450d3 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:20.947692 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-aa9ca165-1d4a-4355-8536-64457aa450d3 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:20.948157 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-aa9ca165-1d4a-4355-8536-64457aa450d3 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Lazy-loading 'fault' on Instance uuid 2457c5d1-8842-4a2d-a5d4-fe97b53b64df {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:35:20.953671 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-fdbd54f4-d37e-4790-aa0e-6429268554f8 tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.4.252"}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:35:20.960280 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-fdbd54f4-d37e-4790-aa0e-6429268554f8 tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] [instance: 486112b2-497b-4039-ac04-b23cf076d470] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:20.975795 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fdbd54f4-d37e-4790-aa0e-6429268554f8 tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:20.977654 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fdbd54f4-d37e-4790-aa0e-6429268554f8 tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:20.978865 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fdbd54f4-d37e-4790-aa0e-6429268554f8 tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:20.983509 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fdbd54f4-d37e-4790-aa0e-6429268554f8 tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:20.984397 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fdbd54f4-d37e-4790-aa0e-6429268554f8 tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:20.985069 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fdbd54f4-d37e-4790-aa0e-6429268554f8 tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:21.048929 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fdbd54f4-d37e-4790-aa0e-6429268554f8 tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] Acquiring lock "refresh_cache-486112b2-497b-4039-ac04-b23cf076d470" {{(pid=128802) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 04 20:35:21.053071 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fdbd54f4-d37e-4790-aa0e-6429268554f8 tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] Acquired lock "refresh_cache-486112b2-497b-4039-ac04-b23cf076d470" {{(pid=128802) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 04 20:35:21.462386 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-aa9ca165-1d4a-4355-8536-64457aa450d3 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cbd31af13444cda97ba5f8c99d19437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a307499cf44d03a1e9bb61f614f099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:21.471505 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-aa9ca165-1d4a-4355-8536-64457aa450d3 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] 10.222.0.33 "GET /compute/v2.1/servers/2457c5d1-8842-4a2d-a5d4-fe97b53b64df" status: 200 len: 1452 microversion: 2.1 time: 0.656864 Oct 04 20:35:21.475417 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 281/541] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:20 2022] GET /compute/v2.1/servers/2457c5d1-8842-4a2d-a5d4-fe97b53b64df => generated 1452 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:21.492757 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-ffbcac67-da5b-43e0-b4bc-d4b8ef984a5c req-40af3091-abc9-4780-8447-814d29492024 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6cdf5bb-821d-4438-9c05-f227c4ebbbcd", "name": "network-vif-plugged", "status": "completed", "tag": "ad1d4490-762d-4d97-941f-671901ca0477"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:35:21.518241 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-ffbcac67-da5b-43e0-b4bc-d4b8ef984a5c req-40af3091-abc9-4780-8447-814d29492024 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:21.518848 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-ffbcac67-da5b-43e0-b4bc-d4b8ef984a5c req-40af3091-abc9-4780-8447-814d29492024 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:21.520615 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-ffbcac67-da5b-43e0-b4bc-d4b8ef984a5c req-40af3091-abc9-4780-8447-814d29492024 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:21.536523 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-ffbcac67-da5b-43e0-b4bc-d4b8ef984a5c req-40af3091-abc9-4780-8447-814d29492024 service nova] Creating event network-vif-plugged:ad1d4490-762d-4d97-941f-671901ca0477 for instance c6cdf5bb-821d-4438-9c05-f227c4ebbbcd on n-h2-854823-8 Oct 04 20:35:21.542876 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-ffbcac67-da5b-43e0-b4bc-d4b8ef984a5c req-40af3091-abc9-4780-8447-814d29492024 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066066 Oct 04 20:35:21.547331 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 282/542] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:35:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:35:21.554067 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-98771af0-cba8-44d4-9261-967d3558ec3c tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:21.555495 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-98771af0-cba8-44d4-9261-967d3558ec3c tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] [instance: dd727dc7-96ee-4553-84ca-0f9b6ed59781] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:21.561950 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-98771af0-cba8-44d4-9261-967d3558ec3c tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:21.562771 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-98771af0-cba8-44d4-9261-967d3558ec3c tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:21.563378 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-98771af0-cba8-44d4-9261-967d3558ec3c tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:21.564251 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-98771af0-cba8-44d4-9261-967d3558ec3c tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:21.564859 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-98771af0-cba8-44d4-9261-967d3558ec3c tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:21.565657 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-98771af0-cba8-44d4-9261-967d3558ec3c tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:22.083828 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-98771af0-cba8-44d4-9261-967d3558ec3c tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f051a291d59242469f8172a9c474ac89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f0707d756b4ee085a19cccf3ab82c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:22.089356 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:35:22.094905 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-98771af0-cba8-44d4-9261-967d3558ec3c tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] 10.222.0.33 "GET /compute/v2.1/servers/dd727dc7-96ee-4553-84ca-0f9b6ed59781" status: 200 len: 1318 microversion: 2.1 time: 0.545484 Oct 04 20:35:22.108745 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 283/543] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:21 2022] GET /compute/v2.1/servers/dd727dc7-96ee-4553-84ca-0f9b6ed59781 => generated 1318 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:22.120877 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d9ce53aa-b8d0-4140-bb16-7255eec4bef3 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:22.121661 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d9ce53aa-b8d0-4140-bb16-7255eec4bef3 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] [instance: 1c6ffc0f-3aaa-41f8-9a9a-0040295fe064] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:22.127942 n-d-854823-8 devstack@n-api.service[128802]: DEBUG neutronclient.v2_0.client [None req-fdbd54f4-d37e-4790-aa0e-6429268554f8 tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] Error message: {"NeutronError": {"type": "FloatingIPPortAlreadyAssociated", "message": "Cannot associate floating IP 172.25.4.252 (46757afa-3ca1-41f1-a4cc-25f9dc8e40a8) with port b97b70cc-e857-429e-ad48-a973b62edd3e using fixed IP 172.20.0.11, as that fixed IP already has a floating IP on external network 7ace76e5-f8c6-495a-b11c-0ae1f7a6ece8.", "detail": ""}} {{(pid=128802) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 20:35:22.129480 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fdbd54f4-d37e-4790-aa0e-6429268554f8 tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] Releasing lock "refresh_cache-486112b2-497b-4039-ac04-b23cf076d470" {{(pid=128802) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 04 20:35:22.129979 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d9ce53aa-b8d0-4140-bb16-7255eec4bef3 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:22.130763 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d9ce53aa-b8d0-4140-bb16-7255eec4bef3 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:22.131089 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.wsgi [None req-fdbd54f4-d37e-4790-aa0e-6429268554f8 tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] HTTP exception thrown: Cannot associate floating IP 172.25.4.252 (46757afa-3ca1-41f1-a4cc-25f9dc8e40a8) with port b97b70cc-e857-429e-ad48-a973b62edd3e using fixed IP 172.20.0.11, as that fixed IP already has a floating IP on external network 7ace76e5-f8c6-495a-b11c-0ae1f7a6ece8. Oct 04 20:35:22.131089 n-d-854823-8 devstack@n-api.service[128802]: Neutron server returns request_ids: ['req-35a20236-c3d1-4220-8b8d-9dc213e7877e'] Oct 04 20:35:22.131475 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d9ce53aa-b8d0-4140-bb16-7255eec4bef3 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:22.132271 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d9ce53aa-b8d0-4140-bb16-7255eec4bef3 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:22.132908 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d9ce53aa-b8d0-4140-bb16-7255eec4bef3 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:22.133427 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d9ce53aa-b8d0-4140-bb16-7255eec4bef3 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:22.141308 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-fdbd54f4-d37e-4790-aa0e-6429268554f8 tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] Request method failure captured: Oct 04 20:35:22.141308 n-d-854823-8 devstack@n-api.service[128802]: request: POST /compute/v2.1/servers/486112b2-497b-4039-ac04-b23cf076d470/action HTTP/1.1 Oct 04 20:35:22.141308 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 20:35:22.141308 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 20:35:22.141308 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 20:35:22.141308 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 46 Oct 04 20:35:22.141308 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 20:35:22.141308 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 20:35:22.141308 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 20:35:22.141308 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 20:35:22.141308 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPJjo0ehgCcVLX9m4cw1-oibWoGlG_FZ6zY8pWR3yQddTBQSrtiDqa5aRmsThNvdRC_qNLxv5I7_CVnrkgu0ATHySIX6WJSOdYfvAiWZlOJBL-opPPgsRFwBwXiO-zU137gpGStP7Xj8gt9FNnb87K-zqXIQOjv7J6zBZeUoZGEuXPbs Oct 04 20:35:22.141308 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 20:35:22.141308 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 20:35:22.141308 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 20:35:22.141308 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 20:35:22.141308 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 20:35:22.141308 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 20:35:22.141308 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: b0ca732ccf4d417ab1f7ba82a9c8c41e Oct 04 20:35:22.141308 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-781358035 Oct 04 20:35:22.141308 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 20:35:22.141308 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 20:35:22.143171 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b0ca732ccf4d417ab1f7ba82a9c8c41e", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b0ca732ccf4d417ab1f7ba82a9c8c41e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b0ca732ccf4d417ab1f7ba82a9c8c41e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b0ca732ccf4d417ab1f7ba82a9c8c41e"}]}] Oct 04 20:35:22.143171 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-781358035 Oct 04 20:35:22.143171 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: b0ca732ccf4d417ab1f7ba82a9c8c41e Oct 04 20:35:22.143171 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-781358035 Oct 04 20:35:22.143171 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project Oct 04 20:35:22.143171 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 20:35:22.143171 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 20:35:22.143171 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: f8f72b5b32ab457aaaa1c1ff7efdce5c Oct 04 20:35:22.143171 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project Oct 04 20:35:22.143171 n-d-854823-8 devstack@n-api.service[128802]: Oct 04 20:35:22.143171 n-d-854823-8 devstack@n-api.service[128802]: {"addFloatingIp": {"address": "172.25.4.252"}} Oct 04 20:35:22.143171 n-d-854823-8 devstack@n-api.service[128802]: method: Oct 04 20:35:22.144151 n-d-854823-8 devstack@n-api.service[128802]: exception: Cannot associate floating IP 172.25.4.252 (46757afa-3ca1-41f1-a4cc-25f9dc8e40a8) with port b97b70cc-e857-429e-ad48-a973b62edd3e using fixed IP 172.20.0.11, as that fixed IP already has a floating IP on external network 7ace76e5-f8c6-495a-b11c-0ae1f7a6ece8. Oct 04 20:35:22.144151 n-d-854823-8 devstack@n-api.service[128802]: Neutron server returns request_ids: ['req-35a20236-c3d1-4220-8b8d-9dc213e7877e'] Oct 04 20:35:22.144151 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'id': '486112b2-497b-4039-ac04-b23cf076d470', 'body': {'addFloatingIp': {'address': '172.25.4.252'}}} Oct 04 20:35:22.144151 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:35:22.144151 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:35:22.144151 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2703, in associate_floating_ip Oct 04 20:35:22.144151 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi client.update_floatingip(fip['id'], {'floatingip': param}) Oct 04 20:35:22.144151 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:35:22.144151 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:35:22.144151 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1016, in update_floatingip Oct 04 20:35:22.144151 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return self._update_resource(self.floatingip_path % (floatingip), Oct 04 20:35:22.144151 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:35:22.144151 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:35:22.144151 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 2548, in _update_resource Oct 04 20:35:22.144151 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return self.put(path, **kwargs) Oct 04 20:35:22.144151 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:35:22.144151 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:35:22.145483 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 365, in put Oct 04 20:35:22.145483 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return self.retry_request("PUT", action, body=body, Oct 04 20:35:22.145483 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:35:22.145483 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:35:22.145483 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:35:22.145483 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:35:22.145483 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:35:22.145483 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:35:22.145483 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 20:35:22.145483 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 20:35:22.145483 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:35:22.145483 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:35:22.145483 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 20:35:22.145483 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 20:35:22.145483 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 20:35:22.145483 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 20:35:22.146978 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Cannot associate floating IP 172.25.4.252 (46757afa-3ca1-41f1-a4cc-25f9dc8e40a8) with port b97b70cc-e857-429e-ad48-a973b62edd3e using fixed IP 172.20.0.11, as that fixed IP already has a floating IP on external network 7ace76e5-f8c6-495a-b11c-0ae1f7a6ece8. Oct 04 20:35:22.146978 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-35a20236-c3d1-4220-8b8d-9dc213e7877e'] Oct 04 20:35:22.146978 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:35:22.146978 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:35:22.146978 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:35:22.146978 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:35:22.146978 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Oct 04 20:35:22.146978 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Oct 04 20:35:22.146978 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 165, in wrapper Oct 04 20:35:22.146978 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Oct 04 20:35:22.146978 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2705, in associate_floating_ip Oct 04 20:35:22.146978 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpAssociateFailed(str(e)) Oct 04 20:35:22.146978 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpAssociateFailed: Cannot associate floating IP 172.25.4.252 (46757afa-3ca1-41f1-a4cc-25f9dc8e40a8) with port b97b70cc-e857-429e-ad48-a973b62edd3e using fixed IP 172.20.0.11, as that fixed IP already has a floating IP on external network 7ace76e5-f8c6-495a-b11c-0ae1f7a6ece8. Oct 04 20:35:22.146978 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-35a20236-c3d1-4220-8b8d-9dc213e7877e'] Oct 04 20:35:22.146978 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:35:22.146978 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:35:22.148484 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:35:22.148484 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:35:22.148484 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:35:22.148484 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:35:22.148484 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:35:22.148484 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:35:22.148484 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:35:22.148484 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:35:22.148484 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:35:22.148484 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:35:22.148484 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:35:22.148484 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:35:22.148484 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 246, in _add_floating_ip Oct 04 20:35:22.148484 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=e.format_message()) Oct 04 20:35:22.148484 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Cannot associate floating IP 172.25.4.252 (46757afa-3ca1-41f1-a4cc-25f9dc8e40a8) with port b97b70cc-e857-429e-ad48-a973b62edd3e using fixed IP 172.20.0.11, as that fixed IP already has a floating IP on external network 7ace76e5-f8c6-495a-b11c-0ae1f7a6ece8. Oct 04 20:35:22.148484 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-35a20236-c3d1-4220-8b8d-9dc213e7877e'] Oct 04 20:35:22.148484 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:35:22.148484 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:35:22.149934 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:35:22.149934 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:35:22.149934 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:35:22.149934 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:35:22.149934 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:35:22.149934 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:35:22.149934 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot associate floating IP 172.25.4.252 (46757afa-3ca1-41f1-a4cc-25f9dc8e40a8) with port b97b70cc-e857-429e-ad48-a973b62edd3e using fixed IP 172.20.0.11, as that fixed IP already has a floating IP on external network 7ace76e5-f8c6-495a-b11c-0ae1f7a6ece8. Oct 04 20:35:22.149934 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-35a20236-c3d1-4220-8b8d-9dc213e7877e'] Oct 04 20:35:22.149934 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:35:22.149934 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-fdbd54f4-d37e-4790-aa0e-6429268554f8 tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] Returning 400 to user: Cannot associate floating IP 172.25.4.252 (46757afa-3ca1-41f1-a4cc-25f9dc8e40a8) with port b97b70cc-e857-429e-ad48-a973b62edd3e using fixed IP 172.20.0.11, as that fixed IP already has a floating IP on external network 7ace76e5-f8c6-495a-b11c-0ae1f7a6ece8. Oct 04 20:35:22.149934 n-d-854823-8 devstack@n-api.service[128802]: Neutron server returns request_ids: ['req-35a20236-c3d1-4220-8b8d-9dc213e7877e'] {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:35:22.150866 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-fdbd54f4-d37e-4790-aa0e-6429268554f8 tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] 10.222.0.33 "POST /compute/v2.1/servers/486112b2-497b-4039-ac04-b23cf076d470/action" status: 400 len: 382 microversion: 2.1 time: 1.199265 Oct 04 20:35:22.150866 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 261/544] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 20:35:20 2022] POST /compute/v2.1/servers/486112b2-497b-4039-ac04-b23cf076d470/action => generated 382 bytes in 1204 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 20:35:22.152151 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-1d63253b-131f-459a-a900-4924bceef240 req-38842ddf-94bb-44c8-9bc1-01f9adb0509b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c6ffc0f-3aaa-41f8-9a9a-0040295fe064", "tag": "edb0cd98-3f42-4412-a492-45b170a8ad7b"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:35:22.167037 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-1d63253b-131f-459a-a900-4924bceef240 req-38842ddf-94bb-44c8-9bc1-01f9adb0509b service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:22.167788 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-1d63253b-131f-459a-a900-4924bceef240 req-38842ddf-94bb-44c8-9bc1-01f9adb0509b service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:22.168582 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-1d63253b-131f-459a-a900-4924bceef240 req-38842ddf-94bb-44c8-9bc1-01f9adb0509b service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:22.184031 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-1d63253b-131f-459a-a900-4924bceef240 req-38842ddf-94bb-44c8-9bc1-01f9adb0509b service nova] Creating event network-changed:edb0cd98-3f42-4412-a492-45b170a8ad7b for instance 1c6ffc0f-3aaa-41f8-9a9a-0040295fe064 on n-h2-854823-8 Oct 04 20:35:22.189129 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-1d63253b-131f-459a-a900-4924bceef240 req-38842ddf-94bb-44c8-9bc1-01f9adb0509b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040877 Oct 04 20:35:22.190324 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 262/545] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:35:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:35:22.197081 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-72eadecb-d04c-4819-941d-d9b0fcd15808 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:22.198598 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-72eadecb-d04c-4819-941d-d9b0fcd15808 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] [instance: 2457c5d1-8842-4a2d-a5d4-fe97b53b64df] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:22.205342 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-72eadecb-d04c-4819-941d-d9b0fcd15808 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:22.205853 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-72eadecb-d04c-4819-941d-d9b0fcd15808 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:22.206371 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-72eadecb-d04c-4819-941d-d9b0fcd15808 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:22.207373 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-72eadecb-d04c-4819-941d-d9b0fcd15808 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:22.207892 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-72eadecb-d04c-4819-941d-d9b0fcd15808 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:22.208324 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-72eadecb-d04c-4819-941d-d9b0fcd15808 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:22.240536 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-72eadecb-d04c-4819-941d-d9b0fcd15808 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] [instance: 2457c5d1-8842-4a2d-a5d4-fe97b53b64df] Going to try to terminate instance {{(pid=128802) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:35:22.327351 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-72eadecb-d04c-4819-941d-d9b0fcd15808 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] 10.222.0.33 "DELETE /compute/v2.1/servers/2457c5d1-8842-4a2d-a5d4-fe97b53b64df" status: 204 len: 0 microversion: 2.1 time: 0.134951 Oct 04 20:35:22.327951 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 263/546] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 20:35:22 2022] DELETE /compute/v2.1/servers/2457c5d1-8842-4a2d-a5d4-fe97b53b64df => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:35:22.333580 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-581d6c6a-ca68-455a-a86e-ea93700ba872 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:22.334389 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-581d6c6a-ca68-455a-a86e-ea93700ba872 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] [instance: c7f3bb5b-e08b-4a3f-ba4d-40012179412e] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:22.341251 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-581d6c6a-ca68-455a-a86e-ea93700ba872 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:22.341745 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-581d6c6a-ca68-455a-a86e-ea93700ba872 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:22.342174 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-581d6c6a-ca68-455a-a86e-ea93700ba872 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:22.342921 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-581d6c6a-ca68-455a-a86e-ea93700ba872 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:22.343378 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-581d6c6a-ca68-455a-a86e-ea93700ba872 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:22.343867 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-581d6c6a-ca68-455a-a86e-ea93700ba872 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:22.673596 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d9ce53aa-b8d0-4140-bb16-7255eec4bef3 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a24944aeb34a5ea228965be9bf4ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c288268acb30475bbc065a8f72cb21d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:22.688434 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d9ce53aa-b8d0-4140-bb16-7255eec4bef3 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] 10.222.0.33 "GET /compute/v2.1/servers/1c6ffc0f-3aaa-41f8-9a9a-0040295fe064" status: 200 len: 1313 microversion: 2.1 time: 0.578362 Oct 04 20:35:22.691705 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 284/547] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:22 2022] GET /compute/v2.1/servers/1c6ffc0f-3aaa-41f8-9a9a-0040295fe064 => generated 1313 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:22.697958 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-96ce8d95-b2ea-49d8-aaed-32e6c8a35bee tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:22.699707 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-96ce8d95-b2ea-49d8-aaed-32e6c8a35bee tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] [instance: c6cdf5bb-821d-4438-9c05-f227c4ebbbcd] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:22.708253 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-96ce8d95-b2ea-49d8-aaed-32e6c8a35bee tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:22.708819 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-96ce8d95-b2ea-49d8-aaed-32e6c8a35bee tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:22.709485 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-96ce8d95-b2ea-49d8-aaed-32e6c8a35bee tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:22.710264 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-96ce8d95-b2ea-49d8-aaed-32e6c8a35bee tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:22.711283 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-96ce8d95-b2ea-49d8-aaed-32e6c8a35bee tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:22.711873 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-96ce8d95-b2ea-49d8-aaed-32e6c8a35bee tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:22.796392 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-581d6c6a-ca68-455a-a86e-ea93700ba872 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3563efe2b8c94931a2a46c4e14811b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3118a5d96843d3bede1ed94bd9717e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:22.805723 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-581d6c6a-ca68-455a-a86e-ea93700ba872 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] 10.222.0.33 "GET /compute/v2.1/servers/c7f3bb5b-e08b-4a3f-ba4d-40012179412e" status: 200 len: 1312 microversion: 2.1 time: 0.476369 Oct 04 20:35:22.806310 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 264/548] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:22 2022] GET /compute/v2.1/servers/c7f3bb5b-e08b-4a3f-ba4d-40012179412e => generated 1312 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:22.812850 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-02538682-43dd-4b12-9f03-f54d0cd629e6 tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] Calling method '.version_select at 0x7f3c74b428b0>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:23.142932 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-96ce8d95-b2ea-49d8-aaed-32e6c8a35bee tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5eda279f6034608b192839a54dda616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f28e80977de42a892b84295ecf05141', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:23.157255 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-96ce8d95-b2ea-49d8-aaed-32e6c8a35bee tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] 10.222.0.33 "GET /compute/v2.1/servers/c6cdf5bb-821d-4438-9c05-f227c4ebbbcd" status: 200 len: 1387 microversion: 2.1 time: 0.463997 Oct 04 20:35:23.173187 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 285/549] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:22 2022] GET /compute/v2.1/servers/c6cdf5bb-821d-4438-9c05-f227c4ebbbcd => generated 1387 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:23.184208 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8eb0bc66-c787-4578-8cbd-ff321fd4217f tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:23.191043 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-8eb0bc66-c787-4578-8cbd-ff321fd4217f tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] [instance: 2457c5d1-8842-4a2d-a5d4-fe97b53b64df] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:23.203602 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8eb0bc66-c787-4578-8cbd-ff321fd4217f tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:23.209564 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8eb0bc66-c787-4578-8cbd-ff321fd4217f tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:23.210280 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8eb0bc66-c787-4578-8cbd-ff321fd4217f tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:23.211620 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8eb0bc66-c787-4578-8cbd-ff321fd4217f tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:23.212325 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8eb0bc66-c787-4578-8cbd-ff321fd4217f tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:23.217528 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8eb0bc66-c787-4578-8cbd-ff321fd4217f tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:23.296311 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8eb0bc66-c787-4578-8cbd-ff321fd4217f tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:23.296710 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8eb0bc66-c787-4578-8cbd-ff321fd4217f tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:23.297141 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8eb0bc66-c787-4578-8cbd-ff321fd4217f tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:23.297589 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-8eb0bc66-c787-4578-8cbd-ff321fd4217f tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Lazy-loading 'fault' on Instance uuid 2457c5d1-8842-4a2d-a5d4-fe97b53b64df {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:35:23.693948 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-8eb0bc66-c787-4578-8cbd-ff321fd4217f tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cbd31af13444cda97ba5f8c99d19437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a307499cf44d03a1e9bb61f614f099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:23.713413 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-8eb0bc66-c787-4578-8cbd-ff321fd4217f tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] 10.222.0.33 "GET /compute/v2.1/servers/2457c5d1-8842-4a2d-a5d4-fe97b53b64df" status: 200 len: 1458 microversion: 2.1 time: 0.535211 Oct 04 20:35:23.713998 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 286/550] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:23 2022] GET /compute/v2.1/servers/2457c5d1-8842-4a2d-a5d4-fe97b53b64df => generated 1458 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:23.718597 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-4cbff811-dc19-42a9-a7a4-6d1796b37158 req-8b81b278-5038-4385-8ee5-aae99765f10f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7f3bb5b-e08b-4a3f-ba4d-40012179412e", "tag": "89b93aa0-8eeb-48c4-a6d4-93a449c21fea"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:35:23.739416 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-4cbff811-dc19-42a9-a7a4-6d1796b37158 req-8b81b278-5038-4385-8ee5-aae99765f10f service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:23.740141 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-4cbff811-dc19-42a9-a7a4-6d1796b37158 req-8b81b278-5038-4385-8ee5-aae99765f10f service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:23.740752 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-4cbff811-dc19-42a9-a7a4-6d1796b37158 req-8b81b278-5038-4385-8ee5-aae99765f10f service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:23.753594 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-4cbff811-dc19-42a9-a7a4-6d1796b37158 req-8b81b278-5038-4385-8ee5-aae99765f10f service nova] Creating event network-changed:89b93aa0-8eeb-48c4-a6d4-93a449c21fea for instance c7f3bb5b-e08b-4a3f-ba4d-40012179412e on n-h1-854823-8 Oct 04 20:35:23.759009 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-4cbff811-dc19-42a9-a7a4-6d1796b37158 req-8b81b278-5038-4385-8ee5-aae99765f10f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043719 Oct 04 20:35:23.760219 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 287/551] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:35:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:35:23.765724 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-347a1610-ff09-4f4a-a8f7-993dce7a26bf tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:23.766746 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-347a1610-ff09-4f4a-a8f7-993dce7a26bf tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] [instance: dd727dc7-96ee-4553-84ca-0f9b6ed59781] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:23.777161 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-347a1610-ff09-4f4a-a8f7-993dce7a26bf tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:23.777685 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-347a1610-ff09-4f4a-a8f7-993dce7a26bf tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:23.778482 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-347a1610-ff09-4f4a-a8f7-993dce7a26bf tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:23.779198 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-347a1610-ff09-4f4a-a8f7-993dce7a26bf tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:23.779324 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-347a1610-ff09-4f4a-a8f7-993dce7a26bf tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:23.781884 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-347a1610-ff09-4f4a-a8f7-993dce7a26bf tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:24.222685 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-347a1610-ff09-4f4a-a8f7-993dce7a26bf tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f051a291d59242469f8172a9c474ac89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f0707d756b4ee085a19cccf3ab82c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:24.244487 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-347a1610-ff09-4f4a-a8f7-993dce7a26bf tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] 10.222.0.33 "GET /compute/v2.1/servers/dd727dc7-96ee-4553-84ca-0f9b6ed59781" status: 200 len: 1318 microversion: 2.1 time: 0.482793 Oct 04 20:35:24.245406 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 288/552] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:23 2022] GET /compute/v2.1/servers/dd727dc7-96ee-4553-84ca-0f9b6ed59781 => generated 1318 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:24.252416 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-3179ebbe-d818-4285-b156-eeed52af6dc3 req-01d71fd1-9d6b-465f-8a7e-8204c9333e2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f8cc082-0a37-4123-a680-1210a90b3ca9", "name": "network-vif-plugged", "status": "completed", "tag": "b3d1f9a5-253e-4b89-ba8b-3d8135069ec1"}, {"server_uuid": "dd727dc7-96ee-4553-84ca-0f9b6ed59781", "name": "network-vif-plugged", "status": "completed", "tag": "a00a0539-edd9-462f-b3eb-c0ff09e3dfb1"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:35:24.278144 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-3179ebbe-d818-4285-b156-eeed52af6dc3 req-01d71fd1-9d6b-465f-8a7e-8204c9333e2b service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:24.279073 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-3179ebbe-d818-4285-b156-eeed52af6dc3 req-01d71fd1-9d6b-465f-8a7e-8204c9333e2b service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:24.279860 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-3179ebbe-d818-4285-b156-eeed52af6dc3 req-01d71fd1-9d6b-465f-8a7e-8204c9333e2b service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:24.298572 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-3179ebbe-d818-4285-b156-eeed52af6dc3 req-01d71fd1-9d6b-465f-8a7e-8204c9333e2b service nova] Creating event network-vif-plugged:b3d1f9a5-253e-4b89-ba8b-3d8135069ec1 for instance 9f8cc082-0a37-4123-a680-1210a90b3ca9 on n-h1-854823-8 Oct 04 20:35:24.302974 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-3179ebbe-d818-4285-b156-eeed52af6dc3 req-01d71fd1-9d6b-465f-8a7e-8204c9333e2b service nova] Creating event network-vif-plugged:a00a0539-edd9-462f-b3eb-c0ff09e3dfb1 for instance dd727dc7-96ee-4553-84ca-0f9b6ed59781 on n-h2-854823-8 Oct 04 20:35:24.316252 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-3179ebbe-d818-4285-b156-eeed52af6dc3 req-01d71fd1-9d6b-465f-8a7e-8204c9333e2b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.069131 Oct 04 20:35:24.317127 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 289/553] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:35:24 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:35:24.329665 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-eaae3906-3fb0-4847-a3f4-f0329f23516e tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:24.330643 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-eaae3906-3fb0-4847-a3f4-f0329f23516e tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] [instance: 1c6ffc0f-3aaa-41f8-9a9a-0040295fe064] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:24.340241 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-eaae3906-3fb0-4847-a3f4-f0329f23516e tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:24.341003 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-eaae3906-3fb0-4847-a3f4-f0329f23516e tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:24.341603 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-eaae3906-3fb0-4847-a3f4-f0329f23516e tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:24.343336 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-eaae3906-3fb0-4847-a3f4-f0329f23516e tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:24.344017 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-eaae3906-3fb0-4847-a3f4-f0329f23516e tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:24.344641 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-eaae3906-3fb0-4847-a3f4-f0329f23516e tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:24.656020 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-02538682-43dd-4b12-9f03-f54d0cd629e6 tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] 10.222.0.33 "DELETE /compute/v2.1/os-floating-ips/46757afa-3ca1-41f1-a4cc-25f9dc8e40a8" status: 202 len: 0 microversion: 2.1 time: 1.846632 Oct 04 20:35:24.660118 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 265/554] 10.222.0.33 () {58 vars in 1263 bytes} [Tue Oct 4 20:35:22 2022] DELETE /compute/v2.1/os-floating-ips/46757afa-3ca1-41f1-a4cc-25f9dc8e40a8 => generated 0 bytes in 1851 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:35:24.667203 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-eaae3906-3fb0-4847-a3f4-f0329f23516e tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a24944aeb34a5ea228965be9bf4ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c288268acb30475bbc065a8f72cb21d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:24.671944 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-6cfb2ee5-f461-4db1-83b3-53fa7bed6732 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:24.672555 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-6cfb2ee5-f461-4db1-83b3-53fa7bed6732 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] [instance: c7f3bb5b-e08b-4a3f-ba4d-40012179412e] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:24.682928 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-eaae3906-3fb0-4847-a3f4-f0329f23516e tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] 10.222.0.33 "GET /compute/v2.1/servers/1c6ffc0f-3aaa-41f8-9a9a-0040295fe064" status: 200 len: 1313 microversion: 2.1 time: 0.358115 Oct 04 20:35:24.683442 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 290/555] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:24 2022] GET /compute/v2.1/servers/1c6ffc0f-3aaa-41f8-9a9a-0040295fe064 => generated 1313 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:24.698979 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6cfb2ee5-f461-4db1-83b3-53fa7bed6732 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:24.698979 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6cfb2ee5-f461-4db1-83b3-53fa7bed6732 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:24.698979 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6cfb2ee5-f461-4db1-83b3-53fa7bed6732 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:24.703449 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6cfb2ee5-f461-4db1-83b3-53fa7bed6732 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:24.703885 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-65c643af-c0fc-4b97-b56e-87dcc97c134a tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:24.704768 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6cfb2ee5-f461-4db1-83b3-53fa7bed6732 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:24.705441 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-65c643af-c0fc-4b97-b56e-87dcc97c134a tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] [instance: c6cdf5bb-821d-4438-9c05-f227c4ebbbcd] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:24.706064 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6cfb2ee5-f461-4db1-83b3-53fa7bed6732 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:24.722536 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-65c643af-c0fc-4b97-b56e-87dcc97c134a tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:24.723308 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-65c643af-c0fc-4b97-b56e-87dcc97c134a tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:24.724131 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-65c643af-c0fc-4b97-b56e-87dcc97c134a tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:24.725178 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-65c643af-c0fc-4b97-b56e-87dcc97c134a tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:24.725962 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-65c643af-c0fc-4b97-b56e-87dcc97c134a tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:24.726952 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-65c643af-c0fc-4b97-b56e-87dcc97c134a tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:24.949796 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-65c643af-c0fc-4b97-b56e-87dcc97c134a tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5eda279f6034608b192839a54dda616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f28e80977de42a892b84295ecf05141', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:24.955117 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-6cfb2ee5-f461-4db1-83b3-53fa7bed6732 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3563efe2b8c94931a2a46c4e14811b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3118a5d96843d3bede1ed94bd9717e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:24.958530 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-65c643af-c0fc-4b97-b56e-87dcc97c134a tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] 10.222.0.33 "GET /compute/v2.1/servers/c6cdf5bb-821d-4438-9c05-f227c4ebbbcd" status: 200 len: 1387 microversion: 2.1 time: 0.270127 Oct 04 20:35:24.959144 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 291/556] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:24 2022] GET /compute/v2.1/servers/c6cdf5bb-821d-4438-9c05-f227c4ebbbcd => generated 1387 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:24.964984 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-68fc3e84-6384-4534-b3d3-d6ec8c771753 tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] Action: 'action', calling method: .version_select at 0x7f3c76319ca0>, body: {"removeFloatingIp": {"address": "172.25.4.102"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:35:24.966730 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-6cfb2ee5-f461-4db1-83b3-53fa7bed6732 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] 10.222.0.33 "GET /compute/v2.1/servers/c7f3bb5b-e08b-4a3f-ba4d-40012179412e" status: 200 len: 1312 microversion: 2.1 time: 0.305033 Oct 04 20:35:24.967575 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 266/557] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:24 2022] GET /compute/v2.1/servers/c7f3bb5b-e08b-4a3f-ba4d-40012179412e => generated 1312 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:24.981829 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-c9afcf72-6f32-43b2-8979-993466ed7e04 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:24.982854 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-c9afcf72-6f32-43b2-8979-993466ed7e04 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] [instance: 2457c5d1-8842-4a2d-a5d4-fe97b53b64df] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:24.990459 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c9afcf72-6f32-43b2-8979-993466ed7e04 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:24.991501 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c9afcf72-6f32-43b2-8979-993466ed7e04 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:24.993137 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c9afcf72-6f32-43b2-8979-993466ed7e04 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:24.994213 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c9afcf72-6f32-43b2-8979-993466ed7e04 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:24.995023 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c9afcf72-6f32-43b2-8979-993466ed7e04 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:24.996324 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c9afcf72-6f32-43b2-8979-993466ed7e04 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:25.017574 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=95,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=2,nova_cell1:RELEASE=1,nova_cell1:INSERT=1 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:35:25.036588 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c9afcf72-6f32-43b2-8979-993466ed7e04 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:25.037528 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c9afcf72-6f32-43b2-8979-993466ed7e04 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:25.040020 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c9afcf72-6f32-43b2-8979-993466ed7e04 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:25.040760 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.objects.instance [None req-c9afcf72-6f32-43b2-8979-993466ed7e04 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Lazy-loading 'fault' on Instance uuid 2457c5d1-8842-4a2d-a5d4-fe97b53b64df {{(pid=128802) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:35:25.208703 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-68fc3e84-6384-4534-b3d3-d6ec8c771753 tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] [instance: 486112b2-497b-4039-ac04-b23cf076d470] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:25.215910 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-68fc3e84-6384-4534-b3d3-d6ec8c771753 tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:25.216388 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-68fc3e84-6384-4534-b3d3-d6ec8c771753 tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:25.217318 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-68fc3e84-6384-4534-b3d3-d6ec8c771753 tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:25.217520 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-68fc3e84-6384-4534-b3d3-d6ec8c771753 tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:25.218887 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-68fc3e84-6384-4534-b3d3-d6ec8c771753 tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:25.219477 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-68fc3e84-6384-4534-b3d3-d6ec8c771753 tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:25.239453 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-c9afcf72-6f32-43b2-8979-993466ed7e04 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cbd31af13444cda97ba5f8c99d19437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a307499cf44d03a1e9bb61f614f099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:25.259603 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-c9afcf72-6f32-43b2-8979-993466ed7e04 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] 10.222.0.33 "GET /compute/v2.1/servers/2457c5d1-8842-4a2d-a5d4-fe97b53b64df" status: 200 len: 1458 microversion: 2.1 time: 0.290660 Oct 04 20:35:25.275774 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 267/558] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:24 2022] GET /compute/v2.1/servers/2457c5d1-8842-4a2d-a5d4-fe97b53b64df => generated 1458 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:25.282265 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-eb795dd3-c1dc-40f8-8cc0-3d458baf07ea tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:25.282910 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-eb795dd3-c1dc-40f8-8cc0-3d458baf07ea tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] [instance: dd727dc7-96ee-4553-84ca-0f9b6ed59781] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:25.290293 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-eb795dd3-c1dc-40f8-8cc0-3d458baf07ea tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:25.291040 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-eb795dd3-c1dc-40f8-8cc0-3d458baf07ea tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:25.291611 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-eb795dd3-c1dc-40f8-8cc0-3d458baf07ea tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:25.292599 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-eb795dd3-c1dc-40f8-8cc0-3d458baf07ea tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:25.293203 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-eb795dd3-c1dc-40f8-8cc0-3d458baf07ea tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:25.293780 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-eb795dd3-c1dc-40f8-8cc0-3d458baf07ea tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:25.682263 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=37 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:35:26.109141 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-eb795dd3-c1dc-40f8-8cc0-3d458baf07ea tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f051a291d59242469f8172a9c474ac89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f0707d756b4ee085a19cccf3ab82c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:26.119294 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-eb795dd3-c1dc-40f8-8cc0-3d458baf07ea tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] 10.222.0.33 "GET /compute/v2.1/servers/dd727dc7-96ee-4553-84ca-0f9b6ed59781" status: 200 len: 1318 microversion: 2.1 time: 0.841857 Oct 04 20:35:26.140491 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 268/559] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:25 2022] GET /compute/v2.1/servers/dd727dc7-96ee-4553-84ca-0f9b6ed59781 => generated 1318 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:26.147962 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-0016eb63-e701-4abb-84ea-e41f04dab273 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:26.151338 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-0016eb63-e701-4abb-84ea-e41f04dab273 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] [instance: 1c6ffc0f-3aaa-41f8-9a9a-0040295fe064] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:26.161278 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0016eb63-e701-4abb-84ea-e41f04dab273 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:26.162143 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0016eb63-e701-4abb-84ea-e41f04dab273 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:26.163651 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0016eb63-e701-4abb-84ea-e41f04dab273 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:26.165344 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0016eb63-e701-4abb-84ea-e41f04dab273 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:26.166312 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0016eb63-e701-4abb-84ea-e41f04dab273 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:26.167139 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0016eb63-e701-4abb-84ea-e41f04dab273 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:26.311184 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell0:SELECT=2 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:35:26.349799 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell0:SELECT=10 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:35:26.617850 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-68fc3e84-6384-4534-b3d3-d6ec8c771753 tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] Acquiring lock "refresh_cache-486112b2-497b-4039-ac04-b23cf076d470" {{(pid=128801) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 04 20:35:26.619489 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-68fc3e84-6384-4534-b3d3-d6ec8c771753 tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] Acquired lock "refresh_cache-486112b2-497b-4039-ac04-b23cf076d470" {{(pid=128801) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 04 20:35:26.862821 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-0016eb63-e701-4abb-84ea-e41f04dab273 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a24944aeb34a5ea228965be9bf4ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c288268acb30475bbc065a8f72cb21d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:26.874560 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-0016eb63-e701-4abb-84ea-e41f04dab273 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] 10.222.0.33 "GET /compute/v2.1/servers/1c6ffc0f-3aaa-41f8-9a9a-0040295fe064" status: 200 len: 1313 microversion: 2.1 time: 0.731680 Oct 04 20:35:26.875845 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 269/560] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:26 2022] GET /compute/v2.1/servers/1c6ffc0f-3aaa-41f8-9a9a-0040295fe064 => generated 1313 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:26.882675 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-d0ec03ce-58d3-46a7-8a61-fd30b3bf7833 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:26.883585 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-d0ec03ce-58d3-46a7-8a61-fd30b3bf7833 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] [instance: c6cdf5bb-821d-4438-9c05-f227c4ebbbcd] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:26.892213 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d0ec03ce-58d3-46a7-8a61-fd30b3bf7833 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:26.893248 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d0ec03ce-58d3-46a7-8a61-fd30b3bf7833 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:26.893902 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d0ec03ce-58d3-46a7-8a61-fd30b3bf7833 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:26.894919 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d0ec03ce-58d3-46a7-8a61-fd30b3bf7833 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:26.895623 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d0ec03ce-58d3-46a7-8a61-fd30b3bf7833 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:26.896254 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d0ec03ce-58d3-46a7-8a61-fd30b3bf7833 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:27.211824 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=9 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:35:27.628984 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-d0ec03ce-58d3-46a7-8a61-fd30b3bf7833 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5eda279f6034608b192839a54dda616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f28e80977de42a892b84295ecf05141', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:27.651801 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-d0ec03ce-58d3-46a7-8a61-fd30b3bf7833 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] 10.222.0.33 "GET /compute/v2.1/servers/c6cdf5bb-821d-4438-9c05-f227c4ebbbcd" status: 200 len: 1586 microversion: 2.1 time: 0.769807 Oct 04 20:35:27.656703 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 270/561] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:26 2022] GET /compute/v2.1/servers/c6cdf5bb-821d-4438-9c05-f227c4ebbbcd => generated 1586 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:27.666395 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-aede7a54-7954-4266-ac89-c6750177d79a tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:27.670783 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-aede7a54-7954-4266-ac89-c6750177d79a tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] [instance: c7f3bb5b-e08b-4a3f-ba4d-40012179412e] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:27.692025 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-aede7a54-7954-4266-ac89-c6750177d79a tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:27.693467 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-aede7a54-7954-4266-ac89-c6750177d79a tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:27.694554 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-aede7a54-7954-4266-ac89-c6750177d79a tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:27.696020 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-aede7a54-7954-4266-ac89-c6750177d79a tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:27.697010 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-aede7a54-7954-4266-ac89-c6750177d79a tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:27.697937 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-aede7a54-7954-4266-ac89-c6750177d79a tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:28.354008 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-aede7a54-7954-4266-ac89-c6750177d79a tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3563efe2b8c94931a2a46c4e14811b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3118a5d96843d3bede1ed94bd9717e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:28.366092 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-aede7a54-7954-4266-ac89-c6750177d79a tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] 10.222.0.33 "GET /compute/v2.1/servers/c7f3bb5b-e08b-4a3f-ba4d-40012179412e" status: 200 len: 1312 microversion: 2.1 time: 0.707220 Oct 04 20:35:28.380869 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 271/562] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:27 2022] GET /compute/v2.1/servers/c7f3bb5b-e08b-4a3f-ba4d-40012179412e => generated 1312 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:28.392223 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-a771eb93-5e41-4366-a6f1-22581deb74e7 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:28.393485 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-a771eb93-5e41-4366-a6f1-22581deb74e7 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] [instance: 2457c5d1-8842-4a2d-a5d4-fe97b53b64df] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:28.404412 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a771eb93-5e41-4366-a6f1-22581deb74e7 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:28.405190 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a771eb93-5e41-4366-a6f1-22581deb74e7 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:28.406560 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a771eb93-5e41-4366-a6f1-22581deb74e7 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:28.407511 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a771eb93-5e41-4366-a6f1-22581deb74e7 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:28.408332 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a771eb93-5e41-4366-a6f1-22581deb74e7 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:28.408917 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a771eb93-5e41-4366-a6f1-22581deb74e7 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:28.463266 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a771eb93-5e41-4366-a6f1-22581deb74e7 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:28.463953 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a771eb93-5e41-4366-a6f1-22581deb74e7 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:28.464594 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a771eb93-5e41-4366-a6f1-22581deb74e7 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:28.465326 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.objects.instance [None req-a771eb93-5e41-4366-a6f1-22581deb74e7 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Lazy-loading 'fault' on Instance uuid 2457c5d1-8842-4a2d-a5d4-fe97b53b64df {{(pid=128802) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:35:29.226605 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-a771eb93-5e41-4366-a6f1-22581deb74e7 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cbd31af13444cda97ba5f8c99d19437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a307499cf44d03a1e9bb61f614f099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:29.240214 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-a771eb93-5e41-4366-a6f1-22581deb74e7 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] 10.222.0.33 "GET /compute/v2.1/servers/2457c5d1-8842-4a2d-a5d4-fe97b53b64df" status: 200 len: 1458 microversion: 2.1 time: 0.857899 Oct 04 20:35:29.241494 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 272/563] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:28 2022] GET /compute/v2.1/servers/2457c5d1-8842-4a2d-a5d4-fe97b53b64df => generated 1458 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:29.248092 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-73e30ae5-6e78-4132-be18-3b4f5e84b5e7 req-4e073678-d774-453b-b3ec-9efb69b4f200 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c6ffc0f-3aaa-41f8-9a9a-0040295fe064", "name": "network-vif-plugged", "status": "completed", "tag": "edb0cd98-3f42-4412-a492-45b170a8ad7b"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:35:29.259428 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-73e30ae5-6e78-4132-be18-3b4f5e84b5e7 req-4e073678-d774-453b-b3ec-9efb69b4f200 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:29.260232 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-73e30ae5-6e78-4132-be18-3b4f5e84b5e7 req-4e073678-d774-453b-b3ec-9efb69b4f200 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:29.260933 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-73e30ae5-6e78-4132-be18-3b4f5e84b5e7 req-4e073678-d774-453b-b3ec-9efb69b4f200 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:29.277740 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-73e30ae5-6e78-4132-be18-3b4f5e84b5e7 req-4e073678-d774-453b-b3ec-9efb69b4f200 service nova] Creating event network-vif-plugged:edb0cd98-3f42-4412-a492-45b170a8ad7b for instance 1c6ffc0f-3aaa-41f8-9a9a-0040295fe064 on n-h2-854823-8 Oct 04 20:35:29.299096 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-73e30ae5-6e78-4132-be18-3b4f5e84b5e7 req-4e073678-d774-453b-b3ec-9efb69b4f200 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055090 Oct 04 20:35:29.304203 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 273/564] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:35:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:35:29.311835 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-79045831-ebee-4f2c-9f55-682ca8618c36 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:29.312904 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-79045831-ebee-4f2c-9f55-682ca8618c36 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] [instance: dd727dc7-96ee-4553-84ca-0f9b6ed59781] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:29.323173 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-79045831-ebee-4f2c-9f55-682ca8618c36 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:29.324035 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-79045831-ebee-4f2c-9f55-682ca8618c36 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:29.324845 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-79045831-ebee-4f2c-9f55-682ca8618c36 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:29.326142 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-79045831-ebee-4f2c-9f55-682ca8618c36 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:29.326857 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-79045831-ebee-4f2c-9f55-682ca8618c36 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:29.327503 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-79045831-ebee-4f2c-9f55-682ca8618c36 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:29.393884 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.network.neutron [None req-68fc3e84-6384-4534-b3d3-d6ec8c771753 tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] [instance: 486112b2-497b-4039-ac04-b23cf076d470] Building network info cache for instance {{(pid=128801) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 04 20:35:30.064439 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-79045831-ebee-4f2c-9f55-682ca8618c36 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f051a291d59242469f8172a9c474ac89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f0707d756b4ee085a19cccf3ab82c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:30.080617 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-79045831-ebee-4f2c-9f55-682ca8618c36 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] 10.222.0.33 "GET /compute/v2.1/servers/dd727dc7-96ee-4553-84ca-0f9b6ed59781" status: 200 len: 1468 microversion: 2.1 time: 0.774061 Oct 04 20:35:30.081427 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 274/565] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:29 2022] GET /compute/v2.1/servers/dd727dc7-96ee-4553-84ca-0f9b6ed59781 => generated 1468 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:30.089720 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-19b2097e-e38d-4a44-ad38-6d37dd270a02 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:30.091112 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-19b2097e-e38d-4a44-ad38-6d37dd270a02 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] [instance: c6cdf5bb-821d-4438-9c05-f227c4ebbbcd] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:30.102468 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-19b2097e-e38d-4a44-ad38-6d37dd270a02 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:30.103313 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-19b2097e-e38d-4a44-ad38-6d37dd270a02 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:30.103974 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-19b2097e-e38d-4a44-ad38-6d37dd270a02 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:30.104899 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-19b2097e-e38d-4a44-ad38-6d37dd270a02 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:30.105652 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-19b2097e-e38d-4a44-ad38-6d37dd270a02 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:30.106295 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-19b2097e-e38d-4a44-ad38-6d37dd270a02 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:30.269854 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-19b2097e-e38d-4a44-ad38-6d37dd270a02 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] 10.222.0.33 "GET /compute/v2.1/servers/c6cdf5bb-821d-4438-9c05-f227c4ebbbcd/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.186938 Oct 04 20:35:30.270462 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 275/566] 10.222.0.33 () {58 vars in 1275 bytes} [Tue Oct 4 20:35:30 2022] GET /compute/v2.1/servers/c6cdf5bb-821d-4438-9c05-f227c4ebbbcd/os-interface => generated 285 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:35:30.283305 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-a4eae894-a70b-4ccb-95ad-b204270bd5da tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:30.284117 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-a4eae894-a70b-4ccb-95ad-b204270bd5da tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] [instance: 1c6ffc0f-3aaa-41f8-9a9a-0040295fe064] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:30.291323 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a4eae894-a70b-4ccb-95ad-b204270bd5da tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:30.292049 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a4eae894-a70b-4ccb-95ad-b204270bd5da tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:30.292853 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a4eae894-a70b-4ccb-95ad-b204270bd5da tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:30.293569 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a4eae894-a70b-4ccb-95ad-b204270bd5da tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:30.294028 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a4eae894-a70b-4ccb-95ad-b204270bd5da tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:30.294483 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a4eae894-a70b-4ccb-95ad-b204270bd5da tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:30.480028 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.network.neutron [None req-68fc3e84-6384-4534-b3d3-d6ec8c771753 tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] [instance: 486112b2-497b-4039-ac04-b23cf076d470] Updating instance_info_cache with network_info: [{"id": "b97b70cc-e857-429e-ad48-a973b62edd3e", "address": "fa:16:3e:78:62:c8", "network": {"id": "c5d8f75c-af9c-48e0-b362-30fb1c3b9cc0", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-1693341596-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "b0ca732ccf4d417ab1f7ba82a9c8c41e", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapb97b70cc-e8", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128801) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 04 20:35:30.507175 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-a4eae894-a70b-4ccb-95ad-b204270bd5da tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a24944aeb34a5ea228965be9bf4ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c288268acb30475bbc065a8f72cb21d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:30.508215 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-68fc3e84-6384-4534-b3d3-d6ec8c771753 tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] Releasing lock "refresh_cache-486112b2-497b-4039-ac04-b23cf076d470" {{(pid=128801) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 04 20:35:30.509565 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-68fc3e84-6384-4534-b3d3-d6ec8c771753 tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] 10.222.0.33 "POST /compute/v2.1/servers/486112b2-497b-4039-ac04-b23cf076d470/action" status: 202 len: 0 microversion: 2.1 time: 5.549006 Oct 04 20:35:30.510402 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 292/567] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 20:35:24 2022] POST /compute/v2.1/servers/486112b2-497b-4039-ac04-b23cf076d470/action => generated 0 bytes in 5550 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 04 20:35:30.516826 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e7764f60-1d6b-4eb7-a803-f141a9cb4301 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:30.517969 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e7764f60-1d6b-4eb7-a803-f141a9cb4301 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] [instance: c7f3bb5b-e08b-4a3f-ba4d-40012179412e] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:30.519257 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-a4eae894-a70b-4ccb-95ad-b204270bd5da tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] 10.222.0.33 "GET /compute/v2.1/servers/1c6ffc0f-3aaa-41f8-9a9a-0040295fe064" status: 200 len: 1313 microversion: 2.1 time: 0.239614 Oct 04 20:35:30.520636 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 276/568] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:30 2022] GET /compute/v2.1/servers/1c6ffc0f-3aaa-41f8-9a9a-0040295fe064 => generated 1313 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:30.526646 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e7764f60-1d6b-4eb7-a803-f141a9cb4301 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:30.527264 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e7764f60-1d6b-4eb7-a803-f141a9cb4301 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:30.527542 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-884f580f-acdd-42f5-ac15-6336eb18a072 req-3e8ae1ce-9641-4f49-9571-5cdd920a7359 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "486112b2-497b-4039-ac04-b23cf076d470", "tag": "b97b70cc-e857-429e-ad48-a973b62edd3e"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:35:30.527900 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e7764f60-1d6b-4eb7-a803-f141a9cb4301 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:30.528700 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e7764f60-1d6b-4eb7-a803-f141a9cb4301 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:30.529280 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e7764f60-1d6b-4eb7-a803-f141a9cb4301 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:30.529852 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e7764f60-1d6b-4eb7-a803-f141a9cb4301 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:30.550774 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-884f580f-acdd-42f5-ac15-6336eb18a072 req-3e8ae1ce-9641-4f49-9571-5cdd920a7359 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:30.552660 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-884f580f-acdd-42f5-ac15-6336eb18a072 req-3e8ae1ce-9641-4f49-9571-5cdd920a7359 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:30.553521 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-884f580f-acdd-42f5-ac15-6336eb18a072 req-3e8ae1ce-9641-4f49-9571-5cdd920a7359 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:30.599590 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-884f580f-acdd-42f5-ac15-6336eb18a072 req-3e8ae1ce-9641-4f49-9571-5cdd920a7359 service nova] Creating event network-changed:b97b70cc-e857-429e-ad48-a973b62edd3e for instance 486112b2-497b-4039-ac04-b23cf076d470 on n-h1-854823-8 Oct 04 20:35:30.621451 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-884f580f-acdd-42f5-ac15-6336eb18a072 req-3e8ae1ce-9641-4f49-9571-5cdd920a7359 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092924 Oct 04 20:35:30.622384 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 277/569] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:35:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:35:30.630833 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-39e5c955-9a1a-4bbc-abd7-f5f6ee057827 tempest-LiveMigrationNegativeTest-850045882 tempest-LiveMigrationNegativeTest-850045882-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:35:30.633643 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-39e5c955-9a1a-4bbc-abd7-f5f6ee057827 tempest-LiveMigrationNegativeTest-850045882 tempest-LiveMigrationNegativeTest-850045882-project-admin] [instance: dd727dc7-96ee-4553-84ca-0f9b6ed59781] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:30.651374 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-39e5c955-9a1a-4bbc-abd7-f5f6ee057827 tempest-LiveMigrationNegativeTest-850045882 tempest-LiveMigrationNegativeTest-850045882-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:30.653296 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-39e5c955-9a1a-4bbc-abd7-f5f6ee057827 tempest-LiveMigrationNegativeTest-850045882 tempest-LiveMigrationNegativeTest-850045882-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:30.654057 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-39e5c955-9a1a-4bbc-abd7-f5f6ee057827 tempest-LiveMigrationNegativeTest-850045882 tempest-LiveMigrationNegativeTest-850045882-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:30.660149 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-39e5c955-9a1a-4bbc-abd7-f5f6ee057827 tempest-LiveMigrationNegativeTest-850045882 tempest-LiveMigrationNegativeTest-850045882-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:30.660644 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-39e5c955-9a1a-4bbc-abd7-f5f6ee057827 tempest-LiveMigrationNegativeTest-850045882 tempest-LiveMigrationNegativeTest-850045882-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:30.661233 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-39e5c955-9a1a-4bbc-abd7-f5f6ee057827 tempest-LiveMigrationNegativeTest-850045882 tempest-LiveMigrationNegativeTest-850045882-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:30.711876 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.objects.instance [None req-39e5c955-9a1a-4bbc-abd7-f5f6ee057827 tempest-LiveMigrationNegativeTest-850045882 tempest-LiveMigrationNegativeTest-850045882-project-admin] Lazy-loading 'flavor' on Instance uuid dd727dc7-96ee-4553-84ca-0f9b6ed59781 {{(pid=128802) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:35:30.880980 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-39e5c955-9a1a-4bbc-abd7-f5f6ee057827 tempest-LiveMigrationNegativeTest-850045882 tempest-LiveMigrationNegativeTest-850045882-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/dd727dc7-96ee-4553-84ca-0f9b6ed59781/action" status: 202 len: 0 microversion: 2.1 time: 0.256356 Oct 04 20:35:30.882090 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 278/570] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 20:35:30 2022] POST /compute/v2.1/servers/dd727dc7-96ee-4553-84ca-0f9b6ed59781/action => generated 0 bytes in 259 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:35:30.894806 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-d37053d3-19d8-4ab4-8225-034a0b1cb1b0 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:30.895518 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-d37053d3-19d8-4ab4-8225-034a0b1cb1b0 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] [instance: 2457c5d1-8842-4a2d-a5d4-fe97b53b64df] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:30.918462 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d37053d3-19d8-4ab4-8225-034a0b1cb1b0 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:30.918960 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d37053d3-19d8-4ab4-8225-034a0b1cb1b0 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:30.919400 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d37053d3-19d8-4ab4-8225-034a0b1cb1b0 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:30.920115 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d37053d3-19d8-4ab4-8225-034a0b1cb1b0 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:30.924710 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d37053d3-19d8-4ab4-8225-034a0b1cb1b0 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:30.927296 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d37053d3-19d8-4ab4-8225-034a0b1cb1b0 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:31.018292 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d37053d3-19d8-4ab4-8225-034a0b1cb1b0 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:31.019183 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d37053d3-19d8-4ab4-8225-034a0b1cb1b0 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:31.020440 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d37053d3-19d8-4ab4-8225-034a0b1cb1b0 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:31.021158 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.objects.instance [None req-d37053d3-19d8-4ab4-8225-034a0b1cb1b0 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Lazy-loading 'fault' on Instance uuid 2457c5d1-8842-4a2d-a5d4-fe97b53b64df {{(pid=128802) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:35:31.124195 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e7764f60-1d6b-4eb7-a803-f141a9cb4301 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3563efe2b8c94931a2a46c4e14811b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3118a5d96843d3bede1ed94bd9717e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:31.133871 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e7764f60-1d6b-4eb7-a803-f141a9cb4301 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] 10.222.0.33 "GET /compute/v2.1/servers/c7f3bb5b-e08b-4a3f-ba4d-40012179412e" status: 200 len: 1312 microversion: 2.1 time: 0.621424 Oct 04 20:35:31.138432 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 293/571] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:30 2022] GET /compute/v2.1/servers/c7f3bb5b-e08b-4a3f-ba4d-40012179412e => generated 1312 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:31.169068 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-bc6becf1-c2f8-43dd-a0d0-5a11b3139607 tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] Calling method '.version_select at 0x7f3c74c5daf0>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:31.513842 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-d37053d3-19d8-4ab4-8225-034a0b1cb1b0 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cbd31af13444cda97ba5f8c99d19437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a307499cf44d03a1e9bb61f614f099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:31.528324 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-d37053d3-19d8-4ab4-8225-034a0b1cb1b0 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] 10.222.0.33 "GET /compute/v2.1/servers/2457c5d1-8842-4a2d-a5d4-fe97b53b64df" status: 200 len: 1310 microversion: 2.1 time: 0.643830 Oct 04 20:35:31.529157 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 279/572] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:30 2022] GET /compute/v2.1/servers/2457c5d1-8842-4a2d-a5d4-fe97b53b64df => generated 1310 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:31.534582 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-cfb3c0b0-1312-4ad0-b7f9-ad63cdce3404 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:31.535279 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-cfb3c0b0-1312-4ad0-b7f9-ad63cdce3404 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] [instance: dd727dc7-96ee-4553-84ca-0f9b6ed59781] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:31.557410 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cfb3c0b0-1312-4ad0-b7f9-ad63cdce3404 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:31.557936 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cfb3c0b0-1312-4ad0-b7f9-ad63cdce3404 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:31.558385 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cfb3c0b0-1312-4ad0-b7f9-ad63cdce3404 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:31.559105 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cfb3c0b0-1312-4ad0-b7f9-ad63cdce3404 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:31.559556 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cfb3c0b0-1312-4ad0-b7f9-ad63cdce3404 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:31.559976 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cfb3c0b0-1312-4ad0-b7f9-ad63cdce3404 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:32.397003 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-cfb3c0b0-1312-4ad0-b7f9-ad63cdce3404 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f051a291d59242469f8172a9c474ac89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f0707d756b4ee085a19cccf3ab82c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:32.435203 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-cfb3c0b0-1312-4ad0-b7f9-ad63cdce3404 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] 10.222.0.33 "GET /compute/v2.1/servers/dd727dc7-96ee-4553-84ca-0f9b6ed59781" status: 200 len: 1476 microversion: 2.1 time: 0.904226 Oct 04 20:35:32.435801 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 280/573] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:31 2022] GET /compute/v2.1/servers/dd727dc7-96ee-4553-84ca-0f9b6ed59781 => generated 1476 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:32.452021 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-bebedd7b-33e9-4aa2-8d68-9b8156b320fe req-c8280782-0244-4bfd-a438-c89d7317c533 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7f3bb5b-e08b-4a3f-ba4d-40012179412e", "name": "network-vif-plugged", "status": "completed", "tag": "89b93aa0-8eeb-48c4-a6d4-93a449c21fea"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:35:32.484914 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-bebedd7b-33e9-4aa2-8d68-9b8156b320fe req-c8280782-0244-4bfd-a438-c89d7317c533 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:32.487004 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-bebedd7b-33e9-4aa2-8d68-9b8156b320fe req-c8280782-0244-4bfd-a438-c89d7317c533 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:32.492631 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-bebedd7b-33e9-4aa2-8d68-9b8156b320fe req-c8280782-0244-4bfd-a438-c89d7317c533 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:32.527986 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-bebedd7b-33e9-4aa2-8d68-9b8156b320fe req-c8280782-0244-4bfd-a438-c89d7317c533 service nova] Creating event network-vif-plugged:89b93aa0-8eeb-48c4-a6d4-93a449c21fea for instance c7f3bb5b-e08b-4a3f-ba4d-40012179412e on n-h1-854823-8 Oct 04 20:35:32.546540 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-bebedd7b-33e9-4aa2-8d68-9b8156b320fe req-c8280782-0244-4bfd-a438-c89d7317c533 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108719 Oct 04 20:35:32.550691 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 281/574] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:35:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:35:32.561421 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-8f489be1-e2dc-403e-b6a8-3abf411460ff tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:32.568855 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-8f489be1-e2dc-403e-b6a8-3abf411460ff tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] [instance: 1c6ffc0f-3aaa-41f8-9a9a-0040295fe064] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:32.588639 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8f489be1-e2dc-403e-b6a8-3abf411460ff tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:32.589416 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8f489be1-e2dc-403e-b6a8-3abf411460ff tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:32.590006 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8f489be1-e2dc-403e-b6a8-3abf411460ff tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:32.590904 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8f489be1-e2dc-403e-b6a8-3abf411460ff tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:32.591507 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8f489be1-e2dc-403e-b6a8-3abf411460ff tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:32.592108 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8f489be1-e2dc-403e-b6a8-3abf411460ff tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:33.671177 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-8f489be1-e2dc-403e-b6a8-3abf411460ff tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a24944aeb34a5ea228965be9bf4ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c288268acb30475bbc065a8f72cb21d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:33.680203 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-8f489be1-e2dc-403e-b6a8-3abf411460ff tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] 10.222.0.33 "GET /compute/v2.1/servers/1c6ffc0f-3aaa-41f8-9a9a-0040295fe064" status: 200 len: 1462 microversion: 2.1 time: 1.127241 Oct 04 20:35:33.690848 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 282/575] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:32 2022] GET /compute/v2.1/servers/1c6ffc0f-3aaa-41f8-9a9a-0040295fe064 => generated 1462 bytes in 1139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:33.704875 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-5c67e1e0-5100-4aaf-8c37-2b866fd9bbc9 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:33.705890 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-5c67e1e0-5100-4aaf-8c37-2b866fd9bbc9 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] [instance: c7f3bb5b-e08b-4a3f-ba4d-40012179412e] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:33.713719 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5c67e1e0-5100-4aaf-8c37-2b866fd9bbc9 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:33.714566 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5c67e1e0-5100-4aaf-8c37-2b866fd9bbc9 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:33.715472 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5c67e1e0-5100-4aaf-8c37-2b866fd9bbc9 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:33.716415 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5c67e1e0-5100-4aaf-8c37-2b866fd9bbc9 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:33.717093 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5c67e1e0-5100-4aaf-8c37-2b866fd9bbc9 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:33.717773 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5c67e1e0-5100-4aaf-8c37-2b866fd9bbc9 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:34.048698 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-5c67e1e0-5100-4aaf-8c37-2b866fd9bbc9 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3563efe2b8c94931a2a46c4e14811b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3118a5d96843d3bede1ed94bd9717e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:34.055230 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:35:34.065226 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-5c67e1e0-5100-4aaf-8c37-2b866fd9bbc9 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] 10.222.0.33 "GET /compute/v2.1/servers/c7f3bb5b-e08b-4a3f-ba4d-40012179412e" status: 200 len: 1312 microversion: 2.1 time: 0.364647 Oct 04 20:35:34.066189 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 283/576] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:33 2022] GET /compute/v2.1/servers/c7f3bb5b-e08b-4a3f-ba4d-40012179412e => generated 1312 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:34.084416 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-39b358f3-517f-4a8b-99a3-01062061f123 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:34.085462 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-39b358f3-517f-4a8b-99a3-01062061f123 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] [instance: 2457c5d1-8842-4a2d-a5d4-fe97b53b64df] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:34.100283 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-39b358f3-517f-4a8b-99a3-01062061f123 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:34.103911 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-39b358f3-517f-4a8b-99a3-01062061f123 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:34.104762 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-39b358f3-517f-4a8b-99a3-01062061f123 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:34.105731 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-39b358f3-517f-4a8b-99a3-01062061f123 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:34.106502 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-39b358f3-517f-4a8b-99a3-01062061f123 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:34.107142 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-39b358f3-517f-4a8b-99a3-01062061f123 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:34.138940 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.wsgi [None req-39b358f3-517f-4a8b-99a3-01062061f123 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] HTTP exception thrown: Instance 2457c5d1-8842-4a2d-a5d4-fe97b53b64df could not be found. Oct 04 20:35:34.140741 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-39b358f3-517f-4a8b-99a3-01062061f123 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Request method failure captured: Oct 04 20:35:34.140741 n-d-854823-8 devstack@n-api.service[128802]: request: GET /compute/v2.1/servers/2457c5d1-8842-4a2d-a5d4-fe97b53b64df HTTP/1.1 Oct 04 20:35:34.140741 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 20:35:34.140741 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 20:35:34.140741 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 20:35:34.140741 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 0 Oct 04 20:35:34.140741 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 20:35:34.140741 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 20:35:34.140741 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 20:35:34.140741 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 20:35:34.140741 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPJjWIa7W9QknWsaey-fCdR6Ih2cpvm1BeCjFGNfwWVocUF4xoE9dgg-X9_kMgOXOC52EiNgJAgUE_Nhfd5pK9mUE_qbSTDl_fqZZyRlt2yi4hkA43q0DeqZFC3W-KtBmUQyQPM4nO2v3hsP0wSLtlD1iifBpZyPjP88JQpmcEakiB0g Oct 04 20:35:34.140741 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 20:35:34.140741 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 20:35:34.140741 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 20:35:34.140741 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 20:35:34.140741 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 20:35:34.140741 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 20:35:34.140741 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: 16a307499cf44d03a1e9bb61f614f099 Oct 04 20:35:34.140741 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-DeleteServersAdminTestJSON-591228109 Oct 04 20:35:34.140741 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 20:35:34.140741 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 20:35:34.142065 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_16a307499cf44d03a1e9bb61f614f099", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/16a307499cf44d03a1e9bb61f614f099"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/16a307499cf44d03a1e9bb61f614f099"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/16a307499cf44d03a1e9bb61f614f099"}]}] Oct 04 20:35:34.142065 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-DeleteServersAdminTestJSON-591228109 Oct 04 20:35:34.142065 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: 16a307499cf44d03a1e9bb61f614f099 Oct 04 20:35:34.142065 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-591228109 Oct 04 20:35:34.142065 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-DeleteServersAdminTestJSON-591228109-project Oct 04 20:35:34.142065 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 20:35:34.142065 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 20:35:34.142065 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: 5cbd31af13444cda97ba5f8c99d19437 Oct 04 20:35:34.142065 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-DeleteServersAdminTestJSON-591228109-project Oct 04 20:35:34.142065 n-d-854823-8 devstack@n-api.service[128802]: method: > Oct 04 20:35:34.142065 n-d-854823-8 devstack@n-api.service[128802]: exception: Instance 2457c5d1-8842-4a2d-a5d4-fe97b53b64df could not be found. Oct 04 20:35:34.142065 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'id': '2457c5d1-8842-4a2d-a5d4-fe97b53b64df'} Oct 04 20:35:34.142845 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:35:34.142845 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:35:34.142845 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:35:34.142845 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:35:34.142845 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:35:34.142845 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:35:34.142845 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:35:34.142845 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:35:34.142845 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:35:34.142845 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:35:34.142845 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2457c5d1-8842-4a2d-a5d4-fe97b53b64df could not be found. Oct 04 20:35:34.142845 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:35:34.142845 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:35:34.142845 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:35:34.142845 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:35:34.142845 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:35:34.142845 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:35:34.142845 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:35:34.142845 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:35:34.142845 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:35:34.144032 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:35:34.144032 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:35:34.144032 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:35:34.144032 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:35:34.144032 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:35:34.144032 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:35:34.144032 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:35:34.144032 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2457c5d1-8842-4a2d-a5d4-fe97b53b64df could not be found. Oct 04 20:35:34.144032 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:35:34.144032 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:35:34.144032 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:35:34.144032 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:35:34.144032 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:35:34.144032 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:35:34.144032 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:35:34.144032 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:35:34.144032 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2457c5d1-8842-4a2d-a5d4-fe97b53b64df could not be found. Oct 04 20:35:34.144032 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:35:34.146204 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-39b358f3-517f-4a8b-99a3-01062061f123 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Returning 404 to user: Instance 2457c5d1-8842-4a2d-a5d4-fe97b53b64df could not be found. {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:35:34.146204 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-39b358f3-517f-4a8b-99a3-01062061f123 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] 10.222.0.33 "GET /compute/v2.1/servers/2457c5d1-8842-4a2d-a5d4-fe97b53b64df" status: 404 len: 111 microversion: 2.1 time: 0.078552 Oct 04 20:35:34.152238 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 284/577] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:34 2022] GET /compute/v2.1/servers/2457c5d1-8842-4a2d-a5d4-fe97b53b64df => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:35:34.153644 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-590181a9-14f7-408b-9c75-60aaaa2caa26 req-03f18e0d-2f85-4d56-9cf5-dea86b95d3bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2457c5d1-8842-4a2d-a5d4-fe97b53b64df", "name": "network-vif-deleted", "tag": "b4fd2bf2-a03d-49a9-8fe6-db90f57c359d"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:35:34.174571 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-590181a9-14f7-408b-9c75-60aaaa2caa26 req-03f18e0d-2f85-4d56-9cf5-dea86b95d3bf service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:34.175059 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-590181a9-14f7-408b-9c75-60aaaa2caa26 req-03f18e0d-2f85-4d56-9cf5-dea86b95d3bf service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:34.175492 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-590181a9-14f7-408b-9c75-60aaaa2caa26 req-03f18e0d-2f85-4d56-9cf5-dea86b95d3bf service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:34.206608 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-590181a9-14f7-408b-9c75-60aaaa2caa26 req-03f18e0d-2f85-4d56-9cf5-dea86b95d3bf service nova] Creating event network-vif-deleted:b4fd2bf2-a03d-49a9-8fe6-db90f57c359d for instance 2457c5d1-8842-4a2d-a5d4-fe97b53b64df on n-h2-854823-8 Oct 04 20:35:34.220203 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-590181a9-14f7-408b-9c75-60aaaa2caa26 req-03f18e0d-2f85-4d56-9cf5-dea86b95d3bf service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071261 Oct 04 20:35:34.220865 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 285/578] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:35:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:35:34.226557 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-16a3122a-cf4b-47d2-9299-fe0f56720d61 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:34.227269 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-16a3122a-cf4b-47d2-9299-fe0f56720d61 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] [instance: c6cdf5bb-821d-4438-9c05-f227c4ebbbcd] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:34.244206 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-16a3122a-cf4b-47d2-9299-fe0f56720d61 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:34.244710 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-16a3122a-cf4b-47d2-9299-fe0f56720d61 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:34.253343 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-16a3122a-cf4b-47d2-9299-fe0f56720d61 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:34.254381 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-16a3122a-cf4b-47d2-9299-fe0f56720d61 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:34.255012 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-16a3122a-cf4b-47d2-9299-fe0f56720d61 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:34.255596 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-16a3122a-cf4b-47d2-9299-fe0f56720d61 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:34.317798 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-bc6becf1-c2f8-43dd-a0d0-5a11b3139607 tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] 10.222.0.33 "DELETE /compute/v2.1/os-floating-ips/3f56442e-9cba-434c-b404-a2e1fcf4a9cf" status: 202 len: 0 microversion: 2.1 time: 3.165598 Oct 04 20:35:34.318795 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 294/579] 10.222.0.33 () {58 vars in 1263 bytes} [Tue Oct 4 20:35:31 2022] DELETE /compute/v2.1/os-floating-ips/3f56442e-9cba-434c-b404-a2e1fcf4a9cf => generated 0 bytes in 3180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:35:34.337624 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-ce8d8307-8112-4174-9921-b2cf3e64bfa1 req-f05cd9f6-1d0c-4251-babf-bf1f9ccdf143 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c6cdf5bb-821d-4438-9c05-f227c4ebbbcd", "tag": "ad1d4490-762d-4d97-941f-671901ca0477"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:35:34.373065 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-ce8d8307-8112-4174-9921-b2cf3e64bfa1 req-f05cd9f6-1d0c-4251-babf-bf1f9ccdf143 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:34.377442 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-ce8d8307-8112-4174-9921-b2cf3e64bfa1 req-f05cd9f6-1d0c-4251-babf-bf1f9ccdf143 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:34.378835 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-ce8d8307-8112-4174-9921-b2cf3e64bfa1 req-f05cd9f6-1d0c-4251-babf-bf1f9ccdf143 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:34.405894 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-ce8d8307-8112-4174-9921-b2cf3e64bfa1 req-f05cd9f6-1d0c-4251-babf-bf1f9ccdf143 service nova] Creating event network-changed:ad1d4490-762d-4d97-941f-671901ca0477 for instance c6cdf5bb-821d-4438-9c05-f227c4ebbbcd on n-h2-854823-8 Oct 04 20:35:34.423971 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-ce8d8307-8112-4174-9921-b2cf3e64bfa1 req-f05cd9f6-1d0c-4251-babf-bf1f9ccdf143 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094714 Oct 04 20:35:34.434779 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 295/580] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:35:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:35:34.440617 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0aafd0cb-9385-4c04-9292-90b9652237f5 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:34.454229 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-0aafd0cb-9385-4c04-9292-90b9652237f5 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] [instance: dd727dc7-96ee-4553-84ca-0f9b6ed59781] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:34.472964 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0aafd0cb-9385-4c04-9292-90b9652237f5 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:34.473891 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0aafd0cb-9385-4c04-9292-90b9652237f5 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:34.474746 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0aafd0cb-9385-4c04-9292-90b9652237f5 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:34.475870 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0aafd0cb-9385-4c04-9292-90b9652237f5 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:34.476589 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0aafd0cb-9385-4c04-9292-90b9652237f5 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:34.477236 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0aafd0cb-9385-4c04-9292-90b9652237f5 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:34.593438 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-16a3122a-cf4b-47d2-9299-fe0f56720d61 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5eda279f6034608b192839a54dda616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f28e80977de42a892b84295ecf05141', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:34.603714 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-16a3122a-cf4b-47d2-9299-fe0f56720d61 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] 10.222.0.33 "GET /compute/v2.1/servers/c6cdf5bb-821d-4438-9c05-f227c4ebbbcd" status: 200 len: 1586 microversion: 2.1 time: 0.381652 Oct 04 20:35:34.604989 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 286/581] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:34 2022] GET /compute/v2.1/servers/c6cdf5bb-821d-4438-9c05-f227c4ebbbcd => generated 1586 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:34.610381 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-26c59725-bf32-4d3a-b76f-e9677b6dbfa9 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:34.611251 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-26c59725-bf32-4d3a-b76f-e9677b6dbfa9 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] [instance: 9f8cc082-0a37-4123-a680-1210a90b3ca9] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:34.619213 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-26c59725-bf32-4d3a-b76f-e9677b6dbfa9 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:34.621255 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-26c59725-bf32-4d3a-b76f-e9677b6dbfa9 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:34.621947 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-26c59725-bf32-4d3a-b76f-e9677b6dbfa9 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:34.623164 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-26c59725-bf32-4d3a-b76f-e9677b6dbfa9 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:34.623845 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-26c59725-bf32-4d3a-b76f-e9677b6dbfa9 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:34.624484 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-26c59725-bf32-4d3a-b76f-e9677b6dbfa9 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:34.914438 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-0aafd0cb-9385-4c04-9292-90b9652237f5 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f051a291d59242469f8172a9c474ac89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f0707d756b4ee085a19cccf3ab82c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:34.939339 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-0aafd0cb-9385-4c04-9292-90b9652237f5 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] 10.222.0.33 "GET /compute/v2.1/servers/dd727dc7-96ee-4553-84ca-0f9b6ed59781" status: 200 len: 1459 microversion: 2.1 time: 0.500615 Oct 04 20:35:34.941056 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 296/582] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:34 2022] GET /compute/v2.1/servers/dd727dc7-96ee-4553-84ca-0f9b6ed59781 => generated 1459 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:34.958908 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2890ead2-b12e-4feb-98e6-89f0848647a6 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:34.961066 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-2890ead2-b12e-4feb-98e6-89f0848647a6 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] [instance: 2457c5d1-8842-4a2d-a5d4-fe97b53b64df] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:34.982892 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2890ead2-b12e-4feb-98e6-89f0848647a6 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:34.984079 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2890ead2-b12e-4feb-98e6-89f0848647a6 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:34.985053 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2890ead2-b12e-4feb-98e6-89f0848647a6 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:34.986754 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2890ead2-b12e-4feb-98e6-89f0848647a6 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:34.991364 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2890ead2-b12e-4feb-98e6-89f0848647a6 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:34.993880 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2890ead2-b12e-4feb-98e6-89f0848647a6 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:35.028189 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-2890ead2-b12e-4feb-98e6-89f0848647a6 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] HTTP exception thrown: Instance 2457c5d1-8842-4a2d-a5d4-fe97b53b64df could not be found. Oct 04 20:35:35.031863 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2890ead2-b12e-4feb-98e6-89f0848647a6 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Request method failure captured: Oct 04 20:35:35.031863 n-d-854823-8 devstack@n-api.service[128801]: request: DELETE /compute/v2.1/servers/2457c5d1-8842-4a2d-a5d4-fe97b53b64df HTTP/1.1 Oct 04 20:35:35.031863 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:35:35.031863 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:35:35.031863 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:35:35.031863 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 0 Oct 04 20:35:35.031863 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:35:35.031863 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:35:35.031863 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:35:35.031863 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:35:35.031863 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJjWIa7W9QknWsaey-fCdR6Ih2cpvm1BeCjFGNfwWVocUF4xoE9dgg-X9_kMgOXOC52EiNgJAgUE_Nhfd5pK9mUE_qbSTDl_fqZZyRlt2yi4hkA43q0DeqZFC3W-KtBmUQyQPM4nO2v3hsP0wSLtlD1iifBpZyPjP88JQpmcEakiB0g Oct 04 20:35:35.031863 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:35:35.031863 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:35:35.031863 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:35:35.031863 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:35:35.031863 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:35:35.031863 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:35:35.031863 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: 16a307499cf44d03a1e9bb61f614f099 Oct 04 20:35:35.031863 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-DeleteServersAdminTestJSON-591228109 Oct 04 20:35:35.031863 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 20:35:35.031863 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 20:35:35.033437 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_16a307499cf44d03a1e9bb61f614f099", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/16a307499cf44d03a1e9bb61f614f099"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/16a307499cf44d03a1e9bb61f614f099"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/16a307499cf44d03a1e9bb61f614f099"}]}] Oct 04 20:35:35.033437 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-DeleteServersAdminTestJSON-591228109 Oct 04 20:35:35.033437 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: 16a307499cf44d03a1e9bb61f614f099 Oct 04 20:35:35.033437 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-591228109 Oct 04 20:35:35.033437 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-DeleteServersAdminTestJSON-591228109-project Oct 04 20:35:35.033437 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:35:35.033437 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:35:35.033437 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: 5cbd31af13444cda97ba5f8c99d19437 Oct 04 20:35:35.033437 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-DeleteServersAdminTestJSON-591228109-project Oct 04 20:35:35.033437 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 20:35:35.033437 n-d-854823-8 devstack@n-api.service[128801]: exception: Instance 2457c5d1-8842-4a2d-a5d4-fe97b53b64df could not be found. Oct 04 20:35:35.033437 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': '2457c5d1-8842-4a2d-a5d4-fe97b53b64df'} Oct 04 20:35:35.034377 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:35:35.034377 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:35:35.034377 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:35:35.034377 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:35:35.034377 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:35:35.034377 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:35:35.034377 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:35:35.034377 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:35:35.034377 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:35:35.034377 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:35:35.034377 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2457c5d1-8842-4a2d-a5d4-fe97b53b64df could not be found. Oct 04 20:35:35.034377 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:35:35.034377 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:35:35.034377 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:35:35.034377 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:35:35.034377 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:35:35.034377 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:35:35.034377 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:35:35.034377 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:35:35.034377 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:35:35.036859 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:35:35.036859 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 20:35:35.036859 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 20:35:35.036859 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 20:35:35.036859 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 20:35:35.036859 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:35:35.036859 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:35:35.036859 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:35:35.036859 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:35:35.036859 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2457c5d1-8842-4a2d-a5d4-fe97b53b64df could not be found. Oct 04 20:35:35.036859 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:35:35.036859 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:35:35.036859 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:35:35.036859 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:35:35.036859 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:35:35.036859 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:35:35.036859 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:35:35.036859 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:35:35.036859 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2457c5d1-8842-4a2d-a5d4-fe97b53b64df could not be found. Oct 04 20:35:35.036859 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:35:35.045539 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2890ead2-b12e-4feb-98e6-89f0848647a6 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Returning 404 to user: Instance 2457c5d1-8842-4a2d-a5d4-fe97b53b64df could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:35:35.047679 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-2890ead2-b12e-4feb-98e6-89f0848647a6 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] 10.222.0.33 "DELETE /compute/v2.1/servers/2457c5d1-8842-4a2d-a5d4-fe97b53b64df" status: 404 len: 111 microversion: 2.1 time: 0.104449 Oct 04 20:35:35.052995 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 297/583] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 20:35:34 2022] DELETE /compute/v2.1/servers/2457c5d1-8842-4a2d-a5d4-fe97b53b64df => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:35:35.068623 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-83a19a0b-a958-414e-9a64-fe5d771e9c55 tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] Action: 'action', calling method: .version_select at 0x7f3c76319d30>, body: {"addFloatingIp": {"address": ""}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:35:35.080335 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-83a19a0b-a958-414e-9a64-fe5d771e9c55 tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] Request method failure captured: Oct 04 20:35:35.080335 n-d-854823-8 devstack@n-api.service[128801]: request: POST /compute/v2.1/servers/486112b2-497b-4039-ac04-b23cf076d470/action HTTP/1.1 Oct 04 20:35:35.080335 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:35:35.080335 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:35:35.080335 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:35:35.080335 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 34 Oct 04 20:35:35.080335 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:35:35.080335 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:35:35.080335 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:35:35.080335 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:35:35.080335 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJjo0ehgCcVLX9m4cw1-oibWoGlG_FZ6zY8pWR3yQddTBQSrtiDqa5aRmsThNvdRC_qNLxv5I7_CVnrkgu0ATHySIX6WJSOdYfvAiWZlOJBL-opPPgsRFwBwXiO-zU137gpGStP7Xj8gt9FNnb87K-zqXIQOjv7J6zBZeUoZGEuXPbs Oct 04 20:35:35.080335 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:35:35.080335 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:35:35.080335 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:35:35.080335 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:35:35.080335 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:35:35.080335 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:35:35.080335 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: b0ca732ccf4d417ab1f7ba82a9c8c41e Oct 04 20:35:35.080335 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-781358035 Oct 04 20:35:35.080335 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 20:35:35.080335 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 20:35:35.081781 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b0ca732ccf4d417ab1f7ba82a9c8c41e", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b0ca732ccf4d417ab1f7ba82a9c8c41e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b0ca732ccf4d417ab1f7ba82a9c8c41e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b0ca732ccf4d417ab1f7ba82a9c8c41e"}]}] Oct 04 20:35:35.081781 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-781358035 Oct 04 20:35:35.081781 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: b0ca732ccf4d417ab1f7ba82a9c8c41e Oct 04 20:35:35.081781 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-781358035 Oct 04 20:35:35.081781 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project Oct 04 20:35:35.081781 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:35:35.081781 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:35:35.081781 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: f8f72b5b32ab457aaaa1c1ff7efdce5c Oct 04 20:35:35.081781 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project Oct 04 20:35:35.081781 n-d-854823-8 devstack@n-api.service[128801]: Oct 04 20:35:35.081781 n-d-854823-8 devstack@n-api.service[128801]: {"addFloatingIp": {"address": ""}} Oct 04 20:35:35.081781 n-d-854823-8 devstack@n-api.service[128801]: method: Oct 04 20:35:35.081781 n-d-854823-8 devstack@n-api.service[128801]: exception: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Oct 04 20:35:35.082658 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': '486112b2-497b-4039-ac04-b23cf076d470', 'body': {'addFloatingIp': {'address': ''}}} Oct 04 20:35:35.082658 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:35:35.082658 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:35:35.082658 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 20:35:35.082658 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 20:35:35.082658 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 20:35:35.082658 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise error Oct 04 20:35:35.082658 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is not valid under any of the given schemas Oct 04 20:35:35.082658 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:35:35.082658 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['addFloatingIp']['properties']['address']: Oct 04 20:35:35.082658 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'ipv4'}, {'format': 'ipv6'}], 'type': 'string'} Oct 04 20:35:35.082658 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:35:35.082658 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi On instance['addFloatingIp']: Oct 04 20:35:35.082658 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi '' Oct 04 20:35:35.082658 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:35:35.082658 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:35:35.082658 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:35:35.082658 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:35:35.082658 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:35:35.082658 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:35:35.082658 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:35:35.082658 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:35:35.084054 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:35:35.084054 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:35:35.084054 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:35:35.084054 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:35:35.084054 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 20:35:35.084054 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 20:35:35.084054 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 20:35:35.084054 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 20:35:35.084054 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 20:35:35.084054 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 20:35:35.084054 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Oct 04 20:35:35.084054 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:35:35.084054 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:35:35.084054 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:35:35.084054 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:35:35.084054 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:35:35.084054 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:35:35.084054 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 20:35:35.084054 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 20:35:35.085453 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Oct 04 20:35:35.085453 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:35:35.090927 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-83a19a0b-a958-414e-9a64-fe5d771e9c55 tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] Returning 400 to user: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:35:35.092520 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-83a19a0b-a958-414e-9a64-fe5d771e9c55 tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] 10.222.0.33 "POST /compute/v2.1/servers/486112b2-497b-4039-ac04-b23cf076d470/action" status: 400 len: 142 microversion: 2.1 time: 0.036544 Oct 04 20:35:35.093606 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 298/584] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 20:35:35 2022] POST /compute/v2.1/servers/486112b2-497b-4039-ac04-b23cf076d470/action => generated 142 bytes in 40 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 20:35:35.123794 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-26c59725-bf32-4d3a-b76f-e9677b6dbfa9 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a24944aeb34a5ea228965be9bf4ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c288268acb30475bbc065a8f72cb21d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:35.139273 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-645cca16-5bcc-4785-9386-5616d580bc22 tempest-LiveMigrationNegativeTest-850045882 tempest-LiveMigrationNegativeTest-850045882-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:35.141217 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-26c59725-bf32-4d3a-b76f-e9677b6dbfa9 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] 10.222.0.33 "GET /compute/v2.1/servers/9f8cc082-0a37-4123-a680-1210a90b3ca9" status: 200 len: 1463 microversion: 2.1 time: 0.534956 Oct 04 20:35:35.143182 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-645cca16-5bcc-4785-9386-5616d580bc22 tempest-LiveMigrationNegativeTest-850045882 tempest-LiveMigrationNegativeTest-850045882-project-admin] [instance: dd727dc7-96ee-4553-84ca-0f9b6ed59781] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:35.162639 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 287/585] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:34 2022] GET /compute/v2.1/servers/9f8cc082-0a37-4123-a680-1210a90b3ca9 => generated 1463 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:35.184221 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-776eb540-b8e5-4a30-9db5-d281c939f034 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:35.184864 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-776eb540-b8e5-4a30-9db5-d281c939f034 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] [instance: 2457c5d1-8842-4a2d-a5d4-fe97b53b64df] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:35.190644 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-645cca16-5bcc-4785-9386-5616d580bc22 tempest-LiveMigrationNegativeTest-850045882 tempest-LiveMigrationNegativeTest-850045882-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:35.191163 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-645cca16-5bcc-4785-9386-5616d580bc22 tempest-LiveMigrationNegativeTest-850045882 tempest-LiveMigrationNegativeTest-850045882-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:35.191752 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-645cca16-5bcc-4785-9386-5616d580bc22 tempest-LiveMigrationNegativeTest-850045882 tempest-LiveMigrationNegativeTest-850045882-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:35.192689 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-645cca16-5bcc-4785-9386-5616d580bc22 tempest-LiveMigrationNegativeTest-850045882 tempest-LiveMigrationNegativeTest-850045882-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:35.193303 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-645cca16-5bcc-4785-9386-5616d580bc22 tempest-LiveMigrationNegativeTest-850045882 tempest-LiveMigrationNegativeTest-850045882-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:35.193888 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-645cca16-5bcc-4785-9386-5616d580bc22 tempest-LiveMigrationNegativeTest-850045882 tempest-LiveMigrationNegativeTest-850045882-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:35.203865 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-776eb540-b8e5-4a30-9db5-d281c939f034 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:35.204557 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-776eb540-b8e5-4a30-9db5-d281c939f034 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:35.205620 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-776eb540-b8e5-4a30-9db5-d281c939f034 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:35.206545 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-776eb540-b8e5-4a30-9db5-d281c939f034 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:35.212749 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-776eb540-b8e5-4a30-9db5-d281c939f034 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:35.213674 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-776eb540-b8e5-4a30-9db5-d281c939f034 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:35.253743 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.wsgi [None req-776eb540-b8e5-4a30-9db5-d281c939f034 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] HTTP exception thrown: Instance 2457c5d1-8842-4a2d-a5d4-fe97b53b64df could not be found. Oct 04 20:35:35.265056 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-776eb540-b8e5-4a30-9db5-d281c939f034 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Request method failure captured: Oct 04 20:35:35.265056 n-d-854823-8 devstack@n-api.service[128802]: request: GET /compute/v2.1/servers/2457c5d1-8842-4a2d-a5d4-fe97b53b64df HTTP/1.1 Oct 04 20:35:35.265056 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 20:35:35.265056 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 20:35:35.265056 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 20:35:35.265056 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 0 Oct 04 20:35:35.265056 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 20:35:35.265056 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 20:35:35.265056 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 20:35:35.265056 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 20:35:35.265056 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPJjWIa7W9QknWsaey-fCdR6Ih2cpvm1BeCjFGNfwWVocUF4xoE9dgg-X9_kMgOXOC52EiNgJAgUE_Nhfd5pK9mUE_qbSTDl_fqZZyRlt2yi4hkA43q0DeqZFC3W-KtBmUQyQPM4nO2v3hsP0wSLtlD1iifBpZyPjP88JQpmcEakiB0g Oct 04 20:35:35.265056 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 20:35:35.265056 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 20:35:35.265056 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 20:35:35.265056 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 20:35:35.265056 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 20:35:35.265056 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 20:35:35.265056 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: 16a307499cf44d03a1e9bb61f614f099 Oct 04 20:35:35.265056 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-DeleteServersAdminTestJSON-591228109 Oct 04 20:35:35.265056 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 20:35:35.265056 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 20:35:35.266767 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_16a307499cf44d03a1e9bb61f614f099", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/16a307499cf44d03a1e9bb61f614f099"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/16a307499cf44d03a1e9bb61f614f099"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/16a307499cf44d03a1e9bb61f614f099"}]}] Oct 04 20:35:35.266767 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-DeleteServersAdminTestJSON-591228109 Oct 04 20:35:35.266767 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: 16a307499cf44d03a1e9bb61f614f099 Oct 04 20:35:35.266767 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-591228109 Oct 04 20:35:35.266767 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-DeleteServersAdminTestJSON-591228109-project Oct 04 20:35:35.266767 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 20:35:35.266767 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 20:35:35.266767 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: 5cbd31af13444cda97ba5f8c99d19437 Oct 04 20:35:35.266767 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-DeleteServersAdminTestJSON-591228109-project Oct 04 20:35:35.266767 n-d-854823-8 devstack@n-api.service[128802]: method: > Oct 04 20:35:35.266767 n-d-854823-8 devstack@n-api.service[128802]: exception: Instance 2457c5d1-8842-4a2d-a5d4-fe97b53b64df could not be found. Oct 04 20:35:35.266767 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'id': '2457c5d1-8842-4a2d-a5d4-fe97b53b64df'} Oct 04 20:35:35.267570 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:35:35.267570 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:35:35.267570 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:35:35.267570 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:35:35.267570 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:35:35.267570 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:35:35.267570 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:35:35.267570 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:35:35.267570 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:35:35.267570 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:35:35.267570 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2457c5d1-8842-4a2d-a5d4-fe97b53b64df could not be found. Oct 04 20:35:35.267570 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:35:35.267570 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:35:35.267570 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:35:35.267570 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:35:35.267570 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:35:35.267570 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:35:35.267570 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:35:35.267570 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:35:35.267570 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:35:35.268895 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:35:35.268895 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:35:35.268895 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:35:35.268895 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:35:35.268895 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:35:35.268895 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:35:35.268895 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:35:35.268895 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2457c5d1-8842-4a2d-a5d4-fe97b53b64df could not be found. Oct 04 20:35:35.268895 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:35:35.268895 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:35:35.268895 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:35:35.268895 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:35:35.268895 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:35:35.268895 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:35:35.268895 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:35:35.268895 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:35:35.268895 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2457c5d1-8842-4a2d-a5d4-fe97b53b64df could not be found. Oct 04 20:35:35.268895 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:35:35.271133 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-776eb540-b8e5-4a30-9db5-d281c939f034 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Returning 404 to user: Instance 2457c5d1-8842-4a2d-a5d4-fe97b53b64df could not be found. {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:35:35.276032 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-776eb540-b8e5-4a30-9db5-d281c939f034 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] 10.222.0.33 "GET /compute/v2.1/servers/2457c5d1-8842-4a2d-a5d4-fe97b53b64df" status: 404 len: 111 microversion: 2.1 time: 0.110059 Oct 04 20:35:35.279038 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 288/586] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:35 2022] GET /compute/v2.1/servers/2457c5d1-8842-4a2d-a5d4-fe97b53b64df => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:35:35.298270 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-47e1745d-6741-4f5f-8d8d-5d99f440f7fd tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:35.302780 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-47e1745d-6741-4f5f-8d8d-5d99f440f7fd tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] [instance: c7f3bb5b-e08b-4a3f-ba4d-40012179412e] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:35.317965 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-47e1745d-6741-4f5f-8d8d-5d99f440f7fd tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:35.321014 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-47e1745d-6741-4f5f-8d8d-5d99f440f7fd tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:35.322661 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-47e1745d-6741-4f5f-8d8d-5d99f440f7fd tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:35.323570 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-47e1745d-6741-4f5f-8d8d-5d99f440f7fd tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:35.324944 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-47e1745d-6741-4f5f-8d8d-5d99f440f7fd tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:35.326882 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-47e1745d-6741-4f5f-8d8d-5d99f440f7fd tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:35.829138 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-47e1745d-6741-4f5f-8d8d-5d99f440f7fd tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3563efe2b8c94931a2a46c4e14811b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3118a5d96843d3bede1ed94bd9717e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:35.838729 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-47e1745d-6741-4f5f-8d8d-5d99f440f7fd tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] 10.222.0.33 "GET /compute/v2.1/servers/c7f3bb5b-e08b-4a3f-ba4d-40012179412e" status: 200 len: 1462 microversion: 2.1 time: 0.554515 Oct 04 20:35:35.857906 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 289/587] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:35 2022] GET /compute/v2.1/servers/c7f3bb5b-e08b-4a3f-ba4d-40012179412e => generated 1462 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:35.867161 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-1eeabd8f-df5b-4963-b448-6912ed289730 tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "0.0.0.0"}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:35:35.870208 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-1eeabd8f-df5b-4963-b448-6912ed289730 tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] [instance: 486112b2-497b-4039-ac04-b23cf076d470] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:35.876962 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1eeabd8f-df5b-4963-b448-6912ed289730 tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:35.877869 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1eeabd8f-df5b-4963-b448-6912ed289730 tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:35.878656 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1eeabd8f-df5b-4963-b448-6912ed289730 tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:35.879570 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1eeabd8f-df5b-4963-b448-6912ed289730 tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:35.880193 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1eeabd8f-df5b-4963-b448-6912ed289730 tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:35.880919 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1eeabd8f-df5b-4963-b448-6912ed289730 tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:35.921167 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1eeabd8f-df5b-4963-b448-6912ed289730 tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] Acquiring lock "refresh_cache-486112b2-497b-4039-ac04-b23cf076d470" {{(pid=128802) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 04 20:35:35.923023 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1eeabd8f-df5b-4963-b448-6912ed289730 tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] Acquired lock "refresh_cache-486112b2-497b-4039-ac04-b23cf076d470" {{(pid=128802) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 04 20:35:36.131230 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-645cca16-5bcc-4785-9386-5616d580bc22 tempest-LiveMigrationNegativeTest-850045882 tempest-LiveMigrationNegativeTest-850045882-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/dd727dc7-96ee-4553-84ca-0f9b6ed59781" status: 200 len: 1610 microversion: 2.1 time: 1.034175 Oct 04 20:35:36.133405 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 299/588] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:35 2022] GET /compute/v2.1/servers/dd727dc7-96ee-4553-84ca-0f9b6ed59781 => generated 1610 bytes in 1039 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:36.146391 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-76cb16f1-f356-4cc0-824c-7987649c2dd7 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:36.149160 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-76cb16f1-f356-4cc0-824c-7987649c2dd7 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] [instance: b8cf32e5-d9cc-4e92-bd81-2c3449406c95] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:36.172790 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-76cb16f1-f356-4cc0-824c-7987649c2dd7 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:36.173351 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-76cb16f1-f356-4cc0-824c-7987649c2dd7 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:36.176579 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-76cb16f1-f356-4cc0-824c-7987649c2dd7 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:36.182576 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-76cb16f1-f356-4cc0-824c-7987649c2dd7 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:36.183446 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1eeabd8f-df5b-4963-b448-6912ed289730 tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] Releasing lock "refresh_cache-486112b2-497b-4039-ac04-b23cf076d470" {{(pid=128802) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 04 20:35:36.183935 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-76cb16f1-f356-4cc0-824c-7987649c2dd7 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:36.184023 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.wsgi [None req-1eeabd8f-df5b-4963-b448-6912ed289730 tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] HTTP exception thrown: floating IP not found Oct 04 20:35:36.185124 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-76cb16f1-f356-4cc0-824c-7987649c2dd7 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:36.185569 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-1eeabd8f-df5b-4963-b448-6912ed289730 tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] Request method failure captured: Oct 04 20:35:36.185569 n-d-854823-8 devstack@n-api.service[128802]: request: POST /compute/v2.1/servers/486112b2-497b-4039-ac04-b23cf076d470/action HTTP/1.1 Oct 04 20:35:36.185569 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 20:35:36.185569 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 20:35:36.185569 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 20:35:36.185569 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 41 Oct 04 20:35:36.185569 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 20:35:36.185569 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 20:35:36.185569 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 20:35:36.185569 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 20:35:36.185569 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPJjo0ehgCcVLX9m4cw1-oibWoGlG_FZ6zY8pWR3yQddTBQSrtiDqa5aRmsThNvdRC_qNLxv5I7_CVnrkgu0ATHySIX6WJSOdYfvAiWZlOJBL-opPPgsRFwBwXiO-zU137gpGStP7Xj8gt9FNnb87K-zqXIQOjv7J6zBZeUoZGEuXPbs Oct 04 20:35:36.185569 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 20:35:36.185569 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 20:35:36.185569 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 20:35:36.185569 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 20:35:36.185569 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 20:35:36.185569 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 20:35:36.185569 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: b0ca732ccf4d417ab1f7ba82a9c8c41e Oct 04 20:35:36.185569 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-781358035 Oct 04 20:35:36.185569 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 20:35:36.185569 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 20:35:36.187141 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b0ca732ccf4d417ab1f7ba82a9c8c41e", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b0ca732ccf4d417ab1f7ba82a9c8c41e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b0ca732ccf4d417ab1f7ba82a9c8c41e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b0ca732ccf4d417ab1f7ba82a9c8c41e"}]}] Oct 04 20:35:36.187141 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-781358035 Oct 04 20:35:36.187141 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: b0ca732ccf4d417ab1f7ba82a9c8c41e Oct 04 20:35:36.187141 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-781358035 Oct 04 20:35:36.187141 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project Oct 04 20:35:36.187141 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 20:35:36.187141 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 20:35:36.187141 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: f8f72b5b32ab457aaaa1c1ff7efdce5c Oct 04 20:35:36.187141 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project Oct 04 20:35:36.187141 n-d-854823-8 devstack@n-api.service[128802]: Oct 04 20:35:36.187141 n-d-854823-8 devstack@n-api.service[128802]: {"addFloatingIp": {"address": "0.0.0.0"}} Oct 04 20:35:36.187141 n-d-854823-8 devstack@n-api.service[128802]: method: Oct 04 20:35:36.187141 n-d-854823-8 devstack@n-api.service[128802]: exception: floating IP not found Oct 04 20:35:36.187896 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'id': '486112b2-497b-4039-ac04-b23cf076d470', 'body': {'addFloatingIp': {'address': '0.0.0.0'}}} Oct 04 20:35:36.187896 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:35:36.187896 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:35:36.187896 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Oct 04 20:35:36.187896 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Oct 04 20:35:36.187896 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 165, in wrapper Oct 04 20:35:36.187896 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Oct 04 20:35:36.187896 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2699, in associate_floating_ip Oct 04 20:35:36.187896 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, floating_address) Oct 04 20:35:36.187896 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3011, in _get_floating_ip_by_address Oct 04 20:35:36.187896 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Oct 04 20:35:36.187896 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Oct 04 20:35:36.187896 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:35:36.187896 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:35:36.187896 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:35:36.187896 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:35:36.187896 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:35:36.187896 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:35:36.187896 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:35:36.189157 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:35:36.189157 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:35:36.189157 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:35:36.189157 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:35:36.189157 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:35:36.189157 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:35:36.189157 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:35:36.189157 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 252, in _add_floating_ip Oct 04 20:35:36.189157 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 04 20:35:36.189157 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: floating IP not found Oct 04 20:35:36.189157 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:35:36.189157 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:35:36.189157 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:35:36.189157 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:35:36.189157 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:35:36.189157 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:35:36.189157 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:35:36.189157 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:35:36.189157 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: floating IP not found Oct 04 20:35:36.189157 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:35:36.190372 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-1eeabd8f-df5b-4963-b448-6912ed289730 tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] Returning 404 to user: floating IP not found {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:35:36.190372 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-1eeabd8f-df5b-4963-b448-6912ed289730 tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] 10.222.0.33 "POST /compute/v2.1/servers/486112b2-497b-4039-ac04-b23cf076d470/action" status: 404 len: 67 microversion: 2.1 time: 0.326556 Oct 04 20:35:36.190372 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 290/589] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 20:35:35 2022] POST /compute/v2.1/servers/486112b2-497b-4039-ac04-b23cf076d470/action => generated 67 bytes in 329 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 20:35:36.196061 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-2d351183-1f23-47ce-adca-26a82f7d6a9d tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-679408581", "imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "9f8cc082-0a37-4123-a680-1210a90b3ca9"}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:35:36.209534 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-76cb16f1-f356-4cc0-824c-7987649c2dd7 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] HTTP exception thrown: Instance b8cf32e5-d9cc-4e92-bd81-2c3449406c95 could not be found. Oct 04 20:35:36.213597 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-76cb16f1-f356-4cc0-824c-7987649c2dd7 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Request method failure captured: Oct 04 20:35:36.213597 n-d-854823-8 devstack@n-api.service[128801]: request: DELETE /compute/v2.1/servers/b8cf32e5-d9cc-4e92-bd81-2c3449406c95 HTTP/1.1 Oct 04 20:35:36.213597 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:35:36.213597 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:35:36.213597 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:35:36.213597 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 0 Oct 04 20:35:36.213597 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:35:36.213597 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:35:36.213597 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:35:36.213597 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:35:36.213597 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJjWIa7W9QknWsaey-fCdR6Ih2cpvm1BeCjFGNfwWVocUF4xoE9dgg-X9_kMgOXOC52EiNgJAgUE_Nhfd5pK9mUE_qbSTDl_fqZZyRlt2yi4hkA43q0DeqZFC3W-KtBmUQyQPM4nO2v3hsP0wSLtlD1iifBpZyPjP88JQpmcEakiB0g Oct 04 20:35:36.213597 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:35:36.213597 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:35:36.213597 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:35:36.213597 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:35:36.213597 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:35:36.213597 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:35:36.213597 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: 16a307499cf44d03a1e9bb61f614f099 Oct 04 20:35:36.213597 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-DeleteServersAdminTestJSON-591228109 Oct 04 20:35:36.213597 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 20:35:36.213597 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 20:35:36.215236 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_16a307499cf44d03a1e9bb61f614f099", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/16a307499cf44d03a1e9bb61f614f099"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/16a307499cf44d03a1e9bb61f614f099"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/16a307499cf44d03a1e9bb61f614f099"}]}] Oct 04 20:35:36.215236 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-DeleteServersAdminTestJSON-591228109 Oct 04 20:35:36.215236 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: 16a307499cf44d03a1e9bb61f614f099 Oct 04 20:35:36.215236 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-591228109 Oct 04 20:35:36.215236 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-DeleteServersAdminTestJSON-591228109-project Oct 04 20:35:36.215236 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:35:36.215236 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:35:36.215236 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: 5cbd31af13444cda97ba5f8c99d19437 Oct 04 20:35:36.215236 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-DeleteServersAdminTestJSON-591228109-project Oct 04 20:35:36.215236 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 20:35:36.215236 n-d-854823-8 devstack@n-api.service[128801]: exception: Instance b8cf32e5-d9cc-4e92-bd81-2c3449406c95 could not be found. Oct 04 20:35:36.215236 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': 'b8cf32e5-d9cc-4e92-bd81-2c3449406c95'} Oct 04 20:35:36.215930 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:35:36.215930 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:35:36.215930 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:35:36.215930 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:35:36.215930 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:35:36.215930 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:35:36.215930 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:35:36.215930 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:35:36.215930 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:35:36.215930 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:35:36.215930 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b8cf32e5-d9cc-4e92-bd81-2c3449406c95 could not be found. Oct 04 20:35:36.215930 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:35:36.215930 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:35:36.215930 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:35:36.215930 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:35:36.215930 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:35:36.215930 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:35:36.215930 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:35:36.215930 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:35:36.215930 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:35:36.217016 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:35:36.217016 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 20:35:36.217016 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 20:35:36.217016 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 20:35:36.217016 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 20:35:36.217016 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:35:36.217016 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:35:36.217016 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:35:36.217016 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:35:36.217016 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b8cf32e5-d9cc-4e92-bd81-2c3449406c95 could not be found. Oct 04 20:35:36.217016 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:35:36.217016 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:35:36.217016 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:35:36.217016 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:35:36.217016 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:35:36.217016 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:35:36.217016 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:35:36.217016 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:35:36.217016 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b8cf32e5-d9cc-4e92-bd81-2c3449406c95 could not be found. Oct 04 20:35:36.217016 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:35:36.232806 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-76cb16f1-f356-4cc0-824c-7987649c2dd7 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Returning 404 to user: Instance b8cf32e5-d9cc-4e92-bd81-2c3449406c95 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:35:36.234125 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-76cb16f1-f356-4cc0-824c-7987649c2dd7 tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] 10.222.0.33 "DELETE /compute/v2.1/servers/b8cf32e5-d9cc-4e92-bd81-2c3449406c95" status: 404 len: 111 microversion: 2.1 time: 0.099576 Oct 04 20:35:36.235421 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 300/590] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 20:35:36 2022] DELETE /compute/v2.1/servers/b8cf32e5-d9cc-4e92-bd81-2c3449406c95 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:35:36.251118 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c0e75ff3-4657-4155-9b80-24ce46eaf17e tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:35:36.254139 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c0e75ff3-4657-4155-9b80-24ce46eaf17e tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] [instance: c7f3bb5b-e08b-4a3f-ba4d-40012179412e] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:36.264778 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c0e75ff3-4657-4155-9b80-24ce46eaf17e tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:36.265615 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c0e75ff3-4657-4155-9b80-24ce46eaf17e tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:36.266117 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c0e75ff3-4657-4155-9b80-24ce46eaf17e tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:36.267136 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c0e75ff3-4657-4155-9b80-24ce46eaf17e tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:36.267828 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c0e75ff3-4657-4155-9b80-24ce46eaf17e tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:36.271496 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c0e75ff3-4657-4155-9b80-24ce46eaf17e tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:36.285614 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.network.neutron [None req-2d351183-1f23-47ce-adca-26a82f7d6a9d tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] validate_networks() for None {{(pid=128802) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:35:36.482499 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c0e75ff3-4657-4155-9b80-24ce46eaf17e tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '3563efe2b8c94931a2a46c4e14811b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3118a5d96843d3bede1ed94bd9717e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:36.497735 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c0e75ff3-4657-4155-9b80-24ce46eaf17e tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] [instance: c7f3bb5b-e08b-4a3f-ba4d-40012179412e] Old instance type m1.heat2, new instance type m1.heat {{(pid=128801) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 04 20:35:36.526426 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-c0e75ff3-4657-4155-9b80-24ce46eaf17e tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Flavor limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:35:36.526854 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-c0e75ff3-4657-4155-9b80-24ce46eaf17e tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Image limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:35:36.527329 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-c0e75ff3-4657-4155-9b80-24ce46eaf17e tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Flavor pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:35:36.532146 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-c0e75ff3-4657-4155-9b80-24ce46eaf17e tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Image pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:35:36.532809 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-c0e75ff3-4657-4155-9b80-24ce46eaf17e tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:35:36.777436 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c0e75ff3-4657-4155-9b80-24ce46eaf17e tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] 10.222.0.33 "POST /compute/v2.1/servers/c7f3bb5b-e08b-4a3f-ba4d-40012179412e/action" status: 202 len: 0 microversion: 2.1 time: 0.540797 Oct 04 20:35:36.778052 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 301/591] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 20:35:36 2022] POST /compute/v2.1/servers/c7f3bb5b-e08b-4a3f-ba4d-40012179412e/action => generated 0 bytes in 542 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:35:36.792442 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-797c82a6-6ea2-4919-a5dd-ee9ea8178493 tempest-LiveMigrationNegativeTest-850045882 tempest-LiveMigrationNegativeTest-850045882-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:36.799161 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-797c82a6-6ea2-4919-a5dd-ee9ea8178493 tempest-LiveMigrationNegativeTest-850045882 tempest-LiveMigrationNegativeTest-850045882-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:36.803712 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-797c82a6-6ea2-4919-a5dd-ee9ea8178493 tempest-LiveMigrationNegativeTest-850045882 tempest-LiveMigrationNegativeTest-850045882-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:36.804197 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-797c82a6-6ea2-4919-a5dd-ee9ea8178493 tempest-LiveMigrationNegativeTest-850045882 tempest-LiveMigrationNegativeTest-850045882-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:36.805367 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-797c82a6-6ea2-4919-a5dd-ee9ea8178493 tempest-LiveMigrationNegativeTest-850045882 tempest-LiveMigrationNegativeTest-850045882-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:36.809856 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-797c82a6-6ea2-4919-a5dd-ee9ea8178493 tempest-LiveMigrationNegativeTest-850045882 tempest-LiveMigrationNegativeTest-850045882-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:36.810318 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-797c82a6-6ea2-4919-a5dd-ee9ea8178493 tempest-LiveMigrationNegativeTest-850045882 tempest-LiveMigrationNegativeTest-850045882-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:36.848411 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-797c82a6-6ea2-4919-a5dd-ee9ea8178493 tempest-LiveMigrationNegativeTest-850045882 tempest-LiveMigrationNegativeTest-850045882-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.068266 Oct 04 20:35:36.849606 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 302/592] 10.222.0.33 () {58 vars in 1176 bytes} [Tue Oct 4 20:35:36 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:35:36.856175 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b9e04e11-79ae-4913-910a-1e8ca9375fdb tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "0.0.0.0"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:35:36.874539 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-2d351183-1f23-47ce-adca-26a82f7d6a9d tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Flavor limits 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:35:36.875029 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-2d351183-1f23-47ce-adca-26a82f7d6a9d tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Image limits 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:35:36.875501 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-2d351183-1f23-47ce-adca-26a82f7d6a9d tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Flavor pref 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:35:36.876365 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-2d351183-1f23-47ce-adca-26a82f7d6a9d tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Image pref 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:35:36.877292 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-2d351183-1f23-47ce-adca-26a82f7d6a9d tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:35:36.896537 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2d351183-1f23-47ce-adca-26a82f7d6a9d tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:36.897018 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2d351183-1f23-47ce-adca-26a82f7d6a9d tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:36.897448 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2d351183-1f23-47ce-adca-26a82f7d6a9d tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:36.903813 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2d351183-1f23-47ce-adca-26a82f7d6a9d tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:36.905440 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2d351183-1f23-47ce-adca-26a82f7d6a9d tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:36.906518 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2d351183-1f23-47ce-adca-26a82f7d6a9d tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:36.965577 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=1 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:35:36.989231 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-2d351183-1f23-47ce-adca-26a82f7d6a9d tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Getting quotas for project c288268acb30475bbc065a8f72cb21d5. Resources: {'ram', 'instances', 'cores'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:35:37.003417 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-2d351183-1f23-47ce-adca-26a82f7d6a9d tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Getting quotas for user b4a24944aeb34a5ea228965be9bf4ce0 and project c288268acb30475bbc065a8f72cb21d5. Resources: {'ram', 'instances', 'cores'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:35:37.016633 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-b9e04e11-79ae-4913-910a-1e8ca9375fdb tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] HTTP exception thrown: Floating IP not found for address 0.0.0.0. Oct 04 20:35:37.024912 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b9e04e11-79ae-4913-910a-1e8ca9375fdb tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] Request method failure captured: Oct 04 20:35:37.024912 n-d-854823-8 devstack@n-api.service[128801]: request: POST /compute/v2.1/servers/486112b2-497b-4039-ac04-b23cf076d470/action HTTP/1.1 Oct 04 20:35:37.024912 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:35:37.024912 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:35:37.024912 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:35:37.024912 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 44 Oct 04 20:35:37.024912 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:35:37.024912 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:35:37.024912 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:35:37.024912 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:35:37.024912 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJjo0ehgCcVLX9m4cw1-oibWoGlG_FZ6zY8pWR3yQddTBQSrtiDqa5aRmsThNvdRC_qNLxv5I7_CVnrkgu0ATHySIX6WJSOdYfvAiWZlOJBL-opPPgsRFwBwXiO-zU137gpGStP7Xj8gt9FNnb87K-zqXIQOjv7J6zBZeUoZGEuXPbs Oct 04 20:35:37.024912 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:35:37.024912 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:35:37.024912 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:35:37.024912 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:35:37.024912 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:35:37.024912 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:35:37.024912 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: b0ca732ccf4d417ab1f7ba82a9c8c41e Oct 04 20:35:37.024912 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-781358035 Oct 04 20:35:37.024912 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 20:35:37.024912 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 20:35:37.026468 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b0ca732ccf4d417ab1f7ba82a9c8c41e", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b0ca732ccf4d417ab1f7ba82a9c8c41e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b0ca732ccf4d417ab1f7ba82a9c8c41e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b0ca732ccf4d417ab1f7ba82a9c8c41e"}]}] Oct 04 20:35:37.026468 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-781358035 Oct 04 20:35:37.026468 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: b0ca732ccf4d417ab1f7ba82a9c8c41e Oct 04 20:35:37.026468 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-781358035 Oct 04 20:35:37.026468 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project Oct 04 20:35:37.026468 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:35:37.026468 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:35:37.026468 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: f8f72b5b32ab457aaaa1c1ff7efdce5c Oct 04 20:35:37.026468 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project Oct 04 20:35:37.026468 n-d-854823-8 devstack@n-api.service[128801]: Oct 04 20:35:37.026468 n-d-854823-8 devstack@n-api.service[128801]: {"removeFloatingIp": {"address": "0.0.0.0"}} Oct 04 20:35:37.026468 n-d-854823-8 devstack@n-api.service[128801]: method: Oct 04 20:35:37.026468 n-d-854823-8 devstack@n-api.service[128801]: exception: Floating IP not found for address 0.0.0.0. Oct 04 20:35:37.027235 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': '486112b2-497b-4039-ac04-b23cf076d470', 'body': {'removeFloatingIp': {'address': '0.0.0.0'}}} Oct 04 20:35:37.027235 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:35:37.027235 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:35:37.027235 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 58, in get_instance_by_floating_ip_addr Oct 04 20:35:37.027235 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self.network_api.get_instance_id_by_floating_address( Oct 04 20:35:37.027235 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2927, in get_instance_id_by_floating_address Oct 04 20:35:37.027235 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, address) Oct 04 20:35:37.027235 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3011, in _get_floating_ip_by_address Oct 04 20:35:37.027235 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Oct 04 20:35:37.027235 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Oct 04 20:35:37.027235 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:35:37.027235 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:35:37.027235 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:35:37.027235 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:35:37.027235 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:35:37.027235 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:35:37.027235 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:35:37.027235 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:35:37.027235 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:35:37.028643 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:35:37.028643 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:35:37.028643 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:35:37.028643 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:35:37.028643 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:35:37.028643 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 277, in _remove_floating_ip Oct 04 20:35:37.028643 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = get_instance_by_floating_ip_addr(self, context, address) Oct 04 20:35:37.028643 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 61, in get_instance_by_floating_ip_addr Oct 04 20:35:37.028643 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=ex.format_message()) Oct 04 20:35:37.028643 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for address 0.0.0.0. Oct 04 20:35:37.028643 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:35:37.028643 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:35:37.028643 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:35:37.028643 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:35:37.028643 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:35:37.028643 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:35:37.028643 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:35:37.028643 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:35:37.028643 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for address 0.0.0.0. Oct 04 20:35:37.028643 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:35:37.030698 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b9e04e11-79ae-4913-910a-1e8ca9375fdb tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] Returning 404 to user: Floating IP not found for address 0.0.0.0. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:35:37.030698 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b9e04e11-79ae-4913-910a-1e8ca9375fdb tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] 10.222.0.33 "POST /compute/v2.1/servers/486112b2-497b-4039-ac04-b23cf076d470/action" status: 404 len: 88 microversion: 2.1 time: 0.175663 Oct 04 20:35:37.031688 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 303/593] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 20:35:36 2022] POST /compute/v2.1/servers/486112b2-497b-4039-ac04-b23cf076d470/action => generated 88 bytes in 181 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 20:35:37.040103 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-2d351183-1f23-47ce-adca-26a82f7d6a9d tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Going to run 1 instances... {{(pid=128802) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:35:37.046974 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-2d351183-1f23-47ce-adca-26a82f7d6a9d tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] [instance: b3667992-a213-4da4-a172-8ab92ff3b2ca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='15b24725-0c99-4bcf-b1fb-907cdf8e2d63',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128802) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:35:37.051059 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-17024979-1b91-4cc2-a6f1-021d4bc28abe tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:37.063794 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-17024979-1b91-4cc2-a6f1-021d4bc28abe tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] [instance: b8cf32e5-d9cc-4e92-bd81-2c3449406c95] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:37.124352 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-17024979-1b91-4cc2-a6f1-021d4bc28abe tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:37.126166 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-17024979-1b91-4cc2-a6f1-021d4bc28abe tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:37.126631 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-17024979-1b91-4cc2-a6f1-021d4bc28abe tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:37.132803 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-17024979-1b91-4cc2-a6f1-021d4bc28abe tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:37.133385 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-17024979-1b91-4cc2-a6f1-021d4bc28abe tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:37.133814 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-17024979-1b91-4cc2-a6f1-021d4bc28abe tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:37.214069 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-17024979-1b91-4cc2-a6f1-021d4bc28abe tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] HTTP exception thrown: Instance b8cf32e5-d9cc-4e92-bd81-2c3449406c95 could not be found. Oct 04 20:35:37.218105 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-17024979-1b91-4cc2-a6f1-021d4bc28abe tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Request method failure captured: Oct 04 20:35:37.218105 n-d-854823-8 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/b8cf32e5-d9cc-4e92-bd81-2c3449406c95 HTTP/1.1 Oct 04 20:35:37.218105 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:35:37.218105 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:35:37.218105 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:35:37.218105 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 0 Oct 04 20:35:37.218105 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:35:37.218105 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:35:37.218105 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:35:37.218105 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:35:37.218105 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJjWIa7W9QknWsaey-fCdR6Ih2cpvm1BeCjFGNfwWVocUF4xoE9dgg-X9_kMgOXOC52EiNgJAgUE_Nhfd5pK9mUE_qbSTDl_fqZZyRlt2yi4hkA43q0DeqZFC3W-KtBmUQyQPM4nO2v3hsP0wSLtlD1iifBpZyPjP88JQpmcEakiB0g Oct 04 20:35:37.218105 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:35:37.218105 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:35:37.218105 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:35:37.218105 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:35:37.218105 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:35:37.218105 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:35:37.218105 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: 16a307499cf44d03a1e9bb61f614f099 Oct 04 20:35:37.218105 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-DeleteServersAdminTestJSON-591228109 Oct 04 20:35:37.218105 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 20:35:37.218105 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 20:35:37.219716 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_16a307499cf44d03a1e9bb61f614f099", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/16a307499cf44d03a1e9bb61f614f099"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/16a307499cf44d03a1e9bb61f614f099"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/16a307499cf44d03a1e9bb61f614f099"}]}] Oct 04 20:35:37.219716 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-DeleteServersAdminTestJSON-591228109 Oct 04 20:35:37.219716 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: 16a307499cf44d03a1e9bb61f614f099 Oct 04 20:35:37.219716 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-591228109 Oct 04 20:35:37.219716 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-DeleteServersAdminTestJSON-591228109-project Oct 04 20:35:37.219716 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:35:37.219716 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:35:37.219716 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: 5cbd31af13444cda97ba5f8c99d19437 Oct 04 20:35:37.219716 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-DeleteServersAdminTestJSON-591228109-project Oct 04 20:35:37.219716 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 20:35:37.219716 n-d-854823-8 devstack@n-api.service[128801]: exception: Instance b8cf32e5-d9cc-4e92-bd81-2c3449406c95 could not be found. Oct 04 20:35:37.219716 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': 'b8cf32e5-d9cc-4e92-bd81-2c3449406c95'} Oct 04 20:35:37.220565 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:35:37.220565 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:35:37.220565 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:35:37.220565 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:35:37.220565 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:35:37.220565 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:35:37.220565 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:35:37.220565 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:35:37.220565 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:35:37.220565 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:35:37.220565 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b8cf32e5-d9cc-4e92-bd81-2c3449406c95 could not be found. Oct 04 20:35:37.220565 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:35:37.220565 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:35:37.220565 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:35:37.220565 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:35:37.220565 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:35:37.220565 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:35:37.220565 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:35:37.220565 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:35:37.220565 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:35:37.221880 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:35:37.221880 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:35:37.221880 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:35:37.221880 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:35:37.221880 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:35:37.221880 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:35:37.221880 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:35:37.221880 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b8cf32e5-d9cc-4e92-bd81-2c3449406c95 could not be found. Oct 04 20:35:37.221880 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:35:37.221880 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:35:37.221880 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:35:37.221880 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:35:37.221880 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:35:37.221880 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:35:37.221880 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:35:37.221880 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:35:37.221880 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b8cf32e5-d9cc-4e92-bd81-2c3449406c95 could not be found. Oct 04 20:35:37.221880 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:35:37.227512 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-17024979-1b91-4cc2-a6f1-021d4bc28abe tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] Returning 404 to user: Instance b8cf32e5-d9cc-4e92-bd81-2c3449406c95 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:35:37.230200 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-17024979-1b91-4cc2-a6f1-021d4bc28abe tempest-DeleteServersAdminTestJSON-591228109 tempest-DeleteServersAdminTestJSON-591228109-project] 10.222.0.33 "GET /compute/v2.1/servers/b8cf32e5-d9cc-4e92-bd81-2c3449406c95" status: 404 len: 111 microversion: 2.1 time: 0.197479 Oct 04 20:35:37.232228 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 304/594] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:37 2022] GET /compute/v2.1/servers/b8cf32e5-d9cc-4e92-bd81-2c3449406c95 => generated 111 bytes in 200 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:35:37.234781 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-2d351183-1f23-47ce-adca-26a82f7d6a9d tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.040723 Oct 04 20:35:37.250739 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1f668c6f-4998-477d-b97d-b7b9e43749cb tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:37.252699 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-1f668c6f-4998-477d-b97d-b7b9e43749cb tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] [instance: c7f3bb5b-e08b-4a3f-ba4d-40012179412e] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:37.255238 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 291/595] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 20:35:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 1063 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 20:35:37.269040 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1f668c6f-4998-477d-b97d-b7b9e43749cb tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:37.272203 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1f668c6f-4998-477d-b97d-b7b9e43749cb tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:37.274368 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1f668c6f-4998-477d-b97d-b7b9e43749cb tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:37.292608 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1f668c6f-4998-477d-b97d-b7b9e43749cb tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:37.295042 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1f668c6f-4998-477d-b97d-b7b9e43749cb tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:37.295657 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1f668c6f-4998-477d-b97d-b7b9e43749cb tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:37.303794 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-38775614-2766-4186-a3ae-815fc7d7d0a7 tempest-LiveMigrationNegativeTest-850045882 tempest-LiveMigrationNegativeTest-850045882-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-854823-8", "block_migration": true, "disk_over_commit": false}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:35:37.309354 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-38775614-2766-4186-a3ae-815fc7d7d0a7 tempest-LiveMigrationNegativeTest-850045882 tempest-LiveMigrationNegativeTest-850045882-project-admin] [instance: dd727dc7-96ee-4553-84ca-0f9b6ed59781] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:37.329953 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-38775614-2766-4186-a3ae-815fc7d7d0a7 tempest-LiveMigrationNegativeTest-850045882 tempest-LiveMigrationNegativeTest-850045882-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:37.334305 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-38775614-2766-4186-a3ae-815fc7d7d0a7 tempest-LiveMigrationNegativeTest-850045882 tempest-LiveMigrationNegativeTest-850045882-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:37.337793 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-38775614-2766-4186-a3ae-815fc7d7d0a7 tempest-LiveMigrationNegativeTest-850045882 tempest-LiveMigrationNegativeTest-850045882-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:37.339089 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-38775614-2766-4186-a3ae-815fc7d7d0a7 tempest-LiveMigrationNegativeTest-850045882 tempest-LiveMigrationNegativeTest-850045882-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:37.347273 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-38775614-2766-4186-a3ae-815fc7d7d0a7 tempest-LiveMigrationNegativeTest-850045882 tempest-LiveMigrationNegativeTest-850045882-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:37.348106 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-38775614-2766-4186-a3ae-815fc7d7d0a7 tempest-LiveMigrationNegativeTest-850045882 tempest-LiveMigrationNegativeTest-850045882-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:37.377685 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=95,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=2,nova_cell1:RELEASE=1,nova_cell1:INSERT=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:35:37.411527 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.objects.instance [None req-38775614-2766-4186-a3ae-815fc7d7d0a7 tempest-LiveMigrationNegativeTest-850045882 tempest-LiveMigrationNegativeTest-850045882-project-admin] Lazy-loading 'flavor' on Instance uuid dd727dc7-96ee-4553-84ca-0f9b6ed59781 {{(pid=128802) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:35:37.452873 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.wsgi [None req-38775614-2766-4186-a3ae-815fc7d7d0a7 tempest-LiveMigrationNegativeTest-850045882 tempest-LiveMigrationNegativeTest-850045882-project-admin] HTTP exception thrown: Cannot 'os-migrateLive' instance dd727dc7-96ee-4553-84ca-0f9b6ed59781 while it is in vm_state suspended Oct 04 20:35:37.461490 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-38775614-2766-4186-a3ae-815fc7d7d0a7 tempest-LiveMigrationNegativeTest-850045882 tempest-LiveMigrationNegativeTest-850045882-project-admin] Request method failure captured: Oct 04 20:35:37.461490 n-d-854823-8 devstack@n-api.service[128802]: request: POST /compute/v2.1/servers/dd727dc7-96ee-4553-84ca-0f9b6ed59781/action HTTP/1.1 Oct 04 20:35:37.461490 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 20:35:37.461490 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 20:35:37.461490 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 20:35:37.461490 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 97 Oct 04 20:35:37.461490 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 20:35:37.461490 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 20:35:37.461490 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 20:35:37.461490 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 20:35:37.461490 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPJjicYdzO8XQcUdH20pP4dZnIE8_sEaoxLpcBk5Z2XZUDicT2CntSW4I1dWvbjTQoxatzQ8UzBaXAhmOhGjYue5lzLwWb1rgULQngK1AszR-WBixHJcsjjQPfMsiPnNBRPyocou0DiM31jRoC0SSuLyu_UOpV0On1ZHkvdiQPQSDAus Oct 04 20:35:37.461490 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 20:35:37.461490 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 20:35:37.461490 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 20:35:37.461490 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 20:35:37.461490 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 20:35:37.461490 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 20:35:37.461490 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: e5d03328b7cf4d0dbe73c003b90e951e Oct 04 20:35:37.461490 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-LiveMigrationNegativeTest-850045882 Oct 04 20:35:37.461490 n-d-854823-8 devstack@n-api.service[128802]: X-Role: admin,reader,member Oct 04 20:35:37.461490 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: admin,reader,member Oct 04 20:35:37.463286 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_e5d03328b7cf4d0dbe73c003b90e951e", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e5d03328b7cf4d0dbe73c003b90e951e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e5d03328b7cf4d0dbe73c003b90e951e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/e5d03328b7cf4d0dbe73c003b90e951e"}]}] Oct 04 20:35:37.463286 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-LiveMigrationNegativeTest-850045882 Oct 04 20:35:37.463286 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: e5d03328b7cf4d0dbe73c003b90e951e Oct 04 20:35:37.463286 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-850045882 Oct 04 20:35:37.463286 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-LiveMigrationNegativeTest-850045882-project-admin Oct 04 20:35:37.463286 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 20:35:37.463286 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 20:35:37.463286 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: 8380dc4657af47358da6a75a5844c659 Oct 04 20:35:37.463286 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-LiveMigrationNegativeTest-850045882-project-admin Oct 04 20:35:37.463286 n-d-854823-8 devstack@n-api.service[128802]: Oct 04 20:35:37.463286 n-d-854823-8 devstack@n-api.service[128802]: {"os-migrateLive": {"host": "n-h1-854823-8", "block_migration": true, "disk_over_commit": false}} Oct 04 20:35:37.463286 n-d-854823-8 devstack@n-api.service[128802]: method: > Oct 04 20:35:37.464248 n-d-854823-8 devstack@n-api.service[128802]: exception: Cannot 'os-migrateLive' instance dd727dc7-96ee-4553-84ca-0f9b6ed59781 while it is in vm_state suspended Oct 04 20:35:37.464248 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'id': 'dd727dc7-96ee-4553-84ca-0f9b6ed59781', 'body': {'os-migrateLive': {'host': 'n-h1-854823-8', 'block_migration': True, 'disk_over_commit': False}}} Oct 04 20:35:37.464248 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:35:37.464248 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:35:37.464248 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Oct 04 20:35:37.464248 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Oct 04 20:35:37.464248 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 04 20:35:37.464248 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 20:35:37.464248 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 04 20:35:37.464248 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 04 20:35:37.464248 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 04 20:35:37.464248 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 04 20:35:37.464248 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 04 20:35:37.464248 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 04 20:35:37.464248 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 04 20:35:37.464248 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 04 20:35:37.464248 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Oct 04 20:35:37.464248 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 04 20:35:37.466295 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 20:35:37.466295 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 20:35:37.466295 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 04 20:35:37.466295 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 04 20:35:37.466295 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance dd727dc7-96ee-4553-84ca-0f9b6ed59781 in vm_state suspended. Cannot live_migrate while the instance is in this state. Oct 04 20:35:37.466295 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:35:37.466295 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:35:37.466295 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:35:37.466295 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:35:37.466295 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:35:37.466295 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:35:37.466295 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:35:37.466295 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:35:37.466295 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:35:37.466295 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:35:37.466295 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:35:37.466295 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:35:37.466295 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:35:37.466295 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:35:37.466295 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:35:37.467854 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:35:37.467854 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 04 20:35:37.467854 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 152, in _migrate_live Oct 04 20:35:37.467854 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 04 20:35:37.467854 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 04 20:35:37.467854 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 04 20:35:37.467854 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'os-migrateLive' instance dd727dc7-96ee-4553-84ca-0f9b6ed59781 while it is in vm_state suspended Oct 04 20:35:37.467854 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:35:37.467854 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:35:37.467854 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:35:37.467854 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:35:37.467854 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:35:37.467854 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:35:37.467854 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:35:37.467854 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:35:37.467854 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'os-migrateLive' instance dd727dc7-96ee-4553-84ca-0f9b6ed59781 while it is in vm_state suspended Oct 04 20:35:37.467854 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:35:37.469283 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-38775614-2766-4186-a3ae-815fc7d7d0a7 tempest-LiveMigrationNegativeTest-850045882 tempest-LiveMigrationNegativeTest-850045882-project-admin] Returning 409 to user: Cannot 'os-migrateLive' instance dd727dc7-96ee-4553-84ca-0f9b6ed59781 while it is in vm_state suspended {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:35:37.471339 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-38775614-2766-4186-a3ae-815fc7d7d0a7 tempest-LiveMigrationNegativeTest-850045882 tempest-LiveMigrationNegativeTest-850045882-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/dd727dc7-96ee-4553-84ca-0f9b6ed59781/action" status: 409 len: 155 microversion: 2.1 time: 0.209564 Oct 04 20:35:37.474780 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 292/596] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 20:35:37 2022] POST /compute/v2.1/servers/dd727dc7-96ee-4553-84ca-0f9b6ed59781/action => generated 155 bytes in 219 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 04 20:35:37.487562 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-3861f528-1046-4ced-a231-2368b196a6f7 tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:37.493888 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-3861f528-1046-4ced-a231-2368b196a6f7 tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] [instance: 486112b2-497b-4039-ac04-b23cf076d470] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:37.510746 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3861f528-1046-4ced-a231-2368b196a6f7 tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:37.511372 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3861f528-1046-4ced-a231-2368b196a6f7 tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:37.512256 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3861f528-1046-4ced-a231-2368b196a6f7 tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:37.513380 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3861f528-1046-4ced-a231-2368b196a6f7 tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:37.514198 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3861f528-1046-4ced-a231-2368b196a6f7 tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:37.514967 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3861f528-1046-4ced-a231-2368b196a6f7 tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:37.610043 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-3861f528-1046-4ced-a231-2368b196a6f7 tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] [instance: 486112b2-497b-4039-ac04-b23cf076d470] Going to try to terminate instance {{(pid=128802) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:35:37.830528 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-3861f528-1046-4ced-a231-2368b196a6f7 tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] 10.222.0.33 "DELETE /compute/v2.1/servers/486112b2-497b-4039-ac04-b23cf076d470" status: 204 len: 0 microversion: 2.1 time: 0.353749 Oct 04 20:35:37.830655 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 293/597] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 20:35:37 2022] DELETE /compute/v2.1/servers/486112b2-497b-4039-ac04-b23cf076d470 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:35:37.841136 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-a7ceb4d5-5390-4146-b765-084898aff3aa tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:37.841842 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-a7ceb4d5-5390-4146-b765-084898aff3aa tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] [instance: b3667992-a213-4da4-a172-8ab92ff3b2ca] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:38.077281 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-a7ceb4d5-5390-4146-b765-084898aff3aa tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a24944aeb34a5ea228965be9bf4ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c288268acb30475bbc065a8f72cb21d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:38.090060 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-a7ceb4d5-5390-4146-b765-084898aff3aa tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] 10.222.0.33 "GET /compute/v2.1/servers/b3667992-a213-4da4-a172-8ab92ff3b2ca" status: 200 len: 1213 microversion: 2.1 time: 0.257926 Oct 04 20:35:38.092496 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 294/598] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:37 2022] GET /compute/v2.1/servers/b3667992-a213-4da4-a172-8ab92ff3b2ca => generated 1213 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:38.109656 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-4e14ca93-49c2-4c47-a4b9-1d2514a1ee68 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:38.111698 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-4e14ca93-49c2-4c47-a4b9-1d2514a1ee68 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] [instance: dd727dc7-96ee-4553-84ca-0f9b6ed59781] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:38.129622 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4e14ca93-49c2-4c47-a4b9-1d2514a1ee68 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:38.130120 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4e14ca93-49c2-4c47-a4b9-1d2514a1ee68 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:38.133354 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4e14ca93-49c2-4c47-a4b9-1d2514a1ee68 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:38.134146 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4e14ca93-49c2-4c47-a4b9-1d2514a1ee68 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:38.137655 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4e14ca93-49c2-4c47-a4b9-1d2514a1ee68 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:38.140495 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4e14ca93-49c2-4c47-a4b9-1d2514a1ee68 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:38.197878 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-1f668c6f-4998-477d-b97d-b7b9e43749cb tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3563efe2b8c94931a2a46c4e14811b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3118a5d96843d3bede1ed94bd9717e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:38.218702 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-1f668c6f-4998-477d-b97d-b7b9e43749cb tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] 10.222.0.33 "GET /compute/v2.1/servers/c7f3bb5b-e08b-4a3f-ba4d-40012179412e" status: 200 len: 1471 microversion: 2.1 time: 0.981658 Oct 04 20:35:38.219180 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-4e14ca93-49c2-4c47-a4b9-1d2514a1ee68 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] [instance: dd727dc7-96ee-4553-84ca-0f9b6ed59781] Going to try to terminate instance {{(pid=128802) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:35:38.222052 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 305/599] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:37 2022] GET /compute/v2.1/servers/c7f3bb5b-e08b-4a3f-ba4d-40012179412e => generated 1471 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:38.233249 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-821be5fa-258e-45ed-b262-df8a1413f4de tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:38.234086 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-821be5fa-258e-45ed-b262-df8a1413f4de tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] [instance: 486112b2-497b-4039-ac04-b23cf076d470] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:38.260666 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-821be5fa-258e-45ed-b262-df8a1413f4de tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:38.261898 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-821be5fa-258e-45ed-b262-df8a1413f4de tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:38.263718 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-821be5fa-258e-45ed-b262-df8a1413f4de tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:38.264941 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-821be5fa-258e-45ed-b262-df8a1413f4de tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:38.265589 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-821be5fa-258e-45ed-b262-df8a1413f4de tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:38.266180 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-821be5fa-258e-45ed-b262-df8a1413f4de tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:38.472807 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-4e14ca93-49c2-4c47-a4b9-1d2514a1ee68 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] 10.222.0.33 "DELETE /compute/v2.1/servers/dd727dc7-96ee-4553-84ca-0f9b6ed59781" status: 204 len: 0 microversion: 2.1 time: 0.376704 Oct 04 20:35:38.478943 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 295/600] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 20:35:38 2022] DELETE /compute/v2.1/servers/dd727dc7-96ee-4553-84ca-0f9b6ed59781 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:35:38.486903 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-6d28301c-4c92-4d02-9716-c67f494b4f90 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:38.505361 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-6d28301c-4c92-4d02-9716-c67f494b4f90 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] [instance: dd727dc7-96ee-4553-84ca-0f9b6ed59781] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:38.513544 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6d28301c-4c92-4d02-9716-c67f494b4f90 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:38.514059 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6d28301c-4c92-4d02-9716-c67f494b4f90 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:38.514448 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6d28301c-4c92-4d02-9716-c67f494b4f90 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:38.520874 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6d28301c-4c92-4d02-9716-c67f494b4f90 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:38.521852 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6d28301c-4c92-4d02-9716-c67f494b4f90 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:38.522471 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6d28301c-4c92-4d02-9716-c67f494b4f90 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:38.723040 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-821be5fa-258e-45ed-b262-df8a1413f4de tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f72b5b32ab457aaaa1c1ff7efdce5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ca732ccf4d417ab1f7ba82a9c8c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:38.732077 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-821be5fa-258e-45ed-b262-df8a1413f4de tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] 10.222.0.33 "GET /compute/v2.1/servers/486112b2-497b-4039-ac04-b23cf076d470" status: 200 len: 1542 microversion: 2.1 time: 0.508803 Oct 04 20:35:38.755935 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 306/601] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:38 2022] GET /compute/v2.1/servers/486112b2-497b-4039-ac04-b23cf076d470 => generated 1542 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:38.936890 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-6d28301c-4c92-4d02-9716-c67f494b4f90 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f051a291d59242469f8172a9c474ac89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f0707d756b4ee085a19cccf3ab82c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:38.947077 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-6d28301c-4c92-4d02-9716-c67f494b4f90 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] 10.222.0.33 "GET /compute/v2.1/servers/dd727dc7-96ee-4553-84ca-0f9b6ed59781" status: 200 len: 1465 microversion: 2.1 time: 0.465998 Oct 04 20:35:38.972269 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 296/602] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:38 2022] GET /compute/v2.1/servers/dd727dc7-96ee-4553-84ca-0f9b6ed59781 => generated 1465 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:39.116071 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-7e5a7f74-b056-4d4c-b22e-260e0cd16d39 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:39.117358 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-7e5a7f74-b056-4d4c-b22e-260e0cd16d39 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] [instance: b3667992-a213-4da4-a172-8ab92ff3b2ca] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:39.130826 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7e5a7f74-b056-4d4c-b22e-260e0cd16d39 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:39.131390 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7e5a7f74-b056-4d4c-b22e-260e0cd16d39 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:39.132090 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7e5a7f74-b056-4d4c-b22e-260e0cd16d39 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:39.133351 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7e5a7f74-b056-4d4c-b22e-260e0cd16d39 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:39.134097 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7e5a7f74-b056-4d4c-b22e-260e0cd16d39 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:39.134564 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7e5a7f74-b056-4d4c-b22e-260e0cd16d39 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:39.139903 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-185f13a2-d06a-46d7-827c-426f175c7847 tempest-FloatingIPDetailsNegativeTestJSON-1351914578 tempest-FloatingIPDetailsNegativeTestJSON-1351914578-project] Calling method '.version_select at 0x7f3c74a65790>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:39.280865 n-d-854823-8 devstack@n-api.service[128801]: DEBUG neutronclient.v2_0.client [None req-185f13a2-d06a-46d7-827c-426f175c7847 tempest-FloatingIPDetailsNegativeTestJSON-1351914578 tempest-FloatingIPDetailsNegativeTestJSON-1351914578-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 34e5d7a0-11ef-4967-810a-d80ffc6d874f could not be found", "detail": ""}} {{(pid=128801) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 20:35:39.283353 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-185f13a2-d06a-46d7-827c-426f175c7847 tempest-FloatingIPDetailsNegativeTestJSON-1351914578 tempest-FloatingIPDetailsNegativeTestJSON-1351914578-project] HTTP exception thrown: Floating IP not found for ID 34e5d7a0-11ef-4967-810a-d80ffc6d874f Oct 04 20:35:39.286646 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-185f13a2-d06a-46d7-827c-426f175c7847 tempest-FloatingIPDetailsNegativeTestJSON-1351914578 tempest-FloatingIPDetailsNegativeTestJSON-1351914578-project] Request method failure captured: Oct 04 20:35:39.286646 n-d-854823-8 devstack@n-api.service[128801]: request: GET /compute/v2.1/os-floating-ips/34e5d7a0-11ef-4967-810a-d80ffc6d874f HTTP/1.1 Oct 04 20:35:39.286646 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:35:39.286646 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:35:39.286646 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:35:39.286646 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 0 Oct 04 20:35:39.286646 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:35:39.286646 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:35:39.286646 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:35:39.286646 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:35:39.286646 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJkaDKIXuCH9ble3OPalwN4OsV7uY7Fcv69tLmKHAhOS7JxuiWmz7jzLxYRoro2uF3QVhazP69e132znKOk5iVEPG-YsNz9X1z1oiz3GoITqKBq73Cmy1TfSDfgswM9_r8zjalT3ensfmYQWEI3FpYElUYXff0qb_WvRckV2c5WUciE Oct 04 20:35:39.286646 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:35:39.286646 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:35:39.286646 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:35:39.286646 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:35:39.286646 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:35:39.286646 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:35:39.286646 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: 8257a898bed64a1896055d38afd51627 Oct 04 20:35:39.286646 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-FloatingIPDetailsNegativeTestJSON-1351914578 Oct 04 20:35:39.286646 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 20:35:39.286646 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 20:35:39.288175 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_8257a898bed64a1896055d38afd51627", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8257a898bed64a1896055d38afd51627"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8257a898bed64a1896055d38afd51627"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/8257a898bed64a1896055d38afd51627"}]}] Oct 04 20:35:39.288175 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-FloatingIPDetailsNegativeTestJSON-1351914578 Oct 04 20:35:39.288175 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: 8257a898bed64a1896055d38afd51627 Oct 04 20:35:39.288175 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-FloatingIPDetailsNegativeTestJSON-1351914578 Oct 04 20:35:39.288175 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-FloatingIPDetailsNegativeTestJSON-1351914578-project Oct 04 20:35:39.288175 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:35:39.288175 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:35:39.288175 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: c399cfcb7ee94b74b030aaa19d10874c Oct 04 20:35:39.288175 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-FloatingIPDetailsNegativeTestJSON-1351914578-project Oct 04 20:35:39.288175 n-d-854823-8 devstack@n-api.service[128801]: method: Oct 04 20:35:39.288175 n-d-854823-8 devstack@n-api.service[128801]: exception: Floating IP not found for ID 34e5d7a0-11ef-4967-810a-d80ffc6d874f Oct 04 20:35:39.288175 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': '34e5d7a0-11ef-4967-810a-d80ffc6d874f'} Oct 04 20:35:39.290053 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:35:39.290053 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:35:39.290053 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 04 20:35:39.290053 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 04 20:35:39.290053 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:35:39.290053 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:35:39.290053 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 04 20:35:39.290053 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 04 20:35:39.290053 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:35:39.290053 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:35:39.290053 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 20:35:39.290053 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 20:35:39.290053 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:35:39.290053 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:35:39.290053 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:35:39.290053 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:35:39.290053 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:35:39.290053 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:35:39.290053 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 20:35:39.291262 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 20:35:39.291262 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:35:39.291262 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:35:39.291262 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 20:35:39.291262 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 20:35:39.291262 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 20:35:39.291262 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 20:35:39.291262 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 34e5d7a0-11ef-4967-810a-d80ffc6d874f could not be found Oct 04 20:35:39.291262 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-856021c4-2f77-4cf1-a608-009d883c2f57'] Oct 04 20:35:39.291262 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:35:39.291262 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:35:39.291262 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:35:39.291262 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:35:39.291262 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Oct 04 20:35:39.291262 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 04 20:35:39.291262 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 04 20:35:39.291262 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 04 20:35:39.291262 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 34e5d7a0-11ef-4967-810a-d80ffc6d874f. Oct 04 20:35:39.291262 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:35:39.292449 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:35:39.292449 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:35:39.292449 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:35:39.292449 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:35:39.292449 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:35:39.292449 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:35:39.292449 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:35:39.292449 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:35:39.292449 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:35:39.292449 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:35:39.292449 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:35:39.292449 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Oct 04 20:35:39.292449 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 04 20:35:39.292449 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 34e5d7a0-11ef-4967-810a-d80ffc6d874f Oct 04 20:35:39.292449 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:35:39.292449 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:35:39.292449 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:35:39.292449 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:35:39.292449 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:35:39.292449 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:35:39.292449 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:35:39.293633 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:35:39.293633 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 34e5d7a0-11ef-4967-810a-d80ffc6d874f Oct 04 20:35:39.293633 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:35:39.295340 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-185f13a2-d06a-46d7-827c-426f175c7847 tempest-FloatingIPDetailsNegativeTestJSON-1351914578 tempest-FloatingIPDetailsNegativeTestJSON-1351914578-project] Returning 404 to user: Floating IP not found for ID 34e5d7a0-11ef-4967-810a-d80ffc6d874f {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:35:39.296622 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-185f13a2-d06a-46d7-827c-426f175c7847 tempest-FloatingIPDetailsNegativeTestJSON-1351914578 tempest-FloatingIPDetailsNegativeTestJSON-1351914578-project] 10.222.0.33 "GET /compute/v2.1/os-floating-ips/34e5d7a0-11ef-4967-810a-d80ffc6d874f" status: 404 len: 111 microversion: 2.1 time: 0.539583 Oct 04 20:35:39.297719 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 307/603] 10.222.0.33 () {58 vars in 1260 bytes} [Tue Oct 4 20:35:38 2022] GET /compute/v2.1/os-floating-ips/34e5d7a0-11ef-4967-810a-d80ffc6d874f => generated 111 bytes in 541 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:35:39.308506 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-143728ab-bc91-42d1-940b-50b1ef88ca33 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:39.309583 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-143728ab-bc91-42d1-940b-50b1ef88ca33 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] [instance: c7f3bb5b-e08b-4a3f-ba4d-40012179412e] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:39.322163 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-143728ab-bc91-42d1-940b-50b1ef88ca33 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:39.323525 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-143728ab-bc91-42d1-940b-50b1ef88ca33 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:39.325313 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-143728ab-bc91-42d1-940b-50b1ef88ca33 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:39.330524 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-143728ab-bc91-42d1-940b-50b1ef88ca33 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:39.332740 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-143728ab-bc91-42d1-940b-50b1ef88ca33 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:39.334235 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-143728ab-bc91-42d1-940b-50b1ef88ca33 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:39.385543 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-7e5a7f74-b056-4d4c-b22e-260e0cd16d39 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a24944aeb34a5ea228965be9bf4ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c288268acb30475bbc065a8f72cb21d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:39.399006 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-7e5a7f74-b056-4d4c-b22e-260e0cd16d39 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] 10.222.0.33 "GET /compute/v2.1/servers/b3667992-a213-4da4-a172-8ab92ff3b2ca" status: 200 len: 1217 microversion: 2.1 time: 0.285947 Oct 04 20:35:39.401557 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 297/604] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:39 2022] GET /compute/v2.1/servers/b3667992-a213-4da4-a172-8ab92ff3b2ca => generated 1217 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:35:39.759374 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-3cd35a9b-9148-446d-a369-27d0b69a10ef tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:39.760424 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-3cd35a9b-9148-446d-a369-27d0b69a10ef tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] [instance: 486112b2-497b-4039-ac04-b23cf076d470] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:39.774775 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3cd35a9b-9148-446d-a369-27d0b69a10ef tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:39.775627 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3cd35a9b-9148-446d-a369-27d0b69a10ef tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:39.779954 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3cd35a9b-9148-446d-a369-27d0b69a10ef tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:39.782208 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3cd35a9b-9148-446d-a369-27d0b69a10ef tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:39.782711 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-143728ab-bc91-42d1-940b-50b1ef88ca33 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3563efe2b8c94931a2a46c4e14811b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3118a5d96843d3bede1ed94bd9717e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:39.783254 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3cd35a9b-9148-446d-a369-27d0b69a10ef tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:39.796258 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3cd35a9b-9148-446d-a369-27d0b69a10ef tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:39.811786 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-143728ab-bc91-42d1-940b-50b1ef88ca33 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] 10.222.0.33 "GET /compute/v2.1/servers/c7f3bb5b-e08b-4a3f-ba4d-40012179412e" status: 200 len: 1471 microversion: 2.1 time: 0.512581 Oct 04 20:35:39.814628 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 308/605] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:39 2022] GET /compute/v2.1/servers/c7f3bb5b-e08b-4a3f-ba4d-40012179412e => generated 1471 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:39.974368 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ceda0073-3ff3-48c4-9d00-a84a8660d04b tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:39.975322 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ceda0073-3ff3-48c4-9d00-a84a8660d04b tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] [instance: dd727dc7-96ee-4553-84ca-0f9b6ed59781] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:39.986108 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ceda0073-3ff3-48c4-9d00-a84a8660d04b tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:40.006989 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ceda0073-3ff3-48c4-9d00-a84a8660d04b tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:40.009200 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ceda0073-3ff3-48c4-9d00-a84a8660d04b tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:40.012365 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ceda0073-3ff3-48c4-9d00-a84a8660d04b tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:40.015075 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ceda0073-3ff3-48c4-9d00-a84a8660d04b tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:40.019192 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ceda0073-3ff3-48c4-9d00-a84a8660d04b tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:40.546648 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-3cd35a9b-9148-446d-a369-27d0b69a10ef tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f72b5b32ab457aaaa1c1ff7efdce5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ca732ccf4d417ab1f7ba82a9c8c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:40.557069 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-3cd35a9b-9148-446d-a369-27d0b69a10ef tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] 10.222.0.33 "GET /compute/v2.1/servers/486112b2-497b-4039-ac04-b23cf076d470" status: 200 len: 1542 microversion: 2.1 time: 0.803540 Oct 04 20:35:40.559649 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 298/606] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:39 2022] GET /compute/v2.1/servers/486112b2-497b-4039-ac04-b23cf076d470 => generated 1542 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:35:40.578187 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-125b8032-0880-4dc1-abe8-2dbee66d35d4 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:40.579649 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-125b8032-0880-4dc1-abe8-2dbee66d35d4 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] [instance: b3667992-a213-4da4-a172-8ab92ff3b2ca] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:40.619182 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-125b8032-0880-4dc1-abe8-2dbee66d35d4 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:40.621553 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-125b8032-0880-4dc1-abe8-2dbee66d35d4 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:40.622909 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-125b8032-0880-4dc1-abe8-2dbee66d35d4 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:40.625989 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-125b8032-0880-4dc1-abe8-2dbee66d35d4 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:40.626586 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-125b8032-0880-4dc1-abe8-2dbee66d35d4 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:40.627085 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-125b8032-0880-4dc1-abe8-2dbee66d35d4 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:41.060296 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-125b8032-0880-4dc1-abe8-2dbee66d35d4 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a24944aeb34a5ea228965be9bf4ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c288268acb30475bbc065a8f72cb21d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:41.069563 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-125b8032-0880-4dc1-abe8-2dbee66d35d4 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] 10.222.0.33 "GET /compute/v2.1/servers/b3667992-a213-4da4-a172-8ab92ff3b2ca" status: 200 len: 1273 microversion: 2.1 time: 0.508577 Oct 04 20:35:41.078678 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 299/607] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:40 2022] GET /compute/v2.1/servers/b3667992-a213-4da4-a172-8ab92ff3b2ca => generated 1273 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:41.094496 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-cd97e964-4479-4b26-8e90-ea57c4426afb tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:41.097020 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-cd97e964-4479-4b26-8e90-ea57c4426afb tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] [instance: c7f3bb5b-e08b-4a3f-ba4d-40012179412e] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:41.125639 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cd97e964-4479-4b26-8e90-ea57c4426afb tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:41.126137 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cd97e964-4479-4b26-8e90-ea57c4426afb tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:41.126611 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cd97e964-4479-4b26-8e90-ea57c4426afb tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:41.130761 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cd97e964-4479-4b26-8e90-ea57c4426afb tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:41.133134 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cd97e964-4479-4b26-8e90-ea57c4426afb tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:41.134543 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cd97e964-4479-4b26-8e90-ea57c4426afb tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:41.274164 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-ceda0073-3ff3-48c4-9d00-a84a8660d04b tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f051a291d59242469f8172a9c474ac89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f0707d756b4ee085a19cccf3ab82c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:41.296463 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ceda0073-3ff3-48c4-9d00-a84a8660d04b tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] 10.222.0.33 "GET /compute/v2.1/servers/dd727dc7-96ee-4553-84ca-0f9b6ed59781" status: 200 len: 1465 microversion: 2.1 time: 1.326597 Oct 04 20:35:41.297411 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 309/608] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:39 2022] GET /compute/v2.1/servers/dd727dc7-96ee-4553-84ca-0f9b6ed59781 => generated 1465 bytes in 1328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:41.592347 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9e5c42d7-c990-4855-bb3c-301208a086b4 tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:41.593062 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-9e5c42d7-c990-4855-bb3c-301208a086b4 tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] [instance: 486112b2-497b-4039-ac04-b23cf076d470] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:41.616575 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9e5c42d7-c990-4855-bb3c-301208a086b4 tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:41.617564 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9e5c42d7-c990-4855-bb3c-301208a086b4 tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:41.617996 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9e5c42d7-c990-4855-bb3c-301208a086b4 tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:41.618835 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9e5c42d7-c990-4855-bb3c-301208a086b4 tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:41.619287 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9e5c42d7-c990-4855-bb3c-301208a086b4 tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:41.619824 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9e5c42d7-c990-4855-bb3c-301208a086b4 tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:42.433613 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-cd97e964-4479-4b26-8e90-ea57c4426afb tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3563efe2b8c94931a2a46c4e14811b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3118a5d96843d3bede1ed94bd9717e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:42.474557 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-cd97e964-4479-4b26-8e90-ea57c4426afb tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] 10.222.0.33 "GET /compute/v2.1/servers/c7f3bb5b-e08b-4a3f-ba4d-40012179412e" status: 200 len: 1471 microversion: 2.1 time: 1.370460 Oct 04 20:35:42.477240 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 300/609] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:41 2022] GET /compute/v2.1/servers/c7f3bb5b-e08b-4a3f-ba4d-40012179412e => generated 1471 bytes in 1398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:42.484453 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-f201ab7a-399f-4ce8-97c5-bacaed7e38bc tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:42.485754 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-f201ab7a-399f-4ce8-97c5-bacaed7e38bc tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] [instance: b3667992-a213-4da4-a172-8ab92ff3b2ca] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:42.497453 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f201ab7a-399f-4ce8-97c5-bacaed7e38bc tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:42.500626 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f201ab7a-399f-4ce8-97c5-bacaed7e38bc tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:42.502278 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f201ab7a-399f-4ce8-97c5-bacaed7e38bc tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:42.503633 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f201ab7a-399f-4ce8-97c5-bacaed7e38bc tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:42.504313 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f201ab7a-399f-4ce8-97c5-bacaed7e38bc tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:42.505308 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f201ab7a-399f-4ce8-97c5-bacaed7e38bc tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:42.512102 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:35:42.702485 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-f201ab7a-399f-4ce8-97c5-bacaed7e38bc tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a24944aeb34a5ea228965be9bf4ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c288268acb30475bbc065a8f72cb21d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:42.713965 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-f201ab7a-399f-4ce8-97c5-bacaed7e38bc tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] 10.222.0.33 "GET /compute/v2.1/servers/b3667992-a213-4da4-a172-8ab92ff3b2ca" status: 200 len: 1271 microversion: 2.1 time: 0.234085 Oct 04 20:35:42.714615 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 301/610] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:42 2022] GET /compute/v2.1/servers/b3667992-a213-4da4-a172-8ab92ff3b2ca => generated 1271 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:42.735901 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-03aa5bd9-9aa9-4980-be31-06d17d35c9a6 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:42.736771 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-03aa5bd9-9aa9-4980-be31-06d17d35c9a6 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] [instance: dd727dc7-96ee-4553-84ca-0f9b6ed59781] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:42.747155 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-03aa5bd9-9aa9-4980-be31-06d17d35c9a6 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:42.751164 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-03aa5bd9-9aa9-4980-be31-06d17d35c9a6 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:42.751716 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-03aa5bd9-9aa9-4980-be31-06d17d35c9a6 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:42.752456 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-03aa5bd9-9aa9-4980-be31-06d17d35c9a6 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:42.752911 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-03aa5bd9-9aa9-4980-be31-06d17d35c9a6 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:42.754850 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-03aa5bd9-9aa9-4980-be31-06d17d35c9a6 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:42.835850 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-9e5c42d7-c990-4855-bb3c-301208a086b4 tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f72b5b32ab457aaaa1c1ff7efdce5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ca732ccf4d417ab1f7ba82a9c8c41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:42.849338 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-9e5c42d7-c990-4855-bb3c-301208a086b4 tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] 10.222.0.33 "GET /compute/v2.1/servers/486112b2-497b-4039-ac04-b23cf076d470" status: 200 len: 1542 microversion: 2.1 time: 1.268119 Oct 04 20:35:42.854650 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 310/611] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:41 2022] GET /compute/v2.1/servers/486112b2-497b-4039-ac04-b23cf076d470 => generated 1542 bytes in 1276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:35:42.873188 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-684a8edb-c3a6-403d-8691-44e3a545ea0a req-b9d8018e-4c8b-4732-b4ac-edf55a8bff06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "486112b2-497b-4039-ac04-b23cf076d470", "name": "network-vif-deleted", "tag": "b97b70cc-e857-429e-ad48-a973b62edd3e"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:35:42.898713 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-684a8edb-c3a6-403d-8691-44e3a545ea0a req-b9d8018e-4c8b-4732-b4ac-edf55a8bff06 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:42.901803 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-684a8edb-c3a6-403d-8691-44e3a545ea0a req-b9d8018e-4c8b-4732-b4ac-edf55a8bff06 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:42.903541 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-684a8edb-c3a6-403d-8691-44e3a545ea0a req-b9d8018e-4c8b-4732-b4ac-edf55a8bff06 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:42.935002 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-684a8edb-c3a6-403d-8691-44e3a545ea0a req-b9d8018e-4c8b-4732-b4ac-edf55a8bff06 service nova] Creating event network-vif-deleted:b97b70cc-e857-429e-ad48-a973b62edd3e for instance 486112b2-497b-4039-ac04-b23cf076d470 on n-h1-854823-8 Oct 04 20:35:42.950009 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-684a8edb-c3a6-403d-8691-44e3a545ea0a req-b9d8018e-4c8b-4732-b4ac-edf55a8bff06 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092228 Oct 04 20:35:42.959074 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 311/612] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:35:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:35:43.162232 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-03aa5bd9-9aa9-4980-be31-06d17d35c9a6 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f051a291d59242469f8172a9c474ac89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f0707d756b4ee085a19cccf3ab82c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:43.194378 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-03aa5bd9-9aa9-4980-be31-06d17d35c9a6 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] 10.222.0.33 "GET /compute/v2.1/servers/dd727dc7-96ee-4553-84ca-0f9b6ed59781" status: 200 len: 1465 microversion: 2.1 time: 0.466097 Oct 04 20:35:43.209185 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 302/613] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:42 2022] GET /compute/v2.1/servers/dd727dc7-96ee-4553-84ca-0f9b6ed59781 => generated 1465 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:43.502480 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-559c98ac-81ed-4d60-8be0-788845b9eb4e tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:43.503025 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-559c98ac-81ed-4d60-8be0-788845b9eb4e tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] [instance: c7f3bb5b-e08b-4a3f-ba4d-40012179412e] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:43.517538 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-559c98ac-81ed-4d60-8be0-788845b9eb4e tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:43.518032 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-559c98ac-81ed-4d60-8be0-788845b9eb4e tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:43.518545 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-559c98ac-81ed-4d60-8be0-788845b9eb4e tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:43.519188 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-559c98ac-81ed-4d60-8be0-788845b9eb4e tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:43.524805 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-559c98ac-81ed-4d60-8be0-788845b9eb4e tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:43.526538 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-559c98ac-81ed-4d60-8be0-788845b9eb4e tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:43.746903 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-36a84546-572a-44a9-bda6-9b53bbec8084 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:43.747689 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-36a84546-572a-44a9-bda6-9b53bbec8084 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] [instance: b3667992-a213-4da4-a172-8ab92ff3b2ca] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:43.784687 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-36a84546-572a-44a9-bda6-9b53bbec8084 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:43.785632 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-36a84546-572a-44a9-bda6-9b53bbec8084 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:43.786844 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-36a84546-572a-44a9-bda6-9b53bbec8084 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:43.787814 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-36a84546-572a-44a9-bda6-9b53bbec8084 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:43.789044 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-36a84546-572a-44a9-bda6-9b53bbec8084 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:43.789688 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-36a84546-572a-44a9-bda6-9b53bbec8084 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:44.173163 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-36a84546-572a-44a9-bda6-9b53bbec8084 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a24944aeb34a5ea228965be9bf4ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c288268acb30475bbc065a8f72cb21d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:44.184544 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-36a84546-572a-44a9-bda6-9b53bbec8084 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] 10.222.0.33 "GET /compute/v2.1/servers/b3667992-a213-4da4-a172-8ab92ff3b2ca" status: 200 len: 1271 microversion: 2.1 time: 0.448428 Oct 04 20:35:44.191404 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 303/614] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:43 2022] GET /compute/v2.1/servers/b3667992-a213-4da4-a172-8ab92ff3b2ca => generated 1271 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:44.203252 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-dac2a30f-ef22-4df9-885d-7cf9a5f66ec3 tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:44.204186 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-dac2a30f-ef22-4df9-885d-7cf9a5f66ec3 tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] [instance: 486112b2-497b-4039-ac04-b23cf076d470] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:44.222871 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dac2a30f-ef22-4df9-885d-7cf9a5f66ec3 tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:44.223543 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dac2a30f-ef22-4df9-885d-7cf9a5f66ec3 tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:44.224381 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dac2a30f-ef22-4df9-885d-7cf9a5f66ec3 tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:44.225464 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dac2a30f-ef22-4df9-885d-7cf9a5f66ec3 tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:44.226143 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dac2a30f-ef22-4df9-885d-7cf9a5f66ec3 tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:44.226823 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dac2a30f-ef22-4df9-885d-7cf9a5f66ec3 tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:44.255196 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-559c98ac-81ed-4d60-8be0-788845b9eb4e tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3563efe2b8c94931a2a46c4e14811b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3118a5d96843d3bede1ed94bd9717e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:44.265590 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-559c98ac-81ed-4d60-8be0-788845b9eb4e tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] 10.222.0.33 "GET /compute/v2.1/servers/c7f3bb5b-e08b-4a3f-ba4d-40012179412e" status: 200 len: 1471 microversion: 2.1 time: 0.768226 Oct 04 20:35:44.292205 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.wsgi [None req-dac2a30f-ef22-4df9-885d-7cf9a5f66ec3 tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] HTTP exception thrown: Instance 486112b2-497b-4039-ac04-b23cf076d470 could not be found. Oct 04 20:35:44.293905 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-dac2a30f-ef22-4df9-885d-7cf9a5f66ec3 tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] Request method failure captured: Oct 04 20:35:44.293905 n-d-854823-8 devstack@n-api.service[128802]: request: GET /compute/v2.1/servers/486112b2-497b-4039-ac04-b23cf076d470 HTTP/1.1 Oct 04 20:35:44.293905 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 20:35:44.293905 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 20:35:44.293905 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 20:35:44.293905 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 0 Oct 04 20:35:44.293905 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 20:35:44.293905 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 20:35:44.293905 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 20:35:44.293905 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 20:35:44.293905 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPJjo0ehgCcVLX9m4cw1-oibWoGlG_FZ6zY8pWR3yQddTBQSrtiDqa5aRmsThNvdRC_qNLxv5I7_CVnrkgu0ATHySIX6WJSOdYfvAiWZlOJBL-opPPgsRFwBwXiO-zU137gpGStP7Xj8gt9FNnb87K-zqXIQOjv7J6zBZeUoZGEuXPbs Oct 04 20:35:44.293905 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 20:35:44.293905 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 20:35:44.293905 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 20:35:44.293905 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 20:35:44.293905 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 20:35:44.293905 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 20:35:44.293905 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: b0ca732ccf4d417ab1f7ba82a9c8c41e Oct 04 20:35:44.293905 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-781358035 Oct 04 20:35:44.293905 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 20:35:44.293905 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 20:35:44.295454 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b0ca732ccf4d417ab1f7ba82a9c8c41e", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b0ca732ccf4d417ab1f7ba82a9c8c41e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b0ca732ccf4d417ab1f7ba82a9c8c41e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b0ca732ccf4d417ab1f7ba82a9c8c41e"}]}] Oct 04 20:35:44.295454 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-781358035 Oct 04 20:35:44.295454 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: b0ca732ccf4d417ab1f7ba82a9c8c41e Oct 04 20:35:44.295454 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-781358035 Oct 04 20:35:44.295454 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project Oct 04 20:35:44.295454 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 20:35:44.295454 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 20:35:44.295454 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: f8f72b5b32ab457aaaa1c1ff7efdce5c Oct 04 20:35:44.295454 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project Oct 04 20:35:44.295454 n-d-854823-8 devstack@n-api.service[128802]: method: > Oct 04 20:35:44.295454 n-d-854823-8 devstack@n-api.service[128802]: exception: Instance 486112b2-497b-4039-ac04-b23cf076d470 could not be found. Oct 04 20:35:44.296184 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'id': '486112b2-497b-4039-ac04-b23cf076d470'} Oct 04 20:35:44.296184 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:35:44.296184 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:35:44.296184 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:35:44.296184 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:35:44.296184 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:35:44.296184 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:35:44.296184 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:35:44.296184 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:35:44.296184 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:35:44.296184 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:35:44.296184 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 486112b2-497b-4039-ac04-b23cf076d470 could not be found. Oct 04 20:35:44.296184 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:35:44.296184 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:35:44.296184 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:35:44.296184 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:35:44.296184 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:35:44.296184 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:35:44.296184 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:35:44.296184 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:35:44.297463 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:35:44.297463 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:35:44.297463 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:35:44.297463 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:35:44.297463 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:35:44.297463 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:35:44.297463 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:35:44.297463 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:35:44.297463 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 486112b2-497b-4039-ac04-b23cf076d470 could not be found. Oct 04 20:35:44.297463 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:35:44.297463 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:35:44.297463 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:35:44.297463 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:35:44.297463 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:35:44.297463 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:35:44.297463 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:35:44.297463 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:35:44.297463 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 486112b2-497b-4039-ac04-b23cf076d470 could not be found. Oct 04 20:35:44.297463 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:35:44.298803 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 312/615] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:43 2022] GET /compute/v2.1/servers/c7f3bb5b-e08b-4a3f-ba4d-40012179412e => generated 1471 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:44.302888 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9eda7116-4367-432a-9ae0-4195cf65f9c4 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:44.304923 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-9eda7116-4367-432a-9ae0-4195cf65f9c4 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] [instance: dd727dc7-96ee-4553-84ca-0f9b6ed59781] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:44.307109 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-dac2a30f-ef22-4df9-885d-7cf9a5f66ec3 tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] Returning 404 to user: Instance 486112b2-497b-4039-ac04-b23cf076d470 could not be found. {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:35:44.328368 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-dac2a30f-ef22-4df9-885d-7cf9a5f66ec3 tempest-FloatingIPsAssociationNegativeTestJSON-781358035 tempest-FloatingIPsAssociationNegativeTestJSON-781358035-project] 10.222.0.33 "GET /compute/v2.1/servers/486112b2-497b-4039-ac04-b23cf076d470" status: 404 len: 111 microversion: 2.1 time: 0.135501 Oct 04 20:35:44.342634 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 304/616] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:44 2022] GET /compute/v2.1/servers/486112b2-497b-4039-ac04-b23cf076d470 => generated 111 bytes in 150 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:35:44.384695 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9eda7116-4367-432a-9ae0-4195cf65f9c4 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:44.386720 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9eda7116-4367-432a-9ae0-4195cf65f9c4 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:44.392272 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9eda7116-4367-432a-9ae0-4195cf65f9c4 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:44.393199 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9eda7116-4367-432a-9ae0-4195cf65f9c4 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:44.397898 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9eda7116-4367-432a-9ae0-4195cf65f9c4 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:44.398495 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9eda7116-4367-432a-9ae0-4195cf65f9c4 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:44.539712 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9eda7116-4367-432a-9ae0-4195cf65f9c4 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:44.557561 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9eda7116-4367-432a-9ae0-4195cf65f9c4 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:44.560036 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9eda7116-4367-432a-9ae0-4195cf65f9c4 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:44.563183 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-9eda7116-4367-432a-9ae0-4195cf65f9c4 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Lazy-loading 'fault' on Instance uuid dd727dc7-96ee-4553-84ca-0f9b6ed59781 {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:35:44.839061 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-9eda7116-4367-432a-9ae0-4195cf65f9c4 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f051a291d59242469f8172a9c474ac89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f0707d756b4ee085a19cccf3ab82c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:44.866657 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-9eda7116-4367-432a-9ae0-4195cf65f9c4 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] 10.222.0.33 "GET /compute/v2.1/servers/dd727dc7-96ee-4553-84ca-0f9b6ed59781" status: 200 len: 1308 microversion: 2.1 time: 0.570637 Oct 04 20:35:44.885123 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 313/617] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:44 2022] GET /compute/v2.1/servers/dd727dc7-96ee-4553-84ca-0f9b6ed59781 => generated 1308 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:45.048558 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-7cf8d652-5940-4d2b-9b92-d272ca203636 req-2fd11c57-5627-4c1b-ab44-b4e1df99b42f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd727dc7-96ee-4553-84ca-0f9b6ed59781", "name": "network-vif-deleted", "tag": "a00a0539-edd9-462f-b3eb-c0ff09e3dfb1"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:35:45.068166 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-7cf8d652-5940-4d2b-9b92-d272ca203636 req-2fd11c57-5627-4c1b-ab44-b4e1df99b42f service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:45.074365 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-7cf8d652-5940-4d2b-9b92-d272ca203636 req-2fd11c57-5627-4c1b-ab44-b4e1df99b42f service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:45.079473 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-7cf8d652-5940-4d2b-9b92-d272ca203636 req-2fd11c57-5627-4c1b-ab44-b4e1df99b42f service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:45.155221 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-7cf8d652-5940-4d2b-9b92-d272ca203636 req-2fd11c57-5627-4c1b-ab44-b4e1df99b42f service nova] Creating event network-vif-deleted:a00a0539-edd9-462f-b3eb-c0ff09e3dfb1 for instance dd727dc7-96ee-4553-84ca-0f9b6ed59781 on n-h2-854823-8 Oct 04 20:35:45.189649 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-7cf8d652-5940-4d2b-9b92-d272ca203636 req-2fd11c57-5627-4c1b-ab44-b4e1df99b42f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133305 Oct 04 20:35:45.190813 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 305/618] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:35:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:35:45.293884 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-c06ca9ce-6f9e-4f51-85a2-d7d362a24c54 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:45.294686 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-c06ca9ce-6f9e-4f51-85a2-d7d362a24c54 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] [instance: c7f3bb5b-e08b-4a3f-ba4d-40012179412e] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:45.312571 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c06ca9ce-6f9e-4f51-85a2-d7d362a24c54 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:45.314184 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c06ca9ce-6f9e-4f51-85a2-d7d362a24c54 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:45.315526 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c06ca9ce-6f9e-4f51-85a2-d7d362a24c54 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:45.321090 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c06ca9ce-6f9e-4f51-85a2-d7d362a24c54 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:45.322425 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-80b463bb-39a8-440f-b887-24278f9d9dd1 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:45.323156 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-80b463bb-39a8-440f-b887-24278f9d9dd1 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] [instance: b3667992-a213-4da4-a172-8ab92ff3b2ca] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:45.330502 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c06ca9ce-6f9e-4f51-85a2-d7d362a24c54 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:45.339142 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c06ca9ce-6f9e-4f51-85a2-d7d362a24c54 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:45.350165 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-80b463bb-39a8-440f-b887-24278f9d9dd1 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:45.350683 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-80b463bb-39a8-440f-b887-24278f9d9dd1 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:45.359445 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-80b463bb-39a8-440f-b887-24278f9d9dd1 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:45.363448 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-80b463bb-39a8-440f-b887-24278f9d9dd1 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:45.367913 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-80b463bb-39a8-440f-b887-24278f9d9dd1 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:45.371245 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-80b463bb-39a8-440f-b887-24278f9d9dd1 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:46.786455 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-80b463bb-39a8-440f-b887-24278f9d9dd1 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a24944aeb34a5ea228965be9bf4ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c288268acb30475bbc065a8f72cb21d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:46.801434 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-80b463bb-39a8-440f-b887-24278f9d9dd1 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] 10.222.0.33 "GET /compute/v2.1/servers/b3667992-a213-4da4-a172-8ab92ff3b2ca" status: 200 len: 1313 microversion: 2.1 time: 1.578751 Oct 04 20:35:46.802528 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 314/619] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:45 2022] GET /compute/v2.1/servers/b3667992-a213-4da4-a172-8ab92ff3b2ca => generated 1313 bytes in 1589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:46.807053 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-c06ca9ce-6f9e-4f51-85a2-d7d362a24c54 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3563efe2b8c94931a2a46c4e14811b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3118a5d96843d3bede1ed94bd9717e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:46.818242 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-c06ca9ce-6f9e-4f51-85a2-d7d362a24c54 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] 10.222.0.33 "GET /compute/v2.1/servers/c7f3bb5b-e08b-4a3f-ba4d-40012179412e" status: 200 len: 1476 microversion: 2.1 time: 1.529423 Oct 04 20:35:46.846376 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 306/620] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:45 2022] GET /compute/v2.1/servers/c7f3bb5b-e08b-4a3f-ba4d-40012179412e => generated 1476 bytes in 1558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:46.855879 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9dde7d60-b9d7-41e4-81dd-338cd259f43c tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:46.858145 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-9dde7d60-b9d7-41e4-81dd-338cd259f43c tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] [instance: dd727dc7-96ee-4553-84ca-0f9b6ed59781] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:46.875351 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:35:46.880222 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9dde7d60-b9d7-41e4-81dd-338cd259f43c tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:46.884072 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9dde7d60-b9d7-41e4-81dd-338cd259f43c tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:46.884739 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9dde7d60-b9d7-41e4-81dd-338cd259f43c tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:46.885493 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9dde7d60-b9d7-41e4-81dd-338cd259f43c tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:46.887867 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9dde7d60-b9d7-41e4-81dd-338cd259f43c tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:46.894306 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9dde7d60-b9d7-41e4-81dd-338cd259f43c tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:46.947032 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell0:SELECT=2 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:35:46.967654 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-9dde7d60-b9d7-41e4-81dd-338cd259f43c tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] HTTP exception thrown: Instance dd727dc7-96ee-4553-84ca-0f9b6ed59781 could not be found. Oct 04 20:35:46.972216 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9dde7d60-b9d7-41e4-81dd-338cd259f43c tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Request method failure captured: Oct 04 20:35:46.972216 n-d-854823-8 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/dd727dc7-96ee-4553-84ca-0f9b6ed59781 HTTP/1.1 Oct 04 20:35:46.972216 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:35:46.972216 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:35:46.972216 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:35:46.972216 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 0 Oct 04 20:35:46.972216 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:35:46.972216 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:35:46.972216 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:35:46.972216 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:35:46.972216 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJjhIXZluEqDIBCEd_KoSb0NnfYYYAvqrGCZ7y6fe3fjYo-cdz7bv8Tn8dReWqdqMbxC6DqaahObWu6Sdy0ApulXxVya9AhEbpGmDzRnoDiiBZvCT0Zd4BqqyzNtbYYngH_Vi7gNfJ8WGUmMea-_FhBudizSU5whTyveE5GLtekT0WU Oct 04 20:35:46.972216 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:35:46.972216 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:35:46.972216 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:35:46.972216 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:35:46.972216 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:35:46.972216 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:35:46.972216 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: 18f0707d756b4ee085a19cccf3ab82c0 Oct 04 20:35:46.972216 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-LiveMigrationNegativeTest-564528865 Oct 04 20:35:46.972216 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 20:35:46.972216 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 20:35:46.973812 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_18f0707d756b4ee085a19cccf3ab82c0", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/18f0707d756b4ee085a19cccf3ab82c0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/18f0707d756b4ee085a19cccf3ab82c0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/18f0707d756b4ee085a19cccf3ab82c0"}]}] Oct 04 20:35:46.973812 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-LiveMigrationNegativeTest-564528865 Oct 04 20:35:46.973812 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: 18f0707d756b4ee085a19cccf3ab82c0 Oct 04 20:35:46.973812 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-564528865 Oct 04 20:35:46.973812 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-LiveMigrationNegativeTest-564528865-project Oct 04 20:35:46.973812 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:35:46.973812 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:35:46.973812 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: f051a291d59242469f8172a9c474ac89 Oct 04 20:35:46.973812 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-LiveMigrationNegativeTest-564528865-project Oct 04 20:35:46.973812 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 20:35:46.973812 n-d-854823-8 devstack@n-api.service[128801]: exception: Instance dd727dc7-96ee-4553-84ca-0f9b6ed59781 could not be found. Oct 04 20:35:46.973812 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': 'dd727dc7-96ee-4553-84ca-0f9b6ed59781'} Oct 04 20:35:46.974675 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:35:46.974675 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:35:46.974675 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:35:46.974675 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:35:46.974675 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:35:46.974675 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:35:46.974675 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:35:46.974675 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:35:46.974675 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:35:46.974675 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:35:46.974675 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd727dc7-96ee-4553-84ca-0f9b6ed59781 could not be found. Oct 04 20:35:46.974675 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:35:46.974675 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:35:46.974675 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:35:46.974675 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:35:46.974675 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:35:46.974675 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:35:46.974675 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:35:46.974675 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:35:46.974675 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:35:46.976608 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:35:46.976608 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:35:46.976608 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:35:46.976608 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:35:46.976608 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:35:46.976608 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:35:46.976608 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:35:46.976608 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd727dc7-96ee-4553-84ca-0f9b6ed59781 could not be found. Oct 04 20:35:46.976608 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:35:46.976608 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:35:46.976608 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:35:46.976608 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:35:46.976608 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:35:46.976608 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:35:46.976608 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:35:46.976608 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:35:46.976608 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd727dc7-96ee-4553-84ca-0f9b6ed59781 could not be found. Oct 04 20:35:46.976608 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:35:46.989022 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9dde7d60-b9d7-41e4-81dd-338cd259f43c tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Returning 404 to user: Instance dd727dc7-96ee-4553-84ca-0f9b6ed59781 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:35:46.990399 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-9dde7d60-b9d7-41e4-81dd-338cd259f43c tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] 10.222.0.33 "GET /compute/v2.1/servers/dd727dc7-96ee-4553-84ca-0f9b6ed59781" status: 404 len: 111 microversion: 2.1 time: 0.186841 Oct 04 20:35:46.991170 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 315/621] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:46 2022] GET /compute/v2.1/servers/dd727dc7-96ee-4553-84ca-0f9b6ed59781 => generated 111 bytes in 188 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:35:47.005525 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b97a1796-e87e-4569-85cd-ba183c21671b tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:47.009866 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b97a1796-e87e-4569-85cd-ba183c21671b tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] [instance: 3961b3f4-aea9-4997-85aa-336b3f902533] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:47.032874 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b97a1796-e87e-4569-85cd-ba183c21671b tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:47.040284 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b97a1796-e87e-4569-85cd-ba183c21671b tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:47.046136 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b97a1796-e87e-4569-85cd-ba183c21671b tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:47.047143 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b97a1796-e87e-4569-85cd-ba183c21671b tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:47.047780 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b97a1796-e87e-4569-85cd-ba183c21671b tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:47.048367 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b97a1796-e87e-4569-85cd-ba183c21671b tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:47.146871 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b97a1796-e87e-4569-85cd-ba183c21671b tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] [instance: 3961b3f4-aea9-4997-85aa-336b3f902533] Going to try to terminate instance {{(pid=128801) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:35:47.246632 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-68c114f7-07d9-461b-b04b-83da780e461c tempest-HostsAdminNegativeTestJSON-1067884877 tempest-HostsAdminNegativeTestJSON-1067884877-project-admin] Calling method '.version_select at 0x7f3c74c00820>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:47.251717 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-68c114f7-07d9-461b-b04b-83da780e461c tempest-HostsAdminNegativeTestJSON-1067884877 tempest-HostsAdminNegativeTestJSON-1067884877-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:47.255148 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-68c114f7-07d9-461b-b04b-83da780e461c tempest-HostsAdminNegativeTestJSON-1067884877 tempest-HostsAdminNegativeTestJSON-1067884877-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:47.255816 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-68c114f7-07d9-461b-b04b-83da780e461c tempest-HostsAdminNegativeTestJSON-1067884877 tempest-HostsAdminNegativeTestJSON-1067884877-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:47.257960 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-68c114f7-07d9-461b-b04b-83da780e461c tempest-HostsAdminNegativeTestJSON-1067884877 tempest-HostsAdminNegativeTestJSON-1067884877-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:47.261164 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-68c114f7-07d9-461b-b04b-83da780e461c tempest-HostsAdminNegativeTestJSON-1067884877 tempest-HostsAdminNegativeTestJSON-1067884877-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:47.263580 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-68c114f7-07d9-461b-b04b-83da780e461c tempest-HostsAdminNegativeTestJSON-1067884877 tempest-HostsAdminNegativeTestJSON-1067884877-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:47.346955 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-68c114f7-07d9-461b-b04b-83da780e461c tempest-HostsAdminNegativeTestJSON-1067884877 tempest-HostsAdminNegativeTestJSON-1067884877-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.495374 Oct 04 20:35:47.357111 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 307/622] 10.222.0.33 () {58 vars in 1128 bytes} [Tue Oct 4 20:35:46 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:35:47.397096 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b97a1796-e87e-4569-85cd-ba183c21671b tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] 10.222.0.33 "DELETE /compute/v2.1/servers/3961b3f4-aea9-4997-85aa-336b3f902533" status: 204 len: 0 microversion: 2.1 time: 0.400457 Oct 04 20:35:47.398057 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 316/623] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 20:35:46 2022] DELETE /compute/v2.1/servers/3961b3f4-aea9-4997-85aa-336b3f902533 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 20:35:47.407271 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a415237b-d638-4712-b3b3-cdc2f0e50d4d tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:47.412267 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a415237b-d638-4712-b3b3-cdc2f0e50d4d tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] [instance: 3961b3f4-aea9-4997-85aa-336b3f902533] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:47.432248 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a415237b-d638-4712-b3b3-cdc2f0e50d4d tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:47.433214 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a415237b-d638-4712-b3b3-cdc2f0e50d4d tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:47.433917 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a415237b-d638-4712-b3b3-cdc2f0e50d4d tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:47.435501 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a415237b-d638-4712-b3b3-cdc2f0e50d4d tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:47.436183 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a415237b-d638-4712-b3b3-cdc2f0e50d4d tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:47.436819 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a415237b-d638-4712-b3b3-cdc2f0e50d4d tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:47.657981 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-297f992f-a7da-4e50-9b24-2287be88b25e tempest-HostsAdminNegativeTestJSON-80887090 tempest-HostsAdminNegativeTestJSON-80887090-project] Calling method '.version_select at 0x7f3c74b42550>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:47.661790 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-297f992f-a7da-4e50-9b24-2287be88b25e tempest-HostsAdminNegativeTestJSON-80887090 tempest-HostsAdminNegativeTestJSON-80887090-project] Policy check for os_compute_api:os-hosts:list failed with credentials {'is_admin': False, 'user_id': '93c85bfeb3af4b6e951e4332d004e11b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b35a9377bed451a82898e34c5f4c2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:47.664369 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-297f992f-a7da-4e50-9b24-2287be88b25e tempest-HostsAdminNegativeTestJSON-80887090 tempest-HostsAdminNegativeTestJSON-80887090-project] Request method failure captured: Oct 04 20:35:47.664369 n-d-854823-8 devstack@n-api.service[128802]: request: GET /compute/v2.1/os-hosts HTTP/1.1 Oct 04 20:35:47.664369 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 20:35:47.664369 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 20:35:47.664369 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 20:35:47.664369 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 0 Oct 04 20:35:47.664369 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 20:35:47.664369 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 20:35:47.664369 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 20:35:47.664369 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 20:35:47.664369 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPJkgCqfYODGanDYgjyL_CvXUcBG1ILDOeHyjikY-CyydYP7flimH0iBxbWuME0rBFXc5Ij7uiQBJj8d8gulCFX2hy0m0Td49zMAkOPDBies0F1BRliqO3AYPcOvc4ZJB4GmWkbYP4OHHrlBBL5vNOpXVNw0qKL-4UpFiDVrLOoc4jMk Oct 04 20:35:47.664369 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 20:35:47.664369 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 20:35:47.664369 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 20:35:47.664369 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 20:35:47.664369 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 20:35:47.664369 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 20:35:47.664369 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: 5b35a9377bed451a82898e34c5f4c2ea Oct 04 20:35:47.664369 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-80887090 Oct 04 20:35:47.664369 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 20:35:47.664369 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 20:35:47.666177 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5b35a9377bed451a82898e34c5f4c2ea", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5b35a9377bed451a82898e34c5f4c2ea"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5b35a9377bed451a82898e34c5f4c2ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5b35a9377bed451a82898e34c5f4c2ea"}]}] Oct 04 20:35:47.666177 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-HostsAdminNegativeTestJSON-80887090 Oct 04 20:35:47.666177 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: 5b35a9377bed451a82898e34c5f4c2ea Oct 04 20:35:47.666177 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-80887090 Oct 04 20:35:47.666177 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-HostsAdminNegativeTestJSON-80887090-project Oct 04 20:35:47.666177 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 20:35:47.666177 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 20:35:47.666177 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: 93c85bfeb3af4b6e951e4332d004e11b Oct 04 20:35:47.666177 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-HostsAdminNegativeTestJSON-80887090-project Oct 04 20:35:47.666177 n-d-854823-8 devstack@n-api.service[128802]: method: Oct 04 20:35:47.666177 n-d-854823-8 devstack@n-api.service[128802]: exception: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Oct 04 20:35:47.666177 n-d-854823-8 devstack@n-api.service[128802]: action_args: {} Oct 04 20:35:47.666177 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:35:47.667007 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:35:47.667007 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:35:47.667007 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:35:47.667007 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:35:47.667007 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:35:47.667007 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:35:47.667007 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:35:47.667007 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 20:35:47.667007 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:35:47.667007 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:35:47.667007 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:35:47.667007 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 74, in index Oct 04 20:35:47.667007 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'list', Oct 04 20:35:47.667007 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 20:35:47.667007 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 20:35:47.667007 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 20:35:47.667007 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 20:35:47.667007 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 20:35:47.667007 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 20:35:47.669036 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 20:35:47.669036 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 20:35:47.669036 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 20:35:47.669036 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 20:35:47.669036 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 20:35:47.669036 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 20:35:47.669036 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 20:35:47.669036 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 20:35:47.669036 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Oct 04 20:35:47.669036 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:35:47.669036 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:35:47.669036 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:35:47.669036 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:35:47.669036 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:35:47.669036 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:35:47.669036 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 20:35:47.669036 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 20:35:47.669036 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Oct 04 20:35:47.669036 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:35:47.671598 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-297f992f-a7da-4e50-9b24-2287be88b25e tempest-HostsAdminNegativeTestJSON-80887090 tempest-HostsAdminNegativeTestJSON-80887090-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:list to be performed. {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:35:47.686950 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-297f992f-a7da-4e50-9b24-2287be88b25e tempest-HostsAdminNegativeTestJSON-80887090 tempest-HostsAdminNegativeTestJSON-80887090-project] 10.222.0.33 "GET /compute/v2.1/os-hosts" status: 403 len: 109 microversion: 2.1 time: 0.305093 Oct 04 20:35:47.691992 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 308/624] 10.222.0.33 () {58 vars in 1128 bytes} [Tue Oct 4 20:35:47 2022] GET /compute/v2.1/os-hosts => generated 109 bytes in 334 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:35:47.712253 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-5b764d32-fbdb-4223-a839-04d2ce8e831c tempest-HostsAdminNegativeTestJSON-80887090 tempest-HostsAdminNegativeTestJSON-80887090-project] Calling method '.version_select at 0x7f3c74b51d30>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:47.714439 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-5b764d32-fbdb-4223-a839-04d2ce8e831c tempest-HostsAdminNegativeTestJSON-80887090 tempest-HostsAdminNegativeTestJSON-80887090-project] Policy check for os_compute_api:os-hosts:reboot failed with credentials {'is_admin': False, 'user_id': '93c85bfeb3af4b6e951e4332d004e11b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b35a9377bed451a82898e34c5f4c2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:47.720155 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-5b764d32-fbdb-4223-a839-04d2ce8e831c tempest-HostsAdminNegativeTestJSON-80887090 tempest-HostsAdminNegativeTestJSON-80887090-project] Request method failure captured: Oct 04 20:35:47.720155 n-d-854823-8 devstack@n-api.service[128802]: request: GET /compute/v2.1/os-hosts/n-d-854823-8/reboot HTTP/1.1 Oct 04 20:35:47.720155 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 20:35:47.720155 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 20:35:47.720155 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 20:35:47.720155 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 0 Oct 04 20:35:47.720155 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 20:35:47.720155 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 20:35:47.720155 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 20:35:47.720155 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 20:35:47.720155 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPJkgCqfYODGanDYgjyL_CvXUcBG1ILDOeHyjikY-CyydYP7flimH0iBxbWuME0rBFXc5Ij7uiQBJj8d8gulCFX2hy0m0Td49zMAkOPDBies0F1BRliqO3AYPcOvc4ZJB4GmWkbYP4OHHrlBBL5vNOpXVNw0qKL-4UpFiDVrLOoc4jMk Oct 04 20:35:47.720155 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 20:35:47.720155 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 20:35:47.720155 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 20:35:47.720155 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 20:35:47.720155 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 20:35:47.720155 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 20:35:47.720155 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: 5b35a9377bed451a82898e34c5f4c2ea Oct 04 20:35:47.720155 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-80887090 Oct 04 20:35:47.720155 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 20:35:47.720155 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 20:35:47.721620 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5b35a9377bed451a82898e34c5f4c2ea", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5b35a9377bed451a82898e34c5f4c2ea"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5b35a9377bed451a82898e34c5f4c2ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5b35a9377bed451a82898e34c5f4c2ea"}]}] Oct 04 20:35:47.721620 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-HostsAdminNegativeTestJSON-80887090 Oct 04 20:35:47.721620 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: 5b35a9377bed451a82898e34c5f4c2ea Oct 04 20:35:47.721620 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-80887090 Oct 04 20:35:47.721620 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-HostsAdminNegativeTestJSON-80887090-project Oct 04 20:35:47.721620 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 20:35:47.721620 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 20:35:47.721620 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: 93c85bfeb3af4b6e951e4332d004e11b Oct 04 20:35:47.721620 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-HostsAdminNegativeTestJSON-80887090-project Oct 04 20:35:47.721620 n-d-854823-8 devstack@n-api.service[128802]: method: Oct 04 20:35:47.721620 n-d-854823-8 devstack@n-api.service[128802]: exception: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Oct 04 20:35:47.721620 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'id': 'n-d-854823-8'} Oct 04 20:35:47.721620 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:35:47.723167 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:35:47.723167 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:35:47.723167 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:35:47.723167 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:35:47.723167 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:35:47.723167 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:35:47.723167 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:35:47.723167 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:35:47.723167 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:35:47.723167 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 203, in reboot Oct 04 20:35:47.723167 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'reboot', Oct 04 20:35:47.723167 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 20:35:47.723167 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 20:35:47.723167 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 20:35:47.723167 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 20:35:47.723167 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 20:35:47.723167 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 20:35:47.723167 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 20:35:47.723167 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 20:35:47.724786 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 20:35:47.724786 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 20:35:47.724786 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 20:35:47.724786 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 20:35:47.724786 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 20:35:47.724786 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 20:35:47.724786 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Oct 04 20:35:47.724786 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:35:47.724786 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:35:47.724786 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:35:47.724786 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:35:47.724786 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:35:47.724786 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:35:47.724786 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 20:35:47.724786 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 20:35:47.724786 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Oct 04 20:35:47.724786 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:35:47.727967 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-5b764d32-fbdb-4223-a839-04d2ce8e831c tempest-HostsAdminNegativeTestJSON-80887090 tempest-HostsAdminNegativeTestJSON-80887090-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:35:47.727967 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-5b764d32-fbdb-4223-a839-04d2ce8e831c tempest-HostsAdminNegativeTestJSON-80887090 tempest-HostsAdminNegativeTestJSON-80887090-project] 10.222.0.33 "GET /compute/v2.1/os-hosts/n-d-854823-8/reboot" status: 403 len: 111 microversion: 2.1 time: 0.018051 Oct 04 20:35:47.729292 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 309/625] 10.222.0.33 () {58 vars in 1188 bytes} [Tue Oct 4 20:35:47 2022] GET /compute/v2.1/os-hosts/n-d-854823-8/reboot => generated 111 bytes in 26 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:35:47.745430 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-a459466c-b6fd-47d9-844c-322d09808854 tempest-HostsAdminNegativeTestJSON-1067884877 tempest-HostsAdminNegativeTestJSON-1067884877-project-admin] Calling method '.version_select at 0x7f3c74dba8b0>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:47.763461 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.wsgi [None req-a459466c-b6fd-47d9-844c-322d09808854 tempest-HostsAdminNegativeTestJSON-1067884877 tempest-HostsAdminNegativeTestJSON-1067884877-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 20:35:47.765610 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-a459466c-b6fd-47d9-844c-322d09808854 tempest-HostsAdminNegativeTestJSON-1067884877 tempest-HostsAdminNegativeTestJSON-1067884877-project-admin] Request method failure captured: Oct 04 20:35:47.765610 n-d-854823-8 devstack@n-api.service[128802]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot HTTP/1.1 Oct 04 20:35:47.765610 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 20:35:47.765610 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 20:35:47.765610 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 20:35:47.765610 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 0 Oct 04 20:35:47.765610 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 20:35:47.765610 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 20:35:47.765610 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 20:35:47.765610 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 20:35:47.765610 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPJkigceXIfRmiaBbp7zgfTtb3Dpo3EwgGgux0KFoNRbjLPuDOS8cTS7kRqNKrbJRfIAFTlvbZ7oFghK2LrAK2PpRMzCz2ANGdxFZ-zznn6TGeG19qvcWoqW3tp38JvtrhvIeaOWIyFeJbzPhumxq85xXGFwChq70r4Z0bWc5oSY0-Yc Oct 04 20:35:47.765610 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 20:35:47.765610 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 20:35:47.765610 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 20:35:47.765610 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 20:35:47.765610 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 20:35:47.765610 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 20:35:47.765610 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: 0b75e00a1f0d471b8d0e80e62dff45eb Oct 04 20:35:47.765610 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1067884877 Oct 04 20:35:47.765610 n-d-854823-8 devstack@n-api.service[128802]: X-Role: admin,reader,member Oct 04 20:35:47.765610 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: admin,reader,member Oct 04 20:35:47.766875 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0b75e00a1f0d471b8d0e80e62dff45eb", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0b75e00a1f0d471b8d0e80e62dff45eb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0b75e00a1f0d471b8d0e80e62dff45eb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0b75e00a1f0d471b8d0e80e62dff45eb"}]}] Oct 04 20:35:47.766875 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1067884877 Oct 04 20:35:47.766875 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: 0b75e00a1f0d471b8d0e80e62dff45eb Oct 04 20:35:47.766875 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1067884877 Oct 04 20:35:47.766875 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-HostsAdminNegativeTestJSON-1067884877-project-admin Oct 04 20:35:47.766875 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 20:35:47.766875 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 20:35:47.766875 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: e8e9d115d6a24b1598a800757fb63c28 Oct 04 20:35:47.766875 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1067884877-project-admin Oct 04 20:35:47.766875 n-d-854823-8 devstack@n-api.service[128802]: method: Oct 04 20:35:47.766875 n-d-854823-8 devstack@n-api.service[128802]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 20:35:47.766875 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'id': 'nonexistent_hostname'} Oct 04 20:35:47.766875 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:35:47.767630 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:35:47.767630 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Oct 04 20:35:47.767630 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Oct 04 20:35:47.767630 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 04 20:35:47.767630 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 04 20:35:47.767630 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 20:35:47.767630 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 20:35:47.767630 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 20:35:47.767630 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 20:35:47.767630 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 04 20:35:47.767630 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 04 20:35:47.767630 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 04 20:35:47.767630 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 04 20:35:47.767630 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 20:35:47.767630 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 20:35:47.767630 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 04 20:35:47.767630 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 04 20:35:47.767630 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 20:35:47.767630 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 20:35:47.768750 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 04 20:35:47.768750 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 04 20:35:47.768750 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 20:35:47.768750 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:35:47.768750 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:35:47.768750 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:35:47.768750 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:35:47.768750 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:35:47.768750 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:35:47.768750 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:35:47.768750 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:35:47.768750 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:35:47.768750 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:35:47.768750 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:35:47.768750 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:35:47.768750 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 205, in reboot Oct 04 20:35:47.768750 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="reboot") Oct 04 20:35:47.768750 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Oct 04 20:35:47.768750 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:35:47.769811 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 20:35:47.769811 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:35:47.769811 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:35:47.769811 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:35:47.769811 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:35:47.769811 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:35:47.769811 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:35:47.769811 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:35:47.769811 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:35:47.769811 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 20:35:47.769811 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:35:47.772211 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-a459466c-b6fd-47d9-844c-322d09808854 tempest-HostsAdminNegativeTestJSON-1067884877 tempest-HostsAdminNegativeTestJSON-1067884877-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:35:47.774133 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-a459466c-b6fd-47d9-844c-322d09808854 tempest-HostsAdminNegativeTestJSON-1067884877 tempest-HostsAdminNegativeTestJSON-1067884877-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot" status: 404 len: 99 microversion: 2.1 time: 0.042833 Oct 04 20:35:47.783423 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 310/626] 10.222.0.33 () {58 vars in 1212 bytes} [Tue Oct 4 20:35:47 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot => generated 99 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 20:35:47.792811 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-d9af5e30-f5d5-4036-b54b-4232cc5e18b7 tempest-HostsAdminNegativeTestJSON-80887090 tempest-HostsAdminNegativeTestJSON-80887090-project] Calling method '.version_select at 0x7f3c74c74160>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:47.798043 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-d9af5e30-f5d5-4036-b54b-4232cc5e18b7 tempest-HostsAdminNegativeTestJSON-80887090 tempest-HostsAdminNegativeTestJSON-80887090-project] Policy check for os_compute_api:os-hosts:show failed with credentials {'is_admin': False, 'user_id': '93c85bfeb3af4b6e951e4332d004e11b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b35a9377bed451a82898e34c5f4c2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:47.804388 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-d9af5e30-f5d5-4036-b54b-4232cc5e18b7 tempest-HostsAdminNegativeTestJSON-80887090 tempest-HostsAdminNegativeTestJSON-80887090-project] Request method failure captured: Oct 04 20:35:47.804388 n-d-854823-8 devstack@n-api.service[128802]: request: GET /compute/v2.1/os-hosts/n-d-854823-8 HTTP/1.1 Oct 04 20:35:47.804388 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 20:35:47.804388 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 20:35:47.804388 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 20:35:47.804388 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 0 Oct 04 20:35:47.804388 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 20:35:47.804388 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 20:35:47.804388 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 20:35:47.804388 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 20:35:47.804388 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPJkgCqfYODGanDYgjyL_CvXUcBG1ILDOeHyjikY-CyydYP7flimH0iBxbWuME0rBFXc5Ij7uiQBJj8d8gulCFX2hy0m0Td49zMAkOPDBies0F1BRliqO3AYPcOvc4ZJB4GmWkbYP4OHHrlBBL5vNOpXVNw0qKL-4UpFiDVrLOoc4jMk Oct 04 20:35:47.804388 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 20:35:47.804388 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 20:35:47.804388 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 20:35:47.804388 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 20:35:47.804388 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 20:35:47.804388 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 20:35:47.804388 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: 5b35a9377bed451a82898e34c5f4c2ea Oct 04 20:35:47.804388 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-80887090 Oct 04 20:35:47.804388 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 20:35:47.804388 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 20:35:47.805845 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5b35a9377bed451a82898e34c5f4c2ea", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5b35a9377bed451a82898e34c5f4c2ea"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5b35a9377bed451a82898e34c5f4c2ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5b35a9377bed451a82898e34c5f4c2ea"}]}] Oct 04 20:35:47.805845 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-HostsAdminNegativeTestJSON-80887090 Oct 04 20:35:47.805845 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: 5b35a9377bed451a82898e34c5f4c2ea Oct 04 20:35:47.805845 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-80887090 Oct 04 20:35:47.805845 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-HostsAdminNegativeTestJSON-80887090-project Oct 04 20:35:47.805845 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 20:35:47.805845 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 20:35:47.805845 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: 93c85bfeb3af4b6e951e4332d004e11b Oct 04 20:35:47.805845 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-HostsAdminNegativeTestJSON-80887090-project Oct 04 20:35:47.805845 n-d-854823-8 devstack@n-api.service[128802]: method: Oct 04 20:35:47.805845 n-d-854823-8 devstack@n-api.service[128802]: exception: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Oct 04 20:35:47.805845 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'id': 'n-d-854823-8'} Oct 04 20:35:47.805845 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:35:47.806725 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:35:47.806725 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:35:47.806725 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:35:47.806725 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:35:47.806725 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:35:47.806725 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:35:47.806725 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:35:47.806725 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:35:47.806725 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:35:47.806725 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 270, in show Oct 04 20:35:47.806725 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'show', Oct 04 20:35:47.806725 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 20:35:47.806725 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 20:35:47.806725 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 20:35:47.806725 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 20:35:47.806725 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 20:35:47.806725 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 20:35:47.806725 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 20:35:47.806725 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 20:35:47.808246 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 20:35:47.808246 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 20:35:47.808246 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 20:35:47.808246 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 20:35:47.808246 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 20:35:47.808246 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 20:35:47.808246 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Oct 04 20:35:47.808246 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:35:47.808246 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:35:47.808246 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:35:47.808246 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:35:47.808246 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:35:47.808246 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:35:47.808246 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 20:35:47.808246 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 20:35:47.808246 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Oct 04 20:35:47.808246 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:35:47.810768 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-d9af5e30-f5d5-4036-b54b-4232cc5e18b7 tempest-HostsAdminNegativeTestJSON-80887090 tempest-HostsAdminNegativeTestJSON-80887090-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:show to be performed. {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:35:47.811855 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-d9af5e30-f5d5-4036-b54b-4232cc5e18b7 tempest-HostsAdminNegativeTestJSON-80887090 tempest-HostsAdminNegativeTestJSON-80887090-project] 10.222.0.33 "GET /compute/v2.1/os-hosts/n-d-854823-8" status: 403 len: 109 microversion: 2.1 time: 0.027149 Oct 04 20:35:47.818643 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 311/627] 10.222.0.33 () {58 vars in 1167 bytes} [Tue Oct 4 20:35:47 2022] GET /compute/v2.1/os-hosts/n-d-854823-8 => generated 109 bytes in 34 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:35:47.824051 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-10f27517-b7cc-48bc-bd16-ec64c41deb45 tempest-HostsAdminNegativeTestJSON-1067884877 tempest-HostsAdminNegativeTestJSON-1067884877-project-admin] Calling method '.version_select at 0x7f3c74b42430>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:47.843106 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.wsgi [None req-10f27517-b7cc-48bc-bd16-ec64c41deb45 tempest-HostsAdminNegativeTestJSON-1067884877 tempest-HostsAdminNegativeTestJSON-1067884877-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 20:35:47.845088 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-10f27517-b7cc-48bc-bd16-ec64c41deb45 tempest-HostsAdminNegativeTestJSON-1067884877 tempest-HostsAdminNegativeTestJSON-1067884877-project-admin] Request method failure captured: Oct 04 20:35:47.845088 n-d-854823-8 devstack@n-api.service[128802]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Oct 04 20:35:47.845088 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 20:35:47.845088 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 20:35:47.845088 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 20:35:47.845088 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 0 Oct 04 20:35:47.845088 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 20:35:47.845088 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 20:35:47.845088 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 20:35:47.845088 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 20:35:47.845088 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPJkigceXIfRmiaBbp7zgfTtb3Dpo3EwgGgux0KFoNRbjLPuDOS8cTS7kRqNKrbJRfIAFTlvbZ7oFghK2LrAK2PpRMzCz2ANGdxFZ-zznn6TGeG19qvcWoqW3tp38JvtrhvIeaOWIyFeJbzPhumxq85xXGFwChq70r4Z0bWc5oSY0-Yc Oct 04 20:35:47.845088 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 20:35:47.845088 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 20:35:47.845088 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 20:35:47.845088 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 20:35:47.845088 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 20:35:47.845088 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 20:35:47.845088 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: 0b75e00a1f0d471b8d0e80e62dff45eb Oct 04 20:35:47.845088 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1067884877 Oct 04 20:35:47.845088 n-d-854823-8 devstack@n-api.service[128802]: X-Role: admin,reader,member Oct 04 20:35:47.845088 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: admin,reader,member Oct 04 20:35:47.846300 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0b75e00a1f0d471b8d0e80e62dff45eb", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0b75e00a1f0d471b8d0e80e62dff45eb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0b75e00a1f0d471b8d0e80e62dff45eb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0b75e00a1f0d471b8d0e80e62dff45eb"}]}] Oct 04 20:35:47.846300 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1067884877 Oct 04 20:35:47.846300 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: 0b75e00a1f0d471b8d0e80e62dff45eb Oct 04 20:35:47.846300 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1067884877 Oct 04 20:35:47.846300 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-HostsAdminNegativeTestJSON-1067884877-project-admin Oct 04 20:35:47.846300 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 20:35:47.846300 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 20:35:47.846300 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: e8e9d115d6a24b1598a800757fb63c28 Oct 04 20:35:47.846300 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1067884877-project-admin Oct 04 20:35:47.846300 n-d-854823-8 devstack@n-api.service[128802]: method: Oct 04 20:35:47.846300 n-d-854823-8 devstack@n-api.service[128802]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 20:35:47.846300 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'id': 'nonexistent_hostname'} Oct 04 20:35:47.846300 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:35:47.847055 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:35:47.847055 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 274, in show Oct 04 20:35:47.847055 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Oct 04 20:35:47.847055 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 20:35:47.847055 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 20:35:47.847055 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 04 20:35:47.847055 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 04 20:35:47.847055 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 20:35:47.847055 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 20:35:47.847055 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 04 20:35:47.847055 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 04 20:35:47.847055 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 20:35:47.847055 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:35:47.847055 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:35:47.847055 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:35:47.847055 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:35:47.847055 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:35:47.847055 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:35:47.847055 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:35:47.848113 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:35:47.848113 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:35:47.848113 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:35:47.848113 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:35:47.848113 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:35:47.848113 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 282, in show Oct 04 20:35:47.848113 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:35:47.848113 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 20:35:47.848113 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:35:47.848113 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:35:47.848113 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:35:47.848113 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:35:47.848113 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:35:47.848113 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:35:47.848113 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:35:47.848113 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:35:47.848113 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 20:35:47.848113 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:35:47.850525 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-10f27517-b7cc-48bc-bd16-ec64c41deb45 tempest-HostsAdminNegativeTestJSON-1067884877 tempest-HostsAdminNegativeTestJSON-1067884877-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:35:47.852542 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-10f27517-b7cc-48bc-bd16-ec64c41deb45 tempest-HostsAdminNegativeTestJSON-1067884877 tempest-HostsAdminNegativeTestJSON-1067884877-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.032427 Oct 04 20:35:47.860372 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 312/628] 10.222.0.33 () {58 vars in 1191 bytes} [Tue Oct 4 20:35:47 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 20:35:47.871633 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-4487907d-b240-4596-9ae6-100af8879617 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:47.876693 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-4487907d-b240-4596-9ae6-100af8879617 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] [instance: b3667992-a213-4da4-a172-8ab92ff3b2ca] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:47.894847 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4487907d-b240-4596-9ae6-100af8879617 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:47.895657 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4487907d-b240-4596-9ae6-100af8879617 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:47.896321 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4487907d-b240-4596-9ae6-100af8879617 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:47.897250 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4487907d-b240-4596-9ae6-100af8879617 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:47.898736 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4487907d-b240-4596-9ae6-100af8879617 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:47.899777 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4487907d-b240-4596-9ae6-100af8879617 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:48.080567 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-a415237b-d638-4712-b3b3-cdc2f0e50d4d tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f051a291d59242469f8172a9c474ac89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f0707d756b4ee085a19cccf3ab82c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:48.082733 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell0:SELECT=8 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:35:48.093133 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a415237b-d638-4712-b3b3-cdc2f0e50d4d tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] 10.222.0.33 "GET /compute/v2.1/servers/3961b3f4-aea9-4997-85aa-336b3f902533" status: 200 len: 1474 microversion: 2.1 time: 0.690606 Oct 04 20:35:48.097289 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 317/629] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:47 2022] GET /compute/v2.1/servers/3961b3f4-aea9-4997-85aa-336b3f902533 => generated 1474 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:48.120566 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0b1ec96f-4d42-458d-a6b3-97c5994dcce2 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:48.121595 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-0b1ec96f-4d42-458d-a6b3-97c5994dcce2 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] [instance: c7f3bb5b-e08b-4a3f-ba4d-40012179412e] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:48.133160 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0b1ec96f-4d42-458d-a6b3-97c5994dcce2 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:48.137608 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0b1ec96f-4d42-458d-a6b3-97c5994dcce2 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:48.138445 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0b1ec96f-4d42-458d-a6b3-97c5994dcce2 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:48.140856 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0b1ec96f-4d42-458d-a6b3-97c5994dcce2 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:48.142196 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0b1ec96f-4d42-458d-a6b3-97c5994dcce2 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:48.145850 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0b1ec96f-4d42-458d-a6b3-97c5994dcce2 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:48.778913 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-0b1ec96f-4d42-458d-a6b3-97c5994dcce2 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3563efe2b8c94931a2a46c4e14811b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3118a5d96843d3bede1ed94bd9717e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:48.818216 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-0b1ec96f-4d42-458d-a6b3-97c5994dcce2 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] 10.222.0.33 "GET /compute/v2.1/servers/c7f3bb5b-e08b-4a3f-ba4d-40012179412e" status: 200 len: 1476 microversion: 2.1 time: 0.696272 Oct 04 20:35:48.819650 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 318/630] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:48 2022] GET /compute/v2.1/servers/c7f3bb5b-e08b-4a3f-ba4d-40012179412e => generated 1476 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:48.869417 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-dbb2be13-8575-4931-b78b-322d8e661007 tempest-HostsAdminNegativeTestJSON-80887090 tempest-HostsAdminNegativeTestJSON-80887090-project] Calling method '.version_select at 0x7f3c74a1aaf0>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:48.871071 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-4487907d-b240-4596-9ae6-100af8879617 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a24944aeb34a5ea228965be9bf4ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c288268acb30475bbc065a8f72cb21d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:48.874290 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-dbb2be13-8575-4931-b78b-322d8e661007 tempest-HostsAdminNegativeTestJSON-80887090 tempest-HostsAdminNegativeTestJSON-80887090-project] Policy check for os_compute_api:os-hosts:shutdown failed with credentials {'is_admin': False, 'user_id': '93c85bfeb3af4b6e951e4332d004e11b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b35a9377bed451a82898e34c5f4c2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:48.876983 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-dbb2be13-8575-4931-b78b-322d8e661007 tempest-HostsAdminNegativeTestJSON-80887090 tempest-HostsAdminNegativeTestJSON-80887090-project] Request method failure captured: Oct 04 20:35:48.876983 n-d-854823-8 devstack@n-api.service[128801]: request: GET /compute/v2.1/os-hosts/n-d-854823-8/shutdown HTTP/1.1 Oct 04 20:35:48.876983 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:35:48.876983 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:35:48.876983 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:35:48.876983 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 0 Oct 04 20:35:48.876983 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:35:48.876983 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:35:48.876983 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:35:48.876983 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:35:48.876983 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJkgCqfYODGanDYgjyL_CvXUcBG1ILDOeHyjikY-CyydYP7flimH0iBxbWuME0rBFXc5Ij7uiQBJj8d8gulCFX2hy0m0Td49zMAkOPDBies0F1BRliqO3AYPcOvc4ZJB4GmWkbYP4OHHrlBBL5vNOpXVNw0qKL-4UpFiDVrLOoc4jMk Oct 04 20:35:48.876983 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:35:48.876983 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:35:48.876983 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:35:48.876983 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:35:48.876983 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:35:48.876983 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:35:48.876983 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: 5b35a9377bed451a82898e34c5f4c2ea Oct 04 20:35:48.876983 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-80887090 Oct 04 20:35:48.876983 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 20:35:48.876983 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 20:35:48.878216 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5b35a9377bed451a82898e34c5f4c2ea", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5b35a9377bed451a82898e34c5f4c2ea"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5b35a9377bed451a82898e34c5f4c2ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5b35a9377bed451a82898e34c5f4c2ea"}]}] Oct 04 20:35:48.878216 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-HostsAdminNegativeTestJSON-80887090 Oct 04 20:35:48.878216 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: 5b35a9377bed451a82898e34c5f4c2ea Oct 04 20:35:48.878216 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-80887090 Oct 04 20:35:48.878216 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-HostsAdminNegativeTestJSON-80887090-project Oct 04 20:35:48.878216 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:35:48.878216 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:35:48.878216 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: 93c85bfeb3af4b6e951e4332d004e11b Oct 04 20:35:48.878216 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-HostsAdminNegativeTestJSON-80887090-project Oct 04 20:35:48.878216 n-d-854823-8 devstack@n-api.service[128801]: method: Oct 04 20:35:48.878216 n-d-854823-8 devstack@n-api.service[128801]: exception: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Oct 04 20:35:48.878216 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': 'n-d-854823-8'} Oct 04 20:35:48.878216 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:35:48.878977 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:35:48.878977 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:35:48.878977 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:35:48.878977 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:35:48.878977 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:35:48.878977 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:35:48.878977 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:35:48.878977 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:35:48.878977 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:35:48.878977 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 195, in shutdown Oct 04 20:35:48.878977 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'shutdown', Oct 04 20:35:48.878977 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 20:35:48.878977 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 20:35:48.878977 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 20:35:48.878977 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 20:35:48.878977 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 20:35:48.878977 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 20:35:48.878977 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 20:35:48.878977 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 20:35:48.880044 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 20:35:48.880044 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 20:35:48.880044 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 20:35:48.880044 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 20:35:48.880044 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 20:35:48.880044 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 20:35:48.880044 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Oct 04 20:35:48.880044 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:35:48.880044 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:35:48.880044 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:35:48.880044 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:35:48.880044 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:35:48.880044 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:35:48.880044 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 20:35:48.880044 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 20:35:48.880044 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Oct 04 20:35:48.880044 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:35:48.881043 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-dbb2be13-8575-4931-b78b-322d8e661007 tempest-HostsAdminNegativeTestJSON-80887090 tempest-HostsAdminNegativeTestJSON-80887090-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:35:48.881043 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-dbb2be13-8575-4931-b78b-322d8e661007 tempest-HostsAdminNegativeTestJSON-80887090 tempest-HostsAdminNegativeTestJSON-80887090-project] 10.222.0.33 "GET /compute/v2.1/os-hosts/n-d-854823-8/shutdown" status: 403 len: 113 microversion: 2.1 time: 0.057486 Oct 04 20:35:48.881043 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 319/631] 10.222.0.33 () {58 vars in 1194 bytes} [Tue Oct 4 20:35:48 2022] GET /compute/v2.1/os-hosts/n-d-854823-8/shutdown => generated 113 bytes in 58 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:35:48.901950 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-4487907d-b240-4596-9ae6-100af8879617 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] 10.222.0.33 "GET /compute/v2.1/servers/b3667992-a213-4da4-a172-8ab92ff3b2ca" status: 200 len: 1313 microversion: 2.1 time: 1.036811 Oct 04 20:35:48.913932 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 313/632] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:47 2022] GET /compute/v2.1/servers/b3667992-a213-4da4-a172-8ab92ff3b2ca => generated 1313 bytes in 1047 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:48.916463 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d7fc13c1-bf7e-46a3-ab1e-c13d2cc09cc6 tempest-HostsAdminNegativeTestJSON-1067884877 tempest-HostsAdminNegativeTestJSON-1067884877-project-admin] Calling method '.version_select at 0x7f3c749fb550>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:48.939659 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-d7fc13c1-bf7e-46a3-ab1e-c13d2cc09cc6 tempest-HostsAdminNegativeTestJSON-1067884877 tempest-HostsAdminNegativeTestJSON-1067884877-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 20:35:48.941659 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d7fc13c1-bf7e-46a3-ab1e-c13d2cc09cc6 tempest-HostsAdminNegativeTestJSON-1067884877 tempest-HostsAdminNegativeTestJSON-1067884877-project-admin] Request method failure captured: Oct 04 20:35:48.941659 n-d-854823-8 devstack@n-api.service[128801]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown HTTP/1.1 Oct 04 20:35:48.941659 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:35:48.941659 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:35:48.941659 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:35:48.941659 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 0 Oct 04 20:35:48.941659 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:35:48.941659 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:35:48.941659 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:35:48.941659 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:35:48.941659 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJkigceXIfRmiaBbp7zgfTtb3Dpo3EwgGgux0KFoNRbjLPuDOS8cTS7kRqNKrbJRfIAFTlvbZ7oFghK2LrAK2PpRMzCz2ANGdxFZ-zznn6TGeG19qvcWoqW3tp38JvtrhvIeaOWIyFeJbzPhumxq85xXGFwChq70r4Z0bWc5oSY0-Yc Oct 04 20:35:48.941659 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:35:48.941659 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:35:48.941659 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:35:48.941659 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:35:48.941659 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:35:48.941659 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:35:48.941659 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: 0b75e00a1f0d471b8d0e80e62dff45eb Oct 04 20:35:48.941659 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1067884877 Oct 04 20:35:48.941659 n-d-854823-8 devstack@n-api.service[128801]: X-Role: admin,reader,member Oct 04 20:35:48.941659 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: admin,reader,member Oct 04 20:35:48.942988 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0b75e00a1f0d471b8d0e80e62dff45eb", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0b75e00a1f0d471b8d0e80e62dff45eb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0b75e00a1f0d471b8d0e80e62dff45eb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0b75e00a1f0d471b8d0e80e62dff45eb"}]}] Oct 04 20:35:48.942988 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1067884877 Oct 04 20:35:48.942988 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: 0b75e00a1f0d471b8d0e80e62dff45eb Oct 04 20:35:48.942988 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1067884877 Oct 04 20:35:48.942988 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-HostsAdminNegativeTestJSON-1067884877-project-admin Oct 04 20:35:48.942988 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:35:48.942988 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:35:48.942988 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: e8e9d115d6a24b1598a800757fb63c28 Oct 04 20:35:48.942988 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1067884877-project-admin Oct 04 20:35:48.942988 n-d-854823-8 devstack@n-api.service[128801]: method: Oct 04 20:35:48.942988 n-d-854823-8 devstack@n-api.service[128801]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 20:35:48.942988 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': 'nonexistent_hostname'} Oct 04 20:35:48.942988 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:35:48.943723 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:35:48.943723 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Oct 04 20:35:48.943723 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Oct 04 20:35:48.943723 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 04 20:35:48.943723 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 04 20:35:48.943723 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 20:35:48.943723 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 20:35:48.943723 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 20:35:48.943723 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 20:35:48.943723 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 04 20:35:48.943723 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 04 20:35:48.943723 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 04 20:35:48.943723 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 04 20:35:48.943723 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 20:35:48.943723 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 20:35:48.943723 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 04 20:35:48.943723 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 04 20:35:48.943723 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 20:35:48.943723 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 20:35:48.954108 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 04 20:35:48.954108 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 04 20:35:48.954108 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 20:35:48.954108 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:35:48.954108 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:35:48.954108 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:35:48.954108 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:35:48.954108 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:35:48.954108 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:35:48.954108 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:35:48.954108 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:35:48.954108 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:35:48.954108 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:35:48.954108 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:35:48.954108 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:35:48.954108 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 197, in shutdown Oct 04 20:35:48.954108 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="shutdown") Oct 04 20:35:48.954108 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Oct 04 20:35:48.954108 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:35:48.957118 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 20:35:48.957118 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:35:48.957118 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:35:48.957118 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:35:48.957118 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:35:48.957118 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:35:48.957118 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:35:48.957118 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:35:48.957118 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:35:48.957118 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 20:35:48.957118 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:35:48.957118 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d7fc13c1-bf7e-46a3-ab1e-c13d2cc09cc6 tempest-HostsAdminNegativeTestJSON-1067884877 tempest-HostsAdminNegativeTestJSON-1067884877-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:35:48.957118 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d7fc13c1-bf7e-46a3-ab1e-c13d2cc09cc6 tempest-HostsAdminNegativeTestJSON-1067884877 tempest-HostsAdminNegativeTestJSON-1067884877-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown" status: 404 len: 99 microversion: 2.1 time: 0.040290 Oct 04 20:35:48.957118 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 320/633] 10.222.0.33 () {58 vars in 1218 bytes} [Tue Oct 4 20:35:48 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown => generated 99 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 20:35:48.965204 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-f6f2abd0-77ce-490f-85ba-cdbc7256ac6d tempest-HostsAdminNegativeTestJSON-80887090 tempest-HostsAdminNegativeTestJSON-80887090-project] Calling method '.version_select at 0x7f3c74cdfee0>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:48.967352 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-f6f2abd0-77ce-490f-85ba-cdbc7256ac6d tempest-HostsAdminNegativeTestJSON-80887090 tempest-HostsAdminNegativeTestJSON-80887090-project] Policy check for os_compute_api:os-hosts:start failed with credentials {'is_admin': False, 'user_id': '93c85bfeb3af4b6e951e4332d004e11b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b35a9377bed451a82898e34c5f4c2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:48.969145 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-f6f2abd0-77ce-490f-85ba-cdbc7256ac6d tempest-HostsAdminNegativeTestJSON-80887090 tempest-HostsAdminNegativeTestJSON-80887090-project] Request method failure captured: Oct 04 20:35:48.969145 n-d-854823-8 devstack@n-api.service[128802]: request: GET /compute/v2.1/os-hosts/n-d-854823-8/startup HTTP/1.1 Oct 04 20:35:48.969145 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 20:35:48.969145 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 20:35:48.969145 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 20:35:48.969145 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 0 Oct 04 20:35:48.969145 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 20:35:48.969145 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 20:35:48.969145 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 20:35:48.969145 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 20:35:48.969145 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPJkgCqfYODGanDYgjyL_CvXUcBG1ILDOeHyjikY-CyydYP7flimH0iBxbWuME0rBFXc5Ij7uiQBJj8d8gulCFX2hy0m0Td49zMAkOPDBies0F1BRliqO3AYPcOvc4ZJB4GmWkbYP4OHHrlBBL5vNOpXVNw0qKL-4UpFiDVrLOoc4jMk Oct 04 20:35:48.969145 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 20:35:48.969145 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 20:35:48.969145 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 20:35:48.969145 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 20:35:48.969145 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 20:35:48.969145 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 20:35:48.969145 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: 5b35a9377bed451a82898e34c5f4c2ea Oct 04 20:35:48.969145 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-80887090 Oct 04 20:35:48.969145 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 20:35:48.969145 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 20:35:48.970402 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5b35a9377bed451a82898e34c5f4c2ea", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5b35a9377bed451a82898e34c5f4c2ea"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5b35a9377bed451a82898e34c5f4c2ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5b35a9377bed451a82898e34c5f4c2ea"}]}] Oct 04 20:35:48.970402 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-HostsAdminNegativeTestJSON-80887090 Oct 04 20:35:48.970402 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: 5b35a9377bed451a82898e34c5f4c2ea Oct 04 20:35:48.970402 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-80887090 Oct 04 20:35:48.970402 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-HostsAdminNegativeTestJSON-80887090-project Oct 04 20:35:48.970402 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 20:35:48.970402 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 20:35:48.970402 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: 93c85bfeb3af4b6e951e4332d004e11b Oct 04 20:35:48.970402 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-HostsAdminNegativeTestJSON-80887090-project Oct 04 20:35:48.970402 n-d-854823-8 devstack@n-api.service[128802]: method: Oct 04 20:35:48.970402 n-d-854823-8 devstack@n-api.service[128802]: exception: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Oct 04 20:35:48.970402 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'id': 'n-d-854823-8'} Oct 04 20:35:48.970402 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:35:48.971160 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:35:48.971160 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:35:48.971160 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:35:48.971160 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:35:48.971160 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:35:48.971160 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:35:48.971160 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:35:48.971160 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:35:48.971160 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:35:48.971160 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 187, in startup Oct 04 20:35:48.971160 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'start', Oct 04 20:35:48.971160 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 20:35:48.971160 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 20:35:48.971160 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 20:35:48.971160 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 20:35:48.971160 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 20:35:48.971160 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 20:35:48.971160 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 20:35:48.971160 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 20:35:48.972207 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 20:35:48.972207 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 20:35:48.972207 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 20:35:48.972207 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 20:35:48.972207 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 20:35:48.972207 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 20:35:48.972207 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Oct 04 20:35:48.972207 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:35:48.972207 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:35:48.972207 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:35:48.972207 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:35:48.972207 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:35:48.972207 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:35:48.972207 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 20:35:48.972207 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 20:35:48.972207 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Oct 04 20:35:48.972207 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:35:48.976270 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-f6f2abd0-77ce-490f-85ba-cdbc7256ac6d tempest-HostsAdminNegativeTestJSON-80887090 tempest-HostsAdminNegativeTestJSON-80887090-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:start to be performed. {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:35:48.979632 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-f6f2abd0-77ce-490f-85ba-cdbc7256ac6d tempest-HostsAdminNegativeTestJSON-80887090 tempest-HostsAdminNegativeTestJSON-80887090-project] 10.222.0.33 "GET /compute/v2.1/os-hosts/n-d-854823-8/startup" status: 403 len: 110 microversion: 2.1 time: 0.019485 Oct 04 20:35:48.980403 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 314/634] 10.222.0.33 () {58 vars in 1191 bytes} [Tue Oct 4 20:35:48 2022] GET /compute/v2.1/os-hosts/n-d-854823-8/startup => generated 110 bytes in 21 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:35:48.999608 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-aabef8ba-f90e-42cf-9289-8043a8672015 tempest-HostsAdminNegativeTestJSON-1067884877 tempest-HostsAdminNegativeTestJSON-1067884877-project-admin] Calling method '.version_select at 0x7f3c74973f70>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:49.034291 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-aabef8ba-f90e-42cf-9289-8043a8672015 tempest-HostsAdminNegativeTestJSON-1067884877 tempest-HostsAdminNegativeTestJSON-1067884877-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 20:35:49.036913 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-aabef8ba-f90e-42cf-9289-8043a8672015 tempest-HostsAdminNegativeTestJSON-1067884877 tempest-HostsAdminNegativeTestJSON-1067884877-project-admin] Request method failure captured: Oct 04 20:35:49.036913 n-d-854823-8 devstack@n-api.service[128801]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/startup HTTP/1.1 Oct 04 20:35:49.036913 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:35:49.036913 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:35:49.036913 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:35:49.036913 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 0 Oct 04 20:35:49.036913 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:35:49.036913 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:35:49.036913 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:35:49.036913 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:35:49.036913 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJkigceXIfRmiaBbp7zgfTtb3Dpo3EwgGgux0KFoNRbjLPuDOS8cTS7kRqNKrbJRfIAFTlvbZ7oFghK2LrAK2PpRMzCz2ANGdxFZ-zznn6TGeG19qvcWoqW3tp38JvtrhvIeaOWIyFeJbzPhumxq85xXGFwChq70r4Z0bWc5oSY0-Yc Oct 04 20:35:49.036913 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:35:49.036913 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:35:49.036913 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:35:49.036913 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:35:49.036913 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:35:49.036913 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:35:49.036913 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: 0b75e00a1f0d471b8d0e80e62dff45eb Oct 04 20:35:49.036913 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1067884877 Oct 04 20:35:49.036913 n-d-854823-8 devstack@n-api.service[128801]: X-Role: admin,reader,member Oct 04 20:35:49.036913 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: admin,reader,member Oct 04 20:35:49.038835 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0b75e00a1f0d471b8d0e80e62dff45eb", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0b75e00a1f0d471b8d0e80e62dff45eb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0b75e00a1f0d471b8d0e80e62dff45eb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0b75e00a1f0d471b8d0e80e62dff45eb"}]}] Oct 04 20:35:49.038835 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1067884877 Oct 04 20:35:49.038835 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: 0b75e00a1f0d471b8d0e80e62dff45eb Oct 04 20:35:49.038835 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1067884877 Oct 04 20:35:49.038835 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-HostsAdminNegativeTestJSON-1067884877-project-admin Oct 04 20:35:49.038835 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:35:49.038835 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:35:49.038835 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: e8e9d115d6a24b1598a800757fb63c28 Oct 04 20:35:49.038835 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1067884877-project-admin Oct 04 20:35:49.038835 n-d-854823-8 devstack@n-api.service[128801]: method: Oct 04 20:35:49.038835 n-d-854823-8 devstack@n-api.service[128801]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 20:35:49.038835 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': 'nonexistent_hostname'} Oct 04 20:35:49.038835 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:35:49.040103 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:35:49.040103 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Oct 04 20:35:49.040103 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Oct 04 20:35:49.040103 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 04 20:35:49.040103 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 04 20:35:49.040103 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 20:35:49.040103 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 20:35:49.040103 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 20:35:49.040103 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 20:35:49.040103 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 04 20:35:49.040103 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 04 20:35:49.040103 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 04 20:35:49.040103 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 04 20:35:49.040103 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 20:35:49.040103 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 20:35:49.040103 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 04 20:35:49.040103 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 04 20:35:49.040103 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 20:35:49.040103 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 20:35:49.041176 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 04 20:35:49.041176 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 04 20:35:49.041176 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 20:35:49.041176 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:35:49.041176 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:35:49.041176 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:35:49.041176 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:35:49.041176 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:35:49.041176 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:35:49.041176 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:35:49.041176 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:35:49.041176 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:35:49.041176 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:35:49.041176 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:35:49.041176 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:35:49.041176 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 189, in startup Oct 04 20:35:49.041176 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="startup") Oct 04 20:35:49.041176 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Oct 04 20:35:49.041176 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:35:49.043148 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 20:35:49.043148 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:35:49.043148 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:35:49.043148 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:35:49.043148 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:35:49.043148 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:35:49.043148 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:35:49.043148 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:35:49.043148 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:35:49.043148 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 20:35:49.043148 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:35:49.043148 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-aabef8ba-f90e-42cf-9289-8043a8672015 tempest-HostsAdminNegativeTestJSON-1067884877 tempest-HostsAdminNegativeTestJSON-1067884877-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:35:49.043148 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-aabef8ba-f90e-42cf-9289-8043a8672015 tempest-HostsAdminNegativeTestJSON-1067884877 tempest-HostsAdminNegativeTestJSON-1067884877-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hosts/nonexistent_hostname/startup" status: 404 len: 99 microversion: 2.1 time: 0.047083 Oct 04 20:35:49.052477 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-656f0dbd-a4eb-4e0d-8d13-7b5fbb1a892e tempest-HostsAdminNegativeTestJSON-1067884877 tempest-HostsAdminNegativeTestJSON-1067884877-project-admin] Action: 'update', calling method: .version_select at 0x7f3c74b51670>, body: {"status": "enable", "maintenance_mode": "invalid"} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:35:49.057589 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 321/635] 10.222.0.33 () {58 vars in 1215 bytes} [Tue Oct 4 20:35:48 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/startup => generated 99 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 04 20:35:49.063968 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-656f0dbd-a4eb-4e0d-8d13-7b5fbb1a892e tempest-HostsAdminNegativeTestJSON-1067884877 tempest-HostsAdminNegativeTestJSON-1067884877-project-admin] Request method failure captured: Oct 04 20:35:49.063968 n-d-854823-8 devstack@n-api.service[128802]: request: PUT /compute/v2.1/os-hosts/n-d-854823-8 HTTP/1.1 Oct 04 20:35:49.063968 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 20:35:49.063968 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 20:35:49.063968 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 20:35:49.063968 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 51 Oct 04 20:35:49.063968 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 20:35:49.063968 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 20:35:49.063968 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 20:35:49.063968 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 20:35:49.063968 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPJkigceXIfRmiaBbp7zgfTtb3Dpo3EwgGgux0KFoNRbjLPuDOS8cTS7kRqNKrbJRfIAFTlvbZ7oFghK2LrAK2PpRMzCz2ANGdxFZ-zznn6TGeG19qvcWoqW3tp38JvtrhvIeaOWIyFeJbzPhumxq85xXGFwChq70r4Z0bWc5oSY0-Yc Oct 04 20:35:49.063968 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 20:35:49.063968 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 20:35:49.063968 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 20:35:49.063968 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 20:35:49.063968 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 20:35:49.063968 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 20:35:49.063968 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: 0b75e00a1f0d471b8d0e80e62dff45eb Oct 04 20:35:49.063968 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1067884877 Oct 04 20:35:49.063968 n-d-854823-8 devstack@n-api.service[128802]: X-Role: admin,reader,member Oct 04 20:35:49.063968 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: admin,reader,member Oct 04 20:35:49.065300 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0b75e00a1f0d471b8d0e80e62dff45eb", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0b75e00a1f0d471b8d0e80e62dff45eb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0b75e00a1f0d471b8d0e80e62dff45eb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0b75e00a1f0d471b8d0e80e62dff45eb"}]}] Oct 04 20:35:49.065300 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1067884877 Oct 04 20:35:49.065300 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: 0b75e00a1f0d471b8d0e80e62dff45eb Oct 04 20:35:49.065300 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1067884877 Oct 04 20:35:49.065300 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-HostsAdminNegativeTestJSON-1067884877-project-admin Oct 04 20:35:49.065300 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 20:35:49.065300 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 20:35:49.065300 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: e8e9d115d6a24b1598a800757fb63c28 Oct 04 20:35:49.065300 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1067884877-project-admin Oct 04 20:35:49.065300 n-d-854823-8 devstack@n-api.service[128802]: Oct 04 20:35:49.065300 n-d-854823-8 devstack@n-api.service[128802]: {"status": "enable", "maintenance_mode": "invalid"} Oct 04 20:35:49.065300 n-d-854823-8 devstack@n-api.service[128802]: method: Oct 04 20:35:49.065300 n-d-854823-8 devstack@n-api.service[128802]: exception: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 04 20:35:49.066052 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'id': 'n-d-854823-8', 'body': {'status': 'enable', 'maintenance_mode': 'invalid'}} Oct 04 20:35:49.066052 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:35:49.066052 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:35:49.066052 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 20:35:49.066052 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 20:35:49.066052 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 20:35:49.066052 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise error Oct 04 20:35:49.066052 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 04 20:35:49.066052 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:35:49.066052 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['maintenance_mode']: Oct 04 20:35:49.066052 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Oct 04 20:35:49.066052 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi 'disable', Oct 04 20:35:49.066052 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi 'Enable', Oct 04 20:35:49.066052 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi 'Disable', Oct 04 20:35:49.066052 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi 'ENABLE', Oct 04 20:35:49.066052 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi 'DISABLE'], Oct 04 20:35:49.066052 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 04 20:35:49.066052 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:35:49.066052 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi On instance: Oct 04 20:35:49.066052 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi 'invalid' Oct 04 20:35:49.066052 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:35:49.066052 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:35:49.066052 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:35:49.066052 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:35:49.066052 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:35:49.068303 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:35:49.068303 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:35:49.068303 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:35:49.068303 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:35:49.068303 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:35:49.068303 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:35:49.068303 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:35:49.068303 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 20:35:49.068303 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 20:35:49.068303 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 20:35:49.068303 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 20:35:49.068303 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 20:35:49.068303 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 20:35:49.068303 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 04 20:35:49.068303 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:35:49.068303 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:35:49.068303 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:35:49.068303 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:35:49.068303 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:35:49.072479 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:35:49.072479 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 20:35:49.072479 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 20:35:49.072479 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 04 20:35:49.072479 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:35:49.072479 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-656f0dbd-a4eb-4e0d-8d13-7b5fbb1a892e tempest-HostsAdminNegativeTestJSON-1067884877 tempest-HostsAdminNegativeTestJSON-1067884877-project-admin] Returning 400 to user: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:35:49.072479 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-656f0dbd-a4eb-4e0d-8d13-7b5fbb1a892e tempest-HostsAdminNegativeTestJSON-1067884877 tempest-HostsAdminNegativeTestJSON-1067884877-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-hosts/n-d-854823-8" status: 400 len: 199 microversion: 2.1 time: 0.018652 Oct 04 20:35:49.081474 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 315/636] 10.222.0.33 () {60 vars in 1187 bytes} [Tue Oct 4 20:35:49 2022] PUT /compute/v2.1/os-hosts/n-d-854823-8 => generated 199 bytes in 35 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 04 20:35:49.084457 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-bdf8cc72-5dab-4835-92a7-1b038fb9fd59 tempest-HostsAdminNegativeTestJSON-1067884877 tempest-HostsAdminNegativeTestJSON-1067884877-project-admin] Action: 'update', calling method: .version_select at 0x7f3c749ac1f0>, body: {"status": "invalid", "maintenance_mode": "enable"} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:35:49.089798 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-bdf8cc72-5dab-4835-92a7-1b038fb9fd59 tempest-HostsAdminNegativeTestJSON-1067884877 tempest-HostsAdminNegativeTestJSON-1067884877-project-admin] Request method failure captured: Oct 04 20:35:49.089798 n-d-854823-8 devstack@n-api.service[128801]: request: PUT /compute/v2.1/os-hosts/n-d-854823-8 HTTP/1.1 Oct 04 20:35:49.089798 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:35:49.089798 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:35:49.089798 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:35:49.089798 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 51 Oct 04 20:35:49.089798 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:35:49.089798 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:35:49.089798 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:35:49.089798 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:35:49.089798 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJkigceXIfRmiaBbp7zgfTtb3Dpo3EwgGgux0KFoNRbjLPuDOS8cTS7kRqNKrbJRfIAFTlvbZ7oFghK2LrAK2PpRMzCz2ANGdxFZ-zznn6TGeG19qvcWoqW3tp38JvtrhvIeaOWIyFeJbzPhumxq85xXGFwChq70r4Z0bWc5oSY0-Yc Oct 04 20:35:49.089798 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:35:49.089798 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:35:49.089798 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:35:49.089798 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:35:49.089798 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:35:49.089798 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:35:49.089798 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: 0b75e00a1f0d471b8d0e80e62dff45eb Oct 04 20:35:49.089798 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1067884877 Oct 04 20:35:49.089798 n-d-854823-8 devstack@n-api.service[128801]: X-Role: admin,reader,member Oct 04 20:35:49.089798 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: admin,reader,member Oct 04 20:35:49.091110 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0b75e00a1f0d471b8d0e80e62dff45eb", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0b75e00a1f0d471b8d0e80e62dff45eb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0b75e00a1f0d471b8d0e80e62dff45eb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0b75e00a1f0d471b8d0e80e62dff45eb"}]}] Oct 04 20:35:49.091110 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1067884877 Oct 04 20:35:49.091110 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: 0b75e00a1f0d471b8d0e80e62dff45eb Oct 04 20:35:49.091110 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1067884877 Oct 04 20:35:49.091110 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-HostsAdminNegativeTestJSON-1067884877-project-admin Oct 04 20:35:49.091110 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:35:49.091110 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:35:49.091110 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: e8e9d115d6a24b1598a800757fb63c28 Oct 04 20:35:49.091110 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1067884877-project-admin Oct 04 20:35:49.091110 n-d-854823-8 devstack@n-api.service[128801]: Oct 04 20:35:49.091110 n-d-854823-8 devstack@n-api.service[128801]: {"status": "invalid", "maintenance_mode": "enable"} Oct 04 20:35:49.091110 n-d-854823-8 devstack@n-api.service[128801]: method: Oct 04 20:35:49.091110 n-d-854823-8 devstack@n-api.service[128801]: exception: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 04 20:35:49.091860 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': 'n-d-854823-8', 'body': {'status': 'invalid', 'maintenance_mode': 'enable'}} Oct 04 20:35:49.091860 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:35:49.091860 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:35:49.091860 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 20:35:49.091860 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 20:35:49.091860 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 20:35:49.091860 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise error Oct 04 20:35:49.091860 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 04 20:35:49.091860 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:35:49.091860 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['status']: Oct 04 20:35:49.091860 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Oct 04 20:35:49.091860 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi 'disable', Oct 04 20:35:49.091860 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi 'Enable', Oct 04 20:35:49.091860 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi 'Disable', Oct 04 20:35:49.091860 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi 'ENABLE', Oct 04 20:35:49.091860 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi 'DISABLE'], Oct 04 20:35:49.091860 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 04 20:35:49.091860 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:35:49.091860 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi On instance: Oct 04 20:35:49.091860 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi 'invalid' Oct 04 20:35:49.091860 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:35:49.091860 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:35:49.091860 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:35:49.091860 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:35:49.091860 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:35:49.095750 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:35:49.095750 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:35:49.095750 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:35:49.095750 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:35:49.095750 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:35:49.095750 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:35:49.095750 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:35:49.095750 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 20:35:49.095750 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 20:35:49.095750 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 20:35:49.095750 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 20:35:49.095750 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 20:35:49.095750 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 20:35:49.095750 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 04 20:35:49.095750 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:35:49.095750 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:35:49.095750 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:35:49.095750 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:35:49.095750 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:35:49.099557 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:35:49.099557 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 20:35:49.099557 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 20:35:49.099557 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 04 20:35:49.099557 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:35:49.099557 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-bdf8cc72-5dab-4835-92a7-1b038fb9fd59 tempest-HostsAdminNegativeTestJSON-1067884877 tempest-HostsAdminNegativeTestJSON-1067884877-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:35:49.099557 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-bdf8cc72-5dab-4835-92a7-1b038fb9fd59 tempest-HostsAdminNegativeTestJSON-1067884877 tempest-HostsAdminNegativeTestJSON-1067884877-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-hosts/n-d-854823-8" status: 400 len: 189 microversion: 2.1 time: 0.015630 Oct 04 20:35:49.105039 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-2ee5958d-91ae-4db7-8035-06c24ca88887 tempest-HostsAdminNegativeTestJSON-80887090 tempest-HostsAdminNegativeTestJSON-80887090-project] Action: 'update', calling method: .version_select at 0x7f3c74b42ca0>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:35:49.107933 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 322/637] 10.222.0.33 () {60 vars in 1187 bytes} [Tue Oct 4 20:35:49 2022] PUT /compute/v2.1/os-hosts/n-d-854823-8 => generated 189 bytes in 34 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 20:35:49.109304 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-2ee5958d-91ae-4db7-8035-06c24ca88887 tempest-HostsAdminNegativeTestJSON-80887090 tempest-HostsAdminNegativeTestJSON-80887090-project] Policy check for os_compute_api:os-hosts:update failed with credentials {'is_admin': False, 'user_id': '93c85bfeb3af4b6e951e4332d004e11b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b35a9377bed451a82898e34c5f4c2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:49.111114 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-2ee5958d-91ae-4db7-8035-06c24ca88887 tempest-HostsAdminNegativeTestJSON-80887090 tempest-HostsAdminNegativeTestJSON-80887090-project] Request method failure captured: Oct 04 20:35:49.111114 n-d-854823-8 devstack@n-api.service[128802]: request: PUT /compute/v2.1/os-hosts/n-d-854823-8 HTTP/1.1 Oct 04 20:35:49.111114 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 20:35:49.111114 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 20:35:49.111114 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 20:35:49.111114 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 50 Oct 04 20:35:49.111114 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 20:35:49.111114 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 20:35:49.111114 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 20:35:49.111114 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 20:35:49.111114 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPJkgCqfYODGanDYgjyL_CvXUcBG1ILDOeHyjikY-CyydYP7flimH0iBxbWuME0rBFXc5Ij7uiQBJj8d8gulCFX2hy0m0Td49zMAkOPDBies0F1BRliqO3AYPcOvc4ZJB4GmWkbYP4OHHrlBBL5vNOpXVNw0qKL-4UpFiDVrLOoc4jMk Oct 04 20:35:49.111114 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 20:35:49.111114 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 20:35:49.111114 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 20:35:49.111114 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 20:35:49.111114 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 20:35:49.111114 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 20:35:49.111114 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: 5b35a9377bed451a82898e34c5f4c2ea Oct 04 20:35:49.111114 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-80887090 Oct 04 20:35:49.111114 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 20:35:49.111114 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 20:35:49.112340 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5b35a9377bed451a82898e34c5f4c2ea", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5b35a9377bed451a82898e34c5f4c2ea"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5b35a9377bed451a82898e34c5f4c2ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5b35a9377bed451a82898e34c5f4c2ea"}]}] Oct 04 20:35:49.112340 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-HostsAdminNegativeTestJSON-80887090 Oct 04 20:35:49.112340 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: 5b35a9377bed451a82898e34c5f4c2ea Oct 04 20:35:49.112340 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-80887090 Oct 04 20:35:49.112340 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-HostsAdminNegativeTestJSON-80887090-project Oct 04 20:35:49.112340 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 20:35:49.112340 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 20:35:49.112340 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: 93c85bfeb3af4b6e951e4332d004e11b Oct 04 20:35:49.112340 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-HostsAdminNegativeTestJSON-80887090-project Oct 04 20:35:49.112340 n-d-854823-8 devstack@n-api.service[128802]: Oct 04 20:35:49.112340 n-d-854823-8 devstack@n-api.service[128802]: {"status": "enable", "maintenance_mode": "enable"} Oct 04 20:35:49.112340 n-d-854823-8 devstack@n-api.service[128802]: method: Oct 04 20:35:49.112340 n-d-854823-8 devstack@n-api.service[128802]: exception: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Oct 04 20:35:49.112340 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'id': 'n-d-854823-8', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Oct 04 20:35:49.113117 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:35:49.113117 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:35:49.113117 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:35:49.113117 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:35:49.113117 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:35:49.113117 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:35:49.113117 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:35:49.113117 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:35:49.113117 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:35:49.113117 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:35:49.113117 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:35:49.113117 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:35:49.113117 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 112, in update Oct 04 20:35:49.113117 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'update', Oct 04 20:35:49.113117 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 20:35:49.113117 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 20:35:49.113117 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 20:35:49.113117 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 20:35:49.113117 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 20:35:49.113117 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 20:35:49.114972 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 20:35:49.114972 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 20:35:49.114972 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 20:35:49.114972 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 20:35:49.114972 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 20:35:49.114972 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 20:35:49.114972 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 20:35:49.114972 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 20:35:49.114972 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Oct 04 20:35:49.114972 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:35:49.114972 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:35:49.114972 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:35:49.114972 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:35:49.114972 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:35:49.114972 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:35:49.114972 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 20:35:49.114972 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 20:35:49.114972 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Oct 04 20:35:49.114972 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:35:49.118797 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-2ee5958d-91ae-4db7-8035-06c24ca88887 tempest-HostsAdminNegativeTestJSON-80887090 tempest-HostsAdminNegativeTestJSON-80887090-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:update to be performed. {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:35:49.118797 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-2ee5958d-91ae-4db7-8035-06c24ca88887 tempest-HostsAdminNegativeTestJSON-80887090 tempest-HostsAdminNegativeTestJSON-80887090-project] 10.222.0.33 "PUT /compute/v2.1/os-hosts/n-d-854823-8" status: 403 len: 111 microversion: 2.1 time: 0.014361 Oct 04 20:35:49.124120 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-4124f718-167b-418f-a998-2786d53ef843 tempest-HostsAdminNegativeTestJSON-1067884877 tempest-HostsAdminNegativeTestJSON-1067884877-project-admin] Action: 'update', calling method: .version_select at 0x7f3c74b81670>, body: {"status": null, "maintenance_mode": null} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:35:49.125317 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 316/638] 10.222.0.33 () {60 vars in 1187 bytes} [Tue Oct 4 20:35:49 2022] PUT /compute/v2.1/os-hosts/n-d-854823-8 => generated 111 bytes in 26 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:35:49.143449 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-cf46b779-31e9-48c5-a3b3-39eff3be28b6 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:49.144046 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-cf46b779-31e9-48c5-a3b3-39eff3be28b6 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] [instance: 3961b3f4-aea9-4997-85aa-336b3f902533] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:49.148016 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-4124f718-167b-418f-a998-2786d53ef843 tempest-HostsAdminNegativeTestJSON-1067884877 tempest-HostsAdminNegativeTestJSON-1067884877-project-admin] Request method failure captured: Oct 04 20:35:49.148016 n-d-854823-8 devstack@n-api.service[128801]: request: PUT /compute/v2.1/os-hosts/n-d-854823-8 HTTP/1.1 Oct 04 20:35:49.148016 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:35:49.148016 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:35:49.148016 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:35:49.148016 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 42 Oct 04 20:35:49.148016 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:35:49.148016 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:35:49.148016 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:35:49.148016 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:35:49.148016 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJkigceXIfRmiaBbp7zgfTtb3Dpo3EwgGgux0KFoNRbjLPuDOS8cTS7kRqNKrbJRfIAFTlvbZ7oFghK2LrAK2PpRMzCz2ANGdxFZ-zznn6TGeG19qvcWoqW3tp38JvtrhvIeaOWIyFeJbzPhumxq85xXGFwChq70r4Z0bWc5oSY0-Yc Oct 04 20:35:49.148016 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:35:49.148016 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:35:49.148016 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:35:49.148016 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:35:49.148016 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:35:49.148016 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:35:49.148016 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: 0b75e00a1f0d471b8d0e80e62dff45eb Oct 04 20:35:49.148016 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1067884877 Oct 04 20:35:49.148016 n-d-854823-8 devstack@n-api.service[128801]: X-Role: admin,reader,member Oct 04 20:35:49.148016 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: admin,reader,member Oct 04 20:35:49.149290 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0b75e00a1f0d471b8d0e80e62dff45eb", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0b75e00a1f0d471b8d0e80e62dff45eb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0b75e00a1f0d471b8d0e80e62dff45eb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0b75e00a1f0d471b8d0e80e62dff45eb"}]}] Oct 04 20:35:49.149290 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1067884877 Oct 04 20:35:49.149290 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: 0b75e00a1f0d471b8d0e80e62dff45eb Oct 04 20:35:49.149290 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1067884877 Oct 04 20:35:49.149290 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-HostsAdminNegativeTestJSON-1067884877-project-admin Oct 04 20:35:49.149290 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:35:49.149290 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:35:49.149290 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: e8e9d115d6a24b1598a800757fb63c28 Oct 04 20:35:49.149290 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1067884877-project-admin Oct 04 20:35:49.149290 n-d-854823-8 devstack@n-api.service[128801]: Oct 04 20:35:49.149290 n-d-854823-8 devstack@n-api.service[128801]: {"status": null, "maintenance_mode": null} Oct 04 20:35:49.149290 n-d-854823-8 devstack@n-api.service[128801]: method: Oct 04 20:35:49.149290 n-d-854823-8 devstack@n-api.service[128801]: exception: Invalid input for field/attribute status. Value: None. None is not of type 'string' Oct 04 20:35:49.149290 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': 'n-d-854823-8', 'body': {'status': None, 'maintenance_mode': None}} Oct 04 20:35:49.150082 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:35:49.150082 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:35:49.150082 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 20:35:49.150082 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 20:35:49.150082 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 20:35:49.150082 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise error Oct 04 20:35:49.150082 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: None is not of type 'string' Oct 04 20:35:49.150082 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:35:49.150082 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['status']: Oct 04 20:35:49.150082 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Oct 04 20:35:49.150082 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi 'disable', Oct 04 20:35:49.150082 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi 'Enable', Oct 04 20:35:49.150082 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi 'Disable', Oct 04 20:35:49.150082 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi 'ENABLE', Oct 04 20:35:49.150082 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi 'DISABLE'], Oct 04 20:35:49.150082 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 04 20:35:49.150082 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:35:49.150082 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi On instance: Oct 04 20:35:49.150082 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi None Oct 04 20:35:49.150082 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:35:49.150082 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:35:49.150082 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:35:49.150082 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:35:49.150082 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:35:49.150082 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:35:49.151514 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:35:49.151514 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:35:49.151514 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:35:49.151514 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:35:49.151514 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:35:49.151514 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:35:49.151514 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 20:35:49.151514 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 20:35:49.151514 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 20:35:49.151514 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 20:35:49.151514 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 20:35:49.151514 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 20:35:49.151514 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: None. None is not of type 'string' Oct 04 20:35:49.151514 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:35:49.151514 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:35:49.151514 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:35:49.151514 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:35:49.151514 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:35:49.151514 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:35:49.152706 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 20:35:49.152706 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 20:35:49.152706 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: None. None is not of type 'string' Oct 04 20:35:49.152706 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:35:49.152706 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-4124f718-167b-418f-a998-2786d53ef843 tempest-HostsAdminNegativeTestJSON-1067884877 tempest-HostsAdminNegativeTestJSON-1067884877-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: None. None is not of type 'string' {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:35:49.152706 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-4124f718-167b-418f-a998-2786d53ef843 tempest-HostsAdminNegativeTestJSON-1067884877 tempest-HostsAdminNegativeTestJSON-1067884877-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-hosts/n-d-854823-8" status: 400 len: 127 microversion: 2.1 time: 0.029012 Oct 04 20:35:49.157881 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 323/639] 10.222.0.33 () {60 vars in 1187 bytes} [Tue Oct 4 20:35:49 2022] PUT /compute/v2.1/os-hosts/n-d-854823-8 => generated 127 bytes in 38 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 20:35:49.173029 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cf46b779-31e9-48c5-a3b3-39eff3be28b6 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:49.175583 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cf46b779-31e9-48c5-a3b3-39eff3be28b6 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:49.176327 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cf46b779-31e9-48c5-a3b3-39eff3be28b6 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:49.177567 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cf46b779-31e9-48c5-a3b3-39eff3be28b6 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:49.178475 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cf46b779-31e9-48c5-a3b3-39eff3be28b6 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:49.184756 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-408519d6-5df7-4456-9dc5-8663a05a071d tempest-HostsAdminNegativeTestJSON-1067884877 tempest-HostsAdminNegativeTestJSON-1067884877-project-admin] Action: 'update', calling method: .version_select at 0x7f3c749ac9d0>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:35:49.187643 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cf46b779-31e9-48c5-a3b3-39eff3be28b6 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:49.188150 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.hosts [None req-408519d6-5df7-4456-9dc5-8663a05a071d tempest-HostsAdminNegativeTestJSON-1067884877 tempest-HostsAdminNegativeTestJSON-1067884877-project-admin] Enabling host nonexistent_hostname. Oct 04 20:35:49.207414 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-408519d6-5df7-4456-9dc5-8663a05a071d tempest-HostsAdminNegativeTestJSON-1067884877 tempest-HostsAdminNegativeTestJSON-1067884877-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 20:35:49.209203 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-408519d6-5df7-4456-9dc5-8663a05a071d tempest-HostsAdminNegativeTestJSON-1067884877 tempest-HostsAdminNegativeTestJSON-1067884877-project-admin] Request method failure captured: Oct 04 20:35:49.209203 n-d-854823-8 devstack@n-api.service[128801]: request: PUT /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Oct 04 20:35:49.209203 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:35:49.209203 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:35:49.209203 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:35:49.209203 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 50 Oct 04 20:35:49.209203 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:35:49.209203 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:35:49.209203 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:35:49.209203 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:35:49.209203 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJkigceXIfRmiaBbp7zgfTtb3Dpo3EwgGgux0KFoNRbjLPuDOS8cTS7kRqNKrbJRfIAFTlvbZ7oFghK2LrAK2PpRMzCz2ANGdxFZ-zznn6TGeG19qvcWoqW3tp38JvtrhvIeaOWIyFeJbzPhumxq85xXGFwChq70r4Z0bWc5oSY0-Yc Oct 04 20:35:49.209203 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:35:49.209203 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:35:49.209203 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:35:49.209203 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:35:49.209203 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:35:49.209203 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:35:49.209203 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: 0b75e00a1f0d471b8d0e80e62dff45eb Oct 04 20:35:49.209203 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1067884877 Oct 04 20:35:49.209203 n-d-854823-8 devstack@n-api.service[128801]: X-Role: admin,reader,member Oct 04 20:35:49.209203 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: admin,reader,member Oct 04 20:35:49.210998 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0b75e00a1f0d471b8d0e80e62dff45eb", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0b75e00a1f0d471b8d0e80e62dff45eb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0b75e00a1f0d471b8d0e80e62dff45eb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0b75e00a1f0d471b8d0e80e62dff45eb"}]}] Oct 04 20:35:49.210998 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1067884877 Oct 04 20:35:49.210998 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: 0b75e00a1f0d471b8d0e80e62dff45eb Oct 04 20:35:49.210998 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1067884877 Oct 04 20:35:49.210998 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-HostsAdminNegativeTestJSON-1067884877-project-admin Oct 04 20:35:49.210998 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:35:49.210998 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:35:49.210998 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: e8e9d115d6a24b1598a800757fb63c28 Oct 04 20:35:49.210998 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1067884877-project-admin Oct 04 20:35:49.210998 n-d-854823-8 devstack@n-api.service[128801]: Oct 04 20:35:49.210998 n-d-854823-8 devstack@n-api.service[128801]: {"status": "enable", "maintenance_mode": "enable"} Oct 04 20:35:49.210998 n-d-854823-8 devstack@n-api.service[128801]: method: Oct 04 20:35:49.210998 n-d-854823-8 devstack@n-api.service[128801]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 20:35:49.210998 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': 'nonexistent_hostname', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Oct 04 20:35:49.211792 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:35:49.211792 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:35:49.211792 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 159, in _set_enabled_status Oct 04 20:35:49.211792 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi result = self.api.set_host_enabled(context, host_name, enabled) Oct 04 20:35:49.211792 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 04 20:35:49.211792 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 04 20:35:49.211792 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 20:35:49.211792 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 20:35:49.211792 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 20:35:49.211792 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 20:35:49.211792 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 04 20:35:49.211792 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 04 20:35:49.211792 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 04 20:35:49.211792 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 04 20:35:49.211792 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 20:35:49.211792 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 20:35:49.211792 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 04 20:35:49.211792 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 04 20:35:49.213061 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 20:35:49.213061 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 20:35:49.213061 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 04 20:35:49.213061 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 04 20:35:49.213061 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 20:35:49.213061 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:35:49.213061 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:35:49.213061 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:35:49.213061 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:35:49.213061 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:35:49.213061 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:35:49.213061 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:35:49.213061 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:35:49.213061 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:35:49.213061 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:35:49.213061 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:35:49.213061 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:35:49.213061 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:35:49.213061 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:35:49.213061 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 124, in update Oct 04 20:35:49.214162 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi result['status'] = self._set_enabled_status(context, id, status) Oct 04 20:35:49.214162 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 163, in _set_enabled_status Oct 04 20:35:49.214162 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:35:49.214162 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 20:35:49.214162 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:35:49.214162 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:35:49.214162 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:35:49.214162 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:35:49.214162 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:35:49.214162 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:35:49.214162 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:35:49.214162 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:35:49.214162 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 20:35:49.214162 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:35:49.247891 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-408519d6-5df7-4456-9dc5-8663a05a071d tempest-HostsAdminNegativeTestJSON-1067884877 tempest-HostsAdminNegativeTestJSON-1067884877-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:35:49.254768 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-408519d6-5df7-4456-9dc5-8663a05a071d tempest-HostsAdminNegativeTestJSON-1067884877 tempest-HostsAdminNegativeTestJSON-1067884877-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.085819 Oct 04 20:35:49.279031 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 324/640] 10.222.0.33 () {60 vars in 1211 bytes} [Tue Oct 4 20:35:49 2022] PUT /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 04 20:35:49.858634 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b4a42242-1589-492b-a401-aaaa94216577 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:49.859612 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b4a42242-1589-492b-a401-aaaa94216577 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] [instance: c7f3bb5b-e08b-4a3f-ba4d-40012179412e] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:49.888700 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b4a42242-1589-492b-a401-aaaa94216577 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:49.902567 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b4a42242-1589-492b-a401-aaaa94216577 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:49.903636 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b4a42242-1589-492b-a401-aaaa94216577 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:49.905181 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b4a42242-1589-492b-a401-aaaa94216577 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:49.907007 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b4a42242-1589-492b-a401-aaaa94216577 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:49.907886 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b4a42242-1589-492b-a401-aaaa94216577 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:50.704634 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-cf46b779-31e9-48c5-a3b3-39eff3be28b6 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f051a291d59242469f8172a9c474ac89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f0707d756b4ee085a19cccf3ab82c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:50.721794 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-cf46b779-31e9-48c5-a3b3-39eff3be28b6 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] 10.222.0.33 "GET /compute/v2.1/servers/3961b3f4-aea9-4997-85aa-336b3f902533" status: 200 len: 1474 microversion: 2.1 time: 1.595281 Oct 04 20:35:50.728722 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 317/641] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:49 2022] GET /compute/v2.1/servers/3961b3f4-aea9-4997-85aa-336b3f902533 => generated 1474 bytes in 1603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:50.740928 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-fbd11f04-f16c-46fc-b717-8aef04892e8a tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:50.744277 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-fbd11f04-f16c-46fc-b717-8aef04892e8a tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] [instance: b3667992-a213-4da4-a172-8ab92ff3b2ca] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:50.758247 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fbd11f04-f16c-46fc-b717-8aef04892e8a tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:50.759067 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fbd11f04-f16c-46fc-b717-8aef04892e8a tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:50.760377 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fbd11f04-f16c-46fc-b717-8aef04892e8a tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:50.762975 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fbd11f04-f16c-46fc-b717-8aef04892e8a tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:50.763680 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fbd11f04-f16c-46fc-b717-8aef04892e8a tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:50.766535 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fbd11f04-f16c-46fc-b717-8aef04892e8a tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:51.005684 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-fbd11f04-f16c-46fc-b717-8aef04892e8a tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a24944aeb34a5ea228965be9bf4ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c288268acb30475bbc065a8f72cb21d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:51.016415 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-fbd11f04-f16c-46fc-b717-8aef04892e8a tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] 10.222.0.33 "GET /compute/v2.1/servers/b3667992-a213-4da4-a172-8ab92ff3b2ca" status: 200 len: 1313 microversion: 2.1 time: 0.283949 Oct 04 20:35:51.017002 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 318/642] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:50 2022] GET /compute/v2.1/servers/b3667992-a213-4da4-a172-8ab92ff3b2ca => generated 1313 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:51.483932 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-b4a42242-1589-492b-a401-aaaa94216577 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3563efe2b8c94931a2a46c4e14811b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3118a5d96843d3bede1ed94bd9717e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:51.492959 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b4a42242-1589-492b-a401-aaaa94216577 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] 10.222.0.33 "GET /compute/v2.1/servers/c7f3bb5b-e08b-4a3f-ba4d-40012179412e" status: 200 len: 1476 microversion: 2.1 time: 1.639046 Oct 04 20:35:51.509064 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 325/643] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:49 2022] GET /compute/v2.1/servers/c7f3bb5b-e08b-4a3f-ba4d-40012179412e => generated 1476 bytes in 1656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:35:51.676426 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-c379e2c2-73e1-4db4-9a29-607fade48c5b req-a537d353-9319-43a5-bb93-cd0b71a0e766 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3667992-a213-4da4-a172-8ab92ff3b2ca", "tag": "e5b970a5-881c-4fd8-852b-0dc92a104d9a"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:35:51.693308 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-c379e2c2-73e1-4db4-9a29-607fade48c5b req-a537d353-9319-43a5-bb93-cd0b71a0e766 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:51.699403 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-c379e2c2-73e1-4db4-9a29-607fade48c5b req-a537d353-9319-43a5-bb93-cd0b71a0e766 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:51.700067 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-c379e2c2-73e1-4db4-9a29-607fade48c5b req-a537d353-9319-43a5-bb93-cd0b71a0e766 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:51.743031 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-c379e2c2-73e1-4db4-9a29-607fade48c5b req-a537d353-9319-43a5-bb93-cd0b71a0e766 service nova] Creating event network-changed:e5b970a5-881c-4fd8-852b-0dc92a104d9a for instance b3667992-a213-4da4-a172-8ab92ff3b2ca on n-h1-854823-8 Oct 04 20:35:51.759392 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ec32b1d8-7804-4ef0-bd0c-8dacbee7cee4 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:51.760382 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ec32b1d8-7804-4ef0-bd0c-8dacbee7cee4 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] [instance: 3961b3f4-aea9-4997-85aa-336b3f902533] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:51.763751 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:35:51.768637 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-c379e2c2-73e1-4db4-9a29-607fade48c5b req-a537d353-9319-43a5-bb93-cd0b71a0e766 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082893 Oct 04 20:35:51.775592 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 319/644] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:35:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:35:51.777260 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ec32b1d8-7804-4ef0-bd0c-8dacbee7cee4 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:51.777772 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ec32b1d8-7804-4ef0-bd0c-8dacbee7cee4 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:51.778211 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ec32b1d8-7804-4ef0-bd0c-8dacbee7cee4 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:51.779143 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ec32b1d8-7804-4ef0-bd0c-8dacbee7cee4 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:51.779762 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ec32b1d8-7804-4ef0-bd0c-8dacbee7cee4 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:51.780481 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ec32b1d8-7804-4ef0-bd0c-8dacbee7cee4 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:51.892870 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-ec32b1d8-7804-4ef0-bd0c-8dacbee7cee4 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f051a291d59242469f8172a9c474ac89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f0707d756b4ee085a19cccf3ab82c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:51.910566 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ec32b1d8-7804-4ef0-bd0c-8dacbee7cee4 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] 10.222.0.33 "GET /compute/v2.1/servers/3961b3f4-aea9-4997-85aa-336b3f902533" status: 200 len: 1432 microversion: 2.1 time: 0.150781 Oct 04 20:35:51.911688 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 326/645] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:51 2022] GET /compute/v2.1/servers/3961b3f4-aea9-4997-85aa-336b3f902533 => generated 1432 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:35:52.061004 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-ea90f904-c044-482c-8cbb-baa6f64b8eed tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:52.061695 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-ea90f904-c044-482c-8cbb-baa6f64b8eed tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] [instance: b3667992-a213-4da4-a172-8ab92ff3b2ca] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:52.070246 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ea90f904-c044-482c-8cbb-baa6f64b8eed tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:52.070981 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ea90f904-c044-482c-8cbb-baa6f64b8eed tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:52.071573 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ea90f904-c044-482c-8cbb-baa6f64b8eed tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:52.072454 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ea90f904-c044-482c-8cbb-baa6f64b8eed tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:52.073051 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ea90f904-c044-482c-8cbb-baa6f64b8eed tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:52.073630 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ea90f904-c044-482c-8cbb-baa6f64b8eed tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:52.443443 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-ea90f904-c044-482c-8cbb-baa6f64b8eed tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a24944aeb34a5ea228965be9bf4ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c288268acb30475bbc065a8f72cb21d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:52.453682 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-ea90f904-c044-482c-8cbb-baa6f64b8eed tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] 10.222.0.33 "GET /compute/v2.1/servers/b3667992-a213-4da4-a172-8ab92ff3b2ca" status: 200 len: 1313 microversion: 2.1 time: 0.400490 Oct 04 20:35:52.463672 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 320/646] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:52 2022] GET /compute/v2.1/servers/b3667992-a213-4da4-a172-8ab92ff3b2ca => generated 1313 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:52.521379 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b579fed2-a647-4925-8fac-874ef0ac412d tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:52.522079 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b579fed2-a647-4925-8fac-874ef0ac412d tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] [instance: c7f3bb5b-e08b-4a3f-ba4d-40012179412e] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:52.534489 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b579fed2-a647-4925-8fac-874ef0ac412d tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:52.535064 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b579fed2-a647-4925-8fac-874ef0ac412d tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:52.535458 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b579fed2-a647-4925-8fac-874ef0ac412d tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:52.545247 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b579fed2-a647-4925-8fac-874ef0ac412d tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:52.545975 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b579fed2-a647-4925-8fac-874ef0ac412d tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:52.546700 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b579fed2-a647-4925-8fac-874ef0ac412d tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:52.939897 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-57548ece-453d-4085-bf25-37a309d118dc tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:52.941325 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-57548ece-453d-4085-bf25-37a309d118dc tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] [instance: 3961b3f4-aea9-4997-85aa-336b3f902533] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:52.948837 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-57548ece-453d-4085-bf25-37a309d118dc tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:52.949609 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-57548ece-453d-4085-bf25-37a309d118dc tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:52.950511 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-57548ece-453d-4085-bf25-37a309d118dc tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:52.951568 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-57548ece-453d-4085-bf25-37a309d118dc tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:52.952232 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-57548ece-453d-4085-bf25-37a309d118dc tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:52.952843 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-57548ece-453d-4085-bf25-37a309d118dc tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:53.016613 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-57548ece-453d-4085-bf25-37a309d118dc tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:53.017100 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-57548ece-453d-4085-bf25-37a309d118dc tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:53.017524 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-57548ece-453d-4085-bf25-37a309d118dc tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:53.017972 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.objects.instance [None req-57548ece-453d-4085-bf25-37a309d118dc tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Lazy-loading 'fault' on Instance uuid 3961b3f4-aea9-4997-85aa-336b3f902533 {{(pid=128802) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:35:53.236174 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-57548ece-453d-4085-bf25-37a309d118dc tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f051a291d59242469f8172a9c474ac89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f0707d756b4ee085a19cccf3ab82c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:53.266881 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-57548ece-453d-4085-bf25-37a309d118dc tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] 10.222.0.33 "GET /compute/v2.1/servers/3961b3f4-aea9-4997-85aa-336b3f902533" status: 200 len: 1309 microversion: 2.1 time: 0.333413 Oct 04 20:35:53.268859 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 321/647] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:52 2022] GET /compute/v2.1/servers/3961b3f4-aea9-4997-85aa-336b3f902533 => generated 1309 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:35:53.355890 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-b579fed2-a647-4925-8fac-874ef0ac412d tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3563efe2b8c94931a2a46c4e14811b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3118a5d96843d3bede1ed94bd9717e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:53.365142 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b579fed2-a647-4925-8fac-874ef0ac412d tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] 10.222.0.33 "GET /compute/v2.1/servers/c7f3bb5b-e08b-4a3f-ba4d-40012179412e" status: 200 len: 1476 microversion: 2.1 time: 0.847861 Oct 04 20:35:53.384821 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 327/648] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:52 2022] GET /compute/v2.1/servers/c7f3bb5b-e08b-4a3f-ba4d-40012179412e => generated 1476 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:53.481984 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-50c80828-d01b-41ec-9159-56dc0cf7bda5 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:53.482827 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-50c80828-d01b-41ec-9159-56dc0cf7bda5 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] [instance: b3667992-a213-4da4-a172-8ab92ff3b2ca] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:53.500170 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-50c80828-d01b-41ec-9159-56dc0cf7bda5 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:53.500675 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-50c80828-d01b-41ec-9159-56dc0cf7bda5 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:53.501106 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-50c80828-d01b-41ec-9159-56dc0cf7bda5 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:53.501822 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-50c80828-d01b-41ec-9159-56dc0cf7bda5 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:53.502269 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-50c80828-d01b-41ec-9159-56dc0cf7bda5 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:53.502719 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-50c80828-d01b-41ec-9159-56dc0cf7bda5 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:53.851901 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-ecedf36e-707d-4dc9-95a3-fd8621725ab5 req-c769332c-526d-4c1b-b5f5-2ce006afdeb0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3961b3f4-aea9-4997-85aa-336b3f902533", "name": "network-vif-deleted", "tag": "6e9e362a-05ec-422d-9902-e146dc60ea86"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:35:53.877389 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-ecedf36e-707d-4dc9-95a3-fd8621725ab5 req-c769332c-526d-4c1b-b5f5-2ce006afdeb0 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:53.878114 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-ecedf36e-707d-4dc9-95a3-fd8621725ab5 req-c769332c-526d-4c1b-b5f5-2ce006afdeb0 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:53.878583 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-ecedf36e-707d-4dc9-95a3-fd8621725ab5 req-c769332c-526d-4c1b-b5f5-2ce006afdeb0 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:53.910332 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-ecedf36e-707d-4dc9-95a3-fd8621725ab5 req-c769332c-526d-4c1b-b5f5-2ce006afdeb0 service nova] Creating event network-vif-deleted:6e9e362a-05ec-422d-9902-e146dc60ea86 for instance 3961b3f4-aea9-4997-85aa-336b3f902533 on n-h1-854823-8 Oct 04 20:35:53.930521 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-ecedf36e-707d-4dc9-95a3-fd8621725ab5 req-c769332c-526d-4c1b-b5f5-2ce006afdeb0 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083254 Oct 04 20:35:53.936938 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 328/649] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:35:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:35:54.300363 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a7aca205-71b1-4a2f-b420-732389a961f4 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:54.301067 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a7aca205-71b1-4a2f-b420-732389a961f4 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] [instance: 3961b3f4-aea9-4997-85aa-336b3f902533] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:54.314937 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a7aca205-71b1-4a2f-b420-732389a961f4 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:54.315518 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a7aca205-71b1-4a2f-b420-732389a961f4 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:54.320302 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a7aca205-71b1-4a2f-b420-732389a961f4 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:54.322112 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a7aca205-71b1-4a2f-b420-732389a961f4 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:54.322630 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a7aca205-71b1-4a2f-b420-732389a961f4 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:54.338447 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a7aca205-71b1-4a2f-b420-732389a961f4 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:54.363693 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:35:54.375087 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-a7aca205-71b1-4a2f-b420-732389a961f4 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] HTTP exception thrown: Instance 3961b3f4-aea9-4997-85aa-336b3f902533 could not be found. Oct 04 20:35:54.376987 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a7aca205-71b1-4a2f-b420-732389a961f4 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Request method failure captured: Oct 04 20:35:54.376987 n-d-854823-8 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/3961b3f4-aea9-4997-85aa-336b3f902533 HTTP/1.1 Oct 04 20:35:54.376987 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:35:54.376987 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:35:54.376987 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:35:54.376987 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 0 Oct 04 20:35:54.376987 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:35:54.376987 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:35:54.376987 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:35:54.376987 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:35:54.376987 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJjhIXZluEqDIBCEd_KoSb0NnfYYYAvqrGCZ7y6fe3fjYo-cdz7bv8Tn8dReWqdqMbxC6DqaahObWu6Sdy0ApulXxVya9AhEbpGmDzRnoDiiBZvCT0Zd4BqqyzNtbYYngH_Vi7gNfJ8WGUmMea-_FhBudizSU5whTyveE5GLtekT0WU Oct 04 20:35:54.376987 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:35:54.376987 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:35:54.376987 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:35:54.376987 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:35:54.376987 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:35:54.376987 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:35:54.376987 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: 18f0707d756b4ee085a19cccf3ab82c0 Oct 04 20:35:54.376987 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-LiveMigrationNegativeTest-564528865 Oct 04 20:35:54.376987 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 20:35:54.376987 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 20:35:54.378492 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_18f0707d756b4ee085a19cccf3ab82c0", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/18f0707d756b4ee085a19cccf3ab82c0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/18f0707d756b4ee085a19cccf3ab82c0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/18f0707d756b4ee085a19cccf3ab82c0"}]}] Oct 04 20:35:54.378492 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-LiveMigrationNegativeTest-564528865 Oct 04 20:35:54.378492 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: 18f0707d756b4ee085a19cccf3ab82c0 Oct 04 20:35:54.378492 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-564528865 Oct 04 20:35:54.378492 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-LiveMigrationNegativeTest-564528865-project Oct 04 20:35:54.378492 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:35:54.378492 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:35:54.378492 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: f051a291d59242469f8172a9c474ac89 Oct 04 20:35:54.378492 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-LiveMigrationNegativeTest-564528865-project Oct 04 20:35:54.378492 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 20:35:54.378492 n-d-854823-8 devstack@n-api.service[128801]: exception: Instance 3961b3f4-aea9-4997-85aa-336b3f902533 could not be found. Oct 04 20:35:54.378492 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': '3961b3f4-aea9-4997-85aa-336b3f902533'} Oct 04 20:35:54.379244 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:35:54.379244 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:35:54.379244 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:35:54.379244 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:35:54.379244 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:35:54.379244 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:35:54.379244 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:35:54.379244 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:35:54.379244 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:35:54.379244 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:35:54.379244 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3961b3f4-aea9-4997-85aa-336b3f902533 could not be found. Oct 04 20:35:54.379244 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:35:54.379244 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:35:54.379244 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:35:54.379244 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:35:54.379244 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:35:54.379244 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:35:54.379244 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:35:54.379244 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:35:54.379244 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:35:54.380643 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:35:54.380643 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:35:54.380643 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:35:54.380643 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:35:54.380643 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:35:54.380643 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:35:54.380643 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:35:54.380643 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3961b3f4-aea9-4997-85aa-336b3f902533 could not be found. Oct 04 20:35:54.380643 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:35:54.380643 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:35:54.380643 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:35:54.380643 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:35:54.380643 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:35:54.380643 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:35:54.380643 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:35:54.380643 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:35:54.380643 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3961b3f4-aea9-4997-85aa-336b3f902533 could not be found. Oct 04 20:35:54.380643 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:35:54.381720 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a7aca205-71b1-4a2f-b420-732389a961f4 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] Returning 404 to user: Instance 3961b3f4-aea9-4997-85aa-336b3f902533 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:35:54.381720 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a7aca205-71b1-4a2f-b420-732389a961f4 tempest-LiveMigrationNegativeTest-564528865 tempest-LiveMigrationNegativeTest-564528865-project] 10.222.0.33 "GET /compute/v2.1/servers/3961b3f4-aea9-4997-85aa-336b3f902533" status: 404 len: 111 microversion: 2.1 time: 0.084592 Oct 04 20:35:54.381720 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 329/650] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:54 2022] GET /compute/v2.1/servers/3961b3f4-aea9-4997-85aa-336b3f902533 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 20:35:54.408149 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-50c80828-d01b-41ec-9159-56dc0cf7bda5 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a24944aeb34a5ea228965be9bf4ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c288268acb30475bbc065a8f72cb21d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:54.419921 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ac9283f7-8922-4888-ab9f-900bc08db80a tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:54.420584 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ac9283f7-8922-4888-ab9f-900bc08db80a tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] [instance: c7f3bb5b-e08b-4a3f-ba4d-40012179412e] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:54.427352 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ac9283f7-8922-4888-ab9f-900bc08db80a tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:54.432177 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ac9283f7-8922-4888-ab9f-900bc08db80a tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:54.433075 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-50c80828-d01b-41ec-9159-56dc0cf7bda5 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] 10.222.0.33 "GET /compute/v2.1/servers/b3667992-a213-4da4-a172-8ab92ff3b2ca" status: 200 len: 1313 microversion: 2.1 time: 0.943900 Oct 04 20:35:54.433766 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 322/651] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:53 2022] GET /compute/v2.1/servers/b3667992-a213-4da4-a172-8ab92ff3b2ca => generated 1313 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:54.442795 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ac9283f7-8922-4888-ab9f-900bc08db80a tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:54.445528 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ac9283f7-8922-4888-ab9f-900bc08db80a tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:54.446194 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ac9283f7-8922-4888-ab9f-900bc08db80a tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:54.450810 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ac9283f7-8922-4888-ab9f-900bc08db80a tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:54.964609 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-ac9283f7-8922-4888-ab9f-900bc08db80a tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3563efe2b8c94931a2a46c4e14811b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3118a5d96843d3bede1ed94bd9717e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:54.972615 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ac9283f7-8922-4888-ab9f-900bc08db80a tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] 10.222.0.33 "GET /compute/v2.1/servers/c7f3bb5b-e08b-4a3f-ba4d-40012179412e" status: 200 len: 1476 microversion: 2.1 time: 0.557302 Oct 04 20:35:54.977551 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 330/652] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:54 2022] GET /compute/v2.1/servers/c7f3bb5b-e08b-4a3f-ba4d-40012179412e => generated 1476 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:55.461967 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-254f01c6-df18-45fa-bb99-be5be09df73d tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:55.464004 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-254f01c6-df18-45fa-bb99-be5be09df73d tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] [instance: b3667992-a213-4da4-a172-8ab92ff3b2ca] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:55.477834 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-254f01c6-df18-45fa-bb99-be5be09df73d tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:55.479032 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-254f01c6-df18-45fa-bb99-be5be09df73d tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:55.479487 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-254f01c6-df18-45fa-bb99-be5be09df73d tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:55.480207 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-254f01c6-df18-45fa-bb99-be5be09df73d tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:55.482991 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-254f01c6-df18-45fa-bb99-be5be09df73d tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:55.483484 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-254f01c6-df18-45fa-bb99-be5be09df73d tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:55.740333 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-254f01c6-df18-45fa-bb99-be5be09df73d tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a24944aeb34a5ea228965be9bf4ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c288268acb30475bbc065a8f72cb21d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:55.753781 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-254f01c6-df18-45fa-bb99-be5be09df73d tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] 10.222.0.33 "GET /compute/v2.1/servers/b3667992-a213-4da4-a172-8ab92ff3b2ca" status: 200 len: 1313 microversion: 2.1 time: 0.296536 Oct 04 20:35:55.758852 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 323/653] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:55 2022] GET /compute/v2.1/servers/b3667992-a213-4da4-a172-8ab92ff3b2ca => generated 1313 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:56.010496 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8f89bc73-d1a9-4fd9-b96e-ffac14ce8a05 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:56.011876 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-8f89bc73-d1a9-4fd9-b96e-ffac14ce8a05 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] [instance: c7f3bb5b-e08b-4a3f-ba4d-40012179412e] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:56.037051 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8f89bc73-d1a9-4fd9-b96e-ffac14ce8a05 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:56.037823 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8f89bc73-d1a9-4fd9-b96e-ffac14ce8a05 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:56.039250 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8f89bc73-d1a9-4fd9-b96e-ffac14ce8a05 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:56.040225 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8f89bc73-d1a9-4fd9-b96e-ffac14ce8a05 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:56.040895 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8f89bc73-d1a9-4fd9-b96e-ffac14ce8a05 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:56.041680 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8f89bc73-d1a9-4fd9-b96e-ffac14ce8a05 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:56.374867 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-8f89bc73-d1a9-4fd9-b96e-ffac14ce8a05 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3563efe2b8c94931a2a46c4e14811b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3118a5d96843d3bede1ed94bd9717e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:56.386472 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-8f89bc73-d1a9-4fd9-b96e-ffac14ce8a05 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] 10.222.0.33 "GET /compute/v2.1/servers/c7f3bb5b-e08b-4a3f-ba4d-40012179412e" status: 200 len: 1476 microversion: 2.1 time: 0.381091 Oct 04 20:35:56.387056 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 331/654] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:56 2022] GET /compute/v2.1/servers/c7f3bb5b-e08b-4a3f-ba4d-40012179412e => generated 1476 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:56.783764 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-f5810b58-abc7-4a01-b2be-8e06792221ce tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:56.784385 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-f5810b58-abc7-4a01-b2be-8e06792221ce tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] [instance: b3667992-a213-4da4-a172-8ab92ff3b2ca] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:56.792721 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f5810b58-abc7-4a01-b2be-8e06792221ce tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:56.793209 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f5810b58-abc7-4a01-b2be-8e06792221ce tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:56.793638 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f5810b58-abc7-4a01-b2be-8e06792221ce tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:56.794333 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f5810b58-abc7-4a01-b2be-8e06792221ce tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:56.796364 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f5810b58-abc7-4a01-b2be-8e06792221ce tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:56.797130 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f5810b58-abc7-4a01-b2be-8e06792221ce tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:57.168907 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-f5810b58-abc7-4a01-b2be-8e06792221ce tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a24944aeb34a5ea228965be9bf4ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c288268acb30475bbc065a8f72cb21d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:57.181642 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-f5810b58-abc7-4a01-b2be-8e06792221ce tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] 10.222.0.33 "GET /compute/v2.1/servers/b3667992-a213-4da4-a172-8ab92ff3b2ca" status: 200 len: 1313 microversion: 2.1 time: 0.402188 Oct 04 20:35:57.195318 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 324/655] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:56 2022] GET /compute/v2.1/servers/b3667992-a213-4da4-a172-8ab92ff3b2ca => generated 1313 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:57.419140 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0e3ad16a-5b7c-4954-a48b-904f533af51e tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:57.419744 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-0e3ad16a-5b7c-4954-a48b-904f533af51e tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] [instance: c7f3bb5b-e08b-4a3f-ba4d-40012179412e] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:57.429929 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0e3ad16a-5b7c-4954-a48b-904f533af51e tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:57.430364 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0e3ad16a-5b7c-4954-a48b-904f533af51e tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:57.431941 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0e3ad16a-5b7c-4954-a48b-904f533af51e tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:57.432717 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0e3ad16a-5b7c-4954-a48b-904f533af51e tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:57.434282 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0e3ad16a-5b7c-4954-a48b-904f533af51e tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:57.434983 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0e3ad16a-5b7c-4954-a48b-904f533af51e tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:57.623392 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-0e3ad16a-5b7c-4954-a48b-904f533af51e tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3563efe2b8c94931a2a46c4e14811b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3118a5d96843d3bede1ed94bd9717e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:57.636297 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-0e3ad16a-5b7c-4954-a48b-904f533af51e tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] 10.222.0.33 "GET /compute/v2.1/servers/c7f3bb5b-e08b-4a3f-ba4d-40012179412e" status: 200 len: 1476 microversion: 2.1 time: 0.220839 Oct 04 20:35:57.637112 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 332/656] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:57 2022] GET /compute/v2.1/servers/c7f3bb5b-e08b-4a3f-ba4d-40012179412e => generated 1476 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:35:58.205806 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-74d96911-7e33-4f0e-a843-8c0b288b5dec tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:58.206428 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-74d96911-7e33-4f0e-a843-8c0b288b5dec tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] [instance: b3667992-a213-4da4-a172-8ab92ff3b2ca] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:58.208418 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell0:SELECT=2 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:35:58.221488 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-74d96911-7e33-4f0e-a843-8c0b288b5dec tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:58.221488 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-74d96911-7e33-4f0e-a843-8c0b288b5dec tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:58.221699 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-74d96911-7e33-4f0e-a843-8c0b288b5dec tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:58.222259 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-74d96911-7e33-4f0e-a843-8c0b288b5dec tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:58.222739 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-74d96911-7e33-4f0e-a843-8c0b288b5dec tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:58.223154 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-74d96911-7e33-4f0e-a843-8c0b288b5dec tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:58.400082 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-74d96911-7e33-4f0e-a843-8c0b288b5dec tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a24944aeb34a5ea228965be9bf4ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c288268acb30475bbc065a8f72cb21d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:58.410664 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-74d96911-7e33-4f0e-a843-8c0b288b5dec tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] 10.222.0.33 "GET /compute/v2.1/servers/b3667992-a213-4da4-a172-8ab92ff3b2ca" status: 200 len: 1313 microversion: 2.1 time: 0.208503 Oct 04 20:35:58.411953 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 325/657] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:58 2022] GET /compute/v2.1/servers/b3667992-a213-4da4-a172-8ab92ff3b2ca => generated 1313 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:58.709008 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-c2741134-0ac1-4565-a973-d851a031c22c tempest-ImagesMetadataNegativeTestJSON-1623291634 tempest-ImagesMetadataNegativeTestJSON-1623291634-project] Calling method '.version_select at 0x7f3c74b51af0>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:58.711918 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c989df88-45b3-49ef-9d1c-f1173a512cc9 tempest-InstanceUsageAuditLogNegativeTestJSON-445452984 tempest-InstanceUsageAuditLogNegativeTestJSON-445452984-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:58.716866 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-c989df88-45b3-49ef-9d1c-f1173a512cc9 tempest-InstanceUsageAuditLogNegativeTestJSON-445452984 tempest-InstanceUsageAuditLogNegativeTestJSON-445452984-project-admin] HTTP exception thrown: Invalid timestamp for date invalid_time Oct 04 20:35:58.740491 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c989df88-45b3-49ef-9d1c-f1173a512cc9 tempest-InstanceUsageAuditLogNegativeTestJSON-445452984 tempest-InstanceUsageAuditLogNegativeTestJSON-445452984-project-admin] Request method failure captured: Oct 04 20:35:58.740491 n-d-854823-8 devstack@n-api.service[128801]: request: GET /compute/v2.1/os-instance_usage_audit_log/invalid_time HTTP/1.1 Oct 04 20:35:58.740491 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:35:58.740491 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:35:58.740491 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:35:58.740491 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 0 Oct 04 20:35:58.740491 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:35:58.740491 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:35:58.740491 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:35:58.740491 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:35:58.740491 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJkuhyYnvQcK1UNVA5Os-ihLhVtkyuEECmZRGF4dmBLsy0hpxMFYeZ0Mj0p-yCGbQK3UVv5kthYdRo6MAAq4kvr2uOn7dOYZUZcHZ9-0EWcP9KHal8Ik3X6qV-ixGGnYrHZM9n9jf2dgNcZT5drKmUUkSFcn7893zLgwR8HTwKdYUCg Oct 04 20:35:58.740491 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:35:58.740491 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:35:58.740491 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:35:58.740491 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:35:58.740491 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:35:58.740491 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:35:58.740491 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: 23d164da37984845bad1d6343c043bd9 Oct 04 20:35:58.740491 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-445452984 Oct 04 20:35:58.740491 n-d-854823-8 devstack@n-api.service[128801]: X-Role: admin,reader,member Oct 04 20:35:58.740491 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: admin,reader,member Oct 04 20:35:58.742788 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_23d164da37984845bad1d6343c043bd9", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/23d164da37984845bad1d6343c043bd9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/23d164da37984845bad1d6343c043bd9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/23d164da37984845bad1d6343c043bd9"}]}] Oct 04 20:35:58.742788 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-445452984 Oct 04 20:35:58.742788 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: 23d164da37984845bad1d6343c043bd9 Oct 04 20:35:58.742788 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-445452984 Oct 04 20:35:58.742788 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-445452984-project-admin Oct 04 20:35:58.742788 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:35:58.742788 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:35:58.742788 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: 4b5186e6cf32416cb8d7cccad3e77731 Oct 04 20:35:58.742788 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-445452984-project-admin Oct 04 20:35:58.742788 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 20:35:58.742788 n-d-854823-8 devstack@n-api.service[128801]: exception: Invalid timestamp for date invalid_time Oct 04 20:35:58.743635 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': 'invalid_time'} Oct 04 20:35:58.743635 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:35:58.743635 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:35:58.743635 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 51, in show Oct 04 20:35:58.743635 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi before_date = datetime.datetime.strptime(str(id), Oct 04 20:35:58.743635 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 568, in _strptime_datetime Oct 04 20:35:58.743635 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi tt, fraction, gmtoff_fraction = _strptime(data_string, format) Oct 04 20:35:58.743635 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 349, in _strptime Oct 04 20:35:58.743635 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise ValueError("time data %r does not match format %r" % Oct 04 20:35:58.743635 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi ValueError: time data 'invalid_time' does not match format '%Y-%m-%d %H:%M:%S' Oct 04 20:35:58.743635 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:35:58.743635 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:35:58.743635 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:35:58.743635 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:35:58.743635 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:35:58.743635 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:35:58.743635 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:35:58.743635 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:35:58.743635 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:35:58.743635 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:35:58.750029 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 55, in show Oct 04 20:35:58.750029 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=msg) Oct 04 20:35:58.750029 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid timestamp for date invalid_time Oct 04 20:35:58.750029 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:35:58.750029 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:35:58.750029 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:35:58.750029 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:35:58.750029 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:35:58.750029 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:35:58.750029 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:35:58.750029 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:35:58.750029 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid timestamp for date invalid_time Oct 04 20:35:58.750029 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:35:58.750029 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c989df88-45b3-49ef-9d1c-f1173a512cc9 tempest-InstanceUsageAuditLogNegativeTestJSON-445452984 tempest-InstanceUsageAuditLogNegativeTestJSON-445452984-project-admin] Returning 400 to user: Invalid timestamp for date invalid_time {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:35:58.750029 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c989df88-45b3-49ef-9d1c-f1173a512cc9 tempest-InstanceUsageAuditLogNegativeTestJSON-445452984 tempest-InstanceUsageAuditLogNegativeTestJSON-445452984-project-admin] 10.222.0.33 "GET /compute/v2.1/os-instance_usage_audit_log/invalid_time" status: 400 len: 83 microversion: 2.1 time: 0.429568 Oct 04 20:35:58.751181 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 333/658] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Oct 4 20:35:58 2022] GET /compute/v2.1/os-instance_usage_audit_log/invalid_time => generated 83 bytes in 431 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 04 20:35:58.752301 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-abd487e2-a32c-49fa-b695-2e030d3168c7 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:58.752301 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-abd487e2-a32c-49fa-b695-2e030d3168c7 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] [instance: c7f3bb5b-e08b-4a3f-ba4d-40012179412e] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:58.754559 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.wsgi [None req-c2741134-0ac1-4565-a973-d851a031c22c tempest-ImagesMetadataNegativeTestJSON-1623291634 tempest-ImagesMetadataNegativeTestJSON-1623291634-project] HTTP exception thrown: Image not found. Oct 04 20:35:58.762803 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-abd487e2-a32c-49fa-b695-2e030d3168c7 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:58.763866 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-abd487e2-a32c-49fa-b695-2e030d3168c7 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:58.764775 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-abd487e2-a32c-49fa-b695-2e030d3168c7 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:58.765707 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-abd487e2-a32c-49fa-b695-2e030d3168c7 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:58.766173 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-abd487e2-a32c-49fa-b695-2e030d3168c7 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:58.767691 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-abd487e2-a32c-49fa-b695-2e030d3168c7 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:58.797699 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-c2741134-0ac1-4565-a973-d851a031c22c tempest-ImagesMetadataNegativeTestJSON-1623291634 tempest-ImagesMetadataNegativeTestJSON-1623291634-project] Request method failure captured: Oct 04 20:35:58.797699 n-d-854823-8 devstack@n-api.service[128802]: request: DELETE /compute/v2.1/images/5fbd097e-e9a4-49bd-88d1-341db3e18c0f/metadata/os_distro HTTP/1.1 Oct 04 20:35:58.797699 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 20:35:58.797699 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 20:35:58.797699 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 20:35:58.797699 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 0 Oct 04 20:35:58.797699 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 20:35:58.797699 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 20:35:58.797699 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 20:35:58.797699 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 20:35:58.797699 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPJku_G10m60LEmGOKe0AxskP4Y6UR4e_jcL6Kq2knBcVTDFvH2JxVL8bsFR8lR_mrw7xnNTRg27psFfoNB8MZwLilvTwG9FXJo23dAm1nIT0QcofivZaiaq73ZPKJMxIUNlcx16VpSye9LwsBPq_JObuoGn3ptw0NNFxbMYaBSdHWsM Oct 04 20:35:58.797699 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 20:35:58.797699 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 20:35:58.797699 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 20:35:58.797699 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 20:35:58.797699 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 20:35:58.797699 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 20:35:58.797699 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: 670f0e2542684821b6ceaa8f08a59668 Oct 04 20:35:58.797699 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1623291634 Oct 04 20:35:58.797699 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 20:35:58.797699 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 20:35:58.799299 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_670f0e2542684821b6ceaa8f08a59668", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/670f0e2542684821b6ceaa8f08a59668"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/670f0e2542684821b6ceaa8f08a59668"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/670f0e2542684821b6ceaa8f08a59668"}]}] Oct 04 20:35:58.799299 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1623291634 Oct 04 20:35:58.799299 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: 670f0e2542684821b6ceaa8f08a59668 Oct 04 20:35:58.799299 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1623291634 Oct 04 20:35:58.799299 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-ImagesMetadataNegativeTestJSON-1623291634-project Oct 04 20:35:58.799299 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 20:35:58.799299 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 20:35:58.799299 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: 27d65ef150634102b92376fcf3d6d99d Oct 04 20:35:58.799299 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1623291634-project Oct 04 20:35:58.799299 n-d-854823-8 devstack@n-api.service[128802]: method: Oct 04 20:35:58.799299 n-d-854823-8 devstack@n-api.service[128802]: exception: Image not found. Oct 04 20:35:58.799299 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'image_id': '5fbd097e-e9a4-49bd-88d1-341db3e18c0f', 'id': 'os_distro'} Oct 04 20:35:58.799299 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:35:58.800287 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:35:58.800287 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 20:35:58.800287 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 20:35:58.800287 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 20:35:58.800287 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 20:35:58.800287 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 20:35:58.800287 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 20:35:58.800287 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 20:35:58.800287 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 20:35:58.800287 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 20:35:58.800287 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 20:35:58.800287 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 20:35:58.800287 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 20:35:58.800287 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 20:35:58.800287 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 20:35:58.800287 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 20:35:58.800287 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 20:35:58.800287 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 5fbd097e-e9a4-49bd-88d1-341db3e18c0f Oct 04 20:35:58.801623 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:35:58.801623 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:35:58.801623 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:35:58.801623 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:35:58.801623 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 04 20:35:58.801623 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 04 20:35:58.801623 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 04 20:35:58.801623 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 04 20:35:58.801623 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 04 20:35:58.801623 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 04 20:35:58.801623 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 04 20:35:58.801623 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 04 20:35:58.801623 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 20:35:58.801623 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 20:35:58.801623 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 20:35:58.801623 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 20:35:58.801623 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 20:35:58.801623 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 20:35:58.801623 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 20:35:58.801623 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 20:35:58.803330 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 20:35:58.803330 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 20:35:58.803330 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 20:35:58.803330 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 20:35:58.803330 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 20:35:58.803330 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 20:35:58.803330 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 20:35:58.803330 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 20:35:58.803330 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 5fbd097e-e9a4-49bd-88d1-341db3e18c0f could not be found. Oct 04 20:35:58.803330 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:35:58.803330 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:35:58.803330 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:35:58.803330 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:35:58.803330 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:35:58.803330 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:35:58.803330 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:35:58.803330 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:35:58.803330 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:35:58.803330 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:35:58.805412 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:35:58.805412 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:35:58.805412 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 125, in delete Oct 04 20:35:58.805412 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 04 20:35:58.805412 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 04 20:35:58.805412 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 04 20:35:58.805412 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 20:35:58.805412 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:35:58.805412 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:35:58.805412 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:35:58.805412 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:35:58.805412 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:35:58.805412 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:35:58.805412 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:35:58.805412 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:35:58.805412 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 20:35:58.805412 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:35:58.805412 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-c2741134-0ac1-4565-a973-d851a031c22c tempest-ImagesMetadataNegativeTestJSON-1623291634 tempest-ImagesMetadataNegativeTestJSON-1623291634-project] Returning 404 to user: Image not found. {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:35:58.807401 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-c2741134-0ac1-4565-a973-d851a031c22c tempest-ImagesMetadataNegativeTestJSON-1623291634 tempest-ImagesMetadataNegativeTestJSON-1623291634-project] 10.222.0.33 "DELETE /compute/v2.1/images/5fbd097e-e9a4-49bd-88d1-341db3e18c0f/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.232261 Oct 04 20:35:58.813745 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 326/659] 10.222.0.33 () {58 vars in 1293 bytes} [Tue Oct 4 20:35:58 2022] DELETE /compute/v2.1/images/5fbd097e-e9a4-49bd-88d1-341db3e18c0f/metadata/os_distro => generated 62 bytes in 239 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 20:35:58.967163 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-abd487e2-a32c-49fa-b695-2e030d3168c7 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3563efe2b8c94931a2a46c4e14811b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3118a5d96843d3bede1ed94bd9717e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:58.977463 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-abd487e2-a32c-49fa-b695-2e030d3168c7 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] 10.222.0.33 "GET /compute/v2.1/servers/c7f3bb5b-e08b-4a3f-ba4d-40012179412e" status: 200 len: 1476 microversion: 2.1 time: 0.231405 Oct 04 20:35:58.994430 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 334/660] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:58 2022] GET /compute/v2.1/servers/c7f3bb5b-e08b-4a3f-ba4d-40012179412e => generated 1476 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:35:59.015942 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7fcb4876-993a-407a-a455-5ce949846fcd tempest-ImagesMetadataNegativeTestJSON-1623291634 tempest-ImagesMetadataNegativeTestJSON-1623291634-project] Calling method '.version_select at 0x7f3c749fb550>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:59.048026 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-7fcb4876-993a-407a-a455-5ce949846fcd tempest-ImagesMetadataNegativeTestJSON-1623291634 tempest-ImagesMetadataNegativeTestJSON-1623291634-project] HTTP exception thrown: Image not found. Oct 04 20:35:59.056120 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7fcb4876-993a-407a-a455-5ce949846fcd tempest-ImagesMetadataNegativeTestJSON-1623291634 tempest-ImagesMetadataNegativeTestJSON-1623291634-project] Request method failure captured: Oct 04 20:35:59.056120 n-d-854823-8 devstack@n-api.service[128801]: request: GET /compute/v2.1/images/d6bf1c93-04ba-43eb-8672-161d8791aada/metadata/os_version HTTP/1.1 Oct 04 20:35:59.056120 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:35:59.056120 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:35:59.056120 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:35:59.056120 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 0 Oct 04 20:35:59.056120 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:35:59.056120 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:35:59.056120 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:35:59.056120 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:35:59.056120 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJku_G10m60LEmGOKe0AxskP4Y6UR4e_jcL6Kq2knBcVTDFvH2JxVL8bsFR8lR_mrw7xnNTRg27psFfoNB8MZwLilvTwG9FXJo23dAm1nIT0QcofivZaiaq73ZPKJMxIUNlcx16VpSye9LwsBPq_JObuoGn3ptw0NNFxbMYaBSdHWsM Oct 04 20:35:59.056120 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:35:59.056120 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:35:59.056120 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:35:59.056120 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:35:59.056120 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:35:59.056120 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:35:59.056120 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: 670f0e2542684821b6ceaa8f08a59668 Oct 04 20:35:59.056120 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1623291634 Oct 04 20:35:59.056120 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 20:35:59.056120 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 20:35:59.057742 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_670f0e2542684821b6ceaa8f08a59668", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/670f0e2542684821b6ceaa8f08a59668"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/670f0e2542684821b6ceaa8f08a59668"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/670f0e2542684821b6ceaa8f08a59668"}]}] Oct 04 20:35:59.057742 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1623291634 Oct 04 20:35:59.057742 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: 670f0e2542684821b6ceaa8f08a59668 Oct 04 20:35:59.057742 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1623291634 Oct 04 20:35:59.057742 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-ImagesMetadataNegativeTestJSON-1623291634-project Oct 04 20:35:59.057742 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:35:59.057742 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:35:59.057742 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: 27d65ef150634102b92376fcf3d6d99d Oct 04 20:35:59.057742 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1623291634-project Oct 04 20:35:59.057742 n-d-854823-8 devstack@n-api.service[128801]: method: Oct 04 20:35:59.057742 n-d-854823-8 devstack@n-api.service[128801]: exception: Image not found. Oct 04 20:35:59.057742 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'image_id': 'd6bf1c93-04ba-43eb-8672-161d8791aada', 'id': 'os_version'} Oct 04 20:35:59.057742 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:35:59.058719 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:35:59.058719 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 20:35:59.058719 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 20:35:59.058719 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 20:35:59.058719 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 20:35:59.058719 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 20:35:59.058719 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 20:35:59.058719 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 20:35:59.058719 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 20:35:59.058719 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 20:35:59.058719 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 20:35:59.058719 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 20:35:59.058719 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 20:35:59.058719 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 20:35:59.058719 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 20:35:59.058719 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 20:35:59.058719 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 20:35:59.058719 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID d6bf1c93-04ba-43eb-8672-161d8791aada Oct 04 20:35:59.059788 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:35:59.059788 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:35:59.059788 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:35:59.059788 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:35:59.059788 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 04 20:35:59.059788 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 04 20:35:59.059788 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 04 20:35:59.059788 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 04 20:35:59.059788 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 04 20:35:59.059788 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 04 20:35:59.059788 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 04 20:35:59.059788 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 04 20:35:59.059788 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 20:35:59.059788 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 20:35:59.059788 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 20:35:59.059788 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 20:35:59.059788 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 20:35:59.059788 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 20:35:59.059788 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 20:35:59.059788 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 20:35:59.060883 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 20:35:59.060883 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 20:35:59.060883 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 20:35:59.060883 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 20:35:59.060883 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 20:35:59.060883 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 20:35:59.060883 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 20:35:59.060883 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 20:35:59.060883 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image d6bf1c93-04ba-43eb-8672-161d8791aada could not be found. Oct 04 20:35:59.060883 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:35:59.060883 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:35:59.060883 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:35:59.060883 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:35:59.060883 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:35:59.060883 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:35:59.060883 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:35:59.060883 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:35:59.060883 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:35:59.060883 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:35:59.062440 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:35:59.062440 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:35:59.062440 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 58, in show Oct 04 20:35:59.062440 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Oct 04 20:35:59.062440 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 04 20:35:59.062440 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 04 20:35:59.062440 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 20:35:59.062440 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:35:59.062440 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:35:59.062440 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:35:59.062440 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:35:59.062440 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:35:59.062440 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:35:59.062440 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:35:59.062440 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:35:59.062440 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 20:35:59.062440 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:35:59.062440 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7fcb4876-993a-407a-a455-5ce949846fcd tempest-ImagesMetadataNegativeTestJSON-1623291634 tempest-ImagesMetadataNegativeTestJSON-1623291634-project] Returning 404 to user: Image not found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:35:59.063584 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-7fcb4876-993a-407a-a455-5ce949846fcd tempest-ImagesMetadataNegativeTestJSON-1623291634 tempest-ImagesMetadataNegativeTestJSON-1623291634-project] 10.222.0.33 "GET /compute/v2.1/images/d6bf1c93-04ba-43eb-8672-161d8791aada/metadata/os_version" status: 404 len: 62 microversion: 2.1 time: 0.054260 Oct 04 20:35:59.066995 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 335/661] 10.222.0.33 () {58 vars in 1293 bytes} [Tue Oct 4 20:35:58 2022] GET /compute/v2.1/images/d6bf1c93-04ba-43eb-8672-161d8791aada/metadata/os_version => generated 62 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 20:35:59.093338 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-bcd1681d-e19a-4975-a8f2-d8c74c32c29d tempest-ImagesMetadataNegativeTestJSON-1623291634 tempest-ImagesMetadataNegativeTestJSON-1623291634-project] Calling method '.version_select at 0x7f3c74a01280>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:59.137557 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-bcd1681d-e19a-4975-a8f2-d8c74c32c29d tempest-ImagesMetadataNegativeTestJSON-1623291634 tempest-ImagesMetadataNegativeTestJSON-1623291634-project] HTTP exception thrown: Image not found. Oct 04 20:35:59.140839 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-bcd1681d-e19a-4975-a8f2-d8c74c32c29d tempest-ImagesMetadataNegativeTestJSON-1623291634 tempest-ImagesMetadataNegativeTestJSON-1623291634-project] Request method failure captured: Oct 04 20:35:59.140839 n-d-854823-8 devstack@n-api.service[128801]: request: GET /compute/v2.1/images/c19be955-a370-472b-bf99-4a043a231b03/metadata HTTP/1.1 Oct 04 20:35:59.140839 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:35:59.140839 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:35:59.140839 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:35:59.140839 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 0 Oct 04 20:35:59.140839 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:35:59.140839 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:35:59.140839 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:35:59.140839 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:35:59.140839 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJku_G10m60LEmGOKe0AxskP4Y6UR4e_jcL6Kq2knBcVTDFvH2JxVL8bsFR8lR_mrw7xnNTRg27psFfoNB8MZwLilvTwG9FXJo23dAm1nIT0QcofivZaiaq73ZPKJMxIUNlcx16VpSye9LwsBPq_JObuoGn3ptw0NNFxbMYaBSdHWsM Oct 04 20:35:59.140839 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:35:59.140839 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:35:59.140839 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:35:59.140839 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:35:59.140839 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:35:59.140839 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:35:59.140839 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: 670f0e2542684821b6ceaa8f08a59668 Oct 04 20:35:59.140839 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1623291634 Oct 04 20:35:59.140839 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 20:35:59.140839 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 20:35:59.142396 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_670f0e2542684821b6ceaa8f08a59668", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/670f0e2542684821b6ceaa8f08a59668"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/670f0e2542684821b6ceaa8f08a59668"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/670f0e2542684821b6ceaa8f08a59668"}]}] Oct 04 20:35:59.142396 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1623291634 Oct 04 20:35:59.142396 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: 670f0e2542684821b6ceaa8f08a59668 Oct 04 20:35:59.142396 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1623291634 Oct 04 20:35:59.142396 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-ImagesMetadataNegativeTestJSON-1623291634-project Oct 04 20:35:59.142396 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:35:59.142396 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:35:59.142396 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: 27d65ef150634102b92376fcf3d6d99d Oct 04 20:35:59.142396 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1623291634-project Oct 04 20:35:59.142396 n-d-854823-8 devstack@n-api.service[128801]: method: Oct 04 20:35:59.142396 n-d-854823-8 devstack@n-api.service[128801]: exception: Image not found. Oct 04 20:35:59.142396 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'image_id': 'c19be955-a370-472b-bf99-4a043a231b03'} Oct 04 20:35:59.142396 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:35:59.143280 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:35:59.143280 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 20:35:59.143280 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 20:35:59.143280 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 20:35:59.143280 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 20:35:59.143280 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 20:35:59.143280 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 20:35:59.143280 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 20:35:59.143280 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 20:35:59.143280 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 20:35:59.143280 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 20:35:59.143280 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 20:35:59.143280 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 20:35:59.143280 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 20:35:59.143280 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 20:35:59.143280 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 20:35:59.143280 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 20:35:59.143280 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID c19be955-a370-472b-bf99-4a043a231b03 Oct 04 20:35:59.144453 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:35:59.144453 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:35:59.144453 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:35:59.144453 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:35:59.144453 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 04 20:35:59.144453 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 04 20:35:59.144453 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 04 20:35:59.144453 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 04 20:35:59.144453 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 04 20:35:59.144453 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 04 20:35:59.144453 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 04 20:35:59.144453 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 04 20:35:59.144453 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 20:35:59.144453 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 20:35:59.144453 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 20:35:59.144453 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 20:35:59.144453 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 20:35:59.144453 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 20:35:59.144453 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 20:35:59.144453 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 20:35:59.145765 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 20:35:59.145765 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 20:35:59.145765 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 20:35:59.145765 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 20:35:59.145765 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 20:35:59.145765 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 20:35:59.145765 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 20:35:59.145765 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 20:35:59.145765 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image c19be955-a370-472b-bf99-4a043a231b03 could not be found. Oct 04 20:35:59.145765 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:35:59.145765 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:35:59.145765 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:35:59.145765 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:35:59.145765 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:35:59.145765 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:35:59.145765 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:35:59.145765 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:35:59.145765 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:35:59.145765 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:35:59.147156 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:35:59.147156 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:35:59.147156 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 51, in index Oct 04 20:35:59.147156 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Oct 04 20:35:59.147156 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 04 20:35:59.147156 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 04 20:35:59.147156 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 20:35:59.147156 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:35:59.147156 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:35:59.147156 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:35:59.147156 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:35:59.147156 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:35:59.147156 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:35:59.147156 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:35:59.147156 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:35:59.147156 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 20:35:59.147156 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:35:59.150070 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-bcd1681d-e19a-4975-a8f2-d8c74c32c29d tempest-ImagesMetadataNegativeTestJSON-1623291634 tempest-ImagesMetadataNegativeTestJSON-1623291634-project] Returning 404 to user: Image not found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:35:59.151156 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-bcd1681d-e19a-4975-a8f2-d8c74c32c29d tempest-ImagesMetadataNegativeTestJSON-1623291634 tempest-ImagesMetadataNegativeTestJSON-1623291634-project] 10.222.0.33 "GET /compute/v2.1/images/c19be955-a370-472b-bf99-4a043a231b03/metadata" status: 404 len: 62 microversion: 2.1 time: 0.083014 Oct 04 20:35:59.152197 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 336/662] 10.222.0.33 () {58 vars in 1260 bytes} [Tue Oct 4 20:35:59 2022] GET /compute/v2.1/images/c19be955-a370-472b-bf99-4a043a231b03/metadata => generated 62 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 20:35:59.161854 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1740795f-fc0f-4b52-96b5-80c3843c117f tempest-ImagesMetadataNegativeTestJSON-1623291634 tempest-ImagesMetadataNegativeTestJSON-1623291634-project] Action: 'update_all', calling method: .version_select at 0x7f3c74973ca0>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:35:59.196087 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-1740795f-fc0f-4b52-96b5-80c3843c117f tempest-ImagesMetadataNegativeTestJSON-1623291634 tempest-ImagesMetadataNegativeTestJSON-1623291634-project] HTTP exception thrown: Image not found. Oct 04 20:35:59.198238 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1740795f-fc0f-4b52-96b5-80c3843c117f tempest-ImagesMetadataNegativeTestJSON-1623291634 tempest-ImagesMetadataNegativeTestJSON-1623291634-project] Request method failure captured: Oct 04 20:35:59.198238 n-d-854823-8 devstack@n-api.service[128801]: request: PUT /compute/v2.1/images/58140ada-d866-49e5-b2be-e6108cc35280/metadata HTTP/1.1 Oct 04 20:35:59.198238 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:35:59.198238 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:35:59.198238 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:35:59.198238 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 57 Oct 04 20:35:59.198238 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:35:59.198238 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:35:59.198238 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:35:59.198238 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:35:59.198238 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJku_G10m60LEmGOKe0AxskP4Y6UR4e_jcL6Kq2knBcVTDFvH2JxVL8bsFR8lR_mrw7xnNTRg27psFfoNB8MZwLilvTwG9FXJo23dAm1nIT0QcofivZaiaq73ZPKJMxIUNlcx16VpSye9LwsBPq_JObuoGn3ptw0NNFxbMYaBSdHWsM Oct 04 20:35:59.198238 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:35:59.198238 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:35:59.198238 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:35:59.198238 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:35:59.198238 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:35:59.198238 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:35:59.198238 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: 670f0e2542684821b6ceaa8f08a59668 Oct 04 20:35:59.198238 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1623291634 Oct 04 20:35:59.198238 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 20:35:59.198238 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 20:35:59.199587 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_670f0e2542684821b6ceaa8f08a59668", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/670f0e2542684821b6ceaa8f08a59668"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/670f0e2542684821b6ceaa8f08a59668"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/670f0e2542684821b6ceaa8f08a59668"}]}] Oct 04 20:35:59.199587 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1623291634 Oct 04 20:35:59.199587 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: 670f0e2542684821b6ceaa8f08a59668 Oct 04 20:35:59.199587 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1623291634 Oct 04 20:35:59.199587 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-ImagesMetadataNegativeTestJSON-1623291634-project Oct 04 20:35:59.199587 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:35:59.199587 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:35:59.199587 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: 27d65ef150634102b92376fcf3d6d99d Oct 04 20:35:59.199587 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1623291634-project Oct 04 20:35:59.199587 n-d-854823-8 devstack@n-api.service[128801]: Oct 04 20:35:59.199587 n-d-854823-8 devstack@n-api.service[128801]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Oct 04 20:35:59.199587 n-d-854823-8 devstack@n-api.service[128801]: method: Oct 04 20:35:59.199587 n-d-854823-8 devstack@n-api.service[128801]: exception: Image not found. Oct 04 20:35:59.200444 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'image_id': '58140ada-d866-49e5-b2be-e6108cc35280', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Oct 04 20:35:59.200444 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:35:59.200444 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:35:59.200444 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 20:35:59.200444 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 20:35:59.200444 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 20:35:59.200444 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 20:35:59.200444 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 20:35:59.200444 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 20:35:59.200444 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 20:35:59.200444 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 20:35:59.200444 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 20:35:59.200444 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 20:35:59.200444 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 20:35:59.200444 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 20:35:59.200444 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 20:35:59.200444 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 20:35:59.200444 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 20:35:59.201456 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 20:35:59.201456 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 58140ada-d866-49e5-b2be-e6108cc35280 Oct 04 20:35:59.201456 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:35:59.201456 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:35:59.201456 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:35:59.201456 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:35:59.201456 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 04 20:35:59.201456 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 04 20:35:59.201456 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 04 20:35:59.201456 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 04 20:35:59.201456 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 04 20:35:59.201456 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 04 20:35:59.201456 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 04 20:35:59.201456 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 04 20:35:59.201456 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 20:35:59.201456 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 20:35:59.201456 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 20:35:59.201456 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 20:35:59.201456 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 20:35:59.201456 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 20:35:59.202631 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 20:35:59.202631 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 20:35:59.202631 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 20:35:59.202631 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 20:35:59.202631 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 20:35:59.202631 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 20:35:59.202631 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 20:35:59.202631 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 20:35:59.202631 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 20:35:59.202631 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 20:35:59.202631 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 58140ada-d866-49e5-b2be-e6108cc35280 could not be found. Oct 04 20:35:59.202631 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:35:59.202631 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:35:59.202631 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:35:59.202631 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:35:59.202631 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:35:59.202631 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:35:59.202631 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:35:59.202631 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:35:59.205600 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:35:59.205600 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:35:59.205600 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:35:59.205600 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:35:59.205600 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:35:59.205600 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:35:59.205600 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 109, in update_all Oct 04 20:35:59.205600 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 04 20:35:59.205600 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 04 20:35:59.205600 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 04 20:35:59.205600 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 20:35:59.205600 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:35:59.205600 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:35:59.205600 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:35:59.205600 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:35:59.205600 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:35:59.205600 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:35:59.205600 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:35:59.205600 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:35:59.205600 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 20:35:59.205600 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:35:59.208340 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1740795f-fc0f-4b52-96b5-80c3843c117f tempest-ImagesMetadataNegativeTestJSON-1623291634 tempest-ImagesMetadataNegativeTestJSON-1623291634-project] Returning 404 to user: Image not found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:35:59.208340 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-1740795f-fc0f-4b52-96b5-80c3843c117f tempest-ImagesMetadataNegativeTestJSON-1623291634 tempest-ImagesMetadataNegativeTestJSON-1623291634-project] 10.222.0.33 "PUT /compute/v2.1/images/58140ada-d866-49e5-b2be-e6108cc35280/metadata" status: 404 len: 62 microversion: 2.1 time: 0.042355 Oct 04 20:35:59.208340 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 337/663] 10.222.0.33 () {60 vars in 1280 bytes} [Tue Oct 4 20:35:59 2022] PUT /compute/v2.1/images/58140ada-d866-49e5-b2be-e6108cc35280/metadata => generated 62 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 04 20:35:59.213008 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a9747dba-7723-477e-b32c-02700d57c1f2 tempest-ImagesMetadataNegativeTestJSON-1623291634 tempest-ImagesMetadataNegativeTestJSON-1623291634-project] Action: 'update', calling method: .version_select at 0x7f3c74a65790>, body: {"meta": {"os_distro": "alt"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:35:59.270314 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-a9747dba-7723-477e-b32c-02700d57c1f2 tempest-ImagesMetadataNegativeTestJSON-1623291634 tempest-ImagesMetadataNegativeTestJSON-1623291634-project] HTTP exception thrown: Image not found. Oct 04 20:35:59.273022 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a9747dba-7723-477e-b32c-02700d57c1f2 tempest-ImagesMetadataNegativeTestJSON-1623291634 tempest-ImagesMetadataNegativeTestJSON-1623291634-project] Request method failure captured: Oct 04 20:35:59.273022 n-d-854823-8 devstack@n-api.service[128801]: request: PUT /compute/v2.1/images/c835d65f-8678-4b3f-b8f2-97856bae5989/metadata/os_distro HTTP/1.1 Oct 04 20:35:59.273022 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:35:59.273022 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:35:59.273022 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:35:59.273022 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 30 Oct 04 20:35:59.273022 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:35:59.273022 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:35:59.273022 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:35:59.273022 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:35:59.273022 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJku_G10m60LEmGOKe0AxskP4Y6UR4e_jcL6Kq2knBcVTDFvH2JxVL8bsFR8lR_mrw7xnNTRg27psFfoNB8MZwLilvTwG9FXJo23dAm1nIT0QcofivZaiaq73ZPKJMxIUNlcx16VpSye9LwsBPq_JObuoGn3ptw0NNFxbMYaBSdHWsM Oct 04 20:35:59.273022 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:35:59.273022 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:35:59.273022 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:35:59.273022 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:35:59.273022 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:35:59.273022 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:35:59.273022 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: 670f0e2542684821b6ceaa8f08a59668 Oct 04 20:35:59.273022 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1623291634 Oct 04 20:35:59.273022 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 20:35:59.273022 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 20:35:59.274804 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_670f0e2542684821b6ceaa8f08a59668", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/670f0e2542684821b6ceaa8f08a59668"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/670f0e2542684821b6ceaa8f08a59668"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/670f0e2542684821b6ceaa8f08a59668"}]}] Oct 04 20:35:59.274804 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1623291634 Oct 04 20:35:59.274804 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: 670f0e2542684821b6ceaa8f08a59668 Oct 04 20:35:59.274804 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1623291634 Oct 04 20:35:59.274804 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-ImagesMetadataNegativeTestJSON-1623291634-project Oct 04 20:35:59.274804 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:35:59.274804 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:35:59.274804 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: 27d65ef150634102b92376fcf3d6d99d Oct 04 20:35:59.274804 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1623291634-project Oct 04 20:35:59.274804 n-d-854823-8 devstack@n-api.service[128801]: Oct 04 20:35:59.274804 n-d-854823-8 devstack@n-api.service[128801]: {"meta": {"os_distro": "alt"}} Oct 04 20:35:59.274804 n-d-854823-8 devstack@n-api.service[128801]: method: Oct 04 20:35:59.274804 n-d-854823-8 devstack@n-api.service[128801]: exception: Image not found. Oct 04 20:35:59.274804 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'image_id': 'c835d65f-8678-4b3f-b8f2-97856bae5989', 'id': 'os_distro', 'body': {'meta': {'os_distro': 'alt'}}} Oct 04 20:35:59.275765 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:35:59.275765 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:35:59.275765 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 20:35:59.275765 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 20:35:59.275765 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 20:35:59.275765 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 20:35:59.275765 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 20:35:59.275765 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 20:35:59.275765 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 20:35:59.275765 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 20:35:59.275765 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 20:35:59.275765 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 20:35:59.275765 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 20:35:59.275765 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 20:35:59.275765 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 20:35:59.275765 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 20:35:59.275765 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 20:35:59.275765 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 20:35:59.276957 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID c835d65f-8678-4b3f-b8f2-97856bae5989 Oct 04 20:35:59.276957 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:35:59.276957 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:35:59.276957 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:35:59.276957 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:35:59.276957 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 04 20:35:59.276957 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 04 20:35:59.276957 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 04 20:35:59.276957 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 04 20:35:59.276957 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 04 20:35:59.276957 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 04 20:35:59.276957 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 04 20:35:59.276957 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 04 20:35:59.276957 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 20:35:59.276957 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 20:35:59.276957 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 20:35:59.276957 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 20:35:59.276957 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 20:35:59.276957 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 20:35:59.278254 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 20:35:59.278254 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 20:35:59.278254 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 20:35:59.278254 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 20:35:59.278254 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 20:35:59.278254 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 20:35:59.278254 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 20:35:59.278254 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 20:35:59.278254 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 20:35:59.278254 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 20:35:59.278254 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image c835d65f-8678-4b3f-b8f2-97856bae5989 could not be found. Oct 04 20:35:59.278254 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:35:59.278254 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:35:59.278254 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:35:59.278254 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:35:59.278254 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:35:59.278254 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:35:59.278254 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:35:59.278254 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:35:59.279637 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:35:59.279637 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:35:59.279637 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:35:59.279637 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:35:59.279637 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:35:59.279637 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:35:59.279637 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 93, in update Oct 04 20:35:59.279637 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 04 20:35:59.279637 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 04 20:35:59.279637 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 04 20:35:59.279637 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 20:35:59.279637 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:35:59.279637 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:35:59.279637 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:35:59.279637 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:35:59.279637 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:35:59.279637 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:35:59.279637 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:35:59.279637 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:35:59.279637 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 20:35:59.279637 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:35:59.283352 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a9747dba-7723-477e-b32c-02700d57c1f2 tempest-ImagesMetadataNegativeTestJSON-1623291634 tempest-ImagesMetadataNegativeTestJSON-1623291634-project] Returning 404 to user: Image not found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:35:59.283352 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a9747dba-7723-477e-b32c-02700d57c1f2 tempest-ImagesMetadataNegativeTestJSON-1623291634 tempest-ImagesMetadataNegativeTestJSON-1623291634-project] 10.222.0.33 "PUT /compute/v2.1/images/c835d65f-8678-4b3f-b8f2-97856bae5989/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.076809 Oct 04 20:35:59.284044 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 338/664] 10.222.0.33 () {60 vars in 1310 bytes} [Tue Oct 4 20:35:59 2022] PUT /compute/v2.1/images/c835d65f-8678-4b3f-b8f2-97856bae5989/metadata/os_distro => generated 62 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 04 20:35:59.297841 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-540ee6a6-ff2c-4251-a12c-378986951770 tempest-ImagesMetadataNegativeTestJSON-1623291634 tempest-ImagesMetadataNegativeTestJSON-1623291634-project] Action: 'create', calling method: .version_select at 0x7f3c74a01670>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:35:59.330941 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-540ee6a6-ff2c-4251-a12c-378986951770 tempest-ImagesMetadataNegativeTestJSON-1623291634 tempest-ImagesMetadataNegativeTestJSON-1623291634-project] HTTP exception thrown: Image not found. Oct 04 20:35:59.333802 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-540ee6a6-ff2c-4251-a12c-378986951770 tempest-ImagesMetadataNegativeTestJSON-1623291634 tempest-ImagesMetadataNegativeTestJSON-1623291634-project] Request method failure captured: Oct 04 20:35:59.333802 n-d-854823-8 devstack@n-api.service[128801]: request: POST /compute/v2.1/images/a87fda41-d662-4367-ae58-6cbe50b54c1a/metadata HTTP/1.1 Oct 04 20:35:59.333802 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:35:59.333802 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:35:59.333802 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:35:59.333802 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 57 Oct 04 20:35:59.333802 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:35:59.333802 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:35:59.333802 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:35:59.333802 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:35:59.333802 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJku_G10m60LEmGOKe0AxskP4Y6UR4e_jcL6Kq2knBcVTDFvH2JxVL8bsFR8lR_mrw7xnNTRg27psFfoNB8MZwLilvTwG9FXJo23dAm1nIT0QcofivZaiaq73ZPKJMxIUNlcx16VpSye9LwsBPq_JObuoGn3ptw0NNFxbMYaBSdHWsM Oct 04 20:35:59.333802 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:35:59.333802 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:35:59.333802 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:35:59.333802 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:35:59.333802 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:35:59.333802 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:35:59.333802 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: 670f0e2542684821b6ceaa8f08a59668 Oct 04 20:35:59.333802 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1623291634 Oct 04 20:35:59.333802 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 20:35:59.333802 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 20:35:59.335771 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_670f0e2542684821b6ceaa8f08a59668", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/670f0e2542684821b6ceaa8f08a59668"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/670f0e2542684821b6ceaa8f08a59668"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/670f0e2542684821b6ceaa8f08a59668"}]}] Oct 04 20:35:59.335771 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1623291634 Oct 04 20:35:59.335771 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: 670f0e2542684821b6ceaa8f08a59668 Oct 04 20:35:59.335771 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1623291634 Oct 04 20:35:59.335771 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-ImagesMetadataNegativeTestJSON-1623291634-project Oct 04 20:35:59.335771 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:35:59.335771 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:35:59.335771 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: 27d65ef150634102b92376fcf3d6d99d Oct 04 20:35:59.335771 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1623291634-project Oct 04 20:35:59.335771 n-d-854823-8 devstack@n-api.service[128801]: Oct 04 20:35:59.335771 n-d-854823-8 devstack@n-api.service[128801]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Oct 04 20:35:59.335771 n-d-854823-8 devstack@n-api.service[128801]: method: Oct 04 20:35:59.335771 n-d-854823-8 devstack@n-api.service[128801]: exception: Image not found. Oct 04 20:35:59.335771 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'image_id': 'a87fda41-d662-4367-ae58-6cbe50b54c1a', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Oct 04 20:35:59.336622 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:35:59.336622 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:35:59.336622 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 20:35:59.336622 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 20:35:59.336622 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 20:35:59.336622 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 20:35:59.336622 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 20:35:59.336622 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 20:35:59.336622 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 20:35:59.336622 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 20:35:59.336622 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 20:35:59.336622 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 20:35:59.336622 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 20:35:59.336622 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 20:35:59.336622 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 20:35:59.336622 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 20:35:59.336622 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 20:35:59.336622 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 20:35:59.338450 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID a87fda41-d662-4367-ae58-6cbe50b54c1a Oct 04 20:35:59.338450 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:35:59.338450 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:35:59.338450 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:35:59.338450 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:35:59.338450 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 04 20:35:59.338450 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 04 20:35:59.338450 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 04 20:35:59.338450 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 04 20:35:59.338450 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 04 20:35:59.338450 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 04 20:35:59.338450 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 04 20:35:59.338450 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 04 20:35:59.338450 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 20:35:59.338450 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 20:35:59.338450 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 20:35:59.338450 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 20:35:59.338450 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 20:35:59.338450 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 20:35:59.339523 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 20:35:59.339523 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 20:35:59.339523 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 20:35:59.339523 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 20:35:59.339523 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 20:35:59.339523 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 20:35:59.339523 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 20:35:59.339523 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 20:35:59.339523 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 20:35:59.339523 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 20:35:59.339523 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image a87fda41-d662-4367-ae58-6cbe50b54c1a could not be found. Oct 04 20:35:59.339523 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:35:59.339523 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:35:59.339523 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:35:59.339523 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:35:59.339523 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:35:59.339523 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:35:59.339523 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:35:59.339523 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:35:59.340565 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:35:59.340565 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:35:59.340565 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:35:59.340565 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:35:59.340565 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:35:59.340565 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:35:59.340565 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 69, in create Oct 04 20:35:59.340565 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 04 20:35:59.340565 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 04 20:35:59.340565 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 04 20:35:59.340565 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 20:35:59.340565 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:35:59.340565 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:35:59.340565 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:35:59.340565 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:35:59.340565 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:35:59.340565 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:35:59.340565 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:35:59.340565 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:35:59.340565 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 20:35:59.340565 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:35:59.343178 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-540ee6a6-ff2c-4251-a12c-378986951770 tempest-ImagesMetadataNegativeTestJSON-1623291634 tempest-ImagesMetadataNegativeTestJSON-1623291634-project] Returning 404 to user: Image not found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:35:59.343178 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-540ee6a6-ff2c-4251-a12c-378986951770 tempest-ImagesMetadataNegativeTestJSON-1623291634 tempest-ImagesMetadataNegativeTestJSON-1623291634-project] 10.222.0.33 "POST /compute/v2.1/images/a87fda41-d662-4367-ae58-6cbe50b54c1a/metadata" status: 404 len: 62 microversion: 2.1 time: 0.045884 Oct 04 20:35:59.343178 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 339/665] 10.222.0.33 () {60 vars in 1281 bytes} [Tue Oct 4 20:35:59 2022] POST /compute/v2.1/images/a87fda41-d662-4367-ae58-6cbe50b54c1a/metadata => generated 62 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 20:35:59.368339 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-3c920e2e-1c75-4669-97a3-e2d6f801c98c req-2b1e704b-bff2-44da-8553-d6a2b89fa862 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3667992-a213-4da4-a172-8ab92ff3b2ca", "name": "network-vif-plugged", "status": "completed", "tag": "e5b970a5-881c-4fd8-852b-0dc92a104d9a"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:35:59.408130 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-3c920e2e-1c75-4669-97a3-e2d6f801c98c req-2b1e704b-bff2-44da-8553-d6a2b89fa862 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:59.410161 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-3c920e2e-1c75-4669-97a3-e2d6f801c98c req-2b1e704b-bff2-44da-8553-d6a2b89fa862 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:59.411376 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-3c920e2e-1c75-4669-97a3-e2d6f801c98c req-2b1e704b-bff2-44da-8553-d6a2b89fa862 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:59.425108 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-9407e357-d440-4df3-acdd-357945b4c6f6 tempest-InstanceUsageAuditLogNegativeTestJSON-877358957 tempest-InstanceUsageAuditLogNegativeTestJSON-877358957-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:59.434308 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-9407e357-d440-4df3-acdd-357945b4c6f6 tempest-InstanceUsageAuditLogNegativeTestJSON-877358957 tempest-InstanceUsageAuditLogNegativeTestJSON-877358957-project] Policy check for os_compute_api:os-instance-usage-audit-log:list failed with credentials {'is_admin': False, 'user_id': '45aed3e3180d471a8cec04f51a9bb7f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1438eef7f6ee44f6b1546e2fff9a705a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:59.440165 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-9407e357-d440-4df3-acdd-357945b4c6f6 tempest-InstanceUsageAuditLogNegativeTestJSON-877358957 tempest-InstanceUsageAuditLogNegativeTestJSON-877358957-project] Request method failure captured: Oct 04 20:35:59.440165 n-d-854823-8 devstack@n-api.service[128802]: request: GET /compute/v2.1/os-instance_usage_audit_log HTTP/1.1 Oct 04 20:35:59.440165 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 20:35:59.440165 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 20:35:59.440165 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 20:35:59.440165 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 0 Oct 04 20:35:59.440165 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 20:35:59.440165 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 20:35:59.440165 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 20:35:59.440165 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 20:35:59.440165 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPJkrVVzJob12jr0RiExZwTzvGCy0HWvtvyr7vDzoqTozQ5M53UO0euO0DeNEgH-p7-RhwGzssC4O8xrdL_dkdLQkVuAyhhgeGmJvyzgNkUmp46LlWZOtecQbhL8jZhid6uEF7Qzwi9LF1FAF1lQIqvFEroTArd_DO0aevLcBeVXF9Rc Oct 04 20:35:59.440165 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 20:35:59.440165 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 20:35:59.440165 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 20:35:59.440165 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 20:35:59.440165 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 20:35:59.440165 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 20:35:59.440165 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: 1438eef7f6ee44f6b1546e2fff9a705a Oct 04 20:35:59.440165 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-877358957 Oct 04 20:35:59.440165 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 20:35:59.440165 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 20:35:59.441677 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_1438eef7f6ee44f6b1546e2fff9a705a", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1438eef7f6ee44f6b1546e2fff9a705a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1438eef7f6ee44f6b1546e2fff9a705a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/1438eef7f6ee44f6b1546e2fff9a705a"}]}] Oct 04 20:35:59.441677 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-877358957 Oct 04 20:35:59.441677 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: 1438eef7f6ee44f6b1546e2fff9a705a Oct 04 20:35:59.441677 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-877358957 Oct 04 20:35:59.441677 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-877358957-project Oct 04 20:35:59.441677 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 20:35:59.441677 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 20:35:59.441677 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: 45aed3e3180d471a8cec04f51a9bb7f3 Oct 04 20:35:59.441677 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-877358957-project Oct 04 20:35:59.441677 n-d-854823-8 devstack@n-api.service[128802]: method: > Oct 04 20:35:59.442493 n-d-854823-8 devstack@n-api.service[128802]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Oct 04 20:35:59.442493 n-d-854823-8 devstack@n-api.service[128802]: action_args: {} Oct 04 20:35:59.442493 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:35:59.442493 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:35:59.442493 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:35:59.442493 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:35:59.442493 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:35:59.442493 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:35:59.442493 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:35:59.442493 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:35:59.442493 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 38, in index Oct 04 20:35:59.442493 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'list', target={}) Oct 04 20:35:59.442493 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 20:35:59.442493 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 20:35:59.442493 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 20:35:59.442493 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 20:35:59.442493 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 20:35:59.442493 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 20:35:59.442493 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 20:35:59.442493 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 20:35:59.443953 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 20:35:59.443953 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 20:35:59.443953 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 20:35:59.443953 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 20:35:59.443953 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 20:35:59.443953 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 20:35:59.443953 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Oct 04 20:35:59.443953 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:35:59.443953 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:35:59.443953 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:35:59.443953 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:35:59.443953 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:35:59.443953 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:35:59.443953 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 20:35:59.443953 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 20:35:59.443953 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Oct 04 20:35:59.443953 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:35:59.447568 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-9407e357-d440-4df3-acdd-357945b4c6f6 tempest-InstanceUsageAuditLogNegativeTestJSON-877358957 tempest-InstanceUsageAuditLogNegativeTestJSON-877358957-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:35:59.448788 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-9407e357-d440-4df3-acdd-357945b4c6f6 tempest-InstanceUsageAuditLogNegativeTestJSON-877358957 tempest-InstanceUsageAuditLogNegativeTestJSON-877358957-project] 10.222.0.33 "GET /compute/v2.1/os-instance_usage_audit_log" status: 403 len: 128 microversion: 2.1 time: 0.633692 Oct 04 20:35:59.452686 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 327/666] 10.222.0.33 () {58 vars in 1185 bytes} [Tue Oct 4 20:35:58 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 128 bytes in 635 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:35:59.454137 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-3c920e2e-1c75-4669-97a3-e2d6f801c98c req-2b1e704b-bff2-44da-8553-d6a2b89fa862 service nova] Creating event network-vif-plugged:e5b970a5-881c-4fd8-852b-0dc92a104d9a for instance b3667992-a213-4da4-a172-8ab92ff3b2ca on n-h1-854823-8 Oct 04 20:35:59.462242 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-d01cb1f1-53d3-4ef4-8be9-104b5cc94adb tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:59.463448 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-d01cb1f1-53d3-4ef4-8be9-104b5cc94adb tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] [instance: b3667992-a213-4da4-a172-8ab92ff3b2ca] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:35:59.470385 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-3c920e2e-1c75-4669-97a3-e2d6f801c98c req-2b1e704b-bff2-44da-8553-d6a2b89fa862 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132643 Oct 04 20:35:59.471443 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d01cb1f1-53d3-4ef4-8be9-104b5cc94adb tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:59.472143 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d01cb1f1-53d3-4ef4-8be9-104b5cc94adb tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:59.472871 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d01cb1f1-53d3-4ef4-8be9-104b5cc94adb tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:59.474107 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d01cb1f1-53d3-4ef4-8be9-104b5cc94adb tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:35:59.474777 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d01cb1f1-53d3-4ef4-8be9-104b5cc94adb tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:35:59.476713 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 340/667] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:35:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:35:59.480027 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d01cb1f1-53d3-4ef4-8be9-104b5cc94adb tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:35:59.482506 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b88890fa-f8de-4064-a663-6c09c9626d0b tempest-InstanceUsageAuditLogNegativeTestJSON-877358957 tempest-InstanceUsageAuditLogNegativeTestJSON-877358957-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:35:59.484242 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-b88890fa-f8de-4064-a663-6c09c9626d0b tempest-InstanceUsageAuditLogNegativeTestJSON-877358957 tempest-InstanceUsageAuditLogNegativeTestJSON-877358957-project] Policy check for os_compute_api:os-instance-usage-audit-log:show failed with credentials {'is_admin': False, 'user_id': '45aed3e3180d471a8cec04f51a9bb7f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1438eef7f6ee44f6b1546e2fff9a705a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:59.485913 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b88890fa-f8de-4064-a663-6c09c9626d0b tempest-InstanceUsageAuditLogNegativeTestJSON-877358957 tempest-InstanceUsageAuditLogNegativeTestJSON-877358957-project] Request method failure captured: Oct 04 20:35:59.485913 n-d-854823-8 devstack@n-api.service[128801]: request: GET /compute/v2.1/os-instance_usage_audit_log/2022-10-04%2020:35:59 HTTP/1.1 Oct 04 20:35:59.485913 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:35:59.485913 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:35:59.485913 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:35:59.485913 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 0 Oct 04 20:35:59.485913 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:35:59.485913 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:35:59.485913 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:35:59.485913 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:35:59.485913 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJkrVVzJob12jr0RiExZwTzvGCy0HWvtvyr7vDzoqTozQ5M53UO0euO0DeNEgH-p7-RhwGzssC4O8xrdL_dkdLQkVuAyhhgeGmJvyzgNkUmp46LlWZOtecQbhL8jZhid6uEF7Qzwi9LF1FAF1lQIqvFEroTArd_DO0aevLcBeVXF9Rc Oct 04 20:35:59.485913 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:35:59.485913 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:35:59.485913 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:35:59.485913 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:35:59.485913 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:35:59.485913 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:35:59.485913 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: 1438eef7f6ee44f6b1546e2fff9a705a Oct 04 20:35:59.485913 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-877358957 Oct 04 20:35:59.485913 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 20:35:59.485913 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 20:35:59.487218 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_1438eef7f6ee44f6b1546e2fff9a705a", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1438eef7f6ee44f6b1546e2fff9a705a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1438eef7f6ee44f6b1546e2fff9a705a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/1438eef7f6ee44f6b1546e2fff9a705a"}]}] Oct 04 20:35:59.487218 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-877358957 Oct 04 20:35:59.487218 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: 1438eef7f6ee44f6b1546e2fff9a705a Oct 04 20:35:59.487218 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-877358957 Oct 04 20:35:59.487218 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-877358957-project Oct 04 20:35:59.487218 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:35:59.487218 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:35:59.487218 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: 45aed3e3180d471a8cec04f51a9bb7f3 Oct 04 20:35:59.487218 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-877358957-project Oct 04 20:35:59.487218 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 20:35:59.487830 n-d-854823-8 devstack@n-api.service[128801]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Oct 04 20:35:59.487830 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': '2022-10-04 20:35:59'} Oct 04 20:35:59.487830 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:35:59.487830 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:35:59.487830 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:35:59.487830 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:35:59.487830 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:35:59.487830 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:35:59.487830 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:35:59.487830 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:35:59.487830 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 45, in show Oct 04 20:35:59.487830 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'show', target={}) Oct 04 20:35:59.487830 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 20:35:59.487830 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 20:35:59.487830 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 20:35:59.487830 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 20:35:59.487830 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 20:35:59.487830 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 20:35:59.487830 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 20:35:59.487830 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 20:35:59.489012 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 20:35:59.489012 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 20:35:59.489012 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 20:35:59.489012 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 20:35:59.489012 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 20:35:59.489012 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 20:35:59.489012 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Oct 04 20:35:59.489012 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:35:59.489012 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:35:59.489012 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:35:59.489012 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:35:59.489012 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:35:59.489012 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:35:59.489012 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 20:35:59.489012 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 20:35:59.489012 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Oct 04 20:35:59.489012 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:35:59.504084 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b88890fa-f8de-4064-a663-6c09c9626d0b tempest-InstanceUsageAuditLogNegativeTestJSON-877358957 tempest-InstanceUsageAuditLogNegativeTestJSON-877358957-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:35:59.507957 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b88890fa-f8de-4064-a663-6c09c9626d0b tempest-InstanceUsageAuditLogNegativeTestJSON-877358957 tempest-InstanceUsageAuditLogNegativeTestJSON-877358957-project] 10.222.0.33 "GET /compute/v2.1/os-instance_usage_audit_log/2022-10-04 20:35:59" status: 403 len: 128 microversion: 2.1 time: 0.029718 Oct 04 20:35:59.516108 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 341/668] 10.222.0.33 () {58 vars in 1251 bytes} [Tue Oct 4 20:35:59 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-10-04%2020%3A35%3A59 => generated 128 bytes in 39 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:35:59.740103 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-d01cb1f1-53d3-4ef4-8be9-104b5cc94adb tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a24944aeb34a5ea228965be9bf4ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c288268acb30475bbc065a8f72cb21d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:35:59.756270 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-d01cb1f1-53d3-4ef4-8be9-104b5cc94adb tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] 10.222.0.33 "GET /compute/v2.1/servers/b3667992-a213-4da4-a172-8ab92ff3b2ca" status: 200 len: 1313 microversion: 2.1 time: 0.299112 Oct 04 20:35:59.758574 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 328/669] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:59 2022] GET /compute/v2.1/servers/b3667992-a213-4da4-a172-8ab92ff3b2ca => generated 1313 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:36:00.003051 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5a33235a-ef31-4d65-aa0e-dd89ed278e05 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:00.003889 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-5a33235a-ef31-4d65-aa0e-dd89ed278e05 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] [instance: c7f3bb5b-e08b-4a3f-ba4d-40012179412e] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:00.017681 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5a33235a-ef31-4d65-aa0e-dd89ed278e05 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:00.018325 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5a33235a-ef31-4d65-aa0e-dd89ed278e05 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:00.018965 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5a33235a-ef31-4d65-aa0e-dd89ed278e05 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:00.025224 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5a33235a-ef31-4d65-aa0e-dd89ed278e05 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:00.026592 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5a33235a-ef31-4d65-aa0e-dd89ed278e05 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:00.027258 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5a33235a-ef31-4d65-aa0e-dd89ed278e05 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:00.280710 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-5a33235a-ef31-4d65-aa0e-dd89ed278e05 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3563efe2b8c94931a2a46c4e14811b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3118a5d96843d3bede1ed94bd9717e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:00.292344 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5a33235a-ef31-4d65-aa0e-dd89ed278e05 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] 10.222.0.33 "GET /compute/v2.1/servers/c7f3bb5b-e08b-4a3f-ba4d-40012179412e" status: 200 len: 1476 microversion: 2.1 time: 0.290818 Oct 04 20:36:00.293916 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 342/670] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:35:59 2022] GET /compute/v2.1/servers/c7f3bb5b-e08b-4a3f-ba4d-40012179412e => generated 1476 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:36:00.781034 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-1269e8d2-c7ba-4099-b54e-bb7ff598c645 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:00.782194 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-1269e8d2-c7ba-4099-b54e-bb7ff598c645 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] [instance: b3667992-a213-4da4-a172-8ab92ff3b2ca] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:00.794649 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1269e8d2-c7ba-4099-b54e-bb7ff598c645 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:00.795483 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1269e8d2-c7ba-4099-b54e-bb7ff598c645 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:00.796246 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1269e8d2-c7ba-4099-b54e-bb7ff598c645 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:00.797941 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1269e8d2-c7ba-4099-b54e-bb7ff598c645 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:00.798820 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1269e8d2-c7ba-4099-b54e-bb7ff598c645 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:00.800697 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1269e8d2-c7ba-4099-b54e-bb7ff598c645 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:01.354384 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-338de07a-9ea6-455e-833b-04108eb398c1 tempest-NetworksTest-606630687 tempest-NetworksTest-606630687-project-admin] Calling method '.version_select at 0x7f3c74a01040>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:01.368018 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-1269e8d2-c7ba-4099-b54e-bb7ff598c645 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a24944aeb34a5ea228965be9bf4ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c288268acb30475bbc065a8f72cb21d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:01.396409 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-1269e8d2-c7ba-4099-b54e-bb7ff598c645 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] 10.222.0.33 "GET /compute/v2.1/servers/b3667992-a213-4da4-a172-8ab92ff3b2ca" status: 200 len: 1313 microversion: 2.1 time: 0.600861 Oct 04 20:36:01.400599 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 329/671] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:36:00 2022] GET /compute/v2.1/servers/b3667992-a213-4da4-a172-8ab92ff3b2ca => generated 1313 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:36:01.424047 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-800e1240-fdc6-4d20-ae34-3282ead51ac1 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:01.425011 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-800e1240-fdc6-4d20-ae34-3282ead51ac1 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] [instance: c7f3bb5b-e08b-4a3f-ba4d-40012179412e] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:01.453131 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-800e1240-fdc6-4d20-ae34-3282ead51ac1 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:01.453699 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-800e1240-fdc6-4d20-ae34-3282ead51ac1 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:01.454150 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-800e1240-fdc6-4d20-ae34-3282ead51ac1 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:01.458078 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-800e1240-fdc6-4d20-ae34-3282ead51ac1 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:01.461766 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-800e1240-fdc6-4d20-ae34-3282ead51ac1 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:01.463204 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-800e1240-fdc6-4d20-ae34-3282ead51ac1 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:01.526014 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=100 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:36:02.123597 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-338de07a-9ea6-455e-833b-04108eb398c1 tempest-NetworksTest-606630687 tempest-NetworksTest-606630687-project-admin] 10.222.0.33 "GET /compute/v2.1/os-networks" status: 200 len: 5382 microversion: 2.1 time: 1.033551 Oct 04 20:36:02.128125 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 343/672] 10.222.0.33 () {58 vars in 1137 bytes} [Tue Oct 4 20:36:01 2022] GET /compute/v2.1/os-networks => generated 5382 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:36:02.134586 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9b1aebe1-1ae5-4f87-bf43-7cbfc30dbb14 tempest-NetworksTest-606630687 tempest-NetworksTest-606630687-project-admin] Calling method '.version_select at 0x7f3c74a01700>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:02.325715 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-800e1240-fdc6-4d20-ae34-3282ead51ac1 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3563efe2b8c94931a2a46c4e14811b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3118a5d96843d3bede1ed94bd9717e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:02.337096 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-800e1240-fdc6-4d20-ae34-3282ead51ac1 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] 10.222.0.33 "GET /compute/v2.1/servers/c7f3bb5b-e08b-4a3f-ba4d-40012179412e" status: 200 len: 1476 microversion: 2.1 time: 0.935236 Oct 04 20:36:02.344247 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 330/673] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:36:01 2022] GET /compute/v2.1/servers/c7f3bb5b-e08b-4a3f-ba4d-40012179412e => generated 1476 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:36:02.423739 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-88669085-91e3-454e-b7aa-f2e0e00c31e2 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:02.424593 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-88669085-91e3-454e-b7aa-f2e0e00c31e2 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] [instance: b3667992-a213-4da4-a172-8ab92ff3b2ca] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:02.433519 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-88669085-91e3-454e-b7aa-f2e0e00c31e2 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:02.435807 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-88669085-91e3-454e-b7aa-f2e0e00c31e2 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:02.440130 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-88669085-91e3-454e-b7aa-f2e0e00c31e2 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:02.441515 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-88669085-91e3-454e-b7aa-f2e0e00c31e2 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:02.444088 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-88669085-91e3-454e-b7aa-f2e0e00c31e2 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:02.445365 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-88669085-91e3-454e-b7aa-f2e0e00c31e2 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:02.503940 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-9b1aebe1-1ae5-4f87-bf43-7cbfc30dbb14 tempest-NetworksTest-606630687 tempest-NetworksTest-606630687-project-admin] 10.222.0.33 "GET /compute/v2.1/os-networks/7ace76e5-f8c6-495a-b11c-0ae1f7a6ece8" status: 200 len: 652 microversion: 2.1 time: 0.374421 Oct 04 20:36:02.507857 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 344/674] 10.222.0.33 () {58 vars in 1248 bytes} [Tue Oct 4 20:36:02 2022] GET /compute/v2.1/os-networks/7ace76e5-f8c6-495a-b11c-0ae1f7a6ece8 => generated 652 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:36:02.521892 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a92b11a6-22ba-4cba-b30d-8ceb2e9dac67 tempest-NetworksTest-606630687 tempest-NetworksTest-606630687-project-admin] Calling method '.version_select at 0x7f3c74987a60>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:02.882762 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-88669085-91e3-454e-b7aa-f2e0e00c31e2 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a24944aeb34a5ea228965be9bf4ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c288268acb30475bbc065a8f72cb21d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:02.899581 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-88669085-91e3-454e-b7aa-f2e0e00c31e2 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] 10.222.0.33 "GET /compute/v2.1/servers/b3667992-a213-4da4-a172-8ab92ff3b2ca" status: 200 len: 1462 microversion: 2.1 time: 0.479733 Oct 04 20:36:02.920373 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 331/675] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:36:02 2022] GET /compute/v2.1/servers/b3667992-a213-4da4-a172-8ab92ff3b2ca => generated 1462 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:36:02.947627 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a92b11a6-22ba-4cba-b30d-8ceb2e9dac67 tempest-NetworksTest-606630687 tempest-NetworksTest-606630687-project-admin] 10.222.0.33 "GET /compute/v2.1/os-networks" status: 200 len: 5382 microversion: 2.1 time: 0.434853 Oct 04 20:36:02.948575 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 345/676] 10.222.0.33 () {58 vars in 1137 bytes} [Tue Oct 4 20:36:02 2022] GET /compute/v2.1/os-networks => generated 5382 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:36:03.330774 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-3f7bcbf1-19d1-4bb2-baa7-f3241b87bca7 tempest-ServersAdminTestJSON-718875626 tempest-ServersAdminTestJSON-718875626-project-admin] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:03.369357 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-169a967a-b107-4f05-82e8-96d2610c8593 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:03.370178 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-169a967a-b107-4f05-82e8-96d2610c8593 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] [instance: c7f3bb5b-e08b-4a3f-ba4d-40012179412e] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:03.372524 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-3f7bcbf1-19d1-4bb2-baa7-f3241b87bca7 tempest-ServersAdminTestJSON-718875626 tempest-ServersAdminTestJSON-718875626-project-admin] Searching by: {'deleted': False, 'project_id': 'cde7b3e4fabe46f6b737684276634d81'} {{(pid=128802) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 20:36:03.395203 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-169a967a-b107-4f05-82e8-96d2610c8593 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:03.395712 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-169a967a-b107-4f05-82e8-96d2610c8593 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:03.396158 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-169a967a-b107-4f05-82e8-96d2610c8593 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:03.396881 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-169a967a-b107-4f05-82e8-96d2610c8593 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:03.397421 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-169a967a-b107-4f05-82e8-96d2610c8593 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:03.405517 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3f7bcbf1-19d1-4bb2-baa7-f3241b87bca7 tempest-ServersAdminTestJSON-718875626 tempest-ServersAdminTestJSON-718875626-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:03.406359 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3f7bcbf1-19d1-4bb2-baa7-f3241b87bca7 tempest-ServersAdminTestJSON-718875626 tempest-ServersAdminTestJSON-718875626-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:03.411922 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-169a967a-b107-4f05-82e8-96d2610c8593 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:03.412501 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3f7bcbf1-19d1-4bb2-baa7-f3241b87bca7 tempest-ServersAdminTestJSON-718875626 tempest-ServersAdminTestJSON-718875626-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:03.417282 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3f7bcbf1-19d1-4bb2-baa7-f3241b87bca7 tempest-ServersAdminTestJSON-718875626 tempest-ServersAdminTestJSON-718875626-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:03.417894 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3f7bcbf1-19d1-4bb2-baa7-f3241b87bca7 tempest-ServersAdminTestJSON-718875626 tempest-ServersAdminTestJSON-718875626-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:03.418218 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3f7bcbf1-19d1-4bb2-baa7-f3241b87bca7 tempest-ServersAdminTestJSON-718875626 tempest-ServersAdminTestJSON-718875626-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:03.727568 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-3f7bcbf1-19d1-4bb2-baa7-f3241b87bca7 tempest-ServersAdminTestJSON-718875626 tempest-ServersAdminTestJSON-718875626-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/detail" status: 200 len: 15 microversion: 2.1 time: 0.805670 Oct 04 20:36:03.728801 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 332/677] 10.222.0.33 () {58 vars in 1146 bytes} [Tue Oct 4 20:36:02 2022] GET /compute/v2.1/servers/detail => generated 15 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 20:36:03.752143 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-ff121de3-fe5d-4ccc-915e-176319e75109 tempest-ServersAdminTestJSON-718875626 tempest-ServersAdminTestJSON-718875626-project-admin] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:03.763822 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-ff121de3-fe5d-4ccc-915e-176319e75109 tempest-ServersAdminTestJSON-718875626 tempest-ServersAdminTestJSON-718875626-project-admin] Searching by: {'deleted': False} {{(pid=128802) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 20:36:03.770619 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ff121de3-fe5d-4ccc-915e-176319e75109 tempest-ServersAdminTestJSON-718875626 tempest-ServersAdminTestJSON-718875626-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:03.771560 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ff121de3-fe5d-4ccc-915e-176319e75109 tempest-ServersAdminTestJSON-718875626 tempest-ServersAdminTestJSON-718875626-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:03.772143 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ff121de3-fe5d-4ccc-915e-176319e75109 tempest-ServersAdminTestJSON-718875626 tempest-ServersAdminTestJSON-718875626-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:03.773659 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ff121de3-fe5d-4ccc-915e-176319e75109 tempest-ServersAdminTestJSON-718875626 tempest-ServersAdminTestJSON-718875626-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:03.774488 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ff121de3-fe5d-4ccc-915e-176319e75109 tempest-ServersAdminTestJSON-718875626 tempest-ServersAdminTestJSON-718875626-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:03.775631 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ff121de3-fe5d-4ccc-915e-176319e75109 tempest-ServersAdminTestJSON-718875626 tempest-ServersAdminTestJSON-718875626-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:04.044726 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-169a967a-b107-4f05-82e8-96d2610c8593 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3563efe2b8c94931a2a46c4e14811b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3118a5d96843d3bede1ed94bd9717e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:04.059030 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-169a967a-b107-4f05-82e8-96d2610c8593 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] 10.222.0.33 "GET /compute/v2.1/servers/c7f3bb5b-e08b-4a3f-ba4d-40012179412e" status: 200 len: 1476 microversion: 2.1 time: 0.697508 Oct 04 20:36:04.063596 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 346/678] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:36:03 2022] GET /compute/v2.1/servers/c7f3bb5b-e08b-4a3f-ba4d-40012179412e => generated 1476 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:36:04.100065 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.multi_cell_list [None req-ff121de3-fe5d-4ccc-915e-176319e75109 tempest-ServersAdminTestJSON-718875626 tempest-ServersAdminTestJSON-718875626-project-admin] Listed batch of 6 results from cell out of 1000 limit. Returned 6 total so far. {{(pid=128802) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 20:36:04.347961 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:36:04.370750 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ff121de3-fe5d-4ccc-915e-176319e75109 tempest-ServersAdminTestJSON-718875626 tempest-ServersAdminTestJSON-718875626-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:04.371418 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ff121de3-fe5d-4ccc-915e-176319e75109 tempest-ServersAdminTestJSON-718875626 tempest-ServersAdminTestJSON-718875626-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:04.371987 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ff121de3-fe5d-4ccc-915e-176319e75109 tempest-ServersAdminTestJSON-718875626 tempest-ServersAdminTestJSON-718875626-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:05.088898 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-826e4a5d-2f33-442c-ae5a-ba986b339c2c tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:05.089511 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-826e4a5d-2f33-442c-ae5a-ba986b339c2c tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] [instance: c7f3bb5b-e08b-4a3f-ba4d-40012179412e] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:05.118667 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-826e4a5d-2f33-442c-ae5a-ba986b339c2c tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:05.119130 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-826e4a5d-2f33-442c-ae5a-ba986b339c2c tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:05.119567 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-826e4a5d-2f33-442c-ae5a-ba986b339c2c tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:05.120284 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-826e4a5d-2f33-442c-ae5a-ba986b339c2c tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:05.120742 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-826e4a5d-2f33-442c-ae5a-ba986b339c2c tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:05.121173 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-826e4a5d-2f33-442c-ae5a-ba986b339c2c tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:05.426619 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-ff121de3-fe5d-4ccc-915e-176319e75109 tempest-ServersAdminTestJSON-718875626 tempest-ServersAdminTestJSON-718875626-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/detail?all_tenants=" status: 200 len: 9890 microversion: 2.1 time: 1.679403 Oct 04 20:36:05.460572 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 333/679] 10.222.0.33 () {58 vars in 1171 bytes} [Tue Oct 4 20:36:03 2022] GET /compute/v2.1/servers/detail?all_tenants= => generated 9890 bytes in 1713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:36:05.470907 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-cfa22cc7-1650-47ee-980d-a4e0ac257643 tempest-ServersAdminTestJSON-718875626 tempest-ServersAdminTestJSON-718875626-project-admin] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:05.484955 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-cfa22cc7-1650-47ee-980d-a4e0ac257643 tempest-ServersAdminTestJSON-718875626 tempest-ServersAdminTestJSON-718875626-project-admin] Searching by: {'deleted': False, 'project_id': 'cde7b3e4fabe46f6b737684276634d81'} {{(pid=128802) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 20:36:05.496839 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cfa22cc7-1650-47ee-980d-a4e0ac257643 tempest-ServersAdminTestJSON-718875626 tempest-ServersAdminTestJSON-718875626-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:05.498129 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cfa22cc7-1650-47ee-980d-a4e0ac257643 tempest-ServersAdminTestJSON-718875626 tempest-ServersAdminTestJSON-718875626-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:05.498721 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cfa22cc7-1650-47ee-980d-a4e0ac257643 tempest-ServersAdminTestJSON-718875626 tempest-ServersAdminTestJSON-718875626-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:05.500264 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cfa22cc7-1650-47ee-980d-a4e0ac257643 tempest-ServersAdminTestJSON-718875626 tempest-ServersAdminTestJSON-718875626-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:05.503075 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cfa22cc7-1650-47ee-980d-a4e0ac257643 tempest-ServersAdminTestJSON-718875626 tempest-ServersAdminTestJSON-718875626-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:05.503610 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cfa22cc7-1650-47ee-980d-a4e0ac257643 tempest-ServersAdminTestJSON-718875626 tempest-ServersAdminTestJSON-718875626-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:05.565734 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-826e4a5d-2f33-442c-ae5a-ba986b339c2c tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3563efe2b8c94931a2a46c4e14811b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3118a5d96843d3bede1ed94bd9717e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:05.579616 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-826e4a5d-2f33-442c-ae5a-ba986b339c2c tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] 10.222.0.33 "GET /compute/v2.1/servers/c7f3bb5b-e08b-4a3f-ba4d-40012179412e" status: 200 len: 1476 microversion: 2.1 time: 0.497358 Oct 04 20:36:05.605166 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-cfa22cc7-1650-47ee-980d-a4e0ac257643 tempest-ServersAdminTestJSON-718875626 tempest-ServersAdminTestJSON-718875626-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/detail?tenant_id=c288268acb30475bbc065a8f72cb21d5" status: 200 len: 15 microversion: 2.1 time: 0.137986 Oct 04 20:36:05.606750 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 334/680] 10.222.0.33 () {58 vars in 1231 bytes} [Tue Oct 4 20:36:05 2022] GET /compute/v2.1/servers/detail?tenant_id=c288268acb30475bbc065a8f72cb21d5 => generated 15 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 20:36:05.608087 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 347/681] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:36:05 2022] GET /compute/v2.1/servers/c7f3bb5b-e08b-4a3f-ba4d-40012179412e => generated 1476 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:36:05.643713 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-9e3f6136-a825-45a5-85a5-13b1d8d55442 tempest-ServersAdminTestJSON-718875626 tempest-ServersAdminTestJSON-718875626-project-admin] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:05.669283 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-9e3f6136-a825-45a5-85a5-13b1d8d55442 tempest-ServersAdminTestJSON-718875626 tempest-ServersAdminTestJSON-718875626-project-admin] Searching by: {'tenant_id': 'c288268acb30475bbc065a8f72cb21d5', 'deleted': False} {{(pid=128802) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 20:36:05.675431 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9e3f6136-a825-45a5-85a5-13b1d8d55442 tempest-ServersAdminTestJSON-718875626 tempest-ServersAdminTestJSON-718875626-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:05.676424 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9e3f6136-a825-45a5-85a5-13b1d8d55442 tempest-ServersAdminTestJSON-718875626 tempest-ServersAdminTestJSON-718875626-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:05.677383 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9e3f6136-a825-45a5-85a5-13b1d8d55442 tempest-ServersAdminTestJSON-718875626 tempest-ServersAdminTestJSON-718875626-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:05.690843 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9e3f6136-a825-45a5-85a5-13b1d8d55442 tempest-ServersAdminTestJSON-718875626 tempest-ServersAdminTestJSON-718875626-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:05.693501 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9e3f6136-a825-45a5-85a5-13b1d8d55442 tempest-ServersAdminTestJSON-718875626 tempest-ServersAdminTestJSON-718875626-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:05.699229 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9e3f6136-a825-45a5-85a5-13b1d8d55442 tempest-ServersAdminTestJSON-718875626 tempest-ServersAdminTestJSON-718875626-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:05.775627 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.multi_cell_list [None req-9e3f6136-a825-45a5-85a5-13b1d8d55442 tempest-ServersAdminTestJSON-718875626 tempest-ServersAdminTestJSON-718875626-project-admin] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128802) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 20:36:06.022252 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9e3f6136-a825-45a5-85a5-13b1d8d55442 tempest-ServersAdminTestJSON-718875626 tempest-ServersAdminTestJSON-718875626-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:06.023062 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9e3f6136-a825-45a5-85a5-13b1d8d55442 tempest-ServersAdminTestJSON-718875626 tempest-ServersAdminTestJSON-718875626-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:06.025776 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9e3f6136-a825-45a5-85a5-13b1d8d55442 tempest-ServersAdminTestJSON-718875626 tempest-ServersAdminTestJSON-718875626-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:06.393887 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-9e3f6136-a825-45a5-85a5-13b1d8d55442 tempest-ServersAdminTestJSON-718875626 tempest-ServersAdminTestJSON-718875626-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=c288268acb30475bbc065a8f72cb21d5" status: 200 len: 4823 microversion: 2.1 time: 0.762994 Oct 04 20:36:06.394745 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 335/682] 10.222.0.33 () {58 vars in 1257 bytes} [Tue Oct 4 20:36:05 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=c288268acb30475bbc065a8f72cb21d5 => generated 4823 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:36:06.425380 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c3cb5c7d-5fd9-4642-9644-a4f2e94391db tempest-ServersAdminTestJSON-718875626 tempest-ServersAdminTestJSON-718875626-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:06.439848 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c3cb5c7d-5fd9-4642-9644-a4f2e94391db tempest-ServersAdminTestJSON-718875626 tempest-ServersAdminTestJSON-718875626-project-admin] Searching by: {'tenant_id': 'cde7b3e4fabe46f6b737684276634d81', 'deleted': False} {{(pid=128801) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 20:36:06.453329 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c3cb5c7d-5fd9-4642-9644-a4f2e94391db tempest-ServersAdminTestJSON-718875626 tempest-ServersAdminTestJSON-718875626-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:06.458169 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c3cb5c7d-5fd9-4642-9644-a4f2e94391db tempest-ServersAdminTestJSON-718875626 tempest-ServersAdminTestJSON-718875626-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:06.458847 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c3cb5c7d-5fd9-4642-9644-a4f2e94391db tempest-ServersAdminTestJSON-718875626 tempest-ServersAdminTestJSON-718875626-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:06.462109 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c3cb5c7d-5fd9-4642-9644-a4f2e94391db tempest-ServersAdminTestJSON-718875626 tempest-ServersAdminTestJSON-718875626-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:06.464432 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c3cb5c7d-5fd9-4642-9644-a4f2e94391db tempest-ServersAdminTestJSON-718875626 tempest-ServersAdminTestJSON-718875626-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:06.465679 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c3cb5c7d-5fd9-4642-9644-a4f2e94391db tempest-ServersAdminTestJSON-718875626 tempest-ServersAdminTestJSON-718875626-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:06.668363 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c3cb5c7d-5fd9-4642-9644-a4f2e94391db tempest-ServersAdminTestJSON-718875626 tempest-ServersAdminTestJSON-718875626-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=cde7b3e4fabe46f6b737684276634d81" status: 200 len: 15 microversion: 2.1 time: 0.246811 Oct 04 20:36:06.669258 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 348/683] 10.222.0.33 () {58 vars in 1257 bytes} [Tue Oct 4 20:36:06 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=cde7b3e4fabe46f6b737684276634d81 => generated 15 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 20:36:06.674293 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-49832db5-16d5-467e-9939-d59a8cb40296 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:06.675090 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-49832db5-16d5-467e-9939-d59a8cb40296 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] [instance: c7f3bb5b-e08b-4a3f-ba4d-40012179412e] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:06.681404 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-49832db5-16d5-467e-9939-d59a8cb40296 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:06.682104 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-49832db5-16d5-467e-9939-d59a8cb40296 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:06.682859 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-49832db5-16d5-467e-9939-d59a8cb40296 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:06.683695 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-49832db5-16d5-467e-9939-d59a8cb40296 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:06.684438 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-49832db5-16d5-467e-9939-d59a8cb40296 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:06.685159 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-49832db5-16d5-467e-9939-d59a8cb40296 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:06.763872 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-3674aebc-9a02-48bf-8c4c-a36bd2d175fc tempest-KeyPairsV210TestJSON-697262699 tempest-KeyPairsV210TestJSON-697262699-project-admin] Action: 'create', calling method: .version_select at 0x7f3c74afbe50>, body: {"keypair": {"name": "tempest-keypair-2139932489", "type": "ssh", "user_id": "e069889e4b544502b77a1e48f2c32635", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGFsTTNjSmUPt9YIoB85qremG0B8jpH/BMfUrCrc/ITD31allRSTrgvUlAlHP1hdOMZ+bFE48/qFKAD4J6XNJBFQJn1aOQUV4qSOuAK+DdoGoGuhZWLC56mOdnH/w1UpAQ=="}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:36:06.804133 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-3674aebc-9a02-48bf-8c4c-a36bd2d175fc tempest-KeyPairsV210TestJSON-697262699 tempest-KeyPairsV210TestJSON-697262699-project-admin] Getting quotas for project 0d1babbe5952404591c1351689e6a1a0. Resources: {'key_pairs'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:36:06.815248 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-3674aebc-9a02-48bf-8c4c-a36bd2d175fc tempest-KeyPairsV210TestJSON-697262699 tempest-KeyPairsV210TestJSON-697262699-project-admin] Getting quotas for user dcc5ddf7883241218472148e67eafcb0 and project 0d1babbe5952404591c1351689e6a1a0. Resources: {'key_pairs'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:36:06.889706 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-3674aebc-9a02-48bf-8c4c-a36bd2d175fc tempest-KeyPairsV210TestJSON-697262699 tempest-KeyPairsV210TestJSON-697262699-project-admin] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.10 time: 0.414648 Oct 04 20:36:06.890847 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 336/684] 10.222.0.33 () {62 vars in 1200 bytes} [Tue Oct 4 20:36:06 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 417 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 04 20:36:06.903384 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-068d51e9-3940-4727-9b34-0c910a7c937b tempest-ServersAdminTestJSON-718875626 tempest-ServersAdminTestJSON-718875626-project-admin] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:06.919031 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-068d51e9-3940-4727-9b34-0c910a7c937b tempest-ServersAdminTestJSON-718875626 tempest-ServersAdminTestJSON-718875626-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/detail?status=invalid_status" status: 200 len: 15 microversion: 2.1 time: 0.023173 Oct 04 20:36:06.919801 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 337/685] 10.222.0.33 () {58 vars in 1189 bytes} [Tue Oct 4 20:36:06 2022] GET /compute/v2.1/servers/detail?status=invalid_status => generated 15 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 20:36:06.934796 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-fdcdbf77-fcd3-4bad-9bd0-1389bf55a5fb tempest-KeyPairsV210TestJSON-697262699 tempest-KeyPairsV210TestJSON-697262699-project-admin] Action: 'create', calling method: .version_select at 0x7f3c748cb160>, body: {"keypair": {"name": "tempest-keypair-1877662701", "type": "ssh", "user_id": "e069889e4b544502b77a1e48f2c32635", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGd0vcth8U1KAhXHYXuR7/38p27corq7kNLvAp5bwrGEWV28ukvhg3Q/Rk2gGYlI9RWC2f1n5bj19smmp5gkYQh6bWvq8VEgp/v+yVhdAys1AXbA2YOndVEDdVL1BBWxkw=="}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:36:06.965953 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-fdcdbf77-fcd3-4bad-9bd0-1389bf55a5fb tempest-KeyPairsV210TestJSON-697262699 tempest-KeyPairsV210TestJSON-697262699-project-admin] Getting quotas for project 0d1babbe5952404591c1351689e6a1a0. Resources: {'key_pairs'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:36:06.971711 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-fdcdbf77-fcd3-4bad-9bd0-1389bf55a5fb tempest-KeyPairsV210TestJSON-697262699 tempest-KeyPairsV210TestJSON-697262699-project-admin] Getting quotas for user dcc5ddf7883241218472148e67eafcb0 and project 0d1babbe5952404591c1351689e6a1a0. Resources: {'key_pairs'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:36:07.017124 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-fdcdbf77-fcd3-4bad-9bd0-1389bf55a5fb tempest-KeyPairsV210TestJSON-697262699 tempest-KeyPairsV210TestJSON-697262699-project-admin] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.10 time: 0.095356 Oct 04 20:36:07.018836 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 338/686] 10.222.0.33 () {62 vars in 1200 bytes} [Tue Oct 4 20:36:06 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 98 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 04 20:36:07.034247 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-d2fa4ebe-fdb1-4d7d-8225-ac7e9a3a1f3c tempest-ServersAdminTestJSON-718875626 tempest-ServersAdminTestJSON-718875626-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:36:07.042549 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-d2fa4ebe-fdb1-4d7d-8225-ac7e9a3a1f3c tempest-ServersAdminTestJSON-718875626 tempest-ServersAdminTestJSON-718875626-project-admin] [instance: 9f8cc082-0a37-4123-a680-1210a90b3ca9] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:07.065240 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d2fa4ebe-fdb1-4d7d-8225-ac7e9a3a1f3c tempest-ServersAdminTestJSON-718875626 tempest-ServersAdminTestJSON-718875626-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:07.068142 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d2fa4ebe-fdb1-4d7d-8225-ac7e9a3a1f3c tempest-ServersAdminTestJSON-718875626 tempest-ServersAdminTestJSON-718875626-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:07.068747 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d2fa4ebe-fdb1-4d7d-8225-ac7e9a3a1f3c tempest-ServersAdminTestJSON-718875626 tempest-ServersAdminTestJSON-718875626-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:07.071024 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d2fa4ebe-fdb1-4d7d-8225-ac7e9a3a1f3c tempest-ServersAdminTestJSON-718875626 tempest-ServersAdminTestJSON-718875626-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:07.071650 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d2fa4ebe-fdb1-4d7d-8225-ac7e9a3a1f3c tempest-ServersAdminTestJSON-718875626 tempest-ServersAdminTestJSON-718875626-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:07.074697 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d2fa4ebe-fdb1-4d7d-8225-ac7e9a3a1f3c tempest-ServersAdminTestJSON-718875626 tempest-ServersAdminTestJSON-718875626-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:07.249415 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-d2fa4ebe-fdb1-4d7d-8225-ac7e9a3a1f3c tempest-ServersAdminTestJSON-718875626 tempest-ServersAdminTestJSON-718875626-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/9f8cc082-0a37-4123-a680-1210a90b3ca9/action" status: 202 len: 0 microversion: 2.1 time: 0.228400 Oct 04 20:36:07.253880 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 339/687] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 20:36:07 2022] POST /compute/v2.1/servers/9f8cc082-0a37-4123-a680-1210a90b3ca9/action => generated 0 bytes in 233 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:36:07.265835 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-4a1cb8b7-84ae-4583-b841-152d7ea8a934 tempest-KeyPairsV210TestJSON-697262699 tempest-KeyPairsV210TestJSON-697262699-project-admin] Calling method '.version_select at 0x7f3c7499a310>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:07.281160 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-4a1cb8b7-84ae-4583-b841-152d7ea8a934 tempest-KeyPairsV210TestJSON-697262699 tempest-KeyPairsV210TestJSON-697262699-project-admin] 10.222.0.33 "GET /compute/v2.1/os-keypairs/tempest-keypair-2139932489?user_id=e069889e4b544502b77a1e48f2c32635" status: 200 len: 512 microversion: 2.10 time: 0.025891 Oct 04 20:36:07.294884 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 340/688] 10.222.0.33 () {60 vars in 1340 bytes} [Tue Oct 4 20:36:07 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-2139932489?user_id=e069889e4b544502b77a1e48f2c32635 => generated 512 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 20:36:07.300669 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-96bb016a-8e22-46fe-aefb-3bd574ef6c39 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:07.310243 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-96bb016a-8e22-46fe-aefb-3bd574ef6c39 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b4a24944aeb34a5ea228965be9bf4ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c288268acb30475bbc065a8f72cb21d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:07.311167 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-96bb016a-8e22-46fe-aefb-3bd574ef6c39 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Searching by: {'vm_state': ['error'], 'deleted': False, 'project_id': 'c288268acb30475bbc065a8f72cb21d5'} {{(pid=128802) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 20:36:07.313455 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-49832db5-16d5-467e-9939-d59a8cb40296 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3563efe2b8c94931a2a46c4e14811b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3118a5d96843d3bede1ed94bd9717e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:07.319723 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-96bb016a-8e22-46fe-aefb-3bd574ef6c39 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:07.320607 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-96bb016a-8e22-46fe-aefb-3bd574ef6c39 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:07.321153 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-96bb016a-8e22-46fe-aefb-3bd574ef6c39 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:07.322013 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-96bb016a-8e22-46fe-aefb-3bd574ef6c39 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:07.322894 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-96bb016a-8e22-46fe-aefb-3bd574ef6c39 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:07.323559 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-96bb016a-8e22-46fe-aefb-3bd574ef6c39 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:07.323892 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-49832db5-16d5-467e-9939-d59a8cb40296 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] 10.222.0.33 "GET /compute/v2.1/servers/c7f3bb5b-e08b-4a3f-ba4d-40012179412e" status: 200 len: 1476 microversion: 2.1 time: 0.653276 Oct 04 20:36:07.366009 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 349/689] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:36:06 2022] GET /compute/v2.1/servers/c7f3bb5b-e08b-4a3f-ba4d-40012179412e => generated 1476 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:36:07.388054 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-130d98b4-ad44-4054-bb81-1b463f511366 tempest-KeyPairsV210TestJSON-697262699 tempest-KeyPairsV210TestJSON-697262699-project-admin] Action: 'create', calling method: .version_select at 0x7f3c749ac4c0>, body: {"keypair": {"name": "tempest-KeyPairsV210TestJSON-keypair-1605923144", "type": "ssh", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJvS19Gg9bNg/DcoYdplY7//v97zQ2+RpDzI9KiK3h2gkz83bv3ZSqA6nd84dkz2WxgZJSOfRb0RC1MQR/KSLv1DVULQ3TQK6NAxaIMAsei7XluHEvnnFt7+3Bp3zvtX0Q=="}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:36:07.444274 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-130d98b4-ad44-4054-bb81-1b463f511366 tempest-KeyPairsV210TestJSON-697262699 tempest-KeyPairsV210TestJSON-697262699-project-admin] Getting quotas for project 0d1babbe5952404591c1351689e6a1a0. Resources: {'key_pairs'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:36:07.455703 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-130d98b4-ad44-4054-bb81-1b463f511366 tempest-KeyPairsV210TestJSON-697262699 tempest-KeyPairsV210TestJSON-697262699-project-admin] Getting quotas for user dcc5ddf7883241218472148e67eafcb0 and project 0d1babbe5952404591c1351689e6a1a0. Resources: {'key_pairs'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:36:07.469230 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.multi_cell_list [None req-96bb016a-8e22-46fe-aefb-3bd574ef6c39 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128802) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 20:36:07.516638 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-130d98b4-ad44-4054-bb81-1b463f511366 tempest-KeyPairsV210TestJSON-697262699 tempest-KeyPairsV210TestJSON-697262699-project-admin] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 201 len: 422 microversion: 2.10 time: 0.147147 Oct 04 20:36:07.517694 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 350/690] 10.222.0.33 () {62 vars in 1200 bytes} [Tue Oct 4 20:36:07 2022] POST /compute/v2.1/os-keypairs => generated 422 bytes in 151 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 04 20:36:07.528604 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-aa16dfb0-aa6a-4cea-acf0-89c7d99bd745 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:07.529379 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-aa16dfb0-aa6a-4cea-acf0-89c7d99bd745 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] [instance: c6cdf5bb-821d-4438-9c05-f227c4ebbbcd] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:07.541803 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-aa16dfb0-aa6a-4cea-acf0-89c7d99bd745 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:07.543749 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-aa16dfb0-aa6a-4cea-acf0-89c7d99bd745 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:07.548670 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-aa16dfb0-aa6a-4cea-acf0-89c7d99bd745 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:07.549697 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-aa16dfb0-aa6a-4cea-acf0-89c7d99bd745 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:07.550716 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-aa16dfb0-aa6a-4cea-acf0-89c7d99bd745 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:07.551610 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-aa16dfb0-aa6a-4cea-acf0-89c7d99bd745 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:07.636510 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-aa16dfb0-aa6a-4cea-acf0-89c7d99bd745 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] [instance: c6cdf5bb-821d-4438-9c05-f227c4ebbbcd] Going to try to terminate instance {{(pid=128801) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:36:07.851700 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-aa16dfb0-aa6a-4cea-acf0-89c7d99bd745 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] 10.222.0.33 "DELETE /compute/v2.1/servers/c6cdf5bb-821d-4438-9c05-f227c4ebbbcd" status: 204 len: 0 microversion: 2.1 time: 0.330976 Oct 04 20:36:07.854172 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 351/691] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 20:36:07 2022] DELETE /compute/v2.1/servers/c6cdf5bb-821d-4438-9c05-f227c4ebbbcd => generated 0 bytes in 336 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:36:07.875307 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-71e99a26-a0bd-4b3b-93ef-6de9f109da40 tempest-KeyPairsV210TestJSON-697262699 tempest-KeyPairsV210TestJSON-697262699-project-admin] Calling method '.version_select at 0x7f3c74b81f70>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:07.887188 n-d-854823-8 devstack@n-api.service[128801]: WARNING oslo_db.sqlalchemy.utils [None req-71e99a26-a0bd-4b3b-93ef-6de9f109da40 tempest-KeyPairsV210TestJSON-697262699 tempest-KeyPairsV210TestJSON-697262699-project-admin] Unique keys not in sort_keys. The sorting order may be unstable. Oct 04 20:36:07.908194 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-71e99a26-a0bd-4b3b-93ef-6de9f109da40 tempest-KeyPairsV210TestJSON-697262699 tempest-KeyPairsV210TestJSON-697262699-project-admin] 10.222.0.33 "GET /compute/v2.1/os-keypairs?user_id=e069889e4b544502b77a1e48f2c32635" status: 200 len: 726 microversion: 2.10 time: 0.048387 Oct 04 20:36:07.909585 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 352/692] 10.222.0.33 () {60 vars in 1259 bytes} [Tue Oct 4 20:36:07 2022] GET /compute/v2.1/os-keypairs?user_id=e069889e4b544502b77a1e48f2c32635 => generated 726 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 20:36:07.920621 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-3b9d6abe-a40e-4bfc-92a0-a4d989ce8982 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:07.923582 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-3b9d6abe-a40e-4bfc-92a0-a4d989ce8982 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] [instance: c6cdf5bb-821d-4438-9c05-f227c4ebbbcd] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:07.943055 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3b9d6abe-a40e-4bfc-92a0-a4d989ce8982 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:07.946095 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3b9d6abe-a40e-4bfc-92a0-a4d989ce8982 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:07.948160 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3b9d6abe-a40e-4bfc-92a0-a4d989ce8982 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:07.966990 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3b9d6abe-a40e-4bfc-92a0-a4d989ce8982 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:07.971535 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3b9d6abe-a40e-4bfc-92a0-a4d989ce8982 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:07.973573 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3b9d6abe-a40e-4bfc-92a0-a4d989ce8982 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:08.108938 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-96bb016a-8e22-46fe-aefb-3bd574ef6c39 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] 10.222.0.33 "GET /compute/v2.1/servers?status=error" status: 200 len: 338 microversion: 2.1 time: 0.812682 Oct 04 20:36:08.110120 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 341/693] 10.222.0.33 () {58 vars in 1150 bytes} [Tue Oct 4 20:36:07 2022] GET /compute/v2.1/servers?status=error => generated 338 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:36:08.122596 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-9cbdbbd1-1a08-43c5-b945-6e84f681e12d tempest-KeyPairsV210TestJSON-697262699 tempest-KeyPairsV210TestJSON-697262699-project-admin] Calling method '.version_select at 0x7f3c74877a60>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:08.157929 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-9cbdbbd1-1a08-43c5-b945-6e84f681e12d tempest-KeyPairsV210TestJSON-697262699 tempest-KeyPairsV210TestJSON-697262699-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-1605923144" status: 204 len: 0 microversion: 2.10 time: 0.045977 Oct 04 20:36:08.158991 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 342/694] 10.222.0.33 () {60 vars in 1325 bytes} [Tue Oct 4 20:36:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-1605923144 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 20:36:08.167882 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-d4dd4def-15b8-43a0-a089-b227ebd49cd8 tempest-ServersAdminTestJSON-718875626 tempest-ServersAdminTestJSON-718875626-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:36:08.172865 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-d4dd4def-15b8-43a0-a089-b227ebd49cd8 tempest-ServersAdminTestJSON-718875626 tempest-ServersAdminTestJSON-718875626-project-admin] [instance: 9f8cc082-0a37-4123-a680-1210a90b3ca9] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:08.185740 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d4dd4def-15b8-43a0-a089-b227ebd49cd8 tempest-ServersAdminTestJSON-718875626 tempest-ServersAdminTestJSON-718875626-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:08.186603 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d4dd4def-15b8-43a0-a089-b227ebd49cd8 tempest-ServersAdminTestJSON-718875626 tempest-ServersAdminTestJSON-718875626-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:08.189550 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d4dd4def-15b8-43a0-a089-b227ebd49cd8 tempest-ServersAdminTestJSON-718875626 tempest-ServersAdminTestJSON-718875626-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:08.189550 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d4dd4def-15b8-43a0-a089-b227ebd49cd8 tempest-ServersAdminTestJSON-718875626 tempest-ServersAdminTestJSON-718875626-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:08.190305 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d4dd4def-15b8-43a0-a089-b227ebd49cd8 tempest-ServersAdminTestJSON-718875626 tempest-ServersAdminTestJSON-718875626-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:08.191082 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d4dd4def-15b8-43a0-a089-b227ebd49cd8 tempest-ServersAdminTestJSON-718875626 tempest-ServersAdminTestJSON-718875626-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:08.400096 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-d4dd4def-15b8-43a0-a089-b227ebd49cd8 tempest-ServersAdminTestJSON-718875626 tempest-ServersAdminTestJSON-718875626-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/9f8cc082-0a37-4123-a680-1210a90b3ca9/action" status: 202 len: 0 microversion: 2.1 time: 0.235142 Oct 04 20:36:08.402313 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 343/695] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 20:36:08 2022] POST /compute/v2.1/servers/9f8cc082-0a37-4123-a680-1210a90b3ca9/action => generated 0 bytes in 242 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:36:08.408486 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-aef712a9-29ad-481e-bd25-48b4fbaa7662 tempest-KeyPairsV210TestJSON-697262699 tempest-KeyPairsV210TestJSON-697262699-project-admin] Calling method '.version_select at 0x7f3c74b37430>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:08.450056 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-aef712a9-29ad-481e-bd25-48b4fbaa7662 tempest-KeyPairsV210TestJSON-697262699 tempest-KeyPairsV210TestJSON-697262699-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1877662701?user_id=e069889e4b544502b77a1e48f2c32635" status: 204 len: 0 microversion: 2.10 time: 0.046162 Oct 04 20:36:08.452562 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 344/696] 10.222.0.33 () {60 vars in 1343 bytes} [Tue Oct 4 20:36:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1877662701?user_id=e069889e4b544502b77a1e48f2c32635 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 20:36:08.462373 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-5541a892-157a-439c-894d-6c7387e7a621 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:08.463169 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-5541a892-157a-439c-894d-6c7387e7a621 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] [instance: c7f3bb5b-e08b-4a3f-ba4d-40012179412e] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:08.483727 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5541a892-157a-439c-894d-6c7387e7a621 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:08.484231 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5541a892-157a-439c-894d-6c7387e7a621 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:08.484671 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5541a892-157a-439c-894d-6c7387e7a621 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:08.485395 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5541a892-157a-439c-894d-6c7387e7a621 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:08.490914 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5541a892-157a-439c-894d-6c7387e7a621 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:08.492038 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5541a892-157a-439c-894d-6c7387e7a621 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:09.276565 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-3b9d6abe-a40e-4bfc-92a0-a4d989ce8982 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5eda279f6034608b192839a54dda616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f28e80977de42a892b84295ecf05141', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:09.288557 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-3b9d6abe-a40e-4bfc-92a0-a4d989ce8982 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] 10.222.0.33 "GET /compute/v2.1/servers/c6cdf5bb-821d-4438-9c05-f227c4ebbbcd" status: 200 len: 1711 microversion: 2.1 time: 1.373456 Oct 04 20:36:09.306919 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 353/697] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:36:07 2022] GET /compute/v2.1/servers/c6cdf5bb-821d-4438-9c05-f227c4ebbbcd => generated 1711 bytes in 1397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:36:09.322320 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-abac4043-10a0-4c5c-a6c1-221fdd588d9f tempest-ServersAdminTestJSON-718875626 tempest-ServersAdminTestJSON-718875626-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:09.323898 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-abac4043-10a0-4c5c-a6c1-221fdd588d9f tempest-ServersAdminTestJSON-718875626 tempest-ServersAdminTestJSON-718875626-project-admin] [instance: 9f8cc082-0a37-4123-a680-1210a90b3ca9] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:09.344295 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-abac4043-10a0-4c5c-a6c1-221fdd588d9f tempest-ServersAdminTestJSON-718875626 tempest-ServersAdminTestJSON-718875626-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:09.345009 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-abac4043-10a0-4c5c-a6c1-221fdd588d9f tempest-ServersAdminTestJSON-718875626 tempest-ServersAdminTestJSON-718875626-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:09.345616 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-abac4043-10a0-4c5c-a6c1-221fdd588d9f tempest-ServersAdminTestJSON-718875626 tempest-ServersAdminTestJSON-718875626-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:09.346566 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-abac4043-10a0-4c5c-a6c1-221fdd588d9f tempest-ServersAdminTestJSON-718875626 tempest-ServersAdminTestJSON-718875626-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:09.349454 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-abac4043-10a0-4c5c-a6c1-221fdd588d9f tempest-ServersAdminTestJSON-718875626 tempest-ServersAdminTestJSON-718875626-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:09.350095 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-abac4043-10a0-4c5c-a6c1-221fdd588d9f tempest-ServersAdminTestJSON-718875626 tempest-ServersAdminTestJSON-718875626-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:09.471267 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-5541a892-157a-439c-894d-6c7387e7a621 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3563efe2b8c94931a2a46c4e14811b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3118a5d96843d3bede1ed94bd9717e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:09.487316 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-5541a892-157a-439c-894d-6c7387e7a621 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] 10.222.0.33 "GET /compute/v2.1/servers/c7f3bb5b-e08b-4a3f-ba4d-40012179412e" status: 200 len: 1475 microversion: 2.1 time: 1.033575 Oct 04 20:36:09.490777 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 345/698] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:36:08 2022] GET /compute/v2.1/servers/c7f3bb5b-e08b-4a3f-ba4d-40012179412e => generated 1475 bytes in 1038 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:36:09.529028 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-fc1e8387-9056-4a84-a794-315d36d2ee6c tempest-KeyPairsV210TestJSON-697262699 tempest-KeyPairsV210TestJSON-697262699-project-admin] Calling method '.version_select at 0x7f3c74b51820>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:09.568915 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-fc1e8387-9056-4a84-a794-315d36d2ee6c tempest-KeyPairsV210TestJSON-697262699 tempest-KeyPairsV210TestJSON-697262699-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2139932489?user_id=e069889e4b544502b77a1e48f2c32635" status: 204 len: 0 microversion: 2.10 time: 0.044708 Oct 04 20:36:09.570876 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 346/699] 10.222.0.33 () {60 vars in 1343 bytes} [Tue Oct 4 20:36:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2139932489?user_id=e069889e4b544502b77a1e48f2c32635 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 20:36:10.321469 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-9f0cec00-75b0-4ee1-90f7-01fff6cadea4 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:10.322238 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-9f0cec00-75b0-4ee1-90f7-01fff6cadea4 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] [instance: c6cdf5bb-821d-4438-9c05-f227c4ebbbcd] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:10.332420 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9f0cec00-75b0-4ee1-90f7-01fff6cadea4 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:10.336304 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9f0cec00-75b0-4ee1-90f7-01fff6cadea4 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:10.336775 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9f0cec00-75b0-4ee1-90f7-01fff6cadea4 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:10.337534 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9f0cec00-75b0-4ee1-90f7-01fff6cadea4 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:10.338254 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9f0cec00-75b0-4ee1-90f7-01fff6cadea4 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:10.348793 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9f0cec00-75b0-4ee1-90f7-01fff6cadea4 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:10.543807 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-abac4043-10a0-4c5c-a6c1-221fdd588d9f tempest-ServersAdminTestJSON-718875626 tempest-ServersAdminTestJSON-718875626-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/9f8cc082-0a37-4123-a680-1210a90b3ca9" status: 200 len: 1614 microversion: 2.1 time: 1.234833 Oct 04 20:36:10.545149 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 354/700] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:36:09 2022] GET /compute/v2.1/servers/9f8cc082-0a37-4123-a680-1210a90b3ca9 => generated 1614 bytes in 1238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:36:10.566517 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e3251c77-76f3-4e6e-b60b-1cce1d4358c6 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:10.566517 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e3251c77-76f3-4e6e-b60b-1cce1d4358c6 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] [instance: c7f3bb5b-e08b-4a3f-ba4d-40012179412e] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:10.598795 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e3251c77-76f3-4e6e-b60b-1cce1d4358c6 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:10.606998 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e3251c77-76f3-4e6e-b60b-1cce1d4358c6 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:10.609211 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e3251c77-76f3-4e6e-b60b-1cce1d4358c6 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:10.616574 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e3251c77-76f3-4e6e-b60b-1cce1d4358c6 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:10.618371 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e3251c77-76f3-4e6e-b60b-1cce1d4358c6 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:10.619262 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e3251c77-76f3-4e6e-b60b-1cce1d4358c6 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:11.907005 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e3251c77-76f3-4e6e-b60b-1cce1d4358c6 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3563efe2b8c94931a2a46c4e14811b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3118a5d96843d3bede1ed94bd9717e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:11.927125 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e3251c77-76f3-4e6e-b60b-1cce1d4358c6 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] 10.222.0.33 "GET /compute/v2.1/servers/c7f3bb5b-e08b-4a3f-ba4d-40012179412e" status: 200 len: 1475 microversion: 2.1 time: 1.369908 Oct 04 20:36:11.933186 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 355/701] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:36:10 2022] GET /compute/v2.1/servers/c7f3bb5b-e08b-4a3f-ba4d-40012179412e => generated 1475 bytes in 1387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:36:11.943463 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c8624bbc-e990-4dbe-b072-73f45d314f2d tempest-ServersAdminTestJSON-718875626 tempest-ServersAdminTestJSON-718875626-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:11.961072 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c8624bbc-e990-4dbe-b072-73f45d314f2d tempest-ServersAdminTestJSON-718875626 tempest-ServersAdminTestJSON-718875626-project-admin] [instance: 9f8cc082-0a37-4123-a680-1210a90b3ca9] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:12.068389 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c8624bbc-e990-4dbe-b072-73f45d314f2d tempest-ServersAdminTestJSON-718875626 tempest-ServersAdminTestJSON-718875626-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:12.070646 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c8624bbc-e990-4dbe-b072-73f45d314f2d tempest-ServersAdminTestJSON-718875626 tempest-ServersAdminTestJSON-718875626-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:12.071373 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c8624bbc-e990-4dbe-b072-73f45d314f2d tempest-ServersAdminTestJSON-718875626 tempest-ServersAdminTestJSON-718875626-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:12.073778 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c8624bbc-e990-4dbe-b072-73f45d314f2d tempest-ServersAdminTestJSON-718875626 tempest-ServersAdminTestJSON-718875626-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:12.075246 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c8624bbc-e990-4dbe-b072-73f45d314f2d tempest-ServersAdminTestJSON-718875626 tempest-ServersAdminTestJSON-718875626-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:12.075900 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c8624bbc-e990-4dbe-b072-73f45d314f2d tempest-ServersAdminTestJSON-718875626 tempest-ServersAdminTestJSON-718875626-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:12.245280 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-9f0cec00-75b0-4ee1-90f7-01fff6cadea4 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5eda279f6034608b192839a54dda616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f28e80977de42a892b84295ecf05141', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:12.262438 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-9f0cec00-75b0-4ee1-90f7-01fff6cadea4 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] 10.222.0.33 "GET /compute/v2.1/servers/c6cdf5bb-821d-4438-9c05-f227c4ebbbcd" status: 200 len: 1711 microversion: 2.1 time: 1.946051 Oct 04 20:36:12.293884 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 347/702] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:36:10 2022] GET /compute/v2.1/servers/c6cdf5bb-821d-4438-9c05-f227c4ebbbcd => generated 1711 bytes in 1978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:36:12.845988 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-4338067c-90d2-425b-a100-20774ee82211 tempest-QuotasAdminNegativeTest-1163094605 tempest-QuotasAdminNegativeTest-1163094605-project-admin] Calling method '.version_select at 0x7f3c74afba60>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:13.468255 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-4338067c-90d2-425b-a100-20774ee82211 tempest-QuotasAdminNegativeTest-1163094605 tempest-QuotasAdminNegativeTest-1163094605-project-admin] 10.222.0.33 "GET /compute/v2.1/os-quota-sets/163e70dcd32d419f92b286d655c05e5c" status: 200 len: 371 microversion: 2.1 time: 1.172367 Oct 04 20:36:13.473597 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 348/703] 10.222.0.33 () {58 vars in 1242 bytes} [Tue Oct 4 20:36:12 2022] GET /compute/v2.1/os-quota-sets/163e70dcd32d419f92b286d655c05e5c => generated 371 bytes in 1179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:36:13.483702 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-7364833e-a2a2-4d33-8b8d-9d84789d5dc8 req-b72f16fb-86c7-4bd9-a280-5b01820defdd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7f3bb5b-e08b-4a3f-ba4d-40012179412e", "name": "network-vif-unplugged", "status": "completed", "tag": "89b93aa0-8eeb-48c4-a6d4-93a449c21fea"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:36:13.521225 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-7364833e-a2a2-4d33-8b8d-9d84789d5dc8 req-b72f16fb-86c7-4bd9-a280-5b01820defdd service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:13.526843 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-7364833e-a2a2-4d33-8b8d-9d84789d5dc8 req-b72f16fb-86c7-4bd9-a280-5b01820defdd service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:13.527550 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-7364833e-a2a2-4d33-8b8d-9d84789d5dc8 req-b72f16fb-86c7-4bd9-a280-5b01820defdd service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:13.564128 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-7364833e-a2a2-4d33-8b8d-9d84789d5dc8 req-b72f16fb-86c7-4bd9-a280-5b01820defdd service nova] Creating event network-vif-unplugged:89b93aa0-8eeb-48c4-a6d4-93a449c21fea for instance c7f3bb5b-e08b-4a3f-ba4d-40012179412e on n-h2-854823-8 Oct 04 20:36:13.583515 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [req-7364833e-a2a2-4d33-8b8d-9d84789d5dc8 req-b72f16fb-86c7-4bd9-a280-5b01820defdd service nova] Instance c7f3bb5b-e08b-4a3f-ba4d-40012179412e is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854823-8', 'n-h2-854823-8'} {{(pid=128802) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 20:36:13.620225 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-7364833e-a2a2-4d33-8b8d-9d84789d5dc8 req-b72f16fb-86c7-4bd9-a280-5b01820defdd service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.145082 Oct 04 20:36:13.622740 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 349/704] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:36:13 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:36:13.630387 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-3c6d8b10-cc87-412e-ad0a-3c12e28b9a8b req-e39b3a3a-0f83-4789-88c8-a12301a8c109 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6cdf5bb-821d-4438-9c05-f227c4ebbbcd", "name": "network-vif-deleted", "tag": "ad1d4490-762d-4d97-941f-671901ca0477"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:36:13.647051 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-3c6d8b10-cc87-412e-ad0a-3c12e28b9a8b req-e39b3a3a-0f83-4789-88c8-a12301a8c109 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:13.649733 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-3c6d8b10-cc87-412e-ad0a-3c12e28b9a8b req-e39b3a3a-0f83-4789-88c8-a12301a8c109 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:13.650336 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-3c6d8b10-cc87-412e-ad0a-3c12e28b9a8b req-e39b3a3a-0f83-4789-88c8-a12301a8c109 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:13.665478 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-3c6d8b10-cc87-412e-ad0a-3c12e28b9a8b req-e39b3a3a-0f83-4789-88c8-a12301a8c109 service nova] Creating event network-vif-deleted:ad1d4490-762d-4d97-941f-671901ca0477 for instance c6cdf5bb-821d-4438-9c05-f227c4ebbbcd on n-h2-854823-8 Oct 04 20:36:13.672702 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-3c6d8b10-cc87-412e-ad0a-3c12e28b9a8b req-e39b3a3a-0f83-4789-88c8-a12301a8c109 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048375 Oct 04 20:36:13.674392 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 350/705] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:36:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:36:13.681464 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-c36d124f-70f4-4d3b-b534-8aaba5a7f5bf tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:13.682971 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-c36d124f-70f4-4d3b-b534-8aaba5a7f5bf tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] [instance: c7f3bb5b-e08b-4a3f-ba4d-40012179412e] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:13.695488 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c36d124f-70f4-4d3b-b534-8aaba5a7f5bf tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:13.696164 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c36d124f-70f4-4d3b-b534-8aaba5a7f5bf tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:13.696776 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c36d124f-70f4-4d3b-b534-8aaba5a7f5bf tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:13.698988 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c36d124f-70f4-4d3b-b534-8aaba5a7f5bf tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:13.703072 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c36d124f-70f4-4d3b-b534-8aaba5a7f5bf tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:13.703797 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c36d124f-70f4-4d3b-b534-8aaba5a7f5bf tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:14.202286 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c8624bbc-e990-4dbe-b072-73f45d314f2d tempest-ServersAdminTestJSON-718875626 tempest-ServersAdminTestJSON-718875626-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/9f8cc082-0a37-4123-a680-1210a90b3ca9" status: 200 len: 1614 microversion: 2.1 time: 2.266805 Oct 04 20:36:14.203817 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 356/706] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:36:11 2022] GET /compute/v2.1/servers/9f8cc082-0a37-4123-a680-1210a90b3ca9 => generated 1614 bytes in 2269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:36:14.226787 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a7493184-7c6c-4b75-a585-c219911941be tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:14.228670 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a7493184-7c6c-4b75-a585-c219911941be tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] [instance: c6cdf5bb-821d-4438-9c05-f227c4ebbbcd] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:14.237968 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a7493184-7c6c-4b75-a585-c219911941be tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:14.240628 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a7493184-7c6c-4b75-a585-c219911941be tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:14.241635 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a7493184-7c6c-4b75-a585-c219911941be tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:14.242663 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a7493184-7c6c-4b75-a585-c219911941be tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:14.243128 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a7493184-7c6c-4b75-a585-c219911941be tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:14.243555 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a7493184-7c6c-4b75-a585-c219911941be tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:14.277651 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-a7493184-7c6c-4b75-a585-c219911941be tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] HTTP exception thrown: Instance c6cdf5bb-821d-4438-9c05-f227c4ebbbcd could not be found. Oct 04 20:36:14.280694 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a7493184-7c6c-4b75-a585-c219911941be tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Request method failure captured: Oct 04 20:36:14.280694 n-d-854823-8 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/c6cdf5bb-821d-4438-9c05-f227c4ebbbcd HTTP/1.1 Oct 04 20:36:14.280694 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:36:14.280694 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:36:14.280694 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:36:14.280694 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 0 Oct 04 20:36:14.280694 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:36:14.280694 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:36:14.280694 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:36:14.280694 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:36:14.280694 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJiej3ZBP1oDsKzH6_pJmapps3lj_Plf6PjDgq4lqlOYZsDLHcADh93YHT5umqV8BQXmRb6AjKFJTjJrD2bCwzpsOzPYwHVOCW1l6YVMP_9BGql22JvSoxUbB3g1p7kraQwhtw0_BXlK88o-mWpjMuocTlAJF6nDb9rqPLkN6PkQKbY Oct 04 20:36:14.280694 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:36:14.280694 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:36:14.280694 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:36:14.280694 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:36:14.280694 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:36:14.280694 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:36:14.280694 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: 8f28e80977de42a892b84295ecf05141 Oct 04 20:36:14.280694 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1458163774 Oct 04 20:36:14.280694 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 20:36:14.280694 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 20:36:14.281994 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_8f28e80977de42a892b84295ecf05141", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8f28e80977de42a892b84295ecf05141"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8f28e80977de42a892b84295ecf05141"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/8f28e80977de42a892b84295ecf05141"}]}] Oct 04 20:36:14.281994 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1458163774 Oct 04 20:36:14.281994 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: 8f28e80977de42a892b84295ecf05141 Oct 04 20:36:14.281994 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1458163774 Oct 04 20:36:14.281994 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1458163774-project Oct 04 20:36:14.281994 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:36:14.281994 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:36:14.281994 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: f5eda279f6034608b192839a54dda616 Oct 04 20:36:14.281994 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1458163774-project Oct 04 20:36:14.281994 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 20:36:14.281994 n-d-854823-8 devstack@n-api.service[128801]: exception: Instance c6cdf5bb-821d-4438-9c05-f227c4ebbbcd could not be found. Oct 04 20:36:14.281994 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': 'c6cdf5bb-821d-4438-9c05-f227c4ebbbcd'} Oct 04 20:36:14.282762 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:36:14.282762 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:36:14.282762 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:36:14.282762 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:36:14.282762 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:36:14.282762 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:36:14.282762 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:36:14.282762 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:36:14.282762 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:36:14.282762 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:36:14.282762 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c6cdf5bb-821d-4438-9c05-f227c4ebbbcd could not be found. Oct 04 20:36:14.282762 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:36:14.282762 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:36:14.282762 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:36:14.282762 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:36:14.282762 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:36:14.282762 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:36:14.282762 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:36:14.282762 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:36:14.282762 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:36:14.283905 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:36:14.283905 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:36:14.283905 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:36:14.283905 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:36:14.283905 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:36:14.283905 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:36:14.283905 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:36:14.283905 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c6cdf5bb-821d-4438-9c05-f227c4ebbbcd could not be found. Oct 04 20:36:14.283905 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:36:14.283905 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:36:14.283905 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:36:14.283905 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:36:14.283905 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:36:14.283905 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:36:14.283905 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:36:14.283905 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:36:14.283905 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c6cdf5bb-821d-4438-9c05-f227c4ebbbcd could not be found. Oct 04 20:36:14.283905 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:36:14.284941 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a7493184-7c6c-4b75-a585-c219911941be tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Returning 404 to user: Instance c6cdf5bb-821d-4438-9c05-f227c4ebbbcd could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:36:14.284941 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a7493184-7c6c-4b75-a585-c219911941be tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] 10.222.0.33 "GET /compute/v2.1/servers/c6cdf5bb-821d-4438-9c05-f227c4ebbbcd" status: 404 len: 111 microversion: 2.1 time: 0.077528 Oct 04 20:36:14.287538 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 357/707] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:36:14 2022] GET /compute/v2.1/servers/c6cdf5bb-821d-4438-9c05-f227c4ebbbcd => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:36:14.293683 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f1969908-70e9-47c9-b499-9b262c5a2b2e tempest-QuotasAdminNegativeTest-1163094605 tempest-QuotasAdminNegativeTest-1163094605-project-admin] Action: 'update', calling method: .version_select at 0x7f3c749fbdc0>, body: {"quota_set": {"force": true, "cores": 0}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:36:14.738000 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f1969908-70e9-47c9-b499-9b262c5a2b2e tempest-QuotasAdminNegativeTest-1163094605 tempest-QuotasAdminNegativeTest-1163094605-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:14.742103 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f1969908-70e9-47c9-b499-9b262c5a2b2e tempest-QuotasAdminNegativeTest-1163094605 tempest-QuotasAdminNegativeTest-1163094605-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:14.743145 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f1969908-70e9-47c9-b499-9b262c5a2b2e tempest-QuotasAdminNegativeTest-1163094605 tempest-QuotasAdminNegativeTest-1163094605-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:14.744156 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f1969908-70e9-47c9-b499-9b262c5a2b2e tempest-QuotasAdminNegativeTest-1163094605 tempest-QuotasAdminNegativeTest-1163094605-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:14.745009 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f1969908-70e9-47c9-b499-9b262c5a2b2e tempest-QuotasAdminNegativeTest-1163094605 tempest-QuotasAdminNegativeTest-1163094605-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:14.745670 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f1969908-70e9-47c9-b499-9b262c5a2b2e tempest-QuotasAdminNegativeTest-1163094605 tempest-QuotasAdminNegativeTest-1163094605-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:14.813464 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-c36d124f-70f4-4d3b-b534-8aaba5a7f5bf tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3563efe2b8c94931a2a46c4e14811b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3118a5d96843d3bede1ed94bd9717e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:14.828684 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f1969908-70e9-47c9-b499-9b262c5a2b2e tempest-QuotasAdminNegativeTest-1163094605 tempest-QuotasAdminNegativeTest-1163094605-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-quota-sets/163e70dcd32d419f92b286d655c05e5c" status: 200 len: 328 microversion: 2.1 time: 0.539020 Oct 04 20:36:14.830013 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 358/708] 10.222.0.33 () {60 vars in 1262 bytes} [Tue Oct 4 20:36:14 2022] PUT /compute/v2.1/os-quota-sets/163e70dcd32d419f92b286d655c05e5c => generated 328 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:36:14.835758 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-09968a43-4b78-42b4-a3bd-e115852c5b69 tempest-ServersAdminTestJSON-718875626 tempest-ServersAdminTestJSON-718875626-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:14.837229 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-c36d124f-70f4-4d3b-b534-8aaba5a7f5bf tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] 10.222.0.33 "GET /compute/v2.1/servers/c7f3bb5b-e08b-4a3f-ba4d-40012179412e" status: 200 len: 1475 microversion: 2.1 time: 1.161413 Oct 04 20:36:14.844821 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-09968a43-4b78-42b4-a3bd-e115852c5b69 tempest-ServersAdminTestJSON-718875626 tempest-ServersAdminTestJSON-718875626-project-admin] Searching by: {'host': 'n-h1-854823-8', 'deleted': False} {{(pid=128801) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 20:36:14.852149 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-09968a43-4b78-42b4-a3bd-e115852c5b69 tempest-ServersAdminTestJSON-718875626 tempest-ServersAdminTestJSON-718875626-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:14.853100 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-09968a43-4b78-42b4-a3bd-e115852c5b69 tempest-ServersAdminTestJSON-718875626 tempest-ServersAdminTestJSON-718875626-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:14.853740 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-09968a43-4b78-42b4-a3bd-e115852c5b69 tempest-ServersAdminTestJSON-718875626 tempest-ServersAdminTestJSON-718875626-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:14.854839 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-09968a43-4b78-42b4-a3bd-e115852c5b69 tempest-ServersAdminTestJSON-718875626 tempest-ServersAdminTestJSON-718875626-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:14.855694 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-09968a43-4b78-42b4-a3bd-e115852c5b69 tempest-ServersAdminTestJSON-718875626 tempest-ServersAdminTestJSON-718875626-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:14.856820 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-09968a43-4b78-42b4-a3bd-e115852c5b69 tempest-ServersAdminTestJSON-718875626 tempest-ServersAdminTestJSON-718875626-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:14.877123 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 351/709] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:36:13 2022] GET /compute/v2.1/servers/c7f3bb5b-e08b-4a3f-ba4d-40012179412e => generated 1475 bytes in 1201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:36:14.901767 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-8cda1dc3-e9a0-41f0-b6ee-0f56513b9863 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:14.908061 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-8cda1dc3-e9a0-41f0-b6ee-0f56513b9863 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] [instance: 8fdcb1b0-65e9-45d1-b0da-5f603f22a8cf] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:14.940675 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8cda1dc3-e9a0-41f0-b6ee-0f56513b9863 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:14.941180 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8cda1dc3-e9a0-41f0-b6ee-0f56513b9863 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:14.948800 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8cda1dc3-e9a0-41f0-b6ee-0f56513b9863 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:14.949610 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8cda1dc3-e9a0-41f0-b6ee-0f56513b9863 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:14.950092 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8cda1dc3-e9a0-41f0-b6ee-0f56513b9863 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:14.950560 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8cda1dc3-e9a0-41f0-b6ee-0f56513b9863 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:15.022272 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.wsgi [None req-8cda1dc3-e9a0-41f0-b6ee-0f56513b9863 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] HTTP exception thrown: Instance 8fdcb1b0-65e9-45d1-b0da-5f603f22a8cf could not be found. Oct 04 20:36:15.033745 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-8cda1dc3-e9a0-41f0-b6ee-0f56513b9863 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Request method failure captured: Oct 04 20:36:15.033745 n-d-854823-8 devstack@n-api.service[128802]: request: DELETE /compute/v2.1/servers/8fdcb1b0-65e9-45d1-b0da-5f603f22a8cf HTTP/1.1 Oct 04 20:36:15.033745 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 20:36:15.033745 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 20:36:15.033745 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 20:36:15.033745 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 0 Oct 04 20:36:15.033745 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 20:36:15.033745 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 20:36:15.033745 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 20:36:15.033745 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 20:36:15.033745 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPJiej3ZBP1oDsKzH6_pJmapps3lj_Plf6PjDgq4lqlOYZsDLHcADh93YHT5umqV8BQXmRb6AjKFJTjJrD2bCwzpsOzPYwHVOCW1l6YVMP_9BGql22JvSoxUbB3g1p7kraQwhtw0_BXlK88o-mWpjMuocTlAJF6nDb9rqPLkN6PkQKbY Oct 04 20:36:15.033745 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 20:36:15.033745 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 20:36:15.033745 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 20:36:15.033745 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 20:36:15.033745 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 20:36:15.033745 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 20:36:15.033745 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: 8f28e80977de42a892b84295ecf05141 Oct 04 20:36:15.033745 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1458163774 Oct 04 20:36:15.033745 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 20:36:15.033745 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 20:36:15.035131 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_8f28e80977de42a892b84295ecf05141", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8f28e80977de42a892b84295ecf05141"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8f28e80977de42a892b84295ecf05141"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/8f28e80977de42a892b84295ecf05141"}]}] Oct 04 20:36:15.035131 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1458163774 Oct 04 20:36:15.035131 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: 8f28e80977de42a892b84295ecf05141 Oct 04 20:36:15.035131 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1458163774 Oct 04 20:36:15.035131 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1458163774-project Oct 04 20:36:15.035131 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 20:36:15.035131 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 20:36:15.035131 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: f5eda279f6034608b192839a54dda616 Oct 04 20:36:15.035131 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1458163774-project Oct 04 20:36:15.035131 n-d-854823-8 devstack@n-api.service[128802]: method: > Oct 04 20:36:15.035131 n-d-854823-8 devstack@n-api.service[128802]: exception: Instance 8fdcb1b0-65e9-45d1-b0da-5f603f22a8cf could not be found. Oct 04 20:36:15.035131 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'id': '8fdcb1b0-65e9-45d1-b0da-5f603f22a8cf'} Oct 04 20:36:15.035831 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:36:15.035831 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:36:15.035831 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:36:15.035831 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:36:15.035831 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:36:15.035831 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:36:15.035831 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:36:15.035831 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:36:15.035831 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:36:15.035831 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:36:15.035831 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8fdcb1b0-65e9-45d1-b0da-5f603f22a8cf could not be found. Oct 04 20:36:15.035831 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:36:15.035831 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:36:15.035831 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:36:15.035831 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:36:15.035831 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:36:15.035831 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:36:15.035831 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:36:15.035831 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:36:15.035831 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:36:15.037021 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:36:15.037021 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 20:36:15.037021 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 20:36:15.037021 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 20:36:15.037021 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 20:36:15.037021 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:36:15.037021 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:36:15.037021 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:36:15.037021 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:36:15.037021 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8fdcb1b0-65e9-45d1-b0da-5f603f22a8cf could not be found. Oct 04 20:36:15.037021 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:36:15.037021 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:36:15.037021 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:36:15.037021 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:36:15.037021 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:36:15.037021 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:36:15.037021 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:36:15.037021 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:36:15.037021 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8fdcb1b0-65e9-45d1-b0da-5f603f22a8cf could not be found. Oct 04 20:36:15.037021 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:36:15.038321 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-8cda1dc3-e9a0-41f0-b6ee-0f56513b9863 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Returning 404 to user: Instance 8fdcb1b0-65e9-45d1-b0da-5f603f22a8cf could not be found. {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:36:15.038321 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-8cda1dc3-e9a0-41f0-b6ee-0f56513b9863 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] 10.222.0.33 "DELETE /compute/v2.1/servers/8fdcb1b0-65e9-45d1-b0da-5f603f22a8cf" status: 404 len: 111 microversion: 2.1 time: 0.151242 Oct 04 20:36:15.045566 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 352/710] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 20:36:14 2022] DELETE /compute/v2.1/servers/8fdcb1b0-65e9-45d1-b0da-5f603f22a8cf => generated 111 bytes in 163 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:36:15.059676 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-ffb672ca-d3dd-4240-bf07-725bcafb1620 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:15.064377 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-ffb672ca-d3dd-4240-bf07-725bcafb1620 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] [instance: 8fdcb1b0-65e9-45d1-b0da-5f603f22a8cf] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:15.086438 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ffb672ca-d3dd-4240-bf07-725bcafb1620 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:15.091167 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ffb672ca-d3dd-4240-bf07-725bcafb1620 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:15.092521 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ffb672ca-d3dd-4240-bf07-725bcafb1620 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:15.092655 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.multi_cell_list [None req-09968a43-4b78-42b4-a3bd-e115852c5b69 tempest-ServersAdminTestJSON-718875626 tempest-ServersAdminTestJSON-718875626-project-admin] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=128801) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 20:36:15.094090 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ffb672ca-d3dd-4240-bf07-725bcafb1620 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:15.096538 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ffb672ca-d3dd-4240-bf07-725bcafb1620 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:15.097398 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ffb672ca-d3dd-4240-bf07-725bcafb1620 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:15.117625 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:36:15.149604 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.wsgi [None req-ffb672ca-d3dd-4240-bf07-725bcafb1620 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] HTTP exception thrown: Instance 8fdcb1b0-65e9-45d1-b0da-5f603f22a8cf could not be found. Oct 04 20:36:15.151224 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-ffb672ca-d3dd-4240-bf07-725bcafb1620 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Request method failure captured: Oct 04 20:36:15.151224 n-d-854823-8 devstack@n-api.service[128802]: request: GET /compute/v2.1/servers/8fdcb1b0-65e9-45d1-b0da-5f603f22a8cf HTTP/1.1 Oct 04 20:36:15.151224 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 20:36:15.151224 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 20:36:15.151224 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 20:36:15.151224 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 0 Oct 04 20:36:15.151224 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 20:36:15.151224 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 20:36:15.151224 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 20:36:15.151224 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 20:36:15.151224 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPJiej3ZBP1oDsKzH6_pJmapps3lj_Plf6PjDgq4lqlOYZsDLHcADh93YHT5umqV8BQXmRb6AjKFJTjJrD2bCwzpsOzPYwHVOCW1l6YVMP_9BGql22JvSoxUbB3g1p7kraQwhtw0_BXlK88o-mWpjMuocTlAJF6nDb9rqPLkN6PkQKbY Oct 04 20:36:15.151224 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 20:36:15.151224 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 20:36:15.151224 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 20:36:15.151224 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 20:36:15.151224 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 20:36:15.151224 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 20:36:15.151224 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: 8f28e80977de42a892b84295ecf05141 Oct 04 20:36:15.151224 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1458163774 Oct 04 20:36:15.151224 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 20:36:15.151224 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 20:36:15.152511 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_8f28e80977de42a892b84295ecf05141", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8f28e80977de42a892b84295ecf05141"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8f28e80977de42a892b84295ecf05141"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/8f28e80977de42a892b84295ecf05141"}]}] Oct 04 20:36:15.152511 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1458163774 Oct 04 20:36:15.152511 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: 8f28e80977de42a892b84295ecf05141 Oct 04 20:36:15.152511 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1458163774 Oct 04 20:36:15.152511 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1458163774-project Oct 04 20:36:15.152511 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 20:36:15.152511 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 20:36:15.152511 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: f5eda279f6034608b192839a54dda616 Oct 04 20:36:15.152511 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1458163774-project Oct 04 20:36:15.152511 n-d-854823-8 devstack@n-api.service[128802]: method: > Oct 04 20:36:15.152511 n-d-854823-8 devstack@n-api.service[128802]: exception: Instance 8fdcb1b0-65e9-45d1-b0da-5f603f22a8cf could not be found. Oct 04 20:36:15.152511 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'id': '8fdcb1b0-65e9-45d1-b0da-5f603f22a8cf'} Oct 04 20:36:15.153224 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:36:15.153224 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:36:15.153224 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:36:15.153224 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:36:15.153224 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:36:15.153224 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:36:15.153224 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:36:15.153224 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:36:15.153224 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:36:15.153224 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:36:15.153224 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8fdcb1b0-65e9-45d1-b0da-5f603f22a8cf could not be found. Oct 04 20:36:15.153224 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:36:15.153224 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:36:15.153224 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:36:15.153224 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:36:15.153224 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:36:15.153224 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:36:15.153224 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:36:15.153224 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:36:15.153224 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:36:15.154941 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:36:15.154941 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:36:15.154941 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:36:15.154941 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:36:15.154941 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:36:15.154941 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:36:15.154941 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:36:15.154941 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8fdcb1b0-65e9-45d1-b0da-5f603f22a8cf could not be found. Oct 04 20:36:15.154941 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:36:15.154941 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:36:15.154941 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:36:15.154941 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:36:15.154941 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:36:15.154941 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:36:15.154941 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:36:15.154941 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:36:15.154941 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8fdcb1b0-65e9-45d1-b0da-5f603f22a8cf could not be found. Oct 04 20:36:15.154941 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:36:15.159446 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-ffb672ca-d3dd-4240-bf07-725bcafb1620 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Returning 404 to user: Instance 8fdcb1b0-65e9-45d1-b0da-5f603f22a8cf could not be found. {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:36:15.164812 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-ffb672ca-d3dd-4240-bf07-725bcafb1620 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] 10.222.0.33 "GET /compute/v2.1/servers/8fdcb1b0-65e9-45d1-b0da-5f603f22a8cf" status: 404 len: 111 microversion: 2.1 time: 0.116915 Oct 04 20:36:15.169641 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 353/711] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:36:15 2022] GET /compute/v2.1/servers/8fdcb1b0-65e9-45d1-b0da-5f603f22a8cf => generated 111 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:36:15.192993 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:36:15.194888 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-4fda7238-a6e9-4d25-ad0d-1aaed045db83 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Calling method '.version_select at 0x7f3c752e2670>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:15.256591 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-4fda7238-a6e9-4d25-ad0d-1aaed045db83 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-992469321" status: 202 len: 0 microversion: 2.1 time: 0.080168 Oct 04 20:36:15.258015 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 354/712] 10.222.0.33 () {58 vars in 1218 bytes} [Tue Oct 4 20:36:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-992469321 => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:36:15.322062 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-09968a43-4b78-42b4-a3bd-e115852c5b69 tempest-ServersAdminTestJSON-718875626 tempest-ServersAdminTestJSON-718875626-project-admin] 10.222.0.33 "GET /compute/v2.1/servers?host=n-h1-854823-8&all_tenants=1" status: 200 len: 663 microversion: 2.1 time: 0.490634 Oct 04 20:36:15.332015 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 359/713] 10.222.0.33 () {58 vars in 1190 bytes} [Tue Oct 4 20:36:14 2022] GET /compute/v2.1/servers?host=n-h1-854823-8&all_tenants=1 => generated 663 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:36:15.339081 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5e02c93d-0aff-4695-ba12-00dc625a3931 tempest-ServersAdminTestJSON-718875626 tempest-ServersAdminTestJSON-718875626-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:15.347536 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-5e02c93d-0aff-4695-ba12-00dc625a3931 tempest-ServersAdminTestJSON-718875626 tempest-ServersAdminTestJSON-718875626-project-admin] Searching by: {'host': 'nonexistent_host', 'deleted': False} {{(pid=128801) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 20:36:15.357222 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5e02c93d-0aff-4695-ba12-00dc625a3931 tempest-ServersAdminTestJSON-718875626 tempest-ServersAdminTestJSON-718875626-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:15.357955 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5e02c93d-0aff-4695-ba12-00dc625a3931 tempest-ServersAdminTestJSON-718875626 tempest-ServersAdminTestJSON-718875626-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:15.358564 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5e02c93d-0aff-4695-ba12-00dc625a3931 tempest-ServersAdminTestJSON-718875626 tempest-ServersAdminTestJSON-718875626-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:15.359811 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5e02c93d-0aff-4695-ba12-00dc625a3931 tempest-ServersAdminTestJSON-718875626 tempest-ServersAdminTestJSON-718875626-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:15.360431 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5e02c93d-0aff-4695-ba12-00dc625a3931 tempest-ServersAdminTestJSON-718875626 tempest-ServersAdminTestJSON-718875626-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:15.361001 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5e02c93d-0aff-4695-ba12-00dc625a3931 tempest-ServersAdminTestJSON-718875626 tempest-ServersAdminTestJSON-718875626-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:15.410391 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5e02c93d-0aff-4695-ba12-00dc625a3931 tempest-ServersAdminTestJSON-718875626 tempest-ServersAdminTestJSON-718875626-project-admin] 10.222.0.33 "GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1" status: 200 len: 15 microversion: 2.1 time: 0.076101 Oct 04 20:36:15.418311 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 360/714] 10.222.0.33 () {58 vars in 1196 bytes} [Tue Oct 4 20:36:15 2022] GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1 => generated 15 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 20:36:15.423679 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1b032ef7-785b-40ba-ac1a-413aa03b8344 tempest-ServersAdminTestJSON-718875626 tempest-ServersAdminTestJSON-718875626-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:36:15.427295 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-1b032ef7-785b-40ba-ac1a-413aa03b8344 tempest-ServersAdminTestJSON-718875626 tempest-ServersAdminTestJSON-718875626-project-admin] [instance: 9f8cc082-0a37-4123-a680-1210a90b3ca9] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:15.435060 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1b032ef7-785b-40ba-ac1a-413aa03b8344 tempest-ServersAdminTestJSON-718875626 tempest-ServersAdminTestJSON-718875626-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:15.435844 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1b032ef7-785b-40ba-ac1a-413aa03b8344 tempest-ServersAdminTestJSON-718875626 tempest-ServersAdminTestJSON-718875626-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:15.436474 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1b032ef7-785b-40ba-ac1a-413aa03b8344 tempest-ServersAdminTestJSON-718875626 tempest-ServersAdminTestJSON-718875626-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:15.437395 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1b032ef7-785b-40ba-ac1a-413aa03b8344 tempest-ServersAdminTestJSON-718875626 tempest-ServersAdminTestJSON-718875626-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:15.439703 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1b032ef7-785b-40ba-ac1a-413aa03b8344 tempest-ServersAdminTestJSON-718875626 tempest-ServersAdminTestJSON-718875626-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:15.440624 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1b032ef7-785b-40ba-ac1a-413aa03b8344 tempest-ServersAdminTestJSON-718875626 tempest-ServersAdminTestJSON-718875626-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:15.587325 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-1b032ef7-785b-40ba-ac1a-413aa03b8344 tempest-ServersAdminTestJSON-718875626 tempest-ServersAdminTestJSON-718875626-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/9f8cc082-0a37-4123-a680-1210a90b3ca9/action" status: 202 len: 0 microversion: 2.1 time: 0.167454 Oct 04 20:36:15.591450 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 361/715] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 20:36:15 2022] POST /compute/v2.1/servers/9f8cc082-0a37-4123-a680-1210a90b3ca9/action => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:36:15.601176 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7ee5909b-9535-4229-b19b-67a1fb496dba tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:36:15.609779 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-7ee5909b-9535-4229-b19b-67a1fb496dba tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] [instance: 9f8cc082-0a37-4123-a680-1210a90b3ca9] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:15.622481 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7ee5909b-9535-4229-b19b-67a1fb496dba tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:15.623089 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7ee5909b-9535-4229-b19b-67a1fb496dba tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:15.623533 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7ee5909b-9535-4229-b19b-67a1fb496dba tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:15.624380 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7ee5909b-9535-4229-b19b-67a1fb496dba tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:15.624911 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7ee5909b-9535-4229-b19b-67a1fb496dba tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:15.625458 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7ee5909b-9535-4229-b19b-67a1fb496dba tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:15.909274 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-7ee5909b-9535-4229-b19b-67a1fb496dba tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Flavor limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:36:15.911771 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-7ee5909b-9535-4229-b19b-67a1fb496dba tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Image limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:36:15.913695 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-7ee5909b-9535-4229-b19b-67a1fb496dba tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Flavor pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:36:15.914282 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-7ee5909b-9535-4229-b19b-67a1fb496dba tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Image pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:36:15.915695 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-7ee5909b-9535-4229-b19b-67a1fb496dba tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:36:15.939806 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-9d252eb0-15cd-4923-aa90-cdd31425331e tempest-QuotasAdminNegativeTest-591593273 tempest-QuotasAdminNegativeTest-591593273-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1160553591", "imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63", "flavorRef": "452"}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:36:16.067306 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-7ee5909b-9535-4229-b19b-67a1fb496dba tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] [instance: 9f8cc082-0a37-4123-a680-1210a90b3ca9] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:16.090611 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7ee5909b-9535-4229-b19b-67a1fb496dba tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:16.093063 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7ee5909b-9535-4229-b19b-67a1fb496dba tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:16.093624 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7ee5909b-9535-4229-b19b-67a1fb496dba tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:16.094748 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7ee5909b-9535-4229-b19b-67a1fb496dba tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:16.095430 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7ee5909b-9535-4229-b19b-67a1fb496dba tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:16.095831 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7ee5909b-9535-4229-b19b-67a1fb496dba tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:16.103692 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.network.neutron [None req-9d252eb0-15cd-4923-aa90-cdd31425331e tempest-QuotasAdminNegativeTest-591593273 tempest-QuotasAdminNegativeTest-591593273-project] validate_networks() for None {{(pid=128802) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:36:16.148852 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-7ee5909b-9535-4229-b19b-67a1fb496dba tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] 10.222.0.33 "POST /compute/v2.1/servers/9f8cc082-0a37-4123-a680-1210a90b3ca9/action" status: 202 len: 1067 microversion: 2.1 time: 0.555889 Oct 04 20:36:16.150123 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 362/716] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 20:36:15 2022] POST /compute/v2.1/servers/9f8cc082-0a37-4123-a680-1210a90b3ca9/action => generated 1067 bytes in 558 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 04 20:36:16.167121 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6a1cb5bc-5510-4855-94a6-755dccdad8e0 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:16.167742 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-6a1cb5bc-5510-4855-94a6-755dccdad8e0 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] [instance: c7f3bb5b-e08b-4a3f-ba4d-40012179412e] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:16.181336 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6a1cb5bc-5510-4855-94a6-755dccdad8e0 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:16.181842 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6a1cb5bc-5510-4855-94a6-755dccdad8e0 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:16.184649 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6a1cb5bc-5510-4855-94a6-755dccdad8e0 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:16.186841 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6a1cb5bc-5510-4855-94a6-755dccdad8e0 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:16.187338 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6a1cb5bc-5510-4855-94a6-755dccdad8e0 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:16.187777 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6a1cb5bc-5510-4855-94a6-755dccdad8e0 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:16.997438 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-6a1cb5bc-5510-4855-94a6-755dccdad8e0 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3563efe2b8c94931a2a46c4e14811b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3118a5d96843d3bede1ed94bd9717e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:17.015159 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-6a1cb5bc-5510-4855-94a6-755dccdad8e0 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] 10.222.0.33 "GET /compute/v2.1/servers/c7f3bb5b-e08b-4a3f-ba4d-40012179412e" status: 200 len: 1475 microversion: 2.1 time: 0.861606 Oct 04 20:36:17.016287 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 363/717] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:36:16 2022] GET /compute/v2.1/servers/c7f3bb5b-e08b-4a3f-ba4d-40012179412e => generated 1475 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:36:17.114908 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e64f0fb6-bc14-4f95-a583-580a88af9871 tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesNegativeTestJSON-server-687240247", "imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63", "flavorRef": "452", "networks": [{"uuid": "1225ff4d-600e-4008-8adb-4eec34c3d7fd"}]}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:36:17.235540 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.network.neutron [None req-e64f0fb6-bc14-4f95-a583-580a88af9871 tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] validate_networks() for [('1225ff4d-600e-4008-8adb-4eec34c3d7fd', None, None, None, None, None)] {{(pid=128801) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:36:17.385784 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell0:SELECT=10 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:36:17.497200 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-9d252eb0-15cd-4923-aa90-cdd31425331e tempest-QuotasAdminNegativeTest-591593273 tempest-QuotasAdminNegativeTest-591593273-project] Flavor limits 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:36:17.497795 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-9d252eb0-15cd-4923-aa90-cdd31425331e tempest-QuotasAdminNegativeTest-591593273 tempest-QuotasAdminNegativeTest-591593273-project] Image limits 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:36:17.498466 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-9d252eb0-15cd-4923-aa90-cdd31425331e tempest-QuotasAdminNegativeTest-591593273 tempest-QuotasAdminNegativeTest-591593273-project] Flavor pref 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:36:17.499027 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-9d252eb0-15cd-4923-aa90-cdd31425331e tempest-QuotasAdminNegativeTest-591593273 tempest-QuotasAdminNegativeTest-591593273-project] Image pref 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:36:17.499611 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-9d252eb0-15cd-4923-aa90-cdd31425331e tempest-QuotasAdminNegativeTest-591593273 tempest-QuotasAdminNegativeTest-591593273-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:36:17.523859 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9d252eb0-15cd-4923-aa90-cdd31425331e tempest-QuotasAdminNegativeTest-591593273 tempest-QuotasAdminNegativeTest-591593273-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:17.533247 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9d252eb0-15cd-4923-aa90-cdd31425331e tempest-QuotasAdminNegativeTest-591593273 tempest-QuotasAdminNegativeTest-591593273-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:17.536502 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9d252eb0-15cd-4923-aa90-cdd31425331e tempest-QuotasAdminNegativeTest-591593273 tempest-QuotasAdminNegativeTest-591593273-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:17.539624 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9d252eb0-15cd-4923-aa90-cdd31425331e tempest-QuotasAdminNegativeTest-591593273 tempest-QuotasAdminNegativeTest-591593273-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:17.540103 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9d252eb0-15cd-4923-aa90-cdd31425331e tempest-QuotasAdminNegativeTest-591593273 tempest-QuotasAdminNegativeTest-591593273-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:17.540526 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9d252eb0-15cd-4923-aa90-cdd31425331e tempest-QuotasAdminNegativeTest-591593273 tempest-QuotasAdminNegativeTest-591593273-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:17.600868 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-9d252eb0-15cd-4923-aa90-cdd31425331e tempest-QuotasAdminNegativeTest-591593273 tempest-QuotasAdminNegativeTest-591593273-project] Getting quotas for project 163e70dcd32d419f92b286d655c05e5c. Resources: {'ram', 'instances', 'cores'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:36:17.604903 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-9d252eb0-15cd-4923-aa90-cdd31425331e tempest-QuotasAdminNegativeTest-591593273 tempest-QuotasAdminNegativeTest-591593273-project] Getting quotas for user b6859154163c46f096b887af763ce881 and project 163e70dcd32d419f92b286d655c05e5c. Resources: {'ram', 'instances', 'cores'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:36:17.627858 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.utils [None req-9d252eb0-15cd-4923-aa90-cdd31425331e tempest-QuotasAdminNegativeTest-591593273 tempest-QuotasAdminNegativeTest-591593273-project] cores quota exceeded for 163e70dcd32d419f92b286d655c05e5c, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=128802) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Oct 04 20:36:17.628679 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.wsgi [None req-9d252eb0-15cd-4923-aa90-cdd31425331e tempest-QuotasAdminNegativeTest-591593273 tempest-QuotasAdminNegativeTest-591593273-project] HTTP exception thrown: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 04 20:36:17.658921 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-9d252eb0-15cd-4923-aa90-cdd31425331e tempest-QuotasAdminNegativeTest-591593273 tempest-QuotasAdminNegativeTest-591593273-project] Request method failure captured: Oct 04 20:36:17.658921 n-d-854823-8 devstack@n-api.service[128802]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 20:36:17.658921 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 20:36:17.658921 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 20:36:17.658921 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 20:36:17.658921 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 145 Oct 04 20:36:17.658921 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 20:36:17.658921 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 20:36:17.658921 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 20:36:17.658921 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 20:36:17.658921 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPJk5-DAYMeIl_LC9dgm4-AvwNoII_biFacWGoEohUsWH0xkWQ5Mz16ptn2MgAV4aAoG5VghkSBtqDHM4BD-9aclXnRyXjkqV5Xh76IrszLEb5eOgvE4XlmgtJHEPS8XgiL1MJbI36psg63v3ttjHw5Gg67cn1Y0IkKYzlp_iDMWk1ls Oct 04 20:36:17.658921 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 20:36:17.658921 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 20:36:17.658921 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 20:36:17.658921 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 20:36:17.658921 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 20:36:17.658921 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 20:36:17.658921 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: 163e70dcd32d419f92b286d655c05e5c Oct 04 20:36:17.658921 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-QuotasAdminNegativeTest-591593273 Oct 04 20:36:17.658921 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 20:36:17.658921 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 20:36:17.660928 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_163e70dcd32d419f92b286d655c05e5c", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/163e70dcd32d419f92b286d655c05e5c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/163e70dcd32d419f92b286d655c05e5c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/163e70dcd32d419f92b286d655c05e5c"}]}] Oct 04 20:36:17.660928 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-QuotasAdminNegativeTest-591593273 Oct 04 20:36:17.660928 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: 163e70dcd32d419f92b286d655c05e5c Oct 04 20:36:17.660928 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-591593273 Oct 04 20:36:17.660928 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-QuotasAdminNegativeTest-591593273-project Oct 04 20:36:17.660928 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 20:36:17.660928 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 20:36:17.660928 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: b6859154163c46f096b887af763ce881 Oct 04 20:36:17.660928 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-QuotasAdminNegativeTest-591593273-project Oct 04 20:36:17.660928 n-d-854823-8 devstack@n-api.service[128802]: Oct 04 20:36:17.660928 n-d-854823-8 devstack@n-api.service[128802]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1160553591", "imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63", "flavorRef": "452"}} Oct 04 20:36:17.660928 n-d-854823-8 devstack@n-api.service[128802]: method: > Oct 04 20:36:17.661875 n-d-854823-8 devstack@n-api.service[128802]: exception: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 04 20:36:17.661875 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1160553591', 'imageRef': '15b24725-0c99-4bcf-b1fb-907cdf8e2d63', 'flavorRef': '452'}}} Oct 04 20:36:17.661875 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:36:17.661875 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:36:17.661875 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Oct 04 20:36:17.661875 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Oct 04 20:36:17.661875 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 20:36:17.661875 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 20:36:17.661875 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 04 20:36:17.661875 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exc Oct 04 20:36:17.661875 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 04 20:36:17.661875 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 04 20:36:17.661875 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 20:36:17.661875 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 20:36:17.661875 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 04 20:36:17.661875 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 04 20:36:17.661875 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 04 20:36:17.661875 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 04 20:36:17.663738 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Oct 04 20:36:17.663738 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 04 20:36:17.663738 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Oct 04 20:36:17.663738 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:36:17.663738 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:36:17.663738 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:36:17.663738 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:36:17.663738 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 20:36:17.663738 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 20:36:17.663738 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 20:36:17.663738 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 20:36:17.663738 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Oct 04 20:36:17.663738 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Oct 04 20:36:17.663738 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Oct 04 20:36:17.663738 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Oct 04 20:36:17.663738 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Oct 04 20:36:17.663738 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 04 20:36:17.663738 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 04 20:36:17.663738 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:36:17.663738 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:36:17.663738 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:36:17.665260 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:36:17.665260 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:36:17.665260 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:36:17.665260 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:36:17.665260 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:36:17.665260 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:36:17.665260 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:36:17.665260 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:36:17.665260 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:36:17.665260 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:36:17.665260 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:36:17.665260 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:36:17.665260 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:36:17.665260 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 20:36:17.665260 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 04 20:36:17.665260 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 04 20:36:17.665260 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 04 20:36:17.665260 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:36:17.665260 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:36:17.665260 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:36:17.665260 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:36:17.666893 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:36:17.666893 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:36:17.666893 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:36:17.666893 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:36:17.666893 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 04 20:36:17.666893 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:36:17.666893 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-9d252eb0-15cd-4923-aa90-cdd31425331e tempest-QuotasAdminNegativeTest-591593273 tempest-QuotasAdminNegativeTest-591593273-project] Returning 403 to user: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:36:17.666893 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-9d252eb0-15cd-4923-aa90-cdd31425331e tempest-QuotasAdminNegativeTest-591593273 tempest-QuotasAdminNegativeTest-591593273-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 403 len: 111 microversion: 2.1 time: 2.397951 Oct 04 20:36:17.666893 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 355/718] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 20:36:15 2022] POST /compute/v2.1/servers => generated 111 bytes in 2404 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:36:17.670184 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-77a6cfad-0cd7-4ccc-9a1e-6fa1ddce044d req-7a425e03-8eef-4750-9ce8-2dc2dc5f5098 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7f3bb5b-e08b-4a3f-ba4d-40012179412e", "tag": "89b93aa0-8eeb-48c4-a6d4-93a449c21fea"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:36:17.719445 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-77a6cfad-0cd7-4ccc-9a1e-6fa1ddce044d req-7a425e03-8eef-4750-9ce8-2dc2dc5f5098 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:17.720141 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-77a6cfad-0cd7-4ccc-9a1e-6fa1ddce044d req-7a425e03-8eef-4750-9ce8-2dc2dc5f5098 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:17.720736 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-77a6cfad-0cd7-4ccc-9a1e-6fa1ddce044d req-7a425e03-8eef-4750-9ce8-2dc2dc5f5098 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:17.745752 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-77a6cfad-0cd7-4ccc-9a1e-6fa1ddce044d req-7a425e03-8eef-4750-9ce8-2dc2dc5f5098 service nova] Creating event network-changed:89b93aa0-8eeb-48c4-a6d4-93a449c21fea for instance c7f3bb5b-e08b-4a3f-ba4d-40012179412e on n-h2-854823-8 Oct 04 20:36:17.771636 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [req-77a6cfad-0cd7-4ccc-9a1e-6fa1ddce044d req-7a425e03-8eef-4750-9ce8-2dc2dc5f5098 service nova] Instance c7f3bb5b-e08b-4a3f-ba4d-40012179412e is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854823-8', 'n-h2-854823-8'} {{(pid=128802) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 20:36:17.811273 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-77a6cfad-0cd7-4ccc-9a1e-6fa1ddce044d req-7a425e03-8eef-4750-9ce8-2dc2dc5f5098 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.144527 Oct 04 20:36:17.816000 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 356/719] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:36:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:36:17.829342 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-b84dc50b-d180-432e-b7bb-a5e81af97a8f tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:17.829988 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-b84dc50b-d180-432e-b7bb-a5e81af97a8f tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] [instance: 9f8cc082-0a37-4123-a680-1210a90b3ca9] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:17.846029 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b84dc50b-d180-432e-b7bb-a5e81af97a8f tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:17.847429 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b84dc50b-d180-432e-b7bb-a5e81af97a8f tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:17.848183 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b84dc50b-d180-432e-b7bb-a5e81af97a8f tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:17.849085 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b84dc50b-d180-432e-b7bb-a5e81af97a8f tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:17.849708 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b84dc50b-d180-432e-b7bb-a5e81af97a8f tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:17.855033 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b84dc50b-d180-432e-b7bb-a5e81af97a8f tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:18.607083 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-b84dc50b-d180-432e-b7bb-a5e81af97a8f tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a24944aeb34a5ea228965be9bf4ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c288268acb30475bbc065a8f72cb21d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:18.621034 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-b84dc50b-d180-432e-b7bb-a5e81af97a8f tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] 10.222.0.33 "GET /compute/v2.1/servers/9f8cc082-0a37-4123-a680-1210a90b3ca9" status: 200 len: 1471 microversion: 2.1 time: 0.803534 Oct 04 20:36:18.640185 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 357/720] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:36:17 2022] GET /compute/v2.1/servers/9f8cc082-0a37-4123-a680-1210a90b3ca9 => generated 1471 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:36:18.645740 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-7716cf21-2666-41e7-87da-778051372a03 tempest-QuotasAdminNegativeTest-1163094605 tempest-QuotasAdminNegativeTest-1163094605-project-admin] Action: 'update', calling method: .version_select at 0x7f3c74afb790>, body: {"quota_set": {"cores": 20}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:36:18.910603 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7716cf21-2666-41e7-87da-778051372a03 tempest-QuotasAdminNegativeTest-1163094605 tempest-QuotasAdminNegativeTest-1163094605-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:18.911019 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7716cf21-2666-41e7-87da-778051372a03 tempest-QuotasAdminNegativeTest-1163094605 tempest-QuotasAdminNegativeTest-1163094605-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:18.911631 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7716cf21-2666-41e7-87da-778051372a03 tempest-QuotasAdminNegativeTest-1163094605 tempest-QuotasAdminNegativeTest-1163094605-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:18.914099 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7716cf21-2666-41e7-87da-778051372a03 tempest-QuotasAdminNegativeTest-1163094605 tempest-QuotasAdminNegativeTest-1163094605-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:18.914813 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7716cf21-2666-41e7-87da-778051372a03 tempest-QuotasAdminNegativeTest-1163094605 tempest-QuotasAdminNegativeTest-1163094605-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:18.915487 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7716cf21-2666-41e7-87da-778051372a03 tempest-QuotasAdminNegativeTest-1163094605 tempest-QuotasAdminNegativeTest-1163094605-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:19.036318 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=2,nova_api:DELETE=4 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:36:19.108146 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-7716cf21-2666-41e7-87da-778051372a03 tempest-QuotasAdminNegativeTest-1163094605 tempest-QuotasAdminNegativeTest-1163094605-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-quota-sets/163e70dcd32d419f92b286d655c05e5c" status: 200 len: 329 microversion: 2.1 time: 0.466581 Oct 04 20:36:19.125314 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 358/721] 10.222.0.33 () {60 vars in 1262 bytes} [Tue Oct 4 20:36:18 2022] PUT /compute/v2.1/os-quota-sets/163e70dcd32d419f92b286d655c05e5c => generated 329 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:36:19.125467 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-e64f0fb6-bc14-4f95-a583-580a88af9871 tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] Flavor limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:36:19.125889 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-e64f0fb6-bc14-4f95-a583-580a88af9871 tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] Image limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:36:19.126279 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-e64f0fb6-bc14-4f95-a583-580a88af9871 tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] Flavor pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:36:19.126992 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-e64f0fb6-bc14-4f95-a583-580a88af9871 tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] Image pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:36:19.127422 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-e64f0fb6-bc14-4f95-a583-580a88af9871 tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:36:19.144288 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e64f0fb6-bc14-4f95-a583-580a88af9871 tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:19.146212 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e64f0fb6-bc14-4f95-a583-580a88af9871 tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:19.149868 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e64f0fb6-bc14-4f95-a583-580a88af9871 tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:19.151421 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e64f0fb6-bc14-4f95-a583-580a88af9871 tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:19.153091 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e64f0fb6-bc14-4f95-a583-580a88af9871 tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:19.153714 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e64f0fb6-bc14-4f95-a583-580a88af9871 tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:19.156112 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-16e44932-2979-447f-911b-9108c3fc9565 tempest-ServersWithSpecificFlavorTestJSON-1131962185 tempest-ServersWithSpecificFlavorTestJSON-1131962185-project-admin] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:19.208606 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-e64f0fb6-bc14-4f95-a583-580a88af9871 tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] Getting quotas for project 2d53510a3a5543618f6b701827e7c365. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:36:19.222447 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-e64f0fb6-bc14-4f95-a583-580a88af9871 tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] Getting quotas for user 70b2a3b8a3d34ecdaab68b7f18f7788e and project 2d53510a3a5543618f6b701827e7c365. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:36:19.233042 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-16e44932-2979-447f-911b-9108c3fc9565 tempest-ServersWithSpecificFlavorTestJSON-1131962185 tempest-ServersWithSpecificFlavorTestJSON-1131962185-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/1464706422" status: 202 len: 0 microversion: 2.1 time: 0.097263 Oct 04 20:36:19.234198 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 359/722] 10.222.0.33 () {58 vars in 1161 bytes} [Tue Oct 4 20:36:19 2022] DELETE /compute/v2.1/flavors/1464706422 => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:36:19.248517 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-6dae6608-3e58-4aba-870d-12cc66258fa1 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:19.249389 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-6dae6608-3e58-4aba-870d-12cc66258fa1 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] [instance: c7f3bb5b-e08b-4a3f-ba4d-40012179412e] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:19.261271 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=2,nova_api:UPDATE=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:36:19.264282 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e64f0fb6-bc14-4f95-a583-580a88af9871 tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] Going to run 1 instances... {{(pid=128801) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:36:19.268435 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6dae6608-3e58-4aba-870d-12cc66258fa1 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:19.269140 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6dae6608-3e58-4aba-870d-12cc66258fa1 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:19.269734 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6dae6608-3e58-4aba-870d-12cc66258fa1 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:19.270666 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6dae6608-3e58-4aba-870d-12cc66258fa1 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:19.271212 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e64f0fb6-bc14-4f95-a583-580a88af9871 tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] [instance: c61a781e-96f8-4bf6-8d3d-b8c3e9c58808] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='15b24725-0c99-4bcf-b1fb-907cdf8e2d63',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128801) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:36:19.273520 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6dae6608-3e58-4aba-870d-12cc66258fa1 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:19.274141 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6dae6608-3e58-4aba-870d-12cc66258fa1 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:19.404636 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e64f0fb6-bc14-4f95-a583-580a88af9871 tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.384461 Oct 04 20:36:19.408531 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 364/723] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 20:36:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 2391 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 20:36:19.419485 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b314911f-8025-4c1b-bcdc-8584cdc99b8f tempest-QuotasAdminNegativeTest-1163094605 tempest-QuotasAdminNegativeTest-1163094605-project-admin] Calling method '.version_select at 0x7f3c74cbdaf0>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:19.599281 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-6dae6608-3e58-4aba-870d-12cc66258fa1 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3563efe2b8c94931a2a46c4e14811b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3118a5d96843d3bede1ed94bd9717e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:19.614816 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-6dae6608-3e58-4aba-870d-12cc66258fa1 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] 10.222.0.33 "GET /compute/v2.1/servers/c7f3bb5b-e08b-4a3f-ba4d-40012179412e" status: 200 len: 1473 microversion: 2.1 time: 0.374394 Oct 04 20:36:19.632139 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 360/724] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:36:19 2022] GET /compute/v2.1/servers/c7f3bb5b-e08b-4a3f-ba4d-40012179412e => generated 1473 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:36:19.651992 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-08731845-5c03-49ee-b804-d148fc585b3f tempest-ServersWithSpecificFlavorTestJSON-1131962185 tempest-ServersWithSpecificFlavorTestJSON-1131962185-project-admin] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:19.695092 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b314911f-8025-4c1b-bcdc-8584cdc99b8f tempest-QuotasAdminNegativeTest-1163094605 tempest-QuotasAdminNegativeTest-1163094605-project-admin] 10.222.0.33 "GET /compute/v2.1/os-quota-sets/163e70dcd32d419f92b286d655c05e5c" status: 200 len: 371 microversion: 2.1 time: 0.285202 Oct 04 20:36:19.709947 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 365/725] 10.222.0.33 () {58 vars in 1242 bytes} [Tue Oct 4 20:36:19 2022] GET /compute/v2.1/os-quota-sets/163e70dcd32d419f92b286d655c05e5c => generated 371 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:36:19.733330 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-08731845-5c03-49ee-b804-d148fc585b3f tempest-ServersWithSpecificFlavorTestJSON-1131962185 tempest-ServersWithSpecificFlavorTestJSON-1131962185-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 5403 microversion: 2.1 time: 0.099948 Oct 04 20:36:19.734307 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f66c7f9b-3684-443b-8a11-3a0425d06d65 tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:19.735332 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f66c7f9b-3684-443b-8a11-3a0425d06d65 tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] [instance: c61a781e-96f8-4bf6-8d3d-b8c3e9c58808] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:19.745655 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 361/726] 10.222.0.33 () {58 vars in 1146 bytes} [Tue Oct 4 20:36:19 2022] GET /compute/v2.1/flavors/detail => generated 5403 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:36:19.758215 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-63798873-5eb3-4ac9-9b1a-d7662c2d8e5f tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:19.759130 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-63798873-5eb3-4ac9-9b1a-d7662c2d8e5f tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] [instance: 9f8cc082-0a37-4123-a680-1210a90b3ca9] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:19.770017 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-63798873-5eb3-4ac9-9b1a-d7662c2d8e5f tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:19.771275 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-63798873-5eb3-4ac9-9b1a-d7662c2d8e5f tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:19.771723 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-63798873-5eb3-4ac9-9b1a-d7662c2d8e5f tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:19.773033 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-63798873-5eb3-4ac9-9b1a-d7662c2d8e5f tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:19.773647 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-63798873-5eb3-4ac9-9b1a-d7662c2d8e5f tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:19.774075 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-63798873-5eb3-4ac9-9b1a-d7662c2d8e5f tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:19.945259 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f66c7f9b-3684-443b-8a11-3a0425d06d65 tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70b2a3b8a3d34ecdaab68b7f18f7788e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d53510a3a5543618f6b701827e7c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:19.952872 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f66c7f9b-3684-443b-8a11-3a0425d06d65 tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] 10.222.0.33 "GET /compute/v2.1/servers/c61a781e-96f8-4bf6-8d3d-b8c3e9c58808" status: 200 len: 1215 microversion: 2.1 time: 0.238576 Oct 04 20:36:19.980003 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 366/727] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:36:19 2022] GET /compute/v2.1/servers/c61a781e-96f8-4bf6-8d3d-b8c3e9c58808 => generated 1215 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:36:19.996242 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0d61c68f-23b3-4b62-83f2-2dc40d284b66 tempest-QuotasAdminNegativeTest-1163094605 tempest-QuotasAdminNegativeTest-1163094605-project-admin] Action: 'update', calling method: .version_select at 0x7f3c74bc1040>, body: {"quota_set": {"force": true, "instances": 0}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:36:20.202720 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0d61c68f-23b3-4b62-83f2-2dc40d284b66 tempest-QuotasAdminNegativeTest-1163094605 tempest-QuotasAdminNegativeTest-1163094605-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:20.204265 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0d61c68f-23b3-4b62-83f2-2dc40d284b66 tempest-QuotasAdminNegativeTest-1163094605 tempest-QuotasAdminNegativeTest-1163094605-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:20.205583 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0d61c68f-23b3-4b62-83f2-2dc40d284b66 tempest-QuotasAdminNegativeTest-1163094605 tempest-QuotasAdminNegativeTest-1163094605-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:20.208547 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0d61c68f-23b3-4b62-83f2-2dc40d284b66 tempest-QuotasAdminNegativeTest-1163094605 tempest-QuotasAdminNegativeTest-1163094605-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:20.212182 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0d61c68f-23b3-4b62-83f2-2dc40d284b66 tempest-QuotasAdminNegativeTest-1163094605 tempest-QuotasAdminNegativeTest-1163094605-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:20.213123 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0d61c68f-23b3-4b62-83f2-2dc40d284b66 tempest-QuotasAdminNegativeTest-1163094605 tempest-QuotasAdminNegativeTest-1163094605-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:20.357497 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-0d61c68f-23b3-4b62-83f2-2dc40d284b66 tempest-QuotasAdminNegativeTest-1163094605 tempest-QuotasAdminNegativeTest-1163094605-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-quota-sets/163e70dcd32d419f92b286d655c05e5c" status: 200 len: 328 microversion: 2.1 time: 0.372550 Oct 04 20:36:20.373515 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 367/728] 10.222.0.33 () {60 vars in 1262 bytes} [Tue Oct 4 20:36:19 2022] PUT /compute/v2.1/os-quota-sets/163e70dcd32d419f92b286d655c05e5c => generated 328 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:36:20.385495 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7cf63884-e9dc-477d-a888-267546d073f7 tempest-ServersWithSpecificFlavorTestJSON-1131962185 tempest-ServersWithSpecificFlavorTestJSON-1131962185-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:20.411865 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-63798873-5eb3-4ac9-9b1a-d7662c2d8e5f tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a24944aeb34a5ea228965be9bf4ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c288268acb30475bbc065a8f72cb21d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:20.429414 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-63798873-5eb3-4ac9-9b1a-d7662c2d8e5f tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] 10.222.0.33 "GET /compute/v2.1/servers/9f8cc082-0a37-4123-a680-1210a90b3ca9" status: 200 len: 1471 microversion: 2.1 time: 0.682117 Oct 04 20:36:20.432601 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 362/729] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:36:19 2022] GET /compute/v2.1/servers/9f8cc082-0a37-4123-a680-1210a90b3ca9 => generated 1471 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:36:20.463477 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-7cf63884-e9dc-477d-a888-267546d073f7 tempest-ServersWithSpecificFlavorTestJSON-1131962185 tempest-ServersWithSpecificFlavorTestJSON-1131962185-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/560564508" status: 202 len: 0 microversion: 2.1 time: 0.087867 Oct 04 20:36:20.474064 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 368/730] 10.222.0.33 () {58 vars in 1158 bytes} [Tue Oct 4 20:36:20 2022] DELETE /compute/v2.1/flavors/560564508 => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:36:20.480093 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-3e3a8984-7415-4f2c-9524-37521a7ebd9f tempest-ServersWithSpecificFlavorTestJSON-1131962185 tempest-ServersWithSpecificFlavorTestJSON-1131962185-project-admin] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:20.509734 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-282e2385-c4b2-445f-a331-d5c594248486 tempest-QuotasAdminNegativeTest-591593273 tempest-QuotasAdminNegativeTest-591593273-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-245096487", "imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63", "flavorRef": "452"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:36:20.535532 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-3e3a8984-7415-4f2c-9524-37521a7ebd9f tempest-ServersWithSpecificFlavorTestJSON-1131962185 tempest-ServersWithSpecificFlavorTestJSON-1131962185-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.060722 Oct 04 20:36:20.547984 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 363/731] 10.222.0.33 () {58 vars in 1146 bytes} [Tue Oct 4 20:36:20 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:36:20.576171 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-68af422b-fd23-4808-99a4-f6b13462cc0f tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:20.576672 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-68af422b-fd23-4808-99a4-f6b13462cc0f tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] [instance: c6cdf5bb-821d-4438-9c05-f227c4ebbbcd] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:20.604414 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-68af422b-fd23-4808-99a4-f6b13462cc0f tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:20.604916 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-68af422b-fd23-4808-99a4-f6b13462cc0f tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:20.605354 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-68af422b-fd23-4808-99a4-f6b13462cc0f tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:20.606073 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-68af422b-fd23-4808-99a4-f6b13462cc0f tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:20.616704 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-68af422b-fd23-4808-99a4-f6b13462cc0f tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:20.620000 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-68af422b-fd23-4808-99a4-f6b13462cc0f tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:20.668301 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.wsgi [None req-68af422b-fd23-4808-99a4-f6b13462cc0f tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] HTTP exception thrown: Instance c6cdf5bb-821d-4438-9c05-f227c4ebbbcd could not be found. Oct 04 20:36:20.681881 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-68af422b-fd23-4808-99a4-f6b13462cc0f tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Request method failure captured: Oct 04 20:36:20.681881 n-d-854823-8 devstack@n-api.service[128802]: request: DELETE /compute/v2.1/servers/c6cdf5bb-821d-4438-9c05-f227c4ebbbcd HTTP/1.1 Oct 04 20:36:20.681881 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 20:36:20.681881 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 20:36:20.681881 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 20:36:20.681881 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 0 Oct 04 20:36:20.681881 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 20:36:20.681881 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 20:36:20.681881 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 20:36:20.681881 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 20:36:20.681881 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPJiej3ZBP1oDsKzH6_pJmapps3lj_Plf6PjDgq4lqlOYZsDLHcADh93YHT5umqV8BQXmRb6AjKFJTjJrD2bCwzpsOzPYwHVOCW1l6YVMP_9BGql22JvSoxUbB3g1p7kraQwhtw0_BXlK88o-mWpjMuocTlAJF6nDb9rqPLkN6PkQKbY Oct 04 20:36:20.681881 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 20:36:20.681881 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 20:36:20.681881 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 20:36:20.681881 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 20:36:20.681881 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 20:36:20.681881 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 20:36:20.681881 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: 8f28e80977de42a892b84295ecf05141 Oct 04 20:36:20.681881 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1458163774 Oct 04 20:36:20.681881 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 20:36:20.681881 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 20:36:20.683308 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_8f28e80977de42a892b84295ecf05141", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8f28e80977de42a892b84295ecf05141"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8f28e80977de42a892b84295ecf05141"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/8f28e80977de42a892b84295ecf05141"}]}] Oct 04 20:36:20.683308 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1458163774 Oct 04 20:36:20.683308 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: 8f28e80977de42a892b84295ecf05141 Oct 04 20:36:20.683308 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1458163774 Oct 04 20:36:20.683308 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1458163774-project Oct 04 20:36:20.683308 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 20:36:20.683308 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 20:36:20.683308 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: f5eda279f6034608b192839a54dda616 Oct 04 20:36:20.683308 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1458163774-project Oct 04 20:36:20.683308 n-d-854823-8 devstack@n-api.service[128802]: method: > Oct 04 20:36:20.683308 n-d-854823-8 devstack@n-api.service[128802]: exception: Instance c6cdf5bb-821d-4438-9c05-f227c4ebbbcd could not be found. Oct 04 20:36:20.683308 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'id': 'c6cdf5bb-821d-4438-9c05-f227c4ebbbcd'} Oct 04 20:36:20.684093 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:36:20.684093 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:36:20.684093 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:36:20.684093 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:36:20.684093 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:36:20.684093 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:36:20.684093 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:36:20.684093 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:36:20.684093 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:36:20.684093 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:36:20.684093 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c6cdf5bb-821d-4438-9c05-f227c4ebbbcd could not be found. Oct 04 20:36:20.684093 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:36:20.684093 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:36:20.684093 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:36:20.684093 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:36:20.684093 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:36:20.684093 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:36:20.684093 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:36:20.684093 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:36:20.684093 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:36:20.685247 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:36:20.685247 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 20:36:20.685247 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 20:36:20.685247 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 20:36:20.685247 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 20:36:20.685247 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:36:20.685247 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:36:20.685247 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:36:20.685247 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:36:20.685247 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c6cdf5bb-821d-4438-9c05-f227c4ebbbcd could not be found. Oct 04 20:36:20.685247 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:36:20.685247 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:36:20.685247 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:36:20.685247 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:36:20.685247 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:36:20.685247 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:36:20.685247 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:36:20.685247 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:36:20.685247 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c6cdf5bb-821d-4438-9c05-f227c4ebbbcd could not be found. Oct 04 20:36:20.685247 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:36:20.686579 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-68af422b-fd23-4808-99a4-f6b13462cc0f tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Returning 404 to user: Instance c6cdf5bb-821d-4438-9c05-f227c4ebbbcd could not be found. {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:36:20.686579 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-68af422b-fd23-4808-99a4-f6b13462cc0f tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] 10.222.0.33 "DELETE /compute/v2.1/servers/c6cdf5bb-821d-4438-9c05-f227c4ebbbcd" status: 404 len: 111 microversion: 2.1 time: 0.114846 Oct 04 20:36:20.686579 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 364/732] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 20:36:20 2022] DELETE /compute/v2.1/servers/c6cdf5bb-821d-4438-9c05-f227c4ebbbcd => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:36:20.704933 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-16e34d8a-60f5-44e4-bbbe-e6061091f6c5 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:20.705879 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-16e34d8a-60f5-44e4-bbbe-e6061091f6c5 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] [instance: c7f3bb5b-e08b-4a3f-ba4d-40012179412e] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:20.708892 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.network.neutron [None req-282e2385-c4b2-445f-a331-d5c594248486 tempest-QuotasAdminNegativeTest-591593273 tempest-QuotasAdminNegativeTest-591593273-project] validate_networks() for None {{(pid=128801) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:36:20.720013 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-16e34d8a-60f5-44e4-bbbe-e6061091f6c5 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:20.721303 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-16e34d8a-60f5-44e4-bbbe-e6061091f6c5 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:20.723041 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-16e34d8a-60f5-44e4-bbbe-e6061091f6c5 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:20.723977 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-16e34d8a-60f5-44e4-bbbe-e6061091f6c5 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:20.729864 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-16e34d8a-60f5-44e4-bbbe-e6061091f6c5 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:20.730606 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-16e34d8a-60f5-44e4-bbbe-e6061091f6c5 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:22.055308 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-16e34d8a-60f5-44e4-bbbe-e6061091f6c5 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3563efe2b8c94931a2a46c4e14811b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3118a5d96843d3bede1ed94bd9717e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:22.065700 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-16e34d8a-60f5-44e4-bbbe-e6061091f6c5 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] 10.222.0.33 "GET /compute/v2.1/servers/c7f3bb5b-e08b-4a3f-ba4d-40012179412e" status: 200 len: 1473 microversion: 2.1 time: 1.376038 Oct 04 20:36:22.071430 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 365/733] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:36:20 2022] GET /compute/v2.1/servers/c7f3bb5b-e08b-4a3f-ba4d-40012179412e => generated 1473 bytes in 1387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:36:22.106711 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-dfcdcbda-3d8c-4dbe-955f-74fb3dedf6d2 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:22.110442 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-dfcdcbda-3d8c-4dbe-955f-74fb3dedf6d2 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] [instance: c6cdf5bb-821d-4438-9c05-f227c4ebbbcd] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:22.139689 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dfcdcbda-3d8c-4dbe-955f-74fb3dedf6d2 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:22.140884 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dfcdcbda-3d8c-4dbe-955f-74fb3dedf6d2 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:22.142721 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dfcdcbda-3d8c-4dbe-955f-74fb3dedf6d2 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:22.143610 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dfcdcbda-3d8c-4dbe-955f-74fb3dedf6d2 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:22.144540 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dfcdcbda-3d8c-4dbe-955f-74fb3dedf6d2 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:22.151038 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dfcdcbda-3d8c-4dbe-955f-74fb3dedf6d2 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:22.210323 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.wsgi [None req-dfcdcbda-3d8c-4dbe-955f-74fb3dedf6d2 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] HTTP exception thrown: Instance c6cdf5bb-821d-4438-9c05-f227c4ebbbcd could not be found. Oct 04 20:36:22.213845 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-dfcdcbda-3d8c-4dbe-955f-74fb3dedf6d2 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Request method failure captured: Oct 04 20:36:22.213845 n-d-854823-8 devstack@n-api.service[128802]: request: GET /compute/v2.1/servers/c6cdf5bb-821d-4438-9c05-f227c4ebbbcd HTTP/1.1 Oct 04 20:36:22.213845 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 20:36:22.213845 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 20:36:22.213845 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 20:36:22.213845 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 0 Oct 04 20:36:22.213845 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 20:36:22.213845 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 20:36:22.213845 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 20:36:22.213845 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 20:36:22.213845 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPJiej3ZBP1oDsKzH6_pJmapps3lj_Plf6PjDgq4lqlOYZsDLHcADh93YHT5umqV8BQXmRb6AjKFJTjJrD2bCwzpsOzPYwHVOCW1l6YVMP_9BGql22JvSoxUbB3g1p7kraQwhtw0_BXlK88o-mWpjMuocTlAJF6nDb9rqPLkN6PkQKbY Oct 04 20:36:22.213845 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 20:36:22.213845 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 20:36:22.213845 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 20:36:22.213845 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 20:36:22.213845 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 20:36:22.213845 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 20:36:22.213845 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: 8f28e80977de42a892b84295ecf05141 Oct 04 20:36:22.213845 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1458163774 Oct 04 20:36:22.213845 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 20:36:22.213845 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 20:36:22.215427 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_8f28e80977de42a892b84295ecf05141", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8f28e80977de42a892b84295ecf05141"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8f28e80977de42a892b84295ecf05141"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/8f28e80977de42a892b84295ecf05141"}]}] Oct 04 20:36:22.215427 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1458163774 Oct 04 20:36:22.215427 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: 8f28e80977de42a892b84295ecf05141 Oct 04 20:36:22.215427 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1458163774 Oct 04 20:36:22.215427 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1458163774-project Oct 04 20:36:22.215427 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 20:36:22.215427 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 20:36:22.215427 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: f5eda279f6034608b192839a54dda616 Oct 04 20:36:22.215427 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1458163774-project Oct 04 20:36:22.215427 n-d-854823-8 devstack@n-api.service[128802]: method: > Oct 04 20:36:22.215427 n-d-854823-8 devstack@n-api.service[128802]: exception: Instance c6cdf5bb-821d-4438-9c05-f227c4ebbbcd could not be found. Oct 04 20:36:22.215427 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'id': 'c6cdf5bb-821d-4438-9c05-f227c4ebbbcd'} Oct 04 20:36:22.216273 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:36:22.216273 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:36:22.216273 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:36:22.216273 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:36:22.216273 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:36:22.216273 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:36:22.216273 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:36:22.216273 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:36:22.216273 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:36:22.216273 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:36:22.216273 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c6cdf5bb-821d-4438-9c05-f227c4ebbbcd could not be found. Oct 04 20:36:22.216273 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:36:22.216273 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:36:22.216273 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:36:22.216273 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:36:22.216273 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:36:22.216273 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:36:22.216273 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:36:22.216273 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:36:22.216273 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:36:22.217606 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:36:22.217606 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:36:22.217606 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:36:22.217606 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:36:22.217606 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:36:22.217606 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:36:22.217606 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:36:22.217606 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c6cdf5bb-821d-4438-9c05-f227c4ebbbcd could not be found. Oct 04 20:36:22.217606 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:36:22.217606 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:36:22.217606 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:36:22.217606 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:36:22.217606 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:36:22.217606 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:36:22.217606 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:36:22.217606 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:36:22.217606 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c6cdf5bb-821d-4438-9c05-f227c4ebbbcd could not be found. Oct 04 20:36:22.217606 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:36:22.228851 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-dfcdcbda-3d8c-4dbe-955f-74fb3dedf6d2 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Returning 404 to user: Instance c6cdf5bb-821d-4438-9c05-f227c4ebbbcd could not be found. {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:36:22.233317 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-dfcdcbda-3d8c-4dbe-955f-74fb3dedf6d2 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] 10.222.0.33 "GET /compute/v2.1/servers/c6cdf5bb-821d-4438-9c05-f227c4ebbbcd" status: 404 len: 111 microversion: 2.1 time: 0.158900 Oct 04 20:36:22.233987 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 366/734] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:36:22 2022] GET /compute/v2.1/servers/c6cdf5bb-821d-4438-9c05-f227c4ebbbcd => generated 111 bytes in 161 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:36:22.246571 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-282e2385-c4b2-445f-a331-d5c594248486 tempest-QuotasAdminNegativeTest-591593273 tempest-QuotasAdminNegativeTest-591593273-project] Flavor limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:36:22.247115 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-282e2385-c4b2-445f-a331-d5c594248486 tempest-QuotasAdminNegativeTest-591593273 tempest-QuotasAdminNegativeTest-591593273-project] Image limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:36:22.247539 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-282e2385-c4b2-445f-a331-d5c594248486 tempest-QuotasAdminNegativeTest-591593273 tempest-QuotasAdminNegativeTest-591593273-project] Flavor pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:36:22.247928 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-282e2385-c4b2-445f-a331-d5c594248486 tempest-QuotasAdminNegativeTest-591593273 tempest-QuotasAdminNegativeTest-591593273-project] Image pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:36:22.248435 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-282e2385-c4b2-445f-a331-d5c594248486 tempest-QuotasAdminNegativeTest-591593273 tempest-QuotasAdminNegativeTest-591593273-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:36:22.255895 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-3647b0d2-0588-4af5-99f2-e6ab13107647 tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:22.256567 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-3647b0d2-0588-4af5-99f2-e6ab13107647 tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] [instance: c61a781e-96f8-4bf6-8d3d-b8c3e9c58808] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:22.275437 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-282e2385-c4b2-445f-a331-d5c594248486 tempest-QuotasAdminNegativeTest-591593273 tempest-QuotasAdminNegativeTest-591593273-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:22.275934 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-282e2385-c4b2-445f-a331-d5c594248486 tempest-QuotasAdminNegativeTest-591593273 tempest-QuotasAdminNegativeTest-591593273-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:22.276383 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-282e2385-c4b2-445f-a331-d5c594248486 tempest-QuotasAdminNegativeTest-591593273 tempest-QuotasAdminNegativeTest-591593273-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:22.277122 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-282e2385-c4b2-445f-a331-d5c594248486 tempest-QuotasAdminNegativeTest-591593273 tempest-QuotasAdminNegativeTest-591593273-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:22.277582 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-282e2385-c4b2-445f-a331-d5c594248486 tempest-QuotasAdminNegativeTest-591593273 tempest-QuotasAdminNegativeTest-591593273-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:22.278009 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-282e2385-c4b2-445f-a331-d5c594248486 tempest-QuotasAdminNegativeTest-591593273 tempest-QuotasAdminNegativeTest-591593273-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:22.283128 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3647b0d2-0588-4af5-99f2-e6ab13107647 tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:22.285441 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3647b0d2-0588-4af5-99f2-e6ab13107647 tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:22.285883 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3647b0d2-0588-4af5-99f2-e6ab13107647 tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:22.288869 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3647b0d2-0588-4af5-99f2-e6ab13107647 tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:22.289333 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3647b0d2-0588-4af5-99f2-e6ab13107647 tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:22.289763 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3647b0d2-0588-4af5-99f2-e6ab13107647 tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:22.360906 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-282e2385-c4b2-445f-a331-d5c594248486 tempest-QuotasAdminNegativeTest-591593273 tempest-QuotasAdminNegativeTest-591593273-project] Getting quotas for project 163e70dcd32d419f92b286d655c05e5c. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:36:22.366523 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-282e2385-c4b2-445f-a331-d5c594248486 tempest-QuotasAdminNegativeTest-591593273 tempest-QuotasAdminNegativeTest-591593273-project] Getting quotas for user b6859154163c46f096b887af763ce881 and project 163e70dcd32d419f92b286d655c05e5c. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:36:22.408530 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.utils [None req-282e2385-c4b2-445f-a331-d5c594248486 tempest-QuotasAdminNegativeTest-591593273 tempest-QuotasAdminNegativeTest-591593273-project] instances quota exceeded for 163e70dcd32d419f92b286d655c05e5c, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=128801) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Oct 04 20:36:22.409298 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-282e2385-c4b2-445f-a331-d5c594248486 tempest-QuotasAdminNegativeTest-591593273 tempest-QuotasAdminNegativeTest-591593273-project] HTTP exception thrown: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 04 20:36:22.420446 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-282e2385-c4b2-445f-a331-d5c594248486 tempest-QuotasAdminNegativeTest-591593273 tempest-QuotasAdminNegativeTest-591593273-project] Request method failure captured: Oct 04 20:36:22.420446 n-d-854823-8 devstack@n-api.service[128801]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 20:36:22.420446 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:36:22.420446 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:36:22.420446 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:36:22.420446 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 144 Oct 04 20:36:22.420446 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:36:22.420446 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:36:22.420446 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:36:22.420446 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:36:22.420446 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJk5-DAYMeIl_LC9dgm4-AvwNoII_biFacWGoEohUsWH0xkWQ5Mz16ptn2MgAV4aAoG5VghkSBtqDHM4BD-9aclXnRyXjkqV5Xh76IrszLEb5eOgvE4XlmgtJHEPS8XgiL1MJbI36psg63v3ttjHw5Gg67cn1Y0IkKYzlp_iDMWk1ls Oct 04 20:36:22.420446 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:36:22.420446 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:36:22.420446 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:36:22.420446 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:36:22.420446 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:36:22.420446 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:36:22.420446 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: 163e70dcd32d419f92b286d655c05e5c Oct 04 20:36:22.420446 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-QuotasAdminNegativeTest-591593273 Oct 04 20:36:22.420446 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 20:36:22.420446 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 20:36:22.422131 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_163e70dcd32d419f92b286d655c05e5c", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/163e70dcd32d419f92b286d655c05e5c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/163e70dcd32d419f92b286d655c05e5c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/163e70dcd32d419f92b286d655c05e5c"}]}] Oct 04 20:36:22.422131 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-QuotasAdminNegativeTest-591593273 Oct 04 20:36:22.422131 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: 163e70dcd32d419f92b286d655c05e5c Oct 04 20:36:22.422131 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-591593273 Oct 04 20:36:22.422131 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-QuotasAdminNegativeTest-591593273-project Oct 04 20:36:22.422131 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:36:22.422131 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:36:22.422131 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: b6859154163c46f096b887af763ce881 Oct 04 20:36:22.422131 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-QuotasAdminNegativeTest-591593273-project Oct 04 20:36:22.422131 n-d-854823-8 devstack@n-api.service[128801]: Oct 04 20:36:22.422131 n-d-854823-8 devstack@n-api.service[128801]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-245096487", "imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63", "flavorRef": "452"}} Oct 04 20:36:22.422131 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 20:36:22.423009 n-d-854823-8 devstack@n-api.service[128801]: exception: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 04 20:36:22.423009 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-245096487', 'imageRef': '15b24725-0c99-4bcf-b1fb-907cdf8e2d63', 'flavorRef': '452'}}} Oct 04 20:36:22.423009 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:36:22.423009 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:36:22.423009 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Oct 04 20:36:22.423009 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Oct 04 20:36:22.423009 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 20:36:22.423009 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 20:36:22.423009 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 04 20:36:22.423009 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc Oct 04 20:36:22.423009 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 04 20:36:22.423009 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 04 20:36:22.423009 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 20:36:22.423009 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 20:36:22.423009 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 04 20:36:22.423009 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 04 20:36:22.423009 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 04 20:36:22.423009 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 04 20:36:22.424024 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Oct 04 20:36:22.424024 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 04 20:36:22.424024 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['instances'] Oct 04 20:36:22.424024 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:36:22.424024 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:36:22.424024 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:36:22.424024 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:36:22.424024 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 20:36:22.424024 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 20:36:22.424024 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 20:36:22.424024 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 20:36:22.424024 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Oct 04 20:36:22.424024 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Oct 04 20:36:22.424024 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Oct 04 20:36:22.424024 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Oct 04 20:36:22.424024 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Oct 04 20:36:22.424024 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 04 20:36:22.424024 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 04 20:36:22.424024 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:36:22.424024 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:36:22.424024 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:36:22.425185 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:36:22.425185 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:36:22.425185 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:36:22.425185 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:36:22.425185 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:36:22.425185 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:36:22.425185 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:36:22.425185 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:36:22.425185 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:36:22.425185 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:36:22.425185 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:36:22.425185 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:36:22.425185 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:36:22.425185 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 20:36:22.425185 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 04 20:36:22.425185 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 04 20:36:22.425185 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 04 20:36:22.425185 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:36:22.425185 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:36:22.425185 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:36:22.425185 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:36:22.426563 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:36:22.426563 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:36:22.426563 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:36:22.426563 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:36:22.426563 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 04 20:36:22.426563 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:36:22.426563 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-282e2385-c4b2-445f-a331-d5c594248486 tempest-QuotasAdminNegativeTest-591593273 tempest-QuotasAdminNegativeTest-591593273-project] Returning 403 to user: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:36:22.426563 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-282e2385-c4b2-445f-a331-d5c594248486 tempest-QuotasAdminNegativeTest-591593273 tempest-QuotasAdminNegativeTest-591593273-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 403 len: 119 microversion: 2.1 time: 1.918680 Oct 04 20:36:22.426563 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 369/735] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 20:36:20 2022] POST /compute/v2.1/servers => generated 119 bytes in 1920 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:36:22.437259 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5e8cefd9-ed0a-4cf9-a90a-958df7a25fb4 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:22.437876 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-5e8cefd9-ed0a-4cf9-a90a-958df7a25fb4 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] [instance: 9f8cc082-0a37-4123-a680-1210a90b3ca9] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:22.458623 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5e8cefd9-ed0a-4cf9-a90a-958df7a25fb4 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:22.459127 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5e8cefd9-ed0a-4cf9-a90a-958df7a25fb4 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:22.461814 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5e8cefd9-ed0a-4cf9-a90a-958df7a25fb4 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:22.463267 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5e8cefd9-ed0a-4cf9-a90a-958df7a25fb4 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:22.463748 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5e8cefd9-ed0a-4cf9-a90a-958df7a25fb4 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:22.465451 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5e8cefd9-ed0a-4cf9-a90a-958df7a25fb4 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:22.574814 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-3647b0d2-0588-4af5-99f2-e6ab13107647 tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70b2a3b8a3d34ecdaab68b7f18f7788e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d53510a3a5543618f6b701827e7c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:22.589607 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-3647b0d2-0588-4af5-99f2-e6ab13107647 tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] 10.222.0.33 "GET /compute/v2.1/servers/c61a781e-96f8-4bf6-8d3d-b8c3e9c58808" status: 200 len: 1285 microversion: 2.1 time: 0.348056 Oct 04 20:36:22.591962 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 367/736] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:36:22 2022] GET /compute/v2.1/servers/c61a781e-96f8-4bf6-8d3d-b8c3e9c58808 => generated 1285 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:36:22.612722 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-a0bc866f-33c4-4a3a-b2ed-085fddade2b0 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:22.629685 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-a0bc866f-33c4-4a3a-b2ed-085fddade2b0 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] [instance: 8fdcb1b0-65e9-45d1-b0da-5f603f22a8cf] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:22.656440 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a0bc866f-33c4-4a3a-b2ed-085fddade2b0 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:22.657241 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a0bc866f-33c4-4a3a-b2ed-085fddade2b0 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:22.657861 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a0bc866f-33c4-4a3a-b2ed-085fddade2b0 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:22.659473 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a0bc866f-33c4-4a3a-b2ed-085fddade2b0 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:22.660975 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a0bc866f-33c4-4a3a-b2ed-085fddade2b0 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:22.661540 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a0bc866f-33c4-4a3a-b2ed-085fddade2b0 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:22.717557 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.wsgi [None req-a0bc866f-33c4-4a3a-b2ed-085fddade2b0 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] HTTP exception thrown: Instance 8fdcb1b0-65e9-45d1-b0da-5f603f22a8cf could not be found. Oct 04 20:36:22.736917 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-a0bc866f-33c4-4a3a-b2ed-085fddade2b0 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Request method failure captured: Oct 04 20:36:22.736917 n-d-854823-8 devstack@n-api.service[128802]: request: DELETE /compute/v2.1/servers/8fdcb1b0-65e9-45d1-b0da-5f603f22a8cf HTTP/1.1 Oct 04 20:36:22.736917 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 20:36:22.736917 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 20:36:22.736917 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 20:36:22.736917 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 0 Oct 04 20:36:22.736917 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 20:36:22.736917 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 20:36:22.736917 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 20:36:22.736917 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 20:36:22.736917 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPJiej3ZBP1oDsKzH6_pJmapps3lj_Plf6PjDgq4lqlOYZsDLHcADh93YHT5umqV8BQXmRb6AjKFJTjJrD2bCwzpsOzPYwHVOCW1l6YVMP_9BGql22JvSoxUbB3g1p7kraQwhtw0_BXlK88o-mWpjMuocTlAJF6nDb9rqPLkN6PkQKbY Oct 04 20:36:22.736917 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 20:36:22.736917 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 20:36:22.736917 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 20:36:22.736917 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 20:36:22.736917 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 20:36:22.736917 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 20:36:22.736917 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: 8f28e80977de42a892b84295ecf05141 Oct 04 20:36:22.736917 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1458163774 Oct 04 20:36:22.736917 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 20:36:22.736917 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 20:36:22.738514 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_8f28e80977de42a892b84295ecf05141", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8f28e80977de42a892b84295ecf05141"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8f28e80977de42a892b84295ecf05141"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/8f28e80977de42a892b84295ecf05141"}]}] Oct 04 20:36:22.738514 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1458163774 Oct 04 20:36:22.738514 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: 8f28e80977de42a892b84295ecf05141 Oct 04 20:36:22.738514 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1458163774 Oct 04 20:36:22.738514 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1458163774-project Oct 04 20:36:22.738514 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 20:36:22.738514 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 20:36:22.738514 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: f5eda279f6034608b192839a54dda616 Oct 04 20:36:22.738514 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1458163774-project Oct 04 20:36:22.738514 n-d-854823-8 devstack@n-api.service[128802]: method: > Oct 04 20:36:22.738514 n-d-854823-8 devstack@n-api.service[128802]: exception: Instance 8fdcb1b0-65e9-45d1-b0da-5f603f22a8cf could not be found. Oct 04 20:36:22.738514 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'id': '8fdcb1b0-65e9-45d1-b0da-5f603f22a8cf'} Oct 04 20:36:22.739267 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:36:22.739267 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:36:22.739267 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:36:22.739267 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:36:22.739267 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:36:22.739267 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:36:22.739267 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:36:22.739267 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:36:22.739267 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:36:22.739267 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:36:22.739267 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8fdcb1b0-65e9-45d1-b0da-5f603f22a8cf could not be found. Oct 04 20:36:22.739267 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:36:22.739267 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:36:22.739267 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:36:22.739267 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:36:22.739267 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:36:22.739267 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:36:22.739267 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:36:22.739267 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:36:22.739267 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:36:22.740384 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:36:22.740384 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 20:36:22.740384 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 20:36:22.740384 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 20:36:22.740384 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 20:36:22.740384 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:36:22.740384 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:36:22.740384 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:36:22.740384 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:36:22.740384 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8fdcb1b0-65e9-45d1-b0da-5f603f22a8cf could not be found. Oct 04 20:36:22.740384 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:36:22.740384 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:36:22.740384 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:36:22.740384 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:36:22.740384 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:36:22.740384 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:36:22.740384 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:36:22.740384 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:36:22.740384 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8fdcb1b0-65e9-45d1-b0da-5f603f22a8cf could not be found. Oct 04 20:36:22.740384 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:36:22.748331 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-a0bc866f-33c4-4a3a-b2ed-085fddade2b0 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Returning 404 to user: Instance 8fdcb1b0-65e9-45d1-b0da-5f603f22a8cf could not be found. {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:36:22.750232 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-a0bc866f-33c4-4a3a-b2ed-085fddade2b0 tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] 10.222.0.33 "DELETE /compute/v2.1/servers/8fdcb1b0-65e9-45d1-b0da-5f603f22a8cf" status: 404 len: 111 microversion: 2.1 time: 0.157106 Oct 04 20:36:22.753980 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 368/737] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 20:36:22 2022] DELETE /compute/v2.1/servers/8fdcb1b0-65e9-45d1-b0da-5f603f22a8cf => generated 111 bytes in 161 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:36:22.770177 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-fd910ced-79cf-498e-bb94-832f4558da33 tempest-QuotasAdminNegativeTest-1163094605 tempest-QuotasAdminNegativeTest-1163094605-project-admin] Action: 'update', calling method: .version_select at 0x7f3c7480ed30>, body: {"quota_set": {"instances": 10}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:36:22.945121 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fd910ced-79cf-498e-bb94-832f4558da33 tempest-QuotasAdminNegativeTest-1163094605 tempest-QuotasAdminNegativeTest-1163094605-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:22.949545 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fd910ced-79cf-498e-bb94-832f4558da33 tempest-QuotasAdminNegativeTest-1163094605 tempest-QuotasAdminNegativeTest-1163094605-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:22.950500 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fd910ced-79cf-498e-bb94-832f4558da33 tempest-QuotasAdminNegativeTest-1163094605 tempest-QuotasAdminNegativeTest-1163094605-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:22.953752 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fd910ced-79cf-498e-bb94-832f4558da33 tempest-QuotasAdminNegativeTest-1163094605 tempest-QuotasAdminNegativeTest-1163094605-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:22.956633 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fd910ced-79cf-498e-bb94-832f4558da33 tempest-QuotasAdminNegativeTest-1163094605 tempest-QuotasAdminNegativeTest-1163094605-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:22.957245 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fd910ced-79cf-498e-bb94-832f4558da33 tempest-QuotasAdminNegativeTest-1163094605 tempest-QuotasAdminNegativeTest-1163094605-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:23.029100 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-5e8cefd9-ed0a-4cf9-a90a-958df7a25fb4 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a24944aeb34a5ea228965be9bf4ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c288268acb30475bbc065a8f72cb21d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:23.039413 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5e8cefd9-ed0a-4cf9-a90a-958df7a25fb4 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] 10.222.0.33 "GET /compute/v2.1/servers/9f8cc082-0a37-4123-a680-1210a90b3ca9" status: 200 len: 1471 microversion: 2.1 time: 0.614202 Oct 04 20:36:23.050875 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 370/738] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:36:22 2022] GET /compute/v2.1/servers/9f8cc082-0a37-4123-a680-1210a90b3ca9 => generated 1471 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:36:23.065199 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-fae821a5-ec1f-4f4e-abf8-02ac999f185f tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:23.074938 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-fae821a5-ec1f-4f4e-abf8-02ac999f185f tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] [instance: 8fdcb1b0-65e9-45d1-b0da-5f603f22a8cf] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:23.100104 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fae821a5-ec1f-4f4e-abf8-02ac999f185f tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:23.102333 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fae821a5-ec1f-4f4e-abf8-02ac999f185f tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:23.110315 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fae821a5-ec1f-4f4e-abf8-02ac999f185f tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:23.122715 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fae821a5-ec1f-4f4e-abf8-02ac999f185f tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:23.124119 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fae821a5-ec1f-4f4e-abf8-02ac999f185f tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:23.127676 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fae821a5-ec1f-4f4e-abf8-02ac999f185f tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:23.167065 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-fae821a5-ec1f-4f4e-abf8-02ac999f185f tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] HTTP exception thrown: Instance 8fdcb1b0-65e9-45d1-b0da-5f603f22a8cf could not be found. Oct 04 20:36:23.168613 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-fae821a5-ec1f-4f4e-abf8-02ac999f185f tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Request method failure captured: Oct 04 20:36:23.168613 n-d-854823-8 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/8fdcb1b0-65e9-45d1-b0da-5f603f22a8cf HTTP/1.1 Oct 04 20:36:23.168613 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:36:23.168613 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:36:23.168613 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:36:23.168613 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 0 Oct 04 20:36:23.168613 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:36:23.168613 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:36:23.168613 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:36:23.168613 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:36:23.168613 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJiej3ZBP1oDsKzH6_pJmapps3lj_Plf6PjDgq4lqlOYZsDLHcADh93YHT5umqV8BQXmRb6AjKFJTjJrD2bCwzpsOzPYwHVOCW1l6YVMP_9BGql22JvSoxUbB3g1p7kraQwhtw0_BXlK88o-mWpjMuocTlAJF6nDb9rqPLkN6PkQKbY Oct 04 20:36:23.168613 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:36:23.168613 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:36:23.168613 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:36:23.168613 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:36:23.168613 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:36:23.168613 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:36:23.168613 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: 8f28e80977de42a892b84295ecf05141 Oct 04 20:36:23.168613 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1458163774 Oct 04 20:36:23.168613 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 20:36:23.168613 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 20:36:23.170191 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_8f28e80977de42a892b84295ecf05141", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8f28e80977de42a892b84295ecf05141"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8f28e80977de42a892b84295ecf05141"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/8f28e80977de42a892b84295ecf05141"}]}] Oct 04 20:36:23.170191 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1458163774 Oct 04 20:36:23.170191 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: 8f28e80977de42a892b84295ecf05141 Oct 04 20:36:23.170191 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1458163774 Oct 04 20:36:23.170191 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1458163774-project Oct 04 20:36:23.170191 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:36:23.170191 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:36:23.170191 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: f5eda279f6034608b192839a54dda616 Oct 04 20:36:23.170191 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1458163774-project Oct 04 20:36:23.170191 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 20:36:23.170191 n-d-854823-8 devstack@n-api.service[128801]: exception: Instance 8fdcb1b0-65e9-45d1-b0da-5f603f22a8cf could not be found. Oct 04 20:36:23.170191 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': '8fdcb1b0-65e9-45d1-b0da-5f603f22a8cf'} Oct 04 20:36:23.171244 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:36:23.171244 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:36:23.171244 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:36:23.171244 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:36:23.171244 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:36:23.171244 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:36:23.171244 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:36:23.171244 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:36:23.171244 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:36:23.171244 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:36:23.171244 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8fdcb1b0-65e9-45d1-b0da-5f603f22a8cf could not be found. Oct 04 20:36:23.171244 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:36:23.171244 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:36:23.171244 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:36:23.171244 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:36:23.171244 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:36:23.171244 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:36:23.171244 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:36:23.171244 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:36:23.171244 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:36:23.172566 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:36:23.172566 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:36:23.172566 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:36:23.172566 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:36:23.172566 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:36:23.172566 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:36:23.172566 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:36:23.172566 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8fdcb1b0-65e9-45d1-b0da-5f603f22a8cf could not be found. Oct 04 20:36:23.172566 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:36:23.172566 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:36:23.172566 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:36:23.172566 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:36:23.172566 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:36:23.172566 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:36:23.172566 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:36:23.172566 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:36:23.172566 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8fdcb1b0-65e9-45d1-b0da-5f603f22a8cf could not be found. Oct 04 20:36:23.172566 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:36:23.173750 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-fae821a5-ec1f-4f4e-abf8-02ac999f185f tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] Returning 404 to user: Instance 8fdcb1b0-65e9-45d1-b0da-5f603f22a8cf could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:36:23.173750 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-fae821a5-ec1f-4f4e-abf8-02ac999f185f tempest-ServersWithSpecificFlavorTestJSON-1458163774 tempest-ServersWithSpecificFlavorTestJSON-1458163774-project] 10.222.0.33 "GET /compute/v2.1/servers/8fdcb1b0-65e9-45d1-b0da-5f603f22a8cf" status: 404 len: 111 microversion: 2.1 time: 0.117669 Oct 04 20:36:23.175868 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-fd910ced-79cf-498e-bb94-832f4558da33 tempest-QuotasAdminNegativeTest-1163094605 tempest-QuotasAdminNegativeTest-1163094605-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-quota-sets/163e70dcd32d419f92b286d655c05e5c" status: 200 len: 329 microversion: 2.1 time: 0.416900 Oct 04 20:36:23.176606 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 369/739] 10.222.0.33 () {60 vars in 1262 bytes} [Tue Oct 4 20:36:22 2022] PUT /compute/v2.1/os-quota-sets/163e70dcd32d419f92b286d655c05e5c => generated 329 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:36:23.187084 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 371/740] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:36:23 2022] GET /compute/v2.1/servers/8fdcb1b0-65e9-45d1-b0da-5f603f22a8cf => generated 111 bytes in 135 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:36:23.192314 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a6a5f5e4-43fe-42f7-af54-4a0a87c6f9ce tempest-QuotasAdminNegativeTest-1163094605 tempest-QuotasAdminNegativeTest-1163094605-project-admin] Calling method '.version_select at 0x7f3c74de1670>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:23.192655 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-3a418efd-d0ee-4bce-8e19-d346006be138 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:23.193553 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-3a418efd-d0ee-4bce-8e19-d346006be138 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] [instance: c7f3bb5b-e08b-4a3f-ba4d-40012179412e] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:23.213938 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3a418efd-d0ee-4bce-8e19-d346006be138 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:23.216621 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3a418efd-d0ee-4bce-8e19-d346006be138 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:23.217912 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3a418efd-d0ee-4bce-8e19-d346006be138 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:23.221528 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3a418efd-d0ee-4bce-8e19-d346006be138 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:23.222074 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3a418efd-d0ee-4bce-8e19-d346006be138 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:23.222608 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3a418efd-d0ee-4bce-8e19-d346006be138 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:23.303508 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a6a5f5e4-43fe-42f7-af54-4a0a87c6f9ce tempest-QuotasAdminNegativeTest-1163094605 tempest-QuotasAdminNegativeTest-1163094605-project-admin] 10.222.0.33 "GET /compute/v2.1/os-quota-sets/163e70dcd32d419f92b286d655c05e5c" status: 200 len: 371 microversion: 2.1 time: 0.114871 Oct 04 20:36:23.305306 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 372/741] 10.222.0.33 () {58 vars in 1242 bytes} [Tue Oct 4 20:36:23 2022] GET /compute/v2.1/os-quota-sets/163e70dcd32d419f92b286d655c05e5c => generated 371 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:36:23.317652 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-184b2cc6-0680-4b6d-bf4e-6fc8f3360e5b tempest-QuotasAdminNegativeTest-1163094605 tempest-QuotasAdminNegativeTest-1163094605-project-admin] Action: 'update', calling method: .version_select at 0x7f3c74efae50>, body: {"quota_set": {"force": true, "ram": 0}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:36:23.419876 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-184b2cc6-0680-4b6d-bf4e-6fc8f3360e5b tempest-QuotasAdminNegativeTest-1163094605 tempest-QuotasAdminNegativeTest-1163094605-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:23.420560 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-184b2cc6-0680-4b6d-bf4e-6fc8f3360e5b tempest-QuotasAdminNegativeTest-1163094605 tempest-QuotasAdminNegativeTest-1163094605-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:23.421160 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-184b2cc6-0680-4b6d-bf4e-6fc8f3360e5b tempest-QuotasAdminNegativeTest-1163094605 tempest-QuotasAdminNegativeTest-1163094605-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:23.422042 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-184b2cc6-0680-4b6d-bf4e-6fc8f3360e5b tempest-QuotasAdminNegativeTest-1163094605 tempest-QuotasAdminNegativeTest-1163094605-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:23.422680 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-184b2cc6-0680-4b6d-bf4e-6fc8f3360e5b tempest-QuotasAdminNegativeTest-1163094605 tempest-QuotasAdminNegativeTest-1163094605-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:23.423368 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-184b2cc6-0680-4b6d-bf4e-6fc8f3360e5b tempest-QuotasAdminNegativeTest-1163094605 tempest-QuotasAdminNegativeTest-1163094605-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:23.538197 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-184b2cc6-0680-4b6d-bf4e-6fc8f3360e5b tempest-QuotasAdminNegativeTest-1163094605 tempest-QuotasAdminNegativeTest-1163094605-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-quota-sets/163e70dcd32d419f92b286d655c05e5c" status: 200 len: 325 microversion: 2.1 time: 0.223588 Oct 04 20:36:23.539764 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 373/742] 10.222.0.33 () {60 vars in 1262 bytes} [Tue Oct 4 20:36:23 2022] PUT /compute/v2.1/os-quota-sets/163e70dcd32d419f92b286d655c05e5c => generated 325 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 20:36:23.626212 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a0cd9fba-83c6-4152-a224-29b260afbb99 tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:23.626212 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a0cd9fba-83c6-4152-a224-29b260afbb99 tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] [instance: c61a781e-96f8-4bf6-8d3d-b8c3e9c58808] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:23.638135 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a0cd9fba-83c6-4152-a224-29b260afbb99 tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:23.638653 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a0cd9fba-83c6-4152-a224-29b260afbb99 tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:23.639094 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a0cd9fba-83c6-4152-a224-29b260afbb99 tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:23.639801 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a0cd9fba-83c6-4152-a224-29b260afbb99 tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:23.640255 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a0cd9fba-83c6-4152-a224-29b260afbb99 tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:23.640715 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a0cd9fba-83c6-4152-a224-29b260afbb99 tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:23.775583 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-3a418efd-d0ee-4bce-8e19-d346006be138 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3563efe2b8c94931a2a46c4e14811b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3118a5d96843d3bede1ed94bd9717e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:23.801226 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-3a418efd-d0ee-4bce-8e19-d346006be138 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] 10.222.0.33 "GET /compute/v2.1/servers/c7f3bb5b-e08b-4a3f-ba4d-40012179412e" status: 200 len: 1470 microversion: 2.1 time: 0.623472 Oct 04 20:36:23.802079 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 370/743] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:36:23 2022] GET /compute/v2.1/servers/c7f3bb5b-e08b-4a3f-ba4d-40012179412e => generated 1470 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:36:23.812071 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-6a41fa46-c8e5-4692-ae5f-117193b99828 tempest-QuotasAdminNegativeTest-591593273 tempest-QuotasAdminNegativeTest-591593273-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-626095437", "imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63", "flavorRef": "452"}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:36:23.884537 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-a0cd9fba-83c6-4152-a224-29b260afbb99 tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70b2a3b8a3d34ecdaab68b7f18f7788e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d53510a3a5543618f6b701827e7c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:23.897531 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a0cd9fba-83c6-4152-a224-29b260afbb99 tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] 10.222.0.33 "GET /compute/v2.1/servers/c61a781e-96f8-4bf6-8d3d-b8c3e9c58808" status: 200 len: 1273 microversion: 2.1 time: 0.279032 Oct 04 20:36:23.900095 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.network.neutron [None req-6a41fa46-c8e5-4692-ae5f-117193b99828 tempest-QuotasAdminNegativeTest-591593273 tempest-QuotasAdminNegativeTest-591593273-project] validate_networks() for None {{(pid=128802) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:36:23.900873 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 374/744] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:36:23 2022] GET /compute/v2.1/servers/c61a781e-96f8-4bf6-8d3d-b8c3e9c58808 => generated 1273 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:36:24.095065 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-07be8a02-322c-4e22-be41-e971ed75e31e tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Action: 'create', calling method: .version_select at 0x7f3c74c39e50>, body: {"keypair": {"name": "tempest-keypair-1107808858", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBzb0rtFCv/dHmlfYaF0fjII87P5O7Uq4uk54l4l57nzBeVbeqfS3ZF2vHMjep80aJiScl0U6+98wlChvOsz3OPkhk7IysfyWDjF4XHQEfO82iBSTHtc9hKaD/ApzVJ1xg=="}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:36:24.120474 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-07be8a02-322c-4e22-be41-e971ed75e31e tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Getting quotas for project e8cc219b86ed450cbe7c780d7f79d9f8. Resources: {'key_pairs'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:36:24.129645 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-07be8a02-322c-4e22-be41-e971ed75e31e tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Getting quotas for user b786966441fc45f28890bf56cdfafb3f and project e8cc219b86ed450cbe7c780d7f79d9f8. Resources: {'key_pairs'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:36:24.174401 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-07be8a02-322c-4e22-be41-e971ed75e31e tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.272352 Oct 04 20:36:24.176215 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 375/745] 10.222.0.33 () {60 vars in 1159 bytes} [Tue Oct 4 20:36:23 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:36:24.183311 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1e235414-951e-4525-a320-1177eb6d82d9 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:36:24.184231 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-1e235414-951e-4525-a320-1177eb6d82d9 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] [instance: c7f3bb5b-e08b-4a3f-ba4d-40012179412e] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:24.195439 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1e235414-951e-4525-a320-1177eb6d82d9 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:24.196497 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1e235414-951e-4525-a320-1177eb6d82d9 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:24.197177 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1e235414-951e-4525-a320-1177eb6d82d9 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:24.198105 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1e235414-951e-4525-a320-1177eb6d82d9 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:24.198930 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1e235414-951e-4525-a320-1177eb6d82d9 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:24.200282 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1e235414-951e-4525-a320-1177eb6d82d9 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:24.297505 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-1e235414-951e-4525-a320-1177eb6d82d9 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] 10.222.0.33 "POST /compute/v2.1/servers/c7f3bb5b-e08b-4a3f-ba4d-40012179412e/action" status: 204 len: 0 microversion: 2.1 time: 0.119665 Oct 04 20:36:24.298666 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 376/746] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 20:36:24 2022] POST /compute/v2.1/servers/c7f3bb5b-e08b-4a3f-ba4d-40012179412e/action => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:36:24.304856 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-6a41fa46-c8e5-4692-ae5f-117193b99828 tempest-QuotasAdminNegativeTest-591593273 tempest-QuotasAdminNegativeTest-591593273-project] Flavor limits 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:36:24.305362 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-6a41fa46-c8e5-4692-ae5f-117193b99828 tempest-QuotasAdminNegativeTest-591593273 tempest-QuotasAdminNegativeTest-591593273-project] Image limits 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:36:24.305442 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e0e724d6-7c68-4015-898b-3205550b7db5 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:24.305803 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-6a41fa46-c8e5-4692-ae5f-117193b99828 tempest-QuotasAdminNegativeTest-591593273 tempest-QuotasAdminNegativeTest-591593273-project] Flavor pref 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:36:24.306132 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-6a41fa46-c8e5-4692-ae5f-117193b99828 tempest-QuotasAdminNegativeTest-591593273 tempest-QuotasAdminNegativeTest-591593273-project] Image pref 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:36:24.306306 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e0e724d6-7c68-4015-898b-3205550b7db5 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] [instance: 9f8cc082-0a37-4123-a680-1210a90b3ca9] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:24.307048 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-6a41fa46-c8e5-4692-ae5f-117193b99828 tempest-QuotasAdminNegativeTest-591593273 tempest-QuotasAdminNegativeTest-591593273-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:36:24.313390 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e0e724d6-7c68-4015-898b-3205550b7db5 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:24.314137 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e0e724d6-7c68-4015-898b-3205550b7db5 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:24.314560 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e0e724d6-7c68-4015-898b-3205550b7db5 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:24.315469 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e0e724d6-7c68-4015-898b-3205550b7db5 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:24.315960 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e0e724d6-7c68-4015-898b-3205550b7db5 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:24.316571 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e0e724d6-7c68-4015-898b-3205550b7db5 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:24.328026 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6a41fa46-c8e5-4692-ae5f-117193b99828 tempest-QuotasAdminNegativeTest-591593273 tempest-QuotasAdminNegativeTest-591593273-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:24.328940 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6a41fa46-c8e5-4692-ae5f-117193b99828 tempest-QuotasAdminNegativeTest-591593273 tempest-QuotasAdminNegativeTest-591593273-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:24.329667 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6a41fa46-c8e5-4692-ae5f-117193b99828 tempest-QuotasAdminNegativeTest-591593273 tempest-QuotasAdminNegativeTest-591593273-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:24.330692 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6a41fa46-c8e5-4692-ae5f-117193b99828 tempest-QuotasAdminNegativeTest-591593273 tempest-QuotasAdminNegativeTest-591593273-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:24.331389 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6a41fa46-c8e5-4692-ae5f-117193b99828 tempest-QuotasAdminNegativeTest-591593273 tempest-QuotasAdminNegativeTest-591593273-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:24.332052 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6a41fa46-c8e5-4692-ae5f-117193b99828 tempest-QuotasAdminNegativeTest-591593273 tempest-QuotasAdminNegativeTest-591593273-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:24.378819 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-6a41fa46-c8e5-4692-ae5f-117193b99828 tempest-QuotasAdminNegativeTest-591593273 tempest-QuotasAdminNegativeTest-591593273-project] Getting quotas for project 163e70dcd32d419f92b286d655c05e5c. Resources: {'ram', 'instances', 'cores'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:36:24.387663 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-6a41fa46-c8e5-4692-ae5f-117193b99828 tempest-QuotasAdminNegativeTest-591593273 tempest-QuotasAdminNegativeTest-591593273-project] Getting quotas for user b6859154163c46f096b887af763ce881 and project 163e70dcd32d419f92b286d655c05e5c. Resources: {'ram', 'instances', 'cores'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:36:24.415710 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.utils [None req-6a41fa46-c8e5-4692-ae5f-117193b99828 tempest-QuotasAdminNegativeTest-591593273 tempest-QuotasAdminNegativeTest-591593273-project] ram quota exceeded for 163e70dcd32d419f92b286d655c05e5c, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=128802) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Oct 04 20:36:24.416550 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.wsgi [None req-6a41fa46-c8e5-4692-ae5f-117193b99828 tempest-QuotasAdminNegativeTest-591593273 tempest-QuotasAdminNegativeTest-591593273-project] HTTP exception thrown: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 04 20:36:24.419424 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-6a41fa46-c8e5-4692-ae5f-117193b99828 tempest-QuotasAdminNegativeTest-591593273 tempest-QuotasAdminNegativeTest-591593273-project] Request method failure captured: Oct 04 20:36:24.419424 n-d-854823-8 devstack@n-api.service[128802]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 20:36:24.419424 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 20:36:24.419424 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 20:36:24.419424 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 20:36:24.419424 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 144 Oct 04 20:36:24.419424 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 20:36:24.419424 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 20:36:24.419424 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 20:36:24.419424 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 20:36:24.419424 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPJk5-DAYMeIl_LC9dgm4-AvwNoII_biFacWGoEohUsWH0xkWQ5Mz16ptn2MgAV4aAoG5VghkSBtqDHM4BD-9aclXnRyXjkqV5Xh76IrszLEb5eOgvE4XlmgtJHEPS8XgiL1MJbI36psg63v3ttjHw5Gg67cn1Y0IkKYzlp_iDMWk1ls Oct 04 20:36:24.419424 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 20:36:24.419424 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 20:36:24.419424 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 20:36:24.419424 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 20:36:24.419424 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 20:36:24.419424 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 20:36:24.419424 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: 163e70dcd32d419f92b286d655c05e5c Oct 04 20:36:24.419424 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-QuotasAdminNegativeTest-591593273 Oct 04 20:36:24.419424 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 20:36:24.419424 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 20:36:24.420676 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_163e70dcd32d419f92b286d655c05e5c", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/163e70dcd32d419f92b286d655c05e5c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/163e70dcd32d419f92b286d655c05e5c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/163e70dcd32d419f92b286d655c05e5c"}]}] Oct 04 20:36:24.420676 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-QuotasAdminNegativeTest-591593273 Oct 04 20:36:24.420676 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: 163e70dcd32d419f92b286d655c05e5c Oct 04 20:36:24.420676 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-591593273 Oct 04 20:36:24.420676 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-QuotasAdminNegativeTest-591593273-project Oct 04 20:36:24.420676 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 20:36:24.420676 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 20:36:24.420676 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: b6859154163c46f096b887af763ce881 Oct 04 20:36:24.420676 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-QuotasAdminNegativeTest-591593273-project Oct 04 20:36:24.420676 n-d-854823-8 devstack@n-api.service[128802]: Oct 04 20:36:24.420676 n-d-854823-8 devstack@n-api.service[128802]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-626095437", "imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63", "flavorRef": "452"}} Oct 04 20:36:24.420676 n-d-854823-8 devstack@n-api.service[128802]: method: > Oct 04 20:36:24.421376 n-d-854823-8 devstack@n-api.service[128802]: exception: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 04 20:36:24.421376 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-626095437', 'imageRef': '15b24725-0c99-4bcf-b1fb-907cdf8e2d63', 'flavorRef': '452'}}} Oct 04 20:36:24.421376 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:36:24.421376 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:36:24.421376 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Oct 04 20:36:24.421376 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Oct 04 20:36:24.421376 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 20:36:24.421376 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 20:36:24.421376 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 04 20:36:24.421376 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exc Oct 04 20:36:24.421376 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 04 20:36:24.421376 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 04 20:36:24.421376 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 20:36:24.421376 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 20:36:24.421376 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 04 20:36:24.421376 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 04 20:36:24.421376 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 04 20:36:24.421376 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 04 20:36:24.423189 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Oct 04 20:36:24.423189 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 04 20:36:24.423189 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Oct 04 20:36:24.423189 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:36:24.423189 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:36:24.423189 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:36:24.423189 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:36:24.423189 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 20:36:24.423189 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 20:36:24.423189 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 20:36:24.423189 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 20:36:24.423189 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Oct 04 20:36:24.423189 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Oct 04 20:36:24.423189 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Oct 04 20:36:24.423189 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Oct 04 20:36:24.423189 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Oct 04 20:36:24.423189 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 04 20:36:24.423189 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 04 20:36:24.423189 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:36:24.423189 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:36:24.423189 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:36:24.424372 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:36:24.424372 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:36:24.424372 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:36:24.424372 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:36:24.424372 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:36:24.424372 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:36:24.424372 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:36:24.424372 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:36:24.424372 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:36:24.424372 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:36:24.424372 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:36:24.424372 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:36:24.424372 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:36:24.424372 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 20:36:24.424372 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 04 20:36:24.424372 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 04 20:36:24.424372 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 04 20:36:24.424372 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:36:24.424372 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:36:24.424372 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:36:24.424372 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:36:24.427532 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:36:24.427532 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:36:24.427532 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:36:24.427532 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:36:24.427532 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 04 20:36:24.427532 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:36:24.427532 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-6a41fa46-c8e5-4692-ae5f-117193b99828 tempest-QuotasAdminNegativeTest-591593273 tempest-QuotasAdminNegativeTest-591593273-project] Returning 403 to user: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:36:24.427532 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-6a41fa46-c8e5-4692-ae5f-117193b99828 tempest-QuotasAdminNegativeTest-591593273 tempest-QuotasAdminNegativeTest-591593273-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 403 len: 110 microversion: 2.1 time: 0.617845 Oct 04 20:36:24.427532 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 371/747] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 20:36:23 2022] POST /compute/v2.1/servers => generated 110 bytes in 625 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:36:24.437899 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-d3b93adf-1c5f-495b-9812-1ffc0be52d50 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:24.438569 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-d3b93adf-1c5f-495b-9812-1ffc0be52d50 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] [instance: c7f3bb5b-e08b-4a3f-ba4d-40012179412e] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:24.446467 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d3b93adf-1c5f-495b-9812-1ffc0be52d50 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:24.447007 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d3b93adf-1c5f-495b-9812-1ffc0be52d50 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:24.448084 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d3b93adf-1c5f-495b-9812-1ffc0be52d50 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:24.448801 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d3b93adf-1c5f-495b-9812-1ffc0be52d50 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:24.449646 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d3b93adf-1c5f-495b-9812-1ffc0be52d50 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:24.450081 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d3b93adf-1c5f-495b-9812-1ffc0be52d50 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:24.709497 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e0e724d6-7c68-4015-898b-3205550b7db5 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a24944aeb34a5ea228965be9bf4ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c288268acb30475bbc065a8f72cb21d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:24.721768 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e0e724d6-7c68-4015-898b-3205550b7db5 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] 10.222.0.33 "GET /compute/v2.1/servers/9f8cc082-0a37-4123-a680-1210a90b3ca9" status: 200 len: 1471 microversion: 2.1 time: 0.421465 Oct 04 20:36:24.723735 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 377/748] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:36:24 2022] GET /compute/v2.1/servers/9f8cc082-0a37-4123-a680-1210a90b3ca9 => generated 1471 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:36:24.728484 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8015861a-ddb1-4df6-b96c-701349adbb57 tempest-QuotasAdminNegativeTest-1163094605 tempest-QuotasAdminNegativeTest-1163094605-project-admin] Action: 'update', calling method: .version_select at 0x7f3c757121f0>, body: {"quota_set": {"ram": 51200}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:36:24.810084 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-d3b93adf-1c5f-495b-9812-1ffc0be52d50 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3563efe2b8c94931a2a46c4e14811b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3118a5d96843d3bede1ed94bd9717e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:24.829287 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-d3b93adf-1c5f-495b-9812-1ffc0be52d50 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] 10.222.0.33 "GET /compute/v2.1/servers/c7f3bb5b-e08b-4a3f-ba4d-40012179412e" status: 200 len: 1470 microversion: 2.1 time: 0.399086 Oct 04 20:36:24.830192 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 372/749] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:36:24 2022] GET /compute/v2.1/servers/c7f3bb5b-e08b-4a3f-ba4d-40012179412e => generated 1470 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:36:24.848130 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8015861a-ddb1-4df6-b96c-701349adbb57 tempest-QuotasAdminNegativeTest-1163094605 tempest-QuotasAdminNegativeTest-1163094605-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:24.849051 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8015861a-ddb1-4df6-b96c-701349adbb57 tempest-QuotasAdminNegativeTest-1163094605 tempest-QuotasAdminNegativeTest-1163094605-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:24.849696 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8015861a-ddb1-4df6-b96c-701349adbb57 tempest-QuotasAdminNegativeTest-1163094605 tempest-QuotasAdminNegativeTest-1163094605-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:24.851897 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8015861a-ddb1-4df6-b96c-701349adbb57 tempest-QuotasAdminNegativeTest-1163094605 tempest-QuotasAdminNegativeTest-1163094605-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:24.857257 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8015861a-ddb1-4df6-b96c-701349adbb57 tempest-QuotasAdminNegativeTest-1163094605 tempest-QuotasAdminNegativeTest-1163094605-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:24.858751 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8015861a-ddb1-4df6-b96c-701349adbb57 tempest-QuotasAdminNegativeTest-1163094605 tempest-QuotasAdminNegativeTest-1163094605-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:24.921090 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-228f5498-5ddb-4ad3-99a0-6829fc1399e0 tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:24.921711 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-228f5498-5ddb-4ad3-99a0-6829fc1399e0 tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] [instance: c61a781e-96f8-4bf6-8d3d-b8c3e9c58808] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:24.939399 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-228f5498-5ddb-4ad3-99a0-6829fc1399e0 tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:24.941684 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-228f5498-5ddb-4ad3-99a0-6829fc1399e0 tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:24.942706 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-228f5498-5ddb-4ad3-99a0-6829fc1399e0 tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:24.944682 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-228f5498-5ddb-4ad3-99a0-6829fc1399e0 tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:24.946159 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-228f5498-5ddb-4ad3-99a0-6829fc1399e0 tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:24.949665 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-228f5498-5ddb-4ad3-99a0-6829fc1399e0 tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:25.001365 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=7,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:36:25.024327 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-8015861a-ddb1-4df6-b96c-701349adbb57 tempest-QuotasAdminNegativeTest-1163094605 tempest-QuotasAdminNegativeTest-1163094605-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-quota-sets/163e70dcd32d419f92b286d655c05e5c" status: 200 len: 329 microversion: 2.1 time: 0.299173 Oct 04 20:36:25.025276 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 378/750] 10.222.0.33 () {60 vars in 1262 bytes} [Tue Oct 4 20:36:24 2022] PUT /compute/v2.1/os-quota-sets/163e70dcd32d419f92b286d655c05e5c => generated 329 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:36:25.038697 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e4f9572d-83a4-40b8-bea8-288ea8e1319c tempest-QuotasAdminNegativeTest-591593273 tempest-QuotasAdminNegativeTest-591593273-project] Action: 'update', calling method: .version_select at 0x7f3c749fb5e0>, body: {"quota_set": {"ram": 0}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:36:25.060423 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e4f9572d-83a4-40b8-bea8-288ea8e1319c tempest-QuotasAdminNegativeTest-591593273 tempest-QuotasAdminNegativeTest-591593273-project] Policy check for os_compute_api:os-quota-sets:update failed with credentials {'is_admin': False, 'user_id': 'b6859154163c46f096b887af763ce881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163e70dcd32d419f92b286d655c05e5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:25.067574 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e4f9572d-83a4-40b8-bea8-288ea8e1319c tempest-QuotasAdminNegativeTest-591593273 tempest-QuotasAdminNegativeTest-591593273-project] Request method failure captured: Oct 04 20:36:25.067574 n-d-854823-8 devstack@n-api.service[128801]: request: PUT /compute/v2.1/os-quota-sets/163e70dcd32d419f92b286d655c05e5c HTTP/1.1 Oct 04 20:36:25.067574 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:36:25.067574 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:36:25.067574 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:36:25.067574 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 25 Oct 04 20:36:25.067574 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:36:25.067574 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:36:25.067574 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:36:25.067574 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:36:25.067574 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJk5-DAYMeIl_LC9dgm4-AvwNoII_biFacWGoEohUsWH0xkWQ5Mz16ptn2MgAV4aAoG5VghkSBtqDHM4BD-9aclXnRyXjkqV5Xh76IrszLEb5eOgvE4XlmgtJHEPS8XgiL1MJbI36psg63v3ttjHw5Gg67cn1Y0IkKYzlp_iDMWk1ls Oct 04 20:36:25.067574 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:36:25.067574 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:36:25.067574 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:36:25.067574 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:36:25.067574 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:36:25.067574 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:36:25.067574 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: 163e70dcd32d419f92b286d655c05e5c Oct 04 20:36:25.067574 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-QuotasAdminNegativeTest-591593273 Oct 04 20:36:25.067574 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 20:36:25.067574 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 20:36:25.069536 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_163e70dcd32d419f92b286d655c05e5c", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/163e70dcd32d419f92b286d655c05e5c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/163e70dcd32d419f92b286d655c05e5c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/163e70dcd32d419f92b286d655c05e5c"}]}] Oct 04 20:36:25.069536 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-QuotasAdminNegativeTest-591593273 Oct 04 20:36:25.069536 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: 163e70dcd32d419f92b286d655c05e5c Oct 04 20:36:25.069536 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-591593273 Oct 04 20:36:25.069536 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-QuotasAdminNegativeTest-591593273-project Oct 04 20:36:25.069536 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:36:25.069536 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:36:25.069536 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: b6859154163c46f096b887af763ce881 Oct 04 20:36:25.069536 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-QuotasAdminNegativeTest-591593273-project Oct 04 20:36:25.069536 n-d-854823-8 devstack@n-api.service[128801]: Oct 04 20:36:25.069536 n-d-854823-8 devstack@n-api.service[128801]: {"quota_set": {"ram": 0}} Oct 04 20:36:25.069536 n-d-854823-8 devstack@n-api.service[128801]: method: Oct 04 20:36:25.069536 n-d-854823-8 devstack@n-api.service[128801]: exception: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Oct 04 20:36:25.069536 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': '163e70dcd32d419f92b286d655c05e5c', 'body': {'quota_set': {'ram': 0}}} Oct 04 20:36:25.070334 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:36:25.070334 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:36:25.070334 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:36:25.070334 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:36:25.070334 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:36:25.070334 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:36:25.070334 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:36:25.070334 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:36:25.070334 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:36:25.070334 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:36:25.070334 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:36:25.070334 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:36:25.070334 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 170, in update Oct 04 20:36:25.070334 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self._update(req, id, body, []) Oct 04 20:36:25.070334 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 20:36:25.070334 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:36:25.070334 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 20:36:25.070334 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:36:25.070334 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 189, in _update Oct 04 20:36:25.071460 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi context.can(qs_policies.POLICY_ROOT % 'update', {'project_id': id}) Oct 04 20:36:25.071460 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 20:36:25.071460 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 20:36:25.071460 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 20:36:25.071460 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 20:36:25.071460 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 20:36:25.071460 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 20:36:25.071460 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 20:36:25.071460 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 20:36:25.071460 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 20:36:25.071460 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 20:36:25.071460 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 20:36:25.071460 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 20:36:25.071460 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 20:36:25.071460 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 20:36:25.071460 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Oct 04 20:36:25.071460 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:36:25.071460 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:36:25.071460 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:36:25.071460 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:36:25.072597 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:36:25.072597 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:36:25.072597 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 20:36:25.072597 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 20:36:25.072597 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Oct 04 20:36:25.072597 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:36:25.072597 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e4f9572d-83a4-40b8-bea8-288ea8e1319c tempest-QuotasAdminNegativeTest-591593273 tempest-QuotasAdminNegativeTest-591593273-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:36:25.074457 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e4f9572d-83a4-40b8-bea8-288ea8e1319c tempest-QuotasAdminNegativeTest-591593273 tempest-QuotasAdminNegativeTest-591593273-project] 10.222.0.33 "PUT /compute/v2.1/os-quota-sets/163e70dcd32d419f92b286d655c05e5c" status: 403 len: 116 microversion: 2.1 time: 0.036371 Oct 04 20:36:25.079246 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 379/751] 10.222.0.33 () {60 vars in 1262 bytes} [Tue Oct 4 20:36:25 2022] PUT /compute/v2.1/os-quota-sets/163e70dcd32d419f92b286d655c05e5c => generated 116 bytes in 45 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 04 20:36:25.133223 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-228f5498-5ddb-4ad3-99a0-6829fc1399e0 tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70b2a3b8a3d34ecdaab68b7f18f7788e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d53510a3a5543618f6b701827e7c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:25.148599 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-228f5498-5ddb-4ad3-99a0-6829fc1399e0 tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] 10.222.0.33 "GET /compute/v2.1/servers/c61a781e-96f8-4bf6-8d3d-b8c3e9c58808" status: 200 len: 1273 microversion: 2.1 time: 0.231307 Oct 04 20:36:25.151326 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 373/752] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:36:24 2022] GET /compute/v2.1/servers/c61a781e-96f8-4bf6-8d3d-b8c3e9c58808 => generated 1273 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:36:25.301340 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0b1d0b19-d2ad-49e5-8f0d-c6a92f5351d7 tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] Action: 'create', calling method: .version_select at 0x7f3c74f65670>, body: {"keypair": {"name": "tempest-keypair-921654706", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGgd1a8Aop+jUnDhN11G3DmrQ8f4gtwSeF7pInC2Uu4li0a1HBQiuXDed5WaZyKZBUakMpkQWEaPzqHHNGJVE4cyW9vlmJ8WZEFgWxbmOaz80KM2CJP3CIBoOzeZbn7wcw=="}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:36:25.323084 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-0b1d0b19-d2ad-49e5-8f0d-c6a92f5351d7 tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] Getting quotas for project 8659949e00dc429e8667767d0f126771. Resources: {'key_pairs'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:36:25.329108 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-0b1d0b19-d2ad-49e5-8f0d-c6a92f5351d7 tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] Getting quotas for user 8fa55ca3469648b0b1a2e1a29541c462 and project 8659949e00dc429e8667767d0f126771. Resources: {'key_pairs'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:36:25.373202 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-0b1d0b19-d2ad-49e5-8f0d-c6a92f5351d7 tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.173257 Oct 04 20:36:25.373886 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 380/753] 10.222.0.33 () {60 vars in 1159 bytes} [Tue Oct 4 20:36:25 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:36:25.489355 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-dfc44de7-56d9-49f4-b29d-5b769db83e05 req-30b15ce4-9a9a-4467-a34e-c20c3bf9c620 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7f3bb5b-e08b-4a3f-ba4d-40012179412e", "name": "network-vif-plugged", "status": "completed", "tag": "89b93aa0-8eeb-48c4-a6d4-93a449c21fea"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:36:25.500570 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-dfc44de7-56d9-49f4-b29d-5b769db83e05 req-30b15ce4-9a9a-4467-a34e-c20c3bf9c620 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:25.501408 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-dfc44de7-56d9-49f4-b29d-5b769db83e05 req-30b15ce4-9a9a-4467-a34e-c20c3bf9c620 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:25.502056 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-dfc44de7-56d9-49f4-b29d-5b769db83e05 req-30b15ce4-9a9a-4467-a34e-c20c3bf9c620 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:25.516488 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-dfc44de7-56d9-49f4-b29d-5b769db83e05 req-30b15ce4-9a9a-4467-a34e-c20c3bf9c620 service nova] Creating event network-vif-plugged:89b93aa0-8eeb-48c4-a6d4-93a449c21fea for instance c7f3bb5b-e08b-4a3f-ba4d-40012179412e on n-h2-854823-8 Oct 04 20:36:25.523949 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [req-dfc44de7-56d9-49f4-b29d-5b769db83e05 req-30b15ce4-9a9a-4467-a34e-c20c3bf9c620 service nova] Instance c7f3bb5b-e08b-4a3f-ba4d-40012179412e is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854823-8', 'n-h2-854823-8'} {{(pid=128802) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 20:36:25.539360 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-dfc44de7-56d9-49f4-b29d-5b769db83e05 req-30b15ce4-9a9a-4467-a34e-c20c3bf9c620 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053418 Oct 04 20:36:25.540662 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 374/754] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:36:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:36:25.745703 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f3d82115-1849-4c5e-a0b9-e3068f014378 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:25.746312 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f3d82115-1849-4c5e-a0b9-e3068f014378 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] [instance: 9f8cc082-0a37-4123-a680-1210a90b3ca9] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:25.753895 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f3d82115-1849-4c5e-a0b9-e3068f014378 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:25.754629 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f3d82115-1849-4c5e-a0b9-e3068f014378 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:25.755250 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f3d82115-1849-4c5e-a0b9-e3068f014378 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:25.756142 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f3d82115-1849-4c5e-a0b9-e3068f014378 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:25.756750 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f3d82115-1849-4c5e-a0b9-e3068f014378 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:25.757435 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f3d82115-1849-4c5e-a0b9-e3068f014378 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:25.862737 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-8cb9a38f-a417-446f-847a-c4196e5fcaa0 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:25.864313 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-8cb9a38f-a417-446f-847a-c4196e5fcaa0 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] [instance: c7f3bb5b-e08b-4a3f-ba4d-40012179412e] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:25.885065 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8cb9a38f-a417-446f-847a-c4196e5fcaa0 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:25.885884 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8cb9a38f-a417-446f-847a-c4196e5fcaa0 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:25.886366 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8cb9a38f-a417-446f-847a-c4196e5fcaa0 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:25.887230 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8cb9a38f-a417-446f-847a-c4196e5fcaa0 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:25.888357 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8cb9a38f-a417-446f-847a-c4196e5fcaa0 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:25.890895 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8cb9a38f-a417-446f-847a-c4196e5fcaa0 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:26.011425 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f3d82115-1849-4c5e-a0b9-e3068f014378 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a24944aeb34a5ea228965be9bf4ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c288268acb30475bbc065a8f72cb21d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:26.023737 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f3d82115-1849-4c5e-a0b9-e3068f014378 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] 10.222.0.33 "GET /compute/v2.1/servers/9f8cc082-0a37-4123-a680-1210a90b3ca9" status: 200 len: 1471 microversion: 2.1 time: 0.281665 Oct 04 20:36:26.029276 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 381/755] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:36:25 2022] GET /compute/v2.1/servers/9f8cc082-0a37-4123-a680-1210a90b3ca9 => generated 1471 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:36:26.177955 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d55dfd16-de3c-45ee-a82f-148e30042323 tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:26.178686 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d55dfd16-de3c-45ee-a82f-148e30042323 tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] [instance: c61a781e-96f8-4bf6-8d3d-b8c3e9c58808] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:26.187720 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d55dfd16-de3c-45ee-a82f-148e30042323 tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:26.195641 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d55dfd16-de3c-45ee-a82f-148e30042323 tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:26.196417 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d55dfd16-de3c-45ee-a82f-148e30042323 tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:26.197345 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d55dfd16-de3c-45ee-a82f-148e30042323 tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:26.197772 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d55dfd16-de3c-45ee-a82f-148e30042323 tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:26.198276 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d55dfd16-de3c-45ee-a82f-148e30042323 tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:26.269374 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-8cb9a38f-a417-446f-847a-c4196e5fcaa0 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3563efe2b8c94931a2a46c4e14811b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3118a5d96843d3bede1ed94bd9717e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:26.283868 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-8cb9a38f-a417-446f-847a-c4196e5fcaa0 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] 10.222.0.33 "GET /compute/v2.1/servers/c7f3bb5b-e08b-4a3f-ba4d-40012179412e" status: 200 len: 1470 microversion: 2.1 time: 0.428435 Oct 04 20:36:26.285352 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 375/756] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:36:25 2022] GET /compute/v2.1/servers/c7f3bb5b-e08b-4a3f-ba4d-40012179412e => generated 1470 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:36:26.539461 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d55dfd16-de3c-45ee-a82f-148e30042323 tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70b2a3b8a3d34ecdaab68b7f18f7788e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d53510a3a5543618f6b701827e7c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:26.550023 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:36:26.561199 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d55dfd16-de3c-45ee-a82f-148e30042323 tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] 10.222.0.33 "GET /compute/v2.1/servers/c61a781e-96f8-4bf6-8d3d-b8c3e9c58808" status: 200 len: 1315 microversion: 2.1 time: 0.387659 Oct 04 20:36:26.564795 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 382/757] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:36:26 2022] GET /compute/v2.1/servers/c61a781e-96f8-4bf6-8d3d-b8c3e9c58808 => generated 1315 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:36:27.048973 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-80f3a77b-c0d4-4016-83d9-96da494ccc6a tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:27.050472 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-80f3a77b-c0d4-4016-83d9-96da494ccc6a tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] [instance: 9f8cc082-0a37-4123-a680-1210a90b3ca9] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:27.060970 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-80f3a77b-c0d4-4016-83d9-96da494ccc6a tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:27.063491 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-80f3a77b-c0d4-4016-83d9-96da494ccc6a tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:27.066580 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-80f3a77b-c0d4-4016-83d9-96da494ccc6a tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:27.068846 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-80f3a77b-c0d4-4016-83d9-96da494ccc6a tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:27.069539 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-80f3a77b-c0d4-4016-83d9-96da494ccc6a tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:27.070520 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-80f3a77b-c0d4-4016-83d9-96da494ccc6a tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:27.316414 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-3a710855-e711-4a61-8452-01754f0d1131 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:27.322240 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-3a710855-e711-4a61-8452-01754f0d1131 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] [instance: c7f3bb5b-e08b-4a3f-ba4d-40012179412e] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:27.335857 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3a710855-e711-4a61-8452-01754f0d1131 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:27.353281 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3a710855-e711-4a61-8452-01754f0d1131 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:27.357594 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3a710855-e711-4a61-8452-01754f0d1131 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:27.359300 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3a710855-e711-4a61-8452-01754f0d1131 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:27.359796 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3a710855-e711-4a61-8452-01754f0d1131 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:27.365517 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3a710855-e711-4a61-8452-01754f0d1131 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:28.111697 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-80f3a77b-c0d4-4016-83d9-96da494ccc6a tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a24944aeb34a5ea228965be9bf4ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c288268acb30475bbc065a8f72cb21d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:28.121215 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-80f3a77b-c0d4-4016-83d9-96da494ccc6a tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] 10.222.0.33 "GET /compute/v2.1/servers/9f8cc082-0a37-4123-a680-1210a90b3ca9" status: 200 len: 1471 microversion: 2.1 time: 1.076297 Oct 04 20:36:28.130459 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 376/758] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:36:27 2022] GET /compute/v2.1/servers/9f8cc082-0a37-4123-a680-1210a90b3ca9 => generated 1471 bytes in 1086 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:36:28.174768 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-b4571aed-f0e9-4dd5-a56f-9d60d831b37a tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:28.175661 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-b4571aed-f0e9-4dd5-a56f-9d60d831b37a tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] [instance: c61a781e-96f8-4bf6-8d3d-b8c3e9c58808] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:28.184480 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b4571aed-f0e9-4dd5-a56f-9d60d831b37a tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:28.186000 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b4571aed-f0e9-4dd5-a56f-9d60d831b37a tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:28.186595 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b4571aed-f0e9-4dd5-a56f-9d60d831b37a tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:28.188103 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b4571aed-f0e9-4dd5-a56f-9d60d831b37a tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:28.188998 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b4571aed-f0e9-4dd5-a56f-9d60d831b37a tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:28.191126 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b4571aed-f0e9-4dd5-a56f-9d60d831b37a tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:28.628655 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-3a710855-e711-4a61-8452-01754f0d1131 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3563efe2b8c94931a2a46c4e14811b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3118a5d96843d3bede1ed94bd9717e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:28.638549 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-3a710855-e711-4a61-8452-01754f0d1131 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] 10.222.0.33 "GET /compute/v2.1/servers/c7f3bb5b-e08b-4a3f-ba4d-40012179412e" status: 200 len: 1470 microversion: 2.1 time: 1.331657 Oct 04 20:36:28.640791 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 383/759] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:36:27 2022] GET /compute/v2.1/servers/c7f3bb5b-e08b-4a3f-ba4d-40012179412e => generated 1470 bytes in 1335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:36:29.046733 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-b4571aed-f0e9-4dd5-a56f-9d60d831b37a tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70b2a3b8a3d34ecdaab68b7f18f7788e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d53510a3a5543618f6b701827e7c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:29.064477 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-b4571aed-f0e9-4dd5-a56f-9d60d831b37a tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] 10.222.0.33 "GET /compute/v2.1/servers/c61a781e-96f8-4bf6-8d3d-b8c3e9c58808" status: 200 len: 1315 microversion: 2.1 time: 0.920935 Oct 04 20:36:29.065271 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 377/760] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:36:28 2022] GET /compute/v2.1/servers/c61a781e-96f8-4bf6-8d3d-b8c3e9c58808 => generated 1315 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:36:29.155089 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0ba6916f-d26c-4753-8f6e-fca06cbd9f31 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:29.155909 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-0ba6916f-d26c-4753-8f6e-fca06cbd9f31 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] [instance: 9f8cc082-0a37-4123-a680-1210a90b3ca9] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:29.166732 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0ba6916f-d26c-4753-8f6e-fca06cbd9f31 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:29.168272 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0ba6916f-d26c-4753-8f6e-fca06cbd9f31 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:29.168908 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0ba6916f-d26c-4753-8f6e-fca06cbd9f31 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:29.170614 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0ba6916f-d26c-4753-8f6e-fca06cbd9f31 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:29.175271 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0ba6916f-d26c-4753-8f6e-fca06cbd9f31 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:29.175945 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0ba6916f-d26c-4753-8f6e-fca06cbd9f31 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:29.288416 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-bc05ab97-6c4c-428b-913d-d8abc2e32535 req-76f1c245-3089-4ba3-95be-5027651ea03c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c61a781e-96f8-4bf6-8d3d-b8c3e9c58808", "tag": "e4cddadd-318e-45b2-a470-85ddf6901196"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:36:29.316499 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-bc05ab97-6c4c-428b-913d-d8abc2e32535 req-76f1c245-3089-4ba3-95be-5027651ea03c service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:29.316985 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-bc05ab97-6c4c-428b-913d-d8abc2e32535 req-76f1c245-3089-4ba3-95be-5027651ea03c service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:29.317413 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-bc05ab97-6c4c-428b-913d-d8abc2e32535 req-76f1c245-3089-4ba3-95be-5027651ea03c service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:29.349493 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-bc05ab97-6c4c-428b-913d-d8abc2e32535 req-76f1c245-3089-4ba3-95be-5027651ea03c service nova] Creating event network-changed:e4cddadd-318e-45b2-a470-85ddf6901196 for instance c61a781e-96f8-4bf6-8d3d-b8c3e9c58808 on n-h1-854823-8 Oct 04 20:36:29.369488 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-bc05ab97-6c4c-428b-913d-d8abc2e32535 req-76f1c245-3089-4ba3-95be-5027651ea03c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087878 Oct 04 20:36:29.371086 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 378/761] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:36:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 20:36:29.668250 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-035e9507-3a7b-4eae-800b-a1f36c1210c8 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:29.669006 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-035e9507-3a7b-4eae-800b-a1f36c1210c8 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] [instance: c7f3bb5b-e08b-4a3f-ba4d-40012179412e] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:29.683448 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-035e9507-3a7b-4eae-800b-a1f36c1210c8 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:29.683943 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-035e9507-3a7b-4eae-800b-a1f36c1210c8 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:29.684376 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-035e9507-3a7b-4eae-800b-a1f36c1210c8 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:29.685204 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-035e9507-3a7b-4eae-800b-a1f36c1210c8 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:29.685678 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-035e9507-3a7b-4eae-800b-a1f36c1210c8 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:29.686105 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-035e9507-3a7b-4eae-800b-a1f36c1210c8 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:29.704754 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-0ba6916f-d26c-4753-8f6e-fca06cbd9f31 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a24944aeb34a5ea228965be9bf4ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c288268acb30475bbc065a8f72cb21d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:29.722029 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-0ba6916f-d26c-4753-8f6e-fca06cbd9f31 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] 10.222.0.33 "GET /compute/v2.1/servers/9f8cc082-0a37-4123-a680-1210a90b3ca9" status: 200 len: 1471 microversion: 2.1 time: 0.568285 Oct 04 20:36:29.732511 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 384/762] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:36:29 2022] GET /compute/v2.1/servers/9f8cc082-0a37-4123-a680-1210a90b3ca9 => generated 1471 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:36:30.089671 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-cc5c2484-ac02-4289-88b5-334ca6bad6e3 tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:30.090623 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-cc5c2484-ac02-4289-88b5-334ca6bad6e3 tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] [instance: c61a781e-96f8-4bf6-8d3d-b8c3e9c58808] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:30.103549 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cc5c2484-ac02-4289-88b5-334ca6bad6e3 tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:30.105262 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cc5c2484-ac02-4289-88b5-334ca6bad6e3 tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:30.106955 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cc5c2484-ac02-4289-88b5-334ca6bad6e3 tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:30.107742 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cc5c2484-ac02-4289-88b5-334ca6bad6e3 tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:30.109481 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cc5c2484-ac02-4289-88b5-334ca6bad6e3 tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:30.111211 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cc5c2484-ac02-4289-88b5-334ca6bad6e3 tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:30.466974 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-035e9507-3a7b-4eae-800b-a1f36c1210c8 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3563efe2b8c94931a2a46c4e14811b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3118a5d96843d3bede1ed94bd9717e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:30.488069 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-035e9507-3a7b-4eae-800b-a1f36c1210c8 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] 10.222.0.33 "GET /compute/v2.1/servers/c7f3bb5b-e08b-4a3f-ba4d-40012179412e" status: 200 len: 1462 microversion: 2.1 time: 0.823967 Oct 04 20:36:30.489055 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 379/763] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:36:29 2022] GET /compute/v2.1/servers/c7f3bb5b-e08b-4a3f-ba4d-40012179412e => generated 1462 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:36:30.517824 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-6501ed90-5dc7-4afb-8d81-226fb25cba02 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:30.518525 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-6501ed90-5dc7-4afb-8d81-226fb25cba02 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] [instance: c7f3bb5b-e08b-4a3f-ba4d-40012179412e] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:30.529797 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6501ed90-5dc7-4afb-8d81-226fb25cba02 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:30.530247 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6501ed90-5dc7-4afb-8d81-226fb25cba02 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:30.533705 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6501ed90-5dc7-4afb-8d81-226fb25cba02 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:30.534474 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6501ed90-5dc7-4afb-8d81-226fb25cba02 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:30.537545 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6501ed90-5dc7-4afb-8d81-226fb25cba02 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:30.539137 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6501ed90-5dc7-4afb-8d81-226fb25cba02 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:30.588203 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=100 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:36:30.786165 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-cc5c2484-ac02-4289-88b5-334ca6bad6e3 tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70b2a3b8a3d34ecdaab68b7f18f7788e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d53510a3a5543618f6b701827e7c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:30.797493 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-cc5c2484-ac02-4289-88b5-334ca6bad6e3 tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] 10.222.0.33 "GET /compute/v2.1/servers/c61a781e-96f8-4bf6-8d3d-b8c3e9c58808" status: 200 len: 1315 microversion: 2.1 time: 0.712969 Oct 04 20:36:30.798092 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 385/764] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:36:30 2022] GET /compute/v2.1/servers/c61a781e-96f8-4bf6-8d3d-b8c3e9c58808 => generated 1315 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:36:30.828455 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-3d89c341-51a4-4ce7-b212-dc41c8ed7efe tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:30.829076 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-3d89c341-51a4-4ce7-b212-dc41c8ed7efe tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] [instance: 9f8cc082-0a37-4123-a680-1210a90b3ca9] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:30.858553 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3d89c341-51a4-4ce7-b212-dc41c8ed7efe tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:30.860221 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3d89c341-51a4-4ce7-b212-dc41c8ed7efe tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:30.860682 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3d89c341-51a4-4ce7-b212-dc41c8ed7efe tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:30.867303 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3d89c341-51a4-4ce7-b212-dc41c8ed7efe tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:30.867771 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3d89c341-51a4-4ce7-b212-dc41c8ed7efe tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:30.868205 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3d89c341-51a4-4ce7-b212-dc41c8ed7efe tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:31.384410 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-6501ed90-5dc7-4afb-8d81-226fb25cba02 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3563efe2b8c94931a2a46c4e14811b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3118a5d96843d3bede1ed94bd9717e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:31.411203 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-6501ed90-5dc7-4afb-8d81-226fb25cba02 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] 10.222.0.33 "GET /compute/v2.1/servers/c7f3bb5b-e08b-4a3f-ba4d-40012179412e" status: 200 len: 1462 microversion: 2.1 time: 0.892116 Oct 04 20:36:31.425101 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 380/765] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:36:30 2022] GET /compute/v2.1/servers/c7f3bb5b-e08b-4a3f-ba4d-40012179412e => generated 1462 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:36:31.459756 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-da8ebe8c-4d9a-4e9a-aa3b-5aadeae62802 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Action: 'create', calling method: .version_select at 0x7f3c74805430>, body: {"keypair": {"name": "tempest-keypair-994478319", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNZrnjQvz3+jtZbZR+T+3KCHfc5DeCiqr60fUOp/aUwxxjUI9cwsXYkJWjxAmzb6k9twbvr0ru9AF1spRpzpdH2COniRq7sfTBAhOXDeOr/dg606CDYlb4phJk/q2wnHKA=="}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:36:31.479416 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell0:SELECT=43 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:36:31.487411 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-da8ebe8c-4d9a-4e9a-aa3b-5aadeae62802 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Getting quotas for project dd3118a5d96843d3bede1ed94bd9717e. Resources: {'key_pairs'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:36:31.497720 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-da8ebe8c-4d9a-4e9a-aa3b-5aadeae62802 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Getting quotas for user 3563efe2b8c94931a2a46c4e14811b3a and project dd3118a5d96843d3bede1ed94bd9717e. Resources: {'key_pairs'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:36:31.530894 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-3d89c341-51a4-4ce7-b212-dc41c8ed7efe tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a24944aeb34a5ea228965be9bf4ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c288268acb30475bbc065a8f72cb21d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:31.549866 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-3d89c341-51a4-4ce7-b212-dc41c8ed7efe tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] 10.222.0.33 "GET /compute/v2.1/servers/9f8cc082-0a37-4123-a680-1210a90b3ca9" status: 200 len: 1471 microversion: 2.1 time: 0.736195 Oct 04 20:36:31.554062 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 386/766] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:36:30 2022] GET /compute/v2.1/servers/9f8cc082-0a37-4123-a680-1210a90b3ca9 => generated 1471 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:36:31.560179 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-da8ebe8c-4d9a-4e9a-aa3b-5aadeae62802 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.104878 Oct 04 20:36:31.562109 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 381/767] 10.222.0.33 () {60 vars in 1159 bytes} [Tue Oct 4 20:36:31 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 20:36:31.825898 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ac5994d6-909b-4678-a698-c392136a3475 tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:31.826822 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ac5994d6-909b-4678-a698-c392136a3475 tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] [instance: c61a781e-96f8-4bf6-8d3d-b8c3e9c58808] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:31.838564 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ac5994d6-909b-4678-a698-c392136a3475 tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:31.838958 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ac5994d6-909b-4678-a698-c392136a3475 tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:31.839394 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ac5994d6-909b-4678-a698-c392136a3475 tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:31.840111 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ac5994d6-909b-4678-a698-c392136a3475 tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:31.840564 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ac5994d6-909b-4678-a698-c392136a3475 tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:31.840981 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ac5994d6-909b-4678-a698-c392136a3475 tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:32.216285 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-4e611aee-a046-482b-8d1c-1fb5bad96987 tempest-ServerDiagnosticsNegativeTest-417074328 tempest-ServerDiagnosticsNegativeTest-417074328-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiagnosticsNegativeTest-server-189716844", "imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63", "flavorRef": "452"}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:36:32.280931 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.network.neutron [None req-4e611aee-a046-482b-8d1c-1fb5bad96987 tempest-ServerDiagnosticsNegativeTest-417074328 tempest-ServerDiagnosticsNegativeTest-417074328-project] validate_networks() for None {{(pid=128802) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:36:32.879659 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-ac5994d6-909b-4678-a698-c392136a3475 tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70b2a3b8a3d34ecdaab68b7f18f7788e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d53510a3a5543618f6b701827e7c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:32.908321 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ac5994d6-909b-4678-a698-c392136a3475 tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] 10.222.0.33 "GET /compute/v2.1/servers/c61a781e-96f8-4bf6-8d3d-b8c3e9c58808" status: 200 len: 1315 microversion: 2.1 time: 1.084728 Oct 04 20:36:32.909984 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 387/768] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:36:31 2022] GET /compute/v2.1/servers/c61a781e-96f8-4bf6-8d3d-b8c3e9c58808 => generated 1315 bytes in 1089 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:36:32.929246 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8c89d203-8ac7-47ee-bb99-4906ffdfe614 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:32.930324 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-8c89d203-8ac7-47ee-bb99-4906ffdfe614 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] [instance: 9f8cc082-0a37-4123-a680-1210a90b3ca9] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:32.939401 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8c89d203-8ac7-47ee-bb99-4906ffdfe614 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:32.940451 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8c89d203-8ac7-47ee-bb99-4906ffdfe614 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:32.942756 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8c89d203-8ac7-47ee-bb99-4906ffdfe614 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:32.945479 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8c89d203-8ac7-47ee-bb99-4906ffdfe614 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:32.951179 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8c89d203-8ac7-47ee-bb99-4906ffdfe614 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:32.952303 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8c89d203-8ac7-47ee-bb99-4906ffdfe614 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:33.481305 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-8c89d203-8ac7-47ee-bb99-4906ffdfe614 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a24944aeb34a5ea228965be9bf4ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c288268acb30475bbc065a8f72cb21d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:33.489729 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-8c89d203-8ac7-47ee-bb99-4906ffdfe614 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] 10.222.0.33 "GET /compute/v2.1/servers/9f8cc082-0a37-4123-a680-1210a90b3ca9" status: 200 len: 1471 microversion: 2.1 time: 0.576940 Oct 04 20:36:33.490750 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 388/769] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:36:32 2022] GET /compute/v2.1/servers/9f8cc082-0a37-4123-a680-1210a90b3ca9 => generated 1471 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:36:33.519054 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-4e611aee-a046-482b-8d1c-1fb5bad96987 tempest-ServerDiagnosticsNegativeTest-417074328 tempest-ServerDiagnosticsNegativeTest-417074328-project] Flavor limits 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:36:33.519520 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-4e611aee-a046-482b-8d1c-1fb5bad96987 tempest-ServerDiagnosticsNegativeTest-417074328 tempest-ServerDiagnosticsNegativeTest-417074328-project] Image limits 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:36:33.520204 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-4e611aee-a046-482b-8d1c-1fb5bad96987 tempest-ServerDiagnosticsNegativeTest-417074328 tempest-ServerDiagnosticsNegativeTest-417074328-project] Flavor pref 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:36:33.520621 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-4e611aee-a046-482b-8d1c-1fb5bad96987 tempest-ServerDiagnosticsNegativeTest-417074328 tempest-ServerDiagnosticsNegativeTest-417074328-project] Image pref 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:36:33.521078 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-4e611aee-a046-482b-8d1c-1fb5bad96987 tempest-ServerDiagnosticsNegativeTest-417074328 tempest-ServerDiagnosticsNegativeTest-417074328-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:36:33.528496 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1c5d9470-1a2b-4212-811e-e56d51f61196 tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-399653648", "imageRef": "ba0b0a1b-e4e4-4ba0-9575-cd168ca3ffd5", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "0824aa89-f17e-45f9-b40a-58d4ba83f038"}], "security_groups": [{"name": "tempest-securitygroup--1954162347"}], "key_name": "tempest-keypair-1107808858", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:36:33.533905 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4e611aee-a046-482b-8d1c-1fb5bad96987 tempest-ServerDiagnosticsNegativeTest-417074328 tempest-ServerDiagnosticsNegativeTest-417074328-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:33.534433 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4e611aee-a046-482b-8d1c-1fb5bad96987 tempest-ServerDiagnosticsNegativeTest-417074328 tempest-ServerDiagnosticsNegativeTest-417074328-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:33.535037 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4e611aee-a046-482b-8d1c-1fb5bad96987 tempest-ServerDiagnosticsNegativeTest-417074328 tempest-ServerDiagnosticsNegativeTest-417074328-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:33.536356 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4e611aee-a046-482b-8d1c-1fb5bad96987 tempest-ServerDiagnosticsNegativeTest-417074328 tempest-ServerDiagnosticsNegativeTest-417074328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:33.536988 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4e611aee-a046-482b-8d1c-1fb5bad96987 tempest-ServerDiagnosticsNegativeTest-417074328 tempest-ServerDiagnosticsNegativeTest-417074328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:33.537633 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4e611aee-a046-482b-8d1c-1fb5bad96987 tempest-ServerDiagnosticsNegativeTest-417074328 tempest-ServerDiagnosticsNegativeTest-417074328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:33.581094 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-4e611aee-a046-482b-8d1c-1fb5bad96987 tempest-ServerDiagnosticsNegativeTest-417074328 tempest-ServerDiagnosticsNegativeTest-417074328-project] Getting quotas for project 930bc715520746bc8a320d082e47af81. Resources: {'ram', 'instances', 'cores'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:36:33.583765 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_api:INSERT=3,nova_api:SELECT=92,nova_api:UPDATE=2,nova_api:DELETE=3 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:36:33.593211 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-4e611aee-a046-482b-8d1c-1fb5bad96987 tempest-ServerDiagnosticsNegativeTest-417074328 tempest-ServerDiagnosticsNegativeTest-417074328-project] Getting quotas for user d2581847c48447f5867331fb858ebb0a and project 930bc715520746bc8a320d082e47af81. Resources: {'ram', 'instances', 'cores'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:36:33.625268 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-4e611aee-a046-482b-8d1c-1fb5bad96987 tempest-ServerDiagnosticsNegativeTest-417074328 tempest-ServerDiagnosticsNegativeTest-417074328-project] Going to run 1 instances... {{(pid=128802) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:36:33.627939 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-4e611aee-a046-482b-8d1c-1fb5bad96987 tempest-ServerDiagnosticsNegativeTest-417074328 tempest-ServerDiagnosticsNegativeTest-417074328-project] [instance: a42d2956-071d-4bad-b9a6-a0f78fcb0498] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='15b24725-0c99-4bcf-b1fb-907cdf8e2d63',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128802) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:36:33.695720 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-4e611aee-a046-482b-8d1c-1fb5bad96987 tempest-ServerDiagnosticsNegativeTest-417074328 tempest-ServerDiagnosticsNegativeTest-417074328-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.695935 Oct 04 20:36:33.696622 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 382/770] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 20:36:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 1698 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 20:36:33.711125 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-a5a25c06-8ca2-4ce5-9735-a52b589f867f tempest-ServerDiagnosticsNegativeTest-417074328 tempest-ServerDiagnosticsNegativeTest-417074328-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:33.719308 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-a5a25c06-8ca2-4ce5-9735-a52b589f867f tempest-ServerDiagnosticsNegativeTest-417074328 tempest-ServerDiagnosticsNegativeTest-417074328-project] [instance: a42d2956-071d-4bad-b9a6-a0f78fcb0498] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:33.879370 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.network.neutron [None req-1c5d9470-1a2b-4212-811e-e56d51f61196 tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] validate_networks() for [('0824aa89-f17e-45f9-b40a-58d4ba83f038', None, None, None, None, None)] {{(pid=128801) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:36:34.000250 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-a5a25c06-8ca2-4ce5-9735-a52b589f867f tempest-ServerDiagnosticsNegativeTest-417074328 tempest-ServerDiagnosticsNegativeTest-417074328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2581847c48447f5867331fb858ebb0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930bc715520746bc8a320d082e47af81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:34.014494 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-a5a25c06-8ca2-4ce5-9735-a52b589f867f tempest-ServerDiagnosticsNegativeTest-417074328 tempest-ServerDiagnosticsNegativeTest-417074328-project] 10.222.0.33 "GET /compute/v2.1/servers/a42d2956-071d-4bad-b9a6-a0f78fcb0498" status: 200 len: 1222 microversion: 2.1 time: 0.307714 Oct 04 20:36:34.015342 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 383/771] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:36:33 2022] GET /compute/v2.1/servers/a42d2956-071d-4bad-b9a6-a0f78fcb0498 => generated 1222 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:36:34.045177 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-3afb26b4-a828-4740-8640-91a4ae832838 tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:34.045789 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-3afb26b4-a828-4740-8640-91a4ae832838 tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] [instance: c61a781e-96f8-4bf6-8d3d-b8c3e9c58808] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:34.060443 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3afb26b4-a828-4740-8640-91a4ae832838 tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:34.062599 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3afb26b4-a828-4740-8640-91a4ae832838 tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:34.064610 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3afb26b4-a828-4740-8640-91a4ae832838 tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:34.065416 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3afb26b4-a828-4740-8640-91a4ae832838 tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:34.066781 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3afb26b4-a828-4740-8640-91a4ae832838 tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:34.067600 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3afb26b4-a828-4740-8640-91a4ae832838 tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:34.366280 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-3afb26b4-a828-4740-8640-91a4ae832838 tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70b2a3b8a3d34ecdaab68b7f18f7788e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d53510a3a5543618f6b701827e7c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:34.386844 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-3afb26b4-a828-4740-8640-91a4ae832838 tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] 10.222.0.33 "GET /compute/v2.1/servers/c61a781e-96f8-4bf6-8d3d-b8c3e9c58808" status: 200 len: 1315 microversion: 2.1 time: 0.356696 Oct 04 20:36:34.391937 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 384/772] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:36:34 2022] GET /compute/v2.1/servers/c61a781e-96f8-4bf6-8d3d-b8c3e9c58808 => generated 1315 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:36:34.411495 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-ebd21083-877f-4b54-9649-8cac82fb2ba2 tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestManualDisk-server-614127410", "imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "3aedeaea-25e6-4a91-a39d-284e89e01fa9"}], "security_groups": [{"name": "tempest-securitygroup--1530930731"}], "key_name": "tempest-keypair-921654706", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:36:34.757078 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.network.neutron [None req-ebd21083-877f-4b54-9649-8cac82fb2ba2 tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] validate_networks() for [('3aedeaea-25e6-4a91-a39d-284e89e01fa9', None, None, None, None, None)] {{(pid=128802) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:36:34.860681 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-1c5d9470-1a2b-4212-811e-e56d51f61196 tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Flavor limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:36:34.861286 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-1c5d9470-1a2b-4212-811e-e56d51f61196 tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Image limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:36:34.862069 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-1c5d9470-1a2b-4212-811e-e56d51f61196 tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Flavor pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:36:34.862772 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-1c5d9470-1a2b-4212-811e-e56d51f61196 tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Image pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:36:34.863850 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-1c5d9470-1a2b-4212-811e-e56d51f61196 tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:36:34.887769 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1c5d9470-1a2b-4212-811e-e56d51f61196 tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:34.901383 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1c5d9470-1a2b-4212-811e-e56d51f61196 tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:34.902002 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1c5d9470-1a2b-4212-811e-e56d51f61196 tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:34.905282 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1c5d9470-1a2b-4212-811e-e56d51f61196 tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:34.907480 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1c5d9470-1a2b-4212-811e-e56d51f61196 tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:34.908304 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1c5d9470-1a2b-4212-811e-e56d51f61196 tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:34.909534 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=18 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:36:34.963287 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-1c5d9470-1a2b-4212-811e-e56d51f61196 tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Getting quotas for project e8cc219b86ed450cbe7c780d7f79d9f8. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:36:34.971126 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-1c5d9470-1a2b-4212-811e-e56d51f61196 tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Getting quotas for user b786966441fc45f28890bf56cdfafb3f and project e8cc219b86ed450cbe7c780d7f79d9f8. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:36:35.011105 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-1c5d9470-1a2b-4212-811e-e56d51f61196 tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Going to run 1 instances... {{(pid=128801) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:36:35.014649 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-1c5d9470-1a2b-4212-811e-e56d51f61196 tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] [instance: 7d9db253-559a-4d4b-9a5e-42c8f63f6cb7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ba0b0a1b-e4e4-4ba0-9575-cd168ca3ffd5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128801) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:36:35.108073 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-1c5d9470-1a2b-4212-811e-e56d51f61196 tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.584195 Oct 04 20:36:35.108729 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 389/773] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 20:36:33 2022] POST /compute/v2.1/servers => generated 406 bytes in 1586 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 20:36:35.136270 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a5873191-43e5-4291-908e-039deaabcc2d tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:35.136897 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a5873191-43e5-4291-908e-039deaabcc2d tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] [instance: 9f8cc082-0a37-4123-a680-1210a90b3ca9] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:35.144765 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a5873191-43e5-4291-908e-039deaabcc2d tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:35.145489 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a5873191-43e5-4291-908e-039deaabcc2d tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:35.147109 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a5873191-43e5-4291-908e-039deaabcc2d tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:35.148995 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a5873191-43e5-4291-908e-039deaabcc2d tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:35.149755 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a5873191-43e5-4291-908e-039deaabcc2d tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:35.150282 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a5873191-43e5-4291-908e-039deaabcc2d tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:35.630146 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-ebd21083-877f-4b54-9649-8cac82fb2ba2 tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] Getting quotas for project 8659949e00dc429e8667767d0f126771. Resources: dict_keys(['metadata_items']) {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:36:35.632034 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-a5873191-43e5-4291-908e-039deaabcc2d tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a24944aeb34a5ea228965be9bf4ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c288268acb30475bbc065a8f72cb21d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:35.642698 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-ebd21083-877f-4b54-9649-8cac82fb2ba2 tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] Getting quotas for user 8fa55ca3469648b0b1a2e1a29541c462 and project 8659949e00dc429e8667767d0f126771. Resources: dict_keys(['metadata_items']) {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:36:35.649359 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a5873191-43e5-4291-908e-039deaabcc2d tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] 10.222.0.33 "GET /compute/v2.1/servers/9f8cc082-0a37-4123-a680-1210a90b3ca9" status: 200 len: 1471 microversion: 2.1 time: 0.537909 Oct 04 20:36:35.654689 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 390/774] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:36:35 2022] GET /compute/v2.1/servers/9f8cc082-0a37-4123-a680-1210a90b3ca9 => generated 1471 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:36:35.661979 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1d2b5b37-754c-4545-93f3-15606dd302b7 tempest-ServerDiagnosticsNegativeTest-417074328 tempest-ServerDiagnosticsNegativeTest-417074328-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:35.667978 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-ebd21083-877f-4b54-9649-8cac82fb2ba2 tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] Flavor limits 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:36:35.668605 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-ebd21083-877f-4b54-9649-8cac82fb2ba2 tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] Image limits 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:36:35.669266 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-ebd21083-877f-4b54-9649-8cac82fb2ba2 tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] Flavor pref 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:36:35.669493 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-1d2b5b37-754c-4545-93f3-15606dd302b7 tempest-ServerDiagnosticsNegativeTest-417074328 tempest-ServerDiagnosticsNegativeTest-417074328-project] [instance: a42d2956-071d-4bad-b9a6-a0f78fcb0498] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:35.674974 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-ebd21083-877f-4b54-9649-8cac82fb2ba2 tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] Image pref 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:36:35.675599 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-ebd21083-877f-4b54-9649-8cac82fb2ba2 tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:36:35.691798 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ebd21083-877f-4b54-9649-8cac82fb2ba2 tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:35.692095 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1d2b5b37-754c-4545-93f3-15606dd302b7 tempest-ServerDiagnosticsNegativeTest-417074328 tempest-ServerDiagnosticsNegativeTest-417074328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:35.692726 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1d2b5b37-754c-4545-93f3-15606dd302b7 tempest-ServerDiagnosticsNegativeTest-417074328 tempest-ServerDiagnosticsNegativeTest-417074328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:35.694308 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1d2b5b37-754c-4545-93f3-15606dd302b7 tempest-ServerDiagnosticsNegativeTest-417074328 tempest-ServerDiagnosticsNegativeTest-417074328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:35.694509 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ebd21083-877f-4b54-9649-8cac82fb2ba2 tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:35.695132 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ebd21083-877f-4b54-9649-8cac82fb2ba2 tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:35.695718 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1d2b5b37-754c-4545-93f3-15606dd302b7 tempest-ServerDiagnosticsNegativeTest-417074328 tempest-ServerDiagnosticsNegativeTest-417074328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:35.696646 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ebd21083-877f-4b54-9649-8cac82fb2ba2 tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:35.699644 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1d2b5b37-754c-4545-93f3-15606dd302b7 tempest-ServerDiagnosticsNegativeTest-417074328 tempest-ServerDiagnosticsNegativeTest-417074328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:35.699919 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ebd21083-877f-4b54-9649-8cac82fb2ba2 tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:35.700545 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ebd21083-877f-4b54-9649-8cac82fb2ba2 tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:35.708698 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1d2b5b37-754c-4545-93f3-15606dd302b7 tempest-ServerDiagnosticsNegativeTest-417074328 tempest-ServerDiagnosticsNegativeTest-417074328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:35.744124 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-ebd21083-877f-4b54-9649-8cac82fb2ba2 tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] Getting quotas for project 8659949e00dc429e8667767d0f126771. Resources: {'ram', 'instances', 'cores'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:36:35.752703 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-ebd21083-877f-4b54-9649-8cac82fb2ba2 tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] Getting quotas for user 8fa55ca3469648b0b1a2e1a29541c462 and project 8659949e00dc429e8667767d0f126771. Resources: {'ram', 'instances', 'cores'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:36:35.779877 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-ebd21083-877f-4b54-9649-8cac82fb2ba2 tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] Going to run 1 instances... {{(pid=128802) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:36:35.783128 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-ebd21083-877f-4b54-9649-8cac82fb2ba2 tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] [instance: 33bf1c5a-fbf7-4db1-b2c8-e4ab05149f25] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='15b24725-0c99-4bcf-b1fb-907cdf8e2d63',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128802) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:36:35.891751 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-1d2b5b37-754c-4545-93f3-15606dd302b7 tempest-ServerDiagnosticsNegativeTest-417074328 tempest-ServerDiagnosticsNegativeTest-417074328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2581847c48447f5867331fb858ebb0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930bc715520746bc8a320d082e47af81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:35.900040 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-ebd21083-877f-4b54-9649-8cac82fb2ba2 tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.506983 Oct 04 20:36:35.903469 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 385/775] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 20:36:34 2022] POST /compute/v2.1/servers => generated 409 bytes in 1511 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 20:36:35.911034 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-0f700691-cde5-4a5d-bb65-ac382694e456 tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:35.911871 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-0f700691-cde5-4a5d-bb65-ac382694e456 tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] [instance: 7d9db253-559a-4d4b-9a5e-42c8f63f6cb7] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:35.922913 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-1d2b5b37-754c-4545-93f3-15606dd302b7 tempest-ServerDiagnosticsNegativeTest-417074328 tempest-ServerDiagnosticsNegativeTest-417074328-project] 10.222.0.33 "GET /compute/v2.1/servers/a42d2956-071d-4bad-b9a6-a0f78fcb0498" status: 200 len: 1274 microversion: 2.1 time: 0.265643 Oct 04 20:36:35.937274 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 391/776] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:36:35 2022] GET /compute/v2.1/servers/a42d2956-071d-4bad-b9a6-a0f78fcb0498 => generated 1274 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:36:35.959868 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b8f9e2f4-687f-47fd-bc42-4dffa8dc56a2 tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:35.960540 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b8f9e2f4-687f-47fd-bc42-4dffa8dc56a2 tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] [instance: c61a781e-96f8-4bf6-8d3d-b8c3e9c58808] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:35.983173 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b8f9e2f4-687f-47fd-bc42-4dffa8dc56a2 tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:35.986275 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b8f9e2f4-687f-47fd-bc42-4dffa8dc56a2 tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:35.988999 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b8f9e2f4-687f-47fd-bc42-4dffa8dc56a2 tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:35.989831 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b8f9e2f4-687f-47fd-bc42-4dffa8dc56a2 tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:35.992376 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b8f9e2f4-687f-47fd-bc42-4dffa8dc56a2 tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:35.992821 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b8f9e2f4-687f-47fd-bc42-4dffa8dc56a2 tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:36.481446 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-0f700691-cde5-4a5d-bb65-ac382694e456 tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b786966441fc45f28890bf56cdfafb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8cc219b86ed450cbe7c780d7f79d9f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:36.500318 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-0f700691-cde5-4a5d-bb65-ac382694e456 tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] 10.222.0.33 "GET /compute/v2.1/servers/7d9db253-559a-4d4b-9a5e-42c8f63f6cb7" status: 200 len: 1245 microversion: 2.1 time: 0.594272 Oct 04 20:36:36.502220 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 386/777] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:36:35 2022] GET /compute/v2.1/servers/7d9db253-559a-4d4b-9a5e-42c8f63f6cb7 => generated 1245 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:36:36.516531 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-b8175618-d2a6-4b3d-9392-0e64f643a042 tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:36.517253 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-b8175618-d2a6-4b3d-9392-0e64f643a042 tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] [instance: 33bf1c5a-fbf7-4db1-b2c8-e4ab05149f25] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:36.569348 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-b8f9e2f4-687f-47fd-bc42-4dffa8dc56a2 tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70b2a3b8a3d34ecdaab68b7f18f7788e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d53510a3a5543618f6b701827e7c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:36.577794 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b8f9e2f4-687f-47fd-bc42-4dffa8dc56a2 tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] 10.222.0.33 "GET /compute/v2.1/servers/c61a781e-96f8-4bf6-8d3d-b8c3e9c58808" status: 200 len: 1315 microversion: 2.1 time: 0.637107 Oct 04 20:36:36.595189 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 392/778] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:36:35 2022] GET /compute/v2.1/servers/c61a781e-96f8-4bf6-8d3d-b8c3e9c58808 => generated 1315 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:36:36.601312 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-46710d50-ea28-4e5d-bd48-c2b95660dc9a tempest-MigrationsAdminTest-1312330847 tempest-MigrationsAdminTest-1312330847-project-admin] Calling method '.version_select at 0x7f3c74deb5e0>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:36.605449 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-46710d50-ea28-4e5d-bd48-c2b95660dc9a tempest-MigrationsAdminTest-1312330847 tempest-MigrationsAdminTest-1312330847-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:36.605934 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-46710d50-ea28-4e5d-bd48-c2b95660dc9a tempest-MigrationsAdminTest-1312330847 tempest-MigrationsAdminTest-1312330847-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:36.606393 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-46710d50-ea28-4e5d-bd48-c2b95660dc9a tempest-MigrationsAdminTest-1312330847 tempest-MigrationsAdminTest-1312330847-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:36.620001 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-46710d50-ea28-4e5d-bd48-c2b95660dc9a tempest-MigrationsAdminTest-1312330847 tempest-MigrationsAdminTest-1312330847-project-admin] 10.222.0.33 "GET /compute/v2.1/os-migrations" status: 200 len: 802 microversion: 2.1 time: 0.037221 Oct 04 20:36:36.620641 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 393/779] 10.222.0.33 () {58 vars in 1143 bytes} [Tue Oct 4 20:36:36 2022] GET /compute/v2.1/os-migrations => generated 802 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:36:36.650255 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-de692ed9-ba2d-4305-9c76-1a2265b63dd2 tempest-MigrationsAdminTest-1312330847 tempest-MigrationsAdminTest-1312330847-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:36.666768 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-de692ed9-ba2d-4305-9c76-1a2265b63dd2 tempest-MigrationsAdminTest-1312330847 tempest-MigrationsAdminTest-1312330847-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.023370 Oct 04 20:36:36.690142 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 394/780] 10.222.0.33 () {58 vars in 1137 bytes} [Tue Oct 4 20:36:36 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:36:36.695117 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-bc8dccc6-dcb6-41ea-a7b9-aff6dc388964 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:36.695727 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-bc8dccc6-dcb6-41ea-a7b9-aff6dc388964 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] [instance: 9f8cc082-0a37-4123-a680-1210a90b3ca9] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:36.707239 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bc8dccc6-dcb6-41ea-a7b9-aff6dc388964 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:36.707738 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bc8dccc6-dcb6-41ea-a7b9-aff6dc388964 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:36.708174 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bc8dccc6-dcb6-41ea-a7b9-aff6dc388964 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:36.708880 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bc8dccc6-dcb6-41ea-a7b9-aff6dc388964 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:36.710076 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bc8dccc6-dcb6-41ea-a7b9-aff6dc388964 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:36.718711 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bc8dccc6-dcb6-41ea-a7b9-aff6dc388964 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:36.956609 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-b8175618-d2a6-4b3d-9392-0e64f643a042 tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa55ca3469648b0b1a2e1a29541c462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8659949e00dc429e8667767d0f126771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:36.973785 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-b8175618-d2a6-4b3d-9392-0e64f643a042 tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] 10.222.0.33 "GET /compute/v2.1/servers/33bf1c5a-fbf7-4db1-b2c8-e4ab05149f25" status: 200 len: 1276 microversion: 2.1 time: 0.459549 Oct 04 20:36:36.977342 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 387/781] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:36:36 2022] GET /compute/v2.1/servers/33bf1c5a-fbf7-4db1-b2c8-e4ab05149f25 => generated 1276 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:36:37.008743 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-dfb31652-794b-4a0a-8e70-7b24ef707f22 tempest-MigrationsAdminTest-1312330847 tempest-MigrationsAdminTest-1312330847-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_resize_flavor_-3300240", "ram": 1024, "disk": 1, "vcpus": 1}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:36:37.080223 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-dfb31652-794b-4a0a-8e70-7b24ef707f22 tempest-MigrationsAdminTest-1312330847 tempest-MigrationsAdminTest-1312330847-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 496 microversion: 2.1 time: 0.082041 Oct 04 20:36:37.083217 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 388/782] 10.222.0.33 () {60 vars in 1146 bytes} [Tue Oct 4 20:36:36 2022] POST /compute/v2.1/flavors => generated 496 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:36:37.096431 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-b3430896-02b9-4e32-9969-861fa928ec3e tempest-ServerDiagnosticsNegativeTest-417074328 tempest-ServerDiagnosticsNegativeTest-417074328-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:37.098259 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-b3430896-02b9-4e32-9969-861fa928ec3e tempest-ServerDiagnosticsNegativeTest-417074328 tempest-ServerDiagnosticsNegativeTest-417074328-project] [instance: a42d2956-071d-4bad-b9a6-a0f78fcb0498] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:37.104567 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-bc8dccc6-dcb6-41ea-a7b9-aff6dc388964 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a24944aeb34a5ea228965be9bf4ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c288268acb30475bbc065a8f72cb21d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:37.112788 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b3430896-02b9-4e32-9969-861fa928ec3e tempest-ServerDiagnosticsNegativeTest-417074328 tempest-ServerDiagnosticsNegativeTest-417074328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:37.113096 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-bc8dccc6-dcb6-41ea-a7b9-aff6dc388964 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] 10.222.0.33 "GET /compute/v2.1/servers/9f8cc082-0a37-4123-a680-1210a90b3ca9" status: 200 len: 1471 microversion: 2.1 time: 0.421901 Oct 04 20:36:37.113219 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b3430896-02b9-4e32-9969-861fa928ec3e tempest-ServerDiagnosticsNegativeTest-417074328 tempest-ServerDiagnosticsNegativeTest-417074328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:37.116589 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b3430896-02b9-4e32-9969-861fa928ec3e tempest-ServerDiagnosticsNegativeTest-417074328 tempest-ServerDiagnosticsNegativeTest-417074328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:37.132938 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b3430896-02b9-4e32-9969-861fa928ec3e tempest-ServerDiagnosticsNegativeTest-417074328 tempest-ServerDiagnosticsNegativeTest-417074328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:37.135385 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b3430896-02b9-4e32-9969-861fa928ec3e tempest-ServerDiagnosticsNegativeTest-417074328 tempest-ServerDiagnosticsNegativeTest-417074328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:37.136940 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b3430896-02b9-4e32-9969-861fa928ec3e tempest-ServerDiagnosticsNegativeTest-417074328 tempest-ServerDiagnosticsNegativeTest-417074328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:37.138708 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 395/783] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:36:36 2022] GET /compute/v2.1/servers/9f8cc082-0a37-4123-a680-1210a90b3ca9 => generated 1471 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:36:37.143915 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e609c697-44b1-4acb-be44-ec28a7516730 tempest-MigrationsAdminTest-1312330847 tempest-MigrationsAdminTest-1312330847-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:37.157386 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e609c697-44b1-4acb-be44-ec28a7516730 tempest-MigrationsAdminTest-1312330847 tempest-MigrationsAdminTest-1312330847-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.017190 Oct 04 20:36:37.172648 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 396/784] 10.222.0.33 () {58 vars in 1182 bytes} [Tue Oct 4 20:36:37 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 20:36:37.396631 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2b8cec3a-1ff8-4ee2-b337-0f10a0b5778d tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-2145910980", "imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63", "flavorRef": "48f18867-47ca-44ca-b04d-8950bf944255"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:36:37.398306 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-b3430896-02b9-4e32-9969-861fa928ec3e tempest-ServerDiagnosticsNegativeTest-417074328 tempest-ServerDiagnosticsNegativeTest-417074328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2581847c48447f5867331fb858ebb0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930bc715520746bc8a320d082e47af81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:37.407104 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-b3430896-02b9-4e32-9969-861fa928ec3e tempest-ServerDiagnosticsNegativeTest-417074328 tempest-ServerDiagnosticsNegativeTest-417074328-project] 10.222.0.33 "GET /compute/v2.1/servers/a42d2956-071d-4bad-b9a6-a0f78fcb0498" status: 200 len: 1280 microversion: 2.1 time: 0.322712 Oct 04 20:36:37.407681 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 389/785] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:36:37 2022] GET /compute/v2.1/servers/a42d2956-071d-4bad-b9a6-a0f78fcb0498 => generated 1280 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:36:37.480012 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-46a93d53-d5d7-4a97-8d82-620365a7a571 req-69762a9a-769e-415a-bf91-f1c60a8b28bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c61a781e-96f8-4bf6-8d3d-b8c3e9c58808", "name": "network-vif-plugged", "status": "completed", "tag": "e4cddadd-318e-45b2-a470-85ddf6901196"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:36:37.504951 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-46a93d53-d5d7-4a97-8d82-620365a7a571 req-69762a9a-769e-415a-bf91-f1c60a8b28bc service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:37.507561 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-46a93d53-d5d7-4a97-8d82-620365a7a571 req-69762a9a-769e-415a-bf91-f1c60a8b28bc service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:37.509211 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-46a93d53-d5d7-4a97-8d82-620365a7a571 req-69762a9a-769e-415a-bf91-f1c60a8b28bc service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:37.526111 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.network.neutron [None req-2b8cec3a-1ff8-4ee2-b337-0f10a0b5778d tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] validate_networks() for None {{(pid=128801) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:36:37.546615 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-46a93d53-d5d7-4a97-8d82-620365a7a571 req-69762a9a-769e-415a-bf91-f1c60a8b28bc service nova] Creating event network-vif-plugged:e4cddadd-318e-45b2-a470-85ddf6901196 for instance c61a781e-96f8-4bf6-8d3d-b8c3e9c58808 on n-h1-854823-8 Oct 04 20:36:37.560533 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-46a93d53-d5d7-4a97-8d82-620365a7a571 req-69762a9a-769e-415a-bf91-f1c60a8b28bc service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082630 Oct 04 20:36:37.562718 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 390/786] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:36:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:36:37.577113 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-cacdf196-db87-46de-a6f7-a3f6ae21aa3e tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:37.577842 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-cacdf196-db87-46de-a6f7-a3f6ae21aa3e tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] [instance: 7d9db253-559a-4d4b-9a5e-42c8f63f6cb7] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:37.591576 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cacdf196-db87-46de-a6f7-a3f6ae21aa3e tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:37.592079 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cacdf196-db87-46de-a6f7-a3f6ae21aa3e tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:37.596346 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cacdf196-db87-46de-a6f7-a3f6ae21aa3e tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:37.597248 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cacdf196-db87-46de-a6f7-a3f6ae21aa3e tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:37.598137 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cacdf196-db87-46de-a6f7-a3f6ae21aa3e tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:37.601150 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cacdf196-db87-46de-a6f7-a3f6ae21aa3e tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:37.884145 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-cacdf196-db87-46de-a6f7-a3f6ae21aa3e tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b786966441fc45f28890bf56cdfafb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8cc219b86ed450cbe7c780d7f79d9f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:37.894697 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-cacdf196-db87-46de-a6f7-a3f6ae21aa3e tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] 10.222.0.33 "GET /compute/v2.1/servers/7d9db253-559a-4d4b-9a5e-42c8f63f6cb7" status: 200 len: 1305 microversion: 2.1 time: 0.330709 Oct 04 20:36:37.906971 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 391/787] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:36:37 2022] GET /compute/v2.1/servers/7d9db253-559a-4d4b-9a5e-42c8f63f6cb7 => generated 1305 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:36:37.917141 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-53548ef8-bc11-448b-bed3-ed48974ce038 tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:37.917908 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-53548ef8-bc11-448b-bed3-ed48974ce038 tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] [instance: c61a781e-96f8-4bf6-8d3d-b8c3e9c58808] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:37.924558 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-53548ef8-bc11-448b-bed3-ed48974ce038 tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:37.925263 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-53548ef8-bc11-448b-bed3-ed48974ce038 tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:37.925904 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-53548ef8-bc11-448b-bed3-ed48974ce038 tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:37.926776 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-53548ef8-bc11-448b-bed3-ed48974ce038 tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:37.927488 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-53548ef8-bc11-448b-bed3-ed48974ce038 tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:37.929096 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-53548ef8-bc11-448b-bed3-ed48974ce038 tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:38.703176 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-53548ef8-bc11-448b-bed3-ed48974ce038 tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70b2a3b8a3d34ecdaab68b7f18f7788e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d53510a3a5543618f6b701827e7c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:38.719918 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-53548ef8-bc11-448b-bed3-ed48974ce038 tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] 10.222.0.33 "GET /compute/v2.1/servers/c61a781e-96f8-4bf6-8d3d-b8c3e9c58808" status: 200 len: 1315 microversion: 2.1 time: 0.811632 Oct 04 20:36:38.720801 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 392/788] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:36:37 2022] GET /compute/v2.1/servers/c61a781e-96f8-4bf6-8d3d-b8c3e9c58808 => generated 1315 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:36:38.726206 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-d5f84924-af6c-4a7e-9044-4a001d7e5c03 tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:38.736041 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-d5f84924-af6c-4a7e-9044-4a001d7e5c03 tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] [instance: 33bf1c5a-fbf7-4db1-b2c8-e4ab05149f25] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:38.746729 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d5f84924-af6c-4a7e-9044-4a001d7e5c03 tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:38.747626 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d5f84924-af6c-4a7e-9044-4a001d7e5c03 tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:38.748260 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d5f84924-af6c-4a7e-9044-4a001d7e5c03 tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:38.749222 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d5f84924-af6c-4a7e-9044-4a001d7e5c03 tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:38.755220 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d5f84924-af6c-4a7e-9044-4a001d7e5c03 tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:38.755888 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d5f84924-af6c-4a7e-9044-4a001d7e5c03 tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:38.903084 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-2b8cec3a-1ff8-4ee2-b337-0f10a0b5778d tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Flavor limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:36:38.904597 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-2b8cec3a-1ff8-4ee2-b337-0f10a0b5778d tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Image limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:36:38.909095 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-2b8cec3a-1ff8-4ee2-b337-0f10a0b5778d tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Flavor pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:36:38.910383 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-2b8cec3a-1ff8-4ee2-b337-0f10a0b5778d tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Image pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:36:38.911030 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-2b8cec3a-1ff8-4ee2-b337-0f10a0b5778d tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:36:38.923185 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=69 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:36:38.930100 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2b8cec3a-1ff8-4ee2-b337-0f10a0b5778d tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:38.931639 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2b8cec3a-1ff8-4ee2-b337-0f10a0b5778d tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:38.933086 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2b8cec3a-1ff8-4ee2-b337-0f10a0b5778d tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:38.935586 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2b8cec3a-1ff8-4ee2-b337-0f10a0b5778d tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:38.937575 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2b8cec3a-1ff8-4ee2-b337-0f10a0b5778d tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:38.938560 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2b8cec3a-1ff8-4ee2-b337-0f10a0b5778d tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:38.978143 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-d5f84924-af6c-4a7e-9044-4a001d7e5c03 tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa55ca3469648b0b1a2e1a29541c462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8659949e00dc429e8667767d0f126771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:38.986529 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-d5f84924-af6c-4a7e-9044-4a001d7e5c03 tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] 10.222.0.33 "GET /compute/v2.1/servers/33bf1c5a-fbf7-4db1-b2c8-e4ab05149f25" status: 200 len: 1328 microversion: 2.1 time: 0.264517 Oct 04 20:36:39.007575 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 393/789] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:36:38 2022] GET /compute/v2.1/servers/33bf1c5a-fbf7-4db1-b2c8-e4ab05149f25 => generated 1328 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:36:39.014395 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-2b8cec3a-1ff8-4ee2-b337-0f10a0b5778d tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Getting quotas for project dd3118a5d96843d3bede1ed94bd9717e. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:36:39.016314 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-90f94b41-48bf-4a65-832b-67810d95a426 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:39.020936 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-90f94b41-48bf-4a65-832b-67810d95a426 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] [instance: 9f8cc082-0a37-4123-a680-1210a90b3ca9] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:39.028081 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-2b8cec3a-1ff8-4ee2-b337-0f10a0b5778d tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Getting quotas for user 3563efe2b8c94931a2a46c4e14811b3a and project dd3118a5d96843d3bede1ed94bd9717e. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:36:39.040481 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-90f94b41-48bf-4a65-832b-67810d95a426 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:39.040936 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-90f94b41-48bf-4a65-832b-67810d95a426 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:39.042583 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-90f94b41-48bf-4a65-832b-67810d95a426 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:39.048045 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-90f94b41-48bf-4a65-832b-67810d95a426 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:39.049005 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-2b8cec3a-1ff8-4ee2-b337-0f10a0b5778d tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Going to run 1 instances... {{(pid=128801) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:36:39.052041 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-2b8cec3a-1ff8-4ee2-b337-0f10a0b5778d tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] [instance: 465ad440-a27e-4ff6-bb31-09f3545e166a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='15b24725-0c99-4bcf-b1fb-907cdf8e2d63',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128801) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:36:39.054810 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-90f94b41-48bf-4a65-832b-67810d95a426 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:39.055871 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-90f94b41-48bf-4a65-832b-67810d95a426 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:39.140741 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-2b8cec3a-1ff8-4ee2-b337-0f10a0b5778d tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.748543 Oct 04 20:36:39.143344 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 397/790] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 20:36:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 1752 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 20:36:39.148712 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b1f5cb52-00a4-4a3e-af56-9cd8e75a3416 tempest-ServerDiagnosticsNegativeTest-417074328 tempest-ServerDiagnosticsNegativeTest-417074328-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:39.150016 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b1f5cb52-00a4-4a3e-af56-9cd8e75a3416 tempest-ServerDiagnosticsNegativeTest-417074328 tempest-ServerDiagnosticsNegativeTest-417074328-project] [instance: a42d2956-071d-4bad-b9a6-a0f78fcb0498] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:39.158660 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b1f5cb52-00a4-4a3e-af56-9cd8e75a3416 tempest-ServerDiagnosticsNegativeTest-417074328 tempest-ServerDiagnosticsNegativeTest-417074328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:39.161481 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b1f5cb52-00a4-4a3e-af56-9cd8e75a3416 tempest-ServerDiagnosticsNegativeTest-417074328 tempest-ServerDiagnosticsNegativeTest-417074328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:39.167092 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b1f5cb52-00a4-4a3e-af56-9cd8e75a3416 tempest-ServerDiagnosticsNegativeTest-417074328 tempest-ServerDiagnosticsNegativeTest-417074328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:39.168239 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b1f5cb52-00a4-4a3e-af56-9cd8e75a3416 tempest-ServerDiagnosticsNegativeTest-417074328 tempest-ServerDiagnosticsNegativeTest-417074328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:39.170865 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b1f5cb52-00a4-4a3e-af56-9cd8e75a3416 tempest-ServerDiagnosticsNegativeTest-417074328 tempest-ServerDiagnosticsNegativeTest-417074328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:39.171996 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b1f5cb52-00a4-4a3e-af56-9cd8e75a3416 tempest-ServerDiagnosticsNegativeTest-417074328 tempest-ServerDiagnosticsNegativeTest-417074328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:39.429668 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-b1f5cb52-00a4-4a3e-af56-9cd8e75a3416 tempest-ServerDiagnosticsNegativeTest-417074328 tempest-ServerDiagnosticsNegativeTest-417074328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2581847c48447f5867331fb858ebb0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930bc715520746bc8a320d082e47af81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:39.439771 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b1f5cb52-00a4-4a3e-af56-9cd8e75a3416 tempest-ServerDiagnosticsNegativeTest-417074328 tempest-ServerDiagnosticsNegativeTest-417074328-project] 10.222.0.33 "GET /compute/v2.1/servers/a42d2956-071d-4bad-b9a6-a0f78fcb0498" status: 200 len: 1280 microversion: 2.1 time: 0.295045 Oct 04 20:36:39.445249 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 398/791] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:36:39 2022] GET /compute/v2.1/servers/a42d2956-071d-4bad-b9a6-a0f78fcb0498 => generated 1280 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:36:39.456402 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-169921c1-85eb-41a1-87af-c185667eaf31 tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:39.458563 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-169921c1-85eb-41a1-87af-c185667eaf31 tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] [instance: 7d9db253-559a-4d4b-9a5e-42c8f63f6cb7] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:39.472256 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-169921c1-85eb-41a1-87af-c185667eaf31 tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:39.472757 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-169921c1-85eb-41a1-87af-c185667eaf31 tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:39.473189 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-169921c1-85eb-41a1-87af-c185667eaf31 tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:39.483346 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-169921c1-85eb-41a1-87af-c185667eaf31 tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:39.483840 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-169921c1-85eb-41a1-87af-c185667eaf31 tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:39.484276 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-169921c1-85eb-41a1-87af-c185667eaf31 tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:39.727148 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-90f94b41-48bf-4a65-832b-67810d95a426 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a24944aeb34a5ea228965be9bf4ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c288268acb30475bbc065a8f72cb21d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:39.739447 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-90f94b41-48bf-4a65-832b-67810d95a426 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] 10.222.0.33 "GET /compute/v2.1/servers/9f8cc082-0a37-4123-a680-1210a90b3ca9" status: 200 len: 1477 microversion: 2.1 time: 0.730685 Oct 04 20:36:39.745362 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 394/792] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:36:39 2022] GET /compute/v2.1/servers/9f8cc082-0a37-4123-a680-1210a90b3ca9 => generated 1477 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:36:39.751685 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-169921c1-85eb-41a1-87af-c185667eaf31 tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b786966441fc45f28890bf56cdfafb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8cc219b86ed450cbe7c780d7f79d9f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:39.763603 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-ea631aec-aac0-441f-a707-38f0fc129a20 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:39.768291 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-ea631aec-aac0-441f-a707-38f0fc129a20 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] [instance: 465ad440-a27e-4ff6-bb31-09f3545e166a] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:39.772008 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-169921c1-85eb-41a1-87af-c185667eaf31 tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] 10.222.0.33 "GET /compute/v2.1/servers/7d9db253-559a-4d4b-9a5e-42c8f63f6cb7" status: 200 len: 1303 microversion: 2.1 time: 0.323533 Oct 04 20:36:39.776352 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 399/793] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:36:39 2022] GET /compute/v2.1/servers/7d9db253-559a-4d4b-9a5e-42c8f63f6cb7 => generated 1303 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:36:39.802517 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-accbe65a-cba7-4ceb-9546-949cec97763c tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:39.806809 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-accbe65a-cba7-4ceb-9546-949cec97763c tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] [instance: c61a781e-96f8-4bf6-8d3d-b8c3e9c58808] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:39.829479 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-accbe65a-cba7-4ceb-9546-949cec97763c tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:39.833450 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-accbe65a-cba7-4ceb-9546-949cec97763c tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:39.833917 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-accbe65a-cba7-4ceb-9546-949cec97763c tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:39.841294 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-accbe65a-cba7-4ceb-9546-949cec97763c tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:39.843500 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-accbe65a-cba7-4ceb-9546-949cec97763c tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:39.844529 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-accbe65a-cba7-4ceb-9546-949cec97763c tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:40.107868 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-ea631aec-aac0-441f-a707-38f0fc129a20 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3563efe2b8c94931a2a46c4e14811b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3118a5d96843d3bede1ed94bd9717e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:40.121563 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-ea631aec-aac0-441f-a707-38f0fc129a20 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] 10.222.0.33 "GET /compute/v2.1/servers/465ad440-a27e-4ff6-bb31-09f3545e166a" status: 200 len: 1279 microversion: 2.1 time: 0.374802 Oct 04 20:36:40.128930 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 395/794] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:36:39 2022] GET /compute/v2.1/servers/465ad440-a27e-4ff6-bb31-09f3545e166a => generated 1279 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:36:40.159088 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-98eaf0d1-0743-435d-b092-24afe26c54b1 tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:40.162697 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-98eaf0d1-0743-435d-b092-24afe26c54b1 tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] [instance: 33bf1c5a-fbf7-4db1-b2c8-e4ab05149f25] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:40.190253 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-98eaf0d1-0743-435d-b092-24afe26c54b1 tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:40.191410 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-98eaf0d1-0743-435d-b092-24afe26c54b1 tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:40.199173 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-98eaf0d1-0743-435d-b092-24afe26c54b1 tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:40.201688 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-98eaf0d1-0743-435d-b092-24afe26c54b1 tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:40.202915 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-98eaf0d1-0743-435d-b092-24afe26c54b1 tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:40.206798 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-98eaf0d1-0743-435d-b092-24afe26c54b1 tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:40.606886 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-98eaf0d1-0743-435d-b092-24afe26c54b1 tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa55ca3469648b0b1a2e1a29541c462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8659949e00dc429e8667767d0f126771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:40.628444 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-98eaf0d1-0743-435d-b092-24afe26c54b1 tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] 10.222.0.33 "GET /compute/v2.1/servers/33bf1c5a-fbf7-4db1-b2c8-e4ab05149f25" status: 200 len: 1328 microversion: 2.1 time: 0.493049 Oct 04 20:36:40.632341 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 396/795] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:36:40 2022] GET /compute/v2.1/servers/33bf1c5a-fbf7-4db1-b2c8-e4ab05149f25 => generated 1328 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:36:40.664443 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-f5e30df6-ca6d-452d-9cb9-f6a2d95b5445 tempest-ServerDiagnosticsNegativeTest-417074328 tempest-ServerDiagnosticsNegativeTest-417074328-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:40.666260 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-f5e30df6-ca6d-452d-9cb9-f6a2d95b5445 tempest-ServerDiagnosticsNegativeTest-417074328 tempest-ServerDiagnosticsNegativeTest-417074328-project] [instance: a42d2956-071d-4bad-b9a6-a0f78fcb0498] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:40.677133 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f5e30df6-ca6d-452d-9cb9-f6a2d95b5445 tempest-ServerDiagnosticsNegativeTest-417074328 tempest-ServerDiagnosticsNegativeTest-417074328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:40.678901 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f5e30df6-ca6d-452d-9cb9-f6a2d95b5445 tempest-ServerDiagnosticsNegativeTest-417074328 tempest-ServerDiagnosticsNegativeTest-417074328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:40.679789 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f5e30df6-ca6d-452d-9cb9-f6a2d95b5445 tempest-ServerDiagnosticsNegativeTest-417074328 tempest-ServerDiagnosticsNegativeTest-417074328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:40.680963 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f5e30df6-ca6d-452d-9cb9-f6a2d95b5445 tempest-ServerDiagnosticsNegativeTest-417074328 tempest-ServerDiagnosticsNegativeTest-417074328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:40.681718 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f5e30df6-ca6d-452d-9cb9-f6a2d95b5445 tempest-ServerDiagnosticsNegativeTest-417074328 tempest-ServerDiagnosticsNegativeTest-417074328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:40.682512 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f5e30df6-ca6d-452d-9cb9-f6a2d95b5445 tempest-ServerDiagnosticsNegativeTest-417074328 tempest-ServerDiagnosticsNegativeTest-417074328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:40.727472 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-accbe65a-cba7-4ceb-9546-949cec97763c tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70b2a3b8a3d34ecdaab68b7f18f7788e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d53510a3a5543618f6b701827e7c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:40.747520 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-accbe65a-cba7-4ceb-9546-949cec97763c tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] 10.222.0.33 "GET /compute/v2.1/servers/c61a781e-96f8-4bf6-8d3d-b8c3e9c58808" status: 200 len: 1315 microversion: 2.1 time: 0.968674 Oct 04 20:36:40.755886 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 400/796] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:36:39 2022] GET /compute/v2.1/servers/c61a781e-96f8-4bf6-8d3d-b8c3e9c58808 => generated 1315 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:36:40.782856 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-796797b2-0a76-43c6-ab6c-87afb3e856a7 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:40.785705 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-796797b2-0a76-43c6-ab6c-87afb3e856a7 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] [instance: 9f8cc082-0a37-4123-a680-1210a90b3ca9] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:40.814249 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-796797b2-0a76-43c6-ab6c-87afb3e856a7 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:40.817972 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-796797b2-0a76-43c6-ab6c-87afb3e856a7 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:40.818988 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-796797b2-0a76-43c6-ab6c-87afb3e856a7 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:40.820022 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-796797b2-0a76-43c6-ab6c-87afb3e856a7 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:40.827077 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-796797b2-0a76-43c6-ab6c-87afb3e856a7 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:40.828495 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-796797b2-0a76-43c6-ab6c-87afb3e856a7 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:41.195729 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-796797b2-0a76-43c6-ab6c-87afb3e856a7 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a24944aeb34a5ea228965be9bf4ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c288268acb30475bbc065a8f72cb21d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:41.206603 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-796797b2-0a76-43c6-ab6c-87afb3e856a7 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] 10.222.0.33 "GET /compute/v2.1/servers/9f8cc082-0a37-4123-a680-1210a90b3ca9" status: 200 len: 1477 microversion: 2.1 time: 0.441325 Oct 04 20:36:41.207191 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 401/797] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:36:40 2022] GET /compute/v2.1/servers/9f8cc082-0a37-4123-a680-1210a90b3ca9 => generated 1477 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:36:41.230524 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a1a01b5f-7c89-483e-a361-ed96e24bbf5f tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:41.230524 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a1a01b5f-7c89-483e-a361-ed96e24bbf5f tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] [instance: 7d9db253-559a-4d4b-9a5e-42c8f63f6cb7] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:41.248499 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a1a01b5f-7c89-483e-a361-ed96e24bbf5f tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:41.249006 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a1a01b5f-7c89-483e-a361-ed96e24bbf5f tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:41.249445 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a1a01b5f-7c89-483e-a361-ed96e24bbf5f tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:41.250173 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a1a01b5f-7c89-483e-a361-ed96e24bbf5f tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:41.254046 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a1a01b5f-7c89-483e-a361-ed96e24bbf5f tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:41.255178 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a1a01b5f-7c89-483e-a361-ed96e24bbf5f tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:41.413246 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-f5e30df6-ca6d-452d-9cb9-f6a2d95b5445 tempest-ServerDiagnosticsNegativeTest-417074328 tempest-ServerDiagnosticsNegativeTest-417074328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2581847c48447f5867331fb858ebb0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930bc715520746bc8a320d082e47af81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:41.425835 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-f5e30df6-ca6d-452d-9cb9-f6a2d95b5445 tempest-ServerDiagnosticsNegativeTest-417074328 tempest-ServerDiagnosticsNegativeTest-417074328-project] 10.222.0.33 "GET /compute/v2.1/servers/a42d2956-071d-4bad-b9a6-a0f78fcb0498" status: 200 len: 1322 microversion: 2.1 time: 0.791655 Oct 04 20:36:41.429471 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 397/798] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:36:40 2022] GET /compute/v2.1/servers/a42d2956-071d-4bad-b9a6-a0f78fcb0498 => generated 1322 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:36:41.445806 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-2c1bb4bf-4a3d-431a-8a49-f5dc36d56a7e tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:41.448090 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-2c1bb4bf-4a3d-431a-8a49-f5dc36d56a7e tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] [instance: 465ad440-a27e-4ff6-bb31-09f3545e166a] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:41.471981 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2c1bb4bf-4a3d-431a-8a49-f5dc36d56a7e tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:41.472402 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2c1bb4bf-4a3d-431a-8a49-f5dc36d56a7e tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:41.472834 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2c1bb4bf-4a3d-431a-8a49-f5dc36d56a7e tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:41.473536 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2c1bb4bf-4a3d-431a-8a49-f5dc36d56a7e tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:41.474161 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2c1bb4bf-4a3d-431a-8a49-f5dc36d56a7e tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:41.475442 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2c1bb4bf-4a3d-431a-8a49-f5dc36d56a7e tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:41.506071 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-a1a01b5f-7c89-483e-a361-ed96e24bbf5f tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b786966441fc45f28890bf56cdfafb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8cc219b86ed450cbe7c780d7f79d9f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:41.525641 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a1a01b5f-7c89-483e-a361-ed96e24bbf5f tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] 10.222.0.33 "GET /compute/v2.1/servers/7d9db253-559a-4d4b-9a5e-42c8f63f6cb7" status: 200 len: 1303 microversion: 2.1 time: 0.310677 Oct 04 20:36:41.526821 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 402/799] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:36:41 2022] GET /compute/v2.1/servers/7d9db253-559a-4d4b-9a5e-42c8f63f6cb7 => generated 1303 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:36:41.621098 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-2c1bb4bf-4a3d-431a-8a49-f5dc36d56a7e tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3563efe2b8c94931a2a46c4e14811b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3118a5d96843d3bede1ed94bd9717e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:41.633084 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-2c1bb4bf-4a3d-431a-8a49-f5dc36d56a7e tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] 10.222.0.33 "GET /compute/v2.1/servers/465ad440-a27e-4ff6-bb31-09f3545e166a" status: 200 len: 1331 microversion: 2.1 time: 0.202302 Oct 04 20:36:41.648100 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 398/800] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:36:41 2022] GET /compute/v2.1/servers/465ad440-a27e-4ff6-bb31-09f3545e166a => generated 1331 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:36:41.656488 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6458173c-1ac4-4479-b7f2-16dfb38d2e80 tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:41.657862 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-6458173c-1ac4-4479-b7f2-16dfb38d2e80 tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] [instance: 33bf1c5a-fbf7-4db1-b2c8-e4ab05149f25] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:41.672174 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6458173c-1ac4-4479-b7f2-16dfb38d2e80 tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:41.674435 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6458173c-1ac4-4479-b7f2-16dfb38d2e80 tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:41.675583 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6458173c-1ac4-4479-b7f2-16dfb38d2e80 tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:41.676966 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6458173c-1ac4-4479-b7f2-16dfb38d2e80 tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:41.680901 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6458173c-1ac4-4479-b7f2-16dfb38d2e80 tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:41.681640 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6458173c-1ac4-4479-b7f2-16dfb38d2e80 tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:41.778081 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=100 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:36:41.783583 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-b928559e-46e7-4466-a84e-3add1a183ea6 tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:41.784318 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-b928559e-46e7-4466-a84e-3add1a183ea6 tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] [instance: c61a781e-96f8-4bf6-8d3d-b8c3e9c58808] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:41.803875 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b928559e-46e7-4466-a84e-3add1a183ea6 tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:41.808062 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b928559e-46e7-4466-a84e-3add1a183ea6 tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:41.810956 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b928559e-46e7-4466-a84e-3add1a183ea6 tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:41.813911 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b928559e-46e7-4466-a84e-3add1a183ea6 tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:41.821444 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b928559e-46e7-4466-a84e-3add1a183ea6 tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:41.822273 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b928559e-46e7-4466-a84e-3add1a183ea6 tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:41.909881 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-6458173c-1ac4-4479-b7f2-16dfb38d2e80 tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa55ca3469648b0b1a2e1a29541c462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8659949e00dc429e8667767d0f126771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:41.923839 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-6458173c-1ac4-4479-b7f2-16dfb38d2e80 tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] 10.222.0.33 "GET /compute/v2.1/servers/33bf1c5a-fbf7-4db1-b2c8-e4ab05149f25" status: 200 len: 1328 microversion: 2.1 time: 0.272958 Oct 04 20:36:41.942227 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 403/801] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:36:41 2022] GET /compute/v2.1/servers/33bf1c5a-fbf7-4db1-b2c8-e4ab05149f25 => generated 1328 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:36:42.213002 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-b928559e-46e7-4466-a84e-3add1a183ea6 tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70b2a3b8a3d34ecdaab68b7f18f7788e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d53510a3a5543618f6b701827e7c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:42.229633 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-b928559e-46e7-4466-a84e-3add1a183ea6 tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] 10.222.0.33 "GET /compute/v2.1/servers/c61a781e-96f8-4bf6-8d3d-b8c3e9c58808" status: 200 len: 1315 microversion: 2.1 time: 0.447301 Oct 04 20:36:42.230992 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 399/802] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:36:41 2022] GET /compute/v2.1/servers/c61a781e-96f8-4bf6-8d3d-b8c3e9c58808 => generated 1315 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:36:42.249811 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-bcbbcc59-6fab-43cf-b578-e9339f0eacab tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:42.250873 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-bcbbcc59-6fab-43cf-b578-e9339f0eacab tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] [instance: 9f8cc082-0a37-4123-a680-1210a90b3ca9] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:42.257801 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bcbbcc59-6fab-43cf-b578-e9339f0eacab tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:42.258570 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bcbbcc59-6fab-43cf-b578-e9339f0eacab tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:42.259166 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bcbbcc59-6fab-43cf-b578-e9339f0eacab tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:42.260830 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bcbbcc59-6fab-43cf-b578-e9339f0eacab tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:42.261890 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bcbbcc59-6fab-43cf-b578-e9339f0eacab tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:42.262696 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bcbbcc59-6fab-43cf-b578-e9339f0eacab tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:42.458240 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-fdc781f1-36ee-4f47-80f1-a77cb078934e tempest-ServerDiagnosticsNegativeTest-417074328 tempest-ServerDiagnosticsNegativeTest-417074328-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:42.460252 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-fdc781f1-36ee-4f47-80f1-a77cb078934e tempest-ServerDiagnosticsNegativeTest-417074328 tempest-ServerDiagnosticsNegativeTest-417074328-project] [instance: a42d2956-071d-4bad-b9a6-a0f78fcb0498] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:42.480094 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fdc781f1-36ee-4f47-80f1-a77cb078934e tempest-ServerDiagnosticsNegativeTest-417074328 tempest-ServerDiagnosticsNegativeTest-417074328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:42.480892 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fdc781f1-36ee-4f47-80f1-a77cb078934e tempest-ServerDiagnosticsNegativeTest-417074328 tempest-ServerDiagnosticsNegativeTest-417074328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:42.481631 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fdc781f1-36ee-4f47-80f1-a77cb078934e tempest-ServerDiagnosticsNegativeTest-417074328 tempest-ServerDiagnosticsNegativeTest-417074328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:42.483887 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fdc781f1-36ee-4f47-80f1-a77cb078934e tempest-ServerDiagnosticsNegativeTest-417074328 tempest-ServerDiagnosticsNegativeTest-417074328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:42.485180 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fdc781f1-36ee-4f47-80f1-a77cb078934e tempest-ServerDiagnosticsNegativeTest-417074328 tempest-ServerDiagnosticsNegativeTest-417074328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:42.487712 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fdc781f1-36ee-4f47-80f1-a77cb078934e tempest-ServerDiagnosticsNegativeTest-417074328 tempest-ServerDiagnosticsNegativeTest-417074328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:42.803294 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-bcbbcc59-6fab-43cf-b578-e9339f0eacab tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a24944aeb34a5ea228965be9bf4ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c288268acb30475bbc065a8f72cb21d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:42.833484 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-bcbbcc59-6fab-43cf-b578-e9339f0eacab tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] 10.222.0.33 "GET /compute/v2.1/servers/9f8cc082-0a37-4123-a680-1210a90b3ca9" status: 200 len: 1477 microversion: 2.1 time: 0.603218 Oct 04 20:36:42.836005 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 404/803] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:36:42 2022] GET /compute/v2.1/servers/9f8cc082-0a37-4123-a680-1210a90b3ca9 => generated 1477 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:36:42.847164 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8d92991b-df5e-469c-9a80-0f67fd160a9f tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:42.854397 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-8d92991b-df5e-469c-9a80-0f67fd160a9f tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] [instance: 7d9db253-559a-4d4b-9a5e-42c8f63f6cb7] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:42.882782 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8d92991b-df5e-469c-9a80-0f67fd160a9f tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:42.884090 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8d92991b-df5e-469c-9a80-0f67fd160a9f tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:42.885204 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8d92991b-df5e-469c-9a80-0f67fd160a9f tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:42.889088 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8d92991b-df5e-469c-9a80-0f67fd160a9f tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:42.889718 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8d92991b-df5e-469c-9a80-0f67fd160a9f tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:42.891482 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8d92991b-df5e-469c-9a80-0f67fd160a9f tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:43.133891 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-fdc781f1-36ee-4f47-80f1-a77cb078934e tempest-ServerDiagnosticsNegativeTest-417074328 tempest-ServerDiagnosticsNegativeTest-417074328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2581847c48447f5867331fb858ebb0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930bc715520746bc8a320d082e47af81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:43.147907 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-fdc781f1-36ee-4f47-80f1-a77cb078934e tempest-ServerDiagnosticsNegativeTest-417074328 tempest-ServerDiagnosticsNegativeTest-417074328-project] 10.222.0.33 "GET /compute/v2.1/servers/a42d2956-071d-4bad-b9a6-a0f78fcb0498" status: 200 len: 1322 microversion: 2.1 time: 0.696512 Oct 04 20:36:43.151125 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 400/804] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:36:42 2022] GET /compute/v2.1/servers/a42d2956-071d-4bad-b9a6-a0f78fcb0498 => generated 1322 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:36:43.178322 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-61237978-a2d3-484d-a03e-2d937a4e8723 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:43.179524 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-61237978-a2d3-484d-a03e-2d937a4e8723 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] [instance: 465ad440-a27e-4ff6-bb31-09f3545e166a] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:43.195498 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-61237978-a2d3-484d-a03e-2d937a4e8723 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:43.204022 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-61237978-a2d3-484d-a03e-2d937a4e8723 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:43.204725 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-61237978-a2d3-484d-a03e-2d937a4e8723 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:43.205694 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-61237978-a2d3-484d-a03e-2d937a4e8723 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:43.206458 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-61237978-a2d3-484d-a03e-2d937a4e8723 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:43.207122 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-61237978-a2d3-484d-a03e-2d937a4e8723 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:43.236924 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-8d92991b-df5e-469c-9a80-0f67fd160a9f tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b786966441fc45f28890bf56cdfafb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8cc219b86ed450cbe7c780d7f79d9f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:43.245963 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-8d92991b-df5e-469c-9a80-0f67fd160a9f tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] 10.222.0.33 "GET /compute/v2.1/servers/7d9db253-559a-4d4b-9a5e-42c8f63f6cb7" status: 200 len: 1303 microversion: 2.1 time: 0.407402 Oct 04 20:36:43.255128 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 405/805] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:36:42 2022] GET /compute/v2.1/servers/7d9db253-559a-4d4b-9a5e-42c8f63f6cb7 => generated 1303 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:36:43.282232 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d933c4a1-d2db-4a09-a663-a3942b4fead9 tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:43.284284 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d933c4a1-d2db-4a09-a663-a3942b4fead9 tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] [instance: 33bf1c5a-fbf7-4db1-b2c8-e4ab05149f25] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:43.316306 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d933c4a1-d2db-4a09-a663-a3942b4fead9 tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:43.316854 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d933c4a1-d2db-4a09-a663-a3942b4fead9 tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:43.317312 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d933c4a1-d2db-4a09-a663-a3942b4fead9 tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:43.318067 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d933c4a1-d2db-4a09-a663-a3942b4fead9 tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:43.319108 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d933c4a1-d2db-4a09-a663-a3942b4fead9 tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:43.319709 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d933c4a1-d2db-4a09-a663-a3942b4fead9 tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:43.361497 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-61237978-a2d3-484d-a03e-2d937a4e8723 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3563efe2b8c94931a2a46c4e14811b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3118a5d96843d3bede1ed94bd9717e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:43.378200 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-61237978-a2d3-484d-a03e-2d937a4e8723 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] 10.222.0.33 "GET /compute/v2.1/servers/465ad440-a27e-4ff6-bb31-09f3545e166a" status: 200 len: 1337 microversion: 2.1 time: 0.221475 Oct 04 20:36:43.380228 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 401/806] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:36:43 2022] GET /compute/v2.1/servers/465ad440-a27e-4ff6-bb31-09f3545e166a => generated 1337 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:36:43.397131 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-5dc5c0f0-fa99-4151-9018-3d995fac4f07 tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:43.398007 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-5dc5c0f0-fa99-4151-9018-3d995fac4f07 tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] [instance: c61a781e-96f8-4bf6-8d3d-b8c3e9c58808] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:43.413038 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5dc5c0f0-fa99-4151-9018-3d995fac4f07 tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:43.419419 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5dc5c0f0-fa99-4151-9018-3d995fac4f07 tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:43.420155 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5dc5c0f0-fa99-4151-9018-3d995fac4f07 tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:43.421404 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5dc5c0f0-fa99-4151-9018-3d995fac4f07 tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:43.422118 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5dc5c0f0-fa99-4151-9018-3d995fac4f07 tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:43.422809 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5dc5c0f0-fa99-4151-9018-3d995fac4f07 tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:43.656542 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d933c4a1-d2db-4a09-a663-a3942b4fead9 tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa55ca3469648b0b1a2e1a29541c462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8659949e00dc429e8667767d0f126771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:43.668378 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d933c4a1-d2db-4a09-a663-a3942b4fead9 tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] 10.222.0.33 "GET /compute/v2.1/servers/33bf1c5a-fbf7-4db1-b2c8-e4ab05149f25" status: 200 len: 1346 microversion: 2.1 time: 0.411320 Oct 04 20:36:43.689222 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 406/807] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:36:43 2022] GET /compute/v2.1/servers/33bf1c5a-fbf7-4db1-b2c8-e4ab05149f25 => generated 1346 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:36:43.757259 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-f989ccdf-6fe4-4f9a-8d05-aaca6e50d026 req-a4b650f7-7400-44c8-8c37-bd83dfe6a180 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a42d2956-071d-4bad-b9a6-a0f78fcb0498", "tag": "8a587d76-a9ec-4db5-9ae4-ccae7d195099"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:36:43.781593 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-f989ccdf-6fe4-4f9a-8d05-aaca6e50d026 req-a4b650f7-7400-44c8-8c37-bd83dfe6a180 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:43.783412 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-f989ccdf-6fe4-4f9a-8d05-aaca6e50d026 req-a4b650f7-7400-44c8-8c37-bd83dfe6a180 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:43.784693 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-f989ccdf-6fe4-4f9a-8d05-aaca6e50d026 req-a4b650f7-7400-44c8-8c37-bd83dfe6a180 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:43.816324 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-f989ccdf-6fe4-4f9a-8d05-aaca6e50d026 req-a4b650f7-7400-44c8-8c37-bd83dfe6a180 service nova] Creating event network-changed:8a587d76-a9ec-4db5-9ae4-ccae7d195099 for instance a42d2956-071d-4bad-b9a6-a0f78fcb0498 on n-h2-854823-8 Oct 04 20:36:43.826887 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-f989ccdf-6fe4-4f9a-8d05-aaca6e50d026 req-a4b650f7-7400-44c8-8c37-bd83dfe6a180 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073428 Oct 04 20:36:43.830012 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 407/808] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:36:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 20:36:43.863287 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b4fd979b-1d3e-4571-9ded-87184cb9e1ea tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:43.863986 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b4fd979b-1d3e-4571-9ded-87184cb9e1ea tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] [instance: 9f8cc082-0a37-4123-a680-1210a90b3ca9] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:43.881245 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b4fd979b-1d3e-4571-9ded-87184cb9e1ea tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:43.886158 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b4fd979b-1d3e-4571-9ded-87184cb9e1ea tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:43.886914 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b4fd979b-1d3e-4571-9ded-87184cb9e1ea tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:43.887888 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b4fd979b-1d3e-4571-9ded-87184cb9e1ea tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:43.888494 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b4fd979b-1d3e-4571-9ded-87184cb9e1ea tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:43.889056 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b4fd979b-1d3e-4571-9ded-87184cb9e1ea tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:44.106183 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-5dc5c0f0-fa99-4151-9018-3d995fac4f07 tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70b2a3b8a3d34ecdaab68b7f18f7788e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d53510a3a5543618f6b701827e7c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:44.114247 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-5dc5c0f0-fa99-4151-9018-3d995fac4f07 tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] 10.222.0.33 "GET /compute/v2.1/servers/c61a781e-96f8-4bf6-8d3d-b8c3e9c58808" status: 200 len: 1504 microversion: 2.1 time: 0.732115 Oct 04 20:36:44.116560 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 402/809] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:36:43 2022] GET /compute/v2.1/servers/c61a781e-96f8-4bf6-8d3d-b8c3e9c58808 => generated 1504 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:36:44.139535 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-db50b36d-de7c-4216-bf7f-fb598d8ace2d tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:44.140346 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-db50b36d-de7c-4216-bf7f-fb598d8ace2d tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] [instance: c61a781e-96f8-4bf6-8d3d-b8c3e9c58808] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:44.148752 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-db50b36d-de7c-4216-bf7f-fb598d8ace2d tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:44.149255 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-db50b36d-de7c-4216-bf7f-fb598d8ace2d tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:44.149768 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-db50b36d-de7c-4216-bf7f-fb598d8ace2d tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:44.150573 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-db50b36d-de7c-4216-bf7f-fb598d8ace2d tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:44.162630 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-db50b36d-de7c-4216-bf7f-fb598d8ace2d tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:44.163143 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-db50b36d-de7c-4216-bf7f-fb598d8ace2d tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:44.261487 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-db50b36d-de7c-4216-bf7f-fb598d8ace2d tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] [instance: c61a781e-96f8-4bf6-8d3d-b8c3e9c58808] Going to try to terminate instance {{(pid=128802) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:36:44.357635 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:36:44.410418 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-b4fd979b-1d3e-4571-9ded-87184cb9e1ea tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a24944aeb34a5ea228965be9bf4ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c288268acb30475bbc065a8f72cb21d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:44.424838 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b4fd979b-1d3e-4571-9ded-87184cb9e1ea tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] 10.222.0.33 "GET /compute/v2.1/servers/9f8cc082-0a37-4123-a680-1210a90b3ca9" status: 200 len: 1477 microversion: 2.1 time: 0.566129 Oct 04 20:36:44.441709 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 408/810] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:36:43 2022] GET /compute/v2.1/servers/9f8cc082-0a37-4123-a680-1210a90b3ca9 => generated 1477 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:36:44.454491 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-db50b36d-de7c-4216-bf7f-fb598d8ace2d tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] 10.222.0.33 "DELETE /compute/v2.1/servers/c61a781e-96f8-4bf6-8d3d-b8c3e9c58808" status: 204 len: 0 microversion: 2.1 time: 0.319123 Oct 04 20:36:44.455568 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 403/811] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 20:36:44 2022] DELETE /compute/v2.1/servers/c61a781e-96f8-4bf6-8d3d-b8c3e9c58808 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:36:44.462185 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c3aae25a-c378-49cb-9987-e7e5f4f2391b tempest-ServerDiagnosticsNegativeTest-417074328 tempest-ServerDiagnosticsNegativeTest-417074328-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:44.464765 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c3aae25a-c378-49cb-9987-e7e5f4f2391b tempest-ServerDiagnosticsNegativeTest-417074328 tempest-ServerDiagnosticsNegativeTest-417074328-project] [instance: a42d2956-071d-4bad-b9a6-a0f78fcb0498] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:44.467410 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-eb77a65b-6f4e-41f4-a0ac-c68f24e7fdb4 tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:44.468642 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-eb77a65b-6f4e-41f4-a0ac-c68f24e7fdb4 tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] [instance: 7d9db253-559a-4d4b-9a5e-42c8f63f6cb7] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:44.472876 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:36:44.478734 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-eb77a65b-6f4e-41f4-a0ac-c68f24e7fdb4 tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:44.479258 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-eb77a65b-6f4e-41f4-a0ac-c68f24e7fdb4 tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:44.479741 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-eb77a65b-6f4e-41f4-a0ac-c68f24e7fdb4 tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:44.480472 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-eb77a65b-6f4e-41f4-a0ac-c68f24e7fdb4 tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:44.480935 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-eb77a65b-6f4e-41f4-a0ac-c68f24e7fdb4 tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:44.481361 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-eb77a65b-6f4e-41f4-a0ac-c68f24e7fdb4 tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:44.488042 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c3aae25a-c378-49cb-9987-e7e5f4f2391b tempest-ServerDiagnosticsNegativeTest-417074328 tempest-ServerDiagnosticsNegativeTest-417074328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:44.488941 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c3aae25a-c378-49cb-9987-e7e5f4f2391b tempest-ServerDiagnosticsNegativeTest-417074328 tempest-ServerDiagnosticsNegativeTest-417074328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:44.493288 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c3aae25a-c378-49cb-9987-e7e5f4f2391b tempest-ServerDiagnosticsNegativeTest-417074328 tempest-ServerDiagnosticsNegativeTest-417074328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:44.494727 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c3aae25a-c378-49cb-9987-e7e5f4f2391b tempest-ServerDiagnosticsNegativeTest-417074328 tempest-ServerDiagnosticsNegativeTest-417074328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:44.495447 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c3aae25a-c378-49cb-9987-e7e5f4f2391b tempest-ServerDiagnosticsNegativeTest-417074328 tempest-ServerDiagnosticsNegativeTest-417074328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:44.496104 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c3aae25a-c378-49cb-9987-e7e5f4f2391b tempest-ServerDiagnosticsNegativeTest-417074328 tempest-ServerDiagnosticsNegativeTest-417074328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:44.677494 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-eb77a65b-6f4e-41f4-a0ac-c68f24e7fdb4 tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b786966441fc45f28890bf56cdfafb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8cc219b86ed450cbe7c780d7f79d9f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:44.693309 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-eb77a65b-6f4e-41f4-a0ac-c68f24e7fdb4 tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] 10.222.0.33 "GET /compute/v2.1/servers/7d9db253-559a-4d4b-9a5e-42c8f63f6cb7" status: 200 len: 1303 microversion: 2.1 time: 0.236217 Oct 04 20:36:44.693931 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 404/812] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:36:44 2022] GET /compute/v2.1/servers/7d9db253-559a-4d4b-9a5e-42c8f63f6cb7 => generated 1303 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:36:44.702862 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-da95b63f-d401-43a1-a868-59c7699353f7 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:44.703474 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-da95b63f-d401-43a1-a868-59c7699353f7 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] [instance: 465ad440-a27e-4ff6-bb31-09f3545e166a] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:44.718147 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-da95b63f-d401-43a1-a868-59c7699353f7 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:44.718672 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-da95b63f-d401-43a1-a868-59c7699353f7 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:44.719337 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-da95b63f-d401-43a1-a868-59c7699353f7 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:44.720412 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-da95b63f-d401-43a1-a868-59c7699353f7 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:44.721073 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-da95b63f-d401-43a1-a868-59c7699353f7 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:44.721689 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-da95b63f-d401-43a1-a868-59c7699353f7 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:44.983603 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-da95b63f-d401-43a1-a868-59c7699353f7 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3563efe2b8c94931a2a46c4e14811b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3118a5d96843d3bede1ed94bd9717e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:44.993762 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-da95b63f-d401-43a1-a868-59c7699353f7 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] 10.222.0.33 "GET /compute/v2.1/servers/465ad440-a27e-4ff6-bb31-09f3545e166a" status: 200 len: 1337 microversion: 2.1 time: 0.298746 Oct 04 20:36:44.996385 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 405/813] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:36:44 2022] GET /compute/v2.1/servers/465ad440-a27e-4ff6-bb31-09f3545e166a => generated 1337 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:36:45.008805 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-a0764130-4b7f-4bb4-a356-96c313c8b93c tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:45.009292 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c3aae25a-c378-49cb-9987-e7e5f4f2391b tempest-ServerDiagnosticsNegativeTest-417074328 tempest-ServerDiagnosticsNegativeTest-417074328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2581847c48447f5867331fb858ebb0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930bc715520746bc8a320d082e47af81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:45.011006 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-a0764130-4b7f-4bb4-a356-96c313c8b93c tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] [instance: c61a781e-96f8-4bf6-8d3d-b8c3e9c58808] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:45.029762 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a0764130-4b7f-4bb4-a356-96c313c8b93c tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:45.034735 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a0764130-4b7f-4bb4-a356-96c313c8b93c tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:45.035521 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a0764130-4b7f-4bb4-a356-96c313c8b93c tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:45.036288 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a0764130-4b7f-4bb4-a356-96c313c8b93c tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:45.036758 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a0764130-4b7f-4bb4-a356-96c313c8b93c tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:45.037945 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a0764130-4b7f-4bb4-a356-96c313c8b93c tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:45.040455 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c3aae25a-c378-49cb-9987-e7e5f4f2391b tempest-ServerDiagnosticsNegativeTest-417074328 tempest-ServerDiagnosticsNegativeTest-417074328-project] 10.222.0.33 "GET /compute/v2.1/servers/a42d2956-071d-4bad-b9a6-a0f78fcb0498" status: 200 len: 1322 microversion: 2.1 time: 0.602964 Oct 04 20:36:45.061292 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 409/814] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:36:44 2022] GET /compute/v2.1/servers/a42d2956-071d-4bad-b9a6-a0f78fcb0498 => generated 1322 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:36:45.067299 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-fddf7e8b-ff8b-46f0-9e18-1878c7968e45 tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:45.068194 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-fddf7e8b-ff8b-46f0-9e18-1878c7968e45 tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] [instance: 33bf1c5a-fbf7-4db1-b2c8-e4ab05149f25] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:45.078397 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fddf7e8b-ff8b-46f0-9e18-1878c7968e45 tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:45.081865 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fddf7e8b-ff8b-46f0-9e18-1878c7968e45 tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:45.082733 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fddf7e8b-ff8b-46f0-9e18-1878c7968e45 tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:45.083629 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fddf7e8b-ff8b-46f0-9e18-1878c7968e45 tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:45.084333 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fddf7e8b-ff8b-46f0-9e18-1878c7968e45 tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:45.084934 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fddf7e8b-ff8b-46f0-9e18-1878c7968e45 tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:45.193705 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-fddf7e8b-ff8b-46f0-9e18-1878c7968e45 tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa55ca3469648b0b1a2e1a29541c462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8659949e00dc429e8667767d0f126771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:45.204238 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-fddf7e8b-ff8b-46f0-9e18-1878c7968e45 tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] 10.222.0.33 "GET /compute/v2.1/servers/33bf1c5a-fbf7-4db1-b2c8-e4ab05149f25" status: 200 len: 1334 microversion: 2.1 time: 0.141391 Oct 04 20:36:45.206017 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 410/815] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:36:45 2022] GET /compute/v2.1/servers/33bf1c5a-fbf7-4db1-b2c8-e4ab05149f25 => generated 1334 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:36:45.284081 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-a0764130-4b7f-4bb4-a356-96c313c8b93c tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70b2a3b8a3d34ecdaab68b7f18f7788e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d53510a3a5543618f6b701827e7c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:45.295269 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-a0764130-4b7f-4bb4-a356-96c313c8b93c tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] 10.222.0.33 "GET /compute/v2.1/servers/c61a781e-96f8-4bf6-8d3d-b8c3e9c58808" status: 200 len: 1510 microversion: 2.1 time: 0.295892 Oct 04 20:36:45.311607 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 406/816] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:36:44 2022] GET /compute/v2.1/servers/c61a781e-96f8-4bf6-8d3d-b8c3e9c58808 => generated 1510 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:36:45.454174 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c134471b-22fa-44b5-b822-729d0890f7d7 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:45.455062 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c134471b-22fa-44b5-b822-729d0890f7d7 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] [instance: 9f8cc082-0a37-4123-a680-1210a90b3ca9] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:45.463200 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c134471b-22fa-44b5-b822-729d0890f7d7 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:45.463890 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c134471b-22fa-44b5-b822-729d0890f7d7 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:45.464435 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c134471b-22fa-44b5-b822-729d0890f7d7 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:45.465259 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c134471b-22fa-44b5-b822-729d0890f7d7 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:45.465985 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c134471b-22fa-44b5-b822-729d0890f7d7 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:45.467143 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c134471b-22fa-44b5-b822-729d0890f7d7 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:45.640048 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-78412c01-4aeb-478d-99c9-7fcb0822cb39 req-92e6022e-dd73-496d-bd3a-1aa117961c3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f8cc082-0a37-4123-a680-1210a90b3ca9", "name": "network-vif-plugged", "status": "completed", "tag": "b3d1f9a5-253e-4b89-ba8b-3d8135069ec1"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:36:45.674620 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-78412c01-4aeb-478d-99c9-7fcb0822cb39 req-92e6022e-dd73-496d-bd3a-1aa117961c3d service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:45.674905 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-78412c01-4aeb-478d-99c9-7fcb0822cb39 req-92e6022e-dd73-496d-bd3a-1aa117961c3d service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:45.680165 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-78412c01-4aeb-478d-99c9-7fcb0822cb39 req-92e6022e-dd73-496d-bd3a-1aa117961c3d service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:45.702768 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-78412c01-4aeb-478d-99c9-7fcb0822cb39 req-92e6022e-dd73-496d-bd3a-1aa117961c3d service nova] Creating event network-vif-plugged:b3d1f9a5-253e-4b89-ba8b-3d8135069ec1 for instance 9f8cc082-0a37-4123-a680-1210a90b3ca9 on n-h1-854823-8 Oct 04 20:36:45.711452 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-78412c01-4aeb-478d-99c9-7fcb0822cb39 req-92e6022e-dd73-496d-bd3a-1aa117961c3d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072197 Oct 04 20:36:45.713828 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 407/817] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:36:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 20:36:45.730768 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-0c2fc5da-d90e-4b9d-b6bd-7cc86cc01145 tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:45.732173 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-0c2fc5da-d90e-4b9d-b6bd-7cc86cc01145 tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] [instance: 7d9db253-559a-4d4b-9a5e-42c8f63f6cb7] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:45.739445 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell0:SELECT=12 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:36:45.741031 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:36:45.743965 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0c2fc5da-d90e-4b9d-b6bd-7cc86cc01145 tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:45.744875 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0c2fc5da-d90e-4b9d-b6bd-7cc86cc01145 tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:45.745559 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0c2fc5da-d90e-4b9d-b6bd-7cc86cc01145 tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:45.746806 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0c2fc5da-d90e-4b9d-b6bd-7cc86cc01145 tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:45.747524 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0c2fc5da-d90e-4b9d-b6bd-7cc86cc01145 tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:45.748196 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0c2fc5da-d90e-4b9d-b6bd-7cc86cc01145 tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:45.939458 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c134471b-22fa-44b5-b822-729d0890f7d7 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a24944aeb34a5ea228965be9bf4ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c288268acb30475bbc065a8f72cb21d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:45.964067 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c134471b-22fa-44b5-b822-729d0890f7d7 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] 10.222.0.33 "GET /compute/v2.1/servers/9f8cc082-0a37-4123-a680-1210a90b3ca9" status: 200 len: 1477 microversion: 2.1 time: 0.515101 Oct 04 20:36:45.981077 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 411/818] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:36:45 2022] GET /compute/v2.1/servers/9f8cc082-0a37-4123-a680-1210a90b3ca9 => generated 1477 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:36:46.026504 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f6033da1-fced-4f36-b60f-014d34d83253 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:46.028167 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f6033da1-fced-4f36-b60f-014d34d83253 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] [instance: 465ad440-a27e-4ff6-bb31-09f3545e166a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:46.041553 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f6033da1-fced-4f36-b60f-014d34d83253 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:46.043037 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f6033da1-fced-4f36-b60f-014d34d83253 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:46.044058 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f6033da1-fced-4f36-b60f-014d34d83253 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:46.046763 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f6033da1-fced-4f36-b60f-014d34d83253 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:46.048003 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f6033da1-fced-4f36-b60f-014d34d83253 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:46.048736 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f6033da1-fced-4f36-b60f-014d34d83253 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:46.103375 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-0c2fc5da-d90e-4b9d-b6bd-7cc86cc01145 tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b786966441fc45f28890bf56cdfafb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8cc219b86ed450cbe7c780d7f79d9f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:46.112254 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-0c2fc5da-d90e-4b9d-b6bd-7cc86cc01145 tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] 10.222.0.33 "GET /compute/v2.1/servers/7d9db253-559a-4d4b-9a5e-42c8f63f6cb7" status: 200 len: 1371 microversion: 2.1 time: 0.396029 Oct 04 20:36:46.113455 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 408/819] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:36:45 2022] GET /compute/v2.1/servers/7d9db253-559a-4d4b-9a5e-42c8f63f6cb7 => generated 1371 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:36:46.130090 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-64252295-7a0c-4e28-adcd-8910cca3da49 tempest-ServerDiagnosticsNegativeTest-417074328 tempest-ServerDiagnosticsNegativeTest-417074328-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:46.131145 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-64252295-7a0c-4e28-adcd-8910cca3da49 tempest-ServerDiagnosticsNegativeTest-417074328 tempest-ServerDiagnosticsNegativeTest-417074328-project] [instance: a42d2956-071d-4bad-b9a6-a0f78fcb0498] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:46.142536 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-64252295-7a0c-4e28-adcd-8910cca3da49 tempest-ServerDiagnosticsNegativeTest-417074328 tempest-ServerDiagnosticsNegativeTest-417074328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:46.146517 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-64252295-7a0c-4e28-adcd-8910cca3da49 tempest-ServerDiagnosticsNegativeTest-417074328 tempest-ServerDiagnosticsNegativeTest-417074328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:46.147186 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-64252295-7a0c-4e28-adcd-8910cca3da49 tempest-ServerDiagnosticsNegativeTest-417074328 tempest-ServerDiagnosticsNegativeTest-417074328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:46.148158 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-64252295-7a0c-4e28-adcd-8910cca3da49 tempest-ServerDiagnosticsNegativeTest-417074328 tempest-ServerDiagnosticsNegativeTest-417074328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:46.150242 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-64252295-7a0c-4e28-adcd-8910cca3da49 tempest-ServerDiagnosticsNegativeTest-417074328 tempest-ServerDiagnosticsNegativeTest-417074328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:46.153615 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-64252295-7a0c-4e28-adcd-8910cca3da49 tempest-ServerDiagnosticsNegativeTest-417074328 tempest-ServerDiagnosticsNegativeTest-417074328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:46.357563 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f6033da1-fced-4f36-b60f-014d34d83253 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3563efe2b8c94931a2a46c4e14811b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3118a5d96843d3bede1ed94bd9717e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:46.367244 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f6033da1-fced-4f36-b60f-014d34d83253 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] 10.222.0.33 "GET /compute/v2.1/servers/465ad440-a27e-4ff6-bb31-09f3545e166a" status: 200 len: 1337 microversion: 2.1 time: 0.346986 Oct 04 20:36:46.371596 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 412/820] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:36:46 2022] GET /compute/v2.1/servers/465ad440-a27e-4ff6-bb31-09f3545e166a => generated 1337 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:36:46.385405 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ffc78815-a7c2-41d0-96e9-936922791082 tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:46.386266 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ffc78815-a7c2-41d0-96e9-936922791082 tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] [instance: 33bf1c5a-fbf7-4db1-b2c8-e4ab05149f25] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:46.401222 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ffc78815-a7c2-41d0-96e9-936922791082 tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:46.401982 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ffc78815-a7c2-41d0-96e9-936922791082 tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:46.403314 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ffc78815-a7c2-41d0-96e9-936922791082 tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:46.408028 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ffc78815-a7c2-41d0-96e9-936922791082 tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:46.409565 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ffc78815-a7c2-41d0-96e9-936922791082 tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:46.412232 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ffc78815-a7c2-41d0-96e9-936922791082 tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:46.582283 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-ffc78815-a7c2-41d0-96e9-936922791082 tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa55ca3469648b0b1a2e1a29541c462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8659949e00dc429e8667767d0f126771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:46.594277 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ffc78815-a7c2-41d0-96e9-936922791082 tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] 10.222.0.33 "GET /compute/v2.1/servers/33bf1c5a-fbf7-4db1-b2c8-e4ab05149f25" status: 200 len: 1334 microversion: 2.1 time: 0.218639 Oct 04 20:36:46.596550 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 413/821] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:36:46 2022] GET /compute/v2.1/servers/33bf1c5a-fbf7-4db1-b2c8-e4ab05149f25 => generated 1334 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:36:46.597996 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-64252295-7a0c-4e28-adcd-8910cca3da49 tempest-ServerDiagnosticsNegativeTest-417074328 tempest-ServerDiagnosticsNegativeTest-417074328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2581847c48447f5867331fb858ebb0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930bc715520746bc8a320d082e47af81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:46.605664 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f8276495-3be0-4eaf-b340-b5f3094b83ac tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:46.610641 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f8276495-3be0-4eaf-b340-b5f3094b83ac tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] [instance: c61a781e-96f8-4bf6-8d3d-b8c3e9c58808] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:46.615726 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-64252295-7a0c-4e28-adcd-8910cca3da49 tempest-ServerDiagnosticsNegativeTest-417074328 tempest-ServerDiagnosticsNegativeTest-417074328-project] 10.222.0.33 "GET /compute/v2.1/servers/a42d2956-071d-4bad-b9a6-a0f78fcb0498" status: 200 len: 1322 microversion: 2.1 time: 0.492724 Oct 04 20:36:46.626189 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f8276495-3be0-4eaf-b340-b5f3094b83ac tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:46.626790 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 409/822] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:36:46 2022] GET /compute/v2.1/servers/a42d2956-071d-4bad-b9a6-a0f78fcb0498 => generated 1322 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:36:46.636658 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f8276495-3be0-4eaf-b340-b5f3094b83ac tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:46.636658 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f8276495-3be0-4eaf-b340-b5f3094b83ac tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:46.636658 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f8276495-3be0-4eaf-b340-b5f3094b83ac tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:46.636658 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f8276495-3be0-4eaf-b340-b5f3094b83ac tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:46.637003 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f8276495-3be0-4eaf-b340-b5f3094b83ac tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:46.991556 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-b534e498-1d70-4ca7-90dc-b8fe25657b5a tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:46.992341 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-b534e498-1d70-4ca7-90dc-b8fe25657b5a tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] [instance: 9f8cc082-0a37-4123-a680-1210a90b3ca9] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:47.013541 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b534e498-1d70-4ca7-90dc-b8fe25657b5a tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:47.019578 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b534e498-1d70-4ca7-90dc-b8fe25657b5a tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:47.020254 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b534e498-1d70-4ca7-90dc-b8fe25657b5a tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:47.021319 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b534e498-1d70-4ca7-90dc-b8fe25657b5a tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:47.025563 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b534e498-1d70-4ca7-90dc-b8fe25657b5a tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:47.026756 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b534e498-1d70-4ca7-90dc-b8fe25657b5a tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:47.133384 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f8276495-3be0-4eaf-b340-b5f3094b83ac tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70b2a3b8a3d34ecdaab68b7f18f7788e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d53510a3a5543618f6b701827e7c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:47.150104 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f8276495-3be0-4eaf-b340-b5f3094b83ac tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] 10.222.0.33 "GET /compute/v2.1/servers/c61a781e-96f8-4bf6-8d3d-b8c3e9c58808" status: 200 len: 1510 microversion: 2.1 time: 0.552166 Oct 04 20:36:47.150987 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 414/823] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:36:46 2022] GET /compute/v2.1/servers/c61a781e-96f8-4bf6-8d3d-b8c3e9c58808 => generated 1510 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:36:47.168085 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-80d542d1-c882-4b56-9ced-fe23030a9cdb tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:47.175321 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-80d542d1-c882-4b56-9ced-fe23030a9cdb tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] [instance: 7d9db253-559a-4d4b-9a5e-42c8f63f6cb7] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:47.187174 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-80d542d1-c882-4b56-9ced-fe23030a9cdb tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:47.191158 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-80d542d1-c882-4b56-9ced-fe23030a9cdb tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:47.191790 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-80d542d1-c882-4b56-9ced-fe23030a9cdb tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:47.192700 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-80d542d1-c882-4b56-9ced-fe23030a9cdb tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:47.193992 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-80d542d1-c882-4b56-9ced-fe23030a9cdb tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:47.195990 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-80d542d1-c882-4b56-9ced-fe23030a9cdb tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:48.521695 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-b534e498-1d70-4ca7-90dc-b8fe25657b5a tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a24944aeb34a5ea228965be9bf4ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c288268acb30475bbc065a8f72cb21d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:48.543172 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-b534e498-1d70-4ca7-90dc-b8fe25657b5a tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] 10.222.0.33 "GET /compute/v2.1/servers/9f8cc082-0a37-4123-a680-1210a90b3ca9" status: 200 len: 1477 microversion: 2.1 time: 1.553997 Oct 04 20:36:48.544364 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 410/824] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:36:46 2022] GET /compute/v2.1/servers/9f8cc082-0a37-4123-a680-1210a90b3ca9 => generated 1477 bytes in 1558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:36:48.559372 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-ef073365-924e-42cb-8996-8779a42a37d2 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:48.563135 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-ef073365-924e-42cb-8996-8779a42a37d2 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] [instance: 465ad440-a27e-4ff6-bb31-09f3545e166a] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:48.594557 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ef073365-924e-42cb-8996-8779a42a37d2 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:48.599158 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ef073365-924e-42cb-8996-8779a42a37d2 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:48.601764 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ef073365-924e-42cb-8996-8779a42a37d2 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:48.616288 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ef073365-924e-42cb-8996-8779a42a37d2 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:48.618293 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ef073365-924e-42cb-8996-8779a42a37d2 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:48.621826 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ef073365-924e-42cb-8996-8779a42a37d2 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:48.950962 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=4 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:36:49.042384 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=5 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:36:49.173471 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-80d542d1-c882-4b56-9ced-fe23030a9cdb tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b786966441fc45f28890bf56cdfafb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8cc219b86ed450cbe7c780d7f79d9f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:49.207170 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-80d542d1-c882-4b56-9ced-fe23030a9cdb tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] 10.222.0.33 "GET /compute/v2.1/servers/7d9db253-559a-4d4b-9a5e-42c8f63f6cb7" status: 200 len: 1371 microversion: 2.1 time: 2.040225 Oct 04 20:36:49.211335 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 415/825] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:36:47 2022] GET /compute/v2.1/servers/7d9db253-559a-4d4b-9a5e-42c8f63f6cb7 => generated 1371 bytes in 2051 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:36:49.235621 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-aab18995-38ee-4489-bde3-461346c6bc13 tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:49.236441 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-aab18995-38ee-4489-bde3-461346c6bc13 tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] [instance: 33bf1c5a-fbf7-4db1-b2c8-e4ab05149f25] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:49.252033 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-aab18995-38ee-4489-bde3-461346c6bc13 tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:49.253223 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-aab18995-38ee-4489-bde3-461346c6bc13 tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:49.253947 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-aab18995-38ee-4489-bde3-461346c6bc13 tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:49.256305 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-aab18995-38ee-4489-bde3-461346c6bc13 tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:49.257222 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-aab18995-38ee-4489-bde3-461346c6bc13 tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:49.258048 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-aab18995-38ee-4489-bde3-461346c6bc13 tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:49.706996 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-aab18995-38ee-4489-bde3-461346c6bc13 tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa55ca3469648b0b1a2e1a29541c462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8659949e00dc429e8667767d0f126771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:49.717596 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-aab18995-38ee-4489-bde3-461346c6bc13 tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] 10.222.0.33 "GET /compute/v2.1/servers/33bf1c5a-fbf7-4db1-b2c8-e4ab05149f25" status: 200 len: 1334 microversion: 2.1 time: 0.501435 Oct 04 20:36:49.732146 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 416/826] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:36:49 2022] GET /compute/v2.1/servers/33bf1c5a-fbf7-4db1-b2c8-e4ab05149f25 => generated 1334 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:36:49.751804 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-233445dc-c4dd-454a-acae-d496391018bb tempest-ServerDiagnosticsNegativeTest-417074328 tempest-ServerDiagnosticsNegativeTest-417074328-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:49.752485 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-233445dc-c4dd-454a-acae-d496391018bb tempest-ServerDiagnosticsNegativeTest-417074328 tempest-ServerDiagnosticsNegativeTest-417074328-project] [instance: a42d2956-071d-4bad-b9a6-a0f78fcb0498] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:49.769802 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-233445dc-c4dd-454a-acae-d496391018bb tempest-ServerDiagnosticsNegativeTest-417074328 tempest-ServerDiagnosticsNegativeTest-417074328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:49.770301 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-233445dc-c4dd-454a-acae-d496391018bb tempest-ServerDiagnosticsNegativeTest-417074328 tempest-ServerDiagnosticsNegativeTest-417074328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:49.772031 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-233445dc-c4dd-454a-acae-d496391018bb tempest-ServerDiagnosticsNegativeTest-417074328 tempest-ServerDiagnosticsNegativeTest-417074328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:49.772360 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-233445dc-c4dd-454a-acae-d496391018bb tempest-ServerDiagnosticsNegativeTest-417074328 tempest-ServerDiagnosticsNegativeTest-417074328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:49.773094 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-233445dc-c4dd-454a-acae-d496391018bb tempest-ServerDiagnosticsNegativeTest-417074328 tempest-ServerDiagnosticsNegativeTest-417074328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:49.773525 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-233445dc-c4dd-454a-acae-d496391018bb tempest-ServerDiagnosticsNegativeTest-417074328 tempest-ServerDiagnosticsNegativeTest-417074328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:50.113214 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell0:SELECT=27 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:36:50.266511 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-ef073365-924e-42cb-8996-8779a42a37d2 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3563efe2b8c94931a2a46c4e14811b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3118a5d96843d3bede1ed94bd9717e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:50.302746 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-ef073365-924e-42cb-8996-8779a42a37d2 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] 10.222.0.33 "GET /compute/v2.1/servers/465ad440-a27e-4ff6-bb31-09f3545e166a" status: 200 len: 1379 microversion: 2.1 time: 1.755472 Oct 04 20:36:50.323466 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 411/827] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:36:48 2022] GET /compute/v2.1/servers/465ad440-a27e-4ff6-bb31-09f3545e166a => generated 1379 bytes in 1778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:36:50.350368 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-f86658e5-9d6d-4a90-b016-68c3f1128c8b tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:50.352866 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-f86658e5-9d6d-4a90-b016-68c3f1128c8b tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] [instance: c61a781e-96f8-4bf6-8d3d-b8c3e9c58808] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:50.375283 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f86658e5-9d6d-4a90-b016-68c3f1128c8b tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:50.376239 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f86658e5-9d6d-4a90-b016-68c3f1128c8b tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:50.377561 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f86658e5-9d6d-4a90-b016-68c3f1128c8b tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:50.379222 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f86658e5-9d6d-4a90-b016-68c3f1128c8b tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:50.380127 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f86658e5-9d6d-4a90-b016-68c3f1128c8b tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:50.382578 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f86658e5-9d6d-4a90-b016-68c3f1128c8b tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:50.728169 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-233445dc-c4dd-454a-acae-d496391018bb tempest-ServerDiagnosticsNegativeTest-417074328 tempest-ServerDiagnosticsNegativeTest-417074328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2581847c48447f5867331fb858ebb0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930bc715520746bc8a320d082e47af81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:50.757391 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-233445dc-c4dd-454a-acae-d496391018bb tempest-ServerDiagnosticsNegativeTest-417074328 tempest-ServerDiagnosticsNegativeTest-417074328-project] 10.222.0.33 "GET /compute/v2.1/servers/a42d2956-071d-4bad-b9a6-a0f78fcb0498" status: 200 len: 1322 microversion: 2.1 time: 1.007192 Oct 04 20:36:50.758969 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 417/828] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:36:49 2022] GET /compute/v2.1/servers/a42d2956-071d-4bad-b9a6-a0f78fcb0498 => generated 1322 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:36:50.792997 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-084b6f19-1655-4de2-aa22-1209a0c9edc7 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:50.793629 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-084b6f19-1655-4de2-aa22-1209a0c9edc7 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] [instance: 9f8cc082-0a37-4123-a680-1210a90b3ca9] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:50.820619 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-084b6f19-1655-4de2-aa22-1209a0c9edc7 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:50.825990 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-084b6f19-1655-4de2-aa22-1209a0c9edc7 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:50.829133 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-084b6f19-1655-4de2-aa22-1209a0c9edc7 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:50.841213 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-084b6f19-1655-4de2-aa22-1209a0c9edc7 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:50.843141 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-084b6f19-1655-4de2-aa22-1209a0c9edc7 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:50.844751 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-084b6f19-1655-4de2-aa22-1209a0c9edc7 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:51.760065 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-f86658e5-9d6d-4a90-b016-68c3f1128c8b tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70b2a3b8a3d34ecdaab68b7f18f7788e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d53510a3a5543618f6b701827e7c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:51.799598 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-f86658e5-9d6d-4a90-b016-68c3f1128c8b tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] 10.222.0.33 "GET /compute/v2.1/servers/c61a781e-96f8-4bf6-8d3d-b8c3e9c58808" status: 200 len: 1510 microversion: 2.1 time: 1.470664 Oct 04 20:36:51.804902 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 412/829] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:36:50 2022] GET /compute/v2.1/servers/c61a781e-96f8-4bf6-8d3d-b8c3e9c58808 => generated 1510 bytes in 1481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:36:51.825547 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-784a44b5-6fc7-4823-aa4e-7696a71866b0 tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:51.827490 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-784a44b5-6fc7-4823-aa4e-7696a71866b0 tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] [instance: 7d9db253-559a-4d4b-9a5e-42c8f63f6cb7] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:51.849489 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-784a44b5-6fc7-4823-aa4e-7696a71866b0 tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:51.851314 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-784a44b5-6fc7-4823-aa4e-7696a71866b0 tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:51.853464 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-784a44b5-6fc7-4823-aa4e-7696a71866b0 tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:51.856008 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-784a44b5-6fc7-4823-aa4e-7696a71866b0 tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:51.856819 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-084b6f19-1655-4de2-aa22-1209a0c9edc7 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a24944aeb34a5ea228965be9bf4ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c288268acb30475bbc065a8f72cb21d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:51.857467 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-784a44b5-6fc7-4823-aa4e-7696a71866b0 tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:51.857887 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-784a44b5-6fc7-4823-aa4e-7696a71866b0 tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:51.878686 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-084b6f19-1655-4de2-aa22-1209a0c9edc7 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] 10.222.0.33 "GET /compute/v2.1/servers/9f8cc082-0a37-4123-a680-1210a90b3ca9" status: 200 len: 1477 microversion: 2.1 time: 1.117391 Oct 04 20:36:51.883535 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 418/830] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:36:50 2022] GET /compute/v2.1/servers/9f8cc082-0a37-4123-a680-1210a90b3ca9 => generated 1477 bytes in 1122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:36:51.912714 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-093234c9-3581-43b8-9b4a-7dfa86883a35 req-00f42ee8-29b4-491c-bcf9-ce0214cb6d42 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "465ad440-a27e-4ff6-bb31-09f3545e166a", "tag": "c16cb04f-6af6-4073-98de-ed8d89a2e3c2"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:36:51.941450 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-093234c9-3581-43b8-9b4a-7dfa86883a35 req-00f42ee8-29b4-491c-bcf9-ce0214cb6d42 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:51.944570 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-093234c9-3581-43b8-9b4a-7dfa86883a35 req-00f42ee8-29b4-491c-bcf9-ce0214cb6d42 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:51.948903 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-093234c9-3581-43b8-9b4a-7dfa86883a35 req-00f42ee8-29b4-491c-bcf9-ce0214cb6d42 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:52.016287 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-093234c9-3581-43b8-9b4a-7dfa86883a35 req-00f42ee8-29b4-491c-bcf9-ce0214cb6d42 service nova] Creating event network-changed:c16cb04f-6af6-4073-98de-ed8d89a2e3c2 for instance 465ad440-a27e-4ff6-bb31-09f3545e166a on n-h2-854823-8 Oct 04 20:36:52.046657 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-093234c9-3581-43b8-9b4a-7dfa86883a35 req-00f42ee8-29b4-491c-bcf9-ce0214cb6d42 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.155121 Oct 04 20:36:52.048209 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 419/831] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:36:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:36:52.076114 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-cae29953-9296-4dd5-8ed9-7f5fd77eb6ad tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:52.078318 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-cae29953-9296-4dd5-8ed9-7f5fd77eb6ad tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] [instance: 33bf1c5a-fbf7-4db1-b2c8-e4ab05149f25] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:52.123148 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cae29953-9296-4dd5-8ed9-7f5fd77eb6ad tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:52.129561 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cae29953-9296-4dd5-8ed9-7f5fd77eb6ad tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:52.134213 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cae29953-9296-4dd5-8ed9-7f5fd77eb6ad tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:52.146040 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cae29953-9296-4dd5-8ed9-7f5fd77eb6ad tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:52.148173 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cae29953-9296-4dd5-8ed9-7f5fd77eb6ad tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:52.149086 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cae29953-9296-4dd5-8ed9-7f5fd77eb6ad tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:52.913667 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-784a44b5-6fc7-4823-aa4e-7696a71866b0 tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b786966441fc45f28890bf56cdfafb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8cc219b86ed450cbe7c780d7f79d9f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:52.927211 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-784a44b5-6fc7-4823-aa4e-7696a71866b0 tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] 10.222.0.33 "GET /compute/v2.1/servers/7d9db253-559a-4d4b-9a5e-42c8f63f6cb7" status: 200 len: 1371 microversion: 2.1 time: 1.120367 Oct 04 20:36:52.929706 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 413/832] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:36:51 2022] GET /compute/v2.1/servers/7d9db253-559a-4d4b-9a5e-42c8f63f6cb7 => generated 1371 bytes in 1124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:36:52.947843 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-da9b4698-7b78-4062-9255-898756965bd2 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:52.951131 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-da9b4698-7b78-4062-9255-898756965bd2 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] [instance: 465ad440-a27e-4ff6-bb31-09f3545e166a] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:52.968266 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-da9b4698-7b78-4062-9255-898756965bd2 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:52.973908 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-da9b4698-7b78-4062-9255-898756965bd2 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:52.975392 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-da9b4698-7b78-4062-9255-898756965bd2 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:52.976651 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-da9b4698-7b78-4062-9255-898756965bd2 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:52.977900 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-da9b4698-7b78-4062-9255-898756965bd2 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:52.978598 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-da9b4698-7b78-4062-9255-898756965bd2 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:52.983945 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-cae29953-9296-4dd5-8ed9-7f5fd77eb6ad tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa55ca3469648b0b1a2e1a29541c462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8659949e00dc429e8667767d0f126771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:52.999685 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-cae29953-9296-4dd5-8ed9-7f5fd77eb6ad tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] 10.222.0.33 "GET /compute/v2.1/servers/33bf1c5a-fbf7-4db1-b2c8-e4ab05149f25" status: 200 len: 1402 microversion: 2.1 time: 0.950144 Oct 04 20:36:53.001303 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 420/833] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:36:52 2022] GET /compute/v2.1/servers/33bf1c5a-fbf7-4db1-b2c8-e4ab05149f25 => generated 1402 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:36:53.008542 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-a4e90935-808c-4e8d-a025-ef5300a522a3 req-345c6a2a-a631-4b74-b39b-d21ac8f9cfdb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a42d2956-071d-4bad-b9a6-a0f78fcb0498", "name": "network-vif-plugged", "status": "completed", "tag": "8a587d76-a9ec-4db5-9ae4-ccae7d195099"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:36:53.026789 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-a4e90935-808c-4e8d-a025-ef5300a522a3 req-345c6a2a-a631-4b74-b39b-d21ac8f9cfdb service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:53.028046 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-a4e90935-808c-4e8d-a025-ef5300a522a3 req-345c6a2a-a631-4b74-b39b-d21ac8f9cfdb service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:53.028811 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-a4e90935-808c-4e8d-a025-ef5300a522a3 req-345c6a2a-a631-4b74-b39b-d21ac8f9cfdb service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:53.093381 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-a4e90935-808c-4e8d-a025-ef5300a522a3 req-345c6a2a-a631-4b74-b39b-d21ac8f9cfdb service nova] Creating event network-vif-plugged:8a587d76-a9ec-4db5-9ae4-ccae7d195099 for instance a42d2956-071d-4bad-b9a6-a0f78fcb0498 on n-h2-854823-8 Oct 04 20:36:53.103882 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-a4e90935-808c-4e8d-a025-ef5300a522a3 req-345c6a2a-a631-4b74-b39b-d21ac8f9cfdb service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097880 Oct 04 20:36:53.104512 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 421/834] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:36:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:36:53.330211 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-679db76c-948a-4bbe-bce2-98dff5de100a tempest-HostsAdminTestJSON-964808243 tempest-HostsAdminTestJSON-964808243-project-admin] Calling method '.version_select at 0x7f3c74efa550>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:53.364487 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-679db76c-948a-4bbe-bce2-98dff5de100a tempest-HostsAdminTestJSON-964808243 tempest-HostsAdminTestJSON-964808243-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:53.365889 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-679db76c-948a-4bbe-bce2-98dff5de100a tempest-HostsAdminTestJSON-964808243 tempest-HostsAdminTestJSON-964808243-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:53.379255 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-679db76c-948a-4bbe-bce2-98dff5de100a tempest-HostsAdminTestJSON-964808243 tempest-HostsAdminTestJSON-964808243-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:53.382694 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-679db76c-948a-4bbe-bce2-98dff5de100a tempest-HostsAdminTestJSON-964808243 tempest-HostsAdminTestJSON-964808243-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:53.383494 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-679db76c-948a-4bbe-bce2-98dff5de100a tempest-HostsAdminTestJSON-964808243 tempest-HostsAdminTestJSON-964808243-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:53.384495 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-679db76c-948a-4bbe-bce2-98dff5de100a tempest-HostsAdminTestJSON-964808243 tempest-HostsAdminTestJSON-964808243-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:53.401157 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=100 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:36:53.427984 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-679db76c-948a-4bbe-bce2-98dff5de100a tempest-HostsAdminTestJSON-964808243 tempest-HostsAdminTestJSON-964808243-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.322023 Oct 04 20:36:53.429822 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 422/835] 10.222.0.33 () {58 vars in 1128 bytes} [Tue Oct 4 20:36:53 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:36:53.441282 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2fbb0228-1a9d-429c-b567-da49b59f54ad tempest-ServerDiagnosticsNegativeTest-417074328 tempest-ServerDiagnosticsNegativeTest-417074328-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:53.442143 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-2fbb0228-1a9d-429c-b567-da49b59f54ad tempest-ServerDiagnosticsNegativeTest-417074328 tempest-ServerDiagnosticsNegativeTest-417074328-project] [instance: a42d2956-071d-4bad-b9a6-a0f78fcb0498] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:53.452767 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2fbb0228-1a9d-429c-b567-da49b59f54ad tempest-ServerDiagnosticsNegativeTest-417074328 tempest-ServerDiagnosticsNegativeTest-417074328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:53.453503 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2fbb0228-1a9d-429c-b567-da49b59f54ad tempest-ServerDiagnosticsNegativeTest-417074328 tempest-ServerDiagnosticsNegativeTest-417074328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:53.453972 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-da9b4698-7b78-4062-9255-898756965bd2 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3563efe2b8c94931a2a46c4e14811b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3118a5d96843d3bede1ed94bd9717e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:53.454492 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2fbb0228-1a9d-429c-b567-da49b59f54ad tempest-ServerDiagnosticsNegativeTest-417074328 tempest-ServerDiagnosticsNegativeTest-417074328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:53.455463 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2fbb0228-1a9d-429c-b567-da49b59f54ad tempest-ServerDiagnosticsNegativeTest-417074328 tempest-ServerDiagnosticsNegativeTest-417074328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:53.456076 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2fbb0228-1a9d-429c-b567-da49b59f54ad tempest-ServerDiagnosticsNegativeTest-417074328 tempest-ServerDiagnosticsNegativeTest-417074328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:53.456878 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2fbb0228-1a9d-429c-b567-da49b59f54ad tempest-ServerDiagnosticsNegativeTest-417074328 tempest-ServerDiagnosticsNegativeTest-417074328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:53.463516 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-da9b4698-7b78-4062-9255-898756965bd2 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] 10.222.0.33 "GET /compute/v2.1/servers/465ad440-a27e-4ff6-bb31-09f3545e166a" status: 200 len: 1379 microversion: 2.1 time: 0.531154 Oct 04 20:36:53.468530 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 414/836] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:36:52 2022] GET /compute/v2.1/servers/465ad440-a27e-4ff6-bb31-09f3545e166a => generated 1379 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:36:53.473682 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-a893210e-ab2f-46c4-8717-fe8b45aa7a4f req-7f90dc64-d429-4945-bdc9-43115524af81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c61a781e-96f8-4bf6-8d3d-b8c3e9c58808", "name": "network-vif-deleted", "tag": "e4cddadd-318e-45b2-a470-85ddf6901196"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:36:53.500361 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-a893210e-ab2f-46c4-8717-fe8b45aa7a4f req-7f90dc64-d429-4945-bdc9-43115524af81 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:53.501062 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-a893210e-ab2f-46c4-8717-fe8b45aa7a4f req-7f90dc64-d429-4945-bdc9-43115524af81 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:53.501651 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-a893210e-ab2f-46c4-8717-fe8b45aa7a4f req-7f90dc64-d429-4945-bdc9-43115524af81 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:53.516669 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-a893210e-ab2f-46c4-8717-fe8b45aa7a4f req-7f90dc64-d429-4945-bdc9-43115524af81 service nova] Creating event network-vif-deleted:e4cddadd-318e-45b2-a470-85ddf6901196 for instance c61a781e-96f8-4bf6-8d3d-b8c3e9c58808 on n-h1-854823-8 Oct 04 20:36:53.523692 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-a893210e-ab2f-46c4-8717-fe8b45aa7a4f req-7f90dc64-d429-4945-bdc9-43115524af81 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053495 Oct 04 20:36:53.524303 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 415/837] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:36:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:36:53.531738 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-9f20bf12-dfeb-4a75-8f5f-cdd3c24e6c6a tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:53.532682 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-9f20bf12-dfeb-4a75-8f5f-cdd3c24e6c6a tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] [instance: c61a781e-96f8-4bf6-8d3d-b8c3e9c58808] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:53.539960 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9f20bf12-dfeb-4a75-8f5f-cdd3c24e6c6a tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:53.540589 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9f20bf12-dfeb-4a75-8f5f-cdd3c24e6c6a tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:53.541113 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9f20bf12-dfeb-4a75-8f5f-cdd3c24e6c6a tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:53.542386 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9f20bf12-dfeb-4a75-8f5f-cdd3c24e6c6a tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:53.542386 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9f20bf12-dfeb-4a75-8f5f-cdd3c24e6c6a tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:53.542860 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9f20bf12-dfeb-4a75-8f5f-cdd3c24e6c6a tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:53.576830 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9f20bf12-dfeb-4a75-8f5f-cdd3c24e6c6a tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:53.577422 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9f20bf12-dfeb-4a75-8f5f-cdd3c24e6c6a tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:53.577922 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9f20bf12-dfeb-4a75-8f5f-cdd3c24e6c6a tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:53.578482 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.objects.instance [None req-9f20bf12-dfeb-4a75-8f5f-cdd3c24e6c6a tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] Lazy-loading 'fault' on Instance uuid c61a781e-96f8-4bf6-8d3d-b8c3e9c58808 {{(pid=128802) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:36:53.655499 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-9f20bf12-dfeb-4a75-8f5f-cdd3c24e6c6a tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70b2a3b8a3d34ecdaab68b7f18f7788e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d53510a3a5543618f6b701827e7c365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:53.666194 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-9f20bf12-dfeb-4a75-8f5f-cdd3c24e6c6a tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] 10.222.0.33 "GET /compute/v2.1/servers/c61a781e-96f8-4bf6-8d3d-b8c3e9c58808" status: 200 len: 1305 microversion: 2.1 time: 0.140557 Oct 04 20:36:53.666806 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 416/838] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:36:53 2022] GET /compute/v2.1/servers/c61a781e-96f8-4bf6-8d3d-b8c3e9c58808 => generated 1305 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:36:53.671908 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-95ee99cc-f207-4bb0-8dea-bd3da30e3797 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:53.672695 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-95ee99cc-f207-4bb0-8dea-bd3da30e3797 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] [instance: 9f8cc082-0a37-4123-a680-1210a90b3ca9] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:53.689022 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-95ee99cc-f207-4bb0-8dea-bd3da30e3797 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:53.692546 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-95ee99cc-f207-4bb0-8dea-bd3da30e3797 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:53.693309 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-95ee99cc-f207-4bb0-8dea-bd3da30e3797 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:53.694913 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-95ee99cc-f207-4bb0-8dea-bd3da30e3797 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:53.696080 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-95ee99cc-f207-4bb0-8dea-bd3da30e3797 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:53.696676 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-95ee99cc-f207-4bb0-8dea-bd3da30e3797 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:53.846551 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-2fbb0228-1a9d-429c-b567-da49b59f54ad tempest-ServerDiagnosticsNegativeTest-417074328 tempest-ServerDiagnosticsNegativeTest-417074328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2581847c48447f5867331fb858ebb0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930bc715520746bc8a320d082e47af81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:53.856515 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-2fbb0228-1a9d-429c-b567-da49b59f54ad tempest-ServerDiagnosticsNegativeTest-417074328 tempest-ServerDiagnosticsNegativeTest-417074328-project] 10.222.0.33 "GET /compute/v2.1/servers/a42d2956-071d-4bad-b9a6-a0f78fcb0498" status: 200 len: 1322 microversion: 2.1 time: 0.425214 Oct 04 20:36:53.857353 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 423/839] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:36:53 2022] GET /compute/v2.1/servers/a42d2956-071d-4bad-b9a6-a0f78fcb0498 => generated 1322 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:36:53.861948 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1bc24db0-1a9f-48a8-9d14-3e3a3c5a9ec6 tempest-HostsAdminTestJSON-964808243 tempest-HostsAdminTestJSON-964808243-project-admin] Calling method '.version_select at 0x7f3c74bc1040>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:53.866026 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1bc24db0-1a9f-48a8-9d14-3e3a3c5a9ec6 tempest-HostsAdminTestJSON-964808243 tempest-HostsAdminTestJSON-964808243-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:53.866691 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1bc24db0-1a9f-48a8-9d14-3e3a3c5a9ec6 tempest-HostsAdminTestJSON-964808243 tempest-HostsAdminTestJSON-964808243-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:53.867364 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1bc24db0-1a9f-48a8-9d14-3e3a3c5a9ec6 tempest-HostsAdminTestJSON-964808243 tempest-HostsAdminTestJSON-964808243-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:53.868182 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1bc24db0-1a9f-48a8-9d14-3e3a3c5a9ec6 tempest-HostsAdminTestJSON-964808243 tempest-HostsAdminTestJSON-964808243-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:53.868831 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1bc24db0-1a9f-48a8-9d14-3e3a3c5a9ec6 tempest-HostsAdminTestJSON-964808243 tempest-HostsAdminTestJSON-964808243-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:53.869515 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1bc24db0-1a9f-48a8-9d14-3e3a3c5a9ec6 tempest-HostsAdminTestJSON-964808243 tempest-HostsAdminTestJSON-964808243-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:53.893265 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-1bc24db0-1a9f-48a8-9d14-3e3a3c5a9ec6 tempest-HostsAdminTestJSON-964808243 tempest-HostsAdminTestJSON-964808243-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hosts?zone=" status: 200 len: 376 microversion: 2.1 time: 0.034642 Oct 04 20:36:53.894040 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 424/840] 10.222.0.33 () {58 vars in 1139 bytes} [Tue Oct 4 20:36:53 2022] GET /compute/v2.1/os-hosts?zone= => generated 376 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:36:53.906181 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b96b2895-1bf8-4507-ac8a-f1d83c8f1eab tempest-HostsAdminTestJSON-964808243 tempest-HostsAdminTestJSON-964808243-project-admin] Calling method '.version_select at 0x7f3c749acee0>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:53.910332 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b96b2895-1bf8-4507-ac8a-f1d83c8f1eab tempest-HostsAdminTestJSON-964808243 tempest-HostsAdminTestJSON-964808243-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:53.911082 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b96b2895-1bf8-4507-ac8a-f1d83c8f1eab tempest-HostsAdminTestJSON-964808243 tempest-HostsAdminTestJSON-964808243-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:53.911737 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b96b2895-1bf8-4507-ac8a-f1d83c8f1eab tempest-HostsAdminTestJSON-964808243 tempest-HostsAdminTestJSON-964808243-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:53.913259 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b96b2895-1bf8-4507-ac8a-f1d83c8f1eab tempest-HostsAdminTestJSON-964808243 tempest-HostsAdminTestJSON-964808243-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:53.913896 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b96b2895-1bf8-4507-ac8a-f1d83c8f1eab tempest-HostsAdminTestJSON-964808243 tempest-HostsAdminTestJSON-964808243-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:53.914322 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b96b2895-1bf8-4507-ac8a-f1d83c8f1eab tempest-HostsAdminTestJSON-964808243 tempest-HostsAdminTestJSON-964808243-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:53.938897 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b96b2895-1bf8-4507-ac8a-f1d83c8f1eab tempest-HostsAdminTestJSON-964808243 tempest-HostsAdminTestJSON-964808243-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hosts?zone=xxx" status: 200 len: 13 microversion: 2.1 time: 0.036274 Oct 04 20:36:53.939885 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 425/841] 10.222.0.33 () {58 vars in 1145 bytes} [Tue Oct 4 20:36:53 2022] GET /compute/v2.1/os-hosts?zone=xxx => generated 13 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 20:36:53.951971 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-507869cb-196f-4933-ab71-ea0700675d37 tempest-HostsAdminTestJSON-964808243 tempest-HostsAdminTestJSON-964808243-project-admin] Calling method '.version_select at 0x7f3c74f43700>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:53.956003 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-507869cb-196f-4933-ab71-ea0700675d37 tempest-HostsAdminTestJSON-964808243 tempest-HostsAdminTestJSON-964808243-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:53.956716 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-507869cb-196f-4933-ab71-ea0700675d37 tempest-HostsAdminTestJSON-964808243 tempest-HostsAdminTestJSON-964808243-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:53.957138 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-507869cb-196f-4933-ab71-ea0700675d37 tempest-HostsAdminTestJSON-964808243 tempest-HostsAdminTestJSON-964808243-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:53.958145 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-507869cb-196f-4933-ab71-ea0700675d37 tempest-HostsAdminTestJSON-964808243 tempest-HostsAdminTestJSON-964808243-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:53.959664 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-507869cb-196f-4933-ab71-ea0700675d37 tempest-HostsAdminTestJSON-964808243 tempest-HostsAdminTestJSON-964808243-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:53.960251 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-507869cb-196f-4933-ab71-ea0700675d37 tempest-HostsAdminTestJSON-964808243 tempest-HostsAdminTestJSON-964808243-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:53.970503 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-95ee99cc-f207-4bb0-8dea-bd3da30e3797 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a24944aeb34a5ea228965be9bf4ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c288268acb30475bbc065a8f72cb21d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:53.984867 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-95ee99cc-f207-4bb0-8dea-bd3da30e3797 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] 10.222.0.33 "GET /compute/v2.1/servers/9f8cc082-0a37-4123-a680-1210a90b3ca9" status: 200 len: 1463 microversion: 2.1 time: 0.316686 Oct 04 20:36:53.986070 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-507869cb-196f-4933-ab71-ea0700675d37 tempest-HostsAdminTestJSON-964808243 tempest-HostsAdminTestJSON-964808243-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.037608 Oct 04 20:36:53.987193 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 417/842] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:36:53 2022] GET /compute/v2.1/servers/9f8cc082-0a37-4123-a680-1210a90b3ca9 => generated 1463 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:36:53.990504 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 426/843] 10.222.0.33 () {58 vars in 1128 bytes} [Tue Oct 4 20:36:53 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 20:36:53.997428 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-bc88f1bc-b54a-4f68-bc0a-b08886f8a688 tempest-HostsAdminTestJSON-964808243 tempest-HostsAdminTestJSON-964808243-project-admin] Calling method '.version_select at 0x7f3c74c16550>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:53.999287 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-d70f95dc-301c-4fc9-9549-94f2b83c2ddd tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:54.000095 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-d70f95dc-301c-4fc9-9549-94f2b83c2ddd tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] [instance: 7d9db253-559a-4d4b-9a5e-42c8f63f6cb7] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:54.003304 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bc88f1bc-b54a-4f68-bc0a-b08886f8a688 tempest-HostsAdminTestJSON-964808243 tempest-HostsAdminTestJSON-964808243-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:54.003981 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bc88f1bc-b54a-4f68-bc0a-b08886f8a688 tempest-HostsAdminTestJSON-964808243 tempest-HostsAdminTestJSON-964808243-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:54.004759 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bc88f1bc-b54a-4f68-bc0a-b08886f8a688 tempest-HostsAdminTestJSON-964808243 tempest-HostsAdminTestJSON-964808243-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:54.006474 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bc88f1bc-b54a-4f68-bc0a-b08886f8a688 tempest-HostsAdminTestJSON-964808243 tempest-HostsAdminTestJSON-964808243-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:54.007037 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bc88f1bc-b54a-4f68-bc0a-b08886f8a688 tempest-HostsAdminTestJSON-964808243 tempest-HostsAdminTestJSON-964808243-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:54.008906 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bc88f1bc-b54a-4f68-bc0a-b08886f8a688 tempest-HostsAdminTestJSON-964808243 tempest-HostsAdminTestJSON-964808243-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:54.009039 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d70f95dc-301c-4fc9-9549-94f2b83c2ddd tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:54.009458 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d70f95dc-301c-4fc9-9549-94f2b83c2ddd tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:54.010060 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d70f95dc-301c-4fc9-9549-94f2b83c2ddd tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:54.011041 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d70f95dc-301c-4fc9-9549-94f2b83c2ddd tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:54.011702 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d70f95dc-301c-4fc9-9549-94f2b83c2ddd tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:54.012327 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d70f95dc-301c-4fc9-9549-94f2b83c2ddd tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:54.038732 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-bc88f1bc-b54a-4f68-bc0a-b08886f8a688 tempest-HostsAdminTestJSON-964808243 tempest-HostsAdminTestJSON-964808243-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hosts?zone=internal" status: 200 len: 236 microversion: 2.1 time: 0.045401 Oct 04 20:36:54.039634 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 427/844] 10.222.0.33 () {58 vars in 1155 bytes} [Tue Oct 4 20:36:53 2022] GET /compute/v2.1/os-hosts?zone=internal => generated 236 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:36:54.046211 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-91769146-a02a-4733-b077-bdbf3144e521 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:54.047572 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-91769146-a02a-4733-b077-bdbf3144e521 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] [instance: 9f8cc082-0a37-4123-a680-1210a90b3ca9] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:54.054904 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-91769146-a02a-4733-b077-bdbf3144e521 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:54.055607 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-91769146-a02a-4733-b077-bdbf3144e521 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:54.056349 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-91769146-a02a-4733-b077-bdbf3144e521 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:54.057237 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-91769146-a02a-4733-b077-bdbf3144e521 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:54.057839 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-91769146-a02a-4733-b077-bdbf3144e521 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:54.058428 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-91769146-a02a-4733-b077-bdbf3144e521 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:54.624148 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-d70f95dc-301c-4fc9-9549-94f2b83c2ddd tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b786966441fc45f28890bf56cdfafb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8cc219b86ed450cbe7c780d7f79d9f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:54.632595 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-d70f95dc-301c-4fc9-9549-94f2b83c2ddd tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] 10.222.0.33 "GET /compute/v2.1/servers/7d9db253-559a-4d4b-9a5e-42c8f63f6cb7" status: 200 len: 1371 microversion: 2.1 time: 0.637085 Oct 04 20:36:54.633172 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 418/845] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:36:53 2022] GET /compute/v2.1/servers/7d9db253-559a-4d4b-9a5e-42c8f63f6cb7 => generated 1371 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:36:54.639341 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-91769146-a02a-4733-b077-bdbf3144e521 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a24944aeb34a5ea228965be9bf4ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c288268acb30475bbc065a8f72cb21d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:54.647783 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-f0e66cf1-e3d4-46a3-a201-9b9b050c55de tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:54.648415 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-f0e66cf1-e3d4-46a3-a201-9b9b050c55de tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] [instance: 33bf1c5a-fbf7-4db1-b2c8-e4ab05149f25] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:54.652488 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-91769146-a02a-4733-b077-bdbf3144e521 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] 10.222.0.33 "GET /compute/v2.1/servers/9f8cc082-0a37-4123-a680-1210a90b3ca9" status: 200 len: 1463 microversion: 2.1 time: 0.611503 Oct 04 20:36:54.653155 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 428/846] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:36:54 2022] GET /compute/v2.1/servers/9f8cc082-0a37-4123-a680-1210a90b3ca9 => generated 1463 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:36:54.656469 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f0e66cf1-e3d4-46a3-a201-9b9b050c55de tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:54.657113 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f0e66cf1-e3d4-46a3-a201-9b9b050c55de tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:54.657543 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f0e66cf1-e3d4-46a3-a201-9b9b050c55de tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:54.658687 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-378e1e5b-feae-468f-8810-17c63f65092c tempest-HostsAdminTestJSON-964808243 tempest-HostsAdminTestJSON-964808243-project-admin] Calling method '.version_select at 0x7f3c749acc10>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:54.659078 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f0e66cf1-e3d4-46a3-a201-9b9b050c55de tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:54.659849 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f0e66cf1-e3d4-46a3-a201-9b9b050c55de tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:54.660555 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f0e66cf1-e3d4-46a3-a201-9b9b050c55de tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:54.677820 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-378e1e5b-feae-468f-8810-17c63f65092c tempest-HostsAdminTestJSON-964808243 tempest-HostsAdminTestJSON-964808243-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:54.678370 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-378e1e5b-feae-468f-8810-17c63f65092c tempest-HostsAdminTestJSON-964808243 tempest-HostsAdminTestJSON-964808243-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:54.678892 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-378e1e5b-feae-468f-8810-17c63f65092c tempest-HostsAdminTestJSON-964808243 tempest-HostsAdminTestJSON-964808243-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:54.680322 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-378e1e5b-feae-468f-8810-17c63f65092c tempest-HostsAdminTestJSON-964808243 tempest-HostsAdminTestJSON-964808243-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:54.680322 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-378e1e5b-feae-468f-8810-17c63f65092c tempest-HostsAdminTestJSON-964808243 tempest-HostsAdminTestJSON-964808243-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:54.680631 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-378e1e5b-feae-468f-8810-17c63f65092c tempest-HostsAdminTestJSON-964808243 tempest-HostsAdminTestJSON-964808243-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:54.715460 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-378e1e5b-feae-468f-8810-17c63f65092c tempest-HostsAdminTestJSON-964808243 tempest-HostsAdminTestJSON-964808243-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.060996 Oct 04 20:36:54.716983 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 429/847] 10.222.0.33 () {58 vars in 1128 bytes} [Tue Oct 4 20:36:54 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:36:54.725288 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-b3639cfd-134e-4cbc-8094-5ea523d48736 req-d69cdb4c-1ed3-48fd-ac48-fbf7a88b10c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d9db253-559a-4d4b-9a5e-42c8f63f6cb7", "tag": "9b3bb850-3715-4a18-91c1-43aaf29fbf6f"}, {"name": "network-changed", "server_uuid": "33bf1c5a-fbf7-4db1-b2c8-e4ab05149f25", "tag": "57e9c24e-f645-45f4-9a9c-48ab34ee6f74"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:36:54.736269 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-b3639cfd-134e-4cbc-8094-5ea523d48736 req-d69cdb4c-1ed3-48fd-ac48-fbf7a88b10c5 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:54.736846 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-b3639cfd-134e-4cbc-8094-5ea523d48736 req-d69cdb4c-1ed3-48fd-ac48-fbf7a88b10c5 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:54.737369 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-b3639cfd-134e-4cbc-8094-5ea523d48736 req-d69cdb4c-1ed3-48fd-ac48-fbf7a88b10c5 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:54.756651 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-b3639cfd-134e-4cbc-8094-5ea523d48736 req-d69cdb4c-1ed3-48fd-ac48-fbf7a88b10c5 service nova] Creating event network-changed:9b3bb850-3715-4a18-91c1-43aaf29fbf6f for instance 7d9db253-559a-4d4b-9a5e-42c8f63f6cb7 on n-h1-854823-8 Oct 04 20:36:54.757149 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-b3639cfd-134e-4cbc-8094-5ea523d48736 req-d69cdb4c-1ed3-48fd-ac48-fbf7a88b10c5 service nova] Creating event network-changed:57e9c24e-f645-45f4-9a9c-48ab34ee6f74 for instance 33bf1c5a-fbf7-4db1-b2c8-e4ab05149f25 on n-h1-854823-8 Oct 04 20:36:54.763753 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-b3639cfd-134e-4cbc-8094-5ea523d48736 req-d69cdb4c-1ed3-48fd-ac48-fbf7a88b10c5 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.045357 Oct 04 20:36:54.764717 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 430/848] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:36:54 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:36:54.769927 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-cbb79262-1992-4aa6-88c2-247ce3617662 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:54.770653 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-cbb79262-1992-4aa6-88c2-247ce3617662 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] [instance: 465ad440-a27e-4ff6-bb31-09f3545e166a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:54.779178 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cbb79262-1992-4aa6-88c2-247ce3617662 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:54.779668 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cbb79262-1992-4aa6-88c2-247ce3617662 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:54.780557 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cbb79262-1992-4aa6-88c2-247ce3617662 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:54.780844 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cbb79262-1992-4aa6-88c2-247ce3617662 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:54.781235 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cbb79262-1992-4aa6-88c2-247ce3617662 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:54.781653 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cbb79262-1992-4aa6-88c2-247ce3617662 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:55.005259 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-f0e66cf1-e3d4-46a3-a201-9b9b050c55de tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa55ca3469648b0b1a2e1a29541c462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8659949e00dc429e8667767d0f126771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:55.014272 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-f0e66cf1-e3d4-46a3-a201-9b9b050c55de tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] 10.222.0.33 "GET /compute/v2.1/servers/33bf1c5a-fbf7-4db1-b2c8-e4ab05149f25" status: 200 len: 1402 microversion: 2.1 time: 0.379840 Oct 04 20:36:55.015419 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 419/849] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:36:54 2022] GET /compute/v2.1/servers/33bf1c5a-fbf7-4db1-b2c8-e4ab05149f25 => generated 1402 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:36:55.020235 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-4d67a988-e9ce-4374-83b5-ff0d401d1348 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63"}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:36:55.023226 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-4d67a988-e9ce-4374-83b5-ff0d401d1348 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] [instance: 9f8cc082-0a37-4123-a680-1210a90b3ca9] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:55.029662 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4d67a988-e9ce-4374-83b5-ff0d401d1348 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:55.030376 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4d67a988-e9ce-4374-83b5-ff0d401d1348 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:55.030819 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4d67a988-e9ce-4374-83b5-ff0d401d1348 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:55.031735 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4d67a988-e9ce-4374-83b5-ff0d401d1348 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:55.032199 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4d67a988-e9ce-4374-83b5-ff0d401d1348 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:55.032626 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4d67a988-e9ce-4374-83b5-ff0d401d1348 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:55.084097 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-cbb79262-1992-4aa6-88c2-247ce3617662 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3563efe2b8c94931a2a46c4e14811b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3118a5d96843d3bede1ed94bd9717e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:55.092275 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-cbb79262-1992-4aa6-88c2-247ce3617662 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] 10.222.0.33 "GET /compute/v2.1/servers/465ad440-a27e-4ff6-bb31-09f3545e166a" status: 200 len: 1379 microversion: 2.1 time: 0.326386 Oct 04 20:36:55.101864 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 431/850] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:36:54 2022] GET /compute/v2.1/servers/465ad440-a27e-4ff6-bb31-09f3545e166a => generated 1379 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:36:55.101864 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-09101bac-6b96-4def-8613-54111497ba22 tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:55.101864 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-09101bac-6b96-4def-8613-54111497ba22 tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] [instance: c61a781e-96f8-4bf6-8d3d-b8c3e9c58808] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:55.109788 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-09101bac-6b96-4def-8613-54111497ba22 tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:55.109788 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-09101bac-6b96-4def-8613-54111497ba22 tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:55.109788 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-09101bac-6b96-4def-8613-54111497ba22 tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:55.109788 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-09101bac-6b96-4def-8613-54111497ba22 tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:55.110133 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-09101bac-6b96-4def-8613-54111497ba22 tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:55.110133 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-09101bac-6b96-4def-8613-54111497ba22 tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:55.123850 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-09101bac-6b96-4def-8613-54111497ba22 tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] HTTP exception thrown: Instance c61a781e-96f8-4bf6-8d3d-b8c3e9c58808 could not be found. Oct 04 20:36:55.125714 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-09101bac-6b96-4def-8613-54111497ba22 tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] Request method failure captured: Oct 04 20:36:55.125714 n-d-854823-8 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/c61a781e-96f8-4bf6-8d3d-b8c3e9c58808 HTTP/1.1 Oct 04 20:36:55.125714 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:36:55.125714 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:36:55.125714 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:36:55.125714 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 0 Oct 04 20:36:55.125714 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:36:55.125714 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:36:55.125714 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:36:55.125714 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:36:55.125714 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJk_6sVbi3BeWY_ruYr_DC9VgN4F00LzOBWSQ6FiPQOS1Te3uyu6mf24vxC0x9_Gv8TwBIwuNPSMdB78QD6s2TgMo6txRgheFLi7cqwyfgdWg4JJghHem0OCXPxRn0FhZG07qnvS9BASIsH0eu7K_34rISLj3XY_ZJqIW-2dwVbp8Ow Oct 04 20:36:55.125714 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:36:55.125714 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:36:55.125714 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:36:55.125714 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:36:55.125714 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:36:55.125714 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:36:55.125714 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: 2d53510a3a5543618f6b701827e7c365 Oct 04 20:36:55.125714 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-ImagesNegativeTestJSON-2001306624 Oct 04 20:36:55.125714 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 20:36:55.125714 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 20:36:55.127125 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_2d53510a3a5543618f6b701827e7c365", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2d53510a3a5543618f6b701827e7c365"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2d53510a3a5543618f6b701827e7c365"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/2d53510a3a5543618f6b701827e7c365"}]}] Oct 04 20:36:55.127125 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-ImagesNegativeTestJSON-2001306624 Oct 04 20:36:55.127125 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: 2d53510a3a5543618f6b701827e7c365 Oct 04 20:36:55.127125 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-2001306624 Oct 04 20:36:55.127125 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-ImagesNegativeTestJSON-2001306624-project Oct 04 20:36:55.127125 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:36:55.127125 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:36:55.127125 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: 70b2a3b8a3d34ecdaab68b7f18f7788e Oct 04 20:36:55.127125 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-ImagesNegativeTestJSON-2001306624-project Oct 04 20:36:55.127125 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 20:36:55.127125 n-d-854823-8 devstack@n-api.service[128801]: exception: Instance c61a781e-96f8-4bf6-8d3d-b8c3e9c58808 could not be found. Oct 04 20:36:55.127125 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': 'c61a781e-96f8-4bf6-8d3d-b8c3e9c58808'} Oct 04 20:36:55.127979 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:36:55.127979 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:36:55.127979 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:36:55.127979 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:36:55.127979 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:36:55.127979 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:36:55.127979 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:36:55.127979 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:36:55.127979 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:36:55.127979 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:36:55.127979 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c61a781e-96f8-4bf6-8d3d-b8c3e9c58808 could not be found. Oct 04 20:36:55.127979 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:36:55.127979 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:36:55.127979 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:36:55.127979 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:36:55.127979 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:36:55.127979 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:36:55.127979 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:36:55.127979 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:36:55.127979 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:36:55.131060 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:36:55.131060 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:36:55.131060 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:36:55.131060 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:36:55.131060 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:36:55.131060 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:36:55.131060 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:36:55.131060 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c61a781e-96f8-4bf6-8d3d-b8c3e9c58808 could not be found. Oct 04 20:36:55.131060 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:36:55.131060 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:36:55.131060 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:36:55.131060 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:36:55.131060 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:36:55.131060 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:36:55.131060 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:36:55.131060 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:36:55.131060 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c61a781e-96f8-4bf6-8d3d-b8c3e9c58808 could not be found. Oct 04 20:36:55.131060 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:36:55.133342 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-09101bac-6b96-4def-8613-54111497ba22 tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] Returning 404 to user: Instance c61a781e-96f8-4bf6-8d3d-b8c3e9c58808 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:36:55.133342 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-09101bac-6b96-4def-8613-54111497ba22 tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] 10.222.0.33 "GET /compute/v2.1/servers/c61a781e-96f8-4bf6-8d3d-b8c3e9c58808" status: 404 len: 111 microversion: 2.1 time: 0.033159 Oct 04 20:36:55.133342 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 432/851] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:36:55 2022] GET /compute/v2.1/servers/c61a781e-96f8-4bf6-8d3d-b8c3e9c58808 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:36:55.134434 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-540a5cdd-8705-4811-9a23-97b052ed460b tempest-HostsAdminTestJSON-964808243 tempest-HostsAdminTestJSON-964808243-project-admin] Calling method '.version_select at 0x7f3c74de1280>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:55.141040 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-540a5cdd-8705-4811-9a23-97b052ed460b tempest-HostsAdminTestJSON-964808243 tempest-HostsAdminTestJSON-964808243-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:55.141622 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-540a5cdd-8705-4811-9a23-97b052ed460b tempest-HostsAdminTestJSON-964808243 tempest-HostsAdminTestJSON-964808243-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:55.142134 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-540a5cdd-8705-4811-9a23-97b052ed460b tempest-HostsAdminTestJSON-964808243 tempest-HostsAdminTestJSON-964808243-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:55.148904 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-4d67a988-e9ce-4374-83b5-ff0d401d1348 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Flavor limits 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:36:55.149513 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-4d67a988-e9ce-4374-83b5-ff0d401d1348 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Image limits 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:36:55.150679 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-4d67a988-e9ce-4374-83b5-ff0d401d1348 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Flavor pref 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:36:55.152257 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-4d67a988-e9ce-4374-83b5-ff0d401d1348 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Image pref 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:36:55.152898 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-4d67a988-e9ce-4374-83b5-ff0d401d1348 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:36:55.158373 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-540a5cdd-8705-4811-9a23-97b052ed460b tempest-HostsAdminTestJSON-964808243 tempest-HostsAdminTestJSON-964808243-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:55.158964 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-540a5cdd-8705-4811-9a23-97b052ed460b tempest-HostsAdminTestJSON-964808243 tempest-HostsAdminTestJSON-964808243-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:55.159480 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-540a5cdd-8705-4811-9a23-97b052ed460b tempest-HostsAdminTestJSON-964808243 tempest-HostsAdminTestJSON-964808243-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:55.182700 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-540a5cdd-8705-4811-9a23-97b052ed460b tempest-HostsAdminTestJSON-964808243 tempest-HostsAdminTestJSON-964808243-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hosts/n-h1-854823-8" status: 200 len: 729 microversion: 2.1 time: 0.054035 Oct 04 20:36:55.183381 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 433/852] 10.222.0.33 () {58 vars in 1170 bytes} [Tue Oct 4 20:36:55 2022] GET /compute/v2.1/os-hosts/n-h1-854823-8 => generated 729 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:36:55.188087 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-007d42a6-1046-4014-85b1-70b7aa5c0380 tempest-ServerDiagnosticsNegativeTest-417074328 tempest-ServerDiagnosticsNegativeTest-417074328-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:55.188999 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-007d42a6-1046-4014-85b1-70b7aa5c0380 tempest-ServerDiagnosticsNegativeTest-417074328 tempest-ServerDiagnosticsNegativeTest-417074328-project] [instance: a42d2956-071d-4bad-b9a6-a0f78fcb0498] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:55.197058 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-007d42a6-1046-4014-85b1-70b7aa5c0380 tempest-ServerDiagnosticsNegativeTest-417074328 tempest-ServerDiagnosticsNegativeTest-417074328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:55.197675 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-007d42a6-1046-4014-85b1-70b7aa5c0380 tempest-ServerDiagnosticsNegativeTest-417074328 tempest-ServerDiagnosticsNegativeTest-417074328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:55.198799 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-007d42a6-1046-4014-85b1-70b7aa5c0380 tempest-ServerDiagnosticsNegativeTest-417074328 tempest-ServerDiagnosticsNegativeTest-417074328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:55.199804 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-007d42a6-1046-4014-85b1-70b7aa5c0380 tempest-ServerDiagnosticsNegativeTest-417074328 tempest-ServerDiagnosticsNegativeTest-417074328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:55.202455 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-007d42a6-1046-4014-85b1-70b7aa5c0380 tempest-ServerDiagnosticsNegativeTest-417074328 tempest-ServerDiagnosticsNegativeTest-417074328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:55.203171 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-007d42a6-1046-4014-85b1-70b7aa5c0380 tempest-ServerDiagnosticsNegativeTest-417074328 tempest-ServerDiagnosticsNegativeTest-417074328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:55.221360 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:36:55.269695 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-4d67a988-e9ce-4374-83b5-ff0d401d1348 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] [instance: 9f8cc082-0a37-4123-a680-1210a90b3ca9] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:55.276163 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4d67a988-e9ce-4374-83b5-ff0d401d1348 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:55.276649 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4d67a988-e9ce-4374-83b5-ff0d401d1348 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:55.277083 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4d67a988-e9ce-4374-83b5-ff0d401d1348 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:55.277783 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4d67a988-e9ce-4374-83b5-ff0d401d1348 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:55.278238 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4d67a988-e9ce-4374-83b5-ff0d401d1348 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:55.278690 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4d67a988-e9ce-4374-83b5-ff0d401d1348 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:55.329396 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-4d67a988-e9ce-4374-83b5-ff0d401d1348 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] 10.222.0.33 "POST /compute/v2.1/servers/9f8cc082-0a37-4123-a680-1210a90b3ca9/action" status: 202 len: 1067 microversion: 2.1 time: 0.312441 Oct 04 20:36:55.329818 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 420/853] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 20:36:55 2022] POST /compute/v2.1/servers/9f8cc082-0a37-4123-a680-1210a90b3ca9/action => generated 1067 bytes in 314 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 04 20:36:55.343507 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-1b1adf5c-b655-49d3-8071-8b924c0de3fe tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-37349323", "metadata": {"image_type": "test"}}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:36:55.352372 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-1b1adf5c-b655-49d3-8071-8b924c0de3fe tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] [instance: c61a781e-96f8-4bf6-8d3d-b8c3e9c58808] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:55.367419 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1b1adf5c-b655-49d3-8071-8b924c0de3fe tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:55.367915 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1b1adf5c-b655-49d3-8071-8b924c0de3fe tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:55.368351 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1b1adf5c-b655-49d3-8071-8b924c0de3fe tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:55.373869 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1b1adf5c-b655-49d3-8071-8b924c0de3fe tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:55.374383 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1b1adf5c-b655-49d3-8071-8b924c0de3fe tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:55.377389 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1b1adf5c-b655-49d3-8071-8b924c0de3fe tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:55.416500 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.wsgi [None req-1b1adf5c-b655-49d3-8071-8b924c0de3fe tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] HTTP exception thrown: Instance c61a781e-96f8-4bf6-8d3d-b8c3e9c58808 could not be found. Oct 04 20:36:55.424163 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-1b1adf5c-b655-49d3-8071-8b924c0de3fe tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] Request method failure captured: Oct 04 20:36:55.424163 n-d-854823-8 devstack@n-api.service[128802]: request: POST /compute/v2.1/servers/c61a781e-96f8-4bf6-8d3d-b8c3e9c58808/action HTTP/1.1 Oct 04 20:36:55.424163 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 20:36:55.424163 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 20:36:55.424163 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 20:36:55.424163 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 110 Oct 04 20:36:55.424163 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 20:36:55.424163 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 20:36:55.424163 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 20:36:55.424163 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 20:36:55.424163 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPJk_6sVbi3BeWY_ruYr_DC9VgN4F00LzOBWSQ6FiPQOS1Te3uyu6mf24vxC0x9_Gv8TwBIwuNPSMdB78QD6s2TgMo6txRgheFLi7cqwyfgdWg4JJghHem0OCXPxRn0FhZG07qnvS9BASIsH0eu7K_34rISLj3XY_ZJqIW-2dwVbp8Ow Oct 04 20:36:55.424163 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 20:36:55.424163 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 20:36:55.424163 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 20:36:55.424163 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 20:36:55.424163 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 20:36:55.424163 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 20:36:55.424163 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: 2d53510a3a5543618f6b701827e7c365 Oct 04 20:36:55.424163 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-ImagesNegativeTestJSON-2001306624 Oct 04 20:36:55.424163 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 20:36:55.424163 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 20:36:55.425592 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_2d53510a3a5543618f6b701827e7c365", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2d53510a3a5543618f6b701827e7c365"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2d53510a3a5543618f6b701827e7c365"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/2d53510a3a5543618f6b701827e7c365"}]}] Oct 04 20:36:55.425592 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-ImagesNegativeTestJSON-2001306624 Oct 04 20:36:55.425592 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: 2d53510a3a5543618f6b701827e7c365 Oct 04 20:36:55.425592 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-2001306624 Oct 04 20:36:55.425592 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-ImagesNegativeTestJSON-2001306624-project Oct 04 20:36:55.425592 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 20:36:55.425592 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 20:36:55.425592 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: 70b2a3b8a3d34ecdaab68b7f18f7788e Oct 04 20:36:55.425592 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-ImagesNegativeTestJSON-2001306624-project Oct 04 20:36:55.425592 n-d-854823-8 devstack@n-api.service[128802]: Oct 04 20:36:55.425592 n-d-854823-8 devstack@n-api.service[128802]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-37349323", "metadata": {"image_type": "test"}}} Oct 04 20:36:55.425592 n-d-854823-8 devstack@n-api.service[128802]: method: > Oct 04 20:36:55.426458 n-d-854823-8 devstack@n-api.service[128802]: exception: Instance c61a781e-96f8-4bf6-8d3d-b8c3e9c58808 could not be found. Oct 04 20:36:55.426458 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'id': 'c61a781e-96f8-4bf6-8d3d-b8c3e9c58808', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-37349323', 'metadata': {'image_type': 'test'}}}} Oct 04 20:36:55.426458 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:36:55.426458 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:36:55.426458 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:36:55.426458 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:36:55.426458 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:36:55.426458 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:36:55.426458 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:36:55.426458 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:36:55.426458 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:36:55.426458 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:36:55.426458 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c61a781e-96f8-4bf6-8d3d-b8c3e9c58808 could not be found. Oct 04 20:36:55.426458 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:36:55.426458 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:36:55.426458 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:36:55.426458 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:36:55.426458 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:36:55.426458 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:36:55.428209 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:36:55.428209 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:36:55.428209 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:36:55.428209 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:36:55.428209 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:36:55.428209 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:36:55.428209 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:36:55.428209 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:36:55.428209 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 04 20:36:55.428209 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 04 20:36:55.428209 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:36:55.428209 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:36:55.428209 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:36:55.428209 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:36:55.428209 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c61a781e-96f8-4bf6-8d3d-b8c3e9c58808 could not be found. Oct 04 20:36:55.428209 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:36:55.428209 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:36:55.428209 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:36:55.428209 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:36:55.428209 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:36:55.429394 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:36:55.429394 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:36:55.429394 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:36:55.429394 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c61a781e-96f8-4bf6-8d3d-b8c3e9c58808 could not be found. Oct 04 20:36:55.429394 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:36:55.429394 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-1b1adf5c-b655-49d3-8071-8b924c0de3fe tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] Returning 404 to user: Instance c61a781e-96f8-4bf6-8d3d-b8c3e9c58808 could not be found. {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:36:55.429394 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-1b1adf5c-b655-49d3-8071-8b924c0de3fe tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] 10.222.0.33 "POST /compute/v2.1/servers/c61a781e-96f8-4bf6-8d3d-b8c3e9c58808/action" status: 404 len: 111 microversion: 2.1 time: 0.092681 Oct 04 20:36:55.432625 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 421/854] 10.222.0.33 () {60 vars in 1279 bytes} [Tue Oct 4 20:36:55 2022] POST /compute/v2.1/servers/c61a781e-96f8-4bf6-8d3d-b8c3e9c58808/action => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:36:55.441133 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-d31d7512-2c55-406b-ae8d-077f2a5acfcf tempest-HostsAdminTestJSON-964808243 tempest-HostsAdminTestJSON-964808243-project-admin] Calling method '.version_select at 0x7f3c748051f0>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:55.452668 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d31d7512-2c55-406b-ae8d-077f2a5acfcf tempest-HostsAdminTestJSON-964808243 tempest-HostsAdminTestJSON-964808243-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:55.453631 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d31d7512-2c55-406b-ae8d-077f2a5acfcf tempest-HostsAdminTestJSON-964808243 tempest-HostsAdminTestJSON-964808243-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:55.454426 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d31d7512-2c55-406b-ae8d-077f2a5acfcf tempest-HostsAdminTestJSON-964808243 tempest-HostsAdminTestJSON-964808243-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:55.472708 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d31d7512-2c55-406b-ae8d-077f2a5acfcf tempest-HostsAdminTestJSON-964808243 tempest-HostsAdminTestJSON-964808243-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:55.473364 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d31d7512-2c55-406b-ae8d-077f2a5acfcf tempest-HostsAdminTestJSON-964808243 tempest-HostsAdminTestJSON-964808243-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:55.473858 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d31d7512-2c55-406b-ae8d-077f2a5acfcf tempest-HostsAdminTestJSON-964808243 tempest-HostsAdminTestJSON-964808243-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:55.502195 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-d31d7512-2c55-406b-ae8d-077f2a5acfcf tempest-HostsAdminTestJSON-964808243 tempest-HostsAdminTestJSON-964808243-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hosts/n-h2-854823-8" status: 200 len: 729 microversion: 2.1 time: 0.066770 Oct 04 20:36:55.515349 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 422/855] 10.222.0.33 () {58 vars in 1170 bytes} [Tue Oct 4 20:36:55 2022] GET /compute/v2.1/os-hosts/n-h2-854823-8 => generated 729 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:36:55.528988 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-1705e653-6009-47b7-b9f3-6c852427a0bd tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:55.529169 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-1705e653-6009-47b7-b9f3-6c852427a0bd tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] [instance: 9f8cc082-0a37-4123-a680-1210a90b3ca9] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:55.529732 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-007d42a6-1046-4014-85b1-70b7aa5c0380 tempest-ServerDiagnosticsNegativeTest-417074328 tempest-ServerDiagnosticsNegativeTest-417074328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2581847c48447f5867331fb858ebb0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930bc715520746bc8a320d082e47af81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:55.540900 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-007d42a6-1046-4014-85b1-70b7aa5c0380 tempest-ServerDiagnosticsNegativeTest-417074328 tempest-ServerDiagnosticsNegativeTest-417074328-project] 10.222.0.33 "GET /compute/v2.1/servers/a42d2956-071d-4bad-b9a6-a0f78fcb0498" status: 200 len: 1322 microversion: 2.1 time: 0.356220 Oct 04 20:36:55.542676 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 434/856] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:36:55 2022] GET /compute/v2.1/servers/a42d2956-071d-4bad-b9a6-a0f78fcb0498 => generated 1322 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:36:55.548588 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-503ecacd-9e6b-4ba0-9c03-53b70f186041 tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1717656728", "metadata": {"image_type": "test"}}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:36:55.551324 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-503ecacd-9e6b-4ba0-9c03-53b70f186041 tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] Failed to fetch instance by id tempest-invalid-1567626111 {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 04 20:36:55.554245 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-503ecacd-9e6b-4ba0-9c03-53b70f186041 tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] HTTP exception thrown: Instance tempest-invalid-1567626111 could not be found. Oct 04 20:36:55.556723 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-503ecacd-9e6b-4ba0-9c03-53b70f186041 tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] Request method failure captured: Oct 04 20:36:55.556723 n-d-854823-8 devstack@n-api.service[128801]: request: POST /compute/v2.1/servers/tempest-invalid-1567626111/action HTTP/1.1 Oct 04 20:36:55.556723 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:36:55.556723 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:36:55.556723 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:36:55.556723 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 112 Oct 04 20:36:55.556723 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:36:55.556723 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:36:55.556723 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:36:55.556723 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:36:55.556723 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJk_6sVbi3BeWY_ruYr_DC9VgN4F00LzOBWSQ6FiPQOS1Te3uyu6mf24vxC0x9_Gv8TwBIwuNPSMdB78QD6s2TgMo6txRgheFLi7cqwyfgdWg4JJghHem0OCXPxRn0FhZG07qnvS9BASIsH0eu7K_34rISLj3XY_ZJqIW-2dwVbp8Ow Oct 04 20:36:55.556723 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:36:55.556723 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:36:55.556723 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:36:55.556723 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:36:55.556723 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:36:55.556723 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:36:55.556723 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: 2d53510a3a5543618f6b701827e7c365 Oct 04 20:36:55.556723 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-ImagesNegativeTestJSON-2001306624 Oct 04 20:36:55.556723 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 20:36:55.556723 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 20:36:55.558079 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_2d53510a3a5543618f6b701827e7c365", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2d53510a3a5543618f6b701827e7c365"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2d53510a3a5543618f6b701827e7c365"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/2d53510a3a5543618f6b701827e7c365"}]}] Oct 04 20:36:55.558079 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-ImagesNegativeTestJSON-2001306624 Oct 04 20:36:55.558079 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: 2d53510a3a5543618f6b701827e7c365 Oct 04 20:36:55.558079 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-2001306624 Oct 04 20:36:55.558079 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-ImagesNegativeTestJSON-2001306624-project Oct 04 20:36:55.558079 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:36:55.558079 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:36:55.558079 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: 70b2a3b8a3d34ecdaab68b7f18f7788e Oct 04 20:36:55.558079 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-ImagesNegativeTestJSON-2001306624-project Oct 04 20:36:55.558079 n-d-854823-8 devstack@n-api.service[128801]: Oct 04 20:36:55.558079 n-d-854823-8 devstack@n-api.service[128801]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1717656728", "metadata": {"image_type": "test"}}} Oct 04 20:36:55.558079 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 20:36:55.559482 n-d-854823-8 devstack@n-api.service[128801]: exception: Instance tempest-invalid-1567626111 could not be found. Oct 04 20:36:55.559482 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': 'tempest-invalid-1567626111', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-1717656728', 'metadata': {'image_type': 'test'}}}} Oct 04 20:36:55.559482 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:36:55.559482 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:36:55.559482 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:36:55.559482 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:36:55.559482 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 04 20:36:55.559482 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 04 20:36:55.559482 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance tempest-invalid-1567626111 could not be found. Oct 04 20:36:55.559482 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:36:55.559482 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:36:55.559482 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:36:55.559482 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:36:55.559482 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:36:55.559482 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:36:55.559482 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:36:55.559482 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:36:55.559482 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:36:55.559482 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:36:55.559482 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:36:55.560912 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:36:55.560912 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:36:55.560912 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:36:55.560912 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 04 20:36:55.560912 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 04 20:36:55.560912 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:36:55.560912 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:36:55.560912 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:36:55.560912 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:36:55.560912 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance tempest-invalid-1567626111 could not be found. Oct 04 20:36:55.560912 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:36:55.560912 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:36:55.560912 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:36:55.560912 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:36:55.560912 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:36:55.560912 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:36:55.560912 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:36:55.560912 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:36:55.560912 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance tempest-invalid-1567626111 could not be found. Oct 04 20:36:55.560912 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:36:55.564147 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-503ecacd-9e6b-4ba0-9c03-53b70f186041 tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] Returning 404 to user: Instance tempest-invalid-1567626111 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:36:55.565330 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-503ecacd-9e6b-4ba0-9c03-53b70f186041 tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] 10.222.0.33 "POST /compute/v2.1/servers/tempest-invalid-1567626111/action" status: 404 len: 101 microversion: 2.1 time: 0.021354 Oct 04 20:36:55.566406 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 435/857] 10.222.0.33 () {60 vars in 1249 bytes} [Tue Oct 4 20:36:55 2022] POST /compute/v2.1/servers/tempest-invalid-1567626111/action => generated 101 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:36:55.573012 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1705e653-6009-47b7-b9f3-6c852427a0bd tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:55.574552 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1705e653-6009-47b7-b9f3-6c852427a0bd tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:55.575073 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1705e653-6009-47b7-b9f3-6c852427a0bd tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:55.575880 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1705e653-6009-47b7-b9f3-6c852427a0bd tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:55.576490 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1705e653-6009-47b7-b9f3-6c852427a0bd tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:55.577763 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1705e653-6009-47b7-b9f3-6c852427a0bd tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:55.696540 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-36a74f14-337a-441c-8ebf-8171f32ccef4 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1970869157", "imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63", "flavorRef": "452", "networks": [{"uuid": "accbf9df-df79-4b74-a013-58a41c8806a7"}]}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:36:55.823315 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.network.neutron [None req-36a74f14-337a-441c-8ebf-8171f32ccef4 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] validate_networks() for [('accbf9df-df79-4b74-a013-58a41c8806a7', None, None, None, None, None)] {{(pid=128801) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:36:56.105923 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-1705e653-6009-47b7-b9f3-6c852427a0bd tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a24944aeb34a5ea228965be9bf4ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c288268acb30475bbc065a8f72cb21d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:56.119419 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-1705e653-6009-47b7-b9f3-6c852427a0bd tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] 10.222.0.33 "GET /compute/v2.1/servers/9f8cc082-0a37-4123-a680-1210a90b3ca9" status: 200 len: 1472 microversion: 2.1 time: 0.602413 Oct 04 20:36:56.121755 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 423/858] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:36:55 2022] GET /compute/v2.1/servers/9f8cc082-0a37-4123-a680-1210a90b3ca9 => generated 1472 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:36:56.139522 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-509d6d67-c966-40f6-a0f6-cb82b0295855 tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-985730261"}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:36:56.141903 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-509d6d67-c966-40f6-a0f6-cb82b0295855 tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 04 20:36:56.143551 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.wsgi [None req-509d6d67-c966-40f6-a0f6-cb82b0295855 tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 04 20:36:56.148012 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-509d6d67-c966-40f6-a0f6-cb82b0295855 tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] Request method failure captured: Oct 04 20:36:56.148012 n-d-854823-8 devstack@n-api.service[128802]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Oct 04 20:36:56.148012 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 20:36:56.148012 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 20:36:56.148012 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 20:36:56.148012 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 56 Oct 04 20:36:56.148012 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 20:36:56.148012 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 20:36:56.148012 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 20:36:56.148012 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 20:36:56.148012 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPJk_6sVbi3BeWY_ruYr_DC9VgN4F00LzOBWSQ6FiPQOS1Te3uyu6mf24vxC0x9_Gv8TwBIwuNPSMdB78QD6s2TgMo6txRgheFLi7cqwyfgdWg4JJghHem0OCXPxRn0FhZG07qnvS9BASIsH0eu7K_34rISLj3XY_ZJqIW-2dwVbp8Ow Oct 04 20:36:56.148012 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 20:36:56.148012 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 20:36:56.148012 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 20:36:56.148012 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 20:36:56.148012 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 20:36:56.148012 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 20:36:56.148012 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: 2d53510a3a5543618f6b701827e7c365 Oct 04 20:36:56.148012 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-ImagesNegativeTestJSON-2001306624 Oct 04 20:36:56.148012 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 20:36:56.148012 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 20:36:56.149397 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_2d53510a3a5543618f6b701827e7c365", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2d53510a3a5543618f6b701827e7c365"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2d53510a3a5543618f6b701827e7c365"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/2d53510a3a5543618f6b701827e7c365"}]}] Oct 04 20:36:56.149397 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-ImagesNegativeTestJSON-2001306624 Oct 04 20:36:56.149397 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: 2d53510a3a5543618f6b701827e7c365 Oct 04 20:36:56.149397 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-2001306624 Oct 04 20:36:56.149397 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-ImagesNegativeTestJSON-2001306624-project Oct 04 20:36:56.149397 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 20:36:56.149397 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 20:36:56.149397 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: 70b2a3b8a3d34ecdaab68b7f18f7788e Oct 04 20:36:56.149397 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-ImagesNegativeTestJSON-2001306624-project Oct 04 20:36:56.149397 n-d-854823-8 devstack@n-api.service[128802]: Oct 04 20:36:56.149397 n-d-854823-8 devstack@n-api.service[128802]: {"createImage": {"name": "tempest-test-snap-985730261"}} Oct 04 20:36:56.149397 n-d-854823-8 devstack@n-api.service[128802]: method: > Oct 04 20:36:56.149397 n-d-854823-8 devstack@n-api.service[128802]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 04 20:36:56.150159 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-985730261'}}} Oct 04 20:36:56.150159 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:36:56.150159 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:36:56.150159 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:36:56.150159 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:36:56.150159 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 04 20:36:56.150159 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 04 20:36:56.150159 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 04 20:36:56.150159 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:36:56.150159 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:36:56.150159 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:36:56.150159 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:36:56.150159 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:36:56.150159 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:36:56.150159 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:36:56.150159 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:36:56.150159 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:36:56.150159 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:36:56.150159 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:36:56.150159 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:36:56.151460 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:36:56.151460 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:36:56.151460 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 04 20:36:56.151460 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 04 20:36:56.151460 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:36:56.151460 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:36:56.151460 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:36:56.151460 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:36:56.151460 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 04 20:36:56.151460 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:36:56.151460 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:36:56.151460 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:36:56.151460 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:36:56.151460 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:36:56.151460 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:36:56.151460 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:36:56.151460 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:36:56.151460 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 04 20:36:56.151460 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:36:56.152559 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-509d6d67-c966-40f6-a0f6-cb82b0295855 tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:36:56.152559 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-509d6d67-c966-40f6-a0f6-cb82b0295855 tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] 10.222.0.33 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 110 microversion: 2.1 time: 0.025908 Oct 04 20:36:56.155136 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 424/859] 10.222.0.33 () {60 vars in 1275 bytes} [Tue Oct 4 20:36:56 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 110 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:36:56.162758 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-9b731611-5814-4903-b878-9d4f598c3473 tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:56.163173 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-9b731611-5814-4903-b878-9d4f598c3473 tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] [instance: 7d9db253-559a-4d4b-9a5e-42c8f63f6cb7] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:56.172955 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9b731611-5814-4903-b878-9d4f598c3473 tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:56.173774 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9b731611-5814-4903-b878-9d4f598c3473 tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:56.173921 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9b731611-5814-4903-b878-9d4f598c3473 tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:56.174625 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9b731611-5814-4903-b878-9d4f598c3473 tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:56.175425 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9b731611-5814-4903-b878-9d4f598c3473 tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:56.176016 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9b731611-5814-4903-b878-9d4f598c3473 tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:56.493594 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-9b731611-5814-4903-b878-9d4f598c3473 tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b786966441fc45f28890bf56cdfafb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8cc219b86ed450cbe7c780d7f79d9f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:56.517798 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-9b731611-5814-4903-b878-9d4f598c3473 tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] 10.222.0.33 "GET /compute/v2.1/servers/7d9db253-559a-4d4b-9a5e-42c8f63f6cb7" status: 200 len: 1371 microversion: 2.1 time: 0.361318 Oct 04 20:36:56.531011 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 425/860] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:36:56 2022] GET /compute/v2.1/servers/7d9db253-559a-4d4b-9a5e-42c8f63f6cb7 => generated 1371 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:36:56.540050 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-0a28f86b-eff6-492a-9322-8974d1f50fdd tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:56.541540 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-0a28f86b-eff6-492a-9322-8974d1f50fdd tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] [instance: 33bf1c5a-fbf7-4db1-b2c8-e4ab05149f25] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:56.548972 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0a28f86b-eff6-492a-9322-8974d1f50fdd tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:56.549675 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0a28f86b-eff6-492a-9322-8974d1f50fdd tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:56.550886 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0a28f86b-eff6-492a-9322-8974d1f50fdd tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:56.551997 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0a28f86b-eff6-492a-9322-8974d1f50fdd tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:56.559182 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0a28f86b-eff6-492a-9322-8974d1f50fdd tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:56.559751 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0a28f86b-eff6-492a-9322-8974d1f50fdd tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:56.807129 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-36a74f14-337a-441c-8ebf-8171f32ccef4 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Flavor limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:36:56.808256 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-36a74f14-337a-441c-8ebf-8171f32ccef4 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Image limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:36:56.808979 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-36a74f14-337a-441c-8ebf-8171f32ccef4 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Flavor pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:36:56.809708 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-36a74f14-337a-441c-8ebf-8171f32ccef4 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Image pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:36:56.810371 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-36a74f14-337a-441c-8ebf-8171f32ccef4 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:36:56.815113 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-0a28f86b-eff6-492a-9322-8974d1f50fdd tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa55ca3469648b0b1a2e1a29541c462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8659949e00dc429e8667767d0f126771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:56.821707 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-36a74f14-337a-441c-8ebf-8171f32ccef4 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:56.822642 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-36a74f14-337a-441c-8ebf-8171f32ccef4 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:56.823412 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-36a74f14-337a-441c-8ebf-8171f32ccef4 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:56.824484 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-36a74f14-337a-441c-8ebf-8171f32ccef4 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:56.825084 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-36a74f14-337a-441c-8ebf-8171f32ccef4 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:56.825805 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-36a74f14-337a-441c-8ebf-8171f32ccef4 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:56.828067 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-0a28f86b-eff6-492a-9322-8974d1f50fdd tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] 10.222.0.33 "GET /compute/v2.1/servers/33bf1c5a-fbf7-4db1-b2c8-e4ab05149f25" status: 200 len: 1402 microversion: 2.1 time: 0.295757 Oct 04 20:36:56.844498 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 426/861] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:36:56 2022] GET /compute/v2.1/servers/33bf1c5a-fbf7-4db1-b2c8-e4ab05149f25 => generated 1402 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:36:56.848849 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-3d6b1793-c1d1-46d4-b08f-834e825eb144 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:56.850292 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-3d6b1793-c1d1-46d4-b08f-834e825eb144 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] [instance: 465ad440-a27e-4ff6-bb31-09f3545e166a] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:56.856514 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-36a74f14-337a-441c-8ebf-8171f32ccef4 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Getting quotas for project 4310eadf656d4ba88ade5714c9661488. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:36:56.857935 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3d6b1793-c1d1-46d4-b08f-834e825eb144 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:56.858763 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3d6b1793-c1d1-46d4-b08f-834e825eb144 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:56.859470 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3d6b1793-c1d1-46d4-b08f-834e825eb144 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:56.860637 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3d6b1793-c1d1-46d4-b08f-834e825eb144 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:56.861331 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3d6b1793-c1d1-46d4-b08f-834e825eb144 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:56.861993 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3d6b1793-c1d1-46d4-b08f-834e825eb144 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:56.862322 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-36a74f14-337a-441c-8ebf-8171f32ccef4 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Getting quotas for user beaac70ab9344f6c9677d6500b8b0df6 and project 4310eadf656d4ba88ade5714c9661488. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:36:56.877613 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-36a74f14-337a-441c-8ebf-8171f32ccef4 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Going to run 1 instances... {{(pid=128801) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:36:56.882983 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-36a74f14-337a-441c-8ebf-8171f32ccef4 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] [instance: 5dbb0cb7-e2d8-416a-a486-72d4398ee877] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='15b24725-0c99-4bcf-b1fb-907cdf8e2d63',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128801) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:36:56.938467 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-36a74f14-337a-441c-8ebf-8171f32ccef4 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.370356 Oct 04 20:36:56.939578 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 436/862] 10.222.0.33 () {62 vars in 1188 bytes} [Tue Oct 4 20:36:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 1372 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 04 20:36:56.963251 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-be459e7c-c17c-41f5-865a-25e78e933132 tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-479754077"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:36:56.967587 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-be459e7c-c17c-41f5-865a-25e78e933132 tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 04 20:36:56.968338 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-be459e7c-c17c-41f5-865a-25e78e933132 tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 04 20:36:56.970067 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-be459e7c-c17c-41f5-865a-25e78e933132 tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] Request method failure captured: Oct 04 20:36:56.970067 n-d-854823-8 devstack@n-api.service[128801]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Oct 04 20:36:56.970067 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:36:56.970067 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:36:56.970067 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:36:56.970067 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 56 Oct 04 20:36:56.970067 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:36:56.970067 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:36:56.970067 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:36:56.970067 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:36:56.970067 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJk_6sVbi3BeWY_ruYr_DC9VgN4F00LzOBWSQ6FiPQOS1Te3uyu6mf24vxC0x9_Gv8TwBIwuNPSMdB78QD6s2TgMo6txRgheFLi7cqwyfgdWg4JJghHem0OCXPxRn0FhZG07qnvS9BASIsH0eu7K_34rISLj3XY_ZJqIW-2dwVbp8Ow Oct 04 20:36:56.970067 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:36:56.970067 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:36:56.970067 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:36:56.970067 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:36:56.970067 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:36:56.970067 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:36:56.970067 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: 2d53510a3a5543618f6b701827e7c365 Oct 04 20:36:56.970067 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-ImagesNegativeTestJSON-2001306624 Oct 04 20:36:56.970067 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 20:36:56.970067 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 20:36:56.971585 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_2d53510a3a5543618f6b701827e7c365", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2d53510a3a5543618f6b701827e7c365"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2d53510a3a5543618f6b701827e7c365"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/2d53510a3a5543618f6b701827e7c365"}]}] Oct 04 20:36:56.971585 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-ImagesNegativeTestJSON-2001306624 Oct 04 20:36:56.971585 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: 2d53510a3a5543618f6b701827e7c365 Oct 04 20:36:56.971585 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-2001306624 Oct 04 20:36:56.971585 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-ImagesNegativeTestJSON-2001306624-project Oct 04 20:36:56.971585 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:36:56.971585 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:36:56.971585 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: 70b2a3b8a3d34ecdaab68b7f18f7788e Oct 04 20:36:56.971585 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-ImagesNegativeTestJSON-2001306624-project Oct 04 20:36:56.971585 n-d-854823-8 devstack@n-api.service[128801]: Oct 04 20:36:56.971585 n-d-854823-8 devstack@n-api.service[128801]: {"createImage": {"name": "tempest-test-snap-479754077"}} Oct 04 20:36:56.971585 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 20:36:56.971585 n-d-854823-8 devstack@n-api.service[128801]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 04 20:36:56.972491 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-479754077'}}} Oct 04 20:36:56.972491 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:36:56.972491 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:36:56.972491 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:36:56.972491 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:36:56.972491 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 04 20:36:56.972491 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 04 20:36:56.972491 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 04 20:36:56.972491 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:36:56.972491 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:36:56.972491 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:36:56.972491 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:36:56.972491 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:36:56.972491 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:36:56.972491 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:36:56.972491 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:36:56.972491 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:36:56.972491 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:36:56.972491 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:36:56.972491 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:36:56.973838 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:36:56.973838 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:36:56.973838 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 04 20:36:56.973838 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 04 20:36:56.973838 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:36:56.973838 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:36:56.973838 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:36:56.973838 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:36:56.973838 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 04 20:36:56.973838 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:36:56.973838 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:36:56.973838 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:36:56.973838 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:36:56.973838 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:36:56.973838 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:36:56.973838 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:36:56.973838 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:36:56.973838 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 04 20:36:56.973838 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:36:56.976737 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-be459e7c-c17c-41f5-865a-25e78e933132 tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:36:56.978925 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-be459e7c-c17c-41f5-865a-25e78e933132 tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] 10.222.0.33 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 112 microversion: 2.1 time: 0.037200 Oct 04 20:36:56.979710 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 437/863] 10.222.0.33 () {60 vars in 1281 bytes} [Tue Oct 4 20:36:56 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 112 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:36:56.984439 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6e25ebbc-e208-45b4-8171-a004a68d4ad2 tempest-ServerDiagnosticsNegativeTest-417074328 tempest-ServerDiagnosticsNegativeTest-417074328-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:56.985384 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-6e25ebbc-e208-45b4-8171-a004a68d4ad2 tempest-ServerDiagnosticsNegativeTest-417074328 tempest-ServerDiagnosticsNegativeTest-417074328-project] [instance: a42d2956-071d-4bad-b9a6-a0f78fcb0498] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:56.996543 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6e25ebbc-e208-45b4-8171-a004a68d4ad2 tempest-ServerDiagnosticsNegativeTest-417074328 tempest-ServerDiagnosticsNegativeTest-417074328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:56.998481 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6e25ebbc-e208-45b4-8171-a004a68d4ad2 tempest-ServerDiagnosticsNegativeTest-417074328 tempest-ServerDiagnosticsNegativeTest-417074328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:56.999096 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6e25ebbc-e208-45b4-8171-a004a68d4ad2 tempest-ServerDiagnosticsNegativeTest-417074328 tempest-ServerDiagnosticsNegativeTest-417074328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:56.999871 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6e25ebbc-e208-45b4-8171-a004a68d4ad2 tempest-ServerDiagnosticsNegativeTest-417074328 tempest-ServerDiagnosticsNegativeTest-417074328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:57.000386 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6e25ebbc-e208-45b4-8171-a004a68d4ad2 tempest-ServerDiagnosticsNegativeTest-417074328 tempest-ServerDiagnosticsNegativeTest-417074328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:57.001050 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6e25ebbc-e208-45b4-8171-a004a68d4ad2 tempest-ServerDiagnosticsNegativeTest-417074328 tempest-ServerDiagnosticsNegativeTest-417074328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:57.116669 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-3d6b1793-c1d1-46d4-b08f-834e825eb144 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3563efe2b8c94931a2a46c4e14811b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3118a5d96843d3bede1ed94bd9717e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:57.125358 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-3d6b1793-c1d1-46d4-b08f-834e825eb144 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] 10.222.0.33 "GET /compute/v2.1/servers/465ad440-a27e-4ff6-bb31-09f3545e166a" status: 200 len: 1379 microversion: 2.1 time: 0.283615 Oct 04 20:36:57.139204 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 427/864] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:36:56 2022] GET /compute/v2.1/servers/465ad440-a27e-4ff6-bb31-09f3545e166a => generated 1379 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:36:57.150156 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-53b21522-9046-48d4-a1c9-0910def1c9f3 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:57.151739 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-53b21522-9046-48d4-a1c9-0910def1c9f3 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] [instance: 5dbb0cb7-e2d8-416a-a486-72d4398ee877] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:57.237748 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-53b21522-9046-48d4-a1c9-0910def1c9f3 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:57.251875 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-53b21522-9046-48d4-a1c9-0910def1c9f3 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:57.254042 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-6e25ebbc-e208-45b4-8171-a004a68d4ad2 tempest-ServerDiagnosticsNegativeTest-417074328 tempest-ServerDiagnosticsNegativeTest-417074328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2581847c48447f5867331fb858ebb0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930bc715520746bc8a320d082e47af81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:57.257758 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-53b21522-9046-48d4-a1c9-0910def1c9f3 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:57.266381 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-6e25ebbc-e208-45b4-8171-a004a68d4ad2 tempest-ServerDiagnosticsNegativeTest-417074328 tempest-ServerDiagnosticsNegativeTest-417074328-project] 10.222.0.33 "GET /compute/v2.1/servers/a42d2956-071d-4bad-b9a6-a0f78fcb0498" status: 200 len: 1472 microversion: 2.1 time: 0.285359 Oct 04 20:36:57.266972 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 438/865] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:36:56 2022] GET /compute/v2.1/servers/a42d2956-071d-4bad-b9a6-a0f78fcb0498 => generated 1472 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:36:57.268422 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-53b21522-9046-48d4-a1c9-0910def1c9f3 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] 10.222.0.33 "GET /compute/v2.1/servers/5dbb0cb7-e2d8-416a-a486-72d4398ee877" status: 200 len: 1262 microversion: 2.25 time: 0.127974 Oct 04 20:36:57.271864 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 428/866] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:36:57 2022] GET /compute/v2.1/servers/5dbb0cb7-e2d8-416a-a486-72d4398ee877 => generated 1262 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:36:57.276662 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-da365ecd-f75a-4efb-9992-af831eee4713 tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:57.277358 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-da365ecd-f75a-4efb-9992-af831eee4713 tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] [instance: c61a781e-96f8-4bf6-8d3d-b8c3e9c58808] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:57.294636 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-d8a69acb-dc89-46f5-af68-c6b2eb000e0c tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:57.295625 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-d8a69acb-dc89-46f5-af68-c6b2eb000e0c tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] [instance: 9f8cc082-0a37-4123-a680-1210a90b3ca9] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:57.298612 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-da365ecd-f75a-4efb-9992-af831eee4713 tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:57.301634 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-da365ecd-f75a-4efb-9992-af831eee4713 tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:57.303437 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-da365ecd-f75a-4efb-9992-af831eee4713 tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:57.304383 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-da365ecd-f75a-4efb-9992-af831eee4713 tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:57.304813 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d8a69acb-dc89-46f5-af68-c6b2eb000e0c tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:57.305567 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d8a69acb-dc89-46f5-af68-c6b2eb000e0c tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:57.306163 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d8a69acb-dc89-46f5-af68-c6b2eb000e0c tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:57.306594 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-da365ecd-f75a-4efb-9992-af831eee4713 tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:57.307042 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-da365ecd-f75a-4efb-9992-af831eee4713 tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:57.307504 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d8a69acb-dc89-46f5-af68-c6b2eb000e0c tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:57.308116 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d8a69acb-dc89-46f5-af68-c6b2eb000e0c tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:57.308697 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d8a69acb-dc89-46f5-af68-c6b2eb000e0c tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:57.336725 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-da365ecd-f75a-4efb-9992-af831eee4713 tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] HTTP exception thrown: Instance c61a781e-96f8-4bf6-8d3d-b8c3e9c58808 could not be found. Oct 04 20:36:57.343059 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-da365ecd-f75a-4efb-9992-af831eee4713 tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] Request method failure captured: Oct 04 20:36:57.343059 n-d-854823-8 devstack@n-api.service[128801]: request: DELETE /compute/v2.1/servers/c61a781e-96f8-4bf6-8d3d-b8c3e9c58808 HTTP/1.1 Oct 04 20:36:57.343059 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:36:57.343059 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:36:57.343059 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:36:57.343059 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 0 Oct 04 20:36:57.343059 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:36:57.343059 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:36:57.343059 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:36:57.343059 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:36:57.343059 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJk_6sVbi3BeWY_ruYr_DC9VgN4F00LzOBWSQ6FiPQOS1Te3uyu6mf24vxC0x9_Gv8TwBIwuNPSMdB78QD6s2TgMo6txRgheFLi7cqwyfgdWg4JJghHem0OCXPxRn0FhZG07qnvS9BASIsH0eu7K_34rISLj3XY_ZJqIW-2dwVbp8Ow Oct 04 20:36:57.343059 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:36:57.343059 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:36:57.343059 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:36:57.343059 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:36:57.343059 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:36:57.343059 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:36:57.343059 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: 2d53510a3a5543618f6b701827e7c365 Oct 04 20:36:57.343059 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-ImagesNegativeTestJSON-2001306624 Oct 04 20:36:57.343059 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 20:36:57.343059 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 20:36:57.347008 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_2d53510a3a5543618f6b701827e7c365", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2d53510a3a5543618f6b701827e7c365"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2d53510a3a5543618f6b701827e7c365"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/2d53510a3a5543618f6b701827e7c365"}]}] Oct 04 20:36:57.347008 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-ImagesNegativeTestJSON-2001306624 Oct 04 20:36:57.347008 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: 2d53510a3a5543618f6b701827e7c365 Oct 04 20:36:57.347008 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-2001306624 Oct 04 20:36:57.347008 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-ImagesNegativeTestJSON-2001306624-project Oct 04 20:36:57.347008 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:36:57.347008 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:36:57.347008 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: 70b2a3b8a3d34ecdaab68b7f18f7788e Oct 04 20:36:57.347008 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-ImagesNegativeTestJSON-2001306624-project Oct 04 20:36:57.347008 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 20:36:57.347008 n-d-854823-8 devstack@n-api.service[128801]: exception: Instance c61a781e-96f8-4bf6-8d3d-b8c3e9c58808 could not be found. Oct 04 20:36:57.347008 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': 'c61a781e-96f8-4bf6-8d3d-b8c3e9c58808'} Oct 04 20:36:57.349164 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:36:57.349164 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:36:57.349164 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:36:57.349164 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:36:57.349164 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:36:57.349164 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:36:57.349164 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:36:57.349164 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:36:57.349164 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:36:57.349164 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:36:57.349164 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c61a781e-96f8-4bf6-8d3d-b8c3e9c58808 could not be found. Oct 04 20:36:57.349164 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:36:57.349164 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:36:57.349164 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:36:57.349164 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:36:57.349164 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:36:57.349164 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:36:57.349164 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:36:57.349164 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:36:57.349164 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:36:57.351217 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:36:57.351217 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 20:36:57.351217 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 20:36:57.351217 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 20:36:57.351217 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 20:36:57.351217 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:36:57.351217 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:36:57.351217 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:36:57.351217 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:36:57.351217 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c61a781e-96f8-4bf6-8d3d-b8c3e9c58808 could not be found. Oct 04 20:36:57.351217 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:36:57.351217 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:36:57.351217 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:36:57.351217 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:36:57.351217 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:36:57.351217 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:36:57.351217 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:36:57.351217 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:36:57.351217 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c61a781e-96f8-4bf6-8d3d-b8c3e9c58808 could not be found. Oct 04 20:36:57.351217 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:36:57.356093 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-da365ecd-f75a-4efb-9992-af831eee4713 tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] Returning 404 to user: Instance c61a781e-96f8-4bf6-8d3d-b8c3e9c58808 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:36:57.358223 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-da365ecd-f75a-4efb-9992-af831eee4713 tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] 10.222.0.33 "DELETE /compute/v2.1/servers/c61a781e-96f8-4bf6-8d3d-b8c3e9c58808" status: 404 len: 111 microversion: 2.1 time: 0.083104 Oct 04 20:36:57.361538 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 439/867] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 20:36:57 2022] DELETE /compute/v2.1/servers/c61a781e-96f8-4bf6-8d3d-b8c3e9c58808 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:36:57.369652 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-4e7e9b3a-b6ab-4577-8144-791949ab62f2 tempest-ServerDiagnosticsNegativeTest-417074328 tempest-ServerDiagnosticsNegativeTest-417074328-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:57.370189 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-4e7e9b3a-b6ab-4577-8144-791949ab62f2 tempest-ServerDiagnosticsNegativeTest-417074328 tempest-ServerDiagnosticsNegativeTest-417074328-project] [instance: a42d2956-071d-4bad-b9a6-a0f78fcb0498] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:57.387081 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4e7e9b3a-b6ab-4577-8144-791949ab62f2 tempest-ServerDiagnosticsNegativeTest-417074328 tempest-ServerDiagnosticsNegativeTest-417074328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:57.387718 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4e7e9b3a-b6ab-4577-8144-791949ab62f2 tempest-ServerDiagnosticsNegativeTest-417074328 tempest-ServerDiagnosticsNegativeTest-417074328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:57.388012 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4e7e9b3a-b6ab-4577-8144-791949ab62f2 tempest-ServerDiagnosticsNegativeTest-417074328 tempest-ServerDiagnosticsNegativeTest-417074328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:57.388733 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4e7e9b3a-b6ab-4577-8144-791949ab62f2 tempest-ServerDiagnosticsNegativeTest-417074328 tempest-ServerDiagnosticsNegativeTest-417074328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:57.389181 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4e7e9b3a-b6ab-4577-8144-791949ab62f2 tempest-ServerDiagnosticsNegativeTest-417074328 tempest-ServerDiagnosticsNegativeTest-417074328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:57.389877 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4e7e9b3a-b6ab-4577-8144-791949ab62f2 tempest-ServerDiagnosticsNegativeTest-417074328 tempest-ServerDiagnosticsNegativeTest-417074328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:57.430617 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-4e7e9b3a-b6ab-4577-8144-791949ab62f2 tempest-ServerDiagnosticsNegativeTest-417074328 tempest-ServerDiagnosticsNegativeTest-417074328-project] Policy check for os_compute_api:os-server-diagnostics failed with credentials {'is_admin': False, 'user_id': 'd2581847c48447f5867331fb858ebb0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930bc715520746bc8a320d082e47af81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:57.437480 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-4e7e9b3a-b6ab-4577-8144-791949ab62f2 tempest-ServerDiagnosticsNegativeTest-417074328 tempest-ServerDiagnosticsNegativeTest-417074328-project] Request method failure captured: Oct 04 20:36:57.437480 n-d-854823-8 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/a42d2956-071d-4bad-b9a6-a0f78fcb0498/diagnostics HTTP/1.1 Oct 04 20:36:57.437480 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:36:57.437480 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:36:57.437480 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:36:57.437480 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 0 Oct 04 20:36:57.437480 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:36:57.437480 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:36:57.437480 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:36:57.437480 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:36:57.437480 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJlOLAqxLAAwVeTMqgjF-NwkgKl5Ah3jTFmxY9-5NVG-2TZxY-xGy4NeREXcjiqL_9jY8vT0uLdle6rq4KkzRcZ6zRIQKb6C8RvxIYsBYNirQs6F0QhYuGDABErYdGnVlvigRLxN9hXrwhuWNQLrRTw102oCbiF7CulP5dRIPyzjCm4 Oct 04 20:36:57.437480 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:36:57.437480 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:36:57.437480 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:36:57.437480 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:36:57.437480 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:36:57.437480 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:36:57.437480 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: 930bc715520746bc8a320d082e47af81 Oct 04 20:36:57.437480 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-417074328 Oct 04 20:36:57.437480 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 20:36:57.437480 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 20:36:57.439132 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_930bc715520746bc8a320d082e47af81", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/930bc715520746bc8a320d082e47af81"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/930bc715520746bc8a320d082e47af81"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/930bc715520746bc8a320d082e47af81"}]}] Oct 04 20:36:57.439132 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-417074328 Oct 04 20:36:57.439132 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: 930bc715520746bc8a320d082e47af81 Oct 04 20:36:57.439132 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-417074328 Oct 04 20:36:57.439132 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-ServerDiagnosticsNegativeTest-417074328-project Oct 04 20:36:57.439132 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:36:57.439132 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:36:57.439132 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: d2581847c48447f5867331fb858ebb0a Oct 04 20:36:57.439132 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-417074328-project Oct 04 20:36:57.439132 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 20:36:57.439132 n-d-854823-8 devstack@n-api.service[128801]: exception: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Oct 04 20:36:57.439993 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'server_id': 'a42d2956-071d-4bad-b9a6-a0f78fcb0498'} Oct 04 20:36:57.439993 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:36:57.439993 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:36:57.439993 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:36:57.439993 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:36:57.439993 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:36:57.439993 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:36:57.439993 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:36:57.439993 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:36:57.439993 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_diagnostics.py", line 38, in index Oct 04 20:36:57.439993 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi context.can(sd_policies.BASE_POLICY_NAME, Oct 04 20:36:57.439993 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 20:36:57.439993 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 20:36:57.439993 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 20:36:57.439993 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 20:36:57.439993 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 20:36:57.439993 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 20:36:57.439993 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 20:36:57.439993 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 20:36:57.439993 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 20:36:57.442172 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 20:36:57.442172 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 20:36:57.442172 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 20:36:57.442172 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 20:36:57.442172 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 20:36:57.442172 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Oct 04 20:36:57.442172 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:36:57.442172 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:36:57.442172 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:36:57.442172 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:36:57.442172 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:36:57.442172 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:36:57.442172 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 20:36:57.442172 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 20:36:57.442172 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Oct 04 20:36:57.442172 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:36:57.446335 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-4e7e9b3a-b6ab-4577-8144-791949ab62f2 tempest-ServerDiagnosticsNegativeTest-417074328 tempest-ServerDiagnosticsNegativeTest-417074328-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:36:57.456538 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-4e7e9b3a-b6ab-4577-8144-791949ab62f2 tempest-ServerDiagnosticsNegativeTest-417074328 tempest-ServerDiagnosticsNegativeTest-417074328-project] 10.222.0.33 "GET /compute/v2.1/servers/a42d2956-071d-4bad-b9a6-a0f78fcb0498/diagnostics" status: 403 len: 117 microversion: 2.1 time: 0.083732 Oct 04 20:36:57.470459 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 440/868] 10.222.0.33 () {58 vars in 1272 bytes} [Tue Oct 4 20:36:57 2022] GET /compute/v2.1/servers/a42d2956-071d-4bad-b9a6-a0f78fcb0498/diagnostics => generated 117 bytes in 96 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:36:57.487282 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2cc9c86d-0d9b-40ff-9861-681d5882c8a9 tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:57.490545 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-2cc9c86d-0d9b-40ff-9861-681d5882c8a9 tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] [instance: c61a781e-96f8-4bf6-8d3d-b8c3e9c58808] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:57.508333 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2cc9c86d-0d9b-40ff-9861-681d5882c8a9 tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:57.509212 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2cc9c86d-0d9b-40ff-9861-681d5882c8a9 tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:57.509832 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2cc9c86d-0d9b-40ff-9861-681d5882c8a9 tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:57.513250 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2cc9c86d-0d9b-40ff-9861-681d5882c8a9 tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:57.514207 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2cc9c86d-0d9b-40ff-9861-681d5882c8a9 tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:57.514595 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2cc9c86d-0d9b-40ff-9861-681d5882c8a9 tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:57.562457 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-2cc9c86d-0d9b-40ff-9861-681d5882c8a9 tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] HTTP exception thrown: Instance c61a781e-96f8-4bf6-8d3d-b8c3e9c58808 could not be found. Oct 04 20:36:57.570572 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2cc9c86d-0d9b-40ff-9861-681d5882c8a9 tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] Request method failure captured: Oct 04 20:36:57.570572 n-d-854823-8 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/c61a781e-96f8-4bf6-8d3d-b8c3e9c58808 HTTP/1.1 Oct 04 20:36:57.570572 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:36:57.570572 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:36:57.570572 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:36:57.570572 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 0 Oct 04 20:36:57.570572 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:36:57.570572 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:36:57.570572 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:36:57.570572 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:36:57.570572 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJk_6sVbi3BeWY_ruYr_DC9VgN4F00LzOBWSQ6FiPQOS1Te3uyu6mf24vxC0x9_Gv8TwBIwuNPSMdB78QD6s2TgMo6txRgheFLi7cqwyfgdWg4JJghHem0OCXPxRn0FhZG07qnvS9BASIsH0eu7K_34rISLj3XY_ZJqIW-2dwVbp8Ow Oct 04 20:36:57.570572 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:36:57.570572 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:36:57.570572 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:36:57.570572 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:36:57.570572 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:36:57.570572 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:36:57.570572 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: 2d53510a3a5543618f6b701827e7c365 Oct 04 20:36:57.570572 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-ImagesNegativeTestJSON-2001306624 Oct 04 20:36:57.570572 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 20:36:57.570572 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 20:36:57.571962 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_2d53510a3a5543618f6b701827e7c365", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2d53510a3a5543618f6b701827e7c365"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2d53510a3a5543618f6b701827e7c365"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/2d53510a3a5543618f6b701827e7c365"}]}] Oct 04 20:36:57.571962 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-ImagesNegativeTestJSON-2001306624 Oct 04 20:36:57.571962 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: 2d53510a3a5543618f6b701827e7c365 Oct 04 20:36:57.571962 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-2001306624 Oct 04 20:36:57.571962 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-ImagesNegativeTestJSON-2001306624-project Oct 04 20:36:57.571962 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:36:57.571962 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:36:57.571962 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: 70b2a3b8a3d34ecdaab68b7f18f7788e Oct 04 20:36:57.571962 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-ImagesNegativeTestJSON-2001306624-project Oct 04 20:36:57.571962 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 20:36:57.571962 n-d-854823-8 devstack@n-api.service[128801]: exception: Instance c61a781e-96f8-4bf6-8d3d-b8c3e9c58808 could not be found. Oct 04 20:36:57.571962 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': 'c61a781e-96f8-4bf6-8d3d-b8c3e9c58808'} Oct 04 20:36:57.572686 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:36:57.572686 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:36:57.572686 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:36:57.572686 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:36:57.572686 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:36:57.572686 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:36:57.572686 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:36:57.572686 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:36:57.572686 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:36:57.572686 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:36:57.572686 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c61a781e-96f8-4bf6-8d3d-b8c3e9c58808 could not be found. Oct 04 20:36:57.572686 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:36:57.572686 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:36:57.572686 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:36:57.572686 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:36:57.572686 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:36:57.572686 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:36:57.572686 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:36:57.572686 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:36:57.572686 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:36:57.573872 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:36:57.573872 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:36:57.573872 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:36:57.573872 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:36:57.573872 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:36:57.573872 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:36:57.573872 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:36:57.573872 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c61a781e-96f8-4bf6-8d3d-b8c3e9c58808 could not be found. Oct 04 20:36:57.573872 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:36:57.573872 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:36:57.573872 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:36:57.573872 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:36:57.573872 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:36:57.573872 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:36:57.573872 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:36:57.573872 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:36:57.573872 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c61a781e-96f8-4bf6-8d3d-b8c3e9c58808 could not be found. Oct 04 20:36:57.573872 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:36:57.574977 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2cc9c86d-0d9b-40ff-9861-681d5882c8a9 tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] Returning 404 to user: Instance c61a781e-96f8-4bf6-8d3d-b8c3e9c58808 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:36:57.574977 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-2cc9c86d-0d9b-40ff-9861-681d5882c8a9 tempest-ImagesNegativeTestJSON-2001306624 tempest-ImagesNegativeTestJSON-2001306624-project] 10.222.0.33 "GET /compute/v2.1/servers/c61a781e-96f8-4bf6-8d3d-b8c3e9c58808" status: 404 len: 111 microversion: 2.1 time: 0.095981 Oct 04 20:36:57.576267 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 441/869] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:36:57 2022] GET /compute/v2.1/servers/c61a781e-96f8-4bf6-8d3d-b8c3e9c58808 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:36:57.582133 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5f8c5ccd-724d-413f-a942-4197be035b58 tempest-ServerDiagnosticsNegativeTest-417074328 tempest-ServerDiagnosticsNegativeTest-417074328-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:57.582658 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-5f8c5ccd-724d-413f-a942-4197be035b58 tempest-ServerDiagnosticsNegativeTest-417074328 tempest-ServerDiagnosticsNegativeTest-417074328-project] [instance: a42d2956-071d-4bad-b9a6-a0f78fcb0498] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:57.597004 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5f8c5ccd-724d-413f-a942-4197be035b58 tempest-ServerDiagnosticsNegativeTest-417074328 tempest-ServerDiagnosticsNegativeTest-417074328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:57.603613 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5f8c5ccd-724d-413f-a942-4197be035b58 tempest-ServerDiagnosticsNegativeTest-417074328 tempest-ServerDiagnosticsNegativeTest-417074328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:57.604332 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5f8c5ccd-724d-413f-a942-4197be035b58 tempest-ServerDiagnosticsNegativeTest-417074328 tempest-ServerDiagnosticsNegativeTest-417074328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:57.612551 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5f8c5ccd-724d-413f-a942-4197be035b58 tempest-ServerDiagnosticsNegativeTest-417074328 tempest-ServerDiagnosticsNegativeTest-417074328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:57.613283 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5f8c5ccd-724d-413f-a942-4197be035b58 tempest-ServerDiagnosticsNegativeTest-417074328 tempest-ServerDiagnosticsNegativeTest-417074328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:57.613913 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5f8c5ccd-724d-413f-a942-4197be035b58 tempest-ServerDiagnosticsNegativeTest-417074328 tempest-ServerDiagnosticsNegativeTest-417074328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:57.673427 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-5f8c5ccd-724d-413f-a942-4197be035b58 tempest-ServerDiagnosticsNegativeTest-417074328 tempest-ServerDiagnosticsNegativeTest-417074328-project] [instance: a42d2956-071d-4bad-b9a6-a0f78fcb0498] Going to try to terminate instance {{(pid=128801) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:36:57.807581 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-d8a69acb-dc89-46f5-af68-c6b2eb000e0c tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a24944aeb34a5ea228965be9bf4ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c288268acb30475bbc065a8f72cb21d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:57.830225 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-d8a69acb-dc89-46f5-af68-c6b2eb000e0c tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] 10.222.0.33 "GET /compute/v2.1/servers/9f8cc082-0a37-4123-a680-1210a90b3ca9" status: 200 len: 1472 microversion: 2.1 time: 0.555989 Oct 04 20:36:57.831400 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 429/870] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:36:57 2022] GET /compute/v2.1/servers/9f8cc082-0a37-4123-a680-1210a90b3ca9 => generated 1472 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:36:57.840186 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-3fecedcb-ee66-4468-8eab-2ea4f6527085 tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:57.841282 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-3fecedcb-ee66-4468-8eab-2ea4f6527085 tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] [instance: 7d9db253-559a-4d4b-9a5e-42c8f63f6cb7] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:57.851510 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3fecedcb-ee66-4468-8eab-2ea4f6527085 tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:57.852853 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3fecedcb-ee66-4468-8eab-2ea4f6527085 tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:57.853832 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3fecedcb-ee66-4468-8eab-2ea4f6527085 tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:57.855961 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3fecedcb-ee66-4468-8eab-2ea4f6527085 tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:57.857530 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3fecedcb-ee66-4468-8eab-2ea4f6527085 tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:57.859144 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3fecedcb-ee66-4468-8eab-2ea4f6527085 tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:57.899684 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5f8c5ccd-724d-413f-a942-4197be035b58 tempest-ServerDiagnosticsNegativeTest-417074328 tempest-ServerDiagnosticsNegativeTest-417074328-project] 10.222.0.33 "DELETE /compute/v2.1/servers/a42d2956-071d-4bad-b9a6-a0f78fcb0498" status: 204 len: 0 microversion: 2.1 time: 0.321813 Oct 04 20:36:57.900325 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 442/871] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 20:36:57 2022] DELETE /compute/v2.1/servers/a42d2956-071d-4bad-b9a6-a0f78fcb0498 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:36:57.908118 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c000ef81-ae4c-4b9a-a229-4f0e1bc8f0a5 tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:57.908810 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c000ef81-ae4c-4b9a-a229-4f0e1bc8f0a5 tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] [instance: 33bf1c5a-fbf7-4db1-b2c8-e4ab05149f25] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:57.932907 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c000ef81-ae4c-4b9a-a229-4f0e1bc8f0a5 tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:57.933406 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c000ef81-ae4c-4b9a-a229-4f0e1bc8f0a5 tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:57.933838 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c000ef81-ae4c-4b9a-a229-4f0e1bc8f0a5 tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:57.934578 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c000ef81-ae4c-4b9a-a229-4f0e1bc8f0a5 tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:57.935021 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c000ef81-ae4c-4b9a-a229-4f0e1bc8f0a5 tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:57.943243 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c000ef81-ae4c-4b9a-a229-4f0e1bc8f0a5 tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:58.274203 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-3fecedcb-ee66-4468-8eab-2ea4f6527085 tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b786966441fc45f28890bf56cdfafb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8cc219b86ed450cbe7c780d7f79d9f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:58.289617 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-3fecedcb-ee66-4468-8eab-2ea4f6527085 tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] 10.222.0.33 "GET /compute/v2.1/servers/7d9db253-559a-4d4b-9a5e-42c8f63f6cb7" status: 200 len: 1371 microversion: 2.1 time: 0.456074 Oct 04 20:36:58.291561 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 430/872] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:36:57 2022] GET /compute/v2.1/servers/7d9db253-559a-4d4b-9a5e-42c8f63f6cb7 => generated 1371 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:36:58.304192 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-edb9b40d-6420-4d9e-aabe-22ccd22f60e3 tempest-ServerDiagnosticsNegativeTest-417074328 tempest-ServerDiagnosticsNegativeTest-417074328-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:58.305979 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-edb9b40d-6420-4d9e-aabe-22ccd22f60e3 tempest-ServerDiagnosticsNegativeTest-417074328 tempest-ServerDiagnosticsNegativeTest-417074328-project] [instance: a42d2956-071d-4bad-b9a6-a0f78fcb0498] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:58.314853 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-edb9b40d-6420-4d9e-aabe-22ccd22f60e3 tempest-ServerDiagnosticsNegativeTest-417074328 tempest-ServerDiagnosticsNegativeTest-417074328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:58.316074 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-edb9b40d-6420-4d9e-aabe-22ccd22f60e3 tempest-ServerDiagnosticsNegativeTest-417074328 tempest-ServerDiagnosticsNegativeTest-417074328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:58.316893 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-edb9b40d-6420-4d9e-aabe-22ccd22f60e3 tempest-ServerDiagnosticsNegativeTest-417074328 tempest-ServerDiagnosticsNegativeTest-417074328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:58.319013 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-edb9b40d-6420-4d9e-aabe-22ccd22f60e3 tempest-ServerDiagnosticsNegativeTest-417074328 tempest-ServerDiagnosticsNegativeTest-417074328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:58.319785 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-edb9b40d-6420-4d9e-aabe-22ccd22f60e3 tempest-ServerDiagnosticsNegativeTest-417074328 tempest-ServerDiagnosticsNegativeTest-417074328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:58.320868 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-edb9b40d-6420-4d9e-aabe-22ccd22f60e3 tempest-ServerDiagnosticsNegativeTest-417074328 tempest-ServerDiagnosticsNegativeTest-417074328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:58.331067 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c000ef81-ae4c-4b9a-a229-4f0e1bc8f0a5 tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa55ca3469648b0b1a2e1a29541c462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8659949e00dc429e8667767d0f126771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:58.342260 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c000ef81-ae4c-4b9a-a229-4f0e1bc8f0a5 tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] 10.222.0.33 "GET /compute/v2.1/servers/33bf1c5a-fbf7-4db1-b2c8-e4ab05149f25" status: 200 len: 1402 microversion: 2.1 time: 0.440759 Oct 04 20:36:58.356650 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 443/873] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:36:57 2022] GET /compute/v2.1/servers/33bf1c5a-fbf7-4db1-b2c8-e4ab05149f25 => generated 1402 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:36:58.368437 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-113d5dbe-3c10-4f5e-b28f-a95eca3400ee tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:58.372968 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-113d5dbe-3c10-4f5e-b28f-a95eca3400ee tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] [instance: 465ad440-a27e-4ff6-bb31-09f3545e166a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:58.389192 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:36:58.391061 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-113d5dbe-3c10-4f5e-b28f-a95eca3400ee tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:58.392537 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-113d5dbe-3c10-4f5e-b28f-a95eca3400ee tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:58.392537 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-113d5dbe-3c10-4f5e-b28f-a95eca3400ee tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:58.393290 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-113d5dbe-3c10-4f5e-b28f-a95eca3400ee tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:58.395069 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-113d5dbe-3c10-4f5e-b28f-a95eca3400ee tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:58.397767 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-113d5dbe-3c10-4f5e-b28f-a95eca3400ee tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:58.684253 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-edb9b40d-6420-4d9e-aabe-22ccd22f60e3 tempest-ServerDiagnosticsNegativeTest-417074328 tempest-ServerDiagnosticsNegativeTest-417074328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2581847c48447f5867331fb858ebb0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930bc715520746bc8a320d082e47af81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:58.697444 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-edb9b40d-6420-4d9e-aabe-22ccd22f60e3 tempest-ServerDiagnosticsNegativeTest-417074328 tempest-ServerDiagnosticsNegativeTest-417074328-project] 10.222.0.33 "GET /compute/v2.1/servers/a42d2956-071d-4bad-b9a6-a0f78fcb0498" status: 200 len: 1478 microversion: 2.1 time: 0.403900 Oct 04 20:36:58.716769 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 431/874] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:36:58 2022] GET /compute/v2.1/servers/a42d2956-071d-4bad-b9a6-a0f78fcb0498 => generated 1478 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:36:58.722062 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-255ca901-8560-4734-8c5b-ab37236f6e96 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:58.722952 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-255ca901-8560-4734-8c5b-ab37236f6e96 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] [instance: 5dbb0cb7-e2d8-416a-a486-72d4398ee877] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:58.729930 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-255ca901-8560-4734-8c5b-ab37236f6e96 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:58.730745 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-255ca901-8560-4734-8c5b-ab37236f6e96 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:58.731620 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-255ca901-8560-4734-8c5b-ab37236f6e96 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:58.732531 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-255ca901-8560-4734-8c5b-ab37236f6e96 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:58.733168 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-255ca901-8560-4734-8c5b-ab37236f6e96 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:58.733533 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-113d5dbe-3c10-4f5e-b28f-a95eca3400ee tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3563efe2b8c94931a2a46c4e14811b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3118a5d96843d3bede1ed94bd9717e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:58.734033 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-255ca901-8560-4734-8c5b-ab37236f6e96 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:58.746144 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-113d5dbe-3c10-4f5e-b28f-a95eca3400ee tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] 10.222.0.33 "GET /compute/v2.1/servers/465ad440-a27e-4ff6-bb31-09f3545e166a" status: 200 len: 1379 microversion: 2.1 time: 0.388136 Oct 04 20:36:58.746963 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 444/875] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:36:58 2022] GET /compute/v2.1/servers/465ad440-a27e-4ff6-bb31-09f3545e166a => generated 1379 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:36:58.859617 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-835f57da-b918-4d77-9d2f-d5205b771b36 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:58.860729 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-835f57da-b918-4d77-9d2f-d5205b771b36 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] [instance: 9f8cc082-0a37-4123-a680-1210a90b3ca9] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:58.871155 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-835f57da-b918-4d77-9d2f-d5205b771b36 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:58.874094 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-835f57da-b918-4d77-9d2f-d5205b771b36 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:58.874769 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-835f57da-b918-4d77-9d2f-d5205b771b36 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:58.875669 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-835f57da-b918-4d77-9d2f-d5205b771b36 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:58.878495 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-835f57da-b918-4d77-9d2f-d5205b771b36 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:58.879132 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-835f57da-b918-4d77-9d2f-d5205b771b36 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:59.409031 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-255ca901-8560-4734-8c5b-ab37236f6e96 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:59.421648 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-255ca901-8560-4734-8c5b-ab37236f6e96 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:59.424387 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-255ca901-8560-4734-8c5b-ab37236f6e96 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:59.430788 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-255ca901-8560-4734-8c5b-ab37236f6e96 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] 10.222.0.33 "GET /compute/v2.1/servers/5dbb0cb7-e2d8-416a-a486-72d4398ee877" status: 200 len: 1314 microversion: 2.25 time: 0.708221 Oct 04 20:36:59.431696 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 432/876] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:36:58 2022] GET /compute/v2.1/servers/5dbb0cb7-e2d8-416a-a486-72d4398ee877 => generated 1314 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:36:59.442136 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-a3de7824-a8d4-4bcf-8bfc-3629ab504fbd tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:59.446791 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-a3de7824-a8d4-4bcf-8bfc-3629ab504fbd tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] [instance: 7d9db253-559a-4d4b-9a5e-42c8f63f6cb7] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:59.473862 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a3de7824-a8d4-4bcf-8bfc-3629ab504fbd tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:59.475563 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a3de7824-a8d4-4bcf-8bfc-3629ab504fbd tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:59.477120 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a3de7824-a8d4-4bcf-8bfc-3629ab504fbd tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:59.477877 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a3de7824-a8d4-4bcf-8bfc-3629ab504fbd tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:59.478372 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a3de7824-a8d4-4bcf-8bfc-3629ab504fbd tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:59.478806 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a3de7824-a8d4-4bcf-8bfc-3629ab504fbd tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:59.716419 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-835f57da-b918-4d77-9d2f-d5205b771b36 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a24944aeb34a5ea228965be9bf4ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c288268acb30475bbc065a8f72cb21d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:59.729687 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-835f57da-b918-4d77-9d2f-d5205b771b36 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] 10.222.0.33 "GET /compute/v2.1/servers/9f8cc082-0a37-4123-a680-1210a90b3ca9" status: 200 len: 1472 microversion: 2.1 time: 0.873312 Oct 04 20:36:59.735014 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 445/877] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:36:58 2022] GET /compute/v2.1/servers/9f8cc082-0a37-4123-a680-1210a90b3ca9 => generated 1472 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:36:59.736981 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-73227ce5-8024-4969-87aa-587307d711ee tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:59.738738 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-73227ce5-8024-4969-87aa-587307d711ee tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] [instance: 33bf1c5a-fbf7-4db1-b2c8-e4ab05149f25] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:59.746672 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-73227ce5-8024-4969-87aa-587307d711ee tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:59.747176 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-73227ce5-8024-4969-87aa-587307d711ee tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:59.747713 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-73227ce5-8024-4969-87aa-587307d711ee tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:59.749019 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-73227ce5-8024-4969-87aa-587307d711ee tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:59.749480 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-73227ce5-8024-4969-87aa-587307d711ee tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:59.750071 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-73227ce5-8024-4969-87aa-587307d711ee tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:59.852075 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-a3de7824-a8d4-4bcf-8bfc-3629ab504fbd tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b786966441fc45f28890bf56cdfafb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8cc219b86ed450cbe7c780d7f79d9f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:36:59.861545 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-a3de7824-a8d4-4bcf-8bfc-3629ab504fbd tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] 10.222.0.33 "GET /compute/v2.1/servers/7d9db253-559a-4d4b-9a5e-42c8f63f6cb7" status: 200 len: 1371 microversion: 2.1 time: 0.426985 Oct 04 20:36:59.867162 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 433/878] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:36:59 2022] GET /compute/v2.1/servers/7d9db253-559a-4d4b-9a5e-42c8f63f6cb7 => generated 1371 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:36:59.882365 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-cd59ac65-03ef-4148-a773-cacdfb1b2372 req-533547ea-6ba0-4413-9a8b-597147a6dd36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "465ad440-a27e-4ff6-bb31-09f3545e166a", "name": "network-vif-plugged", "status": "completed", "tag": "c16cb04f-6af6-4073-98de-ed8d89a2e3c2"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:36:59.893639 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-cd59ac65-03ef-4148-a773-cacdfb1b2372 req-533547ea-6ba0-4413-9a8b-597147a6dd36 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:59.894378 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-cd59ac65-03ef-4148-a773-cacdfb1b2372 req-533547ea-6ba0-4413-9a8b-597147a6dd36 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:59.895178 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-cd59ac65-03ef-4148-a773-cacdfb1b2372 req-533547ea-6ba0-4413-9a8b-597147a6dd36 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:59.913740 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-cd59ac65-03ef-4148-a773-cacdfb1b2372 req-533547ea-6ba0-4413-9a8b-597147a6dd36 service nova] Creating event network-vif-plugged:c16cb04f-6af6-4073-98de-ed8d89a2e3c2 for instance 465ad440-a27e-4ff6-bb31-09f3545e166a on n-h2-854823-8 Oct 04 20:36:59.921081 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-cd59ac65-03ef-4148-a773-cacdfb1b2372 req-533547ea-6ba0-4413-9a8b-597147a6dd36 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052425 Oct 04 20:36:59.922624 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 434/879] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:36:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:36:59.938900 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-24001bc5-01ae-4bf6-8c69-8c4221a76a8e tempest-ServerDiagnosticsNegativeTest-417074328 tempest-ServerDiagnosticsNegativeTest-417074328-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:36:59.941680 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-24001bc5-01ae-4bf6-8c69-8c4221a76a8e tempest-ServerDiagnosticsNegativeTest-417074328 tempest-ServerDiagnosticsNegativeTest-417074328-project] [instance: a42d2956-071d-4bad-b9a6-a0f78fcb0498] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:36:59.949619 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-24001bc5-01ae-4bf6-8c69-8c4221a76a8e tempest-ServerDiagnosticsNegativeTest-417074328 tempest-ServerDiagnosticsNegativeTest-417074328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:59.950483 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-24001bc5-01ae-4bf6-8c69-8c4221a76a8e tempest-ServerDiagnosticsNegativeTest-417074328 tempest-ServerDiagnosticsNegativeTest-417074328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:59.951037 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-24001bc5-01ae-4bf6-8c69-8c4221a76a8e tempest-ServerDiagnosticsNegativeTest-417074328 tempest-ServerDiagnosticsNegativeTest-417074328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:36:59.952061 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-24001bc5-01ae-4bf6-8c69-8c4221a76a8e tempest-ServerDiagnosticsNegativeTest-417074328 tempest-ServerDiagnosticsNegativeTest-417074328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:36:59.952700 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-24001bc5-01ae-4bf6-8c69-8c4221a76a8e tempest-ServerDiagnosticsNegativeTest-417074328 tempest-ServerDiagnosticsNegativeTest-417074328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:36:59.953308 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-24001bc5-01ae-4bf6-8c69-8c4221a76a8e tempest-ServerDiagnosticsNegativeTest-417074328 tempest-ServerDiagnosticsNegativeTest-417074328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:00.149390 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-73227ce5-8024-4969-87aa-587307d711ee tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa55ca3469648b0b1a2e1a29541c462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8659949e00dc429e8667767d0f126771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:00.152766 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:37:00.162273 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-73227ce5-8024-4969-87aa-587307d711ee tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] 10.222.0.33 "GET /compute/v2.1/servers/33bf1c5a-fbf7-4db1-b2c8-e4ab05149f25" status: 200 len: 1402 microversion: 2.1 time: 0.428376 Oct 04 20:37:00.178282 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 446/880] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:36:59 2022] GET /compute/v2.1/servers/33bf1c5a-fbf7-4db1-b2c8-e4ab05149f25 => generated 1402 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:37:00.182481 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-739001af-0545-4327-a1f4-73c42264d392 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:00.183099 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-739001af-0545-4327-a1f4-73c42264d392 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] [instance: 465ad440-a27e-4ff6-bb31-09f3545e166a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:00.200648 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-739001af-0545-4327-a1f4-73c42264d392 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:00.201151 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-739001af-0545-4327-a1f4-73c42264d392 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:00.201589 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-739001af-0545-4327-a1f4-73c42264d392 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:00.202303 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-739001af-0545-4327-a1f4-73c42264d392 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:00.202957 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-739001af-0545-4327-a1f4-73c42264d392 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:00.203383 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-739001af-0545-4327-a1f4-73c42264d392 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:00.583138 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-24001bc5-01ae-4bf6-8c69-8c4221a76a8e tempest-ServerDiagnosticsNegativeTest-417074328 tempest-ServerDiagnosticsNegativeTest-417074328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2581847c48447f5867331fb858ebb0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930bc715520746bc8a320d082e47af81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:00.591552 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-24001bc5-01ae-4bf6-8c69-8c4221a76a8e tempest-ServerDiagnosticsNegativeTest-417074328 tempest-ServerDiagnosticsNegativeTest-417074328-project] 10.222.0.33 "GET /compute/v2.1/servers/a42d2956-071d-4bad-b9a6-a0f78fcb0498" status: 200 len: 1478 microversion: 2.1 time: 0.666298 Oct 04 20:37:00.592252 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 435/881] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:36:59 2022] GET /compute/v2.1/servers/a42d2956-071d-4bad-b9a6-a0f78fcb0498 => generated 1478 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:37:00.597206 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-3dc0ef97-2272-446d-8448-4a9c13ac8f3a tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:00.597929 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-3dc0ef97-2272-446d-8448-4a9c13ac8f3a tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] [instance: 5dbb0cb7-e2d8-416a-a486-72d4398ee877] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:00.604909 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3dc0ef97-2272-446d-8448-4a9c13ac8f3a tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:00.605513 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3dc0ef97-2272-446d-8448-4a9c13ac8f3a tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:00.606040 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3dc0ef97-2272-446d-8448-4a9c13ac8f3a tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:00.606983 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3dc0ef97-2272-446d-8448-4a9c13ac8f3a tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:00.607597 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3dc0ef97-2272-446d-8448-4a9c13ac8f3a tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:00.608844 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3dc0ef97-2272-446d-8448-4a9c13ac8f3a tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:00.689196 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-739001af-0545-4327-a1f4-73c42264d392 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3563efe2b8c94931a2a46c4e14811b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3118a5d96843d3bede1ed94bd9717e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:00.704554 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-739001af-0545-4327-a1f4-73c42264d392 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] 10.222.0.33 "GET /compute/v2.1/servers/465ad440-a27e-4ff6-bb31-09f3545e166a" status: 200 len: 1379 microversion: 2.1 time: 0.536718 Oct 04 20:37:00.707769 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 447/882] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:37:00 2022] GET /compute/v2.1/servers/465ad440-a27e-4ff6-bb31-09f3545e166a => generated 1379 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:37:00.758488 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-875562a8-371a-4182-9b4d-d5b72f67147e tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:00.759207 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-875562a8-371a-4182-9b4d-d5b72f67147e tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] [instance: 9f8cc082-0a37-4123-a680-1210a90b3ca9] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:00.766102 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-875562a8-371a-4182-9b4d-d5b72f67147e tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:00.766928 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-875562a8-371a-4182-9b4d-d5b72f67147e tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:00.767551 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-875562a8-371a-4182-9b4d-d5b72f67147e tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:00.768385 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-875562a8-371a-4182-9b4d-d5b72f67147e tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:00.768852 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-875562a8-371a-4182-9b4d-d5b72f67147e tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:00.769451 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-875562a8-371a-4182-9b4d-d5b72f67147e tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:01.097220 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-3dc0ef97-2272-446d-8448-4a9c13ac8f3a tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:01.108131 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-3dc0ef97-2272-446d-8448-4a9c13ac8f3a tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:01.110029 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-3dc0ef97-2272-446d-8448-4a9c13ac8f3a tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:01.111351 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-3dc0ef97-2272-446d-8448-4a9c13ac8f3a tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] 10.222.0.33 "GET /compute/v2.1/servers/5dbb0cb7-e2d8-416a-a486-72d4398ee877" status: 200 len: 1362 microversion: 2.25 time: 0.517779 Oct 04 20:37:01.112228 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 436/883] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:37:00 2022] GET /compute/v2.1/servers/5dbb0cb7-e2d8-416a-a486-72d4398ee877 => generated 1362 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:37:01.134354 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-a017314d-071d-4e3f-9b46-71e8a3983235 tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:01.142485 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-a017314d-071d-4e3f-9b46-71e8a3983235 tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] [instance: 7d9db253-559a-4d4b-9a5e-42c8f63f6cb7] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:01.149419 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a017314d-071d-4e3f-9b46-71e8a3983235 tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:01.150197 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a017314d-071d-4e3f-9b46-71e8a3983235 tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:01.150810 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a017314d-071d-4e3f-9b46-71e8a3983235 tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:01.151593 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a017314d-071d-4e3f-9b46-71e8a3983235 tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:01.152063 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a017314d-071d-4e3f-9b46-71e8a3983235 tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:01.152485 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a017314d-071d-4e3f-9b46-71e8a3983235 tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:01.168211 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-875562a8-371a-4182-9b4d-d5b72f67147e tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a24944aeb34a5ea228965be9bf4ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c288268acb30475bbc065a8f72cb21d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:01.179295 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-875562a8-371a-4182-9b4d-d5b72f67147e tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] 10.222.0.33 "GET /compute/v2.1/servers/9f8cc082-0a37-4123-a680-1210a90b3ca9" status: 200 len: 1472 microversion: 2.1 time: 0.426071 Oct 04 20:37:01.185813 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 448/884] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:37:00 2022] GET /compute/v2.1/servers/9f8cc082-0a37-4123-a680-1210a90b3ca9 => generated 1472 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:37:01.195312 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-081f8c03-d07f-4568-a8c5-413afaffda9f req-33bdadd8-befd-4c59-9a2a-7f66b51082d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5dbb0cb7-e2d8-416a-a486-72d4398ee877", "tag": "cf080088-b0ac-4a20-83d3-5d85ca5cdb45"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:37:01.215984 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-081f8c03-d07f-4568-a8c5-413afaffda9f req-33bdadd8-befd-4c59-9a2a-7f66b51082d3 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:01.219993 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-081f8c03-d07f-4568-a8c5-413afaffda9f req-33bdadd8-befd-4c59-9a2a-7f66b51082d3 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:01.223090 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-081f8c03-d07f-4568-a8c5-413afaffda9f req-33bdadd8-befd-4c59-9a2a-7f66b51082d3 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:01.238249 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-081f8c03-d07f-4568-a8c5-413afaffda9f req-33bdadd8-befd-4c59-9a2a-7f66b51082d3 service nova] Creating event network-changed:cf080088-b0ac-4a20-83d3-5d85ca5cdb45 for instance 5dbb0cb7-e2d8-416a-a486-72d4398ee877 on n-h1-854823-8 Oct 04 20:37:01.248448 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-081f8c03-d07f-4568-a8c5-413afaffda9f req-33bdadd8-befd-4c59-9a2a-7f66b51082d3 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060357 Oct 04 20:37:01.249600 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 449/885] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:37:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:37:01.257404 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-60ae8f91-29ca-41b4-a455-6828ae07ac60 tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:01.258299 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-60ae8f91-29ca-41b4-a455-6828ae07ac60 tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] [instance: 33bf1c5a-fbf7-4db1-b2c8-e4ab05149f25] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:01.266605 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-60ae8f91-29ca-41b4-a455-6828ae07ac60 tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:01.267307 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-60ae8f91-29ca-41b4-a455-6828ae07ac60 tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:01.270651 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-60ae8f91-29ca-41b4-a455-6828ae07ac60 tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:01.272750 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-60ae8f91-29ca-41b4-a455-6828ae07ac60 tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:01.273529 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-60ae8f91-29ca-41b4-a455-6828ae07ac60 tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:01.280654 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-60ae8f91-29ca-41b4-a455-6828ae07ac60 tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:01.772880 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-a017314d-071d-4e3f-9b46-71e8a3983235 tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b786966441fc45f28890bf56cdfafb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8cc219b86ed450cbe7c780d7f79d9f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:01.788225 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-a017314d-071d-4e3f-9b46-71e8a3983235 tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] 10.222.0.33 "GET /compute/v2.1/servers/7d9db253-559a-4d4b-9a5e-42c8f63f6cb7" status: 200 len: 1371 microversion: 2.1 time: 0.658090 Oct 04 20:37:01.805331 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 437/886] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:37:01 2022] GET /compute/v2.1/servers/7d9db253-559a-4d4b-9a5e-42c8f63f6cb7 => generated 1371 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:37:01.810828 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-5c034ade-5257-49d4-8243-d367638f2a31 req-28d19f4c-84f0-4769-aa5d-d6eab3e90458 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a42d2956-071d-4bad-b9a6-a0f78fcb0498", "name": "network-vif-deleted", "tag": "8a587d76-a9ec-4db5-9ae4-ccae7d195099"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:37:01.836938 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-5c034ade-5257-49d4-8243-d367638f2a31 req-28d19f4c-84f0-4769-aa5d-d6eab3e90458 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:01.839343 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-5c034ade-5257-49d4-8243-d367638f2a31 req-28d19f4c-84f0-4769-aa5d-d6eab3e90458 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:01.839919 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-5c034ade-5257-49d4-8243-d367638f2a31 req-28d19f4c-84f0-4769-aa5d-d6eab3e90458 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:01.874882 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-5c034ade-5257-49d4-8243-d367638f2a31 req-28d19f4c-84f0-4769-aa5d-d6eab3e90458 service nova] Creating event network-vif-deleted:8a587d76-a9ec-4db5-9ae4-ccae7d195099 for instance a42d2956-071d-4bad-b9a6-a0f78fcb0498 on n-h2-854823-8 Oct 04 20:37:01.882661 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-5c034ade-5257-49d4-8243-d367638f2a31 req-28d19f4c-84f0-4769-aa5d-d6eab3e90458 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075736 Oct 04 20:37:01.883980 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 438/887] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:37:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:37:01.889969 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-426d7e7d-9f47-4da0-a688-0fafe5184eef tempest-ServerDiagnosticsNegativeTest-417074328 tempest-ServerDiagnosticsNegativeTest-417074328-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:01.890936 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-426d7e7d-9f47-4da0-a688-0fafe5184eef tempest-ServerDiagnosticsNegativeTest-417074328 tempest-ServerDiagnosticsNegativeTest-417074328-project] [instance: a42d2956-071d-4bad-b9a6-a0f78fcb0498] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:01.898452 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-426d7e7d-9f47-4da0-a688-0fafe5184eef tempest-ServerDiagnosticsNegativeTest-417074328 tempest-ServerDiagnosticsNegativeTest-417074328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:01.899211 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-426d7e7d-9f47-4da0-a688-0fafe5184eef tempest-ServerDiagnosticsNegativeTest-417074328 tempest-ServerDiagnosticsNegativeTest-417074328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:01.899670 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-426d7e7d-9f47-4da0-a688-0fafe5184eef tempest-ServerDiagnosticsNegativeTest-417074328 tempest-ServerDiagnosticsNegativeTest-417074328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:01.900624 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-426d7e7d-9f47-4da0-a688-0fafe5184eef tempest-ServerDiagnosticsNegativeTest-417074328 tempest-ServerDiagnosticsNegativeTest-417074328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:01.900959 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-426d7e7d-9f47-4da0-a688-0fafe5184eef tempest-ServerDiagnosticsNegativeTest-417074328 tempest-ServerDiagnosticsNegativeTest-417074328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:01.901395 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-426d7e7d-9f47-4da0-a688-0fafe5184eef tempest-ServerDiagnosticsNegativeTest-417074328 tempest-ServerDiagnosticsNegativeTest-417074328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:01.913785 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-60ae8f91-29ca-41b4-a455-6828ae07ac60 tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa55ca3469648b0b1a2e1a29541c462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8659949e00dc429e8667767d0f126771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:01.923912 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-60ae8f91-29ca-41b4-a455-6828ae07ac60 tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] 10.222.0.33 "GET /compute/v2.1/servers/33bf1c5a-fbf7-4db1-b2c8-e4ab05149f25" status: 200 len: 1402 microversion: 2.1 time: 0.672692 Oct 04 20:37:01.925538 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 450/888] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:37:01 2022] GET /compute/v2.1/servers/33bf1c5a-fbf7-4db1-b2c8-e4ab05149f25 => generated 1402 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:37:01.930640 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5a5ef21c-c3d4-49b0-aae0-3597ffde3076 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:01.931248 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-5a5ef21c-c3d4-49b0-aae0-3597ffde3076 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] [instance: 465ad440-a27e-4ff6-bb31-09f3545e166a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:01.935646 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-426d7e7d-9f47-4da0-a688-0fafe5184eef tempest-ServerDiagnosticsNegativeTest-417074328 tempest-ServerDiagnosticsNegativeTest-417074328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:01.936882 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-426d7e7d-9f47-4da0-a688-0fafe5184eef tempest-ServerDiagnosticsNegativeTest-417074328 tempest-ServerDiagnosticsNegativeTest-417074328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:01.937405 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5a5ef21c-c3d4-49b0-aae0-3597ffde3076 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:01.937573 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-426d7e7d-9f47-4da0-a688-0fafe5184eef tempest-ServerDiagnosticsNegativeTest-417074328 tempest-ServerDiagnosticsNegativeTest-417074328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:01.937939 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.objects.instance [None req-426d7e7d-9f47-4da0-a688-0fafe5184eef tempest-ServerDiagnosticsNegativeTest-417074328 tempest-ServerDiagnosticsNegativeTest-417074328-project] Lazy-loading 'fault' on Instance uuid a42d2956-071d-4bad-b9a6-a0f78fcb0498 {{(pid=128802) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:37:01.938452 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5a5ef21c-c3d4-49b0-aae0-3597ffde3076 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:01.939050 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5a5ef21c-c3d4-49b0-aae0-3597ffde3076 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:01.939938 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5a5ef21c-c3d4-49b0-aae0-3597ffde3076 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:01.940397 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5a5ef21c-c3d4-49b0-aae0-3597ffde3076 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:01.941112 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:37:01.941284 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5a5ef21c-c3d4-49b0-aae0-3597ffde3076 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:02.026722 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-426d7e7d-9f47-4da0-a688-0fafe5184eef tempest-ServerDiagnosticsNegativeTest-417074328 tempest-ServerDiagnosticsNegativeTest-417074328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2581847c48447f5867331fb858ebb0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930bc715520746bc8a320d082e47af81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:02.035194 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-426d7e7d-9f47-4da0-a688-0fafe5184eef tempest-ServerDiagnosticsNegativeTest-417074328 tempest-ServerDiagnosticsNegativeTest-417074328-project] 10.222.0.33 "GET /compute/v2.1/servers/a42d2956-071d-4bad-b9a6-a0f78fcb0498" status: 200 len: 1312 microversion: 2.1 time: 0.149905 Oct 04 20:37:02.050236 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 439/889] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:37:01 2022] GET /compute/v2.1/servers/a42d2956-071d-4bad-b9a6-a0f78fcb0498 => generated 1312 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:37:02.058818 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-33691a75-73f4-4325-abd4-804255073aac req-5482064a-00ba-4c2e-811a-64109043ad86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d9db253-559a-4d4b-9a5e-42c8f63f6cb7", "name": "network-vif-plugged", "status": "completed", "tag": "9b3bb850-3715-4a18-91c1-43aaf29fbf6f"}, {"server_uuid": "33bf1c5a-fbf7-4db1-b2c8-e4ab05149f25", "name": "network-vif-plugged", "status": "completed", "tag": "57e9c24e-f645-45f4-9a9c-48ab34ee6f74"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:37:02.076892 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-33691a75-73f4-4325-abd4-804255073aac req-5482064a-00ba-4c2e-811a-64109043ad86 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:02.077814 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-33691a75-73f4-4325-abd4-804255073aac req-5482064a-00ba-4c2e-811a-64109043ad86 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:02.078586 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-33691a75-73f4-4325-abd4-804255073aac req-5482064a-00ba-4c2e-811a-64109043ad86 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:02.096329 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-33691a75-73f4-4325-abd4-804255073aac req-5482064a-00ba-4c2e-811a-64109043ad86 service nova] Creating event network-vif-plugged:9b3bb850-3715-4a18-91c1-43aaf29fbf6f for instance 7d9db253-559a-4d4b-9a5e-42c8f63f6cb7 on n-h1-854823-8 Oct 04 20:37:02.097400 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-33691a75-73f4-4325-abd4-804255073aac req-5482064a-00ba-4c2e-811a-64109043ad86 service nova] Creating event network-vif-plugged:57e9c24e-f645-45f4-9a9c-48ab34ee6f74 for instance 33bf1c5a-fbf7-4db1-b2c8-e4ab05149f25 on n-h1-854823-8 Oct 04 20:37:02.104952 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-33691a75-73f4-4325-abd4-804255073aac req-5482064a-00ba-4c2e-811a-64109043ad86 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.052326 Oct 04 20:37:02.106533 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 440/890] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:37:02 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:37:02.150515 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-faf6c769-310d-44c0-a066-397a0797afb2 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:02.151597 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-faf6c769-310d-44c0-a066-397a0797afb2 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] [instance: 5dbb0cb7-e2d8-416a-a486-72d4398ee877] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:02.160161 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-faf6c769-310d-44c0-a066-397a0797afb2 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:02.161668 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-faf6c769-310d-44c0-a066-397a0797afb2 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:02.163184 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-faf6c769-310d-44c0-a066-397a0797afb2 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:02.164520 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-faf6c769-310d-44c0-a066-397a0797afb2 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:02.165799 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-faf6c769-310d-44c0-a066-397a0797afb2 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:02.166565 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-faf6c769-310d-44c0-a066-397a0797afb2 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:02.205198 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-5a5ef21c-c3d4-49b0-aae0-3597ffde3076 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3563efe2b8c94931a2a46c4e14811b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3118a5d96843d3bede1ed94bd9717e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:02.217199 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5a5ef21c-c3d4-49b0-aae0-3597ffde3076 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] 10.222.0.33 "GET /compute/v2.1/servers/465ad440-a27e-4ff6-bb31-09f3545e166a" status: 200 len: 1529 microversion: 2.1 time: 0.290353 Oct 04 20:37:02.229874 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 451/891] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:37:01 2022] GET /compute/v2.1/servers/465ad440-a27e-4ff6-bb31-09f3545e166a => generated 1529 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:37:02.247887 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-229db8ed-f5a4-4c26-a447-26b9c2b9411e tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:02.248635 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-229db8ed-f5a4-4c26-a447-26b9c2b9411e tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] [instance: 9f8cc082-0a37-4123-a680-1210a90b3ca9] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:02.264860 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-229db8ed-f5a4-4c26-a447-26b9c2b9411e tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:02.266307 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-229db8ed-f5a4-4c26-a447-26b9c2b9411e tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:02.267789 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-229db8ed-f5a4-4c26-a447-26b9c2b9411e tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:02.268600 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-229db8ed-f5a4-4c26-a447-26b9c2b9411e tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:02.269112 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-229db8ed-f5a4-4c26-a447-26b9c2b9411e tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:02.269550 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-229db8ed-f5a4-4c26-a447-26b9c2b9411e tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:02.461654 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-faf6c769-310d-44c0-a066-397a0797afb2 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:02.477897 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-faf6c769-310d-44c0-a066-397a0797afb2 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:02.481333 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-faf6c769-310d-44c0-a066-397a0797afb2 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:02.483743 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-faf6c769-310d-44c0-a066-397a0797afb2 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] 10.222.0.33 "GET /compute/v2.1/servers/5dbb0cb7-e2d8-416a-a486-72d4398ee877" status: 200 len: 1362 microversion: 2.25 time: 0.340532 Oct 04 20:37:02.498497 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 441/892] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:37:02 2022] GET /compute/v2.1/servers/5dbb0cb7-e2d8-416a-a486-72d4398ee877 => generated 1362 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 20:37:02.506679 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-b854e3e7-8fae-4f99-a12e-33c22f266832 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:02.509511 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-b854e3e7-8fae-4f99-a12e-33c22f266832 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] [instance: 465ad440-a27e-4ff6-bb31-09f3545e166a] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:02.521843 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b854e3e7-8fae-4f99-a12e-33c22f266832 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:02.522983 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b854e3e7-8fae-4f99-a12e-33c22f266832 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:02.523750 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b854e3e7-8fae-4f99-a12e-33c22f266832 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:02.524781 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b854e3e7-8fae-4f99-a12e-33c22f266832 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:02.525268 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b854e3e7-8fae-4f99-a12e-33c22f266832 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:02.526007 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b854e3e7-8fae-4f99-a12e-33c22f266832 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:02.583858 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-229db8ed-f5a4-4c26-a447-26b9c2b9411e tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a24944aeb34a5ea228965be9bf4ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c288268acb30475bbc065a8f72cb21d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:02.592079 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-229db8ed-f5a4-4c26-a447-26b9c2b9411e tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] 10.222.0.33 "GET /compute/v2.1/servers/9f8cc082-0a37-4123-a680-1210a90b3ca9" status: 200 len: 1472 microversion: 2.1 time: 0.360824 Oct 04 20:37:02.593529 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 452/893] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:37:02 2022] GET /compute/v2.1/servers/9f8cc082-0a37-4123-a680-1210a90b3ca9 => generated 1472 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:37:02.801379 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-b854e3e7-8fae-4f99-a12e-33c22f266832 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3563efe2b8c94931a2a46c4e14811b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3118a5d96843d3bede1ed94bd9717e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:02.814036 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-27c8894e-42e5-49d0-adac-dcba3771e012 tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:02.814751 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-27c8894e-42e5-49d0-adac-dcba3771e012 tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] [instance: 7d9db253-559a-4d4b-9a5e-42c8f63f6cb7] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:02.817033 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-b854e3e7-8fae-4f99-a12e-33c22f266832 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] 10.222.0.33 "GET /compute/v2.1/servers/465ad440-a27e-4ff6-bb31-09f3545e166a" status: 200 len: 1529 microversion: 2.1 time: 0.317971 Oct 04 20:37:02.827654 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-27c8894e-42e5-49d0-adac-dcba3771e012 tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:02.828155 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-27c8894e-42e5-49d0-adac-dcba3771e012 tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:02.828592 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-27c8894e-42e5-49d0-adac-dcba3771e012 tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:02.835141 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 442/894] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:37:02 2022] GET /compute/v2.1/servers/465ad440-a27e-4ff6-bb31-09f3545e166a => generated 1529 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:37:02.844165 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-27c8894e-42e5-49d0-adac-dcba3771e012 tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:02.844165 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-27c8894e-42e5-49d0-adac-dcba3771e012 tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:02.844165 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-27c8894e-42e5-49d0-adac-dcba3771e012 tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:02.852852 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-90dbe237-32d3-4238-8444-061928da8021 tempest-MigrationsAdminTest-1312330847 tempest-MigrationsAdminTest-1312330847-project-admin] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:02.883227 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-90dbe237-32d3-4238-8444-061928da8021 tempest-MigrationsAdminTest-1312330847 tempest-MigrationsAdminTest-1312330847-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/48f18867-47ca-44ca-b04d-8950bf944255" status: 202 len: 0 microversion: 2.1 time: 0.036563 Oct 04 20:37:02.884158 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 443/895] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 20:37:02 2022] DELETE /compute/v2.1/flavors/48f18867-47ca-44ca-b04d-8950bf944255 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:37:02.894254 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-07e71e8d-bd31-49d2-bb33-13ba10d43364 tempest-MigrationsAdminTest-1312330847 tempest-MigrationsAdminTest-1312330847-project-admin] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:02.919759 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-07e71e8d-bd31-49d2-bb33-13ba10d43364 tempest-MigrationsAdminTest-1312330847 tempest-MigrationsAdminTest-1312330847-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.030333 Oct 04 20:37:02.936763 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 444/896] 10.222.0.33 () {58 vars in 1146 bytes} [Tue Oct 4 20:37:02 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:37:02.947610 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-2e8f59c7-157d-414a-9bd5-940384ea71f8 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:37:02.952361 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-2e8f59c7-157d-414a-9bd5-940384ea71f8 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] [instance: 465ad440-a27e-4ff6-bb31-09f3545e166a] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:02.971401 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2e8f59c7-157d-414a-9bd5-940384ea71f8 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:02.972335 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2e8f59c7-157d-414a-9bd5-940384ea71f8 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:02.973176 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2e8f59c7-157d-414a-9bd5-940384ea71f8 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:02.974878 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2e8f59c7-157d-414a-9bd5-940384ea71f8 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:02.975852 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2e8f59c7-157d-414a-9bd5-940384ea71f8 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:02.976545 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2e8f59c7-157d-414a-9bd5-940384ea71f8 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:03.144580 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-2e8f59c7-157d-414a-9bd5-940384ea71f8 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '3563efe2b8c94931a2a46c4e14811b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3118a5d96843d3bede1ed94bd9717e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:03.155110 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-2e8f59c7-157d-414a-9bd5-940384ea71f8 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] [instance: 465ad440-a27e-4ff6-bb31-09f3545e166a] Old instance type tempest-test_resize_flavor_-3300240, new instance type m1.heat {{(pid=128802) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 04 20:37:03.179150 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-2e8f59c7-157d-414a-9bd5-940384ea71f8 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Flavor limits 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:37:03.181950 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-2e8f59c7-157d-414a-9bd5-940384ea71f8 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Image limits 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:37:03.183124 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-2e8f59c7-157d-414a-9bd5-940384ea71f8 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Flavor pref 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:37:03.184278 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-2e8f59c7-157d-414a-9bd5-940384ea71f8 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Image pref 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:37:03.185384 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-2e8f59c7-157d-414a-9bd5-940384ea71f8 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:37:03.238177 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-27c8894e-42e5-49d0-adac-dcba3771e012 tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b786966441fc45f28890bf56cdfafb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8cc219b86ed450cbe7c780d7f79d9f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:03.248363 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-27c8894e-42e5-49d0-adac-dcba3771e012 tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] 10.222.0.33 "GET /compute/v2.1/servers/7d9db253-559a-4d4b-9a5e-42c8f63f6cb7" status: 200 len: 1371 microversion: 2.1 time: 0.439548 Oct 04 20:37:03.255780 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 453/897] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:37:02 2022] GET /compute/v2.1/servers/7d9db253-559a-4d4b-9a5e-42c8f63f6cb7 => generated 1371 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:37:03.270097 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-586d7895-be18-44d1-bf9a-fae21f7a25be tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:03.272849 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-586d7895-be18-44d1-bf9a-fae21f7a25be tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] [instance: 33bf1c5a-fbf7-4db1-b2c8-e4ab05149f25] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:03.291953 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-586d7895-be18-44d1-bf9a-fae21f7a25be tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:03.292450 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-586d7895-be18-44d1-bf9a-fae21f7a25be tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:03.292883 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-586d7895-be18-44d1-bf9a-fae21f7a25be tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:03.293598 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-586d7895-be18-44d1-bf9a-fae21f7a25be tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:03.294060 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-586d7895-be18-44d1-bf9a-fae21f7a25be tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:03.295042 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-586d7895-be18-44d1-bf9a-fae21f7a25be tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:03.414250 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-2e8f59c7-157d-414a-9bd5-940384ea71f8 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] 10.222.0.33 "POST /compute/v2.1/servers/465ad440-a27e-4ff6-bb31-09f3545e166a/action" status: 202 len: 0 microversion: 2.1 time: 0.476116 Oct 04 20:37:03.415637 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 445/898] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 20:37:02 2022] POST /compute/v2.1/servers/465ad440-a27e-4ff6-bb31-09f3545e166a/action => generated 0 bytes in 478 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:37:03.423047 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-6c4fbef4-ae74-40c4-bce3-d7f7988af6b2 tempest-ServerDiagnosticsNegativeTest-417074328 tempest-ServerDiagnosticsNegativeTest-417074328-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:03.423976 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-6c4fbef4-ae74-40c4-bce3-d7f7988af6b2 tempest-ServerDiagnosticsNegativeTest-417074328 tempest-ServerDiagnosticsNegativeTest-417074328-project] [instance: a42d2956-071d-4bad-b9a6-a0f78fcb0498] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:03.432088 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6c4fbef4-ae74-40c4-bce3-d7f7988af6b2 tempest-ServerDiagnosticsNegativeTest-417074328 tempest-ServerDiagnosticsNegativeTest-417074328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:03.433185 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6c4fbef4-ae74-40c4-bce3-d7f7988af6b2 tempest-ServerDiagnosticsNegativeTest-417074328 tempest-ServerDiagnosticsNegativeTest-417074328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:03.433800 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6c4fbef4-ae74-40c4-bce3-d7f7988af6b2 tempest-ServerDiagnosticsNegativeTest-417074328 tempest-ServerDiagnosticsNegativeTest-417074328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:03.434814 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6c4fbef4-ae74-40c4-bce3-d7f7988af6b2 tempest-ServerDiagnosticsNegativeTest-417074328 tempest-ServerDiagnosticsNegativeTest-417074328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:03.435475 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6c4fbef4-ae74-40c4-bce3-d7f7988af6b2 tempest-ServerDiagnosticsNegativeTest-417074328 tempest-ServerDiagnosticsNegativeTest-417074328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:03.436631 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6c4fbef4-ae74-40c4-bce3-d7f7988af6b2 tempest-ServerDiagnosticsNegativeTest-417074328 tempest-ServerDiagnosticsNegativeTest-417074328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:03.506469 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.wsgi [None req-6c4fbef4-ae74-40c4-bce3-d7f7988af6b2 tempest-ServerDiagnosticsNegativeTest-417074328 tempest-ServerDiagnosticsNegativeTest-417074328-project] HTTP exception thrown: Instance a42d2956-071d-4bad-b9a6-a0f78fcb0498 could not be found. Oct 04 20:37:03.511725 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-6c4fbef4-ae74-40c4-bce3-d7f7988af6b2 tempest-ServerDiagnosticsNegativeTest-417074328 tempest-ServerDiagnosticsNegativeTest-417074328-project] Request method failure captured: Oct 04 20:37:03.511725 n-d-854823-8 devstack@n-api.service[128802]: request: GET /compute/v2.1/servers/a42d2956-071d-4bad-b9a6-a0f78fcb0498 HTTP/1.1 Oct 04 20:37:03.511725 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 20:37:03.511725 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 20:37:03.511725 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 20:37:03.511725 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 0 Oct 04 20:37:03.511725 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 20:37:03.511725 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 20:37:03.511725 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 20:37:03.511725 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 20:37:03.511725 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPJlOLAqxLAAwVeTMqgjF-NwkgKl5Ah3jTFmxY9-5NVG-2TZxY-xGy4NeREXcjiqL_9jY8vT0uLdle6rq4KkzRcZ6zRIQKb6C8RvxIYsBYNirQs6F0QhYuGDABErYdGnVlvigRLxN9hXrwhuWNQLrRTw102oCbiF7CulP5dRIPyzjCm4 Oct 04 20:37:03.511725 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 20:37:03.511725 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 20:37:03.511725 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 20:37:03.511725 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 20:37:03.511725 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 20:37:03.511725 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 20:37:03.511725 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: 930bc715520746bc8a320d082e47af81 Oct 04 20:37:03.511725 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-417074328 Oct 04 20:37:03.511725 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 20:37:03.511725 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 20:37:03.513319 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_930bc715520746bc8a320d082e47af81", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/930bc715520746bc8a320d082e47af81"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/930bc715520746bc8a320d082e47af81"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/930bc715520746bc8a320d082e47af81"}]}] Oct 04 20:37:03.513319 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-417074328 Oct 04 20:37:03.513319 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: 930bc715520746bc8a320d082e47af81 Oct 04 20:37:03.513319 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-417074328 Oct 04 20:37:03.513319 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-ServerDiagnosticsNegativeTest-417074328-project Oct 04 20:37:03.513319 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 20:37:03.513319 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 20:37:03.513319 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: d2581847c48447f5867331fb858ebb0a Oct 04 20:37:03.513319 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-417074328-project Oct 04 20:37:03.513319 n-d-854823-8 devstack@n-api.service[128802]: method: > Oct 04 20:37:03.513319 n-d-854823-8 devstack@n-api.service[128802]: exception: Instance a42d2956-071d-4bad-b9a6-a0f78fcb0498 could not be found. Oct 04 20:37:03.513319 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'id': 'a42d2956-071d-4bad-b9a6-a0f78fcb0498'} Oct 04 20:37:03.514197 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:37:03.514197 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:37:03.514197 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:37:03.514197 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:37:03.514197 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:37:03.514197 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:37:03.514197 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:37:03.514197 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:37:03.514197 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:37:03.514197 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:37:03.514197 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a42d2956-071d-4bad-b9a6-a0f78fcb0498 could not be found. Oct 04 20:37:03.514197 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:37:03.514197 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:37:03.514197 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:37:03.514197 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:37:03.514197 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:37:03.514197 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:37:03.514197 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:37:03.514197 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:37:03.514197 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:37:03.515644 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:37:03.515644 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:37:03.515644 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:37:03.515644 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:37:03.515644 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:37:03.515644 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:37:03.515644 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:37:03.515644 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a42d2956-071d-4bad-b9a6-a0f78fcb0498 could not be found. Oct 04 20:37:03.515644 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:37:03.515644 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:37:03.515644 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:37:03.515644 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:37:03.515644 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:37:03.515644 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:37:03.515644 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:37:03.515644 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:37:03.515644 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a42d2956-071d-4bad-b9a6-a0f78fcb0498 could not be found. Oct 04 20:37:03.515644 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:37:03.518313 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-6c4fbef4-ae74-40c4-bce3-d7f7988af6b2 tempest-ServerDiagnosticsNegativeTest-417074328 tempest-ServerDiagnosticsNegativeTest-417074328-project] Returning 404 to user: Instance a42d2956-071d-4bad-b9a6-a0f78fcb0498 could not be found. {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:37:03.525087 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-6c4fbef4-ae74-40c4-bce3-d7f7988af6b2 tempest-ServerDiagnosticsNegativeTest-417074328 tempest-ServerDiagnosticsNegativeTest-417074328-project] 10.222.0.33 "GET /compute/v2.1/servers/a42d2956-071d-4bad-b9a6-a0f78fcb0498" status: 404 len: 111 microversion: 2.1 time: 0.106638 Oct 04 20:37:03.533133 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 446/899] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:37:03 2022] GET /compute/v2.1/servers/a42d2956-071d-4bad-b9a6-a0f78fcb0498 => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:37:03.541501 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-76cbadaa-7638-45d2-806b-0eea43ee43a8 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:03.542295 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-76cbadaa-7638-45d2-806b-0eea43ee43a8 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] [instance: 465ad440-a27e-4ff6-bb31-09f3545e166a] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:03.549183 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-76cbadaa-7638-45d2-806b-0eea43ee43a8 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:03.549883 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-76cbadaa-7638-45d2-806b-0eea43ee43a8 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:03.550476 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-76cbadaa-7638-45d2-806b-0eea43ee43a8 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:03.551298 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-76cbadaa-7638-45d2-806b-0eea43ee43a8 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:03.552540 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-76cbadaa-7638-45d2-806b-0eea43ee43a8 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:03.553118 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-76cbadaa-7638-45d2-806b-0eea43ee43a8 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:04.162908 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-586d7895-be18-44d1-bf9a-fae21f7a25be tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa55ca3469648b0b1a2e1a29541c462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8659949e00dc429e8667767d0f126771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:04.176339 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-586d7895-be18-44d1-bf9a-fae21f7a25be tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] 10.222.0.33 "GET /compute/v2.1/servers/33bf1c5a-fbf7-4db1-b2c8-e4ab05149f25" status: 200 len: 1402 microversion: 2.1 time: 0.914314 Oct 04 20:37:04.198336 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 454/900] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:37:03 2022] GET /compute/v2.1/servers/33bf1c5a-fbf7-4db1-b2c8-e4ab05149f25 => generated 1402 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:37:04.216023 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-33f7f75e-88c5-42c6-82c8-fc691eb7e96f tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:04.218329 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-33f7f75e-88c5-42c6-82c8-fc691eb7e96f tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] [instance: 5dbb0cb7-e2d8-416a-a486-72d4398ee877] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:04.234828 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-33f7f75e-88c5-42c6-82c8-fc691eb7e96f tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:04.235324 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-33f7f75e-88c5-42c6-82c8-fc691eb7e96f tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:04.241803 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-33f7f75e-88c5-42c6-82c8-fc691eb7e96f tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:04.243290 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-33f7f75e-88c5-42c6-82c8-fc691eb7e96f tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:04.243776 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-33f7f75e-88c5-42c6-82c8-fc691eb7e96f tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:04.244211 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-33f7f75e-88c5-42c6-82c8-fc691eb7e96f tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:04.348818 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-76cbadaa-7638-45d2-806b-0eea43ee43a8 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3563efe2b8c94931a2a46c4e14811b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3118a5d96843d3bede1ed94bd9717e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:04.358653 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-76cbadaa-7638-45d2-806b-0eea43ee43a8 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] 10.222.0.33 "GET /compute/v2.1/servers/465ad440-a27e-4ff6-bb31-09f3545e166a" status: 200 len: 1538 microversion: 2.1 time: 0.823993 Oct 04 20:37:04.407743 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 447/901] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:37:03 2022] GET /compute/v2.1/servers/465ad440-a27e-4ff6-bb31-09f3545e166a => generated 1538 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:37:04.423110 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-442bdc9d-b273-4484-8ec8-0d83334834af tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:04.424316 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-442bdc9d-b273-4484-8ec8-0d83334834af tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] [instance: 9f8cc082-0a37-4123-a680-1210a90b3ca9] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:04.433782 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-442bdc9d-b273-4484-8ec8-0d83334834af tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:04.434935 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-442bdc9d-b273-4484-8ec8-0d83334834af tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:04.435627 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-442bdc9d-b273-4484-8ec8-0d83334834af tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:04.436697 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-442bdc9d-b273-4484-8ec8-0d83334834af tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:04.437378 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-442bdc9d-b273-4484-8ec8-0d83334834af tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:04.438278 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-442bdc9d-b273-4484-8ec8-0d83334834af tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:04.665735 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-33f7f75e-88c5-42c6-82c8-fc691eb7e96f tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:04.677105 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-33f7f75e-88c5-42c6-82c8-fc691eb7e96f tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:04.679653 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-33f7f75e-88c5-42c6-82c8-fc691eb7e96f tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:04.680917 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-33f7f75e-88c5-42c6-82c8-fc691eb7e96f tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] 10.222.0.33 "GET /compute/v2.1/servers/5dbb0cb7-e2d8-416a-a486-72d4398ee877" status: 200 len: 1362 microversion: 2.25 time: 0.479712 Oct 04 20:37:04.681664 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 455/902] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:37:04 2022] GET /compute/v2.1/servers/5dbb0cb7-e2d8-416a-a486-72d4398ee877 => generated 1362 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:37:04.688688 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-17f34b6f-eac9-43f1-9ef8-581c5f4932c7 tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:04.691516 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-17f34b6f-eac9-43f1-9ef8-581c5f4932c7 tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] [instance: 7d9db253-559a-4d4b-9a5e-42c8f63f6cb7] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:04.704306 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-17f34b6f-eac9-43f1-9ef8-581c5f4932c7 tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:04.707378 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-17f34b6f-eac9-43f1-9ef8-581c5f4932c7 tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:04.712918 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-17f34b6f-eac9-43f1-9ef8-581c5f4932c7 tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:04.713952 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-17f34b6f-eac9-43f1-9ef8-581c5f4932c7 tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:04.714619 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-17f34b6f-eac9-43f1-9ef8-581c5f4932c7 tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:04.715239 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-17f34b6f-eac9-43f1-9ef8-581c5f4932c7 tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:04.902435 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-442bdc9d-b273-4484-8ec8-0d83334834af tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a24944aeb34a5ea228965be9bf4ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c288268acb30475bbc065a8f72cb21d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:04.915827 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-442bdc9d-b273-4484-8ec8-0d83334834af tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] 10.222.0.33 "GET /compute/v2.1/servers/9f8cc082-0a37-4123-a680-1210a90b3ca9" status: 200 len: 1472 microversion: 2.1 time: 0.504611 Oct 04 20:37:04.926602 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 448/903] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:37:04 2022] GET /compute/v2.1/servers/9f8cc082-0a37-4123-a680-1210a90b3ca9 => generated 1472 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:37:05.028470 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-17f34b6f-eac9-43f1-9ef8-581c5f4932c7 tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b786966441fc45f28890bf56cdfafb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8cc219b86ed450cbe7c780d7f79d9f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:05.064819 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-17f34b6f-eac9-43f1-9ef8-581c5f4932c7 tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] 10.222.0.33 "GET /compute/v2.1/servers/7d9db253-559a-4d4b-9a5e-42c8f63f6cb7" status: 200 len: 1371 microversion: 2.1 time: 0.381725 Oct 04 20:37:05.065432 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 456/904] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:37:04 2022] GET /compute/v2.1/servers/7d9db253-559a-4d4b-9a5e-42c8f63f6cb7 => generated 1371 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:37:05.208140 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-310b16e1-e0b8-4fde-ba9d-45f3a3b3c7a6 tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:05.214082 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-310b16e1-e0b8-4fde-ba9d-45f3a3b3c7a6 tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] [instance: 33bf1c5a-fbf7-4db1-b2c8-e4ab05149f25] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:05.231786 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_api:SELECT=97,nova_api:DELETE=3 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:37:05.252850 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-310b16e1-e0b8-4fde-ba9d-45f3a3b3c7a6 tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:05.253666 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-310b16e1-e0b8-4fde-ba9d-45f3a3b3c7a6 tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:05.254583 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-310b16e1-e0b8-4fde-ba9d-45f3a3b3c7a6 tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:05.256976 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-310b16e1-e0b8-4fde-ba9d-45f3a3b3c7a6 tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:05.270575 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-310b16e1-e0b8-4fde-ba9d-45f3a3b3c7a6 tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:05.272050 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-310b16e1-e0b8-4fde-ba9d-45f3a3b3c7a6 tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:05.395320 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a502bc92-03dd-41e2-b480-cd24746b9484 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:05.397662 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a502bc92-03dd-41e2-b480-cd24746b9484 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] [instance: 465ad440-a27e-4ff6-bb31-09f3545e166a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:05.408425 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a502bc92-03dd-41e2-b480-cd24746b9484 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:05.410528 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a502bc92-03dd-41e2-b480-cd24746b9484 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:05.411235 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a502bc92-03dd-41e2-b480-cd24746b9484 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:05.412495 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a502bc92-03dd-41e2-b480-cd24746b9484 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:05.413293 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a502bc92-03dd-41e2-b480-cd24746b9484 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:05.419681 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a502bc92-03dd-41e2-b480-cd24746b9484 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:06.082615 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-310b16e1-e0b8-4fde-ba9d-45f3a3b3c7a6 tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa55ca3469648b0b1a2e1a29541c462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8659949e00dc429e8667767d0f126771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:06.096762 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-310b16e1-e0b8-4fde-ba9d-45f3a3b3c7a6 tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] 10.222.0.33 "GET /compute/v2.1/servers/33bf1c5a-fbf7-4db1-b2c8-e4ab05149f25" status: 200 len: 1589 microversion: 2.1 time: 0.892543 Oct 04 20:37:06.097553 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 449/905] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:37:05 2022] GET /compute/v2.1/servers/33bf1c5a-fbf7-4db1-b2c8-e4ab05149f25 => generated 1589 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:37:06.106948 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-fe687395-1624-4fa0-8060-5f2ebce30104 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:06.107774 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-fe687395-1624-4fa0-8060-5f2ebce30104 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] [instance: 5dbb0cb7-e2d8-416a-a486-72d4398ee877] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:06.111334 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-a502bc92-03dd-41e2-b480-cd24746b9484 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3563efe2b8c94931a2a46c4e14811b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3118a5d96843d3bede1ed94bd9717e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:06.116438 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fe687395-1624-4fa0-8060-5f2ebce30104 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:06.117187 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fe687395-1624-4fa0-8060-5f2ebce30104 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:06.117654 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fe687395-1624-4fa0-8060-5f2ebce30104 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:06.118367 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fe687395-1624-4fa0-8060-5f2ebce30104 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:06.118841 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fe687395-1624-4fa0-8060-5f2ebce30104 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:06.119260 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fe687395-1624-4fa0-8060-5f2ebce30104 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:06.120009 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a502bc92-03dd-41e2-b480-cd24746b9484 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] 10.222.0.33 "GET /compute/v2.1/servers/465ad440-a27e-4ff6-bb31-09f3545e166a" status: 200 len: 1538 microversion: 2.1 time: 0.729313 Oct 04 20:37:06.120593 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 457/906] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:37:05 2022] GET /compute/v2.1/servers/465ad440-a27e-4ff6-bb31-09f3545e166a => generated 1538 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:37:06.134385 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d92ef52a-003e-4b40-b2a7-fde4d48c5b32 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:06.135030 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d92ef52a-003e-4b40-b2a7-fde4d48c5b32 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] [instance: 9f8cc082-0a37-4123-a680-1210a90b3ca9] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:06.154178 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d92ef52a-003e-4b40-b2a7-fde4d48c5b32 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:06.154911 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d92ef52a-003e-4b40-b2a7-fde4d48c5b32 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:06.155353 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d92ef52a-003e-4b40-b2a7-fde4d48c5b32 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:06.156064 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d92ef52a-003e-4b40-b2a7-fde4d48c5b32 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:06.156679 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d92ef52a-003e-4b40-b2a7-fde4d48c5b32 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:06.157261 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d92ef52a-003e-4b40-b2a7-fde4d48c5b32 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:06.630838 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d92ef52a-003e-4b40-b2a7-fde4d48c5b32 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a24944aeb34a5ea228965be9bf4ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c288268acb30475bbc065a8f72cb21d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:06.644892 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d92ef52a-003e-4b40-b2a7-fde4d48c5b32 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] 10.222.0.33 "GET /compute/v2.1/servers/9f8cc082-0a37-4123-a680-1210a90b3ca9" status: 200 len: 1472 microversion: 2.1 time: 0.516474 Oct 04 20:37:06.648239 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 458/907] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:37:06 2022] GET /compute/v2.1/servers/9f8cc082-0a37-4123-a680-1210a90b3ca9 => generated 1472 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:37:06.655221 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0b2b04b0-537a-4a57-8b31-3e67bcbb84e4 tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:06.656197 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-0b2b04b0-537a-4a57-8b31-3e67bcbb84e4 tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] [instance: 7d9db253-559a-4d4b-9a5e-42c8f63f6cb7] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:06.671926 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0b2b04b0-537a-4a57-8b31-3e67bcbb84e4 tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:06.672756 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0b2b04b0-537a-4a57-8b31-3e67bcbb84e4 tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:06.674093 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0b2b04b0-537a-4a57-8b31-3e67bcbb84e4 tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:06.675423 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0b2b04b0-537a-4a57-8b31-3e67bcbb84e4 tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:06.676908 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0b2b04b0-537a-4a57-8b31-3e67bcbb84e4 tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:06.677937 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0b2b04b0-537a-4a57-8b31-3e67bcbb84e4 tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:06.693666 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-fe687395-1624-4fa0-8060-5f2ebce30104 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:06.704609 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-fe687395-1624-4fa0-8060-5f2ebce30104 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:06.716893 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-fe687395-1624-4fa0-8060-5f2ebce30104 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:06.718047 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-fe687395-1624-4fa0-8060-5f2ebce30104 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] 10.222.0.33 "GET /compute/v2.1/servers/5dbb0cb7-e2d8-416a-a486-72d4398ee877" status: 200 len: 1362 microversion: 2.25 time: 0.619210 Oct 04 20:37:06.718636 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 450/908] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:37:06 2022] GET /compute/v2.1/servers/5dbb0cb7-e2d8-416a-a486-72d4398ee877 => generated 1362 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:37:06.740041 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-c0977547-0b0c-4f2c-ae0f-75b84a33e2b4 tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:06.742775 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-c0977547-0b0c-4f2c-ae0f-75b84a33e2b4 tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] [instance: 33bf1c5a-fbf7-4db1-b2c8-e4ab05149f25] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:06.752154 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c0977547-0b0c-4f2c-ae0f-75b84a33e2b4 tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:06.753088 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c0977547-0b0c-4f2c-ae0f-75b84a33e2b4 tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:06.754294 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c0977547-0b0c-4f2c-ae0f-75b84a33e2b4 tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:06.758011 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c0977547-0b0c-4f2c-ae0f-75b84a33e2b4 tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:06.758963 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c0977547-0b0c-4f2c-ae0f-75b84a33e2b4 tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:06.760189 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c0977547-0b0c-4f2c-ae0f-75b84a33e2b4 tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:06.836213 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=14 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:37:06.872140 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=6 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:37:07.131869 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-c0977547-0b0c-4f2c-ae0f-75b84a33e2b4 tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] 10.222.0.33 "GET /compute/v2.1/servers/33bf1c5a-fbf7-4db1-b2c8-e4ab05149f25/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.395648 Oct 04 20:37:07.132481 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 451/909] 10.222.0.33 () {58 vars in 1275 bytes} [Tue Oct 4 20:37:06 2022] GET /compute/v2.1/servers/33bf1c5a-fbf7-4db1-b2c8-e4ab05149f25/os-interface => generated 285 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:37:07.145555 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-f2f96c6e-b820-4128-9ba1-db48016fdb45 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:07.146872 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-f2f96c6e-b820-4128-9ba1-db48016fdb45 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] [instance: 465ad440-a27e-4ff6-bb31-09f3545e166a] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:07.154402 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f2f96c6e-b820-4128-9ba1-db48016fdb45 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:07.155016 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f2f96c6e-b820-4128-9ba1-db48016fdb45 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:07.155554 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f2f96c6e-b820-4128-9ba1-db48016fdb45 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:07.156356 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f2f96c6e-b820-4128-9ba1-db48016fdb45 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:07.159140 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f2f96c6e-b820-4128-9ba1-db48016fdb45 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:07.162777 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f2f96c6e-b820-4128-9ba1-db48016fdb45 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:07.251551 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell0:SELECT=2 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:37:07.336536 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-0b2b04b0-537a-4a57-8b31-3e67bcbb84e4 tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b786966441fc45f28890bf56cdfafb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8cc219b86ed450cbe7c780d7f79d9f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:07.357063 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-0b2b04b0-537a-4a57-8b31-3e67bcbb84e4 tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] 10.222.0.33 "GET /compute/v2.1/servers/7d9db253-559a-4d4b-9a5e-42c8f63f6cb7" status: 200 len: 1558 microversion: 2.1 time: 0.705730 Oct 04 20:37:07.360490 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 459/910] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:37:06 2022] GET /compute/v2.1/servers/7d9db253-559a-4d4b-9a5e-42c8f63f6cb7 => generated 1558 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:37:07.383236 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-042ed202-2953-4152-812e-1f6b3312eb05 tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:07.384060 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-042ed202-2953-4152-812e-1f6b3312eb05 tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] [instance: 7d9db253-559a-4d4b-9a5e-42c8f63f6cb7] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:07.391669 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-042ed202-2953-4152-812e-1f6b3312eb05 tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:07.392417 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-042ed202-2953-4152-812e-1f6b3312eb05 tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:07.393012 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-042ed202-2953-4152-812e-1f6b3312eb05 tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:07.393953 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-042ed202-2953-4152-812e-1f6b3312eb05 tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:07.394803 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-042ed202-2953-4152-812e-1f6b3312eb05 tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:07.395388 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-042ed202-2953-4152-812e-1f6b3312eb05 tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:07.657733 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-042ed202-2953-4152-812e-1f6b3312eb05 tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] 10.222.0.33 "GET /compute/v2.1/servers/7d9db253-559a-4d4b-9a5e-42c8f63f6cb7/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.278308 Oct 04 20:37:07.669168 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 460/911] 10.222.0.33 () {58 vars in 1275 bytes} [Tue Oct 4 20:37:07 2022] GET /compute/v2.1/servers/7d9db253-559a-4d4b-9a5e-42c8f63f6cb7/os-interface => generated 285 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:37:07.681172 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-4ea6bae0-d60f-473e-9a21-88a40f472be5 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:07.682198 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-4ea6bae0-d60f-473e-9a21-88a40f472be5 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] [instance: 9f8cc082-0a37-4123-a680-1210a90b3ca9] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:07.698846 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4ea6bae0-d60f-473e-9a21-88a40f472be5 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:07.699495 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4ea6bae0-d60f-473e-9a21-88a40f472be5 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:07.700186 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4ea6bae0-d60f-473e-9a21-88a40f472be5 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:07.703231 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4ea6bae0-d60f-473e-9a21-88a40f472be5 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:07.703808 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4ea6bae0-d60f-473e-9a21-88a40f472be5 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:07.709066 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4ea6bae0-d60f-473e-9a21-88a40f472be5 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:07.735052 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-f2f96c6e-b820-4128-9ba1-db48016fdb45 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3563efe2b8c94931a2a46c4e14811b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3118a5d96843d3bede1ed94bd9717e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:07.752832 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-f2f96c6e-b820-4128-9ba1-db48016fdb45 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] 10.222.0.33 "GET /compute/v2.1/servers/465ad440-a27e-4ff6-bb31-09f3545e166a" status: 200 len: 1538 microversion: 2.1 time: 0.611100 Oct 04 20:37:07.753449 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 452/912] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:37:07 2022] GET /compute/v2.1/servers/465ad440-a27e-4ff6-bb31-09f3545e166a => generated 1538 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:37:07.774701 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-a0e3c3f2-eec4-4de1-b2fd-0c17dcbcb01c tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:07.775505 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-a0e3c3f2-eec4-4de1-b2fd-0c17dcbcb01c tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] [instance: 5dbb0cb7-e2d8-416a-a486-72d4398ee877] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:07.790395 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a0e3c3f2-eec4-4de1-b2fd-0c17dcbcb01c tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:07.791225 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a0e3c3f2-eec4-4de1-b2fd-0c17dcbcb01c tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:07.791838 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a0e3c3f2-eec4-4de1-b2fd-0c17dcbcb01c tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:07.793847 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a0e3c3f2-eec4-4de1-b2fd-0c17dcbcb01c tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:07.794985 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a0e3c3f2-eec4-4de1-b2fd-0c17dcbcb01c tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:07.795765 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a0e3c3f2-eec4-4de1-b2fd-0c17dcbcb01c tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:08.670630 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-4ea6bae0-d60f-473e-9a21-88a40f472be5 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a24944aeb34a5ea228965be9bf4ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c288268acb30475bbc065a8f72cb21d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:08.682910 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-4ea6bae0-d60f-473e-9a21-88a40f472be5 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] 10.222.0.33 "GET /compute/v2.1/servers/9f8cc082-0a37-4123-a680-1210a90b3ca9" status: 200 len: 1472 microversion: 2.1 time: 1.007210 Oct 04 20:37:08.686442 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 461/913] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:37:07 2022] GET /compute/v2.1/servers/9f8cc082-0a37-4123-a680-1210a90b3ca9 => generated 1472 bytes in 1012 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:37:08.728876 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-a0e3c3f2-eec4-4de1-b2fd-0c17dcbcb01c tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:08.738381 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-a0e3c3f2-eec4-4de1-b2fd-0c17dcbcb01c tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:08.744022 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-a0e3c3f2-eec4-4de1-b2fd-0c17dcbcb01c tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:08.745789 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-a0e3c3f2-eec4-4de1-b2fd-0c17dcbcb01c tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] 10.222.0.33 "GET /compute/v2.1/servers/5dbb0cb7-e2d8-416a-a486-72d4398ee877" status: 200 len: 1362 microversion: 2.25 time: 0.991145 Oct 04 20:37:08.750682 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 453/914] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:37:07 2022] GET /compute/v2.1/servers/5dbb0cb7-e2d8-416a-a486-72d4398ee877 => generated 1362 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:37:08.781231 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6b220acf-bcf2-4547-a879-d438746cb55e tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:08.781928 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-6b220acf-bcf2-4547-a879-d438746cb55e tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] [instance: 465ad440-a27e-4ff6-bb31-09f3545e166a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:08.803686 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6b220acf-bcf2-4547-a879-d438746cb55e tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:08.804211 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6b220acf-bcf2-4547-a879-d438746cb55e tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:08.804653 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6b220acf-bcf2-4547-a879-d438746cb55e tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:08.808289 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6b220acf-bcf2-4547-a879-d438746cb55e tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:08.809078 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6b220acf-bcf2-4547-a879-d438746cb55e tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:08.810732 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6b220acf-bcf2-4547-a879-d438746cb55e tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:09.214520 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-6b220acf-bcf2-4547-a879-d438746cb55e tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3563efe2b8c94931a2a46c4e14811b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3118a5d96843d3bede1ed94bd9717e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:09.223270 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-6b220acf-bcf2-4547-a879-d438746cb55e tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] 10.222.0.33 "GET /compute/v2.1/servers/465ad440-a27e-4ff6-bb31-09f3545e166a" status: 200 len: 1538 microversion: 2.1 time: 0.447122 Oct 04 20:37:09.229528 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 462/915] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:37:08 2022] GET /compute/v2.1/servers/465ad440-a27e-4ff6-bb31-09f3545e166a => generated 1538 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:37:09.531828 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-cfc49b01-7871-4d08-a5e1-0e890531f877 tempest-KeyPairsNegativeTestJSON-1139940362 tempest-KeyPairsNegativeTestJSON-1139940362-project] Action: 'create', calling method: .version_select at 0x7f3c74778700>, body: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG//vKpqBg6RnNLhkBn/BgREQr6prQPlunEmbGfiM7s0vj5qvKtEmIQq5upDH6GHFqrcCOkCTxsr+OkojaZX6g+0vIHvL8B2W+IzrIFaklBvjvl6xiqQNAGE3yOfwTcw3w=="}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:37:09.542621 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-cfc49b01-7871-4d08-a5e1-0e890531f877 tempest-KeyPairsNegativeTestJSON-1139940362 tempest-KeyPairsNegativeTestJSON-1139940362-project] Request method failure captured: Oct 04 20:37:09.542621 n-d-854823-8 devstack@n-api.service[128802]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 04 20:37:09.542621 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 20:37:09.542621 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 20:37:09.542621 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 20:37:09.542621 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 257 Oct 04 20:37:09.542621 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 20:37:09.542621 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 20:37:09.542621 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 20:37:09.542621 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 20:37:09.542621 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPJl1bygDbrPfv5X6PnKf9bcWoSbMJs5Xq_97ZbkaQK3uipi-fL2ALK1PNYg9z_yhwX-lcNU7jHXJceVwXPcZrcUo1piA05UAqwxIrQeE4xG5HEJW6yXBiZo_g7uLPksme_MD-ETVdSk_2CNDEVijgaAcs1VnH_QPBwUqQkSYB1DIoPI Oct 04 20:37:09.542621 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 20:37:09.542621 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 20:37:09.542621 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 20:37:09.542621 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 20:37:09.542621 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 20:37:09.542621 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 20:37:09.542621 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: 0cc5dcab12744c4cb48623c6432215ea Oct 04 20:37:09.542621 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1139940362 Oct 04 20:37:09.542621 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 20:37:09.542621 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 20:37:09.544552 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0cc5dcab12744c4cb48623c6432215ea", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0cc5dcab12744c4cb48623c6432215ea"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0cc5dcab12744c4cb48623c6432215ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0cc5dcab12744c4cb48623c6432215ea"}]}] Oct 04 20:37:09.544552 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1139940362 Oct 04 20:37:09.544552 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: 0cc5dcab12744c4cb48623c6432215ea Oct 04 20:37:09.544552 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1139940362 Oct 04 20:37:09.544552 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-KeyPairsNegativeTestJSON-1139940362-project Oct 04 20:37:09.544552 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 20:37:09.544552 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 20:37:09.544552 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: 7f3c312a13e146b2a59e18bb16ae79d4 Oct 04 20:37:09.544552 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1139940362-project Oct 04 20:37:09.544552 n-d-854823-8 devstack@n-api.service[128802]: Oct 04 20:37:09.544552 n-d-854823-8 devstack@n-api.service[128802]: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG//vKpqBg6RnNLhkBn/BgREQr6prQPlunEmbGfiM7s0vj5qvKtEmIQq5upDH6GHFqrcCOkCTxsr+OkojaZX6g+0vIHvL8B2W+IzrIFaklBvjvl6xiqQNAGE3yOfwTcw3w=="}} Oct 04 20:37:09.545413 n-d-854823-8 devstack@n-api.service[128802]: method: Oct 04 20:37:09.545413 n-d-854823-8 devstack@n-api.service[128802]: exception: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 04 20:37:09.545413 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'body': {'keypair': {'name': 'key_/.\\@:', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG//vKpqBg6RnNLhkBn/BgREQr6prQPlunEmbGfiM7s0vj5qvKtEmIQq5upDH6GHFqrcCOkCTxsr+OkojaZX6g+0vIHvL8B2W+IzrIFaklBvjvl6xiqQNAGE3yOfwTcw3w=='}}} Oct 04 20:37:09.545413 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:37:09.545413 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:37:09.545413 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Oct 04 20:37:09.545413 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi result = func(instance) Oct 04 20:37:09.545413 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 161, in _validate_keypair_name_20 Oct 04 20:37:09.545413 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return _validate_keypair_name(keypair_name, safe_chars) Oct 04 20:37:09.545413 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 175, in _validate_keypair_name Oct 04 20:37:09.545413 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.InvalidName(reason=reason) Oct 04 20:37:09.545413 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.InvalidName: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 04 20:37:09.545413 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:37:09.545413 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 04 20:37:09.545413 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:37:09.545413 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:37:09.545413 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 20:37:09.546720 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 20:37:09.546720 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 20:37:09.546720 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise error Oct 04 20:37:09.546720 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'key_/.\\@:' is not a 'keypair_name_20' Oct 04 20:37:09.546720 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:37:09.546720 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['keypair']['properties']['name']['allOf'][1]: Oct 04 20:37:09.546720 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi {'format': 'keypair_name_20', Oct 04 20:37:09.546720 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi 'maxLength': 255, Oct 04 20:37:09.546720 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi 'minLength': 1, Oct 04 20:37:09.546720 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 04 20:37:09.546720 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:37:09.546720 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi On instance['keypair']['name']: Oct 04 20:37:09.546720 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi 'key_/.\\@:' Oct 04 20:37:09.546720 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:37:09.546720 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:37:09.546720 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:37:09.546720 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:37:09.546720 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:37:09.546720 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:37:09.546720 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:37:09.546720 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:37:09.546720 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:37:09.546720 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:37:09.548400 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:37:09.548400 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:37:09.548400 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:37:09.548400 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:37:09.548400 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 20:37:09.548400 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 20:37:09.548400 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 20:37:09.548400 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 20:37:09.548400 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 20:37:09.548400 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 20:37:09.548400 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 04 20:37:09.548400 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:37:09.548400 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:37:09.548400 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:37:09.548400 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:37:09.548400 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:37:09.548400 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:37:09.548400 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 20:37:09.548400 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 20:37:09.549794 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 04 20:37:09.549794 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:37:09.553087 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-cfc49b01-7871-4d08-a5e1-0e890531f877 tempest-KeyPairsNegativeTestJSON-1139940362 tempest-KeyPairsNegativeTestJSON-1139940362-project] Returning 400 to user: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:37:09.554174 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-cfc49b01-7871-4d08-a5e1-0e890531f877 tempest-KeyPairsNegativeTestJSON-1139940362 tempest-KeyPairsNegativeTestJSON-1139940362-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 400 len: 193 microversion: 2.1 time: 0.299753 Oct 04 20:37:09.563134 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 454/916] 10.222.0.33 () {60 vars in 1159 bytes} [Tue Oct 4 20:37:09 2022] POST /compute/v2.1/os-keypairs => generated 193 bytes in 309 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 20:37:09.571227 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-55ea3a91-1546-47dc-bc07-4f04fcf57500 tempest-KeyPairsNegativeTestJSON-1139940362 tempest-KeyPairsNegativeTestJSON-1139940362-project] Action: 'create', calling method: .version_select at 0x7f3c74ff14c0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-648304641", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:37:09.601955 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-55ea3a91-1546-47dc-bc07-4f04fcf57500 tempest-KeyPairsNegativeTestJSON-1139940362 tempest-KeyPairsNegativeTestJSON-1139940362-project] Getting quotas for project 0cc5dcab12744c4cb48623c6432215ea. Resources: {'key_pairs'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:37:09.608410 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-55ea3a91-1546-47dc-bc07-4f04fcf57500 tempest-KeyPairsNegativeTestJSON-1139940362 tempest-KeyPairsNegativeTestJSON-1139940362-project] Getting quotas for user 7f3c312a13e146b2a59e18bb16ae79d4 and project 0cc5dcab12744c4cb48623c6432215ea. Resources: {'key_pairs'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:37:09.634709 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-55ea3a91-1546-47dc-bc07-4f04fcf57500 tempest-KeyPairsNegativeTestJSON-1139940362 tempest-KeyPairsNegativeTestJSON-1139940362-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Oct 04 20:37:09.653453 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-0a07a2c9-8a9d-4d52-9874-c1e21790a757 req-39987238-9921-4de1-ae68-26c685493f2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5dbb0cb7-e2d8-416a-a486-72d4398ee877", "name": "network-vif-plugged", "status": "completed", "tag": "cf080088-b0ac-4a20-83d3-5d85ca5cdb45"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:37:09.674373 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-55ea3a91-1546-47dc-bc07-4f04fcf57500 tempest-KeyPairsNegativeTestJSON-1139940362 tempest-KeyPairsNegativeTestJSON-1139940362-project] Request method failure captured: Oct 04 20:37:09.674373 n-d-854823-8 devstack@n-api.service[128801]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 04 20:37:09.674373 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:37:09.674373 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:37:09.674373 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:37:09.674373 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 2166 Oct 04 20:37:09.674373 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:37:09.674373 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:37:09.674373 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:37:09.674373 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:37:09.674373 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJl1bygDbrPfv5X6PnKf9bcWoSbMJs5Xq_97ZbkaQK3uipi-fL2ALK1PNYg9z_yhwX-lcNU7jHXJceVwXPcZrcUo1piA05UAqwxIrQeE4xG5HEJW6yXBiZo_g7uLPksme_MD-ETVdSk_2CNDEVijgaAcs1VnH_QPBwUqQkSYB1DIoPI Oct 04 20:37:09.674373 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:37:09.674373 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:37:09.674373 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:37:09.674373 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:37:09.674373 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:37:09.674373 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:37:09.674373 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: 0cc5dcab12744c4cb48623c6432215ea Oct 04 20:37:09.674373 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1139940362 Oct 04 20:37:09.674373 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 20:37:09.674373 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 20:37:09.674373 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0cc5dcab12744c4cb48623c6432215ea", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0cc5dcab12744c4cb48623c6432215ea"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0cc5dcab12744c4cb48623c6432215ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0cc5dcab12744c4cb48623c6432215ea"}]}] Oct 04 20:37:09.674373 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1139940362 Oct 04 20:37:09.674373 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: 0cc5dcab12744c4cb48623c6432215ea Oct 04 20:37:09.674373 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1139940362 Oct 04 20:37:09.674373 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-KeyPairsNegativeTestJSON-1139940362-project Oct 04 20:37:09.674373 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:37:09.674373 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:37:09.674373 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: 7f3c312a13e146b2a59e18bb16ae79d4 Oct 04 20:37:09.674373 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1139940362-project Oct 04 20:37:09.674373 n-d-854823-8 devstack@n-api.service[128801]: Oct 04 20:37:09.674373 n-d-854823-8 devstack@n-api.service[128801]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-648304641", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} Oct 04 20:37:09.674373 n-d-854823-8 devstack@n-api.service[128801]: method: Oct 04 20:37:09.674373 n-d-854823-8 devstack@n-api.service[128801]: exception: Keypair data is invalid: failed to generate fingerprint Oct 04 20:37:09.685863 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-648304641', 'public_key': 'ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu'}}} Oct 04 20:37:09.685863 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:37:09.685863 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:37:09.685863 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Oct 04 20:37:09.685863 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Oct 04 20:37:09.685863 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 666, in load_ssh_public_key Oct 04 20:37:09.685863 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid key format") Oct 04 20:37:09.685863 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi ValueError: Invalid key format Oct 04 20:37:09.685863 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:37:09.685863 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:37:09.685863 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:37:09.685863 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:37:09.685863 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 04 20:37:09.685863 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 04 20:37:09.685863 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 04 20:37:09.685863 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 04 20:37:09.685863 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 20:37:09.685863 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 20:37:09.685863 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 20:37:09.685863 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 20:37:09.685863 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 04 20:37:09.685863 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 04 20:37:09.685863 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Oct 04 20:37:09.685863 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Oct 04 20:37:09.685863 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Oct 04 20:37:09.685863 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Oct 04 20:37:09.685863 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Oct 04 20:37:09.685863 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Oct 04 20:37:09.685863 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Oct 04 20:37:09.685863 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:37:09.685863 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:37:09.685863 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:37:09.685863 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:37:09.685863 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:37:09.685863 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:37:09.685863 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:37:09.685863 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:37:09.685863 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:37:09.685863 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:37:09.685863 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:37:09.685863 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:37:09.689643 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:37:09.689643 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:37:09.689643 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:37:09.689643 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:37:09.689643 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 04 20:37:09.689643 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 04 20:37:09.689643 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Oct 04 20:37:09.689643 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Oct 04 20:37:09.689643 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Oct 04 20:37:09.689643 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:37:09.689643 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:37:09.689643 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:37:09.689643 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:37:09.689643 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:37:09.689643 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:37:09.689643 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:37:09.689643 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:37:09.689643 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Oct 04 20:37:09.689643 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:37:09.689643 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-55ea3a91-1546-47dc-bc07-4f04fcf57500 tempest-KeyPairsNegativeTestJSON-1139940362 tempest-KeyPairsNegativeTestJSON-1139940362-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:37:09.689643 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-55ea3a91-1546-47dc-bc07-4f04fcf57500 tempest-KeyPairsNegativeTestJSON-1139940362 tempest-KeyPairsNegativeTestJSON-1139940362-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.112285 Oct 04 20:37:09.689643 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 463/917] 10.222.0.33 () {60 vars in 1160 bytes} [Tue Oct 4 20:37:09 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 114 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 04 20:37:09.691060 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-0a07a2c9-8a9d-4d52-9874-c1e21790a757 req-39987238-9921-4de1-ae68-26c685493f2a service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:09.691060 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-0a07a2c9-8a9d-4d52-9874-c1e21790a757 req-39987238-9921-4de1-ae68-26c685493f2a service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:09.691060 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-0a07a2c9-8a9d-4d52-9874-c1e21790a757 req-39987238-9921-4de1-ae68-26c685493f2a service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:09.697171 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-74536646-292f-4dd0-83a3-5590592e1a4c tempest-KeyPairsNegativeTestJSON-1139940362 tempest-KeyPairsNegativeTestJSON-1139940362-project] Action: 'create', calling method: .version_select at 0x7f3c74e058b0>, body: {"keypair": {"name": "tempest-keypair-1872303408", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMrm7HhWtqRA8RAeOlac8WJCjWTl3RfzGkIATQaj9bQrP4nIYnNNFhBf8DpRapAn3esD/C0Ltg9VMJIKIEPJMSZwTU52Z98vkJZrfGya1VAJ/onGpaZFFmHybgpIG/mLhw=="}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:37:09.708482 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-0a07a2c9-8a9d-4d52-9874-c1e21790a757 req-39987238-9921-4de1-ae68-26c685493f2a service nova] Creating event network-vif-plugged:cf080088-b0ac-4a20-83d3-5d85ca5cdb45 for instance 5dbb0cb7-e2d8-416a-a486-72d4398ee877 on n-h1-854823-8 Oct 04 20:37:09.715269 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-0a07a2c9-8a9d-4d52-9874-c1e21790a757 req-39987238-9921-4de1-ae68-26c685493f2a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068859 Oct 04 20:37:09.717762 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 455/918] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:37:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:37:09.724964 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-3eb86912-46ab-4220-90c3-0612a1946d4e tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:09.727185 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-3eb86912-46ab-4220-90c3-0612a1946d4e tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] [instance: 9f8cc082-0a37-4123-a680-1210a90b3ca9] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:09.745451 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-74536646-292f-4dd0-83a3-5590592e1a4c tempest-KeyPairsNegativeTestJSON-1139940362 tempest-KeyPairsNegativeTestJSON-1139940362-project] Getting quotas for project 0cc5dcab12744c4cb48623c6432215ea. Resources: {'key_pairs'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:37:09.745672 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3eb86912-46ab-4220-90c3-0612a1946d4e tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:09.749276 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3eb86912-46ab-4220-90c3-0612a1946d4e tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:09.750121 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3eb86912-46ab-4220-90c3-0612a1946d4e tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:09.752767 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3eb86912-46ab-4220-90c3-0612a1946d4e tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:09.757320 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-74536646-292f-4dd0-83a3-5590592e1a4c tempest-KeyPairsNegativeTestJSON-1139940362 tempest-KeyPairsNegativeTestJSON-1139940362-project] Getting quotas for user 7f3c312a13e146b2a59e18bb16ae79d4 and project 0cc5dcab12744c4cb48623c6432215ea. Resources: {'key_pairs'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:37:09.767410 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3eb86912-46ab-4220-90c3-0612a1946d4e tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:09.768159 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3eb86912-46ab-4220-90c3-0612a1946d4e tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:09.818731 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-74536646-292f-4dd0-83a3-5590592e1a4c tempest-KeyPairsNegativeTestJSON-1139940362 tempest-KeyPairsNegativeTestJSON-1139940362-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.125886 Oct 04 20:37:09.826761 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 464/919] 10.222.0.33 () {60 vars in 1159 bytes} [Tue Oct 4 20:37:09 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 20:37:09.832634 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-3ca5d7cd-365c-47b7-bfc0-5b68402abe21 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:09.833674 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-3ca5d7cd-365c-47b7-bfc0-5b68402abe21 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] [instance: 5dbb0cb7-e2d8-416a-a486-72d4398ee877] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:09.856897 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3ca5d7cd-365c-47b7-bfc0-5b68402abe21 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:09.859019 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3ca5d7cd-365c-47b7-bfc0-5b68402abe21 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:09.859635 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3ca5d7cd-365c-47b7-bfc0-5b68402abe21 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:09.861551 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3ca5d7cd-365c-47b7-bfc0-5b68402abe21 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:09.863583 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3ca5d7cd-365c-47b7-bfc0-5b68402abe21 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:09.864367 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3ca5d7cd-365c-47b7-bfc0-5b68402abe21 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:10.296430 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-3ca5d7cd-365c-47b7-bfc0-5b68402abe21 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:10.306515 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-3ca5d7cd-365c-47b7-bfc0-5b68402abe21 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:10.315000 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-3ca5d7cd-365c-47b7-bfc0-5b68402abe21 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:10.316473 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-3ca5d7cd-365c-47b7-bfc0-5b68402abe21 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] 10.222.0.33 "GET /compute/v2.1/servers/5dbb0cb7-e2d8-416a-a486-72d4398ee877" status: 200 len: 1362 microversion: 2.25 time: 0.487949 Oct 04 20:37:10.339801 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 465/920] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:37:09 2022] GET /compute/v2.1/servers/5dbb0cb7-e2d8-416a-a486-72d4398ee877 => generated 1362 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:37:10.347961 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9fcefc6e-9781-4846-94fc-4353644c9990 tempest-KeyPairsNegativeTestJSON-1139940362 tempest-KeyPairsNegativeTestJSON-1139940362-project] Action: 'create', calling method: .version_select at 0x7f3c749738b0>, body: {"keypair": {"name": "tempest-keypair-1872303408", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDX9MtwSu0gIldAkH2nLeE8CvLTGTwdr5jPia0K747j4M6IhAFFBNJz0Z8SR1sYLQ5cPdxHHn5dt46zk/ieL9s7SzlbJVKlJYn+Ep25wSES7BDPNoweaEafoZGLxoE4htQ=="}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:37:10.368478 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-9fcefc6e-9781-4846-94fc-4353644c9990 tempest-KeyPairsNegativeTestJSON-1139940362 tempest-KeyPairsNegativeTestJSON-1139940362-project] Getting quotas for project 0cc5dcab12744c4cb48623c6432215ea. Resources: {'key_pairs'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:37:10.373480 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-9fcefc6e-9781-4846-94fc-4353644c9990 tempest-KeyPairsNegativeTestJSON-1139940362 tempest-KeyPairsNegativeTestJSON-1139940362-project] Getting quotas for user 7f3c312a13e146b2a59e18bb16ae79d4 and project 0cc5dcab12744c4cb48623c6432215ea. Resources: {'key_pairs'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:37:10.399791 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-3eb86912-46ab-4220-90c3-0612a1946d4e tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a24944aeb34a5ea228965be9bf4ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c288268acb30475bbc065a8f72cb21d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:10.406709 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-9fcefc6e-9781-4846-94fc-4353644c9990 tempest-KeyPairsNegativeTestJSON-1139940362 tempest-KeyPairsNegativeTestJSON-1139940362-project] HTTP exception thrown: Key pair 'tempest-keypair-1872303408' already exists. Oct 04 20:37:10.415689 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9fcefc6e-9781-4846-94fc-4353644c9990 tempest-KeyPairsNegativeTestJSON-1139940362 tempest-KeyPairsNegativeTestJSON-1139940362-project] Request method failure captured: Oct 04 20:37:10.415689 n-d-854823-8 devstack@n-api.service[128801]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 04 20:37:10.415689 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:37:10.415689 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:37:10.415689 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:37:10.415689 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 273 Oct 04 20:37:10.415689 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:37:10.415689 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:37:10.415689 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:37:10.415689 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:37:10.415689 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJl1bygDbrPfv5X6PnKf9bcWoSbMJs5Xq_97ZbkaQK3uipi-fL2ALK1PNYg9z_yhwX-lcNU7jHXJceVwXPcZrcUo1piA05UAqwxIrQeE4xG5HEJW6yXBiZo_g7uLPksme_MD-ETVdSk_2CNDEVijgaAcs1VnH_QPBwUqQkSYB1DIoPI Oct 04 20:37:10.415689 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:37:10.415689 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:37:10.415689 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:37:10.415689 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:37:10.415689 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:37:10.415689 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:37:10.415689 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: 0cc5dcab12744c4cb48623c6432215ea Oct 04 20:37:10.415689 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1139940362 Oct 04 20:37:10.415689 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 20:37:10.415689 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 20:37:10.415689 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0cc5dcab12744c4cb48623c6432215ea", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0cc5dcab12744c4cb48623c6432215ea"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0cc5dcab12744c4cb48623c6432215ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0cc5dcab12744c4cb48623c6432215ea"}]}] Oct 04 20:37:10.415689 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1139940362 Oct 04 20:37:10.415689 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: 0cc5dcab12744c4cb48623c6432215ea Oct 04 20:37:10.415689 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1139940362 Oct 04 20:37:10.415689 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-KeyPairsNegativeTestJSON-1139940362-project Oct 04 20:37:10.415689 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:37:10.415689 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:37:10.415689 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: 7f3c312a13e146b2a59e18bb16ae79d4 Oct 04 20:37:10.415689 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1139940362-project Oct 04 20:37:10.415689 n-d-854823-8 devstack@n-api.service[128801]: Oct 04 20:37:10.415689 n-d-854823-8 devstack@n-api.service[128801]: {"keypair": {"name": "tempest-keypair-1872303408", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDX9MtwSu0gIldAkH2nLeE8CvLTGTwdr5jPia0K747j4M6IhAFFBNJz0Z8SR1sYLQ5cPdxHHn5dt46zk/ieL9s7SzlbJVKlJYn+Ep25wSES7BDPNoweaEafoZGLxoE4htQ=="}} Oct 04 20:37:10.415689 n-d-854823-8 devstack@n-api.service[128801]: method: Oct 04 20:37:10.415689 n-d-854823-8 devstack@n-api.service[128801]: exception: Key pair 'tempest-keypair-1872303408' already exists. Oct 04 20:37:10.415689 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'body': {'keypair': {'name': 'tempest-keypair-1872303408', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDX9MtwSu0gIldAkH2nLeE8CvLTGTwdr5jPia0K747j4M6IhAFFBNJz0Z8SR1sYLQ5cPdxHHn5dt46zk/ieL9s7SzlbJVKlJYn+Ep25wSES7BDPNoweaEafoZGLxoE4htQ=='}}} Oct 04 20:37:10.415689 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:37:10.415689 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:37:10.415689 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 04 20:37:10.415689 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 04 20:37:10.415689 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 04 20:37:10.415689 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 04 20:37:10.415689 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 04 20:37:10.415689 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 04 20:37:10.415689 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 04 20:37:10.415689 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 04 20:37:10.415689 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 04 20:37:10.415689 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 04 20:37:10.415689 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 04 20:37:10.415689 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi result.read() Oct 04 20:37:10.415689 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 04 20:37:10.415689 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 04 20:37:10.415689 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 04 20:37:10.415689 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 04 20:37:10.415689 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 04 20:37:10.415689 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 04 20:37:10.415689 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 04 20:37:10.415689 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 04 20:37:10.415689 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '7f3c312a13e146b2a59e18bb16ae79d4-tempest-keypair-1872303408' for key 'key_pairs.uniq_key_pairs0user_id0name'") Oct 04 20:37:10.415689 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:37:10.419999 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 04 20:37:10.419999 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:37:10.419999 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:37:10.419999 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 69, in _create_in_db Oct 04 20:37:10.419999 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi kp.save(context.session) Oct 04 20:37:10.419999 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Oct 04 20:37:10.419999 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi session.flush() Oct 04 20:37:10.419999 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 04 20:37:10.419999 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self._flush(objects) Oct 04 20:37:10.419999 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 04 20:37:10.419999 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Oct 04 20:37:10.419999 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 04 20:37:10.419999 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi compat.raise_( Oct 04 20:37:10.419999 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 04 20:37:10.419999 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception Oct 04 20:37:10.419999 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 04 20:37:10.419999 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi flush_context.execute() Oct 04 20:37:10.419999 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 04 20:37:10.419999 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi rec.execute(self) Oct 04 20:37:10.419999 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 04 20:37:10.419999 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Oct 04 20:37:10.419999 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 04 20:37:10.419999 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Oct 04 20:37:10.419999 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 04 20:37:10.419999 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Oct 04 20:37:10.419999 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 04 20:37:10.419999 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Oct 04 20:37:10.419999 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 04 20:37:10.419999 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Oct 04 20:37:10.419999 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 04 20:37:10.419999 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Oct 04 20:37:10.419999 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 04 20:37:10.419999 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Oct 04 20:37:10.419999 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 04 20:37:10.419999 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 04 20:37:10.419999 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 04 20:37:10.419999 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception Oct 04 20:37:10.419999 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 04 20:37:10.419999 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 04 20:37:10.419999 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 04 20:37:10.419999 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 04 20:37:10.419999 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 04 20:37:10.419999 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 04 20:37:10.419999 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 04 20:37:10.419999 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 04 20:37:10.419999 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 04 20:37:10.419999 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 04 20:37:10.419999 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 04 20:37:10.419999 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi result.read() Oct 04 20:37:10.419999 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 04 20:37:10.419999 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 04 20:37:10.419999 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 04 20:37:10.419999 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 04 20:37:10.419999 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 04 20:37:10.419999 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 04 20:37:10.419999 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 04 20:37:10.424074 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 04 20:37:10.424074 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '7f3c312a13e146b2a59e18bb16ae79d4-tempest-keypair-1872303408' for key 'key_pairs.uniq_key_pairs0user_id0name'") Oct 04 20:37:10.424074 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO key_pairs (created_at, updated_at, name, user_id, fingerprint, public_key, type) VALUES (%(created_at)s, %(updated_at)s, %(name)s, %(user_id)s, %(fingerprint)s, %(public_key)s, %(type)s)] Oct 04 20:37:10.424074 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 10, 4, 20, 37, 10, 393504), 'updated_at': None, 'name': 'tempest-keypair-1872303408', 'user_id': '7f3c312a13e146b2a59e18bb16ae79d4', 'fingerprint': 'f1:a1:77:d1:dc:be:af:67:93:06:6d:1a:6d:51:04:98', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDX9MtwSu0gIldAkH2nLeE8CvLTGTwdr5jPia0K747j4M6IhAFFBNJz0Z8SR1sYLQ5cPdxHHn5dt46zk/ieL9s7SzlbJVKlJYn+Ep25wSES7BDPNoweaEafoZGLxoE4htQ==', 'type': 'ssh'}] Oct 04 20:37:10.424074 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 04 20:37:10.424074 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:37:10.424074 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:37:10.424074 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:37:10.424074 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:37:10.424074 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 04 20:37:10.424074 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 04 20:37:10.424074 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 04 20:37:10.424074 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 04 20:37:10.424074 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 20:37:10.424074 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 20:37:10.424074 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 20:37:10.424074 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 20:37:10.424074 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 04 20:37:10.424074 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 04 20:37:10.424074 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6777, in import_key_pair Oct 04 20:37:10.424074 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi keypair.create() Oct 04 20:37:10.424074 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 04 20:37:10.424074 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 04 20:37:10.424074 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 158, in create Oct 04 20:37:10.424074 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self._create() Oct 04 20:37:10.424074 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 162, in _create Oct 04 20:37:10.424074 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi db_keypair = self._create_in_db(self._context, updates) Oct 04 20:37:10.424074 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 134, in _create_in_db Oct 04 20:37:10.424074 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return _create_in_db(context, values) Oct 04 20:37:10.424074 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 20:37:10.424074 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 20:37:10.424074 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 71, in _create_in_db Oct 04 20:37:10.424074 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.KeyPairExists(key_name=values['name']) Oct 04 20:37:10.424074 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.KeyPairExists: Key pair 'tempest-keypair-1872303408' already exists. Oct 04 20:37:10.424074 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:37:10.424074 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:37:10.424074 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:37:10.424074 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:37:10.424074 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:37:10.424074 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:37:10.424074 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:37:10.424074 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:37:10.424074 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:37:10.424074 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:37:10.424074 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:37:10.424074 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:37:10.424074 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:37:10.424074 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:37:10.424074 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:37:10.424074 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:37:10.424074 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 04 20:37:10.424074 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 04 20:37:10.424074 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 132, in _create Oct 04 20:37:10.424074 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=exc.format_message()) Oct 04 20:37:10.424074 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Key pair 'tempest-keypair-1872303408' already exists. Oct 04 20:37:10.427860 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:37:10.427860 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:37:10.427860 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:37:10.427860 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:37:10.427860 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:37:10.427860 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:37:10.427860 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:37:10.427860 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:37:10.427860 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Key pair 'tempest-keypair-1872303408' already exists. Oct 04 20:37:10.427860 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:37:10.427860 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9fcefc6e-9781-4846-94fc-4353644c9990 tempest-KeyPairsNegativeTestJSON-1139940362 tempest-KeyPairsNegativeTestJSON-1139940362-project] Returning 409 to user: Key pair 'tempest-keypair-1872303408' already exists. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:37:10.427860 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-9fcefc6e-9781-4846-94fc-4353644c9990 tempest-KeyPairsNegativeTestJSON-1139940362 tempest-KeyPairsNegativeTestJSON-1139940362-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 409 len: 105 microversion: 2.1 time: 0.083664 Oct 04 20:37:10.427860 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 466/921] 10.222.0.33 () {60 vars in 1159 bytes} [Tue Oct 4 20:37:10 2022] POST /compute/v2.1/os-keypairs => generated 105 bytes in 85 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 04 20:37:10.438403 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-3eb86912-46ab-4220-90c3-0612a1946d4e tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] 10.222.0.33 "GET /compute/v2.1/servers/9f8cc082-0a37-4123-a680-1210a90b3ca9" status: 200 len: 1472 microversion: 2.1 time: 0.703461 Oct 04 20:37:10.438403 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 456/922] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:37:09 2022] GET /compute/v2.1/servers/9f8cc082-0a37-4123-a680-1210a90b3ca9 => generated 1472 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:37:10.438739 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-56a2d5f8-cade-4889-8fcd-bbe32c74a47e tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:10.438739 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-56a2d5f8-cade-4889-8fcd-bbe32c74a47e tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] [instance: 33bf1c5a-fbf7-4db1-b2c8-e4ab05149f25] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:10.442716 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-b1526031-2200-465a-886d-1b03f5253ff6 req-443418f2-1020-4227-9fe3-7717a34793ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33bf1c5a-fbf7-4db1-b2c8-e4ab05149f25", "tag": "57e9c24e-f645-45f4-9a9c-48ab34ee6f74"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:37:10.450284 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-56a2d5f8-cade-4889-8fcd-bbe32c74a47e tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:10.450989 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-56a2d5f8-cade-4889-8fcd-bbe32c74a47e tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:10.451527 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-56a2d5f8-cade-4889-8fcd-bbe32c74a47e tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:10.452246 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-56a2d5f8-cade-4889-8fcd-bbe32c74a47e tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:10.452696 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-56a2d5f8-cade-4889-8fcd-bbe32c74a47e tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:10.453271 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-56a2d5f8-cade-4889-8fcd-bbe32c74a47e tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:10.477244 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-b1526031-2200-465a-886d-1b03f5253ff6 req-443418f2-1020-4227-9fe3-7717a34793ba service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:10.478496 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-b1526031-2200-465a-886d-1b03f5253ff6 req-443418f2-1020-4227-9fe3-7717a34793ba service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:10.479445 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=100 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:37:10.480028 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-b1526031-2200-465a-886d-1b03f5253ff6 req-443418f2-1020-4227-9fe3-7717a34793ba service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:10.505255 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-b1526031-2200-465a-886d-1b03f5253ff6 req-443418f2-1020-4227-9fe3-7717a34793ba service nova] Creating event network-changed:57e9c24e-f645-45f4-9a9c-48ab34ee6f74 for instance 33bf1c5a-fbf7-4db1-b2c8-e4ab05149f25 on n-h1-854823-8 Oct 04 20:37:10.517656 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-b1526031-2200-465a-886d-1b03f5253ff6 req-443418f2-1020-4227-9fe3-7717a34793ba service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083515 Oct 04 20:37:10.519477 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 457/923] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:37:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:37:10.534840 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-9d73b557-ed6d-4fdb-9909-b1b399028fb0 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:10.537356 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-9d73b557-ed6d-4fdb-9909-b1b399028fb0 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] [instance: 465ad440-a27e-4ff6-bb31-09f3545e166a] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:10.554776 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9d73b557-ed6d-4fdb-9909-b1b399028fb0 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:10.555670 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9d73b557-ed6d-4fdb-9909-b1b399028fb0 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:10.559356 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9d73b557-ed6d-4fdb-9909-b1b399028fb0 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:10.560468 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9d73b557-ed6d-4fdb-9909-b1b399028fb0 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:10.564709 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9d73b557-ed6d-4fdb-9909-b1b399028fb0 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:10.565290 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9d73b557-ed6d-4fdb-9909-b1b399028fb0 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:10.767821 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-56a2d5f8-cade-4889-8fcd-bbe32c74a47e tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa55ca3469648b0b1a2e1a29541c462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8659949e00dc429e8667767d0f126771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:10.776845 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-56a2d5f8-cade-4889-8fcd-bbe32c74a47e tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] 10.222.0.33 "GET /compute/v2.1/servers/33bf1c5a-fbf7-4db1-b2c8-e4ab05149f25" status: 200 len: 1589 microversion: 2.1 time: 0.349793 Oct 04 20:37:10.778005 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 467/924] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:37:10 2022] GET /compute/v2.1/servers/33bf1c5a-fbf7-4db1-b2c8-e4ab05149f25 => generated 1589 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:37:10.937106 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-9d73b557-ed6d-4fdb-9909-b1b399028fb0 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3563efe2b8c94931a2a46c4e14811b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3118a5d96843d3bede1ed94bd9717e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:10.947105 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-9d73b557-ed6d-4fdb-9909-b1b399028fb0 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] 10.222.0.33 "GET /compute/v2.1/servers/465ad440-a27e-4ff6-bb31-09f3545e166a" status: 200 len: 1543 microversion: 2.1 time: 0.422548 Oct 04 20:37:10.952873 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 458/925] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:37:10 2022] GET /compute/v2.1/servers/465ad440-a27e-4ff6-bb31-09f3545e166a => generated 1543 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:37:10.965387 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-26d32cb4-a192-4110-b129-6f760d52efc4 tempest-KeyPairsNegativeTestJSON-1139940362 tempest-KeyPairsNegativeTestJSON-1139940362-project] Calling method '.version_select at 0x7f3c74738af0>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:11.010070 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-26d32cb4-a192-4110-b129-6f760d52efc4 tempest-KeyPairsNegativeTestJSON-1139940362 tempest-KeyPairsNegativeTestJSON-1139940362-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1872303408" status: 202 len: 0 microversion: 2.1 time: 0.055513 Oct 04 20:37:11.010953 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 459/926] 10.222.0.33 () {58 vars in 1221 bytes} [Tue Oct 4 20:37:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1872303408 => generated 0 bytes in 57 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:37:11.015071 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5e684251-ffb8-4c0d-bf86-327666eb6317 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdmin275Test-server-1169476805", "imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63", "flavorRef": "452", "networks": "none"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:37:11.023810 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-29fbf0ba-9b00-4769-b025-4cb101868348 tempest-KeyPairsNegativeTestJSON-1139940362 tempest-KeyPairsNegativeTestJSON-1139940362-project] Action: 'create', calling method: .version_select at 0x7f3c74679dc0>, body: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCnSDyarvCs2evLR2XoMF1uZucQSjYgpcKLDmpyoDcQNo64YB/LvbrlCID5JGcffTkxEyYjx8Br9UmLd54LUVnpuefUHUpT8RDxznifEmjMjEKASpJ3Vf6ddM8gFhZxtTw=="}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:37:11.029105 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-29fbf0ba-9b00-4769-b025-4cb101868348 tempest-KeyPairsNegativeTestJSON-1139940362 tempest-KeyPairsNegativeTestJSON-1139940362-project] Request method failure captured: Oct 04 20:37:11.029105 n-d-854823-8 devstack@n-api.service[128802]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 04 20:37:11.029105 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 20:37:11.029105 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 20:37:11.029105 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 20:37:11.029105 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 247 Oct 04 20:37:11.029105 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 20:37:11.029105 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 20:37:11.029105 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 20:37:11.029105 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 20:37:11.029105 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPJl1bygDbrPfv5X6PnKf9bcWoSbMJs5Xq_97ZbkaQK3uipi-fL2ALK1PNYg9z_yhwX-lcNU7jHXJceVwXPcZrcUo1piA05UAqwxIrQeE4xG5HEJW6yXBiZo_g7uLPksme_MD-ETVdSk_2CNDEVijgaAcs1VnH_QPBwUqQkSYB1DIoPI Oct 04 20:37:11.029105 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 20:37:11.029105 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 20:37:11.029105 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 20:37:11.029105 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 20:37:11.029105 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 20:37:11.029105 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 20:37:11.029105 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: 0cc5dcab12744c4cb48623c6432215ea Oct 04 20:37:11.029105 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1139940362 Oct 04 20:37:11.029105 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 20:37:11.029105 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 20:37:11.029105 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0cc5dcab12744c4cb48623c6432215ea", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0cc5dcab12744c4cb48623c6432215ea"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0cc5dcab12744c4cb48623c6432215ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0cc5dcab12744c4cb48623c6432215ea"}]}] Oct 04 20:37:11.029105 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1139940362 Oct 04 20:37:11.029105 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: 0cc5dcab12744c4cb48623c6432215ea Oct 04 20:37:11.029105 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1139940362 Oct 04 20:37:11.029105 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-KeyPairsNegativeTestJSON-1139940362-project Oct 04 20:37:11.029105 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 20:37:11.029105 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 20:37:11.029105 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: 7f3c312a13e146b2a59e18bb16ae79d4 Oct 04 20:37:11.029105 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1139940362-project Oct 04 20:37:11.029105 n-d-854823-8 devstack@n-api.service[128802]: Oct 04 20:37:11.029105 n-d-854823-8 devstack@n-api.service[128802]: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCnSDyarvCs2evLR2XoMF1uZucQSjYgpcKLDmpyoDcQNo64YB/LvbrlCID5JGcffTkxEyYjx8Br9UmLd54LUVnpuefUHUpT8RDxznifEmjMjEKASpJ3Vf6ddM8gFhZxtTw=="}} Oct 04 20:37:11.029105 n-d-854823-8 devstack@n-api.service[128802]: method: Oct 04 20:37:11.029105 n-d-854823-8 devstack@n-api.service[128802]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 04 20:37:11.029105 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'body': {'keypair': {'name': '', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCnSDyarvCs2evLR2XoMF1uZucQSjYgpcKLDmpyoDcQNo64YB/LvbrlCID5JGcffTkxEyYjx8Br9UmLd54LUVnpuefUHUpT8RDxznifEmjMjEKASpJ3Vf6ddM8gFhZxtTw=='}}} Oct 04 20:37:11.029105 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:37:11.029105 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:37:11.029105 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 20:37:11.029105 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 20:37:11.029105 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 20:37:11.029105 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise error Oct 04 20:37:11.029105 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 04 20:37:11.029105 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:37:11.029105 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Oct 04 20:37:11.029105 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 04 20:37:11.029105 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:37:11.029105 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi On instance['keypair']: Oct 04 20:37:11.029105 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi '' Oct 04 20:37:11.029105 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:37:11.029105 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:37:11.029105 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:37:11.029105 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:37:11.029105 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:37:11.029105 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:37:11.029105 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:37:11.029105 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:37:11.029105 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:37:11.029105 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:37:11.029105 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:37:11.029105 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:37:11.029105 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:37:11.029105 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:37:11.029105 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 20:37:11.029105 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 20:37:11.033953 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 20:37:11.033953 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 20:37:11.033953 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 20:37:11.033953 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 20:37:11.033953 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 04 20:37:11.033953 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:37:11.033953 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:37:11.033953 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:37:11.033953 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:37:11.033953 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:37:11.033953 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:37:11.033953 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 20:37:11.033953 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 20:37:11.033953 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 04 20:37:11.033953 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:37:11.038520 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-29fbf0ba-9b00-4769-b025-4cb101868348 tempest-KeyPairsNegativeTestJSON-1139940362 tempest-KeyPairsNegativeTestJSON-1139940362-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:37:11.039699 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-29fbf0ba-9b00-4769-b025-4cb101868348 tempest-KeyPairsNegativeTestJSON-1139940362 tempest-KeyPairsNegativeTestJSON-1139940362-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.021173 Oct 04 20:37:11.040829 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 460/927] 10.222.0.33 () {60 vars in 1159 bytes} [Tue Oct 4 20:37:11 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 04 20:37:11.052850 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-22bf8a7b-df36-41c9-a6d7-3a78dc1fbcc2 tempest-KeyPairsNegativeTestJSON-1139940362 tempest-KeyPairsNegativeTestJSON-1139940362-project] Action: 'create', calling method: .version_select at 0x7f3c746e5e50>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1386006257", "public_key": " "}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:37:11.075013 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-22bf8a7b-df36-41c9-a6d7-3a78dc1fbcc2 tempest-KeyPairsNegativeTestJSON-1139940362 tempest-KeyPairsNegativeTestJSON-1139940362-project] Getting quotas for project 0cc5dcab12744c4cb48623c6432215ea. Resources: {'key_pairs'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:37:11.080675 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-22bf8a7b-df36-41c9-a6d7-3a78dc1fbcc2 tempest-KeyPairsNegativeTestJSON-1139940362 tempest-KeyPairsNegativeTestJSON-1139940362-project] Getting quotas for user 7f3c312a13e146b2a59e18bb16ae79d4 and project 0cc5dcab12744c4cb48623c6432215ea. Resources: {'key_pairs'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:37:11.118260 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-5e684251-ffb8-4c0d-bf86-327666eb6317 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Flavor limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:37:11.118856 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-5e684251-ffb8-4c0d-bf86-327666eb6317 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Image limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:37:11.119957 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-5e684251-ffb8-4c0d-bf86-327666eb6317 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Flavor pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:37:11.120484 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-5e684251-ffb8-4c0d-bf86-327666eb6317 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Image pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:37:11.124918 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-5e684251-ffb8-4c0d-bf86-327666eb6317 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:37:11.137113 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.wsgi [None req-22bf8a7b-df36-41c9-a6d7-3a78dc1fbcc2 tempest-KeyPairsNegativeTestJSON-1139940362 tempest-KeyPairsNegativeTestJSON-1139940362-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Oct 04 20:37:11.140608 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-22bf8a7b-df36-41c9-a6d7-3a78dc1fbcc2 tempest-KeyPairsNegativeTestJSON-1139940362 tempest-KeyPairsNegativeTestJSON-1139940362-project] Request method failure captured: Oct 04 20:37:11.140608 n-d-854823-8 devstack@n-api.service[128802]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 04 20:37:11.140608 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 20:37:11.140608 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 20:37:11.140608 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 20:37:11.140608 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 95 Oct 04 20:37:11.140608 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 20:37:11.140608 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 20:37:11.140608 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 20:37:11.140608 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 20:37:11.140608 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPJl1bygDbrPfv5X6PnKf9bcWoSbMJs5Xq_97ZbkaQK3uipi-fL2ALK1PNYg9z_yhwX-lcNU7jHXJceVwXPcZrcUo1piA05UAqwxIrQeE4xG5HEJW6yXBiZo_g7uLPksme_MD-ETVdSk_2CNDEVijgaAcs1VnH_QPBwUqQkSYB1DIoPI Oct 04 20:37:11.140608 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 20:37:11.140608 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 20:37:11.140608 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 20:37:11.140608 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 20:37:11.140608 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 20:37:11.140608 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 20:37:11.140608 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: 0cc5dcab12744c4cb48623c6432215ea Oct 04 20:37:11.140608 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1139940362 Oct 04 20:37:11.140608 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 20:37:11.140608 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 20:37:11.140608 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0cc5dcab12744c4cb48623c6432215ea", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0cc5dcab12744c4cb48623c6432215ea"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0cc5dcab12744c4cb48623c6432215ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0cc5dcab12744c4cb48623c6432215ea"}]}] Oct 04 20:37:11.140608 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1139940362 Oct 04 20:37:11.140608 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: 0cc5dcab12744c4cb48623c6432215ea Oct 04 20:37:11.140608 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1139940362 Oct 04 20:37:11.140608 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-KeyPairsNegativeTestJSON-1139940362-project Oct 04 20:37:11.140608 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 20:37:11.140608 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 20:37:11.140608 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: 7f3c312a13e146b2a59e18bb16ae79d4 Oct 04 20:37:11.140608 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1139940362-project Oct 04 20:37:11.140608 n-d-854823-8 devstack@n-api.service[128802]: Oct 04 20:37:11.140608 n-d-854823-8 devstack@n-api.service[128802]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1386006257", "public_key": " "}} Oct 04 20:37:11.140608 n-d-854823-8 devstack@n-api.service[128802]: method: Oct 04 20:37:11.140608 n-d-854823-8 devstack@n-api.service[128802]: exception: Keypair data is invalid: failed to generate fingerprint Oct 04 20:37:11.140608 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1386006257', 'public_key': ' '}}} Oct 04 20:37:11.140608 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:37:11.140608 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:37:11.140608 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Oct 04 20:37:11.140608 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Oct 04 20:37:11.140608 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 650, in load_ssh_public_key Oct 04 20:37:11.140608 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid line format") Oct 04 20:37:11.140608 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi ValueError: Invalid line format Oct 04 20:37:11.140608 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:37:11.140608 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:37:11.140608 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:37:11.140608 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:37:11.140608 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 04 20:37:11.140608 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 04 20:37:11.140608 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 04 20:37:11.140608 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 04 20:37:11.140608 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 20:37:11.140608 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 20:37:11.140608 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 20:37:11.140608 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 20:37:11.140608 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 04 20:37:11.140608 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 04 20:37:11.140608 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Oct 04 20:37:11.140608 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Oct 04 20:37:11.140608 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Oct 04 20:37:11.140608 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Oct 04 20:37:11.140608 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Oct 04 20:37:11.140608 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Oct 04 20:37:11.140608 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Oct 04 20:37:11.140608 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:37:11.140608 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:37:11.140608 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:37:11.145388 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:37:11.145388 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:37:11.145388 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:37:11.145388 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:37:11.145388 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:37:11.145388 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:37:11.145388 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:37:11.145388 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:37:11.145388 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:37:11.145388 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:37:11.145388 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:37:11.145388 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:37:11.145388 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:37:11.145388 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 04 20:37:11.145388 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 04 20:37:11.145388 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Oct 04 20:37:11.145388 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Oct 04 20:37:11.145388 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Oct 04 20:37:11.145388 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:37:11.145388 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:37:11.145388 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:37:11.145388 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:37:11.145388 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:37:11.145388 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:37:11.145388 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:37:11.145388 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:37:11.145388 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Oct 04 20:37:11.145388 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:37:11.145388 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-22bf8a7b-df36-41c9-a6d7-3a78dc1fbcc2 tempest-KeyPairsNegativeTestJSON-1139940362 tempest-KeyPairsNegativeTestJSON-1139940362-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:37:11.145388 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-22bf8a7b-df36-41c9-a6d7-3a78dc1fbcc2 tempest-KeyPairsNegativeTestJSON-1139940362 tempest-KeyPairsNegativeTestJSON-1139940362-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.093627 Oct 04 20:37:11.145388 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 461/928] 10.222.0.33 () {60 vars in 1158 bytes} [Tue Oct 4 20:37:11 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 96 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 04 20:37:11.154884 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5e684251-ffb8-4c0d-bf86-327666eb6317 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:11.157341 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5e684251-ffb8-4c0d-bf86-327666eb6317 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:11.158279 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5e684251-ffb8-4c0d-bf86-327666eb6317 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:11.159253 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-5bc5c427-9ec2-4688-87d5-48d4458f82d5 tempest-KeyPairsNegativeTestJSON-1139940362 tempest-KeyPairsNegativeTestJSON-1139940362-project] Action: 'create', calling method: .version_select at 0x7f3c74805af0>, body: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD+TOMJ8CIjXtOvQUVknm9tAkEgwDHNlRiCXxtRgZmBtcQY/4dgoIl1ZYW+L0YVPNOyY6TDMWn0WXz4Zqlfcq5KM9THpLyK0Yuz/yxZFI8sRQ6FGQZxXekWC7p9roa0zHg=="}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:37:11.163585 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5e684251-ffb8-4c0d-bf86-327666eb6317 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:11.165652 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5e684251-ffb8-4c0d-bf86-327666eb6317 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:11.166194 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5e684251-ffb8-4c0d-bf86-327666eb6317 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:11.182772 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-5bc5c427-9ec2-4688-87d5-48d4458f82d5 tempest-KeyPairsNegativeTestJSON-1139940362 tempest-KeyPairsNegativeTestJSON-1139940362-project] Request method failure captured: Oct 04 20:37:11.182772 n-d-854823-8 devstack@n-api.service[128802]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 04 20:37:11.182772 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 20:37:11.182772 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 20:37:11.182772 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 20:37:11.182772 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 507 Oct 04 20:37:11.182772 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 20:37:11.182772 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 20:37:11.182772 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 20:37:11.182772 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 20:37:11.182772 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPJl1bygDbrPfv5X6PnKf9bcWoSbMJs5Xq_97ZbkaQK3uipi-fL2ALK1PNYg9z_yhwX-lcNU7jHXJceVwXPcZrcUo1piA05UAqwxIrQeE4xG5HEJW6yXBiZo_g7uLPksme_MD-ETVdSk_2CNDEVijgaAcs1VnH_QPBwUqQkSYB1DIoPI Oct 04 20:37:11.182772 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 20:37:11.182772 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 20:37:11.182772 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 20:37:11.182772 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 20:37:11.182772 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 20:37:11.182772 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 20:37:11.182772 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: 0cc5dcab12744c4cb48623c6432215ea Oct 04 20:37:11.182772 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1139940362 Oct 04 20:37:11.182772 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 20:37:11.182772 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 20:37:11.182772 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0cc5dcab12744c4cb48623c6432215ea", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0cc5dcab12744c4cb48623c6432215ea"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0cc5dcab12744c4cb48623c6432215ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0cc5dcab12744c4cb48623c6432215ea"}]}] Oct 04 20:37:11.182772 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1139940362 Oct 04 20:37:11.182772 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: 0cc5dcab12744c4cb48623c6432215ea Oct 04 20:37:11.182772 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1139940362 Oct 04 20:37:11.182772 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-KeyPairsNegativeTestJSON-1139940362-project Oct 04 20:37:11.182772 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 20:37:11.182772 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 20:37:11.182772 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: 7f3c312a13e146b2a59e18bb16ae79d4 Oct 04 20:37:11.182772 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1139940362-project Oct 04 20:37:11.182772 n-d-854823-8 devstack@n-api.service[128802]: Oct 04 20:37:11.182772 n-d-854823-8 devstack@n-api.service[128802]: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD+TOMJ8CIjXtOvQUVknm9tAkEgwDHNlRiCXxtRgZmBtcQY/4dgoIl1ZYW+L0YVPNOyY6TDMWn0WXz4Zqlfcq5KM9THpLyK0Yuz/yxZFI8sRQ6FGQZxXekWC7p9roa0zHg=="}} Oct 04 20:37:11.182772 n-d-854823-8 devstack@n-api.service[128802]: method: Oct 04 20:37:11.182772 n-d-854823-8 devstack@n-api.service[128802]: exception: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 04 20:37:11.182772 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'body': {'keypair': {'name': 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD+TOMJ8CIjXtOvQUVknm9tAkEgwDHNlRiCXxtRgZmBtcQY/4dgoIl1ZYW+L0YVPNOyY6TDMWn0WXz4Zqlfcq5KM9THpLyK0Yuz/yxZFI8sRQ6FGQZxXekWC7p9roa0zHg=='}}} Oct 04 20:37:11.182772 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:37:11.182772 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:37:11.182772 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 20:37:11.182772 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 20:37:11.182772 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 20:37:11.182772 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise error Oct 04 20:37:11.182772 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 04 20:37:11.182772 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:37:11.182772 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Oct 04 20:37:11.182772 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 04 20:37:11.182772 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:37:11.182772 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi On instance['keypair']: Oct 04 20:37:11.182772 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' Oct 04 20:37:11.186386 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:37:11.186386 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:37:11.186386 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:37:11.186386 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:37:11.186386 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:37:11.186386 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:37:11.186386 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:37:11.186386 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:37:11.186386 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:37:11.186386 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:37:11.186386 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:37:11.186386 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:37:11.186386 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:37:11.186386 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:37:11.186386 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 20:37:11.186386 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 20:37:11.186386 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 20:37:11.186386 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 20:37:11.186386 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 20:37:11.186386 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 20:37:11.186386 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 04 20:37:11.186386 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:37:11.186386 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:37:11.186386 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:37:11.186386 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:37:11.186386 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:37:11.186386 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:37:11.186386 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 20:37:11.186386 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 20:37:11.186386 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 04 20:37:11.186386 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:37:11.186386 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-5bc5c427-9ec2-4688-87d5-48d4458f82d5 tempest-KeyPairsNegativeTestJSON-1139940362 tempest-KeyPairsNegativeTestJSON-1139940362-project] Returning 400 to user: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:37:11.186386 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-5bc5c427-9ec2-4688-87d5-48d4458f82d5 tempest-KeyPairsNegativeTestJSON-1139940362 tempest-KeyPairsNegativeTestJSON-1139940362-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 400 len: 627 microversion: 2.1 time: 0.029397 Oct 04 20:37:11.189447 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 462/929] 10.222.0.33 () {60 vars in 1159 bytes} [Tue Oct 4 20:37:11 2022] POST /compute/v2.1/os-keypairs => generated 627 bytes in 35 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 20:37:11.204553 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-6fc3a13f-adcf-491d-ae3b-5267c4783491 tempest-KeyPairsNegativeTestJSON-1139940362 tempest-KeyPairsNegativeTestJSON-1139940362-project] Action: 'create', calling method: .version_select at 0x7f3c74679820>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-195620924", "public_key": "ssh-rsa JUNK nova@ubuntu"}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:37:11.242540 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-5e684251-ffb8-4c0d-bf86-327666eb6317 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Getting quotas for project 0024f434015447759489d3cdc7bbaa4c. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:37:11.245974 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-6fc3a13f-adcf-491d-ae3b-5267c4783491 tempest-KeyPairsNegativeTestJSON-1139940362 tempest-KeyPairsNegativeTestJSON-1139940362-project] Getting quotas for project 0cc5dcab12744c4cb48623c6432215ea. Resources: {'key_pairs'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:37:11.251209 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-5e684251-ffb8-4c0d-bf86-327666eb6317 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Getting quotas for user a22706a9bf4d42efb57c10cbd92c6eea and project 0024f434015447759489d3cdc7bbaa4c. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:37:11.270609 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-6fc3a13f-adcf-491d-ae3b-5267c4783491 tempest-KeyPairsNegativeTestJSON-1139940362 tempest-KeyPairsNegativeTestJSON-1139940362-project] Getting quotas for user 7f3c312a13e146b2a59e18bb16ae79d4 and project 0cc5dcab12744c4cb48623c6432215ea. Resources: {'key_pairs'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:37:11.282949 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-5e684251-ffb8-4c0d-bf86-327666eb6317 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Going to run 1 instances... {{(pid=128801) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:37:11.290648 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-5e684251-ffb8-4c0d-bf86-327666eb6317 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] [instance: 5e984459-625e-44cd-b226-091276567215] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='15b24725-0c99-4bcf-b1fb-907cdf8e2d63',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128801) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:37:11.321675 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.wsgi [None req-6fc3a13f-adcf-491d-ae3b-5267c4783491 tempest-KeyPairsNegativeTestJSON-1139940362 tempest-KeyPairsNegativeTestJSON-1139940362-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Oct 04 20:37:11.324030 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-6fc3a13f-adcf-491d-ae3b-5267c4783491 tempest-KeyPairsNegativeTestJSON-1139940362 tempest-KeyPairsNegativeTestJSON-1139940362-project] Request method failure captured: Oct 04 20:37:11.324030 n-d-854823-8 devstack@n-api.service[128802]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 04 20:37:11.324030 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 20:37:11.324030 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 20:37:11.324030 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 20:37:11.324030 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 117 Oct 04 20:37:11.324030 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 20:37:11.324030 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 20:37:11.324030 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 20:37:11.324030 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 20:37:11.324030 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPJl1bygDbrPfv5X6PnKf9bcWoSbMJs5Xq_97ZbkaQK3uipi-fL2ALK1PNYg9z_yhwX-lcNU7jHXJceVwXPcZrcUo1piA05UAqwxIrQeE4xG5HEJW6yXBiZo_g7uLPksme_MD-ETVdSk_2CNDEVijgaAcs1VnH_QPBwUqQkSYB1DIoPI Oct 04 20:37:11.324030 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 20:37:11.324030 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 20:37:11.324030 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 20:37:11.324030 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 20:37:11.324030 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 20:37:11.324030 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 20:37:11.324030 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: 0cc5dcab12744c4cb48623c6432215ea Oct 04 20:37:11.324030 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1139940362 Oct 04 20:37:11.324030 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 20:37:11.324030 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 20:37:11.324030 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0cc5dcab12744c4cb48623c6432215ea", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0cc5dcab12744c4cb48623c6432215ea"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0cc5dcab12744c4cb48623c6432215ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0cc5dcab12744c4cb48623c6432215ea"}]}] Oct 04 20:37:11.324030 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1139940362 Oct 04 20:37:11.324030 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: 0cc5dcab12744c4cb48623c6432215ea Oct 04 20:37:11.324030 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1139940362 Oct 04 20:37:11.324030 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-KeyPairsNegativeTestJSON-1139940362-project Oct 04 20:37:11.324030 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 20:37:11.324030 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 20:37:11.324030 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: 7f3c312a13e146b2a59e18bb16ae79d4 Oct 04 20:37:11.324030 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1139940362-project Oct 04 20:37:11.324030 n-d-854823-8 devstack@n-api.service[128802]: Oct 04 20:37:11.324030 n-d-854823-8 devstack@n-api.service[128802]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-195620924", "public_key": "ssh-rsa JUNK nova@ubuntu"}} Oct 04 20:37:11.324030 n-d-854823-8 devstack@n-api.service[128802]: method: Oct 04 20:37:11.324030 n-d-854823-8 devstack@n-api.service[128802]: exception: Keypair data is invalid: failed to generate fingerprint Oct 04 20:37:11.324030 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-195620924', 'public_key': 'ssh-rsa JUNK nova@ubuntu'}}} Oct 04 20:37:11.324030 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:37:11.324030 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:37:11.324030 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Oct 04 20:37:11.324030 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Oct 04 20:37:11.324030 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 664, in load_ssh_public_key Oct 04 20:37:11.324030 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi inner_key_type, data = _get_sshstr(data) Oct 04 20:37:11.324030 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 134, in _get_sshstr Oct 04 20:37:11.324030 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi n, data = _get_u32(data) Oct 04 20:37:11.324030 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 121, in _get_u32 Oct 04 20:37:11.324030 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid data") Oct 04 20:37:11.324030 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi ValueError: Invalid data Oct 04 20:37:11.324030 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:37:11.324030 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:37:11.324030 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:37:11.324030 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:37:11.324030 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 04 20:37:11.324030 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 04 20:37:11.324030 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 04 20:37:11.324030 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 04 20:37:11.324030 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 20:37:11.324030 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 20:37:11.324030 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 20:37:11.324030 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 20:37:11.324030 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 04 20:37:11.324030 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 04 20:37:11.324030 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Oct 04 20:37:11.324030 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Oct 04 20:37:11.324030 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Oct 04 20:37:11.324030 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Oct 04 20:37:11.328040 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Oct 04 20:37:11.328040 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Oct 04 20:37:11.328040 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Oct 04 20:37:11.328040 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:37:11.328040 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:37:11.328040 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:37:11.328040 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:37:11.328040 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:37:11.328040 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:37:11.328040 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:37:11.328040 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:37:11.328040 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:37:11.328040 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:37:11.328040 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:37:11.328040 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:37:11.328040 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:37:11.328040 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:37:11.328040 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:37:11.328040 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:37:11.328040 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 04 20:37:11.328040 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 04 20:37:11.328040 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Oct 04 20:37:11.328040 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Oct 04 20:37:11.328040 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Oct 04 20:37:11.328040 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:37:11.328040 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:37:11.328040 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:37:11.328040 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:37:11.328040 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:37:11.328040 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:37:11.328040 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:37:11.328040 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:37:11.328040 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Oct 04 20:37:11.328040 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:37:11.332927 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-6fc3a13f-adcf-491d-ae3b-5267c4783491 tempest-KeyPairsNegativeTestJSON-1139940362 tempest-KeyPairsNegativeTestJSON-1139940362-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:37:11.334744 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-6fc3a13f-adcf-491d-ae3b-5267c4783491 tempest-KeyPairsNegativeTestJSON-1139940362 tempest-KeyPairsNegativeTestJSON-1139940362-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.139380 Oct 04 20:37:11.335852 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 463/930] 10.222.0.33 () {60 vars in 1159 bytes} [Tue Oct 4 20:37:11 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 141 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 04 20:37:11.348281 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-1f297b49-53fd-4839-9b27-c3c5c25ec5b1 tempest-KeyPairsNegativeTestJSON-1139940362 tempest-KeyPairsNegativeTestJSON-1139940362-project] Calling method '.version_select at 0x7f3c746e5af0>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:11.376699 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.wsgi [None req-1f297b49-53fd-4839-9b27-c3c5c25ec5b1 tempest-KeyPairsNegativeTestJSON-1139940362 tempest-KeyPairsNegativeTestJSON-1139940362-project] HTTP exception thrown: Keypair tempest-keypair-non-existent-1786497742 not found for user 7f3c312a13e146b2a59e18bb16ae79d4 Oct 04 20:37:11.379339 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-1f297b49-53fd-4839-9b27-c3c5c25ec5b1 tempest-KeyPairsNegativeTestJSON-1139940362 tempest-KeyPairsNegativeTestJSON-1139940362-project] Request method failure captured: Oct 04 20:37:11.379339 n-d-854823-8 devstack@n-api.service[128802]: request: DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1786497742 HTTP/1.1 Oct 04 20:37:11.379339 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 20:37:11.379339 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 20:37:11.379339 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 20:37:11.379339 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 0 Oct 04 20:37:11.379339 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 20:37:11.379339 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 20:37:11.379339 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 20:37:11.379339 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 20:37:11.379339 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPJl1bygDbrPfv5X6PnKf9bcWoSbMJs5Xq_97ZbkaQK3uipi-fL2ALK1PNYg9z_yhwX-lcNU7jHXJceVwXPcZrcUo1piA05UAqwxIrQeE4xG5HEJW6yXBiZo_g7uLPksme_MD-ETVdSk_2CNDEVijgaAcs1VnH_QPBwUqQkSYB1DIoPI Oct 04 20:37:11.379339 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 20:37:11.379339 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 20:37:11.379339 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 20:37:11.379339 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 20:37:11.379339 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 20:37:11.379339 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 20:37:11.379339 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: 0cc5dcab12744c4cb48623c6432215ea Oct 04 20:37:11.379339 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1139940362 Oct 04 20:37:11.379339 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 20:37:11.379339 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 20:37:11.379339 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0cc5dcab12744c4cb48623c6432215ea", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0cc5dcab12744c4cb48623c6432215ea"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0cc5dcab12744c4cb48623c6432215ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0cc5dcab12744c4cb48623c6432215ea"}]}] Oct 04 20:37:11.379339 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1139940362 Oct 04 20:37:11.379339 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: 0cc5dcab12744c4cb48623c6432215ea Oct 04 20:37:11.379339 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1139940362 Oct 04 20:37:11.379339 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-KeyPairsNegativeTestJSON-1139940362-project Oct 04 20:37:11.379339 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 20:37:11.379339 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 20:37:11.379339 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: 7f3c312a13e146b2a59e18bb16ae79d4 Oct 04 20:37:11.379339 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1139940362-project Oct 04 20:37:11.379339 n-d-854823-8 devstack@n-api.service[128802]: method: Oct 04 20:37:11.379339 n-d-854823-8 devstack@n-api.service[128802]: exception: Keypair tempest-keypair-non-existent-1786497742 not found for user 7f3c312a13e146b2a59e18bb16ae79d4 Oct 04 20:37:11.379339 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'id': 'tempest-keypair-non-existent-1786497742'} Oct 04 20:37:11.379339 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:37:11.379339 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:37:11.379339 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 170, in _delete Oct 04 20:37:11.379339 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi self.api.delete_key_pair(context, user_id, id) Oct 04 20:37:11.379339 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 04 20:37:11.379339 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 04 20:37:11.379339 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 20:37:11.379339 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 20:37:11.379339 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 20:37:11.379339 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 20:37:11.379339 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 04 20:37:11.379339 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 04 20:37:11.379339 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6861, in delete_key_pair Oct 04 20:37:11.379339 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi keypair = self.get_key_pair(context, user_id, key_name) Oct 04 20:37:11.379339 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6882, in get_key_pair Oct 04 20:37:11.379339 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return objects.KeyPair.get_by_name(context, user_id, key_name) Oct 04 20:37:11.379339 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 20:37:11.379339 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 20:37:11.379339 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Oct 04 20:37:11.379339 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Oct 04 20:37:11.379339 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Oct 04 20:37:11.379339 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Oct 04 20:37:11.379339 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 20:37:11.379339 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 20:37:11.379339 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Oct 04 20:37:11.379339 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Oct 04 20:37:11.379339 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-keypair-non-existent-1786497742 not found for user 7f3c312a13e146b2a59e18bb16ae79d4 Oct 04 20:37:11.379339 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:37:11.379339 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:37:11.384687 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:37:11.384687 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:37:11.384687 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:37:11.384687 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:37:11.384687 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:37:11.384687 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:37:11.384687 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:37:11.384687 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:37:11.384687 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 20:37:11.384687 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:37:11.384687 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:37:11.384687 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:37:11.384687 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 143, in delete Oct 04 20:37:11.384687 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi self._delete(req, id) Oct 04 20:37:11.384687 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 172, in _delete Oct 04 20:37:11.384687 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=exc.format_message()) Oct 04 20:37:11.384687 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Keypair tempest-keypair-non-existent-1786497742 not found for user 7f3c312a13e146b2a59e18bb16ae79d4 Oct 04 20:37:11.384687 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:37:11.384687 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:37:11.384687 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:37:11.384687 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:37:11.384687 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:37:11.384687 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:37:11.384687 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:37:11.384687 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:37:11.384687 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair tempest-keypair-non-existent-1786497742 not found for user 7f3c312a13e146b2a59e18bb16ae79d4 Oct 04 20:37:11.384687 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:37:11.387651 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-1f297b49-53fd-4839-9b27-c3c5c25ec5b1 tempest-KeyPairsNegativeTestJSON-1139940362 tempest-KeyPairsNegativeTestJSON-1139940362-project] Returning 404 to user: Keypair tempest-keypair-non-existent-1786497742 not found for user 7f3c312a13e146b2a59e18bb16ae79d4 {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:37:11.389419 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-1f297b49-53fd-4839-9b27-c3c5c25ec5b1 tempest-KeyPairsNegativeTestJSON-1139940362 tempest-KeyPairsNegativeTestJSON-1139940362-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1786497742" status: 404 len: 145 microversion: 2.1 time: 0.045551 Oct 04 20:37:11.393662 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 464/931] 10.222.0.33 () {58 vars in 1260 bytes} [Tue Oct 4 20:37:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1786497742 => generated 145 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:37:11.453427 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-df8f8ff4-059a-43a0-889f-110bf3c7da2c tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:11.456403 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-df8f8ff4-059a-43a0-889f-110bf3c7da2c tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] [instance: 5dbb0cb7-e2d8-416a-a486-72d4398ee877] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:11.459627 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5e684251-ffb8-4c0d-bf86-327666eb6317 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.75 time: 0.679659 Oct 04 20:37:11.465494 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 468/932] 10.222.0.33 () {62 vars in 1188 bytes} [Tue Oct 4 20:37:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 687 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 04 20:37:11.480061 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5b7b595b-31f9-4814-a168-aa524fdeba87 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:11.481208 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-5b7b595b-31f9-4814-a168-aa524fdeba87 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] [instance: 9f8cc082-0a37-4123-a680-1210a90b3ca9] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:11.494144 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-df8f8ff4-059a-43a0-889f-110bf3c7da2c tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:11.494688 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-df8f8ff4-059a-43a0-889f-110bf3c7da2c tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:11.497472 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5b7b595b-31f9-4814-a168-aa524fdeba87 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:11.498993 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-df8f8ff4-059a-43a0-889f-110bf3c7da2c tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:11.499731 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5b7b595b-31f9-4814-a168-aa524fdeba87 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:11.500282 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5b7b595b-31f9-4814-a168-aa524fdeba87 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:11.500710 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-df8f8ff4-059a-43a0-889f-110bf3c7da2c tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:11.502269 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5b7b595b-31f9-4814-a168-aa524fdeba87 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:11.503525 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5b7b595b-31f9-4814-a168-aa524fdeba87 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:11.503690 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-df8f8ff4-059a-43a0-889f-110bf3c7da2c tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:11.506819 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-df8f8ff4-059a-43a0-889f-110bf3c7da2c tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:11.507670 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5b7b595b-31f9-4814-a168-aa524fdeba87 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:12.031271 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-df8f8ff4-059a-43a0-889f-110bf3c7da2c tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:12.042519 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-df8f8ff4-059a-43a0-889f-110bf3c7da2c tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:12.043962 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-df8f8ff4-059a-43a0-889f-110bf3c7da2c tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:12.051629 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-5b7b595b-31f9-4814-a168-aa524fdeba87 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a24944aeb34a5ea228965be9bf4ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c288268acb30475bbc065a8f72cb21d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:12.058594 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-df8f8ff4-059a-43a0-889f-110bf3c7da2c tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] 10.222.0.33 "GET /compute/v2.1/servers/5dbb0cb7-e2d8-416a-a486-72d4398ee877" status: 200 len: 1362 microversion: 2.25 time: 0.652550 Oct 04 20:37:12.063241 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5b7b595b-31f9-4814-a168-aa524fdeba87 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] 10.222.0.33 "GET /compute/v2.1/servers/9f8cc082-0a37-4123-a680-1210a90b3ca9" status: 200 len: 1472 microversion: 2.1 time: 0.595960 Oct 04 20:37:12.065976 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 465/933] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:37:11 2022] GET /compute/v2.1/servers/5dbb0cb7-e2d8-416a-a486-72d4398ee877 => generated 1362 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:37:12.068315 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 469/934] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:37:11 2022] GET /compute/v2.1/servers/9f8cc082-0a37-4123-a680-1210a90b3ca9 => generated 1472 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:37:12.090107 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-ecfc0b4e-d756-403f-82f7-650f132b3564 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:37:12.091444 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-44c13c5c-5735-453e-a117-77436cf7d8be tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:12.097590 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-44c13c5c-5735-453e-a117-77436cf7d8be tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] [instance: 465ad440-a27e-4ff6-bb31-09f3545e166a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:12.108569 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-ecfc0b4e-d756-403f-82f7-650f132b3564 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] [instance: 5e984459-625e-44cd-b226-091276567215] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:12.111926 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-44c13c5c-5735-453e-a117-77436cf7d8be tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:12.116154 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-44c13c5c-5735-453e-a117-77436cf7d8be tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:12.117967 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-44c13c5c-5735-453e-a117-77436cf7d8be tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:12.119273 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-44c13c5c-5735-453e-a117-77436cf7d8be tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:12.122505 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-44c13c5c-5735-453e-a117-77436cf7d8be tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:12.123541 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-44c13c5c-5735-453e-a117-77436cf7d8be tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:12.368367 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-ecfc0b4e-d756-403f-82f7-650f132b3564 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22706a9bf4d42efb57c10cbd92c6eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0024f434015447759489d3cdc7bbaa4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:12.389330 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-ecfc0b4e-d756-403f-82f7-650f132b3564 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a22706a9bf4d42efb57c10cbd92c6eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0024f434015447759489d3cdc7bbaa4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:12.391113 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-ecfc0b4e-d756-403f-82f7-650f132b3564 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a22706a9bf4d42efb57c10cbd92c6eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0024f434015447759489d3cdc7bbaa4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:12.406187 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-ecfc0b4e-d756-403f-82f7-650f132b3564 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] 10.222.0.33 "PUT /compute/v2.1/servers/5e984459-625e-44cd-b226-091276567215" status: 200 len: 1359 microversion: 2.75 time: 0.336916 Oct 04 20:37:12.425630 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 466/935] 10.222.0.33 () {62 vars in 1297 bytes} [Tue Oct 4 20:37:12 2022] PUT /compute/v2.1/servers/5e984459-625e-44cd-b226-091276567215 => generated 1359 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:37:12.439247 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-52679939-ac52-471a-b703-92add8a638b4 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:12.440191 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-52679939-ac52-471a-b703-92add8a638b4 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] [instance: 5e984459-625e-44cd-b226-091276567215] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:12.447605 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-52679939-ac52-471a-b703-92add8a638b4 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:12.448383 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-52679939-ac52-471a-b703-92add8a638b4 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:12.449276 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-52679939-ac52-471a-b703-92add8a638b4 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:12.450607 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-52679939-ac52-471a-b703-92add8a638b4 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:12.451305 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-52679939-ac52-471a-b703-92add8a638b4 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:12.452022 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-52679939-ac52-471a-b703-92add8a638b4 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:12.597594 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-44c13c5c-5735-453e-a117-77436cf7d8be tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3563efe2b8c94931a2a46c4e14811b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3118a5d96843d3bede1ed94bd9717e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:12.609673 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-44c13c5c-5735-453e-a117-77436cf7d8be tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] 10.222.0.33 "GET /compute/v2.1/servers/465ad440-a27e-4ff6-bb31-09f3545e166a" status: 200 len: 1543 microversion: 2.1 time: 0.539116 Oct 04 20:37:12.610508 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 470/936] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:37:12 2022] GET /compute/v2.1/servers/465ad440-a27e-4ff6-bb31-09f3545e166a => generated 1543 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:37:12.616120 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-dafec7b6-3ab9-433a-87a5-d4325b196770 req-d474b511-0db0-41da-83be-e4b301e43677 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d9db253-559a-4d4b-9a5e-42c8f63f6cb7", "tag": "9b3bb850-3715-4a18-91c1-43aaf29fbf6f"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:37:12.643699 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-dafec7b6-3ab9-433a-87a5-d4325b196770 req-d474b511-0db0-41da-83be-e4b301e43677 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:12.644220 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-dafec7b6-3ab9-433a-87a5-d4325b196770 req-d474b511-0db0-41da-83be-e4b301e43677 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:12.644916 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-dafec7b6-3ab9-433a-87a5-d4325b196770 req-d474b511-0db0-41da-83be-e4b301e43677 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:12.684297 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-dafec7b6-3ab9-433a-87a5-d4325b196770 req-d474b511-0db0-41da-83be-e4b301e43677 service nova] Creating event network-changed:9b3bb850-3715-4a18-91c1-43aaf29fbf6f for instance 7d9db253-559a-4d4b-9a5e-42c8f63f6cb7 on n-h1-854823-8 Oct 04 20:37:12.705066 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-dafec7b6-3ab9-433a-87a5-d4325b196770 req-d474b511-0db0-41da-83be-e4b301e43677 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093300 Oct 04 20:37:12.706218 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 471/937] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:37:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:37:12.816799 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-52679939-ac52-471a-b703-92add8a638b4 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22706a9bf4d42efb57c10cbd92c6eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0024f434015447759489d3cdc7bbaa4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:12.824634 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:37:12.835048 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-52679939-ac52-471a-b703-92add8a638b4 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a22706a9bf4d42efb57c10cbd92c6eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0024f434015447759489d3cdc7bbaa4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:12.836931 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-52679939-ac52-471a-b703-92add8a638b4 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a22706a9bf4d42efb57c10cbd92c6eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0024f434015447759489d3cdc7bbaa4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:12.855326 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-52679939-ac52-471a-b703-92add8a638b4 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] 10.222.0.33 "GET /compute/v2.1/servers/5e984459-625e-44cd-b226-091276567215" status: 200 len: 1363 microversion: 2.75 time: 0.420706 Oct 04 20:37:12.857538 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 467/938] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:37:12 2022] GET /compute/v2.1/servers/5e984459-625e-44cd-b226-091276567215 => generated 1363 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:37:13.098369 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-aff7c0b9-acb4-4eb5-b5e8-8627fc528ddb tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:13.099844 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-aff7c0b9-acb4-4eb5-b5e8-8627fc528ddb tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] [instance: 9f8cc082-0a37-4123-a680-1210a90b3ca9] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:13.103109 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-cf79eb66-f268-459d-91d5-b3b25679fd3b tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:13.106067 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-cf79eb66-f268-459d-91d5-b3b25679fd3b tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] [instance: 5dbb0cb7-e2d8-416a-a486-72d4398ee877] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:13.116077 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-aff7c0b9-acb4-4eb5-b5e8-8627fc528ddb tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:13.117040 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-aff7c0b9-acb4-4eb5-b5e8-8627fc528ddb tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:13.117040 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-aff7c0b9-acb4-4eb5-b5e8-8627fc528ddb tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:13.117704 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-aff7c0b9-acb4-4eb5-b5e8-8627fc528ddb tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:13.118870 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cf79eb66-f268-459d-91d5-b3b25679fd3b tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:13.119590 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cf79eb66-f268-459d-91d5-b3b25679fd3b tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:13.120219 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cf79eb66-f268-459d-91d5-b3b25679fd3b tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:13.121518 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cf79eb66-f268-459d-91d5-b3b25679fd3b tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:13.122328 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cf79eb66-f268-459d-91d5-b3b25679fd3b tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:13.122951 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cf79eb66-f268-459d-91d5-b3b25679fd3b tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:13.126286 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-aff7c0b9-acb4-4eb5-b5e8-8627fc528ddb tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:13.126993 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-aff7c0b9-acb4-4eb5-b5e8-8627fc528ddb tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:13.903576 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-aff7c0b9-acb4-4eb5-b5e8-8627fc528ddb tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a24944aeb34a5ea228965be9bf4ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c288268acb30475bbc065a8f72cb21d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:13.916784 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-cf79eb66-f268-459d-91d5-b3b25679fd3b tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:13.919095 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-aff7c0b9-acb4-4eb5-b5e8-8627fc528ddb tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] 10.222.0.33 "GET /compute/v2.1/servers/9f8cc082-0a37-4123-a680-1210a90b3ca9" status: 200 len: 1472 microversion: 2.1 time: 0.825809 Oct 04 20:37:13.930876 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-cf79eb66-f268-459d-91d5-b3b25679fd3b tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:13.933354 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-cf79eb66-f268-459d-91d5-b3b25679fd3b tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:13.935753 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-cf79eb66-f268-459d-91d5-b3b25679fd3b tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] 10.222.0.33 "GET /compute/v2.1/servers/5dbb0cb7-e2d8-416a-a486-72d4398ee877" status: 200 len: 1557 microversion: 2.25 time: 0.843969 Oct 04 20:37:13.938645 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 468/939] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:37:13 2022] GET /compute/v2.1/servers/9f8cc082-0a37-4123-a680-1210a90b3ca9 => generated 1472 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:37:13.946502 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 472/940] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:37:13 2022] GET /compute/v2.1/servers/5dbb0cb7-e2d8-416a-a486-72d4398ee877 => generated 1557 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 20:37:13.968128 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-b6791030-3657-4b52-896a-45146aa257b0 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:13.969833 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-b6791030-3657-4b52-896a-45146aa257b0 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] [instance: 465ad440-a27e-4ff6-bb31-09f3545e166a] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:13.971993 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-41b718ca-c16d-4648-9a0e-39f3fc2d2ec3 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:13.976392 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-41b718ca-c16d-4648-9a0e-39f3fc2d2ec3 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] [instance: 5e984459-625e-44cd-b226-091276567215] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:13.984071 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b6791030-3657-4b52-896a-45146aa257b0 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:13.986556 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b6791030-3657-4b52-896a-45146aa257b0 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:13.988522 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:37:13.990601 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b6791030-3657-4b52-896a-45146aa257b0 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:13.993456 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b6791030-3657-4b52-896a-45146aa257b0 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:13.993618 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-41b718ca-c16d-4648-9a0e-39f3fc2d2ec3 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:13.994159 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-41b718ca-c16d-4648-9a0e-39f3fc2d2ec3 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:13.994602 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-41b718ca-c16d-4648-9a0e-39f3fc2d2ec3 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:13.995352 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b6791030-3657-4b52-896a-45146aa257b0 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:13.996557 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b6791030-3657-4b52-896a-45146aa257b0 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:13.997056 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-41b718ca-c16d-4648-9a0e-39f3fc2d2ec3 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:14.005816 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-41b718ca-c16d-4648-9a0e-39f3fc2d2ec3 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:14.006465 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-41b718ca-c16d-4648-9a0e-39f3fc2d2ec3 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:14.227728 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-41b718ca-c16d-4648-9a0e-39f3fc2d2ec3 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22706a9bf4d42efb57c10cbd92c6eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0024f434015447759489d3cdc7bbaa4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:14.241044 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-41b718ca-c16d-4648-9a0e-39f3fc2d2ec3 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a22706a9bf4d42efb57c10cbd92c6eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0024f434015447759489d3cdc7bbaa4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:14.243227 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-41b718ca-c16d-4648-9a0e-39f3fc2d2ec3 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a22706a9bf4d42efb57c10cbd92c6eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0024f434015447759489d3cdc7bbaa4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:14.254899 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-41b718ca-c16d-4648-9a0e-39f3fc2d2ec3 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] 10.222.0.33 "GET /compute/v2.1/servers/5e984459-625e-44cd-b226-091276567215" status: 200 len: 1417 microversion: 2.75 time: 0.295290 Oct 04 20:37:14.266401 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 473/941] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:37:13 2022] GET /compute/v2.1/servers/5e984459-625e-44cd-b226-091276567215 => generated 1417 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:37:14.439559 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-b6791030-3657-4b52-896a-45146aa257b0 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3563efe2b8c94931a2a46c4e14811b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3118a5d96843d3bede1ed94bd9717e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:14.448390 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-b6791030-3657-4b52-896a-45146aa257b0 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] 10.222.0.33 "GET /compute/v2.1/servers/465ad440-a27e-4ff6-bb31-09f3545e166a" status: 200 len: 1543 microversion: 2.1 time: 0.509211 Oct 04 20:37:14.452328 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 469/942] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:37:13 2022] GET /compute/v2.1/servers/465ad440-a27e-4ff6-bb31-09f3545e166a => generated 1543 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:37:14.604171 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-5c94d35f-b099-4be9-9e06-60c5af9374c5 tempest-AZV2TestJSON-2119987524 tempest-AZV2TestJSON-2119987524-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:14.606566 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5c94d35f-b099-4be9-9e06-60c5af9374c5 tempest-AZV2TestJSON-2119987524 tempest-AZV2TestJSON-2119987524-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:14.607358 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5c94d35f-b099-4be9-9e06-60c5af9374c5 tempest-AZV2TestJSON-2119987524 tempest-AZV2TestJSON-2119987524-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:14.608027 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5c94d35f-b099-4be9-9e06-60c5af9374c5 tempest-AZV2TestJSON-2119987524 tempest-AZV2TestJSON-2119987524-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:14.609533 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5c94d35f-b099-4be9-9e06-60c5af9374c5 tempest-AZV2TestJSON-2119987524 tempest-AZV2TestJSON-2119987524-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:14.610646 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5c94d35f-b099-4be9-9e06-60c5af9374c5 tempest-AZV2TestJSON-2119987524 tempest-AZV2TestJSON-2119987524-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:14.611289 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5c94d35f-b099-4be9-9e06-60c5af9374c5 tempest-AZV2TestJSON-2119987524 tempest-AZV2TestJSON-2119987524-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:14.653333 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-5c94d35f-b099-4be9-9e06-60c5af9374c5 tempest-AZV2TestJSON-2119987524 tempest-AZV2TestJSON-2119987524-project] 10.222.0.33 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.122760 Oct 04 20:37:14.656132 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 470/943] 10.222.0.33 () {58 vars in 1164 bytes} [Tue Oct 4 20:37:14 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 04 20:37:14.692881 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c7575d56-c995-40cb-8e9b-c6164ca691dd tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:14.693491 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c7575d56-c995-40cb-8e9b-c6164ca691dd tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] [instance: 5dbb0cb7-e2d8-416a-a486-72d4398ee877] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:14.709406 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c7575d56-c995-40cb-8e9b-c6164ca691dd tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:14.710017 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c7575d56-c995-40cb-8e9b-c6164ca691dd tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:14.712896 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c7575d56-c995-40cb-8e9b-c6164ca691dd tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:14.715356 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c7575d56-c995-40cb-8e9b-c6164ca691dd tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:14.716033 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c7575d56-c995-40cb-8e9b-c6164ca691dd tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:14.717102 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c7575d56-c995-40cb-8e9b-c6164ca691dd tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:14.953619 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-9a83217c-8171-452d-8121-54c9dd8ca66e tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:14.954239 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-9a83217c-8171-452d-8121-54c9dd8ca66e tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] [instance: 9f8cc082-0a37-4123-a680-1210a90b3ca9] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:14.965906 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-c7575d56-c995-40cb-8e9b-c6164ca691dd tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] Lazy-loading 'services' on Instance uuid 5dbb0cb7-e2d8-416a-a486-72d4398ee877 {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:37:14.978801 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9a83217c-8171-452d-8121-54c9dd8ca66e tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:14.982952 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9a83217c-8171-452d-8121-54c9dd8ca66e tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:14.983498 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9a83217c-8171-452d-8121-54c9dd8ca66e tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:14.987109 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9a83217c-8171-452d-8121-54c9dd8ca66e tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:14.987687 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9a83217c-8171-452d-8121-54c9dd8ca66e tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:14.994818 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9a83217c-8171-452d-8121-54c9dd8ca66e tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:15.038634 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c7575d56-c995-40cb-8e9b-c6164ca691dd tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/5dbb0cb7-e2d8-416a-a486-72d4398ee877" status: 200 len: 2050 microversion: 2.25 time: 0.778758 Oct 04 20:37:15.039549 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 474/944] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:37:14 2022] GET /compute/v2.1/servers/5dbb0cb7-e2d8-416a-a486-72d4398ee877 => generated 2050 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:37:15.073019 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5913d970-d7d8-49f4-b981-4542bb3f1744 tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:15.073632 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-5913d970-d7d8-49f4-b981-4542bb3f1744 tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] [instance: 5dbb0cb7-e2d8-416a-a486-72d4398ee877] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:15.089068 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5913d970-d7d8-49f4-b981-4542bb3f1744 tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:15.089640 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5913d970-d7d8-49f4-b981-4542bb3f1744 tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:15.090148 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5913d970-d7d8-49f4-b981-4542bb3f1744 tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:15.090940 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5913d970-d7d8-49f4-b981-4542bb3f1744 tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:15.092778 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5913d970-d7d8-49f4-b981-4542bb3f1744 tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:15.093472 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5913d970-d7d8-49f4-b981-4542bb3f1744 tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:15.347479 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-9a83217c-8171-452d-8121-54c9dd8ca66e tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a24944aeb34a5ea228965be9bf4ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c288268acb30475bbc065a8f72cb21d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:15.357369 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-9a83217c-8171-452d-8121-54c9dd8ca66e tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] 10.222.0.33 "GET /compute/v2.1/servers/9f8cc082-0a37-4123-a680-1210a90b3ca9" status: 200 len: 1472 microversion: 2.1 time: 0.407204 Oct 04 20:37:15.363384 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 471/945] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:37:14 2022] GET /compute/v2.1/servers/9f8cc082-0a37-4123-a680-1210a90b3ca9 => generated 1472 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:37:15.368416 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-90a15b5f-33d0-462f-9bd2-b99c575cdde5 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:15.375399 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-90a15b5f-33d0-462f-9bd2-b99c575cdde5 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] [instance: 5e984459-625e-44cd-b226-091276567215] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:15.410640 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-90a15b5f-33d0-462f-9bd2-b99c575cdde5 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:15.411276 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-90a15b5f-33d0-462f-9bd2-b99c575cdde5 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:15.412169 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-90a15b5f-33d0-462f-9bd2-b99c575cdde5 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:15.412970 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-90a15b5f-33d0-462f-9bd2-b99c575cdde5 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:15.416002 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-90a15b5f-33d0-462f-9bd2-b99c575cdde5 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:15.416699 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-90a15b5f-33d0-462f-9bd2-b99c575cdde5 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:15.509332 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-5913d970-d7d8-49f4-b981-4542bb3f1744 tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] Lazy-loading 'services' on Instance uuid 5dbb0cb7-e2d8-416a-a486-72d4398ee877 {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:37:15.558844 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-90a15b5f-33d0-462f-9bd2-b99c575cdde5 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22706a9bf4d42efb57c10cbd92c6eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0024f434015447759489d3cdc7bbaa4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:15.561819 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5913d970-d7d8-49f4-b981-4542bb3f1744 tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/5dbb0cb7-e2d8-416a-a486-72d4398ee877" status: 200 len: 2050 microversion: 2.25 time: 0.493598 Oct 04 20:37:15.563676 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 475/946] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:37:15 2022] GET /compute/v2.1/servers/5dbb0cb7-e2d8-416a-a486-72d4398ee877 => generated 2050 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:37:15.572456 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9a532b85-ec05-4de7-85ce-879b3dd417ad tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:15.573290 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-9a532b85-ec05-4de7-85ce-879b3dd417ad tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] [instance: 465ad440-a27e-4ff6-bb31-09f3545e166a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:15.581356 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9a532b85-ec05-4de7-85ce-879b3dd417ad tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:15.582581 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9a532b85-ec05-4de7-85ce-879b3dd417ad tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:15.583337 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9a532b85-ec05-4de7-85ce-879b3dd417ad tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:15.584382 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9a532b85-ec05-4de7-85ce-879b3dd417ad tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:15.585587 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-90a15b5f-33d0-462f-9bd2-b99c575cdde5 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a22706a9bf4d42efb57c10cbd92c6eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0024f434015447759489d3cdc7bbaa4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:15.587257 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-90a15b5f-33d0-462f-9bd2-b99c575cdde5 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a22706a9bf4d42efb57c10cbd92c6eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0024f434015447759489d3cdc7bbaa4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:15.595510 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9a532b85-ec05-4de7-85ce-879b3dd417ad tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:15.599049 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9a532b85-ec05-4de7-85ce-879b3dd417ad tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:15.600409 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-90a15b5f-33d0-462f-9bd2-b99c575cdde5 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] 10.222.0.33 "GET /compute/v2.1/servers/5e984459-625e-44cd-b226-091276567215" status: 200 len: 1417 microversion: 2.75 time: 0.233799 Oct 04 20:37:15.601040 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 472/947] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:37:15 2022] GET /compute/v2.1/servers/5e984459-625e-44cd-b226-091276567215 => generated 1417 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:37:15.630728 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-ebb6d689-d6d2-4247-9aa4-c921d4250c0c tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:15.634593 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ebb6d689-d6d2-4247-9aa4-c921d4250c0c tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:15.635081 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ebb6d689-d6d2-4247-9aa4-c921d4250c0c tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:15.640784 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ebb6d689-d6d2-4247-9aa4-c921d4250c0c tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:15.641979 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ebb6d689-d6d2-4247-9aa4-c921d4250c0c tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:15.642999 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ebb6d689-d6d2-4247-9aa4-c921d4250c0c tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:15.643599 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ebb6d689-d6d2-4247-9aa4-c921d4250c0c tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:15.676558 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-ebb6d689-d6d2-4247-9aa4-c921d4250c0c tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.057505 Oct 04 20:37:15.677829 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 473/948] 10.222.0.33 () {60 vars in 1217 bytes} [Tue Oct 4 20:37:15 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 20:37:15.689980 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-b0e894be-4c66-43dd-afee-d846690f735f tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-854823-8", "block_migration": "auto"}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:37:15.692845 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-b0e894be-4c66-43dd-afee-d846690f735f tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] [instance: 5dbb0cb7-e2d8-416a-a486-72d4398ee877] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:15.700136 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b0e894be-4c66-43dd-afee-d846690f735f tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:15.700935 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b0e894be-4c66-43dd-afee-d846690f735f tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:15.701678 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b0e894be-4c66-43dd-afee-d846690f735f tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:15.702904 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b0e894be-4c66-43dd-afee-d846690f735f tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:15.703646 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b0e894be-4c66-43dd-afee-d846690f735f tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:15.704313 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b0e894be-4c66-43dd-afee-d846690f735f tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:15.735712 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.objects.instance [None req-b0e894be-4c66-43dd-afee-d846690f735f tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] Lazy-loading 'flavor' on Instance uuid 5dbb0cb7-e2d8-416a-a486-72d4398ee877 {{(pid=128802) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:37:15.755128 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-b0e894be-4c66-43dd-afee-d846690f735f tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] [instance: 5dbb0cb7-e2d8-416a-a486-72d4398ee877] Going to try to live migrate instance to n-h2-854823-8 {{(pid=128802) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 04 20:37:15.906666 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-9a532b85-ec05-4de7-85ce-879b3dd417ad tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3563efe2b8c94931a2a46c4e14811b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3118a5d96843d3bede1ed94bd9717e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:15.925810 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-9a532b85-ec05-4de7-85ce-879b3dd417ad tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] 10.222.0.33 "GET /compute/v2.1/servers/465ad440-a27e-4ff6-bb31-09f3545e166a" status: 200 len: 1543 microversion: 2.1 time: 0.358837 Oct 04 20:37:15.928489 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 476/949] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:37:15 2022] GET /compute/v2.1/servers/465ad440-a27e-4ff6-bb31-09f3545e166a => generated 1543 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:37:16.389162 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a144beed-1809-4011-8ef5-59819c34cd89 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:16.392586 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a144beed-1809-4011-8ef5-59819c34cd89 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] [instance: 9f8cc082-0a37-4123-a680-1210a90b3ca9] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:16.416068 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a144beed-1809-4011-8ef5-59819c34cd89 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:16.416760 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a144beed-1809-4011-8ef5-59819c34cd89 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:16.418721 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a144beed-1809-4011-8ef5-59819c34cd89 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:16.419605 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a144beed-1809-4011-8ef5-59819c34cd89 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:16.420094 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a144beed-1809-4011-8ef5-59819c34cd89 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:16.422750 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a144beed-1809-4011-8ef5-59819c34cd89 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:16.672379 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-a144beed-1809-4011-8ef5-59819c34cd89 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a24944aeb34a5ea228965be9bf4ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c288268acb30475bbc065a8f72cb21d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:16.711836 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a144beed-1809-4011-8ef5-59819c34cd89 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] 10.222.0.33 "GET /compute/v2.1/servers/9f8cc082-0a37-4123-a680-1210a90b3ca9" status: 200 len: 1472 microversion: 2.1 time: 0.329293 Oct 04 20:37:16.712959 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 477/950] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:37:16 2022] GET /compute/v2.1/servers/9f8cc082-0a37-4123-a680-1210a90b3ca9 => generated 1472 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:37:16.718227 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9a8d47ac-1b33-4e5d-ba41-2c90bd9682fc tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:16.719052 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-9a8d47ac-1b33-4e5d-ba41-2c90bd9682fc tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] [instance: 5e984459-625e-44cd-b226-091276567215] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:16.733006 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9a8d47ac-1b33-4e5d-ba41-2c90bd9682fc tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:16.735933 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9a8d47ac-1b33-4e5d-ba41-2c90bd9682fc tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:16.736603 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9a8d47ac-1b33-4e5d-ba41-2c90bd9682fc tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:16.739083 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9a8d47ac-1b33-4e5d-ba41-2c90bd9682fc tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:16.739780 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9a8d47ac-1b33-4e5d-ba41-2c90bd9682fc tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:16.742033 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9a8d47ac-1b33-4e5d-ba41-2c90bd9682fc tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:16.893116 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-9a8d47ac-1b33-4e5d-ba41-2c90bd9682fc tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22706a9bf4d42efb57c10cbd92c6eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0024f434015447759489d3cdc7bbaa4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:16.906424 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-9a8d47ac-1b33-4e5d-ba41-2c90bd9682fc tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a22706a9bf4d42efb57c10cbd92c6eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0024f434015447759489d3cdc7bbaa4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:16.912806 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-9a8d47ac-1b33-4e5d-ba41-2c90bd9682fc tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a22706a9bf4d42efb57c10cbd92c6eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0024f434015447759489d3cdc7bbaa4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:16.924292 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-9a8d47ac-1b33-4e5d-ba41-2c90bd9682fc tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] 10.222.0.33 "GET /compute/v2.1/servers/5e984459-625e-44cd-b226-091276567215" status: 200 len: 1438 microversion: 2.75 time: 0.209799 Oct 04 20:37:16.925342 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 478/951] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:37:16 2022] GET /compute/v2.1/servers/5e984459-625e-44cd-b226-091276567215 => generated 1438 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:37:16.959385 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-28bfd875-2d52-453c-98c9-824548dbc2cd tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:16.960199 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-28bfd875-2d52-453c-98c9-824548dbc2cd tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] [instance: 465ad440-a27e-4ff6-bb31-09f3545e166a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:16.970099 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-28bfd875-2d52-453c-98c9-824548dbc2cd tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:16.970813 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-28bfd875-2d52-453c-98c9-824548dbc2cd tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:16.972686 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-28bfd875-2d52-453c-98c9-824548dbc2cd tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:16.976388 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-28bfd875-2d52-453c-98c9-824548dbc2cd tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:16.976776 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-28bfd875-2d52-453c-98c9-824548dbc2cd tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:16.977212 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-28bfd875-2d52-453c-98c9-824548dbc2cd tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:17.300691 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-28bfd875-2d52-453c-98c9-824548dbc2cd tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3563efe2b8c94931a2a46c4e14811b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3118a5d96843d3bede1ed94bd9717e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:17.309354 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-28bfd875-2d52-453c-98c9-824548dbc2cd tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] 10.222.0.33 "GET /compute/v2.1/servers/465ad440-a27e-4ff6-bb31-09f3545e166a" status: 200 len: 1543 microversion: 2.1 time: 0.355176 Oct 04 20:37:17.312373 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 479/952] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:37:16 2022] GET /compute/v2.1/servers/465ad440-a27e-4ff6-bb31-09f3545e166a => generated 1543 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:37:17.319144 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-92cf7619-5254-4356-bb6c-2e1e9a66bdf1 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:37:17.322502 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-92cf7619-5254-4356-bb6c-2e1e9a66bdf1 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] [instance: 5e984459-625e-44cd-b226-091276567215] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:17.339310 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-92cf7619-5254-4356-bb6c-2e1e9a66bdf1 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:17.342264 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-92cf7619-5254-4356-bb6c-2e1e9a66bdf1 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:17.343786 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-92cf7619-5254-4356-bb6c-2e1e9a66bdf1 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:17.345386 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-92cf7619-5254-4356-bb6c-2e1e9a66bdf1 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:17.346210 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-92cf7619-5254-4356-bb6c-2e1e9a66bdf1 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:17.350463 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-92cf7619-5254-4356-bb6c-2e1e9a66bdf1 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:17.561575 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-92cf7619-5254-4356-bb6c-2e1e9a66bdf1 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Flavor limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:37:17.563925 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-92cf7619-5254-4356-bb6c-2e1e9a66bdf1 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Image limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:37:17.564430 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-92cf7619-5254-4356-bb6c-2e1e9a66bdf1 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Flavor pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:37:17.566651 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-92cf7619-5254-4356-bb6c-2e1e9a66bdf1 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Image pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:37:17.567091 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-92cf7619-5254-4356-bb6c-2e1e9a66bdf1 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:37:17.703147 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-92cf7619-5254-4356-bb6c-2e1e9a66bdf1 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] [instance: 5e984459-625e-44cd-b226-091276567215] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:17.717128 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-92cf7619-5254-4356-bb6c-2e1e9a66bdf1 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:17.719429 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-92cf7619-5254-4356-bb6c-2e1e9a66bdf1 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:17.721859 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-92cf7619-5254-4356-bb6c-2e1e9a66bdf1 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:17.724598 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-92cf7619-5254-4356-bb6c-2e1e9a66bdf1 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:17.727224 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-92cf7619-5254-4356-bb6c-2e1e9a66bdf1 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:17.728350 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-92cf7619-5254-4356-bb6c-2e1e9a66bdf1 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:18.005134 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-92cf7619-5254-4356-bb6c-2e1e9a66bdf1 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22706a9bf4d42efb57c10cbd92c6eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0024f434015447759489d3cdc7bbaa4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:18.017103 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-92cf7619-5254-4356-bb6c-2e1e9a66bdf1 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a22706a9bf4d42efb57c10cbd92c6eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0024f434015447759489d3cdc7bbaa4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:18.041570 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-92cf7619-5254-4356-bb6c-2e1e9a66bdf1 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a22706a9bf4d42efb57c10cbd92c6eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0024f434015447759489d3cdc7bbaa4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:18.048410 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-92cf7619-5254-4356-bb6c-2e1e9a66bdf1 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] 10.222.0.33 "POST /compute/v2.1/servers/5e984459-625e-44cd-b226-091276567215/action" status: 202 len: 1495 microversion: 2.75 time: 0.734669 Oct 04 20:37:18.049320 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 480/953] 10.222.0.33 () {62 vars in 1319 bytes} [Tue Oct 4 20:37:17 2022] POST /compute/v2.1/servers/5e984459-625e-44cd-b226-091276567215/action => generated 1495 bytes in 736 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 04 20:37:18.057172 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-46d72414-4397-4e4a-988c-179932cda4be tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:18.057813 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-46d72414-4397-4e4a-988c-179932cda4be tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] [instance: 9f8cc082-0a37-4123-a680-1210a90b3ca9] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:18.064353 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-46d72414-4397-4e4a-988c-179932cda4be tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:18.065954 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-46d72414-4397-4e4a-988c-179932cda4be tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:18.067319 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-46d72414-4397-4e4a-988c-179932cda4be tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:18.068899 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-46d72414-4397-4e4a-988c-179932cda4be tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:18.072807 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-46d72414-4397-4e4a-988c-179932cda4be tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:18.073261 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-46d72414-4397-4e4a-988c-179932cda4be tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:18.502905 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-46d72414-4397-4e4a-988c-179932cda4be tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a24944aeb34a5ea228965be9bf4ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c288268acb30475bbc065a8f72cb21d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:18.516335 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-46d72414-4397-4e4a-988c-179932cda4be tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] 10.222.0.33 "GET /compute/v2.1/servers/9f8cc082-0a37-4123-a680-1210a90b3ca9" status: 200 len: 1472 microversion: 2.1 time: 0.464240 Oct 04 20:37:18.517055 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 481/954] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:37:18 2022] GET /compute/v2.1/servers/9f8cc082-0a37-4123-a680-1210a90b3ca9 => generated 1472 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:37:18.528103 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-3296db25-8fa0-4aae-b4ad-4a5bc89947ab tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:18.528724 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-3296db25-8fa0-4aae-b4ad-4a5bc89947ab tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] [instance: 5e984459-625e-44cd-b226-091276567215] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:18.560277 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3296db25-8fa0-4aae-b4ad-4a5bc89947ab tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:18.560769 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3296db25-8fa0-4aae-b4ad-4a5bc89947ab tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:18.561210 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3296db25-8fa0-4aae-b4ad-4a5bc89947ab tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:18.561905 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3296db25-8fa0-4aae-b4ad-4a5bc89947ab tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:18.562375 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3296db25-8fa0-4aae-b4ad-4a5bc89947ab tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:18.562808 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3296db25-8fa0-4aae-b4ad-4a5bc89947ab tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:18.630747 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:37:18.659917 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-b0e894be-4c66-43dd-afee-d846690f735f tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/5dbb0cb7-e2d8-416a-a486-72d4398ee877/action" status: 202 len: 0 microversion: 2.25 time: 2.973372 Oct 04 20:37:18.662613 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 474/955] 10.222.0.33 () {62 vars in 1319 bytes} [Tue Oct 4 20:37:15 2022] POST /compute/v2.1/servers/5dbb0cb7-e2d8-416a-a486-72d4398ee877/action => generated 0 bytes in 2977 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 04 20:37:18.671123 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-36b0f6d6-121e-4a76-a10f-20e4bdc00f7a tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:18.673466 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-36b0f6d6-121e-4a76-a10f-20e4bdc00f7a tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] [instance: 465ad440-a27e-4ff6-bb31-09f3545e166a] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:18.689335 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-36b0f6d6-121e-4a76-a10f-20e4bdc00f7a tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:18.692384 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-36b0f6d6-121e-4a76-a10f-20e4bdc00f7a tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:18.695175 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-36b0f6d6-121e-4a76-a10f-20e4bdc00f7a tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:18.698225 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-36b0f6d6-121e-4a76-a10f-20e4bdc00f7a tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:18.699650 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-36b0f6d6-121e-4a76-a10f-20e4bdc00f7a tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:18.701909 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-36b0f6d6-121e-4a76-a10f-20e4bdc00f7a tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:19.180944 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-3296db25-8fa0-4aae-b4ad-4a5bc89947ab tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22706a9bf4d42efb57c10cbd92c6eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0024f434015447759489d3cdc7bbaa4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:19.191289 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-3296db25-8fa0-4aae-b4ad-4a5bc89947ab tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a22706a9bf4d42efb57c10cbd92c6eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0024f434015447759489d3cdc7bbaa4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:19.200088 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-3296db25-8fa0-4aae-b4ad-4a5bc89947ab tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a22706a9bf4d42efb57c10cbd92c6eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0024f434015447759489d3cdc7bbaa4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:19.214972 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-3296db25-8fa0-4aae-b4ad-4a5bc89947ab tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] 10.222.0.33 "GET /compute/v2.1/servers/5e984459-625e-44cd-b226-091276567215" status: 200 len: 1447 microversion: 2.75 time: 0.694913 Oct 04 20:37:19.217381 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 482/956] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:37:18 2022] GET /compute/v2.1/servers/5e984459-625e-44cd-b226-091276567215 => generated 1447 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:37:19.231926 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-4b86212c-4420-40e9-9e9e-967091edbe63 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:19.232609 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-4b86212c-4420-40e9-9e9e-967091edbe63 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] [instance: 5dbb0cb7-e2d8-416a-a486-72d4398ee877] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:19.245417 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4b86212c-4420-40e9-9e9e-967091edbe63 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:19.245988 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4b86212c-4420-40e9-9e9e-967091edbe63 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:19.246495 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4b86212c-4420-40e9-9e9e-967091edbe63 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:19.247424 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4b86212c-4420-40e9-9e9e-967091edbe63 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:19.248055 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4b86212c-4420-40e9-9e9e-967091edbe63 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:19.248489 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4b86212c-4420-40e9-9e9e-967091edbe63 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:19.572043 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-36b0f6d6-121e-4a76-a10f-20e4bdc00f7a tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3563efe2b8c94931a2a46c4e14811b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3118a5d96843d3bede1ed94bd9717e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:19.586667 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-36b0f6d6-121e-4a76-a10f-20e4bdc00f7a tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] 10.222.0.33 "GET /compute/v2.1/servers/465ad440-a27e-4ff6-bb31-09f3545e166a" status: 200 len: 1543 microversion: 2.1 time: 0.921492 Oct 04 20:37:19.587797 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 475/957] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:37:18 2022] GET /compute/v2.1/servers/465ad440-a27e-4ff6-bb31-09f3545e166a => generated 1543 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:37:19.605081 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-5f7765db-a514-4b43-b89e-9dbc76522b78 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:19.605820 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-5f7765db-a514-4b43-b89e-9dbc76522b78 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] [instance: 9f8cc082-0a37-4123-a680-1210a90b3ca9] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:19.616762 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5f7765db-a514-4b43-b89e-9dbc76522b78 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:19.617303 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5f7765db-a514-4b43-b89e-9dbc76522b78 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:19.617743 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5f7765db-a514-4b43-b89e-9dbc76522b78 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:19.618634 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5f7765db-a514-4b43-b89e-9dbc76522b78 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:19.619087 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5f7765db-a514-4b43-b89e-9dbc76522b78 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:19.619500 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5f7765db-a514-4b43-b89e-9dbc76522b78 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:19.698126 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-4b86212c-4420-40e9-9e9e-967091edbe63 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:19.726978 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-4b86212c-4420-40e9-9e9e-967091edbe63 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:19.729549 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-4b86212c-4420-40e9-9e9e-967091edbe63 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:19.730939 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-4b86212c-4420-40e9-9e9e-967091edbe63 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] 10.222.0.33 "GET /compute/v2.1/servers/5dbb0cb7-e2d8-416a-a486-72d4398ee877" status: 200 len: 1567 microversion: 2.25 time: 0.512542 Oct 04 20:37:19.731666 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 483/958] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:37:19 2022] GET /compute/v2.1/servers/5dbb0cb7-e2d8-416a-a486-72d4398ee877 => generated 1567 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:37:20.031367 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-5f7765db-a514-4b43-b89e-9dbc76522b78 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a24944aeb34a5ea228965be9bf4ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c288268acb30475bbc065a8f72cb21d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:20.056681 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-5f7765db-a514-4b43-b89e-9dbc76522b78 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] 10.222.0.33 "GET /compute/v2.1/servers/9f8cc082-0a37-4123-a680-1210a90b3ca9" status: 200 len: 1472 microversion: 2.1 time: 0.459019 Oct 04 20:37:20.057899 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 476/959] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:37:19 2022] GET /compute/v2.1/servers/9f8cc082-0a37-4123-a680-1210a90b3ca9 => generated 1472 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:37:20.245587 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7424e4e7-4e00-4f44-a403-916f8ef3e743 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:20.246877 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-7424e4e7-4e00-4f44-a403-916f8ef3e743 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] [instance: 5e984459-625e-44cd-b226-091276567215] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:20.253469 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7424e4e7-4e00-4f44-a403-916f8ef3e743 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:20.254190 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7424e4e7-4e00-4f44-a403-916f8ef3e743 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:20.255859 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7424e4e7-4e00-4f44-a403-916f8ef3e743 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:20.256737 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7424e4e7-4e00-4f44-a403-916f8ef3e743 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:20.257343 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7424e4e7-4e00-4f44-a403-916f8ef3e743 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:20.257920 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7424e4e7-4e00-4f44-a403-916f8ef3e743 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:20.450043 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-7424e4e7-4e00-4f44-a403-916f8ef3e743 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22706a9bf4d42efb57c10cbd92c6eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0024f434015447759489d3cdc7bbaa4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:20.473533 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-7424e4e7-4e00-4f44-a403-916f8ef3e743 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a22706a9bf4d42efb57c10cbd92c6eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0024f434015447759489d3cdc7bbaa4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:20.475829 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-7424e4e7-4e00-4f44-a403-916f8ef3e743 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a22706a9bf4d42efb57c10cbd92c6eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0024f434015447759489d3cdc7bbaa4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:20.483385 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-7424e4e7-4e00-4f44-a403-916f8ef3e743 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] 10.222.0.33 "GET /compute/v2.1/servers/5e984459-625e-44cd-b226-091276567215" status: 200 len: 1447 microversion: 2.75 time: 0.240972 Oct 04 20:37:20.484306 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 484/960] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:37:20 2022] GET /compute/v2.1/servers/5e984459-625e-44cd-b226-091276567215 => generated 1447 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 20:37:20.613246 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-f526268b-0fa6-4d2f-983c-585a52455ce9 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:20.614112 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-f526268b-0fa6-4d2f-983c-585a52455ce9 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] [instance: 465ad440-a27e-4ff6-bb31-09f3545e166a] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:20.626243 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f526268b-0fa6-4d2f-983c-585a52455ce9 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:20.628688 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f526268b-0fa6-4d2f-983c-585a52455ce9 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:20.629147 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f526268b-0fa6-4d2f-983c-585a52455ce9 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:20.629968 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f526268b-0fa6-4d2f-983c-585a52455ce9 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:20.633702 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f526268b-0fa6-4d2f-983c-585a52455ce9 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:20.634220 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f526268b-0fa6-4d2f-983c-585a52455ce9 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:20.759848 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-38680bff-bc87-4284-97d8-3441cbc0a053 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:20.760991 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-38680bff-bc87-4284-97d8-3441cbc0a053 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] [instance: 5dbb0cb7-e2d8-416a-a486-72d4398ee877] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:20.769157 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-38680bff-bc87-4284-97d8-3441cbc0a053 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:20.772071 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-38680bff-bc87-4284-97d8-3441cbc0a053 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:20.772805 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-38680bff-bc87-4284-97d8-3441cbc0a053 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:20.774286 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-38680bff-bc87-4284-97d8-3441cbc0a053 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:20.777429 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-38680bff-bc87-4284-97d8-3441cbc0a053 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:20.779369 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-38680bff-bc87-4284-97d8-3441cbc0a053 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:21.089764 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-f526268b-0fa6-4d2f-983c-585a52455ce9 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3563efe2b8c94931a2a46c4e14811b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3118a5d96843d3bede1ed94bd9717e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:21.116652 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-f526268b-0fa6-4d2f-983c-585a52455ce9 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] 10.222.0.33 "GET /compute/v2.1/servers/465ad440-a27e-4ff6-bb31-09f3545e166a" status: 200 len: 1543 microversion: 2.1 time: 0.504388 Oct 04 20:37:21.130610 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 477/961] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:37:20 2022] GET /compute/v2.1/servers/465ad440-a27e-4ff6-bb31-09f3545e166a => generated 1543 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:37:21.134599 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-520a1c81-2ec7-4623-8f8a-3e2229095f61 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:21.136060 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-520a1c81-2ec7-4623-8f8a-3e2229095f61 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] [instance: 9f8cc082-0a37-4123-a680-1210a90b3ca9] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:21.152076 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-520a1c81-2ec7-4623-8f8a-3e2229095f61 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:21.152582 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-520a1c81-2ec7-4623-8f8a-3e2229095f61 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:21.153213 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-520a1c81-2ec7-4623-8f8a-3e2229095f61 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:21.154052 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-520a1c81-2ec7-4623-8f8a-3e2229095f61 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:21.155103 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-520a1c81-2ec7-4623-8f8a-3e2229095f61 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:21.155608 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-520a1c81-2ec7-4623-8f8a-3e2229095f61 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:21.195075 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-38680bff-bc87-4284-97d8-3441cbc0a053 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:21.213221 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-38680bff-bc87-4284-97d8-3441cbc0a053 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:21.220715 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-38680bff-bc87-4284-97d8-3441cbc0a053 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:21.226630 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-38680bff-bc87-4284-97d8-3441cbc0a053 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] 10.222.0.33 "GET /compute/v2.1/servers/5dbb0cb7-e2d8-416a-a486-72d4398ee877" status: 200 len: 1567 microversion: 2.25 time: 0.472008 Oct 04 20:37:21.239277 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 485/962] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:37:20 2022] GET /compute/v2.1/servers/5dbb0cb7-e2d8-416a-a486-72d4398ee877 => generated 1567 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 20:37:21.512940 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5ac9d60f-e0ee-4c0c-b084-6b4f2e21baa0 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:21.513576 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-5ac9d60f-e0ee-4c0c-b084-6b4f2e21baa0 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] [instance: 5e984459-625e-44cd-b226-091276567215] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:21.515515 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:37:21.516199 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=18 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:37:21.521932 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-520a1c81-2ec7-4623-8f8a-3e2229095f61 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a24944aeb34a5ea228965be9bf4ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c288268acb30475bbc065a8f72cb21d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:21.537881 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-520a1c81-2ec7-4623-8f8a-3e2229095f61 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] 10.222.0.33 "GET /compute/v2.1/servers/9f8cc082-0a37-4123-a680-1210a90b3ca9" status: 200 len: 1472 microversion: 2.1 time: 0.415608 Oct 04 20:37:21.538914 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 478/963] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:37:21 2022] GET /compute/v2.1/servers/9f8cc082-0a37-4123-a680-1210a90b3ca9 => generated 1472 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:37:21.541512 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5ac9d60f-e0ee-4c0c-b084-6b4f2e21baa0 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:21.542586 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5ac9d60f-e0ee-4c0c-b084-6b4f2e21baa0 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:21.543356 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5ac9d60f-e0ee-4c0c-b084-6b4f2e21baa0 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:21.549935 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5ac9d60f-e0ee-4c0c-b084-6b4f2e21baa0 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:21.551100 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5ac9d60f-e0ee-4c0c-b084-6b4f2e21baa0 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:21.551898 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5ac9d60f-e0ee-4c0c-b084-6b4f2e21baa0 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:21.792558 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-5ac9d60f-e0ee-4c0c-b084-6b4f2e21baa0 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22706a9bf4d42efb57c10cbd92c6eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0024f434015447759489d3cdc7bbaa4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:21.803604 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-5ac9d60f-e0ee-4c0c-b084-6b4f2e21baa0 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a22706a9bf4d42efb57c10cbd92c6eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0024f434015447759489d3cdc7bbaa4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:21.805247 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-5ac9d60f-e0ee-4c0c-b084-6b4f2e21baa0 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a22706a9bf4d42efb57c10cbd92c6eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0024f434015447759489d3cdc7bbaa4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:21.814363 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-cf9b254e-b137-402b-863a-850a7f96a723 req-a91817f2-cd29-435a-8fd1-3b21a2e2df53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5dbb0cb7-e2d8-416a-a486-72d4398ee877", "name": "network-vif-unplugged", "status": "completed", "tag": "cf080088-b0ac-4a20-83d3-5d85ca5cdb45"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:37:21.819354 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5ac9d60f-e0ee-4c0c-b084-6b4f2e21baa0 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] 10.222.0.33 "GET /compute/v2.1/servers/5e984459-625e-44cd-b226-091276567215" status: 200 len: 1447 microversion: 2.75 time: 0.307855 Oct 04 20:37:21.822012 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 486/964] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:37:21 2022] GET /compute/v2.1/servers/5e984459-625e-44cd-b226-091276567215 => generated 1447 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:37:21.854933 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-cf9b254e-b137-402b-863a-850a7f96a723 req-a91817f2-cd29-435a-8fd1-3b21a2e2df53 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:21.855807 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-cf9b254e-b137-402b-863a-850a7f96a723 req-a91817f2-cd29-435a-8fd1-3b21a2e2df53 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:21.856311 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-cf9b254e-b137-402b-863a-850a7f96a723 req-a91817f2-cd29-435a-8fd1-3b21a2e2df53 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:21.878754 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-cf9b254e-b137-402b-863a-850a7f96a723 req-a91817f2-cd29-435a-8fd1-3b21a2e2df53 service nova] Creating event network-vif-unplugged:cf080088-b0ac-4a20-83d3-5d85ca5cdb45 for instance 5dbb0cb7-e2d8-416a-a486-72d4398ee877 on n-h1-854823-8 Oct 04 20:37:21.886450 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-cf9b254e-b137-402b-863a-850a7f96a723 req-a91817f2-cd29-435a-8fd1-3b21a2e2df53 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.077101 Oct 04 20:37:21.891414 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 479/965] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:37:21 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 20:37:22.150967 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-05138bc3-3603-4b0c-b4d2-30bc671501e7 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:22.151583 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-05138bc3-3603-4b0c-b4d2-30bc671501e7 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] [instance: 465ad440-a27e-4ff6-bb31-09f3545e166a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:22.170289 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-05138bc3-3603-4b0c-b4d2-30bc671501e7 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:22.170814 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-05138bc3-3603-4b0c-b4d2-30bc671501e7 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:22.171996 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-05138bc3-3603-4b0c-b4d2-30bc671501e7 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:22.172875 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-05138bc3-3603-4b0c-b4d2-30bc671501e7 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:22.173508 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-05138bc3-3603-4b0c-b4d2-30bc671501e7 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:22.174087 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-05138bc3-3603-4b0c-b4d2-30bc671501e7 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:22.258319 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-47111c10-7032-4397-b5f3-fac967224633 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:22.259649 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-47111c10-7032-4397-b5f3-fac967224633 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] [instance: 5dbb0cb7-e2d8-416a-a486-72d4398ee877] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:22.273238 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-47111c10-7032-4397-b5f3-fac967224633 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:22.275582 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-47111c10-7032-4397-b5f3-fac967224633 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:22.276207 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-47111c10-7032-4397-b5f3-fac967224633 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:22.280834 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-47111c10-7032-4397-b5f3-fac967224633 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:22.281600 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-47111c10-7032-4397-b5f3-fac967224633 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:22.282218 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-47111c10-7032-4397-b5f3-fac967224633 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:22.380527 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell0:SELECT=10 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:37:22.711654 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-05138bc3-3603-4b0c-b4d2-30bc671501e7 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3563efe2b8c94931a2a46c4e14811b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3118a5d96843d3bede1ed94bd9717e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:22.747000 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-05138bc3-3603-4b0c-b4d2-30bc671501e7 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] 10.222.0.33 "GET /compute/v2.1/servers/465ad440-a27e-4ff6-bb31-09f3545e166a" status: 200 len: 1543 microversion: 2.1 time: 0.597318 Oct 04 20:37:22.749218 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 487/966] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:37:22 2022] GET /compute/v2.1/servers/465ad440-a27e-4ff6-bb31-09f3545e166a => generated 1543 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:37:22.776651 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f6ea5c6c-9f1c-41ed-a81c-c487a5634296 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:22.780677 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f6ea5c6c-9f1c-41ed-a81c-c487a5634296 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] [instance: 9f8cc082-0a37-4123-a680-1210a90b3ca9] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:22.788857 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f6ea5c6c-9f1c-41ed-a81c-c487a5634296 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:22.789640 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f6ea5c6c-9f1c-41ed-a81c-c487a5634296 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:22.790840 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f6ea5c6c-9f1c-41ed-a81c-c487a5634296 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:22.791868 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f6ea5c6c-9f1c-41ed-a81c-c487a5634296 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:22.792499 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f6ea5c6c-9f1c-41ed-a81c-c487a5634296 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:22.793250 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f6ea5c6c-9f1c-41ed-a81c-c487a5634296 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:22.854374 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-47111c10-7032-4397-b5f3-fac967224633 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:22.880628 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-47111c10-7032-4397-b5f3-fac967224633 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:22.882731 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-47111c10-7032-4397-b5f3-fac967224633 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:22.896578 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-47111c10-7032-4397-b5f3-fac967224633 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] 10.222.0.33 "GET /compute/v2.1/servers/5dbb0cb7-e2d8-416a-a486-72d4398ee877" status: 200 len: 1567 microversion: 2.25 time: 0.632036 Oct 04 20:37:22.897509 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 480/967] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:37:22 2022] GET /compute/v2.1/servers/5dbb0cb7-e2d8-416a-a486-72d4398ee877 => generated 1567 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:37:22.915741 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-f5f2fde7-df37-497e-8e2d-dc8a078187bd tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:22.916601 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-f5f2fde7-df37-497e-8e2d-dc8a078187bd tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] [instance: 5e984459-625e-44cd-b226-091276567215] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:22.929969 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f5f2fde7-df37-497e-8e2d-dc8a078187bd tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:22.932403 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f5f2fde7-df37-497e-8e2d-dc8a078187bd tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:22.933021 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f5f2fde7-df37-497e-8e2d-dc8a078187bd tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:22.934912 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f5f2fde7-df37-497e-8e2d-dc8a078187bd tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:22.935561 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f5f2fde7-df37-497e-8e2d-dc8a078187bd tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:22.936163 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f5f2fde7-df37-497e-8e2d-dc8a078187bd tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:23.707555 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-f5f2fde7-df37-497e-8e2d-dc8a078187bd tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22706a9bf4d42efb57c10cbd92c6eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0024f434015447759489d3cdc7bbaa4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:23.717564 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-f5f2fde7-df37-497e-8e2d-dc8a078187bd tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a22706a9bf4d42efb57c10cbd92c6eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0024f434015447759489d3cdc7bbaa4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:23.719056 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-f5f2fde7-df37-497e-8e2d-dc8a078187bd tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a22706a9bf4d42efb57c10cbd92c6eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0024f434015447759489d3cdc7bbaa4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:23.744588 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-f5f2fde7-df37-497e-8e2d-dc8a078187bd tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] 10.222.0.33 "GET /compute/v2.1/servers/5e984459-625e-44cd-b226-091276567215" status: 200 len: 1447 microversion: 2.75 time: 0.845421 Oct 04 20:37:23.764200 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 481/968] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:37:22 2022] GET /compute/v2.1/servers/5e984459-625e-44cd-b226-091276567215 => generated 1447 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:37:23.827217 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f6ea5c6c-9f1c-41ed-a81c-c487a5634296 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a24944aeb34a5ea228965be9bf4ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c288268acb30475bbc065a8f72cb21d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:23.837884 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f6ea5c6c-9f1c-41ed-a81c-c487a5634296 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] 10.222.0.33 "GET /compute/v2.1/servers/9f8cc082-0a37-4123-a680-1210a90b3ca9" status: 200 len: 1472 microversion: 2.1 time: 1.070077 Oct 04 20:37:23.845023 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 488/969] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:37:22 2022] GET /compute/v2.1/servers/9f8cc082-0a37-4123-a680-1210a90b3ca9 => generated 1472 bytes in 1095 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:37:23.850752 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d23854c9-e59d-494d-8b2b-b6743fc628ff tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:23.852230 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d23854c9-e59d-494d-8b2b-b6743fc628ff tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] [instance: 465ad440-a27e-4ff6-bb31-09f3545e166a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:23.866232 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d23854c9-e59d-494d-8b2b-b6743fc628ff tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:23.869225 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d23854c9-e59d-494d-8b2b-b6743fc628ff tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:23.871273 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d23854c9-e59d-494d-8b2b-b6743fc628ff tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:23.873589 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d23854c9-e59d-494d-8b2b-b6743fc628ff tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:23.875765 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d23854c9-e59d-494d-8b2b-b6743fc628ff tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:23.877339 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d23854c9-e59d-494d-8b2b-b6743fc628ff tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:24.072404 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-5b2a16d0-f0c0-4102-8080-6d0de418c475 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-603373118", "imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63", "flavorRef": "452", "networks": [{"uuid": "eff6509b-9044-4f53-ac84-39573f9dabae"}]}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:37:24.155161 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d23854c9-e59d-494d-8b2b-b6743fc628ff tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3563efe2b8c94931a2a46c4e14811b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3118a5d96843d3bede1ed94bd9717e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:24.176083 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d23854c9-e59d-494d-8b2b-b6743fc628ff tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] 10.222.0.33 "GET /compute/v2.1/servers/465ad440-a27e-4ff6-bb31-09f3545e166a" status: 200 len: 1543 microversion: 2.1 time: 0.329770 Oct 04 20:37:24.177462 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 489/970] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:37:23 2022] GET /compute/v2.1/servers/465ad440-a27e-4ff6-bb31-09f3545e166a => generated 1543 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:37:24.178554 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.network.neutron [None req-5b2a16d0-f0c0-4102-8080-6d0de418c475 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] validate_networks() for [('eff6509b-9044-4f53-ac84-39573f9dabae', None, None, None, None, None)] {{(pid=128802) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:37:24.182816 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-14e066ae-e411-4cb9-8897-b93a54e32ccb req-8396ace1-2b7b-4084-87b0-c650402a5c09 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5dbb0cb7-e2d8-416a-a486-72d4398ee877", "tag": "cf080088-b0ac-4a20-83d3-5d85ca5cdb45"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:37:24.215812 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-14e066ae-e411-4cb9-8897-b93a54e32ccb req-8396ace1-2b7b-4084-87b0-c650402a5c09 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:24.216289 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-14e066ae-e411-4cb9-8897-b93a54e32ccb req-8396ace1-2b7b-4084-87b0-c650402a5c09 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:24.216721 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-14e066ae-e411-4cb9-8897-b93a54e32ccb req-8396ace1-2b7b-4084-87b0-c650402a5c09 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:24.232731 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-14e066ae-e411-4cb9-8897-b93a54e32ccb req-8396ace1-2b7b-4084-87b0-c650402a5c09 service nova] Creating event network-changed:cf080088-b0ac-4a20-83d3-5d85ca5cdb45 for instance 5dbb0cb7-e2d8-416a-a486-72d4398ee877 on n-h1-854823-8 Oct 04 20:37:24.249212 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-14e066ae-e411-4cb9-8897-b93a54e32ccb req-8396ace1-2b7b-4084-87b0-c650402a5c09 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070347 Oct 04 20:37:24.252139 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 490/971] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:37:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:37:24.264566 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2fbba393-89b9-4fe3-b145-0c888cb1ea23 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:24.266004 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-2fbba393-89b9-4fe3-b145-0c888cb1ea23 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] [instance: 5dbb0cb7-e2d8-416a-a486-72d4398ee877] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:24.285989 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2fbba393-89b9-4fe3-b145-0c888cb1ea23 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:24.287345 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2fbba393-89b9-4fe3-b145-0c888cb1ea23 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:24.287966 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2fbba393-89b9-4fe3-b145-0c888cb1ea23 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:24.289063 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2fbba393-89b9-4fe3-b145-0c888cb1ea23 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:24.289692 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2fbba393-89b9-4fe3-b145-0c888cb1ea23 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:24.290270 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2fbba393-89b9-4fe3-b145-0c888cb1ea23 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:24.644790 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-2fbba393-89b9-4fe3-b145-0c888cb1ea23 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:24.655441 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-2fbba393-89b9-4fe3-b145-0c888cb1ea23 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:24.660123 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-2fbba393-89b9-4fe3-b145-0c888cb1ea23 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:24.662200 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-2fbba393-89b9-4fe3-b145-0c888cb1ea23 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] 10.222.0.33 "GET /compute/v2.1/servers/5dbb0cb7-e2d8-416a-a486-72d4398ee877" status: 200 len: 1567 microversion: 2.25 time: 0.408043 Oct 04 20:37:24.663083 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 491/972] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:37:24 2022] GET /compute/v2.1/servers/5dbb0cb7-e2d8-416a-a486-72d4398ee877 => generated 1567 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:37:24.777895 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-68a5cdb3-68e1-45db-bc31-c3204dc695b7 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:24.792156 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-68a5cdb3-68e1-45db-bc31-c3204dc695b7 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] [instance: 5e984459-625e-44cd-b226-091276567215] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:24.823839 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-68a5cdb3-68e1-45db-bc31-c3204dc695b7 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:24.824629 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-68a5cdb3-68e1-45db-bc31-c3204dc695b7 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:24.825223 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-68a5cdb3-68e1-45db-bc31-c3204dc695b7 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:24.826333 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-68a5cdb3-68e1-45db-bc31-c3204dc695b7 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:24.827033 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-68a5cdb3-68e1-45db-bc31-c3204dc695b7 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:24.827614 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-68a5cdb3-68e1-45db-bc31-c3204dc695b7 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:24.967268 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-5b2a16d0-f0c0-4102-8080-6d0de418c475 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Flavor limits 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:37:24.968260 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-5b2a16d0-f0c0-4102-8080-6d0de418c475 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Image limits 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:37:24.968914 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-5b2a16d0-f0c0-4102-8080-6d0de418c475 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Flavor pref 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:37:24.969889 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-5b2a16d0-f0c0-4102-8080-6d0de418c475 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Image pref 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:37:24.970602 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-5b2a16d0-f0c0-4102-8080-6d0de418c475 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:37:24.979277 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_api:SELECT=99,nova_api:DELETE=1 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:37:24.989854 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5b2a16d0-f0c0-4102-8080-6d0de418c475 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:24.990624 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5b2a16d0-f0c0-4102-8080-6d0de418c475 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:24.991061 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5b2a16d0-f0c0-4102-8080-6d0de418c475 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:24.991951 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5b2a16d0-f0c0-4102-8080-6d0de418c475 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:24.992602 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5b2a16d0-f0c0-4102-8080-6d0de418c475 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:24.993037 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5b2a16d0-f0c0-4102-8080-6d0de418c475 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:25.007530 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-68a5cdb3-68e1-45db-bc31-c3204dc695b7 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22706a9bf4d42efb57c10cbd92c6eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0024f434015447759489d3cdc7bbaa4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:25.037561 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-68a5cdb3-68e1-45db-bc31-c3204dc695b7 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a22706a9bf4d42efb57c10cbd92c6eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0024f434015447759489d3cdc7bbaa4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:25.039691 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-68a5cdb3-68e1-45db-bc31-c3204dc695b7 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a22706a9bf4d42efb57c10cbd92c6eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0024f434015447759489d3cdc7bbaa4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:25.059248 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-68a5cdb3-68e1-45db-bc31-c3204dc695b7 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] 10.222.0.33 "GET /compute/v2.1/servers/5e984459-625e-44cd-b226-091276567215" status: 200 len: 1447 microversion: 2.75 time: 0.280070 Oct 04 20:37:25.074372 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 492/973] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:37:24 2022] GET /compute/v2.1/servers/5e984459-625e-44cd-b226-091276567215 => generated 1447 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:37:25.074625 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-5b2a16d0-f0c0-4102-8080-6d0de418c475 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Getting quotas for project d66ec8ea91b04deb90b679589e0495bb. Resources: {'ram', 'instances', 'cores'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:37:25.074742 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e7cd3808-11f4-409e-88a8-8faec2c83d48 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:25.074742 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e7cd3808-11f4-409e-88a8-8faec2c83d48 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] [instance: 9f8cc082-0a37-4123-a680-1210a90b3ca9] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:25.077087 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-5b2a16d0-f0c0-4102-8080-6d0de418c475 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Getting quotas for user 800db3a57ada47eca381b00189fdbf0a and project d66ec8ea91b04deb90b679589e0495bb. Resources: {'ram', 'instances', 'cores'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:37:25.086056 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e7cd3808-11f4-409e-88a8-8faec2c83d48 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:25.092968 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e7cd3808-11f4-409e-88a8-8faec2c83d48 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:25.093423 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e7cd3808-11f4-409e-88a8-8faec2c83d48 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:25.094576 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e7cd3808-11f4-409e-88a8-8faec2c83d48 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:25.095256 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e7cd3808-11f4-409e-88a8-8faec2c83d48 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:25.096108 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e7cd3808-11f4-409e-88a8-8faec2c83d48 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:25.107241 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-5b2a16d0-f0c0-4102-8080-6d0de418c475 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Going to run 1 instances... {{(pid=128802) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:37:25.111179 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-5b2a16d0-f0c0-4102-8080-6d0de418c475 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] [instance: 62b98bc7-657a-42c2-b501-ae4d926cfa2f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='15b24725-0c99-4bcf-b1fb-907cdf8e2d63',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128802) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:37:25.212626 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-5b2a16d0-f0c0-4102-8080-6d0de418c475 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.446886 Oct 04 20:37:25.214558 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 482/974] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 20:37:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 1450 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 20:37:25.226453 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-27b74e5a-5ec8-41a8-a5b9-af0dc95316f1 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:25.227604 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-27b74e5a-5ec8-41a8-a5b9-af0dc95316f1 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] [instance: 465ad440-a27e-4ff6-bb31-09f3545e166a] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:25.236093 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-27b74e5a-5ec8-41a8-a5b9-af0dc95316f1 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:25.237072 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-27b74e5a-5ec8-41a8-a5b9-af0dc95316f1 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:25.253252 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-27b74e5a-5ec8-41a8-a5b9-af0dc95316f1 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:25.256930 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-27b74e5a-5ec8-41a8-a5b9-af0dc95316f1 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:25.258438 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-27b74e5a-5ec8-41a8-a5b9-af0dc95316f1 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:25.260857 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-27b74e5a-5ec8-41a8-a5b9-af0dc95316f1 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:25.451357 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e7cd3808-11f4-409e-88a8-8faec2c83d48 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a24944aeb34a5ea228965be9bf4ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c288268acb30475bbc065a8f72cb21d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:25.460761 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e7cd3808-11f4-409e-88a8-8faec2c83d48 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] 10.222.0.33 "GET /compute/v2.1/servers/9f8cc082-0a37-4123-a680-1210a90b3ca9" status: 200 len: 1472 microversion: 2.1 time: 0.398263 Oct 04 20:37:25.466332 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 493/975] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:37:25 2022] GET /compute/v2.1/servers/9f8cc082-0a37-4123-a680-1210a90b3ca9 => generated 1472 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:37:25.478458 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-cc213737-9bee-4135-8c55-21dfba677c21 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:25.481234 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-cc213737-9bee-4135-8c55-21dfba677c21 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] [instance: 62b98bc7-657a-42c2-b501-ae4d926cfa2f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:25.563964 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-27b74e5a-5ec8-41a8-a5b9-af0dc95316f1 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3563efe2b8c94931a2a46c4e14811b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3118a5d96843d3bede1ed94bd9717e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:25.575314 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-27b74e5a-5ec8-41a8-a5b9-af0dc95316f1 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] 10.222.0.33 "GET /compute/v2.1/servers/465ad440-a27e-4ff6-bb31-09f3545e166a" status: 200 len: 1543 microversion: 2.1 time: 0.359357 Oct 04 20:37:25.581716 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 483/976] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:37:25 2022] GET /compute/v2.1/servers/465ad440-a27e-4ff6-bb31-09f3545e166a => generated 1543 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:37:25.622129 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-cc213737-9bee-4135-8c55-21dfba677c21 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '800db3a57ada47eca381b00189fdbf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66ec8ea91b04deb90b679589e0495bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:25.636903 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-cc213737-9bee-4135-8c55-21dfba677c21 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] 10.222.0.33 "GET /compute/v2.1/servers/62b98bc7-657a-42c2-b501-ae4d926cfa2f" status: 200 len: 1210 microversion: 2.1 time: 0.169150 Oct 04 20:37:25.637708 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 494/977] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:37:25 2022] GET /compute/v2.1/servers/62b98bc7-657a-42c2-b501-ae4d926cfa2f => generated 1210 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:37:25.692699 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-160cabaa-3055-4e1f-bd33-f94f15ab6fda tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:25.693687 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-160cabaa-3055-4e1f-bd33-f94f15ab6fda tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] [instance: 5dbb0cb7-e2d8-416a-a486-72d4398ee877] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:25.707479 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-160cabaa-3055-4e1f-bd33-f94f15ab6fda tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:25.708875 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-160cabaa-3055-4e1f-bd33-f94f15ab6fda tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:25.709986 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-160cabaa-3055-4e1f-bd33-f94f15ab6fda tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:25.711843 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-160cabaa-3055-4e1f-bd33-f94f15ab6fda tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:25.715545 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-160cabaa-3055-4e1f-bd33-f94f15ab6fda tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:25.716196 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-160cabaa-3055-4e1f-bd33-f94f15ab6fda tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:25.833226 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-47d73360-97e3-422e-9551-93d2ddb538df tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Action: 'create', calling method: .version_select at 0x7f3c746be700>, body: {"keypair": {"name": "tempest-keypair-1873046423", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI80dZEFKn5R6kor+V2kSRf05EO1KIOdo1RAU7i7yr/YqQ65yYOv4Hf8J72+wTc+CsZ6LQMADiJpS3tcBwbhz101JnxPXa20insTckCyhoni9kU//Euvw6PRKHv2ymtaRQ=="}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:37:25.861659 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-47d73360-97e3-422e-9551-93d2ddb538df tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Getting quotas for project f3e0d8329b2c4d64bf51d88948ca0de2. Resources: {'key_pairs'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:37:25.868524 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-47d73360-97e3-422e-9551-93d2ddb538df tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Getting quotas for user 11149c46e1bc468f836fe70635dbf33b and project f3e0d8329b2c4d64bf51d88948ca0de2. Resources: {'key_pairs'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:37:25.898384 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-47d73360-97e3-422e-9551-93d2ddb538df tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.164299 Oct 04 20:37:25.899445 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 495/978] 10.222.0.33 () {60 vars in 1159 bytes} [Tue Oct 4 20:37:25 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 20:37:25.954784 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-160cabaa-3055-4e1f-bd33-f94f15ab6fda tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:25.967378 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-160cabaa-3055-4e1f-bd33-f94f15ab6fda tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:25.970034 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-160cabaa-3055-4e1f-bd33-f94f15ab6fda tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:25.973294 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-160cabaa-3055-4e1f-bd33-f94f15ab6fda tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] 10.222.0.33 "GET /compute/v2.1/servers/5dbb0cb7-e2d8-416a-a486-72d4398ee877" status: 200 len: 1567 microversion: 2.25 time: 0.284205 Oct 04 20:37:25.975104 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 484/979] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:37:25 2022] GET /compute/v2.1/servers/5dbb0cb7-e2d8-416a-a486-72d4398ee877 => generated 1567 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:37:26.092114 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-58adcd49-7f3d-4aaf-9bc3-ee7669453c4e tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:26.093100 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-58adcd49-7f3d-4aaf-9bc3-ee7669453c4e tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] [instance: 5e984459-625e-44cd-b226-091276567215] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:26.101592 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-58adcd49-7f3d-4aaf-9bc3-ee7669453c4e tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:26.102092 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-58adcd49-7f3d-4aaf-9bc3-ee7669453c4e tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:26.102554 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-58adcd49-7f3d-4aaf-9bc3-ee7669453c4e tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:26.103470 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-58adcd49-7f3d-4aaf-9bc3-ee7669453c4e tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:26.104084 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-58adcd49-7f3d-4aaf-9bc3-ee7669453c4e tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:26.104666 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-58adcd49-7f3d-4aaf-9bc3-ee7669453c4e tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:26.207282 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-58adcd49-7f3d-4aaf-9bc3-ee7669453c4e tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22706a9bf4d42efb57c10cbd92c6eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0024f434015447759489d3cdc7bbaa4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:26.219345 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-58adcd49-7f3d-4aaf-9bc3-ee7669453c4e tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a22706a9bf4d42efb57c10cbd92c6eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0024f434015447759489d3cdc7bbaa4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:26.221036 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-58adcd49-7f3d-4aaf-9bc3-ee7669453c4e tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a22706a9bf4d42efb57c10cbd92c6eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0024f434015447759489d3cdc7bbaa4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:26.226611 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-58adcd49-7f3d-4aaf-9bc3-ee7669453c4e tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] 10.222.0.33 "GET /compute/v2.1/servers/5e984459-625e-44cd-b226-091276567215" status: 200 len: 1447 microversion: 2.75 time: 0.139001 Oct 04 20:37:26.227575 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 496/980] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:37:26 2022] GET /compute/v2.1/servers/5e984459-625e-44cd-b226-091276567215 => generated 1447 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:37:26.492374 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-9f189bf8-c0ce-4bdb-b560-c8026a86e5b8 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:26.493339 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-9f189bf8-c0ce-4bdb-b560-c8026a86e5b8 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] [instance: 9f8cc082-0a37-4123-a680-1210a90b3ca9] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:26.501221 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9f189bf8-c0ce-4bdb-b560-c8026a86e5b8 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:26.501796 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9f189bf8-c0ce-4bdb-b560-c8026a86e5b8 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:26.502304 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9f189bf8-c0ce-4bdb-b560-c8026a86e5b8 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:26.503118 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9f189bf8-c0ce-4bdb-b560-c8026a86e5b8 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:26.503676 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9f189bf8-c0ce-4bdb-b560-c8026a86e5b8 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:26.504143 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9f189bf8-c0ce-4bdb-b560-c8026a86e5b8 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:26.510736 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:37:26.605595 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2ed449f0-2e46-4921-91bc-29589ced4ad2 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:26.607374 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-2ed449f0-2e46-4921-91bc-29589ced4ad2 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] [instance: 465ad440-a27e-4ff6-bb31-09f3545e166a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:26.616678 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2ed449f0-2e46-4921-91bc-29589ced4ad2 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:26.617436 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2ed449f0-2e46-4921-91bc-29589ced4ad2 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:26.617563 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2ed449f0-2e46-4921-91bc-29589ced4ad2 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:26.618244 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2ed449f0-2e46-4921-91bc-29589ced4ad2 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:26.618816 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2ed449f0-2e46-4921-91bc-29589ced4ad2 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:26.619265 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2ed449f0-2e46-4921-91bc-29589ced4ad2 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:26.800828 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-9f189bf8-c0ce-4bdb-b560-c8026a86e5b8 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a24944aeb34a5ea228965be9bf4ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c288268acb30475bbc065a8f72cb21d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:26.811422 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-9f189bf8-c0ce-4bdb-b560-c8026a86e5b8 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] 10.222.0.33 "GET /compute/v2.1/servers/9f8cc082-0a37-4123-a680-1210a90b3ca9" status: 200 len: 1472 microversion: 2.1 time: 0.323653 Oct 04 20:37:26.826855 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 485/981] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:37:26 2022] GET /compute/v2.1/servers/9f8cc082-0a37-4123-a680-1210a90b3ca9 => generated 1472 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:37:26.835533 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-768df65f-8b8e-42fd-b4ae-ae1b6f3cba99 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:26.842139 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-768df65f-8b8e-42fd-b4ae-ae1b6f3cba99 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] [instance: 62b98bc7-657a-42c2-b501-ae4d926cfa2f] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:26.854606 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-768df65f-8b8e-42fd-b4ae-ae1b6f3cba99 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:26.855159 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-768df65f-8b8e-42fd-b4ae-ae1b6f3cba99 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:26.855673 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-768df65f-8b8e-42fd-b4ae-ae1b6f3cba99 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:26.856453 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-768df65f-8b8e-42fd-b4ae-ae1b6f3cba99 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:26.857242 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-768df65f-8b8e-42fd-b4ae-ae1b6f3cba99 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:26.857821 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-768df65f-8b8e-42fd-b4ae-ae1b6f3cba99 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:26.873016 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-2ed449f0-2e46-4921-91bc-29589ced4ad2 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3563efe2b8c94931a2a46c4e14811b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3118a5d96843d3bede1ed94bd9717e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:26.884358 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-2ed449f0-2e46-4921-91bc-29589ced4ad2 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] 10.222.0.33 "GET /compute/v2.1/servers/465ad440-a27e-4ff6-bb31-09f3545e166a" status: 200 len: 1543 microversion: 2.1 time: 0.286850 Oct 04 20:37:26.884625 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 497/982] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:37:26 2022] GET /compute/v2.1/servers/465ad440-a27e-4ff6-bb31-09f3545e166a => generated 1543 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:37:26.983517 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-768df65f-8b8e-42fd-b4ae-ae1b6f3cba99 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '800db3a57ada47eca381b00189fdbf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66ec8ea91b04deb90b679589e0495bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:26.998841 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-768df65f-8b8e-42fd-b4ae-ae1b6f3cba99 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] 10.222.0.33 "GET /compute/v2.1/servers/62b98bc7-657a-42c2-b501-ae4d926cfa2f" status: 200 len: 1214 microversion: 2.1 time: 0.170652 Oct 04 20:37:26.999429 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 486/983] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:37:26 2022] GET /compute/v2.1/servers/62b98bc7-657a-42c2-b501-ae4d926cfa2f => generated 1214 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:37:27.002153 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1e296cf4-7e8b-4f1b-bf70-67d237beee99 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:27.002800 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-1e296cf4-7e8b-4f1b-bf70-67d237beee99 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] [instance: 5dbb0cb7-e2d8-416a-a486-72d4398ee877] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:27.018662 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1e296cf4-7e8b-4f1b-bf70-67d237beee99 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:27.019510 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1e296cf4-7e8b-4f1b-bf70-67d237beee99 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:27.020283 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1e296cf4-7e8b-4f1b-bf70-67d237beee99 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:27.022688 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1e296cf4-7e8b-4f1b-bf70-67d237beee99 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:27.023387 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1e296cf4-7e8b-4f1b-bf70-67d237beee99 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:27.025224 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1e296cf4-7e8b-4f1b-bf70-67d237beee99 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:27.267960 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-5c5ee496-da63-4dd6-9454-3c7d12345bf4 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:27.271562 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-5c5ee496-da63-4dd6-9454-3c7d12345bf4 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] [instance: 5e984459-625e-44cd-b226-091276567215] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:27.293972 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5c5ee496-da63-4dd6-9454-3c7d12345bf4 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:27.298251 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5c5ee496-da63-4dd6-9454-3c7d12345bf4 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:27.298829 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5c5ee496-da63-4dd6-9454-3c7d12345bf4 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:27.299803 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5c5ee496-da63-4dd6-9454-3c7d12345bf4 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:27.300362 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5c5ee496-da63-4dd6-9454-3c7d12345bf4 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:27.300885 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5c5ee496-da63-4dd6-9454-3c7d12345bf4 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:27.399255 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-1e296cf4-7e8b-4f1b-bf70-67d237beee99 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:27.408542 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-1e296cf4-7e8b-4f1b-bf70-67d237beee99 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:27.410319 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-1e296cf4-7e8b-4f1b-bf70-67d237beee99 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:27.412695 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-1e296cf4-7e8b-4f1b-bf70-67d237beee99 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] 10.222.0.33 "GET /compute/v2.1/servers/5dbb0cb7-e2d8-416a-a486-72d4398ee877" status: 200 len: 1567 microversion: 2.25 time: 0.415371 Oct 04 20:37:27.413294 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 498/984] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:37:26 2022] GET /compute/v2.1/servers/5dbb0cb7-e2d8-416a-a486-72d4398ee877 => generated 1567 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:37:27.431449 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-5c5ee496-da63-4dd6-9454-3c7d12345bf4 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22706a9bf4d42efb57c10cbd92c6eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0024f434015447759489d3cdc7bbaa4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:27.445846 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-5c5ee496-da63-4dd6-9454-3c7d12345bf4 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a22706a9bf4d42efb57c10cbd92c6eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0024f434015447759489d3cdc7bbaa4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:27.448578 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-5c5ee496-da63-4dd6-9454-3c7d12345bf4 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a22706a9bf4d42efb57c10cbd92c6eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0024f434015447759489d3cdc7bbaa4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:27.460479 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-5c5ee496-da63-4dd6-9454-3c7d12345bf4 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] 10.222.0.33 "GET /compute/v2.1/servers/5e984459-625e-44cd-b226-091276567215" status: 200 len: 1447 microversion: 2.75 time: 0.193989 Oct 04 20:37:27.461942 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 487/985] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:37:27 2022] GET /compute/v2.1/servers/5e984459-625e-44cd-b226-091276567215 => generated 1447 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:37:27.839516 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e84ccf38-dc2d-46f9-b169-30c13772b666 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:27.840387 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e84ccf38-dc2d-46f9-b169-30c13772b666 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] [instance: 9f8cc082-0a37-4123-a680-1210a90b3ca9] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:27.859003 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e84ccf38-dc2d-46f9-b169-30c13772b666 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:27.861371 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e84ccf38-dc2d-46f9-b169-30c13772b666 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:27.862848 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e84ccf38-dc2d-46f9-b169-30c13772b666 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:27.863785 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e84ccf38-dc2d-46f9-b169-30c13772b666 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:27.866728 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e84ccf38-dc2d-46f9-b169-30c13772b666 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:27.867414 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e84ccf38-dc2d-46f9-b169-30c13772b666 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:27.909024 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-e96dc595-5772-4fb8-ab54-03d59a37be54 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:27.909758 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-e96dc595-5772-4fb8-ab54-03d59a37be54 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] [instance: 465ad440-a27e-4ff6-bb31-09f3545e166a] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:27.922012 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e96dc595-5772-4fb8-ab54-03d59a37be54 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:27.922600 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e96dc595-5772-4fb8-ab54-03d59a37be54 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:27.923037 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e96dc595-5772-4fb8-ab54-03d59a37be54 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:27.925047 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e96dc595-5772-4fb8-ab54-03d59a37be54 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:27.925702 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e96dc595-5772-4fb8-ab54-03d59a37be54 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:27.926387 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e96dc595-5772-4fb8-ab54-03d59a37be54 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:28.228510 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e84ccf38-dc2d-46f9-b169-30c13772b666 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a24944aeb34a5ea228965be9bf4ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c288268acb30475bbc065a8f72cb21d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:28.237922 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e84ccf38-dc2d-46f9-b169-30c13772b666 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] 10.222.0.33 "GET /compute/v2.1/servers/9f8cc082-0a37-4123-a680-1210a90b3ca9" status: 200 len: 1490 microversion: 2.1 time: 0.402931 Oct 04 20:37:28.249582 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-e96dc595-5772-4fb8-ab54-03d59a37be54 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3563efe2b8c94931a2a46c4e14811b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3118a5d96843d3bede1ed94bd9717e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:28.258622 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 499/986] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:37:27 2022] GET /compute/v2.1/servers/9f8cc082-0a37-4123-a680-1210a90b3ca9 => generated 1490 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:37:28.263120 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-e96dc595-5772-4fb8-ab54-03d59a37be54 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] 10.222.0.33 "GET /compute/v2.1/servers/465ad440-a27e-4ff6-bb31-09f3545e166a" status: 200 len: 1543 microversion: 2.1 time: 0.358435 Oct 04 20:37:28.265783 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 488/987] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:37:27 2022] GET /compute/v2.1/servers/465ad440-a27e-4ff6-bb31-09f3545e166a => generated 1543 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:37:28.267289 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0159e898-8086-4513-9b18-67d1cde23698 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:28.268090 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-0159e898-8086-4513-9b18-67d1cde23698 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] [instance: 62b98bc7-657a-42c2-b501-ae4d926cfa2f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:28.276657 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0159e898-8086-4513-9b18-67d1cde23698 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:28.277352 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0159e898-8086-4513-9b18-67d1cde23698 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:28.277965 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0159e898-8086-4513-9b18-67d1cde23698 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:28.280271 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0159e898-8086-4513-9b18-67d1cde23698 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:28.281034 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0159e898-8086-4513-9b18-67d1cde23698 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:28.282310 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0159e898-8086-4513-9b18-67d1cde23698 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:28.373531 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-0159e898-8086-4513-9b18-67d1cde23698 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '800db3a57ada47eca381b00189fdbf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66ec8ea91b04deb90b679589e0495bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:28.388450 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-0159e898-8086-4513-9b18-67d1cde23698 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] 10.222.0.33 "GET /compute/v2.1/servers/62b98bc7-657a-42c2-b501-ae4d926cfa2f" status: 200 len: 1262 microversion: 2.1 time: 0.126934 Oct 04 20:37:28.389509 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 500/988] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:37:28 2022] GET /compute/v2.1/servers/62b98bc7-657a-42c2-b501-ae4d926cfa2f => generated 1262 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:37:28.439491 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-10817ab1-4004-43b5-9ade-bdc15baa4c74 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:28.440274 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-10817ab1-4004-43b5-9ade-bdc15baa4c74 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] [instance: 5dbb0cb7-e2d8-416a-a486-72d4398ee877] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:28.449041 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-10817ab1-4004-43b5-9ade-bdc15baa4c74 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:28.450123 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-10817ab1-4004-43b5-9ade-bdc15baa4c74 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:28.451048 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-10817ab1-4004-43b5-9ade-bdc15baa4c74 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:28.452607 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-10817ab1-4004-43b5-9ade-bdc15baa4c74 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:28.453293 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-10817ab1-4004-43b5-9ade-bdc15baa4c74 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:28.454542 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-10817ab1-4004-43b5-9ade-bdc15baa4c74 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:28.490899 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-00cee6ab-5bbd-4775-a275-73bf74b4685d tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:28.491504 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-00cee6ab-5bbd-4775-a275-73bf74b4685d tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] [instance: 5e984459-625e-44cd-b226-091276567215] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:28.501995 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-00cee6ab-5bbd-4775-a275-73bf74b4685d tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:28.502527 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-00cee6ab-5bbd-4775-a275-73bf74b4685d tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:28.502976 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-00cee6ab-5bbd-4775-a275-73bf74b4685d tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:28.503695 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-00cee6ab-5bbd-4775-a275-73bf74b4685d tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:28.504164 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-00cee6ab-5bbd-4775-a275-73bf74b4685d tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:28.504596 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-00cee6ab-5bbd-4775-a275-73bf74b4685d tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:28.610149 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-00cee6ab-5bbd-4775-a275-73bf74b4685d tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22706a9bf4d42efb57c10cbd92c6eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0024f434015447759489d3cdc7bbaa4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:28.617516 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=100 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:37:28.627037 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-00cee6ab-5bbd-4775-a275-73bf74b4685d tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a22706a9bf4d42efb57c10cbd92c6eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0024f434015447759489d3cdc7bbaa4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:28.629149 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-00cee6ab-5bbd-4775-a275-73bf74b4685d tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a22706a9bf4d42efb57c10cbd92c6eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0024f434015447759489d3cdc7bbaa4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:28.644386 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-00cee6ab-5bbd-4775-a275-73bf74b4685d tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] 10.222.0.33 "GET /compute/v2.1/servers/5e984459-625e-44cd-b226-091276567215" status: 200 len: 1447 microversion: 2.75 time: 0.157964 Oct 04 20:37:28.658927 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 501/989] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:37:28 2022] GET /compute/v2.1/servers/5e984459-625e-44cd-b226-091276567215 => generated 1447 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 20:37:28.676415 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-10817ab1-4004-43b5-9ade-bdc15baa4c74 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:28.687602 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-10817ab1-4004-43b5-9ade-bdc15baa4c74 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:28.689668 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-10817ab1-4004-43b5-9ade-bdc15baa4c74 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:28.691134 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-10817ab1-4004-43b5-9ade-bdc15baa4c74 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] 10.222.0.33 "GET /compute/v2.1/servers/5dbb0cb7-e2d8-416a-a486-72d4398ee877" status: 200 len: 1567 microversion: 2.25 time: 0.256587 Oct 04 20:37:28.691999 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 489/990] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:37:28 2022] GET /compute/v2.1/servers/5dbb0cb7-e2d8-416a-a486-72d4398ee877 => generated 1567 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:37:29.267921 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6c08ccb2-6c71-492f-8a97-17fde2be450f tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:29.269172 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-6c08ccb2-6c71-492f-8a97-17fde2be450f tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] [instance: 9f8cc082-0a37-4123-a680-1210a90b3ca9] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:29.278979 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6c08ccb2-6c71-492f-8a97-17fde2be450f tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:29.279914 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6c08ccb2-6c71-492f-8a97-17fde2be450f tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:29.280674 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6c08ccb2-6c71-492f-8a97-17fde2be450f tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:29.281626 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6c08ccb2-6c71-492f-8a97-17fde2be450f tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:29.282681 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6c08ccb2-6c71-492f-8a97-17fde2be450f tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:29.283450 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6c08ccb2-6c71-492f-8a97-17fde2be450f tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:29.292407 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-67a5b5d3-3341-4371-9a8a-ac6bbff383c0 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:29.293086 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-67a5b5d3-3341-4371-9a8a-ac6bbff383c0 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] [instance: 465ad440-a27e-4ff6-bb31-09f3545e166a] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:29.322296 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-67a5b5d3-3341-4371-9a8a-ac6bbff383c0 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:29.326252 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-67a5b5d3-3341-4371-9a8a-ac6bbff383c0 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:29.326964 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-67a5b5d3-3341-4371-9a8a-ac6bbff383c0 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:29.328885 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-67a5b5d3-3341-4371-9a8a-ac6bbff383c0 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:29.329587 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-67a5b5d3-3341-4371-9a8a-ac6bbff383c0 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:29.330205 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-67a5b5d3-3341-4371-9a8a-ac6bbff383c0 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:29.634299 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-6c08ccb2-6c71-492f-8a97-17fde2be450f tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a24944aeb34a5ea228965be9bf4ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c288268acb30475bbc065a8f72cb21d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:29.638206 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-67a5b5d3-3341-4371-9a8a-ac6bbff383c0 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3563efe2b8c94931a2a46c4e14811b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3118a5d96843d3bede1ed94bd9717e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:29.647903 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-67a5b5d3-3341-4371-9a8a-ac6bbff383c0 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] 10.222.0.33 "GET /compute/v2.1/servers/465ad440-a27e-4ff6-bb31-09f3545e166a" status: 200 len: 1543 microversion: 2.1 time: 0.360254 Oct 04 20:37:29.648898 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-6c08ccb2-6c71-492f-8a97-17fde2be450f tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] 10.222.0.33 "GET /compute/v2.1/servers/9f8cc082-0a37-4123-a680-1210a90b3ca9" status: 200 len: 1478 microversion: 2.1 time: 0.387589 Oct 04 20:37:29.649258 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 490/991] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:37:29 2022] GET /compute/v2.1/servers/465ad440-a27e-4ff6-bb31-09f3545e166a => generated 1543 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:37:29.650455 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 502/992] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:37:29 2022] GET /compute/v2.1/servers/9f8cc082-0a37-4123-a680-1210a90b3ca9 => generated 1478 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:37:29.671423 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-b3f6ad8f-e3e1-4e34-8698-38b469e8ac95 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:29.672372 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-b3f6ad8f-e3e1-4e34-8698-38b469e8ac95 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] [instance: 62b98bc7-657a-42c2-b501-ae4d926cfa2f] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:29.679371 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b3f6ad8f-e3e1-4e34-8698-38b469e8ac95 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:29.679861 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b3f6ad8f-e3e1-4e34-8698-38b469e8ac95 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:29.680158 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7d2482f1-7464-457d-99f1-5c7bbe59910b tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:29.680281 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b3f6ad8f-e3e1-4e34-8698-38b469e8ac95 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:29.680787 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-7d2482f1-7464-457d-99f1-5c7bbe59910b tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] [instance: 5e984459-625e-44cd-b226-091276567215] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:29.680974 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b3f6ad8f-e3e1-4e34-8698-38b469e8ac95 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:29.681790 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b3f6ad8f-e3e1-4e34-8698-38b469e8ac95 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:29.682670 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b3f6ad8f-e3e1-4e34-8698-38b469e8ac95 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:29.689397 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7d2482f1-7464-457d-99f1-5c7bbe59910b tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:29.690121 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7d2482f1-7464-457d-99f1-5c7bbe59910b tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:29.690801 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7d2482f1-7464-457d-99f1-5c7bbe59910b tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:29.691688 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7d2482f1-7464-457d-99f1-5c7bbe59910b tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:29.692284 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7d2482f1-7464-457d-99f1-5c7bbe59910b tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:29.693366 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7d2482f1-7464-457d-99f1-5c7bbe59910b tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:29.791579 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-b3f6ad8f-e3e1-4e34-8698-38b469e8ac95 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '800db3a57ada47eca381b00189fdbf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66ec8ea91b04deb90b679589e0495bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:29.793286 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-7d2482f1-7464-457d-99f1-5c7bbe59910b tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22706a9bf4d42efb57c10cbd92c6eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0024f434015447759489d3cdc7bbaa4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:29.802648 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-b3f6ad8f-e3e1-4e34-8698-38b469e8ac95 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] 10.222.0.33 "GET /compute/v2.1/servers/62b98bc7-657a-42c2-b501-ae4d926cfa2f" status: 200 len: 1262 microversion: 2.1 time: 0.151927 Oct 04 20:37:29.803453 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-7d2482f1-7464-457d-99f1-5c7bbe59910b tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a22706a9bf4d42efb57c10cbd92c6eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0024f434015447759489d3cdc7bbaa4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:29.804903 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-7d2482f1-7464-457d-99f1-5c7bbe59910b tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a22706a9bf4d42efb57c10cbd92c6eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0024f434015447759489d3cdc7bbaa4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:29.805562 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 491/993] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:37:29 2022] GET /compute/v2.1/servers/62b98bc7-657a-42c2-b501-ae4d926cfa2f => generated 1262 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:37:29.816925 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-21ced0e8-6982-471a-b557-71b621337500 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:29.817858 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-21ced0e8-6982-471a-b557-71b621337500 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] [instance: 5dbb0cb7-e2d8-416a-a486-72d4398ee877] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:29.827380 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-21ced0e8-6982-471a-b557-71b621337500 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:29.828139 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-21ced0e8-6982-471a-b557-71b621337500 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:29.829368 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-21ced0e8-6982-471a-b557-71b621337500 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:29.830274 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-21ced0e8-6982-471a-b557-71b621337500 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:29.830905 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-21ced0e8-6982-471a-b557-71b621337500 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:29.831499 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-21ced0e8-6982-471a-b557-71b621337500 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:29.835894 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-7d2482f1-7464-457d-99f1-5c7bbe59910b tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] 10.222.0.33 "GET /compute/v2.1/servers/5e984459-625e-44cd-b226-091276567215" status: 200 len: 1447 microversion: 2.75 time: 0.160945 Oct 04 20:37:29.846994 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 503/994] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:37:29 2022] GET /compute/v2.1/servers/5e984459-625e-44cd-b226-091276567215 => generated 1447 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 20:37:30.094739 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-21ced0e8-6982-471a-b557-71b621337500 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:30.111958 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-21ced0e8-6982-471a-b557-71b621337500 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:30.118589 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-21ced0e8-6982-471a-b557-71b621337500 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:30.122164 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-21ced0e8-6982-471a-b557-71b621337500 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] 10.222.0.33 "GET /compute/v2.1/servers/5dbb0cb7-e2d8-416a-a486-72d4398ee877" status: 200 len: 1567 microversion: 2.25 time: 0.314846 Oct 04 20:37:30.125529 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 492/995] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:37:29 2022] GET /compute/v2.1/servers/5dbb0cb7-e2d8-416a-a486-72d4398ee877 => generated 1567 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:37:30.678675 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-b3ca9cf8-bf3f-43d4-b50a-c9133d95c680 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:30.679744 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-20b01c2e-ef23-492a-a6c6-07b86acf738a tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:30.680957 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-20b01c2e-ef23-492a-a6c6-07b86acf738a tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] [instance: 465ad440-a27e-4ff6-bb31-09f3545e166a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:30.681807 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-b3ca9cf8-bf3f-43d4-b50a-c9133d95c680 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] [instance: 9f8cc082-0a37-4123-a680-1210a90b3ca9] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:30.696953 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-20b01c2e-ef23-492a-a6c6-07b86acf738a tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:30.698035 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b3ca9cf8-bf3f-43d4-b50a-c9133d95c680 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:30.698767 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-20b01c2e-ef23-492a-a6c6-07b86acf738a tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:30.699481 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b3ca9cf8-bf3f-43d4-b50a-c9133d95c680 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:30.700104 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-20b01c2e-ef23-492a-a6c6-07b86acf738a tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:30.700719 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b3ca9cf8-bf3f-43d4-b50a-c9133d95c680 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:30.701547 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-20b01c2e-ef23-492a-a6c6-07b86acf738a tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:30.703160 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b3ca9cf8-bf3f-43d4-b50a-c9133d95c680 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:30.704053 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-20b01c2e-ef23-492a-a6c6-07b86acf738a tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:30.704707 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b3ca9cf8-bf3f-43d4-b50a-c9133d95c680 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:30.705332 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-20b01c2e-ef23-492a-a6c6-07b86acf738a tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:30.710934 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b3ca9cf8-bf3f-43d4-b50a-c9133d95c680 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:31.035659 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-20b01c2e-ef23-492a-a6c6-07b86acf738a tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3563efe2b8c94931a2a46c4e14811b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3118a5d96843d3bede1ed94bd9717e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:31.053848 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-b3ca9cf8-bf3f-43d4-b50a-c9133d95c680 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a24944aeb34a5ea228965be9bf4ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c288268acb30475bbc065a8f72cb21d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:31.058976 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-20b01c2e-ef23-492a-a6c6-07b86acf738a tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] 10.222.0.33 "GET /compute/v2.1/servers/465ad440-a27e-4ff6-bb31-09f3545e166a" status: 200 len: 1543 microversion: 2.1 time: 0.388511 Oct 04 20:37:31.061744 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 504/996] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:37:30 2022] GET /compute/v2.1/servers/465ad440-a27e-4ff6-bb31-09f3545e166a => generated 1543 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:37:31.074181 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-b3ca9cf8-bf3f-43d4-b50a-c9133d95c680 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] 10.222.0.33 "GET /compute/v2.1/servers/9f8cc082-0a37-4123-a680-1210a90b3ca9" status: 200 len: 1478 microversion: 2.1 time: 0.405056 Oct 04 20:37:31.075466 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-bf4e3de8-73be-4cc7-8302-77b83a08b769 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:31.076109 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-bf4e3de8-73be-4cc7-8302-77b83a08b769 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] [instance: 62b98bc7-657a-42c2-b501-ae4d926cfa2f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:31.085944 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 493/997] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:37:30 2022] GET /compute/v2.1/servers/9f8cc082-0a37-4123-a680-1210a90b3ca9 => generated 1478 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:37:31.090489 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:37:31.092195 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bf4e3de8-73be-4cc7-8302-77b83a08b769 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:31.093014 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bf4e3de8-73be-4cc7-8302-77b83a08b769 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:31.093722 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bf4e3de8-73be-4cc7-8302-77b83a08b769 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:31.094268 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-52018f7d-a181-4b8e-8793-086f6c30459e tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:31.094815 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bf4e3de8-73be-4cc7-8302-77b83a08b769 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:31.094934 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-52018f7d-a181-4b8e-8793-086f6c30459e tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] [instance: 5e984459-625e-44cd-b226-091276567215] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:31.103647 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bf4e3de8-73be-4cc7-8302-77b83a08b769 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:31.104583 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bf4e3de8-73be-4cc7-8302-77b83a08b769 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:31.104697 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-52018f7d-a181-4b8e-8793-086f6c30459e tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:31.105159 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-52018f7d-a181-4b8e-8793-086f6c30459e tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:31.121141 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-52018f7d-a181-4b8e-8793-086f6c30459e tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:31.122373 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-52018f7d-a181-4b8e-8793-086f6c30459e tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:31.138748 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-52018f7d-a181-4b8e-8793-086f6c30459e tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:31.139464 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-52018f7d-a181-4b8e-8793-086f6c30459e tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:31.263041 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-bf4e3de8-73be-4cc7-8302-77b83a08b769 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '800db3a57ada47eca381b00189fdbf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66ec8ea91b04deb90b679589e0495bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:31.273329 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-bf4e3de8-73be-4cc7-8302-77b83a08b769 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] 10.222.0.33 "GET /compute/v2.1/servers/62b98bc7-657a-42c2-b501-ae4d926cfa2f" status: 200 len: 1268 microversion: 2.1 time: 0.210042 Oct 04 20:37:31.292250 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 505/998] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:37:31 2022] GET /compute/v2.1/servers/62b98bc7-657a-42c2-b501-ae4d926cfa2f => generated 1268 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:37:31.298683 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-84107bf4-1317-4a69-b730-b84ba8b814d2 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:31.299780 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-84107bf4-1317-4a69-b730-b84ba8b814d2 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] [instance: 5dbb0cb7-e2d8-416a-a486-72d4398ee877] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:31.311496 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-84107bf4-1317-4a69-b730-b84ba8b814d2 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:31.312418 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-84107bf4-1317-4a69-b730-b84ba8b814d2 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:31.313489 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-84107bf4-1317-4a69-b730-b84ba8b814d2 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:31.314467 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-84107bf4-1317-4a69-b730-b84ba8b814d2 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:31.315151 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-84107bf4-1317-4a69-b730-b84ba8b814d2 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:31.316039 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-84107bf4-1317-4a69-b730-b84ba8b814d2 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:31.341438 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-52018f7d-a181-4b8e-8793-086f6c30459e tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22706a9bf4d42efb57c10cbd92c6eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0024f434015447759489d3cdc7bbaa4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:31.360194 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-52018f7d-a181-4b8e-8793-086f6c30459e tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a22706a9bf4d42efb57c10cbd92c6eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0024f434015447759489d3cdc7bbaa4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:31.362142 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-52018f7d-a181-4b8e-8793-086f6c30459e tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a22706a9bf4d42efb57c10cbd92c6eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0024f434015447759489d3cdc7bbaa4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:31.384854 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-52018f7d-a181-4b8e-8793-086f6c30459e tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] 10.222.0.33 "GET /compute/v2.1/servers/5e984459-625e-44cd-b226-091276567215" status: 200 len: 1447 microversion: 2.75 time: 0.295503 Oct 04 20:37:31.387635 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 494/999] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:37:31 2022] GET /compute/v2.1/servers/5e984459-625e-44cd-b226-091276567215 => generated 1447 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:37:31.596284 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-84107bf4-1317-4a69-b730-b84ba8b814d2 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:31.611217 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-84107bf4-1317-4a69-b730-b84ba8b814d2 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:31.613169 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-84107bf4-1317-4a69-b730-b84ba8b814d2 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:31.615844 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-84107bf4-1317-4a69-b730-b84ba8b814d2 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] 10.222.0.33 "GET /compute/v2.1/servers/5dbb0cb7-e2d8-416a-a486-72d4398ee877" status: 200 len: 1567 microversion: 2.25 time: 0.322236 Oct 04 20:37:31.628978 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 506/1000] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:37:31 2022] GET /compute/v2.1/servers/5dbb0cb7-e2d8-416a-a486-72d4398ee877 => generated 1567 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:37:31.907877 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-1ca16e96-77ee-44c7-bf9a-9e5e9a7fe8fb req-cc0ca58d-be0f-4a07-a1c4-900905e24d5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f8cc082-0a37-4123-a680-1210a90b3ca9", "name": "network-vif-unplugged", "status": "completed", "tag": "b3d1f9a5-253e-4b89-ba8b-3d8135069ec1"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:37:31.936802 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-1ca16e96-77ee-44c7-bf9a-9e5e9a7fe8fb req-cc0ca58d-be0f-4a07-a1c4-900905e24d5e service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:31.938632 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-1ca16e96-77ee-44c7-bf9a-9e5e9a7fe8fb req-cc0ca58d-be0f-4a07-a1c4-900905e24d5e service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:31.939515 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-1ca16e96-77ee-44c7-bf9a-9e5e9a7fe8fb req-cc0ca58d-be0f-4a07-a1c4-900905e24d5e service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:31.962725 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-1ca16e96-77ee-44c7-bf9a-9e5e9a7fe8fb req-cc0ca58d-be0f-4a07-a1c4-900905e24d5e service nova] Creating event network-vif-unplugged:b3d1f9a5-253e-4b89-ba8b-3d8135069ec1 for instance 9f8cc082-0a37-4123-a680-1210a90b3ca9 on n-h1-854823-8 Oct 04 20:37:31.968720 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-1ca16e96-77ee-44c7-bf9a-9e5e9a7fe8fb req-cc0ca58d-be0f-4a07-a1c4-900905e24d5e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.065946 Oct 04 20:37:31.970041 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 495/1001] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:37:31 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:37:32.090271 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2588caa1-c49e-421d-a91f-15b7f58a59a3 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:32.091164 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-2588caa1-c49e-421d-a91f-15b7f58a59a3 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] [instance: 465ad440-a27e-4ff6-bb31-09f3545e166a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:32.105842 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2588caa1-c49e-421d-a91f-15b7f58a59a3 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:32.106383 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2588caa1-c49e-421d-a91f-15b7f58a59a3 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:32.107792 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2588caa1-c49e-421d-a91f-15b7f58a59a3 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:32.108802 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2588caa1-c49e-421d-a91f-15b7f58a59a3 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:32.110476 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2588caa1-c49e-421d-a91f-15b7f58a59a3 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:32.111930 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2588caa1-c49e-421d-a91f-15b7f58a59a3 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:32.115871 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-1e80b4cc-2d1c-4daa-832f-e6f9ca1bfe37 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:32.116827 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-1e80b4cc-2d1c-4daa-832f-e6f9ca1bfe37 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] [instance: 9f8cc082-0a37-4123-a680-1210a90b3ca9] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:32.131717 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1e80b4cc-2d1c-4daa-832f-e6f9ca1bfe37 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:32.132226 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1e80b4cc-2d1c-4daa-832f-e6f9ca1bfe37 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:32.134922 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1e80b4cc-2d1c-4daa-832f-e6f9ca1bfe37 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:32.135712 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1e80b4cc-2d1c-4daa-832f-e6f9ca1bfe37 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:32.136364 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1e80b4cc-2d1c-4daa-832f-e6f9ca1bfe37 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:32.137426 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1e80b4cc-2d1c-4daa-832f-e6f9ca1bfe37 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:32.490061 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-2588caa1-c49e-421d-a91f-15b7f58a59a3 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3563efe2b8c94931a2a46c4e14811b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3118a5d96843d3bede1ed94bd9717e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:32.499005 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-2588caa1-c49e-421d-a91f-15b7f58a59a3 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] 10.222.0.33 "GET /compute/v2.1/servers/465ad440-a27e-4ff6-bb31-09f3545e166a" status: 200 len: 1543 microversion: 2.1 time: 0.413303 Oct 04 20:37:32.511721 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-1e80b4cc-2d1c-4daa-832f-e6f9ca1bfe37 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a24944aeb34a5ea228965be9bf4ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c288268acb30475bbc065a8f72cb21d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:32.512367 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 507/1002] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:37:32 2022] GET /compute/v2.1/servers/465ad440-a27e-4ff6-bb31-09f3545e166a => generated 1543 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:37:32.523522 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5909e7b0-8729-4e02-a9ae-2368baad6267 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:32.524695 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-5909e7b0-8729-4e02-a9ae-2368baad6267 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] [instance: 62b98bc7-657a-42c2-b501-ae4d926cfa2f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:32.527356 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-1e80b4cc-2d1c-4daa-832f-e6f9ca1bfe37 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] 10.222.0.33 "GET /compute/v2.1/servers/9f8cc082-0a37-4123-a680-1210a90b3ca9" status: 200 len: 1463 microversion: 2.1 time: 0.418004 Oct 04 20:37:32.528421 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 496/1003] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:37:32 2022] GET /compute/v2.1/servers/9f8cc082-0a37-4123-a680-1210a90b3ca9 => generated 1463 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:37:32.531965 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5909e7b0-8729-4e02-a9ae-2368baad6267 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:32.532670 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5909e7b0-8729-4e02-a9ae-2368baad6267 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:32.533464 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5909e7b0-8729-4e02-a9ae-2368baad6267 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:32.534395 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5909e7b0-8729-4e02-a9ae-2368baad6267 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:32.535121 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5909e7b0-8729-4e02-a9ae-2368baad6267 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:32.535708 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5909e7b0-8729-4e02-a9ae-2368baad6267 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:32.537554 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-5767242c-d80f-416d-8571-c1154fbaac48 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:32.541921 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-5767242c-d80f-416d-8571-c1154fbaac48 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] [instance: 5e984459-625e-44cd-b226-091276567215] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:32.552597 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5767242c-d80f-416d-8571-c1154fbaac48 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:32.554578 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5767242c-d80f-416d-8571-c1154fbaac48 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:32.555258 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5767242c-d80f-416d-8571-c1154fbaac48 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:32.556678 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5767242c-d80f-416d-8571-c1154fbaac48 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:32.557242 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5767242c-d80f-416d-8571-c1154fbaac48 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:32.557865 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5767242c-d80f-416d-8571-c1154fbaac48 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:32.697461 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-5767242c-d80f-416d-8571-c1154fbaac48 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22706a9bf4d42efb57c10cbd92c6eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0024f434015447759489d3cdc7bbaa4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:32.710821 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-5767242c-d80f-416d-8571-c1154fbaac48 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a22706a9bf4d42efb57c10cbd92c6eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0024f434015447759489d3cdc7bbaa4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:32.712513 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-5767242c-d80f-416d-8571-c1154fbaac48 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a22706a9bf4d42efb57c10cbd92c6eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0024f434015447759489d3cdc7bbaa4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:32.733172 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-5767242c-d80f-416d-8571-c1154fbaac48 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] 10.222.0.33 "GET /compute/v2.1/servers/5e984459-625e-44cd-b226-091276567215" status: 200 len: 1447 microversion: 2.75 time: 0.203074 Oct 04 20:37:32.735904 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 497/1004] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:37:32 2022] GET /compute/v2.1/servers/5e984459-625e-44cd-b226-091276567215 => generated 1447 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:37:32.765593 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-952260ee-8513-4ebc-ab5b-84fbae90d10b tempest-ServersAdminTestJSON-718875626 tempest-ServersAdminTestJSON-718875626-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:37:32.775450 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-952260ee-8513-4ebc-ab5b-84fbae90d10b tempest-ServersAdminTestJSON-718875626 tempest-ServersAdminTestJSON-718875626-project-admin] [instance: 9f8cc082-0a37-4123-a680-1210a90b3ca9] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:32.788083 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-952260ee-8513-4ebc-ab5b-84fbae90d10b tempest-ServersAdminTestJSON-718875626 tempest-ServersAdminTestJSON-718875626-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:32.788791 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-952260ee-8513-4ebc-ab5b-84fbae90d10b tempest-ServersAdminTestJSON-718875626 tempest-ServersAdminTestJSON-718875626-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:32.789382 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-952260ee-8513-4ebc-ab5b-84fbae90d10b tempest-ServersAdminTestJSON-718875626 tempest-ServersAdminTestJSON-718875626-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:32.790461 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-952260ee-8513-4ebc-ab5b-84fbae90d10b tempest-ServersAdminTestJSON-718875626 tempest-ServersAdminTestJSON-718875626-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:32.791212 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-952260ee-8513-4ebc-ab5b-84fbae90d10b tempest-ServersAdminTestJSON-718875626 tempest-ServersAdminTestJSON-718875626-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:32.791726 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-952260ee-8513-4ebc-ab5b-84fbae90d10b tempest-ServersAdminTestJSON-718875626 tempest-ServersAdminTestJSON-718875626-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:32.902932 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-952260ee-8513-4ebc-ab5b-84fbae90d10b tempest-ServersAdminTestJSON-718875626 tempest-ServersAdminTestJSON-718875626-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/9f8cc082-0a37-4123-a680-1210a90b3ca9/action" status: 202 len: 0 microversion: 2.1 time: 0.148994 Oct 04 20:37:32.903601 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 498/1005] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 20:37:32 2022] POST /compute/v2.1/servers/9f8cc082-0a37-4123-a680-1210a90b3ca9/action => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:37:32.925880 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-e5faaed6-f73e-49ba-991f-32c6d2e2f2f8 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:32.929713 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-e5faaed6-f73e-49ba-991f-32c6d2e2f2f8 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] [instance: 5dbb0cb7-e2d8-416a-a486-72d4398ee877] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:32.942869 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-5909e7b0-8729-4e02-a9ae-2368baad6267 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '800db3a57ada47eca381b00189fdbf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66ec8ea91b04deb90b679589e0495bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:32.947818 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e5faaed6-f73e-49ba-991f-32c6d2e2f2f8 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:32.951873 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5909e7b0-8729-4e02-a9ae-2368baad6267 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] 10.222.0.33 "GET /compute/v2.1/servers/62b98bc7-657a-42c2-b501-ae4d926cfa2f" status: 200 len: 1310 microversion: 2.1 time: 0.437993 Oct 04 20:37:32.952468 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 508/1006] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:37:32 2022] GET /compute/v2.1/servers/62b98bc7-657a-42c2-b501-ae4d926cfa2f => generated 1310 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:37:32.953512 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e5faaed6-f73e-49ba-991f-32c6d2e2f2f8 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:32.953981 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e5faaed6-f73e-49ba-991f-32c6d2e2f2f8 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:32.955193 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e5faaed6-f73e-49ba-991f-32c6d2e2f2f8 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:32.955650 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e5faaed6-f73e-49ba-991f-32c6d2e2f2f8 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:32.957956 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e5faaed6-f73e-49ba-991f-32c6d2e2f2f8 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:32.960126 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-b46c13fe-13ef-4ea3-b14c-a7ba3a685ec0 req-fc08e993-c3ef-4d9b-9c80-3acc5421c4f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62b98bc7-657a-42c2-b501-ae4d926cfa2f", "tag": "7e9ad1e9-b4f0-48a2-b19c-30f06d92c931"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:37:32.987296 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-b46c13fe-13ef-4ea3-b14c-a7ba3a685ec0 req-fc08e993-c3ef-4d9b-9c80-3acc5421c4f6 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:32.987782 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-b46c13fe-13ef-4ea3-b14c-a7ba3a685ec0 req-fc08e993-c3ef-4d9b-9c80-3acc5421c4f6 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:32.988260 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-b46c13fe-13ef-4ea3-b14c-a7ba3a685ec0 req-fc08e993-c3ef-4d9b-9c80-3acc5421c4f6 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:33.020169 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-b46c13fe-13ef-4ea3-b14c-a7ba3a685ec0 req-fc08e993-c3ef-4d9b-9c80-3acc5421c4f6 service nova] Creating event network-changed:7e9ad1e9-b4f0-48a2-b19c-30f06d92c931 for instance 62b98bc7-657a-42c2-b501-ae4d926cfa2f on n-h1-854823-8 Oct 04 20:37:33.027575 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-b46c13fe-13ef-4ea3-b14c-a7ba3a685ec0 req-fc08e993-c3ef-4d9b-9c80-3acc5421c4f6 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070822 Oct 04 20:37:33.028228 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 509/1007] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:37:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:37:33.039131 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f1bfe836-b86b-44be-8309-d92922368ac2 tempest-ServersAdminTestJSON-718875626 tempest-ServersAdminTestJSON-718875626-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:33.048876 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f1bfe836-b86b-44be-8309-d92922368ac2 tempest-ServersAdminTestJSON-718875626 tempest-ServersAdminTestJSON-718875626-project-admin] [instance: 9f8cc082-0a37-4123-a680-1210a90b3ca9] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:33.062532 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f1bfe836-b86b-44be-8309-d92922368ac2 tempest-ServersAdminTestJSON-718875626 tempest-ServersAdminTestJSON-718875626-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:33.063029 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f1bfe836-b86b-44be-8309-d92922368ac2 tempest-ServersAdminTestJSON-718875626 tempest-ServersAdminTestJSON-718875626-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:33.063463 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f1bfe836-b86b-44be-8309-d92922368ac2 tempest-ServersAdminTestJSON-718875626 tempest-ServersAdminTestJSON-718875626-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:33.064178 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f1bfe836-b86b-44be-8309-d92922368ac2 tempest-ServersAdminTestJSON-718875626 tempest-ServersAdminTestJSON-718875626-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:33.064633 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f1bfe836-b86b-44be-8309-d92922368ac2 tempest-ServersAdminTestJSON-718875626 tempest-ServersAdminTestJSON-718875626-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:33.065059 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f1bfe836-b86b-44be-8309-d92922368ac2 tempest-ServersAdminTestJSON-718875626 tempest-ServersAdminTestJSON-718875626-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:33.143859 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f1bfe836-b86b-44be-8309-d92922368ac2 tempest-ServersAdminTestJSON-718875626 tempest-ServersAdminTestJSON-718875626-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:33.144508 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f1bfe836-b86b-44be-8309-d92922368ac2 tempest-ServersAdminTestJSON-718875626 tempest-ServersAdminTestJSON-718875626-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:33.144789 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f1bfe836-b86b-44be-8309-d92922368ac2 tempest-ServersAdminTestJSON-718875626 tempest-ServersAdminTestJSON-718875626-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:33.145589 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-f1bfe836-b86b-44be-8309-d92922368ac2 tempest-ServersAdminTestJSON-718875626 tempest-ServersAdminTestJSON-718875626-project-admin] Lazy-loading 'fault' on Instance uuid 9f8cc082-0a37-4123-a680-1210a90b3ca9 {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:37:33.333897 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f1bfe836-b86b-44be-8309-d92922368ac2 tempest-ServersAdminTestJSON-718875626 tempest-ServersAdminTestJSON-718875626-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/9f8cc082-0a37-4123-a680-1210a90b3ca9" status: 200 len: 1597 microversion: 2.1 time: 0.302175 Oct 04 20:37:33.350399 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 510/1008] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:37:33 2022] GET /compute/v2.1/servers/9f8cc082-0a37-4123-a680-1210a90b3ca9 => generated 1597 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:37:33.357130 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-307f650e-1d36-4bc7-940e-c001cd11d6b5 tempest-ServersAdminTestJSON-718875626 tempest-ServersAdminTestJSON-718875626-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:37:33.359578 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-307f650e-1d36-4bc7-940e-c001cd11d6b5 tempest-ServersAdminTestJSON-718875626 tempest-ServersAdminTestJSON-718875626-project-admin] [instance: 9f8cc082-0a37-4123-a680-1210a90b3ca9] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:33.367962 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-307f650e-1d36-4bc7-940e-c001cd11d6b5 tempest-ServersAdminTestJSON-718875626 tempest-ServersAdminTestJSON-718875626-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:33.368460 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-307f650e-1d36-4bc7-940e-c001cd11d6b5 tempest-ServersAdminTestJSON-718875626 tempest-ServersAdminTestJSON-718875626-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:33.368910 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-307f650e-1d36-4bc7-940e-c001cd11d6b5 tempest-ServersAdminTestJSON-718875626 tempest-ServersAdminTestJSON-718875626-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:33.369619 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-307f650e-1d36-4bc7-940e-c001cd11d6b5 tempest-ServersAdminTestJSON-718875626 tempest-ServersAdminTestJSON-718875626-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:33.370079 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-307f650e-1d36-4bc7-940e-c001cd11d6b5 tempest-ServersAdminTestJSON-718875626 tempest-ServersAdminTestJSON-718875626-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:33.370541 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-307f650e-1d36-4bc7-940e-c001cd11d6b5 tempest-ServersAdminTestJSON-718875626 tempest-ServersAdminTestJSON-718875626-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:33.382831 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-e5faaed6-f73e-49ba-991f-32c6d2e2f2f8 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:33.392251 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-e5faaed6-f73e-49ba-991f-32c6d2e2f2f8 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:33.406305 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-e5faaed6-f73e-49ba-991f-32c6d2e2f2f8 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:33.411026 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-e5faaed6-f73e-49ba-991f-32c6d2e2f2f8 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] 10.222.0.33 "GET /compute/v2.1/servers/5dbb0cb7-e2d8-416a-a486-72d4398ee877" status: 200 len: 1557 microversion: 2.25 time: 0.501777 Oct 04 20:37:33.412564 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 499/1009] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:37:32 2022] GET /compute/v2.1/servers/5dbb0cb7-e2d8-416a-a486-72d4398ee877 => generated 1557 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:37:33.436975 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-5f45046e-03f1-4118-a166-3cc69b540219 tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] Calling method '.version_select at 0x7f3c745cdb80>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:33.444083 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5f45046e-03f1-4118-a166-3cc69b540219 tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:33.444687 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5f45046e-03f1-4118-a166-3cc69b540219 tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:33.445198 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5f45046e-03f1-4118-a166-3cc69b540219 tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:33.463367 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-5f45046e-03f1-4118-a166-3cc69b540219 tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] 10.222.0.33 "GET /compute/v2.1/os-migrations" status: 200 len: 1946 microversion: 2.25 time: 0.029953 Oct 04 20:37:33.465368 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 500/1010] 10.222.0.33 () {60 vars in 1184 bytes} [Tue Oct 4 20:37:33 2022] GET /compute/v2.1/os-migrations => generated 1946 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:37:33.481227 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-45ef2036-1fc6-446a-bd57-683a3f344ec8 tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:33.482369 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-45ef2036-1fc6-446a-bd57-683a3f344ec8 tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] [instance: 5dbb0cb7-e2d8-416a-a486-72d4398ee877] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:33.492284 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-307f650e-1d36-4bc7-940e-c001cd11d6b5 tempest-ServersAdminTestJSON-718875626 tempest-ServersAdminTestJSON-718875626-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/9f8cc082-0a37-4123-a680-1210a90b3ca9/action" status: 202 len: 0 microversion: 2.1 time: 0.138881 Oct 04 20:37:33.493454 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-45ef2036-1fc6-446a-bd57-683a3f344ec8 tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:33.493945 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-45ef2036-1fc6-446a-bd57-683a3f344ec8 tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:33.494759 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 511/1011] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 20:37:33 2022] POST /compute/v2.1/servers/9f8cc082-0a37-4123-a680-1210a90b3ca9/action => generated 0 bytes in 142 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 20:37:33.497604 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-45ef2036-1fc6-446a-bd57-683a3f344ec8 tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:33.498488 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-45ef2036-1fc6-446a-bd57-683a3f344ec8 tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:33.498995 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-45ef2036-1fc6-446a-bd57-683a3f344ec8 tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:33.499493 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-45ef2036-1fc6-446a-bd57-683a3f344ec8 tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:33.502025 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2ef8c32f-5b95-4fb9-b9fb-12f6fe89a3c1 tempest-ServersAdminTestJSON-718875626 tempest-ServersAdminTestJSON-718875626-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:33.502834 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-2ef8c32f-5b95-4fb9-b9fb-12f6fe89a3c1 tempest-ServersAdminTestJSON-718875626 tempest-ServersAdminTestJSON-718875626-project-admin] [instance: 9f8cc082-0a37-4123-a680-1210a90b3ca9] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:33.510383 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2ef8c32f-5b95-4fb9-b9fb-12f6fe89a3c1 tempest-ServersAdminTestJSON-718875626 tempest-ServersAdminTestJSON-718875626-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:33.510896 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2ef8c32f-5b95-4fb9-b9fb-12f6fe89a3c1 tempest-ServersAdminTestJSON-718875626 tempest-ServersAdminTestJSON-718875626-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:33.511323 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2ef8c32f-5b95-4fb9-b9fb-12f6fe89a3c1 tempest-ServersAdminTestJSON-718875626 tempest-ServersAdminTestJSON-718875626-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:33.512031 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2ef8c32f-5b95-4fb9-b9fb-12f6fe89a3c1 tempest-ServersAdminTestJSON-718875626 tempest-ServersAdminTestJSON-718875626-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:33.512527 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2ef8c32f-5b95-4fb9-b9fb-12f6fe89a3c1 tempest-ServersAdminTestJSON-718875626 tempest-ServersAdminTestJSON-718875626-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:33.513099 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2ef8c32f-5b95-4fb9-b9fb-12f6fe89a3c1 tempest-ServersAdminTestJSON-718875626 tempest-ServersAdminTestJSON-718875626-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:33.989805 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:37:34.002652 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.objects.instance [None req-45ef2036-1fc6-446a-bd57-683a3f344ec8 tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] Lazy-loading 'services' on Instance uuid 5dbb0cb7-e2d8-416a-a486-72d4398ee877 {{(pid=128802) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:37:34.002862 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-2ef8c32f-5b95-4fb9-b9fb-12f6fe89a3c1 tempest-ServersAdminTestJSON-718875626 tempest-ServersAdminTestJSON-718875626-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/9f8cc082-0a37-4123-a680-1210a90b3ca9" status: 200 len: 1614 microversion: 2.1 time: 0.504041 Oct 04 20:37:34.003819 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 512/1012] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:37:33 2022] GET /compute/v2.1/servers/9f8cc082-0a37-4123-a680-1210a90b3ca9 => generated 1614 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:37:34.013904 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-463f3189-9a9f-4ab4-866d-4cb1695aef87 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:34.014693 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-463f3189-9a9f-4ab4-866d-4cb1695aef87 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] [instance: 465ad440-a27e-4ff6-bb31-09f3545e166a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:34.023771 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-463f3189-9a9f-4ab4-866d-4cb1695aef87 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:34.024662 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-463f3189-9a9f-4ab4-866d-4cb1695aef87 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:34.025209 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-463f3189-9a9f-4ab4-866d-4cb1695aef87 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:34.026522 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-463f3189-9a9f-4ab4-866d-4cb1695aef87 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:34.026522 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-463f3189-9a9f-4ab4-866d-4cb1695aef87 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:34.027388 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-463f3189-9a9f-4ab4-866d-4cb1695aef87 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:34.077888 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-45ef2036-1fc6-446a-bd57-683a3f344ec8 tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/5dbb0cb7-e2d8-416a-a486-72d4398ee877" status: 200 len: 2050 microversion: 2.25 time: 0.600563 Oct 04 20:37:34.078649 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 501/1013] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:37:33 2022] GET /compute/v2.1/servers/5dbb0cb7-e2d8-416a-a486-72d4398ee877 => generated 2050 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 20:37:34.083809 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-26389e38-92ca-4372-83e0-95841159607d tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:34.084465 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-26389e38-92ca-4372-83e0-95841159607d tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] [instance: 5e984459-625e-44cd-b226-091276567215] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:34.092236 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-26389e38-92ca-4372-83e0-95841159607d tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:34.092715 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-26389e38-92ca-4372-83e0-95841159607d tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:34.093143 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-26389e38-92ca-4372-83e0-95841159607d tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:34.093838 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-26389e38-92ca-4372-83e0-95841159607d tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:34.094286 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-26389e38-92ca-4372-83e0-95841159607d tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:34.094724 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-26389e38-92ca-4372-83e0-95841159607d tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:34.185467 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-26389e38-92ca-4372-83e0-95841159607d tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22706a9bf4d42efb57c10cbd92c6eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0024f434015447759489d3cdc7bbaa4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:34.201545 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-26389e38-92ca-4372-83e0-95841159607d tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a22706a9bf4d42efb57c10cbd92c6eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0024f434015447759489d3cdc7bbaa4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:34.203267 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-26389e38-92ca-4372-83e0-95841159607d tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a22706a9bf4d42efb57c10cbd92c6eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0024f434015447759489d3cdc7bbaa4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:34.210272 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-26389e38-92ca-4372-83e0-95841159607d tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] 10.222.0.33 "GET /compute/v2.1/servers/5e984459-625e-44cd-b226-091276567215" status: 200 len: 1447 microversion: 2.75 time: 0.130610 Oct 04 20:37:34.211552 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 502/1014] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:37:34 2022] GET /compute/v2.1/servers/5e984459-625e-44cd-b226-091276567215 => generated 1447 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:37:34.228946 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-463f3189-9a9f-4ab4-866d-4cb1695aef87 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3563efe2b8c94931a2a46c4e14811b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3118a5d96843d3bede1ed94bd9717e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:34.234332 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-3f470399-2143-4e04-b568-e682bfacb7aa tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:34.235031 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-3f470399-2143-4e04-b568-e682bfacb7aa tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] [instance: 62b98bc7-657a-42c2-b501-ae4d926cfa2f] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:34.237707 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-463f3189-9a9f-4ab4-866d-4cb1695aef87 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] 10.222.0.33 "GET /compute/v2.1/servers/465ad440-a27e-4ff6-bb31-09f3545e166a" status: 200 len: 1543 microversion: 2.1 time: 0.232540 Oct 04 20:37:34.238815 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 513/1015] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:37:34 2022] GET /compute/v2.1/servers/465ad440-a27e-4ff6-bb31-09f3545e166a => generated 1543 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:37:34.241918 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3f470399-2143-4e04-b568-e682bfacb7aa tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:34.242501 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3f470399-2143-4e04-b568-e682bfacb7aa tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:34.242997 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3f470399-2143-4e04-b568-e682bfacb7aa tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:34.244025 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3f470399-2143-4e04-b568-e682bfacb7aa tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:34.244770 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3f470399-2143-4e04-b568-e682bfacb7aa tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:34.245790 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3f470399-2143-4e04-b568-e682bfacb7aa tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:34.246255 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0bc232ad-4f74-4383-9350-e4ab7a80c5c7 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:34.246922 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-0bc232ad-4f74-4383-9350-e4ab7a80c5c7 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] [instance: b3667992-a213-4da4-a172-8ab92ff3b2ca] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:34.256293 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0bc232ad-4f74-4383-9350-e4ab7a80c5c7 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:34.257338 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0bc232ad-4f74-4383-9350-e4ab7a80c5c7 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:34.257939 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0bc232ad-4f74-4383-9350-e4ab7a80c5c7 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:34.258677 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0bc232ad-4f74-4383-9350-e4ab7a80c5c7 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:34.259400 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0bc232ad-4f74-4383-9350-e4ab7a80c5c7 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:34.259825 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0bc232ad-4f74-4383-9350-e4ab7a80c5c7 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:34.289207 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-0bc232ad-4f74-4383-9350-e4ab7a80c5c7 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] [instance: b3667992-a213-4da4-a172-8ab92ff3b2ca] Going to try to terminate instance {{(pid=128801) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:37:34.382264 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-0bc232ad-4f74-4383-9350-e4ab7a80c5c7 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] 10.222.0.33 "DELETE /compute/v2.1/servers/b3667992-a213-4da4-a172-8ab92ff3b2ca" status: 204 len: 0 microversion: 2.1 time: 0.141151 Oct 04 20:37:34.383201 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 514/1016] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 20:37:34 2022] DELETE /compute/v2.1/servers/b3667992-a213-4da4-a172-8ab92ff3b2ca => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:37:34.388383 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d289d095-31e0-4750-b0f3-c1a211826466 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1958910231", "imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63", "flavorRef": "452", "networks": [{"uuid": "accbf9df-df79-4b74-a013-58a41c8806a7"}]}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:37:34.404839 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-3f470399-2143-4e04-b568-e682bfacb7aa tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '800db3a57ada47eca381b00189fdbf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66ec8ea91b04deb90b679589e0495bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:34.414554 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-3f470399-2143-4e04-b568-e682bfacb7aa tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] 10.222.0.33 "GET /compute/v2.1/servers/62b98bc7-657a-42c2-b501-ae4d926cfa2f" status: 200 len: 1310 microversion: 2.1 time: 0.201746 Oct 04 20:37:34.415421 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 503/1017] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:37:34 2022] GET /compute/v2.1/servers/62b98bc7-657a-42c2-b501-ae4d926cfa2f => generated 1310 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:37:34.434033 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-77e0f0d3-15d6-422a-b805-67ac27d89def tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:34.434687 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-77e0f0d3-15d6-422a-b805-67ac27d89def tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] [instance: b3667992-a213-4da4-a172-8ab92ff3b2ca] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:34.441521 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-77e0f0d3-15d6-422a-b805-67ac27d89def tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:34.442771 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-77e0f0d3-15d6-422a-b805-67ac27d89def tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:34.443611 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-77e0f0d3-15d6-422a-b805-67ac27d89def tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:34.444382 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-77e0f0d3-15d6-422a-b805-67ac27d89def tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:34.444904 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-77e0f0d3-15d6-422a-b805-67ac27d89def tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:34.445417 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-77e0f0d3-15d6-422a-b805-67ac27d89def tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:34.451445 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.network.neutron [None req-d289d095-31e0-4750-b0f3-c1a211826466 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] validate_networks() for [('accbf9df-df79-4b74-a013-58a41c8806a7', None, None, None, None, None)] {{(pid=128801) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:37:34.651945 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-77e0f0d3-15d6-422a-b805-67ac27d89def tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a24944aeb34a5ea228965be9bf4ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c288268acb30475bbc065a8f72cb21d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:34.660353 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-77e0f0d3-15d6-422a-b805-67ac27d89def tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] 10.222.0.33 "GET /compute/v2.1/servers/b3667992-a213-4da4-a172-8ab92ff3b2ca" status: 200 len: 1468 microversion: 2.1 time: 0.244121 Oct 04 20:37:34.661622 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 504/1018] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:37:34 2022] GET /compute/v2.1/servers/b3667992-a213-4da4-a172-8ab92ff3b2ca => generated 1468 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:37:34.928613 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-d289d095-31e0-4750-b0f3-c1a211826466 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Flavor limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:37:34.929041 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-d289d095-31e0-4750-b0f3-c1a211826466 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Image limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:37:34.929577 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-d289d095-31e0-4750-b0f3-c1a211826466 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Flavor pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:37:34.929992 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-d289d095-31e0-4750-b0f3-c1a211826466 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Image pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:37:34.930432 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-d289d095-31e0-4750-b0f3-c1a211826466 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:37:34.939847 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d289d095-31e0-4750-b0f3-c1a211826466 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:34.940270 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d289d095-31e0-4750-b0f3-c1a211826466 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:34.940698 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d289d095-31e0-4750-b0f3-c1a211826466 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:34.941422 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d289d095-31e0-4750-b0f3-c1a211826466 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:34.941874 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d289d095-31e0-4750-b0f3-c1a211826466 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:34.943335 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d289d095-31e0-4750-b0f3-c1a211826466 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:34.961403 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-d289d095-31e0-4750-b0f3-c1a211826466 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Getting quotas for project 4310eadf656d4ba88ade5714c9661488. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:37:34.965600 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-d289d095-31e0-4750-b0f3-c1a211826466 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Getting quotas for user beaac70ab9344f6c9677d6500b8b0df6 and project 4310eadf656d4ba88ade5714c9661488. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:37:34.977934 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d289d095-31e0-4750-b0f3-c1a211826466 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Going to run 1 instances... {{(pid=128801) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:37:34.980364 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d289d095-31e0-4750-b0f3-c1a211826466 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] [instance: f33c0e5c-fe2c-4379-b50a-08eb17062b91] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='15b24725-0c99-4bcf-b1fb-907cdf8e2d63',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128801) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:37:35.029559 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d289d095-31e0-4750-b0f3-c1a211826466 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 0.645146 Oct 04 20:37:35.030273 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 515/1019] 10.222.0.33 () {62 vars in 1188 bytes} [Tue Oct 4 20:37:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 646 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 04 20:37:35.042671 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-e7bfe3c0-79c0-4418-a7fd-c2351dc950c7 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:35.043379 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-e7bfe3c0-79c0-4418-a7fd-c2351dc950c7 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] [instance: f33c0e5c-fe2c-4379-b50a-08eb17062b91] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:35.046830 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell0:SELECT=6 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:37:35.093490 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell0:SELECT=6 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:37:35.118520 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-e7bfe3c0-79c0-4418-a7fd-c2351dc950c7 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:35.125928 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-e7bfe3c0-79c0-4418-a7fd-c2351dc950c7 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:35.127418 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-e7bfe3c0-79c0-4418-a7fd-c2351dc950c7 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:35.128534 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-e7bfe3c0-79c0-4418-a7fd-c2351dc950c7 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] 10.222.0.33 "GET /compute/v2.1/servers/f33c0e5c-fe2c-4379-b50a-08eb17062b91" status: 200 len: 1262 microversion: 2.25 time: 0.090444 Oct 04 20:37:35.129095 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 505/1020] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:37:35 2022] GET /compute/v2.1/servers/f33c0e5c-fe2c-4379-b50a-08eb17062b91 => generated 1262 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:37:35.240090 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d7afc7b9-1ded-4271-aae4-cc23e333a349 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:35.240711 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d7afc7b9-1ded-4271-aae4-cc23e333a349 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] [instance: 5e984459-625e-44cd-b226-091276567215] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:35.246948 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d7afc7b9-1ded-4271-aae4-cc23e333a349 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:35.247691 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d7afc7b9-1ded-4271-aae4-cc23e333a349 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:35.248131 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d7afc7b9-1ded-4271-aae4-cc23e333a349 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:35.248823 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d7afc7b9-1ded-4271-aae4-cc23e333a349 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:35.249278 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d7afc7b9-1ded-4271-aae4-cc23e333a349 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:35.249703 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d7afc7b9-1ded-4271-aae4-cc23e333a349 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:35.264021 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-520bd850-e17b-47db-a697-00a05577a788 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:35.264951 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-520bd850-e17b-47db-a697-00a05577a788 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] [instance: 465ad440-a27e-4ff6-bb31-09f3545e166a] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:35.275510 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-520bd850-e17b-47db-a697-00a05577a788 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:35.276496 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-520bd850-e17b-47db-a697-00a05577a788 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:35.276649 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:37:35.277270 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-520bd850-e17b-47db-a697-00a05577a788 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:35.278457 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-520bd850-e17b-47db-a697-00a05577a788 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:35.279117 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-520bd850-e17b-47db-a697-00a05577a788 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:35.279728 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-520bd850-e17b-47db-a697-00a05577a788 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:35.378378 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d7afc7b9-1ded-4271-aae4-cc23e333a349 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22706a9bf4d42efb57c10cbd92c6eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0024f434015447759489d3cdc7bbaa4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:35.396059 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d7afc7b9-1ded-4271-aae4-cc23e333a349 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a22706a9bf4d42efb57c10cbd92c6eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0024f434015447759489d3cdc7bbaa4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:35.397512 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d7afc7b9-1ded-4271-aae4-cc23e333a349 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a22706a9bf4d42efb57c10cbd92c6eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0024f434015447759489d3cdc7bbaa4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:35.402837 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d7afc7b9-1ded-4271-aae4-cc23e333a349 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] 10.222.0.33 "GET /compute/v2.1/servers/5e984459-625e-44cd-b226-091276567215" status: 200 len: 1447 microversion: 2.75 time: 0.167402 Oct 04 20:37:35.408162 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 516/1021] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:37:35 2022] GET /compute/v2.1/servers/5e984459-625e-44cd-b226-091276567215 => generated 1447 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:37:35.438382 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f614ed16-757d-473f-85ba-ac43be19a40c tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:35.439335 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f614ed16-757d-473f-85ba-ac43be19a40c tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] [instance: 62b98bc7-657a-42c2-b501-ae4d926cfa2f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:35.456506 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f614ed16-757d-473f-85ba-ac43be19a40c tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:35.460562 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f614ed16-757d-473f-85ba-ac43be19a40c tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:35.461334 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f614ed16-757d-473f-85ba-ac43be19a40c tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:35.462105 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f614ed16-757d-473f-85ba-ac43be19a40c tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:35.462863 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f614ed16-757d-473f-85ba-ac43be19a40c tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:35.463229 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f614ed16-757d-473f-85ba-ac43be19a40c tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:35.524039 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-520bd850-e17b-47db-a697-00a05577a788 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3563efe2b8c94931a2a46c4e14811b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3118a5d96843d3bede1ed94bd9717e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:35.545987 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-520bd850-e17b-47db-a697-00a05577a788 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] 10.222.0.33 "GET /compute/v2.1/servers/465ad440-a27e-4ff6-bb31-09f3545e166a" status: 200 len: 1543 microversion: 2.1 time: 0.276069 Oct 04 20:37:35.547060 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 506/1022] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:37:35 2022] GET /compute/v2.1/servers/465ad440-a27e-4ff6-bb31-09f3545e166a => generated 1543 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:37:35.566861 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-c64bb623-6c21-4965-b8a7-739614ab92d0 req-954b2734-3227-4561-a09c-e5262880a692 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f8cc082-0a37-4123-a680-1210a90b3ca9", "name": "network-vif-plugged", "status": "completed", "tag": "b3d1f9a5-253e-4b89-ba8b-3d8135069ec1"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:37:35.585868 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-c64bb623-6c21-4965-b8a7-739614ab92d0 req-954b2734-3227-4561-a09c-e5262880a692 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:35.586371 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-c64bb623-6c21-4965-b8a7-739614ab92d0 req-954b2734-3227-4561-a09c-e5262880a692 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:35.586790 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-c64bb623-6c21-4965-b8a7-739614ab92d0 req-954b2734-3227-4561-a09c-e5262880a692 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:35.618845 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-c64bb623-6c21-4965-b8a7-739614ab92d0 req-954b2734-3227-4561-a09c-e5262880a692 service nova] Creating event network-vif-plugged:b3d1f9a5-253e-4b89-ba8b-3d8135069ec1 for instance 9f8cc082-0a37-4123-a680-1210a90b3ca9 on n-h1-854823-8 Oct 04 20:37:35.625160 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-c64bb623-6c21-4965-b8a7-739614ab92d0 req-954b2734-3227-4561-a09c-e5262880a692 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062193 Oct 04 20:37:35.626275 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 507/1023] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:37:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 20:37:35.685061 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-1df5d143-686f-459a-bf98-ca29f823e8a1 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:35.686164 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-1df5d143-686f-459a-bf98-ca29f823e8a1 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] [instance: b3667992-a213-4da4-a172-8ab92ff3b2ca] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:35.694281 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1df5d143-686f-459a-bf98-ca29f823e8a1 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:35.694814 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1df5d143-686f-459a-bf98-ca29f823e8a1 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:35.695445 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1df5d143-686f-459a-bf98-ca29f823e8a1 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:35.695955 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1df5d143-686f-459a-bf98-ca29f823e8a1 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:35.696406 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1df5d143-686f-459a-bf98-ca29f823e8a1 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:35.696833 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1df5d143-686f-459a-bf98-ca29f823e8a1 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:35.726276 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f614ed16-757d-473f-85ba-ac43be19a40c tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '800db3a57ada47eca381b00189fdbf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66ec8ea91b04deb90b679589e0495bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:35.736831 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f614ed16-757d-473f-85ba-ac43be19a40c tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] 10.222.0.33 "GET /compute/v2.1/servers/62b98bc7-657a-42c2-b501-ae4d926cfa2f" status: 200 len: 1310 microversion: 2.1 time: 0.302506 Oct 04 20:37:35.737526 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 517/1024] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:37:35 2022] GET /compute/v2.1/servers/62b98bc7-657a-42c2-b501-ae4d926cfa2f => generated 1310 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:37:35.854027 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-1df5d143-686f-459a-bf98-ca29f823e8a1 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a24944aeb34a5ea228965be9bf4ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c288268acb30475bbc065a8f72cb21d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:35.865532 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-1df5d143-686f-459a-bf98-ca29f823e8a1 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] 10.222.0.33 "GET /compute/v2.1/servers/b3667992-a213-4da4-a172-8ab92ff3b2ca" status: 200 len: 1468 microversion: 2.1 time: 0.185037 Oct 04 20:37:35.866276 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 508/1025] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:37:35 2022] GET /compute/v2.1/servers/b3667992-a213-4da4-a172-8ab92ff3b2ca => generated 1468 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:37:36.154310 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b1a78e09-55bf-48a2-9339-2a3656597364 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:36.155097 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b1a78e09-55bf-48a2-9339-2a3656597364 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] [instance: f33c0e5c-fe2c-4379-b50a-08eb17062b91] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:36.162524 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b1a78e09-55bf-48a2-9339-2a3656597364 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:36.163015 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b1a78e09-55bf-48a2-9339-2a3656597364 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:36.163448 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b1a78e09-55bf-48a2-9339-2a3656597364 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:36.164321 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b1a78e09-55bf-48a2-9339-2a3656597364 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:36.165719 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b1a78e09-55bf-48a2-9339-2a3656597364 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:36.166714 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b1a78e09-55bf-48a2-9339-2a3656597364 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:36.241023 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-b1a78e09-55bf-48a2-9339-2a3656597364 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:36.250238 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-b1a78e09-55bf-48a2-9339-2a3656597364 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:36.251809 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-b1a78e09-55bf-48a2-9339-2a3656597364 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:36.252975 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b1a78e09-55bf-48a2-9339-2a3656597364 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] 10.222.0.33 "GET /compute/v2.1/servers/f33c0e5c-fe2c-4379-b50a-08eb17062b91" status: 200 len: 1314 microversion: 2.25 time: 0.102688 Oct 04 20:37:36.266712 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 518/1026] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:37:36 2022] GET /compute/v2.1/servers/f33c0e5c-fe2c-4379-b50a-08eb17062b91 => generated 1314 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:37:36.436891 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-095263a8-ad24-4abe-ae21-ca409a1f9591 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:36.437787 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-095263a8-ad24-4abe-ae21-ca409a1f9591 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] [instance: 5e984459-625e-44cd-b226-091276567215] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:36.445381 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-095263a8-ad24-4abe-ae21-ca409a1f9591 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:36.445967 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-095263a8-ad24-4abe-ae21-ca409a1f9591 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:36.446431 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-095263a8-ad24-4abe-ae21-ca409a1f9591 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:36.447137 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-095263a8-ad24-4abe-ae21-ca409a1f9591 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:36.447587 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-095263a8-ad24-4abe-ae21-ca409a1f9591 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:36.448008 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-095263a8-ad24-4abe-ae21-ca409a1f9591 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:36.523069 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-095263a8-ad24-4abe-ae21-ca409a1f9591 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22706a9bf4d42efb57c10cbd92c6eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0024f434015447759489d3cdc7bbaa4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:36.533545 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-095263a8-ad24-4abe-ae21-ca409a1f9591 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a22706a9bf4d42efb57c10cbd92c6eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0024f434015447759489d3cdc7bbaa4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:36.535330 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-095263a8-ad24-4abe-ae21-ca409a1f9591 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a22706a9bf4d42efb57c10cbd92c6eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0024f434015447759489d3cdc7bbaa4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:36.544243 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-095263a8-ad24-4abe-ae21-ca409a1f9591 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] 10.222.0.33 "GET /compute/v2.1/servers/5e984459-625e-44cd-b226-091276567215" status: 200 len: 1447 microversion: 2.75 time: 0.111084 Oct 04 20:37:36.557857 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 509/1027] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:37:36 2022] GET /compute/v2.1/servers/5e984459-625e-44cd-b226-091276567215 => generated 1447 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:37:36.569942 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-222ff9ba-f414-48d9-8fa5-3f9d6c8e114d tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:36.572572 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-222ff9ba-f414-48d9-8fa5-3f9d6c8e114d tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] [instance: 465ad440-a27e-4ff6-bb31-09f3545e166a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:36.579518 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-222ff9ba-f414-48d9-8fa5-3f9d6c8e114d tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:36.580004 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-222ff9ba-f414-48d9-8fa5-3f9d6c8e114d tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:36.580460 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-222ff9ba-f414-48d9-8fa5-3f9d6c8e114d tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:36.581196 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-222ff9ba-f414-48d9-8fa5-3f9d6c8e114d tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:36.581911 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-222ff9ba-f414-48d9-8fa5-3f9d6c8e114d tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:36.582608 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-222ff9ba-f414-48d9-8fa5-3f9d6c8e114d tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:36.762280 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-17de593b-7aa0-4c18-9a04-b1f93b43ff9b tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:36.764016 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-17de593b-7aa0-4c18-9a04-b1f93b43ff9b tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] [instance: 62b98bc7-657a-42c2-b501-ae4d926cfa2f] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:36.785140 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-17de593b-7aa0-4c18-9a04-b1f93b43ff9b tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:36.787358 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-17de593b-7aa0-4c18-9a04-b1f93b43ff9b tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:36.788236 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-17de593b-7aa0-4c18-9a04-b1f93b43ff9b tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:36.789450 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-17de593b-7aa0-4c18-9a04-b1f93b43ff9b tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:36.790758 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-17de593b-7aa0-4c18-9a04-b1f93b43ff9b tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:36.796160 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-17de593b-7aa0-4c18-9a04-b1f93b43ff9b tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:37.030657 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-222ff9ba-f414-48d9-8fa5-3f9d6c8e114d tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3563efe2b8c94931a2a46c4e14811b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3118a5d96843d3bede1ed94bd9717e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:37.040657 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-222ff9ba-f414-48d9-8fa5-3f9d6c8e114d tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] 10.222.0.33 "GET /compute/v2.1/servers/465ad440-a27e-4ff6-bb31-09f3545e166a" status: 200 len: 1543 microversion: 2.1 time: 0.475142 Oct 04 20:37:37.045098 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 519/1028] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:37:36 2022] GET /compute/v2.1/servers/465ad440-a27e-4ff6-bb31-09f3545e166a => generated 1543 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:37:37.050629 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f112e243-c593-4246-b68c-2a679b883914 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:37.051539 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f112e243-c593-4246-b68c-2a679b883914 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] [instance: b3667992-a213-4da4-a172-8ab92ff3b2ca] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:37.059389 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f112e243-c593-4246-b68c-2a679b883914 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:37.060479 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f112e243-c593-4246-b68c-2a679b883914 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:37.061147 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f112e243-c593-4246-b68c-2a679b883914 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:37.062092 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f112e243-c593-4246-b68c-2a679b883914 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:37.063052 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f112e243-c593-4246-b68c-2a679b883914 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:37.063690 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f112e243-c593-4246-b68c-2a679b883914 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:37.259165 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-17de593b-7aa0-4c18-9a04-b1f93b43ff9b tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '800db3a57ada47eca381b00189fdbf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66ec8ea91b04deb90b679589e0495bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:37.267853 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-17de593b-7aa0-4c18-9a04-b1f93b43ff9b tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] 10.222.0.33 "GET /compute/v2.1/servers/62b98bc7-657a-42c2-b501-ae4d926cfa2f" status: 200 len: 1310 microversion: 2.1 time: 0.510806 Oct 04 20:37:37.269426 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 510/1029] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:37:36 2022] GET /compute/v2.1/servers/62b98bc7-657a-42c2-b501-ae4d926cfa2f => generated 1310 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:37:37.279540 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-4aee85f4-e521-4111-aa9a-21e74c423c0a tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:37.280560 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-4aee85f4-e521-4111-aa9a-21e74c423c0a tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] [instance: f33c0e5c-fe2c-4379-b50a-08eb17062b91] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:37.303005 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4aee85f4-e521-4111-aa9a-21e74c423c0a tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:37.303822 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4aee85f4-e521-4111-aa9a-21e74c423c0a tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:37.304452 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4aee85f4-e521-4111-aa9a-21e74c423c0a tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:37.305525 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4aee85f4-e521-4111-aa9a-21e74c423c0a tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:37.306183 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4aee85f4-e521-4111-aa9a-21e74c423c0a tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:37.306862 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4aee85f4-e521-4111-aa9a-21e74c423c0a tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:37.313296 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f112e243-c593-4246-b68c-2a679b883914 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a24944aeb34a5ea228965be9bf4ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c288268acb30475bbc065a8f72cb21d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:37.324791 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f112e243-c593-4246-b68c-2a679b883914 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] 10.222.0.33 "GET /compute/v2.1/servers/b3667992-a213-4da4-a172-8ab92ff3b2ca" status: 200 len: 1468 microversion: 2.1 time: 0.278236 Oct 04 20:37:37.325739 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 520/1030] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:37:37 2022] GET /compute/v2.1/servers/b3667992-a213-4da4-a172-8ab92ff3b2ca => generated 1468 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:37:37.437260 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-7a9bcf51-5b92-400e-9371-c10eb88c6e71 req-acde8008-c7ed-4877-b556-450a1f4b47af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3667992-a213-4da4-a172-8ab92ff3b2ca", "name": "network-vif-deleted", "tag": "e5b970a5-881c-4fd8-852b-0dc92a104d9a"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:37:37.450848 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-7a9bcf51-5b92-400e-9371-c10eb88c6e71 req-acde8008-c7ed-4877-b556-450a1f4b47af service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:37.452282 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-7a9bcf51-5b92-400e-9371-c10eb88c6e71 req-acde8008-c7ed-4877-b556-450a1f4b47af service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:37.452896 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-7a9bcf51-5b92-400e-9371-c10eb88c6e71 req-acde8008-c7ed-4877-b556-450a1f4b47af service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:37.460651 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-4aee85f4-e521-4111-aa9a-21e74c423c0a tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:37.469733 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-7a9bcf51-5b92-400e-9371-c10eb88c6e71 req-acde8008-c7ed-4877-b556-450a1f4b47af service nova] Creating event network-vif-deleted:e5b970a5-881c-4fd8-852b-0dc92a104d9a for instance b3667992-a213-4da4-a172-8ab92ff3b2ca on n-h1-854823-8 Oct 04 20:37:37.478153 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-7a9bcf51-5b92-400e-9371-c10eb88c6e71 req-acde8008-c7ed-4877-b556-450a1f4b47af service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044410 Oct 04 20:37:37.480906 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-4aee85f4-e521-4111-aa9a-21e74c423c0a tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:37.483450 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-4aee85f4-e521-4111-aa9a-21e74c423c0a tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:37.484145 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 521/1031] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:37:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 20:37:37.486331 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-4aee85f4-e521-4111-aa9a-21e74c423c0a tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] 10.222.0.33 "GET /compute/v2.1/servers/f33c0e5c-fe2c-4379-b50a-08eb17062b91" status: 200 len: 1320 microversion: 2.25 time: 0.212185 Oct 04 20:37:37.486924 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 511/1032] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:37:37 2022] GET /compute/v2.1/servers/f33c0e5c-fe2c-4379-b50a-08eb17062b91 => generated 1320 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:37:37.578068 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d3214ba1-ed04-4e31-92cb-c58290317ae4 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:37.578981 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d3214ba1-ed04-4e31-92cb-c58290317ae4 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] [instance: 5e984459-625e-44cd-b226-091276567215] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:37.593140 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d3214ba1-ed04-4e31-92cb-c58290317ae4 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:37.593755 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d3214ba1-ed04-4e31-92cb-c58290317ae4 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:37.594701 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d3214ba1-ed04-4e31-92cb-c58290317ae4 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:37.595701 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d3214ba1-ed04-4e31-92cb-c58290317ae4 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:37.596346 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d3214ba1-ed04-4e31-92cb-c58290317ae4 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:37.597105 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d3214ba1-ed04-4e31-92cb-c58290317ae4 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:37.705980 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d3214ba1-ed04-4e31-92cb-c58290317ae4 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22706a9bf4d42efb57c10cbd92c6eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0024f434015447759489d3cdc7bbaa4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:37.717148 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d3214ba1-ed04-4e31-92cb-c58290317ae4 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a22706a9bf4d42efb57c10cbd92c6eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0024f434015447759489d3cdc7bbaa4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:37.721381 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d3214ba1-ed04-4e31-92cb-c58290317ae4 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a22706a9bf4d42efb57c10cbd92c6eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0024f434015447759489d3cdc7bbaa4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:37.728862 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d3214ba1-ed04-4e31-92cb-c58290317ae4 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] 10.222.0.33 "GET /compute/v2.1/servers/5e984459-625e-44cd-b226-091276567215" status: 200 len: 1447 microversion: 2.75 time: 0.158525 Oct 04 20:37:37.730100 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 522/1033] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:37:37 2022] GET /compute/v2.1/servers/5e984459-625e-44cd-b226-091276567215 => generated 1447 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:37:38.065942 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-0095c3b2-7fd1-4960-b573-4bd5db9266da tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:38.066622 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-0095c3b2-7fd1-4960-b573-4bd5db9266da tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] [instance: 465ad440-a27e-4ff6-bb31-09f3545e166a] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:38.079780 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0095c3b2-7fd1-4960-b573-4bd5db9266da tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:38.080552 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0095c3b2-7fd1-4960-b573-4bd5db9266da tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:38.081110 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0095c3b2-7fd1-4960-b573-4bd5db9266da tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:38.084524 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0095c3b2-7fd1-4960-b573-4bd5db9266da tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:38.085004 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0095c3b2-7fd1-4960-b573-4bd5db9266da tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:38.085437 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0095c3b2-7fd1-4960-b573-4bd5db9266da tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:38.293922 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-4d687895-f069-42e0-9e70-98ccbc43a033 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:38.295783 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-4d687895-f069-42e0-9e70-98ccbc43a033 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] [instance: 62b98bc7-657a-42c2-b501-ae4d926cfa2f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:38.310335 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4d687895-f069-42e0-9e70-98ccbc43a033 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:38.311367 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4d687895-f069-42e0-9e70-98ccbc43a033 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:38.311815 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4d687895-f069-42e0-9e70-98ccbc43a033 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:38.315679 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4d687895-f069-42e0-9e70-98ccbc43a033 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:38.316813 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4d687895-f069-42e0-9e70-98ccbc43a033 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:38.318362 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4d687895-f069-42e0-9e70-98ccbc43a033 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:38.390679 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-0095c3b2-7fd1-4960-b573-4bd5db9266da tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3563efe2b8c94931a2a46c4e14811b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3118a5d96843d3bede1ed94bd9717e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:38.400585 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-0095c3b2-7fd1-4960-b573-4bd5db9266da tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] 10.222.0.33 "GET /compute/v2.1/servers/465ad440-a27e-4ff6-bb31-09f3545e166a" status: 200 len: 1543 microversion: 2.1 time: 0.340142 Oct 04 20:37:38.402239 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 512/1034] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:37:38 2022] GET /compute/v2.1/servers/465ad440-a27e-4ff6-bb31-09f3545e166a => generated 1543 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:37:38.407650 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-8d5f5f88-baf5-49c4-84a1-1f773c471be9 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:38.408347 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-8d5f5f88-baf5-49c4-84a1-1f773c471be9 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] [instance: b3667992-a213-4da4-a172-8ab92ff3b2ca] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:38.415295 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8d5f5f88-baf5-49c4-84a1-1f773c471be9 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:38.415866 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8d5f5f88-baf5-49c4-84a1-1f773c471be9 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:38.416543 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8d5f5f88-baf5-49c4-84a1-1f773c471be9 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:38.417323 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8d5f5f88-baf5-49c4-84a1-1f773c471be9 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:38.417933 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8d5f5f88-baf5-49c4-84a1-1f773c471be9 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:38.418667 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8d5f5f88-baf5-49c4-84a1-1f773c471be9 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:38.434153 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.wsgi [None req-8d5f5f88-baf5-49c4-84a1-1f773c471be9 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] HTTP exception thrown: Instance b3667992-a213-4da4-a172-8ab92ff3b2ca could not be found. Oct 04 20:37:38.436248 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-8d5f5f88-baf5-49c4-84a1-1f773c471be9 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Request method failure captured: Oct 04 20:37:38.436248 n-d-854823-8 devstack@n-api.service[128802]: request: GET /compute/v2.1/servers/b3667992-a213-4da4-a172-8ab92ff3b2ca HTTP/1.1 Oct 04 20:37:38.436248 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 20:37:38.436248 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 20:37:38.436248 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 20:37:38.436248 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 0 Oct 04 20:37:38.436248 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 20:37:38.436248 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 20:37:38.436248 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 20:37:38.436248 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 20:37:38.436248 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPJj70pkEpfnn_riq2CJ3vbhS6uwqsmbInkczI4lwy7f-ypfW2zouEJzhVZnu6kmdfqJN8C6tm0Ejbx97ATlFhUoiOhWMbM6AcAQ9UgYSMPkh7Ybe2Gw_g9qL7w6T9EsDeNcxyJWqy6WAuAaUdTLbDnmujDsKYea49AZgSbg2L-Kungw Oct 04 20:37:38.436248 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 20:37:38.436248 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 20:37:38.436248 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 20:37:38.436248 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 20:37:38.436248 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 20:37:38.436248 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 20:37:38.436248 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: c288268acb30475bbc065a8f72cb21d5 Oct 04 20:37:38.436248 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-ServersAdminTestJSON-1951935148 Oct 04 20:37:38.436248 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 20:37:38.436248 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 20:37:38.436248 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_c288268acb30475bbc065a8f72cb21d5", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c288268acb30475bbc065a8f72cb21d5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c288268acb30475bbc065a8f72cb21d5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/c288268acb30475bbc065a8f72cb21d5"}]}] Oct 04 20:37:38.436248 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-ServersAdminTestJSON-1951935148 Oct 04 20:37:38.436248 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: c288268acb30475bbc065a8f72cb21d5 Oct 04 20:37:38.436248 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-ServersAdminTestJSON-1951935148 Oct 04 20:37:38.436248 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-ServersAdminTestJSON-1951935148-project Oct 04 20:37:38.436248 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 20:37:38.436248 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 20:37:38.436248 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: b4a24944aeb34a5ea228965be9bf4ce0 Oct 04 20:37:38.436248 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-ServersAdminTestJSON-1951935148-project Oct 04 20:37:38.436248 n-d-854823-8 devstack@n-api.service[128802]: method: > Oct 04 20:37:38.436248 n-d-854823-8 devstack@n-api.service[128802]: exception: Instance b3667992-a213-4da4-a172-8ab92ff3b2ca could not be found. Oct 04 20:37:38.436248 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'id': 'b3667992-a213-4da4-a172-8ab92ff3b2ca'} Oct 04 20:37:38.436248 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:37:38.436248 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:37:38.436248 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:37:38.436248 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:37:38.436248 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:37:38.436248 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:37:38.436248 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:37:38.436248 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:37:38.436248 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:37:38.436248 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:37:38.436248 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b3667992-a213-4da4-a172-8ab92ff3b2ca could not be found. Oct 04 20:37:38.436248 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:37:38.436248 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:37:38.436248 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:37:38.436248 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:37:38.436248 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:37:38.436248 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:37:38.436248 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:37:38.436248 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:37:38.436248 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:37:38.436248 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:37:38.436248 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:37:38.436248 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:37:38.436248 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:37:38.436248 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:37:38.436248 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:37:38.436248 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:37:38.436248 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b3667992-a213-4da4-a172-8ab92ff3b2ca could not be found. Oct 04 20:37:38.436248 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:37:38.436248 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:37:38.436248 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:37:38.441691 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:37:38.441691 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:37:38.441691 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:37:38.441691 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:37:38.441691 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:37:38.441691 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b3667992-a213-4da4-a172-8ab92ff3b2ca could not be found. Oct 04 20:37:38.441691 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:37:38.444071 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-8d5f5f88-baf5-49c4-84a1-1f773c471be9 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Returning 404 to user: Instance b3667992-a213-4da4-a172-8ab92ff3b2ca could not be found. {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:37:38.445191 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-8d5f5f88-baf5-49c4-84a1-1f773c471be9 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] 10.222.0.33 "GET /compute/v2.1/servers/b3667992-a213-4da4-a172-8ab92ff3b2ca" status: 404 len: 111 microversion: 2.1 time: 0.041590 Oct 04 20:37:38.445996 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 513/1035] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:37:38 2022] GET /compute/v2.1/servers/b3667992-a213-4da4-a172-8ab92ff3b2ca => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:37:38.455735 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-e5f3db67-0591-42b7-9c2b-e9f04f838e70 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:38.456565 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-e5f3db67-0591-42b7-9c2b-e9f04f838e70 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] [instance: 1c6ffc0f-3aaa-41f8-9a9a-0040295fe064] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:38.465851 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e5f3db67-0591-42b7-9c2b-e9f04f838e70 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:38.467169 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e5f3db67-0591-42b7-9c2b-e9f04f838e70 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:38.467822 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e5f3db67-0591-42b7-9c2b-e9f04f838e70 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:38.468634 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e5f3db67-0591-42b7-9c2b-e9f04f838e70 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:38.469335 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e5f3db67-0591-42b7-9c2b-e9f04f838e70 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:38.469964 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e5f3db67-0591-42b7-9c2b-e9f04f838e70 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:38.501978 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-e5f3db67-0591-42b7-9c2b-e9f04f838e70 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] [instance: 1c6ffc0f-3aaa-41f8-9a9a-0040295fe064] Going to try to terminate instance {{(pid=128802) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:37:38.610364 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-e5f3db67-0591-42b7-9c2b-e9f04f838e70 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] 10.222.0.33 "DELETE /compute/v2.1/servers/1c6ffc0f-3aaa-41f8-9a9a-0040295fe064" status: 204 len: 0 microversion: 2.1 time: 0.156449 Oct 04 20:37:38.612054 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 514/1036] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 20:37:38 2022] DELETE /compute/v2.1/servers/1c6ffc0f-3aaa-41f8-9a9a-0040295fe064 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:37:38.625297 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-a31b26b7-6111-454d-bf6c-32017ccae399 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:38.626311 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-a31b26b7-6111-454d-bf6c-32017ccae399 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] [instance: f33c0e5c-fe2c-4379-b50a-08eb17062b91] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:38.634172 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a31b26b7-6111-454d-bf6c-32017ccae399 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:38.634691 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a31b26b7-6111-454d-bf6c-32017ccae399 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:38.635475 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a31b26b7-6111-454d-bf6c-32017ccae399 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:38.636387 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a31b26b7-6111-454d-bf6c-32017ccae399 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:38.637020 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a31b26b7-6111-454d-bf6c-32017ccae399 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:38.637616 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a31b26b7-6111-454d-bf6c-32017ccae399 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:38.648890 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-4d687895-f069-42e0-9e70-98ccbc43a033 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '800db3a57ada47eca381b00189fdbf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66ec8ea91b04deb90b679589e0495bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:38.659744 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-4d687895-f069-42e0-9e70-98ccbc43a033 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] 10.222.0.33 "GET /compute/v2.1/servers/62b98bc7-657a-42c2-b501-ae4d926cfa2f" status: 200 len: 1310 microversion: 2.1 time: 0.369369 Oct 04 20:37:38.663189 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 523/1037] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:37:38 2022] GET /compute/v2.1/servers/62b98bc7-657a-42c2-b501-ae4d926cfa2f => generated 1310 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:37:38.668793 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-4f4ca82c-a4c0-4ff6-a4d2-59ac14f8ecac tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:38.670285 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-4f4ca82c-a4c0-4ff6-a4d2-59ac14f8ecac tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] [instance: 1c6ffc0f-3aaa-41f8-9a9a-0040295fe064] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:38.683727 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4f4ca82c-a4c0-4ff6-a4d2-59ac14f8ecac tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:38.684887 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4f4ca82c-a4c0-4ff6-a4d2-59ac14f8ecac tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:38.685535 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4f4ca82c-a4c0-4ff6-a4d2-59ac14f8ecac tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:38.686527 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4f4ca82c-a4c0-4ff6-a4d2-59ac14f8ecac tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:38.687144 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4f4ca82c-a4c0-4ff6-a4d2-59ac14f8ecac tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:38.687867 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4f4ca82c-a4c0-4ff6-a4d2-59ac14f8ecac tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:38.975939 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-a31b26b7-6111-454d-bf6c-32017ccae399 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:38.986302 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-a31b26b7-6111-454d-bf6c-32017ccae399 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:38.987837 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-a31b26b7-6111-454d-bf6c-32017ccae399 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:38.989246 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-a31b26b7-6111-454d-bf6c-32017ccae399 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] 10.222.0.33 "GET /compute/v2.1/servers/f33c0e5c-fe2c-4379-b50a-08eb17062b91" status: 200 len: 1362 microversion: 2.25 time: 0.372372 Oct 04 20:37:38.989815 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 515/1038] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:37:38 2022] GET /compute/v2.1/servers/f33c0e5c-fe2c-4379-b50a-08eb17062b91 => generated 1362 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:37:38.994743 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-176e9b35-0de3-4bfe-adf3-9dc927ed85ca tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:38.995344 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-176e9b35-0de3-4bfe-adf3-9dc927ed85ca tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] [instance: 5e984459-625e-44cd-b226-091276567215] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:39.001587 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-176e9b35-0de3-4bfe-adf3-9dc927ed85ca tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:39.002328 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-176e9b35-0de3-4bfe-adf3-9dc927ed85ca tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:39.002650 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-176e9b35-0de3-4bfe-adf3-9dc927ed85ca tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:39.003345 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-176e9b35-0de3-4bfe-adf3-9dc927ed85ca tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:39.004104 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-176e9b35-0de3-4bfe-adf3-9dc927ed85ca tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:39.004216 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-176e9b35-0de3-4bfe-adf3-9dc927ed85ca tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:39.012744 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-4f4ca82c-a4c0-4ff6-a4d2-59ac14f8ecac tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a24944aeb34a5ea228965be9bf4ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c288268acb30475bbc065a8f72cb21d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:39.021442 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-4f4ca82c-a4c0-4ff6-a4d2-59ac14f8ecac tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] 10.222.0.33 "GET /compute/v2.1/servers/1c6ffc0f-3aaa-41f8-9a9a-0040295fe064" status: 200 len: 1468 microversion: 2.1 time: 0.356578 Oct 04 20:37:39.022508 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 524/1039] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:37:38 2022] GET /compute/v2.1/servers/1c6ffc0f-3aaa-41f8-9a9a-0040295fe064 => generated 1468 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:37:39.105989 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-176e9b35-0de3-4bfe-adf3-9dc927ed85ca tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22706a9bf4d42efb57c10cbd92c6eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0024f434015447759489d3cdc7bbaa4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:39.116536 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-176e9b35-0de3-4bfe-adf3-9dc927ed85ca tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a22706a9bf4d42efb57c10cbd92c6eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0024f434015447759489d3cdc7bbaa4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:39.118173 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-176e9b35-0de3-4bfe-adf3-9dc927ed85ca tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a22706a9bf4d42efb57c10cbd92c6eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0024f434015447759489d3cdc7bbaa4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:39.124576 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-176e9b35-0de3-4bfe-adf3-9dc927ed85ca tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] 10.222.0.33 "GET /compute/v2.1/servers/5e984459-625e-44cd-b226-091276567215" status: 200 len: 1447 microversion: 2.75 time: 0.133636 Oct 04 20:37:39.125427 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 516/1040] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:37:38 2022] GET /compute/v2.1/servers/5e984459-625e-44cd-b226-091276567215 => generated 1447 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:37:39.309221 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-657ad841-6d7f-433e-bba9-b2ace937d202 req-de924fc7-5545-4591-9638-20e9c26883f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f33c0e5c-fe2c-4379-b50a-08eb17062b91", "tag": "619319cb-49b8-4e19-a3ae-04ba59d88700"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:37:39.325825 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-657ad841-6d7f-433e-bba9-b2ace937d202 req-de924fc7-5545-4591-9638-20e9c26883f8 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:39.327056 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-657ad841-6d7f-433e-bba9-b2ace937d202 req-de924fc7-5545-4591-9638-20e9c26883f8 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:39.327737 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-657ad841-6d7f-433e-bba9-b2ace937d202 req-de924fc7-5545-4591-9638-20e9c26883f8 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:39.341529 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-657ad841-6d7f-433e-bba9-b2ace937d202 req-de924fc7-5545-4591-9638-20e9c26883f8 service nova] Creating event network-changed:619319cb-49b8-4e19-a3ae-04ba59d88700 for instance f33c0e5c-fe2c-4379-b50a-08eb17062b91 on n-h2-854823-8 Oct 04 20:37:39.347129 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-657ad841-6d7f-433e-bba9-b2ace937d202 req-de924fc7-5545-4591-9638-20e9c26883f8 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041601 Oct 04 20:37:39.348411 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 525/1041] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:37:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:37:39.424599 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-f13b22ff-5095-4744-a662-857468667ecd tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:39.425167 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-f13b22ff-5095-4744-a662-857468667ecd tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] [instance: 465ad440-a27e-4ff6-bb31-09f3545e166a] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:39.427336 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:37:39.434019 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f13b22ff-5095-4744-a662-857468667ecd tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:39.434528 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f13b22ff-5095-4744-a662-857468667ecd tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:39.434962 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f13b22ff-5095-4744-a662-857468667ecd tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:39.435655 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f13b22ff-5095-4744-a662-857468667ecd tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:39.436107 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f13b22ff-5095-4744-a662-857468667ecd tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:39.436514 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f13b22ff-5095-4744-a662-857468667ecd tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:39.512736 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-3ed977f0-a449-455e-aa57-66b9d51725b3 req-eb319e6d-73f3-4617-accb-4bb3ded2fd1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62b98bc7-657a-42c2-b501-ae4d926cfa2f", "name": "network-vif-plugged", "status": "completed", "tag": "7e9ad1e9-b4f0-48a2-b19c-30f06d92c931"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:37:39.530221 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-3ed977f0-a449-455e-aa57-66b9d51725b3 req-eb319e6d-73f3-4617-accb-4bb3ded2fd1c service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:39.531449 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-3ed977f0-a449-455e-aa57-66b9d51725b3 req-eb319e6d-73f3-4617-accb-4bb3ded2fd1c service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:39.532242 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-3ed977f0-a449-455e-aa57-66b9d51725b3 req-eb319e6d-73f3-4617-accb-4bb3ded2fd1c service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:39.546711 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-3ed977f0-a449-455e-aa57-66b9d51725b3 req-eb319e6d-73f3-4617-accb-4bb3ded2fd1c service nova] Creating event network-vif-plugged:7e9ad1e9-b4f0-48a2-b19c-30f06d92c931 for instance 62b98bc7-657a-42c2-b501-ae4d926cfa2f on n-h1-854823-8 Oct 04 20:37:39.554556 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-3ed977f0-a449-455e-aa57-66b9d51725b3 req-eb319e6d-73f3-4617-accb-4bb3ded2fd1c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047295 Oct 04 20:37:39.555655 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 526/1042] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:37:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 20:37:39.601935 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-f13b22ff-5095-4744-a662-857468667ecd tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3563efe2b8c94931a2a46c4e14811b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3118a5d96843d3bede1ed94bd9717e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:39.611607 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-f13b22ff-5095-4744-a662-857468667ecd tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] 10.222.0.33 "GET /compute/v2.1/servers/465ad440-a27e-4ff6-bb31-09f3545e166a" status: 200 len: 1543 microversion: 2.1 time: 0.190721 Oct 04 20:37:39.627540 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 517/1043] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:37:39 2022] GET /compute/v2.1/servers/465ad440-a27e-4ff6-bb31-09f3545e166a => generated 1543 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:37:39.687221 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-990aeea1-fe58-4c5b-9f88-5296b9bef401 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:39.688113 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-990aeea1-fe58-4c5b-9f88-5296b9bef401 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] [instance: 62b98bc7-657a-42c2-b501-ae4d926cfa2f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:39.695288 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-990aeea1-fe58-4c5b-9f88-5296b9bef401 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:39.695492 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-990aeea1-fe58-4c5b-9f88-5296b9bef401 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:39.696023 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-990aeea1-fe58-4c5b-9f88-5296b9bef401 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:39.699623 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-990aeea1-fe58-4c5b-9f88-5296b9bef401 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:39.700498 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-990aeea1-fe58-4c5b-9f88-5296b9bef401 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:39.701251 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-990aeea1-fe58-4c5b-9f88-5296b9bef401 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:39.840269 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-990aeea1-fe58-4c5b-9f88-5296b9bef401 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '800db3a57ada47eca381b00189fdbf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66ec8ea91b04deb90b679589e0495bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:39.850043 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-990aeea1-fe58-4c5b-9f88-5296b9bef401 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] 10.222.0.33 "GET /compute/v2.1/servers/62b98bc7-657a-42c2-b501-ae4d926cfa2f" status: 200 len: 1310 microversion: 2.1 time: 0.168500 Oct 04 20:37:39.857696 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 527/1044] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:37:39 2022] GET /compute/v2.1/servers/62b98bc7-657a-42c2-b501-ae4d926cfa2f => generated 1310 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:37:40.014681 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-0b05b449-adf5-4775-be32-749a4e5f6f42 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:40.015556 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-0b05b449-adf5-4775-be32-749a4e5f6f42 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] [instance: f33c0e5c-fe2c-4379-b50a-08eb17062b91] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:40.023382 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0b05b449-adf5-4775-be32-749a4e5f6f42 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:40.024001 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0b05b449-adf5-4775-be32-749a4e5f6f42 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:40.024539 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0b05b449-adf5-4775-be32-749a4e5f6f42 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:40.025676 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0b05b449-adf5-4775-be32-749a4e5f6f42 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:40.026324 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0b05b449-adf5-4775-be32-749a4e5f6f42 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:40.026780 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0b05b449-adf5-4775-be32-749a4e5f6f42 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:40.047833 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2dc67a18-d241-4f53-9353-134e19e4b94a tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:40.048580 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-2dc67a18-d241-4f53-9353-134e19e4b94a tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] [instance: 1c6ffc0f-3aaa-41f8-9a9a-0040295fe064] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:40.054835 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2dc67a18-d241-4f53-9353-134e19e4b94a tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:40.055327 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2dc67a18-d241-4f53-9353-134e19e4b94a tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:40.056312 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2dc67a18-d241-4f53-9353-134e19e4b94a tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:40.057017 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2dc67a18-d241-4f53-9353-134e19e4b94a tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:40.057464 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2dc67a18-d241-4f53-9353-134e19e4b94a tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:40.057884 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2dc67a18-d241-4f53-9353-134e19e4b94a tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:40.241539 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-0b05b449-adf5-4775-be32-749a4e5f6f42 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:40.244312 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:37:40.248145 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-2dc67a18-d241-4f53-9353-134e19e4b94a tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a24944aeb34a5ea228965be9bf4ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c288268acb30475bbc065a8f72cb21d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:40.253065 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-0b05b449-adf5-4775-be32-749a4e5f6f42 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:40.255337 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-0b05b449-adf5-4775-be32-749a4e5f6f42 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:40.256841 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-0b05b449-adf5-4775-be32-749a4e5f6f42 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] 10.222.0.33 "GET /compute/v2.1/servers/f33c0e5c-fe2c-4379-b50a-08eb17062b91" status: 200 len: 1362 microversion: 2.25 time: 0.246464 Oct 04 20:37:40.257069 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-2dc67a18-d241-4f53-9353-134e19e4b94a tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] 10.222.0.33 "GET /compute/v2.1/servers/1c6ffc0f-3aaa-41f8-9a9a-0040295fe064" status: 200 len: 1468 microversion: 2.1 time: 0.213109 Oct 04 20:37:40.274379 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 528/1045] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:37:40 2022] GET /compute/v2.1/servers/1c6ffc0f-3aaa-41f8-9a9a-0040295fe064 => generated 1468 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:37:40.274591 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 518/1046] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:37:40 2022] GET /compute/v2.1/servers/f33c0e5c-fe2c-4379-b50a-08eb17062b91 => generated 1362 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 20:37:40.274725 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-51038128-a3a0-4aa1-aae7-f4c20feb9b69 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:40.274725 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-51038128-a3a0-4aa1-aae7-f4c20feb9b69 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] [instance: 5e984459-625e-44cd-b226-091276567215] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:40.274725 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-51038128-a3a0-4aa1-aae7-f4c20feb9b69 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:40.275073 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-51038128-a3a0-4aa1-aae7-f4c20feb9b69 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:40.275501 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-51038128-a3a0-4aa1-aae7-f4c20feb9b69 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:40.276188 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-51038128-a3a0-4aa1-aae7-f4c20feb9b69 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:40.276632 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-51038128-a3a0-4aa1-aae7-f4c20feb9b69 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:40.277045 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-51038128-a3a0-4aa1-aae7-f4c20feb9b69 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:40.342808 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-51038128-a3a0-4aa1-aae7-f4c20feb9b69 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22706a9bf4d42efb57c10cbd92c6eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0024f434015447759489d3cdc7bbaa4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:40.351576 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-51038128-a3a0-4aa1-aae7-f4c20feb9b69 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a22706a9bf4d42efb57c10cbd92c6eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0024f434015447759489d3cdc7bbaa4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:40.353017 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-51038128-a3a0-4aa1-aae7-f4c20feb9b69 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a22706a9bf4d42efb57c10cbd92c6eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0024f434015447759489d3cdc7bbaa4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:40.358610 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-51038128-a3a0-4aa1-aae7-f4c20feb9b69 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] 10.222.0.33 "GET /compute/v2.1/servers/5e984459-625e-44cd-b226-091276567215" status: 200 len: 1447 microversion: 2.75 time: 0.095195 Oct 04 20:37:40.359239 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 529/1047] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:37:40 2022] GET /compute/v2.1/servers/5e984459-625e-44cd-b226-091276567215 => generated 1447 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:37:40.639520 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-c4bc86f9-116c-4486-970b-ccece565311b tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:40.641106 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-c4bc86f9-116c-4486-970b-ccece565311b tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] [instance: 465ad440-a27e-4ff6-bb31-09f3545e166a] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:40.649285 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c4bc86f9-116c-4486-970b-ccece565311b tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:40.649771 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c4bc86f9-116c-4486-970b-ccece565311b tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:40.650233 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c4bc86f9-116c-4486-970b-ccece565311b tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:40.651241 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c4bc86f9-116c-4486-970b-ccece565311b tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:40.651733 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c4bc86f9-116c-4486-970b-ccece565311b tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:40.652158 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c4bc86f9-116c-4486-970b-ccece565311b tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:40.808520 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-c4bc86f9-116c-4486-970b-ccece565311b tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3563efe2b8c94931a2a46c4e14811b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3118a5d96843d3bede1ed94bd9717e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:40.819939 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-c4bc86f9-116c-4486-970b-ccece565311b tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] 10.222.0.33 "GET /compute/v2.1/servers/465ad440-a27e-4ff6-bb31-09f3545e166a" status: 200 len: 1543 microversion: 2.1 time: 0.186819 Oct 04 20:37:40.820595 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 519/1048] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:37:40 2022] GET /compute/v2.1/servers/465ad440-a27e-4ff6-bb31-09f3545e166a => generated 1543 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:37:40.874089 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-51d0dc9a-d8d8-48e8-aa74-0fc78407d236 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:40.875287 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-51d0dc9a-d8d8-48e8-aa74-0fc78407d236 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] [instance: 62b98bc7-657a-42c2-b501-ae4d926cfa2f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:40.882974 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-51d0dc9a-d8d8-48e8-aa74-0fc78407d236 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:40.883456 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-51d0dc9a-d8d8-48e8-aa74-0fc78407d236 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:40.883877 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-51d0dc9a-d8d8-48e8-aa74-0fc78407d236 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:40.884567 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-51d0dc9a-d8d8-48e8-aa74-0fc78407d236 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:40.885034 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-51d0dc9a-d8d8-48e8-aa74-0fc78407d236 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:40.885430 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-51d0dc9a-d8d8-48e8-aa74-0fc78407d236 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:41.027628 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-51d0dc9a-d8d8-48e8-aa74-0fc78407d236 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '800db3a57ada47eca381b00189fdbf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66ec8ea91b04deb90b679589e0495bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:41.035949 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-51d0dc9a-d8d8-48e8-aa74-0fc78407d236 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] 10.222.0.33 "GET /compute/v2.1/servers/62b98bc7-657a-42c2-b501-ae4d926cfa2f" status: 200 len: 1310 microversion: 2.1 time: 0.166310 Oct 04 20:37:41.036605 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 530/1049] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:37:40 2022] GET /compute/v2.1/servers/62b98bc7-657a-42c2-b501-ae4d926cfa2f => generated 1310 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:37:41.281010 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-897dbad5-f7a4-4929-93a1-65a8945c7592 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:41.281534 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-897dbad5-f7a4-4929-93a1-65a8945c7592 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] [instance: 1c6ffc0f-3aaa-41f8-9a9a-0040295fe064] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:41.284306 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-51fa9740-821c-4458-ac95-ea3dc9a94f1d tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:41.285008 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-51fa9740-821c-4458-ac95-ea3dc9a94f1d tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] [instance: f33c0e5c-fe2c-4379-b50a-08eb17062b91] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:41.288763 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-897dbad5-f7a4-4929-93a1-65a8945c7592 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:41.289248 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-897dbad5-f7a4-4929-93a1-65a8945c7592 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:41.289683 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-897dbad5-f7a4-4929-93a1-65a8945c7592 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:41.290397 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-897dbad5-f7a4-4929-93a1-65a8945c7592 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:41.291097 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-897dbad5-f7a4-4929-93a1-65a8945c7592 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:41.291296 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-51fa9740-821c-4458-ac95-ea3dc9a94f1d tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:41.291747 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-51fa9740-821c-4458-ac95-ea3dc9a94f1d tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:41.291869 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-897dbad5-f7a4-4929-93a1-65a8945c7592 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:41.292178 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-51fa9740-821c-4458-ac95-ea3dc9a94f1d tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:41.292870 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-51fa9740-821c-4458-ac95-ea3dc9a94f1d tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:41.293325 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-51fa9740-821c-4458-ac95-ea3dc9a94f1d tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:41.293747 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-51fa9740-821c-4458-ac95-ea3dc9a94f1d tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:41.508675 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-51fa9740-821c-4458-ac95-ea3dc9a94f1d tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:41.511485 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-897dbad5-f7a4-4929-93a1-65a8945c7592 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a24944aeb34a5ea228965be9bf4ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c288268acb30475bbc065a8f72cb21d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:41.517011 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-51fa9740-821c-4458-ac95-ea3dc9a94f1d tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:41.518535 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-51fa9740-821c-4458-ac95-ea3dc9a94f1d tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:41.519428 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-897dbad5-f7a4-4929-93a1-65a8945c7592 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] 10.222.0.33 "GET /compute/v2.1/servers/1c6ffc0f-3aaa-41f8-9a9a-0040295fe064" status: 200 len: 1468 microversion: 2.1 time: 0.243006 Oct 04 20:37:41.519651 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-51fa9740-821c-4458-ac95-ea3dc9a94f1d tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] 10.222.0.33 "GET /compute/v2.1/servers/f33c0e5c-fe2c-4379-b50a-08eb17062b91" status: 200 len: 1362 microversion: 2.25 time: 0.239604 Oct 04 20:37:41.520065 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 520/1050] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:37:41 2022] GET /compute/v2.1/servers/1c6ffc0f-3aaa-41f8-9a9a-0040295fe064 => generated 1468 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:37:41.530390 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 531/1051] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:37:41 2022] GET /compute/v2.1/servers/f33c0e5c-fe2c-4379-b50a-08eb17062b91 => generated 1362 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 20:37:41.530584 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-de2b2383-918c-4a91-a22e-00865f70701e tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:41.530584 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-de2b2383-918c-4a91-a22e-00865f70701e tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] [instance: 5e984459-625e-44cd-b226-091276567215] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:41.534125 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-de2b2383-918c-4a91-a22e-00865f70701e tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:41.534623 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-de2b2383-918c-4a91-a22e-00865f70701e tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:41.535104 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-de2b2383-918c-4a91-a22e-00865f70701e tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:41.536630 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-de2b2383-918c-4a91-a22e-00865f70701e tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:41.537106 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-de2b2383-918c-4a91-a22e-00865f70701e tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:41.539609 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-de2b2383-918c-4a91-a22e-00865f70701e tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:41.608561 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-de2b2383-918c-4a91-a22e-00865f70701e tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22706a9bf4d42efb57c10cbd92c6eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0024f434015447759489d3cdc7bbaa4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:41.617642 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-de2b2383-918c-4a91-a22e-00865f70701e tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a22706a9bf4d42efb57c10cbd92c6eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0024f434015447759489d3cdc7bbaa4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:41.619137 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-de2b2383-918c-4a91-a22e-00865f70701e tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a22706a9bf4d42efb57c10cbd92c6eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0024f434015447759489d3cdc7bbaa4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:41.624090 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-de2b2383-918c-4a91-a22e-00865f70701e tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] 10.222.0.33 "GET /compute/v2.1/servers/5e984459-625e-44cd-b226-091276567215" status: 200 len: 1447 microversion: 2.75 time: 0.102954 Oct 04 20:37:41.624973 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 521/1052] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:37:41 2022] GET /compute/v2.1/servers/5e984459-625e-44cd-b226-091276567215 => generated 1447 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:37:41.846023 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-fe7bc657-dd47-4f0b-8ffd-0d75396b0b35 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:41.847043 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-fe7bc657-dd47-4f0b-8ffd-0d75396b0b35 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] [instance: 465ad440-a27e-4ff6-bb31-09f3545e166a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:41.856572 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fe7bc657-dd47-4f0b-8ffd-0d75396b0b35 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:41.857353 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fe7bc657-dd47-4f0b-8ffd-0d75396b0b35 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:41.858108 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fe7bc657-dd47-4f0b-8ffd-0d75396b0b35 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:41.859097 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fe7bc657-dd47-4f0b-8ffd-0d75396b0b35 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:41.859956 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fe7bc657-dd47-4f0b-8ffd-0d75396b0b35 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:41.860733 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fe7bc657-dd47-4f0b-8ffd-0d75396b0b35 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:42.061141 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-2a132f9e-8313-4739-afdb-4d12880698ab tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:42.061841 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-2a132f9e-8313-4739-afdb-4d12880698ab tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] [instance: 62b98bc7-657a-42c2-b501-ae4d926cfa2f] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:42.075253 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2a132f9e-8313-4739-afdb-4d12880698ab tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:42.075858 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2a132f9e-8313-4739-afdb-4d12880698ab tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:42.076401 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2a132f9e-8313-4739-afdb-4d12880698ab tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:42.077222 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2a132f9e-8313-4739-afdb-4d12880698ab tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:42.077769 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2a132f9e-8313-4739-afdb-4d12880698ab tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:42.078264 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2a132f9e-8313-4739-afdb-4d12880698ab tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:42.252049 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-fe7bc657-dd47-4f0b-8ffd-0d75396b0b35 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3563efe2b8c94931a2a46c4e14811b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3118a5d96843d3bede1ed94bd9717e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:42.274746 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-fe7bc657-dd47-4f0b-8ffd-0d75396b0b35 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] 10.222.0.33 "GET /compute/v2.1/servers/465ad440-a27e-4ff6-bb31-09f3545e166a" status: 200 len: 1543 microversion: 2.1 time: 0.433740 Oct 04 20:37:42.275461 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 532/1053] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:37:41 2022] GET /compute/v2.1/servers/465ad440-a27e-4ff6-bb31-09f3545e166a => generated 1543 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:37:42.364764 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-6632f9f9-5b9b-4eb1-adb5-593c140fa360 req-b16f7b3c-a1eb-4158-a115-1326fe84f255 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c6ffc0f-3aaa-41f8-9a9a-0040295fe064", "name": "network-vif-deleted", "tag": "edb0cd98-3f42-4412-a492-45b170a8ad7b"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:37:42.374952 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-6632f9f9-5b9b-4eb1-adb5-593c140fa360 req-b16f7b3c-a1eb-4158-a115-1326fe84f255 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:42.375573 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-6632f9f9-5b9b-4eb1-adb5-593c140fa360 req-b16f7b3c-a1eb-4158-a115-1326fe84f255 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:42.376259 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-6632f9f9-5b9b-4eb1-adb5-593c140fa360 req-b16f7b3c-a1eb-4158-a115-1326fe84f255 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:42.389217 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-6632f9f9-5b9b-4eb1-adb5-593c140fa360 req-b16f7b3c-a1eb-4158-a115-1326fe84f255 service nova] Creating event network-vif-deleted:edb0cd98-3f42-4412-a492-45b170a8ad7b for instance 1c6ffc0f-3aaa-41f8-9a9a-0040295fe064 on n-h2-854823-8 Oct 04 20:37:42.394846 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-6632f9f9-5b9b-4eb1-adb5-593c140fa360 req-b16f7b3c-a1eb-4158-a115-1326fe84f255 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034975 Oct 04 20:37:42.395825 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 533/1054] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:37:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 20:37:42.544848 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a977b61d-52b3-402c-86f9-2771b3df0659 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:42.547130 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a977b61d-52b3-402c-86f9-2771b3df0659 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] [instance: 1c6ffc0f-3aaa-41f8-9a9a-0040295fe064] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:42.556878 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a977b61d-52b3-402c-86f9-2771b3df0659 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:42.557872 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a977b61d-52b3-402c-86f9-2771b3df0659 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:42.558318 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a977b61d-52b3-402c-86f9-2771b3df0659 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:42.559917 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a977b61d-52b3-402c-86f9-2771b3df0659 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:42.559917 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a977b61d-52b3-402c-86f9-2771b3df0659 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:42.560259 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a977b61d-52b3-402c-86f9-2771b3df0659 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:42.654107 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a977b61d-52b3-402c-86f9-2771b3df0659 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:42.654989 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a977b61d-52b3-402c-86f9-2771b3df0659 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:42.655694 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a977b61d-52b3-402c-86f9-2771b3df0659 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:42.656357 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-a977b61d-52b3-402c-86f9-2771b3df0659 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lazy-loading 'fault' on Instance uuid 1c6ffc0f-3aaa-41f8-9a9a-0040295fe064 {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:37:42.685734 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-2a132f9e-8313-4739-afdb-4d12880698ab tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '800db3a57ada47eca381b00189fdbf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66ec8ea91b04deb90b679589e0495bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:42.702861 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-2a132f9e-8313-4739-afdb-4d12880698ab tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] 10.222.0.33 "GET /compute/v2.1/servers/62b98bc7-657a-42c2-b501-ae4d926cfa2f" status: 200 len: 1494 microversion: 2.1 time: 0.645417 Oct 04 20:37:42.720225 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 522/1055] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:37:42 2022] GET /compute/v2.1/servers/62b98bc7-657a-42c2-b501-ae4d926cfa2f => generated 1494 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:37:42.731026 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-0bf5fd30-467a-43e1-8403-13f934da2260 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:42.732944 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-0bf5fd30-467a-43e1-8403-13f934da2260 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] [instance: f33c0e5c-fe2c-4379-b50a-08eb17062b91] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:42.756665 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0bf5fd30-467a-43e1-8403-13f934da2260 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:42.758746 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0bf5fd30-467a-43e1-8403-13f934da2260 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:42.760282 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0bf5fd30-467a-43e1-8403-13f934da2260 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:42.761215 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0bf5fd30-467a-43e1-8403-13f934da2260 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:42.762180 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0bf5fd30-467a-43e1-8403-13f934da2260 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:42.762802 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0bf5fd30-467a-43e1-8403-13f934da2260 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:42.813241 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-a977b61d-52b3-402c-86f9-2771b3df0659 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a24944aeb34a5ea228965be9bf4ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c288268acb30475bbc065a8f72cb21d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:42.824677 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a977b61d-52b3-402c-86f9-2771b3df0659 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] 10.222.0.33 "GET /compute/v2.1/servers/1c6ffc0f-3aaa-41f8-9a9a-0040295fe064" status: 200 len: 1303 microversion: 2.1 time: 0.284307 Oct 04 20:37:42.825284 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 534/1056] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:37:42 2022] GET /compute/v2.1/servers/1c6ffc0f-3aaa-41f8-9a9a-0040295fe064 => generated 1303 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:37:42.830609 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-fcd7fd33-f6cf-4605-a75f-bdb914affa8e tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:42.831478 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-fcd7fd33-f6cf-4605-a75f-bdb914affa8e tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] [instance: 5e984459-625e-44cd-b226-091276567215] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:42.839110 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fcd7fd33-f6cf-4605-a75f-bdb914affa8e tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:42.841966 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fcd7fd33-f6cf-4605-a75f-bdb914affa8e tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:42.842713 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fcd7fd33-f6cf-4605-a75f-bdb914affa8e tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:42.843635 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fcd7fd33-f6cf-4605-a75f-bdb914affa8e tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:42.844255 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fcd7fd33-f6cf-4605-a75f-bdb914affa8e tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:42.849230 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fcd7fd33-f6cf-4605-a75f-bdb914affa8e tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:42.890356 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=100 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:37:43.015947 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-fcd7fd33-f6cf-4605-a75f-bdb914affa8e tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22706a9bf4d42efb57c10cbd92c6eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0024f434015447759489d3cdc7bbaa4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:43.026947 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-fcd7fd33-f6cf-4605-a75f-bdb914affa8e tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a22706a9bf4d42efb57c10cbd92c6eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0024f434015447759489d3cdc7bbaa4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:43.028845 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-fcd7fd33-f6cf-4605-a75f-bdb914affa8e tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a22706a9bf4d42efb57c10cbd92c6eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0024f434015447759489d3cdc7bbaa4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:43.034681 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-fcd7fd33-f6cf-4605-a75f-bdb914affa8e tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] 10.222.0.33 "GET /compute/v2.1/servers/5e984459-625e-44cd-b226-091276567215" status: 200 len: 1447 microversion: 2.75 time: 0.207524 Oct 04 20:37:43.050383 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 535/1057] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:37:42 2022] GET /compute/v2.1/servers/5e984459-625e-44cd-b226-091276567215 => generated 1447 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:37:43.105616 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-0bf5fd30-467a-43e1-8403-13f934da2260 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:43.115609 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-0bf5fd30-467a-43e1-8403-13f934da2260 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:43.117789 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-0bf5fd30-467a-43e1-8403-13f934da2260 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:43.119017 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-0bf5fd30-467a-43e1-8403-13f934da2260 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] 10.222.0.33 "GET /compute/v2.1/servers/f33c0e5c-fe2c-4379-b50a-08eb17062b91" status: 200 len: 1362 microversion: 2.25 time: 0.397556 Oct 04 20:37:43.120050 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 523/1058] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:37:42 2022] GET /compute/v2.1/servers/f33c0e5c-fe2c-4379-b50a-08eb17062b91 => generated 1362 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:37:43.125581 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-98f9f6c4-8377-40dc-9e03-de9399b53f2b tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:43.126926 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-98f9f6c4-8377-40dc-9e03-de9399b53f2b tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] [instance: 62b98bc7-657a-42c2-b501-ae4d926cfa2f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:43.135369 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-98f9f6c4-8377-40dc-9e03-de9399b53f2b tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:43.136188 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-98f9f6c4-8377-40dc-9e03-de9399b53f2b tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:43.136863 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-98f9f6c4-8377-40dc-9e03-de9399b53f2b tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:43.137784 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-98f9f6c4-8377-40dc-9e03-de9399b53f2b tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:43.138483 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-98f9f6c4-8377-40dc-9e03-de9399b53f2b tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:43.139111 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-98f9f6c4-8377-40dc-9e03-de9399b53f2b tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:43.213181 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-5b40eee6-3cf8-4087-af85-7db5408f0b82 req-99bf0f86-5336-44f4-99d4-1287b7635774 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "465ad440-a27e-4ff6-bb31-09f3545e166a", "name": "network-vif-unplugged", "status": "completed", "tag": "c16cb04f-6af6-4073-98de-ed8d89a2e3c2"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:37:43.227494 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-5b40eee6-3cf8-4087-af85-7db5408f0b82 req-99bf0f86-5336-44f4-99d4-1287b7635774 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:43.228295 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-5b40eee6-3cf8-4087-af85-7db5408f0b82 req-99bf0f86-5336-44f4-99d4-1287b7635774 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:43.229256 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-5b40eee6-3cf8-4087-af85-7db5408f0b82 req-99bf0f86-5336-44f4-99d4-1287b7635774 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:43.248002 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-5b40eee6-3cf8-4087-af85-7db5408f0b82 req-99bf0f86-5336-44f4-99d4-1287b7635774 service nova] Creating event network-vif-unplugged:c16cb04f-6af6-4073-98de-ed8d89a2e3c2 for instance 465ad440-a27e-4ff6-bb31-09f3545e166a on n-h2-854823-8 Oct 04 20:37:43.259479 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [req-5b40eee6-3cf8-4087-af85-7db5408f0b82 req-99bf0f86-5336-44f4-99d4-1287b7635774 service nova] Instance 465ad440-a27e-4ff6-bb31-09f3545e166a is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854823-8'} {{(pid=128802) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 20:37:43.266450 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-5b40eee6-3cf8-4087-af85-7db5408f0b82 req-99bf0f86-5336-44f4-99d4-1287b7635774 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.061088 Oct 04 20:37:43.267832 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 524/1059] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:37:43 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 20:37:43.299701 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-5e921935-6c8a-4ac9-ae88-15d946bad7d6 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:43.300875 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-5e921935-6c8a-4ac9-ae88-15d946bad7d6 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] [instance: 465ad440-a27e-4ff6-bb31-09f3545e166a] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:43.307715 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5e921935-6c8a-4ac9-ae88-15d946bad7d6 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:43.314152 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5e921935-6c8a-4ac9-ae88-15d946bad7d6 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:43.314660 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5e921935-6c8a-4ac9-ae88-15d946bad7d6 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:43.315403 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5e921935-6c8a-4ac9-ae88-15d946bad7d6 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:43.315855 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5e921935-6c8a-4ac9-ae88-15d946bad7d6 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:43.316284 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5e921935-6c8a-4ac9-ae88-15d946bad7d6 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:43.391196 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-98f9f6c4-8377-40dc-9e03-de9399b53f2b tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/62b98bc7-657a-42c2-b501-ae4d926cfa2f" status: 200 len: 1645 microversion: 2.1 time: 0.352864 Oct 04 20:37:43.391772 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 536/1060] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:37:43 2022] GET /compute/v2.1/servers/62b98bc7-657a-42c2-b501-ae4d926cfa2f => generated 1645 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:37:43.419897 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c14857a2-2212-4314-9f08-fec3386f0ba8 tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:43.420505 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c14857a2-2212-4314-9f08-fec3386f0ba8 tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] [instance: 62b98bc7-657a-42c2-b501-ae4d926cfa2f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:43.426699 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c14857a2-2212-4314-9f08-fec3386f0ba8 tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:43.427196 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c14857a2-2212-4314-9f08-fec3386f0ba8 tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:43.428192 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c14857a2-2212-4314-9f08-fec3386f0ba8 tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:43.428935 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c14857a2-2212-4314-9f08-fec3386f0ba8 tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:43.429393 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c14857a2-2212-4314-9f08-fec3386f0ba8 tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:43.429819 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c14857a2-2212-4314-9f08-fec3386f0ba8 tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:43.808824 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-5e921935-6c8a-4ac9-ae88-15d946bad7d6 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3563efe2b8c94931a2a46c4e14811b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3118a5d96843d3bede1ed94bd9717e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:43.817835 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-5e921935-6c8a-4ac9-ae88-15d946bad7d6 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] 10.222.0.33 "GET /compute/v2.1/servers/465ad440-a27e-4ff6-bb31-09f3545e166a" status: 200 len: 1542 microversion: 2.1 time: 0.522363 Oct 04 20:37:43.832727 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 525/1061] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:37:43 2022] GET /compute/v2.1/servers/465ad440-a27e-4ff6-bb31-09f3545e166a => generated 1542 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:37:43.855935 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c14857a2-2212-4314-9f08-fec3386f0ba8 tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/62b98bc7-657a-42c2-b501-ae4d926cfa2f" status: 200 len: 1645 microversion: 2.1 time: 0.438271 Oct 04 20:37:43.857033 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 537/1062] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:37:43 2022] GET /compute/v2.1/servers/62b98bc7-657a-42c2-b501-ae4d926cfa2f => generated 1645 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:37:43.858829 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-23238dff-3d38-4124-9540-927e35db7840 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:43.859940 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-23238dff-3d38-4124-9540-927e35db7840 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] [instance: 1c6ffc0f-3aaa-41f8-9a9a-0040295fe064] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:43.867159 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-23238dff-3d38-4124-9540-927e35db7840 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:43.868270 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-23238dff-3d38-4124-9540-927e35db7840 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:43.869142 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-23238dff-3d38-4124-9540-927e35db7840 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:43.870108 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-23238dff-3d38-4124-9540-927e35db7840 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:43.871716 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-23238dff-3d38-4124-9540-927e35db7840 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:43.872399 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-23238dff-3d38-4124-9540-927e35db7840 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:43.880373 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d0278e27-8de8-4784-8f02-424a7159580c tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:43.885060 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d0278e27-8de8-4784-8f02-424a7159580c tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:43.885756 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d0278e27-8de8-4784-8f02-424a7159580c tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:43.886512 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d0278e27-8de8-4784-8f02-424a7159580c tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:43.887421 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d0278e27-8de8-4784-8f02-424a7159580c tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:43.888201 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d0278e27-8de8-4784-8f02-424a7159580c tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:43.888791 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d0278e27-8de8-4784-8f02-424a7159580c tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:43.903310 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.wsgi [None req-23238dff-3d38-4124-9540-927e35db7840 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] HTTP exception thrown: Instance 1c6ffc0f-3aaa-41f8-9a9a-0040295fe064 could not be found. Oct 04 20:37:43.905074 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-23238dff-3d38-4124-9540-927e35db7840 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Request method failure captured: Oct 04 20:37:43.905074 n-d-854823-8 devstack@n-api.service[128802]: request: GET /compute/v2.1/servers/1c6ffc0f-3aaa-41f8-9a9a-0040295fe064 HTTP/1.1 Oct 04 20:37:43.905074 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 20:37:43.905074 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 20:37:43.905074 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 20:37:43.905074 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 0 Oct 04 20:37:43.905074 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 20:37:43.905074 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 20:37:43.905074 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 20:37:43.905074 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 20:37:43.905074 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPJj70pkEpfnn_riq2CJ3vbhS6uwqsmbInkczI4lwy7f-ypfW2zouEJzhVZnu6kmdfqJN8C6tm0Ejbx97ATlFhUoiOhWMbM6AcAQ9UgYSMPkh7Ybe2Gw_g9qL7w6T9EsDeNcxyJWqy6WAuAaUdTLbDnmujDsKYea49AZgSbg2L-Kungw Oct 04 20:37:43.905074 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 20:37:43.905074 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 20:37:43.905074 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 20:37:43.905074 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 20:37:43.905074 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 20:37:43.905074 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 20:37:43.905074 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: c288268acb30475bbc065a8f72cb21d5 Oct 04 20:37:43.905074 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-ServersAdminTestJSON-1951935148 Oct 04 20:37:43.905074 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 20:37:43.905074 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 20:37:43.905074 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_c288268acb30475bbc065a8f72cb21d5", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c288268acb30475bbc065a8f72cb21d5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c288268acb30475bbc065a8f72cb21d5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/c288268acb30475bbc065a8f72cb21d5"}]}] Oct 04 20:37:43.905074 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-ServersAdminTestJSON-1951935148 Oct 04 20:37:43.905074 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: c288268acb30475bbc065a8f72cb21d5 Oct 04 20:37:43.905074 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-ServersAdminTestJSON-1951935148 Oct 04 20:37:43.905074 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-ServersAdminTestJSON-1951935148-project Oct 04 20:37:43.905074 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 20:37:43.905074 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 20:37:43.905074 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: b4a24944aeb34a5ea228965be9bf4ce0 Oct 04 20:37:43.905074 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-ServersAdminTestJSON-1951935148-project Oct 04 20:37:43.905074 n-d-854823-8 devstack@n-api.service[128802]: method: > Oct 04 20:37:43.905074 n-d-854823-8 devstack@n-api.service[128802]: exception: Instance 1c6ffc0f-3aaa-41f8-9a9a-0040295fe064 could not be found. Oct 04 20:37:43.905074 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'id': '1c6ffc0f-3aaa-41f8-9a9a-0040295fe064'} Oct 04 20:37:43.905074 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:37:43.905074 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:37:43.905074 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:37:43.905074 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:37:43.905074 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:37:43.905074 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:37:43.905074 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:37:43.905074 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:37:43.905074 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:37:43.905074 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:37:43.905074 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c6ffc0f-3aaa-41f8-9a9a-0040295fe064 could not be found. Oct 04 20:37:43.905074 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:37:43.905074 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:37:43.905074 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:37:43.905074 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:37:43.905074 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:37:43.905074 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:37:43.905074 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:37:43.905074 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:37:43.905074 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:37:43.905074 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:37:43.905074 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:37:43.905074 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:37:43.905074 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:37:43.905074 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:37:43.905074 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:37:43.905074 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:37:43.905074 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c6ffc0f-3aaa-41f8-9a9a-0040295fe064 could not be found. Oct 04 20:37:43.905074 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:37:43.905074 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:37:43.905074 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:37:43.910832 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:37:43.910832 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:37:43.910832 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:37:43.910832 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:37:43.910832 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:37:43.910832 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c6ffc0f-3aaa-41f8-9a9a-0040295fe064 could not be found. Oct 04 20:37:43.910832 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:37:43.912804 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:37:43.913112 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-23238dff-3d38-4124-9540-927e35db7840 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Returning 404 to user: Instance 1c6ffc0f-3aaa-41f8-9a9a-0040295fe064 could not be found. {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:37:43.914196 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-23238dff-3d38-4124-9540-927e35db7840 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] 10.222.0.33 "GET /compute/v2.1/servers/1c6ffc0f-3aaa-41f8-9a9a-0040295fe064" status: 404 len: 111 microversion: 2.1 time: 0.064636 Oct 04 20:37:43.915374 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 526/1063] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:37:43 2022] GET /compute/v2.1/servers/1c6ffc0f-3aaa-41f8-9a9a-0040295fe064 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 20:37:43.925970 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-f69d249d-d786-4ab8-9204-b04549149bc2 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:43.927175 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-f69d249d-d786-4ab8-9204-b04549149bc2 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] [instance: 9f8cc082-0a37-4123-a680-1210a90b3ca9] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:43.934202 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d0278e27-8de8-4784-8f02-424a7159580c tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.058346 Oct 04 20:37:43.935165 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 538/1064] 10.222.0.33 () {58 vars in 1176 bytes} [Tue Oct 4 20:37:43 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 20:37:43.937420 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f69d249d-d786-4ab8-9204-b04549149bc2 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:43.937879 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f69d249d-d786-4ab8-9204-b04549149bc2 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:43.938306 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f69d249d-d786-4ab8-9204-b04549149bc2 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:43.939083 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f69d249d-d786-4ab8-9204-b04549149bc2 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:43.939532 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f69d249d-d786-4ab8-9204-b04549149bc2 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:43.940522 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f69d249d-d786-4ab8-9204-b04549149bc2 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:43.949673 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-60d01b35-d830-4d4a-a689-6ca4cfb07bdc tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-854823-8", "block_migration": true, "disk_over_commit": false}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:37:43.952944 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-60d01b35-d830-4d4a-a689-6ca4cfb07bdc tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] [instance: 62b98bc7-657a-42c2-b501-ae4d926cfa2f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:43.959072 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-60d01b35-d830-4d4a-a689-6ca4cfb07bdc tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:43.960292 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-60d01b35-d830-4d4a-a689-6ca4cfb07bdc tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:43.960292 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-60d01b35-d830-4d4a-a689-6ca4cfb07bdc tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:43.961538 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-60d01b35-d830-4d4a-a689-6ca4cfb07bdc tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:43.962101 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-60d01b35-d830-4d4a-a689-6ca4cfb07bdc tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:43.964024 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-60d01b35-d830-4d4a-a689-6ca4cfb07bdc tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:43.975584 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-f69d249d-d786-4ab8-9204-b04549149bc2 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] [instance: 9f8cc082-0a37-4123-a680-1210a90b3ca9] Going to try to terminate instance {{(pid=128802) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:37:44.036331 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-60d01b35-d830-4d4a-a689-6ca4cfb07bdc tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] Lazy-loading 'flavor' on Instance uuid 62b98bc7-657a-42c2-b501-ae4d926cfa2f {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:37:44.076421 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-60d01b35-d830-4d4a-a689-6ca4cfb07bdc tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] [instance: 62b98bc7-657a-42c2-b501-ae4d926cfa2f] Going to try to live migrate instance to n-h2-854823-8 {{(pid=128801) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 04 20:37:44.086068 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-f69d249d-d786-4ab8-9204-b04549149bc2 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] 10.222.0.33 "DELETE /compute/v2.1/servers/9f8cc082-0a37-4123-a680-1210a90b3ca9" status: 204 len: 0 microversion: 2.1 time: 0.160586 Oct 04 20:37:44.088317 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 527/1065] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 20:37:43 2022] DELETE /compute/v2.1/servers/9f8cc082-0a37-4123-a680-1210a90b3ca9 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 20:37:44.094956 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-8426f8c3-2f1a-4852-a7f4-eb5ef0062af7 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:44.095764 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-8426f8c3-2f1a-4852-a7f4-eb5ef0062af7 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] [instance: 5e984459-625e-44cd-b226-091276567215] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:44.102763 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8426f8c3-2f1a-4852-a7f4-eb5ef0062af7 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:44.103247 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8426f8c3-2f1a-4852-a7f4-eb5ef0062af7 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:44.103727 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8426f8c3-2f1a-4852-a7f4-eb5ef0062af7 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:44.104438 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8426f8c3-2f1a-4852-a7f4-eb5ef0062af7 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:44.105891 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8426f8c3-2f1a-4852-a7f4-eb5ef0062af7 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:44.106589 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8426f8c3-2f1a-4852-a7f4-eb5ef0062af7 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:44.196931 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-8426f8c3-2f1a-4852-a7f4-eb5ef0062af7 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22706a9bf4d42efb57c10cbd92c6eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0024f434015447759489d3cdc7bbaa4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:44.210495 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-8426f8c3-2f1a-4852-a7f4-eb5ef0062af7 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a22706a9bf4d42efb57c10cbd92c6eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0024f434015447759489d3cdc7bbaa4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:44.212839 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-8426f8c3-2f1a-4852-a7f4-eb5ef0062af7 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a22706a9bf4d42efb57c10cbd92c6eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0024f434015447759489d3cdc7bbaa4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:44.220738 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-8426f8c3-2f1a-4852-a7f4-eb5ef0062af7 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] 10.222.0.33 "GET /compute/v2.1/servers/5e984459-625e-44cd-b226-091276567215" status: 200 len: 1447 microversion: 2.75 time: 0.130615 Oct 04 20:37:44.221522 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 528/1066] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:37:44 2022] GET /compute/v2.1/servers/5e984459-625e-44cd-b226-091276567215 => generated 1447 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:37:44.245030 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-3acb0bb2-fb59-4cda-bdcd-f2543ee38332 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:44.245715 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-3acb0bb2-fb59-4cda-bdcd-f2543ee38332 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] [instance: 9f8cc082-0a37-4123-a680-1210a90b3ca9] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:44.255793 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3acb0bb2-fb59-4cda-bdcd-f2543ee38332 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:44.256480 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3acb0bb2-fb59-4cda-bdcd-f2543ee38332 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:44.257002 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3acb0bb2-fb59-4cda-bdcd-f2543ee38332 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:44.257922 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3acb0bb2-fb59-4cda-bdcd-f2543ee38332 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:44.258483 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3acb0bb2-fb59-4cda-bdcd-f2543ee38332 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:44.258979 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3acb0bb2-fb59-4cda-bdcd-f2543ee38332 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:44.413557 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-3acb0bb2-fb59-4cda-bdcd-f2543ee38332 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a24944aeb34a5ea228965be9bf4ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c288268acb30475bbc065a8f72cb21d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:44.422216 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-3acb0bb2-fb59-4cda-bdcd-f2543ee38332 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] 10.222.0.33 "GET /compute/v2.1/servers/9f8cc082-0a37-4123-a680-1210a90b3ca9" status: 200 len: 1469 microversion: 2.1 time: 0.192200 Oct 04 20:37:44.422937 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 529/1067] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:37:44 2022] GET /compute/v2.1/servers/9f8cc082-0a37-4123-a680-1210a90b3ca9 => generated 1469 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:37:44.428144 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-19c4bef9-83e3-4b77-9ac0-6538310b2966 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:44.428999 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-19c4bef9-83e3-4b77-9ac0-6538310b2966 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] [instance: f33c0e5c-fe2c-4379-b50a-08eb17062b91] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:44.439314 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-19c4bef9-83e3-4b77-9ac0-6538310b2966 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:44.452836 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-19c4bef9-83e3-4b77-9ac0-6538310b2966 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:44.453419 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-19c4bef9-83e3-4b77-9ac0-6538310b2966 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:44.454204 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-19c4bef9-83e3-4b77-9ac0-6538310b2966 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:44.454700 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-19c4bef9-83e3-4b77-9ac0-6538310b2966 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:44.455126 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-19c4bef9-83e3-4b77-9ac0-6538310b2966 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:44.611853 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-19c4bef9-83e3-4b77-9ac0-6538310b2966 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:44.620394 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-19c4bef9-83e3-4b77-9ac0-6538310b2966 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:44.621901 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-19c4bef9-83e3-4b77-9ac0-6538310b2966 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:44.623128 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-19c4bef9-83e3-4b77-9ac0-6538310b2966 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] 10.222.0.33 "GET /compute/v2.1/servers/f33c0e5c-fe2c-4379-b50a-08eb17062b91" status: 200 len: 1362 microversion: 2.25 time: 0.199042 Oct 04 20:37:44.623770 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 530/1068] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:37:44 2022] GET /compute/v2.1/servers/f33c0e5c-fe2c-4379-b50a-08eb17062b91 => generated 1362 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:37:44.841268 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-4a07ce3d-0f92-4128-87ca-38e97155fca0 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:44.841976 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-4a07ce3d-0f92-4128-87ca-38e97155fca0 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] [instance: 465ad440-a27e-4ff6-bb31-09f3545e166a] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:44.847855 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4a07ce3d-0f92-4128-87ca-38e97155fca0 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:44.848715 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4a07ce3d-0f92-4128-87ca-38e97155fca0 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:44.848933 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4a07ce3d-0f92-4128-87ca-38e97155fca0 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:44.849749 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4a07ce3d-0f92-4128-87ca-38e97155fca0 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:44.850277 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4a07ce3d-0f92-4128-87ca-38e97155fca0 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:44.851328 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4a07ce3d-0f92-4128-87ca-38e97155fca0 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:44.972951 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=12 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:37:44.984343 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-4a07ce3d-0f92-4128-87ca-38e97155fca0 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3563efe2b8c94931a2a46c4e14811b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3118a5d96843d3bede1ed94bd9717e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:44.993062 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-4a07ce3d-0f92-4128-87ca-38e97155fca0 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] 10.222.0.33 "GET /compute/v2.1/servers/465ad440-a27e-4ff6-bb31-09f3545e166a" status: 200 len: 1542 microversion: 2.1 time: 0.155964 Oct 04 20:37:44.993663 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 531/1069] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:37:44 2022] GET /compute/v2.1/servers/465ad440-a27e-4ff6-bb31-09f3545e166a => generated 1542 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:37:45.249046 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-3fc26f56-d57d-413f-a7b5-d3ae3259c7c4 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:45.249716 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-3fc26f56-d57d-413f-a7b5-d3ae3259c7c4 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] [instance: 5e984459-625e-44cd-b226-091276567215] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:45.253554 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell0:SELECT=2 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:37:45.259500 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3fc26f56-d57d-413f-a7b5-d3ae3259c7c4 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:45.259994 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3fc26f56-d57d-413f-a7b5-d3ae3259c7c4 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:45.260428 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3fc26f56-d57d-413f-a7b5-d3ae3259c7c4 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:45.261137 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3fc26f56-d57d-413f-a7b5-d3ae3259c7c4 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:45.261598 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3fc26f56-d57d-413f-a7b5-d3ae3259c7c4 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:45.262024 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3fc26f56-d57d-413f-a7b5-d3ae3259c7c4 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:45.331733 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-3fc26f56-d57d-413f-a7b5-d3ae3259c7c4 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22706a9bf4d42efb57c10cbd92c6eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0024f434015447759489d3cdc7bbaa4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:45.341701 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-3fc26f56-d57d-413f-a7b5-d3ae3259c7c4 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a22706a9bf4d42efb57c10cbd92c6eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0024f434015447759489d3cdc7bbaa4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:45.343472 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-3fc26f56-d57d-413f-a7b5-d3ae3259c7c4 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a22706a9bf4d42efb57c10cbd92c6eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0024f434015447759489d3cdc7bbaa4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:45.351774 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-3fc26f56-d57d-413f-a7b5-d3ae3259c7c4 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] 10.222.0.33 "GET /compute/v2.1/servers/5e984459-625e-44cd-b226-091276567215" status: 200 len: 1447 microversion: 2.75 time: 0.106447 Oct 04 20:37:45.352474 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 532/1070] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:37:45 2022] GET /compute/v2.1/servers/5e984459-625e-44cd-b226-091276567215 => generated 1447 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 20:37:45.446586 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-96fba52a-ecf9-4a06-a7fc-76b8ad446e10 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:45.447419 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-96fba52a-ecf9-4a06-a7fc-76b8ad446e10 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] [instance: 9f8cc082-0a37-4123-a680-1210a90b3ca9] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:45.453550 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-96fba52a-ecf9-4a06-a7fc-76b8ad446e10 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:45.454040 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-96fba52a-ecf9-4a06-a7fc-76b8ad446e10 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:45.454532 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-96fba52a-ecf9-4a06-a7fc-76b8ad446e10 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:45.456006 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-96fba52a-ecf9-4a06-a7fc-76b8ad446e10 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:45.456604 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-96fba52a-ecf9-4a06-a7fc-76b8ad446e10 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:45.456945 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-96fba52a-ecf9-4a06-a7fc-76b8ad446e10 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:45.617752 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-96fba52a-ecf9-4a06-a7fc-76b8ad446e10 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a24944aeb34a5ea228965be9bf4ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c288268acb30475bbc065a8f72cb21d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:45.627017 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-96fba52a-ecf9-4a06-a7fc-76b8ad446e10 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] 10.222.0.33 "GET /compute/v2.1/servers/9f8cc082-0a37-4123-a680-1210a90b3ca9" status: 200 len: 1469 microversion: 2.1 time: 0.184780 Oct 04 20:37:45.627819 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 533/1071] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:37:45 2022] GET /compute/v2.1/servers/9f8cc082-0a37-4123-a680-1210a90b3ca9 => generated 1469 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:37:45.650069 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-8fd1f875-c4db-4dd8-b0bd-feaa948da747 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:45.650885 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-8fd1f875-c4db-4dd8-b0bd-feaa948da747 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] [instance: f33c0e5c-fe2c-4379-b50a-08eb17062b91] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:45.657420 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8fd1f875-c4db-4dd8-b0bd-feaa948da747 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:45.657913 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8fd1f875-c4db-4dd8-b0bd-feaa948da747 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:45.658360 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8fd1f875-c4db-4dd8-b0bd-feaa948da747 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:45.659152 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8fd1f875-c4db-4dd8-b0bd-feaa948da747 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:45.659605 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8fd1f875-c4db-4dd8-b0bd-feaa948da747 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:45.660027 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8fd1f875-c4db-4dd8-b0bd-feaa948da747 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:45.811012 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-8fd1f875-c4db-4dd8-b0bd-feaa948da747 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:45.813180 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:37:45.821520 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-8fd1f875-c4db-4dd8-b0bd-feaa948da747 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:45.822997 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-8fd1f875-c4db-4dd8-b0bd-feaa948da747 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:45.824116 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-8fd1f875-c4db-4dd8-b0bd-feaa948da747 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] 10.222.0.33 "GET /compute/v2.1/servers/f33c0e5c-fe2c-4379-b50a-08eb17062b91" status: 200 len: 1362 microversion: 2.25 time: 0.178137 Oct 04 20:37:45.824673 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 534/1072] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:37:45 2022] GET /compute/v2.1/servers/f33c0e5c-fe2c-4379-b50a-08eb17062b91 => generated 1362 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:37:46.020856 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-62ba923a-1850-4a2d-9e82-9213bed87c1c tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:46.021469 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-62ba923a-1850-4a2d-9e82-9213bed87c1c tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] [instance: 465ad440-a27e-4ff6-bb31-09f3545e166a] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:46.028413 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-62ba923a-1850-4a2d-9e82-9213bed87c1c tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:46.028870 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-62ba923a-1850-4a2d-9e82-9213bed87c1c tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:46.029303 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-62ba923a-1850-4a2d-9e82-9213bed87c1c tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:46.030068 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-62ba923a-1850-4a2d-9e82-9213bed87c1c tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:46.030656 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-62ba923a-1850-4a2d-9e82-9213bed87c1c tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:46.031013 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-62ba923a-1850-4a2d-9e82-9213bed87c1c tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:46.194875 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-62ba923a-1850-4a2d-9e82-9213bed87c1c tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3563efe2b8c94931a2a46c4e14811b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3118a5d96843d3bede1ed94bd9717e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:46.205292 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-62ba923a-1850-4a2d-9e82-9213bed87c1c tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] 10.222.0.33 "GET /compute/v2.1/servers/465ad440-a27e-4ff6-bb31-09f3545e166a" status: 200 len: 1474 microversion: 2.1 time: 0.190645 Oct 04 20:37:46.206754 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 535/1073] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:37:46 2022] GET /compute/v2.1/servers/465ad440-a27e-4ff6-bb31-09f3545e166a => generated 1474 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:37:46.213769 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-a2ac5719-9d02-4cb5-97cd-3150818276d9 req-72ae88f8-7988-4c59-a238-2464bdd3b533 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f8cc082-0a37-4123-a680-1210a90b3ca9", "name": "network-vif-deleted", "tag": "b3d1f9a5-253e-4b89-ba8b-3d8135069ec1"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:37:46.224351 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-a2ac5719-9d02-4cb5-97cd-3150818276d9 req-72ae88f8-7988-4c59-a238-2464bdd3b533 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:46.224830 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-a2ac5719-9d02-4cb5-97cd-3150818276d9 req-72ae88f8-7988-4c59-a238-2464bdd3b533 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:46.225260 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-a2ac5719-9d02-4cb5-97cd-3150818276d9 req-72ae88f8-7988-4c59-a238-2464bdd3b533 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:46.238560 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-a2ac5719-9d02-4cb5-97cd-3150818276d9 req-72ae88f8-7988-4c59-a238-2464bdd3b533 service nova] Creating event network-vif-deleted:b3d1f9a5-253e-4b89-ba8b-3d8135069ec1 for instance 9f8cc082-0a37-4123-a680-1210a90b3ca9 on n-h1-854823-8 Oct 04 20:37:46.246218 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-a2ac5719-9d02-4cb5-97cd-3150818276d9 req-72ae88f8-7988-4c59-a238-2464bdd3b533 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037788 Oct 04 20:37:46.248949 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 536/1074] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:37:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:37:46.382706 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-3e35dcde-a773-484c-bf96-7e3b9abdc0dd tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:46.383543 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-3e35dcde-a773-484c-bf96-7e3b9abdc0dd tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] [instance: 5e984459-625e-44cd-b226-091276567215] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:46.394859 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3e35dcde-a773-484c-bf96-7e3b9abdc0dd tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:46.395880 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3e35dcde-a773-484c-bf96-7e3b9abdc0dd tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:46.396343 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3e35dcde-a773-484c-bf96-7e3b9abdc0dd tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:46.397069 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3e35dcde-a773-484c-bf96-7e3b9abdc0dd tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:46.397511 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3e35dcde-a773-484c-bf96-7e3b9abdc0dd tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:46.397923 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3e35dcde-a773-484c-bf96-7e3b9abdc0dd tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:46.472190 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-3e35dcde-a773-484c-bf96-7e3b9abdc0dd tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22706a9bf4d42efb57c10cbd92c6eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0024f434015447759489d3cdc7bbaa4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:46.481663 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-3e35dcde-a773-484c-bf96-7e3b9abdc0dd tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a22706a9bf4d42efb57c10cbd92c6eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0024f434015447759489d3cdc7bbaa4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:46.483148 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-3e35dcde-a773-484c-bf96-7e3b9abdc0dd tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a22706a9bf4d42efb57c10cbd92c6eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0024f434015447759489d3cdc7bbaa4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:46.487890 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-3e35dcde-a773-484c-bf96-7e3b9abdc0dd tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] 10.222.0.33 "GET /compute/v2.1/servers/5e984459-625e-44cd-b226-091276567215" status: 200 len: 1447 microversion: 2.75 time: 0.110561 Oct 04 20:37:46.488450 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 537/1075] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:37:46 2022] GET /compute/v2.1/servers/5e984459-625e-44cd-b226-091276567215 => generated 1447 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:37:46.657153 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-1147b54d-9d89-49b4-bbee-e87683dfa1cb tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:46.658029 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-1147b54d-9d89-49b4-bbee-e87683dfa1cb tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] [instance: 9f8cc082-0a37-4123-a680-1210a90b3ca9] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:46.665531 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1147b54d-9d89-49b4-bbee-e87683dfa1cb tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:46.666269 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1147b54d-9d89-49b4-bbee-e87683dfa1cb tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:46.667010 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1147b54d-9d89-49b4-bbee-e87683dfa1cb tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:46.667947 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1147b54d-9d89-49b4-bbee-e87683dfa1cb tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:46.668485 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1147b54d-9d89-49b4-bbee-e87683dfa1cb tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:46.669067 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1147b54d-9d89-49b4-bbee-e87683dfa1cb tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:46.727842 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1147b54d-9d89-49b4-bbee-e87683dfa1cb tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:46.728493 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1147b54d-9d89-49b4-bbee-e87683dfa1cb tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:46.729176 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1147b54d-9d89-49b4-bbee-e87683dfa1cb tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:46.729866 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.objects.instance [None req-1147b54d-9d89-49b4-bbee-e87683dfa1cb tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lazy-loading 'fault' on Instance uuid 9f8cc082-0a37-4123-a680-1210a90b3ca9 {{(pid=128802) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:37:46.782083 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-1147b54d-9d89-49b4-bbee-e87683dfa1cb tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a24944aeb34a5ea228965be9bf4ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c288268acb30475bbc065a8f72cb21d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:46.791928 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-1147b54d-9d89-49b4-bbee-e87683dfa1cb tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] 10.222.0.33 "GET /compute/v2.1/servers/9f8cc082-0a37-4123-a680-1210a90b3ca9" status: 200 len: 1303 microversion: 2.1 time: 0.143181 Oct 04 20:37:46.793194 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 538/1076] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:37:46 2022] GET /compute/v2.1/servers/9f8cc082-0a37-4123-a680-1210a90b3ca9 => generated 1303 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:37:46.852247 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-61996b3e-da42-4522-b96c-bc0a61440ea9 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:46.852855 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-61996b3e-da42-4522-b96c-bc0a61440ea9 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] [instance: f33c0e5c-fe2c-4379-b50a-08eb17062b91] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:46.863832 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-61996b3e-da42-4522-b96c-bc0a61440ea9 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:46.865118 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-61996b3e-da42-4522-b96c-bc0a61440ea9 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:46.865662 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-61996b3e-da42-4522-b96c-bc0a61440ea9 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:46.867413 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-61996b3e-da42-4522-b96c-bc0a61440ea9 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:46.868389 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-61996b3e-da42-4522-b96c-bc0a61440ea9 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:46.869133 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-61996b3e-da42-4522-b96c-bc0a61440ea9 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:47.094967 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-61996b3e-da42-4522-b96c-bc0a61440ea9 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:47.108723 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-61996b3e-da42-4522-b96c-bc0a61440ea9 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:47.110420 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-61996b3e-da42-4522-b96c-bc0a61440ea9 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:47.111586 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-61996b3e-da42-4522-b96c-bc0a61440ea9 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] 10.222.0.33 "GET /compute/v2.1/servers/f33c0e5c-fe2c-4379-b50a-08eb17062b91" status: 200 len: 1362 microversion: 2.25 time: 0.264366 Oct 04 20:37:47.112156 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 539/1077] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:37:46 2022] GET /compute/v2.1/servers/f33c0e5c-fe2c-4379-b50a-08eb17062b91 => generated 1362 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 20:37:47.232508 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-d6a86f18-9767-4e88-ac63-17d7ebe4e82b tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:47.233320 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-d6a86f18-9767-4e88-ac63-17d7ebe4e82b tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] [instance: 465ad440-a27e-4ff6-bb31-09f3545e166a] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:47.244166 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d6a86f18-9767-4e88-ac63-17d7ebe4e82b tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:47.248579 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d6a86f18-9767-4e88-ac63-17d7ebe4e82b tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:47.249147 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d6a86f18-9767-4e88-ac63-17d7ebe4e82b tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:47.249988 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d6a86f18-9767-4e88-ac63-17d7ebe4e82b tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:47.250615 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d6a86f18-9767-4e88-ac63-17d7ebe4e82b tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:47.251145 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d6a86f18-9767-4e88-ac63-17d7ebe4e82b tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:47.474236 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-d6a86f18-9767-4e88-ac63-17d7ebe4e82b tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3563efe2b8c94931a2a46c4e14811b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3118a5d96843d3bede1ed94bd9717e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:47.482308 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-d6a86f18-9767-4e88-ac63-17d7ebe4e82b tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] 10.222.0.33 "GET /compute/v2.1/servers/465ad440-a27e-4ff6-bb31-09f3545e166a" status: 200 len: 1471 microversion: 2.1 time: 0.255639 Oct 04 20:37:47.484107 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 540/1078] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:37:47 2022] GET /compute/v2.1/servers/465ad440-a27e-4ff6-bb31-09f3545e166a => generated 1471 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:37:47.509294 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-528b13a7-5843-4897-a994-43afa6d51acb tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:37:47.510645 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-528b13a7-5843-4897-a994-43afa6d51acb tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] [instance: 465ad440-a27e-4ff6-bb31-09f3545e166a] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:47.517653 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-528b13a7-5843-4897-a994-43afa6d51acb tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:47.518326 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-528b13a7-5843-4897-a994-43afa6d51acb tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:47.518905 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-528b13a7-5843-4897-a994-43afa6d51acb tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:47.520104 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-528b13a7-5843-4897-a994-43afa6d51acb tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:47.521386 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-528b13a7-5843-4897-a994-43afa6d51acb tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:47.521959 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-528b13a7-5843-4897-a994-43afa6d51acb tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:47.615287 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-528b13a7-5843-4897-a994-43afa6d51acb tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:47.615762 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-528b13a7-5843-4897-a994-43afa6d51acb tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:47.616634 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-528b13a7-5843-4897-a994-43afa6d51acb tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:47.626589 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-528b13a7-5843-4897-a994-43afa6d51acb tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:47.627423 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-528b13a7-5843-4897-a994-43afa6d51acb tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:47.627821 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-528b13a7-5843-4897-a994-43afa6d51acb tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:47.669159 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-528b13a7-5843-4897-a994-43afa6d51acb tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Getting quotas for project dd3118a5d96843d3bede1ed94bd9717e. Resources: {'ram', 'cores'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:37:47.675747 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-528b13a7-5843-4897-a994-43afa6d51acb tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Getting quotas for user 3563efe2b8c94931a2a46c4e14811b3a and project dd3118a5d96843d3bede1ed94bd9717e. Resources: {'ram', 'cores'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:37:47.682141 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-60d01b35-d830-4d4a-a689-6ca4cfb07bdc tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/62b98bc7-657a-42c2-b501-ae4d926cfa2f/action" status: 202 len: 0 microversion: 2.1 time: 3.737678 Oct 04 20:37:47.683243 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 539/1079] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 20:37:43 2022] POST /compute/v2.1/servers/62b98bc7-657a-42c2-b501-ae4d926cfa2f/action => generated 0 bytes in 3740 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 20:37:47.689093 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d2e99f61-86e6-46cf-9c99-322f1612aaab tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:47.690014 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d2e99f61-86e6-46cf-9c99-322f1612aaab tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] [instance: 5e984459-625e-44cd-b226-091276567215] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:47.714947 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d2e99f61-86e6-46cf-9c99-322f1612aaab tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:47.715736 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d2e99f61-86e6-46cf-9c99-322f1612aaab tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:47.716354 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d2e99f61-86e6-46cf-9c99-322f1612aaab tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:47.717235 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d2e99f61-86e6-46cf-9c99-322f1612aaab tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:47.718034 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d2e99f61-86e6-46cf-9c99-322f1612aaab tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:47.718793 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d2e99f61-86e6-46cf-9c99-322f1612aaab tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:47.799786 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d2e99f61-86e6-46cf-9c99-322f1612aaab tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22706a9bf4d42efb57c10cbd92c6eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0024f434015447759489d3cdc7bbaa4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:47.814306 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d2e99f61-86e6-46cf-9c99-322f1612aaab tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a22706a9bf4d42efb57c10cbd92c6eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0024f434015447759489d3cdc7bbaa4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:47.816104 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d2e99f61-86e6-46cf-9c99-322f1612aaab tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a22706a9bf4d42efb57c10cbd92c6eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0024f434015447759489d3cdc7bbaa4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:47.824985 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d2e99f61-86e6-46cf-9c99-322f1612aaab tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] 10.222.0.33 "GET /compute/v2.1/servers/5e984459-625e-44cd-b226-091276567215" status: 200 len: 1447 microversion: 2.75 time: 0.140581 Oct 04 20:37:47.826743 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 540/1080] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:37:47 2022] GET /compute/v2.1/servers/5e984459-625e-44cd-b226-091276567215 => generated 1447 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:37:47.838082 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-3331cbc2-bc0f-451b-9ab7-7dabb894cab2 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:47.839233 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-3331cbc2-bc0f-451b-9ab7-7dabb894cab2 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] [instance: 62b98bc7-657a-42c2-b501-ae4d926cfa2f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:47.846458 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3331cbc2-bc0f-451b-9ab7-7dabb894cab2 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:47.847193 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3331cbc2-bc0f-451b-9ab7-7dabb894cab2 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:47.847866 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3331cbc2-bc0f-451b-9ab7-7dabb894cab2 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:47.849025 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3331cbc2-bc0f-451b-9ab7-7dabb894cab2 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:47.849919 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3331cbc2-bc0f-451b-9ab7-7dabb894cab2 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:47.850606 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3331cbc2-bc0f-451b-9ab7-7dabb894cab2 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:47.905298 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-528b13a7-5843-4897-a994-43afa6d51acb tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] 10.222.0.33 "POST /compute/v2.1/servers/465ad440-a27e-4ff6-bb31-09f3545e166a/action" status: 202 len: 0 microversion: 2.1 time: 0.399566 Oct 04 20:37:47.909139 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 541/1081] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 20:37:47 2022] POST /compute/v2.1/servers/465ad440-a27e-4ff6-bb31-09f3545e166a/action => generated 0 bytes in 402 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 20:37:47.912780 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-a8d74c2b-6a38-4ea2-812d-c38fc7b36d22 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:47.913598 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-a8d74c2b-6a38-4ea2-812d-c38fc7b36d22 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] [instance: 9f8cc082-0a37-4123-a680-1210a90b3ca9] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:47.928235 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a8d74c2b-6a38-4ea2-812d-c38fc7b36d22 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:47.949468 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a8d74c2b-6a38-4ea2-812d-c38fc7b36d22 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:47.949970 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a8d74c2b-6a38-4ea2-812d-c38fc7b36d22 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:47.951012 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a8d74c2b-6a38-4ea2-812d-c38fc7b36d22 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:47.951525 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a8d74c2b-6a38-4ea2-812d-c38fc7b36d22 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:47.952391 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a8d74c2b-6a38-4ea2-812d-c38fc7b36d22 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:47.979344 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.wsgi [None req-a8d74c2b-6a38-4ea2-812d-c38fc7b36d22 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] HTTP exception thrown: Instance 9f8cc082-0a37-4123-a680-1210a90b3ca9 could not be found. Oct 04 20:37:47.982880 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-a8d74c2b-6a38-4ea2-812d-c38fc7b36d22 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Request method failure captured: Oct 04 20:37:47.982880 n-d-854823-8 devstack@n-api.service[128802]: request: GET /compute/v2.1/servers/9f8cc082-0a37-4123-a680-1210a90b3ca9 HTTP/1.1 Oct 04 20:37:47.982880 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 20:37:47.982880 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 20:37:47.982880 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 20:37:47.982880 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 0 Oct 04 20:37:47.982880 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 20:37:47.982880 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 20:37:47.982880 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 20:37:47.982880 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 20:37:47.982880 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPJj70pkEpfnn_riq2CJ3vbhS6uwqsmbInkczI4lwy7f-ypfW2zouEJzhVZnu6kmdfqJN8C6tm0Ejbx97ATlFhUoiOhWMbM6AcAQ9UgYSMPkh7Ybe2Gw_g9qL7w6T9EsDeNcxyJWqy6WAuAaUdTLbDnmujDsKYea49AZgSbg2L-Kungw Oct 04 20:37:47.982880 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 20:37:47.982880 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 20:37:47.982880 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 20:37:47.982880 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 20:37:47.982880 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 20:37:47.982880 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 20:37:47.982880 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: c288268acb30475bbc065a8f72cb21d5 Oct 04 20:37:47.982880 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-ServersAdminTestJSON-1951935148 Oct 04 20:37:47.982880 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 20:37:47.982880 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 20:37:47.982880 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_c288268acb30475bbc065a8f72cb21d5", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c288268acb30475bbc065a8f72cb21d5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c288268acb30475bbc065a8f72cb21d5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/c288268acb30475bbc065a8f72cb21d5"}]}] Oct 04 20:37:47.982880 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-ServersAdminTestJSON-1951935148 Oct 04 20:37:47.982880 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: c288268acb30475bbc065a8f72cb21d5 Oct 04 20:37:47.982880 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-ServersAdminTestJSON-1951935148 Oct 04 20:37:47.982880 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-ServersAdminTestJSON-1951935148-project Oct 04 20:37:47.982880 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 20:37:47.982880 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 20:37:47.982880 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: b4a24944aeb34a5ea228965be9bf4ce0 Oct 04 20:37:47.982880 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-ServersAdminTestJSON-1951935148-project Oct 04 20:37:47.982880 n-d-854823-8 devstack@n-api.service[128802]: method: > Oct 04 20:37:47.982880 n-d-854823-8 devstack@n-api.service[128802]: exception: Instance 9f8cc082-0a37-4123-a680-1210a90b3ca9 could not be found. Oct 04 20:37:47.982880 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'id': '9f8cc082-0a37-4123-a680-1210a90b3ca9'} Oct 04 20:37:47.982880 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:37:47.982880 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:37:47.982880 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:37:47.982880 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:37:47.982880 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:37:47.982880 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:37:47.982880 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:37:47.982880 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:37:47.982880 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:37:47.982880 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:37:47.982880 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f8cc082-0a37-4123-a680-1210a90b3ca9 could not be found. Oct 04 20:37:47.982880 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:37:47.982880 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:37:47.982880 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:37:47.982880 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:37:47.982880 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:37:47.982880 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:37:47.982880 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:37:47.982880 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:37:47.982880 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:37:47.982880 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:37:47.982880 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:37:47.982880 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:37:47.982880 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:37:47.982880 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:37:47.982880 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:37:47.982880 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:37:47.982880 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f8cc082-0a37-4123-a680-1210a90b3ca9 could not be found. Oct 04 20:37:47.982880 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:37:47.982880 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:37:47.982880 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:37:47.986747 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:37:47.986747 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:37:47.986747 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:37:47.986747 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:37:47.986747 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:37:47.986747 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f8cc082-0a37-4123-a680-1210a90b3ca9 could not be found. Oct 04 20:37:47.986747 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:37:47.986747 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-a8d74c2b-6a38-4ea2-812d-c38fc7b36d22 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] Returning 404 to user: Instance 9f8cc082-0a37-4123-a680-1210a90b3ca9 could not be found. {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:37:47.986747 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-a8d74c2b-6a38-4ea2-812d-c38fc7b36d22 tempest-ServersAdminTestJSON-1951935148 tempest-ServersAdminTestJSON-1951935148-project] 10.222.0.33 "GET /compute/v2.1/servers/9f8cc082-0a37-4123-a680-1210a90b3ca9" status: 404 len: 111 microversion: 2.1 time: 0.075026 Oct 04 20:37:47.986747 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 542/1082] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:37:47 2022] GET /compute/v2.1/servers/9f8cc082-0a37-4123-a680-1210a90b3ca9 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:37:47.992596 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-8037d8de-2d34-4d6a-93de-f994927e172f tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:47.993892 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-8037d8de-2d34-4d6a-93de-f994927e172f tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] [instance: 465ad440-a27e-4ff6-bb31-09f3545e166a] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:48.001140 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8037d8de-2d34-4d6a-93de-f994927e172f tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:48.001640 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8037d8de-2d34-4d6a-93de-f994927e172f tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:48.002071 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8037d8de-2d34-4d6a-93de-f994927e172f tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:48.002799 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8037d8de-2d34-4d6a-93de-f994927e172f tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:48.003253 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8037d8de-2d34-4d6a-93de-f994927e172f tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:48.003678 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8037d8de-2d34-4d6a-93de-f994927e172f tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:48.344448 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-8037d8de-2d34-4d6a-93de-f994927e172f tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3563efe2b8c94931a2a46c4e14811b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3118a5d96843d3bede1ed94bd9717e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:48.359011 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-8037d8de-2d34-4d6a-93de-f994927e172f tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] 10.222.0.33 "GET /compute/v2.1/servers/465ad440-a27e-4ff6-bb31-09f3545e166a" status: 200 len: 1470 microversion: 2.1 time: 0.374333 Oct 04 20:37:48.359526 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 543/1083] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:37:47 2022] GET /compute/v2.1/servers/465ad440-a27e-4ff6-bb31-09f3545e166a => generated 1470 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:37:48.385030 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-85386eca-7097-4cf4-afed-2a1f5d8e63bc tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:48.385661 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-85386eca-7097-4cf4-afed-2a1f5d8e63bc tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] [instance: f33c0e5c-fe2c-4379-b50a-08eb17062b91] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:48.400976 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-85386eca-7097-4cf4-afed-2a1f5d8e63bc tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:48.401475 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-85386eca-7097-4cf4-afed-2a1f5d8e63bc tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:48.401919 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-85386eca-7097-4cf4-afed-2a1f5d8e63bc tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:48.402665 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-85386eca-7097-4cf4-afed-2a1f5d8e63bc tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:48.403122 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-85386eca-7097-4cf4-afed-2a1f5d8e63bc tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:48.403545 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-85386eca-7097-4cf4-afed-2a1f5d8e63bc tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:48.438053 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-3331cbc2-bc0f-451b-9ab7-7dabb894cab2 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '800db3a57ada47eca381b00189fdbf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66ec8ea91b04deb90b679589e0495bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:48.446299 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-3331cbc2-bc0f-451b-9ab7-7dabb894cab2 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] 10.222.0.33 "GET /compute/v2.1/servers/62b98bc7-657a-42c2-b501-ae4d926cfa2f" status: 200 len: 1504 microversion: 2.1 time: 0.612914 Oct 04 20:37:48.459239 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 541/1084] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:37:47 2022] GET /compute/v2.1/servers/62b98bc7-657a-42c2-b501-ae4d926cfa2f => generated 1504 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:37:48.464627 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-be84199b-7d84-43ee-a90b-8dedfb0cc33b tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:48.469810 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-be84199b-7d84-43ee-a90b-8dedfb0cc33b tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8fa55ca3469648b0b1a2e1a29541c462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8659949e00dc429e8667767d0f126771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:48.480142 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-be84199b-7d84-43ee-a90b-8dedfb0cc33b tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] Searching by: {'deleted': False, 'project_id': '8659949e00dc429e8667767d0f126771'} {{(pid=128801) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 20:37:48.487174 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-be84199b-7d84-43ee-a90b-8dedfb0cc33b tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:48.487860 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-be84199b-7d84-43ee-a90b-8dedfb0cc33b tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:48.488483 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-be84199b-7d84-43ee-a90b-8dedfb0cc33b tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:48.495868 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-be84199b-7d84-43ee-a90b-8dedfb0cc33b tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:48.496576 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-be84199b-7d84-43ee-a90b-8dedfb0cc33b tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:48.497165 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-be84199b-7d84-43ee-a90b-8dedfb0cc33b tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:48.630956 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.multi_cell_list [None req-be84199b-7d84-43ee-a90b-8dedfb0cc33b tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128801) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 20:37:48.663994 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-85386eca-7097-4cf4-afed-2a1f5d8e63bc tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:48.674334 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-85386eca-7097-4cf4-afed-2a1f5d8e63bc tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:48.676447 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-85386eca-7097-4cf4-afed-2a1f5d8e63bc tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:48.677825 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-85386eca-7097-4cf4-afed-2a1f5d8e63bc tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] 10.222.0.33 "GET /compute/v2.1/servers/f33c0e5c-fe2c-4379-b50a-08eb17062b91" status: 200 len: 1362 microversion: 2.25 time: 0.301908 Oct 04 20:37:48.678897 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 544/1085] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:37:48 2022] GET /compute/v2.1/servers/f33c0e5c-fe2c-4379-b50a-08eb17062b91 => generated 1362 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:37:48.706102 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-be84199b-7d84-43ee-a90b-8dedfb0cc33b tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] 10.222.0.33 "GET /compute/v2.1/servers" status: 200 len: 339 microversion: 2.1 time: 0.245436 Oct 04 20:37:48.715279 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 542/1086] 10.222.0.33 () {58 vars in 1125 bytes} [Tue Oct 4 20:37:48 2022] GET /compute/v2.1/servers => generated 339 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:37:48.721949 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-8575e577-9a4a-4274-b875-98fa68ba397c tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:48.728278 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-8575e577-9a4a-4274-b875-98fa68ba397c tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8fa55ca3469648b0b1a2e1a29541c462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8659949e00dc429e8667767d0f126771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:48.729564 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-8575e577-9a4a-4274-b875-98fa68ba397c tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] Searching by: {'deleted': False, 'project_id': '8659949e00dc429e8667767d0f126771'} {{(pid=128802) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 20:37:48.735753 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8575e577-9a4a-4274-b875-98fa68ba397c tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:48.736581 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8575e577-9a4a-4274-b875-98fa68ba397c tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:48.737203 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8575e577-9a4a-4274-b875-98fa68ba397c tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:48.738154 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8575e577-9a4a-4274-b875-98fa68ba397c tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:48.738972 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8575e577-9a4a-4274-b875-98fa68ba397c tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:48.739698 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8575e577-9a4a-4274-b875-98fa68ba397c tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:48.772577 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.multi_cell_list [None req-8575e577-9a4a-4274-b875-98fa68ba397c tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128802) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 20:37:48.822237 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-8575e577-9a4a-4274-b875-98fa68ba397c tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa55ca3469648b0b1a2e1a29541c462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8659949e00dc429e8667767d0f126771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:48.829578 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8575e577-9a4a-4274-b875-98fa68ba397c tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:48.830465 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8575e577-9a4a-4274-b875-98fa68ba397c tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:48.831084 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8575e577-9a4a-4274-b875-98fa68ba397c tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:48.856915 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f9255ec5-a619-48ae-833a-2c3729123abf tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:48.857439 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f9255ec5-a619-48ae-833a-2c3729123abf tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] [instance: 5e984459-625e-44cd-b226-091276567215] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:48.867917 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f9255ec5-a619-48ae-833a-2c3729123abf tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:48.898861 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f9255ec5-a619-48ae-833a-2c3729123abf tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:48.898861 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f9255ec5-a619-48ae-833a-2c3729123abf tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:48.898861 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f9255ec5-a619-48ae-833a-2c3729123abf tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:48.898861 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f9255ec5-a619-48ae-833a-2c3729123abf tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:48.898861 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f9255ec5-a619-48ae-833a-2c3729123abf tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:48.999864 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f9255ec5-a619-48ae-833a-2c3729123abf tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22706a9bf4d42efb57c10cbd92c6eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0024f434015447759489d3cdc7bbaa4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:49.018005 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-8575e577-9a4a-4274-b875-98fa68ba397c tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] 10.222.0.33 "GET /compute/v2.1/servers/detail" status: 200 len: 1710 microversion: 2.1 time: 0.299942 Oct 04 20:37:49.019320 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 545/1087] 10.222.0.33 () {58 vars in 1146 bytes} [Tue Oct 4 20:37:48 2022] GET /compute/v2.1/servers/detail => generated 1710 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:37:49.030877 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f9255ec5-a619-48ae-833a-2c3729123abf tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a22706a9bf4d42efb57c10cbd92c6eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0024f434015447759489d3cdc7bbaa4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:49.032892 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f9255ec5-a619-48ae-833a-2c3729123abf tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a22706a9bf4d42efb57c10cbd92c6eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0024f434015447759489d3cdc7bbaa4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:49.046700 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-58fc9d93-0788-4484-a149-5ce3c11d6de5 tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:49.053452 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f9255ec5-a619-48ae-833a-2c3729123abf tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] 10.222.0.33 "GET /compute/v2.1/servers/5e984459-625e-44cd-b226-091276567215" status: 200 len: 1447 microversion: 2.75 time: 0.200310 Oct 04 20:37:49.055602 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 543/1088] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:37:48 2022] GET /compute/v2.1/servers/5e984459-625e-44cd-b226-091276567215 => generated 1447 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 20:37:49.059890 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-58fc9d93-0788-4484-a149-5ce3c11d6de5 tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] 10.222.0.33 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.019859 Oct 04 20:37:49.068414 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 546/1089] 10.222.0.33 () {58 vars in 1137 bytes} [Tue Oct 4 20:37:49 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 20:37:49.202033 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-326e8850-cf85-44de-8b41-9f244bdddeed tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "46cf45ea-fecc-44e2-8e73-7f7892c24148"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:37:49.206092 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-326e8850-cf85-44de-8b41-9f244bdddeed tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] [instance: 7d9db253-559a-4d4b-9a5e-42c8f63f6cb7] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:49.214119 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-326e8850-cf85-44de-8b41-9f244bdddeed tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:49.214698 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-326e8850-cf85-44de-8b41-9f244bdddeed tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:49.215274 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-326e8850-cf85-44de-8b41-9f244bdddeed tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:49.216267 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-326e8850-cf85-44de-8b41-9f244bdddeed tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:49.216704 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-326e8850-cf85-44de-8b41-9f244bdddeed tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:49.217197 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-326e8850-cf85-44de-8b41-9f244bdddeed tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:49.388870 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-513e6613-67f7-498f-a6ad-255ee57b75be tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:49.390613 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-513e6613-67f7-498f-a6ad-255ee57b75be tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] [instance: 465ad440-a27e-4ff6-bb31-09f3545e166a] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:49.409131 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-513e6613-67f7-498f-a6ad-255ee57b75be tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:49.409131 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-513e6613-67f7-498f-a6ad-255ee57b75be tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:49.409131 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-513e6613-67f7-498f-a6ad-255ee57b75be tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:49.409131 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-513e6613-67f7-498f-a6ad-255ee57b75be tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:49.409131 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-513e6613-67f7-498f-a6ad-255ee57b75be tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:49.409131 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-513e6613-67f7-498f-a6ad-255ee57b75be tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:49.612943 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-513e6613-67f7-498f-a6ad-255ee57b75be tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3563efe2b8c94931a2a46c4e14811b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3118a5d96843d3bede1ed94bd9717e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:49.627265 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-513e6613-67f7-498f-a6ad-255ee57b75be tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] 10.222.0.33 "GET /compute/v2.1/servers/465ad440-a27e-4ff6-bb31-09f3545e166a" status: 200 len: 1470 microversion: 2.1 time: 0.244422 Oct 04 20:37:49.628017 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 547/1090] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:37:49 2022] GET /compute/v2.1/servers/465ad440-a27e-4ff6-bb31-09f3545e166a => generated 1470 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:37:49.633810 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-6d41f8b1-f305-4c91-8640-e13879f46201 tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:49.634821 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-6d41f8b1-f305-4c91-8640-e13879f46201 tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] [instance: 33bf1c5a-fbf7-4db1-b2c8-e4ab05149f25] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:49.644143 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6d41f8b1-f305-4c91-8640-e13879f46201 tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:49.645220 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6d41f8b1-f305-4c91-8640-e13879f46201 tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:49.646072 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6d41f8b1-f305-4c91-8640-e13879f46201 tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:49.647175 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6d41f8b1-f305-4c91-8640-e13879f46201 tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:49.648575 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6d41f8b1-f305-4c91-8640-e13879f46201 tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:49.649126 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6d41f8b1-f305-4c91-8640-e13879f46201 tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:49.685717 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-326e8850-cf85-44de-8b41-9f244bdddeed tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] 10.222.0.33 "POST /compute/v2.1/servers/7d9db253-559a-4d4b-9a5e-42c8f63f6cb7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.488094 Oct 04 20:37:49.694671 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 544/1091] 10.222.0.33 () {60 vars in 1323 bytes} [Tue Oct 4 20:37:49 2022] POST /compute/v2.1/servers/7d9db253-559a-4d4b-9a5e-42c8f63f6cb7/os-volume_attachments => generated 194 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:37:49.714640 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-6d41f8b1-f305-4c91-8640-e13879f46201 tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] [instance: 33bf1c5a-fbf7-4db1-b2c8-e4ab05149f25] Going to try to terminate instance {{(pid=128802) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:37:49.733157 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-958fd4e9-5f68-4838-82cf-a1178a43f8fd tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:49.736690 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-958fd4e9-5f68-4838-82cf-a1178a43f8fd tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] [instance: 62b98bc7-657a-42c2-b501-ae4d926cfa2f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:49.750098 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-958fd4e9-5f68-4838-82cf-a1178a43f8fd tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:49.750623 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-958fd4e9-5f68-4838-82cf-a1178a43f8fd tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:49.752335 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-958fd4e9-5f68-4838-82cf-a1178a43f8fd tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:49.753156 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-958fd4e9-5f68-4838-82cf-a1178a43f8fd tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:49.755220 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-958fd4e9-5f68-4838-82cf-a1178a43f8fd tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:49.755892 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-958fd4e9-5f68-4838-82cf-a1178a43f8fd tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:49.799362 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:37:49.899568 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:37:49.946238 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-6d41f8b1-f305-4c91-8640-e13879f46201 tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] 10.222.0.33 "DELETE /compute/v2.1/servers/33bf1c5a-fbf7-4db1-b2c8-e4ab05149f25" status: 204 len: 0 microversion: 2.1 time: 0.316735 Oct 04 20:37:49.952611 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 548/1092] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 20:37:49 2022] DELETE /compute/v2.1/servers/33bf1c5a-fbf7-4db1-b2c8-e4ab05149f25 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:37:49.968950 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-2f9287ef-c1b7-41ea-a93a-54a2deee4a0a tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:49.970996 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-2f9287ef-c1b7-41ea-a93a-54a2deee4a0a tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] [instance: f33c0e5c-fe2c-4379-b50a-08eb17062b91] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:49.993265 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2f9287ef-c1b7-41ea-a93a-54a2deee4a0a tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:49.999322 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2f9287ef-c1b7-41ea-a93a-54a2deee4a0a tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:49.999848 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2f9287ef-c1b7-41ea-a93a-54a2deee4a0a tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:50.014190 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2f9287ef-c1b7-41ea-a93a-54a2deee4a0a tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:50.014722 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2f9287ef-c1b7-41ea-a93a-54a2deee4a0a tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:50.015470 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2f9287ef-c1b7-41ea-a93a-54a2deee4a0a tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:50.400321 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-958fd4e9-5f68-4838-82cf-a1178a43f8fd tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '800db3a57ada47eca381b00189fdbf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66ec8ea91b04deb90b679589e0495bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:50.419979 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-958fd4e9-5f68-4838-82cf-a1178a43f8fd tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] 10.222.0.33 "GET /compute/v2.1/servers/62b98bc7-657a-42c2-b501-ae4d926cfa2f" status: 200 len: 1504 microversion: 2.1 time: 0.715939 Oct 04 20:37:50.424597 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 545/1093] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:37:49 2022] GET /compute/v2.1/servers/62b98bc7-657a-42c2-b501-ae4d926cfa2f => generated 1504 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:37:50.440700 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2998c0a3-83ea-4f38-a330-ad9006b54e44 tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:50.445525 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-2998c0a3-83ea-4f38-a330-ad9006b54e44 tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] [instance: 33bf1c5a-fbf7-4db1-b2c8-e4ab05149f25] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:50.460893 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2998c0a3-83ea-4f38-a330-ad9006b54e44 tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:50.461732 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2998c0a3-83ea-4f38-a330-ad9006b54e44 tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:50.462778 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2998c0a3-83ea-4f38-a330-ad9006b54e44 tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:50.468143 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2998c0a3-83ea-4f38-a330-ad9006b54e44 tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:50.468966 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2998c0a3-83ea-4f38-a330-ad9006b54e44 tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:50.469486 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2998c0a3-83ea-4f38-a330-ad9006b54e44 tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:50.493644 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-2f9287ef-c1b7-41ea-a93a-54a2deee4a0a tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:50.503744 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-2f9287ef-c1b7-41ea-a93a-54a2deee4a0a tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:50.515688 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-2f9287ef-c1b7-41ea-a93a-54a2deee4a0a tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:50.518086 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-2f9287ef-c1b7-41ea-a93a-54a2deee4a0a tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] 10.222.0.33 "GET /compute/v2.1/servers/f33c0e5c-fe2c-4379-b50a-08eb17062b91" status: 200 len: 1362 microversion: 2.25 time: 0.566858 Oct 04 20:37:50.519181 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 549/1094] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:37:49 2022] GET /compute/v2.1/servers/f33c0e5c-fe2c-4379-b50a-08eb17062b91 => generated 1362 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:37:50.543482 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-27e599af-aeb3-4718-bbd2-dd314b2d31e6 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:50.544632 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-27e599af-aeb3-4718-bbd2-dd314b2d31e6 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] [instance: 5e984459-625e-44cd-b226-091276567215] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:50.560245 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-27e599af-aeb3-4718-bbd2-dd314b2d31e6 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:50.560797 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-27e599af-aeb3-4718-bbd2-dd314b2d31e6 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:50.561237 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-27e599af-aeb3-4718-bbd2-dd314b2d31e6 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:50.561965 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-27e599af-aeb3-4718-bbd2-dd314b2d31e6 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:50.570951 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-27e599af-aeb3-4718-bbd2-dd314b2d31e6 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:50.572099 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-27e599af-aeb3-4718-bbd2-dd314b2d31e6 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:50.732693 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-27e599af-aeb3-4718-bbd2-dd314b2d31e6 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22706a9bf4d42efb57c10cbd92c6eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0024f434015447759489d3cdc7bbaa4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:50.737408 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-2998c0a3-83ea-4f38-a330-ad9006b54e44 tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa55ca3469648b0b1a2e1a29541c462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8659949e00dc429e8667767d0f126771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:50.745067 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-27e599af-aeb3-4718-bbd2-dd314b2d31e6 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a22706a9bf4d42efb57c10cbd92c6eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0024f434015447759489d3cdc7bbaa4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:50.747121 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-27e599af-aeb3-4718-bbd2-dd314b2d31e6 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a22706a9bf4d42efb57c10cbd92c6eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0024f434015447759489d3cdc7bbaa4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:50.749064 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-2998c0a3-83ea-4f38-a330-ad9006b54e44 tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] 10.222.0.33 "GET /compute/v2.1/servers/33bf1c5a-fbf7-4db1-b2c8-e4ab05149f25" status: 200 len: 1713 microversion: 2.1 time: 0.316572 Oct 04 20:37:50.753486 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 546/1095] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:37:50 2022] GET /compute/v2.1/servers/33bf1c5a-fbf7-4db1-b2c8-e4ab05149f25 => generated 1713 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:37:50.763199 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-79f1a759-4b79-473a-8c10-136ae76ed4e3 req-e8b061f0-ad81-4952-959c-2cac5a4bb1cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f33c0e5c-fe2c-4379-b50a-08eb17062b91", "name": "network-vif-plugged", "status": "completed", "tag": "619319cb-49b8-4e19-a3ae-04ba59d88700"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:37:50.764586 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-27e599af-aeb3-4718-bbd2-dd314b2d31e6 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] 10.222.0.33 "GET /compute/v2.1/servers/5e984459-625e-44cd-b226-091276567215" status: 200 len: 1453 microversion: 2.75 time: 0.243835 Oct 04 20:37:50.777764 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 550/1096] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:37:50 2022] GET /compute/v2.1/servers/5e984459-625e-44cd-b226-091276567215 => generated 1453 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:37:50.777993 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-79f1a759-4b79-473a-8c10-136ae76ed4e3 req-e8b061f0-ad81-4952-959c-2cac5a4bb1cd service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:50.777993 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-79f1a759-4b79-473a-8c10-136ae76ed4e3 req-e8b061f0-ad81-4952-959c-2cac5a4bb1cd service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:50.777993 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-79f1a759-4b79-473a-8c10-136ae76ed4e3 req-e8b061f0-ad81-4952-959c-2cac5a4bb1cd service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:50.778266 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-53cd2f4c-49c6-47a9-a6a1-93d10b132501 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:50.778266 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-53cd2f4c-49c6-47a9-a6a1-93d10b132501 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] [instance: 465ad440-a27e-4ff6-bb31-09f3545e166a] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:50.785627 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-53cd2f4c-49c6-47a9-a6a1-93d10b132501 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:50.786645 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-53cd2f4c-49c6-47a9-a6a1-93d10b132501 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:50.787285 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-53cd2f4c-49c6-47a9-a6a1-93d10b132501 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:50.787999 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-53cd2f4c-49c6-47a9-a6a1-93d10b132501 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:50.788453 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-53cd2f4c-49c6-47a9-a6a1-93d10b132501 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:50.788629 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-79f1a759-4b79-473a-8c10-136ae76ed4e3 req-e8b061f0-ad81-4952-959c-2cac5a4bb1cd service nova] Creating event network-vif-plugged:619319cb-49b8-4e19-a3ae-04ba59d88700 for instance f33c0e5c-fe2c-4379-b50a-08eb17062b91 on n-h2-854823-8 Oct 04 20:37:50.788877 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-53cd2f4c-49c6-47a9-a6a1-93d10b132501 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:50.795254 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-79f1a759-4b79-473a-8c10-136ae76ed4e3 req-e8b061f0-ad81-4952-959c-2cac5a4bb1cd service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040482 Oct 04 20:37:50.796231 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 547/1097] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:37:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:37:50.975108 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-53cd2f4c-49c6-47a9-a6a1-93d10b132501 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3563efe2b8c94931a2a46c4e14811b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3118a5d96843d3bede1ed94bd9717e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:50.986157 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-53cd2f4c-49c6-47a9-a6a1-93d10b132501 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] 10.222.0.33 "GET /compute/v2.1/servers/465ad440-a27e-4ff6-bb31-09f3545e166a" status: 200 len: 1470 microversion: 2.1 time: 0.219758 Oct 04 20:37:50.986921 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 551/1098] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:37:50 2022] GET /compute/v2.1/servers/465ad440-a27e-4ff6-bb31-09f3545e166a => generated 1470 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:37:51.122738 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0a2b72d0-5b83-4bfa-8454-1a693785047b tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestBootFromVolume-server-707968055", "imageRef": "", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "4d612ef0-d5bb-4055-a923-dcd4627b5413"}], "security_groups": [{"name": "tempest-securitygroup--1048216256"}], "key_name": "tempest-keypair-1873046423", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "7bfb1b1d-8436-43f9-b105-5844352dbfd8", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "OS-DCF:diskConfig": "}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:37:51.251630 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.network.neutron [None req-0a2b72d0-5b83-4bfa-8454-1a693785047b tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] validate_networks() for [('4d612ef0-d5bb-4055-a923-dcd4627b5413', None, None, None, None, None)] {{(pid=128801) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:37:51.449209 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-e7f7122b-2acb-4972-805f-e7836eae6972 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:51.449827 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-e7f7122b-2acb-4972-805f-e7836eae6972 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] [instance: 62b98bc7-657a-42c2-b501-ae4d926cfa2f] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:51.461062 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e7f7122b-2acb-4972-805f-e7836eae6972 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:51.462443 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e7f7122b-2acb-4972-805f-e7836eae6972 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:51.462443 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e7f7122b-2acb-4972-805f-e7836eae6972 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:51.464827 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e7f7122b-2acb-4972-805f-e7836eae6972 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:51.464827 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e7f7122b-2acb-4972-805f-e7836eae6972 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:51.464827 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e7f7122b-2acb-4972-805f-e7836eae6972 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:52.155085 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-e7f7122b-2acb-4972-805f-e7836eae6972 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '800db3a57ada47eca381b00189fdbf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66ec8ea91b04deb90b679589e0495bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:52.163683 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-e7f7122b-2acb-4972-805f-e7836eae6972 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] 10.222.0.33 "GET /compute/v2.1/servers/62b98bc7-657a-42c2-b501-ae4d926cfa2f" status: 200 len: 1504 microversion: 2.1 time: 0.718205 Oct 04 20:37:52.179230 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 552/1099] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:37:51 2022] GET /compute/v2.1/servers/62b98bc7-657a-42c2-b501-ae4d926cfa2f => generated 1504 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:37:52.192520 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-197beeae-dc8e-43fb-a807-4fd71991b1c1 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:52.193246 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-197beeae-dc8e-43fb-a807-4fd71991b1c1 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] [instance: f33c0e5c-fe2c-4379-b50a-08eb17062b91] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:52.203345 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-197beeae-dc8e-43fb-a807-4fd71991b1c1 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:52.204131 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-197beeae-dc8e-43fb-a807-4fd71991b1c1 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:52.204788 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-197beeae-dc8e-43fb-a807-4fd71991b1c1 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:52.205666 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-197beeae-dc8e-43fb-a807-4fd71991b1c1 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:52.206324 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-197beeae-dc8e-43fb-a807-4fd71991b1c1 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:52.206955 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-197beeae-dc8e-43fb-a807-4fd71991b1c1 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:52.476166 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-197beeae-dc8e-43fb-a807-4fd71991b1c1 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:52.494547 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-197beeae-dc8e-43fb-a807-4fd71991b1c1 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:52.496815 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-197beeae-dc8e-43fb-a807-4fd71991b1c1 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:52.499236 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-197beeae-dc8e-43fb-a807-4fd71991b1c1 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] 10.222.0.33 "GET /compute/v2.1/servers/f33c0e5c-fe2c-4379-b50a-08eb17062b91" status: 200 len: 1362 microversion: 2.25 time: 0.317591 Oct 04 20:37:52.510371 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 553/1100] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:37:52 2022] GET /compute/v2.1/servers/f33c0e5c-fe2c-4379-b50a-08eb17062b91 => generated 1362 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:37:52.510818 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-28fb4e4e-9754-4702-a72b-b1827d3aab2e tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:52.511665 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-28fb4e4e-9754-4702-a72b-b1827d3aab2e tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] [instance: 33bf1c5a-fbf7-4db1-b2c8-e4ab05149f25] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:52.523112 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-0a2b72d0-5b83-4bfa-8454-1a693785047b tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Getting quotas for project f3e0d8329b2c4d64bf51d88948ca0de2. Resources: dict_keys(['metadata_items']) {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:37:52.524618 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-28fb4e4e-9754-4702-a72b-b1827d3aab2e tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:52.526808 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-28fb4e4e-9754-4702-a72b-b1827d3aab2e tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:52.527476 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-28fb4e4e-9754-4702-a72b-b1827d3aab2e tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:52.528895 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-28fb4e4e-9754-4702-a72b-b1827d3aab2e tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:52.529028 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-0a2b72d0-5b83-4bfa-8454-1a693785047b tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Getting quotas for user 11149c46e1bc468f836fe70635dbf33b and project f3e0d8329b2c4d64bf51d88948ca0de2. Resources: dict_keys(['metadata_items']) {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:37:52.537471 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-28fb4e4e-9754-4702-a72b-b1827d3aab2e tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:52.538183 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-28fb4e4e-9754-4702-a72b-b1827d3aab2e tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:52.547168 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-0a2b72d0-5b83-4bfa-8454-1a693785047b tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Flavor limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:37:52.547737 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-0a2b72d0-5b83-4bfa-8454-1a693785047b tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Image limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:37:52.548316 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-0a2b72d0-5b83-4bfa-8454-1a693785047b tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Flavor pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:37:52.548821 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-0a2b72d0-5b83-4bfa-8454-1a693785047b tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Image pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:37:52.549361 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-0a2b72d0-5b83-4bfa-8454-1a693785047b tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:37:52.562739 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0a2b72d0-5b83-4bfa-8454-1a693785047b tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:52.563372 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0a2b72d0-5b83-4bfa-8454-1a693785047b tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:52.563914 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0a2b72d0-5b83-4bfa-8454-1a693785047b tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:52.564836 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0a2b72d0-5b83-4bfa-8454-1a693785047b tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:52.565394 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0a2b72d0-5b83-4bfa-8454-1a693785047b tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:52.566028 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0a2b72d0-5b83-4bfa-8454-1a693785047b tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:52.589865 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-0a2b72d0-5b83-4bfa-8454-1a693785047b tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Getting quotas for project f3e0d8329b2c4d64bf51d88948ca0de2. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:37:52.605939 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-0a2b72d0-5b83-4bfa-8454-1a693785047b tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Getting quotas for user 11149c46e1bc468f836fe70635dbf33b and project f3e0d8329b2c4d64bf51d88948ca0de2. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:37:52.680402 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-0a2b72d0-5b83-4bfa-8454-1a693785047b tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Going to run 1 instances... {{(pid=128801) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:37:52.683170 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-0a2b72d0-5b83-4bfa-8454-1a693785047b tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] [instance: 5ac07e56-084c-4208-a988-13ec91af9171] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7bfb1b1d-8436-43f9-b105-5844352dbfd8',volume_size=None,volume_type=None)] {{(pid=128801) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:37:52.903847 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-28fb4e4e-9754-4702-a72b-b1827d3aab2e tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa55ca3469648b0b1a2e1a29541c462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8659949e00dc429e8667767d0f126771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:52.918790 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-28fb4e4e-9754-4702-a72b-b1827d3aab2e tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] 10.222.0.33 "GET /compute/v2.1/servers/33bf1c5a-fbf7-4db1-b2c8-e4ab05149f25" status: 200 len: 1645 microversion: 2.1 time: 0.415941 Oct 04 20:37:52.937464 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 554/1101] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:37:52 2022] GET /compute/v2.1/servers/33bf1c5a-fbf7-4db1-b2c8-e4ab05149f25 => generated 1645 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:37:52.942618 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-0a2b72d0-5b83-4bfa-8454-1a693785047b tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 1.824026 Oct 04 20:37:52.945248 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 548/1102] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 20:37:51 2022] POST /compute/v2.1/servers => generated 407 bytes in 1829 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 20:37:52.959751 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-1d9251a9-9c49-4dfb-bb73-1e6cc1c06962 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:52.960364 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-1d9251a9-9c49-4dfb-bb73-1e6cc1c06962 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] [instance: 5e984459-625e-44cd-b226-091276567215] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:52.979756 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1d9251a9-9c49-4dfb-bb73-1e6cc1c06962 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:52.992585 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1d9251a9-9c49-4dfb-bb73-1e6cc1c06962 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:52.993775 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1d9251a9-9c49-4dfb-bb73-1e6cc1c06962 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:52.995123 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1d9251a9-9c49-4dfb-bb73-1e6cc1c06962 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:52.995737 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1d9251a9-9c49-4dfb-bb73-1e6cc1c06962 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:52.997400 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1d9251a9-9c49-4dfb-bb73-1e6cc1c06962 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:53.121690 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-1d9251a9-9c49-4dfb-bb73-1e6cc1c06962 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22706a9bf4d42efb57c10cbd92c6eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0024f434015447759489d3cdc7bbaa4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:53.129995 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-1d9251a9-9c49-4dfb-bb73-1e6cc1c06962 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a22706a9bf4d42efb57c10cbd92c6eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0024f434015447759489d3cdc7bbaa4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:53.132629 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-1d9251a9-9c49-4dfb-bb73-1e6cc1c06962 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a22706a9bf4d42efb57c10cbd92c6eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0024f434015447759489d3cdc7bbaa4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:53.142797 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-1d9251a9-9c49-4dfb-bb73-1e6cc1c06962 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] 10.222.0.33 "GET /compute/v2.1/servers/5e984459-625e-44cd-b226-091276567215" status: 200 len: 1453 microversion: 2.75 time: 0.187362 Oct 04 20:37:53.146515 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 555/1103] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:37:52 2022] GET /compute/v2.1/servers/5e984459-625e-44cd-b226-091276567215 => generated 1453 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:37:53.158653 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-4f8132e1-7a4b-41f5-bef6-298527ab4625 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:53.159350 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-4f8132e1-7a4b-41f5-bef6-298527ab4625 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] [instance: 465ad440-a27e-4ff6-bb31-09f3545e166a] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:53.171280 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4f8132e1-7a4b-41f5-bef6-298527ab4625 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:53.179455 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4f8132e1-7a4b-41f5-bef6-298527ab4625 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:53.180369 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4f8132e1-7a4b-41f5-bef6-298527ab4625 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:53.181802 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4f8132e1-7a4b-41f5-bef6-298527ab4625 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:53.182718 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4f8132e1-7a4b-41f5-bef6-298527ab4625 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:53.183555 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4f8132e1-7a4b-41f5-bef6-298527ab4625 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:53.197115 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2631e6d9-aad6-4827-91ef-b383bd5a4dd7 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-718874102", "imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63", "flavorRef": "452"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:37:53.278761 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.network.neutron [None req-2631e6d9-aad6-4827-91ef-b383bd5a4dd7 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] validate_networks() for None {{(pid=128801) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:37:53.681898 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-4f8132e1-7a4b-41f5-bef6-298527ab4625 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3563efe2b8c94931a2a46c4e14811b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3118a5d96843d3bede1ed94bd9717e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:53.708530 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-4f8132e1-7a4b-41f5-bef6-298527ab4625 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] 10.222.0.33 "GET /compute/v2.1/servers/465ad440-a27e-4ff6-bb31-09f3545e166a" status: 200 len: 1470 microversion: 2.1 time: 0.560809 Oct 04 20:37:53.709524 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 556/1104] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:37:53 2022] GET /compute/v2.1/servers/465ad440-a27e-4ff6-bb31-09f3545e166a => generated 1470 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:37:53.738280 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-99ad0863-68c5-4311-9fa0-4d813cd59e9c req-749f4534-aa73-4a44-9b19-050e7f6e3f41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33bf1c5a-fbf7-4db1-b2c8-e4ab05149f25", "name": "network-vif-deleted", "tag": "57e9c24e-f645-45f4-9a9c-48ab34ee6f74"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:37:53.764203 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-99ad0863-68c5-4311-9fa0-4d813cd59e9c req-749f4534-aa73-4a44-9b19-050e7f6e3f41 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:53.765131 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-99ad0863-68c5-4311-9fa0-4d813cd59e9c req-749f4534-aa73-4a44-9b19-050e7f6e3f41 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:53.765727 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-99ad0863-68c5-4311-9fa0-4d813cd59e9c req-749f4534-aa73-4a44-9b19-050e7f6e3f41 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:53.789551 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-99ad0863-68c5-4311-9fa0-4d813cd59e9c req-749f4534-aa73-4a44-9b19-050e7f6e3f41 service nova] Creating event network-vif-deleted:57e9c24e-f645-45f4-9a9c-48ab34ee6f74 for instance 33bf1c5a-fbf7-4db1-b2c8-e4ab05149f25 on n-h1-854823-8 Oct 04 20:37:53.800333 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-99ad0863-68c5-4311-9fa0-4d813cd59e9c req-749f4534-aa73-4a44-9b19-050e7f6e3f41 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089212 Oct 04 20:37:53.810307 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 557/1105] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:37:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:37:53.816607 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-2649fd8f-eb00-4e8f-977d-0a6366d54701 req-a8d7ab1b-a2a6-445a-9e00-502539c9150b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "465ad440-a27e-4ff6-bb31-09f3545e166a", "name": "network-vif-plugged", "status": "completed", "tag": "c16cb04f-6af6-4073-98de-ed8d89a2e3c2"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:37:53.848670 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-2649fd8f-eb00-4e8f-977d-0a6366d54701 req-a8d7ab1b-a2a6-445a-9e00-502539c9150b service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:53.849935 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-2649fd8f-eb00-4e8f-977d-0a6366d54701 req-a8d7ab1b-a2a6-445a-9e00-502539c9150b service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:53.850646 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-2649fd8f-eb00-4e8f-977d-0a6366d54701 req-a8d7ab1b-a2a6-445a-9e00-502539c9150b service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:53.869640 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-2649fd8f-eb00-4e8f-977d-0a6366d54701 req-a8d7ab1b-a2a6-445a-9e00-502539c9150b service nova] Creating event network-vif-plugged:c16cb04f-6af6-4073-98de-ed8d89a2e3c2 for instance 465ad440-a27e-4ff6-bb31-09f3545e166a on n-h2-854823-8 Oct 04 20:37:53.878569 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [req-2649fd8f-eb00-4e8f-977d-0a6366d54701 req-a8d7ab1b-a2a6-445a-9e00-502539c9150b service nova] Instance 465ad440-a27e-4ff6-bb31-09f3545e166a is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854823-8'} {{(pid=128802) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 20:37:53.890994 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-2649fd8f-eb00-4e8f-977d-0a6366d54701 req-a8d7ab1b-a2a6-445a-9e00-502539c9150b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077871 Oct 04 20:37:53.892076 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 558/1106] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:37:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:37:53.901724 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-a6b7c0eb-7552-42a5-b9e9-150b3c98b6a2 tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:53.902602 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-a6b7c0eb-7552-42a5-b9e9-150b3c98b6a2 tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] [instance: 5ac07e56-084c-4208-a988-13ec91af9171] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:53.910016 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a6b7c0eb-7552-42a5-b9e9-150b3c98b6a2 tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:53.911319 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a6b7c0eb-7552-42a5-b9e9-150b3c98b6a2 tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:53.912111 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a6b7c0eb-7552-42a5-b9e9-150b3c98b6a2 tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:53.913279 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a6b7c0eb-7552-42a5-b9e9-150b3c98b6a2 tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:53.913943 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a6b7c0eb-7552-42a5-b9e9-150b3c98b6a2 tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:53.914959 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a6b7c0eb-7552-42a5-b9e9-150b3c98b6a2 tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:54.021955 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-2631e6d9-aad6-4827-91ef-b383bd5a4dd7 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Flavor limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:37:54.022549 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-2631e6d9-aad6-4827-91ef-b383bd5a4dd7 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Image limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:37:54.022881 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-2631e6d9-aad6-4827-91ef-b383bd5a4dd7 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Flavor pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:37:54.023349 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-2631e6d9-aad6-4827-91ef-b383bd5a4dd7 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Image pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:37:54.023771 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-2631e6d9-aad6-4827-91ef-b383bd5a4dd7 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:37:54.040729 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2631e6d9-aad6-4827-91ef-b383bd5a4dd7 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:54.041590 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2631e6d9-aad6-4827-91ef-b383bd5a4dd7 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:54.042031 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2631e6d9-aad6-4827-91ef-b383bd5a4dd7 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:54.042863 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2631e6d9-aad6-4827-91ef-b383bd5a4dd7 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:54.043320 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2631e6d9-aad6-4827-91ef-b383bd5a4dd7 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:54.043747 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2631e6d9-aad6-4827-91ef-b383bd5a4dd7 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:54.064982 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-a6b7c0eb-7552-42a5-b9e9-150b3c98b6a2 tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11149c46e1bc468f836fe70635dbf33b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e0d8329b2c4d64bf51d88948ca0de2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:54.100042 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-a6b7c0eb-7552-42a5-b9e9-150b3c98b6a2 tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] 10.222.0.33 "GET /compute/v2.1/servers/5ac07e56-084c-4208-a988-13ec91af9171" status: 200 len: 1171 microversion: 2.1 time: 0.203829 Oct 04 20:37:54.103629 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 559/1107] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:37:53 2022] GET /compute/v2.1/servers/5ac07e56-084c-4208-a988-13ec91af9171 => generated 1171 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:37:54.111205 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-1e5efb96-f9c4-4150-a19c-ed403490c749 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:54.112232 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-1e5efb96-f9c4-4150-a19c-ed403490c749 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] [instance: 62b98bc7-657a-42c2-b501-ae4d926cfa2f] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:54.141544 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-2631e6d9-aad6-4827-91ef-b383bd5a4dd7 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Getting quotas for project 1a23a85365414f92bbc03177d7f190e6. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:37:54.144016 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1e5efb96-f9c4-4150-a19c-ed403490c749 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:54.146359 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1e5efb96-f9c4-4150-a19c-ed403490c749 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:54.148268 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1e5efb96-f9c4-4150-a19c-ed403490c749 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:54.150737 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1e5efb96-f9c4-4150-a19c-ed403490c749 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:54.151671 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1e5efb96-f9c4-4150-a19c-ed403490c749 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:54.152634 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1e5efb96-f9c4-4150-a19c-ed403490c749 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:54.153491 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-2631e6d9-aad6-4827-91ef-b383bd5a4dd7 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Getting quotas for user e36f4114dc4f443f8b48da7b4027e0c1 and project 1a23a85365414f92bbc03177d7f190e6. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:37:54.197246 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-2631e6d9-aad6-4827-91ef-b383bd5a4dd7 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Going to run 1 instances... {{(pid=128801) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:37:54.210128 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-2631e6d9-aad6-4827-91ef-b383bd5a4dd7 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] [instance: 42726a57-cdc8-45e3-8d61-348f02bfcd53] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='15b24725-0c99-4bcf-b1fb-907cdf8e2d63',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128801) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:37:54.291337 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-2631e6d9-aad6-4827-91ef-b383bd5a4dd7 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.344823 Oct 04 20:37:54.302033 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 549/1108] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 20:37:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 1356 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 20:37:54.325016 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-02895883-ee66-4a1f-ac53-c9019c9e5622 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:54.325647 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-02895883-ee66-4a1f-ac53-c9019c9e5622 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] [instance: f33c0e5c-fe2c-4379-b50a-08eb17062b91] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:54.348501 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-02895883-ee66-4a1f-ac53-c9019c9e5622 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:54.349012 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-02895883-ee66-4a1f-ac53-c9019c9e5622 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:54.350037 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-02895883-ee66-4a1f-ac53-c9019c9e5622 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:54.350964 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-02895883-ee66-4a1f-ac53-c9019c9e5622 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:54.351427 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-02895883-ee66-4a1f-ac53-c9019c9e5622 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:54.352212 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-02895883-ee66-4a1f-ac53-c9019c9e5622 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:54.575105 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-1e5efb96-f9c4-4150-a19c-ed403490c749 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '800db3a57ada47eca381b00189fdbf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66ec8ea91b04deb90b679589e0495bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:54.586540 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-1e5efb96-f9c4-4150-a19c-ed403490c749 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] 10.222.0.33 "GET /compute/v2.1/servers/62b98bc7-657a-42c2-b501-ae4d926cfa2f" status: 200 len: 1504 microversion: 2.1 time: 0.481243 Oct 04 20:37:54.603451 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 560/1109] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:37:54 2022] GET /compute/v2.1/servers/62b98bc7-657a-42c2-b501-ae4d926cfa2f => generated 1504 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:37:54.608118 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-45ef829f-4ab3-46d5-bf06-7bb5d2aaf604 tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:54.608944 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-45ef829f-4ab3-46d5-bf06-7bb5d2aaf604 tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] [instance: 33bf1c5a-fbf7-4db1-b2c8-e4ab05149f25] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:54.617048 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-45ef829f-4ab3-46d5-bf06-7bb5d2aaf604 tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:54.617864 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-45ef829f-4ab3-46d5-bf06-7bb5d2aaf604 tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:54.618510 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-45ef829f-4ab3-46d5-bf06-7bb5d2aaf604 tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:54.619413 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-45ef829f-4ab3-46d5-bf06-7bb5d2aaf604 tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:54.620047 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-45ef829f-4ab3-46d5-bf06-7bb5d2aaf604 tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:54.620642 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-45ef829f-4ab3-46d5-bf06-7bb5d2aaf604 tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:54.636512 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.wsgi [None req-45ef829f-4ab3-46d5-bf06-7bb5d2aaf604 tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] HTTP exception thrown: Instance 33bf1c5a-fbf7-4db1-b2c8-e4ab05149f25 could not be found. Oct 04 20:37:54.638628 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-45ef829f-4ab3-46d5-bf06-7bb5d2aaf604 tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] Request method failure captured: Oct 04 20:37:54.638628 n-d-854823-8 devstack@n-api.service[128802]: request: GET /compute/v2.1/servers/33bf1c5a-fbf7-4db1-b2c8-e4ab05149f25 HTTP/1.1 Oct 04 20:37:54.638628 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 20:37:54.638628 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 20:37:54.638628 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 20:37:54.638628 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 0 Oct 04 20:37:54.638628 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 20:37:54.638628 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 20:37:54.638628 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 20:37:54.638628 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 20:37:54.638628 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPJlJPtU6HBCGL3WvT1FyLRvg-no5vqgsntLiaOx-ZBRrAXVAcRILRrBZ5odPuPsYqEjOZ1U4NI5hSinD8JGnkaV-omg5ud57FajomAEEWMVrdwBBx0Z0-92zk1hVYlsjRVcJt72mP7A-RGagH33bVRbM7HqJBN0igW7TFrCWf1V73Bw Oct 04 20:37:54.638628 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 20:37:54.638628 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 20:37:54.638628 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 20:37:54.638628 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 20:37:54.638628 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 20:37:54.638628 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 20:37:54.638628 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: 8659949e00dc429e8667767d0f126771 Oct 04 20:37:54.638628 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-ServersTestManualDisk-2033835306 Oct 04 20:37:54.638628 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 20:37:54.638628 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 20:37:54.638628 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_8659949e00dc429e8667767d0f126771", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8659949e00dc429e8667767d0f126771"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8659949e00dc429e8667767d0f126771"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/8659949e00dc429e8667767d0f126771"}]}] Oct 04 20:37:54.638628 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-ServersTestManualDisk-2033835306 Oct 04 20:37:54.638628 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: 8659949e00dc429e8667767d0f126771 Oct 04 20:37:54.638628 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-ServersTestManualDisk-2033835306 Oct 04 20:37:54.638628 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-ServersTestManualDisk-2033835306-project Oct 04 20:37:54.638628 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 20:37:54.638628 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 20:37:54.638628 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: 8fa55ca3469648b0b1a2e1a29541c462 Oct 04 20:37:54.638628 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-ServersTestManualDisk-2033835306-project Oct 04 20:37:54.638628 n-d-854823-8 devstack@n-api.service[128802]: method: > Oct 04 20:37:54.638628 n-d-854823-8 devstack@n-api.service[128802]: exception: Instance 33bf1c5a-fbf7-4db1-b2c8-e4ab05149f25 could not be found. Oct 04 20:37:54.638628 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'id': '33bf1c5a-fbf7-4db1-b2c8-e4ab05149f25'} Oct 04 20:37:54.638628 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:37:54.638628 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:37:54.638628 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:37:54.638628 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:37:54.638628 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:37:54.638628 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:37:54.638628 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:37:54.638628 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:37:54.638628 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:37:54.638628 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:37:54.638628 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33bf1c5a-fbf7-4db1-b2c8-e4ab05149f25 could not be found. Oct 04 20:37:54.638628 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:37:54.638628 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:37:54.638628 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:37:54.638628 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:37:54.638628 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:37:54.638628 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:37:54.638628 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:37:54.638628 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:37:54.638628 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:37:54.638628 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:37:54.638628 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:37:54.638628 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:37:54.638628 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:37:54.638628 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:37:54.638628 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:37:54.638628 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:37:54.638628 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33bf1c5a-fbf7-4db1-b2c8-e4ab05149f25 could not be found. Oct 04 20:37:54.638628 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:37:54.638628 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:37:54.638628 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:37:54.642967 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:37:54.642967 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:37:54.642967 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:37:54.642967 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:37:54.642967 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:37:54.642967 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33bf1c5a-fbf7-4db1-b2c8-e4ab05149f25 could not be found. Oct 04 20:37:54.642967 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:37:54.645294 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-45ef829f-4ab3-46d5-bf06-7bb5d2aaf604 tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] Returning 404 to user: Instance 33bf1c5a-fbf7-4db1-b2c8-e4ab05149f25 could not be found. {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:37:54.646680 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-45ef829f-4ab3-46d5-bf06-7bb5d2aaf604 tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] 10.222.0.33 "GET /compute/v2.1/servers/33bf1c5a-fbf7-4db1-b2c8-e4ab05149f25" status: 404 len: 111 microversion: 2.1 time: 0.042612 Oct 04 20:37:54.647498 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 561/1110] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:37:54 2022] GET /compute/v2.1/servers/33bf1c5a-fbf7-4db1-b2c8-e4ab05149f25 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:37:54.658744 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-02895883-ee66-4a1f-ac53-c9019c9e5622 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:54.661783 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-621dc5f8-0b66-43af-8ed6-6d8f9937ae91 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:54.664921 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-621dc5f8-0b66-43af-8ed6-6d8f9937ae91 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] [instance: 5e984459-625e-44cd-b226-091276567215] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:54.668693 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-02895883-ee66-4a1f-ac53-c9019c9e5622 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:54.675705 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-02895883-ee66-4a1f-ac53-c9019c9e5622 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:54.677114 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-621dc5f8-0b66-43af-8ed6-6d8f9937ae91 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:54.677991 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-621dc5f8-0b66-43af-8ed6-6d8f9937ae91 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:54.678464 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-621dc5f8-0b66-43af-8ed6-6d8f9937ae91 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:54.679308 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-621dc5f8-0b66-43af-8ed6-6d8f9937ae91 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:54.679969 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-621dc5f8-0b66-43af-8ed6-6d8f9937ae91 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:54.680603 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-621dc5f8-0b66-43af-8ed6-6d8f9937ae91 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:54.683373 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-02895883-ee66-4a1f-ac53-c9019c9e5622 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] 10.222.0.33 "GET /compute/v2.1/servers/f33c0e5c-fe2c-4379-b50a-08eb17062b91" status: 200 len: 1558 microversion: 2.25 time: 0.379867 Oct 04 20:37:54.684170 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 550/1111] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:37:54 2022] GET /compute/v2.1/servers/f33c0e5c-fe2c-4379-b50a-08eb17062b91 => generated 1558 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:37:54.715898 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-69787dbd-9ce8-46a5-8833-6335f0d9e10d tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:54.717264 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-69787dbd-9ce8-46a5-8833-6335f0d9e10d tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] [instance: 42726a57-cdc8-45e3-8d61-348f02bfcd53] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:54.799613 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-621dc5f8-0b66-43af-8ed6-6d8f9937ae91 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22706a9bf4d42efb57c10cbd92c6eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0024f434015447759489d3cdc7bbaa4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:54.808793 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-621dc5f8-0b66-43af-8ed6-6d8f9937ae91 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a22706a9bf4d42efb57c10cbd92c6eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0024f434015447759489d3cdc7bbaa4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:54.810254 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-621dc5f8-0b66-43af-8ed6-6d8f9937ae91 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a22706a9bf4d42efb57c10cbd92c6eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0024f434015447759489d3cdc7bbaa4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:54.830642 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-621dc5f8-0b66-43af-8ed6-6d8f9937ae91 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] 10.222.0.33 "GET /compute/v2.1/servers/5e984459-625e-44cd-b226-091276567215" status: 200 len: 1438 microversion: 2.75 time: 0.181759 Oct 04 20:37:54.831593 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 562/1112] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:37:54 2022] GET /compute/v2.1/servers/5e984459-625e-44cd-b226-091276567215 => generated 1438 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:37:54.846557 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-a995860f-7063-45e1-ba1f-43325831e98c tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] Calling method '.version_select at 0x7f3c74564e50>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:54.891735 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-a995860f-7063-45e1-ba1f-43325831e98c tempest-ServersTestManualDisk-2033835306 tempest-ServersTestManualDisk-2033835306-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-921654706" status: 202 len: 0 microversion: 2.1 time: 0.057054 Oct 04 20:37:54.894439 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 563/1113] 10.222.0.33 () {58 vars in 1218 bytes} [Tue Oct 4 20:37:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-921654706 => generated 0 bytes in 61 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:37:54.907922 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-69787dbd-9ce8-46a5-8833-6335f0d9e10d tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36f4114dc4f443f8b48da7b4027e0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a23a85365414f92bbc03177d7f190e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:54.923002 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-0e9cba1a-f05d-4c6f-8cd0-c028da48fb3a tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:54.925440 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-69787dbd-9ce8-46a5-8833-6335f0d9e10d tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] 10.222.0.33 "GET /compute/v2.1/servers/42726a57-cdc8-45e3-8d61-348f02bfcd53" status: 200 len: 1216 microversion: 2.1 time: 0.223525 Oct 04 20:37:54.925844 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-0e9cba1a-f05d-4c6f-8cd0-c028da48fb3a tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] [instance: f33c0e5c-fe2c-4379-b50a-08eb17062b91] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:54.928807 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 551/1114] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:37:54 2022] GET /compute/v2.1/servers/42726a57-cdc8-45e3-8d61-348f02bfcd53 => generated 1216 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:37:54.953662 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7b2b5342-2e46-4d85-94f8-0a5983158d02 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:54.955334 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-7b2b5342-2e46-4d85-94f8-0a5983158d02 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] [instance: 465ad440-a27e-4ff6-bb31-09f3545e166a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:54.956877 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0e9cba1a-f05d-4c6f-8cd0-c028da48fb3a tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:54.961529 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0e9cba1a-f05d-4c6f-8cd0-c028da48fb3a tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:54.962547 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0e9cba1a-f05d-4c6f-8cd0-c028da48fb3a tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:54.965315 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7b2b5342-2e46-4d85-94f8-0a5983158d02 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:54.966200 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7b2b5342-2e46-4d85-94f8-0a5983158d02 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:54.966853 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7b2b5342-2e46-4d85-94f8-0a5983158d02 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:54.968241 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7b2b5342-2e46-4d85-94f8-0a5983158d02 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:54.968990 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7b2b5342-2e46-4d85-94f8-0a5983158d02 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:54.969115 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0e9cba1a-f05d-4c6f-8cd0-c028da48fb3a tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:54.969840 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0e9cba1a-f05d-4c6f-8cd0-c028da48fb3a tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:54.971362 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7b2b5342-2e46-4d85-94f8-0a5983158d02 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:54.972132 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0e9cba1a-f05d-4c6f-8cd0-c028da48fb3a tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:54.980084 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:37:55.391560 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-7b2b5342-2e46-4d85-94f8-0a5983158d02 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3563efe2b8c94931a2a46c4e14811b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3118a5d96843d3bede1ed94bd9717e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:55.404925 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-7b2b5342-2e46-4d85-94f8-0a5983158d02 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] 10.222.0.33 "GET /compute/v2.1/servers/465ad440-a27e-4ff6-bb31-09f3545e166a" status: 200 len: 1470 microversion: 2.1 time: 0.473148 Oct 04 20:37:55.425189 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 552/1115] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:37:54 2022] GET /compute/v2.1/servers/465ad440-a27e-4ff6-bb31-09f3545e166a => generated 1470 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:37:55.461849 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.objects.instance [None req-0e9cba1a-f05d-4c6f-8cd0-c028da48fb3a tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] Lazy-loading 'services' on Instance uuid f33c0e5c-fe2c-4379-b50a-08eb17062b91 {{(pid=128802) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:37:55.488817 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-0e9cba1a-f05d-4c6f-8cd0-c028da48fb3a tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/f33c0e5c-fe2c-4379-b50a-08eb17062b91" status: 200 len: 2051 microversion: 2.25 time: 0.591137 Oct 04 20:37:55.492786 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 564/1116] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:37:54 2022] GET /compute/v2.1/servers/f33c0e5c-fe2c-4379-b50a-08eb17062b91 => generated 2051 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:37:55.523018 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-c77ea29c-8abf-4774-a23b-8ab0776eb429 req-73e2d76a-49c0-4d2a-aefc-83ec7e70de88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62b98bc7-657a-42c2-b501-ae4d926cfa2f", "name": "network-vif-unplugged", "status": "completed", "tag": "7e9ad1e9-b4f0-48a2-b19c-30f06d92c931"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:37:55.548546 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-c77ea29c-8abf-4774-a23b-8ab0776eb429 req-73e2d76a-49c0-4d2a-aefc-83ec7e70de88 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:55.563116 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-c77ea29c-8abf-4774-a23b-8ab0776eb429 req-73e2d76a-49c0-4d2a-aefc-83ec7e70de88 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:55.564891 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-c77ea29c-8abf-4774-a23b-8ab0776eb429 req-73e2d76a-49c0-4d2a-aefc-83ec7e70de88 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:55.591457 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-c77ea29c-8abf-4774-a23b-8ab0776eb429 req-73e2d76a-49c0-4d2a-aefc-83ec7e70de88 service nova] Creating event network-vif-unplugged:7e9ad1e9-b4f0-48a2-b19c-30f06d92c931 for instance 62b98bc7-657a-42c2-b501-ae4d926cfa2f on n-h1-854823-8 Oct 04 20:37:55.599439 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-c77ea29c-8abf-4774-a23b-8ab0776eb429 req-73e2d76a-49c0-4d2a-aefc-83ec7e70de88 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.105175 Oct 04 20:37:55.600838 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 565/1117] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:37:55 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:37:55.606945 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-905f92cf-506e-4c70-b8bb-8c78278e5622 tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:55.608385 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-905f92cf-506e-4c70-b8bb-8c78278e5622 tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] [instance: 5ac07e56-084c-4208-a988-13ec91af9171] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:55.621845 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-905f92cf-506e-4c70-b8bb-8c78278e5622 tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:55.622330 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-905f92cf-506e-4c70-b8bb-8c78278e5622 tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:55.623010 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-905f92cf-506e-4c70-b8bb-8c78278e5622 tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:55.634625 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-905f92cf-506e-4c70-b8bb-8c78278e5622 tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:55.635344 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-905f92cf-506e-4c70-b8bb-8c78278e5622 tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:55.636147 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-905f92cf-506e-4c70-b8bb-8c78278e5622 tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:55.732475 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-39d13375-c8e5-4a14-b5ad-b81fd632d638 tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:37:55.735236 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-39d13375-c8e5-4a14-b5ad-b81fd632d638 tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] [instance: 5e984459-625e-44cd-b226-091276567215] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:55.748118 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-39d13375-c8e5-4a14-b5ad-b81fd632d638 tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:55.748600 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-39d13375-c8e5-4a14-b5ad-b81fd632d638 tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:55.749033 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-39d13375-c8e5-4a14-b5ad-b81fd632d638 tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:55.749733 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-39d13375-c8e5-4a14-b5ad-b81fd632d638 tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:55.752759 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-39d13375-c8e5-4a14-b5ad-b81fd632d638 tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:55.753389 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-39d13375-c8e5-4a14-b5ad-b81fd632d638 tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:55.903588 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-39d13375-c8e5-4a14-b5ad-b81fd632d638 tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] Flavor limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:37:55.904497 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-39d13375-c8e5-4a14-b5ad-b81fd632d638 tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] Image limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:37:55.905334 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-39d13375-c8e5-4a14-b5ad-b81fd632d638 tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] Flavor pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:37:55.905962 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-39d13375-c8e5-4a14-b5ad-b81fd632d638 tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] Image pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:37:55.906643 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-39d13375-c8e5-4a14-b5ad-b81fd632d638 tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:37:55.923250 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-905f92cf-506e-4c70-b8bb-8c78278e5622 tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11149c46e1bc468f836fe70635dbf33b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e0d8329b2c4d64bf51d88948ca0de2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:55.938266 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-905f92cf-506e-4c70-b8bb-8c78278e5622 tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] 10.222.0.33 "GET /compute/v2.1/servers/5ac07e56-084c-4208-a988-13ec91af9171" status: 200 len: 1237 microversion: 2.1 time: 0.335873 Oct 04 20:37:55.951726 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 566/1118] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:37:55 2022] GET /compute/v2.1/servers/5ac07e56-084c-4208-a988-13ec91af9171 => generated 1237 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:37:55.964997 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-01aa9643-786c-4de0-ad33-3c8108eea868 tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:55.965646 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-01aa9643-786c-4de0-ad33-3c8108eea868 tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] [instance: f33c0e5c-fe2c-4379-b50a-08eb17062b91] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:55.992037 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-01aa9643-786c-4de0-ad33-3c8108eea868 tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:55.995059 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-01aa9643-786c-4de0-ad33-3c8108eea868 tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:55.995628 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-01aa9643-786c-4de0-ad33-3c8108eea868 tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:55.998608 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-01aa9643-786c-4de0-ad33-3c8108eea868 tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:55.999185 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-01aa9643-786c-4de0-ad33-3c8108eea868 tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:56.000075 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-01aa9643-786c-4de0-ad33-3c8108eea868 tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:56.067458 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-39d13375-c8e5-4a14-b5ad-b81fd632d638 tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] [instance: 5e984459-625e-44cd-b226-091276567215] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:56.081215 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-39d13375-c8e5-4a14-b5ad-b81fd632d638 tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:56.085821 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-39d13375-c8e5-4a14-b5ad-b81fd632d638 tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:56.086409 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-39d13375-c8e5-4a14-b5ad-b81fd632d638 tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:56.087428 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-39d13375-c8e5-4a14-b5ad-b81fd632d638 tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:56.087898 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-39d13375-c8e5-4a14-b5ad-b81fd632d638 tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:56.091968 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-39d13375-c8e5-4a14-b5ad-b81fd632d638 tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:56.290226 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:37:56.311788 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.objects.instance [None req-01aa9643-786c-4de0-ad33-3c8108eea868 tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] Lazy-loading 'services' on Instance uuid f33c0e5c-fe2c-4379-b50a-08eb17062b91 {{(pid=128802) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:37:56.364401 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-39d13375-c8e5-4a14-b5ad-b81fd632d638 tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] Lazy-loading 'services' on Instance uuid 5e984459-625e-44cd-b226-091276567215 {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:37:56.365332 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-01aa9643-786c-4de0-ad33-3c8108eea868 tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/f33c0e5c-fe2c-4379-b50a-08eb17062b91" status: 200 len: 2051 microversion: 2.25 time: 0.410184 Oct 04 20:37:56.383389 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 567/1119] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:37:55 2022] GET /compute/v2.1/servers/f33c0e5c-fe2c-4379-b50a-08eb17062b91 => generated 2051 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:37:56.385632 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-39d13375-c8e5-4a14-b5ad-b81fd632d638 tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/5e984459-625e-44cd-b226-091276567215/action" status: 202 len: 1942 microversion: 2.75 time: 0.959162 Oct 04 20:37:56.386872 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 553/1120] 10.222.0.33 () {62 vars in 1319 bytes} [Tue Oct 4 20:37:55 2022] POST /compute/v2.1/servers/5e984459-625e-44cd-b226-091276567215/action => generated 1942 bytes in 961 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 04 20:37:56.396597 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-3897ce35-96c4-435a-a380-c7598f265eac tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:56.400543 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d14f059f-eef9-4087-aac3-ac891c4e042b tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:56.401848 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d14f059f-eef9-4087-aac3-ac891c4e042b tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] [instance: 42726a57-cdc8-45e3-8d61-348f02bfcd53] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:56.404588 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-3897ce35-96c4-435a-a380-c7598f265eac tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] [instance: 62b98bc7-657a-42c2-b501-ae4d926cfa2f] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:56.414843 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d14f059f-eef9-4087-aac3-ac891c4e042b tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:56.415339 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d14f059f-eef9-4087-aac3-ac891c4e042b tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:56.415774 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d14f059f-eef9-4087-aac3-ac891c4e042b tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:56.416481 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d14f059f-eef9-4087-aac3-ac891c4e042b tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:56.416933 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d14f059f-eef9-4087-aac3-ac891c4e042b tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:56.417352 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d14f059f-eef9-4087-aac3-ac891c4e042b tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:56.418045 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3897ce35-96c4-435a-a380-c7598f265eac tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:56.418792 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3897ce35-96c4-435a-a380-c7598f265eac tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:56.419434 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3897ce35-96c4-435a-a380-c7598f265eac tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:56.420853 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3897ce35-96c4-435a-a380-c7598f265eac tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:56.421664 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3897ce35-96c4-435a-a380-c7598f265eac tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:56.423726 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3897ce35-96c4-435a-a380-c7598f265eac tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:56.512028 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d14f059f-eef9-4087-aac3-ac891c4e042b tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36f4114dc4f443f8b48da7b4027e0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a23a85365414f92bbc03177d7f190e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:56.528903 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d14f059f-eef9-4087-aac3-ac891c4e042b tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] 10.222.0.33 "GET /compute/v2.1/servers/42726a57-cdc8-45e3-8d61-348f02bfcd53" status: 200 len: 1276 microversion: 2.1 time: 0.140662 Oct 04 20:37:56.532868 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 554/1121] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:37:56 2022] GET /compute/v2.1/servers/42726a57-cdc8-45e3-8d61-348f02bfcd53 => generated 1276 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:37:56.540733 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-85e40c61-7881-448b-82c7-e5f419be7b59 tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:56.545420 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-85e40c61-7881-448b-82c7-e5f419be7b59 tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:56.546096 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-85e40c61-7881-448b-82c7-e5f419be7b59 tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:56.547939 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-85e40c61-7881-448b-82c7-e5f419be7b59 tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:56.549002 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-85e40c61-7881-448b-82c7-e5f419be7b59 tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:56.550039 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-85e40c61-7881-448b-82c7-e5f419be7b59 tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:56.550568 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-85e40c61-7881-448b-82c7-e5f419be7b59 tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:56.616297 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-85e40c61-7881-448b-82c7-e5f419be7b59 tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.079687 Oct 04 20:37:56.617113 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 555/1122] 10.222.0.33 () {60 vars in 1217 bytes} [Tue Oct 4 20:37:56 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 20:37:56.630894 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-729e91f5-c865-4897-8fb2-47891fdb5f80 tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:56.631562 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-729e91f5-c865-4897-8fb2-47891fdb5f80 tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] [instance: 5e984459-625e-44cd-b226-091276567215] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:56.644626 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-729e91f5-c865-4897-8fb2-47891fdb5f80 tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:56.645724 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-729e91f5-c865-4897-8fb2-47891fdb5f80 tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:56.646159 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-729e91f5-c865-4897-8fb2-47891fdb5f80 tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:56.647457 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-729e91f5-c865-4897-8fb2-47891fdb5f80 tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:56.647457 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-729e91f5-c865-4897-8fb2-47891fdb5f80 tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:56.647751 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-729e91f5-c865-4897-8fb2-47891fdb5f80 tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:56.729855 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-3897ce35-96c4-435a-a380-c7598f265eac tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '800db3a57ada47eca381b00189fdbf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66ec8ea91b04deb90b679589e0495bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:56.739981 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-3897ce35-96c4-435a-a380-c7598f265eac tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] 10.222.0.33 "GET /compute/v2.1/servers/62b98bc7-657a-42c2-b501-ae4d926cfa2f" status: 200 len: 1504 microversion: 2.1 time: 0.354580 Oct 04 20:37:56.759355 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 568/1123] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:37:56 2022] GET /compute/v2.1/servers/62b98bc7-657a-42c2-b501-ae4d926cfa2f => generated 1504 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:37:56.768875 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-acbd2d6a-9b43-45fa-9a9d-99206f37e7fb tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:56.769482 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-acbd2d6a-9b43-45fa-9a9d-99206f37e7fb tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] [instance: 465ad440-a27e-4ff6-bb31-09f3545e166a] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:56.801353 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-acbd2d6a-9b43-45fa-9a9d-99206f37e7fb tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:56.802123 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-acbd2d6a-9b43-45fa-9a9d-99206f37e7fb tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:56.805126 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-acbd2d6a-9b43-45fa-9a9d-99206f37e7fb tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:56.806202 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-acbd2d6a-9b43-45fa-9a9d-99206f37e7fb tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:56.806967 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-729e91f5-c865-4897-8fb2-47891fdb5f80 tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] Lazy-loading 'services' on Instance uuid 5e984459-625e-44cd-b226-091276567215 {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:37:56.808217 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-acbd2d6a-9b43-45fa-9a9d-99206f37e7fb tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:56.808655 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-acbd2d6a-9b43-45fa-9a9d-99206f37e7fb tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:56.838610 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-729e91f5-c865-4897-8fb2-47891fdb5f80 tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/5e984459-625e-44cd-b226-091276567215" status: 200 len: 1929 microversion: 2.75 time: 0.218522 Oct 04 20:37:56.840089 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 556/1124] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:37:56 2022] GET /compute/v2.1/servers/5e984459-625e-44cd-b226-091276567215 => generated 1929 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:37:56.855591 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-203db688-7a9f-4e40-a5f9-695ae3980af4 tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:37:56.856517 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-203db688-7a9f-4e40-a5f9-695ae3980af4 tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] [instance: f33c0e5c-fe2c-4379-b50a-08eb17062b91] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:56.871061 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-203db688-7a9f-4e40-a5f9-695ae3980af4 tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:56.875274 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-203db688-7a9f-4e40-a5f9-695ae3980af4 tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:56.876039 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-203db688-7a9f-4e40-a5f9-695ae3980af4 tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:56.877052 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-203db688-7a9f-4e40-a5f9-695ae3980af4 tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:56.877724 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-203db688-7a9f-4e40-a5f9-695ae3980af4 tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:56.878392 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-203db688-7a9f-4e40-a5f9-695ae3980af4 tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:57.006808 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-acbd2d6a-9b43-45fa-9a9d-99206f37e7fb tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3563efe2b8c94931a2a46c4e14811b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3118a5d96843d3bede1ed94bd9717e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:57.017900 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-acbd2d6a-9b43-45fa-9a9d-99206f37e7fb tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] 10.222.0.33 "GET /compute/v2.1/servers/465ad440-a27e-4ff6-bb31-09f3545e166a" status: 200 len: 1470 microversion: 2.1 time: 0.256315 Oct 04 20:37:57.030840 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 569/1125] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:37:56 2022] GET /compute/v2.1/servers/465ad440-a27e-4ff6-bb31-09f3545e166a => generated 1470 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:37:57.030840 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-2f0a12ae-74e4-4002-acc9-45436cc9ec19 tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:57.030840 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-2f0a12ae-74e4-4002-acc9-45436cc9ec19 tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] [instance: 5ac07e56-084c-4208-a988-13ec91af9171] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:57.036577 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2f0a12ae-74e4-4002-acc9-45436cc9ec19 tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:57.037145 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2f0a12ae-74e4-4002-acc9-45436cc9ec19 tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:57.037711 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2f0a12ae-74e4-4002-acc9-45436cc9ec19 tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:57.038576 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2f0a12ae-74e4-4002-acc9-45436cc9ec19 tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:57.039148 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2f0a12ae-74e4-4002-acc9-45436cc9ec19 tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:57.039635 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2f0a12ae-74e4-4002-acc9-45436cc9ec19 tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:57.050498 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-203db688-7a9f-4e40-a5f9-695ae3980af4 tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/f33c0e5c-fe2c-4379-b50a-08eb17062b91/action" status: 202 len: 0 microversion: 2.25 time: 0.208191 Oct 04 20:37:57.054934 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 557/1126] 10.222.0.33 () {62 vars in 1319 bytes} [Tue Oct 4 20:37:56 2022] POST /compute/v2.1/servers/f33c0e5c-fe2c-4379-b50a-08eb17062b91/action => generated 0 bytes in 211 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:37:57.064828 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6559f3ad-7b16-4e55-ac40-6a3cc8f1fa20 tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:57.066224 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-6559f3ad-7b16-4e55-ac40-6a3cc8f1fa20 tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] [instance: f33c0e5c-fe2c-4379-b50a-08eb17062b91] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:57.077462 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6559f3ad-7b16-4e55-ac40-6a3cc8f1fa20 tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:57.077901 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6559f3ad-7b16-4e55-ac40-6a3cc8f1fa20 tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:57.078357 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6559f3ad-7b16-4e55-ac40-6a3cc8f1fa20 tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:57.082733 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6559f3ad-7b16-4e55-ac40-6a3cc8f1fa20 tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:57.083090 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6559f3ad-7b16-4e55-ac40-6a3cc8f1fa20 tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:57.083578 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6559f3ad-7b16-4e55-ac40-6a3cc8f1fa20 tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:57.445836 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-2f0a12ae-74e4-4002-acc9-45436cc9ec19 tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11149c46e1bc468f836fe70635dbf33b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e0d8329b2c4d64bf51d88948ca0de2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:57.456656 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-2f0a12ae-74e4-4002-acc9-45436cc9ec19 tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] 10.222.0.33 "GET /compute/v2.1/servers/5ac07e56-084c-4208-a988-13ec91af9171" status: 200 len: 1305 microversion: 2.1 time: 0.434414 Oct 04 20:37:57.474448 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 570/1127] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:37:57 2022] GET /compute/v2.1/servers/5ac07e56-084c-4208-a988-13ec91af9171 => generated 1305 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:37:57.555413 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-64b03c75-a2e7-4148-a2d6-42e27dd79db8 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:57.556036 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-64b03c75-a2e7-4148-a2d6-42e27dd79db8 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] [instance: 42726a57-cdc8-45e3-8d61-348f02bfcd53] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:57.572180 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-64b03c75-a2e7-4148-a2d6-42e27dd79db8 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:57.573337 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-64b03c75-a2e7-4148-a2d6-42e27dd79db8 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:57.573337 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-64b03c75-a2e7-4148-a2d6-42e27dd79db8 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:57.574025 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-64b03c75-a2e7-4148-a2d6-42e27dd79db8 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:57.574518 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-64b03c75-a2e7-4148-a2d6-42e27dd79db8 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:57.574970 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-64b03c75-a2e7-4148-a2d6-42e27dd79db8 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:57.581725 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-6559f3ad-7b16-4e55-ac40-6a3cc8f1fa20 tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] Lazy-loading 'services' on Instance uuid f33c0e5c-fe2c-4379-b50a-08eb17062b91 {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:37:57.628501 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-6559f3ad-7b16-4e55-ac40-6a3cc8f1fa20 tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/f33c0e5c-fe2c-4379-b50a-08eb17062b91" status: 200 len: 2056 microversion: 2.25 time: 0.572127 Oct 04 20:37:57.636751 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 558/1128] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:37:57 2022] GET /compute/v2.1/servers/f33c0e5c-fe2c-4379-b50a-08eb17062b91 => generated 2056 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:37:57.755449 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-5fea3e29-8e86-474f-ada9-c0d7dacee348 req-b57c0d89-2321-46fd-9b9c-f3f0761c79cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62b98bc7-657a-42c2-b501-ae4d926cfa2f", "tag": "7e9ad1e9-b4f0-48a2-b19c-30f06d92c931"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:37:57.790711 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-5fea3e29-8e86-474f-ada9-c0d7dacee348 req-b57c0d89-2321-46fd-9b9c-f3f0761c79cf service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:57.791789 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-5fea3e29-8e86-474f-ada9-c0d7dacee348 req-b57c0d89-2321-46fd-9b9c-f3f0761c79cf service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:57.793428 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-5fea3e29-8e86-474f-ada9-c0d7dacee348 req-b57c0d89-2321-46fd-9b9c-f3f0761c79cf service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:57.816633 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-64b03c75-a2e7-4148-a2d6-42e27dd79db8 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36f4114dc4f443f8b48da7b4027e0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a23a85365414f92bbc03177d7f190e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:57.827374 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-5fea3e29-8e86-474f-ada9-c0d7dacee348 req-b57c0d89-2321-46fd-9b9c-f3f0761c79cf service nova] Creating event network-changed:7e9ad1e9-b4f0-48a2-b19c-30f06d92c931 for instance 62b98bc7-657a-42c2-b501-ae4d926cfa2f on n-h1-854823-8 Oct 04 20:37:57.828608 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-64b03c75-a2e7-4148-a2d6-42e27dd79db8 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] 10.222.0.33 "GET /compute/v2.1/servers/42726a57-cdc8-45e3-8d61-348f02bfcd53" status: 200 len: 1274 microversion: 2.1 time: 0.278749 Oct 04 20:37:57.832150 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 571/1129] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:37:57 2022] GET /compute/v2.1/servers/42726a57-cdc8-45e3-8d61-348f02bfcd53 => generated 1274 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:37:57.836759 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-5fea3e29-8e86-474f-ada9-c0d7dacee348 req-b57c0d89-2321-46fd-9b9c-f3f0761c79cf service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088799 Oct 04 20:37:57.838297 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 559/1130] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:37:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:37:57.840655 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-6db09184-e13a-41c4-a8ba-f4bba77ebc27 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:57.841258 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-6db09184-e13a-41c4-a8ba-f4bba77ebc27 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] [instance: 62b98bc7-657a-42c2-b501-ae4d926cfa2f] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:57.858624 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6db09184-e13a-41c4-a8ba-f4bba77ebc27 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:57.859153 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6db09184-e13a-41c4-a8ba-f4bba77ebc27 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:57.859732 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6db09184-e13a-41c4-a8ba-f4bba77ebc27 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:57.860290 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6db09184-e13a-41c4-a8ba-f4bba77ebc27 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:57.862533 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6db09184-e13a-41c4-a8ba-f4bba77ebc27 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:57.862533 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6db09184-e13a-41c4-a8ba-f4bba77ebc27 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:57.886006 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8e6632eb-45ca-4a27-ac78-f30298176897 tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:57.887433 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-8e6632eb-45ca-4a27-ac78-f30298176897 tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] [instance: 5e984459-625e-44cd-b226-091276567215] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:57.897904 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:37:57.914217 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8e6632eb-45ca-4a27-ac78-f30298176897 tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:57.915669 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8e6632eb-45ca-4a27-ac78-f30298176897 tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:57.917634 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8e6632eb-45ca-4a27-ac78-f30298176897 tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:57.918539 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8e6632eb-45ca-4a27-ac78-f30298176897 tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:57.919756 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8e6632eb-45ca-4a27-ac78-f30298176897 tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:57.923858 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8e6632eb-45ca-4a27-ac78-f30298176897 tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:58.086031 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-8e6632eb-45ca-4a27-ac78-f30298176897 tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] Lazy-loading 'services' on Instance uuid 5e984459-625e-44cd-b226-091276567215 {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:37:58.112593 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-8e6632eb-45ca-4a27-ac78-f30298176897 tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/5e984459-625e-44cd-b226-091276567215" status: 200 len: 1929 microversion: 2.75 time: 0.247929 Oct 04 20:37:58.114395 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 560/1131] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:37:57 2022] GET /compute/v2.1/servers/5e984459-625e-44cd-b226-091276567215 => generated 1929 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 20:37:58.124328 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7494e937-25f8-40d8-a697-cf5445e09caf tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:58.125272 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-7494e937-25f8-40d8-a697-cf5445e09caf tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] [instance: 465ad440-a27e-4ff6-bb31-09f3545e166a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:58.145004 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7494e937-25f8-40d8-a697-cf5445e09caf tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:58.146006 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7494e937-25f8-40d8-a697-cf5445e09caf tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:58.151086 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7494e937-25f8-40d8-a697-cf5445e09caf tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:58.152197 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7494e937-25f8-40d8-a697-cf5445e09caf tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:58.152855 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7494e937-25f8-40d8-a697-cf5445e09caf tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:58.154746 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7494e937-25f8-40d8-a697-cf5445e09caf tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:58.388059 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-6db09184-e13a-41c4-a8ba-f4bba77ebc27 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '800db3a57ada47eca381b00189fdbf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66ec8ea91b04deb90b679589e0495bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:58.398390 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-6db09184-e13a-41c4-a8ba-f4bba77ebc27 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] 10.222.0.33 "GET /compute/v2.1/servers/62b98bc7-657a-42c2-b501-ae4d926cfa2f" status: 200 len: 1504 microversion: 2.1 time: 0.563407 Oct 04 20:37:58.411515 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 572/1132] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:37:57 2022] GET /compute/v2.1/servers/62b98bc7-657a-42c2-b501-ae4d926cfa2f => generated 1504 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:37:58.485604 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-c0b24e4b-acf6-4642-9dbb-8feadcd1c77a tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:58.487474 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-c0b24e4b-acf6-4642-9dbb-8feadcd1c77a tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] [instance: 5ac07e56-084c-4208-a988-13ec91af9171] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:58.498170 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c0b24e4b-acf6-4642-9dbb-8feadcd1c77a tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:58.499187 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c0b24e4b-acf6-4642-9dbb-8feadcd1c77a tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:58.500974 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c0b24e4b-acf6-4642-9dbb-8feadcd1c77a tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:58.502050 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c0b24e4b-acf6-4642-9dbb-8feadcd1c77a tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:58.503033 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c0b24e4b-acf6-4642-9dbb-8feadcd1c77a tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:58.503843 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c0b24e4b-acf6-4642-9dbb-8feadcd1c77a tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:58.516480 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-7494e937-25f8-40d8-a697-cf5445e09caf tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3563efe2b8c94931a2a46c4e14811b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3118a5d96843d3bede1ed94bd9717e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:58.530976 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-7494e937-25f8-40d8-a697-cf5445e09caf tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] 10.222.0.33 "GET /compute/v2.1/servers/465ad440-a27e-4ff6-bb31-09f3545e166a" status: 200 len: 1536 microversion: 2.1 time: 0.415246 Oct 04 20:37:58.547107 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 561/1133] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:37:58 2022] GET /compute/v2.1/servers/465ad440-a27e-4ff6-bb31-09f3545e166a => generated 1536 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:37:58.658271 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b67a2d84-288d-480f-b3dc-1259866ab460 tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:58.662306 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b67a2d84-288d-480f-b3dc-1259866ab460 tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] [instance: f33c0e5c-fe2c-4379-b50a-08eb17062b91] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:58.670675 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b67a2d84-288d-480f-b3dc-1259866ab460 tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:58.671926 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b67a2d84-288d-480f-b3dc-1259866ab460 tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:58.672779 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b67a2d84-288d-480f-b3dc-1259866ab460 tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:58.673918 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b67a2d84-288d-480f-b3dc-1259866ab460 tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:58.674621 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b67a2d84-288d-480f-b3dc-1259866ab460 tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:58.675310 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b67a2d84-288d-480f-b3dc-1259866ab460 tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:58.754059 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell0:SELECT=5 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:37:58.818905 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell0:SELECT=2 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:37:59.372575 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-c0b24e4b-acf6-4642-9dbb-8feadcd1c77a tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11149c46e1bc468f836fe70635dbf33b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e0d8329b2c4d64bf51d88948ca0de2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:37:59.385557 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-c0b24e4b-acf6-4642-9dbb-8feadcd1c77a tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] 10.222.0.33 "GET /compute/v2.1/servers/5ac07e56-084c-4208-a988-13ec91af9171" status: 200 len: 1305 microversion: 2.1 time: 0.908014 Oct 04 20:37:59.389001 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 573/1134] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:37:58 2022] GET /compute/v2.1/servers/5ac07e56-084c-4208-a988-13ec91af9171 => generated 1305 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:37:59.400578 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-71154c70-2ea8-48bb-aba5-114e66c02ba2 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:59.401126 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-71154c70-2ea8-48bb-aba5-114e66c02ba2 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] [instance: 42726a57-cdc8-45e3-8d61-348f02bfcd53] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:59.424675 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-71154c70-2ea8-48bb-aba5-114e66c02ba2 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:59.425306 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-71154c70-2ea8-48bb-aba5-114e66c02ba2 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:59.425738 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-71154c70-2ea8-48bb-aba5-114e66c02ba2 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:59.426762 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-71154c70-2ea8-48bb-aba5-114e66c02ba2 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:59.427428 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-71154c70-2ea8-48bb-aba5-114e66c02ba2 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:59.428059 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-71154c70-2ea8-48bb-aba5-114e66c02ba2 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:59.666617 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-b67a2d84-288d-480f-b3dc-1259866ab460 tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] Lazy-loading 'services' on Instance uuid f33c0e5c-fe2c-4379-b50a-08eb17062b91 {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:37:59.684342 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b67a2d84-288d-480f-b3dc-1259866ab460 tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/f33c0e5c-fe2c-4379-b50a-08eb17062b91" status: 200 len: 2036 microversion: 2.25 time: 1.033489 Oct 04 20:37:59.685651 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 562/1135] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:37:58 2022] GET /compute/v2.1/servers/f33c0e5c-fe2c-4379-b50a-08eb17062b91 => generated 2036 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:37:59.690709 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-dbc2d7b7-3712-49ee-ace2-abaccaefd564 tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:59.691796 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-dbc2d7b7-3712-49ee-ace2-abaccaefd564 tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] [instance: 5e984459-625e-44cd-b226-091276567215] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:59.700538 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dbc2d7b7-3712-49ee-ace2-abaccaefd564 tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:59.702950 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dbc2d7b7-3712-49ee-ace2-abaccaefd564 tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:59.703799 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dbc2d7b7-3712-49ee-ace2-abaccaefd564 tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:59.706277 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dbc2d7b7-3712-49ee-ace2-abaccaefd564 tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:59.707122 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dbc2d7b7-3712-49ee-ace2-abaccaefd564 tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:59.708891 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dbc2d7b7-3712-49ee-ace2-abaccaefd564 tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:59.906636 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-dbc2d7b7-3712-49ee-ace2-abaccaefd564 tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] Lazy-loading 'services' on Instance uuid 5e984459-625e-44cd-b226-091276567215 {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:37:59.936276 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-dbc2d7b7-3712-49ee-ace2-abaccaefd564 tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/5e984459-625e-44cd-b226-091276567215" status: 200 len: 1929 microversion: 2.75 time: 0.249257 Oct 04 20:37:59.937469 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 563/1136] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:37:59 2022] GET /compute/v2.1/servers/5e984459-625e-44cd-b226-091276567215 => generated 1929 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:37:59.943887 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0ab22c4e-eea5-4c1d-bc66-5ea952d72ff0 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:37:59.944706 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-0ab22c4e-eea5-4c1d-bc66-5ea952d72ff0 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] [instance: 62b98bc7-657a-42c2-b501-ae4d926cfa2f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:37:59.951934 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0ab22c4e-eea5-4c1d-bc66-5ea952d72ff0 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:59.952730 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0ab22c4e-eea5-4c1d-bc66-5ea952d72ff0 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:59.953326 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0ab22c4e-eea5-4c1d-bc66-5ea952d72ff0 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:37:59.954199 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0ab22c4e-eea5-4c1d-bc66-5ea952d72ff0 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:37:59.954843 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0ab22c4e-eea5-4c1d-bc66-5ea952d72ff0 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:37:59.955625 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0ab22c4e-eea5-4c1d-bc66-5ea952d72ff0 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:00.122018 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-71154c70-2ea8-48bb-aba5-114e66c02ba2 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36f4114dc4f443f8b48da7b4027e0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a23a85365414f92bbc03177d7f190e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:00.141484 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-71154c70-2ea8-48bb-aba5-114e66c02ba2 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] 10.222.0.33 "GET /compute/v2.1/servers/42726a57-cdc8-45e3-8d61-348f02bfcd53" status: 200 len: 1316 microversion: 2.1 time: 0.750962 Oct 04 20:38:00.166535 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 574/1137] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:37:59 2022] GET /compute/v2.1/servers/42726a57-cdc8-45e3-8d61-348f02bfcd53 => generated 1316 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:38:00.173803 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-a0584bde-a8da-4cdc-8901-59b210a2d914 req-a1c9f87a-cd4f-4f40-aa68-f53ced2ab567 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ac07e56-084c-4208-a988-13ec91af9171", "tag": "110ce36c-aef7-4f87-ae06-e95d837c4b2b"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:38:00.211594 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-a0584bde-a8da-4cdc-8901-59b210a2d914 req-a1c9f87a-cd4f-4f40-aa68-f53ced2ab567 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:00.212933 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-a0584bde-a8da-4cdc-8901-59b210a2d914 req-a1c9f87a-cd4f-4f40-aa68-f53ced2ab567 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:00.213516 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-a0584bde-a8da-4cdc-8901-59b210a2d914 req-a1c9f87a-cd4f-4f40-aa68-f53ced2ab567 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:00.228444 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-a0584bde-a8da-4cdc-8901-59b210a2d914 req-a1c9f87a-cd4f-4f40-aa68-f53ced2ab567 service nova] Creating event network-changed:110ce36c-aef7-4f87-ae06-e95d837c4b2b for instance 5ac07e56-084c-4208-a988-13ec91af9171 on n-h1-854823-8 Oct 04 20:38:00.235633 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-a0584bde-a8da-4cdc-8901-59b210a2d914 req-a1c9f87a-cd4f-4f40-aa68-f53ced2ab567 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066338 Oct 04 20:38:00.237083 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 575/1138] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:38:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:38:00.246499 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-4d68e0da-5da1-481a-ab91-d4bb41873be9 req-4c9dd44a-ff76-4599-ac36-0aa24220d749 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "465ad440-a27e-4ff6-bb31-09f3545e166a", "name": "network-vif-unplugged", "status": "completed", "tag": "c16cb04f-6af6-4073-98de-ed8d89a2e3c2"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:38:00.260912 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-4d68e0da-5da1-481a-ab91-d4bb41873be9 req-4c9dd44a-ff76-4599-ac36-0aa24220d749 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:00.262258 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-4d68e0da-5da1-481a-ab91-d4bb41873be9 req-4c9dd44a-ff76-4599-ac36-0aa24220d749 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:00.262875 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-4d68e0da-5da1-481a-ab91-d4bb41873be9 req-4c9dd44a-ff76-4599-ac36-0aa24220d749 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:00.277881 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-4d68e0da-5da1-481a-ab91-d4bb41873be9 req-4c9dd44a-ff76-4599-ac36-0aa24220d749 service nova] Creating event network-vif-unplugged:c16cb04f-6af6-4073-98de-ed8d89a2e3c2 for instance 465ad440-a27e-4ff6-bb31-09f3545e166a on n-h2-854823-8 Oct 04 20:38:00.287929 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [req-4d68e0da-5da1-481a-ab91-d4bb41873be9 req-4c9dd44a-ff76-4599-ac36-0aa24220d749 service nova] Instance 465ad440-a27e-4ff6-bb31-09f3545e166a is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854823-8'} {{(pid=128802) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 20:38:00.298174 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-4d68e0da-5da1-481a-ab91-d4bb41873be9 req-4c9dd44a-ff76-4599-ac36-0aa24220d749 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.058743 Oct 04 20:38:00.306659 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 576/1139] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:38:00 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:38:00.316179 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-8695a022-4abc-4376-bf96-b38f938229c3 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:00.318821 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-8695a022-4abc-4376-bf96-b38f938229c3 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] [instance: 465ad440-a27e-4ff6-bb31-09f3545e166a] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:00.326424 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8695a022-4abc-4376-bf96-b38f938229c3 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:00.327220 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8695a022-4abc-4376-bf96-b38f938229c3 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:00.328064 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8695a022-4abc-4376-bf96-b38f938229c3 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:00.328933 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8695a022-4abc-4376-bf96-b38f938229c3 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:00.329538 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8695a022-4abc-4376-bf96-b38f938229c3 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:00.330787 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8695a022-4abc-4376-bf96-b38f938229c3 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:00.379873 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-0ab22c4e-eea5-4c1d-bc66-5ea952d72ff0 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '800db3a57ada47eca381b00189fdbf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66ec8ea91b04deb90b679589e0495bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:00.382942 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:38:00.407062 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-0ab22c4e-eea5-4c1d-bc66-5ea952d72ff0 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] 10.222.0.33 "GET /compute/v2.1/servers/62b98bc7-657a-42c2-b501-ae4d926cfa2f" status: 200 len: 1504 microversion: 2.1 time: 0.461185 Oct 04 20:38:00.424676 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 564/1140] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:37:59 2022] GET /compute/v2.1/servers/62b98bc7-657a-42c2-b501-ae4d926cfa2f => generated 1504 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:38:00.433428 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0d2e2dba-b60d-4a59-ab93-7ea869b99827 tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-854823-8", "block_migration": "auto"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:38:00.435974 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-0d2e2dba-b60d-4a59-ab93-7ea869b99827 tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] [instance: f33c0e5c-fe2c-4379-b50a-08eb17062b91] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:00.454515 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0d2e2dba-b60d-4a59-ab93-7ea869b99827 tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:00.455009 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0d2e2dba-b60d-4a59-ab93-7ea869b99827 tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:00.456064 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0d2e2dba-b60d-4a59-ab93-7ea869b99827 tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:00.456788 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0d2e2dba-b60d-4a59-ab93-7ea869b99827 tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:00.457304 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0d2e2dba-b60d-4a59-ab93-7ea869b99827 tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:00.458778 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0d2e2dba-b60d-4a59-ab93-7ea869b99827 tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:00.527232 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-0d2e2dba-b60d-4a59-ab93-7ea869b99827 tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] Lazy-loading 'flavor' on Instance uuid f33c0e5c-fe2c-4379-b50a-08eb17062b91 {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:38:00.556495 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-0d2e2dba-b60d-4a59-ab93-7ea869b99827 tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] [instance: f33c0e5c-fe2c-4379-b50a-08eb17062b91] Going to try to live migrate instance to n-h1-854823-8 {{(pid=128801) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 04 20:38:00.663738 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-8695a022-4abc-4376-bf96-b38f938229c3 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3563efe2b8c94931a2a46c4e14811b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3118a5d96843d3bede1ed94bd9717e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:00.673639 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-8695a022-4abc-4376-bf96-b38f938229c3 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] 10.222.0.33 "GET /compute/v2.1/servers/465ad440-a27e-4ff6-bb31-09f3545e166a" status: 200 len: 1536 microversion: 2.1 time: 0.365321 Oct 04 20:38:00.692503 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 577/1141] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:38:00 2022] GET /compute/v2.1/servers/465ad440-a27e-4ff6-bb31-09f3545e166a => generated 1536 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:38:00.702672 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-4be39560-8911-4ad7-a3d7-8d4e3a432647 tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:00.713272 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-4be39560-8911-4ad7-a3d7-8d4e3a432647 tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] [instance: 5ac07e56-084c-4208-a988-13ec91af9171] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:00.725202 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4be39560-8911-4ad7-a3d7-8d4e3a432647 tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:00.725703 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4be39560-8911-4ad7-a3d7-8d4e3a432647 tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:00.726131 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4be39560-8911-4ad7-a3d7-8d4e3a432647 tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:00.726861 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4be39560-8911-4ad7-a3d7-8d4e3a432647 tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:00.727313 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4be39560-8911-4ad7-a3d7-8d4e3a432647 tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:00.727734 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4be39560-8911-4ad7-a3d7-8d4e3a432647 tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:00.971498 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-4be39560-8911-4ad7-a3d7-8d4e3a432647 tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11149c46e1bc468f836fe70635dbf33b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e0d8329b2c4d64bf51d88948ca0de2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:00.981293 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-4be39560-8911-4ad7-a3d7-8d4e3a432647 tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] 10.222.0.33 "GET /compute/v2.1/servers/5ac07e56-084c-4208-a988-13ec91af9171" status: 200 len: 1305 microversion: 2.1 time: 0.287542 Oct 04 20:38:00.985101 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 578/1142] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:38:00 2022] GET /compute/v2.1/servers/5ac07e56-084c-4208-a988-13ec91af9171 => generated 1305 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:38:00.993827 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-09cc882d-d2de-4082-a547-3972c5c5cf6c tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:00.994461 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-09cc882d-d2de-4082-a547-3972c5c5cf6c tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] [instance: 5e984459-625e-44cd-b226-091276567215] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:01.006158 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-09cc882d-d2de-4082-a547-3972c5c5cf6c tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:01.006673 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-09cc882d-d2de-4082-a547-3972c5c5cf6c tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:01.007110 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-09cc882d-d2de-4082-a547-3972c5c5cf6c tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:01.007815 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-09cc882d-d2de-4082-a547-3972c5c5cf6c tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:01.008267 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-09cc882d-d2de-4082-a547-3972c5c5cf6c tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:01.008687 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-09cc882d-d2de-4082-a547-3972c5c5cf6c tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:01.323733 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.objects.instance [None req-09cc882d-d2de-4082-a547-3972c5c5cf6c tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] Lazy-loading 'services' on Instance uuid 5e984459-625e-44cd-b226-091276567215 {{(pid=128802) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:38:01.362904 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-09cc882d-d2de-4082-a547-3972c5c5cf6c tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/5e984459-625e-44cd-b226-091276567215" status: 200 len: 1929 microversion: 2.75 time: 0.376606 Oct 04 20:38:01.364406 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 579/1143] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:38:00 2022] GET /compute/v2.1/servers/5e984459-625e-44cd-b226-091276567215 => generated 1929 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:38:01.369814 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-d1897934-2c7b-44a8-87fe-e24a2c72d1f7 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:01.371850 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-d1897934-2c7b-44a8-87fe-e24a2c72d1f7 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] [instance: 42726a57-cdc8-45e3-8d61-348f02bfcd53] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:01.378846 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d1897934-2c7b-44a8-87fe-e24a2c72d1f7 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:01.379689 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d1897934-2c7b-44a8-87fe-e24a2c72d1f7 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:01.380649 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d1897934-2c7b-44a8-87fe-e24a2c72d1f7 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:01.382190 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d1897934-2c7b-44a8-87fe-e24a2c72d1f7 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:01.383181 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d1897934-2c7b-44a8-87fe-e24a2c72d1f7 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:01.383878 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d1897934-2c7b-44a8-87fe-e24a2c72d1f7 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:01.674623 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-d1897934-2c7b-44a8-87fe-e24a2c72d1f7 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36f4114dc4f443f8b48da7b4027e0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a23a85365414f92bbc03177d7f190e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:01.692289 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-d1897934-2c7b-44a8-87fe-e24a2c72d1f7 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] 10.222.0.33 "GET /compute/v2.1/servers/42726a57-cdc8-45e3-8d61-348f02bfcd53" status: 200 len: 1316 microversion: 2.1 time: 0.320082 Oct 04 20:38:01.696116 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 580/1144] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:38:01 2022] GET /compute/v2.1/servers/42726a57-cdc8-45e3-8d61-348f02bfcd53 => generated 1316 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:38:01.708029 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-e0550f4d-d571-463f-bfb6-f805c565f379 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:01.708628 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-e0550f4d-d571-463f-bfb6-f805c565f379 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] [instance: 62b98bc7-657a-42c2-b501-ae4d926cfa2f] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:01.725038 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e0550f4d-d571-463f-bfb6-f805c565f379 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:01.725555 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e0550f4d-d571-463f-bfb6-f805c565f379 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:01.725993 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e0550f4d-d571-463f-bfb6-f805c565f379 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:01.727167 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e0550f4d-d571-463f-bfb6-f805c565f379 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:01.727167 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e0550f4d-d571-463f-bfb6-f805c565f379 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:01.727611 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e0550f4d-d571-463f-bfb6-f805c565f379 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:01.990294 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-e0550f4d-d571-463f-bfb6-f805c565f379 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '800db3a57ada47eca381b00189fdbf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66ec8ea91b04deb90b679589e0495bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:02.002891 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-e0550f4d-d571-463f-bfb6-f805c565f379 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] 10.222.0.33 "GET /compute/v2.1/servers/62b98bc7-657a-42c2-b501-ae4d926cfa2f" status: 200 len: 1504 microversion: 2.1 time: 0.305595 Oct 04 20:38:02.004281 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 581/1145] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:38:01 2022] GET /compute/v2.1/servers/62b98bc7-657a-42c2-b501-ae4d926cfa2f => generated 1504 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:38:02.011739 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-fc44b620-c477-4bce-bce7-21aecb7d5f5c tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:02.015351 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-fc44b620-c477-4bce-bce7-21aecb7d5f5c tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] [instance: 465ad440-a27e-4ff6-bb31-09f3545e166a] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:02.028584 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fc44b620-c477-4bce-bce7-21aecb7d5f5c tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:02.030688 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fc44b620-c477-4bce-bce7-21aecb7d5f5c tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:02.031321 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fc44b620-c477-4bce-bce7-21aecb7d5f5c tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:02.033621 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fc44b620-c477-4bce-bce7-21aecb7d5f5c tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:02.034410 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fc44b620-c477-4bce-bce7-21aecb7d5f5c tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:02.035122 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fc44b620-c477-4bce-bce7-21aecb7d5f5c tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:02.365218 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-fc44b620-c477-4bce-bce7-21aecb7d5f5c tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3563efe2b8c94931a2a46c4e14811b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3118a5d96843d3bede1ed94bd9717e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:02.374284 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-fc44b620-c477-4bce-bce7-21aecb7d5f5c tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] 10.222.0.33 "GET /compute/v2.1/servers/465ad440-a27e-4ff6-bb31-09f3545e166a" status: 200 len: 1536 microversion: 2.1 time: 0.368731 Oct 04 20:38:02.375166 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 582/1146] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:38:02 2022] GET /compute/v2.1/servers/465ad440-a27e-4ff6-bb31-09f3545e166a => generated 1536 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:38:02.394645 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-4dc06581-abc9-4d9a-be80-917560abcfbb tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:02.396242 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-4dc06581-abc9-4d9a-be80-917560abcfbb tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] [instance: 5ac07e56-084c-4208-a988-13ec91af9171] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:02.402776 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4dc06581-abc9-4d9a-be80-917560abcfbb tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:02.403341 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4dc06581-abc9-4d9a-be80-917560abcfbb tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:02.403853 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4dc06581-abc9-4d9a-be80-917560abcfbb tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:02.404602 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4dc06581-abc9-4d9a-be80-917560abcfbb tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:02.405327 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4dc06581-abc9-4d9a-be80-917560abcfbb tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:02.405663 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4dc06581-abc9-4d9a-be80-917560abcfbb tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:02.581039 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-4dc06581-abc9-4d9a-be80-917560abcfbb tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11149c46e1bc468f836fe70635dbf33b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e0d8329b2c4d64bf51d88948ca0de2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:02.591522 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-4dc06581-abc9-4d9a-be80-917560abcfbb tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] 10.222.0.33 "GET /compute/v2.1/servers/5ac07e56-084c-4208-a988-13ec91af9171" status: 200 len: 1305 microversion: 2.1 time: 0.203301 Oct 04 20:38:02.592413 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 583/1147] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:38:02 2022] GET /compute/v2.1/servers/5ac07e56-084c-4208-a988-13ec91af9171 => generated 1305 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:38:02.597615 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-1e87d5cc-8d7d-4879-a718-4e4e003be8fb req-19050a75-496e-4b88-b03a-f05393460df0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42726a57-cdc8-45e3-8d61-348f02bfcd53", "tag": "e79353aa-2a26-4aa4-aa99-70580b24b76e"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:38:02.610086 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-1e87d5cc-8d7d-4879-a718-4e4e003be8fb req-19050a75-496e-4b88-b03a-f05393460df0 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:02.611219 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-1e87d5cc-8d7d-4879-a718-4e4e003be8fb req-19050a75-496e-4b88-b03a-f05393460df0 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:02.611822 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-1e87d5cc-8d7d-4879-a718-4e4e003be8fb req-19050a75-496e-4b88-b03a-f05393460df0 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:02.624203 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-1e87d5cc-8d7d-4879-a718-4e4e003be8fb req-19050a75-496e-4b88-b03a-f05393460df0 service nova] Creating event network-changed:e79353aa-2a26-4aa4-aa99-70580b24b76e for instance 42726a57-cdc8-45e3-8d61-348f02bfcd53 on n-h1-854823-8 Oct 04 20:38:02.630143 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-1e87d5cc-8d7d-4879-a718-4e4e003be8fb req-19050a75-496e-4b88-b03a-f05393460df0 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035823 Oct 04 20:38:02.631335 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 584/1148] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:38:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:38:02.637906 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-97219b03-8d8e-4d7e-8e0a-115ce63c2564 tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:02.639179 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-97219b03-8d8e-4d7e-8e0a-115ce63c2564 tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] [instance: 5e984459-625e-44cd-b226-091276567215] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:02.646922 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-97219b03-8d8e-4d7e-8e0a-115ce63c2564 tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:02.647737 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-97219b03-8d8e-4d7e-8e0a-115ce63c2564 tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:02.649752 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-97219b03-8d8e-4d7e-8e0a-115ce63c2564 tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:02.650851 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-97219b03-8d8e-4d7e-8e0a-115ce63c2564 tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:02.651558 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-97219b03-8d8e-4d7e-8e0a-115ce63c2564 tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:02.652234 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-97219b03-8d8e-4d7e-8e0a-115ce63c2564 tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:02.670830 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=100 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:38:02.776080 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.objects.instance [None req-97219b03-8d8e-4d7e-8e0a-115ce63c2564 tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] Lazy-loading 'services' on Instance uuid 5e984459-625e-44cd-b226-091276567215 {{(pid=128802) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:38:02.802576 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-97219b03-8d8e-4d7e-8e0a-115ce63c2564 tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/5e984459-625e-44cd-b226-091276567215" status: 200 len: 1929 microversion: 2.75 time: 0.169343 Oct 04 20:38:02.812800 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 585/1149] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:38:02 2022] GET /compute/v2.1/servers/5e984459-625e-44cd-b226-091276567215 => generated 1929 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:38:02.812800 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-eb067e37-07b7-49b5-a364-162dc9a66147 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:02.812800 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-eb067e37-07b7-49b5-a364-162dc9a66147 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] [instance: 42726a57-cdc8-45e3-8d61-348f02bfcd53] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:02.818570 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-eb067e37-07b7-49b5-a364-162dc9a66147 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:02.818570 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-eb067e37-07b7-49b5-a364-162dc9a66147 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:02.818570 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-eb067e37-07b7-49b5-a364-162dc9a66147 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:02.818570 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-eb067e37-07b7-49b5-a364-162dc9a66147 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:02.820029 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-eb067e37-07b7-49b5-a364-162dc9a66147 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:02.820029 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-eb067e37-07b7-49b5-a364-162dc9a66147 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:03.092294 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-eb067e37-07b7-49b5-a364-162dc9a66147 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36f4114dc4f443f8b48da7b4027e0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a23a85365414f92bbc03177d7f190e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:03.102903 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-eb067e37-07b7-49b5-a364-162dc9a66147 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] 10.222.0.33 "GET /compute/v2.1/servers/42726a57-cdc8-45e3-8d61-348f02bfcd53" status: 200 len: 1316 microversion: 2.1 time: 0.297960 Oct 04 20:38:03.104318 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 586/1150] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:38:02 2022] GET /compute/v2.1/servers/42726a57-cdc8-45e3-8d61-348f02bfcd53 => generated 1316 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:38:03.111809 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-b2648b77-76cc-4aa4-8be9-0713b32524f8 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:03.112572 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-b2648b77-76cc-4aa4-8be9-0713b32524f8 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] [instance: 62b98bc7-657a-42c2-b501-ae4d926cfa2f] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:03.146985 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b2648b77-76cc-4aa4-8be9-0713b32524f8 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:03.158569 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b2648b77-76cc-4aa4-8be9-0713b32524f8 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:03.159406 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b2648b77-76cc-4aa4-8be9-0713b32524f8 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:03.161201 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b2648b77-76cc-4aa4-8be9-0713b32524f8 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:03.161819 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b2648b77-76cc-4aa4-8be9-0713b32524f8 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:03.162576 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b2648b77-76cc-4aa4-8be9-0713b32524f8 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:03.472591 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-b2648b77-76cc-4aa4-8be9-0713b32524f8 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '800db3a57ada47eca381b00189fdbf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66ec8ea91b04deb90b679589e0495bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:03.480800 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-b2648b77-76cc-4aa4-8be9-0713b32524f8 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] 10.222.0.33 "GET /compute/v2.1/servers/62b98bc7-657a-42c2-b501-ae4d926cfa2f" status: 200 len: 1504 microversion: 2.1 time: 0.375314 Oct 04 20:38:03.481385 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 587/1151] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:38:03 2022] GET /compute/v2.1/servers/62b98bc7-657a-42c2-b501-ae4d926cfa2f => generated 1504 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:38:03.495646 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-f0e7efcf-4e45-43f2-868b-d56e1063aaf9 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:03.496422 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-f0e7efcf-4e45-43f2-868b-d56e1063aaf9 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] [instance: 465ad440-a27e-4ff6-bb31-09f3545e166a] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:03.509812 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f0e7efcf-4e45-43f2-868b-d56e1063aaf9 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:03.510736 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f0e7efcf-4e45-43f2-868b-d56e1063aaf9 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:03.511192 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f0e7efcf-4e45-43f2-868b-d56e1063aaf9 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:03.513952 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f0e7efcf-4e45-43f2-868b-d56e1063aaf9 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:03.514495 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f0e7efcf-4e45-43f2-868b-d56e1063aaf9 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:03.514936 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f0e7efcf-4e45-43f2-868b-d56e1063aaf9 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:03.769729 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-f0e7efcf-4e45-43f2-868b-d56e1063aaf9 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3563efe2b8c94931a2a46c4e14811b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3118a5d96843d3bede1ed94bd9717e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:03.783759 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-f0e7efcf-4e45-43f2-868b-d56e1063aaf9 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] 10.222.0.33 "GET /compute/v2.1/servers/465ad440-a27e-4ff6-bb31-09f3545e166a" status: 200 len: 1529 microversion: 2.1 time: 0.292397 Oct 04 20:38:03.784749 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 588/1152] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:38:03 2022] GET /compute/v2.1/servers/465ad440-a27e-4ff6-bb31-09f3545e166a => generated 1529 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:38:03.806725 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-082765b4-477f-4d4c-b342-69ffcce3bee5 tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:03.807415 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-082765b4-477f-4d4c-b342-69ffcce3bee5 tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] [instance: 5ac07e56-084c-4208-a988-13ec91af9171] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:03.814208 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-082765b4-477f-4d4c-b342-69ffcce3bee5 tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:03.814760 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-082765b4-477f-4d4c-b342-69ffcce3bee5 tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:03.815191 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-082765b4-477f-4d4c-b342-69ffcce3bee5 tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:03.815901 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-082765b4-477f-4d4c-b342-69ffcce3bee5 tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:03.816353 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-082765b4-477f-4d4c-b342-69ffcce3bee5 tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:03.817557 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-082765b4-477f-4d4c-b342-69ffcce3bee5 tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:04.064938 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-082765b4-477f-4d4c-b342-69ffcce3bee5 tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11149c46e1bc468f836fe70635dbf33b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e0d8329b2c4d64bf51d88948ca0de2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:04.075107 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-082765b4-477f-4d4c-b342-69ffcce3bee5 tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] 10.222.0.33 "GET /compute/v2.1/servers/5ac07e56-084c-4208-a988-13ec91af9171" status: 200 len: 1305 microversion: 2.1 time: 0.275573 Oct 04 20:38:04.076045 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 589/1153] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:38:03 2022] GET /compute/v2.1/servers/5ac07e56-084c-4208-a988-13ec91af9171 => generated 1305 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:38:04.086920 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-73a19f91-e37c-4e00-9ee0-da570bf5c3f3 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:04.088011 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-73a19f91-e37c-4e00-9ee0-da570bf5c3f3 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] [instance: 465ad440-a27e-4ff6-bb31-09f3545e166a] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:04.094283 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-73a19f91-e37c-4e00-9ee0-da570bf5c3f3 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:04.094813 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-73a19f91-e37c-4e00-9ee0-da570bf5c3f3 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:04.095240 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-73a19f91-e37c-4e00-9ee0-da570bf5c3f3 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:04.096096 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-73a19f91-e37c-4e00-9ee0-da570bf5c3f3 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:04.096544 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-73a19f91-e37c-4e00-9ee0-da570bf5c3f3 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:04.096968 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-73a19f91-e37c-4e00-9ee0-da570bf5c3f3 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:04.265655 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-73a19f91-e37c-4e00-9ee0-da570bf5c3f3 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3563efe2b8c94931a2a46c4e14811b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3118a5d96843d3bede1ed94bd9717e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:04.303491 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-73a19f91-e37c-4e00-9ee0-da570bf5c3f3 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] 10.222.0.33 "GET /compute/v2.1/servers/465ad440-a27e-4ff6-bb31-09f3545e166a" status: 200 len: 1529 microversion: 2.1 time: 0.226229 Oct 04 20:38:04.304528 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 590/1154] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:38:04 2022] GET /compute/v2.1/servers/465ad440-a27e-4ff6-bb31-09f3545e166a => generated 1529 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:38:04.314163 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-ea85b229-827d-4936-9853-587039ebc6a4 tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:04.314163 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-ea85b229-827d-4936-9853-587039ebc6a4 tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] [instance: 5e984459-625e-44cd-b226-091276567215] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:04.328218 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_api:UPDATE=1,nova_api:SELECT=98,nova_api:DELETE=1 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:38:04.329294 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ea85b229-827d-4936-9853-587039ebc6a4 tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:04.329789 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ea85b229-827d-4936-9853-587039ebc6a4 tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:04.330252 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ea85b229-827d-4936-9853-587039ebc6a4 tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:04.331970 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ea85b229-827d-4936-9853-587039ebc6a4 tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:04.331970 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ea85b229-827d-4936-9853-587039ebc6a4 tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:04.332753 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ea85b229-827d-4936-9853-587039ebc6a4 tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:04.476531 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.objects.instance [None req-ea85b229-827d-4936-9853-587039ebc6a4 tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] Lazy-loading 'services' on Instance uuid 5e984459-625e-44cd-b226-091276567215 {{(pid=128802) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:38:04.523751 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-ea85b229-827d-4936-9853-587039ebc6a4 tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/5e984459-625e-44cd-b226-091276567215" status: 200 len: 1929 microversion: 2.75 time: 0.207074 Oct 04 20:38:04.524432 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 591/1155] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:38:04 2022] GET /compute/v2.1/servers/5e984459-625e-44cd-b226-091276567215 => generated 1929 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:38:04.554585 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-1d6aabbd-ab96-4851-8568-93194c75b016 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:04.555230 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-1d6aabbd-ab96-4851-8568-93194c75b016 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] [instance: 42726a57-cdc8-45e3-8d61-348f02bfcd53] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:04.563109 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1d6aabbd-ab96-4851-8568-93194c75b016 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:04.563885 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1d6aabbd-ab96-4851-8568-93194c75b016 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:04.564549 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1d6aabbd-ab96-4851-8568-93194c75b016 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:04.565447 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1d6aabbd-ab96-4851-8568-93194c75b016 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:04.566213 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1d6aabbd-ab96-4851-8568-93194c75b016 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:04.567224 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1d6aabbd-ab96-4851-8568-93194c75b016 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:04.679956 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-0d2e2dba-b60d-4a59-ab93-7ea869b99827 tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/f33c0e5c-fe2c-4379-b50a-08eb17062b91/action" status: 202 len: 0 microversion: 2.25 time: 4.253623 Oct 04 20:38:04.680577 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 565/1156] 10.222.0.33 () {62 vars in 1319 bytes} [Tue Oct 4 20:38:00 2022] POST /compute/v2.1/servers/f33c0e5c-fe2c-4379-b50a-08eb17062b91/action => generated 0 bytes in 4255 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:38:04.686899 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7709284a-19e9-46a5-98d9-d6d05ea4759b tempest-MigrationsAdminTest-1312330847 tempest-MigrationsAdminTest-1312330847-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:04.705592 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-7709284a-19e9-46a5-98d9-d6d05ea4759b tempest-MigrationsAdminTest-1312330847 tempest-MigrationsAdminTest-1312330847-project-admin] HTTP exception thrown: Flavor 48f18867-47ca-44ca-b04d-8950bf944255 could not be found. Oct 04 20:38:04.719692 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7709284a-19e9-46a5-98d9-d6d05ea4759b tempest-MigrationsAdminTest-1312330847 tempest-MigrationsAdminTest-1312330847-project-admin] Request method failure captured: Oct 04 20:38:04.719692 n-d-854823-8 devstack@n-api.service[128801]: request: DELETE /compute/v2.1/flavors/48f18867-47ca-44ca-b04d-8950bf944255 HTTP/1.1 Oct 04 20:38:04.719692 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:38:04.719692 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:38:04.719692 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:38:04.719692 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 0 Oct 04 20:38:04.719692 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:38:04.719692 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:38:04.719692 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:38:04.719692 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:38:04.719692 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJi7x6--mfA4UqsJzfYQ8Xwcu00gR5gV2RmMd6QgcKUbvpYEgKkz8N6QD-3ptDH6CmEYGy6Q0X4BWVXkFHBvI6sGxv66E-hh-c3CAmFFAI3cf2M5Dsm8C_KXRm4eH81lg9PDTITk7jXW5lwBQz-8wsJmUP4syVpvAHrl4BOHCAVon_g Oct 04 20:38:04.719692 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:38:04.719692 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:38:04.719692 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:38:04.719692 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:38:04.719692 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:38:04.719692 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:38:04.719692 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: 469f672650854ebd85443dc8dffd96d5 Oct 04 20:38:04.719692 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-MigrationsAdminTest-1312330847 Oct 04 20:38:04.719692 n-d-854823-8 devstack@n-api.service[128801]: X-Role: admin,reader,member Oct 04 20:38:04.719692 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: admin,reader,member Oct 04 20:38:04.719692 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_469f672650854ebd85443dc8dffd96d5", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/469f672650854ebd85443dc8dffd96d5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/469f672650854ebd85443dc8dffd96d5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/469f672650854ebd85443dc8dffd96d5"}]}] Oct 04 20:38:04.719692 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-MigrationsAdminTest-1312330847 Oct 04 20:38:04.719692 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: 469f672650854ebd85443dc8dffd96d5 Oct 04 20:38:04.719692 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-MigrationsAdminTest-1312330847 Oct 04 20:38:04.719692 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-MigrationsAdminTest-1312330847-project-admin Oct 04 20:38:04.719692 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:38:04.719692 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:38:04.719692 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: c99257ede776423ea801536531a3ea6d Oct 04 20:38:04.719692 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-MigrationsAdminTest-1312330847-project-admin Oct 04 20:38:04.719692 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 20:38:04.719692 n-d-854823-8 devstack@n-api.service[128801]: exception: Flavor 48f18867-47ca-44ca-b04d-8950bf944255 could not be found. Oct 04 20:38:04.719692 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': '48f18867-47ca-44ca-b04d-8950bf944255'} Oct 04 20:38:04.719692 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:38:04.719692 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:38:04.719692 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 43, in _delete Oct 04 20:38:04.719692 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi flavor.destroy() Oct 04 20:38:04.719692 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 04 20:38:04.719692 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 04 20:38:04.719692 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 558, in destroy Oct 04 20:38:04.719692 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi db_flavor = self._flavor_destroy(self._context, Oct 04 20:38:04.719692 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 544, in _flavor_destroy Oct 04 20:38:04.719692 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return _flavor_destroy(context, flavor_id=flavor_id, flavorid=flavorid) Oct 04 20:38:04.719692 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 20:38:04.719692 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 20:38:04.719692 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 185, in _flavor_destroy Oct 04 20:38:04.719692 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=(flavor_id or flavorid)) Oct 04 20:38:04.719692 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 48f18867-47ca-44ca-b04d-8950bf944255 could not be found. Oct 04 20:38:04.719692 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:38:04.719692 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:38:04.719692 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:38:04.719692 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:38:04.719692 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:38:04.719692 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:38:04.719692 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:38:04.719692 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:38:04.719692 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:38:04.719692 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:38:04.719692 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 45, in _delete Oct 04 20:38:04.719692 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:38:04.719692 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 48f18867-47ca-44ca-b04d-8950bf944255 could not be found. Oct 04 20:38:04.719692 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:38:04.719692 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:38:04.726556 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:38:04.726556 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:38:04.726556 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:38:04.726556 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:38:04.726556 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:38:04.726556 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:38:04.726556 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 48f18867-47ca-44ca-b04d-8950bf944255 could not be found. Oct 04 20:38:04.726556 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:38:04.728886 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7709284a-19e9-46a5-98d9-d6d05ea4759b tempest-MigrationsAdminTest-1312330847 tempest-MigrationsAdminTest-1312330847-project-admin] Returning 404 to user: Flavor 48f18867-47ca-44ca-b04d-8950bf944255 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:38:04.729960 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-7709284a-19e9-46a5-98d9-d6d05ea4759b tempest-MigrationsAdminTest-1312330847 tempest-MigrationsAdminTest-1312330847-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/48f18867-47ca-44ca-b04d-8950bf944255" status: 404 len: 109 microversion: 2.1 time: 0.048223 Oct 04 20:38:04.731203 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 566/1157] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 20:38:04 2022] DELETE /compute/v2.1/flavors/48f18867-47ca-44ca-b04d-8950bf944255 => generated 109 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:38:04.746620 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-81ca1d4c-7f92-4a4e-9ed7-9cdb8e6305fc tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:04.757582 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-81ca1d4c-7f92-4a4e-9ed7-9cdb8e6305fc tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] [instance: 62b98bc7-657a-42c2-b501-ae4d926cfa2f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:04.774417 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-81ca1d4c-7f92-4a4e-9ed7-9cdb8e6305fc tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:04.775366 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-81ca1d4c-7f92-4a4e-9ed7-9cdb8e6305fc tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:04.776217 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-81ca1d4c-7f92-4a4e-9ed7-9cdb8e6305fc tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:04.777402 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-81ca1d4c-7f92-4a4e-9ed7-9cdb8e6305fc tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:04.778169 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-81ca1d4c-7f92-4a4e-9ed7-9cdb8e6305fc tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:04.779478 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-81ca1d4c-7f92-4a4e-9ed7-9cdb8e6305fc tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:04.916232 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=18 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:38:05.229892 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-1d6aabbd-ab96-4851-8568-93194c75b016 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36f4114dc4f443f8b48da7b4027e0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a23a85365414f92bbc03177d7f190e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:05.239083 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-1d6aabbd-ab96-4851-8568-93194c75b016 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] 10.222.0.33 "GET /compute/v2.1/servers/42726a57-cdc8-45e3-8d61-348f02bfcd53" status: 200 len: 1316 microversion: 2.1 time: 0.692231 Oct 04 20:38:05.239889 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 592/1158] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:38:04 2022] GET /compute/v2.1/servers/42726a57-cdc8-45e3-8d61-348f02bfcd53 => generated 1316 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:38:05.260490 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-c838b5ef-f070-4854-acfc-08f42e57e01e tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:05.261037 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-c838b5ef-f070-4854-acfc-08f42e57e01e tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] [instance: f33c0e5c-fe2c-4379-b50a-08eb17062b91] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:05.267352 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c838b5ef-f070-4854-acfc-08f42e57e01e tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:05.267949 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c838b5ef-f070-4854-acfc-08f42e57e01e tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:05.268392 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c838b5ef-f070-4854-acfc-08f42e57e01e tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:05.269098 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c838b5ef-f070-4854-acfc-08f42e57e01e tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:05.270105 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c838b5ef-f070-4854-acfc-08f42e57e01e tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:05.270541 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c838b5ef-f070-4854-acfc-08f42e57e01e tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:05.278671 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-81ca1d4c-7f92-4a4e-9ed7-9cdb8e6305fc tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '800db3a57ada47eca381b00189fdbf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66ec8ea91b04deb90b679589e0495bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:05.292834 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-81ca1d4c-7f92-4a4e-9ed7-9cdb8e6305fc tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] 10.222.0.33 "GET /compute/v2.1/servers/62b98bc7-657a-42c2-b501-ae4d926cfa2f" status: 200 len: 1494 microversion: 2.1 time: 0.558142 Oct 04 20:38:05.308652 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 567/1159] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:38:04 2022] GET /compute/v2.1/servers/62b98bc7-657a-42c2-b501-ae4d926cfa2f => generated 1494 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:38:05.318382 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-3ab94dfd-98f4-4d95-8bc9-3c9212bf4356 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1912003948", "imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63", "flavorRef": "452"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:38:05.434325 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.network.neutron [None req-3ab94dfd-98f4-4d95-8bc9-3c9212bf4356 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] validate_networks() for None {{(pid=128801) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:38:05.508147 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-c838b5ef-f070-4854-acfc-08f42e57e01e tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:05.517540 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-c838b5ef-f070-4854-acfc-08f42e57e01e tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:05.519027 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-c838b5ef-f070-4854-acfc-08f42e57e01e tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:05.521041 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-c838b5ef-f070-4854-acfc-08f42e57e01e tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] 10.222.0.33 "GET /compute/v2.1/servers/f33c0e5c-fe2c-4379-b50a-08eb17062b91" status: 200 len: 1568 microversion: 2.25 time: 0.264458 Oct 04 20:38:05.534892 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 593/1160] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:38:05 2022] GET /compute/v2.1/servers/f33c0e5c-fe2c-4379-b50a-08eb17062b91 => generated 1568 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:38:05.541735 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-b8ce342e-85a4-4a22-ad8b-f2840f6b784b tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:05.542694 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-b8ce342e-85a4-4a22-ad8b-f2840f6b784b tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] [instance: 5ac07e56-084c-4208-a988-13ec91af9171] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:05.549277 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b8ce342e-85a4-4a22-ad8b-f2840f6b784b tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:05.549766 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b8ce342e-85a4-4a22-ad8b-f2840f6b784b tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:05.550193 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b8ce342e-85a4-4a22-ad8b-f2840f6b784b tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:05.551264 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b8ce342e-85a4-4a22-ad8b-f2840f6b784b tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:05.551845 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b8ce342e-85a4-4a22-ad8b-f2840f6b784b tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:05.552478 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b8ce342e-85a4-4a22-ad8b-f2840f6b784b tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:05.778258 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-b8ce342e-85a4-4a22-ad8b-f2840f6b784b tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11149c46e1bc468f836fe70635dbf33b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e0d8329b2c4d64bf51d88948ca0de2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:05.789419 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-b8ce342e-85a4-4a22-ad8b-f2840f6b784b tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] 10.222.0.33 "GET /compute/v2.1/servers/5ac07e56-084c-4208-a988-13ec91af9171" status: 200 len: 1293 microversion: 2.1 time: 0.252554 Oct 04 20:38:05.797695 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 594/1161] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:38:05 2022] GET /compute/v2.1/servers/5ac07e56-084c-4208-a988-13ec91af9171 => generated 1293 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:38:05.803107 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-9110fdfe-24a0-4ffe-9f79-3139537a90c2 tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] Calling method '.version_select at 0x7f3c7450d280>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:05.803716 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-3ab94dfd-98f4-4d95-8bc9-3c9212bf4356 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Flavor limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:38:05.804174 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-3ab94dfd-98f4-4d95-8bc9-3c9212bf4356 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Image limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:38:05.804615 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-3ab94dfd-98f4-4d95-8bc9-3c9212bf4356 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Flavor pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:38:05.805033 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-3ab94dfd-98f4-4d95-8bc9-3c9212bf4356 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Image pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:38:05.805653 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-3ab94dfd-98f4-4d95-8bc9-3c9212bf4356 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:38:05.812713 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9110fdfe-24a0-4ffe-9f79-3139537a90c2 tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:05.815541 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3ab94dfd-98f4-4d95-8bc9-3c9212bf4356 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:05.816222 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9110fdfe-24a0-4ffe-9f79-3139537a90c2 tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:05.816418 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3ab94dfd-98f4-4d95-8bc9-3c9212bf4356 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:05.816960 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9110fdfe-24a0-4ffe-9f79-3139537a90c2 tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:05.817555 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3ab94dfd-98f4-4d95-8bc9-3c9212bf4356 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:05.818512 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3ab94dfd-98f4-4d95-8bc9-3c9212bf4356 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:05.819138 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3ab94dfd-98f4-4d95-8bc9-3c9212bf4356 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:05.819745 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3ab94dfd-98f4-4d95-8bc9-3c9212bf4356 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:05.829730 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=13 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:38:05.840972 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-9110fdfe-24a0-4ffe-9f79-3139537a90c2 tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] 10.222.0.33 "GET /compute/v2.1/os-migrations" status: 200 len: 2344 microversion: 2.1 time: 0.041349 Oct 04 20:38:05.842872 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 595/1162] 10.222.0.33 () {58 vars in 1143 bytes} [Tue Oct 4 20:38:05 2022] GET /compute/v2.1/os-migrations => generated 2344 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:38:05.843696 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-3ab94dfd-98f4-4d95-8bc9-3c9212bf4356 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Getting quotas for project dd3118a5d96843d3bede1ed94bd9717e. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:38:05.852035 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-722b7f2d-2115-462f-9b0e-fbf8e5baf58a tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:05.852740 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-722b7f2d-2115-462f-9b0e-fbf8e5baf58a tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] [instance: 5e984459-625e-44cd-b226-091276567215] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:05.856331 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-3ab94dfd-98f4-4d95-8bc9-3c9212bf4356 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Getting quotas for user 3563efe2b8c94931a2a46c4e14811b3a and project dd3118a5d96843d3bede1ed94bd9717e. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:38:05.859830 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-722b7f2d-2115-462f-9b0e-fbf8e5baf58a tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:05.860429 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-722b7f2d-2115-462f-9b0e-fbf8e5baf58a tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:05.860956 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-722b7f2d-2115-462f-9b0e-fbf8e5baf58a tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:05.861744 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-722b7f2d-2115-462f-9b0e-fbf8e5baf58a tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:05.862256 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-722b7f2d-2115-462f-9b0e-fbf8e5baf58a tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:05.862775 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-722b7f2d-2115-462f-9b0e-fbf8e5baf58a tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:05.881574 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-3ab94dfd-98f4-4d95-8bc9-3c9212bf4356 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Going to run 1 instances... {{(pid=128801) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:38:05.884873 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-3ab94dfd-98f4-4d95-8bc9-3c9212bf4356 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] [instance: 23da26ba-68f4-4aef-b13c-0b6588a65e43] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='15b24725-0c99-4bcf-b1fb-907cdf8e2d63',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128801) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:38:05.984254 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-3ab94dfd-98f4-4d95-8bc9-3c9212bf4356 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.672939 Oct 04 20:38:05.989536 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 568/1163] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 20:38:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 679 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 20:38:05.994300 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-05bdcd6d-054a-4f12-81f0-6fcb7a3739f9 req-157e5d8f-4b3c-485a-8d64-8f6524baa6d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42726a57-cdc8-45e3-8d61-348f02bfcd53", "name": "network-vif-plugged", "status": "completed", "tag": "e79353aa-2a26-4aa4-aa99-70580b24b76e"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:38:06.002793 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.objects.instance [None req-722b7f2d-2115-462f-9b0e-fbf8e5baf58a tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] Lazy-loading 'services' on Instance uuid 5e984459-625e-44cd-b226-091276567215 {{(pid=128802) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:38:06.024110 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-05bdcd6d-054a-4f12-81f0-6fcb7a3739f9 req-157e5d8f-4b3c-485a-8d64-8f6524baa6d0 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:06.024996 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-05bdcd6d-054a-4f12-81f0-6fcb7a3739f9 req-157e5d8f-4b3c-485a-8d64-8f6524baa6d0 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:06.029078 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-05bdcd6d-054a-4f12-81f0-6fcb7a3739f9 req-157e5d8f-4b3c-485a-8d64-8f6524baa6d0 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:06.032373 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-722b7f2d-2115-462f-9b0e-fbf8e5baf58a tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/5e984459-625e-44cd-b226-091276567215" status: 200 len: 1929 microversion: 2.75 time: 0.187279 Oct 04 20:38:06.032971 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 596/1164] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:38:05 2022] GET /compute/v2.1/servers/5e984459-625e-44cd-b226-091276567215 => generated 1929 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:38:06.046457 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-7d6d4167-042a-45aa-87f4-b06d37a3847d tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:06.047304 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-7d6d4167-042a-45aa-87f4-b06d37a3847d tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] [instance: 62b98bc7-657a-42c2-b501-ae4d926cfa2f] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:06.049917 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-05bdcd6d-054a-4f12-81f0-6fcb7a3739f9 req-157e5d8f-4b3c-485a-8d64-8f6524baa6d0 service nova] Creating event network-vif-plugged:e79353aa-2a26-4aa4-aa99-70580b24b76e for instance 42726a57-cdc8-45e3-8d61-348f02bfcd53 on n-h1-854823-8 Oct 04 20:38:06.056997 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-05bdcd6d-054a-4f12-81f0-6fcb7a3739f9 req-157e5d8f-4b3c-485a-8d64-8f6524baa6d0 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066030 Oct 04 20:38:06.058008 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7d6d4167-042a-45aa-87f4-b06d37a3847d tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:06.058578 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7d6d4167-042a-45aa-87f4-b06d37a3847d tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:06.058710 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 569/1165] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:38:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:38:06.074848 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7d6d4167-042a-45aa-87f4-b06d37a3847d tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:06.075845 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7d6d4167-042a-45aa-87f4-b06d37a3847d tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:06.076198 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7d6d4167-042a-45aa-87f4-b06d37a3847d tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:06.076665 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7d6d4167-042a-45aa-87f4-b06d37a3847d tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:06.086040 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-281fc1fe-4f69-4010-aba8-87d066d343a0 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:06.086793 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-281fc1fe-4f69-4010-aba8-87d066d343a0 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] [instance: 23da26ba-68f4-4aef-b13c-0b6588a65e43] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:06.195480 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-281fc1fe-4f69-4010-aba8-87d066d343a0 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3563efe2b8c94931a2a46c4e14811b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3118a5d96843d3bede1ed94bd9717e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:06.204070 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-281fc1fe-4f69-4010-aba8-87d066d343a0 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] 10.222.0.33 "GET /compute/v2.1/servers/23da26ba-68f4-4aef-b13c-0b6588a65e43" status: 200 len: 1213 microversion: 2.1 time: 0.143958 Oct 04 20:38:06.208996 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 570/1166] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:38:06 2022] GET /compute/v2.1/servers/23da26ba-68f4-4aef-b13c-0b6588a65e43 => generated 1213 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:38:06.263334 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-db1aab5f-f6c9-4d24-85a5-cd2930e6570f tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:06.264122 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-db1aab5f-f6c9-4d24-85a5-cd2930e6570f tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] [instance: 42726a57-cdc8-45e3-8d61-348f02bfcd53] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:06.279083 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-db1aab5f-f6c9-4d24-85a5-cd2930e6570f tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:06.279705 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-db1aab5f-f6c9-4d24-85a5-cd2930e6570f tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:06.280154 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-db1aab5f-f6c9-4d24-85a5-cd2930e6570f tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:06.281020 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-db1aab5f-f6c9-4d24-85a5-cd2930e6570f tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:06.281479 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-db1aab5f-f6c9-4d24-85a5-cd2930e6570f tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:06.282006 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-db1aab5f-f6c9-4d24-85a5-cd2930e6570f tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:06.533933 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-7d6d4167-042a-45aa-87f4-b06d37a3847d tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/62b98bc7-657a-42c2-b501-ae4d926cfa2f" status: 200 len: 1645 microversion: 2.1 time: 0.491615 Oct 04 20:38:06.536038 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 597/1167] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:38:06 2022] GET /compute/v2.1/servers/62b98bc7-657a-42c2-b501-ae4d926cfa2f => generated 1645 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:38:06.575246 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-3d9c93a0-7807-445a-872c-16ee2b894f03 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:06.576519 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-3d9c93a0-7807-445a-872c-16ee2b894f03 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] [instance: f33c0e5c-fe2c-4379-b50a-08eb17062b91] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:06.584664 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3d9c93a0-7807-445a-872c-16ee2b894f03 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:06.585844 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3d9c93a0-7807-445a-872c-16ee2b894f03 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:06.586885 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3d9c93a0-7807-445a-872c-16ee2b894f03 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:06.588302 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3d9c93a0-7807-445a-872c-16ee2b894f03 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:06.589175 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3d9c93a0-7807-445a-872c-16ee2b894f03 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:06.589885 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3d9c93a0-7807-445a-872c-16ee2b894f03 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:06.617230 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-db1aab5f-f6c9-4d24-85a5-cd2930e6570f tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36f4114dc4f443f8b48da7b4027e0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a23a85365414f92bbc03177d7f190e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:06.631626 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-db1aab5f-f6c9-4d24-85a5-cd2930e6570f tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] 10.222.0.33 "GET /compute/v2.1/servers/42726a57-cdc8-45e3-8d61-348f02bfcd53" status: 200 len: 1316 microversion: 2.1 time: 0.373546 Oct 04 20:38:06.637188 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 571/1168] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:38:06 2022] GET /compute/v2.1/servers/42726a57-cdc8-45e3-8d61-348f02bfcd53 => generated 1316 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:38:06.748648 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1681c4ed-a3c7-487f-b4e4-df21a64d9c67 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-282213560", "imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63", "flavorRef": "452", "networks": [{"uuid": "eff6509b-9044-4f53-ac84-39573f9dabae"}]}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:38:06.773407 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-3d9c93a0-7807-445a-872c-16ee2b894f03 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:06.787249 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-3d9c93a0-7807-445a-872c-16ee2b894f03 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:06.789019 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-3d9c93a0-7807-445a-872c-16ee2b894f03 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:06.790658 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-3d9c93a0-7807-445a-872c-16ee2b894f03 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] 10.222.0.33 "GET /compute/v2.1/servers/f33c0e5c-fe2c-4379-b50a-08eb17062b91" status: 200 len: 1568 microversion: 2.25 time: 0.235131 Oct 04 20:38:06.803033 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 598/1169] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:38:06 2022] GET /compute/v2.1/servers/f33c0e5c-fe2c-4379-b50a-08eb17062b91 => generated 1568 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:38:06.809514 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.network.neutron [None req-1681c4ed-a3c7-487f-b4e4-df21a64d9c67 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] validate_networks() for [('eff6509b-9044-4f53-ac84-39573f9dabae', None, None, None, None, None)] {{(pid=128801) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:38:06.823705 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-2ee832cd-e4f9-4f69-8ec5-2f32e12ad91f tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:06.824376 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-2ee832cd-e4f9-4f69-8ec5-2f32e12ad91f tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] [instance: 5ac07e56-084c-4208-a988-13ec91af9171] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:06.830374 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2ee832cd-e4f9-4f69-8ec5-2f32e12ad91f tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:06.830885 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2ee832cd-e4f9-4f69-8ec5-2f32e12ad91f tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:06.831567 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2ee832cd-e4f9-4f69-8ec5-2f32e12ad91f tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:06.833198 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2ee832cd-e4f9-4f69-8ec5-2f32e12ad91f tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:06.833840 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2ee832cd-e4f9-4f69-8ec5-2f32e12ad91f tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:06.834452 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2ee832cd-e4f9-4f69-8ec5-2f32e12ad91f tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:07.091274 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-2ee832cd-e4f9-4f69-8ec5-2f32e12ad91f tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11149c46e1bc468f836fe70635dbf33b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e0d8329b2c4d64bf51d88948ca0de2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:07.100903 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-2ee832cd-e4f9-4f69-8ec5-2f32e12ad91f tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] 10.222.0.33 "GET /compute/v2.1/servers/5ac07e56-084c-4208-a988-13ec91af9171" status: 200 len: 1293 microversion: 2.1 time: 0.281481 Oct 04 20:38:07.102627 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 599/1170] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:38:06 2022] GET /compute/v2.1/servers/5ac07e56-084c-4208-a988-13ec91af9171 => generated 1293 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:38:07.109112 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-7f377ff1-8536-4696-9f8d-2f572fe84cfa tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:07.109941 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-7f377ff1-8536-4696-9f8d-2f572fe84cfa tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] [instance: 5e984459-625e-44cd-b226-091276567215] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:07.118749 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7f377ff1-8536-4696-9f8d-2f572fe84cfa tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:07.119188 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7f377ff1-8536-4696-9f8d-2f572fe84cfa tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:07.119834 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7f377ff1-8536-4696-9f8d-2f572fe84cfa tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:07.120648 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7f377ff1-8536-4696-9f8d-2f572fe84cfa tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:07.120947 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7f377ff1-8536-4696-9f8d-2f572fe84cfa tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:07.121708 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7f377ff1-8536-4696-9f8d-2f572fe84cfa tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:07.242967 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.objects.instance [None req-7f377ff1-8536-4696-9f8d-2f572fe84cfa tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] Lazy-loading 'services' on Instance uuid 5e984459-625e-44cd-b226-091276567215 {{(pid=128802) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:38:07.260905 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-7f377ff1-8536-4696-9f8d-2f572fe84cfa tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/5e984459-625e-44cd-b226-091276567215" status: 200 len: 1929 microversion: 2.75 time: 0.156909 Oct 04 20:38:07.272566 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 600/1171] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:38:07 2022] GET /compute/v2.1/servers/5e984459-625e-44cd-b226-091276567215 => generated 1929 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:38:07.272566 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-ccdc5621-349a-4417-9081-0a7f9627a067 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:07.272566 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-ccdc5621-349a-4417-9081-0a7f9627a067 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] [instance: 23da26ba-68f4-4aef-b13c-0b6588a65e43] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:07.272943 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ccdc5621-349a-4417-9081-0a7f9627a067 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:07.273341 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ccdc5621-349a-4417-9081-0a7f9627a067 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:07.273775 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ccdc5621-349a-4417-9081-0a7f9627a067 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:07.274496 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ccdc5621-349a-4417-9081-0a7f9627a067 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:07.274952 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ccdc5621-349a-4417-9081-0a7f9627a067 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:07.275364 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ccdc5621-349a-4417-9081-0a7f9627a067 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:07.290964 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=100 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:38:07.395462 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-ccdc5621-349a-4417-9081-0a7f9627a067 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3563efe2b8c94931a2a46c4e14811b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3118a5d96843d3bede1ed94bd9717e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:07.403321 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-ccdc5621-349a-4417-9081-0a7f9627a067 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] 10.222.0.33 "GET /compute/v2.1/servers/23da26ba-68f4-4aef-b13c-0b6588a65e43" status: 200 len: 1209 microversion: 2.1 time: 0.140528 Oct 04 20:38:07.403898 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 601/1172] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:38:07 2022] GET /compute/v2.1/servers/23da26ba-68f4-4aef-b13c-0b6588a65e43 => generated 1209 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:38:07.519904 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-1681c4ed-a3c7-487f-b4e4-df21a64d9c67 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Flavor limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:38:07.520337 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-1681c4ed-a3c7-487f-b4e4-df21a64d9c67 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Image limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:38:07.521296 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-1681c4ed-a3c7-487f-b4e4-df21a64d9c67 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Flavor pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:38:07.521714 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-1681c4ed-a3c7-487f-b4e4-df21a64d9c67 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Image pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:38:07.522409 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-1681c4ed-a3c7-487f-b4e4-df21a64d9c67 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:38:07.531631 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1681c4ed-a3c7-487f-b4e4-df21a64d9c67 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:07.532119 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1681c4ed-a3c7-487f-b4e4-df21a64d9c67 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:07.532662 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1681c4ed-a3c7-487f-b4e4-df21a64d9c67 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:07.533394 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1681c4ed-a3c7-487f-b4e4-df21a64d9c67 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:07.534071 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1681c4ed-a3c7-487f-b4e4-df21a64d9c67 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:07.534815 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1681c4ed-a3c7-487f-b4e4-df21a64d9c67 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:07.559915 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-1681c4ed-a3c7-487f-b4e4-df21a64d9c67 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Getting quotas for project d66ec8ea91b04deb90b679589e0495bb. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:38:07.565131 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-1681c4ed-a3c7-487f-b4e4-df21a64d9c67 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Getting quotas for user 800db3a57ada47eca381b00189fdbf0a and project d66ec8ea91b04deb90b679589e0495bb. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:38:07.582665 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-1681c4ed-a3c7-487f-b4e4-df21a64d9c67 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Going to run 1 instances... {{(pid=128801) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:38:07.582665 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-1681c4ed-a3c7-487f-b4e4-df21a64d9c67 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] [instance: 8a72de6a-64a0-4ec7-a613-576f8ac02af3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='15b24725-0c99-4bcf-b1fb-907cdf8e2d63',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128801) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:38:07.630014 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-1681c4ed-a3c7-487f-b4e4-df21a64d9c67 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.885578 Oct 04 20:38:07.630746 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 572/1173] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 20:38:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 888 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 20:38:07.641863 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-d084eaa7-8755-49bf-a717-c6496c9722fd tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:07.642599 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-d084eaa7-8755-49bf-a717-c6496c9722fd tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] [instance: 8a72de6a-64a0-4ec7-a613-576f8ac02af3] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:07.657273 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5989ead3-3c5d-4292-9646-06cd3f18659f tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:07.657943 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-5989ead3-3c5d-4292-9646-06cd3f18659f tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] [instance: 42726a57-cdc8-45e3-8d61-348f02bfcd53] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:07.679786 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5989ead3-3c5d-4292-9646-06cd3f18659f tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:07.680292 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5989ead3-3c5d-4292-9646-06cd3f18659f tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:07.680722 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5989ead3-3c5d-4292-9646-06cd3f18659f tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:07.681420 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5989ead3-3c5d-4292-9646-06cd3f18659f tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:07.683028 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5989ead3-3c5d-4292-9646-06cd3f18659f tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:07.683930 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5989ead3-3c5d-4292-9646-06cd3f18659f tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:07.841374 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-d084eaa7-8755-49bf-a717-c6496c9722fd tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '800db3a57ada47eca381b00189fdbf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66ec8ea91b04deb90b679589e0495bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:07.850835 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-d084eaa7-8755-49bf-a717-c6496c9722fd tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] 10.222.0.33 "GET /compute/v2.1/servers/8a72de6a-64a0-4ec7-a613-576f8ac02af3" status: 200 len: 1210 microversion: 2.1 time: 0.211175 Oct 04 20:38:07.851722 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 602/1174] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:38:07 2022] GET /compute/v2.1/servers/8a72de6a-64a0-4ec7-a613-576f8ac02af3 => generated 1210 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:38:07.893806 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-9064af6a-8bd4-4342-9dc2-aac9b6f4f37b tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:07.896009 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-9064af6a-8bd4-4342-9dc2-aac9b6f4f37b tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] [instance: f33c0e5c-fe2c-4379-b50a-08eb17062b91] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:07.903857 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9064af6a-8bd4-4342-9dc2-aac9b6f4f37b tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:07.904570 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9064af6a-8bd4-4342-9dc2-aac9b6f4f37b tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:07.905028 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9064af6a-8bd4-4342-9dc2-aac9b6f4f37b tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:07.905765 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9064af6a-8bd4-4342-9dc2-aac9b6f4f37b tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:07.906224 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9064af6a-8bd4-4342-9dc2-aac9b6f4f37b tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:07.906676 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9064af6a-8bd4-4342-9dc2-aac9b6f4f37b tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:08.108590 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-5989ead3-3c5d-4292-9646-06cd3f18659f tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36f4114dc4f443f8b48da7b4027e0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a23a85365414f92bbc03177d7f190e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:08.118092 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5989ead3-3c5d-4292-9646-06cd3f18659f tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] 10.222.0.33 "GET /compute/v2.1/servers/42726a57-cdc8-45e3-8d61-348f02bfcd53" status: 200 len: 1316 microversion: 2.1 time: 0.464772 Oct 04 20:38:08.118973 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 573/1175] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:38:07 2022] GET /compute/v2.1/servers/42726a57-cdc8-45e3-8d61-348f02bfcd53 => generated 1316 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:38:08.124083 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-221508ad-136a-4cdb-a3aa-b384dc17e905 req-61ceef2f-8ed1-4a0a-aff3-2136171f54a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "465ad440-a27e-4ff6-bb31-09f3545e166a", "name": "network-vif-plugged", "status": "completed", "tag": "c16cb04f-6af6-4073-98de-ed8d89a2e3c2"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:38:08.143258 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-221508ad-136a-4cdb-a3aa-b384dc17e905 req-61ceef2f-8ed1-4a0a-aff3-2136171f54a2 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:08.146464 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-221508ad-136a-4cdb-a3aa-b384dc17e905 req-61ceef2f-8ed1-4a0a-aff3-2136171f54a2 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:08.148536 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-221508ad-136a-4cdb-a3aa-b384dc17e905 req-61ceef2f-8ed1-4a0a-aff3-2136171f54a2 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:08.167367 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-221508ad-136a-4cdb-a3aa-b384dc17e905 req-61ceef2f-8ed1-4a0a-aff3-2136171f54a2 service nova] Creating event network-vif-plugged:c16cb04f-6af6-4073-98de-ed8d89a2e3c2 for instance 465ad440-a27e-4ff6-bb31-09f3545e166a on n-h2-854823-8 Oct 04 20:38:08.172968 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-221508ad-136a-4cdb-a3aa-b384dc17e905 req-61ceef2f-8ed1-4a0a-aff3-2136171f54a2 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052620 Oct 04 20:38:08.174039 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 574/1176] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:38:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:38:08.180332 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a276bc59-7e11-40b6-ad3c-17b7f258b37c tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:08.181233 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a276bc59-7e11-40b6-ad3c-17b7f258b37c tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] [instance: 5ac07e56-084c-4208-a988-13ec91af9171] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:08.187972 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a276bc59-7e11-40b6-ad3c-17b7f258b37c tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:08.188671 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a276bc59-7e11-40b6-ad3c-17b7f258b37c tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:08.189256 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a276bc59-7e11-40b6-ad3c-17b7f258b37c tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:08.190148 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a276bc59-7e11-40b6-ad3c-17b7f258b37c tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:08.190805 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a276bc59-7e11-40b6-ad3c-17b7f258b37c tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:08.191440 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a276bc59-7e11-40b6-ad3c-17b7f258b37c tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:08.245292 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-9064af6a-8bd4-4342-9dc2-aac9b6f4f37b tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:08.276105 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-9064af6a-8bd4-4342-9dc2-aac9b6f4f37b tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:08.278087 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-9064af6a-8bd4-4342-9dc2-aac9b6f4f37b tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:08.279589 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-9064af6a-8bd4-4342-9dc2-aac9b6f4f37b tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] 10.222.0.33 "GET /compute/v2.1/servers/f33c0e5c-fe2c-4379-b50a-08eb17062b91" status: 200 len: 1568 microversion: 2.25 time: 0.416073 Oct 04 20:38:08.280395 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 603/1177] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:38:07 2022] GET /compute/v2.1/servers/f33c0e5c-fe2c-4379-b50a-08eb17062b91 => generated 1568 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:38:08.287705 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-10b90fb0-5339-4f04-9e21-1b897688d77f req-fdc1a967-f872-4768-90ba-e32048cb96ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f33c0e5c-fe2c-4379-b50a-08eb17062b91", "name": "network-vif-unplugged", "status": "completed", "tag": "619319cb-49b8-4e19-a3ae-04ba59d88700"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:38:08.298148 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-10b90fb0-5339-4f04-9e21-1b897688d77f req-fdc1a967-f872-4768-90ba-e32048cb96ce service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:08.298687 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-10b90fb0-5339-4f04-9e21-1b897688d77f req-fdc1a967-f872-4768-90ba-e32048cb96ce service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:08.299120 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-10b90fb0-5339-4f04-9e21-1b897688d77f req-fdc1a967-f872-4768-90ba-e32048cb96ce service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:08.314030 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-10b90fb0-5339-4f04-9e21-1b897688d77f req-fdc1a967-f872-4768-90ba-e32048cb96ce service nova] Creating event network-vif-unplugged:619319cb-49b8-4e19-a3ae-04ba59d88700 for instance f33c0e5c-fe2c-4379-b50a-08eb17062b91 on n-h2-854823-8 Oct 04 20:38:08.319892 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-10b90fb0-5339-4f04-9e21-1b897688d77f req-fdc1a967-f872-4768-90ba-e32048cb96ce service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037961 Oct 04 20:38:08.321002 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 604/1178] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:38:08 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:38:08.326493 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-fa2147c4-f95f-4a35-90bc-0da8fe9985a0 tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:08.327564 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-fa2147c4-f95f-4a35-90bc-0da8fe9985a0 tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] [instance: 5e984459-625e-44cd-b226-091276567215] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:08.334163 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fa2147c4-f95f-4a35-90bc-0da8fe9985a0 tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:08.334695 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fa2147c4-f95f-4a35-90bc-0da8fe9985a0 tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:08.335159 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fa2147c4-f95f-4a35-90bc-0da8fe9985a0 tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:08.335865 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fa2147c4-f95f-4a35-90bc-0da8fe9985a0 tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:08.336493 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fa2147c4-f95f-4a35-90bc-0da8fe9985a0 tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:08.337353 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fa2147c4-f95f-4a35-90bc-0da8fe9985a0 tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:08.474110 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.objects.instance [None req-fa2147c4-f95f-4a35-90bc-0da8fe9985a0 tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] Lazy-loading 'services' on Instance uuid 5e984459-625e-44cd-b226-091276567215 {{(pid=128802) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:38:08.497705 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-fa2147c4-f95f-4a35-90bc-0da8fe9985a0 tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/5e984459-625e-44cd-b226-091276567215" status: 200 len: 1929 microversion: 2.75 time: 0.175204 Oct 04 20:38:08.498727 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 605/1179] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:38:08 2022] GET /compute/v2.1/servers/5e984459-625e-44cd-b226-091276567215 => generated 1929 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:38:08.503843 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-528619f5-004d-475f-af23-c104d827bc69 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:08.505293 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-528619f5-004d-475f-af23-c104d827bc69 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] [instance: 23da26ba-68f4-4aef-b13c-0b6588a65e43] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:08.512800 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-528619f5-004d-475f-af23-c104d827bc69 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:08.513575 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-528619f5-004d-475f-af23-c104d827bc69 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:08.514471 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-528619f5-004d-475f-af23-c104d827bc69 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:08.515515 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-528619f5-004d-475f-af23-c104d827bc69 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:08.516182 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-528619f5-004d-475f-af23-c104d827bc69 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:08.516818 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-528619f5-004d-475f-af23-c104d827bc69 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:08.521631 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-a276bc59-7e11-40b6-ad3c-17b7f258b37c tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11149c46e1bc468f836fe70635dbf33b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e0d8329b2c4d64bf51d88948ca0de2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:08.543813 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a276bc59-7e11-40b6-ad3c-17b7f258b37c tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] 10.222.0.33 "GET /compute/v2.1/servers/5ac07e56-084c-4208-a988-13ec91af9171" status: 200 len: 1293 microversion: 2.1 time: 0.368350 Oct 04 20:38:08.561165 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 575/1180] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:38:08 2022] GET /compute/v2.1/servers/5ac07e56-084c-4208-a988-13ec91af9171 => generated 1293 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:38:08.620807 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-528619f5-004d-475f-af23-c104d827bc69 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3563efe2b8c94931a2a46c4e14811b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3118a5d96843d3bede1ed94bd9717e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:08.634488 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-528619f5-004d-475f-af23-c104d827bc69 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] 10.222.0.33 "GET /compute/v2.1/servers/23da26ba-68f4-4aef-b13c-0b6588a65e43" status: 200 len: 1265 microversion: 2.1 time: 0.131537 Oct 04 20:38:08.635647 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 606/1181] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:38:08 2022] GET /compute/v2.1/servers/23da26ba-68f4-4aef-b13c-0b6588a65e43 => generated 1265 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:38:08.881675 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-539fd48a-ff6a-4ff0-a24e-ef1ea2545a64 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:08.882714 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-539fd48a-ff6a-4ff0-a24e-ef1ea2545a64 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] [instance: 8a72de6a-64a0-4ec7-a613-576f8ac02af3] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:08.890787 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-539fd48a-ff6a-4ff0-a24e-ef1ea2545a64 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:08.892097 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-539fd48a-ff6a-4ff0-a24e-ef1ea2545a64 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:08.892801 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-539fd48a-ff6a-4ff0-a24e-ef1ea2545a64 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:08.893730 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-539fd48a-ff6a-4ff0-a24e-ef1ea2545a64 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:08.894170 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-539fd48a-ff6a-4ff0-a24e-ef1ea2545a64 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:08.895268 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-539fd48a-ff6a-4ff0-a24e-ef1ea2545a64 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:08.966280 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-539fd48a-ff6a-4ff0-a24e-ef1ea2545a64 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '800db3a57ada47eca381b00189fdbf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66ec8ea91b04deb90b679589e0495bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:08.974937 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-539fd48a-ff6a-4ff0-a24e-ef1ea2545a64 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] 10.222.0.33 "GET /compute/v2.1/servers/8a72de6a-64a0-4ec7-a613-576f8ac02af3" status: 200 len: 1214 microversion: 2.1 time: 0.098467 Oct 04 20:38:08.975889 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 576/1182] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:38:08 2022] GET /compute/v2.1/servers/8a72de6a-64a0-4ec7-a613-576f8ac02af3 => generated 1214 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:38:09.141598 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-39c04e66-6715-4625-8b23-eb710891bec4 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:09.142983 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-39c04e66-6715-4625-8b23-eb710891bec4 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] [instance: 42726a57-cdc8-45e3-8d61-348f02bfcd53] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:09.151559 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-39c04e66-6715-4625-8b23-eb710891bec4 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:09.152047 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-39c04e66-6715-4625-8b23-eb710891bec4 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:09.152513 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-39c04e66-6715-4625-8b23-eb710891bec4 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:09.153363 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-39c04e66-6715-4625-8b23-eb710891bec4 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:09.153915 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-39c04e66-6715-4625-8b23-eb710891bec4 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:09.154217 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-39c04e66-6715-4625-8b23-eb710891bec4 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:09.306874 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-39c04e66-6715-4625-8b23-eb710891bec4 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36f4114dc4f443f8b48da7b4027e0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a23a85365414f92bbc03177d7f190e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:09.312688 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8445c130-ddab-424a-bae7-e86f17ba780f tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:09.313270 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-8445c130-ddab-424a-bae7-e86f17ba780f tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] [instance: f33c0e5c-fe2c-4379-b50a-08eb17062b91] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:09.325174 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-39c04e66-6715-4625-8b23-eb710891bec4 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] 10.222.0.33 "GET /compute/v2.1/servers/42726a57-cdc8-45e3-8d61-348f02bfcd53" status: 200 len: 1466 microversion: 2.1 time: 0.187171 Oct 04 20:38:09.344335 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8445c130-ddab-424a-bae7-e86f17ba780f tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:09.344846 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8445c130-ddab-424a-bae7-e86f17ba780f tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:09.345282 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8445c130-ddab-424a-bae7-e86f17ba780f tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:09.346424 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 607/1183] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:38:09 2022] GET /compute/v2.1/servers/42726a57-cdc8-45e3-8d61-348f02bfcd53 => generated 1466 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:38:09.352939 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8445c130-ddab-424a-bae7-e86f17ba780f tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:09.353616 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8445c130-ddab-424a-bae7-e86f17ba780f tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:09.354213 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8445c130-ddab-424a-bae7-e86f17ba780f tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:09.551164 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-8445c130-ddab-424a-bae7-e86f17ba780f tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:09.563997 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-8445c130-ddab-424a-bae7-e86f17ba780f tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:09.566087 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-8445c130-ddab-424a-bae7-e86f17ba780f tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:09.568085 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-8445c130-ddab-424a-bae7-e86f17ba780f tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] 10.222.0.33 "GET /compute/v2.1/servers/f33c0e5c-fe2c-4379-b50a-08eb17062b91" status: 200 len: 1568 microversion: 2.25 time: 0.265789 Oct 04 20:38:09.582558 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 577/1184] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:38:09 2022] GET /compute/v2.1/servers/f33c0e5c-fe2c-4379-b50a-08eb17062b91 => generated 1568 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:38:09.582558 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a0b033b1-3133-43f3-8c99-f5ef2d239f14 tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:09.582558 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a0b033b1-3133-43f3-8c99-f5ef2d239f14 tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] [instance: 5e984459-625e-44cd-b226-091276567215] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:09.590583 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a0b033b1-3133-43f3-8c99-f5ef2d239f14 tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:09.590583 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a0b033b1-3133-43f3-8c99-f5ef2d239f14 tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:09.590583 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a0b033b1-3133-43f3-8c99-f5ef2d239f14 tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:09.591305 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a0b033b1-3133-43f3-8c99-f5ef2d239f14 tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:09.591829 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a0b033b1-3133-43f3-8c99-f5ef2d239f14 tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:09.592255 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a0b033b1-3133-43f3-8c99-f5ef2d239f14 tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:09.655830 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-0f72067f-ef9c-420e-b3b2-75876c2195a2 tempest-ServersOnMultiNodesTest-176762512 tempest-ServersOnMultiNodesTest-176762512-project-admin] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:09.658270 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-0f72067f-ef9c-420e-b3b2-75876c2195a2 tempest-ServersOnMultiNodesTest-176762512 tempest-ServersOnMultiNodesTest-176762512-project-admin] [instance: 42726a57-cdc8-45e3-8d61-348f02bfcd53] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:09.675477 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0f72067f-ef9c-420e-b3b2-75876c2195a2 tempest-ServersOnMultiNodesTest-176762512 tempest-ServersOnMultiNodesTest-176762512-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:09.676178 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0f72067f-ef9c-420e-b3b2-75876c2195a2 tempest-ServersOnMultiNodesTest-176762512 tempest-ServersOnMultiNodesTest-176762512-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:09.676610 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0f72067f-ef9c-420e-b3b2-75876c2195a2 tempest-ServersOnMultiNodesTest-176762512 tempest-ServersOnMultiNodesTest-176762512-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:09.711391 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0f72067f-ef9c-420e-b3b2-75876c2195a2 tempest-ServersOnMultiNodesTest-176762512 tempest-ServersOnMultiNodesTest-176762512-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:09.711928 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0f72067f-ef9c-420e-b3b2-75876c2195a2 tempest-ServersOnMultiNodesTest-176762512 tempest-ServersOnMultiNodesTest-176762512-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:09.712575 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0f72067f-ef9c-420e-b3b2-75876c2195a2 tempest-ServersOnMultiNodesTest-176762512 tempest-ServersOnMultiNodesTest-176762512-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:09.781031 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-a0b033b1-3133-43f3-8c99-f5ef2d239f14 tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] Lazy-loading 'services' on Instance uuid 5e984459-625e-44cd-b226-091276567215 {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:38:09.845350 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a0b033b1-3133-43f3-8c99-f5ef2d239f14 tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/5e984459-625e-44cd-b226-091276567215" status: 200 len: 1929 microversion: 2.75 time: 0.275178 Oct 04 20:38:09.851452 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 578/1185] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:38:09 2022] GET /compute/v2.1/servers/5e984459-625e-44cd-b226-091276567215 => generated 1929 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:38:09.858590 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9888ab9c-f122-471a-8838-858be2438641 tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:09.863279 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-9888ab9c-f122-471a-8838-858be2438641 tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] [instance: 5ac07e56-084c-4208-a988-13ec91af9171] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:09.877782 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9888ab9c-f122-471a-8838-858be2438641 tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:09.881181 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9888ab9c-f122-471a-8838-858be2438641 tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:09.882038 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9888ab9c-f122-471a-8838-858be2438641 tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:09.883158 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9888ab9c-f122-471a-8838-858be2438641 tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:09.884111 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9888ab9c-f122-471a-8838-858be2438641 tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:09.887543 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9888ab9c-f122-471a-8838-858be2438641 tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:10.284491 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-9888ab9c-f122-471a-8838-858be2438641 tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11149c46e1bc468f836fe70635dbf33b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e0d8329b2c4d64bf51d88948ca0de2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:10.295243 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-9888ab9c-f122-471a-8838-858be2438641 tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] 10.222.0.33 "GET /compute/v2.1/servers/5ac07e56-084c-4208-a988-13ec91af9171" status: 200 len: 1293 microversion: 2.1 time: 0.441915 Oct 04 20:38:10.297072 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 579/1186] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:38:09 2022] GET /compute/v2.1/servers/5ac07e56-084c-4208-a988-13ec91af9171 => generated 1293 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:38:10.304070 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-54a78537-df01-4bf9-9568-565d1e83f714 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:10.305423 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-54a78537-df01-4bf9-9568-565d1e83f714 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] [instance: 23da26ba-68f4-4aef-b13c-0b6588a65e43] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:10.315981 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-54a78537-df01-4bf9-9568-565d1e83f714 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:10.317694 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-54a78537-df01-4bf9-9568-565d1e83f714 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:10.318420 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-54a78537-df01-4bf9-9568-565d1e83f714 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:10.319863 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-54a78537-df01-4bf9-9568-565d1e83f714 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:10.320955 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-54a78537-df01-4bf9-9568-565d1e83f714 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:10.321776 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-54a78537-df01-4bf9-9568-565d1e83f714 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:10.427643 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-54a78537-df01-4bf9-9568-565d1e83f714 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3563efe2b8c94931a2a46c4e14811b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3118a5d96843d3bede1ed94bd9717e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:10.435577 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-54a78537-df01-4bf9-9568-565d1e83f714 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] 10.222.0.33 "GET /compute/v2.1/servers/23da26ba-68f4-4aef-b13c-0b6588a65e43" status: 200 len: 1271 microversion: 2.1 time: 0.137009 Oct 04 20:38:10.436424 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 580/1187] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:38:10 2022] GET /compute/v2.1/servers/23da26ba-68f4-4aef-b13c-0b6588a65e43 => generated 1271 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:38:10.441262 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-cca6e8a0-d69e-4c65-bd6c-32ac8cad2cb0 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:10.442209 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-cca6e8a0-d69e-4c65-bd6c-32ac8cad2cb0 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] [instance: 8a72de6a-64a0-4ec7-a613-576f8ac02af3] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:10.448922 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cca6e8a0-d69e-4c65-bd6c-32ac8cad2cb0 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:10.449686 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cca6e8a0-d69e-4c65-bd6c-32ac8cad2cb0 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:10.450361 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cca6e8a0-d69e-4c65-bd6c-32ac8cad2cb0 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:10.451322 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cca6e8a0-d69e-4c65-bd6c-32ac8cad2cb0 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:10.452000 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cca6e8a0-d69e-4c65-bd6c-32ac8cad2cb0 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:10.452689 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cca6e8a0-d69e-4c65-bd6c-32ac8cad2cb0 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:10.475581 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-0f72067f-ef9c-420e-b3b2-75876c2195a2 tempest-ServersOnMultiNodesTest-176762512 tempest-ServersOnMultiNodesTest-176762512-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/42726a57-cdc8-45e3-8d61-348f02bfcd53" status: 200 len: 1617 microversion: 2.1 time: 1.127744 Oct 04 20:38:10.481390 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 608/1188] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:38:09 2022] GET /compute/v2.1/servers/42726a57-cdc8-45e3-8d61-348f02bfcd53 => generated 1617 bytes in 1134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:38:10.489974 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-3977f302-d414-47bb-8e7e-ac404db7c8f9 tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:10.497936 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-3977f302-d414-47bb-8e7e-ac404db7c8f9 tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] [instance: 7d9db253-559a-4d4b-9a5e-42c8f63f6cb7] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:10.506039 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3977f302-d414-47bb-8e7e-ac404db7c8f9 tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:10.506887 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3977f302-d414-47bb-8e7e-ac404db7c8f9 tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:10.507475 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3977f302-d414-47bb-8e7e-ac404db7c8f9 tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:10.508338 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3977f302-d414-47bb-8e7e-ac404db7c8f9 tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:10.508937 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3977f302-d414-47bb-8e7e-ac404db7c8f9 tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:10.510280 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3977f302-d414-47bb-8e7e-ac404db7c8f9 tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:10.552674 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-3977f302-d414-47bb-8e7e-ac404db7c8f9 tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] 10.222.0.33 "GET /compute/v2.1/servers/7d9db253-559a-4d4b-9a5e-42c8f63f6cb7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.070138 Oct 04 20:38:10.553701 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 609/1189] 10.222.0.33 () {58 vars in 1302 bytes} [Tue Oct 4 20:38:10 2022] GET /compute/v2.1/servers/7d9db253-559a-4d4b-9a5e-42c8f63f6cb7/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:38:10.558801 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-381bef27-f8a8-4c5d-8dbe-508b611a145f req-a3e8eb05-3320-4b16-9b82-7da247a6efd0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f33c0e5c-fe2c-4379-b50a-08eb17062b91", "tag": "619319cb-49b8-4e19-a3ae-04ba59d88700"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:38:10.572459 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-381bef27-f8a8-4c5d-8dbe-508b611a145f req-a3e8eb05-3320-4b16-9b82-7da247a6efd0 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:10.573953 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-381bef27-f8a8-4c5d-8dbe-508b611a145f req-a3e8eb05-3320-4b16-9b82-7da247a6efd0 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:10.574918 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-381bef27-f8a8-4c5d-8dbe-508b611a145f req-a3e8eb05-3320-4b16-9b82-7da247a6efd0 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:10.578235 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-cca6e8a0-d69e-4c65-bd6c-32ac8cad2cb0 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '800db3a57ada47eca381b00189fdbf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66ec8ea91b04deb90b679589e0495bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:10.590667 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-381bef27-f8a8-4c5d-8dbe-508b611a145f req-a3e8eb05-3320-4b16-9b82-7da247a6efd0 service nova] Creating event network-changed:619319cb-49b8-4e19-a3ae-04ba59d88700 for instance f33c0e5c-fe2c-4379-b50a-08eb17062b91 on n-h2-854823-8 Oct 04 20:38:10.595400 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-cca6e8a0-d69e-4c65-bd6c-32ac8cad2cb0 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] 10.222.0.33 "GET /compute/v2.1/servers/8a72de6a-64a0-4ec7-a613-576f8ac02af3" status: 200 len: 1262 microversion: 2.1 time: 0.157561 Oct 04 20:38:10.596300 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 581/1190] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:38:10 2022] GET /compute/v2.1/servers/8a72de6a-64a0-4ec7-a613-576f8ac02af3 => generated 1262 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:38:10.602961 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-935dbb9d-3a46-49c7-ba6a-92f4be0ec5bb tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Action: 'create', calling method: .version_select at 0x7f3c74332550>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-733922520", "policies": ["affinity"]}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:38:10.612446 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-381bef27-f8a8-4c5d-8dbe-508b611a145f req-a3e8eb05-3320-4b16-9b82-7da247a6efd0 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057032 Oct 04 20:38:10.614223 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 610/1191] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:38:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:38:10.621582 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-30b24fb5-78ef-4711-8eb2-e6f79ee8e8cd tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:10.622403 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-30b24fb5-78ef-4711-8eb2-e6f79ee8e8cd tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] [instance: 7d9db253-559a-4d4b-9a5e-42c8f63f6cb7] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:10.630897 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-935dbb9d-3a46-49c7-ba6a-92f4be0ec5bb tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Getting quotas for project 1a23a85365414f92bbc03177d7f190e6. Resources: {'server_groups'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:38:10.635979 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-30b24fb5-78ef-4711-8eb2-e6f79ee8e8cd tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:10.636187 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-30b24fb5-78ef-4711-8eb2-e6f79ee8e8cd tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:10.636571 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-30b24fb5-78ef-4711-8eb2-e6f79ee8e8cd tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:10.637310 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-30b24fb5-78ef-4711-8eb2-e6f79ee8e8cd tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:10.637538 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-935dbb9d-3a46-49c7-ba6a-92f4be0ec5bb tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Getting quotas for user e36f4114dc4f443f8b48da7b4027e0c1 and project 1a23a85365414f92bbc03177d7f190e6. Resources: {'server_groups'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:38:10.639472 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-30b24fb5-78ef-4711-8eb2-e6f79ee8e8cd tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:10.640161 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-30b24fb5-78ef-4711-8eb2-e6f79ee8e8cd tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:10.696599 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:38:10.708518 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-935dbb9d-3a46-49c7-ba6a-92f4be0ec5bb tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Getting quotas for project 1a23a85365414f92bbc03177d7f190e6. Resources: {'server_groups'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:38:10.721393 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-935dbb9d-3a46-49c7-ba6a-92f4be0ec5bb tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Getting quotas for user e36f4114dc4f443f8b48da7b4027e0c1 and project 1a23a85365414f92bbc03177d7f190e6. Resources: {'server_groups'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:38:10.743621 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-935dbb9d-3a46-49c7-ba6a-92f4be0ec5bb tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] 10.222.0.33 "POST /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.146233 Oct 04 20:38:10.744526 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 582/1192] 10.222.0.33 () {60 vars in 1174 bytes} [Tue Oct 4 20:38:10 2022] POST /compute/v2.1/os-server-groups => generated 187 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:38:10.755408 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-fc71cf4f-3760-4250-a70e-1a2006ddad46 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:10.756657 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-fc71cf4f-3760-4250-a70e-1a2006ddad46 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] [instance: f33c0e5c-fe2c-4379-b50a-08eb17062b91] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:10.764235 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fc71cf4f-3760-4250-a70e-1a2006ddad46 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:10.764837 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fc71cf4f-3760-4250-a70e-1a2006ddad46 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:10.765722 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fc71cf4f-3760-4250-a70e-1a2006ddad46 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:10.766568 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fc71cf4f-3760-4250-a70e-1a2006ddad46 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:10.767472 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fc71cf4f-3760-4250-a70e-1a2006ddad46 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:10.768075 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fc71cf4f-3760-4250-a70e-1a2006ddad46 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:10.934563 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.objects.instance [None req-30b24fb5-78ef-4711-8eb2-e6f79ee8e8cd tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Lazy-loading 'services' on Instance uuid 7d9db253-559a-4d4b-9a5e-42c8f63f6cb7 {{(pid=128802) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:38:11.153443 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-30b24fb5-78ef-4711-8eb2-e6f79ee8e8cd tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] 10.222.0.33 "DELETE /compute/v2.1/servers/7d9db253-559a-4d4b-9a5e-42c8f63f6cb7/os-volume_attachments/46cf45ea-fecc-44e2-8e73-7f7892c24148" status: 202 len: 0 microversion: 2.1 time: 0.537448 Oct 04 20:38:11.154469 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 611/1193] 10.222.0.33 () {58 vars in 1416 bytes} [Tue Oct 4 20:38:10 2022] DELETE /compute/v2.1/servers/7d9db253-559a-4d4b-9a5e-42c8f63f6cb7/os-volume_attachments/46cf45ea-fecc-44e2-8e73-7f7892c24148 => generated 0 bytes in 539 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:38:11.179166 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-030184b3-051f-464b-afe9-93ea1917bfb8 tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:11.180771 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-030184b3-051f-464b-afe9-93ea1917bfb8 tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] [instance: 5e984459-625e-44cd-b226-091276567215] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:11.195223 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-030184b3-051f-464b-afe9-93ea1917bfb8 tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:11.196001 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-030184b3-051f-464b-afe9-93ea1917bfb8 tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:11.198712 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-030184b3-051f-464b-afe9-93ea1917bfb8 tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:11.199686 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-030184b3-051f-464b-afe9-93ea1917bfb8 tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:11.200300 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-030184b3-051f-464b-afe9-93ea1917bfb8 tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:11.202364 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-030184b3-051f-464b-afe9-93ea1917bfb8 tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:11.210447 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-fc71cf4f-3760-4250-a70e-1a2006ddad46 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:11.224080 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-fc71cf4f-3760-4250-a70e-1a2006ddad46 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:11.225508 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-fc71cf4f-3760-4250-a70e-1a2006ddad46 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:11.233911 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-fc71cf4f-3760-4250-a70e-1a2006ddad46 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] 10.222.0.33 "GET /compute/v2.1/servers/f33c0e5c-fe2c-4379-b50a-08eb17062b91" status: 200 len: 1568 microversion: 2.25 time: 0.486773 Oct 04 20:38:11.235667 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 583/1194] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:38:10 2022] GET /compute/v2.1/servers/f33c0e5c-fe2c-4379-b50a-08eb17062b91 => generated 1568 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:38:11.245386 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-35eb6f52-9c08-41a3-ba20-e93101fa3dfa tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1297776336", "imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "49c045c4-4d35-4fe6-956c-aa9908064ea1"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:38:11.394761 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.network.neutron [None req-35eb6f52-9c08-41a3-ba20-e93101fa3dfa tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] validate_networks() for None {{(pid=128801) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:38:11.506160 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.objects.instance [None req-030184b3-051f-464b-afe9-93ea1917bfb8 tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] Lazy-loading 'services' on Instance uuid 5e984459-625e-44cd-b226-091276567215 {{(pid=128802) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:38:11.551985 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-030184b3-051f-464b-afe9-93ea1917bfb8 tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/5e984459-625e-44cd-b226-091276567215" status: 200 len: 1929 microversion: 2.75 time: 0.383024 Oct 04 20:38:11.555564 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 612/1195] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:38:11 2022] GET /compute/v2.1/servers/5e984459-625e-44cd-b226-091276567215 => generated 1929 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:38:11.575566 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-f5d6ac9b-b813-4360-b65f-33f03cd13673 tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:11.576429 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-f5d6ac9b-b813-4360-b65f-33f03cd13673 tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] [instance: 5ac07e56-084c-4208-a988-13ec91af9171] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:11.591543 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f5d6ac9b-b813-4360-b65f-33f03cd13673 tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:11.592132 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f5d6ac9b-b813-4360-b65f-33f03cd13673 tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:11.592575 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f5d6ac9b-b813-4360-b65f-33f03cd13673 tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:11.593303 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f5d6ac9b-b813-4360-b65f-33f03cd13673 tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:11.593793 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f5d6ac9b-b813-4360-b65f-33f03cd13673 tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:11.594156 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f5d6ac9b-b813-4360-b65f-33f03cd13673 tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:12.422070 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-f5d6ac9b-b813-4360-b65f-33f03cd13673 tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11149c46e1bc468f836fe70635dbf33b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e0d8329b2c4d64bf51d88948ca0de2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:12.438658 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-f5d6ac9b-b813-4360-b65f-33f03cd13673 tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] 10.222.0.33 "GET /compute/v2.1/servers/5ac07e56-084c-4208-a988-13ec91af9171" status: 200 len: 1293 microversion: 2.1 time: 0.878975 Oct 04 20:38:12.441198 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 613/1196] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:38:11 2022] GET /compute/v2.1/servers/5ac07e56-084c-4208-a988-13ec91af9171 => generated 1293 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:38:12.467841 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-622416e5-6a6b-4bbc-838f-c10098945382 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:12.468915 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-622416e5-6a6b-4bbc-838f-c10098945382 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] [instance: 23da26ba-68f4-4aef-b13c-0b6588a65e43] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:12.492874 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-622416e5-6a6b-4bbc-838f-c10098945382 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:12.498295 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-622416e5-6a6b-4bbc-838f-c10098945382 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:12.498907 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-622416e5-6a6b-4bbc-838f-c10098945382 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:12.499762 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-622416e5-6a6b-4bbc-838f-c10098945382 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:12.500468 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-622416e5-6a6b-4bbc-838f-c10098945382 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:12.502576 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-622416e5-6a6b-4bbc-838f-c10098945382 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:12.666334 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-622416e5-6a6b-4bbc-838f-c10098945382 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3563efe2b8c94931a2a46c4e14811b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3118a5d96843d3bede1ed94bd9717e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:12.671104 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-35eb6f52-9c08-41a3-ba20-e93101fa3dfa tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Flavor limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:38:12.673680 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-35eb6f52-9c08-41a3-ba20-e93101fa3dfa tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Image limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:38:12.674556 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-35eb6f52-9c08-41a3-ba20-e93101fa3dfa tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Flavor pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:38:12.675339 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-35eb6f52-9c08-41a3-ba20-e93101fa3dfa tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Image pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:38:12.676483 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-35eb6f52-9c08-41a3-ba20-e93101fa3dfa tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:38:12.681539 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-622416e5-6a6b-4bbc-838f-c10098945382 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] 10.222.0.33 "GET /compute/v2.1/servers/23da26ba-68f4-4aef-b13c-0b6588a65e43" status: 200 len: 1271 microversion: 2.1 time: 0.238728 Oct 04 20:38:12.684748 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 614/1197] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:38:12 2022] GET /compute/v2.1/servers/23da26ba-68f4-4aef-b13c-0b6588a65e43 => generated 1271 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:38:12.712364 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-672e9f5d-9817-458e-bc36-89e13aa93cc9 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:12.715553 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-672e9f5d-9817-458e-bc36-89e13aa93cc9 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] [instance: 8a72de6a-64a0-4ec7-a613-576f8ac02af3] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:12.729433 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-672e9f5d-9817-458e-bc36-89e13aa93cc9 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:12.730924 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-672e9f5d-9817-458e-bc36-89e13aa93cc9 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:12.732242 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-672e9f5d-9817-458e-bc36-89e13aa93cc9 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:12.734693 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-672e9f5d-9817-458e-bc36-89e13aa93cc9 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:12.735475 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-672e9f5d-9817-458e-bc36-89e13aa93cc9 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:12.739133 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-672e9f5d-9817-458e-bc36-89e13aa93cc9 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:12.803132 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-35eb6f52-9c08-41a3-ba20-e93101fa3dfa tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:12.804712 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-35eb6f52-9c08-41a3-ba20-e93101fa3dfa tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:12.807377 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-35eb6f52-9c08-41a3-ba20-e93101fa3dfa tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:12.821761 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-35eb6f52-9c08-41a3-ba20-e93101fa3dfa tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:12.822907 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-35eb6f52-9c08-41a3-ba20-e93101fa3dfa tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:12.826760 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-35eb6f52-9c08-41a3-ba20-e93101fa3dfa tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:12.887281 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-35eb6f52-9c08-41a3-ba20-e93101fa3dfa tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Getting quotas for project 1a23a85365414f92bbc03177d7f190e6. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:38:12.895895 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-35eb6f52-9c08-41a3-ba20-e93101fa3dfa tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Getting quotas for user e36f4114dc4f443f8b48da7b4027e0c1 and project 1a23a85365414f92bbc03177d7f190e6. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:38:12.929164 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-35eb6f52-9c08-41a3-ba20-e93101fa3dfa tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Going to run 2 instances... {{(pid=128801) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:38:12.944285 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-35eb6f52-9c08-41a3-ba20-e93101fa3dfa tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] [instance: 96d890a0-a100-40a7-b795-6677eb966251] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='15b24725-0c99-4bcf-b1fb-907cdf8e2d63',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128801) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:38:13.028965 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-35eb6f52-9c08-41a3-ba20-e93101fa3dfa tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=128801) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Oct 04 20:38:13.061954 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-35eb6f52-9c08-41a3-ba20-e93101fa3dfa tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Getting quotas for project 1a23a85365414f92bbc03177d7f190e6. Resources: {'server_group_members'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:38:13.070930 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-35eb6f52-9c08-41a3-ba20-e93101fa3dfa tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Getting quotas for user e36f4114dc4f443f8b48da7b4027e0c1 and project 1a23a85365414f92bbc03177d7f190e6. Resources: {'server_group_members'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:38:13.140384 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-35eb6f52-9c08-41a3-ba20-e93101fa3dfa tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Getting quotas for project 1a23a85365414f92bbc03177d7f190e6. Resources: {'server_group_members'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:38:13.151967 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-35eb6f52-9c08-41a3-ba20-e93101fa3dfa tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Getting quotas for user e36f4114dc4f443f8b48da7b4027e0c1 and project 1a23a85365414f92bbc03177d7f190e6. Resources: {'server_group_members'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:38:13.182928 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-35eb6f52-9c08-41a3-ba20-e93101fa3dfa tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] [instance: 2182737b-f69a-44aa-a3ea-bbabae8ad737] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='15b24725-0c99-4bcf-b1fb-907cdf8e2d63',instance=,instance_uuid=96d890a0-a100-40a7-b795-6677eb966251,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128801) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:38:13.337867 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-672e9f5d-9817-458e-bc36-89e13aa93cc9 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '800db3a57ada47eca381b00189fdbf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66ec8ea91b04deb90b679589e0495bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:13.352386 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-35eb6f52-9c08-41a3-ba20-e93101fa3dfa tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Getting quotas for project 1a23a85365414f92bbc03177d7f190e6. Resources: {'server_group_members'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:38:13.353395 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-672e9f5d-9817-458e-bc36-89e13aa93cc9 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] 10.222.0.33 "GET /compute/v2.1/servers/8a72de6a-64a0-4ec7-a613-576f8ac02af3" status: 200 len: 1268 microversion: 2.1 time: 0.657758 Oct 04 20:38:13.356899 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 615/1198] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:38:12 2022] GET /compute/v2.1/servers/8a72de6a-64a0-4ec7-a613-576f8ac02af3 => generated 1268 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:38:13.371228 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-758f689b-2398-403f-ac35-991c5163fcd3 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:13.377088 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-758f689b-2398-403f-ac35-991c5163fcd3 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] [instance: f33c0e5c-fe2c-4379-b50a-08eb17062b91] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:13.415381 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-758f689b-2398-403f-ac35-991c5163fcd3 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:13.416739 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-758f689b-2398-403f-ac35-991c5163fcd3 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:13.418521 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-758f689b-2398-403f-ac35-991c5163fcd3 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:13.419445 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-758f689b-2398-403f-ac35-991c5163fcd3 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:13.423022 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-758f689b-2398-403f-ac35-991c5163fcd3 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:13.423515 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-35eb6f52-9c08-41a3-ba20-e93101fa3dfa tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Getting quotas for user e36f4114dc4f443f8b48da7b4027e0c1 and project 1a23a85365414f92bbc03177d7f190e6. Resources: {'server_group_members'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:38:13.424230 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-758f689b-2398-403f-ac35-991c5163fcd3 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:13.584354 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-35eb6f52-9c08-41a3-ba20-e93101fa3dfa tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Getting quotas for project 1a23a85365414f92bbc03177d7f190e6. Resources: {'server_group_members'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:38:13.596348 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-35eb6f52-9c08-41a3-ba20-e93101fa3dfa tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Getting quotas for user e36f4114dc4f443f8b48da7b4027e0c1 and project 1a23a85365414f92bbc03177d7f190e6. Resources: {'server_group_members'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:38:13.669098 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-35eb6f52-9c08-41a3-ba20-e93101fa3dfa tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 2.432150 Oct 04 20:38:13.670128 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 584/1199] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 20:38:11 2022] POST /compute/v2.1/servers => generated 32 bytes in 2434 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Oct 04 20:38:13.677083 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-bac840d4-e0d9-43aa-bfe7-320817f501dd tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:13.679268 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-bac840d4-e0d9-43aa-bfe7-320817f501dd tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] [instance: 5e984459-625e-44cd-b226-091276567215] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:13.687106 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bac840d4-e0d9-43aa-bfe7-320817f501dd tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:13.687958 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bac840d4-e0d9-43aa-bfe7-320817f501dd tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:13.688686 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bac840d4-e0d9-43aa-bfe7-320817f501dd tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:13.689643 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bac840d4-e0d9-43aa-bfe7-320817f501dd tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:13.690468 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bac840d4-e0d9-43aa-bfe7-320817f501dd tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:13.692705 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bac840d4-e0d9-43aa-bfe7-320817f501dd tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:13.818208 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:38:13.965434 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-758f689b-2398-403f-ac35-991c5163fcd3 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:13.981511 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-758f689b-2398-403f-ac35-991c5163fcd3 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:13.984235 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-758f689b-2398-403f-ac35-991c5163fcd3 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:13.991465 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-758f689b-2398-403f-ac35-991c5163fcd3 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] 10.222.0.33 "GET /compute/v2.1/servers/f33c0e5c-fe2c-4379-b50a-08eb17062b91" status: 200 len: 1568 microversion: 2.25 time: 0.632270 Oct 04 20:38:13.994193 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 616/1200] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:38:13 2022] GET /compute/v2.1/servers/f33c0e5c-fe2c-4379-b50a-08eb17062b91 => generated 1568 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:38:14.025353 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-c292c9a5-330c-4a43-91f9-d3479ec7558e tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:14.028161 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-c292c9a5-330c-4a43-91f9-d3479ec7558e tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] [instance: 5ac07e56-084c-4208-a988-13ec91af9171] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:14.044535 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c292c9a5-330c-4a43-91f9-d3479ec7558e tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:14.045646 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c292c9a5-330c-4a43-91f9-d3479ec7558e tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:14.046093 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c292c9a5-330c-4a43-91f9-d3479ec7558e tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:14.048770 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c292c9a5-330c-4a43-91f9-d3479ec7558e tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:14.053634 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c292c9a5-330c-4a43-91f9-d3479ec7558e tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:14.054263 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c292c9a5-330c-4a43-91f9-d3479ec7558e tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:14.175766 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-bac840d4-e0d9-43aa-bfe7-320817f501dd tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] Lazy-loading 'services' on Instance uuid 5e984459-625e-44cd-b226-091276567215 {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:38:14.397613 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-c292c9a5-330c-4a43-91f9-d3479ec7558e tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11149c46e1bc468f836fe70635dbf33b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e0d8329b2c4d64bf51d88948ca0de2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:14.412496 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-c292c9a5-330c-4a43-91f9-d3479ec7558e tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] 10.222.0.33 "GET /compute/v2.1/servers/5ac07e56-084c-4208-a988-13ec91af9171" status: 200 len: 1293 microversion: 2.1 time: 0.391413 Oct 04 20:38:14.413421 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 617/1201] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:38:14 2022] GET /compute/v2.1/servers/5ac07e56-084c-4208-a988-13ec91af9171 => generated 1293 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:38:14.428714 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-705fdddd-c9fa-48ea-8c2d-a13beba8fec6 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:14.437077 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-705fdddd-c9fa-48ea-8c2d-a13beba8fec6 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e36f4114dc4f443f8b48da7b4027e0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a23a85365414f92bbc03177d7f190e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:14.438586 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-705fdddd-c9fa-48ea-8c2d-a13beba8fec6 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Searching by: {'deleted': False, 'project_id': '1a23a85365414f92bbc03177d7f190e6'} {{(pid=128802) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 20:38:14.476230 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-705fdddd-c9fa-48ea-8c2d-a13beba8fec6 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:14.477271 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-705fdddd-c9fa-48ea-8c2d-a13beba8fec6 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:14.478814 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-705fdddd-c9fa-48ea-8c2d-a13beba8fec6 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:14.481383 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-705fdddd-c9fa-48ea-8c2d-a13beba8fec6 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:14.485891 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-705fdddd-c9fa-48ea-8c2d-a13beba8fec6 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:14.486618 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-705fdddd-c9fa-48ea-8c2d-a13beba8fec6 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:14.719659 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-bac840d4-e0d9-43aa-bfe7-320817f501dd tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/5e984459-625e-44cd-b226-091276567215" status: 200 len: 1929 microversion: 2.75 time: 1.047778 Oct 04 20:38:14.721544 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 585/1202] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:38:13 2022] GET /compute/v2.1/servers/5e984459-625e-44cd-b226-091276567215 => generated 1929 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:38:14.734699 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f969b447-187a-48d2-b71b-ba9c4951f0d0 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:14.742019 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f969b447-187a-48d2-b71b-ba9c4951f0d0 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] [instance: 23da26ba-68f4-4aef-b13c-0b6588a65e43] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:14.747053 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.multi_cell_list [None req-705fdddd-c9fa-48ea-8c2d-a13beba8fec6 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Listed batch of 1 results from cell out of 998 limit. Returned 1 total so far. {{(pid=128802) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 20:38:14.778778 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:38:14.782019 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f969b447-187a-48d2-b71b-ba9c4951f0d0 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:14.786249 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f969b447-187a-48d2-b71b-ba9c4951f0d0 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:14.788093 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f969b447-187a-48d2-b71b-ba9c4951f0d0 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:14.788957 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f969b447-187a-48d2-b71b-ba9c4951f0d0 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:14.790858 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f969b447-187a-48d2-b71b-ba9c4951f0d0 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:14.791587 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f969b447-187a-48d2-b71b-ba9c4951f0d0 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:14.920381 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-705fdddd-c9fa-48ea-8c2d-a13beba8fec6 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] 10.222.0.33 "GET /compute/v2.1/servers" status: 200 len: 1003 microversion: 2.1 time: 0.505582 Oct 04 20:38:14.934027 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 618/1203] 10.222.0.33 () {58 vars in 1125 bytes} [Tue Oct 4 20:38:14 2022] GET /compute/v2.1/servers => generated 1003 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:38:14.952669 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-2f1e9926-4805-4f36-a8ec-0fe9acc690a6 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:14.953296 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-2f1e9926-4805-4f36-a8ec-0fe9acc690a6 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] [instance: 8a72de6a-64a0-4ec7-a613-576f8ac02af3] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:14.978510 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2f1e9926-4805-4f36-a8ec-0fe9acc690a6 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:14.982637 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2f1e9926-4805-4f36-a8ec-0fe9acc690a6 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:14.983116 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2f1e9926-4805-4f36-a8ec-0fe9acc690a6 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:14.983874 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2f1e9926-4805-4f36-a8ec-0fe9acc690a6 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:14.984334 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2f1e9926-4805-4f36-a8ec-0fe9acc690a6 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:14.990920 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2f1e9926-4805-4f36-a8ec-0fe9acc690a6 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:15.737844 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f969b447-187a-48d2-b71b-ba9c4951f0d0 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3563efe2b8c94931a2a46c4e14811b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3118a5d96843d3bede1ed94bd9717e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:15.750468 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f969b447-187a-48d2-b71b-ba9c4951f0d0 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] 10.222.0.33 "GET /compute/v2.1/servers/23da26ba-68f4-4aef-b13c-0b6588a65e43" status: 200 len: 1313 microversion: 2.1 time: 1.026686 Oct 04 20:38:15.751317 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 586/1204] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:38:14 2022] GET /compute/v2.1/servers/23da26ba-68f4-4aef-b13c-0b6588a65e43 => generated 1313 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:38:15.765565 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-fb0ecba2-f4d2-4145-bcae-35846cff4006 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:15.766441 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-fb0ecba2-f4d2-4145-bcae-35846cff4006 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] [instance: 2182737b-f69a-44aa-a3ea-bbabae8ad737] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:15.781061 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fb0ecba2-f4d2-4145-bcae-35846cff4006 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:15.785791 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fb0ecba2-f4d2-4145-bcae-35846cff4006 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:15.786625 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fb0ecba2-f4d2-4145-bcae-35846cff4006 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:15.789519 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fb0ecba2-f4d2-4145-bcae-35846cff4006 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:15.789775 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-2f1e9926-4805-4f36-a8ec-0fe9acc690a6 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '800db3a57ada47eca381b00189fdbf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66ec8ea91b04deb90b679589e0495bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:15.790421 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fb0ecba2-f4d2-4145-bcae-35846cff4006 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:15.794971 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fb0ecba2-f4d2-4145-bcae-35846cff4006 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:15.811446 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-2f1e9926-4805-4f36-a8ec-0fe9acc690a6 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] 10.222.0.33 "GET /compute/v2.1/servers/8a72de6a-64a0-4ec7-a613-576f8ac02af3" status: 200 len: 1310 microversion: 2.1 time: 0.876122 Oct 04 20:38:15.816139 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 619/1205] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:38:14 2022] GET /compute/v2.1/servers/8a72de6a-64a0-4ec7-a613-576f8ac02af3 => generated 1310 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:38:15.834745 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-c2836ba9-9dc9-41e5-9cb7-5ca618d24857 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:15.835432 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-c2836ba9-9dc9-41e5-9cb7-5ca618d24857 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] [instance: f33c0e5c-fe2c-4379-b50a-08eb17062b91] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:15.865850 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c2836ba9-9dc9-41e5-9cb7-5ca618d24857 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:15.870486 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c2836ba9-9dc9-41e5-9cb7-5ca618d24857 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:15.870957 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c2836ba9-9dc9-41e5-9cb7-5ca618d24857 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:15.875089 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c2836ba9-9dc9-41e5-9cb7-5ca618d24857 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:15.876117 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c2836ba9-9dc9-41e5-9cb7-5ca618d24857 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:15.884872 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c2836ba9-9dc9-41e5-9cb7-5ca618d24857 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:15.954804 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-fb0ecba2-f4d2-4145-bcae-35846cff4006 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36f4114dc4f443f8b48da7b4027e0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a23a85365414f92bbc03177d7f190e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:15.971248 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-fb0ecba2-f4d2-4145-bcae-35846cff4006 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] 10.222.0.33 "GET /compute/v2.1/servers/2182737b-f69a-44aa-a3ea-bbabae8ad737" status: 200 len: 1215 microversion: 2.1 time: 0.217302 Oct 04 20:38:15.991445 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 587/1206] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:38:15 2022] GET /compute/v2.1/servers/2182737b-f69a-44aa-a3ea-bbabae8ad737 => generated 1215 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:38:16.002800 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1c6fb56a-ac70-48e2-82d8-30d309427650 tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:16.004291 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-1c6fb56a-ac70-48e2-82d8-30d309427650 tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] [instance: 5ac07e56-084c-4208-a988-13ec91af9171] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:16.036747 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1c6fb56a-ac70-48e2-82d8-30d309427650 tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:16.037349 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1c6fb56a-ac70-48e2-82d8-30d309427650 tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:16.037907 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1c6fb56a-ac70-48e2-82d8-30d309427650 tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:16.038759 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1c6fb56a-ac70-48e2-82d8-30d309427650 tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:16.039323 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1c6fb56a-ac70-48e2-82d8-30d309427650 tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:16.039850 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1c6fb56a-ac70-48e2-82d8-30d309427650 tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:16.284527 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-c2836ba9-9dc9-41e5-9cb7-5ca618d24857 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:16.310658 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-c2836ba9-9dc9-41e5-9cb7-5ca618d24857 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:16.327443 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-c2836ba9-9dc9-41e5-9cb7-5ca618d24857 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:16.328779 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-c2836ba9-9dc9-41e5-9cb7-5ca618d24857 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] 10.222.0.33 "GET /compute/v2.1/servers/f33c0e5c-fe2c-4379-b50a-08eb17062b91" status: 200 len: 1568 microversion: 2.25 time: 0.510546 Oct 04 20:38:16.329445 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 620/1207] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:38:15 2022] GET /compute/v2.1/servers/f33c0e5c-fe2c-4379-b50a-08eb17062b91 => generated 1568 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:38:16.344392 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-2c8812dd-9077-42da-8536-2c519c9eeb58 tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:16.345375 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-2c8812dd-9077-42da-8536-2c519c9eeb58 tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] [instance: 5e984459-625e-44cd-b226-091276567215] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:16.352324 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2c8812dd-9077-42da-8536-2c519c9eeb58 tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:16.353885 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2c8812dd-9077-42da-8536-2c519c9eeb58 tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:16.356027 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2c8812dd-9077-42da-8536-2c519c9eeb58 tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:16.357010 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2c8812dd-9077-42da-8536-2c519c9eeb58 tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:16.365058 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2c8812dd-9077-42da-8536-2c519c9eeb58 tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:16.365514 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2c8812dd-9077-42da-8536-2c519c9eeb58 tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:16.567140 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-1c6fb56a-ac70-48e2-82d8-30d309427650 tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11149c46e1bc468f836fe70635dbf33b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e0d8329b2c4d64bf51d88948ca0de2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:16.576938 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-1c6fb56a-ac70-48e2-82d8-30d309427650 tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] 10.222.0.33 "GET /compute/v2.1/servers/5ac07e56-084c-4208-a988-13ec91af9171" status: 200 len: 1293 microversion: 2.1 time: 0.584233 Oct 04 20:38:16.578452 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 588/1208] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:38:15 2022] GET /compute/v2.1/servers/5ac07e56-084c-4208-a988-13ec91af9171 => generated 1293 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:38:16.617725 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.objects.instance [None req-2c8812dd-9077-42da-8536-2c519c9eeb58 tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] Lazy-loading 'services' on Instance uuid 5e984459-625e-44cd-b226-091276567215 {{(pid=128802) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:38:16.702377 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-2c8812dd-9077-42da-8536-2c519c9eeb58 tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/5e984459-625e-44cd-b226-091276567215" status: 200 len: 1929 microversion: 2.75 time: 0.369849 Oct 04 20:38:16.729143 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 621/1209] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:38:16 2022] GET /compute/v2.1/servers/5e984459-625e-44cd-b226-091276567215 => generated 1929 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:38:16.737411 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-dd177991-ff53-494e-aebe-3bcf71a08e5e req-13fe29bd-56b7-4986-acfa-d43a31f30ab5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a72de6a-64a0-4ec7-a613-576f8ac02af3", "tag": "ae521132-718e-4290-aca2-064b766ac78a"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:38:16.745958 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5eb3f8f2-88c9-4018-ae4a-aab5ec19b261 tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsTestJSON-server-192365946", "imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63", "flavorRef": "452", "networks": [{"uuid": "5efb5d00-11a3-4a48-92ae-9a1a4f0eec84"}]}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:38:16.783943 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-dd177991-ff53-494e-aebe-3bcf71a08e5e req-13fe29bd-56b7-4986-acfa-d43a31f30ab5 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:16.784426 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-dd177991-ff53-494e-aebe-3bcf71a08e5e req-13fe29bd-56b7-4986-acfa-d43a31f30ab5 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:16.784863 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-dd177991-ff53-494e-aebe-3bcf71a08e5e req-13fe29bd-56b7-4986-acfa-d43a31f30ab5 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:16.853719 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-dd177991-ff53-494e-aebe-3bcf71a08e5e req-13fe29bd-56b7-4986-acfa-d43a31f30ab5 service nova] Creating event network-changed:ae521132-718e-4290-aca2-064b766ac78a for instance 8a72de6a-64a0-4ec7-a613-576f8ac02af3 on n-h1-854823-8 Oct 04 20:38:16.864102 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-dd177991-ff53-494e-aebe-3bcf71a08e5e req-13fe29bd-56b7-4986-acfa-d43a31f30ab5 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.132624 Oct 04 20:38:16.872366 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 622/1210] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:38:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:38:16.875832 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.network.neutron [None req-5eb3f8f2-88c9-4018-ae4a-aab5ec19b261 tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] validate_networks() for [('5efb5d00-11a3-4a48-92ae-9a1a4f0eec84', None, None, None, None, None)] {{(pid=128801) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:38:16.888510 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-7670e976-be34-423c-9d17-72988932a3d1 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:16.889274 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-7670e976-be34-423c-9d17-72988932a3d1 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] [instance: 23da26ba-68f4-4aef-b13c-0b6588a65e43] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:16.904086 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7670e976-be34-423c-9d17-72988932a3d1 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:16.904594 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7670e976-be34-423c-9d17-72988932a3d1 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:16.905038 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7670e976-be34-423c-9d17-72988932a3d1 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:16.905761 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7670e976-be34-423c-9d17-72988932a3d1 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:16.909003 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7670e976-be34-423c-9d17-72988932a3d1 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:16.909483 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7670e976-be34-423c-9d17-72988932a3d1 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:17.805358 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-7670e976-be34-423c-9d17-72988932a3d1 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3563efe2b8c94931a2a46c4e14811b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3118a5d96843d3bede1ed94bd9717e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:17.819080 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-7670e976-be34-423c-9d17-72988932a3d1 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] 10.222.0.33 "GET /compute/v2.1/servers/23da26ba-68f4-4aef-b13c-0b6588a65e43" status: 200 len: 1313 microversion: 2.1 time: 0.944337 Oct 04 20:38:17.834848 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 623/1211] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:38:16 2022] GET /compute/v2.1/servers/23da26ba-68f4-4aef-b13c-0b6588a65e43 => generated 1313 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:38:17.846117 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-b8bd633d-ffa0-4757-8d2f-82fd59b5c9de tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:17.847036 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-b8bd633d-ffa0-4757-8d2f-82fd59b5c9de tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] [instance: 8a72de6a-64a0-4ec7-a613-576f8ac02af3] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:17.853210 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell0:SELECT=2 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:38:17.871900 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b8bd633d-ffa0-4757-8d2f-82fd59b5c9de tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:17.872741 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b8bd633d-ffa0-4757-8d2f-82fd59b5c9de tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:17.874457 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b8bd633d-ffa0-4757-8d2f-82fd59b5c9de tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:17.875854 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b8bd633d-ffa0-4757-8d2f-82fd59b5c9de tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:17.876563 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b8bd633d-ffa0-4757-8d2f-82fd59b5c9de tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:17.877212 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b8bd633d-ffa0-4757-8d2f-82fd59b5c9de tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:18.545008 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-b8bd633d-ffa0-4757-8d2f-82fd59b5c9de tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '800db3a57ada47eca381b00189fdbf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66ec8ea91b04deb90b679589e0495bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:18.556117 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-b8bd633d-ffa0-4757-8d2f-82fd59b5c9de tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] 10.222.0.33 "GET /compute/v2.1/servers/8a72de6a-64a0-4ec7-a613-576f8ac02af3" status: 200 len: 1310 microversion: 2.1 time: 0.719759 Oct 04 20:38:18.565750 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 624/1212] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:38:17 2022] GET /compute/v2.1/servers/8a72de6a-64a0-4ec7-a613-576f8ac02af3 => generated 1310 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:38:18.571697 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-b7e3d65f-f1e6-4ead-ad00-c6adb2ba0d52 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:18.589826 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-b7e3d65f-f1e6-4ead-ad00-c6adb2ba0d52 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] [instance: 2182737b-f69a-44aa-a3ea-bbabae8ad737] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:18.602331 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b7e3d65f-f1e6-4ead-ad00-c6adb2ba0d52 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:18.605930 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b7e3d65f-f1e6-4ead-ad00-c6adb2ba0d52 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:18.609786 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b7e3d65f-f1e6-4ead-ad00-c6adb2ba0d52 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:18.611072 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b7e3d65f-f1e6-4ead-ad00-c6adb2ba0d52 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:18.611747 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b7e3d65f-f1e6-4ead-ad00-c6adb2ba0d52 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:18.620441 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b7e3d65f-f1e6-4ead-ad00-c6adb2ba0d52 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:18.912597 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-b7e3d65f-f1e6-4ead-ad00-c6adb2ba0d52 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36f4114dc4f443f8b48da7b4027e0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a23a85365414f92bbc03177d7f190e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:18.921931 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-b7e3d65f-f1e6-4ead-ad00-c6adb2ba0d52 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] 10.222.0.33 "GET /compute/v2.1/servers/2182737b-f69a-44aa-a3ea-bbabae8ad737" status: 200 len: 1277 microversion: 2.1 time: 0.353944 Oct 04 20:38:18.927702 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 625/1213] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:38:18 2022] GET /compute/v2.1/servers/2182737b-f69a-44aa-a3ea-bbabae8ad737 => generated 1277 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:38:18.932786 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-4ac53a3e-54d1-422c-a2bf-cb9fcbc0ca2b tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:18.938810 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-4ac53a3e-54d1-422c-a2bf-cb9fcbc0ca2b tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] [instance: f33c0e5c-fe2c-4379-b50a-08eb17062b91] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:18.952262 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4ac53a3e-54d1-422c-a2bf-cb9fcbc0ca2b tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:18.952863 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4ac53a3e-54d1-422c-a2bf-cb9fcbc0ca2b tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:18.962824 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4ac53a3e-54d1-422c-a2bf-cb9fcbc0ca2b tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:18.963747 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4ac53a3e-54d1-422c-a2bf-cb9fcbc0ca2b tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:18.964317 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4ac53a3e-54d1-422c-a2bf-cb9fcbc0ca2b tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:18.964812 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4ac53a3e-54d1-422c-a2bf-cb9fcbc0ca2b tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:19.229717 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-5eb3f8f2-88c9-4018-ae4a-aab5ec19b261 tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] Flavor limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:38:19.230604 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-5eb3f8f2-88c9-4018-ae4a-aab5ec19b261 tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] Image limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:38:19.231154 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-5eb3f8f2-88c9-4018-ae4a-aab5ec19b261 tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] Flavor pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:38:19.231645 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-5eb3f8f2-88c9-4018-ae4a-aab5ec19b261 tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] Image pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:38:19.232156 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-5eb3f8f2-88c9-4018-ae4a-aab5ec19b261 tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:38:19.247443 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5eb3f8f2-88c9-4018-ae4a-aab5ec19b261 tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:19.249903 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5eb3f8f2-88c9-4018-ae4a-aab5ec19b261 tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:19.250581 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5eb3f8f2-88c9-4018-ae4a-aab5ec19b261 tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:19.252084 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5eb3f8f2-88c9-4018-ae4a-aab5ec19b261 tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:19.252571 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5eb3f8f2-88c9-4018-ae4a-aab5ec19b261 tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:19.253012 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5eb3f8f2-88c9-4018-ae4a-aab5ec19b261 tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:19.314263 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-5eb3f8f2-88c9-4018-ae4a-aab5ec19b261 tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] Getting quotas for project 870c8d858eb44228acd9bbe345a1143c. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:38:19.320436 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-5eb3f8f2-88c9-4018-ae4a-aab5ec19b261 tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] Getting quotas for user 58d46a7cdc204e808eabedbad9c5aea6 and project 870c8d858eb44228acd9bbe345a1143c. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:38:19.325342 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:38:19.341234 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-5eb3f8f2-88c9-4018-ae4a-aab5ec19b261 tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] Going to run 1 instances... {{(pid=128801) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:38:19.345630 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-5eb3f8f2-88c9-4018-ae4a-aab5ec19b261 tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] [instance: acecffb2-4128-4bd7-8bc3-7529881b64ed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='15b24725-0c99-4bcf-b1fb-907cdf8e2d63',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128801) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:38:19.496057 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5eb3f8f2-88c9-4018-ae4a-aab5ec19b261 tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.913988 Oct 04 20:38:19.499034 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 589/1214] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 20:38:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 2917 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 20:38:19.507191 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-763a8372-7bd1-4bab-a4e1-c77b6b8686aa tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:19.508749 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-763a8372-7bd1-4bab-a4e1-c77b6b8686aa tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] [instance: 5ac07e56-084c-4208-a988-13ec91af9171] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:19.539402 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-763a8372-7bd1-4bab-a4e1-c77b6b8686aa tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:19.539931 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-763a8372-7bd1-4bab-a4e1-c77b6b8686aa tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:19.540470 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-763a8372-7bd1-4bab-a4e1-c77b6b8686aa tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:19.541220 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-763a8372-7bd1-4bab-a4e1-c77b6b8686aa tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:19.541688 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-763a8372-7bd1-4bab-a4e1-c77b6b8686aa tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:19.542173 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-763a8372-7bd1-4bab-a4e1-c77b6b8686aa tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:20.374217 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-4ac53a3e-54d1-422c-a2bf-cb9fcbc0ca2b tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:20.385271 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-4ac53a3e-54d1-422c-a2bf-cb9fcbc0ca2b tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:20.386786 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-4ac53a3e-54d1-422c-a2bf-cb9fcbc0ca2b tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:20.387977 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-4ac53a3e-54d1-422c-a2bf-cb9fcbc0ca2b tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] 10.222.0.33 "GET /compute/v2.1/servers/f33c0e5c-fe2c-4379-b50a-08eb17062b91" status: 200 len: 1568 microversion: 2.25 time: 1.458964 Oct 04 20:38:20.405218 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 626/1215] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:38:18 2022] GET /compute/v2.1/servers/f33c0e5c-fe2c-4379-b50a-08eb17062b91 => generated 1568 bytes in 1476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:38:20.413186 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-6069f533-128c-4de6-8b66-c286baf3e004 tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:20.413897 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-6069f533-128c-4de6-8b66-c286baf3e004 tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] [instance: 5e984459-625e-44cd-b226-091276567215] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:20.430244 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6069f533-128c-4de6-8b66-c286baf3e004 tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:20.430778 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6069f533-128c-4de6-8b66-c286baf3e004 tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:20.431372 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6069f533-128c-4de6-8b66-c286baf3e004 tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:20.432086 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6069f533-128c-4de6-8b66-c286baf3e004 tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:20.432571 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6069f533-128c-4de6-8b66-c286baf3e004 tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:20.432995 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6069f533-128c-4de6-8b66-c286baf3e004 tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:20.651429 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.objects.instance [None req-6069f533-128c-4de6-8b66-c286baf3e004 tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] Lazy-loading 'services' on Instance uuid 5e984459-625e-44cd-b226-091276567215 {{(pid=128802) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:38:20.674390 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-6069f533-128c-4de6-8b66-c286baf3e004 tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/5e984459-625e-44cd-b226-091276567215" status: 200 len: 1929 microversion: 2.75 time: 0.267949 Oct 04 20:38:20.715085 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 627/1216] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:38:20 2022] GET /compute/v2.1/servers/5e984459-625e-44cd-b226-091276567215 => generated 1929 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:38:20.720975 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-9fadf7a4-bb3c-4229-96ea-2ae907f46b3a req-a0041430-ca11-45a1-9cc0-97ff84c7b985 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ac07e56-084c-4208-a988-13ec91af9171", "name": "network-vif-plugged", "status": "completed", "tag": "110ce36c-aef7-4f87-ae06-e95d837c4b2b"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:38:20.732747 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-9fadf7a4-bb3c-4229-96ea-2ae907f46b3a req-a0041430-ca11-45a1-9cc0-97ff84c7b985 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:20.733509 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-9fadf7a4-bb3c-4229-96ea-2ae907f46b3a req-a0041430-ca11-45a1-9cc0-97ff84c7b985 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:20.734329 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-9fadf7a4-bb3c-4229-96ea-2ae907f46b3a req-a0041430-ca11-45a1-9cc0-97ff84c7b985 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:20.749025 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-9fadf7a4-bb3c-4229-96ea-2ae907f46b3a req-a0041430-ca11-45a1-9cc0-97ff84c7b985 service nova] Creating event network-vif-plugged:110ce36c-aef7-4f87-ae06-e95d837c4b2b for instance 5ac07e56-084c-4208-a988-13ec91af9171 on n-h1-854823-8 Oct 04 20:38:20.773354 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-9fadf7a4-bb3c-4229-96ea-2ae907f46b3a req-a0041430-ca11-45a1-9cc0-97ff84c7b985 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056975 Oct 04 20:38:20.774577 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 628/1217] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:38:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:38:20.784844 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-de882503-914d-4502-8c80-54ee266e6b57 req-7ac3f98b-4c33-4e8e-a32b-41f0e170087e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23da26ba-68f4-4aef-b13c-0b6588a65e43", "tag": "f692dbdb-9498-4986-a253-420f090b704f"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:38:20.790146 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-763a8372-7bd1-4bab-a4e1-c77b6b8686aa tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11149c46e1bc468f836fe70635dbf33b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e0d8329b2c4d64bf51d88948ca0de2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:20.802741 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-763a8372-7bd1-4bab-a4e1-c77b6b8686aa tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] 10.222.0.33 "GET /compute/v2.1/servers/5ac07e56-084c-4208-a988-13ec91af9171" status: 200 len: 1293 microversion: 2.1 time: 1.300582 Oct 04 20:38:20.807163 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-de882503-914d-4502-8c80-54ee266e6b57 req-7ac3f98b-4c33-4e8e-a32b-41f0e170087e service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:20.807846 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-de882503-914d-4502-8c80-54ee266e6b57 req-7ac3f98b-4c33-4e8e-a32b-41f0e170087e service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:20.810630 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-de882503-914d-4502-8c80-54ee266e6b57 req-7ac3f98b-4c33-4e8e-a32b-41f0e170087e service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:20.820856 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 590/1218] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:38:19 2022] GET /compute/v2.1/servers/5ac07e56-084c-4208-a988-13ec91af9171 => generated 1293 bytes in 1321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:38:20.828226 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-de882503-914d-4502-8c80-54ee266e6b57 req-7ac3f98b-4c33-4e8e-a32b-41f0e170087e service nova] Creating event network-changed:f692dbdb-9498-4986-a253-420f090b704f for instance 23da26ba-68f4-4aef-b13c-0b6588a65e43 on n-h1-854823-8 Oct 04 20:38:20.830228 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9862349e-598f-4417-89be-7f328de3b375 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:20.833905 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-9862349e-598f-4417-89be-7f328de3b375 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] [instance: 23da26ba-68f4-4aef-b13c-0b6588a65e43] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:20.847079 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9862349e-598f-4417-89be-7f328de3b375 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:20.848971 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-de882503-914d-4502-8c80-54ee266e6b57 req-7ac3f98b-4c33-4e8e-a32b-41f0e170087e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068222 Oct 04 20:38:20.850123 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 629/1219] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:38:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:38:20.850249 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9862349e-598f-4417-89be-7f328de3b375 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:20.852996 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9862349e-598f-4417-89be-7f328de3b375 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:20.854381 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9862349e-598f-4417-89be-7f328de3b375 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:20.855214 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9862349e-598f-4417-89be-7f328de3b375 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:20.855919 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9862349e-598f-4417-89be-7f328de3b375 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:20.861059 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-b9124bf2-caf3-4a95-993d-b7a6cb824d4c tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:20.861779 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-b9124bf2-caf3-4a95-993d-b7a6cb824d4c tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] [instance: acecffb2-4128-4bd7-8bc3-7529881b64ed] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:20.881092 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b9124bf2-caf3-4a95-993d-b7a6cb824d4c tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:20.881591 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b9124bf2-caf3-4a95-993d-b7a6cb824d4c tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:20.882025 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b9124bf2-caf3-4a95-993d-b7a6cb824d4c tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:20.882763 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b9124bf2-caf3-4a95-993d-b7a6cb824d4c tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:20.883214 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b9124bf2-caf3-4a95-993d-b7a6cb824d4c tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:20.883632 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b9124bf2-caf3-4a95-993d-b7a6cb824d4c tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:21.100145 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-b9124bf2-caf3-4a95-993d-b7a6cb824d4c tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d46a7cdc204e808eabedbad9c5aea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '870c8d858eb44228acd9bbe345a1143c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:21.108620 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-b9124bf2-caf3-4a95-993d-b7a6cb824d4c tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] 10.222.0.33 "GET /compute/v2.1/servers/acecffb2-4128-4bd7-8bc3-7529881b64ed" status: 200 len: 1268 microversion: 2.1 time: 0.256831 Oct 04 20:38:21.126772 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 630/1220] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:38:20 2022] GET /compute/v2.1/servers/acecffb2-4128-4bd7-8bc3-7529881b64ed => generated 1268 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:38:21.133805 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-9941570e-5b46-4dc5-9247-c268e8d1eda2 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:21.134674 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-9941570e-5b46-4dc5-9247-c268e8d1eda2 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] [instance: 8a72de6a-64a0-4ec7-a613-576f8ac02af3] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:21.149127 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9941570e-5b46-4dc5-9247-c268e8d1eda2 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:21.149629 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9941570e-5b46-4dc5-9247-c268e8d1eda2 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:21.150057 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9941570e-5b46-4dc5-9247-c268e8d1eda2 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:21.150878 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9941570e-5b46-4dc5-9247-c268e8d1eda2 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:21.151568 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9941570e-5b46-4dc5-9247-c268e8d1eda2 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:21.152173 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9941570e-5b46-4dc5-9247-c268e8d1eda2 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:21.427946 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-9862349e-598f-4417-89be-7f328de3b375 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3563efe2b8c94931a2a46c4e14811b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3118a5d96843d3bede1ed94bd9717e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:21.445526 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-9862349e-598f-4417-89be-7f328de3b375 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] 10.222.0.33 "GET /compute/v2.1/servers/23da26ba-68f4-4aef-b13c-0b6588a65e43" status: 200 len: 1313 microversion: 2.1 time: 0.623348 Oct 04 20:38:21.447672 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 591/1221] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:38:20 2022] GET /compute/v2.1/servers/23da26ba-68f4-4aef-b13c-0b6588a65e43 => generated 1313 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:38:21.453261 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-98856921-bb02-4515-9d90-e93f9f57e2d3 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:21.454141 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-98856921-bb02-4515-9d90-e93f9f57e2d3 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] [instance: 2182737b-f69a-44aa-a3ea-bbabae8ad737] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:21.464134 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-98856921-bb02-4515-9d90-e93f9f57e2d3 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:21.464861 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-98856921-bb02-4515-9d90-e93f9f57e2d3 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:21.477913 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-98856921-bb02-4515-9d90-e93f9f57e2d3 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:21.479123 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-98856921-bb02-4515-9d90-e93f9f57e2d3 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:21.480072 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-98856921-bb02-4515-9d90-e93f9f57e2d3 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:21.482950 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-98856921-bb02-4515-9d90-e93f9f57e2d3 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:21.603756 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-9941570e-5b46-4dc5-9247-c268e8d1eda2 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '800db3a57ada47eca381b00189fdbf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66ec8ea91b04deb90b679589e0495bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:21.614485 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-9941570e-5b46-4dc5-9247-c268e8d1eda2 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] 10.222.0.33 "GET /compute/v2.1/servers/8a72de6a-64a0-4ec7-a613-576f8ac02af3" status: 200 len: 1310 microversion: 2.1 time: 0.485350 Oct 04 20:38:21.618890 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 631/1222] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:38:21 2022] GET /compute/v2.1/servers/8a72de6a-64a0-4ec7-a613-576f8ac02af3 => generated 1310 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:38:21.626523 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-c232f59f-d399-41e1-a61f-081e0d03a396 tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:21.632335 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-98856921-bb02-4515-9d90-e93f9f57e2d3 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36f4114dc4f443f8b48da7b4027e0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a23a85365414f92bbc03177d7f190e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:21.633934 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-c232f59f-d399-41e1-a61f-081e0d03a396 tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] [instance: 7d9db253-559a-4d4b-9a5e-42c8f63f6cb7] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:21.640802 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-98856921-bb02-4515-9d90-e93f9f57e2d3 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] 10.222.0.33 "GET /compute/v2.1/servers/2182737b-f69a-44aa-a3ea-bbabae8ad737" status: 200 len: 1277 microversion: 2.1 time: 0.191803 Oct 04 20:38:21.643649 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c232f59f-d399-41e1-a61f-081e0d03a396 tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:21.644871 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c232f59f-d399-41e1-a61f-081e0d03a396 tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:21.645518 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c232f59f-d399-41e1-a61f-081e0d03a396 tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:21.646455 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c232f59f-d399-41e1-a61f-081e0d03a396 tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:21.647075 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c232f59f-d399-41e1-a61f-081e0d03a396 tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:21.647705 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c232f59f-d399-41e1-a61f-081e0d03a396 tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:21.650883 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 592/1223] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:38:21 2022] GET /compute/v2.1/servers/2182737b-f69a-44aa-a3ea-bbabae8ad737 => generated 1277 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:38:21.663530 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-503762c8-6c9e-4fba-b4b8-45b1570728c9 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:21.664380 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-503762c8-6c9e-4fba-b4b8-45b1570728c9 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] [instance: f33c0e5c-fe2c-4379-b50a-08eb17062b91] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:21.670945 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-503762c8-6c9e-4fba-b4b8-45b1570728c9 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:21.671685 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-503762c8-6c9e-4fba-b4b8-45b1570728c9 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:21.672305 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-503762c8-6c9e-4fba-b4b8-45b1570728c9 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:21.673726 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-503762c8-6c9e-4fba-b4b8-45b1570728c9 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:21.674367 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-503762c8-6c9e-4fba-b4b8-45b1570728c9 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:21.674947 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-503762c8-6c9e-4fba-b4b8-45b1570728c9 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:21.685930 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-c232f59f-d399-41e1-a61f-081e0d03a396 tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] 10.222.0.33 "GET /compute/v2.1/servers/7d9db253-559a-4d4b-9a5e-42c8f63f6cb7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.065101 Oct 04 20:38:21.694302 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 632/1224] 10.222.0.33 () {58 vars in 1302 bytes} [Tue Oct 4 20:38:21 2022] GET /compute/v2.1/servers/7d9db253-559a-4d4b-9a5e-42c8f63f6cb7/os-volume_attachments => generated 25 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 20:38:21.721806 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-c1121ba7-1352-481b-b7de-e33ed523acbf tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:21.723787 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-c1121ba7-1352-481b-b7de-e33ed523acbf tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] [instance: 5e984459-625e-44cd-b226-091276567215] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:21.730816 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c1121ba7-1352-481b-b7de-e33ed523acbf tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:21.731389 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c1121ba7-1352-481b-b7de-e33ed523acbf tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:21.731737 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c1121ba7-1352-481b-b7de-e33ed523acbf tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:21.732443 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c1121ba7-1352-481b-b7de-e33ed523acbf tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:21.732905 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c1121ba7-1352-481b-b7de-e33ed523acbf tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:21.733384 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c1121ba7-1352-481b-b7de-e33ed523acbf tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:21.910242 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.objects.instance [None req-c1121ba7-1352-481b-b7de-e33ed523acbf tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] Lazy-loading 'services' on Instance uuid 5e984459-625e-44cd-b226-091276567215 {{(pid=128802) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:38:21.948303 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_api:SELECT=100 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:38:21.954277 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-c1121ba7-1352-481b-b7de-e33ed523acbf tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/5e984459-625e-44cd-b226-091276567215" status: 200 len: 1929 microversion: 2.75 time: 0.242619 Oct 04 20:38:21.955791 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 633/1225] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:38:21 2022] GET /compute/v2.1/servers/5e984459-625e-44cd-b226-091276567215 => generated 1929 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:38:21.962820 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-06d6f043-3f2e-41df-af6d-79acf928e9e8 tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:21.965809 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-06d6f043-3f2e-41df-af6d-79acf928e9e8 tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] [instance: 7d9db253-559a-4d4b-9a5e-42c8f63f6cb7] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:21.975621 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-06d6f043-3f2e-41df-af6d-79acf928e9e8 tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:21.976438 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-06d6f043-3f2e-41df-af6d-79acf928e9e8 tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:21.977188 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-06d6f043-3f2e-41df-af6d-79acf928e9e8 tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:21.979093 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-06d6f043-3f2e-41df-af6d-79acf928e9e8 tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:21.979770 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-06d6f043-3f2e-41df-af6d-79acf928e9e8 tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:21.980447 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-06d6f043-3f2e-41df-af6d-79acf928e9e8 tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:22.028317 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-06d6f043-3f2e-41df-af6d-79acf928e9e8 tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] 10.222.0.33 "GET /compute/v2.1/servers/7d9db253-559a-4d4b-9a5e-42c8f63f6cb7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.070946 Oct 04 20:38:22.028992 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 634/1226] 10.222.0.33 () {58 vars in 1302 bytes} [Tue Oct 4 20:38:21 2022] GET /compute/v2.1/servers/7d9db253-559a-4d4b-9a5e-42c8f63f6cb7/os-volume_attachments => generated 25 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 20:38:22.034200 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-e4bc402a-f796-4db6-b823-11209ade03af tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:22.035641 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-e4bc402a-f796-4db6-b823-11209ade03af tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] [instance: 5ac07e56-084c-4208-a988-13ec91af9171] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:22.044009 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e4bc402a-f796-4db6-b823-11209ade03af tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:22.044911 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e4bc402a-f796-4db6-b823-11209ade03af tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:22.045519 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e4bc402a-f796-4db6-b823-11209ade03af tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:22.046430 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e4bc402a-f796-4db6-b823-11209ade03af tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:22.047067 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e4bc402a-f796-4db6-b823-11209ade03af tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:22.047642 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e4bc402a-f796-4db6-b823-11209ade03af tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:22.162863 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-503762c8-6c9e-4fba-b4b8-45b1570728c9 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:22.171116 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-503762c8-6c9e-4fba-b4b8-45b1570728c9 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:22.173232 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-503762c8-6c9e-4fba-b4b8-45b1570728c9 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:22.174444 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-503762c8-6c9e-4fba-b4b8-45b1570728c9 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] 10.222.0.33 "GET /compute/v2.1/servers/f33c0e5c-fe2c-4379-b50a-08eb17062b91" status: 200 len: 1543 microversion: 2.25 time: 0.522238 Oct 04 20:38:22.175012 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 593/1227] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:38:21 2022] GET /compute/v2.1/servers/f33c0e5c-fe2c-4379-b50a-08eb17062b91 => generated 1543 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:38:22.181152 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-100743b9-a1a2-4636-a339-70f1e1b69abb tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:22.181649 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-100743b9-a1a2-4636-a339-70f1e1b69abb tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] [instance: 7d9db253-559a-4d4b-9a5e-42c8f63f6cb7] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:22.187955 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-100743b9-a1a2-4636-a339-70f1e1b69abb tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:22.188516 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-100743b9-a1a2-4636-a339-70f1e1b69abb tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:22.189126 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-100743b9-a1a2-4636-a339-70f1e1b69abb tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:22.189897 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-100743b9-a1a2-4636-a339-70f1e1b69abb tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:22.190482 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-100743b9-a1a2-4636-a339-70f1e1b69abb tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:22.190979 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-100743b9-a1a2-4636-a339-70f1e1b69abb tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:22.225366 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-100743b9-a1a2-4636-a339-70f1e1b69abb tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] [instance: 7d9db253-559a-4d4b-9a5e-42c8f63f6cb7] Going to try to terminate instance {{(pid=128801) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:38:22.309644 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-100743b9-a1a2-4636-a339-70f1e1b69abb tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] 10.222.0.33 "DELETE /compute/v2.1/servers/7d9db253-559a-4d4b-9a5e-42c8f63f6cb7" status: 204 len: 0 microversion: 2.1 time: 0.131837 Oct 04 20:38:22.310582 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 594/1228] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 20:38:22 2022] DELETE /compute/v2.1/servers/7d9db253-559a-4d4b-9a5e-42c8f63f6cb7 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:38:22.315918 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-acdde908-c55f-4b12-a158-bcd02cf17df8 tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:22.318040 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-acdde908-c55f-4b12-a158-bcd02cf17df8 tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] [instance: acecffb2-4128-4bd7-8bc3-7529881b64ed] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:22.323911 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-acdde908-c55f-4b12-a158-bcd02cf17df8 tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:22.324401 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-acdde908-c55f-4b12-a158-bcd02cf17df8 tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:22.324834 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-acdde908-c55f-4b12-a158-bcd02cf17df8 tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:22.325535 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-acdde908-c55f-4b12-a158-bcd02cf17df8 tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:22.325993 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-acdde908-c55f-4b12-a158-bcd02cf17df8 tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:22.326465 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-acdde908-c55f-4b12-a158-bcd02cf17df8 tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:22.357855 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-e4bc402a-f796-4db6-b823-11209ade03af tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11149c46e1bc468f836fe70635dbf33b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e0d8329b2c4d64bf51d88948ca0de2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:22.367770 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-e4bc402a-f796-4db6-b823-11209ade03af tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] 10.222.0.33 "GET /compute/v2.1/servers/5ac07e56-084c-4208-a988-13ec91af9171" status: 200 len: 1293 microversion: 2.1 time: 0.337084 Oct 04 20:38:22.384148 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 635/1229] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:38:22 2022] GET /compute/v2.1/servers/5ac07e56-084c-4208-a988-13ec91af9171 => generated 1293 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:38:22.387152 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-3e7e9aaf-2b3c-46f3-bfc0-2dd72796dc7f tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] Calling method '.version_select at 0x7f3c7422f3a0>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:22.391983 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3e7e9aaf-2b3c-46f3-bfc0-2dd72796dc7f tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:22.392476 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3e7e9aaf-2b3c-46f3-bfc0-2dd72796dc7f tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:22.392911 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3e7e9aaf-2b3c-46f3-bfc0-2dd72796dc7f tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:22.404564 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-3e7e9aaf-2b3c-46f3-bfc0-2dd72796dc7f tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] 10.222.0.33 "GET /compute/v2.1/os-migrations" status: 200 len: 2785 microversion: 2.25 time: 0.022219 Oct 04 20:38:22.405165 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 636/1230] 10.222.0.33 () {60 vars in 1184 bytes} [Tue Oct 4 20:38:22 2022] GET /compute/v2.1/os-migrations => generated 2785 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:38:22.410469 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-ef0e4c64-f44e-4acc-950e-4306ae05dad3 tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:22.411251 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-ef0e4c64-f44e-4acc-950e-4306ae05dad3 tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] [instance: 7d9db253-559a-4d4b-9a5e-42c8f63f6cb7] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:22.417821 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ef0e4c64-f44e-4acc-950e-4306ae05dad3 tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:22.418643 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ef0e4c64-f44e-4acc-950e-4306ae05dad3 tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:22.419089 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ef0e4c64-f44e-4acc-950e-4306ae05dad3 tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:22.419976 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ef0e4c64-f44e-4acc-950e-4306ae05dad3 tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:22.420438 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ef0e4c64-f44e-4acc-950e-4306ae05dad3 tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:22.420866 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ef0e4c64-f44e-4acc-950e-4306ae05dad3 tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:22.425226 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=100 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:38:22.455587 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-acdde908-c55f-4b12-a158-bcd02cf17df8 tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d46a7cdc204e808eabedbad9c5aea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '870c8d858eb44228acd9bbe345a1143c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:22.469111 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-acdde908-c55f-4b12-a158-bcd02cf17df8 tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] 10.222.0.33 "GET /compute/v2.1/servers/acecffb2-4128-4bd7-8bc3-7529881b64ed" status: 200 len: 1276 microversion: 2.1 time: 0.157075 Oct 04 20:38:22.469845 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 595/1231] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:38:22 2022] GET /compute/v2.1/servers/acecffb2-4128-4bd7-8bc3-7529881b64ed => generated 1276 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:38:22.475625 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-aced9d2b-c778-4af9-819c-aac5a9df281c tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:22.476241 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-aced9d2b-c778-4af9-819c-aac5a9df281c tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] [instance: f33c0e5c-fe2c-4379-b50a-08eb17062b91] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:22.482578 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-aced9d2b-c778-4af9-819c-aac5a9df281c tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:22.483391 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-aced9d2b-c778-4af9-819c-aac5a9df281c tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:22.483828 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-aced9d2b-c778-4af9-819c-aac5a9df281c tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:22.484532 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-aced9d2b-c778-4af9-819c-aac5a9df281c tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:22.484988 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-aced9d2b-c778-4af9-819c-aac5a9df281c tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:22.485414 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-aced9d2b-c778-4af9-819c-aac5a9df281c tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:22.879437 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-ef0e4c64-f44e-4acc-950e-4306ae05dad3 tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b786966441fc45f28890bf56cdfafb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8cc219b86ed450cbe7c780d7f79d9f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:22.887956 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-ef0e4c64-f44e-4acc-950e-4306ae05dad3 tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] 10.222.0.33 "GET /compute/v2.1/servers/7d9db253-559a-4d4b-9a5e-42c8f63f6cb7" status: 200 len: 1682 microversion: 2.1 time: 0.481570 Oct 04 20:38:22.888527 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 637/1232] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:38:22 2022] GET /compute/v2.1/servers/7d9db253-559a-4d4b-9a5e-42c8f63f6cb7 => generated 1682 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:38:22.893319 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-2399858e-dba7-481a-9127-148eb25c3c46 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:22.894027 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-2399858e-dba7-481a-9127-148eb25c3c46 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] [instance: 23da26ba-68f4-4aef-b13c-0b6588a65e43] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:22.900073 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2399858e-dba7-481a-9127-148eb25c3c46 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:22.900745 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2399858e-dba7-481a-9127-148eb25c3c46 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:22.901247 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2399858e-dba7-481a-9127-148eb25c3c46 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:22.902008 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2399858e-dba7-481a-9127-148eb25c3c46 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:22.902559 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2399858e-dba7-481a-9127-148eb25c3c46 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:22.903040 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2399858e-dba7-481a-9127-148eb25c3c46 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:23.039428 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-aced9d2b-c778-4af9-819c-aac5a9df281c tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] Lazy-loading 'services' on Instance uuid f33c0e5c-fe2c-4379-b50a-08eb17062b91 {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:38:23.057229 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-aced9d2b-c778-4af9-819c-aac5a9df281c tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/f33c0e5c-fe2c-4379-b50a-08eb17062b91" status: 200 len: 2036 microversion: 2.25 time: 0.585860 Oct 04 20:38:23.058217 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 596/1233] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:38:22 2022] GET /compute/v2.1/servers/f33c0e5c-fe2c-4379-b50a-08eb17062b91 => generated 2036 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:38:23.063158 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-89dffe39-7f89-41e3-912b-0b44a4464f1d tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:23.063997 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-89dffe39-7f89-41e3-912b-0b44a4464f1d tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] [instance: 8a72de6a-64a0-4ec7-a613-576f8ac02af3] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:23.072049 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-89dffe39-7f89-41e3-912b-0b44a4464f1d tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:23.072940 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-89dffe39-7f89-41e3-912b-0b44a4464f1d tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:23.073643 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-89dffe39-7f89-41e3-912b-0b44a4464f1d tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:23.074455 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-89dffe39-7f89-41e3-912b-0b44a4464f1d tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:23.075044 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-89dffe39-7f89-41e3-912b-0b44a4464f1d tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:23.094785 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-89dffe39-7f89-41e3-912b-0b44a4464f1d tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:23.332729 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-2399858e-dba7-481a-9127-148eb25c3c46 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3563efe2b8c94931a2a46c4e14811b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3118a5d96843d3bede1ed94bd9717e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:23.341128 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-2399858e-dba7-481a-9127-148eb25c3c46 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] 10.222.0.33 "GET /compute/v2.1/servers/23da26ba-68f4-4aef-b13c-0b6588a65e43" status: 200 len: 1313 microversion: 2.1 time: 0.451390 Oct 04 20:38:23.341710 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 638/1234] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:38:22 2022] GET /compute/v2.1/servers/23da26ba-68f4-4aef-b13c-0b6588a65e43 => generated 1313 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:38:23.346698 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-3f2b205d-0c5e-4666-9d15-bc5c526ea811 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:23.347303 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-3f2b205d-0c5e-4666-9d15-bc5c526ea811 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] [instance: 2182737b-f69a-44aa-a3ea-bbabae8ad737] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:23.354181 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3f2b205d-0c5e-4666-9d15-bc5c526ea811 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:23.354945 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3f2b205d-0c5e-4666-9d15-bc5c526ea811 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:23.355838 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3f2b205d-0c5e-4666-9d15-bc5c526ea811 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:23.356836 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3f2b205d-0c5e-4666-9d15-bc5c526ea811 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:23.357327 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3f2b205d-0c5e-4666-9d15-bc5c526ea811 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:23.357921 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3f2b205d-0c5e-4666-9d15-bc5c526ea811 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:23.533561 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-89dffe39-7f89-41e3-912b-0b44a4464f1d tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '800db3a57ada47eca381b00189fdbf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66ec8ea91b04deb90b679589e0495bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:23.544042 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-89dffe39-7f89-41e3-912b-0b44a4464f1d tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] 10.222.0.33 "GET /compute/v2.1/servers/8a72de6a-64a0-4ec7-a613-576f8ac02af3" status: 200 len: 1310 microversion: 2.1 time: 0.484324 Oct 04 20:38:23.545131 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 597/1235] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:38:23 2022] GET /compute/v2.1/servers/8a72de6a-64a0-4ec7-a613-576f8ac02af3 => generated 1310 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:38:23.549918 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-1c98201c-32f5-41aa-971d-274b1f8bc0a5 req-36f0889b-f9ea-4b00-85e9-a211268ef095 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a72de6a-64a0-4ec7-a613-576f8ac02af3", "name": "network-vif-plugged", "status": "completed", "tag": "ae521132-718e-4290-aca2-064b766ac78a"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:38:23.568376 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-1c98201c-32f5-41aa-971d-274b1f8bc0a5 req-36f0889b-f9ea-4b00-85e9-a211268ef095 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:23.568968 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-1c98201c-32f5-41aa-971d-274b1f8bc0a5 req-36f0889b-f9ea-4b00-85e9-a211268ef095 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:23.569617 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-1c98201c-32f5-41aa-971d-274b1f8bc0a5 req-36f0889b-f9ea-4b00-85e9-a211268ef095 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:23.584806 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-1c98201c-32f5-41aa-971d-274b1f8bc0a5 req-36f0889b-f9ea-4b00-85e9-a211268ef095 service nova] Creating event network-vif-plugged:ae521132-718e-4290-aca2-064b766ac78a for instance 8a72de6a-64a0-4ec7-a613-576f8ac02af3 on n-h1-854823-8 Oct 04 20:38:23.590044 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-1c98201c-32f5-41aa-971d-274b1f8bc0a5 req-36f0889b-f9ea-4b00-85e9-a211268ef095 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043528 Oct 04 20:38:23.590961 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 598/1236] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:38:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:38:23.596256 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-544904a5-ab8c-4e49-80a3-812457a182c9 tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:23.596961 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-544904a5-ab8c-4e49-80a3-812457a182c9 tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] [instance: 5e984459-625e-44cd-b226-091276567215] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:23.603675 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-544904a5-ab8c-4e49-80a3-812457a182c9 tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:23.604434 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-544904a5-ab8c-4e49-80a3-812457a182c9 tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:23.604878 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-544904a5-ab8c-4e49-80a3-812457a182c9 tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:23.605593 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-544904a5-ab8c-4e49-80a3-812457a182c9 tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:23.606052 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-544904a5-ab8c-4e49-80a3-812457a182c9 tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:23.606516 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-544904a5-ab8c-4e49-80a3-812457a182c9 tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:23.733468 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-544904a5-ab8c-4e49-80a3-812457a182c9 tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] Lazy-loading 'services' on Instance uuid 5e984459-625e-44cd-b226-091276567215 {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:38:23.743892 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-3f2b205d-0c5e-4666-9d15-bc5c526ea811 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36f4114dc4f443f8b48da7b4027e0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a23a85365414f92bbc03177d7f190e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:23.755189 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-3f2b205d-0c5e-4666-9d15-bc5c526ea811 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] 10.222.0.33 "GET /compute/v2.1/servers/2182737b-f69a-44aa-a3ea-bbabae8ad737" status: 200 len: 1319 microversion: 2.1 time: 0.411616 Oct 04 20:38:23.758238 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-544904a5-ab8c-4e49-80a3-812457a182c9 tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/5e984459-625e-44cd-b226-091276567215" status: 200 len: 1929 microversion: 2.75 time: 0.165564 Oct 04 20:38:23.759083 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 599/1237] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:38:23 2022] GET /compute/v2.1/servers/5e984459-625e-44cd-b226-091276567215 => generated 1929 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:38:23.764294 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9c9b31cc-875e-49e5-a884-327f1828d65f tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Action: 'create', calling method: .version_select at 0x7f3c74309040>, body: {"keypair": {"name": "tempest-keypair-352896086", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCwzAGrWMfRvTe8qyuXT4fL1IxCrugVOd4V9gaVS1SVp07foisED2K66f0bZ3WwAQsjFZCfvF/K3ip6j/pYEeppffRQAGIArOvq5F3zco/QMXNZwmr+EyBoFOE5iUvZn1w=="}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:38:23.768004 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 639/1238] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:38:23 2022] GET /compute/v2.1/servers/2182737b-f69a-44aa-a3ea-bbabae8ad737 => generated 1319 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:38:23.782884 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-9c9b31cc-875e-49e5-a884-327f1828d65f tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Getting quotas for project 4310eadf656d4ba88ade5714c9661488. Resources: {'key_pairs'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:38:23.788140 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-9c9b31cc-875e-49e5-a884-327f1828d65f tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Getting quotas for user beaac70ab9344f6c9677d6500b8b0df6 and project 4310eadf656d4ba88ade5714c9661488. Resources: {'key_pairs'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:38:23.796045 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-3e3e5c60-06b7-4ff6-88ac-d7e5ac71056f tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:23.797237 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-3e3e5c60-06b7-4ff6-88ac-d7e5ac71056f tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] [instance: 5ac07e56-084c-4208-a988-13ec91af9171] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:23.812196 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3e3e5c60-06b7-4ff6-88ac-d7e5ac71056f tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:23.812938 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3e3e5c60-06b7-4ff6-88ac-d7e5ac71056f tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:23.813526 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3e3e5c60-06b7-4ff6-88ac-d7e5ac71056f tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:23.814447 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3e3e5c60-06b7-4ff6-88ac-d7e5ac71056f tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:23.815673 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-9c9b31cc-875e-49e5-a884-327f1828d65f tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.25 time: 0.055203 Oct 04 20:38:23.816204 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3e3e5c60-06b7-4ff6-88ac-d7e5ac71056f tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:23.816938 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3e3e5c60-06b7-4ff6-88ac-d7e5ac71056f tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:23.817057 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 600/1239] 10.222.0.33 () {62 vars in 1200 bytes} [Tue Oct 4 20:38:23 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 57 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 04 20:38:23.826083 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b9e0ba9d-a227-4c5d-bcc8-738f6adea55a tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:23.826773 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b9e0ba9d-a227-4c5d-bcc8-738f6adea55a tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] [instance: acecffb2-4128-4bd7-8bc3-7529881b64ed] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:23.836129 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b9e0ba9d-a227-4c5d-bcc8-738f6adea55a tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:23.836898 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b9e0ba9d-a227-4c5d-bcc8-738f6adea55a tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:23.838614 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b9e0ba9d-a227-4c5d-bcc8-738f6adea55a tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:23.839866 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b9e0ba9d-a227-4c5d-bcc8-738f6adea55a tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:23.840505 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b9e0ba9d-a227-4c5d-bcc8-738f6adea55a tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:23.841106 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b9e0ba9d-a227-4c5d-bcc8-738f6adea55a tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:23.983537 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-b9e0ba9d-a227-4c5d-bcc8-738f6adea55a tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d46a7cdc204e808eabedbad9c5aea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '870c8d858eb44228acd9bbe345a1143c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:23.985969 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:38:23.998161 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b9e0ba9d-a227-4c5d-bcc8-738f6adea55a tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] 10.222.0.33 "GET /compute/v2.1/servers/acecffb2-4128-4bd7-8bc3-7529881b64ed" status: 200 len: 1276 microversion: 2.1 time: 0.179752 Oct 04 20:38:24.011638 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 601/1240] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:38:23 2022] GET /compute/v2.1/servers/acecffb2-4128-4bd7-8bc3-7529881b64ed => generated 1276 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:38:24.030919 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-56fea73c-612c-456e-b7f0-22ad96c28f01 tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:24.032084 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-56fea73c-612c-456e-b7f0-22ad96c28f01 tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] [instance: 7d9db253-559a-4d4b-9a5e-42c8f63f6cb7] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:24.040390 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-56fea73c-612c-456e-b7f0-22ad96c28f01 tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:24.040792 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-56fea73c-612c-456e-b7f0-22ad96c28f01 tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:24.041352 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-56fea73c-612c-456e-b7f0-22ad96c28f01 tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:24.042305 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-56fea73c-612c-456e-b7f0-22ad96c28f01 tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:24.043164 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-56fea73c-612c-456e-b7f0-22ad96c28f01 tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:24.043565 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-56fea73c-612c-456e-b7f0-22ad96c28f01 tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:24.260503 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-3e3e5c60-06b7-4ff6-88ac-d7e5ac71056f tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11149c46e1bc468f836fe70635dbf33b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e0d8329b2c4d64bf51d88948ca0de2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:24.271253 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-3e3e5c60-06b7-4ff6-88ac-d7e5ac71056f tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] 10.222.0.33 "GET /compute/v2.1/servers/5ac07e56-084c-4208-a988-13ec91af9171" status: 200 len: 1293 microversion: 2.1 time: 0.494927 Oct 04 20:38:24.273891 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 640/1241] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:38:23 2022] GET /compute/v2.1/servers/5ac07e56-084c-4208-a988-13ec91af9171 => generated 1293 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:38:24.309042 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-a6d86eb3-1efb-4798-bccd-fe833ffbe4c8 req-8339fba2-9fff-4ee2-9a61-9f1e7fa2b75b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96d890a0-a100-40a7-b795-6677eb966251", "tag": "469a4e48-dbb3-4d56-9055-2fc2f7f7ab62"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:38:24.320588 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-a6d86eb3-1efb-4798-bccd-fe833ffbe4c8 req-8339fba2-9fff-4ee2-9a61-9f1e7fa2b75b service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:24.321066 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-a6d86eb3-1efb-4798-bccd-fe833ffbe4c8 req-8339fba2-9fff-4ee2-9a61-9f1e7fa2b75b service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:24.321563 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-a6d86eb3-1efb-4798-bccd-fe833ffbe4c8 req-8339fba2-9fff-4ee2-9a61-9f1e7fa2b75b service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:24.334383 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-a6d86eb3-1efb-4798-bccd-fe833ffbe4c8 req-8339fba2-9fff-4ee2-9a61-9f1e7fa2b75b service nova] Creating event network-changed:469a4e48-dbb3-4d56-9055-2fc2f7f7ab62 for instance 96d890a0-a100-40a7-b795-6677eb966251 on n-h2-854823-8 Oct 04 20:38:24.339906 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-a6d86eb3-1efb-4798-bccd-fe833ffbe4c8 req-8339fba2-9fff-4ee2-9a61-9f1e7fa2b75b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064586 Oct 04 20:38:24.340959 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 641/1242] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:38:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:38:24.367671 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-ae27b3d1-a948-4ebf-a929-c9521cc454cf tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:24.368400 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-ae27b3d1-a948-4ebf-a929-c9521cc454cf tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] [instance: 23da26ba-68f4-4aef-b13c-0b6588a65e43] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:24.375315 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ae27b3d1-a948-4ebf-a929-c9521cc454cf tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:24.375799 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ae27b3d1-a948-4ebf-a929-c9521cc454cf tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:24.376226 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ae27b3d1-a948-4ebf-a929-c9521cc454cf tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:24.376933 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ae27b3d1-a948-4ebf-a929-c9521cc454cf tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:24.378029 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ae27b3d1-a948-4ebf-a929-c9521cc454cf tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:24.378533 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ae27b3d1-a948-4ebf-a929-c9521cc454cf tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:24.599820 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell0:SELECT=2 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:38:25.055004 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-56fea73c-612c-456e-b7f0-22ad96c28f01 tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b786966441fc45f28890bf56cdfafb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8cc219b86ed450cbe7c780d7f79d9f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:25.069584 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-56fea73c-612c-456e-b7f0-22ad96c28f01 tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] 10.222.0.33 "GET /compute/v2.1/servers/7d9db253-559a-4d4b-9a5e-42c8f63f6cb7" status: 200 len: 1682 microversion: 2.1 time: 1.055520 Oct 04 20:38:25.074962 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 602/1243] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:38:24 2022] GET /compute/v2.1/servers/7d9db253-559a-4d4b-9a5e-42c8f63f6cb7 => generated 1682 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:38:25.081280 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-63b10c29-873a-48ae-a838-f0966c7bd769 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:25.084715 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-63b10c29-873a-48ae-a838-f0966c7bd769 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] [instance: 8a72de6a-64a0-4ec7-a613-576f8ac02af3] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:25.096120 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-63b10c29-873a-48ae-a838-f0966c7bd769 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:25.097986 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-63b10c29-873a-48ae-a838-f0966c7bd769 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:25.098891 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-63b10c29-873a-48ae-a838-f0966c7bd769 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:25.100206 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-63b10c29-873a-48ae-a838-f0966c7bd769 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:25.100837 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-63b10c29-873a-48ae-a838-f0966c7bd769 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:25.101700 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-63b10c29-873a-48ae-a838-f0966c7bd769 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:25.216666 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-ae27b3d1-a948-4ebf-a929-c9521cc454cf tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3563efe2b8c94931a2a46c4e14811b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3118a5d96843d3bede1ed94bd9717e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:25.227814 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-ae27b3d1-a948-4ebf-a929-c9521cc454cf tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] 10.222.0.33 "GET /compute/v2.1/servers/23da26ba-68f4-4aef-b13c-0b6588a65e43" status: 200 len: 1313 microversion: 2.1 time: 0.865560 Oct 04 20:38:25.228579 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 642/1244] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:38:24 2022] GET /compute/v2.1/servers/23da26ba-68f4-4aef-b13c-0b6588a65e43 => generated 1313 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:38:25.235106 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-311ff0f3-75f1-4cb6-af7c-64bf1aeebad8 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:25.236345 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-311ff0f3-75f1-4cb6-af7c-64bf1aeebad8 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] [instance: 2182737b-f69a-44aa-a3ea-bbabae8ad737] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:25.243737 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-311ff0f3-75f1-4cb6-af7c-64bf1aeebad8 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:25.244233 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-311ff0f3-75f1-4cb6-af7c-64bf1aeebad8 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:25.245076 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-311ff0f3-75f1-4cb6-af7c-64bf1aeebad8 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:25.245990 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-311ff0f3-75f1-4cb6-af7c-64bf1aeebad8 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:25.246897 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-311ff0f3-75f1-4cb6-af7c-64bf1aeebad8 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:25.247489 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-311ff0f3-75f1-4cb6-af7c-64bf1aeebad8 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:25.717496 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-63b10c29-873a-48ae-a838-f0966c7bd769 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '800db3a57ada47eca381b00189fdbf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66ec8ea91b04deb90b679589e0495bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:25.728108 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-63b10c29-873a-48ae-a838-f0966c7bd769 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] 10.222.0.33 "GET /compute/v2.1/servers/8a72de6a-64a0-4ec7-a613-576f8ac02af3" status: 200 len: 1310 microversion: 2.1 time: 0.651724 Oct 04 20:38:25.730076 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 603/1245] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:38:25 2022] GET /compute/v2.1/servers/8a72de6a-64a0-4ec7-a613-576f8ac02af3 => generated 1310 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:38:25.738832 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a1b9c5bd-c80f-481a-a2b9-beff484561ef tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:25.739783 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a1b9c5bd-c80f-481a-a2b9-beff484561ef tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] [instance: 5e984459-625e-44cd-b226-091276567215] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:25.754043 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a1b9c5bd-c80f-481a-a2b9-beff484561ef tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:25.759611 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a1b9c5bd-c80f-481a-a2b9-beff484561ef tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:25.760181 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a1b9c5bd-c80f-481a-a2b9-beff484561ef tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:25.760886 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a1b9c5bd-c80f-481a-a2b9-beff484561ef tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:25.761378 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a1b9c5bd-c80f-481a-a2b9-beff484561ef tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:25.761808 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a1b9c5bd-c80f-481a-a2b9-beff484561ef tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:25.764071 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-311ff0f3-75f1-4cb6-af7c-64bf1aeebad8 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36f4114dc4f443f8b48da7b4027e0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a23a85365414f92bbc03177d7f190e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:25.775077 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-311ff0f3-75f1-4cb6-af7c-64bf1aeebad8 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] 10.222.0.33 "GET /compute/v2.1/servers/2182737b-f69a-44aa-a3ea-bbabae8ad737" status: 200 len: 1319 microversion: 2.1 time: 0.544792 Oct 04 20:38:25.775949 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 643/1246] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:38:25 2022] GET /compute/v2.1/servers/2182737b-f69a-44aa-a3ea-bbabae8ad737 => generated 1319 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:38:25.790058 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-6543b9c2-5759-4dcf-8473-ff23f2c8128b tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:25.790664 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-6543b9c2-5759-4dcf-8473-ff23f2c8128b tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] [instance: acecffb2-4128-4bd7-8bc3-7529881b64ed] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:25.803496 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6543b9c2-5759-4dcf-8473-ff23f2c8128b tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:25.805227 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6543b9c2-5759-4dcf-8473-ff23f2c8128b tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:25.807816 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6543b9c2-5759-4dcf-8473-ff23f2c8128b tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:25.809293 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6543b9c2-5759-4dcf-8473-ff23f2c8128b tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:25.812291 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6543b9c2-5759-4dcf-8473-ff23f2c8128b tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:25.813729 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6543b9c2-5759-4dcf-8473-ff23f2c8128b tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:25.957764 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-a1b9c5bd-c80f-481a-a2b9-beff484561ef tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] Lazy-loading 'services' on Instance uuid 5e984459-625e-44cd-b226-091276567215 {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:38:25.958804 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-6543b9c2-5759-4dcf-8473-ff23f2c8128b tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d46a7cdc204e808eabedbad9c5aea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '870c8d858eb44228acd9bbe345a1143c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:25.976114 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-6543b9c2-5759-4dcf-8473-ff23f2c8128b tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] 10.222.0.33 "GET /compute/v2.1/servers/acecffb2-4128-4bd7-8bc3-7529881b64ed" status: 200 len: 1274 microversion: 2.1 time: 0.199223 Oct 04 20:38:25.977960 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 644/1247] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:38:25 2022] GET /compute/v2.1/servers/acecffb2-4128-4bd7-8bc3-7529881b64ed => generated 1274 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:38:25.985607 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-c68675d3-2096-4705-ba60-11f23b268b06 tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:25.986562 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-c68675d3-2096-4705-ba60-11f23b268b06 tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] [instance: 5ac07e56-084c-4208-a988-13ec91af9171] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:25.996773 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c68675d3-2096-4705-ba60-11f23b268b06 tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:25.998668 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c68675d3-2096-4705-ba60-11f23b268b06 tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:26.000756 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c68675d3-2096-4705-ba60-11f23b268b06 tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:26.001575 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c68675d3-2096-4705-ba60-11f23b268b06 tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:26.002128 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c68675d3-2096-4705-ba60-11f23b268b06 tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:26.002738 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c68675d3-2096-4705-ba60-11f23b268b06 tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:26.016149 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a1b9c5bd-c80f-481a-a2b9-beff484561ef tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/5e984459-625e-44cd-b226-091276567215" status: 200 len: 1929 microversion: 2.75 time: 0.284211 Oct 04 20:38:26.057032 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 604/1248] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:38:25 2022] GET /compute/v2.1/servers/5e984459-625e-44cd-b226-091276567215 => generated 1929 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:38:26.071792 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-2241d011-f628-407a-a066-4074f98192c8 req-2a86893e-b44f-4b86-b6ea-02d72342915e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23da26ba-68f4-4aef-b13c-0b6588a65e43", "name": "network-vif-plugged", "status": "completed", "tag": "f692dbdb-9498-4986-a253-420f090b704f"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:38:26.114272 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-2241d011-f628-407a-a066-4074f98192c8 req-2a86893e-b44f-4b86-b6ea-02d72342915e service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:26.115184 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-2241d011-f628-407a-a066-4074f98192c8 req-2a86893e-b44f-4b86-b6ea-02d72342915e service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:26.115784 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-2241d011-f628-407a-a066-4074f98192c8 req-2a86893e-b44f-4b86-b6ea-02d72342915e service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:26.133514 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-2241d011-f628-407a-a066-4074f98192c8 req-2a86893e-b44f-4b86-b6ea-02d72342915e service nova] Creating event network-vif-plugged:f692dbdb-9498-4986-a253-420f090b704f for instance 23da26ba-68f4-4aef-b13c-0b6588a65e43 on n-h1-854823-8 Oct 04 20:38:26.140774 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-2241d011-f628-407a-a066-4074f98192c8 req-2a86893e-b44f-4b86-b6ea-02d72342915e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080703 Oct 04 20:38:26.143094 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 605/1249] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:38:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:38:26.156293 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-08cf1474-268a-4f28-bc95-424c28c6a33e tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:26.157279 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-08cf1474-268a-4f28-bc95-424c28c6a33e tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] [instance: 7d9db253-559a-4d4b-9a5e-42c8f63f6cb7] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:26.167964 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-08cf1474-268a-4f28-bc95-424c28c6a33e tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:26.168711 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-08cf1474-268a-4f28-bc95-424c28c6a33e tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:26.169556 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-08cf1474-268a-4f28-bc95-424c28c6a33e tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:26.170480 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-08cf1474-268a-4f28-bc95-424c28c6a33e tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:26.171841 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-08cf1474-268a-4f28-bc95-424c28c6a33e tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:26.172615 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-08cf1474-268a-4f28-bc95-424c28c6a33e tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:26.439414 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-c68675d3-2096-4705-ba60-11f23b268b06 tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11149c46e1bc468f836fe70635dbf33b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e0d8329b2c4d64bf51d88948ca0de2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:26.454332 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-c68675d3-2096-4705-ba60-11f23b268b06 tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] 10.222.0.33 "GET /compute/v2.1/servers/5ac07e56-084c-4208-a988-13ec91af9171" status: 200 len: 1484 microversion: 2.1 time: 0.474036 Oct 04 20:38:26.468940 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 645/1250] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:38:25 2022] GET /compute/v2.1/servers/5ac07e56-084c-4208-a988-13ec91af9171 => generated 1484 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:38:26.485739 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-7ee1151d-305a-4bc8-9619-7269a949a02a tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:26.486490 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-7ee1151d-305a-4bc8-9619-7269a949a02a tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] [instance: 23da26ba-68f4-4aef-b13c-0b6588a65e43] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:26.494843 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7ee1151d-305a-4bc8-9619-7269a949a02a tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:26.495471 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7ee1151d-305a-4bc8-9619-7269a949a02a tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:26.495999 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7ee1151d-305a-4bc8-9619-7269a949a02a tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:26.496857 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7ee1151d-305a-4bc8-9619-7269a949a02a tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:26.497410 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7ee1151d-305a-4bc8-9619-7269a949a02a tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:26.498488 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7ee1151d-305a-4bc8-9619-7269a949a02a tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:26.514495 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-08cf1474-268a-4f28-bc95-424c28c6a33e tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b786966441fc45f28890bf56cdfafb3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8cc219b86ed450cbe7c780d7f79d9f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:26.524488 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-08cf1474-268a-4f28-bc95-424c28c6a33e tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] 10.222.0.33 "GET /compute/v2.1/servers/7d9db253-559a-4d4b-9a5e-42c8f63f6cb7" status: 200 len: 1682 microversion: 2.1 time: 0.377826 Oct 04 20:38:26.525090 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 606/1251] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:38:26 2022] GET /compute/v2.1/servers/7d9db253-559a-4d4b-9a5e-42c8f63f6cb7 => generated 1682 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:38:26.540360 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-3ace1327-0646-4bca-8d48-2e73fbe9deca tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:26.541277 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-3ace1327-0646-4bca-8d48-2e73fbe9deca tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] [instance: 5ac07e56-084c-4208-a988-13ec91af9171] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:26.563960 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3ace1327-0646-4bca-8d48-2e73fbe9deca tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:26.564459 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3ace1327-0646-4bca-8d48-2e73fbe9deca tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:26.564917 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3ace1327-0646-4bca-8d48-2e73fbe9deca tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:26.565622 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3ace1327-0646-4bca-8d48-2e73fbe9deca tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:26.566145 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3ace1327-0646-4bca-8d48-2e73fbe9deca tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:26.566598 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3ace1327-0646-4bca-8d48-2e73fbe9deca tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:26.844326 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-3ace1327-0646-4bca-8d48-2e73fbe9deca tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] 10.222.0.33 "GET /compute/v2.1/servers/5ac07e56-084c-4208-a988-13ec91af9171/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.317833 Oct 04 20:38:26.855182 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 607/1252] 10.222.0.33 () {58 vars in 1275 bytes} [Tue Oct 4 20:38:26 2022] GET /compute/v2.1/servers/5ac07e56-084c-4208-a988-13ec91af9171/os-interface => generated 285 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:38:26.861832 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d701ca9c-04a6-4fe8-82df-229550e1c4e3 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-585059360", "imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63", "flavorRef": "452", "networks": [{"uuid": "accbf9df-df79-4b74-a013-58a41c8806a7"}], "security_groups": [{"name": "tempest-securitygroup--764952626"}], "key_name": "tempest-keypair-352896086", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:38:27.066947 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-7ee1151d-305a-4bc8-9619-7269a949a02a tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3563efe2b8c94931a2a46c4e14811b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3118a5d96843d3bede1ed94bd9717e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:27.078997 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-7ee1151d-305a-4bc8-9619-7269a949a02a tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] 10.222.0.33 "GET /compute/v2.1/servers/23da26ba-68f4-4aef-b13c-0b6588a65e43" status: 200 len: 1313 microversion: 2.1 time: 0.608614 Oct 04 20:38:27.090364 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 646/1253] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:38:26 2022] GET /compute/v2.1/servers/23da26ba-68f4-4aef-b13c-0b6588a65e43 => generated 1313 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:38:27.099103 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-4fe35f1e-d095-4b2f-b3d3-81982dbd52ca req-7562c70f-445a-4ce1-8a9b-f5edc7ed8447 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2182737b-f69a-44aa-a3ea-bbabae8ad737", "tag": "f7a4a879-9c9a-46e9-a921-58ebd3c70015"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:38:27.111308 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-4fe35f1e-d095-4b2f-b3d3-81982dbd52ca req-7562c70f-445a-4ce1-8a9b-f5edc7ed8447 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:27.113080 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-4fe35f1e-d095-4b2f-b3d3-81982dbd52ca req-7562c70f-445a-4ce1-8a9b-f5edc7ed8447 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:27.113745 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-4fe35f1e-d095-4b2f-b3d3-81982dbd52ca req-7562c70f-445a-4ce1-8a9b-f5edc7ed8447 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:27.121602 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.network.neutron [None req-d701ca9c-04a6-4fe8-82df-229550e1c4e3 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] validate_networks() for [('accbf9df-df79-4b74-a013-58a41c8806a7', None, None, None, None, None)] {{(pid=128801) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:38:27.136949 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-4fe35f1e-d095-4b2f-b3d3-81982dbd52ca req-7562c70f-445a-4ce1-8a9b-f5edc7ed8447 service nova] Creating event network-changed:f7a4a879-9c9a-46e9-a921-58ebd3c70015 for instance 2182737b-f69a-44aa-a3ea-bbabae8ad737 on n-h2-854823-8 Oct 04 20:38:27.151603 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-4fe35f1e-d095-4b2f-b3d3-81982dbd52ca req-7562c70f-445a-4ce1-8a9b-f5edc7ed8447 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070122 Oct 04 20:38:27.152229 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 647/1254] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:38:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:38:27.163944 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-3a223f44-4184-469a-8747-9af94b5ca0d0 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:27.165094 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-3a223f44-4184-469a-8747-9af94b5ca0d0 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] [instance: 8a72de6a-64a0-4ec7-a613-576f8ac02af3] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:27.174261 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3a223f44-4184-469a-8747-9af94b5ca0d0 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:27.175005 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3a223f44-4184-469a-8747-9af94b5ca0d0 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:27.176839 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3a223f44-4184-469a-8747-9af94b5ca0d0 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:27.176839 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3a223f44-4184-469a-8747-9af94b5ca0d0 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:27.177101 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3a223f44-4184-469a-8747-9af94b5ca0d0 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:27.177482 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3a223f44-4184-469a-8747-9af94b5ca0d0 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:27.489767 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-3a223f44-4184-469a-8747-9af94b5ca0d0 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '800db3a57ada47eca381b00189fdbf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66ec8ea91b04deb90b679589e0495bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:27.506495 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-3a223f44-4184-469a-8747-9af94b5ca0d0 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] 10.222.0.33 "GET /compute/v2.1/servers/8a72de6a-64a0-4ec7-a613-576f8ac02af3" status: 200 len: 1493 microversion: 2.1 time: 0.352952 Oct 04 20:38:27.508131 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 648/1255] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:38:27 2022] GET /compute/v2.1/servers/8a72de6a-64a0-4ec7-a613-576f8ac02af3 => generated 1493 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:38:27.514516 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-f737c373-821c-4dda-8e27-828acde98859 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:27.515848 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-f737c373-821c-4dda-8e27-828acde98859 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] [instance: 2182737b-f69a-44aa-a3ea-bbabae8ad737] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:27.524331 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f737c373-821c-4dda-8e27-828acde98859 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:27.525147 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f737c373-821c-4dda-8e27-828acde98859 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:27.526304 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f737c373-821c-4dda-8e27-828acde98859 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:27.527396 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f737c373-821c-4dda-8e27-828acde98859 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:27.529555 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f737c373-821c-4dda-8e27-828acde98859 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:27.530243 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f737c373-821c-4dda-8e27-828acde98859 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:28.241680 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-f737c373-821c-4dda-8e27-828acde98859 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36f4114dc4f443f8b48da7b4027e0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a23a85365414f92bbc03177d7f190e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:28.252200 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-f737c373-821c-4dda-8e27-828acde98859 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] 10.222.0.33 "GET /compute/v2.1/servers/2182737b-f69a-44aa-a3ea-bbabae8ad737" status: 200 len: 1319 microversion: 2.1 time: 0.742755 Oct 04 20:38:28.253957 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 649/1256] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:38:27 2022] GET /compute/v2.1/servers/2182737b-f69a-44aa-a3ea-bbabae8ad737 => generated 1319 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:38:28.259517 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-3a545e2e-297c-4021-8e45-568fe90d725a tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:28.260580 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-3a545e2e-297c-4021-8e45-568fe90d725a tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] [instance: acecffb2-4128-4bd7-8bc3-7529881b64ed] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:28.279446 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-d701ca9c-04a6-4fe8-82df-229550e1c4e3 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Flavor limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:38:28.280663 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-d701ca9c-04a6-4fe8-82df-229550e1c4e3 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Image limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:38:28.283859 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-d701ca9c-04a6-4fe8-82df-229550e1c4e3 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Flavor pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:38:28.286033 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-d701ca9c-04a6-4fe8-82df-229550e1c4e3 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Image pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:38:28.286789 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-d701ca9c-04a6-4fe8-82df-229550e1c4e3 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:38:28.294503 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3a545e2e-297c-4021-8e45-568fe90d725a tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:28.296010 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3a545e2e-297c-4021-8e45-568fe90d725a tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:28.299749 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3a545e2e-297c-4021-8e45-568fe90d725a tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:28.300920 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3a545e2e-297c-4021-8e45-568fe90d725a tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:28.305559 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3a545e2e-297c-4021-8e45-568fe90d725a tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:28.307757 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3a545e2e-297c-4021-8e45-568fe90d725a tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:28.313620 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d701ca9c-04a6-4fe8-82df-229550e1c4e3 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:28.314846 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d701ca9c-04a6-4fe8-82df-229550e1c4e3 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:28.315531 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d701ca9c-04a6-4fe8-82df-229550e1c4e3 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:28.328228 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d701ca9c-04a6-4fe8-82df-229550e1c4e3 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:28.332568 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d701ca9c-04a6-4fe8-82df-229550e1c4e3 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:28.333451 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d701ca9c-04a6-4fe8-82df-229550e1c4e3 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:28.409209 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-d701ca9c-04a6-4fe8-82df-229550e1c4e3 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Getting quotas for project 4310eadf656d4ba88ade5714c9661488. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:38:28.416966 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-d701ca9c-04a6-4fe8-82df-229550e1c4e3 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Getting quotas for user beaac70ab9344f6c9677d6500b8b0df6 and project 4310eadf656d4ba88ade5714c9661488. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:38:28.435091 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d701ca9c-04a6-4fe8-82df-229550e1c4e3 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Going to run 1 instances... {{(pid=128801) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:38:28.437780 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d701ca9c-04a6-4fe8-82df-229550e1c4e3 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] [instance: 81748c83-b703-4c68-899c-c575cc3340d2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='15b24725-0c99-4bcf-b1fb-907cdf8e2d63',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128801) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:38:28.513559 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d701ca9c-04a6-4fe8-82df-229550e1c4e3 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.25 time: 1.656224 Oct 04 20:38:28.518509 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 608/1257] 10.222.0.33 () {62 vars in 1188 bytes} [Tue Oct 4 20:38:26 2022] POST /compute/v2.1/servers => generated 405 bytes in 1663 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 04 20:38:28.530540 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-e7c0b2ac-22ba-4791-8b6d-a4fed0ac1afb req-ebe33cd6-fcce-4e7b-944c-80e2785ed3ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d9db253-559a-4d4b-9a5e-42c8f63f6cb7", "name": "network-vif-deleted", "tag": "9b3bb850-3715-4a18-91c1-43aaf29fbf6f"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:38:28.544171 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-e7c0b2ac-22ba-4791-8b6d-a4fed0ac1afb req-ebe33cd6-fcce-4e7b-944c-80e2785ed3ea service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:28.545691 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-e7c0b2ac-22ba-4791-8b6d-a4fed0ac1afb req-ebe33cd6-fcce-4e7b-944c-80e2785ed3ea service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:28.546893 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-e7c0b2ac-22ba-4791-8b6d-a4fed0ac1afb req-ebe33cd6-fcce-4e7b-944c-80e2785ed3ea service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:28.569867 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-e7c0b2ac-22ba-4791-8b6d-a4fed0ac1afb req-ebe33cd6-fcce-4e7b-944c-80e2785ed3ea service nova] Creating event network-vif-deleted:9b3bb850-3715-4a18-91c1-43aaf29fbf6f for instance 7d9db253-559a-4d4b-9a5e-42c8f63f6cb7 on n-h1-854823-8 Oct 04 20:38:28.578566 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-e7c0b2ac-22ba-4791-8b6d-a4fed0ac1afb req-ebe33cd6-fcce-4e7b-944c-80e2785ed3ea service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057594 Oct 04 20:38:28.579842 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 609/1258] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:38:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:38:28.587350 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ae01304d-28f0-4b32-8f7a-3ff30cfcdb24 tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:28.588455 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ae01304d-28f0-4b32-8f7a-3ff30cfcdb24 tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] [instance: 5e984459-625e-44cd-b226-091276567215] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:28.597745 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ae01304d-28f0-4b32-8f7a-3ff30cfcdb24 tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:28.598615 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ae01304d-28f0-4b32-8f7a-3ff30cfcdb24 tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:28.599718 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ae01304d-28f0-4b32-8f7a-3ff30cfcdb24 tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:28.601561 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ae01304d-28f0-4b32-8f7a-3ff30cfcdb24 tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:28.603491 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ae01304d-28f0-4b32-8f7a-3ff30cfcdb24 tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:28.604181 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ae01304d-28f0-4b32-8f7a-3ff30cfcdb24 tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:28.710322 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-3a545e2e-297c-4021-8e45-568fe90d725a tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d46a7cdc204e808eabedbad9c5aea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '870c8d858eb44228acd9bbe345a1143c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:28.720187 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-3a545e2e-297c-4021-8e45-568fe90d725a tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] 10.222.0.33 "GET /compute/v2.1/servers/acecffb2-4128-4bd7-8bc3-7529881b64ed" status: 200 len: 1316 microversion: 2.1 time: 0.464841 Oct 04 20:38:28.721834 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 650/1259] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:38:28 2022] GET /compute/v2.1/servers/acecffb2-4128-4bd7-8bc3-7529881b64ed => generated 1316 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:38:28.732497 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-cd238d3c-ba1f-440f-8676-e0e3e7591144 tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:28.733369 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-cd238d3c-ba1f-440f-8676-e0e3e7591144 tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] [instance: 8a72de6a-64a0-4ec7-a613-576f8ac02af3] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:28.750262 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-ae01304d-28f0-4b32-8f7a-3ff30cfcdb24 tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] Lazy-loading 'services' on Instance uuid 5e984459-625e-44cd-b226-091276567215 {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:38:28.759285 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cd238d3c-ba1f-440f-8676-e0e3e7591144 tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:28.760225 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cd238d3c-ba1f-440f-8676-e0e3e7591144 tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:28.761253 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cd238d3c-ba1f-440f-8676-e0e3e7591144 tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:28.775922 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ae01304d-28f0-4b32-8f7a-3ff30cfcdb24 tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/5e984459-625e-44cd-b226-091276567215" status: 200 len: 1929 microversion: 2.75 time: 0.194545 Oct 04 20:38:28.778154 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cd238d3c-ba1f-440f-8676-e0e3e7591144 tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:28.789428 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cd238d3c-ba1f-440f-8676-e0e3e7591144 tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:28.790198 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cd238d3c-ba1f-440f-8676-e0e3e7591144 tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:28.806170 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 610/1260] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:38:28 2022] GET /compute/v2.1/servers/5e984459-625e-44cd-b226-091276567215 => generated 1929 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:38:28.815425 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ea33857d-d40e-4e4e-8dbe-99b0aef63e54 tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:28.818595 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ea33857d-d40e-4e4e-8dbe-99b0aef63e54 tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] [instance: 7d9db253-559a-4d4b-9a5e-42c8f63f6cb7] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:28.829855 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ea33857d-d40e-4e4e-8dbe-99b0aef63e54 tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:28.830685 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ea33857d-d40e-4e4e-8dbe-99b0aef63e54 tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:28.833311 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ea33857d-d40e-4e4e-8dbe-99b0aef63e54 tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:28.834246 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ea33857d-d40e-4e4e-8dbe-99b0aef63e54 tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:28.836391 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ea33857d-d40e-4e4e-8dbe-99b0aef63e54 tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:28.840232 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ea33857d-d40e-4e4e-8dbe-99b0aef63e54 tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:28.874523 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-ea33857d-d40e-4e4e-8dbe-99b0aef63e54 tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] HTTP exception thrown: Instance 7d9db253-559a-4d4b-9a5e-42c8f63f6cb7 could not be found. Oct 04 20:38:28.876776 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ea33857d-d40e-4e4e-8dbe-99b0aef63e54 tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Request method failure captured: Oct 04 20:38:28.876776 n-d-854823-8 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/7d9db253-559a-4d4b-9a5e-42c8f63f6cb7 HTTP/1.1 Oct 04 20:38:28.876776 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:38:28.876776 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:38:28.876776 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:38:28.876776 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 0 Oct 04 20:38:28.876776 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:38:28.876776 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:38:28.876776 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:38:28.876776 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:38:28.876776 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJkTaVBQBbcSle_BCOIe5JQ0hXNW-JZmgLYS5Uzb1Vl-dpbiKAwgncy1QvWBjG4xX1gR8DTcJfEyhZ3cuMJJ02qNbZDDoK1jHHyD8OeNgHQBppdwBIWDrPA6RRKL5KTJurSBBxnQwIatFQa5M8XqO1G1nXB3isB8veCUZH9-SpK_Q8U Oct 04 20:38:28.876776 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:38:28.876776 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:38:28.876776 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:38:28.876776 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:38:28.876776 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:38:28.876776 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:38:28.876776 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: e8cc219b86ed450cbe7c780d7f79d9f8 Oct 04 20:38:28.876776 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-837025504 Oct 04 20:38:28.876776 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 20:38:28.876776 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 20:38:28.876776 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_e8cc219b86ed450cbe7c780d7f79d9f8", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e8cc219b86ed450cbe7c780d7f79d9f8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e8cc219b86ed450cbe7c780d7f79d9f8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/e8cc219b86ed450cbe7c780d7f79d9f8"}]}] Oct 04 20:38:28.876776 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-837025504 Oct 04 20:38:28.876776 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: e8cc219b86ed450cbe7c780d7f79d9f8 Oct 04 20:38:28.876776 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-837025504 Oct 04 20:38:28.876776 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-AttachSCSIVolumeTestJSON-837025504-project Oct 04 20:38:28.876776 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:38:28.876776 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:38:28.876776 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: b786966441fc45f28890bf56cdfafb3f Oct 04 20:38:28.876776 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-837025504-project Oct 04 20:38:28.876776 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 20:38:28.876776 n-d-854823-8 devstack@n-api.service[128801]: exception: Instance 7d9db253-559a-4d4b-9a5e-42c8f63f6cb7 could not be found. Oct 04 20:38:28.876776 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': '7d9db253-559a-4d4b-9a5e-42c8f63f6cb7'} Oct 04 20:38:28.876776 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:38:28.876776 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:38:28.876776 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:38:28.876776 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:38:28.876776 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:38:28.876776 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:38:28.876776 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:38:28.876776 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:38:28.876776 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:38:28.876776 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:38:28.876776 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d9db253-559a-4d4b-9a5e-42c8f63f6cb7 could not be found. Oct 04 20:38:28.876776 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:38:28.876776 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:38:28.876776 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:38:28.876776 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:38:28.876776 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:38:28.876776 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:38:28.876776 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:38:28.876776 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:38:28.876776 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:38:28.876776 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:38:28.876776 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:38:28.876776 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:38:28.876776 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:38:28.876776 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:38:28.876776 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:38:28.876776 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:38:28.876776 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d9db253-559a-4d4b-9a5e-42c8f63f6cb7 could not be found. Oct 04 20:38:28.876776 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:38:28.876776 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:38:28.876776 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:38:28.882524 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:38:28.882524 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:38:28.882524 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:38:28.882524 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:38:28.882524 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:38:28.882524 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d9db253-559a-4d4b-9a5e-42c8f63f6cb7 could not be found. Oct 04 20:38:28.882524 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:38:28.882524 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ea33857d-d40e-4e4e-8dbe-99b0aef63e54 tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Returning 404 to user: Instance 7d9db253-559a-4d4b-9a5e-42c8f63f6cb7 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:38:28.882524 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ea33857d-d40e-4e4e-8dbe-99b0aef63e54 tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] 10.222.0.33 "GET /compute/v2.1/servers/7d9db253-559a-4d4b-9a5e-42c8f63f6cb7" status: 404 len: 111 microversion: 2.1 time: 0.070691 Oct 04 20:38:28.883230 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 611/1261] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:38:28 2022] GET /compute/v2.1/servers/7d9db253-559a-4d4b-9a5e-42c8f63f6cb7 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:38:28.908272 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ed24d03a-4274-4c2f-98c2-2210c746b7fb tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:28.908893 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ed24d03a-4274-4c2f-98c2-2210c746b7fb tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] [instance: 23da26ba-68f4-4aef-b13c-0b6588a65e43] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:28.918069 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ed24d03a-4274-4c2f-98c2-2210c746b7fb tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:28.918802 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ed24d03a-4274-4c2f-98c2-2210c746b7fb tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:28.919884 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ed24d03a-4274-4c2f-98c2-2210c746b7fb tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:28.927527 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ed24d03a-4274-4c2f-98c2-2210c746b7fb tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:28.928685 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ed24d03a-4274-4c2f-98c2-2210c746b7fb tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:28.930329 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ed24d03a-4274-4c2f-98c2-2210c746b7fb tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:29.317728 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-cd238d3c-ba1f-440f-8676-e0e3e7591144 tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/8a72de6a-64a0-4ec7-a613-576f8ac02af3" status: 200 len: 1644 microversion: 2.1 time: 0.594617 Oct 04 20:38:29.318713 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 651/1262] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:38:28 2022] GET /compute/v2.1/servers/8a72de6a-64a0-4ec7-a613-576f8ac02af3 => generated 1644 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:38:29.334545 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-5cbd930f-2fe0-46bf-827e-e628b40d0391 tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:29.335816 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-5cbd930f-2fe0-46bf-827e-e628b40d0391 tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] [instance: 5ac07e56-084c-4208-a988-13ec91af9171] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:29.343783 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-ed24d03a-4274-4c2f-98c2-2210c746b7fb tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3563efe2b8c94931a2a46c4e14811b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3118a5d96843d3bede1ed94bd9717e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:29.350463 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5cbd930f-2fe0-46bf-827e-e628b40d0391 tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:29.351286 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5cbd930f-2fe0-46bf-827e-e628b40d0391 tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:29.351732 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5cbd930f-2fe0-46bf-827e-e628b40d0391 tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:29.352729 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5cbd930f-2fe0-46bf-827e-e628b40d0391 tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:29.353194 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5cbd930f-2fe0-46bf-827e-e628b40d0391 tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:29.353625 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5cbd930f-2fe0-46bf-827e-e628b40d0391 tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:29.354862 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ed24d03a-4274-4c2f-98c2-2210c746b7fb tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] 10.222.0.33 "GET /compute/v2.1/servers/23da26ba-68f4-4aef-b13c-0b6588a65e43" status: 200 len: 1463 microversion: 2.1 time: 0.461203 Oct 04 20:38:29.356317 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 612/1263] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:38:28 2022] GET /compute/v2.1/servers/23da26ba-68f4-4aef-b13c-0b6588a65e43 => generated 1463 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:38:29.364800 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-5fb55397-fe36-47b7-ba94-c3be4f955152 req-3527b79e-cb91-41f2-996f-437ef701dbd8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d9db253-559a-4d4b-9a5e-42c8f63f6cb7", "name": "network-vif-unplugged", "status": "completed", "tag": "9b3bb850-3715-4a18-91c1-43aaf29fbf6f"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:38:29.377177 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-5fb55397-fe36-47b7-ba94-c3be4f955152 req-3527b79e-cb91-41f2-996f-437ef701dbd8 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:29.377765 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-5fb55397-fe36-47b7-ba94-c3be4f955152 req-3527b79e-cb91-41f2-996f-437ef701dbd8 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:29.378476 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-5fb55397-fe36-47b7-ba94-c3be4f955152 req-3527b79e-cb91-41f2-996f-437ef701dbd8 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:29.394917 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-5fb55397-fe36-47b7-ba94-c3be4f955152 req-3527b79e-cb91-41f2-996f-437ef701dbd8 service nova] Creating event network-vif-unplugged:9b3bb850-3715-4a18-91c1-43aaf29fbf6f for instance 7d9db253-559a-4d4b-9a5e-42c8f63f6cb7 on n-h1-854823-8 Oct 04 20:38:29.400367 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-5fb55397-fe36-47b7-ba94-c3be4f955152 req-3527b79e-cb91-41f2-996f-437ef701dbd8 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042522 Oct 04 20:38:29.401216 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 613/1264] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:38:29 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:38:29.408455 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-709a0f06-159d-4134-adf0-8ababb5b3df7 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:29.409401 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-709a0f06-159d-4134-adf0-8ababb5b3df7 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] [instance: 81748c83-b703-4c68-899c-c575cc3340d2] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:29.416930 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-709a0f06-159d-4134-adf0-8ababb5b3df7 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:29.417555 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-709a0f06-159d-4134-adf0-8ababb5b3df7 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:29.418083 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-709a0f06-159d-4134-adf0-8ababb5b3df7 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:29.419046 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-709a0f06-159d-4134-adf0-8ababb5b3df7 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:29.419599 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-709a0f06-159d-4134-adf0-8ababb5b3df7 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:29.420116 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-709a0f06-159d-4134-adf0-8ababb5b3df7 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:29.518149 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-709a0f06-159d-4134-adf0-8ababb5b3df7 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:29.533972 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-709a0f06-159d-4134-adf0-8ababb5b3df7 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:29.535600 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-709a0f06-159d-4134-adf0-8ababb5b3df7 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:29.536737 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-709a0f06-159d-4134-adf0-8ababb5b3df7 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] 10.222.0.33 "GET /compute/v2.1/servers/81748c83-b703-4c68-899c-c575cc3340d2" status: 200 len: 1288 microversion: 2.25 time: 0.134256 Oct 04 20:38:29.537295 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 614/1265] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:38:29 2022] GET /compute/v2.1/servers/81748c83-b703-4c68-899c-c575cc3340d2 => generated 1288 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:38:29.543737 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b242b1af-f6d5-4f7f-9caa-f160f7512992 tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Calling method '.version_select at 0x7f3c74303040>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:29.567915 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b242b1af-f6d5-4f7f-9caa-f160f7512992 tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1107808858" status: 202 len: 0 microversion: 2.1 time: 0.027217 Oct 04 20:38:29.569111 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 615/1266] 10.222.0.33 () {58 vars in 1221 bytes} [Tue Oct 4 20:38:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1107808858 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:38:29.575247 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-13db11c9-e983-44cf-bc2c-7a168bd9a6e2 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:29.578079 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-13db11c9-e983-44cf-bc2c-7a168bd9a6e2 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] [instance: 2182737b-f69a-44aa-a3ea-bbabae8ad737] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:29.585030 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=7,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:38:29.588705 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-13db11c9-e983-44cf-bc2c-7a168bd9a6e2 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:29.589585 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-13db11c9-e983-44cf-bc2c-7a168bd9a6e2 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:29.591152 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-13db11c9-e983-44cf-bc2c-7a168bd9a6e2 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:29.592087 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-13db11c9-e983-44cf-bc2c-7a168bd9a6e2 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:29.592747 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-13db11c9-e983-44cf-bc2c-7a168bd9a6e2 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:29.593913 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-13db11c9-e983-44cf-bc2c-7a168bd9a6e2 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:29.626218 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-5cbd930f-2fe0-46bf-827e-e628b40d0391 tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11149c46e1bc468f836fe70635dbf33b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e0d8329b2c4d64bf51d88948ca0de2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:29.635634 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-5cbd930f-2fe0-46bf-827e-e628b40d0391 tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] 10.222.0.33 "GET /compute/v2.1/servers/5ac07e56-084c-4208-a988-13ec91af9171" status: 200 len: 1484 microversion: 2.1 time: 0.315428 Oct 04 20:38:29.650373 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 652/1267] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:38:29 2022] GET /compute/v2.1/servers/5ac07e56-084c-4208-a988-13ec91af9171 => generated 1484 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:38:29.650373 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-4f2ddf09-e6a8-4659-9c53-86b75e2f72d9 tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:29.650373 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-4f2ddf09-e6a8-4659-9c53-86b75e2f72d9 tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] [instance: 8a72de6a-64a0-4ec7-a613-576f8ac02af3] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:29.651532 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4f2ddf09-e6a8-4659-9c53-86b75e2f72d9 tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:29.652158 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4f2ddf09-e6a8-4659-9c53-86b75e2f72d9 tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:29.652864 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4f2ddf09-e6a8-4659-9c53-86b75e2f72d9 tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:29.653664 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4f2ddf09-e6a8-4659-9c53-86b75e2f72d9 tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:29.654556 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4f2ddf09-e6a8-4659-9c53-86b75e2f72d9 tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:29.655225 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4f2ddf09-e6a8-4659-9c53-86b75e2f72d9 tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:29.959345 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-13db11c9-e983-44cf-bc2c-7a168bd9a6e2 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36f4114dc4f443f8b48da7b4027e0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a23a85365414f92bbc03177d7f190e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:29.976520 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-4f2ddf09-e6a8-4659-9c53-86b75e2f72d9 tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/8a72de6a-64a0-4ec7-a613-576f8ac02af3" status: 200 len: 1644 microversion: 2.1 time: 0.338643 Oct 04 20:38:29.979265 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 653/1268] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:38:29 2022] GET /compute/v2.1/servers/8a72de6a-64a0-4ec7-a613-576f8ac02af3 => generated 1644 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:38:29.990845 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-13db11c9-e983-44cf-bc2c-7a168bd9a6e2 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] 10.222.0.33 "GET /compute/v2.1/servers/2182737b-f69a-44aa-a3ea-bbabae8ad737" status: 200 len: 1319 microversion: 2.1 time: 0.420388 Oct 04 20:38:29.995555 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 616/1269] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:38:29 2022] GET /compute/v2.1/servers/2182737b-f69a-44aa-a3ea-bbabae8ad737 => generated 1319 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:38:29.996231 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-b79e8470-f09f-4879-9fa2-4a734343e4a7 tempest-MigrationsAdminTest-1312330847 tempest-MigrationsAdminTest-1312330847-project-admin] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:29.996864 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-b79e8470-f09f-4879-9fa2-4a734343e4a7 tempest-MigrationsAdminTest-1312330847 tempest-MigrationsAdminTest-1312330847-project-admin] [instance: 23da26ba-68f4-4aef-b13c-0b6588a65e43] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:30.010210 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-3f1f35df-f6f2-4643-908d-df39dbc2b01a tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:30.011108 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-3f1f35df-f6f2-4643-908d-df39dbc2b01a tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] [instance: acecffb2-4128-4bd7-8bc3-7529881b64ed] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:30.011552 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b79e8470-f09f-4879-9fa2-4a734343e4a7 tempest-MigrationsAdminTest-1312330847 tempest-MigrationsAdminTest-1312330847-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:30.012061 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b79e8470-f09f-4879-9fa2-4a734343e4a7 tempest-MigrationsAdminTest-1312330847 tempest-MigrationsAdminTest-1312330847-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:30.012506 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b79e8470-f09f-4879-9fa2-4a734343e4a7 tempest-MigrationsAdminTest-1312330847 tempest-MigrationsAdminTest-1312330847-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:30.013238 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b79e8470-f09f-4879-9fa2-4a734343e4a7 tempest-MigrationsAdminTest-1312330847 tempest-MigrationsAdminTest-1312330847-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:30.013688 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b79e8470-f09f-4879-9fa2-4a734343e4a7 tempest-MigrationsAdminTest-1312330847 tempest-MigrationsAdminTest-1312330847-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:30.014113 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b79e8470-f09f-4879-9fa2-4a734343e4a7 tempest-MigrationsAdminTest-1312330847 tempest-MigrationsAdminTest-1312330847-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:30.029829 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3f1f35df-f6f2-4643-908d-df39dbc2b01a tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:30.030522 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3f1f35df-f6f2-4643-908d-df39dbc2b01a tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:30.032303 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3f1f35df-f6f2-4643-908d-df39dbc2b01a tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:30.034297 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3f1f35df-f6f2-4643-908d-df39dbc2b01a tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:30.044015 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3f1f35df-f6f2-4643-908d-df39dbc2b01a tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:30.044525 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3f1f35df-f6f2-4643-908d-df39dbc2b01a tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:30.607908 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-b79e8470-f09f-4879-9fa2-4a734343e4a7 tempest-MigrationsAdminTest-1312330847 tempest-MigrationsAdminTest-1312330847-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/23da26ba-68f4-4aef-b13c-0b6588a65e43" status: 200 len: 1614 microversion: 2.1 time: 0.627352 Oct 04 20:38:30.623665 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 654/1270] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:38:29 2022] GET /compute/v2.1/servers/23da26ba-68f4-4aef-b13c-0b6588a65e43 => generated 1614 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:38:30.634441 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-3af5791d-e5e0-4b34-93c5-4f9b1d3eb4bd tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:30.635395 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-3af5791d-e5e0-4b34-93c5-4f9b1d3eb4bd tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] [instance: 5e984459-625e-44cd-b226-091276567215] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:30.644737 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3af5791d-e5e0-4b34-93c5-4f9b1d3eb4bd tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:30.645478 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3af5791d-e5e0-4b34-93c5-4f9b1d3eb4bd tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:30.667176 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-3f1f35df-f6f2-4643-908d-df39dbc2b01a tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d46a7cdc204e808eabedbad9c5aea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '870c8d858eb44228acd9bbe345a1143c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:30.667786 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3af5791d-e5e0-4b34-93c5-4f9b1d3eb4bd tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:30.670054 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3af5791d-e5e0-4b34-93c5-4f9b1d3eb4bd tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:30.672068 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3af5791d-e5e0-4b34-93c5-4f9b1d3eb4bd tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:30.672718 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3af5791d-e5e0-4b34-93c5-4f9b1d3eb4bd tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:30.676778 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-3f1f35df-f6f2-4643-908d-df39dbc2b01a tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] 10.222.0.33 "GET /compute/v2.1/servers/acecffb2-4128-4bd7-8bc3-7529881b64ed" status: 200 len: 1316 microversion: 2.1 time: 0.677742 Oct 04 20:38:30.689212 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=100 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:38:30.692063 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 617/1271] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:38:29 2022] GET /compute/v2.1/servers/acecffb2-4128-4bd7-8bc3-7529881b64ed => generated 1316 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:38:30.705912 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-e734d758-c99d-4120-8aa5-be8794786404 req-169f6b66-4d09-437f-8b45-cf257eef13f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "acecffb2-4128-4bd7-8bc3-7529881b64ed", "tag": "db43bc12-c09e-49c1-a9c7-99d45670ecf7"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:38:30.718114 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-e734d758-c99d-4120-8aa5-be8794786404 req-169f6b66-4d09-437f-8b45-cf257eef13f9 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:30.719388 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-e734d758-c99d-4120-8aa5-be8794786404 req-169f6b66-4d09-437f-8b45-cf257eef13f9 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:30.720029 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-e734d758-c99d-4120-8aa5-be8794786404 req-169f6b66-4d09-437f-8b45-cf257eef13f9 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:30.735109 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-e734d758-c99d-4120-8aa5-be8794786404 req-169f6b66-4d09-437f-8b45-cf257eef13f9 service nova] Creating event network-changed:db43bc12-c09e-49c1-a9c7-99d45670ecf7 for instance acecffb2-4128-4bd7-8bc3-7529881b64ed on n-h1-854823-8 Oct 04 20:38:30.740696 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-e734d758-c99d-4120-8aa5-be8794786404 req-169f6b66-4d09-437f-8b45-cf257eef13f9 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046813 Oct 04 20:38:30.742374 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 618/1272] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:38:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:38:30.749207 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e5d75cf7-b522-4a10-8332-bc63b7e21ba7 tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:30.755379 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e5d75cf7-b522-4a10-8332-bc63b7e21ba7 tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:30.756073 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e5d75cf7-b522-4a10-8332-bc63b7e21ba7 tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:30.756896 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e5d75cf7-b522-4a10-8332-bc63b7e21ba7 tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:30.758375 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e5d75cf7-b522-4a10-8332-bc63b7e21ba7 tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:30.758999 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e5d75cf7-b522-4a10-8332-bc63b7e21ba7 tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:30.759507 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e5d75cf7-b522-4a10-8332-bc63b7e21ba7 tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:30.789371 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e5d75cf7-b522-4a10-8332-bc63b7e21ba7 tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.044935 Oct 04 20:38:30.796790 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 619/1273] 10.222.0.33 () {58 vars in 1176 bytes} [Tue Oct 4 20:38:30 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:38:30.796790 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-930ecf47-1f61-4ae8-9bc6-cf27cfe181bb tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:30.796790 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-930ecf47-1f61-4ae8-9bc6-cf27cfe181bb tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] [instance: 81748c83-b703-4c68-899c-c575cc3340d2] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:30.804623 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-930ecf47-1f61-4ae8-9bc6-cf27cfe181bb tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:30.805216 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-930ecf47-1f61-4ae8-9bc6-cf27cfe181bb tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:30.805719 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-930ecf47-1f61-4ae8-9bc6-cf27cfe181bb tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:30.806523 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-930ecf47-1f61-4ae8-9bc6-cf27cfe181bb tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:30.807110 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-930ecf47-1f61-4ae8-9bc6-cf27cfe181bb tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:30.807639 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-930ecf47-1f61-4ae8-9bc6-cf27cfe181bb tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:30.868535 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.objects.instance [None req-3af5791d-e5e0-4b34-93c5-4f9b1d3eb4bd tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] Lazy-loading 'services' on Instance uuid 5e984459-625e-44cd-b226-091276567215 {{(pid=128802) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:38:30.887251 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-3af5791d-e5e0-4b34-93c5-4f9b1d3eb4bd tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/5e984459-625e-44cd-b226-091276567215" status: 200 len: 1935 microversion: 2.75 time: 0.262519 Oct 04 20:38:30.887829 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 655/1274] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:38:30 2022] GET /compute/v2.1/servers/5e984459-625e-44cd-b226-091276567215 => generated 1935 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:38:30.893393 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-387bad5a-8199-4cf2-b563-ef5ca13a10e1 req-3d58371e-c05f-483c-b34b-93116dca930f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ac07e56-084c-4208-a988-13ec91af9171", "tag": "110ce36c-aef7-4f87-ae06-e95d837c4b2b"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:38:30.898944 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-930ecf47-1f61-4ae8-9bc6-cf27cfe181bb tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:30.903049 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-387bad5a-8199-4cf2-b563-ef5ca13a10e1 req-3d58371e-c05f-483c-b34b-93116dca930f service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:30.903521 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-387bad5a-8199-4cf2-b563-ef5ca13a10e1 req-3d58371e-c05f-483c-b34b-93116dca930f service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:30.903948 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-387bad5a-8199-4cf2-b563-ef5ca13a10e1 req-3d58371e-c05f-483c-b34b-93116dca930f service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:30.912829 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-930ecf47-1f61-4ae8-9bc6-cf27cfe181bb tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:30.915020 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-930ecf47-1f61-4ae8-9bc6-cf27cfe181bb tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:30.916520 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-930ecf47-1f61-4ae8-9bc6-cf27cfe181bb tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] 10.222.0.33 "GET /compute/v2.1/servers/81748c83-b703-4c68-899c-c575cc3340d2" status: 200 len: 1280 microversion: 2.25 time: 0.124994 Oct 04 20:38:30.917154 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 620/1275] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:38:30 2022] GET /compute/v2.1/servers/81748c83-b703-4c68-899c-c575cc3340d2 => generated 1280 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:38:30.921850 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c6d456d0-f7c0-4c84-b289-327d88e034d2 tempest-MigrationsAdminTest-1312330847 tempest-MigrationsAdminTest-1312330847-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:38:30.922581 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c6d456d0-f7c0-4c84-b289-327d88e034d2 tempest-MigrationsAdminTest-1312330847 tempest-MigrationsAdminTest-1312330847-project-admin] [instance: 23da26ba-68f4-4aef-b13c-0b6588a65e43] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:30.930483 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-387bad5a-8199-4cf2-b563-ef5ca13a10e1 req-3d58371e-c05f-483c-b34b-93116dca930f service nova] Creating event network-changed:110ce36c-aef7-4f87-ae06-e95d837c4b2b for instance 5ac07e56-084c-4208-a988-13ec91af9171 on n-h1-854823-8 Oct 04 20:38:30.935804 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c6d456d0-f7c0-4c84-b289-327d88e034d2 tempest-MigrationsAdminTest-1312330847 tempest-MigrationsAdminTest-1312330847-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:30.937963 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c6d456d0-f7c0-4c84-b289-327d88e034d2 tempest-MigrationsAdminTest-1312330847 tempest-MigrationsAdminTest-1312330847-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:30.938545 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c6d456d0-f7c0-4c84-b289-327d88e034d2 tempest-MigrationsAdminTest-1312330847 tempest-MigrationsAdminTest-1312330847-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:30.939361 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c6d456d0-f7c0-4c84-b289-327d88e034d2 tempest-MigrationsAdminTest-1312330847 tempest-MigrationsAdminTest-1312330847-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:30.940080 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c6d456d0-f7c0-4c84-b289-327d88e034d2 tempest-MigrationsAdminTest-1312330847 tempest-MigrationsAdminTest-1312330847-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:30.940461 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c6d456d0-f7c0-4c84-b289-327d88e034d2 tempest-MigrationsAdminTest-1312330847 tempest-MigrationsAdminTest-1312330847-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:30.942749 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-387bad5a-8199-4cf2-b563-ef5ca13a10e1 req-3d58371e-c05f-483c-b34b-93116dca930f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052969 Oct 04 20:38:30.943632 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 656/1276] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:38:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:38:30.948990 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-cbb650c0-465a-4872-94a1-74f40cef4b18 tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:38:30.949696 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-cbb650c0-465a-4872-94a1-74f40cef4b18 tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] [instance: 8a72de6a-64a0-4ec7-a613-576f8ac02af3] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:30.961765 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cbb650c0-465a-4872-94a1-74f40cef4b18 tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:30.962747 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cbb650c0-465a-4872-94a1-74f40cef4b18 tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:30.963580 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cbb650c0-465a-4872-94a1-74f40cef4b18 tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:30.967998 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cbb650c0-465a-4872-94a1-74f40cef4b18 tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:30.969004 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cbb650c0-465a-4872-94a1-74f40cef4b18 tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:30.969621 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cbb650c0-465a-4872-94a1-74f40cef4b18 tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:30.975175 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c6d456d0-f7c0-4c84-b289-327d88e034d2 tempest-MigrationsAdminTest-1312330847 tempest-MigrationsAdminTest-1312330847-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'c99257ede776423ea801536531a3ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '469f672650854ebd85443dc8dffd96d5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:30.975775 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c6d456d0-f7c0-4c84-b289-327d88e034d2 tempest-MigrationsAdminTest-1312330847 tempest-MigrationsAdminTest-1312330847-project-admin] [instance: 23da26ba-68f4-4aef-b13c-0b6588a65e43] flavor_id is None. Assuming migration. {{(pid=128801) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 04 20:38:30.976221 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c6d456d0-f7c0-4c84-b289-327d88e034d2 tempest-MigrationsAdminTest-1312330847 tempest-MigrationsAdminTest-1312330847-project-admin] [instance: 23da26ba-68f4-4aef-b13c-0b6588a65e43] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=128801) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 04 20:38:31.063602 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-cbb650c0-465a-4872-94a1-74f40cef4b18 tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/8a72de6a-64a0-4ec7-a613-576f8ac02af3/action" status: 202 len: 0 microversion: 2.1 time: 0.118330 Oct 04 20:38:31.064569 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 657/1277] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 20:38:30 2022] POST /compute/v2.1/servers/8a72de6a-64a0-4ec7-a613-576f8ac02af3/action => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:38:31.072755 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-5faeccc6-6b30-41fc-89a3-d72a4aa7bf97 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:31.073552 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-5faeccc6-6b30-41fc-89a3-d72a4aa7bf97 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] [instance: 2182737b-f69a-44aa-a3ea-bbabae8ad737] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:31.080788 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5faeccc6-6b30-41fc-89a3-d72a4aa7bf97 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:31.081285 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5faeccc6-6b30-41fc-89a3-d72a4aa7bf97 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:31.082530 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5faeccc6-6b30-41fc-89a3-d72a4aa7bf97 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:31.083749 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5faeccc6-6b30-41fc-89a3-d72a4aa7bf97 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:31.084755 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5faeccc6-6b30-41fc-89a3-d72a4aa7bf97 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:31.085264 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5faeccc6-6b30-41fc-89a3-d72a4aa7bf97 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:31.262994 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-5faeccc6-6b30-41fc-89a3-d72a4aa7bf97 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36f4114dc4f443f8b48da7b4027e0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a23a85365414f92bbc03177d7f190e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:31.272132 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-5faeccc6-6b30-41fc-89a3-d72a4aa7bf97 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] 10.222.0.33 "GET /compute/v2.1/servers/2182737b-f69a-44aa-a3ea-bbabae8ad737" status: 200 len: 1319 microversion: 2.1 time: 0.206231 Oct 04 20:38:31.272711 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 658/1278] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:38:31 2022] GET /compute/v2.1/servers/2182737b-f69a-44aa-a3ea-bbabae8ad737 => generated 1319 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:38:31.279022 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-6657e71c-553e-469a-9556-fba24f84f99f tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:31.279826 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-6657e71c-553e-469a-9556-fba24f84f99f tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] [instance: 8a72de6a-64a0-4ec7-a613-576f8ac02af3] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:31.286595 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6657e71c-553e-469a-9556-fba24f84f99f tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:31.287385 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6657e71c-553e-469a-9556-fba24f84f99f tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:31.288025 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6657e71c-553e-469a-9556-fba24f84f99f tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:31.288902 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6657e71c-553e-469a-9556-fba24f84f99f tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:31.289524 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6657e71c-553e-469a-9556-fba24f84f99f tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:31.289950 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6657e71c-553e-469a-9556-fba24f84f99f tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:31.345368 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c6d456d0-f7c0-4c84-b289-327d88e034d2 tempest-MigrationsAdminTest-1312330847 tempest-MigrationsAdminTest-1312330847-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/23da26ba-68f4-4aef-b13c-0b6588a65e43/action" status: 202 len: 0 microversion: 2.1 time: 0.426827 Oct 04 20:38:31.346095 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 621/1279] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 20:38:30 2022] POST /compute/v2.1/servers/23da26ba-68f4-4aef-b13c-0b6588a65e43/action => generated 0 bytes in 428 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:38:31.355164 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-411d978b-bec0-4888-872c-e36cf4cdad70 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:31.355809 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-411d978b-bec0-4888-872c-e36cf4cdad70 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] [instance: 23da26ba-68f4-4aef-b13c-0b6588a65e43] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:31.362893 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-411d978b-bec0-4888-872c-e36cf4cdad70 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:31.363284 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-411d978b-bec0-4888-872c-e36cf4cdad70 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:31.363697 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-411d978b-bec0-4888-872c-e36cf4cdad70 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:31.364479 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-411d978b-bec0-4888-872c-e36cf4cdad70 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:31.365042 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-411d978b-bec0-4888-872c-e36cf4cdad70 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:31.365655 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-411d978b-bec0-4888-872c-e36cf4cdad70 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:31.371088 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:38:31.452073 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-6657e71c-553e-469a-9556-fba24f84f99f tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/8a72de6a-64a0-4ec7-a613-576f8ac02af3" status: 200 len: 1649 microversion: 2.1 time: 0.177977 Oct 04 20:38:31.452923 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 659/1280] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:38:31 2022] GET /compute/v2.1/servers/8a72de6a-64a0-4ec7-a613-576f8ac02af3 => generated 1649 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:38:31.579942 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-411d978b-bec0-4888-872c-e36cf4cdad70 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3563efe2b8c94931a2a46c4e14811b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3118a5d96843d3bede1ed94bd9717e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:31.589550 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-411d978b-bec0-4888-872c-e36cf4cdad70 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] 10.222.0.33 "GET /compute/v2.1/servers/23da26ba-68f4-4aef-b13c-0b6588a65e43" status: 200 len: 1472 microversion: 2.1 time: 0.238494 Oct 04 20:38:31.590127 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 622/1281] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:38:31 2022] GET /compute/v2.1/servers/23da26ba-68f4-4aef-b13c-0b6588a65e43 => generated 1472 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:38:31.708451 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-2a0330c5-0c3e-4b2e-bd4e-f5a994aae303 tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:31.709195 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-2a0330c5-0c3e-4b2e-bd4e-f5a994aae303 tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] [instance: acecffb2-4128-4bd7-8bc3-7529881b64ed] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:31.716294 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2a0330c5-0c3e-4b2e-bd4e-f5a994aae303 tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:31.716779 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2a0330c5-0c3e-4b2e-bd4e-f5a994aae303 tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:31.717214 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2a0330c5-0c3e-4b2e-bd4e-f5a994aae303 tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:31.717915 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2a0330c5-0c3e-4b2e-bd4e-f5a994aae303 tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:31.718386 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2a0330c5-0c3e-4b2e-bd4e-f5a994aae303 tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:31.718965 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2a0330c5-0c3e-4b2e-bd4e-f5a994aae303 tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:31.857333 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-2a0330c5-0c3e-4b2e-bd4e-f5a994aae303 tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d46a7cdc204e808eabedbad9c5aea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '870c8d858eb44228acd9bbe345a1143c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:31.866780 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-2a0330c5-0c3e-4b2e-bd4e-f5a994aae303 tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] 10.222.0.33 "GET /compute/v2.1/servers/acecffb2-4128-4bd7-8bc3-7529881b64ed" status: 200 len: 1316 microversion: 2.1 time: 0.165246 Oct 04 20:38:31.871981 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 660/1282] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:38:31 2022] GET /compute/v2.1/servers/acecffb2-4128-4bd7-8bc3-7529881b64ed => generated 1316 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:38:31.920713 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-208963c8-5b61-47a9-a98a-323185920d0c tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:31.921408 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-208963c8-5b61-47a9-a98a-323185920d0c tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] [instance: 5e984459-625e-44cd-b226-091276567215] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:31.932154 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-208963c8-5b61-47a9-a98a-323185920d0c tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:31.932645 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-208963c8-5b61-47a9-a98a-323185920d0c tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:31.933361 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-208963c8-5b61-47a9-a98a-323185920d0c tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:31.934729 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-208963c8-5b61-47a9-a98a-323185920d0c tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:31.935412 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-208963c8-5b61-47a9-a98a-323185920d0c tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:31.936143 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-208963c8-5b61-47a9-a98a-323185920d0c tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:31.942302 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-52df246f-13b6-4104-9014-2d962a626b80 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:31.943166 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-52df246f-13b6-4104-9014-2d962a626b80 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] [instance: 81748c83-b703-4c68-899c-c575cc3340d2] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:31.950106 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-52df246f-13b6-4104-9014-2d962a626b80 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:31.952635 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-52df246f-13b6-4104-9014-2d962a626b80 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:31.954976 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-52df246f-13b6-4104-9014-2d962a626b80 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:31.956966 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-52df246f-13b6-4104-9014-2d962a626b80 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:31.959257 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-52df246f-13b6-4104-9014-2d962a626b80 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:31.960457 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-52df246f-13b6-4104-9014-2d962a626b80 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:32.065520 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-208963c8-5b61-47a9-a98a-323185920d0c tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] Lazy-loading 'services' on Instance uuid 5e984459-625e-44cd-b226-091276567215 {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:38:32.099268 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-52df246f-13b6-4104-9014-2d962a626b80 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:32.111953 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-208963c8-5b61-47a9-a98a-323185920d0c tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/5e984459-625e-44cd-b226-091276567215" status: 200 len: 1935 microversion: 2.75 time: 0.197208 Oct 04 20:38:32.120835 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-52df246f-13b6-4104-9014-2d962a626b80 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:32.125596 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-52df246f-13b6-4104-9014-2d962a626b80 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:32.126260 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 623/1283] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:38:31 2022] GET /compute/v2.1/servers/5e984459-625e-44cd-b226-091276567215 => generated 1935 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:38:32.131029 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-52df246f-13b6-4104-9014-2d962a626b80 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] 10.222.0.33 "GET /compute/v2.1/servers/81748c83-b703-4c68-899c-c575cc3340d2" status: 200 len: 1336 microversion: 2.25 time: 0.192763 Oct 04 20:38:32.136099 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-dee6c1f3-9bfd-434d-a406-a34921fe4b24 req-9587885f-b13b-45dd-8a74-9536148edfcf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96d890a0-a100-40a7-b795-6677eb966251", "name": "network-vif-plugged", "status": "completed", "tag": "469a4e48-dbb3-4d56-9055-2fc2f7f7ab62"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:38:32.137487 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 661/1284] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:38:31 2022] GET /compute/v2.1/servers/81748c83-b703-4c68-899c-c575cc3340d2 => generated 1336 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 20:38:32.167514 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-dee6c1f3-9bfd-434d-a406-a34921fe4b24 req-9587885f-b13b-45dd-8a74-9536148edfcf service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:32.168326 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-dee6c1f3-9bfd-434d-a406-a34921fe4b24 req-9587885f-b13b-45dd-8a74-9536148edfcf service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:32.169365 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-dee6c1f3-9bfd-434d-a406-a34921fe4b24 req-9587885f-b13b-45dd-8a74-9536148edfcf service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:32.182669 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-dee6c1f3-9bfd-434d-a406-a34921fe4b24 req-9587885f-b13b-45dd-8a74-9536148edfcf service nova] Creating event network-vif-plugged:469a4e48-dbb3-4d56-9055-2fc2f7f7ab62 for instance 96d890a0-a100-40a7-b795-6677eb966251 on n-h2-854823-8 Oct 04 20:38:32.188686 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-dee6c1f3-9bfd-434d-a406-a34921fe4b24 req-9587885f-b13b-45dd-8a74-9536148edfcf service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060801 Oct 04 20:38:32.189881 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 624/1285] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:38:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:38:32.296986 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-4d9b7573-7926-4a19-8792-b01f53415dda tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:32.297956 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-4d9b7573-7926-4a19-8792-b01f53415dda tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] [instance: 2182737b-f69a-44aa-a3ea-bbabae8ad737] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:32.307091 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4d9b7573-7926-4a19-8792-b01f53415dda tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:32.307922 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4d9b7573-7926-4a19-8792-b01f53415dda tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:32.308683 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4d9b7573-7926-4a19-8792-b01f53415dda tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:32.309614 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4d9b7573-7926-4a19-8792-b01f53415dda tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:32.310427 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4d9b7573-7926-4a19-8792-b01f53415dda tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:32.311048 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4d9b7573-7926-4a19-8792-b01f53415dda tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:32.478717 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8c0b887e-288f-4c07-a486-2ca8d0ae25f2 tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:32.479418 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-8c0b887e-288f-4c07-a486-2ca8d0ae25f2 tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] [instance: 8a72de6a-64a0-4ec7-a613-576f8ac02af3] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:32.486021 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8c0b887e-288f-4c07-a486-2ca8d0ae25f2 tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:32.486555 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8c0b887e-288f-4c07-a486-2ca8d0ae25f2 tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:32.487002 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8c0b887e-288f-4c07-a486-2ca8d0ae25f2 tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:32.487703 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8c0b887e-288f-4c07-a486-2ca8d0ae25f2 tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:32.488851 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8c0b887e-288f-4c07-a486-2ca8d0ae25f2 tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:32.489583 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8c0b887e-288f-4c07-a486-2ca8d0ae25f2 tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:32.676170 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-4d9b7573-7926-4a19-8792-b01f53415dda tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36f4114dc4f443f8b48da7b4027e0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a23a85365414f92bbc03177d7f190e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:32.683986 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-4d9b7573-7926-4a19-8792-b01f53415dda tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] 10.222.0.33 "GET /compute/v2.1/servers/2182737b-f69a-44aa-a3ea-bbabae8ad737" status: 200 len: 1319 microversion: 2.1 time: 0.391013 Oct 04 20:38:32.699479 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 662/1286] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:38:32 2022] GET /compute/v2.1/servers/2182737b-f69a-44aa-a3ea-bbabae8ad737 => generated 1319 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:38:32.714316 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-556df33c-4f1f-46bc-a157-d791c11e0eb2 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:32.715867 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-556df33c-4f1f-46bc-a157-d791c11e0eb2 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] [instance: 23da26ba-68f4-4aef-b13c-0b6588a65e43] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:32.726994 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-556df33c-4f1f-46bc-a157-d791c11e0eb2 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:32.731722 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-556df33c-4f1f-46bc-a157-d791c11e0eb2 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:32.735267 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-556df33c-4f1f-46bc-a157-d791c11e0eb2 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:32.736901 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-556df33c-4f1f-46bc-a157-d791c11e0eb2 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:32.738680 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-556df33c-4f1f-46bc-a157-d791c11e0eb2 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:32.740518 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-556df33c-4f1f-46bc-a157-d791c11e0eb2 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:33.588965 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-556df33c-4f1f-46bc-a157-d791c11e0eb2 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3563efe2b8c94931a2a46c4e14811b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3118a5d96843d3bede1ed94bd9717e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:33.597405 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-8c0b887e-288f-4c07-a486-2ca8d0ae25f2 tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/8a72de6a-64a0-4ec7-a613-576f8ac02af3" status: 200 len: 1629 microversion: 2.1 time: 1.123087 Oct 04 20:38:33.597966 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-556df33c-4f1f-46bc-a157-d791c11e0eb2 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] 10.222.0.33 "GET /compute/v2.1/servers/23da26ba-68f4-4aef-b13c-0b6588a65e43" status: 200 len: 1472 microversion: 2.1 time: 0.897041 Oct 04 20:38:33.598688 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 663/1287] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:38:32 2022] GET /compute/v2.1/servers/23da26ba-68f4-4aef-b13c-0b6588a65e43 => generated 1472 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:38:33.611824 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-0d4e171e-5a07-4d64-b53a-9d8e2afa64f3 tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:33.613419 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-0d4e171e-5a07-4d64-b53a-9d8e2afa64f3 tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] [instance: acecffb2-4128-4bd7-8bc3-7529881b64ed] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:33.620798 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0d4e171e-5a07-4d64-b53a-9d8e2afa64f3 tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:33.620953 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 625/1288] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:38:32 2022] GET /compute/v2.1/servers/8a72de6a-64a0-4ec7-a613-576f8ac02af3 => generated 1629 bytes in 1148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:38:33.621390 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0d4e171e-5a07-4d64-b53a-9d8e2afa64f3 tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:33.621911 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0d4e171e-5a07-4d64-b53a-9d8e2afa64f3 tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:33.622880 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0d4e171e-5a07-4d64-b53a-9d8e2afa64f3 tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:33.623791 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0d4e171e-5a07-4d64-b53a-9d8e2afa64f3 tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:33.624559 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0d4e171e-5a07-4d64-b53a-9d8e2afa64f3 tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:33.625585 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d4b9424b-4796-4f4b-a855-0ed33a278a57 tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:33.626197 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d4b9424b-4796-4f4b-a855-0ed33a278a57 tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] [instance: 5e984459-625e-44cd-b226-091276567215] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:33.664976 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d4b9424b-4796-4f4b-a855-0ed33a278a57 tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:33.665485 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d4b9424b-4796-4f4b-a855-0ed33a278a57 tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:33.665999 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d4b9424b-4796-4f4b-a855-0ed33a278a57 tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:33.666814 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d4b9424b-4796-4f4b-a855-0ed33a278a57 tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:33.673163 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d4b9424b-4796-4f4b-a855-0ed33a278a57 tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:33.674082 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d4b9424b-4796-4f4b-a855-0ed33a278a57 tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:33.890034 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-d4b9424b-4796-4f4b-a855-0ed33a278a57 tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] Lazy-loading 'services' on Instance uuid 5e984459-625e-44cd-b226-091276567215 {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:38:33.916286 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d4b9424b-4796-4f4b-a855-0ed33a278a57 tempest-ServersAdmin275Test-698087732 tempest-ServersAdmin275Test-698087732-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/5e984459-625e-44cd-b226-091276567215" status: 200 len: 1920 microversion: 2.75 time: 0.293870 Oct 04 20:38:33.917389 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 626/1289] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:38:33 2022] GET /compute/v2.1/servers/5e984459-625e-44cd-b226-091276567215 => generated 1920 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:38:33.922831 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a95fdaab-c8d0-42bb-aec5-d20eea35fd3a tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:33.924102 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a95fdaab-c8d0-42bb-aec5-d20eea35fd3a tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] [instance: 81748c83-b703-4c68-899c-c575cc3340d2] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:33.933674 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a95fdaab-c8d0-42bb-aec5-d20eea35fd3a tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:33.934512 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a95fdaab-c8d0-42bb-aec5-d20eea35fd3a tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:33.935209 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a95fdaab-c8d0-42bb-aec5-d20eea35fd3a tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:33.936140 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a95fdaab-c8d0-42bb-aec5-d20eea35fd3a tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:33.936871 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a95fdaab-c8d0-42bb-aec5-d20eea35fd3a tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:33.938110 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a95fdaab-c8d0-42bb-aec5-d20eea35fd3a tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:34.098931 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-a95fdaab-c8d0-42bb-aec5-d20eea35fd3a tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:34.114755 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-a95fdaab-c8d0-42bb-aec5-d20eea35fd3a tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:34.117025 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-a95fdaab-c8d0-42bb-aec5-d20eea35fd3a tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:34.118838 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a95fdaab-c8d0-42bb-aec5-d20eea35fd3a tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] 10.222.0.33 "GET /compute/v2.1/servers/81748c83-b703-4c68-899c-c575cc3340d2" status: 200 len: 1336 microversion: 2.25 time: 0.199698 Oct 04 20:38:34.119975 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 627/1290] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:38:33 2022] GET /compute/v2.1/servers/81748c83-b703-4c68-899c-c575cc3340d2 => generated 1336 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:38:34.125164 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-53280271-46d7-4cc5-92c6-adce2e35e81f tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-854823-8", "block_migration": true, "disk_over_commit": false}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:38:34.129352 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-53280271-46d7-4cc5-92c6-adce2e35e81f tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] [instance: 8a72de6a-64a0-4ec7-a613-576f8ac02af3] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:34.139821 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-53280271-46d7-4cc5-92c6-adce2e35e81f tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:34.140603 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-53280271-46d7-4cc5-92c6-adce2e35e81f tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:34.142116 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-53280271-46d7-4cc5-92c6-adce2e35e81f tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:34.144053 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-53280271-46d7-4cc5-92c6-adce2e35e81f tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:34.145179 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-53280271-46d7-4cc5-92c6-adce2e35e81f tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:34.148403 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-53280271-46d7-4cc5-92c6-adce2e35e81f tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:34.167958 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-0d4e171e-5a07-4d64-b53a-9d8e2afa64f3 tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d46a7cdc204e808eabedbad9c5aea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '870c8d858eb44228acd9bbe345a1143c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:34.177561 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-0d4e171e-5a07-4d64-b53a-9d8e2afa64f3 tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] 10.222.0.33 "GET /compute/v2.1/servers/acecffb2-4128-4bd7-8bc3-7529881b64ed" status: 200 len: 1316 microversion: 2.1 time: 0.570439 Oct 04 20:38:34.184325 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 664/1291] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:38:33 2022] GET /compute/v2.1/servers/acecffb2-4128-4bd7-8bc3-7529881b64ed => generated 1316 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:38:34.184927 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-53280271-46d7-4cc5-92c6-adce2e35e81f tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] Lazy-loading 'flavor' on Instance uuid 8a72de6a-64a0-4ec7-a613-576f8ac02af3 {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:38:34.195638 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-ab97c30a-ad4a-495d-bf7f-49c38407b4af tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:34.196241 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-ab97c30a-ad4a-495d-bf7f-49c38407b4af tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] [instance: 2182737b-f69a-44aa-a3ea-bbabae8ad737] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:34.205925 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-53280271-46d7-4cc5-92c6-adce2e35e81f tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] [instance: 8a72de6a-64a0-4ec7-a613-576f8ac02af3] Going to try to live migrate instance to n-h2-854823-8 {{(pid=128801) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 04 20:38:34.222988 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ab97c30a-ad4a-495d-bf7f-49c38407b4af tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:34.223497 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ab97c30a-ad4a-495d-bf7f-49c38407b4af tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:34.223933 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ab97c30a-ad4a-495d-bf7f-49c38407b4af tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:34.224650 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ab97c30a-ad4a-495d-bf7f-49c38407b4af tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:34.225108 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ab97c30a-ad4a-495d-bf7f-49c38407b4af tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:34.225524 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ab97c30a-ad4a-495d-bf7f-49c38407b4af tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:34.521082 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-ab97c30a-ad4a-495d-bf7f-49c38407b4af tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36f4114dc4f443f8b48da7b4027e0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a23a85365414f92bbc03177d7f190e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:34.529760 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-ab97c30a-ad4a-495d-bf7f-49c38407b4af tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] 10.222.0.33 "GET /compute/v2.1/servers/2182737b-f69a-44aa-a3ea-bbabae8ad737" status: 200 len: 1319 microversion: 2.1 time: 0.344232 Oct 04 20:38:34.530401 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 665/1292] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:38:34 2022] GET /compute/v2.1/servers/2182737b-f69a-44aa-a3ea-bbabae8ad737 => generated 1319 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:38:34.545002 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-26d693fa-1d82-4786-b7eb-15467d9ed5a2 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:34.547394 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-26d693fa-1d82-4786-b7eb-15467d9ed5a2 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] [instance: 5e984459-625e-44cd-b226-091276567215] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:34.556114 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-26d693fa-1d82-4786-b7eb-15467d9ed5a2 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:34.556608 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-26d693fa-1d82-4786-b7eb-15467d9ed5a2 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:34.557253 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-26d693fa-1d82-4786-b7eb-15467d9ed5a2 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:34.557960 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-26d693fa-1d82-4786-b7eb-15467d9ed5a2 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:34.558739 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-26d693fa-1d82-4786-b7eb-15467d9ed5a2 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:34.559328 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-26d693fa-1d82-4786-b7eb-15467d9ed5a2 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:34.596684 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-26d693fa-1d82-4786-b7eb-15467d9ed5a2 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] [instance: 5e984459-625e-44cd-b226-091276567215] Going to try to terminate instance {{(pid=128802) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:38:34.696461 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-26d693fa-1d82-4786-b7eb-15467d9ed5a2 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] 10.222.0.33 "DELETE /compute/v2.1/servers/5e984459-625e-44cd-b226-091276567215" status: 204 len: 0 microversion: 2.75 time: 0.163727 Oct 04 20:38:34.706266 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 666/1293] 10.222.0.33 () {60 vars in 1280 bytes} [Tue Oct 4 20:38:34 2022] DELETE /compute/v2.1/servers/5e984459-625e-44cd-b226-091276567215 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 20:38:34.706266 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-dc8868ff-a589-4492-b6ff-46a58e86bd2e tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:34.706266 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-dc8868ff-a589-4492-b6ff-46a58e86bd2e tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] [instance: 23da26ba-68f4-4aef-b13c-0b6588a65e43] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:34.714405 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dc8868ff-a589-4492-b6ff-46a58e86bd2e tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:34.714916 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dc8868ff-a589-4492-b6ff-46a58e86bd2e tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:34.715353 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dc8868ff-a589-4492-b6ff-46a58e86bd2e tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:34.716061 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dc8868ff-a589-4492-b6ff-46a58e86bd2e tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:34.716516 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dc8868ff-a589-4492-b6ff-46a58e86bd2e tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:34.716955 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dc8868ff-a589-4492-b6ff-46a58e86bd2e tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:34.980555 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-dc8868ff-a589-4492-b6ff-46a58e86bd2e tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3563efe2b8c94931a2a46c4e14811b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3118a5d96843d3bede1ed94bd9717e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:34.989977 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-dc8868ff-a589-4492-b6ff-46a58e86bd2e tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] 10.222.0.33 "GET /compute/v2.1/servers/23da26ba-68f4-4aef-b13c-0b6588a65e43" status: 200 len: 1472 microversion: 2.1 time: 0.290944 Oct 04 20:38:35.000258 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 667/1294] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:38:34 2022] GET /compute/v2.1/servers/23da26ba-68f4-4aef-b13c-0b6588a65e43 => generated 1472 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:38:35.011988 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-f707a12b-869c-4ffc-8e83-982e3a957aba tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:35.012824 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-f707a12b-869c-4ffc-8e83-982e3a957aba tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] [instance: 5e984459-625e-44cd-b226-091276567215] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:35.018889 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f707a12b-869c-4ffc-8e83-982e3a957aba tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:35.020069 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f707a12b-869c-4ffc-8e83-982e3a957aba tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:35.020510 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f707a12b-869c-4ffc-8e83-982e3a957aba tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:35.021234 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f707a12b-869c-4ffc-8e83-982e3a957aba tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:35.021682 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f707a12b-869c-4ffc-8e83-982e3a957aba tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:35.022112 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f707a12b-869c-4ffc-8e83-982e3a957aba tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:35.091406 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-f707a12b-869c-4ffc-8e83-982e3a957aba tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22706a9bf4d42efb57c10cbd92c6eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0024f434015447759489d3cdc7bbaa4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:35.100430 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-f707a12b-869c-4ffc-8e83-982e3a957aba tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a22706a9bf4d42efb57c10cbd92c6eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0024f434015447759489d3cdc7bbaa4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:35.101820 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-f707a12b-869c-4ffc-8e83-982e3a957aba tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a22706a9bf4d42efb57c10cbd92c6eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0024f434015447759489d3cdc7bbaa4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:35.106956 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-f707a12b-869c-4ffc-8e83-982e3a957aba tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] 10.222.0.33 "GET /compute/v2.1/servers/5e984459-625e-44cd-b226-091276567215" status: 200 len: 1444 microversion: 2.75 time: 0.104410 Oct 04 20:38:35.113610 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 668/1295] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:38:35 2022] GET /compute/v2.1/servers/5e984459-625e-44cd-b226-091276567215 => generated 1444 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:38:35.119647 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-a4ee8b5b-9736-4fd1-9dec-5b7e73c1c885 tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:35.120529 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-a4ee8b5b-9736-4fd1-9dec-5b7e73c1c885 tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] [instance: 7d9db253-559a-4d4b-9a5e-42c8f63f6cb7] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:35.128552 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a4ee8b5b-9736-4fd1-9dec-5b7e73c1c885 tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:35.129313 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a4ee8b5b-9736-4fd1-9dec-5b7e73c1c885 tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:35.130230 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a4ee8b5b-9736-4fd1-9dec-5b7e73c1c885 tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:35.131157 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a4ee8b5b-9736-4fd1-9dec-5b7e73c1c885 tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:35.131773 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a4ee8b5b-9736-4fd1-9dec-5b7e73c1c885 tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:35.132359 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a4ee8b5b-9736-4fd1-9dec-5b7e73c1c885 tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:35.154625 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.wsgi [None req-a4ee8b5b-9736-4fd1-9dec-5b7e73c1c885 tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] HTTP exception thrown: Instance 7d9db253-559a-4d4b-9a5e-42c8f63f6cb7 could not be found. Oct 04 20:38:35.156564 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-a4ee8b5b-9736-4fd1-9dec-5b7e73c1c885 tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Request method failure captured: Oct 04 20:38:35.156564 n-d-854823-8 devstack@n-api.service[128802]: request: DELETE /compute/v2.1/servers/7d9db253-559a-4d4b-9a5e-42c8f63f6cb7 HTTP/1.1 Oct 04 20:38:35.156564 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 20:38:35.156564 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 20:38:35.156564 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 20:38:35.156564 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 0 Oct 04 20:38:35.156564 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 20:38:35.156564 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 20:38:35.156564 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 20:38:35.156564 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 20:38:35.156564 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPJkTaVBQBbcSle_BCOIe5JQ0hXNW-JZmgLYS5Uzb1Vl-dpbiKAwgncy1QvWBjG4xX1gR8DTcJfEyhZ3cuMJJ02qNbZDDoK1jHHyD8OeNgHQBppdwBIWDrPA6RRKL5KTJurSBBxnQwIatFQa5M8XqO1G1nXB3isB8veCUZH9-SpK_Q8U Oct 04 20:38:35.156564 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 20:38:35.156564 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 20:38:35.156564 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 20:38:35.156564 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 20:38:35.156564 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 20:38:35.156564 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 20:38:35.156564 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: e8cc219b86ed450cbe7c780d7f79d9f8 Oct 04 20:38:35.156564 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-837025504 Oct 04 20:38:35.156564 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 20:38:35.156564 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 20:38:35.156564 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_e8cc219b86ed450cbe7c780d7f79d9f8", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e8cc219b86ed450cbe7c780d7f79d9f8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e8cc219b86ed450cbe7c780d7f79d9f8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/e8cc219b86ed450cbe7c780d7f79d9f8"}]}] Oct 04 20:38:35.156564 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-837025504 Oct 04 20:38:35.156564 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: e8cc219b86ed450cbe7c780d7f79d9f8 Oct 04 20:38:35.156564 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-837025504 Oct 04 20:38:35.156564 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-AttachSCSIVolumeTestJSON-837025504-project Oct 04 20:38:35.156564 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 20:38:35.156564 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 20:38:35.156564 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: b786966441fc45f28890bf56cdfafb3f Oct 04 20:38:35.156564 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-837025504-project Oct 04 20:38:35.156564 n-d-854823-8 devstack@n-api.service[128802]: method: > Oct 04 20:38:35.156564 n-d-854823-8 devstack@n-api.service[128802]: exception: Instance 7d9db253-559a-4d4b-9a5e-42c8f63f6cb7 could not be found. Oct 04 20:38:35.156564 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'id': '7d9db253-559a-4d4b-9a5e-42c8f63f6cb7'} Oct 04 20:38:35.156564 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:38:35.156564 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:38:35.156564 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:38:35.156564 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:38:35.156564 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:38:35.156564 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:38:35.156564 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:38:35.156564 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:38:35.156564 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:38:35.156564 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:38:35.156564 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d9db253-559a-4d4b-9a5e-42c8f63f6cb7 could not be found. Oct 04 20:38:35.156564 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:38:35.156564 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:38:35.156564 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:38:35.156564 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:38:35.156564 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:38:35.156564 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:38:35.156564 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:38:35.156564 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:38:35.156564 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:38:35.156564 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:38:35.156564 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 20:38:35.156564 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 20:38:35.156564 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 20:38:35.156564 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 20:38:35.156564 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:38:35.156564 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:38:35.156564 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:38:35.156564 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:38:35.161971 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d9db253-559a-4d4b-9a5e-42c8f63f6cb7 could not be found. Oct 04 20:38:35.161971 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:38:35.161971 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:38:35.161971 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:38:35.161971 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:38:35.161971 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:38:35.161971 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:38:35.161971 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:38:35.161971 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:38:35.161971 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d9db253-559a-4d4b-9a5e-42c8f63f6cb7 could not be found. Oct 04 20:38:35.161971 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:38:35.165927 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-a4ee8b5b-9736-4fd1-9dec-5b7e73c1c885 tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Returning 404 to user: Instance 7d9db253-559a-4d4b-9a5e-42c8f63f6cb7 could not be found. {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:38:35.167030 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-a4ee8b5b-9736-4fd1-9dec-5b7e73c1c885 tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] 10.222.0.33 "DELETE /compute/v2.1/servers/7d9db253-559a-4d4b-9a5e-42c8f63f6cb7" status: 404 len: 111 microversion: 2.1 time: 0.052192 Oct 04 20:38:35.169861 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 669/1296] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 20:38:35 2022] DELETE /compute/v2.1/servers/7d9db253-559a-4d4b-9a5e-42c8f63f6cb7 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:38:35.179377 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-180543a4-5011-4f3e-931f-711fe520ed1d tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:35.186592 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-180543a4-5011-4f3e-931f-711fe520ed1d tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] [instance: 81748c83-b703-4c68-899c-c575cc3340d2] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:35.209887 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-180543a4-5011-4f3e-931f-711fe520ed1d tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:35.211281 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-180543a4-5011-4f3e-931f-711fe520ed1d tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:35.212149 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-180543a4-5011-4f3e-931f-711fe520ed1d tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:35.215173 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-180543a4-5011-4f3e-931f-711fe520ed1d tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:35.215882 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-180543a4-5011-4f3e-931f-711fe520ed1d tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:35.217452 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-180543a4-5011-4f3e-931f-711fe520ed1d tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:35.230137 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:38:35.401379 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-180543a4-5011-4f3e-931f-711fe520ed1d tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:35.410921 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-180543a4-5011-4f3e-931f-711fe520ed1d tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:35.412828 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-180543a4-5011-4f3e-931f-711fe520ed1d tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:35.414292 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-180543a4-5011-4f3e-931f-711fe520ed1d tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] 10.222.0.33 "GET /compute/v2.1/servers/81748c83-b703-4c68-899c-c575cc3340d2" status: 200 len: 1354 microversion: 2.25 time: 0.242762 Oct 04 20:38:35.415109 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 670/1297] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:38:35 2022] GET /compute/v2.1/servers/81748c83-b703-4c68-899c-c575cc3340d2 => generated 1354 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:38:35.420704 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-53d2edcc-7078-43d0-a226-2bcddae7bdb3 tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:35.421630 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-53d2edcc-7078-43d0-a226-2bcddae7bdb3 tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] [instance: 7d9db253-559a-4d4b-9a5e-42c8f63f6cb7] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:35.429374 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-53d2edcc-7078-43d0-a226-2bcddae7bdb3 tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:35.430163 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-53d2edcc-7078-43d0-a226-2bcddae7bdb3 tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:35.430851 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-53d2edcc-7078-43d0-a226-2bcddae7bdb3 tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:35.431845 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-53d2edcc-7078-43d0-a226-2bcddae7bdb3 tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:35.432393 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-53d2edcc-7078-43d0-a226-2bcddae7bdb3 tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:35.433048 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-53d2edcc-7078-43d0-a226-2bcddae7bdb3 tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:35.449916 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.wsgi [None req-53d2edcc-7078-43d0-a226-2bcddae7bdb3 tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] HTTP exception thrown: Instance 7d9db253-559a-4d4b-9a5e-42c8f63f6cb7 could not be found. Oct 04 20:38:35.451606 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-53d2edcc-7078-43d0-a226-2bcddae7bdb3 tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Request method failure captured: Oct 04 20:38:35.451606 n-d-854823-8 devstack@n-api.service[128802]: request: GET /compute/v2.1/servers/7d9db253-559a-4d4b-9a5e-42c8f63f6cb7 HTTP/1.1 Oct 04 20:38:35.451606 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 20:38:35.451606 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 20:38:35.451606 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 20:38:35.451606 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 0 Oct 04 20:38:35.451606 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 20:38:35.451606 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 20:38:35.451606 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 20:38:35.451606 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 20:38:35.451606 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPJkTaVBQBbcSle_BCOIe5JQ0hXNW-JZmgLYS5Uzb1Vl-dpbiKAwgncy1QvWBjG4xX1gR8DTcJfEyhZ3cuMJJ02qNbZDDoK1jHHyD8OeNgHQBppdwBIWDrPA6RRKL5KTJurSBBxnQwIatFQa5M8XqO1G1nXB3isB8veCUZH9-SpK_Q8U Oct 04 20:38:35.451606 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 20:38:35.451606 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 20:38:35.451606 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 20:38:35.451606 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 20:38:35.451606 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 20:38:35.451606 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 20:38:35.451606 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: e8cc219b86ed450cbe7c780d7f79d9f8 Oct 04 20:38:35.451606 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-837025504 Oct 04 20:38:35.451606 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 20:38:35.451606 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 20:38:35.451606 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_e8cc219b86ed450cbe7c780d7f79d9f8", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e8cc219b86ed450cbe7c780d7f79d9f8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e8cc219b86ed450cbe7c780d7f79d9f8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/e8cc219b86ed450cbe7c780d7f79d9f8"}]}] Oct 04 20:38:35.451606 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-837025504 Oct 04 20:38:35.451606 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: e8cc219b86ed450cbe7c780d7f79d9f8 Oct 04 20:38:35.451606 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-837025504 Oct 04 20:38:35.451606 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-AttachSCSIVolumeTestJSON-837025504-project Oct 04 20:38:35.451606 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 20:38:35.451606 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 20:38:35.451606 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: b786966441fc45f28890bf56cdfafb3f Oct 04 20:38:35.451606 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-837025504-project Oct 04 20:38:35.451606 n-d-854823-8 devstack@n-api.service[128802]: method: > Oct 04 20:38:35.451606 n-d-854823-8 devstack@n-api.service[128802]: exception: Instance 7d9db253-559a-4d4b-9a5e-42c8f63f6cb7 could not be found. Oct 04 20:38:35.451606 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'id': '7d9db253-559a-4d4b-9a5e-42c8f63f6cb7'} Oct 04 20:38:35.451606 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:38:35.451606 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:38:35.451606 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:38:35.451606 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:38:35.451606 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:38:35.451606 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:38:35.451606 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:38:35.451606 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:38:35.451606 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:38:35.451606 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:38:35.451606 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d9db253-559a-4d4b-9a5e-42c8f63f6cb7 could not be found. Oct 04 20:38:35.451606 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:38:35.451606 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:38:35.451606 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:38:35.451606 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:38:35.451606 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:38:35.451606 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:38:35.451606 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:38:35.451606 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:38:35.451606 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:38:35.451606 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:38:35.451606 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:38:35.451606 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:38:35.451606 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:38:35.451606 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:38:35.451606 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:38:35.451606 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:38:35.451606 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d9db253-559a-4d4b-9a5e-42c8f63f6cb7 could not be found. Oct 04 20:38:35.451606 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:38:35.451606 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:38:35.451606 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:38:35.457254 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:38:35.457254 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:38:35.457254 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:38:35.457254 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:38:35.457254 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:38:35.457254 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d9db253-559a-4d4b-9a5e-42c8f63f6cb7 could not be found. Oct 04 20:38:35.457254 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:38:35.457254 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-53d2edcc-7078-43d0-a226-2bcddae7bdb3 tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] Returning 404 to user: Instance 7d9db253-559a-4d4b-9a5e-42c8f63f6cb7 could not be found. {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:38:35.458567 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-53d2edcc-7078-43d0-a226-2bcddae7bdb3 tempest-AttachSCSIVolumeTestJSON-837025504 tempest-AttachSCSIVolumeTestJSON-837025504-project] 10.222.0.33 "GET /compute/v2.1/servers/7d9db253-559a-4d4b-9a5e-42c8f63f6cb7" status: 404 len: 111 microversion: 2.1 time: 0.041795 Oct 04 20:38:35.459532 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 671/1298] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:38:35 2022] GET /compute/v2.1/servers/7d9db253-559a-4d4b-9a5e-42c8f63f6cb7 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:38:35.464889 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-63db87b5-40c6-4ad5-b3be-bde31f558cfc tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:35.465666 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-63db87b5-40c6-4ad5-b3be-bde31f558cfc tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] [instance: acecffb2-4128-4bd7-8bc3-7529881b64ed] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:35.476128 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-63db87b5-40c6-4ad5-b3be-bde31f558cfc tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:35.476873 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-63db87b5-40c6-4ad5-b3be-bde31f558cfc tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:35.477488 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-63db87b5-40c6-4ad5-b3be-bde31f558cfc tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:35.478386 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-63db87b5-40c6-4ad5-b3be-bde31f558cfc tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:35.479142 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-63db87b5-40c6-4ad5-b3be-bde31f558cfc tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:35.480137 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-63db87b5-40c6-4ad5-b3be-bde31f558cfc tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:35.848675 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-63db87b5-40c6-4ad5-b3be-bde31f558cfc tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d46a7cdc204e808eabedbad9c5aea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '870c8d858eb44228acd9bbe345a1143c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:35.861966 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-63db87b5-40c6-4ad5-b3be-bde31f558cfc tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] 10.222.0.33 "GET /compute/v2.1/servers/acecffb2-4128-4bd7-8bc3-7529881b64ed" status: 200 len: 1316 microversion: 2.1 time: 0.397553 Oct 04 20:38:35.862949 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 672/1299] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:38:35 2022] GET /compute/v2.1/servers/acecffb2-4128-4bd7-8bc3-7529881b64ed => generated 1316 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:38:35.873383 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-f3843449-3493-4a98-adc3-9588cab92a01 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:35.873997 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-f3843449-3493-4a98-adc3-9588cab92a01 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] [instance: 2182737b-f69a-44aa-a3ea-bbabae8ad737] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:35.889381 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f3843449-3493-4a98-adc3-9588cab92a01 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:35.889868 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f3843449-3493-4a98-adc3-9588cab92a01 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:35.896547 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f3843449-3493-4a98-adc3-9588cab92a01 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:35.897518 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f3843449-3493-4a98-adc3-9588cab92a01 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:35.897934 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f3843449-3493-4a98-adc3-9588cab92a01 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:35.898612 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f3843449-3493-4a98-adc3-9588cab92a01 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:36.555415 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-f3843449-3493-4a98-adc3-9588cab92a01 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36f4114dc4f443f8b48da7b4027e0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a23a85365414f92bbc03177d7f190e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:36.565111 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-f3843449-3493-4a98-adc3-9588cab92a01 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] 10.222.0.33 "GET /compute/v2.1/servers/2182737b-f69a-44aa-a3ea-bbabae8ad737" status: 200 len: 1319 microversion: 2.1 time: 0.700653 Oct 04 20:38:36.566739 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 673/1300] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:38:35 2022] GET /compute/v2.1/servers/2182737b-f69a-44aa-a3ea-bbabae8ad737 => generated 1319 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:38:36.576527 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-3d044fdb-da20-4c9b-8404-af17069d904f req-0bfd329a-7207-479b-af5e-b026cbc4321a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "acecffb2-4128-4bd7-8bc3-7529881b64ed", "name": "network-vif-plugged", "status": "completed", "tag": "db43bc12-c09e-49c1-a9c7-99d45670ecf7"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:38:36.589866 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-3d044fdb-da20-4c9b-8404-af17069d904f req-0bfd329a-7207-479b-af5e-b026cbc4321a service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:36.590494 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-3d044fdb-da20-4c9b-8404-af17069d904f req-0bfd329a-7207-479b-af5e-b026cbc4321a service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:36.591259 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-3d044fdb-da20-4c9b-8404-af17069d904f req-0bfd329a-7207-479b-af5e-b026cbc4321a service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:36.604553 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-3d044fdb-da20-4c9b-8404-af17069d904f req-0bfd329a-7207-479b-af5e-b026cbc4321a service nova] Creating event network-vif-plugged:db43bc12-c09e-49c1-a9c7-99d45670ecf7 for instance acecffb2-4128-4bd7-8bc3-7529881b64ed on n-h1-854823-8 Oct 04 20:38:36.610305 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-3d044fdb-da20-4c9b-8404-af17069d904f req-0bfd329a-7207-479b-af5e-b026cbc4321a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042122 Oct 04 20:38:36.611330 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 674/1301] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:38:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:38:36.617203 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-957b9a1e-b720-456a-ab65-cda1d204c040 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:36.617904 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-957b9a1e-b720-456a-ab65-cda1d204c040 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] [instance: 23da26ba-68f4-4aef-b13c-0b6588a65e43] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:36.624015 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-957b9a1e-b720-456a-ab65-cda1d204c040 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:36.625424 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-957b9a1e-b720-456a-ab65-cda1d204c040 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:36.626228 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-957b9a1e-b720-456a-ab65-cda1d204c040 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:36.626985 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-957b9a1e-b720-456a-ab65-cda1d204c040 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:36.627447 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-957b9a1e-b720-456a-ab65-cda1d204c040 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:36.627878 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-957b9a1e-b720-456a-ab65-cda1d204c040 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:36.912354 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-957b9a1e-b720-456a-ab65-cda1d204c040 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3563efe2b8c94931a2a46c4e14811b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3118a5d96843d3bede1ed94bd9717e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:36.923058 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-957b9a1e-b720-456a-ab65-cda1d204c040 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] 10.222.0.33 "GET /compute/v2.1/servers/23da26ba-68f4-4aef-b13c-0b6588a65e43" status: 200 len: 1472 microversion: 2.1 time: 0.310489 Oct 04 20:38:36.944427 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 675/1302] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:38:36 2022] GET /compute/v2.1/servers/23da26ba-68f4-4aef-b13c-0b6588a65e43 => generated 1472 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:38:36.953746 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-85edfa12-165f-4e46-83f3-74803093c677 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:36.954603 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-85edfa12-165f-4e46-83f3-74803093c677 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] [instance: 5e984459-625e-44cd-b226-091276567215] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:36.961650 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-85edfa12-165f-4e46-83f3-74803093c677 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:36.962544 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-85edfa12-165f-4e46-83f3-74803093c677 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:36.963730 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-85edfa12-165f-4e46-83f3-74803093c677 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:36.964533 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-85edfa12-165f-4e46-83f3-74803093c677 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:36.965076 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-85edfa12-165f-4e46-83f3-74803093c677 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:36.966569 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-85edfa12-165f-4e46-83f3-74803093c677 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:37.008185 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-53280271-46d7-4cc5-92c6-adce2e35e81f tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/8a72de6a-64a0-4ec7-a613-576f8ac02af3/action" status: 202 len: 0 microversion: 2.1 time: 2.886846 Oct 04 20:38:37.013071 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 628/1303] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 20:38:34 2022] POST /compute/v2.1/servers/8a72de6a-64a0-4ec7-a613-576f8ac02af3/action => generated 0 bytes in 2892 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:38:37.026335 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-df9473e9-8f57-4fd9-b130-a042a19831a1 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:37.026995 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-df9473e9-8f57-4fd9-b130-a042a19831a1 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] [instance: 81748c83-b703-4c68-899c-c575cc3340d2] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:37.044754 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-df9473e9-8f57-4fd9-b130-a042a19831a1 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:37.047739 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-df9473e9-8f57-4fd9-b130-a042a19831a1 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:37.048208 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-df9473e9-8f57-4fd9-b130-a042a19831a1 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:37.052906 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-df9473e9-8f57-4fd9-b130-a042a19831a1 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:37.053817 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-df9473e9-8f57-4fd9-b130-a042a19831a1 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:37.054286 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-df9473e9-8f57-4fd9-b130-a042a19831a1 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:37.079336 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-85edfa12-165f-4e46-83f3-74803093c677 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22706a9bf4d42efb57c10cbd92c6eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0024f434015447759489d3cdc7bbaa4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:37.092847 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-85edfa12-165f-4e46-83f3-74803093c677 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a22706a9bf4d42efb57c10cbd92c6eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0024f434015447759489d3cdc7bbaa4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:37.096966 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-85edfa12-165f-4e46-83f3-74803093c677 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a22706a9bf4d42efb57c10cbd92c6eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0024f434015447759489d3cdc7bbaa4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:37.114074 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-85edfa12-165f-4e46-83f3-74803093c677 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] 10.222.0.33 "GET /compute/v2.1/servers/5e984459-625e-44cd-b226-091276567215" status: 200 len: 1444 microversion: 2.75 time: 0.166476 Oct 04 20:38:37.115219 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 676/1304] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:38:36 2022] GET /compute/v2.1/servers/5e984459-625e-44cd-b226-091276567215 => generated 1444 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:38:37.122025 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-fe34b0ab-e23d-41e9-bda4-6b6057efe4fb tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:37.122753 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-fe34b0ab-e23d-41e9-bda4-6b6057efe4fb tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] [instance: acecffb2-4128-4bd7-8bc3-7529881b64ed] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:37.147580 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fe34b0ab-e23d-41e9-bda4-6b6057efe4fb tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:37.148310 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fe34b0ab-e23d-41e9-bda4-6b6057efe4fb tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:37.149119 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fe34b0ab-e23d-41e9-bda4-6b6057efe4fb tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:37.150609 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fe34b0ab-e23d-41e9-bda4-6b6057efe4fb tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:37.151481 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fe34b0ab-e23d-41e9-bda4-6b6057efe4fb tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:37.152179 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fe34b0ab-e23d-41e9-bda4-6b6057efe4fb tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:37.502739 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-df9473e9-8f57-4fd9-b130-a042a19831a1 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:37.514853 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-df9473e9-8f57-4fd9-b130-a042a19831a1 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:37.516454 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-df9473e9-8f57-4fd9-b130-a042a19831a1 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:37.518596 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-df9473e9-8f57-4fd9-b130-a042a19831a1 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] 10.222.0.33 "GET /compute/v2.1/servers/81748c83-b703-4c68-899c-c575cc3340d2" status: 200 len: 1409 microversion: 2.25 time: 0.501325 Oct 04 20:38:37.533741 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 629/1305] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:38:37 2022] GET /compute/v2.1/servers/81748c83-b703-4c68-899c-c575cc3340d2 => generated 1409 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:38:37.533741 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-87d414da-dd7d-44d9-87b8-2075d4b1fef7 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:37.533741 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-87d414da-dd7d-44d9-87b8-2075d4b1fef7 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] [instance: 8a72de6a-64a0-4ec7-a613-576f8ac02af3] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:37.533741 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-87d414da-dd7d-44d9-87b8-2075d4b1fef7 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:37.533741 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-87d414da-dd7d-44d9-87b8-2075d4b1fef7 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:37.533741 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-87d414da-dd7d-44d9-87b8-2075d4b1fef7 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:37.533741 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-87d414da-dd7d-44d9-87b8-2075d4b1fef7 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:37.534749 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-87d414da-dd7d-44d9-87b8-2075d4b1fef7 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:37.534749 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-87d414da-dd7d-44d9-87b8-2075d4b1fef7 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:37.552874 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-fe34b0ab-e23d-41e9-bda4-6b6057efe4fb tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d46a7cdc204e808eabedbad9c5aea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '870c8d858eb44228acd9bbe345a1143c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:37.564301 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-fe34b0ab-e23d-41e9-bda4-6b6057efe4fb tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] 10.222.0.33 "GET /compute/v2.1/servers/acecffb2-4128-4bd7-8bc3-7529881b64ed" status: 200 len: 1316 microversion: 2.1 time: 0.447095 Oct 04 20:38:37.566594 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 677/1306] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:38:37 2022] GET /compute/v2.1/servers/acecffb2-4128-4bd7-8bc3-7529881b64ed => generated 1316 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:38:37.589277 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-7c518f86-5527-4f47-b273-a8b080827bad tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:37.589888 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-7c518f86-5527-4f47-b273-a8b080827bad tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] [instance: 2182737b-f69a-44aa-a3ea-bbabae8ad737] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:37.593382 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:38:37.598466 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7c518f86-5527-4f47-b273-a8b080827bad tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:37.598995 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7c518f86-5527-4f47-b273-a8b080827bad tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:37.599437 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7c518f86-5527-4f47-b273-a8b080827bad tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:37.600465 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7c518f86-5527-4f47-b273-a8b080827bad tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:37.600994 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7c518f86-5527-4f47-b273-a8b080827bad tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:37.601916 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7c518f86-5527-4f47-b273-a8b080827bad tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:38.271836 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-87d414da-dd7d-44d9-87b8-2075d4b1fef7 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '800db3a57ada47eca381b00189fdbf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66ec8ea91b04deb90b679589e0495bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:38.282704 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-87d414da-dd7d-44d9-87b8-2075d4b1fef7 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] 10.222.0.33 "GET /compute/v2.1/servers/8a72de6a-64a0-4ec7-a613-576f8ac02af3" status: 200 len: 1503 microversion: 2.1 time: 0.761253 Oct 04 20:38:38.284007 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 630/1307] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:38:37 2022] GET /compute/v2.1/servers/8a72de6a-64a0-4ec7-a613-576f8ac02af3 => generated 1503 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:38:38.290452 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-994e0df8-3c09-4174-bda7-06a94f9834e5 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:38.291283 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-994e0df8-3c09-4174-bda7-06a94f9834e5 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] [instance: 23da26ba-68f4-4aef-b13c-0b6588a65e43] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:38.298895 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-994e0df8-3c09-4174-bda7-06a94f9834e5 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:38.300062 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-994e0df8-3c09-4174-bda7-06a94f9834e5 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:38.300977 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-994e0df8-3c09-4174-bda7-06a94f9834e5 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:38.302142 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-994e0df8-3c09-4174-bda7-06a94f9834e5 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:38.302982 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-994e0df8-3c09-4174-bda7-06a94f9834e5 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:38.303611 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-994e0df8-3c09-4174-bda7-06a94f9834e5 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:38.430512 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=60 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:38:38.530478 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-7c518f86-5527-4f47-b273-a8b080827bad tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36f4114dc4f443f8b48da7b4027e0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a23a85365414f92bbc03177d7f190e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:38.552328 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-7c518f86-5527-4f47-b273-a8b080827bad tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] 10.222.0.33 "GET /compute/v2.1/servers/2182737b-f69a-44aa-a3ea-bbabae8ad737" status: 200 len: 1319 microversion: 2.1 time: 0.967250 Oct 04 20:38:38.553677 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 678/1308] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:38:37 2022] GET /compute/v2.1/servers/2182737b-f69a-44aa-a3ea-bbabae8ad737 => generated 1319 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:38:38.561910 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-e5e5f347-13ac-4c0a-b239-fade9873257e req-363f2464-b413-4f69-b505-464a840480bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81748c83-b703-4c68-899c-c575cc3340d2", "tag": "c2865aee-fb0f-4bf6-91f8-8215288d29f5"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:38:38.572902 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-e5e5f347-13ac-4c0a-b239-fade9873257e req-363f2464-b413-4f69-b505-464a840480bb service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:38.574312 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-e5e5f347-13ac-4c0a-b239-fade9873257e req-363f2464-b413-4f69-b505-464a840480bb service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:38.575024 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-e5e5f347-13ac-4c0a-b239-fade9873257e req-363f2464-b413-4f69-b505-464a840480bb service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:38.593592 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-e5e5f347-13ac-4c0a-b239-fade9873257e req-363f2464-b413-4f69-b505-464a840480bb service nova] Creating event network-changed:c2865aee-fb0f-4bf6-91f8-8215288d29f5 for instance 81748c83-b703-4c68-899c-c575cc3340d2 on n-h2-854823-8 Oct 04 20:38:38.600796 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-e5e5f347-13ac-4c0a-b239-fade9873257e req-363f2464-b413-4f69-b505-464a840480bb service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044473 Oct 04 20:38:38.602106 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 679/1309] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:38:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:38:38.609201 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-f5b34b8e-8d70-463f-a09d-0f7a8f94f5a8 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:38.610429 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-f5b34b8e-8d70-463f-a09d-0f7a8f94f5a8 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] [instance: 5e984459-625e-44cd-b226-091276567215] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:38.618137 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f5b34b8e-8d70-463f-a09d-0f7a8f94f5a8 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:38.618675 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f5b34b8e-8d70-463f-a09d-0f7a8f94f5a8 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:38.619113 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f5b34b8e-8d70-463f-a09d-0f7a8f94f5a8 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:38.619913 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f5b34b8e-8d70-463f-a09d-0f7a8f94f5a8 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:38.620374 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f5b34b8e-8d70-463f-a09d-0f7a8f94f5a8 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:38.620840 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f5b34b8e-8d70-463f-a09d-0f7a8f94f5a8 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:38.662950 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f5b34b8e-8d70-463f-a09d-0f7a8f94f5a8 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:38.663388 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f5b34b8e-8d70-463f-a09d-0f7a8f94f5a8 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:38.663879 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f5b34b8e-8d70-463f-a09d-0f7a8f94f5a8 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:38.664330 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.objects.instance [None req-f5b34b8e-8d70-463f-a09d-0f7a8f94f5a8 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Lazy-loading 'fault' on Instance uuid 5e984459-625e-44cd-b226-091276567215 {{(pid=128802) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:38:38.756411 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-f5b34b8e-8d70-463f-a09d-0f7a8f94f5a8 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22706a9bf4d42efb57c10cbd92c6eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0024f434015447759489d3cdc7bbaa4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:38.764729 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-f5b34b8e-8d70-463f-a09d-0f7a8f94f5a8 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a22706a9bf4d42efb57c10cbd92c6eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0024f434015447759489d3cdc7bbaa4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:38.766460 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-f5b34b8e-8d70-463f-a09d-0f7a8f94f5a8 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a22706a9bf4d42efb57c10cbd92c6eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0024f434015447759489d3cdc7bbaa4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:38.772772 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-f5b34b8e-8d70-463f-a09d-0f7a8f94f5a8 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] 10.222.0.33 "GET /compute/v2.1/servers/5e984459-625e-44cd-b226-091276567215" status: 200 len: 1449 microversion: 2.75 time: 0.169108 Oct 04 20:38:38.773266 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 680/1310] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:38:38 2022] GET /compute/v2.1/servers/5e984459-625e-44cd-b226-091276567215 => generated 1449 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:38:38.778242 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-e40a08b8-c0c7-49d8-9c95-4f34525c01fc tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:38.778863 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-e40a08b8-c0c7-49d8-9c95-4f34525c01fc tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] [instance: 81748c83-b703-4c68-899c-c575cc3340d2] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:38.785967 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e40a08b8-c0c7-49d8-9c95-4f34525c01fc tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:38.786482 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e40a08b8-c0c7-49d8-9c95-4f34525c01fc tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:38.786973 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e40a08b8-c0c7-49d8-9c95-4f34525c01fc tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:38.787660 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e40a08b8-c0c7-49d8-9c95-4f34525c01fc tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:38.788115 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e40a08b8-c0c7-49d8-9c95-4f34525c01fc tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:38.788662 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e40a08b8-c0c7-49d8-9c95-4f34525c01fc tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:38.880555 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-994e0df8-3c09-4174-bda7-06a94f9834e5 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3563efe2b8c94931a2a46c4e14811b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3118a5d96843d3bede1ed94bd9717e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:38.889458 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-994e0df8-3c09-4174-bda7-06a94f9834e5 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] 10.222.0.33 "GET /compute/v2.1/servers/23da26ba-68f4-4aef-b13c-0b6588a65e43" status: 200 len: 1472 microversion: 2.1 time: 0.603278 Oct 04 20:38:38.890101 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 631/1311] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:38:38 2022] GET /compute/v2.1/servers/23da26ba-68f4-4aef-b13c-0b6588a65e43 => generated 1472 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:38:38.894996 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6fc20ba3-73ef-492e-985f-2370a1f9aa14 tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:38.895609 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-6fc20ba3-73ef-492e-985f-2370a1f9aa14 tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] [instance: acecffb2-4128-4bd7-8bc3-7529881b64ed] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:38.905609 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6fc20ba3-73ef-492e-985f-2370a1f9aa14 tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:38.906146 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6fc20ba3-73ef-492e-985f-2370a1f9aa14 tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:38.906626 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6fc20ba3-73ef-492e-985f-2370a1f9aa14 tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:38.907656 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6fc20ba3-73ef-492e-985f-2370a1f9aa14 tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:38.908166 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6fc20ba3-73ef-492e-985f-2370a1f9aa14 tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:38.908592 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6fc20ba3-73ef-492e-985f-2370a1f9aa14 tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:39.163744 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-e40a08b8-c0c7-49d8-9c95-4f34525c01fc tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:39.172653 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-e40a08b8-c0c7-49d8-9c95-4f34525c01fc tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:39.174083 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-e40a08b8-c0c7-49d8-9c95-4f34525c01fc tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:39.175866 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-e40a08b8-c0c7-49d8-9c95-4f34525c01fc tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] 10.222.0.33 "GET /compute/v2.1/servers/81748c83-b703-4c68-899c-c575cc3340d2" status: 200 len: 1409 microversion: 2.25 time: 0.400881 Oct 04 20:38:39.176430 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 681/1312] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:38:38 2022] GET /compute/v2.1/servers/81748c83-b703-4c68-899c-c575cc3340d2 => generated 1409 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:38:39.180923 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-c4582962-ba2b-4053-83ba-465302bbb079 req-5eab3db4-05bd-4ce5-ae41-cf5cde65bf67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2182737b-f69a-44aa-a3ea-bbabae8ad737", "name": "network-vif-plugged", "status": "completed", "tag": "f7a4a879-9c9a-46e9-a921-58ebd3c70015"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:38:39.190125 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-c4582962-ba2b-4053-83ba-465302bbb079 req-5eab3db4-05bd-4ce5-ae41-cf5cde65bf67 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:39.190639 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-c4582962-ba2b-4053-83ba-465302bbb079 req-5eab3db4-05bd-4ce5-ae41-cf5cde65bf67 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:39.191327 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-c4582962-ba2b-4053-83ba-465302bbb079 req-5eab3db4-05bd-4ce5-ae41-cf5cde65bf67 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:39.203895 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-c4582962-ba2b-4053-83ba-465302bbb079 req-5eab3db4-05bd-4ce5-ae41-cf5cde65bf67 service nova] Creating event network-vif-plugged:f7a4a879-9c9a-46e9-a921-58ebd3c70015 for instance 2182737b-f69a-44aa-a3ea-bbabae8ad737 on n-h2-854823-8 Oct 04 20:38:39.209211 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-c4582962-ba2b-4053-83ba-465302bbb079 req-5eab3db4-05bd-4ce5-ae41-cf5cde65bf67 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031510 Oct 04 20:38:39.210140 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 682/1313] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:38:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:38:39.312881 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-702dd4fb-8696-4412-9e1b-9cfe1225b0cd tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:39.313212 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-702dd4fb-8696-4412-9e1b-9cfe1225b0cd tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] [instance: 8a72de6a-64a0-4ec7-a613-576f8ac02af3] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:39.318281 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-6fc20ba3-73ef-492e-985f-2370a1f9aa14 tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d46a7cdc204e808eabedbad9c5aea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '870c8d858eb44228acd9bbe345a1143c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:39.321393 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-702dd4fb-8696-4412-9e1b-9cfe1225b0cd tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:39.321997 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-702dd4fb-8696-4412-9e1b-9cfe1225b0cd tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:39.322960 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-702dd4fb-8696-4412-9e1b-9cfe1225b0cd tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:39.323699 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-702dd4fb-8696-4412-9e1b-9cfe1225b0cd tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:39.324684 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-702dd4fb-8696-4412-9e1b-9cfe1225b0cd tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:39.325118 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-702dd4fb-8696-4412-9e1b-9cfe1225b0cd tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:39.327053 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-6fc20ba3-73ef-492e-985f-2370a1f9aa14 tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] 10.222.0.33 "GET /compute/v2.1/servers/acecffb2-4128-4bd7-8bc3-7529881b64ed" status: 200 len: 1505 microversion: 2.1 time: 0.435934 Oct 04 20:38:39.344551 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 632/1314] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:38:38 2022] GET /compute/v2.1/servers/acecffb2-4128-4bd7-8bc3-7529881b64ed => generated 1505 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:38:39.351530 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8f623119-ad3e-4e85-b6b3-c720adeb02f5 tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:39.352065 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-8f623119-ad3e-4e85-b6b3-c720adeb02f5 tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] [instance: acecffb2-4128-4bd7-8bc3-7529881b64ed] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:39.358026 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8f623119-ad3e-4e85-b6b3-c720adeb02f5 tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:39.358542 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8f623119-ad3e-4e85-b6b3-c720adeb02f5 tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:39.359029 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8f623119-ad3e-4e85-b6b3-c720adeb02f5 tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:39.359729 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8f623119-ad3e-4e85-b6b3-c720adeb02f5 tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:39.360180 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8f623119-ad3e-4e85-b6b3-c720adeb02f5 tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:39.360678 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8f623119-ad3e-4e85-b6b3-c720adeb02f5 tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:39.393585 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-8f623119-ad3e-4e85-b6b3-c720adeb02f5 tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] Policy check for os_compute_api:os-instance-actions:events failed with credentials {'is_admin': False, 'user_id': '58d46a7cdc204e808eabedbad9c5aea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '870c8d858eb44228acd9bbe345a1143c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:39.395446 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-8f623119-ad3e-4e85-b6b3-c720adeb02f5 tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] 10.222.0.33 "GET /compute/v2.1/servers/acecffb2-4128-4bd7-8bc3-7529881b64ed/os-instance-actions/req-5eb3f8f2-88c9-4018-ae4a-aab5ec19b261" status: 200 len: 313 microversion: 2.1 time: 0.048698 Oct 04 20:38:39.396037 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 633/1315] 10.222.0.33 () {58 vars in 1419 bytes} [Tue Oct 4 20:38:39 2022] GET /compute/v2.1/servers/acecffb2-4128-4bd7-8bc3-7529881b64ed/os-instance-actions/req-5eb3f8f2-88c9-4018-ae4a-aab5ec19b261 => generated 313 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 20:38:39.409452 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-cb8d0dd1-9c4d-495d-9340-82a9590f39fc tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:38:39.411913 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-cb8d0dd1-9c4d-495d-9340-82a9590f39fc tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] [instance: acecffb2-4128-4bd7-8bc3-7529881b64ed] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:39.418043 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cb8d0dd1-9c4d-495d-9340-82a9590f39fc tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:39.418570 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cb8d0dd1-9c4d-495d-9340-82a9590f39fc tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:39.419003 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cb8d0dd1-9c4d-495d-9340-82a9590f39fc tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:39.419701 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cb8d0dd1-9c4d-495d-9340-82a9590f39fc tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:39.420159 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cb8d0dd1-9c4d-495d-9340-82a9590f39fc tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:39.420584 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cb8d0dd1-9c4d-495d-9340-82a9590f39fc tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:39.497724 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-cb8d0dd1-9c4d-495d-9340-82a9590f39fc tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] 10.222.0.33 "POST /compute/v2.1/servers/acecffb2-4128-4bd7-8bc3-7529881b64ed/action" status: 202 len: 0 microversion: 2.1 time: 0.091924 Oct 04 20:38:39.498773 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 634/1316] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 20:38:39 2022] POST /compute/v2.1/servers/acecffb2-4128-4bd7-8bc3-7529881b64ed/action => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:38:39.510894 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1041860d-565c-4649-989e-22e319148357 tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:39.511596 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-1041860d-565c-4649-989e-22e319148357 tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] [instance: acecffb2-4128-4bd7-8bc3-7529881b64ed] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:39.518774 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1041860d-565c-4649-989e-22e319148357 tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:39.519733 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1041860d-565c-4649-989e-22e319148357 tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:39.520167 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1041860d-565c-4649-989e-22e319148357 tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:39.520879 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1041860d-565c-4649-989e-22e319148357 tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:39.521343 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1041860d-565c-4649-989e-22e319148357 tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:39.522701 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1041860d-565c-4649-989e-22e319148357 tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:39.707370 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-702dd4fb-8696-4412-9e1b-9cfe1225b0cd tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '800db3a57ada47eca381b00189fdbf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66ec8ea91b04deb90b679589e0495bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:39.715476 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-702dd4fb-8696-4412-9e1b-9cfe1225b0cd tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] 10.222.0.33 "GET /compute/v2.1/servers/8a72de6a-64a0-4ec7-a613-576f8ac02af3" status: 200 len: 1503 microversion: 2.1 time: 0.407190 Oct 04 20:38:39.716043 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 683/1317] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:38:39 2022] GET /compute/v2.1/servers/8a72de6a-64a0-4ec7-a613-576f8ac02af3 => generated 1503 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:38:39.720452 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-85fbb1ab-8fd8-4b7e-87e5-1b08b8de7b5d tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:39.721044 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-85fbb1ab-8fd8-4b7e-87e5-1b08b8de7b5d tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] [instance: 2182737b-f69a-44aa-a3ea-bbabae8ad737] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:39.729337 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-85fbb1ab-8fd8-4b7e-87e5-1b08b8de7b5d tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:39.729843 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-85fbb1ab-8fd8-4b7e-87e5-1b08b8de7b5d tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:39.730248 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-85fbb1ab-8fd8-4b7e-87e5-1b08b8de7b5d tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:39.730975 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-85fbb1ab-8fd8-4b7e-87e5-1b08b8de7b5d tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:39.731447 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-85fbb1ab-8fd8-4b7e-87e5-1b08b8de7b5d tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:39.731825 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-85fbb1ab-8fd8-4b7e-87e5-1b08b8de7b5d tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:40.008036 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-1041860d-565c-4649-989e-22e319148357 tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d46a7cdc204e808eabedbad9c5aea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '870c8d858eb44228acd9bbe345a1143c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:40.012482 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:38:40.023157 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-1041860d-565c-4649-989e-22e319148357 tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] 10.222.0.33 "GET /compute/v2.1/servers/acecffb2-4128-4bd7-8bc3-7529881b64ed" status: 200 len: 1507 microversion: 2.1 time: 0.518121 Oct 04 20:38:40.024600 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 635/1318] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:38:39 2022] GET /compute/v2.1/servers/acecffb2-4128-4bd7-8bc3-7529881b64ed => generated 1507 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:38:40.030643 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b6af35ae-b49c-4f2f-b036-f5efb7b32624 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:40.036794 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b6af35ae-b49c-4f2f-b036-f5efb7b32624 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] [instance: 5e984459-625e-44cd-b226-091276567215] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:40.056683 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b6af35ae-b49c-4f2f-b036-f5efb7b32624 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:40.057971 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b6af35ae-b49c-4f2f-b036-f5efb7b32624 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:40.061391 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b6af35ae-b49c-4f2f-b036-f5efb7b32624 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:40.065170 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b6af35ae-b49c-4f2f-b036-f5efb7b32624 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:40.067753 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b6af35ae-b49c-4f2f-b036-f5efb7b32624 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:40.068441 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b6af35ae-b49c-4f2f-b036-f5efb7b32624 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:40.122600 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b6af35ae-b49c-4f2f-b036-f5efb7b32624 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:40.123935 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b6af35ae-b49c-4f2f-b036-f5efb7b32624 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:40.124785 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b6af35ae-b49c-4f2f-b036-f5efb7b32624 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:40.125785 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-b6af35ae-b49c-4f2f-b036-f5efb7b32624 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Lazy-loading 'fault' on Instance uuid 5e984459-625e-44cd-b226-091276567215 {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:38:40.284322 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-85fbb1ab-8fd8-4b7e-87e5-1b08b8de7b5d tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36f4114dc4f443f8b48da7b4027e0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a23a85365414f92bbc03177d7f190e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:40.293460 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-85fbb1ab-8fd8-4b7e-87e5-1b08b8de7b5d tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] 10.222.0.33 "GET /compute/v2.1/servers/2182737b-f69a-44aa-a3ea-bbabae8ad737" status: 200 len: 1319 microversion: 2.1 time: 0.576398 Oct 04 20:38:40.293620 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-b6af35ae-b49c-4f2f-b036-f5efb7b32624 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22706a9bf4d42efb57c10cbd92c6eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0024f434015447759489d3cdc7bbaa4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:40.306496 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-b6af35ae-b49c-4f2f-b036-f5efb7b32624 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a22706a9bf4d42efb57c10cbd92c6eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0024f434015447759489d3cdc7bbaa4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:40.307267 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 684/1319] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:38:39 2022] GET /compute/v2.1/servers/2182737b-f69a-44aa-a3ea-bbabae8ad737 => generated 1319 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:38:40.308910 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-b6af35ae-b49c-4f2f-b036-f5efb7b32624 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a22706a9bf4d42efb57c10cbd92c6eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0024f434015447759489d3cdc7bbaa4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:40.314846 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-06b7b8c5-7464-48b0-b076-11024ace2a82 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:40.315590 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-06b7b8c5-7464-48b0-b076-11024ace2a82 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] [instance: 23da26ba-68f4-4aef-b13c-0b6588a65e43] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:40.315990 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b6af35ae-b49c-4f2f-b036-f5efb7b32624 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] 10.222.0.33 "GET /compute/v2.1/servers/5e984459-625e-44cd-b226-091276567215" status: 200 len: 1449 microversion: 2.75 time: 0.289756 Oct 04 20:38:40.317616 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 636/1320] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:38:40 2022] GET /compute/v2.1/servers/5e984459-625e-44cd-b226-091276567215 => generated 1449 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:38:40.324679 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e8ced6c0-d43b-4f8c-a483-53235fe927f2 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:40.325835 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e8ced6c0-d43b-4f8c-a483-53235fe927f2 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] [instance: 81748c83-b703-4c68-899c-c575cc3340d2] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:40.336340 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-06b7b8c5-7464-48b0-b076-11024ace2a82 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:40.337649 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-06b7b8c5-7464-48b0-b076-11024ace2a82 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:40.338616 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-06b7b8c5-7464-48b0-b076-11024ace2a82 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:40.339532 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-06b7b8c5-7464-48b0-b076-11024ace2a82 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:40.340281 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-06b7b8c5-7464-48b0-b076-11024ace2a82 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:40.340918 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-06b7b8c5-7464-48b0-b076-11024ace2a82 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:40.341269 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e8ced6c0-d43b-4f8c-a483-53235fe927f2 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:40.341775 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e8ced6c0-d43b-4f8c-a483-53235fe927f2 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:40.342216 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e8ced6c0-d43b-4f8c-a483-53235fe927f2 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:40.342988 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e8ced6c0-d43b-4f8c-a483-53235fe927f2 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:40.343626 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e8ced6c0-d43b-4f8c-a483-53235fe927f2 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:40.344214 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e8ced6c0-d43b-4f8c-a483-53235fe927f2 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:40.768111 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=11 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:38:41.212600 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e8ced6c0-d43b-4f8c-a483-53235fe927f2 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:41.225209 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e8ced6c0-d43b-4f8c-a483-53235fe927f2 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:41.226955 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e8ced6c0-d43b-4f8c-a483-53235fe927f2 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:41.227593 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-06b7b8c5-7464-48b0-b076-11024ace2a82 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3563efe2b8c94931a2a46c4e14811b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3118a5d96843d3bede1ed94bd9717e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:41.228878 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e8ced6c0-d43b-4f8c-a483-53235fe927f2 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] 10.222.0.33 "GET /compute/v2.1/servers/81748c83-b703-4c68-899c-c575cc3340d2" status: 200 len: 1409 microversion: 2.25 time: 0.910171 Oct 04 20:38:41.239217 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-06b7b8c5-7464-48b0-b076-11024ace2a82 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] 10.222.0.33 "GET /compute/v2.1/servers/23da26ba-68f4-4aef-b13c-0b6588a65e43" status: 200 len: 1477 microversion: 2.1 time: 0.931026 Oct 04 20:38:41.242843 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 637/1321] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:38:40 2022] GET /compute/v2.1/servers/81748c83-b703-4c68-899c-c575cc3340d2 => generated 1409 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:38:41.248548 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 685/1322] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:38:40 2022] GET /compute/v2.1/servers/23da26ba-68f4-4aef-b13c-0b6588a65e43 => generated 1477 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:38:41.252368 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-dbcd6772-6fe2-475c-b39b-003ecc9cb3b2 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:41.253404 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-dbcd6772-6fe2-475c-b39b-003ecc9cb3b2 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] [instance: 8a72de6a-64a0-4ec7-a613-576f8ac02af3] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:41.255243 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-e73e730f-3efe-4e06-a1f2-d07a1e5be72f tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:41.255935 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-e73e730f-3efe-4e06-a1f2-d07a1e5be72f tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] [instance: acecffb2-4128-4bd7-8bc3-7529881b64ed] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:41.263559 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dbcd6772-6fe2-475c-b39b-003ecc9cb3b2 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:41.264052 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dbcd6772-6fe2-475c-b39b-003ecc9cb3b2 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:41.264484 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dbcd6772-6fe2-475c-b39b-003ecc9cb3b2 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:41.265187 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dbcd6772-6fe2-475c-b39b-003ecc9cb3b2 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:41.265644 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dbcd6772-6fe2-475c-b39b-003ecc9cb3b2 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:41.266066 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dbcd6772-6fe2-475c-b39b-003ecc9cb3b2 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:41.266889 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e73e730f-3efe-4e06-a1f2-d07a1e5be72f tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:41.268280 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e73e730f-3efe-4e06-a1f2-d07a1e5be72f tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:41.270768 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e73e730f-3efe-4e06-a1f2-d07a1e5be72f tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:41.271913 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e73e730f-3efe-4e06-a1f2-d07a1e5be72f tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:41.272899 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e73e730f-3efe-4e06-a1f2-d07a1e5be72f tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:41.273773 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e73e730f-3efe-4e06-a1f2-d07a1e5be72f tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:41.699453 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-e73e730f-3efe-4e06-a1f2-d07a1e5be72f tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d46a7cdc204e808eabedbad9c5aea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '870c8d858eb44228acd9bbe345a1143c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:41.708940 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-e73e730f-3efe-4e06-a1f2-d07a1e5be72f tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] 10.222.0.33 "GET /compute/v2.1/servers/acecffb2-4128-4bd7-8bc3-7529881b64ed" status: 200 len: 1507 microversion: 2.1 time: 0.459051 Oct 04 20:38:41.720078 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 686/1323] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:38:41 2022] GET /compute/v2.1/servers/acecffb2-4128-4bd7-8bc3-7529881b64ed => generated 1507 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:38:41.720078 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-ae9bc829-5e51-4d74-88e5-0133a9cc233a tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:41.720078 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-ae9bc829-5e51-4d74-88e5-0133a9cc233a tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] [instance: 2182737b-f69a-44aa-a3ea-bbabae8ad737] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:41.722583 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ae9bc829-5e51-4d74-88e5-0133a9cc233a tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:41.725091 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ae9bc829-5e51-4d74-88e5-0133a9cc233a tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:41.725091 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ae9bc829-5e51-4d74-88e5-0133a9cc233a tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:41.725091 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ae9bc829-5e51-4d74-88e5-0133a9cc233a tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:41.725091 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ae9bc829-5e51-4d74-88e5-0133a9cc233a tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:41.725091 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ae9bc829-5e51-4d74-88e5-0133a9cc233a tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:41.731927 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-dbcd6772-6fe2-475c-b39b-003ecc9cb3b2 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '800db3a57ada47eca381b00189fdbf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66ec8ea91b04deb90b679589e0495bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:41.744846 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-dbcd6772-6fe2-475c-b39b-003ecc9cb3b2 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] 10.222.0.33 "GET /compute/v2.1/servers/8a72de6a-64a0-4ec7-a613-576f8ac02af3" status: 200 len: 1503 microversion: 2.1 time: 0.500553 Oct 04 20:38:41.754451 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 638/1324] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:38:41 2022] GET /compute/v2.1/servers/8a72de6a-64a0-4ec7-a613-576f8ac02af3 => generated 1503 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:38:41.754451 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-429ebee9-2acb-42be-aade-d8afbc551f92 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:41.754451 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-429ebee9-2acb-42be-aade-d8afbc551f92 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] [instance: 5e984459-625e-44cd-b226-091276567215] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:41.761230 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-429ebee9-2acb-42be-aade-d8afbc551f92 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:41.761230 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-429ebee9-2acb-42be-aade-d8afbc551f92 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:41.761230 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-429ebee9-2acb-42be-aade-d8afbc551f92 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:41.762032 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-429ebee9-2acb-42be-aade-d8afbc551f92 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:41.762574 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-429ebee9-2acb-42be-aade-d8afbc551f92 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:41.763177 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-429ebee9-2acb-42be-aade-d8afbc551f92 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:41.781453 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-429ebee9-2acb-42be-aade-d8afbc551f92 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] HTTP exception thrown: Instance 5e984459-625e-44cd-b226-091276567215 could not be found. Oct 04 20:38:41.783276 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-429ebee9-2acb-42be-aade-d8afbc551f92 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Request method failure captured: Oct 04 20:38:41.783276 n-d-854823-8 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/5e984459-625e-44cd-b226-091276567215 HTTP/1.1 Oct 04 20:38:41.783276 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:38:41.783276 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:38:41.783276 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:38:41.783276 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 0 Oct 04 20:38:41.783276 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:38:41.783276 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:38:41.783276 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:38:41.783276 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:38:41.783276 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJl0Z3BeyK8EtfUb7YQbUJy6M8_B5uOVysJYu6l1tC_Ab7F8CMYmkidxzoxCbIOSbqV6xOYCJ5CRgm5E6JMMHdqAXb4XiRz44bNd95McX7piWiOgH2YTW1h9GeH1ik1WC4aCnEeNJIZDLoAzp7vQhc5-1W3bGV9DarB1OW0MBJv9djE Oct 04 20:38:41.783276 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:38:41.783276 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:38:41.783276 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:38:41.783276 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:38:41.783276 n-d-854823-8 devstack@n-api.service[128801]: X-Openstack-Nova-Api-Version: 2.75 Oct 04 20:38:41.783276 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:38:41.783276 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:38:41.783276 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: 0024f434015447759489d3cdc7bbaa4c Oct 04 20:38:41.783276 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-ServersAdmin275Test-643937328 Oct 04 20:38:41.783276 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 20:38:41.783276 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 20:38:41.783276 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0024f434015447759489d3cdc7bbaa4c", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0024f434015447759489d3cdc7bbaa4c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0024f434015447759489d3cdc7bbaa4c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0024f434015447759489d3cdc7bbaa4c"}]}] Oct 04 20:38:41.783276 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-ServersAdmin275Test-643937328 Oct 04 20:38:41.783276 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: 0024f434015447759489d3cdc7bbaa4c Oct 04 20:38:41.783276 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ServersAdmin275Test-643937328 Oct 04 20:38:41.783276 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-ServersAdmin275Test-643937328-project Oct 04 20:38:41.783276 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:38:41.783276 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:38:41.783276 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: a22706a9bf4d42efb57c10cbd92c6eea Oct 04 20:38:41.783276 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-ServersAdmin275Test-643937328-project Oct 04 20:38:41.783276 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 20:38:41.783276 n-d-854823-8 devstack@n-api.service[128801]: exception: Instance 5e984459-625e-44cd-b226-091276567215 could not be found. Oct 04 20:38:41.783276 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': '5e984459-625e-44cd-b226-091276567215'} Oct 04 20:38:41.783276 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:38:41.783276 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:38:41.783276 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:38:41.783276 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:38:41.783276 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:38:41.783276 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:38:41.783276 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:38:41.783276 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:38:41.783276 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:38:41.783276 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:38:41.783276 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e984459-625e-44cd-b226-091276567215 could not be found. Oct 04 20:38:41.783276 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:38:41.783276 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:38:41.783276 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:38:41.783276 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:38:41.783276 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:38:41.783276 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:38:41.783276 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:38:41.783276 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:38:41.783276 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:38:41.783276 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:38:41.783276 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:38:41.783276 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:38:41.783276 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:38:41.783276 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:38:41.783276 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:38:41.783276 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:38:41.783276 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e984459-625e-44cd-b226-091276567215 could not be found. Oct 04 20:38:41.783276 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:38:41.783276 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:38:41.783276 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:38:41.788187 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:38:41.788187 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:38:41.788187 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:38:41.788187 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:38:41.788187 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:38:41.788187 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e984459-625e-44cd-b226-091276567215 could not be found. Oct 04 20:38:41.788187 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:38:41.788187 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-429ebee9-2acb-42be-aade-d8afbc551f92 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] Returning 404 to user: Instance 5e984459-625e-44cd-b226-091276567215 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:38:41.788187 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-429ebee9-2acb-42be-aade-d8afbc551f92 tempest-ServersAdmin275Test-643937328 tempest-ServersAdmin275Test-643937328-project] 10.222.0.33 "GET /compute/v2.1/servers/5e984459-625e-44cd-b226-091276567215" status: 404 len: 111 microversion: 2.75 time: 0.037876 Oct 04 20:38:41.788187 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 639/1325] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:38:41 2022] GET /compute/v2.1/servers/5e984459-625e-44cd-b226-091276567215 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 20:38:42.007019 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-ae9bc829-5e51-4d74-88e5-0133a9cc233a tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36f4114dc4f443f8b48da7b4027e0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a23a85365414f92bbc03177d7f190e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:42.021366 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-ae9bc829-5e51-4d74-88e5-0133a9cc233a tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] 10.222.0.33 "GET /compute/v2.1/servers/2182737b-f69a-44aa-a3ea-bbabae8ad737" status: 200 len: 1319 microversion: 2.1 time: 0.310188 Oct 04 20:38:42.022214 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 687/1326] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:38:41 2022] GET /compute/v2.1/servers/2182737b-f69a-44aa-a3ea-bbabae8ad737 => generated 1319 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:38:42.257799 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-afe3bdcf-b907-449e-8abd-8fcddd7da05c tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:42.258617 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-afe3bdcf-b907-449e-8abd-8fcddd7da05c tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] [instance: 81748c83-b703-4c68-899c-c575cc3340d2] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:42.265805 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-afe3bdcf-b907-449e-8abd-8fcddd7da05c tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:42.266629 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-afe3bdcf-b907-449e-8abd-8fcddd7da05c tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:42.266993 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-993092fa-bb62-4c74-9692-06cf8003b6be tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:42.267715 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-993092fa-bb62-4c74-9692-06cf8003b6be tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] [instance: 23da26ba-68f4-4aef-b13c-0b6588a65e43] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:42.268296 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-afe3bdcf-b907-449e-8abd-8fcddd7da05c tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:42.269250 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-afe3bdcf-b907-449e-8abd-8fcddd7da05c tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:42.269980 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-afe3bdcf-b907-449e-8abd-8fcddd7da05c tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:42.270609 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-afe3bdcf-b907-449e-8abd-8fcddd7da05c tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:42.275320 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-993092fa-bb62-4c74-9692-06cf8003b6be tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:42.275850 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-993092fa-bb62-4c74-9692-06cf8003b6be tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:42.276901 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-993092fa-bb62-4c74-9692-06cf8003b6be tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:42.277623 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-993092fa-bb62-4c74-9692-06cf8003b6be tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:42.278563 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-993092fa-bb62-4c74-9692-06cf8003b6be tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:42.279082 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-993092fa-bb62-4c74-9692-06cf8003b6be tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:42.647288 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-993092fa-bb62-4c74-9692-06cf8003b6be tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3563efe2b8c94931a2a46c4e14811b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3118a5d96843d3bede1ed94bd9717e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:42.660402 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-993092fa-bb62-4c74-9692-06cf8003b6be tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] 10.222.0.33 "GET /compute/v2.1/servers/23da26ba-68f4-4aef-b13c-0b6588a65e43" status: 200 len: 1477 microversion: 2.1 time: 0.397166 Oct 04 20:38:42.677240 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 688/1327] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:38:42 2022] GET /compute/v2.1/servers/23da26ba-68f4-4aef-b13c-0b6588a65e43 => generated 1477 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:38:42.695810 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-afe3bdcf-b907-449e-8abd-8fcddd7da05c tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:42.717254 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-afe3bdcf-b907-449e-8abd-8fcddd7da05c tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:42.723474 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-afe3bdcf-b907-449e-8abd-8fcddd7da05c tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:42.724915 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-afe3bdcf-b907-449e-8abd-8fcddd7da05c tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] 10.222.0.33 "GET /compute/v2.1/servers/81748c83-b703-4c68-899c-c575cc3340d2" status: 200 len: 1409 microversion: 2.25 time: 0.472991 Oct 04 20:38:42.726129 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 640/1328] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:38:42 2022] GET /compute/v2.1/servers/81748c83-b703-4c68-899c-c575cc3340d2 => generated 1409 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:38:42.744162 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-9c840de8-8489-4818-a137-bf23a7db65bc tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:42.744874 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-9c840de8-8489-4818-a137-bf23a7db65bc tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] [instance: acecffb2-4128-4bd7-8bc3-7529881b64ed] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:42.752194 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9c840de8-8489-4818-a137-bf23a7db65bc tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:42.752806 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9c840de8-8489-4818-a137-bf23a7db65bc tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:42.753345 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9c840de8-8489-4818-a137-bf23a7db65bc tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:42.761050 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9c840de8-8489-4818-a137-bf23a7db65bc tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:42.762775 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9c840de8-8489-4818-a137-bf23a7db65bc tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:42.763501 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9c840de8-8489-4818-a137-bf23a7db65bc tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:42.782070 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8ce961ef-7c7b-477b-ab92-31f7f27b6617 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:42.787558 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-8ce961ef-7c7b-477b-ab92-31f7f27b6617 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] [instance: 8a72de6a-64a0-4ec7-a613-576f8ac02af3] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:42.796526 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8ce961ef-7c7b-477b-ab92-31f7f27b6617 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:42.796975 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8ce961ef-7c7b-477b-ab92-31f7f27b6617 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:42.797460 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8ce961ef-7c7b-477b-ab92-31f7f27b6617 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:42.798178 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8ce961ef-7c7b-477b-ab92-31f7f27b6617 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:42.798828 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8ce961ef-7c7b-477b-ab92-31f7f27b6617 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:42.799896 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=100 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:38:42.821983 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8ce961ef-7c7b-477b-ab92-31f7f27b6617 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:43.204937 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-8ce961ef-7c7b-477b-ab92-31f7f27b6617 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '800db3a57ada47eca381b00189fdbf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66ec8ea91b04deb90b679589e0495bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:43.221303 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-8ce961ef-7c7b-477b-ab92-31f7f27b6617 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] 10.222.0.33 "GET /compute/v2.1/servers/8a72de6a-64a0-4ec7-a613-576f8ac02af3" status: 200 len: 1503 microversion: 2.1 time: 0.454210 Oct 04 20:38:43.222962 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 641/1329] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:38:42 2022] GET /compute/v2.1/servers/8a72de6a-64a0-4ec7-a613-576f8ac02af3 => generated 1503 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:38:43.237270 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c0b2c2ed-5b09-442f-b4cd-6fef217fb6d5 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:43.237411 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c0b2c2ed-5b09-442f-b4cd-6fef217fb6d5 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] [instance: 2182737b-f69a-44aa-a3ea-bbabae8ad737] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:43.246885 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c0b2c2ed-5b09-442f-b4cd-6fef217fb6d5 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:43.247498 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c0b2c2ed-5b09-442f-b4cd-6fef217fb6d5 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:43.248097 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c0b2c2ed-5b09-442f-b4cd-6fef217fb6d5 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:43.249351 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c0b2c2ed-5b09-442f-b4cd-6fef217fb6d5 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:43.249525 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c0b2c2ed-5b09-442f-b4cd-6fef217fb6d5 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:43.251162 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c0b2c2ed-5b09-442f-b4cd-6fef217fb6d5 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:43.258409 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-9c840de8-8489-4818-a137-bf23a7db65bc tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d46a7cdc204e808eabedbad9c5aea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '870c8d858eb44228acd9bbe345a1143c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:43.281880 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-9c840de8-8489-4818-a137-bf23a7db65bc tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] 10.222.0.33 "GET /compute/v2.1/servers/acecffb2-4128-4bd7-8bc3-7529881b64ed" status: 200 len: 1505 microversion: 2.1 time: 0.550507 Oct 04 20:38:43.283853 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 689/1330] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:38:42 2022] GET /compute/v2.1/servers/acecffb2-4128-4bd7-8bc3-7529881b64ed => generated 1505 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:38:43.297442 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-3c73861e-38b8-4e65-a11b-440782df290d req-1ee66ca0-1b0b-447c-9b64-58a53bc994ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a72de6a-64a0-4ec7-a613-576f8ac02af3", "name": "network-vif-unplugged", "status": "completed", "tag": "ae521132-718e-4290-aca2-064b766ac78a"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:38:43.309311 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-3c73861e-38b8-4e65-a11b-440782df290d req-1ee66ca0-1b0b-447c-9b64-58a53bc994ef service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:43.309815 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-3c73861e-38b8-4e65-a11b-440782df290d req-1ee66ca0-1b0b-447c-9b64-58a53bc994ef service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:43.310318 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-3c73861e-38b8-4e65-a11b-440782df290d req-1ee66ca0-1b0b-447c-9b64-58a53bc994ef service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:43.324345 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-3c73861e-38b8-4e65-a11b-440782df290d req-1ee66ca0-1b0b-447c-9b64-58a53bc994ef service nova] Creating event network-vif-unplugged:ae521132-718e-4290-aca2-064b766ac78a for instance 8a72de6a-64a0-4ec7-a613-576f8ac02af3 on n-h1-854823-8 Oct 04 20:38:43.330210 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-3c73861e-38b8-4e65-a11b-440782df290d req-1ee66ca0-1b0b-447c-9b64-58a53bc994ef service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044912 Oct 04 20:38:43.332027 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 690/1331] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:38:43 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:38:43.338530 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-8e7149af-4742-42c6-b14d-4cd0259a4661 tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] Calling method '.version_select at 0x7f3c7432bf70>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:43.339635 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-8e7149af-4742-42c6-b14d-4cd0259a4661 tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] [instance: acecffb2-4128-4bd7-8bc3-7529881b64ed] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:43.346927 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8e7149af-4742-42c6-b14d-4cd0259a4661 tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:43.348278 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8e7149af-4742-42c6-b14d-4cd0259a4661 tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:43.348926 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8e7149af-4742-42c6-b14d-4cd0259a4661 tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:43.349933 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8e7149af-4742-42c6-b14d-4cd0259a4661 tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:43.350578 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8e7149af-4742-42c6-b14d-4cd0259a4661 tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:43.351261 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8e7149af-4742-42c6-b14d-4cd0259a4661 tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:43.389689 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-8e7149af-4742-42c6-b14d-4cd0259a4661 tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] 10.222.0.33 "GET /compute/v2.1/servers/acecffb2-4128-4bd7-8bc3-7529881b64ed/os-instance-actions" status: 200 len: 611 microversion: 2.1 time: 0.056026 Oct 04 20:38:43.391628 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 691/1332] 10.222.0.33 () {58 vars in 1296 bytes} [Tue Oct 4 20:38:43 2022] GET /compute/v2.1/servers/acecffb2-4128-4bd7-8bc3-7529881b64ed/os-instance-actions => generated 611 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:38:43.408629 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-be9ed912-4551-4d9c-87fd-2f076172abc1 tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:43.412734 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-be9ed912-4551-4d9c-87fd-2f076172abc1 tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] [instance: acecffb2-4128-4bd7-8bc3-7529881b64ed] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:43.424161 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-be9ed912-4551-4d9c-87fd-2f076172abc1 tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:43.426420 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-be9ed912-4551-4d9c-87fd-2f076172abc1 tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:43.427133 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-be9ed912-4551-4d9c-87fd-2f076172abc1 tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:43.428220 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-be9ed912-4551-4d9c-87fd-2f076172abc1 tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:43.428673 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-be9ed912-4551-4d9c-87fd-2f076172abc1 tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:43.430776 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-be9ed912-4551-4d9c-87fd-2f076172abc1 tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:43.470169 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-be9ed912-4551-4d9c-87fd-2f076172abc1 tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] [instance: acecffb2-4128-4bd7-8bc3-7529881b64ed] Going to try to terminate instance {{(pid=128802) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:38:43.577063 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-be9ed912-4551-4d9c-87fd-2f076172abc1 tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] 10.222.0.33 "DELETE /compute/v2.1/servers/acecffb2-4128-4bd7-8bc3-7529881b64ed" status: 204 len: 0 microversion: 2.1 time: 0.175358 Oct 04 20:38:43.577978 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 692/1333] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 20:38:43 2022] DELETE /compute/v2.1/servers/acecffb2-4128-4bd7-8bc3-7529881b64ed => generated 0 bytes in 177 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:38:43.590555 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-a3f8cb35-2b89-4c2d-9211-0642530f572f tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:43.591189 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-a3f8cb35-2b89-4c2d-9211-0642530f572f tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] [instance: acecffb2-4128-4bd7-8bc3-7529881b64ed] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:43.599333 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a3f8cb35-2b89-4c2d-9211-0642530f572f tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:43.599822 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a3f8cb35-2b89-4c2d-9211-0642530f572f tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:43.600251 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a3f8cb35-2b89-4c2d-9211-0642530f572f tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:43.600952 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a3f8cb35-2b89-4c2d-9211-0642530f572f tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:43.601421 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a3f8cb35-2b89-4c2d-9211-0642530f572f tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:43.601836 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a3f8cb35-2b89-4c2d-9211-0642530f572f tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:43.732195 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c0b2c2ed-5b09-442f-b4cd-6fef217fb6d5 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36f4114dc4f443f8b48da7b4027e0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a23a85365414f92bbc03177d7f190e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:43.740570 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c0b2c2ed-5b09-442f-b4cd-6fef217fb6d5 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] 10.222.0.33 "GET /compute/v2.1/servers/2182737b-f69a-44aa-a3ea-bbabae8ad737" status: 200 len: 1469 microversion: 2.1 time: 0.515515 Oct 04 20:38:43.741615 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 642/1334] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:38:43 2022] GET /compute/v2.1/servers/2182737b-f69a-44aa-a3ea-bbabae8ad737 => generated 1469 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:38:43.755030 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-09309c3f-99ca-43a3-90be-9b6fef1e2085 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:43.755990 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-09309c3f-99ca-43a3-90be-9b6fef1e2085 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] [instance: 23da26ba-68f4-4aef-b13c-0b6588a65e43] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:43.763269 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-09309c3f-99ca-43a3-90be-9b6fef1e2085 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:43.763771 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-09309c3f-99ca-43a3-90be-9b6fef1e2085 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:43.764212 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-09309c3f-99ca-43a3-90be-9b6fef1e2085 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:43.764921 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-09309c3f-99ca-43a3-90be-9b6fef1e2085 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:43.765377 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-09309c3f-99ca-43a3-90be-9b6fef1e2085 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:43.765800 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-09309c3f-99ca-43a3-90be-9b6fef1e2085 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:43.981377 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-a3f8cb35-2b89-4c2d-9211-0642530f572f tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d46a7cdc204e808eabedbad9c5aea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '870c8d858eb44228acd9bbe345a1143c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:43.990476 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-a3f8cb35-2b89-4c2d-9211-0642530f572f tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] 10.222.0.33 "GET /compute/v2.1/servers/acecffb2-4128-4bd7-8bc3-7529881b64ed" status: 200 len: 1511 microversion: 2.1 time: 0.406718 Oct 04 20:38:43.991380 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 693/1335] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:38:43 2022] GET /compute/v2.1/servers/acecffb2-4128-4bd7-8bc3-7529881b64ed => generated 1511 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:38:44.010274 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-5e68fc71-f299-411b-8bd9-bedf2b269770 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:44.011001 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-5e68fc71-f299-411b-8bd9-bedf2b269770 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] [instance: 81748c83-b703-4c68-899c-c575cc3340d2] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:44.020318 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5e68fc71-f299-411b-8bd9-bedf2b269770 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:44.020854 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5e68fc71-f299-411b-8bd9-bedf2b269770 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:44.026510 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5e68fc71-f299-411b-8bd9-bedf2b269770 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:44.027677 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5e68fc71-f299-411b-8bd9-bedf2b269770 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:44.028304 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5e68fc71-f299-411b-8bd9-bedf2b269770 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:44.028882 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5e68fc71-f299-411b-8bd9-bedf2b269770 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:44.128125 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-09309c3f-99ca-43a3-90be-9b6fef1e2085 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3563efe2b8c94931a2a46c4e14811b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3118a5d96843d3bede1ed94bd9717e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:44.139680 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-09309c3f-99ca-43a3-90be-9b6fef1e2085 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] 10.222.0.33 "GET /compute/v2.1/servers/23da26ba-68f4-4aef-b13c-0b6588a65e43" status: 200 len: 1477 microversion: 2.1 time: 0.395754 Oct 04 20:38:44.150742 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 643/1336] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:38:43 2022] GET /compute/v2.1/servers/23da26ba-68f4-4aef-b13c-0b6588a65e43 => generated 1477 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:38:44.160740 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-67d4eeb0-a1ae-42e1-a7fc-7950568af6d8 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:44.161357 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-67d4eeb0-a1ae-42e1-a7fc-7950568af6d8 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] [instance: 96d890a0-a100-40a7-b795-6677eb966251] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:44.167568 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-67d4eeb0-a1ae-42e1-a7fc-7950568af6d8 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:44.168426 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-67d4eeb0-a1ae-42e1-a7fc-7950568af6d8 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:44.169083 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-67d4eeb0-a1ae-42e1-a7fc-7950568af6d8 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:44.170026 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-67d4eeb0-a1ae-42e1-a7fc-7950568af6d8 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:44.170723 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-67d4eeb0-a1ae-42e1-a7fc-7950568af6d8 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:44.171612 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-67d4eeb0-a1ae-42e1-a7fc-7950568af6d8 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:44.487114 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-5e68fc71-f299-411b-8bd9-bedf2b269770 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:44.498926 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-5e68fc71-f299-411b-8bd9-bedf2b269770 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:44.500830 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-5e68fc71-f299-411b-8bd9-bedf2b269770 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:44.502533 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-5e68fc71-f299-411b-8bd9-bedf2b269770 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] 10.222.0.33 "GET /compute/v2.1/servers/81748c83-b703-4c68-899c-c575cc3340d2" status: 200 len: 1409 microversion: 2.25 time: 0.509496 Oct 04 20:38:44.503825 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 694/1337] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:38:43 2022] GET /compute/v2.1/servers/81748c83-b703-4c68-899c-c575cc3340d2 => generated 1409 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:38:44.509452 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-e169310c-fef7-4471-a42f-7717e3b45624 req-a3b383b8-4e07-47e4-85bb-e055300642a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81748c83-b703-4c68-899c-c575cc3340d2", "name": "network-vif-plugged", "status": "completed", "tag": "c2865aee-fb0f-4bf6-91f8-8215288d29f5"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:38:44.540466 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-e169310c-fef7-4471-a42f-7717e3b45624 req-a3b383b8-4e07-47e4-85bb-e055300642a3 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:44.541948 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-e169310c-fef7-4471-a42f-7717e3b45624 req-a3b383b8-4e07-47e4-85bb-e055300642a3 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:44.544122 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-e169310c-fef7-4471-a42f-7717e3b45624 req-a3b383b8-4e07-47e4-85bb-e055300642a3 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:44.569174 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-e169310c-fef7-4471-a42f-7717e3b45624 req-a3b383b8-4e07-47e4-85bb-e055300642a3 service nova] Creating event network-vif-plugged:c2865aee-fb0f-4bf6-91f8-8215288d29f5 for instance 81748c83-b703-4c68-899c-c575cc3340d2 on n-h2-854823-8 Oct 04 20:38:44.571417 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-67d4eeb0-a1ae-42e1-a7fc-7950568af6d8 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36f4114dc4f443f8b48da7b4027e0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a23a85365414f92bbc03177d7f190e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:44.575708 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-e169310c-fef7-4471-a42f-7717e3b45624 req-a3b383b8-4e07-47e4-85bb-e055300642a3 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069736 Oct 04 20:38:44.576884 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 695/1338] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:38:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:38:44.584386 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-102fad5d-e1f8-4368-a2eb-6e63c8dbde60 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:44.585198 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-102fad5d-e1f8-4368-a2eb-6e63c8dbde60 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] [instance: 8a72de6a-64a0-4ec7-a613-576f8ac02af3] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:44.587415 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-67d4eeb0-a1ae-42e1-a7fc-7950568af6d8 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] 10.222.0.33 "GET /compute/v2.1/servers/96d890a0-a100-40a7-b795-6677eb966251" status: 200 len: 1469 microversion: 2.1 time: 0.435241 Oct 04 20:38:44.588027 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 644/1339] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:38:44 2022] GET /compute/v2.1/servers/96d890a0-a100-40a7-b795-6677eb966251 => generated 1469 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:38:44.600859 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-102fad5d-e1f8-4368-a2eb-6e63c8dbde60 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:44.601547 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-102fad5d-e1f8-4368-a2eb-6e63c8dbde60 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:44.602093 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-102fad5d-e1f8-4368-a2eb-6e63c8dbde60 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:44.603558 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-102fad5d-e1f8-4368-a2eb-6e63c8dbde60 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:44.605062 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-102fad5d-e1f8-4368-a2eb-6e63c8dbde60 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:44.605710 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-102fad5d-e1f8-4368-a2eb-6e63c8dbde60 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:44.612020 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c0dabf37-1d0e-4010-a70a-ae90731600f2 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:44.619081 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c0dabf37-1d0e-4010-a70a-ae90731600f2 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e36f4114dc4f443f8b48da7b4027e0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a23a85365414f92bbc03177d7f190e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:44.623401 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c0dabf37-1d0e-4010-a70a-ae90731600f2 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Searching by: {'reservation_id': 'r-5g02bvve', 'deleted': False, 'project_id': '1a23a85365414f92bbc03177d7f190e6'} {{(pid=128801) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 20:38:44.636957 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c0dabf37-1d0e-4010-a70a-ae90731600f2 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:44.639632 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c0dabf37-1d0e-4010-a70a-ae90731600f2 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:44.640428 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c0dabf37-1d0e-4010-a70a-ae90731600f2 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:44.644510 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c0dabf37-1d0e-4010-a70a-ae90731600f2 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:44.656948 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c0dabf37-1d0e-4010-a70a-ae90731600f2 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:44.658472 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c0dabf37-1d0e-4010-a70a-ae90731600f2 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:44.847882 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.multi_cell_list [None req-c0dabf37-1d0e-4010-a70a-ae90731600f2 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=128801) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 20:38:44.891900 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-102fad5d-e1f8-4368-a2eb-6e63c8dbde60 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '800db3a57ada47eca381b00189fdbf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66ec8ea91b04deb90b679589e0495bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:44.908154 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-102fad5d-e1f8-4368-a2eb-6e63c8dbde60 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] 10.222.0.33 "GET /compute/v2.1/servers/8a72de6a-64a0-4ec7-a613-576f8ac02af3" status: 200 len: 1503 microversion: 2.1 time: 0.329575 Oct 04 20:38:44.910285 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 696/1340] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:38:44 2022] GET /compute/v2.1/servers/8a72de6a-64a0-4ec7-a613-576f8ac02af3 => generated 1503 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:38:44.942393 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c0dabf37-1d0e-4010-a70a-ae90731600f2 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36f4114dc4f443f8b48da7b4027e0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a23a85365414f92bbc03177d7f190e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:44.949442 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c0dabf37-1d0e-4010-a70a-ae90731600f2 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:44.949818 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c0dabf37-1d0e-4010-a70a-ae90731600f2 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:44.950384 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c0dabf37-1d0e-4010-a70a-ae90731600f2 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:45.016391 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-337a4185-74cc-4181-ab0d-31abf3d2759a tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:45.017258 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-337a4185-74cc-4181-ab0d-31abf3d2759a tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] [instance: acecffb2-4128-4bd7-8bc3-7529881b64ed] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:45.025580 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-337a4185-74cc-4181-ab0d-31abf3d2759a tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:45.026175 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-337a4185-74cc-4181-ab0d-31abf3d2759a tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:45.026971 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-337a4185-74cc-4181-ab0d-31abf3d2759a tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:45.028236 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-337a4185-74cc-4181-ab0d-31abf3d2759a tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:45.028839 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-337a4185-74cc-4181-ab0d-31abf3d2759a tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:45.029311 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-337a4185-74cc-4181-ab0d-31abf3d2759a tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:45.224639 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c0dabf37-1d0e-4010-a70a-ae90731600f2 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] 10.222.0.33 "GET /compute/v2.1/servers/detail?reservation_id=r-5g02bvve" status: 200 len: 2931 microversion: 2.1 time: 0.611901 Oct 04 20:38:45.226866 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 645/1341] 10.222.0.33 () {58 vars in 1197 bytes} [Tue Oct 4 20:38:44 2022] GET /compute/v2.1/servers/detail?reservation_id=r-5g02bvve => generated 2931 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:38:45.235896 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c734294c-55a3-4fb1-a5b8-f41f678922b4 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:45.236825 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c734294c-55a3-4fb1-a5b8-f41f678922b4 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] [instance: 23da26ba-68f4-4aef-b13c-0b6588a65e43] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:45.250633 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c734294c-55a3-4fb1-a5b8-f41f678922b4 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:45.251481 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c734294c-55a3-4fb1-a5b8-f41f678922b4 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:45.251922 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c734294c-55a3-4fb1-a5b8-f41f678922b4 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:45.252630 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c734294c-55a3-4fb1-a5b8-f41f678922b4 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:45.253203 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c734294c-55a3-4fb1-a5b8-f41f678922b4 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:45.254694 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c734294c-55a3-4fb1-a5b8-f41f678922b4 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:45.315351 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-337a4185-74cc-4181-ab0d-31abf3d2759a tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d46a7cdc204e808eabedbad9c5aea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '870c8d858eb44228acd9bbe345a1143c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:45.323135 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-337a4185-74cc-4181-ab0d-31abf3d2759a tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] 10.222.0.33 "GET /compute/v2.1/servers/acecffb2-4128-4bd7-8bc3-7529881b64ed" status: 200 len: 1511 microversion: 2.1 time: 0.313406 Oct 04 20:38:45.323908 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 697/1342] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:38:45 2022] GET /compute/v2.1/servers/acecffb2-4128-4bd7-8bc3-7529881b64ed => generated 1511 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:38:45.339849 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-9c365174-ba38-4b1d-9310-7f2f3dbc1994 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:45.375246 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.compute.server_groups [None req-9c365174-ba38-4b1d-9310-7f2f3dbc1994 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Querying cell 189ff13b-7538-4a71-a71c-1e7f1d3e1b46(cell1) for 2 instances {{(pid=128802) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 04 20:38:45.376056 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9c365174-ba38-4b1d-9310-7f2f3dbc1994 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:45.377029 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9c365174-ba38-4b1d-9310-7f2f3dbc1994 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:45.377609 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9c365174-ba38-4b1d-9310-7f2f3dbc1994 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:45.411134 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-9c365174-ba38-4b1d-9310-7f2f3dbc1994 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] 10.222.0.33 "GET /compute/v2.1/os-server-groups/49c045c4-4d35-4fe6-956c-aa9908064ea1" status: 200 len: 265 microversion: 2.1 time: 0.079541 Oct 04 20:38:45.417527 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 698/1343] 10.222.0.33 () {58 vars in 1263 bytes} [Tue Oct 4 20:38:45 2022] GET /compute/v2.1/os-server-groups/49c045c4-4d35-4fe6-956c-aa9908064ea1 => generated 265 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:38:45.421863 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-399b6caf-b760-464a-bd6f-acd6066f2c71 req-3c6f1d21-af4c-4ed5-acfc-b33dc2636644 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a72de6a-64a0-4ec7-a613-576f8ac02af3", "tag": "ae521132-718e-4290-aca2-064b766ac78a"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:38:45.432016 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-399b6caf-b760-464a-bd6f-acd6066f2c71 req-3c6f1d21-af4c-4ed5-acfc-b33dc2636644 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:45.432633 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-399b6caf-b760-464a-bd6f-acd6066f2c71 req-3c6f1d21-af4c-4ed5-acfc-b33dc2636644 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:45.433192 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-399b6caf-b760-464a-bd6f-acd6066f2c71 req-3c6f1d21-af4c-4ed5-acfc-b33dc2636644 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:45.445524 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-399b6caf-b760-464a-bd6f-acd6066f2c71 req-3c6f1d21-af4c-4ed5-acfc-b33dc2636644 service nova] Creating event network-changed:ae521132-718e-4290-aca2-064b766ac78a for instance 8a72de6a-64a0-4ec7-a613-576f8ac02af3 on n-h1-854823-8 Oct 04 20:38:45.451234 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-399b6caf-b760-464a-bd6f-acd6066f2c71 req-3c6f1d21-af4c-4ed5-acfc-b33dc2636644 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037773 Oct 04 20:38:45.452158 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 699/1344] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:38:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:38:45.458793 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-dda7c3d4-f667-455c-bcca-84bce5530e57 tempest-ServersOnMultiNodesTest-176762512 tempest-ServersOnMultiNodesTest-176762512-project-admin] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:45.459661 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-dda7c3d4-f667-455c-bcca-84bce5530e57 tempest-ServersOnMultiNodesTest-176762512 tempest-ServersOnMultiNodesTest-176762512-project-admin] [instance: 2182737b-f69a-44aa-a3ea-bbabae8ad737] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:45.467188 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dda7c3d4-f667-455c-bcca-84bce5530e57 tempest-ServersOnMultiNodesTest-176762512 tempest-ServersOnMultiNodesTest-176762512-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:45.467749 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dda7c3d4-f667-455c-bcca-84bce5530e57 tempest-ServersOnMultiNodesTest-176762512 tempest-ServersOnMultiNodesTest-176762512-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:45.469048 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dda7c3d4-f667-455c-bcca-84bce5530e57 tempest-ServersOnMultiNodesTest-176762512 tempest-ServersOnMultiNodesTest-176762512-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:45.469926 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dda7c3d4-f667-455c-bcca-84bce5530e57 tempest-ServersOnMultiNodesTest-176762512 tempest-ServersOnMultiNodesTest-176762512-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:45.470520 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dda7c3d4-f667-455c-bcca-84bce5530e57 tempest-ServersOnMultiNodesTest-176762512 tempest-ServersOnMultiNodesTest-176762512-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:45.471044 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dda7c3d4-f667-455c-bcca-84bce5530e57 tempest-ServersOnMultiNodesTest-176762512 tempest-ServersOnMultiNodesTest-176762512-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:45.532653 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c734294c-55a3-4fb1-a5b8-f41f678922b4 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3563efe2b8c94931a2a46c4e14811b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3118a5d96843d3bede1ed94bd9717e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:45.541518 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c734294c-55a3-4fb1-a5b8-f41f678922b4 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] 10.222.0.33 "GET /compute/v2.1/servers/23da26ba-68f4-4aef-b13c-0b6588a65e43" status: 200 len: 1477 microversion: 2.1 time: 0.312904 Oct 04 20:38:45.542455 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 646/1345] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:38:45 2022] GET /compute/v2.1/servers/23da26ba-68f4-4aef-b13c-0b6588a65e43 => generated 1477 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:38:45.595306 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c5a290dd-cf0b-44c9-8fc3-d1f4502dd92d tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:45.596541 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c5a290dd-cf0b-44c9-8fc3-d1f4502dd92d tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] [instance: 81748c83-b703-4c68-899c-c575cc3340d2] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:45.606642 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c5a290dd-cf0b-44c9-8fc3-d1f4502dd92d tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:45.607542 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c5a290dd-cf0b-44c9-8fc3-d1f4502dd92d tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:45.608218 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c5a290dd-cf0b-44c9-8fc3-d1f4502dd92d tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:45.609220 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c5a290dd-cf0b-44c9-8fc3-d1f4502dd92d tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:45.609966 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c5a290dd-cf0b-44c9-8fc3-d1f4502dd92d tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:45.610685 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c5a290dd-cf0b-44c9-8fc3-d1f4502dd92d tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:46.200446 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-dda7c3d4-f667-455c-bcca-84bce5530e57 tempest-ServersOnMultiNodesTest-176762512 tempest-ServersOnMultiNodesTest-176762512-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/2182737b-f69a-44aa-a3ea-bbabae8ad737" status: 200 len: 1620 microversion: 2.1 time: 0.747186 Oct 04 20:38:46.214791 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 700/1346] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:38:45 2022] GET /compute/v2.1/servers/2182737b-f69a-44aa-a3ea-bbabae8ad737 => generated 1620 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:38:46.224425 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-a3edb6c2-5bdd-467c-9f56-72b50f585763 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:46.225316 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-a3edb6c2-5bdd-467c-9f56-72b50f585763 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] [instance: 8a72de6a-64a0-4ec7-a613-576f8ac02af3] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:46.231558 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a3edb6c2-5bdd-467c-9f56-72b50f585763 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:46.232245 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a3edb6c2-5bdd-467c-9f56-72b50f585763 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:46.232835 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a3edb6c2-5bdd-467c-9f56-72b50f585763 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:46.233715 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a3edb6c2-5bdd-467c-9f56-72b50f585763 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:46.234325 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a3edb6c2-5bdd-467c-9f56-72b50f585763 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:46.234921 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a3edb6c2-5bdd-467c-9f56-72b50f585763 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:46.457321 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c5a290dd-cf0b-44c9-8fc3-d1f4502dd92d tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:46.467049 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c5a290dd-cf0b-44c9-8fc3-d1f4502dd92d tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:46.471605 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c5a290dd-cf0b-44c9-8fc3-d1f4502dd92d tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:46.478557 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c5a290dd-cf0b-44c9-8fc3-d1f4502dd92d tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] 10.222.0.33 "GET /compute/v2.1/servers/81748c83-b703-4c68-899c-c575cc3340d2" status: 200 len: 1409 microversion: 2.25 time: 0.889560 Oct 04 20:38:46.479981 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 647/1347] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:38:45 2022] GET /compute/v2.1/servers/81748c83-b703-4c68-899c-c575cc3340d2 => generated 1409 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 20:38:46.499747 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8f8c1adc-bc00-4b3c-a9b8-e25f38132042 tempest-ServersOnMultiNodesTest-176762512 tempest-ServersOnMultiNodesTest-176762512-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:46.506569 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-8f8c1adc-bc00-4b3c-a9b8-e25f38132042 tempest-ServersOnMultiNodesTest-176762512 tempest-ServersOnMultiNodesTest-176762512-project-admin] [instance: 96d890a0-a100-40a7-b795-6677eb966251] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:46.516916 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8f8c1adc-bc00-4b3c-a9b8-e25f38132042 tempest-ServersOnMultiNodesTest-176762512 tempest-ServersOnMultiNodesTest-176762512-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:46.518298 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8f8c1adc-bc00-4b3c-a9b8-e25f38132042 tempest-ServersOnMultiNodesTest-176762512 tempest-ServersOnMultiNodesTest-176762512-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:46.519347 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8f8c1adc-bc00-4b3c-a9b8-e25f38132042 tempest-ServersOnMultiNodesTest-176762512 tempest-ServersOnMultiNodesTest-176762512-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:46.520321 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8f8c1adc-bc00-4b3c-a9b8-e25f38132042 tempest-ServersOnMultiNodesTest-176762512 tempest-ServersOnMultiNodesTest-176762512-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:46.521931 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8f8c1adc-bc00-4b3c-a9b8-e25f38132042 tempest-ServersOnMultiNodesTest-176762512 tempest-ServersOnMultiNodesTest-176762512-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:46.522725 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8f8c1adc-bc00-4b3c-a9b8-e25f38132042 tempest-ServersOnMultiNodesTest-176762512 tempest-ServersOnMultiNodesTest-176762512-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:46.809491 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-a3edb6c2-5bdd-467c-9f56-72b50f585763 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '800db3a57ada47eca381b00189fdbf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66ec8ea91b04deb90b679589e0495bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:46.821356 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-a3edb6c2-5bdd-467c-9f56-72b50f585763 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] 10.222.0.33 "GET /compute/v2.1/servers/8a72de6a-64a0-4ec7-a613-576f8ac02af3" status: 200 len: 1503 microversion: 2.1 time: 0.605040 Oct 04 20:38:46.823088 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 701/1348] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:38:46 2022] GET /compute/v2.1/servers/8a72de6a-64a0-4ec7-a613-576f8ac02af3 => generated 1503 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:38:46.830796 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-30ab1f52-cd16-404e-ad1a-f9dc3f857eb5 tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:46.832958 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-30ab1f52-cd16-404e-ad1a-f9dc3f857eb5 tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] [instance: acecffb2-4128-4bd7-8bc3-7529881b64ed] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:46.846374 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-30ab1f52-cd16-404e-ad1a-f9dc3f857eb5 tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:46.847737 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-30ab1f52-cd16-404e-ad1a-f9dc3f857eb5 tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:46.848518 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-30ab1f52-cd16-404e-ad1a-f9dc3f857eb5 tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:46.849803 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-30ab1f52-cd16-404e-ad1a-f9dc3f857eb5 tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:46.850470 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-30ab1f52-cd16-404e-ad1a-f9dc3f857eb5 tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:46.851046 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-30ab1f52-cd16-404e-ad1a-f9dc3f857eb5 tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:47.039606 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-8f8c1adc-bc00-4b3c-a9b8-e25f38132042 tempest-ServersOnMultiNodesTest-176762512 tempest-ServersOnMultiNodesTest-176762512-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/96d890a0-a100-40a7-b795-6677eb966251" status: 200 len: 1620 microversion: 2.1 time: 0.558297 Oct 04 20:38:47.042743 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 648/1349] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:38:46 2022] GET /compute/v2.1/servers/96d890a0-a100-40a7-b795-6677eb966251 => generated 1620 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:38:47.058249 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a86bbb84-4afe-453b-90bc-ddf60f50ddb3 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:47.059219 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a86bbb84-4afe-453b-90bc-ddf60f50ddb3 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] [instance: 23da26ba-68f4-4aef-b13c-0b6588a65e43] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:47.074825 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a86bbb84-4afe-453b-90bc-ddf60f50ddb3 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:47.075354 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a86bbb84-4afe-453b-90bc-ddf60f50ddb3 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:47.075791 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a86bbb84-4afe-453b-90bc-ddf60f50ddb3 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:47.076756 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a86bbb84-4afe-453b-90bc-ddf60f50ddb3 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:47.077367 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a86bbb84-4afe-453b-90bc-ddf60f50ddb3 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:47.077950 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a86bbb84-4afe-453b-90bc-ddf60f50ddb3 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:47.349486 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-30ab1f52-cd16-404e-ad1a-f9dc3f857eb5 tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d46a7cdc204e808eabedbad9c5aea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '870c8d858eb44228acd9bbe345a1143c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:47.374855 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-30ab1f52-cd16-404e-ad1a-f9dc3f857eb5 tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] 10.222.0.33 "GET /compute/v2.1/servers/acecffb2-4128-4bd7-8bc3-7529881b64ed" status: 200 len: 1511 microversion: 2.1 time: 0.550231 Oct 04 20:38:47.389901 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 702/1350] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:38:46 2022] GET /compute/v2.1/servers/acecffb2-4128-4bd7-8bc3-7529881b64ed => generated 1511 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:38:47.416592 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-9fa70824-6c42-4948-ac51-9db30b98b530 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Action: 'create', calling method: .version_select at 0x7f3c743d13a0>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-1818660315", "policies": ["anti-affinity"]}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:38:47.467553 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-a86bbb84-4afe-453b-90bc-ddf60f50ddb3 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3563efe2b8c94931a2a46c4e14811b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3118a5d96843d3bede1ed94bd9717e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:47.474194 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-9fa70824-6c42-4948-ac51-9db30b98b530 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Getting quotas for project 1a23a85365414f92bbc03177d7f190e6. Resources: {'server_groups'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:38:47.486882 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a86bbb84-4afe-453b-90bc-ddf60f50ddb3 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] 10.222.0.33 "GET /compute/v2.1/servers/23da26ba-68f4-4aef-b13c-0b6588a65e43" status: 200 len: 1477 microversion: 2.1 time: 0.437709 Oct 04 20:38:47.488105 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 649/1351] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:38:47 2022] GET /compute/v2.1/servers/23da26ba-68f4-4aef-b13c-0b6588a65e43 => generated 1477 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:38:47.495160 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-9fa70824-6c42-4948-ac51-9db30b98b530 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Getting quotas for user e36f4114dc4f443f8b48da7b4027e0c1 and project 1a23a85365414f92bbc03177d7f190e6. Resources: {'server_groups'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:38:47.506257 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-3a582173-5809-4ad8-9134-a12909521aca tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:47.507258 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-3a582173-5809-4ad8-9134-a12909521aca tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] [instance: 81748c83-b703-4c68-899c-c575cc3340d2] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:47.517216 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3a582173-5809-4ad8-9134-a12909521aca tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:47.518106 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3a582173-5809-4ad8-9134-a12909521aca tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:47.519375 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3a582173-5809-4ad8-9134-a12909521aca tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:47.520628 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3a582173-5809-4ad8-9134-a12909521aca tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:47.521613 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3a582173-5809-4ad8-9134-a12909521aca tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:47.522244 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3a582173-5809-4ad8-9134-a12909521aca tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:47.639481 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-9fa70824-6c42-4948-ac51-9db30b98b530 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Getting quotas for project 1a23a85365414f92bbc03177d7f190e6. Resources: {'server_groups'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:38:47.643482 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-9fa70824-6c42-4948-ac51-9db30b98b530 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Getting quotas for user e36f4114dc4f443f8b48da7b4027e0c1 and project 1a23a85365414f92bbc03177d7f190e6. Resources: {'server_groups'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:38:47.656332 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-9fa70824-6c42-4948-ac51-9db30b98b530 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] 10.222.0.33 "POST /compute/v2.1/os-server-groups" status: 200 len: 193 microversion: 2.1 time: 0.256409 Oct 04 20:38:47.657735 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 703/1352] 10.222.0.33 () {60 vars in 1174 bytes} [Tue Oct 4 20:38:47 2022] POST /compute/v2.1/os-server-groups => generated 193 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:38:47.851681 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-af4c1ee7-1a28-4ea0-a948-b6b8268fb34e tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:47.852414 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-af4c1ee7-1a28-4ea0-a948-b6b8268fb34e tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] [instance: 8a72de6a-64a0-4ec7-a613-576f8ac02af3] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:47.863747 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-af4c1ee7-1a28-4ea0-a948-b6b8268fb34e tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:47.864976 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-af4c1ee7-1a28-4ea0-a948-b6b8268fb34e tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:47.869125 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-af4c1ee7-1a28-4ea0-a948-b6b8268fb34e tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:47.869926 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-af4c1ee7-1a28-4ea0-a948-b6b8268fb34e tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:47.870429 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-af4c1ee7-1a28-4ea0-a948-b6b8268fb34e tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:47.870872 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-af4c1ee7-1a28-4ea0-a948-b6b8268fb34e tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:48.178318 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-3a582173-5809-4ad8-9134-a12909521aca tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:48.192557 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-3a582173-5809-4ad8-9134-a12909521aca tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:48.197452 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-3a582173-5809-4ad8-9134-a12909521aca tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:48.198880 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-3a582173-5809-4ad8-9134-a12909521aca tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] 10.222.0.33 "GET /compute/v2.1/servers/81748c83-b703-4c68-899c-c575cc3340d2" status: 200 len: 1605 microversion: 2.25 time: 0.697237 Oct 04 20:38:48.199715 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 650/1353] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:38:47 2022] GET /compute/v2.1/servers/81748c83-b703-4c68-899c-c575cc3340d2 => generated 1605 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:38:48.207527 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5cb55407-5d98-4fa3-8911-acd088429519 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-748773578", "imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "a27428b4-242f-42e1-b297-1a93e60f513e"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:38:48.235110 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-af4c1ee7-1a28-4ea0-a948-b6b8268fb34e tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '800db3a57ada47eca381b00189fdbf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66ec8ea91b04deb90b679589e0495bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:48.247337 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-af4c1ee7-1a28-4ea0-a948-b6b8268fb34e tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] 10.222.0.33 "GET /compute/v2.1/servers/8a72de6a-64a0-4ec7-a613-576f8ac02af3" status: 200 len: 1503 microversion: 2.1 time: 0.398630 Oct 04 20:38:48.247945 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 704/1354] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:38:47 2022] GET /compute/v2.1/servers/8a72de6a-64a0-4ec7-a613-576f8ac02af3 => generated 1503 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:38:48.254876 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-d6ca4812-cf3e-41e9-ad85-cb4fe438929e req-ed527e99-8046-450f-93b7-61c8fbee9101 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "acecffb2-4128-4bd7-8bc3-7529881b64ed", "name": "network-vif-deleted", "tag": "db43bc12-c09e-49c1-a9c7-99d45670ecf7"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:38:48.271670 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-d6ca4812-cf3e-41e9-ad85-cb4fe438929e req-ed527e99-8046-450f-93b7-61c8fbee9101 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:48.272271 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-d6ca4812-cf3e-41e9-ad85-cb4fe438929e req-ed527e99-8046-450f-93b7-61c8fbee9101 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:48.272764 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-d6ca4812-cf3e-41e9-ad85-cb4fe438929e req-ed527e99-8046-450f-93b7-61c8fbee9101 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:48.303283 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.network.neutron [None req-5cb55407-5d98-4fa3-8911-acd088429519 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] validate_networks() for None {{(pid=128801) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:38:48.307391 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-d6ca4812-cf3e-41e9-ad85-cb4fe438929e req-ed527e99-8046-450f-93b7-61c8fbee9101 service nova] Creating event network-vif-deleted:db43bc12-c09e-49c1-a9c7-99d45670ecf7 for instance acecffb2-4128-4bd7-8bc3-7529881b64ed on n-h1-854823-8 Oct 04 20:38:48.314789 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-d6ca4812-cf3e-41e9-ad85-cb4fe438929e req-ed527e99-8046-450f-93b7-61c8fbee9101 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063542 Oct 04 20:38:48.316460 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 705/1355] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:38:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:38:48.323136 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-bcf3e44a-7eaa-446b-8565-8d7b349251fb tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:48.324791 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-bcf3e44a-7eaa-446b-8565-8d7b349251fb tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] [instance: 81748c83-b703-4c68-899c-c575cc3340d2] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:48.336321 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bcf3e44a-7eaa-446b-8565-8d7b349251fb tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:48.337232 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bcf3e44a-7eaa-446b-8565-8d7b349251fb tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:48.337601 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bcf3e44a-7eaa-446b-8565-8d7b349251fb tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:48.339062 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bcf3e44a-7eaa-446b-8565-8d7b349251fb tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:48.339568 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bcf3e44a-7eaa-446b-8565-8d7b349251fb tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:48.340640 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bcf3e44a-7eaa-446b-8565-8d7b349251fb tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:48.570545 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-bcf3e44a-7eaa-446b-8565-8d7b349251fb tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] 10.222.0.33 "GET /compute/v2.1/servers/81748c83-b703-4c68-899c-c575cc3340d2/os-interface" status: 200 len: 285 microversion: 2.25 time: 0.252434 Oct 04 20:38:48.572672 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 706/1356] 10.222.0.33 () {60 vars in 1316 bytes} [Tue Oct 4 20:38:48 2022] GET /compute/v2.1/servers/81748c83-b703-4c68-899c-c575cc3340d2/os-interface => generated 285 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 20:38:48.582498 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-563a20b2-73d9-447e-93cc-72314a5116ea tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:48.583363 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-563a20b2-73d9-447e-93cc-72314a5116ea tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] [instance: acecffb2-4128-4bd7-8bc3-7529881b64ed] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:48.590670 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-563a20b2-73d9-447e-93cc-72314a5116ea tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:48.591337 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-563a20b2-73d9-447e-93cc-72314a5116ea tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:48.591929 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-563a20b2-73d9-447e-93cc-72314a5116ea tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:48.593006 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-563a20b2-73d9-447e-93cc-72314a5116ea tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:48.593632 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-563a20b2-73d9-447e-93cc-72314a5116ea tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:48.594213 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-563a20b2-73d9-447e-93cc-72314a5116ea tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:48.630616 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-563a20b2-73d9-447e-93cc-72314a5116ea tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:48.631465 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-563a20b2-73d9-447e-93cc-72314a5116ea tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:48.632064 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-563a20b2-73d9-447e-93cc-72314a5116ea tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:48.632684 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.objects.instance [None req-563a20b2-73d9-447e-93cc-72314a5116ea tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] Lazy-loading 'fault' on Instance uuid acecffb2-4128-4bd7-8bc3-7529881b64ed {{(pid=128802) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:38:48.711631 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-563a20b2-73d9-447e-93cc-72314a5116ea tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d46a7cdc204e808eabedbad9c5aea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '870c8d858eb44228acd9bbe345a1143c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:48.723486 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-563a20b2-73d9-447e-93cc-72314a5116ea tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] 10.222.0.33 "GET /compute/v2.1/servers/acecffb2-4128-4bd7-8bc3-7529881b64ed" status: 200 len: 1306 microversion: 2.1 time: 0.149443 Oct 04 20:38:48.736024 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 707/1357] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:38:48 2022] GET /compute/v2.1/servers/acecffb2-4128-4bd7-8bc3-7529881b64ed => generated 1306 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:38:48.751633 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-996bd5c4-ff18-4393-bbca-9e514ff08118 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:48.753562 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-996bd5c4-ff18-4393-bbca-9e514ff08118 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] [instance: 23da26ba-68f4-4aef-b13c-0b6588a65e43] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:48.763493 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-996bd5c4-ff18-4393-bbca-9e514ff08118 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:48.764288 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-996bd5c4-ff18-4393-bbca-9e514ff08118 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:48.765732 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-996bd5c4-ff18-4393-bbca-9e514ff08118 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:48.766714 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-996bd5c4-ff18-4393-bbca-9e514ff08118 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:48.768426 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-996bd5c4-ff18-4393-bbca-9e514ff08118 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:48.769671 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-996bd5c4-ff18-4393-bbca-9e514ff08118 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:48.776725 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:38:49.218548 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-5cb55407-5d98-4fa3-8911-acd088429519 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Flavor limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:38:49.219770 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-5cb55407-5d98-4fa3-8911-acd088429519 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Image limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:38:49.220494 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-5cb55407-5d98-4fa3-8911-acd088429519 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Flavor pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:38:49.221388 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-5cb55407-5d98-4fa3-8911-acd088429519 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Image pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:38:49.223369 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-5cb55407-5d98-4fa3-8911-acd088429519 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:38:49.256820 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5cb55407-5d98-4fa3-8911-acd088429519 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:49.257976 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5cb55407-5d98-4fa3-8911-acd088429519 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:49.257976 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5cb55407-5d98-4fa3-8911-acd088429519 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:49.258813 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5cb55407-5d98-4fa3-8911-acd088429519 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:49.259369 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5cb55407-5d98-4fa3-8911-acd088429519 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:49.260057 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5cb55407-5d98-4fa3-8911-acd088429519 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:49.264356 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-996bd5c4-ff18-4393-bbca-9e514ff08118 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3563efe2b8c94931a2a46c4e14811b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3118a5d96843d3bede1ed94bd9717e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:49.285790 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-996bd5c4-ff18-4393-bbca-9e514ff08118 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] 10.222.0.33 "GET /compute/v2.1/servers/23da26ba-68f4-4aef-b13c-0b6588a65e43" status: 200 len: 1477 microversion: 2.1 time: 0.542506 Oct 04 20:38:49.292117 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-5cb55407-5d98-4fa3-8911-acd088429519 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Getting quotas for project 1a23a85365414f92bbc03177d7f190e6. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:38:49.297686 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-5cb55407-5d98-4fa3-8911-acd088429519 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Getting quotas for user e36f4114dc4f443f8b48da7b4027e0c1 and project 1a23a85365414f92bbc03177d7f190e6. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:38:49.297962 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 708/1358] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:38:48 2022] GET /compute/v2.1/servers/23da26ba-68f4-4aef-b13c-0b6588a65e43 => generated 1477 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:38:49.307253 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-5d74d052-5fac-4c4b-a353-c51c7b8f94da tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:49.308087 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-5d74d052-5fac-4c4b-a353-c51c7b8f94da tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] [instance: 8a72de6a-64a0-4ec7-a613-576f8ac02af3] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:49.310593 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=1,nova_api:INSERT=2 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:38:49.318478 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5d74d052-5fac-4c4b-a353-c51c7b8f94da tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:49.321187 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5d74d052-5fac-4c4b-a353-c51c7b8f94da tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:49.322320 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5d74d052-5fac-4c4b-a353-c51c7b8f94da tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:49.325756 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5d74d052-5fac-4c4b-a353-c51c7b8f94da tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:49.326445 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5d74d052-5fac-4c4b-a353-c51c7b8f94da tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:49.327035 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5d74d052-5fac-4c4b-a353-c51c7b8f94da tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:49.338649 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-5cb55407-5d98-4fa3-8911-acd088429519 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Going to run 2 instances... {{(pid=128801) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:38:49.341530 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-5cb55407-5d98-4fa3-8911-acd088429519 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] [instance: 55d73a76-3d5e-426c-8a99-9cae92f8498b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='15b24725-0c99-4bcf-b1fb-907cdf8e2d63',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128801) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:38:49.375090 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=100 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:38:49.449386 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-5cb55407-5d98-4fa3-8911-acd088429519 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Getting quotas for project 1a23a85365414f92bbc03177d7f190e6. Resources: {'server_group_members'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:38:49.455472 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-5cb55407-5d98-4fa3-8911-acd088429519 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Getting quotas for user e36f4114dc4f443f8b48da7b4027e0c1 and project 1a23a85365414f92bbc03177d7f190e6. Resources: {'server_group_members'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:38:49.551842 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-5cb55407-5d98-4fa3-8911-acd088429519 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Getting quotas for project 1a23a85365414f92bbc03177d7f190e6. Resources: {'server_group_members'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:38:49.557474 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-5cb55407-5d98-4fa3-8911-acd088429519 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Getting quotas for user e36f4114dc4f443f8b48da7b4027e0c1 and project 1a23a85365414f92bbc03177d7f190e6. Resources: {'server_group_members'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:38:49.580287 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-5cb55407-5d98-4fa3-8911-acd088429519 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] [instance: a1e8b81b-5e26-4d5c-87ca-057eea43abba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='15b24725-0c99-4bcf-b1fb-907cdf8e2d63',instance=,instance_uuid=55d73a76-3d5e-426c-8a99-9cae92f8498b,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128801) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:38:49.660063 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-5cb55407-5d98-4fa3-8911-acd088429519 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Getting quotas for project 1a23a85365414f92bbc03177d7f190e6. Resources: {'server_group_members'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:38:49.677401 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-5cb55407-5d98-4fa3-8911-acd088429519 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Getting quotas for user e36f4114dc4f443f8b48da7b4027e0c1 and project 1a23a85365414f92bbc03177d7f190e6. Resources: {'server_group_members'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:38:49.733434 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-5cb55407-5d98-4fa3-8911-acd088429519 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Getting quotas for project 1a23a85365414f92bbc03177d7f190e6. Resources: {'server_group_members'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:38:49.738323 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-5cb55407-5d98-4fa3-8911-acd088429519 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Getting quotas for user e36f4114dc4f443f8b48da7b4027e0c1 and project 1a23a85365414f92bbc03177d7f190e6. Resources: {'server_group_members'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:38:49.774285 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5cb55407-5d98-4fa3-8911-acd088429519 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.572738 Oct 04 20:38:49.774940 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 651/1359] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 20:38:48 2022] POST /compute/v2.1/servers => generated 32 bytes in 1574 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Oct 04 20:38:49.780444 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f4923042-3022-4552-bf32-4ba58379c376 tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:49.781069 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f4923042-3022-4552-bf32-4ba58379c376 tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] [instance: acecffb2-4128-4bd7-8bc3-7529881b64ed] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:49.788766 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f4923042-3022-4552-bf32-4ba58379c376 tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:49.789258 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f4923042-3022-4552-bf32-4ba58379c376 tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:49.789692 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f4923042-3022-4552-bf32-4ba58379c376 tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:49.790411 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f4923042-3022-4552-bf32-4ba58379c376 tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:49.790863 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f4923042-3022-4552-bf32-4ba58379c376 tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:49.791283 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f4923042-3022-4552-bf32-4ba58379c376 tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:49.807597 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-f4923042-3022-4552-bf32-4ba58379c376 tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] HTTP exception thrown: Instance acecffb2-4128-4bd7-8bc3-7529881b64ed could not be found. Oct 04 20:38:49.809691 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f4923042-3022-4552-bf32-4ba58379c376 tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] Request method failure captured: Oct 04 20:38:49.809691 n-d-854823-8 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/acecffb2-4128-4bd7-8bc3-7529881b64ed HTTP/1.1 Oct 04 20:38:49.809691 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:38:49.809691 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:38:49.809691 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:38:49.809691 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 0 Oct 04 20:38:49.809691 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:38:49.809691 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:38:49.809691 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:38:49.809691 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:38:49.809691 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJm4gGdVAKeh1NNkdH0ZCsKDQTmLA2Ej1Y3a9kA_8XlezihgUBVKwc90ImC1njaYJb7ngTb4V87z14dfjy0Hn9NpBu9V1qVWAaGVgV795Fb1zPwmsgc4kAsnXSs3SObpL8cIOP9WEHVRz560l9owLqdl8CKd4HoQSbV6kYjNFo8uUC0 Oct 04 20:38:49.809691 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:38:49.809691 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:38:49.809691 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:38:49.809691 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:38:49.809691 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:38:49.809691 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:38:49.809691 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: 870c8d858eb44228acd9bbe345a1143c Oct 04 20:38:49.809691 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-InstanceActionsTestJSON-1431841168 Oct 04 20:38:49.809691 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 20:38:49.809691 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 20:38:49.809691 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_870c8d858eb44228acd9bbe345a1143c", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/870c8d858eb44228acd9bbe345a1143c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/870c8d858eb44228acd9bbe345a1143c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/870c8d858eb44228acd9bbe345a1143c"}]}] Oct 04 20:38:49.809691 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-InstanceActionsTestJSON-1431841168 Oct 04 20:38:49.809691 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: 870c8d858eb44228acd9bbe345a1143c Oct 04 20:38:49.809691 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-InstanceActionsTestJSON-1431841168 Oct 04 20:38:49.809691 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-InstanceActionsTestJSON-1431841168-project Oct 04 20:38:49.809691 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:38:49.809691 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:38:49.809691 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: 58d46a7cdc204e808eabedbad9c5aea6 Oct 04 20:38:49.809691 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-InstanceActionsTestJSON-1431841168-project Oct 04 20:38:49.809691 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 20:38:49.809691 n-d-854823-8 devstack@n-api.service[128801]: exception: Instance acecffb2-4128-4bd7-8bc3-7529881b64ed could not be found. Oct 04 20:38:49.809691 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': 'acecffb2-4128-4bd7-8bc3-7529881b64ed'} Oct 04 20:38:49.809691 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:38:49.809691 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:38:49.809691 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:38:49.809691 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:38:49.809691 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:38:49.809691 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:38:49.809691 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:38:49.809691 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:38:49.809691 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:38:49.809691 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:38:49.809691 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance acecffb2-4128-4bd7-8bc3-7529881b64ed could not be found. Oct 04 20:38:49.809691 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:38:49.809691 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:38:49.809691 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:38:49.809691 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:38:49.809691 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:38:49.809691 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:38:49.809691 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:38:49.809691 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:38:49.809691 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:38:49.809691 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:38:49.809691 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:38:49.809691 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:38:49.809691 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:38:49.809691 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:38:49.809691 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:38:49.809691 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:38:49.809691 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance acecffb2-4128-4bd7-8bc3-7529881b64ed could not be found. Oct 04 20:38:49.809691 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:38:49.809691 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:38:49.809691 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:38:49.816476 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:38:49.816476 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:38:49.816476 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:38:49.816476 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:38:49.816476 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:38:49.816476 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance acecffb2-4128-4bd7-8bc3-7529881b64ed could not be found. Oct 04 20:38:49.816476 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:38:49.816476 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f4923042-3022-4552-bf32-4ba58379c376 tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] Returning 404 to user: Instance acecffb2-4128-4bd7-8bc3-7529881b64ed could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:38:49.816476 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f4923042-3022-4552-bf32-4ba58379c376 tempest-InstanceActionsTestJSON-1431841168 tempest-InstanceActionsTestJSON-1431841168-project] 10.222.0.33 "GET /compute/v2.1/servers/acecffb2-4128-4bd7-8bc3-7529881b64ed" status: 404 len: 111 microversion: 2.1 time: 0.035219 Oct 04 20:38:49.816476 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 652/1360] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:38:49 2022] GET /compute/v2.1/servers/acecffb2-4128-4bd7-8bc3-7529881b64ed => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:38:49.820542 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a61f6850-f552-49ca-b616-3c25bc50a9e0 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:49.825467 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-a61f6850-f552-49ca-b616-3c25bc50a9e0 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e36f4114dc4f443f8b48da7b4027e0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a23a85365414f92bbc03177d7f190e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:49.826070 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a61f6850-f552-49ca-b616-3c25bc50a9e0 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Searching by: {'deleted': False, 'project_id': '1a23a85365414f92bbc03177d7f190e6'} {{(pid=128801) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 20:38:49.844664 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a61f6850-f552-49ca-b616-3c25bc50a9e0 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:49.845144 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a61f6850-f552-49ca-b616-3c25bc50a9e0 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:49.845706 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a61f6850-f552-49ca-b616-3c25bc50a9e0 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:49.846476 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a61f6850-f552-49ca-b616-3c25bc50a9e0 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:49.847730 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a61f6850-f552-49ca-b616-3c25bc50a9e0 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:49.848348 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a61f6850-f552-49ca-b616-3c25bc50a9e0 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:49.872162 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=100 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:38:49.878983 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.multi_cell_list [None req-a61f6850-f552-49ca-b616-3c25bc50a9e0 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Listed batch of 3 results from cell out of 998 limit. Returned 3 total so far. {{(pid=128801) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 20:38:49.930193 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a61f6850-f552-49ca-b616-3c25bc50a9e0 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] 10.222.0.33 "GET /compute/v2.1/servers" status: 200 len: 1663 microversion: 2.1 time: 0.113565 Oct 04 20:38:49.934399 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 653/1361] 10.222.0.33 () {58 vars in 1125 bytes} [Tue Oct 4 20:38:49 2022] GET /compute/v2.1/servers => generated 1663 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:38:49.944760 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a33bc74d-a332-46ba-b981-8f6242729d33 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:49.945376 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a33bc74d-a332-46ba-b981-8f6242729d33 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] [instance: a1e8b81b-5e26-4d5c-87ca-057eea43abba] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:50.222283 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-a33bc74d-a332-46ba-b981-8f6242729d33 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36f4114dc4f443f8b48da7b4027e0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a23a85365414f92bbc03177d7f190e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:50.231249 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a33bc74d-a332-46ba-b981-8f6242729d33 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] 10.222.0.33 "GET /compute/v2.1/servers/a1e8b81b-5e26-4d5c-87ca-057eea43abba" status: 200 len: 1218 microversion: 2.1 time: 0.290888 Oct 04 20:38:50.232238 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 654/1362] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:38:49 2022] GET /compute/v2.1/servers/a1e8b81b-5e26-4d5c-87ca-057eea43abba => generated 1218 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:38:50.311469 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-511c56dc-5c80-44b7-8fef-dd0e24d5bf1a tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:50.312363 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-511c56dc-5c80-44b7-8fef-dd0e24d5bf1a tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] [instance: 23da26ba-68f4-4aef-b13c-0b6588a65e43] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:50.324726 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-511c56dc-5c80-44b7-8fef-dd0e24d5bf1a tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:50.327062 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-511c56dc-5c80-44b7-8fef-dd0e24d5bf1a tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:50.327843 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-511c56dc-5c80-44b7-8fef-dd0e24d5bf1a tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:50.331949 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-511c56dc-5c80-44b7-8fef-dd0e24d5bf1a tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:50.332770 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-511c56dc-5c80-44b7-8fef-dd0e24d5bf1a tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:50.333714 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-511c56dc-5c80-44b7-8fef-dd0e24d5bf1a tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:50.527190 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-5d74d052-5fac-4c4b-a353-c51c7b8f94da tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '800db3a57ada47eca381b00189fdbf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66ec8ea91b04deb90b679589e0495bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:50.539934 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-5d74d052-5fac-4c4b-a353-c51c7b8f94da tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] 10.222.0.33 "GET /compute/v2.1/servers/8a72de6a-64a0-4ec7-a613-576f8ac02af3" status: 200 len: 1503 microversion: 2.1 time: 1.240431 Oct 04 20:38:50.547094 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 709/1363] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:38:49 2022] GET /compute/v2.1/servers/8a72de6a-64a0-4ec7-a613-576f8ac02af3 => generated 1503 bytes in 1248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:38:51.257664 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-7f045ac8-8b7d-4aec-8dc1-e0287bbf298e tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:51.259562 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-7f045ac8-8b7d-4aec-8dc1-e0287bbf298e tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] [instance: a1e8b81b-5e26-4d5c-87ca-057eea43abba] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:51.312763 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7f045ac8-8b7d-4aec-8dc1-e0287bbf298e tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:51.318628 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7f045ac8-8b7d-4aec-8dc1-e0287bbf298e tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:51.319093 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7f045ac8-8b7d-4aec-8dc1-e0287bbf298e tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:51.319851 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7f045ac8-8b7d-4aec-8dc1-e0287bbf298e tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:51.322104 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7f045ac8-8b7d-4aec-8dc1-e0287bbf298e tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:51.324162 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7f045ac8-8b7d-4aec-8dc1-e0287bbf298e tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:51.629202 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-511c56dc-5c80-44b7-8fef-dd0e24d5bf1a tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3563efe2b8c94931a2a46c4e14811b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3118a5d96843d3bede1ed94bd9717e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:51.646977 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-511c56dc-5c80-44b7-8fef-dd0e24d5bf1a tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] 10.222.0.33 "GET /compute/v2.1/servers/23da26ba-68f4-4aef-b13c-0b6588a65e43" status: 200 len: 1477 microversion: 2.1 time: 1.332618 Oct 04 20:38:51.650005 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 655/1364] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:38:50 2022] GET /compute/v2.1/servers/23da26ba-68f4-4aef-b13c-0b6588a65e43 => generated 1477 bytes in 1343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:38:51.667447 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7dc18594-c0ca-41b1-9b7d-2ccb72a0f140 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:51.669214 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-7dc18594-c0ca-41b1-9b7d-2ccb72a0f140 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] [instance: 8a72de6a-64a0-4ec7-a613-576f8ac02af3] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:51.693088 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7dc18594-c0ca-41b1-9b7d-2ccb72a0f140 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:51.695227 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7dc18594-c0ca-41b1-9b7d-2ccb72a0f140 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:51.697570 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7dc18594-c0ca-41b1-9b7d-2ccb72a0f140 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:51.699743 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7dc18594-c0ca-41b1-9b7d-2ccb72a0f140 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:51.701786 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7dc18594-c0ca-41b1-9b7d-2ccb72a0f140 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:51.702513 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7dc18594-c0ca-41b1-9b7d-2ccb72a0f140 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:52.080335 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-7f045ac8-8b7d-4aec-8dc1-e0287bbf298e tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36f4114dc4f443f8b48da7b4027e0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a23a85365414f92bbc03177d7f190e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:52.090868 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-7f045ac8-8b7d-4aec-8dc1-e0287bbf298e tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] 10.222.0.33 "GET /compute/v2.1/servers/a1e8b81b-5e26-4d5c-87ca-057eea43abba" status: 200 len: 1214 microversion: 2.1 time: 0.839871 Oct 04 20:38:52.110762 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 710/1365] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:38:51 2022] GET /compute/v2.1/servers/a1e8b81b-5e26-4d5c-87ca-057eea43abba => generated 1214 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:38:52.155648 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-7dc18594-c0ca-41b1-9b7d-2ccb72a0f140 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '800db3a57ada47eca381b00189fdbf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66ec8ea91b04deb90b679589e0495bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:52.165519 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-7dc18594-c0ca-41b1-9b7d-2ccb72a0f140 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] 10.222.0.33 "GET /compute/v2.1/servers/8a72de6a-64a0-4ec7-a613-576f8ac02af3" status: 200 len: 1503 microversion: 2.1 time: 0.513225 Oct 04 20:38:52.169763 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 656/1366] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:38:51 2022] GET /compute/v2.1/servers/8a72de6a-64a0-4ec7-a613-576f8ac02af3 => generated 1503 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:38:52.681727 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-bd98261f-063a-44b9-807a-6e2a90085ebe tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:52.682640 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-bd98261f-063a-44b9-807a-6e2a90085ebe tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] [instance: 23da26ba-68f4-4aef-b13c-0b6588a65e43] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:52.710686 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bd98261f-063a-44b9-807a-6e2a90085ebe tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:52.711182 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bd98261f-063a-44b9-807a-6e2a90085ebe tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:52.713794 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bd98261f-063a-44b9-807a-6e2a90085ebe tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:52.714623 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bd98261f-063a-44b9-807a-6e2a90085ebe tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:52.718884 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bd98261f-063a-44b9-807a-6e2a90085ebe tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:52.719337 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bd98261f-063a-44b9-807a-6e2a90085ebe tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:53.120761 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a3bb884c-b60f-4d7b-a062-5f03b9b98a7b tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:53.121976 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a3bb884c-b60f-4d7b-a062-5f03b9b98a7b tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] [instance: a1e8b81b-5e26-4d5c-87ca-057eea43abba] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:53.133336 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a3bb884c-b60f-4d7b-a062-5f03b9b98a7b tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:53.134100 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a3bb884c-b60f-4d7b-a062-5f03b9b98a7b tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:53.134982 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a3bb884c-b60f-4d7b-a062-5f03b9b98a7b tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:53.135955 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a3bb884c-b60f-4d7b-a062-5f03b9b98a7b tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:53.136704 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a3bb884c-b60f-4d7b-a062-5f03b9b98a7b tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:53.137505 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a3bb884c-b60f-4d7b-a062-5f03b9b98a7b tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:53.863500 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-a3bb884c-b60f-4d7b-a062-5f03b9b98a7b tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36f4114dc4f443f8b48da7b4027e0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a23a85365414f92bbc03177d7f190e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:53.876272 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a3bb884c-b60f-4d7b-a062-5f03b9b98a7b tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] 10.222.0.33 "GET /compute/v2.1/servers/a1e8b81b-5e26-4d5c-87ca-057eea43abba" status: 200 len: 1276 microversion: 2.1 time: 0.760326 Oct 04 20:38:53.876871 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 657/1367] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:38:53 2022] GET /compute/v2.1/servers/a1e8b81b-5e26-4d5c-87ca-057eea43abba => generated 1276 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:38:53.884588 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a35b0d26-2798-47c1-a1ed-25f752373443 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:53.885233 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a35b0d26-2798-47c1-a1ed-25f752373443 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] [instance: 8a72de6a-64a0-4ec7-a613-576f8ac02af3] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:53.899101 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a35b0d26-2798-47c1-a1ed-25f752373443 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:53.904314 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a35b0d26-2798-47c1-a1ed-25f752373443 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:53.905990 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a35b0d26-2798-47c1-a1ed-25f752373443 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:53.908547 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a35b0d26-2798-47c1-a1ed-25f752373443 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:53.909969 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a35b0d26-2798-47c1-a1ed-25f752373443 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:53.918015 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a35b0d26-2798-47c1-a1ed-25f752373443 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:54.098687 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-bd98261f-063a-44b9-807a-6e2a90085ebe tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3563efe2b8c94931a2a46c4e14811b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3118a5d96843d3bede1ed94bd9717e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:54.109080 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-bd98261f-063a-44b9-807a-6e2a90085ebe tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] 10.222.0.33 "GET /compute/v2.1/servers/23da26ba-68f4-4aef-b13c-0b6588a65e43" status: 200 len: 1477 microversion: 2.1 time: 1.432091 Oct 04 20:38:54.121712 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 711/1368] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:38:52 2022] GET /compute/v2.1/servers/23da26ba-68f4-4aef-b13c-0b6588a65e43 => generated 1477 bytes in 1445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:38:54.399616 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-c75f7e3a-0666-4a72-a776-17fe1600dac4 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1566930326", "imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63", "flavorRef": "452", "networks": [{"uuid": "f7c73946-c8b6-4692-9980-985e34afc9ea"}]}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:38:54.507284 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.network.neutron [None req-c75f7e3a-0666-4a72-a776-17fe1600dac4 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] validate_networks() for [('f7c73946-c8b6-4692-9980-985e34afc9ea', None, None, None, None, None)] {{(pid=128802) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:38:54.764263 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-a35b0d26-2798-47c1-a1ed-25f752373443 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '800db3a57ada47eca381b00189fdbf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66ec8ea91b04deb90b679589e0495bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:54.775703 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a35b0d26-2798-47c1-a1ed-25f752373443 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] 10.222.0.33 "GET /compute/v2.1/servers/8a72de6a-64a0-4ec7-a613-576f8ac02af3" status: 200 len: 1503 microversion: 2.1 time: 0.896069 Oct 04 20:38:54.776442 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 658/1369] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:38:53 2022] GET /compute/v2.1/servers/8a72de6a-64a0-4ec7-a613-576f8ac02af3 => generated 1503 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:38:54.905618 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f9d0fa5c-d3c0-48d5-b77a-faf1c7bda040 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:54.906274 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f9d0fa5c-d3c0-48d5-b77a-faf1c7bda040 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] [instance: a1e8b81b-5e26-4d5c-87ca-057eea43abba] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:54.913471 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f9d0fa5c-d3c0-48d5-b77a-faf1c7bda040 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:54.914125 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f9d0fa5c-d3c0-48d5-b77a-faf1c7bda040 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:54.914606 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f9d0fa5c-d3c0-48d5-b77a-faf1c7bda040 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:54.915659 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f9d0fa5c-d3c0-48d5-b77a-faf1c7bda040 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:54.916118 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f9d0fa5c-d3c0-48d5-b77a-faf1c7bda040 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:54.916940 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f9d0fa5c-d3c0-48d5-b77a-faf1c7bda040 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:55.118615 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f9d0fa5c-d3c0-48d5-b77a-faf1c7bda040 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36f4114dc4f443f8b48da7b4027e0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a23a85365414f92bbc03177d7f190e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:55.146408 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f9d0fa5c-d3c0-48d5-b77a-faf1c7bda040 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] 10.222.0.33 "GET /compute/v2.1/servers/a1e8b81b-5e26-4d5c-87ca-057eea43abba" status: 200 len: 1276 microversion: 2.1 time: 0.244831 Oct 04 20:38:55.148788 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 659/1370] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:38:54 2022] GET /compute/v2.1/servers/a1e8b81b-5e26-4d5c-87ca-057eea43abba => generated 1276 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:38:55.160986 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-134218dc-ed34-45ca-b00f-369c8e0a2227 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:55.162850 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-134218dc-ed34-45ca-b00f-369c8e0a2227 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] [instance: 23da26ba-68f4-4aef-b13c-0b6588a65e43] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:55.177975 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-134218dc-ed34-45ca-b00f-369c8e0a2227 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:55.178680 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-134218dc-ed34-45ca-b00f-369c8e0a2227 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:55.180703 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-134218dc-ed34-45ca-b00f-369c8e0a2227 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:55.193166 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-134218dc-ed34-45ca-b00f-369c8e0a2227 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:55.196011 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-134218dc-ed34-45ca-b00f-369c8e0a2227 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:55.196798 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-134218dc-ed34-45ca-b00f-369c8e0a2227 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:55.884141 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-134218dc-ed34-45ca-b00f-369c8e0a2227 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3563efe2b8c94931a2a46c4e14811b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3118a5d96843d3bede1ed94bd9717e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:55.892984 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-134218dc-ed34-45ca-b00f-369c8e0a2227 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] 10.222.0.33 "GET /compute/v2.1/servers/23da26ba-68f4-4aef-b13c-0b6588a65e43" status: 200 len: 1477 microversion: 2.1 time: 0.740951 Oct 04 20:38:55.907006 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 660/1371] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:38:55 2022] GET /compute/v2.1/servers/23da26ba-68f4-4aef-b13c-0b6588a65e43 => generated 1477 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:38:55.915553 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-6a405a82-9cb7-43d1-8015-68be4ea8b806 req-92ef16ec-10b2-4a2c-ad57-b0ae444f8a2a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81748c83-b703-4c68-899c-c575cc3340d2", "tag": "c2865aee-fb0f-4bf6-91f8-8215288d29f5"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:38:55.926558 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-6a405a82-9cb7-43d1-8015-68be4ea8b806 req-92ef16ec-10b2-4a2c-ad57-b0ae444f8a2a service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:55.927702 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-6a405a82-9cb7-43d1-8015-68be4ea8b806 req-92ef16ec-10b2-4a2c-ad57-b0ae444f8a2a service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:55.928285 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-6a405a82-9cb7-43d1-8015-68be4ea8b806 req-92ef16ec-10b2-4a2c-ad57-b0ae444f8a2a service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:55.942104 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-6a405a82-9cb7-43d1-8015-68be4ea8b806 req-92ef16ec-10b2-4a2c-ad57-b0ae444f8a2a service nova] Creating event network-changed:c2865aee-fb0f-4bf6-91f8-8215288d29f5 for instance 81748c83-b703-4c68-899c-c575cc3340d2 on n-h2-854823-8 Oct 04 20:38:55.948404 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-6a405a82-9cb7-43d1-8015-68be4ea8b806 req-92ef16ec-10b2-4a2c-ad57-b0ae444f8a2a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039788 Oct 04 20:38:55.949592 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 661/1372] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:38:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:38:55.955529 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-78a56431-c5fd-4591-8672-69e6e926448f tempest-ImagesMetadataTestJSON-902088131 tempest-ImagesMetadataTestJSON-902088131-project] Calling method '.version_select at 0x7f3c749764c0>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:56.024169 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-78a56431-c5fd-4591-8672-69e6e926448f tempest-ImagesMetadataTestJSON-902088131 tempest-ImagesMetadataTestJSON-902088131-project] 10.222.0.33 "GET /compute/v2.1/images/0a983cdf-96f8-4d03-ab30-968995a2ff3e" status: 200 len: 637 microversion: 2.1 time: 0.072966 Oct 04 20:38:56.025422 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 662/1373] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 20:38:55 2022] GET /compute/v2.1/images/0a983cdf-96f8-4d03-ab30-968995a2ff3e => generated 637 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:38:56.033758 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5940f429-1486-4292-ae03-6a20e437964b tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:56.037725 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-5940f429-1486-4292-ae03-6a20e437964b tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] [instance: 8a72de6a-64a0-4ec7-a613-576f8ac02af3] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:56.046719 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5940f429-1486-4292-ae03-6a20e437964b tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:56.048151 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5940f429-1486-4292-ae03-6a20e437964b tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:56.048867 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5940f429-1486-4292-ae03-6a20e437964b tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:56.051108 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5940f429-1486-4292-ae03-6a20e437964b tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:56.051869 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5940f429-1486-4292-ae03-6a20e437964b tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:56.052544 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5940f429-1486-4292-ae03-6a20e437964b tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:56.804391 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-c75f7e3a-0666-4a72-a776-17fe1600dac4 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Flavor limits 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:38:56.804897 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-c75f7e3a-0666-4a72-a776-17fe1600dac4 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Image limits 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:38:56.805564 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-c75f7e3a-0666-4a72-a776-17fe1600dac4 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Flavor pref 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:38:56.806609 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-c75f7e3a-0666-4a72-a776-17fe1600dac4 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Image pref 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:38:56.807390 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-c75f7e3a-0666-4a72-a776-17fe1600dac4 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:38:56.824696 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c75f7e3a-0666-4a72-a776-17fe1600dac4 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:56.826115 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c75f7e3a-0666-4a72-a776-17fe1600dac4 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:56.827145 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c75f7e3a-0666-4a72-a776-17fe1600dac4 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:56.829230 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c75f7e3a-0666-4a72-a776-17fe1600dac4 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:56.830784 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c75f7e3a-0666-4a72-a776-17fe1600dac4 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:56.832663 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c75f7e3a-0666-4a72-a776-17fe1600dac4 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:56.877642 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-c75f7e3a-0666-4a72-a776-17fe1600dac4 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Getting quotas for project ecf3793be3eb4f3186c07a7e45fd8f06. Resources: {'ram', 'instances', 'cores'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:38:56.883297 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-c75f7e3a-0666-4a72-a776-17fe1600dac4 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Getting quotas for user 89a82c49a62249029ebc6ae3b4829709 and project ecf3793be3eb4f3186c07a7e45fd8f06. Resources: {'ram', 'instances', 'cores'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:38:56.907674 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-c75f7e3a-0666-4a72-a776-17fe1600dac4 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Going to run 1 instances... {{(pid=128802) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:38:56.912280 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-c75f7e3a-0666-4a72-a776-17fe1600dac4 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] [instance: d2173117-c1c5-4c2d-9658-914e67649cdd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='15b24725-0c99-4bcf-b1fb-907cdf8e2d63',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128802) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:38:57.019153 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-c75f7e3a-0666-4a72-a776-17fe1600dac4 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.890187 Oct 04 20:38:57.021855 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 712/1374] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 20:38:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 2899 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 20:38:57.028802 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-a52c0c4a-6d86-4b22-bbc3-531a6f0d6deb tempest-ImagesMetadataTestJSON-902088131 tempest-ImagesMetadataTestJSON-902088131-project] Action: 'update_all', calling method: .version_select at 0x7f3c7450d5e0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:38:57.165652 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-a52c0c4a-6d86-4b22-bbc3-531a6f0d6deb tempest-ImagesMetadataTestJSON-902088131 tempest-ImagesMetadataTestJSON-902088131-project] Getting quotas for project 76c855450dae45ab806ba873da9a76b6. Resources: dict_keys(['metadata_items']) {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:38:57.171601 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-a52c0c4a-6d86-4b22-bbc3-531a6f0d6deb tempest-ImagesMetadataTestJSON-902088131 tempest-ImagesMetadataTestJSON-902088131-project] Getting quotas for user 0e2167d601c14dc1a4b7a1f952cc6313 and project 76c855450dae45ab806ba873da9a76b6. Resources: dict_keys(['metadata_items']) {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:38:57.185124 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-5940f429-1486-4292-ae03-6a20e437964b tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '800db3a57ada47eca381b00189fdbf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66ec8ea91b04deb90b679589e0495bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:57.199185 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5940f429-1486-4292-ae03-6a20e437964b tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] 10.222.0.33 "GET /compute/v2.1/servers/8a72de6a-64a0-4ec7-a613-576f8ac02af3" status: 200 len: 1503 microversion: 2.1 time: 1.172345 Oct 04 20:38:57.200143 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 663/1375] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:38:56 2022] GET /compute/v2.1/servers/8a72de6a-64a0-4ec7-a613-576f8ac02af3 => generated 1503 bytes in 1174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:38:57.205063 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-73881e01-8986-48a6-bad0-c33c899498c1 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:57.205959 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-73881e01-8986-48a6-bad0-c33c899498c1 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] [instance: a1e8b81b-5e26-4d5c-87ca-057eea43abba] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:57.226910 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-73881e01-8986-48a6-bad0-c33c899498c1 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:57.234809 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-73881e01-8986-48a6-bad0-c33c899498c1 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:57.235264 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-73881e01-8986-48a6-bad0-c33c899498c1 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:57.236013 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-73881e01-8986-48a6-bad0-c33c899498c1 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:57.236561 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-73881e01-8986-48a6-bad0-c33c899498c1 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:57.236893 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-73881e01-8986-48a6-bad0-c33c899498c1 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:57.500267 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-73881e01-8986-48a6-bad0-c33c899498c1 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36f4114dc4f443f8b48da7b4027e0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a23a85365414f92bbc03177d7f190e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:57.563828 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-73881e01-8986-48a6-bad0-c33c899498c1 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] 10.222.0.33 "GET /compute/v2.1/servers/a1e8b81b-5e26-4d5c-87ca-057eea43abba" status: 200 len: 1276 microversion: 2.1 time: 0.358991 Oct 04 20:38:57.565262 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 664/1376] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:38:57 2022] GET /compute/v2.1/servers/a1e8b81b-5e26-4d5c-87ca-057eea43abba => generated 1276 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:38:57.584829 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-cf2cbcf7-c7a1-43ae-9138-41c7e5e149e4 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:57.585831 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-cf2cbcf7-c7a1-43ae-9138-41c7e5e149e4 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] [instance: 23da26ba-68f4-4aef-b13c-0b6588a65e43] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:57.611056 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cf2cbcf7-c7a1-43ae-9138-41c7e5e149e4 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:57.613078 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cf2cbcf7-c7a1-43ae-9138-41c7e5e149e4 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:57.614568 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cf2cbcf7-c7a1-43ae-9138-41c7e5e149e4 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:57.616316 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cf2cbcf7-c7a1-43ae-9138-41c7e5e149e4 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:57.616965 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cf2cbcf7-c7a1-43ae-9138-41c7e5e149e4 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:57.618656 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cf2cbcf7-c7a1-43ae-9138-41c7e5e149e4 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:57.881726 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-a52c0c4a-6d86-4b22-bbc3-531a6f0d6deb tempest-ImagesMetadataTestJSON-902088131 tempest-ImagesMetadataTestJSON-902088131-project] 10.222.0.33 "PUT /compute/v2.1/images/0a983cdf-96f8-4d03-ab30-968995a2ff3e/metadata" status: 200 len: 61 microversion: 2.1 time: 0.858360 Oct 04 20:38:57.883090 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 713/1377] 10.222.0.33 () {60 vars in 1280 bytes} [Tue Oct 4 20:38:57 2022] PUT /compute/v2.1/images/0a983cdf-96f8-4d03-ab30-968995a2ff3e/metadata => generated 61 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 20:38:57.891926 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-e8c50ecd-3a83-4be9-80cd-4cfc74a5a0ff tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:57.894940 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-e8c50ecd-3a83-4be9-80cd-4cfc74a5a0ff tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] [instance: d2173117-c1c5-4c2d-9658-914e67649cdd] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:58.085216 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-e8c50ecd-3a83-4be9-80cd-4cfc74a5a0ff tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a82c49a62249029ebc6ae3b4829709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecf3793be3eb4f3186c07a7e45fd8f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:58.097620 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-e8c50ecd-3a83-4be9-80cd-4cfc74a5a0ff tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] 10.222.0.33 "GET /compute/v2.1/servers/d2173117-c1c5-4c2d-9658-914e67649cdd" status: 200 len: 1225 microversion: 2.1 time: 0.212054 Oct 04 20:38:58.098965 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 714/1378] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:38:57 2022] GET /compute/v2.1/servers/d2173117-c1c5-4c2d-9658-914e67649cdd => generated 1225 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:38:58.104311 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-bcf856ea-a26c-4766-8b56-ad50b1aba2cd tempest-ImagesMetadataTestJSON-902088131 tempest-ImagesMetadataTestJSON-902088131-project] Calling method '.version_select at 0x7f3c7448c4c0>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:58.428059 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-cf2cbcf7-c7a1-43ae-9138-41c7e5e149e4 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3563efe2b8c94931a2a46c4e14811b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3118a5d96843d3bede1ed94bd9717e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:58.447095 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-cf2cbcf7-c7a1-43ae-9138-41c7e5e149e4 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] 10.222.0.33 "GET /compute/v2.1/servers/23da26ba-68f4-4aef-b13c-0b6588a65e43" status: 200 len: 1477 microversion: 2.1 time: 0.878522 Oct 04 20:38:58.447702 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 665/1379] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:38:57 2022] GET /compute/v2.1/servers/23da26ba-68f4-4aef-b13c-0b6588a65e43 => generated 1477 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:38:58.452793 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0631b292-0caf-4ab2-afe1-25fc925adbfe tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:58.453656 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-0631b292-0caf-4ab2-afe1-25fc925adbfe tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] [instance: 8a72de6a-64a0-4ec7-a613-576f8ac02af3] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:58.465930 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0631b292-0caf-4ab2-afe1-25fc925adbfe tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:58.466781 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0631b292-0caf-4ab2-afe1-25fc925adbfe tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:58.467767 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0631b292-0caf-4ab2-afe1-25fc925adbfe tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:58.468665 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0631b292-0caf-4ab2-afe1-25fc925adbfe tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:58.474096 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0631b292-0caf-4ab2-afe1-25fc925adbfe tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:58.475493 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0631b292-0caf-4ab2-afe1-25fc925adbfe tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:58.496723 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-bcf856ea-a26c-4766-8b56-ad50b1aba2cd tempest-ImagesMetadataTestJSON-902088131 tempest-ImagesMetadataTestJSON-902088131-project] 10.222.0.33 "DELETE /compute/v2.1/images/0a983cdf-96f8-4d03-ab30-968995a2ff3e/metadata/os_version" status: 204 len: 0 microversion: 2.1 time: 0.396382 Oct 04 20:38:58.497305 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 715/1380] 10.222.0.33 () {58 vars in 1296 bytes} [Tue Oct 4 20:38:58 2022] DELETE /compute/v2.1/images/0a983cdf-96f8-4d03-ab30-968995a2ff3e/metadata/os_version => generated 0 bytes in 398 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:38:58.509018 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-9a0812c1-6bd1-48fe-b4ca-716564684f15 tempest-ImagesMetadataTestJSON-902088131 tempest-ImagesMetadataTestJSON-902088131-project] Calling method '.version_select at 0x7f3c743321f0>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:58.577943 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-9a0812c1-6bd1-48fe-b4ca-716564684f15 tempest-ImagesMetadataTestJSON-902088131 tempest-ImagesMetadataTestJSON-902088131-project] 10.222.0.33 "GET /compute/v2.1/images/0a983cdf-96f8-4d03-ab30-968995a2ff3e/metadata" status: 200 len: 37 microversion: 2.1 time: 0.075393 Oct 04 20:38:58.579028 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 716/1381] 10.222.0.33 () {58 vars in 1260 bytes} [Tue Oct 4 20:38:58 2022] GET /compute/v2.1/images/0a983cdf-96f8-4d03-ab30-968995a2ff3e/metadata => generated 37 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 04 20:38:58.590656 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-a64c83ed-c624-4498-b4dc-1352f496d799 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:58.591280 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-a64c83ed-c624-4498-b4dc-1352f496d799 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] [instance: a1e8b81b-5e26-4d5c-87ca-057eea43abba] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:58.598530 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a64c83ed-c624-4498-b4dc-1352f496d799 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:58.599027 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a64c83ed-c624-4498-b4dc-1352f496d799 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:58.599461 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a64c83ed-c624-4498-b4dc-1352f496d799 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:58.601214 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a64c83ed-c624-4498-b4dc-1352f496d799 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:58.601913 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a64c83ed-c624-4498-b4dc-1352f496d799 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:58.602540 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a64c83ed-c624-4498-b4dc-1352f496d799 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:58.709783 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-a64c83ed-c624-4498-b4dc-1352f496d799 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36f4114dc4f443f8b48da7b4027e0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a23a85365414f92bbc03177d7f190e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:58.729336 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-a64c83ed-c624-4498-b4dc-1352f496d799 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] 10.222.0.33 "GET /compute/v2.1/servers/a1e8b81b-5e26-4d5c-87ca-057eea43abba" status: 200 len: 1276 microversion: 2.1 time: 0.142991 Oct 04 20:38:58.730602 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 717/1382] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:38:58 2022] GET /compute/v2.1/servers/a1e8b81b-5e26-4d5c-87ca-057eea43abba => generated 1276 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:38:58.736642 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-2dabf548-41e6-460b-b786-a358111d0233 tempest-ImagesMetadataTestJSON-902088131 tempest-ImagesMetadataTestJSON-902088131-project] Action: 'update_all', calling method: .version_select at 0x7f3c7432b040>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:38:58.829929 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-2dabf548-41e6-460b-b786-a358111d0233 tempest-ImagesMetadataTestJSON-902088131 tempest-ImagesMetadataTestJSON-902088131-project] Getting quotas for project 76c855450dae45ab806ba873da9a76b6. Resources: dict_keys(['metadata_items']) {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:38:58.837516 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-2dabf548-41e6-460b-b786-a358111d0233 tempest-ImagesMetadataTestJSON-902088131 tempest-ImagesMetadataTestJSON-902088131-project] Getting quotas for user 0e2167d601c14dc1a4b7a1f952cc6313 and project 76c855450dae45ab806ba873da9a76b6. Resources: dict_keys(['metadata_items']) {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:38:59.000470 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-0631b292-0caf-4ab2-afe1-25fc925adbfe tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '800db3a57ada47eca381b00189fdbf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66ec8ea91b04deb90b679589e0495bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:59.009780 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-0631b292-0caf-4ab2-afe1-25fc925adbfe tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] 10.222.0.33 "GET /compute/v2.1/servers/8a72de6a-64a0-4ec7-a613-576f8ac02af3" status: 200 len: 1503 microversion: 2.1 time: 0.560859 Oct 04 20:38:59.016851 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 666/1383] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:38:58 2022] GET /compute/v2.1/servers/8a72de6a-64a0-4ec7-a613-576f8ac02af3 => generated 1503 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:38:59.123703 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-622040bb-64fa-4615-97c6-6b3eb27c432c tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:59.124318 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-622040bb-64fa-4615-97c6-6b3eb27c432c tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] [instance: d2173117-c1c5-4c2d-9658-914e67649cdd] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:59.136371 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-622040bb-64fa-4615-97c6-6b3eb27c432c tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:59.136878 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-622040bb-64fa-4615-97c6-6b3eb27c432c tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:59.137319 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-622040bb-64fa-4615-97c6-6b3eb27c432c tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:59.138037 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-622040bb-64fa-4615-97c6-6b3eb27c432c tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:59.138543 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-622040bb-64fa-4615-97c6-6b3eb27c432c tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:59.138977 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-622040bb-64fa-4615-97c6-6b3eb27c432c tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:59.411201 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-2dabf548-41e6-460b-b786-a358111d0233 tempest-ImagesMetadataTestJSON-902088131 tempest-ImagesMetadataTestJSON-902088131-project] 10.222.0.33 "PUT /compute/v2.1/images/0a983cdf-96f8-4d03-ab30-968995a2ff3e/metadata" status: 200 len: 61 microversion: 2.1 time: 0.678840 Oct 04 20:38:59.411953 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 718/1384] 10.222.0.33 () {60 vars in 1280 bytes} [Tue Oct 4 20:38:58 2022] PUT /compute/v2.1/images/0a983cdf-96f8-4d03-ab30-968995a2ff3e/metadata => generated 61 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 20:38:59.426379 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-e691de04-91ae-46ae-abd6-8bfdf026b7f4 tempest-ImagesMetadataTestJSON-902088131 tempest-ImagesMetadataTestJSON-902088131-project] Calling method '.version_select at 0x7f3c7432bb80>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:59.498310 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-e691de04-91ae-46ae-abd6-8bfdf026b7f4 tempest-ImagesMetadataTestJSON-902088131 tempest-ImagesMetadataTestJSON-902088131-project] 10.222.0.33 "GET /compute/v2.1/images/0a983cdf-96f8-4d03-ab30-968995a2ff3e/metadata/os_distro" status: 200 len: 33 microversion: 2.1 time: 0.080718 Oct 04 20:38:59.498948 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 719/1385] 10.222.0.33 () {58 vars in 1290 bytes} [Tue Oct 4 20:38:59 2022] GET /compute/v2.1/images/0a983cdf-96f8-4d03-ab30-968995a2ff3e/metadata/os_distro => generated 33 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 04 20:38:59.509191 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-f3da46d0-1c7e-4c1f-a45f-62917d5b5ecb tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:59.510014 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-f3da46d0-1c7e-4c1f-a45f-62917d5b5ecb tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] [instance: 23da26ba-68f4-4aef-b13c-0b6588a65e43] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:59.517194 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f3da46d0-1c7e-4c1f-a45f-62917d5b5ecb tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:59.517682 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f3da46d0-1c7e-4c1f-a45f-62917d5b5ecb tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:59.518170 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f3da46d0-1c7e-4c1f-a45f-62917d5b5ecb tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:59.519671 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f3da46d0-1c7e-4c1f-a45f-62917d5b5ecb tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:59.519671 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f3da46d0-1c7e-4c1f-a45f-62917d5b5ecb tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:59.520184 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f3da46d0-1c7e-4c1f-a45f-62917d5b5ecb tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:59.552596 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-622040bb-64fa-4615-97c6-6b3eb27c432c tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a82c49a62249029ebc6ae3b4829709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecf3793be3eb4f3186c07a7e45fd8f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:38:59.565875 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-622040bb-64fa-4615-97c6-6b3eb27c432c tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] 10.222.0.33 "GET /compute/v2.1/servers/d2173117-c1c5-4c2d-9658-914e67649cdd" status: 200 len: 1285 microversion: 2.1 time: 0.445669 Oct 04 20:38:59.567406 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 667/1386] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:38:59 2022] GET /compute/v2.1/servers/d2173117-c1c5-4c2d-9658-914e67649cdd => generated 1285 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:38:59.572862 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-edc2dee8-4fd2-4f14-956c-aec77f471e7e tempest-ImagesMetadataTestJSON-902088131 tempest-ImagesMetadataTestJSON-902088131-project] Action: 'update_all', calling method: .version_select at 0x7f3c74c5d700>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:38:59.626305 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-edc2dee8-4fd2-4f14-956c-aec77f471e7e tempest-ImagesMetadataTestJSON-902088131 tempest-ImagesMetadataTestJSON-902088131-project] Getting quotas for project 76c855450dae45ab806ba873da9a76b6. Resources: dict_keys(['metadata_items']) {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:38:59.631066 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-edc2dee8-4fd2-4f14-956c-aec77f471e7e tempest-ImagesMetadataTestJSON-902088131 tempest-ImagesMetadataTestJSON-902088131-project] Getting quotas for user 0e2167d601c14dc1a4b7a1f952cc6313 and project 76c855450dae45ab806ba873da9a76b6. Resources: dict_keys(['metadata_items']) {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:38:59.819495 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-edc2dee8-4fd2-4f14-956c-aec77f471e7e tempest-ImagesMetadataTestJSON-902088131 tempest-ImagesMetadataTestJSON-902088131-project] 10.222.0.33 "PUT /compute/v2.1/images/0a983cdf-96f8-4d03-ab30-968995a2ff3e/metadata" status: 200 len: 61 microversion: 2.1 time: 0.250610 Oct 04 20:38:59.820102 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 668/1387] 10.222.0.33 () {60 vars in 1280 bytes} [Tue Oct 4 20:38:59 2022] PUT /compute/v2.1/images/0a983cdf-96f8-4d03-ab30-968995a2ff3e/metadata => generated 61 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 20:38:59.825417 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-07a692a4-6901-4b95-91e6-02b52b030a34 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:38:59.826038 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-07a692a4-6901-4b95-91e6-02b52b030a34 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] [instance: a1e8b81b-5e26-4d5c-87ca-057eea43abba] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:38:59.833871 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-07a692a4-6901-4b95-91e6-02b52b030a34 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:59.834593 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-07a692a4-6901-4b95-91e6-02b52b030a34 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:59.835041 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-07a692a4-6901-4b95-91e6-02b52b030a34 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:59.835796 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-07a692a4-6901-4b95-91e6-02b52b030a34 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:38:59.836265 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-07a692a4-6901-4b95-91e6-02b52b030a34 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:38:59.836702 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-07a692a4-6901-4b95-91e6-02b52b030a34 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:38:59.862094 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=6 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:39:00.644039 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-f3da46d0-1c7e-4c1f-a45f-62917d5b5ecb tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3563efe2b8c94931a2a46c4e14811b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3118a5d96843d3bede1ed94bd9717e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:00.653952 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-f3da46d0-1c7e-4c1f-a45f-62917d5b5ecb tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] 10.222.0.33 "GET /compute/v2.1/servers/23da26ba-68f4-4aef-b13c-0b6588a65e43" status: 200 len: 1477 microversion: 2.1 time: 1.153811 Oct 04 20:39:00.671305 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 720/1388] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:38:59 2022] GET /compute/v2.1/servers/23da26ba-68f4-4aef-b13c-0b6588a65e43 => generated 1477 bytes in 1171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:00.681516 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-7c162ccf-9aec-4297-be0a-dfae291dfa93 tempest-ImagesMetadataTestJSON-902088131 tempest-ImagesMetadataTestJSON-902088131-project] Calling method '.version_select at 0x7f3c74758ee0>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:00.756015 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-7c162ccf-9aec-4297-be0a-dfae291dfa93 tempest-ImagesMetadataTestJSON-902088131 tempest-ImagesMetadataTestJSON-902088131-project] 10.222.0.33 "GET /compute/v2.1/images/0a983cdf-96f8-4d03-ab30-968995a2ff3e/metadata" status: 200 len: 61 microversion: 2.1 time: 0.083148 Oct 04 20:39:00.756699 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 721/1389] 10.222.0.33 () {58 vars in 1260 bytes} [Tue Oct 4 20:39:00 2022] GET /compute/v2.1/images/0a983cdf-96f8-4d03-ab30-968995a2ff3e/metadata => generated 61 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 20:39:00.767570 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-7e1533bc-7ef8-4f2a-a65b-d4706d32b202 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:00.768227 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-7e1533bc-7ef8-4f2a-a65b-d4706d32b202 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] [instance: 8a72de6a-64a0-4ec7-a613-576f8ac02af3] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:00.776122 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7e1533bc-7ef8-4f2a-a65b-d4706d32b202 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:00.778731 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7e1533bc-7ef8-4f2a-a65b-d4706d32b202 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:00.779397 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7e1533bc-7ef8-4f2a-a65b-d4706d32b202 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:00.781588 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7e1533bc-7ef8-4f2a-a65b-d4706d32b202 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:00.782429 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7e1533bc-7ef8-4f2a-a65b-d4706d32b202 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:00.783369 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7e1533bc-7ef8-4f2a-a65b-d4706d32b202 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:00.814230 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-07a692a4-6901-4b95-91e6-02b52b030a34 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36f4114dc4f443f8b48da7b4027e0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a23a85365414f92bbc03177d7f190e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:00.825434 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-07a692a4-6901-4b95-91e6-02b52b030a34 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] 10.222.0.33 "GET /compute/v2.1/servers/a1e8b81b-5e26-4d5c-87ca-057eea43abba" status: 200 len: 1318 microversion: 2.1 time: 1.004261 Oct 04 20:39:00.830769 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 669/1390] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:38:59 2022] GET /compute/v2.1/servers/a1e8b81b-5e26-4d5c-87ca-057eea43abba => generated 1318 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:00.839431 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e07b9ac4-3930-4b1d-8c4d-38cff8cddb05 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:00.840264 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e07b9ac4-3930-4b1d-8c4d-38cff8cddb05 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] [instance: d2173117-c1c5-4c2d-9658-914e67649cdd] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:00.854930 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e07b9ac4-3930-4b1d-8c4d-38cff8cddb05 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:00.855706 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e07b9ac4-3930-4b1d-8c4d-38cff8cddb05 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:00.856375 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e07b9ac4-3930-4b1d-8c4d-38cff8cddb05 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:00.857262 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e07b9ac4-3930-4b1d-8c4d-38cff8cddb05 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:00.857886 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e07b9ac4-3930-4b1d-8c4d-38cff8cddb05 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:00.858525 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e07b9ac4-3930-4b1d-8c4d-38cff8cddb05 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:01.011721 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e07b9ac4-3930-4b1d-8c4d-38cff8cddb05 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a82c49a62249029ebc6ae3b4829709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecf3793be3eb4f3186c07a7e45fd8f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:01.022555 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e07b9ac4-3930-4b1d-8c4d-38cff8cddb05 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] 10.222.0.33 "GET /compute/v2.1/servers/d2173117-c1c5-4c2d-9658-914e67649cdd" status: 200 len: 1283 microversion: 2.1 time: 0.190023 Oct 04 20:39:01.023172 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 670/1391] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:00 2022] GET /compute/v2.1/servers/d2173117-c1c5-4c2d-9658-914e67649cdd => generated 1283 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:01.031832 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ec7816d9-1caf-4c97-ad60-94bbb953c28a tempest-ImagesMetadataTestJSON-902088131 tempest-ImagesMetadataTestJSON-902088131-project] Action: 'update_all', calling method: .version_select at 0x7f3c74f65040>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:39:01.104761 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:INSERT=8,nova_api:SELECT=92 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:39:01.127083 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-ec7816d9-1caf-4c97-ad60-94bbb953c28a tempest-ImagesMetadataTestJSON-902088131 tempest-ImagesMetadataTestJSON-902088131-project] Getting quotas for project 76c855450dae45ab806ba873da9a76b6. Resources: dict_keys(['metadata_items']) {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:39:01.137258 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-ec7816d9-1caf-4c97-ad60-94bbb953c28a tempest-ImagesMetadataTestJSON-902088131 tempest-ImagesMetadataTestJSON-902088131-project] Getting quotas for user 0e2167d601c14dc1a4b7a1f952cc6313 and project 76c855450dae45ab806ba873da9a76b6. Resources: dict_keys(['metadata_items']) {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:39:01.411684 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ec7816d9-1caf-4c97-ad60-94bbb953c28a tempest-ImagesMetadataTestJSON-902088131 tempest-ImagesMetadataTestJSON-902088131-project] 10.222.0.33 "PUT /compute/v2.1/images/0a983cdf-96f8-4d03-ab30-968995a2ff3e/metadata" status: 200 len: 61 microversion: 2.1 time: 0.387440 Oct 04 20:39:01.417226 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 671/1392] 10.222.0.33 () {60 vars in 1280 bytes} [Tue Oct 4 20:39:01 2022] PUT /compute/v2.1/images/0a983cdf-96f8-4d03-ab30-968995a2ff3e/metadata => generated 61 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 20:39:01.424434 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-3ae14a4f-8e6a-4340-b524-510627b6e2bf tempest-ImagesMetadataTestJSON-902088131 tempest-ImagesMetadataTestJSON-902088131-project] Action: 'update_all', calling method: .version_select at 0x7f3c74d5a820>, body: {"metadata": {"os_version": "value2", "architecture": "value3"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:39:01.496299 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-7e1533bc-7ef8-4f2a-a65b-d4706d32b202 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '800db3a57ada47eca381b00189fdbf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66ec8ea91b04deb90b679589e0495bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:01.503406 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-3ae14a4f-8e6a-4340-b524-510627b6e2bf tempest-ImagesMetadataTestJSON-902088131 tempest-ImagesMetadataTestJSON-902088131-project] Getting quotas for project 76c855450dae45ab806ba873da9a76b6. Resources: dict_keys(['metadata_items']) {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:39:01.515043 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-7e1533bc-7ef8-4f2a-a65b-d4706d32b202 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] 10.222.0.33 "GET /compute/v2.1/servers/8a72de6a-64a0-4ec7-a613-576f8ac02af3" status: 200 len: 1478 microversion: 2.1 time: 0.757279 Oct 04 20:39:01.515631 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 722/1393] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:00 2022] GET /compute/v2.1/servers/8a72de6a-64a0-4ec7-a613-576f8ac02af3 => generated 1478 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:01.544654 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-4349a01a-f53e-4e6b-9240-bbc7233feda6 tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] Calling method '.version_select at 0x7f3c7422f820>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:01.548439 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4349a01a-f53e-4e6b-9240-bbc7233feda6 tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:01.548932 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4349a01a-f53e-4e6b-9240-bbc7233feda6 tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:01.549417 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4349a01a-f53e-4e6b-9240-bbc7233feda6 tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:01.552651 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-3ae14a4f-8e6a-4340-b524-510627b6e2bf tempest-ImagesMetadataTestJSON-902088131 tempest-ImagesMetadataTestJSON-902088131-project] Getting quotas for user 0e2167d601c14dc1a4b7a1f952cc6313 and project 76c855450dae45ab806ba873da9a76b6. Resources: dict_keys(['metadata_items']) {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:39:01.577176 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-4349a01a-f53e-4e6b-9240-bbc7233feda6 tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] 10.222.0.33 "GET /compute/v2.1/os-migrations" status: 200 len: 3121 microversion: 2.1 time: 0.036244 Oct 04 20:39:01.577808 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 723/1394] 10.222.0.33 () {58 vars in 1143 bytes} [Tue Oct 4 20:39:01 2022] GET /compute/v2.1/os-migrations => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:39:01.596026 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-50b9fe15-da2b-4b76-91ae-14c11376332f tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:01.597300 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-50b9fe15-da2b-4b76-91ae-14c11376332f tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] [instance: 8a72de6a-64a0-4ec7-a613-576f8ac02af3] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:01.608550 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-50b9fe15-da2b-4b76-91ae-14c11376332f tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:01.612106 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-50b9fe15-da2b-4b76-91ae-14c11376332f tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:01.613124 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-50b9fe15-da2b-4b76-91ae-14c11376332f tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:01.617938 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-50b9fe15-da2b-4b76-91ae-14c11376332f tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:01.618629 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-50b9fe15-da2b-4b76-91ae-14c11376332f tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:01.619084 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-50b9fe15-da2b-4b76-91ae-14c11376332f tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:02.072511 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-3ae14a4f-8e6a-4340-b524-510627b6e2bf tempest-ImagesMetadataTestJSON-902088131 tempest-ImagesMetadataTestJSON-902088131-project] 10.222.0.33 "PUT /compute/v2.1/images/0a983cdf-96f8-4d03-ab30-968995a2ff3e/metadata" status: 200 len: 64 microversion: 2.1 time: 0.653962 Oct 04 20:39:02.079446 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 672/1395] 10.222.0.33 () {60 vars in 1280 bytes} [Tue Oct 4 20:39:01 2022] PUT /compute/v2.1/images/0a983cdf-96f8-4d03-ab30-968995a2ff3e/metadata => generated 64 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 20:39:02.085583 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-68158891-c1b3-449c-b37f-71d5f1aa5d08 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:02.086654 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-68158891-c1b3-449c-b37f-71d5f1aa5d08 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] [instance: 23da26ba-68f4-4aef-b13c-0b6588a65e43] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:02.093440 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-68158891-c1b3-449c-b37f-71d5f1aa5d08 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:02.094234 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-68158891-c1b3-449c-b37f-71d5f1aa5d08 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:02.094958 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-68158891-c1b3-449c-b37f-71d5f1aa5d08 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:02.096049 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-68158891-c1b3-449c-b37f-71d5f1aa5d08 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:02.097511 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-68158891-c1b3-449c-b37f-71d5f1aa5d08 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:02.098190 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-68158891-c1b3-449c-b37f-71d5f1aa5d08 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:02.225610 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-50b9fe15-da2b-4b76-91ae-14c11376332f tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/8a72de6a-64a0-4ec7-a613-576f8ac02af3" status: 200 len: 1629 microversion: 2.1 time: 0.633840 Oct 04 20:39:02.227297 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 724/1396] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:01 2022] GET /compute/v2.1/servers/8a72de6a-64a0-4ec7-a613-576f8ac02af3 => generated 1629 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:39:02.238936 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-80b66654-81b5-41be-8b0c-b0075c920531 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:02.240202 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-80b66654-81b5-41be-8b0c-b0075c920531 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] [instance: a1e8b81b-5e26-4d5c-87ca-057eea43abba] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:02.249845 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-80b66654-81b5-41be-8b0c-b0075c920531 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:02.250822 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-80b66654-81b5-41be-8b0c-b0075c920531 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:02.251745 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-80b66654-81b5-41be-8b0c-b0075c920531 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:02.252746 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-80b66654-81b5-41be-8b0c-b0075c920531 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:02.253589 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-80b66654-81b5-41be-8b0c-b0075c920531 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:02.254428 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-80b66654-81b5-41be-8b0c-b0075c920531 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:02.661657 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-80b66654-81b5-41be-8b0c-b0075c920531 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36f4114dc4f443f8b48da7b4027e0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a23a85365414f92bbc03177d7f190e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:02.677762 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-80b66654-81b5-41be-8b0c-b0075c920531 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] 10.222.0.33 "GET /compute/v2.1/servers/a1e8b81b-5e26-4d5c-87ca-057eea43abba" status: 200 len: 1318 microversion: 2.1 time: 0.443604 Oct 04 20:39:02.690462 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 725/1397] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:02 2022] GET /compute/v2.1/servers/a1e8b81b-5e26-4d5c-87ca-057eea43abba => generated 1318 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:02.700810 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-5ee8f423-e3e8-4412-ada6-753fbe6c73a3 req-af57d4e1-cca7-49db-bd1e-caea906dee31 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "55d73a76-3d5e-426c-8a99-9cae92f8498b", "tag": "42d92097-d729-44f9-8a5b-0613e0581707"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:39:02.714773 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-5ee8f423-e3e8-4412-ada6-753fbe6c73a3 req-af57d4e1-cca7-49db-bd1e-caea906dee31 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:02.715475 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-5ee8f423-e3e8-4412-ada6-753fbe6c73a3 req-af57d4e1-cca7-49db-bd1e-caea906dee31 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:02.716072 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-5ee8f423-e3e8-4412-ada6-753fbe6c73a3 req-af57d4e1-cca7-49db-bd1e-caea906dee31 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:02.722863 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-68158891-c1b3-449c-b37f-71d5f1aa5d08 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3563efe2b8c94931a2a46c4e14811b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3118a5d96843d3bede1ed94bd9717e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:02.738611 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-5ee8f423-e3e8-4412-ada6-753fbe6c73a3 req-af57d4e1-cca7-49db-bd1e-caea906dee31 service nova] Creating event network-changed:42d92097-d729-44f9-8a5b-0613e0581707 for instance 55d73a76-3d5e-426c-8a99-9cae92f8498b on n-h1-854823-8 Oct 04 20:39:02.744081 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-68158891-c1b3-449c-b37f-71d5f1aa5d08 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] 10.222.0.33 "GET /compute/v2.1/servers/23da26ba-68f4-4aef-b13c-0b6588a65e43" status: 200 len: 1477 microversion: 2.1 time: 0.662780 Oct 04 20:39:02.744277 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-5ee8f423-e3e8-4412-ada6-753fbe6c73a3 req-af57d4e1-cca7-49db-bd1e-caea906dee31 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049278 Oct 04 20:39:02.744856 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 726/1398] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:39:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:39:02.746555 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 673/1399] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:02 2022] GET /compute/v2.1/servers/23da26ba-68f4-4aef-b13c-0b6588a65e43 => generated 1477 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:02.755942 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1348c0fb-9a99-4c96-8608-ed0e4cf44596 tempest-ImagesMetadataTestJSON-902088131 tempest-ImagesMetadataTestJSON-902088131-project] Calling method '.version_select at 0x7f3c74d5a790>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:02.764734 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-c7c5b819-7ece-4c53-99e8-e7f0ee8ac702 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:02.765739 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-c7c5b819-7ece-4c53-99e8-e7f0ee8ac702 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] [instance: d2173117-c1c5-4c2d-9658-914e67649cdd] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:02.802692 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c7c5b819-7ece-4c53-99e8-e7f0ee8ac702 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:02.803696 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c7c5b819-7ece-4c53-99e8-e7f0ee8ac702 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:02.804370 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c7c5b819-7ece-4c53-99e8-e7f0ee8ac702 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:02.805665 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c7c5b819-7ece-4c53-99e8-e7f0ee8ac702 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:02.806917 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c7c5b819-7ece-4c53-99e8-e7f0ee8ac702 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:02.808122 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c7c5b819-7ece-4c53-99e8-e7f0ee8ac702 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:02.845756 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-1348c0fb-9a99-4c96-8608-ed0e4cf44596 tempest-ImagesMetadataTestJSON-902088131 tempest-ImagesMetadataTestJSON-902088131-project] 10.222.0.33 "GET /compute/v2.1/images/0a983cdf-96f8-4d03-ab30-968995a2ff3e/metadata" status: 200 len: 64 microversion: 2.1 time: 0.097748 Oct 04 20:39:02.847508 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 674/1400] 10.222.0.33 () {58 vars in 1260 bytes} [Tue Oct 4 20:39:02 2022] GET /compute/v2.1/images/0a983cdf-96f8-4d03-ab30-968995a2ff3e/metadata => generated 64 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 20:39:02.856678 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-60785a39-3844-4f58-817f-8007a6d9a2fc tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Action: 'create', calling method: .version_select at 0x7f3c74976550>, body: {"keypair": {"name": "tempest-keypair-2007695224", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCD8C+mTJDGjtyRu0vFvqb2wMARv0EuZIwiF6JtBovNO9OVehp2FPVUFy17SVRCAZ1xvDd9nw2HsA12hvJk/VtADCcC16sEjql0SYDLHszfeFvEhcm42FUKdSWPrh0YyHw=="}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:39:02.883380 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-60785a39-3844-4f58-817f-8007a6d9a2fc tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Getting quotas for project d66ec8ea91b04deb90b679589e0495bb. Resources: {'key_pairs'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:39:02.899112 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-60785a39-3844-4f58-817f-8007a6d9a2fc tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Getting quotas for user 800db3a57ada47eca381b00189fdbf0a and project d66ec8ea91b04deb90b679589e0495bb. Resources: {'key_pairs'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:39:02.932440 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-60785a39-3844-4f58-817f-8007a6d9a2fc tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.083066 Oct 04 20:39:02.934415 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 675/1401] 10.222.0.33 () {60 vars in 1159 bytes} [Tue Oct 4 20:39:02 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:39:02.946834 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1d68c8e6-18f9-4a04-b13d-a8d23eb93fd7 tempest-ImagesMetadataTestJSON-902088131 tempest-ImagesMetadataTestJSON-902088131-project] Action: 'update_all', calling method: .version_select at 0x7f3c74d058b0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:39:03.024874 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-1d68c8e6-18f9-4a04-b13d-a8d23eb93fd7 tempest-ImagesMetadataTestJSON-902088131 tempest-ImagesMetadataTestJSON-902088131-project] Getting quotas for project 76c855450dae45ab806ba873da9a76b6. Resources: dict_keys(['metadata_items']) {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:39:03.029145 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-1d68c8e6-18f9-4a04-b13d-a8d23eb93fd7 tempest-ImagesMetadataTestJSON-902088131 tempest-ImagesMetadataTestJSON-902088131-project] Getting quotas for user 0e2167d601c14dc1a4b7a1f952cc6313 and project 76c855450dae45ab806ba873da9a76b6. Resources: dict_keys(['metadata_items']) {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:39:03.489294 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-1d68c8e6-18f9-4a04-b13d-a8d23eb93fd7 tempest-ImagesMetadataTestJSON-902088131 tempest-ImagesMetadataTestJSON-902088131-project] 10.222.0.33 "PUT /compute/v2.1/images/0a983cdf-96f8-4d03-ab30-968995a2ff3e/metadata" status: 200 len: 61 microversion: 2.1 time: 0.552834 Oct 04 20:39:03.490236 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 676/1402] 10.222.0.33 () {60 vars in 1280 bytes} [Tue Oct 4 20:39:02 2022] PUT /compute/v2.1/images/0a983cdf-96f8-4d03-ab30-968995a2ff3e/metadata => generated 61 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 20:39:03.499551 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6e7c9cdb-3b84-476d-ad03-61ef9797432a tempest-ImagesMetadataTestJSON-902088131 tempest-ImagesMetadataTestJSON-902088131-project] Action: 'update', calling method: .version_select at 0x7f3c74bceee0>, body: {"meta": {"os_version": "alt"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:39:03.591868 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-6e7c9cdb-3b84-476d-ad03-61ef9797432a tempest-ImagesMetadataTestJSON-902088131 tempest-ImagesMetadataTestJSON-902088131-project] Getting quotas for project 76c855450dae45ab806ba873da9a76b6. Resources: dict_keys(['metadata_items']) {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:39:03.596234 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-6e7c9cdb-3b84-476d-ad03-61ef9797432a tempest-ImagesMetadataTestJSON-902088131 tempest-ImagesMetadataTestJSON-902088131-project] Getting quotas for user 0e2167d601c14dc1a4b7a1f952cc6313 and project 76c855450dae45ab806ba873da9a76b6. Resources: dict_keys(['metadata_items']) {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:39:03.618710 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-c7c5b819-7ece-4c53-99e8-e7f0ee8ac702 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a82c49a62249029ebc6ae3b4829709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecf3793be3eb4f3186c07a7e45fd8f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:03.629988 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-c7c5b819-7ece-4c53-99e8-e7f0ee8ac702 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] 10.222.0.33 "GET /compute/v2.1/servers/d2173117-c1c5-4c2d-9658-914e67649cdd" status: 200 len: 1325 microversion: 2.1 time: 0.883487 Oct 04 20:39:03.630494 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 727/1403] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:02 2022] GET /compute/v2.1/servers/d2173117-c1c5-4c2d-9658-914e67649cdd => generated 1325 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:03.708732 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-fda58e99-6c77-4906-9fb6-84b75ea6cb87 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:03.709371 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-fda58e99-6c77-4906-9fb6-84b75ea6cb87 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] [instance: a1e8b81b-5e26-4d5c-87ca-057eea43abba] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:03.723066 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fda58e99-6c77-4906-9fb6-84b75ea6cb87 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:03.723377 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fda58e99-6c77-4906-9fb6-84b75ea6cb87 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:03.723833 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fda58e99-6c77-4906-9fb6-84b75ea6cb87 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:03.729101 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fda58e99-6c77-4906-9fb6-84b75ea6cb87 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:03.729587 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fda58e99-6c77-4906-9fb6-84b75ea6cb87 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:03.730121 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fda58e99-6c77-4906-9fb6-84b75ea6cb87 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:03.994134 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-6e7c9cdb-3b84-476d-ad03-61ef9797432a tempest-ImagesMetadataTestJSON-902088131 tempest-ImagesMetadataTestJSON-902088131-project] 10.222.0.33 "PUT /compute/v2.1/images/0a983cdf-96f8-4d03-ab30-968995a2ff3e/metadata/os_version" status: 200 len: 31 microversion: 2.1 time: 0.498477 Oct 04 20:39:03.995120 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 677/1404] 10.222.0.33 () {60 vars in 1313 bytes} [Tue Oct 4 20:39:03 2022] PUT /compute/v2.1/images/0a983cdf-96f8-4d03-ab30-968995a2ff3e/metadata/os_version => generated 31 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 20:39:03.999823 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9ae610ec-d8db-4ae3-adf5-679204251970 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:04.000550 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-9ae610ec-d8db-4ae3-adf5-679204251970 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] [instance: 23da26ba-68f4-4aef-b13c-0b6588a65e43] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:04.007180 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9ae610ec-d8db-4ae3-adf5-679204251970 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:04.007673 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9ae610ec-d8db-4ae3-adf5-679204251970 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:04.008296 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9ae610ec-d8db-4ae3-adf5-679204251970 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:04.009087 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9ae610ec-d8db-4ae3-adf5-679204251970 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:04.009712 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9ae610ec-d8db-4ae3-adf5-679204251970 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:04.010151 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9ae610ec-d8db-4ae3-adf5-679204251970 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:04.653248 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-fda58e99-6c77-4906-9fb6-84b75ea6cb87 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36f4114dc4f443f8b48da7b4027e0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a23a85365414f92bbc03177d7f190e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:04.662932 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-fda58e99-6c77-4906-9fb6-84b75ea6cb87 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] 10.222.0.33 "GET /compute/v2.1/servers/a1e8b81b-5e26-4d5c-87ca-057eea43abba" status: 200 len: 1318 microversion: 2.1 time: 0.962778 Oct 04 20:39:04.663833 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 728/1405] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:03 2022] GET /compute/v2.1/servers/a1e8b81b-5e26-4d5c-87ca-057eea43abba => generated 1318 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:39:04.694707 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-50742404-158b-4c9c-ba20-93320226a73d tempest-ImagesMetadataTestJSON-902088131 tempest-ImagesMetadataTestJSON-902088131-project] Calling method '.version_select at 0x7f3c7450d670>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:04.759427 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-50742404-158b-4c9c-ba20-93320226a73d tempest-ImagesMetadataTestJSON-902088131 tempest-ImagesMetadataTestJSON-902088131-project] 10.222.0.33 "GET /compute/v2.1/images/0a983cdf-96f8-4d03-ab30-968995a2ff3e/metadata" status: 200 len: 58 microversion: 2.1 time: 0.079353 Oct 04 20:39:04.765683 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 729/1406] 10.222.0.33 () {58 vars in 1260 bytes} [Tue Oct 4 20:39:04 2022] GET /compute/v2.1/images/0a983cdf-96f8-4d03-ab30-968995a2ff3e/metadata => generated 58 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 20:39:04.766292 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-30e41c84-4c3e-40fa-a317-e53ce9391041 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:04.767625 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-30e41c84-4c3e-40fa-a317-e53ce9391041 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] [instance: d2173117-c1c5-4c2d-9658-914e67649cdd] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:04.778278 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-30e41c84-4c3e-40fa-a317-e53ce9391041 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:04.779029 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-30e41c84-4c3e-40fa-a317-e53ce9391041 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:04.780289 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-30e41c84-4c3e-40fa-a317-e53ce9391041 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:04.781622 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-30e41c84-4c3e-40fa-a317-e53ce9391041 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:04.783171 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-30e41c84-4c3e-40fa-a317-e53ce9391041 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:04.783906 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-30e41c84-4c3e-40fa-a317-e53ce9391041 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:05.234608 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-9ae610ec-d8db-4ae3-adf5-679204251970 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3563efe2b8c94931a2a46c4e14811b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3118a5d96843d3bede1ed94bd9717e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:05.244177 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-9ae610ec-d8db-4ae3-adf5-679204251970 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] 10.222.0.33 "GET /compute/v2.1/servers/23da26ba-68f4-4aef-b13c-0b6588a65e43" status: 200 len: 1477 microversion: 2.1 time: 1.247918 Oct 04 20:39:05.244765 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 678/1407] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:03 2022] GET /compute/v2.1/servers/23da26ba-68f4-4aef-b13c-0b6588a65e43 => generated 1477 bytes in 1249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:05.260554 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-525d389d-6d1c-4c99-a489-df98e9b2e6c1 tempest-ImagesMetadataTestJSON-902088131 tempest-ImagesMetadataTestJSON-902088131-project] Action: 'update_all', calling method: .version_select at 0x7f3c74efaa60>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:39:05.335346 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-525d389d-6d1c-4c99-a489-df98e9b2e6c1 tempest-ImagesMetadataTestJSON-902088131 tempest-ImagesMetadataTestJSON-902088131-project] Getting quotas for project 76c855450dae45ab806ba873da9a76b6. Resources: dict_keys(['metadata_items']) {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:39:05.341046 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-525d389d-6d1c-4c99-a489-df98e9b2e6c1 tempest-ImagesMetadataTestJSON-902088131 tempest-ImagesMetadataTestJSON-902088131-project] Getting quotas for user 0e2167d601c14dc1a4b7a1f952cc6313 and project 76c855450dae45ab806ba873da9a76b6. Resources: dict_keys(['metadata_items']) {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:39:05.402545 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-30e41c84-4c3e-40fa-a317-e53ce9391041 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a82c49a62249029ebc6ae3b4829709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecf3793be3eb4f3186c07a7e45fd8f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:05.411968 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-30e41c84-4c3e-40fa-a317-e53ce9391041 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] 10.222.0.33 "GET /compute/v2.1/servers/d2173117-c1c5-4c2d-9658-914e67649cdd" status: 200 len: 1325 microversion: 2.1 time: 0.650143 Oct 04 20:39:05.412903 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 730/1408] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:04 2022] GET /compute/v2.1/servers/d2173117-c1c5-4c2d-9658-914e67649cdd => generated 1325 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:05.424007 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-2a86da1d-a41c-40bd-9813-5378cdd51c9f req-6534fedb-d0e1-448a-867c-169902dc4123 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1e8b81b-5e26-4d5c-87ca-057eea43abba", "tag": "79dd85da-fe6b-4163-bb34-adeab48cf2e5"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:39:05.452668 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-2a86da1d-a41c-40bd-9813-5378cdd51c9f req-6534fedb-d0e1-448a-867c-169902dc4123 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:05.453657 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-2a86da1d-a41c-40bd-9813-5378cdd51c9f req-6534fedb-d0e1-448a-867c-169902dc4123 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:05.454402 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-2a86da1d-a41c-40bd-9813-5378cdd51c9f req-6534fedb-d0e1-448a-867c-169902dc4123 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:05.470232 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-2a86da1d-a41c-40bd-9813-5378cdd51c9f req-6534fedb-d0e1-448a-867c-169902dc4123 service nova] Creating event network-changed:79dd85da-fe6b-4163-bb34-adeab48cf2e5 for instance a1e8b81b-5e26-4d5c-87ca-057eea43abba on n-h2-854823-8 Oct 04 20:39:05.482218 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-2a86da1d-a41c-40bd-9813-5378cdd51c9f req-6534fedb-d0e1-448a-867c-169902dc4123 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067879 Oct 04 20:39:05.483387 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 731/1409] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:39:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:39:05.683478 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-525d389d-6d1c-4c99-a489-df98e9b2e6c1 tempest-ImagesMetadataTestJSON-902088131 tempest-ImagesMetadataTestJSON-902088131-project] 10.222.0.33 "PUT /compute/v2.1/images/0a983cdf-96f8-4d03-ab30-968995a2ff3e/metadata" status: 200 len: 61 microversion: 2.1 time: 0.437312 Oct 04 20:39:05.684245 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 679/1410] 10.222.0.33 () {60 vars in 1280 bytes} [Tue Oct 4 20:39:05 2022] PUT /compute/v2.1/images/0a983cdf-96f8-4d03-ab30-968995a2ff3e/metadata => generated 61 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 20:39:05.694395 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-9293df1b-5219-41a3-9804-7dd40e248032 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:05.695704 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-9293df1b-5219-41a3-9804-7dd40e248032 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] [instance: a1e8b81b-5e26-4d5c-87ca-057eea43abba] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:05.701045 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8bb1a02c-abf3-488a-9ca3-4e4ff487d1f9 tempest-ImagesMetadataTestJSON-902088131 tempest-ImagesMetadataTestJSON-902088131-project] Action: 'create', calling method: .version_select at 0x7f3c745a9940>, body: {"metadata": {"os_version": "alt1", "architecture": "value3"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:39:05.708818 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9293df1b-5219-41a3-9804-7dd40e248032 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:05.709321 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9293df1b-5219-41a3-9804-7dd40e248032 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:05.709759 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9293df1b-5219-41a3-9804-7dd40e248032 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:05.719180 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9293df1b-5219-41a3-9804-7dd40e248032 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:05.719900 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9293df1b-5219-41a3-9804-7dd40e248032 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:05.720534 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9293df1b-5219-41a3-9804-7dd40e248032 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:05.811304 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-8bb1a02c-abf3-488a-9ca3-4e4ff487d1f9 tempest-ImagesMetadataTestJSON-902088131 tempest-ImagesMetadataTestJSON-902088131-project] Getting quotas for project 76c855450dae45ab806ba873da9a76b6. Resources: dict_keys(['metadata_items']) {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:39:05.817877 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-8bb1a02c-abf3-488a-9ca3-4e4ff487d1f9 tempest-ImagesMetadataTestJSON-902088131 tempest-ImagesMetadataTestJSON-902088131-project] Getting quotas for user 0e2167d601c14dc1a4b7a1f952cc6313 and project 76c855450dae45ab806ba873da9a76b6. Resources: dict_keys(['metadata_items']) {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:39:06.183548 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-9293df1b-5219-41a3-9804-7dd40e248032 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36f4114dc4f443f8b48da7b4027e0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a23a85365414f92bbc03177d7f190e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:06.199007 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-9293df1b-5219-41a3-9804-7dd40e248032 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] 10.222.0.33 "GET /compute/v2.1/servers/a1e8b81b-5e26-4d5c-87ca-057eea43abba" status: 200 len: 1318 microversion: 2.1 time: 0.509753 Oct 04 20:39:06.199608 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 732/1411] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:05 2022] GET /compute/v2.1/servers/a1e8b81b-5e26-4d5c-87ca-057eea43abba => generated 1318 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:06.271559 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-d2fbbebc-11ea-4c1c-9b47-230cfd2199f0 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:06.272520 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-d2fbbebc-11ea-4c1c-9b47-230cfd2199f0 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] [instance: 23da26ba-68f4-4aef-b13c-0b6588a65e43] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:06.279012 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-8bb1a02c-abf3-488a-9ca3-4e4ff487d1f9 tempest-ImagesMetadataTestJSON-902088131 tempest-ImagesMetadataTestJSON-902088131-project] 10.222.0.33 "POST /compute/v2.1/images/0a983cdf-96f8-4d03-ab30-968995a2ff3e/metadata" status: 200 len: 85 microversion: 2.1 time: 0.587133 Oct 04 20:39:06.279675 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d2fbbebc-11ea-4c1c-9b47-230cfd2199f0 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:06.280404 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d2fbbebc-11ea-4c1c-9b47-230cfd2199f0 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:06.281071 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d2fbbebc-11ea-4c1c-9b47-230cfd2199f0 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:06.282023 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d2fbbebc-11ea-4c1c-9b47-230cfd2199f0 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:06.282734 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d2fbbebc-11ea-4c1c-9b47-230cfd2199f0 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:06.283395 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d2fbbebc-11ea-4c1c-9b47-230cfd2199f0 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:06.288184 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 680/1412] 10.222.0.33 () {60 vars in 1281 bytes} [Tue Oct 4 20:39:05 2022] POST /compute/v2.1/images/0a983cdf-96f8-4d03-ab30-968995a2ff3e/metadata => generated 85 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 20:39:06.355476 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-54b311f4-b0b8-45b8-b2c6-4eb80effaaf9 tempest-ImagesMetadataTestJSON-902088131 tempest-ImagesMetadataTestJSON-902088131-project] Calling method '.version_select at 0x7f3c746be280>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:06.421457 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-54b311f4-b0b8-45b8-b2c6-4eb80effaaf9 tempest-ImagesMetadataTestJSON-902088131 tempest-ImagesMetadataTestJSON-902088131-project] 10.222.0.33 "GET /compute/v2.1/images/0a983cdf-96f8-4d03-ab30-968995a2ff3e/metadata" status: 200 len: 85 microversion: 2.1 time: 0.069925 Oct 04 20:39:06.422644 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 681/1413] 10.222.0.33 () {58 vars in 1260 bytes} [Tue Oct 4 20:39:06 2022] GET /compute/v2.1/images/0a983cdf-96f8-4d03-ab30-968995a2ff3e/metadata => generated 85 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 20:39:06.442944 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f6542fb8-96e3-43fd-8b87-0380d24e9321 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:06.444847 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f6542fb8-96e3-43fd-8b87-0380d24e9321 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] [instance: d2173117-c1c5-4c2d-9658-914e67649cdd] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:06.452752 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f6542fb8-96e3-43fd-8b87-0380d24e9321 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:06.454176 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f6542fb8-96e3-43fd-8b87-0380d24e9321 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:06.455108 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f6542fb8-96e3-43fd-8b87-0380d24e9321 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:06.456756 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f6542fb8-96e3-43fd-8b87-0380d24e9321 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:06.457759 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f6542fb8-96e3-43fd-8b87-0380d24e9321 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:06.458483 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f6542fb8-96e3-43fd-8b87-0380d24e9321 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:06.478133 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=100 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:39:06.865114 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell0:SELECT=2 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:39:06.910756 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-d2fbbebc-11ea-4c1c-9b47-230cfd2199f0 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3563efe2b8c94931a2a46c4e14811b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3118a5d96843d3bede1ed94bd9717e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:06.925141 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-d2fbbebc-11ea-4c1c-9b47-230cfd2199f0 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] 10.222.0.33 "GET /compute/v2.1/servers/23da26ba-68f4-4aef-b13c-0b6588a65e43" status: 200 len: 1477 microversion: 2.1 time: 0.657767 Oct 04 20:39:06.926160 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 733/1414] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:06 2022] GET /compute/v2.1/servers/23da26ba-68f4-4aef-b13c-0b6588a65e43 => generated 1477 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:39:06.974137 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f6542fb8-96e3-43fd-8b87-0380d24e9321 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a82c49a62249029ebc6ae3b4829709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecf3793be3eb4f3186c07a7e45fd8f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:06.988673 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f6542fb8-96e3-43fd-8b87-0380d24e9321 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] 10.222.0.33 "GET /compute/v2.1/servers/d2173117-c1c5-4c2d-9658-914e67649cdd" status: 200 len: 1325 microversion: 2.1 time: 0.555185 Oct 04 20:39:06.990900 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 682/1415] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:06 2022] GET /compute/v2.1/servers/d2173117-c1c5-4c2d-9658-914e67649cdd => generated 1325 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:07.232021 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-e2e7d19c-02e6-4fb4-9954-8f2599d62191 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:07.232955 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-e2e7d19c-02e6-4fb4-9954-8f2599d62191 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] [instance: a1e8b81b-5e26-4d5c-87ca-057eea43abba] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:07.245140 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e2e7d19c-02e6-4fb4-9954-8f2599d62191 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:07.246688 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e2e7d19c-02e6-4fb4-9954-8f2599d62191 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:07.249122 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e2e7d19c-02e6-4fb4-9954-8f2599d62191 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:07.251532 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e2e7d19c-02e6-4fb4-9954-8f2599d62191 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:07.254157 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e2e7d19c-02e6-4fb4-9954-8f2599d62191 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:07.254849 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e2e7d19c-02e6-4fb4-9954-8f2599d62191 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:07.328777 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-31dfbc44-7275-4070-b312-04f228282409 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1013457565", "imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63", "flavorRef": "452", "networks": [{"uuid": "eff6509b-9044-4f53-ac84-39573f9dabae"}], "security_groups": [{"name": "tempest-securitygroup--1523637237"}], "key_name": "tempest-keypair-2007695224", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:39:07.876231 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.network.neutron [None req-31dfbc44-7275-4070-b312-04f228282409 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] validate_networks() for [('eff6509b-9044-4f53-ac84-39573f9dabae', None, None, None, None, None)] {{(pid=128801) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:39:08.146705 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-e2e7d19c-02e6-4fb4-9954-8f2599d62191 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36f4114dc4f443f8b48da7b4027e0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a23a85365414f92bbc03177d7f190e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:08.181130 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-e2e7d19c-02e6-4fb4-9954-8f2599d62191 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] 10.222.0.33 "GET /compute/v2.1/servers/a1e8b81b-5e26-4d5c-87ca-057eea43abba" status: 200 len: 1318 microversion: 2.1 time: 0.949944 Oct 04 20:39:08.187856 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 734/1416] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:07 2022] GET /compute/v2.1/servers/a1e8b81b-5e26-4d5c-87ca-057eea43abba => generated 1318 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:08.203877 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-7fc9182a-cc4f-49aa-b58b-39f2f9c5ea9f req-2e009992-174d-42da-9e67-cbf400739157 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2173117-c1c5-4c2d-9658-914e67649cdd", "tag": "5f97afab-20db-4d1c-9da9-8ce948bd87f0"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:39:08.229636 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-7fc9182a-cc4f-49aa-b58b-39f2f9c5ea9f req-2e009992-174d-42da-9e67-cbf400739157 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:08.231669 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-7fc9182a-cc4f-49aa-b58b-39f2f9c5ea9f req-2e009992-174d-42da-9e67-cbf400739157 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:08.232370 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-7fc9182a-cc4f-49aa-b58b-39f2f9c5ea9f req-2e009992-174d-42da-9e67-cbf400739157 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:08.264209 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-7fc9182a-cc4f-49aa-b58b-39f2f9c5ea9f req-2e009992-174d-42da-9e67-cbf400739157 service nova] Creating event network-changed:5f97afab-20db-4d1c-9da9-8ce948bd87f0 for instance d2173117-c1c5-4c2d-9658-914e67649cdd on n-h1-854823-8 Oct 04 20:39:08.279778 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-7fc9182a-cc4f-49aa-b58b-39f2f9c5ea9f req-2e009992-174d-42da-9e67-cbf400739157 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089526 Oct 04 20:39:08.281306 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 735/1417] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:39:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:39:08.289115 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-13fd4ab9-f854-4ef0-aed6-aa90333e3819 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:08.290633 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-13fd4ab9-f854-4ef0-aed6-aa90333e3819 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] [instance: 23da26ba-68f4-4aef-b13c-0b6588a65e43] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:08.298868 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-13fd4ab9-f854-4ef0-aed6-aa90333e3819 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:08.299961 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-13fd4ab9-f854-4ef0-aed6-aa90333e3819 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:08.300843 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-13fd4ab9-f854-4ef0-aed6-aa90333e3819 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:08.302480 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-13fd4ab9-f854-4ef0-aed6-aa90333e3819 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:08.303189 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-13fd4ab9-f854-4ef0-aed6-aa90333e3819 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:08.303836 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-13fd4ab9-f854-4ef0-aed6-aa90333e3819 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:08.313790 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=100 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:39:08.727416 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-13fd4ab9-f854-4ef0-aed6-aa90333e3819 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3563efe2b8c94931a2a46c4e14811b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3118a5d96843d3bede1ed94bd9717e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:08.744039 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-13fd4ab9-f854-4ef0-aed6-aa90333e3819 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] 10.222.0.33 "GET /compute/v2.1/servers/23da26ba-68f4-4aef-b13c-0b6588a65e43" status: 200 len: 1477 microversion: 2.1 time: 0.460623 Oct 04 20:39:08.745543 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 736/1418] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:08 2022] GET /compute/v2.1/servers/23da26ba-68f4-4aef-b13c-0b6588a65e43 => generated 1477 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:08.750813 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-af3c7737-8a18-47fb-9def-f1ef5f6f1a05 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:08.751631 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-af3c7737-8a18-47fb-9def-f1ef5f6f1a05 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] [instance: d2173117-c1c5-4c2d-9658-914e67649cdd] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:08.761549 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-af3c7737-8a18-47fb-9def-f1ef5f6f1a05 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:08.762557 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-af3c7737-8a18-47fb-9def-f1ef5f6f1a05 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:08.764627 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-af3c7737-8a18-47fb-9def-f1ef5f6f1a05 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:08.766307 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-af3c7737-8a18-47fb-9def-f1ef5f6f1a05 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:08.780477 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-af3c7737-8a18-47fb-9def-f1ef5f6f1a05 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:08.781290 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-af3c7737-8a18-47fb-9def-f1ef5f6f1a05 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:08.855482 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell0:SELECT=24 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:39:09.000378 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-31dfbc44-7275-4070-b312-04f228282409 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Flavor limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:39:09.001028 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-31dfbc44-7275-4070-b312-04f228282409 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Image limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:39:09.001296 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-31dfbc44-7275-4070-b312-04f228282409 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Flavor pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:39:09.001651 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-31dfbc44-7275-4070-b312-04f228282409 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Image pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:39:09.002062 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-31dfbc44-7275-4070-b312-04f228282409 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:39:09.019637 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=59 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:39:09.022309 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-31dfbc44-7275-4070-b312-04f228282409 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:09.022800 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-31dfbc44-7275-4070-b312-04f228282409 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:09.023246 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-31dfbc44-7275-4070-b312-04f228282409 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:09.023981 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-31dfbc44-7275-4070-b312-04f228282409 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:09.024443 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-31dfbc44-7275-4070-b312-04f228282409 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:09.027635 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-31dfbc44-7275-4070-b312-04f228282409 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:09.065446 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-af3c7737-8a18-47fb-9def-f1ef5f6f1a05 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a82c49a62249029ebc6ae3b4829709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecf3793be3eb4f3186c07a7e45fd8f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:09.078639 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-af3c7737-8a18-47fb-9def-f1ef5f6f1a05 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] 10.222.0.33 "GET /compute/v2.1/servers/d2173117-c1c5-4c2d-9658-914e67649cdd" status: 200 len: 1325 microversion: 2.1 time: 0.331561 Oct 04 20:39:09.094368 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-31dfbc44-7275-4070-b312-04f228282409 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Getting quotas for project d66ec8ea91b04deb90b679589e0495bb. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:39:09.094740 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 737/1419] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:08 2022] GET /compute/v2.1/servers/d2173117-c1c5-4c2d-9658-914e67649cdd => generated 1325 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:09.094846 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-31dfbc44-7275-4070-b312-04f228282409 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Getting quotas for user 800db3a57ada47eca381b00189fdbf0a and project d66ec8ea91b04deb90b679589e0495bb. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:39:09.115512 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-31dfbc44-7275-4070-b312-04f228282409 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Going to run 1 instances... {{(pid=128801) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:39:09.118037 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-31dfbc44-7275-4070-b312-04f228282409 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] [instance: 83df4756-40e2-4fc6-be48-48a82dd4572a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='15b24725-0c99-4bcf-b1fb-907cdf8e2d63',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128801) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:39:09.187854 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-31dfbc44-7275-4070-b312-04f228282409 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.864790 Oct 04 20:39:09.191726 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 683/1420] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 20:39:07 2022] POST /compute/v2.1/servers => generated 406 bytes in 1869 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 20:39:09.209009 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0ad1f20c-a5bc-4b6a-acac-a7ba404958fc tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:09.211339 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-0ad1f20c-a5bc-4b6a-acac-a7ba404958fc tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] [instance: 83df4756-40e2-4fc6-be48-48a82dd4572a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:09.321799 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-0ad1f20c-a5bc-4b6a-acac-a7ba404958fc tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '800db3a57ada47eca381b00189fdbf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66ec8ea91b04deb90b679589e0495bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:09.336173 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-0ad1f20c-a5bc-4b6a-acac-a7ba404958fc tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] 10.222.0.33 "GET /compute/v2.1/servers/83df4756-40e2-4fc6-be48-48a82dd4572a" status: 200 len: 1235 microversion: 2.1 time: 0.139250 Oct 04 20:39:09.339809 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 684/1421] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:09 2022] GET /compute/v2.1/servers/83df4756-40e2-4fc6-be48-48a82dd4572a => generated 1235 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:09.354617 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-25d1e947-1873-4395-843e-77510040f2cd tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:09.356097 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-25d1e947-1873-4395-843e-77510040f2cd tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] [instance: a1e8b81b-5e26-4d5c-87ca-057eea43abba] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:09.371141 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-25d1e947-1873-4395-843e-77510040f2cd tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:09.371964 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-25d1e947-1873-4395-843e-77510040f2cd tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:09.373134 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-25d1e947-1873-4395-843e-77510040f2cd tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:09.374252 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-25d1e947-1873-4395-843e-77510040f2cd tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:09.374947 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-25d1e947-1873-4395-843e-77510040f2cd tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:09.375724 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-25d1e947-1873-4395-843e-77510040f2cd tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:09.400044 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-8eb6a4aa-2309-4cc9-8037-6f2cc5df1213 req-cded4bda-67f5-4e27-99f6-0cd1dc08b054 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55d73a76-3d5e-426c-8a99-9cae92f8498b", "name": "network-vif-plugged", "status": "completed", "tag": "42d92097-d729-44f9-8a5b-0613e0581707"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:39:09.417595 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-8eb6a4aa-2309-4cc9-8037-6f2cc5df1213 req-cded4bda-67f5-4e27-99f6-0cd1dc08b054 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:09.422235 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-8eb6a4aa-2309-4cc9-8037-6f2cc5df1213 req-cded4bda-67f5-4e27-99f6-0cd1dc08b054 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:09.422734 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-8eb6a4aa-2309-4cc9-8037-6f2cc5df1213 req-cded4bda-67f5-4e27-99f6-0cd1dc08b054 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:09.466826 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-8eb6a4aa-2309-4cc9-8037-6f2cc5df1213 req-cded4bda-67f5-4e27-99f6-0cd1dc08b054 service nova] Creating event network-vif-plugged:42d92097-d729-44f9-8a5b-0613e0581707 for instance 55d73a76-3d5e-426c-8a99-9cae92f8498b on n-h1-854823-8 Oct 04 20:39:09.479120 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-8eb6a4aa-2309-4cc9-8037-6f2cc5df1213 req-cded4bda-67f5-4e27-99f6-0cd1dc08b054 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.391917 Oct 04 20:39:09.479901 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 738/1422] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:39:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:39:09.719648 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-25d1e947-1873-4395-843e-77510040f2cd tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36f4114dc4f443f8b48da7b4027e0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a23a85365414f92bbc03177d7f190e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:09.730042 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-25d1e947-1873-4395-843e-77510040f2cd tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] 10.222.0.33 "GET /compute/v2.1/servers/a1e8b81b-5e26-4d5c-87ca-057eea43abba" status: 200 len: 1318 microversion: 2.1 time: 0.389174 Oct 04 20:39:09.736968 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 685/1423] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:09 2022] GET /compute/v2.1/servers/a1e8b81b-5e26-4d5c-87ca-057eea43abba => generated 1318 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:09.774525 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-77cfdc39-aed8-43d4-809a-c8f972f4553d tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:09.776523 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-77cfdc39-aed8-43d4-809a-c8f972f4553d tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] [instance: 23da26ba-68f4-4aef-b13c-0b6588a65e43] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:09.797237 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-77cfdc39-aed8-43d4-809a-c8f972f4553d tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:09.797788 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-77cfdc39-aed8-43d4-809a-c8f972f4553d tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:09.798236 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-77cfdc39-aed8-43d4-809a-c8f972f4553d tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:09.799004 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-77cfdc39-aed8-43d4-809a-c8f972f4553d tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:09.799467 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-77cfdc39-aed8-43d4-809a-c8f972f4553d tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:09.800533 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-77cfdc39-aed8-43d4-809a-c8f972f4553d tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:09.989053 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-77cfdc39-aed8-43d4-809a-c8f972f4553d tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3563efe2b8c94931a2a46c4e14811b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3118a5d96843d3bede1ed94bd9717e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:10.004320 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-77cfdc39-aed8-43d4-809a-c8f972f4553d tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] 10.222.0.33 "GET /compute/v2.1/servers/23da26ba-68f4-4aef-b13c-0b6588a65e43" status: 200 len: 1477 microversion: 2.1 time: 0.237081 Oct 04 20:39:10.014431 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 739/1424] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:09 2022] GET /compute/v2.1/servers/23da26ba-68f4-4aef-b13c-0b6588a65e43 => generated 1477 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:10.107166 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7e73b996-b625-43d0-9a29-fcfe68fa6407 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:10.108456 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-7e73b996-b625-43d0-9a29-fcfe68fa6407 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] [instance: d2173117-c1c5-4c2d-9658-914e67649cdd] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:10.123522 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7e73b996-b625-43d0-9a29-fcfe68fa6407 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:10.126247 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7e73b996-b625-43d0-9a29-fcfe68fa6407 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:10.126725 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7e73b996-b625-43d0-9a29-fcfe68fa6407 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:10.127461 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7e73b996-b625-43d0-9a29-fcfe68fa6407 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:10.128172 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7e73b996-b625-43d0-9a29-fcfe68fa6407 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:10.131033 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7e73b996-b625-43d0-9a29-fcfe68fa6407 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:10.324650 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-7e73b996-b625-43d0-9a29-fcfe68fa6407 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a82c49a62249029ebc6ae3b4829709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecf3793be3eb4f3186c07a7e45fd8f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:10.335583 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-7e73b996-b625-43d0-9a29-fcfe68fa6407 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] 10.222.0.33 "GET /compute/v2.1/servers/d2173117-c1c5-4c2d-9658-914e67649cdd" status: 200 len: 1325 microversion: 2.1 time: 0.233322 Oct 04 20:39:10.336156 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 686/1425] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:10 2022] GET /compute/v2.1/servers/d2173117-c1c5-4c2d-9658-914e67649cdd => generated 1325 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:39:10.372540 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9a9e9e4b-e976-4748-a273-9d5599d3ee37 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:10.373188 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-9a9e9e4b-e976-4748-a273-9d5599d3ee37 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] [instance: 83df4756-40e2-4fc6-be48-48a82dd4572a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:10.386850 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9a9e9e4b-e976-4748-a273-9d5599d3ee37 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:10.388169 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9a9e9e4b-e976-4748-a273-9d5599d3ee37 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:10.388781 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9a9e9e4b-e976-4748-a273-9d5599d3ee37 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:10.389686 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9a9e9e4b-e976-4748-a273-9d5599d3ee37 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:10.390144 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9a9e9e4b-e976-4748-a273-9d5599d3ee37 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:10.390597 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9a9e9e4b-e976-4748-a273-9d5599d3ee37 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:10.423737 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-87eccad5-0538-4438-a9d4-a6a0781301f4 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerTestJSON-server-1599268223", "imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63", "flavorRef": "452"}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:39:10.464402 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-9a9e9e4b-e976-4748-a273-9d5599d3ee37 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '800db3a57ada47eca381b00189fdbf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66ec8ea91b04deb90b679589e0495bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:10.474895 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-9a9e9e4b-e976-4748-a273-9d5599d3ee37 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] 10.222.0.33 "GET /compute/v2.1/servers/83df4756-40e2-4fc6-be48-48a82dd4572a" status: 200 len: 1239 microversion: 2.1 time: 0.115775 Oct 04 20:39:10.475830 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 687/1426] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:10 2022] GET /compute/v2.1/servers/83df4756-40e2-4fc6-be48-48a82dd4572a => generated 1239 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:10.490920 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.network.neutron [None req-87eccad5-0538-4438-a9d4-a6a0781301f4 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] validate_networks() for None {{(pid=128802) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:39:10.642292 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-3a21db1f-7c91-4020-a625-43b8d26397b9 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-933451257", "imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:39:10.718590 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.network.neutron [None req-3a21db1f-7c91-4020-a625-43b8d26397b9 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] validate_networks() for [('5340dae4-9a85-4904-9e18-daf4cbe871b8', None, None, None, None, None)] {{(pid=128801) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:39:10.787069 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-87eccad5-0538-4438-a9d4-a6a0781301f4 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Flavor limits 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:39:10.787488 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-87eccad5-0538-4438-a9d4-a6a0781301f4 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Image limits 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:39:10.788007 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-87eccad5-0538-4438-a9d4-a6a0781301f4 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Flavor pref 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:39:10.788458 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-87eccad5-0538-4438-a9d4-a6a0781301f4 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Image pref 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:39:10.788862 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-87eccad5-0538-4438-a9d4-a6a0781301f4 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:39:10.800335 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-87eccad5-0538-4438-a9d4-a6a0781301f4 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:10.800841 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-87eccad5-0538-4438-a9d4-a6a0781301f4 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:10.801394 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-87eccad5-0538-4438-a9d4-a6a0781301f4 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:10.802710 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-87eccad5-0538-4438-a9d4-a6a0781301f4 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:10.803177 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-87eccad5-0538-4438-a9d4-a6a0781301f4 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:10.803604 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-87eccad5-0538-4438-a9d4-a6a0781301f4 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:10.823933 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-87eccad5-0538-4438-a9d4-a6a0781301f4 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Getting quotas for project 4151c9ef7ae04a728306297f58ba5088. Resources: {'ram', 'instances', 'cores'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:39:10.828826 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-87eccad5-0538-4438-a9d4-a6a0781301f4 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Getting quotas for user 7bdfa818206f4f4b88cc962c1c34adf3 and project 4151c9ef7ae04a728306297f58ba5088. Resources: {'ram', 'instances', 'cores'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:39:10.842678 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-87eccad5-0538-4438-a9d4-a6a0781301f4 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Going to run 1 instances... {{(pid=128802) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:39:10.845024 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-87eccad5-0538-4438-a9d4-a6a0781301f4 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] [instance: 0dd1d0cf-a3a0-4ea2-8260-ac206bbfac88] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='15b24725-0c99-4bcf-b1fb-907cdf8e2d63',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128802) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:39:10.897276 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-87eccad5-0538-4438-a9d4-a6a0781301f4 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.661334 Oct 04 20:39:10.898592 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 740/1427] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 20:39:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 664 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 20:39:10.909532 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-dabed385-af3d-4b69-89e5-589e25ff7773 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:10.910563 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-dabed385-af3d-4b69-89e5-589e25ff7773 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] [instance: a1e8b81b-5e26-4d5c-87ca-057eea43abba] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:10.918839 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dabed385-af3d-4b69-89e5-589e25ff7773 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:10.919603 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dabed385-af3d-4b69-89e5-589e25ff7773 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:10.920220 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dabed385-af3d-4b69-89e5-589e25ff7773 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:10.921084 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dabed385-af3d-4b69-89e5-589e25ff7773 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:10.921694 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dabed385-af3d-4b69-89e5-589e25ff7773 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:10.922267 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dabed385-af3d-4b69-89e5-589e25ff7773 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:11.228175 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-dabed385-af3d-4b69-89e5-589e25ff7773 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36f4114dc4f443f8b48da7b4027e0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a23a85365414f92bbc03177d7f190e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:11.242675 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-dabed385-af3d-4b69-89e5-589e25ff7773 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] 10.222.0.33 "GET /compute/v2.1/servers/a1e8b81b-5e26-4d5c-87ca-057eea43abba" status: 200 len: 1318 microversion: 2.1 time: 0.342453 Oct 04 20:39:11.243356 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 741/1428] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:10 2022] GET /compute/v2.1/servers/a1e8b81b-5e26-4d5c-87ca-057eea43abba => generated 1318 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:11.264708 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-8a1bae52-de5e-4910-a5a2-c85e7e75a806 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:11.265392 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-8a1bae52-de5e-4910-a5a2-c85e7e75a806 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] [instance: 0dd1d0cf-a3a0-4ea2-8260-ac206bbfac88] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:11.283212 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-3a21db1f-7c91-4020-a625-43b8d26397b9 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Flavor limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:39:11.283708 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-3a21db1f-7c91-4020-a625-43b8d26397b9 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Image limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:39:11.284781 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-3a21db1f-7c91-4020-a625-43b8d26397b9 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Flavor pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:39:11.285247 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-3a21db1f-7c91-4020-a625-43b8d26397b9 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Image pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:39:11.285654 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-3a21db1f-7c91-4020-a625-43b8d26397b9 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:39:11.295391 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3a21db1f-7c91-4020-a625-43b8d26397b9 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:11.295884 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3a21db1f-7c91-4020-a625-43b8d26397b9 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:11.296316 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3a21db1f-7c91-4020-a625-43b8d26397b9 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:11.297037 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3a21db1f-7c91-4020-a625-43b8d26397b9 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:11.297487 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3a21db1f-7c91-4020-a625-43b8d26397b9 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:11.297911 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3a21db1f-7c91-4020-a625-43b8d26397b9 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:11.316332 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-3a21db1f-7c91-4020-a625-43b8d26397b9 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Getting quotas for project b44ce10b78bf49c882c9b4df06187114. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:39:11.320463 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:39:11.321815 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-3a21db1f-7c91-4020-a625-43b8d26397b9 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Getting quotas for user f96919ec99c14864876d64a9c2b20f8f and project b44ce10b78bf49c882c9b4df06187114. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:39:11.336136 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-3a21db1f-7c91-4020-a625-43b8d26397b9 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Going to run 1 instances... {{(pid=128801) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:39:11.338610 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-3a21db1f-7c91-4020-a625-43b8d26397b9 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] [instance: a2fc592c-9dac-4f72-8633-229925d3bf76] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='15b24725-0c99-4bcf-b1fb-907cdf8e2d63',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128801) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:39:11.339193 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-8a1bae52-de5e-4910-a5a2-c85e7e75a806 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bdfa818206f4f4b88cc962c1c34adf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4151c9ef7ae04a728306297f58ba5088', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:11.350536 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-8a1bae52-de5e-4910-a5a2-c85e7e75a806 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] 10.222.0.33 "GET /compute/v2.1/servers/0dd1d0cf-a3a0-4ea2-8260-ac206bbfac88" status: 200 len: 1217 microversion: 2.1 time: 0.089571 Oct 04 20:39:11.351583 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 742/1429] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:11 2022] GET /compute/v2.1/servers/0dd1d0cf-a3a0-4ea2-8260-ac206bbfac88 => generated 1217 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:11.357932 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-541184c6-9e6b-47aa-b258-2fdf580daf05 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:11.366287 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-541184c6-9e6b-47aa-b258-2fdf580daf05 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] [instance: 23da26ba-68f4-4aef-b13c-0b6588a65e43] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:11.376456 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:39:11.378906 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-541184c6-9e6b-47aa-b258-2fdf580daf05 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:11.379555 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-541184c6-9e6b-47aa-b258-2fdf580daf05 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:11.379997 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-541184c6-9e6b-47aa-b258-2fdf580daf05 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:11.380814 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-541184c6-9e6b-47aa-b258-2fdf580daf05 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:11.381323 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-541184c6-9e6b-47aa-b258-2fdf580daf05 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:11.381822 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-541184c6-9e6b-47aa-b258-2fdf580daf05 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:11.408123 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-3a21db1f-7c91-4020-a625-43b8d26397b9 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.854780 Oct 04 20:39:11.409979 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 688/1430] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 20:39:10 2022] POST /compute/v2.1/servers => generated 383 bytes in 857 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 20:39:11.417076 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-dd44695a-02a6-4dfb-b3f5-f1fc7f307ac1 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:11.417946 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-dd44695a-02a6-4dfb-b3f5-f1fc7f307ac1 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] [instance: d2173117-c1c5-4c2d-9658-914e67649cdd] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:11.425767 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dd44695a-02a6-4dfb-b3f5-f1fc7f307ac1 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:11.427155 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dd44695a-02a6-4dfb-b3f5-f1fc7f307ac1 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:11.427830 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dd44695a-02a6-4dfb-b3f5-f1fc7f307ac1 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:11.428795 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dd44695a-02a6-4dfb-b3f5-f1fc7f307ac1 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:11.429473 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dd44695a-02a6-4dfb-b3f5-f1fc7f307ac1 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:11.430130 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dd44695a-02a6-4dfb-b3f5-f1fc7f307ac1 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:11.632472 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-541184c6-9e6b-47aa-b258-2fdf580daf05 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3563efe2b8c94931a2a46c4e14811b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3118a5d96843d3bede1ed94bd9717e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:11.641823 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-541184c6-9e6b-47aa-b258-2fdf580daf05 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] 10.222.0.33 "GET /compute/v2.1/servers/23da26ba-68f4-4aef-b13c-0b6588a65e43" status: 200 len: 1477 microversion: 2.1 time: 0.289058 Oct 04 20:39:11.651783 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 743/1431] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:11 2022] GET /compute/v2.1/servers/23da26ba-68f4-4aef-b13c-0b6588a65e43 => generated 1477 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:11.666424 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-249eb0c3-5415-4cf3-81a8-dffb0147f2cf tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:11.668704 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-249eb0c3-5415-4cf3-81a8-dffb0147f2cf tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] [instance: a2fc592c-9dac-4f72-8633-229925d3bf76] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:11.751454 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-dd44695a-02a6-4dfb-b3f5-f1fc7f307ac1 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a82c49a62249029ebc6ae3b4829709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecf3793be3eb4f3186c07a7e45fd8f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:11.768582 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-dd44695a-02a6-4dfb-b3f5-f1fc7f307ac1 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] 10.222.0.33 "GET /compute/v2.1/servers/d2173117-c1c5-4c2d-9658-914e67649cdd" status: 200 len: 1325 microversion: 2.1 time: 0.352622 Oct 04 20:39:11.770417 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 689/1432] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:11 2022] GET /compute/v2.1/servers/d2173117-c1c5-4c2d-9658-914e67649cdd => generated 1325 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:11.777056 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a3f96c59-8ad9-4569-b081-fb9723306ea4 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:11.777931 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a3f96c59-8ad9-4569-b081-fb9723306ea4 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] [instance: 83df4756-40e2-4fc6-be48-48a82dd4572a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:11.791239 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a3f96c59-8ad9-4569-b081-fb9723306ea4 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:11.792247 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a3f96c59-8ad9-4569-b081-fb9723306ea4 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:11.792971 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a3f96c59-8ad9-4569-b081-fb9723306ea4 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:11.793977 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a3f96c59-8ad9-4569-b081-fb9723306ea4 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:11.794545 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-249eb0c3-5415-4cf3-81a8-dffb0147f2cf tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96919ec99c14864876d64a9c2b20f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b44ce10b78bf49c882c9b4df06187114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:11.795008 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a3f96c59-8ad9-4569-b081-fb9723306ea4 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:11.795654 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a3f96c59-8ad9-4569-b081-fb9723306ea4 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:11.803668 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-249eb0c3-5415-4cf3-81a8-dffb0147f2cf tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] 10.222.0.33 "GET /compute/v2.1/servers/a2fc592c-9dac-4f72-8633-229925d3bf76" status: 200 len: 1213 microversion: 2.1 time: 0.150601 Oct 04 20:39:11.804262 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 744/1433] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:11 2022] GET /compute/v2.1/servers/a2fc592c-9dac-4f72-8633-229925d3bf76 => generated 1213 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:11.826809 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-2000282d-8771-424e-a1cc-a1f4aab94f0a req-96417c60-88c5-4162-a5b9-1e7606cf66b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1e8b81b-5e26-4d5c-87ca-057eea43abba", "name": "network-vif-plugged", "status": "completed", "tag": "79dd85da-fe6b-4163-bb34-adeab48cf2e5"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:39:11.837859 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-2000282d-8771-424e-a1cc-a1f4aab94f0a req-96417c60-88c5-4162-a5b9-1e7606cf66b4 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:11.838876 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-2000282d-8771-424e-a1cc-a1f4aab94f0a req-96417c60-88c5-4162-a5b9-1e7606cf66b4 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:11.839500 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-2000282d-8771-424e-a1cc-a1f4aab94f0a req-96417c60-88c5-4162-a5b9-1e7606cf66b4 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:11.873074 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-2000282d-8771-424e-a1cc-a1f4aab94f0a req-96417c60-88c5-4162-a5b9-1e7606cf66b4 service nova] Creating event network-vif-plugged:79dd85da-fe6b-4163-bb34-adeab48cf2e5 for instance a1e8b81b-5e26-4d5c-87ca-057eea43abba on n-h2-854823-8 Oct 04 20:39:11.886221 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-2000282d-8771-424e-a1cc-a1f4aab94f0a req-96417c60-88c5-4162-a5b9-1e7606cf66b4 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062975 Oct 04 20:39:11.887259 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 745/1434] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:39:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:39:11.901252 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-a3f96c59-8ad9-4569-b081-fb9723306ea4 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '800db3a57ada47eca381b00189fdbf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66ec8ea91b04deb90b679589e0495bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:11.913623 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a3f96c59-8ad9-4569-b081-fb9723306ea4 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] 10.222.0.33 "GET /compute/v2.1/servers/83df4756-40e2-4fc6-be48-48a82dd4572a" status: 200 len: 1231 microversion: 2.1 time: 0.141381 Oct 04 20:39:11.914528 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 690/1435] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:11 2022] GET /compute/v2.1/servers/83df4756-40e2-4fc6-be48-48a82dd4572a => generated 1231 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:12.272684 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-0932c1c9-a331-40cf-a535-f6cfaf72ea3b tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:12.274990 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-0932c1c9-a331-40cf-a535-f6cfaf72ea3b tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] [instance: a1e8b81b-5e26-4d5c-87ca-057eea43abba] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:12.283642 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0932c1c9-a331-40cf-a535-f6cfaf72ea3b tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:12.285008 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0932c1c9-a331-40cf-a535-f6cfaf72ea3b tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:12.285677 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0932c1c9-a331-40cf-a535-f6cfaf72ea3b tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:12.288061 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0932c1c9-a331-40cf-a535-f6cfaf72ea3b tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:12.288681 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0932c1c9-a331-40cf-a535-f6cfaf72ea3b tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:12.289231 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0932c1c9-a331-40cf-a535-f6cfaf72ea3b tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:12.383974 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-4c104a3e-8ae1-4059-af58-c510475d6b7f tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:12.384814 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-4c104a3e-8ae1-4059-af58-c510475d6b7f tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] [instance: 0dd1d0cf-a3a0-4ea2-8260-ac206bbfac88] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:12.392560 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4c104a3e-8ae1-4059-af58-c510475d6b7f tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:12.394320 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4c104a3e-8ae1-4059-af58-c510475d6b7f tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:12.395399 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4c104a3e-8ae1-4059-af58-c510475d6b7f tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:12.396315 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4c104a3e-8ae1-4059-af58-c510475d6b7f tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:12.396982 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4c104a3e-8ae1-4059-af58-c510475d6b7f tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:12.397608 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4c104a3e-8ae1-4059-af58-c510475d6b7f tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:12.584503 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-0932c1c9-a331-40cf-a535-f6cfaf72ea3b tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36f4114dc4f443f8b48da7b4027e0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a23a85365414f92bbc03177d7f190e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:12.598278 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-0932c1c9-a331-40cf-a535-f6cfaf72ea3b tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] 10.222.0.33 "GET /compute/v2.1/servers/a1e8b81b-5e26-4d5c-87ca-057eea43abba" status: 200 len: 1318 microversion: 2.1 time: 0.335153 Oct 04 20:39:12.599831 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 746/1436] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:12 2022] GET /compute/v2.1/servers/a1e8b81b-5e26-4d5c-87ca-057eea43abba => generated 1318 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:12.616050 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-4c104a3e-8ae1-4059-af58-c510475d6b7f tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bdfa818206f4f4b88cc962c1c34adf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4151c9ef7ae04a728306297f58ba5088', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:12.624088 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-4c104a3e-8ae1-4059-af58-c510475d6b7f tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] 10.222.0.33 "GET /compute/v2.1/servers/0dd1d0cf-a3a0-4ea2-8260-ac206bbfac88" status: 200 len: 1213 microversion: 2.1 time: 0.249006 Oct 04 20:39:12.625812 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 691/1437] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:12 2022] GET /compute/v2.1/servers/0dd1d0cf-a3a0-4ea2-8260-ac206bbfac88 => generated 1213 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:39:12.669385 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-017aa91d-bf8c-42ad-9be3-cb79ce78658e tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:12.670075 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-017aa91d-bf8c-42ad-9be3-cb79ce78658e tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] [instance: 23da26ba-68f4-4aef-b13c-0b6588a65e43] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:12.676705 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-017aa91d-bf8c-42ad-9be3-cb79ce78658e tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:12.677192 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-017aa91d-bf8c-42ad-9be3-cb79ce78658e tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:12.677627 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-017aa91d-bf8c-42ad-9be3-cb79ce78658e tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:12.678473 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-017aa91d-bf8c-42ad-9be3-cb79ce78658e tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:12.679714 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-017aa91d-bf8c-42ad-9be3-cb79ce78658e tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:12.680143 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-017aa91d-bf8c-42ad-9be3-cb79ce78658e tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:12.797908 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7af142b9-08aa-42f9-9a51-3a707d2b5f26 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:12.798584 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-7af142b9-08aa-42f9-9a51-3a707d2b5f26 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] [instance: d2173117-c1c5-4c2d-9658-914e67649cdd] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:12.813685 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7af142b9-08aa-42f9-9a51-3a707d2b5f26 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:12.814180 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7af142b9-08aa-42f9-9a51-3a707d2b5f26 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:12.814645 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7af142b9-08aa-42f9-9a51-3a707d2b5f26 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:12.816161 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7af142b9-08aa-42f9-9a51-3a707d2b5f26 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:12.817336 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7af142b9-08aa-42f9-9a51-3a707d2b5f26 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:12.818006 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7af142b9-08aa-42f9-9a51-3a707d2b5f26 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:12.865132 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-017aa91d-bf8c-42ad-9be3-cb79ce78658e tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3563efe2b8c94931a2a46c4e14811b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3118a5d96843d3bede1ed94bd9717e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:12.873712 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-017aa91d-bf8c-42ad-9be3-cb79ce78658e tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] 10.222.0.33 "GET /compute/v2.1/servers/23da26ba-68f4-4aef-b13c-0b6588a65e43" status: 200 len: 1476 microversion: 2.1 time: 0.211253 Oct 04 20:39:12.874313 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 747/1438] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:12 2022] GET /compute/v2.1/servers/23da26ba-68f4-4aef-b13c-0b6588a65e43 => generated 1476 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:12.879920 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-96016ab3-750b-4f9f-985c-8f04508d0e6f tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:12.880525 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-96016ab3-750b-4f9f-985c-8f04508d0e6f tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] [instance: a2fc592c-9dac-4f72-8633-229925d3bf76] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:12.890956 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-96016ab3-750b-4f9f-985c-8f04508d0e6f tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:12.892254 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-96016ab3-750b-4f9f-985c-8f04508d0e6f tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:12.892696 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-96016ab3-750b-4f9f-985c-8f04508d0e6f tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:12.893436 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-96016ab3-750b-4f9f-985c-8f04508d0e6f tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:12.893890 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-96016ab3-750b-4f9f-985c-8f04508d0e6f tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:12.894512 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-96016ab3-750b-4f9f-985c-8f04508d0e6f tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:12.973929 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-96016ab3-750b-4f9f-985c-8f04508d0e6f tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96919ec99c14864876d64a9c2b20f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b44ce10b78bf49c882c9b4df06187114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:12.983986 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-96016ab3-750b-4f9f-985c-8f04508d0e6f tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] 10.222.0.33 "GET /compute/v2.1/servers/a2fc592c-9dac-4f72-8633-229925d3bf76" status: 200 len: 1209 microversion: 2.1 time: 0.108299 Oct 04 20:39:12.984862 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 748/1439] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:12 2022] GET /compute/v2.1/servers/a2fc592c-9dac-4f72-8633-229925d3bf76 => generated 1209 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:12.995656 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-7af142b9-08aa-42f9-9a51-3a707d2b5f26 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a82c49a62249029ebc6ae3b4829709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecf3793be3eb4f3186c07a7e45fd8f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:13.007625 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-7af142b9-08aa-42f9-9a51-3a707d2b5f26 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] 10.222.0.33 "GET /compute/v2.1/servers/d2173117-c1c5-4c2d-9658-914e67649cdd" status: 200 len: 1325 microversion: 2.1 time: 0.214237 Oct 04 20:39:13.008609 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 692/1440] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:12 2022] GET /compute/v2.1/servers/d2173117-c1c5-4c2d-9658-914e67649cdd => generated 1325 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:39:13.010333 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-67e7b59f-af38-433d-a3c5-e5e3ae264756 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:13.011824 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-67e7b59f-af38-433d-a3c5-e5e3ae264756 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] [instance: 83df4756-40e2-4fc6-be48-48a82dd4572a] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:13.018029 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-67e7b59f-af38-433d-a3c5-e5e3ae264756 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:13.018958 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-67e7b59f-af38-433d-a3c5-e5e3ae264756 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:13.019574 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-67e7b59f-af38-433d-a3c5-e5e3ae264756 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:13.021768 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-67e7b59f-af38-433d-a3c5-e5e3ae264756 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:13.022422 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-67e7b59f-af38-433d-a3c5-e5e3ae264756 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:13.023080 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-67e7b59f-af38-433d-a3c5-e5e3ae264756 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:13.132126 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-67e7b59f-af38-433d-a3c5-e5e3ae264756 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '800db3a57ada47eca381b00189fdbf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66ec8ea91b04deb90b679589e0495bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:13.152262 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-67e7b59f-af38-433d-a3c5-e5e3ae264756 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] 10.222.0.33 "GET /compute/v2.1/servers/83df4756-40e2-4fc6-be48-48a82dd4572a" status: 200 len: 1295 microversion: 2.1 time: 0.150009 Oct 04 20:39:13.153082 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 749/1441] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:12 2022] GET /compute/v2.1/servers/83df4756-40e2-4fc6-be48-48a82dd4572a => generated 1295 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:13.627148 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6169e8c7-c441-4adb-8b75-353aff192812 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:13.630105 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-6169e8c7-c441-4adb-8b75-353aff192812 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] [instance: a1e8b81b-5e26-4d5c-87ca-057eea43abba] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:13.639456 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6169e8c7-c441-4adb-8b75-353aff192812 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:13.644248 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6169e8c7-c441-4adb-8b75-353aff192812 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:13.645015 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6169e8c7-c441-4adb-8b75-353aff192812 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:13.646433 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6169e8c7-c441-4adb-8b75-353aff192812 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:13.647084 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6169e8c7-c441-4adb-8b75-353aff192812 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:13.647711 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6169e8c7-c441-4adb-8b75-353aff192812 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:13.648568 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-8fbed181-5db0-4575-bd8f-a49289cd779d tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:13.649191 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-8fbed181-5db0-4575-bd8f-a49289cd779d tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] [instance: 0dd1d0cf-a3a0-4ea2-8260-ac206bbfac88] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:13.655856 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8fbed181-5db0-4575-bd8f-a49289cd779d tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:13.656350 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8fbed181-5db0-4575-bd8f-a49289cd779d tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:13.666371 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8fbed181-5db0-4575-bd8f-a49289cd779d tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:13.667332 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8fbed181-5db0-4575-bd8f-a49289cd779d tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:13.667840 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8fbed181-5db0-4575-bd8f-a49289cd779d tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:13.668280 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8fbed181-5db0-4575-bd8f-a49289cd779d tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:13.954201 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-8fbed181-5db0-4575-bd8f-a49289cd779d tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bdfa818206f4f4b88cc962c1c34adf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4151c9ef7ae04a728306297f58ba5088', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:13.973698 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-8fbed181-5db0-4575-bd8f-a49289cd779d tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] 10.222.0.33 "GET /compute/v2.1/servers/0dd1d0cf-a3a0-4ea2-8260-ac206bbfac88" status: 200 len: 1269 microversion: 2.1 time: 0.329574 Oct 04 20:39:13.974621 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 750/1442] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:13 2022] GET /compute/v2.1/servers/0dd1d0cf-a3a0-4ea2-8260-ac206bbfac88 => generated 1269 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:39:14.004583 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-125b9b7f-8434-4285-8554-f20078682ac0 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:14.005607 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-125b9b7f-8434-4285-8554-f20078682ac0 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] [instance: 23da26ba-68f4-4aef-b13c-0b6588a65e43] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:14.021880 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-125b9b7f-8434-4285-8554-f20078682ac0 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:14.022406 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-125b9b7f-8434-4285-8554-f20078682ac0 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:14.024425 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-125b9b7f-8434-4285-8554-f20078682ac0 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:14.026220 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-125b9b7f-8434-4285-8554-f20078682ac0 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:14.026741 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-125b9b7f-8434-4285-8554-f20078682ac0 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:14.028871 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-125b9b7f-8434-4285-8554-f20078682ac0 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:14.280688 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-6169e8c7-c441-4adb-8b75-353aff192812 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36f4114dc4f443f8b48da7b4027e0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a23a85365414f92bbc03177d7f190e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:14.289763 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-6169e8c7-c441-4adb-8b75-353aff192812 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] 10.222.0.33 "GET /compute/v2.1/servers/a1e8b81b-5e26-4d5c-87ca-057eea43abba" status: 200 len: 1318 microversion: 2.1 time: 0.668115 Oct 04 20:39:14.291073 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 693/1443] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:13 2022] GET /compute/v2.1/servers/a1e8b81b-5e26-4d5c-87ca-057eea43abba => generated 1318 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:14.296772 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-3ac013ea-e125-446e-a202-2b7fce0048f5 req-1300b998-6e08-4f8d-908c-07243b28f3cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2173117-c1c5-4c2d-9658-914e67649cdd", "name": "network-vif-plugged", "status": "completed", "tag": "5f97afab-20db-4d1c-9da9-8ce948bd87f0"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:39:14.308603 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-3ac013ea-e125-446e-a202-2b7fce0048f5 req-1300b998-6e08-4f8d-908c-07243b28f3cf service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:14.309422 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-3ac013ea-e125-446e-a202-2b7fce0048f5 req-1300b998-6e08-4f8d-908c-07243b28f3cf service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:14.309966 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-3ac013ea-e125-446e-a202-2b7fce0048f5 req-1300b998-6e08-4f8d-908c-07243b28f3cf service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:14.324716 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-3ac013ea-e125-446e-a202-2b7fce0048f5 req-1300b998-6e08-4f8d-908c-07243b28f3cf service nova] Creating event network-vif-plugged:5f97afab-20db-4d1c-9da9-8ce948bd87f0 for instance d2173117-c1c5-4c2d-9658-914e67649cdd on n-h1-854823-8 Oct 04 20:39:14.336407 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-3ac013ea-e125-446e-a202-2b7fce0048f5 req-1300b998-6e08-4f8d-908c-07243b28f3cf service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043594 Oct 04 20:39:14.337988 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 694/1444] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:39:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:39:14.347930 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f3fe3b51-eda8-44ed-a6c9-b1f7a6fb7060 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:14.350171 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f3fe3b51-eda8-44ed-a6c9-b1f7a6fb7060 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] [instance: a2fc592c-9dac-4f72-8633-229925d3bf76] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:14.362292 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f3fe3b51-eda8-44ed-a6c9-b1f7a6fb7060 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:14.363506 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f3fe3b51-eda8-44ed-a6c9-b1f7a6fb7060 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:14.365846 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f3fe3b51-eda8-44ed-a6c9-b1f7a6fb7060 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:14.366908 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f3fe3b51-eda8-44ed-a6c9-b1f7a6fb7060 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:14.367620 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f3fe3b51-eda8-44ed-a6c9-b1f7a6fb7060 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:14.368314 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f3fe3b51-eda8-44ed-a6c9-b1f7a6fb7060 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:14.520295 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f3fe3b51-eda8-44ed-a6c9-b1f7a6fb7060 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96919ec99c14864876d64a9c2b20f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b44ce10b78bf49c882c9b4df06187114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:14.529863 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f3fe3b51-eda8-44ed-a6c9-b1f7a6fb7060 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] 10.222.0.33 "GET /compute/v2.1/servers/a2fc592c-9dac-4f72-8633-229925d3bf76" status: 200 len: 1265 microversion: 2.1 time: 0.188849 Oct 04 20:39:14.530639 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 695/1445] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:14 2022] GET /compute/v2.1/servers/a2fc592c-9dac-4f72-8633-229925d3bf76 => generated 1265 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:14.537835 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-4a563059-acd4-41ec-a4a5-6b7ed9239a6e tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:14.538586 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-4a563059-acd4-41ec-a4a5-6b7ed9239a6e tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] [instance: d2173117-c1c5-4c2d-9658-914e67649cdd] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:14.546084 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4a563059-acd4-41ec-a4a5-6b7ed9239a6e tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:14.546947 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4a563059-acd4-41ec-a4a5-6b7ed9239a6e tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:14.547717 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4a563059-acd4-41ec-a4a5-6b7ed9239a6e tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:14.548763 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4a563059-acd4-41ec-a4a5-6b7ed9239a6e tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:14.549283 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4a563059-acd4-41ec-a4a5-6b7ed9239a6e tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:14.550439 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4a563059-acd4-41ec-a4a5-6b7ed9239a6e tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:14.740922 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-125b9b7f-8434-4285-8554-f20078682ac0 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3563efe2b8c94931a2a46c4e14811b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3118a5d96843d3bede1ed94bd9717e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:14.750290 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-125b9b7f-8434-4285-8554-f20078682ac0 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] 10.222.0.33 "GET /compute/v2.1/servers/23da26ba-68f4-4aef-b13c-0b6588a65e43" status: 200 len: 1476 microversion: 2.1 time: 0.755428 Oct 04 20:39:14.770439 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 751/1446] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:13 2022] GET /compute/v2.1/servers/23da26ba-68f4-4aef-b13c-0b6588a65e43 => generated 1476 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:14.776358 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-4efe1e1b-8d1b-467f-a620-26dff37c9a58 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:14.777252 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-4efe1e1b-8d1b-467f-a620-26dff37c9a58 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] [instance: 83df4756-40e2-4fc6-be48-48a82dd4572a] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:14.786322 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4efe1e1b-8d1b-467f-a620-26dff37c9a58 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:14.786931 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4efe1e1b-8d1b-467f-a620-26dff37c9a58 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:14.787417 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4efe1e1b-8d1b-467f-a620-26dff37c9a58 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:14.788164 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4efe1e1b-8d1b-467f-a620-26dff37c9a58 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:14.788745 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4efe1e1b-8d1b-467f-a620-26dff37c9a58 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:14.789169 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4efe1e1b-8d1b-467f-a620-26dff37c9a58 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:14.959958 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-4efe1e1b-8d1b-467f-a620-26dff37c9a58 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '800db3a57ada47eca381b00189fdbf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66ec8ea91b04deb90b679589e0495bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:14.991579 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-4efe1e1b-8d1b-467f-a620-26dff37c9a58 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] 10.222.0.33 "GET /compute/v2.1/servers/83df4756-40e2-4fc6-be48-48a82dd4572a" status: 200 len: 1293 microversion: 2.1 time: 0.219579 Oct 04 20:39:14.993913 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 752/1447] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:14 2022] GET /compute/v2.1/servers/83df4756-40e2-4fc6-be48-48a82dd4572a => generated 1293 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:15.000450 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-d96f1d09-2c00-4531-9da4-5f5505bede0d tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:15.017057 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-d96f1d09-2c00-4531-9da4-5f5505bede0d tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '11149c46e1bc468f836fe70635dbf33b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e0d8329b2c4d64bf51d88948ca0de2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:15.019811 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-d96f1d09-2c00-4531-9da4-5f5505bede0d tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Searching by: {'deleted': False, 'project_id': 'f3e0d8329b2c4d64bf51d88948ca0de2'} {{(pid=128802) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 20:39:15.031577 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d96f1d09-2c00-4531-9da4-5f5505bede0d tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:15.035316 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d96f1d09-2c00-4531-9da4-5f5505bede0d tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:15.036096 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d96f1d09-2c00-4531-9da4-5f5505bede0d tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:15.037233 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d96f1d09-2c00-4531-9da4-5f5505bede0d tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:15.038650 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d96f1d09-2c00-4531-9da4-5f5505bede0d tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:15.040156 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d96f1d09-2c00-4531-9da4-5f5505bede0d tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:15.109471 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.multi_cell_list [None req-d96f1d09-2c00-4531-9da4-5f5505bede0d tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128802) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 20:39:15.112749 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-4a563059-acd4-41ec-a4a5-6b7ed9239a6e tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a82c49a62249029ebc6ae3b4829709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecf3793be3eb4f3186c07a7e45fd8f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:15.122943 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-4a563059-acd4-41ec-a4a5-6b7ed9239a6e tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] 10.222.0.33 "GET /compute/v2.1/servers/d2173117-c1c5-4c2d-9658-914e67649cdd" status: 200 len: 1325 microversion: 2.1 time: 0.590865 Oct 04 20:39:15.130811 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 696/1448] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:14 2022] GET /compute/v2.1/servers/d2173117-c1c5-4c2d-9658-914e67649cdd => generated 1325 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:15.141538 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9f66bca7-5521-42be-aab7-647bdd89fcc7 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:15.141538 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-9f66bca7-5521-42be-aab7-647bdd89fcc7 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] [instance: 0dd1d0cf-a3a0-4ea2-8260-ac206bbfac88] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:15.167026 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9f66bca7-5521-42be-aab7-647bdd89fcc7 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:15.172927 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9f66bca7-5521-42be-aab7-647bdd89fcc7 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:15.178845 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9f66bca7-5521-42be-aab7-647bdd89fcc7 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:15.179742 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-d96f1d09-2c00-4531-9da4-5f5505bede0d tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] 10.222.0.33 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.182531 Oct 04 20:39:15.180073 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9f66bca7-5521-42be-aab7-647bdd89fcc7 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:15.183996 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9f66bca7-5521-42be-aab7-647bdd89fcc7 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:15.187019 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9f66bca7-5521-42be-aab7-647bdd89fcc7 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:15.194902 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 753/1449] 10.222.0.33 () {58 vars in 1125 bytes} [Tue Oct 4 20:39:14 2022] GET /compute/v2.1/servers => generated 343 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:39:15.207574 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-6f51eff3-8b48-43f8-ad39-da266eacbb2c tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:15.225664 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-6f51eff3-8b48-43f8-ad39-da266eacbb2c tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '11149c46e1bc468f836fe70635dbf33b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e0d8329b2c4d64bf51d88948ca0de2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:15.228425 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-6f51eff3-8b48-43f8-ad39-da266eacbb2c tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Searching by: {'deleted': False, 'project_id': 'f3e0d8329b2c4d64bf51d88948ca0de2'} {{(pid=128802) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 20:39:15.246155 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6f51eff3-8b48-43f8-ad39-da266eacbb2c tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:15.248205 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6f51eff3-8b48-43f8-ad39-da266eacbb2c tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:15.250118 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6f51eff3-8b48-43f8-ad39-da266eacbb2c tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:15.252214 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6f51eff3-8b48-43f8-ad39-da266eacbb2c tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:15.255161 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6f51eff3-8b48-43f8-ad39-da266eacbb2c tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:15.256361 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6f51eff3-8b48-43f8-ad39-da266eacbb2c tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:15.303662 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.multi_cell_list [None req-6f51eff3-8b48-43f8-ad39-da266eacbb2c tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128802) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 20:39:15.370129 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-6f51eff3-8b48-43f8-ad39-da266eacbb2c tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11149c46e1bc468f836fe70635dbf33b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e0d8329b2c4d64bf51d88948ca0de2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:15.377008 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6f51eff3-8b48-43f8-ad39-da266eacbb2c tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:15.377687 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6f51eff3-8b48-43f8-ad39-da266eacbb2c tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:15.378115 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6f51eff3-8b48-43f8-ad39-da266eacbb2c tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:15.505189 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-9f66bca7-5521-42be-aab7-647bdd89fcc7 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bdfa818206f4f4b88cc962c1c34adf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4151c9ef7ae04a728306297f58ba5088', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:15.514847 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-9f66bca7-5521-42be-aab7-647bdd89fcc7 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] 10.222.0.33 "GET /compute/v2.1/servers/0dd1d0cf-a3a0-4ea2-8260-ac206bbfac88" status: 200 len: 1275 microversion: 2.1 time: 0.381813 Oct 04 20:39:15.516144 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 697/1450] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:15 2022] GET /compute/v2.1/servers/0dd1d0cf-a3a0-4ea2-8260-ac206bbfac88 => generated 1275 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:15.521512 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-801c5217-e98b-48ec-9502-c97d0605da55 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:15.528668 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-801c5217-e98b-48ec-9502-c97d0605da55 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] [instance: a1e8b81b-5e26-4d5c-87ca-057eea43abba] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:15.552452 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-801c5217-e98b-48ec-9502-c97d0605da55 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:15.553104 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-801c5217-e98b-48ec-9502-c97d0605da55 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:15.554719 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-801c5217-e98b-48ec-9502-c97d0605da55 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:15.555922 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-801c5217-e98b-48ec-9502-c97d0605da55 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:15.561483 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-801c5217-e98b-48ec-9502-c97d0605da55 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:15.563214 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-801c5217-e98b-48ec-9502-c97d0605da55 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:15.822032 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-6f51eff3-8b48-43f8-ad39-da266eacbb2c tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] 10.222.0.33 "GET /compute/v2.1/servers/detail" status: 200 len: 1606 microversion: 2.1 time: 0.624754 Oct 04 20:39:15.822977 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 754/1451] 10.222.0.33 () {58 vars in 1146 bytes} [Tue Oct 4 20:39:15 2022] GET /compute/v2.1/servers/detail => generated 1606 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:15.828320 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-ef0c9e28-f2c5-4578-ad1d-5658a71fd8ec tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:15.829158 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-ef0c9e28-f2c5-4578-ad1d-5658a71fd8ec tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] [instance: a2fc592c-9dac-4f72-8633-229925d3bf76] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:15.843789 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ef0c9e28-f2c5-4578-ad1d-5658a71fd8ec tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:15.844575 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ef0c9e28-f2c5-4578-ad1d-5658a71fd8ec tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:15.845223 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ef0c9e28-f2c5-4578-ad1d-5658a71fd8ec tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:15.851129 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ef0c9e28-f2c5-4578-ad1d-5658a71fd8ec tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:15.851970 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ef0c9e28-f2c5-4578-ad1d-5658a71fd8ec tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:15.852676 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ef0c9e28-f2c5-4578-ad1d-5658a71fd8ec tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:16.031473 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-ef0c9e28-f2c5-4578-ad1d-5658a71fd8ec tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96919ec99c14864876d64a9c2b20f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b44ce10b78bf49c882c9b4df06187114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:16.037084 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=100 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:39:16.046531 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-ef0c9e28-f2c5-4578-ad1d-5658a71fd8ec tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] 10.222.0.33 "GET /compute/v2.1/servers/a2fc592c-9dac-4f72-8633-229925d3bf76" status: 200 len: 1271 microversion: 2.1 time: 0.222114 Oct 04 20:39:16.057187 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 755/1452] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:15 2022] GET /compute/v2.1/servers/a2fc592c-9dac-4f72-8633-229925d3bf76 => generated 1271 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:16.098533 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-801c5217-e98b-48ec-9502-c97d0605da55 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36f4114dc4f443f8b48da7b4027e0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a23a85365414f92bbc03177d7f190e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:16.107503 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-801c5217-e98b-48ec-9502-c97d0605da55 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] 10.222.0.33 "GET /compute/v2.1/servers/a1e8b81b-5e26-4d5c-87ca-057eea43abba" status: 200 len: 1468 microversion: 2.1 time: 0.590138 Oct 04 20:39:16.108091 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 698/1453] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:15 2022] GET /compute/v2.1/servers/a1e8b81b-5e26-4d5c-87ca-057eea43abba => generated 1468 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:16.124590 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e4f40b0f-f028-4cc8-9985-30740cce31ad tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:16.127548 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e4f40b0f-f028-4cc8-9985-30740cce31ad tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] [instance: 23da26ba-68f4-4aef-b13c-0b6588a65e43] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:16.138731 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e4f40b0f-f028-4cc8-9985-30740cce31ad tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:16.139158 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e4f40b0f-f028-4cc8-9985-30740cce31ad tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:16.139667 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e4f40b0f-f028-4cc8-9985-30740cce31ad tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:16.140463 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e4f40b0f-f028-4cc8-9985-30740cce31ad tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:16.140967 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e4f40b0f-f028-4cc8-9985-30740cce31ad tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:16.141400 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e4f40b0f-f028-4cc8-9985-30740cce31ad tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:16.192432 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-d9b186b6-b899-4174-a1f8-6e2ae8601fca req-8bae21ed-4686-4197-a33c-0109d10a0e43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23da26ba-68f4-4aef-b13c-0b6588a65e43", "name": "network-vif-unplugged", "status": "completed", "tag": "f692dbdb-9498-4986-a253-420f090b704f"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:39:16.216039 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-d9b186b6-b899-4174-a1f8-6e2ae8601fca req-8bae21ed-4686-4197-a33c-0109d10a0e43 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:16.217854 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-d9b186b6-b899-4174-a1f8-6e2ae8601fca req-8bae21ed-4686-4197-a33c-0109d10a0e43 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:16.219313 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-d9b186b6-b899-4174-a1f8-6e2ae8601fca req-8bae21ed-4686-4197-a33c-0109d10a0e43 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:16.255500 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-d9b186b6-b899-4174-a1f8-6e2ae8601fca req-8bae21ed-4686-4197-a33c-0109d10a0e43 service nova] Creating event network-vif-unplugged:f692dbdb-9498-4986-a253-420f090b704f for instance 23da26ba-68f4-4aef-b13c-0b6588a65e43 on n-h2-854823-8 Oct 04 20:39:16.271894 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [req-d9b186b6-b899-4174-a1f8-6e2ae8601fca req-8bae21ed-4686-4197-a33c-0109d10a0e43 service nova] Instance 23da26ba-68f4-4aef-b13c-0b6588a65e43 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854823-8', 'n-h2-854823-8'} {{(pid=128802) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 20:39:16.307050 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-d9b186b6-b899-4174-a1f8-6e2ae8601fca req-8bae21ed-4686-4197-a33c-0109d10a0e43 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.248300 Oct 04 20:39:16.307719 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 756/1454] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:39:16 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:39:16.313836 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-63e3827a-b19d-452b-822e-596b9b19239b tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:16.325715 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-63e3827a-b19d-452b-822e-596b9b19239b tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] 10.222.0.33 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.015960 Oct 04 20:39:16.326941 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 757/1455] 10.222.0.33 () {58 vars in 1137 bytes} [Tue Oct 4 20:39:16 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:39:16.332393 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-8703a0f0-e742-4f12-a61e-e6b53c26fd25 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:16.333360 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-8703a0f0-e742-4f12-a61e-e6b53c26fd25 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] [instance: 83df4756-40e2-4fc6-be48-48a82dd4572a] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:16.341210 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8703a0f0-e742-4f12-a61e-e6b53c26fd25 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:16.342262 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8703a0f0-e742-4f12-a61e-e6b53c26fd25 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:16.342994 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8703a0f0-e742-4f12-a61e-e6b53c26fd25 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:16.343911 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8703a0f0-e742-4f12-a61e-e6b53c26fd25 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:16.344541 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8703a0f0-e742-4f12-a61e-e6b53c26fd25 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:16.344969 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8703a0f0-e742-4f12-a61e-e6b53c26fd25 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:16.741365 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e4f40b0f-f028-4cc8-9985-30740cce31ad tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3563efe2b8c94931a2a46c4e14811b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3118a5d96843d3bede1ed94bd9717e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:16.750986 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e4f40b0f-f028-4cc8-9985-30740cce31ad tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] 10.222.0.33 "GET /compute/v2.1/servers/23da26ba-68f4-4aef-b13c-0b6588a65e43" status: 200 len: 1476 microversion: 2.1 time: 0.631983 Oct 04 20:39:16.751853 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 699/1456] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:16 2022] GET /compute/v2.1/servers/23da26ba-68f4-4aef-b13c-0b6588a65e43 => generated 1476 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:16.757525 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b6bf0221-7900-415a-9b22-b628543d27fc tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:16.758372 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b6bf0221-7900-415a-9b22-b628543d27fc tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] [instance: 55d73a76-3d5e-426c-8a99-9cae92f8498b] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:16.764537 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b6bf0221-7900-415a-9b22-b628543d27fc tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:16.765223 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b6bf0221-7900-415a-9b22-b628543d27fc tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:16.765976 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b6bf0221-7900-415a-9b22-b628543d27fc tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:16.767010 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b6bf0221-7900-415a-9b22-b628543d27fc tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:16.767607 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b6bf0221-7900-415a-9b22-b628543d27fc tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:16.768250 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b6bf0221-7900-415a-9b22-b628543d27fc tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:16.805813 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-8703a0f0-e742-4f12-a61e-e6b53c26fd25 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '800db3a57ada47eca381b00189fdbf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66ec8ea91b04deb90b679589e0495bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:16.815802 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-8703a0f0-e742-4f12-a61e-e6b53c26fd25 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] 10.222.0.33 "GET /compute/v2.1/servers/83df4756-40e2-4fc6-be48-48a82dd4572a" status: 200 len: 1361 microversion: 2.1 time: 0.487123 Oct 04 20:39:16.818802 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 758/1457] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:16 2022] GET /compute/v2.1/servers/83df4756-40e2-4fc6-be48-48a82dd4572a => generated 1361 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:16.826189 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-dfdbedc2-3e57-4885-bc3b-c54f9cb3998d tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:16.827724 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-dfdbedc2-3e57-4885-bc3b-c54f9cb3998d tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] [instance: d2173117-c1c5-4c2d-9658-914e67649cdd] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:16.835211 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dfdbedc2-3e57-4885-bc3b-c54f9cb3998d tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:16.835974 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dfdbedc2-3e57-4885-bc3b-c54f9cb3998d tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:16.836583 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dfdbedc2-3e57-4885-bc3b-c54f9cb3998d tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:16.838101 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dfdbedc2-3e57-4885-bc3b-c54f9cb3998d tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:16.838993 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dfdbedc2-3e57-4885-bc3b-c54f9cb3998d tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:16.839601 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dfdbedc2-3e57-4885-bc3b-c54f9cb3998d tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:17.451309 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-b6bf0221-7900-415a-9b22-b628543d27fc tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36f4114dc4f443f8b48da7b4027e0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a23a85365414f92bbc03177d7f190e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:17.454003 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-dfdbedc2-3e57-4885-bc3b-c54f9cb3998d tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a82c49a62249029ebc6ae3b4829709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecf3793be3eb4f3186c07a7e45fd8f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:17.470748 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b6bf0221-7900-415a-9b22-b628543d27fc tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] 10.222.0.33 "GET /compute/v2.1/servers/55d73a76-3d5e-426c-8a99-9cae92f8498b" status: 200 len: 1468 microversion: 2.1 time: 0.717113 Oct 04 20:39:17.471371 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 700/1458] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:16 2022] GET /compute/v2.1/servers/55d73a76-3d5e-426c-8a99-9cae92f8498b => generated 1468 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:17.477779 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c5e0ef00-4c91-4dd6-8bf6-3380ba32b225 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:17.478403 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c5e0ef00-4c91-4dd6-8bf6-3380ba32b225 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] [instance: 0dd1d0cf-a3a0-4ea2-8260-ac206bbfac88] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:17.478998 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-dfdbedc2-3e57-4885-bc3b-c54f9cb3998d tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] 10.222.0.33 "GET /compute/v2.1/servers/d2173117-c1c5-4c2d-9658-914e67649cdd" status: 200 len: 1522 microversion: 2.1 time: 0.648672 Oct 04 20:39:17.482241 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 759/1459] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:16 2022] GET /compute/v2.1/servers/d2173117-c1c5-4c2d-9658-914e67649cdd => generated 1522 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:17.490549 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-aa15455d-a7da-4b2d-8722-26188474c693 tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:17.491054 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-aa15455d-a7da-4b2d-8722-26188474c693 tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] [instance: 5ac07e56-084c-4208-a988-13ec91af9171] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:17.503673 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c5e0ef00-4c91-4dd6-8bf6-3380ba32b225 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:17.504453 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c5e0ef00-4c91-4dd6-8bf6-3380ba32b225 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:17.505330 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c5e0ef00-4c91-4dd6-8bf6-3380ba32b225 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:17.506298 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c5e0ef00-4c91-4dd6-8bf6-3380ba32b225 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:17.506511 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-aa15455d-a7da-4b2d-8722-26188474c693 tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:17.507039 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-aa15455d-a7da-4b2d-8722-26188474c693 tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:17.507410 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c5e0ef00-4c91-4dd6-8bf6-3380ba32b225 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:17.507537 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-aa15455d-a7da-4b2d-8722-26188474c693 tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:17.508149 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-aa15455d-a7da-4b2d-8722-26188474c693 tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:17.508355 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c5e0ef00-4c91-4dd6-8bf6-3380ba32b225 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:17.508609 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-aa15455d-a7da-4b2d-8722-26188474c693 tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:17.509035 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-aa15455d-a7da-4b2d-8722-26188474c693 tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:17.543047 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-aa15455d-a7da-4b2d-8722-26188474c693 tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] [instance: 5ac07e56-084c-4208-a988-13ec91af9171] Going to try to terminate instance {{(pid=128802) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:39:17.673554 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-aa15455d-a7da-4b2d-8722-26188474c693 tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] 10.222.0.33 "DELETE /compute/v2.1/servers/5ac07e56-084c-4208-a988-13ec91af9171" status: 204 len: 0 microversion: 2.1 time: 0.189173 Oct 04 20:39:17.675932 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 760/1460] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 20:39:17 2022] DELETE /compute/v2.1/servers/5ac07e56-084c-4208-a988-13ec91af9171 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:39:17.685789 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-515bb843-e359-48d3-bff4-ff4baddc5985 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:17.686845 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-515bb843-e359-48d3-bff4-ff4baddc5985 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] [instance: a2fc592c-9dac-4f72-8633-229925d3bf76] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:17.695723 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-515bb843-e359-48d3-bff4-ff4baddc5985 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:17.696191 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-515bb843-e359-48d3-bff4-ff4baddc5985 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:17.696626 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-515bb843-e359-48d3-bff4-ff4baddc5985 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:17.697439 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-515bb843-e359-48d3-bff4-ff4baddc5985 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:17.697895 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-515bb843-e359-48d3-bff4-ff4baddc5985 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:17.698323 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-515bb843-e359-48d3-bff4-ff4baddc5985 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:17.995464 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c5e0ef00-4c91-4dd6-8bf6-3380ba32b225 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bdfa818206f4f4b88cc962c1c34adf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4151c9ef7ae04a728306297f58ba5088', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:18.005564 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c5e0ef00-4c91-4dd6-8bf6-3380ba32b225 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] 10.222.0.33 "GET /compute/v2.1/servers/0dd1d0cf-a3a0-4ea2-8260-ac206bbfac88" status: 200 len: 1275 microversion: 2.1 time: 0.531536 Oct 04 20:39:18.006161 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 701/1461] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:17 2022] GET /compute/v2.1/servers/0dd1d0cf-a3a0-4ea2-8260-ac206bbfac88 => generated 1275 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:18.071727 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-b365fe74-f9ea-4ee2-b435-abecba8b458a req-e95b95ee-512f-4aa1-8bdc-c433db14868a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2fc592c-9dac-4f72-8633-229925d3bf76", "tag": "1a24093e-a143-47cb-9d69-c8078dca39c0"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:39:18.082155 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-b365fe74-f9ea-4ee2-b435-abecba8b458a req-e95b95ee-512f-4aa1-8bdc-c433db14868a service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:18.082696 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-b365fe74-f9ea-4ee2-b435-abecba8b458a req-e95b95ee-512f-4aa1-8bdc-c433db14868a service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:18.083126 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-b365fe74-f9ea-4ee2-b435-abecba8b458a req-e95b95ee-512f-4aa1-8bdc-c433db14868a service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:18.088474 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=100 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:39:18.097549 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-b365fe74-f9ea-4ee2-b435-abecba8b458a req-e95b95ee-512f-4aa1-8bdc-c433db14868a service nova] Creating event network-changed:1a24093e-a143-47cb-9d69-c8078dca39c0 for instance a2fc592c-9dac-4f72-8633-229925d3bf76 on n-h1-854823-8 Oct 04 20:39:18.103386 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-b365fe74-f9ea-4ee2-b435-abecba8b458a req-e95b95ee-512f-4aa1-8bdc-c433db14868a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095750 Oct 04 20:39:18.107230 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 702/1462] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:39:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:39:18.113063 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-91b2b098-460e-453d-9f2a-9142559dc670 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:18.118278 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-91b2b098-460e-453d-9f2a-9142559dc670 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e36f4114dc4f443f8b48da7b4027e0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a23a85365414f92bbc03177d7f190e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:18.119180 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-91b2b098-460e-453d-9f2a-9142559dc670 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Searching by: {'reservation_id': 'r-7yfx1si4', 'deleted': False, 'project_id': '1a23a85365414f92bbc03177d7f190e6'} {{(pid=128801) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 20:39:18.125328 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-91b2b098-460e-453d-9f2a-9142559dc670 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:18.125803 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-91b2b098-460e-453d-9f2a-9142559dc670 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:18.126232 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-91b2b098-460e-453d-9f2a-9142559dc670 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:18.127012 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-91b2b098-460e-453d-9f2a-9142559dc670 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:18.129194 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-91b2b098-460e-453d-9f2a-9142559dc670 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:18.129194 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-91b2b098-460e-453d-9f2a-9142559dc670 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:18.228656 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.multi_cell_list [None req-91b2b098-460e-453d-9f2a-9142559dc670 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=128801) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 20:39:18.296974 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-91b2b098-460e-453d-9f2a-9142559dc670 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36f4114dc4f443f8b48da7b4027e0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a23a85365414f92bbc03177d7f190e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:18.299216 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-515bb843-e359-48d3-bff4-ff4baddc5985 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96919ec99c14864876d64a9c2b20f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b44ce10b78bf49c882c9b4df06187114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:18.304543 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-91b2b098-460e-453d-9f2a-9142559dc670 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:18.305023 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-91b2b098-460e-453d-9f2a-9142559dc670 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:18.305451 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-91b2b098-460e-453d-9f2a-9142559dc670 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:18.309101 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-515bb843-e359-48d3-bff4-ff4baddc5985 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] 10.222.0.33 "GET /compute/v2.1/servers/a2fc592c-9dac-4f72-8633-229925d3bf76" status: 200 len: 1313 microversion: 2.1 time: 0.630774 Oct 04 20:39:18.310149 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 761/1463] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:17 2022] GET /compute/v2.1/servers/a2fc592c-9dac-4f72-8633-229925d3bf76 => generated 1313 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:18.314817 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-a4431539-613e-407f-9cdf-ac75fc1e8f5f tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:18.316248 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-a4431539-613e-407f-9cdf-ac75fc1e8f5f tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] [instance: d2173117-c1c5-4c2d-9658-914e67649cdd] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:18.323085 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a4431539-613e-407f-9cdf-ac75fc1e8f5f tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:18.323565 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a4431539-613e-407f-9cdf-ac75fc1e8f5f tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:18.323991 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a4431539-613e-407f-9cdf-ac75fc1e8f5f tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:18.324688 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a4431539-613e-407f-9cdf-ac75fc1e8f5f tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:18.325298 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a4431539-613e-407f-9cdf-ac75fc1e8f5f tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:18.325888 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a4431539-613e-407f-9cdf-ac75fc1e8f5f tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:18.794324 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-91b2b098-460e-453d-9f2a-9142559dc670 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] 10.222.0.33 "GET /compute/v2.1/servers/detail?reservation_id=r-7yfx1si4" status: 200 len: 2929 microversion: 2.1 time: 0.685746 Oct 04 20:39:18.798904 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 703/1464] 10.222.0.33 () {58 vars in 1197 bytes} [Tue Oct 4 20:39:18 2022] GET /compute/v2.1/servers/detail?reservation_id=r-7yfx1si4 => generated 2929 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:18.808083 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-87d70109-7b34-4f29-b5ec-8924b26fd7bf tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:18.812490 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-87d70109-7b34-4f29-b5ec-8924b26fd7bf tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] [instance: 5ac07e56-084c-4208-a988-13ec91af9171] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:18.819041 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-87d70109-7b34-4f29-b5ec-8924b26fd7bf tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:18.820641 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-87d70109-7b34-4f29-b5ec-8924b26fd7bf tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:18.821097 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-87d70109-7b34-4f29-b5ec-8924b26fd7bf tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:18.821832 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-87d70109-7b34-4f29-b5ec-8924b26fd7bf tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:18.822315 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-87d70109-7b34-4f29-b5ec-8924b26fd7bf tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:18.822779 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-87d70109-7b34-4f29-b5ec-8924b26fd7bf tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:18.854171 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-a4431539-613e-407f-9cdf-ac75fc1e8f5f tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a82c49a62249029ebc6ae3b4829709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecf3793be3eb4f3186c07a7e45fd8f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:18.861778 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-a4431539-613e-407f-9cdf-ac75fc1e8f5f tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] 10.222.0.33 "GET /compute/v2.1/servers/d2173117-c1c5-4c2d-9658-914e67649cdd" status: 200 len: 1522 microversion: 2.1 time: 0.550448 Oct 04 20:39:18.862990 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 762/1465] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:18 2022] GET /compute/v2.1/servers/d2173117-c1c5-4c2d-9658-914e67649cdd => generated 1522 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:18.867271 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-9445c313-a04a-4a45-8744-15648a2e5b86 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:18.867868 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-9445c313-a04a-4a45-8744-15648a2e5b86 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] [instance: 23da26ba-68f4-4aef-b13c-0b6588a65e43] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:18.873516 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9445c313-a04a-4a45-8744-15648a2e5b86 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:18.874780 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9445c313-a04a-4a45-8744-15648a2e5b86 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:18.875215 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9445c313-a04a-4a45-8744-15648a2e5b86 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:18.875899 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9445c313-a04a-4a45-8744-15648a2e5b86 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:18.876536 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9445c313-a04a-4a45-8744-15648a2e5b86 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:18.876953 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9445c313-a04a-4a45-8744-15648a2e5b86 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:19.333751 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-87d70109-7b34-4f29-b5ec-8924b26fd7bf tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11149c46e1bc468f836fe70635dbf33b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e0d8329b2c4d64bf51d88948ca0de2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:19.344601 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-87d70109-7b34-4f29-b5ec-8924b26fd7bf tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] 10.222.0.33 "GET /compute/v2.1/servers/5ac07e56-084c-4208-a988-13ec91af9171" status: 200 len: 1609 microversion: 2.1 time: 0.544089 Oct 04 20:39:19.353530 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-9445c313-a04a-4a45-8744-15648a2e5b86 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3563efe2b8c94931a2a46c4e14811b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3118a5d96843d3bede1ed94bd9717e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:19.361161 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 704/1466] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:18 2022] GET /compute/v2.1/servers/5ac07e56-084c-4208-a988-13ec91af9171 => generated 1609 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:19.364755 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-9445c313-a04a-4a45-8744-15648a2e5b86 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] 10.222.0.33 "GET /compute/v2.1/servers/23da26ba-68f4-4aef-b13c-0b6588a65e43" status: 200 len: 1476 microversion: 2.1 time: 0.500751 Oct 04 20:39:19.365523 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 763/1467] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:18 2022] GET /compute/v2.1/servers/23da26ba-68f4-4aef-b13c-0b6588a65e43 => generated 1476 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:19.374701 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2089c209-11bf-428d-ad47-743834708e03 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:19.374701 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-2089c209-11bf-428d-ad47-743834708e03 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] [instance: 83df4756-40e2-4fc6-be48-48a82dd4572a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:19.382563 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2089c209-11bf-428d-ad47-743834708e03 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:19.383269 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2089c209-11bf-428d-ad47-743834708e03 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:19.383766 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2089c209-11bf-428d-ad47-743834708e03 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:19.384882 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2089c209-11bf-428d-ad47-743834708e03 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:19.385358 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2089c209-11bf-428d-ad47-743834708e03 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:19.385693 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-af487052-f2c8-48df-9513-34e5b55356b2 req-f46ca2c4-0f56-4186-9bf5-612adeb1ae5d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23da26ba-68f4-4aef-b13c-0b6588a65e43", "tag": "f692dbdb-9498-4986-a253-420f090b704f"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:39:19.385823 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2089c209-11bf-428d-ad47-743834708e03 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:19.396873 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-af487052-f2c8-48df-9513-34e5b55356b2 req-f46ca2c4-0f56-4186-9bf5-612adeb1ae5d service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:19.398296 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-af487052-f2c8-48df-9513-34e5b55356b2 req-f46ca2c4-0f56-4186-9bf5-612adeb1ae5d service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:19.398968 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-af487052-f2c8-48df-9513-34e5b55356b2 req-f46ca2c4-0f56-4186-9bf5-612adeb1ae5d service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:19.416426 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-af487052-f2c8-48df-9513-34e5b55356b2 req-f46ca2c4-0f56-4186-9bf5-612adeb1ae5d service nova] Creating event network-changed:f692dbdb-9498-4986-a253-420f090b704f for instance 23da26ba-68f4-4aef-b13c-0b6588a65e43 on n-h2-854823-8 Oct 04 20:39:19.422527 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [req-af487052-f2c8-48df-9513-34e5b55356b2 req-f46ca2c4-0f56-4186-9bf5-612adeb1ae5d service nova] Instance 23da26ba-68f4-4aef-b13c-0b6588a65e43 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854823-8', 'n-h2-854823-8'} {{(pid=128802) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 20:39:19.434107 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-af487052-f2c8-48df-9513-34e5b55356b2 req-f46ca2c4-0f56-4186-9bf5-612adeb1ae5d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057486 Oct 04 20:39:19.434744 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 764/1468] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:39:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:39:19.439712 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-73c5f78a-9014-4868-9ca4-7a81e237bc1d tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:19.476518 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.compute.server_groups [None req-73c5f78a-9014-4868-9ca4-7a81e237bc1d tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Querying cell 189ff13b-7538-4a71-a71c-1e7f1d3e1b46(cell1) for 2 instances {{(pid=128802) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 04 20:39:19.478165 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-73c5f78a-9014-4868-9ca4-7a81e237bc1d tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:19.478861 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-73c5f78a-9014-4868-9ca4-7a81e237bc1d tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:19.479319 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-73c5f78a-9014-4868-9ca4-7a81e237bc1d tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:19.514292 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-73c5f78a-9014-4868-9ca4-7a81e237bc1d tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] 10.222.0.33 "GET /compute/v2.1/os-server-groups/a27428b4-242f-42e1-b297-1a93e60f513e" status: 200 len: 271 microversion: 2.1 time: 0.078285 Oct 04 20:39:19.515071 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 765/1469] 10.222.0.33 () {58 vars in 1263 bytes} [Tue Oct 4 20:39:19 2022] GET /compute/v2.1/os-server-groups/a27428b4-242f-42e1-b297-1a93e60f513e => generated 271 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:39:19.520845 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-5a0a2fac-e57d-4c3b-85c4-af959e3bc23c tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1418447015", "metadata": {"": ""}}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:39:19.524330 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-5a0a2fac-e57d-4c3b-85c4-af959e3bc23c tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Request method failure captured: Oct 04 20:39:19.524330 n-d-854823-8 devstack@n-api.service[128802]: request: POST /compute/v2.1/servers/d2173117-c1c5-4c2d-9658-914e67649cdd/action HTTP/1.1 Oct 04 20:39:19.524330 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 20:39:19.524330 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 20:39:19.524330 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 20:39:19.524330 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 107 Oct 04 20:39:19.524330 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 20:39:19.524330 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 20:39:19.524330 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 20:39:19.524330 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 20:39:19.524330 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPJndB3mJHN0LJ8w6Kheb2n0CJ86k8j-AXdWa3AMW_tNY1_9QQNH8dAe8aGzPWpNIRLrfkOudQ5X3ptj4NBqufJdfAt-Rzg0K2bAeHF3DIzHVwi3Ysg8-zRwFjrbgaapzSsHDGJy5Rd6NQfSoCIrbX0y1TKi0r3vLuM4ZTrt6iTVd_LI Oct 04 20:39:19.524330 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 20:39:19.524330 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 20:39:19.524330 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 20:39:19.524330 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 20:39:19.524330 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 20:39:19.524330 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 20:39:19.524330 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: ecf3793be3eb4f3186c07a7e45fd8f06 Oct 04 20:39:19.524330 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-957462329 Oct 04 20:39:19.524330 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 20:39:19.524330 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 20:39:19.524330 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ecf3793be3eb4f3186c07a7e45fd8f06", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ecf3793be3eb4f3186c07a7e45fd8f06"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ecf3793be3eb4f3186c07a7e45fd8f06"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ecf3793be3eb4f3186c07a7e45fd8f06"}]}] Oct 04 20:39:19.524330 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-957462329 Oct 04 20:39:19.524330 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: ecf3793be3eb4f3186c07a7e45fd8f06 Oct 04 20:39:19.524330 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-957462329 Oct 04 20:39:19.524330 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-ImagesOneServerNegativeTestJSON-957462329-project Oct 04 20:39:19.524330 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 20:39:19.524330 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 20:39:19.524330 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: 89a82c49a62249029ebc6ae3b4829709 Oct 04 20:39:19.524330 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-957462329-project Oct 04 20:39:19.524330 n-d-854823-8 devstack@n-api.service[128802]: Oct 04 20:39:19.524330 n-d-854823-8 devstack@n-api.service[128802]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1418447015", "metadata": {"": ""}}} Oct 04 20:39:19.524330 n-d-854823-8 devstack@n-api.service[128802]: method: > Oct 04 20:39:19.524330 n-d-854823-8 devstack@n-api.service[128802]: exception: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 20:39:19.524330 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'id': 'd2173117-c1c5-4c2d-9658-914e67649cdd', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1418447015', 'metadata': {'': ''}}}} Oct 04 20:39:19.524330 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:39:19.524330 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:39:19.524330 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 20:39:19.524330 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 20:39:19.524330 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 20:39:19.524330 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise error Oct 04 20:39:19.524330 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 20:39:19.524330 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:39:19.524330 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Oct 04 20:39:19.524330 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 04 20:39:19.524330 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 04 20:39:19.524330 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 04 20:39:19.524330 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 04 20:39:19.524330 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:39:19.524330 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi On instance['createImage']: Oct 04 20:39:19.524330 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi {'': ''} Oct 04 20:39:19.524330 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:39:19.524330 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:39:19.524330 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:39:19.524330 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:39:19.524330 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:39:19.524330 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:39:19.524330 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:39:19.524330 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:39:19.524330 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:39:19.524330 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:39:19.524330 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:39:19.524330 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:39:19.524330 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 20:39:19.529639 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 20:39:19.529639 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 20:39:19.529639 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 20:39:19.529639 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 20:39:19.529639 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 20:39:19.529639 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 20:39:19.529639 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:39:19.529639 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:39:19.529639 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:39:19.529639 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:39:19.529639 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:39:19.529639 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:39:19.529639 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 20:39:19.529639 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 20:39:19.529639 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 20:39:19.529639 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:39:19.529639 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-5a0a2fac-e57d-4c3b-85c4-af959e3bc23c tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:39:19.529639 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-5a0a2fac-e57d-4c3b-85c4-af959e3bc23c tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] 10.222.0.33 "POST /compute/v2.1/servers/d2173117-c1c5-4c2d-9658-914e67649cdd/action" status: 400 len: 170 microversion: 2.1 time: 0.009843 Oct 04 20:39:19.529639 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 766/1470] 10.222.0.33 () {60 vars in 1279 bytes} [Tue Oct 4 20:39:19 2022] POST /compute/v2.1/servers/d2173117-c1c5-4c2d-9658-914e67649cdd/action => generated 170 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 20:39:19.533908 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-bfe446e3-bb76-47eb-94f6-c86251891576 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:19.534779 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-bfe446e3-bb76-47eb-94f6-c86251891576 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] [instance: 0dd1d0cf-a3a0-4ea2-8260-ac206bbfac88] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:19.543257 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bfe446e3-bb76-47eb-94f6-c86251891576 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:19.543746 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bfe446e3-bb76-47eb-94f6-c86251891576 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:19.544168 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bfe446e3-bb76-47eb-94f6-c86251891576 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:19.544865 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bfe446e3-bb76-47eb-94f6-c86251891576 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:19.545454 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bfe446e3-bb76-47eb-94f6-c86251891576 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:19.545882 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bfe446e3-bb76-47eb-94f6-c86251891576 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:19.757306 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-2089c209-11bf-428d-ad47-743834708e03 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '800db3a57ada47eca381b00189fdbf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66ec8ea91b04deb90b679589e0495bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:19.764198 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-2089c209-11bf-428d-ad47-743834708e03 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] 10.222.0.33 "GET /compute/v2.1/servers/83df4756-40e2-4fc6-be48-48a82dd4572a" status: 200 len: 1361 microversion: 2.1 time: 0.401108 Oct 04 20:39:19.774372 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 705/1471] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:19 2022] GET /compute/v2.1/servers/83df4756-40e2-4fc6-be48-48a82dd4572a => generated 1361 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:19.774372 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-70506a8f-088e-4f84-a282-3d8a851fc3e0 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:19.774372 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-70506a8f-088e-4f84-a282-3d8a851fc3e0 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] [instance: a2fc592c-9dac-4f72-8633-229925d3bf76] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:19.775917 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-70506a8f-088e-4f84-a282-3d8a851fc3e0 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:19.776403 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-70506a8f-088e-4f84-a282-3d8a851fc3e0 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:19.776838 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-70506a8f-088e-4f84-a282-3d8a851fc3e0 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:19.777928 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-70506a8f-088e-4f84-a282-3d8a851fc3e0 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:19.778054 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-70506a8f-088e-4f84-a282-3d8a851fc3e0 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:19.778468 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-70506a8f-088e-4f84-a282-3d8a851fc3e0 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:19.871812 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-bfe446e3-bb76-47eb-94f6-c86251891576 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bdfa818206f4f4b88cc962c1c34adf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4151c9ef7ae04a728306297f58ba5088', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:19.879605 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-bfe446e3-bb76-47eb-94f6-c86251891576 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] 10.222.0.33 "GET /compute/v2.1/servers/0dd1d0cf-a3a0-4ea2-8260-ac206bbfac88" status: 200 len: 1317 microversion: 2.1 time: 0.352248 Oct 04 20:39:19.880172 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 767/1472] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:19 2022] GET /compute/v2.1/servers/0dd1d0cf-a3a0-4ea2-8260-ac206bbfac88 => generated 1317 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:19.884671 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-bfd3c877-1517-4a09-8561-3b1279db2d80 tempest-ServersOnMultiNodesTest-176762512 tempest-ServersOnMultiNodesTest-176762512-project-admin] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:19.885269 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-bfd3c877-1517-4a09-8561-3b1279db2d80 tempest-ServersOnMultiNodesTest-176762512 tempest-ServersOnMultiNodesTest-176762512-project-admin] [instance: 55d73a76-3d5e-426c-8a99-9cae92f8498b] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:19.894069 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bfd3c877-1517-4a09-8561-3b1279db2d80 tempest-ServersOnMultiNodesTest-176762512 tempest-ServersOnMultiNodesTest-176762512-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:19.894590 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bfd3c877-1517-4a09-8561-3b1279db2d80 tempest-ServersOnMultiNodesTest-176762512 tempest-ServersOnMultiNodesTest-176762512-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:19.895029 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bfd3c877-1517-4a09-8561-3b1279db2d80 tempest-ServersOnMultiNodesTest-176762512 tempest-ServersOnMultiNodesTest-176762512-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:19.895735 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bfd3c877-1517-4a09-8561-3b1279db2d80 tempest-ServersOnMultiNodesTest-176762512 tempest-ServersOnMultiNodesTest-176762512-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:19.896189 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bfd3c877-1517-4a09-8561-3b1279db2d80 tempest-ServersOnMultiNodesTest-176762512 tempest-ServersOnMultiNodesTest-176762512-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:19.896669 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bfd3c877-1517-4a09-8561-3b1279db2d80 tempest-ServersOnMultiNodesTest-176762512 tempest-ServersOnMultiNodesTest-176762512-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:20.082014 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-70506a8f-088e-4f84-a282-3d8a851fc3e0 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96919ec99c14864876d64a9c2b20f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b44ce10b78bf49c882c9b4df06187114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:20.089939 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-70506a8f-088e-4f84-a282-3d8a851fc3e0 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] 10.222.0.33 "GET /compute/v2.1/servers/a2fc592c-9dac-4f72-8633-229925d3bf76" status: 200 len: 1313 microversion: 2.1 time: 0.324054 Oct 04 20:39:20.095281 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 706/1473] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:19 2022] GET /compute/v2.1/servers/a2fc592c-9dac-4f72-8633-229925d3bf76 => generated 1313 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:20.095281 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-4eb196b8-7395-4b25-81eb-ef886f09b73f tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:20.095595 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-4eb196b8-7395-4b25-81eb-ef886f09b73f tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] [instance: d2173117-c1c5-4c2d-9658-914e67649cdd] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:20.103456 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4eb196b8-7395-4b25-81eb-ef886f09b73f tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:20.104129 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4eb196b8-7395-4b25-81eb-ef886f09b73f tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:20.104741 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4eb196b8-7395-4b25-81eb-ef886f09b73f tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:20.105615 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4eb196b8-7395-4b25-81eb-ef886f09b73f tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:20.106071 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4eb196b8-7395-4b25-81eb-ef886f09b73f tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:20.106522 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4eb196b8-7395-4b25-81eb-ef886f09b73f tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:20.146671 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-bfd3c877-1517-4a09-8561-3b1279db2d80 tempest-ServersOnMultiNodesTest-176762512 tempest-ServersOnMultiNodesTest-176762512-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/55d73a76-3d5e-426c-8a99-9cae92f8498b" status: 200 len: 1619 microversion: 2.1 time: 0.264738 Oct 04 20:39:20.147651 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 768/1474] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:19 2022] GET /compute/v2.1/servers/55d73a76-3d5e-426c-8a99-9cae92f8498b => generated 1619 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:20.169590 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-fa02515c-d962-41b8-8ac4-5534319251dc tempest-ServersOnMultiNodesTest-176762512 tempest-ServersOnMultiNodesTest-176762512-project-admin] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:20.170195 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-fa02515c-d962-41b8-8ac4-5534319251dc tempest-ServersOnMultiNodesTest-176762512 tempest-ServersOnMultiNodesTest-176762512-project-admin] [instance: a1e8b81b-5e26-4d5c-87ca-057eea43abba] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:20.176196 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fa02515c-d962-41b8-8ac4-5534319251dc tempest-ServersOnMultiNodesTest-176762512 tempest-ServersOnMultiNodesTest-176762512-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:20.176671 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fa02515c-d962-41b8-8ac4-5534319251dc tempest-ServersOnMultiNodesTest-176762512 tempest-ServersOnMultiNodesTest-176762512-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:20.177097 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fa02515c-d962-41b8-8ac4-5534319251dc tempest-ServersOnMultiNodesTest-176762512 tempest-ServersOnMultiNodesTest-176762512-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:20.177787 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fa02515c-d962-41b8-8ac4-5534319251dc tempest-ServersOnMultiNodesTest-176762512 tempest-ServersOnMultiNodesTest-176762512-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:20.178236 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fa02515c-d962-41b8-8ac4-5534319251dc tempest-ServersOnMultiNodesTest-176762512 tempest-ServersOnMultiNodesTest-176762512-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:20.178684 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fa02515c-d962-41b8-8ac4-5534319251dc tempest-ServersOnMultiNodesTest-176762512 tempest-ServersOnMultiNodesTest-176762512-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:20.374481 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-4eb196b8-7395-4b25-81eb-ef886f09b73f tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a82c49a62249029ebc6ae3b4829709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecf3793be3eb4f3186c07a7e45fd8f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:20.385438 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-4eb196b8-7395-4b25-81eb-ef886f09b73f tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] 10.222.0.33 "GET /compute/v2.1/servers/d2173117-c1c5-4c2d-9658-914e67649cdd" status: 200 len: 1522 microversion: 2.1 time: 0.293792 Oct 04 20:39:20.386051 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 707/1475] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:20 2022] GET /compute/v2.1/servers/d2173117-c1c5-4c2d-9658-914e67649cdd => generated 1522 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:20.390651 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-fb2bf082-1576-4aa0-8922-42d86538ff9b tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:20.391329 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-fb2bf082-1576-4aa0-8922-42d86538ff9b tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] [instance: 5ac07e56-084c-4208-a988-13ec91af9171] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:20.398387 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fb2bf082-1576-4aa0-8922-42d86538ff9b tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:20.399075 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fb2bf082-1576-4aa0-8922-42d86538ff9b tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:20.399773 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fb2bf082-1576-4aa0-8922-42d86538ff9b tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:20.400807 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fb2bf082-1576-4aa0-8922-42d86538ff9b tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:20.401269 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fb2bf082-1576-4aa0-8922-42d86538ff9b tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:20.401699 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fb2bf082-1576-4aa0-8922-42d86538ff9b tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:20.431451 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-fa02515c-d962-41b8-8ac4-5534319251dc tempest-ServersOnMultiNodesTest-176762512 tempest-ServersOnMultiNodesTest-176762512-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/a1e8b81b-5e26-4d5c-87ca-057eea43abba" status: 200 len: 1619 microversion: 2.1 time: 0.265455 Oct 04 20:39:20.432253 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 769/1476] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:20 2022] GET /compute/v2.1/servers/a1e8b81b-5e26-4d5c-87ca-057eea43abba => generated 1619 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:39:20.441838 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-ce5a8f63-700a-47f0-9982-ac96984f5344 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:20.442556 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-ce5a8f63-700a-47f0-9982-ac96984f5344 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] [instance: 23da26ba-68f4-4aef-b13c-0b6588a65e43] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:20.449235 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ce5a8f63-700a-47f0-9982-ac96984f5344 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:20.449235 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ce5a8f63-700a-47f0-9982-ac96984f5344 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:20.449652 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ce5a8f63-700a-47f0-9982-ac96984f5344 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:20.450575 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ce5a8f63-700a-47f0-9982-ac96984f5344 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:20.451291 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ce5a8f63-700a-47f0-9982-ac96984f5344 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:20.451868 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ce5a8f63-700a-47f0-9982-ac96984f5344 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:20.886031 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-fb2bf082-1576-4aa0-8922-42d86538ff9b tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11149c46e1bc468f836fe70635dbf33b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e0d8329b2c4d64bf51d88948ca0de2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:20.895555 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-fb2bf082-1576-4aa0-8922-42d86538ff9b tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] 10.222.0.33 "GET /compute/v2.1/servers/5ac07e56-084c-4208-a988-13ec91af9171" status: 200 len: 1609 microversion: 2.1 time: 0.508281 Oct 04 20:39:20.896160 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 708/1477] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:20 2022] GET /compute/v2.1/servers/5ac07e56-084c-4208-a988-13ec91af9171 => generated 1609 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:20.901717 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7c777ebd-02cd-474e-9f86-f4a64f8dc1db tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:20.905996 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-ce5a8f63-700a-47f0-9982-ac96984f5344 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3563efe2b8c94931a2a46c4e14811b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3118a5d96843d3bede1ed94bd9717e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:20.914251 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-7c777ebd-02cd-474e-9f86-f4a64f8dc1db tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] [instance: d2173117-c1c5-4c2d-9658-914e67649cdd] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:20.918752 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-ce5a8f63-700a-47f0-9982-ac96984f5344 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] 10.222.0.33 "GET /compute/v2.1/servers/23da26ba-68f4-4aef-b13c-0b6588a65e43" status: 200 len: 1474 microversion: 2.1 time: 0.481415 Oct 04 20:39:20.919580 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 770/1478] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:20 2022] GET /compute/v2.1/servers/23da26ba-68f4-4aef-b13c-0b6588a65e43 => generated 1474 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:20.926597 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7c777ebd-02cd-474e-9f86-f4a64f8dc1db tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:20.929686 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7c777ebd-02cd-474e-9f86-f4a64f8dc1db tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:20.930535 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7c777ebd-02cd-474e-9f86-f4a64f8dc1db tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:20.931575 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7c777ebd-02cd-474e-9f86-f4a64f8dc1db tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:20.932211 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7c777ebd-02cd-474e-9f86-f4a64f8dc1db tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:20.932815 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7c777ebd-02cd-474e-9f86-f4a64f8dc1db tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:20.938225 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-d67ef922-592b-42a1-889c-412f268112fd tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1062601984", "imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": "42726a57-cdc8-45e3-8d61-348f02bfcd53"}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:39:20.996001 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.network.neutron [None req-d67ef922-592b-42a1-889c-412f268112fd tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] validate_networks() for None {{(pid=128802) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:39:21.941748 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-7c777ebd-02cd-474e-9f86-f4a64f8dc1db tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a82c49a62249029ebc6ae3b4829709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecf3793be3eb4f3186c07a7e45fd8f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:21.961434 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-7c777ebd-02cd-474e-9f86-f4a64f8dc1db tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] 10.222.0.33 "GET /compute/v2.1/servers/d2173117-c1c5-4c2d-9658-914e67649cdd" status: 200 len: 1522 microversion: 2.1 time: 1.063601 Oct 04 20:39:21.963553 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 709/1479] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:20 2022] GET /compute/v2.1/servers/d2173117-c1c5-4c2d-9658-914e67649cdd => generated 1522 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:21.975528 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c0fb0f2c-4345-4d6b-909b-a701d94b3f76 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:21.977100 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c0fb0f2c-4345-4d6b-909b-a701d94b3f76 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] [instance: 83df4756-40e2-4fc6-be48-48a82dd4572a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:21.989346 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c0fb0f2c-4345-4d6b-909b-a701d94b3f76 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:21.991152 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c0fb0f2c-4345-4d6b-909b-a701d94b3f76 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:21.992153 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c0fb0f2c-4345-4d6b-909b-a701d94b3f76 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:21.993669 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c0fb0f2c-4345-4d6b-909b-a701d94b3f76 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:21.994783 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c0fb0f2c-4345-4d6b-909b-a701d94b3f76 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:21.995786 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c0fb0f2c-4345-4d6b-909b-a701d94b3f76 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:22.206849 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-d67ef922-592b-42a1-889c-412f268112fd tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Flavor limits 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:39:22.208167 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-d67ef922-592b-42a1-889c-412f268112fd tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Image limits 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:39:22.210054 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-d67ef922-592b-42a1-889c-412f268112fd tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Flavor pref 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:39:22.210496 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-d67ef922-592b-42a1-889c-412f268112fd tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Image pref 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:39:22.210911 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-d67ef922-592b-42a1-889c-412f268112fd tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:39:22.220622 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d67ef922-592b-42a1-889c-412f268112fd tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:22.221814 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d67ef922-592b-42a1-889c-412f268112fd tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:22.222533 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d67ef922-592b-42a1-889c-412f268112fd tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:22.223532 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d67ef922-592b-42a1-889c-412f268112fd tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:22.223990 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d67ef922-592b-42a1-889c-412f268112fd tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:22.224420 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d67ef922-592b-42a1-889c-412f268112fd tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:22.243312 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-d67ef922-592b-42a1-889c-412f268112fd tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Getting quotas for project 1a23a85365414f92bbc03177d7f190e6. Resources: {'ram', 'instances', 'cores'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:39:22.247473 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-d67ef922-592b-42a1-889c-412f268112fd tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Getting quotas for user e36f4114dc4f443f8b48da7b4027e0c1 and project 1a23a85365414f92bbc03177d7f190e6. Resources: {'ram', 'instances', 'cores'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:39:22.260775 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-d67ef922-592b-42a1-889c-412f268112fd tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Going to run 1 instances... {{(pid=128802) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:39:22.263369 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-d67ef922-592b-42a1-889c-412f268112fd tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] [instance: d9c5805f-6cd2-4993-86b2-8a7546b62dd6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='15b24725-0c99-4bcf-b1fb-907cdf8e2d63',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128802) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:39:22.317000 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-d67ef922-592b-42a1-889c-412f268112fd tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.396018 Oct 04 20:39:22.324336 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 771/1480] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 20:39:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 1398 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 20:39:22.324336 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-8a50d27d-abb0-4342-99fc-1c8986936851 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:22.324618 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-8a50d27d-abb0-4342-99fc-1c8986936851 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] [instance: 0dd1d0cf-a3a0-4ea2-8260-ac206bbfac88] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:22.333444 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8a50d27d-abb0-4342-99fc-1c8986936851 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:22.333947 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8a50d27d-abb0-4342-99fc-1c8986936851 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:22.334405 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8a50d27d-abb0-4342-99fc-1c8986936851 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:22.335417 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8a50d27d-abb0-4342-99fc-1c8986936851 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:22.335567 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8a50d27d-abb0-4342-99fc-1c8986936851 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:22.335956 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8a50d27d-abb0-4342-99fc-1c8986936851 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:22.420000 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c0fb0f2c-4345-4d6b-909b-a701d94b3f76 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '800db3a57ada47eca381b00189fdbf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66ec8ea91b04deb90b679589e0495bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:22.433492 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c0fb0f2c-4345-4d6b-909b-a701d94b3f76 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] 10.222.0.33 "GET /compute/v2.1/servers/83df4756-40e2-4fc6-be48-48a82dd4572a" status: 200 len: 1361 microversion: 2.1 time: 0.464928 Oct 04 20:39:22.436100 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 710/1481] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:21 2022] GET /compute/v2.1/servers/83df4756-40e2-4fc6-be48-48a82dd4572a => generated 1361 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:22.449020 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-90fa2a72-45b6-4653-bef9-f76860081012 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:22.450055 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-90fa2a72-45b6-4653-bef9-f76860081012 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] [instance: a2fc592c-9dac-4f72-8633-229925d3bf76] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:22.457347 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-90fa2a72-45b6-4653-bef9-f76860081012 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:22.457851 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-90fa2a72-45b6-4653-bef9-f76860081012 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:22.458293 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-90fa2a72-45b6-4653-bef9-f76860081012 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:22.459025 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-90fa2a72-45b6-4653-bef9-f76860081012 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:22.459673 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-90fa2a72-45b6-4653-bef9-f76860081012 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:22.460263 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-90fa2a72-45b6-4653-bef9-f76860081012 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:22.751045 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-8a50d27d-abb0-4342-99fc-1c8986936851 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bdfa818206f4f4b88cc962c1c34adf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4151c9ef7ae04a728306297f58ba5088', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:22.759593 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-8a50d27d-abb0-4342-99fc-1c8986936851 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] 10.222.0.33 "GET /compute/v2.1/servers/0dd1d0cf-a3a0-4ea2-8260-ac206bbfac88" status: 200 len: 1317 microversion: 2.1 time: 0.439920 Oct 04 20:39:22.774382 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 772/1482] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:22 2022] GET /compute/v2.1/servers/0dd1d0cf-a3a0-4ea2-8260-ac206bbfac88 => generated 1317 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:22.774382 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-74373667-4af4-4afe-a011-2ac1cbd0fc27 req-a962763b-5c64-42cc-8e72-e449381419c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "83df4756-40e2-4fc6-be48-48a82dd4572a", "tag": "df81fac5-fbf3-4eb9-bad4-4478b0098ba4"}, {"name": "network-changed", "server_uuid": "0dd1d0cf-a3a0-4ea2-8260-ac206bbfac88", "tag": "5ef34720-ea76-4ea1-90bb-a255bf7dfe8b"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:39:22.776491 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-74373667-4af4-4afe-a011-2ac1cbd0fc27 req-a962763b-5c64-42cc-8e72-e449381419c3 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:22.777340 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-74373667-4af4-4afe-a011-2ac1cbd0fc27 req-a962763b-5c64-42cc-8e72-e449381419c3 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:22.778049 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-74373667-4af4-4afe-a011-2ac1cbd0fc27 req-a962763b-5c64-42cc-8e72-e449381419c3 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:22.792728 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-74373667-4af4-4afe-a011-2ac1cbd0fc27 req-a962763b-5c64-42cc-8e72-e449381419c3 service nova] Creating event network-changed:df81fac5-fbf3-4eb9-bad4-4478b0098ba4 for instance 83df4756-40e2-4fc6-be48-48a82dd4572a on n-h1-854823-8 Oct 04 20:39:22.793296 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-74373667-4af4-4afe-a011-2ac1cbd0fc27 req-a962763b-5c64-42cc-8e72-e449381419c3 service nova] Creating event network-changed:5ef34720-ea76-4ea1-90bb-a255bf7dfe8b for instance 0dd1d0cf-a3a0-4ea2-8260-ac206bbfac88 on n-h1-854823-8 Oct 04 20:39:22.801826 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-74373667-4af4-4afe-a011-2ac1cbd0fc27 req-a962763b-5c64-42cc-8e72-e449381419c3 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.039927 Oct 04 20:39:22.802451 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 773/1483] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:39:22 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:39:22.808077 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-093cfb7d-ebbf-47dd-a48b-f5269f40447f tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:22.809196 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-093cfb7d-ebbf-47dd-a48b-f5269f40447f tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] [instance: 5ac07e56-084c-4208-a988-13ec91af9171] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:22.816277 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-093cfb7d-ebbf-47dd-a48b-f5269f40447f tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:22.816801 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-093cfb7d-ebbf-47dd-a48b-f5269f40447f tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:22.817259 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-093cfb7d-ebbf-47dd-a48b-f5269f40447f tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:22.818143 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-093cfb7d-ebbf-47dd-a48b-f5269f40447f tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:22.818780 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-093cfb7d-ebbf-47dd-a48b-f5269f40447f tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:22.819360 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-093cfb7d-ebbf-47dd-a48b-f5269f40447f tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:22.850378 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-90fa2a72-45b6-4653-bef9-f76860081012 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96919ec99c14864876d64a9c2b20f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b44ce10b78bf49c882c9b4df06187114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:22.857956 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-90fa2a72-45b6-4653-bef9-f76860081012 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] 10.222.0.33 "GET /compute/v2.1/servers/a2fc592c-9dac-4f72-8633-229925d3bf76" status: 200 len: 1313 microversion: 2.1 time: 0.419950 Oct 04 20:39:22.858555 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 711/1484] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:22 2022] GET /compute/v2.1/servers/a2fc592c-9dac-4f72-8633-229925d3bf76 => generated 1313 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:22.863746 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-da4cf7d1-6d9e-4879-9ca5-48bace5d3d06 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:22.864418 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-da4cf7d1-6d9e-4879-9ca5-48bace5d3d06 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] [instance: 23da26ba-68f4-4aef-b13c-0b6588a65e43] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:22.870333 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-da4cf7d1-6d9e-4879-9ca5-48bace5d3d06 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:22.870898 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-da4cf7d1-6d9e-4879-9ca5-48bace5d3d06 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:22.871580 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-da4cf7d1-6d9e-4879-9ca5-48bace5d3d06 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:22.872336 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-da4cf7d1-6d9e-4879-9ca5-48bace5d3d06 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:22.872855 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-da4cf7d1-6d9e-4879-9ca5-48bace5d3d06 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:22.873344 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-da4cf7d1-6d9e-4879-9ca5-48bace5d3d06 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:22.965175 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-093cfb7d-ebbf-47dd-a48b-f5269f40447f tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11149c46e1bc468f836fe70635dbf33b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e0d8329b2c4d64bf51d88948ca0de2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:22.976110 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-093cfb7d-ebbf-47dd-a48b-f5269f40447f tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] 10.222.0.33 "GET /compute/v2.1/servers/5ac07e56-084c-4208-a988-13ec91af9171" status: 200 len: 1541 microversion: 2.1 time: 0.172020 Oct 04 20:39:22.977258 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 774/1485] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:22 2022] GET /compute/v2.1/servers/5ac07e56-084c-4208-a988-13ec91af9171 => generated 1541 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:22.982967 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-79bf8e08-4ee0-408d-b511-c227681195c6 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-561426087", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:39:22.988340 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-79bf8e08-4ee0-408d-b511-c227681195c6 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Request method failure captured: Oct 04 20:39:22.988340 n-d-854823-8 devstack@n-api.service[128802]: request: POST /compute/v2.1/servers/d2173117-c1c5-4c2d-9658-914e67649cdd/action HTTP/1.1 Oct 04 20:39:22.988340 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 20:39:22.988340 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 20:39:22.988340 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 20:39:22.988340 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 618 Oct 04 20:39:22.988340 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 20:39:22.988340 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 20:39:22.988340 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 20:39:22.988340 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 20:39:22.988340 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPJndB3mJHN0LJ8w6Kheb2n0CJ86k8j-AXdWa3AMW_tNY1_9QQNH8dAe8aGzPWpNIRLrfkOudQ5X3ptj4NBqufJdfAt-Rzg0K2bAeHF3DIzHVwi3Ysg8-zRwFjrbgaapzSsHDGJy5Rd6NQfSoCIrbX0y1TKi0r3vLuM4ZTrt6iTVd_LI Oct 04 20:39:22.988340 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 20:39:22.988340 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 20:39:22.988340 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 20:39:22.988340 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 20:39:22.988340 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 20:39:22.988340 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 20:39:22.988340 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: ecf3793be3eb4f3186c07a7e45fd8f06 Oct 04 20:39:22.988340 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-957462329 Oct 04 20:39:22.988340 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 20:39:22.988340 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 20:39:22.988340 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ecf3793be3eb4f3186c07a7e45fd8f06", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ecf3793be3eb4f3186c07a7e45fd8f06"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ecf3793be3eb4f3186c07a7e45fd8f06"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ecf3793be3eb4f3186c07a7e45fd8f06"}]}] Oct 04 20:39:22.988340 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-957462329 Oct 04 20:39:22.988340 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: ecf3793be3eb4f3186c07a7e45fd8f06 Oct 04 20:39:22.988340 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-957462329 Oct 04 20:39:22.988340 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-ImagesOneServerNegativeTestJSON-957462329-project Oct 04 20:39:22.988340 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 20:39:22.988340 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 20:39:22.988340 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: 89a82c49a62249029ebc6ae3b4829709 Oct 04 20:39:22.988340 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-957462329-project Oct 04 20:39:22.988340 n-d-854823-8 devstack@n-api.service[128802]: Oct 04 20:39:22.988340 n-d-854823-8 devstack@n-api.service[128802]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-561426087", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} Oct 04 20:39:22.988340 n-d-854823-8 devstack@n-api.service[128802]: method: > Oct 04 20:39:22.988340 n-d-854823-8 devstack@n-api.service[128802]: exception: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 20:39:22.988340 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'id': 'd2173117-c1c5-4c2d-9658-914e67649cdd', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-561426087', 'metadata': {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}}}} Oct 04 20:39:22.988340 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:39:22.988340 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:39:22.988340 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 20:39:22.988340 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 20:39:22.988340 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 20:39:22.988340 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise error Oct 04 20:39:22.991411 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 20:39:22.991411 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:39:22.991411 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Oct 04 20:39:22.991411 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 04 20:39:22.991411 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 04 20:39:22.991411 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 04 20:39:22.991411 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 04 20:39:22.991411 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:39:22.991411 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi On instance['createImage']: Oct 04 20:39:22.991411 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'} Oct 04 20:39:22.991411 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:39:22.991411 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:39:22.991411 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:39:22.991411 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:39:22.991411 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:39:22.991411 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:39:22.991411 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:39:22.991411 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:39:22.991411 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:39:22.991411 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:39:22.991411 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:39:22.991411 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:39:22.991411 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 20:39:22.991411 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 20:39:22.991411 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 20:39:22.991411 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 20:39:22.991411 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 20:39:22.991411 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 20:39:22.991411 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 20:39:22.991411 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:39:22.991411 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:39:22.991411 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:39:22.991411 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:39:22.991411 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:39:22.991411 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:39:22.991411 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 20:39:22.991411 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 20:39:22.991411 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 20:39:22.991411 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:39:22.997033 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-79bf8e08-4ee0-408d-b511-c227681195c6 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:39:22.997033 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-79bf8e08-4ee0-408d-b511-c227681195c6 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] 10.222.0.33 "POST /compute/v2.1/servers/d2173117-c1c5-4c2d-9658-914e67649cdd/action" status: 400 len: 938 microversion: 2.1 time: 0.011469 Oct 04 20:39:22.997033 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 775/1486] 10.222.0.33 () {60 vars in 1279 bytes} [Tue Oct 4 20:39:22 2022] POST /compute/v2.1/servers/d2173117-c1c5-4c2d-9658-914e67649cdd/action => generated 938 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 20:39:22.997033 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-67ca9d34-a786-4cdf-a19e-cba44454ec1f tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:22.997033 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-67ca9d34-a786-4cdf-a19e-cba44454ec1f tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] [instance: d9c5805f-6cd2-4993-86b2-8a7546b62dd6] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:23.003431 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-67ca9d34-a786-4cdf-a19e-cba44454ec1f tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:23.003917 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-67ca9d34-a786-4cdf-a19e-cba44454ec1f tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:23.005142 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-67ca9d34-a786-4cdf-a19e-cba44454ec1f tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:23.005844 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-67ca9d34-a786-4cdf-a19e-cba44454ec1f tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:23.006664 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-67ca9d34-a786-4cdf-a19e-cba44454ec1f tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:23.007142 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-67ca9d34-a786-4cdf-a19e-cba44454ec1f tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:23.010002 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:39:23.125054 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-67ca9d34-a786-4cdf-a19e-cba44454ec1f tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36f4114dc4f443f8b48da7b4027e0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a23a85365414f92bbc03177d7f190e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:23.137119 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-67ca9d34-a786-4cdf-a19e-cba44454ec1f tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] 10.222.0.33 "GET /compute/v2.1/servers/d9c5805f-6cd2-4993-86b2-8a7546b62dd6" status: 200 len: 1213 microversion: 2.1 time: 0.144918 Oct 04 20:39:23.154997 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 776/1487] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:22 2022] GET /compute/v2.1/servers/d9c5805f-6cd2-4993-86b2-8a7546b62dd6 => generated 1213 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:23.161302 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-24ccacfd-95e8-400a-a9ba-9375422797fd tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:23.162227 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-24ccacfd-95e8-400a-a9ba-9375422797fd tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] [instance: d2173117-c1c5-4c2d-9658-914e67649cdd] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:23.171383 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-24ccacfd-95e8-400a-a9ba-9375422797fd tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:23.172082 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-24ccacfd-95e8-400a-a9ba-9375422797fd tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:23.172663 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-24ccacfd-95e8-400a-a9ba-9375422797fd tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:23.173696 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-24ccacfd-95e8-400a-a9ba-9375422797fd tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:23.174814 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-24ccacfd-95e8-400a-a9ba-9375422797fd tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:23.175512 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-24ccacfd-95e8-400a-a9ba-9375422797fd tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:23.284743 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-da4cf7d1-6d9e-4879-9ca5-48bace5d3d06 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3563efe2b8c94931a2a46c4e14811b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3118a5d96843d3bede1ed94bd9717e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:23.293244 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-da4cf7d1-6d9e-4879-9ca5-48bace5d3d06 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] 10.222.0.33 "GET /compute/v2.1/servers/23da26ba-68f4-4aef-b13c-0b6588a65e43" status: 200 len: 1471 microversion: 2.1 time: 0.433669 Oct 04 20:39:23.294734 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 712/1488] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:22 2022] GET /compute/v2.1/servers/23da26ba-68f4-4aef-b13c-0b6588a65e43 => generated 1471 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:23.318264 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8087448a-eafb-44bf-9fb8-a522fdf730a7 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:39:23.318829 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-8087448a-eafb-44bf-9fb8-a522fdf730a7 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] [instance: 23da26ba-68f4-4aef-b13c-0b6588a65e43] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:23.325080 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8087448a-eafb-44bf-9fb8-a522fdf730a7 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:23.325570 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8087448a-eafb-44bf-9fb8-a522fdf730a7 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:23.326001 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8087448a-eafb-44bf-9fb8-a522fdf730a7 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:23.326728 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8087448a-eafb-44bf-9fb8-a522fdf730a7 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:23.327178 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8087448a-eafb-44bf-9fb8-a522fdf730a7 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:23.327600 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8087448a-eafb-44bf-9fb8-a522fdf730a7 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:23.460422 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-24ccacfd-95e8-400a-a9ba-9375422797fd tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a82c49a62249029ebc6ae3b4829709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecf3793be3eb4f3186c07a7e45fd8f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:23.471075 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-24ccacfd-95e8-400a-a9ba-9375422797fd tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] 10.222.0.33 "GET /compute/v2.1/servers/d2173117-c1c5-4c2d-9658-914e67649cdd" status: 200 len: 1522 microversion: 2.1 time: 0.314997 Oct 04 20:39:23.472403 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 777/1489] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:23 2022] GET /compute/v2.1/servers/d2173117-c1c5-4c2d-9658-914e67649cdd => generated 1522 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:23.472799 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-8087448a-eafb-44bf-9fb8-a522fdf730a7 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] 10.222.0.33 "POST /compute/v2.1/servers/23da26ba-68f4-4aef-b13c-0b6588a65e43/action" status: 202 len: 0 microversion: 2.1 time: 0.158260 Oct 04 20:39:23.473992 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 713/1490] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 20:39:23 2022] POST /compute/v2.1/servers/23da26ba-68f4-4aef-b13c-0b6588a65e43/action => generated 0 bytes in 161 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 20:39:23.478441 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-6af2fd6b-4beb-428a-a29e-85a6c5bdff9a tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:23.479366 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-6af2fd6b-4beb-428a-a29e-85a6c5bdff9a tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] [instance: 83df4756-40e2-4fc6-be48-48a82dd4572a] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:23.492393 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1bf4fa5b-72db-4eb1-8641-097e868b6370 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:23.493436 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-1bf4fa5b-72db-4eb1-8641-097e868b6370 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] [instance: 23da26ba-68f4-4aef-b13c-0b6588a65e43] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:23.501758 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1bf4fa5b-72db-4eb1-8641-097e868b6370 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:23.502260 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1bf4fa5b-72db-4eb1-8641-097e868b6370 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:23.503155 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6af2fd6b-4beb-428a-a29e-85a6c5bdff9a tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:23.503748 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6af2fd6b-4beb-428a-a29e-85a6c5bdff9a tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:23.504331 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1bf4fa5b-72db-4eb1-8641-097e868b6370 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:23.505226 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1bf4fa5b-72db-4eb1-8641-097e868b6370 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:23.505528 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6af2fd6b-4beb-428a-a29e-85a6c5bdff9a tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:23.506269 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6af2fd6b-4beb-428a-a29e-85a6c5bdff9a tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:23.506815 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1bf4fa5b-72db-4eb1-8641-097e868b6370 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:23.507426 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1bf4fa5b-72db-4eb1-8641-097e868b6370 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:23.508702 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6af2fd6b-4beb-428a-a29e-85a6c5bdff9a tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:23.509162 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6af2fd6b-4beb-428a-a29e-85a6c5bdff9a tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:23.762085 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-6af2fd6b-4beb-428a-a29e-85a6c5bdff9a tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '800db3a57ada47eca381b00189fdbf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66ec8ea91b04deb90b679589e0495bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:23.765465 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-1bf4fa5b-72db-4eb1-8641-097e868b6370 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3563efe2b8c94931a2a46c4e14811b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3118a5d96843d3bede1ed94bd9717e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:23.773151 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-6af2fd6b-4beb-428a-a29e-85a6c5bdff9a tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] 10.222.0.33 "GET /compute/v2.1/servers/83df4756-40e2-4fc6-be48-48a82dd4572a" status: 200 len: 1361 microversion: 2.1 time: 0.298601 Oct 04 20:39:23.777816 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-1bf4fa5b-72db-4eb1-8641-097e868b6370 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] 10.222.0.33 "GET /compute/v2.1/servers/23da26ba-68f4-4aef-b13c-0b6588a65e43" status: 200 len: 1470 microversion: 2.1 time: 0.299272 Oct 04 20:39:23.779650 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 714/1491] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:23 2022] GET /compute/v2.1/servers/23da26ba-68f4-4aef-b13c-0b6588a65e43 => generated 1470 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:39:23.789297 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9288f9c9-2222-46ef-9d3e-96919be11758 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:23.790687 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-9288f9c9-2222-46ef-9d3e-96919be11758 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] [instance: d2173117-c1c5-4c2d-9658-914e67649cdd] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:23.791921 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 778/1492] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:23 2022] GET /compute/v2.1/servers/83df4756-40e2-4fc6-be48-48a82dd4572a => generated 1361 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:23.798233 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9288f9c9-2222-46ef-9d3e-96919be11758 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:23.799204 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9288f9c9-2222-46ef-9d3e-96919be11758 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:23.799933 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9288f9c9-2222-46ef-9d3e-96919be11758 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:23.801000 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9288f9c9-2222-46ef-9d3e-96919be11758 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:23.801871 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9288f9c9-2222-46ef-9d3e-96919be11758 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:23.802764 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9288f9c9-2222-46ef-9d3e-96919be11758 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:23.811194 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-576d7468-2f4b-489e-b348-856afe2f2f11 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:23.818500 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-576d7468-2f4b-489e-b348-856afe2f2f11 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] [instance: 0dd1d0cf-a3a0-4ea2-8260-ac206bbfac88] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:23.824650 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-576d7468-2f4b-489e-b348-856afe2f2f11 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:23.825766 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-576d7468-2f4b-489e-b348-856afe2f2f11 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:23.826200 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-576d7468-2f4b-489e-b348-856afe2f2f11 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:23.826938 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-576d7468-2f4b-489e-b348-856afe2f2f11 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:23.827390 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-576d7468-2f4b-489e-b348-856afe2f2f11 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:23.827812 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-576d7468-2f4b-489e-b348-856afe2f2f11 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:24.263974 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-9288f9c9-2222-46ef-9d3e-96919be11758 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a82c49a62249029ebc6ae3b4829709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecf3793be3eb4f3186c07a7e45fd8f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:24.274840 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-9288f9c9-2222-46ef-9d3e-96919be11758 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] 10.222.0.33 "GET /compute/v2.1/servers/d2173117-c1c5-4c2d-9658-914e67649cdd" status: 200 len: 1522 microversion: 2.1 time: 0.493216 Oct 04 20:39:24.298150 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 715/1493] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:23 2022] GET /compute/v2.1/servers/d2173117-c1c5-4c2d-9658-914e67649cdd => generated 1522 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:24.318409 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6e55f698-e40a-4668-9f69-4ff00379ce35 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:24.319041 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-6e55f698-e40a-4668-9f69-4ff00379ce35 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] [instance: a2fc592c-9dac-4f72-8633-229925d3bf76] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:24.335973 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6e55f698-e40a-4668-9f69-4ff00379ce35 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:24.341746 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6e55f698-e40a-4668-9f69-4ff00379ce35 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:24.343047 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6e55f698-e40a-4668-9f69-4ff00379ce35 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:24.344093 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6e55f698-e40a-4668-9f69-4ff00379ce35 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:24.345380 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6e55f698-e40a-4668-9f69-4ff00379ce35 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:24.346014 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6e55f698-e40a-4668-9f69-4ff00379ce35 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:24.521034 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-576d7468-2f4b-489e-b348-856afe2f2f11 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bdfa818206f4f4b88cc962c1c34adf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4151c9ef7ae04a728306297f58ba5088', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:24.535961 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-576d7468-2f4b-489e-b348-856afe2f2f11 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] 10.222.0.33 "GET /compute/v2.1/servers/0dd1d0cf-a3a0-4ea2-8260-ac206bbfac88" status: 200 len: 1317 microversion: 2.1 time: 0.739699 Oct 04 20:39:24.539337 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 779/1494] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:23 2022] GET /compute/v2.1/servers/0dd1d0cf-a3a0-4ea2-8260-ac206bbfac88 => generated 1317 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:24.554606 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-06dd3895-ac70-4a9d-9547-e8ada1f45dda tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:24.557267 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-06dd3895-ac70-4a9d-9547-e8ada1f45dda tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] [instance: 5ac07e56-084c-4208-a988-13ec91af9171] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:24.571797 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-06dd3895-ac70-4a9d-9547-e8ada1f45dda tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:24.573105 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-06dd3895-ac70-4a9d-9547-e8ada1f45dda tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:24.574612 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-06dd3895-ac70-4a9d-9547-e8ada1f45dda tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:24.576233 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-06dd3895-ac70-4a9d-9547-e8ada1f45dda tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:24.577953 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-06dd3895-ac70-4a9d-9547-e8ada1f45dda tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:24.578995 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-06dd3895-ac70-4a9d-9547-e8ada1f45dda tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:25.181374 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-06dd3895-ac70-4a9d-9547-e8ada1f45dda tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11149c46e1bc468f836fe70635dbf33b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e0d8329b2c4d64bf51d88948ca0de2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:25.200132 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-06dd3895-ac70-4a9d-9547-e8ada1f45dda tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] 10.222.0.33 "GET /compute/v2.1/servers/5ac07e56-084c-4208-a988-13ec91af9171" status: 200 len: 1252 microversion: 2.1 time: 0.659427 Oct 04 20:39:25.201692 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 780/1495] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:24 2022] GET /compute/v2.1/servers/5ac07e56-084c-4208-a988-13ec91af9171 => generated 1252 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:25.208571 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-8864735f-caaa-483a-a440-1c515a19e557 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:25.209341 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-8864735f-caaa-483a-a440-1c515a19e557 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] [instance: d9c5805f-6cd2-4993-86b2-8a7546b62dd6] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:25.215899 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8864735f-caaa-483a-a440-1c515a19e557 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:25.216737 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8864735f-caaa-483a-a440-1c515a19e557 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:25.217393 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8864735f-caaa-483a-a440-1c515a19e557 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:25.218325 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8864735f-caaa-483a-a440-1c515a19e557 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:25.219034 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8864735f-caaa-483a-a440-1c515a19e557 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:25.219680 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8864735f-caaa-483a-a440-1c515a19e557 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:25.381469 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-8864735f-caaa-483a-a440-1c515a19e557 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36f4114dc4f443f8b48da7b4027e0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a23a85365414f92bbc03177d7f190e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:25.399383 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-8864735f-caaa-483a-a440-1c515a19e557 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] 10.222.0.33 "GET /compute/v2.1/servers/d9c5805f-6cd2-4993-86b2-8a7546b62dd6" status: 200 len: 1275 microversion: 2.1 time: 0.195776 Oct 04 20:39:25.400533 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 781/1496] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:25 2022] GET /compute/v2.1/servers/d9c5805f-6cd2-4993-86b2-8a7546b62dd6 => generated 1275 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:25.406772 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-72222efd-ab44-4fc2-9a44-835339a2d5de tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Action: 'action', calling method: >, body: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:39:25.412812 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-72222efd-ab44-4fc2-9a44-835339a2d5de tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Request method failure captured: Oct 04 20:39:25.412812 n-d-854823-8 devstack@n-api.service[128802]: request: POST /compute/v2.1/servers/d2173117-c1c5-4c2d-9658-914e67649cdd/action HTTP/1.1 Oct 04 20:39:25.412812 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 20:39:25.412812 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 20:39:25.412812 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 20:39:25.412812 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 285 Oct 04 20:39:25.412812 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 20:39:25.412812 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 20:39:25.412812 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 20:39:25.412812 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 20:39:25.412812 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPJndB3mJHN0LJ8w6Kheb2n0CJ86k8j-AXdWa3AMW_tNY1_9QQNH8dAe8aGzPWpNIRLrfkOudQ5X3ptj4NBqufJdfAt-Rzg0K2bAeHF3DIzHVwi3Ysg8-zRwFjrbgaapzSsHDGJy5Rd6NQfSoCIrbX0y1TKi0r3vLuM4ZTrt6iTVd_LI Oct 04 20:39:25.412812 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 20:39:25.412812 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 20:39:25.412812 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 20:39:25.412812 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 20:39:25.412812 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 20:39:25.412812 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 20:39:25.412812 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: ecf3793be3eb4f3186c07a7e45fd8f06 Oct 04 20:39:25.412812 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-957462329 Oct 04 20:39:25.412812 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 20:39:25.412812 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 20:39:25.412812 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ecf3793be3eb4f3186c07a7e45fd8f06", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ecf3793be3eb4f3186c07a7e45fd8f06"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ecf3793be3eb4f3186c07a7e45fd8f06"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ecf3793be3eb4f3186c07a7e45fd8f06"}]}] Oct 04 20:39:25.412812 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-957462329 Oct 04 20:39:25.412812 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: ecf3793be3eb4f3186c07a7e45fd8f06 Oct 04 20:39:25.412812 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-957462329 Oct 04 20:39:25.412812 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-ImagesOneServerNegativeTestJSON-957462329-project Oct 04 20:39:25.412812 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 20:39:25.412812 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 20:39:25.412812 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: 89a82c49a62249029ebc6ae3b4829709 Oct 04 20:39:25.412812 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-957462329-project Oct 04 20:39:25.412812 n-d-854823-8 devstack@n-api.service[128802]: Oct 04 20:39:25.412812 n-d-854823-8 devstack@n-api.service[128802]: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Oct 04 20:39:25.412812 n-d-854823-8 devstack@n-api.service[128802]: method: > Oct 04 20:39:25.412812 n-d-854823-8 devstack@n-api.service[128802]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 04 20:39:25.412812 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'id': 'd2173117-c1c5-4c2d-9658-914e67649cdd', 'body': {'createImage': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Oct 04 20:39:25.412812 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:39:25.412812 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:39:25.412812 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 20:39:25.412812 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 20:39:25.412812 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 20:39:25.412812 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise error Oct 04 20:39:25.412812 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 04 20:39:25.412812 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:39:25.412812 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['createImage']['properties']['name']: Oct 04 20:39:25.412812 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 04 20:39:25.412812 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:39:25.412812 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi On instance['createImage']: Oct 04 20:39:25.412812 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 04 20:39:25.412812 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:39:25.412812 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:39:25.412812 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:39:25.412812 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:39:25.417090 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:39:25.417090 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:39:25.417090 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:39:25.417090 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:39:25.417090 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:39:25.417090 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:39:25.417090 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:39:25.417090 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:39:25.417090 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 20:39:25.417090 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 20:39:25.417090 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 20:39:25.417090 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 20:39:25.417090 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 20:39:25.417090 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 20:39:25.417090 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 04 20:39:25.417090 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:39:25.417090 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:39:25.417090 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:39:25.417090 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:39:25.417090 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:39:25.417090 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:39:25.417090 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 20:39:25.417090 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 20:39:25.417090 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 04 20:39:25.417090 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:39:25.420037 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-72222efd-ab44-4fc2-9a44-835339a2d5de tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:39:25.420037 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-72222efd-ab44-4fc2-9a44-835339a2d5de tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] 10.222.0.33 "POST /compute/v2.1/servers/d2173117-c1c5-4c2d-9658-914e67649cdd/action" status: 400 len: 619 microversion: 2.1 time: 0.017467 Oct 04 20:39:25.420894 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 782/1497] 10.222.0.33 () {60 vars in 1279 bytes} [Tue Oct 4 20:39:25 2022] POST /compute/v2.1/servers/d2173117-c1c5-4c2d-9658-914e67649cdd/action => generated 619 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 20:39:25.431071 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-35c68a56-ecc8-4e03-b707-1976ff0a70e1 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:25.431942 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-35c68a56-ecc8-4e03-b707-1976ff0a70e1 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] [instance: 83df4756-40e2-4fc6-be48-48a82dd4572a] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:25.433951 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:39:25.483105 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-35c68a56-ecc8-4e03-b707-1976ff0a70e1 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:25.486973 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-35c68a56-ecc8-4e03-b707-1976ff0a70e1 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:25.488134 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-35c68a56-ecc8-4e03-b707-1976ff0a70e1 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:25.489173 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-35c68a56-ecc8-4e03-b707-1976ff0a70e1 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:25.489847 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-35c68a56-ecc8-4e03-b707-1976ff0a70e1 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:25.490653 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-35c68a56-ecc8-4e03-b707-1976ff0a70e1 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:25.586515 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-6e55f698-e40a-4668-9f69-4ff00379ce35 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96919ec99c14864876d64a9c2b20f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b44ce10b78bf49c882c9b4df06187114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:25.590321 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:39:25.598313 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-6e55f698-e40a-4668-9f69-4ff00379ce35 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] 10.222.0.33 "GET /compute/v2.1/servers/a2fc592c-9dac-4f72-8633-229925d3bf76" status: 200 len: 1313 microversion: 2.1 time: 1.298929 Oct 04 20:39:25.614925 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 716/1498] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:24 2022] GET /compute/v2.1/servers/a2fc592c-9dac-4f72-8633-229925d3bf76 => generated 1313 bytes in 1316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:25.622175 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-33c6e02e-96c0-466d-9cd6-de81edbe78b3 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:25.623441 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-33c6e02e-96c0-466d-9cd6-de81edbe78b3 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] [instance: 23da26ba-68f4-4aef-b13c-0b6588a65e43] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:25.630724 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-33c6e02e-96c0-466d-9cd6-de81edbe78b3 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:25.631651 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-33c6e02e-96c0-466d-9cd6-de81edbe78b3 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:25.632453 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-33c6e02e-96c0-466d-9cd6-de81edbe78b3 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:25.633527 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-33c6e02e-96c0-466d-9cd6-de81edbe78b3 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:25.634279 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-33c6e02e-96c0-466d-9cd6-de81edbe78b3 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:25.634936 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-33c6e02e-96c0-466d-9cd6-de81edbe78b3 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:26.066488 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-35c68a56-ecc8-4e03-b707-1976ff0a70e1 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '800db3a57ada47eca381b00189fdbf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66ec8ea91b04deb90b679589e0495bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:26.075740 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-35c68a56-ecc8-4e03-b707-1976ff0a70e1 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] 10.222.0.33 "GET /compute/v2.1/servers/83df4756-40e2-4fc6-be48-48a82dd4572a" status: 200 len: 1361 microversion: 2.1 time: 0.653651 Oct 04 20:39:26.087206 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 783/1499] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:25 2022] GET /compute/v2.1/servers/83df4756-40e2-4fc6-be48-48a82dd4572a => generated 1361 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:26.092065 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-028c2fe9-4d3a-45d2-a808-17235f1af398 req-663bf9fe-2651-4ece-858e-24e0a6101772 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2fc592c-9dac-4f72-8633-229925d3bf76", "name": "network-vif-plugged", "status": "completed", "tag": "1a24093e-a143-47cb-9d69-c8078dca39c0"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:39:26.103851 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-028c2fe9-4d3a-45d2-a808-17235f1af398 req-663bf9fe-2651-4ece-858e-24e0a6101772 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:26.104886 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-028c2fe9-4d3a-45d2-a808-17235f1af398 req-663bf9fe-2651-4ece-858e-24e0a6101772 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:26.105309 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-028c2fe9-4d3a-45d2-a808-17235f1af398 req-663bf9fe-2651-4ece-858e-24e0a6101772 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:26.118601 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-028c2fe9-4d3a-45d2-a808-17235f1af398 req-663bf9fe-2651-4ece-858e-24e0a6101772 service nova] Creating event network-vif-plugged:1a24093e-a143-47cb-9d69-c8078dca39c0 for instance a2fc592c-9dac-4f72-8633-229925d3bf76 on n-h1-854823-8 Oct 04 20:39:26.123513 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-028c2fe9-4d3a-45d2-a808-17235f1af398 req-663bf9fe-2651-4ece-858e-24e0a6101772 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036314 Oct 04 20:39:26.124525 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 784/1500] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:39:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:39:26.130897 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-f9d656c3-b0df-4761-8bd2-bc1d64dc8dc1 req-5955b96c-32f3-4e3f-85ca-f63645c0cf51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ac07e56-084c-4208-a988-13ec91af9171", "name": "network-vif-deleted", "tag": "110ce36c-aef7-4f87-ae06-e95d837c4b2b"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:39:26.140857 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-f9d656c3-b0df-4761-8bd2-bc1d64dc8dc1 req-5955b96c-32f3-4e3f-85ca-f63645c0cf51 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:26.141323 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-f9d656c3-b0df-4761-8bd2-bc1d64dc8dc1 req-5955b96c-32f3-4e3f-85ca-f63645c0cf51 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:26.141748 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-f9d656c3-b0df-4761-8bd2-bc1d64dc8dc1 req-5955b96c-32f3-4e3f-85ca-f63645c0cf51 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:26.155650 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-f9d656c3-b0df-4761-8bd2-bc1d64dc8dc1 req-5955b96c-32f3-4e3f-85ca-f63645c0cf51 service nova] Creating event network-vif-deleted:110ce36c-aef7-4f87-ae06-e95d837c4b2b for instance 5ac07e56-084c-4208-a988-13ec91af9171 on n-h1-854823-8 Oct 04 20:39:26.162881 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-f9d656c3-b0df-4761-8bd2-bc1d64dc8dc1 req-5955b96c-32f3-4e3f-85ca-f63645c0cf51 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036927 Oct 04 20:39:26.164267 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 785/1501] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:39:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:39:26.170296 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-3e42188d-fa46-4955-a92c-0c2fbedeecd5 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:26.172113 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-3e42188d-fa46-4955-a92c-0c2fbedeecd5 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] [instance: d2173117-c1c5-4c2d-9658-914e67649cdd] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:26.174833 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-33c6e02e-96c0-466d-9cd6-de81edbe78b3 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3563efe2b8c94931a2a46c4e14811b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3118a5d96843d3bede1ed94bd9717e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:26.179707 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3e42188d-fa46-4955-a92c-0c2fbedeecd5 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:26.180379 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3e42188d-fa46-4955-a92c-0c2fbedeecd5 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:26.180993 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3e42188d-fa46-4955-a92c-0c2fbedeecd5 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:26.181856 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3e42188d-fa46-4955-a92c-0c2fbedeecd5 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:26.183006 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3e42188d-fa46-4955-a92c-0c2fbedeecd5 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:26.183609 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3e42188d-fa46-4955-a92c-0c2fbedeecd5 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:26.212212 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-33c6e02e-96c0-466d-9cd6-de81edbe78b3 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] 10.222.0.33 "GET /compute/v2.1/servers/23da26ba-68f4-4aef-b13c-0b6588a65e43" status: 200 len: 1470 microversion: 2.1 time: 0.595233 Oct 04 20:39:26.215858 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 717/1502] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:25 2022] GET /compute/v2.1/servers/23da26ba-68f4-4aef-b13c-0b6588a65e43 => generated 1470 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:26.238098 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b674e05e-ba2a-4940-9ba6-4af982b745c7 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:26.242049 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b674e05e-ba2a-4940-9ba6-4af982b745c7 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] [instance: 0dd1d0cf-a3a0-4ea2-8260-ac206bbfac88] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:26.251182 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b674e05e-ba2a-4940-9ba6-4af982b745c7 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:26.252459 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b674e05e-ba2a-4940-9ba6-4af982b745c7 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:26.254015 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b674e05e-ba2a-4940-9ba6-4af982b745c7 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:26.255555 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b674e05e-ba2a-4940-9ba6-4af982b745c7 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:26.259333 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b674e05e-ba2a-4940-9ba6-4af982b745c7 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:26.260095 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b674e05e-ba2a-4940-9ba6-4af982b745c7 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:26.633836 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-3e42188d-fa46-4955-a92c-0c2fbedeecd5 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a82c49a62249029ebc6ae3b4829709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecf3793be3eb4f3186c07a7e45fd8f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:26.645793 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-3e42188d-fa46-4955-a92c-0c2fbedeecd5 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] 10.222.0.33 "GET /compute/v2.1/servers/d2173117-c1c5-4c2d-9658-914e67649cdd" status: 200 len: 1522 microversion: 2.1 time: 0.480066 Oct 04 20:39:26.659320 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 786/1503] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:26 2022] GET /compute/v2.1/servers/d2173117-c1c5-4c2d-9658-914e67649cdd => generated 1522 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:26.671507 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-dc19df07-1a9c-4f92-b4f5-86c900f758ed tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:26.672365 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-dc19df07-1a9c-4f92-b4f5-86c900f758ed tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] [instance: 5ac07e56-084c-4208-a988-13ec91af9171] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:26.680474 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dc19df07-1a9c-4f92-b4f5-86c900f758ed tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:26.681336 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dc19df07-1a9c-4f92-b4f5-86c900f758ed tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:26.681984 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dc19df07-1a9c-4f92-b4f5-86c900f758ed tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:26.682975 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dc19df07-1a9c-4f92-b4f5-86c900f758ed tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:26.683644 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dc19df07-1a9c-4f92-b4f5-86c900f758ed tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:26.684410 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dc19df07-1a9c-4f92-b4f5-86c900f758ed tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:26.740048 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-b674e05e-ba2a-4940-9ba6-4af982b745c7 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bdfa818206f4f4b88cc962c1c34adf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4151c9ef7ae04a728306297f58ba5088', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:26.753253 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b674e05e-ba2a-4940-9ba6-4af982b745c7 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] 10.222.0.33 "GET /compute/v2.1/servers/0dd1d0cf-a3a0-4ea2-8260-ac206bbfac88" status: 200 len: 1317 microversion: 2.1 time: 0.532308 Oct 04 20:39:26.754379 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 718/1504] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:26 2022] GET /compute/v2.1/servers/0dd1d0cf-a3a0-4ea2-8260-ac206bbfac88 => generated 1317 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:26.760148 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-cbcd7d1b-ae58-468d-bda8-589af6553013 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:26.761057 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-cbcd7d1b-ae58-468d-bda8-589af6553013 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] [instance: d9c5805f-6cd2-4993-86b2-8a7546b62dd6] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:26.772351 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cbcd7d1b-ae58-468d-bda8-589af6553013 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:26.773851 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cbcd7d1b-ae58-468d-bda8-589af6553013 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:26.774738 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cbcd7d1b-ae58-468d-bda8-589af6553013 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:26.778090 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cbcd7d1b-ae58-468d-bda8-589af6553013 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:26.778870 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cbcd7d1b-ae58-468d-bda8-589af6553013 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:26.779590 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cbcd7d1b-ae58-468d-bda8-589af6553013 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:26.855660 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-dc19df07-1a9c-4f92-b4f5-86c900f758ed tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11149c46e1bc468f836fe70635dbf33b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e0d8329b2c4d64bf51d88948ca0de2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:26.863949 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-dc19df07-1a9c-4f92-b4f5-86c900f758ed tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] 10.222.0.33 "GET /compute/v2.1/servers/5ac07e56-084c-4208-a988-13ec91af9171" status: 200 len: 1252 microversion: 2.1 time: 0.203311 Oct 04 20:39:26.864525 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 787/1505] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:26 2022] GET /compute/v2.1/servers/5ac07e56-084c-4208-a988-13ec91af9171 => generated 1252 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:26.875017 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-6c27e46c-ad2a-4856-8d87-eb17e026c659 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:26.875991 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-6c27e46c-ad2a-4856-8d87-eb17e026c659 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] [instance: a2fc592c-9dac-4f72-8633-229925d3bf76] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:26.883580 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6c27e46c-ad2a-4856-8d87-eb17e026c659 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:26.884196 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6c27e46c-ad2a-4856-8d87-eb17e026c659 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:26.884715 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6c27e46c-ad2a-4856-8d87-eb17e026c659 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:26.885550 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6c27e46c-ad2a-4856-8d87-eb17e026c659 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:26.886077 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6c27e46c-ad2a-4856-8d87-eb17e026c659 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:26.886611 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6c27e46c-ad2a-4856-8d87-eb17e026c659 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:26.919413 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-cbcd7d1b-ae58-468d-bda8-589af6553013 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36f4114dc4f443f8b48da7b4027e0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a23a85365414f92bbc03177d7f190e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:26.930919 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-cbcd7d1b-ae58-468d-bda8-589af6553013 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] 10.222.0.33 "GET /compute/v2.1/servers/d9c5805f-6cd2-4993-86b2-8a7546b62dd6" status: 200 len: 1275 microversion: 2.1 time: 0.174674 Oct 04 20:39:26.932194 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 719/1506] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:26 2022] GET /compute/v2.1/servers/d9c5805f-6cd2-4993-86b2-8a7546b62dd6 => generated 1275 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:26.937477 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e0e9aaa9-d9f3-46a7-9817-352f89317ae6 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:26.938500 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e0e9aaa9-d9f3-46a7-9817-352f89317ae6 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] [instance: d2173117-c1c5-4c2d-9658-914e67649cdd] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:26.948873 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e0e9aaa9-d9f3-46a7-9817-352f89317ae6 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:26.949478 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e0e9aaa9-d9f3-46a7-9817-352f89317ae6 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:26.950031 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e0e9aaa9-d9f3-46a7-9817-352f89317ae6 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:26.951059 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e0e9aaa9-d9f3-46a7-9817-352f89317ae6 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:26.951764 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e0e9aaa9-d9f3-46a7-9817-352f89317ae6 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:26.952703 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e0e9aaa9-d9f3-46a7-9817-352f89317ae6 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:27.168390 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-6c27e46c-ad2a-4856-8d87-eb17e026c659 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96919ec99c14864876d64a9c2b20f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b44ce10b78bf49c882c9b4df06187114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:27.189035 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-6c27e46c-ad2a-4856-8d87-eb17e026c659 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] 10.222.0.33 "GET /compute/v2.1/servers/a2fc592c-9dac-4f72-8633-229925d3bf76" status: 200 len: 1313 microversion: 2.1 time: 0.323130 Oct 04 20:39:27.189874 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 788/1507] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:26 2022] GET /compute/v2.1/servers/a2fc592c-9dac-4f72-8633-229925d3bf76 => generated 1313 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:27.205244 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e0e9aaa9-d9f3-46a7-9817-352f89317ae6 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a82c49a62249029ebc6ae3b4829709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecf3793be3eb4f3186c07a7e45fd8f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:27.208529 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e0e9aaa9-d9f3-46a7-9817-352f89317ae6 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] 10.222.0.33 "GET /compute/v2.1/servers/d2173117-c1c5-4c2d-9658-914e67649cdd" status: 200 len: 1522 microversion: 2.1 time: 0.274948 Oct 04 20:39:27.212460 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-bf54d1a7-4342-4f29-b2f4-8d2a957f3ea4 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:27.213269 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-bf54d1a7-4342-4f29-b2f4-8d2a957f3ea4 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] [instance: 83df4756-40e2-4fc6-be48-48a82dd4572a] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:27.219990 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bf54d1a7-4342-4f29-b2f4-8d2a957f3ea4 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:27.220737 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bf54d1a7-4342-4f29-b2f4-8d2a957f3ea4 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:27.222082 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bf54d1a7-4342-4f29-b2f4-8d2a957f3ea4 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:27.222525 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 720/1508] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:26 2022] GET /compute/v2.1/servers/d2173117-c1c5-4c2d-9658-914e67649cdd => generated 1522 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:27.223202 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bf54d1a7-4342-4f29-b2f4-8d2a957f3ea4 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:27.223810 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bf54d1a7-4342-4f29-b2f4-8d2a957f3ea4 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:27.224385 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bf54d1a7-4342-4f29-b2f4-8d2a957f3ea4 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:27.238996 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f0017168-95d7-4a9b-a3ce-3ff7cb0a121c tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1122359329"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:39:27.242627 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f0017168-95d7-4a9b-a3ce-3ff7cb0a121c tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] [instance: d2173117-c1c5-4c2d-9658-914e67649cdd] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:27.251122 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f0017168-95d7-4a9b-a3ce-3ff7cb0a121c tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:27.253200 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f0017168-95d7-4a9b-a3ce-3ff7cb0a121c tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:27.253874 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f0017168-95d7-4a9b-a3ce-3ff7cb0a121c tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:27.254717 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f0017168-95d7-4a9b-a3ce-3ff7cb0a121c tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:27.255279 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f0017168-95d7-4a9b-a3ce-3ff7cb0a121c tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:27.256208 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f0017168-95d7-4a9b-a3ce-3ff7cb0a121c tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:27.564040 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-bf54d1a7-4342-4f29-b2f4-8d2a957f3ea4 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '800db3a57ada47eca381b00189fdbf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66ec8ea91b04deb90b679589e0495bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:27.584829 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-bf54d1a7-4342-4f29-b2f4-8d2a957f3ea4 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] 10.222.0.33 "GET /compute/v2.1/servers/83df4756-40e2-4fc6-be48-48a82dd4572a" status: 200 len: 1361 microversion: 2.1 time: 0.374853 Oct 04 20:39:27.601756 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 789/1509] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:27 2022] GET /compute/v2.1/servers/83df4756-40e2-4fc6-be48-48a82dd4572a => generated 1361 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:27.609454 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-2034d273-3a43-42c8-a149-a0a6bfe2f848 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:27.610466 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-2034d273-3a43-42c8-a149-a0a6bfe2f848 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] [instance: 23da26ba-68f4-4aef-b13c-0b6588a65e43] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:27.614033 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f0017168-95d7-4a9b-a3ce-3ff7cb0a121c tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] 10.222.0.33 "POST /compute/v2.1/servers/d2173117-c1c5-4c2d-9658-914e67649cdd/action" status: 202 len: 0 microversion: 2.1 time: 0.383975 Oct 04 20:39:27.621410 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2034d273-3a43-42c8-a149-a0a6bfe2f848 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:27.622171 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2034d273-3a43-42c8-a149-a0a6bfe2f848 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:27.622319 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 721/1510] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 20:39:27 2022] POST /compute/v2.1/servers/d2173117-c1c5-4c2d-9658-914e67649cdd/action => generated 0 bytes in 393 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Oct 04 20:39:27.622957 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2034d273-3a43-42c8-a149-a0a6bfe2f848 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:27.624492 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2034d273-3a43-42c8-a149-a0a6bfe2f848 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:27.625215 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2034d273-3a43-42c8-a149-a0a6bfe2f848 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:27.625812 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2034d273-3a43-42c8-a149-a0a6bfe2f848 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:27.633370 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-3ccddfd9-994c-4bb1-9fc4-5998b001e057 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-936948061"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:39:27.641931 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-3ccddfd9-994c-4bb1-9fc4-5998b001e057 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] [instance: d2173117-c1c5-4c2d-9658-914e67649cdd] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:27.656268 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3ccddfd9-994c-4bb1-9fc4-5998b001e057 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:27.657229 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3ccddfd9-994c-4bb1-9fc4-5998b001e057 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:27.657901 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3ccddfd9-994c-4bb1-9fc4-5998b001e057 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:27.660754 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3ccddfd9-994c-4bb1-9fc4-5998b001e057 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:27.661549 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3ccddfd9-994c-4bb1-9fc4-5998b001e057 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:27.662556 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3ccddfd9-994c-4bb1-9fc4-5998b001e057 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:27.781019 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-3ccddfd9-994c-4bb1-9fc4-5998b001e057 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] HTTP exception thrown: Cannot 'createImage' instance d2173117-c1c5-4c2d-9658-914e67649cdd while it is in task_state image_snapshot_pending Oct 04 20:39:27.782989 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-3ccddfd9-994c-4bb1-9fc4-5998b001e057 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Request method failure captured: Oct 04 20:39:27.782989 n-d-854823-8 devstack@n-api.service[128801]: request: POST /compute/v2.1/servers/d2173117-c1c5-4c2d-9658-914e67649cdd/action HTTP/1.1 Oct 04 20:39:27.782989 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:39:27.782989 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:39:27.782989 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:39:27.782989 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 84 Oct 04 20:39:27.782989 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:39:27.782989 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:39:27.782989 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:39:27.782989 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:39:27.782989 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJndB3mJHN0LJ8w6Kheb2n0CJ86k8j-AXdWa3AMW_tNY1_9QQNH8dAe8aGzPWpNIRLrfkOudQ5X3ptj4NBqufJdfAt-Rzg0K2bAeHF3DIzHVwi3Ysg8-zRwFjrbgaapzSsHDGJy5Rd6NQfSoCIrbX0y1TKi0r3vLuM4ZTrt6iTVd_LI Oct 04 20:39:27.782989 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:39:27.782989 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:39:27.782989 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:39:27.782989 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:39:27.782989 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:39:27.782989 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:39:27.782989 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: ecf3793be3eb4f3186c07a7e45fd8f06 Oct 04 20:39:27.782989 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-957462329 Oct 04 20:39:27.782989 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 20:39:27.782989 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 20:39:27.782989 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ecf3793be3eb4f3186c07a7e45fd8f06", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ecf3793be3eb4f3186c07a7e45fd8f06"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ecf3793be3eb4f3186c07a7e45fd8f06"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ecf3793be3eb4f3186c07a7e45fd8f06"}]}] Oct 04 20:39:27.782989 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-957462329 Oct 04 20:39:27.782989 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: ecf3793be3eb4f3186c07a7e45fd8f06 Oct 04 20:39:27.782989 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-957462329 Oct 04 20:39:27.782989 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-ImagesOneServerNegativeTestJSON-957462329-project Oct 04 20:39:27.782989 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:39:27.782989 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:39:27.782989 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: 89a82c49a62249029ebc6ae3b4829709 Oct 04 20:39:27.782989 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-957462329-project Oct 04 20:39:27.782989 n-d-854823-8 devstack@n-api.service[128801]: Oct 04 20:39:27.782989 n-d-854823-8 devstack@n-api.service[128801]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-936948061"}} Oct 04 20:39:27.782989 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 20:39:27.782989 n-d-854823-8 devstack@n-api.service[128801]: exception: Cannot 'createImage' instance d2173117-c1c5-4c2d-9658-914e67649cdd while it is in task_state image_snapshot_pending Oct 04 20:39:27.782989 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': 'd2173117-c1c5-4c2d-9658-914e67649cdd', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-936948061'}}} Oct 04 20:39:27.782989 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:39:27.782989 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:39:27.782989 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1349, in _action_create_image Oct 04 20:39:27.782989 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi image = self.compute_api.snapshot(context, Oct 04 20:39:27.782989 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 155, in inner Oct 04 20:39:27.782989 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 04 20:39:27.782989 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance d2173117-c1c5-4c2d-9658-914e67649cdd in task_state image_snapshot_pending. Cannot snapshot while the instance is in this state. Oct 04 20:39:27.782989 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:39:27.782989 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:39:27.782989 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:39:27.782989 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:39:27.782989 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:39:27.782989 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:39:27.782989 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:39:27.782989 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:39:27.782989 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:39:27.782989 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:39:27.782989 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:39:27.782989 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:39:27.782989 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:39:27.782989 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:39:27.782989 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1354, in _action_create_image Oct 04 20:39:27.782989 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 04 20:39:27.782989 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 04 20:39:27.782989 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 04 20:39:27.788642 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'createImage' instance d2173117-c1c5-4c2d-9658-914e67649cdd while it is in task_state image_snapshot_pending Oct 04 20:39:27.788642 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:39:27.788642 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:39:27.788642 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:39:27.788642 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:39:27.788642 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:39:27.788642 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:39:27.788642 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:39:27.788642 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:39:27.788642 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'createImage' instance d2173117-c1c5-4c2d-9658-914e67649cdd while it is in task_state image_snapshot_pending Oct 04 20:39:27.788642 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:39:27.788642 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-3ccddfd9-994c-4bb1-9fc4-5998b001e057 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Returning 409 to user: Cannot 'createImage' instance d2173117-c1c5-4c2d-9658-914e67649cdd while it is in task_state image_snapshot_pending {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:39:27.788642 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-3ccddfd9-994c-4bb1-9fc4-5998b001e057 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] 10.222.0.33 "POST /compute/v2.1/servers/d2173117-c1c5-4c2d-9658-914e67649cdd/action" status: 409 len: 167 microversion: 2.1 time: 0.162055 Oct 04 20:39:27.789632 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 722/1511] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 20:39:27 2022] POST /compute/v2.1/servers/d2173117-c1c5-4c2d-9658-914e67649cdd/action => generated 167 bytes in 166 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 04 20:39:27.799656 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-08ead7bf-24e7-42d3-8e1e-b413a774c0e4 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:27.800280 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-08ead7bf-24e7-42d3-8e1e-b413a774c0e4 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] [instance: 0dd1d0cf-a3a0-4ea2-8260-ac206bbfac88] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:27.808514 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-08ead7bf-24e7-42d3-8e1e-b413a774c0e4 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:27.809020 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-08ead7bf-24e7-42d3-8e1e-b413a774c0e4 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:27.809608 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-08ead7bf-24e7-42d3-8e1e-b413a774c0e4 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:27.811100 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-08ead7bf-24e7-42d3-8e1e-b413a774c0e4 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:27.811637 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-08ead7bf-24e7-42d3-8e1e-b413a774c0e4 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:27.812338 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-08ead7bf-24e7-42d3-8e1e-b413a774c0e4 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:27.959167 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-2034d273-3a43-42c8-a149-a0a6bfe2f848 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3563efe2b8c94931a2a46c4e14811b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3118a5d96843d3bede1ed94bd9717e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:27.979401 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-2034d273-3a43-42c8-a149-a0a6bfe2f848 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] 10.222.0.33 "GET /compute/v2.1/servers/23da26ba-68f4-4aef-b13c-0b6588a65e43" status: 200 len: 1470 microversion: 2.1 time: 0.374918 Oct 04 20:39:27.980003 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 790/1512] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:27 2022] GET /compute/v2.1/servers/23da26ba-68f4-4aef-b13c-0b6588a65e43 => generated 1470 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:27.984621 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-5218216a-3c56-453f-bf7d-28b86e6fe4ad tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Calling method '.version_select at 0x7f3c7461fa60>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:28.152099 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-08ead7bf-24e7-42d3-8e1e-b413a774c0e4 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bdfa818206f4f4b88cc962c1c34adf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4151c9ef7ae04a728306297f58ba5088', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:28.160928 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-08ead7bf-24e7-42d3-8e1e-b413a774c0e4 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] 10.222.0.33 "GET /compute/v2.1/servers/0dd1d0cf-a3a0-4ea2-8260-ac206bbfac88" status: 200 len: 1317 microversion: 2.1 time: 0.365950 Oct 04 20:39:28.171436 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 723/1513] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:27 2022] GET /compute/v2.1/servers/0dd1d0cf-a3a0-4ea2-8260-ac206bbfac88 => generated 1317 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:28.177320 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1707ca89-63ce-4d02-aa60-bcaf43abb293 tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:28.178231 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-1707ca89-63ce-4d02-aa60-bcaf43abb293 tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] [instance: 5ac07e56-084c-4208-a988-13ec91af9171] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:28.180520 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=6 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:39:28.195002 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1707ca89-63ce-4d02-aa60-bcaf43abb293 tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:28.201778 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1707ca89-63ce-4d02-aa60-bcaf43abb293 tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:28.203256 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1707ca89-63ce-4d02-aa60-bcaf43abb293 tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:28.204206 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1707ca89-63ce-4d02-aa60-bcaf43abb293 tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:28.204852 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1707ca89-63ce-4d02-aa60-bcaf43abb293 tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:28.205559 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1707ca89-63ce-4d02-aa60-bcaf43abb293 tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:28.229985 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-5218216a-3c56-453f-bf7d-28b86e6fe4ad tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] 10.222.0.33 "DELETE /compute/v2.1/images/9ef8a157-ebb5-4f4e-ad27-89e99e3f5ff2" status: 204 len: 0 microversion: 2.1 time: 0.248921 Oct 04 20:39:28.230679 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 791/1514] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:27 2022] DELETE /compute/v2.1/images/9ef8a157-ebb5-4f4e-ad27-89e99e3f5ff2 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:39:28.237192 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-0b45e003-733e-46a5-b25e-380dd46717e0 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:28.238252 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-0b45e003-733e-46a5-b25e-380dd46717e0 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] [instance: d9c5805f-6cd2-4993-86b2-8a7546b62dd6] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:28.257676 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0b45e003-733e-46a5-b25e-380dd46717e0 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:28.259086 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0b45e003-733e-46a5-b25e-380dd46717e0 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:28.260333 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0b45e003-733e-46a5-b25e-380dd46717e0 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:28.261900 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0b45e003-733e-46a5-b25e-380dd46717e0 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:28.262617 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0b45e003-733e-46a5-b25e-380dd46717e0 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:28.263771 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0b45e003-733e-46a5-b25e-380dd46717e0 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:28.294130 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=15 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:39:28.398443 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-1707ca89-63ce-4d02-aa60-bcaf43abb293 tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11149c46e1bc468f836fe70635dbf33b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e0d8329b2c4d64bf51d88948ca0de2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:28.410006 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-1707ca89-63ce-4d02-aa60-bcaf43abb293 tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] 10.222.0.33 "GET /compute/v2.1/servers/5ac07e56-084c-4208-a988-13ec91af9171" status: 200 len: 1252 microversion: 2.1 time: 0.237040 Oct 04 20:39:28.411685 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 724/1515] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:28 2022] GET /compute/v2.1/servers/5ac07e56-084c-4208-a988-13ec91af9171 => generated 1252 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:28.418281 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-8ee68267-0d2d-40a7-9c40-2c527643466b req-f24cdf45-2260-45f8-a4b4-e8bbc8dcd066 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23da26ba-68f4-4aef-b13c-0b6588a65e43", "name": "network-vif-plugged", "status": "completed", "tag": "f692dbdb-9498-4986-a253-420f090b704f"}, {"server_uuid": "0dd1d0cf-a3a0-4ea2-8260-ac206bbfac88", "name": "network-vif-plugged", "status": "completed", "tag": "5ef34720-ea76-4ea1-90bb-a255bf7dfe8b"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:39:28.433749 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-8ee68267-0d2d-40a7-9c40-2c527643466b req-f24cdf45-2260-45f8-a4b4-e8bbc8dcd066 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:28.434865 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-8ee68267-0d2d-40a7-9c40-2c527643466b req-f24cdf45-2260-45f8-a4b4-e8bbc8dcd066 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:28.435579 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-8ee68267-0d2d-40a7-9c40-2c527643466b req-f24cdf45-2260-45f8-a4b4-e8bbc8dcd066 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:28.453892 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-8ee68267-0d2d-40a7-9c40-2c527643466b req-f24cdf45-2260-45f8-a4b4-e8bbc8dcd066 service nova] Creating event network-vif-plugged:f692dbdb-9498-4986-a253-420f090b704f for instance 23da26ba-68f4-4aef-b13c-0b6588a65e43 on n-h2-854823-8 Oct 04 20:39:28.455259 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-8ee68267-0d2d-40a7-9c40-2c527643466b req-f24cdf45-2260-45f8-a4b4-e8bbc8dcd066 service nova] Creating event network-vif-plugged:5ef34720-ea76-4ea1-90bb-a255bf7dfe8b for instance 0dd1d0cf-a3a0-4ea2-8260-ac206bbfac88 on n-h1-854823-8 Oct 04 20:39:28.470117 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [req-8ee68267-0d2d-40a7-9c40-2c527643466b req-f24cdf45-2260-45f8-a4b4-e8bbc8dcd066 service nova] Instance 23da26ba-68f4-4aef-b13c-0b6588a65e43 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854823-8', 'n-h2-854823-8'} {{(pid=128801) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 20:39:28.502019 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-8ee68267-0d2d-40a7-9c40-2c527643466b req-f24cdf45-2260-45f8-a4b4-e8bbc8dcd066 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.088257 Oct 04 20:39:28.505418 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 725/1516] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:39:28 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:39:28.512810 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e58f2443-1cd9-46ad-9ba9-a6535aee1564 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:28.513593 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e58f2443-1cd9-46ad-9ba9-a6535aee1564 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] [instance: a2fc592c-9dac-4f72-8633-229925d3bf76] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:28.521645 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e58f2443-1cd9-46ad-9ba9-a6535aee1564 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:28.522238 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e58f2443-1cd9-46ad-9ba9-a6535aee1564 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:28.522751 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e58f2443-1cd9-46ad-9ba9-a6535aee1564 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:28.524310 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e58f2443-1cd9-46ad-9ba9-a6535aee1564 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:28.524969 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e58f2443-1cd9-46ad-9ba9-a6535aee1564 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:28.525724 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e58f2443-1cd9-46ad-9ba9-a6535aee1564 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:28.701608 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-0b45e003-733e-46a5-b25e-380dd46717e0 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36f4114dc4f443f8b48da7b4027e0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a23a85365414f92bbc03177d7f190e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:28.713289 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-0b45e003-733e-46a5-b25e-380dd46717e0 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] 10.222.0.33 "GET /compute/v2.1/servers/d9c5805f-6cd2-4993-86b2-8a7546b62dd6" status: 200 len: 1317 microversion: 2.1 time: 0.481297 Oct 04 20:39:28.714509 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 792/1517] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:28 2022] GET /compute/v2.1/servers/d9c5805f-6cd2-4993-86b2-8a7546b62dd6 => generated 1317 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:28.719512 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-0984d759-2123-4e17-a59e-a428ce55e9be tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:28.720120 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-0984d759-2123-4e17-a59e-a428ce55e9be tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] [instance: d2173117-c1c5-4c2d-9658-914e67649cdd] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:28.727278 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0984d759-2123-4e17-a59e-a428ce55e9be tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:28.727991 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0984d759-2123-4e17-a59e-a428ce55e9be tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:28.728603 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0984d759-2123-4e17-a59e-a428ce55e9be tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:28.729487 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0984d759-2123-4e17-a59e-a428ce55e9be tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:28.730107 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0984d759-2123-4e17-a59e-a428ce55e9be tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:28.730818 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0984d759-2123-4e17-a59e-a428ce55e9be tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:28.925952 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e58f2443-1cd9-46ad-9ba9-a6535aee1564 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96919ec99c14864876d64a9c2b20f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b44ce10b78bf49c882c9b4df06187114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:28.937177 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e58f2443-1cd9-46ad-9ba9-a6535aee1564 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] 10.222.0.33 "GET /compute/v2.1/servers/a2fc592c-9dac-4f72-8633-229925d3bf76" status: 200 len: 1498 microversion: 2.1 time: 0.430033 Oct 04 20:39:28.938650 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 726/1518] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:28 2022] GET /compute/v2.1/servers/a2fc592c-9dac-4f72-8633-229925d3bf76 => generated 1498 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:28.948172 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-134bbafa-1891-461e-9086-d81c98cecf71 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:28.949154 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-134bbafa-1891-461e-9086-d81c98cecf71 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] [instance: 83df4756-40e2-4fc6-be48-48a82dd4572a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:28.959095 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-134bbafa-1891-461e-9086-d81c98cecf71 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:28.960552 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-134bbafa-1891-461e-9086-d81c98cecf71 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:28.961278 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-134bbafa-1891-461e-9086-d81c98cecf71 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:28.963337 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-134bbafa-1891-461e-9086-d81c98cecf71 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:28.965248 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-134bbafa-1891-461e-9086-d81c98cecf71 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:28.966369 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-134bbafa-1891-461e-9086-d81c98cecf71 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:28.983510 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-0984d759-2123-4e17-a59e-a428ce55e9be tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a82c49a62249029ebc6ae3b4829709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecf3793be3eb4f3186c07a7e45fd8f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:28.998795 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-0984d759-2123-4e17-a59e-a428ce55e9be tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] 10.222.0.33 "GET /compute/v2.1/servers/d2173117-c1c5-4c2d-9658-914e67649cdd" status: 200 len: 1534 microversion: 2.1 time: 0.282680 Oct 04 20:39:28.999435 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 793/1519] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:28 2022] GET /compute/v2.1/servers/d2173117-c1c5-4c2d-9658-914e67649cdd => generated 1534 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:29.006214 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-eae24654-7938-49e8-9d02-9e51a771c5e9 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:39:29.009044 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-eae24654-7938-49e8-9d02-9e51a771c5e9 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] [instance: a2fc592c-9dac-4f72-8633-229925d3bf76] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:29.016862 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-eae24654-7938-49e8-9d02-9e51a771c5e9 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:29.017352 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-eae24654-7938-49e8-9d02-9e51a771c5e9 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:29.018194 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-eae24654-7938-49e8-9d02-9e51a771c5e9 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:29.018588 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-eae24654-7938-49e8-9d02-9e51a771c5e9 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:29.019213 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-eae24654-7938-49e8-9d02-9e51a771c5e9 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:29.019796 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-eae24654-7938-49e8-9d02-9e51a771c5e9 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:29.048127 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.objects.instance [None req-eae24654-7938-49e8-9d02-9e51a771c5e9 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lazy-loading 'flavor' on Instance uuid a2fc592c-9dac-4f72-8633-229925d3bf76 {{(pid=128802) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:39:29.182389 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:39:29.215705 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-eae24654-7938-49e8-9d02-9e51a771c5e9 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] 10.222.0.33 "POST /compute/v2.1/servers/a2fc592c-9dac-4f72-8633-229925d3bf76/action" status: 200 len: 32 microversion: 2.1 time: 0.214835 Oct 04 20:39:29.216800 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 794/1520] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 20:39:28 2022] POST /compute/v2.1/servers/a2fc592c-9dac-4f72-8633-229925d3bf76/action => generated 32 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 20:39:29.223625 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-d519dc50-01c8-490d-9e9a-a5f5d3052d55 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:29.224493 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-d519dc50-01c8-490d-9e9a-a5f5d3052d55 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] [instance: 23da26ba-68f4-4aef-b13c-0b6588a65e43] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:29.233539 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d519dc50-01c8-490d-9e9a-a5f5d3052d55 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:29.234417 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d519dc50-01c8-490d-9e9a-a5f5d3052d55 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:29.234922 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d519dc50-01c8-490d-9e9a-a5f5d3052d55 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:29.235812 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d519dc50-01c8-490d-9e9a-a5f5d3052d55 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:29.237418 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d519dc50-01c8-490d-9e9a-a5f5d3052d55 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:29.239279 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d519dc50-01c8-490d-9e9a-a5f5d3052d55 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:29.245821 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-134bbafa-1891-461e-9086-d81c98cecf71 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '800db3a57ada47eca381b00189fdbf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66ec8ea91b04deb90b679589e0495bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:29.253468 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-134bbafa-1891-461e-9086-d81c98cecf71 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] 10.222.0.33 "GET /compute/v2.1/servers/83df4756-40e2-4fc6-be48-48a82dd4572a" status: 200 len: 1361 microversion: 2.1 time: 0.313447 Oct 04 20:39:29.254047 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 727/1521] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:28 2022] GET /compute/v2.1/servers/83df4756-40e2-4fc6-be48-48a82dd4572a => generated 1361 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:29.264670 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6c0f791a-7743-437b-83ed-9fa57c10e8d9 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:29.267193 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-6c0f791a-7743-437b-83ed-9fa57c10e8d9 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] [instance: 0dd1d0cf-a3a0-4ea2-8260-ac206bbfac88] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:29.279769 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6c0f791a-7743-437b-83ed-9fa57c10e8d9 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:29.280260 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6c0f791a-7743-437b-83ed-9fa57c10e8d9 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:29.280700 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6c0f791a-7743-437b-83ed-9fa57c10e8d9 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:29.281396 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6c0f791a-7743-437b-83ed-9fa57c10e8d9 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:29.281854 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6c0f791a-7743-437b-83ed-9fa57c10e8d9 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:29.282275 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6c0f791a-7743-437b-83ed-9fa57c10e8d9 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:29.560125 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-6c0f791a-7743-437b-83ed-9fa57c10e8d9 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bdfa818206f4f4b88cc962c1c34adf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4151c9ef7ae04a728306297f58ba5088', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:29.560512 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-d519dc50-01c8-490d-9e9a-a5f5d3052d55 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3563efe2b8c94931a2a46c4e14811b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3118a5d96843d3bede1ed94bd9717e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:29.570935 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-6c0f791a-7743-437b-83ed-9fa57c10e8d9 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] 10.222.0.33 "GET /compute/v2.1/servers/0dd1d0cf-a3a0-4ea2-8260-ac206bbfac88" status: 200 len: 1317 microversion: 2.1 time: 0.315759 Oct 04 20:39:29.572278 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 728/1522] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:29 2022] GET /compute/v2.1/servers/0dd1d0cf-a3a0-4ea2-8260-ac206bbfac88 => generated 1317 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:29.578794 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-45399865-3013-4c4a-a225-42a5bcc55042 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:29.579879 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-45399865-3013-4c4a-a225-42a5bcc55042 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] [instance: a2fc592c-9dac-4f72-8633-229925d3bf76] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:29.586992 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-d519dc50-01c8-490d-9e9a-a5f5d3052d55 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] 10.222.0.33 "GET /compute/v2.1/servers/23da26ba-68f4-4aef-b13c-0b6588a65e43" status: 200 len: 1470 microversion: 2.1 time: 0.359689 Oct 04 20:39:29.588440 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 795/1523] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:29 2022] GET /compute/v2.1/servers/23da26ba-68f4-4aef-b13c-0b6588a65e43 => generated 1470 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:29.591637 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-45399865-3013-4c4a-a225-42a5bcc55042 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:29.592703 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-45399865-3013-4c4a-a225-42a5bcc55042 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:29.593399 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-45399865-3013-4c4a-a225-42a5bcc55042 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:29.593558 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-7b393e94-7627-4b8f-ae33-6a157a4b2011 tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:29.594138 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-7b393e94-7627-4b8f-ae33-6a157a4b2011 tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] [instance: 5ac07e56-084c-4208-a988-13ec91af9171] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:29.594829 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-45399865-3013-4c4a-a225-42a5bcc55042 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:29.595552 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-45399865-3013-4c4a-a225-42a5bcc55042 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:29.597952 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-45399865-3013-4c4a-a225-42a5bcc55042 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:29.605704 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7b393e94-7627-4b8f-ae33-6a157a4b2011 tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:29.611534 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7b393e94-7627-4b8f-ae33-6a157a4b2011 tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:29.612946 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7b393e94-7627-4b8f-ae33-6a157a4b2011 tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:29.614556 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7b393e94-7627-4b8f-ae33-6a157a4b2011 tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:29.615226 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7b393e94-7627-4b8f-ae33-6a157a4b2011 tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:29.615845 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7b393e94-7627-4b8f-ae33-6a157a4b2011 tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:29.775815 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-7b393e94-7627-4b8f-ae33-6a157a4b2011 tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11149c46e1bc468f836fe70635dbf33b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e0d8329b2c4d64bf51d88948ca0de2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:29.788918 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-7b393e94-7627-4b8f-ae33-6a157a4b2011 tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] 10.222.0.33 "GET /compute/v2.1/servers/5ac07e56-084c-4208-a988-13ec91af9171" status: 200 len: 1252 microversion: 2.1 time: 0.198591 Oct 04 20:39:29.790227 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 796/1524] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:29 2022] GET /compute/v2.1/servers/5ac07e56-084c-4208-a988-13ec91af9171 => generated 1252 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:29.794925 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-15df48ad-196b-41e5-af36-e43e1ead3dc9 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:29.795713 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-15df48ad-196b-41e5-af36-e43e1ead3dc9 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] [instance: d9c5805f-6cd2-4993-86b2-8a7546b62dd6] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:29.802930 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-15df48ad-196b-41e5-af36-e43e1ead3dc9 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:29.803656 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-15df48ad-196b-41e5-af36-e43e1ead3dc9 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:29.804279 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-15df48ad-196b-41e5-af36-e43e1ead3dc9 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:29.805187 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-15df48ad-196b-41e5-af36-e43e1ead3dc9 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:29.805825 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-15df48ad-196b-41e5-af36-e43e1ead3dc9 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:29.806697 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-15df48ad-196b-41e5-af36-e43e1ead3dc9 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:30.549963 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-45399865-3013-4c4a-a225-42a5bcc55042 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96919ec99c14864876d64a9c2b20f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b44ce10b78bf49c882c9b4df06187114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:30.561298 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-45399865-3013-4c4a-a225-42a5bcc55042 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] 10.222.0.33 "GET /compute/v2.1/servers/a2fc592c-9dac-4f72-8633-229925d3bf76" status: 200 len: 1504 microversion: 2.1 time: 0.987365 Oct 04 20:39:30.566432 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 729/1525] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:29 2022] GET /compute/v2.1/servers/a2fc592c-9dac-4f72-8633-229925d3bf76 => generated 1504 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:30.573406 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-ac170c0a-7db7-4f1d-8d6e-aed77d488047 req-c4eee86a-271c-43b6-847d-f575c35e3aed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9c5805f-6cd2-4993-86b2-8a7546b62dd6", "tag": "c853f19c-b474-473f-8984-c02e35b0a0e2"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:39:30.598856 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-ac170c0a-7db7-4f1d-8d6e-aed77d488047 req-c4eee86a-271c-43b6-847d-f575c35e3aed service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:30.607652 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-ac170c0a-7db7-4f1d-8d6e-aed77d488047 req-c4eee86a-271c-43b6-847d-f575c35e3aed service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:30.608253 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-ac170c0a-7db7-4f1d-8d6e-aed77d488047 req-c4eee86a-271c-43b6-847d-f575c35e3aed service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:30.632035 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-ac170c0a-7db7-4f1d-8d6e-aed77d488047 req-c4eee86a-271c-43b6-847d-f575c35e3aed service nova] Creating event network-changed:c853f19c-b474-473f-8984-c02e35b0a0e2 for instance d9c5805f-6cd2-4993-86b2-8a7546b62dd6 on n-h2-854823-8 Oct 04 20:39:30.656324 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-ac170c0a-7db7-4f1d-8d6e-aed77d488047 req-c4eee86a-271c-43b6-847d-f575c35e3aed service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088213 Oct 04 20:39:30.657540 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 730/1526] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:39:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:39:30.663596 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b2916da7-f324-4d99-961c-db056d583b6e tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:30.664473 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b2916da7-f324-4d99-961c-db056d583b6e tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] [instance: 81748c83-b703-4c68-899c-c575cc3340d2] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:30.671862 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:39:30.674673 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b2916da7-f324-4d99-961c-db056d583b6e tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:30.681631 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b2916da7-f324-4d99-961c-db056d583b6e tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:30.682328 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b2916da7-f324-4d99-961c-db056d583b6e tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:30.683261 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b2916da7-f324-4d99-961c-db056d583b6e tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:30.683883 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b2916da7-f324-4d99-961c-db056d583b6e tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:30.684469 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b2916da7-f324-4d99-961c-db056d583b6e tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:30.815416 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-15df48ad-196b-41e5-af36-e43e1ead3dc9 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36f4114dc4f443f8b48da7b4027e0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a23a85365414f92bbc03177d7f190e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:30.825112 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-15df48ad-196b-41e5-af36-e43e1ead3dc9 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] 10.222.0.33 "GET /compute/v2.1/servers/d9c5805f-6cd2-4993-86b2-8a7546b62dd6" status: 200 len: 1317 microversion: 2.1 time: 1.033598 Oct 04 20:39:30.829132 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 797/1527] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:29 2022] GET /compute/v2.1/servers/d9c5805f-6cd2-4993-86b2-8a7546b62dd6 => generated 1317 bytes in 1038 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:30.834566 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-7587658c-53bc-4d72-a584-b95c10aac4a4 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:30.843290 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-7587658c-53bc-4d72-a584-b95c10aac4a4 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] [instance: d2173117-c1c5-4c2d-9658-914e67649cdd] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:30.856091 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7587658c-53bc-4d72-a584-b95c10aac4a4 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:30.857240 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7587658c-53bc-4d72-a584-b95c10aac4a4 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:30.858836 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7587658c-53bc-4d72-a584-b95c10aac4a4 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:30.859840 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7587658c-53bc-4d72-a584-b95c10aac4a4 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:30.860514 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7587658c-53bc-4d72-a584-b95c10aac4a4 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:30.861153 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7587658c-53bc-4d72-a584-b95c10aac4a4 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:30.998496 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-b2916da7-f324-4d99-961c-db056d583b6e tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] Lazy-loading 'services' on Instance uuid 81748c83-b703-4c68-899c-c575cc3340d2 {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:39:31.015444 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b2916da7-f324-4d99-961c-db056d583b6e tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/81748c83-b703-4c68-899c-c575cc3340d2" status: 200 len: 2342 microversion: 2.25 time: 0.356469 Oct 04 20:39:31.016666 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 731/1528] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:39:30 2022] GET /compute/v2.1/servers/81748c83-b703-4c68-899c-c575cc3340d2 => generated 2342 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:39:31.022068 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-667abd3d-e7a0-4791-9858-3538d5d95e3d tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:31.023279 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-667abd3d-e7a0-4791-9858-3538d5d95e3d tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] [instance: 83df4756-40e2-4fc6-be48-48a82dd4572a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:31.029871 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-667abd3d-e7a0-4791-9858-3538d5d95e3d tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:31.030613 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-667abd3d-e7a0-4791-9858-3538d5d95e3d tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:31.032562 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-667abd3d-e7a0-4791-9858-3538d5d95e3d tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:31.034390 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-667abd3d-e7a0-4791-9858-3538d5d95e3d tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:31.036854 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-667abd3d-e7a0-4791-9858-3538d5d95e3d tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:31.037470 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-667abd3d-e7a0-4791-9858-3538d5d95e3d tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:31.199775 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-7587658c-53bc-4d72-a584-b95c10aac4a4 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a82c49a62249029ebc6ae3b4829709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecf3793be3eb4f3186c07a7e45fd8f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:31.219145 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-7587658c-53bc-4d72-a584-b95c10aac4a4 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] 10.222.0.33 "GET /compute/v2.1/servers/d2173117-c1c5-4c2d-9658-914e67649cdd" status: 200 len: 1540 microversion: 2.1 time: 0.388699 Oct 04 20:39:31.219738 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 798/1529] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:30 2022] GET /compute/v2.1/servers/d2173117-c1c5-4c2d-9658-914e67649cdd => generated 1540 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:31.225278 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-ab553b1a-e064-4d1b-8ee7-1ee7583b16dd req-0280a010-e042-4711-ab07-337d60e1a0ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83df4756-40e2-4fc6-be48-48a82dd4572a", "name": "network-vif-plugged", "status": "completed", "tag": "df81fac5-fbf3-4eb9-bad4-4478b0098ba4"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:39:31.244884 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-ab553b1a-e064-4d1b-8ee7-1ee7583b16dd req-0280a010-e042-4711-ab07-337d60e1a0ba service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:31.251151 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-ab553b1a-e064-4d1b-8ee7-1ee7583b16dd req-0280a010-e042-4711-ab07-337d60e1a0ba service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:31.251921 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-ab553b1a-e064-4d1b-8ee7-1ee7583b16dd req-0280a010-e042-4711-ab07-337d60e1a0ba service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:31.281138 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-ab553b1a-e064-4d1b-8ee7-1ee7583b16dd req-0280a010-e042-4711-ab07-337d60e1a0ba service nova] Creating event network-vif-plugged:df81fac5-fbf3-4eb9-bad4-4478b0098ba4 for instance 83df4756-40e2-4fc6-be48-48a82dd4572a on n-h1-854823-8 Oct 04 20:39:31.287388 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-ab553b1a-e064-4d1b-8ee7-1ee7583b16dd req-0280a010-e042-4711-ab07-337d60e1a0ba service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066029 Oct 04 20:39:31.288563 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 799/1530] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:39:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:39:31.295596 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-7c8daf06-a114-4b4c-a34c-2d0de39ce658 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:31.304196 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-7c8daf06-a114-4b4c-a34c-2d0de39ce658 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] [instance: 23da26ba-68f4-4aef-b13c-0b6588a65e43] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:31.312650 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7c8daf06-a114-4b4c-a34c-2d0de39ce658 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:31.313604 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7c8daf06-a114-4b4c-a34c-2d0de39ce658 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:31.314208 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7c8daf06-a114-4b4c-a34c-2d0de39ce658 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:31.315162 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7c8daf06-a114-4b4c-a34c-2d0de39ce658 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:31.315823 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7c8daf06-a114-4b4c-a34c-2d0de39ce658 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:31.316493 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7c8daf06-a114-4b4c-a34c-2d0de39ce658 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:31.641039 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-667abd3d-e7a0-4791-9858-3538d5d95e3d tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '800db3a57ada47eca381b00189fdbf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66ec8ea91b04deb90b679589e0495bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:31.649724 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:39:31.653305 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-667abd3d-e7a0-4791-9858-3538d5d95e3d tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] 10.222.0.33 "GET /compute/v2.1/servers/83df4756-40e2-4fc6-be48-48a82dd4572a" status: 200 len: 1361 microversion: 2.1 time: 0.635292 Oct 04 20:39:31.672475 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 732/1531] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:31 2022] GET /compute/v2.1/servers/83df4756-40e2-4fc6-be48-48a82dd4572a => generated 1361 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:31.679860 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-320ba4d4-13cc-44a9-8169-2da0ca4bf4a4 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:31.680486 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-320ba4d4-13cc-44a9-8169-2da0ca4bf4a4 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] [instance: 0dd1d0cf-a3a0-4ea2-8260-ac206bbfac88] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:31.689265 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-320ba4d4-13cc-44a9-8169-2da0ca4bf4a4 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:31.690240 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-320ba4d4-13cc-44a9-8169-2da0ca4bf4a4 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:31.690847 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-320ba4d4-13cc-44a9-8169-2da0ca4bf4a4 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:31.692017 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-320ba4d4-13cc-44a9-8169-2da0ca4bf4a4 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:31.692540 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-320ba4d4-13cc-44a9-8169-2da0ca4bf4a4 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:31.693215 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-320ba4d4-13cc-44a9-8169-2da0ca4bf4a4 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:31.715262 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-7c8daf06-a114-4b4c-a34c-2d0de39ce658 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3563efe2b8c94931a2a46c4e14811b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3118a5d96843d3bede1ed94bd9717e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:31.726063 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-7c8daf06-a114-4b4c-a34c-2d0de39ce658 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] 10.222.0.33 "GET /compute/v2.1/servers/23da26ba-68f4-4aef-b13c-0b6588a65e43" status: 200 len: 1470 microversion: 2.1 time: 0.436055 Oct 04 20:39:31.740225 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 800/1532] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:31 2022] GET /compute/v2.1/servers/23da26ba-68f4-4aef-b13c-0b6588a65e43 => generated 1470 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:31.750553 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-b4fb1372-22ea-4334-8ddd-d8438f20ea8d tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:31.751999 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-b4fb1372-22ea-4334-8ddd-d8438f20ea8d tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] [instance: 5ac07e56-084c-4208-a988-13ec91af9171] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:31.760947 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b4fb1372-22ea-4334-8ddd-d8438f20ea8d tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:31.761996 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b4fb1372-22ea-4334-8ddd-d8438f20ea8d tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:31.762792 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b4fb1372-22ea-4334-8ddd-d8438f20ea8d tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:31.763745 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b4fb1372-22ea-4334-8ddd-d8438f20ea8d tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:31.764461 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b4fb1372-22ea-4334-8ddd-d8438f20ea8d tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:31.765116 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b4fb1372-22ea-4334-8ddd-d8438f20ea8d tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:31.787569 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.wsgi [None req-b4fb1372-22ea-4334-8ddd-d8438f20ea8d tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] HTTP exception thrown: Instance 5ac07e56-084c-4208-a988-13ec91af9171 could not be found. Oct 04 20:39:31.790692 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-b4fb1372-22ea-4334-8ddd-d8438f20ea8d tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Request method failure captured: Oct 04 20:39:31.790692 n-d-854823-8 devstack@n-api.service[128802]: request: GET /compute/v2.1/servers/5ac07e56-084c-4208-a988-13ec91af9171 HTTP/1.1 Oct 04 20:39:31.790692 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 20:39:31.790692 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 20:39:31.790692 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 20:39:31.790692 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 0 Oct 04 20:39:31.790692 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 20:39:31.790692 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 20:39:31.790692 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 20:39:31.790692 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 20:39:31.790692 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPJmFn8QGZ9lRRPNIWBHZFda_HmA-5bskcWJmsvlQS5o_zceyHo7_4W3LtBCnHaHlmllz0j8jDv0Zu4nEE6Yl4RZP9ErEYpBJ4BWiP_OsIIwLSvDf0SfQMbwXKdIt-g97cv_mRpTe-FR-_yiYkert4OSzHWpJADp6LRGiL4DyvKchYNw Oct 04 20:39:31.790692 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 20:39:31.790692 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 20:39:31.790692 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 20:39:31.790692 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 20:39:31.790692 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 20:39:31.790692 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 20:39:31.790692 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: f3e0d8329b2c4d64bf51d88948ca0de2 Oct 04 20:39:31.790692 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-ServersTestBootFromVolume-1645472423 Oct 04 20:39:31.790692 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 20:39:31.790692 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 20:39:31.790692 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f3e0d8329b2c4d64bf51d88948ca0de2", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f3e0d8329b2c4d64bf51d88948ca0de2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f3e0d8329b2c4d64bf51d88948ca0de2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f3e0d8329b2c4d64bf51d88948ca0de2"}]}] Oct 04 20:39:31.790692 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-ServersTestBootFromVolume-1645472423 Oct 04 20:39:31.790692 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: f3e0d8329b2c4d64bf51d88948ca0de2 Oct 04 20:39:31.790692 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-ServersTestBootFromVolume-1645472423 Oct 04 20:39:31.790692 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-ServersTestBootFromVolume-1645472423-project Oct 04 20:39:31.790692 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 20:39:31.790692 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 20:39:31.790692 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: 11149c46e1bc468f836fe70635dbf33b Oct 04 20:39:31.790692 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-ServersTestBootFromVolume-1645472423-project Oct 04 20:39:31.790692 n-d-854823-8 devstack@n-api.service[128802]: method: > Oct 04 20:39:31.790692 n-d-854823-8 devstack@n-api.service[128802]: exception: Instance 5ac07e56-084c-4208-a988-13ec91af9171 could not be found. Oct 04 20:39:31.790692 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'id': '5ac07e56-084c-4208-a988-13ec91af9171'} Oct 04 20:39:31.790692 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:39:31.790692 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:39:31.790692 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:39:31.790692 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:39:31.790692 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:39:31.790692 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:39:31.790692 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:39:31.790692 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:39:31.790692 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:39:31.790692 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:39:31.790692 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ac07e56-084c-4208-a988-13ec91af9171 could not be found. Oct 04 20:39:31.790692 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:39:31.790692 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:39:31.790692 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:39:31.790692 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:39:31.790692 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:39:31.790692 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:39:31.790692 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:39:31.790692 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:39:31.790692 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:39:31.790692 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:39:31.790692 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:39:31.790692 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:39:31.790692 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:39:31.790692 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:39:31.790692 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:39:31.790692 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:39:31.790692 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ac07e56-084c-4208-a988-13ec91af9171 could not be found. Oct 04 20:39:31.790692 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:39:31.790692 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:39:31.790692 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:39:31.798280 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:39:31.798280 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:39:31.798280 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:39:31.798280 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:39:31.798280 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:39:31.798280 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ac07e56-084c-4208-a988-13ec91af9171 could not be found. Oct 04 20:39:31.798280 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:39:31.800367 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-b4fb1372-22ea-4334-8ddd-d8438f20ea8d tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Returning 404 to user: Instance 5ac07e56-084c-4208-a988-13ec91af9171 could not be found. {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:39:31.801615 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-b4fb1372-22ea-4334-8ddd-d8438f20ea8d tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] 10.222.0.33 "GET /compute/v2.1/servers/5ac07e56-084c-4208-a988-13ec91af9171" status: 404 len: 111 microversion: 2.1 time: 0.058700 Oct 04 20:39:31.802691 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 801/1533] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:31 2022] GET /compute/v2.1/servers/5ac07e56-084c-4208-a988-13ec91af9171 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:39:31.807799 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-58aa0e76-3106-45fc-948b-d2f650ee8074 tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:31.813150 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-58aa0e76-3106-45fc-948b-d2f650ee8074 tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:31.813986 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-58aa0e76-3106-45fc-948b-d2f650ee8074 tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:31.814817 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-58aa0e76-3106-45fc-948b-d2f650ee8074 tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:31.815961 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-58aa0e76-3106-45fc-948b-d2f650ee8074 tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:31.817063 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-58aa0e76-3106-45fc-948b-d2f650ee8074 tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:31.817725 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-58aa0e76-3106-45fc-948b-d2f650ee8074 tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:31.854933 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-58aa0e76-3106-45fc-948b-d2f650ee8074 tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.050850 Oct 04 20:39:31.866656 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 802/1534] 10.222.0.33 () {60 vars in 1217 bytes} [Tue Oct 4 20:39:31 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 20:39:31.873754 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-01f35ea6-17db-41ef-bc80-31655b7db7f1 req-be0eb397-7356-46a6-947e-7400bb1caa5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23da26ba-68f4-4aef-b13c-0b6588a65e43", "name": "network-vif-unplugged", "status": "completed", "tag": "f692dbdb-9498-4986-a253-420f090b704f"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:39:31.886198 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-01f35ea6-17db-41ef-bc80-31655b7db7f1 req-be0eb397-7356-46a6-947e-7400bb1caa5e service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:31.886858 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-01f35ea6-17db-41ef-bc80-31655b7db7f1 req-be0eb397-7356-46a6-947e-7400bb1caa5e service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:31.887292 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-01f35ea6-17db-41ef-bc80-31655b7db7f1 req-be0eb397-7356-46a6-947e-7400bb1caa5e service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:31.907415 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-01f35ea6-17db-41ef-bc80-31655b7db7f1 req-be0eb397-7356-46a6-947e-7400bb1caa5e service nova] Creating event network-vif-unplugged:f692dbdb-9498-4986-a253-420f090b704f for instance 23da26ba-68f4-4aef-b13c-0b6588a65e43 on n-h1-854823-8 Oct 04 20:39:31.916853 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [req-01f35ea6-17db-41ef-bc80-31655b7db7f1 req-be0eb397-7356-46a6-947e-7400bb1caa5e service nova] Instance 23da26ba-68f4-4aef-b13c-0b6588a65e43 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854823-8', 'n-h2-854823-8'} {{(pid=128802) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 20:39:31.929774 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-01f35ea6-17db-41ef-bc80-31655b7db7f1 req-be0eb397-7356-46a6-947e-7400bb1caa5e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.061613 Oct 04 20:39:31.930394 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 803/1535] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:39:31 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:39:31.937881 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-9de001ef-a752-45c1-8a31-9bbcca0fd086 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:31.938981 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-9de001ef-a752-45c1-8a31-9bbcca0fd086 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] [instance: a2fc592c-9dac-4f72-8633-229925d3bf76] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:31.948569 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9de001ef-a752-45c1-8a31-9bbcca0fd086 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:31.949279 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9de001ef-a752-45c1-8a31-9bbcca0fd086 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:31.949923 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9de001ef-a752-45c1-8a31-9bbcca0fd086 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:31.950976 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9de001ef-a752-45c1-8a31-9bbcca0fd086 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:31.952339 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9de001ef-a752-45c1-8a31-9bbcca0fd086 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:31.953229 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9de001ef-a752-45c1-8a31-9bbcca0fd086 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:31.977314 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-320ba4d4-13cc-44a9-8169-2da0ca4bf4a4 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bdfa818206f4f4b88cc962c1c34adf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4151c9ef7ae04a728306297f58ba5088', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:31.988726 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-320ba4d4-13cc-44a9-8169-2da0ca4bf4a4 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] 10.222.0.33 "GET /compute/v2.1/servers/0dd1d0cf-a3a0-4ea2-8260-ac206bbfac88" status: 200 len: 1467 microversion: 2.1 time: 0.314249 Oct 04 20:39:31.989880 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 733/1536] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:31 2022] GET /compute/v2.1/servers/0dd1d0cf-a3a0-4ea2-8260-ac206bbfac88 => generated 1467 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:31.995301 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-34d4ed64-3391-4eca-b112-466bd7541555 tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] Calling method '.version_select at 0x7f3c75723d30>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:32.039327 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-34d4ed64-3391-4eca-b112-466bd7541555 tempest-ServersTestBootFromVolume-1645472423 tempest-ServersTestBootFromVolume-1645472423-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1873046423" status: 202 len: 0 microversion: 2.1 time: 0.047412 Oct 04 20:39:32.040381 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 734/1537] 10.222.0.33 () {58 vars in 1221 bytes} [Tue Oct 4 20:39:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1873046423 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:39:32.060757 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-3bfb4fd4-60bf-4066-a45f-85268708443b tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:32.061373 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-3bfb4fd4-60bf-4066-a45f-85268708443b tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] [instance: d9c5805f-6cd2-4993-86b2-8a7546b62dd6] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:32.074868 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3bfb4fd4-60bf-4066-a45f-85268708443b tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:32.075483 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3bfb4fd4-60bf-4066-a45f-85268708443b tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:32.077734 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3bfb4fd4-60bf-4066-a45f-85268708443b tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:32.078776 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3bfb4fd4-60bf-4066-a45f-85268708443b tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:32.081890 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3bfb4fd4-60bf-4066-a45f-85268708443b tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:32.082634 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3bfb4fd4-60bf-4066-a45f-85268708443b tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:32.256745 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell0:SELECT=18 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:39:32.484945 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-9de001ef-a752-45c1-8a31-9bbcca0fd086 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96919ec99c14864876d64a9c2b20f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b44ce10b78bf49c882c9b4df06187114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:32.504946 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-9de001ef-a752-45c1-8a31-9bbcca0fd086 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] 10.222.0.33 "GET /compute/v2.1/servers/a2fc592c-9dac-4f72-8633-229925d3bf76" status: 200 len: 1504 microversion: 2.1 time: 0.572840 Oct 04 20:39:32.510392 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 804/1538] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:31 2022] GET /compute/v2.1/servers/a2fc592c-9dac-4f72-8633-229925d3bf76 => generated 1504 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:32.516258 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-6493cbff-3e33-4611-9647-cffbf48cdf37 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-image-427609593", "metadata": {"image_type": "test"}}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:39:32.527319 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-6493cbff-3e33-4611-9647-cffbf48cdf37 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] [instance: 0dd1d0cf-a3a0-4ea2-8260-ac206bbfac88] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:32.537706 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6493cbff-3e33-4611-9647-cffbf48cdf37 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:32.538142 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6493cbff-3e33-4611-9647-cffbf48cdf37 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:32.538725 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6493cbff-3e33-4611-9647-cffbf48cdf37 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:32.541386 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6493cbff-3e33-4611-9647-cffbf48cdf37 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:32.541386 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6493cbff-3e33-4611-9647-cffbf48cdf37 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:32.541386 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6493cbff-3e33-4611-9647-cffbf48cdf37 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:32.555702 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-3bfb4fd4-60bf-4066-a45f-85268708443b tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36f4114dc4f443f8b48da7b4027e0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a23a85365414f92bbc03177d7f190e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:32.568035 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-3bfb4fd4-60bf-4066-a45f-85268708443b tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] 10.222.0.33 "GET /compute/v2.1/servers/d9c5805f-6cd2-4993-86b2-8a7546b62dd6" status: 200 len: 1317 microversion: 2.1 time: 0.526237 Oct 04 20:39:32.569029 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 735/1539] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:32 2022] GET /compute/v2.1/servers/d9c5805f-6cd2-4993-86b2-8a7546b62dd6 => generated 1317 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:32.575532 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d02e6bc5-3c46-4a61-b3ea-0cac5876c23b tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:32.576156 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d02e6bc5-3c46-4a61-b3ea-0cac5876c23b tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] [instance: d2173117-c1c5-4c2d-9658-914e67649cdd] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:32.585878 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d02e6bc5-3c46-4a61-b3ea-0cac5876c23b tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:32.586526 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d02e6bc5-3c46-4a61-b3ea-0cac5876c23b tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:32.587246 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d02e6bc5-3c46-4a61-b3ea-0cac5876c23b tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:32.587964 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d02e6bc5-3c46-4a61-b3ea-0cac5876c23b tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:32.589015 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d02e6bc5-3c46-4a61-b3ea-0cac5876c23b tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:32.589668 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d02e6bc5-3c46-4a61-b3ea-0cac5876c23b tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:32.629962 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-6493cbff-3e33-4611-9647-cffbf48cdf37 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Getting quotas for project 4151c9ef7ae04a728306297f58ba5088. Resources: dict_keys(['metadata_items']) {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:39:32.643200 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-6493cbff-3e33-4611-9647-cffbf48cdf37 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Getting quotas for user 7bdfa818206f4f4b88cc962c1c34adf3 and project 4151c9ef7ae04a728306297f58ba5088. Resources: dict_keys(['metadata_items']) {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:39:32.991335 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d02e6bc5-3c46-4a61-b3ea-0cac5876c23b tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a82c49a62249029ebc6ae3b4829709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecf3793be3eb4f3186c07a7e45fd8f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:33.000184 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-6493cbff-3e33-4611-9647-cffbf48cdf37 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] 10.222.0.33 "POST /compute/v2.1/servers/0dd1d0cf-a3a0-4ea2-8260-ac206bbfac88/action" status: 202 len: 0 microversion: 2.1 time: 0.492699 Oct 04 20:39:33.000840 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 805/1540] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 20:39:32 2022] POST /compute/v2.1/servers/0dd1d0cf-a3a0-4ea2-8260-ac206bbfac88/action => generated 0 bytes in 494 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 04 20:39:33.007308 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d02e6bc5-3c46-4a61-b3ea-0cac5876c23b tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] 10.222.0.33 "GET /compute/v2.1/servers/d2173117-c1c5-4c2d-9658-914e67649cdd" status: 200 len: 1522 microversion: 2.1 time: 0.436689 Oct 04 20:39:33.019798 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-51e0772c-ebe6-4be2-833c-344509b9b0b3 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:33.020901 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-51e0772c-ebe6-4be2-833c-344509b9b0b3 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] [instance: 83df4756-40e2-4fc6-be48-48a82dd4572a] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:33.023551 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 736/1541] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:32 2022] GET /compute/v2.1/servers/d2173117-c1c5-4c2d-9658-914e67649cdd => generated 1522 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:33.036689 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-11a00c20-51a4-4174-b5d1-fd81c7b20b71 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:33.037758 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-11a00c20-51a4-4174-b5d1-fd81c7b20b71 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] [instance: 23da26ba-68f4-4aef-b13c-0b6588a65e43] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:33.047917 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-51e0772c-ebe6-4be2-833c-344509b9b0b3 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:33.049560 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-51e0772c-ebe6-4be2-833c-344509b9b0b3 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:33.050144 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-51e0772c-ebe6-4be2-833c-344509b9b0b3 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:33.050980 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-51e0772c-ebe6-4be2-833c-344509b9b0b3 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:33.051455 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-51e0772c-ebe6-4be2-833c-344509b9b0b3 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:33.051880 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-51e0772c-ebe6-4be2-833c-344509b9b0b3 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:33.055382 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-11a00c20-51a4-4174-b5d1-fd81c7b20b71 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:33.055882 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-11a00c20-51a4-4174-b5d1-fd81c7b20b71 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:33.056324 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-11a00c20-51a4-4174-b5d1-fd81c7b20b71 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:33.057037 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-11a00c20-51a4-4174-b5d1-fd81c7b20b71 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:33.057495 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-11a00c20-51a4-4174-b5d1-fd81c7b20b71 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:33.058074 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-11a00c20-51a4-4174-b5d1-fd81c7b20b71 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:33.358232 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-11a00c20-51a4-4174-b5d1-fd81c7b20b71 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3563efe2b8c94931a2a46c4e14811b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3118a5d96843d3bede1ed94bd9717e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:33.364917 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-51e0772c-ebe6-4be2-833c-344509b9b0b3 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '800db3a57ada47eca381b00189fdbf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66ec8ea91b04deb90b679589e0495bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:33.379464 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-51e0772c-ebe6-4be2-833c-344509b9b0b3 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] 10.222.0.33 "GET /compute/v2.1/servers/83df4756-40e2-4fc6-be48-48a82dd4572a" status: 200 len: 1361 microversion: 2.1 time: 0.372525 Oct 04 20:39:33.380549 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 806/1542] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:33 2022] GET /compute/v2.1/servers/83df4756-40e2-4fc6-be48-48a82dd4572a => generated 1361 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:33.387522 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-bcf6fd50-2a45-44b1-a2ba-b3e1fdaf7ff0 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Calling method '.version_select at 0x7f3c746629d0>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:33.388578 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-11a00c20-51a4-4174-b5d1-fd81c7b20b71 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] 10.222.0.33 "GET /compute/v2.1/servers/23da26ba-68f4-4aef-b13c-0b6588a65e43" status: 200 len: 1470 microversion: 2.1 time: 0.363593 Oct 04 20:39:33.397173 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 737/1543] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:33 2022] GET /compute/v2.1/servers/23da26ba-68f4-4aef-b13c-0b6588a65e43 => generated 1470 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:33.413606 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a68082fd-fa21-4ea8-90c2-d84c93299446 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:33.414036 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a68082fd-fa21-4ea8-90c2-d84c93299446 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] [instance: d2173117-c1c5-4c2d-9658-914e67649cdd] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:33.420216 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a68082fd-fa21-4ea8-90c2-d84c93299446 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:33.420880 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a68082fd-fa21-4ea8-90c2-d84c93299446 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:33.422282 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a68082fd-fa21-4ea8-90c2-d84c93299446 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:33.423039 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a68082fd-fa21-4ea8-90c2-d84c93299446 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:33.423865 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a68082fd-fa21-4ea8-90c2-d84c93299446 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:33.424414 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a68082fd-fa21-4ea8-90c2-d84c93299446 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:33.459428 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a68082fd-fa21-4ea8-90c2-d84c93299446 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] [instance: d2173117-c1c5-4c2d-9658-914e67649cdd] Going to try to terminate instance {{(pid=128801) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:39:33.461282 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-bcf6fd50-2a45-44b1-a2ba-b3e1fdaf7ff0 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] 10.222.0.33 "GET /compute/v2.1/images/4ceaa94c-0232-4808-b979-89d23cbd895c" status: 200 len: 1421 microversion: 2.1 time: 0.079203 Oct 04 20:39:33.462586 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 807/1544] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 20:39:33 2022] GET /compute/v2.1/images/4ceaa94c-0232-4808-b979-89d23cbd895c => generated 1421 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:33.467988 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-18970653-f1bd-437d-9e1f-fb88d9f668cd req-3d429b39-d40d-4eee-bf8c-36b64a3f2638 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2173117-c1c5-4c2d-9658-914e67649cdd", "name": "network-vif-plugged", "status": "completed", "tag": "5f97afab-20db-4d1c-9da9-8ce948bd87f0"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:39:33.479380 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-18970653-f1bd-437d-9e1f-fb88d9f668cd req-3d429b39-d40d-4eee-bf8c-36b64a3f2638 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:33.480504 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-18970653-f1bd-437d-9e1f-fb88d9f668cd req-3d429b39-d40d-4eee-bf8c-36b64a3f2638 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:33.481088 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-18970653-f1bd-437d-9e1f-fb88d9f668cd req-3d429b39-d40d-4eee-bf8c-36b64a3f2638 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:33.497134 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-18970653-f1bd-437d-9e1f-fb88d9f668cd req-3d429b39-d40d-4eee-bf8c-36b64a3f2638 service nova] Creating event network-vif-plugged:5f97afab-20db-4d1c-9da9-8ce948bd87f0 for instance d2173117-c1c5-4c2d-9658-914e67649cdd on n-h1-854823-8 Oct 04 20:39:33.503836 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-18970653-f1bd-437d-9e1f-fb88d9f668cd req-3d429b39-d40d-4eee-bf8c-36b64a3f2638 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039214 Oct 04 20:39:33.504835 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 808/1545] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:39:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:39:33.535673 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-3efd0df6-cd16-4606-b4ab-67a5bcc2e77e tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:33.537128 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-3efd0df6-cd16-4606-b4ab-67a5bcc2e77e tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] [instance: a2fc592c-9dac-4f72-8633-229925d3bf76] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:33.544304 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3efd0df6-cd16-4606-b4ab-67a5bcc2e77e tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:33.545127 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3efd0df6-cd16-4606-b4ab-67a5bcc2e77e tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:33.546088 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3efd0df6-cd16-4606-b4ab-67a5bcc2e77e tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:33.547814 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3efd0df6-cd16-4606-b4ab-67a5bcc2e77e tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:33.548119 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3efd0df6-cd16-4606-b4ab-67a5bcc2e77e tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:33.554265 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3efd0df6-cd16-4606-b4ab-67a5bcc2e77e tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:33.611338 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a68082fd-fa21-4ea8-90c2-d84c93299446 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] 10.222.0.33 "DELETE /compute/v2.1/servers/d2173117-c1c5-4c2d-9658-914e67649cdd" status: 204 len: 0 microversion: 2.1 time: 0.212478 Oct 04 20:39:33.613543 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 738/1546] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 20:39:33 2022] DELETE /compute/v2.1/servers/d2173117-c1c5-4c2d-9658-914e67649cdd => generated 0 bytes in 216 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:39:33.620491 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5b127efe-4f9c-41fe-a42b-29832862a5ae tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:33.621525 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-5b127efe-4f9c-41fe-a42b-29832862a5ae tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] [instance: d9c5805f-6cd2-4993-86b2-8a7546b62dd6] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:33.630948 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5b127efe-4f9c-41fe-a42b-29832862a5ae tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:33.652236 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5b127efe-4f9c-41fe-a42b-29832862a5ae tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:33.653940 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5b127efe-4f9c-41fe-a42b-29832862a5ae tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:33.654795 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5b127efe-4f9c-41fe-a42b-29832862a5ae tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:33.662449 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5b127efe-4f9c-41fe-a42b-29832862a5ae tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:33.663026 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5b127efe-4f9c-41fe-a42b-29832862a5ae tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:34.121122 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-3efd0df6-cd16-4606-b4ab-67a5bcc2e77e tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96919ec99c14864876d64a9c2b20f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b44ce10b78bf49c882c9b4df06187114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:34.134619 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-3efd0df6-cd16-4606-b4ab-67a5bcc2e77e tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] 10.222.0.33 "GET /compute/v2.1/servers/a2fc592c-9dac-4f72-8633-229925d3bf76" status: 200 len: 1504 microversion: 2.1 time: 0.607315 Oct 04 20:39:34.136462 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 809/1547] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:33 2022] GET /compute/v2.1/servers/a2fc592c-9dac-4f72-8633-229925d3bf76 => generated 1504 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:34.147073 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-63d98989-7260-4ad1-bf53-3146bf1037db tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:34.149782 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-63d98989-7260-4ad1-bf53-3146bf1037db tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] [instance: d2173117-c1c5-4c2d-9658-914e67649cdd] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:34.169804 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-63d98989-7260-4ad1-bf53-3146bf1037db tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:34.170597 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-63d98989-7260-4ad1-bf53-3146bf1037db tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:34.171298 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-63d98989-7260-4ad1-bf53-3146bf1037db tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:34.175079 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-63d98989-7260-4ad1-bf53-3146bf1037db tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:34.175811 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-63d98989-7260-4ad1-bf53-3146bf1037db tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:34.177935 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-63d98989-7260-4ad1-bf53-3146bf1037db tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:34.191356 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-5b127efe-4f9c-41fe-a42b-29832862a5ae tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36f4114dc4f443f8b48da7b4027e0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a23a85365414f92bbc03177d7f190e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:34.209954 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5b127efe-4f9c-41fe-a42b-29832862a5ae tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] 10.222.0.33 "GET /compute/v2.1/servers/d9c5805f-6cd2-4993-86b2-8a7546b62dd6" status: 200 len: 1317 microversion: 2.1 time: 0.594359 Oct 04 20:39:34.212175 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 739/1548] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:33 2022] GET /compute/v2.1/servers/d9c5805f-6cd2-4993-86b2-8a7546b62dd6 => generated 1317 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:34.224700 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-6cd09d91-8165-465b-bbe1-5c68d9d90d15 req-928fb397-9e60-4b06-9642-4ec55181a707 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23da26ba-68f4-4aef-b13c-0b6588a65e43", "tag": "f692dbdb-9498-4986-a253-420f090b704f"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:39:34.250446 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-6cd09d91-8165-465b-bbe1-5c68d9d90d15 req-928fb397-9e60-4b06-9642-4ec55181a707 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:34.250934 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-6cd09d91-8165-465b-bbe1-5c68d9d90d15 req-928fb397-9e60-4b06-9642-4ec55181a707 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:34.251545 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-6cd09d91-8165-465b-bbe1-5c68d9d90d15 req-928fb397-9e60-4b06-9642-4ec55181a707 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:34.264674 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-6cd09d91-8165-465b-bbe1-5c68d9d90d15 req-928fb397-9e60-4b06-9642-4ec55181a707 service nova] Creating event network-changed:f692dbdb-9498-4986-a253-420f090b704f for instance 23da26ba-68f4-4aef-b13c-0b6588a65e43 on n-h1-854823-8 Oct 04 20:39:34.271877 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [req-6cd09d91-8165-465b-bbe1-5c68d9d90d15 req-928fb397-9e60-4b06-9642-4ec55181a707 service nova] Instance 23da26ba-68f4-4aef-b13c-0b6588a65e43 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854823-8', 'n-h2-854823-8'} {{(pid=128801) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 20:39:34.284567 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-6cd09d91-8165-465b-bbe1-5c68d9d90d15 req-928fb397-9e60-4b06-9642-4ec55181a707 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069772 Oct 04 20:39:34.286093 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 740/1549] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:39:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:39:34.422924 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-06203089-e063-4a53-bb0c-fd9ee90efaab tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:34.424672 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-06203089-e063-4a53-bb0c-fd9ee90efaab tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] [instance: 83df4756-40e2-4fc6-be48-48a82dd4572a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:34.434928 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-06203089-e063-4a53-bb0c-fd9ee90efaab tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:34.435742 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-06203089-e063-4a53-bb0c-fd9ee90efaab tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:34.436645 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-06203089-e063-4a53-bb0c-fd9ee90efaab tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:34.437813 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-06203089-e063-4a53-bb0c-fd9ee90efaab tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:34.438870 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-06203089-e063-4a53-bb0c-fd9ee90efaab tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:34.439549 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-06203089-e063-4a53-bb0c-fd9ee90efaab tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:34.583890 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-63d98989-7260-4ad1-bf53-3146bf1037db tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a82c49a62249029ebc6ae3b4829709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecf3793be3eb4f3186c07a7e45fd8f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:34.593074 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-63d98989-7260-4ad1-bf53-3146bf1037db tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] 10.222.0.33 "GET /compute/v2.1/servers/d2173117-c1c5-4c2d-9658-914e67649cdd" status: 200 len: 1528 microversion: 2.1 time: 0.454919 Oct 04 20:39:34.610629 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 810/1550] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:34 2022] GET /compute/v2.1/servers/d2173117-c1c5-4c2d-9658-914e67649cdd => generated 1528 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:34.618874 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-8342bb0a-e1aa-4710-b7ee-9442368a4812 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:34.619490 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-8342bb0a-e1aa-4710-b7ee-9442368a4812 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] [instance: 23da26ba-68f4-4aef-b13c-0b6588a65e43] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:34.641931 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8342bb0a-e1aa-4710-b7ee-9442368a4812 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:34.643472 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8342bb0a-e1aa-4710-b7ee-9442368a4812 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:34.643890 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8342bb0a-e1aa-4710-b7ee-9442368a4812 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:34.645090 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8342bb0a-e1aa-4710-b7ee-9442368a4812 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:34.645090 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8342bb0a-e1aa-4710-b7ee-9442368a4812 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:34.645754 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8342bb0a-e1aa-4710-b7ee-9442368a4812 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:35.177162 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-06203089-e063-4a53-bb0c-fd9ee90efaab tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '800db3a57ada47eca381b00189fdbf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66ec8ea91b04deb90b679589e0495bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:35.192133 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-06203089-e063-4a53-bb0c-fd9ee90efaab tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] 10.222.0.33 "GET /compute/v2.1/servers/83df4756-40e2-4fc6-be48-48a82dd4572a" status: 200 len: 1361 microversion: 2.1 time: 0.776529 Oct 04 20:39:35.193524 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 741/1551] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:34 2022] GET /compute/v2.1/servers/83df4756-40e2-4fc6-be48-48a82dd4572a => generated 1361 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:35.198654 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6dcfdac5-2f7f-43b6-96cb-c62659e5bc28 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Calling method '.version_select at 0x7f3c746ca160>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:35.262003 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-6dcfdac5-2f7f-43b6-96cb-c62659e5bc28 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] 10.222.0.33 "GET /compute/v2.1/images/4ceaa94c-0232-4808-b979-89d23cbd895c" status: 200 len: 1421 microversion: 2.1 time: 0.067178 Oct 04 20:39:35.270755 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 742/1552] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 20:39:35 2022] GET /compute/v2.1/images/4ceaa94c-0232-4808-b979-89d23cbd895c => generated 1421 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:35.276816 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1ff96e41-c03b-46fd-9d4a-c762ee9357ba tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3e5147bd-5a5b-494f-afff-2b8b3942acb4", "device": "/dev/xvdb"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:39:35.280194 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-1ff96e41-c03b-46fd-9d4a-c762ee9357ba tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] [instance: 81748c83-b703-4c68-899c-c575cc3340d2] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:35.288083 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1ff96e41-c03b-46fd-9d4a-c762ee9357ba tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:35.288672 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1ff96e41-c03b-46fd-9d4a-c762ee9357ba tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:35.289353 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1ff96e41-c03b-46fd-9d4a-c762ee9357ba tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:35.290375 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1ff96e41-c03b-46fd-9d4a-c762ee9357ba tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:35.291089 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1ff96e41-c03b-46fd-9d4a-c762ee9357ba tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:35.291618 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1ff96e41-c03b-46fd-9d4a-c762ee9357ba tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:35.294841 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-8342bb0a-e1aa-4710-b7ee-9442368a4812 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3563efe2b8c94931a2a46c4e14811b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3118a5d96843d3bede1ed94bd9717e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:35.304711 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-8342bb0a-e1aa-4710-b7ee-9442368a4812 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] 10.222.0.33 "GET /compute/v2.1/servers/23da26ba-68f4-4aef-b13c-0b6588a65e43" status: 200 len: 1470 microversion: 2.1 time: 0.692923 Oct 04 20:39:35.312390 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 811/1553] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:34 2022] GET /compute/v2.1/servers/23da26ba-68f4-4aef-b13c-0b6588a65e43 => generated 1470 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:35.317913 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-6ecaa9d1-663f-4537-bfef-19143d345871 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:35.318870 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-6ecaa9d1-663f-4537-bfef-19143d345871 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] [instance: a2fc592c-9dac-4f72-8633-229925d3bf76] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:35.326967 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6ecaa9d1-663f-4537-bfef-19143d345871 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:35.327655 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6ecaa9d1-663f-4537-bfef-19143d345871 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:35.328087 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6ecaa9d1-663f-4537-bfef-19143d345871 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:35.328814 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6ecaa9d1-663f-4537-bfef-19143d345871 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:35.329431 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6ecaa9d1-663f-4537-bfef-19143d345871 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:35.329955 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6ecaa9d1-663f-4537-bfef-19143d345871 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:35.493761 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-6ecaa9d1-663f-4537-bfef-19143d345871 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96919ec99c14864876d64a9c2b20f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b44ce10b78bf49c882c9b4df06187114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:35.497077 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:39:35.504368 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-6ecaa9d1-663f-4537-bfef-19143d345871 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] 10.222.0.33 "GET /compute/v2.1/servers/a2fc592c-9dac-4f72-8633-229925d3bf76" status: 200 len: 1504 microversion: 2.1 time: 0.193049 Oct 04 20:39:35.505112 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 812/1554] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:35 2022] GET /compute/v2.1/servers/a2fc592c-9dac-4f72-8633-229925d3bf76 => generated 1504 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:35.512351 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-6248dbe3-0474-4b4c-a0ad-91cb44c502c1 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:35.513168 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-6248dbe3-0474-4b4c-a0ad-91cb44c502c1 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] [instance: d9c5805f-6cd2-4993-86b2-8a7546b62dd6] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:35.522393 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6248dbe3-0474-4b4c-a0ad-91cb44c502c1 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:35.522886 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6248dbe3-0474-4b4c-a0ad-91cb44c502c1 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:35.524596 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6248dbe3-0474-4b4c-a0ad-91cb44c502c1 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:35.524596 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6248dbe3-0474-4b4c-a0ad-91cb44c502c1 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:35.524596 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6248dbe3-0474-4b4c-a0ad-91cb44c502c1 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:35.525005 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6248dbe3-0474-4b4c-a0ad-91cb44c502c1 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:35.629745 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-1ff96e41-c03b-46fd-9d4a-c762ee9357ba tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] 10.222.0.33 "POST /compute/v2.1/servers/81748c83-b703-4c68-899c-c575cc3340d2/os-volume_attachments" status: 200 len: 194 microversion: 2.25 time: 0.357031 Oct 04 20:39:35.630669 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 743/1555] 10.222.0.33 () {62 vars in 1364 bytes} [Tue Oct 4 20:39:35 2022] POST /compute/v2.1/servers/81748c83-b703-4c68-899c-c575cc3340d2/os-volume_attachments => generated 194 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 20:39:35.656695 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-24c1a036-dd67-43bb-bd6a-0c11cea0de59 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:35.659661 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-24c1a036-dd67-43bb-bd6a-0c11cea0de59 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] [instance: d2173117-c1c5-4c2d-9658-914e67649cdd] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:35.671747 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-24c1a036-dd67-43bb-bd6a-0c11cea0de59 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:35.672265 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-24c1a036-dd67-43bb-bd6a-0c11cea0de59 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:35.672697 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-24c1a036-dd67-43bb-bd6a-0c11cea0de59 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:35.673404 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-24c1a036-dd67-43bb-bd6a-0c11cea0de59 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:35.673852 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-24c1a036-dd67-43bb-bd6a-0c11cea0de59 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:35.680774 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-24c1a036-dd67-43bb-bd6a-0c11cea0de59 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:35.698596 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-6248dbe3-0474-4b4c-a0ad-91cb44c502c1 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36f4114dc4f443f8b48da7b4027e0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a23a85365414f92bbc03177d7f190e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:35.716618 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-6248dbe3-0474-4b4c-a0ad-91cb44c502c1 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] 10.222.0.33 "GET /compute/v2.1/servers/d9c5805f-6cd2-4993-86b2-8a7546b62dd6" status: 200 len: 1317 microversion: 2.1 time: 0.208223 Oct 04 20:39:35.716901 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 813/1556] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:35 2022] GET /compute/v2.1/servers/d9c5805f-6cd2-4993-86b2-8a7546b62dd6 => generated 1317 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:35.856275 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-24c1a036-dd67-43bb-bd6a-0c11cea0de59 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a82c49a62249029ebc6ae3b4829709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecf3793be3eb4f3186c07a7e45fd8f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:35.869282 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-24c1a036-dd67-43bb-bd6a-0c11cea0de59 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] 10.222.0.33 "GET /compute/v2.1/servers/d2173117-c1c5-4c2d-9658-914e67649cdd" status: 200 len: 1528 microversion: 2.1 time: 0.237355 Oct 04 20:39:35.870310 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 744/1557] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:35 2022] GET /compute/v2.1/servers/d2173117-c1c5-4c2d-9658-914e67649cdd => generated 1528 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:36.038028 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-245ac31e-2ae4-4274-be4c-4e90f2ed2a85 req-13fde33f-25c4-49ea-ae1b-adf41c9fa760 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9c5805f-6cd2-4993-86b2-8a7546b62dd6", "name": "network-vif-plugged", "status": "completed", "tag": "c853f19c-b474-473f-8984-c02e35b0a0e2"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:39:36.050373 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-245ac31e-2ae4-4274-be4c-4e90f2ed2a85 req-13fde33f-25c4-49ea-ae1b-adf41c9fa760 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:36.050938 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-245ac31e-2ae4-4274-be4c-4e90f2ed2a85 req-13fde33f-25c4-49ea-ae1b-adf41c9fa760 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:36.051446 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-245ac31e-2ae4-4274-be4c-4e90f2ed2a85 req-13fde33f-25c4-49ea-ae1b-adf41c9fa760 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:36.064447 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-245ac31e-2ae4-4274-be4c-4e90f2ed2a85 req-13fde33f-25c4-49ea-ae1b-adf41c9fa760 service nova] Creating event network-vif-plugged:c853f19c-b474-473f-8984-c02e35b0a0e2 for instance d9c5805f-6cd2-4993-86b2-8a7546b62dd6 on n-h2-854823-8 Oct 04 20:39:36.070045 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-245ac31e-2ae4-4274-be4c-4e90f2ed2a85 req-13fde33f-25c4-49ea-ae1b-adf41c9fa760 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035893 Oct 04 20:39:36.071265 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 814/1558] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:39:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:39:36.217246 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-cfb5fcf4-3a58-4d50-8601-bc13a468760f tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:36.218478 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-cfb5fcf4-3a58-4d50-8601-bc13a468760f tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] [instance: 83df4756-40e2-4fc6-be48-48a82dd4572a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:36.226791 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cfb5fcf4-3a58-4d50-8601-bc13a468760f tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:36.227594 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cfb5fcf4-3a58-4d50-8601-bc13a468760f tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:36.228387 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cfb5fcf4-3a58-4d50-8601-bc13a468760f tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:36.229331 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cfb5fcf4-3a58-4d50-8601-bc13a468760f tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:36.230037 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cfb5fcf4-3a58-4d50-8601-bc13a468760f tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:36.230720 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cfb5fcf4-3a58-4d50-8601-bc13a468760f tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:36.279670 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-26c5c265-272e-48be-b887-d3be75a166d8 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Calling method '.version_select at 0x7f3c744bcf70>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:36.338503 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-26c5c265-272e-48be-b887-d3be75a166d8 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] 10.222.0.33 "GET /compute/v2.1/images/4ceaa94c-0232-4808-b979-89d23cbd895c" status: 200 len: 1421 microversion: 2.1 time: 0.064420 Oct 04 20:39:36.340218 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 815/1559] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 20:39:36 2022] GET /compute/v2.1/images/4ceaa94c-0232-4808-b979-89d23cbd895c => generated 1421 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:36.352667 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-a6e75ce8-77b6-44a6-8a60-ab5c7e59cf7c tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:36.353516 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-a6e75ce8-77b6-44a6-8a60-ab5c7e59cf7c tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] [instance: 23da26ba-68f4-4aef-b13c-0b6588a65e43] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:36.361382 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a6e75ce8-77b6-44a6-8a60-ab5c7e59cf7c tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:36.362739 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a6e75ce8-77b6-44a6-8a60-ab5c7e59cf7c tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:36.363421 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a6e75ce8-77b6-44a6-8a60-ab5c7e59cf7c tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:36.366585 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a6e75ce8-77b6-44a6-8a60-ab5c7e59cf7c tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:36.367340 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a6e75ce8-77b6-44a6-8a60-ab5c7e59cf7c tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:36.368960 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a6e75ce8-77b6-44a6-8a60-ab5c7e59cf7c tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:36.619513 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-cfb5fcf4-3a58-4d50-8601-bc13a468760f tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '800db3a57ada47eca381b00189fdbf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66ec8ea91b04deb90b679589e0495bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:36.632871 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-cfb5fcf4-3a58-4d50-8601-bc13a468760f tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] 10.222.0.33 "GET /compute/v2.1/servers/83df4756-40e2-4fc6-be48-48a82dd4572a" status: 200 len: 1544 microversion: 2.1 time: 0.419398 Oct 04 20:39:36.635585 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 745/1560] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:36 2022] GET /compute/v2.1/servers/83df4756-40e2-4fc6-be48-48a82dd4572a => generated 1544 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:36.640436 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2e01dc2f-18a1-4325-aafb-70c77919e9c5 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:36.641039 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-2e01dc2f-18a1-4325-aafb-70c77919e9c5 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] [instance: a2fc592c-9dac-4f72-8633-229925d3bf76] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:36.660501 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2e01dc2f-18a1-4325-aafb-70c77919e9c5 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:36.660993 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2e01dc2f-18a1-4325-aafb-70c77919e9c5 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:36.661423 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2e01dc2f-18a1-4325-aafb-70c77919e9c5 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:36.662123 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2e01dc2f-18a1-4325-aafb-70c77919e9c5 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:36.662595 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2e01dc2f-18a1-4325-aafb-70c77919e9c5 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:36.663226 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2e01dc2f-18a1-4325-aafb-70c77919e9c5 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:36.772997 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-a6e75ce8-77b6-44a6-8a60-ab5c7e59cf7c tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3563efe2b8c94931a2a46c4e14811b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3118a5d96843d3bede1ed94bd9717e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:36.781313 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-a6e75ce8-77b6-44a6-8a60-ab5c7e59cf7c tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] 10.222.0.33 "GET /compute/v2.1/servers/23da26ba-68f4-4aef-b13c-0b6588a65e43" status: 200 len: 1470 microversion: 2.1 time: 0.439939 Oct 04 20:39:36.790688 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 816/1561] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:36 2022] GET /compute/v2.1/servers/23da26ba-68f4-4aef-b13c-0b6588a65e43 => generated 1470 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:36.796204 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-77c61e01-7b81-4e2d-91c5-f217f1d9c9af tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:36.796944 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-77c61e01-7b81-4e2d-91c5-f217f1d9c9af tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] [instance: 83df4756-40e2-4fc6-be48-48a82dd4572a] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:36.812593 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-77c61e01-7b81-4e2d-91c5-f217f1d9c9af tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:36.813277 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-77c61e01-7b81-4e2d-91c5-f217f1d9c9af tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:36.813936 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-77c61e01-7b81-4e2d-91c5-f217f1d9c9af tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:36.815749 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-77c61e01-7b81-4e2d-91c5-f217f1d9c9af tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:36.818645 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-77c61e01-7b81-4e2d-91c5-f217f1d9c9af tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:36.819271 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-77c61e01-7b81-4e2d-91c5-f217f1d9c9af tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:37.012029 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-77c61e01-7b81-4e2d-91c5-f217f1d9c9af tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] 10.222.0.33 "GET /compute/v2.1/servers/83df4756-40e2-4fc6-be48-48a82dd4572a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.225013 Oct 04 20:39:37.013938 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 817/1562] 10.222.0.33 () {58 vars in 1275 bytes} [Tue Oct 4 20:39:36 2022] GET /compute/v2.1/servers/83df4756-40e2-4fc6-be48-48a82dd4572a/os-interface => generated 284 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:39:37.041662 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-b86f0e5f-332c-4c01-b7e2-2e0718058aea tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:37.042425 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-b86f0e5f-332c-4c01-b7e2-2e0718058aea tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] [instance: d9c5805f-6cd2-4993-86b2-8a7546b62dd6] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:37.049821 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-2e01dc2f-18a1-4325-aafb-70c77919e9c5 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96919ec99c14864876d64a9c2b20f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b44ce10b78bf49c882c9b4df06187114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:37.058960 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-2e01dc2f-18a1-4325-aafb-70c77919e9c5 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] 10.222.0.33 "GET /compute/v2.1/servers/a2fc592c-9dac-4f72-8633-229925d3bf76" status: 200 len: 1504 microversion: 2.1 time: 0.422233 Oct 04 20:39:37.061174 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 746/1563] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:36 2022] GET /compute/v2.1/servers/a2fc592c-9dac-4f72-8633-229925d3bf76 => generated 1504 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:37.070092 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b86f0e5f-332c-4c01-b7e2-2e0718058aea tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:37.070608 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b86f0e5f-332c-4c01-b7e2-2e0718058aea tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:37.071049 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b86f0e5f-332c-4c01-b7e2-2e0718058aea tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:37.071757 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b86f0e5f-332c-4c01-b7e2-2e0718058aea tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:37.072210 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b86f0e5f-332c-4c01-b7e2-2e0718058aea tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:37.072636 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b86f0e5f-332c-4c01-b7e2-2e0718058aea tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:37.073988 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-65017059-a60f-42b6-af03-76ad12493926 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:37.074682 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-65017059-a60f-42b6-af03-76ad12493926 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] [instance: d2173117-c1c5-4c2d-9658-914e67649cdd] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:37.087347 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-65017059-a60f-42b6-af03-76ad12493926 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:37.087844 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-65017059-a60f-42b6-af03-76ad12493926 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:37.088271 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-65017059-a60f-42b6-af03-76ad12493926 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:37.098136 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-65017059-a60f-42b6-af03-76ad12493926 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:37.098982 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-65017059-a60f-42b6-af03-76ad12493926 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:37.099582 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-65017059-a60f-42b6-af03-76ad12493926 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:37.580038 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-b86f0e5f-332c-4c01-b7e2-2e0718058aea tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36f4114dc4f443f8b48da7b4027e0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a23a85365414f92bbc03177d7f190e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:37.591716 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-b86f0e5f-332c-4c01-b7e2-2e0718058aea tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] 10.222.0.33 "GET /compute/v2.1/servers/d9c5805f-6cd2-4993-86b2-8a7546b62dd6" status: 200 len: 1317 microversion: 2.1 time: 0.576522 Oct 04 20:39:37.594725 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 818/1564] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:37 2022] GET /compute/v2.1/servers/d9c5805f-6cd2-4993-86b2-8a7546b62dd6 => generated 1317 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:37.614047 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-0fe82f34-8b7a-4435-a797-81c2339319ae tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Calling method '.version_select at 0x7f3c74805280>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:37.633300 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-65017059-a60f-42b6-af03-76ad12493926 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a82c49a62249029ebc6ae3b4829709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecf3793be3eb4f3186c07a7e45fd8f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:37.642442 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-65017059-a60f-42b6-af03-76ad12493926 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] 10.222.0.33 "GET /compute/v2.1/servers/d2173117-c1c5-4c2d-9658-914e67649cdd" status: 200 len: 1528 microversion: 2.1 time: 0.577073 Oct 04 20:39:37.659586 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 747/1565] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:37 2022] GET /compute/v2.1/servers/d2173117-c1c5-4c2d-9658-914e67649cdd => generated 1528 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:37.680551 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-0fe82f34-8b7a-4435-a797-81c2339319ae tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] 10.222.0.33 "GET /compute/v2.1/images/4ceaa94c-0232-4808-b979-89d23cbd895c" status: 200 len: 1421 microversion: 2.1 time: 0.083915 Oct 04 20:39:37.683035 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 819/1566] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 20:39:37 2022] GET /compute/v2.1/images/4ceaa94c-0232-4808-b979-89d23cbd895c => generated 1421 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:37.805533 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a8d9972b-f3a9-4dd9-8ee5-97f40595f6af tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:37.806230 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a8d9972b-f3a9-4dd9-8ee5-97f40595f6af tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] [instance: 23da26ba-68f4-4aef-b13c-0b6588a65e43] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:37.819963 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a8d9972b-f3a9-4dd9-8ee5-97f40595f6af tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:37.821340 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a8d9972b-f3a9-4dd9-8ee5-97f40595f6af tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:37.822013 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a8d9972b-f3a9-4dd9-8ee5-97f40595f6af tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:37.823055 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a8d9972b-f3a9-4dd9-8ee5-97f40595f6af tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:37.824132 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a8d9972b-f3a9-4dd9-8ee5-97f40595f6af tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:37.824784 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a8d9972b-f3a9-4dd9-8ee5-97f40595f6af tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:38.092680 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-494adea3-85c1-4795-b99a-328eaad07850 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:38.093317 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-494adea3-85c1-4795-b99a-328eaad07850 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] [instance: a2fc592c-9dac-4f72-8633-229925d3bf76] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:38.115725 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-494adea3-85c1-4795-b99a-328eaad07850 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:38.116340 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-494adea3-85c1-4795-b99a-328eaad07850 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:38.116990 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-494adea3-85c1-4795-b99a-328eaad07850 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:38.118876 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-494adea3-85c1-4795-b99a-328eaad07850 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:38.119509 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-494adea3-85c1-4795-b99a-328eaad07850 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:38.120381 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-494adea3-85c1-4795-b99a-328eaad07850 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:38.216376 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-a8d9972b-f3a9-4dd9-8ee5-97f40595f6af tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3563efe2b8c94931a2a46c4e14811b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3118a5d96843d3bede1ed94bd9717e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:38.220467 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:39:38.230048 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a8d9972b-f3a9-4dd9-8ee5-97f40595f6af tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] 10.222.0.33 "GET /compute/v2.1/servers/23da26ba-68f4-4aef-b13c-0b6588a65e43" status: 200 len: 1463 microversion: 2.1 time: 0.428055 Oct 04 20:39:38.234692 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 748/1567] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:37 2022] GET /compute/v2.1/servers/23da26ba-68f4-4aef-b13c-0b6588a65e43 => generated 1463 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:38.244122 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-1f2fa045-2349-4d94-a32f-77a80aa1d777 req-d1086d5e-a54f-4454-b92d-800ed44bf1d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2173117-c1c5-4c2d-9658-914e67649cdd", "name": "network-vif-unplugged", "status": "completed", "tag": "5f97afab-20db-4d1c-9da9-8ce948bd87f0"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:39:38.260679 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-1f2fa045-2349-4d94-a32f-77a80aa1d777 req-d1086d5e-a54f-4454-b92d-800ed44bf1d1 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:38.261210 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-1f2fa045-2349-4d94-a32f-77a80aa1d777 req-d1086d5e-a54f-4454-b92d-800ed44bf1d1 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:38.262602 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-1f2fa045-2349-4d94-a32f-77a80aa1d777 req-d1086d5e-a54f-4454-b92d-800ed44bf1d1 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:38.279041 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-1f2fa045-2349-4d94-a32f-77a80aa1d777 req-d1086d5e-a54f-4454-b92d-800ed44bf1d1 service nova] Creating event network-vif-unplugged:5f97afab-20db-4d1c-9da9-8ce948bd87f0 for instance d2173117-c1c5-4c2d-9658-914e67649cdd on n-h1-854823-8 Oct 04 20:39:38.288310 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-1f2fa045-2349-4d94-a32f-77a80aa1d777 req-d1086d5e-a54f-4454-b92d-800ed44bf1d1 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.052214 Oct 04 20:39:38.289251 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 749/1568] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:39:38 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:39:38.481448 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-137243b7-989f-415c-afed-d424f48f70dc tempest-MigrationsAdminTest-1312330847 tempest-MigrationsAdminTest-1312330847-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:38.482870 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-137243b7-989f-415c-afed-d424f48f70dc tempest-MigrationsAdminTest-1312330847 tempest-MigrationsAdminTest-1312330847-project-admin] [instance: 23da26ba-68f4-4aef-b13c-0b6588a65e43] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:38.492682 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-137243b7-989f-415c-afed-d424f48f70dc tempest-MigrationsAdminTest-1312330847 tempest-MigrationsAdminTest-1312330847-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:38.493581 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-137243b7-989f-415c-afed-d424f48f70dc tempest-MigrationsAdminTest-1312330847 tempest-MigrationsAdminTest-1312330847-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:38.494265 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-137243b7-989f-415c-afed-d424f48f70dc tempest-MigrationsAdminTest-1312330847 tempest-MigrationsAdminTest-1312330847-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:38.495288 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-137243b7-989f-415c-afed-d424f48f70dc tempest-MigrationsAdminTest-1312330847 tempest-MigrationsAdminTest-1312330847-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:38.496392 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-137243b7-989f-415c-afed-d424f48f70dc tempest-MigrationsAdminTest-1312330847 tempest-MigrationsAdminTest-1312330847-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:38.497021 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-137243b7-989f-415c-afed-d424f48f70dc tempest-MigrationsAdminTest-1312330847 tempest-MigrationsAdminTest-1312330847-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:38.594519 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-494adea3-85c1-4795-b99a-328eaad07850 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96919ec99c14864876d64a9c2b20f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b44ce10b78bf49c882c9b4df06187114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:38.609612 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-494adea3-85c1-4795-b99a-328eaad07850 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] 10.222.0.33 "GET /compute/v2.1/servers/a2fc592c-9dac-4f72-8633-229925d3bf76" status: 200 len: 1504 microversion: 2.1 time: 0.525771 Oct 04 20:39:38.623990 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 820/1569] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:38 2022] GET /compute/v2.1/servers/a2fc592c-9dac-4f72-8633-229925d3bf76 => generated 1504 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:38.636355 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-71cf39b4-65ae-41e6-821f-5eeea9ee8e9f tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:38.636988 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-71cf39b4-65ae-41e6-821f-5eeea9ee8e9f tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] [instance: d9c5805f-6cd2-4993-86b2-8a7546b62dd6] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:38.698883 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-71cf39b4-65ae-41e6-821f-5eeea9ee8e9f tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:38.708932 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-71cf39b4-65ae-41e6-821f-5eeea9ee8e9f tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:38.712446 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-71cf39b4-65ae-41e6-821f-5eeea9ee8e9f tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:38.713254 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-71cf39b4-65ae-41e6-821f-5eeea9ee8e9f tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:38.713834 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-71cf39b4-65ae-41e6-821f-5eeea9ee8e9f tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:38.714801 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-71cf39b4-65ae-41e6-821f-5eeea9ee8e9f tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:39.155320 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-137243b7-989f-415c-afed-d424f48f70dc tempest-MigrationsAdminTest-1312330847 tempest-MigrationsAdminTest-1312330847-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/23da26ba-68f4-4aef-b13c-0b6588a65e43" status: 200 len: 1614 microversion: 2.1 time: 0.863962 Oct 04 20:39:39.156451 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 750/1570] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:38 2022] GET /compute/v2.1/servers/23da26ba-68f4-4aef-b13c-0b6588a65e43 => generated 1614 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:39.162224 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9ebc1568-f8d2-4835-8037-6c2db201646c tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:39.164737 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-9ebc1568-f8d2-4835-8037-6c2db201646c tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] [instance: d2173117-c1c5-4c2d-9658-914e67649cdd] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:39.192755 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9ebc1568-f8d2-4835-8037-6c2db201646c tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:39.193617 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9ebc1568-f8d2-4835-8037-6c2db201646c tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:39.194306 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9ebc1568-f8d2-4835-8037-6c2db201646c tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:39.195313 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9ebc1568-f8d2-4835-8037-6c2db201646c tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:39.196142 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9ebc1568-f8d2-4835-8037-6c2db201646c tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:39.197030 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9ebc1568-f8d2-4835-8037-6c2db201646c tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:39.289838 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9ebc1568-f8d2-4835-8037-6c2db201646c tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:39.291160 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9ebc1568-f8d2-4835-8037-6c2db201646c tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:39.296054 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9ebc1568-f8d2-4835-8037-6c2db201646c tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:39.296705 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-9ebc1568-f8d2-4835-8037-6c2db201646c tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lazy-loading 'fault' on Instance uuid d2173117-c1c5-4c2d-9658-914e67649cdd {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:39:39.342450 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-71cf39b4-65ae-41e6-821f-5eeea9ee8e9f tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36f4114dc4f443f8b48da7b4027e0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a23a85365414f92bbc03177d7f190e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:39.352961 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-71cf39b4-65ae-41e6-821f-5eeea9ee8e9f tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] 10.222.0.33 "GET /compute/v2.1/servers/d9c5805f-6cd2-4993-86b2-8a7546b62dd6" status: 200 len: 1467 microversion: 2.1 time: 0.727336 Oct 04 20:39:39.353888 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 821/1571] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:38 2022] GET /compute/v2.1/servers/d9c5805f-6cd2-4993-86b2-8a7546b62dd6 => generated 1467 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:39.360546 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-6dcda781-ca2b-4056-9679-7d1d710d1601 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Calling method '.version_select at 0x7f3c7499a0d0>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:39.363511 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-9ebc1568-f8d2-4835-8037-6c2db201646c tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a82c49a62249029ebc6ae3b4829709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecf3793be3eb4f3186c07a7e45fd8f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:39.374653 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-9ebc1568-f8d2-4835-8037-6c2db201646c tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] 10.222.0.33 "GET /compute/v2.1/servers/d2173117-c1c5-4c2d-9658-914e67649cdd" status: 200 len: 1315 microversion: 2.1 time: 0.216689 Oct 04 20:39:39.378305 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 751/1572] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:39 2022] GET /compute/v2.1/servers/d2173117-c1c5-4c2d-9658-914e67649cdd => generated 1315 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:39.389125 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-36726944-146b-42d0-af92-3f588d39a366 req-c326c065-bbf0-4ea4-a554-c81cff67418e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2173117-c1c5-4c2d-9658-914e67649cdd", "name": "network-vif-deleted", "tag": "5f97afab-20db-4d1c-9da9-8ce948bd87f0"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:39:39.413678 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-36726944-146b-42d0-af92-3f588d39a366 req-c326c065-bbf0-4ea4-a554-c81cff67418e service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:39.414219 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-36726944-146b-42d0-af92-3f588d39a366 req-c326c065-bbf0-4ea4-a554-c81cff67418e service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:39.421213 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-36726944-146b-42d0-af92-3f588d39a366 req-c326c065-bbf0-4ea4-a554-c81cff67418e service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:39.445126 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-36726944-146b-42d0-af92-3f588d39a366 req-c326c065-bbf0-4ea4-a554-c81cff67418e service nova] Creating event network-vif-deleted:5f97afab-20db-4d1c-9da9-8ce948bd87f0 for instance d2173117-c1c5-4c2d-9658-914e67649cdd on n-h1-854823-8 Oct 04 20:39:39.451121 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-36726944-146b-42d0-af92-3f588d39a366 req-c326c065-bbf0-4ea4-a554-c81cff67418e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071125 Oct 04 20:39:39.451817 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 752/1573] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:39:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:39:39.464607 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5573e80f-47f5-408c-9115-00c796f19f31 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:39.470146 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-5573e80f-47f5-408c-9115-00c796f19f31 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] [instance: 23da26ba-68f4-4aef-b13c-0b6588a65e43] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:39.482025 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-6dcda781-ca2b-4056-9679-7d1d710d1601 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] 10.222.0.33 "GET /compute/v2.1/images/4ceaa94c-0232-4808-b979-89d23cbd895c" status: 200 len: 1421 microversion: 2.1 time: 0.126777 Oct 04 20:39:39.483378 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 822/1574] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 20:39:39 2022] GET /compute/v2.1/images/4ceaa94c-0232-4808-b979-89d23cbd895c => generated 1421 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:39.487357 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5573e80f-47f5-408c-9115-00c796f19f31 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:39.488186 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5573e80f-47f5-408c-9115-00c796f19f31 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:39.488626 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5573e80f-47f5-408c-9115-00c796f19f31 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:39.489344 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5573e80f-47f5-408c-9115-00c796f19f31 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:39.489798 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5573e80f-47f5-408c-9115-00c796f19f31 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:39.490533 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5573e80f-47f5-408c-9115-00c796f19f31 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:39.505926 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-da34f258-dec3-47ff-b1eb-ca3147548bef tempest-ServersOnMultiNodesTest-176762512 tempest-ServersOnMultiNodesTest-176762512-project-admin] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:39.509021 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-da34f258-dec3-47ff-b1eb-ca3147548bef tempest-ServersOnMultiNodesTest-176762512 tempest-ServersOnMultiNodesTest-176762512-project-admin] [instance: d9c5805f-6cd2-4993-86b2-8a7546b62dd6] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:39.531111 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-da34f258-dec3-47ff-b1eb-ca3147548bef tempest-ServersOnMultiNodesTest-176762512 tempest-ServersOnMultiNodesTest-176762512-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:39.531766 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-da34f258-dec3-47ff-b1eb-ca3147548bef tempest-ServersOnMultiNodesTest-176762512 tempest-ServersOnMultiNodesTest-176762512-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:39.532305 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-da34f258-dec3-47ff-b1eb-ca3147548bef tempest-ServersOnMultiNodesTest-176762512 tempest-ServersOnMultiNodesTest-176762512-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:39.533542 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-da34f258-dec3-47ff-b1eb-ca3147548bef tempest-ServersOnMultiNodesTest-176762512 tempest-ServersOnMultiNodesTest-176762512-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:39.535351 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-da34f258-dec3-47ff-b1eb-ca3147548bef tempest-ServersOnMultiNodesTest-176762512 tempest-ServersOnMultiNodesTest-176762512-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:39.535901 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-da34f258-dec3-47ff-b1eb-ca3147548bef tempest-ServersOnMultiNodesTest-176762512 tempest-ServersOnMultiNodesTest-176762512-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:39.556456 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-5573e80f-47f5-408c-9115-00c796f19f31 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] [instance: 23da26ba-68f4-4aef-b13c-0b6588a65e43] Going to try to terminate instance {{(pid=128801) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:39:39.666590 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5573e80f-47f5-408c-9115-00c796f19f31 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] 10.222.0.33 "DELETE /compute/v2.1/servers/23da26ba-68f4-4aef-b13c-0b6588a65e43" status: 204 len: 0 microversion: 2.1 time: 0.209474 Oct 04 20:39:39.667492 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 753/1575] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 20:39:39 2022] DELETE /compute/v2.1/servers/23da26ba-68f4-4aef-b13c-0b6588a65e43 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:39:39.673623 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-6fac279d-7fc2-45fa-8e18-7fc170146316 req-5fc3c2e6-2323-46b8-a3b3-f6e03e2c7a66 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "83df4756-40e2-4fc6-be48-48a82dd4572a", "tag": "df81fac5-fbf3-4eb9-bad4-4478b0098ba4"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:39:39.686569 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-6fac279d-7fc2-45fa-8e18-7fc170146316 req-5fc3c2e6-2323-46b8-a3b3-f6e03e2c7a66 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:39.687058 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-6fac279d-7fc2-45fa-8e18-7fc170146316 req-5fc3c2e6-2323-46b8-a3b3-f6e03e2c7a66 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:39.687488 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-6fac279d-7fc2-45fa-8e18-7fc170146316 req-5fc3c2e6-2323-46b8-a3b3-f6e03e2c7a66 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:39.705771 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-6fac279d-7fc2-45fa-8e18-7fc170146316 req-5fc3c2e6-2323-46b8-a3b3-f6e03e2c7a66 service nova] Creating event network-changed:df81fac5-fbf3-4eb9-bad4-4478b0098ba4 for instance 83df4756-40e2-4fc6-be48-48a82dd4572a on n-h1-854823-8 Oct 04 20:39:39.712596 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-6fac279d-7fc2-45fa-8e18-7fc170146316 req-5fc3c2e6-2323-46b8-a3b3-f6e03e2c7a66 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043335 Oct 04 20:39:39.713684 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 754/1576] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:39:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:39:39.727264 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8b191846-efaa-42d2-89fd-85346f8ea35b tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:39.728429 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-8b191846-efaa-42d2-89fd-85346f8ea35b tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] [instance: a2fc592c-9dac-4f72-8633-229925d3bf76] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:39.735713 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8b191846-efaa-42d2-89fd-85346f8ea35b tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:39.736204 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8b191846-efaa-42d2-89fd-85346f8ea35b tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:39.737166 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8b191846-efaa-42d2-89fd-85346f8ea35b tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:39.738771 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8b191846-efaa-42d2-89fd-85346f8ea35b tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:39.739255 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8b191846-efaa-42d2-89fd-85346f8ea35b tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:39.739689 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8b191846-efaa-42d2-89fd-85346f8ea35b tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:39.865375 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-da34f258-dec3-47ff-b1eb-ca3147548bef tempest-ServersOnMultiNodesTest-176762512 tempest-ServersOnMultiNodesTest-176762512-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/d9c5805f-6cd2-4993-86b2-8a7546b62dd6" status: 200 len: 1618 microversion: 2.1 time: 0.371056 Oct 04 20:39:39.866916 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 823/1577] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:39 2022] GET /compute/v2.1/servers/d9c5805f-6cd2-4993-86b2-8a7546b62dd6 => generated 1618 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:39.899209 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-7629e749-739d-47d0-87be-8c2a4dc6cc20 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:39.902635 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-7629e749-739d-47d0-87be-8c2a4dc6cc20 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] [instance: 23da26ba-68f4-4aef-b13c-0b6588a65e43] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:39.922182 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7629e749-739d-47d0-87be-8c2a4dc6cc20 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:39.922834 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7629e749-739d-47d0-87be-8c2a4dc6cc20 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:39.923601 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7629e749-739d-47d0-87be-8c2a4dc6cc20 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:39.924626 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7629e749-739d-47d0-87be-8c2a4dc6cc20 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:39.925129 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7629e749-739d-47d0-87be-8c2a4dc6cc20 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:39.936423 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7629e749-739d-47d0-87be-8c2a4dc6cc20 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:40.015540 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-8b191846-efaa-42d2-89fd-85346f8ea35b tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96919ec99c14864876d64a9c2b20f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b44ce10b78bf49c882c9b4df06187114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:40.035500 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-8b191846-efaa-42d2-89fd-85346f8ea35b tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] 10.222.0.33 "GET /compute/v2.1/servers/a2fc592c-9dac-4f72-8633-229925d3bf76" status: 200 len: 1504 microversion: 2.1 time: 0.320192 Oct 04 20:39:40.036034 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 755/1578] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:39 2022] GET /compute/v2.1/servers/a2fc592c-9dac-4f72-8633-229925d3bf76 => generated 1504 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:40.066200 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d4374291-f0f7-403f-9f95-12890432b87a tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-25244582", "imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": ["42726a57-cdc8-45e3-8d61-348f02bfcd53"]}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:39:40.177874 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.network.neutron [None req-d4374291-f0f7-403f-9f95-12890432b87a tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] validate_networks() for None {{(pid=128801) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:39:40.295782 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-7629e749-739d-47d0-87be-8c2a4dc6cc20 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3563efe2b8c94931a2a46c4e14811b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3118a5d96843d3bede1ed94bd9717e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:40.304749 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-7629e749-739d-47d0-87be-8c2a4dc6cc20 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] 10.222.0.33 "GET /compute/v2.1/servers/23da26ba-68f4-4aef-b13c-0b6588a65e43" status: 200 len: 1469 microversion: 2.1 time: 0.436322 Oct 04 20:39:40.309852 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 824/1579] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:39 2022] GET /compute/v2.1/servers/23da26ba-68f4-4aef-b13c-0b6588a65e43 => generated 1469 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:40.348565 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-becc77c6-1298-4bcb-b5b7-db584eb94045 req-d0b8eed3-31de-4fba-88c9-577672302f87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23da26ba-68f4-4aef-b13c-0b6588a65e43", "name": "network-vif-plugged", "status": "completed", "tag": "f692dbdb-9498-4986-a253-420f090b704f"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:39:40.365985 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-becc77c6-1298-4bcb-b5b7-db584eb94045 req-d0b8eed3-31de-4fba-88c9-577672302f87 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:40.368914 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-becc77c6-1298-4bcb-b5b7-db584eb94045 req-d0b8eed3-31de-4fba-88c9-577672302f87 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:40.370061 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-becc77c6-1298-4bcb-b5b7-db584eb94045 req-d0b8eed3-31de-4fba-88c9-577672302f87 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:40.398247 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-becc77c6-1298-4bcb-b5b7-db584eb94045 req-d0b8eed3-31de-4fba-88c9-577672302f87 service nova] Creating event network-vif-plugged:f692dbdb-9498-4986-a253-420f090b704f for instance 23da26ba-68f4-4aef-b13c-0b6588a65e43 on n-h1-854823-8 Oct 04 20:39:40.414480 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-becc77c6-1298-4bcb-b5b7-db584eb94045 req-d0b8eed3-31de-4fba-88c9-577672302f87 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067981 Oct 04 20:39:40.416670 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 825/1580] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:39:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:39:40.428390 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-8aef9d05-36bc-4071-9107-2eab555df5af tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:40.431400 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-8aef9d05-36bc-4071-9107-2eab555df5af tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] [instance: d2173117-c1c5-4c2d-9658-914e67649cdd] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:40.442664 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8aef9d05-36bc-4071-9107-2eab555df5af tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:40.445382 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8aef9d05-36bc-4071-9107-2eab555df5af tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:40.446038 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8aef9d05-36bc-4071-9107-2eab555df5af tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:40.446968 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8aef9d05-36bc-4071-9107-2eab555df5af tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:40.451513 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8aef9d05-36bc-4071-9107-2eab555df5af tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:40.452201 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8aef9d05-36bc-4071-9107-2eab555df5af tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:40.543306 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8aef9d05-36bc-4071-9107-2eab555df5af tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:40.543801 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8aef9d05-36bc-4071-9107-2eab555df5af tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:40.544244 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8aef9d05-36bc-4071-9107-2eab555df5af tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:40.544681 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.objects.instance [None req-8aef9d05-36bc-4071-9107-2eab555df5af tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lazy-loading 'fault' on Instance uuid d2173117-c1c5-4c2d-9658-914e67649cdd {{(pid=128802) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:39:40.609030 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-d4374291-f0f7-403f-9f95-12890432b87a tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Flavor limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:39:40.609447 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-d4374291-f0f7-403f-9f95-12890432b87a tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Image limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:39:40.609925 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-d4374291-f0f7-403f-9f95-12890432b87a tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Flavor pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:39:40.610324 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-d4374291-f0f7-403f-9f95-12890432b87a tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Image pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:39:40.610750 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-d4374291-f0f7-403f-9f95-12890432b87a tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:39:40.620239 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-8aef9d05-36bc-4071-9107-2eab555df5af tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a82c49a62249029ebc6ae3b4829709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecf3793be3eb4f3186c07a7e45fd8f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:40.623226 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d4374291-f0f7-403f-9f95-12890432b87a tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:40.623712 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d4374291-f0f7-403f-9f95-12890432b87a tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:40.624148 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d4374291-f0f7-403f-9f95-12890432b87a tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:40.624867 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d4374291-f0f7-403f-9f95-12890432b87a tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:40.625320 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d4374291-f0f7-403f-9f95-12890432b87a tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:40.625740 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d4374291-f0f7-403f-9f95-12890432b87a tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:40.636802 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-8aef9d05-36bc-4071-9107-2eab555df5af tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] 10.222.0.33 "GET /compute/v2.1/servers/d2173117-c1c5-4c2d-9658-914e67649cdd" status: 200 len: 1315 microversion: 2.1 time: 0.218683 Oct 04 20:39:40.642142 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 826/1581] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:40 2022] GET /compute/v2.1/servers/d2173117-c1c5-4c2d-9658-914e67649cdd => generated 1315 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:40.653690 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-98dfeb60-5ad6-4b82-9f76-155598289f4c tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Calling method '.version_select at 0x7f3c7461fe50>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:40.661546 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-d4374291-f0f7-403f-9f95-12890432b87a tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Getting quotas for project 1a23a85365414f92bbc03177d7f190e6. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:39:40.665919 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-d4374291-f0f7-403f-9f95-12890432b87a tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Getting quotas for user e36f4114dc4f443f8b48da7b4027e0c1 and project 1a23a85365414f92bbc03177d7f190e6. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:39:40.678726 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d4374291-f0f7-403f-9f95-12890432b87a tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Going to run 1 instances... {{(pid=128801) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:39:40.681039 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d4374291-f0f7-403f-9f95-12890432b87a tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] [instance: 286a7673-8323-4451-b329-4b33690e1c48] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='15b24725-0c99-4bcf-b1fb-907cdf8e2d63',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128801) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:39:40.743338 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-98dfeb60-5ad6-4b82-9f76-155598289f4c tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] 10.222.0.33 "GET /compute/v2.1/images/4ceaa94c-0232-4808-b979-89d23cbd895c" status: 200 len: 1421 microversion: 2.1 time: 0.099436 Oct 04 20:39:40.743922 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 827/1582] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 20:39:40 2022] GET /compute/v2.1/images/4ceaa94c-0232-4808-b979-89d23cbd895c => generated 1421 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:40.750064 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d4374291-f0f7-403f-9f95-12890432b87a tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.712949 Oct 04 20:39:40.757163 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 756/1583] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 20:39:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 720 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 20:39:40.765883 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-0d85546c-7fd9-4ca5-b375-2bd2e9b52ec6 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:40.766532 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-0d85546c-7fd9-4ca5-b375-2bd2e9b52ec6 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] [instance: 286a7673-8323-4451-b329-4b33690e1c48] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:40.906235 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-0d85546c-7fd9-4ca5-b375-2bd2e9b52ec6 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36f4114dc4f443f8b48da7b4027e0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a23a85365414f92bbc03177d7f190e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:40.919118 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-0d85546c-7fd9-4ca5-b375-2bd2e9b52ec6 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] 10.222.0.33 "GET /compute/v2.1/servers/286a7673-8323-4451-b329-4b33690e1c48" status: 200 len: 1215 microversion: 2.1 time: 0.157032 Oct 04 20:39:40.922054 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 828/1584] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:40 2022] GET /compute/v2.1/servers/286a7673-8323-4451-b329-4b33690e1c48 => generated 1215 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:41.061636 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ae78290c-5267-4c29-bdf8-6c8c5e80ce5b tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:41.062468 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ae78290c-5267-4c29-bdf8-6c8c5e80ce5b tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] [instance: a2fc592c-9dac-4f72-8633-229925d3bf76] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:41.076464 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ae78290c-5267-4c29-bdf8-6c8c5e80ce5b tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:41.079878 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ae78290c-5267-4c29-bdf8-6c8c5e80ce5b tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:41.081980 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ae78290c-5267-4c29-bdf8-6c8c5e80ce5b tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:41.084392 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ae78290c-5267-4c29-bdf8-6c8c5e80ce5b tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:41.085580 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ae78290c-5267-4c29-bdf8-6c8c5e80ce5b tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:41.094474 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ae78290c-5267-4c29-bdf8-6c8c5e80ce5b tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:41.347089 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-109d6b03-c3f6-43f7-8975-c2cd781957bc tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:41.351597 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-109d6b03-c3f6-43f7-8975-c2cd781957bc tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] [instance: 23da26ba-68f4-4aef-b13c-0b6588a65e43] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:41.381289 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-109d6b03-c3f6-43f7-8975-c2cd781957bc tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:41.388252 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-109d6b03-c3f6-43f7-8975-c2cd781957bc tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:41.391946 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-109d6b03-c3f6-43f7-8975-c2cd781957bc tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:41.394404 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-109d6b03-c3f6-43f7-8975-c2cd781957bc tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:41.395240 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-109d6b03-c3f6-43f7-8975-c2cd781957bc tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:41.401688 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-109d6b03-c3f6-43f7-8975-c2cd781957bc tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:41.598947 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-ae78290c-5267-4c29-bdf8-6c8c5e80ce5b tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96919ec99c14864876d64a9c2b20f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b44ce10b78bf49c882c9b4df06187114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:41.616950 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ae78290c-5267-4c29-bdf8-6c8c5e80ce5b tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] 10.222.0.33 "GET /compute/v2.1/servers/a2fc592c-9dac-4f72-8633-229925d3bf76" status: 200 len: 1504 microversion: 2.1 time: 0.559643 Oct 04 20:39:41.621761 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 757/1585] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:41 2022] GET /compute/v2.1/servers/a2fc592c-9dac-4f72-8633-229925d3bf76 => generated 1504 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:41.664110 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-532eb0ac-54eb-4b6f-ac9e-613f614a79aa tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:41.664966 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-532eb0ac-54eb-4b6f-ac9e-613f614a79aa tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] [instance: d2173117-c1c5-4c2d-9658-914e67649cdd] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:41.677410 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-532eb0ac-54eb-4b6f-ac9e-613f614a79aa tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:41.682313 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-532eb0ac-54eb-4b6f-ac9e-613f614a79aa tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:41.683015 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-532eb0ac-54eb-4b6f-ac9e-613f614a79aa tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:41.683921 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-532eb0ac-54eb-4b6f-ac9e-613f614a79aa tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:41.684688 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-532eb0ac-54eb-4b6f-ac9e-613f614a79aa tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:41.696047 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-532eb0ac-54eb-4b6f-ac9e-613f614a79aa tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:41.768528 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-532eb0ac-54eb-4b6f-ac9e-613f614a79aa tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] HTTP exception thrown: Instance d2173117-c1c5-4c2d-9658-914e67649cdd could not be found. Oct 04 20:39:41.790458 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-532eb0ac-54eb-4b6f-ac9e-613f614a79aa tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Request method failure captured: Oct 04 20:39:41.790458 n-d-854823-8 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/d2173117-c1c5-4c2d-9658-914e67649cdd HTTP/1.1 Oct 04 20:39:41.790458 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:39:41.790458 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:39:41.790458 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:39:41.790458 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 0 Oct 04 20:39:41.790458 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:39:41.790458 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:39:41.790458 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:39:41.790458 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:39:41.790458 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJndB3mJHN0LJ8w6Kheb2n0CJ86k8j-AXdWa3AMW_tNY1_9QQNH8dAe8aGzPWpNIRLrfkOudQ5X3ptj4NBqufJdfAt-Rzg0K2bAeHF3DIzHVwi3Ysg8-zRwFjrbgaapzSsHDGJy5Rd6NQfSoCIrbX0y1TKi0r3vLuM4ZTrt6iTVd_LI Oct 04 20:39:41.790458 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:39:41.790458 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:39:41.790458 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:39:41.790458 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:39:41.790458 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:39:41.790458 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:39:41.790458 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: ecf3793be3eb4f3186c07a7e45fd8f06 Oct 04 20:39:41.790458 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-957462329 Oct 04 20:39:41.790458 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 20:39:41.790458 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 20:39:41.790458 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ecf3793be3eb4f3186c07a7e45fd8f06", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ecf3793be3eb4f3186c07a7e45fd8f06"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ecf3793be3eb4f3186c07a7e45fd8f06"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ecf3793be3eb4f3186c07a7e45fd8f06"}]}] Oct 04 20:39:41.790458 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-957462329 Oct 04 20:39:41.790458 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: ecf3793be3eb4f3186c07a7e45fd8f06 Oct 04 20:39:41.790458 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-957462329 Oct 04 20:39:41.790458 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-ImagesOneServerNegativeTestJSON-957462329-project Oct 04 20:39:41.790458 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:39:41.790458 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:39:41.790458 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: 89a82c49a62249029ebc6ae3b4829709 Oct 04 20:39:41.790458 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-957462329-project Oct 04 20:39:41.790458 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 20:39:41.790458 n-d-854823-8 devstack@n-api.service[128801]: exception: Instance d2173117-c1c5-4c2d-9658-914e67649cdd could not be found. Oct 04 20:39:41.790458 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': 'd2173117-c1c5-4c2d-9658-914e67649cdd'} Oct 04 20:39:41.790458 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:39:41.790458 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:39:41.790458 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:39:41.790458 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:39:41.790458 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:39:41.790458 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:39:41.790458 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:39:41.790458 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:39:41.790458 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:39:41.790458 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:39:41.790458 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2173117-c1c5-4c2d-9658-914e67649cdd could not be found. Oct 04 20:39:41.790458 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:39:41.790458 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:39:41.790458 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:39:41.790458 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:39:41.790458 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:39:41.790458 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:39:41.790458 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:39:41.790458 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:39:41.790458 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:39:41.790458 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:39:41.790458 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:39:41.790458 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:39:41.790458 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:39:41.790458 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:39:41.790458 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:39:41.790458 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:39:41.790458 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2173117-c1c5-4c2d-9658-914e67649cdd could not be found. Oct 04 20:39:41.790458 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:39:41.790458 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:39:41.797350 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:39:41.797350 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:39:41.797350 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:39:41.797350 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:39:41.797350 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:39:41.797350 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:39:41.797350 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2173117-c1c5-4c2d-9658-914e67649cdd could not be found. Oct 04 20:39:41.797350 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:39:41.797350 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-532eb0ac-54eb-4b6f-ac9e-613f614a79aa tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Returning 404 to user: Instance d2173117-c1c5-4c2d-9658-914e67649cdd could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:39:41.797350 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-532eb0ac-54eb-4b6f-ac9e-613f614a79aa tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] 10.222.0.33 "GET /compute/v2.1/servers/d2173117-c1c5-4c2d-9658-914e67649cdd" status: 404 len: 111 microversion: 2.1 time: 0.135596 Oct 04 20:39:41.797350 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 758/1586] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:41 2022] GET /compute/v2.1/servers/d2173117-c1c5-4c2d-9658-914e67649cdd => generated 111 bytes in 137 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:39:41.803364 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-de57284e-7a9c-4359-8bc3-08d5f9e698fe tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Calling method '.version_select at 0x7f3c7889e820>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:41.827877 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell0:SELECT=10 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:39:41.912392 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-de57284e-7a9c-4359-8bc3-08d5f9e698fe tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] 10.222.0.33 "GET /compute/v2.1/images/4ceaa94c-0232-4808-b979-89d23cbd895c" status: 200 len: 1421 microversion: 2.1 time: 0.118150 Oct 04 20:39:41.913216 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 759/1587] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 20:39:41 2022] GET /compute/v2.1/images/4ceaa94c-0232-4808-b979-89d23cbd895c => generated 1421 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:41.931396 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ce513b04-eda0-4da4-9a49-64757b9a744c tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Action: 'create', calling method: .version_select at 0x7f3c788eeb80>, body: {"keypair": {"name": "tempest-keypair-1298622356", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPTF6Nmb0hPF6wOkf2IsSfWmCrBihvs+DASAyWCm2yIZR0N/ICO+VnyO41hTfldWjxr7SRX+0T7/PPB7/8AwJ87mSmR+pZeh3Hc/1K3IJ1ezf+VaHM3i/wZS20dZqCHzoA=="}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:39:41.983779 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-ce513b04-eda0-4da4-9a49-64757b9a744c tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Getting quotas for project ecf3793be3eb4f3186c07a7e45fd8f06. Resources: {'key_pairs'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:39:42.004015 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-ce513b04-eda0-4da4-9a49-64757b9a744c tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Getting quotas for user 89a82c49a62249029ebc6ae3b4829709 and project ecf3793be3eb4f3186c07a7e45fd8f06. Resources: {'key_pairs'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:39:42.074074 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ce513b04-eda0-4da4-9a49-64757b9a744c tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.146450 Oct 04 20:39:42.075149 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 760/1588] 10.222.0.33 () {60 vars in 1159 bytes} [Tue Oct 4 20:39:41 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:39:42.091809 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-afd984c1-0451-4219-800c-157a49476102 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:42.092553 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-afd984c1-0451-4219-800c-157a49476102 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] [instance: 286a7673-8323-4451-b329-4b33690e1c48] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:42.108880 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-afd984c1-0451-4219-800c-157a49476102 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:42.116894 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-afd984c1-0451-4219-800c-157a49476102 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:42.117797 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-afd984c1-0451-4219-800c-157a49476102 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:42.119360 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-afd984c1-0451-4219-800c-157a49476102 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:42.119967 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-afd984c1-0451-4219-800c-157a49476102 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:42.120503 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-afd984c1-0451-4219-800c-157a49476102 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:42.478146 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-afd984c1-0451-4219-800c-157a49476102 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36f4114dc4f443f8b48da7b4027e0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a23a85365414f92bbc03177d7f190e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:42.488654 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-109d6b03-c3f6-43f7-8975-c2cd781957bc tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3563efe2b8c94931a2a46c4e14811b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3118a5d96843d3bede1ed94bd9717e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:42.500186 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-afd984c1-0451-4219-800c-157a49476102 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] 10.222.0.33 "GET /compute/v2.1/servers/286a7673-8323-4451-b329-4b33690e1c48" status: 200 len: 1211 microversion: 2.1 time: 0.423789 Oct 04 20:39:42.504311 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 761/1589] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:42 2022] GET /compute/v2.1/servers/286a7673-8323-4451-b329-4b33690e1c48 => generated 1211 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:42.509526 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-109d6b03-c3f6-43f7-8975-c2cd781957bc tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] 10.222.0.33 "GET /compute/v2.1/servers/23da26ba-68f4-4aef-b13c-0b6588a65e43" status: 200 len: 1469 microversion: 2.1 time: 1.179932 Oct 04 20:39:42.522519 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 829/1590] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:41 2022] GET /compute/v2.1/servers/23da26ba-68f4-4aef-b13c-0b6588a65e43 => generated 1469 bytes in 1185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:42.646882 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-10cd233b-2ca7-4928-9bb8-4b1d34d75ece tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:42.648289 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-10cd233b-2ca7-4928-9bb8-4b1d34d75ece tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] [instance: a2fc592c-9dac-4f72-8633-229925d3bf76] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:42.665544 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-10cd233b-2ca7-4928-9bb8-4b1d34d75ece tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:42.669817 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-10cd233b-2ca7-4928-9bb8-4b1d34d75ece tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:42.670315 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-10cd233b-2ca7-4928-9bb8-4b1d34d75ece tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:42.671215 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-10cd233b-2ca7-4928-9bb8-4b1d34d75ece tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:42.671693 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-10cd233b-2ca7-4928-9bb8-4b1d34d75ece tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:42.672129 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-10cd233b-2ca7-4928-9bb8-4b1d34d75ece tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:42.938909 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-e062c480-4d5c-47ed-9564-a8857f5ff2dc tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Calling method '.version_select at 0x7f3c7422f820>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:43.086920 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-10cd233b-2ca7-4928-9bb8-4b1d34d75ece tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96919ec99c14864876d64a9c2b20f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b44ce10b78bf49c882c9b4df06187114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:43.108731 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-e062c480-4d5c-47ed-9564-a8857f5ff2dc tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] 10.222.0.33 "GET /compute/v2.1/images/4ceaa94c-0232-4808-b979-89d23cbd895c" status: 200 len: 1421 microversion: 2.1 time: 0.179931 Oct 04 20:39:43.117024 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-10cd233b-2ca7-4928-9bb8-4b1d34d75ece tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] 10.222.0.33 "GET /compute/v2.1/servers/a2fc592c-9dac-4f72-8633-229925d3bf76" status: 200 len: 1504 microversion: 2.1 time: 0.458113 Oct 04 20:39:43.118015 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 762/1591] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:42 2022] GET /compute/v2.1/servers/a2fc592c-9dac-4f72-8633-229925d3bf76 => generated 1504 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:43.124370 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-343c3950-f86a-4b66-accb-21dfb40f6852 req-c7eceee3-98f7-40fb-8f4b-6b555fb3da6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23da26ba-68f4-4aef-b13c-0b6588a65e43", "name": "network-vif-deleted", "tag": "f692dbdb-9498-4986-a253-420f090b704f"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:39:43.132709 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 830/1592] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 20:39:42 2022] GET /compute/v2.1/images/4ceaa94c-0232-4808-b979-89d23cbd895c => generated 1421 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:39:43.137083 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=1,nova_api:UPDATE=2,nova_api:INSERT=4 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:39:43.153601 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-343c3950-f86a-4b66-accb-21dfb40f6852 req-c7eceee3-98f7-40fb-8f4b-6b555fb3da6f service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:43.156243 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-343c3950-f86a-4b66-accb-21dfb40f6852 req-c7eceee3-98f7-40fb-8f4b-6b555fb3da6f service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:43.156878 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-343c3950-f86a-4b66-accb-21dfb40f6852 req-c7eceee3-98f7-40fb-8f4b-6b555fb3da6f service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:43.208621 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-343c3950-f86a-4b66-accb-21dfb40f6852 req-c7eceee3-98f7-40fb-8f4b-6b555fb3da6f service nova] Creating event network-vif-deleted:f692dbdb-9498-4986-a253-420f090b704f for instance 23da26ba-68f4-4aef-b13c-0b6588a65e43 on n-h1-854823-8 Oct 04 20:39:43.227044 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-343c3950-f86a-4b66-accb-21dfb40f6852 req-c7eceee3-98f7-40fb-8f4b-6b555fb3da6f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107699 Oct 04 20:39:43.233801 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 763/1593] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:39:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:39:43.467649 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-068eea19-4a64-4abb-9880-8c6eca3ae055 req-014d60d9-9db9-48ba-a066-14cb2813624c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0dd1d0cf-a3a0-4ea2-8260-ac206bbfac88", "name": "network-vif-plugged", "status": "completed", "tag": "5ef34720-ea76-4ea1-90bb-a255bf7dfe8b"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:39:43.491211 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-068eea19-4a64-4abb-9880-8c6eca3ae055 req-014d60d9-9db9-48ba-a066-14cb2813624c service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:43.491818 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-068eea19-4a64-4abb-9880-8c6eca3ae055 req-014d60d9-9db9-48ba-a066-14cb2813624c service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:43.492100 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-068eea19-4a64-4abb-9880-8c6eca3ae055 req-014d60d9-9db9-48ba-a066-14cb2813624c service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:43.527281 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-068eea19-4a64-4abb-9880-8c6eca3ae055 req-014d60d9-9db9-48ba-a066-14cb2813624c service nova] Creating event network-vif-plugged:5ef34720-ea76-4ea1-90bb-a255bf7dfe8b for instance 0dd1d0cf-a3a0-4ea2-8260-ac206bbfac88 on n-h1-854823-8 Oct 04 20:39:43.544031 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c6f7a58b-1cc6-43f2-8306-ea870dc30930 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:43.558052 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-068eea19-4a64-4abb-9880-8c6eca3ae055 req-014d60d9-9db9-48ba-a066-14cb2813624c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094837 Oct 04 20:39:43.558684 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 831/1594] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:39:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:39:43.566568 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c6f7a58b-1cc6-43f2-8306-ea870dc30930 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] [instance: 286a7673-8323-4451-b329-4b33690e1c48] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:43.591121 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-aeeaeb88-a8ac-4b56-8b7d-57f84cba78bc tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:43.593704 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c6f7a58b-1cc6-43f2-8306-ea870dc30930 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:43.594947 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c6f7a58b-1cc6-43f2-8306-ea870dc30930 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:43.596424 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-aeeaeb88-a8ac-4b56-8b7d-57f84cba78bc tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] [instance: 23da26ba-68f4-4aef-b13c-0b6588a65e43] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:43.598142 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c6f7a58b-1cc6-43f2-8306-ea870dc30930 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:43.601469 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c6f7a58b-1cc6-43f2-8306-ea870dc30930 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:43.602983 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c6f7a58b-1cc6-43f2-8306-ea870dc30930 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:43.604948 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c6f7a58b-1cc6-43f2-8306-ea870dc30930 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:43.619881 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-aeeaeb88-a8ac-4b56-8b7d-57f84cba78bc tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:43.620667 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-aeeaeb88-a8ac-4b56-8b7d-57f84cba78bc tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:43.622742 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-aeeaeb88-a8ac-4b56-8b7d-57f84cba78bc tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:43.626831 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-aeeaeb88-a8ac-4b56-8b7d-57f84cba78bc tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:43.628517 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-aeeaeb88-a8ac-4b56-8b7d-57f84cba78bc tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:43.629110 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-aeeaeb88-a8ac-4b56-8b7d-57f84cba78bc tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:43.756466 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_api:SELECT=100 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:39:43.800827 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-aeeaeb88-a8ac-4b56-8b7d-57f84cba78bc tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:43.801229 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-aeeaeb88-a8ac-4b56-8b7d-57f84cba78bc tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:43.801663 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-aeeaeb88-a8ac-4b56-8b7d-57f84cba78bc tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:43.802115 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.objects.instance [None req-aeeaeb88-a8ac-4b56-8b7d-57f84cba78bc tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lazy-loading 'fault' on Instance uuid 23da26ba-68f4-4aef-b13c-0b6588a65e43 {{(pid=128802) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:39:43.922437 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c6f7a58b-1cc6-43f2-8306-ea870dc30930 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36f4114dc4f443f8b48da7b4027e0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a23a85365414f92bbc03177d7f190e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:43.943852 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c6f7a58b-1cc6-43f2-8306-ea870dc30930 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] 10.222.0.33 "GET /compute/v2.1/servers/286a7673-8323-4451-b329-4b33690e1c48" status: 200 len: 1267 microversion: 2.1 time: 0.419794 Oct 04 20:39:43.965654 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 764/1595] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:43 2022] GET /compute/v2.1/servers/286a7673-8323-4451-b329-4b33690e1c48 => generated 1267 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:39:43.994076 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-aeeaeb88-a8ac-4b56-8b7d-57f84cba78bc tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3563efe2b8c94931a2a46c4e14811b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3118a5d96843d3bede1ed94bd9717e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:44.005290 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-aeeaeb88-a8ac-4b56-8b7d-57f84cba78bc tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] 10.222.0.33 "GET /compute/v2.1/servers/23da26ba-68f4-4aef-b13c-0b6588a65e43" status: 200 len: 1303 microversion: 2.1 time: 0.434789 Oct 04 20:39:44.009462 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 832/1596] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:43 2022] GET /compute/v2.1/servers/23da26ba-68f4-4aef-b13c-0b6588a65e43 => generated 1303 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:44.152855 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-4c7a553b-3509-4eaa-b742-164abb9acbfb tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Calling method '.version_select at 0x7f3c788eef70>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:44.154257 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-fbfabb6c-9232-47c1-a528-28f85c35d3bc tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:44.155846 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-fbfabb6c-9232-47c1-a528-28f85c35d3bc tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] [instance: a2fc592c-9dac-4f72-8633-229925d3bf76] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:44.182233 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fbfabb6c-9232-47c1-a528-28f85c35d3bc tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:44.184132 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fbfabb6c-9232-47c1-a528-28f85c35d3bc tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:44.187354 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fbfabb6c-9232-47c1-a528-28f85c35d3bc tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:44.191041 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fbfabb6c-9232-47c1-a528-28f85c35d3bc tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:44.192500 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fbfabb6c-9232-47c1-a528-28f85c35d3bc tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:44.197495 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fbfabb6c-9232-47c1-a528-28f85c35d3bc tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:44.257430 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-4c7a553b-3509-4eaa-b742-164abb9acbfb tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] 10.222.0.33 "GET /compute/v2.1/images/4ceaa94c-0232-4808-b979-89d23cbd895c" status: 200 len: 1421 microversion: 2.1 time: 0.114814 Oct 04 20:39:44.260704 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 765/1597] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 20:39:44 2022] GET /compute/v2.1/images/4ceaa94c-0232-4808-b979-89d23cbd895c => generated 1421 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:44.869326 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-fbfabb6c-9232-47c1-a528-28f85c35d3bc tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96919ec99c14864876d64a9c2b20f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b44ce10b78bf49c882c9b4df06187114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:44.884713 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-fbfabb6c-9232-47c1-a528-28f85c35d3bc tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] 10.222.0.33 "GET /compute/v2.1/servers/a2fc592c-9dac-4f72-8633-229925d3bf76" status: 200 len: 1504 microversion: 2.1 time: 0.738344 Oct 04 20:39:44.904029 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 833/1598] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:44 2022] GET /compute/v2.1/servers/a2fc592c-9dac-4f72-8633-229925d3bf76 => generated 1504 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:44.976156 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5f6735c6-f70a-47fc-955c-6764c51de5a7 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:44.977666 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-5f6735c6-f70a-47fc-955c-6764c51de5a7 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] [instance: 286a7673-8323-4451-b329-4b33690e1c48] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:44.995746 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5f6735c6-f70a-47fc-955c-6764c51de5a7 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:44.997619 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5f6735c6-f70a-47fc-955c-6764c51de5a7 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:44.999871 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5f6735c6-f70a-47fc-955c-6764c51de5a7 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:45.002769 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5f6735c6-f70a-47fc-955c-6764c51de5a7 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:45.002886 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5f6735c6-f70a-47fc-955c-6764c51de5a7 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:45.003390 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5f6735c6-f70a-47fc-955c-6764c51de5a7 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:45.040877 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-dd42cd20-22dd-4eff-a6f4-d1d3caab7edb tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:45.041542 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-dd42cd20-22dd-4eff-a6f4-d1d3caab7edb tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] [instance: 23da26ba-68f4-4aef-b13c-0b6588a65e43] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:45.061763 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dd42cd20-22dd-4eff-a6f4-d1d3caab7edb tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:45.063461 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dd42cd20-22dd-4eff-a6f4-d1d3caab7edb tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:45.065548 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dd42cd20-22dd-4eff-a6f4-d1d3caab7edb tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:45.067580 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dd42cd20-22dd-4eff-a6f4-d1d3caab7edb tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:45.068241 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dd42cd20-22dd-4eff-a6f4-d1d3caab7edb tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:45.070009 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dd42cd20-22dd-4eff-a6f4-d1d3caab7edb tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:45.114320 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.wsgi [None req-dd42cd20-22dd-4eff-a6f4-d1d3caab7edb tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] HTTP exception thrown: Instance 23da26ba-68f4-4aef-b13c-0b6588a65e43 could not be found. Oct 04 20:39:45.116756 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-dd42cd20-22dd-4eff-a6f4-d1d3caab7edb tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Request method failure captured: Oct 04 20:39:45.116756 n-d-854823-8 devstack@n-api.service[128802]: request: GET /compute/v2.1/servers/23da26ba-68f4-4aef-b13c-0b6588a65e43 HTTP/1.1 Oct 04 20:39:45.116756 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 20:39:45.116756 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 20:39:45.116756 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 20:39:45.116756 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 0 Oct 04 20:39:45.116756 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 20:39:45.116756 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 20:39:45.116756 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 20:39:45.116756 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 20:39:45.116756 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPJi4YW5paijGjm0KJCD3xPCjqoV7Yx2gPBOteSu0r3DtnBaxauAhN82fJ8sA4jGopne1RZKgRzfyGU8WtYmELZERLpy7PD9YLLtoJOaL9dbdJigxopqVQsdWKaWPFztWyama9XcrUH3oJLe6wPMcVbEBemlmJBzjFTlhWfl4Iuq6Rdc Oct 04 20:39:45.116756 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 20:39:45.116756 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 20:39:45.116756 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 20:39:45.116756 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 20:39:45.116756 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 20:39:45.116756 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 20:39:45.116756 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: dd3118a5d96843d3bede1ed94bd9717e Oct 04 20:39:45.116756 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-MigrationsAdminTest-282898562 Oct 04 20:39:45.116756 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 20:39:45.116756 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 20:39:45.116756 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_dd3118a5d96843d3bede1ed94bd9717e", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/dd3118a5d96843d3bede1ed94bd9717e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/dd3118a5d96843d3bede1ed94bd9717e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/dd3118a5d96843d3bede1ed94bd9717e"}]}] Oct 04 20:39:45.116756 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-MigrationsAdminTest-282898562 Oct 04 20:39:45.116756 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: dd3118a5d96843d3bede1ed94bd9717e Oct 04 20:39:45.116756 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-MigrationsAdminTest-282898562 Oct 04 20:39:45.116756 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-MigrationsAdminTest-282898562-project Oct 04 20:39:45.116756 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 20:39:45.116756 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 20:39:45.116756 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: 3563efe2b8c94931a2a46c4e14811b3a Oct 04 20:39:45.116756 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-MigrationsAdminTest-282898562-project Oct 04 20:39:45.116756 n-d-854823-8 devstack@n-api.service[128802]: method: > Oct 04 20:39:45.116756 n-d-854823-8 devstack@n-api.service[128802]: exception: Instance 23da26ba-68f4-4aef-b13c-0b6588a65e43 could not be found. Oct 04 20:39:45.116756 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'id': '23da26ba-68f4-4aef-b13c-0b6588a65e43'} Oct 04 20:39:45.116756 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:39:45.116756 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:39:45.116756 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:39:45.116756 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:39:45.116756 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:39:45.116756 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:39:45.116756 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:39:45.116756 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:39:45.116756 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:39:45.116756 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:39:45.116756 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 23da26ba-68f4-4aef-b13c-0b6588a65e43 could not be found. Oct 04 20:39:45.116756 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:39:45.116756 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:39:45.116756 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:39:45.116756 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:39:45.116756 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:39:45.116756 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:39:45.116756 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:39:45.116756 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:39:45.116756 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:39:45.116756 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:39:45.116756 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:39:45.116756 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:39:45.116756 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:39:45.116756 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:39:45.116756 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:39:45.116756 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:39:45.116756 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 23da26ba-68f4-4aef-b13c-0b6588a65e43 could not be found. Oct 04 20:39:45.116756 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:39:45.116756 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:39:45.116756 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:39:45.121597 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:39:45.121597 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:39:45.121597 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:39:45.121597 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:39:45.121597 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:39:45.121597 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 23da26ba-68f4-4aef-b13c-0b6588a65e43 could not be found. Oct 04 20:39:45.121597 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:39:45.124683 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-dd42cd20-22dd-4eff-a6f4-d1d3caab7edb tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Returning 404 to user: Instance 23da26ba-68f4-4aef-b13c-0b6588a65e43 could not be found. {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:39:45.128373 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-dd42cd20-22dd-4eff-a6f4-d1d3caab7edb tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] 10.222.0.33 "GET /compute/v2.1/servers/23da26ba-68f4-4aef-b13c-0b6588a65e43" status: 404 len: 111 microversion: 2.1 time: 0.091789 Oct 04 20:39:45.130940 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 834/1599] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:45 2022] GET /compute/v2.1/servers/23da26ba-68f4-4aef-b13c-0b6588a65e43 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 20:39:45.148291 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-53754261-ebfe-4432-b3e0-b7e5a6e77444 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:45.148814 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-53754261-ebfe-4432-b3e0-b7e5a6e77444 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] [instance: 465ad440-a27e-4ff6-bb31-09f3545e166a] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:45.166627 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-53754261-ebfe-4432-b3e0-b7e5a6e77444 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:45.167354 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-53754261-ebfe-4432-b3e0-b7e5a6e77444 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:45.167963 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-53754261-ebfe-4432-b3e0-b7e5a6e77444 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:45.168887 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-53754261-ebfe-4432-b3e0-b7e5a6e77444 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:45.169497 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-53754261-ebfe-4432-b3e0-b7e5a6e77444 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:45.170084 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-53754261-ebfe-4432-b3e0-b7e5a6e77444 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:45.243076 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-53754261-ebfe-4432-b3e0-b7e5a6e77444 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] [instance: 465ad440-a27e-4ff6-bb31-09f3545e166a] Going to try to terminate instance {{(pid=128802) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:39:45.276790 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-5f6735c6-f70a-47fc-955c-6764c51de5a7 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36f4114dc4f443f8b48da7b4027e0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a23a85365414f92bbc03177d7f190e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:45.292312 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5f6735c6-f70a-47fc-955c-6764c51de5a7 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] 10.222.0.33 "GET /compute/v2.1/servers/286a7673-8323-4451-b329-4b33690e1c48" status: 200 len: 1273 microversion: 2.1 time: 0.319668 Oct 04 20:39:45.292965 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 766/1600] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:44 2022] GET /compute/v2.1/servers/286a7673-8323-4451-b329-4b33690e1c48 => generated 1273 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:45.305911 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-88312cc7-03ca-40e8-b391-1ae41b5dd531 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Calling method '.version_select at 0x7f3c7889e430>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:45.398372 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-88312cc7-03ca-40e8-b391-1ae41b5dd531 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] 10.222.0.33 "GET /compute/v2.1/images/4ceaa94c-0232-4808-b979-89d23cbd895c" status: 200 len: 1421 microversion: 2.1 time: 0.103976 Oct 04 20:39:45.398963 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 767/1601] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 20:39:45 2022] GET /compute/v2.1/images/4ceaa94c-0232-4808-b979-89d23cbd895c => generated 1421 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:45.438456 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-53754261-ebfe-4432-b3e0-b7e5a6e77444 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] 10.222.0.33 "DELETE /compute/v2.1/servers/465ad440-a27e-4ff6-bb31-09f3545e166a" status: 204 len: 0 microversion: 2.1 time: 0.301997 Oct 04 20:39:45.439365 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 835/1602] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 20:39:45 2022] DELETE /compute/v2.1/servers/465ad440-a27e-4ff6-bb31-09f3545e166a => generated 0 bytes in 304 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:39:45.450358 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9a97945e-5d8f-47e4-a7d4-21e2798faa43 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:45.452821 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-9a97945e-5d8f-47e4-a7d4-21e2798faa43 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] [instance: 465ad440-a27e-4ff6-bb31-09f3545e166a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:45.465533 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9a97945e-5d8f-47e4-a7d4-21e2798faa43 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:45.467467 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9a97945e-5d8f-47e4-a7d4-21e2798faa43 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:45.468763 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9a97945e-5d8f-47e4-a7d4-21e2798faa43 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:45.469687 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9a97945e-5d8f-47e4-a7d4-21e2798faa43 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:45.470321 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9a97945e-5d8f-47e4-a7d4-21e2798faa43 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:45.471414 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9a97945e-5d8f-47e4-a7d4-21e2798faa43 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:45.778795 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-9a97945e-5d8f-47e4-a7d4-21e2798faa43 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3563efe2b8c94931a2a46c4e14811b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3118a5d96843d3bede1ed94bd9717e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:45.792686 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-9a97945e-5d8f-47e4-a7d4-21e2798faa43 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] 10.222.0.33 "GET /compute/v2.1/servers/465ad440-a27e-4ff6-bb31-09f3545e166a" status: 200 len: 1535 microversion: 2.1 time: 0.348325 Oct 04 20:39:45.793925 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 768/1603] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:45 2022] GET /compute/v2.1/servers/465ad440-a27e-4ff6-bb31-09f3545e166a => generated 1535 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:45.933098 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-5b8698c2-18f0-4cfa-9ccf-18ebec1ec8ff tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:45.933098 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-5b8698c2-18f0-4cfa-9ccf-18ebec1ec8ff tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] [instance: a2fc592c-9dac-4f72-8633-229925d3bf76] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:45.934033 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5b8698c2-18f0-4cfa-9ccf-18ebec1ec8ff tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:45.936986 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5b8698c2-18f0-4cfa-9ccf-18ebec1ec8ff tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:45.937999 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5b8698c2-18f0-4cfa-9ccf-18ebec1ec8ff tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:45.942258 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5b8698c2-18f0-4cfa-9ccf-18ebec1ec8ff tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:45.942877 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5b8698c2-18f0-4cfa-9ccf-18ebec1ec8ff tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:45.943416 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5b8698c2-18f0-4cfa-9ccf-18ebec1ec8ff tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:45.974166 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:39:46.155318 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5ecea69c-cd05-4cb5-bffa-e33384091221 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-180072453", "imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:39:46.224758 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-5b8698c2-18f0-4cfa-9ccf-18ebec1ec8ff tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96919ec99c14864876d64a9c2b20f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b44ce10b78bf49c882c9b4df06187114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:46.232874 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-5b8698c2-18f0-4cfa-9ccf-18ebec1ec8ff tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] 10.222.0.33 "GET /compute/v2.1/servers/a2fc592c-9dac-4f72-8633-229925d3bf76" status: 200 len: 1504 microversion: 2.1 time: 0.323129 Oct 04 20:39:46.237614 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 836/1604] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:45 2022] GET /compute/v2.1/servers/a2fc592c-9dac-4f72-8633-229925d3bf76 => generated 1504 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:46.315912 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.network.neutron [None req-5ecea69c-cd05-4cb5-bffa-e33384091221 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] validate_networks() for [('f7c73946-c8b6-4692-9980-985e34afc9ea', None, None, None, None, None)] {{(pid=128801) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:39:46.318306 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-8be95b26-2269-4325-bd6c-1fd9cbd55a52 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:46.319031 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-8be95b26-2269-4325-bd6c-1fd9cbd55a52 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] [instance: 286a7673-8323-4451-b329-4b33690e1c48] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:46.343401 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8be95b26-2269-4325-bd6c-1fd9cbd55a52 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:46.344287 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8be95b26-2269-4325-bd6c-1fd9cbd55a52 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:46.345109 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8be95b26-2269-4325-bd6c-1fd9cbd55a52 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:46.352581 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8be95b26-2269-4325-bd6c-1fd9cbd55a52 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:46.356183 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8be95b26-2269-4325-bd6c-1fd9cbd55a52 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:46.357175 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8be95b26-2269-4325-bd6c-1fd9cbd55a52 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:46.758090 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-8be95b26-2269-4325-bd6c-1fd9cbd55a52 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36f4114dc4f443f8b48da7b4027e0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a23a85365414f92bbc03177d7f190e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:46.772720 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-8be95b26-2269-4325-bd6c-1fd9cbd55a52 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] 10.222.0.33 "GET /compute/v2.1/servers/286a7673-8323-4451-b329-4b33690e1c48" status: 200 len: 1315 microversion: 2.1 time: 0.459230 Oct 04 20:39:46.773548 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 837/1605] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:46 2022] GET /compute/v2.1/servers/286a7673-8323-4451-b329-4b33690e1c48 => generated 1315 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:46.789019 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-b9986f2d-9cf7-42e0-a407-c81075e6950b tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Calling method '.version_select at 0x7f3c7450b1f0>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:46.893400 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-b9986f2d-9cf7-42e0-a407-c81075e6950b tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] 10.222.0.33 "GET /compute/v2.1/images/4ceaa94c-0232-4808-b979-89d23cbd895c" status: 200 len: 1421 microversion: 2.1 time: 0.116249 Oct 04 20:39:46.894303 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 838/1606] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 20:39:46 2022] GET /compute/v2.1/images/4ceaa94c-0232-4808-b979-89d23cbd895c => generated 1421 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:46.908710 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-de4a01b4-ed1c-4f1c-9ba0-68db9e4d1166 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:46.917744 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-de4a01b4-ed1c-4f1c-9ba0-68db9e4d1166 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] [instance: 465ad440-a27e-4ff6-bb31-09f3545e166a] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:46.943420 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-de4a01b4-ed1c-4f1c-9ba0-68db9e4d1166 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:46.950054 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-de4a01b4-ed1c-4f1c-9ba0-68db9e4d1166 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:46.950777 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-de4a01b4-ed1c-4f1c-9ba0-68db9e4d1166 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:46.951758 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-de4a01b4-ed1c-4f1c-9ba0-68db9e4d1166 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:46.953583 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-de4a01b4-ed1c-4f1c-9ba0-68db9e4d1166 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:46.958715 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-de4a01b4-ed1c-4f1c-9ba0-68db9e4d1166 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:46.989583 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-5ecea69c-cd05-4cb5-bffa-e33384091221 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Flavor limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:39:46.990019 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-5ecea69c-cd05-4cb5-bffa-e33384091221 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Image limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:39:46.990537 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-5ecea69c-cd05-4cb5-bffa-e33384091221 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Flavor pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:39:46.991002 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-5ecea69c-cd05-4cb5-bffa-e33384091221 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Image pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:39:46.991479 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-5ecea69c-cd05-4cb5-bffa-e33384091221 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:39:47.007225 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5ecea69c-cd05-4cb5-bffa-e33384091221 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:47.007716 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5ecea69c-cd05-4cb5-bffa-e33384091221 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:47.008169 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5ecea69c-cd05-4cb5-bffa-e33384091221 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:47.008900 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5ecea69c-cd05-4cb5-bffa-e33384091221 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:47.014679 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5ecea69c-cd05-4cb5-bffa-e33384091221 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:47.015263 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5ecea69c-cd05-4cb5-bffa-e33384091221 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:47.078272 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-5ecea69c-cd05-4cb5-bffa-e33384091221 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Getting quotas for project ecf3793be3eb4f3186c07a7e45fd8f06. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:39:47.083902 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-5ecea69c-cd05-4cb5-bffa-e33384091221 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Getting quotas for user 89a82c49a62249029ebc6ae3b4829709 and project ecf3793be3eb4f3186c07a7e45fd8f06. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:39:47.107987 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-5ecea69c-cd05-4cb5-bffa-e33384091221 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Going to run 1 instances... {{(pid=128801) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:39:47.110757 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-5ecea69c-cd05-4cb5-bffa-e33384091221 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] [instance: 0081d54e-8054-4f3b-9dd4-018f66aa4b27] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='15b24725-0c99-4bcf-b1fb-907cdf8e2d63',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128801) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:39:47.225415 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5ecea69c-cd05-4cb5-bffa-e33384091221 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.074756 Oct 04 20:39:47.232749 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 769/1607] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 20:39:46 2022] POST /compute/v2.1/servers => generated 383 bytes in 1083 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 20:39:47.248906 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8430e9d5-4b17-4bd1-9b15-289a998cf160 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:47.254139 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-8430e9d5-4b17-4bd1-9b15-289a998cf160 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] [instance: 0081d54e-8054-4f3b-9dd4-018f66aa4b27] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:47.388773 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-8430e9d5-4b17-4bd1-9b15-289a998cf160 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a82c49a62249029ebc6ae3b4829709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecf3793be3eb4f3186c07a7e45fd8f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:47.401570 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-8430e9d5-4b17-4bd1-9b15-289a998cf160 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] 10.222.0.33 "GET /compute/v2.1/servers/0081d54e-8054-4f3b-9dd4-018f66aa4b27" status: 200 len: 1224 microversion: 2.1 time: 0.159694 Oct 04 20:39:47.405180 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 770/1608] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:47 2022] GET /compute/v2.1/servers/0081d54e-8054-4f3b-9dd4-018f66aa4b27 => generated 1224 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:47.415723 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-de4a01b4-ed1c-4f1c-9ba0-68db9e4d1166 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3563efe2b8c94931a2a46c4e14811b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3118a5d96843d3bede1ed94bd9717e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:47.427060 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-02924209-953c-44b9-8173-5d4902c2af0f tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:47.427694 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-02924209-953c-44b9-8173-5d4902c2af0f tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] [instance: a2fc592c-9dac-4f72-8633-229925d3bf76] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:47.443707 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-de4a01b4-ed1c-4f1c-9ba0-68db9e4d1166 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] 10.222.0.33 "GET /compute/v2.1/servers/465ad440-a27e-4ff6-bb31-09f3545e166a" status: 200 len: 1535 microversion: 2.1 time: 0.548216 Oct 04 20:39:47.444433 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 839/1609] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:46 2022] GET /compute/v2.1/servers/465ad440-a27e-4ff6-bb31-09f3545e166a => generated 1535 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:47.462758 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-02924209-953c-44b9-8173-5d4902c2af0f tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:47.463370 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-02924209-953c-44b9-8173-5d4902c2af0f tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:47.463688 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-02924209-953c-44b9-8173-5d4902c2af0f tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:47.465391 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-02924209-953c-44b9-8173-5d4902c2af0f tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:47.465738 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-02924209-953c-44b9-8173-5d4902c2af0f tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:47.466809 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-02924209-953c-44b9-8173-5d4902c2af0f tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:47.797801 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-8fc42409-a23c-4365-8aff-513339488df8 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:47.798441 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-8fc42409-a23c-4365-8aff-513339488df8 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] [instance: 286a7673-8323-4451-b329-4b33690e1c48] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:47.811764 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8fc42409-a23c-4365-8aff-513339488df8 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:47.816477 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8fc42409-a23c-4365-8aff-513339488df8 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:47.819637 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8fc42409-a23c-4365-8aff-513339488df8 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:47.822212 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8fc42409-a23c-4365-8aff-513339488df8 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:47.824548 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8fc42409-a23c-4365-8aff-513339488df8 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:47.827051 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8fc42409-a23c-4365-8aff-513339488df8 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:48.304527 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-02924209-953c-44b9-8173-5d4902c2af0f tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96919ec99c14864876d64a9c2b20f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b44ce10b78bf49c882c9b4df06187114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:48.320130 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-02924209-953c-44b9-8173-5d4902c2af0f tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] 10.222.0.33 "GET /compute/v2.1/servers/a2fc592c-9dac-4f72-8633-229925d3bf76" status: 200 len: 1504 microversion: 2.1 time: 0.907553 Oct 04 20:39:48.339732 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 771/1610] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:47 2022] GET /compute/v2.1/servers/a2fc592c-9dac-4f72-8633-229925d3bf76 => generated 1504 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:48.367881 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8ed5d2c8-5ec3-4ba4-9cf7-23e5f702d837 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Calling method '.version_select at 0x7f3c788a1790>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:48.476081 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-8ed5d2c8-5ec3-4ba4-9cf7-23e5f702d837 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] 10.222.0.33 "GET /compute/v2.1/images/4ceaa94c-0232-4808-b979-89d23cbd895c" status: 200 len: 1421 microversion: 2.1 time: 0.134844 Oct 04 20:39:48.476685 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 772/1611] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 20:39:48 2022] GET /compute/v2.1/images/4ceaa94c-0232-4808-b979-89d23cbd895c => generated 1421 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:48.493150 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-304c46d8-1da3-4199-9252-d985449a2235 req-ab723ab2-0e86-4ab8-906a-2657d8e728ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "465ad440-a27e-4ff6-bb31-09f3545e166a", "name": "network-vif-deleted", "tag": "c16cb04f-6af6-4073-98de-ed8d89a2e3c2"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:39:48.502045 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-8fc42409-a23c-4365-8aff-513339488df8 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36f4114dc4f443f8b48da7b4027e0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a23a85365414f92bbc03177d7f190e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:48.528918 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-8fc42409-a23c-4365-8aff-513339488df8 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] 10.222.0.33 "GET /compute/v2.1/servers/286a7673-8323-4451-b329-4b33690e1c48" status: 200 len: 1315 microversion: 2.1 time: 0.729223 Oct 04 20:39:48.531201 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 840/1612] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:47 2022] GET /compute/v2.1/servers/286a7673-8323-4451-b329-4b33690e1c48 => generated 1315 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:48.544791 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-88c6e656-31bd-4357-850a-1aef8d3f6f36 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:48.567766 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-88c6e656-31bd-4357-850a-1aef8d3f6f36 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] [instance: 0081d54e-8054-4f3b-9dd4-018f66aa4b27] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:48.576864 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-304c46d8-1da3-4199-9252-d985449a2235 req-ab723ab2-0e86-4ab8-906a-2657d8e728ef service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:48.579417 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-304c46d8-1da3-4199-9252-d985449a2235 req-ab723ab2-0e86-4ab8-906a-2657d8e728ef service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:48.579887 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-304c46d8-1da3-4199-9252-d985449a2235 req-ab723ab2-0e86-4ab8-906a-2657d8e728ef service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:48.581509 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-88c6e656-31bd-4357-850a-1aef8d3f6f36 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:48.583235 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-88c6e656-31bd-4357-850a-1aef8d3f6f36 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:48.585211 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-88c6e656-31bd-4357-850a-1aef8d3f6f36 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:48.589392 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-88c6e656-31bd-4357-850a-1aef8d3f6f36 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:48.590634 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-88c6e656-31bd-4357-850a-1aef8d3f6f36 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:48.593402 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-88c6e656-31bd-4357-850a-1aef8d3f6f36 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:48.627310 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-304c46d8-1da3-4199-9252-d985449a2235 req-ab723ab2-0e86-4ab8-906a-2657d8e728ef service nova] Creating event network-vif-deleted:c16cb04f-6af6-4073-98de-ed8d89a2e3c2 for instance 465ad440-a27e-4ff6-bb31-09f3545e166a on n-h2-854823-8 Oct 04 20:39:48.659030 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-304c46d8-1da3-4199-9252-d985449a2235 req-ab723ab2-0e86-4ab8-906a-2657d8e728ef service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.173554 Oct 04 20:39:48.664079 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 773/1613] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:39:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:39:48.671136 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-58ef888f-d7ae-408e-9f59-b03b4c1474f9 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:48.681484 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-58ef888f-d7ae-408e-9f59-b03b4c1474f9 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] [instance: 465ad440-a27e-4ff6-bb31-09f3545e166a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:48.695987 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-58ef888f-d7ae-408e-9f59-b03b4c1474f9 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:48.696703 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-58ef888f-d7ae-408e-9f59-b03b4c1474f9 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:48.697308 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-58ef888f-d7ae-408e-9f59-b03b4c1474f9 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:48.701683 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-58ef888f-d7ae-408e-9f59-b03b4c1474f9 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:48.702493 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-58ef888f-d7ae-408e-9f59-b03b4c1474f9 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:48.703235 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-58ef888f-d7ae-408e-9f59-b03b4c1474f9 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:48.827871 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-58ef888f-d7ae-408e-9f59-b03b4c1474f9 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:48.828622 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-58ef888f-d7ae-408e-9f59-b03b4c1474f9 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:48.829240 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-58ef888f-d7ae-408e-9f59-b03b4c1474f9 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:48.831315 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-58ef888f-d7ae-408e-9f59-b03b4c1474f9 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lazy-loading 'fault' on Instance uuid 465ad440-a27e-4ff6-bb31-09f3545e166a {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:39:48.838793 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:39:48.842992 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-88c6e656-31bd-4357-850a-1aef8d3f6f36 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a82c49a62249029ebc6ae3b4829709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecf3793be3eb4f3186c07a7e45fd8f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:48.858334 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-88c6e656-31bd-4357-850a-1aef8d3f6f36 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] 10.222.0.33 "GET /compute/v2.1/servers/0081d54e-8054-4f3b-9dd4-018f66aa4b27" status: 200 len: 1276 microversion: 2.1 time: 0.325682 Oct 04 20:39:48.859693 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 841/1614] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:48 2022] GET /compute/v2.1/servers/0081d54e-8054-4f3b-9dd4-018f66aa4b27 => generated 1276 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:48.987916 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-58ef888f-d7ae-408e-9f59-b03b4c1474f9 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3563efe2b8c94931a2a46c4e14811b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3118a5d96843d3bede1ed94bd9717e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:49.001241 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-58ef888f-d7ae-408e-9f59-b03b4c1474f9 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] 10.222.0.33 "GET /compute/v2.1/servers/465ad440-a27e-4ff6-bb31-09f3545e166a" status: 200 len: 1369 microversion: 2.1 time: 0.333020 Oct 04 20:39:49.001463 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 774/1615] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:48 2022] GET /compute/v2.1/servers/465ad440-a27e-4ff6-bb31-09f3545e166a => generated 1369 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:49.358564 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-5b8ab2b9-8540-4352-b724-143246b4e0fd tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:49.359179 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-5b8ab2b9-8540-4352-b724-143246b4e0fd tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] [instance: a2fc592c-9dac-4f72-8633-229925d3bf76] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:49.370305 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5b8ab2b9-8540-4352-b724-143246b4e0fd tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:49.371287 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5b8ab2b9-8540-4352-b724-143246b4e0fd tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:49.371885 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5b8ab2b9-8540-4352-b724-143246b4e0fd tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:49.372944 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5b8ab2b9-8540-4352-b724-143246b4e0fd tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:49.373675 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5b8ab2b9-8540-4352-b724-143246b4e0fd tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:49.374270 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5b8ab2b9-8540-4352-b724-143246b4e0fd tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:49.492386 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5bac64f5-6ea7-41be-8021-68a394d43d5c tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Calling method '.version_select at 0x7f3c788aeaf0>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:49.614233 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5bac64f5-6ea7-41be-8021-68a394d43d5c tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] 10.222.0.33 "GET /compute/v2.1/images/4ceaa94c-0232-4808-b979-89d23cbd895c" status: 200 len: 1421 microversion: 2.1 time: 0.125360 Oct 04 20:39:49.614852 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 775/1616] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 20:39:49 2022] GET /compute/v2.1/images/4ceaa94c-0232-4808-b979-89d23cbd895c => generated 1421 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:39:49.625295 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e5844c0d-7582-4d96-bb0b-54d8cc7aadd0 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:49.636043 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e5844c0d-7582-4d96-bb0b-54d8cc7aadd0 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] [instance: 286a7673-8323-4451-b329-4b33690e1c48] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:49.649612 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-5b8ab2b9-8540-4352-b724-143246b4e0fd tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96919ec99c14864876d64a9c2b20f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b44ce10b78bf49c882c9b4df06187114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:49.651383 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e5844c0d-7582-4d96-bb0b-54d8cc7aadd0 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:49.652217 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e5844c0d-7582-4d96-bb0b-54d8cc7aadd0 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:49.652876 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e5844c0d-7582-4d96-bb0b-54d8cc7aadd0 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:49.653784 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e5844c0d-7582-4d96-bb0b-54d8cc7aadd0 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:49.654502 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e5844c0d-7582-4d96-bb0b-54d8cc7aadd0 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:49.655105 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e5844c0d-7582-4d96-bb0b-54d8cc7aadd0 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:49.666906 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-5b8ab2b9-8540-4352-b724-143246b4e0fd tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] 10.222.0.33 "GET /compute/v2.1/servers/a2fc592c-9dac-4f72-8633-229925d3bf76" status: 200 len: 1504 microversion: 2.1 time: 0.312887 Oct 04 20:39:49.667854 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 842/1617] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:49 2022] GET /compute/v2.1/servers/a2fc592c-9dac-4f72-8633-229925d3bf76 => generated 1504 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:49.887274 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-45f25a73-84b0-4ec7-a0d1-1e07808ac4ea tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:49.888239 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-45f25a73-84b0-4ec7-a0d1-1e07808ac4ea tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] [instance: 0081d54e-8054-4f3b-9dd4-018f66aa4b27] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:49.903338 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-45f25a73-84b0-4ec7-a0d1-1e07808ac4ea tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:49.907243 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-45f25a73-84b0-4ec7-a0d1-1e07808ac4ea tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:49.914298 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-45f25a73-84b0-4ec7-a0d1-1e07808ac4ea tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:49.921274 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-45f25a73-84b0-4ec7-a0d1-1e07808ac4ea tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:49.922088 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-45f25a73-84b0-4ec7-a0d1-1e07808ac4ea tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:49.924877 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-45f25a73-84b0-4ec7-a0d1-1e07808ac4ea tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:50.155884 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-45f25a73-84b0-4ec7-a0d1-1e07808ac4ea tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a82c49a62249029ebc6ae3b4829709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecf3793be3eb4f3186c07a7e45fd8f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:50.170213 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-45f25a73-84b0-4ec7-a0d1-1e07808ac4ea tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] 10.222.0.33 "GET /compute/v2.1/servers/0081d54e-8054-4f3b-9dd4-018f66aa4b27" status: 200 len: 1294 microversion: 2.1 time: 0.284388 Oct 04 20:39:50.172950 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 843/1618] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:49 2022] GET /compute/v2.1/servers/0081d54e-8054-4f3b-9dd4-018f66aa4b27 => generated 1294 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:50.195297 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-62245aca-3440-471b-9582-f1cb04e2d472 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:50.199197 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-62245aca-3440-471b-9582-f1cb04e2d472 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] [instance: 465ad440-a27e-4ff6-bb31-09f3545e166a] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:50.215427 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-62245aca-3440-471b-9582-f1cb04e2d472 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:50.217469 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-62245aca-3440-471b-9582-f1cb04e2d472 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:50.218096 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-62245aca-3440-471b-9582-f1cb04e2d472 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:50.222110 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-62245aca-3440-471b-9582-f1cb04e2d472 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:50.223385 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-62245aca-3440-471b-9582-f1cb04e2d472 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:50.225207 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-62245aca-3440-471b-9582-f1cb04e2d472 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:50.263299 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.wsgi [None req-62245aca-3440-471b-9582-f1cb04e2d472 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] HTTP exception thrown: Instance 465ad440-a27e-4ff6-bb31-09f3545e166a could not be found. Oct 04 20:39:50.269348 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-62245aca-3440-471b-9582-f1cb04e2d472 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Request method failure captured: Oct 04 20:39:50.269348 n-d-854823-8 devstack@n-api.service[128802]: request: GET /compute/v2.1/servers/465ad440-a27e-4ff6-bb31-09f3545e166a HTTP/1.1 Oct 04 20:39:50.269348 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 20:39:50.269348 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 20:39:50.269348 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 20:39:50.269348 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 0 Oct 04 20:39:50.269348 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 20:39:50.269348 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 20:39:50.269348 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 20:39:50.269348 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 20:39:50.269348 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPJi4YW5paijGjm0KJCD3xPCjqoV7Yx2gPBOteSu0r3DtnBaxauAhN82fJ8sA4jGopne1RZKgRzfyGU8WtYmELZERLpy7PD9YLLtoJOaL9dbdJigxopqVQsdWKaWPFztWyama9XcrUH3oJLe6wPMcVbEBemlmJBzjFTlhWfl4Iuq6Rdc Oct 04 20:39:50.269348 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 20:39:50.269348 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 20:39:50.269348 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 20:39:50.269348 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 20:39:50.269348 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 20:39:50.269348 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 20:39:50.269348 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: dd3118a5d96843d3bede1ed94bd9717e Oct 04 20:39:50.269348 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-MigrationsAdminTest-282898562 Oct 04 20:39:50.269348 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 20:39:50.269348 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 20:39:50.269348 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_dd3118a5d96843d3bede1ed94bd9717e", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/dd3118a5d96843d3bede1ed94bd9717e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/dd3118a5d96843d3bede1ed94bd9717e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/dd3118a5d96843d3bede1ed94bd9717e"}]}] Oct 04 20:39:50.269348 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-MigrationsAdminTest-282898562 Oct 04 20:39:50.269348 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: dd3118a5d96843d3bede1ed94bd9717e Oct 04 20:39:50.269348 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-MigrationsAdminTest-282898562 Oct 04 20:39:50.269348 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-MigrationsAdminTest-282898562-project Oct 04 20:39:50.269348 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 20:39:50.269348 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 20:39:50.269348 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: 3563efe2b8c94931a2a46c4e14811b3a Oct 04 20:39:50.269348 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-MigrationsAdminTest-282898562-project Oct 04 20:39:50.269348 n-d-854823-8 devstack@n-api.service[128802]: method: > Oct 04 20:39:50.269348 n-d-854823-8 devstack@n-api.service[128802]: exception: Instance 465ad440-a27e-4ff6-bb31-09f3545e166a could not be found. Oct 04 20:39:50.269348 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'id': '465ad440-a27e-4ff6-bb31-09f3545e166a'} Oct 04 20:39:50.269348 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:39:50.269348 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:39:50.269348 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:39:50.269348 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:39:50.269348 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:39:50.269348 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:39:50.269348 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:39:50.269348 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:39:50.269348 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:39:50.269348 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:39:50.269348 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 465ad440-a27e-4ff6-bb31-09f3545e166a could not be found. Oct 04 20:39:50.269348 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:39:50.269348 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:39:50.269348 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:39:50.269348 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:39:50.269348 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:39:50.269348 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:39:50.269348 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:39:50.269348 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:39:50.269348 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:39:50.269348 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:39:50.269348 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:39:50.269348 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:39:50.269348 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:39:50.269348 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:39:50.269348 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:39:50.269348 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:39:50.269348 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 465ad440-a27e-4ff6-bb31-09f3545e166a could not be found. Oct 04 20:39:50.269348 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:39:50.269348 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:39:50.269348 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:39:50.274642 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:39:50.274642 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:39:50.274642 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:39:50.274642 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:39:50.274642 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:39:50.274642 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 465ad440-a27e-4ff6-bb31-09f3545e166a could not be found. Oct 04 20:39:50.274642 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:39:50.277780 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-62245aca-3440-471b-9582-f1cb04e2d472 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Returning 404 to user: Instance 465ad440-a27e-4ff6-bb31-09f3545e166a could not be found. {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:39:50.279953 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-62245aca-3440-471b-9582-f1cb04e2d472 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] 10.222.0.33 "GET /compute/v2.1/servers/465ad440-a27e-4ff6-bb31-09f3545e166a" status: 404 len: 111 microversion: 2.1 time: 0.105217 Oct 04 20:39:50.284138 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 844/1619] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:50 2022] GET /compute/v2.1/servers/465ad440-a27e-4ff6-bb31-09f3545e166a => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:39:50.295479 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-4fe132cb-6b25-456a-a802-32c396afdf08 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Calling method '.version_select at 0x7f3c74877c10>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:50.340219 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-4fe132cb-6b25-456a-a802-32c396afdf08 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-994478319" status: 202 len: 0 microversion: 2.1 time: 0.052649 Oct 04 20:39:50.344360 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e5844c0d-7582-4d96-bb0b-54d8cc7aadd0 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36f4114dc4f443f8b48da7b4027e0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a23a85365414f92bbc03177d7f190e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:50.344883 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 845/1620] 10.222.0.33 () {58 vars in 1218 bytes} [Tue Oct 4 20:39:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-994478319 => generated 0 bytes in 58 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:39:50.353765 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e5844c0d-7582-4d96-bb0b-54d8cc7aadd0 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] 10.222.0.33 "GET /compute/v2.1/servers/286a7673-8323-4451-b329-4b33690e1c48" status: 200 len: 1315 microversion: 2.1 time: 0.737222 Oct 04 20:39:50.361101 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 776/1621] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:49 2022] GET /compute/v2.1/servers/286a7673-8323-4451-b329-4b33690e1c48 => generated 1315 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:50.472512 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-72300aae-d8fb-4f6e-b203-8ba7091490a8 req-da94c24c-a46b-47e8-aa7c-f3dce37de32a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "286a7673-8323-4451-b329-4b33690e1c48", "tag": "ffee23db-b749-4944-8249-c57f4f15636e"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:39:50.501167 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-72300aae-d8fb-4f6e-b203-8ba7091490a8 req-da94c24c-a46b-47e8-aa7c-f3dce37de32a service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:50.502861 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-72300aae-d8fb-4f6e-b203-8ba7091490a8 req-da94c24c-a46b-47e8-aa7c-f3dce37de32a service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:50.504906 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-72300aae-d8fb-4f6e-b203-8ba7091490a8 req-da94c24c-a46b-47e8-aa7c-f3dce37de32a service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:50.537545 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-72300aae-d8fb-4f6e-b203-8ba7091490a8 req-da94c24c-a46b-47e8-aa7c-f3dce37de32a service nova] Creating event network-changed:ffee23db-b749-4944-8249-c57f4f15636e for instance 286a7673-8323-4451-b329-4b33690e1c48 on n-h2-854823-8 Oct 04 20:39:50.544019 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-72300aae-d8fb-4f6e-b203-8ba7091490a8 req-da94c24c-a46b-47e8-aa7c-f3dce37de32a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077596 Oct 04 20:39:50.545438 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 846/1622] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:39:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:39:50.641778 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-fcf79185-8038-412d-a0de-f259af95ca3a tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Calling method '.version_select at 0x7f3c74cced30>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:50.697314 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-b5fc8e7e-ad0a-472a-bae1-d197290f2360 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:50.699056 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-b5fc8e7e-ad0a-472a-bae1-d197290f2360 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] [instance: a2fc592c-9dac-4f72-8633-229925d3bf76] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:50.717372 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b5fc8e7e-ad0a-472a-bae1-d197290f2360 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:50.718155 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b5fc8e7e-ad0a-472a-bae1-d197290f2360 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:50.719981 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b5fc8e7e-ad0a-472a-bae1-d197290f2360 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:50.723240 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b5fc8e7e-ad0a-472a-bae1-d197290f2360 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:50.725348 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b5fc8e7e-ad0a-472a-bae1-d197290f2360 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:50.726199 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-fcf79185-8038-412d-a0de-f259af95ca3a tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] 10.222.0.33 "GET /compute/v2.1/images/4ceaa94c-0232-4808-b979-89d23cbd895c" status: 200 len: 1421 microversion: 2.1 time: 0.094581 Oct 04 20:39:50.729727 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 777/1623] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 20:39:50 2022] GET /compute/v2.1/images/4ceaa94c-0232-4808-b979-89d23cbd895c => generated 1421 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:50.735354 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b5fc8e7e-ad0a-472a-bae1-d197290f2360 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:50.917507 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell0:SELECT=2 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:39:51.109582 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-b5fc8e7e-ad0a-472a-bae1-d197290f2360 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96919ec99c14864876d64a9c2b20f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b44ce10b78bf49c882c9b4df06187114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:51.120488 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-b5fc8e7e-ad0a-472a-bae1-d197290f2360 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] 10.222.0.33 "GET /compute/v2.1/servers/a2fc592c-9dac-4f72-8633-229925d3bf76" status: 200 len: 1504 microversion: 2.1 time: 0.429391 Oct 04 20:39:51.121085 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 847/1624] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:50 2022] GET /compute/v2.1/servers/a2fc592c-9dac-4f72-8633-229925d3bf76 => generated 1504 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:51.204147 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-3d6b75e3-c749-4a79-aa6e-18d4f2e10c30 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:51.206488 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-3d6b75e3-c749-4a79-aa6e-18d4f2e10c30 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] [instance: 0081d54e-8054-4f3b-9dd4-018f66aa4b27] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:51.224642 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3d6b75e3-c749-4a79-aa6e-18d4f2e10c30 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:51.228342 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3d6b75e3-c749-4a79-aa6e-18d4f2e10c30 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:51.229004 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3d6b75e3-c749-4a79-aa6e-18d4f2e10c30 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:51.231231 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3d6b75e3-c749-4a79-aa6e-18d4f2e10c30 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:51.233770 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3d6b75e3-c749-4a79-aa6e-18d4f2e10c30 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:51.234537 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3d6b75e3-c749-4a79-aa6e-18d4f2e10c30 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:51.393425 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-a19bf046-3aa3-4c85-afaa-9453c23df0ab tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:51.394451 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-a19bf046-3aa3-4c85-afaa-9453c23df0ab tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] [instance: 286a7673-8323-4451-b329-4b33690e1c48] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:51.416730 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a19bf046-3aa3-4c85-afaa-9453c23df0ab tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:51.423980 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a19bf046-3aa3-4c85-afaa-9453c23df0ab tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:51.431091 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a19bf046-3aa3-4c85-afaa-9453c23df0ab tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:51.431986 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a19bf046-3aa3-4c85-afaa-9453c23df0ab tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:51.432474 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a19bf046-3aa3-4c85-afaa-9453c23df0ab tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:51.432915 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a19bf046-3aa3-4c85-afaa-9453c23df0ab tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:52.123301 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-a19bf046-3aa3-4c85-afaa-9453c23df0ab tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36f4114dc4f443f8b48da7b4027e0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a23a85365414f92bbc03177d7f190e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:52.135970 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-a19bf046-3aa3-4c85-afaa-9453c23df0ab tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] 10.222.0.33 "GET /compute/v2.1/servers/286a7673-8323-4451-b329-4b33690e1c48" status: 200 len: 1315 microversion: 2.1 time: 0.750201 Oct 04 20:39:52.140927 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 848/1625] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:51 2022] GET /compute/v2.1/servers/286a7673-8323-4451-b329-4b33690e1c48 => generated 1315 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:52.147175 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-3d6b75e3-c749-4a79-aa6e-18d4f2e10c30 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a82c49a62249029ebc6ae3b4829709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecf3793be3eb4f3186c07a7e45fd8f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:52.160381 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-3797e23a-8757-4a27-a42b-6c4dc84b950f tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Calling method '.version_select at 0x7f3c744bc1f0>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:52.161016 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-3d6b75e3-c749-4a79-aa6e-18d4f2e10c30 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] 10.222.0.33 "GET /compute/v2.1/servers/0081d54e-8054-4f3b-9dd4-018f66aa4b27" status: 200 len: 1324 microversion: 2.1 time: 0.964491 Oct 04 20:39:52.162780 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 778/1626] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:51 2022] GET /compute/v2.1/servers/0081d54e-8054-4f3b-9dd4-018f66aa4b27 => generated 1324 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:52.181580 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0fbaadd2-7ea4-4276-b5f3-8f3d63d490d3 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:52.182650 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-0fbaadd2-7ea4-4276-b5f3-8f3d63d490d3 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] [instance: a2fc592c-9dac-4f72-8633-229925d3bf76] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:52.201902 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0fbaadd2-7ea4-4276-b5f3-8f3d63d490d3 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:52.203667 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0fbaadd2-7ea4-4276-b5f3-8f3d63d490d3 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:52.205460 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0fbaadd2-7ea4-4276-b5f3-8f3d63d490d3 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:52.206406 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0fbaadd2-7ea4-4276-b5f3-8f3d63d490d3 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:52.212536 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0fbaadd2-7ea4-4276-b5f3-8f3d63d490d3 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:52.213256 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0fbaadd2-7ea4-4276-b5f3-8f3d63d490d3 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:52.251699 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-3797e23a-8757-4a27-a42b-6c4dc84b950f tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] 10.222.0.33 "GET /compute/v2.1/images/4ceaa94c-0232-4808-b979-89d23cbd895c" status: 200 len: 1421 microversion: 2.1 time: 0.108453 Oct 04 20:39:52.253815 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 849/1627] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 20:39:52 2022] GET /compute/v2.1/images/4ceaa94c-0232-4808-b979-89d23cbd895c => generated 1421 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:52.716249 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-6189ff79-1981-4f05-b195-d80ef40b3409 tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:52.717312 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-6189ff79-1981-4f05-b195-d80ef40b3409 tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] [instance: 81748c83-b703-4c68-899c-c575cc3340d2] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:52.729452 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6189ff79-1981-4f05-b195-d80ef40b3409 tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:52.730325 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6189ff79-1981-4f05-b195-d80ef40b3409 tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:52.732811 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6189ff79-1981-4f05-b195-d80ef40b3409 tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:52.733859 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6189ff79-1981-4f05-b195-d80ef40b3409 tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:52.735912 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6189ff79-1981-4f05-b195-d80ef40b3409 tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:52.737190 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6189ff79-1981-4f05-b195-d80ef40b3409 tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:53.175455 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-0fbaadd2-7ea4-4276-b5f3-8f3d63d490d3 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96919ec99c14864876d64a9c2b20f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b44ce10b78bf49c882c9b4df06187114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:53.189436 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-0fbaadd2-7ea4-4276-b5f3-8f3d63d490d3 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] 10.222.0.33 "GET /compute/v2.1/servers/a2fc592c-9dac-4f72-8633-229925d3bf76" status: 200 len: 1504 microversion: 2.1 time: 1.024869 Oct 04 20:39:53.190384 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 779/1628] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:52 2022] GET /compute/v2.1/servers/a2fc592c-9dac-4f72-8633-229925d3bf76 => generated 1504 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:53.209750 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e30bb006-21f2-499d-98f0-31955e377414 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:53.210410 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e30bb006-21f2-499d-98f0-31955e377414 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] [instance: 286a7673-8323-4451-b329-4b33690e1c48] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:53.211157 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.objects.instance [None req-6189ff79-1981-4f05-b195-d80ef40b3409 tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] Lazy-loading 'services' on Instance uuid 81748c83-b703-4c68-899c-c575cc3340d2 {{(pid=128802) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:39:53.220123 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e30bb006-21f2-499d-98f0-31955e377414 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:53.221247 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e30bb006-21f2-499d-98f0-31955e377414 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:53.221676 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e30bb006-21f2-499d-98f0-31955e377414 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:53.223378 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e30bb006-21f2-499d-98f0-31955e377414 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:53.224029 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e30bb006-21f2-499d-98f0-31955e377414 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:53.224624 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e30bb006-21f2-499d-98f0-31955e377414 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:53.260666 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-6189ff79-1981-4f05-b195-d80ef40b3409 tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/81748c83-b703-4c68-899c-c575cc3340d2" status: 200 len: 2420 microversion: 2.25 time: 0.547526 Oct 04 20:39:53.263416 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 850/1629] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:39:52 2022] GET /compute/v2.1/servers/81748c83-b703-4c68-899c-c575cc3340d2 => generated 2420 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 20:39:53.270804 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-e0a052a0-dd1b-4f8d-879e-5ed9ee7d3c8e tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:53.271656 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-e0a052a0-dd1b-4f8d-879e-5ed9ee7d3c8e tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] [instance: 0081d54e-8054-4f3b-9dd4-018f66aa4b27] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:53.281208 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e0a052a0-dd1b-4f8d-879e-5ed9ee7d3c8e tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:53.287107 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e0a052a0-dd1b-4f8d-879e-5ed9ee7d3c8e tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:53.287816 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e0a052a0-dd1b-4f8d-879e-5ed9ee7d3c8e tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:53.288904 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e0a052a0-dd1b-4f8d-879e-5ed9ee7d3c8e tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:53.289516 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e0a052a0-dd1b-4f8d-879e-5ed9ee7d3c8e tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:53.290297 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e0a052a0-dd1b-4f8d-879e-5ed9ee7d3c8e tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:53.746361 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-e0a052a0-dd1b-4f8d-879e-5ed9ee7d3c8e tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a82c49a62249029ebc6ae3b4829709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecf3793be3eb4f3186c07a7e45fd8f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:53.759144 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-e0a052a0-dd1b-4f8d-879e-5ed9ee7d3c8e tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] 10.222.0.33 "GET /compute/v2.1/servers/0081d54e-8054-4f3b-9dd4-018f66aa4b27" status: 200 len: 1324 microversion: 2.1 time: 0.494279 Oct 04 20:39:53.760087 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 851/1630] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:53 2022] GET /compute/v2.1/servers/0081d54e-8054-4f3b-9dd4-018f66aa4b27 => generated 1324 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:53.769624 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-c2376037-ac5e-469f-ab55-9489da412371 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Calling method '.version_select at 0x7f3c7432bb80>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:53.835696 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e30bb006-21f2-499d-98f0-31955e377414 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36f4114dc4f443f8b48da7b4027e0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a23a85365414f92bbc03177d7f190e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:53.868918 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e30bb006-21f2-499d-98f0-31955e377414 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] 10.222.0.33 "GET /compute/v2.1/servers/286a7673-8323-4451-b329-4b33690e1c48" status: 200 len: 1315 microversion: 2.1 time: 0.676474 Oct 04 20:39:53.869560 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 780/1631] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:53 2022] GET /compute/v2.1/servers/286a7673-8323-4451-b329-4b33690e1c48 => generated 1315 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:53.877105 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e5918cad-761c-448d-a996-921b4759ffc1 tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-854823-8", "block_migration": "auto"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:39:53.880447 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e5918cad-761c-448d-a996-921b4759ffc1 tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] [instance: 81748c83-b703-4c68-899c-c575cc3340d2] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:53.882529 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-c2376037-ac5e-469f-ab55-9489da412371 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] 10.222.0.33 "GET /compute/v2.1/images/4ceaa94c-0232-4808-b979-89d23cbd895c" status: 200 len: 1421 microversion: 2.1 time: 0.119456 Oct 04 20:39:53.884768 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 852/1632] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 20:39:53 2022] GET /compute/v2.1/images/4ceaa94c-0232-4808-b979-89d23cbd895c => generated 1421 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:53.898633 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e5918cad-761c-448d-a996-921b4759ffc1 tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:53.900454 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e5918cad-761c-448d-a996-921b4759ffc1 tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:53.901386 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e5918cad-761c-448d-a996-921b4759ffc1 tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:53.908953 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e5918cad-761c-448d-a996-921b4759ffc1 tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:53.911183 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e5918cad-761c-448d-a996-921b4759ffc1 tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:53.912006 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e5918cad-761c-448d-a996-921b4759ffc1 tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:53.972069 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-e5918cad-761c-448d-a996-921b4759ffc1 tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] Lazy-loading 'flavor' on Instance uuid 81748c83-b703-4c68-899c-c575cc3340d2 {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:39:53.999446 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e5918cad-761c-448d-a996-921b4759ffc1 tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] [instance: 81748c83-b703-4c68-899c-c575cc3340d2] Going to try to live migrate instance to n-h1-854823-8 {{(pid=128801) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 04 20:39:54.167367 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-176e097e-b2f1-4ecc-9c00-de99cefc9e00 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:54.168283 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-176e097e-b2f1-4ecc-9c00-de99cefc9e00 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] [instance: c7f3bb5b-e08b-4a3f-ba4d-40012179412e] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:54.178268 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-176e097e-b2f1-4ecc-9c00-de99cefc9e00 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:54.179194 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-176e097e-b2f1-4ecc-9c00-de99cefc9e00 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:54.179866 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-176e097e-b2f1-4ecc-9c00-de99cefc9e00 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:54.180841 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-176e097e-b2f1-4ecc-9c00-de99cefc9e00 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:54.181907 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-176e097e-b2f1-4ecc-9c00-de99cefc9e00 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:54.182616 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-176e097e-b2f1-4ecc-9c00-de99cefc9e00 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:54.222042 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-176e097e-b2f1-4ecc-9c00-de99cefc9e00 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] [instance: c7f3bb5b-e08b-4a3f-ba4d-40012179412e] Going to try to terminate instance {{(pid=128802) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:39:54.426613 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-176e097e-b2f1-4ecc-9c00-de99cefc9e00 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] 10.222.0.33 "DELETE /compute/v2.1/servers/c7f3bb5b-e08b-4a3f-ba4d-40012179412e" status: 204 len: 0 microversion: 2.1 time: 0.262766 Oct 04 20:39:54.430817 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 853/1633] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 20:39:54 2022] DELETE /compute/v2.1/servers/c7f3bb5b-e08b-4a3f-ba4d-40012179412e => generated 0 bytes in 265 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:39:54.438388 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-4c84d514-d330-4017-9e16-d202880dff46 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:54.441080 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-4c84d514-d330-4017-9e16-d202880dff46 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] [instance: a2fc592c-9dac-4f72-8633-229925d3bf76] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:54.456335 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4c84d514-d330-4017-9e16-d202880dff46 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:54.457174 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4c84d514-d330-4017-9e16-d202880dff46 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:54.458927 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4c84d514-d330-4017-9e16-d202880dff46 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:54.460947 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4c84d514-d330-4017-9e16-d202880dff46 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:54.461431 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4c84d514-d330-4017-9e16-d202880dff46 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:54.466579 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4c84d514-d330-4017-9e16-d202880dff46 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:54.835375 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-4c84d514-d330-4017-9e16-d202880dff46 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96919ec99c14864876d64a9c2b20f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b44ce10b78bf49c882c9b4df06187114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:54.853140 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-4c84d514-d330-4017-9e16-d202880dff46 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] 10.222.0.33 "GET /compute/v2.1/servers/a2fc592c-9dac-4f72-8633-229925d3bf76" status: 200 len: 1504 microversion: 2.1 time: 0.418502 Oct 04 20:39:54.859074 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 854/1634] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:54 2022] GET /compute/v2.1/servers/a2fc592c-9dac-4f72-8633-229925d3bf76 => generated 1504 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:54.872002 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-8257c789-0f5e-4928-a871-d49e7c41c87e tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:54.873560 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-8257c789-0f5e-4928-a871-d49e7c41c87e tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] [instance: c7f3bb5b-e08b-4a3f-ba4d-40012179412e] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:54.884200 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8257c789-0f5e-4928-a871-d49e7c41c87e tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:54.884910 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8257c789-0f5e-4928-a871-d49e7c41c87e tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:54.885528 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8257c789-0f5e-4928-a871-d49e7c41c87e tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:54.886431 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8257c789-0f5e-4928-a871-d49e7c41c87e tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:54.887043 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8257c789-0f5e-4928-a871-d49e7c41c87e tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:54.887623 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8257c789-0f5e-4928-a871-d49e7c41c87e tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:55.350061 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-8257c789-0f5e-4928-a871-d49e7c41c87e tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3563efe2b8c94931a2a46c4e14811b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3118a5d96843d3bede1ed94bd9717e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:55.360576 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-8257c789-0f5e-4928-a871-d49e7c41c87e tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] 10.222.0.33 "GET /compute/v2.1/servers/c7f3bb5b-e08b-4a3f-ba4d-40012179412e" status: 200 len: 1468 microversion: 2.1 time: 0.500193 Oct 04 20:39:55.374675 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 855/1635] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:54 2022] GET /compute/v2.1/servers/c7f3bb5b-e08b-4a3f-ba4d-40012179412e => generated 1468 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:55.387768 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-9ca45f1a-a734-4d49-8e86-b37d641826fe req-34f3de13-28f0-4cf0-b1ce-73dc4c8500d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0081d54e-8054-4f3b-9dd4-018f66aa4b27", "tag": "d3a7e9f7-b445-41aa-929c-167e630cb388"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:39:55.409020 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-9ca45f1a-a734-4d49-8e86-b37d641826fe req-34f3de13-28f0-4cf0-b1ce-73dc4c8500d2 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:55.421150 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-9ca45f1a-a734-4d49-8e86-b37d641826fe req-34f3de13-28f0-4cf0-b1ce-73dc4c8500d2 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:55.421851 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-9ca45f1a-a734-4d49-8e86-b37d641826fe req-34f3de13-28f0-4cf0-b1ce-73dc4c8500d2 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:55.445306 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:39:55.449887 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-9ca45f1a-a734-4d49-8e86-b37d641826fe req-34f3de13-28f0-4cf0-b1ce-73dc4c8500d2 service nova] Creating event network-changed:d3a7e9f7-b445-41aa-929c-167e630cb388 for instance 0081d54e-8054-4f3b-9dd4-018f66aa4b27 on n-h1-854823-8 Oct 04 20:39:55.461050 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-9ca45f1a-a734-4d49-8e86-b37d641826fe req-34f3de13-28f0-4cf0-b1ce-73dc4c8500d2 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082877 Oct 04 20:39:55.462944 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 856/1636] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:39:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:39:55.476200 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-2b624feb-cebf-4bc4-a3e5-8836d335e238 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:55.476914 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-2b624feb-cebf-4bc4-a3e5-8836d335e238 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] [instance: 0081d54e-8054-4f3b-9dd4-018f66aa4b27] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:55.495482 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2b624feb-cebf-4bc4-a3e5-8836d335e238 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:55.495971 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2b624feb-cebf-4bc4-a3e5-8836d335e238 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:55.496400 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2b624feb-cebf-4bc4-a3e5-8836d335e238 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:55.497107 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2b624feb-cebf-4bc4-a3e5-8836d335e238 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:55.497555 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2b624feb-cebf-4bc4-a3e5-8836d335e238 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:55.497971 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2b624feb-cebf-4bc4-a3e5-8836d335e238 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:55.691906 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-2b624feb-cebf-4bc4-a3e5-8836d335e238 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a82c49a62249029ebc6ae3b4829709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecf3793be3eb4f3186c07a7e45fd8f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:55.702310 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-2b624feb-cebf-4bc4-a3e5-8836d335e238 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] 10.222.0.33 "GET /compute/v2.1/servers/0081d54e-8054-4f3b-9dd4-018f66aa4b27" status: 200 len: 1324 microversion: 2.1 time: 0.238171 Oct 04 20:39:55.704174 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 857/1637] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:55 2022] GET /compute/v2.1/servers/0081d54e-8054-4f3b-9dd4-018f66aa4b27 => generated 1324 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:55.710024 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-1830564e-bae2-452a-adf8-9453e29b73fa tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Calling method '.version_select at 0x7f3c7428b5e0>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:55.781539 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-1830564e-bae2-452a-adf8-9453e29b73fa tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] 10.222.0.33 "GET /compute/v2.1/images/4ceaa94c-0232-4808-b979-89d23cbd895c" status: 200 len: 1421 microversion: 2.1 time: 0.075984 Oct 04 20:39:55.787165 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 858/1638] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 20:39:55 2022] GET /compute/v2.1/images/4ceaa94c-0232-4808-b979-89d23cbd895c => generated 1421 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:55.792811 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-2bb3616d-4e30-4069-903b-2bde14d953f1 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:55.793475 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-2bb3616d-4e30-4069-903b-2bde14d953f1 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] [instance: 286a7673-8323-4451-b329-4b33690e1c48] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:55.808842 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2bb3616d-4e30-4069-903b-2bde14d953f1 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:55.809346 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2bb3616d-4e30-4069-903b-2bde14d953f1 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:55.809787 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2bb3616d-4e30-4069-903b-2bde14d953f1 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:55.810541 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2bb3616d-4e30-4069-903b-2bde14d953f1 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:55.814578 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2bb3616d-4e30-4069-903b-2bde14d953f1 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:55.815288 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2bb3616d-4e30-4069-903b-2bde14d953f1 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:55.992820 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-2bb3616d-4e30-4069-903b-2bde14d953f1 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36f4114dc4f443f8b48da7b4027e0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a23a85365414f92bbc03177d7f190e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:56.001518 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-2bb3616d-4e30-4069-903b-2bde14d953f1 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] 10.222.0.33 "GET /compute/v2.1/servers/286a7673-8323-4451-b329-4b33690e1c48" status: 200 len: 1315 microversion: 2.1 time: 0.216523 Oct 04 20:39:56.003201 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 859/1639] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:55 2022] GET /compute/v2.1/servers/286a7673-8323-4451-b329-4b33690e1c48 => generated 1315 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:56.170981 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-c1d8cd64-b9e6-4edc-ab8e-99f0d9252696 tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] Action: 'create', calling method: .version_select at 0x7f3c7480e5e0>, body: {"keypair": {"name": "tempest-keypair-1671583020", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGjumOgA0RJ1M8xoggcF4f1vQi5fgDFrVjTI3IOcIEn+MlGIzZJxa1e/irQt57HESGEAW/ruMFaxR1ME2J8TE2LI3p5GXxC3oZ6Wn4fDexBT476+KghjsGbu+bTn9agBJA=="}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:39:56.190377 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-c1d8cd64-b9e6-4edc-ab8e-99f0d9252696 tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] Getting quotas for project f67490cfb798433eb86c006008c9aaa6. Resources: {'key_pairs'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:39:56.195773 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-c1d8cd64-b9e6-4edc-ab8e-99f0d9252696 tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] Getting quotas for user 673886dab3ed4cbd8a314386fbfbe39e and project f67490cfb798433eb86c006008c9aaa6. Resources: {'key_pairs'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:39:56.223905 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-c1d8cd64-b9e6-4edc-ab8e-99f0d9252696 tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.218857 Oct 04 20:39:56.224923 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 860/1640] 10.222.0.33 () {60 vars in 1159 bytes} [Tue Oct 4 20:39:56 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:39:56.238492 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-72665648-6ff5-48a4-a77f-5bd3456cbfb9 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:56.239461 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-72665648-6ff5-48a4-a77f-5bd3456cbfb9 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] [instance: a2fc592c-9dac-4f72-8633-229925d3bf76] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:56.246666 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-72665648-6ff5-48a4-a77f-5bd3456cbfb9 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:56.247485 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-72665648-6ff5-48a4-a77f-5bd3456cbfb9 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:56.248120 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-72665648-6ff5-48a4-a77f-5bd3456cbfb9 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:56.249139 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-72665648-6ff5-48a4-a77f-5bd3456cbfb9 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:56.249837 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-72665648-6ff5-48a4-a77f-5bd3456cbfb9 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:56.250554 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-72665648-6ff5-48a4-a77f-5bd3456cbfb9 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:56.466330 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-72665648-6ff5-48a4-a77f-5bd3456cbfb9 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96919ec99c14864876d64a9c2b20f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b44ce10b78bf49c882c9b4df06187114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:56.501189 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-72665648-6ff5-48a4-a77f-5bd3456cbfb9 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] 10.222.0.33 "GET /compute/v2.1/servers/a2fc592c-9dac-4f72-8633-229925d3bf76" status: 200 len: 1504 microversion: 2.1 time: 0.267992 Oct 04 20:39:56.502095 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 861/1641] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:56 2022] GET /compute/v2.1/servers/a2fc592c-9dac-4f72-8633-229925d3bf76 => generated 1504 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:56.515540 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-d2535103-fd47-42b3-8e7e-607fe681c386 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:56.518288 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-d2535103-fd47-42b3-8e7e-607fe681c386 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] [instance: c7f3bb5b-e08b-4a3f-ba4d-40012179412e] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:56.543636 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d2535103-fd47-42b3-8e7e-607fe681c386 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:56.544720 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d2535103-fd47-42b3-8e7e-607fe681c386 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:56.545400 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d2535103-fd47-42b3-8e7e-607fe681c386 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:56.546373 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d2535103-fd47-42b3-8e7e-607fe681c386 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:56.547095 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d2535103-fd47-42b3-8e7e-607fe681c386 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:56.547771 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d2535103-fd47-42b3-8e7e-607fe681c386 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:56.787647 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-d2535103-fd47-42b3-8e7e-607fe681c386 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3563efe2b8c94931a2a46c4e14811b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3118a5d96843d3bede1ed94bd9717e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:56.796276 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-d2535103-fd47-42b3-8e7e-607fe681c386 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] 10.222.0.33 "GET /compute/v2.1/servers/c7f3bb5b-e08b-4a3f-ba4d-40012179412e" status: 200 len: 1468 microversion: 2.1 time: 0.285280 Oct 04 20:39:56.815137 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 862/1642] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:56 2022] GET /compute/v2.1/servers/c7f3bb5b-e08b-4a3f-ba4d-40012179412e => generated 1468 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:56.826056 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-437862be-a340-41f1-9232-f4a94332143a tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:56.829410 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-437862be-a340-41f1-9232-f4a94332143a tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] [instance: 0081d54e-8054-4f3b-9dd4-018f66aa4b27] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:56.859803 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-437862be-a340-41f1-9232-f4a94332143a tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:56.865655 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-437862be-a340-41f1-9232-f4a94332143a tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:56.867668 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-437862be-a340-41f1-9232-f4a94332143a tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:56.869333 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-437862be-a340-41f1-9232-f4a94332143a tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:56.870010 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-437862be-a340-41f1-9232-f4a94332143a tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:56.870665 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-437862be-a340-41f1-9232-f4a94332143a tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:57.054069 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=4 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:39:57.394814 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=18 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:39:57.896511 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-437862be-a340-41f1-9232-f4a94332143a tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a82c49a62249029ebc6ae3b4829709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecf3793be3eb4f3186c07a7e45fd8f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:57.913643 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-437862be-a340-41f1-9232-f4a94332143a tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] 10.222.0.33 "GET /compute/v2.1/servers/0081d54e-8054-4f3b-9dd4-018f66aa4b27" status: 200 len: 1324 microversion: 2.1 time: 1.094409 Oct 04 20:39:57.926373 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 863/1643] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:56 2022] GET /compute/v2.1/servers/0081d54e-8054-4f3b-9dd4-018f66aa4b27 => generated 1324 bytes in 1099 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:57.933612 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-e3888433-20bb-4ce1-a401-5f926f602d07 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Calling method '.version_select at 0x7f3c78a27d30>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:58.044485 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-e3888433-20bb-4ce1-a401-5f926f602d07 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] 10.222.0.33 "GET /compute/v2.1/images/4ceaa94c-0232-4808-b979-89d23cbd895c" status: 200 len: 1421 microversion: 2.1 time: 0.123751 Oct 04 20:39:58.045488 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 864/1644] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 20:39:57 2022] GET /compute/v2.1/images/4ceaa94c-0232-4808-b979-89d23cbd895c => generated 1421 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:58.067494 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-7017285f-2eba-4aad-99fb-701eae7bac63 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:58.068147 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-7017285f-2eba-4aad-99fb-701eae7bac63 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] [instance: 286a7673-8323-4451-b329-4b33690e1c48] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:58.085535 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7017285f-2eba-4aad-99fb-701eae7bac63 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:58.087562 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7017285f-2eba-4aad-99fb-701eae7bac63 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:58.089409 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7017285f-2eba-4aad-99fb-701eae7bac63 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:58.090157 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7017285f-2eba-4aad-99fb-701eae7bac63 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:58.092170 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7017285f-2eba-4aad-99fb-701eae7bac63 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:58.092613 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7017285f-2eba-4aad-99fb-701eae7bac63 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:58.398151 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-7017285f-2eba-4aad-99fb-701eae7bac63 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36f4114dc4f443f8b48da7b4027e0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a23a85365414f92bbc03177d7f190e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:58.413136 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-7017285f-2eba-4aad-99fb-701eae7bac63 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] 10.222.0.33 "GET /compute/v2.1/servers/286a7673-8323-4451-b329-4b33690e1c48" status: 200 len: 1315 microversion: 2.1 time: 0.356024 Oct 04 20:39:58.413743 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 865/1645] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:58 2022] GET /compute/v2.1/servers/286a7673-8323-4451-b329-4b33690e1c48 => generated 1315 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:58.434255 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-bbcd8ae5-fb5c-498b-89c1-963cb9fe85e8 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:58.434928 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-bbcd8ae5-fb5c-498b-89c1-963cb9fe85e8 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] [instance: a2fc592c-9dac-4f72-8633-229925d3bf76] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:58.451434 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bbcd8ae5-fb5c-498b-89c1-963cb9fe85e8 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:58.451786 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bbcd8ae5-fb5c-498b-89c1-963cb9fe85e8 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:58.452310 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bbcd8ae5-fb5c-498b-89c1-963cb9fe85e8 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:58.452902 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bbcd8ae5-fb5c-498b-89c1-963cb9fe85e8 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:58.453349 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bbcd8ae5-fb5c-498b-89c1-963cb9fe85e8 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:58.453773 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bbcd8ae5-fb5c-498b-89c1-963cb9fe85e8 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:58.781695 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-bbcd8ae5-fb5c-498b-89c1-963cb9fe85e8 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96919ec99c14864876d64a9c2b20f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b44ce10b78bf49c882c9b4df06187114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:58.791475 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-bbcd8ae5-fb5c-498b-89c1-963cb9fe85e8 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] 10.222.0.33 "GET /compute/v2.1/servers/a2fc592c-9dac-4f72-8633-229925d3bf76" status: 200 len: 1504 microversion: 2.1 time: 0.363507 Oct 04 20:39:58.792306 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 866/1646] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:58 2022] GET /compute/v2.1/servers/a2fc592c-9dac-4f72-8633-229925d3bf76 => generated 1504 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:58.802462 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-deacf751-64a9-4c69-876d-93634030f707 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:58.804163 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-deacf751-64a9-4c69-876d-93634030f707 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] [instance: c7f3bb5b-e08b-4a3f-ba4d-40012179412e] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:58.819737 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-deacf751-64a9-4c69-876d-93634030f707 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:58.823107 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-deacf751-64a9-4c69-876d-93634030f707 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:58.823576 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-deacf751-64a9-4c69-876d-93634030f707 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:58.829204 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-deacf751-64a9-4c69-876d-93634030f707 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:58.830446 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-deacf751-64a9-4c69-876d-93634030f707 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:58.836133 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-deacf751-64a9-4c69-876d-93634030f707 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:59.141637 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e5918cad-761c-448d-a996-921b4759ffc1 tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/81748c83-b703-4c68-899c-c575cc3340d2/action" status: 202 len: 0 microversion: 2.25 time: 5.268595 Oct 04 20:39:59.144460 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 781/1647] 10.222.0.33 () {62 vars in 1319 bytes} [Tue Oct 4 20:39:53 2022] POST /compute/v2.1/servers/81748c83-b703-4c68-899c-c575cc3340d2/action => generated 0 bytes in 5274 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:39:59.152004 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-3f510d64-381a-4198-8ed9-e79e6b778f71 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:59.153370 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-3f510d64-381a-4198-8ed9-e79e6b778f71 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] [instance: 0081d54e-8054-4f3b-9dd4-018f66aa4b27] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:59.176390 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3f510d64-381a-4198-8ed9-e79e6b778f71 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:59.177234 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3f510d64-381a-4198-8ed9-e79e6b778f71 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:59.177862 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3f510d64-381a-4198-8ed9-e79e6b778f71 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:59.179531 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3f510d64-381a-4198-8ed9-e79e6b778f71 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:59.182189 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-deacf751-64a9-4c69-876d-93634030f707 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3563efe2b8c94931a2a46c4e14811b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3118a5d96843d3bede1ed94bd9717e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:59.183266 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3f510d64-381a-4198-8ed9-e79e6b778f71 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:59.183946 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3f510d64-381a-4198-8ed9-e79e6b778f71 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:59.202680 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-deacf751-64a9-4c69-876d-93634030f707 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] 10.222.0.33 "GET /compute/v2.1/servers/c7f3bb5b-e08b-4a3f-ba4d-40012179412e" status: 200 len: 1468 microversion: 2.1 time: 0.401131 Oct 04 20:39:59.205525 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 867/1648] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:58 2022] GET /compute/v2.1/servers/c7f3bb5b-e08b-4a3f-ba4d-40012179412e => generated 1468 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:59.216947 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-2373ae4a-c36b-4c80-a062-e4bfcc030f3c tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Calling method '.version_select at 0x7f3c7428b160>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:59.337932 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-2373ae4a-c36b-4c80-a062-e4bfcc030f3c tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] 10.222.0.33 "GET /compute/v2.1/images/4ceaa94c-0232-4808-b979-89d23cbd895c" status: 200 len: 1421 microversion: 2.1 time: 0.127605 Oct 04 20:39:59.339286 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 868/1649] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 20:39:59 2022] GET /compute/v2.1/images/4ceaa94c-0232-4808-b979-89d23cbd895c => generated 1421 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:39:59.344682 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-79858c87-6808-49ac-8beb-3b22f2e17a65 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:39:59.345570 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-79858c87-6808-49ac-8beb-3b22f2e17a65 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] [instance: 81748c83-b703-4c68-899c-c575cc3340d2] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:39:59.355246 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-79858c87-6808-49ac-8beb-3b22f2e17a65 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:59.356029 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-79858c87-6808-49ac-8beb-3b22f2e17a65 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:59.356648 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-79858c87-6808-49ac-8beb-3b22f2e17a65 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:59.357603 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-79858c87-6808-49ac-8beb-3b22f2e17a65 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:39:59.358220 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-79858c87-6808-49ac-8beb-3b22f2e17a65 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:39:59.358837 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-79858c87-6808-49ac-8beb-3b22f2e17a65 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:39:59.989629 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-3f510d64-381a-4198-8ed9-e79e6b778f71 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a82c49a62249029ebc6ae3b4829709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecf3793be3eb4f3186c07a7e45fd8f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:39:59.998553 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-3f510d64-381a-4198-8ed9-e79e6b778f71 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] 10.222.0.33 "GET /compute/v2.1/servers/0081d54e-8054-4f3b-9dd4-018f66aa4b27" status: 200 len: 1324 microversion: 2.1 time: 0.852244 Oct 04 20:40:00.000333 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 782/1650] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:39:59 2022] GET /compute/v2.1/servers/0081d54e-8054-4f3b-9dd4-018f66aa4b27 => generated 1324 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:00.028801 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-70dba973-cafb-4abb-937c-b77e7c6aaf64 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:00.037188 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-70dba973-cafb-4abb-937c-b77e7c6aaf64 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] [instance: 286a7673-8323-4451-b329-4b33690e1c48] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:00.061305 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-70dba973-cafb-4abb-937c-b77e7c6aaf64 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:00.063679 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-70dba973-cafb-4abb-937c-b77e7c6aaf64 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:00.064644 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-70dba973-cafb-4abb-937c-b77e7c6aaf64 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:00.067287 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-70dba973-cafb-4abb-937c-b77e7c6aaf64 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:00.068512 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-70dba973-cafb-4abb-937c-b77e7c6aaf64 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:00.069811 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-70dba973-cafb-4abb-937c-b77e7c6aaf64 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:00.196019 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-79858c87-6808-49ac-8beb-3b22f2e17a65 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:00.232348 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-79858c87-6808-49ac-8beb-3b22f2e17a65 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:00.257523 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-79858c87-6808-49ac-8beb-3b22f2e17a65 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:00.259103 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-79858c87-6808-49ac-8beb-3b22f2e17a65 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] 10.222.0.33 "GET /compute/v2.1/servers/81748c83-b703-4c68-899c-c575cc3340d2" status: 200 len: 1812 microversion: 2.25 time: 0.918567 Oct 04 20:40:00.263144 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 869/1651] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:39:59 2022] GET /compute/v2.1/servers/81748c83-b703-4c68-899c-c575cc3340d2 => generated 1812 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:40:00.271927 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-e6a12f5c-85b3-46cb-a723-f606e6b382ca req-cd125ae5-dc0e-49bd-84f9-9873cf8a9278 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7f3bb5b-e08b-4a3f-ba4d-40012179412e", "name": "network-vif-deleted", "tag": "89b93aa0-8eeb-48c4-a6d4-93a449c21fea"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:40:00.313417 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-e6a12f5c-85b3-46cb-a723-f606e6b382ca req-cd125ae5-dc0e-49bd-84f9-9873cf8a9278 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:00.313918 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-e6a12f5c-85b3-46cb-a723-f606e6b382ca req-cd125ae5-dc0e-49bd-84f9-9873cf8a9278 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:00.314986 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-e6a12f5c-85b3-46cb-a723-f606e6b382ca req-cd125ae5-dc0e-49bd-84f9-9873cf8a9278 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:00.356369 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-e6a12f5c-85b3-46cb-a723-f606e6b382ca req-cd125ae5-dc0e-49bd-84f9-9873cf8a9278 service nova] Creating event network-vif-deleted:89b93aa0-8eeb-48c4-a6d4-93a449c21fea for instance c7f3bb5b-e08b-4a3f-ba4d-40012179412e on n-h2-854823-8 Oct 04 20:40:00.380097 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-e6a12f5c-85b3-46cb-a723-f606e6b382ca req-cd125ae5-dc0e-49bd-84f9-9873cf8a9278 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115399 Oct 04 20:40:00.387358 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 870/1652] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:40:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:40:00.398224 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-63a0152c-5466-4188-8b6f-d3c5cf24ec50 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:00.401621 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-63a0152c-5466-4188-8b6f-d3c5cf24ec50 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] [instance: a2fc592c-9dac-4f72-8633-229925d3bf76] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:00.435270 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-63a0152c-5466-4188-8b6f-d3c5cf24ec50 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:00.435768 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-63a0152c-5466-4188-8b6f-d3c5cf24ec50 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:00.436208 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-63a0152c-5466-4188-8b6f-d3c5cf24ec50 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:00.436919 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-63a0152c-5466-4188-8b6f-d3c5cf24ec50 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:00.445514 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-63a0152c-5466-4188-8b6f-d3c5cf24ec50 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:00.447836 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-63a0152c-5466-4188-8b6f-d3c5cf24ec50 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:00.692693 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-70dba973-cafb-4abb-937c-b77e7c6aaf64 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36f4114dc4f443f8b48da7b4027e0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a23a85365414f92bbc03177d7f190e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:00.705769 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-70dba973-cafb-4abb-937c-b77e7c6aaf64 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] 10.222.0.33 "GET /compute/v2.1/servers/286a7673-8323-4451-b329-4b33690e1c48" status: 200 len: 1315 microversion: 2.1 time: 0.676229 Oct 04 20:40:00.724645 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 783/1653] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:40:00 2022] GET /compute/v2.1/servers/286a7673-8323-4451-b329-4b33690e1c48 => generated 1315 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:00.730238 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-ac84284c-3060-4984-948d-545e83e919d6 req-cf3d1ac5-c64b-4e6d-8e15-e18c520d6cb9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "286a7673-8323-4451-b329-4b33690e1c48", "name": "network-vif-plugged", "status": "completed", "tag": "ffee23db-b749-4944-8249-c57f4f15636e"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:40:00.742704 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-ac84284c-3060-4984-948d-545e83e919d6 req-cf3d1ac5-c64b-4e6d-8e15-e18c520d6cb9 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:00.743477 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-ac84284c-3060-4984-948d-545e83e919d6 req-cf3d1ac5-c64b-4e6d-8e15-e18c520d6cb9 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:00.744203 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-ac84284c-3060-4984-948d-545e83e919d6 req-cf3d1ac5-c64b-4e6d-8e15-e18c520d6cb9 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:00.758643 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-ac84284c-3060-4984-948d-545e83e919d6 req-cf3d1ac5-c64b-4e6d-8e15-e18c520d6cb9 service nova] Creating event network-vif-plugged:ffee23db-b749-4944-8249-c57f4f15636e for instance 286a7673-8323-4451-b329-4b33690e1c48 on n-h2-854823-8 Oct 04 20:40:00.771016 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-ac84284c-3060-4984-948d-545e83e919d6 req-cf3d1ac5-c64b-4e6d-8e15-e18c520d6cb9 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043462 Oct 04 20:40:00.778404 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 784/1654] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:40:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:40:00.785082 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b99bb742-b1a6-4f9f-b12c-a963166eff16 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:00.786334 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b99bb742-b1a6-4f9f-b12c-a963166eff16 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] [instance: c7f3bb5b-e08b-4a3f-ba4d-40012179412e] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:00.794479 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-63a0152c-5466-4188-8b6f-d3c5cf24ec50 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96919ec99c14864876d64a9c2b20f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b44ce10b78bf49c882c9b4df06187114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:00.795455 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b99bb742-b1a6-4f9f-b12c-a963166eff16 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:00.796130 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b99bb742-b1a6-4f9f-b12c-a963166eff16 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:00.796772 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b99bb742-b1a6-4f9f-b12c-a963166eff16 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:00.797879 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b99bb742-b1a6-4f9f-b12c-a963166eff16 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:00.798729 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b99bb742-b1a6-4f9f-b12c-a963166eff16 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:00.801153 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b99bb742-b1a6-4f9f-b12c-a963166eff16 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:00.805326 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-63a0152c-5466-4188-8b6f-d3c5cf24ec50 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] 10.222.0.33 "GET /compute/v2.1/servers/a2fc592c-9dac-4f72-8633-229925d3bf76" status: 200 len: 1504 microversion: 2.1 time: 0.412064 Oct 04 20:40:00.805915 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 871/1655] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:40:00 2022] GET /compute/v2.1/servers/a2fc592c-9dac-4f72-8633-229925d3bf76 => generated 1504 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:00.818462 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-2abcf9af-3f50-4135-bb6c-3adb7fa50dc1 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Calling method '.version_select at 0x7f3c7499a670>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:00.881370 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b99bb742-b1a6-4f9f-b12c-a963166eff16 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:00.882292 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b99bb742-b1a6-4f9f-b12c-a963166eff16 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:00.882989 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b99bb742-b1a6-4f9f-b12c-a963166eff16 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:00.883620 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-b99bb742-b1a6-4f9f-b12c-a963166eff16 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lazy-loading 'fault' on Instance uuid c7f3bb5b-e08b-4a3f-ba4d-40012179412e {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:40:00.905620 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-2abcf9af-3f50-4135-bb6c-3adb7fa50dc1 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] 10.222.0.33 "GET /compute/v2.1/images/4ceaa94c-0232-4808-b979-89d23cbd895c" status: 200 len: 1421 microversion: 2.1 time: 0.097651 Oct 04 20:40:00.906551 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 872/1656] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 20:40:00 2022] GET /compute/v2.1/images/4ceaa94c-0232-4808-b979-89d23cbd895c => generated 1421 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:00.912169 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-738630b9-5fe1-44f0-a749-aa33283b8020 tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] Action: 'create', calling method: >, body: {"server": {"name": "guest-instance-1.domain.com", "imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63", "flavorRef": "452", "adminPass": "***", "accessIPv4": "2.2.2.2", "networks": [{"uuid": "51112816-2a52-4558-b1f3-e45860f42f81"}], "security_groups": [{"name": "tempest-securitygroup--755922312"}], "key_name": "tempest-keypair-1671583020", "user_data": "}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:40:00.973635 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-b99bb742-b1a6-4f9f-b12c-a963166eff16 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3563efe2b8c94931a2a46c4e14811b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3118a5d96843d3bede1ed94bd9717e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:00.988295 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b99bb742-b1a6-4f9f-b12c-a963166eff16 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] 10.222.0.33 "GET /compute/v2.1/servers/c7f3bb5b-e08b-4a3f-ba4d-40012179412e" status: 200 len: 1302 microversion: 2.1 time: 0.206129 Oct 04 20:40:00.989662 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 785/1657] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:40:00 2022] GET /compute/v2.1/servers/c7f3bb5b-e08b-4a3f-ba4d-40012179412e => generated 1302 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:01.026953 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-22e2a445-8bda-48a2-8c44-8f4e5f615cee tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:01.027959 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-22e2a445-8bda-48a2-8c44-8f4e5f615cee tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] [instance: 0081d54e-8054-4f3b-9dd4-018f66aa4b27] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:01.039147 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-22e2a445-8bda-48a2-8c44-8f4e5f615cee tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:01.039999 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-22e2a445-8bda-48a2-8c44-8f4e5f615cee tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:01.041105 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-22e2a445-8bda-48a2-8c44-8f4e5f615cee tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:01.042047 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-22e2a445-8bda-48a2-8c44-8f4e5f615cee tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:01.042800 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-22e2a445-8bda-48a2-8c44-8f4e5f615cee tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:01.043463 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-22e2a445-8bda-48a2-8c44-8f4e5f615cee tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:01.168176 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.network.neutron [None req-738630b9-5fe1-44f0-a749-aa33283b8020 tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] validate_networks() for [('51112816-2a52-4558-b1f3-e45860f42f81', None, None, None, None, None)] {{(pid=128802) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:40:01.436678 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-22e2a445-8bda-48a2-8c44-8f4e5f615cee tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a82c49a62249029ebc6ae3b4829709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecf3793be3eb4f3186c07a7e45fd8f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:01.447823 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-22e2a445-8bda-48a2-8c44-8f4e5f615cee tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] 10.222.0.33 "GET /compute/v2.1/servers/0081d54e-8054-4f3b-9dd4-018f66aa4b27" status: 200 len: 1324 microversion: 2.1 time: 0.426190 Oct 04 20:40:01.448438 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 786/1658] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:40:01 2022] GET /compute/v2.1/servers/0081d54e-8054-4f3b-9dd4-018f66aa4b27 => generated 1324 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:01.468902 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0998bd1a-df77-477a-8b17-250b57089afd tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:01.469568 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-0998bd1a-df77-477a-8b17-250b57089afd tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] [instance: 81748c83-b703-4c68-899c-c575cc3340d2] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:01.480800 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0998bd1a-df77-477a-8b17-250b57089afd tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:01.481305 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0998bd1a-df77-477a-8b17-250b57089afd tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:01.481862 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0998bd1a-df77-477a-8b17-250b57089afd tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:01.482511 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0998bd1a-df77-477a-8b17-250b57089afd tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:01.483168 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0998bd1a-df77-477a-8b17-250b57089afd tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:01.483768 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0998bd1a-df77-477a-8b17-250b57089afd tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:01.797712 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-0998bd1a-df77-477a-8b17-250b57089afd tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:01.814380 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-0998bd1a-df77-477a-8b17-250b57089afd tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:01.819235 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-0998bd1a-df77-477a-8b17-250b57089afd tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:01.824479 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-0998bd1a-df77-477a-8b17-250b57089afd tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] 10.222.0.33 "GET /compute/v2.1/servers/81748c83-b703-4c68-899c-c575cc3340d2" status: 200 len: 1812 microversion: 2.25 time: 0.356558 Oct 04 20:40:01.846623 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 787/1659] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:40:01 2022] GET /compute/v2.1/servers/81748c83-b703-4c68-899c-c575cc3340d2 => generated 1812 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:40:01.856163 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-66df5204-e83b-4373-b967-026ce7adf93a tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:01.859023 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-66df5204-e83b-4373-b967-026ce7adf93a tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] [instance: 286a7673-8323-4451-b329-4b33690e1c48] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:01.870265 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-66df5204-e83b-4373-b967-026ce7adf93a tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:01.875187 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-66df5204-e83b-4373-b967-026ce7adf93a tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:01.875845 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-66df5204-e83b-4373-b967-026ce7adf93a tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:01.877595 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-66df5204-e83b-4373-b967-026ce7adf93a tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:01.878259 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-66df5204-e83b-4373-b967-026ce7adf93a tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:01.878724 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-66df5204-e83b-4373-b967-026ce7adf93a tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:02.051553 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-738630b9-5fe1-44f0-a749-aa33283b8020 tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] Flavor limits 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:40:02.052698 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-738630b9-5fe1-44f0-a749-aa33283b8020 tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] Image limits 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:40:02.053345 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-738630b9-5fe1-44f0-a749-aa33283b8020 tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] Flavor pref 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:40:02.053944 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-738630b9-5fe1-44f0-a749-aa33283b8020 tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] Image pref 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:40:02.054564 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-738630b9-5fe1-44f0-a749-aa33283b8020 tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:40:02.066710 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-738630b9-5fe1-44f0-a749-aa33283b8020 tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:02.067793 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-738630b9-5fe1-44f0-a749-aa33283b8020 tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:02.068473 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-738630b9-5fe1-44f0-a749-aa33283b8020 tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:02.069789 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-738630b9-5fe1-44f0-a749-aa33283b8020 tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:02.070526 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-738630b9-5fe1-44f0-a749-aa33283b8020 tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:02.071421 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-738630b9-5fe1-44f0-a749-aa33283b8020 tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:02.093039 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-738630b9-5fe1-44f0-a749-aa33283b8020 tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] Getting quotas for project f67490cfb798433eb86c006008c9aaa6. Resources: {'ram', 'instances', 'cores'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:40:02.098732 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:40:02.100881 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-738630b9-5fe1-44f0-a749-aa33283b8020 tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] Getting quotas for user 673886dab3ed4cbd8a314386fbfbe39e and project f67490cfb798433eb86c006008c9aaa6. Resources: {'ram', 'instances', 'cores'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:40:02.119504 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-738630b9-5fe1-44f0-a749-aa33283b8020 tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] Going to run 1 instances... {{(pid=128802) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:40:02.120885 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-66df5204-e83b-4373-b967-026ce7adf93a tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36f4114dc4f443f8b48da7b4027e0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a23a85365414f92bbc03177d7f190e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:02.122892 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-738630b9-5fe1-44f0-a749-aa33283b8020 tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] [instance: 6ff56299-ada5-4e73-9e68-59cdd48f8a16] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='15b24725-0c99-4bcf-b1fb-907cdf8e2d63',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128802) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:40:02.130229 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-66df5204-e83b-4373-b967-026ce7adf93a tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] 10.222.0.33 "GET /compute/v2.1/servers/286a7673-8323-4451-b329-4b33690e1c48" status: 200 len: 1315 microversion: 2.1 time: 0.282031 Oct 04 20:40:02.143324 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 788/1660] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:40:01 2022] GET /compute/v2.1/servers/286a7673-8323-4451-b329-4b33690e1c48 => generated 1315 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:02.153622 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-3c829a0d-a054-4ad9-80ac-9222d9edadcc tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:02.154772 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-3c829a0d-a054-4ad9-80ac-9222d9edadcc tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] [instance: a2fc592c-9dac-4f72-8633-229925d3bf76] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:02.162983 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3c829a0d-a054-4ad9-80ac-9222d9edadcc tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:02.164063 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3c829a0d-a054-4ad9-80ac-9222d9edadcc tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:02.164919 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3c829a0d-a054-4ad9-80ac-9222d9edadcc tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:02.165877 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3c829a0d-a054-4ad9-80ac-9222d9edadcc tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:02.166801 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3c829a0d-a054-4ad9-80ac-9222d9edadcc tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:02.167608 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3c829a0d-a054-4ad9-80ac-9222d9edadcc tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:02.199707 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-738630b9-5fe1-44f0-a749-aa33283b8020 tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.289282 Oct 04 20:40:02.208647 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 873/1661] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 20:40:00 2022] POST /compute/v2.1/servers => generated 408 bytes in 1301 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 20:40:02.221948 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-4f2115ce-baec-499e-a012-e2bb9d53125f tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Calling method '.version_select at 0x7f3c7499a670>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:02.313414 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-4f2115ce-baec-499e-a012-e2bb9d53125f tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] 10.222.0.33 "GET /compute/v2.1/images/4ceaa94c-0232-4808-b979-89d23cbd895c" status: 200 len: 1421 microversion: 2.1 time: 0.096748 Oct 04 20:40:02.322505 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 874/1662] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 20:40:02 2022] GET /compute/v2.1/images/4ceaa94c-0232-4808-b979-89d23cbd895c => generated 1421 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:02.328482 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-2a8e959e-5ef5-4c32-9df0-f8ed0543b759 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:02.329645 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-2a8e959e-5ef5-4c32-9df0-f8ed0543b759 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] [instance: c7f3bb5b-e08b-4a3f-ba4d-40012179412e] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:02.339585 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2a8e959e-5ef5-4c32-9df0-f8ed0543b759 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:02.340950 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2a8e959e-5ef5-4c32-9df0-f8ed0543b759 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:02.341611 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2a8e959e-5ef5-4c32-9df0-f8ed0543b759 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:02.342981 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2a8e959e-5ef5-4c32-9df0-f8ed0543b759 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:02.343677 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2a8e959e-5ef5-4c32-9df0-f8ed0543b759 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:02.344286 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2a8e959e-5ef5-4c32-9df0-f8ed0543b759 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:02.363874 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.wsgi [None req-2a8e959e-5ef5-4c32-9df0-f8ed0543b759 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] HTTP exception thrown: Instance c7f3bb5b-e08b-4a3f-ba4d-40012179412e could not be found. Oct 04 20:40:02.366154 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-2a8e959e-5ef5-4c32-9df0-f8ed0543b759 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Request method failure captured: Oct 04 20:40:02.366154 n-d-854823-8 devstack@n-api.service[128802]: request: GET /compute/v2.1/servers/c7f3bb5b-e08b-4a3f-ba4d-40012179412e HTTP/1.1 Oct 04 20:40:02.366154 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 20:40:02.366154 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 20:40:02.366154 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 20:40:02.366154 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 0 Oct 04 20:40:02.366154 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 20:40:02.366154 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 20:40:02.366154 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 20:40:02.366154 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 20:40:02.366154 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPJi4YW5paijGjm0KJCD3xPCjqoV7Yx2gPBOteSu0r3DtnBaxauAhN82fJ8sA4jGopne1RZKgRzfyGU8WtYmELZERLpy7PD9YLLtoJOaL9dbdJigxopqVQsdWKaWPFztWyama9XcrUH3oJLe6wPMcVbEBemlmJBzjFTlhWfl4Iuq6Rdc Oct 04 20:40:02.366154 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 20:40:02.366154 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 20:40:02.366154 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 20:40:02.366154 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 20:40:02.366154 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 20:40:02.366154 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 20:40:02.366154 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: dd3118a5d96843d3bede1ed94bd9717e Oct 04 20:40:02.366154 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-MigrationsAdminTest-282898562 Oct 04 20:40:02.366154 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 20:40:02.366154 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 20:40:02.366154 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_dd3118a5d96843d3bede1ed94bd9717e", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/dd3118a5d96843d3bede1ed94bd9717e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/dd3118a5d96843d3bede1ed94bd9717e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/dd3118a5d96843d3bede1ed94bd9717e"}]}] Oct 04 20:40:02.366154 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-MigrationsAdminTest-282898562 Oct 04 20:40:02.366154 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: dd3118a5d96843d3bede1ed94bd9717e Oct 04 20:40:02.366154 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-MigrationsAdminTest-282898562 Oct 04 20:40:02.366154 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-MigrationsAdminTest-282898562-project Oct 04 20:40:02.366154 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 20:40:02.366154 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 20:40:02.366154 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: 3563efe2b8c94931a2a46c4e14811b3a Oct 04 20:40:02.366154 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-MigrationsAdminTest-282898562-project Oct 04 20:40:02.366154 n-d-854823-8 devstack@n-api.service[128802]: method: > Oct 04 20:40:02.366154 n-d-854823-8 devstack@n-api.service[128802]: exception: Instance c7f3bb5b-e08b-4a3f-ba4d-40012179412e could not be found. Oct 04 20:40:02.366154 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'id': 'c7f3bb5b-e08b-4a3f-ba4d-40012179412e'} Oct 04 20:40:02.366154 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:40:02.366154 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:40:02.366154 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:40:02.366154 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:40:02.366154 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:40:02.366154 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:40:02.366154 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:40:02.366154 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:40:02.366154 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:40:02.366154 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:40:02.366154 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c7f3bb5b-e08b-4a3f-ba4d-40012179412e could not be found. Oct 04 20:40:02.366154 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:40:02.366154 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:40:02.366154 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:40:02.366154 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:40:02.366154 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:40:02.366154 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:40:02.366154 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:40:02.366154 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:40:02.366154 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:40:02.366154 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:40:02.366154 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:40:02.366154 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:40:02.366154 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:40:02.366154 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:40:02.366154 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:40:02.366154 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:40:02.366154 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c7f3bb5b-e08b-4a3f-ba4d-40012179412e could not be found. Oct 04 20:40:02.366154 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:40:02.366154 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:40:02.366154 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:40:02.371202 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:40:02.371202 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:40:02.371202 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:40:02.371202 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:40:02.371202 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:40:02.371202 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c7f3bb5b-e08b-4a3f-ba4d-40012179412e could not be found. Oct 04 20:40:02.371202 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:40:02.371202 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-2a8e959e-5ef5-4c32-9df0-f8ed0543b759 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Returning 404 to user: Instance c7f3bb5b-e08b-4a3f-ba4d-40012179412e could not be found. {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:40:02.371202 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-2a8e959e-5ef5-4c32-9df0-f8ed0543b759 tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] 10.222.0.33 "GET /compute/v2.1/servers/c7f3bb5b-e08b-4a3f-ba4d-40012179412e" status: 404 len: 111 microversion: 2.1 time: 0.043725 Oct 04 20:40:02.371202 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 875/1663] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:40:02 2022] GET /compute/v2.1/servers/c7f3bb5b-e08b-4a3f-ba4d-40012179412e => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:40:02.375455 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-8da4596d-82ca-4428-b89c-acb0c3fb46df tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:02.376450 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-8da4596d-82ca-4428-b89c-acb0c3fb46df tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] [instance: 6ff56299-ada5-4e73-9e68-59cdd48f8a16] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:02.472443 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-3c829a0d-a054-4ad9-80ac-9222d9edadcc tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96919ec99c14864876d64a9c2b20f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b44ce10b78bf49c882c9b4df06187114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:02.480985 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-8da4596d-82ca-4428-b89c-acb0c3fb46df tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673886dab3ed4cbd8a314386fbfbe39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f67490cfb798433eb86c006008c9aaa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:02.482569 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-3c829a0d-a054-4ad9-80ac-9222d9edadcc tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] 10.222.0.33 "GET /compute/v2.1/servers/a2fc592c-9dac-4f72-8633-229925d3bf76" status: 200 len: 1504 microversion: 2.1 time: 0.337768 Oct 04 20:40:02.488784 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 789/1664] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:40:02 2022] GET /compute/v2.1/servers/a2fc592c-9dac-4f72-8633-229925d3bf76 => generated 1504 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:02.494930 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-8da4596d-82ca-4428-b89c-acb0c3fb46df tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] 10.222.0.33 "GET /compute/v2.1/servers/6ff56299-ada5-4e73-9e68-59cdd48f8a16" status: 200 len: 1226 microversion: 2.1 time: 0.125227 Oct 04 20:40:02.496180 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 876/1665] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:40:02 2022] GET /compute/v2.1/servers/6ff56299-ada5-4e73-9e68-59cdd48f8a16 => generated 1226 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:02.497326 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-97cb2b66-6c52-447d-b535-8dd902467c8d tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:02.498020 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-97cb2b66-6c52-447d-b535-8dd902467c8d tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] [instance: 9e9f6289-9999-4188-9af1-6cf64a676eee] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:02.501559 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-f6ce30f0-d673-434f-8508-9b411343aae5 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:02.503276 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-f6ce30f0-d673-434f-8508-9b411343aae5 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] [instance: 0081d54e-8054-4f3b-9dd4-018f66aa4b27] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:02.506136 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-97cb2b66-6c52-447d-b535-8dd902467c8d tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:02.506853 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-97cb2b66-6c52-447d-b535-8dd902467c8d tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:02.507457 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-97cb2b66-6c52-447d-b535-8dd902467c8d tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:02.508479 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-97cb2b66-6c52-447d-b535-8dd902467c8d tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:02.509210 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-97cb2b66-6c52-447d-b535-8dd902467c8d tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:02.509794 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-97cb2b66-6c52-447d-b535-8dd902467c8d tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:02.513655 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f6ce30f0-d673-434f-8508-9b411343aae5 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:02.514542 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f6ce30f0-d673-434f-8508-9b411343aae5 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:02.515302 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f6ce30f0-d673-434f-8508-9b411343aae5 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:02.516634 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f6ce30f0-d673-434f-8508-9b411343aae5 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:02.518822 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f6ce30f0-d673-434f-8508-9b411343aae5 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:02.519669 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f6ce30f0-d673-434f-8508-9b411343aae5 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:02.539632 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-97cb2b66-6c52-447d-b535-8dd902467c8d tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] [instance: 9e9f6289-9999-4188-9af1-6cf64a676eee] Going to try to terminate instance {{(pid=128801) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:40:02.585566 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:40:02.721462 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-97cb2b66-6c52-447d-b535-8dd902467c8d tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] 10.222.0.33 "DELETE /compute/v2.1/servers/9e9f6289-9999-4188-9af1-6cf64a676eee" status: 204 len: 0 microversion: 2.1 time: 0.228965 Oct 04 20:40:02.722664 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 790/1666] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 20:40:02 2022] DELETE /compute/v2.1/servers/9e9f6289-9999-4188-9af1-6cf64a676eee => generated 0 bytes in 233 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:40:02.734899 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-fcd9ca1f-791b-4e15-9b40-961ac7b811eb tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:02.736994 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-fcd9ca1f-791b-4e15-9b40-961ac7b811eb tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] [instance: 9e9f6289-9999-4188-9af1-6cf64a676eee] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:02.754164 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fcd9ca1f-791b-4e15-9b40-961ac7b811eb tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:02.756109 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fcd9ca1f-791b-4e15-9b40-961ac7b811eb tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:02.756792 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fcd9ca1f-791b-4e15-9b40-961ac7b811eb tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:02.757612 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fcd9ca1f-791b-4e15-9b40-961ac7b811eb tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:02.757990 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fcd9ca1f-791b-4e15-9b40-961ac7b811eb tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:02.761053 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fcd9ca1f-791b-4e15-9b40-961ac7b811eb tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:02.791373 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-f6ce30f0-d673-434f-8508-9b411343aae5 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a82c49a62249029ebc6ae3b4829709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecf3793be3eb4f3186c07a7e45fd8f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:02.804829 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-f6ce30f0-d673-434f-8508-9b411343aae5 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] 10.222.0.33 "GET /compute/v2.1/servers/0081d54e-8054-4f3b-9dd4-018f66aa4b27" status: 200 len: 1324 microversion: 2.1 time: 0.305100 Oct 04 20:40:02.805441 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 877/1667] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:40:02 2022] GET /compute/v2.1/servers/0081d54e-8054-4f3b-9dd4-018f66aa4b27 => generated 1324 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:02.820117 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-34017468-8d0c-4e75-a027-2f7b59cafda3 req-0d962f69-a567-40d3-9ed8-c15d4474c180 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0081d54e-8054-4f3b-9dd4-018f66aa4b27", "name": "network-vif-plugged", "status": "completed", "tag": "d3a7e9f7-b445-41aa-929c-167e630cb388"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:40:02.849346 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-34017468-8d0c-4e75-a027-2f7b59cafda3 req-0d962f69-a567-40d3-9ed8-c15d4474c180 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:02.849834 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-34017468-8d0c-4e75-a027-2f7b59cafda3 req-0d962f69-a567-40d3-9ed8-c15d4474c180 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:02.850264 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-34017468-8d0c-4e75-a027-2f7b59cafda3 req-0d962f69-a567-40d3-9ed8-c15d4474c180 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:02.865136 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-34017468-8d0c-4e75-a027-2f7b59cafda3 req-0d962f69-a567-40d3-9ed8-c15d4474c180 service nova] Creating event network-vif-plugged:d3a7e9f7-b445-41aa-929c-167e630cb388 for instance 0081d54e-8054-4f3b-9dd4-018f66aa4b27 on n-h1-854823-8 Oct 04 20:40:02.870689 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-34017468-8d0c-4e75-a027-2f7b59cafda3 req-0d962f69-a567-40d3-9ed8-c15d4474c180 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064002 Oct 04 20:40:02.875118 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 878/1668] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:40:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:40:02.882313 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-9995fd70-f693-4ecd-9e6d-81393b6e050b tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:02.895852 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-9995fd70-f693-4ecd-9e6d-81393b6e050b tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] [instance: 81748c83-b703-4c68-899c-c575cc3340d2] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:02.909270 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9995fd70-f693-4ecd-9e6d-81393b6e050b tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:02.912320 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9995fd70-f693-4ecd-9e6d-81393b6e050b tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:02.912955 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9995fd70-f693-4ecd-9e6d-81393b6e050b tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:02.913845 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9995fd70-f693-4ecd-9e6d-81393b6e050b tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:02.914483 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9995fd70-f693-4ecd-9e6d-81393b6e050b tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:02.915110 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9995fd70-f693-4ecd-9e6d-81393b6e050b tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:03.137852 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-fcd9ca1f-791b-4e15-9b40-961ac7b811eb tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3563efe2b8c94931a2a46c4e14811b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3118a5d96843d3bede1ed94bd9717e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:03.146803 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-fcd9ca1f-791b-4e15-9b40-961ac7b811eb tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] 10.222.0.33 "GET /compute/v2.1/servers/9e9f6289-9999-4188-9af1-6cf64a676eee" status: 200 len: 1469 microversion: 2.1 time: 0.418739 Oct 04 20:40:03.167165 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 791/1669] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:40:02 2022] GET /compute/v2.1/servers/9e9f6289-9999-4188-9af1-6cf64a676eee => generated 1469 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:03.179191 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-10d7adc7-b27a-44d1-9f55-9e4e9abcf583 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:03.186849 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-10d7adc7-b27a-44d1-9f55-9e4e9abcf583 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] [instance: 286a7673-8323-4451-b329-4b33690e1c48] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:03.194769 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-10d7adc7-b27a-44d1-9f55-9e4e9abcf583 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:03.195373 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-10d7adc7-b27a-44d1-9f55-9e4e9abcf583 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:03.195898 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-10d7adc7-b27a-44d1-9f55-9e4e9abcf583 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:03.198867 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-10d7adc7-b27a-44d1-9f55-9e4e9abcf583 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:03.199932 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-10d7adc7-b27a-44d1-9f55-9e4e9abcf583 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:03.201352 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-10d7adc7-b27a-44d1-9f55-9e4e9abcf583 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:03.448349 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-9995fd70-f693-4ecd-9e6d-81393b6e050b tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:03.462238 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-9995fd70-f693-4ecd-9e6d-81393b6e050b tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:03.464789 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-9995fd70-f693-4ecd-9e6d-81393b6e050b tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:03.470858 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-9995fd70-f693-4ecd-9e6d-81393b6e050b tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] 10.222.0.33 "GET /compute/v2.1/servers/81748c83-b703-4c68-899c-c575cc3340d2" status: 200 len: 1812 microversion: 2.25 time: 0.591217 Oct 04 20:40:03.486460 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 879/1670] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:40:02 2022] GET /compute/v2.1/servers/81748c83-b703-4c68-899c-c575cc3340d2 => generated 1812 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:40:03.486823 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-10d7adc7-b27a-44d1-9f55-9e4e9abcf583 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36f4114dc4f443f8b48da7b4027e0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a23a85365414f92bbc03177d7f190e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:03.486950 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-675b71da-aaf5-4e4f-b23e-67e0453f1dae tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Calling method '.version_select at 0x7f3c78a27af0>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:03.496189 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-10d7adc7-b27a-44d1-9f55-9e4e9abcf583 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] 10.222.0.33 "GET /compute/v2.1/servers/286a7673-8323-4451-b329-4b33690e1c48" status: 200 len: 1465 microversion: 2.1 time: 0.326534 Oct 04 20:40:03.496189 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 792/1671] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:40:03 2022] GET /compute/v2.1/servers/286a7673-8323-4451-b329-4b33690e1c48 => generated 1465 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:03.512423 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-df3e14fa-deed-4334-922a-f54434f172fc tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:03.515483 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-df3e14fa-deed-4334-922a-f54434f172fc tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] [instance: a2fc592c-9dac-4f72-8633-229925d3bf76] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:03.529917 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-df3e14fa-deed-4334-922a-f54434f172fc tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:03.530814 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-df3e14fa-deed-4334-922a-f54434f172fc tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:03.531419 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-df3e14fa-deed-4334-922a-f54434f172fc tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:03.532469 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-df3e14fa-deed-4334-922a-f54434f172fc tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:03.533650 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-df3e14fa-deed-4334-922a-f54434f172fc tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:03.534241 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-df3e14fa-deed-4334-922a-f54434f172fc tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:03.574140 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-675b71da-aaf5-4e4f-b23e-67e0453f1dae tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] 10.222.0.33 "GET /compute/v2.1/images/4ceaa94c-0232-4808-b979-89d23cbd895c" status: 200 len: 1421 microversion: 2.1 time: 0.101486 Oct 04 20:40:03.586303 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 880/1672] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 20:40:03 2022] GET /compute/v2.1/images/4ceaa94c-0232-4808-b979-89d23cbd895c => generated 1421 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:03.588756 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-6c96b49e-5ced-4d81-8cdf-77c1e7241622 tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:03.589385 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-6c96b49e-5ced-4d81-8cdf-77c1e7241622 tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] [instance: 6ff56299-ada5-4e73-9e68-59cdd48f8a16] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:03.598882 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6c96b49e-5ced-4d81-8cdf-77c1e7241622 tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:03.599376 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6c96b49e-5ced-4d81-8cdf-77c1e7241622 tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:03.600459 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6c96b49e-5ced-4d81-8cdf-77c1e7241622 tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:03.601686 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6c96b49e-5ced-4d81-8cdf-77c1e7241622 tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:03.602154 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6c96b49e-5ced-4d81-8cdf-77c1e7241622 tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:03.602780 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6c96b49e-5ced-4d81-8cdf-77c1e7241622 tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:03.695671 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-6c96b49e-5ced-4d81-8cdf-77c1e7241622 tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673886dab3ed4cbd8a314386fbfbe39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f67490cfb798433eb86c006008c9aaa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:03.720270 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-6c96b49e-5ced-4d81-8cdf-77c1e7241622 tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] 10.222.0.33 "GET /compute/v2.1/servers/6ff56299-ada5-4e73-9e68-59cdd48f8a16" status: 200 len: 1278 microversion: 2.1 time: 0.141088 Oct 04 20:40:03.721455 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 881/1673] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:40:03 2022] GET /compute/v2.1/servers/6ff56299-ada5-4e73-9e68-59cdd48f8a16 => generated 1278 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:03.730402 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-ed443bce-2ae7-4727-91de-a1126fb4fd66 tempest-ServersOnMultiNodesTest-176762512 tempest-ServersOnMultiNodesTest-176762512-project-admin] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:03.731332 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-ed443bce-2ae7-4727-91de-a1126fb4fd66 tempest-ServersOnMultiNodesTest-176762512 tempest-ServersOnMultiNodesTest-176762512-project-admin] [instance: 286a7673-8323-4451-b329-4b33690e1c48] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:03.746810 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ed443bce-2ae7-4727-91de-a1126fb4fd66 tempest-ServersOnMultiNodesTest-176762512 tempest-ServersOnMultiNodesTest-176762512-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:03.747675 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ed443bce-2ae7-4727-91de-a1126fb4fd66 tempest-ServersOnMultiNodesTest-176762512 tempest-ServersOnMultiNodesTest-176762512-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:03.750765 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ed443bce-2ae7-4727-91de-a1126fb4fd66 tempest-ServersOnMultiNodesTest-176762512 tempest-ServersOnMultiNodesTest-176762512-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:03.751856 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ed443bce-2ae7-4727-91de-a1126fb4fd66 tempest-ServersOnMultiNodesTest-176762512 tempest-ServersOnMultiNodesTest-176762512-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:03.752626 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ed443bce-2ae7-4727-91de-a1126fb4fd66 tempest-ServersOnMultiNodesTest-176762512 tempest-ServersOnMultiNodesTest-176762512-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:03.753318 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ed443bce-2ae7-4727-91de-a1126fb4fd66 tempest-ServersOnMultiNodesTest-176762512 tempest-ServersOnMultiNodesTest-176762512-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:03.846715 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-df3e14fa-deed-4334-922a-f54434f172fc tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96919ec99c14864876d64a9c2b20f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b44ce10b78bf49c882c9b4df06187114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:03.858147 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-df3e14fa-deed-4334-922a-f54434f172fc tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] 10.222.0.33 "GET /compute/v2.1/servers/a2fc592c-9dac-4f72-8633-229925d3bf76" status: 200 len: 1504 microversion: 2.1 time: 0.353056 Oct 04 20:40:03.874396 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 793/1674] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:40:03 2022] GET /compute/v2.1/servers/a2fc592c-9dac-4f72-8633-229925d3bf76 => generated 1504 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:03.880251 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-32d2c22b-0364-440b-8982-00bc741a5d3d tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:03.880879 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-32d2c22b-0364-440b-8982-00bc741a5d3d tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] [instance: 0081d54e-8054-4f3b-9dd4-018f66aa4b27] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:03.905165 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-32d2c22b-0364-440b-8982-00bc741a5d3d tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:03.905912 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-32d2c22b-0364-440b-8982-00bc741a5d3d tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:03.906384 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-32d2c22b-0364-440b-8982-00bc741a5d3d tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:03.907152 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-32d2c22b-0364-440b-8982-00bc741a5d3d tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:03.907611 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-32d2c22b-0364-440b-8982-00bc741a5d3d tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:03.908584 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-32d2c22b-0364-440b-8982-00bc741a5d3d tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:04.010589 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-ed443bce-2ae7-4727-91de-a1126fb4fd66 tempest-ServersOnMultiNodesTest-176762512 tempest-ServersOnMultiNodesTest-176762512-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/286a7673-8323-4451-b329-4b33690e1c48" status: 200 len: 1616 microversion: 2.1 time: 0.287953 Oct 04 20:40:04.011380 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 882/1675] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:40:03 2022] GET /compute/v2.1/servers/286a7673-8323-4451-b329-4b33690e1c48 => generated 1616 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:04.097830 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-32d2c22b-0364-440b-8982-00bc741a5d3d tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a82c49a62249029ebc6ae3b4829709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecf3793be3eb4f3186c07a7e45fd8f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:04.110548 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-32d2c22b-0364-440b-8982-00bc741a5d3d tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] 10.222.0.33 "GET /compute/v2.1/servers/0081d54e-8054-4f3b-9dd4-018f66aa4b27" status: 200 len: 1324 microversion: 2.1 time: 0.234870 Oct 04 20:40:04.123137 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 794/1676] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:40:03 2022] GET /compute/v2.1/servers/0081d54e-8054-4f3b-9dd4-018f66aa4b27 => generated 1324 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:04.186752 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-a261a404-4f3f-4d28-8845-c3c41e2f068e tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:04.190907 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-a261a404-4f3f-4d28-8845-c3c41e2f068e tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] [instance: 9e9f6289-9999-4188-9af1-6cf64a676eee] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:04.225397 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7454d299-b673-47cf-b9d1-1cac687e9c5f tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-492005341", "imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "42726a57-cdc8-45e3-8d61-348f02bfcd53"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:40:04.243158 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a261a404-4f3f-4d28-8845-c3c41e2f068e tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:04.243793 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a261a404-4f3f-4d28-8845-c3c41e2f068e tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:04.244254 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a261a404-4f3f-4d28-8845-c3c41e2f068e tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:04.254170 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a261a404-4f3f-4d28-8845-c3c41e2f068e tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:04.257124 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a261a404-4f3f-4d28-8845-c3c41e2f068e tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:04.257583 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a261a404-4f3f-4d28-8845-c3c41e2f068e tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:04.355504 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.network.neutron [None req-7454d299-b673-47cf-b9d1-1cac687e9c5f tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] validate_networks() for None {{(pid=128801) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:40:04.392154 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-a261a404-4f3f-4d28-8845-c3c41e2f068e tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3563efe2b8c94931a2a46c4e14811b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3118a5d96843d3bede1ed94bd9717e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:04.407771 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-a261a404-4f3f-4d28-8845-c3c41e2f068e tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] 10.222.0.33 "GET /compute/v2.1/servers/9e9f6289-9999-4188-9af1-6cf64a676eee" status: 200 len: 1427 microversion: 2.1 time: 0.225101 Oct 04 20:40:04.409448 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 883/1677] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:40:04 2022] GET /compute/v2.1/servers/9e9f6289-9999-4188-9af1-6cf64a676eee => generated 1427 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:04.434648 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-9d325db0-2826-464e-891e-414c15ec1f89 req-528af95f-daa2-43c9-9df8-974610076d15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e9f6289-9999-4188-9af1-6cf64a676eee", "name": "network-vif-deleted", "tag": "adebf0e2-e917-4865-9fef-2062cd63bdc7"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:40:04.459708 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-9d325db0-2826-464e-891e-414c15ec1f89 req-528af95f-daa2-43c9-9df8-974610076d15 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:04.462265 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-9d325db0-2826-464e-891e-414c15ec1f89 req-528af95f-daa2-43c9-9df8-974610076d15 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:04.464155 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-9d325db0-2826-464e-891e-414c15ec1f89 req-528af95f-daa2-43c9-9df8-974610076d15 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:04.473890 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=100 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:40:04.512100 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-9d325db0-2826-464e-891e-414c15ec1f89 req-528af95f-daa2-43c9-9df8-974610076d15 service nova] Creating event network-vif-deleted:adebf0e2-e917-4865-9fef-2062cd63bdc7 for instance 9e9f6289-9999-4188-9af1-6cf64a676eee on n-h2-854823-8 Oct 04 20:40:04.522182 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-9d325db0-2826-464e-891e-414c15ec1f89 req-528af95f-daa2-43c9-9df8-974610076d15 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111222 Oct 04 20:40:04.523967 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 884/1678] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:40:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:40:04.547553 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-edd9cf6b-9048-43a6-8d4d-305c7dcc0b65 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:04.549912 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-edd9cf6b-9048-43a6-8d4d-305c7dcc0b65 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] [instance: 81748c83-b703-4c68-899c-c575cc3340d2] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:04.574381 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-edd9cf6b-9048-43a6-8d4d-305c7dcc0b65 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:04.591003 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-edd9cf6b-9048-43a6-8d4d-305c7dcc0b65 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:04.593356 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-edd9cf6b-9048-43a6-8d4d-305c7dcc0b65 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:04.594989 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-edd9cf6b-9048-43a6-8d4d-305c7dcc0b65 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:04.600921 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-edd9cf6b-9048-43a6-8d4d-305c7dcc0b65 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:04.606211 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-edd9cf6b-9048-43a6-8d4d-305c7dcc0b65 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:05.048093 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-edd9cf6b-9048-43a6-8d4d-305c7dcc0b65 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:05.059504 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-edd9cf6b-9048-43a6-8d4d-305c7dcc0b65 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:05.062680 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-edd9cf6b-9048-43a6-8d4d-305c7dcc0b65 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:05.065018 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-edd9cf6b-9048-43a6-8d4d-305c7dcc0b65 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] 10.222.0.33 "GET /compute/v2.1/servers/81748c83-b703-4c68-899c-c575cc3340d2" status: 200 len: 1812 microversion: 2.25 time: 0.538941 Oct 04 20:40:05.071077 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-7454d299-b673-47cf-b9d1-1cac687e9c5f tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Flavor limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:40:05.071972 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-7454d299-b673-47cf-b9d1-1cac687e9c5f tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Image limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:40:05.072606 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-7454d299-b673-47cf-b9d1-1cac687e9c5f tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Flavor pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:40:05.073231 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-7454d299-b673-47cf-b9d1-1cac687e9c5f tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Image pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:40:05.073821 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-7454d299-b673-47cf-b9d1-1cac687e9c5f tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:40:05.092537 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 885/1679] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:40:04 2022] GET /compute/v2.1/servers/81748c83-b703-4c68-899c-c575cc3340d2 => generated 1812 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:40:05.098062 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-12ad6f7a-cf7c-4460-969b-4718efb94571 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Calling method '.version_select at 0x7f3c78a27f70>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:05.100947 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7454d299-b673-47cf-b9d1-1cac687e9c5f tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:05.101443 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7454d299-b673-47cf-b9d1-1cac687e9c5f tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:05.101881 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7454d299-b673-47cf-b9d1-1cac687e9c5f tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:05.107176 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7454d299-b673-47cf-b9d1-1cac687e9c5f tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:05.107682 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7454d299-b673-47cf-b9d1-1cac687e9c5f tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:05.108157 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7454d299-b673-47cf-b9d1-1cac687e9c5f tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:05.133980 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-7454d299-b673-47cf-b9d1-1cac687e9c5f tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Getting quotas for project 1a23a85365414f92bbc03177d7f190e6. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:40:05.140437 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-7454d299-b673-47cf-b9d1-1cac687e9c5f tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Getting quotas for user e36f4114dc4f443f8b48da7b4027e0c1 and project 1a23a85365414f92bbc03177d7f190e6. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:40:05.161224 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-7454d299-b673-47cf-b9d1-1cac687e9c5f tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Going to run 1 instances... {{(pid=128801) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:40:05.163639 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-7454d299-b673-47cf-b9d1-1cac687e9c5f tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] [instance: 21de8a24-9cad-4f83-a459-5297200c20ad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='15b24725-0c99-4bcf-b1fb-907cdf8e2d63',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128801) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:40:05.177976 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-12ad6f7a-cf7c-4460-969b-4718efb94571 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] 10.222.0.33 "GET /compute/v2.1/images/4ceaa94c-0232-4808-b979-89d23cbd895c" status: 200 len: 1421 microversion: 2.1 time: 0.084219 Oct 04 20:40:05.186660 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 886/1680] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 20:40:05 2022] GET /compute/v2.1/images/4ceaa94c-0232-4808-b979-89d23cbd895c => generated 1421 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:05.188213 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-59cbbccd-a483-432c-b8a2-359d047caabc tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:05.188913 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-59cbbccd-a483-432c-b8a2-359d047caabc tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] [instance: 6ff56299-ada5-4e73-9e68-59cdd48f8a16] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:05.208164 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-59cbbccd-a483-432c-b8a2-359d047caabc tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:05.208647 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-59cbbccd-a483-432c-b8a2-359d047caabc tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:05.209285 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-59cbbccd-a483-432c-b8a2-359d047caabc tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:05.209791 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-59cbbccd-a483-432c-b8a2-359d047caabc tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:05.210239 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-59cbbccd-a483-432c-b8a2-359d047caabc tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:05.218647 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-59cbbccd-a483-432c-b8a2-359d047caabc tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:05.262452 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-7454d299-b673-47cf-b9d1-1cac687e9c5f tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.046824 Oct 04 20:40:05.263999 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 795/1681] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 20:40:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 1049 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 20:40:05.280661 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-4a3ebde1-54ba-4de6-b8f5-b97128227083 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:05.285265 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-4a3ebde1-54ba-4de6-b8f5-b97128227083 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] [instance: a2fc592c-9dac-4f72-8633-229925d3bf76] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:05.304120 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4a3ebde1-54ba-4de6-b8f5-b97128227083 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:05.304911 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4a3ebde1-54ba-4de6-b8f5-b97128227083 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:05.306254 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4a3ebde1-54ba-4de6-b8f5-b97128227083 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:05.307532 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4a3ebde1-54ba-4de6-b8f5-b97128227083 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:05.308331 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4a3ebde1-54ba-4de6-b8f5-b97128227083 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:05.309305 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4a3ebde1-54ba-4de6-b8f5-b97128227083 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:05.455043 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-59cbbccd-a483-432c-b8a2-359d047caabc tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673886dab3ed4cbd8a314386fbfbe39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f67490cfb798433eb86c006008c9aaa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:05.474655 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-59cbbccd-a483-432c-b8a2-359d047caabc tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] 10.222.0.33 "GET /compute/v2.1/servers/6ff56299-ada5-4e73-9e68-59cdd48f8a16" status: 200 len: 1278 microversion: 2.1 time: 0.294906 Oct 04 20:40:05.476829 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 887/1682] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:40:05 2022] GET /compute/v2.1/servers/6ff56299-ada5-4e73-9e68-59cdd48f8a16 => generated 1278 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:05.490541 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-847e5f92-f30e-4a61-acbf-bbf4cb1e1d93 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:05.491553 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-847e5f92-f30e-4a61-acbf-bbf4cb1e1d93 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] [instance: 0081d54e-8054-4f3b-9dd4-018f66aa4b27] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:05.509785 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-847e5f92-f30e-4a61-acbf-bbf4cb1e1d93 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:05.511514 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-847e5f92-f30e-4a61-acbf-bbf4cb1e1d93 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:05.512384 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-847e5f92-f30e-4a61-acbf-bbf4cb1e1d93 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:05.515032 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-847e5f92-f30e-4a61-acbf-bbf4cb1e1d93 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:05.518963 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-847e5f92-f30e-4a61-acbf-bbf4cb1e1d93 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:05.519982 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-847e5f92-f30e-4a61-acbf-bbf4cb1e1d93 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:05.708668 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-4a3ebde1-54ba-4de6-b8f5-b97128227083 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96919ec99c14864876d64a9c2b20f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b44ce10b78bf49c882c9b4df06187114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:05.719080 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-4a3ebde1-54ba-4de6-b8f5-b97128227083 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] 10.222.0.33 "GET /compute/v2.1/servers/a2fc592c-9dac-4f72-8633-229925d3bf76" status: 200 len: 1504 microversion: 2.1 time: 0.453632 Oct 04 20:40:05.720014 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 796/1683] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:40:05 2022] GET /compute/v2.1/servers/a2fc592c-9dac-4f72-8633-229925d3bf76 => generated 1504 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:05.727710 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-75062251-2cbb-4264-b82e-f02b6e8666a7 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:05.728753 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-75062251-2cbb-4264-b82e-f02b6e8666a7 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] [instance: 21de8a24-9cad-4f83-a459-5297200c20ad] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:05.739841 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:40:05.823244 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-75062251-2cbb-4264-b82e-f02b6e8666a7 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36f4114dc4f443f8b48da7b4027e0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a23a85365414f92bbc03177d7f190e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:05.827688 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-847e5f92-f30e-4a61-acbf-bbf4cb1e1d93 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a82c49a62249029ebc6ae3b4829709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecf3793be3eb4f3186c07a7e45fd8f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:05.836234 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-75062251-2cbb-4264-b82e-f02b6e8666a7 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] 10.222.0.33 "GET /compute/v2.1/servers/21de8a24-9cad-4f83-a459-5297200c20ad" status: 200 len: 1216 microversion: 2.1 time: 0.114270 Oct 04 20:40:05.836852 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-847e5f92-f30e-4a61-acbf-bbf4cb1e1d93 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] 10.222.0.33 "GET /compute/v2.1/servers/0081d54e-8054-4f3b-9dd4-018f66aa4b27" status: 200 len: 1324 microversion: 2.1 time: 0.358706 Oct 04 20:40:05.852434 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 797/1684] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:40:05 2022] GET /compute/v2.1/servers/21de8a24-9cad-4f83-a459-5297200c20ad => generated 1216 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:05.852434 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-3d04fcb4-4350-4b11-a814-a0d9fcd3bb7b tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:05.852434 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-3d04fcb4-4350-4b11-a814-a0d9fcd3bb7b tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] [instance: 9e9f6289-9999-4188-9af1-6cf64a676eee] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:05.852434 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3d04fcb4-4350-4b11-a814-a0d9fcd3bb7b tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:05.852907 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3d04fcb4-4350-4b11-a814-a0d9fcd3bb7b tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:05.853357 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3d04fcb4-4350-4b11-a814-a0d9fcd3bb7b tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:05.861760 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3d04fcb4-4350-4b11-a814-a0d9fcd3bb7b tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:05.861894 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 888/1685] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:40:05 2022] GET /compute/v2.1/servers/0081d54e-8054-4f3b-9dd4-018f66aa4b27 => generated 1324 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:05.861990 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3d04fcb4-4350-4b11-a814-a0d9fcd3bb7b tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:05.861990 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3d04fcb4-4350-4b11-a814-a0d9fcd3bb7b tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:05.873166 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-3d04fcb4-4350-4b11-a814-a0d9fcd3bb7b tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] HTTP exception thrown: Instance 9e9f6289-9999-4188-9af1-6cf64a676eee could not be found. Oct 04 20:40:05.874957 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-3d04fcb4-4350-4b11-a814-a0d9fcd3bb7b tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Request method failure captured: Oct 04 20:40:05.874957 n-d-854823-8 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/9e9f6289-9999-4188-9af1-6cf64a676eee HTTP/1.1 Oct 04 20:40:05.874957 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:40:05.874957 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:40:05.874957 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:40:05.874957 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 0 Oct 04 20:40:05.874957 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:40:05.874957 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:40:05.874957 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:40:05.874957 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:40:05.874957 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJi4YW5paijGjm0KJCD3xPCjqoV7Yx2gPBOteSu0r3DtnBaxauAhN82fJ8sA4jGopne1RZKgRzfyGU8WtYmELZERLpy7PD9YLLtoJOaL9dbdJigxopqVQsdWKaWPFztWyama9XcrUH3oJLe6wPMcVbEBemlmJBzjFTlhWfl4Iuq6Rdc Oct 04 20:40:05.874957 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:40:05.874957 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:40:05.874957 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:40:05.874957 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:40:05.874957 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:40:05.874957 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:40:05.874957 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: dd3118a5d96843d3bede1ed94bd9717e Oct 04 20:40:05.874957 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-MigrationsAdminTest-282898562 Oct 04 20:40:05.874957 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 20:40:05.874957 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 20:40:05.874957 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_dd3118a5d96843d3bede1ed94bd9717e", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/dd3118a5d96843d3bede1ed94bd9717e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/dd3118a5d96843d3bede1ed94bd9717e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/dd3118a5d96843d3bede1ed94bd9717e"}]}] Oct 04 20:40:05.874957 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-MigrationsAdminTest-282898562 Oct 04 20:40:05.874957 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: dd3118a5d96843d3bede1ed94bd9717e Oct 04 20:40:05.874957 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-MigrationsAdminTest-282898562 Oct 04 20:40:05.874957 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-MigrationsAdminTest-282898562-project Oct 04 20:40:05.874957 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:40:05.874957 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:40:05.874957 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: 3563efe2b8c94931a2a46c4e14811b3a Oct 04 20:40:05.874957 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-MigrationsAdminTest-282898562-project Oct 04 20:40:05.874957 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 20:40:05.874957 n-d-854823-8 devstack@n-api.service[128801]: exception: Instance 9e9f6289-9999-4188-9af1-6cf64a676eee could not be found. Oct 04 20:40:05.874957 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': '9e9f6289-9999-4188-9af1-6cf64a676eee'} Oct 04 20:40:05.874957 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:40:05.874957 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:40:05.874957 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:40:05.874957 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:40:05.874957 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:40:05.874957 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:40:05.874957 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:40:05.874957 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:40:05.874957 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:40:05.874957 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:40:05.874957 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e9f6289-9999-4188-9af1-6cf64a676eee could not be found. Oct 04 20:40:05.874957 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:40:05.874957 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:40:05.874957 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:40:05.874957 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:40:05.874957 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:40:05.874957 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:40:05.874957 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:40:05.874957 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:40:05.874957 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:40:05.874957 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:40:05.874957 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:40:05.874957 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:40:05.874957 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:40:05.874957 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:40:05.874957 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:40:05.874957 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:40:05.874957 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e9f6289-9999-4188-9af1-6cf64a676eee could not be found. Oct 04 20:40:05.874957 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:40:05.874957 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:40:05.874957 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:40:05.882091 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:40:05.882091 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:40:05.882091 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:40:05.882091 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:40:05.882091 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:40:05.882091 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e9f6289-9999-4188-9af1-6cf64a676eee could not be found. Oct 04 20:40:05.882091 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:40:05.882091 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-3d04fcb4-4350-4b11-a814-a0d9fcd3bb7b tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] Returning 404 to user: Instance 9e9f6289-9999-4188-9af1-6cf64a676eee could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:40:05.882091 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-3d04fcb4-4350-4b11-a814-a0d9fcd3bb7b tempest-MigrationsAdminTest-282898562 tempest-MigrationsAdminTest-282898562-project] 10.222.0.33 "GET /compute/v2.1/servers/9e9f6289-9999-4188-9af1-6cf64a676eee" status: 404 len: 111 microversion: 2.1 time: 0.037916 Oct 04 20:40:05.882091 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 798/1686] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:40:05 2022] GET /compute/v2.1/servers/9e9f6289-9999-4188-9af1-6cf64a676eee => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:40:06.093352 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-2bb19a48-cf58-4fe7-85b9-ca4c73058c7b tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:06.094692 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-2bb19a48-cf58-4fe7-85b9-ca4c73058c7b tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] [instance: 81748c83-b703-4c68-899c-c575cc3340d2] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:06.106146 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2bb19a48-cf58-4fe7-85b9-ca4c73058c7b tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:06.107526 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2bb19a48-cf58-4fe7-85b9-ca4c73058c7b tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:06.108005 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2bb19a48-cf58-4fe7-85b9-ca4c73058c7b tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:06.108713 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2bb19a48-cf58-4fe7-85b9-ca4c73058c7b tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:06.109173 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2bb19a48-cf58-4fe7-85b9-ca4c73058c7b tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:06.109598 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2bb19a48-cf58-4fe7-85b9-ca4c73058c7b tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:06.194895 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6cd055b0-3c14-4efb-9336-9f15b788a329 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Calling method '.version_select at 0x7f3c788eef70>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:06.259781 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-6cd055b0-3c14-4efb-9336-9f15b788a329 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] 10.222.0.33 "GET /compute/v2.1/images/4ceaa94c-0232-4808-b979-89d23cbd895c" status: 200 len: 1430 microversion: 2.1 time: 0.068929 Oct 04 20:40:06.270800 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 799/1687] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 20:40:06 2022] GET /compute/v2.1/images/4ceaa94c-0232-4808-b979-89d23cbd895c => generated 1430 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:40:06.276399 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-00a707a8-76d5-4349-bc94-a988055aa53d tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Calling method '.version_select at 0x7f3c78844dc0>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:06.332688 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-2bb19a48-cf58-4fe7-85b9-ca4c73058c7b tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:06.333777 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-00a707a8-76d5-4349-bc94-a988055aa53d tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] 10.222.0.33 "GET /compute/v2.1/images/4ceaa94c-0232-4808-b979-89d23cbd895c" status: 200 len: 1430 microversion: 2.1 time: 0.061662 Oct 04 20:40:06.334771 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 800/1688] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 20:40:06 2022] GET /compute/v2.1/images/4ceaa94c-0232-4808-b979-89d23cbd895c => generated 1430 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:06.351426 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-83e7ed13-41c9-45de-80c7-50b1d025d57f tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:06.351426 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-83e7ed13-41c9-45de-80c7-50b1d025d57f tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] [instance: 0dd1d0cf-a3a0-4ea2-8260-ac206bbfac88] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:06.357416 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-2bb19a48-cf58-4fe7-85b9-ca4c73058c7b tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:06.357597 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-83e7ed13-41c9-45de-80c7-50b1d025d57f tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:06.358014 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-83e7ed13-41c9-45de-80c7-50b1d025d57f tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:06.358482 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-83e7ed13-41c9-45de-80c7-50b1d025d57f tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:06.359194 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-83e7ed13-41c9-45de-80c7-50b1d025d57f tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:06.359657 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-83e7ed13-41c9-45de-80c7-50b1d025d57f tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:06.360228 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-83e7ed13-41c9-45de-80c7-50b1d025d57f tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:06.360368 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-2bb19a48-cf58-4fe7-85b9-ca4c73058c7b tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:06.362291 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-2bb19a48-cf58-4fe7-85b9-ca4c73058c7b tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] 10.222.0.33 "GET /compute/v2.1/servers/81748c83-b703-4c68-899c-c575cc3340d2" status: 200 len: 1812 microversion: 2.25 time: 0.274260 Oct 04 20:40:06.363161 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 889/1689] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:40:06 2022] GET /compute/v2.1/servers/81748c83-b703-4c68-899c-c575cc3340d2 => generated 1812 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:40:06.498870 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-a5fd922d-969a-4c9c-96dc-032381eff1f2 tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:06.499727 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-a5fd922d-969a-4c9c-96dc-032381eff1f2 tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] [instance: 6ff56299-ada5-4e73-9e68-59cdd48f8a16] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:06.515788 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a5fd922d-969a-4c9c-96dc-032381eff1f2 tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:06.519656 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a5fd922d-969a-4c9c-96dc-032381eff1f2 tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:06.522324 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a5fd922d-969a-4c9c-96dc-032381eff1f2 tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:06.525658 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a5fd922d-969a-4c9c-96dc-032381eff1f2 tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:06.527832 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a5fd922d-969a-4c9c-96dc-032381eff1f2 tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:06.528882 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a5fd922d-969a-4c9c-96dc-032381eff1f2 tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:06.573305 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-83e7ed13-41c9-45de-80c7-50b1d025d57f tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bdfa818206f4f4b88cc962c1c34adf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4151c9ef7ae04a728306297f58ba5088', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:06.589095 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-83e7ed13-41c9-45de-80c7-50b1d025d57f tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] 10.222.0.33 "GET /compute/v2.1/servers/0dd1d0cf-a3a0-4ea2-8260-ac206bbfac88" status: 200 len: 1467 microversion: 2.1 time: 0.243586 Oct 04 20:40:06.590323 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 801/1690] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:40:06 2022] GET /compute/v2.1/servers/0dd1d0cf-a3a0-4ea2-8260-ac206bbfac88 => generated 1467 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:40:06.614808 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f31fda2d-fb5e-4a73-b668-5e9c4d909289 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Calling method '.version_select at 0x7f3c742f5ca0>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:06.630512 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-a5fd922d-969a-4c9c-96dc-032381eff1f2 tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673886dab3ed4cbd8a314386fbfbe39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f67490cfb798433eb86c006008c9aaa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:06.644811 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-a5fd922d-969a-4c9c-96dc-032381eff1f2 tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] 10.222.0.33 "GET /compute/v2.1/servers/6ff56299-ada5-4e73-9e68-59cdd48f8a16" status: 200 len: 1278 microversion: 2.1 time: 0.150169 Oct 04 20:40:06.646539 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 890/1691] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:40:06 2022] GET /compute/v2.1/servers/6ff56299-ada5-4e73-9e68-59cdd48f8a16 => generated 1278 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:40:06.668294 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f31fda2d-fb5e-4a73-b668-5e9c4d909289 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] 10.222.0.33 "GET /compute/v2.1/images/15b24725-0c99-4bcf-b1fb-907cdf8e2d63" status: 200 len: 784 microversion: 2.1 time: 0.059199 Oct 04 20:40:06.670576 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 802/1692] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 20:40:06 2022] GET /compute/v2.1/images/15b24725-0c99-4bcf-b1fb-907cdf8e2d63 => generated 784 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 20:40:06.684335 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-c5f62926-d085-455e-b0db-652d38ff7661 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:06.693911 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-c5f62926-d085-455e-b0db-652d38ff7661 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] 10.222.0.33 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.013350 Oct 04 20:40:06.694584 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 891/1693] 10.222.0.33 () {58 vars in 1137 bytes} [Tue Oct 4 20:40:06 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:40:06.707666 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-fc69078c-bfa1-4b96-8e47-f17b79364946 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Calling method '.version_select at 0x7f3c78844c10>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:06.744194 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-4cfe14ad-75cc-4ad3-88c1-260002166984 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:06.744948 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-4cfe14ad-75cc-4ad3-88c1-260002166984 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] [instance: a2fc592c-9dac-4f72-8633-229925d3bf76] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:06.752355 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4cfe14ad-75cc-4ad3-88c1-260002166984 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:06.753390 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4cfe14ad-75cc-4ad3-88c1-260002166984 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:06.754211 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4cfe14ad-75cc-4ad3-88c1-260002166984 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:06.755165 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4cfe14ad-75cc-4ad3-88c1-260002166984 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:06.755857 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4cfe14ad-75cc-4ad3-88c1-260002166984 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:06.756661 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4cfe14ad-75cc-4ad3-88c1-260002166984 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:07.040531 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-4cfe14ad-75cc-4ad3-88c1-260002166984 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96919ec99c14864876d64a9c2b20f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b44ce10b78bf49c882c9b4df06187114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:07.061354 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-4cfe14ad-75cc-4ad3-88c1-260002166984 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] 10.222.0.33 "GET /compute/v2.1/servers/a2fc592c-9dac-4f72-8633-229925d3bf76" status: 200 len: 1504 microversion: 2.1 time: 0.322277 Oct 04 20:40:07.062706 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 892/1694] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:40:06 2022] GET /compute/v2.1/servers/a2fc592c-9dac-4f72-8633-229925d3bf76 => generated 1504 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:07.091486 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-5d5f6241-51f0-4129-9e78-83f773118260 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:07.092698 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-5d5f6241-51f0-4129-9e78-83f773118260 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] [instance: 21de8a24-9cad-4f83-a459-5297200c20ad] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:07.109356 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5d5f6241-51f0-4129-9e78-83f773118260 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:07.111789 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5d5f6241-51f0-4129-9e78-83f773118260 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:07.115829 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5d5f6241-51f0-4129-9e78-83f773118260 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:07.117056 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5d5f6241-51f0-4129-9e78-83f773118260 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:07.117715 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5d5f6241-51f0-4129-9e78-83f773118260 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:07.118304 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5d5f6241-51f0-4129-9e78-83f773118260 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:07.277985 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-5d5f6241-51f0-4129-9e78-83f773118260 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36f4114dc4f443f8b48da7b4027e0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a23a85365414f92bbc03177d7f190e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:07.295450 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-5d5f6241-51f0-4129-9e78-83f773118260 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] 10.222.0.33 "GET /compute/v2.1/servers/21de8a24-9cad-4f83-a459-5297200c20ad" status: 200 len: 1212 microversion: 2.1 time: 0.223299 Oct 04 20:40:07.297349 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 893/1695] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:40:07 2022] GET /compute/v2.1/servers/21de8a24-9cad-4f83-a459-5297200c20ad => generated 1212 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:07.320192 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-cfb6fa43-a4f8-4812-8d1c-6031e4596e2e tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:07.321831 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-cfb6fa43-a4f8-4812-8d1c-6031e4596e2e tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] [instance: 0081d54e-8054-4f3b-9dd4-018f66aa4b27] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:07.353030 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cfb6fa43-a4f8-4812-8d1c-6031e4596e2e tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:07.356546 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cfb6fa43-a4f8-4812-8d1c-6031e4596e2e tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:07.357228 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cfb6fa43-a4f8-4812-8d1c-6031e4596e2e tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:07.359356 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cfb6fa43-a4f8-4812-8d1c-6031e4596e2e tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:07.363984 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cfb6fa43-a4f8-4812-8d1c-6031e4596e2e tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:07.364938 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cfb6fa43-a4f8-4812-8d1c-6031e4596e2e tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:07.594806 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-fc69078c-bfa1-4b96-8e47-f17b79364946 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] 10.222.0.33 "DELETE /compute/v2.1/images/4ceaa94c-0232-4808-b979-89d23cbd895c" status: 204 len: 0 microversion: 2.1 time: 0.891226 Oct 04 20:40:07.595510 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 803/1696] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:40:06 2022] DELETE /compute/v2.1/images/4ceaa94c-0232-4808-b979-89d23cbd895c => generated 0 bytes in 893 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:40:07.602857 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d9c9d909-4c4d-4fc8-9706-ff056f2da0a0 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:07.603596 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d9c9d909-4c4d-4fc8-9706-ff056f2da0a0 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] [instance: 81748c83-b703-4c68-899c-c575cc3340d2] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:07.610840 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d9c9d909-4c4d-4fc8-9706-ff056f2da0a0 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:07.613906 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d9c9d909-4c4d-4fc8-9706-ff056f2da0a0 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:07.620837 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d9c9d909-4c4d-4fc8-9706-ff056f2da0a0 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:07.624700 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d9c9d909-4c4d-4fc8-9706-ff056f2da0a0 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:07.627486 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d9c9d909-4c4d-4fc8-9706-ff056f2da0a0 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:07.628975 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d9c9d909-4c4d-4fc8-9706-ff056f2da0a0 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:07.747532 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-cfb6fa43-a4f8-4812-8d1c-6031e4596e2e tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a82c49a62249029ebc6ae3b4829709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecf3793be3eb4f3186c07a7e45fd8f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:07.774470 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-cfb6fa43-a4f8-4812-8d1c-6031e4596e2e tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] 10.222.0.33 "GET /compute/v2.1/servers/0081d54e-8054-4f3b-9dd4-018f66aa4b27" status: 200 len: 1521 microversion: 2.1 time: 0.475708 Oct 04 20:40:07.775276 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 894/1697] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:40:07 2022] GET /compute/v2.1/servers/0081d54e-8054-4f3b-9dd4-018f66aa4b27 => generated 1521 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:07.804582 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-ed6b72e8-6ac3-4709-9ee1-6d3cf0dd2159 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Calling method '.version_select at 0x7f3c74805700>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:07.828180 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.wsgi [None req-ed6b72e8-6ac3-4709-9ee1-6d3cf0dd2159 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] HTTP exception thrown: Image not found. Oct 04 20:40:07.838588 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-ed6b72e8-6ac3-4709-9ee1-6d3cf0dd2159 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Request method failure captured: Oct 04 20:40:07.838588 n-d-854823-8 devstack@n-api.service[128802]: request: GET /compute/v2.1/images/4ceaa94c-0232-4808-b979-89d23cbd895c HTTP/1.1 Oct 04 20:40:07.838588 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 20:40:07.838588 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 20:40:07.838588 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 20:40:07.838588 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 0 Oct 04 20:40:07.838588 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 20:40:07.838588 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 20:40:07.838588 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 20:40:07.838588 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 20:40:07.838588 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPJnuE2rDdF4OJaHNqaaT6E-hBI9LuK6Sm2sdGaLGM4LHFmgD5UEONtmpt2qAD9awwC2Ssw_XSGcZ3JQzJEtsQqt8zM57DJ-OWjh9lMMmfdMkJ___oqbIg_C_qrcSoEkSRrITPKRaX9r5zH92sl2oFY6aLjh8ZiuJDCyw2O78ZZSEXbI Oct 04 20:40:07.838588 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 20:40:07.838588 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 20:40:07.838588 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 20:40:07.838588 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 20:40:07.838588 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 20:40:07.838588 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 20:40:07.838588 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: 4151c9ef7ae04a728306297f58ba5088 Oct 04 20:40:07.838588 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-ImagesOneServerTestJSON-264095593 Oct 04 20:40:07.838588 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 20:40:07.838588 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 20:40:07.838588 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_4151c9ef7ae04a728306297f58ba5088", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4151c9ef7ae04a728306297f58ba5088"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4151c9ef7ae04a728306297f58ba5088"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/4151c9ef7ae04a728306297f58ba5088"}]}] Oct 04 20:40:07.838588 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-ImagesOneServerTestJSON-264095593 Oct 04 20:40:07.838588 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: 4151c9ef7ae04a728306297f58ba5088 Oct 04 20:40:07.838588 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-264095593 Oct 04 20:40:07.838588 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-ImagesOneServerTestJSON-264095593-project Oct 04 20:40:07.838588 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 20:40:07.838588 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 20:40:07.838588 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: 7bdfa818206f4f4b88cc962c1c34adf3 Oct 04 20:40:07.838588 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-ImagesOneServerTestJSON-264095593-project Oct 04 20:40:07.838588 n-d-854823-8 devstack@n-api.service[128802]: method: Oct 04 20:40:07.838588 n-d-854823-8 devstack@n-api.service[128802]: exception: Image not found. Oct 04 20:40:07.838588 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'id': '4ceaa94c-0232-4808-b979-89d23cbd895c'} Oct 04 20:40:07.838588 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:40:07.838588 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:40:07.838588 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 20:40:07.838588 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 20:40:07.838588 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 20:40:07.838588 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 20:40:07.838588 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 20:40:07.838588 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 20:40:07.838588 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 20:40:07.838588 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 20:40:07.838588 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 20:40:07.838588 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 20:40:07.838588 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 20:40:07.838588 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 20:40:07.838588 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 20:40:07.838588 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 20:40:07.838588 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 20:40:07.838588 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 20:40:07.838588 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 4ceaa94c-0232-4808-b979-89d23cbd895c Oct 04 20:40:07.838588 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:40:07.838588 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:40:07.838588 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:40:07.838588 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:40:07.838588 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 04 20:40:07.838588 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 04 20:40:07.838588 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 04 20:40:07.838588 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 04 20:40:07.838588 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 04 20:40:07.838588 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 04 20:40:07.838588 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 04 20:40:07.843865 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 04 20:40:07.843865 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 20:40:07.843865 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 20:40:07.843865 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 20:40:07.843865 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 20:40:07.843865 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 20:40:07.843865 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 20:40:07.843865 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 20:40:07.843865 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 20:40:07.843865 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 20:40:07.843865 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 20:40:07.843865 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 20:40:07.843865 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 20:40:07.843865 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 20:40:07.843865 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 20:40:07.843865 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 20:40:07.843865 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 20:40:07.843865 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 4ceaa94c-0232-4808-b979-89d23cbd895c could not be found. Oct 04 20:40:07.843865 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:40:07.843865 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:40:07.843865 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:40:07.843865 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:40:07.843865 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:40:07.843865 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:40:07.843865 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:40:07.843865 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:40:07.843865 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:40:07.843865 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:40:07.843865 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:40:07.843865 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:40:07.843865 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 04 20:40:07.843865 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 04 20:40:07.843865 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 20:40:07.843865 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:40:07.843865 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:40:07.843865 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:40:07.843865 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:40:07.843865 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:40:07.843865 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:40:07.843865 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:40:07.843865 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:40:07.843865 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 20:40:07.843865 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:40:07.851302 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-ed6b72e8-6ac3-4709-9ee1-6d3cf0dd2159 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Returning 404 to user: Image not found. {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:40:07.851302 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-ed6b72e8-6ac3-4709-9ee1-6d3cf0dd2159 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] 10.222.0.33 "GET /compute/v2.1/images/4ceaa94c-0232-4808-b979-89d23cbd895c" status: 404 len: 62 microversion: 2.1 time: 0.058619 Oct 04 20:40:07.852264 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 895/1698] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 20:40:07 2022] GET /compute/v2.1/images/4ceaa94c-0232-4808-b979-89d23cbd895c => generated 62 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 20:40:07.863751 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-930cd3b2-3e6d-473c-9938-00326bae5182 tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:07.864646 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-930cd3b2-3e6d-473c-9938-00326bae5182 tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] [instance: 6ff56299-ada5-4e73-9e68-59cdd48f8a16] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:07.873834 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-930cd3b2-3e6d-473c-9938-00326bae5182 tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:07.874251 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-930cd3b2-3e6d-473c-9938-00326bae5182 tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:07.874713 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-930cd3b2-3e6d-473c-9938-00326bae5182 tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:07.875416 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-930cd3b2-3e6d-473c-9938-00326bae5182 tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:07.875860 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-930cd3b2-3e6d-473c-9938-00326bae5182 tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:07.876477 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-930cd3b2-3e6d-473c-9938-00326bae5182 tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:07.953823 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d9c9d909-4c4d-4fc8-9706-ff056f2da0a0 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:07.966722 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d9c9d909-4c4d-4fc8-9706-ff056f2da0a0 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:07.972932 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d9c9d909-4c4d-4fc8-9706-ff056f2da0a0 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:07.974932 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d9c9d909-4c4d-4fc8-9706-ff056f2da0a0 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] 10.222.0.33 "GET /compute/v2.1/servers/81748c83-b703-4c68-899c-c575cc3340d2" status: 200 len: 1812 microversion: 2.25 time: 0.377832 Oct 04 20:40:07.975594 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 804/1699] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:40:07 2022] GET /compute/v2.1/servers/81748c83-b703-4c68-899c-c575cc3340d2 => generated 1812 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:40:07.981993 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f9abd7a6-6a19-4157-a556-9a70e4890d2f tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:07.983335 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f9abd7a6-6a19-4157-a556-9a70e4890d2f tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] [instance: 0081d54e-8054-4f3b-9dd4-018f66aa4b27] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:07.991644 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f9abd7a6-6a19-4157-a556-9a70e4890d2f tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:07.993533 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f9abd7a6-6a19-4157-a556-9a70e4890d2f tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:07.994556 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f9abd7a6-6a19-4157-a556-9a70e4890d2f tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:07.995934 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f9abd7a6-6a19-4157-a556-9a70e4890d2f tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:07.996569 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-930cd3b2-3e6d-473c-9938-00326bae5182 tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673886dab3ed4cbd8a314386fbfbe39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f67490cfb798433eb86c006008c9aaa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:07.997023 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f9abd7a6-6a19-4157-a556-9a70e4890d2f tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:07.997554 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f9abd7a6-6a19-4157-a556-9a70e4890d2f tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:08.006307 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-930cd3b2-3e6d-473c-9938-00326bae5182 tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] 10.222.0.33 "GET /compute/v2.1/servers/6ff56299-ada5-4e73-9e68-59cdd48f8a16" status: 200 len: 1284 microversion: 2.1 time: 0.148088 Oct 04 20:40:08.007470 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 896/1700] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:40:07 2022] GET /compute/v2.1/servers/6ff56299-ada5-4e73-9e68-59cdd48f8a16 => generated 1284 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:08.012673 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-fefa9a26-3525-4bba-aa2d-5b12e4df58be tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-\u20a1-605924622"}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:40:08.015293 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-fefa9a26-3525-4bba-aa2d-5b12e4df58be tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] [instance: 0dd1d0cf-a3a0-4ea2-8260-ac206bbfac88] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:08.023464 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fefa9a26-3525-4bba-aa2d-5b12e4df58be tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:08.023997 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fefa9a26-3525-4bba-aa2d-5b12e4df58be tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:08.024766 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fefa9a26-3525-4bba-aa2d-5b12e4df58be tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:08.025665 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fefa9a26-3525-4bba-aa2d-5b12e4df58be tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:08.026182 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fefa9a26-3525-4bba-aa2d-5b12e4df58be tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:08.026641 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fefa9a26-3525-4bba-aa2d-5b12e4df58be tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:08.390617 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-fefa9a26-3525-4bba-aa2d-5b12e4df58be tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] 10.222.0.33 "POST /compute/v2.1/servers/0dd1d0cf-a3a0-4ea2-8260-ac206bbfac88/action" status: 202 len: 0 microversion: 2.1 time: 0.381634 Oct 04 20:40:08.392209 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 897/1701] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 20:40:08 2022] POST /compute/v2.1/servers/0dd1d0cf-a3a0-4ea2-8260-ac206bbfac88/action => generated 0 bytes in 384 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 04 20:40:08.400042 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-fa17b9bb-254e-4cba-8f38-528ee50f1e7d tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:08.400980 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-fa17b9bb-254e-4cba-8f38-528ee50f1e7d tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] [instance: a2fc592c-9dac-4f72-8633-229925d3bf76] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:08.408995 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fa17b9bb-254e-4cba-8f38-528ee50f1e7d tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:08.409695 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fa17b9bb-254e-4cba-8f38-528ee50f1e7d tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:08.410551 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fa17b9bb-254e-4cba-8f38-528ee50f1e7d tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:08.411427 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fa17b9bb-254e-4cba-8f38-528ee50f1e7d tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:08.412046 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fa17b9bb-254e-4cba-8f38-528ee50f1e7d tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:08.412652 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fa17b9bb-254e-4cba-8f38-528ee50f1e7d tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:08.466295 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f9abd7a6-6a19-4157-a556-9a70e4890d2f tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a82c49a62249029ebc6ae3b4829709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecf3793be3eb4f3186c07a7e45fd8f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:08.481038 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f9abd7a6-6a19-4157-a556-9a70e4890d2f tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] 10.222.0.33 "GET /compute/v2.1/servers/0081d54e-8054-4f3b-9dd4-018f66aa4b27" status: 200 len: 1521 microversion: 2.1 time: 0.504005 Oct 04 20:40:08.481782 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 805/1702] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:40:07 2022] GET /compute/v2.1/servers/0081d54e-8054-4f3b-9dd4-018f66aa4b27 => generated 1521 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:08.487371 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-fb8086fe-0ac8-43e3-a73f-32cdc957aa1b tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:08.498030 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-fb8086fe-0ac8-43e3-a73f-32cdc957aa1b tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] [instance: 21de8a24-9cad-4f83-a459-5297200c20ad] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:08.511723 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fb8086fe-0ac8-43e3-a73f-32cdc957aa1b tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:08.514501 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fb8086fe-0ac8-43e3-a73f-32cdc957aa1b tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:08.515069 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fb8086fe-0ac8-43e3-a73f-32cdc957aa1b tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:08.516117 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fb8086fe-0ac8-43e3-a73f-32cdc957aa1b tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:08.517401 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fb8086fe-0ac8-43e3-a73f-32cdc957aa1b tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:08.518857 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fb8086fe-0ac8-43e3-a73f-32cdc957aa1b tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:08.667754 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-fb8086fe-0ac8-43e3-a73f-32cdc957aa1b tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36f4114dc4f443f8b48da7b4027e0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a23a85365414f92bbc03177d7f190e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:08.700224 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-fb8086fe-0ac8-43e3-a73f-32cdc957aa1b tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] 10.222.0.33 "GET /compute/v2.1/servers/21de8a24-9cad-4f83-a459-5297200c20ad" status: 200 len: 1274 microversion: 2.1 time: 0.217051 Oct 04 20:40:08.710520 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 806/1703] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:40:08 2022] GET /compute/v2.1/servers/21de8a24-9cad-4f83-a459-5297200c20ad => generated 1274 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:08.719169 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b8689592-08bc-47de-9619-d5925dda6f8e tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Calling method '.version_select at 0x7f3c788564c0>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:08.781643 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-fa17b9bb-254e-4cba-8f38-528ee50f1e7d tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96919ec99c14864876d64a9c2b20f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b44ce10b78bf49c882c9b4df06187114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:08.786805 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b8689592-08bc-47de-9619-d5925dda6f8e tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] 10.222.0.33 "GET /compute/v2.1/images/dec1cfe6-6be8-4fc4-a82f-728708d575e6" status: 200 len: 1426 microversion: 2.1 time: 0.074045 Oct 04 20:40:08.788771 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 807/1704] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 20:40:08 2022] GET /compute/v2.1/images/dec1cfe6-6be8-4fc4-a82f-728708d575e6 => generated 1426 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:08.791397 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-fa17b9bb-254e-4cba-8f38-528ee50f1e7d tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] 10.222.0.33 "GET /compute/v2.1/servers/a2fc592c-9dac-4f72-8633-229925d3bf76" status: 200 len: 1484 microversion: 2.1 time: 0.396154 Oct 04 20:40:08.796294 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 898/1705] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:40:08 2022] GET /compute/v2.1/servers/a2fc592c-9dac-4f72-8633-229925d3bf76 => generated 1484 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:08.803942 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7ab203c7-ef72-48da-bb26-0612e51c47c3 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-890049353"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:40:08.808905 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-7ab203c7-ef72-48da-bb26-0612e51c47c3 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] [instance: 0081d54e-8054-4f3b-9dd4-018f66aa4b27] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:08.820375 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7ab203c7-ef72-48da-bb26-0612e51c47c3 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:08.821280 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7ab203c7-ef72-48da-bb26-0612e51c47c3 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:08.821829 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7ab203c7-ef72-48da-bb26-0612e51c47c3 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:08.823102 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7ab203c7-ef72-48da-bb26-0612e51c47c3 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:08.848176 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7ab203c7-ef72-48da-bb26-0612e51c47c3 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:08.849352 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7ab203c7-ef72-48da-bb26-0612e51c47c3 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:09.001055 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-5eb48ffb-0262-425b-8f38-db98d7b5f15a tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:09.001780 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-5eb48ffb-0262-425b-8f38-db98d7b5f15a tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] [instance: 81748c83-b703-4c68-899c-c575cc3340d2] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:09.011802 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5eb48ffb-0262-425b-8f38-db98d7b5f15a tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:09.012295 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5eb48ffb-0262-425b-8f38-db98d7b5f15a tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:09.012739 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5eb48ffb-0262-425b-8f38-db98d7b5f15a tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:09.013457 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5eb48ffb-0262-425b-8f38-db98d7b5f15a tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:09.013913 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5eb48ffb-0262-425b-8f38-db98d7b5f15a tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:09.014357 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5eb48ffb-0262-425b-8f38-db98d7b5f15a tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:09.242418 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-7ab203c7-ef72-48da-bb26-0612e51c47c3 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] 10.222.0.33 "POST /compute/v2.1/servers/0081d54e-8054-4f3b-9dd4-018f66aa4b27/action" status: 202 len: 0 microversion: 2.1 time: 0.452026 Oct 04 20:40:09.249375 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 808/1706] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 20:40:08 2022] POST /compute/v2.1/servers/0081d54e-8054-4f3b-9dd4-018f66aa4b27/action => generated 0 bytes in 456 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 04 20:40:09.259109 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2bb88791-ae7e-425c-b604-be39c31f035b tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-696119062", "imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:40:09.292026 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-5eb48ffb-0262-425b-8f38-db98d7b5f15a tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:09.304330 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-5eb48ffb-0262-425b-8f38-db98d7b5f15a tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:09.309597 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-5eb48ffb-0262-425b-8f38-db98d7b5f15a tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:09.316151 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-5eb48ffb-0262-425b-8f38-db98d7b5f15a tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] 10.222.0.33 "GET /compute/v2.1/servers/81748c83-b703-4c68-899c-c575cc3340d2" status: 200 len: 1812 microversion: 2.25 time: 0.317669 Oct 04 20:40:09.330376 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 899/1707] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:40:08 2022] GET /compute/v2.1/servers/81748c83-b703-4c68-899c-c575cc3340d2 => generated 1812 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 20:40:09.346405 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.network.neutron [None req-2bb88791-ae7e-425c-b604-be39c31f035b tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] validate_networks() for [('5340dae4-9a85-4904-9e18-daf4cbe871b8', None, None, None, None, None)] {{(pid=128801) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:40:09.347241 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-015a62fe-3770-4e6d-8ba0-27981fafb286 tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:09.348116 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-015a62fe-3770-4e6d-8ba0-27981fafb286 tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] [instance: 6ff56299-ada5-4e73-9e68-59cdd48f8a16] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:09.363380 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-015a62fe-3770-4e6d-8ba0-27981fafb286 tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:09.363932 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-015a62fe-3770-4e6d-8ba0-27981fafb286 tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:09.364803 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-015a62fe-3770-4e6d-8ba0-27981fafb286 tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:09.365928 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-015a62fe-3770-4e6d-8ba0-27981fafb286 tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:09.366404 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-015a62fe-3770-4e6d-8ba0-27981fafb286 tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:09.366831 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-015a62fe-3770-4e6d-8ba0-27981fafb286 tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:09.801780 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-015a62fe-3770-4e6d-8ba0-27981fafb286 tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673886dab3ed4cbd8a314386fbfbe39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f67490cfb798433eb86c006008c9aaa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:09.814881 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-015a62fe-3770-4e6d-8ba0-27981fafb286 tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] 10.222.0.33 "GET /compute/v2.1/servers/6ff56299-ada5-4e73-9e68-59cdd48f8a16" status: 200 len: 1351 microversion: 2.1 time: 0.482032 Oct 04 20:40:09.818371 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 900/1708] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:40:09 2022] GET /compute/v2.1/servers/6ff56299-ada5-4e73-9e68-59cdd48f8a16 => generated 1351 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:09.835051 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-6b3bedb1-b760-4862-8898-358622f33b63 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Calling method '.version_select at 0x7f3c789deb80>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:10.051325 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-6b3bedb1-b760-4862-8898-358622f33b63 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] 10.222.0.33 "DELETE /compute/v2.1/images/96ef56d9-69d3-4bee-a5fc-d6af38f1495c" status: 204 len: 0 microversion: 2.1 time: 0.231531 Oct 04 20:40:10.055552 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 901/1709] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:40:09 2022] DELETE /compute/v2.1/images/96ef56d9-69d3-4bee-a5fc-d6af38f1495c => generated 0 bytes in 233 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:40:10.059260 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-2afe8d3e-f375-4277-a3e3-856b73526754 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:10.060215 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-2afe8d3e-f375-4277-a3e3-856b73526754 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] [instance: 21de8a24-9cad-4f83-a459-5297200c20ad] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:10.067141 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2afe8d3e-f375-4277-a3e3-856b73526754 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:10.067962 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2afe8d3e-f375-4277-a3e3-856b73526754 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:10.068851 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2afe8d3e-f375-4277-a3e3-856b73526754 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:10.070119 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2afe8d3e-f375-4277-a3e3-856b73526754 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:10.070832 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2afe8d3e-f375-4277-a3e3-856b73526754 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:10.071459 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2afe8d3e-f375-4277-a3e3-856b73526754 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:10.656607 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-2afe8d3e-f375-4277-a3e3-856b73526754 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36f4114dc4f443f8b48da7b4027e0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a23a85365414f92bbc03177d7f190e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:10.674603 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-2afe8d3e-f375-4277-a3e3-856b73526754 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] 10.222.0.33 "GET /compute/v2.1/servers/21de8a24-9cad-4f83-a459-5297200c20ad" status: 200 len: 1316 microversion: 2.1 time: 0.620387 Oct 04 20:40:10.675509 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 902/1710] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:40:10 2022] GET /compute/v2.1/servers/21de8a24-9cad-4f83-a459-5297200c20ad => generated 1316 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:10.814237 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-dfaaaffb-6339-4137-85db-b8eaa69f8b2d tempest-TenantUsagesNegativeTestJSON-444609320 tempest-TenantUsagesNegativeTestJSON-444609320-project-admin] 10.222.0.33 "GET /compute/v2.1/os-simple-tenant-usage/?start=2022-10-03T20%3A40%3A09.751163&end=2022-10-05T20%3A40%3A09.751163" status: 404 len: 112 microversion: - time: 0.137587 Oct 04 20:40:10.820061 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 903/1711] 10.222.0.33 () {58 vars in 1316 bytes} [Tue Oct 4 20:40:10 2022] GET /compute/v2.1/os-simple-tenant-usage/?start=2022-10-03T20%3A40%3A09.751163&end=2022-10-05T20%3A40%3A09.751163 => generated 112 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 04 20:40:10.825828 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-ef955663-2bc9-490f-9366-5357aef80389 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Calling method '.version_select at 0x7f3c78a27670>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:10.854326 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-2bb88791-ae7e-425c-b604-be39c31f035b tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Flavor limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:40:10.854832 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-2bb88791-ae7e-425c-b604-be39c31f035b tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Image limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:40:10.855248 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-2bb88791-ae7e-425c-b604-be39c31f035b tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Flavor pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:40:10.855658 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-2bb88791-ae7e-425c-b604-be39c31f035b tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Image pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:40:10.856274 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-2bb88791-ae7e-425c-b604-be39c31f035b tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:40:10.867357 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2bb88791-ae7e-425c-b604-be39c31f035b tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:10.868074 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2bb88791-ae7e-425c-b604-be39c31f035b tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:10.868680 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2bb88791-ae7e-425c-b604-be39c31f035b tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:10.869596 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2bb88791-ae7e-425c-b604-be39c31f035b tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:10.870246 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2bb88791-ae7e-425c-b604-be39c31f035b tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:10.870875 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2bb88791-ae7e-425c-b604-be39c31f035b tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:10.885441 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-ef955663-2bc9-490f-9366-5357aef80389 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] 10.222.0.33 "GET /compute/v2.1/images/dec1cfe6-6be8-4fc4-a82f-728708d575e6" status: 200 len: 1426 microversion: 2.1 time: 0.063078 Oct 04 20:40:10.887163 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 904/1712] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 20:40:10 2022] GET /compute/v2.1/images/dec1cfe6-6be8-4fc4-a82f-728708d575e6 => generated 1426 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:10.892332 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-2bb88791-ae7e-425c-b604-be39c31f035b tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Getting quotas for project b44ce10b78bf49c882c9b4df06187114. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:40:10.898328 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-2bb88791-ae7e-425c-b604-be39c31f035b tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Getting quotas for user f96919ec99c14864876d64a9c2b20f8f and project b44ce10b78bf49c882c9b4df06187114. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:40:10.898534 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-05dac9e1-fe2b-4057-9df9-c2bbfbc44d59 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Calling method '.version_select at 0x7f3c7422f430>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:10.915495 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-2bb88791-ae7e-425c-b604-be39c31f035b tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Going to run 1 instances... {{(pid=128801) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:40:10.919079 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-2bb88791-ae7e-425c-b604-be39c31f035b tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] [instance: 53f0a355-8a5d-4775-a0d3-3aeedfc01570] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='15b24725-0c99-4bcf-b1fb-907cdf8e2d63',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128801) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:40:10.924664 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.wsgi [None req-05dac9e1-fe2b-4057-9df9-c2bbfbc44d59 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] HTTP exception thrown: Image not found. Oct 04 20:40:10.927219 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-05dac9e1-fe2b-4057-9df9-c2bbfbc44d59 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Request method failure captured: Oct 04 20:40:10.927219 n-d-854823-8 devstack@n-api.service[128802]: request: GET /compute/v2.1/images/96ef56d9-69d3-4bee-a5fc-d6af38f1495c HTTP/1.1 Oct 04 20:40:10.927219 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 20:40:10.927219 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 20:40:10.927219 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 20:40:10.927219 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 0 Oct 04 20:40:10.927219 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 20:40:10.927219 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 20:40:10.927219 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 20:40:10.927219 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 20:40:10.927219 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPJndB3mJHN0LJ8w6Kheb2n0CJ86k8j-AXdWa3AMW_tNY1_9QQNH8dAe8aGzPWpNIRLrfkOudQ5X3ptj4NBqufJdfAt-Rzg0K2bAeHF3DIzHVwi3Ysg8-zRwFjrbgaapzSsHDGJy5Rd6NQfSoCIrbX0y1TKi0r3vLuM4ZTrt6iTVd_LI Oct 04 20:40:10.927219 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 20:40:10.927219 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 20:40:10.927219 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 20:40:10.927219 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 20:40:10.927219 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 20:40:10.927219 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 20:40:10.927219 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: ecf3793be3eb4f3186c07a7e45fd8f06 Oct 04 20:40:10.927219 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-957462329 Oct 04 20:40:10.927219 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 20:40:10.927219 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 20:40:10.927219 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ecf3793be3eb4f3186c07a7e45fd8f06", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ecf3793be3eb4f3186c07a7e45fd8f06"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ecf3793be3eb4f3186c07a7e45fd8f06"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ecf3793be3eb4f3186c07a7e45fd8f06"}]}] Oct 04 20:40:10.927219 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-957462329 Oct 04 20:40:10.927219 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: ecf3793be3eb4f3186c07a7e45fd8f06 Oct 04 20:40:10.927219 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-957462329 Oct 04 20:40:10.927219 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-ImagesOneServerNegativeTestJSON-957462329-project Oct 04 20:40:10.927219 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 20:40:10.927219 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 20:40:10.927219 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: 89a82c49a62249029ebc6ae3b4829709 Oct 04 20:40:10.927219 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-957462329-project Oct 04 20:40:10.927219 n-d-854823-8 devstack@n-api.service[128802]: method: Oct 04 20:40:10.927219 n-d-854823-8 devstack@n-api.service[128802]: exception: Image not found. Oct 04 20:40:10.927219 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'id': '96ef56d9-69d3-4bee-a5fc-d6af38f1495c'} Oct 04 20:40:10.927219 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:40:10.927219 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:40:10.927219 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 20:40:10.927219 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 20:40:10.927219 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 20:40:10.927219 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 20:40:10.927219 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 20:40:10.927219 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 20:40:10.927219 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 20:40:10.927219 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 20:40:10.927219 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 20:40:10.927219 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 20:40:10.927219 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 20:40:10.927219 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 20:40:10.927219 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 20:40:10.927219 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 20:40:10.927219 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 20:40:10.927219 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 20:40:10.927219 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 96ef56d9-69d3-4bee-a5fc-d6af38f1495c Oct 04 20:40:10.927219 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:40:10.927219 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:40:10.927219 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:40:10.927219 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:40:10.927219 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 04 20:40:10.927219 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 04 20:40:10.927219 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 04 20:40:10.927219 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 04 20:40:10.927219 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 04 20:40:10.927219 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 04 20:40:10.927219 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 04 20:40:10.932426 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 04 20:40:10.932426 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 20:40:10.932426 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 20:40:10.932426 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 20:40:10.932426 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 20:40:10.932426 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 20:40:10.932426 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 20:40:10.932426 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 20:40:10.932426 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 20:40:10.932426 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 20:40:10.932426 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 20:40:10.932426 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 20:40:10.932426 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 20:40:10.932426 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 20:40:10.932426 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 20:40:10.932426 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 20:40:10.932426 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 20:40:10.932426 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 96ef56d9-69d3-4bee-a5fc-d6af38f1495c could not be found. Oct 04 20:40:10.932426 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:40:10.932426 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:40:10.932426 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:40:10.932426 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:40:10.932426 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:40:10.932426 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:40:10.932426 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:40:10.932426 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:40:10.932426 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:40:10.932426 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:40:10.932426 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:40:10.932426 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:40:10.932426 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 04 20:40:10.932426 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 04 20:40:10.932426 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 20:40:10.932426 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:40:10.932426 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:40:10.932426 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:40:10.932426 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:40:10.932426 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:40:10.932426 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:40:10.932426 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:40:10.932426 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:40:10.932426 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 20:40:10.932426 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:40:10.937621 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-05dac9e1-fe2b-4057-9df9-c2bbfbc44d59 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Returning 404 to user: Image not found. {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:40:10.938688 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-05dac9e1-fe2b-4057-9df9-c2bbfbc44d59 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] 10.222.0.33 "GET /compute/v2.1/images/96ef56d9-69d3-4bee-a5fc-d6af38f1495c" status: 404 len: 62 microversion: 2.1 time: 0.050108 Oct 04 20:40:10.943550 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 905/1713] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 20:40:10 2022] GET /compute/v2.1/images/96ef56d9-69d3-4bee-a5fc-d6af38f1495c => generated 62 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 20:40:10.950213 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-b7a7f110-fcd4-434d-bd7d-36a51b4cb570 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:10.951294 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-b7a7f110-fcd4-434d-bd7d-36a51b4cb570 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] [instance: 81748c83-b703-4c68-899c-c575cc3340d2] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:10.959196 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b7a7f110-fcd4-434d-bd7d-36a51b4cb570 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:10.960067 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b7a7f110-fcd4-434d-bd7d-36a51b4cb570 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:10.960686 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b7a7f110-fcd4-434d-bd7d-36a51b4cb570 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:10.962178 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b7a7f110-fcd4-434d-bd7d-36a51b4cb570 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:10.962598 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b7a7f110-fcd4-434d-bd7d-36a51b4cb570 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:10.963002 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b7a7f110-fcd4-434d-bd7d-36a51b4cb570 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:10.981857 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-2bb88791-ae7e-425c-b604-be39c31f035b tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.732917 Oct 04 20:40:10.983349 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 809/1714] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 20:40:09 2022] POST /compute/v2.1/servers => generated 383 bytes in 1735 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 20:40:10.989105 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-e6cc8877-b673-486b-9254-a15846d1d6ac req-825f9ee6-77e5-48e4-9284-fd5e5cb7ff7d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21de8a24-9cad-4f83-a459-5297200c20ad", "tag": "bbffae2a-7404-4047-a95f-8dd200c997e8"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:40:11.000224 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-e6cc8877-b673-486b-9254-a15846d1d6ac req-825f9ee6-77e5-48e4-9284-fd5e5cb7ff7d service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:11.000710 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-e6cc8877-b673-486b-9254-a15846d1d6ac req-825f9ee6-77e5-48e4-9284-fd5e5cb7ff7d service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:11.001142 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-e6cc8877-b673-486b-9254-a15846d1d6ac req-825f9ee6-77e5-48e4-9284-fd5e5cb7ff7d service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:11.012899 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-e6cc8877-b673-486b-9254-a15846d1d6ac req-825f9ee6-77e5-48e4-9284-fd5e5cb7ff7d service nova] Creating event network-changed:bbffae2a-7404-4047-a95f-8dd200c997e8 for instance 21de8a24-9cad-4f83-a459-5297200c20ad on n-h1-854823-8 Oct 04 20:40:11.019066 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-e6cc8877-b673-486b-9254-a15846d1d6ac req-825f9ee6-77e5-48e4-9284-fd5e5cb7ff7d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033878 Oct 04 20:40:11.019988 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 810/1715] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:40:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:40:11.027251 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c4fb08cf-5bf9-4971-95b4-8c8f3919fe80 tempest-TenantUsagesNegativeTestJSON-444609320 tempest-TenantUsagesNegativeTestJSON-444609320-project-admin] Calling method '.version_select at 0x7f3c788563a0>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:11.046919 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-c4fb08cf-5bf9-4971-95b4-8c8f3919fe80 tempest-TenantUsagesNegativeTestJSON-444609320 tempest-TenantUsagesNegativeTestJSON-444609320-project-admin] HTTP exception thrown: Invalid start time. The start time cannot occur after the end time. Oct 04 20:40:11.055127 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c4fb08cf-5bf9-4971-95b4-8c8f3919fe80 tempest-TenantUsagesNegativeTestJSON-444609320 tempest-TenantUsagesNegativeTestJSON-444609320-project-admin] Request method failure captured: Oct 04 20:40:11.055127 n-d-854823-8 devstack@n-api.service[128801]: request: GET /compute/v2.1/os-simple-tenant-usage/8b9846ab91e54311843b80922f625b25?start=2022-10-05T20%3A40%3A09.751163&end=2022-10-03T20%3A40%3A09.751163 HTTP/1.1 Oct 04 20:40:11.055127 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:40:11.055127 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:40:11.055127 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:40:11.055127 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 0 Oct 04 20:40:11.055127 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:40:11.055127 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:40:11.055127 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:40:11.055127 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:40:11.055127 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJop-ci5Vq1p5k5j6b-FUhg9wr9KzfV6Q6Cu_y1c1CNl6Uf8D4jLB0zNLvrp99so1dHzH1axI2cnS7V9VqpHiO7EVuHo10nPjf4lFjY4q2Gaq0xt68yzKwPXR1T45pvQtmO8TvPCoy0oWJptBqHH74PtXlL86yGeDAYKz6tnh2p82nE Oct 04 20:40:11.055127 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:40:11.055127 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:40:11.055127 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:40:11.055127 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:40:11.055127 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:40:11.055127 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:40:11.055127 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: 8e2cebf0243747ea9cf53cd4547ebe74 Oct 04 20:40:11.055127 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-444609320 Oct 04 20:40:11.055127 n-d-854823-8 devstack@n-api.service[128801]: X-Role: admin,reader,member Oct 04 20:40:11.055127 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: admin,reader,member Oct 04 20:40:11.055127 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_8e2cebf0243747ea9cf53cd4547ebe74", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8e2cebf0243747ea9cf53cd4547ebe74"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8e2cebf0243747ea9cf53cd4547ebe74"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/8e2cebf0243747ea9cf53cd4547ebe74"}]}] Oct 04 20:40:11.055127 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-444609320 Oct 04 20:40:11.055127 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: 8e2cebf0243747ea9cf53cd4547ebe74 Oct 04 20:40:11.055127 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-444609320 Oct 04 20:40:11.055127 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-TenantUsagesNegativeTestJSON-444609320-project-admin Oct 04 20:40:11.055127 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:40:11.055127 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:40:11.055127 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: c468095d0abc41b9aedf8cd17b62a70c Oct 04 20:40:11.055127 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-444609320-project-admin Oct 04 20:40:11.055127 n-d-854823-8 devstack@n-api.service[128801]: method: Oct 04 20:40:11.055127 n-d-854823-8 devstack@n-api.service[128801]: exception: Invalid start time. The start time cannot occur after the end time. Oct 04 20:40:11.055127 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': '8b9846ab91e54311843b80922f625b25'} Oct 04 20:40:11.055127 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:40:11.055127 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:40:11.055127 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:40:11.055127 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:40:11.055127 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:40:11.055127 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:40:11.055127 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:40:11.055127 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:40:11.055127 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 20:40:11.055127 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:40:11.055127 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:40:11.055127 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:40:11.055127 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 292, in show Oct 04 20:40:11.055127 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self._show(req, id) Oct 04 20:40:11.055127 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 338, in _show Oct 04 20:40:11.055127 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi (period_start, period_stop, ignore) = self._get_datetime_range( Oct 04 20:40:11.055127 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 259, in _get_datetime_range Oct 04 20:40:11.055127 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 04 20:40:11.055127 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid start time. The start time cannot occur after the end time. Oct 04 20:40:11.055127 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:40:11.055127 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:40:11.055127 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:40:11.055127 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:40:11.055127 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:40:11.055127 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:40:11.055127 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:40:11.055127 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:40:11.055127 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid start time. The start time cannot occur after the end time. Oct 04 20:40:11.055127 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:40:11.062576 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c4fb08cf-5bf9-4971-95b4-8c8f3919fe80 tempest-TenantUsagesNegativeTestJSON-444609320 tempest-TenantUsagesNegativeTestJSON-444609320-project-admin] Returning 400 to user: Invalid start time. The start time cannot occur after the end time. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:40:11.063467 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c4fb08cf-5bf9-4971-95b4-8c8f3919fe80 tempest-TenantUsagesNegativeTestJSON-444609320 tempest-TenantUsagesNegativeTestJSON-444609320-project-admin] 10.222.0.33 "GET /compute/v2.1/os-simple-tenant-usage/8b9846ab91e54311843b80922f625b25?start=2022-10-05T20%3A40%3A09.751163&end=2022-10-03T20%3A40%3A09.751163" status: 400 len: 111 microversion: 2.1 time: 0.042141 Oct 04 20:40:11.064791 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 811/1716] 10.222.0.33 () {58 vars in 1412 bytes} [Tue Oct 4 20:40:11 2022] GET /compute/v2.1/os-simple-tenant-usage/8b9846ab91e54311843b80922f625b25?start=2022-10-05T20%3A40%3A09.751163&end=2022-10-03T20%3A40%3A09.751163 => generated 111 bytes in 44 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 20:40:11.074666 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2e8bc65e-6e51-4ead-94d3-5d16b7ccbae2 tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:11.075412 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-2e8bc65e-6e51-4ead-94d3-5d16b7ccbae2 tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] [instance: 6ff56299-ada5-4e73-9e68-59cdd48f8a16] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:11.083993 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2e8bc65e-6e51-4ead-94d3-5d16b7ccbae2 tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:11.084876 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2e8bc65e-6e51-4ead-94d3-5d16b7ccbae2 tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:11.086138 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2e8bc65e-6e51-4ead-94d3-5d16b7ccbae2 tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:11.087377 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2e8bc65e-6e51-4ead-94d3-5d16b7ccbae2 tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:11.088464 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2e8bc65e-6e51-4ead-94d3-5d16b7ccbae2 tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:11.089120 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2e8bc65e-6e51-4ead-94d3-5d16b7ccbae2 tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:11.282101 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-b7a7f110-fcd4-434d-bd7d-36a51b4cb570 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:11.294501 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-b7a7f110-fcd4-434d-bd7d-36a51b4cb570 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:11.296561 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-b7a7f110-fcd4-434d-bd7d-36a51b4cb570 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:11.298389 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-b7a7f110-fcd4-434d-bd7d-36a51b4cb570 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] 10.222.0.33 "GET /compute/v2.1/servers/81748c83-b703-4c68-899c-c575cc3340d2" status: 200 len: 1812 microversion: 2.25 time: 0.353263 Oct 04 20:40:11.299357 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 906/1717] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:40:10 2022] GET /compute/v2.1/servers/81748c83-b703-4c68-899c-c575cc3340d2 => generated 1812 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:40:11.303684 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-83270d76-6cd0-4b69-bb8d-61edb0763f0a tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:11.304292 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-83270d76-6cd0-4b69-bb8d-61edb0763f0a tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] [instance: 0081d54e-8054-4f3b-9dd4-018f66aa4b27] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:11.310374 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-83270d76-6cd0-4b69-bb8d-61edb0763f0a tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:11.310851 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-83270d76-6cd0-4b69-bb8d-61edb0763f0a tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:11.311512 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-83270d76-6cd0-4b69-bb8d-61edb0763f0a tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:11.312560 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-83270d76-6cd0-4b69-bb8d-61edb0763f0a tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:11.313297 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-83270d76-6cd0-4b69-bb8d-61edb0763f0a tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:11.314217 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-83270d76-6cd0-4b69-bb8d-61edb0763f0a tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:11.318882 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:40:11.326108 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-2e8bc65e-6e51-4ead-94d3-5d16b7ccbae2 tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673886dab3ed4cbd8a314386fbfbe39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f67490cfb798433eb86c006008c9aaa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:11.339049 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-2e8bc65e-6e51-4ead-94d3-5d16b7ccbae2 tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] 10.222.0.33 "GET /compute/v2.1/servers/6ff56299-ada5-4e73-9e68-59cdd48f8a16" status: 200 len: 1351 microversion: 2.1 time: 0.272731 Oct 04 20:40:11.340388 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 812/1718] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:40:11 2022] GET /compute/v2.1/servers/6ff56299-ada5-4e73-9e68-59cdd48f8a16 => generated 1351 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:11.349066 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9d5a939c-53fa-4fd1-8f78-d82fac37909e tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:11.350327 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-9d5a939c-53fa-4fd1-8f78-d82fac37909e tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] [instance: 53f0a355-8a5d-4775-a0d3-3aeedfc01570] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:11.429062 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-9d5a939c-53fa-4fd1-8f78-d82fac37909e tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96919ec99c14864876d64a9c2b20f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b44ce10b78bf49c882c9b4df06187114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:11.436921 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-9d5a939c-53fa-4fd1-8f78-d82fac37909e tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] 10.222.0.33 "GET /compute/v2.1/servers/53f0a355-8a5d-4775-a0d3-3aeedfc01570" status: 200 len: 1213 microversion: 2.1 time: 0.094803 Oct 04 20:40:11.437497 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 813/1719] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:40:11 2022] GET /compute/v2.1/servers/53f0a355-8a5d-4775-a0d3-3aeedfc01570 => generated 1213 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:11.446850 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-dbf7faa0-c7de-4a81-810c-b46a6e9f4a8b req-7d15ab04-453a-4c45-85c2-6d60f53a6202 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ff56299-ada5-4e73-9e68-59cdd48f8a16", "tag": "8639aac2-0a5a-4a66-92f5-712c9424eedf"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:40:11.458270 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-dbf7faa0-c7de-4a81-810c-b46a6e9f4a8b req-7d15ab04-453a-4c45-85c2-6d60f53a6202 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:11.458781 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-dbf7faa0-c7de-4a81-810c-b46a6e9f4a8b req-7d15ab04-453a-4c45-85c2-6d60f53a6202 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:11.459213 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-dbf7faa0-c7de-4a81-810c-b46a6e9f4a8b req-7d15ab04-453a-4c45-85c2-6d60f53a6202 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:11.470920 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-dbf7faa0-c7de-4a81-810c-b46a6e9f4a8b req-7d15ab04-453a-4c45-85c2-6d60f53a6202 service nova] Creating event network-changed:8639aac2-0a5a-4a66-92f5-712c9424eedf for instance 6ff56299-ada5-4e73-9e68-59cdd48f8a16 on n-h1-854823-8 Oct 04 20:40:11.476439 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-dbf7faa0-c7de-4a81-810c-b46a6e9f4a8b req-7d15ab04-453a-4c45-85c2-6d60f53a6202 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037561 Oct 04 20:40:11.477377 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 814/1720] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:40:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:40:11.497530 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-83270d76-6cd0-4b69-bb8d-61edb0763f0a tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a82c49a62249029ebc6ae3b4829709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecf3793be3eb4f3186c07a7e45fd8f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:11.505424 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-83270d76-6cd0-4b69-bb8d-61edb0763f0a tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] 10.222.0.33 "GET /compute/v2.1/servers/0081d54e-8054-4f3b-9dd4-018f66aa4b27" status: 200 len: 1539 microversion: 2.1 time: 0.205264 Oct 04 20:40:11.505997 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 907/1721] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:40:11 2022] GET /compute/v2.1/servers/0081d54e-8054-4f3b-9dd4-018f66aa4b27 => generated 1539 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:11.606164 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b9407843-f2d6-4fdc-bbce-ebabbe89deee tempest-TenantUsagesNegativeTestJSON-1348358220 tempest-TenantUsagesNegativeTestJSON-1348358220-project] Calling method '.version_select at 0x7f3c743b3160>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:11.611790 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-b9407843-f2d6-4fdc-bbce-ebabbe89deee tempest-TenantUsagesNegativeTestJSON-1348358220 tempest-TenantUsagesNegativeTestJSON-1348358220-project] Policy check for os_compute_api:os-simple-tenant-usage:list failed with credentials {'is_admin': False, 'user_id': 'fa40b4132ab445f7a671e99d2d1c8b9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b9846ab91e54311843b80922f625b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:11.613604 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b9407843-f2d6-4fdc-bbce-ebabbe89deee tempest-TenantUsagesNegativeTestJSON-1348358220 tempest-TenantUsagesNegativeTestJSON-1348358220-project] Request method failure captured: Oct 04 20:40:11.613604 n-d-854823-8 devstack@n-api.service[128801]: request: GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-03T20%3A40%3A09.751163&end=2022-10-05T20%3A40%3A09.751163&detailed=1 HTTP/1.1 Oct 04 20:40:11.613604 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:40:11.613604 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:40:11.613604 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:40:11.613604 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 0 Oct 04 20:40:11.613604 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:40:11.613604 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:40:11.613604 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:40:11.613604 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:40:11.613604 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJoooYz2ajTh0AqN3IXbsq2KlkTwqwZMftYJxseHmvFFsGSsJMJFs-s-TStU2_UspHIkmzYwoI2ENkxI5IdS_OKQSCDvgpKm8-JnsYT3Gv-RJnM3SiMIY9czhYUOeNdXCQ3hXNjsY030uKU5sNJxFoLL5ayC2MNO0Vrp7_UaRWIRlVQ Oct 04 20:40:11.613604 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:40:11.613604 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:40:11.613604 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:40:11.613604 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:40:11.613604 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:40:11.613604 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:40:11.613604 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: 8b9846ab91e54311843b80922f625b25 Oct 04 20:40:11.613604 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-1348358220 Oct 04 20:40:11.613604 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 20:40:11.613604 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 20:40:11.613604 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_8b9846ab91e54311843b80922f625b25", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8b9846ab91e54311843b80922f625b25"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8b9846ab91e54311843b80922f625b25"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/8b9846ab91e54311843b80922f625b25"}]}] Oct 04 20:40:11.613604 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-1348358220 Oct 04 20:40:11.613604 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: 8b9846ab91e54311843b80922f625b25 Oct 04 20:40:11.613604 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-1348358220 Oct 04 20:40:11.613604 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-TenantUsagesNegativeTestJSON-1348358220-project Oct 04 20:40:11.613604 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:40:11.613604 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:40:11.613604 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: fa40b4132ab445f7a671e99d2d1c8b9a Oct 04 20:40:11.613604 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-1348358220-project Oct 04 20:40:11.613604 n-d-854823-8 devstack@n-api.service[128801]: method: Oct 04 20:40:11.613604 n-d-854823-8 devstack@n-api.service[128801]: exception: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Oct 04 20:40:11.613604 n-d-854823-8 devstack@n-api.service[128801]: action_args: {} Oct 04 20:40:11.613604 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:40:11.613604 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:40:11.613604 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:40:11.613604 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:40:11.613604 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:40:11.613604 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:40:11.613604 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:40:11.613604 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:40:11.613604 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 20:40:11.613604 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:40:11.613604 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:40:11.613604 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:40:11.613604 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 277, in index Oct 04 20:40:11.613604 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self._index(req) Oct 04 20:40:11.613604 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 297, in _index Oct 04 20:40:11.613604 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi context.can(stu_policies.POLICY_ROOT % 'list') Oct 04 20:40:11.613604 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 20:40:11.613604 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 20:40:11.613604 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 20:40:11.613604 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 20:40:11.613604 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 20:40:11.613604 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 20:40:11.613604 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 20:40:11.613604 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 20:40:11.613604 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 20:40:11.613604 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 20:40:11.613604 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 20:40:11.613604 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 20:40:11.613604 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 20:40:11.618250 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 20:40:11.618250 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Oct 04 20:40:11.618250 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:40:11.618250 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:40:11.618250 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:40:11.618250 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:40:11.618250 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:40:11.618250 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:40:11.618250 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 20:40:11.618250 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 20:40:11.618250 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Oct 04 20:40:11.618250 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:40:11.618250 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b9407843-f2d6-4fdc-bbce-ebabbe89deee tempest-TenantUsagesNegativeTestJSON-1348358220 tempest-TenantUsagesNegativeTestJSON-1348358220-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:40:11.618250 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b9407843-f2d6-4fdc-bbce-ebabbe89deee tempest-TenantUsagesNegativeTestJSON-1348358220 tempest-TenantUsagesNegativeTestJSON-1348358220-project] 10.222.0.33 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-03T20%3A40%3A09.751163&end=2022-10-05T20%3A40%3A09.751163&detailed=1" status: 403 len: 123 microversion: 2.1 time: 0.136178 Oct 04 20:40:11.618250 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 815/1722] 10.222.0.33 () {58 vars in 1335 bytes} [Tue Oct 4 20:40:11 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-03T20%3A40%3A09.751163&end=2022-10-05T20%3A40%3A09.751163&detailed=1 => generated 123 bytes in 137 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:40:11.700420 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-98308102-9fdd-4cd5-b526-0d0cf587b239 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:11.701421 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-98308102-9fdd-4cd5-b526-0d0cf587b239 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] [instance: 21de8a24-9cad-4f83-a459-5297200c20ad] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:11.710856 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-98308102-9fdd-4cd5-b526-0d0cf587b239 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:11.711515 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-98308102-9fdd-4cd5-b526-0d0cf587b239 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:11.712496 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-98308102-9fdd-4cd5-b526-0d0cf587b239 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:11.713449 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-98308102-9fdd-4cd5-b526-0d0cf587b239 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:11.714221 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-98308102-9fdd-4cd5-b526-0d0cf587b239 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:11.715278 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-98308102-9fdd-4cd5-b526-0d0cf587b239 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:11.765624 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-a0b6d09f-b1e7-48a7-b9e9-315f70c0dd95 req-87ab6e88-22c0-4261-b57f-c7bea90f21cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0dd1d0cf-a3a0-4ea2-8260-ac206bbfac88", "name": "network-vif-unplugged", "status": "completed", "tag": "5ef34720-ea76-4ea1-90bb-a255bf7dfe8b"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:40:11.812392 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-a0b6d09f-b1e7-48a7-b9e9-315f70c0dd95 req-87ab6e88-22c0-4261-b57f-c7bea90f21cd service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:11.815054 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-a0b6d09f-b1e7-48a7-b9e9-315f70c0dd95 req-87ab6e88-22c0-4261-b57f-c7bea90f21cd service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:11.816490 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-a0b6d09f-b1e7-48a7-b9e9-315f70c0dd95 req-87ab6e88-22c0-4261-b57f-c7bea90f21cd service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:11.834788 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-a0b6d09f-b1e7-48a7-b9e9-315f70c0dd95 req-87ab6e88-22c0-4261-b57f-c7bea90f21cd service nova] Creating event network-vif-unplugged:5ef34720-ea76-4ea1-90bb-a255bf7dfe8b for instance 0dd1d0cf-a3a0-4ea2-8260-ac206bbfac88 on n-h1-854823-8 Oct 04 20:40:11.844771 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-a0b6d09f-b1e7-48a7-b9e9-315f70c0dd95 req-87ab6e88-22c0-4261-b57f-c7bea90f21cd service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.083575 Oct 04 20:40:11.847026 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 816/1723] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:40:11 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:40:11.904390 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2f47d4e3-6df2-4039-ba50-96699d468db8 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Calling method '.version_select at 0x7f3c78844820>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:11.946389 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-98308102-9fdd-4cd5-b526-0d0cf587b239 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36f4114dc4f443f8b48da7b4027e0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a23a85365414f92bbc03177d7f190e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:11.958051 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-98308102-9fdd-4cd5-b526-0d0cf587b239 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] 10.222.0.33 "GET /compute/v2.1/servers/21de8a24-9cad-4f83-a459-5297200c20ad" status: 200 len: 1316 microversion: 2.1 time: 0.264845 Oct 04 20:40:11.958682 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 908/1724] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:40:11 2022] GET /compute/v2.1/servers/21de8a24-9cad-4f83-a459-5297200c20ad => generated 1316 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:11.991938 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-2f47d4e3-6df2-4039-ba50-96699d468db8 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] 10.222.0.33 "GET /compute/v2.1/images/dec1cfe6-6be8-4fc4-a82f-728708d575e6" status: 200 len: 1426 microversion: 2.1 time: 0.093755 Oct 04 20:40:12.000347 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 817/1725] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 20:40:11 2022] GET /compute/v2.1/images/dec1cfe6-6be8-4fc4-a82f-728708d575e6 => generated 1426 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:12.324281 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-995855cf-b89f-4e04-aa1c-5a4a4ad343c7 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:12.324811 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-995855cf-b89f-4e04-aa1c-5a4a4ad343c7 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] [instance: 81748c83-b703-4c68-899c-c575cc3340d2] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:12.327197 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell0:SELECT=2 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:40:12.332754 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-995855cf-b89f-4e04-aa1c-5a4a4ad343c7 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:12.333246 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-995855cf-b89f-4e04-aa1c-5a4a4ad343c7 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:12.333681 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-995855cf-b89f-4e04-aa1c-5a4a4ad343c7 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:12.334413 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-995855cf-b89f-4e04-aa1c-5a4a4ad343c7 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:12.335395 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-995855cf-b89f-4e04-aa1c-5a4a4ad343c7 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:12.335847 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-995855cf-b89f-4e04-aa1c-5a4a4ad343c7 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:12.367366 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2255e571-3595-44eb-a9c4-d4484061f70a tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:12.368214 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-2255e571-3595-44eb-a9c4-d4484061f70a tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] [instance: 6ff56299-ada5-4e73-9e68-59cdd48f8a16] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:12.374850 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2255e571-3595-44eb-a9c4-d4484061f70a tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:12.375362 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2255e571-3595-44eb-a9c4-d4484061f70a tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:12.375956 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2255e571-3595-44eb-a9c4-d4484061f70a tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:12.376919 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2255e571-3595-44eb-a9c4-d4484061f70a tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:12.377703 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2255e571-3595-44eb-a9c4-d4484061f70a tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:12.378138 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2255e571-3595-44eb-a9c4-d4484061f70a tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:12.491746 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell0:SELECT=12 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:40:12.568795 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-995855cf-b89f-4e04-aa1c-5a4a4ad343c7 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:12.594235 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-995855cf-b89f-4e04-aa1c-5a4a4ad343c7 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:12.596907 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-995855cf-b89f-4e04-aa1c-5a4a4ad343c7 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:12.598143 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-995855cf-b89f-4e04-aa1c-5a4a4ad343c7 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] 10.222.0.33 "GET /compute/v2.1/servers/81748c83-b703-4c68-899c-c575cc3340d2" status: 200 len: 1812 microversion: 2.25 time: 0.278455 Oct 04 20:40:12.599661 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 909/1726] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:40:12 2022] GET /compute/v2.1/servers/81748c83-b703-4c68-899c-c575cc3340d2 => generated 1812 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:40:12.607167 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-ab267b83-21d5-4cc2-b0e4-52627895b31a tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:12.610024 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-ab267b83-21d5-4cc2-b0e4-52627895b31a tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] [instance: 53f0a355-8a5d-4775-a0d3-3aeedfc01570] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:12.624924 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ab267b83-21d5-4cc2-b0e4-52627895b31a tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:12.625674 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ab267b83-21d5-4cc2-b0e4-52627895b31a tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:12.626734 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ab267b83-21d5-4cc2-b0e4-52627895b31a tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:12.627711 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ab267b83-21d5-4cc2-b0e4-52627895b31a tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:12.628341 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ab267b83-21d5-4cc2-b0e4-52627895b31a tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:12.628941 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ab267b83-21d5-4cc2-b0e4-52627895b31a tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:12.636330 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-2255e571-3595-44eb-a9c4-d4484061f70a tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673886dab3ed4cbd8a314386fbfbe39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f67490cfb798433eb86c006008c9aaa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:12.647681 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-2255e571-3595-44eb-a9c4-d4484061f70a tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] 10.222.0.33 "GET /compute/v2.1/servers/6ff56299-ada5-4e73-9e68-59cdd48f8a16" status: 200 len: 1351 microversion: 2.1 time: 0.286065 Oct 04 20:40:12.654617 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 818/1727] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:40:12 2022] GET /compute/v2.1/servers/6ff56299-ada5-4e73-9e68-59cdd48f8a16 => generated 1351 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:12.668200 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9be7fefd-5ddb-4a0c-bf67-360666896735 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:12.668744 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-9be7fefd-5ddb-4a0c-bf67-360666896735 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] [instance: 0081d54e-8054-4f3b-9dd4-018f66aa4b27] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:12.683192 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9be7fefd-5ddb-4a0c-bf67-360666896735 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:12.683907 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9be7fefd-5ddb-4a0c-bf67-360666896735 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:12.684343 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9be7fefd-5ddb-4a0c-bf67-360666896735 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:12.685050 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9be7fefd-5ddb-4a0c-bf67-360666896735 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:12.685953 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9be7fefd-5ddb-4a0c-bf67-360666896735 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:12.686579 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9be7fefd-5ddb-4a0c-bf67-360666896735 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:12.718982 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=96,nova_cell1:INSERT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:40:12.803223 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-ab267b83-21d5-4cc2-b0e4-52627895b31a tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96919ec99c14864876d64a9c2b20f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b44ce10b78bf49c882c9b4df06187114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:12.814794 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-ab267b83-21d5-4cc2-b0e4-52627895b31a tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] 10.222.0.33 "GET /compute/v2.1/servers/53f0a355-8a5d-4775-a0d3-3aeedfc01570" status: 200 len: 1265 microversion: 2.1 time: 0.213814 Oct 04 20:40:12.820041 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 910/1728] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:40:12 2022] GET /compute/v2.1/servers/53f0a355-8a5d-4775-a0d3-3aeedfc01570 => generated 1265 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:12.984094 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-9f1bd4a0-e35e-4bbf-8782-b42aafcdd50c tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:12.984698 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-9f1bd4a0-e35e-4bbf-8782-b42aafcdd50c tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] [instance: 21de8a24-9cad-4f83-a459-5297200c20ad] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:12.991498 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9f1bd4a0-e35e-4bbf-8782-b42aafcdd50c tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:12.991981 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9f1bd4a0-e35e-4bbf-8782-b42aafcdd50c tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:12.992414 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9f1bd4a0-e35e-4bbf-8782-b42aafcdd50c tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:12.993124 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9f1bd4a0-e35e-4bbf-8782-b42aafcdd50c tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:12.993578 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9f1bd4a0-e35e-4bbf-8782-b42aafcdd50c tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:12.994204 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9f1bd4a0-e35e-4bbf-8782-b42aafcdd50c tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:12.999693 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-9be7fefd-5ddb-4a0c-bf67-360666896735 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a82c49a62249029ebc6ae3b4829709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecf3793be3eb4f3186c07a7e45fd8f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:13.008774 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-9be7fefd-5ddb-4a0c-bf67-360666896735 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] 10.222.0.33 "GET /compute/v2.1/servers/0081d54e-8054-4f3b-9dd4-018f66aa4b27" status: 200 len: 1539 microversion: 2.1 time: 0.352813 Oct 04 20:40:13.023299 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 819/1729] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:40:12 2022] GET /compute/v2.1/servers/0081d54e-8054-4f3b-9dd4-018f66aa4b27 => generated 1539 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:13.031060 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1f9c75a8-b799-4a83-950c-a0c4427d6642 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Calling method '.version_select at 0x7f3c78844ee0>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:13.082736 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-1f9c75a8-b799-4a83-950c-a0c4427d6642 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] 10.222.0.33 "GET /compute/v2.1/images/dec1cfe6-6be8-4fc4-a82f-728708d575e6" status: 200 len: 1426 microversion: 2.1 time: 0.057846 Oct 04 20:40:13.083319 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 820/1730] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 20:40:13 2022] GET /compute/v2.1/images/dec1cfe6-6be8-4fc4-a82f-728708d575e6 => generated 1426 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:13.273192 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-9f1bd4a0-e35e-4bbf-8782-b42aafcdd50c tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36f4114dc4f443f8b48da7b4027e0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a23a85365414f92bbc03177d7f190e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:13.281477 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-9f1bd4a0-e35e-4bbf-8782-b42aafcdd50c tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] 10.222.0.33 "GET /compute/v2.1/servers/21de8a24-9cad-4f83-a459-5297200c20ad" status: 200 len: 1316 microversion: 2.1 time: 0.302408 Oct 04 20:40:13.298443 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 911/1731] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:40:12 2022] GET /compute/v2.1/servers/21de8a24-9cad-4f83-a459-5297200c20ad => generated 1316 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:40:13.628794 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-912e2422-e411-4906-baf7-37ede4304978 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:13.629609 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-912e2422-e411-4906-baf7-37ede4304978 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] [instance: 81748c83-b703-4c68-899c-c575cc3340d2] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:13.639963 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-912e2422-e411-4906-baf7-37ede4304978 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:13.640826 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-912e2422-e411-4906-baf7-37ede4304978 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:13.641468 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-912e2422-e411-4906-baf7-37ede4304978 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:13.642694 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-912e2422-e411-4906-baf7-37ede4304978 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:13.643321 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-912e2422-e411-4906-baf7-37ede4304978 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:13.644041 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-912e2422-e411-4906-baf7-37ede4304978 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:13.677992 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-ef726c7c-6b01-443a-9cae-621bad73162a tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:13.678947 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-ef726c7c-6b01-443a-9cae-621bad73162a tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] [instance: 6ff56299-ada5-4e73-9e68-59cdd48f8a16] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:13.693867 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ef726c7c-6b01-443a-9cae-621bad73162a tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:13.694402 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ef726c7c-6b01-443a-9cae-621bad73162a tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:13.694835 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ef726c7c-6b01-443a-9cae-621bad73162a tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:13.695547 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ef726c7c-6b01-443a-9cae-621bad73162a tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:13.696002 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ef726c7c-6b01-443a-9cae-621bad73162a tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:13.696430 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ef726c7c-6b01-443a-9cae-621bad73162a tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:13.900383 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-912e2422-e411-4906-baf7-37ede4304978 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:13.910206 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-912e2422-e411-4906-baf7-37ede4304978 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:13.911681 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-912e2422-e411-4906-baf7-37ede4304978 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:13.920921 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-912e2422-e411-4906-baf7-37ede4304978 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] 10.222.0.33 "GET /compute/v2.1/servers/81748c83-b703-4c68-899c-c575cc3340d2" status: 200 len: 1812 microversion: 2.25 time: 0.289661 Oct 04 20:40:13.922733 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 821/1732] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:40:13 2022] GET /compute/v2.1/servers/81748c83-b703-4c68-899c-c575cc3340d2 => generated 1812 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:40:13.945033 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-ef726c7c-6b01-443a-9cae-621bad73162a tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673886dab3ed4cbd8a314386fbfbe39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f67490cfb798433eb86c006008c9aaa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:13.948971 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-82eac10d-d93b-4376-b4ff-c0fe3c00ce91 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:13.949688 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-82eac10d-d93b-4376-b4ff-c0fe3c00ce91 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] [instance: 53f0a355-8a5d-4775-a0d3-3aeedfc01570] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:13.956469 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-ef726c7c-6b01-443a-9cae-621bad73162a tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] 10.222.0.33 "GET /compute/v2.1/servers/6ff56299-ada5-4e73-9e68-59cdd48f8a16" status: 200 len: 1351 microversion: 2.1 time: 0.283205 Oct 04 20:40:13.969747 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-82eac10d-d93b-4376-b4ff-c0fe3c00ce91 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:13.969747 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-82eac10d-d93b-4376-b4ff-c0fe3c00ce91 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:13.969747 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-82eac10d-d93b-4376-b4ff-c0fe3c00ce91 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:13.969747 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-82eac10d-d93b-4376-b4ff-c0fe3c00ce91 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:13.969747 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-82eac10d-d93b-4376-b4ff-c0fe3c00ce91 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:13.971148 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 912/1733] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:40:13 2022] GET /compute/v2.1/servers/6ff56299-ada5-4e73-9e68-59cdd48f8a16 => generated 1351 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:40:13.971275 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-82eac10d-d93b-4376-b4ff-c0fe3c00ce91 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:14.039305 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-d4ab2e84-cec0-4f75-81c2-67f904503293 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:14.040598 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-d4ab2e84-cec0-4f75-81c2-67f904503293 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] [instance: 0081d54e-8054-4f3b-9dd4-018f66aa4b27] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:14.050883 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d4ab2e84-cec0-4f75-81c2-67f904503293 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:14.056111 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d4ab2e84-cec0-4f75-81c2-67f904503293 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:14.056810 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d4ab2e84-cec0-4f75-81c2-67f904503293 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:14.057760 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d4ab2e84-cec0-4f75-81c2-67f904503293 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:14.059286 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d4ab2e84-cec0-4f75-81c2-67f904503293 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:14.068438 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d4ab2e84-cec0-4f75-81c2-67f904503293 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:14.162358 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-82eac10d-d93b-4376-b4ff-c0fe3c00ce91 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96919ec99c14864876d64a9c2b20f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b44ce10b78bf49c882c9b4df06187114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:14.176371 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-82eac10d-d93b-4376-b4ff-c0fe3c00ce91 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] 10.222.0.33 "GET /compute/v2.1/servers/53f0a355-8a5d-4775-a0d3-3aeedfc01570" status: 200 len: 1313 microversion: 2.1 time: 0.250800 Oct 04 20:40:14.214444 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 822/1734] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:40:13 2022] GET /compute/v2.1/servers/53f0a355-8a5d-4775-a0d3-3aeedfc01570 => generated 1313 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:14.219279 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-3c6c7693-f113-427a-a22c-c79850e15977 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Calling method '.version_select at 0x7f3c78844940>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:14.271801 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-3c6c7693-f113-427a-a22c-c79850e15977 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] 10.222.0.33 "GET /compute/v2.1/images/dec1cfe6-6be8-4fc4-a82f-728708d575e6" status: 200 len: 1426 microversion: 2.1 time: 0.056309 Oct 04 20:40:14.273748 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 823/1735] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 20:40:14 2022] GET /compute/v2.1/images/dec1cfe6-6be8-4fc4-a82f-728708d575e6 => generated 1426 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:14.286262 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-bdac6f2a-2a93-4031-9398-13804a2cc970 req-8dfff777-6d35-4c87-81e8-3cef560a7324 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0dd1d0cf-a3a0-4ea2-8260-ac206bbfac88", "name": "network-vif-plugged", "status": "completed", "tag": "5ef34720-ea76-4ea1-90bb-a255bf7dfe8b"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:40:14.312284 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-bdac6f2a-2a93-4031-9398-13804a2cc970 req-8dfff777-6d35-4c87-81e8-3cef560a7324 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:14.312702 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-bdac6f2a-2a93-4031-9398-13804a2cc970 req-8dfff777-6d35-4c87-81e8-3cef560a7324 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:14.313170 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-bdac6f2a-2a93-4031-9398-13804a2cc970 req-8dfff777-6d35-4c87-81e8-3cef560a7324 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:14.337948 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-bdac6f2a-2a93-4031-9398-13804a2cc970 req-8dfff777-6d35-4c87-81e8-3cef560a7324 service nova] Creating event network-vif-plugged:5ef34720-ea76-4ea1-90bb-a255bf7dfe8b for instance 0dd1d0cf-a3a0-4ea2-8260-ac206bbfac88 on n-h1-854823-8 Oct 04 20:40:14.338148 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-d4ab2e84-cec0-4f75-81c2-67f904503293 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a82c49a62249029ebc6ae3b4829709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecf3793be3eb4f3186c07a7e45fd8f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:14.349726 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-d4ab2e84-cec0-4f75-81c2-67f904503293 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] 10.222.0.33 "GET /compute/v2.1/servers/0081d54e-8054-4f3b-9dd4-018f66aa4b27" status: 200 len: 1539 microversion: 2.1 time: 0.317078 Oct 04 20:40:14.351685 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 913/1736] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:40:14 2022] GET /compute/v2.1/servers/0081d54e-8054-4f3b-9dd4-018f66aa4b27 => generated 1539 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:40:14.354702 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-bdac6f2a-2a93-4031-9398-13804a2cc970 req-8dfff777-6d35-4c87-81e8-3cef560a7324 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073043 Oct 04 20:40:14.355526 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 824/1737] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:40:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:40:14.358964 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-3cc123c4-7e55-4380-8e0d-4d249a90b23f tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:14.359555 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-3cc123c4-7e55-4380-8e0d-4d249a90b23f tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] [instance: 21de8a24-9cad-4f83-a459-5297200c20ad] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:14.366520 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3cc123c4-7e55-4380-8e0d-4d249a90b23f tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:14.367249 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3cc123c4-7e55-4380-8e0d-4d249a90b23f tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:14.368118 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3cc123c4-7e55-4380-8e0d-4d249a90b23f tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:14.368987 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3cc123c4-7e55-4380-8e0d-4d249a90b23f tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:14.369922 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3cc123c4-7e55-4380-8e0d-4d249a90b23f tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:14.370557 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3cc123c4-7e55-4380-8e0d-4d249a90b23f tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:14.530984 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-3cc123c4-7e55-4380-8e0d-4d249a90b23f tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36f4114dc4f443f8b48da7b4027e0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a23a85365414f92bbc03177d7f190e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:14.541487 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-3cc123c4-7e55-4380-8e0d-4d249a90b23f tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] 10.222.0.33 "GET /compute/v2.1/servers/21de8a24-9cad-4f83-a459-5297200c20ad" status: 200 len: 1316 microversion: 2.1 time: 0.187448 Oct 04 20:40:14.542535 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 914/1738] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:40:14 2022] GET /compute/v2.1/servers/21de8a24-9cad-4f83-a459-5297200c20ad => generated 1316 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:14.957969 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-4e88fe34-27ee-4c83-b606-1bd179691966 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:14.958694 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-4e88fe34-27ee-4c83-b606-1bd179691966 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] [instance: 81748c83-b703-4c68-899c-c575cc3340d2] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:14.965707 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4e88fe34-27ee-4c83-b606-1bd179691966 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:14.966477 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4e88fe34-27ee-4c83-b606-1bd179691966 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:14.967198 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4e88fe34-27ee-4c83-b606-1bd179691966 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:14.968065 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4e88fe34-27ee-4c83-b606-1bd179691966 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:14.968711 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4e88fe34-27ee-4c83-b606-1bd179691966 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:14.969426 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4e88fe34-27ee-4c83-b606-1bd179691966 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:14.985133 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-6fe18fe6-1390-4709-a492-8085ef382581 tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:14.990468 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-6fe18fe6-1390-4709-a492-8085ef382581 tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] [instance: 6ff56299-ada5-4e73-9e68-59cdd48f8a16] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:15.011442 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6fe18fe6-1390-4709-a492-8085ef382581 tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:15.012056 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6fe18fe6-1390-4709-a492-8085ef382581 tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:15.013374 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6fe18fe6-1390-4709-a492-8085ef382581 tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:15.016723 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6fe18fe6-1390-4709-a492-8085ef382581 tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:15.017954 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6fe18fe6-1390-4709-a492-8085ef382581 tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:15.018494 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6fe18fe6-1390-4709-a492-8085ef382581 tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:15.327514 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-4e88fe34-27ee-4c83-b606-1bd179691966 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:15.338791 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-4e88fe34-27ee-4c83-b606-1bd179691966 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:15.347959 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-6fe18fe6-1390-4709-a492-8085ef382581 tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673886dab3ed4cbd8a314386fbfbe39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f67490cfb798433eb86c006008c9aaa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:15.348487 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-4e88fe34-27ee-4c83-b606-1bd179691966 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:15.354632 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-4e88fe34-27ee-4c83-b606-1bd179691966 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] 10.222.0.33 "GET /compute/v2.1/servers/81748c83-b703-4c68-899c-c575cc3340d2" status: 200 len: 1812 microversion: 2.25 time: 0.404906 Oct 04 20:40:15.355359 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 825/1739] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:40:14 2022] GET /compute/v2.1/servers/81748c83-b703-4c68-899c-c575cc3340d2 => generated 1812 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:40:15.372346 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-6fe18fe6-1390-4709-a492-8085ef382581 tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] 10.222.0.33 "GET /compute/v2.1/servers/6ff56299-ada5-4e73-9e68-59cdd48f8a16" status: 200 len: 1351 microversion: 2.1 time: 0.393542 Oct 04 20:40:15.375285 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a744b5bb-7f17-4a82-9299-dabb298402de tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:15.375853 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 915/1740] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:40:14 2022] GET /compute/v2.1/servers/6ff56299-ada5-4e73-9e68-59cdd48f8a16 => generated 1351 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:40:15.376765 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a744b5bb-7f17-4a82-9299-dabb298402de tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] [instance: 53f0a355-8a5d-4775-a0d3-3aeedfc01570] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:15.383062 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-b69a01c5-e8f4-4780-9a75-a87d475912a1 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Calling method '.version_select at 0x7f3c746e5a60>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:15.390508 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a744b5bb-7f17-4a82-9299-dabb298402de tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:15.391516 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a744b5bb-7f17-4a82-9299-dabb298402de tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:15.393537 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a744b5bb-7f17-4a82-9299-dabb298402de tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:15.394829 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a744b5bb-7f17-4a82-9299-dabb298402de tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:15.395585 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a744b5bb-7f17-4a82-9299-dabb298402de tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:15.396103 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a744b5bb-7f17-4a82-9299-dabb298402de tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:15.441748 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-b69a01c5-e8f4-4780-9a75-a87d475912a1 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] 10.222.0.33 "GET /compute/v2.1/images/dec1cfe6-6be8-4fc4-a82f-728708d575e6" status: 200 len: 1426 microversion: 2.1 time: 0.064746 Oct 04 20:40:15.442447 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 916/1741] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 20:40:15 2022] GET /compute/v2.1/images/dec1cfe6-6be8-4fc4-a82f-728708d575e6 => generated 1426 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:15.449984 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-709ed699-6b39-4057-bb07-c75c3ba40aee req-00e19ad7-3cb2-4179-89df-5c1abbea4cc8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53f0a355-8a5d-4775-a0d3-3aeedfc01570", "tag": "28f3e80c-7ad7-4450-a14a-de593e11ffea"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:40:15.456467 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-709ed699-6b39-4057-bb07-c75c3ba40aee req-00e19ad7-3cb2-4179-89df-5c1abbea4cc8 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:15.456942 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-709ed699-6b39-4057-bb07-c75c3ba40aee req-00e19ad7-3cb2-4179-89df-5c1abbea4cc8 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:15.457371 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-709ed699-6b39-4057-bb07-c75c3ba40aee req-00e19ad7-3cb2-4179-89df-5c1abbea4cc8 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:15.469217 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-709ed699-6b39-4057-bb07-c75c3ba40aee req-00e19ad7-3cb2-4179-89df-5c1abbea4cc8 service nova] Creating event network-changed:28f3e80c-7ad7-4450-a14a-de593e11ffea for instance 53f0a355-8a5d-4775-a0d3-3aeedfc01570 on n-h2-854823-8 Oct 04 20:40:15.474799 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-709ed699-6b39-4057-bb07-c75c3ba40aee req-00e19ad7-3cb2-4179-89df-5c1abbea4cc8 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031222 Oct 04 20:40:15.475385 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 917/1742] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:40:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:40:15.480519 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-5fe68398-c8b4-4418-8e7b-48f8d0ebe677 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:15.481206 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-5fe68398-c8b4-4418-8e7b-48f8d0ebe677 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] [instance: 0081d54e-8054-4f3b-9dd4-018f66aa4b27] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:15.488088 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5fe68398-c8b4-4418-8e7b-48f8d0ebe677 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:15.488570 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5fe68398-c8b4-4418-8e7b-48f8d0ebe677 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:15.489057 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5fe68398-c8b4-4418-8e7b-48f8d0ebe677 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:15.489742 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5fe68398-c8b4-4418-8e7b-48f8d0ebe677 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:15.490190 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5fe68398-c8b4-4418-8e7b-48f8d0ebe677 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:15.490636 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5fe68398-c8b4-4418-8e7b-48f8d0ebe677 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:15.816365 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-a744b5bb-7f17-4a82-9299-dabb298402de tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96919ec99c14864876d64a9c2b20f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b44ce10b78bf49c882c9b4df06187114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:15.826983 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-5fe68398-c8b4-4418-8e7b-48f8d0ebe677 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a82c49a62249029ebc6ae3b4829709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecf3793be3eb4f3186c07a7e45fd8f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:15.832812 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a744b5bb-7f17-4a82-9299-dabb298402de tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] 10.222.0.33 "GET /compute/v2.1/servers/53f0a355-8a5d-4775-a0d3-3aeedfc01570" status: 200 len: 1313 microversion: 2.1 time: 0.472291 Oct 04 20:40:15.842847 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-5fe68398-c8b4-4418-8e7b-48f8d0ebe677 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] 10.222.0.33 "GET /compute/v2.1/servers/0081d54e-8054-4f3b-9dd4-018f66aa4b27" status: 200 len: 1534 microversion: 2.1 time: 0.365969 Oct 04 20:40:15.843443 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 918/1743] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:40:15 2022] GET /compute/v2.1/servers/0081d54e-8054-4f3b-9dd4-018f66aa4b27 => generated 1534 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:15.857043 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 826/1744] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:40:15 2022] GET /compute/v2.1/servers/53f0a355-8a5d-4775-a0d3-3aeedfc01570 => generated 1313 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:15.862729 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-35af1dfd-a02f-41f0-9606-e668b5be199a tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:15.864640 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-35af1dfd-a02f-41f0-9606-e668b5be199a tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] [instance: 21de8a24-9cad-4f83-a459-5297200c20ad] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:15.876163 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-35af1dfd-a02f-41f0-9606-e668b5be199a tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:15.877056 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-35af1dfd-a02f-41f0-9606-e668b5be199a tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:15.877492 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-35af1dfd-a02f-41f0-9606-e668b5be199a tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:15.878201 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-35af1dfd-a02f-41f0-9606-e668b5be199a tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:15.878690 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-35af1dfd-a02f-41f0-9606-e668b5be199a tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:15.879111 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-35af1dfd-a02f-41f0-9606-e668b5be199a tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:16.242796 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-35af1dfd-a02f-41f0-9606-e668b5be199a tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36f4114dc4f443f8b48da7b4027e0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a23a85365414f92bbc03177d7f190e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:16.254635 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-35af1dfd-a02f-41f0-9606-e668b5be199a tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] 10.222.0.33 "GET /compute/v2.1/servers/21de8a24-9cad-4f83-a459-5297200c20ad" status: 200 len: 1316 microversion: 2.1 time: 0.407788 Oct 04 20:40:16.255465 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 919/1745] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:40:15 2022] GET /compute/v2.1/servers/21de8a24-9cad-4f83-a459-5297200c20ad => generated 1316 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:16.374603 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-ea6aae28-f81c-4d2c-98c8-d8d7e7d13cff req-4a5fa530-8833-4628-8648-f62b142420b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0081d54e-8054-4f3b-9dd4-018f66aa4b27", "name": "network-vif-plugged", "status": "completed", "tag": "d3a7e9f7-b445-41aa-929c-167e630cb388"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:40:16.385471 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-ad0c5a86-631a-4960-8f99-baa10cefadde tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:16.386698 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-ad0c5a86-631a-4960-8f99-baa10cefadde tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] [instance: 81748c83-b703-4c68-899c-c575cc3340d2] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:16.387506 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-ea6aae28-f81c-4d2c-98c8-d8d7e7d13cff req-4a5fa530-8833-4628-8648-f62b142420b3 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:16.388171 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-ea6aae28-f81c-4d2c-98c8-d8d7e7d13cff req-4a5fa530-8833-4628-8648-f62b142420b3 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:16.388769 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-ea6aae28-f81c-4d2c-98c8-d8d7e7d13cff req-4a5fa530-8833-4628-8648-f62b142420b3 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:16.403174 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ad0c5a86-631a-4960-8f99-baa10cefadde tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:16.403806 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ad0c5a86-631a-4960-8f99-baa10cefadde tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:16.404339 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ad0c5a86-631a-4960-8f99-baa10cefadde tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:16.405148 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ad0c5a86-631a-4960-8f99-baa10cefadde tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:16.405704 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ad0c5a86-631a-4960-8f99-baa10cefadde tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:16.410900 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-ea6aae28-f81c-4d2c-98c8-d8d7e7d13cff req-4a5fa530-8833-4628-8648-f62b142420b3 service nova] Creating event network-vif-plugged:d3a7e9f7-b445-41aa-929c-167e630cb388 for instance 0081d54e-8054-4f3b-9dd4-018f66aa4b27 on n-h1-854823-8 Oct 04 20:40:16.411642 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ad0c5a86-631a-4960-8f99-baa10cefadde tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:16.418160 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-ea6aae28-f81c-4d2c-98c8-d8d7e7d13cff req-4a5fa530-8833-4628-8648-f62b142420b3 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047213 Oct 04 20:40:16.419609 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 827/1746] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:40:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:40:16.428420 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0813c606-beac-4f65-8225-905d27e5cfcb tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:16.430620 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-0813c606-beac-4f65-8225-905d27e5cfcb tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] [instance: 6ff56299-ada5-4e73-9e68-59cdd48f8a16] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:16.438933 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0813c606-beac-4f65-8225-905d27e5cfcb tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:16.440758 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0813c606-beac-4f65-8225-905d27e5cfcb tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:16.446955 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0813c606-beac-4f65-8225-905d27e5cfcb tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:16.448320 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0813c606-beac-4f65-8225-905d27e5cfcb tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:16.449177 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0813c606-beac-4f65-8225-905d27e5cfcb tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:16.450245 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0813c606-beac-4f65-8225-905d27e5cfcb tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:16.868682 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-ad0c5a86-631a-4960-8f99-baa10cefadde tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:16.883777 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-ad0c5a86-631a-4960-8f99-baa10cefadde tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:16.889841 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-ad0c5a86-631a-4960-8f99-baa10cefadde tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:16.893219 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-ad0c5a86-631a-4960-8f99-baa10cefadde tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] 10.222.0.33 "GET /compute/v2.1/servers/81748c83-b703-4c68-899c-c575cc3340d2" status: 200 len: 1812 microversion: 2.25 time: 0.512021 Oct 04 20:40:16.897272 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 920/1747] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:40:16 2022] GET /compute/v2.1/servers/81748c83-b703-4c68-899c-c575cc3340d2 => generated 1812 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:40:16.916157 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-0813c606-beac-4f65-8225-905d27e5cfcb tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673886dab3ed4cbd8a314386fbfbe39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f67490cfb798433eb86c006008c9aaa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:16.925142 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-0813c606-beac-4f65-8225-905d27e5cfcb tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] 10.222.0.33 "GET /compute/v2.1/servers/6ff56299-ada5-4e73-9e68-59cdd48f8a16" status: 200 len: 1351 microversion: 2.1 time: 0.503446 Oct 04 20:40:16.925906 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-f12ce964-43f4-4ef0-8fc5-8a89e47f2c61 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Calling method '.version_select at 0x7f3c7428b160>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:16.942910 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 828/1748] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:40:16 2022] GET /compute/v2.1/servers/6ff56299-ada5-4e73-9e68-59cdd48f8a16 => generated 1351 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:16.955994 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ee9a4a8c-b57c-4b8f-9530-76b49564109d tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:16.957839 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ee9a4a8c-b57c-4b8f-9530-76b49564109d tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] [instance: 53f0a355-8a5d-4775-a0d3-3aeedfc01570] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:16.965424 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ee9a4a8c-b57c-4b8f-9530-76b49564109d tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:16.966957 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ee9a4a8c-b57c-4b8f-9530-76b49564109d tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:16.967634 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ee9a4a8c-b57c-4b8f-9530-76b49564109d tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:16.968616 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ee9a4a8c-b57c-4b8f-9530-76b49564109d tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:16.969234 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ee9a4a8c-b57c-4b8f-9530-76b49564109d tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:16.969824 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ee9a4a8c-b57c-4b8f-9530-76b49564109d tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:17.046331 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-f12ce964-43f4-4ef0-8fc5-8a89e47f2c61 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] 10.222.0.33 "GET /compute/v2.1/images/dec1cfe6-6be8-4fc4-a82f-728708d575e6" status: 200 len: 1426 microversion: 2.1 time: 0.147615 Oct 04 20:40:17.055313 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 921/1749] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 20:40:16 2022] GET /compute/v2.1/images/dec1cfe6-6be8-4fc4-a82f-728708d575e6 => generated 1426 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:17.062609 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-dbc60303-06fa-4ecb-889e-877053b0bb77 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:17.063573 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-dbc60303-06fa-4ecb-889e-877053b0bb77 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] [instance: 0081d54e-8054-4f3b-9dd4-018f66aa4b27] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:17.074620 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dbc60303-06fa-4ecb-889e-877053b0bb77 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:17.075695 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dbc60303-06fa-4ecb-889e-877053b0bb77 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:17.076412 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dbc60303-06fa-4ecb-889e-877053b0bb77 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:17.077414 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dbc60303-06fa-4ecb-889e-877053b0bb77 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:17.078133 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dbc60303-06fa-4ecb-889e-877053b0bb77 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:17.078891 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dbc60303-06fa-4ecb-889e-877053b0bb77 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:17.297357 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-ee9a4a8c-b57c-4b8f-9530-76b49564109d tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96919ec99c14864876d64a9c2b20f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b44ce10b78bf49c882c9b4df06187114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:17.311140 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-dbc60303-06fa-4ecb-889e-877053b0bb77 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a82c49a62249029ebc6ae3b4829709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecf3793be3eb4f3186c07a7e45fd8f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:17.322805 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ee9a4a8c-b57c-4b8f-9530-76b49564109d tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] 10.222.0.33 "GET /compute/v2.1/servers/53f0a355-8a5d-4775-a0d3-3aeedfc01570" status: 200 len: 1313 microversion: 2.1 time: 0.378643 Oct 04 20:40:17.323883 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-dbc60303-06fa-4ecb-889e-877053b0bb77 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] 10.222.0.33 "GET /compute/v2.1/servers/0081d54e-8054-4f3b-9dd4-018f66aa4b27" status: 200 len: 1521 microversion: 2.1 time: 0.266531 Oct 04 20:40:17.324666 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 829/1750] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:40:16 2022] GET /compute/v2.1/servers/53f0a355-8a5d-4775-a0d3-3aeedfc01570 => generated 1313 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:17.340726 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 922/1751] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:40:17 2022] GET /compute/v2.1/servers/0081d54e-8054-4f3b-9dd4-018f66aa4b27 => generated 1521 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:17.350529 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ae0a51be-e551-49f6-9073-12615e6b3b9d tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:17.351545 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ae0a51be-e551-49f6-9073-12615e6b3b9d tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] [instance: 21de8a24-9cad-4f83-a459-5297200c20ad] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:17.359805 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ae0a51be-e551-49f6-9073-12615e6b3b9d tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:17.360565 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ae0a51be-e551-49f6-9073-12615e6b3b9d tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:17.367995 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-54b53029-ba0b-4517-9c3f-122b2380e229 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:17.368786 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-54b53029-ba0b-4517-9c3f-122b2380e229 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] [instance: 0081d54e-8054-4f3b-9dd4-018f66aa4b27] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:17.371976 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ae0a51be-e551-49f6-9073-12615e6b3b9d tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:17.379173 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ae0a51be-e551-49f6-9073-12615e6b3b9d tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:17.380378 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ae0a51be-e551-49f6-9073-12615e6b3b9d tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:17.381012 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ae0a51be-e551-49f6-9073-12615e6b3b9d tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:17.386558 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-54b53029-ba0b-4517-9c3f-122b2380e229 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:17.389696 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-54b53029-ba0b-4517-9c3f-122b2380e229 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:17.390571 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-54b53029-ba0b-4517-9c3f-122b2380e229 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:17.391655 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-54b53029-ba0b-4517-9c3f-122b2380e229 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:17.392191 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-54b53029-ba0b-4517-9c3f-122b2380e229 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:17.396811 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-54b53029-ba0b-4517-9c3f-122b2380e229 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:17.462398 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-54b53029-ba0b-4517-9c3f-122b2380e229 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] [instance: 0081d54e-8054-4f3b-9dd4-018f66aa4b27] Going to try to terminate instance {{(pid=128802) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:40:17.663369 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-ae0a51be-e551-49f6-9073-12615e6b3b9d tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36f4114dc4f443f8b48da7b4027e0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a23a85365414f92bbc03177d7f190e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:17.681273 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-54b53029-ba0b-4517-9c3f-122b2380e229 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] 10.222.0.33 "DELETE /compute/v2.1/servers/0081d54e-8054-4f3b-9dd4-018f66aa4b27" status: 204 len: 0 microversion: 2.1 time: 0.316475 Oct 04 20:40:17.682653 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 923/1752] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 20:40:17 2022] DELETE /compute/v2.1/servers/0081d54e-8054-4f3b-9dd4-018f66aa4b27 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:40:17.688506 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-14b07c18-7948-4e3b-b0ab-d5696f3407b8 req-0008a453-c9cf-4a12-86c6-2422c75a0b59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81748c83-b703-4c68-899c-c575cc3340d2", "name": "network-vif-unplugged", "status": "completed", "tag": "c2865aee-fb0f-4bf6-91f8-8215288d29f5"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:40:17.694232 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ae0a51be-e551-49f6-9073-12615e6b3b9d tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] 10.222.0.33 "GET /compute/v2.1/servers/21de8a24-9cad-4f83-a459-5297200c20ad" status: 200 len: 1316 microversion: 2.1 time: 0.342728 Oct 04 20:40:17.698066 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 830/1753] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:40:17 2022] GET /compute/v2.1/servers/21de8a24-9cad-4f83-a459-5297200c20ad => generated 1316 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:17.703161 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-be33aa3b-a20e-4152-bd71-20f49e21d2db tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:17.706779 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-be33aa3b-a20e-4152-bd71-20f49e21d2db tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] [instance: 0081d54e-8054-4f3b-9dd4-018f66aa4b27] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:17.730181 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-14b07c18-7948-4e3b-b0ab-d5696f3407b8 req-0008a453-c9cf-4a12-86c6-2422c75a0b59 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:17.730985 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-14b07c18-7948-4e3b-b0ab-d5696f3407b8 req-0008a453-c9cf-4a12-86c6-2422c75a0b59 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:17.731587 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-14b07c18-7948-4e3b-b0ab-d5696f3407b8 req-0008a453-c9cf-4a12-86c6-2422c75a0b59 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:17.734798 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-be33aa3b-a20e-4152-bd71-20f49e21d2db tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:17.738853 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-be33aa3b-a20e-4152-bd71-20f49e21d2db tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:17.740875 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-be33aa3b-a20e-4152-bd71-20f49e21d2db tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:17.743362 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-be33aa3b-a20e-4152-bd71-20f49e21d2db tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:17.747324 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-be33aa3b-a20e-4152-bd71-20f49e21d2db tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:17.748049 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-be33aa3b-a20e-4152-bd71-20f49e21d2db tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:17.752887 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-14b07c18-7948-4e3b-b0ab-d5696f3407b8 req-0008a453-c9cf-4a12-86c6-2422c75a0b59 service nova] Creating event network-vif-unplugged:c2865aee-fb0f-4bf6-91f8-8215288d29f5 for instance 81748c83-b703-4c68-899c-c575cc3340d2 on n-h2-854823-8 Oct 04 20:40:17.760491 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-14b07c18-7948-4e3b-b0ab-d5696f3407b8 req-0008a453-c9cf-4a12-86c6-2422c75a0b59 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.076235 Oct 04 20:40:17.763672 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 924/1754] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:40:17 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:40:17.924690 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-c45ecf40-7c5f-4a40-b28a-132d8c19cd0b tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:17.925647 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-c45ecf40-7c5f-4a40-b28a-132d8c19cd0b tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] [instance: 81748c83-b703-4c68-899c-c575cc3340d2] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:17.951849 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:40:17.961766 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c45ecf40-7c5f-4a40-b28a-132d8c19cd0b tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:17.966150 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c45ecf40-7c5f-4a40-b28a-132d8c19cd0b tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:17.967804 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c45ecf40-7c5f-4a40-b28a-132d8c19cd0b tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:17.971944 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c45ecf40-7c5f-4a40-b28a-132d8c19cd0b tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:17.972438 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c45ecf40-7c5f-4a40-b28a-132d8c19cd0b tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:17.972904 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c45ecf40-7c5f-4a40-b28a-132d8c19cd0b tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:18.016423 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-be33aa3b-a20e-4152-bd71-20f49e21d2db tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a82c49a62249029ebc6ae3b4829709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecf3793be3eb4f3186c07a7e45fd8f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:18.026206 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-be33aa3b-a20e-4152-bd71-20f49e21d2db tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] 10.222.0.33 "GET /compute/v2.1/servers/0081d54e-8054-4f3b-9dd4-018f66aa4b27" status: 200 len: 1527 microversion: 2.1 time: 0.326767 Oct 04 20:40:18.038616 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 831/1755] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:40:17 2022] GET /compute/v2.1/servers/0081d54e-8054-4f3b-9dd4-018f66aa4b27 => generated 1527 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:18.038863 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:40:18.040284 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-480a4a53-2516-47c6-a540-30ba5d15011e tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:18.040917 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-480a4a53-2516-47c6-a540-30ba5d15011e tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] [instance: 6ff56299-ada5-4e73-9e68-59cdd48f8a16] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:18.058593 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-480a4a53-2516-47c6-a540-30ba5d15011e tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:18.059427 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-480a4a53-2516-47c6-a540-30ba5d15011e tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:18.059927 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-480a4a53-2516-47c6-a540-30ba5d15011e tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:18.060662 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-480a4a53-2516-47c6-a540-30ba5d15011e tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:18.061119 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-480a4a53-2516-47c6-a540-30ba5d15011e tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:18.068872 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-480a4a53-2516-47c6-a540-30ba5d15011e tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:18.338734 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-c45ecf40-7c5f-4a40-b28a-132d8c19cd0b tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:18.354558 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-c45ecf40-7c5f-4a40-b28a-132d8c19cd0b tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:18.360446 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-c45ecf40-7c5f-4a40-b28a-132d8c19cd0b tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:18.363953 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-c45ecf40-7c5f-4a40-b28a-132d8c19cd0b tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] 10.222.0.33 "GET /compute/v2.1/servers/81748c83-b703-4c68-899c-c575cc3340d2" status: 200 len: 1812 microversion: 2.25 time: 0.443830 Oct 04 20:40:18.364998 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 925/1756] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:40:17 2022] GET /compute/v2.1/servers/81748c83-b703-4c68-899c-c575cc3340d2 => generated 1812 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:40:18.377449 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-3f6ffea4-ad62-4e43-97cd-34c2ca276375 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Calling method '.version_select at 0x7f3c789de8b0>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:18.397552 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-480a4a53-2516-47c6-a540-30ba5d15011e tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673886dab3ed4cbd8a314386fbfbe39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f67490cfb798433eb86c006008c9aaa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:18.434971 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-480a4a53-2516-47c6-a540-30ba5d15011e tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] 10.222.0.33 "GET /compute/v2.1/servers/6ff56299-ada5-4e73-9e68-59cdd48f8a16" status: 200 len: 1351 microversion: 2.1 time: 0.405987 Oct 04 20:40:18.435591 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 832/1757] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:40:18 2022] GET /compute/v2.1/servers/6ff56299-ada5-4e73-9e68-59cdd48f8a16 => generated 1351 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:18.458948 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c5d61878-abba-46a2-aeeb-7edb7ac7ab5f tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:18.462305 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c5d61878-abba-46a2-aeeb-7edb7ac7ab5f tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] [instance: 53f0a355-8a5d-4775-a0d3-3aeedfc01570] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:18.483716 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c5d61878-abba-46a2-aeeb-7edb7ac7ab5f tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:18.489305 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c5d61878-abba-46a2-aeeb-7edb7ac7ab5f tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:18.490035 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c5d61878-abba-46a2-aeeb-7edb7ac7ab5f tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:18.491013 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c5d61878-abba-46a2-aeeb-7edb7ac7ab5f tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:18.491656 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c5d61878-abba-46a2-aeeb-7edb7ac7ab5f tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:18.493093 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c5d61878-abba-46a2-aeeb-7edb7ac7ab5f tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:18.498112 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-3f6ffea4-ad62-4e43-97cd-34c2ca276375 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] 10.222.0.33 "GET /compute/v2.1/images/dec1cfe6-6be8-4fc4-a82f-728708d575e6" status: 200 len: 1426 microversion: 2.1 time: 0.129782 Oct 04 20:40:18.499779 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 926/1758] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 20:40:18 2022] GET /compute/v2.1/images/dec1cfe6-6be8-4fc4-a82f-728708d575e6 => generated 1426 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:18.727918 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-ab200166-b45d-48e9-85b5-af1e9b82dd2d tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:18.728815 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-ab200166-b45d-48e9-85b5-af1e9b82dd2d tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] [instance: 21de8a24-9cad-4f83-a459-5297200c20ad] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:18.748021 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ab200166-b45d-48e9-85b5-af1e9b82dd2d tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:18.749393 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ab200166-b45d-48e9-85b5-af1e9b82dd2d tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:18.750043 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ab200166-b45d-48e9-85b5-af1e9b82dd2d tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:18.752991 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c5d61878-abba-46a2-aeeb-7edb7ac7ab5f tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96919ec99c14864876d64a9c2b20f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b44ce10b78bf49c882c9b4df06187114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:18.753863 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ab200166-b45d-48e9-85b5-af1e9b82dd2d tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:18.757894 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ab200166-b45d-48e9-85b5-af1e9b82dd2d tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:18.758601 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ab200166-b45d-48e9-85b5-af1e9b82dd2d tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:18.769374 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c5d61878-abba-46a2-aeeb-7edb7ac7ab5f tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] 10.222.0.33 "GET /compute/v2.1/servers/53f0a355-8a5d-4775-a0d3-3aeedfc01570" status: 200 len: 1313 microversion: 2.1 time: 0.327274 Oct 04 20:40:18.770695 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 833/1759] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:40:18 2022] GET /compute/v2.1/servers/53f0a355-8a5d-4775-a0d3-3aeedfc01570 => generated 1313 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:18.961912 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-ab200166-b45d-48e9-85b5-af1e9b82dd2d tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36f4114dc4f443f8b48da7b4027e0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a23a85365414f92bbc03177d7f190e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:18.972801 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-ab200166-b45d-48e9-85b5-af1e9b82dd2d tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] 10.222.0.33 "GET /compute/v2.1/servers/21de8a24-9cad-4f83-a459-5297200c20ad" status: 200 len: 1316 microversion: 2.1 time: 0.253210 Oct 04 20:40:18.989855 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 927/1760] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:40:18 2022] GET /compute/v2.1/servers/21de8a24-9cad-4f83-a459-5297200c20ad => generated 1316 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:40:19.055933 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0bedca04-5b4f-4b8e-b6b8-c6e4d008e76f tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:19.056833 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-0bedca04-5b4f-4b8e-b6b8-c6e4d008e76f tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] [instance: 0081d54e-8054-4f3b-9dd4-018f66aa4b27] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:19.067685 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0bedca04-5b4f-4b8e-b6b8-c6e4d008e76f tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:19.068207 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0bedca04-5b4f-4b8e-b6b8-c6e4d008e76f tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:19.071311 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0bedca04-5b4f-4b8e-b6b8-c6e4d008e76f tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:19.071311 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0bedca04-5b4f-4b8e-b6b8-c6e4d008e76f tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:19.073182 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0bedca04-5b4f-4b8e-b6b8-c6e4d008e76f tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:19.073645 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0bedca04-5b4f-4b8e-b6b8-c6e4d008e76f tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:19.395621 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-58c6c454-e140-42c4-901f-5353f2e424f8 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:19.396615 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-58c6c454-e140-42c4-901f-5353f2e424f8 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] [instance: 81748c83-b703-4c68-899c-c575cc3340d2] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:19.416102 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-58c6c454-e140-42c4-901f-5353f2e424f8 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:19.417078 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-58c6c454-e140-42c4-901f-5353f2e424f8 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:19.417750 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-58c6c454-e140-42c4-901f-5353f2e424f8 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:19.418787 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-58c6c454-e140-42c4-901f-5353f2e424f8 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:19.430617 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-58c6c454-e140-42c4-901f-5353f2e424f8 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:19.433157 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-0bedca04-5b4f-4b8e-b6b8-c6e4d008e76f tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a82c49a62249029ebc6ae3b4829709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecf3793be3eb4f3186c07a7e45fd8f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:19.433782 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-58c6c454-e140-42c4-901f-5353f2e424f8 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:19.444939 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-0bedca04-5b4f-4b8e-b6b8-c6e4d008e76f tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] 10.222.0.33 "GET /compute/v2.1/servers/0081d54e-8054-4f3b-9dd4-018f66aa4b27" status: 200 len: 1527 microversion: 2.1 time: 0.393070 Oct 04 20:40:19.450724 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 834/1761] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:40:19 2022] GET /compute/v2.1/servers/0081d54e-8054-4f3b-9dd4-018f66aa4b27 => generated 1527 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:19.458503 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-0ff028e1-ae00-4b1f-8443-d129e45b62c3 req-a4ac36ec-538c-4c3d-adfd-80637a557f3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21de8a24-9cad-4f83-a459-5297200c20ad", "name": "network-vif-plugged", "status": "completed", "tag": "bbffae2a-7404-4047-a95f-8dd200c997e8"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:40:19.492815 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-0ff028e1-ae00-4b1f-8443-d129e45b62c3 req-a4ac36ec-538c-4c3d-adfd-80637a557f3f service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:19.493719 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-0ff028e1-ae00-4b1f-8443-d129e45b62c3 req-a4ac36ec-538c-4c3d-adfd-80637a557f3f service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:19.498454 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-0ff028e1-ae00-4b1f-8443-d129e45b62c3 req-a4ac36ec-538c-4c3d-adfd-80637a557f3f service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:19.531345 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-0ff028e1-ae00-4b1f-8443-d129e45b62c3 req-a4ac36ec-538c-4c3d-adfd-80637a557f3f service nova] Creating event network-vif-plugged:bbffae2a-7404-4047-a95f-8dd200c997e8 for instance 21de8a24-9cad-4f83-a459-5297200c20ad on n-h1-854823-8 Oct 04 20:40:19.556028 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-0ff028e1-ae00-4b1f-8443-d129e45b62c3 req-a4ac36ec-538c-4c3d-adfd-80637a557f3f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103454 Oct 04 20:40:19.566861 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 835/1762] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:40:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:40:19.573494 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2f6bfc03-e459-4a5c-a32a-b7592546c719 tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:19.574785 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-2f6bfc03-e459-4a5c-a32a-b7592546c719 tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] [instance: 6ff56299-ada5-4e73-9e68-59cdd48f8a16] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:19.584931 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2f6bfc03-e459-4a5c-a32a-b7592546c719 tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:19.585916 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2f6bfc03-e459-4a5c-a32a-b7592546c719 tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:19.586834 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2f6bfc03-e459-4a5c-a32a-b7592546c719 tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:19.587993 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2f6bfc03-e459-4a5c-a32a-b7592546c719 tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:19.588682 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2f6bfc03-e459-4a5c-a32a-b7592546c719 tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:19.589630 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2f6bfc03-e459-4a5c-a32a-b7592546c719 tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:20.027913 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-58c6c454-e140-42c4-901f-5353f2e424f8 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:20.042098 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-58c6c454-e140-42c4-901f-5353f2e424f8 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:20.043577 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-58c6c454-e140-42c4-901f-5353f2e424f8 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:20.054930 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-58c6c454-e140-42c4-901f-5353f2e424f8 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] 10.222.0.33 "GET /compute/v2.1/servers/81748c83-b703-4c68-899c-c575cc3340d2" status: 200 len: 1812 microversion: 2.25 time: 0.664258 Oct 04 20:40:20.057966 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 928/1763] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:40:19 2022] GET /compute/v2.1/servers/81748c83-b703-4c68-899c-c575cc3340d2 => generated 1812 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 20:40:20.082729 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-ac087a25-f738-4921-9fd2-f60a55d10397 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Calling method '.version_select at 0x7f3c789ee040>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:20.185434 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-ac087a25-f738-4921-9fd2-f60a55d10397 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] 10.222.0.33 "GET /compute/v2.1/images/dec1cfe6-6be8-4fc4-a82f-728708d575e6" status: 200 len: 1426 microversion: 2.1 time: 0.122408 Oct 04 20:40:20.186493 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 929/1764] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 20:40:20 2022] GET /compute/v2.1/images/dec1cfe6-6be8-4fc4-a82f-728708d575e6 => generated 1426 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:20.200076 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-130dbe3d-bd79-40fb-8cce-d7b16111a749 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:20.200792 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-130dbe3d-bd79-40fb-8cce-d7b16111a749 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] [instance: 53f0a355-8a5d-4775-a0d3-3aeedfc01570] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:20.210016 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-130dbe3d-bd79-40fb-8cce-d7b16111a749 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:20.210619 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-130dbe3d-bd79-40fb-8cce-d7b16111a749 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:20.211059 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-130dbe3d-bd79-40fb-8cce-d7b16111a749 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:20.212028 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-130dbe3d-bd79-40fb-8cce-d7b16111a749 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:20.212641 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-130dbe3d-bd79-40fb-8cce-d7b16111a749 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:20.213194 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-130dbe3d-bd79-40fb-8cce-d7b16111a749 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:20.314582 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-2f6bfc03-e459-4a5c-a32a-b7592546c719 tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673886dab3ed4cbd8a314386fbfbe39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f67490cfb798433eb86c006008c9aaa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:20.332115 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-2f6bfc03-e459-4a5c-a32a-b7592546c719 tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] 10.222.0.33 "GET /compute/v2.1/servers/6ff56299-ada5-4e73-9e68-59cdd48f8a16" status: 200 len: 1351 microversion: 2.1 time: 0.756500 Oct 04 20:40:20.339385 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 836/1765] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:40:19 2022] GET /compute/v2.1/servers/6ff56299-ada5-4e73-9e68-59cdd48f8a16 => generated 1351 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:20.358437 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-987f368d-c589-4059-acab-ac070b7fb0e4 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:20.358930 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-987f368d-c589-4059-acab-ac070b7fb0e4 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] [instance: 21de8a24-9cad-4f83-a459-5297200c20ad] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:20.405899 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-987f368d-c589-4059-acab-ac070b7fb0e4 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:20.406463 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-987f368d-c589-4059-acab-ac070b7fb0e4 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:20.406970 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-987f368d-c589-4059-acab-ac070b7fb0e4 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:20.408255 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-987f368d-c589-4059-acab-ac070b7fb0e4 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:20.408712 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-987f368d-c589-4059-acab-ac070b7fb0e4 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:20.427421 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-987f368d-c589-4059-acab-ac070b7fb0e4 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:20.592446 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-130dbe3d-bd79-40fb-8cce-d7b16111a749 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96919ec99c14864876d64a9c2b20f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b44ce10b78bf49c882c9b4df06187114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:20.609560 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-130dbe3d-bd79-40fb-8cce-d7b16111a749 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] 10.222.0.33 "GET /compute/v2.1/servers/53f0a355-8a5d-4775-a0d3-3aeedfc01570" status: 200 len: 1313 microversion: 2.1 time: 0.417664 Oct 04 20:40:20.610516 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 930/1766] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:40:20 2022] GET /compute/v2.1/servers/53f0a355-8a5d-4775-a0d3-3aeedfc01570 => generated 1313 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:20.631197 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-577eedd4-195e-4d5d-96ff-76e470c361b3 req-5187fb13-cfad-40a2-a4d5-116dfb10e117 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81748c83-b703-4c68-899c-c575cc3340d2", "tag": "c2865aee-fb0f-4bf6-91f8-8215288d29f5"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:40:20.659597 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-577eedd4-195e-4d5d-96ff-76e470c361b3 req-5187fb13-cfad-40a2-a4d5-116dfb10e117 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:20.662140 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-577eedd4-195e-4d5d-96ff-76e470c361b3 req-5187fb13-cfad-40a2-a4d5-116dfb10e117 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:20.665834 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-577eedd4-195e-4d5d-96ff-76e470c361b3 req-5187fb13-cfad-40a2-a4d5-116dfb10e117 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:20.696932 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-577eedd4-195e-4d5d-96ff-76e470c361b3 req-5187fb13-cfad-40a2-a4d5-116dfb10e117 service nova] Creating event network-changed:c2865aee-fb0f-4bf6-91f8-8215288d29f5 for instance 81748c83-b703-4c68-899c-c575cc3340d2 on n-h2-854823-8 Oct 04 20:40:20.709915 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-577eedd4-195e-4d5d-96ff-76e470c361b3 req-5187fb13-cfad-40a2-a4d5-116dfb10e117 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095255 Oct 04 20:40:20.711072 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 931/1767] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:40:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:40:20.718632 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-ecb46976-1b91-47df-9174-55f553ca70cf tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:20.719706 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-ecb46976-1b91-47df-9174-55f553ca70cf tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] [instance: 0081d54e-8054-4f3b-9dd4-018f66aa4b27] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:20.727939 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ecb46976-1b91-47df-9174-55f553ca70cf tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:20.728723 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ecb46976-1b91-47df-9174-55f553ca70cf tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:20.729345 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ecb46976-1b91-47df-9174-55f553ca70cf tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:20.730387 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ecb46976-1b91-47df-9174-55f553ca70cf tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:20.743417 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ecb46976-1b91-47df-9174-55f553ca70cf tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:20.744381 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ecb46976-1b91-47df-9174-55f553ca70cf tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:20.781441 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-987f368d-c589-4059-acab-ac070b7fb0e4 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36f4114dc4f443f8b48da7b4027e0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a23a85365414f92bbc03177d7f190e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:20.792042 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-987f368d-c589-4059-acab-ac070b7fb0e4 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] 10.222.0.33 "GET /compute/v2.1/servers/21de8a24-9cad-4f83-a459-5297200c20ad" status: 200 len: 1316 microversion: 2.1 time: 0.450809 Oct 04 20:40:20.793377 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 837/1768] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:40:20 2022] GET /compute/v2.1/servers/21de8a24-9cad-4f83-a459-5297200c20ad => generated 1316 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:20.977613 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-ecb46976-1b91-47df-9174-55f553ca70cf tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a82c49a62249029ebc6ae3b4829709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecf3793be3eb4f3186c07a7e45fd8f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:20.988913 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-ecb46976-1b91-47df-9174-55f553ca70cf tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] 10.222.0.33 "GET /compute/v2.1/servers/0081d54e-8054-4f3b-9dd4-018f66aa4b27" status: 200 len: 1527 microversion: 2.1 time: 0.275913 Oct 04 20:40:20.990042 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 932/1769] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:40:20 2022] GET /compute/v2.1/servers/0081d54e-8054-4f3b-9dd4-018f66aa4b27 => generated 1527 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:21.090598 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-dbb2f073-8565-4b6c-9b3c-56c791f7ebfb tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:21.090598 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-dbb2f073-8565-4b6c-9b3c-56c791f7ebfb tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] [instance: 81748c83-b703-4c68-899c-c575cc3340d2] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:21.093221 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=4 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:40:21.109479 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dbb2f073-8565-4b6c-9b3c-56c791f7ebfb tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:21.110072 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dbb2f073-8565-4b6c-9b3c-56c791f7ebfb tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:21.110072 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dbb2f073-8565-4b6c-9b3c-56c791f7ebfb tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:21.123359 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dbb2f073-8565-4b6c-9b3c-56c791f7ebfb tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:21.123993 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dbb2f073-8565-4b6c-9b3c-56c791f7ebfb tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:21.126911 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dbb2f073-8565-4b6c-9b3c-56c791f7ebfb tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:21.210429 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-82ba07ad-3a3f-45bd-b865-07ca856cb471 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Calling method '.version_select at 0x7f3c789de0d0>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:21.295426 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-82ba07ad-3a3f-45bd-b865-07ca856cb471 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] 10.222.0.33 "GET /compute/v2.1/images/dec1cfe6-6be8-4fc4-a82f-728708d575e6" status: 200 len: 1426 microversion: 2.1 time: 0.097831 Oct 04 20:40:21.305954 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 933/1770] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 20:40:21 2022] GET /compute/v2.1/images/dec1cfe6-6be8-4fc4-a82f-728708d575e6 => generated 1426 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:21.360559 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-08203333-ca7f-4ec4-92bd-a5cefb048223 tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:21.361528 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-08203333-ca7f-4ec4-92bd-a5cefb048223 tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] [instance: 6ff56299-ada5-4e73-9e68-59cdd48f8a16] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:21.373256 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-08203333-ca7f-4ec4-92bd-a5cefb048223 tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:21.375139 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-08203333-ca7f-4ec4-92bd-a5cefb048223 tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:21.375139 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-08203333-ca7f-4ec4-92bd-a5cefb048223 tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:21.378211 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-08203333-ca7f-4ec4-92bd-a5cefb048223 tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:21.378928 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-08203333-ca7f-4ec4-92bd-a5cefb048223 tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:21.379378 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-08203333-ca7f-4ec4-92bd-a5cefb048223 tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:21.435894 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=16 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:40:21.479706 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-dbb2f073-8565-4b6c-9b3c-56c791f7ebfb tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:21.510504 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-dbb2f073-8565-4b6c-9b3c-56c791f7ebfb tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:21.514626 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-dbb2f073-8565-4b6c-9b3c-56c791f7ebfb tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:21.518086 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-dbb2f073-8565-4b6c-9b3c-56c791f7ebfb tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] 10.222.0.33 "GET /compute/v2.1/servers/81748c83-b703-4c68-899c-c575cc3340d2" status: 200 len: 1812 microversion: 2.25 time: 0.432980 Oct 04 20:40:21.543212 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 838/1771] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:40:21 2022] GET /compute/v2.1/servers/81748c83-b703-4c68-899c-c575cc3340d2 => generated 1812 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:40:21.620187 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-08203333-ca7f-4ec4-92bd-a5cefb048223 tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673886dab3ed4cbd8a314386fbfbe39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f67490cfb798433eb86c006008c9aaa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:21.629110 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-08203333-ca7f-4ec4-92bd-a5cefb048223 tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] 10.222.0.33 "GET /compute/v2.1/servers/6ff56299-ada5-4e73-9e68-59cdd48f8a16" status: 200 len: 1351 microversion: 2.1 time: 0.273573 Oct 04 20:40:21.629718 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 934/1772] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:40:21 2022] GET /compute/v2.1/servers/6ff56299-ada5-4e73-9e68-59cdd48f8a16 => generated 1351 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:40:21.656856 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-69f78d04-388b-4f4a-99d5-02c41f1aa2a2 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:21.660680 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-69f78d04-388b-4f4a-99d5-02c41f1aa2a2 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] [instance: 53f0a355-8a5d-4775-a0d3-3aeedfc01570] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:21.672309 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-69f78d04-388b-4f4a-99d5-02c41f1aa2a2 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:21.673261 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-69f78d04-388b-4f4a-99d5-02c41f1aa2a2 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:21.674294 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-69f78d04-388b-4f4a-99d5-02c41f1aa2a2 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:21.675240 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-69f78d04-388b-4f4a-99d5-02c41f1aa2a2 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:21.675873 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-69f78d04-388b-4f4a-99d5-02c41f1aa2a2 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:21.676468 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-69f78d04-388b-4f4a-99d5-02c41f1aa2a2 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:21.819616 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-408b183d-9743-4338-a37d-06b500a71384 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:21.820512 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-408b183d-9743-4338-a37d-06b500a71384 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] [instance: 21de8a24-9cad-4f83-a459-5297200c20ad] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:21.827464 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-408b183d-9743-4338-a37d-06b500a71384 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:21.837378 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-408b183d-9743-4338-a37d-06b500a71384 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:21.841314 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-408b183d-9743-4338-a37d-06b500a71384 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:21.842331 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-408b183d-9743-4338-a37d-06b500a71384 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:21.842989 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-408b183d-9743-4338-a37d-06b500a71384 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:21.843575 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-408b183d-9743-4338-a37d-06b500a71384 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:21.979452 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-69f78d04-388b-4f4a-99d5-02c41f1aa2a2 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96919ec99c14864876d64a9c2b20f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b44ce10b78bf49c882c9b4df06187114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:22.002193 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=100 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:40:22.027201 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-69f78d04-388b-4f4a-99d5-02c41f1aa2a2 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] 10.222.0.33 "GET /compute/v2.1/servers/53f0a355-8a5d-4775-a0d3-3aeedfc01570" status: 200 len: 1313 microversion: 2.1 time: 0.375561 Oct 04 20:40:22.029350 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 839/1773] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:40:21 2022] GET /compute/v2.1/servers/53f0a355-8a5d-4775-a0d3-3aeedfc01570 => generated 1313 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:22.050570 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-bd73d6ea-dff6-4411-a4c3-46c1e3bcf587 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:22.051390 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-bd73d6ea-dff6-4411-a4c3-46c1e3bcf587 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] [instance: 0081d54e-8054-4f3b-9dd4-018f66aa4b27] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:22.061090 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bd73d6ea-dff6-4411-a4c3-46c1e3bcf587 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:22.061389 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bd73d6ea-dff6-4411-a4c3-46c1e3bcf587 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:22.069183 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bd73d6ea-dff6-4411-a4c3-46c1e3bcf587 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:22.069892 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bd73d6ea-dff6-4411-a4c3-46c1e3bcf587 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:22.070437 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bd73d6ea-dff6-4411-a4c3-46c1e3bcf587 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:22.070886 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bd73d6ea-dff6-4411-a4c3-46c1e3bcf587 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:22.232063 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-bd73d6ea-dff6-4411-a4c3-46c1e3bcf587 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a82c49a62249029ebc6ae3b4829709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecf3793be3eb4f3186c07a7e45fd8f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:22.245390 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-bd73d6ea-dff6-4411-a4c3-46c1e3bcf587 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] 10.222.0.33 "GET /compute/v2.1/servers/0081d54e-8054-4f3b-9dd4-018f66aa4b27" status: 200 len: 1309 microversion: 2.1 time: 0.215035 Oct 04 20:40:22.245993 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 840/1774] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:40:22 2022] GET /compute/v2.1/servers/0081d54e-8054-4f3b-9dd4-018f66aa4b27 => generated 1309 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:22.296029 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-408b183d-9743-4338-a37d-06b500a71384 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36f4114dc4f443f8b48da7b4027e0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a23a85365414f92bbc03177d7f190e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:22.304920 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-408b183d-9743-4338-a37d-06b500a71384 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] 10.222.0.33 "GET /compute/v2.1/servers/21de8a24-9cad-4f83-a459-5297200c20ad" status: 200 len: 1316 microversion: 2.1 time: 0.488974 Oct 04 20:40:22.311739 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ddd4bc54-b154-45cf-ae85-b303a3bcd869 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Calling method '.version_select at 0x7f3c78865940>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:22.328250 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 935/1775] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:40:21 2022] GET /compute/v2.1/servers/21de8a24-9cad-4f83-a459-5297200c20ad => generated 1316 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:22.372646 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ddd4bc54-b154-45cf-ae85-b303a3bcd869 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] 10.222.0.33 "GET /compute/v2.1/images/dec1cfe6-6be8-4fc4-a82f-728708d575e6" status: 200 len: 1426 microversion: 2.1 time: 0.064573 Oct 04 20:40:22.374115 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 841/1776] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 20:40:22 2022] GET /compute/v2.1/images/dec1cfe6-6be8-4fc4-a82f-728708d575e6 => generated 1426 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:40:22.548180 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-8875c13d-11ab-4abb-bf21-4c3455ad7092 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:22.549298 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-8875c13d-11ab-4abb-bf21-4c3455ad7092 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] [instance: 81748c83-b703-4c68-899c-c575cc3340d2] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:22.560254 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8875c13d-11ab-4abb-bf21-4c3455ad7092 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:22.561156 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8875c13d-11ab-4abb-bf21-4c3455ad7092 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:22.562011 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8875c13d-11ab-4abb-bf21-4c3455ad7092 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:22.563893 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8875c13d-11ab-4abb-bf21-4c3455ad7092 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:22.564898 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8875c13d-11ab-4abb-bf21-4c3455ad7092 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:22.565950 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8875c13d-11ab-4abb-bf21-4c3455ad7092 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:22.660278 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-effc6dde-1170-43c3-9f29-af1b23fd007a tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:22.660964 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-effc6dde-1170-43c3-9f29-af1b23fd007a tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] [instance: 6ff56299-ada5-4e73-9e68-59cdd48f8a16] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:22.674856 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-effc6dde-1170-43c3-9f29-af1b23fd007a tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:22.676621 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-effc6dde-1170-43c3-9f29-af1b23fd007a tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:22.678775 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-effc6dde-1170-43c3-9f29-af1b23fd007a tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:22.681632 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-effc6dde-1170-43c3-9f29-af1b23fd007a tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:22.682420 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-effc6dde-1170-43c3-9f29-af1b23fd007a tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:22.683978 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-effc6dde-1170-43c3-9f29-af1b23fd007a tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:22.773355 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-8875c13d-11ab-4abb-bf21-4c3455ad7092 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:22.788659 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-8875c13d-11ab-4abb-bf21-4c3455ad7092 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:22.794823 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-8875c13d-11ab-4abb-bf21-4c3455ad7092 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:22.797459 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-8875c13d-11ab-4abb-bf21-4c3455ad7092 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] 10.222.0.33 "GET /compute/v2.1/servers/81748c83-b703-4c68-899c-c575cc3340d2" status: 200 len: 1812 microversion: 2.25 time: 0.253896 Oct 04 20:40:22.805818 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 936/1777] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:40:22 2022] GET /compute/v2.1/servers/81748c83-b703-4c68-899c-c575cc3340d2 => generated 1812 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:40:22.816962 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-381b11f8-83ac-40f9-aba4-1273e9adfe14 req-36de24a5-d469-426e-a045-1ca026c0ee28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0081d54e-8054-4f3b-9dd4-018f66aa4b27", "name": "network-vif-deleted", "tag": "d3a7e9f7-b445-41aa-929c-167e630cb388"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:40:22.844706 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-381b11f8-83ac-40f9-aba4-1273e9adfe14 req-36de24a5-d469-426e-a045-1ca026c0ee28 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:22.846598 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-381b11f8-83ac-40f9-aba4-1273e9adfe14 req-36de24a5-d469-426e-a045-1ca026c0ee28 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:22.851216 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-381b11f8-83ac-40f9-aba4-1273e9adfe14 req-36de24a5-d469-426e-a045-1ca026c0ee28 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:22.878844 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-381b11f8-83ac-40f9-aba4-1273e9adfe14 req-36de24a5-d469-426e-a045-1ca026c0ee28 service nova] Creating event network-vif-deleted:d3a7e9f7-b445-41aa-929c-167e630cb388 for instance 0081d54e-8054-4f3b-9dd4-018f66aa4b27 on n-h1-854823-8 Oct 04 20:40:22.890532 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-381b11f8-83ac-40f9-aba4-1273e9adfe14 req-36de24a5-d469-426e-a045-1ca026c0ee28 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082878 Oct 04 20:40:22.895156 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 937/1778] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:40:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:40:22.905648 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-7730d860-9790-4357-88eb-a541d5ce3554 req-bf48b0a2-c860-4cad-8d9c-007bc8caa956 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53f0a355-8a5d-4775-a0d3-3aeedfc01570", "name": "network-vif-plugged", "status": "completed", "tag": "28f3e80c-7ad7-4450-a14a-de593e11ffea"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:40:22.935116 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-7730d860-9790-4357-88eb-a541d5ce3554 req-bf48b0a2-c860-4cad-8d9c-007bc8caa956 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:22.937028 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-7730d860-9790-4357-88eb-a541d5ce3554 req-bf48b0a2-c860-4cad-8d9c-007bc8caa956 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:22.941346 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-7730d860-9790-4357-88eb-a541d5ce3554 req-bf48b0a2-c860-4cad-8d9c-007bc8caa956 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:22.968127 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-7730d860-9790-4357-88eb-a541d5ce3554 req-bf48b0a2-c860-4cad-8d9c-007bc8caa956 service nova] Creating event network-vif-plugged:28f3e80c-7ad7-4450-a14a-de593e11ffea for instance 53f0a355-8a5d-4775-a0d3-3aeedfc01570 on n-h2-854823-8 Oct 04 20:40:22.981121 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-7730d860-9790-4357-88eb-a541d5ce3554 req-bf48b0a2-c860-4cad-8d9c-007bc8caa956 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082328 Oct 04 20:40:22.986507 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 938/1779] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:40:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:40:23.015029 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-effc6dde-1170-43c3-9f29-af1b23fd007a tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673886dab3ed4cbd8a314386fbfbe39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f67490cfb798433eb86c006008c9aaa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:23.026073 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-effc6dde-1170-43c3-9f29-af1b23fd007a tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] 10.222.0.33 "GET /compute/v2.1/servers/6ff56299-ada5-4e73-9e68-59cdd48f8a16" status: 200 len: 1351 microversion: 2.1 time: 0.371542 Oct 04 20:40:23.041933 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 842/1780] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:40:22 2022] GET /compute/v2.1/servers/6ff56299-ada5-4e73-9e68-59cdd48f8a16 => generated 1351 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:23.060852 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-f850ec91-7ac1-47f1-898f-8e938f755bdf tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:23.064841 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-f850ec91-7ac1-47f1-898f-8e938f755bdf tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] [instance: 53f0a355-8a5d-4775-a0d3-3aeedfc01570] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:23.073065 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f850ec91-7ac1-47f1-898f-8e938f755bdf tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:23.073942 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f850ec91-7ac1-47f1-898f-8e938f755bdf tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:23.074633 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f850ec91-7ac1-47f1-898f-8e938f755bdf tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:23.075556 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f850ec91-7ac1-47f1-898f-8e938f755bdf tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:23.076225 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f850ec91-7ac1-47f1-898f-8e938f755bdf tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:23.076811 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f850ec91-7ac1-47f1-898f-8e938f755bdf tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:23.243908 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0b6d7b93-f340-481b-aa07-90c9e2937853 tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:23.245617 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-0b6d7b93-f340-481b-aa07-90c9e2937853 tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] [instance: 83df4756-40e2-4fc6-be48-48a82dd4572a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:23.256316 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0b6d7b93-f340-481b-aa07-90c9e2937853 tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:23.257486 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0b6d7b93-f340-481b-aa07-90c9e2937853 tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:23.259892 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0b6d7b93-f340-481b-aa07-90c9e2937853 tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:23.260782 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0b6d7b93-f340-481b-aa07-90c9e2937853 tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:23.262458 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0b6d7b93-f340-481b-aa07-90c9e2937853 tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:23.265635 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0b6d7b93-f340-481b-aa07-90c9e2937853 tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:23.339373 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-f850ec91-7ac1-47f1-898f-8e938f755bdf tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96919ec99c14864876d64a9c2b20f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b44ce10b78bf49c882c9b4df06187114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:23.354391 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-f850ec91-7ac1-47f1-898f-8e938f755bdf tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] 10.222.0.33 "GET /compute/v2.1/servers/53f0a355-8a5d-4775-a0d3-3aeedfc01570" status: 200 len: 1313 microversion: 2.1 time: 0.303623 Oct 04 20:40:23.374280 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 939/1781] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:40:23 2022] GET /compute/v2.1/servers/53f0a355-8a5d-4775-a0d3-3aeedfc01570 => generated 1313 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:23.390397 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-eef55fab-a447-49ce-97e6-343936fe46a0 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:23.391022 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-eef55fab-a447-49ce-97e6-343936fe46a0 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] [instance: 0081d54e-8054-4f3b-9dd4-018f66aa4b27] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:23.412502 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-eef55fab-a447-49ce-97e6-343936fe46a0 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:23.414270 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-eef55fab-a447-49ce-97e6-343936fe46a0 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:23.415035 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-eef55fab-a447-49ce-97e6-343936fe46a0 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:23.415473 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-eef55fab-a447-49ce-97e6-343936fe46a0 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:23.417398 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-eef55fab-a447-49ce-97e6-343936fe46a0 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:23.420364 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-eef55fab-a447-49ce-97e6-343936fe46a0 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:23.509132 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-eef55fab-a447-49ce-97e6-343936fe46a0 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:23.514564 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-eef55fab-a447-49ce-97e6-343936fe46a0 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:23.515528 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-eef55fab-a447-49ce-97e6-343936fe46a0 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:23.516195 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.objects.instance [None req-eef55fab-a447-49ce-97e6-343936fe46a0 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lazy-loading 'fault' on Instance uuid 0081d54e-8054-4f3b-9dd4-018f66aa4b27 {{(pid=128802) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:40:23.636760 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-eef55fab-a447-49ce-97e6-343936fe46a0 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a82c49a62249029ebc6ae3b4829709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecf3793be3eb4f3186c07a7e45fd8f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:23.650159 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-eef55fab-a447-49ce-97e6-343936fe46a0 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] 10.222.0.33 "GET /compute/v2.1/servers/0081d54e-8054-4f3b-9dd4-018f66aa4b27" status: 200 len: 1314 microversion: 2.1 time: 0.274533 Oct 04 20:40:23.651273 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 940/1782] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:40:23 2022] GET /compute/v2.1/servers/0081d54e-8054-4f3b-9dd4-018f66aa4b27 => generated 1314 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:23.666262 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-94522441-728a-42de-83e6-7cf2208c8e8a tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:23.673930 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-94522441-728a-42de-83e6-7cf2208c8e8a tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] [instance: 21de8a24-9cad-4f83-a459-5297200c20ad] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:23.683143 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-0b6d7b93-f340-481b-aa07-90c9e2937853 tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/83df4756-40e2-4fc6-be48-48a82dd4572a" status: 200 len: 1813 microversion: 2.1 time: 0.443691 Oct 04 20:40:23.683729 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 843/1783] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:40:23 2022] GET /compute/v2.1/servers/83df4756-40e2-4fc6-be48-48a82dd4572a => generated 1813 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:23.694791 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-94522441-728a-42de-83e6-7cf2208c8e8a tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:23.695501 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-94522441-728a-42de-83e6-7cf2208c8e8a tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:23.696166 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-94522441-728a-42de-83e6-7cf2208c8e8a tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:23.697066 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-94522441-728a-42de-83e6-7cf2208c8e8a tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:23.697527 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d35839be-8fb7-46f4-acab-886493da265e tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Calling method '.version_select at 0x7f3c78855a60>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:23.697875 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-94522441-728a-42de-83e6-7cf2208c8e8a tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:23.716919 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-94522441-728a-42de-83e6-7cf2208c8e8a tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:23.787082 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d35839be-8fb7-46f4-acab-886493da265e tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] 10.222.0.33 "GET /compute/v2.1/images/dec1cfe6-6be8-4fc4-a82f-728708d575e6" status: 200 len: 1426 microversion: 2.1 time: 0.101269 Oct 04 20:40:23.787721 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 844/1784] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 20:40:23 2022] GET /compute/v2.1/images/dec1cfe6-6be8-4fc4-a82f-728708d575e6 => generated 1426 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:23.805176 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-86534f45-2608-4f26-b03a-3ad512b937e4 tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:23.815892 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-86534f45-2608-4f26-b03a-3ad512b937e4 tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:23.819545 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-86534f45-2608-4f26-b03a-3ad512b937e4 tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:23.820183 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-86534f45-2608-4f26-b03a-3ad512b937e4 tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:23.821270 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-86534f45-2608-4f26-b03a-3ad512b937e4 tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:23.821915 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-86534f45-2608-4f26-b03a-3ad512b937e4 tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:23.822382 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-86534f45-2608-4f26-b03a-3ad512b937e4 tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:23.890606 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-86534f45-2608-4f26-b03a-3ad512b937e4 tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.093084 Oct 04 20:40:23.893468 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 845/1785] 10.222.0.33 () {58 vars in 1176 bytes} [Tue Oct 4 20:40:23 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:40:23.901883 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8617fb0f-1c7e-400c-ba2f-e1383689c114 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:23.903529 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-8617fb0f-1c7e-400c-ba2f-e1383689c114 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] [instance: 81748c83-b703-4c68-899c-c575cc3340d2] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:23.912662 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8617fb0f-1c7e-400c-ba2f-e1383689c114 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:23.913345 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8617fb0f-1c7e-400c-ba2f-e1383689c114 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:23.913978 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8617fb0f-1c7e-400c-ba2f-e1383689c114 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:23.916395 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8617fb0f-1c7e-400c-ba2f-e1383689c114 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:23.917052 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8617fb0f-1c7e-400c-ba2f-e1383689c114 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:23.918939 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8617fb0f-1c7e-400c-ba2f-e1383689c114 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:23.988504 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-94522441-728a-42de-83e6-7cf2208c8e8a tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36f4114dc4f443f8b48da7b4027e0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a23a85365414f92bbc03177d7f190e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:23.998991 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-94522441-728a-42de-83e6-7cf2208c8e8a tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] 10.222.0.33 "GET /compute/v2.1/servers/21de8a24-9cad-4f83-a459-5297200c20ad" status: 200 len: 1466 microversion: 2.1 time: 0.345985 Oct 04 20:40:24.003824 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 941/1786] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:40:23 2022] GET /compute/v2.1/servers/21de8a24-9cad-4f83-a459-5297200c20ad => generated 1466 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:24.031410 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-8ba522a9-952f-4a2d-8ea9-0a970b6d1028 tempest-ServersOnMultiNodesTest-176762512 tempest-ServersOnMultiNodesTest-176762512-project-admin] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:24.034616 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-8ba522a9-952f-4a2d-8ea9-0a970b6d1028 tempest-ServersOnMultiNodesTest-176762512 tempest-ServersOnMultiNodesTest-176762512-project-admin] [instance: 21de8a24-9cad-4f83-a459-5297200c20ad] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:24.055328 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8ba522a9-952f-4a2d-8ea9-0a970b6d1028 tempest-ServersOnMultiNodesTest-176762512 tempest-ServersOnMultiNodesTest-176762512-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:24.056054 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8ba522a9-952f-4a2d-8ea9-0a970b6d1028 tempest-ServersOnMultiNodesTest-176762512 tempest-ServersOnMultiNodesTest-176762512-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:24.061278 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8ba522a9-952f-4a2d-8ea9-0a970b6d1028 tempest-ServersOnMultiNodesTest-176762512 tempest-ServersOnMultiNodesTest-176762512-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:24.063359 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8ba522a9-952f-4a2d-8ea9-0a970b6d1028 tempest-ServersOnMultiNodesTest-176762512 tempest-ServersOnMultiNodesTest-176762512-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:24.064700 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8ba522a9-952f-4a2d-8ea9-0a970b6d1028 tempest-ServersOnMultiNodesTest-176762512 tempest-ServersOnMultiNodesTest-176762512-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:24.068313 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8ba522a9-952f-4a2d-8ea9-0a970b6d1028 tempest-ServersOnMultiNodesTest-176762512 tempest-ServersOnMultiNodesTest-176762512-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:24.338218 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-8617fb0f-1c7e-400c-ba2f-e1383689c114 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:24.367831 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-8617fb0f-1c7e-400c-ba2f-e1383689c114 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:24.374984 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-8617fb0f-1c7e-400c-ba2f-e1383689c114 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:24.379127 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-8617fb0f-1c7e-400c-ba2f-e1383689c114 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] 10.222.0.33 "GET /compute/v2.1/servers/81748c83-b703-4c68-899c-c575cc3340d2" status: 200 len: 1812 microversion: 2.25 time: 0.483384 Oct 04 20:40:24.380451 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 846/1787] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:40:23 2022] GET /compute/v2.1/servers/81748c83-b703-4c68-899c-c575cc3340d2 => generated 1812 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:40:24.392417 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-79936b96-4bfb-4843-9f95-d88bb680910e tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:24.396807 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-79936b96-4bfb-4843-9f95-d88bb680910e tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] [instance: 6ff56299-ada5-4e73-9e68-59cdd48f8a16] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:24.411087 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-79936b96-4bfb-4843-9f95-d88bb680910e tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:24.411703 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-79936b96-4bfb-4843-9f95-d88bb680910e tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:24.412219 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-79936b96-4bfb-4843-9f95-d88bb680910e tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:24.413032 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-79936b96-4bfb-4843-9f95-d88bb680910e tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:24.414939 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-79936b96-4bfb-4843-9f95-d88bb680910e tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:24.415587 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-79936b96-4bfb-4843-9f95-d88bb680910e tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:24.501460 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-8ba522a9-952f-4a2d-8ea9-0a970b6d1028 tempest-ServersOnMultiNodesTest-176762512 tempest-ServersOnMultiNodesTest-176762512-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/21de8a24-9cad-4f83-a459-5297200c20ad" status: 200 len: 1617 microversion: 2.1 time: 0.474159 Oct 04 20:40:24.524407 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 942/1788] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:40:24 2022] GET /compute/v2.1/servers/21de8a24-9cad-4f83-a459-5297200c20ad => generated 1617 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:24.531981 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-f28e9c10-a574-4d7c-9111-19f1dafa0d47 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:24.533215 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-f28e9c10-a574-4d7c-9111-19f1dafa0d47 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] [instance: 53f0a355-8a5d-4775-a0d3-3aeedfc01570] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:24.546108 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f28e9c10-a574-4d7c-9111-19f1dafa0d47 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:24.554978 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f28e9c10-a574-4d7c-9111-19f1dafa0d47 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:24.555646 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f28e9c10-a574-4d7c-9111-19f1dafa0d47 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:24.556576 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f28e9c10-a574-4d7c-9111-19f1dafa0d47 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:24.557107 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f28e9c10-a574-4d7c-9111-19f1dafa0d47 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:24.557611 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f28e9c10-a574-4d7c-9111-19f1dafa0d47 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:25.281021 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-79936b96-4bfb-4843-9f95-d88bb680910e tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673886dab3ed4cbd8a314386fbfbe39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f67490cfb798433eb86c006008c9aaa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:25.295396 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-79936b96-4bfb-4843-9f95-d88bb680910e tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] 10.222.0.33 "GET /compute/v2.1/servers/6ff56299-ada5-4e73-9e68-59cdd48f8a16" status: 200 len: 1351 microversion: 2.1 time: 0.913774 Oct 04 20:40:25.296370 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 847/1789] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:40:24 2022] GET /compute/v2.1/servers/6ff56299-ada5-4e73-9e68-59cdd48f8a16 => generated 1351 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:25.301315 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-02c8c2cf-2b38-4d3d-905a-d24b65b825bd tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:25.319035 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-02c8c2cf-2b38-4d3d-905a-d24b65b825bd tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] [instance: 21de8a24-9cad-4f83-a459-5297200c20ad] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:25.328244 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-02c8c2cf-2b38-4d3d-905a-d24b65b825bd tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:25.335450 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-02c8c2cf-2b38-4d3d-905a-d24b65b825bd tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:25.338310 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-02c8c2cf-2b38-4d3d-905a-d24b65b825bd tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:25.339821 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-02c8c2cf-2b38-4d3d-905a-d24b65b825bd tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:25.341769 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-02c8c2cf-2b38-4d3d-905a-d24b65b825bd tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:25.351090 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-02c8c2cf-2b38-4d3d-905a-d24b65b825bd tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:25.461989 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-f28e9c10-a574-4d7c-9111-19f1dafa0d47 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96919ec99c14864876d64a9c2b20f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b44ce10b78bf49c882c9b4df06187114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:25.471529 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-f28e9c10-a574-4d7c-9111-19f1dafa0d47 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] 10.222.0.33 "GET /compute/v2.1/servers/53f0a355-8a5d-4775-a0d3-3aeedfc01570" status: 200 len: 1313 microversion: 2.1 time: 0.945858 Oct 04 20:40:25.478891 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 943/1790] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:40:24 2022] GET /compute/v2.1/servers/53f0a355-8a5d-4775-a0d3-3aeedfc01570 => generated 1313 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:25.500390 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-02c8c2cf-2b38-4d3d-905a-d24b65b825bd tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] [instance: 21de8a24-9cad-4f83-a459-5297200c20ad] Going to try to terminate instance {{(pid=128801) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:40:25.505202 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-1a183a6f-947e-4911-bfe5-062f2d2a7713 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:25.508566 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-1a183a6f-947e-4911-bfe5-062f2d2a7713 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] [instance: 0081d54e-8054-4f3b-9dd4-018f66aa4b27] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:25.525259 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1a183a6f-947e-4911-bfe5-062f2d2a7713 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:25.543150 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1a183a6f-947e-4911-bfe5-062f2d2a7713 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:25.543893 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1a183a6f-947e-4911-bfe5-062f2d2a7713 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:25.545951 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1a183a6f-947e-4911-bfe5-062f2d2a7713 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:25.549205 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1a183a6f-947e-4911-bfe5-062f2d2a7713 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:25.553414 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1a183a6f-947e-4911-bfe5-062f2d2a7713 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:25.617547 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.wsgi [None req-1a183a6f-947e-4911-bfe5-062f2d2a7713 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] HTTP exception thrown: Instance 0081d54e-8054-4f3b-9dd4-018f66aa4b27 could not be found. Oct 04 20:40:25.622585 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-1a183a6f-947e-4911-bfe5-062f2d2a7713 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Request method failure captured: Oct 04 20:40:25.622585 n-d-854823-8 devstack@n-api.service[128802]: request: GET /compute/v2.1/servers/0081d54e-8054-4f3b-9dd4-018f66aa4b27 HTTP/1.1 Oct 04 20:40:25.622585 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 20:40:25.622585 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 20:40:25.622585 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 20:40:25.622585 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 0 Oct 04 20:40:25.622585 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 20:40:25.622585 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 20:40:25.622585 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 20:40:25.622585 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 20:40:25.622585 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPJndB3mJHN0LJ8w6Kheb2n0CJ86k8j-AXdWa3AMW_tNY1_9QQNH8dAe8aGzPWpNIRLrfkOudQ5X3ptj4NBqufJdfAt-Rzg0K2bAeHF3DIzHVwi3Ysg8-zRwFjrbgaapzSsHDGJy5Rd6NQfSoCIrbX0y1TKi0r3vLuM4ZTrt6iTVd_LI Oct 04 20:40:25.622585 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 20:40:25.622585 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 20:40:25.622585 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 20:40:25.622585 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 20:40:25.622585 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 20:40:25.622585 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 20:40:25.622585 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: ecf3793be3eb4f3186c07a7e45fd8f06 Oct 04 20:40:25.622585 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-957462329 Oct 04 20:40:25.622585 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 20:40:25.622585 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 20:40:25.622585 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ecf3793be3eb4f3186c07a7e45fd8f06", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ecf3793be3eb4f3186c07a7e45fd8f06"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ecf3793be3eb4f3186c07a7e45fd8f06"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ecf3793be3eb4f3186c07a7e45fd8f06"}]}] Oct 04 20:40:25.622585 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-957462329 Oct 04 20:40:25.622585 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: ecf3793be3eb4f3186c07a7e45fd8f06 Oct 04 20:40:25.622585 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-957462329 Oct 04 20:40:25.622585 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-ImagesOneServerNegativeTestJSON-957462329-project Oct 04 20:40:25.622585 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 20:40:25.622585 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 20:40:25.622585 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: 89a82c49a62249029ebc6ae3b4829709 Oct 04 20:40:25.622585 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-957462329-project Oct 04 20:40:25.622585 n-d-854823-8 devstack@n-api.service[128802]: method: > Oct 04 20:40:25.622585 n-d-854823-8 devstack@n-api.service[128802]: exception: Instance 0081d54e-8054-4f3b-9dd4-018f66aa4b27 could not be found. Oct 04 20:40:25.622585 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'id': '0081d54e-8054-4f3b-9dd4-018f66aa4b27'} Oct 04 20:40:25.622585 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:40:25.622585 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:40:25.622585 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:40:25.622585 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:40:25.622585 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:40:25.622585 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:40:25.622585 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:40:25.622585 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:40:25.622585 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:40:25.622585 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:40:25.622585 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0081d54e-8054-4f3b-9dd4-018f66aa4b27 could not be found. Oct 04 20:40:25.622585 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:40:25.622585 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:40:25.622585 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:40:25.622585 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:40:25.622585 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:40:25.622585 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:40:25.622585 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:40:25.622585 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:40:25.622585 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:40:25.622585 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:40:25.622585 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:40:25.622585 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:40:25.622585 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:40:25.622585 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:40:25.622585 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:40:25.622585 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:40:25.622585 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0081d54e-8054-4f3b-9dd4-018f66aa4b27 could not be found. Oct 04 20:40:25.622585 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:40:25.622585 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:40:25.627947 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:40:25.627947 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:40:25.627947 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:40:25.627947 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:40:25.627947 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:40:25.627947 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:40:25.627947 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0081d54e-8054-4f3b-9dd4-018f66aa4b27 could not be found. Oct 04 20:40:25.627947 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:40:25.636250 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-1a183a6f-947e-4911-bfe5-062f2d2a7713 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Returning 404 to user: Instance 0081d54e-8054-4f3b-9dd4-018f66aa4b27 could not be found. {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:40:25.638036 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-1a183a6f-947e-4911-bfe5-062f2d2a7713 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] 10.222.0.33 "GET /compute/v2.1/servers/0081d54e-8054-4f3b-9dd4-018f66aa4b27" status: 404 len: 111 microversion: 2.1 time: 0.157745 Oct 04 20:40:25.639313 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 944/1791] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:40:25 2022] GET /compute/v2.1/servers/0081d54e-8054-4f3b-9dd4-018f66aa4b27 => generated 111 bytes in 159 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:40:25.655687 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-0a2b2456-4856-4a1f-bf21-fce2dc8475e7 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Calling method '.version_select at 0x7f3c789eec10>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:25.778289 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-0a2b2456-4856-4a1f-bf21-fce2dc8475e7 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] 10.222.0.33 "GET /compute/v2.1/images/dec1cfe6-6be8-4fc4-a82f-728708d575e6" status: 200 len: 1426 microversion: 2.1 time: 0.137614 Oct 04 20:40:25.780361 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 945/1792] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 20:40:25 2022] GET /compute/v2.1/images/dec1cfe6-6be8-4fc4-a82f-728708d575e6 => generated 1426 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:25.788469 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:40:25.793128 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-b3f234db-b830-418b-95c5-c041e71b930b req-22698e2a-f6ac-4f19-8d4f-a5375e202ce2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ff56299-ada5-4e73-9e68-59cdd48f8a16", "name": "network-vif-plugged", "status": "completed", "tag": "8639aac2-0a5a-4a66-92f5-712c9424eedf"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:40:25.830520 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-02c8c2cf-2b38-4d3d-905a-d24b65b825bd tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] 10.222.0.33 "DELETE /compute/v2.1/servers/21de8a24-9cad-4f83-a459-5297200c20ad" status: 204 len: 0 microversion: 2.1 time: 0.532520 Oct 04 20:40:25.833711 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-b3f234db-b830-418b-95c5-c041e71b930b req-22698e2a-f6ac-4f19-8d4f-a5375e202ce2 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:25.834470 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-b3f234db-b830-418b-95c5-c041e71b930b req-22698e2a-f6ac-4f19-8d4f-a5375e202ce2 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:25.835799 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-b3f234db-b830-418b-95c5-c041e71b930b req-22698e2a-f6ac-4f19-8d4f-a5375e202ce2 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:25.836386 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 848/1793] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 20:40:25 2022] DELETE /compute/v2.1/servers/21de8a24-9cad-4f83-a459-5297200c20ad => generated 0 bytes in 539 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:40:25.853995 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-da11a8eb-f816-4cc0-b5b7-bcdebaf8d5d2 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:25.869634 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-da11a8eb-f816-4cc0-b5b7-bcdebaf8d5d2 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] [instance: 81748c83-b703-4c68-899c-c575cc3340d2] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:25.880915 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-b3f234db-b830-418b-95c5-c041e71b930b req-22698e2a-f6ac-4f19-8d4f-a5375e202ce2 service nova] Creating event network-vif-plugged:8639aac2-0a5a-4a66-92f5-712c9424eedf for instance 6ff56299-ada5-4e73-9e68-59cdd48f8a16 on n-h1-854823-8 Oct 04 20:40:25.899359 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-b3f234db-b830-418b-95c5-c041e71b930b req-22698e2a-f6ac-4f19-8d4f-a5375e202ce2 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117528 Oct 04 20:40:25.904379 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 946/1794] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:40:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:40:25.916676 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-10b79441-4164-4517-9b8d-9da6569508ad tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:25.917723 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-10b79441-4164-4517-9b8d-9da6569508ad tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] [instance: 21de8a24-9cad-4f83-a459-5297200c20ad] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:25.929498 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-da11a8eb-f816-4cc0-b5b7-bcdebaf8d5d2 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:25.930783 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-10b79441-4164-4517-9b8d-9da6569508ad tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:25.931784 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-da11a8eb-f816-4cc0-b5b7-bcdebaf8d5d2 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:25.932242 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-da11a8eb-f816-4cc0-b5b7-bcdebaf8d5d2 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:25.932851 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-10b79441-4164-4517-9b8d-9da6569508ad tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:25.932994 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-da11a8eb-f816-4cc0-b5b7-bcdebaf8d5d2 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:25.935275 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-10b79441-4164-4517-9b8d-9da6569508ad tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:25.936132 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-10b79441-4164-4517-9b8d-9da6569508ad tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:25.936723 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-10b79441-4164-4517-9b8d-9da6569508ad tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:25.939168 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-10b79441-4164-4517-9b8d-9da6569508ad tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:25.943651 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-da11a8eb-f816-4cc0-b5b7-bcdebaf8d5d2 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:25.944113 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-da11a8eb-f816-4cc0-b5b7-bcdebaf8d5d2 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:26.301554 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-10b79441-4164-4517-9b8d-9da6569508ad tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36f4114dc4f443f8b48da7b4027e0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a23a85365414f92bbc03177d7f190e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:26.313456 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-10b79441-4164-4517-9b8d-9da6569508ad tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] 10.222.0.33 "GET /compute/v2.1/servers/21de8a24-9cad-4f83-a459-5297200c20ad" status: 200 len: 1472 microversion: 2.1 time: 0.407738 Oct 04 20:40:26.317945 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 947/1795] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:40:25 2022] GET /compute/v2.1/servers/21de8a24-9cad-4f83-a459-5297200c20ad => generated 1472 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:26.341435 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-e98fb39e-c9d0-464b-8ca5-c41467ca7995 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-518393586", "imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:40:26.493752 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.network.neutron [None req-e98fb39e-c9d0-464b-8ca5-c41467ca7995 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] validate_networks() for [('f7c73946-c8b6-4692-9980-985e34afc9ea', None, None, None, None, None)] {{(pid=128802) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:40:26.732685 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-da11a8eb-f816-4cc0-b5b7-bcdebaf8d5d2 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:26.745715 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-da11a8eb-f816-4cc0-b5b7-bcdebaf8d5d2 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:26.754506 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-da11a8eb-f816-4cc0-b5b7-bcdebaf8d5d2 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:26.759227 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-da11a8eb-f816-4cc0-b5b7-bcdebaf8d5d2 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] 10.222.0.33 "GET /compute/v2.1/servers/81748c83-b703-4c68-899c-c575cc3340d2" status: 200 len: 1812 microversion: 2.25 time: 0.921092 Oct 04 20:40:26.762684 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 849/1796] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:40:25 2022] GET /compute/v2.1/servers/81748c83-b703-4c68-899c-c575cc3340d2 => generated 1812 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:40:26.780502 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-74128f3b-f882-4bb4-b87e-dd34149fcd82 tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:26.781386 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-74128f3b-f882-4bb4-b87e-dd34149fcd82 tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] [instance: 6ff56299-ada5-4e73-9e68-59cdd48f8a16] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:26.812995 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-74128f3b-f882-4bb4-b87e-dd34149fcd82 tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:26.813659 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-74128f3b-f882-4bb4-b87e-dd34149fcd82 tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:26.814007 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-74128f3b-f882-4bb4-b87e-dd34149fcd82 tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:26.814776 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-74128f3b-f882-4bb4-b87e-dd34149fcd82 tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:26.819639 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-74128f3b-f882-4bb4-b87e-dd34149fcd82 tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:26.820851 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-74128f3b-f882-4bb4-b87e-dd34149fcd82 tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:27.466386 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-74128f3b-f882-4bb4-b87e-dd34149fcd82 tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673886dab3ed4cbd8a314386fbfbe39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f67490cfb798433eb86c006008c9aaa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:27.486558 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-74128f3b-f882-4bb4-b87e-dd34149fcd82 tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] 10.222.0.33 "GET /compute/v2.1/servers/6ff56299-ada5-4e73-9e68-59cdd48f8a16" status: 200 len: 1351 microversion: 2.1 time: 0.712820 Oct 04 20:40:27.487745 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 850/1797] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:40:26 2022] GET /compute/v2.1/servers/6ff56299-ada5-4e73-9e68-59cdd48f8a16 => generated 1351 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:27.509913 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-4886b7c1-f779-4f53-a408-07d6e0fd35d9 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:27.510591 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-4886b7c1-f779-4f53-a408-07d6e0fd35d9 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] [instance: 53f0a355-8a5d-4775-a0d3-3aeedfc01570] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:27.536968 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4886b7c1-f779-4f53-a408-07d6e0fd35d9 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:27.537476 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4886b7c1-f779-4f53-a408-07d6e0fd35d9 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:27.537924 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4886b7c1-f779-4f53-a408-07d6e0fd35d9 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:27.544853 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4886b7c1-f779-4f53-a408-07d6e0fd35d9 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:27.545622 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4886b7c1-f779-4f53-a408-07d6e0fd35d9 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:27.546276 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4886b7c1-f779-4f53-a408-07d6e0fd35d9 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:27.953746 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-e98fb39e-c9d0-464b-8ca5-c41467ca7995 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Flavor limits 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:40:27.954396 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-e98fb39e-c9d0-464b-8ca5-c41467ca7995 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Image limits 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:40:27.955002 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-e98fb39e-c9d0-464b-8ca5-c41467ca7995 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Flavor pref 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:40:27.955426 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-e98fb39e-c9d0-464b-8ca5-c41467ca7995 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Image pref 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:40:27.955830 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-e98fb39e-c9d0-464b-8ca5-c41467ca7995 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:40:27.972504 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e98fb39e-c9d0-464b-8ca5-c41467ca7995 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:27.977409 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e98fb39e-c9d0-464b-8ca5-c41467ca7995 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:27.978110 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e98fb39e-c9d0-464b-8ca5-c41467ca7995 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:27.979220 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e98fb39e-c9d0-464b-8ca5-c41467ca7995 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:27.981188 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e98fb39e-c9d0-464b-8ca5-c41467ca7995 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:27.981834 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e98fb39e-c9d0-464b-8ca5-c41467ca7995 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:28.009201 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-4886b7c1-f779-4f53-a408-07d6e0fd35d9 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96919ec99c14864876d64a9c2b20f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b44ce10b78bf49c882c9b4df06187114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:28.021103 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-4886b7c1-f779-4f53-a408-07d6e0fd35d9 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] 10.222.0.33 "GET /compute/v2.1/servers/53f0a355-8a5d-4775-a0d3-3aeedfc01570" status: 200 len: 1499 microversion: 2.1 time: 0.532247 Oct 04 20:40:28.027817 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 851/1798] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:40:27 2022] GET /compute/v2.1/servers/53f0a355-8a5d-4775-a0d3-3aeedfc01570 => generated 1499 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:28.040991 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-685c014f-854f-4df3-a611-fd39ca2280ce tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Calling method '.version_select at 0x7f3c788284c0>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:28.050231 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-e98fb39e-c9d0-464b-8ca5-c41467ca7995 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Getting quotas for project ecf3793be3eb4f3186c07a7e45fd8f06. Resources: {'ram', 'instances', 'cores'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:40:28.058496 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-e98fb39e-c9d0-464b-8ca5-c41467ca7995 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Getting quotas for user 89a82c49a62249029ebc6ae3b4829709 and project ecf3793be3eb4f3186c07a7e45fd8f06. Resources: {'ram', 'instances', 'cores'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:40:28.074539 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-e98fb39e-c9d0-464b-8ca5-c41467ca7995 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Going to run 1 instances... {{(pid=128802) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:40:28.077954 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-e98fb39e-c9d0-464b-8ca5-c41467ca7995 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] [instance: fd12aa25-6dbc-4f92-a2e1-83ae94ab83b4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='15b24725-0c99-4bcf-b1fb-907cdf8e2d63',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128802) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:40:28.124416 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-685c014f-854f-4df3-a611-fd39ca2280ce tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] 10.222.0.33 "GET /compute/v2.1/images/dec1cfe6-6be8-4fc4-a82f-728708d575e6" status: 200 len: 1426 microversion: 2.1 time: 0.093845 Oct 04 20:40:28.127433 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 852/1799] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 20:40:28 2022] GET /compute/v2.1/images/dec1cfe6-6be8-4fc4-a82f-728708d575e6 => generated 1426 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:28.138954 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8e16c478-fe51-474b-a588-d2bd0dc87581 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "89f632ad-5ac8-4440-95d0-1bc8bf718d82", "device": "/dev/xvdb"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:40:28.145996 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-8e16c478-fe51-474b-a588-d2bd0dc87581 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] [instance: 83df4756-40e2-4fc6-be48-48a82dd4572a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:28.172767 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8e16c478-fe51-474b-a588-d2bd0dc87581 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:28.173951 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8e16c478-fe51-474b-a588-d2bd0dc87581 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:28.185771 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8e16c478-fe51-474b-a588-d2bd0dc87581 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:28.186768 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8e16c478-fe51-474b-a588-d2bd0dc87581 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:28.187718 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8e16c478-fe51-474b-a588-d2bd0dc87581 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:28.188184 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8e16c478-fe51-474b-a588-d2bd0dc87581 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:28.213273 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-e98fb39e-c9d0-464b-8ca5-c41467ca7995 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.893420 Oct 04 20:40:28.213858 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 948/1800] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 20:40:26 2022] POST /compute/v2.1/servers => generated 383 bytes in 1895 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 20:40:28.539049 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-b0895287-a030-4f85-8755-962312dbc278 tempest-FloatingIPsTestJSON-1592318220 tempest-FloatingIPsTestJSON-1592318220-project] Action: 'create', calling method: .version_select at 0x7f3c789eed30>, body: {"pool": null} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:40:29.296771 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-8e16c478-fe51-474b-a588-d2bd0dc87581 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] 10.222.0.33 "POST /compute/v2.1/servers/83df4756-40e2-4fc6-be48-48a82dd4572a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.166615 Oct 04 20:40:29.305542 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 853/1801] 10.222.0.33 () {60 vars in 1323 bytes} [Tue Oct 4 20:40:28 2022] POST /compute/v2.1/servers/83df4756-40e2-4fc6-be48-48a82dd4572a/os-volume_attachments => generated 194 bytes in 1177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:40:29.338068 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d05afd2f-acb2-482f-82ce-f9d30aee4459 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:29.344060 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d05afd2f-acb2-482f-82ce-f9d30aee4459 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] [instance: 21de8a24-9cad-4f83-a459-5297200c20ad] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:29.387485 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d05afd2f-acb2-482f-82ce-f9d30aee4459 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:29.392463 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d05afd2f-acb2-482f-82ce-f9d30aee4459 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:29.394793 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d05afd2f-acb2-482f-82ce-f9d30aee4459 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:29.396608 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d05afd2f-acb2-482f-82ce-f9d30aee4459 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:29.406926 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d05afd2f-acb2-482f-82ce-f9d30aee4459 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:29.409294 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d05afd2f-acb2-482f-82ce-f9d30aee4459 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:29.505050 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d05afd2f-acb2-482f-82ce-f9d30aee4459 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:29.505858 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d05afd2f-acb2-482f-82ce-f9d30aee4459 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:29.506479 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d05afd2f-acb2-482f-82ce-f9d30aee4459 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:29.531373 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-d05afd2f-acb2-482f-82ce-f9d30aee4459 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lazy-loading 'fault' on Instance uuid 21de8a24-9cad-4f83-a459-5297200c20ad {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:40:29.786054 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d05afd2f-acb2-482f-82ce-f9d30aee4459 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36f4114dc4f443f8b48da7b4027e0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a23a85365414f92bbc03177d7f190e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:29.810407 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d05afd2f-acb2-482f-82ce-f9d30aee4459 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] 10.222.0.33 "GET /compute/v2.1/servers/21de8a24-9cad-4f83-a459-5297200c20ad" status: 200 len: 1306 microversion: 2.1 time: 0.501242 Oct 04 20:40:29.812473 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 854/1802] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:40:29 2022] GET /compute/v2.1/servers/21de8a24-9cad-4f83-a459-5297200c20ad => generated 1306 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:29.825013 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b66e0b77-4ac8-4211-aae2-04b03ac382ec tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:29.827717 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b66e0b77-4ac8-4211-aae2-04b03ac382ec tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] [instance: 81748c83-b703-4c68-899c-c575cc3340d2] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:29.859049 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b66e0b77-4ac8-4211-aae2-04b03ac382ec tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:29.861881 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b66e0b77-4ac8-4211-aae2-04b03ac382ec tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:29.862561 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b66e0b77-4ac8-4211-aae2-04b03ac382ec tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:29.864359 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b66e0b77-4ac8-4211-aae2-04b03ac382ec tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:29.869615 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b66e0b77-4ac8-4211-aae2-04b03ac382ec tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:29.872246 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b66e0b77-4ac8-4211-aae2-04b03ac382ec tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:30.230843 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-b66e0b77-4ac8-4211-aae2-04b03ac382ec tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:30.256725 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-b66e0b77-4ac8-4211-aae2-04b03ac382ec tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:30.266734 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-b66e0b77-4ac8-4211-aae2-04b03ac382ec tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:30.271328 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b66e0b77-4ac8-4211-aae2-04b03ac382ec tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] 10.222.0.33 "GET /compute/v2.1/servers/81748c83-b703-4c68-899c-c575cc3340d2" status: 200 len: 1812 microversion: 2.25 time: 0.456650 Oct 04 20:40:30.299323 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 855/1803] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:40:29 2022] GET /compute/v2.1/servers/81748c83-b703-4c68-899c-c575cc3340d2 => generated 1812 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:40:30.312600 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d2a4b9e9-7d53-4c3d-9e30-caf117e1bd6d tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:40:30.324132 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d2a4b9e9-7d53-4c3d-9e30-caf117e1bd6d tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] [instance: 53f0a355-8a5d-4775-a0d3-3aeedfc01570] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:30.339902 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d2a4b9e9-7d53-4c3d-9e30-caf117e1bd6d tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:30.340420 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d2a4b9e9-7d53-4c3d-9e30-caf117e1bd6d tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:30.341385 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d2a4b9e9-7d53-4c3d-9e30-caf117e1bd6d tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:30.343257 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d2a4b9e9-7d53-4c3d-9e30-caf117e1bd6d tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:30.343981 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d2a4b9e9-7d53-4c3d-9e30-caf117e1bd6d tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:30.344648 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d2a4b9e9-7d53-4c3d-9e30-caf117e1bd6d tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:30.399698 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-d2a4b9e9-7d53-4c3d-9e30-caf117e1bd6d tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lazy-loading 'flavor' on Instance uuid 53f0a355-8a5d-4775-a0d3-3aeedfc01570 {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:40:30.468645 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:40:30.719234 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d2a4b9e9-7d53-4c3d-9e30-caf117e1bd6d tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] 10.222.0.33 "POST /compute/v2.1/servers/53f0a355-8a5d-4775-a0d3-3aeedfc01570/action" status: 200 len: 32 microversion: 2.1 time: 0.414986 Oct 04 20:40:30.729485 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 856/1804] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 20:40:30 2022] POST /compute/v2.1/servers/53f0a355-8a5d-4775-a0d3-3aeedfc01570/action => generated 32 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 20:40:30.749984 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c7b520f1-bb9f-4638-812e-601ac4f35515 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:30.750738 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c7b520f1-bb9f-4638-812e-601ac4f35515 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] [instance: fd12aa25-6dbc-4f92-a2e1-83ae94ab83b4] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:30.778584 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c7b520f1-bb9f-4638-812e-601ac4f35515 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:30.780178 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c7b520f1-bb9f-4638-812e-601ac4f35515 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:30.780636 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c7b520f1-bb9f-4638-812e-601ac4f35515 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:30.781380 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c7b520f1-bb9f-4638-812e-601ac4f35515 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:30.781837 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c7b520f1-bb9f-4638-812e-601ac4f35515 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:30.782284 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c7b520f1-bb9f-4638-812e-601ac4f35515 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:31.294923 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c7b520f1-bb9f-4638-812e-601ac4f35515 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a82c49a62249029ebc6ae3b4829709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecf3793be3eb4f3186c07a7e45fd8f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:31.313946 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c7b520f1-bb9f-4638-812e-601ac4f35515 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] 10.222.0.33 "GET /compute/v2.1/servers/fd12aa25-6dbc-4f92-a2e1-83ae94ab83b4" status: 200 len: 1276 microversion: 2.1 time: 0.581595 Oct 04 20:40:31.316732 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 857/1805] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:40:30 2022] GET /compute/v2.1/servers/fd12aa25-6dbc-4f92-a2e1-83ae94ab83b4 => generated 1276 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:31.333051 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-4fe4c03e-07c2-4a3f-a259-4405d29a045c req-782810af-1f08-49db-8691-1e03dd653831 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21de8a24-9cad-4f83-a459-5297200c20ad", "name": "network-vif-deleted", "tag": "bbffae2a-7404-4047-a95f-8dd200c997e8"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:40:31.352864 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-4fe4c03e-07c2-4a3f-a259-4405d29a045c req-782810af-1f08-49db-8691-1e03dd653831 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:31.358076 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-4fe4c03e-07c2-4a3f-a259-4405d29a045c req-782810af-1f08-49db-8691-1e03dd653831 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:31.358856 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-4fe4c03e-07c2-4a3f-a259-4405d29a045c req-782810af-1f08-49db-8691-1e03dd653831 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:31.406708 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-4fe4c03e-07c2-4a3f-a259-4405d29a045c req-782810af-1f08-49db-8691-1e03dd653831 service nova] Creating event network-vif-deleted:bbffae2a-7404-4047-a95f-8dd200c997e8 for instance 21de8a24-9cad-4f83-a459-5297200c20ad on n-h1-854823-8 Oct 04 20:40:31.412748 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-4fe4c03e-07c2-4a3f-a259-4405d29a045c req-782810af-1f08-49db-8691-1e03dd653831 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084640 Oct 04 20:40:31.414060 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 858/1806] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:40:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:40:31.420897 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e702342d-f10d-4d36-b8e6-3585051e380f tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:31.421930 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e702342d-f10d-4d36-b8e6-3585051e380f tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] [instance: 6ff56299-ada5-4e73-9e68-59cdd48f8a16] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:31.444755 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e702342d-f10d-4d36-b8e6-3585051e380f tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:31.445664 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e702342d-f10d-4d36-b8e6-3585051e380f tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:31.446424 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e702342d-f10d-4d36-b8e6-3585051e380f tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:31.447374 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e702342d-f10d-4d36-b8e6-3585051e380f tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:31.451717 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e702342d-f10d-4d36-b8e6-3585051e380f tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:31.452902 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e702342d-f10d-4d36-b8e6-3585051e380f tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:31.738675 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-b0895287-a030-4f85-8755-962312dbc278 tempest-FloatingIPsTestJSON-1592318220 tempest-FloatingIPsTestJSON-1592318220-project] 10.222.0.33 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.505490 Oct 04 20:40:31.739975 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 949/1807] 10.222.0.33 () {60 vars in 1170 bytes} [Tue Oct 4 20:40:28 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3526 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:40:31.744754 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-7c6a3354-a889-4368-a1f0-99ac5d907deb tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Calling method '.version_select at 0x7f3c789ee4c0>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:31.845769 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-7c6a3354-a889-4368-a1f0-99ac5d907deb tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] 10.222.0.33 "GET /compute/v2.1/images/dec1cfe6-6be8-4fc4-a82f-728708d575e6" status: 200 len: 1426 microversion: 2.1 time: 0.103927 Oct 04 20:40:31.847793 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 950/1808] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 20:40:31 2022] GET /compute/v2.1/images/dec1cfe6-6be8-4fc4-a82f-728708d575e6 => generated 1426 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:31.864460 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-74b5bfe8-ba9f-4956-94fb-1351fd8bc2d9 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:31.867514 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-74b5bfe8-ba9f-4956-94fb-1351fd8bc2d9 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] [instance: 53f0a355-8a5d-4775-a0d3-3aeedfc01570] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:31.875042 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e702342d-f10d-4d36-b8e6-3585051e380f tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673886dab3ed4cbd8a314386fbfbe39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f67490cfb798433eb86c006008c9aaa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:31.887359 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e702342d-f10d-4d36-b8e6-3585051e380f tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] 10.222.0.33 "GET /compute/v2.1/servers/6ff56299-ada5-4e73-9e68-59cdd48f8a16" status: 200 len: 1540 microversion: 2.1 time: 0.471656 Oct 04 20:40:31.892239 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-74b5bfe8-ba9f-4956-94fb-1351fd8bc2d9 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:31.895936 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-74b5bfe8-ba9f-4956-94fb-1351fd8bc2d9 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:31.898899 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-74b5bfe8-ba9f-4956-94fb-1351fd8bc2d9 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:31.900286 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-74b5bfe8-ba9f-4956-94fb-1351fd8bc2d9 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:31.910461 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 859/1809] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:40:31 2022] GET /compute/v2.1/servers/6ff56299-ada5-4e73-9e68-59cdd48f8a16 => generated 1540 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:31.915684 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f81c31a4-7126-4a28-814a-b1296d80c3dd tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:31.920714 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-74b5bfe8-ba9f-4956-94fb-1351fd8bc2d9 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:31.921620 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f81c31a4-7126-4a28-814a-b1296d80c3dd tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] [instance: 21de8a24-9cad-4f83-a459-5297200c20ad] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:31.922310 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-74b5bfe8-ba9f-4956-94fb-1351fd8bc2d9 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:31.935212 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f81c31a4-7126-4a28-814a-b1296d80c3dd tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:31.936018 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f81c31a4-7126-4a28-814a-b1296d80c3dd tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:31.936622 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f81c31a4-7126-4a28-814a-b1296d80c3dd tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:31.937586 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f81c31a4-7126-4a28-814a-b1296d80c3dd tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:31.938186 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f81c31a4-7126-4a28-814a-b1296d80c3dd tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:31.939715 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f81c31a4-7126-4a28-814a-b1296d80c3dd tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:31.990411 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-f81c31a4-7126-4a28-814a-b1296d80c3dd tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] HTTP exception thrown: Instance 21de8a24-9cad-4f83-a459-5297200c20ad could not be found. Oct 04 20:40:31.996288 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f81c31a4-7126-4a28-814a-b1296d80c3dd tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Request method failure captured: Oct 04 20:40:31.996288 n-d-854823-8 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/21de8a24-9cad-4f83-a459-5297200c20ad HTTP/1.1 Oct 04 20:40:31.996288 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:40:31.996288 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:40:31.996288 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:40:31.996288 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 0 Oct 04 20:40:31.996288 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:40:31.996288 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:40:31.996288 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:40:31.996288 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:40:31.996288 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJmeqrgxMn_vD-ao9MwjUJsz467_UAHW--vO2J2bMBYcsyRLhLo6Qj0nbEneOIdoi1LyiMNoKFQexjywspnMbrI5Aae3ew90UDzKQnlSm-j4NlsTEmvIdX9JuBz7NdY6Hhk6Az56PzRPsjCNW7LpLzJRfXCMnPsMFpfxnfuJgRzeSWg Oct 04 20:40:31.996288 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:40:31.996288 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:40:31.996288 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:40:31.996288 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:40:31.996288 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:40:31.996288 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:40:31.996288 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: 1a23a85365414f92bbc03177d7f190e6 Oct 04 20:40:31.996288 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-ServersOnMultiNodesTest-1191352258 Oct 04 20:40:31.996288 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 20:40:31.996288 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 20:40:31.996288 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_1a23a85365414f92bbc03177d7f190e6", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1a23a85365414f92bbc03177d7f190e6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1a23a85365414f92bbc03177d7f190e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/1a23a85365414f92bbc03177d7f190e6"}]}] Oct 04 20:40:31.996288 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-ServersOnMultiNodesTest-1191352258 Oct 04 20:40:31.996288 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: 1a23a85365414f92bbc03177d7f190e6 Oct 04 20:40:31.996288 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1191352258 Oct 04 20:40:31.996288 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-ServersOnMultiNodesTest-1191352258-project Oct 04 20:40:31.996288 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:40:31.996288 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:40:31.996288 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: e36f4114dc4f443f8b48da7b4027e0c1 Oct 04 20:40:31.996288 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-ServersOnMultiNodesTest-1191352258-project Oct 04 20:40:31.996288 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 20:40:31.996288 n-d-854823-8 devstack@n-api.service[128801]: exception: Instance 21de8a24-9cad-4f83-a459-5297200c20ad could not be found. Oct 04 20:40:31.996288 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': '21de8a24-9cad-4f83-a459-5297200c20ad'} Oct 04 20:40:31.996288 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:40:31.996288 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:40:31.996288 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:40:31.996288 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:40:31.996288 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:40:31.996288 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:40:31.996288 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:40:31.996288 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:40:31.996288 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:40:31.996288 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:40:31.996288 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21de8a24-9cad-4f83-a459-5297200c20ad could not be found. Oct 04 20:40:31.996288 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:40:31.996288 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:40:31.996288 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:40:31.996288 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:40:31.996288 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:40:31.996288 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:40:31.996288 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:40:31.996288 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:40:31.996288 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:40:31.996288 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:40:31.996288 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:40:31.996288 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:40:31.996288 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:40:31.996288 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:40:31.996288 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:40:31.996288 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:40:31.996288 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21de8a24-9cad-4f83-a459-5297200c20ad could not be found. Oct 04 20:40:31.996288 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:40:31.996288 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:40:31.996288 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:40:32.001717 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:40:32.001717 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:40:32.001717 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:40:32.001717 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:40:32.001717 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:40:32.001717 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21de8a24-9cad-4f83-a459-5297200c20ad could not be found. Oct 04 20:40:32.001717 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:40:32.006902 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f81c31a4-7126-4a28-814a-b1296d80c3dd tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Returning 404 to user: Instance 21de8a24-9cad-4f83-a459-5297200c20ad could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:40:32.007992 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f81c31a4-7126-4a28-814a-b1296d80c3dd tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] 10.222.0.33 "GET /compute/v2.1/servers/21de8a24-9cad-4f83-a459-5297200c20ad" status: 404 len: 111 microversion: 2.1 time: 0.096184 Oct 04 20:40:32.026994 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 860/1810] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:40:31 2022] GET /compute/v2.1/servers/21de8a24-9cad-4f83-a459-5297200c20ad => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:40:32.032281 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e4d14ff7-05f8-4768-9cd8-37776750d2e0 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:32.045888 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e4d14ff7-05f8-4768-9cd8-37776750d2e0 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] [instance: 81748c83-b703-4c68-899c-c575cc3340d2] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:32.072023 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e4d14ff7-05f8-4768-9cd8-37776750d2e0 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:32.075915 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e4d14ff7-05f8-4768-9cd8-37776750d2e0 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:32.087392 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e4d14ff7-05f8-4768-9cd8-37776750d2e0 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:32.094066 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e4d14ff7-05f8-4768-9cd8-37776750d2e0 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:32.094874 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e4d14ff7-05f8-4768-9cd8-37776750d2e0 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:32.095488 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e4d14ff7-05f8-4768-9cd8-37776750d2e0 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:33.132685 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-74b5bfe8-ba9f-4956-94fb-1351fd8bc2d9 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96919ec99c14864876d64a9c2b20f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b44ce10b78bf49c882c9b4df06187114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:33.137399 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=100 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:40:33.158955 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-74b5bfe8-ba9f-4956-94fb-1351fd8bc2d9 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] 10.222.0.33 "GET /compute/v2.1/servers/53f0a355-8a5d-4775-a0d3-3aeedfc01570" status: 200 len: 1505 microversion: 2.1 time: 1.300132 Oct 04 20:40:33.174490 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 951/1811] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:40:31 2022] GET /compute/v2.1/servers/53f0a355-8a5d-4775-a0d3-3aeedfc01570 => generated 1505 bytes in 1311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:33.174490 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-dc5aa6c8-17dc-409d-b55f-7b007927f312 tempest-FloatingIPsTestJSON-1592318220 tempest-FloatingIPsTestJSON-1592318220-project] Calling method '.version_select at 0x7f3c7899c0d0>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:33.308986 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e4d14ff7-05f8-4768-9cd8-37776750d2e0 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:33.345954 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e4d14ff7-05f8-4768-9cd8-37776750d2e0 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:33.348404 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e4d14ff7-05f8-4768-9cd8-37776750d2e0 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:33.353587 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e4d14ff7-05f8-4768-9cd8-37776750d2e0 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] 10.222.0.33 "GET /compute/v2.1/servers/81748c83-b703-4c68-899c-c575cc3340d2" status: 200 len: 1812 microversion: 2.25 time: 1.324019 Oct 04 20:40:33.376285 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 861/1812] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:40:32 2022] GET /compute/v2.1/servers/81748c83-b703-4c68-899c-c575cc3340d2 => generated 1812 bytes in 1348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:40:33.392587 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f92d4838-71a7-45d0-9f33-498d575b9d1c tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:33.398982 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f92d4838-71a7-45d0-9f33-498d575b9d1c tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] [instance: 6ff56299-ada5-4e73-9e68-59cdd48f8a16] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:33.409005 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f92d4838-71a7-45d0-9f33-498d575b9d1c tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:33.409839 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f92d4838-71a7-45d0-9f33-498d575b9d1c tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:33.410735 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f92d4838-71a7-45d0-9f33-498d575b9d1c tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:33.417216 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f92d4838-71a7-45d0-9f33-498d575b9d1c tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:33.418173 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f92d4838-71a7-45d0-9f33-498d575b9d1c tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:33.418834 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f92d4838-71a7-45d0-9f33-498d575b9d1c tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:33.842125 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:40:33.982207 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-dc5aa6c8-17dc-409d-b55f-7b007927f312 tempest-FloatingIPsTestJSON-1592318220 tempest-FloatingIPsTestJSON-1592318220-project] 10.222.0.33 "GET /compute/v2.1/os-floating-ips/0698397f-62eb-46dc-a501-1f4629f5adb6" status: 200 len: 142 microversion: 2.1 time: 0.820904 Oct 04 20:40:33.996557 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 952/1813] 10.222.0.33 () {58 vars in 1260 bytes} [Tue Oct 4 20:40:33 2022] GET /compute/v2.1/os-floating-ips/0698397f-62eb-46dc-a501-1f4629f5adb6 => generated 142 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:40:34.001985 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-b40d4b0c-e104-4a26-974d-2a83061db8b7 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:34.002728 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-b40d4b0c-e104-4a26-974d-2a83061db8b7 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] [instance: 286a7673-8323-4451-b329-4b33690e1c48] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:34.021066 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b40d4b0c-e104-4a26-974d-2a83061db8b7 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:34.021858 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b40d4b0c-e104-4a26-974d-2a83061db8b7 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:34.022677 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b40d4b0c-e104-4a26-974d-2a83061db8b7 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:34.023603 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b40d4b0c-e104-4a26-974d-2a83061db8b7 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:34.024232 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b40d4b0c-e104-4a26-974d-2a83061db8b7 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:34.024831 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b40d4b0c-e104-4a26-974d-2a83061db8b7 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:34.057394 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-b40d4b0c-e104-4a26-974d-2a83061db8b7 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] [instance: 286a7673-8323-4451-b329-4b33690e1c48] Going to try to terminate instance {{(pid=128802) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:40:34.081414 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f92d4838-71a7-45d0-9f33-498d575b9d1c tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] 10.222.0.33 "GET /compute/v2.1/servers/6ff56299-ada5-4e73-9e68-59cdd48f8a16/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.700036 Oct 04 20:40:34.082318 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 862/1814] 10.222.0.33 () {58 vars in 1275 bytes} [Tue Oct 4 20:40:33 2022] GET /compute/v2.1/servers/6ff56299-ada5-4e73-9e68-59cdd48f8a16/os-interface => generated 284 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:40:34.087517 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2c2cd8c5-0ccf-427a-b956-49419319082c tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:34.089094 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-2c2cd8c5-0ccf-427a-b956-49419319082c tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] [instance: fd12aa25-6dbc-4f92-a2e1-83ae94ab83b4] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:34.111060 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2c2cd8c5-0ccf-427a-b956-49419319082c tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:34.119471 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2c2cd8c5-0ccf-427a-b956-49419319082c tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:34.122849 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2c2cd8c5-0ccf-427a-b956-49419319082c tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:34.123832 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2c2cd8c5-0ccf-427a-b956-49419319082c tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:34.136529 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2c2cd8c5-0ccf-427a-b956-49419319082c tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:34.137250 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2c2cd8c5-0ccf-427a-b956-49419319082c tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:34.181070 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-b40d4b0c-e104-4a26-974d-2a83061db8b7 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] 10.222.0.33 "DELETE /compute/v2.1/servers/286a7673-8323-4451-b329-4b33690e1c48" status: 204 len: 0 microversion: 2.1 time: 0.182445 Oct 04 20:40:34.183441 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 953/1815] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 20:40:33 2022] DELETE /compute/v2.1/servers/286a7673-8323-4451-b329-4b33690e1c48 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:40:34.191663 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-65ee56d7-c21b-48a4-9594-c8b783b27a2e tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Calling method '.version_select at 0x7f3c745cc160>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:34.265560 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-65ee56d7-c21b-48a4-9594-c8b783b27a2e tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] 10.222.0.33 "GET /compute/v2.1/images/dec1cfe6-6be8-4fc4-a82f-728708d575e6" status: 200 len: 1426 microversion: 2.1 time: 0.080449 Oct 04 20:40:34.267653 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 954/1816] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 20:40:34 2022] GET /compute/v2.1/images/dec1cfe6-6be8-4fc4-a82f-728708d575e6 => generated 1426 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:34.278752 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-44203716-1206-48d8-8495-210e6e2ac9b2 tempest-FloatingIPsTestJSON-1592318220 tempest-FloatingIPsTestJSON-1592318220-project] Calling method '.version_select at 0x7f3c7899c280>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:35.565697 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-2c2cd8c5-0ccf-427a-b956-49419319082c tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a82c49a62249029ebc6ae3b4829709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecf3793be3eb4f3186c07a7e45fd8f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:35.577834 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-2c2cd8c5-0ccf-427a-b956-49419319082c tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] 10.222.0.33 "GET /compute/v2.1/servers/fd12aa25-6dbc-4f92-a2e1-83ae94ab83b4" status: 200 len: 1324 microversion: 2.1 time: 1.494130 Oct 04 20:40:35.582008 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 863/1817] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:40:34 2022] GET /compute/v2.1/servers/fd12aa25-6dbc-4f92-a2e1-83ae94ab83b4 => generated 1324 bytes in 1498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:35.600402 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7698f67b-59f2-427f-9403-d9059e51d1a9 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:35.603918 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-7698f67b-59f2-427f-9403-d9059e51d1a9 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] [instance: 53f0a355-8a5d-4775-a0d3-3aeedfc01570] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:35.630494 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7698f67b-59f2-427f-9403-d9059e51d1a9 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:35.634163 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7698f67b-59f2-427f-9403-d9059e51d1a9 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:35.635908 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7698f67b-59f2-427f-9403-d9059e51d1a9 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:35.636681 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7698f67b-59f2-427f-9403-d9059e51d1a9 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:35.637196 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7698f67b-59f2-427f-9403-d9059e51d1a9 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:35.651429 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7698f67b-59f2-427f-9403-d9059e51d1a9 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:36.214296 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-7698f67b-59f2-427f-9403-d9059e51d1a9 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96919ec99c14864876d64a9c2b20f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b44ce10b78bf49c882c9b4df06187114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:36.228093 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-7698f67b-59f2-427f-9403-d9059e51d1a9 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] 10.222.0.33 "GET /compute/v2.1/servers/53f0a355-8a5d-4775-a0d3-3aeedfc01570" status: 200 len: 1505 microversion: 2.1 time: 0.641465 Oct 04 20:40:36.228689 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 864/1818] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:40:35 2022] GET /compute/v2.1/servers/53f0a355-8a5d-4775-a0d3-3aeedfc01570 => generated 1505 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:36.241281 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1d88f0bd-bc6b-4c8f-962f-8ad8c5a728f8 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:36.243930 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-1d88f0bd-bc6b-4c8f-962f-8ad8c5a728f8 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] [instance: 286a7673-8323-4451-b329-4b33690e1c48] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:36.255709 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1d88f0bd-bc6b-4c8f-962f-8ad8c5a728f8 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:36.257341 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1d88f0bd-bc6b-4c8f-962f-8ad8c5a728f8 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:36.258014 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1d88f0bd-bc6b-4c8f-962f-8ad8c5a728f8 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:36.258951 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1d88f0bd-bc6b-4c8f-962f-8ad8c5a728f8 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:36.260844 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1d88f0bd-bc6b-4c8f-962f-8ad8c5a728f8 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:36.261484 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1d88f0bd-bc6b-4c8f-962f-8ad8c5a728f8 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:36.381955 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-44203716-1206-48d8-8495-210e6e2ac9b2 tempest-FloatingIPsTestJSON-1592318220 tempest-FloatingIPsTestJSON-1592318220-project] 10.222.0.33 "GET /compute/v2.1/os-floating-ips" status: 200 len: 145 microversion: 2.1 time: 2.111830 Oct 04 20:40:36.386447 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 955/1819] 10.222.0.33 () {58 vars in 1149 bytes} [Tue Oct 4 20:40:34 2022] GET /compute/v2.1/os-floating-ips => generated 145 bytes in 2117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:40:36.397600 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-e8084025-afff-40dc-bc44-4f2253ff8b69 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:36.401200 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-e8084025-afff-40dc-bc44-4f2253ff8b69 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] [instance: 81748c83-b703-4c68-899c-c575cc3340d2] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:36.416442 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e8084025-afff-40dc-bc44-4f2253ff8b69 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:36.417224 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e8084025-afff-40dc-bc44-4f2253ff8b69 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:36.418042 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e8084025-afff-40dc-bc44-4f2253ff8b69 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:36.419402 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e8084025-afff-40dc-bc44-4f2253ff8b69 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:36.420212 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e8084025-afff-40dc-bc44-4f2253ff8b69 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:36.420881 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e8084025-afff-40dc-bc44-4f2253ff8b69 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:36.725628 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-1d88f0bd-bc6b-4c8f-962f-8ad8c5a728f8 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36f4114dc4f443f8b48da7b4027e0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a23a85365414f92bbc03177d7f190e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:36.741032 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-1d88f0bd-bc6b-4c8f-962f-8ad8c5a728f8 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] 10.222.0.33 "GET /compute/v2.1/servers/286a7673-8323-4451-b329-4b33690e1c48" status: 200 len: 1471 microversion: 2.1 time: 0.500509 Oct 04 20:40:36.741994 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 865/1820] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:40:36 2022] GET /compute/v2.1/servers/286a7673-8323-4451-b329-4b33690e1c48 => generated 1471 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:36.759113 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-64295ecd-b8cb-4cfa-9300-b1047e5f7b9f req-4b1728ff-56b3-4bfe-b14e-c94d939a6caf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd12aa25-6dbc-4f92-a2e1-83ae94ab83b4", "tag": "277f1cea-7772-4f31-88f2-7e690a93cf8f"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:40:36.770291 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-64295ecd-b8cb-4cfa-9300-b1047e5f7b9f req-4b1728ff-56b3-4bfe-b14e-c94d939a6caf service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:36.771105 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-64295ecd-b8cb-4cfa-9300-b1047e5f7b9f req-4b1728ff-56b3-4bfe-b14e-c94d939a6caf service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:36.771700 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-64295ecd-b8cb-4cfa-9300-b1047e5f7b9f req-4b1728ff-56b3-4bfe-b14e-c94d939a6caf service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:36.786462 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-e8084025-afff-40dc-bc44-4f2253ff8b69 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:36.789504 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-64295ecd-b8cb-4cfa-9300-b1047e5f7b9f req-4b1728ff-56b3-4bfe-b14e-c94d939a6caf service nova] Creating event network-changed:277f1cea-7772-4f31-88f2-7e690a93cf8f for instance fd12aa25-6dbc-4f92-a2e1-83ae94ab83b4 on n-h1-854823-8 Oct 04 20:40:36.796062 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-e8084025-afff-40dc-bc44-4f2253ff8b69 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:36.803930 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-64295ecd-b8cb-4cfa-9300-b1047e5f7b9f req-4b1728ff-56b3-4bfe-b14e-c94d939a6caf service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056071 Oct 04 20:40:36.804548 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 866/1821] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:40:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:40:36.807897 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-e8084025-afff-40dc-bc44-4f2253ff8b69 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:36.809123 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-e8084025-afff-40dc-bc44-4f2253ff8b69 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] 10.222.0.33 "GET /compute/v2.1/servers/81748c83-b703-4c68-899c-c575cc3340d2" status: 200 len: 1812 microversion: 2.25 time: 0.420973 Oct 04 20:40:36.809674 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 956/1822] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:40:36 2022] GET /compute/v2.1/servers/81748c83-b703-4c68-899c-c575cc3340d2 => generated 1812 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:40:36.810987 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b363c958-f6a9-496b-9004-0a07f336c8c9 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Calling method '.version_select at 0x7f3c7888f430>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:36.814395 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-1573813e-2e7a-4eb3-8b16-2ed6b0373389 tempest-FloatingIPsTestJSON-1592318220 tempest-FloatingIPsTestJSON-1592318220-project] Calling method '.version_select at 0x7f3c7461f670>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:36.906328 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b363c958-f6a9-496b-9004-0a07f336c8c9 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] 10.222.0.33 "GET /compute/v2.1/images/dec1cfe6-6be8-4fc4-a82f-728708d575e6" status: 200 len: 1426 microversion: 2.1 time: 0.100326 Oct 04 20:40:36.921383 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 867/1823] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 20:40:36 2022] GET /compute/v2.1/images/dec1cfe6-6be8-4fc4-a82f-728708d575e6 => generated 1426 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:36.937404 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-51d07983-6286-4062-8b27-60c3c459c54f tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:36.939028 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-51d07983-6286-4062-8b27-60c3c459c54f tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] [instance: fd12aa25-6dbc-4f92-a2e1-83ae94ab83b4] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:36.960589 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-51d07983-6286-4062-8b27-60c3c459c54f tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:36.961387 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-51d07983-6286-4062-8b27-60c3c459c54f tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:36.962252 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-51d07983-6286-4062-8b27-60c3c459c54f tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:36.963187 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-51d07983-6286-4062-8b27-60c3c459c54f tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:36.963844 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-51d07983-6286-4062-8b27-60c3c459c54f tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:36.964442 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-51d07983-6286-4062-8b27-60c3c459c54f tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:38.020326 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell0:SELECT=2 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:40:38.068033 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell0:SELECT=6 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:40:38.131078 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-51d07983-6286-4062-8b27-60c3c459c54f tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a82c49a62249029ebc6ae3b4829709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecf3793be3eb4f3186c07a7e45fd8f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:38.145034 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-51d07983-6286-4062-8b27-60c3c459c54f tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] 10.222.0.33 "GET /compute/v2.1/servers/fd12aa25-6dbc-4f92-a2e1-83ae94ab83b4" status: 200 len: 1324 microversion: 2.1 time: 1.222232 Oct 04 20:40:38.146195 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 868/1824] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:40:36 2022] GET /compute/v2.1/servers/fd12aa25-6dbc-4f92-a2e1-83ae94ab83b4 => generated 1324 bytes in 1224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:38.153570 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-52238e99-3f89-461a-ae7c-0ae85797f70e tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:38.156089 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-52238e99-3f89-461a-ae7c-0ae85797f70e tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] [instance: 53f0a355-8a5d-4775-a0d3-3aeedfc01570] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:38.168874 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-52238e99-3f89-461a-ae7c-0ae85797f70e tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:38.170793 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-52238e99-3f89-461a-ae7c-0ae85797f70e tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:38.171408 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-52238e99-3f89-461a-ae7c-0ae85797f70e tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:38.174504 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-52238e99-3f89-461a-ae7c-0ae85797f70e tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:38.175198 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-52238e99-3f89-461a-ae7c-0ae85797f70e tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:38.178126 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-52238e99-3f89-461a-ae7c-0ae85797f70e tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:38.831412 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-52238e99-3f89-461a-ae7c-0ae85797f70e tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96919ec99c14864876d64a9c2b20f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b44ce10b78bf49c882c9b4df06187114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:38.846748 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-52238e99-3f89-461a-ae7c-0ae85797f70e tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] 10.222.0.33 "GET /compute/v2.1/servers/53f0a355-8a5d-4775-a0d3-3aeedfc01570" status: 200 len: 1505 microversion: 2.1 time: 0.699229 Oct 04 20:40:38.849569 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 869/1825] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:40:38 2022] GET /compute/v2.1/servers/53f0a355-8a5d-4775-a0d3-3aeedfc01570 => generated 1505 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:38.855271 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-bd3278e6-201e-4826-8748-43da5e2e18bb tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:38.856190 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-bd3278e6-201e-4826-8748-43da5e2e18bb tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] [instance: 286a7673-8323-4451-b329-4b33690e1c48] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:38.864401 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bd3278e6-201e-4826-8748-43da5e2e18bb tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:38.865293 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bd3278e6-201e-4826-8748-43da5e2e18bb tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:38.865961 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bd3278e6-201e-4826-8748-43da5e2e18bb tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:38.867202 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bd3278e6-201e-4826-8748-43da5e2e18bb tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:38.868025 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bd3278e6-201e-4826-8748-43da5e2e18bb tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:38.868693 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bd3278e6-201e-4826-8748-43da5e2e18bb tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:38.989596 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-bd3278e6-201e-4826-8748-43da5e2e18bb tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36f4114dc4f443f8b48da7b4027e0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a23a85365414f92bbc03177d7f190e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:39.032747 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-bd3278e6-201e-4826-8748-43da5e2e18bb tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] 10.222.0.33 "GET /compute/v2.1/servers/286a7673-8323-4451-b329-4b33690e1c48" status: 200 len: 1429 microversion: 2.1 time: 0.181770 Oct 04 20:40:39.033356 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 870/1826] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:40:38 2022] GET /compute/v2.1/servers/286a7673-8323-4451-b329-4b33690e1c48 => generated 1429 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:39.062839 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6b53faa0-e356-42a0-afa3-b39debe8d6bb tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:39.069523 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-6b53faa0-e356-42a0-afa3-b39debe8d6bb tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] [instance: 81748c83-b703-4c68-899c-c575cc3340d2] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:39.085401 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6b53faa0-e356-42a0-afa3-b39debe8d6bb tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:39.085887 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6b53faa0-e356-42a0-afa3-b39debe8d6bb tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:39.086321 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6b53faa0-e356-42a0-afa3-b39debe8d6bb tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:39.087306 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6b53faa0-e356-42a0-afa3-b39debe8d6bb tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:39.087755 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6b53faa0-e356-42a0-afa3-b39debe8d6bb tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:39.088178 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6b53faa0-e356-42a0-afa3-b39debe8d6bb tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:39.883358 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-6b53faa0-e356-42a0-afa3-b39debe8d6bb tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:39.901194 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-6b53faa0-e356-42a0-afa3-b39debe8d6bb tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:39.910823 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-6b53faa0-e356-42a0-afa3-b39debe8d6bb tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:39.915274 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-6b53faa0-e356-42a0-afa3-b39debe8d6bb tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] 10.222.0.33 "GET /compute/v2.1/servers/81748c83-b703-4c68-899c-c575cc3340d2" status: 200 len: 1812 microversion: 2.25 time: 0.856067 Oct 04 20:40:39.920229 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 871/1827] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:40:39 2022] GET /compute/v2.1/servers/81748c83-b703-4c68-899c-c575cc3340d2 => generated 1812 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:40:39.935168 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2d27c1e7-a21c-4f15-b614-300f8cf1f15a tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Calling method '.version_select at 0x7f3c7888f940>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:39.964183 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-1573813e-2e7a-4eb3-8b16-2ed6b0373389 tempest-FloatingIPsTestJSON-1592318220 tempest-FloatingIPsTestJSON-1592318220-project] 10.222.0.33 "DELETE /compute/v2.1/os-floating-ips/0698397f-62eb-46dc-a501-1f4629f5adb6" status: 202 len: 0 microversion: 2.1 time: 3.153215 Oct 04 20:40:39.965267 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 957/1828] 10.222.0.33 () {58 vars in 1263 bytes} [Tue Oct 4 20:40:36 2022] DELETE /compute/v2.1/os-floating-ips/0698397f-62eb-46dc-a501-1f4629f5adb6 => generated 0 bytes in 3155 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:40:39.970571 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-6b533642-0216-48b3-96f9-dd7d78137bcd req-89391f2a-bce2-4cfb-a532-486d781c2c56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "286a7673-8323-4451-b329-4b33690e1c48", "name": "network-vif-deleted", "tag": "ffee23db-b749-4944-8249-c57f4f15636e"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:40:40.002770 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-6b533642-0216-48b3-96f9-dd7d78137bcd req-89391f2a-bce2-4cfb-a532-486d781c2c56 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:40.003962 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-6b533642-0216-48b3-96f9-dd7d78137bcd req-89391f2a-bce2-4cfb-a532-486d781c2c56 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:40.004784 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-6b533642-0216-48b3-96f9-dd7d78137bcd req-89391f2a-bce2-4cfb-a532-486d781c2c56 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:40.018413 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-6b533642-0216-48b3-96f9-dd7d78137bcd req-89391f2a-bce2-4cfb-a532-486d781c2c56 service nova] Creating event network-vif-deleted:ffee23db-b749-4944-8249-c57f4f15636e for instance 286a7673-8323-4451-b329-4b33690e1c48 on n-h2-854823-8 Oct 04 20:40:40.025253 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-6b533642-0216-48b3-96f9-dd7d78137bcd req-89391f2a-bce2-4cfb-a532-486d781c2c56 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058752 Oct 04 20:40:40.026437 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-2d27c1e7-a21c-4f15-b614-300f8cf1f15a tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] 10.222.0.33 "GET /compute/v2.1/images/dec1cfe6-6be8-4fc4-a82f-728708d575e6" status: 200 len: 1426 microversion: 2.1 time: 0.104572 Oct 04 20:40:40.027935 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 872/1829] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 20:40:39 2022] GET /compute/v2.1/images/dec1cfe6-6be8-4fc4-a82f-728708d575e6 => generated 1426 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:40.032687 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 958/1830] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:40:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:40:40.037784 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-611b82b3-6966-457c-8afc-edb601e84791 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:40.038930 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-bfa83c99-0998-48a2-b0e0-67c9b5d190d1 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:40.039829 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-bfa83c99-0998-48a2-b0e0-67c9b5d190d1 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] [instance: 53f0a355-8a5d-4775-a0d3-3aeedfc01570] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:40.042990 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-611b82b3-6966-457c-8afc-edb601e84791 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] [instance: fd12aa25-6dbc-4f92-a2e1-83ae94ab83b4] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:40.049248 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bfa83c99-0998-48a2-b0e0-67c9b5d190d1 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:40.052120 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bfa83c99-0998-48a2-b0e0-67c9b5d190d1 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:40.052756 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bfa83c99-0998-48a2-b0e0-67c9b5d190d1 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:40.053666 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bfa83c99-0998-48a2-b0e0-67c9b5d190d1 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:40.054436 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bfa83c99-0998-48a2-b0e0-67c9b5d190d1 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:40.055316 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bfa83c99-0998-48a2-b0e0-67c9b5d190d1 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:40.059654 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-611b82b3-6966-457c-8afc-edb601e84791 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:40.060278 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-611b82b3-6966-457c-8afc-edb601e84791 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:40.061998 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-611b82b3-6966-457c-8afc-edb601e84791 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:40.063318 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-611b82b3-6966-457c-8afc-edb601e84791 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:40.066233 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-611b82b3-6966-457c-8afc-edb601e84791 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:40.067939 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-611b82b3-6966-457c-8afc-edb601e84791 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:40.352334 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-bfa83c99-0998-48a2-b0e0-67c9b5d190d1 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96919ec99c14864876d64a9c2b20f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b44ce10b78bf49c882c9b4df06187114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:40.365916 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-bfa83c99-0998-48a2-b0e0-67c9b5d190d1 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] 10.222.0.33 "GET /compute/v2.1/servers/53f0a355-8a5d-4775-a0d3-3aeedfc01570" status: 200 len: 1505 microversion: 2.1 time: 0.331605 Oct 04 20:40:40.367103 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 959/1831] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:40:40 2022] GET /compute/v2.1/servers/53f0a355-8a5d-4775-a0d3-3aeedfc01570 => generated 1505 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:40.373122 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-600ed80f-de54-423e-a14e-5501a8a524fc tempest-FloatingIPsTestJSON-1592318220 tempest-FloatingIPsTestJSON-1592318220-project] Action: 'create', calling method: .version_select at 0x7f3c7461fee0>, body: {"pool": null} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:40:40.421866 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-611b82b3-6966-457c-8afc-edb601e84791 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a82c49a62249029ebc6ae3b4829709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecf3793be3eb4f3186c07a7e45fd8f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:40.436430 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-611b82b3-6966-457c-8afc-edb601e84791 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] 10.222.0.33 "GET /compute/v2.1/servers/fd12aa25-6dbc-4f92-a2e1-83ae94ab83b4" status: 200 len: 1324 microversion: 2.1 time: 0.405287 Oct 04 20:40:40.437715 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 873/1832] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:40:40 2022] GET /compute/v2.1/servers/fd12aa25-6dbc-4f92-a2e1-83ae94ab83b4 => generated 1324 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:40.447362 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2d9d5e74-306c-4dbd-a72e-6227d7e85adf tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:40.449900 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-2d9d5e74-306c-4dbd-a72e-6227d7e85adf tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] [instance: 286a7673-8323-4451-b329-4b33690e1c48] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:40.462504 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2d9d5e74-306c-4dbd-a72e-6227d7e85adf tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:40.463265 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2d9d5e74-306c-4dbd-a72e-6227d7e85adf tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:40.463885 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2d9d5e74-306c-4dbd-a72e-6227d7e85adf tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:40.465658 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2d9d5e74-306c-4dbd-a72e-6227d7e85adf tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:40.466324 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2d9d5e74-306c-4dbd-a72e-6227d7e85adf tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:40.468481 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2d9d5e74-306c-4dbd-a72e-6227d7e85adf tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:40.517764 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2d9d5e74-306c-4dbd-a72e-6227d7e85adf tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:40.521057 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2d9d5e74-306c-4dbd-a72e-6227d7e85adf tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:40.521681 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2d9d5e74-306c-4dbd-a72e-6227d7e85adf tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:40.522595 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-2d9d5e74-306c-4dbd-a72e-6227d7e85adf tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lazy-loading 'fault' on Instance uuid 286a7673-8323-4451-b329-4b33690e1c48 {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:40:40.623689 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-2d9d5e74-306c-4dbd-a72e-6227d7e85adf tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36f4114dc4f443f8b48da7b4027e0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a23a85365414f92bbc03177d7f190e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:40.640324 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-2d9d5e74-306c-4dbd-a72e-6227d7e85adf tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] 10.222.0.33 "GET /compute/v2.1/servers/286a7673-8323-4451-b329-4b33690e1c48" status: 200 len: 1305 microversion: 2.1 time: 0.200614 Oct 04 20:40:40.675000 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 874/1833] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:40:40 2022] GET /compute/v2.1/servers/286a7673-8323-4451-b329-4b33690e1c48 => generated 1305 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:40.950005 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-37d7e263-5ede-4ec1-819b-3b8905dafc62 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:40.951696 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-37d7e263-5ede-4ec1-819b-3b8905dafc62 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] [instance: 81748c83-b703-4c68-899c-c575cc3340d2] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:40.959500 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-37d7e263-5ede-4ec1-819b-3b8905dafc62 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:40.959986 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-37d7e263-5ede-4ec1-819b-3b8905dafc62 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:40.960626 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-37d7e263-5ede-4ec1-819b-3b8905dafc62 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:40.961365 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-37d7e263-5ede-4ec1-819b-3b8905dafc62 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:40.962070 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-37d7e263-5ede-4ec1-819b-3b8905dafc62 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:40.962550 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-37d7e263-5ede-4ec1-819b-3b8905dafc62 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:40.987312 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:40:41.315859 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-37d7e263-5ede-4ec1-819b-3b8905dafc62 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:41.325004 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-37d7e263-5ede-4ec1-819b-3b8905dafc62 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:41.326484 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-37d7e263-5ede-4ec1-819b-3b8905dafc62 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:41.327655 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-37d7e263-5ede-4ec1-819b-3b8905dafc62 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] 10.222.0.33 "GET /compute/v2.1/servers/81748c83-b703-4c68-899c-c575cc3340d2" status: 200 len: 1802 microversion: 2.25 time: 0.382321 Oct 04 20:40:41.328228 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 875/1834] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:40:40 2022] GET /compute/v2.1/servers/81748c83-b703-4c68-899c-c575cc3340d2 => generated 1802 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:40:41.333322 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8abe5171-bf4b-48b3-a764-7571ca857e72 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Calling method '.version_select at 0x7f3c7893a4c0>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:41.379616 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-8abe5171-bf4b-48b3-a764-7571ca857e72 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] 10.222.0.33 "GET /compute/v2.1/images/dec1cfe6-6be8-4fc4-a82f-728708d575e6" status: 200 len: 1435 microversion: 2.1 time: 0.050318 Oct 04 20:40:41.380220 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 876/1835] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 20:40:41 2022] GET /compute/v2.1/images/dec1cfe6-6be8-4fc4-a82f-728708d575e6 => generated 1435 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:41.384492 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-61449c2b-a0c0-47f3-8bc0-062695d32e15 tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] Calling method '.version_select at 0x7f3c7888fd30>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:41.387757 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-61449c2b-a0c0-47f3-8bc0-062695d32e15 tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:41.388233 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-61449c2b-a0c0-47f3-8bc0-062695d32e15 tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:41.388660 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-61449c2b-a0c0-47f3-8bc0-062695d32e15 tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:41.399969 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-61449c2b-a0c0-47f3-8bc0-062695d32e15 tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] 10.222.0.33 "GET /compute/v2.1/os-migrations" status: 200 len: 2360 microversion: 2.25 time: 0.018776 Oct 04 20:40:41.400585 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 877/1836] 10.222.0.33 () {60 vars in 1184 bytes} [Tue Oct 4 20:40:41 2022] GET /compute/v2.1/os-migrations => generated 2360 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:40:41.404950 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e50e1565-6fd9-42de-a461-1f3b1a7285ae tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:41.405547 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e50e1565-6fd9-42de-a461-1f3b1a7285ae tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] [instance: 53f0a355-8a5d-4775-a0d3-3aeedfc01570] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:41.411785 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e50e1565-6fd9-42de-a461-1f3b1a7285ae tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:41.412268 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e50e1565-6fd9-42de-a461-1f3b1a7285ae tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:41.412699 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e50e1565-6fd9-42de-a461-1f3b1a7285ae tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:41.413395 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e50e1565-6fd9-42de-a461-1f3b1a7285ae tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:41.413870 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e50e1565-6fd9-42de-a461-1f3b1a7285ae tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:41.414289 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e50e1565-6fd9-42de-a461-1f3b1a7285ae tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:41.660486 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e50e1565-6fd9-42de-a461-1f3b1a7285ae tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96919ec99c14864876d64a9c2b20f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b44ce10b78bf49c882c9b4df06187114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:41.670457 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e50e1565-6fd9-42de-a461-1f3b1a7285ae tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] 10.222.0.33 "GET /compute/v2.1/servers/53f0a355-8a5d-4775-a0d3-3aeedfc01570" status: 200 len: 1505 microversion: 2.1 time: 0.268451 Oct 04 20:40:41.671029 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 878/1837] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:40:41 2022] GET /compute/v2.1/servers/53f0a355-8a5d-4775-a0d3-3aeedfc01570 => generated 1505 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:41.677297 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-782a5276-9bea-435d-bdae-aad9249cf61a tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Calling method '.version_select at 0x7f3c788ae550>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:41.760102 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-782a5276-9bea-435d-bdae-aad9249cf61a tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] 10.222.0.33 "GET /compute/v2.1/images/dec1cfe6-6be8-4fc4-a82f-728708d575e6" status: 200 len: 1435 microversion: 2.1 time: 0.087858 Oct 04 20:40:41.760754 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 879/1838] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 20:40:41 2022] GET /compute/v2.1/images/dec1cfe6-6be8-4fc4-a82f-728708d575e6 => generated 1435 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:41.765040 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-892d58fa-42bb-415c-9e22-cb1aaafe8138 tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:41.766028 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-892d58fa-42bb-415c-9e22-cb1aaafe8138 tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] [instance: 81748c83-b703-4c68-899c-c575cc3340d2] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:41.773562 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-892d58fa-42bb-415c-9e22-cb1aaafe8138 tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:41.774133 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-892d58fa-42bb-415c-9e22-cb1aaafe8138 tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:41.774658 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-892d58fa-42bb-415c-9e22-cb1aaafe8138 tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:41.775591 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-892d58fa-42bb-415c-9e22-cb1aaafe8138 tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:41.776387 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-892d58fa-42bb-415c-9e22-cb1aaafe8138 tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:41.776877 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-892d58fa-42bb-415c-9e22-cb1aaafe8138 tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:41.993257 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-892d58fa-42bb-415c-9e22-cb1aaafe8138 tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] Lazy-loading 'services' on Instance uuid 81748c83-b703-4c68-899c-c575cc3340d2 {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:40:42.019822 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-892d58fa-42bb-415c-9e22-cb1aaafe8138 tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/81748c83-b703-4c68-899c-c575cc3340d2" status: 200 len: 2420 microversion: 2.25 time: 0.257856 Oct 04 20:40:42.021126 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 880/1839] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:40:41 2022] GET /compute/v2.1/servers/81748c83-b703-4c68-899c-c575cc3340d2 => generated 2420 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:40:42.026930 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b3684d36-e18f-4e8c-a32a-8843aec3f149 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:42.027533 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b3684d36-e18f-4e8c-a32a-8843aec3f149 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] [instance: fd12aa25-6dbc-4f92-a2e1-83ae94ab83b4] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:42.033825 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b3684d36-e18f-4e8c-a32a-8843aec3f149 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:42.034308 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b3684d36-e18f-4e8c-a32a-8843aec3f149 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:42.034760 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b3684d36-e18f-4e8c-a32a-8843aec3f149 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:42.035845 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b3684d36-e18f-4e8c-a32a-8843aec3f149 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:42.036858 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b3684d36-e18f-4e8c-a32a-8843aec3f149 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:42.037429 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b3684d36-e18f-4e8c-a32a-8843aec3f149 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:42.298458 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-b3684d36-e18f-4e8c-a32a-8843aec3f149 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a82c49a62249029ebc6ae3b4829709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecf3793be3eb4f3186c07a7e45fd8f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:42.306432 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b3684d36-e18f-4e8c-a32a-8843aec3f149 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] 10.222.0.33 "GET /compute/v2.1/servers/fd12aa25-6dbc-4f92-a2e1-83ae94ab83b4" status: 200 len: 1324 microversion: 2.1 time: 0.283774 Oct 04 20:40:42.307161 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 881/1840] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:40:42 2022] GET /compute/v2.1/servers/fd12aa25-6dbc-4f92-a2e1-83ae94ab83b4 => generated 1324 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:42.312290 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-3b39c45b-ab8c-4d71-957f-22b82d74db01 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:42.313024 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-3b39c45b-ab8c-4d71-957f-22b82d74db01 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] [instance: 286a7673-8323-4451-b329-4b33690e1c48] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:42.318869 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3b39c45b-ab8c-4d71-957f-22b82d74db01 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:42.319469 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3b39c45b-ab8c-4d71-957f-22b82d74db01 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:42.320029 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3b39c45b-ab8c-4d71-957f-22b82d74db01 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:42.320844 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3b39c45b-ab8c-4d71-957f-22b82d74db01 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:42.321436 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3b39c45b-ab8c-4d71-957f-22b82d74db01 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:42.321961 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3b39c45b-ab8c-4d71-957f-22b82d74db01 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:42.335634 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-3b39c45b-ab8c-4d71-957f-22b82d74db01 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] HTTP exception thrown: Instance 286a7673-8323-4451-b329-4b33690e1c48 could not be found. Oct 04 20:40:42.337539 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-3b39c45b-ab8c-4d71-957f-22b82d74db01 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Request method failure captured: Oct 04 20:40:42.337539 n-d-854823-8 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/286a7673-8323-4451-b329-4b33690e1c48 HTTP/1.1 Oct 04 20:40:42.337539 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:40:42.337539 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:40:42.337539 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:40:42.337539 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 0 Oct 04 20:40:42.337539 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:40:42.337539 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:40:42.337539 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:40:42.337539 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:40:42.337539 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJmeqrgxMn_vD-ao9MwjUJsz467_UAHW--vO2J2bMBYcsyRLhLo6Qj0nbEneOIdoi1LyiMNoKFQexjywspnMbrI5Aae3ew90UDzKQnlSm-j4NlsTEmvIdX9JuBz7NdY6Hhk6Az56PzRPsjCNW7LpLzJRfXCMnPsMFpfxnfuJgRzeSWg Oct 04 20:40:42.337539 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:40:42.337539 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:40:42.337539 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:40:42.337539 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:40:42.337539 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:40:42.337539 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:40:42.337539 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: 1a23a85365414f92bbc03177d7f190e6 Oct 04 20:40:42.337539 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-ServersOnMultiNodesTest-1191352258 Oct 04 20:40:42.337539 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 20:40:42.337539 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 20:40:42.337539 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_1a23a85365414f92bbc03177d7f190e6", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1a23a85365414f92bbc03177d7f190e6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1a23a85365414f92bbc03177d7f190e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/1a23a85365414f92bbc03177d7f190e6"}]}] Oct 04 20:40:42.337539 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-ServersOnMultiNodesTest-1191352258 Oct 04 20:40:42.337539 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: 1a23a85365414f92bbc03177d7f190e6 Oct 04 20:40:42.337539 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1191352258 Oct 04 20:40:42.337539 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-ServersOnMultiNodesTest-1191352258-project Oct 04 20:40:42.337539 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:40:42.337539 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:40:42.337539 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: e36f4114dc4f443f8b48da7b4027e0c1 Oct 04 20:40:42.337539 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-ServersOnMultiNodesTest-1191352258-project Oct 04 20:40:42.337539 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 20:40:42.337539 n-d-854823-8 devstack@n-api.service[128801]: exception: Instance 286a7673-8323-4451-b329-4b33690e1c48 could not be found. Oct 04 20:40:42.337539 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': '286a7673-8323-4451-b329-4b33690e1c48'} Oct 04 20:40:42.337539 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:40:42.337539 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:40:42.337539 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:40:42.337539 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:40:42.337539 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:40:42.337539 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:40:42.337539 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:40:42.337539 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:40:42.337539 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:40:42.337539 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:40:42.337539 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 286a7673-8323-4451-b329-4b33690e1c48 could not be found. Oct 04 20:40:42.337539 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:40:42.337539 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:40:42.337539 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:40:42.337539 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:40:42.337539 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:40:42.337539 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:40:42.337539 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:40:42.337539 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:40:42.337539 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:40:42.337539 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:40:42.337539 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:40:42.337539 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:40:42.337539 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:40:42.337539 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:40:42.337539 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:40:42.337539 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:40:42.337539 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 286a7673-8323-4451-b329-4b33690e1c48 could not be found. Oct 04 20:40:42.337539 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:40:42.337539 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:40:42.337539 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:40:42.342833 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:40:42.342833 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:40:42.342833 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:40:42.342833 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:40:42.342833 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:40:42.342833 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 286a7673-8323-4451-b329-4b33690e1c48 could not be found. Oct 04 20:40:42.342833 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:40:42.342833 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-3b39c45b-ab8c-4d71-957f-22b82d74db01 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Returning 404 to user: Instance 286a7673-8323-4451-b329-4b33690e1c48 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:40:42.342833 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-3b39c45b-ab8c-4d71-957f-22b82d74db01 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] 10.222.0.33 "GET /compute/v2.1/servers/286a7673-8323-4451-b329-4b33690e1c48" status: 404 len: 111 microversion: 2.1 time: 0.032580 Oct 04 20:40:42.346371 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 882/1841] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:40:42 2022] GET /compute/v2.1/servers/286a7673-8323-4451-b329-4b33690e1c48 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:40:42.350946 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6fc37ad3-19fc-46d3-995f-eedac56174ab tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:42.351561 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-6fc37ad3-19fc-46d3-995f-eedac56174ab tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] [instance: 0dd1d0cf-a3a0-4ea2-8260-ac206bbfac88] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:42.354009 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-600ed80f-de54-423e-a14e-5501a8a524fc tempest-FloatingIPsTestJSON-1592318220 tempest-FloatingIPsTestJSON-1592318220-project] 10.222.0.33 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 1.985198 Oct 04 20:40:42.354797 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 960/1842] 10.222.0.33 () {60 vars in 1170 bytes} [Tue Oct 4 20:40:40 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 1986 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:40:42.357523 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6fc37ad3-19fc-46d3-995f-eedac56174ab tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:42.358012 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6fc37ad3-19fc-46d3-995f-eedac56174ab tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:42.358533 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6fc37ad3-19fc-46d3-995f-eedac56174ab tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:42.359233 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6fc37ad3-19fc-46d3-995f-eedac56174ab tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:42.359436 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-a4e3cb67-36e7-4b2b-9dfd-83a695d6f50f req-61ad96ea-4bf6-4656-ba76-a2fd7a2534b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ff56299-ada5-4e73-9e68-59cdd48f8a16", "tag": "8639aac2-0a5a-4a66-92f5-712c9424eedf"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:40:42.359693 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6fc37ad3-19fc-46d3-995f-eedac56174ab tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:42.360119 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6fc37ad3-19fc-46d3-995f-eedac56174ab tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:42.370885 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-a4e3cb67-36e7-4b2b-9dfd-83a695d6f50f req-61ad96ea-4bf6-4656-ba76-a2fd7a2534b4 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:42.371495 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-a4e3cb67-36e7-4b2b-9dfd-83a695d6f50f req-61ad96ea-4bf6-4656-ba76-a2fd7a2534b4 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:42.371923 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-a4e3cb67-36e7-4b2b-9dfd-83a695d6f50f req-61ad96ea-4bf6-4656-ba76-a2fd7a2534b4 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:42.382246 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-a4e3cb67-36e7-4b2b-9dfd-83a695d6f50f req-61ad96ea-4bf6-4656-ba76-a2fd7a2534b4 service nova] Creating event network-changed:8639aac2-0a5a-4a66-92f5-712c9424eedf for instance 6ff56299-ada5-4e73-9e68-59cdd48f8a16 on n-h1-854823-8 Oct 04 20:40:42.387298 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-a4e3cb67-36e7-4b2b-9dfd-83a695d6f50f req-61ad96ea-4bf6-4656-ba76-a2fd7a2534b4 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031264 Oct 04 20:40:42.388100 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 961/1843] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:40:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:40:42.393175 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-390e3e50-823d-490a-b453-2dd79c63347b tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:42.393864 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-390e3e50-823d-490a-b453-2dd79c63347b tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] [instance: 81748c83-b703-4c68-899c-c575cc3340d2] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:42.400834 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-390e3e50-823d-490a-b453-2dd79c63347b tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:42.401314 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-390e3e50-823d-490a-b453-2dd79c63347b tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:42.401740 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-390e3e50-823d-490a-b453-2dd79c63347b tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:42.402773 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-390e3e50-823d-490a-b453-2dd79c63347b tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:42.403388 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-390e3e50-823d-490a-b453-2dd79c63347b tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:42.403979 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-390e3e50-823d-490a-b453-2dd79c63347b tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:42.649329 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-6fc37ad3-19fc-46d3-995f-eedac56174ab tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bdfa818206f4f4b88cc962c1c34adf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4151c9ef7ae04a728306297f58ba5088', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:42.659132 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-6fc37ad3-19fc-46d3-995f-eedac56174ab tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] 10.222.0.33 "GET /compute/v2.1/servers/0dd1d0cf-a3a0-4ea2-8260-ac206bbfac88" status: 200 len: 1467 microversion: 2.1 time: 0.311126 Oct 04 20:40:42.659831 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 883/1844] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:40:42 2022] GET /compute/v2.1/servers/0dd1d0cf-a3a0-4ea2-8260-ac206bbfac88 => generated 1467 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:42.674806 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-67fec523-043e-4fcf-a853-f67c3d960c77 req-fab9ca20-42f7-4752-b9f0-6a43021c676e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd12aa25-6dbc-4f92-a2e1-83ae94ab83b4", "name": "network-vif-plugged", "status": "completed", "tag": "277f1cea-7772-4f31-88f2-7e690a93cf8f"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:40:42.688051 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-67fec523-043e-4fcf-a853-f67c3d960c77 req-fab9ca20-42f7-4752-b9f0-6a43021c676e service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:42.688648 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-67fec523-043e-4fcf-a853-f67c3d960c77 req-fab9ca20-42f7-4752-b9f0-6a43021c676e service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:42.689279 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-67fec523-043e-4fcf-a853-f67c3d960c77 req-fab9ca20-42f7-4752-b9f0-6a43021c676e service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:42.701181 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.objects.instance [None req-390e3e50-823d-490a-b453-2dd79c63347b tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] Lazy-loading 'services' on Instance uuid 81748c83-b703-4c68-899c-c575cc3340d2 {{(pid=128802) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:40:42.710989 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-67fec523-043e-4fcf-a853-f67c3d960c77 req-fab9ca20-42f7-4752-b9f0-6a43021c676e service nova] Creating event network-vif-plugged:277f1cea-7772-4f31-88f2-7e690a93cf8f for instance fd12aa25-6dbc-4f92-a2e1-83ae94ab83b4 on n-h1-854823-8 Oct 04 20:40:42.716559 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-67fec523-043e-4fcf-a853-f67c3d960c77 req-fab9ca20-42f7-4752-b9f0-6a43021c676e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055337 Oct 04 20:40:42.718717 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-390e3e50-823d-490a-b453-2dd79c63347b tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/81748c83-b703-4c68-899c-c575cc3340d2" status: 200 len: 2420 microversion: 2.25 time: 0.329414 Oct 04 20:40:42.720567 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 962/1845] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:40:42 2022] GET /compute/v2.1/servers/81748c83-b703-4c68-899c-c575cc3340d2 => generated 2420 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:40:42.721069 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 884/1846] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:40:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:40:42.726803 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-13876347-493c-454a-bb25-a125cbfc9c21 tempest-FloatingIPsTestJSON-1592318220 tempest-FloatingIPsTestJSON-1592318220-project] Calling method '.version_select at 0x7f3c787c4160>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:42.728342 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-96b31518-ba25-4d25-aadb-695e0fe5312b tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:42.729121 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-96b31518-ba25-4d25-aadb-695e0fe5312b tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] [instance: d9c5805f-6cd2-4993-86b2-8a7546b62dd6] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:42.735636 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-96b31518-ba25-4d25-aadb-695e0fe5312b tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:42.736360 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-96b31518-ba25-4d25-aadb-695e0fe5312b tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:42.736906 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-96b31518-ba25-4d25-aadb-695e0fe5312b tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:42.737696 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-96b31518-ba25-4d25-aadb-695e0fe5312b tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:42.738244 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-96b31518-ba25-4d25-aadb-695e0fe5312b tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:42.738799 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-96b31518-ba25-4d25-aadb-695e0fe5312b tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:42.779686 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-96b31518-ba25-4d25-aadb-695e0fe5312b tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] [instance: d9c5805f-6cd2-4993-86b2-8a7546b62dd6] Going to try to terminate instance {{(pid=128802) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:40:42.884856 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-96b31518-ba25-4d25-aadb-695e0fe5312b tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] 10.222.0.33 "DELETE /compute/v2.1/servers/d9c5805f-6cd2-4993-86b2-8a7546b62dd6" status: 204 len: 0 microversion: 2.1 time: 0.161868 Oct 04 20:40:42.886941 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 963/1847] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 20:40:42 2022] DELETE /compute/v2.1/servers/d9c5805f-6cd2-4993-86b2-8a7546b62dd6 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:40:42.894084 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-ef44c5c6-e34d-4a2c-8b9d-9d911685227d tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Calling method '.version_select at 0x7f3c7422f430>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:43.323544 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-ef44c5c6-e34d-4a2c-8b9d-9d911685227d tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] 10.222.0.33 "DELETE /compute/v2.1/images/dec1cfe6-6be8-4fc4-a82f-728708d575e6" status: 204 len: 0 microversion: 2.1 time: 0.434588 Oct 04 20:40:43.324753 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 964/1848] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:40:42 2022] DELETE /compute/v2.1/images/dec1cfe6-6be8-4fc4-a82f-728708d575e6 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:40:43.330604 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-0f78b940-912d-4947-a7a6-66deebf2e842 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:43.331434 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-0f78b940-912d-4947-a7a6-66deebf2e842 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] [instance: 53f0a355-8a5d-4775-a0d3-3aeedfc01570] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:43.337862 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0f78b940-912d-4947-a7a6-66deebf2e842 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:43.338534 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0f78b940-912d-4947-a7a6-66deebf2e842 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:43.339230 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0f78b940-912d-4947-a7a6-66deebf2e842 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:43.340005 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0f78b940-912d-4947-a7a6-66deebf2e842 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:43.340532 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0f78b940-912d-4947-a7a6-66deebf2e842 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:43.341030 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0f78b940-912d-4947-a7a6-66deebf2e842 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:43.555053 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-0f78b940-912d-4947-a7a6-66deebf2e842 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96919ec99c14864876d64a9c2b20f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b44ce10b78bf49c882c9b4df06187114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:43.563064 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-0f78b940-912d-4947-a7a6-66deebf2e842 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] 10.222.0.33 "GET /compute/v2.1/servers/53f0a355-8a5d-4775-a0d3-3aeedfc01570" status: 200 len: 1505 microversion: 2.1 time: 0.237191 Oct 04 20:40:43.564075 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 965/1849] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:40:43 2022] GET /compute/v2.1/servers/53f0a355-8a5d-4775-a0d3-3aeedfc01570 => generated 1505 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:43.583116 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-290e19ff-749e-4962-86c0-4f2ecd35d468 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:43.583712 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-290e19ff-749e-4962-86c0-4f2ecd35d468 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] [instance: 81748c83-b703-4c68-899c-c575cc3340d2] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:43.589862 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-290e19ff-749e-4962-86c0-4f2ecd35d468 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:43.590370 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-290e19ff-749e-4962-86c0-4f2ecd35d468 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:43.590812 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-290e19ff-749e-4962-86c0-4f2ecd35d468 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:43.591511 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-290e19ff-749e-4962-86c0-4f2ecd35d468 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:43.591977 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-290e19ff-749e-4962-86c0-4f2ecd35d468 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:43.592432 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-290e19ff-749e-4962-86c0-4f2ecd35d468 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:43.678061 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.objects.instance [None req-290e19ff-749e-4962-86c0-4f2ecd35d468 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lazy-loading 'services' on Instance uuid 81748c83-b703-4c68-899c-c575cc3340d2 {{(pid=128802) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:40:43.758847 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-13876347-493c-454a-bb25-a125cbfc9c21 tempest-FloatingIPsTestJSON-1592318220 tempest-FloatingIPsTestJSON-1592318220-project] 10.222.0.33 "DELETE /compute/v2.1/os-floating-ips/434af189-2b5e-4e20-94ed-702054a6829e" status: 202 len: 0 microversion: 2.1 time: 1.036323 Oct 04 20:40:43.759656 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 885/1850] 10.222.0.33 () {58 vars in 1263 bytes} [Tue Oct 4 20:40:42 2022] DELETE /compute/v2.1/os-floating-ips/434af189-2b5e-4e20-94ed-702054a6829e => generated 0 bytes in 1038 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:40:43.764804 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-19c91000-695e-4290-9c64-9b880a625170 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:43.765536 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-19c91000-695e-4290-9c64-9b880a625170 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] [instance: d9c5805f-6cd2-4993-86b2-8a7546b62dd6] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:43.768724 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-290e19ff-749e-4962-86c0-4f2ecd35d468 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] 10.222.0.33 "DELETE /compute/v2.1/servers/81748c83-b703-4c68-899c-c575cc3340d2/os-volume_attachments/3e5147bd-5a5b-494f-afff-2b8b3942acb4" status: 202 len: 0 microversion: 2.25 time: 0.203191 Oct 04 20:40:43.769457 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 966/1851] 10.222.0.33 () {60 vars in 1457 bytes} [Tue Oct 4 20:40:43 2022] DELETE /compute/v2.1/servers/81748c83-b703-4c68-899c-c575cc3340d2/os-volume_attachments/3e5147bd-5a5b-494f-afff-2b8b3942acb4 => generated 0 bytes in 205 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:40:43.775947 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-b17fddf3-3fbd-4b56-9627-d023c49f0997 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:43.776668 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-b17fddf3-3fbd-4b56-9627-d023c49f0997 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] [instance: fd12aa25-6dbc-4f92-a2e1-83ae94ab83b4] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:43.777254 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-19c91000-695e-4290-9c64-9b880a625170 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:43.777624 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-19c91000-695e-4290-9c64-9b880a625170 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:43.778436 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-19c91000-695e-4290-9c64-9b880a625170 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:43.779145 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-19c91000-695e-4290-9c64-9b880a625170 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:43.779596 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-19c91000-695e-4290-9c64-9b880a625170 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:43.780016 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-19c91000-695e-4290-9c64-9b880a625170 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:43.783759 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b17fddf3-3fbd-4b56-9627-d023c49f0997 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:43.784238 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b17fddf3-3fbd-4b56-9627-d023c49f0997 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:43.786079 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b17fddf3-3fbd-4b56-9627-d023c49f0997 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:43.786872 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b17fddf3-3fbd-4b56-9627-d023c49f0997 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:43.787325 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b17fddf3-3fbd-4b56-9627-d023c49f0997 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:43.787871 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b17fddf3-3fbd-4b56-9627-d023c49f0997 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:44.030745 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-19c91000-695e-4290-9c64-9b880a625170 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36f4114dc4f443f8b48da7b4027e0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a23a85365414f92bbc03177d7f190e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:44.039257 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-19c91000-695e-4290-9c64-9b880a625170 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] 10.222.0.33 "GET /compute/v2.1/servers/d9c5805f-6cd2-4993-86b2-8a7546b62dd6" status: 200 len: 1473 microversion: 2.1 time: 0.278372 Oct 04 20:40:44.039853 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 886/1852] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:40:43 2022] GET /compute/v2.1/servers/d9c5805f-6cd2-4993-86b2-8a7546b62dd6 => generated 1473 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:44.044393 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-72c799ae-3943-49e7-bde3-cb44477283d7 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Calling method '.version_select at 0x7f3c787eaca0>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:44.051502 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-b17fddf3-3fbd-4b56-9627-d023c49f0997 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a82c49a62249029ebc6ae3b4829709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecf3793be3eb4f3186c07a7e45fd8f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:44.063669 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-b17fddf3-3fbd-4b56-9627-d023c49f0997 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] 10.222.0.33 "GET /compute/v2.1/servers/fd12aa25-6dbc-4f92-a2e1-83ae94ab83b4" status: 200 len: 1324 microversion: 2.1 time: 0.292693 Oct 04 20:40:44.064583 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 967/1853] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:40:43 2022] GET /compute/v2.1/servers/fd12aa25-6dbc-4f92-a2e1-83ae94ab83b4 => generated 1324 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:44.069594 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-0828723c-080c-4cc0-91fa-8111e80854b3 tempest-FloatingIPsTestJSON-1592318220 tempest-FloatingIPsTestJSON-1592318220-project] Calling method '.version_select at 0x7f3c78a27040>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:44.101617 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-72c799ae-3943-49e7-bde3-cb44477283d7 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] HTTP exception thrown: Image not found. Oct 04 20:40:44.103721 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-72c799ae-3943-49e7-bde3-cb44477283d7 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Request method failure captured: Oct 04 20:40:44.103721 n-d-854823-8 devstack@n-api.service[128801]: request: DELETE /compute/v2.1/images/4ceaa94c-0232-4808-b979-89d23cbd895c HTTP/1.1 Oct 04 20:40:44.103721 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:40:44.103721 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:40:44.103721 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:40:44.103721 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 0 Oct 04 20:40:44.103721 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:40:44.103721 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:40:44.103721 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:40:44.103721 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:40:44.103721 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJnuE2rDdF4OJaHNqaaT6E-hBI9LuK6Sm2sdGaLGM4LHFmgD5UEONtmpt2qAD9awwC2Ssw_XSGcZ3JQzJEtsQqt8zM57DJ-OWjh9lMMmfdMkJ___oqbIg_C_qrcSoEkSRrITPKRaX9r5zH92sl2oFY6aLjh8ZiuJDCyw2O78ZZSEXbI Oct 04 20:40:44.103721 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:40:44.103721 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:40:44.103721 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:40:44.103721 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:40:44.103721 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:40:44.103721 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:40:44.103721 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: 4151c9ef7ae04a728306297f58ba5088 Oct 04 20:40:44.103721 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-ImagesOneServerTestJSON-264095593 Oct 04 20:40:44.103721 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 20:40:44.103721 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 20:40:44.103721 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_4151c9ef7ae04a728306297f58ba5088", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4151c9ef7ae04a728306297f58ba5088"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4151c9ef7ae04a728306297f58ba5088"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/4151c9ef7ae04a728306297f58ba5088"}]}] Oct 04 20:40:44.103721 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-ImagesOneServerTestJSON-264095593 Oct 04 20:40:44.103721 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: 4151c9ef7ae04a728306297f58ba5088 Oct 04 20:40:44.103721 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-264095593 Oct 04 20:40:44.103721 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-ImagesOneServerTestJSON-264095593-project Oct 04 20:40:44.103721 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:40:44.103721 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:40:44.103721 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: 7bdfa818206f4f4b88cc962c1c34adf3 Oct 04 20:40:44.103721 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-ImagesOneServerTestJSON-264095593-project Oct 04 20:40:44.103721 n-d-854823-8 devstack@n-api.service[128801]: method: Oct 04 20:40:44.103721 n-d-854823-8 devstack@n-api.service[128801]: exception: Image not found. Oct 04 20:40:44.103721 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': '4ceaa94c-0232-4808-b979-89d23cbd895c'} Oct 04 20:40:44.103721 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:40:44.103721 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:40:44.103721 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 04 20:40:44.103721 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 04 20:40:44.103721 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 20:40:44.103721 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 20:40:44.103721 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 20:40:44.103721 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 20:40:44.103721 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 04 20:40:44.103721 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 04 20:40:44.103721 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 04 20:40:44.103721 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 04 20:40:44.103721 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 20:40:44.103721 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 20:40:44.103721 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 20:40:44.103721 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 20:40:44.103721 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 4ceaa94c-0232-4808-b979-89d23cbd895c to delete Oct 04 20:40:44.103721 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:40:44.103721 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:40:44.103721 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:40:44.103721 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:40:44.103721 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 04 20:40:44.103721 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 04 20:40:44.103721 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 04 20:40:44.103721 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 04 20:40:44.103721 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 04 20:40:44.103721 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 04 20:40:44.103721 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 4ceaa94c-0232-4808-b979-89d23cbd895c could not be found. Oct 04 20:40:44.103721 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:40:44.103721 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:40:44.103721 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:40:44.103721 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:40:44.109299 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:40:44.109299 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:40:44.109299 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:40:44.109299 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:40:44.109299 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:40:44.109299 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:40:44.109299 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:40:44.109299 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:40:44.109299 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 04 20:40:44.109299 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 04 20:40:44.109299 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 20:40:44.109299 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:40:44.109299 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:40:44.109299 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:40:44.109299 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:40:44.109299 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:40:44.109299 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:40:44.109299 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:40:44.109299 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:40:44.109299 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 20:40:44.109299 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:40:44.109299 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-72c799ae-3943-49e7-bde3-cb44477283d7 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Returning 404 to user: Image not found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:40:44.109299 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-72c799ae-3943-49e7-bde3-cb44477283d7 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] 10.222.0.33 "DELETE /compute/v2.1/images/4ceaa94c-0232-4808-b979-89d23cbd895c" status: 404 len: 62 microversion: 2.1 time: 0.064451 Oct 04 20:40:44.109299 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 887/1854] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:40:44 2022] DELETE /compute/v2.1/images/4ceaa94c-0232-4808-b979-89d23cbd895c => generated 62 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 20:40:44.113417 n-d-854823-8 devstack@n-api.service[128802]: DEBUG neutronclient.v2_0.client [None req-0828723c-080c-4cc0-91fa-8111e80854b3 tempest-FloatingIPsTestJSON-1592318220 tempest-FloatingIPsTestJSON-1592318220-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 434af189-2b5e-4e20-94ed-702054a6829e could not be found", "detail": ""}} {{(pid=128802) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 20:40:44.114058 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6a59199c-7013-49bf-be6a-6860c6d2f740 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:44.114231 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.wsgi [None req-0828723c-080c-4cc0-91fa-8111e80854b3 tempest-FloatingIPsTestJSON-1592318220 tempest-FloatingIPsTestJSON-1592318220-project] HTTP exception thrown: Floating IP not found for ID 434af189-2b5e-4e20-94ed-702054a6829e Oct 04 20:40:44.116267 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-0828723c-080c-4cc0-91fa-8111e80854b3 tempest-FloatingIPsTestJSON-1592318220 tempest-FloatingIPsTestJSON-1592318220-project] Request method failure captured: Oct 04 20:40:44.116267 n-d-854823-8 devstack@n-api.service[128802]: request: GET /compute/v2.1/os-floating-ips/434af189-2b5e-4e20-94ed-702054a6829e HTTP/1.1 Oct 04 20:40:44.116267 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 20:40:44.116267 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 20:40:44.116267 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 20:40:44.116267 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 0 Oct 04 20:40:44.116267 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 20:40:44.116267 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 20:40:44.116267 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 20:40:44.116267 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 20:40:44.116267 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPJo7um8oQLM36hGtm-Is02DU4Y13v1Nce6eis-QW3mQkRUZj9YUbnEmGSJImDs2X7HVQzPj2lstMG520aq7KhrB-yh-8Q0FQgW9sZNIzrmT4Uasl6b4mionsa86GdTePKOg7JfqAivGBBdJjrLNio3xz00vMaMyD9t9H6DsmTkYjyEo Oct 04 20:40:44.116267 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 20:40:44.116267 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 20:40:44.116267 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 20:40:44.116267 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 20:40:44.116267 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 20:40:44.116267 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 20:40:44.116267 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: 4e2cfc14d0c3494db4f910297dbc5410 Oct 04 20:40:44.116267 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-FloatingIPsTestJSON-1592318220 Oct 04 20:40:44.116267 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 20:40:44.116267 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 20:40:44.116267 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_4e2cfc14d0c3494db4f910297dbc5410", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4e2cfc14d0c3494db4f910297dbc5410"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4e2cfc14d0c3494db4f910297dbc5410"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/4e2cfc14d0c3494db4f910297dbc5410"}]}] Oct 04 20:40:44.116267 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-FloatingIPsTestJSON-1592318220 Oct 04 20:40:44.116267 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: 4e2cfc14d0c3494db4f910297dbc5410 Oct 04 20:40:44.116267 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-FloatingIPsTestJSON-1592318220 Oct 04 20:40:44.116267 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-FloatingIPsTestJSON-1592318220-project Oct 04 20:40:44.116267 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 20:40:44.116267 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 20:40:44.116267 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: e7fec05489d64accbc2538b0b45df214 Oct 04 20:40:44.116267 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-FloatingIPsTestJSON-1592318220-project Oct 04 20:40:44.116267 n-d-854823-8 devstack@n-api.service[128802]: method: Oct 04 20:40:44.116267 n-d-854823-8 devstack@n-api.service[128802]: exception: Floating IP not found for ID 434af189-2b5e-4e20-94ed-702054a6829e Oct 04 20:40:44.116267 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'id': '434af189-2b5e-4e20-94ed-702054a6829e'} Oct 04 20:40:44.116267 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:40:44.116267 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:40:44.116267 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 04 20:40:44.116267 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 04 20:40:44.116267 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:40:44.116267 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:40:44.116267 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 04 20:40:44.116267 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 04 20:40:44.116267 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:40:44.116267 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:40:44.116267 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 20:40:44.116267 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 20:40:44.116267 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:40:44.116267 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:40:44.116267 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:40:44.116267 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:40:44.116267 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:40:44.116267 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:40:44.116267 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 20:40:44.116267 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 20:40:44.116267 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:40:44.116267 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:40:44.116267 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 20:40:44.116267 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 20:40:44.116267 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 20:40:44.116267 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 20:40:44.116267 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 434af189-2b5e-4e20-94ed-702054a6829e could not be found Oct 04 20:40:44.116267 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d5b2ec52-015c-48bc-bd56-089c5eaaa5fd'] Oct 04 20:40:44.116267 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:40:44.121369 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:40:44.121369 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:40:44.121369 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:40:44.121369 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Oct 04 20:40:44.121369 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 04 20:40:44.121369 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 04 20:40:44.121369 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 04 20:40:44.121369 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 434af189-2b5e-4e20-94ed-702054a6829e. Oct 04 20:40:44.121369 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:40:44.121369 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:40:44.121369 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:40:44.121369 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:40:44.121369 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:40:44.121369 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:40:44.121369 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:40:44.121369 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:40:44.121369 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:40:44.121369 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:40:44.121369 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:40:44.121369 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:40:44.121369 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Oct 04 20:40:44.121369 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 04 20:40:44.121369 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 434af189-2b5e-4e20-94ed-702054a6829e Oct 04 20:40:44.121369 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:40:44.121369 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:40:44.121369 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:40:44.121369 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:40:44.121369 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:40:44.121369 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:40:44.121369 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:40:44.121369 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:40:44.121369 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 434af189-2b5e-4e20-94ed-702054a6829e Oct 04 20:40:44.121369 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:40:44.121369 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-0828723c-080c-4cc0-91fa-8111e80854b3 tempest-FloatingIPsTestJSON-1592318220 tempest-FloatingIPsTestJSON-1592318220-project] Returning 404 to user: Floating IP not found for ID 434af189-2b5e-4e20-94ed-702054a6829e {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:40:44.124855 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-6a59199c-7013-49bf-be6a-6860c6d2f740 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] [instance: 81748c83-b703-4c68-899c-c575cc3340d2] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:44.124959 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-0828723c-080c-4cc0-91fa-8111e80854b3 tempest-FloatingIPsTestJSON-1592318220 tempest-FloatingIPsTestJSON-1592318220-project] 10.222.0.33 "GET /compute/v2.1/os-floating-ips/434af189-2b5e-4e20-94ed-702054a6829e" status: 404 len: 111 microversion: 2.1 time: 0.052974 Oct 04 20:40:44.124959 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 968/1855] 10.222.0.33 () {58 vars in 1260 bytes} [Tue Oct 4 20:40:44 2022] GET /compute/v2.1/os-floating-ips/434af189-2b5e-4e20-94ed-702054a6829e => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:40:44.127431 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-78b7e0c5-fe35-4dc1-a015-a7a8d31f3179 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:44.127917 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-78b7e0c5-fe35-4dc1-a015-a7a8d31f3179 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] [instance: 0dd1d0cf-a3a0-4ea2-8260-ac206bbfac88] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:44.128858 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6a59199c-7013-49bf-be6a-6860c6d2f740 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:44.129357 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6a59199c-7013-49bf-be6a-6860c6d2f740 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:44.129796 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6a59199c-7013-49bf-be6a-6860c6d2f740 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:44.130551 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6a59199c-7013-49bf-be6a-6860c6d2f740 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:44.131015 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6a59199c-7013-49bf-be6a-6860c6d2f740 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:44.131441 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6a59199c-7013-49bf-be6a-6860c6d2f740 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:44.134802 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-78b7e0c5-fe35-4dc1-a015-a7a8d31f3179 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:44.135281 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-78b7e0c5-fe35-4dc1-a015-a7a8d31f3179 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:44.135708 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-78b7e0c5-fe35-4dc1-a015-a7a8d31f3179 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:44.136399 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-78b7e0c5-fe35-4dc1-a015-a7a8d31f3179 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:44.136850 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-78b7e0c5-fe35-4dc1-a015-a7a8d31f3179 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:44.137275 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-78b7e0c5-fe35-4dc1-a015-a7a8d31f3179 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:44.164734 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-6a59199c-7013-49bf-be6a-6860c6d2f740 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] 10.222.0.33 "GET /compute/v2.1/servers/81748c83-b703-4c68-899c-c575cc3340d2/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.052890 Oct 04 20:40:44.164734 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 888/1856] 10.222.0.33 () {60 vars in 1343 bytes} [Tue Oct 4 20:40:44 2022] GET /compute/v2.1/servers/81748c83-b703-4c68-899c-c575cc3340d2/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 20:40:44.165060 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-78b7e0c5-fe35-4dc1-a015-a7a8d31f3179 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] [instance: 0dd1d0cf-a3a0-4ea2-8260-ac206bbfac88] Going to try to terminate instance {{(pid=128802) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:40:44.168510 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-502fe07e-a875-4dc8-8172-497609903ef3 tempest-FloatingIPsTestJSON-1592318220 tempest-FloatingIPsTestJSON-1592318220-project] Calling method '.version_select at 0x7f3c78808790>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:44.211830 n-d-854823-8 devstack@n-api.service[128801]: DEBUG neutronclient.v2_0.client [None req-502fe07e-a875-4dc8-8172-497609903ef3 tempest-FloatingIPsTestJSON-1592318220 tempest-FloatingIPsTestJSON-1592318220-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 434af189-2b5e-4e20-94ed-702054a6829e could not be found", "detail": ""}} {{(pid=128801) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 20:40:44.212521 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-502fe07e-a875-4dc8-8172-497609903ef3 tempest-FloatingIPsTestJSON-1592318220 tempest-FloatingIPsTestJSON-1592318220-project] HTTP exception thrown: Floating IP not found for ID 434af189-2b5e-4e20-94ed-702054a6829e Oct 04 20:40:44.214406 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-502fe07e-a875-4dc8-8172-497609903ef3 tempest-FloatingIPsTestJSON-1592318220 tempest-FloatingIPsTestJSON-1592318220-project] Request method failure captured: Oct 04 20:40:44.214406 n-d-854823-8 devstack@n-api.service[128801]: request: DELETE /compute/v2.1/os-floating-ips/434af189-2b5e-4e20-94ed-702054a6829e HTTP/1.1 Oct 04 20:40:44.214406 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:40:44.214406 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:40:44.214406 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:40:44.214406 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 0 Oct 04 20:40:44.214406 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:40:44.214406 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:40:44.214406 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:40:44.214406 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:40:44.214406 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJo7um8oQLM36hGtm-Is02DU4Y13v1Nce6eis-QW3mQkRUZj9YUbnEmGSJImDs2X7HVQzPj2lstMG520aq7KhrB-yh-8Q0FQgW9sZNIzrmT4Uasl6b4mionsa86GdTePKOg7JfqAivGBBdJjrLNio3xz00vMaMyD9t9H6DsmTkYjyEo Oct 04 20:40:44.214406 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:40:44.214406 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:40:44.214406 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:40:44.214406 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:40:44.214406 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:40:44.214406 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:40:44.214406 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: 4e2cfc14d0c3494db4f910297dbc5410 Oct 04 20:40:44.214406 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-FloatingIPsTestJSON-1592318220 Oct 04 20:40:44.214406 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 20:40:44.214406 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 20:40:44.214406 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_4e2cfc14d0c3494db4f910297dbc5410", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4e2cfc14d0c3494db4f910297dbc5410"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4e2cfc14d0c3494db4f910297dbc5410"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/4e2cfc14d0c3494db4f910297dbc5410"}]}] Oct 04 20:40:44.214406 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-FloatingIPsTestJSON-1592318220 Oct 04 20:40:44.214406 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: 4e2cfc14d0c3494db4f910297dbc5410 Oct 04 20:40:44.214406 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-FloatingIPsTestJSON-1592318220 Oct 04 20:40:44.214406 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-FloatingIPsTestJSON-1592318220-project Oct 04 20:40:44.214406 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:40:44.214406 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:40:44.214406 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: e7fec05489d64accbc2538b0b45df214 Oct 04 20:40:44.214406 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-FloatingIPsTestJSON-1592318220-project Oct 04 20:40:44.214406 n-d-854823-8 devstack@n-api.service[128801]: method: Oct 04 20:40:44.214406 n-d-854823-8 devstack@n-api.service[128801]: exception: Floating IP not found for ID 434af189-2b5e-4e20-94ed-702054a6829e Oct 04 20:40:44.214406 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': '434af189-2b5e-4e20-94ed-702054a6829e'} Oct 04 20:40:44.214406 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:40:44.214406 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:40:44.214406 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 04 20:40:44.214406 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 04 20:40:44.214406 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:40:44.214406 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:40:44.214406 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 04 20:40:44.214406 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 04 20:40:44.214406 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:40:44.214406 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:40:44.214406 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 20:40:44.214406 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 20:40:44.214406 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:40:44.214406 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:40:44.214406 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:40:44.214406 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:40:44.214406 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:40:44.214406 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:40:44.214406 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 20:40:44.214406 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 20:40:44.214406 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:40:44.214406 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:40:44.214406 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 20:40:44.214406 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 20:40:44.214406 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 20:40:44.214406 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 20:40:44.214406 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 434af189-2b5e-4e20-94ed-702054a6829e could not be found Oct 04 20:40:44.214406 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-abd0cbf9-535f-4c39-90e5-dd6bd959fc84'] Oct 04 20:40:44.214406 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:40:44.218886 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:40:44.218886 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:40:44.218886 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:40:44.218886 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Oct 04 20:40:44.218886 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 04 20:40:44.218886 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 04 20:40:44.218886 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 04 20:40:44.218886 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 434af189-2b5e-4e20-94ed-702054a6829e. Oct 04 20:40:44.218886 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:40:44.218886 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:40:44.218886 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:40:44.218886 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:40:44.218886 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:40:44.218886 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:40:44.218886 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:40:44.218886 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:40:44.218886 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:40:44.218886 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:40:44.218886 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:40:44.218886 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:40:44.218886 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Oct 04 20:40:44.218886 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 04 20:40:44.218886 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 434af189-2b5e-4e20-94ed-702054a6829e Oct 04 20:40:44.218886 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:40:44.218886 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:40:44.218886 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:40:44.218886 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:40:44.218886 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:40:44.218886 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:40:44.218886 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:40:44.218886 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:40:44.218886 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 434af189-2b5e-4e20-94ed-702054a6829e Oct 04 20:40:44.218886 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:40:44.218886 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-502fe07e-a875-4dc8-8172-497609903ef3 tempest-FloatingIPsTestJSON-1592318220 tempest-FloatingIPsTestJSON-1592318220-project] Returning 404 to user: Floating IP not found for ID 434af189-2b5e-4e20-94ed-702054a6829e {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:40:44.218886 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-502fe07e-a875-4dc8-8172-497609903ef3 tempest-FloatingIPsTestJSON-1592318220 tempest-FloatingIPsTestJSON-1592318220-project] 10.222.0.33 "DELETE /compute/v2.1/os-floating-ips/434af189-2b5e-4e20-94ed-702054a6829e" status: 404 len: 111 microversion: 2.1 time: 0.051546 Oct 04 20:40:44.221810 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 889/1857] 10.222.0.33 () {58 vars in 1263 bytes} [Tue Oct 4 20:40:44 2022] DELETE /compute/v2.1/os-floating-ips/434af189-2b5e-4e20-94ed-702054a6829e => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:40:44.247230 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-78b7e0c5-fe35-4dc1-a015-a7a8d31f3179 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] 10.222.0.33 "DELETE /compute/v2.1/servers/0dd1d0cf-a3a0-4ea2-8260-ac206bbfac88" status: 204 len: 0 microversion: 2.1 time: 0.124434 Oct 04 20:40:44.247819 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 969/1858] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 20:40:44 2022] DELETE /compute/v2.1/servers/0dd1d0cf-a3a0-4ea2-8260-ac206bbfac88 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:40:44.255671 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b9b5d068-c0c3-41c2-ade5-d203778db0a6 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:44.256441 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b9b5d068-c0c3-41c2-ade5-d203778db0a6 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] [instance: 0dd1d0cf-a3a0-4ea2-8260-ac206bbfac88] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:44.263093 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b9b5d068-c0c3-41c2-ade5-d203778db0a6 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:44.263572 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b9b5d068-c0c3-41c2-ade5-d203778db0a6 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:44.263999 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b9b5d068-c0c3-41c2-ade5-d203778db0a6 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:44.264685 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b9b5d068-c0c3-41c2-ade5-d203778db0a6 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:44.265132 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b9b5d068-c0c3-41c2-ade5-d203778db0a6 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:44.265628 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b9b5d068-c0c3-41c2-ade5-d203778db0a6 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:44.588105 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-2a369c37-bfed-4a6a-894f-7626a6d744c5 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:44.588811 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-2a369c37-bfed-4a6a-894f-7626a6d744c5 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] [instance: 53f0a355-8a5d-4775-a0d3-3aeedfc01570] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:44.595125 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2a369c37-bfed-4a6a-894f-7626a6d744c5 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:44.595643 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2a369c37-bfed-4a6a-894f-7626a6d744c5 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:44.596076 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2a369c37-bfed-4a6a-894f-7626a6d744c5 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:44.596786 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2a369c37-bfed-4a6a-894f-7626a6d744c5 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:44.597237 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2a369c37-bfed-4a6a-894f-7626a6d744c5 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:44.597664 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2a369c37-bfed-4a6a-894f-7626a6d744c5 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:44.926516 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-b9b5d068-c0c3-41c2-ade5-d203778db0a6 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bdfa818206f4f4b88cc962c1c34adf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4151c9ef7ae04a728306297f58ba5088', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:44.942029 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b9b5d068-c0c3-41c2-ade5-d203778db0a6 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] 10.222.0.33 "GET /compute/v2.1/servers/0dd1d0cf-a3a0-4ea2-8260-ac206bbfac88" status: 200 len: 1473 microversion: 2.1 time: 0.690030 Oct 04 20:40:44.942952 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 890/1859] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:40:44 2022] GET /compute/v2.1/servers/0dd1d0cf-a3a0-4ea2-8260-ac206bbfac88 => generated 1473 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:44.947739 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2e854957-d9b2-47cc-af29-7032f6aa481b tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:44.948549 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-2e854957-d9b2-47cc-af29-7032f6aa481b tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] [instance: 83df4756-40e2-4fc6-be48-48a82dd4572a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:44.954761 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2e854957-d9b2-47cc-af29-7032f6aa481b tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:44.955226 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2e854957-d9b2-47cc-af29-7032f6aa481b tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:44.955671 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2e854957-d9b2-47cc-af29-7032f6aa481b tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:44.956374 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2e854957-d9b2-47cc-af29-7032f6aa481b tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:44.957089 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2e854957-d9b2-47cc-af29-7032f6aa481b tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:44.957528 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2e854957-d9b2-47cc-af29-7032f6aa481b tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:44.977488 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-2a369c37-bfed-4a6a-894f-7626a6d744c5 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96919ec99c14864876d64a9c2b20f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b44ce10b78bf49c882c9b4df06187114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:44.980238 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=3,nova_cell1:INSERT=4 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:40:44.990049 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-2a369c37-bfed-4a6a-894f-7626a6d744c5 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] 10.222.0.33 "GET /compute/v2.1/servers/53f0a355-8a5d-4775-a0d3-3aeedfc01570" status: 200 len: 1505 microversion: 2.1 time: 0.406359 Oct 04 20:40:44.996962 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 970/1860] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:40:44 2022] GET /compute/v2.1/servers/53f0a355-8a5d-4775-a0d3-3aeedfc01570 => generated 1505 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:40:45.062730 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-61014aa8-9bf2-4f02-bf54-eff9d8c5c64f tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:45.065125 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-61014aa8-9bf2-4f02-bf54-eff9d8c5c64f tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] [instance: d9c5805f-6cd2-4993-86b2-8a7546b62dd6] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:45.068715 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:UPDATE=3 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:40:45.074630 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-61014aa8-9bf2-4f02-bf54-eff9d8c5c64f tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:45.075126 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-61014aa8-9bf2-4f02-bf54-eff9d8c5c64f tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:45.075562 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-61014aa8-9bf2-4f02-bf54-eff9d8c5c64f tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:45.076269 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-61014aa8-9bf2-4f02-bf54-eff9d8c5c64f tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:45.076719 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-61014aa8-9bf2-4f02-bf54-eff9d8c5c64f tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:45.077140 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-61014aa8-9bf2-4f02-bf54-eff9d8c5c64f tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:45.340008 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-2e854957-d9b2-47cc-af29-7032f6aa481b tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/83df4756-40e2-4fc6-be48-48a82dd4572a" status: 200 len: 1859 microversion: 2.1 time: 0.396100 Oct 04 20:40:45.340683 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 891/1861] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:40:44 2022] GET /compute/v2.1/servers/83df4756-40e2-4fc6-be48-48a82dd4572a => generated 1859 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:45.345877 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-259b8e84-d78b-4ee1-9725-b51e1694aaa8 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:45.346578 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-259b8e84-d78b-4ee1-9725-b51e1694aaa8 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] [instance: fd12aa25-6dbc-4f92-a2e1-83ae94ab83b4] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:45.352428 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-259b8e84-d78b-4ee1-9725-b51e1694aaa8 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:45.352910 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-259b8e84-d78b-4ee1-9725-b51e1694aaa8 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:45.353345 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-259b8e84-d78b-4ee1-9725-b51e1694aaa8 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:45.354038 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-259b8e84-d78b-4ee1-9725-b51e1694aaa8 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:45.354530 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-259b8e84-d78b-4ee1-9725-b51e1694aaa8 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:45.354954 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-259b8e84-d78b-4ee1-9725-b51e1694aaa8 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:45.495073 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-61014aa8-9bf2-4f02-bf54-eff9d8c5c64f tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36f4114dc4f443f8b48da7b4027e0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a23a85365414f92bbc03177d7f190e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:45.503543 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-61014aa8-9bf2-4f02-bf54-eff9d8c5c64f tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] 10.222.0.33 "GET /compute/v2.1/servers/d9c5805f-6cd2-4993-86b2-8a7546b62dd6" status: 200 len: 1473 microversion: 2.1 time: 0.444763 Oct 04 20:40:45.504201 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 971/1862] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:40:45 2022] GET /compute/v2.1/servers/d9c5805f-6cd2-4993-86b2-8a7546b62dd6 => generated 1473 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:40:45.508704 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-2921c873-a9f2-4a51-aad2-3e8cac362b22 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:45.511233 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-2921c873-a9f2-4a51-aad2-3e8cac362b22 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] [instance: 81748c83-b703-4c68-899c-c575cc3340d2] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:45.519064 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2921c873-a9f2-4a51-aad2-3e8cac362b22 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:45.519578 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2921c873-a9f2-4a51-aad2-3e8cac362b22 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:45.520046 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2921c873-a9f2-4a51-aad2-3e8cac362b22 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:45.520906 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2921c873-a9f2-4a51-aad2-3e8cac362b22 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:45.521362 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2921c873-a9f2-4a51-aad2-3e8cac362b22 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:45.521850 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2921c873-a9f2-4a51-aad2-3e8cac362b22 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:45.554434 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-2921c873-a9f2-4a51-aad2-3e8cac362b22 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] 10.222.0.33 "GET /compute/v2.1/servers/81748c83-b703-4c68-899c-c575cc3340d2/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.049309 Oct 04 20:40:45.555107 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 972/1863] 10.222.0.33 () {60 vars in 1343 bytes} [Tue Oct 4 20:40:45 2022] GET /compute/v2.1/servers/81748c83-b703-4c68-899c-c575cc3340d2/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 20:40:45.559711 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-03ecf0c5-d0c2-4d72-aff5-8b52c4253c01 tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-854823-8", "block_migration": true, "disk_over_commit": false}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:40:45.562100 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-03ecf0c5-d0c2-4d72-aff5-8b52c4253c01 tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] [instance: 83df4756-40e2-4fc6-be48-48a82dd4572a] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:45.567917 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-03ecf0c5-d0c2-4d72-aff5-8b52c4253c01 tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:45.568390 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-03ecf0c5-d0c2-4d72-aff5-8b52c4253c01 tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:45.568822 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-03ecf0c5-d0c2-4d72-aff5-8b52c4253c01 tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:45.569553 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-03ecf0c5-d0c2-4d72-aff5-8b52c4253c01 tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:45.569998 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-03ecf0c5-d0c2-4d72-aff5-8b52c4253c01 tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:45.570466 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-03ecf0c5-d0c2-4d72-aff5-8b52c4253c01 tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:45.597405 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.objects.instance [None req-03ecf0c5-d0c2-4d72-aff5-8b52c4253c01 tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] Lazy-loading 'flavor' on Instance uuid 83df4756-40e2-4fc6-be48-48a82dd4572a {{(pid=128802) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:40:45.608986 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-03ecf0c5-d0c2-4d72-aff5-8b52c4253c01 tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] [instance: 83df4756-40e2-4fc6-be48-48a82dd4572a] Going to try to live migrate instance to n-h2-854823-8 {{(pid=128802) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 04 20:40:45.671793 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-259b8e84-d78b-4ee1-9725-b51e1694aaa8 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a82c49a62249029ebc6ae3b4829709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecf3793be3eb4f3186c07a7e45fd8f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:45.680872 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-259b8e84-d78b-4ee1-9725-b51e1694aaa8 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] 10.222.0.33 "GET /compute/v2.1/servers/fd12aa25-6dbc-4f92-a2e1-83ae94ab83b4" status: 200 len: 1520 microversion: 2.1 time: 0.339123 Oct 04 20:40:45.681751 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 892/1864] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:40:45 2022] GET /compute/v2.1/servers/fd12aa25-6dbc-4f92-a2e1-83ae94ab83b4 => generated 1520 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:45.727451 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-982117f9-fd2f-43d6-b0c5-c2d0d535bc06 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:45.728304 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-982117f9-fd2f-43d6-b0c5-c2d0d535bc06 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] [instance: fd12aa25-6dbc-4f92-a2e1-83ae94ab83b4] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:45.737940 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-982117f9-fd2f-43d6-b0c5-c2d0d535bc06 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:45.738459 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-982117f9-fd2f-43d6-b0c5-c2d0d535bc06 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:45.738893 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-982117f9-fd2f-43d6-b0c5-c2d0d535bc06 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:45.739599 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-982117f9-fd2f-43d6-b0c5-c2d0d535bc06 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:45.740054 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-982117f9-fd2f-43d6-b0c5-c2d0d535bc06 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:45.740480 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-982117f9-fd2f-43d6-b0c5-c2d0d535bc06 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:45.780841 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-982117f9-fd2f-43d6-b0c5-c2d0d535bc06 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] [instance: fd12aa25-6dbc-4f92-a2e1-83ae94ab83b4] Going to try to terminate instance {{(pid=128801) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:40:45.927584 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-982117f9-fd2f-43d6-b0c5-c2d0d535bc06 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] 10.222.0.33 "DELETE /compute/v2.1/servers/fd12aa25-6dbc-4f92-a2e1-83ae94ab83b4" status: 204 len: 0 microversion: 2.1 time: 0.203709 Oct 04 20:40:45.928511 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 893/1865] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 20:40:45 2022] DELETE /compute/v2.1/servers/fd12aa25-6dbc-4f92-a2e1-83ae94ab83b4 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:40:45.948846 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-fdcf6335-dd4e-4d17-93b9-d60495d0a6f1 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:45.949633 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-fdcf6335-dd4e-4d17-93b9-d60495d0a6f1 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] [instance: fd12aa25-6dbc-4f92-a2e1-83ae94ab83b4] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:45.957467 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fdcf6335-dd4e-4d17-93b9-d60495d0a6f1 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:45.958099 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fdcf6335-dd4e-4d17-93b9-d60495d0a6f1 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:45.958557 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fdcf6335-dd4e-4d17-93b9-d60495d0a6f1 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:45.959465 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fdcf6335-dd4e-4d17-93b9-d60495d0a6f1 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:45.960078 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fdcf6335-dd4e-4d17-93b9-d60495d0a6f1 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:45.960661 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fdcf6335-dd4e-4d17-93b9-d60495d0a6f1 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:46.216295 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-fdcf6335-dd4e-4d17-93b9-d60495d0a6f1 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a82c49a62249029ebc6ae3b4829709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecf3793be3eb4f3186c07a7e45fd8f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:46.227739 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-fdcf6335-dd4e-4d17-93b9-d60495d0a6f1 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] 10.222.0.33 "GET /compute/v2.1/servers/fd12aa25-6dbc-4f92-a2e1-83ae94ab83b4" status: 200 len: 1526 microversion: 2.1 time: 0.285723 Oct 04 20:40:46.231690 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 894/1866] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:40:45 2022] GET /compute/v2.1/servers/fd12aa25-6dbc-4f92-a2e1-83ae94ab83b4 => generated 1526 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:40:46.237211 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-9b8a20d6-4641-4c20-9b9f-0dea8a9ee4d0 req-cbe7f35f-8f9c-4193-ac72-10ddc833f64b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9c5805f-6cd2-4993-86b2-8a7546b62dd6", "name": "network-vif-deleted", "tag": "c853f19c-b474-473f-8984-c02e35b0a0e2"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:40:46.250085 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-9b8a20d6-4641-4c20-9b9f-0dea8a9ee4d0 req-cbe7f35f-8f9c-4193-ac72-10ddc833f64b service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:46.250956 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-9b8a20d6-4641-4c20-9b9f-0dea8a9ee4d0 req-cbe7f35f-8f9c-4193-ac72-10ddc833f64b service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:46.251636 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-9b8a20d6-4641-4c20-9b9f-0dea8a9ee4d0 req-cbe7f35f-8f9c-4193-ac72-10ddc833f64b service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:46.274812 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-9b8a20d6-4641-4c20-9b9f-0dea8a9ee4d0 req-cbe7f35f-8f9c-4193-ac72-10ddc833f64b service nova] Creating event network-vif-deleted:c853f19c-b474-473f-8984-c02e35b0a0e2 for instance d9c5805f-6cd2-4993-86b2-8a7546b62dd6 on n-h2-854823-8 Oct 04 20:40:46.298787 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-9b8a20d6-4641-4c20-9b9f-0dea8a9ee4d0 req-cbe7f35f-8f9c-4193-ac72-10ddc833f64b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065443 Oct 04 20:40:46.300879 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 895/1867] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:40:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:40:46.309477 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a19f3cde-6b9c-430e-ac2c-a22e5f5c078f tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:46.316985 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a19f3cde-6b9c-430e-ac2c-a22e5f5c078f tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] [instance: 0dd1d0cf-a3a0-4ea2-8260-ac206bbfac88] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:46.330002 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a19f3cde-6b9c-430e-ac2c-a22e5f5c078f tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:46.330793 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a19f3cde-6b9c-430e-ac2c-a22e5f5c078f tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:46.331432 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a19f3cde-6b9c-430e-ac2c-a22e5f5c078f tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:46.332508 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a19f3cde-6b9c-430e-ac2c-a22e5f5c078f tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:46.333181 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a19f3cde-6b9c-430e-ac2c-a22e5f5c078f tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:46.333636 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a19f3cde-6b9c-430e-ac2c-a22e5f5c078f tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:46.572657 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-a19f3cde-6b9c-430e-ac2c-a22e5f5c078f tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bdfa818206f4f4b88cc962c1c34adf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4151c9ef7ae04a728306297f58ba5088', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:46.583263 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a19f3cde-6b9c-430e-ac2c-a22e5f5c078f tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] 10.222.0.33 "GET /compute/v2.1/servers/0dd1d0cf-a3a0-4ea2-8260-ac206bbfac88" status: 200 len: 1473 microversion: 2.1 time: 0.281172 Oct 04 20:40:46.583855 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 896/1868] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:40:46 2022] GET /compute/v2.1/servers/0dd1d0cf-a3a0-4ea2-8260-ac206bbfac88 => generated 1473 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:46.593030 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6a1b8f57-204e-4024-aa13-5add82620595 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:46.597410 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-6a1b8f57-204e-4024-aa13-5add82620595 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] [instance: 53f0a355-8a5d-4775-a0d3-3aeedfc01570] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:46.610074 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6a1b8f57-204e-4024-aa13-5add82620595 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:46.611533 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6a1b8f57-204e-4024-aa13-5add82620595 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:46.612183 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6a1b8f57-204e-4024-aa13-5add82620595 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:46.613156 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6a1b8f57-204e-4024-aa13-5add82620595 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:46.613839 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6a1b8f57-204e-4024-aa13-5add82620595 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:46.614550 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6a1b8f57-204e-4024-aa13-5add82620595 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:46.855562 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-6a1b8f57-204e-4024-aa13-5add82620595 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96919ec99c14864876d64a9c2b20f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b44ce10b78bf49c882c9b4df06187114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:46.859112 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:40:46.864813 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-6a1b8f57-204e-4024-aa13-5add82620595 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] 10.222.0.33 "GET /compute/v2.1/servers/53f0a355-8a5d-4775-a0d3-3aeedfc01570" status: 200 len: 1505 microversion: 2.1 time: 0.278158 Oct 04 20:40:46.865616 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 897/1869] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:40:46 2022] GET /compute/v2.1/servers/53f0a355-8a5d-4775-a0d3-3aeedfc01570 => generated 1505 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:46.869833 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-954477da-6910-4cd7-a320-0c248a73abde req-51a37df2-fb23-4d18-98b9-7f76e4241dac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0dd1d0cf-a3a0-4ea2-8260-ac206bbfac88", "name": "network-vif-unplugged", "status": "completed", "tag": "5ef34720-ea76-4ea1-90bb-a255bf7dfe8b"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:40:46.880639 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-954477da-6910-4cd7-a320-0c248a73abde req-51a37df2-fb23-4d18-98b9-7f76e4241dac service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:46.881068 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-954477da-6910-4cd7-a320-0c248a73abde req-51a37df2-fb23-4d18-98b9-7f76e4241dac service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:46.881526 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-954477da-6910-4cd7-a320-0c248a73abde req-51a37df2-fb23-4d18-98b9-7f76e4241dac service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:46.894659 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-954477da-6910-4cd7-a320-0c248a73abde req-51a37df2-fb23-4d18-98b9-7f76e4241dac service nova] Creating event network-vif-unplugged:5ef34720-ea76-4ea1-90bb-a255bf7dfe8b for instance 0dd1d0cf-a3a0-4ea2-8260-ac206bbfac88 on n-h1-854823-8 Oct 04 20:40:46.899553 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-954477da-6910-4cd7-a320-0c248a73abde req-51a37df2-fb23-4d18-98b9-7f76e4241dac service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032977 Oct 04 20:40:46.900093 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 898/1870] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:40:46 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:40:46.905012 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d2ac15d7-03f0-42ce-886e-69f466376c41 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:46.905711 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d2ac15d7-03f0-42ce-886e-69f466376c41 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] [instance: d9c5805f-6cd2-4993-86b2-8a7546b62dd6] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:46.911952 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d2ac15d7-03f0-42ce-886e-69f466376c41 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:46.912462 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d2ac15d7-03f0-42ce-886e-69f466376c41 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:46.912923 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d2ac15d7-03f0-42ce-886e-69f466376c41 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:46.913629 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d2ac15d7-03f0-42ce-886e-69f466376c41 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:46.914163 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d2ac15d7-03f0-42ce-886e-69f466376c41 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:46.914670 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d2ac15d7-03f0-42ce-886e-69f466376c41 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:46.942834 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:40:46.948458 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d2ac15d7-03f0-42ce-886e-69f466376c41 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:46.948941 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d2ac15d7-03f0-42ce-886e-69f466376c41 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:46.949373 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d2ac15d7-03f0-42ce-886e-69f466376c41 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:46.949823 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-d2ac15d7-03f0-42ce-886e-69f466376c41 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lazy-loading 'fault' on Instance uuid d9c5805f-6cd2-4993-86b2-8a7546b62dd6 {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:40:47.002985 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d2ac15d7-03f0-42ce-886e-69f466376c41 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36f4114dc4f443f8b48da7b4027e0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a23a85365414f92bbc03177d7f190e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:47.010954 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d2ac15d7-03f0-42ce-886e-69f466376c41 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] 10.222.0.33 "GET /compute/v2.1/servers/d9c5805f-6cd2-4993-86b2-8a7546b62dd6" status: 200 len: 1307 microversion: 2.1 time: 0.109710 Oct 04 20:40:47.011538 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 899/1871] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:40:46 2022] GET /compute/v2.1/servers/d9c5805f-6cd2-4993-86b2-8a7546b62dd6 => generated 1307 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:47.016132 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1f105b68-9df3-4d59-908a-8b774c33d3b6 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:47.018603 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-1f105b68-9df3-4d59-908a-8b774c33d3b6 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] [instance: 81748c83-b703-4c68-899c-c575cc3340d2] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:47.024416 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1f105b68-9df3-4d59-908a-8b774c33d3b6 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:47.024895 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1f105b68-9df3-4d59-908a-8b774c33d3b6 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:47.025348 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1f105b68-9df3-4d59-908a-8b774c33d3b6 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:47.026306 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1f105b68-9df3-4d59-908a-8b774c33d3b6 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:47.026785 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1f105b68-9df3-4d59-908a-8b774c33d3b6 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:47.027204 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1f105b68-9df3-4d59-908a-8b774c33d3b6 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:47.059097 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-1f105b68-9df3-4d59-908a-8b774c33d3b6 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] 10.222.0.33 "GET /compute/v2.1/servers/81748c83-b703-4c68-899c-c575cc3340d2/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.046204 Oct 04 20:40:47.065375 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 900/1872] 10.222.0.33 () {60 vars in 1343 bytes} [Tue Oct 4 20:40:47 2022] GET /compute/v2.1/servers/81748c83-b703-4c68-899c-c575cc3340d2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 20:40:47.251931 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e5f6d296-05c5-4828-8d2a-65a6bae01d45 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:47.252776 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e5f6d296-05c5-4828-8d2a-65a6bae01d45 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] [instance: fd12aa25-6dbc-4f92-a2e1-83ae94ab83b4] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:47.260055 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e5f6d296-05c5-4828-8d2a-65a6bae01d45 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:47.260971 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e5f6d296-05c5-4828-8d2a-65a6bae01d45 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:47.267397 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e5f6d296-05c5-4828-8d2a-65a6bae01d45 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:47.269868 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e5f6d296-05c5-4828-8d2a-65a6bae01d45 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:47.271010 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e5f6d296-05c5-4828-8d2a-65a6bae01d45 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:47.271633 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e5f6d296-05c5-4828-8d2a-65a6bae01d45 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:47.528366 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e5f6d296-05c5-4828-8d2a-65a6bae01d45 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a82c49a62249029ebc6ae3b4829709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecf3793be3eb4f3186c07a7e45fd8f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:47.537879 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e5f6d296-05c5-4828-8d2a-65a6bae01d45 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] 10.222.0.33 "GET /compute/v2.1/servers/fd12aa25-6dbc-4f92-a2e1-83ae94ab83b4" status: 200 len: 1526 microversion: 2.1 time: 0.290445 Oct 04 20:40:47.548699 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 901/1873] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:40:47 2022] GET /compute/v2.1/servers/fd12aa25-6dbc-4f92-a2e1-83ae94ab83b4 => generated 1526 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:40:47.609763 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-230429e7-0539-4933-a948-7de31970580a tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:47.611133 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-230429e7-0539-4933-a948-7de31970580a tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] [instance: 0dd1d0cf-a3a0-4ea2-8260-ac206bbfac88] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:47.617219 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-230429e7-0539-4933-a948-7de31970580a tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:47.617779 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-230429e7-0539-4933-a948-7de31970580a tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:47.618275 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-230429e7-0539-4933-a948-7de31970580a tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:47.619079 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-230429e7-0539-4933-a948-7de31970580a tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:47.619532 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-230429e7-0539-4933-a948-7de31970580a tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:47.619981 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-230429e7-0539-4933-a948-7de31970580a tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:47.833473 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-230429e7-0539-4933-a948-7de31970580a tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bdfa818206f4f4b88cc962c1c34adf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4151c9ef7ae04a728306297f58ba5088', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:47.841731 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-230429e7-0539-4933-a948-7de31970580a tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] 10.222.0.33 "GET /compute/v2.1/servers/0dd1d0cf-a3a0-4ea2-8260-ac206bbfac88" status: 200 len: 1473 microversion: 2.1 time: 0.235768 Oct 04 20:40:47.842241 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 902/1874] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:40:47 2022] GET /compute/v2.1/servers/0dd1d0cf-a3a0-4ea2-8260-ac206bbfac88 => generated 1473 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:40:47.888293 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c521289b-f3e2-42a9-ad77-98fe65cf06c8 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:47.888935 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c521289b-f3e2-42a9-ad77-98fe65cf06c8 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] [instance: 53f0a355-8a5d-4775-a0d3-3aeedfc01570] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:47.895494 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c521289b-f3e2-42a9-ad77-98fe65cf06c8 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:47.896010 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c521289b-f3e2-42a9-ad77-98fe65cf06c8 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:47.896444 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c521289b-f3e2-42a9-ad77-98fe65cf06c8 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:47.897140 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c521289b-f3e2-42a9-ad77-98fe65cf06c8 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:47.897592 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c521289b-f3e2-42a9-ad77-98fe65cf06c8 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:47.898014 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c521289b-f3e2-42a9-ad77-98fe65cf06c8 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:48.111509 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c521289b-f3e2-42a9-ad77-98fe65cf06c8 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96919ec99c14864876d64a9c2b20f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b44ce10b78bf49c882c9b4df06187114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:48.119625 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c521289b-f3e2-42a9-ad77-98fe65cf06c8 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] 10.222.0.33 "GET /compute/v2.1/servers/53f0a355-8a5d-4775-a0d3-3aeedfc01570" status: 200 len: 1505 microversion: 2.1 time: 0.235162 Oct 04 20:40:48.120489 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 903/1875] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:40:47 2022] GET /compute/v2.1/servers/53f0a355-8a5d-4775-a0d3-3aeedfc01570 => generated 1505 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:40:48.125272 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b3982a22-5197-48c4-bb9b-b873218f30f1 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:48.126491 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b3982a22-5197-48c4-bb9b-b873218f30f1 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] [instance: d9c5805f-6cd2-4993-86b2-8a7546b62dd6] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:48.147615 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b3982a22-5197-48c4-bb9b-b873218f30f1 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:48.148117 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b3982a22-5197-48c4-bb9b-b873218f30f1 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:48.148584 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b3982a22-5197-48c4-bb9b-b873218f30f1 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:48.149309 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b3982a22-5197-48c4-bb9b-b873218f30f1 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:48.149765 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b3982a22-5197-48c4-bb9b-b873218f30f1 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:48.150211 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b3982a22-5197-48c4-bb9b-b873218f30f1 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:48.168107 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-b3982a22-5197-48c4-bb9b-b873218f30f1 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] HTTP exception thrown: Instance d9c5805f-6cd2-4993-86b2-8a7546b62dd6 could not be found. Oct 04 20:40:48.170030 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b3982a22-5197-48c4-bb9b-b873218f30f1 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Request method failure captured: Oct 04 20:40:48.170030 n-d-854823-8 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/d9c5805f-6cd2-4993-86b2-8a7546b62dd6 HTTP/1.1 Oct 04 20:40:48.170030 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:40:48.170030 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:40:48.170030 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:40:48.170030 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 0 Oct 04 20:40:48.170030 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:40:48.170030 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:40:48.170030 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:40:48.170030 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:40:48.170030 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJmeqrgxMn_vD-ao9MwjUJsz467_UAHW--vO2J2bMBYcsyRLhLo6Qj0nbEneOIdoi1LyiMNoKFQexjywspnMbrI5Aae3ew90UDzKQnlSm-j4NlsTEmvIdX9JuBz7NdY6Hhk6Az56PzRPsjCNW7LpLzJRfXCMnPsMFpfxnfuJgRzeSWg Oct 04 20:40:48.170030 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:40:48.170030 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:40:48.170030 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:40:48.170030 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:40:48.170030 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:40:48.170030 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:40:48.170030 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: 1a23a85365414f92bbc03177d7f190e6 Oct 04 20:40:48.170030 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-ServersOnMultiNodesTest-1191352258 Oct 04 20:40:48.170030 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 20:40:48.170030 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 20:40:48.170030 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_1a23a85365414f92bbc03177d7f190e6", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1a23a85365414f92bbc03177d7f190e6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1a23a85365414f92bbc03177d7f190e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/1a23a85365414f92bbc03177d7f190e6"}]}] Oct 04 20:40:48.170030 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-ServersOnMultiNodesTest-1191352258 Oct 04 20:40:48.170030 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: 1a23a85365414f92bbc03177d7f190e6 Oct 04 20:40:48.170030 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1191352258 Oct 04 20:40:48.170030 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-ServersOnMultiNodesTest-1191352258-project Oct 04 20:40:48.170030 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:40:48.170030 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:40:48.170030 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: e36f4114dc4f443f8b48da7b4027e0c1 Oct 04 20:40:48.170030 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-ServersOnMultiNodesTest-1191352258-project Oct 04 20:40:48.170030 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 20:40:48.170030 n-d-854823-8 devstack@n-api.service[128801]: exception: Instance d9c5805f-6cd2-4993-86b2-8a7546b62dd6 could not be found. Oct 04 20:40:48.170030 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': 'd9c5805f-6cd2-4993-86b2-8a7546b62dd6'} Oct 04 20:40:48.170030 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:40:48.170030 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:40:48.170030 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:40:48.170030 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:40:48.170030 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:40:48.170030 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:40:48.170030 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:40:48.170030 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:40:48.170030 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:40:48.170030 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:40:48.170030 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d9c5805f-6cd2-4993-86b2-8a7546b62dd6 could not be found. Oct 04 20:40:48.170030 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:40:48.170030 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:40:48.170030 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:40:48.170030 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:40:48.170030 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:40:48.170030 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:40:48.170030 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:40:48.170030 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:40:48.170030 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:40:48.170030 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:40:48.170030 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:40:48.170030 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:40:48.170030 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:40:48.170030 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:40:48.170030 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:40:48.170030 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:40:48.170030 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d9c5805f-6cd2-4993-86b2-8a7546b62dd6 could not be found. Oct 04 20:40:48.170030 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:40:48.170030 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:40:48.170030 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:40:48.176598 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:40:48.176598 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:40:48.176598 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:40:48.176598 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:40:48.176598 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:40:48.176598 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d9c5805f-6cd2-4993-86b2-8a7546b62dd6 could not be found. Oct 04 20:40:48.176598 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:40:48.176598 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b3982a22-5197-48c4-bb9b-b873218f30f1 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Returning 404 to user: Instance d9c5805f-6cd2-4993-86b2-8a7546b62dd6 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:40:48.176598 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b3982a22-5197-48c4-bb9b-b873218f30f1 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] 10.222.0.33 "GET /compute/v2.1/servers/d9c5805f-6cd2-4993-86b2-8a7546b62dd6" status: 404 len: 111 microversion: 2.1 time: 0.049781 Oct 04 20:40:48.176598 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 904/1876] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:40:48 2022] GET /compute/v2.1/servers/d9c5805f-6cd2-4993-86b2-8a7546b62dd6 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:40:48.180725 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-662731d7-2a93-4b2b-94fc-67ccb31867f6 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:48.183622 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-662731d7-2a93-4b2b-94fc-67ccb31867f6 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] [instance: 81748c83-b703-4c68-899c-c575cc3340d2] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:48.190462 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-662731d7-2a93-4b2b-94fc-67ccb31867f6 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:48.190962 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-662731d7-2a93-4b2b-94fc-67ccb31867f6 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:48.191468 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-662731d7-2a93-4b2b-94fc-67ccb31867f6 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:48.192125 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-662731d7-2a93-4b2b-94fc-67ccb31867f6 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:48.192573 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-662731d7-2a93-4b2b-94fc-67ccb31867f6 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:48.193002 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-662731d7-2a93-4b2b-94fc-67ccb31867f6 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:48.240465 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-662731d7-2a93-4b2b-94fc-67ccb31867f6 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] 10.222.0.33 "GET /compute/v2.1/servers/81748c83-b703-4c68-899c-c575cc3340d2/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.063473 Oct 04 20:40:48.241057 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 905/1877] 10.222.0.33 () {60 vars in 1343 bytes} [Tue Oct 4 20:40:48 2022] GET /compute/v2.1/servers/81748c83-b703-4c68-899c-c575cc3340d2/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 20:40:48.246723 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-bf4719ab-73f3-4acd-94c2-75697171a4c3 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:48.247646 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-bf4719ab-73f3-4acd-94c2-75697171a4c3 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] [instance: 55d73a76-3d5e-426c-8a99-9cae92f8498b] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:48.254817 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bf4719ab-73f3-4acd-94c2-75697171a4c3 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:48.255871 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bf4719ab-73f3-4acd-94c2-75697171a4c3 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:48.256502 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bf4719ab-73f3-4acd-94c2-75697171a4c3 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:48.257392 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bf4719ab-73f3-4acd-94c2-75697171a4c3 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:48.258011 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bf4719ab-73f3-4acd-94c2-75697171a4c3 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:48.259269 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bf4719ab-73f3-4acd-94c2-75697171a4c3 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:48.294519 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-bf4719ab-73f3-4acd-94c2-75697171a4c3 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] [instance: 55d73a76-3d5e-426c-8a99-9cae92f8498b] Going to try to terminate instance {{(pid=128801) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:40:48.417122 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-bf4719ab-73f3-4acd-94c2-75697171a4c3 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] 10.222.0.33 "DELETE /compute/v2.1/servers/55d73a76-3d5e-426c-8a99-9cae92f8498b" status: 204 len: 0 microversion: 2.1 time: 0.174212 Oct 04 20:40:48.417993 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 906/1878] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 20:40:48 2022] DELETE /compute/v2.1/servers/55d73a76-3d5e-426c-8a99-9cae92f8498b => generated 0 bytes in 176 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:40:48.428911 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1f264915-ea4c-4559-81ff-841a8f8ddb34 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:48.431294 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-1f264915-ea4c-4559-81ff-841a8f8ddb34 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] [instance: a1e8b81b-5e26-4d5c-87ca-057eea43abba] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:48.438895 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1f264915-ea4c-4559-81ff-841a8f8ddb34 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:48.439830 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1f264915-ea4c-4559-81ff-841a8f8ddb34 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:48.440528 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1f264915-ea4c-4559-81ff-841a8f8ddb34 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:48.441781 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1f264915-ea4c-4559-81ff-841a8f8ddb34 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:48.442643 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1f264915-ea4c-4559-81ff-841a8f8ddb34 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:48.443300 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1f264915-ea4c-4559-81ff-841a8f8ddb34 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:48.482781 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-1f264915-ea4c-4559-81ff-841a8f8ddb34 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] [instance: a1e8b81b-5e26-4d5c-87ca-057eea43abba] Going to try to terminate instance {{(pid=128801) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:40:48.623568 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-1f264915-ea4c-4559-81ff-841a8f8ddb34 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] 10.222.0.33 "DELETE /compute/v2.1/servers/a1e8b81b-5e26-4d5c-87ca-057eea43abba" status: 204 len: 0 microversion: 2.1 time: 0.200226 Oct 04 20:40:48.625472 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 907/1879] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 20:40:48 2022] DELETE /compute/v2.1/servers/a1e8b81b-5e26-4d5c-87ca-057eea43abba => generated 0 bytes in 204 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:40:48.635123 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a91699e5-08c1-4294-b60a-debc46af5959 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:48.635757 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a91699e5-08c1-4294-b60a-debc46af5959 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] [instance: fd12aa25-6dbc-4f92-a2e1-83ae94ab83b4] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:48.643673 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a91699e5-08c1-4294-b60a-debc46af5959 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:48.644166 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a91699e5-08c1-4294-b60a-debc46af5959 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:48.644598 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a91699e5-08c1-4294-b60a-debc46af5959 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:48.645298 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a91699e5-08c1-4294-b60a-debc46af5959 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:48.645747 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a91699e5-08c1-4294-b60a-debc46af5959 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:48.646161 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a91699e5-08c1-4294-b60a-debc46af5959 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:48.918229 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-03ecf0c5-d0c2-4d72-aff5-8b52c4253c01 tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/83df4756-40e2-4fc6-be48-48a82dd4572a/action" status: 202 len: 0 microversion: 2.1 time: 3.361671 Oct 04 20:40:48.920031 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 973/1880] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 20:40:45 2022] POST /compute/v2.1/servers/83df4756-40e2-4fc6-be48-48a82dd4572a/action => generated 0 bytes in 3364 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:40:48.926432 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-236952f2-9a89-43eb-a069-efa0ea6630bd tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:48.927579 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-236952f2-9a89-43eb-a069-efa0ea6630bd tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] [instance: 55d73a76-3d5e-426c-8a99-9cae92f8498b] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:48.932408 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-a91699e5-08c1-4294-b60a-debc46af5959 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a82c49a62249029ebc6ae3b4829709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecf3793be3eb4f3186c07a7e45fd8f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:48.944322 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a91699e5-08c1-4294-b60a-debc46af5959 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] 10.222.0.33 "GET /compute/v2.1/servers/fd12aa25-6dbc-4f92-a2e1-83ae94ab83b4" status: 200 len: 1526 microversion: 2.1 time: 0.317348 Oct 04 20:40:48.944984 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 908/1881] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:40:48 2022] GET /compute/v2.1/servers/fd12aa25-6dbc-4f92-a2e1-83ae94ab83b4 => generated 1526 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:48.963085 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-236952f2-9a89-43eb-a069-efa0ea6630bd tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:48.964198 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-236952f2-9a89-43eb-a069-efa0ea6630bd tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:48.967257 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b5918e8b-1c15-43b4-81de-57a6fb9b2e0c tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:48.967910 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b5918e8b-1c15-43b4-81de-57a6fb9b2e0c tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] [instance: 0dd1d0cf-a3a0-4ea2-8260-ac206bbfac88] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:48.974600 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b5918e8b-1c15-43b4-81de-57a6fb9b2e0c tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:48.975096 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b5918e8b-1c15-43b4-81de-57a6fb9b2e0c tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:48.975531 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b5918e8b-1c15-43b4-81de-57a6fb9b2e0c tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:48.976246 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b5918e8b-1c15-43b4-81de-57a6fb9b2e0c tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:48.976697 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b5918e8b-1c15-43b4-81de-57a6fb9b2e0c tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:48.977364 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b5918e8b-1c15-43b4-81de-57a6fb9b2e0c tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:48.979953 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-236952f2-9a89-43eb-a069-efa0ea6630bd tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:48.981093 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-236952f2-9a89-43eb-a069-efa0ea6630bd tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:48.981997 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-236952f2-9a89-43eb-a069-efa0ea6630bd tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:48.982985 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-236952f2-9a89-43eb-a069-efa0ea6630bd tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:49.258008 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-b5918e8b-1c15-43b4-81de-57a6fb9b2e0c tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bdfa818206f4f4b88cc962c1c34adf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4151c9ef7ae04a728306297f58ba5088', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:49.269921 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b5918e8b-1c15-43b4-81de-57a6fb9b2e0c tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] 10.222.0.33 "GET /compute/v2.1/servers/0dd1d0cf-a3a0-4ea2-8260-ac206bbfac88" status: 200 len: 1473 microversion: 2.1 time: 0.306442 Oct 04 20:40:49.270541 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 909/1882] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:40:48 2022] GET /compute/v2.1/servers/0dd1d0cf-a3a0-4ea2-8260-ac206bbfac88 => generated 1473 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:49.278510 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0d5eb2fe-e692-4305-9eed-eba0fd5c393f tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:49.282851 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-0d5eb2fe-e692-4305-9eed-eba0fd5c393f tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] [instance: 83df4756-40e2-4fc6-be48-48a82dd4572a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:49.290416 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-236952f2-9a89-43eb-a069-efa0ea6630bd tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36f4114dc4f443f8b48da7b4027e0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a23a85365414f92bbc03177d7f190e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:49.294679 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0d5eb2fe-e692-4305-9eed-eba0fd5c393f tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:49.295172 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0d5eb2fe-e692-4305-9eed-eba0fd5c393f tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:49.295610 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0d5eb2fe-e692-4305-9eed-eba0fd5c393f tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:49.296334 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0d5eb2fe-e692-4305-9eed-eba0fd5c393f tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:49.296776 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0d5eb2fe-e692-4305-9eed-eba0fd5c393f tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:49.297199 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0d5eb2fe-e692-4305-9eed-eba0fd5c393f tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:49.310542 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-236952f2-9a89-43eb-a069-efa0ea6630bd tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] 10.222.0.33 "GET /compute/v2.1/servers/55d73a76-3d5e-426c-8a99-9cae92f8498b" status: 200 len: 1474 microversion: 2.1 time: 0.377730 Oct 04 20:40:49.311357 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 974/1883] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:40:48 2022] GET /compute/v2.1/servers/55d73a76-3d5e-426c-8a99-9cae92f8498b => generated 1474 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:49.316319 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-46b72517-e322-41ee-a5ba-e0ba81656937 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:49.323051 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-46b72517-e322-41ee-a5ba-e0ba81656937 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] [instance: 53f0a355-8a5d-4775-a0d3-3aeedfc01570] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:49.341344 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-46b72517-e322-41ee-a5ba-e0ba81656937 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:49.341841 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-46b72517-e322-41ee-a5ba-e0ba81656937 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:49.346177 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-46b72517-e322-41ee-a5ba-e0ba81656937 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:49.347288 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-46b72517-e322-41ee-a5ba-e0ba81656937 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:49.347933 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-46b72517-e322-41ee-a5ba-e0ba81656937 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:49.348550 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-46b72517-e322-41ee-a5ba-e0ba81656937 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:49.579413 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-0d5eb2fe-e692-4305-9eed-eba0fd5c393f tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '800db3a57ada47eca381b00189fdbf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66ec8ea91b04deb90b679589e0495bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:49.593626 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-0d5eb2fe-e692-4305-9eed-eba0fd5c393f tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] 10.222.0.33 "GET /compute/v2.1/servers/83df4756-40e2-4fc6-be48-48a82dd4572a" status: 200 len: 1718 microversion: 2.1 time: 0.322029 Oct 04 20:40:49.594639 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 910/1884] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:40:49 2022] GET /compute/v2.1/servers/83df4756-40e2-4fc6-be48-48a82dd4572a => generated 1718 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:49.621118 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6aa6a420-b4ce-4f6b-bfaa-d9970b9d00fc tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:49.623439 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-6aa6a420-b4ce-4f6b-bfaa-d9970b9d00fc tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] [instance: 81748c83-b703-4c68-899c-c575cc3340d2] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:49.632414 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6aa6a420-b4ce-4f6b-bfaa-d9970b9d00fc tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:49.632908 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6aa6a420-b4ce-4f6b-bfaa-d9970b9d00fc tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:49.633345 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6aa6a420-b4ce-4f6b-bfaa-d9970b9d00fc tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:49.634053 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6aa6a420-b4ce-4f6b-bfaa-d9970b9d00fc tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:49.634544 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6aa6a420-b4ce-4f6b-bfaa-d9970b9d00fc tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:49.634973 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6aa6a420-b4ce-4f6b-bfaa-d9970b9d00fc tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:49.657459 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-46b72517-e322-41ee-a5ba-e0ba81656937 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96919ec99c14864876d64a9c2b20f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b44ce10b78bf49c882c9b4df06187114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:49.667035 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-46b72517-e322-41ee-a5ba-e0ba81656937 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] 10.222.0.33 "GET /compute/v2.1/servers/53f0a355-8a5d-4775-a0d3-3aeedfc01570" status: 200 len: 1505 microversion: 2.1 time: 0.354543 Oct 04 20:40:49.669993 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 975/1885] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:40:49 2022] GET /compute/v2.1/servers/53f0a355-8a5d-4775-a0d3-3aeedfc01570 => generated 1505 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:49.727693 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-6aa6a420-b4ce-4f6b-bfaa-d9970b9d00fc tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] 10.222.0.33 "GET /compute/v2.1/servers/81748c83-b703-4c68-899c-c575cc3340d2/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.119908 Oct 04 20:40:49.730677 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 911/1886] 10.222.0.33 () {60 vars in 1343 bytes} [Tue Oct 4 20:40:49 2022] GET /compute/v2.1/servers/81748c83-b703-4c68-899c-c575cc3340d2/os-volume_attachments => generated 197 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 20:40:49.969060 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-39d9e352-fc03-44a8-a4f4-e5a956a55fcf tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:49.970142 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-39d9e352-fc03-44a8-a4f4-e5a956a55fcf tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] [instance: fd12aa25-6dbc-4f92-a2e1-83ae94ab83b4] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:49.978237 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-39d9e352-fc03-44a8-a4f4-e5a956a55fcf tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:49.979144 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-39d9e352-fc03-44a8-a4f4-e5a956a55fcf tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:49.979808 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-39d9e352-fc03-44a8-a4f4-e5a956a55fcf tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:49.980734 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-39d9e352-fc03-44a8-a4f4-e5a956a55fcf tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:49.981786 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-39d9e352-fc03-44a8-a4f4-e5a956a55fcf tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:49.982805 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-39d9e352-fc03-44a8-a4f4-e5a956a55fcf tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:50.296253 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5525e555-de24-4b80-b640-b71d298fafcb tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:50.297142 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-5525e555-de24-4b80-b640-b71d298fafcb tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] [instance: 0dd1d0cf-a3a0-4ea2-8260-ac206bbfac88] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:50.311954 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5525e555-de24-4b80-b640-b71d298fafcb tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:50.315733 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5525e555-de24-4b80-b640-b71d298fafcb tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:50.316373 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5525e555-de24-4b80-b640-b71d298fafcb tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:50.318058 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5525e555-de24-4b80-b640-b71d298fafcb tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:50.318747 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5525e555-de24-4b80-b640-b71d298fafcb tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:50.320115 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5525e555-de24-4b80-b640-b71d298fafcb tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:50.331325 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:40:50.389220 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-39d9e352-fc03-44a8-a4f4-e5a956a55fcf tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89a82c49a62249029ebc6ae3b4829709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecf3793be3eb4f3186c07a7e45fd8f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:50.398637 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-39d9e352-fc03-44a8-a4f4-e5a956a55fcf tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] 10.222.0.33 "GET /compute/v2.1/servers/fd12aa25-6dbc-4f92-a2e1-83ae94ab83b4" status: 200 len: 1526 microversion: 2.1 time: 0.432266 Oct 04 20:40:50.414570 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 976/1887] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:40:49 2022] GET /compute/v2.1/servers/fd12aa25-6dbc-4f92-a2e1-83ae94ab83b4 => generated 1526 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:50.419675 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-2e86c0c9-c73d-4814-b519-b1058056e6b6 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:50.420550 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-2e86c0c9-c73d-4814-b519-b1058056e6b6 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] [instance: 55d73a76-3d5e-426c-8a99-9cae92f8498b] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:50.428545 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2e86c0c9-c73d-4814-b519-b1058056e6b6 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:50.429303 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2e86c0c9-c73d-4814-b519-b1058056e6b6 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:50.429911 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2e86c0c9-c73d-4814-b519-b1058056e6b6 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:50.430793 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2e86c0c9-c73d-4814-b519-b1058056e6b6 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:50.431403 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2e86c0c9-c73d-4814-b519-b1058056e6b6 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:50.431972 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2e86c0c9-c73d-4814-b519-b1058056e6b6 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:51.089776 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-5525e555-de24-4b80-b640-b71d298fafcb tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bdfa818206f4f4b88cc962c1c34adf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4151c9ef7ae04a728306297f58ba5088', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:51.100463 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5525e555-de24-4b80-b640-b71d298fafcb tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] 10.222.0.33 "GET /compute/v2.1/servers/0dd1d0cf-a3a0-4ea2-8260-ac206bbfac88" status: 200 len: 1473 microversion: 2.1 time: 0.809602 Oct 04 20:40:51.113157 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-2e86c0c9-c73d-4814-b519-b1058056e6b6 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36f4114dc4f443f8b48da7b4027e0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a23a85365414f92bbc03177d7f190e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:51.120766 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 912/1888] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:40:50 2022] GET /compute/v2.1/servers/0dd1d0cf-a3a0-4ea2-8260-ac206bbfac88 => generated 1473 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:51.127489 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-2e86c0c9-c73d-4814-b519-b1058056e6b6 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] 10.222.0.33 "GET /compute/v2.1/servers/55d73a76-3d5e-426c-8a99-9cae92f8498b" status: 200 len: 1474 microversion: 2.1 time: 0.709382 Oct 04 20:40:51.143133 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c4ffab7c-57d8-4528-b853-9b196d80feb2 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:51.143133 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c4ffab7c-57d8-4528-b853-9b196d80feb2 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] [instance: 83df4756-40e2-4fc6-be48-48a82dd4572a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:51.146090 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 977/1889] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:40:50 2022] GET /compute/v2.1/servers/55d73a76-3d5e-426c-8a99-9cae92f8498b => generated 1474 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:51.153372 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c4ffab7c-57d8-4528-b853-9b196d80feb2 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:51.153876 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c4ffab7c-57d8-4528-b853-9b196d80feb2 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:51.159252 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c4ffab7c-57d8-4528-b853-9b196d80feb2 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:51.160485 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-ebaa6210-f705-4a95-b769-5d2dd94873ca tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:51.161340 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-ebaa6210-f705-4a95-b769-5d2dd94873ca tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] [instance: 53f0a355-8a5d-4775-a0d3-3aeedfc01570] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:51.162308 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c4ffab7c-57d8-4528-b853-9b196d80feb2 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:51.166002 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c4ffab7c-57d8-4528-b853-9b196d80feb2 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:51.166757 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c4ffab7c-57d8-4528-b853-9b196d80feb2 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:51.185488 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ebaa6210-f705-4a95-b769-5d2dd94873ca tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:51.190065 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ebaa6210-f705-4a95-b769-5d2dd94873ca tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:51.190773 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ebaa6210-f705-4a95-b769-5d2dd94873ca tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:51.193805 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ebaa6210-f705-4a95-b769-5d2dd94873ca tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:51.194598 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ebaa6210-f705-4a95-b769-5d2dd94873ca tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:51.195223 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ebaa6210-f705-4a95-b769-5d2dd94873ca tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:51.895450 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-ebaa6210-f705-4a95-b769-5d2dd94873ca tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96919ec99c14864876d64a9c2b20f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b44ce10b78bf49c882c9b4df06187114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:51.926560 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-ebaa6210-f705-4a95-b769-5d2dd94873ca tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] 10.222.0.33 "GET /compute/v2.1/servers/53f0a355-8a5d-4775-a0d3-3aeedfc01570" status: 200 len: 1505 microversion: 2.1 time: 0.776261 Oct 04 20:40:51.926819 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c4ffab7c-57d8-4528-b853-9b196d80feb2 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '800db3a57ada47eca381b00189fdbf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66ec8ea91b04deb90b679589e0495bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:51.928658 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 978/1890] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:40:51 2022] GET /compute/v2.1/servers/53f0a355-8a5d-4775-a0d3-3aeedfc01570 => generated 1505 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:51.944609 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c4ffab7c-57d8-4528-b853-9b196d80feb2 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] 10.222.0.33 "GET /compute/v2.1/servers/83df4756-40e2-4fc6-be48-48a82dd4572a" status: 200 len: 1718 microversion: 2.1 time: 0.822502 Oct 04 20:40:51.945550 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-d0d3ec4b-0142-4f42-9f7d-72453b3e222a req-db0ca8ff-48d7-4a78-a0b2-65c6c1170ffe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd12aa25-6dbc-4f92-a2e1-83ae94ab83b4", "name": "network-vif-deleted", "tag": "277f1cea-7772-4f31-88f2-7e690a93cf8f"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:40:51.961119 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 913/1891] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:40:51 2022] GET /compute/v2.1/servers/83df4756-40e2-4fc6-be48-48a82dd4572a => generated 1718 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:51.971321 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-fb6b69dc-8839-484c-9e7e-7f22546444b5 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:51.976653 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-fb6b69dc-8839-484c-9e7e-7f22546444b5 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] [instance: 81748c83-b703-4c68-899c-c575cc3340d2] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:51.989113 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fb6b69dc-8839-484c-9e7e-7f22546444b5 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:51.991126 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-d0d3ec4b-0142-4f42-9f7d-72453b3e222a req-db0ca8ff-48d7-4a78-a0b2-65c6c1170ffe service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:51.991552 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fb6b69dc-8839-484c-9e7e-7f22546444b5 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:51.992030 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fb6b69dc-8839-484c-9e7e-7f22546444b5 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:51.992767 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fb6b69dc-8839-484c-9e7e-7f22546444b5 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:51.993237 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fb6b69dc-8839-484c-9e7e-7f22546444b5 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:51.993666 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fb6b69dc-8839-484c-9e7e-7f22546444b5 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:51.994694 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-d0d3ec4b-0142-4f42-9f7d-72453b3e222a req-db0ca8ff-48d7-4a78-a0b2-65c6c1170ffe service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:51.996900 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-d0d3ec4b-0142-4f42-9f7d-72453b3e222a req-db0ca8ff-48d7-4a78-a0b2-65c6c1170ffe service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:52.027394 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-d0d3ec4b-0142-4f42-9f7d-72453b3e222a req-db0ca8ff-48d7-4a78-a0b2-65c6c1170ffe service nova] Creating event network-vif-deleted:277f1cea-7772-4f31-88f2-7e690a93cf8f for instance fd12aa25-6dbc-4f92-a2e1-83ae94ab83b4 on n-h1-854823-8 Oct 04 20:40:52.038710 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-d0d3ec4b-0142-4f42-9f7d-72453b3e222a req-db0ca8ff-48d7-4a78-a0b2-65c6c1170ffe service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107215 Oct 04 20:40:52.040977 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 979/1892] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:40:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:40:52.054941 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-097f90f7-b264-467d-b38e-f762c3f8c06c req-7fe957f5-d06b-4ea4-be45-22a8cdc8878b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0dd1d0cf-a3a0-4ea2-8260-ac206bbfac88", "name": "network-vif-deleted", "tag": "5ef34720-ea76-4ea1-90bb-a255bf7dfe8b"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:40:52.063993 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-fb6b69dc-8839-484c-9e7e-7f22546444b5 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] 10.222.0.33 "GET /compute/v2.1/servers/81748c83-b703-4c68-899c-c575cc3340d2/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.113064 Oct 04 20:40:52.074802 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 914/1893] 10.222.0.33 () {60 vars in 1343 bytes} [Tue Oct 4 20:40:51 2022] GET /compute/v2.1/servers/81748c83-b703-4c68-899c-c575cc3340d2/os-volume_attachments => generated 197 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 20:40:52.079898 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-097f90f7-b264-467d-b38e-f762c3f8c06c req-7fe957f5-d06b-4ea4-be45-22a8cdc8878b service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:52.080438 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c9f81ba8-2002-4470-9a57-2834fe00fc4b tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:52.081192 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c9f81ba8-2002-4470-9a57-2834fe00fc4b tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] [instance: fd12aa25-6dbc-4f92-a2e1-83ae94ab83b4] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:52.082041 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-097f90f7-b264-467d-b38e-f762c3f8c06c req-7fe957f5-d06b-4ea4-be45-22a8cdc8878b service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:52.083721 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-097f90f7-b264-467d-b38e-f762c3f8c06c req-7fe957f5-d06b-4ea4-be45-22a8cdc8878b service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:52.094463 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c9f81ba8-2002-4470-9a57-2834fe00fc4b tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:52.094977 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c9f81ba8-2002-4470-9a57-2834fe00fc4b tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:52.095508 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c9f81ba8-2002-4470-9a57-2834fe00fc4b tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:52.096231 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c9f81ba8-2002-4470-9a57-2834fe00fc4b tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:52.096692 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c9f81ba8-2002-4470-9a57-2834fe00fc4b tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:52.097124 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c9f81ba8-2002-4470-9a57-2834fe00fc4b tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:52.113494 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-097f90f7-b264-467d-b38e-f762c3f8c06c req-7fe957f5-d06b-4ea4-be45-22a8cdc8878b service nova] Creating event network-vif-deleted:5ef34720-ea76-4ea1-90bb-a255bf7dfe8b for instance 0dd1d0cf-a3a0-4ea2-8260-ac206bbfac88 on n-h1-854823-8 Oct 04 20:40:52.122722 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-c9f81ba8-2002-4470-9a57-2834fe00fc4b tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] HTTP exception thrown: Instance fd12aa25-6dbc-4f92-a2e1-83ae94ab83b4 could not be found. Oct 04 20:40:52.125328 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c9f81ba8-2002-4470-9a57-2834fe00fc4b tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Request method failure captured: Oct 04 20:40:52.125328 n-d-854823-8 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/fd12aa25-6dbc-4f92-a2e1-83ae94ab83b4 HTTP/1.1 Oct 04 20:40:52.125328 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:40:52.125328 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:40:52.125328 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:40:52.125328 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 0 Oct 04 20:40:52.125328 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:40:52.125328 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:40:52.125328 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:40:52.125328 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:40:52.125328 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJndB3mJHN0LJ8w6Kheb2n0CJ86k8j-AXdWa3AMW_tNY1_9QQNH8dAe8aGzPWpNIRLrfkOudQ5X3ptj4NBqufJdfAt-Rzg0K2bAeHF3DIzHVwi3Ysg8-zRwFjrbgaapzSsHDGJy5Rd6NQfSoCIrbX0y1TKi0r3vLuM4ZTrt6iTVd_LI Oct 04 20:40:52.125328 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:40:52.125328 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:40:52.125328 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:40:52.125328 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:40:52.125328 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:40:52.125328 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:40:52.125328 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: ecf3793be3eb4f3186c07a7e45fd8f06 Oct 04 20:40:52.125328 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-957462329 Oct 04 20:40:52.125328 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 20:40:52.125328 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 20:40:52.125328 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ecf3793be3eb4f3186c07a7e45fd8f06", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ecf3793be3eb4f3186c07a7e45fd8f06"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ecf3793be3eb4f3186c07a7e45fd8f06"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ecf3793be3eb4f3186c07a7e45fd8f06"}]}] Oct 04 20:40:52.125328 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-957462329 Oct 04 20:40:52.125328 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: ecf3793be3eb4f3186c07a7e45fd8f06 Oct 04 20:40:52.125328 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-957462329 Oct 04 20:40:52.125328 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-ImagesOneServerNegativeTestJSON-957462329-project Oct 04 20:40:52.125328 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:40:52.125328 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:40:52.125328 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: 89a82c49a62249029ebc6ae3b4829709 Oct 04 20:40:52.125328 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-957462329-project Oct 04 20:40:52.125328 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 20:40:52.125328 n-d-854823-8 devstack@n-api.service[128801]: exception: Instance fd12aa25-6dbc-4f92-a2e1-83ae94ab83b4 could not be found. Oct 04 20:40:52.125328 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': 'fd12aa25-6dbc-4f92-a2e1-83ae94ab83b4'} Oct 04 20:40:52.125328 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:40:52.125328 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:40:52.125328 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:40:52.125328 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:40:52.125328 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:40:52.125328 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:40:52.125328 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:40:52.125328 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:40:52.125328 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:40:52.125328 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:40:52.125328 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd12aa25-6dbc-4f92-a2e1-83ae94ab83b4 could not be found. Oct 04 20:40:52.125328 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:40:52.125328 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:40:52.125328 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:40:52.125328 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:40:52.125328 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:40:52.125328 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:40:52.125328 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:40:52.125328 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:40:52.125328 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:40:52.125328 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:40:52.125328 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:40:52.125328 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:40:52.125328 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:40:52.125328 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:40:52.125328 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:40:52.125328 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:40:52.125328 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd12aa25-6dbc-4f92-a2e1-83ae94ab83b4 could not be found. Oct 04 20:40:52.125328 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:40:52.125328 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:40:52.130237 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:40:52.130237 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:40:52.130237 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:40:52.130237 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:40:52.130237 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:40:52.130237 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:40:52.130237 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd12aa25-6dbc-4f92-a2e1-83ae94ab83b4 could not be found. Oct 04 20:40:52.130237 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:40:52.130237 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c9f81ba8-2002-4470-9a57-2834fe00fc4b tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Returning 404 to user: Instance fd12aa25-6dbc-4f92-a2e1-83ae94ab83b4 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:40:52.130237 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c9f81ba8-2002-4470-9a57-2834fe00fc4b tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] 10.222.0.33 "GET /compute/v2.1/servers/fd12aa25-6dbc-4f92-a2e1-83ae94ab83b4" status: 404 len: 111 microversion: 2.1 time: 0.052081 Oct 04 20:40:52.130237 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 915/1894] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:40:52 2022] GET /compute/v2.1/servers/fd12aa25-6dbc-4f92-a2e1-83ae94ab83b4 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:40:52.133855 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-097f90f7-b264-467d-b38e-f762c3f8c06c req-7fe957f5-d06b-4ea4-be45-22a8cdc8878b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090119 Oct 04 20:40:52.136697 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 980/1895] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:40:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:40:52.137514 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-091c9f1b-a714-4fde-bb6a-b6604c146d09 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:52.138151 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-091c9f1b-a714-4fde-bb6a-b6604c146d09 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] [instance: 0dd1d0cf-a3a0-4ea2-8260-ac206bbfac88] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:52.146214 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-091c9f1b-a714-4fde-bb6a-b6604c146d09 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:52.146745 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-091c9f1b-a714-4fde-bb6a-b6604c146d09 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:52.147288 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-091c9f1b-a714-4fde-bb6a-b6604c146d09 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:52.148084 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-091c9f1b-a714-4fde-bb6a-b6604c146d09 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:52.148451 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-091c9f1b-a714-4fde-bb6a-b6604c146d09 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:52.149026 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-091c9f1b-a714-4fde-bb6a-b6604c146d09 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:52.155526 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-02466ac7-2efb-4e4b-bc37-d45e93fb6b19 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Calling method '.version_select at 0x7f3c78a27040>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:52.184537 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-091c9f1b-a714-4fde-bb6a-b6604c146d09 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:52.184744 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-091c9f1b-a714-4fde-bb6a-b6604c146d09 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:52.185180 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-091c9f1b-a714-4fde-bb6a-b6604c146d09 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:52.185716 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-091c9f1b-a714-4fde-bb6a-b6604c146d09 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Lazy-loading 'fault' on Instance uuid 0dd1d0cf-a3a0-4ea2-8260-ac206bbfac88 {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:40:52.210073 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.wsgi [None req-02466ac7-2efb-4e4b-bc37-d45e93fb6b19 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] HTTP exception thrown: Image not found. Oct 04 20:40:52.212192 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-02466ac7-2efb-4e4b-bc37-d45e93fb6b19 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Request method failure captured: Oct 04 20:40:52.212192 n-d-854823-8 devstack@n-api.service[128802]: request: DELETE /compute/v2.1/images/96ef56d9-69d3-4bee-a5fc-d6af38f1495c HTTP/1.1 Oct 04 20:40:52.212192 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 20:40:52.212192 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 20:40:52.212192 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 20:40:52.212192 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 0 Oct 04 20:40:52.212192 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 20:40:52.212192 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 20:40:52.212192 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 20:40:52.212192 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 20:40:52.212192 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPJndB3mJHN0LJ8w6Kheb2n0CJ86k8j-AXdWa3AMW_tNY1_9QQNH8dAe8aGzPWpNIRLrfkOudQ5X3ptj4NBqufJdfAt-Rzg0K2bAeHF3DIzHVwi3Ysg8-zRwFjrbgaapzSsHDGJy5Rd6NQfSoCIrbX0y1TKi0r3vLuM4ZTrt6iTVd_LI Oct 04 20:40:52.212192 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 20:40:52.212192 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 20:40:52.212192 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 20:40:52.212192 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 20:40:52.212192 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 20:40:52.212192 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 20:40:52.212192 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: ecf3793be3eb4f3186c07a7e45fd8f06 Oct 04 20:40:52.212192 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-957462329 Oct 04 20:40:52.212192 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 20:40:52.212192 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 20:40:52.212192 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ecf3793be3eb4f3186c07a7e45fd8f06", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ecf3793be3eb4f3186c07a7e45fd8f06"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ecf3793be3eb4f3186c07a7e45fd8f06"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ecf3793be3eb4f3186c07a7e45fd8f06"}]}] Oct 04 20:40:52.212192 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-957462329 Oct 04 20:40:52.212192 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: ecf3793be3eb4f3186c07a7e45fd8f06 Oct 04 20:40:52.212192 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-957462329 Oct 04 20:40:52.212192 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-ImagesOneServerNegativeTestJSON-957462329-project Oct 04 20:40:52.212192 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 20:40:52.212192 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 20:40:52.212192 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: 89a82c49a62249029ebc6ae3b4829709 Oct 04 20:40:52.212192 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-957462329-project Oct 04 20:40:52.212192 n-d-854823-8 devstack@n-api.service[128802]: method: Oct 04 20:40:52.212192 n-d-854823-8 devstack@n-api.service[128802]: exception: Image not found. Oct 04 20:40:52.212192 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'id': '96ef56d9-69d3-4bee-a5fc-d6af38f1495c'} Oct 04 20:40:52.212192 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:40:52.212192 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:40:52.212192 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 04 20:40:52.212192 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 04 20:40:52.212192 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 20:40:52.212192 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 20:40:52.212192 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 20:40:52.212192 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 20:40:52.212192 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 04 20:40:52.212192 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 04 20:40:52.212192 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 04 20:40:52.212192 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 04 20:40:52.212192 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 20:40:52.212192 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 20:40:52.212192 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 20:40:52.212192 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 20:40:52.212192 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 96ef56d9-69d3-4bee-a5fc-d6af38f1495c to delete Oct 04 20:40:52.212192 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:40:52.212192 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:40:52.212192 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:40:52.212192 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:40:52.212192 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 04 20:40:52.212192 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 04 20:40:52.212192 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 04 20:40:52.212192 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 04 20:40:52.212192 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 04 20:40:52.212192 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 04 20:40:52.212192 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 96ef56d9-69d3-4bee-a5fc-d6af38f1495c could not be found. Oct 04 20:40:52.212192 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:40:52.212192 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:40:52.212192 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:40:52.222056 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:40:52.222056 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:40:52.222056 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:40:52.222056 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:40:52.222056 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:40:52.222056 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:40:52.222056 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:40:52.222056 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:40:52.222056 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:40:52.222056 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 04 20:40:52.222056 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 04 20:40:52.222056 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 20:40:52.222056 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:40:52.222056 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:40:52.222056 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:40:52.222056 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:40:52.222056 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:40:52.222056 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:40:52.222056 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:40:52.222056 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:40:52.222056 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 20:40:52.222056 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:40:52.222056 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-02466ac7-2efb-4e4b-bc37-d45e93fb6b19 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Returning 404 to user: Image not found. {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:40:52.222056 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-02466ac7-2efb-4e4b-bc37-d45e93fb6b19 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] 10.222.0.33 "DELETE /compute/v2.1/images/96ef56d9-69d3-4bee-a5fc-d6af38f1495c" status: 404 len: 62 microversion: 2.1 time: 0.076043 Oct 04 20:40:52.222056 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 981/1896] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:40:52 2022] DELETE /compute/v2.1/images/96ef56d9-69d3-4bee-a5fc-d6af38f1495c => generated 62 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 20:40:52.226605 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-d5b37bad-3bce-49ea-8e1e-61e3050bd238 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:52.232261 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-d5b37bad-3bce-49ea-8e1e-61e3050bd238 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] [instance: 55d73a76-3d5e-426c-8a99-9cae92f8498b] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:52.249970 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d5b37bad-3bce-49ea-8e1e-61e3050bd238 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:52.251398 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d5b37bad-3bce-49ea-8e1e-61e3050bd238 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:52.252104 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d5b37bad-3bce-49ea-8e1e-61e3050bd238 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:52.253047 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d5b37bad-3bce-49ea-8e1e-61e3050bd238 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:52.253719 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d5b37bad-3bce-49ea-8e1e-61e3050bd238 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:52.254375 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d5b37bad-3bce-49ea-8e1e-61e3050bd238 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:52.339891 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-091c9f1b-a714-4fde-bb6a-b6604c146d09 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bdfa818206f4f4b88cc962c1c34adf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4151c9ef7ae04a728306297f58ba5088', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:52.355173 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-091c9f1b-a714-4fde-bb6a-b6604c146d09 tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] 10.222.0.33 "GET /compute/v2.1/servers/0dd1d0cf-a3a0-4ea2-8260-ac206bbfac88" status: 200 len: 1307 microversion: 2.1 time: 0.223569 Oct 04 20:40:52.355839 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 916/1897] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:40:52 2022] GET /compute/v2.1/servers/0dd1d0cf-a3a0-4ea2-8260-ac206bbfac88 => generated 1307 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:52.365649 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0f44d5bc-696b-433f-849c-76258744565e tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:52.366152 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-0f44d5bc-696b-433f-849c-76258744565e tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] [instance: 0081d54e-8054-4f3b-9dd4-018f66aa4b27] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:52.387720 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0f44d5bc-696b-433f-849c-76258744565e tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:52.388422 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0f44d5bc-696b-433f-849c-76258744565e tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:52.389054 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0f44d5bc-696b-433f-849c-76258744565e tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:52.389793 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0f44d5bc-696b-433f-849c-76258744565e tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:52.390836 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0f44d5bc-696b-433f-849c-76258744565e tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:52.392177 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0f44d5bc-696b-433f-849c-76258744565e tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:52.421369 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-0f44d5bc-696b-433f-849c-76258744565e tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] HTTP exception thrown: Instance 0081d54e-8054-4f3b-9dd4-018f66aa4b27 could not be found. Oct 04 20:40:52.423204 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0f44d5bc-696b-433f-849c-76258744565e tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Request method failure captured: Oct 04 20:40:52.423204 n-d-854823-8 devstack@n-api.service[128801]: request: DELETE /compute/v2.1/servers/0081d54e-8054-4f3b-9dd4-018f66aa4b27 HTTP/1.1 Oct 04 20:40:52.423204 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:40:52.423204 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:40:52.423204 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:40:52.423204 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 0 Oct 04 20:40:52.423204 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:40:52.423204 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:40:52.423204 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:40:52.423204 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:40:52.423204 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJndB3mJHN0LJ8w6Kheb2n0CJ86k8j-AXdWa3AMW_tNY1_9QQNH8dAe8aGzPWpNIRLrfkOudQ5X3ptj4NBqufJdfAt-Rzg0K2bAeHF3DIzHVwi3Ysg8-zRwFjrbgaapzSsHDGJy5Rd6NQfSoCIrbX0y1TKi0r3vLuM4ZTrt6iTVd_LI Oct 04 20:40:52.423204 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:40:52.423204 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:40:52.423204 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:40:52.423204 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:40:52.423204 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:40:52.423204 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:40:52.423204 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: ecf3793be3eb4f3186c07a7e45fd8f06 Oct 04 20:40:52.423204 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-957462329 Oct 04 20:40:52.423204 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 20:40:52.423204 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 20:40:52.423204 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ecf3793be3eb4f3186c07a7e45fd8f06", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ecf3793be3eb4f3186c07a7e45fd8f06"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ecf3793be3eb4f3186c07a7e45fd8f06"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ecf3793be3eb4f3186c07a7e45fd8f06"}]}] Oct 04 20:40:52.423204 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-957462329 Oct 04 20:40:52.423204 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: ecf3793be3eb4f3186c07a7e45fd8f06 Oct 04 20:40:52.423204 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-957462329 Oct 04 20:40:52.423204 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-ImagesOneServerNegativeTestJSON-957462329-project Oct 04 20:40:52.423204 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:40:52.423204 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:40:52.423204 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: 89a82c49a62249029ebc6ae3b4829709 Oct 04 20:40:52.423204 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-957462329-project Oct 04 20:40:52.423204 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 20:40:52.423204 n-d-854823-8 devstack@n-api.service[128801]: exception: Instance 0081d54e-8054-4f3b-9dd4-018f66aa4b27 could not be found. Oct 04 20:40:52.423204 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': '0081d54e-8054-4f3b-9dd4-018f66aa4b27'} Oct 04 20:40:52.423204 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:40:52.423204 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:40:52.423204 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:40:52.423204 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:40:52.423204 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:40:52.423204 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:40:52.423204 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:40:52.423204 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:40:52.423204 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:40:52.423204 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:40:52.423204 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0081d54e-8054-4f3b-9dd4-018f66aa4b27 could not be found. Oct 04 20:40:52.423204 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:40:52.423204 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:40:52.423204 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:40:52.423204 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:40:52.423204 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:40:52.423204 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:40:52.423204 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:40:52.423204 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:40:52.423204 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:40:52.423204 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:40:52.423204 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 20:40:52.423204 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 20:40:52.423204 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 20:40:52.423204 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 20:40:52.423204 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:40:52.423204 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:40:52.423204 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:40:52.423204 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:40:52.431316 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0081d54e-8054-4f3b-9dd4-018f66aa4b27 could not be found. Oct 04 20:40:52.431316 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:40:52.431316 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:40:52.431316 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:40:52.431316 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:40:52.431316 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:40:52.431316 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:40:52.431316 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:40:52.431316 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:40:52.431316 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0081d54e-8054-4f3b-9dd4-018f66aa4b27 could not be found. Oct 04 20:40:52.431316 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:40:52.431316 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0f44d5bc-696b-433f-849c-76258744565e tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Returning 404 to user: Instance 0081d54e-8054-4f3b-9dd4-018f66aa4b27 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:40:52.431316 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-0f44d5bc-696b-433f-849c-76258744565e tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] 10.222.0.33 "DELETE /compute/v2.1/servers/0081d54e-8054-4f3b-9dd4-018f66aa4b27" status: 404 len: 111 microversion: 2.1 time: 0.066172 Oct 04 20:40:52.431316 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 917/1898] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 20:40:52 2022] DELETE /compute/v2.1/servers/0081d54e-8054-4f3b-9dd4-018f66aa4b27 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:40:52.444896 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a12222dc-7b19-46d3-bbdc-005bf403ac16 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:52.446067 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a12222dc-7b19-46d3-bbdc-005bf403ac16 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] [instance: 0081d54e-8054-4f3b-9dd4-018f66aa4b27] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:52.460393 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a12222dc-7b19-46d3-bbdc-005bf403ac16 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:52.473612 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a12222dc-7b19-46d3-bbdc-005bf403ac16 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:52.474803 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a12222dc-7b19-46d3-bbdc-005bf403ac16 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:52.477364 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a12222dc-7b19-46d3-bbdc-005bf403ac16 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:52.480859 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a12222dc-7b19-46d3-bbdc-005bf403ac16 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:52.482251 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a12222dc-7b19-46d3-bbdc-005bf403ac16 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:52.509455 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-a12222dc-7b19-46d3-bbdc-005bf403ac16 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] HTTP exception thrown: Instance 0081d54e-8054-4f3b-9dd4-018f66aa4b27 could not be found. Oct 04 20:40:52.511260 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a12222dc-7b19-46d3-bbdc-005bf403ac16 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Request method failure captured: Oct 04 20:40:52.511260 n-d-854823-8 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/0081d54e-8054-4f3b-9dd4-018f66aa4b27 HTTP/1.1 Oct 04 20:40:52.511260 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:40:52.511260 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:40:52.511260 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:40:52.511260 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 0 Oct 04 20:40:52.511260 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:40:52.511260 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:40:52.511260 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:40:52.511260 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:40:52.511260 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJndB3mJHN0LJ8w6Kheb2n0CJ86k8j-AXdWa3AMW_tNY1_9QQNH8dAe8aGzPWpNIRLrfkOudQ5X3ptj4NBqufJdfAt-Rzg0K2bAeHF3DIzHVwi3Ysg8-zRwFjrbgaapzSsHDGJy5Rd6NQfSoCIrbX0y1TKi0r3vLuM4ZTrt6iTVd_LI Oct 04 20:40:52.511260 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:40:52.511260 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:40:52.511260 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:40:52.511260 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:40:52.511260 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:40:52.511260 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:40:52.511260 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: ecf3793be3eb4f3186c07a7e45fd8f06 Oct 04 20:40:52.511260 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-957462329 Oct 04 20:40:52.511260 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 20:40:52.511260 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 20:40:52.511260 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ecf3793be3eb4f3186c07a7e45fd8f06", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ecf3793be3eb4f3186c07a7e45fd8f06"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ecf3793be3eb4f3186c07a7e45fd8f06"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ecf3793be3eb4f3186c07a7e45fd8f06"}]}] Oct 04 20:40:52.511260 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-957462329 Oct 04 20:40:52.511260 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: ecf3793be3eb4f3186c07a7e45fd8f06 Oct 04 20:40:52.511260 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-957462329 Oct 04 20:40:52.511260 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-ImagesOneServerNegativeTestJSON-957462329-project Oct 04 20:40:52.511260 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:40:52.511260 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:40:52.511260 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: 89a82c49a62249029ebc6ae3b4829709 Oct 04 20:40:52.511260 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-957462329-project Oct 04 20:40:52.511260 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 20:40:52.511260 n-d-854823-8 devstack@n-api.service[128801]: exception: Instance 0081d54e-8054-4f3b-9dd4-018f66aa4b27 could not be found. Oct 04 20:40:52.511260 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': '0081d54e-8054-4f3b-9dd4-018f66aa4b27'} Oct 04 20:40:52.511260 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:40:52.511260 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:40:52.511260 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:40:52.511260 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:40:52.511260 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:40:52.511260 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:40:52.511260 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:40:52.511260 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:40:52.511260 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:40:52.511260 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:40:52.511260 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0081d54e-8054-4f3b-9dd4-018f66aa4b27 could not be found. Oct 04 20:40:52.511260 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:40:52.511260 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:40:52.511260 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:40:52.511260 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:40:52.511260 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:40:52.511260 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:40:52.511260 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:40:52.511260 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:40:52.511260 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:40:52.511260 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:40:52.511260 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:40:52.511260 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:40:52.511260 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:40:52.511260 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:40:52.511260 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:40:52.511260 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:40:52.511260 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0081d54e-8054-4f3b-9dd4-018f66aa4b27 could not be found. Oct 04 20:40:52.511260 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:40:52.511260 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:40:52.516402 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:40:52.516402 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:40:52.516402 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:40:52.516402 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:40:52.516402 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:40:52.516402 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:40:52.516402 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0081d54e-8054-4f3b-9dd4-018f66aa4b27 could not be found. Oct 04 20:40:52.516402 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:40:52.517969 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a12222dc-7b19-46d3-bbdc-005bf403ac16 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Returning 404 to user: Instance 0081d54e-8054-4f3b-9dd4-018f66aa4b27 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:40:52.519233 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a12222dc-7b19-46d3-bbdc-005bf403ac16 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] 10.222.0.33 "GET /compute/v2.1/servers/0081d54e-8054-4f3b-9dd4-018f66aa4b27" status: 404 len: 111 microversion: 2.1 time: 0.080177 Oct 04 20:40:52.523407 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 918/1899] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:40:52 2022] GET /compute/v2.1/servers/0081d54e-8054-4f3b-9dd4-018f66aa4b27 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:40:52.529216 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-751ff28e-fbc0-4c81-9d27-656f8689edea tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Calling method '.version_select at 0x7f3c788ab3a0>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:52.557835 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-751ff28e-fbc0-4c81-9d27-656f8689edea tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1298622356" status: 202 len: 0 microversion: 2.1 time: 0.032830 Oct 04 20:40:52.559938 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 919/1900] 10.222.0.33 () {58 vars in 1221 bytes} [Tue Oct 4 20:40:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1298622356 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:40:52.742860 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-d5b37bad-3bce-49ea-8e1e-61e3050bd238 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36f4114dc4f443f8b48da7b4027e0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a23a85365414f92bbc03177d7f190e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:52.765577 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-d5b37bad-3bce-49ea-8e1e-61e3050bd238 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] 10.222.0.33 "GET /compute/v2.1/servers/55d73a76-3d5e-426c-8a99-9cae92f8498b" status: 200 len: 1432 microversion: 2.1 time: 0.546875 Oct 04 20:40:52.767797 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 982/1901] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:40:52 2022] GET /compute/v2.1/servers/55d73a76-3d5e-426c-8a99-9cae92f8498b => generated 1432 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:52.956783 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-830f74da-7806-46f6-86ec-a693180473c4 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:52.957399 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-830f74da-7806-46f6-86ec-a693180473c4 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] [instance: 53f0a355-8a5d-4775-a0d3-3aeedfc01570] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:52.972690 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-830f74da-7806-46f6-86ec-a693180473c4 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:52.976119 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-830f74da-7806-46f6-86ec-a693180473c4 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:52.976750 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-830f74da-7806-46f6-86ec-a693180473c4 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:52.977664 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-830f74da-7806-46f6-86ec-a693180473c4 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:52.978460 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-830f74da-7806-46f6-86ec-a693180473c4 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:52.979218 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-830f74da-7806-46f6-86ec-a693180473c4 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:52.987548 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-ed5fed0c-af7d-4acb-ad0f-e2a2b5fa12e9 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:52.989081 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-ed5fed0c-af7d-4acb-ad0f-e2a2b5fa12e9 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] [instance: 83df4756-40e2-4fc6-be48-48a82dd4572a] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:53.009423 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ed5fed0c-af7d-4acb-ad0f-e2a2b5fa12e9 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:53.011541 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ed5fed0c-af7d-4acb-ad0f-e2a2b5fa12e9 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:53.017530 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ed5fed0c-af7d-4acb-ad0f-e2a2b5fa12e9 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:53.020423 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ed5fed0c-af7d-4acb-ad0f-e2a2b5fa12e9 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:53.023067 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ed5fed0c-af7d-4acb-ad0f-e2a2b5fa12e9 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:53.026690 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ed5fed0c-af7d-4acb-ad0f-e2a2b5fa12e9 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:53.469934 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-830f74da-7806-46f6-86ec-a693180473c4 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96919ec99c14864876d64a9c2b20f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b44ce10b78bf49c882c9b4df06187114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:53.492680 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-830f74da-7806-46f6-86ec-a693180473c4 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] 10.222.0.33 "GET /compute/v2.1/servers/53f0a355-8a5d-4775-a0d3-3aeedfc01570" status: 200 len: 1505 microversion: 2.1 time: 0.540313 Oct 04 20:40:53.498904 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 920/1902] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:40:52 2022] GET /compute/v2.1/servers/53f0a355-8a5d-4775-a0d3-3aeedfc01570 => generated 1505 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:53.509728 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-92ca7ceb-07ec-45ff-b781-fa70f6fd67b6 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:53.517544 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-92ca7ceb-07ec-45ff-b781-fa70f6fd67b6 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] [instance: 81748c83-b703-4c68-899c-c575cc3340d2] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:53.527889 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-92ca7ceb-07ec-45ff-b781-fa70f6fd67b6 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:53.529225 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-92ca7ceb-07ec-45ff-b781-fa70f6fd67b6 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:53.529903 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-92ca7ceb-07ec-45ff-b781-fa70f6fd67b6 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:53.531448 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-92ca7ceb-07ec-45ff-b781-fa70f6fd67b6 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:53.532514 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-92ca7ceb-07ec-45ff-b781-fa70f6fd67b6 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:53.533207 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-92ca7ceb-07ec-45ff-b781-fa70f6fd67b6 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:53.577825 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-ed5fed0c-af7d-4acb-ad0f-e2a2b5fa12e9 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '800db3a57ada47eca381b00189fdbf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66ec8ea91b04deb90b679589e0495bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:53.580845 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-92ca7ceb-07ec-45ff-b781-fa70f6fd67b6 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] 10.222.0.33 "GET /compute/v2.1/servers/81748c83-b703-4c68-899c-c575cc3340d2/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.078456 Oct 04 20:40:53.586735 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 921/1903] 10.222.0.33 () {60 vars in 1343 bytes} [Tue Oct 4 20:40:53 2022] GET /compute/v2.1/servers/81748c83-b703-4c68-899c-c575cc3340d2/os-volume_attachments => generated 197 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 20:40:53.595285 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-43ed1b3b-c7cf-4c1a-8d3e-844d1c7fec6e tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:53.596498 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-43ed1b3b-c7cf-4c1a-8d3e-844d1c7fec6e tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] [instance: 0dd1d0cf-a3a0-4ea2-8260-ac206bbfac88] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:53.602003 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-ed5fed0c-af7d-4acb-ad0f-e2a2b5fa12e9 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] 10.222.0.33 "GET /compute/v2.1/servers/83df4756-40e2-4fc6-be48-48a82dd4572a" status: 200 len: 1718 microversion: 2.1 time: 0.626289 Oct 04 20:40:53.604492 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-43ed1b3b-c7cf-4c1a-8d3e-844d1c7fec6e tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:53.605065 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-43ed1b3b-c7cf-4c1a-8d3e-844d1c7fec6e tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:53.605618 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 983/1904] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:40:52 2022] GET /compute/v2.1/servers/83df4756-40e2-4fc6-be48-48a82dd4572a => generated 1718 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:53.606097 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-43ed1b3b-c7cf-4c1a-8d3e-844d1c7fec6e tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:53.606941 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-43ed1b3b-c7cf-4c1a-8d3e-844d1c7fec6e tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:53.607479 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-43ed1b3b-c7cf-4c1a-8d3e-844d1c7fec6e tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:53.608119 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-43ed1b3b-c7cf-4c1a-8d3e-844d1c7fec6e tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:53.641263 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-43ed1b3b-c7cf-4c1a-8d3e-844d1c7fec6e tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] HTTP exception thrown: Instance 0dd1d0cf-a3a0-4ea2-8260-ac206bbfac88 could not be found. Oct 04 20:40:53.643990 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-43ed1b3b-c7cf-4c1a-8d3e-844d1c7fec6e tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Request method failure captured: Oct 04 20:40:53.643990 n-d-854823-8 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/0dd1d0cf-a3a0-4ea2-8260-ac206bbfac88 HTTP/1.1 Oct 04 20:40:53.643990 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:40:53.643990 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:40:53.643990 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:40:53.643990 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 0 Oct 04 20:40:53.643990 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:40:53.643990 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:40:53.643990 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:40:53.643990 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:40:53.643990 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJnuE2rDdF4OJaHNqaaT6E-hBI9LuK6Sm2sdGaLGM4LHFmgD5UEONtmpt2qAD9awwC2Ssw_XSGcZ3JQzJEtsQqt8zM57DJ-OWjh9lMMmfdMkJ___oqbIg_C_qrcSoEkSRrITPKRaX9r5zH92sl2oFY6aLjh8ZiuJDCyw2O78ZZSEXbI Oct 04 20:40:53.643990 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:40:53.643990 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:40:53.643990 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:40:53.643990 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:40:53.643990 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:40:53.643990 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:40:53.643990 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: 4151c9ef7ae04a728306297f58ba5088 Oct 04 20:40:53.643990 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-ImagesOneServerTestJSON-264095593 Oct 04 20:40:53.643990 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 20:40:53.643990 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 20:40:53.643990 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_4151c9ef7ae04a728306297f58ba5088", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4151c9ef7ae04a728306297f58ba5088"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4151c9ef7ae04a728306297f58ba5088"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/4151c9ef7ae04a728306297f58ba5088"}]}] Oct 04 20:40:53.643990 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-ImagesOneServerTestJSON-264095593 Oct 04 20:40:53.643990 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: 4151c9ef7ae04a728306297f58ba5088 Oct 04 20:40:53.643990 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-264095593 Oct 04 20:40:53.643990 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-ImagesOneServerTestJSON-264095593-project Oct 04 20:40:53.643990 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:40:53.643990 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:40:53.643990 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: 7bdfa818206f4f4b88cc962c1c34adf3 Oct 04 20:40:53.643990 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-ImagesOneServerTestJSON-264095593-project Oct 04 20:40:53.643990 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 20:40:53.643990 n-d-854823-8 devstack@n-api.service[128801]: exception: Instance 0dd1d0cf-a3a0-4ea2-8260-ac206bbfac88 could not be found. Oct 04 20:40:53.643990 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': '0dd1d0cf-a3a0-4ea2-8260-ac206bbfac88'} Oct 04 20:40:53.643990 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:40:53.643990 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:40:53.643990 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:40:53.643990 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:40:53.643990 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:40:53.643990 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:40:53.643990 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:40:53.643990 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:40:53.643990 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:40:53.643990 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:40:53.643990 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0dd1d0cf-a3a0-4ea2-8260-ac206bbfac88 could not be found. Oct 04 20:40:53.643990 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:40:53.643990 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:40:53.643990 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:40:53.643990 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:40:53.643990 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:40:53.643990 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:40:53.643990 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:40:53.643990 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:40:53.643990 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:40:53.643990 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:40:53.643990 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:40:53.643990 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:40:53.643990 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:40:53.643990 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:40:53.643990 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:40:53.643990 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:40:53.643990 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0dd1d0cf-a3a0-4ea2-8260-ac206bbfac88 could not be found. Oct 04 20:40:53.643990 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:40:53.643990 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:40:53.643990 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:40:53.650146 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:40:53.650146 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:40:53.650146 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:40:53.650146 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:40:53.650146 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:40:53.650146 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0dd1d0cf-a3a0-4ea2-8260-ac206bbfac88 could not be found. Oct 04 20:40:53.650146 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:40:53.650146 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-43ed1b3b-c7cf-4c1a-8d3e-844d1c7fec6e tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] Returning 404 to user: Instance 0dd1d0cf-a3a0-4ea2-8260-ac206bbfac88 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:40:53.650146 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-43ed1b3b-c7cf-4c1a-8d3e-844d1c7fec6e tempest-ImagesOneServerTestJSON-264095593 tempest-ImagesOneServerTestJSON-264095593-project] 10.222.0.33 "GET /compute/v2.1/servers/0dd1d0cf-a3a0-4ea2-8260-ac206bbfac88" status: 404 len: 111 microversion: 2.1 time: 0.057016 Oct 04 20:40:53.676645 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 922/1905] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:40:53 2022] GET /compute/v2.1/servers/0dd1d0cf-a3a0-4ea2-8260-ac206bbfac88 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:40:53.796326 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-34065d40-722a-47b9-a1e1-43b7776f3160 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:53.798958 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-34065d40-722a-47b9-a1e1-43b7776f3160 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] [instance: 55d73a76-3d5e-426c-8a99-9cae92f8498b] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:53.810553 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-34065d40-722a-47b9-a1e1-43b7776f3160 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:53.812376 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-34065d40-722a-47b9-a1e1-43b7776f3160 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:53.812833 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-34065d40-722a-47b9-a1e1-43b7776f3160 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:53.816775 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-34065d40-722a-47b9-a1e1-43b7776f3160 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:53.819707 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-34065d40-722a-47b9-a1e1-43b7776f3160 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:53.820860 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-34065d40-722a-47b9-a1e1-43b7776f3160 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:53.866857 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-cc9f2da9-9621-4c24-99bd-30e9af511727 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Calling method '.version_select at 0x7f3c74218af0>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:53.926903 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-cc9f2da9-9621-4c24-99bd-30e9af511727 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] HTTP exception thrown: Image not found. Oct 04 20:40:53.929556 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-cc9f2da9-9621-4c24-99bd-30e9af511727 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Request method failure captured: Oct 04 20:40:53.929556 n-d-854823-8 devstack@n-api.service[128801]: request: DELETE /compute/v2.1/images/9ef8a157-ebb5-4f4e-ad27-89e99e3f5ff2 HTTP/1.1 Oct 04 20:40:53.929556 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:40:53.929556 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:40:53.929556 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:40:53.929556 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 0 Oct 04 20:40:53.929556 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:40:53.929556 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:40:53.929556 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:40:53.929556 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:40:53.929556 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJndB3mJHN0LJ8w6Kheb2n0CJ86k8j-AXdWa3AMW_tNY1_9QQNH8dAe8aGzPWpNIRLrfkOudQ5X3ptj4NBqufJdfAt-Rzg0K2bAeHF3DIzHVwi3Ysg8-zRwFjrbgaapzSsHDGJy5Rd6NQfSoCIrbX0y1TKi0r3vLuM4ZTrt6iTVd_LI Oct 04 20:40:53.929556 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:40:53.929556 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:40:53.929556 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:40:53.929556 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:40:53.929556 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:40:53.929556 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:40:53.929556 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: ecf3793be3eb4f3186c07a7e45fd8f06 Oct 04 20:40:53.929556 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-957462329 Oct 04 20:40:53.929556 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 20:40:53.929556 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 20:40:53.929556 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ecf3793be3eb4f3186c07a7e45fd8f06", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ecf3793be3eb4f3186c07a7e45fd8f06"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ecf3793be3eb4f3186c07a7e45fd8f06"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ecf3793be3eb4f3186c07a7e45fd8f06"}]}] Oct 04 20:40:53.929556 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-957462329 Oct 04 20:40:53.929556 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: ecf3793be3eb4f3186c07a7e45fd8f06 Oct 04 20:40:53.929556 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-957462329 Oct 04 20:40:53.929556 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-ImagesOneServerNegativeTestJSON-957462329-project Oct 04 20:40:53.929556 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:40:53.929556 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:40:53.929556 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: 89a82c49a62249029ebc6ae3b4829709 Oct 04 20:40:53.929556 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-957462329-project Oct 04 20:40:53.929556 n-d-854823-8 devstack@n-api.service[128801]: method: Oct 04 20:40:53.929556 n-d-854823-8 devstack@n-api.service[128801]: exception: Image not found. Oct 04 20:40:53.929556 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': '9ef8a157-ebb5-4f4e-ad27-89e99e3f5ff2'} Oct 04 20:40:53.929556 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:40:53.929556 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:40:53.929556 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 04 20:40:53.929556 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 04 20:40:53.929556 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 20:40:53.929556 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 20:40:53.929556 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 20:40:53.929556 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 20:40:53.929556 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 04 20:40:53.929556 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 04 20:40:53.929556 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 04 20:40:53.929556 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 04 20:40:53.929556 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 20:40:53.929556 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 20:40:53.929556 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 20:40:53.929556 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 20:40:53.929556 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 9ef8a157-ebb5-4f4e-ad27-89e99e3f5ff2 to delete Oct 04 20:40:53.929556 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:40:53.929556 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:40:53.929556 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:40:53.929556 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:40:53.929556 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 04 20:40:53.929556 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 04 20:40:53.929556 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 04 20:40:53.929556 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 04 20:40:53.929556 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 04 20:40:53.929556 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 04 20:40:53.929556 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 9ef8a157-ebb5-4f4e-ad27-89e99e3f5ff2 could not be found. Oct 04 20:40:53.929556 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:40:53.929556 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:40:53.929556 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:40:53.934649 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:40:53.934649 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:40:53.934649 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:40:53.934649 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:40:53.934649 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:40:53.934649 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:40:53.934649 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:40:53.934649 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:40:53.934649 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:40:53.934649 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 04 20:40:53.934649 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 04 20:40:53.934649 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 20:40:53.934649 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:40:53.934649 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:40:53.934649 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:40:53.934649 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:40:53.934649 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:40:53.934649 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:40:53.934649 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:40:53.934649 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:40:53.934649 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 20:40:53.934649 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:40:53.942734 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-cc9f2da9-9621-4c24-99bd-30e9af511727 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Returning 404 to user: Image not found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:40:53.944165 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-34065d40-722a-47b9-a1e1-43b7776f3160 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:53.944660 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-34065d40-722a-47b9-a1e1-43b7776f3160 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:53.945098 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-34065d40-722a-47b9-a1e1-43b7776f3160 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:53.945858 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.objects.instance [None req-34065d40-722a-47b9-a1e1-43b7776f3160 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lazy-loading 'fault' on Instance uuid 55d73a76-3d5e-426c-8a99-9cae92f8498b {{(pid=128802) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:40:53.947921 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-cc9f2da9-9621-4c24-99bd-30e9af511727 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] 10.222.0.33 "DELETE /compute/v2.1/images/9ef8a157-ebb5-4f4e-ad27-89e99e3f5ff2" status: 404 len: 62 microversion: 2.1 time: 0.083081 Oct 04 20:40:53.949281 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 923/1906] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:40:53 2022] DELETE /compute/v2.1/images/9ef8a157-ebb5-4f4e-ad27-89e99e3f5ff2 => generated 62 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 20:40:53.966055 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b7aab81e-6b43-4d57-8aa3-c562eafb0954 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:53.967537 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b7aab81e-6b43-4d57-8aa3-c562eafb0954 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] [instance: d2173117-c1c5-4c2d-9658-914e67649cdd] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:53.989493 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b7aab81e-6b43-4d57-8aa3-c562eafb0954 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:53.990877 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b7aab81e-6b43-4d57-8aa3-c562eafb0954 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:53.991530 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b7aab81e-6b43-4d57-8aa3-c562eafb0954 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:53.992519 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b7aab81e-6b43-4d57-8aa3-c562eafb0954 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:53.993361 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b7aab81e-6b43-4d57-8aa3-c562eafb0954 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:53.994187 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b7aab81e-6b43-4d57-8aa3-c562eafb0954 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:54.019059 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-34065d40-722a-47b9-a1e1-43b7776f3160 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36f4114dc4f443f8b48da7b4027e0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a23a85365414f92bbc03177d7f190e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:54.030655 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-34065d40-722a-47b9-a1e1-43b7776f3160 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] 10.222.0.33 "GET /compute/v2.1/servers/55d73a76-3d5e-426c-8a99-9cae92f8498b" status: 200 len: 1308 microversion: 2.1 time: 0.238782 Oct 04 20:40:54.032251 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-b7aab81e-6b43-4d57-8aa3-c562eafb0954 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] HTTP exception thrown: Instance d2173117-c1c5-4c2d-9658-914e67649cdd could not be found. Oct 04 20:40:54.033180 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 984/1907] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:40:53 2022] GET /compute/v2.1/servers/55d73a76-3d5e-426c-8a99-9cae92f8498b => generated 1308 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:54.034555 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b7aab81e-6b43-4d57-8aa3-c562eafb0954 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Request method failure captured: Oct 04 20:40:54.034555 n-d-854823-8 devstack@n-api.service[128801]: request: DELETE /compute/v2.1/servers/d2173117-c1c5-4c2d-9658-914e67649cdd HTTP/1.1 Oct 04 20:40:54.034555 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:40:54.034555 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:40:54.034555 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:40:54.034555 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 0 Oct 04 20:40:54.034555 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:40:54.034555 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:40:54.034555 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:40:54.034555 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:40:54.034555 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJndB3mJHN0LJ8w6Kheb2n0CJ86k8j-AXdWa3AMW_tNY1_9QQNH8dAe8aGzPWpNIRLrfkOudQ5X3ptj4NBqufJdfAt-Rzg0K2bAeHF3DIzHVwi3Ysg8-zRwFjrbgaapzSsHDGJy5Rd6NQfSoCIrbX0y1TKi0r3vLuM4ZTrt6iTVd_LI Oct 04 20:40:54.034555 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:40:54.034555 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:40:54.034555 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:40:54.034555 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:40:54.034555 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:40:54.034555 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:40:54.034555 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: ecf3793be3eb4f3186c07a7e45fd8f06 Oct 04 20:40:54.034555 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-957462329 Oct 04 20:40:54.034555 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 20:40:54.034555 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 20:40:54.034555 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ecf3793be3eb4f3186c07a7e45fd8f06", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ecf3793be3eb4f3186c07a7e45fd8f06"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ecf3793be3eb4f3186c07a7e45fd8f06"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ecf3793be3eb4f3186c07a7e45fd8f06"}]}] Oct 04 20:40:54.034555 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-957462329 Oct 04 20:40:54.034555 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: ecf3793be3eb4f3186c07a7e45fd8f06 Oct 04 20:40:54.034555 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-957462329 Oct 04 20:40:54.034555 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-ImagesOneServerNegativeTestJSON-957462329-project Oct 04 20:40:54.034555 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:40:54.034555 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:40:54.034555 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: 89a82c49a62249029ebc6ae3b4829709 Oct 04 20:40:54.034555 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-957462329-project Oct 04 20:40:54.034555 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 20:40:54.034555 n-d-854823-8 devstack@n-api.service[128801]: exception: Instance d2173117-c1c5-4c2d-9658-914e67649cdd could not be found. Oct 04 20:40:54.034555 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': 'd2173117-c1c5-4c2d-9658-914e67649cdd'} Oct 04 20:40:54.034555 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:40:54.034555 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:40:54.034555 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:40:54.034555 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:40:54.034555 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:40:54.034555 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:40:54.034555 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:40:54.034555 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:40:54.034555 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:40:54.034555 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:40:54.034555 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2173117-c1c5-4c2d-9658-914e67649cdd could not be found. Oct 04 20:40:54.034555 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:40:54.034555 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:40:54.034555 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:40:54.034555 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:40:54.034555 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:40:54.034555 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:40:54.034555 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:40:54.034555 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:40:54.034555 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:40:54.034555 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:40:54.034555 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 20:40:54.034555 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 20:40:54.034555 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 20:40:54.034555 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 20:40:54.034555 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:40:54.034555 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:40:54.034555 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:40:54.034555 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:40:54.042820 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2173117-c1c5-4c2d-9658-914e67649cdd could not be found. Oct 04 20:40:54.042820 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:40:54.042820 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:40:54.042820 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:40:54.042820 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:40:54.042820 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:40:54.042820 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:40:54.042820 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:40:54.042820 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:40:54.042820 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2173117-c1c5-4c2d-9658-914e67649cdd could not be found. Oct 04 20:40:54.042820 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:40:54.042820 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b7aab81e-6b43-4d57-8aa3-c562eafb0954 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Returning 404 to user: Instance d2173117-c1c5-4c2d-9658-914e67649cdd could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:40:54.042820 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b7aab81e-6b43-4d57-8aa3-c562eafb0954 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] 10.222.0.33 "DELETE /compute/v2.1/servers/d2173117-c1c5-4c2d-9658-914e67649cdd" status: 404 len: 111 microversion: 2.1 time: 0.083261 Oct 04 20:40:54.042820 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 924/1908] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 20:40:53 2022] DELETE /compute/v2.1/servers/d2173117-c1c5-4c2d-9658-914e67649cdd => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:40:54.051343 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-e806885f-1586-48de-80f2-a28b3933fea9 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:54.052564 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-e806885f-1586-48de-80f2-a28b3933fea9 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] [instance: d2173117-c1c5-4c2d-9658-914e67649cdd] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:54.060673 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e806885f-1586-48de-80f2-a28b3933fea9 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:54.061518 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e806885f-1586-48de-80f2-a28b3933fea9 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:54.062109 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e806885f-1586-48de-80f2-a28b3933fea9 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:54.064421 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e806885f-1586-48de-80f2-a28b3933fea9 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:54.065571 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e806885f-1586-48de-80f2-a28b3933fea9 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:54.066245 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e806885f-1586-48de-80f2-a28b3933fea9 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:54.087892 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.wsgi [None req-e806885f-1586-48de-80f2-a28b3933fea9 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] HTTP exception thrown: Instance d2173117-c1c5-4c2d-9658-914e67649cdd could not be found. Oct 04 20:40:54.091734 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-e806885f-1586-48de-80f2-a28b3933fea9 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Request method failure captured: Oct 04 20:40:54.091734 n-d-854823-8 devstack@n-api.service[128802]: request: GET /compute/v2.1/servers/d2173117-c1c5-4c2d-9658-914e67649cdd HTTP/1.1 Oct 04 20:40:54.091734 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 20:40:54.091734 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 20:40:54.091734 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 20:40:54.091734 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 0 Oct 04 20:40:54.091734 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 20:40:54.091734 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 20:40:54.091734 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 20:40:54.091734 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 20:40:54.091734 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPJndB3mJHN0LJ8w6Kheb2n0CJ86k8j-AXdWa3AMW_tNY1_9QQNH8dAe8aGzPWpNIRLrfkOudQ5X3ptj4NBqufJdfAt-Rzg0K2bAeHF3DIzHVwi3Ysg8-zRwFjrbgaapzSsHDGJy5Rd6NQfSoCIrbX0y1TKi0r3vLuM4ZTrt6iTVd_LI Oct 04 20:40:54.091734 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 20:40:54.091734 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 20:40:54.091734 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 20:40:54.091734 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 20:40:54.091734 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 20:40:54.091734 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 20:40:54.091734 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: ecf3793be3eb4f3186c07a7e45fd8f06 Oct 04 20:40:54.091734 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-957462329 Oct 04 20:40:54.091734 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 20:40:54.091734 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 20:40:54.091734 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ecf3793be3eb4f3186c07a7e45fd8f06", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ecf3793be3eb4f3186c07a7e45fd8f06"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ecf3793be3eb4f3186c07a7e45fd8f06"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ecf3793be3eb4f3186c07a7e45fd8f06"}]}] Oct 04 20:40:54.091734 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-957462329 Oct 04 20:40:54.091734 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: ecf3793be3eb4f3186c07a7e45fd8f06 Oct 04 20:40:54.091734 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-957462329 Oct 04 20:40:54.091734 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-ImagesOneServerNegativeTestJSON-957462329-project Oct 04 20:40:54.091734 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 20:40:54.091734 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 20:40:54.091734 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: 89a82c49a62249029ebc6ae3b4829709 Oct 04 20:40:54.091734 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-957462329-project Oct 04 20:40:54.091734 n-d-854823-8 devstack@n-api.service[128802]: method: > Oct 04 20:40:54.091734 n-d-854823-8 devstack@n-api.service[128802]: exception: Instance d2173117-c1c5-4c2d-9658-914e67649cdd could not be found. Oct 04 20:40:54.091734 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'id': 'd2173117-c1c5-4c2d-9658-914e67649cdd'} Oct 04 20:40:54.091734 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:40:54.091734 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:40:54.091734 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:40:54.091734 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:40:54.091734 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:40:54.091734 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:40:54.091734 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:40:54.091734 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:40:54.091734 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:40:54.091734 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:40:54.091734 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2173117-c1c5-4c2d-9658-914e67649cdd could not be found. Oct 04 20:40:54.091734 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:40:54.091734 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:40:54.091734 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:40:54.091734 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:40:54.091734 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:40:54.091734 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:40:54.091734 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:40:54.091734 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:40:54.091734 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:40:54.091734 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:40:54.091734 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:40:54.091734 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:40:54.091734 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:40:54.091734 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:40:54.091734 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:40:54.091734 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:40:54.091734 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2173117-c1c5-4c2d-9658-914e67649cdd could not be found. Oct 04 20:40:54.091734 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:40:54.091734 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:40:54.096996 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:40:54.096996 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:40:54.096996 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:40:54.096996 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:40:54.096996 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:40:54.096996 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:40:54.096996 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2173117-c1c5-4c2d-9658-914e67649cdd could not be found. Oct 04 20:40:54.096996 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:40:54.098845 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-e806885f-1586-48de-80f2-a28b3933fea9 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] Returning 404 to user: Instance d2173117-c1c5-4c2d-9658-914e67649cdd could not be found. {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:40:54.100703 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-e806885f-1586-48de-80f2-a28b3933fea9 tempest-ImagesOneServerNegativeTestJSON-957462329 tempest-ImagesOneServerNegativeTestJSON-957462329-project] 10.222.0.33 "GET /compute/v2.1/servers/d2173117-c1c5-4c2d-9658-914e67649cdd" status: 404 len: 111 microversion: 2.1 time: 0.055373 Oct 04 20:40:54.101934 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 985/1909] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:40:54 2022] GET /compute/v2.1/servers/d2173117-c1c5-4c2d-9658-914e67649cdd => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:40:54.243268 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-5c10e834-3390-4f4c-b620-cb8262e6959b req-879873b2-964d-4d2d-8056-9b03c56f5bc3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1e8b81b-5e26-4d5c-87ca-057eea43abba", "name": "network-vif-deleted", "tag": "79dd85da-fe6b-4163-bb34-adeab48cf2e5"}, {"server_uuid": "55d73a76-3d5e-426c-8a99-9cae92f8498b", "name": "network-vif-deleted", "tag": "42d92097-d729-44f9-8a5b-0613e0581707"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:40:54.264278 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-5c10e834-3390-4f4c-b620-cb8262e6959b req-879873b2-964d-4d2d-8056-9b03c56f5bc3 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:54.265936 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-5c10e834-3390-4f4c-b620-cb8262e6959b req-879873b2-964d-4d2d-8056-9b03c56f5bc3 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:54.266791 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-5c10e834-3390-4f4c-b620-cb8262e6959b req-879873b2-964d-4d2d-8056-9b03c56f5bc3 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:54.298383 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-5c10e834-3390-4f4c-b620-cb8262e6959b req-879873b2-964d-4d2d-8056-9b03c56f5bc3 service nova] Creating event network-vif-deleted:79dd85da-fe6b-4163-bb34-adeab48cf2e5 for instance a1e8b81b-5e26-4d5c-87ca-057eea43abba on n-h2-854823-8 Oct 04 20:40:54.299881 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-5c10e834-3390-4f4c-b620-cb8262e6959b req-879873b2-964d-4d2d-8056-9b03c56f5bc3 service nova] Creating event network-vif-deleted:42d92097-d729-44f9-8a5b-0613e0581707 for instance 55d73a76-3d5e-426c-8a99-9cae92f8498b on n-h1-854823-8 Oct 04 20:40:54.314138 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-5c10e834-3390-4f4c-b620-cb8262e6959b req-879873b2-964d-4d2d-8056-9b03c56f5bc3 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.073432 Oct 04 20:40:54.315385 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 925/1910] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:40:54 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:40:54.526054 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-ea31984a-8732-4e7a-a94e-00c47f7baab4 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:54.527264 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-ea31984a-8732-4e7a-a94e-00c47f7baab4 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] [instance: 53f0a355-8a5d-4775-a0d3-3aeedfc01570] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:54.569436 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ea31984a-8732-4e7a-a94e-00c47f7baab4 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:54.570365 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ea31984a-8732-4e7a-a94e-00c47f7baab4 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:54.570972 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ea31984a-8732-4e7a-a94e-00c47f7baab4 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:54.572079 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ea31984a-8732-4e7a-a94e-00c47f7baab4 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:54.572760 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ea31984a-8732-4e7a-a94e-00c47f7baab4 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:54.573322 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ea31984a-8732-4e7a-a94e-00c47f7baab4 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:54.598246 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-3bbf729d-860e-4e20-b844-48e9c9586528 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:54.601015 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-3bbf729d-860e-4e20-b844-48e9c9586528 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] [instance: 81748c83-b703-4c68-899c-c575cc3340d2] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:54.620700 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3bbf729d-860e-4e20-b844-48e9c9586528 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:54.621467 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3bbf729d-860e-4e20-b844-48e9c9586528 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:54.622090 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3bbf729d-860e-4e20-b844-48e9c9586528 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:54.622998 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3bbf729d-860e-4e20-b844-48e9c9586528 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:54.623689 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3bbf729d-860e-4e20-b844-48e9c9586528 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:54.624329 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3bbf729d-860e-4e20-b844-48e9c9586528 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:54.697500 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-3bbf729d-860e-4e20-b844-48e9c9586528 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] 10.222.0.33 "GET /compute/v2.1/servers/81748c83-b703-4c68-899c-c575cc3340d2/os-volume_attachments" status: 200 len: 25 microversion: 2.25 time: 0.105034 Oct 04 20:40:54.706931 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 926/1911] 10.222.0.33 () {60 vars in 1343 bytes} [Tue Oct 4 20:40:54 2022] GET /compute/v2.1/servers/81748c83-b703-4c68-899c-c575cc3340d2/os-volume_attachments => generated 25 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:54.713404 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e3ad87d4-db92-4e01-9c45-310112cda3df tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:54.717597 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e3ad87d4-db92-4e01-9c45-310112cda3df tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] [instance: 83df4756-40e2-4fc6-be48-48a82dd4572a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:54.734278 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e3ad87d4-db92-4e01-9c45-310112cda3df tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:54.734967 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e3ad87d4-db92-4e01-9c45-310112cda3df tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:54.735513 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e3ad87d4-db92-4e01-9c45-310112cda3df tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:54.736333 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e3ad87d4-db92-4e01-9c45-310112cda3df tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:54.740014 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e3ad87d4-db92-4e01-9c45-310112cda3df tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:54.742126 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e3ad87d4-db92-4e01-9c45-310112cda3df tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:55.260028 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-ea31984a-8732-4e7a-a94e-00c47f7baab4 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96919ec99c14864876d64a9c2b20f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b44ce10b78bf49c882c9b4df06187114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:55.268078 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-ea31984a-8732-4e7a-a94e-00c47f7baab4 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] 10.222.0.33 "GET /compute/v2.1/servers/53f0a355-8a5d-4775-a0d3-3aeedfc01570" status: 200 len: 1505 microversion: 2.1 time: 0.747919 Oct 04 20:40:55.268735 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 986/1912] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:40:54 2022] GET /compute/v2.1/servers/53f0a355-8a5d-4775-a0d3-3aeedfc01570 => generated 1505 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:55.295735 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-350a0404-2957-43ff-966d-8684c5dc6fc4 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:55.299107 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-350a0404-2957-43ff-966d-8684c5dc6fc4 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] [instance: 55d73a76-3d5e-426c-8a99-9cae92f8498b] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:55.315506 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-350a0404-2957-43ff-966d-8684c5dc6fc4 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:55.316267 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-350a0404-2957-43ff-966d-8684c5dc6fc4 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:55.316884 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-350a0404-2957-43ff-966d-8684c5dc6fc4 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:55.317780 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-350a0404-2957-43ff-966d-8684c5dc6fc4 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:55.318432 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-350a0404-2957-43ff-966d-8684c5dc6fc4 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:55.319047 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-350a0404-2957-43ff-966d-8684c5dc6fc4 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:55.344180 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.wsgi [None req-350a0404-2957-43ff-966d-8684c5dc6fc4 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] HTTP exception thrown: Instance 55d73a76-3d5e-426c-8a99-9cae92f8498b could not be found. Oct 04 20:40:55.345857 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-350a0404-2957-43ff-966d-8684c5dc6fc4 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Request method failure captured: Oct 04 20:40:55.345857 n-d-854823-8 devstack@n-api.service[128802]: request: GET /compute/v2.1/servers/55d73a76-3d5e-426c-8a99-9cae92f8498b HTTP/1.1 Oct 04 20:40:55.345857 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 20:40:55.345857 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 20:40:55.345857 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 20:40:55.345857 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 0 Oct 04 20:40:55.345857 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 20:40:55.345857 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 20:40:55.345857 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 20:40:55.345857 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 20:40:55.345857 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPJmeqrgxMn_vD-ao9MwjUJsz467_UAHW--vO2J2bMBYcsyRLhLo6Qj0nbEneOIdoi1LyiMNoKFQexjywspnMbrI5Aae3ew90UDzKQnlSm-j4NlsTEmvIdX9JuBz7NdY6Hhk6Az56PzRPsjCNW7LpLzJRfXCMnPsMFpfxnfuJgRzeSWg Oct 04 20:40:55.345857 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 20:40:55.345857 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 20:40:55.345857 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 20:40:55.345857 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 20:40:55.345857 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 20:40:55.345857 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 20:40:55.345857 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: 1a23a85365414f92bbc03177d7f190e6 Oct 04 20:40:55.345857 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-ServersOnMultiNodesTest-1191352258 Oct 04 20:40:55.345857 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 20:40:55.345857 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 20:40:55.345857 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_1a23a85365414f92bbc03177d7f190e6", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1a23a85365414f92bbc03177d7f190e6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1a23a85365414f92bbc03177d7f190e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/1a23a85365414f92bbc03177d7f190e6"}]}] Oct 04 20:40:55.345857 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-ServersOnMultiNodesTest-1191352258 Oct 04 20:40:55.345857 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: 1a23a85365414f92bbc03177d7f190e6 Oct 04 20:40:55.345857 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1191352258 Oct 04 20:40:55.345857 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-ServersOnMultiNodesTest-1191352258-project Oct 04 20:40:55.345857 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 20:40:55.345857 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 20:40:55.345857 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: e36f4114dc4f443f8b48da7b4027e0c1 Oct 04 20:40:55.345857 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-ServersOnMultiNodesTest-1191352258-project Oct 04 20:40:55.345857 n-d-854823-8 devstack@n-api.service[128802]: method: > Oct 04 20:40:55.345857 n-d-854823-8 devstack@n-api.service[128802]: exception: Instance 55d73a76-3d5e-426c-8a99-9cae92f8498b could not be found. Oct 04 20:40:55.345857 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'id': '55d73a76-3d5e-426c-8a99-9cae92f8498b'} Oct 04 20:40:55.345857 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:40:55.345857 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:40:55.345857 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:40:55.345857 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:40:55.345857 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:40:55.345857 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:40:55.345857 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:40:55.345857 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:40:55.345857 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:40:55.345857 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:40:55.345857 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 55d73a76-3d5e-426c-8a99-9cae92f8498b could not be found. Oct 04 20:40:55.345857 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:40:55.345857 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:40:55.345857 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:40:55.345857 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:40:55.345857 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:40:55.345857 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:40:55.345857 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:40:55.345857 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:40:55.345857 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:40:55.345857 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:40:55.345857 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:40:55.345857 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:40:55.345857 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:40:55.345857 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:40:55.345857 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:40:55.345857 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:40:55.345857 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 55d73a76-3d5e-426c-8a99-9cae92f8498b could not be found. Oct 04 20:40:55.345857 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:40:55.345857 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:40:55.345857 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:40:55.350986 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:40:55.350986 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:40:55.350986 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:40:55.350986 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:40:55.350986 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:40:55.350986 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 55d73a76-3d5e-426c-8a99-9cae92f8498b could not be found. Oct 04 20:40:55.350986 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:40:55.358560 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-350a0404-2957-43ff-966d-8684c5dc6fc4 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Returning 404 to user: Instance 55d73a76-3d5e-426c-8a99-9cae92f8498b could not be found. {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:40:55.359632 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-350a0404-2957-43ff-966d-8684c5dc6fc4 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] 10.222.0.33 "GET /compute/v2.1/servers/55d73a76-3d5e-426c-8a99-9cae92f8498b" status: 404 len: 111 microversion: 2.1 time: 0.071014 Oct 04 20:40:55.361222 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 987/1913] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:40:55 2022] GET /compute/v2.1/servers/55d73a76-3d5e-426c-8a99-9cae92f8498b => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:40:55.369867 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-7184263b-fb2c-4725-a68b-a7ea024a4f4d tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:55.370523 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-7184263b-fb2c-4725-a68b-a7ea024a4f4d tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] [instance: a1e8b81b-5e26-4d5c-87ca-057eea43abba] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:55.387262 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7184263b-fb2c-4725-a68b-a7ea024a4f4d tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:55.387759 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7184263b-fb2c-4725-a68b-a7ea024a4f4d tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:55.388189 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7184263b-fb2c-4725-a68b-a7ea024a4f4d tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:55.388896 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7184263b-fb2c-4725-a68b-a7ea024a4f4d tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:55.389344 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7184263b-fb2c-4725-a68b-a7ea024a4f4d tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:55.389768 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7184263b-fb2c-4725-a68b-a7ea024a4f4d tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:55.424575 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.wsgi [None req-7184263b-fb2c-4725-a68b-a7ea024a4f4d tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] HTTP exception thrown: Instance a1e8b81b-5e26-4d5c-87ca-057eea43abba could not be found. Oct 04 20:40:55.426125 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-7184263b-fb2c-4725-a68b-a7ea024a4f4d tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Request method failure captured: Oct 04 20:40:55.426125 n-d-854823-8 devstack@n-api.service[128802]: request: GET /compute/v2.1/servers/a1e8b81b-5e26-4d5c-87ca-057eea43abba HTTP/1.1 Oct 04 20:40:55.426125 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 20:40:55.426125 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 20:40:55.426125 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 20:40:55.426125 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 0 Oct 04 20:40:55.426125 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 20:40:55.426125 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 20:40:55.426125 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 20:40:55.426125 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 20:40:55.426125 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPJmeqrgxMn_vD-ao9MwjUJsz467_UAHW--vO2J2bMBYcsyRLhLo6Qj0nbEneOIdoi1LyiMNoKFQexjywspnMbrI5Aae3ew90UDzKQnlSm-j4NlsTEmvIdX9JuBz7NdY6Hhk6Az56PzRPsjCNW7LpLzJRfXCMnPsMFpfxnfuJgRzeSWg Oct 04 20:40:55.426125 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 20:40:55.426125 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 20:40:55.426125 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 20:40:55.426125 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 20:40:55.426125 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 20:40:55.426125 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 20:40:55.426125 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: 1a23a85365414f92bbc03177d7f190e6 Oct 04 20:40:55.426125 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-ServersOnMultiNodesTest-1191352258 Oct 04 20:40:55.426125 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 20:40:55.426125 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 20:40:55.426125 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_1a23a85365414f92bbc03177d7f190e6", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1a23a85365414f92bbc03177d7f190e6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1a23a85365414f92bbc03177d7f190e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/1a23a85365414f92bbc03177d7f190e6"}]}] Oct 04 20:40:55.426125 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-ServersOnMultiNodesTest-1191352258 Oct 04 20:40:55.426125 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: 1a23a85365414f92bbc03177d7f190e6 Oct 04 20:40:55.426125 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1191352258 Oct 04 20:40:55.426125 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-ServersOnMultiNodesTest-1191352258-project Oct 04 20:40:55.426125 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 20:40:55.426125 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 20:40:55.426125 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: e36f4114dc4f443f8b48da7b4027e0c1 Oct 04 20:40:55.426125 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-ServersOnMultiNodesTest-1191352258-project Oct 04 20:40:55.426125 n-d-854823-8 devstack@n-api.service[128802]: method: > Oct 04 20:40:55.426125 n-d-854823-8 devstack@n-api.service[128802]: exception: Instance a1e8b81b-5e26-4d5c-87ca-057eea43abba could not be found. Oct 04 20:40:55.426125 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'id': 'a1e8b81b-5e26-4d5c-87ca-057eea43abba'} Oct 04 20:40:55.426125 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:40:55.426125 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:40:55.426125 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:40:55.426125 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:40:55.426125 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:40:55.426125 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:40:55.426125 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:40:55.426125 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:40:55.426125 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:40:55.426125 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:40:55.426125 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a1e8b81b-5e26-4d5c-87ca-057eea43abba could not be found. Oct 04 20:40:55.426125 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:40:55.426125 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:40:55.426125 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:40:55.426125 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:40:55.426125 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:40:55.426125 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:40:55.426125 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:40:55.426125 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:40:55.426125 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:40:55.426125 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:40:55.426125 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:40:55.426125 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:40:55.426125 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:40:55.426125 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:40:55.426125 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:40:55.426125 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:40:55.426125 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1e8b81b-5e26-4d5c-87ca-057eea43abba could not be found. Oct 04 20:40:55.426125 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:40:55.426125 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:40:55.426125 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:40:55.433665 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:40:55.433665 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:40:55.433665 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:40:55.433665 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:40:55.433665 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:40:55.433665 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1e8b81b-5e26-4d5c-87ca-057eea43abba could not be found. Oct 04 20:40:55.433665 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:40:55.433665 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-7184263b-fb2c-4725-a68b-a7ea024a4f4d tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Returning 404 to user: Instance a1e8b81b-5e26-4d5c-87ca-057eea43abba could not be found. {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:40:55.433665 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-7184263b-fb2c-4725-a68b-a7ea024a4f4d tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] 10.222.0.33 "GET /compute/v2.1/servers/a1e8b81b-5e26-4d5c-87ca-057eea43abba" status: 404 len: 111 microversion: 2.1 time: 0.062501 Oct 04 20:40:55.433665 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 988/1914] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:40:55 2022] GET /compute/v2.1/servers/a1e8b81b-5e26-4d5c-87ca-057eea43abba => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 20:40:55.436334 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-8fa97e4e-e8eb-4f63-a5cd-6e263eb81987 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:55.457418 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e3ad87d4-db92-4e01-9c45-310112cda3df tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '800db3a57ada47eca381b00189fdbf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66ec8ea91b04deb90b679589e0495bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:55.468243 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e3ad87d4-db92-4e01-9c45-310112cda3df tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] 10.222.0.33 "GET /compute/v2.1/servers/83df4756-40e2-4fc6-be48-48a82dd4572a" status: 200 len: 1718 microversion: 2.1 time: 0.759873 Oct 04 20:40:55.486522 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 927/1915] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:40:54 2022] GET /compute/v2.1/servers/83df4756-40e2-4fc6-be48-48a82dd4572a => generated 1718 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:55.499501 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-8fa97e4e-e8eb-4f63-a5cd-6e263eb81987 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] 10.222.0.33 "DELETE /compute/v2.1/os-server-groups/a27428b4-242f-42e1-b297-1a93e60f513e" status: 204 len: 0 microversion: 2.1 time: 0.066591 Oct 04 20:40:55.502688 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 989/1916] 10.222.0.33 () {58 vars in 1266 bytes} [Tue Oct 4 20:40:55 2022] DELETE /compute/v2.1/os-server-groups/a27428b4-242f-42e1-b297-1a93e60f513e => generated 0 bytes in 70 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:40:55.513462 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b3394fa7-4518-40b1-a0bc-9b1f2e14f28c tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:55.516625 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b3394fa7-4518-40b1-a0bc-9b1f2e14f28c tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] [instance: 96d890a0-a100-40a7-b795-6677eb966251] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:55.538879 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b3394fa7-4518-40b1-a0bc-9b1f2e14f28c tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:55.539679 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b3394fa7-4518-40b1-a0bc-9b1f2e14f28c tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:55.541981 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b3394fa7-4518-40b1-a0bc-9b1f2e14f28c tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:55.544189 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b3394fa7-4518-40b1-a0bc-9b1f2e14f28c tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:55.544665 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b3394fa7-4518-40b1-a0bc-9b1f2e14f28c tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:55.546266 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b3394fa7-4518-40b1-a0bc-9b1f2e14f28c tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:55.615309 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b3394fa7-4518-40b1-a0bc-9b1f2e14f28c tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] [instance: 96d890a0-a100-40a7-b795-6677eb966251] Going to try to terminate instance {{(pid=128801) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:40:55.790805 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b3394fa7-4518-40b1-a0bc-9b1f2e14f28c tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] 10.222.0.33 "DELETE /compute/v2.1/servers/96d890a0-a100-40a7-b795-6677eb966251" status: 204 len: 0 microversion: 2.1 time: 0.283618 Oct 04 20:40:55.792053 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 928/1917] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 20:40:55 2022] DELETE /compute/v2.1/servers/96d890a0-a100-40a7-b795-6677eb966251 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:40:55.803454 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-cdf0f8ab-de27-4816-bcaa-3c69018caaa3 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:55.804195 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-cdf0f8ab-de27-4816-bcaa-3c69018caaa3 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] [instance: 2182737b-f69a-44aa-a3ea-bbabae8ad737] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:55.831130 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cdf0f8ab-de27-4816-bcaa-3c69018caaa3 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:55.831637 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cdf0f8ab-de27-4816-bcaa-3c69018caaa3 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:55.832081 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cdf0f8ab-de27-4816-bcaa-3c69018caaa3 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:55.832814 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cdf0f8ab-de27-4816-bcaa-3c69018caaa3 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:55.858788 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cdf0f8ab-de27-4816-bcaa-3c69018caaa3 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:55.888588 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cdf0f8ab-de27-4816-bcaa-3c69018caaa3 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:55.923781 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:40:55.962855 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-cdf0f8ab-de27-4816-bcaa-3c69018caaa3 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] [instance: 2182737b-f69a-44aa-a3ea-bbabae8ad737] Going to try to terminate instance {{(pid=128802) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:40:56.167144 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-cdf0f8ab-de27-4816-bcaa-3c69018caaa3 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] 10.222.0.33 "DELETE /compute/v2.1/servers/2182737b-f69a-44aa-a3ea-bbabae8ad737" status: 204 len: 0 microversion: 2.1 time: 0.367057 Oct 04 20:40:56.169941 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 990/1918] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 20:40:55 2022] DELETE /compute/v2.1/servers/2182737b-f69a-44aa-a3ea-bbabae8ad737 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:40:56.179669 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-3397f724-9a25-488c-a93c-ae2058440df6 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:56.180490 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-3397f724-9a25-488c-a93c-ae2058440df6 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] [instance: 96d890a0-a100-40a7-b795-6677eb966251] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:56.193964 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3397f724-9a25-488c-a93c-ae2058440df6 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:56.196112 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3397f724-9a25-488c-a93c-ae2058440df6 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:56.196632 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3397f724-9a25-488c-a93c-ae2058440df6 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:56.197685 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3397f724-9a25-488c-a93c-ae2058440df6 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:56.198154 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3397f724-9a25-488c-a93c-ae2058440df6 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:56.201775 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3397f724-9a25-488c-a93c-ae2058440df6 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:56.296514 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-62afd109-4bd5-4fdf-bd7a-50f0480118d5 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:56.297227 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-62afd109-4bd5-4fdf-bd7a-50f0480118d5 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] [instance: 53f0a355-8a5d-4775-a0d3-3aeedfc01570] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:56.308601 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-62afd109-4bd5-4fdf-bd7a-50f0480118d5 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:56.309094 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-62afd109-4bd5-4fdf-bd7a-50f0480118d5 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:56.309532 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-62afd109-4bd5-4fdf-bd7a-50f0480118d5 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:56.310253 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-62afd109-4bd5-4fdf-bd7a-50f0480118d5 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:56.310736 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-62afd109-4bd5-4fdf-bd7a-50f0480118d5 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:56.311157 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-62afd109-4bd5-4fdf-bd7a-50f0480118d5 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:56.785086 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-3397f724-9a25-488c-a93c-ae2058440df6 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36f4114dc4f443f8b48da7b4027e0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a23a85365414f92bbc03177d7f190e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:56.802718 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-3397f724-9a25-488c-a93c-ae2058440df6 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] 10.222.0.33 "GET /compute/v2.1/servers/96d890a0-a100-40a7-b795-6677eb966251" status: 200 len: 1475 microversion: 2.1 time: 0.621546 Oct 04 20:40:56.804195 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 929/1919] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:40:56 2022] GET /compute/v2.1/servers/96d890a0-a100-40a7-b795-6677eb966251 => generated 1475 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:40:56.822105 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-06e0193f-b214-4202-b971-5794e6177fe5 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:56.824531 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-06e0193f-b214-4202-b971-5794e6177fe5 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] [instance: 83df4756-40e2-4fc6-be48-48a82dd4572a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:56.847063 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-06e0193f-b214-4202-b971-5794e6177fe5 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:56.850285 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-06e0193f-b214-4202-b971-5794e6177fe5 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:56.852049 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-06e0193f-b214-4202-b971-5794e6177fe5 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:56.864635 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-06e0193f-b214-4202-b971-5794e6177fe5 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:56.866835 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-06e0193f-b214-4202-b971-5794e6177fe5 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:56.868118 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-06e0193f-b214-4202-b971-5794e6177fe5 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:56.874712 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-62afd109-4bd5-4fdf-bd7a-50f0480118d5 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96919ec99c14864876d64a9c2b20f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b44ce10b78bf49c882c9b4df06187114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:56.884218 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-62afd109-4bd5-4fdf-bd7a-50f0480118d5 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] 10.222.0.33 "GET /compute/v2.1/servers/53f0a355-8a5d-4775-a0d3-3aeedfc01570" status: 200 len: 1505 microversion: 2.1 time: 0.592589 Oct 04 20:40:56.884829 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 991/1920] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:40:56 2022] GET /compute/v2.1/servers/53f0a355-8a5d-4775-a0d3-3aeedfc01570 => generated 1505 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:40:57.350980 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-06e0193f-b214-4202-b971-5794e6177fe5 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '800db3a57ada47eca381b00189fdbf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66ec8ea91b04deb90b679589e0495bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:57.363826 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-06e0193f-b214-4202-b971-5794e6177fe5 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] 10.222.0.33 "GET /compute/v2.1/servers/83df4756-40e2-4fc6-be48-48a82dd4572a" status: 200 len: 1718 microversion: 2.1 time: 0.556844 Oct 04 20:40:57.365155 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 930/1921] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:40:56 2022] GET /compute/v2.1/servers/83df4756-40e2-4fc6-be48-48a82dd4572a => generated 1718 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:57.833065 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-f79f60ba-b308-43e1-906f-2733472cf70c tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:57.833592 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-f79f60ba-b308-43e1-906f-2733472cf70c tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] [instance: 96d890a0-a100-40a7-b795-6677eb966251] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:57.846105 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f79f60ba-b308-43e1-906f-2733472cf70c tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:57.846624 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f79f60ba-b308-43e1-906f-2733472cf70c tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:57.847057 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f79f60ba-b308-43e1-906f-2733472cf70c tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:57.847768 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f79f60ba-b308-43e1-906f-2733472cf70c tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:57.848216 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f79f60ba-b308-43e1-906f-2733472cf70c tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:57.848634 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f79f60ba-b308-43e1-906f-2733472cf70c tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:57.915742 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-60bf186e-6e39-4717-a80d-9158d16742e5 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:57.916484 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-60bf186e-6e39-4717-a80d-9158d16742e5 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] [instance: 53f0a355-8a5d-4775-a0d3-3aeedfc01570] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:57.927328 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-60bf186e-6e39-4717-a80d-9158d16742e5 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:57.928072 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-60bf186e-6e39-4717-a80d-9158d16742e5 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:57.928692 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-60bf186e-6e39-4717-a80d-9158d16742e5 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:57.929580 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-60bf186e-6e39-4717-a80d-9158d16742e5 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:57.930197 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-60bf186e-6e39-4717-a80d-9158d16742e5 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:57.930794 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-60bf186e-6e39-4717-a80d-9158d16742e5 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:58.335646 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-f79f60ba-b308-43e1-906f-2733472cf70c tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36f4114dc4f443f8b48da7b4027e0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a23a85365414f92bbc03177d7f190e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:58.354175 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-f79f60ba-b308-43e1-906f-2733472cf70c tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] 10.222.0.33 "GET /compute/v2.1/servers/96d890a0-a100-40a7-b795-6677eb966251" status: 200 len: 1475 microversion: 2.1 time: 0.526322 Oct 04 20:40:58.355169 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 992/1922] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:40:57 2022] GET /compute/v2.1/servers/96d890a0-a100-40a7-b795-6677eb966251 => generated 1475 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:58.389128 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-cbde0efb-4b12-4a9f-9612-dac544fc8d9d tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:58.390011 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-cbde0efb-4b12-4a9f-9612-dac544fc8d9d tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] [instance: 83df4756-40e2-4fc6-be48-48a82dd4572a] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:58.408002 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cbde0efb-4b12-4a9f-9612-dac544fc8d9d tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:58.408916 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cbde0efb-4b12-4a9f-9612-dac544fc8d9d tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:58.409469 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cbde0efb-4b12-4a9f-9612-dac544fc8d9d tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:58.410291 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cbde0efb-4b12-4a9f-9612-dac544fc8d9d tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:58.410857 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cbde0efb-4b12-4a9f-9612-dac544fc8d9d tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:58.411521 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cbde0efb-4b12-4a9f-9612-dac544fc8d9d tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:58.468641 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-60bf186e-6e39-4717-a80d-9158d16742e5 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96919ec99c14864876d64a9c2b20f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b44ce10b78bf49c882c9b4df06187114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:58.478392 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-60bf186e-6e39-4717-a80d-9158d16742e5 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] 10.222.0.33 "GET /compute/v2.1/servers/53f0a355-8a5d-4775-a0d3-3aeedfc01570" status: 200 len: 1505 microversion: 2.1 time: 0.566698 Oct 04 20:40:58.489735 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 931/1923] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:40:57 2022] GET /compute/v2.1/servers/53f0a355-8a5d-4775-a0d3-3aeedfc01570 => generated 1505 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:40:58.924401 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-cbde0efb-4b12-4a9f-9612-dac544fc8d9d tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '800db3a57ada47eca381b00189fdbf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66ec8ea91b04deb90b679589e0495bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:40:58.939933 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-cbde0efb-4b12-4a9f-9612-dac544fc8d9d tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] 10.222.0.33 "GET /compute/v2.1/servers/83df4756-40e2-4fc6-be48-48a82dd4572a" status: 200 len: 1718 microversion: 2.1 time: 0.554530 Oct 04 20:40:58.944164 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 993/1924] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:40:58 2022] GET /compute/v2.1/servers/83df4756-40e2-4fc6-be48-48a82dd4572a => generated 1718 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:40:59.382126 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e33d67db-b321-456c-8798-795f9c7c9068 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:59.383491 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e33d67db-b321-456c-8798-795f9c7c9068 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] [instance: 96d890a0-a100-40a7-b795-6677eb966251] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:59.398101 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e33d67db-b321-456c-8798-795f9c7c9068 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:59.407651 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e33d67db-b321-456c-8798-795f9c7c9068 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:59.408257 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e33d67db-b321-456c-8798-795f9c7c9068 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:59.413185 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e33d67db-b321-456c-8798-795f9c7c9068 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:59.413812 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e33d67db-b321-456c-8798-795f9c7c9068 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:59.414385 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e33d67db-b321-456c-8798-795f9c7c9068 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:59.513394 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-afa153f0-a933-48f3-85f0-84077a492600 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:40:59.514178 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-afa153f0-a933-48f3-85f0-84077a492600 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] [instance: 53f0a355-8a5d-4775-a0d3-3aeedfc01570] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:40:59.527456 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-afa153f0-a933-48f3-85f0-84077a492600 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:59.528109 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-afa153f0-a933-48f3-85f0-84077a492600 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:59.533561 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-afa153f0-a933-48f3-85f0-84077a492600 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:40:59.542414 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-afa153f0-a933-48f3-85f0-84077a492600 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:40:59.543300 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-afa153f0-a933-48f3-85f0-84077a492600 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:40:59.543843 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-afa153f0-a933-48f3-85f0-84077a492600 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:01.465900 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e33d67db-b321-456c-8798-795f9c7c9068 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36f4114dc4f443f8b48da7b4027e0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a23a85365414f92bbc03177d7f190e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:41:01.471005 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:41:01.477897 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-afa153f0-a933-48f3-85f0-84077a492600 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96919ec99c14864876d64a9c2b20f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b44ce10b78bf49c882c9b4df06187114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:41:01.480204 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e33d67db-b321-456c-8798-795f9c7c9068 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] 10.222.0.33 "GET /compute/v2.1/servers/96d890a0-a100-40a7-b795-6677eb966251" status: 200 len: 1475 microversion: 2.1 time: 2.101944 Oct 04 20:41:01.481285 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 932/1925] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:40:59 2022] GET /compute/v2.1/servers/96d890a0-a100-40a7-b795-6677eb966251 => generated 1475 bytes in 2104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:41:01.495624 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-afa153f0-a933-48f3-85f0-84077a492600 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] 10.222.0.33 "GET /compute/v2.1/servers/53f0a355-8a5d-4775-a0d3-3aeedfc01570" status: 200 len: 1505 microversion: 2.1 time: 1.987802 Oct 04 20:41:01.497615 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 994/1926] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:40:59 2022] GET /compute/v2.1/servers/53f0a355-8a5d-4775-a0d3-3aeedfc01570 => generated 1505 bytes in 1990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:41:01.500249 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1899b65e-7581-42a8-b2b0-707629e97d94 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:41:01.501101 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-1899b65e-7581-42a8-b2b0-707629e97d94 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] [instance: 83df4756-40e2-4fc6-be48-48a82dd4572a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:41:01.511928 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1899b65e-7581-42a8-b2b0-707629e97d94 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:01.512806 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1899b65e-7581-42a8-b2b0-707629e97d94 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:01.513421 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1899b65e-7581-42a8-b2b0-707629e97d94 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:01.514480 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1899b65e-7581-42a8-b2b0-707629e97d94 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:01.515125 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1899b65e-7581-42a8-b2b0-707629e97d94 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:01.515708 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1899b65e-7581-42a8-b2b0-707629e97d94 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:01.575538 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-7504a0fd-dd19-4e11-98a5-7bfb8ef69c5b req-1498d2f4-74d2-460d-bb46-0e330f3d069f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96d890a0-a100-40a7-b795-6677eb966251", "name": "network-vif-deleted", "tag": "469a4e48-dbb3-4d56-9055-2fc2f7f7ab62"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:41:01.613637 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-7504a0fd-dd19-4e11-98a5-7bfb8ef69c5b req-1498d2f4-74d2-460d-bb46-0e330f3d069f service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:01.615654 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-7504a0fd-dd19-4e11-98a5-7bfb8ef69c5b req-1498d2f4-74d2-460d-bb46-0e330f3d069f service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:01.616294 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-7504a0fd-dd19-4e11-98a5-7bfb8ef69c5b req-1498d2f4-74d2-460d-bb46-0e330f3d069f service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:01.653544 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-7504a0fd-dd19-4e11-98a5-7bfb8ef69c5b req-1498d2f4-74d2-460d-bb46-0e330f3d069f service nova] Creating event network-vif-deleted:469a4e48-dbb3-4d56-9055-2fc2f7f7ab62 for instance 96d890a0-a100-40a7-b795-6677eb966251 on n-h2-854823-8 Oct 04 20:41:01.668571 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-7504a0fd-dd19-4e11-98a5-7bfb8ef69c5b req-1498d2f4-74d2-460d-bb46-0e330f3d069f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098820 Oct 04 20:41:01.671204 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 995/1927] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:41:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:41:02.320896 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-1899b65e-7581-42a8-b2b0-707629e97d94 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '800db3a57ada47eca381b00189fdbf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66ec8ea91b04deb90b679589e0495bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:41:02.342740 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-1899b65e-7581-42a8-b2b0-707629e97d94 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] 10.222.0.33 "GET /compute/v2.1/servers/83df4756-40e2-4fc6-be48-48a82dd4572a" status: 200 len: 1718 microversion: 2.1 time: 0.851247 Oct 04 20:41:02.346751 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 933/1928] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:41:01 2022] GET /compute/v2.1/servers/83df4756-40e2-4fc6-be48-48a82dd4572a => generated 1718 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:41:02.537271 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-37abbf3e-bd6b-4c86-b277-d7c302a82e81 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:41:02.538605 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-dbe61cfd-e9a9-48e4-970d-7eb90ec1784b tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:41:02.539395 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-37abbf3e-bd6b-4c86-b277-d7c302a82e81 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] [instance: 53f0a355-8a5d-4775-a0d3-3aeedfc01570] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:41:02.540702 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-dbe61cfd-e9a9-48e4-970d-7eb90ec1784b tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] [instance: 96d890a0-a100-40a7-b795-6677eb966251] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:41:02.565070 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dbe61cfd-e9a9-48e4-970d-7eb90ec1784b tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:02.567713 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-37abbf3e-bd6b-4c86-b277-d7c302a82e81 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:02.568501 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-37abbf3e-bd6b-4c86-b277-d7c302a82e81 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:02.569394 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-37abbf3e-bd6b-4c86-b277-d7c302a82e81 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:02.570333 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-37abbf3e-bd6b-4c86-b277-d7c302a82e81 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:02.571627 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dbe61cfd-e9a9-48e4-970d-7eb90ec1784b tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:02.572518 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-37abbf3e-bd6b-4c86-b277-d7c302a82e81 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:02.573147 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dbe61cfd-e9a9-48e4-970d-7eb90ec1784b tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:02.574407 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dbe61cfd-e9a9-48e4-970d-7eb90ec1784b tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:02.574907 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-37abbf3e-bd6b-4c86-b277-d7c302a82e81 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:02.576517 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dbe61cfd-e9a9-48e4-970d-7eb90ec1784b tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:02.579588 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dbe61cfd-e9a9-48e4-970d-7eb90ec1784b tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:02.683422 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dbe61cfd-e9a9-48e4-970d-7eb90ec1784b tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:02.684182 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dbe61cfd-e9a9-48e4-970d-7eb90ec1784b tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:02.684799 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dbe61cfd-e9a9-48e4-970d-7eb90ec1784b tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:02.685431 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.objects.instance [None req-dbe61cfd-e9a9-48e4-970d-7eb90ec1784b tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lazy-loading 'fault' on Instance uuid 96d890a0-a100-40a7-b795-6677eb966251 {{(pid=128802) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:41:03.379320 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-dbe61cfd-e9a9-48e4-970d-7eb90ec1784b tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36f4114dc4f443f8b48da7b4027e0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a23a85365414f92bbc03177d7f190e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:41:03.402973 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-dbe61cfd-e9a9-48e4-970d-7eb90ec1784b tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] 10.222.0.33 "GET /compute/v2.1/servers/96d890a0-a100-40a7-b795-6677eb966251" status: 200 len: 1309 microversion: 2.1 time: 0.879844 Oct 04 20:41:03.408276 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 996/1929] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:41:02 2022] GET /compute/v2.1/servers/96d890a0-a100-40a7-b795-6677eb966251 => generated 1309 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:41:03.427227 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-a744ba9c-b622-419c-a317-cae5f83aa52b req-83441a59-bee4-40bf-895e-a3a5ee59c240 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2182737b-f69a-44aa-a3ea-bbabae8ad737", "name": "network-vif-deleted", "tag": "f7a4a879-9c9a-46e9-a921-58ebd3c70015"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:41:03.459182 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-a744ba9c-b622-419c-a317-cae5f83aa52b req-83441a59-bee4-40bf-895e-a3a5ee59c240 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:03.463665 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-a744ba9c-b622-419c-a317-cae5f83aa52b req-83441a59-bee4-40bf-895e-a3a5ee59c240 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:03.467963 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-a744ba9c-b622-419c-a317-cae5f83aa52b req-83441a59-bee4-40bf-895e-a3a5ee59c240 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:03.511400 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-a744ba9c-b622-419c-a317-cae5f83aa52b req-83441a59-bee4-40bf-895e-a3a5ee59c240 service nova] Creating event network-vif-deleted:f7a4a879-9c9a-46e9-a921-58ebd3c70015 for instance 2182737b-f69a-44aa-a3ea-bbabae8ad737 on n-h2-854823-8 Oct 04 20:41:03.527900 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-a744ba9c-b622-419c-a317-cae5f83aa52b req-83441a59-bee4-40bf-895e-a3a5ee59c240 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118278 Oct 04 20:41:03.535208 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 997/1930] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:41:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:41:03.556992 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-5f22bf4d-c8ff-4860-a91b-1ef1ad75706b tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:41:03.562516 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-5f22bf4d-c8ff-4860-a91b-1ef1ad75706b tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] [instance: 83df4756-40e2-4fc6-be48-48a82dd4572a] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:41:03.590494 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5f22bf4d-c8ff-4860-a91b-1ef1ad75706b tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:03.590992 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5f22bf4d-c8ff-4860-a91b-1ef1ad75706b tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:03.591436 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5f22bf4d-c8ff-4860-a91b-1ef1ad75706b tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:03.592152 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5f22bf4d-c8ff-4860-a91b-1ef1ad75706b tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:03.592654 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5f22bf4d-c8ff-4860-a91b-1ef1ad75706b tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:03.593014 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5f22bf4d-c8ff-4860-a91b-1ef1ad75706b tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:04.007219 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-37abbf3e-bd6b-4c86-b277-d7c302a82e81 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96919ec99c14864876d64a9c2b20f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b44ce10b78bf49c882c9b4df06187114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:41:04.017106 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-37abbf3e-bd6b-4c86-b277-d7c302a82e81 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] 10.222.0.33 "GET /compute/v2.1/servers/53f0a355-8a5d-4775-a0d3-3aeedfc01570" status: 200 len: 1505 microversion: 2.1 time: 1.490967 Oct 04 20:41:04.018723 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 934/1931] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:41:02 2022] GET /compute/v2.1/servers/53f0a355-8a5d-4775-a0d3-3aeedfc01570 => generated 1505 bytes in 1494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:41:04.435443 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-43303ef9-e020-4761-91aa-a737ad6a9fa8 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:41:04.436077 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-43303ef9-e020-4761-91aa-a737ad6a9fa8 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] [instance: 96d890a0-a100-40a7-b795-6677eb966251] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:41:04.467045 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-43303ef9-e020-4761-91aa-a737ad6a9fa8 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:04.467574 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-43303ef9-e020-4761-91aa-a737ad6a9fa8 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:04.468023 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-43303ef9-e020-4761-91aa-a737ad6a9fa8 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:04.468859 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-43303ef9-e020-4761-91aa-a737ad6a9fa8 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:04.470382 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-43303ef9-e020-4761-91aa-a737ad6a9fa8 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:04.471034 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-43303ef9-e020-4761-91aa-a737ad6a9fa8 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:04.501535 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-43303ef9-e020-4761-91aa-a737ad6a9fa8 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] HTTP exception thrown: Instance 96d890a0-a100-40a7-b795-6677eb966251 could not be found. Oct 04 20:41:04.508131 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-43303ef9-e020-4761-91aa-a737ad6a9fa8 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Request method failure captured: Oct 04 20:41:04.508131 n-d-854823-8 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/96d890a0-a100-40a7-b795-6677eb966251 HTTP/1.1 Oct 04 20:41:04.508131 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:41:04.508131 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:41:04.508131 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:41:04.508131 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 0 Oct 04 20:41:04.508131 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:41:04.508131 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:41:04.508131 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:41:04.508131 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:41:04.508131 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJmeqrgxMn_vD-ao9MwjUJsz467_UAHW--vO2J2bMBYcsyRLhLo6Qj0nbEneOIdoi1LyiMNoKFQexjywspnMbrI5Aae3ew90UDzKQnlSm-j4NlsTEmvIdX9JuBz7NdY6Hhk6Az56PzRPsjCNW7LpLzJRfXCMnPsMFpfxnfuJgRzeSWg Oct 04 20:41:04.508131 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:41:04.508131 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:41:04.508131 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:41:04.508131 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:41:04.508131 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:41:04.508131 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:41:04.508131 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: 1a23a85365414f92bbc03177d7f190e6 Oct 04 20:41:04.508131 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-ServersOnMultiNodesTest-1191352258 Oct 04 20:41:04.508131 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 20:41:04.508131 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 20:41:04.508131 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_1a23a85365414f92bbc03177d7f190e6", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1a23a85365414f92bbc03177d7f190e6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1a23a85365414f92bbc03177d7f190e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/1a23a85365414f92bbc03177d7f190e6"}]}] Oct 04 20:41:04.508131 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-ServersOnMultiNodesTest-1191352258 Oct 04 20:41:04.508131 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: 1a23a85365414f92bbc03177d7f190e6 Oct 04 20:41:04.508131 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1191352258 Oct 04 20:41:04.508131 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-ServersOnMultiNodesTest-1191352258-project Oct 04 20:41:04.508131 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:41:04.508131 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:41:04.508131 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: e36f4114dc4f443f8b48da7b4027e0c1 Oct 04 20:41:04.508131 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-ServersOnMultiNodesTest-1191352258-project Oct 04 20:41:04.508131 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 20:41:04.508131 n-d-854823-8 devstack@n-api.service[128801]: exception: Instance 96d890a0-a100-40a7-b795-6677eb966251 could not be found. Oct 04 20:41:04.508131 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': '96d890a0-a100-40a7-b795-6677eb966251'} Oct 04 20:41:04.508131 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:41:04.508131 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:41:04.508131 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:41:04.508131 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:41:04.508131 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:41:04.508131 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:41:04.508131 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:41:04.508131 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:41:04.508131 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:41:04.508131 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:41:04.508131 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 96d890a0-a100-40a7-b795-6677eb966251 could not be found. Oct 04 20:41:04.508131 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:41:04.508131 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:41:04.508131 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:41:04.508131 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:41:04.508131 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:41:04.508131 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:41:04.508131 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:41:04.508131 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:41:04.508131 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:41:04.508131 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:41:04.508131 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:41:04.508131 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:41:04.508131 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:41:04.508131 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:41:04.508131 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:41:04.508131 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:41:04.508131 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 96d890a0-a100-40a7-b795-6677eb966251 could not be found. Oct 04 20:41:04.508131 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:41:04.508131 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:41:04.508131 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:41:04.513842 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:41:04.513842 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:41:04.513842 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:41:04.513842 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:41:04.513842 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:41:04.513842 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 96d890a0-a100-40a7-b795-6677eb966251 could not be found. Oct 04 20:41:04.513842 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:41:04.530136 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-5f22bf4d-c8ff-4860-a91b-1ef1ad75706b tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '800db3a57ada47eca381b00189fdbf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66ec8ea91b04deb90b679589e0495bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:41:04.540214 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-43303ef9-e020-4761-91aa-a737ad6a9fa8 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Returning 404 to user: Instance 96d890a0-a100-40a7-b795-6677eb966251 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:41:04.542020 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-43303ef9-e020-4761-91aa-a737ad6a9fa8 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] 10.222.0.33 "GET /compute/v2.1/servers/96d890a0-a100-40a7-b795-6677eb966251" status: 404 len: 111 microversion: 2.1 time: 0.113179 Oct 04 20:41:04.542919 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 935/1932] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:41:04 2022] GET /compute/v2.1/servers/96d890a0-a100-40a7-b795-6677eb966251 => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:41:04.551423 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5dba2f21-5255-490f-924f-a2e5fc01758b tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:41:04.552278 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-5dba2f21-5255-490f-924f-a2e5fc01758b tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] [instance: 2182737b-f69a-44aa-a3ea-bbabae8ad737] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:41:04.569501 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5dba2f21-5255-490f-924f-a2e5fc01758b tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:04.570196 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5dba2f21-5255-490f-924f-a2e5fc01758b tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:04.570821 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5dba2f21-5255-490f-924f-a2e5fc01758b tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:04.571701 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5dba2f21-5255-490f-924f-a2e5fc01758b tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:04.575068 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5dba2f21-5255-490f-924f-a2e5fc01758b tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:04.575845 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5dba2f21-5255-490f-924f-a2e5fc01758b tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:04.609123 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-5dba2f21-5255-490f-924f-a2e5fc01758b tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] HTTP exception thrown: Instance 2182737b-f69a-44aa-a3ea-bbabae8ad737 could not be found. Oct 04 20:41:04.611798 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-5f22bf4d-c8ff-4860-a91b-1ef1ad75706b tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] 10.222.0.33 "GET /compute/v2.1/servers/83df4756-40e2-4fc6-be48-48a82dd4572a" status: 200 len: 1718 microversion: 2.1 time: 1.063612 Oct 04 20:41:04.613708 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 998/1933] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:41:03 2022] GET /compute/v2.1/servers/83df4756-40e2-4fc6-be48-48a82dd4572a => generated 1718 bytes in 1074 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:41:04.614142 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5dba2f21-5255-490f-924f-a2e5fc01758b tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Request method failure captured: Oct 04 20:41:04.614142 n-d-854823-8 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/2182737b-f69a-44aa-a3ea-bbabae8ad737 HTTP/1.1 Oct 04 20:41:04.614142 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:41:04.614142 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:41:04.614142 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:41:04.614142 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 0 Oct 04 20:41:04.614142 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:41:04.614142 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:41:04.614142 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:41:04.614142 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:41:04.614142 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJmeqrgxMn_vD-ao9MwjUJsz467_UAHW--vO2J2bMBYcsyRLhLo6Qj0nbEneOIdoi1LyiMNoKFQexjywspnMbrI5Aae3ew90UDzKQnlSm-j4NlsTEmvIdX9JuBz7NdY6Hhk6Az56PzRPsjCNW7LpLzJRfXCMnPsMFpfxnfuJgRzeSWg Oct 04 20:41:04.614142 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:41:04.614142 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:41:04.614142 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:41:04.614142 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:41:04.614142 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:41:04.614142 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:41:04.614142 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: 1a23a85365414f92bbc03177d7f190e6 Oct 04 20:41:04.614142 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-ServersOnMultiNodesTest-1191352258 Oct 04 20:41:04.614142 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 20:41:04.614142 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 20:41:04.614142 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_1a23a85365414f92bbc03177d7f190e6", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1a23a85365414f92bbc03177d7f190e6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1a23a85365414f92bbc03177d7f190e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/1a23a85365414f92bbc03177d7f190e6"}]}] Oct 04 20:41:04.614142 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-ServersOnMultiNodesTest-1191352258 Oct 04 20:41:04.614142 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: 1a23a85365414f92bbc03177d7f190e6 Oct 04 20:41:04.614142 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1191352258 Oct 04 20:41:04.614142 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-ServersOnMultiNodesTest-1191352258-project Oct 04 20:41:04.614142 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:41:04.614142 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:41:04.614142 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: e36f4114dc4f443f8b48da7b4027e0c1 Oct 04 20:41:04.614142 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-ServersOnMultiNodesTest-1191352258-project Oct 04 20:41:04.614142 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 20:41:04.614142 n-d-854823-8 devstack@n-api.service[128801]: exception: Instance 2182737b-f69a-44aa-a3ea-bbabae8ad737 could not be found. Oct 04 20:41:04.614142 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': '2182737b-f69a-44aa-a3ea-bbabae8ad737'} Oct 04 20:41:04.614142 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:41:04.614142 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:41:04.614142 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:41:04.614142 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:41:04.614142 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:41:04.614142 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:41:04.614142 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:41:04.614142 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:41:04.614142 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:41:04.614142 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:41:04.614142 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2182737b-f69a-44aa-a3ea-bbabae8ad737 could not be found. Oct 04 20:41:04.614142 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:41:04.614142 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:41:04.614142 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:41:04.614142 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:41:04.614142 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:41:04.614142 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:41:04.614142 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:41:04.614142 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:41:04.614142 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:41:04.614142 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:41:04.614142 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:41:04.614142 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:41:04.614142 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:41:04.614142 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:41:04.614142 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:41:04.614142 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:41:04.614142 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2182737b-f69a-44aa-a3ea-bbabae8ad737 could not be found. Oct 04 20:41:04.614142 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:41:04.614142 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:41:04.614142 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:41:04.619650 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:41:04.619650 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:41:04.619650 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:41:04.619650 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:41:04.619650 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:41:04.619650 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2182737b-f69a-44aa-a3ea-bbabae8ad737 could not be found. Oct 04 20:41:04.619650 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:41:04.624828 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5dba2f21-5255-490f-924f-a2e5fc01758b tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Returning 404 to user: Instance 2182737b-f69a-44aa-a3ea-bbabae8ad737 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:41:04.631508 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5dba2f21-5255-490f-924f-a2e5fc01758b tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] 10.222.0.33 "GET /compute/v2.1/servers/2182737b-f69a-44aa-a3ea-bbabae8ad737" status: 404 len: 111 microversion: 2.1 time: 0.084460 Oct 04 20:41:04.636257 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 936/1934] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:41:04 2022] GET /compute/v2.1/servers/2182737b-f69a-44aa-a3ea-bbabae8ad737 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 20:41:04.642647 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-fd4a65b6-b72c-489d-bc64-70d1b2e027e5 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:41:04.720916 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-fd4a65b6-b72c-489d-bc64-70d1b2e027e5 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] 10.222.0.33 "DELETE /compute/v2.1/os-server-groups/49c045c4-4d35-4fe6-956c-aa9908064ea1" status: 204 len: 0 microversion: 2.1 time: 0.083950 Oct 04 20:41:04.730723 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 999/1935] 10.222.0.33 () {58 vars in 1266 bytes} [Tue Oct 4 20:41:04 2022] DELETE /compute/v2.1/os-server-groups/49c045c4-4d35-4fe6-956c-aa9908064ea1 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:41:04.733692 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-00f6dd0c-bcb6-4794-bb36-6ed4b4d8b998 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:41:04.734194 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-00f6dd0c-bcb6-4794-bb36-6ed4b4d8b998 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] [instance: 42726a57-cdc8-45e3-8d61-348f02bfcd53] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:41:04.743825 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-00f6dd0c-bcb6-4794-bb36-6ed4b4d8b998 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:04.744580 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-00f6dd0c-bcb6-4794-bb36-6ed4b4d8b998 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:04.745303 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-00f6dd0c-bcb6-4794-bb36-6ed4b4d8b998 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:04.751950 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-00f6dd0c-bcb6-4794-bb36-6ed4b4d8b998 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:04.753576 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-00f6dd0c-bcb6-4794-bb36-6ed4b4d8b998 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:04.754262 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-00f6dd0c-bcb6-4794-bb36-6ed4b4d8b998 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:04.795982 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-00f6dd0c-bcb6-4794-bb36-6ed4b4d8b998 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] [instance: 42726a57-cdc8-45e3-8d61-348f02bfcd53] Going to try to terminate instance {{(pid=128801) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:41:05.012999 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:41:05.026670 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-00f6dd0c-bcb6-4794-bb36-6ed4b4d8b998 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] 10.222.0.33 "DELETE /compute/v2.1/servers/42726a57-cdc8-45e3-8d61-348f02bfcd53" status: 204 len: 0 microversion: 2.1 time: 0.293626 Oct 04 20:41:05.028942 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 937/1936] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 20:41:04 2022] DELETE /compute/v2.1/servers/42726a57-cdc8-45e3-8d61-348f02bfcd53 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 20:41:05.037313 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-206a67c3-63d1-40a3-b5ee-e1487d611781 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:41:05.038099 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-206a67c3-63d1-40a3-b5ee-e1487d611781 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] [instance: 42726a57-cdc8-45e3-8d61-348f02bfcd53] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:41:05.059581 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-962332f9-38df-411e-a00f-86fe02047469 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:41:05.060575 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-206a67c3-63d1-40a3-b5ee-e1487d611781 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:05.061574 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-206a67c3-63d1-40a3-b5ee-e1487d611781 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:05.063062 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-962332f9-38df-411e-a00f-86fe02047469 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] [instance: 53f0a355-8a5d-4775-a0d3-3aeedfc01570] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:41:05.063967 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-206a67c3-63d1-40a3-b5ee-e1487d611781 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:05.064978 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-206a67c3-63d1-40a3-b5ee-e1487d611781 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:05.067457 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-206a67c3-63d1-40a3-b5ee-e1487d611781 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:05.068146 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-206a67c3-63d1-40a3-b5ee-e1487d611781 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:05.087388 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-962332f9-38df-411e-a00f-86fe02047469 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:05.088872 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-962332f9-38df-411e-a00f-86fe02047469 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:05.091171 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-962332f9-38df-411e-a00f-86fe02047469 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:05.092127 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-962332f9-38df-411e-a00f-86fe02047469 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:05.104222 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-962332f9-38df-411e-a00f-86fe02047469 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:05.106976 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-962332f9-38df-411e-a00f-86fe02047469 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:06.005554 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-962332f9-38df-411e-a00f-86fe02047469 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96919ec99c14864876d64a9c2b20f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b44ce10b78bf49c882c9b4df06187114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:41:06.028027 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-962332f9-38df-411e-a00f-86fe02047469 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] 10.222.0.33 "GET /compute/v2.1/servers/53f0a355-8a5d-4775-a0d3-3aeedfc01570" status: 200 len: 1485 microversion: 2.1 time: 0.985080 Oct 04 20:41:06.028969 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 938/1937] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:41:05 2022] GET /compute/v2.1/servers/53f0a355-8a5d-4775-a0d3-3aeedfc01570 => generated 1485 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:41:06.034107 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-07d1ca2f-1bd7-4a2e-84b6-62c1bc6191d7 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:41:06.034430 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-07d1ca2f-1bd7-4a2e-84b6-62c1bc6191d7 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] [instance: 83df4756-40e2-4fc6-be48-48a82dd4572a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:41:06.046161 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-206a67c3-63d1-40a3-b5ee-e1487d611781 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36f4114dc4f443f8b48da7b4027e0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a23a85365414f92bbc03177d7f190e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:41:06.058705 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-07d1ca2f-1bd7-4a2e-84b6-62c1bc6191d7 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:06.060477 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-07d1ca2f-1bd7-4a2e-84b6-62c1bc6191d7 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:06.062450 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-07d1ca2f-1bd7-4a2e-84b6-62c1bc6191d7 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:06.065670 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-07d1ca2f-1bd7-4a2e-84b6-62c1bc6191d7 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:06.066525 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-07d1ca2f-1bd7-4a2e-84b6-62c1bc6191d7 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:06.068812 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-206a67c3-63d1-40a3-b5ee-e1487d611781 tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] 10.222.0.33 "GET /compute/v2.1/servers/42726a57-cdc8-45e3-8d61-348f02bfcd53" status: 200 len: 1472 microversion: 2.1 time: 1.034906 Oct 04 20:41:06.071550 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-07d1ca2f-1bd7-4a2e-84b6-62c1bc6191d7 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:06.084274 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1000/1938] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:41:05 2022] GET /compute/v2.1/servers/42726a57-cdc8-45e3-8d61-348f02bfcd53 => generated 1472 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:41:06.097704 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-271bfde3-5494-431a-b2cd-2b5805ba92d7 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:41:06.099555 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-271bfde3-5494-431a-b2cd-2b5805ba92d7 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] [instance: 53f0a355-8a5d-4775-a0d3-3aeedfc01570] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:41:06.118815 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-271bfde3-5494-431a-b2cd-2b5805ba92d7 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:06.122252 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-271bfde3-5494-431a-b2cd-2b5805ba92d7 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:06.123638 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-271bfde3-5494-431a-b2cd-2b5805ba92d7 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:06.126703 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-271bfde3-5494-431a-b2cd-2b5805ba92d7 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:06.128973 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-271bfde3-5494-431a-b2cd-2b5805ba92d7 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:06.130161 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-271bfde3-5494-431a-b2cd-2b5805ba92d7 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:06.327238 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-271bfde3-5494-431a-b2cd-2b5805ba92d7 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] 10.222.0.33 "POST /compute/v2.1/servers/53f0a355-8a5d-4775-a0d3-3aeedfc01570/action" status: 202 len: 0 microversion: 2.1 time: 0.226575 Oct 04 20:41:06.328000 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1001/1939] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 20:41:06 2022] POST /compute/v2.1/servers/53f0a355-8a5d-4775-a0d3-3aeedfc01570/action => generated 0 bytes in 243 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:41:06.341315 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-1957d811-90eb-4a9b-b1f4-89ed9ae34794 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:41:06.342779 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-1957d811-90eb-4a9b-b1f4-89ed9ae34794 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] [instance: 53f0a355-8a5d-4775-a0d3-3aeedfc01570] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:41:06.354749 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1957d811-90eb-4a9b-b1f4-89ed9ae34794 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:06.358444 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1957d811-90eb-4a9b-b1f4-89ed9ae34794 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:06.363272 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1957d811-90eb-4a9b-b1f4-89ed9ae34794 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:06.364291 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1957d811-90eb-4a9b-b1f4-89ed9ae34794 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:06.364763 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1957d811-90eb-4a9b-b1f4-89ed9ae34794 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:06.370819 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1957d811-90eb-4a9b-b1f4-89ed9ae34794 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:06.495316 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-07d1ca2f-1bd7-4a2e-84b6-62c1bc6191d7 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '800db3a57ada47eca381b00189fdbf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66ec8ea91b04deb90b679589e0495bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:41:06.506019 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-07d1ca2f-1bd7-4a2e-84b6-62c1bc6191d7 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] 10.222.0.33 "GET /compute/v2.1/servers/83df4756-40e2-4fc6-be48-48a82dd4572a" status: 200 len: 1718 microversion: 2.1 time: 0.475951 Oct 04 20:41:06.522038 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 939/1940] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:41:06 2022] GET /compute/v2.1/servers/83df4756-40e2-4fc6-be48-48a82dd4572a => generated 1718 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:41:07.066040 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-1957d811-90eb-4a9b-b1f4-89ed9ae34794 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96919ec99c14864876d64a9c2b20f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b44ce10b78bf49c882c9b4df06187114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:41:07.084883 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-1957d811-90eb-4a9b-b1f4-89ed9ae34794 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] 10.222.0.33 "GET /compute/v2.1/servers/53f0a355-8a5d-4775-a0d3-3aeedfc01570" status: 200 len: 1493 microversion: 2.1 time: 0.751642 Oct 04 20:41:07.097643 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1002/1941] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:41:06 2022] GET /compute/v2.1/servers/53f0a355-8a5d-4775-a0d3-3aeedfc01570 => generated 1493 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:41:07.109806 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-3770c2fb-4999-4768-87c7-243462533b3d tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:41:07.111183 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-3770c2fb-4999-4768-87c7-243462533b3d tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] [instance: 42726a57-cdc8-45e3-8d61-348f02bfcd53] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:41:07.132930 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3770c2fb-4999-4768-87c7-243462533b3d tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:07.133232 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3770c2fb-4999-4768-87c7-243462533b3d tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:07.143746 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3770c2fb-4999-4768-87c7-243462533b3d tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:07.144675 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3770c2fb-4999-4768-87c7-243462533b3d tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:07.145163 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3770c2fb-4999-4768-87c7-243462533b3d tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:07.145605 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3770c2fb-4999-4768-87c7-243462533b3d tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:07.672304 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-3770c2fb-4999-4768-87c7-243462533b3d tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36f4114dc4f443f8b48da7b4027e0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a23a85365414f92bbc03177d7f190e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:41:07.685955 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8c6e7ce0-e768-4937-adba-a8b90cb298a5 tempest-FloatingIPDetailsTestJSON-1552955020 tempest-FloatingIPDetailsTestJSON-1552955020-project] Action: 'create', calling method: .version_select at 0x7f3c78839940>, body: {"pool": null} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:41:07.687287 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-3770c2fb-4999-4768-87c7-243462533b3d tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] 10.222.0.33 "GET /compute/v2.1/servers/42726a57-cdc8-45e3-8d61-348f02bfcd53" status: 200 len: 1472 microversion: 2.1 time: 0.589793 Oct 04 20:41:07.689912 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1003/1942] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:41:07 2022] GET /compute/v2.1/servers/42726a57-cdc8-45e3-8d61-348f02bfcd53 => generated 1472 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:41:07.701409 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-68f34797-fd95-4d9a-b129-06519397a7ba tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:41:07.702263 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-68f34797-fd95-4d9a-b129-06519397a7ba tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] [instance: 83df4756-40e2-4fc6-be48-48a82dd4572a] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:41:07.716632 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-68f34797-fd95-4d9a-b129-06519397a7ba tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:07.720010 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-68f34797-fd95-4d9a-b129-06519397a7ba tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:07.721120 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-68f34797-fd95-4d9a-b129-06519397a7ba tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:07.722226 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-68f34797-fd95-4d9a-b129-06519397a7ba tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:07.724625 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-68f34797-fd95-4d9a-b129-06519397a7ba tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:07.725267 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-68f34797-fd95-4d9a-b129-06519397a7ba tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:08.209319 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-68f34797-fd95-4d9a-b129-06519397a7ba tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '800db3a57ada47eca381b00189fdbf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66ec8ea91b04deb90b679589e0495bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:41:08.236248 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-68f34797-fd95-4d9a-b129-06519397a7ba tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] 10.222.0.33 "GET /compute/v2.1/servers/83df4756-40e2-4fc6-be48-48a82dd4572a" status: 200 len: 1718 microversion: 2.1 time: 0.544946 Oct 04 20:41:08.241989 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1004/1943] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:41:07 2022] GET /compute/v2.1/servers/83df4756-40e2-4fc6-be48-48a82dd4572a => generated 1718 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:41:08.263673 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-21b2d35e-da4e-4d36-b726-e3d3b19d9f09 req-dc9812b7-81ae-45b7-9789-f815ae783d8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42726a57-cdc8-45e3-8d61-348f02bfcd53", "name": "network-vif-deleted", "tag": "e79353aa-2a26-4aa4-aa99-70580b24b76e"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:41:08.288982 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-21b2d35e-da4e-4d36-b726-e3d3b19d9f09 req-dc9812b7-81ae-45b7-9789-f815ae783d8b service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:08.289416 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-21b2d35e-da4e-4d36-b726-e3d3b19d9f09 req-dc9812b7-81ae-45b7-9789-f815ae783d8b service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:08.289908 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-21b2d35e-da4e-4d36-b726-e3d3b19d9f09 req-dc9812b7-81ae-45b7-9789-f815ae783d8b service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:08.334895 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-21b2d35e-da4e-4d36-b726-e3d3b19d9f09 req-dc9812b7-81ae-45b7-9789-f815ae783d8b service nova] Creating event network-vif-deleted:e79353aa-2a26-4aa4-aa99-70580b24b76e for instance 42726a57-cdc8-45e3-8d61-348f02bfcd53 on n-h1-854823-8 Oct 04 20:41:08.354673 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-21b2d35e-da4e-4d36-b726-e3d3b19d9f09 req-dc9812b7-81ae-45b7-9789-f815ae783d8b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111888 Oct 04 20:41:08.362726 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1005/1944] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:41:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:41:08.371297 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-1f68f53c-a684-47f9-8a5f-a44ae995ba3e tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:41:08.377335 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-1f68f53c-a684-47f9-8a5f-a44ae995ba3e tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] [instance: 53f0a355-8a5d-4775-a0d3-3aeedfc01570] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:41:08.397162 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1f68f53c-a684-47f9-8a5f-a44ae995ba3e tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:08.397668 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1f68f53c-a684-47f9-8a5f-a44ae995ba3e tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:08.398161 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1f68f53c-a684-47f9-8a5f-a44ae995ba3e tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:08.398973 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1f68f53c-a684-47f9-8a5f-a44ae995ba3e tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:08.399472 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1f68f53c-a684-47f9-8a5f-a44ae995ba3e tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:08.407162 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1f68f53c-a684-47f9-8a5f-a44ae995ba3e tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:09.737950 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-1f68f53c-a684-47f9-8a5f-a44ae995ba3e tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96919ec99c14864876d64a9c2b20f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b44ce10b78bf49c882c9b4df06187114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:41:09.752283 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-1f68f53c-a684-47f9-8a5f-a44ae995ba3e tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] 10.222.0.33 "GET /compute/v2.1/servers/53f0a355-8a5d-4775-a0d3-3aeedfc01570" status: 200 len: 1493 microversion: 2.1 time: 1.381648 Oct 04 20:41:09.770368 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1006/1945] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:41:08 2022] GET /compute/v2.1/servers/53f0a355-8a5d-4775-a0d3-3aeedfc01570 => generated 1493 bytes in 1393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:41:09.776366 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-c0314a31-dce8-4e50-91d5-41983db289cb tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:41:09.776992 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-c0314a31-dce8-4e50-91d5-41983db289cb tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] [instance: 42726a57-cdc8-45e3-8d61-348f02bfcd53] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:41:09.822136 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c0314a31-dce8-4e50-91d5-41983db289cb tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:09.822716 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c0314a31-dce8-4e50-91d5-41983db289cb tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:09.823170 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c0314a31-dce8-4e50-91d5-41983db289cb tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:09.823928 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c0314a31-dce8-4e50-91d5-41983db289cb tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:09.824391 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c0314a31-dce8-4e50-91d5-41983db289cb tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:09.824825 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c0314a31-dce8-4e50-91d5-41983db289cb tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:09.833203 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:41:09.866262 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.wsgi [None req-c0314a31-dce8-4e50-91d5-41983db289cb tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] HTTP exception thrown: Instance 42726a57-cdc8-45e3-8d61-348f02bfcd53 could not be found. Oct 04 20:41:09.873824 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-c0314a31-dce8-4e50-91d5-41983db289cb tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Request method failure captured: Oct 04 20:41:09.873824 n-d-854823-8 devstack@n-api.service[128802]: request: GET /compute/v2.1/servers/42726a57-cdc8-45e3-8d61-348f02bfcd53 HTTP/1.1 Oct 04 20:41:09.873824 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 20:41:09.873824 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 20:41:09.873824 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 20:41:09.873824 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 0 Oct 04 20:41:09.873824 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 20:41:09.873824 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 20:41:09.873824 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 20:41:09.873824 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 20:41:09.873824 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPJmeqrgxMn_vD-ao9MwjUJsz467_UAHW--vO2J2bMBYcsyRLhLo6Qj0nbEneOIdoi1LyiMNoKFQexjywspnMbrI5Aae3ew90UDzKQnlSm-j4NlsTEmvIdX9JuBz7NdY6Hhk6Az56PzRPsjCNW7LpLzJRfXCMnPsMFpfxnfuJgRzeSWg Oct 04 20:41:09.873824 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 20:41:09.873824 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 20:41:09.873824 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 20:41:09.873824 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 20:41:09.873824 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 20:41:09.873824 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 20:41:09.873824 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: 1a23a85365414f92bbc03177d7f190e6 Oct 04 20:41:09.873824 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-ServersOnMultiNodesTest-1191352258 Oct 04 20:41:09.873824 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 20:41:09.873824 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 20:41:09.873824 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_1a23a85365414f92bbc03177d7f190e6", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1a23a85365414f92bbc03177d7f190e6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1a23a85365414f92bbc03177d7f190e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/1a23a85365414f92bbc03177d7f190e6"}]}] Oct 04 20:41:09.873824 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-ServersOnMultiNodesTest-1191352258 Oct 04 20:41:09.873824 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: 1a23a85365414f92bbc03177d7f190e6 Oct 04 20:41:09.873824 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1191352258 Oct 04 20:41:09.873824 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-ServersOnMultiNodesTest-1191352258-project Oct 04 20:41:09.873824 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 20:41:09.873824 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 20:41:09.873824 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: e36f4114dc4f443f8b48da7b4027e0c1 Oct 04 20:41:09.873824 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-ServersOnMultiNodesTest-1191352258-project Oct 04 20:41:09.873824 n-d-854823-8 devstack@n-api.service[128802]: method: > Oct 04 20:41:09.873824 n-d-854823-8 devstack@n-api.service[128802]: exception: Instance 42726a57-cdc8-45e3-8d61-348f02bfcd53 could not be found. Oct 04 20:41:09.873824 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'id': '42726a57-cdc8-45e3-8d61-348f02bfcd53'} Oct 04 20:41:09.873824 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:41:09.873824 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:41:09.873824 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:41:09.873824 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:41:09.873824 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:41:09.873824 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:41:09.873824 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:41:09.873824 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:41:09.873824 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:41:09.873824 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:41:09.873824 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 42726a57-cdc8-45e3-8d61-348f02bfcd53 could not be found. Oct 04 20:41:09.873824 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:41:09.873824 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:41:09.873824 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:41:09.873824 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:41:09.873824 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:41:09.873824 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:41:09.873824 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:41:09.873824 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:41:09.873824 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:41:09.873824 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:41:09.873824 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:41:09.873824 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:41:09.873824 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:41:09.873824 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:41:09.873824 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:41:09.873824 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:41:09.873824 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 42726a57-cdc8-45e3-8d61-348f02bfcd53 could not be found. Oct 04 20:41:09.873824 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:41:09.873824 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:41:09.873824 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:41:09.881868 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:41:09.881868 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:41:09.881868 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:41:09.881868 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:41:09.881868 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:41:09.881868 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 42726a57-cdc8-45e3-8d61-348f02bfcd53 could not be found. Oct 04 20:41:09.881868 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:41:09.886652 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-c0314a31-dce8-4e50-91d5-41983db289cb tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] Returning 404 to user: Instance 42726a57-cdc8-45e3-8d61-348f02bfcd53 could not be found. {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:41:09.887964 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-c0314a31-dce8-4e50-91d5-41983db289cb tempest-ServersOnMultiNodesTest-1191352258 tempest-ServersOnMultiNodesTest-1191352258-project] 10.222.0.33 "GET /compute/v2.1/servers/42726a57-cdc8-45e3-8d61-348f02bfcd53" status: 404 len: 111 microversion: 2.1 time: 0.129459 Oct 04 20:41:09.891978 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1007/1946] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:41:09 2022] GET /compute/v2.1/servers/42726a57-cdc8-45e3-8d61-348f02bfcd53 => generated 111 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:41:09.902306 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-da44dd33-6e1e-4f1e-8213-ef409ef5cab9 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:41:09.910265 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-da44dd33-6e1e-4f1e-8213-ef409ef5cab9 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] [instance: 83df4756-40e2-4fc6-be48-48a82dd4572a] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:41:09.935980 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-da44dd33-6e1e-4f1e-8213-ef409ef5cab9 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:09.936478 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-da44dd33-6e1e-4f1e-8213-ef409ef5cab9 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:09.938097 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-da44dd33-6e1e-4f1e-8213-ef409ef5cab9 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:09.947738 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-da44dd33-6e1e-4f1e-8213-ef409ef5cab9 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:09.948230 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-da44dd33-6e1e-4f1e-8213-ef409ef5cab9 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:09.951497 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-da44dd33-6e1e-4f1e-8213-ef409ef5cab9 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:10.258963 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-da44dd33-6e1e-4f1e-8213-ef409ef5cab9 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '800db3a57ada47eca381b00189fdbf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66ec8ea91b04deb90b679589e0495bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:41:10.273642 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-da44dd33-6e1e-4f1e-8213-ef409ef5cab9 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] 10.222.0.33 "GET /compute/v2.1/servers/83df4756-40e2-4fc6-be48-48a82dd4572a" status: 200 len: 1718 microversion: 2.1 time: 0.383263 Oct 04 20:41:10.284414 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1008/1947] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:41:09 2022] GET /compute/v2.1/servers/83df4756-40e2-4fc6-be48-48a82dd4572a => generated 1718 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:41:11.145035 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-33ad7535-f5bf-4319-ac5d-fa7edff20c91 tempest-SecurityGroupRulesTestJSON-387118441 tempest-SecurityGroupRulesTestJSON-387118441-project] Action: 'create', calling method: .version_select at 0x7f3c78977b80>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1806331981", "description": "tempest-description-1434823950"}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:41:11.800680 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-8c6e7ce0-e768-4937-adba-a8b90cb298a5 tempest-FloatingIPDetailsTestJSON-1552955020 tempest-FloatingIPDetailsTestJSON-1552955020-project] 10.222.0.33 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.926021 Oct 04 20:41:11.801637 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 940/1948] 10.222.0.33 () {60 vars in 1170 bytes} [Tue Oct 4 20:41:06 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4928 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 20:41:11.819006 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-77756da7-66c8-4303-86f3-fd18bdca4cc9 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:41:11.820984 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-77756da7-66c8-4303-86f3-fd18bdca4cc9 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] [instance: 53f0a355-8a5d-4775-a0d3-3aeedfc01570] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:41:11.850223 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-77756da7-66c8-4303-86f3-fd18bdca4cc9 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:11.851107 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-77756da7-66c8-4303-86f3-fd18bdca4cc9 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:11.851749 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-77756da7-66c8-4303-86f3-fd18bdca4cc9 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:11.852678 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-77756da7-66c8-4303-86f3-fd18bdca4cc9 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:11.853329 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-77756da7-66c8-4303-86f3-fd18bdca4cc9 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:11.853960 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-77756da7-66c8-4303-86f3-fd18bdca4cc9 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:12.257798 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-77756da7-66c8-4303-86f3-fd18bdca4cc9 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96919ec99c14864876d64a9c2b20f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b44ce10b78bf49c882c9b4df06187114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:41:12.275262 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-77756da7-66c8-4303-86f3-fd18bdca4cc9 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] 10.222.0.33 "GET /compute/v2.1/servers/53f0a355-8a5d-4775-a0d3-3aeedfc01570" status: 200 len: 1499 microversion: 2.1 time: 0.472140 Oct 04 20:41:12.278957 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 941/1949] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:41:11 2022] GET /compute/v2.1/servers/53f0a355-8a5d-4775-a0d3-3aeedfc01570 => generated 1499 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:41:12.296910 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-daebe8db-9cf5-4ad9-8bc7-4817c739d3d6 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:41:12.300744 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-daebe8db-9cf5-4ad9-8bc7-4817c739d3d6 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] [instance: 83df4756-40e2-4fc6-be48-48a82dd4572a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:41:12.331707 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-33ad7535-f5bf-4319-ac5d-fa7edff20c91 tempest-SecurityGroupRulesTestJSON-387118441 tempest-SecurityGroupRulesTestJSON-387118441-project] 10.222.0.33 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 1.559263 Oct 04 20:41:12.332219 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-daebe8db-9cf5-4ad9-8bc7-4817c739d3d6 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:12.332219 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-daebe8db-9cf5-4ad9-8bc7-4817c739d3d6 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:12.332219 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-daebe8db-9cf5-4ad9-8bc7-4817c739d3d6 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:12.332493 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1009/1950] 10.222.0.33 () {60 vars in 1180 bytes} [Tue Oct 4 20:41:10 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 1561 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:41:12.332869 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-daebe8db-9cf5-4ad9-8bc7-4817c739d3d6 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:12.338522 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-4b206e34-9ff6-4085-b63d-218f28ae03e3 req-e4c77d66-aed5-468b-8943-ea92ffc19105 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83df4756-40e2-4fc6-be48-48a82dd4572a", "name": "network-vif-unplugged", "status": "completed", "tag": "df81fac5-fbf3-4eb9-bad4-4478b0098ba4"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:41:12.343816 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-daebe8db-9cf5-4ad9-8bc7-4817c739d3d6 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:12.344931 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-daebe8db-9cf5-4ad9-8bc7-4817c739d3d6 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:12.381023 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-4b206e34-9ff6-4085-b63d-218f28ae03e3 req-e4c77d66-aed5-468b-8943-ea92ffc19105 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:12.382242 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-4b206e34-9ff6-4085-b63d-218f28ae03e3 req-e4c77d66-aed5-468b-8943-ea92ffc19105 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:12.383415 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-4b206e34-9ff6-4085-b63d-218f28ae03e3 req-e4c77d66-aed5-468b-8943-ea92ffc19105 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:12.435558 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-4b206e34-9ff6-4085-b63d-218f28ae03e3 req-e4c77d66-aed5-468b-8943-ea92ffc19105 service nova] Creating event network-vif-unplugged:df81fac5-fbf3-4eb9-bad4-4478b0098ba4 for instance 83df4756-40e2-4fc6-be48-48a82dd4572a on n-h1-854823-8 Oct 04 20:41:12.459375 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-4b206e34-9ff6-4085-b63d-218f28ae03e3 req-e4c77d66-aed5-468b-8943-ea92ffc19105 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.125679 Oct 04 20:41:12.466862 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1010/1951] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:41:12 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:41:12.492506 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-2af2f25a-09dd-4f9e-8817-58b14dc7c308 tempest-FloatingIPDetailsTestJSON-1552955020 tempest-FloatingIPDetailsTestJSON-1552955020-project] Action: 'create', calling method: .version_select at 0x7f3c7890fdc0>, body: {"pool": null} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:41:12.968311 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-daebe8db-9cf5-4ad9-8bc7-4817c739d3d6 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '800db3a57ada47eca381b00189fdbf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66ec8ea91b04deb90b679589e0495bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:41:12.988039 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-daebe8db-9cf5-4ad9-8bc7-4817c739d3d6 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] 10.222.0.33 "GET /compute/v2.1/servers/83df4756-40e2-4fc6-be48-48a82dd4572a" status: 200 len: 1718 microversion: 2.1 time: 0.702675 Oct 04 20:41:13.003539 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 942/1952] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:41:12 2022] GET /compute/v2.1/servers/83df4756-40e2-4fc6-be48-48a82dd4572a => generated 1718 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:41:13.012603 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b943c006-bff0-4bab-ba84-921cc3fc5b94 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:41:13.013438 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b943c006-bff0-4bab-ba84-921cc3fc5b94 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] [instance: 53f0a355-8a5d-4775-a0d3-3aeedfc01570] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:41:13.021871 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b943c006-bff0-4bab-ba84-921cc3fc5b94 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:13.022640 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b943c006-bff0-4bab-ba84-921cc3fc5b94 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:13.023332 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b943c006-bff0-4bab-ba84-921cc3fc5b94 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:13.024302 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b943c006-bff0-4bab-ba84-921cc3fc5b94 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:13.024983 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b943c006-bff0-4bab-ba84-921cc3fc5b94 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:13.025637 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b943c006-bff0-4bab-ba84-921cc3fc5b94 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:13.097836 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b943c006-bff0-4bab-ba84-921cc3fc5b94 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] [instance: 53f0a355-8a5d-4775-a0d3-3aeedfc01570] Going to try to terminate instance {{(pid=128801) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:41:13.308345 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b943c006-bff0-4bab-ba84-921cc3fc5b94 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] 10.222.0.33 "DELETE /compute/v2.1/servers/53f0a355-8a5d-4775-a0d3-3aeedfc01570" status: 204 len: 0 microversion: 2.1 time: 0.301422 Oct 04 20:41:13.308958 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 943/1953] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 20:41:13 2022] DELETE /compute/v2.1/servers/53f0a355-8a5d-4775-a0d3-3aeedfc01570 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:41:13.317433 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-def425c0-7582-40be-b97a-6006d38656f2 tempest-SecurityGroupRulesTestJSON-387118441 tempest-SecurityGroupRulesTestJSON-387118441-project] Action: 'create', calling method: .version_select at 0x7f3c741f2700>, body: {"security_group_rule": {"parent_group_id": "47f23a54-67e2-4b08-bfc0-5aa6db3d75be", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:41:14.156359 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-def425c0-7582-40be-b97a-6006d38656f2 tempest-SecurityGroupRulesTestJSON-387118441 tempest-SecurityGroupRulesTestJSON-387118441-project] 10.222.0.33 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.844392 Oct 04 20:41:14.158806 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 944/1954] 10.222.0.33 () {60 vars in 1195 bytes} [Tue Oct 4 20:41:13 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:41:14.164618 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-60c8bd8c-93be-475c-82ff-71497bedcef6 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:41:14.166148 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-60c8bd8c-93be-475c-82ff-71497bedcef6 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] [instance: 53f0a355-8a5d-4775-a0d3-3aeedfc01570] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:41:14.212864 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-60c8bd8c-93be-475c-82ff-71497bedcef6 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:14.215133 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-60c8bd8c-93be-475c-82ff-71497bedcef6 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:14.216357 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-60c8bd8c-93be-475c-82ff-71497bedcef6 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:14.223774 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-60c8bd8c-93be-475c-82ff-71497bedcef6 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:14.224601 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-60c8bd8c-93be-475c-82ff-71497bedcef6 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:14.230155 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-60c8bd8c-93be-475c-82ff-71497bedcef6 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:14.637759 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-60c8bd8c-93be-475c-82ff-71497bedcef6 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96919ec99c14864876d64a9c2b20f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b44ce10b78bf49c882c9b4df06187114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:41:14.651572 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-60c8bd8c-93be-475c-82ff-71497bedcef6 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] 10.222.0.33 "GET /compute/v2.1/servers/53f0a355-8a5d-4775-a0d3-3aeedfc01570" status: 200 len: 1505 microversion: 2.1 time: 0.491362 Oct 04 20:41:14.671193 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 945/1955] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:41:14 2022] GET /compute/v2.1/servers/53f0a355-8a5d-4775-a0d3-3aeedfc01570 => generated 1505 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:41:14.684673 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6edfa4bc-6f0e-4238-9444-01923b18b2af tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:41:14.687096 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-6edfa4bc-6f0e-4238-9444-01923b18b2af tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] [instance: 6ff56299-ada5-4e73-9e68-59cdd48f8a16] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:41:14.700858 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6edfa4bc-6f0e-4238-9444-01923b18b2af tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:14.704931 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6edfa4bc-6f0e-4238-9444-01923b18b2af tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:14.705625 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6edfa4bc-6f0e-4238-9444-01923b18b2af tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:14.706609 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6edfa4bc-6f0e-4238-9444-01923b18b2af tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:14.707274 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6edfa4bc-6f0e-4238-9444-01923b18b2af tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:14.707913 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6edfa4bc-6f0e-4238-9444-01923b18b2af tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:14.774658 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-6edfa4bc-6f0e-4238-9444-01923b18b2af tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] [instance: 6ff56299-ada5-4e73-9e68-59cdd48f8a16] Going to try to terminate instance {{(pid=128801) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:41:14.931022 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-6edfa4bc-6f0e-4238-9444-01923b18b2af tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] 10.222.0.33 "DELETE /compute/v2.1/servers/6ff56299-ada5-4e73-9e68-59cdd48f8a16" status: 204 len: 0 microversion: 2.1 time: 0.254137 Oct 04 20:41:14.937999 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 946/1956] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 20:41:14 2022] DELETE /compute/v2.1/servers/6ff56299-ada5-4e73-9e68-59cdd48f8a16 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:41:14.947098 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e70d58ca-d0f1-4524-a8c8-d199e516d0b2 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:41:14.948960 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e70d58ca-d0f1-4524-a8c8-d199e516d0b2 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] [instance: 83df4756-40e2-4fc6-be48-48a82dd4572a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:41:14.966856 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e70d58ca-d0f1-4524-a8c8-d199e516d0b2 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:14.967361 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e70d58ca-d0f1-4524-a8c8-d199e516d0b2 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:14.967799 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e70d58ca-d0f1-4524-a8c8-d199e516d0b2 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:14.970162 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e70d58ca-d0f1-4524-a8c8-d199e516d0b2 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:14.970662 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e70d58ca-d0f1-4524-a8c8-d199e516d0b2 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:14.971082 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e70d58ca-d0f1-4524-a8c8-d199e516d0b2 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:15.483853 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e70d58ca-d0f1-4524-a8c8-d199e516d0b2 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '800db3a57ada47eca381b00189fdbf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66ec8ea91b04deb90b679589e0495bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:41:15.493410 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:41:15.500638 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e70d58ca-d0f1-4524-a8c8-d199e516d0b2 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] 10.222.0.33 "GET /compute/v2.1/servers/83df4756-40e2-4fc6-be48-48a82dd4572a" status: 200 len: 1718 microversion: 2.1 time: 0.560085 Oct 04 20:41:15.502830 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 947/1957] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:41:14 2022] GET /compute/v2.1/servers/83df4756-40e2-4fc6-be48-48a82dd4572a => generated 1718 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:41:15.508642 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2e20a8f5-23dd-4822-a7f7-e12c075f2481 tempest-SecurityGroupRulesTestJSON-387118441 tempest-SecurityGroupRulesTestJSON-387118441-project] Action: 'create', calling method: .version_select at 0x7f3c741f2af0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1548443808", "description": "tempest-description-910265554"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:41:15.529884 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-2af2f25a-09dd-4f9e-8817-58b14dc7c308 tempest-FloatingIPDetailsTestJSON-1552955020 tempest-FloatingIPDetailsTestJSON-1552955020-project] 10.222.0.33 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.061440 Oct 04 20:41:15.530569 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1011/1958] 10.222.0.33 () {60 vars in 1170 bytes} [Tue Oct 4 20:41:12 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3063 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:41:15.557621 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-70141dac-dfc1-416b-a41b-152a49b32f57 req-ad1c163b-c709-4844-8d6c-7b6d4afef060 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "83df4756-40e2-4fc6-be48-48a82dd4572a", "tag": "df81fac5-fbf3-4eb9-bad4-4478b0098ba4"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:41:15.597647 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=6,nova_api:UPDATE=1 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:41:15.603461 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-70141dac-dfc1-416b-a41b-152a49b32f57 req-ad1c163b-c709-4844-8d6c-7b6d4afef060 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:15.611771 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-70141dac-dfc1-416b-a41b-152a49b32f57 req-ad1c163b-c709-4844-8d6c-7b6d4afef060 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:15.612699 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-70141dac-dfc1-416b-a41b-152a49b32f57 req-ad1c163b-c709-4844-8d6c-7b6d4afef060 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:15.655641 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-70141dac-dfc1-416b-a41b-152a49b32f57 req-ad1c163b-c709-4844-8d6c-7b6d4afef060 service nova] Creating event network-changed:df81fac5-fbf3-4eb9-bad4-4478b0098ba4 for instance 83df4756-40e2-4fc6-be48-48a82dd4572a on n-h1-854823-8 Oct 04 20:41:15.683134 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-70141dac-dfc1-416b-a41b-152a49b32f57 req-ad1c163b-c709-4844-8d6c-7b6d4afef060 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.142148 Oct 04 20:41:15.686210 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1012/1959] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:41:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:41:15.701620 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-beedc85a-54f9-4318-a973-425b05f9a40f tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:41:15.703451 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-beedc85a-54f9-4318-a973-425b05f9a40f tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] [instance: 6ff56299-ada5-4e73-9e68-59cdd48f8a16] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:41:15.704660 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-2e20a8f5-23dd-4822-a7f7-e12c075f2481 tempest-SecurityGroupRulesTestJSON-387118441 tempest-SecurityGroupRulesTestJSON-387118441-project] 10.222.0.33 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.200530 Oct 04 20:41:15.705548 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 948/1960] 10.222.0.33 () {60 vars in 1180 bytes} [Tue Oct 4 20:41:15 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:41:15.713445 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-eb9cec43-9c3b-46aa-8be2-25f8b1772003 tempest-FloatingIPDetailsTestJSON-1552955020 tempest-FloatingIPDetailsTestJSON-1552955020-project] Action: 'create', calling method: .version_select at 0x7f3c7425bee0>, body: {"pool": null} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:41:15.731943 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-beedc85a-54f9-4318-a973-425b05f9a40f tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:15.732952 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-beedc85a-54f9-4318-a973-425b05f9a40f tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:15.733572 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-beedc85a-54f9-4318-a973-425b05f9a40f tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:15.735216 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-beedc85a-54f9-4318-a973-425b05f9a40f tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:15.736958 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-beedc85a-54f9-4318-a973-425b05f9a40f tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:15.737578 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-beedc85a-54f9-4318-a973-425b05f9a40f tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:16.385010 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-beedc85a-54f9-4318-a973-425b05f9a40f tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673886dab3ed4cbd8a314386fbfbe39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f67490cfb798433eb86c006008c9aaa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:41:16.405124 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-beedc85a-54f9-4318-a973-425b05f9a40f tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] 10.222.0.33 "GET /compute/v2.1/servers/6ff56299-ada5-4e73-9e68-59cdd48f8a16" status: 200 len: 1663 microversion: 2.1 time: 0.712089 Oct 04 20:41:16.409565 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1013/1961] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:41:15 2022] GET /compute/v2.1/servers/6ff56299-ada5-4e73-9e68-59cdd48f8a16 => generated 1663 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:41:16.425802 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-83ec8a82-b5e7-4d23-a938-524c1c935cf1 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:41:16.429951 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-83ec8a82-b5e7-4d23-a938-524c1c935cf1 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] [instance: 53f0a355-8a5d-4775-a0d3-3aeedfc01570] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:41:16.447680 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-83ec8a82-b5e7-4d23-a938-524c1c935cf1 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:16.448455 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-83ec8a82-b5e7-4d23-a938-524c1c935cf1 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:16.449376 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-83ec8a82-b5e7-4d23-a938-524c1c935cf1 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:16.450405 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-83ec8a82-b5e7-4d23-a938-524c1c935cf1 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:16.451038 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-83ec8a82-b5e7-4d23-a938-524c1c935cf1 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:16.452342 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-83ec8a82-b5e7-4d23-a938-524c1c935cf1 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:18.645560 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-83ec8a82-b5e7-4d23-a938-524c1c935cf1 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96919ec99c14864876d64a9c2b20f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b44ce10b78bf49c882c9b4df06187114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:41:18.679645 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-83ec8a82-b5e7-4d23-a938-524c1c935cf1 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] 10.222.0.33 "GET /compute/v2.1/servers/53f0a355-8a5d-4775-a0d3-3aeedfc01570" status: 200 len: 1505 microversion: 2.1 time: 2.265908 Oct 04 20:41:18.681597 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1014/1962] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:41:16 2022] GET /compute/v2.1/servers/53f0a355-8a5d-4775-a0d3-3aeedfc01570 => generated 1505 bytes in 2271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:41:18.710141 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-1ec609a7-a8cc-432f-9d06-58564cef6584 tempest-SecurityGroupRulesTestJSON-387118441 tempest-SecurityGroupRulesTestJSON-387118441-project] Action: 'create', calling method: .version_select at 0x7f3c7428b5e0>, body: {"security_group_rule": {"parent_group_id": "47c69efa-1d80-4d7a-bf4c-fd8c3873e19b", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "10.2.3.124/24"}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:41:21.435625 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-1ec609a7-a8cc-432f-9d06-58564cef6584 tempest-SecurityGroupRulesTestJSON-387118441 tempest-SecurityGroupRulesTestJSON-387118441-project] 10.222.0.33 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 236 microversion: 2.1 time: 2.750868 Oct 04 20:41:21.436260 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1015/1963] 10.222.0.33 () {60 vars in 1195 bytes} [Tue Oct 4 20:41:18 2022] POST /compute/v2.1/os-security-group-rules => generated 236 bytes in 2753 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:41:21.441898 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-28542ac4-1033-4350-9bc0-95d861a4e13c tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:41:21.442552 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-28542ac4-1033-4350-9bc0-95d861a4e13c tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] [instance: 83df4756-40e2-4fc6-be48-48a82dd4572a] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:41:21.478525 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-28542ac4-1033-4350-9bc0-95d861a4e13c tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:21.479040 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-28542ac4-1033-4350-9bc0-95d861a4e13c tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:21.481780 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-28542ac4-1033-4350-9bc0-95d861a4e13c tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:21.482734 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-28542ac4-1033-4350-9bc0-95d861a4e13c tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:21.483209 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-28542ac4-1033-4350-9bc0-95d861a4e13c tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:21.485780 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-28542ac4-1033-4350-9bc0-95d861a4e13c tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:21.967979 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-28542ac4-1033-4350-9bc0-95d861a4e13c tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '800db3a57ada47eca381b00189fdbf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66ec8ea91b04deb90b679589e0495bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:41:22.000007 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-28542ac4-1033-4350-9bc0-95d861a4e13c tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] 10.222.0.33 "GET /compute/v2.1/servers/83df4756-40e2-4fc6-be48-48a82dd4572a" status: 200 len: 1718 microversion: 2.1 time: 0.562724 Oct 04 20:41:22.006002 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1016/1964] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:41:21 2022] GET /compute/v2.1/servers/83df4756-40e2-4fc6-be48-48a82dd4572a => generated 1718 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:41:22.020092 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-53afce7b-80ca-4e88-8787-a543fb321a3b tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:41:22.030243 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-53afce7b-80ca-4e88-8787-a543fb321a3b tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] [instance: 6ff56299-ada5-4e73-9e68-59cdd48f8a16] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:41:22.045733 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-53afce7b-80ca-4e88-8787-a543fb321a3b tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:22.059866 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-53afce7b-80ca-4e88-8787-a543fb321a3b tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:22.060840 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-53afce7b-80ca-4e88-8787-a543fb321a3b tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:22.061839 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-53afce7b-80ca-4e88-8787-a543fb321a3b tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:22.062419 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-53afce7b-80ca-4e88-8787-a543fb321a3b tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:22.067280 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-53afce7b-80ca-4e88-8787-a543fb321a3b tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:22.365841 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-53afce7b-80ca-4e88-8787-a543fb321a3b tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673886dab3ed4cbd8a314386fbfbe39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f67490cfb798433eb86c006008c9aaa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:41:22.378861 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-53afce7b-80ca-4e88-8787-a543fb321a3b tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] 10.222.0.33 "GET /compute/v2.1/servers/6ff56299-ada5-4e73-9e68-59cdd48f8a16" status: 200 len: 1596 microversion: 2.1 time: 0.367325 Oct 04 20:41:22.380078 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1017/1965] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:41:22 2022] GET /compute/v2.1/servers/6ff56299-ada5-4e73-9e68-59cdd48f8a16 => generated 1596 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:41:22.679077 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-ac7b9f64-10d5-4a69-9d40-5d07200a01ea tempest-TenantUsagesTestJSON-375897061 tempest-TenantUsagesTestJSON-375897061-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TenantUsagesTestJSON-server-2047504900", "imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63", "flavorRef": "452"}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:41:22.877636 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.network.neutron [None req-ac7b9f64-10d5-4a69-9d40-5d07200a01ea tempest-TenantUsagesTestJSON-375897061 tempest-TenantUsagesTestJSON-375897061-project] validate_networks() for None {{(pid=128802) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:41:23.746724 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-eb9cec43-9c3b-46aa-8be2-25f8b1772003 tempest-FloatingIPDetailsTestJSON-1552955020 tempest-FloatingIPDetailsTestJSON-1552955020-project] 10.222.0.33 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 8.039515 Oct 04 20:41:23.748077 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 949/1966] 10.222.0.33 () {60 vars in 1170 bytes} [Tue Oct 4 20:41:15 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 8042 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:41:23.754315 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-a2abd0ca-ca12-4876-93db-6c4057984506 req-fb1c6cbf-0cc2-4899-9e46-9793eb16e1d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53f0a355-8a5d-4775-a0d3-3aeedfc01570", "name": "network-vif-deleted", "tag": "28f3e80c-7ad7-4450-a14a-de593e11ffea"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:41:23.789761 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-a2abd0ca-ca12-4876-93db-6c4057984506 req-fb1c6cbf-0cc2-4899-9e46-9793eb16e1d9 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:23.790570 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-a2abd0ca-ca12-4876-93db-6c4057984506 req-fb1c6cbf-0cc2-4899-9e46-9793eb16e1d9 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:23.791358 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-a2abd0ca-ca12-4876-93db-6c4057984506 req-fb1c6cbf-0cc2-4899-9e46-9793eb16e1d9 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:23.805922 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-a2abd0ca-ca12-4876-93db-6c4057984506 req-fb1c6cbf-0cc2-4899-9e46-9793eb16e1d9 service nova] Creating event network-vif-deleted:28f3e80c-7ad7-4450-a14a-de593e11ffea for instance 53f0a355-8a5d-4775-a0d3-3aeedfc01570 on n-h2-854823-8 Oct 04 20:41:23.816613 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-a2abd0ca-ca12-4876-93db-6c4057984506 req-fb1c6cbf-0cc2-4899-9e46-9793eb16e1d9 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067043 Oct 04 20:41:23.819168 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 950/1967] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:41:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:41:23.833388 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7d0f4735-023a-477d-af51-cfa84c2020d3 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:41:23.834320 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-7d0f4735-023a-477d-af51-cfa84c2020d3 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] [instance: 53f0a355-8a5d-4775-a0d3-3aeedfc01570] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:41:23.856353 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7d0f4735-023a-477d-af51-cfa84c2020d3 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:23.857966 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7d0f4735-023a-477d-af51-cfa84c2020d3 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:23.859946 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7d0f4735-023a-477d-af51-cfa84c2020d3 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:23.861019 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7d0f4735-023a-477d-af51-cfa84c2020d3 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:23.861956 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7d0f4735-023a-477d-af51-cfa84c2020d3 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:23.863213 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7d0f4735-023a-477d-af51-cfa84c2020d3 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:23.896260 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-7d0f4735-023a-477d-af51-cfa84c2020d3 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] HTTP exception thrown: Instance 53f0a355-8a5d-4775-a0d3-3aeedfc01570 could not be found. Oct 04 20:41:23.898943 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7d0f4735-023a-477d-af51-cfa84c2020d3 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Request method failure captured: Oct 04 20:41:23.898943 n-d-854823-8 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/53f0a355-8a5d-4775-a0d3-3aeedfc01570 HTTP/1.1 Oct 04 20:41:23.898943 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:41:23.898943 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:41:23.898943 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:41:23.898943 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 0 Oct 04 20:41:23.898943 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:41:23.898943 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:41:23.898943 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:41:23.898943 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:41:23.898943 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJnuHTm4OYw0xc9SL3N7Jzd4vy7pjPjk-VzjNdzf9JkYRu7LjBJ7ezIZC_ibUEtpkaWihYnSgV8rl93QQWAzC-tCvGIXd4yDfqWytNCQeXdV59nwIqYCHXBJEUAznNRUlPXsuV0816cMEF0ZynrvmsBJieU6o28fx5oUnNIbTFdaQcA Oct 04 20:41:23.898943 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:41:23.898943 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:41:23.898943 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:41:23.898943 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:41:23.898943 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:41:23.898943 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:41:23.898943 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: b44ce10b78bf49c882c9b4df06187114 Oct 04 20:41:23.898943 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-ServerRescueTestJSON-630527753 Oct 04 20:41:23.898943 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 20:41:23.898943 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 20:41:23.898943 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b44ce10b78bf49c882c9b4df06187114", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b44ce10b78bf49c882c9b4df06187114"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b44ce10b78bf49c882c9b4df06187114"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b44ce10b78bf49c882c9b4df06187114"}]}] Oct 04 20:41:23.898943 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-ServerRescueTestJSON-630527753 Oct 04 20:41:23.898943 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: b44ce10b78bf49c882c9b4df06187114 Oct 04 20:41:23.898943 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ServerRescueTestJSON-630527753 Oct 04 20:41:23.898943 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-ServerRescueTestJSON-630527753-project Oct 04 20:41:23.898943 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:41:23.898943 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:41:23.898943 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: f96919ec99c14864876d64a9c2b20f8f Oct 04 20:41:23.898943 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-ServerRescueTestJSON-630527753-project Oct 04 20:41:23.898943 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 20:41:23.898943 n-d-854823-8 devstack@n-api.service[128801]: exception: Instance 53f0a355-8a5d-4775-a0d3-3aeedfc01570 could not be found. Oct 04 20:41:23.898943 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': '53f0a355-8a5d-4775-a0d3-3aeedfc01570'} Oct 04 20:41:23.898943 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:41:23.898943 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:41:23.898943 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:41:23.898943 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:41:23.898943 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:41:23.898943 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:41:23.898943 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:41:23.898943 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:41:23.898943 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:41:23.898943 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:41:23.898943 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 53f0a355-8a5d-4775-a0d3-3aeedfc01570 could not be found. Oct 04 20:41:23.898943 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:41:23.898943 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:41:23.898943 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:41:23.898943 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:41:23.898943 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:41:23.898943 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:41:23.898943 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:41:23.898943 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:41:23.898943 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:41:23.898943 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:41:23.898943 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:41:23.898943 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:41:23.898943 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:41:23.898943 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:41:23.898943 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:41:23.898943 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:41:23.898943 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 53f0a355-8a5d-4775-a0d3-3aeedfc01570 could not be found. Oct 04 20:41:23.898943 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:41:23.898943 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:41:23.898943 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:41:23.904865 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:41:23.904865 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:41:23.904865 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:41:23.904865 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:41:23.904865 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:41:23.904865 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 53f0a355-8a5d-4775-a0d3-3aeedfc01570 could not be found. Oct 04 20:41:23.904865 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:41:23.907614 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7d0f4735-023a-477d-af51-cfa84c2020d3 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Returning 404 to user: Instance 53f0a355-8a5d-4775-a0d3-3aeedfc01570 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:41:23.909211 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-7d0f4735-023a-477d-af51-cfa84c2020d3 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] 10.222.0.33 "GET /compute/v2.1/servers/53f0a355-8a5d-4775-a0d3-3aeedfc01570" status: 404 len: 111 microversion: 2.1 time: 0.085481 Oct 04 20:41:23.910329 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 951/1968] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:41:23 2022] GET /compute/v2.1/servers/53f0a355-8a5d-4775-a0d3-3aeedfc01570 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:41:23.917824 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ab265db3-3dc0-4d3d-b9a8-4c06ebaca5a5 tempest-SecurityGroupRulesTestJSON-387118441 tempest-SecurityGroupRulesTestJSON-387118441-project] Action: 'create', calling method: .version_select at 0x7f3c742494c0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-733294689", "description": "tempest-description-216378325"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:41:24.056108 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-ac7b9f64-10d5-4a69-9d40-5d07200a01ea tempest-TenantUsagesTestJSON-375897061 tempest-TenantUsagesTestJSON-375897061-project] Flavor limits 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:41:24.058058 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-ac7b9f64-10d5-4a69-9d40-5d07200a01ea tempest-TenantUsagesTestJSON-375897061 tempest-TenantUsagesTestJSON-375897061-project] Image limits 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:41:24.058901 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-ac7b9f64-10d5-4a69-9d40-5d07200a01ea tempest-TenantUsagesTestJSON-375897061 tempest-TenantUsagesTestJSON-375897061-project] Flavor pref 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:41:24.059486 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-ac7b9f64-10d5-4a69-9d40-5d07200a01ea tempest-TenantUsagesTestJSON-375897061 tempest-TenantUsagesTestJSON-375897061-project] Image pref 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:41:24.060060 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-ac7b9f64-10d5-4a69-9d40-5d07200a01ea tempest-TenantUsagesTestJSON-375897061 tempest-TenantUsagesTestJSON-375897061-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:41:24.086816 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ac7b9f64-10d5-4a69-9d40-5d07200a01ea tempest-TenantUsagesTestJSON-375897061 tempest-TenantUsagesTestJSON-375897061-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:24.092999 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ac7b9f64-10d5-4a69-9d40-5d07200a01ea tempest-TenantUsagesTestJSON-375897061 tempest-TenantUsagesTestJSON-375897061-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:24.095419 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ac7b9f64-10d5-4a69-9d40-5d07200a01ea tempest-TenantUsagesTestJSON-375897061 tempest-TenantUsagesTestJSON-375897061-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:24.099623 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ac7b9f64-10d5-4a69-9d40-5d07200a01ea tempest-TenantUsagesTestJSON-375897061 tempest-TenantUsagesTestJSON-375897061-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:24.103531 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ac7b9f64-10d5-4a69-9d40-5d07200a01ea tempest-TenantUsagesTestJSON-375897061 tempest-TenantUsagesTestJSON-375897061-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:24.104422 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ac7b9f64-10d5-4a69-9d40-5d07200a01ea tempest-TenantUsagesTestJSON-375897061 tempest-TenantUsagesTestJSON-375897061-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:24.146052 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-ac7b9f64-10d5-4a69-9d40-5d07200a01ea tempest-TenantUsagesTestJSON-375897061 tempest-TenantUsagesTestJSON-375897061-project] Getting quotas for project dcdc664107bb480ebe6c30acbe313d51. Resources: {'ram', 'instances', 'cores'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:41:24.151506 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-ac7b9f64-10d5-4a69-9d40-5d07200a01ea tempest-TenantUsagesTestJSON-375897061 tempest-TenantUsagesTestJSON-375897061-project] Getting quotas for user 42f2e2261dea48638016ed569f884a10 and project dcdc664107bb480ebe6c30acbe313d51. Resources: {'ram', 'instances', 'cores'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:41:24.168554 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-ac7b9f64-10d5-4a69-9d40-5d07200a01ea tempest-TenantUsagesTestJSON-375897061 tempest-TenantUsagesTestJSON-375897061-project] Going to run 1 instances... {{(pid=128802) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:41:24.171819 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-ac7b9f64-10d5-4a69-9d40-5d07200a01ea tempest-TenantUsagesTestJSON-375897061 tempest-TenantUsagesTestJSON-375897061-project] [instance: 5099c29c-026b-4f84-ad3f-228d2ac22b08] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='15b24725-0c99-4bcf-b1fb-907cdf8e2d63',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128802) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:41:24.276146 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-ac7b9f64-10d5-4a69-9d40-5d07200a01ea tempest-TenantUsagesTestJSON-375897061 tempest-TenantUsagesTestJSON-375897061-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.894890 Oct 04 20:41:24.277714 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1018/1969] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 20:41:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 1897 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 20:41:24.284190 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-c2b9ebb5-28ea-4b65-a941-8fd91fa1aa3d tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:41:24.285083 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-c2b9ebb5-28ea-4b65-a941-8fd91fa1aa3d tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] [instance: 83df4756-40e2-4fc6-be48-48a82dd4572a] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:41:24.295329 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c2b9ebb5-28ea-4b65-a941-8fd91fa1aa3d tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:24.296301 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c2b9ebb5-28ea-4b65-a941-8fd91fa1aa3d tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:24.298668 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c2b9ebb5-28ea-4b65-a941-8fd91fa1aa3d tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:24.299868 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c2b9ebb5-28ea-4b65-a941-8fd91fa1aa3d tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:24.300570 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c2b9ebb5-28ea-4b65-a941-8fd91fa1aa3d tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:24.301180 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c2b9ebb5-28ea-4b65-a941-8fd91fa1aa3d tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:24.949493 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-c2b9ebb5-28ea-4b65-a941-8fd91fa1aa3d tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '800db3a57ada47eca381b00189fdbf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66ec8ea91b04deb90b679589e0495bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:41:24.960314 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-c2b9ebb5-28ea-4b65-a941-8fd91fa1aa3d tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] 10.222.0.33 "GET /compute/v2.1/servers/83df4756-40e2-4fc6-be48-48a82dd4572a" status: 200 len: 1718 microversion: 2.1 time: 0.681283 Oct 04 20:41:24.963309 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1019/1970] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:41:24 2022] GET /compute/v2.1/servers/83df4756-40e2-4fc6-be48-48a82dd4572a => generated 1718 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:41:24.990987 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-839c94f6-55a0-4838-9af7-1a13d1bff90f tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:41:24.993752 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-839c94f6-55a0-4838-9af7-1a13d1bff90f tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] [instance: 6ff56299-ada5-4e73-9e68-59cdd48f8a16] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:41:25.015181 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-839c94f6-55a0-4838-9af7-1a13d1bff90f tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:25.019065 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-839c94f6-55a0-4838-9af7-1a13d1bff90f tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:25.019572 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-839c94f6-55a0-4838-9af7-1a13d1bff90f tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:25.022536 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-839c94f6-55a0-4838-9af7-1a13d1bff90f tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:25.024389 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-839c94f6-55a0-4838-9af7-1a13d1bff90f tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:25.026249 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-839c94f6-55a0-4838-9af7-1a13d1bff90f tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:25.102824 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ab265db3-3dc0-4d3d-b9a8-4c06ebaca5a5 tempest-SecurityGroupRulesTestJSON-387118441 tempest-SecurityGroupRulesTestJSON-387118441-project] 10.222.0.33 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 1.191161 Oct 04 20:41:25.104430 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 952/1971] 10.222.0.33 () {60 vars in 1180 bytes} [Tue Oct 4 20:41:23 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 1193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:41:25.120588 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-01139890-1751-4e77-8615-a904a2c50de7 req-3744d2f7-c238-430d-bd04-b84d02d824f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ff56299-ada5-4e73-9e68-59cdd48f8a16", "name": "network-vif-deleted", "tag": "8639aac2-0a5a-4a66-92f5-712c9424eedf"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:41:25.163151 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-839c94f6-55a0-4838-9af7-1a13d1bff90f tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:25.165613 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-839c94f6-55a0-4838-9af7-1a13d1bff90f tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:25.166631 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-839c94f6-55a0-4838-9af7-1a13d1bff90f tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:25.167108 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.objects.instance [None req-839c94f6-55a0-4838-9af7-1a13d1bff90f tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] Lazy-loading 'fault' on Instance uuid 6ff56299-ada5-4e73-9e68-59cdd48f8a16 {{(pid=128802) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:41:25.182029 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-01139890-1751-4e77-8615-a904a2c50de7 req-3744d2f7-c238-430d-bd04-b84d02d824f2 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:25.182558 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-01139890-1751-4e77-8615-a904a2c50de7 req-3744d2f7-c238-430d-bd04-b84d02d824f2 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:25.182994 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-01139890-1751-4e77-8615-a904a2c50de7 req-3744d2f7-c238-430d-bd04-b84d02d824f2 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:25.247609 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-01139890-1751-4e77-8615-a904a2c50de7 req-3744d2f7-c238-430d-bd04-b84d02d824f2 service nova] Creating event network-vif-deleted:8639aac2-0a5a-4a66-92f5-712c9424eedf for instance 6ff56299-ada5-4e73-9e68-59cdd48f8a16 on n-h1-854823-8 Oct 04 20:41:25.279191 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-01139890-1751-4e77-8615-a904a2c50de7 req-3744d2f7-c238-430d-bd04-b84d02d824f2 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.158588 Oct 04 20:41:25.286187 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 953/1972] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:41:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:41:25.348977 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a9fda923-4415-4355-9e22-32378b8f6be1 tempest-FloatingIPDetailsTestJSON-1552955020 tempest-FloatingIPDetailsTestJSON-1552955020-project] Action: 'create', calling method: .version_select at 0x7f3c741f13a0>, body: {"pool": null} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:41:25.648032 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-839c94f6-55a0-4838-9af7-1a13d1bff90f tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673886dab3ed4cbd8a314386fbfbe39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f67490cfb798433eb86c006008c9aaa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:41:25.670202 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-839c94f6-55a0-4838-9af7-1a13d1bff90f tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] 10.222.0.33 "GET /compute/v2.1/servers/6ff56299-ada5-4e73-9e68-59cdd48f8a16" status: 200 len: 1316 microversion: 2.1 time: 0.701681 Oct 04 20:41:25.690945 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1020/1973] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:41:24 2022] GET /compute/v2.1/servers/6ff56299-ada5-4e73-9e68-59cdd48f8a16 => generated 1316 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:41:25.708492 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-3af218b1-d0bd-4864-8b97-32c9f99202c8 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:41:25.710297 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-3af218b1-d0bd-4864-8b97-32c9f99202c8 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] [instance: a2fc592c-9dac-4f72-8633-229925d3bf76] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:41:25.726983 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3af218b1-d0bd-4864-8b97-32c9f99202c8 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:25.729726 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3af218b1-d0bd-4864-8b97-32c9f99202c8 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:25.730277 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3af218b1-d0bd-4864-8b97-32c9f99202c8 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:25.731122 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3af218b1-d0bd-4864-8b97-32c9f99202c8 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:25.731864 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3af218b1-d0bd-4864-8b97-32c9f99202c8 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:25.732512 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3af218b1-d0bd-4864-8b97-32c9f99202c8 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:25.780836 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-3af218b1-d0bd-4864-8b97-32c9f99202c8 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] [instance: a2fc592c-9dac-4f72-8633-229925d3bf76] Going to try to terminate instance {{(pid=128802) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:41:26.014387 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-3af218b1-d0bd-4864-8b97-32c9f99202c8 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] 10.222.0.33 "DELETE /compute/v2.1/servers/a2fc592c-9dac-4f72-8633-229925d3bf76" status: 204 len: 0 microversion: 2.1 time: 0.319579 Oct 04 20:41:26.018259 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1021/1974] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 20:41:25 2022] DELETE /compute/v2.1/servers/a2fc592c-9dac-4f72-8633-229925d3bf76 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:41:26.030316 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-d4010edb-6e9e-4312-a3ab-17175de30c9a tempest-TenantUsagesTestJSON-375897061 tempest-TenantUsagesTestJSON-375897061-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:41:26.036014 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-d4010edb-6e9e-4312-a3ab-17175de30c9a tempest-TenantUsagesTestJSON-375897061 tempest-TenantUsagesTestJSON-375897061-project] [instance: 5099c29c-026b-4f84-ad3f-228d2ac22b08] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:41:26.051198 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d4010edb-6e9e-4312-a3ab-17175de30c9a tempest-TenantUsagesTestJSON-375897061 tempest-TenantUsagesTestJSON-375897061-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:26.053253 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d4010edb-6e9e-4312-a3ab-17175de30c9a tempest-TenantUsagesTestJSON-375897061 tempest-TenantUsagesTestJSON-375897061-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:26.054270 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d4010edb-6e9e-4312-a3ab-17175de30c9a tempest-TenantUsagesTestJSON-375897061 tempest-TenantUsagesTestJSON-375897061-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:26.057254 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d4010edb-6e9e-4312-a3ab-17175de30c9a tempest-TenantUsagesTestJSON-375897061 tempest-TenantUsagesTestJSON-375897061-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:26.057834 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d4010edb-6e9e-4312-a3ab-17175de30c9a tempest-TenantUsagesTestJSON-375897061 tempest-TenantUsagesTestJSON-375897061-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:26.058366 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d4010edb-6e9e-4312-a3ab-17175de30c9a tempest-TenantUsagesTestJSON-375897061 tempest-TenantUsagesTestJSON-375897061-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:26.298268 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-d4010edb-6e9e-4312-a3ab-17175de30c9a tempest-TenantUsagesTestJSON-375897061 tempest-TenantUsagesTestJSON-375897061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f2e2261dea48638016ed569f884a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcdc664107bb480ebe6c30acbe313d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:41:26.347401 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-d4010edb-6e9e-4312-a3ab-17175de30c9a tempest-TenantUsagesTestJSON-375897061 tempest-TenantUsagesTestJSON-375897061-project] 10.222.0.33 "GET /compute/v2.1/servers/5099c29c-026b-4f84-ad3f-228d2ac22b08" status: 200 len: 1266 microversion: 2.1 time: 0.324520 Oct 04 20:41:26.348209 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1022/1975] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:41:26 2022] GET /compute/v2.1/servers/5099c29c-026b-4f84-ad3f-228d2ac22b08 => generated 1266 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:41:26.366603 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-b42cd2fa-5cdc-4a11-9087-0f02f3801e46 tempest-SecurityGroupRulesTestJSON-387118441 tempest-SecurityGroupRulesTestJSON-387118441-project] Action: 'create', calling method: .version_select at 0x7f3c789059d0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1140472073", "description": "tempest-description-155660504"}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:41:27.632655 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-b42cd2fa-5cdc-4a11-9087-0f02f3801e46 tempest-SecurityGroupRulesTestJSON-387118441 tempest-SecurityGroupRulesTestJSON-387118441-project] 10.222.0.33 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 1.283499 Oct 04 20:41:27.634252 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1023/1976] 10.222.0.33 () {60 vars in 1180 bytes} [Tue Oct 4 20:41:26 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 1286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:41:27.640399 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-8538c09b-dec2-4a78-9858-25503263d5a0 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:41:27.641954 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-8538c09b-dec2-4a78-9858-25503263d5a0 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] [instance: 83df4756-40e2-4fc6-be48-48a82dd4572a] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:41:27.660934 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8538c09b-dec2-4a78-9858-25503263d5a0 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:27.661737 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8538c09b-dec2-4a78-9858-25503263d5a0 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:27.662437 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8538c09b-dec2-4a78-9858-25503263d5a0 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:27.663313 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8538c09b-dec2-4a78-9858-25503263d5a0 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:27.663952 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8538c09b-dec2-4a78-9858-25503263d5a0 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:27.664573 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8538c09b-dec2-4a78-9858-25503263d5a0 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:28.108611 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-8538c09b-dec2-4a78-9858-25503263d5a0 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '800db3a57ada47eca381b00189fdbf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66ec8ea91b04deb90b679589e0495bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:41:28.123634 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-8538c09b-dec2-4a78-9858-25503263d5a0 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] 10.222.0.33 "GET /compute/v2.1/servers/83df4756-40e2-4fc6-be48-48a82dd4572a" status: 200 len: 1718 microversion: 2.1 time: 0.487839 Oct 04 20:41:28.140099 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1024/1977] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:41:27 2022] GET /compute/v2.1/servers/83df4756-40e2-4fc6-be48-48a82dd4572a => generated 1718 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:41:28.148903 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-c67cacfd-842d-4996-a6ea-54ba9776b358 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:41:28.163399 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-c67cacfd-842d-4996-a6ea-54ba9776b358 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] [instance: a2fc592c-9dac-4f72-8633-229925d3bf76] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:41:28.183517 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c67cacfd-842d-4996-a6ea-54ba9776b358 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:28.184446 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c67cacfd-842d-4996-a6ea-54ba9776b358 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:28.185080 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c67cacfd-842d-4996-a6ea-54ba9776b358 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:28.190296 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c67cacfd-842d-4996-a6ea-54ba9776b358 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:28.193734 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c67cacfd-842d-4996-a6ea-54ba9776b358 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:28.195315 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c67cacfd-842d-4996-a6ea-54ba9776b358 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:29.594724 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-c67cacfd-842d-4996-a6ea-54ba9776b358 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96919ec99c14864876d64a9c2b20f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b44ce10b78bf49c882c9b4df06187114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:41:29.607106 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-c67cacfd-842d-4996-a6ea-54ba9776b358 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] 10.222.0.33 "GET /compute/v2.1/servers/a2fc592c-9dac-4f72-8633-229925d3bf76" status: 200 len: 1490 microversion: 2.1 time: 1.465255 Oct 04 20:41:29.611418 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1025/1978] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:41:28 2022] GET /compute/v2.1/servers/a2fc592c-9dac-4f72-8633-229925d3bf76 => generated 1490 bytes in 1471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:41:29.616443 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-c864b81d-9fb6-47b7-9b21-6b75fda4fc07 tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:41:29.627387 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-c864b81d-9fb6-47b7-9b21-6b75fda4fc07 tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] [instance: 6ff56299-ada5-4e73-9e68-59cdd48f8a16] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:41:29.644831 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c864b81d-9fb6-47b7-9b21-6b75fda4fc07 tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:29.645323 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c864b81d-9fb6-47b7-9b21-6b75fda4fc07 tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:29.645763 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c864b81d-9fb6-47b7-9b21-6b75fda4fc07 tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:29.646515 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c864b81d-9fb6-47b7-9b21-6b75fda4fc07 tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:29.646976 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c864b81d-9fb6-47b7-9b21-6b75fda4fc07 tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:29.659182 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c864b81d-9fb6-47b7-9b21-6b75fda4fc07 tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:29.724342 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.wsgi [None req-c864b81d-9fb6-47b7-9b21-6b75fda4fc07 tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] HTTP exception thrown: Instance 6ff56299-ada5-4e73-9e68-59cdd48f8a16 could not be found. Oct 04 20:41:29.726268 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-c864b81d-9fb6-47b7-9b21-6b75fda4fc07 tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] Request method failure captured: Oct 04 20:41:29.726268 n-d-854823-8 devstack@n-api.service[128802]: request: GET /compute/v2.1/servers/6ff56299-ada5-4e73-9e68-59cdd48f8a16 HTTP/1.1 Oct 04 20:41:29.726268 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 20:41:29.726268 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 20:41:29.726268 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 20:41:29.726268 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 0 Oct 04 20:41:29.726268 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 20:41:29.726268 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 20:41:29.726268 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 20:41:29.726268 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 20:41:29.726268 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPJobV902J9jqhyQ8697GeUgxEwtaCXbLMard6wUq6pS8xEj7DpNYcbf5HaXoLbINvZzZ9MSM1xW52WKq7QstnKa1aUm5HPwqKAxEFQDS9Q4ar1Guka4dY3MhLLpDhSb9NN8nZylemgAqydLoEuW-LMbei6J6pa4ujBsY05FKIg5nclk Oct 04 20:41:29.726268 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 20:41:29.726268 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 20:41:29.726268 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 20:41:29.726268 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 20:41:29.726268 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 20:41:29.726268 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 20:41:29.726268 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: f67490cfb798433eb86c006008c9aaa6 Oct 04 20:41:29.726268 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-ServersTestFqdnHostnames-10776872 Oct 04 20:41:29.726268 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 20:41:29.726268 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 20:41:29.726268 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f67490cfb798433eb86c006008c9aaa6", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f67490cfb798433eb86c006008c9aaa6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f67490cfb798433eb86c006008c9aaa6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f67490cfb798433eb86c006008c9aaa6"}]}] Oct 04 20:41:29.726268 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-ServersTestFqdnHostnames-10776872 Oct 04 20:41:29.726268 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: f67490cfb798433eb86c006008c9aaa6 Oct 04 20:41:29.726268 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-ServersTestFqdnHostnames-10776872 Oct 04 20:41:29.726268 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-ServersTestFqdnHostnames-10776872-project Oct 04 20:41:29.726268 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 20:41:29.726268 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 20:41:29.726268 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: 673886dab3ed4cbd8a314386fbfbe39e Oct 04 20:41:29.726268 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-ServersTestFqdnHostnames-10776872-project Oct 04 20:41:29.726268 n-d-854823-8 devstack@n-api.service[128802]: method: > Oct 04 20:41:29.726268 n-d-854823-8 devstack@n-api.service[128802]: exception: Instance 6ff56299-ada5-4e73-9e68-59cdd48f8a16 could not be found. Oct 04 20:41:29.726268 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'id': '6ff56299-ada5-4e73-9e68-59cdd48f8a16'} Oct 04 20:41:29.726268 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:41:29.726268 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:41:29.726268 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:41:29.726268 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:41:29.726268 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:41:29.726268 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:41:29.726268 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:41:29.726268 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:41:29.726268 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:41:29.726268 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:41:29.726268 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ff56299-ada5-4e73-9e68-59cdd48f8a16 could not be found. Oct 04 20:41:29.726268 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:41:29.726268 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:41:29.726268 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:41:29.726268 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:41:29.726268 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:41:29.726268 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:41:29.726268 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:41:29.726268 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:41:29.726268 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:41:29.726268 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:41:29.726268 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:41:29.726268 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:41:29.726268 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:41:29.726268 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:41:29.726268 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:41:29.726268 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:41:29.726268 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ff56299-ada5-4e73-9e68-59cdd48f8a16 could not be found. Oct 04 20:41:29.726268 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:41:29.726268 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:41:29.726268 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:41:29.732131 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:41:29.732131 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:41:29.732131 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:41:29.732131 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:41:29.732131 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:41:29.732131 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ff56299-ada5-4e73-9e68-59cdd48f8a16 could not be found. Oct 04 20:41:29.732131 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:41:29.733488 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-c864b81d-9fb6-47b7-9b21-6b75fda4fc07 tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] Returning 404 to user: Instance 6ff56299-ada5-4e73-9e68-59cdd48f8a16 could not be found. {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:41:29.735106 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-c864b81d-9fb6-47b7-9b21-6b75fda4fc07 tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] 10.222.0.33 "GET /compute/v2.1/servers/6ff56299-ada5-4e73-9e68-59cdd48f8a16" status: 404 len: 111 microversion: 2.1 time: 0.121822 Oct 04 20:41:29.736890 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1026/1979] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:41:29 2022] GET /compute/v2.1/servers/6ff56299-ada5-4e73-9e68-59cdd48f8a16 => generated 111 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:41:29.749463 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-b8f4330e-736d-4757-bb01-f1a1c9afadf6 tempest-TenantUsagesTestJSON-375897061 tempest-TenantUsagesTestJSON-375897061-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:41:29.750323 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-b8f4330e-736d-4757-bb01-f1a1c9afadf6 tempest-TenantUsagesTestJSON-375897061 tempest-TenantUsagesTestJSON-375897061-project] [instance: 5099c29c-026b-4f84-ad3f-228d2ac22b08] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:41:29.769031 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b8f4330e-736d-4757-bb01-f1a1c9afadf6 tempest-TenantUsagesTestJSON-375897061 tempest-TenantUsagesTestJSON-375897061-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:29.769839 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b8f4330e-736d-4757-bb01-f1a1c9afadf6 tempest-TenantUsagesTestJSON-375897061 tempest-TenantUsagesTestJSON-375897061-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:29.770500 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b8f4330e-736d-4757-bb01-f1a1c9afadf6 tempest-TenantUsagesTestJSON-375897061 tempest-TenantUsagesTestJSON-375897061-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:29.771389 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b8f4330e-736d-4757-bb01-f1a1c9afadf6 tempest-TenantUsagesTestJSON-375897061 tempest-TenantUsagesTestJSON-375897061-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:29.772033 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b8f4330e-736d-4757-bb01-f1a1c9afadf6 tempest-TenantUsagesTestJSON-375897061 tempest-TenantUsagesTestJSON-375897061-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:29.772625 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b8f4330e-736d-4757-bb01-f1a1c9afadf6 tempest-TenantUsagesTestJSON-375897061 tempest-TenantUsagesTestJSON-375897061-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:30.135251 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-b8f4330e-736d-4757-bb01-f1a1c9afadf6 tempest-TenantUsagesTestJSON-375897061 tempest-TenantUsagesTestJSON-375897061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f2e2261dea48638016ed569f884a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcdc664107bb480ebe6c30acbe313d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:41:30.149750 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-b8f4330e-736d-4757-bb01-f1a1c9afadf6 tempest-TenantUsagesTestJSON-375897061 tempest-TenantUsagesTestJSON-375897061-project] 10.222.0.33 "GET /compute/v2.1/servers/5099c29c-026b-4f84-ad3f-228d2ac22b08" status: 200 len: 1272 microversion: 2.1 time: 0.411565 Oct 04 20:41:30.152411 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1027/1980] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:41:29 2022] GET /compute/v2.1/servers/5099c29c-026b-4f84-ad3f-228d2ac22b08 => generated 1272 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:41:30.160583 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-da6cf64e-6de0-4188-8a85-4b01455073ab tempest-SecurityGroupRulesTestJSON-387118441 tempest-SecurityGroupRulesTestJSON-387118441-project] Action: 'create', calling method: .version_select at 0x7f3c789baca0>, body: {"security_group_rule": {"parent_group_id": "14975e2d-9164-406b-88c8-dd7575db57fa", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "6e941de3-b026-4aa0-ac04-3eb537278913"}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:41:31.587652 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-da6cf64e-6de0-4188-8a85-4b01455073ab tempest-SecurityGroupRulesTestJSON-387118441 tempest-SecurityGroupRulesTestJSON-387118441-project] 10.222.0.33 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 1.432322 Oct 04 20:41:31.588821 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1028/1981] 10.222.0.33 () {60 vars in 1195 bytes} [Tue Oct 4 20:41:30 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 1435 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:41:31.596070 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-e011beb8-a871-4ac0-a769-6091f6aa8bbc tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:41:31.597816 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-e011beb8-a871-4ac0-a769-6091f6aa8bbc tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] [instance: 83df4756-40e2-4fc6-be48-48a82dd4572a] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:41:31.608907 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e011beb8-a871-4ac0-a769-6091f6aa8bbc tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:31.609222 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e011beb8-a871-4ac0-a769-6091f6aa8bbc tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:31.610219 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e011beb8-a871-4ac0-a769-6091f6aa8bbc tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:31.611350 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e011beb8-a871-4ac0-a769-6091f6aa8bbc tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:31.612312 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e011beb8-a871-4ac0-a769-6091f6aa8bbc tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:31.612750 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e011beb8-a871-4ac0-a769-6091f6aa8bbc tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:31.626743 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a9fda923-4415-4355-9e22-32378b8f6be1 tempest-FloatingIPDetailsTestJSON-1552955020 tempest-FloatingIPDetailsTestJSON-1552955020-project] 10.222.0.33 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 6.337729 Oct 04 20:41:31.640796 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 954/1982] 10.222.0.33 () {60 vars in 1170 bytes} [Tue Oct 4 20:41:25 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 6354 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:41:31.646079 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-4a301cab-7c81-4ec7-8c4f-a2db0a562e60 tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] Calling method '.version_select at 0x7f3c7425b8b0>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:41:31.699071 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-4a301cab-7c81-4ec7-8c4f-a2db0a562e60 tempest-ServersTestFqdnHostnames-10776872 tempest-ServersTestFqdnHostnames-10776872-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1671583020" status: 202 len: 0 microversion: 2.1 time: 0.056693 Oct 04 20:41:31.700236 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 955/1983] 10.222.0.33 () {58 vars in 1221 bytes} [Tue Oct 4 20:41:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1671583020 => generated 0 bytes in 59 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:41:31.705284 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-59ecd809-5850-4790-aac2-61e59b244512 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-199170118", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "accbf9df-df79-4b74-a013-58a41c8806a7"}], "block_device_mapping_v2": [{"uuid": "d5c62d89-2d74-4d92-a361-3c4478176a5d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:41:31.804710 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.network.neutron [None req-59ecd809-5850-4790-aac2-61e59b244512 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] validate_networks() for [('accbf9df-df79-4b74-a013-58a41c8806a7', None, None, None, None, None)] {{(pid=128801) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:41:31.971081 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-e011beb8-a871-4ac0-a769-6091f6aa8bbc tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '800db3a57ada47eca381b00189fdbf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66ec8ea91b04deb90b679589e0495bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:41:31.993155 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-e011beb8-a871-4ac0-a769-6091f6aa8bbc tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] 10.222.0.33 "GET /compute/v2.1/servers/83df4756-40e2-4fc6-be48-48a82dd4572a" status: 200 len: 1718 microversion: 2.1 time: 0.402763 Oct 04 20:41:31.994840 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1029/1984] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:41:31 2022] GET /compute/v2.1/servers/83df4756-40e2-4fc6-be48-48a82dd4572a => generated 1718 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:41:32.030098 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-b726125b-e21c-460a-b7ed-05b17420ba98 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:41:32.032712 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-b726125b-e21c-460a-b7ed-05b17420ba98 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] [instance: a2fc592c-9dac-4f72-8633-229925d3bf76] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:41:32.053925 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b726125b-e21c-460a-b7ed-05b17420ba98 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:32.054460 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b726125b-e21c-460a-b7ed-05b17420ba98 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:32.054901 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b726125b-e21c-460a-b7ed-05b17420ba98 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:32.055772 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b726125b-e21c-460a-b7ed-05b17420ba98 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:32.056053 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b726125b-e21c-460a-b7ed-05b17420ba98 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:32.056502 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b726125b-e21c-460a-b7ed-05b17420ba98 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:32.068157 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:41:32.162455 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b726125b-e21c-460a-b7ed-05b17420ba98 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:32.163298 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b726125b-e21c-460a-b7ed-05b17420ba98 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:32.163925 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b726125b-e21c-460a-b7ed-05b17420ba98 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:32.164622 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.objects.instance [None req-b726125b-e21c-460a-b7ed-05b17420ba98 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lazy-loading 'fault' on Instance uuid a2fc592c-9dac-4f72-8633-229925d3bf76 {{(pid=128802) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:41:32.367992 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-b726125b-e21c-460a-b7ed-05b17420ba98 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96919ec99c14864876d64a9c2b20f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b44ce10b78bf49c882c9b4df06187114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:41:32.381817 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-b726125b-e21c-460a-b7ed-05b17420ba98 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] 10.222.0.33 "GET /compute/v2.1/servers/a2fc592c-9dac-4f72-8633-229925d3bf76" status: 200 len: 1303 microversion: 2.1 time: 0.383792 Oct 04 20:41:32.382441 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1030/1985] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:41:31 2022] GET /compute/v2.1/servers/a2fc592c-9dac-4f72-8633-229925d3bf76 => generated 1303 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:41:32.399896 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-a021db16-425b-454b-9a1e-12999dc21b82 tempest-TenantUsagesTestJSON-375897061 tempest-TenantUsagesTestJSON-375897061-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:41:32.400546 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-a021db16-425b-454b-9a1e-12999dc21b82 tempest-TenantUsagesTestJSON-375897061 tempest-TenantUsagesTestJSON-375897061-project] [instance: 5099c29c-026b-4f84-ad3f-228d2ac22b08] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:41:32.413608 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a021db16-425b-454b-9a1e-12999dc21b82 tempest-TenantUsagesTestJSON-375897061 tempest-TenantUsagesTestJSON-375897061-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:32.415484 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a021db16-425b-454b-9a1e-12999dc21b82 tempest-TenantUsagesTestJSON-375897061 tempest-TenantUsagesTestJSON-375897061-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:32.416151 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a021db16-425b-454b-9a1e-12999dc21b82 tempest-TenantUsagesTestJSON-375897061 tempest-TenantUsagesTestJSON-375897061-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:32.417651 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a021db16-425b-454b-9a1e-12999dc21b82 tempest-TenantUsagesTestJSON-375897061 tempest-TenantUsagesTestJSON-375897061-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:32.418008 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a021db16-425b-454b-9a1e-12999dc21b82 tempest-TenantUsagesTestJSON-375897061 tempest-TenantUsagesTestJSON-375897061-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:32.418469 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a021db16-425b-454b-9a1e-12999dc21b82 tempest-TenantUsagesTestJSON-375897061 tempest-TenantUsagesTestJSON-375897061-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:33.103159 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-59ecd809-5850-4790-aac2-61e59b244512 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Flavor limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:41:33.105430 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-59ecd809-5850-4790-aac2-61e59b244512 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Image limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:41:33.106782 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-59ecd809-5850-4790-aac2-61e59b244512 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Flavor pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:41:33.107458 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-59ecd809-5850-4790-aac2-61e59b244512 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Image pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:41:33.108652 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-59ecd809-5850-4790-aac2-61e59b244512 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:41:33.121292 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-59ecd809-5850-4790-aac2-61e59b244512 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:33.122180 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-59ecd809-5850-4790-aac2-61e59b244512 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:33.122938 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-59ecd809-5850-4790-aac2-61e59b244512 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:33.126156 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-59ecd809-5850-4790-aac2-61e59b244512 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:33.128306 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-59ecd809-5850-4790-aac2-61e59b244512 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:33.132636 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-59ecd809-5850-4790-aac2-61e59b244512 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:33.178746 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-59ecd809-5850-4790-aac2-61e59b244512 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Getting quotas for project 4310eadf656d4ba88ade5714c9661488. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:41:33.184697 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-59ecd809-5850-4790-aac2-61e59b244512 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Getting quotas for user beaac70ab9344f6c9677d6500b8b0df6 and project 4310eadf656d4ba88ade5714c9661488. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:41:33.280807 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-a021db16-425b-454b-9a1e-12999dc21b82 tempest-TenantUsagesTestJSON-375897061 tempest-TenantUsagesTestJSON-375897061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f2e2261dea48638016ed569f884a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcdc664107bb480ebe6c30acbe313d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:41:33.294085 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-a021db16-425b-454b-9a1e-12999dc21b82 tempest-TenantUsagesTestJSON-375897061 tempest-TenantUsagesTestJSON-375897061-project] 10.222.0.33 "GET /compute/v2.1/servers/5099c29c-026b-4f84-ad3f-228d2ac22b08" status: 200 len: 1314 microversion: 2.1 time: 0.910065 Oct 04 20:41:33.307328 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-59ecd809-5850-4790-aac2-61e59b244512 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Going to run 1 instances... {{(pid=128801) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:41:33.307328 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-59ecd809-5850-4790-aac2-61e59b244512 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] [instance: 8f1e4990-6f32-426c-bdea-ce2007c37a6f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d5c62d89-2d74-4d92-a361-3c4478176a5d',volume_size=None,volume_type=None)] {{(pid=128801) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:41:33.308524 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1031/1986] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:41:32 2022] GET /compute/v2.1/servers/5099c29c-026b-4f84-ad3f-228d2ac22b08 => generated 1314 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:41:33.325079 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-a54d57d0-f0e9-46fa-b2d5-1e2c1c8e2de8 req-64fea7dd-5167-4ad4-89b5-1a54dba0604a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2fc592c-9dac-4f72-8633-229925d3bf76", "name": "network-vif-deleted", "tag": "1a24093e-a143-47cb-9d69-c8078dca39c0"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:41:33.345765 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-a54d57d0-f0e9-46fa-b2d5-1e2c1c8e2de8 req-64fea7dd-5167-4ad4-89b5-1a54dba0604a service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:33.346691 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-a54d57d0-f0e9-46fa-b2d5-1e2c1c8e2de8 req-64fea7dd-5167-4ad4-89b5-1a54dba0604a service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:33.347358 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-a54d57d0-f0e9-46fa-b2d5-1e2c1c8e2de8 req-64fea7dd-5167-4ad4-89b5-1a54dba0604a service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:33.361135 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-a54d57d0-f0e9-46fa-b2d5-1e2c1c8e2de8 req-64fea7dd-5167-4ad4-89b5-1a54dba0604a service nova] Creating event network-vif-deleted:1a24093e-a143-47cb-9d69-c8078dca39c0 for instance a2fc592c-9dac-4f72-8633-229925d3bf76 on n-h1-854823-8 Oct 04 20:41:33.367395 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-a54d57d0-f0e9-46fa-b2d5-1e2c1c8e2de8 req-64fea7dd-5167-4ad4-89b5-1a54dba0604a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049371 Oct 04 20:41:33.368842 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1032/1987] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:41:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:41:33.378695 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-76e2de51-0d38-42fc-9b6d-c36a9132f10f tempest-SecurityGroupRulesTestJSON-387118441 tempest-SecurityGroupRulesTestJSON-387118441-project] Action: 'create', calling method: .version_select at 0x7f3c7428b5e0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1424833997", "description": "tempest-description-32722186"}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:41:33.547242 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-59ecd809-5850-4790-aac2-61e59b244512 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.845086 Oct 04 20:41:33.550920 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 956/1988] 10.222.0.33 () {62 vars in 1188 bytes} [Tue Oct 4 20:41:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 1850 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 04 20:41:33.584625 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-352f6406-1ff3-4fa0-ad7b-47bd212116ba tempest-FloatingIPDetailsTestJSON-1552955020 tempest-FloatingIPDetailsTestJSON-1552955020-project] Calling method '.version_select at 0x7f3c787f0f70>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:41:34.095548 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-352f6406-1ff3-4fa0-ad7b-47bd212116ba tempest-FloatingIPDetailsTestJSON-1552955020 tempest-FloatingIPDetailsTestJSON-1552955020-project] 10.222.0.33 "GET /compute/v2.1/os-floating-ips/3307fe9e-e6a6-4726-b82f-eadea2a95776" status: 200 len: 141 microversion: 2.1 time: 0.536669 Oct 04 20:41:34.099412 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 957/1989] 10.222.0.33 () {58 vars in 1260 bytes} [Tue Oct 4 20:41:33 2022] GET /compute/v2.1/os-floating-ips/3307fe9e-e6a6-4726-b82f-eadea2a95776 => generated 141 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:41:34.107157 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-4f2b30ce-b9d1-4d38-92c5-11c9c4b1c3cb req-f5c5f035-bed5-4112-93b8-4fc413148f8e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5099c29c-026b-4f84-ad3f-228d2ac22b08", "tag": "74b97ebd-8030-4c1c-b3f4-b506f180587b"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:41:34.137002 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell0:SELECT=2 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:41:34.145556 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-76e2de51-0d38-42fc-9b6d-c36a9132f10f tempest-SecurityGroupRulesTestJSON-387118441 tempest-SecurityGroupRulesTestJSON-387118441-project] 10.222.0.33 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.773490 Oct 04 20:41:34.146658 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1033/1990] 10.222.0.33 () {60 vars in 1180 bytes} [Tue Oct 4 20:41:33 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:41:34.155963 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-b1ee11f7-fc00-406b-b164-caaea75c6bd3 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:41:34.160009 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-b1ee11f7-fc00-406b-b164-caaea75c6bd3 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] [instance: 83df4756-40e2-4fc6-be48-48a82dd4572a] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:41:34.173360 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell0:SELECT=6 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:41:34.180723 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b1ee11f7-fc00-406b-b164-caaea75c6bd3 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:34.181634 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b1ee11f7-fc00-406b-b164-caaea75c6bd3 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:34.182494 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-4f2b30ce-b9d1-4d38-92c5-11c9c4b1c3cb req-f5c5f035-bed5-4112-93b8-4fc413148f8e service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:34.182967 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-4f2b30ce-b9d1-4d38-92c5-11c9c4b1c3cb req-f5c5f035-bed5-4112-93b8-4fc413148f8e service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:34.184601 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b1ee11f7-fc00-406b-b164-caaea75c6bd3 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:34.187691 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b1ee11f7-fc00-406b-b164-caaea75c6bd3 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:34.188504 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b1ee11f7-fc00-406b-b164-caaea75c6bd3 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:34.189150 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b1ee11f7-fc00-406b-b164-caaea75c6bd3 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:34.192180 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-4f2b30ce-b9d1-4d38-92c5-11c9c4b1c3cb req-f5c5f035-bed5-4112-93b8-4fc413148f8e service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:34.235305 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-4f2b30ce-b9d1-4d38-92c5-11c9c4b1c3cb req-f5c5f035-bed5-4112-93b8-4fc413148f8e service nova] Creating event network-changed:74b97ebd-8030-4c1c-b3f4-b506f180587b for instance 5099c29c-026b-4f84-ad3f-228d2ac22b08 on n-h2-854823-8 Oct 04 20:41:34.252065 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-4f2b30ce-b9d1-4d38-92c5-11c9c4b1c3cb req-f5c5f035-bed5-4112-93b8-4fc413148f8e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.151043 Oct 04 20:41:34.252697 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 958/1991] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:41:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:41:34.263687 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f4e83e46-c9e3-4b74-b994-a2a83260c801 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:41:34.264642 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f4e83e46-c9e3-4b74-b994-a2a83260c801 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] [instance: a2fc592c-9dac-4f72-8633-229925d3bf76] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:41:34.273586 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f4e83e46-c9e3-4b74-b994-a2a83260c801 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:34.274844 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f4e83e46-c9e3-4b74-b994-a2a83260c801 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:34.275607 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f4e83e46-c9e3-4b74-b994-a2a83260c801 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:34.276539 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f4e83e46-c9e3-4b74-b994-a2a83260c801 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:34.277160 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f4e83e46-c9e3-4b74-b994-a2a83260c801 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:34.277776 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f4e83e46-c9e3-4b74-b994-a2a83260c801 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:34.296556 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-f4e83e46-c9e3-4b74-b994-a2a83260c801 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] HTTP exception thrown: Instance a2fc592c-9dac-4f72-8633-229925d3bf76 could not be found. Oct 04 20:41:34.299661 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f4e83e46-c9e3-4b74-b994-a2a83260c801 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Request method failure captured: Oct 04 20:41:34.299661 n-d-854823-8 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/a2fc592c-9dac-4f72-8633-229925d3bf76 HTTP/1.1 Oct 04 20:41:34.299661 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:41:34.299661 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:41:34.299661 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:41:34.299661 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 0 Oct 04 20:41:34.299661 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:41:34.299661 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:41:34.299661 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:41:34.299661 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:41:34.299661 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJnuHTm4OYw0xc9SL3N7Jzd4vy7pjPjk-VzjNdzf9JkYRu7LjBJ7ezIZC_ibUEtpkaWihYnSgV8rl93QQWAzC-tCvGIXd4yDfqWytNCQeXdV59nwIqYCHXBJEUAznNRUlPXsuV0816cMEF0ZynrvmsBJieU6o28fx5oUnNIbTFdaQcA Oct 04 20:41:34.299661 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:41:34.299661 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:41:34.299661 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:41:34.299661 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:41:34.299661 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:41:34.299661 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:41:34.299661 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: b44ce10b78bf49c882c9b4df06187114 Oct 04 20:41:34.299661 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-ServerRescueTestJSON-630527753 Oct 04 20:41:34.299661 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 20:41:34.299661 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 20:41:34.299661 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b44ce10b78bf49c882c9b4df06187114", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b44ce10b78bf49c882c9b4df06187114"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b44ce10b78bf49c882c9b4df06187114"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b44ce10b78bf49c882c9b4df06187114"}]}] Oct 04 20:41:34.299661 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-ServerRescueTestJSON-630527753 Oct 04 20:41:34.299661 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: b44ce10b78bf49c882c9b4df06187114 Oct 04 20:41:34.299661 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ServerRescueTestJSON-630527753 Oct 04 20:41:34.299661 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-ServerRescueTestJSON-630527753-project Oct 04 20:41:34.299661 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:41:34.299661 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:41:34.299661 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: f96919ec99c14864876d64a9c2b20f8f Oct 04 20:41:34.299661 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-ServerRescueTestJSON-630527753-project Oct 04 20:41:34.299661 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 20:41:34.299661 n-d-854823-8 devstack@n-api.service[128801]: exception: Instance a2fc592c-9dac-4f72-8633-229925d3bf76 could not be found. Oct 04 20:41:34.299661 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': 'a2fc592c-9dac-4f72-8633-229925d3bf76'} Oct 04 20:41:34.299661 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:41:34.299661 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:41:34.299661 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:41:34.299661 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:41:34.299661 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:41:34.299661 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:41:34.299661 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:41:34.299661 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:41:34.299661 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:41:34.299661 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:41:34.299661 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a2fc592c-9dac-4f72-8633-229925d3bf76 could not be found. Oct 04 20:41:34.299661 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:41:34.299661 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:41:34.299661 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:41:34.299661 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:41:34.299661 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:41:34.299661 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:41:34.299661 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:41:34.299661 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:41:34.299661 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:41:34.299661 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:41:34.299661 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:41:34.299661 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:41:34.299661 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:41:34.299661 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:41:34.299661 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:41:34.299661 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:41:34.299661 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a2fc592c-9dac-4f72-8633-229925d3bf76 could not be found. Oct 04 20:41:34.299661 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:41:34.299661 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:41:34.299661 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:41:34.305824 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:41:34.305824 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:41:34.305824 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:41:34.305824 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:41:34.305824 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:41:34.305824 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a2fc592c-9dac-4f72-8633-229925d3bf76 could not be found. Oct 04 20:41:34.305824 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:41:34.305824 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f4e83e46-c9e3-4b74-b994-a2a83260c801 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] Returning 404 to user: Instance a2fc592c-9dac-4f72-8633-229925d3bf76 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:41:34.307096 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f4e83e46-c9e3-4b74-b994-a2a83260c801 tempest-ServerRescueTestJSON-630527753 tempest-ServerRescueTestJSON-630527753-project] 10.222.0.33 "GET /compute/v2.1/servers/a2fc592c-9dac-4f72-8633-229925d3bf76" status: 404 len: 111 microversion: 2.1 time: 0.050514 Oct 04 20:41:34.308861 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 959/1992] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:41:34 2022] GET /compute/v2.1/servers/a2fc592c-9dac-4f72-8633-229925d3bf76 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:41:34.332211 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-956bf210-b14f-4351-86be-b0c8de97011e tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:41:34.333160 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-956bf210-b14f-4351-86be-b0c8de97011e tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] [instance: 8f1e4990-6f32-426c-bdea-ce2007c37a6f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:41:34.493886 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-956bf210-b14f-4351-86be-b0c8de97011e tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:41:34.508530 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-956bf210-b14f-4351-86be-b0c8de97011e tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:41:34.509953 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-956bf210-b14f-4351-86be-b0c8de97011e tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:41:34.516473 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-b1ee11f7-fc00-406b-b164-caaea75c6bd3 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '800db3a57ada47eca381b00189fdbf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66ec8ea91b04deb90b679589e0495bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:41:34.531851 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-b1ee11f7-fc00-406b-b164-caaea75c6bd3 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] 10.222.0.33 "GET /compute/v2.1/servers/83df4756-40e2-4fc6-be48-48a82dd4572a" status: 200 len: 1708 microversion: 2.1 time: 0.383785 Oct 04 20:41:34.549554 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1034/1993] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:41:34 2022] GET /compute/v2.1/servers/83df4756-40e2-4fc6-be48-48a82dd4572a => generated 1708 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:41:34.549773 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-956bf210-b14f-4351-86be-b0c8de97011e tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] 10.222.0.33 "GET /compute/v2.1/servers/8f1e4990-6f32-426c-bdea-ce2007c37a6f" status: 200 len: 1103 microversion: 2.25 time: 0.224782 Oct 04 20:41:34.549773 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 960/1994] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:41:34 2022] GET /compute/v2.1/servers/8f1e4990-6f32-426c-bdea-ce2007c37a6f => generated 1103 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:41:34.551635 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c9e2f759-cd52-481c-b7e4-36dbb3a0b862 tempest-SecurityGroupRulesTestJSON-387118441 tempest-SecurityGroupRulesTestJSON-387118441-project] Action: 'create', calling method: .version_select at 0x7f3c74223550>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-2085776833", "description": "tempest-description-1363043497"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:41:34.555843 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-d469e932-39ee-4510-b6ec-66d44a706c90 tempest-FloatingIPDetailsTestJSON-1552955020 tempest-FloatingIPDetailsTestJSON-1552955020-project] Calling method '.version_select at 0x7f3c7428b940>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:41:35.186438 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c9e2f759-cd52-481c-b7e4-36dbb3a0b862 tempest-SecurityGroupRulesTestJSON-387118441 tempest-SecurityGroupRulesTestJSON-387118441-project] 10.222.0.33 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.649006 Oct 04 20:41:35.188927 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 961/1995] 10.222.0.33 () {60 vars in 1180 bytes} [Tue Oct 4 20:41:34 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:41:35.200921 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8010854e-dac8-4050-95a7-831c6f95dce0 tempest-TenantUsagesTestJSON-375897061 tempest-TenantUsagesTestJSON-375897061-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:41:35.201552 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-8010854e-dac8-4050-95a7-831c6f95dce0 tempest-TenantUsagesTestJSON-375897061 tempest-TenantUsagesTestJSON-375897061-project] [instance: 5099c29c-026b-4f84-ad3f-228d2ac22b08] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:41:35.205502 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=3,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:41:35.228968 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8010854e-dac8-4050-95a7-831c6f95dce0 tempest-TenantUsagesTestJSON-375897061 tempest-TenantUsagesTestJSON-375897061-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:35.229509 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8010854e-dac8-4050-95a7-831c6f95dce0 tempest-TenantUsagesTestJSON-375897061 tempest-TenantUsagesTestJSON-375897061-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:35.231211 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8010854e-dac8-4050-95a7-831c6f95dce0 tempest-TenantUsagesTestJSON-375897061 tempest-TenantUsagesTestJSON-375897061-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:35.231992 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8010854e-dac8-4050-95a7-831c6f95dce0 tempest-TenantUsagesTestJSON-375897061 tempest-TenantUsagesTestJSON-375897061-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:35.232464 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8010854e-dac8-4050-95a7-831c6f95dce0 tempest-TenantUsagesTestJSON-375897061 tempest-TenantUsagesTestJSON-375897061-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:35.233688 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8010854e-dac8-4050-95a7-831c6f95dce0 tempest-TenantUsagesTestJSON-375897061 tempest-TenantUsagesTestJSON-375897061-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:35.738877 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-8010854e-dac8-4050-95a7-831c6f95dce0 tempest-TenantUsagesTestJSON-375897061 tempest-TenantUsagesTestJSON-375897061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f2e2261dea48638016ed569f884a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcdc664107bb480ebe6c30acbe313d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:41:35.755369 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-8010854e-dac8-4050-95a7-831c6f95dce0 tempest-TenantUsagesTestJSON-375897061 tempest-TenantUsagesTestJSON-375897061-project] 10.222.0.33 "GET /compute/v2.1/servers/5099c29c-026b-4f84-ad3f-228d2ac22b08" status: 200 len: 1314 microversion: 2.1 time: 0.564299 Oct 04 20:41:35.756238 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 962/1996] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:41:35 2022] GET /compute/v2.1/servers/5099c29c-026b-4f84-ad3f-228d2ac22b08 => generated 1314 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:41:35.770209 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7ed9c54a-5999-429b-974d-2a04537d9ebf tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] Calling method '.version_select at 0x7f3c74223d30>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:41:35.774207 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7ed9c54a-5999-429b-974d-2a04537d9ebf tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:35.774901 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7ed9c54a-5999-429b-974d-2a04537d9ebf tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:35.775568 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7ed9c54a-5999-429b-974d-2a04537d9ebf tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:35.790517 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-7ed9c54a-5999-429b-974d-2a04537d9ebf tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] 10.222.0.33 "GET /compute/v2.1/os-migrations" status: 200 len: 2321 microversion: 2.1 time: 0.032945 Oct 04 20:41:35.803198 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 963/1997] 10.222.0.33 () {58 vars in 1143 bytes} [Tue Oct 4 20:41:35 2022] GET /compute/v2.1/os-migrations => generated 2321 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:41:35.808586 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2decac1f-4471-4a40-9cde-b141b1700b73 tempest-SecurityGroupRulesTestJSON-387118441 tempest-SecurityGroupRulesTestJSON-387118441-project] Action: 'create', calling method: .version_select at 0x7f3c78828160>, body: {"security_group_rule": {"parent_group_id": "4b8222e7-1d66-4548-8d6e-ea1bc718f445", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "afafff8b-57b1-46e7-bd7e-0dde24e02c81"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:41:37.712265 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-2decac1f-4471-4a40-9cde-b141b1700b73 tempest-SecurityGroupRulesTestJSON-387118441 tempest-SecurityGroupRulesTestJSON-387118441-project] 10.222.0.33 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 1.907548 Oct 04 20:41:37.720594 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 964/1998] 10.222.0.33 () {60 vars in 1195 bytes} [Tue Oct 4 20:41:35 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 1916 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:41:37.726303 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-32d4cfdd-fb28-4ace-8b88-271c1f8212d7 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:41:37.731439 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-32d4cfdd-fb28-4ace-8b88-271c1f8212d7 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] [instance: 8f1e4990-6f32-426c-bdea-ce2007c37a6f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:41:37.745303 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-32d4cfdd-fb28-4ace-8b88-271c1f8212d7 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:37.746072 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-32d4cfdd-fb28-4ace-8b88-271c1f8212d7 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:37.747038 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-32d4cfdd-fb28-4ace-8b88-271c1f8212d7 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:37.750424 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-32d4cfdd-fb28-4ace-8b88-271c1f8212d7 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:37.751403 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-32d4cfdd-fb28-4ace-8b88-271c1f8212d7 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:37.755318 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-32d4cfdd-fb28-4ace-8b88-271c1f8212d7 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:38.081969 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-32d4cfdd-fb28-4ace-8b88-271c1f8212d7 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:41:38.098093 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-32d4cfdd-fb28-4ace-8b88-271c1f8212d7 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:41:38.105355 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-32d4cfdd-fb28-4ace-8b88-271c1f8212d7 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:41:38.115691 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-32d4cfdd-fb28-4ace-8b88-271c1f8212d7 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] 10.222.0.33 "GET /compute/v2.1/servers/8f1e4990-6f32-426c-bdea-ce2007c37a6f" status: 200 len: 1250 microversion: 2.25 time: 0.392093 Oct 04 20:41:38.118619 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 965/1999] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:41:37 2022] GET /compute/v2.1/servers/8f1e4990-6f32-426c-bdea-ce2007c37a6f => generated 1250 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:41:38.139524 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-156a254c-9825-4d84-964b-3e9ff91ab5c4 tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:41:38.140351 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-156a254c-9825-4d84-964b-3e9ff91ab5c4 tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] [instance: 83df4756-40e2-4fc6-be48-48a82dd4572a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:41:38.162407 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-156a254c-9825-4d84-964b-3e9ff91ab5c4 tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:38.165183 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-156a254c-9825-4d84-964b-3e9ff91ab5c4 tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:38.165745 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-156a254c-9825-4d84-964b-3e9ff91ab5c4 tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:38.168745 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-156a254c-9825-4d84-964b-3e9ff91ab5c4 tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:38.169333 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-156a254c-9825-4d84-964b-3e9ff91ab5c4 tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:38.178456 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-156a254c-9825-4d84-964b-3e9ff91ab5c4 tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:38.741164 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-d469e932-39ee-4510-b6ec-66d44a706c90 tempest-FloatingIPDetailsTestJSON-1552955020 tempest-FloatingIPDetailsTestJSON-1552955020-project] 10.222.0.33 "DELETE /compute/v2.1/os-floating-ips/3307fe9e-e6a6-4726-b82f-eadea2a95776" status: 202 len: 0 microversion: 2.1 time: 4.207182 Oct 04 20:41:38.746275 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1035/2000] 10.222.0.33 () {58 vars in 1263 bytes} [Tue Oct 4 20:41:34 2022] DELETE /compute/v2.1/os-floating-ips/3307fe9e-e6a6-4726-b82f-eadea2a95776 => generated 0 bytes in 4213 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:41:38.752481 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-c7cbf94c-3079-443d-b027-c6198866bc38 tempest-TenantUsagesTestJSON-375897061 tempest-TenantUsagesTestJSON-375897061-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:41:38.754831 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-c7cbf94c-3079-443d-b027-c6198866bc38 tempest-TenantUsagesTestJSON-375897061 tempest-TenantUsagesTestJSON-375897061-project] [instance: 5099c29c-026b-4f84-ad3f-228d2ac22b08] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:41:38.764795 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c7cbf94c-3079-443d-b027-c6198866bc38 tempest-TenantUsagesTestJSON-375897061 tempest-TenantUsagesTestJSON-375897061-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:38.767478 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-156a254c-9825-4d84-964b-3e9ff91ab5c4 tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/83df4756-40e2-4fc6-be48-48a82dd4572a" status: 200 len: 1859 microversion: 2.1 time: 0.644673 Oct 04 20:41:38.768078 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 966/2001] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:41:38 2022] GET /compute/v2.1/servers/83df4756-40e2-4fc6-be48-48a82dd4572a => generated 1859 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:41:38.768580 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c7cbf94c-3079-443d-b027-c6198866bc38 tempest-TenantUsagesTestJSON-375897061 tempest-TenantUsagesTestJSON-375897061-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:38.769305 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c7cbf94c-3079-443d-b027-c6198866bc38 tempest-TenantUsagesTestJSON-375897061 tempest-TenantUsagesTestJSON-375897061-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:38.770231 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c7cbf94c-3079-443d-b027-c6198866bc38 tempest-TenantUsagesTestJSON-375897061 tempest-TenantUsagesTestJSON-375897061-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:38.770879 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c7cbf94c-3079-443d-b027-c6198866bc38 tempest-TenantUsagesTestJSON-375897061 tempest-TenantUsagesTestJSON-375897061-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:38.771497 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c7cbf94c-3079-443d-b027-c6198866bc38 tempest-TenantUsagesTestJSON-375897061 tempest-TenantUsagesTestJSON-375897061-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:38.791102 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-3bec64b6-99a2-48d9-a276-e0ae906f2f16 tempest-SecurityGroupRulesTestJSON-387118441 tempest-SecurityGroupRulesTestJSON-387118441-project] Calling method '.version_select at 0x7f3c74218f70>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:41:39.354646 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-c7cbf94c-3079-443d-b027-c6198866bc38 tempest-TenantUsagesTestJSON-375897061 tempest-TenantUsagesTestJSON-375897061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f2e2261dea48638016ed569f884a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcdc664107bb480ebe6c30acbe313d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:41:39.371195 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-c7cbf94c-3079-443d-b027-c6198866bc38 tempest-TenantUsagesTestJSON-375897061 tempest-TenantUsagesTestJSON-375897061-project] 10.222.0.33 "GET /compute/v2.1/servers/5099c29c-026b-4f84-ad3f-228d2ac22b08" status: 200 len: 1314 microversion: 2.1 time: 0.620258 Oct 04 20:41:39.388105 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1036/2002] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:41:38 2022] GET /compute/v2.1/servers/5099c29c-026b-4f84-ad3f-228d2ac22b08 => generated 1314 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:41:39.401284 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-f2655d5a-249e-401a-9acd-db3a75cd4d84 tempest-FloatingIPDetailsTestJSON-1552955020 tempest-FloatingIPDetailsTestJSON-1552955020-project] Calling method '.version_select at 0x7f3c7890c1f0>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:41:39.713992 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-f2655d5a-249e-401a-9acd-db3a75cd4d84 tempest-FloatingIPDetailsTestJSON-1552955020 tempest-FloatingIPDetailsTestJSON-1552955020-project] 10.222.0.33 "GET /compute/v2.1/os-floating-ip-pools" status: 200 len: 43 microversion: 2.1 time: 0.324493 Oct 04 20:41:39.715189 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1037/2003] 10.222.0.33 () {58 vars in 1164 bytes} [Tue Oct 4 20:41:39 2022] GET /compute/v2.1/os-floating-ip-pools => generated 43 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 20:41:39.729415 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-0948082b-a8e2-4f9b-82f9-bd1b1c16da59 tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:41:39.730599 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-0948082b-a8e2-4f9b-82f9-bd1b1c16da59 tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] [instance: 83df4756-40e2-4fc6-be48-48a82dd4572a] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:41:39.738991 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-3bec64b6-99a2-48d9-a276-e0ae906f2f16 tempest-SecurityGroupRulesTestJSON-387118441 tempest-SecurityGroupRulesTestJSON-387118441-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/afafff8b-57b1-46e7-bd7e-0dde24e02c81" status: 202 len: 0 microversion: 2.1 time: 0.966589 Oct 04 20:41:39.740417 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 967/2004] 10.222.0.33 () {58 vars in 1272 bytes} [Tue Oct 4 20:41:38 2022] DELETE /compute/v2.1/os-security-groups/afafff8b-57b1-46e7-bd7e-0dde24e02c81 => generated 0 bytes in 969 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:41:39.745099 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0948082b-a8e2-4f9b-82f9-bd1b1c16da59 tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:39.748514 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0948082b-a8e2-4f9b-82f9-bd1b1c16da59 tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:39.749161 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0948082b-a8e2-4f9b-82f9-bd1b1c16da59 tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:39.749741 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-08cba4dd-807c-4421-8132-27bd9161b48c req-308871ab-a932-400e-9941-04ba9f3e53ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5099c29c-026b-4f84-ad3f-228d2ac22b08", "name": "network-vif-plugged", "status": "completed", "tag": "74b97ebd-8030-4c1c-b3f4-b506f180587b"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:41:39.751101 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0948082b-a8e2-4f9b-82f9-bd1b1c16da59 tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:39.751733 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0948082b-a8e2-4f9b-82f9-bd1b1c16da59 tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:39.752556 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0948082b-a8e2-4f9b-82f9-bd1b1c16da59 tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:39.816795 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-08cba4dd-807c-4421-8132-27bd9161b48c req-308871ab-a932-400e-9941-04ba9f3e53ce service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:39.818462 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-08cba4dd-807c-4421-8132-27bd9161b48c req-308871ab-a932-400e-9941-04ba9f3e53ce service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:39.824662 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-08cba4dd-807c-4421-8132-27bd9161b48c req-308871ab-a932-400e-9941-04ba9f3e53ce service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:39.849148 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-08cba4dd-807c-4421-8132-27bd9161b48c req-308871ab-a932-400e-9941-04ba9f3e53ce service nova] Creating event network-vif-plugged:74b97ebd-8030-4c1c-b3f4-b506f180587b for instance 5099c29c-026b-4f84-ad3f-228d2ac22b08 on n-h2-854823-8 Oct 04 20:41:39.854782 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-08cba4dd-807c-4421-8132-27bd9161b48c req-308871ab-a932-400e-9941-04ba9f3e53ce service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112863 Oct 04 20:41:39.855956 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 968/2005] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:41:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:41:39.865179 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-3a44f4f3-da30-426f-9f9c-f0c3168491ab tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:41:39.866439 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-3a44f4f3-da30-426f-9f9c-f0c3168491ab tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] [instance: 8f1e4990-6f32-426c-bdea-ce2007c37a6f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:41:39.874680 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3a44f4f3-da30-426f-9f9c-f0c3168491ab tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:39.876163 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3a44f4f3-da30-426f-9f9c-f0c3168491ab tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:39.876790 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3a44f4f3-da30-426f-9f9c-f0c3168491ab tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:39.877691 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3a44f4f3-da30-426f-9f9c-f0c3168491ab tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:39.878324 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3a44f4f3-da30-426f-9f9c-f0c3168491ab tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:39.879029 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3a44f4f3-da30-426f-9f9c-f0c3168491ab tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:40.271403 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-0948082b-a8e2-4f9b-82f9-bd1b1c16da59 tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/83df4756-40e2-4fc6-be48-48a82dd4572a" status: 200 len: 1859 microversion: 2.1 time: 0.547863 Oct 04 20:41:40.272594 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1038/2006] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:41:39 2022] GET /compute/v2.1/servers/83df4756-40e2-4fc6-be48-48a82dd4572a => generated 1859 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:41:40.277047 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-daa2d78e-82a9-4188-9403-17545c379bc3 tempest-FloatingIPDetailsTestJSON-1552955020 tempest-FloatingIPDetailsTestJSON-1552955020-project] Calling method '.version_select at 0x7f3c7890fee0>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:41:40.316561 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-3a44f4f3-da30-426f-9f9c-f0c3168491ab tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:41:40.340652 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-3a44f4f3-da30-426f-9f9c-f0c3168491ab tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:41:40.348770 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-3a44f4f3-da30-426f-9f9c-f0c3168491ab tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:41:40.350634 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-3a44f4f3-da30-426f-9f9c-f0c3168491ab tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] 10.222.0.33 "GET /compute/v2.1/servers/8f1e4990-6f32-426c-bdea-ce2007c37a6f" status: 200 len: 1292 microversion: 2.25 time: 0.493214 Oct 04 20:41:40.354886 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 969/2007] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:41:39 2022] GET /compute/v2.1/servers/8f1e4990-6f32-426c-bdea-ce2007c37a6f => generated 1292 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:41:40.367687 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c56568cd-7d55-422f-bab4-edc461f420e2 tempest-SecurityGroupRulesTestJSON-387118441 tempest-SecurityGroupRulesTestJSON-387118441-project] Calling method '.version_select at 0x7f3c741b0e50>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:41:40.564910 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c56568cd-7d55-422f-bab4-edc461f420e2 tempest-SecurityGroupRulesTestJSON-387118441 tempest-SecurityGroupRulesTestJSON-387118441-project] 10.222.0.33 "GET /compute/v2.1/os-security-groups/4b8222e7-1d66-4548-8d6e-ea1bc718f445" status: 200 len: 246 microversion: 2.1 time: 0.208521 Oct 04 20:41:40.566023 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 970/2008] 10.222.0.33 () {58 vars in 1269 bytes} [Tue Oct 4 20:41:40 2022] GET /compute/v2.1/os-security-groups/4b8222e7-1d66-4548-8d6e-ea1bc718f445 => generated 246 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:41:40.571051 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-89f3d231-e48b-4f5f-9b8a-76e3d2dd13cf tempest-TenantUsagesTestJSON-375897061 tempest-TenantUsagesTestJSON-375897061-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:41:40.571918 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-89f3d231-e48b-4f5f-9b8a-76e3d2dd13cf tempest-TenantUsagesTestJSON-375897061 tempest-TenantUsagesTestJSON-375897061-project] [instance: 5099c29c-026b-4f84-ad3f-228d2ac22b08] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:41:40.589240 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-89f3d231-e48b-4f5f-9b8a-76e3d2dd13cf tempest-TenantUsagesTestJSON-375897061 tempest-TenantUsagesTestJSON-375897061-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:40.590763 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-89f3d231-e48b-4f5f-9b8a-76e3d2dd13cf tempest-TenantUsagesTestJSON-375897061 tempest-TenantUsagesTestJSON-375897061-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:40.591573 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-89f3d231-e48b-4f5f-9b8a-76e3d2dd13cf tempest-TenantUsagesTestJSON-375897061 tempest-TenantUsagesTestJSON-375897061-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:40.592533 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-89f3d231-e48b-4f5f-9b8a-76e3d2dd13cf tempest-TenantUsagesTestJSON-375897061 tempest-TenantUsagesTestJSON-375897061-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:40.594958 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-89f3d231-e48b-4f5f-9b8a-76e3d2dd13cf tempest-TenantUsagesTestJSON-375897061 tempest-TenantUsagesTestJSON-375897061-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:40.595735 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-89f3d231-e48b-4f5f-9b8a-76e3d2dd13cf tempest-TenantUsagesTestJSON-375897061 tempest-TenantUsagesTestJSON-375897061-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:40.833433 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-daa2d78e-82a9-4188-9403-17545c379bc3 tempest-FloatingIPDetailsTestJSON-1552955020 tempest-FloatingIPDetailsTestJSON-1552955020-project] 10.222.0.33 "GET /compute/v2.1/os-floating-ips" status: 200 len: 398 microversion: 2.1 time: 0.559770 Oct 04 20:41:40.844667 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1039/2009] 10.222.0.33 () {58 vars in 1149 bytes} [Tue Oct 4 20:41:40 2022] GET /compute/v2.1/os-floating-ips => generated 398 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:41:40.849951 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-4bb87a0c-166b-42a2-89ea-b16d54104b86 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:41:40.850480 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-4bb87a0c-166b-42a2-89ea-b16d54104b86 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] [instance: 83df4756-40e2-4fc6-be48-48a82dd4572a] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:41:40.865012 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4bb87a0c-166b-42a2-89ea-b16d54104b86 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:40.865516 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4bb87a0c-166b-42a2-89ea-b16d54104b86 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:40.865956 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4bb87a0c-166b-42a2-89ea-b16d54104b86 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:40.868981 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4bb87a0c-166b-42a2-89ea-b16d54104b86 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:40.869487 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4bb87a0c-166b-42a2-89ea-b16d54104b86 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:40.869927 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4bb87a0c-166b-42a2-89ea-b16d54104b86 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:41.022583 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-89f3d231-e48b-4f5f-9b8a-76e3d2dd13cf tempest-TenantUsagesTestJSON-375897061 tempest-TenantUsagesTestJSON-375897061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f2e2261dea48638016ed569f884a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcdc664107bb480ebe6c30acbe313d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:41:41.035874 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-89f3d231-e48b-4f5f-9b8a-76e3d2dd13cf tempest-TenantUsagesTestJSON-375897061 tempest-TenantUsagesTestJSON-375897061-project] 10.222.0.33 "GET /compute/v2.1/servers/5099c29c-026b-4f84-ad3f-228d2ac22b08" status: 200 len: 1314 microversion: 2.1 time: 0.468544 Oct 04 20:41:41.038660 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 971/2010] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:41:40 2022] GET /compute/v2.1/servers/5099c29c-026b-4f84-ad3f-228d2ac22b08 => generated 1314 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:41:41.046232 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d9865ce1-a9b4-4a24-bd51-caab71f4f3f0 tempest-SecurityGroupRulesTestJSON-387118441 tempest-SecurityGroupRulesTestJSON-387118441-project] Action: 'create', calling method: .version_select at 0x7f3c742081f0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-828637077", "description": "tempest-description-1535308985"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:41:41.081098 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.objects.instance [None req-4bb87a0c-166b-42a2-89ea-b16d54104b86 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lazy-loading 'services' on Instance uuid 83df4756-40e2-4fc6-be48-48a82dd4572a {{(pid=128802) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:41:41.245880 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-4bb87a0c-166b-42a2-89ea-b16d54104b86 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] 10.222.0.33 "DELETE /compute/v2.1/servers/83df4756-40e2-4fc6-be48-48a82dd4572a/os-volume_attachments/89f632ad-5ac8-4440-95d0-1bc8bf718d82" status: 202 len: 0 microversion: 2.1 time: 0.399594 Oct 04 20:41:41.246508 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1040/2011] 10.222.0.33 () {58 vars in 1416 bytes} [Tue Oct 4 20:41:40 2022] DELETE /compute/v2.1/servers/83df4756-40e2-4fc6-be48-48a82dd4572a/os-volume_attachments/89f632ad-5ac8-4440-95d0-1bc8bf718d82 => generated 0 bytes in 401 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:41:41.251851 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-86b370d0-088e-4099-8d40-4beec9b9740c tempest-FloatingIPDetailsTestJSON-1552955020 tempest-FloatingIPDetailsTestJSON-1552955020-project] Calling method '.version_select at 0x7f3c789de670>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:41:41.925989 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d9865ce1-a9b4-4a24-bd51-caab71f4f3f0 tempest-SecurityGroupRulesTestJSON-387118441 tempest-SecurityGroupRulesTestJSON-387118441-project] 10.222.0.33 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.886035 Oct 04 20:41:41.928190 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 972/2012] 10.222.0.33 () {60 vars in 1180 bytes} [Tue Oct 4 20:41:41 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:41:41.939419 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b5f30666-8977-4ec6-9e30-a6bca5cbc4be tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:41:41.957326 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b5f30666-8977-4ec6-9e30-a6bca5cbc4be tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] [instance: 83df4756-40e2-4fc6-be48-48a82dd4572a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:41:41.997827 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b5f30666-8977-4ec6-9e30-a6bca5cbc4be tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:42.000467 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b5f30666-8977-4ec6-9e30-a6bca5cbc4be tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:42.001169 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b5f30666-8977-4ec6-9e30-a6bca5cbc4be tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:42.002104 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b5f30666-8977-4ec6-9e30-a6bca5cbc4be tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:42.003808 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b5f30666-8977-4ec6-9e30-a6bca5cbc4be tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:42.006331 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b5f30666-8977-4ec6-9e30-a6bca5cbc4be tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:42.075941 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b5f30666-8977-4ec6-9e30-a6bca5cbc4be tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] 10.222.0.33 "GET /compute/v2.1/servers/83df4756-40e2-4fc6-be48-48a82dd4572a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.145257 Oct 04 20:41:42.076623 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 973/2013] 10.222.0.33 () {58 vars in 1302 bytes} [Tue Oct 4 20:41:41 2022] GET /compute/v2.1/servers/83df4756-40e2-4fc6-be48-48a82dd4572a/os-volume_attachments => generated 197 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:41:42.125670 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-bc218be0-ec0e-4931-b85f-85b19b3c1c0d tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:41:42.128217 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-bc218be0-ec0e-4931-b85f-85b19b3c1c0d tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] [instance: 8f1e4990-6f32-426c-bdea-ce2007c37a6f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:41:42.171229 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bc218be0-ec0e-4931-b85f-85b19b3c1c0d tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:42.178596 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bc218be0-ec0e-4931-b85f-85b19b3c1c0d tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:42.181634 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bc218be0-ec0e-4931-b85f-85b19b3c1c0d tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:42.186647 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bc218be0-ec0e-4931-b85f-85b19b3c1c0d tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:42.192604 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bc218be0-ec0e-4931-b85f-85b19b3c1c0d tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:42.197836 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bc218be0-ec0e-4931-b85f-85b19b3c1c0d tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:42.879702 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-bc218be0-ec0e-4931-b85f-85b19b3c1c0d tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:41:42.893716 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-bc218be0-ec0e-4931-b85f-85b19b3c1c0d tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:41:42.895806 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-bc218be0-ec0e-4931-b85f-85b19b3c1c0d tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:41:42.899024 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-bc218be0-ec0e-4931-b85f-85b19b3c1c0d tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] 10.222.0.33 "GET /compute/v2.1/servers/8f1e4990-6f32-426c-bdea-ce2007c37a6f" status: 200 len: 1292 microversion: 2.25 time: 0.818875 Oct 04 20:41:42.899883 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 974/2014] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:41:42 2022] GET /compute/v2.1/servers/8f1e4990-6f32-426c-bdea-ce2007c37a6f => generated 1292 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:41:42.904738 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e7ef4019-e747-4658-ace5-13828ac1c164 tempest-SecurityGroupRulesTestJSON-387118441 tempest-SecurityGroupRulesTestJSON-387118441-project] Action: 'create', calling method: .version_select at 0x7f3c788281f0>, body: {"security_group_rule": {"parent_group_id": "36b71336-96fe-45d2-a760-a0ba9c556c47", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:41:43.149248 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:41:44.504743 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=8 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:41:44.589956 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-86b370d0-088e-4099-8d40-4beec9b9740c tempest-FloatingIPDetailsTestJSON-1552955020 tempest-FloatingIPDetailsTestJSON-1552955020-project] 10.222.0.33 "DELETE /compute/v2.1/os-floating-ips/64867472-237c-438f-b20a-c6283256b142" status: 202 len: 0 microversion: 2.1 time: 3.340506 Oct 04 20:41:44.599035 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1041/2015] 10.222.0.33 () {58 vars in 1263 bytes} [Tue Oct 4 20:41:41 2022] DELETE /compute/v2.1/os-floating-ips/64867472-237c-438f-b20a-c6283256b142 => generated 0 bytes in 3352 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:41:44.607307 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e7ef4019-e747-4658-ace5-13828ac1c164 tempest-SecurityGroupRulesTestJSON-387118441 tempest-SecurityGroupRulesTestJSON-387118441-project] 10.222.0.33 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 1.705416 Oct 04 20:41:44.608451 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 975/2016] 10.222.0.33 () {60 vars in 1195 bytes} [Tue Oct 4 20:41:42 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 1708 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:41:44.622837 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-bd2a8994-fdcb-460c-810d-36693722b9c3 tempest-TenantUsagesTestJSON-375897061 tempest-TenantUsagesTestJSON-375897061-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:41:44.623518 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-833a8ef1-f690-4d9f-8307-dddbefd5c38e req-dfec6c7a-2f56-4afb-b47c-a1eca6f7b535 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f1e4990-6f32-426c-bdea-ce2007c37a6f", "tag": "ade75c1b-2031-475c-af20-7442fa7b876a"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:41:44.627958 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-bd2a8994-fdcb-460c-810d-36693722b9c3 tempest-TenantUsagesTestJSON-375897061 tempest-TenantUsagesTestJSON-375897061-project] [instance: 5099c29c-026b-4f84-ad3f-228d2ac22b08] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:41:44.647947 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bd2a8994-fdcb-460c-810d-36693722b9c3 tempest-TenantUsagesTestJSON-375897061 tempest-TenantUsagesTestJSON-375897061-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:44.648822 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bd2a8994-fdcb-460c-810d-36693722b9c3 tempest-TenantUsagesTestJSON-375897061 tempest-TenantUsagesTestJSON-375897061-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:44.649482 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bd2a8994-fdcb-460c-810d-36693722b9c3 tempest-TenantUsagesTestJSON-375897061 tempest-TenantUsagesTestJSON-375897061-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:44.651645 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bd2a8994-fdcb-460c-810d-36693722b9c3 tempest-TenantUsagesTestJSON-375897061 tempest-TenantUsagesTestJSON-375897061-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:44.653168 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bd2a8994-fdcb-460c-810d-36693722b9c3 tempest-TenantUsagesTestJSON-375897061 tempest-TenantUsagesTestJSON-375897061-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:44.654607 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bd2a8994-fdcb-460c-810d-36693722b9c3 tempest-TenantUsagesTestJSON-375897061 tempest-TenantUsagesTestJSON-375897061-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:44.655187 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-833a8ef1-f690-4d9f-8307-dddbefd5c38e req-dfec6c7a-2f56-4afb-b47c-a1eca6f7b535 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:44.657102 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-833a8ef1-f690-4d9f-8307-dddbefd5c38e req-dfec6c7a-2f56-4afb-b47c-a1eca6f7b535 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:44.658990 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-833a8ef1-f690-4d9f-8307-dddbefd5c38e req-dfec6c7a-2f56-4afb-b47c-a1eca6f7b535 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:44.686104 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-833a8ef1-f690-4d9f-8307-dddbefd5c38e req-dfec6c7a-2f56-4afb-b47c-a1eca6f7b535 service nova] Creating event network-changed:ade75c1b-2031-475c-af20-7442fa7b876a for instance 8f1e4990-6f32-426c-bdea-ce2007c37a6f on n-h1-854823-8 Oct 04 20:41:44.705231 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-833a8ef1-f690-4d9f-8307-dddbefd5c38e req-dfec6c7a-2f56-4afb-b47c-a1eca6f7b535 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094639 Oct 04 20:41:44.707100 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 976/2017] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:41:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:41:44.725190 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-98112b0d-9390-4c18-ae8e-e8c4623604c9 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:41:44.731370 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-98112b0d-9390-4c18-ae8e-e8c4623604c9 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] [instance: 83df4756-40e2-4fc6-be48-48a82dd4572a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:41:44.747590 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-98112b0d-9390-4c18-ae8e-e8c4623604c9 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:44.752148 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-98112b0d-9390-4c18-ae8e-e8c4623604c9 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:44.752918 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-98112b0d-9390-4c18-ae8e-e8c4623604c9 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:44.756111 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-98112b0d-9390-4c18-ae8e-e8c4623604c9 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:44.757049 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-98112b0d-9390-4c18-ae8e-e8c4623604c9 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:44.758582 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-98112b0d-9390-4c18-ae8e-e8c4623604c9 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:44.818878 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-98112b0d-9390-4c18-ae8e-e8c4623604c9 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] 10.222.0.33 "GET /compute/v2.1/servers/83df4756-40e2-4fc6-be48-48a82dd4572a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.108389 Oct 04 20:41:44.820067 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 977/2018] 10.222.0.33 () {58 vars in 1302 bytes} [Tue Oct 4 20:41:44 2022] GET /compute/v2.1/servers/83df4756-40e2-4fc6-be48-48a82dd4572a/os-volume_attachments => generated 197 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:41:44.827047 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-acab3aea-614f-4d6b-b92e-77492abfc511 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:41:44.828250 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-acab3aea-614f-4d6b-b92e-77492abfc511 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] [instance: 8f1e4990-6f32-426c-bdea-ce2007c37a6f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:41:44.839536 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-acab3aea-614f-4d6b-b92e-77492abfc511 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:44.841045 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-acab3aea-614f-4d6b-b92e-77492abfc511 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:44.841714 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-acab3aea-614f-4d6b-b92e-77492abfc511 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:44.842857 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-acab3aea-614f-4d6b-b92e-77492abfc511 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:44.843607 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-acab3aea-614f-4d6b-b92e-77492abfc511 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:44.844259 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-acab3aea-614f-4d6b-b92e-77492abfc511 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:45.339554 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-bd2a8994-fdcb-460c-810d-36693722b9c3 tempest-TenantUsagesTestJSON-375897061 tempest-TenantUsagesTestJSON-375897061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f2e2261dea48638016ed569f884a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcdc664107bb480ebe6c30acbe313d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:41:45.349643 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-bd2a8994-fdcb-460c-810d-36693722b9c3 tempest-TenantUsagesTestJSON-375897061 tempest-TenantUsagesTestJSON-375897061-project] 10.222.0.33 "GET /compute/v2.1/servers/5099c29c-026b-4f84-ad3f-228d2ac22b08" status: 200 len: 1464 microversion: 2.1 time: 0.748189 Oct 04 20:41:45.353729 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1042/2019] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:41:44 2022] GET /compute/v2.1/servers/5099c29c-026b-4f84-ad3f-228d2ac22b08 => generated 1464 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:41:45.368254 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-7229ad3a-d30b-427b-85c6-911a844397a6 tempest-FloatingIPDetailsTestJSON-1552955020 tempest-FloatingIPDetailsTestJSON-1552955020-project] Calling method '.version_select at 0x7f3c78934c10>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:41:45.396265 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-acab3aea-614f-4d6b-b92e-77492abfc511 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:41:45.407210 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-acab3aea-614f-4d6b-b92e-77492abfc511 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:41:45.411243 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-acab3aea-614f-4d6b-b92e-77492abfc511 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:41:45.413368 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-acab3aea-614f-4d6b-b92e-77492abfc511 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] 10.222.0.33 "GET /compute/v2.1/servers/8f1e4990-6f32-426c-bdea-ce2007c37a6f" status: 200 len: 1292 microversion: 2.25 time: 0.590946 Oct 04 20:41:45.427589 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 978/2020] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:41:44 2022] GET /compute/v2.1/servers/8f1e4990-6f32-426c-bdea-ce2007c37a6f => generated 1292 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:41:45.442125 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7b4c0888-6cfe-425f-9f17-197690f27831 tempest-SecurityGroupRulesTestJSON-387118441 tempest-SecurityGroupRulesTestJSON-387118441-project] Action: 'create', calling method: .version_select at 0x7f3c74223a60>, body: {"security_group_rule": {"parent_group_id": "36b71336-96fe-45d2-a760-a0ba9c556c47", "ip_protocol": "icmp", "from_port": -1, "to_port": -1}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:41:46.443579 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-7b4c0888-6cfe-425f-9f17-197690f27831 tempest-SecurityGroupRulesTestJSON-387118441 tempest-SecurityGroupRulesTestJSON-387118441-project] 10.222.0.33 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 1.014114 Oct 04 20:41:46.451182 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 979/2021] 10.222.0.33 () {60 vars in 1195 bytes} [Tue Oct 4 20:41:45 2022] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:41:46.788491 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-bd01af35-8a9e-40f2-98ba-3c7bee8d5a9b tempest-TenantUsagesTestJSON-195088827 tempest-TenantUsagesTestJSON-195088827-project-admin] Calling method '.version_select at 0x7f3c74208d30>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:41:46.807410 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bd01af35-8a9e-40f2-98ba-3c7bee8d5a9b tempest-TenantUsagesTestJSON-195088827 tempest-TenantUsagesTestJSON-195088827-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:46.807902 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bd01af35-8a9e-40f2-98ba-3c7bee8d5a9b tempest-TenantUsagesTestJSON-195088827 tempest-TenantUsagesTestJSON-195088827-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:46.808337 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bd01af35-8a9e-40f2-98ba-3c7bee8d5a9b tempest-TenantUsagesTestJSON-195088827 tempest-TenantUsagesTestJSON-195088827-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:46.847477 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bd01af35-8a9e-40f2-98ba-3c7bee8d5a9b tempest-TenantUsagesTestJSON-195088827 tempest-TenantUsagesTestJSON-195088827-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:46.850975 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bd01af35-8a9e-40f2-98ba-3c7bee8d5a9b tempest-TenantUsagesTestJSON-195088827 tempest-TenantUsagesTestJSON-195088827-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:46.852338 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bd01af35-8a9e-40f2-98ba-3c7bee8d5a9b tempest-TenantUsagesTestJSON-195088827 tempest-TenantUsagesTestJSON-195088827-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:46.891502 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=73 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:41:46.904613 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-bd01af35-8a9e-40f2-98ba-3c7bee8d5a9b tempest-TenantUsagesTestJSON-195088827 tempest-TenantUsagesTestJSON-195088827-project-admin] 10.222.0.33 "GET /compute/v2.1/os-simple-tenant-usage/dcdc664107bb480ebe6c30acbe313d51?start=2022-10-03T20%3A41%3A45.369745&end=2022-10-05T20%3A41%3A45.369745" status: 200 len: 695 microversion: 2.1 time: 0.456355 Oct 04 20:41:46.908853 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 980/2022] 10.222.0.33 () {58 vars in 1412 bytes} [Tue Oct 4 20:41:46 2022] GET /compute/v2.1/os-simple-tenant-usage/dcdc664107bb480ebe6c30acbe313d51?start=2022-10-03T20%3A41%3A45.369745&end=2022-10-05T20%3A41%3A45.369745 => generated 695 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:41:46.917084 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0870b661-6783-44fb-b114-e38c79836a2c tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:41:46.923292 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-0870b661-6783-44fb-b114-e38c79836a2c tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] [instance: 83df4756-40e2-4fc6-be48-48a82dd4572a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:41:46.944489 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0870b661-6783-44fb-b114-e38c79836a2c tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:46.946075 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0870b661-6783-44fb-b114-e38c79836a2c tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:46.947369 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0870b661-6783-44fb-b114-e38c79836a2c tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:46.948449 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0870b661-6783-44fb-b114-e38c79836a2c tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:46.949263 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0870b661-6783-44fb-b114-e38c79836a2c tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:46.949822 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0870b661-6783-44fb-b114-e38c79836a2c tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:47.041146 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-0870b661-6783-44fb-b114-e38c79836a2c tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] 10.222.0.33 "GET /compute/v2.1/servers/83df4756-40e2-4fc6-be48-48a82dd4572a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.130143 Oct 04 20:41:47.043075 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 981/2023] 10.222.0.33 () {58 vars in 1302 bytes} [Tue Oct 4 20:41:46 2022] GET /compute/v2.1/servers/83df4756-40e2-4fc6-be48-48a82dd4572a/os-volume_attachments => generated 197 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:41:47.053223 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-942914ee-35c9-4bcc-928e-cba4a0239fcb tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:41:47.056291 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-942914ee-35c9-4bcc-928e-cba4a0239fcb tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] [instance: 8f1e4990-6f32-426c-bdea-ce2007c37a6f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:41:47.071461 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-942914ee-35c9-4bcc-928e-cba4a0239fcb tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:47.074271 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-942914ee-35c9-4bcc-928e-cba4a0239fcb tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:47.075029 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-942914ee-35c9-4bcc-928e-cba4a0239fcb tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:47.076921 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-942914ee-35c9-4bcc-928e-cba4a0239fcb tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:47.079447 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-942914ee-35c9-4bcc-928e-cba4a0239fcb tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:47.081184 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-942914ee-35c9-4bcc-928e-cba4a0239fcb tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:47.269750 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-7229ad3a-d30b-427b-85c6-911a844397a6 tempest-FloatingIPDetailsTestJSON-1552955020 tempest-FloatingIPDetailsTestJSON-1552955020-project] 10.222.0.33 "DELETE /compute/v2.1/os-floating-ips/ef3e46ef-5fee-4f4b-90f4-05d21fb860b8" status: 202 len: 0 microversion: 2.1 time: 1.914500 Oct 04 20:41:47.271250 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1043/2024] 10.222.0.33 () {58 vars in 1263 bytes} [Tue Oct 4 20:41:45 2022] DELETE /compute/v2.1/os-floating-ips/ef3e46ef-5fee-4f4b-90f4-05d21fb860b8 => generated 0 bytes in 1917 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:41:47.276844 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-abbcde26-3e45-4ef8-a709-5b9a85615c86 tempest-SecurityGroupRulesTestJSON-387118441 tempest-SecurityGroupRulesTestJSON-387118441-project] Calling method '.version_select at 0x7f3c789ba040>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:41:47.354276 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-942914ee-35c9-4bcc-928e-cba4a0239fcb tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:41:47.372062 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-942914ee-35c9-4bcc-928e-cba4a0239fcb tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:41:47.375161 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-942914ee-35c9-4bcc-928e-cba4a0239fcb tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:41:47.380340 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-942914ee-35c9-4bcc-928e-cba4a0239fcb tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] 10.222.0.33 "GET /compute/v2.1/servers/8f1e4990-6f32-426c-bdea-ce2007c37a6f" status: 200 len: 1280 microversion: 2.25 time: 0.336017 Oct 04 20:41:47.381047 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 982/2025] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:41:47 2022] GET /compute/v2.1/servers/8f1e4990-6f32-426c-bdea-ce2007c37a6f => generated 1280 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:41:47.391300 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c7a8deb0-fb8d-456c-9cd6-772cff0df1f6 tempest-TenantUsagesTestJSON-375897061 tempest-TenantUsagesTestJSON-375897061-project] Calling method '.version_select at 0x7f3c741ba9d0>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:41:47.411199 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c7a8deb0-fb8d-456c-9cd6-772cff0df1f6 tempest-TenantUsagesTestJSON-375897061 tempest-TenantUsagesTestJSON-375897061-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:47.412836 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c7a8deb0-fb8d-456c-9cd6-772cff0df1f6 tempest-TenantUsagesTestJSON-375897061 tempest-TenantUsagesTestJSON-375897061-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:47.414157 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c7a8deb0-fb8d-456c-9cd6-772cff0df1f6 tempest-TenantUsagesTestJSON-375897061 tempest-TenantUsagesTestJSON-375897061-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:47.438226 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-abbcde26-3e45-4ef8-a709-5b9a85615c86 tempest-SecurityGroupRulesTestJSON-387118441 tempest-SecurityGroupRulesTestJSON-387118441-project] 10.222.0.33 "GET /compute/v2.1/os-security-groups/36b71336-96fe-45d2-a760-a0ba9c556c47" status: 200 len: 664 microversion: 2.1 time: 0.164828 Oct 04 20:41:47.439160 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1044/2026] 10.222.0.33 () {58 vars in 1269 bytes} [Tue Oct 4 20:41:47 2022] GET /compute/v2.1/os-security-groups/36b71336-96fe-45d2-a760-a0ba9c556c47 => generated 664 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:41:47.448270 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-ffd139fe-846d-483f-89dc-14fab2265f03 tempest-FloatingIPDetailsTestJSON-1552955020 tempest-FloatingIPDetailsTestJSON-1552955020-project] Calling method '.version_select at 0x7f3c78905940>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:41:47.964018 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c7a8deb0-fb8d-456c-9cd6-772cff0df1f6 tempest-TenantUsagesTestJSON-375897061 tempest-TenantUsagesTestJSON-375897061-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:47.966737 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c7a8deb0-fb8d-456c-9cd6-772cff0df1f6 tempest-TenantUsagesTestJSON-375897061 tempest-TenantUsagesTestJSON-375897061-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:47.967437 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c7a8deb0-fb8d-456c-9cd6-772cff0df1f6 tempest-TenantUsagesTestJSON-375897061 tempest-TenantUsagesTestJSON-375897061-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:47.997484 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c7a8deb0-fb8d-456c-9cd6-772cff0df1f6 tempest-TenantUsagesTestJSON-375897061 tempest-TenantUsagesTestJSON-375897061-project] 10.222.0.33 "GET /compute/v2.1/os-simple-tenant-usage/dcdc664107bb480ebe6c30acbe313d51?start=2022-10-03T20%3A41%3A45.369745&end=2022-10-05T20%3A41%3A45.369745" status: 200 len: 695 microversion: 2.1 time: 0.609916 Oct 04 20:41:48.004278 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 983/2027] 10.222.0.33 () {58 vars in 1412 bytes} [Tue Oct 4 20:41:47 2022] GET /compute/v2.1/os-simple-tenant-usage/dcdc664107bb480ebe6c30acbe313d51?start=2022-10-03T20%3A41%3A45.369745&end=2022-10-05T20%3A41%3A45.369745 => generated 695 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:41:48.011316 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9867743e-b7aa-4b6b-a3aa-ce71251b86f9 tempest-SecurityGroupRulesTestJSON-387118441 tempest-SecurityGroupRulesTestJSON-387118441-project] Calling method '.version_select at 0x7f3c741f14c0>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:41:48.417054 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-9867743e-b7aa-4b6b-a3aa-ce71251b86f9 tempest-SecurityGroupRulesTestJSON-387118441 tempest-SecurityGroupRulesTestJSON-387118441-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-group-rules/29ffa521-ec43-4b3d-a6d9-1e42daf29bcb" status: 202 len: 0 microversion: 2.1 time: 0.410705 Oct 04 20:41:48.417631 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 984/2028] 10.222.0.33 () {58 vars in 1287 bytes} [Tue Oct 4 20:41:48 2022] DELETE /compute/v2.1/os-security-group-rules/29ffa521-ec43-4b3d-a6d9-1e42daf29bcb => generated 0 bytes in 412 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:41:48.428662 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-152ae86a-e463-4c96-9588-6a6049d06238 tempest-TenantUsagesTestJSON-195088827 tempest-TenantUsagesTestJSON-195088827-project-admin] Calling method '.version_select at 0x7f3c741f1700>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:41:48.451695 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-152ae86a-e463-4c96-9588-6a6049d06238 tempest-TenantUsagesTestJSON-195088827 tempest-TenantUsagesTestJSON-195088827-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:48.452072 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-152ae86a-e463-4c96-9588-6a6049d06238 tempest-TenantUsagesTestJSON-195088827 tempest-TenantUsagesTestJSON-195088827-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:48.452574 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-152ae86a-e463-4c96-9588-6a6049d06238 tempest-TenantUsagesTestJSON-195088827 tempest-TenantUsagesTestJSON-195088827-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:48.484877 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-152ae86a-e463-4c96-9588-6a6049d06238 tempest-TenantUsagesTestJSON-195088827 tempest-TenantUsagesTestJSON-195088827-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:48.485368 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-152ae86a-e463-4c96-9588-6a6049d06238 tempest-TenantUsagesTestJSON-195088827 tempest-TenantUsagesTestJSON-195088827-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:48.495167 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-152ae86a-e463-4c96-9588-6a6049d06238 tempest-TenantUsagesTestJSON-195088827 tempest-TenantUsagesTestJSON-195088827-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:48.675974 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-152ae86a-e463-4c96-9588-6a6049d06238 tempest-TenantUsagesTestJSON-195088827 tempest-TenantUsagesTestJSON-195088827-project-admin] 10.222.0.33 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-03T20%3A41%3A45.369745&end=2022-10-05T20%3A41%3A45.369745&detailed=1" status: 200 len: 25034 microversion: 2.1 time: 0.257241 Oct 04 20:41:48.676856 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 985/2029] 10.222.0.33 () {58 vars in 1335 bytes} [Tue Oct 4 20:41:48 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-03T20%3A41%3A45.369745&end=2022-10-05T20%3A41%3A45.369745&detailed=1 => generated 25034 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 20:41:48.720435 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1fa7725c-3168-41aa-9d0f-13ebc95ad560 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:41:48.722931 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-1fa7725c-3168-41aa-9d0f-13ebc95ad560 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] [instance: 83df4756-40e2-4fc6-be48-48a82dd4572a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:41:48.729842 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1fa7725c-3168-41aa-9d0f-13ebc95ad560 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:48.730609 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1fa7725c-3168-41aa-9d0f-13ebc95ad560 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:48.731221 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1fa7725c-3168-41aa-9d0f-13ebc95ad560 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:48.732110 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1fa7725c-3168-41aa-9d0f-13ebc95ad560 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:48.732728 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1fa7725c-3168-41aa-9d0f-13ebc95ad560 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:48.733315 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1fa7725c-3168-41aa-9d0f-13ebc95ad560 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:48.771222 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-1fa7725c-3168-41aa-9d0f-13ebc95ad560 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] 10.222.0.33 "GET /compute/v2.1/servers/83df4756-40e2-4fc6-be48-48a82dd4572a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.078968 Oct 04 20:41:48.777712 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 986/2030] 10.222.0.33 () {58 vars in 1302 bytes} [Tue Oct 4 20:41:48 2022] GET /compute/v2.1/servers/83df4756-40e2-4fc6-be48-48a82dd4572a/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:41:48.783205 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ca5ac656-1ef0-44d9-9acc-ab6e6b0a2330 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:41:48.783892 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ca5ac656-1ef0-44d9-9acc-ab6e6b0a2330 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] [instance: 8f1e4990-6f32-426c-bdea-ce2007c37a6f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:41:48.790676 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ca5ac656-1ef0-44d9-9acc-ab6e6b0a2330 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:48.791689 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ca5ac656-1ef0-44d9-9acc-ab6e6b0a2330 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:48.792325 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ca5ac656-1ef0-44d9-9acc-ab6e6b0a2330 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:48.793603 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ca5ac656-1ef0-44d9-9acc-ab6e6b0a2330 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:48.794310 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ca5ac656-1ef0-44d9-9acc-ab6e6b0a2330 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:48.794996 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ca5ac656-1ef0-44d9-9acc-ab6e6b0a2330 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:49.172608 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-ca5ac656-1ef0-44d9-9acc-ab6e6b0a2330 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:41:49.185921 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-ca5ac656-1ef0-44d9-9acc-ab6e6b0a2330 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:41:49.187630 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-ca5ac656-1ef0-44d9-9acc-ab6e6b0a2330 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:41:49.197932 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ca5ac656-1ef0-44d9-9acc-ab6e6b0a2330 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] 10.222.0.33 "GET /compute/v2.1/servers/8f1e4990-6f32-426c-bdea-ce2007c37a6f" status: 200 len: 1280 microversion: 2.25 time: 0.419973 Oct 04 20:41:49.199185 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 987/2031] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:41:48 2022] GET /compute/v2.1/servers/8f1e4990-6f32-426c-bdea-ce2007c37a6f => generated 1280 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:41:49.206837 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0e881dcd-9bf5-436c-85f3-f52679c77388 tempest-SecurityGroupRulesTestJSON-387118441 tempest-SecurityGroupRulesTestJSON-387118441-project] Calling method '.version_select at 0x7f3c74208160>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:41:49.338334 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-ffd139fe-846d-483f-89dc-14fab2265f03 tempest-FloatingIPDetailsTestJSON-1552955020 tempest-FloatingIPDetailsTestJSON-1552955020-project] 10.222.0.33 "DELETE /compute/v2.1/os-floating-ips/dae29966-d693-40fa-b1d8-320a84a949e1" status: 202 len: 0 microversion: 2.1 time: 1.897869 Oct 04 20:41:49.338970 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1045/2032] 10.222.0.33 () {58 vars in 1263 bytes} [Tue Oct 4 20:41:47 2022] DELETE /compute/v2.1/os-floating-ips/dae29966-d693-40fa-b1d8-320a84a949e1 => generated 0 bytes in 1899 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:41:49.346036 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-ec002edb-e430-43c7-b4b3-07cae85607e6 tempest-TenantUsagesTestJSON-375897061 tempest-TenantUsagesTestJSON-375897061-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:41:49.346807 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-ec002edb-e430-43c7-b4b3-07cae85607e6 tempest-TenantUsagesTestJSON-375897061 tempest-TenantUsagesTestJSON-375897061-project] [instance: 5099c29c-026b-4f84-ad3f-228d2ac22b08] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:41:49.354096 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:41:49.370944 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ec002edb-e430-43c7-b4b3-07cae85607e6 tempest-TenantUsagesTestJSON-375897061 tempest-TenantUsagesTestJSON-375897061-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:49.371712 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ec002edb-e430-43c7-b4b3-07cae85607e6 tempest-TenantUsagesTestJSON-375897061 tempest-TenantUsagesTestJSON-375897061-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:49.372337 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ec002edb-e430-43c7-b4b3-07cae85607e6 tempest-TenantUsagesTestJSON-375897061 tempest-TenantUsagesTestJSON-375897061-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:49.375995 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ec002edb-e430-43c7-b4b3-07cae85607e6 tempest-TenantUsagesTestJSON-375897061 tempest-TenantUsagesTestJSON-375897061-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:49.376706 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ec002edb-e430-43c7-b4b3-07cae85607e6 tempest-TenantUsagesTestJSON-375897061 tempest-TenantUsagesTestJSON-375897061-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:49.377700 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ec002edb-e430-43c7-b4b3-07cae85607e6 tempest-TenantUsagesTestJSON-375897061 tempest-TenantUsagesTestJSON-375897061-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:49.423217 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-ec002edb-e430-43c7-b4b3-07cae85607e6 tempest-TenantUsagesTestJSON-375897061 tempest-TenantUsagesTestJSON-375897061-project] [instance: 5099c29c-026b-4f84-ad3f-228d2ac22b08] Going to try to terminate instance {{(pid=128802) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:41:49.571472 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-ec002edb-e430-43c7-b4b3-07cae85607e6 tempest-TenantUsagesTestJSON-375897061 tempest-TenantUsagesTestJSON-375897061-project] 10.222.0.33 "DELETE /compute/v2.1/servers/5099c29c-026b-4f84-ad3f-228d2ac22b08" status: 204 len: 0 microversion: 2.1 time: 0.230671 Oct 04 20:41:49.575411 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1046/2033] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 20:41:49 2022] DELETE /compute/v2.1/servers/5099c29c-026b-4f84-ad3f-228d2ac22b08 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:41:49.587640 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-f7f2e3c9-f453-42ad-9071-9dec14f38100 tempest-TenantUsagesTestJSON-375897061 tempest-TenantUsagesTestJSON-375897061-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:41:49.591552 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-f7f2e3c9-f453-42ad-9071-9dec14f38100 tempest-TenantUsagesTestJSON-375897061 tempest-TenantUsagesTestJSON-375897061-project] [instance: 5099c29c-026b-4f84-ad3f-228d2ac22b08] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:41:49.618471 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f7f2e3c9-f453-42ad-9071-9dec14f38100 tempest-TenantUsagesTestJSON-375897061 tempest-TenantUsagesTestJSON-375897061-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:49.620893 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f7f2e3c9-f453-42ad-9071-9dec14f38100 tempest-TenantUsagesTestJSON-375897061 tempest-TenantUsagesTestJSON-375897061-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:49.622939 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f7f2e3c9-f453-42ad-9071-9dec14f38100 tempest-TenantUsagesTestJSON-375897061 tempest-TenantUsagesTestJSON-375897061-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:49.625155 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f7f2e3c9-f453-42ad-9071-9dec14f38100 tempest-TenantUsagesTestJSON-375897061 tempest-TenantUsagesTestJSON-375897061-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:49.626514 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f7f2e3c9-f453-42ad-9071-9dec14f38100 tempest-TenantUsagesTestJSON-375897061 tempest-TenantUsagesTestJSON-375897061-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:49.627818 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f7f2e3c9-f453-42ad-9071-9dec14f38100 tempest-TenantUsagesTestJSON-375897061 tempest-TenantUsagesTestJSON-375897061-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:50.268439 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-f7f2e3c9-f453-42ad-9071-9dec14f38100 tempest-TenantUsagesTestJSON-375897061 tempest-TenantUsagesTestJSON-375897061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f2e2261dea48638016ed569f884a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcdc664107bb480ebe6c30acbe313d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:41:50.284120 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-f7f2e3c9-f453-42ad-9071-9dec14f38100 tempest-TenantUsagesTestJSON-375897061 tempest-TenantUsagesTestJSON-375897061-project] 10.222.0.33 "GET /compute/v2.1/servers/5099c29c-026b-4f84-ad3f-228d2ac22b08" status: 200 len: 1470 microversion: 2.1 time: 0.707236 Oct 04 20:41:50.284727 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1047/2034] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:41:49 2022] GET /compute/v2.1/servers/5099c29c-026b-4f84-ad3f-228d2ac22b08 => generated 1470 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:41:50.292858 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-f38cd863-1396-4184-b329-2ec7fe6cedc9 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:41:50.304657 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-f38cd863-1396-4184-b329-2ec7fe6cedc9 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] [instance: 83df4756-40e2-4fc6-be48-48a82dd4572a] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:41:50.333436 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f38cd863-1396-4184-b329-2ec7fe6cedc9 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:50.338273 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f38cd863-1396-4184-b329-2ec7fe6cedc9 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:50.339316 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f38cd863-1396-4184-b329-2ec7fe6cedc9 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:50.340989 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f38cd863-1396-4184-b329-2ec7fe6cedc9 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:50.341651 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f38cd863-1396-4184-b329-2ec7fe6cedc9 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:50.342281 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f38cd863-1396-4184-b329-2ec7fe6cedc9 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:50.419638 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-f38cd863-1396-4184-b329-2ec7fe6cedc9 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] 10.222.0.33 "GET /compute/v2.1/servers/83df4756-40e2-4fc6-be48-48a82dd4572a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.133486 Oct 04 20:41:50.420585 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1048/2035] 10.222.0.33 () {58 vars in 1302 bytes} [Tue Oct 4 20:41:50 2022] GET /compute/v2.1/servers/83df4756-40e2-4fc6-be48-48a82dd4572a/os-volume_attachments => generated 197 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:41:50.429123 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-e045e93e-29db-4141-bf66-b6b781b59344 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:41:50.430073 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-e045e93e-29db-4141-bf66-b6b781b59344 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] [instance: 8f1e4990-6f32-426c-bdea-ce2007c37a6f] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:41:50.455593 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e045e93e-29db-4141-bf66-b6b781b59344 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:50.456556 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e045e93e-29db-4141-bf66-b6b781b59344 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:50.457429 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e045e93e-29db-4141-bf66-b6b781b59344 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:50.458514 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e045e93e-29db-4141-bf66-b6b781b59344 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:50.459165 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e045e93e-29db-4141-bf66-b6b781b59344 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:50.460013 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e045e93e-29db-4141-bf66-b6b781b59344 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:50.619621 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-0e881dcd-9bf5-436c-85f3-f52679c77388 tempest-SecurityGroupRulesTestJSON-387118441 tempest-SecurityGroupRulesTestJSON-387118441-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/36b71336-96fe-45d2-a760-a0ba9c556c47" status: 202 len: 0 microversion: 2.1 time: 1.419113 Oct 04 20:41:50.620886 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 988/2036] 10.222.0.33 () {58 vars in 1272 bytes} [Tue Oct 4 20:41:49 2022] DELETE /compute/v2.1/os-security-groups/36b71336-96fe-45d2-a760-a0ba9c556c47 => generated 0 bytes in 1421 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:41:50.629939 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b8b0036d-86f9-4494-b203-7a398896b201 tempest-SecurityGroupRulesTestJSON-387118441 tempest-SecurityGroupRulesTestJSON-387118441-project] Calling method '.version_select at 0x7f3c74249ee0>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:41:50.735938 n-d-854823-8 devstack@n-api.service[128801]: DEBUG neutronclient.v2_0.client [None req-b8b0036d-86f9-4494-b203-7a398896b201 tempest-SecurityGroupRulesTestJSON-387118441 tempest-SecurityGroupRulesTestJSON-387118441-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group afafff8b-57b1-46e7-bd7e-0dde24e02c81 does not exist", "detail": ""}} {{(pid=128801) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 20:41:50.736942 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.network.security_group_api [None req-b8b0036d-86f9-4494-b203-7a398896b201 tempest-SecurityGroupRulesTestJSON-387118441 tempest-SecurityGroupRulesTestJSON-387118441-project] Neutron security group afafff8b-57b1-46e7-bd7e-0dde24e02c81 not found {{(pid=128801) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 04 20:41:50.737686 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-b8b0036d-86f9-4494-b203-7a398896b201 tempest-SecurityGroupRulesTestJSON-387118441 tempest-SecurityGroupRulesTestJSON-387118441-project] HTTP exception thrown: Security group afafff8b-57b1-46e7-bd7e-0dde24e02c81 does not exist Oct 04 20:41:50.737686 n-d-854823-8 devstack@n-api.service[128801]: Neutron server returns request_ids: ['req-99d41481-6fe5-40fc-a6b8-c9541fe41b27'] Oct 04 20:41:50.752574 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b8b0036d-86f9-4494-b203-7a398896b201 tempest-SecurityGroupRulesTestJSON-387118441 tempest-SecurityGroupRulesTestJSON-387118441-project] Request method failure captured: Oct 04 20:41:50.752574 n-d-854823-8 devstack@n-api.service[128801]: request: DELETE /compute/v2.1/os-security-groups/afafff8b-57b1-46e7-bd7e-0dde24e02c81 HTTP/1.1 Oct 04 20:41:50.752574 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:41:50.752574 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:41:50.752574 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:41:50.752574 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 0 Oct 04 20:41:50.752574 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:41:50.752574 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:41:50.752574 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:41:50.752574 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:41:50.752574 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJpmj0uOoxKazFajXI0n_UxoNr1FMC-jie7cDb7yPXS88pg6FWo985gUL3G4yaJdi4c8Nae7E9c_wzRV1_aaRAQ_JGa3T7p58fvqgIPOH0K1C03dJMK0BizMICQlw_YJafQXjR0O8rzGUcoUwb2QQQD_nJBtbymLY1l_n3yEic_faNM Oct 04 20:41:50.752574 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:41:50.752574 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:41:50.752574 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:41:50.752574 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:41:50.752574 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:41:50.752574 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:41:50.752574 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: e5046a35f21a4d1fb300070dc1c3146b Oct 04 20:41:50.752574 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-SecurityGroupRulesTestJSON-387118441 Oct 04 20:41:50.752574 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 20:41:50.752574 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 20:41:50.752574 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_e5046a35f21a4d1fb300070dc1c3146b", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e5046a35f21a4d1fb300070dc1c3146b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e5046a35f21a4d1fb300070dc1c3146b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/e5046a35f21a4d1fb300070dc1c3146b"}]}] Oct 04 20:41:50.752574 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-SecurityGroupRulesTestJSON-387118441 Oct 04 20:41:50.752574 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: e5046a35f21a4d1fb300070dc1c3146b Oct 04 20:41:50.752574 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-SecurityGroupRulesTestJSON-387118441 Oct 04 20:41:50.752574 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-SecurityGroupRulesTestJSON-387118441-project Oct 04 20:41:50.752574 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:41:50.752574 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:41:50.752574 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: 3e0e31dfccbf42b1847400b0b919f348 Oct 04 20:41:50.752574 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-SecurityGroupRulesTestJSON-387118441-project Oct 04 20:41:50.752574 n-d-854823-8 devstack@n-api.service[128801]: method: Oct 04 20:41:50.752574 n-d-854823-8 devstack@n-api.service[128801]: exception: Security group afafff8b-57b1-46e7-bd7e-0dde24e02c81 does not exist Oct 04 20:41:50.752574 n-d-854823-8 devstack@n-api.service[128801]: Neutron server returns request_ids: ['req-99d41481-6fe5-40fc-a6b8-c9541fe41b27'] Oct 04 20:41:50.752574 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': 'afafff8b-57b1-46e7-bd7e-0dde24e02c81'} Oct 04 20:41:50.752574 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:41:50.752574 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:41:50.752574 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 04 20:41:50.752574 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 04 20:41:50.752574 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:41:50.752574 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:41:50.752574 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 04 20:41:50.752574 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 04 20:41:50.752574 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:41:50.752574 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:41:50.752574 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 20:41:50.752574 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 20:41:50.752574 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:41:50.752574 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:41:50.752574 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:41:50.752574 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:41:50.752574 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:41:50.752574 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:41:50.752574 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 20:41:50.752574 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 20:41:50.752574 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:41:50.752574 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:41:50.752574 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 20:41:50.752574 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 20:41:50.752574 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 20:41:50.752574 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 20:41:50.752574 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group afafff8b-57b1-46e7-bd7e-0dde24e02c81 does not exist Oct 04 20:41:50.759894 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-99d41481-6fe5-40fc-a6b8-c9541fe41b27'] Oct 04 20:41:50.759894 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:41:50.759894 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:41:50.759894 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:41:50.759894 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:41:50.759894 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 04 20:41:50.759894 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 04 20:41:50.759894 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 04 20:41:50.759894 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 04 20:41:50.759894 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group afafff8b-57b1-46e7-bd7e-0dde24e02c81 does not exist Oct 04 20:41:50.759894 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-99d41481-6fe5-40fc-a6b8-c9541fe41b27'] Oct 04 20:41:50.759894 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:41:50.759894 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:41:50.759894 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:41:50.759894 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:41:50.759894 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:41:50.759894 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:41:50.759894 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:41:50.759894 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:41:50.759894 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:41:50.759894 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:41:50.759894 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:41:50.759894 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:41:50.759894 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 04 20:41:50.759894 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 04 20:41:50.759894 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group afafff8b-57b1-46e7-bd7e-0dde24e02c81 does not exist Oct 04 20:41:50.759894 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-99d41481-6fe5-40fc-a6b8-c9541fe41b27'] Oct 04 20:41:50.759894 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:41:50.759894 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:41:50.759894 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:41:50.759894 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:41:50.759894 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:41:50.759894 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:41:50.759894 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:41:50.759894 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:41:50.759894 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group afafff8b-57b1-46e7-bd7e-0dde24e02c81 does not exist Oct 04 20:41:50.759894 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-99d41481-6fe5-40fc-a6b8-c9541fe41b27'] Oct 04 20:41:50.759894 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:41:50.759894 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b8b0036d-86f9-4494-b203-7a398896b201 tempest-SecurityGroupRulesTestJSON-387118441 tempest-SecurityGroupRulesTestJSON-387118441-project] Returning 404 to user: Security group afafff8b-57b1-46e7-bd7e-0dde24e02c81 does not exist Oct 04 20:41:50.759894 n-d-854823-8 devstack@n-api.service[128801]: Neutron server returns request_ids: ['req-99d41481-6fe5-40fc-a6b8-c9541fe41b27'] {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:41:50.759894 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b8b0036d-86f9-4494-b203-7a398896b201 tempest-SecurityGroupRulesTestJSON-387118441 tempest-SecurityGroupRulesTestJSON-387118441-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/afafff8b-57b1-46e7-bd7e-0dde24e02c81" status: 404 len: 194 microversion: 2.1 time: 0.130459 Oct 04 20:41:50.767106 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 989/2037] 10.222.0.33 () {58 vars in 1272 bytes} [Tue Oct 4 20:41:50 2022] DELETE /compute/v2.1/os-security-groups/afafff8b-57b1-46e7-bd7e-0dde24e02c81 => generated 194 bytes in 136 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 20:41:50.771464 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-973ef430-6cd0-4c88-824c-f142cd08c672 tempest-SecurityGroupRulesTestJSON-387118441 tempest-SecurityGroupRulesTestJSON-387118441-project] Calling method '.version_select at 0x7f3c74249820>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:41:50.812550 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-e045e93e-29db-4141-bf66-b6b781b59344 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:41:50.828385 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-e045e93e-29db-4141-bf66-b6b781b59344 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:41:50.833593 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-e045e93e-29db-4141-bf66-b6b781b59344 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:41:50.839696 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-e045e93e-29db-4141-bf66-b6b781b59344 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] 10.222.0.33 "GET /compute/v2.1/servers/8f1e4990-6f32-426c-bdea-ce2007c37a6f" status: 200 len: 1280 microversion: 2.25 time: 0.417359 Oct 04 20:41:50.841694 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1049/2038] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:41:50 2022] GET /compute/v2.1/servers/8f1e4990-6f32-426c-bdea-ce2007c37a6f => generated 1280 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:41:51.209754 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-973ef430-6cd0-4c88-824c-f142cd08c672 tempest-SecurityGroupRulesTestJSON-387118441 tempest-SecurityGroupRulesTestJSON-387118441-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/4b8222e7-1d66-4548-8d6e-ea1bc718f445" status: 202 len: 0 microversion: 2.1 time: 0.445178 Oct 04 20:41:51.212213 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 990/2039] 10.222.0.33 () {58 vars in 1272 bytes} [Tue Oct 4 20:41:50 2022] DELETE /compute/v2.1/os-security-groups/4b8222e7-1d66-4548-8d6e-ea1bc718f445 => generated 0 bytes in 449 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:41:51.222030 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-8fc57726-0c4c-4b21-bf60-1df63be01a61 tempest-SecurityGroupRulesTestJSON-387118441 tempest-SecurityGroupRulesTestJSON-387118441-project] Calling method '.version_select at 0x7f3c7891c0d0>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:41:51.314669 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-4cd09670-371e-40e0-90df-8bb153a0e8d0 tempest-TenantUsagesTestJSON-375897061 tempest-TenantUsagesTestJSON-375897061-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:41:51.315291 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-4cd09670-371e-40e0-90df-8bb153a0e8d0 tempest-TenantUsagesTestJSON-375897061 tempest-TenantUsagesTestJSON-375897061-project] [instance: 5099c29c-026b-4f84-ad3f-228d2ac22b08] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:41:51.321659 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4cd09670-371e-40e0-90df-8bb153a0e8d0 tempest-TenantUsagesTestJSON-375897061 tempest-TenantUsagesTestJSON-375897061-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:51.322308 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4cd09670-371e-40e0-90df-8bb153a0e8d0 tempest-TenantUsagesTestJSON-375897061 tempest-TenantUsagesTestJSON-375897061-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:51.323024 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4cd09670-371e-40e0-90df-8bb153a0e8d0 tempest-TenantUsagesTestJSON-375897061 tempest-TenantUsagesTestJSON-375897061-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:51.330230 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4cd09670-371e-40e0-90df-8bb153a0e8d0 tempest-TenantUsagesTestJSON-375897061 tempest-TenantUsagesTestJSON-375897061-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:51.330759 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4cd09670-371e-40e0-90df-8bb153a0e8d0 tempest-TenantUsagesTestJSON-375897061 tempest-TenantUsagesTestJSON-375897061-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:51.331208 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4cd09670-371e-40e0-90df-8bb153a0e8d0 tempest-TenantUsagesTestJSON-375897061 tempest-TenantUsagesTestJSON-375897061-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:51.894213 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-4cd09670-371e-40e0-90df-8bb153a0e8d0 tempest-TenantUsagesTestJSON-375897061 tempest-TenantUsagesTestJSON-375897061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f2e2261dea48638016ed569f884a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcdc664107bb480ebe6c30acbe313d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:41:51.910301 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-8fc57726-0c4c-4b21-bf60-1df63be01a61 tempest-SecurityGroupRulesTestJSON-387118441 tempest-SecurityGroupRulesTestJSON-387118441-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/6e941de3-b026-4aa0-ac04-3eb537278913" status: 202 len: 0 microversion: 2.1 time: 0.693655 Oct 04 20:41:51.911728 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1050/2040] 10.222.0.33 () {58 vars in 1272 bytes} [Tue Oct 4 20:41:51 2022] DELETE /compute/v2.1/os-security-groups/6e941de3-b026-4aa0-ac04-3eb537278913 => generated 0 bytes in 696 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:41:51.916999 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-3d35590e-ae7f-49e9-aa63-b69d1a42e19c tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:41:51.920291 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-4cd09670-371e-40e0-90df-8bb153a0e8d0 tempest-TenantUsagesTestJSON-375897061 tempest-TenantUsagesTestJSON-375897061-project] 10.222.0.33 "GET /compute/v2.1/servers/5099c29c-026b-4f84-ad3f-228d2ac22b08" status: 200 len: 1470 microversion: 2.1 time: 0.595770 Oct 04 20:41:51.921458 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-3d35590e-ae7f-49e9-aa63-b69d1a42e19c tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] [instance: 83df4756-40e2-4fc6-be48-48a82dd4572a] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:41:51.922326 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 991/2041] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:41:51 2022] GET /compute/v2.1/servers/5099c29c-026b-4f84-ad3f-228d2ac22b08 => generated 1470 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:41:51.935192 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c0d3bdbf-77c9-410c-98a1-1220c82794d5 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:41:51.943850 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c0d3bdbf-77c9-410c-98a1-1220c82794d5 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] [instance: 8f1e4990-6f32-426c-bdea-ce2007c37a6f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:41:51.944853 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3d35590e-ae7f-49e9-aa63-b69d1a42e19c tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:51.951154 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3d35590e-ae7f-49e9-aa63-b69d1a42e19c tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:51.951154 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3d35590e-ae7f-49e9-aa63-b69d1a42e19c tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:51.958323 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3d35590e-ae7f-49e9-aa63-b69d1a42e19c tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:51.959027 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3d35590e-ae7f-49e9-aa63-b69d1a42e19c tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:51.962683 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c0d3bdbf-77c9-410c-98a1-1220c82794d5 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:51.963225 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3d35590e-ae7f-49e9-aa63-b69d1a42e19c tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:51.974556 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c0d3bdbf-77c9-410c-98a1-1220c82794d5 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:51.976336 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c0d3bdbf-77c9-410c-98a1-1220c82794d5 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:51.977304 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c0d3bdbf-77c9-410c-98a1-1220c82794d5 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:51.979562 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c0d3bdbf-77c9-410c-98a1-1220c82794d5 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:51.980092 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c0d3bdbf-77c9-410c-98a1-1220c82794d5 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:52.050070 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-3d35590e-ae7f-49e9-aa63-b69d1a42e19c tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] 10.222.0.33 "GET /compute/v2.1/servers/83df4756-40e2-4fc6-be48-48a82dd4572a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.137006 Oct 04 20:41:52.055521 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1051/2042] 10.222.0.33 () {58 vars in 1302 bytes} [Tue Oct 4 20:41:51 2022] GET /compute/v2.1/servers/83df4756-40e2-4fc6-be48-48a82dd4572a/os-volume_attachments => generated 197 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:41:52.068221 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-a3c35ce1-ccef-4195-8618-792fce3a75a1 tempest-SecurityGroupRulesTestJSON-387118441 tempest-SecurityGroupRulesTestJSON-387118441-project] Calling method '.version_select at 0x7f3c7891c5e0>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:41:52.823576 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c0d3bdbf-77c9-410c-98a1-1220c82794d5 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:41:52.839957 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c0d3bdbf-77c9-410c-98a1-1220c82794d5 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:41:52.845128 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c0d3bdbf-77c9-410c-98a1-1220c82794d5 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:41:52.850325 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c0d3bdbf-77c9-410c-98a1-1220c82794d5 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] 10.222.0.33 "GET /compute/v2.1/servers/8f1e4990-6f32-426c-bdea-ce2007c37a6f" status: 200 len: 1280 microversion: 2.25 time: 0.921978 Oct 04 20:41:52.851884 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 992/2043] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:41:51 2022] GET /compute/v2.1/servers/8f1e4990-6f32-426c-bdea-ce2007c37a6f => generated 1280 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:41:52.951630 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ab7780ee-2329-4fe3-970c-e84a203a13d7 tempest-TenantUsagesTestJSON-375897061 tempest-TenantUsagesTestJSON-375897061-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:41:52.953708 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ab7780ee-2329-4fe3-970c-e84a203a13d7 tempest-TenantUsagesTestJSON-375897061 tempest-TenantUsagesTestJSON-375897061-project] [instance: 5099c29c-026b-4f84-ad3f-228d2ac22b08] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:41:52.996381 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ab7780ee-2329-4fe3-970c-e84a203a13d7 tempest-TenantUsagesTestJSON-375897061 tempest-TenantUsagesTestJSON-375897061-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:52.997631 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ab7780ee-2329-4fe3-970c-e84a203a13d7 tempest-TenantUsagesTestJSON-375897061 tempest-TenantUsagesTestJSON-375897061-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:52.998915 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ab7780ee-2329-4fe3-970c-e84a203a13d7 tempest-TenantUsagesTestJSON-375897061 tempest-TenantUsagesTestJSON-375897061-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:53.000731 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ab7780ee-2329-4fe3-970c-e84a203a13d7 tempest-TenantUsagesTestJSON-375897061 tempest-TenantUsagesTestJSON-375897061-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:53.001417 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ab7780ee-2329-4fe3-970c-e84a203a13d7 tempest-TenantUsagesTestJSON-375897061 tempest-TenantUsagesTestJSON-375897061-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:53.002124 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ab7780ee-2329-4fe3-970c-e84a203a13d7 tempest-TenantUsagesTestJSON-375897061 tempest-TenantUsagesTestJSON-375897061-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:53.241060 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-ab7780ee-2329-4fe3-970c-e84a203a13d7 tempest-TenantUsagesTestJSON-375897061 tempest-TenantUsagesTestJSON-375897061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f2e2261dea48638016ed569f884a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcdc664107bb480ebe6c30acbe313d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:41:53.254057 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ab7780ee-2329-4fe3-970c-e84a203a13d7 tempest-TenantUsagesTestJSON-375897061 tempest-TenantUsagesTestJSON-375897061-project] 10.222.0.33 "GET /compute/v2.1/servers/5099c29c-026b-4f84-ad3f-228d2ac22b08" status: 200 len: 1428 microversion: 2.1 time: 0.306025 Oct 04 20:41:53.284442 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 993/2044] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:41:52 2022] GET /compute/v2.1/servers/5099c29c-026b-4f84-ad3f-228d2ac22b08 => generated 1428 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:41:53.303175 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-df79a892-296f-4c83-90a0-64d2bb89809c tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:41:53.309114 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-df79a892-296f-4c83-90a0-64d2bb89809c tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] [instance: 83df4756-40e2-4fc6-be48-48a82dd4572a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:41:53.331803 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-df79a892-296f-4c83-90a0-64d2bb89809c tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:53.335917 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-df79a892-296f-4c83-90a0-64d2bb89809c tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:53.337221 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-df79a892-296f-4c83-90a0-64d2bb89809c tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:53.338172 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-df79a892-296f-4c83-90a0-64d2bb89809c tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:53.338830 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-df79a892-296f-4c83-90a0-64d2bb89809c tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:53.339463 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-df79a892-296f-4c83-90a0-64d2bb89809c tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:53.412222 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-df79a892-296f-4c83-90a0-64d2bb89809c tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] 10.222.0.33 "GET /compute/v2.1/servers/83df4756-40e2-4fc6-be48-48a82dd4572a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.126586 Oct 04 20:41:53.417829 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 994/2045] 10.222.0.33 () {58 vars in 1302 bytes} [Tue Oct 4 20:41:53 2022] GET /compute/v2.1/servers/83df4756-40e2-4fc6-be48-48a82dd4572a/os-volume_attachments => generated 25 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 20:41:53.429447 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-f5f061b4-ed1d-4cff-83b6-ceb21c4405f6 req-60941daf-b03a-47ca-afab-ade68b33745f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5099c29c-026b-4f84-ad3f-228d2ac22b08", "name": "network-vif-deleted", "tag": "74b97ebd-8030-4c1c-b3f4-b506f180587b"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:41:53.453302 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-f5f061b4-ed1d-4cff-83b6-ceb21c4405f6 req-60941daf-b03a-47ca-afab-ade68b33745f service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:53.458935 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-f5f061b4-ed1d-4cff-83b6-ceb21c4405f6 req-60941daf-b03a-47ca-afab-ade68b33745f service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:53.460072 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-f5f061b4-ed1d-4cff-83b6-ceb21c4405f6 req-60941daf-b03a-47ca-afab-ade68b33745f service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:53.490846 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-f5f061b4-ed1d-4cff-83b6-ceb21c4405f6 req-60941daf-b03a-47ca-afab-ade68b33745f service nova] Creating event network-vif-deleted:74b97ebd-8030-4c1c-b3f4-b506f180587b for instance 5099c29c-026b-4f84-ad3f-228d2ac22b08 on n-h2-854823-8 Oct 04 20:41:53.509718 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-f5f061b4-ed1d-4cff-83b6-ceb21c4405f6 req-60941daf-b03a-47ca-afab-ade68b33745f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082330 Oct 04 20:41:53.511081 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 995/2046] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:41:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:41:53.870800 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-a3c35ce1-ccef-4195-8618-792fce3a75a1 tempest-SecurityGroupRulesTestJSON-387118441 tempest-SecurityGroupRulesTestJSON-387118441-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/14975e2d-9164-406b-88c8-dd7575db57fa" status: 202 len: 0 microversion: 2.1 time: 1.813737 Oct 04 20:41:53.872565 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1052/2047] 10.222.0.33 () {58 vars in 1272 bytes} [Tue Oct 4 20:41:52 2022] DELETE /compute/v2.1/os-security-groups/14975e2d-9164-406b-88c8-dd7575db57fa => generated 0 bytes in 1816 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:41:53.889373 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-019a892d-d84f-4356-8e9b-a1d25e108a59 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:41:53.892716 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-0c49e537-8f02-4c5c-960b-ffb1be0da5da tempest-SecurityGroupRulesTestJSON-387118441 tempest-SecurityGroupRulesTestJSON-387118441-project] Calling method '.version_select at 0x7f3c78957e50>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:41:53.895854 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-019a892d-d84f-4356-8e9b-a1d25e108a59 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] [instance: 8f1e4990-6f32-426c-bdea-ce2007c37a6f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:41:53.916958 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-019a892d-d84f-4356-8e9b-a1d25e108a59 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:53.919184 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-019a892d-d84f-4356-8e9b-a1d25e108a59 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:53.919839 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-019a892d-d84f-4356-8e9b-a1d25e108a59 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:53.922460 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-019a892d-d84f-4356-8e9b-a1d25e108a59 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:53.924730 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-019a892d-d84f-4356-8e9b-a1d25e108a59 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:53.931351 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-019a892d-d84f-4356-8e9b-a1d25e108a59 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:54.374028 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-019a892d-d84f-4356-8e9b-a1d25e108a59 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:41:54.410361 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-019a892d-d84f-4356-8e9b-a1d25e108a59 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:41:54.418219 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-019a892d-d84f-4356-8e9b-a1d25e108a59 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:41:54.429485 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-019a892d-d84f-4356-8e9b-a1d25e108a59 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] 10.222.0.33 "GET /compute/v2.1/servers/8f1e4990-6f32-426c-bdea-ce2007c37a6f" status: 200 len: 1280 microversion: 2.25 time: 0.550289 Oct 04 20:41:54.439216 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 996/2048] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:41:53 2022] GET /compute/v2.1/servers/8f1e4990-6f32-426c-bdea-ce2007c37a6f => generated 1280 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:41:54.470387 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-892a3aa0-1809-4fc3-9af6-556d2f90b883 tempest-TenantUsagesTestJSON-375897061 tempest-TenantUsagesTestJSON-375897061-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:41:54.470387 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-892a3aa0-1809-4fc3-9af6-556d2f90b883 tempest-TenantUsagesTestJSON-375897061 tempest-TenantUsagesTestJSON-375897061-project] [instance: 5099c29c-026b-4f84-ad3f-228d2ac22b08] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:41:54.514378 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-892a3aa0-1809-4fc3-9af6-556d2f90b883 tempest-TenantUsagesTestJSON-375897061 tempest-TenantUsagesTestJSON-375897061-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:54.516310 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-892a3aa0-1809-4fc3-9af6-556d2f90b883 tempest-TenantUsagesTestJSON-375897061 tempest-TenantUsagesTestJSON-375897061-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:54.519089 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-892a3aa0-1809-4fc3-9af6-556d2f90b883 tempest-TenantUsagesTestJSON-375897061 tempest-TenantUsagesTestJSON-375897061-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:54.524690 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-892a3aa0-1809-4fc3-9af6-556d2f90b883 tempest-TenantUsagesTestJSON-375897061 tempest-TenantUsagesTestJSON-375897061-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:54.525345 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-892a3aa0-1809-4fc3-9af6-556d2f90b883 tempest-TenantUsagesTestJSON-375897061 tempest-TenantUsagesTestJSON-375897061-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:54.529362 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-892a3aa0-1809-4fc3-9af6-556d2f90b883 tempest-TenantUsagesTestJSON-375897061 tempest-TenantUsagesTestJSON-375897061-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:54.535238 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-0c49e537-8f02-4c5c-960b-ffb1be0da5da tempest-SecurityGroupRulesTestJSON-387118441 tempest-SecurityGroupRulesTestJSON-387118441-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/47c69efa-1d80-4d7a-bf4c-fd8c3873e19b" status: 202 len: 0 microversion: 2.1 time: 0.654627 Oct 04 20:41:54.536144 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1053/2049] 10.222.0.33 () {58 vars in 1272 bytes} [Tue Oct 4 20:41:53 2022] DELETE /compute/v2.1/os-security-groups/47c69efa-1d80-4d7a-bf4c-fd8c3873e19b => generated 0 bytes in 656 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:41:54.544114 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-c718fb9e-d7a1-49d5-b4a7-5d0bdb55094f tempest-SecurityGroupRulesTestJSON-387118441 tempest-SecurityGroupRulesTestJSON-387118441-project] Calling method '.version_select at 0x7f3c7890caf0>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:41:54.648028 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-892a3aa0-1809-4fc3-9af6-556d2f90b883 tempest-TenantUsagesTestJSON-375897061 tempest-TenantUsagesTestJSON-375897061-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:54.648515 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-892a3aa0-1809-4fc3-9af6-556d2f90b883 tempest-TenantUsagesTestJSON-375897061 tempest-TenantUsagesTestJSON-375897061-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:54.648949 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-892a3aa0-1809-4fc3-9af6-556d2f90b883 tempest-TenantUsagesTestJSON-375897061 tempest-TenantUsagesTestJSON-375897061-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:54.649404 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-892a3aa0-1809-4fc3-9af6-556d2f90b883 tempest-TenantUsagesTestJSON-375897061 tempest-TenantUsagesTestJSON-375897061-project] Lazy-loading 'fault' on Instance uuid 5099c29c-026b-4f84-ad3f-228d2ac22b08 {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:41:54.914518 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-892a3aa0-1809-4fc3-9af6-556d2f90b883 tempest-TenantUsagesTestJSON-375897061 tempest-TenantUsagesTestJSON-375897061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f2e2261dea48638016ed569f884a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcdc664107bb480ebe6c30acbe313d51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:41:54.926928 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-892a3aa0-1809-4fc3-9af6-556d2f90b883 tempest-TenantUsagesTestJSON-375897061 tempest-TenantUsagesTestJSON-375897061-project] 10.222.0.33 "GET /compute/v2.1/servers/5099c29c-026b-4f84-ad3f-228d2ac22b08" status: 200 len: 1304 microversion: 2.1 time: 0.486346 Oct 04 20:41:54.929365 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 997/2050] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:41:54 2022] GET /compute/v2.1/servers/5099c29c-026b-4f84-ad3f-228d2ac22b08 => generated 1304 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:41:55.142888 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-c718fb9e-d7a1-49d5-b4a7-5d0bdb55094f tempest-SecurityGroupRulesTestJSON-387118441 tempest-SecurityGroupRulesTestJSON-387118441-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/47f23a54-67e2-4b08-bfc0-5aa6db3d75be" status: 202 len: 0 microversion: 2.1 time: 0.602082 Oct 04 20:41:55.143587 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1054/2051] 10.222.0.33 () {58 vars in 1272 bytes} [Tue Oct 4 20:41:54 2022] DELETE /compute/v2.1/os-security-groups/47f23a54-67e2-4b08-bfc0-5aa6db3d75be => generated 0 bytes in 604 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:41:55.960296 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-659d5ed0-78cb-4838-a47d-7d2e2bb54485 tempest-TenantUsagesTestJSON-375897061 tempest-TenantUsagesTestJSON-375897061-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:41:55.962952 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-659d5ed0-78cb-4838-a47d-7d2e2bb54485 tempest-TenantUsagesTestJSON-375897061 tempest-TenantUsagesTestJSON-375897061-project] [instance: 5099c29c-026b-4f84-ad3f-228d2ac22b08] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:41:55.987878 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-659d5ed0-78cb-4838-a47d-7d2e2bb54485 tempest-TenantUsagesTestJSON-375897061 tempest-TenantUsagesTestJSON-375897061-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:55.989976 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-659d5ed0-78cb-4838-a47d-7d2e2bb54485 tempest-TenantUsagesTestJSON-375897061 tempest-TenantUsagesTestJSON-375897061-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:55.990899 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-659d5ed0-78cb-4838-a47d-7d2e2bb54485 tempest-TenantUsagesTestJSON-375897061 tempest-TenantUsagesTestJSON-375897061-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:55.994115 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-659d5ed0-78cb-4838-a47d-7d2e2bb54485 tempest-TenantUsagesTestJSON-375897061 tempest-TenantUsagesTestJSON-375897061-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:55.996604 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-659d5ed0-78cb-4838-a47d-7d2e2bb54485 tempest-TenantUsagesTestJSON-375897061 tempest-TenantUsagesTestJSON-375897061-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:55.998523 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-659d5ed0-78cb-4838-a47d-7d2e2bb54485 tempest-TenantUsagesTestJSON-375897061 tempest-TenantUsagesTestJSON-375897061-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:56.063609 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.wsgi [None req-659d5ed0-78cb-4838-a47d-7d2e2bb54485 tempest-TenantUsagesTestJSON-375897061 tempest-TenantUsagesTestJSON-375897061-project] HTTP exception thrown: Instance 5099c29c-026b-4f84-ad3f-228d2ac22b08 could not be found. Oct 04 20:41:56.071883 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-659d5ed0-78cb-4838-a47d-7d2e2bb54485 tempest-TenantUsagesTestJSON-375897061 tempest-TenantUsagesTestJSON-375897061-project] Request method failure captured: Oct 04 20:41:56.071883 n-d-854823-8 devstack@n-api.service[128802]: request: GET /compute/v2.1/servers/5099c29c-026b-4f84-ad3f-228d2ac22b08 HTTP/1.1 Oct 04 20:41:56.071883 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 20:41:56.071883 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 20:41:56.071883 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 20:41:56.071883 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 0 Oct 04 20:41:56.071883 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 20:41:56.071883 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 20:41:56.071883 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 20:41:56.071883 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 20:41:56.071883 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPJprxJ0BnqpxkpTbC7yJbMug62xz9hlukfr-exaHJldqLN_EHLJfB_3wcuhp16G6WrKyFM-KXvb3S4e6MIfC0yEhcPyFth5Djz01WJ3zQ7Kq4s4d8p9rEBioPCZA1D-MR73iOeJOWJ1tUj1iWsFxgs3E7TXPyKvdIQDPYuBnKeyB2H0 Oct 04 20:41:56.071883 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 20:41:56.071883 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 20:41:56.071883 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 20:41:56.071883 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 20:41:56.071883 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 20:41:56.071883 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 20:41:56.071883 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: dcdc664107bb480ebe6c30acbe313d51 Oct 04 20:41:56.071883 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-TenantUsagesTestJSON-375897061 Oct 04 20:41:56.071883 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 20:41:56.071883 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 20:41:56.071883 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_dcdc664107bb480ebe6c30acbe313d51", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/dcdc664107bb480ebe6c30acbe313d51"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/dcdc664107bb480ebe6c30acbe313d51"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/dcdc664107bb480ebe6c30acbe313d51"}]}] Oct 04 20:41:56.071883 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-TenantUsagesTestJSON-375897061 Oct 04 20:41:56.071883 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: dcdc664107bb480ebe6c30acbe313d51 Oct 04 20:41:56.071883 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-TenantUsagesTestJSON-375897061 Oct 04 20:41:56.071883 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-TenantUsagesTestJSON-375897061-project Oct 04 20:41:56.071883 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 20:41:56.071883 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 20:41:56.071883 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: 42f2e2261dea48638016ed569f884a10 Oct 04 20:41:56.071883 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-TenantUsagesTestJSON-375897061-project Oct 04 20:41:56.071883 n-d-854823-8 devstack@n-api.service[128802]: method: > Oct 04 20:41:56.071883 n-d-854823-8 devstack@n-api.service[128802]: exception: Instance 5099c29c-026b-4f84-ad3f-228d2ac22b08 could not be found. Oct 04 20:41:56.071883 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'id': '5099c29c-026b-4f84-ad3f-228d2ac22b08'} Oct 04 20:41:56.071883 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:41:56.071883 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:41:56.071883 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:41:56.071883 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:41:56.071883 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:41:56.071883 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:41:56.071883 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:41:56.071883 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:41:56.071883 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:41:56.071883 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:41:56.071883 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5099c29c-026b-4f84-ad3f-228d2ac22b08 could not be found. Oct 04 20:41:56.071883 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:41:56.071883 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:41:56.071883 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:41:56.071883 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:41:56.071883 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:41:56.071883 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:41:56.071883 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:41:56.071883 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:41:56.071883 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:41:56.071883 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:41:56.071883 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:41:56.071883 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:41:56.071883 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:41:56.071883 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:41:56.071883 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:41:56.071883 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:41:56.071883 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5099c29c-026b-4f84-ad3f-228d2ac22b08 could not be found. Oct 04 20:41:56.071883 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:41:56.071883 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:41:56.071883 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:41:56.077544 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:41:56.077544 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:41:56.077544 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:41:56.077544 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:41:56.077544 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:41:56.077544 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5099c29c-026b-4f84-ad3f-228d2ac22b08 could not be found. Oct 04 20:41:56.077544 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:41:56.088846 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-659d5ed0-78cb-4838-a47d-7d2e2bb54485 tempest-TenantUsagesTestJSON-375897061 tempest-TenantUsagesTestJSON-375897061-project] Returning 404 to user: Instance 5099c29c-026b-4f84-ad3f-228d2ac22b08 could not be found. {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:41:56.088846 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-659d5ed0-78cb-4838-a47d-7d2e2bb54485 tempest-TenantUsagesTestJSON-375897061 tempest-TenantUsagesTestJSON-375897061-project] 10.222.0.33 "GET /compute/v2.1/servers/5099c29c-026b-4f84-ad3f-228d2ac22b08" status: 404 len: 111 microversion: 2.1 time: 0.134960 Oct 04 20:41:56.103238 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1055/2052] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:41:55 2022] GET /compute/v2.1/servers/5099c29c-026b-4f84-ad3f-228d2ac22b08 => generated 111 bytes in 150 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:41:56.104137 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d3737eb9-e798-42bb-8913-c42e69367953 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:41:56.105390 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d3737eb9-e798-42bb-8913-c42e69367953 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] [instance: 8f1e4990-6f32-426c-bdea-ce2007c37a6f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:41:56.145799 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d3737eb9-e798-42bb-8913-c42e69367953 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:56.148017 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d3737eb9-e798-42bb-8913-c42e69367953 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:56.153215 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d3737eb9-e798-42bb-8913-c42e69367953 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:56.156966 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d3737eb9-e798-42bb-8913-c42e69367953 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:56.163023 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d3737eb9-e798-42bb-8913-c42e69367953 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:56.169968 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d3737eb9-e798-42bb-8913-c42e69367953 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:56.715765 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d3737eb9-e798-42bb-8913-c42e69367953 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:41:56.727850 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d3737eb9-e798-42bb-8913-c42e69367953 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:41:56.740975 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d3737eb9-e798-42bb-8913-c42e69367953 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:41:56.743020 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d3737eb9-e798-42bb-8913-c42e69367953 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] 10.222.0.33 "GET /compute/v2.1/servers/8f1e4990-6f32-426c-bdea-ce2007c37a6f" status: 200 len: 1280 microversion: 2.25 time: 1.284295 Oct 04 20:41:56.746183 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 998/2053] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:41:55 2022] GET /compute/v2.1/servers/8f1e4990-6f32-426c-bdea-ce2007c37a6f => generated 1280 bytes in 1288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:41:57.780350 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-9b9905ec-8ff0-4220-8538-d34f7f5aac23 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:41:57.781822 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-9b9905ec-8ff0-4220-8538-d34f7f5aac23 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] [instance: 8f1e4990-6f32-426c-bdea-ce2007c37a6f] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:41:57.804711 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9b9905ec-8ff0-4220-8538-d34f7f5aac23 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:57.806916 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9b9905ec-8ff0-4220-8538-d34f7f5aac23 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:57.807387 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9b9905ec-8ff0-4220-8538-d34f7f5aac23 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:57.815446 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9b9905ec-8ff0-4220-8538-d34f7f5aac23 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:57.816139 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9b9905ec-8ff0-4220-8538-d34f7f5aac23 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:57.816885 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9b9905ec-8ff0-4220-8538-d34f7f5aac23 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:58.445205 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-9b9905ec-8ff0-4220-8538-d34f7f5aac23 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:41:58.463318 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-9b9905ec-8ff0-4220-8538-d34f7f5aac23 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:41:58.465708 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-9b9905ec-8ff0-4220-8538-d34f7f5aac23 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:41:58.466924 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-9b9905ec-8ff0-4220-8538-d34f7f5aac23 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] 10.222.0.33 "GET /compute/v2.1/servers/8f1e4990-6f32-426c-bdea-ce2007c37a6f" status: 200 len: 1280 microversion: 2.25 time: 0.691414 Oct 04 20:41:58.483195 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1056/2054] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:41:57 2022] GET /compute/v2.1/servers/8f1e4990-6f32-426c-bdea-ce2007c37a6f => generated 1280 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:41:59.159052 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-22532e33-ee81-4689-9eda-e01efcd88b6e req-0fd63393-aa2e-43aa-a9ab-f14649067c4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f1e4990-6f32-426c-bdea-ce2007c37a6f", "name": "network-vif-plugged", "status": "completed", "tag": "ade75c1b-2031-475c-af20-7442fa7b876a"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:41:59.175703 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=6 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:41:59.181653 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-22532e33-ee81-4689-9eda-e01efcd88b6e req-0fd63393-aa2e-43aa-a9ab-f14649067c4d service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:59.182911 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-22532e33-ee81-4689-9eda-e01efcd88b6e req-0fd63393-aa2e-43aa-a9ab-f14649067c4d service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:59.184531 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-22532e33-ee81-4689-9eda-e01efcd88b6e req-0fd63393-aa2e-43aa-a9ab-f14649067c4d service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:59.225152 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-22532e33-ee81-4689-9eda-e01efcd88b6e req-0fd63393-aa2e-43aa-a9ab-f14649067c4d service nova] Creating event network-vif-plugged:ade75c1b-2031-475c-af20-7442fa7b876a for instance 8f1e4990-6f32-426c-bdea-ce2007c37a6f on n-h1-854823-8 Oct 04 20:41:59.242586 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-22532e33-ee81-4689-9eda-e01efcd88b6e req-0fd63393-aa2e-43aa-a9ab-f14649067c4d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089783 Oct 04 20:41:59.246181 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 999/2055] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:41:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 20:41:59.494179 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-fa3d657d-32cf-4c3b-b31a-6e442ca9b7d2 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:41:59.495080 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-fa3d657d-32cf-4c3b-b31a-6e442ca9b7d2 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] [instance: 8f1e4990-6f32-426c-bdea-ce2007c37a6f] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:41:59.512643 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fa3d657d-32cf-4c3b-b31a-6e442ca9b7d2 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:59.514304 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fa3d657d-32cf-4c3b-b31a-6e442ca9b7d2 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:59.516437 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fa3d657d-32cf-4c3b-b31a-6e442ca9b7d2 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:59.518775 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fa3d657d-32cf-4c3b-b31a-6e442ca9b7d2 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:41:59.519269 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fa3d657d-32cf-4c3b-b31a-6e442ca9b7d2 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:41:59.519980 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fa3d657d-32cf-4c3b-b31a-6e442ca9b7d2 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:41:59.595728 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:42:00.094652 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-fa3d657d-32cf-4c3b-b31a-6e442ca9b7d2 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:42:00.103909 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-fa3d657d-32cf-4c3b-b31a-6e442ca9b7d2 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:42:00.111899 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-fa3d657d-32cf-4c3b-b31a-6e442ca9b7d2 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:42:00.113089 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-fa3d657d-32cf-4c3b-b31a-6e442ca9b7d2 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] 10.222.0.33 "GET /compute/v2.1/servers/8f1e4990-6f32-426c-bdea-ce2007c37a6f" status: 200 len: 1280 microversion: 2.25 time: 0.623912 Oct 04 20:42:00.127337 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1057/2056] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:41:59 2022] GET /compute/v2.1/servers/8f1e4990-6f32-426c-bdea-ce2007c37a6f => generated 1280 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:42:01.140576 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-fd459e94-ffc3-4d15-a1fd-fd79a92d9dc0 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:01.141277 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-fd459e94-ffc3-4d15-a1fd-fd79a92d9dc0 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] [instance: 8f1e4990-6f32-426c-bdea-ce2007c37a6f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:42:01.156682 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fd459e94-ffc3-4d15-a1fd-fd79a92d9dc0 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:01.157290 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fd459e94-ffc3-4d15-a1fd-fd79a92d9dc0 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:01.157725 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fd459e94-ffc3-4d15-a1fd-fd79a92d9dc0 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:01.166906 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fd459e94-ffc3-4d15-a1fd-fd79a92d9dc0 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:01.167557 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fd459e94-ffc3-4d15-a1fd-fd79a92d9dc0 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:01.168005 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fd459e94-ffc3-4d15-a1fd-fd79a92d9dc0 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:01.636755 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-fd459e94-ffc3-4d15-a1fd-fd79a92d9dc0 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:42:01.653252 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-fd459e94-ffc3-4d15-a1fd-fd79a92d9dc0 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:42:01.657475 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-fd459e94-ffc3-4d15-a1fd-fd79a92d9dc0 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:42:01.664389 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-fd459e94-ffc3-4d15-a1fd-fd79a92d9dc0 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] 10.222.0.33 "GET /compute/v2.1/servers/8f1e4990-6f32-426c-bdea-ce2007c37a6f" status: 200 len: 1280 microversion: 2.25 time: 0.524436 Oct 04 20:42:01.665448 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1000/2057] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:42:01 2022] GET /compute/v2.1/servers/8f1e4990-6f32-426c-bdea-ce2007c37a6f => generated 1280 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:42:02.698896 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-3f8a868b-e5ff-4bdd-8a70-77027f86da03 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:02.699678 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-3f8a868b-e5ff-4bdd-8a70-77027f86da03 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] [instance: 8f1e4990-6f32-426c-bdea-ce2007c37a6f] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:42:02.745587 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3f8a868b-e5ff-4bdd-8a70-77027f86da03 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:02.748833 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3f8a868b-e5ff-4bdd-8a70-77027f86da03 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:02.749835 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3f8a868b-e5ff-4bdd-8a70-77027f86da03 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:02.754400 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3f8a868b-e5ff-4bdd-8a70-77027f86da03 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:02.758672 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3f8a868b-e5ff-4bdd-8a70-77027f86da03 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:02.763287 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3f8a868b-e5ff-4bdd-8a70-77027f86da03 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:03.289073 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-3f8a868b-e5ff-4bdd-8a70-77027f86da03 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:42:03.308851 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-3f8a868b-e5ff-4bdd-8a70-77027f86da03 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:42:03.312854 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-3f8a868b-e5ff-4bdd-8a70-77027f86da03 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:42:03.315859 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-3f8a868b-e5ff-4bdd-8a70-77027f86da03 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] 10.222.0.33 "GET /compute/v2.1/servers/8f1e4990-6f32-426c-bdea-ce2007c37a6f" status: 200 len: 1475 microversion: 2.25 time: 0.621509 Oct 04 20:42:03.332544 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1058/2058] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:42:02 2022] GET /compute/v2.1/servers/8f1e4990-6f32-426c-bdea-ce2007c37a6f => generated 1475 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:42:03.344857 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6669cddf-5634-4111-9310-e4b052aa2934 tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:03.346233 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-6669cddf-5634-4111-9310-e4b052aa2934 tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] [instance: 8f1e4990-6f32-426c-bdea-ce2007c37a6f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:42:03.359706 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6669cddf-5634-4111-9310-e4b052aa2934 tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:03.366089 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6669cddf-5634-4111-9310-e4b052aa2934 tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:03.370503 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6669cddf-5634-4111-9310-e4b052aa2934 tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:03.371643 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6669cddf-5634-4111-9310-e4b052aa2934 tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:03.372396 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6669cddf-5634-4111-9310-e4b052aa2934 tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:03.372976 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6669cddf-5634-4111-9310-e4b052aa2934 tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:03.679702 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-6669cddf-5634-4111-9310-e4b052aa2934 tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] Lazy-loading 'services' on Instance uuid 8f1e4990-6f32-426c-bdea-ce2007c37a6f {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:42:03.728695 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-6669cddf-5634-4111-9310-e4b052aa2934 tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/8f1e4990-6f32-426c-bdea-ce2007c37a6f" status: 200 len: 1967 microversion: 2.25 time: 0.389225 Oct 04 20:42:03.732715 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1001/2059] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:42:03 2022] GET /compute/v2.1/servers/8f1e4990-6f32-426c-bdea-ce2007c37a6f => generated 1967 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:42:03.760508 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0fb83916-a41c-4b21-9b3b-9e02d20b8b85 tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:03.762701 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-0fb83916-a41c-4b21-9b3b-9e02d20b8b85 tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] [instance: 8f1e4990-6f32-426c-bdea-ce2007c37a6f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:42:03.778085 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0fb83916-a41c-4b21-9b3b-9e02d20b8b85 tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:03.779398 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0fb83916-a41c-4b21-9b3b-9e02d20b8b85 tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:03.787539 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0fb83916-a41c-4b21-9b3b-9e02d20b8b85 tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:03.789302 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0fb83916-a41c-4b21-9b3b-9e02d20b8b85 tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:03.790647 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0fb83916-a41c-4b21-9b3b-9e02d20b8b85 tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:03.791983 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0fb83916-a41c-4b21-9b3b-9e02d20b8b85 tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:03.794176 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-3e833bdc-e62e-402e-a9ec-245236ca9b2c tempest-FlavorsV2TestJSON-1606292848 tempest-FlavorsV2TestJSON-1606292848-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:03.825054 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-3e833bdc-e62e-402e-a9ec-245236ca9b2c tempest-FlavorsV2TestJSON-1606292848 tempest-FlavorsV2TestJSON-1606292848-project] 10.222.0.33 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.324985 Oct 04 20:42:03.825663 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1059/2060] 10.222.0.33 () {58 vars in 1137 bytes} [Tue Oct 4 20:42:03 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:42:03.840173 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-ca424cf0-c362-4b10-838e-2efc62b7db5c tempest-FlavorsV2TestJSON-1606292848 tempest-FlavorsV2TestJSON-1606292848-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:03.895633 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-ca424cf0-c362-4b10-838e-2efc62b7db5c tempest-FlavorsV2TestJSON-1606292848 tempest-FlavorsV2TestJSON-1606292848-project] 10.222.0.33 "GET /compute/v2.1/flavors" status: 200 len: 2594 microversion: 2.1 time: 0.059397 Oct 04 20:42:03.897483 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1060/2061] 10.222.0.33 () {58 vars in 1125 bytes} [Tue Oct 4 20:42:03 2022] GET /compute/v2.1/flavors => generated 2594 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:42:03.913276 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-1e714ad3-c1db-4a23-8d39-a870923ec860 tempest-FlavorsV2TestJSON-1606292848 tempest-FlavorsV2TestJSON-1606292848-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:03.932117 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-1e714ad3-c1db-4a23-8d39-a870923ec860 tempest-FlavorsV2TestJSON-1606292848 tempest-FlavorsV2TestJSON-1606292848-project] 10.222.0.33 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.022514 Oct 04 20:42:03.934276 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1061/2062] 10.222.0.33 () {58 vars in 1137 bytes} [Tue Oct 4 20:42:03 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:42:03.948449 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-d976aa0b-6ada-445f-9e39-e8f470cc50f0 tempest-FlavorsV2TestJSON-1606292848 tempest-FlavorsV2TestJSON-1606292848-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:03.970569 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-d976aa0b-6ada-445f-9e39-e8f470cc50f0 tempest-FlavorsV2TestJSON-1606292848 tempest-FlavorsV2TestJSON-1606292848-project] 10.222.0.33 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.026363 Oct 04 20:42:03.973561 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1062/2063] 10.222.0.33 () {58 vars in 1137 bytes} [Tue Oct 4 20:42:03 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:42:04.001933 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-ec66ce02-148a-44b1-a710-4343d46dc623 tempest-FlavorsV2TestJSON-1606292848 tempest-FlavorsV2TestJSON-1606292848-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:04.137615 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-ec66ce02-148a-44b1-a710-4343d46dc623 tempest-FlavorsV2TestJSON-1606292848 tempest-FlavorsV2TestJSON-1606292848-project] 10.222.0.33 "GET /compute/v2.1/flavors/detail?minDisk=2" status: 200 len: 3209 microversion: 2.1 time: 0.148764 Oct 04 20:42:04.138587 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1063/2064] 10.222.0.33 () {58 vars in 1165 bytes} [Tue Oct 4 20:42:03 2022] GET /compute/v2.1/flavors/detail?minDisk=2 => generated 3209 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:42:04.195461 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-c4ac7796-79bb-408e-8613-80e7afa8b69f tempest-FlavorsV2TestJSON-1606292848 tempest-FlavorsV2TestJSON-1606292848-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:04.222633 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-c4ac7796-79bb-408e-8613-80e7afa8b69f tempest-FlavorsV2TestJSON-1606292848 tempest-FlavorsV2TestJSON-1606292848-project] 10.222.0.33 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.043868 Oct 04 20:42:04.230973 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1064/2065] 10.222.0.33 () {58 vars in 1137 bytes} [Tue Oct 4 20:42:04 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:42:04.251138 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-25ba3b6f-2fe5-458c-9a65-7809b31f5b30 tempest-FlavorsV2TestJSON-1606292848 tempest-FlavorsV2TestJSON-1606292848-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:04.335571 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-25ba3b6f-2fe5-458c-9a65-7809b31f5b30 tempest-FlavorsV2TestJSON-1606292848 tempest-FlavorsV2TestJSON-1606292848-project] 10.222.0.33 "GET /compute/v2.1/flavors/detail?minRam=1025" status: 200 len: 2145 microversion: 2.1 time: 0.096811 Oct 04 20:42:04.339132 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1065/2066] 10.222.0.33 () {58 vars in 1169 bytes} [Tue Oct 4 20:42:04 2022] GET /compute/v2.1/flavors/detail?minRam=1025 => generated 2145 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:42:04.356853 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-89d16a37-7f6b-4cb5-a630-c041808b91a8 tempest-FlavorsV2TestJSON-1606292848 tempest-FlavorsV2TestJSON-1606292848-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:04.429555 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-89d16a37-7f6b-4cb5-a630-c041808b91a8 tempest-FlavorsV2TestJSON-1606292848 tempest-FlavorsV2TestJSON-1606292848-project] 10.222.0.33 "GET /compute/v2.1/flavors/detail?limit=1" status: 200 len: 476 microversion: 2.1 time: 0.076737 Oct 04 20:42:04.440330 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1066/2067] 10.222.0.33 () {58 vars in 1161 bytes} [Tue Oct 4 20:42:04 2022] GET /compute/v2.1/flavors/detail?limit=1 => generated 476 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 20:42:04.454928 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-4cf3bfab-06a7-4c1e-b367-bf837e3b67f9 tempest-FlavorsV2TestJSON-1606292848 tempest-FlavorsV2TestJSON-1606292848-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:04.486132 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-4cf3bfab-06a7-4c1e-b367-bf837e3b67f9 tempest-FlavorsV2TestJSON-1606292848 tempest-FlavorsV2TestJSON-1606292848-project] 10.222.0.33 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.041979 Oct 04 20:42:04.493149 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1067/2068] 10.222.0.33 () {58 vars in 1137 bytes} [Tue Oct 4 20:42:04 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:42:04.659681 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-293d81e4-a47f-43cd-9a9d-0124543e7447 tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSONUnderV235-server-88035990", "imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:42:04.667496 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-0fb83916-a41c-4b21-9b3b-9e02d20b8b85 tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] Lazy-loading 'services' on Instance uuid 8f1e4990-6f32-426c-bdea-ce2007c37a6f {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:42:04.725772 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-0fb83916-a41c-4b21-9b3b-9e02d20b8b85 tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/8f1e4990-6f32-426c-bdea-ce2007c37a6f" status: 200 len: 1967 microversion: 2.25 time: 0.969731 Oct 04 20:42:04.759235 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1002/2069] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:42:03 2022] GET /compute/v2.1/servers/8f1e4990-6f32-426c-bdea-ce2007c37a6f => generated 1967 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:42:04.771259 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8f773f57-a6f8-44dc-a468-88358ed3ba9f tempest-FlavorsV2TestJSON-1606292848 tempest-FlavorsV2TestJSON-1606292848-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:04.813003 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.network.neutron [None req-293d81e4-a47f-43cd-9a9d-0124543e7447 tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] validate_networks() for [('acfc8820-ee09-4a6a-92bb-7ee4a63b93f8', None, None, None, None, None)] {{(pid=128802) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:42:04.918210 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-8f773f57-a6f8-44dc-a468-88358ed3ba9f tempest-FlavorsV2TestJSON-1606292848 tempest-FlavorsV2TestJSON-1606292848-project] 10.222.0.33 "GET /compute/v2.1/flavors/detail?marker=452" status: 200 len: 2500 microversion: 2.1 time: 0.156743 Oct 04 20:42:04.934137 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1003/2070] 10.222.0.33 () {58 vars in 1167 bytes} [Tue Oct 4 20:42:04 2022] GET /compute/v2.1/flavors/detail?marker=452 => generated 2500 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:42:04.940639 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ebae2031-fc3c-4513-b285-bd7fb90c5706 tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:04.946218 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ebae2031-fc3c-4513-b285-bd7fb90c5706 tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:04.947137 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ebae2031-fc3c-4513-b285-bd7fb90c5706 tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:04.947988 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ebae2031-fc3c-4513-b285-bd7fb90c5706 tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:04.948954 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ebae2031-fc3c-4513-b285-bd7fb90c5706 tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:04.949604 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ebae2031-fc3c-4513-b285-bd7fb90c5706 tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:04.950319 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ebae2031-fc3c-4513-b285-bd7fb90c5706 tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:04.966478 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=100 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:42:04.985241 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ebae2031-fc3c-4513-b285-bd7fb90c5706 tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.049101 Oct 04 20:42:04.986775 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1004/2071] 10.222.0.33 () {60 vars in 1217 bytes} [Tue Oct 4 20:42:04 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 20:42:04.994581 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0386b5c2-575b-45d6-8226-beee38e87677 tempest-FlavorsV2TestJSON-1606292848 tempest-FlavorsV2TestJSON-1606292848-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:05.004065 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-0386b5c2-575b-45d6-8226-beee38e87677 tempest-FlavorsV2TestJSON-1606292848 tempest-FlavorsV2TestJSON-1606292848-project] 10.222.0.33 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.015349 Oct 04 20:42:05.015347 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1005/2072] 10.222.0.33 () {58 vars in 1137 bytes} [Tue Oct 4 20:42:04 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:42:05.034787 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-76978fe5-a94f-451b-b04d-d2f1383bb388 tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-854823-8", "block_migration": "auto"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:42:05.038467 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-76978fe5-a94f-451b-b04d-d2f1383bb388 tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] [instance: 8f1e4990-6f32-426c-bdea-ce2007c37a6f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:42:05.067091 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-76978fe5-a94f-451b-b04d-d2f1383bb388 tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:05.067923 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-76978fe5-a94f-451b-b04d-d2f1383bb388 tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:05.068594 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-76978fe5-a94f-451b-b04d-d2f1383bb388 tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:05.071360 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-76978fe5-a94f-451b-b04d-d2f1383bb388 tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:05.072061 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-76978fe5-a94f-451b-b04d-d2f1383bb388 tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:05.072719 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-76978fe5-a94f-451b-b04d-d2f1383bb388 tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:05.138319 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-76978fe5-a94f-451b-b04d-d2f1383bb388 tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] Lazy-loading 'flavor' on Instance uuid 8f1e4990-6f32-426c-bdea-ce2007c37a6f {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:42:05.196621 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-76978fe5-a94f-451b-b04d-d2f1383bb388 tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] [instance: 8f1e4990-6f32-426c-bdea-ce2007c37a6f] Going to try to live migrate instance to n-h2-854823-8 {{(pid=128801) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 04 20:42:06.238687 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-293d81e4-a47f-43cd-9a9d-0124543e7447 tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Flavor limits 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:42:06.240662 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-293d81e4-a47f-43cd-9a9d-0124543e7447 tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Image limits 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:42:06.242632 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-293d81e4-a47f-43cd-9a9d-0124543e7447 tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Flavor pref 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:42:06.243320 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-293d81e4-a47f-43cd-9a9d-0124543e7447 tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Image pref 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:42:06.244034 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-293d81e4-a47f-43cd-9a9d-0124543e7447 tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:42:06.288276 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-293d81e4-a47f-43cd-9a9d-0124543e7447 tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:06.290984 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-293d81e4-a47f-43cd-9a9d-0124543e7447 tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:06.293099 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-293d81e4-a47f-43cd-9a9d-0124543e7447 tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:06.296756 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-293d81e4-a47f-43cd-9a9d-0124543e7447 tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:06.302358 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-293d81e4-a47f-43cd-9a9d-0124543e7447 tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:06.303970 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-293d81e4-a47f-43cd-9a9d-0124543e7447 tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:06.407314 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-293d81e4-a47f-43cd-9a9d-0124543e7447 tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Getting quotas for project c99c97de335941a4af0f09c695ab3a43. Resources: {'ram', 'instances', 'cores'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:42:06.432318 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-293d81e4-a47f-43cd-9a9d-0124543e7447 tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Getting quotas for user 73345e7aa3ec490e9266cf356dc442ce and project c99c97de335941a4af0f09c695ab3a43. Resources: {'ram', 'instances', 'cores'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:42:06.451924 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-293d81e4-a47f-43cd-9a9d-0124543e7447 tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Going to run 1 instances... {{(pid=128802) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:42:06.456403 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-293d81e4-a47f-43cd-9a9d-0124543e7447 tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] [instance: c806a6c6-6b03-4b6e-9247-75b8541ce9b4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='15b24725-0c99-4bcf-b1fb-907cdf8e2d63',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128802) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:42:06.579131 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-293d81e4-a47f-43cd-9a9d-0124543e7447 tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.074092 Oct 04 20:42:06.600690 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1068/2073] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 20:42:04 2022] POST /compute/v2.1/servers => generated 383 bytes in 2096 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 20:42:06.605816 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-c0c98710-a024-452f-9141-2fa574edf035 tempest-FlavorsV2TestJSON-1606292848 tempest-FlavorsV2TestJSON-1606292848-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:06.665293 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-c0c98710-a024-452f-9141-2fa574edf035 tempest-FlavorsV2TestJSON-1606292848 tempest-FlavorsV2TestJSON-1606292848-project] 10.222.0.33 "GET /compute/v2.1/flavors?minDisk=2" status: 200 len: 1663 microversion: 2.1 time: 0.063343 Oct 04 20:42:06.676751 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1069/2074] 10.222.0.33 () {58 vars in 1144 bytes} [Tue Oct 4 20:42:06 2022] GET /compute/v2.1/flavors?minDisk=2 => generated 1663 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:42:07.348341 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-666e2d2b-6b8e-4955-be46-6e36ccd7ad60 tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] Action: 'create', calling method: .version_select at 0x7f3c7428bd30>, body: {"keypair": {"name": "tempest-keypair-1101435304", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIqZmoE79X6PLvFdJ9yfl3oHuXzxNRgxsIDL6rS9gE7cmrNURNQOrnf+NKIzHFCrW34M3U7OiK95B4YIbK13yMdTqlOzi0N0hJ9/ccPODqARHsz85uzXc7CVA3kJNTQigQ=="}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:42:07.388197 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-666e2d2b-6b8e-4955-be46-6e36ccd7ad60 tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] Getting quotas for project 6d7a1e525a85411ca2ce2bce1638b463. Resources: {'key_pairs'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:42:07.399764 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-666e2d2b-6b8e-4955-be46-6e36ccd7ad60 tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] Getting quotas for user 4dd8aa669e8847a3848a723c7890ef98 and project 6d7a1e525a85411ca2ce2bce1638b463. Resources: {'key_pairs'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:42:07.479645 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-666e2d2b-6b8e-4955-be46-6e36ccd7ad60 tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.786721 Oct 04 20:42:07.487054 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1070/2075] 10.222.0.33 () {60 vars in 1159 bytes} [Tue Oct 4 20:42:06 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:42:07.502082 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-ca20dd27-f0cc-4e3a-ae59-f49e16c720e8 tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:07.504749 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-ca20dd27-f0cc-4e3a-ae59-f49e16c720e8 tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] [instance: c806a6c6-6b03-4b6e-9247-75b8541ce9b4] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:42:07.630906 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-ca20dd27-f0cc-4e3a-ae59-f49e16c720e8 tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73345e7aa3ec490e9266cf356dc442ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99c97de335941a4af0f09c695ab3a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:42:07.640913 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-ca20dd27-f0cc-4e3a-ae59-f49e16c720e8 tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] 10.222.0.33 "GET /compute/v2.1/servers/c806a6c6-6b03-4b6e-9247-75b8541ce9b4" status: 200 len: 1221 microversion: 2.1 time: 0.151557 Oct 04 20:42:07.643875 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1071/2076] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:42:07 2022] GET /compute/v2.1/servers/c806a6c6-6b03-4b6e-9247-75b8541ce9b4 => generated 1221 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:42:07.674623 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-c308da6e-d841-4d64-b548-20371da7c964 tempest-FlavorsV2TestJSON-1606292848 tempest-FlavorsV2TestJSON-1606292848-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:07.697284 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-c308da6e-d841-4d64-b548-20371da7c964 tempest-FlavorsV2TestJSON-1606292848 tempest-FlavorsV2TestJSON-1606292848-project] 10.222.0.33 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.035465 Oct 04 20:42:07.707508 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1072/2077] 10.222.0.33 () {58 vars in 1137 bytes} [Tue Oct 4 20:42:07 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:42:07.721004 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-8edbd90a-5128-402b-8b42-9cfbd508217e tempest-FlavorsV2TestJSON-1606292848 tempest-FlavorsV2TestJSON-1606292848-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:07.761491 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-8edbd90a-5128-402b-8b42-9cfbd508217e tempest-FlavorsV2TestJSON-1606292848 tempest-FlavorsV2TestJSON-1606292848-project] 10.222.0.33 "GET /compute/v2.1/flavors?minRam=1025" status: 200 len: 1111 microversion: 2.1 time: 0.051537 Oct 04 20:42:07.776630 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1073/2078] 10.222.0.33 () {58 vars in 1148 bytes} [Tue Oct 4 20:42:07 2022] GET /compute/v2.1/flavors?minRam=1025 => generated 1111 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:42:07.788783 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-57ca566a-bca9-4044-bb72-3a623f3416dd tempest-FlavorsV2TestJSON-1606292848 tempest-FlavorsV2TestJSON-1606292848-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:07.817492 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-57ca566a-bca9-4044-bb72-3a623f3416dd tempest-FlavorsV2TestJSON-1606292848 tempest-FlavorsV2TestJSON-1606292848-project] 10.222.0.33 "GET /compute/v2.1/flavors?limit=1" status: 200 len: 299 microversion: 2.1 time: 0.039664 Oct 04 20:42:07.818274 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1074/2079] 10.222.0.33 () {58 vars in 1140 bytes} [Tue Oct 4 20:42:07 2022] GET /compute/v2.1/flavors?limit=1 => generated 299 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:42:07.846096 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-37a8ac59-68f1-4805-a329-e6ae4c9692d5 tempest-FlavorsV2TestJSON-1606292848 tempest-FlavorsV2TestJSON-1606292848-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:07.865991 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-37a8ac59-68f1-4805-a329-e6ae4c9692d5 tempest-FlavorsV2TestJSON-1606292848 tempest-FlavorsV2TestJSON-1606292848-project] 10.222.0.33 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.031311 Oct 04 20:42:07.877079 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1075/2080] 10.222.0.33 () {58 vars in 1137 bytes} [Tue Oct 4 20:42:07 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:42:07.886578 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-2ccc58e3-5ebd-49e3-be54-d4a33f59d839 tempest-FlavorsV2TestJSON-1606292848 tempest-FlavorsV2TestJSON-1606292848-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:07.974243 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-2ccc58e3-5ebd-49e3-be54-d4a33f59d839 tempest-FlavorsV2TestJSON-1606292848 tempest-FlavorsV2TestJSON-1606292848-project] 10.222.0.33 "GET /compute/v2.1/flavors?marker=452" status: 200 len: 1300 microversion: 2.1 time: 0.095893 Oct 04 20:42:07.979323 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1076/2081] 10.222.0.33 () {58 vars in 1146 bytes} [Tue Oct 4 20:42:07 2022] GET /compute/v2.1/flavors?marker=452 => generated 1300 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:42:08.003460 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-bdc92d96-7c0e-46b5-aad8-74ac4f5e929e tempest-FlavorsV2TestJSON-1606292848 tempest-FlavorsV2TestJSON-1606292848-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:08.106405 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-bdc92d96-7c0e-46b5-aad8-74ac4f5e929e tempest-FlavorsV2TestJSON-1606292848 tempest-FlavorsV2TestJSON-1606292848-project] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.113868 Oct 04 20:42:08.107028 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1077/2082] 10.222.0.33 () {58 vars in 1146 bytes} [Tue Oct 4 20:42:07 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:42:08.136737 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-ab56af6a-07af-440a-94e6-3bbf81691937 tempest-FlavorsV2TestJSON-1606292848 tempest-FlavorsV2TestJSON-1606292848-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:08.162733 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-ab56af6a-07af-440a-94e6-3bbf81691937 tempest-FlavorsV2TestJSON-1606292848 tempest-FlavorsV2TestJSON-1606292848-project] 10.222.0.33 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.033669 Oct 04 20:42:08.163500 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1078/2083] 10.222.0.33 () {58 vars in 1137 bytes} [Tue Oct 4 20:42:08 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:42:08.672620 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-ae01e8a1-b070-4fd4-bd3a-cd3934bf0e5a tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:08.673432 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-ae01e8a1-b070-4fd4-bd3a-cd3934bf0e5a tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] [instance: c806a6c6-6b03-4b6e-9247-75b8541ce9b4] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:42:08.714789 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ae01e8a1-b070-4fd4-bd3a-cd3934bf0e5a tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:08.716261 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ae01e8a1-b070-4fd4-bd3a-cd3934bf0e5a tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:08.718936 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ae01e8a1-b070-4fd4-bd3a-cd3934bf0e5a tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:08.722521 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ae01e8a1-b070-4fd4-bd3a-cd3934bf0e5a tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:08.724327 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ae01e8a1-b070-4fd4-bd3a-cd3934bf0e5a tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:08.724767 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ae01e8a1-b070-4fd4-bd3a-cd3934bf0e5a tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:08.881440 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-ae01e8a1-b070-4fd4-bd3a-cd3934bf0e5a tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73345e7aa3ec490e9266cf356dc442ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99c97de335941a4af0f09c695ab3a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:42:08.899710 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-ae01e8a1-b070-4fd4-bd3a-cd3934bf0e5a tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] 10.222.0.33 "GET /compute/v2.1/servers/c806a6c6-6b03-4b6e-9247-75b8541ce9b4" status: 200 len: 1273 microversion: 2.1 time: 0.228471 Oct 04 20:42:08.901892 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1079/2084] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:42:08 2022] GET /compute/v2.1/servers/c806a6c6-6b03-4b6e-9247-75b8541ce9b4 => generated 1273 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:42:09.860684 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-76978fe5-a94f-451b-b04d-d2f1383bb388 tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/8f1e4990-6f32-426c-bdea-ce2007c37a6f/action" status: 202 len: 0 microversion: 2.25 time: 4.840850 Oct 04 20:42:09.861461 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1006/2085] 10.222.0.33 () {62 vars in 1319 bytes} [Tue Oct 4 20:42:05 2022] POST /compute/v2.1/servers/8f1e4990-6f32-426c-bdea-ce2007c37a6f/action => generated 0 bytes in 4845 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:42:09.871787 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-1d15c307-f98c-4f40-b410-b1f993698b55 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:09.872619 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-1d15c307-f98c-4f40-b410-b1f993698b55 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] [instance: 8f1e4990-6f32-426c-bdea-ce2007c37a6f] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:42:09.887221 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1d15c307-f98c-4f40-b410-b1f993698b55 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:09.888007 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1d15c307-f98c-4f40-b410-b1f993698b55 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:09.892088 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1d15c307-f98c-4f40-b410-b1f993698b55 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:09.893154 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1d15c307-f98c-4f40-b410-b1f993698b55 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:09.894737 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1d15c307-f98c-4f40-b410-b1f993698b55 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:09.895528 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1d15c307-f98c-4f40-b410-b1f993698b55 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:09.928987 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-02c5bac7-5161-45bc-8fcc-1150ff0dca82 tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:09.931395 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-02c5bac7-5161-45bc-8fcc-1150ff0dca82 tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] [instance: c806a6c6-6b03-4b6e-9247-75b8541ce9b4] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:42:09.970653 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=75 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:42:09.987226 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-02c5bac7-5161-45bc-8fcc-1150ff0dca82 tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:09.987796 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-02c5bac7-5161-45bc-8fcc-1150ff0dca82 tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:09.995671 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-02c5bac7-5161-45bc-8fcc-1150ff0dca82 tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:09.997258 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-02c5bac7-5161-45bc-8fcc-1150ff0dca82 tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:10.001906 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-02c5bac7-5161-45bc-8fcc-1150ff0dca82 tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:10.003483 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-02c5bac7-5161-45bc-8fcc-1150ff0dca82 tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:10.536808 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-02c5bac7-5161-45bc-8fcc-1150ff0dca82 tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73345e7aa3ec490e9266cf356dc442ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99c97de335941a4af0f09c695ab3a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:42:10.550094 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-02c5bac7-5161-45bc-8fcc-1150ff0dca82 tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] 10.222.0.33 "GET /compute/v2.1/servers/c806a6c6-6b03-4b6e-9247-75b8541ce9b4" status: 200 len: 1279 microversion: 2.1 time: 0.629593 Oct 04 20:42:10.552786 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1007/2086] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:42:09 2022] GET /compute/v2.1/servers/c806a6c6-6b03-4b6e-9247-75b8541ce9b4 => generated 1279 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:42:10.845774 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-1d15c307-f98c-4f40-b410-b1f993698b55 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:42:10.868337 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-1d15c307-f98c-4f40-b410-b1f993698b55 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:42:10.875050 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-1d15c307-f98c-4f40-b410-b1f993698b55 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:42:10.876292 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-1d15c307-f98c-4f40-b410-b1f993698b55 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] 10.222.0.33 "GET /compute/v2.1/servers/8f1e4990-6f32-426c-bdea-ce2007c37a6f" status: 200 len: 1485 microversion: 2.25 time: 1.010439 Oct 04 20:42:10.876876 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1080/2087] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:42:09 2022] GET /compute/v2.1/servers/8f1e4990-6f32-426c-bdea-ce2007c37a6f => generated 1485 bytes in 1012 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:42:11.102272 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d67cd106-830d-4935-80d5-afb1d78120a9 tempest-ListImageFiltersNegativeTestJSON-294384624 tempest-ListImageFiltersNegativeTestJSON-294384624-project] Calling method '.version_select at 0x7f3c788bb040>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:11.176098 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-d67cd106-830d-4935-80d5-afb1d78120a9 tempest-ListImageFiltersNegativeTestJSON-294384624 tempest-ListImageFiltersNegativeTestJSON-294384624-project] HTTP exception thrown: Image not found. Oct 04 20:42:11.182302 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d67cd106-830d-4935-80d5-afb1d78120a9 tempest-ListImageFiltersNegativeTestJSON-294384624 tempest-ListImageFiltersNegativeTestJSON-294384624-project] Request method failure captured: Oct 04 20:42:11.182302 n-d-854823-8 devstack@n-api.service[128801]: request: GET /compute/v2.1/images/81717bef-d5d8-4da4-91ac-e969eac5ee7e HTTP/1.1 Oct 04 20:42:11.182302 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:42:11.182302 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:42:11.182302 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:42:11.182302 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 0 Oct 04 20:42:11.182302 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:42:11.182302 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:42:11.182302 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:42:11.182302 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:42:11.182302 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJqhtMBj7QpGf4slMf3UTzoubJ035axAdcMo3CF9DdTocbRSCR8ERbkj6T2SO9iWrZSY1hG3GnqkwcDo15QQLXDMTpURcd5ylblz-B3Qeodh_G_8xzTtdgnEi5AQSvHnbM4jbFcxYbPSCjx75RVFDqvDuV-Wqj0fV1vVWSrfxJzWU2E Oct 04 20:42:11.182302 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:42:11.182302 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:42:11.182302 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:42:11.182302 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:42:11.182302 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:42:11.182302 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:42:11.182302 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: 2aa5572ef611460786d8668c5696fbe8 Oct 04 20:42:11.182302 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-ListImageFiltersNegativeTestJSON-294384624 Oct 04 20:42:11.182302 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 20:42:11.182302 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 20:42:11.182302 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_2aa5572ef611460786d8668c5696fbe8", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2aa5572ef611460786d8668c5696fbe8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2aa5572ef611460786d8668c5696fbe8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/2aa5572ef611460786d8668c5696fbe8"}]}] Oct 04 20:42:11.182302 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-ListImageFiltersNegativeTestJSON-294384624 Oct 04 20:42:11.182302 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: 2aa5572ef611460786d8668c5696fbe8 Oct 04 20:42:11.182302 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ListImageFiltersNegativeTestJSON-294384624 Oct 04 20:42:11.182302 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-ListImageFiltersNegativeTestJSON-294384624-project Oct 04 20:42:11.182302 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:42:11.182302 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:42:11.182302 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: 171d378d6b2647d9bb1a960305731abd Oct 04 20:42:11.182302 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-ListImageFiltersNegativeTestJSON-294384624-project Oct 04 20:42:11.182302 n-d-854823-8 devstack@n-api.service[128801]: method: Oct 04 20:42:11.182302 n-d-854823-8 devstack@n-api.service[128801]: exception: Image not found. Oct 04 20:42:11.182302 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': '81717bef-d5d8-4da4-91ac-e969eac5ee7e'} Oct 04 20:42:11.182302 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:42:11.182302 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:42:11.182302 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 20:42:11.182302 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 20:42:11.182302 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 20:42:11.182302 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 20:42:11.182302 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 20:42:11.182302 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 20:42:11.182302 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 20:42:11.182302 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 20:42:11.182302 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 20:42:11.182302 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 20:42:11.182302 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 20:42:11.182302 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 20:42:11.182302 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 20:42:11.182302 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 20:42:11.182302 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 20:42:11.182302 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 20:42:11.182302 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 81717bef-d5d8-4da4-91ac-e969eac5ee7e Oct 04 20:42:11.182302 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:42:11.182302 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:42:11.182302 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:42:11.182302 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:42:11.182302 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 04 20:42:11.182302 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 04 20:42:11.182302 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 04 20:42:11.182302 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 04 20:42:11.182302 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 04 20:42:11.182302 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 04 20:42:11.182302 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 04 20:42:11.185395 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 04 20:42:11.185395 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 20:42:11.185395 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 20:42:11.185395 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 20:42:11.185395 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 20:42:11.185395 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 20:42:11.185395 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 20:42:11.185395 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 20:42:11.185395 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 20:42:11.185395 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 20:42:11.185395 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 20:42:11.185395 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 20:42:11.185395 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 20:42:11.185395 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 20:42:11.185395 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 20:42:11.185395 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 20:42:11.185395 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 20:42:11.185395 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 81717bef-d5d8-4da4-91ac-e969eac5ee7e could not be found. Oct 04 20:42:11.185395 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:42:11.185395 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:42:11.185395 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:42:11.185395 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:42:11.185395 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:42:11.185395 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:42:11.185395 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:42:11.185395 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:42:11.185395 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:42:11.185395 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:42:11.185395 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:42:11.185395 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:42:11.185395 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 04 20:42:11.185395 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 04 20:42:11.185395 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 20:42:11.185395 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:42:11.185395 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:42:11.185395 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:42:11.185395 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:42:11.185395 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:42:11.185395 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:42:11.185395 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:42:11.185395 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:42:11.185395 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 20:42:11.185395 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:42:11.190577 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d67cd106-830d-4935-80d5-afb1d78120a9 tempest-ListImageFiltersNegativeTestJSON-294384624 tempest-ListImageFiltersNegativeTestJSON-294384624-project] Returning 404 to user: Image not found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:42:11.191698 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d67cd106-830d-4935-80d5-afb1d78120a9 tempest-ListImageFiltersNegativeTestJSON-294384624 tempest-ListImageFiltersNegativeTestJSON-294384624-project] 10.222.0.33 "GET /compute/v2.1/images/81717bef-d5d8-4da4-91ac-e969eac5ee7e" status: 404 len: 62 microversion: 2.1 time: 0.637477 Oct 04 20:42:11.192479 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1008/2088] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 20:42:10 2022] GET /compute/v2.1/images/81717bef-d5d8-4da4-91ac-e969eac5ee7e => generated 62 bytes in 639 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 20:42:11.584706 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-fcd1b9ed-75d9-4f34-8fe8-113e869e9bf2 tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:11.585949 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-fcd1b9ed-75d9-4f34-8fe8-113e869e9bf2 tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] [instance: c806a6c6-6b03-4b6e-9247-75b8541ce9b4] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:42:11.607849 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fcd1b9ed-75d9-4f34-8fe8-113e869e9bf2 tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:11.611731 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fcd1b9ed-75d9-4f34-8fe8-113e869e9bf2 tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:11.616216 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fcd1b9ed-75d9-4f34-8fe8-113e869e9bf2 tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:11.620349 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fcd1b9ed-75d9-4f34-8fe8-113e869e9bf2 tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:11.623023 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fcd1b9ed-75d9-4f34-8fe8-113e869e9bf2 tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:11.624366 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fcd1b9ed-75d9-4f34-8fe8-113e869e9bf2 tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:11.909924 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6670907a-a0f3-4f62-81b9-76db2aecfc16 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:11.910749 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-6670907a-a0f3-4f62-81b9-76db2aecfc16 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] [instance: 8f1e4990-6f32-426c-bdea-ce2007c37a6f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:42:11.955223 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6670907a-a0f3-4f62-81b9-76db2aecfc16 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:11.959095 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6670907a-a0f3-4f62-81b9-76db2aecfc16 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:11.959882 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6670907a-a0f3-4f62-81b9-76db2aecfc16 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:11.963384 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6670907a-a0f3-4f62-81b9-76db2aecfc16 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:11.971671 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6670907a-a0f3-4f62-81b9-76db2aecfc16 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:11.973165 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6670907a-a0f3-4f62-81b9-76db2aecfc16 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:12.681773 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-fcd1b9ed-75d9-4f34-8fe8-113e869e9bf2 tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73345e7aa3ec490e9266cf356dc442ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99c97de335941a4af0f09c695ab3a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:42:12.691983 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-fcd1b9ed-75d9-4f34-8fe8-113e869e9bf2 tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] 10.222.0.33 "GET /compute/v2.1/servers/c806a6c6-6b03-4b6e-9247-75b8541ce9b4" status: 200 len: 1321 microversion: 2.1 time: 1.113154 Oct 04 20:42:12.698133 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1081/2089] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:42:11 2022] GET /compute/v2.1/servers/c806a6c6-6b03-4b6e-9247-75b8541ce9b4 => generated 1321 bytes in 1120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:42:12.707482 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-6670907a-a0f3-4f62-81b9-76db2aecfc16 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:42:12.730420 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-6670907a-a0f3-4f62-81b9-76db2aecfc16 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:42:12.739110 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-6670907a-a0f3-4f62-81b9-76db2aecfc16 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:42:12.745051 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-6670907a-a0f3-4f62-81b9-76db2aecfc16 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] 10.222.0.33 "GET /compute/v2.1/servers/8f1e4990-6f32-426c-bdea-ce2007c37a6f" status: 200 len: 1485 microversion: 2.25 time: 0.839260 Oct 04 20:42:12.747080 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1009/2090] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:42:11 2022] GET /compute/v2.1/servers/8f1e4990-6f32-426c-bdea-ce2007c37a6f => generated 1485 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 20:42:13.726760 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-34afd2cb-520d-4961-ab33-50193ae2fb10 tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:13.727422 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-34afd2cb-520d-4961-ab33-50193ae2fb10 tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] [instance: c806a6c6-6b03-4b6e-9247-75b8541ce9b4] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:42:13.752401 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-34afd2cb-520d-4961-ab33-50193ae2fb10 tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:13.756362 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-34afd2cb-520d-4961-ab33-50193ae2fb10 tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:13.761113 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-34afd2cb-520d-4961-ab33-50193ae2fb10 tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:13.762177 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-34afd2cb-520d-4961-ab33-50193ae2fb10 tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:13.762695 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-34afd2cb-520d-4961-ab33-50193ae2fb10 tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:13.763134 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-34afd2cb-520d-4961-ab33-50193ae2fb10 tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:13.779371 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-bf95c679-9475-46ff-8a0a-77bb60e39d5d tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:13.781437 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-bf95c679-9475-46ff-8a0a-77bb60e39d5d tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] [instance: 8f1e4990-6f32-426c-bdea-ce2007c37a6f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:42:13.798332 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bf95c679-9475-46ff-8a0a-77bb60e39d5d tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:13.800179 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bf95c679-9475-46ff-8a0a-77bb60e39d5d tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:13.803087 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bf95c679-9475-46ff-8a0a-77bb60e39d5d tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:13.805847 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bf95c679-9475-46ff-8a0a-77bb60e39d5d tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:13.810636 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bf95c679-9475-46ff-8a0a-77bb60e39d5d tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:13.812549 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bf95c679-9475-46ff-8a0a-77bb60e39d5d tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:14.749192 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-bf95c679-9475-46ff-8a0a-77bb60e39d5d tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:42:14.762531 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-bf95c679-9475-46ff-8a0a-77bb60e39d5d tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:42:14.766995 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-bf95c679-9475-46ff-8a0a-77bb60e39d5d tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:42:14.769790 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-bf95c679-9475-46ff-8a0a-77bb60e39d5d tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] 10.222.0.33 "GET /compute/v2.1/servers/8f1e4990-6f32-426c-bdea-ce2007c37a6f" status: 200 len: 1485 microversion: 2.25 time: 0.995064 Oct 04 20:42:14.771388 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1010/2091] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:42:13 2022] GET /compute/v2.1/servers/8f1e4990-6f32-426c-bdea-ce2007c37a6f => generated 1485 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 20:42:14.827968 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-34afd2cb-520d-4961-ab33-50193ae2fb10 tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73345e7aa3ec490e9266cf356dc442ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99c97de335941a4af0f09c695ab3a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:42:14.843983 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-34afd2cb-520d-4961-ab33-50193ae2fb10 tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] 10.222.0.33 "GET /compute/v2.1/servers/c806a6c6-6b03-4b6e-9247-75b8541ce9b4" status: 200 len: 1321 microversion: 2.1 time: 1.123806 Oct 04 20:42:14.845005 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1082/2092] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:42:13 2022] GET /compute/v2.1/servers/c806a6c6-6b03-4b6e-9247-75b8541ce9b4 => generated 1321 bytes in 1128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:42:15.420419 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-4c619792-3474-4fcd-90c8-543946a3a989 req-0ca959e4-8e28-4460-88a7-ff3656738a4e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c806a6c6-6b03-4b6e-9247-75b8541ce9b4", "tag": "059512bd-a604-4d49-978d-ee2246b9e518"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:42:15.436239 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:42:15.454724 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-4c619792-3474-4fcd-90c8-543946a3a989 req-0ca959e4-8e28-4460-88a7-ff3656738a4e service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:15.457474 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-4c619792-3474-4fcd-90c8-543946a3a989 req-0ca959e4-8e28-4460-88a7-ff3656738a4e service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:15.459734 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-4c619792-3474-4fcd-90c8-543946a3a989 req-0ca959e4-8e28-4460-88a7-ff3656738a4e service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:15.526552 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-4c619792-3474-4fcd-90c8-543946a3a989 req-0ca959e4-8e28-4460-88a7-ff3656738a4e service nova] Creating event network-changed:059512bd-a604-4d49-978d-ee2246b9e518 for instance c806a6c6-6b03-4b6e-9247-75b8541ce9b4 on n-h2-854823-8 Oct 04 20:42:15.544050 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-4c619792-3474-4fcd-90c8-543946a3a989 req-0ca959e4-8e28-4460-88a7-ff3656738a4e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.129331 Oct 04 20:42:15.550139 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1011/2093] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:42:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:42:15.648832 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-2d9239a7-b274-4888-8afc-edbbb42542ab tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-2022344526", "imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "874e03fd-529d-42a0-84bc-f4a31a3cd9d5"}], "security_groups": [{"name": "tempest-securitygroup--2057951401"}], "key_name": "tempest-keypair-1101435304", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:42:15.680969 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:42:15.803359 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ca16da04-a497-4178-82ac-087da4fe7136 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:15.804402 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ca16da04-a497-4178-82ac-087da4fe7136 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] [instance: 8f1e4990-6f32-426c-bdea-ce2007c37a6f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:42:15.817019 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ca16da04-a497-4178-82ac-087da4fe7136 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:15.819443 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ca16da04-a497-4178-82ac-087da4fe7136 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:15.822949 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ca16da04-a497-4178-82ac-087da4fe7136 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:15.827930 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ca16da04-a497-4178-82ac-087da4fe7136 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:15.828674 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ca16da04-a497-4178-82ac-087da4fe7136 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:15.829416 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ca16da04-a497-4178-82ac-087da4fe7136 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:16.252797 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.network.neutron [None req-2d9239a7-b274-4888-8afc-edbbb42542ab tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] validate_networks() for [('874e03fd-529d-42a0-84bc-f4a31a3cd9d5', None, None, None, None, None)] {{(pid=128802) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:42:16.370707 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell0:SELECT=2 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:42:16.969921 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-ca16da04-a497-4178-82ac-087da4fe7136 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:42:16.982525 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-ca16da04-a497-4178-82ac-087da4fe7136 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:42:16.985380 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-ca16da04-a497-4178-82ac-087da4fe7136 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:42:16.986630 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ca16da04-a497-4178-82ac-087da4fe7136 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] 10.222.0.33 "GET /compute/v2.1/servers/8f1e4990-6f32-426c-bdea-ce2007c37a6f" status: 200 len: 1485 microversion: 2.25 time: 1.189464 Oct 04 20:42:17.011552 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1012/2094] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:42:15 2022] GET /compute/v2.1/servers/8f1e4990-6f32-426c-bdea-ce2007c37a6f => generated 1485 bytes in 1215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:42:17.031167 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e496d56e-1cc5-4a58-a0e8-c75db9cfcf7a tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:17.032183 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e496d56e-1cc5-4a58-a0e8-c75db9cfcf7a tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] [instance: c806a6c6-6b03-4b6e-9247-75b8541ce9b4] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:42:17.039224 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e496d56e-1cc5-4a58-a0e8-c75db9cfcf7a tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:17.039959 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e496d56e-1cc5-4a58-a0e8-c75db9cfcf7a tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:17.040671 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e496d56e-1cc5-4a58-a0e8-c75db9cfcf7a tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:17.041765 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e496d56e-1cc5-4a58-a0e8-c75db9cfcf7a tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:17.042392 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e496d56e-1cc5-4a58-a0e8-c75db9cfcf7a tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:17.047399 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e496d56e-1cc5-4a58-a0e8-c75db9cfcf7a tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:17.629833 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e496d56e-1cc5-4a58-a0e8-c75db9cfcf7a tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73345e7aa3ec490e9266cf356dc442ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99c97de335941a4af0f09c695ab3a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:42:17.649631 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell0:SELECT=12 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:42:17.652325 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e496d56e-1cc5-4a58-a0e8-c75db9cfcf7a tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] 10.222.0.33 "GET /compute/v2.1/servers/c806a6c6-6b03-4b6e-9247-75b8541ce9b4" status: 200 len: 1321 microversion: 2.1 time: 0.632504 Oct 04 20:42:17.659108 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1013/2095] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:42:17 2022] GET /compute/v2.1/servers/c806a6c6-6b03-4b6e-9247-75b8541ce9b4 => generated 1321 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:42:18.010095 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-602b96c5-ff79-4ffd-982c-cb0d171e70b5 tempest-AbsoluteLimitsTestJSON-1694600303 tempest-AbsoluteLimitsTestJSON-1694600303-project] Calling method '.version_select at 0x7f3c788ab040>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:18.049789 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-602b96c5-ff79-4ffd-982c-cb0d171e70b5 tempest-AbsoluteLimitsTestJSON-1694600303 tempest-AbsoluteLimitsTestJSON-1694600303-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:18.052722 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-602b96c5-ff79-4ffd-982c-cb0d171e70b5 tempest-AbsoluteLimitsTestJSON-1694600303 tempest-AbsoluteLimitsTestJSON-1694600303-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:18.053306 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-602b96c5-ff79-4ffd-982c-cb0d171e70b5 tempest-AbsoluteLimitsTestJSON-1694600303 tempest-AbsoluteLimitsTestJSON-1694600303-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:18.054231 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-602b96c5-ff79-4ffd-982c-cb0d171e70b5 tempest-AbsoluteLimitsTestJSON-1694600303 tempest-AbsoluteLimitsTestJSON-1694600303-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:18.056135 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-602b96c5-ff79-4ffd-982c-cb0d171e70b5 tempest-AbsoluteLimitsTestJSON-1694600303 tempest-AbsoluteLimitsTestJSON-1694600303-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:18.056692 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-602b96c5-ff79-4ffd-982c-cb0d171e70b5 tempest-AbsoluteLimitsTestJSON-1694600303 tempest-AbsoluteLimitsTestJSON-1694600303-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:18.119384 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-602b96c5-ff79-4ffd-982c-cb0d171e70b5 tempest-AbsoluteLimitsTestJSON-1694600303 tempest-AbsoluteLimitsTestJSON-1694600303-project] 10.222.0.33 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.458217 Oct 04 20:42:18.128546 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1014/2096] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 20:42:17 2022] GET /compute/v2.1/limits => generated 511 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:42:18.148625 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9aab9a74-bc76-4f55-a851-1b1353e14d69 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:18.150453 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-9aab9a74-bc76-4f55-a851-1b1353e14d69 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] [instance: 8f1e4990-6f32-426c-bdea-ce2007c37a6f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:42:18.164935 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9aab9a74-bc76-4f55-a851-1b1353e14d69 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:18.165762 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9aab9a74-bc76-4f55-a851-1b1353e14d69 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:18.168150 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9aab9a74-bc76-4f55-a851-1b1353e14d69 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:18.169144 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9aab9a74-bc76-4f55-a851-1b1353e14d69 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:18.169680 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9aab9a74-bc76-4f55-a851-1b1353e14d69 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:18.170505 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9aab9a74-bc76-4f55-a851-1b1353e14d69 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:19.469113 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-2d9239a7-b274-4888-8afc-edbbb42542ab tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] Getting quotas for project 6d7a1e525a85411ca2ce2bce1638b463. Resources: dict_keys(['metadata_items']) {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:42:19.485379 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-2d9239a7-b274-4888-8afc-edbbb42542ab tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] Getting quotas for user 4dd8aa669e8847a3848a723c7890ef98 and project 6d7a1e525a85411ca2ce2bce1638b463. Resources: dict_keys(['metadata_items']) {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:42:19.527026 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-2d9239a7-b274-4888-8afc-edbbb42542ab tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] Flavor limits 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:42:19.527448 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-2d9239a7-b274-4888-8afc-edbbb42542ab tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] Image limits 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:42:19.528113 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-2d9239a7-b274-4888-8afc-edbbb42542ab tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] Flavor pref 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:42:19.528709 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-2d9239a7-b274-4888-8afc-edbbb42542ab tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] Image pref 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:42:19.529443 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-2d9239a7-b274-4888-8afc-edbbb42542ab tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:42:19.549802 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2d9239a7-b274-4888-8afc-edbbb42542ab tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:19.551761 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2d9239a7-b274-4888-8afc-edbbb42542ab tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:19.555272 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2d9239a7-b274-4888-8afc-edbbb42542ab tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:19.556562 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2d9239a7-b274-4888-8afc-edbbb42542ab tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:19.557045 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2d9239a7-b274-4888-8afc-edbbb42542ab tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:19.557500 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2d9239a7-b274-4888-8afc-edbbb42542ab tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:19.588627 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-9aab9a74-bc76-4f55-a851-1b1353e14d69 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:42:19.602153 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-2d9239a7-b274-4888-8afc-edbbb42542ab tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] Getting quotas for project 6d7a1e525a85411ca2ce2bce1638b463. Resources: {'ram', 'instances', 'cores'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:42:19.605222 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-9aab9a74-bc76-4f55-a851-1b1353e14d69 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:42:19.610944 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-9aab9a74-bc76-4f55-a851-1b1353e14d69 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:42:19.612667 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-2d9239a7-b274-4888-8afc-edbbb42542ab tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] Getting quotas for user 4dd8aa669e8847a3848a723c7890ef98 and project 6d7a1e525a85411ca2ce2bce1638b463. Resources: {'ram', 'instances', 'cores'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:42:19.615550 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-9aab9a74-bc76-4f55-a851-1b1353e14d69 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] 10.222.0.33 "GET /compute/v2.1/servers/8f1e4990-6f32-426c-bdea-ce2007c37a6f" status: 200 len: 1485 microversion: 2.25 time: 1.470517 Oct 04 20:42:19.656761 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-2d9239a7-b274-4888-8afc-edbbb42542ab tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] Going to run 1 instances... {{(pid=128802) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:42:19.661292 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-2d9239a7-b274-4888-8afc-edbbb42542ab tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] [instance: 251a34fb-f406-415f-8a45-d80feb48581d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='15b24725-0c99-4bcf-b1fb-907cdf8e2d63',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128802) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:42:19.669644 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1015/2097] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:42:18 2022] GET /compute/v2.1/servers/8f1e4990-6f32-426c-bdea-ce2007c37a6f => generated 1485 bytes in 1524 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:42:19.680919 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d4e5e25b-713a-4431-80db-1b2c7e190fb7 tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:19.681595 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d4e5e25b-713a-4431-80db-1b2c7e190fb7 tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] [instance: c806a6c6-6b03-4b6e-9247-75b8541ce9b4] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:42:19.700563 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d4e5e25b-713a-4431-80db-1b2c7e190fb7 tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:19.700563 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d4e5e25b-713a-4431-80db-1b2c7e190fb7 tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:19.700563 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d4e5e25b-713a-4431-80db-1b2c7e190fb7 tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:19.704636 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d4e5e25b-713a-4431-80db-1b2c7e190fb7 tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:19.705840 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d4e5e25b-713a-4431-80db-1b2c7e190fb7 tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:19.706293 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d4e5e25b-713a-4431-80db-1b2c7e190fb7 tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:19.821542 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-2d9239a7-b274-4888-8afc-edbbb42542ab tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 4.177056 Oct 04 20:42:19.822951 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1083/2098] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 20:42:15 2022] POST /compute/v2.1/servers => generated 407 bytes in 4179 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 20:42:19.846397 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-f9a6b16d-0a9d-488a-8833-439ac153fc48 tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:19.849399 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-f9a6b16d-0a9d-488a-8833-439ac153fc48 tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] [instance: 251a34fb-f406-415f-8a45-d80feb48581d] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:42:20.094911 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-f9a6b16d-0a9d-488a-8833-439ac153fc48 tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd8aa669e8847a3848a723c7890ef98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7a1e525a85411ca2ce2bce1638b463', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:42:20.105095 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-f9a6b16d-0a9d-488a-8833-439ac153fc48 tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] 10.222.0.33 "GET /compute/v2.1/servers/251a34fb-f406-415f-8a45-d80feb48581d" status: 200 len: 1270 microversion: 2.1 time: 0.273205 Oct 04 20:42:20.106408 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1084/2099] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:42:19 2022] GET /compute/v2.1/servers/251a34fb-f406-415f-8a45-d80feb48581d => generated 1270 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:42:20.354633 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d4e5e25b-713a-4431-80db-1b2c7e190fb7 tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73345e7aa3ec490e9266cf356dc442ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99c97de335941a4af0f09c695ab3a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:42:20.370792 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d4e5e25b-713a-4431-80db-1b2c7e190fb7 tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] 10.222.0.33 "GET /compute/v2.1/servers/c806a6c6-6b03-4b6e-9247-75b8541ce9b4" status: 200 len: 1321 microversion: 2.1 time: 0.699935 Oct 04 20:42:20.371666 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1016/2100] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:42:19 2022] GET /compute/v2.1/servers/c806a6c6-6b03-4b6e-9247-75b8541ce9b4 => generated 1321 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:42:20.651579 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-1d5e6782-e775-40f0-bba0-19de2af9eed2 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:20.653014 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-1d5e6782-e775-40f0-bba0-19de2af9eed2 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] [instance: 8f1e4990-6f32-426c-bdea-ce2007c37a6f] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:42:20.664547 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1d5e6782-e775-40f0-bba0-19de2af9eed2 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:20.665470 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1d5e6782-e775-40f0-bba0-19de2af9eed2 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:20.666653 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1d5e6782-e775-40f0-bba0-19de2af9eed2 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:20.667730 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1d5e6782-e775-40f0-bba0-19de2af9eed2 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:20.668389 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1d5e6782-e775-40f0-bba0-19de2af9eed2 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:20.669005 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1d5e6782-e775-40f0-bba0-19de2af9eed2 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:21.136073 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-fbc492de-68cc-48f5-b440-721d2959c714 tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:21.136705 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-fbc492de-68cc-48f5-b440-721d2959c714 tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] [instance: 251a34fb-f406-415f-8a45-d80feb48581d] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:42:21.154140 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fbc492de-68cc-48f5-b440-721d2959c714 tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:21.157738 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fbc492de-68cc-48f5-b440-721d2959c714 tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:21.159839 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fbc492de-68cc-48f5-b440-721d2959c714 tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:21.161914 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fbc492de-68cc-48f5-b440-721d2959c714 tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:21.162639 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fbc492de-68cc-48f5-b440-721d2959c714 tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:21.163185 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fbc492de-68cc-48f5-b440-721d2959c714 tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:21.196048 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-1d5e6782-e775-40f0-bba0-19de2af9eed2 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:42:21.227877 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-1d5e6782-e775-40f0-bba0-19de2af9eed2 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:42:21.237754 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-1d5e6782-e775-40f0-bba0-19de2af9eed2 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:42:21.239914 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-1d5e6782-e775-40f0-bba0-19de2af9eed2 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] 10.222.0.33 "GET /compute/v2.1/servers/8f1e4990-6f32-426c-bdea-ce2007c37a6f" status: 200 len: 1485 microversion: 2.25 time: 0.596107 Oct 04 20:42:21.240530 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1085/2101] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:42:20 2022] GET /compute/v2.1/servers/8f1e4990-6f32-426c-bdea-ce2007c37a6f => generated 1485 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:42:21.397530 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-88a4ac8b-c89e-43a6-b817-8ffe6a9cdc6d tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:21.398142 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-88a4ac8b-c89e-43a6-b817-8ffe6a9cdc6d tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] [instance: c806a6c6-6b03-4b6e-9247-75b8541ce9b4] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:42:21.412555 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-88a4ac8b-c89e-43a6-b817-8ffe6a9cdc6d tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:21.413579 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-88a4ac8b-c89e-43a6-b817-8ffe6a9cdc6d tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:21.414178 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-88a4ac8b-c89e-43a6-b817-8ffe6a9cdc6d tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:21.417225 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-88a4ac8b-c89e-43a6-b817-8ffe6a9cdc6d tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:21.418041 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-88a4ac8b-c89e-43a6-b817-8ffe6a9cdc6d tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:21.419682 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-88a4ac8b-c89e-43a6-b817-8ffe6a9cdc6d tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:21.427196 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-fbc492de-68cc-48f5-b440-721d2959c714 tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd8aa669e8847a3848a723c7890ef98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7a1e525a85411ca2ce2bce1638b463', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:42:21.445150 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-fbc492de-68cc-48f5-b440-721d2959c714 tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] 10.222.0.33 "GET /compute/v2.1/servers/251a34fb-f406-415f-8a45-d80feb48581d" status: 200 len: 1266 microversion: 2.1 time: 0.315395 Oct 04 20:42:21.445847 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1017/2102] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:42:21 2022] GET /compute/v2.1/servers/251a34fb-f406-415f-8a45-d80feb48581d => generated 1266 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:42:22.271893 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-dbcec983-334a-4724-9ce8-4b9f512cc5ac tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:22.272544 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-dbcec983-334a-4724-9ce8-4b9f512cc5ac tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] [instance: 8f1e4990-6f32-426c-bdea-ce2007c37a6f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:42:22.293428 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dbcec983-334a-4724-9ce8-4b9f512cc5ac tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:22.300136 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dbcec983-334a-4724-9ce8-4b9f512cc5ac tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:22.301394 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dbcec983-334a-4724-9ce8-4b9f512cc5ac tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:22.306827 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dbcec983-334a-4724-9ce8-4b9f512cc5ac tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:22.310854 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dbcec983-334a-4724-9ce8-4b9f512cc5ac tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:22.312604 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dbcec983-334a-4724-9ce8-4b9f512cc5ac tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:23.471688 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-88a4ac8b-c89e-43a6-b817-8ffe6a9cdc6d tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73345e7aa3ec490e9266cf356dc442ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99c97de335941a4af0f09c695ab3a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:42:23.481158 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-88a4ac8b-c89e-43a6-b817-8ffe6a9cdc6d tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] 10.222.0.33 "GET /compute/v2.1/servers/c806a6c6-6b03-4b6e-9247-75b8541ce9b4" status: 200 len: 1321 microversion: 2.1 time: 2.087286 Oct 04 20:42:23.491477 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1086/2103] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:42:21 2022] GET /compute/v2.1/servers/c806a6c6-6b03-4b6e-9247-75b8541ce9b4 => generated 1321 bytes in 2098 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:42:23.497104 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-93f70a5e-181b-4072-a0b0-d5aa5648508e tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:23.497949 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-93f70a5e-181b-4072-a0b0-d5aa5648508e tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] [instance: 251a34fb-f406-415f-8a45-d80feb48581d] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:42:23.516490 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-93f70a5e-181b-4072-a0b0-d5aa5648508e tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:23.517196 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-93f70a5e-181b-4072-a0b0-d5aa5648508e tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:23.518248 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-93f70a5e-181b-4072-a0b0-d5aa5648508e tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:23.521231 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-93f70a5e-181b-4072-a0b0-d5aa5648508e tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:23.521884 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-93f70a5e-181b-4072-a0b0-d5aa5648508e tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:23.522484 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-93f70a5e-181b-4072-a0b0-d5aa5648508e tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:23.772439 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-93f70a5e-181b-4072-a0b0-d5aa5648508e tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd8aa669e8847a3848a723c7890ef98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7a1e525a85411ca2ce2bce1638b463', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:42:23.785368 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-93f70a5e-181b-4072-a0b0-d5aa5648508e tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] 10.222.0.33 "GET /compute/v2.1/servers/251a34fb-f406-415f-8a45-d80feb48581d" status: 200 len: 1328 microversion: 2.1 time: 0.292535 Oct 04 20:42:23.786303 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1087/2104] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:42:23 2022] GET /compute/v2.1/servers/251a34fb-f406-415f-8a45-d80feb48581d => generated 1328 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:42:23.989338 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-dbcec983-334a-4724-9ce8-4b9f512cc5ac tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:42:24.002363 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-dbcec983-334a-4724-9ce8-4b9f512cc5ac tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:42:24.005047 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-dbcec983-334a-4724-9ce8-4b9f512cc5ac tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:42:24.010155 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-dbcec983-334a-4724-9ce8-4b9f512cc5ac tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] 10.222.0.33 "GET /compute/v2.1/servers/8f1e4990-6f32-426c-bdea-ce2007c37a6f" status: 200 len: 1485 microversion: 2.25 time: 1.742493 Oct 04 20:42:24.036757 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1018/2105] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:42:22 2022] GET /compute/v2.1/servers/8f1e4990-6f32-426c-bdea-ce2007c37a6f => generated 1485 bytes in 1770 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:42:24.527081 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-6691a87c-36b2-4847-8615-0f3f23168d6a tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:24.529373 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-6691a87c-36b2-4847-8615-0f3f23168d6a tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] [instance: c806a6c6-6b03-4b6e-9247-75b8541ce9b4] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:42:24.550678 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6691a87c-36b2-4847-8615-0f3f23168d6a tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:24.551164 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6691a87c-36b2-4847-8615-0f3f23168d6a tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:24.551589 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6691a87c-36b2-4847-8615-0f3f23168d6a tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:24.568810 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6691a87c-36b2-4847-8615-0f3f23168d6a tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:24.570026 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6691a87c-36b2-4847-8615-0f3f23168d6a tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:24.570896 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6691a87c-36b2-4847-8615-0f3f23168d6a tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:24.809221 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1921e4a8-2f19-4c20-8f79-856ea6ff6470 tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:24.810483 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-1921e4a8-2f19-4c20-8f79-856ea6ff6470 tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] [instance: 251a34fb-f406-415f-8a45-d80feb48581d] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:42:24.842596 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1921e4a8-2f19-4c20-8f79-856ea6ff6470 tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:24.843515 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1921e4a8-2f19-4c20-8f79-856ea6ff6470 tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:24.843970 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1921e4a8-2f19-4c20-8f79-856ea6ff6470 tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:24.862819 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1921e4a8-2f19-4c20-8f79-856ea6ff6470 tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:24.863410 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1921e4a8-2f19-4c20-8f79-856ea6ff6470 tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:24.865886 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1921e4a8-2f19-4c20-8f79-856ea6ff6470 tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:25.652794 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-6691a87c-36b2-4847-8615-0f3f23168d6a tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73345e7aa3ec490e9266cf356dc442ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99c97de335941a4af0f09c695ab3a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:42:25.662544 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-6691a87c-36b2-4847-8615-0f3f23168d6a tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] 10.222.0.33 "GET /compute/v2.1/servers/c806a6c6-6b03-4b6e-9247-75b8541ce9b4" status: 200 len: 1321 microversion: 2.1 time: 1.148467 Oct 04 20:42:25.673174 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1088/2106] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:42:24 2022] GET /compute/v2.1/servers/c806a6c6-6b03-4b6e-9247-75b8541ce9b4 => generated 1321 bytes in 1160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:42:25.686379 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-be57c420-e35a-4dbd-a611-6186056b1863 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:25.687257 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-be57c420-e35a-4dbd-a611-6186056b1863 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] [instance: 8f1e4990-6f32-426c-bdea-ce2007c37a6f] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:42:25.712177 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-be57c420-e35a-4dbd-a611-6186056b1863 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:25.712684 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-be57c420-e35a-4dbd-a611-6186056b1863 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:25.713118 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-be57c420-e35a-4dbd-a611-6186056b1863 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:25.713841 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-be57c420-e35a-4dbd-a611-6186056b1863 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:25.714297 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-be57c420-e35a-4dbd-a611-6186056b1863 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:25.721569 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-be57c420-e35a-4dbd-a611-6186056b1863 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:26.056809 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-1921e4a8-2f19-4c20-8f79-856ea6ff6470 tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd8aa669e8847a3848a723c7890ef98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7a1e525a85411ca2ce2bce1638b463', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:42:26.082059 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-1921e4a8-2f19-4c20-8f79-856ea6ff6470 tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] 10.222.0.33 "GET /compute/v2.1/servers/251a34fb-f406-415f-8a45-d80feb48581d" status: 200 len: 1328 microversion: 2.1 time: 1.266583 Oct 04 20:42:26.082059 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1019/2107] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:42:24 2022] GET /compute/v2.1/servers/251a34fb-f406-415f-8a45-d80feb48581d => generated 1328 bytes in 1270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:42:26.382874 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-efa0d0c2-c040-49b1-beca-2405f9d37262 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Action: 'create', calling method: .version_select at 0x7f3c788391f0>, body: {"keypair": {"name": "tempest-keypair-1396397535", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH84K/cBpC9OjJQaLiHb+oz3mSv15FcZFvdkApQnNSky3aNSY4+ro+jETukjroeMZv4nGspj2YFk0ZEWnv3qCnyvi3X0dUqXqKiF0hU3f2DTxti9+78NgyUiNIC/VtmCUQ=="}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:42:26.428700 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-efa0d0c2-c040-49b1-beca-2405f9d37262 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Getting quotas for project 5392c67506f7445ab33d62b191558f7b. Resources: {'key_pairs'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:42:26.440426 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-efa0d0c2-c040-49b1-beca-2405f9d37262 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Getting quotas for user 28399882314945d787a3af6eb59935c0 and project 5392c67506f7445ab33d62b191558f7b. Resources: {'key_pairs'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:42:26.493824 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-efa0d0c2-c040-49b1-beca-2405f9d37262 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.32 time: 0.122723 Oct 04 20:42:26.494468 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1020/2108] 10.222.0.33 () {62 vars in 1200 bytes} [Tue Oct 4 20:42:26 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 124 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 04 20:42:26.515342 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-0055c145-e12b-4923-ac86-95008849507d req-05b9287a-e18b-4cd0-870d-89391bd78485 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c806a6c6-6b03-4b6e-9247-75b8541ce9b4", "name": "network-vif-plugged", "status": "completed", "tag": "059512bd-a604-4d49-978d-ee2246b9e518"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:42:26.543143 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-0055c145-e12b-4923-ac86-95008849507d req-05b9287a-e18b-4cd0-870d-89391bd78485 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:26.543662 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-0055c145-e12b-4923-ac86-95008849507d req-05b9287a-e18b-4cd0-870d-89391bd78485 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:26.544297 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-0055c145-e12b-4923-ac86-95008849507d req-05b9287a-e18b-4cd0-870d-89391bd78485 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:26.589833 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-0055c145-e12b-4923-ac86-95008849507d req-05b9287a-e18b-4cd0-870d-89391bd78485 service nova] Creating event network-vif-plugged:059512bd-a604-4d49-978d-ee2246b9e518 for instance c806a6c6-6b03-4b6e-9247-75b8541ce9b4 on n-h2-854823-8 Oct 04 20:42:26.600723 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-0055c145-e12b-4923-ac86-95008849507d req-05b9287a-e18b-4cd0-870d-89391bd78485 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097867 Oct 04 20:42:26.601367 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1021/2109] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:42:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:42:26.692854 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-48b1ab6d-462c-4898-bff0-878af2920cf3 tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:26.693576 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-48b1ab6d-462c-4898-bff0-878af2920cf3 tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] [instance: c806a6c6-6b03-4b6e-9247-75b8541ce9b4] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:42:26.706308 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-48b1ab6d-462c-4898-bff0-878af2920cf3 tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:26.713474 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-48b1ab6d-462c-4898-bff0-878af2920cf3 tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:26.713966 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-48b1ab6d-462c-4898-bff0-878af2920cf3 tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:26.725908 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-48b1ab6d-462c-4898-bff0-878af2920cf3 tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:26.739056 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-48b1ab6d-462c-4898-bff0-878af2920cf3 tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:26.739558 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-48b1ab6d-462c-4898-bff0-878af2920cf3 tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:27.943579 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-be57c420-e35a-4dbd-a611-6186056b1863 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:42:27.957911 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-be57c420-e35a-4dbd-a611-6186056b1863 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:42:27.960631 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-be57c420-e35a-4dbd-a611-6186056b1863 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:42:28.000725 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-be57c420-e35a-4dbd-a611-6186056b1863 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] 10.222.0.33 "GET /compute/v2.1/servers/8f1e4990-6f32-426c-bdea-ce2007c37a6f" status: 200 len: 1485 microversion: 2.25 time: 2.288102 Oct 04 20:42:28.002089 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1089/2110] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:42:25 2022] GET /compute/v2.1/servers/8f1e4990-6f32-426c-bdea-ce2007c37a6f => generated 1485 bytes in 2328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:42:28.012204 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-be84ac54-7cec-4573-a167-259e8059c10e tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:28.013238 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-be84ac54-7cec-4573-a167-259e8059c10e tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] [instance: 251a34fb-f406-415f-8a45-d80feb48581d] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:42:28.029276 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-be84ac54-7cec-4573-a167-259e8059c10e tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:28.040497 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-be84ac54-7cec-4573-a167-259e8059c10e tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:28.041184 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-be84ac54-7cec-4573-a167-259e8059c10e tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:28.053502 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-be84ac54-7cec-4573-a167-259e8059c10e tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:28.063870 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-be84ac54-7cec-4573-a167-259e8059c10e tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:28.064615 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-be84ac54-7cec-4573-a167-259e8059c10e tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:28.088560 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:42:28.463108 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-48b1ab6d-462c-4898-bff0-878af2920cf3 tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73345e7aa3ec490e9266cf356dc442ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99c97de335941a4af0f09c695ab3a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:42:28.473297 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-48b1ab6d-462c-4898-bff0-878af2920cf3 tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] 10.222.0.33 "GET /compute/v2.1/servers/c806a6c6-6b03-4b6e-9247-75b8541ce9b4" status: 200 len: 1321 microversion: 2.1 time: 1.784666 Oct 04 20:42:28.482121 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1022/2111] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:42:26 2022] GET /compute/v2.1/servers/c806a6c6-6b03-4b6e-9247-75b8541ce9b4 => generated 1321 bytes in 1794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:42:28.906796 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-be84ac54-7cec-4573-a167-259e8059c10e tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd8aa669e8847a3848a723c7890ef98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7a1e525a85411ca2ce2bce1638b463', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:42:28.926489 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-be84ac54-7cec-4573-a167-259e8059c10e tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] 10.222.0.33 "GET /compute/v2.1/servers/251a34fb-f406-415f-8a45-d80feb48581d" status: 200 len: 1396 microversion: 2.1 time: 0.922825 Oct 04 20:42:28.943534 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1090/2112] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:42:28 2022] GET /compute/v2.1/servers/251a34fb-f406-415f-8a45-d80feb48581d => generated 1396 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:42:29.033670 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b471cdde-700c-404d-bea0-1624de46b2cd tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:29.034300 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b471cdde-700c-404d-bea0-1624de46b2cd tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] [instance: 8f1e4990-6f32-426c-bdea-ce2007c37a6f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:42:29.047247 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b471cdde-700c-404d-bea0-1624de46b2cd tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:29.047854 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b471cdde-700c-404d-bea0-1624de46b2cd tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:29.048303 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b471cdde-700c-404d-bea0-1624de46b2cd tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:29.049070 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b471cdde-700c-404d-bea0-1624de46b2cd tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:29.049538 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b471cdde-700c-404d-bea0-1624de46b2cd tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:29.049972 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b471cdde-700c-404d-bea0-1624de46b2cd tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:29.512335 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-9a7eb443-afd4-44db-b861-5ff9103a52f8 tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:29.516065 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-9a7eb443-afd4-44db-b861-5ff9103a52f8 tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] [instance: c806a6c6-6b03-4b6e-9247-75b8541ce9b4] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:42:29.537141 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9a7eb443-afd4-44db-b861-5ff9103a52f8 tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:29.538523 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9a7eb443-afd4-44db-b861-5ff9103a52f8 tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:29.541033 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9a7eb443-afd4-44db-b861-5ff9103a52f8 tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:29.542018 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9a7eb443-afd4-44db-b861-5ff9103a52f8 tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:29.542872 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9a7eb443-afd4-44db-b861-5ff9103a52f8 tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:29.547626 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9a7eb443-afd4-44db-b861-5ff9103a52f8 tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:29.591216 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell0:SELECT=2 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:42:30.105166 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell0:SELECT=12 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:42:31.091030 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-9a7eb443-afd4-44db-b861-5ff9103a52f8 tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73345e7aa3ec490e9266cf356dc442ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99c97de335941a4af0f09c695ab3a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:42:31.112887 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=78 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:42:31.120265 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-9a7eb443-afd4-44db-b861-5ff9103a52f8 tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] 10.222.0.33 "GET /compute/v2.1/servers/c806a6c6-6b03-4b6e-9247-75b8541ce9b4" status: 200 len: 1517 microversion: 2.1 time: 1.614766 Oct 04 20:42:31.121838 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1091/2113] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:42:29 2022] GET /compute/v2.1/servers/c806a6c6-6b03-4b6e-9247-75b8541ce9b4 => generated 1517 bytes in 1617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:42:31.129731 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-910abdcd-7528-4e2e-be77-1df114bed401 tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:31.130708 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-910abdcd-7528-4e2e-be77-1df114bed401 tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] [instance: 251a34fb-f406-415f-8a45-d80feb48581d] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:42:31.139819 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-910abdcd-7528-4e2e-be77-1df114bed401 tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:31.140808 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-910abdcd-7528-4e2e-be77-1df114bed401 tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:31.141434 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-910abdcd-7528-4e2e-be77-1df114bed401 tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:31.142822 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-910abdcd-7528-4e2e-be77-1df114bed401 tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:31.143660 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-910abdcd-7528-4e2e-be77-1df114bed401 tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:31.158117 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-910abdcd-7528-4e2e-be77-1df114bed401 tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:31.231833 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-b471cdde-700c-404d-bea0-1624de46b2cd tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:42:31.245344 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-b471cdde-700c-404d-bea0-1624de46b2cd tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:42:31.256921 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-b471cdde-700c-404d-bea0-1624de46b2cd tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:42:31.258239 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b471cdde-700c-404d-bea0-1624de46b2cd tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] 10.222.0.33 "GET /compute/v2.1/servers/8f1e4990-6f32-426c-bdea-ce2007c37a6f" status: 200 len: 1485 microversion: 2.25 time: 2.229687 Oct 04 20:42:31.259478 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1023/2114] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:42:29 2022] GET /compute/v2.1/servers/8f1e4990-6f32-426c-bdea-ce2007c37a6f => generated 1485 bytes in 2232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:42:31.296499 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-cb5ce959-6478-4bb5-bb18-8fafb7035674 tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:42:31.300969 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-cb5ce959-6478-4bb5-bb18-8fafb7035674 tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] [instance: c806a6c6-6b03-4b6e-9247-75b8541ce9b4] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:42:31.323321 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cb5ce959-6478-4bb5-bb18-8fafb7035674 tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:31.323823 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cb5ce959-6478-4bb5-bb18-8fafb7035674 tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:31.324366 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cb5ce959-6478-4bb5-bb18-8fafb7035674 tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:31.325284 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cb5ce959-6478-4bb5-bb18-8fafb7035674 tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:31.325754 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cb5ce959-6478-4bb5-bb18-8fafb7035674 tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:31.331888 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cb5ce959-6478-4bb5-bb18-8fafb7035674 tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:31.354274 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:42:31.382716 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-cb5ce959-6478-4bb5-bb18-8fafb7035674 tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Lazy-loading 'flavor' on Instance uuid c806a6c6-6b03-4b6e-9247-75b8541ce9b4 {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:42:31.652800 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-cb5ce959-6478-4bb5-bb18-8fafb7035674 tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] 10.222.0.33 "POST /compute/v2.1/servers/c806a6c6-6b03-4b6e-9247-75b8541ce9b4/action" status: 200 len: 32 microversion: 2.1 time: 0.375540 Oct 04 20:42:31.655531 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1024/2115] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 20:42:31 2022] POST /compute/v2.1/servers/c806a6c6-6b03-4b6e-9247-75b8541ce9b4/action => generated 32 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 20:42:31.667740 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f00d5469-bccb-440f-b429-6ec3c764b835 tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:31.697467 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f00d5469-bccb-440f-b429-6ec3c764b835 tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] [instance: c806a6c6-6b03-4b6e-9247-75b8541ce9b4] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:42:31.740425 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f00d5469-bccb-440f-b429-6ec3c764b835 tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:31.741950 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f00d5469-bccb-440f-b429-6ec3c764b835 tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:31.745983 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f00d5469-bccb-440f-b429-6ec3c764b835 tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:31.749092 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f00d5469-bccb-440f-b429-6ec3c764b835 tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:31.751545 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f00d5469-bccb-440f-b429-6ec3c764b835 tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:31.756369 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f00d5469-bccb-440f-b429-6ec3c764b835 tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:32.463289 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-910abdcd-7528-4e2e-be77-1df114bed401 tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd8aa669e8847a3848a723c7890ef98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7a1e525a85411ca2ce2bce1638b463', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:42:32.474212 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-910abdcd-7528-4e2e-be77-1df114bed401 tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] 10.222.0.33 "GET /compute/v2.1/servers/251a34fb-f406-415f-8a45-d80feb48581d" status: 200 len: 1396 microversion: 2.1 time: 1.350808 Oct 04 20:42:32.483611 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1092/2116] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:42:31 2022] GET /compute/v2.1/servers/251a34fb-f406-415f-8a45-d80feb48581d => generated 1396 bytes in 1361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:42:32.502163 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-1aef5e99-10c5-4f7e-87d4-6325427fb86a tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-139130746", "imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "8bd4a86c-7b0c-44d9-ae6b-c18d5fed6675"}, {"port": "24c541fa-d6dd-41ae-99d3-45a43da2f893", "tag": "port-1"}, {"port": "41720b8f-0f05-4932-ad4e-fda7403fd530", "tag": "port-2"}, {"uuid": "95188f13-bc4e-42e9-a808-03d14e34b924", "tag": "net-1"}, {"uuid": "95188f13-bc4e-42e9-a808-03d14e34b924"}, {"uuid": "577b1c22-0b46-469b-9821-45e45a2a6535", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "577b1c22-0b46-469b-9821-45e45a2a6535", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "6de17d64-0727-486a-8fd7-3ed080e559fb", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "3095d8a0-51da-497c-85e0-35508275a4b2", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "1c33d46a-02ed-40da-bf44-05e69ba5ae3a", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--2039738298"}], "key_name": "tempest-keypair-1396397535", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:42:33.010508 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f00d5469-bccb-440f-b429-6ec3c764b835 tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73345e7aa3ec490e9266cf356dc442ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99c97de335941a4af0f09c695ab3a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:42:33.027237 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f00d5469-bccb-440f-b429-6ec3c764b835 tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] 10.222.0.33 "GET /compute/v2.1/servers/c806a6c6-6b03-4b6e-9247-75b8541ce9b4" status: 200 len: 1523 microversion: 2.1 time: 1.364272 Oct 04 20:42:33.028622 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1025/2117] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:42:31 2022] GET /compute/v2.1/servers/c806a6c6-6b03-4b6e-9247-75b8541ce9b4 => generated 1523 bytes in 1368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:42:33.046645 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-3d689970-3c02-4cb9-8bc0-de55857e1ff1 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:33.050550 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-3d689970-3c02-4cb9-8bc0-de55857e1ff1 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] [instance: 8f1e4990-6f32-426c-bdea-ce2007c37a6f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:42:33.089036 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3d689970-3c02-4cb9-8bc0-de55857e1ff1 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:33.093355 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3d689970-3c02-4cb9-8bc0-de55857e1ff1 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:33.095093 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3d689970-3c02-4cb9-8bc0-de55857e1ff1 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:33.098772 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3d689970-3c02-4cb9-8bc0-de55857e1ff1 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:33.099480 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3d689970-3c02-4cb9-8bc0-de55857e1ff1 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:33.099931 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3d689970-3c02-4cb9-8bc0-de55857e1ff1 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:33.218848 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.network.neutron [None req-1aef5e99-10c5-4f7e-87d4-6325427fb86a tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] validate_networks() for [('8bd4a86c-7b0c-44d9-ae6b-c18d5fed6675', None, None, None, None, None), (None, None, '24c541fa-d6dd-41ae-99d3-45a43da2f893', None, None, None), (None, None, '41720b8f-0f05-4932-ad4e-fda7403fd530', None, None, None), ('95188f13-bc4e-42e9-a808-03d14e34b924', None, None, None, None, None), ('95188f13-bc4e-42e9-a808-03d14e34b924', None, None, None, None, None), ('577b1c22-0b46-469b-9821-45e45a2a6535', '10.2.2.100', None, None, None, None), ('577b1c22-0b46-469b-9821-45e45a2a6535', '10.2.2.200', None, None, None, None)] {{(pid=128802) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:42:34.564471 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-3d689970-3c02-4cb9-8bc0-de55857e1ff1 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:42:34.584056 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-3d689970-3c02-4cb9-8bc0-de55857e1ff1 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:42:34.585978 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-3d689970-3c02-4cb9-8bc0-de55857e1ff1 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:42:34.587873 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-3d689970-3c02-4cb9-8bc0-de55857e1ff1 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] 10.222.0.33 "GET /compute/v2.1/servers/8f1e4990-6f32-426c-bdea-ce2007c37a6f" status: 200 len: 1485 microversion: 2.25 time: 1.555310 Oct 04 20:42:34.619051 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1026/2118] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:42:33 2022] GET /compute/v2.1/servers/8f1e4990-6f32-426c-bdea-ce2007c37a6f => generated 1485 bytes in 1590 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:42:34.625415 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-379c4a98-226a-422a-9775-0e52fd29ace5 req-ba11d9fc-e226-4026-82d2-b021cba18bfd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f1e4990-6f32-426c-bdea-ce2007c37a6f", "name": "network-vif-unplugged", "status": "completed", "tag": "ade75c1b-2031-475c-af20-7442fa7b876a"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:42:34.649818 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-379c4a98-226a-422a-9775-0e52fd29ace5 req-ba11d9fc-e226-4026-82d2-b021cba18bfd service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:34.657573 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-379c4a98-226a-422a-9775-0e52fd29ace5 req-ba11d9fc-e226-4026-82d2-b021cba18bfd service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:34.658390 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-379c4a98-226a-422a-9775-0e52fd29ace5 req-ba11d9fc-e226-4026-82d2-b021cba18bfd service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:34.676293 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-379c4a98-226a-422a-9775-0e52fd29ace5 req-ba11d9fc-e226-4026-82d2-b021cba18bfd service nova] Creating event network-vif-unplugged:ade75c1b-2031-475c-af20-7442fa7b876a for instance 8f1e4990-6f32-426c-bdea-ce2007c37a6f on n-h1-854823-8 Oct 04 20:42:34.683243 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-379c4a98-226a-422a-9775-0e52fd29ace5 req-ba11d9fc-e226-4026-82d2-b021cba18bfd service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.062636 Oct 04 20:42:34.684396 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1027/2119] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:42:34 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:42:34.692484 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-cd2e2764-f995-4820-ab7a-65ff40bd934d tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:34.693632 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-cd2e2764-f995-4820-ab7a-65ff40bd934d tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] [instance: 251a34fb-f406-415f-8a45-d80feb48581d] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:42:34.702419 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cd2e2764-f995-4820-ab7a-65ff40bd934d tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:34.703286 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cd2e2764-f995-4820-ab7a-65ff40bd934d tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:34.703934 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cd2e2764-f995-4820-ab7a-65ff40bd934d tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:34.704815 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cd2e2764-f995-4820-ab7a-65ff40bd934d tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:34.708674 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cd2e2764-f995-4820-ab7a-65ff40bd934d tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:34.709177 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cd2e2764-f995-4820-ab7a-65ff40bd934d tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:35.751444 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-cd2e2764-f995-4820-ab7a-65ff40bd934d tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd8aa669e8847a3848a723c7890ef98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7a1e525a85411ca2ce2bce1638b463', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:42:35.772965 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-cd2e2764-f995-4820-ab7a-65ff40bd934d tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] 10.222.0.33 "GET /compute/v2.1/servers/251a34fb-f406-415f-8a45-d80feb48581d" status: 200 len: 1396 microversion: 2.1 time: 1.086203 Oct 04 20:42:35.775198 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1028/2120] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:42:34 2022] GET /compute/v2.1/servers/251a34fb-f406-415f-8a45-d80feb48581d => generated 1396 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:42:35.783184 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f691ade4-1ce9-4367-90e2-1186fddccee7 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-21168407", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "eff6509b-9044-4f53-ac84-39573f9dabae"}], "block_device_mapping_v2": [{"uuid": "fcb07a1c-1b30-400a-806d-b1bd2a0ffebe", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:42:35.882668 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.network.neutron [None req-f691ade4-1ce9-4367-90e2-1186fddccee7 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] validate_networks() for [('eff6509b-9044-4f53-ac84-39573f9dabae', None, None, None, None, None)] {{(pid=128801) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:42:36.456433 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=6 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:42:37.777267 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-f691ade4-1ce9-4367-90e2-1186fddccee7 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Flavor limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:42:37.777958 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-f691ade4-1ce9-4367-90e2-1186fddccee7 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Image limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:42:37.778150 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-f691ade4-1ce9-4367-90e2-1186fddccee7 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Flavor pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:42:37.780061 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-f691ade4-1ce9-4367-90e2-1186fddccee7 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Image pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:42:37.780630 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-f691ade4-1ce9-4367-90e2-1186fddccee7 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:42:37.791888 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f691ade4-1ce9-4367-90e2-1186fddccee7 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:37.792739 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f691ade4-1ce9-4367-90e2-1186fddccee7 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:37.793325 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f691ade4-1ce9-4367-90e2-1186fddccee7 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:37.794218 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f691ade4-1ce9-4367-90e2-1186fddccee7 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:37.795214 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f691ade4-1ce9-4367-90e2-1186fddccee7 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:37.795797 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f691ade4-1ce9-4367-90e2-1186fddccee7 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:37.826900 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-f691ade4-1ce9-4367-90e2-1186fddccee7 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Getting quotas for project d66ec8ea91b04deb90b679589e0495bb. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:42:37.836334 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-f691ade4-1ce9-4367-90e2-1186fddccee7 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Getting quotas for user 800db3a57ada47eca381b00189fdbf0a and project d66ec8ea91b04deb90b679589e0495bb. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:42:37.928508 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f691ade4-1ce9-4367-90e2-1186fddccee7 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Going to run 1 instances... {{(pid=128801) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:42:37.931545 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f691ade4-1ce9-4367-90e2-1186fddccee7 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] [instance: 17f61077-3e1c-4d86-b364-b22e4e40b3ca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='fcb07a1c-1b30-400a-806d-b1bd2a0ffebe',volume_size=None,volume_type=None)] {{(pid=128801) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:42:38.124882 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f691ade4-1ce9-4367-90e2-1186fddccee7 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.347640 Oct 04 20:42:38.126101 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1029/2121] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 20:42:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 2350 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 20:42:38.131837 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-037f3698-eb21-42d1-bf37-aecaa34b37eb tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:38.133232 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-037f3698-eb21-42d1-bf37-aecaa34b37eb tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] [instance: c806a6c6-6b03-4b6e-9247-75b8541ce9b4] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:42:38.142720 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-037f3698-eb21-42d1-bf37-aecaa34b37eb tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:38.143626 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-037f3698-eb21-42d1-bf37-aecaa34b37eb tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:38.144445 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-037f3698-eb21-42d1-bf37-aecaa34b37eb tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:38.145440 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-037f3698-eb21-42d1-bf37-aecaa34b37eb tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:38.146101 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-037f3698-eb21-42d1-bf37-aecaa34b37eb tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:38.146725 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-037f3698-eb21-42d1-bf37-aecaa34b37eb tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:38.505151 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-037f3698-eb21-42d1-bf37-aecaa34b37eb tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73345e7aa3ec490e9266cf356dc442ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99c97de335941a4af0f09c695ab3a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:42:38.518035 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-037f3698-eb21-42d1-bf37-aecaa34b37eb tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] 10.222.0.33 "GET /compute/v2.1/servers/c806a6c6-6b03-4b6e-9247-75b8541ce9b4" status: 200 len: 1523 microversion: 2.1 time: 0.390440 Oct 04 20:42:38.521227 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1030/2122] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:42:38 2022] GET /compute/v2.1/servers/c806a6c6-6b03-4b6e-9247-75b8541ce9b4 => generated 1523 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:42:38.529652 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-c80d7e6c-db6f-4b89-b8b8-bd53ad3aa330 req-8da844dc-1790-4dfc-8e88-4769acc4fa30 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "251a34fb-f406-415f-8a45-d80feb48581d", "tag": "47d205c9-2575-420f-bb45-a99478492ca2"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:42:38.562018 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-c80d7e6c-db6f-4b89-b8b8-bd53ad3aa330 req-8da844dc-1790-4dfc-8e88-4769acc4fa30 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:38.566510 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-c80d7e6c-db6f-4b89-b8b8-bd53ad3aa330 req-8da844dc-1790-4dfc-8e88-4769acc4fa30 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:38.567834 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-c80d7e6c-db6f-4b89-b8b8-bd53ad3aa330 req-8da844dc-1790-4dfc-8e88-4769acc4fa30 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:38.601311 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-c80d7e6c-db6f-4b89-b8b8-bd53ad3aa330 req-8da844dc-1790-4dfc-8e88-4769acc4fa30 service nova] Creating event network-changed:47d205c9-2575-420f-bb45-a99478492ca2 for instance 251a34fb-f406-415f-8a45-d80feb48581d on n-h1-854823-8 Oct 04 20:42:38.607992 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-c80d7e6c-db6f-4b89-b8b8-bd53ad3aa330 req-8da844dc-1790-4dfc-8e88-4769acc4fa30 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083557 Oct 04 20:42:38.609357 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1031/2123] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:42:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:42:38.621655 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2bef1f97-8f09-45f6-82a4-6577662b69bd tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:38.622484 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-2bef1f97-8f09-45f6-82a4-6577662b69bd tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] [instance: 8f1e4990-6f32-426c-bdea-ce2007c37a6f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:42:38.633066 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2bef1f97-8f09-45f6-82a4-6577662b69bd tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:38.633766 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2bef1f97-8f09-45f6-82a4-6577662b69bd tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:38.634277 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2bef1f97-8f09-45f6-82a4-6577662b69bd tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:38.637735 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2bef1f97-8f09-45f6-82a4-6577662b69bd tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:38.638266 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2bef1f97-8f09-45f6-82a4-6577662b69bd tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:38.640686 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2bef1f97-8f09-45f6-82a4-6577662b69bd tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:39.282809 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-2bef1f97-8f09-45f6-82a4-6577662b69bd tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:42:39.299192 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-2bef1f97-8f09-45f6-82a4-6577662b69bd tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:42:39.303372 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-2bef1f97-8f09-45f6-82a4-6577662b69bd tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:42:39.304910 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-2bef1f97-8f09-45f6-82a4-6577662b69bd tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] 10.222.0.33 "GET /compute/v2.1/servers/8f1e4990-6f32-426c-bdea-ce2007c37a6f" status: 200 len: 1485 microversion: 2.25 time: 0.688591 Oct 04 20:42:39.307579 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1032/2124] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:42:38 2022] GET /compute/v2.1/servers/8f1e4990-6f32-426c-bdea-ce2007c37a6f => generated 1485 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:42:39.620469 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e56a61c2-e988-4679-8d7f-a3e17088f6b1 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Action: 'create', calling method: .version_select at 0x7f3c741f1af0>, body: {"keypair": {"name": "tempest-keypair-738414864", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNGMFjB0a55ADY52qi07fDF79FIdBHFV1ol6Usz2dALRPmvWGPyPLj2qCJNNA4kLnVumrR6vLeAijB81GzAtsTsXSARBV2nUfzyGhxuXVjki+HDQ7FcJ+R878MDqGVE3SA=="}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:42:39.729292 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-e56a61c2-e988-4679-8d7f-a3e17088f6b1 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Getting quotas for project fc7f38600b5041ad8e66a12d77b940fa. Resources: {'key_pairs'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:42:39.746157 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-e56a61c2-e988-4679-8d7f-a3e17088f6b1 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Getting quotas for user d9e4b00964014a0383f79597652bd428 and project fc7f38600b5041ad8e66a12d77b940fa. Resources: {'key_pairs'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:42:39.860647 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e56a61c2-e988-4679-8d7f-a3e17088f6b1 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.544368 Oct 04 20:42:39.864524 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1033/2125] 10.222.0.33 () {60 vars in 1159 bytes} [Tue Oct 4 20:42:39 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:42:39.901119 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-df9b42a4-5e2a-4500-8557-067678a5283f tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:39.906287 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-df9b42a4-5e2a-4500-8557-067678a5283f tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] [instance: 251a34fb-f406-415f-8a45-d80feb48581d] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:42:39.961390 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-df9b42a4-5e2a-4500-8557-067678a5283f tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:39.964918 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-df9b42a4-5e2a-4500-8557-067678a5283f tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:39.968974 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-df9b42a4-5e2a-4500-8557-067678a5283f tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:39.972123 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-df9b42a4-5e2a-4500-8557-067678a5283f tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:39.974278 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-df9b42a4-5e2a-4500-8557-067678a5283f tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:39.976434 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-df9b42a4-5e2a-4500-8557-067678a5283f tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:42.321346 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-df9b42a4-5e2a-4500-8557-067678a5283f tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd8aa669e8847a3848a723c7890ef98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7a1e525a85411ca2ce2bce1638b463', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:42:42.334264 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-df9b42a4-5e2a-4500-8557-067678a5283f tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] 10.222.0.33 "GET /compute/v2.1/servers/251a34fb-f406-415f-8a45-d80feb48581d" status: 200 len: 1396 microversion: 2.1 time: 2.468055 Oct 04 20:42:42.334890 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1034/2126] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:42:39 2022] GET /compute/v2.1/servers/251a34fb-f406-415f-8a45-d80feb48581d => generated 1396 bytes in 2470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:42:42.347876 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-b5d7feba-18ed-4020-a146-39574f42d737 req-01c53aaa-528a-4c61-8127-9ea4e5538b55 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f1e4990-6f32-426c-bdea-ce2007c37a6f", "tag": "ade75c1b-2031-475c-af20-7442fa7b876a"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:42:42.364466 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=5 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:42:42.380100 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-b5d7feba-18ed-4020-a146-39574f42d737 req-01c53aaa-528a-4c61-8127-9ea4e5538b55 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:42.383319 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-b5d7feba-18ed-4020-a146-39574f42d737 req-01c53aaa-528a-4c61-8127-9ea4e5538b55 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:42.384087 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-b5d7feba-18ed-4020-a146-39574f42d737 req-01c53aaa-528a-4c61-8127-9ea4e5538b55 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:42.414824 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-b5d7feba-18ed-4020-a146-39574f42d737 req-01c53aaa-528a-4c61-8127-9ea4e5538b55 service nova] Creating event network-changed:ade75c1b-2031-475c-af20-7442fa7b876a for instance 8f1e4990-6f32-426c-bdea-ce2007c37a6f on n-h1-854823-8 Oct 04 20:42:42.428680 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-b5d7feba-18ed-4020-a146-39574f42d737 req-01c53aaa-528a-4c61-8127-9ea4e5538b55 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089976 Oct 04 20:42:42.432555 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1035/2127] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:42:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:42:42.458477 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-96c53929-1f98-4de2-894a-b959cfadd286 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:42.461750 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-96c53929-1f98-4de2-894a-b959cfadd286 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] [instance: 17f61077-3e1c-4d86-b364-b22e4e40b3ca] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:42:42.467487 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=7 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:42:42.485096 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-96c53929-1f98-4de2-894a-b959cfadd286 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:42.485841 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-96c53929-1f98-4de2-894a-b959cfadd286 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:42.486466 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-96c53929-1f98-4de2-894a-b959cfadd286 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:42.489640 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-96c53929-1f98-4de2-894a-b959cfadd286 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:42.490365 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-96c53929-1f98-4de2-894a-b959cfadd286 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:42.490959 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-96c53929-1f98-4de2-894a-b959cfadd286 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:42.870856 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-96c53929-1f98-4de2-894a-b959cfadd286 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '800db3a57ada47eca381b00189fdbf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66ec8ea91b04deb90b679589e0495bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:42:42.896247 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-96c53929-1f98-4de2-894a-b959cfadd286 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] 10.222.0.33 "GET /compute/v2.1/servers/17f61077-3e1c-4d86-b364-b22e4e40b3ca" status: 200 len: 1167 microversion: 2.1 time: 0.461915 Oct 04 20:42:42.903180 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1036/2128] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:42:42 2022] GET /compute/v2.1/servers/17f61077-3e1c-4d86-b364-b22e4e40b3ca => generated 1167 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:42:42.916860 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-4453d86a-ba49-42b3-a933-89a16ea864dd tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:42.917483 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-4453d86a-ba49-42b3-a933-89a16ea864dd tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] [instance: c806a6c6-6b03-4b6e-9247-75b8541ce9b4] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:42:42.931738 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4453d86a-ba49-42b3-a933-89a16ea864dd tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:42.932513 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4453d86a-ba49-42b3-a933-89a16ea864dd tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:42.932686 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4453d86a-ba49-42b3-a933-89a16ea864dd tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:42.933811 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4453d86a-ba49-42b3-a933-89a16ea864dd tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:42.934498 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4453d86a-ba49-42b3-a933-89a16ea864dd tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:42.939915 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4453d86a-ba49-42b3-a933-89a16ea864dd tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:43.737679 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-4453d86a-ba49-42b3-a933-89a16ea864dd tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73345e7aa3ec490e9266cf356dc442ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99c97de335941a4af0f09c695ab3a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:42:43.751778 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-4453d86a-ba49-42b3-a933-89a16ea864dd tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] 10.222.0.33 "GET /compute/v2.1/servers/c806a6c6-6b03-4b6e-9247-75b8541ce9b4" status: 200 len: 1523 microversion: 2.1 time: 0.847098 Oct 04 20:42:43.752823 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1037/2129] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:42:42 2022] GET /compute/v2.1/servers/c806a6c6-6b03-4b6e-9247-75b8541ce9b4 => generated 1523 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:42:43.767143 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1ee8bdc4-0a47-4e97-9de9-702d50bdd6ea tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:43.767772 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-1ee8bdc4-0a47-4e97-9de9-702d50bdd6ea tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] [instance: 8f1e4990-6f32-426c-bdea-ce2007c37a6f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:42:43.795223 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1ee8bdc4-0a47-4e97-9de9-702d50bdd6ea tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:43.795847 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1ee8bdc4-0a47-4e97-9de9-702d50bdd6ea tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:43.796290 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1ee8bdc4-0a47-4e97-9de9-702d50bdd6ea tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:43.797026 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1ee8bdc4-0a47-4e97-9de9-702d50bdd6ea tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:43.797663 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1ee8bdc4-0a47-4e97-9de9-702d50bdd6ea tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:43.798268 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1ee8bdc4-0a47-4e97-9de9-702d50bdd6ea tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:44.274528 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-1ee8bdc4-0a47-4e97-9de9-702d50bdd6ea tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:42:44.291088 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-1ee8bdc4-0a47-4e97-9de9-702d50bdd6ea tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:42:44.292642 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-1ee8bdc4-0a47-4e97-9de9-702d50bdd6ea tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:42:44.294033 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-1ee8bdc4-0a47-4e97-9de9-702d50bdd6ea tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] 10.222.0.33 "GET /compute/v2.1/servers/8f1e4990-6f32-426c-bdea-ce2007c37a6f" status: 200 len: 1485 microversion: 2.25 time: 0.540107 Oct 04 20:42:44.294748 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1038/2130] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:42:43 2022] GET /compute/v2.1/servers/8f1e4990-6f32-426c-bdea-ce2007c37a6f => generated 1485 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:42:44.409411 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9d538c54-78cb-485d-8d5e-0851b743b627 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-2034390270", "imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63", "flavorRef": "452", "networks": [{"uuid": "8041a123-3203-48c7-8a2d-6c4dad3abeb6"}]}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:42:44.525846 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.network.neutron [None req-9d538c54-78cb-485d-8d5e-0851b743b627 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] validate_networks() for [('8041a123-3203-48c7-8a2d-6c4dad3abeb6', None, None, None, None, None)] {{(pid=128801) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:42:45.907968 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-1aef5e99-10c5-4f7e-87d4-6325427fb86a tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Flavor limits 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:42:45.908449 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-1aef5e99-10c5-4f7e-87d4-6325427fb86a tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Image limits 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:42:45.908999 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-1aef5e99-10c5-4f7e-87d4-6325427fb86a tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Flavor pref 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:42:45.909488 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-1aef5e99-10c5-4f7e-87d4-6325427fb86a tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Image pref 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:42:45.912601 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-1aef5e99-10c5-4f7e-87d4-6325427fb86a tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:42:45.922392 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=3 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:42:45.945113 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1aef5e99-10c5-4f7e-87d4-6325427fb86a tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:45.945703 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1aef5e99-10c5-4f7e-87d4-6325427fb86a tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:45.946222 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1aef5e99-10c5-4f7e-87d4-6325427fb86a tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:45.947136 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1aef5e99-10c5-4f7e-87d4-6325427fb86a tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:45.948262 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1aef5e99-10c5-4f7e-87d4-6325427fb86a tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:45.948885 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1aef5e99-10c5-4f7e-87d4-6325427fb86a tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:46.009161 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-1aef5e99-10c5-4f7e-87d4-6325427fb86a tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Getting quotas for project 5392c67506f7445ab33d62b191558f7b. Resources: {'ram', 'instances', 'cores'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:42:46.021876 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-1aef5e99-10c5-4f7e-87d4-6325427fb86a tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Getting quotas for user 28399882314945d787a3af6eb59935c0 and project 5392c67506f7445ab33d62b191558f7b. Resources: {'ram', 'instances', 'cores'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:42:46.161486 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-9d538c54-78cb-485d-8d5e-0851b743b627 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Flavor limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:42:46.161950 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-9d538c54-78cb-485d-8d5e-0851b743b627 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Image limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:42:46.162397 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-9d538c54-78cb-485d-8d5e-0851b743b627 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Flavor pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:42:46.162820 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-9d538c54-78cb-485d-8d5e-0851b743b627 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Image pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:42:46.163237 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-9d538c54-78cb-485d-8d5e-0851b743b627 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:42:46.180192 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9d538c54-78cb-485d-8d5e-0851b743b627 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:46.180521 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9d538c54-78cb-485d-8d5e-0851b743b627 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:46.181177 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9d538c54-78cb-485d-8d5e-0851b743b627 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:46.182238 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9d538c54-78cb-485d-8d5e-0851b743b627 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:46.182894 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9d538c54-78cb-485d-8d5e-0851b743b627 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:46.183550 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9d538c54-78cb-485d-8d5e-0851b743b627 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:46.251801 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-9d538c54-78cb-485d-8d5e-0851b743b627 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Getting quotas for project 2f258cb1ecd049078b201eb41692735a. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:42:46.264047 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-9d538c54-78cb-485d-8d5e-0851b743b627 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Getting quotas for user 07c500628d414c9983836c33563b38bc and project 2f258cb1ecd049078b201eb41692735a. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:42:46.293153 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-9d538c54-78cb-485d-8d5e-0851b743b627 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Going to run 1 instances... {{(pid=128801) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:42:46.300433 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-9d538c54-78cb-485d-8d5e-0851b743b627 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] [instance: 659f073c-b8c2-48d3-8c09-fef755291460] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='15b24725-0c99-4bcf-b1fb-907cdf8e2d63',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128801) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:42:46.322245 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-1aef5e99-10c5-4f7e-87d4-6325427fb86a tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Going to run 1 instances... {{(pid=128802) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:42:46.325159 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-1aef5e99-10c5-4f7e-87d4-6325427fb86a tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] [instance: c0a14e22-0620-4912-9893-62974c80978a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='6de17d64-0727-486a-8fd7-3ed080e559fb',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='3095d8a0-51da-497c-85e0-35508275a4b2',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1c33d46a-02ed-40da-bf44-05e69ba5ae3a',volume_size=None,volume_type=None)] {{(pid=128802) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:42:46.429414 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-9d538c54-78cb-485d-8d5e-0851b743b627 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.133101 Oct 04 20:42:46.434651 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1039/2131] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 20:42:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 2138 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 20:42:46.452545 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6bd23efe-75de-4861-8df1-221efd723bf8 tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:46.459547 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-6bd23efe-75de-4861-8df1-221efd723bf8 tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] [instance: 251a34fb-f406-415f-8a45-d80feb48581d] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:42:46.503542 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6bd23efe-75de-4861-8df1-221efd723bf8 tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:46.504451 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6bd23efe-75de-4861-8df1-221efd723bf8 tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:46.505035 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6bd23efe-75de-4861-8df1-221efd723bf8 tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:46.508422 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6bd23efe-75de-4861-8df1-221efd723bf8 tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:46.509127 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6bd23efe-75de-4861-8df1-221efd723bf8 tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:46.509871 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6bd23efe-75de-4861-8df1-221efd723bf8 tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:47.056492 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-6bd23efe-75de-4861-8df1-221efd723bf8 tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd8aa669e8847a3848a723c7890ef98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7a1e525a85411ca2ce2bce1638b463', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:42:47.066598 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-6bd23efe-75de-4861-8df1-221efd723bf8 tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] 10.222.0.33 "GET /compute/v2.1/servers/251a34fb-f406-415f-8a45-d80feb48581d" status: 200 len: 1396 microversion: 2.1 time: 0.626868 Oct 04 20:42:47.071080 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1040/2132] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:42:46 2022] GET /compute/v2.1/servers/251a34fb-f406-415f-8a45-d80feb48581d => generated 1396 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:42:47.085373 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-57ae6bcf-e429-40c0-8c20-dae6242acf0a tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:47.085991 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-57ae6bcf-e429-40c0-8c20-dae6242acf0a tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] [instance: 17f61077-3e1c-4d86-b364-b22e4e40b3ca] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:42:47.108449 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-57ae6bcf-e429-40c0-8c20-dae6242acf0a tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:47.111140 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-57ae6bcf-e429-40c0-8c20-dae6242acf0a tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:47.111372 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-57ae6bcf-e429-40c0-8c20-dae6242acf0a tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:47.114102 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-57ae6bcf-e429-40c0-8c20-dae6242acf0a tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:47.118811 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-57ae6bcf-e429-40c0-8c20-dae6242acf0a tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:47.123517 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-57ae6bcf-e429-40c0-8c20-dae6242acf0a tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:47.187864 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-1aef5e99-10c5-4f7e-87d4-6325427fb86a tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.32 time: 14.703048 Oct 04 20:42:47.193606 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1093/2133] 10.222.0.33 () {62 vars in 1189 bytes} [Tue Oct 4 20:42:32 2022] POST /compute/v2.1/servers => generated 406 bytes in 14709 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 04 20:42:47.202558 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-38cade37-70a0-4517-85e9-8590cc4d2308 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-1812648761", "imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63", "flavorRef": "452", "networks": [{"uuid": "aae2e1d2-087f-4f2a-8d05-27693af57321"}, {"uuid": "06204289-2383-451f-914a-9a50c9e3fd78"}, {"uuid": "aae2e1d2-087f-4f2a-8d05-27693af57321"}]}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:42:47.313070 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.network.neutron [None req-38cade37-70a0-4517-85e9-8590cc4d2308 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] validate_networks() for [('aae2e1d2-087f-4f2a-8d05-27693af57321', None, None, None, None, None), ('06204289-2383-451f-914a-9a50c9e3fd78', None, None, None, None, None), ('aae2e1d2-087f-4f2a-8d05-27693af57321', None, None, None, None, None)] {{(pid=128802) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:42:47.629379 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-57ae6bcf-e429-40c0-8c20-dae6242acf0a tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '800db3a57ada47eca381b00189fdbf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66ec8ea91b04deb90b679589e0495bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:42:47.639045 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-57ae6bcf-e429-40c0-8c20-dae6242acf0a tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] 10.222.0.33 "GET /compute/v2.1/servers/17f61077-3e1c-4d86-b364-b22e4e40b3ca" status: 200 len: 1209 microversion: 2.1 time: 0.565752 Oct 04 20:42:47.650765 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1041/2134] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:42:47 2022] GET /compute/v2.1/servers/17f61077-3e1c-4d86-b364-b22e4e40b3ca => generated 1209 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:42:47.656585 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-70d30285-eb7d-4817-9d24-31cfbbc6c61e tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:47.657237 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-70d30285-eb7d-4817-9d24-31cfbbc6c61e tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] [instance: c806a6c6-6b03-4b6e-9247-75b8541ce9b4] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:42:47.673482 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-70d30285-eb7d-4817-9d24-31cfbbc6c61e tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:47.673974 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-70d30285-eb7d-4817-9d24-31cfbbc6c61e tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:47.680898 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-70d30285-eb7d-4817-9d24-31cfbbc6c61e tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:47.681860 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-70d30285-eb7d-4817-9d24-31cfbbc6c61e tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:47.691190 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-70d30285-eb7d-4817-9d24-31cfbbc6c61e tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:47.691884 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-70d30285-eb7d-4817-9d24-31cfbbc6c61e tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:48.138904 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-70d30285-eb7d-4817-9d24-31cfbbc6c61e tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73345e7aa3ec490e9266cf356dc442ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99c97de335941a4af0f09c695ab3a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:42:48.150545 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-70d30285-eb7d-4817-9d24-31cfbbc6c61e tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] 10.222.0.33 "GET /compute/v2.1/servers/c806a6c6-6b03-4b6e-9247-75b8541ce9b4" status: 200 len: 1523 microversion: 2.1 time: 0.496721 Oct 04 20:42:48.151224 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1042/2135] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:42:47 2022] GET /compute/v2.1/servers/c806a6c6-6b03-4b6e-9247-75b8541ce9b4 => generated 1523 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:42:48.169831 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8816c056-fb86-4170-851f-a55797602fa2 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:48.171897 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-8816c056-fb86-4170-851f-a55797602fa2 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] [instance: 8f1e4990-6f32-426c-bdea-ce2007c37a6f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:42:48.195222 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8816c056-fb86-4170-851f-a55797602fa2 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:48.198533 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8816c056-fb86-4170-851f-a55797602fa2 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:48.199096 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8816c056-fb86-4170-851f-a55797602fa2 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:48.199838 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8816c056-fb86-4170-851f-a55797602fa2 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:48.200726 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8816c056-fb86-4170-851f-a55797602fa2 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:48.201215 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8816c056-fb86-4170-851f-a55797602fa2 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:48.223021 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:42:48.743047 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-8816c056-fb86-4170-851f-a55797602fa2 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:42:48.759196 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-8816c056-fb86-4170-851f-a55797602fa2 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:42:48.760878 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-8816c056-fb86-4170-851f-a55797602fa2 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:42:48.764321 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-8816c056-fb86-4170-851f-a55797602fa2 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] 10.222.0.33 "GET /compute/v2.1/servers/8f1e4990-6f32-426c-bdea-ce2007c37a6f" status: 200 len: 1475 microversion: 2.25 time: 0.612108 Oct 04 20:42:48.775196 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1043/2136] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:42:48 2022] GET /compute/v2.1/servers/8f1e4990-6f32-426c-bdea-ce2007c37a6f => generated 1475 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:42:48.780987 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-761bc5cb-49a0-4280-8fe5-38cf350f7233 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:48.781493 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-761bc5cb-49a0-4280-8fe5-38cf350f7233 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] [instance: 659f073c-b8c2-48d3-8c09-fef755291460] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:42:48.800430 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-761bc5cb-49a0-4280-8fe5-38cf350f7233 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:48.800942 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-761bc5cb-49a0-4280-8fe5-38cf350f7233 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:48.801390 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-761bc5cb-49a0-4280-8fe5-38cf350f7233 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:48.802386 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-761bc5cb-49a0-4280-8fe5-38cf350f7233 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:48.802926 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-761bc5cb-49a0-4280-8fe5-38cf350f7233 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:48.803495 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-761bc5cb-49a0-4280-8fe5-38cf350f7233 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:48.973438 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-761bc5cb-49a0-4280-8fe5-38cf350f7233 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07c500628d414c9983836c33563b38bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f258cb1ecd049078b201eb41692735a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:42:48.983209 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-761bc5cb-49a0-4280-8fe5-38cf350f7233 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] 10.222.0.33 "GET /compute/v2.1/servers/659f073c-b8c2-48d3-8c09-fef755291460" status: 200 len: 1284 microversion: 2.1 time: 0.206276 Oct 04 20:42:49.002891 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1044/2137] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:42:48 2022] GET /compute/v2.1/servers/659f073c-b8c2-48d3-8c09-fef755291460 => generated 1284 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:42:49.021737 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-87771794-e97b-4b0a-b7ea-71d98352efc7 req-4840fa43-234f-429f-8909-0d96384485b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "251a34fb-f406-415f-8a45-d80feb48581d", "name": "network-vif-plugged", "status": "completed", "tag": "47d205c9-2575-420f-bb45-a99478492ca2"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:42:49.035122 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-87771794-e97b-4b0a-b7ea-71d98352efc7 req-4840fa43-234f-429f-8909-0d96384485b7 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:49.035635 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-87771794-e97b-4b0a-b7ea-71d98352efc7 req-4840fa43-234f-429f-8909-0d96384485b7 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:49.036075 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-87771794-e97b-4b0a-b7ea-71d98352efc7 req-4840fa43-234f-429f-8909-0d96384485b7 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:49.080692 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-87771794-e97b-4b0a-b7ea-71d98352efc7 req-4840fa43-234f-429f-8909-0d96384485b7 service nova] Creating event network-vif-plugged:47d205c9-2575-420f-bb45-a99478492ca2 for instance 251a34fb-f406-415f-8a45-d80feb48581d on n-h1-854823-8 Oct 04 20:42:49.087161 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-87771794-e97b-4b0a-b7ea-71d98352efc7 req-4840fa43-234f-429f-8909-0d96384485b7 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082847 Oct 04 20:42:49.089683 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1045/2138] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:42:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:42:49.106666 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d7f98c99-9efc-46a2-b9b1-47cfef070582 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:49.120210 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d7f98c99-9efc-46a2-b9b1-47cfef070582 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] [instance: c0a14e22-0620-4912-9893-62974c80978a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:42:49.143330 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d7f98c99-9efc-46a2-b9b1-47cfef070582 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:49.143834 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d7f98c99-9efc-46a2-b9b1-47cfef070582 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:49.144354 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d7f98c99-9efc-46a2-b9b1-47cfef070582 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:49.145079 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d7f98c99-9efc-46a2-b9b1-47cfef070582 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:49.148298 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d7f98c99-9efc-46a2-b9b1-47cfef070582 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:49.148802 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d7f98c99-9efc-46a2-b9b1-47cfef070582 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:49.484638 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d7f98c99-9efc-46a2-b9b1-47cfef070582 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28399882314945d787a3af6eb59935c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5392c67506f7445ab33d62b191558f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:42:49.500589 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d7f98c99-9efc-46a2-b9b1-47cfef070582 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28399882314945d787a3af6eb59935c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5392c67506f7445ab33d62b191558f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:42:49.502467 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d7f98c99-9efc-46a2-b9b1-47cfef070582 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28399882314945d787a3af6eb59935c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5392c67506f7445ab33d62b191558f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:42:49.507190 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d7f98c99-9efc-46a2-b9b1-47cfef070582 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] 10.222.0.33 "GET /compute/v2.1/servers/c0a14e22-0620-4912-9893-62974c80978a" status: 200 len: 1519 microversion: 2.32 time: 0.416065 Oct 04 20:42:49.508291 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1046/2139] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:42:49 2022] GET /compute/v2.1/servers/c0a14e22-0620-4912-9893-62974c80978a => generated 1519 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:42:49.521253 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b8b73cce-a58d-456a-b161-1bc60e02c64b tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-537305105", "imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1b6eb29e-dbc2-4007-8946-b5a4c5a89268"}], "security_groups": [{"name": "tempest-securitygroup--397507589"}], "key_name": "tempest-keypair-738414864", "user_data": "}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:42:49.916145 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.network.neutron [None req-b8b73cce-a58d-456a-b161-1bc60e02c64b tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] validate_networks() for [('1b6eb29e-dbc2-4007-8946-b5a4c5a89268', None, None, None, None, None)] {{(pid=128801) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:42:50.101866 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-38cade37-70a0-4517-85e9-8590cc4d2308 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Flavor limits 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:42:50.102908 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-38cade37-70a0-4517-85e9-8590cc4d2308 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Image limits 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:42:50.104039 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-38cade37-70a0-4517-85e9-8590cc4d2308 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Flavor pref 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:42:50.104204 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-38cade37-70a0-4517-85e9-8590cc4d2308 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Image pref 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:42:50.105024 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-38cade37-70a0-4517-85e9-8590cc4d2308 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:42:50.126262 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-38cade37-70a0-4517-85e9-8590cc4d2308 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:50.127217 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-38cade37-70a0-4517-85e9-8590cc4d2308 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:50.127889 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-38cade37-70a0-4517-85e9-8590cc4d2308 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:50.128738 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-38cade37-70a0-4517-85e9-8590cc4d2308 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:50.129295 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-38cade37-70a0-4517-85e9-8590cc4d2308 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:50.129729 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-38cade37-70a0-4517-85e9-8590cc4d2308 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:50.183789 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-38cade37-70a0-4517-85e9-8590cc4d2308 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Getting quotas for project a6a44744f2bb4130b9a49065b49cf854. Resources: {'ram', 'instances', 'cores'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:42:50.202580 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-38cade37-70a0-4517-85e9-8590cc4d2308 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Getting quotas for user e3e1e240b20e41e8b90e0d630e0d6b46 and project a6a44744f2bb4130b9a49065b49cf854. Resources: {'ram', 'instances', 'cores'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:42:50.261511 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-38cade37-70a0-4517-85e9-8590cc4d2308 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Going to run 1 instances... {{(pid=128802) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:42:50.267676 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-38cade37-70a0-4517-85e9-8590cc4d2308 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] [instance: 2bae38c5-cec9-444b-8879-dcb7eb2822e6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='15b24725-0c99-4bcf-b1fb-907cdf8e2d63',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128802) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:42:50.444240 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-38cade37-70a0-4517-85e9-8590cc4d2308 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.249452 Oct 04 20:42:50.444980 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1094/2140] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 20:42:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 3251 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 20:42:50.480312 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-1bd9d655-b4fa-453a-94e9-a947e5d63596 req-54f4c8a1-21a8-4bcb-898b-5abb66647ee3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17f61077-3e1c-4d86-b364-b22e4e40b3ca", "tag": "f185090f-7c96-46b5-b51f-76a45035b6a4"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:42:50.510870 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-1bd9d655-b4fa-453a-94e9-a947e5d63596 req-54f4c8a1-21a8-4bcb-898b-5abb66647ee3 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:50.511364 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-1bd9d655-b4fa-453a-94e9-a947e5d63596 req-54f4c8a1-21a8-4bcb-898b-5abb66647ee3 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:50.511841 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-1bd9d655-b4fa-453a-94e9-a947e5d63596 req-54f4c8a1-21a8-4bcb-898b-5abb66647ee3 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:50.526328 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-1bd9d655-b4fa-453a-94e9-a947e5d63596 req-54f4c8a1-21a8-4bcb-898b-5abb66647ee3 service nova] Creating event network-changed:f185090f-7c96-46b5-b51f-76a45035b6a4 for instance 17f61077-3e1c-4d86-b364-b22e4e40b3ca on n-h1-854823-8 Oct 04 20:42:50.563702 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-1bd9d655-b4fa-453a-94e9-a947e5d63596 req-54f4c8a1-21a8-4bcb-898b-5abb66647ee3 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117178 Oct 04 20:42:50.564723 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1095/2141] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:42:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:42:50.570545 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-f4c900b7-9ccd-44b7-98f1-4a363f2a6491 tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:50.571491 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-f4c900b7-9ccd-44b7-98f1-4a363f2a6491 tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] [instance: 251a34fb-f406-415f-8a45-d80feb48581d] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:42:50.611819 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f4c900b7-9ccd-44b7-98f1-4a363f2a6491 tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:50.612385 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f4c900b7-9ccd-44b7-98f1-4a363f2a6491 tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:50.612890 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f4c900b7-9ccd-44b7-98f1-4a363f2a6491 tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:50.613944 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f4c900b7-9ccd-44b7-98f1-4a363f2a6491 tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:50.614432 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f4c900b7-9ccd-44b7-98f1-4a363f2a6491 tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:50.615122 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f4c900b7-9ccd-44b7-98f1-4a363f2a6491 tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:51.397453 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-f4c900b7-9ccd-44b7-98f1-4a363f2a6491 tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd8aa669e8847a3848a723c7890ef98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7a1e525a85411ca2ce2bce1638b463', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:42:51.416232 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-f4c900b7-9ccd-44b7-98f1-4a363f2a6491 tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] 10.222.0.33 "GET /compute/v2.1/servers/251a34fb-f406-415f-8a45-d80feb48581d" status: 200 len: 1396 microversion: 2.1 time: 0.850175 Oct 04 20:42:51.422368 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1096/2142] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:42:50 2022] GET /compute/v2.1/servers/251a34fb-f406-415f-8a45-d80feb48581d => generated 1396 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:42:51.430832 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-b63cb8e1-a6cc-4a84-ae96-9906e0218c0a tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:51.437795 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-b63cb8e1-a6cc-4a84-ae96-9906e0218c0a tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] [instance: 17f61077-3e1c-4d86-b364-b22e4e40b3ca] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:42:51.454216 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b63cb8e1-a6cc-4a84-ae96-9906e0218c0a tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:51.456959 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b63cb8e1-a6cc-4a84-ae96-9906e0218c0a tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:51.457614 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b63cb8e1-a6cc-4a84-ae96-9906e0218c0a tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:51.465818 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b63cb8e1-a6cc-4a84-ae96-9906e0218c0a tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:51.467362 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b63cb8e1-a6cc-4a84-ae96-9906e0218c0a tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:51.467996 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b63cb8e1-a6cc-4a84-ae96-9906e0218c0a tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:51.590740 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-b8b73cce-a58d-456a-b161-1bc60e02c64b tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Flavor limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:42:51.592189 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-b8b73cce-a58d-456a-b161-1bc60e02c64b tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Image limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:42:51.592805 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-b8b73cce-a58d-456a-b161-1bc60e02c64b tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Flavor pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:42:51.593655 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-b8b73cce-a58d-456a-b161-1bc60e02c64b tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Image pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:42:51.594455 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-b8b73cce-a58d-456a-b161-1bc60e02c64b tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:42:51.623337 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b8b73cce-a58d-456a-b161-1bc60e02c64b tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:51.624085 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b8b73cce-a58d-456a-b161-1bc60e02c64b tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:51.624596 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b8b73cce-a58d-456a-b161-1bc60e02c64b tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:51.625423 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b8b73cce-a58d-456a-b161-1bc60e02c64b tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:51.627475 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b8b73cce-a58d-456a-b161-1bc60e02c64b tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:51.628206 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b8b73cce-a58d-456a-b161-1bc60e02c64b tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:51.653153 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-b8b73cce-a58d-456a-b161-1bc60e02c64b tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Getting quotas for project fc7f38600b5041ad8e66a12d77b940fa. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:42:51.660368 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-b8b73cce-a58d-456a-b161-1bc60e02c64b tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Getting quotas for user d9e4b00964014a0383f79597652bd428 and project fc7f38600b5041ad8e66a12d77b940fa. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:42:51.674587 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b8b73cce-a58d-456a-b161-1bc60e02c64b tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Going to run 1 instances... {{(pid=128801) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:42:51.677474 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b8b73cce-a58d-456a-b161-1bc60e02c64b tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] [instance: d849cb42-dfe6-4225-814a-90bef2839739] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='15b24725-0c99-4bcf-b1fb-907cdf8e2d63',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128801) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:42:51.754739 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b8b73cce-a58d-456a-b161-1bc60e02c64b tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.243137 Oct 04 20:42:51.756471 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1047/2143] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 20:42:49 2022] POST /compute/v2.1/servers => generated 401 bytes in 2247 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 20:42:51.761138 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c90fbeaf-7fa3-4e83-9b8f-16202a6170b4 tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] Calling method '.version_select at 0x7f3c74424940>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:51.773230 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c90fbeaf-7fa3-4e83-9b8f-16202a6170b4 tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:51.774097 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c90fbeaf-7fa3-4e83-9b8f-16202a6170b4 tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:51.786493 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c90fbeaf-7fa3-4e83-9b8f-16202a6170b4 tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:51.829510 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c90fbeaf-7fa3-4e83-9b8f-16202a6170b4 tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] 10.222.0.33 "GET /compute/v2.1/os-migrations" status: 200 len: 2958 microversion: 2.25 time: 0.070094 Oct 04 20:42:51.831723 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1048/2144] 10.222.0.33 () {60 vars in 1184 bytes} [Tue Oct 4 20:42:51 2022] GET /compute/v2.1/os-migrations => generated 2958 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:42:51.844008 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ffe7edf2-04ba-4db9-933d-a88bf8e811e3 tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:51.845894 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ffe7edf2-04ba-4db9-933d-a88bf8e811e3 tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] [instance: c806a6c6-6b03-4b6e-9247-75b8541ce9b4] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:42:51.862411 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ffe7edf2-04ba-4db9-933d-a88bf8e811e3 tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:51.863108 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ffe7edf2-04ba-4db9-933d-a88bf8e811e3 tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:51.863549 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ffe7edf2-04ba-4db9-933d-a88bf8e811e3 tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:51.864266 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ffe7edf2-04ba-4db9-933d-a88bf8e811e3 tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:51.864724 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ffe7edf2-04ba-4db9-933d-a88bf8e811e3 tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:51.865152 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ffe7edf2-04ba-4db9-933d-a88bf8e811e3 tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:52.010880 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-b63cb8e1-a6cc-4a84-ae96-9906e0218c0a tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '800db3a57ada47eca381b00189fdbf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66ec8ea91b04deb90b679589e0495bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:42:52.019428 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-b63cb8e1-a6cc-4a84-ae96-9906e0218c0a tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] 10.222.0.33 "GET /compute/v2.1/servers/17f61077-3e1c-4d86-b364-b22e4e40b3ca" status: 200 len: 1209 microversion: 2.1 time: 0.595560 Oct 04 20:42:52.030044 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1097/2145] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:42:51 2022] GET /compute/v2.1/servers/17f61077-3e1c-4d86-b364-b22e4e40b3ca => generated 1209 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:42:52.034683 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-7a30098c-81e3-44f7-9f6f-237848791f59 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:52.035551 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-7a30098c-81e3-44f7-9f6f-237848791f59 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] [instance: 659f073c-b8c2-48d3-8c09-fef755291460] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:42:52.052870 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7a30098c-81e3-44f7-9f6f-237848791f59 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:52.053413 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7a30098c-81e3-44f7-9f6f-237848791f59 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:52.053932 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7a30098c-81e3-44f7-9f6f-237848791f59 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:52.054790 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7a30098c-81e3-44f7-9f6f-237848791f59 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:52.055242 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7a30098c-81e3-44f7-9f6f-237848791f59 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:52.055672 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7a30098c-81e3-44f7-9f6f-237848791f59 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:53.082174 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-ffe7edf2-04ba-4db9-933d-a88bf8e811e3 tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73345e7aa3ec490e9266cf356dc442ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99c97de335941a4af0f09c695ab3a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:42:53.095542 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ffe7edf2-04ba-4db9-933d-a88bf8e811e3 tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] 10.222.0.33 "GET /compute/v2.1/servers/c806a6c6-6b03-4b6e-9247-75b8541ce9b4" status: 200 len: 1523 microversion: 2.1 time: 1.262450 Oct 04 20:42:53.096511 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1049/2146] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:42:51 2022] GET /compute/v2.1/servers/c806a6c6-6b03-4b6e-9247-75b8541ce9b4 => generated 1523 bytes in 1264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:42:53.101470 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f5283e5c-820f-461e-83af-6f126240ae54 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:53.102328 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f5283e5c-820f-461e-83af-6f126240ae54 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] [instance: 2bae38c5-cec9-444b-8879-dcb7eb2822e6] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:42:53.109425 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f5283e5c-820f-461e-83af-6f126240ae54 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:53.110199 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f5283e5c-820f-461e-83af-6f126240ae54 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:53.110964 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f5283e5c-820f-461e-83af-6f126240ae54 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:53.111896 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f5283e5c-820f-461e-83af-6f126240ae54 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:53.112558 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f5283e5c-820f-461e-83af-6f126240ae54 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:53.113191 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f5283e5c-820f-461e-83af-6f126240ae54 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:53.223406 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f5283e5c-820f-461e-83af-6f126240ae54 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e1e240b20e41e8b90e0d630e0d6b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a44744f2bb4130b9a49065b49cf854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:42:53.231457 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f5283e5c-820f-461e-83af-6f126240ae54 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] 10.222.0.33 "GET /compute/v2.1/servers/2bae38c5-cec9-444b-8879-dcb7eb2822e6" status: 200 len: 1265 microversion: 2.1 time: 0.133635 Oct 04 20:42:53.233052 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1050/2147] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:42:53 2022] GET /compute/v2.1/servers/2bae38c5-cec9-444b-8879-dcb7eb2822e6 => generated 1265 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:42:53.238312 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ad2410f9-7178-46ba-9a3d-54fc33bc2199 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:53.238958 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ad2410f9-7178-46ba-9a3d-54fc33bc2199 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] [instance: c0a14e22-0620-4912-9893-62974c80978a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:42:53.247453 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-7a30098c-81e3-44f7-9f6f-237848791f59 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07c500628d414c9983836c33563b38bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f258cb1ecd049078b201eb41692735a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:42:53.257727 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-7a30098c-81e3-44f7-9f6f-237848791f59 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] 10.222.0.33 "GET /compute/v2.1/servers/659f073c-b8c2-48d3-8c09-fef755291460" status: 200 len: 1324 microversion: 2.1 time: 1.229768 Oct 04 20:42:53.259633 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ad2410f9-7178-46ba-9a3d-54fc33bc2199 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:53.260299 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ad2410f9-7178-46ba-9a3d-54fc33bc2199 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:53.261032 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ad2410f9-7178-46ba-9a3d-54fc33bc2199 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:53.261909 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ad2410f9-7178-46ba-9a3d-54fc33bc2199 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:53.277462 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ad2410f9-7178-46ba-9a3d-54fc33bc2199 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:53.281257 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1098/2148] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:42:52 2022] GET /compute/v2.1/servers/659f073c-b8c2-48d3-8c09-fef755291460 => generated 1324 bytes in 1250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:42:53.286978 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ad2410f9-7178-46ba-9a3d-54fc33bc2199 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:53.294554 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-08c32e08-178d-4ccb-bd26-365b43edb783 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:53.295881 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-08c32e08-178d-4ccb-bd26-365b43edb783 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] [instance: d849cb42-dfe6-4225-814a-90bef2839739] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:42:53.304066 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-08c32e08-178d-4ccb-bd26-365b43edb783 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:53.305748 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-08c32e08-178d-4ccb-bd26-365b43edb783 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:53.306721 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-08c32e08-178d-4ccb-bd26-365b43edb783 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:53.307857 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-08c32e08-178d-4ccb-bd26-365b43edb783 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:53.308537 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-08c32e08-178d-4ccb-bd26-365b43edb783 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:53.309250 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-08c32e08-178d-4ccb-bd26-365b43edb783 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:53.527391 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-08c32e08-178d-4ccb-bd26-365b43edb783 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e4b00964014a0383f79597652bd428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7f38600b5041ad8e66a12d77b940fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:42:53.540595 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-08c32e08-178d-4ccb-bd26-365b43edb783 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] 10.222.0.33 "GET /compute/v2.1/servers/d849cb42-dfe6-4225-814a-90bef2839739" status: 200 len: 1236 microversion: 2.1 time: 0.257841 Oct 04 20:42:53.543368 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1099/2149] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:42:53 2022] GET /compute/v2.1/servers/d849cb42-dfe6-4225-814a-90bef2839739 => generated 1236 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:42:53.561708 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-ad2410f9-7178-46ba-9a3d-54fc33bc2199 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28399882314945d787a3af6eb59935c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5392c67506f7445ab33d62b191558f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:42:53.566774 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-e2f2c4b1-daf8-42fa-b7b5-6cc439266f56 tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:53.567754 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-e2f2c4b1-daf8-42fa-b7b5-6cc439266f56 tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] [instance: 8f1e4990-6f32-426c-bdea-ce2007c37a6f] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:42:53.583865 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-ad2410f9-7178-46ba-9a3d-54fc33bc2199 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28399882314945d787a3af6eb59935c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5392c67506f7445ab33d62b191558f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:42:53.587884 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-ad2410f9-7178-46ba-9a3d-54fc33bc2199 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28399882314945d787a3af6eb59935c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5392c67506f7445ab33d62b191558f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:42:53.593495 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ad2410f9-7178-46ba-9a3d-54fc33bc2199 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] 10.222.0.33 "GET /compute/v2.1/servers/c0a14e22-0620-4912-9893-62974c80978a" status: 200 len: 1593 microversion: 2.32 time: 0.358606 Oct 04 20:42:53.594778 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e2f2c4b1-daf8-42fa-b7b5-6cc439266f56 tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:53.595899 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e2f2c4b1-daf8-42fa-b7b5-6cc439266f56 tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:53.595899 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e2f2c4b1-daf8-42fa-b7b5-6cc439266f56 tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:53.599104 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1051/2150] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:42:53 2022] GET /compute/v2.1/servers/c0a14e22-0620-4912-9893-62974c80978a => generated 1593 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:42:53.611150 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e2f2c4b1-daf8-42fa-b7b5-6cc439266f56 tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:53.612303 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e2f2c4b1-daf8-42fa-b7b5-6cc439266f56 tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:53.615327 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-041c70f2-4d04-46eb-8cb2-81f199a1ec79 tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:53.616149 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-041c70f2-4d04-46eb-8cb2-81f199a1ec79 tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] [instance: 251a34fb-f406-415f-8a45-d80feb48581d] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:42:53.619841 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e2f2c4b1-daf8-42fa-b7b5-6cc439266f56 tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:53.627754 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-041c70f2-4d04-46eb-8cb2-81f199a1ec79 tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:53.628504 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-041c70f2-4d04-46eb-8cb2-81f199a1ec79 tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:53.629270 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-041c70f2-4d04-46eb-8cb2-81f199a1ec79 tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:53.630216 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-041c70f2-4d04-46eb-8cb2-81f199a1ec79 tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:53.630918 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-041c70f2-4d04-46eb-8cb2-81f199a1ec79 tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:53.631655 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-041c70f2-4d04-46eb-8cb2-81f199a1ec79 tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:54.040087 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-041c70f2-4d04-46eb-8cb2-81f199a1ec79 tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd8aa669e8847a3848a723c7890ef98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7a1e525a85411ca2ce2bce1638b463', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:42:54.048473 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-041c70f2-4d04-46eb-8cb2-81f199a1ec79 tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] 10.222.0.33 "GET /compute/v2.1/servers/251a34fb-f406-415f-8a45-d80feb48581d" status: 200 len: 1576 microversion: 2.1 time: 0.447985 Oct 04 20:42:54.049877 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1052/2151] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:42:53 2022] GET /compute/v2.1/servers/251a34fb-f406-415f-8a45-d80feb48581d => generated 1576 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:42:54.055941 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6bf05ef6-979f-48ca-9439-764363bc3a72 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:54.056209 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.objects.instance [None req-e2f2c4b1-daf8-42fa-b7b5-6cc439266f56 tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] Lazy-loading 'services' on Instance uuid 8f1e4990-6f32-426c-bdea-ce2007c37a6f {{(pid=128802) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:42:54.056846 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-6bf05ef6-979f-48ca-9439-764363bc3a72 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] [instance: 17f61077-3e1c-4d86-b364-b22e4e40b3ca] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:42:54.065725 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6bf05ef6-979f-48ca-9439-764363bc3a72 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:54.067031 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6bf05ef6-979f-48ca-9439-764363bc3a72 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:54.067717 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6bf05ef6-979f-48ca-9439-764363bc3a72 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:54.068717 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6bf05ef6-979f-48ca-9439-764363bc3a72 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:54.069319 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6bf05ef6-979f-48ca-9439-764363bc3a72 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:54.069905 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6bf05ef6-979f-48ca-9439-764363bc3a72 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:54.074901 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-e2f2c4b1-daf8-42fa-b7b5-6cc439266f56 tempest-LiveAutoBlockMigrationV225Test-661800215 tempest-LiveAutoBlockMigrationV225Test-661800215-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/8f1e4990-6f32-426c-bdea-ce2007c37a6f" status: 200 len: 1967 microversion: 2.25 time: 0.528821 Oct 04 20:42:54.092078 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1100/2152] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:42:53 2022] GET /compute/v2.1/servers/8f1e4990-6f32-426c-bdea-ce2007c37a6f => generated 1967 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:42:54.101822 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-501a0636-06e3-41a2-a7e0-a2c9cf2bb322 req-fb7affcc-5a73-453b-ab91-627e2db1ac77 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "659f073c-b8c2-48d3-8c09-fef755291460", "tag": "267a2eeb-d782-40d7-865d-522dfe433aa5"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:42:54.120136 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-501a0636-06e3-41a2-a7e0-a2c9cf2bb322 req-fb7affcc-5a73-453b-ab91-627e2db1ac77 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:54.120700 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-501a0636-06e3-41a2-a7e0-a2c9cf2bb322 req-fb7affcc-5a73-453b-ab91-627e2db1ac77 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:54.121195 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-501a0636-06e3-41a2-a7e0-a2c9cf2bb322 req-fb7affcc-5a73-453b-ab91-627e2db1ac77 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:54.135654 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-501a0636-06e3-41a2-a7e0-a2c9cf2bb322 req-fb7affcc-5a73-453b-ab91-627e2db1ac77 service nova] Creating event network-changed:267a2eeb-d782-40d7-865d-522dfe433aa5 for instance 659f073c-b8c2-48d3-8c09-fef755291460 on n-h2-854823-8 Oct 04 20:42:54.141090 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-501a0636-06e3-41a2-a7e0-a2c9cf2bb322 req-fb7affcc-5a73-453b-ab91-627e2db1ac77 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047155 Oct 04 20:42:54.141768 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1101/2153] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:42:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:42:54.150114 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-65e1efa0-1c92-4692-b789-e450f8d7aae3 tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:54.150887 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-65e1efa0-1c92-4692-b789-e450f8d7aae3 tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] [instance: 251a34fb-f406-415f-8a45-d80feb48581d] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:42:54.158024 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-65e1efa0-1c92-4692-b789-e450f8d7aae3 tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:54.158537 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-65e1efa0-1c92-4692-b789-e450f8d7aae3 tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:54.158966 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-65e1efa0-1c92-4692-b789-e450f8d7aae3 tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:54.159905 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-65e1efa0-1c92-4692-b789-e450f8d7aae3 tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:54.160442 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-65e1efa0-1c92-4692-b789-e450f8d7aae3 tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:54.160926 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-65e1efa0-1c92-4692-b789-e450f8d7aae3 tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:54.308277 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-65e1efa0-1c92-4692-b789-e450f8d7aae3 tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] 10.222.0.33 "GET /compute/v2.1/servers/251a34fb-f406-415f-8a45-d80feb48581d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.162267 Oct 04 20:42:54.309397 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1102/2154] 10.222.0.33 () {58 vars in 1275 bytes} [Tue Oct 4 20:42:54 2022] GET /compute/v2.1/servers/251a34fb-f406-415f-8a45-d80feb48581d/os-interface => generated 284 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:42:54.333746 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-62031a40-2056-4f16-9e07-fb113ab9257d tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:54.334652 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-62031a40-2056-4f16-9e07-fb113ab9257d tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] [instance: 8f1e4990-6f32-426c-bdea-ce2007c37a6f] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:42:54.344377 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-6bf05ef6-979f-48ca-9439-764363bc3a72 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '800db3a57ada47eca381b00189fdbf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66ec8ea91b04deb90b679589e0495bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:42:54.346713 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-62031a40-2056-4f16-9e07-fb113ab9257d tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:54.347202 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-62031a40-2056-4f16-9e07-fb113ab9257d tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:54.347633 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-62031a40-2056-4f16-9e07-fb113ab9257d tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:54.348339 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-62031a40-2056-4f16-9e07-fb113ab9257d tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:54.348789 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-62031a40-2056-4f16-9e07-fb113ab9257d tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:54.349203 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-62031a40-2056-4f16-9e07-fb113ab9257d tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:54.366974 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-6bf05ef6-979f-48ca-9439-764363bc3a72 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] 10.222.0.33 "GET /compute/v2.1/servers/17f61077-3e1c-4d86-b364-b22e4e40b3ca" status: 200 len: 1197 microversion: 2.1 time: 0.315838 Oct 04 20:42:54.389017 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1053/2155] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:42:54 2022] GET /compute/v2.1/servers/17f61077-3e1c-4d86-b364-b22e4e40b3ca => generated 1197 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:42:54.394405 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a795041a-81f5-499a-811f-95833c768701 tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:54.400244 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a795041a-81f5-499a-811f-95833c768701 tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] [instance: c806a6c6-6b03-4b6e-9247-75b8541ce9b4] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:42:54.410913 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a795041a-81f5-499a-811f-95833c768701 tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:54.414016 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a795041a-81f5-499a-811f-95833c768701 tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:54.414731 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a795041a-81f5-499a-811f-95833c768701 tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:54.415618 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-62031a40-2056-4f16-9e07-fb113ab9257d tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] [instance: 8f1e4990-6f32-426c-bdea-ce2007c37a6f] Going to try to terminate instance {{(pid=128802) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:42:54.417819 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a795041a-81f5-499a-811f-95833c768701 tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:54.418495 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a795041a-81f5-499a-811f-95833c768701 tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:54.420036 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a795041a-81f5-499a-811f-95833c768701 tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:54.697635 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-62031a40-2056-4f16-9e07-fb113ab9257d tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] 10.222.0.33 "DELETE /compute/v2.1/servers/8f1e4990-6f32-426c-bdea-ce2007c37a6f" status: 204 len: 0 microversion: 2.25 time: 0.384051 Oct 04 20:42:54.708979 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1103/2156] 10.222.0.33 () {60 vars in 1280 bytes} [Tue Oct 4 20:42:54 2022] DELETE /compute/v2.1/servers/8f1e4990-6f32-426c-bdea-ce2007c37a6f => generated 0 bytes in 398 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 20:42:54.720448 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-4955858e-b299-4946-b8a6-9ad032c642ea tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:54.725702 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-4955858e-b299-4946-b8a6-9ad032c642ea tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] [instance: 2bae38c5-cec9-444b-8879-dcb7eb2822e6] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:42:54.736381 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4955858e-b299-4946-b8a6-9ad032c642ea tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:54.741825 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4955858e-b299-4946-b8a6-9ad032c642ea tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:54.742664 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4955858e-b299-4946-b8a6-9ad032c642ea tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:54.743679 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4955858e-b299-4946-b8a6-9ad032c642ea tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:54.744626 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4955858e-b299-4946-b8a6-9ad032c642ea tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:54.745039 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4955858e-b299-4946-b8a6-9ad032c642ea tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:54.790207 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-a795041a-81f5-499a-811f-95833c768701 tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73345e7aa3ec490e9266cf356dc442ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99c97de335941a4af0f09c695ab3a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:42:54.802144 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a795041a-81f5-499a-811f-95833c768701 tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] 10.222.0.33 "GET /compute/v2.1/servers/c806a6c6-6b03-4b6e-9247-75b8541ce9b4" status: 200 len: 1523 microversion: 2.1 time: 0.411571 Oct 04 20:42:54.807486 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1054/2157] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:42:54 2022] GET /compute/v2.1/servers/c806a6c6-6b03-4b6e-9247-75b8541ce9b4 => generated 1523 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:42:54.823268 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-102738c4-5f75-45cb-8aa2-3185279eb7e7 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:54.824915 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-102738c4-5f75-45cb-8aa2-3185279eb7e7 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] [instance: 659f073c-b8c2-48d3-8c09-fef755291460] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:42:54.837149 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-102738c4-5f75-45cb-8aa2-3185279eb7e7 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:54.837918 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-102738c4-5f75-45cb-8aa2-3185279eb7e7 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:54.838588 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-102738c4-5f75-45cb-8aa2-3185279eb7e7 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:54.840311 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-102738c4-5f75-45cb-8aa2-3185279eb7e7 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:54.841502 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-102738c4-5f75-45cb-8aa2-3185279eb7e7 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:54.842947 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-102738c4-5f75-45cb-8aa2-3185279eb7e7 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:54.932202 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-4955858e-b299-4946-b8a6-9ad032c642ea tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e1e240b20e41e8b90e0d630e0d6b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a44744f2bb4130b9a49065b49cf854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:42:54.945924 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-4955858e-b299-4946-b8a6-9ad032c642ea tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] 10.222.0.33 "GET /compute/v2.1/servers/2bae38c5-cec9-444b-8879-dcb7eb2822e6" status: 200 len: 1271 microversion: 2.1 time: 0.232458 Oct 04 20:42:54.949122 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1104/2158] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:42:54 2022] GET /compute/v2.1/servers/2bae38c5-cec9-444b-8879-dcb7eb2822e6 => generated 1271 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:42:54.955261 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-a811109b-6157-4524-ba2d-434139d43305 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:54.958961 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-a811109b-6157-4524-ba2d-434139d43305 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] [instance: d849cb42-dfe6-4225-814a-90bef2839739] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:42:54.968901 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a811109b-6157-4524-ba2d-434139d43305 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:54.969391 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a811109b-6157-4524-ba2d-434139d43305 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:54.969829 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a811109b-6157-4524-ba2d-434139d43305 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:54.970583 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a811109b-6157-4524-ba2d-434139d43305 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:54.971204 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a811109b-6157-4524-ba2d-434139d43305 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:54.971803 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a811109b-6157-4524-ba2d-434139d43305 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:55.252002 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-a811109b-6157-4524-ba2d-434139d43305 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e4b00964014a0383f79597652bd428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7f38600b5041ad8e66a12d77b940fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:42:55.265059 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-a811109b-6157-4524-ba2d-434139d43305 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] 10.222.0.33 "GET /compute/v2.1/servers/d849cb42-dfe6-4225-814a-90bef2839739" status: 200 len: 1292 microversion: 2.1 time: 0.314619 Oct 04 20:42:55.281744 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1105/2159] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:42:54 2022] GET /compute/v2.1/servers/d849cb42-dfe6-4225-814a-90bef2839739 => generated 1292 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:42:55.286007 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-dc7ef61e-b59f-4e0c-a076-0557e83bfbf8 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:55.286863 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-dc7ef61e-b59f-4e0c-a076-0557e83bfbf8 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] [instance: c0a14e22-0620-4912-9893-62974c80978a] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:42:55.294901 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dc7ef61e-b59f-4e0c-a076-0557e83bfbf8 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:55.295640 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dc7ef61e-b59f-4e0c-a076-0557e83bfbf8 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:55.296268 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dc7ef61e-b59f-4e0c-a076-0557e83bfbf8 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:55.297176 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dc7ef61e-b59f-4e0c-a076-0557e83bfbf8 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:55.297872 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dc7ef61e-b59f-4e0c-a076-0557e83bfbf8 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:55.298416 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dc7ef61e-b59f-4e0c-a076-0557e83bfbf8 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:55.473114 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-102738c4-5f75-45cb-8aa2-3185279eb7e7 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07c500628d414c9983836c33563b38bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f258cb1ecd049078b201eb41692735a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:42:55.491899 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-102738c4-5f75-45cb-8aa2-3185279eb7e7 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] 10.222.0.33 "GET /compute/v2.1/servers/659f073c-b8c2-48d3-8c09-fef755291460" status: 200 len: 1324 microversion: 2.1 time: 0.683094 Oct 04 20:42:55.494733 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1055/2160] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:42:54 2022] GET /compute/v2.1/servers/659f073c-b8c2-48d3-8c09-fef755291460 => generated 1324 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:42:55.502270 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-da078047-cb52-4154-9fa3-06141a972693 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:55.503928 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-da078047-cb52-4154-9fa3-06141a972693 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] [instance: 8f1e4990-6f32-426c-bdea-ce2007c37a6f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:42:55.512583 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-da078047-cb52-4154-9fa3-06141a972693 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:55.514848 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-da078047-cb52-4154-9fa3-06141a972693 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:55.515524 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-da078047-cb52-4154-9fa3-06141a972693 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:55.516466 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-da078047-cb52-4154-9fa3-06141a972693 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:55.517126 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-da078047-cb52-4154-9fa3-06141a972693 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:55.517945 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-da078047-cb52-4154-9fa3-06141a972693 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:55.691716 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-dc7ef61e-b59f-4e0c-a076-0557e83bfbf8 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28399882314945d787a3af6eb59935c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5392c67506f7445ab33d62b191558f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:42:55.710515 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-dc7ef61e-b59f-4e0c-a076-0557e83bfbf8 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28399882314945d787a3af6eb59935c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5392c67506f7445ab33d62b191558f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:42:55.713130 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-dc7ef61e-b59f-4e0c-a076-0557e83bfbf8 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28399882314945d787a3af6eb59935c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5392c67506f7445ab33d62b191558f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:42:55.715470 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-dc7ef61e-b59f-4e0c-a076-0557e83bfbf8 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] 10.222.0.33 "GET /compute/v2.1/servers/c0a14e22-0620-4912-9893-62974c80978a" status: 200 len: 1661 microversion: 2.32 time: 0.436810 Oct 04 20:42:55.729201 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1106/2161] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:42:55 2022] GET /compute/v2.1/servers/c0a14e22-0620-4912-9893-62974c80978a => generated 1661 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:42:55.740310 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-fadf6d13-e880-4cb8-9ef0-4c59eb8c414a tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:55.741257 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-fadf6d13-e880-4cb8-9ef0-4c59eb8c414a tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] [instance: 17f61077-3e1c-4d86-b364-b22e4e40b3ca] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:42:55.748469 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fadf6d13-e880-4cb8-9ef0-4c59eb8c414a tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:55.749309 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fadf6d13-e880-4cb8-9ef0-4c59eb8c414a tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:55.749988 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fadf6d13-e880-4cb8-9ef0-4c59eb8c414a tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:55.750922 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fadf6d13-e880-4cb8-9ef0-4c59eb8c414a tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:55.751591 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fadf6d13-e880-4cb8-9ef0-4c59eb8c414a tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:55.752286 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fadf6d13-e880-4cb8-9ef0-4c59eb8c414a tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:55.909749 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-da078047-cb52-4154-9fa3-06141a972693 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:42:55.923206 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-da078047-cb52-4154-9fa3-06141a972693 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:42:55.925145 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-da078047-cb52-4154-9fa3-06141a972693 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:42:55.927529 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-da078047-cb52-4154-9fa3-06141a972693 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] 10.222.0.33 "GET /compute/v2.1/servers/8f1e4990-6f32-426c-bdea-ce2007c37a6f" status: 200 len: 1481 microversion: 2.25 time: 0.431393 Oct 04 20:42:55.938583 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1056/2162] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:42:55 2022] GET /compute/v2.1/servers/8f1e4990-6f32-426c-bdea-ce2007c37a6f => generated 1481 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:42:55.938583 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a92add3e-cbcf-4230-9eca-84c46180339b tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:55.939644 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a92add3e-cbcf-4230-9eca-84c46180339b tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] [instance: c806a6c6-6b03-4b6e-9247-75b8541ce9b4] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:42:55.949884 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a92add3e-cbcf-4230-9eca-84c46180339b tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:55.951402 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a92add3e-cbcf-4230-9eca-84c46180339b tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:55.951985 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a92add3e-cbcf-4230-9eca-84c46180339b tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:55.953839 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a92add3e-cbcf-4230-9eca-84c46180339b tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:55.954485 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a92add3e-cbcf-4230-9eca-84c46180339b tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:55.955063 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a92add3e-cbcf-4230-9eca-84c46180339b tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:56.194689 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-fadf6d13-e880-4cb8-9ef0-4c59eb8c414a tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '800db3a57ada47eca381b00189fdbf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66ec8ea91b04deb90b679589e0495bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:42:56.206726 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-fadf6d13-e880-4cb8-9ef0-4c59eb8c414a tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] 10.222.0.33 "GET /compute/v2.1/servers/17f61077-3e1c-4d86-b364-b22e4e40b3ca" status: 200 len: 1197 microversion: 2.1 time: 0.473470 Oct 04 20:42:56.210175 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1107/2163] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:42:55 2022] GET /compute/v2.1/servers/17f61077-3e1c-4d86-b364-b22e4e40b3ca => generated 1197 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:42:56.222539 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-39883342-7a0d-41d9-8539-0579bcbd6c85 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:56.223381 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-39883342-7a0d-41d9-8539-0579bcbd6c85 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] [instance: 2bae38c5-cec9-444b-8879-dcb7eb2822e6] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:42:56.230957 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-39883342-7a0d-41d9-8539-0579bcbd6c85 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:56.231693 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-39883342-7a0d-41d9-8539-0579bcbd6c85 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:56.232295 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-39883342-7a0d-41d9-8539-0579bcbd6c85 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:56.233134 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-39883342-7a0d-41d9-8539-0579bcbd6c85 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:56.234046 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-39883342-7a0d-41d9-8539-0579bcbd6c85 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:56.234643 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-39883342-7a0d-41d9-8539-0579bcbd6c85 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:56.502283 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-a92add3e-cbcf-4230-9eca-84c46180339b tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73345e7aa3ec490e9266cf356dc442ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99c97de335941a4af0f09c695ab3a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:42:56.523984 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a92add3e-cbcf-4230-9eca-84c46180339b tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] 10.222.0.33 "GET /compute/v2.1/servers/c806a6c6-6b03-4b6e-9247-75b8541ce9b4" status: 200 len: 1503 microversion: 2.1 time: 0.593788 Oct 04 20:42:56.528741 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1057/2164] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:42:55 2022] GET /compute/v2.1/servers/c806a6c6-6b03-4b6e-9247-75b8541ce9b4 => generated 1503 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:42:56.537911 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-21d85f18-e947-40ff-af6b-3402af96f78b tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:56.553431 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-21d85f18-e947-40ff-af6b-3402af96f78b tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] [instance: 251a34fb-f406-415f-8a45-d80feb48581d] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:42:56.578588 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-21d85f18-e947-40ff-af6b-3402af96f78b tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:56.579412 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-21d85f18-e947-40ff-af6b-3402af96f78b tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:56.580045 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-21d85f18-e947-40ff-af6b-3402af96f78b tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:56.581961 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-21d85f18-e947-40ff-af6b-3402af96f78b tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:56.584133 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-21d85f18-e947-40ff-af6b-3402af96f78b tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:56.584372 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-39883342-7a0d-41d9-8539-0579bcbd6c85 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e1e240b20e41e8b90e0d630e0d6b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a44744f2bb4130b9a49065b49cf854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:42:56.587459 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-21d85f18-e947-40ff-af6b-3402af96f78b tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:56.597085 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-39883342-7a0d-41d9-8539-0579bcbd6c85 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] 10.222.0.33 "GET /compute/v2.1/servers/2bae38c5-cec9-444b-8879-dcb7eb2822e6" status: 200 len: 1313 microversion: 2.1 time: 0.382342 Oct 04 20:42:56.597870 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1108/2165] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:42:56 2022] GET /compute/v2.1/servers/2bae38c5-cec9-444b-8879-dcb7eb2822e6 => generated 1313 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:42:56.621296 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-a291fa25-050b-4e8c-8555-74fe777fe6d5 req-a76cadc9-f433-47ee-a06d-7025669eec59 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "251a34fb-f406-415f-8a45-d80feb48581d", "tag": "47d205c9-2575-420f-bb45-a99478492ca2"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:42:56.641965 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-a291fa25-050b-4e8c-8555-74fe777fe6d5 req-a76cadc9-f433-47ee-a06d-7025669eec59 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:56.643628 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-a291fa25-050b-4e8c-8555-74fe777fe6d5 req-a76cadc9-f433-47ee-a06d-7025669eec59 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:56.644586 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-a291fa25-050b-4e8c-8555-74fe777fe6d5 req-a76cadc9-f433-47ee-a06d-7025669eec59 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:56.684678 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-a291fa25-050b-4e8c-8555-74fe777fe6d5 req-a76cadc9-f433-47ee-a06d-7025669eec59 service nova] Creating event network-changed:47d205c9-2575-420f-bb45-a99478492ca2 for instance 251a34fb-f406-415f-8a45-d80feb48581d on n-h1-854823-8 Oct 04 20:42:56.692870 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-a291fa25-050b-4e8c-8555-74fe777fe6d5 req-a76cadc9-f433-47ee-a06d-7025669eec59 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077945 Oct 04 20:42:56.698005 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1109/2166] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:42:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:42:56.726892 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-7587943e-3ab7-4aa3-be73-abd4b89eed76 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:56.728040 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-7587943e-3ab7-4aa3-be73-abd4b89eed76 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] [instance: d849cb42-dfe6-4225-814a-90bef2839739] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:42:56.740684 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7587943e-3ab7-4aa3-be73-abd4b89eed76 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:56.741880 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7587943e-3ab7-4aa3-be73-abd4b89eed76 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:56.743743 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7587943e-3ab7-4aa3-be73-abd4b89eed76 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:56.745036 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7587943e-3ab7-4aa3-be73-abd4b89eed76 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:56.745703 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7587943e-3ab7-4aa3-be73-abd4b89eed76 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:56.746632 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7587943e-3ab7-4aa3-be73-abd4b89eed76 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:57.049930 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-7587943e-3ab7-4aa3-be73-abd4b89eed76 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e4b00964014a0383f79597652bd428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7f38600b5041ad8e66a12d77b940fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:42:57.058835 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-7587943e-3ab7-4aa3-be73-abd4b89eed76 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] 10.222.0.33 "GET /compute/v2.1/servers/d849cb42-dfe6-4225-814a-90bef2839739" status: 200 len: 1292 microversion: 2.1 time: 0.349127 Oct 04 20:42:57.061664 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1110/2167] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:42:56 2022] GET /compute/v2.1/servers/d849cb42-dfe6-4225-814a-90bef2839739 => generated 1292 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:42:57.079223 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-d6b3d214-6ec5-4155-b556-6925c9b1ae5e tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:57.080414 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-d6b3d214-6ec5-4155-b556-6925c9b1ae5e tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] [instance: 659f073c-b8c2-48d3-8c09-fef755291460] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:42:57.086923 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d6b3d214-6ec5-4155-b556-6925c9b1ae5e tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:57.091234 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d6b3d214-6ec5-4155-b556-6925c9b1ae5e tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:57.092408 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d6b3d214-6ec5-4155-b556-6925c9b1ae5e tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:57.093676 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d6b3d214-6ec5-4155-b556-6925c9b1ae5e tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:57.094453 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d6b3d214-6ec5-4155-b556-6925c9b1ae5e tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:57.094947 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d6b3d214-6ec5-4155-b556-6925c9b1ae5e tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:57.101807 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:42:57.524621 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-21d85f18-e947-40ff-af6b-3402af96f78b tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd8aa669e8847a3848a723c7890ef98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7a1e525a85411ca2ce2bce1638b463', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:42:57.540468 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-21d85f18-e947-40ff-af6b-3402af96f78b tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] 10.222.0.33 "GET /compute/v2.1/servers/251a34fb-f406-415f-8a45-d80feb48581d" status: 200 len: 1576 microversion: 2.1 time: 1.009920 Oct 04 20:42:57.541759 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1058/2168] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:42:56 2022] GET /compute/v2.1/servers/251a34fb-f406-415f-8a45-d80feb48581d => generated 1576 bytes in 1012 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:42:57.555684 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-17f97742-47b6-4025-8acf-4cd76c26e131 tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Action: 'create', calling method: .version_select at 0x7f3c7425b820>, body: {"security_group": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-472299204", "description": "tempest-description-295734576"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:42:57.585610 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-d6b3d214-6ec5-4155-b556-6925c9b1ae5e tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07c500628d414c9983836c33563b38bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f258cb1ecd049078b201eb41692735a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:42:57.598682 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-d6b3d214-6ec5-4155-b556-6925c9b1ae5e tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] 10.222.0.33 "GET /compute/v2.1/servers/659f073c-b8c2-48d3-8c09-fef755291460" status: 200 len: 1324 microversion: 2.1 time: 0.535450 Oct 04 20:42:57.600071 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1111/2169] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:42:57 2022] GET /compute/v2.1/servers/659f073c-b8c2-48d3-8c09-fef755291460 => generated 1324 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:42:57.608383 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-752a67ed-a45d-4806-bbb8-d2f7ca74ebef tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:57.609145 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-752a67ed-a45d-4806-bbb8-d2f7ca74ebef tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] [instance: c0a14e22-0620-4912-9893-62974c80978a] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:42:57.618182 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-752a67ed-a45d-4806-bbb8-d2f7ca74ebef tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:57.618858 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-752a67ed-a45d-4806-bbb8-d2f7ca74ebef tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:57.623140 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-752a67ed-a45d-4806-bbb8-d2f7ca74ebef tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:57.625999 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-752a67ed-a45d-4806-bbb8-d2f7ca74ebef tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:57.626799 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-752a67ed-a45d-4806-bbb8-d2f7ca74ebef tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:57.627335 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-752a67ed-a45d-4806-bbb8-d2f7ca74ebef tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:58.601720 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-752a67ed-a45d-4806-bbb8-d2f7ca74ebef tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28399882314945d787a3af6eb59935c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5392c67506f7445ab33d62b191558f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:42:58.615879 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-752a67ed-a45d-4806-bbb8-d2f7ca74ebef tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28399882314945d787a3af6eb59935c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5392c67506f7445ab33d62b191558f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:42:58.618665 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-752a67ed-a45d-4806-bbb8-d2f7ca74ebef tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28399882314945d787a3af6eb59935c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5392c67506f7445ab33d62b191558f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:42:58.620140 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-752a67ed-a45d-4806-bbb8-d2f7ca74ebef tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] 10.222.0.33 "GET /compute/v2.1/servers/c0a14e22-0620-4912-9893-62974c80978a" status: 200 len: 1708 microversion: 2.32 time: 1.018819 Oct 04 20:42:58.621318 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1112/2170] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:42:57 2022] GET /compute/v2.1/servers/c0a14e22-0620-4912-9893-62974c80978a => generated 1708 bytes in 1020 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:42:58.627273 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-cdf4a8d0-fcce-4ebf-a3c7-9c1043f8de0a tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:58.628287 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-cdf4a8d0-fcce-4ebf-a3c7-9c1043f8de0a tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] [instance: 8f1e4990-6f32-426c-bdea-ce2007c37a6f] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:42:58.635416 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cdf4a8d0-fcce-4ebf-a3c7-9c1043f8de0a tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:58.636151 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cdf4a8d0-fcce-4ebf-a3c7-9c1043f8de0a tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:58.636864 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cdf4a8d0-fcce-4ebf-a3c7-9c1043f8de0a tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:58.638400 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cdf4a8d0-fcce-4ebf-a3c7-9c1043f8de0a tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:58.639116 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cdf4a8d0-fcce-4ebf-a3c7-9c1043f8de0a tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:58.639996 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cdf4a8d0-fcce-4ebf-a3c7-9c1043f8de0a tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:58.865184 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-17f97742-47b6-4025-8acf-4cd76c26e131 tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] 10.222.0.33 "POST /compute/v2.1/os-security-groups" status: 200 len: 249 microversion: 2.1 time: 1.321551 Oct 04 20:42:58.867615 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1059/2171] 10.222.0.33 () {60 vars in 1180 bytes} [Tue Oct 4 20:42:57 2022] POST /compute/v2.1/os-security-groups => generated 249 bytes in 1324 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:42:58.873994 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-386772b9-8731-4bc7-962c-e3548d46818f tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:58.874721 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-386772b9-8731-4bc7-962c-e3548d46818f tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] [instance: 17f61077-3e1c-4d86-b364-b22e4e40b3ca] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:42:58.885859 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-386772b9-8731-4bc7-962c-e3548d46818f tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:58.886635 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-386772b9-8731-4bc7-962c-e3548d46818f tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:58.887818 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-386772b9-8731-4bc7-962c-e3548d46818f tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:58.888633 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-386772b9-8731-4bc7-962c-e3548d46818f tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:58.889220 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-386772b9-8731-4bc7-962c-e3548d46818f tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:58.889721 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-386772b9-8731-4bc7-962c-e3548d46818f tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:59.362863 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-cdf4a8d0-fcce-4ebf-a3c7-9c1043f8de0a tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:42:59.376916 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-cdf4a8d0-fcce-4ebf-a3c7-9c1043f8de0a tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:42:59.379210 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-cdf4a8d0-fcce-4ebf-a3c7-9c1043f8de0a tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:42:59.382009 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-cdf4a8d0-fcce-4ebf-a3c7-9c1043f8de0a tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] 10.222.0.33 "GET /compute/v2.1/servers/8f1e4990-6f32-426c-bdea-ce2007c37a6f" status: 200 len: 1481 microversion: 2.25 time: 0.757619 Oct 04 20:42:59.396393 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1113/2172] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:42:58 2022] GET /compute/v2.1/servers/8f1e4990-6f32-426c-bdea-ce2007c37a6f => generated 1481 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:42:59.410965 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-b6ad66d2-4084-4297-8a67-c58afd5a4b17 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:59.411653 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-b6ad66d2-4084-4297-8a67-c58afd5a4b17 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] [instance: 2bae38c5-cec9-444b-8879-dcb7eb2822e6] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:42:59.423286 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b6ad66d2-4084-4297-8a67-c58afd5a4b17 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:59.430171 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b6ad66d2-4084-4297-8a67-c58afd5a4b17 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:59.430527 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b6ad66d2-4084-4297-8a67-c58afd5a4b17 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:59.431297 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b6ad66d2-4084-4297-8a67-c58afd5a4b17 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:59.431773 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b6ad66d2-4084-4297-8a67-c58afd5a4b17 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:59.432205 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b6ad66d2-4084-4297-8a67-c58afd5a4b17 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:59.521594 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-386772b9-8731-4bc7-962c-e3548d46818f tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '800db3a57ada47eca381b00189fdbf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66ec8ea91b04deb90b679589e0495bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:42:59.535671 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-386772b9-8731-4bc7-962c-e3548d46818f tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] 10.222.0.33 "GET /compute/v2.1/servers/17f61077-3e1c-4d86-b364-b22e4e40b3ca" status: 200 len: 1197 microversion: 2.1 time: 0.663319 Oct 04 20:42:59.539860 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1060/2173] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:42:58 2022] GET /compute/v2.1/servers/17f61077-3e1c-4d86-b364-b22e4e40b3ca => generated 1197 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:42:59.552720 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8219c301-2bb5-427e-8b5c-87d2cc2f4092 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:42:59.553347 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-8219c301-2bb5-427e-8b5c-87d2cc2f4092 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] [instance: d849cb42-dfe6-4225-814a-90bef2839739] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:42:59.571345 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8219c301-2bb5-427e-8b5c-87d2cc2f4092 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:59.571836 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8219c301-2bb5-427e-8b5c-87d2cc2f4092 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:59.572279 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8219c301-2bb5-427e-8b5c-87d2cc2f4092 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:42:59.573000 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8219c301-2bb5-427e-8b5c-87d2cc2f4092 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:42:59.573451 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8219c301-2bb5-427e-8b5c-87d2cc2f4092 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:42:59.573876 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8219c301-2bb5-427e-8b5c-87d2cc2f4092 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:00.076995 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-b6ad66d2-4084-4297-8a67-c58afd5a4b17 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e1e240b20e41e8b90e0d630e0d6b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a44744f2bb4130b9a49065b49cf854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:00.095536 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-b6ad66d2-4084-4297-8a67-c58afd5a4b17 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] 10.222.0.33 "GET /compute/v2.1/servers/2bae38c5-cec9-444b-8879-dcb7eb2822e6" status: 200 len: 1334 microversion: 2.1 time: 0.697386 Oct 04 20:43:00.112945 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1114/2174] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:42:59 2022] GET /compute/v2.1/servers/2bae38c5-cec9-444b-8879-dcb7eb2822e6 => generated 1334 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:43:00.119144 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-505f0b58-7b34-45f3-b979-e56f99f39859 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:00.120919 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-505f0b58-7b34-45f3-b979-e56f99f39859 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] [instance: 659f073c-b8c2-48d3-8c09-fef755291460] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:00.129396 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-505f0b58-7b34-45f3-b979-e56f99f39859 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:00.130252 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-505f0b58-7b34-45f3-b979-e56f99f39859 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:00.130937 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-505f0b58-7b34-45f3-b979-e56f99f39859 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:00.132746 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-505f0b58-7b34-45f3-b979-e56f99f39859 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:00.134370 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-505f0b58-7b34-45f3-b979-e56f99f39859 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:00.135027 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-505f0b58-7b34-45f3-b979-e56f99f39859 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:00.146907 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-8219c301-2bb5-427e-8b5c-87d2cc2f4092 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e4b00964014a0383f79597652bd428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7f38600b5041ad8e66a12d77b940fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:00.155129 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-8219c301-2bb5-427e-8b5c-87d2cc2f4092 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] 10.222.0.33 "GET /compute/v2.1/servers/d849cb42-dfe6-4225-814a-90bef2839739" status: 200 len: 1365 microversion: 2.1 time: 0.614177 Oct 04 20:43:00.155721 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1061/2175] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:42:59 2022] GET /compute/v2.1/servers/d849cb42-dfe6-4225-814a-90bef2839739 => generated 1365 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:43:00.157301 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell0:SELECT=4 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:43:00.175602 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5c21fdd7-aeeb-4f2d-b550-f6ca86b9d626 tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-472299204"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:43:00.176154 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-5c21fdd7-aeeb-4f2d-b550-f6ca86b9d626 tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] [instance: c806a6c6-6b03-4b6e-9247-75b8541ce9b4] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:00.182199 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5c21fdd7-aeeb-4f2d-b550-f6ca86b9d626 tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:00.182897 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5c21fdd7-aeeb-4f2d-b550-f6ca86b9d626 tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:00.183504 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5c21fdd7-aeeb-4f2d-b550-f6ca86b9d626 tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:00.184903 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5c21fdd7-aeeb-4f2d-b550-f6ca86b9d626 tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:00.185549 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5c21fdd7-aeeb-4f2d-b550-f6ca86b9d626 tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:00.186312 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5c21fdd7-aeeb-4f2d-b550-f6ca86b9d626 tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:00.247750 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell0:SELECT=12 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:43:00.443339 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-505f0b58-7b34-45f3-b979-e56f99f39859 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07c500628d414c9983836c33563b38bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f258cb1ecd049078b201eb41692735a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:00.453434 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-505f0b58-7b34-45f3-b979-e56f99f39859 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] 10.222.0.33 "GET /compute/v2.1/servers/659f073c-b8c2-48d3-8c09-fef755291460" status: 200 len: 1324 microversion: 2.1 time: 0.338969 Oct 04 20:43:00.458193 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1115/2176] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:43:00 2022] GET /compute/v2.1/servers/659f073c-b8c2-48d3-8c09-fef755291460 => generated 1324 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:43:00.465142 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-56a59835-0c1b-490e-8316-3c759a0525e8 req-5cdb6981-696e-4374-86eb-8f6207099a6c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d849cb42-dfe6-4225-814a-90bef2839739", "tag": "43c43378-662f-421f-8638-f0585d16813b"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:43:00.476090 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-56a59835-0c1b-490e-8316-3c759a0525e8 req-5cdb6981-696e-4374-86eb-8f6207099a6c service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:00.476563 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-56a59835-0c1b-490e-8316-3c759a0525e8 req-5cdb6981-696e-4374-86eb-8f6207099a6c service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:00.476997 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-56a59835-0c1b-490e-8316-3c759a0525e8 req-5cdb6981-696e-4374-86eb-8f6207099a6c service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:00.489322 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-56a59835-0c1b-490e-8316-3c759a0525e8 req-5cdb6981-696e-4374-86eb-8f6207099a6c service nova] Creating event network-changed:43c43378-662f-421f-8638-f0585d16813b for instance d849cb42-dfe6-4225-814a-90bef2839739 on n-h2-854823-8 Oct 04 20:43:00.494577 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-56a59835-0c1b-490e-8316-3c759a0525e8 req-5cdb6981-696e-4374-86eb-8f6207099a6c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039417 Oct 04 20:43:00.495348 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1116/2177] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:43:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:43:00.502237 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-4b6911dc-d574-4f45-ae3b-df4e838c0dd9 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:00.502801 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-4b6911dc-d574-4f45-ae3b-df4e838c0dd9 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] [instance: c0a14e22-0620-4912-9893-62974c80978a] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:00.509006 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4b6911dc-d574-4f45-ae3b-df4e838c0dd9 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:00.509293 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4b6911dc-d574-4f45-ae3b-df4e838c0dd9 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:00.509725 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4b6911dc-d574-4f45-ae3b-df4e838c0dd9 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:00.510870 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4b6911dc-d574-4f45-ae3b-df4e838c0dd9 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:00.510870 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4b6911dc-d574-4f45-ae3b-df4e838c0dd9 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:00.511304 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4b6911dc-d574-4f45-ae3b-df4e838c0dd9 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:00.563992 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.network.security_group_api [None req-5c21fdd7-aeeb-4f2d-b550-f6ca86b9d626 tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Adding security group f0512cf6-f0f5-4c47-a410-b32c2e33a22c to port 059512bd-a604-4d49-978d-ee2246b9e518 Oct 04 20:43:00.925408 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-4b6911dc-d574-4f45-ae3b-df4e838c0dd9 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28399882314945d787a3af6eb59935c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5392c67506f7445ab33d62b191558f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:00.946867 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-4b6911dc-d574-4f45-ae3b-df4e838c0dd9 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28399882314945d787a3af6eb59935c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5392c67506f7445ab33d62b191558f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:00.948433 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-4b6911dc-d574-4f45-ae3b-df4e838c0dd9 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28399882314945d787a3af6eb59935c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5392c67506f7445ab33d62b191558f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:00.949622 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-4b6911dc-d574-4f45-ae3b-df4e838c0dd9 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] 10.222.0.33 "GET /compute/v2.1/servers/c0a14e22-0620-4912-9893-62974c80978a" status: 200 len: 1755 microversion: 2.32 time: 0.452755 Oct 04 20:43:00.951104 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1117/2178] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:43:00 2022] GET /compute/v2.1/servers/c0a14e22-0620-4912-9893-62974c80978a => generated 1755 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:43:00.955570 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-321fc30d-57db-41bd-9704-3dabe2e95159 req-35044bc0-42ba-4c9f-820b-6d49bac1b77f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f1e4990-6f32-426c-bdea-ce2007c37a6f", "name": "network-vif-deleted", "tag": "ade75c1b-2031-475c-af20-7442fa7b876a"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:43:00.977519 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-321fc30d-57db-41bd-9704-3dabe2e95159 req-35044bc0-42ba-4c9f-820b-6d49bac1b77f service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:00.978255 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-321fc30d-57db-41bd-9704-3dabe2e95159 req-35044bc0-42ba-4c9f-820b-6d49bac1b77f service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:00.978842 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-321fc30d-57db-41bd-9704-3dabe2e95159 req-35044bc0-42ba-4c9f-820b-6d49bac1b77f service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:00.990445 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-321fc30d-57db-41bd-9704-3dabe2e95159 req-35044bc0-42ba-4c9f-820b-6d49bac1b77f service nova] Creating event network-vif-deleted:ade75c1b-2031-475c-af20-7442fa7b876a for instance 8f1e4990-6f32-426c-bdea-ce2007c37a6f on n-h2-854823-8 Oct 04 20:43:00.995474 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-321fc30d-57db-41bd-9704-3dabe2e95159 req-35044bc0-42ba-4c9f-820b-6d49bac1b77f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043272 Oct 04 20:43:00.996558 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1118/2179] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:43:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:43:01.002242 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-138c8b4e-df4e-4671-a2a0-532c4fa1443b tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:01.003189 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-138c8b4e-df4e-4671-a2a0-532c4fa1443b tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] [instance: 8f1e4990-6f32-426c-bdea-ce2007c37a6f] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:01.009538 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-138c8b4e-df4e-4671-a2a0-532c4fa1443b tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:01.010264 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-138c8b4e-df4e-4671-a2a0-532c4fa1443b tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:01.010913 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-138c8b4e-df4e-4671-a2a0-532c4fa1443b tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:01.011789 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-138c8b4e-df4e-4671-a2a0-532c4fa1443b tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:01.012417 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-138c8b4e-df4e-4671-a2a0-532c4fa1443b tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:01.013587 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-138c8b4e-df4e-4671-a2a0-532c4fa1443b tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:01.151478 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-138c8b4e-df4e-4671-a2a0-532c4fa1443b tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:01.168663 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-138c8b4e-df4e-4671-a2a0-532c4fa1443b tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:01.171863 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-138c8b4e-df4e-4671-a2a0-532c4fa1443b tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:01.173910 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-138c8b4e-df4e-4671-a2a0-532c4fa1443b tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] 10.222.0.33 "GET /compute/v2.1/servers/8f1e4990-6f32-426c-bdea-ce2007c37a6f" status: 200 len: 1265 microversion: 2.25 time: 0.175573 Oct 04 20:43:01.174962 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1119/2180] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:43:00 2022] GET /compute/v2.1/servers/8f1e4990-6f32-426c-bdea-ce2007c37a6f => generated 1265 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:43:01.208835 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-30df4000-55ad-44df-8a32-d3a6f8a9eec5 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:01.210665 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-30df4000-55ad-44df-8a32-d3a6f8a9eec5 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] [instance: 17f61077-3e1c-4d86-b364-b22e4e40b3ca] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:01.228801 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-30df4000-55ad-44df-8a32-d3a6f8a9eec5 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:01.233713 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-30df4000-55ad-44df-8a32-d3a6f8a9eec5 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:01.234424 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-30df4000-55ad-44df-8a32-d3a6f8a9eec5 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:01.235543 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-30df4000-55ad-44df-8a32-d3a6f8a9eec5 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:01.236415 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-30df4000-55ad-44df-8a32-d3a6f8a9eec5 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:01.237127 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-30df4000-55ad-44df-8a32-d3a6f8a9eec5 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:01.640727 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=6 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:43:01.669428 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=22 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:43:01.953084 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-30df4000-55ad-44df-8a32-d3a6f8a9eec5 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '800db3a57ada47eca381b00189fdbf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66ec8ea91b04deb90b679589e0495bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:01.968840 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-30df4000-55ad-44df-8a32-d3a6f8a9eec5 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] 10.222.0.33 "GET /compute/v2.1/servers/17f61077-3e1c-4d86-b364-b22e4e40b3ca" status: 200 len: 1197 microversion: 2.1 time: 0.774664 Oct 04 20:43:01.969761 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1120/2181] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:43:01 2022] GET /compute/v2.1/servers/17f61077-3e1c-4d86-b364-b22e4e40b3ca => generated 1197 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:43:01.974571 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-aff68498-0dd1-48bf-9747-a99dbfd8f2ef tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:01.979878 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-aff68498-0dd1-48bf-9747-a99dbfd8f2ef tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] [instance: 2bae38c5-cec9-444b-8879-dcb7eb2822e6] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:01.998818 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-aff68498-0dd1-48bf-9747-a99dbfd8f2ef tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:01.999583 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-aff68498-0dd1-48bf-9747-a99dbfd8f2ef tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:02.003877 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-aff68498-0dd1-48bf-9747-a99dbfd8f2ef tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:02.005102 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-aff68498-0dd1-48bf-9747-a99dbfd8f2ef tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:02.008438 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-aff68498-0dd1-48bf-9747-a99dbfd8f2ef tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:02.009485 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-aff68498-0dd1-48bf-9747-a99dbfd8f2ef tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:02.019353 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5c21fdd7-aeeb-4f2d-b550-f6ca86b9d626 tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] 10.222.0.33 "POST /compute/v2.1/servers/c806a6c6-6b03-4b6e-9247-75b8541ce9b4/action" status: 202 len: 0 microversion: 2.1 time: 1.861205 Oct 04 20:43:02.022588 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1062/2182] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 20:43:00 2022] POST /compute/v2.1/servers/c806a6c6-6b03-4b6e-9247-75b8541ce9b4/action => generated 0 bytes in 1865 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:43:02.030918 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d9306cb0-4e2b-4ae3-b7d7-1b929eaccf90 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:02.031713 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d9306cb0-4e2b-4ae3-b7d7-1b929eaccf90 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] [instance: d849cb42-dfe6-4225-814a-90bef2839739] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:02.049567 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d9306cb0-4e2b-4ae3-b7d7-1b929eaccf90 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:02.050555 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d9306cb0-4e2b-4ae3-b7d7-1b929eaccf90 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:02.057375 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d9306cb0-4e2b-4ae3-b7d7-1b929eaccf90 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:02.058513 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d9306cb0-4e2b-4ae3-b7d7-1b929eaccf90 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:02.059173 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d9306cb0-4e2b-4ae3-b7d7-1b929eaccf90 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:02.060076 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d9306cb0-4e2b-4ae3-b7d7-1b929eaccf90 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:02.101416 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=100 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:43:02.601202 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-aff68498-0dd1-48bf-9747-a99dbfd8f2ef tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e1e240b20e41e8b90e0d630e0d6b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a44744f2bb4130b9a49065b49cf854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:02.611726 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-aff68498-0dd1-48bf-9747-a99dbfd8f2ef tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] 10.222.0.33 "GET /compute/v2.1/servers/2bae38c5-cec9-444b-8879-dcb7eb2822e6" status: 200 len: 1355 microversion: 2.1 time: 0.640540 Oct 04 20:43:02.612444 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1121/2183] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:43:01 2022] GET /compute/v2.1/servers/2bae38c5-cec9-444b-8879-dcb7eb2822e6 => generated 1355 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:43:02.627335 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-5ef0f1f1-8944-4d87-a99b-f0b29ca8ac12 req-16ee3102-9450-442a-b0db-d365b5d8cd84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "659f073c-b8c2-48d3-8c09-fef755291460", "name": "network-vif-plugged", "status": "completed", "tag": "267a2eeb-d782-40d7-865d-522dfe433aa5"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:43:02.627582 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d9306cb0-4e2b-4ae3-b7d7-1b929eaccf90 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e4b00964014a0383f79597652bd428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7f38600b5041ad8e66a12d77b940fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:02.627582 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d9306cb0-4e2b-4ae3-b7d7-1b929eaccf90 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] 10.222.0.33 "GET /compute/v2.1/servers/d849cb42-dfe6-4225-814a-90bef2839739" status: 200 len: 1365 microversion: 2.1 time: 0.602082 Oct 04 20:43:02.629610 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-5ef0f1f1-8944-4d87-a99b-f0b29ca8ac12 req-16ee3102-9450-442a-b0db-d365b5d8cd84 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:02.630336 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-5ef0f1f1-8944-4d87-a99b-f0b29ca8ac12 req-16ee3102-9450-442a-b0db-d365b5d8cd84 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:02.630890 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-5ef0f1f1-8944-4d87-a99b-f0b29ca8ac12 req-16ee3102-9450-442a-b0db-d365b5d8cd84 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:02.638985 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1063/2184] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:43:02 2022] GET /compute/v2.1/servers/d849cb42-dfe6-4225-814a-90bef2839739 => generated 1365 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:43:02.643760 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-5ef0f1f1-8944-4d87-a99b-f0b29ca8ac12 req-16ee3102-9450-442a-b0db-d365b5d8cd84 service nova] Creating event network-vif-plugged:267a2eeb-d782-40d7-865d-522dfe433aa5 for instance 659f073c-b8c2-48d3-8c09-fef755291460 on n-h2-854823-8 Oct 04 20:43:02.643968 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e4af5ba0-ee43-437a-ac63-11377e56c264 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:02.644592 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e4af5ba0-ee43-437a-ac63-11377e56c264 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] [instance: 659f073c-b8c2-48d3-8c09-fef755291460] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:02.649134 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-5ef0f1f1-8944-4d87-a99b-f0b29ca8ac12 req-16ee3102-9450-442a-b0db-d365b5d8cd84 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035390 Oct 04 20:43:02.650236 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1122/2185] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:43:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:43:02.657210 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-dd199667-9672-40e9-b991-0f44e299c6fc tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:02.658020 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-dd199667-9672-40e9-b991-0f44e299c6fc tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] [instance: c0a14e22-0620-4912-9893-62974c80978a] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:02.662577 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e4af5ba0-ee43-437a-ac63-11377e56c264 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:02.663412 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e4af5ba0-ee43-437a-ac63-11377e56c264 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:02.664058 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e4af5ba0-ee43-437a-ac63-11377e56c264 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:02.665079 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dd199667-9672-40e9-b991-0f44e299c6fc tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:02.665650 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dd199667-9672-40e9-b991-0f44e299c6fc tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:02.666241 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dd199667-9672-40e9-b991-0f44e299c6fc tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:02.667105 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e4af5ba0-ee43-437a-ac63-11377e56c264 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:02.667221 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dd199667-9672-40e9-b991-0f44e299c6fc tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:02.667772 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dd199667-9672-40e9-b991-0f44e299c6fc tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:02.668122 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e4af5ba0-ee43-437a-ac63-11377e56c264 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:02.668283 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dd199667-9672-40e9-b991-0f44e299c6fc tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:02.670783 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e4af5ba0-ee43-437a-ac63-11377e56c264 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:03.125112 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-dd199667-9672-40e9-b991-0f44e299c6fc tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28399882314945d787a3af6eb59935c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5392c67506f7445ab33d62b191558f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:03.138254 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-dd199667-9672-40e9-b991-0f44e299c6fc tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28399882314945d787a3af6eb59935c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5392c67506f7445ab33d62b191558f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:03.140594 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-dd199667-9672-40e9-b991-0f44e299c6fc tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28399882314945d787a3af6eb59935c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5392c67506f7445ab33d62b191558f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:03.142311 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-dd199667-9672-40e9-b991-0f44e299c6fc tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] 10.222.0.33 "GET /compute/v2.1/servers/c0a14e22-0620-4912-9893-62974c80978a" status: 200 len: 1755 microversion: 2.32 time: 0.490855 Oct 04 20:43:03.143667 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1123/2186] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:43:02 2022] GET /compute/v2.1/servers/c0a14e22-0620-4912-9893-62974c80978a => generated 1755 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:43:03.149739 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-06eff3fa-305f-4eb5-b651-5e4895b1f967 tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-472299204"}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:43:03.150742 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-06eff3fa-305f-4eb5-b651-5e4895b1f967 tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] [instance: c806a6c6-6b03-4b6e-9247-75b8541ce9b4] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:03.159872 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e4af5ba0-ee43-437a-ac63-11377e56c264 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07c500628d414c9983836c33563b38bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f258cb1ecd049078b201eb41692735a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:03.160998 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-06eff3fa-305f-4eb5-b651-5e4895b1f967 tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:03.161693 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-06eff3fa-305f-4eb5-b651-5e4895b1f967 tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:03.162362 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-06eff3fa-305f-4eb5-b651-5e4895b1f967 tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:03.166326 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-06eff3fa-305f-4eb5-b651-5e4895b1f967 tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:03.167157 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-06eff3fa-305f-4eb5-b651-5e4895b1f967 tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:03.167787 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-06eff3fa-305f-4eb5-b651-5e4895b1f967 tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:03.168109 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e4af5ba0-ee43-437a-ac63-11377e56c264 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] 10.222.0.33 "GET /compute/v2.1/servers/659f073c-b8c2-48d3-8c09-fef755291460" status: 200 len: 1324 microversion: 2.1 time: 0.527957 Oct 04 20:43:03.174502 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1064/2187] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:43:02 2022] GET /compute/v2.1/servers/659f073c-b8c2-48d3-8c09-fef755291460 => generated 1324 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:43:03.214672 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d1b4cab6-a3c3-493f-a488-0d41acb24c79 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:03.215305 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d1b4cab6-a3c3-493f-a488-0d41acb24c79 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] [instance: 8f1e4990-6f32-426c-bdea-ce2007c37a6f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:03.222381 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d1b4cab6-a3c3-493f-a488-0d41acb24c79 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:03.222932 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d1b4cab6-a3c3-493f-a488-0d41acb24c79 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:03.223360 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d1b4cab6-a3c3-493f-a488-0d41acb24c79 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:03.224233 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d1b4cab6-a3c3-493f-a488-0d41acb24c79 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:03.224875 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d1b4cab6-a3c3-493f-a488-0d41acb24c79 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:03.225455 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d1b4cab6-a3c3-493f-a488-0d41acb24c79 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:03.376047 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d1b4cab6-a3c3-493f-a488-0d41acb24c79 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:03.395033 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d1b4cab6-a3c3-493f-a488-0d41acb24c79 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:03.397582 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d1b4cab6-a3c3-493f-a488-0d41acb24c79 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:03.400082 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d1b4cab6-a3c3-493f-a488-0d41acb24c79 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] 10.222.0.33 "GET /compute/v2.1/servers/8f1e4990-6f32-426c-bdea-ce2007c37a6f" status: 200 len: 1265 microversion: 2.25 time: 0.200651 Oct 04 20:43:03.416677 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1065/2188] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:43:03 2022] GET /compute/v2.1/servers/8f1e4990-6f32-426c-bdea-ce2007c37a6f => generated 1265 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:43:03.428889 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-30e0a2d9-54c9-4540-b10f-212c1ad44552 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:03.429681 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-30e0a2d9-54c9-4540-b10f-212c1ad44552 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] [instance: 17f61077-3e1c-4d86-b364-b22e4e40b3ca] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:03.437897 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-30e0a2d9-54c9-4540-b10f-212c1ad44552 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:03.438724 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-30e0a2d9-54c9-4540-b10f-212c1ad44552 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:03.439370 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-30e0a2d9-54c9-4540-b10f-212c1ad44552 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:03.440301 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-30e0a2d9-54c9-4540-b10f-212c1ad44552 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:03.440917 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-30e0a2d9-54c9-4540-b10f-212c1ad44552 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:03.441550 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-30e0a2d9-54c9-4540-b10f-212c1ad44552 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:03.649385 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.network.security_group_api [None req-06eff3fa-305f-4eb5-b651-5e4895b1f967 tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Removing security group f0512cf6-f0f5-4c47-a410-b32c2e33a22c from port 059512bd-a604-4d49-978d-ee2246b9e518 Oct 04 20:43:03.967038 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-30e0a2d9-54c9-4540-b10f-212c1ad44552 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '800db3a57ada47eca381b00189fdbf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66ec8ea91b04deb90b679589e0495bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:03.980772 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-30e0a2d9-54c9-4540-b10f-212c1ad44552 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] 10.222.0.33 "GET /compute/v2.1/servers/17f61077-3e1c-4d86-b364-b22e4e40b3ca" status: 200 len: 1197 microversion: 2.1 time: 0.560522 Oct 04 20:43:03.981821 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1066/2189] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:43:03 2022] GET /compute/v2.1/servers/17f61077-3e1c-4d86-b364-b22e4e40b3ca => generated 1197 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:43:03.986728 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-717a065e-5318-4315-9b18-d2405cb8eac5 req-8826acab-cf4f-42d9-ba9d-5281354a59f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c806a6c6-6b03-4b6e-9247-75b8541ce9b4", "tag": "059512bd-a604-4d49-978d-ee2246b9e518"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:43:03.998843 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-717a065e-5318-4315-9b18-d2405cb8eac5 req-8826acab-cf4f-42d9-ba9d-5281354a59f3 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:03.999547 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-717a065e-5318-4315-9b18-d2405cb8eac5 req-8826acab-cf4f-42d9-ba9d-5281354a59f3 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:04.000128 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-717a065e-5318-4315-9b18-d2405cb8eac5 req-8826acab-cf4f-42d9-ba9d-5281354a59f3 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:04.017772 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-717a065e-5318-4315-9b18-d2405cb8eac5 req-8826acab-cf4f-42d9-ba9d-5281354a59f3 service nova] Creating event network-changed:059512bd-a604-4d49-978d-ee2246b9e518 for instance c806a6c6-6b03-4b6e-9247-75b8541ce9b4 on n-h2-854823-8 Oct 04 20:43:04.024817 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-717a065e-5318-4315-9b18-d2405cb8eac5 req-8826acab-cf4f-42d9-ba9d-5281354a59f3 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041605 Oct 04 20:43:04.025968 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1067/2190] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:43:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:43:04.031494 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-220c4468-1a7e-48af-9a00-fad0ea5b6b1b tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:04.033976 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-220c4468-1a7e-48af-9a00-fad0ea5b6b1b tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] [instance: 2bae38c5-cec9-444b-8879-dcb7eb2822e6] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:04.040447 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-220c4468-1a7e-48af-9a00-fad0ea5b6b1b tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:04.040939 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-220c4468-1a7e-48af-9a00-fad0ea5b6b1b tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:04.041545 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-220c4468-1a7e-48af-9a00-fad0ea5b6b1b tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:04.043126 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-220c4468-1a7e-48af-9a00-fad0ea5b6b1b tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:04.043811 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-220c4468-1a7e-48af-9a00-fad0ea5b6b1b tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:04.044395 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-220c4468-1a7e-48af-9a00-fad0ea5b6b1b tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:04.469339 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-220c4468-1a7e-48af-9a00-fad0ea5b6b1b tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e1e240b20e41e8b90e0d630e0d6b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a44744f2bb4130b9a49065b49cf854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:04.491706 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-220c4468-1a7e-48af-9a00-fad0ea5b6b1b tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] 10.222.0.33 "GET /compute/v2.1/servers/2bae38c5-cec9-444b-8879-dcb7eb2822e6" status: 200 len: 1355 microversion: 2.1 time: 0.462731 Oct 04 20:43:04.499134 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1068/2191] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:43:04 2022] GET /compute/v2.1/servers/2bae38c5-cec9-444b-8879-dcb7eb2822e6 => generated 1355 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:43:04.505869 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-358e0c70-d9ad-4bff-9196-82aa64fdf0a7 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:04.507287 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-358e0c70-d9ad-4bff-9196-82aa64fdf0a7 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] [instance: d849cb42-dfe6-4225-814a-90bef2839739] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:04.523459 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-358e0c70-d9ad-4bff-9196-82aa64fdf0a7 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:04.524523 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-358e0c70-d9ad-4bff-9196-82aa64fdf0a7 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:04.525191 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-358e0c70-d9ad-4bff-9196-82aa64fdf0a7 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:04.527183 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-358e0c70-d9ad-4bff-9196-82aa64fdf0a7 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:04.527806 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-358e0c70-d9ad-4bff-9196-82aa64fdf0a7 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:04.528986 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-358e0c70-d9ad-4bff-9196-82aa64fdf0a7 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:05.151034 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-06eff3fa-305f-4eb5-b651-5e4895b1f967 tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] 10.222.0.33 "POST /compute/v2.1/servers/c806a6c6-6b03-4b6e-9247-75b8541ce9b4/action" status: 202 len: 0 microversion: 2.1 time: 2.005272 Oct 04 20:43:05.152680 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1124/2192] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 20:43:03 2022] POST /compute/v2.1/servers/c806a6c6-6b03-4b6e-9247-75b8541ce9b4/action => generated 0 bytes in 2008 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:43:05.160816 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-954ca445-a910-48ff-860f-2244b70a0988 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:05.167301 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-954ca445-a910-48ff-860f-2244b70a0988 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] [instance: c0a14e22-0620-4912-9893-62974c80978a] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:05.189617 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-358e0c70-d9ad-4bff-9196-82aa64fdf0a7 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e4b00964014a0383f79597652bd428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7f38600b5041ad8e66a12d77b940fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:05.199426 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-954ca445-a910-48ff-860f-2244b70a0988 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:05.201836 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-358e0c70-d9ad-4bff-9196-82aa64fdf0a7 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] 10.222.0.33 "GET /compute/v2.1/servers/d849cb42-dfe6-4225-814a-90bef2839739" status: 200 len: 1365 microversion: 2.1 time: 0.700435 Oct 04 20:43:05.208031 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-954ca445-a910-48ff-860f-2244b70a0988 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:05.210968 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-954ca445-a910-48ff-860f-2244b70a0988 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:05.212123 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-954ca445-a910-48ff-860f-2244b70a0988 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:05.214179 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-954ca445-a910-48ff-860f-2244b70a0988 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:05.216619 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-954ca445-a910-48ff-860f-2244b70a0988 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:05.218802 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1069/2193] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:43:04 2022] GET /compute/v2.1/servers/d849cb42-dfe6-4225-814a-90bef2839739 => generated 1365 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:43:05.232792 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0a7c528d-e767-442a-9316-63d690b7d4e2 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:05.235887 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-0a7c528d-e767-442a-9316-63d690b7d4e2 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] [instance: 659f073c-b8c2-48d3-8c09-fef755291460] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:05.248934 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0a7c528d-e767-442a-9316-63d690b7d4e2 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:05.249624 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0a7c528d-e767-442a-9316-63d690b7d4e2 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:05.250846 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0a7c528d-e767-442a-9316-63d690b7d4e2 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:05.255264 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0a7c528d-e767-442a-9316-63d690b7d4e2 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:05.255934 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0a7c528d-e767-442a-9316-63d690b7d4e2 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:05.256523 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0a7c528d-e767-442a-9316-63d690b7d4e2 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:05.736000 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-954ca445-a910-48ff-860f-2244b70a0988 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28399882314945d787a3af6eb59935c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5392c67506f7445ab33d62b191558f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:05.747705 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-954ca445-a910-48ff-860f-2244b70a0988 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28399882314945d787a3af6eb59935c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5392c67506f7445ab33d62b191558f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:05.749284 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-954ca445-a910-48ff-860f-2244b70a0988 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28399882314945d787a3af6eb59935c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5392c67506f7445ab33d62b191558f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:05.751710 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-954ca445-a910-48ff-860f-2244b70a0988 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] 10.222.0.33 "GET /compute/v2.1/servers/c0a14e22-0620-4912-9893-62974c80978a" status: 200 len: 1802 microversion: 2.32 time: 0.596213 Oct 04 20:43:05.763418 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1125/2194] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:43:05 2022] GET /compute/v2.1/servers/c0a14e22-0620-4912-9893-62974c80978a => generated 1802 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:43:05.775921 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-920df74e-9a5e-4515-a74d-526dfc8d1a56 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:05.776544 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-920df74e-9a5e-4515-a74d-526dfc8d1a56 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] [instance: 8f1e4990-6f32-426c-bdea-ce2007c37a6f] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:05.783353 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-920df74e-9a5e-4515-a74d-526dfc8d1a56 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:05.783943 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-920df74e-9a5e-4515-a74d-526dfc8d1a56 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:05.784406 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-920df74e-9a5e-4515-a74d-526dfc8d1a56 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:05.785117 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-920df74e-9a5e-4515-a74d-526dfc8d1a56 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:05.785662 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-920df74e-9a5e-4515-a74d-526dfc8d1a56 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:05.786108 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-920df74e-9a5e-4515-a74d-526dfc8d1a56 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:05.789628 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-0a7c528d-e767-442a-9316-63d690b7d4e2 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07c500628d414c9983836c33563b38bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f258cb1ecd049078b201eb41692735a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:05.802009 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-0a7c528d-e767-442a-9316-63d690b7d4e2 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] 10.222.0.33 "GET /compute/v2.1/servers/659f073c-b8c2-48d3-8c09-fef755291460" status: 200 len: 1520 microversion: 2.1 time: 0.582033 Oct 04 20:43:05.802835 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1070/2195] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:43:05 2022] GET /compute/v2.1/servers/659f073c-b8c2-48d3-8c09-fef755291460 => generated 1520 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:43:05.807160 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-306ad2f2-24a3-41fa-9c85-9cdcd2704ecf req-bff161cd-6f62-4a56-8aca-35e1e9e150f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17f61077-3e1c-4d86-b364-b22e4e40b3ca", "name": "network-vif-plugged", "status": "completed", "tag": "f185090f-7c96-46b5-b51f-76a45035b6a4"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:43:05.827275 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-306ad2f2-24a3-41fa-9c85-9cdcd2704ecf req-bff161cd-6f62-4a56-8aca-35e1e9e150f8 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:05.828016 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-306ad2f2-24a3-41fa-9c85-9cdcd2704ecf req-bff161cd-6f62-4a56-8aca-35e1e9e150f8 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:05.828662 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-306ad2f2-24a3-41fa-9c85-9cdcd2704ecf req-bff161cd-6f62-4a56-8aca-35e1e9e150f8 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:05.841729 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-306ad2f2-24a3-41fa-9c85-9cdcd2704ecf req-bff161cd-6f62-4a56-8aca-35e1e9e150f8 service nova] Creating event network-vif-plugged:f185090f-7c96-46b5-b51f-76a45035b6a4 for instance 17f61077-3e1c-4d86-b364-b22e4e40b3ca on n-h1-854823-8 Oct 04 20:43:05.846966 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-306ad2f2-24a3-41fa-9c85-9cdcd2704ecf req-bff161cd-6f62-4a56-8aca-35e1e9e150f8 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043180 Oct 04 20:43:05.847640 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1071/2196] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:43:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:43:05.853137 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-414f1d08-2eef-4acc-ad89-fd1c15c44f2d tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:05.853836 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-414f1d08-2eef-4acc-ad89-fd1c15c44f2d tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] [instance: 17f61077-3e1c-4d86-b364-b22e4e40b3ca] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:05.855775 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:43:05.861077 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-414f1d08-2eef-4acc-ad89-fd1c15c44f2d tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:05.861771 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-414f1d08-2eef-4acc-ad89-fd1c15c44f2d tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:05.862725 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-414f1d08-2eef-4acc-ad89-fd1c15c44f2d tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:05.864046 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-414f1d08-2eef-4acc-ad89-fd1c15c44f2d tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:05.864653 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-414f1d08-2eef-4acc-ad89-fd1c15c44f2d tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:05.865371 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-414f1d08-2eef-4acc-ad89-fd1c15c44f2d tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:05.954714 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-920df74e-9a5e-4515-a74d-526dfc8d1a56 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:05.965137 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-920df74e-9a5e-4515-a74d-526dfc8d1a56 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:05.967731 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-920df74e-9a5e-4515-a74d-526dfc8d1a56 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:05.969067 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-920df74e-9a5e-4515-a74d-526dfc8d1a56 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] 10.222.0.33 "GET /compute/v2.1/servers/8f1e4990-6f32-426c-bdea-ce2007c37a6f" status: 200 len: 1265 microversion: 2.25 time: 0.204513 Oct 04 20:43:05.969829 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1126/2197] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:43:05 2022] GET /compute/v2.1/servers/8f1e4990-6f32-426c-bdea-ce2007c37a6f => generated 1265 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:43:05.974982 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-a0abbdc3-f7f6-4707-b14e-7d9c4874be3d tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Action: 'create', calling method: .version_select at 0x7f3c7885ce50>, body: {"pool": null} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:43:06.358899 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-414f1d08-2eef-4acc-ad89-fd1c15c44f2d tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '800db3a57ada47eca381b00189fdbf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66ec8ea91b04deb90b679589e0495bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:06.375011 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-414f1d08-2eef-4acc-ad89-fd1c15c44f2d tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] 10.222.0.33 "GET /compute/v2.1/servers/17f61077-3e1c-4d86-b364-b22e4e40b3ca" status: 200 len: 1197 microversion: 2.1 time: 0.525833 Oct 04 20:43:06.378140 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1072/2198] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:43:05 2022] GET /compute/v2.1/servers/17f61077-3e1c-4d86-b364-b22e4e40b3ca => generated 1197 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:43:06.384582 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0e40ec1a-2687-40b6-a08e-e4eab7637218 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:06.385570 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-0e40ec1a-2687-40b6-a08e-e4eab7637218 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] [instance: 2bae38c5-cec9-444b-8879-dcb7eb2822e6] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:06.395624 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0e40ec1a-2687-40b6-a08e-e4eab7637218 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:06.396417 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0e40ec1a-2687-40b6-a08e-e4eab7637218 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:06.397066 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0e40ec1a-2687-40b6-a08e-e4eab7637218 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:06.398277 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0e40ec1a-2687-40b6-a08e-e4eab7637218 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:06.399167 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0e40ec1a-2687-40b6-a08e-e4eab7637218 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:06.400031 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0e40ec1a-2687-40b6-a08e-e4eab7637218 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:06.799718 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-0e40ec1a-2687-40b6-a08e-e4eab7637218 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e1e240b20e41e8b90e0d630e0d6b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a44744f2bb4130b9a49065b49cf854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:06.809399 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-0e40ec1a-2687-40b6-a08e-e4eab7637218 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] 10.222.0.33 "GET /compute/v2.1/servers/2bae38c5-cec9-444b-8879-dcb7eb2822e6" status: 200 len: 1355 microversion: 2.1 time: 0.429273 Oct 04 20:43:06.810000 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1073/2199] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:43:06 2022] GET /compute/v2.1/servers/2bae38c5-cec9-444b-8879-dcb7eb2822e6 => generated 1355 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:43:06.814973 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7d8ce545-8aff-4ad3-bd29-83eb44522b80 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Action: 'create', calling method: .version_select at 0x7f3c741f1940>, body: {"pool": null} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:43:10.245180 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-a0abbdc3-f7f6-4707-b14e-7d9c4874be3d tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] 10.222.0.33 "POST /compute/v2.1/os-floating-ips" status: 200 len: 140 microversion: 2.1 time: 4.274212 Oct 04 20:43:10.255516 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1127/2200] 10.222.0.33 () {60 vars in 1170 bytes} [Tue Oct 4 20:43:05 2022] POST /compute/v2.1/os-floating-ips => generated 140 bytes in 4285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:43:10.260850 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-65479a77-7aff-4370-82cb-323352cb157b req-be482539-23f3-4967-abbd-04a42a04801f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2bae38c5-cec9-444b-8879-dcb7eb2822e6", "tag": "651fbaa6-3b6b-47e0-878e-047d44c783c9"}, {"name": "network-changed", "server_uuid": "c806a6c6-6b03-4b6e-9247-75b8541ce9b4", "tag": "059512bd-a604-4d49-978d-ee2246b9e518"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:43:10.273499 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:43:10.276885 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-65479a77-7aff-4370-82cb-323352cb157b req-be482539-23f3-4967-abbd-04a42a04801f service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:10.278456 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-65479a77-7aff-4370-82cb-323352cb157b req-be482539-23f3-4967-abbd-04a42a04801f service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:10.279379 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-65479a77-7aff-4370-82cb-323352cb157b req-be482539-23f3-4967-abbd-04a42a04801f service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:10.301864 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-65479a77-7aff-4370-82cb-323352cb157b req-be482539-23f3-4967-abbd-04a42a04801f service nova] Creating event network-changed:651fbaa6-3b6b-47e0-878e-047d44c783c9 for instance 2bae38c5-cec9-444b-8879-dcb7eb2822e6 on n-h2-854823-8 Oct 04 20:43:10.302295 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-65479a77-7aff-4370-82cb-323352cb157b req-be482539-23f3-4967-abbd-04a42a04801f service nova] Creating event network-changed:059512bd-a604-4d49-978d-ee2246b9e518 for instance c806a6c6-6b03-4b6e-9247-75b8541ce9b4 on n-h2-854823-8 Oct 04 20:43:10.309350 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-65479a77-7aff-4370-82cb-323352cb157b req-be482539-23f3-4967-abbd-04a42a04801f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.052443 Oct 04 20:43:10.310179 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1128/2201] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:43:10 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:43:10.315906 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-520b696f-ca01-4afb-97d1-a3702287ed72 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:10.316621 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-520b696f-ca01-4afb-97d1-a3702287ed72 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] [instance: d849cb42-dfe6-4225-814a-90bef2839739] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:10.323754 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-520b696f-ca01-4afb-97d1-a3702287ed72 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:10.324337 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-520b696f-ca01-4afb-97d1-a3702287ed72 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:10.325476 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-520b696f-ca01-4afb-97d1-a3702287ed72 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:10.326412 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-520b696f-ca01-4afb-97d1-a3702287ed72 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:10.326882 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-520b696f-ca01-4afb-97d1-a3702287ed72 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:10.327312 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-520b696f-ca01-4afb-97d1-a3702287ed72 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:10.589926 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-520b696f-ca01-4afb-97d1-a3702287ed72 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e4b00964014a0383f79597652bd428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7f38600b5041ad8e66a12d77b940fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:10.604475 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-520b696f-ca01-4afb-97d1-a3702287ed72 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] 10.222.0.33 "GET /compute/v2.1/servers/d849cb42-dfe6-4225-814a-90bef2839739" status: 200 len: 1365 microversion: 2.1 time: 0.291776 Oct 04 20:43:10.605794 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1129/2202] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:43:10 2022] GET /compute/v2.1/servers/d849cb42-dfe6-4225-814a-90bef2839739 => generated 1365 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:43:10.614217 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-adb225b3-8389-4883-9275-29f8de6b77eb tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:10.615368 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-adb225b3-8389-4883-9275-29f8de6b77eb tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] [instance: c0a14e22-0620-4912-9893-62974c80978a] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:10.625510 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-adb225b3-8389-4883-9275-29f8de6b77eb tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:10.626536 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-adb225b3-8389-4883-9275-29f8de6b77eb tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:10.627622 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-adb225b3-8389-4883-9275-29f8de6b77eb tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:10.628885 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-adb225b3-8389-4883-9275-29f8de6b77eb tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:10.629547 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-adb225b3-8389-4883-9275-29f8de6b77eb tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:10.630272 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-adb225b3-8389-4883-9275-29f8de6b77eb tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:11.498506 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-adb225b3-8389-4883-9275-29f8de6b77eb tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28399882314945d787a3af6eb59935c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5392c67506f7445ab33d62b191558f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:11.508122 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-adb225b3-8389-4883-9275-29f8de6b77eb tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28399882314945d787a3af6eb59935c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5392c67506f7445ab33d62b191558f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:11.509546 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-adb225b3-8389-4883-9275-29f8de6b77eb tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28399882314945d787a3af6eb59935c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5392c67506f7445ab33d62b191558f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:11.522712 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-adb225b3-8389-4883-9275-29f8de6b77eb tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] 10.222.0.33 "GET /compute/v2.1/servers/c0a14e22-0620-4912-9893-62974c80978a" status: 200 len: 1849 microversion: 2.32 time: 0.901698 Oct 04 20:43:11.523369 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1130/2203] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:43:10 2022] GET /compute/v2.1/servers/c0a14e22-0620-4912-9893-62974c80978a => generated 1849 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:43:11.524743 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-7d8ce545-8aff-4ad3-bd29-83eb44522b80 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] 10.222.0.33 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.713287 Oct 04 20:43:11.525335 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1074/2204] 10.222.0.33 () {60 vars in 1170 bytes} [Tue Oct 4 20:43:06 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4715 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:43:11.530327 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-eb38bc88-ee81-44a6-acb9-fbd6ccbf0170 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:11.530947 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-eb38bc88-ee81-44a6-acb9-fbd6ccbf0170 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] [instance: 17f61077-3e1c-4d86-b364-b22e4e40b3ca] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:11.537399 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-eb38bc88-ee81-44a6-acb9-fbd6ccbf0170 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:11.537885 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-eb38bc88-ee81-44a6-acb9-fbd6ccbf0170 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:11.538316 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-eb38bc88-ee81-44a6-acb9-fbd6ccbf0170 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:11.542902 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-eb38bc88-ee81-44a6-acb9-fbd6ccbf0170 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:11.544294 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-eb38bc88-ee81-44a6-acb9-fbd6ccbf0170 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:11.545518 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-eb38bc88-ee81-44a6-acb9-fbd6ccbf0170 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:11.557565 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-a917aa53-3383-4751-9dd9-c4ef1ec0abe0 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:11.565677 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-a917aa53-3383-4751-9dd9-c4ef1ec0abe0 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] [instance: 8f1e4990-6f32-426c-bdea-ce2007c37a6f] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:11.577987 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a917aa53-3383-4751-9dd9-c4ef1ec0abe0 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:11.578762 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a917aa53-3383-4751-9dd9-c4ef1ec0abe0 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:11.579365 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a917aa53-3383-4751-9dd9-c4ef1ec0abe0 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:11.580242 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a917aa53-3383-4751-9dd9-c4ef1ec0abe0 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:11.582080 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a917aa53-3383-4751-9dd9-c4ef1ec0abe0 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:11.584028 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a917aa53-3383-4751-9dd9-c4ef1ec0abe0 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:11.610715 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.wsgi [None req-a917aa53-3383-4751-9dd9-c4ef1ec0abe0 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] HTTP exception thrown: Instance 8f1e4990-6f32-426c-bdea-ce2007c37a6f could not be found. Oct 04 20:43:11.612869 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-a917aa53-3383-4751-9dd9-c4ef1ec0abe0 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Request method failure captured: Oct 04 20:43:11.612869 n-d-854823-8 devstack@n-api.service[128802]: request: GET /compute/v2.1/servers/8f1e4990-6f32-426c-bdea-ce2007c37a6f HTTP/1.1 Oct 04 20:43:11.612869 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 20:43:11.612869 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 20:43:11.612869 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 20:43:11.612869 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 0 Oct 04 20:43:11.612869 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 20:43:11.612869 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 20:43:11.612869 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 20:43:11.612869 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 20:43:11.612869 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPJlS7YkNoNsErcluy9zSzxfkdD1qZsxsTW6bj1bKeKNXQ1TZFsYEQE0A2-BDVieUj00yHcDo9HNRo-TRBb7WBLfhc-CTf5TtIr0bX4L7OLkl9dbNYfuXD8y1gAU3Jdg3pQ4OIwr5m4ORRwm2L-EVgflU4LvUAUpABmHQuENksFWfbrE Oct 04 20:43:11.612869 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 20:43:11.612869 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 20:43:11.612869 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 20:43:11.612869 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 20:43:11.612869 n-d-854823-8 devstack@n-api.service[128802]: X-Openstack-Nova-Api-Version: 2.25 Oct 04 20:43:11.612869 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 20:43:11.612869 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 20:43:11.612869 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: 4310eadf656d4ba88ade5714c9661488 Oct 04 20:43:11.612869 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1173687642 Oct 04 20:43:11.612869 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 20:43:11.612869 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 20:43:11.612869 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_4310eadf656d4ba88ade5714c9661488", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4310eadf656d4ba88ade5714c9661488"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4310eadf656d4ba88ade5714c9661488"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/4310eadf656d4ba88ade5714c9661488"}]}] Oct 04 20:43:11.612869 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1173687642 Oct 04 20:43:11.612869 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: 4310eadf656d4ba88ade5714c9661488 Oct 04 20:43:11.612869 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1173687642 Oct 04 20:43:11.612869 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-LiveAutoBlockMigrationV225Test-1173687642-project Oct 04 20:43:11.612869 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 20:43:11.612869 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 20:43:11.612869 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: beaac70ab9344f6c9677d6500b8b0df6 Oct 04 20:43:11.612869 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1173687642-project Oct 04 20:43:11.612869 n-d-854823-8 devstack@n-api.service[128802]: method: > Oct 04 20:43:11.612869 n-d-854823-8 devstack@n-api.service[128802]: exception: Instance 8f1e4990-6f32-426c-bdea-ce2007c37a6f could not be found. Oct 04 20:43:11.612869 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'id': '8f1e4990-6f32-426c-bdea-ce2007c37a6f'} Oct 04 20:43:11.612869 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:43:11.612869 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:43:11.612869 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:43:11.612869 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:43:11.612869 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:43:11.612869 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:43:11.612869 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:43:11.612869 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:43:11.612869 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:43:11.612869 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:43:11.612869 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f1e4990-6f32-426c-bdea-ce2007c37a6f could not be found. Oct 04 20:43:11.612869 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:43:11.612869 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:43:11.612869 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:43:11.612869 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:43:11.612869 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:43:11.612869 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:43:11.612869 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:43:11.612869 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:43:11.612869 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:43:11.612869 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:43:11.612869 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:43:11.612869 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:43:11.612869 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:43:11.612869 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:43:11.612869 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:43:11.612869 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:43:11.612869 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f1e4990-6f32-426c-bdea-ce2007c37a6f could not be found. Oct 04 20:43:11.612869 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:43:11.617133 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:43:11.617133 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:43:11.617133 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:43:11.617133 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:43:11.617133 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:43:11.617133 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:43:11.617133 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:43:11.617133 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f1e4990-6f32-426c-bdea-ce2007c37a6f could not be found. Oct 04 20:43:11.617133 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:43:11.618441 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-a917aa53-3383-4751-9dd9-c4ef1ec0abe0 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Returning 404 to user: Instance 8f1e4990-6f32-426c-bdea-ce2007c37a6f could not be found. {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:43:11.619470 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-a917aa53-3383-4751-9dd9-c4ef1ec0abe0 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] 10.222.0.33 "GET /compute/v2.1/servers/8f1e4990-6f32-426c-bdea-ce2007c37a6f" status: 404 len: 111 microversion: 2.25 time: 0.077895 Oct 04 20:43:11.620509 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1131/2205] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:43:11 2022] GET /compute/v2.1/servers/8f1e4990-6f32-426c-bdea-ce2007c37a6f => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 20:43:11.625854 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-978a44b9-65a8-4bb7-b628-e3d155fd2993 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:11.626781 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-978a44b9-65a8-4bb7-b628-e3d155fd2993 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] [instance: 2bae38c5-cec9-444b-8879-dcb7eb2822e6] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:11.634541 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-978a44b9-65a8-4bb7-b628-e3d155fd2993 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:11.635228 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-978a44b9-65a8-4bb7-b628-e3d155fd2993 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:11.635819 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-978a44b9-65a8-4bb7-b628-e3d155fd2993 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:11.636680 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-978a44b9-65a8-4bb7-b628-e3d155fd2993 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:11.637329 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-978a44b9-65a8-4bb7-b628-e3d155fd2993 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:11.637919 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-978a44b9-65a8-4bb7-b628-e3d155fd2993 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:11.661304 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=100 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:43:12.107532 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-eb38bc88-ee81-44a6-acb9-fbd6ccbf0170 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '800db3a57ada47eca381b00189fdbf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66ec8ea91b04deb90b679589e0495bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:12.111126 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-978a44b9-65a8-4bb7-b628-e3d155fd2993 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e1e240b20e41e8b90e0d630e0d6b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a44744f2bb4130b9a49065b49cf854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:12.119313 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-eb38bc88-ee81-44a6-acb9-fbd6ccbf0170 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] 10.222.0.33 "GET /compute/v2.1/servers/17f61077-3e1c-4d86-b364-b22e4e40b3ca" status: 200 len: 1381 microversion: 2.1 time: 0.592793 Oct 04 20:43:12.120091 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-978a44b9-65a8-4bb7-b628-e3d155fd2993 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] 10.222.0.33 "GET /compute/v2.1/servers/2bae38c5-cec9-444b-8879-dcb7eb2822e6" status: 200 len: 1355 microversion: 2.1 time: 0.498341 Oct 04 20:43:12.121149 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1075/2206] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:43:11 2022] GET /compute/v2.1/servers/17f61077-3e1c-4d86-b364-b22e4e40b3ca => generated 1381 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:43:12.127231 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-ac22ac19-a1a7-4a90-898a-be10180067be req-9a4353de-ffd8-477d-9272-ab85e763fa06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d849cb42-dfe6-4225-814a-90bef2839739", "name": "network-vif-plugged", "status": "completed", "tag": "43c43378-662f-421f-8638-f0585d16813b"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:43:12.131757 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1132/2207] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:43:11 2022] GET /compute/v2.1/servers/2bae38c5-cec9-444b-8879-dcb7eb2822e6 => generated 1355 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:43:12.140503 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-ac22ac19-a1a7-4a90-898a-be10180067be req-9a4353de-ffd8-477d-9272-ab85e763fa06 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:12.141452 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-ac22ac19-a1a7-4a90-898a-be10180067be req-9a4353de-ffd8-477d-9272-ab85e763fa06 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:12.142147 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-ac22ac19-a1a7-4a90-898a-be10180067be req-9a4353de-ffd8-477d-9272-ab85e763fa06 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:12.144083 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-e2c7292f-f656-49fa-8bb8-f5ea762940d5 tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.4.2"}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:43:12.146937 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-e2c7292f-f656-49fa-8bb8-f5ea762940d5 tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] [instance: c806a6c6-6b03-4b6e-9247-75b8541ce9b4] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:12.154293 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e2c7292f-f656-49fa-8bb8-f5ea762940d5 tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:12.154990 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e2c7292f-f656-49fa-8bb8-f5ea762940d5 tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:12.155746 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e2c7292f-f656-49fa-8bb8-f5ea762940d5 tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:12.156737 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e2c7292f-f656-49fa-8bb8-f5ea762940d5 tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:12.157404 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e2c7292f-f656-49fa-8bb8-f5ea762940d5 tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:12.158046 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e2c7292f-f656-49fa-8bb8-f5ea762940d5 tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:12.160525 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-ac22ac19-a1a7-4a90-898a-be10180067be req-9a4353de-ffd8-477d-9272-ab85e763fa06 service nova] Creating event network-vif-plugged:43c43378-662f-421f-8638-f0585d16813b for instance d849cb42-dfe6-4225-814a-90bef2839739 on n-h2-854823-8 Oct 04 20:43:12.167651 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-ac22ac19-a1a7-4a90-898a-be10180067be req-9a4353de-ffd8-477d-9272-ab85e763fa06 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043966 Oct 04 20:43:12.168774 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1076/2208] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:43:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:43:12.178888 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-4f5e10bc-51c2-43ac-9664-96d386932b38 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-2079841186", "imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63", "flavorRef": "452", "networks": [{"uuid": "8041a123-3203-48c7-8a2d-6c4dad3abeb6"}]}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:43:12.219601 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e2c7292f-f656-49fa-8bb8-f5ea762940d5 tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Acquiring lock "refresh_cache-c806a6c6-6b03-4b6e-9247-75b8541ce9b4" {{(pid=128802) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 04 20:43:12.219810 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e2c7292f-f656-49fa-8bb8-f5ea762940d5 tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Acquired lock "refresh_cache-c806a6c6-6b03-4b6e-9247-75b8541ce9b4" {{(pid=128802) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 04 20:43:12.270511 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.network.neutron [None req-4f5e10bc-51c2-43ac-9664-96d386932b38 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] validate_networks() for [('8041a123-3203-48c7-8a2d-6c4dad3abeb6', None, None, None, None, None)] {{(pid=128801) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:43:13.607579 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-4f5e10bc-51c2-43ac-9664-96d386932b38 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Flavor limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:43:13.608669 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-4f5e10bc-51c2-43ac-9664-96d386932b38 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Image limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:43:13.609290 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-4f5e10bc-51c2-43ac-9664-96d386932b38 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Flavor pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:43:13.609871 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-4f5e10bc-51c2-43ac-9664-96d386932b38 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Image pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:43:13.610817 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-4f5e10bc-51c2-43ac-9664-96d386932b38 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:43:13.620430 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4f5e10bc-51c2-43ac-9664-96d386932b38 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:13.620902 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4f5e10bc-51c2-43ac-9664-96d386932b38 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:13.622286 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4f5e10bc-51c2-43ac-9664-96d386932b38 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:13.623083 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4f5e10bc-51c2-43ac-9664-96d386932b38 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:13.623696 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4f5e10bc-51c2-43ac-9664-96d386932b38 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:13.624124 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4f5e10bc-51c2-43ac-9664-96d386932b38 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:13.642250 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-4f5e10bc-51c2-43ac-9664-96d386932b38 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Getting quotas for project 2f258cb1ecd049078b201eb41692735a. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:43:13.646791 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-4f5e10bc-51c2-43ac-9664-96d386932b38 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Getting quotas for user 07c500628d414c9983836c33563b38bc and project 2f258cb1ecd049078b201eb41692735a. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:43:13.659025 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-4f5e10bc-51c2-43ac-9664-96d386932b38 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Going to run 1 instances... {{(pid=128801) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:43:13.661453 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-4f5e10bc-51c2-43ac-9664-96d386932b38 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] [instance: 8ef51f7d-45b1-4d48-8611-5c7805f52d15] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='15b24725-0c99-4bcf-b1fb-907cdf8e2d63',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128801) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:43:13.710201 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-4f5e10bc-51c2-43ac-9664-96d386932b38 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.538608 Oct 04 20:43:13.718498 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1077/2209] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 20:43:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 1548 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 20:43:13.724109 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b0ede52e-50f7-4208-a6f4-10c648234999 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:13.724985 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b0ede52e-50f7-4208-a6f4-10c648234999 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] [instance: d849cb42-dfe6-4225-814a-90bef2839739] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:13.732741 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b0ede52e-50f7-4208-a6f4-10c648234999 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:13.733508 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b0ede52e-50f7-4208-a6f4-10c648234999 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:13.734095 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b0ede52e-50f7-4208-a6f4-10c648234999 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:13.735020 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b0ede52e-50f7-4208-a6f4-10c648234999 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:13.735625 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b0ede52e-50f7-4208-a6f4-10c648234999 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:13.736202 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b0ede52e-50f7-4208-a6f4-10c648234999 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:14.374584 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-b0ede52e-50f7-4208-a6f4-10c648234999 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e4b00964014a0383f79597652bd428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7f38600b5041ad8e66a12d77b940fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:14.385761 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b0ede52e-50f7-4208-a6f4-10c648234999 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] 10.222.0.33 "GET /compute/v2.1/servers/d849cb42-dfe6-4225-814a-90bef2839739" status: 200 len: 1365 microversion: 2.1 time: 0.665822 Oct 04 20:43:14.387947 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1078/2210] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:43:13 2022] GET /compute/v2.1/servers/d849cb42-dfe6-4225-814a-90bef2839739 => generated 1365 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:43:14.551510 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-3afb6749-cd51-41be-9c63-9bd135c96b69 tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:14.552652 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-3afb6749-cd51-41be-9c63-9bd135c96b69 tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] [instance: 17f61077-3e1c-4d86-b364-b22e4e40b3ca] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:14.575456 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3afb6749-cd51-41be-9c63-9bd135c96b69 tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:14.576897 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3afb6749-cd51-41be-9c63-9bd135c96b69 tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:14.577649 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3afb6749-cd51-41be-9c63-9bd135c96b69 tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:14.578571 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3afb6749-cd51-41be-9c63-9bd135c96b69 tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:14.579335 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3afb6749-cd51-41be-9c63-9bd135c96b69 tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:14.580328 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3afb6749-cd51-41be-9c63-9bd135c96b69 tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:14.941931 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-3afb6749-cd51-41be-9c63-9bd135c96b69 tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/17f61077-3e1c-4d86-b364-b22e4e40b3ca" status: 200 len: 1532 microversion: 2.1 time: 0.551800 Oct 04 20:43:14.944568 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1079/2211] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:43:14 2022] GET /compute/v2.1/servers/17f61077-3e1c-4d86-b364-b22e4e40b3ca => generated 1532 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:43:14.952064 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-26b1c2c3-5139-4472-ae15-7d3d342b87ac req-d3187771-9d4c-4c93-97e2-c88f5415a97a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2bae38c5-cec9-444b-8879-dcb7eb2822e6", "tag": "0c70749a-4945-4ee8-823a-ffab1c784795"}, {"name": "network-changed", "server_uuid": "c0a14e22-0620-4912-9893-62974c80978a", "tag": "06028cc3-2b0b-4175-9579-b3aaf701fc68"}, {"name": "network-changed", "server_uuid": "2bae38c5-cec9-444b-8879-dcb7eb2822e6", "tag": "28a5bcd6-0d84-4242-8515-221e946610a0"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:43:14.968676 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-26b1c2c3-5139-4472-ae15-7d3d342b87ac req-d3187771-9d4c-4c93-97e2-c88f5415a97a service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:14.969629 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-26b1c2c3-5139-4472-ae15-7d3d342b87ac req-d3187771-9d4c-4c93-97e2-c88f5415a97a service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:14.970271 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-26b1c2c3-5139-4472-ae15-7d3d342b87ac req-d3187771-9d4c-4c93-97e2-c88f5415a97a service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:14.989266 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-26b1c2c3-5139-4472-ae15-7d3d342b87ac req-d3187771-9d4c-4c93-97e2-c88f5415a97a service nova] Creating event network-changed:0c70749a-4945-4ee8-823a-ffab1c784795 for instance 2bae38c5-cec9-444b-8879-dcb7eb2822e6 on n-h2-854823-8 Oct 04 20:43:14.990281 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-26b1c2c3-5139-4472-ae15-7d3d342b87ac req-d3187771-9d4c-4c93-97e2-c88f5415a97a service nova] Creating event network-changed:06028cc3-2b0b-4175-9579-b3aaf701fc68 for instance c0a14e22-0620-4912-9893-62974c80978a on n-h1-854823-8 Oct 04 20:43:14.990997 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-26b1c2c3-5139-4472-ae15-7d3d342b87ac req-d3187771-9d4c-4c93-97e2-c88f5415a97a service nova] Creating event network-changed:28a5bcd6-0d84-4242-8515-221e946610a0 for instance 2bae38c5-cec9-444b-8879-dcb7eb2822e6 on n-h2-854823-8 Oct 04 20:43:15.004499 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-26b1c2c3-5139-4472-ae15-7d3d342b87ac req-d3187771-9d4c-4c93-97e2-c88f5415a97a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 513 microversion: 2.1 time: 0.058405 Oct 04 20:43:15.005120 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1080/2212] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:43:14 2022] POST /compute/v2.1/os-server-external-events => generated 513 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:43:15.011956 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b1e55f65-c96a-4a4f-a1e4-45e5b0874f4e tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:15.013407 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b1e55f65-c96a-4a4f-a1e4-45e5b0874f4e tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] [instance: c0a14e22-0620-4912-9893-62974c80978a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:15.020627 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b1e55f65-c96a-4a4f-a1e4-45e5b0874f4e tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:15.021436 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b1e55f65-c96a-4a4f-a1e4-45e5b0874f4e tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:15.021909 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b1e55f65-c96a-4a4f-a1e4-45e5b0874f4e tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:15.022660 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b1e55f65-c96a-4a4f-a1e4-45e5b0874f4e tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:15.023270 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b1e55f65-c96a-4a4f-a1e4-45e5b0874f4e tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:15.024981 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b1e55f65-c96a-4a4f-a1e4-45e5b0874f4e tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:15.743220 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-b1e55f65-c96a-4a4f-a1e4-45e5b0874f4e tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28399882314945d787a3af6eb59935c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5392c67506f7445ab33d62b191558f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:15.763485 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-b1e55f65-c96a-4a4f-a1e4-45e5b0874f4e tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28399882314945d787a3af6eb59935c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5392c67506f7445ab33d62b191558f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:15.765270 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-b1e55f65-c96a-4a4f-a1e4-45e5b0874f4e tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28399882314945d787a3af6eb59935c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5392c67506f7445ab33d62b191558f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:15.766787 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b1e55f65-c96a-4a4f-a1e4-45e5b0874f4e tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] 10.222.0.33 "GET /compute/v2.1/servers/c0a14e22-0620-4912-9893-62974c80978a" status: 200 len: 1891 microversion: 2.32 time: 0.760175 Oct 04 20:43:15.767458 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1081/2213] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:43:15 2022] GET /compute/v2.1/servers/c0a14e22-0620-4912-9893-62974c80978a => generated 1891 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:43:15.773622 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d9b492ea-6a80-4dd2-8e08-bc79fea0af74 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:15.774325 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d9b492ea-6a80-4dd2-8e08-bc79fea0af74 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] [instance: 2bae38c5-cec9-444b-8879-dcb7eb2822e6] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:15.780944 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d9b492ea-6a80-4dd2-8e08-bc79fea0af74 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:15.782150 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d9b492ea-6a80-4dd2-8e08-bc79fea0af74 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:15.782686 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d9b492ea-6a80-4dd2-8e08-bc79fea0af74 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:15.783933 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d9b492ea-6a80-4dd2-8e08-bc79fea0af74 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:15.784583 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d9b492ea-6a80-4dd2-8e08-bc79fea0af74 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:15.785353 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d9b492ea-6a80-4dd2-8e08-bc79fea0af74 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:16.140297 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d9b492ea-6a80-4dd2-8e08-bc79fea0af74 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e1e240b20e41e8b90e0d630e0d6b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a44744f2bb4130b9a49065b49cf854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:16.151751 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d9b492ea-6a80-4dd2-8e08-bc79fea0af74 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] 10.222.0.33 "GET /compute/v2.1/servers/2bae38c5-cec9-444b-8879-dcb7eb2822e6" status: 200 len: 1355 microversion: 2.1 time: 0.383169 Oct 04 20:43:16.153198 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1082/2214] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:43:15 2022] GET /compute/v2.1/servers/2bae38c5-cec9-444b-8879-dcb7eb2822e6 => generated 1355 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:43:16.157385 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-343ae78e-4df2-4dba-a789-5ea6474f1ddf tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:16.157994 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-343ae78e-4df2-4dba-a789-5ea6474f1ddf tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] [instance: 8ef51f7d-45b1-4d48-8611-5c7805f52d15] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:16.161801 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.network.neutron [None req-e2c7292f-f656-49fa-8bb8-f5ea762940d5 tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] [instance: c806a6c6-6b03-4b6e-9247-75b8541ce9b4] Building network info cache for instance {{(pid=128802) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 04 20:43:16.227980 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-343ae78e-4df2-4dba-a789-5ea6474f1ddf tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:16.228488 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-343ae78e-4df2-4dba-a789-5ea6474f1ddf tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:16.228927 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-343ae78e-4df2-4dba-a789-5ea6474f1ddf tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:16.229652 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-343ae78e-4df2-4dba-a789-5ea6474f1ddf tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:16.230105 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-343ae78e-4df2-4dba-a789-5ea6474f1ddf tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:16.231751 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-343ae78e-4df2-4dba-a789-5ea6474f1ddf tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:17.731695 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-343ae78e-4df2-4dba-a789-5ea6474f1ddf tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07c500628d414c9983836c33563b38bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f258cb1ecd049078b201eb41692735a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:17.756265 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-343ae78e-4df2-4dba-a789-5ea6474f1ddf tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] 10.222.0.33 "GET /compute/v2.1/servers/8ef51f7d-45b1-4d48-8611-5c7805f52d15" status: 200 len: 1324 microversion: 2.1 time: 1.602303 Oct 04 20:43:17.757200 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1083/2215] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:43:16 2022] GET /compute/v2.1/servers/8ef51f7d-45b1-4d48-8611-5c7805f52d15 => generated 1324 bytes in 1604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:43:17.761733 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-4f8939d9-25e0-450d-94b5-43ba279d5a7f tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:17.762950 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-4f8939d9-25e0-450d-94b5-43ba279d5a7f tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] [instance: 17f61077-3e1c-4d86-b364-b22e4e40b3ca] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:17.771866 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4f8939d9-25e0-450d-94b5-43ba279d5a7f tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:17.772362 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4f8939d9-25e0-450d-94b5-43ba279d5a7f tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:17.772804 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4f8939d9-25e0-450d-94b5-43ba279d5a7f tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:17.773528 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4f8939d9-25e0-450d-94b5-43ba279d5a7f tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:17.773989 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4f8939d9-25e0-450d-94b5-43ba279d5a7f tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:17.774440 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4f8939d9-25e0-450d-94b5-43ba279d5a7f tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:17.805037 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=100 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:43:18.276536 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-4f8939d9-25e0-450d-94b5-43ba279d5a7f tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/17f61077-3e1c-4d86-b364-b22e4e40b3ca" status: 200 len: 1532 microversion: 2.1 time: 0.516532 Oct 04 20:43:18.279420 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1084/2216] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:43:17 2022] GET /compute/v2.1/servers/17f61077-3e1c-4d86-b364-b22e4e40b3ca => generated 1532 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:43:18.285333 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-57c1b396-de6a-433c-b269-f51409613c72 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:18.286258 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-57c1b396-de6a-433c-b269-f51409613c72 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] [instance: d849cb42-dfe6-4225-814a-90bef2839739] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:18.301779 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-57c1b396-de6a-433c-b269-f51409613c72 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:18.307318 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-57c1b396-de6a-433c-b269-f51409613c72 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:18.308098 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-57c1b396-de6a-433c-b269-f51409613c72 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:18.310195 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-57c1b396-de6a-433c-b269-f51409613c72 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:18.312609 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-57c1b396-de6a-433c-b269-f51409613c72 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:18.313342 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-57c1b396-de6a-433c-b269-f51409613c72 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:18.505673 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.network.neutron [None req-e2c7292f-f656-49fa-8bb8-f5ea762940d5 tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] [instance: c806a6c6-6b03-4b6e-9247-75b8541ce9b4] Updating instance_info_cache with network_info: [{"id": "059512bd-a604-4d49-978d-ee2246b9e518", "address": "fa:16:3e:3c:25:4b", "network": {"id": "acfc8820-ee09-4a6a-92bb-7ee4a63b93f8", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-1073232699-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "c99c97de335941a4af0f09c695ab3a43", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap059512bd-a6", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128802) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 04 20:43:18.519546 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e2c7292f-f656-49fa-8bb8-f5ea762940d5 tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Releasing lock "refresh_cache-c806a6c6-6b03-4b6e-9247-75b8541ce9b4" {{(pid=128802) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 04 20:43:18.520499 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-e2c7292f-f656-49fa-8bb8-f5ea762940d5 tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] 10.222.0.33 "POST /compute/v2.1/servers/c806a6c6-6b03-4b6e-9247-75b8541ce9b4/action" status: 202 len: 0 microversion: 2.1 time: 6.387630 Oct 04 20:43:18.521118 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1133/2217] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 20:43:12 2022] POST /compute/v2.1/servers/c806a6c6-6b03-4b6e-9247-75b8541ce9b4/action => generated 0 bytes in 6389 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 04 20:43:18.526222 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-857df76b-95ce-4f71-88d0-b217363c23b9 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:18.526838 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-857df76b-95ce-4f71-88d0-b217363c23b9 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] [instance: c0a14e22-0620-4912-9893-62974c80978a] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:18.533855 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-857df76b-95ce-4f71-88d0-b217363c23b9 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:18.534370 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-857df76b-95ce-4f71-88d0-b217363c23b9 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:18.534901 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-857df76b-95ce-4f71-88d0-b217363c23b9 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:18.535643 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-857df76b-95ce-4f71-88d0-b217363c23b9 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:18.536105 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-857df76b-95ce-4f71-88d0-b217363c23b9 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:18.536529 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-857df76b-95ce-4f71-88d0-b217363c23b9 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:18.792194 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-57c1b396-de6a-433c-b269-f51409613c72 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e4b00964014a0383f79597652bd428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7f38600b5041ad8e66a12d77b940fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:18.805707 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-57c1b396-de6a-433c-b269-f51409613c72 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] 10.222.0.33 "GET /compute/v2.1/servers/d849cb42-dfe6-4225-814a-90bef2839739" status: 200 len: 1554 microversion: 2.1 time: 0.524772 Oct 04 20:43:18.817276 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1085/2218] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:43:18 2022] GET /compute/v2.1/servers/d849cb42-dfe6-4225-814a-90bef2839739 => generated 1554 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:43:18.828805 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-3ffc52c8-3e1f-4dab-bd66-8eea2144a3a3 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:18.829424 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-3ffc52c8-3e1f-4dab-bd66-8eea2144a3a3 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] [instance: 2bae38c5-cec9-444b-8879-dcb7eb2822e6] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:18.836538 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3ffc52c8-3e1f-4dab-bd66-8eea2144a3a3 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:18.837077 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3ffc52c8-3e1f-4dab-bd66-8eea2144a3a3 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:18.837547 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3ffc52c8-3e1f-4dab-bd66-8eea2144a3a3 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:18.838377 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3ffc52c8-3e1f-4dab-bd66-8eea2144a3a3 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:18.838832 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3ffc52c8-3e1f-4dab-bd66-8eea2144a3a3 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:18.839468 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3ffc52c8-3e1f-4dab-bd66-8eea2144a3a3 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:19.063770 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-857df76b-95ce-4f71-88d0-b217363c23b9 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28399882314945d787a3af6eb59935c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5392c67506f7445ab33d62b191558f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:19.075705 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-857df76b-95ce-4f71-88d0-b217363c23b9 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28399882314945d787a3af6eb59935c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5392c67506f7445ab33d62b191558f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:19.077267 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-857df76b-95ce-4f71-88d0-b217363c23b9 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28399882314945d787a3af6eb59935c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5392c67506f7445ab33d62b191558f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:19.078701 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-857df76b-95ce-4f71-88d0-b217363c23b9 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] 10.222.0.33 "GET /compute/v2.1/servers/c0a14e22-0620-4912-9893-62974c80978a" status: 200 len: 1879 microversion: 2.32 time: 0.556417 Oct 04 20:43:19.079585 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1134/2219] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:43:18 2022] GET /compute/v2.1/servers/c0a14e22-0620-4912-9893-62974c80978a => generated 1879 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:43:19.084627 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-4e9d9fa2-c7be-4b89-9dc1-1d43e839dcf4 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:19.085697 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-4e9d9fa2-c7be-4b89-9dc1-1d43e839dcf4 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] [instance: 81748c83-b703-4c68-899c-c575cc3340d2] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:19.092110 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4e9d9fa2-c7be-4b89-9dc1-1d43e839dcf4 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:19.092589 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4e9d9fa2-c7be-4b89-9dc1-1d43e839dcf4 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:19.093370 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4e9d9fa2-c7be-4b89-9dc1-1d43e839dcf4 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:19.095199 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4e9d9fa2-c7be-4b89-9dc1-1d43e839dcf4 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:19.095666 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4e9d9fa2-c7be-4b89-9dc1-1d43e839dcf4 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:19.096091 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4e9d9fa2-c7be-4b89-9dc1-1d43e839dcf4 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:19.124688 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-4e9d9fa2-c7be-4b89-9dc1-1d43e839dcf4 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] [instance: 81748c83-b703-4c68-899c-c575cc3340d2] Going to try to terminate instance {{(pid=128802) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:43:19.187680 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-3ffc52c8-3e1f-4dab-bd66-8eea2144a3a3 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e1e240b20e41e8b90e0d630e0d6b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a44744f2bb4130b9a49065b49cf854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:19.199190 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-3ffc52c8-3e1f-4dab-bd66-8eea2144a3a3 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] 10.222.0.33 "GET /compute/v2.1/servers/2bae38c5-cec9-444b-8879-dcb7eb2822e6" status: 200 len: 1355 microversion: 2.1 time: 0.383592 Oct 04 20:43:19.219049 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1086/2220] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:43:18 2022] GET /compute/v2.1/servers/2bae38c5-cec9-444b-8879-dcb7eb2822e6 => generated 1355 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:43:19.224781 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-d0e36a71-17c5-4b44-a4ca-2e97960f5f3d req-0db27eaa-0ff4-4446-ac2e-59f301142210 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0a14e22-0620-4912-9893-62974c80978a", "tag": "24c541fa-d6dd-41ae-99d3-45a43da2f893"}, {"name": "network-changed", "server_uuid": "c0a14e22-0620-4912-9893-62974c80978a", "tag": "41720b8f-0f05-4932-ad4e-fda7403fd530"}, {"name": "network-changed", "server_uuid": "c806a6c6-6b03-4b6e-9247-75b8541ce9b4", "tag": "059512bd-a604-4d49-978d-ee2246b9e518"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:43:19.231420 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-4e9d9fa2-c7be-4b89-9dc1-1d43e839dcf4 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] 10.222.0.33 "DELETE /compute/v2.1/servers/81748c83-b703-4c68-899c-c575cc3340d2" status: 204 len: 0 microversion: 2.25 time: 0.149529 Oct 04 20:43:19.232995 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1135/2221] 10.222.0.33 () {60 vars in 1280 bytes} [Tue Oct 4 20:43:19 2022] DELETE /compute/v2.1/servers/81748c83-b703-4c68-899c-c575cc3340d2 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 20:43:19.238682 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-e4451d29-c7dc-4149-a10e-72930191e277 req-9f4c3e83-2987-459e-b12f-d13243c85b99 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ef51f7d-45b1-4d48-8611-5c7805f52d15", "tag": "19434094-416b-42b5-95e8-2a04021d1e51"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:43:19.239446 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-d0e36a71-17c5-4b44-a4ca-2e97960f5f3d req-0db27eaa-0ff4-4446-ac2e-59f301142210 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:19.240169 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-d0e36a71-17c5-4b44-a4ca-2e97960f5f3d req-0db27eaa-0ff4-4446-ac2e-59f301142210 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:19.240746 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-d0e36a71-17c5-4b44-a4ca-2e97960f5f3d req-0db27eaa-0ff4-4446-ac2e-59f301142210 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:19.249538 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-e4451d29-c7dc-4149-a10e-72930191e277 req-9f4c3e83-2987-459e-b12f-d13243c85b99 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:19.250202 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-e4451d29-c7dc-4149-a10e-72930191e277 req-9f4c3e83-2987-459e-b12f-d13243c85b99 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:19.250688 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-e4451d29-c7dc-4149-a10e-72930191e277 req-9f4c3e83-2987-459e-b12f-d13243c85b99 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:19.257707 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-d0e36a71-17c5-4b44-a4ca-2e97960f5f3d req-0db27eaa-0ff4-4446-ac2e-59f301142210 service nova] Creating event network-changed:24c541fa-d6dd-41ae-99d3-45a43da2f893 for instance c0a14e22-0620-4912-9893-62974c80978a on n-h1-854823-8 Oct 04 20:43:19.258487 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-d0e36a71-17c5-4b44-a4ca-2e97960f5f3d req-0db27eaa-0ff4-4446-ac2e-59f301142210 service nova] Creating event network-changed:41720b8f-0f05-4932-ad4e-fda7403fd530 for instance c0a14e22-0620-4912-9893-62974c80978a on n-h1-854823-8 Oct 04 20:43:19.259209 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-d0e36a71-17c5-4b44-a4ca-2e97960f5f3d req-0db27eaa-0ff4-4446-ac2e-59f301142210 service nova] Creating event network-changed:059512bd-a604-4d49-978d-ee2246b9e518 for instance c806a6c6-6b03-4b6e-9247-75b8541ce9b4 on n-h2-854823-8 Oct 04 20:43:19.264827 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-e4451d29-c7dc-4149-a10e-72930191e277 req-9f4c3e83-2987-459e-b12f-d13243c85b99 service nova] Creating event network-changed:19434094-416b-42b5-95e8-2a04021d1e51 for instance 8ef51f7d-45b1-4d48-8611-5c7805f52d15 on n-h1-854823-8 Oct 04 20:43:19.270126 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-d0e36a71-17c5-4b44-a4ca-2e97960f5f3d req-0db27eaa-0ff4-4446-ac2e-59f301142210 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 513 microversion: 2.1 time: 0.049816 Oct 04 20:43:19.270781 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-e4451d29-c7dc-4149-a10e-72930191e277 req-9f4c3e83-2987-459e-b12f-d13243c85b99 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035994 Oct 04 20:43:19.271493 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1087/2222] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:43:19 2022] POST /compute/v2.1/os-server-external-events => generated 513 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:43:19.271654 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1136/2223] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:43:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:43:19.276935 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-4effc50b-8515-46c5-a13a-33f2c67eebb7 tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:19.280509 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0df2c94c-8e0a-4d47-99f5-f574995769ac tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.4.2"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:43:19.280921 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4effc50b-8515-46c5-a13a-33f2c67eebb7 tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:19.281407 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4effc50b-8515-46c5-a13a-33f2c67eebb7 tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:19.281853 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4effc50b-8515-46c5-a13a-33f2c67eebb7 tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:19.282706 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4effc50b-8515-46c5-a13a-33f2c67eebb7 tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:19.283261 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4effc50b-8515-46c5-a13a-33f2c67eebb7 tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:19.283689 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4effc50b-8515-46c5-a13a-33f2c67eebb7 tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:19.312154 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-4effc50b-8515-46c5-a13a-33f2c67eebb7 tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.039118 Oct 04 20:43:19.313071 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1137/2224] 10.222.0.33 () {58 vars in 1176 bytes} [Tue Oct 4 20:43:19 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:43:19.318314 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-86d26d9b-be96-4ce7-bdae-3ae45910dce5 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:19.319076 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-86d26d9b-be96-4ce7-bdae-3ae45910dce5 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] [instance: 8ef51f7d-45b1-4d48-8611-5c7805f52d15] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:19.328362 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-86d26d9b-be96-4ce7-bdae-3ae45910dce5 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:19.329118 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-86d26d9b-be96-4ce7-bdae-3ae45910dce5 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:19.329739 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-86d26d9b-be96-4ce7-bdae-3ae45910dce5 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:19.330835 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-86d26d9b-be96-4ce7-bdae-3ae45910dce5 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:19.331435 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-86d26d9b-be96-4ce7-bdae-3ae45910dce5 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:19.332012 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-86d26d9b-be96-4ce7-bdae-3ae45910dce5 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:19.648647 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-0df2c94c-8e0a-4d47-99f5-f574995769ac tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] [instance: c806a6c6-6b03-4b6e-9247-75b8541ce9b4] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:19.656368 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0df2c94c-8e0a-4d47-99f5-f574995769ac tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:19.657115 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0df2c94c-8e0a-4d47-99f5-f574995769ac tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:19.657761 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0df2c94c-8e0a-4d47-99f5-f574995769ac tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:19.658684 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0df2c94c-8e0a-4d47-99f5-f574995769ac tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:19.659395 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0df2c94c-8e0a-4d47-99f5-f574995769ac tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:19.660062 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0df2c94c-8e0a-4d47-99f5-f574995769ac tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:19.883545 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-86d26d9b-be96-4ce7-bdae-3ae45910dce5 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07c500628d414c9983836c33563b38bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f258cb1ecd049078b201eb41692735a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:19.894657 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-86d26d9b-be96-4ce7-bdae-3ae45910dce5 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] 10.222.0.33 "GET /compute/v2.1/servers/8ef51f7d-45b1-4d48-8611-5c7805f52d15" status: 200 len: 1324 microversion: 2.1 time: 0.580160 Oct 04 20:43:19.901433 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1138/2225] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:43:19 2022] GET /compute/v2.1/servers/8ef51f7d-45b1-4d48-8611-5c7805f52d15 => generated 1324 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:43:19.907322 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-f22db5a7-a4da-4e38-8614-e651d47e9d06 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:19.907995 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-f22db5a7-a4da-4e38-8614-e651d47e9d06 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] [instance: d849cb42-dfe6-4225-814a-90bef2839739] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:19.917827 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f22db5a7-a4da-4e38-8614-e651d47e9d06 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:19.918592 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f22db5a7-a4da-4e38-8614-e651d47e9d06 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:19.919326 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f22db5a7-a4da-4e38-8614-e651d47e9d06 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:19.920657 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f22db5a7-a4da-4e38-8614-e651d47e9d06 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:19.921239 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f22db5a7-a4da-4e38-8614-e651d47e9d06 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:19.921919 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f22db5a7-a4da-4e38-8614-e651d47e9d06 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:20.084000 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-f22db5a7-a4da-4e38-8614-e651d47e9d06 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] 10.222.0.33 "GET /compute/v2.1/servers/d849cb42-dfe6-4225-814a-90bef2839739/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.180798 Oct 04 20:43:20.093649 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1139/2226] 10.222.0.33 () {58 vars in 1275 bytes} [Tue Oct 4 20:43:19 2022] GET /compute/v2.1/servers/d849cb42-dfe6-4225-814a-90bef2839739/os-interface => generated 284 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:43:20.111391 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-2b49892e-78d0-48c3-b792-3e6156d5a138 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:20.114677 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-2b49892e-78d0-48c3-b792-3e6156d5a138 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] [instance: 81748c83-b703-4c68-899c-c575cc3340d2] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:20.133257 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2b49892e-78d0-48c3-b792-3e6156d5a138 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:20.133759 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2b49892e-78d0-48c3-b792-3e6156d5a138 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:20.134473 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2b49892e-78d0-48c3-b792-3e6156d5a138 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:20.135251 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2b49892e-78d0-48c3-b792-3e6156d5a138 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:20.135772 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2b49892e-78d0-48c3-b792-3e6156d5a138 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:20.136423 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2b49892e-78d0-48c3-b792-3e6156d5a138 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:20.221746 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0df2c94c-8e0a-4d47-99f5-f574995769ac tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Acquiring lock "refresh_cache-c806a6c6-6b03-4b6e-9247-75b8541ce9b4" {{(pid=128801) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 04 20:43:20.222188 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0df2c94c-8e0a-4d47-99f5-f574995769ac tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Acquired lock "refresh_cache-c806a6c6-6b03-4b6e-9247-75b8541ce9b4" {{(pid=128801) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 04 20:43:21.304276 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-2b49892e-78d0-48c3-b792-3e6156d5a138 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:21.315062 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-2b49892e-78d0-48c3-b792-3e6156d5a138 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:21.316504 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-2b49892e-78d0-48c3-b792-3e6156d5a138 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:21.317675 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-2b49892e-78d0-48c3-b792-3e6156d5a138 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] 10.222.0.33 "GET /compute/v2.1/servers/81748c83-b703-4c68-899c-c575cc3340d2" status: 200 len: 1730 microversion: 2.25 time: 1.216700 Oct 04 20:43:21.318609 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1140/2227] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:43:20 2022] GET /compute/v2.1/servers/81748c83-b703-4c68-899c-c575cc3340d2 => generated 1730 bytes in 1224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:43:21.323467 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-5843f204-7a71-417a-b581-725a08993531 tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-854823-8", "block_migration": false, "disk_over_commit": false}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:43:21.326866 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-5843f204-7a71-417a-b581-725a08993531 tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] [instance: 17f61077-3e1c-4d86-b364-b22e4e40b3ca] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:21.336122 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5843f204-7a71-417a-b581-725a08993531 tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:21.336910 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5843f204-7a71-417a-b581-725a08993531 tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:21.337412 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5843f204-7a71-417a-b581-725a08993531 tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:21.338184 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5843f204-7a71-417a-b581-725a08993531 tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:21.338738 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5843f204-7a71-417a-b581-725a08993531 tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:21.339226 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5843f204-7a71-417a-b581-725a08993531 tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:21.368318 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.objects.instance [None req-5843f204-7a71-417a-b581-725a08993531 tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] Lazy-loading 'flavor' on Instance uuid 17f61077-3e1c-4d86-b364-b22e4e40b3ca {{(pid=128802) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:43:21.383768 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-5843f204-7a71-417a-b581-725a08993531 tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] [instance: 17f61077-3e1c-4d86-b364-b22e4e40b3ca] Going to try to live migrate instance to n-h2-854823-8 {{(pid=128802) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 04 20:43:23.109166 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-5843f204-7a71-417a-b581-725a08993531 tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/17f61077-3e1c-4d86-b364-b22e4e40b3ca/action" status: 202 len: 0 microversion: 2.1 time: 1.789215 Oct 04 20:43:23.109850 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1141/2228] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 20:43:21 2022] POST /compute/v2.1/servers/17f61077-3e1c-4d86-b364-b22e4e40b3ca/action => generated 0 bytes in 1790 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:43:23.119548 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-6e7d3649-cb3b-4f91-b19c-be5c226d244b tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:23.120902 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-6e7d3649-cb3b-4f91-b19c-be5c226d244b tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] [instance: c0a14e22-0620-4912-9893-62974c80978a] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:23.136723 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6e7d3649-cb3b-4f91-b19c-be5c226d244b tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:23.137496 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6e7d3649-cb3b-4f91-b19c-be5c226d244b tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:23.138096 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6e7d3649-cb3b-4f91-b19c-be5c226d244b tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:23.139023 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6e7d3649-cb3b-4f91-b19c-be5c226d244b tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:23.139618 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6e7d3649-cb3b-4f91-b19c-be5c226d244b tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:23.140195 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6e7d3649-cb3b-4f91-b19c-be5c226d244b tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:23.633696 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:43:23.654655 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=6 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:43:23.879479 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-6e7d3649-cb3b-4f91-b19c-be5c226d244b tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28399882314945d787a3af6eb59935c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5392c67506f7445ab33d62b191558f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:23.888793 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-6e7d3649-cb3b-4f91-b19c-be5c226d244b tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28399882314945d787a3af6eb59935c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5392c67506f7445ab33d62b191558f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:23.890236 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-6e7d3649-cb3b-4f91-b19c-be5c226d244b tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28399882314945d787a3af6eb59935c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5392c67506f7445ab33d62b191558f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:23.891428 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-6e7d3649-cb3b-4f91-b19c-be5c226d244b tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] 10.222.0.33 "GET /compute/v2.1/servers/c0a14e22-0620-4912-9893-62974c80978a" status: 200 len: 1879 microversion: 2.32 time: 0.776686 Oct 04 20:43:23.891994 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1142/2229] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:43:23 2022] GET /compute/v2.1/servers/c0a14e22-0620-4912-9893-62974c80978a => generated 1879 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:43:23.911967 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-0556489a-e493-4fc7-80ad-553f5fca8ead tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:23.912624 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-0556489a-e493-4fc7-80ad-553f5fca8ead tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] [instance: 2bae38c5-cec9-444b-8879-dcb7eb2822e6] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:23.920014 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0556489a-e493-4fc7-80ad-553f5fca8ead tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:23.920492 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0556489a-e493-4fc7-80ad-553f5fca8ead tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:23.920918 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0556489a-e493-4fc7-80ad-553f5fca8ead tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:23.921734 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0556489a-e493-4fc7-80ad-553f5fca8ead tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:23.922184 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0556489a-e493-4fc7-80ad-553f5fca8ead tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:23.922648 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0556489a-e493-4fc7-80ad-553f5fca8ead tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:24.160203 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.network.neutron [None req-0df2c94c-8e0a-4d47-99f5-f574995769ac tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] [instance: c806a6c6-6b03-4b6e-9247-75b8541ce9b4] Building network info cache for instance {{(pid=128801) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 04 20:43:24.968112 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-0556489a-e493-4fc7-80ad-553f5fca8ead tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e1e240b20e41e8b90e0d630e0d6b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a44744f2bb4130b9a49065b49cf854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:24.977050 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-0556489a-e493-4fc7-80ad-553f5fca8ead tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] 10.222.0.33 "GET /compute/v2.1/servers/2bae38c5-cec9-444b-8879-dcb7eb2822e6" status: 200 len: 1355 microversion: 2.1 time: 1.083651 Oct 04 20:43:24.991284 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1143/2230] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:43:23 2022] GET /compute/v2.1/servers/2bae38c5-cec9-444b-8879-dcb7eb2822e6 => generated 1355 bytes in 1098 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:43:25.001760 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-73b45e05-d316-4fe9-a44e-9d2de59b16fa tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:25.002941 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-73b45e05-d316-4fe9-a44e-9d2de59b16fa tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] [instance: 8ef51f7d-45b1-4d48-8611-5c7805f52d15] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:25.009997 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-73b45e05-d316-4fe9-a44e-9d2de59b16fa tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:25.010864 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-73b45e05-d316-4fe9-a44e-9d2de59b16fa tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:25.011516 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-73b45e05-d316-4fe9-a44e-9d2de59b16fa tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:25.013359 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-73b45e05-d316-4fe9-a44e-9d2de59b16fa tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:25.013933 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-73b45e05-d316-4fe9-a44e-9d2de59b16fa tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:25.014495 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-73b45e05-d316-4fe9-a44e-9d2de59b16fa tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:25.696475 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-73b45e05-d316-4fe9-a44e-9d2de59b16fa tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07c500628d414c9983836c33563b38bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f258cb1ecd049078b201eb41692735a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:25.705306 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-73b45e05-d316-4fe9-a44e-9d2de59b16fa tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] 10.222.0.33 "GET /compute/v2.1/servers/8ef51f7d-45b1-4d48-8611-5c7805f52d15" status: 200 len: 1324 microversion: 2.1 time: 0.712675 Oct 04 20:43:25.706106 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1144/2231] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:43:24 2022] GET /compute/v2.1/servers/8ef51f7d-45b1-4d48-8611-5c7805f52d15 => generated 1324 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:43:25.722028 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-b4a772e1-c355-408b-8c48-9fc022b4ec55 req-9881727c-b941-43a0-969d-f9d8da627b32 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0a14e22-0620-4912-9893-62974c80978a", "tag": "dfc19e40-1e2b-4560-8ac7-cb603e8ca4ab"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:43:25.731352 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-b4a772e1-c355-408b-8c48-9fc022b4ec55 req-9881727c-b941-43a0-969d-f9d8da627b32 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:25.731814 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-b4a772e1-c355-408b-8c48-9fc022b4ec55 req-9881727c-b941-43a0-969d-f9d8da627b32 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:25.732230 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-b4a772e1-c355-408b-8c48-9fc022b4ec55 req-9881727c-b941-43a0-969d-f9d8da627b32 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:25.743340 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-b4a772e1-c355-408b-8c48-9fc022b4ec55 req-9881727c-b941-43a0-969d-f9d8da627b32 service nova] Creating event network-changed:dfc19e40-1e2b-4560-8ac7-cb603e8ca4ab for instance c0a14e22-0620-4912-9893-62974c80978a on n-h1-854823-8 Oct 04 20:43:25.748470 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-b4a772e1-c355-408b-8c48-9fc022b4ec55 req-9881727c-b941-43a0-969d-f9d8da627b32 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041039 Oct 04 20:43:25.749064 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1145/2232] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:43:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:43:25.754127 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-8e0890e3-52bb-468e-8155-18807531dd5b req-e53c5158-004c-4fe3-ac8a-708618d82c26 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0a14e22-0620-4912-9893-62974c80978a", "tag": "5f2c3d14-997c-4225-a9eb-1379adba5e6c"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:43:25.764152 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-8e0890e3-52bb-468e-8155-18807531dd5b req-e53c5158-004c-4fe3-ac8a-708618d82c26 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:25.764645 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-8e0890e3-52bb-468e-8155-18807531dd5b req-e53c5158-004c-4fe3-ac8a-708618d82c26 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:25.765067 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-8e0890e3-52bb-468e-8155-18807531dd5b req-e53c5158-004c-4fe3-ac8a-708618d82c26 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:25.775237 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-8e0890e3-52bb-468e-8155-18807531dd5b req-e53c5158-004c-4fe3-ac8a-708618d82c26 service nova] Creating event network-changed:5f2c3d14-997c-4225-a9eb-1379adba5e6c for instance c0a14e22-0620-4912-9893-62974c80978a on n-h1-854823-8 Oct 04 20:43:25.780201 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-8e0890e3-52bb-468e-8155-18807531dd5b req-e53c5158-004c-4fe3-ac8a-708618d82c26 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029723 Oct 04 20:43:25.780794 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1146/2233] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:43:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:43:25.786594 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-20298dbc-52fd-4d93-a584-b883995265ad tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:25.787308 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-20298dbc-52fd-4d93-a584-b883995265ad tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] [instance: 81748c83-b703-4c68-899c-c575cc3340d2] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:25.793869 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-20298dbc-52fd-4d93-a584-b883995265ad tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:25.794530 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-20298dbc-52fd-4d93-a584-b883995265ad tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:25.794965 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-20298dbc-52fd-4d93-a584-b883995265ad tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:25.795682 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-20298dbc-52fd-4d93-a584-b883995265ad tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:25.796297 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-20298dbc-52fd-4d93-a584-b883995265ad tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:25.796722 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-20298dbc-52fd-4d93-a584-b883995265ad tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:25.935849 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-20298dbc-52fd-4d93-a584-b883995265ad tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:25.938643 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=92,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=4,nova_cell1:RELEASE=1,nova_cell1:INSERT=2 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:43:25.948819 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-20298dbc-52fd-4d93-a584-b883995265ad tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:25.951133 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-20298dbc-52fd-4d93-a584-b883995265ad tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:25.952547 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-20298dbc-52fd-4d93-a584-b883995265ad tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] 10.222.0.33 "GET /compute/v2.1/servers/81748c83-b703-4c68-899c-c575cc3340d2" status: 200 len: 1663 microversion: 2.25 time: 0.170672 Oct 04 20:43:25.953110 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1147/2234] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:43:25 2022] GET /compute/v2.1/servers/81748c83-b703-4c68-899c-c575cc3340d2 => generated 1663 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:43:25.957968 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-b8024d3a-e1a9-42a8-882b-0075098948d5 req-6637a63e-e14e-4549-9c1b-662c237f4caf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2bae38c5-cec9-444b-8879-dcb7eb2822e6", "name": "network-vif-plugged", "status": "completed", "tag": "0c70749a-4945-4ee8-823a-ffab1c784795"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:43:25.971407 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-b8024d3a-e1a9-42a8-882b-0075098948d5 req-6637a63e-e14e-4549-9c1b-662c237f4caf service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:25.972649 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-b8024d3a-e1a9-42a8-882b-0075098948d5 req-6637a63e-e14e-4549-9c1b-662c237f4caf service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:25.973301 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-b8024d3a-e1a9-42a8-882b-0075098948d5 req-6637a63e-e14e-4549-9c1b-662c237f4caf service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:25.992308 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-b8024d3a-e1a9-42a8-882b-0075098948d5 req-6637a63e-e14e-4549-9c1b-662c237f4caf service nova] Creating event network-vif-plugged:0c70749a-4945-4ee8-823a-ffab1c784795 for instance 2bae38c5-cec9-444b-8879-dcb7eb2822e6 on n-h2-854823-8 Oct 04 20:43:25.998638 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-b8024d3a-e1a9-42a8-882b-0075098948d5 req-6637a63e-e14e-4549-9c1b-662c237f4caf service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044057 Oct 04 20:43:25.999631 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1148/2235] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:43:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:43:26.005204 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-9e287351-bdf2-4ea9-be46-6db8ecd2507e tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:26.005963 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-9e287351-bdf2-4ea9-be46-6db8ecd2507e tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] [instance: 17f61077-3e1c-4d86-b364-b22e4e40b3ca] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:26.012793 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9e287351-bdf2-4ea9-be46-6db8ecd2507e tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:26.013625 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9e287351-bdf2-4ea9-be46-6db8ecd2507e tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:26.016693 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9e287351-bdf2-4ea9-be46-6db8ecd2507e tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:26.017670 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9e287351-bdf2-4ea9-be46-6db8ecd2507e tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:26.018495 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9e287351-bdf2-4ea9-be46-6db8ecd2507e tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:26.019126 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9e287351-bdf2-4ea9-be46-6db8ecd2507e tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:26.434221 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.network.neutron [None req-0df2c94c-8e0a-4d47-99f5-f574995769ac tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] [instance: c806a6c6-6b03-4b6e-9247-75b8541ce9b4] Updating instance_info_cache with network_info: [{"id": "059512bd-a604-4d49-978d-ee2246b9e518", "address": "fa:16:3e:3c:25:4b", "network": {"id": "acfc8820-ee09-4a6a-92bb-7ee4a63b93f8", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-1073232699-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "c99c97de335941a4af0f09c695ab3a43", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap059512bd-a6", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128801) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 04 20:43:26.439215 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-9e287351-bdf2-4ea9-be46-6db8ecd2507e tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '800db3a57ada47eca381b00189fdbf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66ec8ea91b04deb90b679589e0495bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:26.448115 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-9e287351-bdf2-4ea9-be46-6db8ecd2507e tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] 10.222.0.33 "GET /compute/v2.1/servers/17f61077-3e1c-4d86-b364-b22e4e40b3ca" status: 200 len: 1391 microversion: 2.1 time: 0.447131 Oct 04 20:43:26.452223 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1149/2236] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:43:25 2022] GET /compute/v2.1/servers/17f61077-3e1c-4d86-b364-b22e4e40b3ca => generated 1391 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:43:26.452843 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0df2c94c-8e0a-4d47-99f5-f574995769ac tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Releasing lock "refresh_cache-c806a6c6-6b03-4b6e-9247-75b8541ce9b4" {{(pid=128801) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 04 20:43:26.455442 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-0df2c94c-8e0a-4d47-99f5-f574995769ac tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] 10.222.0.33 "POST /compute/v2.1/servers/c806a6c6-6b03-4b6e-9247-75b8541ce9b4/action" status: 202 len: 0 microversion: 2.1 time: 7.181207 Oct 04 20:43:26.456243 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1088/2237] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 20:43:19 2022] POST /compute/v2.1/servers/c806a6c6-6b03-4b6e-9247-75b8541ce9b4/action => generated 0 bytes in 7184 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 04 20:43:26.461982 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-9a9f0b20-af9f-42ab-b792-8cf0ddcd6942 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:26.462820 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-9a9f0b20-af9f-42ab-b792-8cf0ddcd6942 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] [instance: c0a14e22-0620-4912-9893-62974c80978a] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:26.471639 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9a9f0b20-af9f-42ab-b792-8cf0ddcd6942 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:26.472217 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9a9f0b20-af9f-42ab-b792-8cf0ddcd6942 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:26.472895 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9a9f0b20-af9f-42ab-b792-8cf0ddcd6942 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:26.474232 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9a9f0b20-af9f-42ab-b792-8cf0ddcd6942 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:26.475013 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9a9f0b20-af9f-42ab-b792-8cf0ddcd6942 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:26.475442 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-fc1b8c2b-1708-45f4-98a9-64faf519191b tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:26.476126 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9a9f0b20-af9f-42ab-b792-8cf0ddcd6942 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:26.476352 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-fc1b8c2b-1708-45f4-98a9-64faf519191b tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] [instance: 2bae38c5-cec9-444b-8879-dcb7eb2822e6] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:26.493618 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fc1b8c2b-1708-45f4-98a9-64faf519191b tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:26.495334 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fc1b8c2b-1708-45f4-98a9-64faf519191b tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:26.498160 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fc1b8c2b-1708-45f4-98a9-64faf519191b tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:26.500463 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fc1b8c2b-1708-45f4-98a9-64faf519191b tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:26.507887 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fc1b8c2b-1708-45f4-98a9-64faf519191b tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:26.508610 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fc1b8c2b-1708-45f4-98a9-64faf519191b tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:26.951068 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-9a9f0b20-af9f-42ab-b792-8cf0ddcd6942 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28399882314945d787a3af6eb59935c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5392c67506f7445ab33d62b191558f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:26.969279 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-9a9f0b20-af9f-42ab-b792-8cf0ddcd6942 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28399882314945d787a3af6eb59935c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5392c67506f7445ab33d62b191558f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:26.974468 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-9a9f0b20-af9f-42ab-b792-8cf0ddcd6942 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28399882314945d787a3af6eb59935c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5392c67506f7445ab33d62b191558f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:26.976816 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-9a9f0b20-af9f-42ab-b792-8cf0ddcd6942 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] 10.222.0.33 "GET /compute/v2.1/servers/c0a14e22-0620-4912-9893-62974c80978a" status: 200 len: 1879 microversion: 2.32 time: 0.523242 Oct 04 20:43:26.977392 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1150/2238] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:43:26 2022] GET /compute/v2.1/servers/c0a14e22-0620-4912-9893-62974c80978a => generated 1879 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:43:26.988966 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-da9db404-8ecd-4e5a-9faa-2e4a98d111ac tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Calling method '.version_select at 0x7f3c788c2280>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:27.244731 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-fc1b8c2b-1708-45f4-98a9-64faf519191b tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e1e240b20e41e8b90e0d630e0d6b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a44744f2bb4130b9a49065b49cf854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:27.267460 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-fc1b8c2b-1708-45f4-98a9-64faf519191b tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] 10.222.0.33 "GET /compute/v2.1/servers/2bae38c5-cec9-444b-8879-dcb7eb2822e6" status: 200 len: 1355 microversion: 2.1 time: 0.803035 Oct 04 20:43:27.267881 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1089/2239] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:43:26 2022] GET /compute/v2.1/servers/2bae38c5-cec9-444b-8879-dcb7eb2822e6 => generated 1355 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:43:27.285817 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b1ba624f-e392-412f-8d90-531cd3fb0fe1 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:27.286812 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b1ba624f-e392-412f-8d90-531cd3fb0fe1 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] [instance: 8ef51f7d-45b1-4d48-8611-5c7805f52d15] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:27.303381 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b1ba624f-e392-412f-8d90-531cd3fb0fe1 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:27.303976 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b1ba624f-e392-412f-8d90-531cd3fb0fe1 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:27.304535 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b1ba624f-e392-412f-8d90-531cd3fb0fe1 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:27.305946 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b1ba624f-e392-412f-8d90-531cd3fb0fe1 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:27.307383 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b1ba624f-e392-412f-8d90-531cd3fb0fe1 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:27.311017 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b1ba624f-e392-412f-8d90-531cd3fb0fe1 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:28.049357 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-b1ba624f-e392-412f-8d90-531cd3fb0fe1 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07c500628d414c9983836c33563b38bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f258cb1ecd049078b201eb41692735a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:28.059290 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b1ba624f-e392-412f-8d90-531cd3fb0fe1 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] 10.222.0.33 "GET /compute/v2.1/servers/8ef51f7d-45b1-4d48-8611-5c7805f52d15" status: 200 len: 1324 microversion: 2.1 time: 0.788811 Oct 04 20:43:28.059862 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1090/2240] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:43:27 2022] GET /compute/v2.1/servers/8ef51f7d-45b1-4d48-8611-5c7805f52d15 => generated 1324 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:43:28.064686 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-330317cb-db70-4742-914a-3b308cc25fdb tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:28.065433 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-330317cb-db70-4742-914a-3b308cc25fdb tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] [instance: 81748c83-b703-4c68-899c-c575cc3340d2] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:28.071582 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-330317cb-db70-4742-914a-3b308cc25fdb tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:28.072258 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-330317cb-db70-4742-914a-3b308cc25fdb tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:28.072881 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-330317cb-db70-4742-914a-3b308cc25fdb tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:28.073750 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-330317cb-db70-4742-914a-3b308cc25fdb tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:28.074440 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-330317cb-db70-4742-914a-3b308cc25fdb tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:28.075102 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-330317cb-db70-4742-914a-3b308cc25fdb tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:28.092926 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-330317cb-db70-4742-914a-3b308cc25fdb tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] HTTP exception thrown: Instance 81748c83-b703-4c68-899c-c575cc3340d2 could not be found. Oct 04 20:43:28.094661 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-330317cb-db70-4742-914a-3b308cc25fdb tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Request method failure captured: Oct 04 20:43:28.094661 n-d-854823-8 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/81748c83-b703-4c68-899c-c575cc3340d2 HTTP/1.1 Oct 04 20:43:28.094661 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:43:28.094661 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:43:28.094661 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:43:28.094661 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 0 Oct 04 20:43:28.094661 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:43:28.094661 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:43:28.094661 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:43:28.094661 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:43:28.094661 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJlS7YkNoNsErcluy9zSzxfkdD1qZsxsTW6bj1bKeKNXQ1TZFsYEQE0A2-BDVieUj00yHcDo9HNRo-TRBb7WBLfhc-CTf5TtIr0bX4L7OLkl9dbNYfuXD8y1gAU3Jdg3pQ4OIwr5m4ORRwm2L-EVgflU4LvUAUpABmHQuENksFWfbrE Oct 04 20:43:28.094661 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:43:28.094661 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:43:28.094661 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:43:28.094661 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:43:28.094661 n-d-854823-8 devstack@n-api.service[128801]: X-Openstack-Nova-Api-Version: 2.25 Oct 04 20:43:28.094661 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:43:28.094661 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:43:28.094661 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: 4310eadf656d4ba88ade5714c9661488 Oct 04 20:43:28.094661 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1173687642 Oct 04 20:43:28.094661 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 20:43:28.094661 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 20:43:28.094661 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_4310eadf656d4ba88ade5714c9661488", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4310eadf656d4ba88ade5714c9661488"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4310eadf656d4ba88ade5714c9661488"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/4310eadf656d4ba88ade5714c9661488"}]}] Oct 04 20:43:28.094661 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1173687642 Oct 04 20:43:28.094661 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: 4310eadf656d4ba88ade5714c9661488 Oct 04 20:43:28.094661 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1173687642 Oct 04 20:43:28.094661 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-LiveAutoBlockMigrationV225Test-1173687642-project Oct 04 20:43:28.094661 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:43:28.094661 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:43:28.094661 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: beaac70ab9344f6c9677d6500b8b0df6 Oct 04 20:43:28.094661 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1173687642-project Oct 04 20:43:28.094661 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 20:43:28.094661 n-d-854823-8 devstack@n-api.service[128801]: exception: Instance 81748c83-b703-4c68-899c-c575cc3340d2 could not be found. Oct 04 20:43:28.094661 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': '81748c83-b703-4c68-899c-c575cc3340d2'} Oct 04 20:43:28.094661 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:43:28.094661 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:43:28.094661 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:43:28.094661 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:43:28.094661 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:43:28.094661 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:43:28.094661 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:43:28.094661 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:43:28.094661 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:43:28.094661 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:43:28.094661 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 81748c83-b703-4c68-899c-c575cc3340d2 could not be found. Oct 04 20:43:28.094661 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:43:28.094661 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:43:28.094661 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:43:28.094661 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:43:28.094661 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:43:28.094661 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:43:28.094661 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:43:28.094661 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:43:28.094661 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:43:28.094661 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:43:28.094661 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:43:28.094661 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:43:28.094661 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:43:28.094661 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:43:28.094661 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:43:28.094661 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:43:28.094661 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 81748c83-b703-4c68-899c-c575cc3340d2 could not be found. Oct 04 20:43:28.094661 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:43:28.099609 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:43:28.099609 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:43:28.099609 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:43:28.099609 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:43:28.099609 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:43:28.099609 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:43:28.099609 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:43:28.099609 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 81748c83-b703-4c68-899c-c575cc3340d2 could not be found. Oct 04 20:43:28.099609 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:43:28.099609 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-330317cb-db70-4742-914a-3b308cc25fdb tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Returning 404 to user: Instance 81748c83-b703-4c68-899c-c575cc3340d2 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:43:28.099609 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-330317cb-db70-4742-914a-3b308cc25fdb tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] 10.222.0.33 "GET /compute/v2.1/servers/81748c83-b703-4c68-899c-c575cc3340d2" status: 404 len: 111 microversion: 2.25 time: 0.035042 Oct 04 20:43:28.101351 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1091/2241] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:43:28 2022] GET /compute/v2.1/servers/81748c83-b703-4c68-899c-c575cc3340d2 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 20:43:28.105214 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ea5dfb39-a821-4982-b9d9-fe23b48d52c0 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:28.106728 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ea5dfb39-a821-4982-b9d9-fe23b48d52c0 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] [instance: 17f61077-3e1c-4d86-b364-b22e4e40b3ca] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:28.114489 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ea5dfb39-a821-4982-b9d9-fe23b48d52c0 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:28.115115 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ea5dfb39-a821-4982-b9d9-fe23b48d52c0 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:28.115649 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ea5dfb39-a821-4982-b9d9-fe23b48d52c0 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:28.116457 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ea5dfb39-a821-4982-b9d9-fe23b48d52c0 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:28.117023 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ea5dfb39-a821-4982-b9d9-fe23b48d52c0 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:28.117543 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ea5dfb39-a821-4982-b9d9-fe23b48d52c0 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:28.471467 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-ea5dfb39-a821-4982-b9d9-fe23b48d52c0 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '800db3a57ada47eca381b00189fdbf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66ec8ea91b04deb90b679589e0495bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:28.479723 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ea5dfb39-a821-4982-b9d9-fe23b48d52c0 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] 10.222.0.33 "GET /compute/v2.1/servers/17f61077-3e1c-4d86-b364-b22e4e40b3ca" status: 200 len: 1391 microversion: 2.1 time: 0.378804 Oct 04 20:43:28.495401 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1092/2242] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:43:28 2022] GET /compute/v2.1/servers/17f61077-3e1c-4d86-b364-b22e4e40b3ca => generated 1391 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:43:28.495401 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-cd2c63bf-2ff4-47bd-890c-1f12c615c22c req-48c037dc-058f-4804-be88-123373b9b899 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0a14e22-0620-4912-9893-62974c80978a", "tag": "6a2a59c6-7fc0-4c9d-9f8a-2a71aff6748a"}, {"name": "network-changed", "server_uuid": "c0a14e22-0620-4912-9893-62974c80978a", "tag": "3aae6729-b226-4156-a8f1-4164c26d5309"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:43:28.503466 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-cd2c63bf-2ff4-47bd-890c-1f12c615c22c req-48c037dc-058f-4804-be88-123373b9b899 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:28.504017 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-cd2c63bf-2ff4-47bd-890c-1f12c615c22c req-48c037dc-058f-4804-be88-123373b9b899 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:28.504544 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-cd2c63bf-2ff4-47bd-890c-1f12c615c22c req-48c037dc-058f-4804-be88-123373b9b899 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:28.516643 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-cd2c63bf-2ff4-47bd-890c-1f12c615c22c req-48c037dc-058f-4804-be88-123373b9b899 service nova] Creating event network-changed:6a2a59c6-7fc0-4c9d-9f8a-2a71aff6748a for instance c0a14e22-0620-4912-9893-62974c80978a on n-h1-854823-8 Oct 04 20:43:28.517225 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-cd2c63bf-2ff4-47bd-890c-1f12c615c22c req-48c037dc-058f-4804-be88-123373b9b899 service nova] Creating event network-changed:3aae6729-b226-4156-a8f1-4164c26d5309 for instance c0a14e22-0620-4912-9893-62974c80978a on n-h1-854823-8 Oct 04 20:43:28.522319 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-cd2c63bf-2ff4-47bd-890c-1f12c615c22c req-48c037dc-058f-4804-be88-123373b9b899 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.034834 Oct 04 20:43:28.523294 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1093/2243] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:43:28 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:43:28.533822 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5a095633-45eb-4e49-bd84-277a4d5e43b3 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:28.534907 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-5a095633-45eb-4e49-bd84-277a4d5e43b3 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] [instance: c0a14e22-0620-4912-9893-62974c80978a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:28.541441 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5a095633-45eb-4e49-bd84-277a4d5e43b3 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:28.542168 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5a095633-45eb-4e49-bd84-277a4d5e43b3 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:28.542697 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5a095633-45eb-4e49-bd84-277a4d5e43b3 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:28.543562 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5a095633-45eb-4e49-bd84-277a4d5e43b3 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:28.544376 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5a095633-45eb-4e49-bd84-277a4d5e43b3 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:28.544531 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5a095633-45eb-4e49-bd84-277a4d5e43b3 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:28.907645 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-5a095633-45eb-4e49-bd84-277a4d5e43b3 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28399882314945d787a3af6eb59935c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5392c67506f7445ab33d62b191558f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:28.924134 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-5a095633-45eb-4e49-bd84-277a4d5e43b3 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28399882314945d787a3af6eb59935c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5392c67506f7445ab33d62b191558f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:28.925901 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-5a095633-45eb-4e49-bd84-277a4d5e43b3 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28399882314945d787a3af6eb59935c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5392c67506f7445ab33d62b191558f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:28.927360 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5a095633-45eb-4e49-bd84-277a4d5e43b3 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] 10.222.0.33 "GET /compute/v2.1/servers/c0a14e22-0620-4912-9893-62974c80978a" status: 200 len: 1879 microversion: 2.32 time: 0.398150 Oct 04 20:43:28.928229 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1094/2244] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:43:28 2022] GET /compute/v2.1/servers/c0a14e22-0620-4912-9893-62974c80978a => generated 1879 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:43:28.933282 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-de70a66c-9f5c-44cb-80b7-02e8880075ee req-c329b0b4-7f7e-4fb9-b3c9-49b062397532 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2bae38c5-cec9-444b-8879-dcb7eb2822e6", "name": "network-vif-plugged", "status": "completed", "tag": "651fbaa6-3b6b-47e0-878e-047d44c783c9"}, {"server_uuid": "8ef51f7d-45b1-4d48-8611-5c7805f52d15", "name": "network-vif-plugged", "status": "completed", "tag": "19434094-416b-42b5-95e8-2a04021d1e51"}, {"server_uuid": "2bae38c5-cec9-444b-8879-dcb7eb2822e6", "name": "network-vif-plugged", "status": "completed", "tag": "28a5bcd6-0d84-4242-8515-221e946610a0"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:43:28.944837 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-de70a66c-9f5c-44cb-80b7-02e8880075ee req-c329b0b4-7f7e-4fb9-b3c9-49b062397532 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:28.945750 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-de70a66c-9f5c-44cb-80b7-02e8880075ee req-c329b0b4-7f7e-4fb9-b3c9-49b062397532 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:28.946440 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-de70a66c-9f5c-44cb-80b7-02e8880075ee req-c329b0b4-7f7e-4fb9-b3c9-49b062397532 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:28.960156 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-de70a66c-9f5c-44cb-80b7-02e8880075ee req-c329b0b4-7f7e-4fb9-b3c9-49b062397532 service nova] Creating event network-vif-plugged:651fbaa6-3b6b-47e0-878e-047d44c783c9 for instance 2bae38c5-cec9-444b-8879-dcb7eb2822e6 on n-h2-854823-8 Oct 04 20:43:28.960810 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-de70a66c-9f5c-44cb-80b7-02e8880075ee req-c329b0b4-7f7e-4fb9-b3c9-49b062397532 service nova] Creating event network-vif-plugged:19434094-416b-42b5-95e8-2a04021d1e51 for instance 8ef51f7d-45b1-4d48-8611-5c7805f52d15 on n-h1-854823-8 Oct 04 20:43:28.961417 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-de70a66c-9f5c-44cb-80b7-02e8880075ee req-c329b0b4-7f7e-4fb9-b3c9-49b062397532 service nova] Creating event network-vif-plugged:28a5bcd6-0d84-4242-8515-221e946610a0 for instance 2bae38c5-cec9-444b-8879-dcb7eb2822e6 on n-h2-854823-8 Oct 04 20:43:28.972629 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-de70a66c-9f5c-44cb-80b7-02e8880075ee req-c329b0b4-7f7e-4fb9-b3c9-49b062397532 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.042589 Oct 04 20:43:28.973577 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1095/2245] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:43:28 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:43:28.979051 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-345a29e9-f9da-4af5-9738-c512fdaa1c47 req-e6e1f5ea-7af9-4813-99f7-a07cf8ba9d64 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c806a6c6-6b03-4b6e-9247-75b8541ce9b4", "tag": "059512bd-a604-4d49-978d-ee2246b9e518"}, {"name": "network-changed", "server_uuid": "d849cb42-dfe6-4225-814a-90bef2839739", "tag": "43c43378-662f-421f-8638-f0585d16813b"}, {"server_uuid": "81748c83-b703-4c68-899c-c575cc3340d2", "name": "network-vif-deleted", "tag": "c2865aee-fb0f-4bf6-91f8-8215288d29f5"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:43:28.999306 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-345a29e9-f9da-4af5-9738-c512fdaa1c47 req-e6e1f5ea-7af9-4813-99f7-a07cf8ba9d64 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:28.999792 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-345a29e9-f9da-4af5-9738-c512fdaa1c47 req-e6e1f5ea-7af9-4813-99f7-a07cf8ba9d64 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:29.000226 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-345a29e9-f9da-4af5-9738-c512fdaa1c47 req-e6e1f5ea-7af9-4813-99f7-a07cf8ba9d64 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:29.021406 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-345a29e9-f9da-4af5-9738-c512fdaa1c47 req-e6e1f5ea-7af9-4813-99f7-a07cf8ba9d64 service nova] Creating event network-changed:059512bd-a604-4d49-978d-ee2246b9e518 for instance c806a6c6-6b03-4b6e-9247-75b8541ce9b4 on n-h2-854823-8 Oct 04 20:43:29.021655 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-345a29e9-f9da-4af5-9738-c512fdaa1c47 req-e6e1f5ea-7af9-4813-99f7-a07cf8ba9d64 service nova] Creating event network-changed:43c43378-662f-421f-8638-f0585d16813b for instance d849cb42-dfe6-4225-814a-90bef2839739 on n-h2-854823-8 Oct 04 20:43:29.022144 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-345a29e9-f9da-4af5-9738-c512fdaa1c47 req-e6e1f5ea-7af9-4813-99f7-a07cf8ba9d64 service nova] Creating event network-vif-deleted:c2865aee-fb0f-4bf6-91f8-8215288d29f5 for instance 81748c83-b703-4c68-899c-c575cc3340d2 on n-h1-854823-8 Oct 04 20:43:29.034161 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-345a29e9-f9da-4af5-9738-c512fdaa1c47 req-e6e1f5ea-7af9-4813-99f7-a07cf8ba9d64 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 517 microversion: 2.1 time: 0.059192 Oct 04 20:43:29.035495 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1096/2246] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:43:28 2022] POST /compute/v2.1/os-server-external-events => generated 517 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:43:29.040976 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d4ff8047-a9a2-45f1-9c96-ed17441b3375 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Calling method '.version_select at 0x7f3c741ba790>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:29.045842 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-da9db404-8ecd-4e5a-9faa-2e4a98d111ac tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] 10.222.0.33 "DELETE /compute/v2.1/os-floating-ips/c6ebdb28-a941-431f-9755-4ae10cad0dfb" status: 202 len: 0 microversion: 2.1 time: 2.065941 Oct 04 20:43:29.053563 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1151/2247] 10.222.0.33 () {58 vars in 1263 bytes} [Tue Oct 4 20:43:26 2022] DELETE /compute/v2.1/os-floating-ips/c6ebdb28-a941-431f-9755-4ae10cad0dfb => generated 0 bytes in 2074 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:43:29.066751 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d4ff8047-a9a2-45f1-9c96-ed17441b3375 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-352896086" status: 204 len: 0 microversion: 2.25 time: 0.029837 Oct 04 20:43:29.068021 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1097/2248] 10.222.0.33 () {60 vars in 1259 bytes} [Tue Oct 4 20:43:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-352896086 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 20:43:29.072931 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-14ac45b0-3ab7-49fa-b62c-bf377df30766 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:29.073845 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-cd61afd6-4267-4a40-aa1e-94ec886a7819 tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Calling method '.version_select at 0x7f3c74cce0d0>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:29.076547 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-14ac45b0-3ab7-49fa-b62c-bf377df30766 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] [instance: 2bae38c5-cec9-444b-8879-dcb7eb2822e6] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:29.091162 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-14ac45b0-3ab7-49fa-b62c-bf377df30766 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:29.092646 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-14ac45b0-3ab7-49fa-b62c-bf377df30766 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:29.093227 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-14ac45b0-3ab7-49fa-b62c-bf377df30766 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:29.095218 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-14ac45b0-3ab7-49fa-b62c-bf377df30766 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:29.095836 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-14ac45b0-3ab7-49fa-b62c-bf377df30766 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:29.097438 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-14ac45b0-3ab7-49fa-b62c-bf377df30766 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:29.293601 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell0:SELECT=2 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:43:29.597024 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-14ac45b0-3ab7-49fa-b62c-bf377df30766 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e1e240b20e41e8b90e0d630e0d6b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a44744f2bb4130b9a49065b49cf854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:29.615004 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-14ac45b0-3ab7-49fa-b62c-bf377df30766 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] 10.222.0.33 "GET /compute/v2.1/servers/2bae38c5-cec9-444b-8879-dcb7eb2822e6" status: 200 len: 1355 microversion: 2.1 time: 0.559168 Oct 04 20:43:29.617102 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1152/2249] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:43:29 2022] GET /compute/v2.1/servers/2bae38c5-cec9-444b-8879-dcb7eb2822e6 => generated 1355 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:43:29.625425 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-9e60d654-af7a-4f64-a721-cd0aceb444df tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:29.626406 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-9e60d654-af7a-4f64-a721-cd0aceb444df tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] [instance: 8ef51f7d-45b1-4d48-8611-5c7805f52d15] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:29.636405 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9e60d654-af7a-4f64-a721-cd0aceb444df tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:29.639435 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9e60d654-af7a-4f64-a721-cd0aceb444df tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:29.640931 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9e60d654-af7a-4f64-a721-cd0aceb444df tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:29.641875 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9e60d654-af7a-4f64-a721-cd0aceb444df tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:29.642445 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9e60d654-af7a-4f64-a721-cd0aceb444df tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:29.643081 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9e60d654-af7a-4f64-a721-cd0aceb444df tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:29.824843 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-cd61afd6-4267-4a40-aa1e-94ec886a7819 tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/f0512cf6-f0f5-4c47-a410-b32c2e33a22c" status: 202 len: 0 microversion: 2.1 time: 0.755660 Oct 04 20:43:29.825638 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1098/2250] 10.222.0.33 () {58 vars in 1272 bytes} [Tue Oct 4 20:43:29 2022] DELETE /compute/v2.1/os-security-groups/f0512cf6-f0f5-4c47-a410-b32c2e33a22c => generated 0 bytes in 757 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:43:29.830448 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-effae881-c9a3-4a34-8666-52992365e6a1 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:29.831229 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-effae881-c9a3-4a34-8666-52992365e6a1 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] [instance: 17f61077-3e1c-4d86-b364-b22e4e40b3ca] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:29.844721 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-effae881-c9a3-4a34-8666-52992365e6a1 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:29.846470 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-effae881-c9a3-4a34-8666-52992365e6a1 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:29.847298 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-effae881-c9a3-4a34-8666-52992365e6a1 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:29.849477 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-effae881-c9a3-4a34-8666-52992365e6a1 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:29.850214 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-effae881-c9a3-4a34-8666-52992365e6a1 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:29.851225 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-effae881-c9a3-4a34-8666-52992365e6a1 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:29.986722 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-9e60d654-af7a-4f64-a721-cd0aceb444df tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07c500628d414c9983836c33563b38bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f258cb1ecd049078b201eb41692735a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:30.019018 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-9e60d654-af7a-4f64-a721-cd0aceb444df tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] 10.222.0.33 "GET /compute/v2.1/servers/8ef51f7d-45b1-4d48-8611-5c7805f52d15" status: 200 len: 1324 microversion: 2.1 time: 0.399213 Oct 04 20:43:30.020810 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1153/2251] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:43:29 2022] GET /compute/v2.1/servers/8ef51f7d-45b1-4d48-8611-5c7805f52d15 => generated 1324 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:43:30.026267 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-f14ea750-6f6e-42e0-a606-e226e20ff521 tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:30.028364 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-f14ea750-6f6e-42e0-a606-e226e20ff521 tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] [instance: c806a6c6-6b03-4b6e-9247-75b8541ce9b4] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:30.035475 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f14ea750-6f6e-42e0-a606-e226e20ff521 tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:30.036255 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f14ea750-6f6e-42e0-a606-e226e20ff521 tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:30.036942 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f14ea750-6f6e-42e0-a606-e226e20ff521 tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:30.037755 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f14ea750-6f6e-42e0-a606-e226e20ff521 tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:30.038308 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f14ea750-6f6e-42e0-a606-e226e20ff521 tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:30.038952 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f14ea750-6f6e-42e0-a606-e226e20ff521 tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:30.072546 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-f14ea750-6f6e-42e0-a606-e226e20ff521 tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] [instance: c806a6c6-6b03-4b6e-9247-75b8541ce9b4] Going to try to terminate instance {{(pid=128802) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:43:30.118303 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-effae881-c9a3-4a34-8666-52992365e6a1 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '800db3a57ada47eca381b00189fdbf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66ec8ea91b04deb90b679589e0495bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:30.126478 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-effae881-c9a3-4a34-8666-52992365e6a1 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] 10.222.0.33 "GET /compute/v2.1/servers/17f61077-3e1c-4d86-b364-b22e4e40b3ca" status: 200 len: 1391 microversion: 2.1 time: 0.299661 Oct 04 20:43:30.142103 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1099/2252] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:43:29 2022] GET /compute/v2.1/servers/17f61077-3e1c-4d86-b364-b22e4e40b3ca => generated 1391 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:43:30.147939 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ba8dcb64-4a31-480f-89c9-18f11fc8c540 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:30.149410 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ba8dcb64-4a31-480f-89c9-18f11fc8c540 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] [instance: c0a14e22-0620-4912-9893-62974c80978a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:30.157104 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ba8dcb64-4a31-480f-89c9-18f11fc8c540 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:30.157350 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ba8dcb64-4a31-480f-89c9-18f11fc8c540 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:30.157821 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ba8dcb64-4a31-480f-89c9-18f11fc8c540 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:30.158594 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ba8dcb64-4a31-480f-89c9-18f11fc8c540 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:30.159029 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ba8dcb64-4a31-480f-89c9-18f11fc8c540 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:30.159455 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ba8dcb64-4a31-480f-89c9-18f11fc8c540 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:30.161088 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-f14ea750-6f6e-42e0-a606-e226e20ff521 tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] 10.222.0.33 "DELETE /compute/v2.1/servers/c806a6c6-6b03-4b6e-9247-75b8541ce9b4" status: 204 len: 0 microversion: 2.1 time: 0.138790 Oct 04 20:43:30.161750 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1154/2253] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 20:43:30 2022] DELETE /compute/v2.1/servers/c806a6c6-6b03-4b6e-9247-75b8541ce9b4 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:43:30.171873 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-4250a77b-e2fe-485d-b944-fffff8fdc2d1 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:30.172545 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-4250a77b-e2fe-485d-b944-fffff8fdc2d1 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] [instance: f33c0e5c-fe2c-4379-b50a-08eb17062b91] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:30.179527 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4250a77b-e2fe-485d-b944-fffff8fdc2d1 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:30.180006 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4250a77b-e2fe-485d-b944-fffff8fdc2d1 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:30.180437 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4250a77b-e2fe-485d-b944-fffff8fdc2d1 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:30.181127 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4250a77b-e2fe-485d-b944-fffff8fdc2d1 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:30.181572 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4250a77b-e2fe-485d-b944-fffff8fdc2d1 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:30.182006 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4250a77b-e2fe-485d-b944-fffff8fdc2d1 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:30.211887 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-4250a77b-e2fe-485d-b944-fffff8fdc2d1 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] [instance: f33c0e5c-fe2c-4379-b50a-08eb17062b91] Going to try to terminate instance {{(pid=128802) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:43:30.338389 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-4250a77b-e2fe-485d-b944-fffff8fdc2d1 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] 10.222.0.33 "DELETE /compute/v2.1/servers/f33c0e5c-fe2c-4379-b50a-08eb17062b91" status: 204 len: 0 microversion: 2.25 time: 0.173956 Oct 04 20:43:30.340109 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1155/2254] 10.222.0.33 () {60 vars in 1280 bytes} [Tue Oct 4 20:43:30 2022] DELETE /compute/v2.1/servers/f33c0e5c-fe2c-4379-b50a-08eb17062b91 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 20:43:30.347650 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-f8ada6ae-b5d1-4fd2-8128-0fe54595c0d2 tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:30.348558 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-f8ada6ae-b5d1-4fd2-8128-0fe54595c0d2 tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] [instance: c806a6c6-6b03-4b6e-9247-75b8541ce9b4] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:30.355088 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f8ada6ae-b5d1-4fd2-8128-0fe54595c0d2 tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:30.356761 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f8ada6ae-b5d1-4fd2-8128-0fe54595c0d2 tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:30.357394 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f8ada6ae-b5d1-4fd2-8128-0fe54595c0d2 tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:30.358108 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f8ada6ae-b5d1-4fd2-8128-0fe54595c0d2 tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:30.358588 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f8ada6ae-b5d1-4fd2-8128-0fe54595c0d2 tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:30.359016 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f8ada6ae-b5d1-4fd2-8128-0fe54595c0d2 tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:30.551904 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-ba8dcb64-4a31-480f-89c9-18f11fc8c540 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28399882314945d787a3af6eb59935c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5392c67506f7445ab33d62b191558f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:30.563200 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-ba8dcb64-4a31-480f-89c9-18f11fc8c540 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28399882314945d787a3af6eb59935c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5392c67506f7445ab33d62b191558f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:30.565031 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-ba8dcb64-4a31-480f-89c9-18f11fc8c540 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28399882314945d787a3af6eb59935c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5392c67506f7445ab33d62b191558f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:30.566617 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ba8dcb64-4a31-480f-89c9-18f11fc8c540 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] 10.222.0.33 "GET /compute/v2.1/servers/c0a14e22-0620-4912-9893-62974c80978a" status: 200 len: 1879 microversion: 2.32 time: 0.422651 Oct 04 20:43:30.572562 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1100/2255] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:43:30 2022] GET /compute/v2.1/servers/c0a14e22-0620-4912-9893-62974c80978a => generated 1879 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:43:30.572562 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-17893e5d-bf37-4088-b34c-188e9993ec38 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:30.573026 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-17893e5d-bf37-4088-b34c-188e9993ec38 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] [instance: f33c0e5c-fe2c-4379-b50a-08eb17062b91] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:30.580980 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-17893e5d-bf37-4088-b34c-188e9993ec38 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:30.581750 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-17893e5d-bf37-4088-b34c-188e9993ec38 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:30.582430 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-17893e5d-bf37-4088-b34c-188e9993ec38 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:30.583613 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-17893e5d-bf37-4088-b34c-188e9993ec38 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:30.584525 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-17893e5d-bf37-4088-b34c-188e9993ec38 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:30.585152 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-17893e5d-bf37-4088-b34c-188e9993ec38 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:30.609608 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-f8ada6ae-b5d1-4fd2-8128-0fe54595c0d2 tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73345e7aa3ec490e9266cf356dc442ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99c97de335941a4af0f09c695ab3a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:30.617766 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-f8ada6ae-b5d1-4fd2-8128-0fe54595c0d2 tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] 10.222.0.33 "GET /compute/v2.1/servers/c806a6c6-6b03-4b6e-9247-75b8541ce9b4" status: 200 len: 1509 microversion: 2.1 time: 0.274512 Oct 04 20:43:30.618780 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1156/2256] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:43:30 2022] GET /compute/v2.1/servers/c806a6c6-6b03-4b6e-9247-75b8541ce9b4 => generated 1509 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:43:30.623538 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-faedbb20-166d-4543-bfe0-3530408447d1 tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:30.628899 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-faedbb20-166d-4543-bfe0-3530408447d1 tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4dd8aa669e8847a3848a723c7890ef98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7a1e525a85411ca2ce2bce1638b463', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:30.629921 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-faedbb20-166d-4543-bfe0-3530408447d1 tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] Searching by: {'deleted': False, 'project_id': '6d7a1e525a85411ca2ce2bce1638b463'} {{(pid=128802) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 20:43:30.635886 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-faedbb20-166d-4543-bfe0-3530408447d1 tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:30.637172 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-faedbb20-166d-4543-bfe0-3530408447d1 tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:30.637824 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-faedbb20-166d-4543-bfe0-3530408447d1 tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:30.638799 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-faedbb20-166d-4543-bfe0-3530408447d1 tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:30.639450 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-faedbb20-166d-4543-bfe0-3530408447d1 tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:30.640326 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-faedbb20-166d-4543-bfe0-3530408447d1 tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:30.672112 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.multi_cell_list [None req-faedbb20-166d-4543-bfe0-3530408447d1 tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128802) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 20:43:30.705106 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-faedbb20-166d-4543-bfe0-3530408447d1 tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] 10.222.0.33 "GET /compute/v2.1/servers" status: 200 len: 334 microversion: 2.1 time: 0.084940 Oct 04 20:43:30.714256 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1157/2257] 10.222.0.33 () {58 vars in 1125 bytes} [Tue Oct 4 20:43:30 2022] GET /compute/v2.1/servers => generated 334 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:43:30.714256 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-3795ff86-6e4f-43c8-89bc-dd89d487af75 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:30.714256 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-3795ff86-6e4f-43c8-89bc-dd89d487af75 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] [instance: 2bae38c5-cec9-444b-8879-dcb7eb2822e6] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:30.721324 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3795ff86-6e4f-43c8-89bc-dd89d487af75 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:30.721810 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3795ff86-6e4f-43c8-89bc-dd89d487af75 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:30.722241 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3795ff86-6e4f-43c8-89bc-dd89d487af75 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:30.722981 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3795ff86-6e4f-43c8-89bc-dd89d487af75 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:30.723435 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3795ff86-6e4f-43c8-89bc-dd89d487af75 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:30.723855 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3795ff86-6e4f-43c8-89bc-dd89d487af75 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:30.797321 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-17893e5d-bf37-4088-b34c-188e9993ec38 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:30.813643 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-17893e5d-bf37-4088-b34c-188e9993ec38 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:30.815415 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-17893e5d-bf37-4088-b34c-188e9993ec38 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:30.817107 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-17893e5d-bf37-4088-b34c-188e9993ec38 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] 10.222.0.33 "GET /compute/v2.1/servers/f33c0e5c-fe2c-4379-b50a-08eb17062b91" status: 200 len: 1549 microversion: 2.25 time: 0.248047 Oct 04 20:43:30.822555 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1101/2258] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:43:30 2022] GET /compute/v2.1/servers/f33c0e5c-fe2c-4379-b50a-08eb17062b91 => generated 1549 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:43:30.823075 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-746cb3eb-c02d-4398-a8ef-6df0073031a4 tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:30.828663 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-746cb3eb-c02d-4398-a8ef-6df0073031a4 tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4dd8aa669e8847a3848a723c7890ef98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7a1e525a85411ca2ce2bce1638b463', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:30.829620 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-746cb3eb-c02d-4398-a8ef-6df0073031a4 tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] Searching by: {'deleted': False, 'project_id': '6d7a1e525a85411ca2ce2bce1638b463'} {{(pid=128801) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 20:43:30.835476 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-746cb3eb-c02d-4398-a8ef-6df0073031a4 tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:30.836057 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-746cb3eb-c02d-4398-a8ef-6df0073031a4 tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:30.836579 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-746cb3eb-c02d-4398-a8ef-6df0073031a4 tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:30.837383 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-746cb3eb-c02d-4398-a8ef-6df0073031a4 tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:30.837907 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-746cb3eb-c02d-4398-a8ef-6df0073031a4 tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:30.838431 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-746cb3eb-c02d-4398-a8ef-6df0073031a4 tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:30.873733 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.multi_cell_list [None req-746cb3eb-c02d-4398-a8ef-6df0073031a4 tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128801) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 20:43:30.967840 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-746cb3eb-c02d-4398-a8ef-6df0073031a4 tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd8aa669e8847a3848a723c7890ef98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7a1e525a85411ca2ce2bce1638b463', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:30.975875 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-746cb3eb-c02d-4398-a8ef-6df0073031a4 tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:30.976512 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-746cb3eb-c02d-4398-a8ef-6df0073031a4 tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:30.977045 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-746cb3eb-c02d-4398-a8ef-6df0073031a4 tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:31.190724 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-3795ff86-6e4f-43c8-89bc-dd89d487af75 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e1e240b20e41e8b90e0d630e0d6b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a44744f2bb4130b9a49065b49cf854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:31.199511 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-3795ff86-6e4f-43c8-89bc-dd89d487af75 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] 10.222.0.33 "GET /compute/v2.1/servers/2bae38c5-cec9-444b-8879-dcb7eb2822e6" status: 200 len: 1355 microversion: 2.1 time: 0.492567 Oct 04 20:43:31.211461 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1158/2259] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:43:30 2022] GET /compute/v2.1/servers/2bae38c5-cec9-444b-8879-dcb7eb2822e6 => generated 1355 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:43:31.211461 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-91b57613-7214-44e3-a97b-94a49f7657a7 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:31.211461 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-91b57613-7214-44e3-a97b-94a49f7657a7 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] [instance: 8ef51f7d-45b1-4d48-8611-5c7805f52d15] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:31.212634 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-91b57613-7214-44e3-a97b-94a49f7657a7 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:31.213220 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-91b57613-7214-44e3-a97b-94a49f7657a7 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:31.213758 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-91b57613-7214-44e3-a97b-94a49f7657a7 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:31.219979 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-91b57613-7214-44e3-a97b-94a49f7657a7 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:31.219979 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-91b57613-7214-44e3-a97b-94a49f7657a7 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:31.219979 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-91b57613-7214-44e3-a97b-94a49f7657a7 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:31.398275 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-746cb3eb-c02d-4398-a8ef-6df0073031a4 tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] 10.222.0.33 "GET /compute/v2.1/servers/detail" status: 200 len: 1697 microversion: 2.1 time: 0.578936 Oct 04 20:43:31.410975 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1102/2260] 10.222.0.33 () {58 vars in 1146 bytes} [Tue Oct 4 20:43:30 2022] GET /compute/v2.1/servers/detail => generated 1697 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:43:31.410975 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-63ad0374-f3f3-4075-aa4d-876e445f078b tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:31.410975 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-63ad0374-f3f3-4075-aa4d-876e445f078b tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] [instance: 17f61077-3e1c-4d86-b364-b22e4e40b3ca] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:31.413225 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-63ad0374-f3f3-4075-aa4d-876e445f078b tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:31.413225 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-63ad0374-f3f3-4075-aa4d-876e445f078b tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:31.413824 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-63ad0374-f3f3-4075-aa4d-876e445f078b tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:31.421448 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-63ad0374-f3f3-4075-aa4d-876e445f078b tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:31.421448 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-63ad0374-f3f3-4075-aa4d-876e445f078b tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:31.421448 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-63ad0374-f3f3-4075-aa4d-876e445f078b tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:31.993586 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-91b57613-7214-44e3-a97b-94a49f7657a7 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07c500628d414c9983836c33563b38bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f258cb1ecd049078b201eb41692735a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:32.001520 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-91b57613-7214-44e3-a97b-94a49f7657a7 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] 10.222.0.33 "GET /compute/v2.1/servers/8ef51f7d-45b1-4d48-8611-5c7805f52d15" status: 200 len: 1520 microversion: 2.1 time: 0.799879 Oct 04 20:43:32.002296 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1159/2261] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:43:31 2022] GET /compute/v2.1/servers/8ef51f7d-45b1-4d48-8611-5c7805f52d15 => generated 1520 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:43:32.006748 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-bda54205-c98e-4f88-908c-e99dc0ea12f0 tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:32.014984 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-bda54205-c98e-4f88-908c-e99dc0ea12f0 tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] 10.222.0.33 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.011798 Oct 04 20:43:32.016517 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1160/2262] 10.222.0.33 () {58 vars in 1137 bytes} [Tue Oct 4 20:43:32 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:43:32.028212 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-e1fd9af4-b967-4c11-980c-c7aa85360556 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:32.028927 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-e1fd9af4-b967-4c11-980c-c7aa85360556 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] [instance: c0a14e22-0620-4912-9893-62974c80978a] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:32.035122 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e1fd9af4-b967-4c11-980c-c7aa85360556 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:32.035634 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e1fd9af4-b967-4c11-980c-c7aa85360556 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:32.036087 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e1fd9af4-b967-4c11-980c-c7aa85360556 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:32.036797 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e1fd9af4-b967-4c11-980c-c7aa85360556 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:32.037256 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e1fd9af4-b967-4c11-980c-c7aa85360556 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:32.037684 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e1fd9af4-b967-4c11-980c-c7aa85360556 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:32.132931 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-63ad0374-f3f3-4075-aa4d-876e445f078b tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '800db3a57ada47eca381b00189fdbf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66ec8ea91b04deb90b679589e0495bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:32.142198 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-63ad0374-f3f3-4075-aa4d-876e445f078b tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] 10.222.0.33 "GET /compute/v2.1/servers/17f61077-3e1c-4d86-b364-b22e4e40b3ca" status: 200 len: 1391 microversion: 2.1 time: 0.741950 Oct 04 20:43:32.142821 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1103/2263] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:43:31 2022] GET /compute/v2.1/servers/17f61077-3e1c-4d86-b364-b22e4e40b3ca => generated 1391 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:43:32.147400 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-036fb7ae-aabb-48fc-b4d6-483d1f519540 tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:32.148126 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-036fb7ae-aabb-48fc-b4d6-483d1f519540 tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] [instance: c806a6c6-6b03-4b6e-9247-75b8541ce9b4] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:32.155414 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-036fb7ae-aabb-48fc-b4d6-483d1f519540 tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:32.155607 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-036fb7ae-aabb-48fc-b4d6-483d1f519540 tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:32.156017 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-036fb7ae-aabb-48fc-b4d6-483d1f519540 tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:32.156692 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-036fb7ae-aabb-48fc-b4d6-483d1f519540 tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:32.157213 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-036fb7ae-aabb-48fc-b4d6-483d1f519540 tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:32.157640 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-036fb7ae-aabb-48fc-b4d6-483d1f519540 tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:32.474031 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-e1fd9af4-b967-4c11-980c-c7aa85360556 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28399882314945d787a3af6eb59935c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5392c67506f7445ab33d62b191558f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:32.488762 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-e1fd9af4-b967-4c11-980c-c7aa85360556 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28399882314945d787a3af6eb59935c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5392c67506f7445ab33d62b191558f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:32.490516 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-e1fd9af4-b967-4c11-980c-c7aa85360556 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28399882314945d787a3af6eb59935c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5392c67506f7445ab33d62b191558f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:32.492242 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-e1fd9af4-b967-4c11-980c-c7aa85360556 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] 10.222.0.33 "GET /compute/v2.1/servers/c0a14e22-0620-4912-9893-62974c80978a" status: 200 len: 1879 microversion: 2.32 time: 0.468420 Oct 04 20:43:32.492962 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1161/2264] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:43:32 2022] GET /compute/v2.1/servers/c0a14e22-0620-4912-9893-62974c80978a => generated 1879 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:43:32.498852 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-0a70221f-000e-4517-86ba-aab4f3929e48 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:32.499468 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-0a70221f-000e-4517-86ba-aab4f3929e48 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] [instance: f33c0e5c-fe2c-4379-b50a-08eb17062b91] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:32.505917 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0a70221f-000e-4517-86ba-aab4f3929e48 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:32.506599 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0a70221f-000e-4517-86ba-aab4f3929e48 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:32.507409 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0a70221f-000e-4517-86ba-aab4f3929e48 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:32.508136 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0a70221f-000e-4517-86ba-aab4f3929e48 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:32.508596 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0a70221f-000e-4517-86ba-aab4f3929e48 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:32.509022 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0a70221f-000e-4517-86ba-aab4f3929e48 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:32.538953 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-036fb7ae-aabb-48fc-b4d6-483d1f519540 tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73345e7aa3ec490e9266cf356dc442ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99c97de335941a4af0f09c695ab3a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:32.543091 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:43:32.548571 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-036fb7ae-aabb-48fc-b4d6-483d1f519540 tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] 10.222.0.33 "GET /compute/v2.1/servers/c806a6c6-6b03-4b6e-9247-75b8541ce9b4" status: 200 len: 1509 microversion: 2.1 time: 0.404743 Oct 04 20:43:32.549267 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1104/2265] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:43:32 2022] GET /compute/v2.1/servers/c806a6c6-6b03-4b6e-9247-75b8541ce9b4 => generated 1509 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:43:32.554592 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-43a13697-d72d-4328-94d9-1773f9b3edba tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.4.187"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:43:32.557332 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-43a13697-d72d-4328-94d9-1773f9b3edba tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] [instance: 659f073c-b8c2-48d3-8c09-fef755291460] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:32.565476 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-43a13697-d72d-4328-94d9-1773f9b3edba tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:32.566169 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-43a13697-d72d-4328-94d9-1773f9b3edba tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:32.566731 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-43a13697-d72d-4328-94d9-1773f9b3edba tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:32.567475 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-43a13697-d72d-4328-94d9-1773f9b3edba tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:32.568123 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-43a13697-d72d-4328-94d9-1773f9b3edba tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:32.568460 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-43a13697-d72d-4328-94d9-1773f9b3edba tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:32.604091 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-43a13697-d72d-4328-94d9-1773f9b3edba tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Acquiring lock "refresh_cache-659f073c-b8c2-48d3-8c09-fef755291460" {{(pid=128801) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 04 20:43:32.604541 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-43a13697-d72d-4328-94d9-1773f9b3edba tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Acquired lock "refresh_cache-659f073c-b8c2-48d3-8c09-fef755291460" {{(pid=128801) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 04 20:43:32.644514 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-0a70221f-000e-4517-86ba-aab4f3929e48 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:32.658958 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-0a70221f-000e-4517-86ba-aab4f3929e48 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:32.661104 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-0a70221f-000e-4517-86ba-aab4f3929e48 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:32.662733 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-0a70221f-000e-4517-86ba-aab4f3929e48 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] 10.222.0.33 "GET /compute/v2.1/servers/f33c0e5c-fe2c-4379-b50a-08eb17062b91" status: 200 len: 1507 microversion: 2.25 time: 0.168528 Oct 04 20:43:32.663802 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1162/2266] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:43:32 2022] GET /compute/v2.1/servers/f33c0e5c-fe2c-4379-b50a-08eb17062b91 => generated 1507 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:43:32.669088 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-719a6f0b-e99f-4138-b933-683d810a545b tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:32.670301 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-719a6f0b-e99f-4138-b933-683d810a545b tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] [instance: 2bae38c5-cec9-444b-8879-dcb7eb2822e6] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:32.677394 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-719a6f0b-e99f-4138-b933-683d810a545b tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:32.678189 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-719a6f0b-e99f-4138-b933-683d810a545b tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:32.678891 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-719a6f0b-e99f-4138-b933-683d810a545b tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:32.680025 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-719a6f0b-e99f-4138-b933-683d810a545b tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:32.680992 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-719a6f0b-e99f-4138-b933-683d810a545b tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:32.681609 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-719a6f0b-e99f-4138-b933-683d810a545b tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:32.708789 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:43:33.180964 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-719a6f0b-e99f-4138-b933-683d810a545b tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e1e240b20e41e8b90e0d630e0d6b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a44744f2bb4130b9a49065b49cf854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:33.190358 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-719a6f0b-e99f-4138-b933-683d810a545b tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] 10.222.0.33 "GET /compute/v2.1/servers/2bae38c5-cec9-444b-8879-dcb7eb2822e6" status: 200 len: 1355 microversion: 2.1 time: 0.525196 Oct 04 20:43:33.194393 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1163/2267] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:43:32 2022] GET /compute/v2.1/servers/2bae38c5-cec9-444b-8879-dcb7eb2822e6 => generated 1355 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:43:33.196322 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-8ee95291-1c31-4c3a-b0ce-5bb8ed8ec7a0 tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:33.196885 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-8ee95291-1c31-4c3a-b0ce-5bb8ed8ec7a0 tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] [instance: 251a34fb-f406-415f-8a45-d80feb48581d] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:33.204997 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8ee95291-1c31-4c3a-b0ce-5bb8ed8ec7a0 tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:33.205680 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8ee95291-1c31-4c3a-b0ce-5bb8ed8ec7a0 tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:33.206176 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8ee95291-1c31-4c3a-b0ce-5bb8ed8ec7a0 tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:33.207025 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8ee95291-1c31-4c3a-b0ce-5bb8ed8ec7a0 tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:33.209502 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8ee95291-1c31-4c3a-b0ce-5bb8ed8ec7a0 tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:33.210016 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8ee95291-1c31-4c3a-b0ce-5bb8ed8ec7a0 tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:33.244312 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-8ee95291-1c31-4c3a-b0ce-5bb8ed8ec7a0 tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] [instance: 251a34fb-f406-415f-8a45-d80feb48581d] Going to try to terminate instance {{(pid=128802) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:43:33.339618 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-8ee95291-1c31-4c3a-b0ce-5bb8ed8ec7a0 tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] 10.222.0.33 "DELETE /compute/v2.1/servers/251a34fb-f406-415f-8a45-d80feb48581d" status: 204 len: 0 microversion: 2.1 time: 0.146965 Oct 04 20:43:33.343560 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1164/2268] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 20:43:33 2022] DELETE /compute/v2.1/servers/251a34fb-f406-415f-8a45-d80feb48581d => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:43:33.345772 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-d01ac761-06db-4958-b584-8e39def644bf req-ce5d4dcf-575c-47de-ab32-b1ab4bf08c77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f33c0e5c-fe2c-4379-b50a-08eb17062b91", "name": "network-vif-deleted", "tag": "619319cb-49b8-4e19-a3ae-04ba59d88700"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:43:33.354192 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=4 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:43:33.356170 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-d01ac761-06db-4958-b584-8e39def644bf req-ce5d4dcf-575c-47de-ab32-b1ab4bf08c77 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:33.356656 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-d01ac761-06db-4958-b584-8e39def644bf req-ce5d4dcf-575c-47de-ab32-b1ab4bf08c77 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:33.357071 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-d01ac761-06db-4958-b584-8e39def644bf req-ce5d4dcf-575c-47de-ab32-b1ab4bf08c77 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:33.368852 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-d01ac761-06db-4958-b584-8e39def644bf req-ce5d4dcf-575c-47de-ab32-b1ab4bf08c77 service nova] Creating event network-vif-deleted:619319cb-49b8-4e19-a3ae-04ba59d88700 for instance f33c0e5c-fe2c-4379-b50a-08eb17062b91 on n-h1-854823-8 Oct 04 20:43:33.376989 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-d01ac761-06db-4958-b584-8e39def644bf req-ce5d4dcf-575c-47de-ab32-b1ab4bf08c77 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035053 Oct 04 20:43:33.377942 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1165/2269] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:43:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:43:33.383315 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-407b713a-d24d-46d5-bf33-17890c9af631 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:33.383826 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-407b713a-d24d-46d5-bf33-17890c9af631 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] [instance: 17f61077-3e1c-4d86-b364-b22e4e40b3ca] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:33.390862 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-407b713a-d24d-46d5-bf33-17890c9af631 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:33.391335 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-407b713a-d24d-46d5-bf33-17890c9af631 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:33.391773 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-407b713a-d24d-46d5-bf33-17890c9af631 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:33.392457 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-407b713a-d24d-46d5-bf33-17890c9af631 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:33.392905 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-407b713a-d24d-46d5-bf33-17890c9af631 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:33.393320 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-407b713a-d24d-46d5-bf33-17890c9af631 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:33.756100 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-407b713a-d24d-46d5-bf33-17890c9af631 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '800db3a57ada47eca381b00189fdbf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66ec8ea91b04deb90b679589e0495bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:33.764909 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-407b713a-d24d-46d5-bf33-17890c9af631 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] 10.222.0.33 "GET /compute/v2.1/servers/17f61077-3e1c-4d86-b364-b22e4e40b3ca" status: 200 len: 1391 microversion: 2.1 time: 0.385586 Oct 04 20:43:33.765502 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1166/2270] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:43:33 2022] GET /compute/v2.1/servers/17f61077-3e1c-4d86-b364-b22e4e40b3ca => generated 1391 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:43:33.771169 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-808a4565-3096-4e69-a861-646a7f31b9fb tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:33.771991 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-808a4565-3096-4e69-a861-646a7f31b9fb tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] [instance: 251a34fb-f406-415f-8a45-d80feb48581d] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:33.779050 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-808a4565-3096-4e69-a861-646a7f31b9fb tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:33.779769 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-808a4565-3096-4e69-a861-646a7f31b9fb tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:33.780502 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-808a4565-3096-4e69-a861-646a7f31b9fb tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:33.781564 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-808a4565-3096-4e69-a861-646a7f31b9fb tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:33.782953 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-808a4565-3096-4e69-a861-646a7f31b9fb tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:33.783409 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-808a4565-3096-4e69-a861-646a7f31b9fb tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:34.046173 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-808a4565-3096-4e69-a861-646a7f31b9fb tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd8aa669e8847a3848a723c7890ef98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7a1e525a85411ca2ce2bce1638b463', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:34.055612 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-808a4565-3096-4e69-a861-646a7f31b9fb tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] 10.222.0.33 "GET /compute/v2.1/servers/251a34fb-f406-415f-8a45-d80feb48581d" status: 200 len: 1700 microversion: 2.1 time: 0.288073 Oct 04 20:43:34.056417 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1167/2271] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:43:33 2022] GET /compute/v2.1/servers/251a34fb-f406-415f-8a45-d80feb48581d => generated 1700 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:43:34.062156 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-95221cfd-1b97-4d42-baec-b770d51c6524 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:34.063131 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-95221cfd-1b97-4d42-baec-b770d51c6524 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] [instance: c0a14e22-0620-4912-9893-62974c80978a] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:34.069701 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-95221cfd-1b97-4d42-baec-b770d51c6524 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:34.070182 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-95221cfd-1b97-4d42-baec-b770d51c6524 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:34.070637 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-95221cfd-1b97-4d42-baec-b770d51c6524 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:34.071336 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-95221cfd-1b97-4d42-baec-b770d51c6524 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:34.071783 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-95221cfd-1b97-4d42-baec-b770d51c6524 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:34.072205 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-95221cfd-1b97-4d42-baec-b770d51c6524 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:34.696674 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-95221cfd-1b97-4d42-baec-b770d51c6524 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28399882314945d787a3af6eb59935c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5392c67506f7445ab33d62b191558f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:34.713683 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-95221cfd-1b97-4d42-baec-b770d51c6524 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28399882314945d787a3af6eb59935c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5392c67506f7445ab33d62b191558f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:34.715727 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-95221cfd-1b97-4d42-baec-b770d51c6524 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28399882314945d787a3af6eb59935c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5392c67506f7445ab33d62b191558f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:34.716875 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-95221cfd-1b97-4d42-baec-b770d51c6524 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] 10.222.0.33 "GET /compute/v2.1/servers/c0a14e22-0620-4912-9893-62974c80978a" status: 200 len: 1879 microversion: 2.32 time: 0.658928 Oct 04 20:43:34.717423 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1168/2272] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:43:34 2022] GET /compute/v2.1/servers/c0a14e22-0620-4912-9893-62974c80978a => generated 1879 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:43:34.722170 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-94807a86-60d1-42ef-b61a-c795bb34d539 tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:34.722789 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-94807a86-60d1-42ef-b61a-c795bb34d539 tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] [instance: c806a6c6-6b03-4b6e-9247-75b8541ce9b4] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:34.728816 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-94807a86-60d1-42ef-b61a-c795bb34d539 tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:34.729433 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-94807a86-60d1-42ef-b61a-c795bb34d539 tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:34.729997 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-94807a86-60d1-42ef-b61a-c795bb34d539 tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:34.731652 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-94807a86-60d1-42ef-b61a-c795bb34d539 tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:34.732236 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-94807a86-60d1-42ef-b61a-c795bb34d539 tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:34.732789 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-94807a86-60d1-42ef-b61a-c795bb34d539 tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:34.765582 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-94807a86-60d1-42ef-b61a-c795bb34d539 tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:34.766209 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-94807a86-60d1-42ef-b61a-c795bb34d539 tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:34.766491 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-94807a86-60d1-42ef-b61a-c795bb34d539 tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:34.766941 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.objects.instance [None req-94807a86-60d1-42ef-b61a-c795bb34d539 tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Lazy-loading 'fault' on Instance uuid c806a6c6-6b03-4b6e-9247-75b8541ce9b4 {{(pid=128802) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:43:34.834984 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-94807a86-60d1-42ef-b61a-c795bb34d539 tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73345e7aa3ec490e9266cf356dc442ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99c97de335941a4af0f09c695ab3a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:34.843867 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-94807a86-60d1-42ef-b61a-c795bb34d539 tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] 10.222.0.33 "GET /compute/v2.1/servers/c806a6c6-6b03-4b6e-9247-75b8541ce9b4" status: 200 len: 1311 microversion: 2.1 time: 0.125086 Oct 04 20:43:34.844544 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1169/2273] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:43:34 2022] GET /compute/v2.1/servers/c806a6c6-6b03-4b6e-9247-75b8541ce9b4 => generated 1311 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:43:34.849250 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-d17bb256-0c3e-45cf-afe3-90e6d0c353eb tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:34.849858 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-d17bb256-0c3e-45cf-afe3-90e6d0c353eb tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] [instance: f33c0e5c-fe2c-4379-b50a-08eb17062b91] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:34.858383 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d17bb256-0c3e-45cf-afe3-90e6d0c353eb tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:34.859399 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d17bb256-0c3e-45cf-afe3-90e6d0c353eb tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:34.860500 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d17bb256-0c3e-45cf-afe3-90e6d0c353eb tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:34.862657 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d17bb256-0c3e-45cf-afe3-90e6d0c353eb tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:34.862934 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d17bb256-0c3e-45cf-afe3-90e6d0c353eb tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:34.863973 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d17bb256-0c3e-45cf-afe3-90e6d0c353eb tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:34.894372 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.network.neutron [None req-43a13697-d72d-4328-94d9-1773f9b3edba tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] [instance: 659f073c-b8c2-48d3-8c09-fef755291460] Building network info cache for instance {{(pid=128801) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 04 20:43:34.899969 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d17bb256-0c3e-45cf-afe3-90e6d0c353eb tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:34.900672 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d17bb256-0c3e-45cf-afe3-90e6d0c353eb tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:34.901109 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d17bb256-0c3e-45cf-afe3-90e6d0c353eb tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:34.901593 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.objects.instance [None req-d17bb256-0c3e-45cf-afe3-90e6d0c353eb tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lazy-loading 'fault' on Instance uuid f33c0e5c-fe2c-4379-b50a-08eb17062b91 {{(pid=128802) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:43:34.967745 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-d17bb256-0c3e-45cf-afe3-90e6d0c353eb tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:34.995973 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-d17bb256-0c3e-45cf-afe3-90e6d0c353eb tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:35.006533 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-d17bb256-0c3e-45cf-afe3-90e6d0c353eb tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:35.013396 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-d17bb256-0c3e-45cf-afe3-90e6d0c353eb tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] 10.222.0.33 "GET /compute/v2.1/servers/f33c0e5c-fe2c-4379-b50a-08eb17062b91" status: 200 len: 1352 microversion: 2.25 time: 0.166002 Oct 04 20:43:35.017425 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1170/2274] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:43:34 2022] GET /compute/v2.1/servers/f33c0e5c-fe2c-4379-b50a-08eb17062b91 => generated 1352 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:43:35.031712 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-858c613d-c1f6-4338-87f3-54b214d32c00 req-bea29f3a-c96f-4a6b-8c2f-53621c7b2f22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c806a6c6-6b03-4b6e-9247-75b8541ce9b4", "name": "network-vif-deleted", "tag": "059512bd-a604-4d49-978d-ee2246b9e518"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:43:35.049435 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-858c613d-c1f6-4338-87f3-54b214d32c00 req-bea29f3a-c96f-4a6b-8c2f-53621c7b2f22 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:35.056881 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-858c613d-c1f6-4338-87f3-54b214d32c00 req-bea29f3a-c96f-4a6b-8c2f-53621c7b2f22 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:35.056881 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-858c613d-c1f6-4338-87f3-54b214d32c00 req-bea29f3a-c96f-4a6b-8c2f-53621c7b2f22 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:35.085129 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-858c613d-c1f6-4338-87f3-54b214d32c00 req-bea29f3a-c96f-4a6b-8c2f-53621c7b2f22 service nova] Creating event network-vif-deleted:059512bd-a604-4d49-978d-ee2246b9e518 for instance c806a6c6-6b03-4b6e-9247-75b8541ce9b4 on n-h2-854823-8 Oct 04 20:43:35.109024 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-858c613d-c1f6-4338-87f3-54b214d32c00 req-bea29f3a-c96f-4a6b-8c2f-53621c7b2f22 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088410 Oct 04 20:43:35.111707 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1171/2275] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:43:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:43:35.118796 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-749ed2af-c68b-4e5b-b6a2-927a71f9e597 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:35.119721 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-749ed2af-c68b-4e5b-b6a2-927a71f9e597 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] [instance: 2bae38c5-cec9-444b-8879-dcb7eb2822e6] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:35.154534 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-749ed2af-c68b-4e5b-b6a2-927a71f9e597 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:35.155668 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-749ed2af-c68b-4e5b-b6a2-927a71f9e597 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:35.157257 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-749ed2af-c68b-4e5b-b6a2-927a71f9e597 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:35.159160 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-749ed2af-c68b-4e5b-b6a2-927a71f9e597 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:35.160714 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-749ed2af-c68b-4e5b-b6a2-927a71f9e597 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:35.161167 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-749ed2af-c68b-4e5b-b6a2-927a71f9e597 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:35.616789 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-749ed2af-c68b-4e5b-b6a2-927a71f9e597 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e1e240b20e41e8b90e0d630e0d6b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a44744f2bb4130b9a49065b49cf854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:35.628168 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-749ed2af-c68b-4e5b-b6a2-927a71f9e597 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] 10.222.0.33 "GET /compute/v2.1/servers/2bae38c5-cec9-444b-8879-dcb7eb2822e6" status: 200 len: 1806 microversion: 2.1 time: 0.514507 Oct 04 20:43:35.643926 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1172/2276] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:43:35 2022] GET /compute/v2.1/servers/2bae38c5-cec9-444b-8879-dcb7eb2822e6 => generated 1806 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:43:35.656062 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-917139b8-5750-472c-9f07-d3e84074be96 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:35.656872 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-917139b8-5750-472c-9f07-d3e84074be96 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] [instance: 17f61077-3e1c-4d86-b364-b22e4e40b3ca] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:35.663103 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-917139b8-5750-472c-9f07-d3e84074be96 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:35.663676 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-917139b8-5750-472c-9f07-d3e84074be96 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:35.664206 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-917139b8-5750-472c-9f07-d3e84074be96 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:35.664998 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-917139b8-5750-472c-9f07-d3e84074be96 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:35.665586 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-917139b8-5750-472c-9f07-d3e84074be96 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:35.666081 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-917139b8-5750-472c-9f07-d3e84074be96 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:36.160655 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-917139b8-5750-472c-9f07-d3e84074be96 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '800db3a57ada47eca381b00189fdbf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66ec8ea91b04deb90b679589e0495bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:36.169574 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-917139b8-5750-472c-9f07-d3e84074be96 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] 10.222.0.33 "GET /compute/v2.1/servers/17f61077-3e1c-4d86-b364-b22e4e40b3ca" status: 200 len: 1391 microversion: 2.1 time: 0.523519 Oct 04 20:43:36.170258 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1173/2277] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:43:35 2022] GET /compute/v2.1/servers/17f61077-3e1c-4d86-b364-b22e4e40b3ca => generated 1391 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:43:36.174818 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-5657daf4-de72-44eb-a5b5-01a4dc840795 tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:36.175395 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-5657daf4-de72-44eb-a5b5-01a4dc840795 tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] [instance: 251a34fb-f406-415f-8a45-d80feb48581d] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:36.181468 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5657daf4-de72-44eb-a5b5-01a4dc840795 tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:36.181939 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5657daf4-de72-44eb-a5b5-01a4dc840795 tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:36.182385 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5657daf4-de72-44eb-a5b5-01a4dc840795 tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:36.183090 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5657daf4-de72-44eb-a5b5-01a4dc840795 tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:36.184150 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5657daf4-de72-44eb-a5b5-01a4dc840795 tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:36.184621 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5657daf4-de72-44eb-a5b5-01a4dc840795 tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:36.499907 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.network.neutron [None req-43a13697-d72d-4328-94d9-1773f9b3edba tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] [instance: 659f073c-b8c2-48d3-8c09-fef755291460] Updating instance_info_cache with network_info: [{"id": "267a2eeb-d782-40d7-865d-522dfe433aa5", "address": "fa:16:3e:1a:0b:04", "network": {"id": "8041a123-3203-48c7-8a2d-6c4dad3abeb6", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1176833900-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.4.187", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "2f258cb1ecd049078b201eb41692735a", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap267a2eeb-d7", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128801) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 04 20:43:36.511569 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-43a13697-d72d-4328-94d9-1773f9b3edba tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Releasing lock "refresh_cache-659f073c-b8c2-48d3-8c09-fef755291460" {{(pid=128801) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 04 20:43:36.512633 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-43a13697-d72d-4328-94d9-1773f9b3edba tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] 10.222.0.33 "POST /compute/v2.1/servers/659f073c-b8c2-48d3-8c09-fef755291460/action" status: 202 len: 0 microversion: 2.1 time: 3.962377 Oct 04 20:43:36.513266 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1105/2278] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 20:43:32 2022] POST /compute/v2.1/servers/659f073c-b8c2-48d3-8c09-fef755291460/action => generated 0 bytes in 3963 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 04 20:43:36.518026 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-ed233d52-fa4e-4338-8ec0-07bc58152eb2 req-89bbe105-d6af-4b47-89b0-016d28f25cd5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "659f073c-b8c2-48d3-8c09-fef755291460", "tag": "267a2eeb-d782-40d7-865d-522dfe433aa5"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:43:36.524066 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:43:36.528706 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-ed233d52-fa4e-4338-8ec0-07bc58152eb2 req-89bbe105-d6af-4b47-89b0-016d28f25cd5 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:36.529184 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-ed233d52-fa4e-4338-8ec0-07bc58152eb2 req-89bbe105-d6af-4b47-89b0-016d28f25cd5 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:36.529614 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-ed233d52-fa4e-4338-8ec0-07bc58152eb2 req-89bbe105-d6af-4b47-89b0-016d28f25cd5 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:36.542164 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-ed233d52-fa4e-4338-8ec0-07bc58152eb2 req-89bbe105-d6af-4b47-89b0-016d28f25cd5 service nova] Creating event network-changed:267a2eeb-d782-40d7-865d-522dfe433aa5 for instance 659f073c-b8c2-48d3-8c09-fef755291460 on n-h2-854823-8 Oct 04 20:43:36.548055 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-ed233d52-fa4e-4338-8ec0-07bc58152eb2 req-89bbe105-d6af-4b47-89b0-016d28f25cd5 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033538 Oct 04 20:43:36.548653 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1106/2279] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:43:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:43:36.553954 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f71dc239-c1df-4a86-ae3a-045dc8834404 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:36.554592 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f71dc239-c1df-4a86-ae3a-045dc8834404 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] [instance: 2bae38c5-cec9-444b-8879-dcb7eb2822e6] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:36.561796 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f71dc239-c1df-4a86-ae3a-045dc8834404 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:36.562270 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f71dc239-c1df-4a86-ae3a-045dc8834404 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:36.562741 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f71dc239-c1df-4a86-ae3a-045dc8834404 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:36.563451 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f71dc239-c1df-4a86-ae3a-045dc8834404 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:36.563901 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f71dc239-c1df-4a86-ae3a-045dc8834404 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:36.564322 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f71dc239-c1df-4a86-ae3a-045dc8834404 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:36.589063 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f71dc239-c1df-4a86-ae3a-045dc8834404 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] 10.222.0.33 "GET /compute/v2.1/servers/2bae38c5-cec9-444b-8879-dcb7eb2822e6/ips" status: 200 len: 219 microversion: 2.1 time: 0.039115 Oct 04 20:43:36.589590 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1107/2280] 10.222.0.33 () {58 vars in 1248 bytes} [Tue Oct 4 20:43:36 2022] GET /compute/v2.1/servers/2bae38c5-cec9-444b-8879-dcb7eb2822e6/ips => generated 219 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:43:36.594099 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9532c427-e515-4412-a984-39d022b505d6 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:36.594730 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-9532c427-e515-4412-a984-39d022b505d6 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] [instance: c0a14e22-0620-4912-9893-62974c80978a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:36.601435 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-5657daf4-de72-44eb-a5b5-01a4dc840795 tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd8aa669e8847a3848a723c7890ef98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7a1e525a85411ca2ce2bce1638b463', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:36.611235 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-5657daf4-de72-44eb-a5b5-01a4dc840795 tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] 10.222.0.33 "GET /compute/v2.1/servers/251a34fb-f406-415f-8a45-d80feb48581d" status: 200 len: 1700 microversion: 2.1 time: 0.439869 Oct 04 20:43:36.612053 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1174/2281] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:43:36 2022] GET /compute/v2.1/servers/251a34fb-f406-415f-8a45-d80feb48581d => generated 1700 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:43:36.613671 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9532c427-e515-4412-a984-39d022b505d6 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:36.614231 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9532c427-e515-4412-a984-39d022b505d6 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:36.614772 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9532c427-e515-4412-a984-39d022b505d6 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:36.615538 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9532c427-e515-4412-a984-39d022b505d6 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:36.616070 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9532c427-e515-4412-a984-39d022b505d6 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:36.616573 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9532c427-e515-4412-a984-39d022b505d6 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:36.616918 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-b29dff0a-c801-4967-806b-ad7bec4df724 tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:36.618458 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-b29dff0a-c801-4967-806b-ad7bec4df724 tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] [instance: c806a6c6-6b03-4b6e-9247-75b8541ce9b4] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:36.625573 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b29dff0a-c801-4967-806b-ad7bec4df724 tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:36.626302 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b29dff0a-c801-4967-806b-ad7bec4df724 tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:36.626779 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b29dff0a-c801-4967-806b-ad7bec4df724 tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:36.627533 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b29dff0a-c801-4967-806b-ad7bec4df724 tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:36.630634 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b29dff0a-c801-4967-806b-ad7bec4df724 tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:36.631048 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b29dff0a-c801-4967-806b-ad7bec4df724 tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:36.648195 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.wsgi [None req-b29dff0a-c801-4967-806b-ad7bec4df724 tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] HTTP exception thrown: Instance c806a6c6-6b03-4b6e-9247-75b8541ce9b4 could not be found. Oct 04 20:43:36.650602 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-b29dff0a-c801-4967-806b-ad7bec4df724 tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Request method failure captured: Oct 04 20:43:36.650602 n-d-854823-8 devstack@n-api.service[128802]: request: GET /compute/v2.1/servers/c806a6c6-6b03-4b6e-9247-75b8541ce9b4 HTTP/1.1 Oct 04 20:43:36.650602 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 20:43:36.650602 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 20:43:36.650602 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 20:43:36.650602 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 0 Oct 04 20:43:36.650602 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 20:43:36.650602 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 20:43:36.650602 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 20:43:36.650602 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 20:43:36.650602 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPJqcH_qTnvF_WTJ32gZDOPSQSssWxeTOj6NrXHx__jGz-rl13SFo9aFqzOQNVQDcpPnyKmqOyQeCjj9-ABbhDFRTunEVD4WMLuXIhbA59OJmxhBBdKQp1EorRfwI47yA3Xw2CAt3QT5bxUwSbzCBdZBTUOLOYIvagPL2KVG8v0QUrOk Oct 04 20:43:36.650602 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 20:43:36.650602 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 20:43:36.650602 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 20:43:36.650602 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 20:43:36.650602 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 20:43:36.650602 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 20:43:36.650602 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: c99c97de335941a4af0f09c695ab3a43 Oct 04 20:43:36.650602 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-ServerRescueTestJSONUnderV235-531260958 Oct 04 20:43:36.650602 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 20:43:36.650602 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 20:43:36.650602 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_c99c97de335941a4af0f09c695ab3a43", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c99c97de335941a4af0f09c695ab3a43"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c99c97de335941a4af0f09c695ab3a43"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/c99c97de335941a4af0f09c695ab3a43"}]}] Oct 04 20:43:36.650602 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-ServerRescueTestJSONUnderV235-531260958 Oct 04 20:43:36.650602 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: c99c97de335941a4af0f09c695ab3a43 Oct 04 20:43:36.650602 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-ServerRescueTestJSONUnderV235-531260958 Oct 04 20:43:36.650602 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-ServerRescueTestJSONUnderV235-531260958-project Oct 04 20:43:36.650602 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 20:43:36.650602 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 20:43:36.650602 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: 73345e7aa3ec490e9266cf356dc442ce Oct 04 20:43:36.650602 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-ServerRescueTestJSONUnderV235-531260958-project Oct 04 20:43:36.650602 n-d-854823-8 devstack@n-api.service[128802]: method: > Oct 04 20:43:36.650602 n-d-854823-8 devstack@n-api.service[128802]: exception: Instance c806a6c6-6b03-4b6e-9247-75b8541ce9b4 could not be found. Oct 04 20:43:36.650602 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'id': 'c806a6c6-6b03-4b6e-9247-75b8541ce9b4'} Oct 04 20:43:36.650602 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:43:36.650602 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:43:36.650602 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:43:36.650602 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:43:36.650602 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:43:36.650602 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:43:36.650602 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:43:36.650602 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:43:36.650602 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:43:36.650602 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:43:36.650602 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c806a6c6-6b03-4b6e-9247-75b8541ce9b4 could not be found. Oct 04 20:43:36.650602 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:43:36.650602 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:43:36.650602 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:43:36.650602 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:43:36.650602 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:43:36.650602 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:43:36.650602 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:43:36.650602 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:43:36.650602 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:43:36.650602 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:43:36.650602 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:43:36.650602 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:43:36.650602 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:43:36.650602 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:43:36.650602 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:43:36.650602 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:43:36.650602 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c806a6c6-6b03-4b6e-9247-75b8541ce9b4 could not be found. Oct 04 20:43:36.650602 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:43:36.650602 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:43:36.655105 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:43:36.655105 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:43:36.655105 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:43:36.655105 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:43:36.655105 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:43:36.655105 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:43:36.655105 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c806a6c6-6b03-4b6e-9247-75b8541ce9b4 could not be found. Oct 04 20:43:36.655105 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:43:36.656348 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-b29dff0a-c801-4967-806b-ad7bec4df724 tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] Returning 404 to user: Instance c806a6c6-6b03-4b6e-9247-75b8541ce9b4 could not be found. {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:43:36.657592 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-b29dff0a-c801-4967-806b-ad7bec4df724 tempest-ServerRescueTestJSONUnderV235-531260958 tempest-ServerRescueTestJSONUnderV235-531260958-project] 10.222.0.33 "GET /compute/v2.1/servers/c806a6c6-6b03-4b6e-9247-75b8541ce9b4" status: 404 len: 111 microversion: 2.1 time: 0.044478 Oct 04 20:43:36.658686 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1175/2282] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:43:36 2022] GET /compute/v2.1/servers/c806a6c6-6b03-4b6e-9247-75b8541ce9b4 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:43:36.664279 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-c33f6dac-ef48-49b3-92bb-ee3ef193581f tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:36.665764 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-c33f6dac-ef48-49b3-92bb-ee3ef193581f tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] [instance: f33c0e5c-fe2c-4379-b50a-08eb17062b91] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:36.673604 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c33f6dac-ef48-49b3-92bb-ee3ef193581f tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:36.674591 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c33f6dac-ef48-49b3-92bb-ee3ef193581f tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:36.675341 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c33f6dac-ef48-49b3-92bb-ee3ef193581f tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:36.676215 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c33f6dac-ef48-49b3-92bb-ee3ef193581f tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:36.676828 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c33f6dac-ef48-49b3-92bb-ee3ef193581f tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:36.677412 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c33f6dac-ef48-49b3-92bb-ee3ef193581f tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:36.693502 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.wsgi [None req-c33f6dac-ef48-49b3-92bb-ee3ef193581f tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] HTTP exception thrown: Instance f33c0e5c-fe2c-4379-b50a-08eb17062b91 could not be found. Oct 04 20:43:36.695166 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-c33f6dac-ef48-49b3-92bb-ee3ef193581f tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Request method failure captured: Oct 04 20:43:36.695166 n-d-854823-8 devstack@n-api.service[128802]: request: GET /compute/v2.1/servers/f33c0e5c-fe2c-4379-b50a-08eb17062b91 HTTP/1.1 Oct 04 20:43:36.695166 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 20:43:36.695166 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 20:43:36.695166 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 20:43:36.695166 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 0 Oct 04 20:43:36.695166 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 20:43:36.695166 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 20:43:36.695166 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 20:43:36.695166 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 20:43:36.695166 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPJlS7YkNoNsErcluy9zSzxfkdD1qZsxsTW6bj1bKeKNXQ1TZFsYEQE0A2-BDVieUj00yHcDo9HNRo-TRBb7WBLfhc-CTf5TtIr0bX4L7OLkl9dbNYfuXD8y1gAU3Jdg3pQ4OIwr5m4ORRwm2L-EVgflU4LvUAUpABmHQuENksFWfbrE Oct 04 20:43:36.695166 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 20:43:36.695166 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 20:43:36.695166 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 20:43:36.695166 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 20:43:36.695166 n-d-854823-8 devstack@n-api.service[128802]: X-Openstack-Nova-Api-Version: 2.25 Oct 04 20:43:36.695166 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 20:43:36.695166 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 20:43:36.695166 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: 4310eadf656d4ba88ade5714c9661488 Oct 04 20:43:36.695166 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1173687642 Oct 04 20:43:36.695166 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 20:43:36.695166 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 20:43:36.695166 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_4310eadf656d4ba88ade5714c9661488", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4310eadf656d4ba88ade5714c9661488"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4310eadf656d4ba88ade5714c9661488"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/4310eadf656d4ba88ade5714c9661488"}]}] Oct 04 20:43:36.695166 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1173687642 Oct 04 20:43:36.695166 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: 4310eadf656d4ba88ade5714c9661488 Oct 04 20:43:36.695166 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1173687642 Oct 04 20:43:36.695166 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-LiveAutoBlockMigrationV225Test-1173687642-project Oct 04 20:43:36.695166 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 20:43:36.695166 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 20:43:36.695166 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: beaac70ab9344f6c9677d6500b8b0df6 Oct 04 20:43:36.695166 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1173687642-project Oct 04 20:43:36.695166 n-d-854823-8 devstack@n-api.service[128802]: method: > Oct 04 20:43:36.695166 n-d-854823-8 devstack@n-api.service[128802]: exception: Instance f33c0e5c-fe2c-4379-b50a-08eb17062b91 could not be found. Oct 04 20:43:36.695166 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'id': 'f33c0e5c-fe2c-4379-b50a-08eb17062b91'} Oct 04 20:43:36.695166 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:43:36.695166 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:43:36.695166 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:43:36.695166 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:43:36.695166 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:43:36.695166 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:43:36.695166 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:43:36.695166 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:43:36.695166 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:43:36.695166 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:43:36.695166 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f33c0e5c-fe2c-4379-b50a-08eb17062b91 could not be found. Oct 04 20:43:36.695166 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:43:36.695166 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:43:36.695166 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:43:36.695166 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:43:36.695166 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:43:36.695166 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:43:36.695166 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:43:36.695166 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:43:36.695166 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:43:36.695166 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:43:36.695166 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:43:36.695166 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:43:36.695166 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:43:36.695166 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:43:36.695166 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:43:36.695166 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:43:36.695166 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f33c0e5c-fe2c-4379-b50a-08eb17062b91 could not be found. Oct 04 20:43:36.695166 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:43:36.706829 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:43:36.706829 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:43:36.706829 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:43:36.706829 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:43:36.706829 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:43:36.706829 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:43:36.706829 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:43:36.706829 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f33c0e5c-fe2c-4379-b50a-08eb17062b91 could not be found. Oct 04 20:43:36.706829 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:43:36.706829 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-c33f6dac-ef48-49b3-92bb-ee3ef193581f tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Returning 404 to user: Instance f33c0e5c-fe2c-4379-b50a-08eb17062b91 could not be found. {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:43:36.706829 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-c33f6dac-ef48-49b3-92bb-ee3ef193581f tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] 10.222.0.33 "GET /compute/v2.1/servers/f33c0e5c-fe2c-4379-b50a-08eb17062b91" status: 404 len: 111 microversion: 2.25 time: 0.036748 Oct 04 20:43:36.706829 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1176/2283] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:43:36 2022] GET /compute/v2.1/servers/f33c0e5c-fe2c-4379-b50a-08eb17062b91 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 20:43:36.706829 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-992e8d3f-730e-40e0-8822-4df9d6762e23 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.4.187"}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:43:36.708663 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-992e8d3f-730e-40e0-8822-4df9d6762e23 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] [instance: 8ef51f7d-45b1-4d48-8611-5c7805f52d15] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:36.715671 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-992e8d3f-730e-40e0-8822-4df9d6762e23 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:36.716161 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-992e8d3f-730e-40e0-8822-4df9d6762e23 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:36.717452 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-992e8d3f-730e-40e0-8822-4df9d6762e23 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:36.718205 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-992e8d3f-730e-40e0-8822-4df9d6762e23 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:36.718763 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-992e8d3f-730e-40e0-8822-4df9d6762e23 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:36.719232 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-992e8d3f-730e-40e0-8822-4df9d6762e23 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:36.756387 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-992e8d3f-730e-40e0-8822-4df9d6762e23 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Acquiring lock "refresh_cache-8ef51f7d-45b1-4d48-8611-5c7805f52d15" {{(pid=128802) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 04 20:43:36.756791 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-992e8d3f-730e-40e0-8822-4df9d6762e23 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Acquired lock "refresh_cache-8ef51f7d-45b1-4d48-8611-5c7805f52d15" {{(pid=128802) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 04 20:43:37.680734 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-9532c427-e515-4412-a984-39d022b505d6 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28399882314945d787a3af6eb59935c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5392c67506f7445ab33d62b191558f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:37.709519 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-9532c427-e515-4412-a984-39d022b505d6 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28399882314945d787a3af6eb59935c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5392c67506f7445ab33d62b191558f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:37.712413 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-9532c427-e515-4412-a984-39d022b505d6 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28399882314945d787a3af6eb59935c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5392c67506f7445ab33d62b191558f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:37.713908 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-9532c427-e515-4412-a984-39d022b505d6 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] 10.222.0.33 "GET /compute/v2.1/servers/c0a14e22-0620-4912-9893-62974c80978a" status: 200 len: 1879 microversion: 2.32 time: 1.123382 Oct 04 20:43:37.725667 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1108/2284] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:43:36 2022] GET /compute/v2.1/servers/c0a14e22-0620-4912-9893-62974c80978a => generated 1879 bytes in 1135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:43:37.735979 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6842aa24-3920-46d8-8a0f-5bd6072daa81 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:37.736719 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-6842aa24-3920-46d8-8a0f-5bd6072daa81 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] [instance: 2bae38c5-cec9-444b-8879-dcb7eb2822e6] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:37.744683 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6842aa24-3920-46d8-8a0f-5bd6072daa81 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:37.745242 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6842aa24-3920-46d8-8a0f-5bd6072daa81 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:37.746746 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6842aa24-3920-46d8-8a0f-5bd6072daa81 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:37.747720 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6842aa24-3920-46d8-8a0f-5bd6072daa81 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:37.748260 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6842aa24-3920-46d8-8a0f-5bd6072daa81 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:37.748776 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6842aa24-3920-46d8-8a0f-5bd6072daa81 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:37.780189 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-6842aa24-3920-46d8-8a0f-5bd6072daa81 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] [instance: 2bae38c5-cec9-444b-8879-dcb7eb2822e6] Going to try to terminate instance {{(pid=128801) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:43:37.881138 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-6842aa24-3920-46d8-8a0f-5bd6072daa81 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] 10.222.0.33 "DELETE /compute/v2.1/servers/2bae38c5-cec9-444b-8879-dcb7eb2822e6" status: 204 len: 0 microversion: 2.1 time: 0.152782 Oct 04 20:43:37.881841 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1109/2285] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 20:43:37 2022] DELETE /compute/v2.1/servers/2bae38c5-cec9-444b-8879-dcb7eb2822e6 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:43:37.893586 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2c4c0e5f-73ee-48bf-8353-410bbf7b4f90 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:37.894260 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-2c4c0e5f-73ee-48bf-8353-410bbf7b4f90 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] [instance: 5dbb0cb7-e2d8-416a-a486-72d4398ee877] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:37.902118 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2c4c0e5f-73ee-48bf-8353-410bbf7b4f90 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:37.903064 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2c4c0e5f-73ee-48bf-8353-410bbf7b4f90 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:37.903691 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2c4c0e5f-73ee-48bf-8353-410bbf7b4f90 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:37.904729 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2c4c0e5f-73ee-48bf-8353-410bbf7b4f90 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:37.906018 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2c4c0e5f-73ee-48bf-8353-410bbf7b4f90 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:37.906674 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2c4c0e5f-73ee-48bf-8353-410bbf7b4f90 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:37.943037 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-2c4c0e5f-73ee-48bf-8353-410bbf7b4f90 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] [instance: 5dbb0cb7-e2d8-416a-a486-72d4398ee877] Going to try to terminate instance {{(pid=128801) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:43:38.047937 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-2c4c0e5f-73ee-48bf-8353-410bbf7b4f90 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] 10.222.0.33 "DELETE /compute/v2.1/servers/5dbb0cb7-e2d8-416a-a486-72d4398ee877" status: 204 len: 0 microversion: 2.25 time: 0.164622 Oct 04 20:43:38.051818 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1110/2286] 10.222.0.33 () {60 vars in 1280 bytes} [Tue Oct 4 20:43:37 2022] DELETE /compute/v2.1/servers/5dbb0cb7-e2d8-416a-a486-72d4398ee877 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 20:43:38.059456 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-36821424-715c-414d-b2e0-5677af4a0e43 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:38.060307 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-36821424-715c-414d-b2e0-5677af4a0e43 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] [instance: 17f61077-3e1c-4d86-b364-b22e4e40b3ca] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:38.068792 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-36821424-715c-414d-b2e0-5677af4a0e43 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:38.070193 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-36821424-715c-414d-b2e0-5677af4a0e43 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:38.071277 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-36821424-715c-414d-b2e0-5677af4a0e43 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:38.072248 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-36821424-715c-414d-b2e0-5677af4a0e43 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:38.072783 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-36821424-715c-414d-b2e0-5677af4a0e43 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:38.073481 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-36821424-715c-414d-b2e0-5677af4a0e43 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:38.538957 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-36821424-715c-414d-b2e0-5677af4a0e43 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '800db3a57ada47eca381b00189fdbf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66ec8ea91b04deb90b679589e0495bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:38.549341 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-36821424-715c-414d-b2e0-5677af4a0e43 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] 10.222.0.33 "GET /compute/v2.1/servers/17f61077-3e1c-4d86-b364-b22e4e40b3ca" status: 200 len: 1391 microversion: 2.1 time: 0.498625 Oct 04 20:43:38.549848 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1111/2287] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:43:38 2022] GET /compute/v2.1/servers/17f61077-3e1c-4d86-b364-b22e4e40b3ca => generated 1391 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:43:38.558983 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-64129f2c-8e78-4acb-a867-e008426efafc tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:38.559978 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-64129f2c-8e78-4acb-a867-e008426efafc tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] [instance: 251a34fb-f406-415f-8a45-d80feb48581d] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:38.567211 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-64129f2c-8e78-4acb-a867-e008426efafc tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:38.567958 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-64129f2c-8e78-4acb-a867-e008426efafc tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:38.569594 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-64129f2c-8e78-4acb-a867-e008426efafc tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:38.569594 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-64129f2c-8e78-4acb-a867-e008426efafc tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:38.569764 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-64129f2c-8e78-4acb-a867-e008426efafc tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:38.570370 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-64129f2c-8e78-4acb-a867-e008426efafc tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:38.761800 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-64129f2c-8e78-4acb-a867-e008426efafc tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd8aa669e8847a3848a723c7890ef98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d7a1e525a85411ca2ce2bce1638b463', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:38.778867 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-64129f2c-8e78-4acb-a867-e008426efafc tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] 10.222.0.33 "GET /compute/v2.1/servers/251a34fb-f406-415f-8a45-d80feb48581d" status: 200 len: 1632 microversion: 2.1 time: 0.227559 Oct 04 20:43:38.780141 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1112/2288] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:43:38 2022] GET /compute/v2.1/servers/251a34fb-f406-415f-8a45-d80feb48581d => generated 1632 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:43:38.785110 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-831d1601-a8b6-4d3d-a575-1db72b8de89f tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:38.788104 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-831d1601-a8b6-4d3d-a575-1db72b8de89f tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] [instance: 2bae38c5-cec9-444b-8879-dcb7eb2822e6] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:38.804050 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-831d1601-a8b6-4d3d-a575-1db72b8de89f tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:38.805871 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-831d1601-a8b6-4d3d-a575-1db72b8de89f tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:38.806680 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-831d1601-a8b6-4d3d-a575-1db72b8de89f tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:38.807645 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-831d1601-a8b6-4d3d-a575-1db72b8de89f tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:38.819181 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-831d1601-a8b6-4d3d-a575-1db72b8de89f tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:38.820047 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-831d1601-a8b6-4d3d-a575-1db72b8de89f tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:39.215415 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-831d1601-a8b6-4d3d-a575-1db72b8de89f tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e1e240b20e41e8b90e0d630e0d6b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a44744f2bb4130b9a49065b49cf854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:39.225652 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-831d1601-a8b6-4d3d-a575-1db72b8de89f tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] 10.222.0.33 "GET /compute/v2.1/servers/2bae38c5-cec9-444b-8879-dcb7eb2822e6" status: 200 len: 1812 microversion: 2.1 time: 0.444167 Oct 04 20:43:39.238519 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1113/2289] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:43:38 2022] GET /compute/v2.1/servers/2bae38c5-cec9-444b-8879-dcb7eb2822e6 => generated 1812 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:43:39.238519 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c7865ee7-4db8-41e7-ad19-27e0480fe982 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:39.238519 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c7865ee7-4db8-41e7-ad19-27e0480fe982 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] [instance: 5dbb0cb7-e2d8-416a-a486-72d4398ee877] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:39.255122 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c7865ee7-4db8-41e7-ad19-27e0480fe982 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:39.257825 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c7865ee7-4db8-41e7-ad19-27e0480fe982 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:39.258507 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c7865ee7-4db8-41e7-ad19-27e0480fe982 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:39.259247 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c7865ee7-4db8-41e7-ad19-27e0480fe982 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:39.262575 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c7865ee7-4db8-41e7-ad19-27e0480fe982 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:39.263134 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c7865ee7-4db8-41e7-ad19-27e0480fe982 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:40.080740 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c7865ee7-4db8-41e7-ad19-27e0480fe982 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:40.094243 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c7865ee7-4db8-41e7-ad19-27e0480fe982 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:40.108339 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c7865ee7-4db8-41e7-ad19-27e0480fe982 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:40.112040 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c7865ee7-4db8-41e7-ad19-27e0480fe982 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] 10.222.0.33 "GET /compute/v2.1/servers/5dbb0cb7-e2d8-416a-a486-72d4398ee877" status: 200 len: 1563 microversion: 2.25 time: 0.882056 Oct 04 20:43:40.112861 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1114/2290] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:43:39 2022] GET /compute/v2.1/servers/5dbb0cb7-e2d8-416a-a486-72d4398ee877 => generated 1563 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:43:40.131004 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-a4833922-418b-41c9-b637-188972612a21 req-07b46bdc-38a1-4b0d-9728-fe9708905174 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "251a34fb-f406-415f-8a45-d80feb48581d", "name": "network-vif-deleted", "tag": "47d205c9-2575-420f-bb45-a99478492ca2"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:43:40.145436 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-a4833922-418b-41c9-b637-188972612a21 req-07b46bdc-38a1-4b0d-9728-fe9708905174 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:40.145913 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-a4833922-418b-41c9-b637-188972612a21 req-07b46bdc-38a1-4b0d-9728-fe9708905174 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:40.146427 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-a4833922-418b-41c9-b637-188972612a21 req-07b46bdc-38a1-4b0d-9728-fe9708905174 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:40.162369 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-a4833922-418b-41c9-b637-188972612a21 req-07b46bdc-38a1-4b0d-9728-fe9708905174 service nova] Creating event network-vif-deleted:47d205c9-2575-420f-bb45-a99478492ca2 for instance 251a34fb-f406-415f-8a45-d80feb48581d on n-h1-854823-8 Oct 04 20:43:40.167636 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-a4833922-418b-41c9-b637-188972612a21 req-07b46bdc-38a1-4b0d-9728-fe9708905174 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053130 Oct 04 20:43:40.168660 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1115/2291] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:43:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:43:40.173903 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-bdae510d-7888-4386-9878-2758def44d98 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:40.174758 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-bdae510d-7888-4386-9878-2758def44d98 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] [instance: c0a14e22-0620-4912-9893-62974c80978a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:40.181865 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bdae510d-7888-4386-9878-2758def44d98 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:40.182429 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bdae510d-7888-4386-9878-2758def44d98 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:40.182940 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bdae510d-7888-4386-9878-2758def44d98 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:40.184779 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bdae510d-7888-4386-9878-2758def44d98 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:40.185345 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bdae510d-7888-4386-9878-2758def44d98 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:40.185854 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bdae510d-7888-4386-9878-2758def44d98 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:40.656698 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell0:SELECT=2 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:43:40.714924 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-bdae510d-7888-4386-9878-2758def44d98 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28399882314945d787a3af6eb59935c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5392c67506f7445ab33d62b191558f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:40.728869 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-bdae510d-7888-4386-9878-2758def44d98 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28399882314945d787a3af6eb59935c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5392c67506f7445ab33d62b191558f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:40.728869 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-bdae510d-7888-4386-9878-2758def44d98 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28399882314945d787a3af6eb59935c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5392c67506f7445ab33d62b191558f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:40.728869 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-bdae510d-7888-4386-9878-2758def44d98 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] 10.222.0.33 "GET /compute/v2.1/servers/c0a14e22-0620-4912-9893-62974c80978a" status: 200 len: 1879 microversion: 2.32 time: 0.557687 Oct 04 20:43:40.728869 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1116/2292] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:43:40 2022] GET /compute/v2.1/servers/c0a14e22-0620-4912-9893-62974c80978a => generated 1879 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:43:40.754722 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d14b2cf3-a6d6-4ae7-9dff-c73bb2fe91e9 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:40.754722 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d14b2cf3-a6d6-4ae7-9dff-c73bb2fe91e9 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] [instance: 17f61077-3e1c-4d86-b364-b22e4e40b3ca] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:40.761002 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d14b2cf3-a6d6-4ae7-9dff-c73bb2fe91e9 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:40.762528 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d14b2cf3-a6d6-4ae7-9dff-c73bb2fe91e9 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:40.763259 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d14b2cf3-a6d6-4ae7-9dff-c73bb2fe91e9 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:40.764152 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d14b2cf3-a6d6-4ae7-9dff-c73bb2fe91e9 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:40.764791 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d14b2cf3-a6d6-4ae7-9dff-c73bb2fe91e9 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:40.765469 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d14b2cf3-a6d6-4ae7-9dff-c73bb2fe91e9 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:40.845307 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:43:40.963185 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:43:41.397618 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d14b2cf3-a6d6-4ae7-9dff-c73bb2fe91e9 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '800db3a57ada47eca381b00189fdbf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66ec8ea91b04deb90b679589e0495bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:41.410979 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d14b2cf3-a6d6-4ae7-9dff-c73bb2fe91e9 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] 10.222.0.33 "GET /compute/v2.1/servers/17f61077-3e1c-4d86-b364-b22e4e40b3ca" status: 200 len: 1391 microversion: 2.1 time: 0.667100 Oct 04 20:43:41.413625 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1117/2293] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:43:40 2022] GET /compute/v2.1/servers/17f61077-3e1c-4d86-b364-b22e4e40b3ca => generated 1391 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:43:41.419801 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-42915c9b-14be-43b1-ab9f-a77f070bd52b tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:41.420754 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-42915c9b-14be-43b1-ab9f-a77f070bd52b tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] [instance: 251a34fb-f406-415f-8a45-d80feb48581d] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:41.427677 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-42915c9b-14be-43b1-ab9f-a77f070bd52b tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:41.428473 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-42915c9b-14be-43b1-ab9f-a77f070bd52b tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:41.429173 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-42915c9b-14be-43b1-ab9f-a77f070bd52b tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:41.430309 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-42915c9b-14be-43b1-ab9f-a77f070bd52b tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:41.431103 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-42915c9b-14be-43b1-ab9f-a77f070bd52b tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:41.431837 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-42915c9b-14be-43b1-ab9f-a77f070bd52b tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:41.472333 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-42915c9b-14be-43b1-ab9f-a77f070bd52b tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] HTTP exception thrown: Instance 251a34fb-f406-415f-8a45-d80feb48581d could not be found. Oct 04 20:43:41.474402 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-42915c9b-14be-43b1-ab9f-a77f070bd52b tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] Request method failure captured: Oct 04 20:43:41.474402 n-d-854823-8 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/251a34fb-f406-415f-8a45-d80feb48581d HTTP/1.1 Oct 04 20:43:41.474402 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:43:41.474402 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:43:41.474402 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:43:41.474402 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 0 Oct 04 20:43:41.474402 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:43:41.474402 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:43:41.474402 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:43:41.474402 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:43:41.474402 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJqdRNl7k9V9G6J1-leTEsdvX87Bozx3dES_SYEdukUJAIpt1I14khuuVtO5-FWGq3EH6x0rZN514FinnQkgCL2_rTmhhpRrs-Cp5CbMl9cGzGIPZpepZBq4Dy1Dgnl1mJ32s6JVbqThKT3D4KXZcz7a6cvsti5-G3gOppjxvUUALbk Oct 04 20:43:41.474402 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:43:41.474402 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:43:41.474402 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:43:41.474402 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:43:41.474402 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:43:41.474402 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:43:41.474402 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: 6d7a1e525a85411ca2ce2bce1638b463 Oct 04 20:43:41.474402 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-ServersTestJSON-904076126 Oct 04 20:43:41.474402 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 20:43:41.474402 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 20:43:41.474402 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_6d7a1e525a85411ca2ce2bce1638b463", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/6d7a1e525a85411ca2ce2bce1638b463"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/6d7a1e525a85411ca2ce2bce1638b463"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/6d7a1e525a85411ca2ce2bce1638b463"}]}] Oct 04 20:43:41.474402 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-ServersTestJSON-904076126 Oct 04 20:43:41.474402 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: 6d7a1e525a85411ca2ce2bce1638b463 Oct 04 20:43:41.474402 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ServersTestJSON-904076126 Oct 04 20:43:41.474402 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-ServersTestJSON-904076126-project Oct 04 20:43:41.474402 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:43:41.474402 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:43:41.474402 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: 4dd8aa669e8847a3848a723c7890ef98 Oct 04 20:43:41.474402 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-ServersTestJSON-904076126-project Oct 04 20:43:41.474402 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 20:43:41.474402 n-d-854823-8 devstack@n-api.service[128801]: exception: Instance 251a34fb-f406-415f-8a45-d80feb48581d could not be found. Oct 04 20:43:41.474402 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': '251a34fb-f406-415f-8a45-d80feb48581d'} Oct 04 20:43:41.474402 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:43:41.474402 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:43:41.474402 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:43:41.474402 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:43:41.474402 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:43:41.474402 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:43:41.474402 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:43:41.474402 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:43:41.474402 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:43:41.474402 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:43:41.474402 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 251a34fb-f406-415f-8a45-d80feb48581d could not be found. Oct 04 20:43:41.474402 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:43:41.474402 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:43:41.474402 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:43:41.474402 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:43:41.474402 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:43:41.474402 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:43:41.474402 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:43:41.474402 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:43:41.474402 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:43:41.474402 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:43:41.474402 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:43:41.474402 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:43:41.474402 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:43:41.474402 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:43:41.474402 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:43:41.474402 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:43:41.474402 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 251a34fb-f406-415f-8a45-d80feb48581d could not be found. Oct 04 20:43:41.474402 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:43:41.474402 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:43:41.474402 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:43:41.474402 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:43:41.478204 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:43:41.478204 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:43:41.478204 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:43:41.478204 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:43:41.478204 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 251a34fb-f406-415f-8a45-d80feb48581d could not be found. Oct 04 20:43:41.478204 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:43:41.485029 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-42915c9b-14be-43b1-ab9f-a77f070bd52b tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] Returning 404 to user: Instance 251a34fb-f406-415f-8a45-d80feb48581d could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:43:41.487122 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-42915c9b-14be-43b1-ab9f-a77f070bd52b tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] 10.222.0.33 "GET /compute/v2.1/servers/251a34fb-f406-415f-8a45-d80feb48581d" status: 404 len: 111 microversion: 2.1 time: 0.071949 Oct 04 20:43:41.491907 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1118/2294] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:43:41 2022] GET /compute/v2.1/servers/251a34fb-f406-415f-8a45-d80feb48581d => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:43:41.498004 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-63721e81-4bc4-4af4-a44b-a4c29dc2bdae tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:41.499093 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-63721e81-4bc4-4af4-a44b-a4c29dc2bdae tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] [instance: 2bae38c5-cec9-444b-8879-dcb7eb2822e6] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:41.506504 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-63721e81-4bc4-4af4-a44b-a4c29dc2bdae tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:41.507454 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-63721e81-4bc4-4af4-a44b-a4c29dc2bdae tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:41.508296 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-63721e81-4bc4-4af4-a44b-a4c29dc2bdae tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:41.509323 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-63721e81-4bc4-4af4-a44b-a4c29dc2bdae tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:41.509982 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-63721e81-4bc4-4af4-a44b-a4c29dc2bdae tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:41.510787 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-63721e81-4bc4-4af4-a44b-a4c29dc2bdae tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:42.134858 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-63721e81-4bc4-4af4-a44b-a4c29dc2bdae tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e1e240b20e41e8b90e0d630e0d6b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a44744f2bb4130b9a49065b49cf854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:42.138092 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=93,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=3,nova_cell1:RELEASE=1,nova_cell1:INSERT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:43:42.147109 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-63721e81-4bc4-4af4-a44b-a4c29dc2bdae tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] 10.222.0.33 "GET /compute/v2.1/servers/2bae38c5-cec9-444b-8879-dcb7eb2822e6" status: 200 len: 1791 microversion: 2.1 time: 0.653805 Oct 04 20:43:42.176278 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1119/2295] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:43:41 2022] GET /compute/v2.1/servers/2bae38c5-cec9-444b-8879-dcb7eb2822e6 => generated 1791 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:43:42.182306 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f35c036a-90e9-4ac6-9deb-7f874830f608 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:42.184100 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f35c036a-90e9-4ac6-9deb-7f874830f608 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] [instance: 5dbb0cb7-e2d8-416a-a486-72d4398ee877] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:42.198190 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f35c036a-90e9-4ac6-9deb-7f874830f608 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:42.201967 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f35c036a-90e9-4ac6-9deb-7f874830f608 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:42.202705 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f35c036a-90e9-4ac6-9deb-7f874830f608 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:42.206649 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f35c036a-90e9-4ac6-9deb-7f874830f608 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:42.207369 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f35c036a-90e9-4ac6-9deb-7f874830f608 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:42.208037 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f35c036a-90e9-4ac6-9deb-7f874830f608 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:42.684944 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f35c036a-90e9-4ac6-9deb-7f874830f608 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:42.699746 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f35c036a-90e9-4ac6-9deb-7f874830f608 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:42.706362 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f35c036a-90e9-4ac6-9deb-7f874830f608 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'beaac70ab9344f6c9677d6500b8b0df6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4310eadf656d4ba88ade5714c9661488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:42.707943 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f35c036a-90e9-4ac6-9deb-7f874830f608 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] 10.222.0.33 "GET /compute/v2.1/servers/5dbb0cb7-e2d8-416a-a486-72d4398ee877" status: 200 len: 1521 microversion: 2.25 time: 0.530375 Oct 04 20:43:42.729753 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1120/2296] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:43:42 2022] GET /compute/v2.1/servers/5dbb0cb7-e2d8-416a-a486-72d4398ee877 => generated 1521 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:43:42.735377 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-262e42b6-09bc-4144-be65-59cd72a4bc7f tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] Calling method '.version_select at 0x7f3c746be160>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:42.793331 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-262e42b6-09bc-4144-be65-59cd72a4bc7f tempest-ServersTestJSON-904076126 tempest-ServersTestJSON-904076126-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1101435304" status: 202 len: 0 microversion: 2.1 time: 0.060935 Oct 04 20:43:42.794396 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1121/2297] 10.222.0.33 () {58 vars in 1221 bytes} [Tue Oct 4 20:43:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1101435304 => generated 0 bytes in 63 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:43:42.801050 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-60bdb03d-1635-4175-ab3d-e877bedb6d17 req-705b36ea-31f5-4248-8430-4a4b98f143d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2bae38c5-cec9-444b-8879-dcb7eb2822e6", "name": "network-vif-deleted", "tag": "0c70749a-4945-4ee8-823a-ffab1c784795"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:43:42.834472 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-60bdb03d-1635-4175-ab3d-e877bedb6d17 req-705b36ea-31f5-4248-8430-4a4b98f143d4 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:42.834993 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-60bdb03d-1635-4175-ab3d-e877bedb6d17 req-705b36ea-31f5-4248-8430-4a4b98f143d4 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:42.835456 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-60bdb03d-1635-4175-ab3d-e877bedb6d17 req-705b36ea-31f5-4248-8430-4a4b98f143d4 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:42.876855 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-60bdb03d-1635-4175-ab3d-e877bedb6d17 req-705b36ea-31f5-4248-8430-4a4b98f143d4 service nova] Creating event network-vif-deleted:0c70749a-4945-4ee8-823a-ffab1c784795 for instance 2bae38c5-cec9-444b-8879-dcb7eb2822e6 on n-h2-854823-8 Oct 04 20:43:42.890683 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-60bdb03d-1635-4175-ab3d-e877bedb6d17 req-705b36ea-31f5-4248-8430-4a4b98f143d4 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094776 Oct 04 20:43:42.891922 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1122/2298] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:43:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:43:42.897246 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9817577a-d325-4ce0-9923-5975b5edcc97 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:42.905740 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-9817577a-d325-4ce0-9923-5975b5edcc97 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] [instance: c0a14e22-0620-4912-9893-62974c80978a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:42.921462 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9817577a-d325-4ce0-9923-5975b5edcc97 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:42.926660 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9817577a-d325-4ce0-9923-5975b5edcc97 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:42.927442 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9817577a-d325-4ce0-9923-5975b5edcc97 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:42.929501 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9817577a-d325-4ce0-9923-5975b5edcc97 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:42.932318 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9817577a-d325-4ce0-9923-5975b5edcc97 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:42.933723 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9817577a-d325-4ce0-9923-5975b5edcc97 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:43.656001 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-9817577a-d325-4ce0-9923-5975b5edcc97 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28399882314945d787a3af6eb59935c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5392c67506f7445ab33d62b191558f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:43.668585 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-9817577a-d325-4ce0-9923-5975b5edcc97 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28399882314945d787a3af6eb59935c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5392c67506f7445ab33d62b191558f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:43.670656 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-9817577a-d325-4ce0-9923-5975b5edcc97 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28399882314945d787a3af6eb59935c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5392c67506f7445ab33d62b191558f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:43.672126 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-9817577a-d325-4ce0-9923-5975b5edcc97 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] 10.222.0.33 "GET /compute/v2.1/servers/c0a14e22-0620-4912-9893-62974c80978a" status: 200 len: 1879 microversion: 2.32 time: 0.778917 Oct 04 20:43:43.673430 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1123/2299] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:43:42 2022] GET /compute/v2.1/servers/c0a14e22-0620-4912-9893-62974c80978a => generated 1879 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:43:43.678857 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9b16d00f-caf8-43c5-b427-dbec1c4a7ebc tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:43.680019 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-9b16d00f-caf8-43c5-b427-dbec1c4a7ebc tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] [instance: 17f61077-3e1c-4d86-b364-b22e4e40b3ca] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:43.687539 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9b16d00f-caf8-43c5-b427-dbec1c4a7ebc tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:43.688835 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9b16d00f-caf8-43c5-b427-dbec1c4a7ebc tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:43.689667 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9b16d00f-caf8-43c5-b427-dbec1c4a7ebc tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:43.690655 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9b16d00f-caf8-43c5-b427-dbec1c4a7ebc tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:43.691421 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9b16d00f-caf8-43c5-b427-dbec1c4a7ebc tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:43.692186 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9b16d00f-caf8-43c5-b427-dbec1c4a7ebc tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:43.906194 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.network.neutron [None req-992e8d3f-730e-40e0-8822-4df9d6762e23 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] [instance: 8ef51f7d-45b1-4d48-8611-5c7805f52d15] re-assign floating IP 172.25.4.187 from instance 659f073c-b8c2-48d3-8c09-fef755291460 Oct 04 20:43:44.013172 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.network.neutron [None req-992e8d3f-730e-40e0-8822-4df9d6762e23 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] [instance: 659f073c-b8c2-48d3-8c09-fef755291460] Building network info cache for instance {{(pid=128802) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 04 20:43:44.285366 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-9b16d00f-caf8-43c5-b427-dbec1c4a7ebc tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '800db3a57ada47eca381b00189fdbf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66ec8ea91b04deb90b679589e0495bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:44.298006 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-9b16d00f-caf8-43c5-b427-dbec1c4a7ebc tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] 10.222.0.33 "GET /compute/v2.1/servers/17f61077-3e1c-4d86-b364-b22e4e40b3ca" status: 200 len: 1391 microversion: 2.1 time: 0.623210 Oct 04 20:43:44.315208 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1124/2300] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:43:43 2022] GET /compute/v2.1/servers/17f61077-3e1c-4d86-b364-b22e4e40b3ca => generated 1391 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:43:44.320831 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-43409aff-e369-4de3-9359-35d737cd6dc6 req-1f7b7d15-749f-421b-ab23-e92dd4aab27c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5dbb0cb7-e2d8-416a-a486-72d4398ee877", "name": "network-vif-deleted", "tag": "cf080088-b0ac-4a20-83d3-5d85ca5cdb45"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:43:44.332858 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-43409aff-e369-4de3-9359-35d737cd6dc6 req-1f7b7d15-749f-421b-ab23-e92dd4aab27c service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:44.333549 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-43409aff-e369-4de3-9359-35d737cd6dc6 req-1f7b7d15-749f-421b-ab23-e92dd4aab27c service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:44.334421 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-43409aff-e369-4de3-9359-35d737cd6dc6 req-1f7b7d15-749f-421b-ab23-e92dd4aab27c service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:44.356094 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-43409aff-e369-4de3-9359-35d737cd6dc6 req-1f7b7d15-749f-421b-ab23-e92dd4aab27c service nova] Creating event network-vif-deleted:cf080088-b0ac-4a20-83d3-5d85ca5cdb45 for instance 5dbb0cb7-e2d8-416a-a486-72d4398ee877 on n-h2-854823-8 Oct 04 20:43:44.363311 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-43409aff-e369-4de3-9359-35d737cd6dc6 req-1f7b7d15-749f-421b-ab23-e92dd4aab27c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046226 Oct 04 20:43:44.366123 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1125/2301] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:43:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:43:44.374462 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-78c38f49-255f-4dda-85ab-e39947fb6ab4 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:44.375250 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-78c38f49-255f-4dda-85ab-e39947fb6ab4 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] [instance: 2bae38c5-cec9-444b-8879-dcb7eb2822e6] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:44.384605 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-78c38f49-255f-4dda-85ab-e39947fb6ab4 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:44.385153 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-78c38f49-255f-4dda-85ab-e39947fb6ab4 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:44.385587 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-78c38f49-255f-4dda-85ab-e39947fb6ab4 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:44.386585 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-78c38f49-255f-4dda-85ab-e39947fb6ab4 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:44.387050 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-78c38f49-255f-4dda-85ab-e39947fb6ab4 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:44.387466 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-78c38f49-255f-4dda-85ab-e39947fb6ab4 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:44.604764 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-78c38f49-255f-4dda-85ab-e39947fb6ab4 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e1e240b20e41e8b90e0d630e0d6b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a44744f2bb4130b9a49065b49cf854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:44.617245 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-78c38f49-255f-4dda-85ab-e39947fb6ab4 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] 10.222.0.33 "GET /compute/v2.1/servers/2bae38c5-cec9-444b-8879-dcb7eb2822e6" status: 200 len: 1570 microversion: 2.1 time: 0.249597 Oct 04 20:43:44.623800 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1126/2302] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:43:44 2022] GET /compute/v2.1/servers/2bae38c5-cec9-444b-8879-dcb7eb2822e6 => generated 1570 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:43:44.640187 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c60720c8-83f0-448d-9a3e-59bca10f31f4 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:44.641032 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c60720c8-83f0-448d-9a3e-59bca10f31f4 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] [instance: 5dbb0cb7-e2d8-416a-a486-72d4398ee877] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:44.656200 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c60720c8-83f0-448d-9a3e-59bca10f31f4 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:44.658742 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c60720c8-83f0-448d-9a3e-59bca10f31f4 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:44.661235 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c60720c8-83f0-448d-9a3e-59bca10f31f4 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:44.662181 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c60720c8-83f0-448d-9a3e-59bca10f31f4 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:44.663026 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c60720c8-83f0-448d-9a3e-59bca10f31f4 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:44.666328 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c60720c8-83f0-448d-9a3e-59bca10f31f4 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:44.730818 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-c60720c8-83f0-448d-9a3e-59bca10f31f4 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] HTTP exception thrown: Instance 5dbb0cb7-e2d8-416a-a486-72d4398ee877 could not be found. Oct 04 20:43:44.738022 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c60720c8-83f0-448d-9a3e-59bca10f31f4 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Request method failure captured: Oct 04 20:43:44.738022 n-d-854823-8 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/5dbb0cb7-e2d8-416a-a486-72d4398ee877 HTTP/1.1 Oct 04 20:43:44.738022 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:43:44.738022 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:43:44.738022 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:43:44.738022 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 0 Oct 04 20:43:44.738022 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:43:44.738022 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:43:44.738022 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:43:44.738022 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:43:44.738022 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJlS7YkNoNsErcluy9zSzxfkdD1qZsxsTW6bj1bKeKNXQ1TZFsYEQE0A2-BDVieUj00yHcDo9HNRo-TRBb7WBLfhc-CTf5TtIr0bX4L7OLkl9dbNYfuXD8y1gAU3Jdg3pQ4OIwr5m4ORRwm2L-EVgflU4LvUAUpABmHQuENksFWfbrE Oct 04 20:43:44.738022 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:43:44.738022 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:43:44.738022 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:43:44.738022 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:43:44.738022 n-d-854823-8 devstack@n-api.service[128801]: X-Openstack-Nova-Api-Version: 2.25 Oct 04 20:43:44.738022 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:43:44.738022 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:43:44.738022 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: 4310eadf656d4ba88ade5714c9661488 Oct 04 20:43:44.738022 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1173687642 Oct 04 20:43:44.738022 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 20:43:44.738022 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 20:43:44.738022 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_4310eadf656d4ba88ade5714c9661488", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4310eadf656d4ba88ade5714c9661488"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4310eadf656d4ba88ade5714c9661488"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/4310eadf656d4ba88ade5714c9661488"}]}] Oct 04 20:43:44.738022 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1173687642 Oct 04 20:43:44.738022 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: 4310eadf656d4ba88ade5714c9661488 Oct 04 20:43:44.738022 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1173687642 Oct 04 20:43:44.738022 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-LiveAutoBlockMigrationV225Test-1173687642-project Oct 04 20:43:44.738022 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:43:44.738022 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:43:44.738022 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: beaac70ab9344f6c9677d6500b8b0df6 Oct 04 20:43:44.738022 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1173687642-project Oct 04 20:43:44.738022 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 20:43:44.738022 n-d-854823-8 devstack@n-api.service[128801]: exception: Instance 5dbb0cb7-e2d8-416a-a486-72d4398ee877 could not be found. Oct 04 20:43:44.738022 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': '5dbb0cb7-e2d8-416a-a486-72d4398ee877'} Oct 04 20:43:44.738022 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:43:44.738022 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:43:44.738022 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:43:44.738022 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:43:44.738022 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:43:44.738022 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:43:44.738022 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:43:44.738022 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:43:44.738022 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:43:44.738022 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:43:44.738022 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5dbb0cb7-e2d8-416a-a486-72d4398ee877 could not be found. Oct 04 20:43:44.738022 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:43:44.738022 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:43:44.738022 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:43:44.738022 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:43:44.738022 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:43:44.738022 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:43:44.738022 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:43:44.738022 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:43:44.738022 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:43:44.738022 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:43:44.738022 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:43:44.738022 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:43:44.738022 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:43:44.738022 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:43:44.738022 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:43:44.738022 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:43:44.738022 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5dbb0cb7-e2d8-416a-a486-72d4398ee877 could not be found. Oct 04 20:43:44.738022 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:43:44.742418 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:43:44.742418 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:43:44.742418 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:43:44.742418 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:43:44.742418 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:43:44.742418 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:43:44.742418 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:43:44.742418 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5dbb0cb7-e2d8-416a-a486-72d4398ee877 could not be found. Oct 04 20:43:44.742418 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:43:44.743562 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c60720c8-83f0-448d-9a3e-59bca10f31f4 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] Returning 404 to user: Instance 5dbb0cb7-e2d8-416a-a486-72d4398ee877 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:43:44.745355 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c60720c8-83f0-448d-9a3e-59bca10f31f4 tempest-LiveAutoBlockMigrationV225Test-1173687642 tempest-LiveAutoBlockMigrationV225Test-1173687642-project] 10.222.0.33 "GET /compute/v2.1/servers/5dbb0cb7-e2d8-416a-a486-72d4398ee877" status: 404 len: 111 microversion: 2.25 time: 0.120294 Oct 04 20:43:44.746390 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1127/2303] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:43:44 2022] GET /compute/v2.1/servers/5dbb0cb7-e2d8-416a-a486-72d4398ee877 => generated 111 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 20:43:44.762306 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6eab7d01-a3cc-456f-b092-6840a525f81a tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:44.780865 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-6eab7d01-a3cc-456f-b092-6840a525f81a tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] [instance: c0a14e22-0620-4912-9893-62974c80978a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:44.799236 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6eab7d01-a3cc-456f-b092-6840a525f81a tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:44.800049 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6eab7d01-a3cc-456f-b092-6840a525f81a tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:44.801804 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6eab7d01-a3cc-456f-b092-6840a525f81a tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:44.803294 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6eab7d01-a3cc-456f-b092-6840a525f81a tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:44.805280 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6eab7d01-a3cc-456f-b092-6840a525f81a tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:44.807189 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6eab7d01-a3cc-456f-b092-6840a525f81a tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:45.254220 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-6eab7d01-a3cc-456f-b092-6840a525f81a tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28399882314945d787a3af6eb59935c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5392c67506f7445ab33d62b191558f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:45.281514 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-6eab7d01-a3cc-456f-b092-6840a525f81a tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28399882314945d787a3af6eb59935c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5392c67506f7445ab33d62b191558f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:45.294534 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-6eab7d01-a3cc-456f-b092-6840a525f81a tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28399882314945d787a3af6eb59935c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5392c67506f7445ab33d62b191558f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:45.299978 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-6eab7d01-a3cc-456f-b092-6840a525f81a tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] 10.222.0.33 "GET /compute/v2.1/servers/c0a14e22-0620-4912-9893-62974c80978a" status: 200 len: 1879 microversion: 2.32 time: 0.550200 Oct 04 20:43:45.303208 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1128/2304] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:43:44 2022] GET /compute/v2.1/servers/c0a14e22-0620-4912-9893-62974c80978a => generated 1879 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:43:45.311372 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-c58eaa56-48f8-4705-a18a-89f6e392c676 req-a9ca9aa0-fa8a-467e-928e-3cf9ba1ee93f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17f61077-3e1c-4d86-b364-b22e4e40b3ca", "name": "network-vif-unplugged", "status": "completed", "tag": "f185090f-7c96-46b5-b51f-76a45035b6a4"}, {"server_uuid": "2bae38c5-cec9-444b-8879-dcb7eb2822e6", "name": "network-vif-deleted", "tag": "28a5bcd6-0d84-4242-8515-221e946610a0"}, {"name": "network-changed", "server_uuid": "17f61077-3e1c-4d86-b364-b22e4e40b3ca", "tag": "f185090f-7c96-46b5-b51f-76a45035b6a4"}, {"server_uuid": "2bae38c5-cec9-444b-8879-dcb7eb2822e6", "name": "network-vif-deleted", "tag": "651fbaa6-3b6b-47e0-878e-047d44c783c9"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:43:45.334821 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-c58eaa56-48f8-4705-a18a-89f6e392c676 req-a9ca9aa0-fa8a-467e-928e-3cf9ba1ee93f service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:45.335945 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-c58eaa56-48f8-4705-a18a-89f6e392c676 req-a9ca9aa0-fa8a-467e-928e-3cf9ba1ee93f service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:45.336725 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-c58eaa56-48f8-4705-a18a-89f6e392c676 req-a9ca9aa0-fa8a-467e-928e-3cf9ba1ee93f service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:45.363313 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-c58eaa56-48f8-4705-a18a-89f6e392c676 req-a9ca9aa0-fa8a-467e-928e-3cf9ba1ee93f service nova] Creating event network-vif-unplugged:f185090f-7c96-46b5-b51f-76a45035b6a4 for instance 17f61077-3e1c-4d86-b364-b22e4e40b3ca on n-h1-854823-8 Oct 04 20:43:45.364116 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-c58eaa56-48f8-4705-a18a-89f6e392c676 req-a9ca9aa0-fa8a-467e-928e-3cf9ba1ee93f service nova] Creating event network-vif-deleted:28a5bcd6-0d84-4242-8515-221e946610a0 for instance 2bae38c5-cec9-444b-8879-dcb7eb2822e6 on n-h2-854823-8 Oct 04 20:43:45.365331 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-c58eaa56-48f8-4705-a18a-89f6e392c676 req-a9ca9aa0-fa8a-467e-928e-3cf9ba1ee93f service nova] Creating event network-changed:f185090f-7c96-46b5-b51f-76a45035b6a4 for instance 17f61077-3e1c-4d86-b364-b22e4e40b3ca on n-h1-854823-8 Oct 04 20:43:45.366634 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-c58eaa56-48f8-4705-a18a-89f6e392c676 req-a9ca9aa0-fa8a-467e-928e-3cf9ba1ee93f service nova] Creating event network-vif-deleted:651fbaa6-3b6b-47e0-878e-047d44c783c9 for instance 2bae38c5-cec9-444b-8879-dcb7eb2822e6 on n-h2-854823-8 Oct 04 20:43:45.379741 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-c58eaa56-48f8-4705-a18a-89f6e392c676 req-a9ca9aa0-fa8a-467e-928e-3cf9ba1ee93f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 694 microversion: 2.1 time: 0.073870 Oct 04 20:43:45.381145 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1129/2305] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:43:45 2022] POST /compute/v2.1/os-server-external-events => generated 694 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:43:45.387695 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e33601ee-3817-4024-8ad0-6e71ec34cef7 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:45.389092 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e33601ee-3817-4024-8ad0-6e71ec34cef7 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] [instance: 17f61077-3e1c-4d86-b364-b22e4e40b3ca] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:45.403497 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e33601ee-3817-4024-8ad0-6e71ec34cef7 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:45.404468 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e33601ee-3817-4024-8ad0-6e71ec34cef7 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:45.405357 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e33601ee-3817-4024-8ad0-6e71ec34cef7 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:45.406940 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e33601ee-3817-4024-8ad0-6e71ec34cef7 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:45.407876 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e33601ee-3817-4024-8ad0-6e71ec34cef7 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:45.408940 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e33601ee-3817-4024-8ad0-6e71ec34cef7 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:45.670974 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.network.neutron [None req-992e8d3f-730e-40e0-8822-4df9d6762e23 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] [instance: 659f073c-b8c2-48d3-8c09-fef755291460] Updating instance_info_cache with network_info: [{"id": "267a2eeb-d782-40d7-865d-522dfe433aa5", "address": "fa:16:3e:1a:0b:04", "network": {"id": "8041a123-3203-48c7-8a2d-6c4dad3abeb6", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1176833900-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "2f258cb1ecd049078b201eb41692735a", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap267a2eeb-d7", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128802) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 04 20:43:45.696131 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.network.neutron [None req-992e8d3f-730e-40e0-8822-4df9d6762e23 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] [instance: 8ef51f7d-45b1-4d48-8611-5c7805f52d15] Building network info cache for instance {{(pid=128802) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 04 20:43:45.787973 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e33601ee-3817-4024-8ad0-6e71ec34cef7 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '800db3a57ada47eca381b00189fdbf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66ec8ea91b04deb90b679589e0495bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:45.797471 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e33601ee-3817-4024-8ad0-6e71ec34cef7 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] 10.222.0.33 "GET /compute/v2.1/servers/17f61077-3e1c-4d86-b364-b22e4e40b3ca" status: 200 len: 1391 microversion: 2.1 time: 0.414980 Oct 04 20:43:45.815083 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1130/2306] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:43:45 2022] GET /compute/v2.1/servers/17f61077-3e1c-4d86-b364-b22e4e40b3ca => generated 1391 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:43:45.820179 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-badec0a8-90bb-4ab1-b33f-1b76083dde75 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:45.821007 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-badec0a8-90bb-4ab1-b33f-1b76083dde75 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] [instance: 2bae38c5-cec9-444b-8879-dcb7eb2822e6] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:45.828005 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-badec0a8-90bb-4ab1-b33f-1b76083dde75 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:45.829473 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-badec0a8-90bb-4ab1-b33f-1b76083dde75 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:45.830077 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-badec0a8-90bb-4ab1-b33f-1b76083dde75 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:45.830999 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-badec0a8-90bb-4ab1-b33f-1b76083dde75 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:45.831979 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-badec0a8-90bb-4ab1-b33f-1b76083dde75 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:45.832562 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-badec0a8-90bb-4ab1-b33f-1b76083dde75 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:45.852303 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-badec0a8-90bb-4ab1-b33f-1b76083dde75 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] HTTP exception thrown: Instance 2bae38c5-cec9-444b-8879-dcb7eb2822e6 could not be found. Oct 04 20:43:45.854519 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-badec0a8-90bb-4ab1-b33f-1b76083dde75 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Request method failure captured: Oct 04 20:43:45.854519 n-d-854823-8 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/2bae38c5-cec9-444b-8879-dcb7eb2822e6 HTTP/1.1 Oct 04 20:43:45.854519 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:43:45.854519 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:43:45.854519 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:43:45.854519 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 0 Oct 04 20:43:45.854519 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:43:45.854519 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:43:45.854519 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:43:45.854519 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:43:45.854519 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJq9Qd71BosERLHbwV3kJJWPjGgXRnAwIsYo-uTAcHoKIBlN0RgqoukzyD4CEpzEOP916ZiJwcS_DodM5R8KTlQ7aQf1i8Ls6prjaCrz8FEtf6YqeRUj-v5zUGmRZXvKIkY9aYzCIXc6KOjqiXdqOBIUhPEGUrYHrpacXgcHwXicA98 Oct 04 20:43:45.854519 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:43:45.854519 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:43:45.854519 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:43:45.854519 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:43:45.854519 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:43:45.854519 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:43:45.854519 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: a6a44744f2bb4130b9a49065b49cf854 Oct 04 20:43:45.854519 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-ServersTestMultiNic-1546118216 Oct 04 20:43:45.854519 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 20:43:45.854519 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 20:43:45.854519 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a6a44744f2bb4130b9a49065b49cf854", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a6a44744f2bb4130b9a49065b49cf854"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a6a44744f2bb4130b9a49065b49cf854"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a6a44744f2bb4130b9a49065b49cf854"}]}] Oct 04 20:43:45.854519 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-ServersTestMultiNic-1546118216 Oct 04 20:43:45.854519 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: a6a44744f2bb4130b9a49065b49cf854 Oct 04 20:43:45.854519 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ServersTestMultiNic-1546118216 Oct 04 20:43:45.854519 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-ServersTestMultiNic-1546118216-project Oct 04 20:43:45.854519 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:43:45.854519 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:43:45.854519 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: e3e1e240b20e41e8b90e0d630e0d6b46 Oct 04 20:43:45.854519 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-ServersTestMultiNic-1546118216-project Oct 04 20:43:45.854519 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 20:43:45.854519 n-d-854823-8 devstack@n-api.service[128801]: exception: Instance 2bae38c5-cec9-444b-8879-dcb7eb2822e6 could not be found. Oct 04 20:43:45.854519 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': '2bae38c5-cec9-444b-8879-dcb7eb2822e6'} Oct 04 20:43:45.854519 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:43:45.854519 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:43:45.854519 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:43:45.854519 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:43:45.854519 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:43:45.854519 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:43:45.854519 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:43:45.854519 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:43:45.854519 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:43:45.854519 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:43:45.854519 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2bae38c5-cec9-444b-8879-dcb7eb2822e6 could not be found. Oct 04 20:43:45.854519 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:43:45.854519 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:43:45.854519 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:43:45.854519 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:43:45.854519 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:43:45.854519 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:43:45.854519 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:43:45.854519 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:43:45.854519 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:43:45.854519 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:43:45.854519 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:43:45.854519 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:43:45.854519 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:43:45.854519 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:43:45.854519 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:43:45.854519 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:43:45.854519 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2bae38c5-cec9-444b-8879-dcb7eb2822e6 could not be found. Oct 04 20:43:45.854519 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:43:45.854519 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:43:45.854519 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:43:45.859292 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:43:45.859292 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:43:45.859292 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:43:45.859292 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:43:45.859292 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:43:45.859292 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2bae38c5-cec9-444b-8879-dcb7eb2822e6 could not be found. Oct 04 20:43:45.859292 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:43:45.860710 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-badec0a8-90bb-4ab1-b33f-1b76083dde75 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Returning 404 to user: Instance 2bae38c5-cec9-444b-8879-dcb7eb2822e6 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:43:45.862061 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-badec0a8-90bb-4ab1-b33f-1b76083dde75 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] 10.222.0.33 "GET /compute/v2.1/servers/2bae38c5-cec9-444b-8879-dcb7eb2822e6" status: 404 len: 111 microversion: 2.1 time: 0.045743 Oct 04 20:43:45.863625 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1131/2307] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:43:45 2022] GET /compute/v2.1/servers/2bae38c5-cec9-444b-8879-dcb7eb2822e6 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:43:46.332713 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c9dad6ab-a390-43dd-95c2-716c09562294 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:46.333563 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c9dad6ab-a390-43dd-95c2-716c09562294 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] [instance: c0a14e22-0620-4912-9893-62974c80978a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:46.362859 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c9dad6ab-a390-43dd-95c2-716c09562294 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:46.364211 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c9dad6ab-a390-43dd-95c2-716c09562294 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:46.366965 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c9dad6ab-a390-43dd-95c2-716c09562294 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:46.370597 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c9dad6ab-a390-43dd-95c2-716c09562294 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:46.372613 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c9dad6ab-a390-43dd-95c2-716c09562294 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:46.373095 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c9dad6ab-a390-43dd-95c2-716c09562294 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:46.712847 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_api:SELECT=29 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:43:47.225468 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c9dad6ab-a390-43dd-95c2-716c09562294 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28399882314945d787a3af6eb59935c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5392c67506f7445ab33d62b191558f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:47.243061 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c9dad6ab-a390-43dd-95c2-716c09562294 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28399882314945d787a3af6eb59935c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5392c67506f7445ab33d62b191558f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:47.244809 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c9dad6ab-a390-43dd-95c2-716c09562294 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28399882314945d787a3af6eb59935c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5392c67506f7445ab33d62b191558f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:47.246746 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c9dad6ab-a390-43dd-95c2-716c09562294 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] 10.222.0.33 "GET /compute/v2.1/servers/c0a14e22-0620-4912-9893-62974c80978a" status: 200 len: 1879 microversion: 2.32 time: 0.920376 Oct 04 20:43:47.254085 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1132/2308] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:43:46 2022] GET /compute/v2.1/servers/c0a14e22-0620-4912-9893-62974c80978a => generated 1879 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 20:43:47.283423 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-d06b2317-3eaa-4a25-9dc4-3960e940c10b req-8c4d632d-706a-4cc8-855b-915e9df1b971 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "659f073c-b8c2-48d3-8c09-fef755291460", "tag": "267a2eeb-d782-40d7-865d-522dfe433aa5"}, {"name": "network-changed", "server_uuid": "8ef51f7d-45b1-4d48-8611-5c7805f52d15", "tag": "19434094-416b-42b5-95e8-2a04021d1e51"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:43:47.334286 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-d06b2317-3eaa-4a25-9dc4-3960e940c10b req-8c4d632d-706a-4cc8-855b-915e9df1b971 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:47.334829 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-d06b2317-3eaa-4a25-9dc4-3960e940c10b req-8c4d632d-706a-4cc8-855b-915e9df1b971 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:47.335253 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-d06b2317-3eaa-4a25-9dc4-3960e940c10b req-8c4d632d-706a-4cc8-855b-915e9df1b971 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:47.377163 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-d06b2317-3eaa-4a25-9dc4-3960e940c10b req-8c4d632d-706a-4cc8-855b-915e9df1b971 service nova] Creating event network-changed:267a2eeb-d782-40d7-865d-522dfe433aa5 for instance 659f073c-b8c2-48d3-8c09-fef755291460 on n-h2-854823-8 Oct 04 20:43:47.379187 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-d06b2317-3eaa-4a25-9dc4-3960e940c10b req-8c4d632d-706a-4cc8-855b-915e9df1b971 service nova] Creating event network-changed:19434094-416b-42b5-95e8-2a04021d1e51 for instance 8ef51f7d-45b1-4d48-8611-5c7805f52d15 on n-h1-854823-8 Oct 04 20:43:47.395752 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-d06b2317-3eaa-4a25-9dc4-3960e940c10b req-8c4d632d-706a-4cc8-855b-915e9df1b971 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.122887 Oct 04 20:43:47.401151 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1133/2309] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:43:47 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:43:47.407872 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c8a9cc5a-a9d9-43b8-9d47-5af2705875e5 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:47.408880 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c8a9cc5a-a9d9-43b8-9d47-5af2705875e5 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] [instance: 17f61077-3e1c-4d86-b364-b22e4e40b3ca] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:47.415577 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c8a9cc5a-a9d9-43b8-9d47-5af2705875e5 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:47.416369 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c8a9cc5a-a9d9-43b8-9d47-5af2705875e5 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:47.416992 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c8a9cc5a-a9d9-43b8-9d47-5af2705875e5 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:47.418980 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c8a9cc5a-a9d9-43b8-9d47-5af2705875e5 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:47.419614 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c8a9cc5a-a9d9-43b8-9d47-5af2705875e5 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:47.420316 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c8a9cc5a-a9d9-43b8-9d47-5af2705875e5 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:47.981748 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.network.neutron [None req-992e8d3f-730e-40e0-8822-4df9d6762e23 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] [instance: 8ef51f7d-45b1-4d48-8611-5c7805f52d15] Updating instance_info_cache with network_info: [{"id": "19434094-416b-42b5-95e8-2a04021d1e51", "address": "fa:16:3e:88:e2:91", "network": {"id": "8041a123-3203-48c7-8a2d-6c4dad3abeb6", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1176833900-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.4.187", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "2f258cb1ecd049078b201eb41692735a", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap19434094-41", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128802) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 04 20:43:47.983726 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c8a9cc5a-a9d9-43b8-9d47-5af2705875e5 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '800db3a57ada47eca381b00189fdbf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66ec8ea91b04deb90b679589e0495bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:47.998397 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c8a9cc5a-a9d9-43b8-9d47-5af2705875e5 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] 10.222.0.33 "GET /compute/v2.1/servers/17f61077-3e1c-4d86-b364-b22e4e40b3ca" status: 200 len: 1391 microversion: 2.1 time: 0.593280 Oct 04 20:43:48.000677 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1134/2310] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:43:47 2022] GET /compute/v2.1/servers/17f61077-3e1c-4d86-b364-b22e4e40b3ca => generated 1391 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:43:48.001953 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-992e8d3f-730e-40e0-8822-4df9d6762e23 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Releasing lock "refresh_cache-8ef51f7d-45b1-4d48-8611-5c7805f52d15" {{(pid=128802) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 04 20:43:48.005650 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-992e8d3f-730e-40e0-8822-4df9d6762e23 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] 10.222.0.33 "POST /compute/v2.1/servers/8ef51f7d-45b1-4d48-8611-5c7805f52d15/action" status: 202 len: 0 microversion: 2.1 time: 11.306988 Oct 04 20:43:48.010115 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1177/2311] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 20:43:36 2022] POST /compute/v2.1/servers/8ef51f7d-45b1-4d48-8611-5c7805f52d15/action => generated 0 bytes in 11312 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 04 20:43:48.019054 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ab4e0b3a-4560-443c-a602-189ab8292307 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.4.187"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:43:48.283642 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-4cac70f9-c47c-4795-8199-bed652085a81 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:48.285241 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-4cac70f9-c47c-4795-8199-bed652085a81 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] [instance: c0a14e22-0620-4912-9893-62974c80978a] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:48.297967 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4cac70f9-c47c-4795-8199-bed652085a81 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:48.298974 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4cac70f9-c47c-4795-8199-bed652085a81 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:48.299529 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4cac70f9-c47c-4795-8199-bed652085a81 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:48.300378 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4cac70f9-c47c-4795-8199-bed652085a81 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:48.306480 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4cac70f9-c47c-4795-8199-bed652085a81 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:48.306941 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4cac70f9-c47c-4795-8199-bed652085a81 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:48.314471 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=3,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=2,nova_cell1:RELEASE=2 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:43:48.643313 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ab4e0b3a-4560-443c-a602-189ab8292307 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] [instance: 8ef51f7d-45b1-4d48-8611-5c7805f52d15] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:48.650421 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ab4e0b3a-4560-443c-a602-189ab8292307 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:48.651238 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ab4e0b3a-4560-443c-a602-189ab8292307 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:48.652416 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ab4e0b3a-4560-443c-a602-189ab8292307 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:48.657416 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ab4e0b3a-4560-443c-a602-189ab8292307 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:48.658061 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ab4e0b3a-4560-443c-a602-189ab8292307 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:48.658896 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ab4e0b3a-4560-443c-a602-189ab8292307 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:49.080948 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-4cac70f9-c47c-4795-8199-bed652085a81 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28399882314945d787a3af6eb59935c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5392c67506f7445ab33d62b191558f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:49.115848 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-4cac70f9-c47c-4795-8199-bed652085a81 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28399882314945d787a3af6eb59935c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5392c67506f7445ab33d62b191558f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:49.119236 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-4cac70f9-c47c-4795-8199-bed652085a81 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28399882314945d787a3af6eb59935c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5392c67506f7445ab33d62b191558f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:49.120651 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-4cac70f9-c47c-4795-8199-bed652085a81 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] 10.222.0.33 "GET /compute/v2.1/servers/c0a14e22-0620-4912-9893-62974c80978a" status: 200 len: 1879 microversion: 2.32 time: 0.841232 Oct 04 20:43:49.121548 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1178/2312] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:43:48 2022] GET /compute/v2.1/servers/c0a14e22-0620-4912-9893-62974c80978a => generated 1879 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:43:49.144589 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-646eeab0-6aa1-4cd8-9f21-a541cf27816b tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:49.145791 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-646eeab0-6aa1-4cd8-9f21-a541cf27816b tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] [instance: 17f61077-3e1c-4d86-b364-b22e4e40b3ca] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:49.153813 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-646eeab0-6aa1-4cd8-9f21-a541cf27816b tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:49.154601 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-646eeab0-6aa1-4cd8-9f21-a541cf27816b tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:49.155218 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-646eeab0-6aa1-4cd8-9f21-a541cf27816b tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:49.156812 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-646eeab0-6aa1-4cd8-9f21-a541cf27816b tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:49.157437 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-646eeab0-6aa1-4cd8-9f21-a541cf27816b tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:49.158014 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-646eeab0-6aa1-4cd8-9f21-a541cf27816b tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:49.474289 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-ab4e0b3a-4560-443c-a602-189ab8292307 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] HTTP exception thrown: Floating IP 172.25.4.187 is not associated with instance 659f073c-b8c2-48d3-8c09-fef755291460. Oct 04 20:43:49.475842 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ab4e0b3a-4560-443c-a602-189ab8292307 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Request method failure captured: Oct 04 20:43:49.475842 n-d-854823-8 devstack@n-api.service[128801]: request: POST /compute/v2.1/servers/659f073c-b8c2-48d3-8c09-fef755291460/action HTTP/1.1 Oct 04 20:43:49.475842 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:43:49.475842 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:43:49.475842 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:43:49.475842 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 49 Oct 04 20:43:49.475842 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:43:49.475842 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:43:49.475842 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:43:49.475842 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:43:49.475842 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJrCXn9qkai-t0ssRtB2hHbsXxnP5vBOsXLyrdpMENqm1lUMebcltiaPpyMILmcvIN8llVIUttogRG2DF_WtLJWYaQ5u4-061o1eVh20ZNBGxnAtXnxMrwm1GWR6CkNd6wvaFrzIuArFkGOfhkVebmLChRySZyfWaukv6J6WbRuDoGI Oct 04 20:43:49.475842 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:43:49.475842 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:43:49.475842 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:43:49.475842 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:43:49.475842 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:43:49.475842 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:43:49.475842 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: 2f258cb1ecd049078b201eb41692735a Oct 04 20:43:49.475842 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-2034231916 Oct 04 20:43:49.475842 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 20:43:49.475842 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 20:43:49.475842 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_2f258cb1ecd049078b201eb41692735a", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2f258cb1ecd049078b201eb41692735a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2f258cb1ecd049078b201eb41692735a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/2f258cb1ecd049078b201eb41692735a"}]}] Oct 04 20:43:49.475842 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-2034231916 Oct 04 20:43:49.475842 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: 2f258cb1ecd049078b201eb41692735a Oct 04 20:43:49.475842 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-2034231916 Oct 04 20:43:49.475842 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-FloatingIPsAssociationTestJSON-2034231916-project Oct 04 20:43:49.475842 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:43:49.475842 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:43:49.475842 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: 07c500628d414c9983836c33563b38bc Oct 04 20:43:49.475842 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-2034231916-project Oct 04 20:43:49.475842 n-d-854823-8 devstack@n-api.service[128801]: Oct 04 20:43:49.475842 n-d-854823-8 devstack@n-api.service[128801]: {"removeFloatingIp": {"address": "172.25.4.187"}} Oct 04 20:43:49.475842 n-d-854823-8 devstack@n-api.service[128801]: method: Oct 04 20:43:49.475842 n-d-854823-8 devstack@n-api.service[128801]: exception: Floating IP 172.25.4.187 is not associated with instance 659f073c-b8c2-48d3-8c09-fef755291460. Oct 04 20:43:49.475842 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': '659f073c-b8c2-48d3-8c09-fef755291460', 'body': {'removeFloatingIp': {'address': '172.25.4.187'}}} Oct 04 20:43:49.475842 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:43:49.475842 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:43:49.475842 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:43:49.475842 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:43:49.475842 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:43:49.475842 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:43:49.475842 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:43:49.475842 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:43:49.475842 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:43:49.475842 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:43:49.475842 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:43:49.475842 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:43:49.475842 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 300, in _remove_floating_ip Oct 04 20:43:49.475842 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 04 20:43:49.475842 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Floating IP 172.25.4.187 is not associated with instance 659f073c-b8c2-48d3-8c09-fef755291460. Oct 04 20:43:49.475842 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:43:49.475842 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:43:49.475842 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:43:49.475842 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:43:49.475842 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:43:49.475842 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:43:49.475842 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:43:49.475842 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:43:49.475842 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP 172.25.4.187 is not associated with instance 659f073c-b8c2-48d3-8c09-fef755291460. Oct 04 20:43:49.475842 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:43:49.481972 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ab4e0b3a-4560-443c-a602-189ab8292307 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Returning 409 to user: Floating IP 172.25.4.187 is not associated with instance 659f073c-b8c2-48d3-8c09-fef755291460. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:43:49.483518 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ab4e0b3a-4560-443c-a602-189ab8292307 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] 10.222.0.33 "POST /compute/v2.1/servers/659f073c-b8c2-48d3-8c09-fef755291460/action" status: 409 len: 146 microversion: 2.1 time: 1.469814 Oct 04 20:43:49.484606 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1135/2313] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 20:43:48 2022] POST /compute/v2.1/servers/659f073c-b8c2-48d3-8c09-fef755291460/action => generated 146 bytes in 1471 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 04 20:43:49.493204 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5958fec5-2ff8-49a1-b80c-716dbd3c0967 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.4.187"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:43:49.961063 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-646eeab0-6aa1-4cd8-9f21-a541cf27816b tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '800db3a57ada47eca381b00189fdbf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66ec8ea91b04deb90b679589e0495bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:49.979011 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-646eeab0-6aa1-4cd8-9f21-a541cf27816b tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] 10.222.0.33 "GET /compute/v2.1/servers/17f61077-3e1c-4d86-b364-b22e4e40b3ca" status: 200 len: 1391 microversion: 2.1 time: 0.852204 Oct 04 20:43:49.981554 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1179/2314] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:43:49 2022] GET /compute/v2.1/servers/17f61077-3e1c-4d86-b364-b22e4e40b3ca => generated 1391 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:43:50.096284 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-5958fec5-2ff8-49a1-b80c-716dbd3c0967 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] [instance: 8ef51f7d-45b1-4d48-8611-5c7805f52d15] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:50.117707 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5958fec5-2ff8-49a1-b80c-716dbd3c0967 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:50.120662 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5958fec5-2ff8-49a1-b80c-716dbd3c0967 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:50.126373 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5958fec5-2ff8-49a1-b80c-716dbd3c0967 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:50.128975 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5958fec5-2ff8-49a1-b80c-716dbd3c0967 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:50.131242 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5958fec5-2ff8-49a1-b80c-716dbd3c0967 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:50.132403 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5958fec5-2ff8-49a1-b80c-716dbd3c0967 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:50.152625 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-1695bdb2-8101-414a-8b18-8b79878086d7 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:50.153310 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-1695bdb2-8101-414a-8b18-8b79878086d7 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] [instance: c0a14e22-0620-4912-9893-62974c80978a] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:50.177821 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1695bdb2-8101-414a-8b18-8b79878086d7 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:50.181960 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1695bdb2-8101-414a-8b18-8b79878086d7 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:50.183025 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1695bdb2-8101-414a-8b18-8b79878086d7 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:50.185502 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1695bdb2-8101-414a-8b18-8b79878086d7 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:50.187233 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1695bdb2-8101-414a-8b18-8b79878086d7 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:50.187823 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1695bdb2-8101-414a-8b18-8b79878086d7 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:50.679388 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-1695bdb2-8101-414a-8b18-8b79878086d7 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28399882314945d787a3af6eb59935c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5392c67506f7445ab33d62b191558f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:50.695706 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-1695bdb2-8101-414a-8b18-8b79878086d7 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28399882314945d787a3af6eb59935c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5392c67506f7445ab33d62b191558f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:50.698816 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-1695bdb2-8101-414a-8b18-8b79878086d7 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28399882314945d787a3af6eb59935c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5392c67506f7445ab33d62b191558f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:50.703778 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-1695bdb2-8101-414a-8b18-8b79878086d7 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] 10.222.0.33 "GET /compute/v2.1/servers/c0a14e22-0620-4912-9893-62974c80978a" status: 200 len: 1879 microversion: 2.32 time: 0.556484 Oct 04 20:43:50.727095 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1180/2315] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:43:50 2022] GET /compute/v2.1/servers/c0a14e22-0620-4912-9893-62974c80978a => generated 1879 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:43:50.967062 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5958fec5-2ff8-49a1-b80c-716dbd3c0967 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Acquiring lock "refresh_cache-8ef51f7d-45b1-4d48-8611-5c7805f52d15" {{(pid=128801) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 04 20:43:50.967480 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5958fec5-2ff8-49a1-b80c-716dbd3c0967 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Acquired lock "refresh_cache-8ef51f7d-45b1-4d48-8611-5c7805f52d15" {{(pid=128801) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 04 20:43:51.004442 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-4e2e01db-dc0a-43b5-8a3d-dcc6c6324e2a tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:51.005065 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-4e2e01db-dc0a-43b5-8a3d-dcc6c6324e2a tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] [instance: 17f61077-3e1c-4d86-b364-b22e4e40b3ca] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:51.018862 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4e2e01db-dc0a-43b5-8a3d-dcc6c6324e2a tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:51.019603 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4e2e01db-dc0a-43b5-8a3d-dcc6c6324e2a tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:51.020137 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4e2e01db-dc0a-43b5-8a3d-dcc6c6324e2a tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:51.021760 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4e2e01db-dc0a-43b5-8a3d-dcc6c6324e2a tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:51.022234 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4e2e01db-dc0a-43b5-8a3d-dcc6c6324e2a tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:51.022701 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4e2e01db-dc0a-43b5-8a3d-dcc6c6324e2a tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:51.318278 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-4e2e01db-dc0a-43b5-8a3d-dcc6c6324e2a tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '800db3a57ada47eca381b00189fdbf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66ec8ea91b04deb90b679589e0495bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:51.328655 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-4e2e01db-dc0a-43b5-8a3d-dcc6c6324e2a tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] 10.222.0.33 "GET /compute/v2.1/servers/17f61077-3e1c-4d86-b364-b22e4e40b3ca" status: 200 len: 1391 microversion: 2.1 time: 0.328585 Oct 04 20:43:51.329366 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1181/2316] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:43:50 2022] GET /compute/v2.1/servers/17f61077-3e1c-4d86-b364-b22e4e40b3ca => generated 1391 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:43:51.735638 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-5707f4c5-4e74-4664-88ae-c7484a12f77b tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:51.736543 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-5707f4c5-4e74-4664-88ae-c7484a12f77b tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] [instance: c0a14e22-0620-4912-9893-62974c80978a] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:51.747964 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5707f4c5-4e74-4664-88ae-c7484a12f77b tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:51.748719 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5707f4c5-4e74-4664-88ae-c7484a12f77b tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:51.749313 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5707f4c5-4e74-4664-88ae-c7484a12f77b tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:51.750820 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5707f4c5-4e74-4664-88ae-c7484a12f77b tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:51.751434 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5707f4c5-4e74-4664-88ae-c7484a12f77b tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:51.752763 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5707f4c5-4e74-4664-88ae-c7484a12f77b tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:52.427776 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-5707f4c5-4e74-4664-88ae-c7484a12f77b tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28399882314945d787a3af6eb59935c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5392c67506f7445ab33d62b191558f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:52.454058 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-5707f4c5-4e74-4664-88ae-c7484a12f77b tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28399882314945d787a3af6eb59935c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5392c67506f7445ab33d62b191558f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:52.457642 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-5707f4c5-4e74-4664-88ae-c7484a12f77b tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28399882314945d787a3af6eb59935c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5392c67506f7445ab33d62b191558f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:52.462748 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-5707f4c5-4e74-4664-88ae-c7484a12f77b tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] 10.222.0.33 "GET /compute/v2.1/servers/c0a14e22-0620-4912-9893-62974c80978a" status: 200 len: 1879 microversion: 2.32 time: 0.732781 Oct 04 20:43:52.465648 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1182/2317] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:43:51 2022] GET /compute/v2.1/servers/c0a14e22-0620-4912-9893-62974c80978a => generated 1879 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:43:52.478980 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-611d7a9e-decb-4d80-8327-48eb0dbefbfa tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:52.480656 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-611d7a9e-decb-4d80-8327-48eb0dbefbfa tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] [instance: 17f61077-3e1c-4d86-b364-b22e4e40b3ca] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:52.496667 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-611d7a9e-decb-4d80-8327-48eb0dbefbfa tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:52.497564 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-611d7a9e-decb-4d80-8327-48eb0dbefbfa tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:52.499214 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-611d7a9e-decb-4d80-8327-48eb0dbefbfa tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:52.500188 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-611d7a9e-decb-4d80-8327-48eb0dbefbfa tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:52.502602 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-611d7a9e-decb-4d80-8327-48eb0dbefbfa tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:52.504183 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-611d7a9e-decb-4d80-8327-48eb0dbefbfa tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:53.446315 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.network.neutron [None req-5958fec5-2ff8-49a1-b80c-716dbd3c0967 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] [instance: 8ef51f7d-45b1-4d48-8611-5c7805f52d15] Building network info cache for instance {{(pid=128801) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 04 20:43:53.463589 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-611d7a9e-decb-4d80-8327-48eb0dbefbfa tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '800db3a57ada47eca381b00189fdbf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66ec8ea91b04deb90b679589e0495bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:53.478695 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-611d7a9e-decb-4d80-8327-48eb0dbefbfa tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] 10.222.0.33 "GET /compute/v2.1/servers/17f61077-3e1c-4d86-b364-b22e4e40b3ca" status: 200 len: 1391 microversion: 2.1 time: 1.010270 Oct 04 20:43:53.479326 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1183/2318] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:43:52 2022] GET /compute/v2.1/servers/17f61077-3e1c-4d86-b364-b22e4e40b3ca => generated 1391 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:43:53.515938 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-76dd540a-76f4-47bb-8a09-b59ff39a01cf tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:53.516638 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-76dd540a-76f4-47bb-8a09-b59ff39a01cf tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] [instance: d849cb42-dfe6-4225-814a-90bef2839739] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:53.535936 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-76dd540a-76f4-47bb-8a09-b59ff39a01cf tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:53.536306 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-76dd540a-76f4-47bb-8a09-b59ff39a01cf tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:53.538858 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-76dd540a-76f4-47bb-8a09-b59ff39a01cf tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:53.539635 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-76dd540a-76f4-47bb-8a09-b59ff39a01cf tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:53.541205 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-76dd540a-76f4-47bb-8a09-b59ff39a01cf tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:53.541802 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-76dd540a-76f4-47bb-8a09-b59ff39a01cf tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:53.608683 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-76dd540a-76f4-47bb-8a09-b59ff39a01cf tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] 10.222.0.33 "GET /compute/v2.1/servers/d849cb42-dfe6-4225-814a-90bef2839739/ips" status: 200 len: 149 microversion: 2.1 time: 0.109291 Oct 04 20:43:53.609472 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1184/2319] 10.222.0.33 () {58 vars in 1248 bytes} [Tue Oct 4 20:43:53 2022] GET /compute/v2.1/servers/d849cb42-dfe6-4225-814a-90bef2839739/ips => generated 149 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:43:53.624706 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-5ece6f40-0381-4a82-9508-21d69f97d29e req-5b0a3f2a-ec89-498f-a2f0-1b6d9823d798 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ef51f7d-45b1-4d48-8611-5c7805f52d15", "tag": "19434094-416b-42b5-95e8-2a04021d1e51"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:43:53.642956 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-5ece6f40-0381-4a82-9508-21d69f97d29e req-5b0a3f2a-ec89-498f-a2f0-1b6d9823d798 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:53.645461 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-5ece6f40-0381-4a82-9508-21d69f97d29e req-5b0a3f2a-ec89-498f-a2f0-1b6d9823d798 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:53.646170 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-5ece6f40-0381-4a82-9508-21d69f97d29e req-5b0a3f2a-ec89-498f-a2f0-1b6d9823d798 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:53.677229 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-5ece6f40-0381-4a82-9508-21d69f97d29e req-5b0a3f2a-ec89-498f-a2f0-1b6d9823d798 service nova] Creating event network-changed:19434094-416b-42b5-95e8-2a04021d1e51 for instance 8ef51f7d-45b1-4d48-8611-5c7805f52d15 on n-h1-854823-8 Oct 04 20:43:53.688883 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-5ece6f40-0381-4a82-9508-21d69f97d29e req-5b0a3f2a-ec89-498f-a2f0-1b6d9823d798 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076013 Oct 04 20:43:53.692425 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1185/2320] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:43:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:43:53.707483 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-8e941d36-c8b7-4118-8d8d-ab4b50a753c6 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:53.714459 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-8e941d36-c8b7-4118-8d8d-ab4b50a753c6 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] [instance: c0a14e22-0620-4912-9893-62974c80978a] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:53.725058 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8e941d36-c8b7-4118-8d8d-ab4b50a753c6 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:53.729327 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8e941d36-c8b7-4118-8d8d-ab4b50a753c6 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:53.730664 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8e941d36-c8b7-4118-8d8d-ab4b50a753c6 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:53.731828 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8e941d36-c8b7-4118-8d8d-ab4b50a753c6 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:53.732660 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8e941d36-c8b7-4118-8d8d-ab4b50a753c6 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:53.738965 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8e941d36-c8b7-4118-8d8d-ab4b50a753c6 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:55.079410 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-8e941d36-c8b7-4118-8d8d-ab4b50a753c6 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28399882314945d787a3af6eb59935c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5392c67506f7445ab33d62b191558f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:55.100578 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-8e941d36-c8b7-4118-8d8d-ab4b50a753c6 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28399882314945d787a3af6eb59935c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5392c67506f7445ab33d62b191558f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:55.109198 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-8e941d36-c8b7-4118-8d8d-ab4b50a753c6 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28399882314945d787a3af6eb59935c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5392c67506f7445ab33d62b191558f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:55.113729 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-8e941d36-c8b7-4118-8d8d-ab4b50a753c6 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] 10.222.0.33 "GET /compute/v2.1/servers/c0a14e22-0620-4912-9893-62974c80978a" status: 200 len: 1879 microversion: 2.32 time: 1.418327 Oct 04 20:43:55.115597 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1186/2321] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:43:53 2022] GET /compute/v2.1/servers/c0a14e22-0620-4912-9893-62974c80978a => generated 1879 bytes in 1422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:43:55.145480 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-1aa80871-0916-41b9-8ecb-dccf0ec329ab tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:55.148202 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-1aa80871-0916-41b9-8ecb-dccf0ec329ab tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] [instance: 17f61077-3e1c-4d86-b364-b22e4e40b3ca] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:55.164426 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1aa80871-0916-41b9-8ecb-dccf0ec329ab tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:55.167063 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1aa80871-0916-41b9-8ecb-dccf0ec329ab tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:55.169174 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1aa80871-0916-41b9-8ecb-dccf0ec329ab tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:55.173257 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1aa80871-0916-41b9-8ecb-dccf0ec329ab tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:55.173837 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1aa80871-0916-41b9-8ecb-dccf0ec329ab tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:55.174405 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1aa80871-0916-41b9-8ecb-dccf0ec329ab tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:56.375962 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.network.neutron [None req-5958fec5-2ff8-49a1-b80c-716dbd3c0967 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] [instance: 8ef51f7d-45b1-4d48-8611-5c7805f52d15] Updating instance_info_cache with network_info: [{"id": "19434094-416b-42b5-95e8-2a04021d1e51", "address": "fa:16:3e:88:e2:91", "network": {"id": "8041a123-3203-48c7-8a2d-6c4dad3abeb6", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1176833900-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "2f258cb1ecd049078b201eb41692735a", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap19434094-41", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128801) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 04 20:43:56.394056 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5958fec5-2ff8-49a1-b80c-716dbd3c0967 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Releasing lock "refresh_cache-8ef51f7d-45b1-4d48-8611-5c7805f52d15" {{(pid=128801) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 04 20:43:56.395613 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5958fec5-2ff8-49a1-b80c-716dbd3c0967 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] 10.222.0.33 "POST /compute/v2.1/servers/8ef51f7d-45b1-4d48-8611-5c7805f52d15/action" status: 202 len: 0 microversion: 2.1 time: 6.906427 Oct 04 20:43:56.396644 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1136/2322] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 20:43:49 2022] POST /compute/v2.1/servers/8ef51f7d-45b1-4d48-8611-5c7805f52d15/action => generated 0 bytes in 6908 msecs (HTTP/1.1 202) 9 headers in 369 bytes (2 switches on core 0) Oct 04 20:43:56.407650 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a95aaa27-ede3-4536-962d-add0b0df2852 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:56.408277 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a95aaa27-ede3-4536-962d-add0b0df2852 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] [instance: c0a14e22-0620-4912-9893-62974c80978a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:56.434253 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a95aaa27-ede3-4536-962d-add0b0df2852 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:56.435315 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a95aaa27-ede3-4536-962d-add0b0df2852 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:56.435911 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a95aaa27-ede3-4536-962d-add0b0df2852 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:56.436792 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a95aaa27-ede3-4536-962d-add0b0df2852 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:56.437411 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a95aaa27-ede3-4536-962d-add0b0df2852 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:56.437983 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a95aaa27-ede3-4536-962d-add0b0df2852 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:57.326673 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-1aa80871-0916-41b9-8ecb-dccf0ec329ab tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '800db3a57ada47eca381b00189fdbf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66ec8ea91b04deb90b679589e0495bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:57.343499 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-1aa80871-0916-41b9-8ecb-dccf0ec329ab tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] 10.222.0.33 "GET /compute/v2.1/servers/17f61077-3e1c-4d86-b364-b22e4e40b3ca" status: 200 len: 1391 microversion: 2.1 time: 2.221810 Oct 04 20:43:57.351001 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1187/2323] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:43:55 2022] GET /compute/v2.1/servers/17f61077-3e1c-4d86-b364-b22e4e40b3ca => generated 1391 bytes in 2230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:43:57.366575 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-2e3ee1ef-663c-488b-8ccf-40878fd32a4d tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:57.367429 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-2e3ee1ef-663c-488b-8ccf-40878fd32a4d tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] [instance: 8ef51f7d-45b1-4d48-8611-5c7805f52d15] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:57.390853 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2e3ee1ef-663c-488b-8ccf-40878fd32a4d tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:57.391515 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2e3ee1ef-663c-488b-8ccf-40878fd32a4d tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:57.392080 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2e3ee1ef-663c-488b-8ccf-40878fd32a4d tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:57.396708 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2e3ee1ef-663c-488b-8ccf-40878fd32a4d tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:57.400511 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2e3ee1ef-663c-488b-8ccf-40878fd32a4d tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:57.402948 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2e3ee1ef-663c-488b-8ccf-40878fd32a4d tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:57.514228 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-2e3ee1ef-663c-488b-8ccf-40878fd32a4d tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] [instance: 8ef51f7d-45b1-4d48-8611-5c7805f52d15] Going to try to terminate instance {{(pid=128802) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:43:57.693313 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-2e3ee1ef-663c-488b-8ccf-40878fd32a4d tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] 10.222.0.33 "DELETE /compute/v2.1/servers/8ef51f7d-45b1-4d48-8611-5c7805f52d15" status: 204 len: 0 microversion: 2.1 time: 0.339807 Oct 04 20:43:57.696921 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1188/2324] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 20:43:57 2022] DELETE /compute/v2.1/servers/8ef51f7d-45b1-4d48-8611-5c7805f52d15 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:43:57.704859 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-0653ea3a-3060-4540-95e6-e81fa9c347cf tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5b1a385d-80d1-4f7a-bf6d-29b6df8272f1"}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:43:57.708521 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-0653ea3a-3060-4540-95e6-e81fa9c347cf tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] [instance: d849cb42-dfe6-4225-814a-90bef2839739] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:57.717775 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-a95aaa27-ede3-4536-962d-add0b0df2852 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28399882314945d787a3af6eb59935c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5392c67506f7445ab33d62b191558f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:57.718675 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0653ea3a-3060-4540-95e6-e81fa9c347cf tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:57.719620 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0653ea3a-3060-4540-95e6-e81fa9c347cf tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:57.720617 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0653ea3a-3060-4540-95e6-e81fa9c347cf tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:57.722482 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0653ea3a-3060-4540-95e6-e81fa9c347cf tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:57.723305 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0653ea3a-3060-4540-95e6-e81fa9c347cf tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:57.723954 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0653ea3a-3060-4540-95e6-e81fa9c347cf tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:57.736979 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-a95aaa27-ede3-4536-962d-add0b0df2852 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28399882314945d787a3af6eb59935c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5392c67506f7445ab33d62b191558f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:57.740438 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-a95aaa27-ede3-4536-962d-add0b0df2852 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28399882314945d787a3af6eb59935c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5392c67506f7445ab33d62b191558f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:57.741809 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a95aaa27-ede3-4536-962d-add0b0df2852 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] 10.222.0.33 "GET /compute/v2.1/servers/c0a14e22-0620-4912-9893-62974c80978a" status: 200 len: 1879 microversion: 2.32 time: 1.341252 Oct 04 20:43:57.746488 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1137/2325] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:43:56 2022] GET /compute/v2.1/servers/c0a14e22-0620-4912-9893-62974c80978a => generated 1879 bytes in 1349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:43:57.767941 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b90c7312-9f24-419e-9ea7-af8cbd59c284 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.4.187"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:43:57.771232 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b90c7312-9f24-419e-9ea7-af8cbd59c284 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] [instance: 659f073c-b8c2-48d3-8c09-fef755291460] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:57.781049 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b90c7312-9f24-419e-9ea7-af8cbd59c284 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:57.781795 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b90c7312-9f24-419e-9ea7-af8cbd59c284 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:57.783071 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b90c7312-9f24-419e-9ea7-af8cbd59c284 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:57.784115 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b90c7312-9f24-419e-9ea7-af8cbd59c284 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:57.784746 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b90c7312-9f24-419e-9ea7-af8cbd59c284 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:57.785340 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b90c7312-9f24-419e-9ea7-af8cbd59c284 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:57.858575 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b90c7312-9f24-419e-9ea7-af8cbd59c284 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Acquiring lock "refresh_cache-659f073c-b8c2-48d3-8c09-fef755291460" {{(pid=128801) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 04 20:43:57.860175 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b90c7312-9f24-419e-9ea7-af8cbd59c284 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Acquired lock "refresh_cache-659f073c-b8c2-48d3-8c09-fef755291460" {{(pid=128801) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 04 20:43:58.215746 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-0653ea3a-3060-4540-95e6-e81fa9c347cf tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] 10.222.0.33 "POST /compute/v2.1/servers/d849cb42-dfe6-4225-814a-90bef2839739/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.514069 Oct 04 20:43:58.217256 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1189/2326] 10.222.0.33 () {60 vars in 1323 bytes} [Tue Oct 4 20:43:57 2022] POST /compute/v2.1/servers/d849cb42-dfe6-4225-814a-90bef2839739/os-volume_attachments => generated 194 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:43:58.386996 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-a4681016-e5e7-4926-8bae-be43e91da2d5 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:58.387827 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-a4681016-e5e7-4926-8bae-be43e91da2d5 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] [instance: 17f61077-3e1c-4d86-b364-b22e4e40b3ca] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:58.400844 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a4681016-e5e7-4926-8bae-be43e91da2d5 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:58.402393 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a4681016-e5e7-4926-8bae-be43e91da2d5 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:58.403136 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a4681016-e5e7-4926-8bae-be43e91da2d5 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:58.404393 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a4681016-e5e7-4926-8bae-be43e91da2d5 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:58.405883 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a4681016-e5e7-4926-8bae-be43e91da2d5 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:58.406705 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a4681016-e5e7-4926-8bae-be43e91da2d5 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:59.199872 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-a4681016-e5e7-4926-8bae-be43e91da2d5 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '800db3a57ada47eca381b00189fdbf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66ec8ea91b04deb90b679589e0495bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:59.211994 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-a4681016-e5e7-4926-8bae-be43e91da2d5 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] 10.222.0.33 "GET /compute/v2.1/servers/17f61077-3e1c-4d86-b364-b22e4e40b3ca" status: 200 len: 1381 microversion: 2.1 time: 0.834401 Oct 04 20:43:59.215053 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1190/2327] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:43:58 2022] GET /compute/v2.1/servers/17f61077-3e1c-4d86-b364-b22e4e40b3ca => generated 1381 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:43:59.223858 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-bc66a663-c876-43e6-9e96-05b3cfb6052a tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:59.233335 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-bc66a663-c876-43e6-9e96-05b3cfb6052a tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] [instance: c0a14e22-0620-4912-9893-62974c80978a] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:43:59.241379 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bc66a663-c876-43e6-9e96-05b3cfb6052a tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:59.241885 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bc66a663-c876-43e6-9e96-05b3cfb6052a tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:59.242328 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bc66a663-c876-43e6-9e96-05b3cfb6052a tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:59.243086 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bc66a663-c876-43e6-9e96-05b3cfb6052a tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:59.243536 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bc66a663-c876-43e6-9e96-05b3cfb6052a tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:59.249465 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bc66a663-c876-43e6-9e96-05b3cfb6052a tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:43:59.933995 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-bc66a663-c876-43e6-9e96-05b3cfb6052a tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28399882314945d787a3af6eb59935c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5392c67506f7445ab33d62b191558f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:59.956152 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-bc66a663-c876-43e6-9e96-05b3cfb6052a tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28399882314945d787a3af6eb59935c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5392c67506f7445ab33d62b191558f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:59.960502 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-bc66a663-c876-43e6-9e96-05b3cfb6052a tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28399882314945d787a3af6eb59935c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5392c67506f7445ab33d62b191558f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:43:59.963149 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-bc66a663-c876-43e6-9e96-05b3cfb6052a tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] 10.222.0.33 "GET /compute/v2.1/servers/c0a14e22-0620-4912-9893-62974c80978a" status: 200 len: 1879 microversion: 2.32 time: 0.746042 Oct 04 20:43:59.975544 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1191/2328] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:43:59 2022] GET /compute/v2.1/servers/c0a14e22-0620-4912-9893-62974c80978a => generated 1879 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:43:59.991213 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-0615abc3-d25e-4c99-bb93-a593e7e6e52a tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] Calling method '.version_select at 0x7f3c7885c9d0>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:43:59.995136 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0615abc3-d25e-4c99-bb93-a593e7e6e52a tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:43:59.997071 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0615abc3-d25e-4c99-bb93-a593e7e6e52a tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:43:59.997626 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0615abc3-d25e-4c99-bb93-a593e7e6e52a tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:00.009291 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-0615abc3-d25e-4c99-bb93-a593e7e6e52a tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] 10.222.0.33 "GET /compute/v2.1/os-migrations" status: 200 len: 1552 microversion: 2.1 time: 0.032477 Oct 04 20:44:00.010219 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1192/2329] 10.222.0.33 () {58 vars in 1143 bytes} [Tue Oct 4 20:43:59 2022] GET /compute/v2.1/os-migrations => generated 1552 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:44:00.020155 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-a8b3c144-f64a-48cf-a8e8-bcbe028c3116 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-2021291055", "imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63", "flavorRef": "452", "networks": [{"uuid": "73e1d038-0f3d-4226-9405-918ec0486811"}, {"uuid": "29d7e2d9-ac2a-4a1d-9f2d-75bae2991d48"}]}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:44:00.095143 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.network.neutron [None req-a8b3c144-f64a-48cf-a8e8-bcbe028c3116 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] validate_networks() for [('73e1d038-0f3d-4226-9405-918ec0486811', None, None, None, None, None), ('29d7e2d9-ac2a-4a1d-9f2d-75bae2991d48', None, None, None, None, None)] {{(pid=128802) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:44:03.034898 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.network.neutron [None req-b90c7312-9f24-419e-9ea7-af8cbd59c284 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] [instance: 659f073c-b8c2-48d3-8c09-fef755291460] Building network info cache for instance {{(pid=128801) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 04 20:44:04.197917 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-a8b3c144-f64a-48cf-a8e8-bcbe028c3116 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Flavor limits 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:44:04.199177 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-a8b3c144-f64a-48cf-a8e8-bcbe028c3116 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Image limits 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:44:04.199655 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-a8b3c144-f64a-48cf-a8e8-bcbe028c3116 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Flavor pref 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:44:04.200190 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-a8b3c144-f64a-48cf-a8e8-bcbe028c3116 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Image pref 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:44:04.200612 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-a8b3c144-f64a-48cf-a8e8-bcbe028c3116 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:44:04.225155 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a8b3c144-f64a-48cf-a8e8-bcbe028c3116 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:04.225661 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a8b3c144-f64a-48cf-a8e8-bcbe028c3116 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:04.232850 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a8b3c144-f64a-48cf-a8e8-bcbe028c3116 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:04.233704 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a8b3c144-f64a-48cf-a8e8-bcbe028c3116 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:04.234192 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a8b3c144-f64a-48cf-a8e8-bcbe028c3116 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:04.234658 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a8b3c144-f64a-48cf-a8e8-bcbe028c3116 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:04.326514 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-a8b3c144-f64a-48cf-a8e8-bcbe028c3116 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Getting quotas for project a6a44744f2bb4130b9a49065b49cf854. Resources: {'ram', 'instances', 'cores'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:44:04.335200 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-a8b3c144-f64a-48cf-a8e8-bcbe028c3116 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Getting quotas for user e3e1e240b20e41e8b90e0d630e0d6b46 and project a6a44744f2bb4130b9a49065b49cf854. Resources: {'ram', 'instances', 'cores'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:44:04.368181 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-a8b3c144-f64a-48cf-a8e8-bcbe028c3116 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Going to run 1 instances... {{(pid=128802) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:44:04.372667 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-a8b3c144-f64a-48cf-a8e8-bcbe028c3116 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] [instance: c147993c-5773-4b76-93bc-62c0cbb6044a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='15b24725-0c99-4bcf-b1fb-907cdf8e2d63',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128802) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:44:04.540002 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-a8b3c144-f64a-48cf-a8e8-bcbe028c3116 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.528081 Oct 04 20:44:04.551552 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1193/2330] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 20:44:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 4541 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 20:44:04.563550 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-70a51758-f7ab-45eb-823e-9048fa0eaa42 tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:44:04.564183 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-70a51758-f7ab-45eb-823e-9048fa0eaa42 tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] [instance: 17f61077-3e1c-4d86-b364-b22e4e40b3ca] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:44:04.574329 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-70a51758-f7ab-45eb-823e-9048fa0eaa42 tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:04.575050 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-70a51758-f7ab-45eb-823e-9048fa0eaa42 tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:04.575692 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-70a51758-f7ab-45eb-823e-9048fa0eaa42 tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:04.615892 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-70a51758-f7ab-45eb-823e-9048fa0eaa42 tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:04.617833 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-70a51758-f7ab-45eb-823e-9048fa0eaa42 tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.041s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:04.618478 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-70a51758-f7ab-45eb-823e-9048fa0eaa42 tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:04.627120 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:44:05.678197 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-70a51758-f7ab-45eb-823e-9048fa0eaa42 tempest-LiveMigrationTest-1433397858 tempest-LiveMigrationTest-1433397858-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/17f61077-3e1c-4d86-b364-b22e4e40b3ca" status: 200 len: 1532 microversion: 2.1 time: 1.125338 Oct 04 20:44:05.682555 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1194/2331] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:44:04 2022] GET /compute/v2.1/servers/17f61077-3e1c-4d86-b364-b22e4e40b3ca => generated 1532 bytes in 1130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:44:05.697328 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-3f4267bb-3192-4fca-a3e0-684dcf6188ae tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:44:05.698607 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-3f4267bb-3192-4fca-a3e0-684dcf6188ae tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] [instance: c0a14e22-0620-4912-9893-62974c80978a] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:44:05.712620 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3f4267bb-3192-4fca-a3e0-684dcf6188ae tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:05.715877 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3f4267bb-3192-4fca-a3e0-684dcf6188ae tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:05.716477 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3f4267bb-3192-4fca-a3e0-684dcf6188ae tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:05.717615 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3f4267bb-3192-4fca-a3e0-684dcf6188ae tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:05.720096 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3f4267bb-3192-4fca-a3e0-684dcf6188ae tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:05.720703 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3f4267bb-3192-4fca-a3e0-684dcf6188ae tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:06.962115 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.network.neutron [None req-b90c7312-9f24-419e-9ea7-af8cbd59c284 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] [instance: 659f073c-b8c2-48d3-8c09-fef755291460] Updating instance_info_cache with network_info: [{"id": "267a2eeb-d782-40d7-865d-522dfe433aa5", "address": "fa:16:3e:1a:0b:04", "network": {"id": "8041a123-3203-48c7-8a2d-6c4dad3abeb6", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1176833900-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.4.187", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "2f258cb1ecd049078b201eb41692735a", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap267a2eeb-d7", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128801) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 04 20:44:06.989847 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b90c7312-9f24-419e-9ea7-af8cbd59c284 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Releasing lock "refresh_cache-659f073c-b8c2-48d3-8c09-fef755291460" {{(pid=128801) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 04 20:44:06.991197 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b90c7312-9f24-419e-9ea7-af8cbd59c284 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] 10.222.0.33 "POST /compute/v2.1/servers/659f073c-b8c2-48d3-8c09-fef755291460/action" status: 202 len: 0 microversion: 2.1 time: 9.243408 Oct 04 20:44:06.992145 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1138/2332] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 20:43:57 2022] POST /compute/v2.1/servers/659f073c-b8c2-48d3-8c09-fef755291460/action => generated 0 bytes in 9245 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 04 20:44:06.999384 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-23494198-37fe-40c1-84c1-13a2d22d8773 req-f27a8e40-0fd2-4a5a-8479-51ec5fc16e88 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "659f073c-b8c2-48d3-8c09-fef755291460", "tag": "267a2eeb-d782-40d7-865d-522dfe433aa5"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:44:07.022572 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=77,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:44:07.038389 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-23494198-37fe-40c1-84c1-13a2d22d8773 req-f27a8e40-0fd2-4a5a-8479-51ec5fc16e88 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:07.039367 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-23494198-37fe-40c1-84c1-13a2d22d8773 req-f27a8e40-0fd2-4a5a-8479-51ec5fc16e88 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:07.039998 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-23494198-37fe-40c1-84c1-13a2d22d8773 req-f27a8e40-0fd2-4a5a-8479-51ec5fc16e88 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:07.068921 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-23494198-37fe-40c1-84c1-13a2d22d8773 req-f27a8e40-0fd2-4a5a-8479-51ec5fc16e88 service nova] Creating event network-changed:267a2eeb-d782-40d7-865d-522dfe433aa5 for instance 659f073c-b8c2-48d3-8c09-fef755291460 on n-h2-854823-8 Oct 04 20:44:07.084954 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-23494198-37fe-40c1-84c1-13a2d22d8773 req-f27a8e40-0fd2-4a5a-8479-51ec5fc16e88 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091404 Oct 04 20:44:07.085911 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1139/2333] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:44:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:44:07.261211 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-3f4267bb-3192-4fca-a3e0-684dcf6188ae tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28399882314945d787a3af6eb59935c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5392c67506f7445ab33d62b191558f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:44:07.293568 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-3f4267bb-3192-4fca-a3e0-684dcf6188ae tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28399882314945d787a3af6eb59935c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5392c67506f7445ab33d62b191558f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:44:07.305459 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-3f4267bb-3192-4fca-a3e0-684dcf6188ae tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28399882314945d787a3af6eb59935c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5392c67506f7445ab33d62b191558f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:44:07.306783 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-3f4267bb-3192-4fca-a3e0-684dcf6188ae tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] 10.222.0.33 "GET /compute/v2.1/servers/c0a14e22-0620-4912-9893-62974c80978a" status: 200 len: 1879 microversion: 2.32 time: 1.622228 Oct 04 20:44:07.321499 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1195/2334] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:44:05 2022] GET /compute/v2.1/servers/c0a14e22-0620-4912-9893-62974c80978a => generated 1879 bytes in 1638 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:44:07.354051 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-3ace2ce0-ec92-4385-9304-53bb63e4c28e tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:44:07.365598 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-3ace2ce0-ec92-4385-9304-53bb63e4c28e tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] [instance: c147993c-5773-4b76-93bc-62c0cbb6044a] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:44:07.398470 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3ace2ce0-ec92-4385-9304-53bb63e4c28e tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:07.398975 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3ace2ce0-ec92-4385-9304-53bb63e4c28e tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:07.399425 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3ace2ce0-ec92-4385-9304-53bb63e4c28e tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:07.400162 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3ace2ce0-ec92-4385-9304-53bb63e4c28e tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:07.413970 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3ace2ce0-ec92-4385-9304-53bb63e4c28e tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:07.422189 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3ace2ce0-ec92-4385-9304-53bb63e4c28e tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:07.783165 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-3ace2ce0-ec92-4385-9304-53bb63e4c28e tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e1e240b20e41e8b90e0d630e0d6b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a44744f2bb4130b9a49065b49cf854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:44:07.795539 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-3ace2ce0-ec92-4385-9304-53bb63e4c28e tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] 10.222.0.33 "GET /compute/v2.1/servers/c147993c-5773-4b76-93bc-62c0cbb6044a" status: 200 len: 1273 microversion: 2.1 time: 0.472872 Oct 04 20:44:07.799671 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1196/2335] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:44:07 2022] GET /compute/v2.1/servers/c147993c-5773-4b76-93bc-62c0cbb6044a => generated 1273 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:44:07.811204 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-fb5d4795-aa51-42f1-816e-66524ae6b100 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:44:07.811932 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-fb5d4795-aa51-42f1-816e-66524ae6b100 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] [instance: 17f61077-3e1c-4d86-b364-b22e4e40b3ca] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:44:07.839772 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fb5d4795-aa51-42f1-816e-66524ae6b100 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:07.840355 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fb5d4795-aa51-42f1-816e-66524ae6b100 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:07.840927 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fb5d4795-aa51-42f1-816e-66524ae6b100 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:07.841507 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fb5d4795-aa51-42f1-816e-66524ae6b100 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:07.841955 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fb5d4795-aa51-42f1-816e-66524ae6b100 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:07.843274 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fb5d4795-aa51-42f1-816e-66524ae6b100 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:07.938089 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-fb5d4795-aa51-42f1-816e-66524ae6b100 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] [instance: 17f61077-3e1c-4d86-b364-b22e4e40b3ca] Going to try to terminate instance {{(pid=128802) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:44:07.945302 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1499630c-db90-40c8-b352-faaf51f73c5c tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-\u20a1-1133383291", "imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63", "flavorRef": "452", "networks": [{"uuid": "a32beee4-b00b-48d9-8656-e7b824aeffce"}]}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:44:08.048557 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.network.neutron [None req-1499630c-db90-40c8-b352-faaf51f73c5c tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] validate_networks() for [('a32beee4-b00b-48d9-8656-e7b824aeffce', None, None, None, None, None)] {{(pid=128801) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:44:08.172117 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-fb5d4795-aa51-42f1-816e-66524ae6b100 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] 10.222.0.33 "DELETE /compute/v2.1/servers/17f61077-3e1c-4d86-b364-b22e4e40b3ca" status: 204 len: 0 microversion: 2.1 time: 0.370868 Oct 04 20:44:08.172984 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1197/2336] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 20:44:07 2022] DELETE /compute/v2.1/servers/17f61077-3e1c-4d86-b364-b22e4e40b3ca => generated 0 bytes in 373 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:44:08.179369 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-9b2b2c36-62d0-494d-a0d9-91cf2a478149 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Calling method '.version_select at 0x7f3c789ee430>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:44:08.847100 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-9b2b2c36-62d0-494d-a0d9-91cf2a478149 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] 10.222.0.33 "GET /compute/v2.1/os-floating-ips/ffd78ef7-a042-4aa3-a55f-e9372d50057c" status: 200 len: 184 microversion: 2.1 time: 0.672617 Oct 04 20:44:08.850179 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1198/2337] 10.222.0.33 () {58 vars in 1260 bytes} [Tue Oct 4 20:44:08 2022] GET /compute/v2.1/os-floating-ips/ffd78ef7-a042-4aa3-a55f-e9372d50057c => generated 184 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:44:08.861913 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-8b5a059c-1571-44b2-847c-b0328f50257b tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:44:08.862934 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-8b5a059c-1571-44b2-847c-b0328f50257b tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] [instance: 17f61077-3e1c-4d86-b364-b22e4e40b3ca] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:44:08.884016 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8b5a059c-1571-44b2-847c-b0328f50257b tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:08.884781 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8b5a059c-1571-44b2-847c-b0328f50257b tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:08.886076 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8b5a059c-1571-44b2-847c-b0328f50257b tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:08.887328 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8b5a059c-1571-44b2-847c-b0328f50257b tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:08.887923 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8b5a059c-1571-44b2-847c-b0328f50257b tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:08.888478 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8b5a059c-1571-44b2-847c-b0328f50257b tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:09.493442 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-8b5a059c-1571-44b2-847c-b0328f50257b tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '800db3a57ada47eca381b00189fdbf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66ec8ea91b04deb90b679589e0495bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:44:09.503582 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-8b5a059c-1571-44b2-847c-b0328f50257b tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] 10.222.0.33 "GET /compute/v2.1/servers/17f61077-3e1c-4d86-b364-b22e4e40b3ca" status: 200 len: 1387 microversion: 2.1 time: 0.651747 Oct 04 20:44:09.504769 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1199/2338] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:44:08 2022] GET /compute/v2.1/servers/17f61077-3e1c-4d86-b364-b22e4e40b3ca => generated 1387 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:44:09.511086 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-3796d3f9-5695-4d19-9f49-d6bf0b4c5400 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:44:09.512577 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-3796d3f9-5695-4d19-9f49-d6bf0b4c5400 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] [instance: c0a14e22-0620-4912-9893-62974c80978a] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:44:09.520217 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3796d3f9-5695-4d19-9f49-d6bf0b4c5400 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:09.521129 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3796d3f9-5695-4d19-9f49-d6bf0b4c5400 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:09.521710 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3796d3f9-5695-4d19-9f49-d6bf0b4c5400 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:09.522617 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3796d3f9-5695-4d19-9f49-d6bf0b4c5400 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:09.523326 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3796d3f9-5695-4d19-9f49-d6bf0b4c5400 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:09.523897 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3796d3f9-5695-4d19-9f49-d6bf0b4c5400 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:10.744423 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-3796d3f9-5695-4d19-9f49-d6bf0b4c5400 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28399882314945d787a3af6eb59935c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5392c67506f7445ab33d62b191558f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:44:10.762245 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-1499630c-db90-40c8-b352-faaf51f73c5c tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Flavor limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:44:10.762726 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-1499630c-db90-40c8-b352-faaf51f73c5c tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Image limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:44:10.763835 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-1499630c-db90-40c8-b352-faaf51f73c5c tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Flavor pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:44:10.764272 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-1499630c-db90-40c8-b352-faaf51f73c5c tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Image pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:44:10.764698 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-1499630c-db90-40c8-b352-faaf51f73c5c tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:44:10.766669 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-3796d3f9-5695-4d19-9f49-d6bf0b4c5400 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28399882314945d787a3af6eb59935c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5392c67506f7445ab33d62b191558f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:44:10.768383 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-3796d3f9-5695-4d19-9f49-d6bf0b4c5400 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28399882314945d787a3af6eb59935c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5392c67506f7445ab33d62b191558f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:44:10.769613 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-3796d3f9-5695-4d19-9f49-d6bf0b4c5400 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] 10.222.0.33 "GET /compute/v2.1/servers/c0a14e22-0620-4912-9893-62974c80978a" status: 200 len: 1879 microversion: 2.32 time: 1.263671 Oct 04 20:44:10.775208 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1200/2339] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:44:09 2022] GET /compute/v2.1/servers/c0a14e22-0620-4912-9893-62974c80978a => generated 1879 bytes in 1270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:44:10.789215 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1499630c-db90-40c8-b352-faaf51f73c5c tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:10.795013 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1499630c-db90-40c8-b352-faaf51f73c5c tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:10.795732 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1499630c-db90-40c8-b352-faaf51f73c5c tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:10.802686 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1499630c-db90-40c8-b352-faaf51f73c5c tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:10.802878 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-e925da24-a0e4-49b5-a5e2-d709aa848699 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:44:10.803553 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-e925da24-a0e4-49b5-a5e2-d709aa848699 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] [instance: c147993c-5773-4b76-93bc-62c0cbb6044a] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:44:10.804837 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1499630c-db90-40c8-b352-faaf51f73c5c tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:10.805475 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1499630c-db90-40c8-b352-faaf51f73c5c tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:10.818759 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e925da24-a0e4-49b5-a5e2-d709aa848699 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:10.819059 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e925da24-a0e4-49b5-a5e2-d709aa848699 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:10.830370 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e925da24-a0e4-49b5-a5e2-d709aa848699 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:10.831232 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e925da24-a0e4-49b5-a5e2-d709aa848699 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:10.831821 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e925da24-a0e4-49b5-a5e2-d709aa848699 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:10.832134 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e925da24-a0e4-49b5-a5e2-d709aa848699 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:10.881426 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-1499630c-db90-40c8-b352-faaf51f73c5c tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Getting quotas for project 7097bc12179446f6a3e1fac8434d5c64. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:44:10.897361 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-1499630c-db90-40c8-b352-faaf51f73c5c tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Getting quotas for user 87dcc7baf63f4ae6bfe0a099adffd408 and project 7097bc12179446f6a3e1fac8434d5c64. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:44:10.934178 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-1499630c-db90-40c8-b352-faaf51f73c5c tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Going to run 1 instances... {{(pid=128801) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:44:10.937705 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-1499630c-db90-40c8-b352-faaf51f73c5c tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] [instance: 0f127014-9e6f-47e6-b8a5-94ca91e0836c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='15b24725-0c99-4bcf-b1fb-907cdf8e2d63',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128801) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:44:11.121105 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-1499630c-db90-40c8-b352-faaf51f73c5c tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.027139 Oct 04 20:44:11.137776 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1140/2340] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 20:44:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 4051 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 20:44:11.149600 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-98d80a8d-b2fb-40d5-bf64-cfd3368339ac tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.4.187"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:44:11.238264 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-e925da24-a0e4-49b5-a5e2-d709aa848699 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e1e240b20e41e8b90e0d630e0d6b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a44744f2bb4130b9a49065b49cf854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:44:11.253032 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-e925da24-a0e4-49b5-a5e2-d709aa848699 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] 10.222.0.33 "GET /compute/v2.1/servers/c147993c-5773-4b76-93bc-62c0cbb6044a" status: 200 len: 1313 microversion: 2.1 time: 0.476439 Oct 04 20:44:11.253875 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1201/2341] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:44:10 2022] GET /compute/v2.1/servers/c147993c-5773-4b76-93bc-62c0cbb6044a => generated 1313 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:44:11.261821 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-5d1988af-967c-485f-9b95-06925c48a890 req-d7c12fd6-989a-4bbe-9e79-d2fdfd77ef68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ef51f7d-45b1-4d48-8611-5c7805f52d15", "name": "network-vif-deleted", "tag": "19434094-416b-42b5-95e8-2a04021d1e51"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:44:11.310802 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-5d1988af-967c-485f-9b95-06925c48a890 req-d7c12fd6-989a-4bbe-9e79-d2fdfd77ef68 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:11.311639 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-5d1988af-967c-485f-9b95-06925c48a890 req-d7c12fd6-989a-4bbe-9e79-d2fdfd77ef68 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:11.313045 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-5d1988af-967c-485f-9b95-06925c48a890 req-d7c12fd6-989a-4bbe-9e79-d2fdfd77ef68 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:11.367146 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-5d1988af-967c-485f-9b95-06925c48a890 req-d7c12fd6-989a-4bbe-9e79-d2fdfd77ef68 service nova] Creating event network-vif-deleted:19434094-416b-42b5-95e8-2a04021d1e51 for instance 8ef51f7d-45b1-4d48-8611-5c7805f52d15 on n-h1-854823-8 Oct 04 20:44:11.384499 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-5d1988af-967c-485f-9b95-06925c48a890 req-d7c12fd6-989a-4bbe-9e79-d2fdfd77ef68 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121678 Oct 04 20:44:11.387463 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1202/2342] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:44:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:44:11.443682 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-98d80a8d-b2fb-40d5-bf64-cfd3368339ac tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] [instance: 659f073c-b8c2-48d3-8c09-fef755291460] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:44:11.458939 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-98d80a8d-b2fb-40d5-bf64-cfd3368339ac tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:11.459769 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-98d80a8d-b2fb-40d5-bf64-cfd3368339ac tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:11.460226 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-98d80a8d-b2fb-40d5-bf64-cfd3368339ac tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:11.460971 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-98d80a8d-b2fb-40d5-bf64-cfd3368339ac tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:11.461417 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-98d80a8d-b2fb-40d5-bf64-cfd3368339ac tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:11.461845 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-98d80a8d-b2fb-40d5-bf64-cfd3368339ac tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:11.499153 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=94,nova_cell1:SAVEPOINT=2,nova_cell1:UPDATE=2,nova_cell1:RELEASE=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:44:11.711746 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-90cc0973-d0c9-4672-b851-9d8a167479d4 tempest-QuotaClassesAdminTestJSON-1567535924 tempest-QuotaClassesAdminTestJSON-1567535924-project-admin] Calling method '.version_select at 0x7f3c7888d3a0>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:44:11.779306 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-90cc0973-d0c9-4672-b851-9d8a167479d4 tempest-QuotaClassesAdminTestJSON-1567535924 tempest-QuotaClassesAdminTestJSON-1567535924-project-admin] 10.222.0.33 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 303 microversion: 2.1 time: 0.385311 Oct 04 20:44:11.780885 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1203/2343] 10.222.0.33 () {58 vars in 1185 bytes} [Tue Oct 4 20:44:11 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 303 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:44:11.817388 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-695bd32f-b33e-41c5-89d6-c004247208c1 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:44:11.831351 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-695bd32f-b33e-41c5-89d6-c004247208c1 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] [instance: 17f61077-3e1c-4d86-b364-b22e4e40b3ca] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:44:11.849001 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-695bd32f-b33e-41c5-89d6-c004247208c1 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:11.855106 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-695bd32f-b33e-41c5-89d6-c004247208c1 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:11.856613 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-695bd32f-b33e-41c5-89d6-c004247208c1 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:11.858067 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-695bd32f-b33e-41c5-89d6-c004247208c1 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:11.858680 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-695bd32f-b33e-41c5-89d6-c004247208c1 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:11.862651 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-695bd32f-b33e-41c5-89d6-c004247208c1 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:12.040914 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-98d80a8d-b2fb-40d5-bf64-cfd3368339ac tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Acquiring lock "refresh_cache-659f073c-b8c2-48d3-8c09-fef755291460" {{(pid=128801) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 04 20:44:12.041944 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-98d80a8d-b2fb-40d5-bf64-cfd3368339ac tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Acquired lock "refresh_cache-659f073c-b8c2-48d3-8c09-fef755291460" {{(pid=128801) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 04 20:44:12.046145 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-695bd32f-b33e-41c5-89d6-c004247208c1 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '800db3a57ada47eca381b00189fdbf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66ec8ea91b04deb90b679589e0495bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:44:12.054146 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-695bd32f-b33e-41c5-89d6-c004247208c1 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] 10.222.0.33 "GET /compute/v2.1/servers/17f61077-3e1c-4d86-b364-b22e4e40b3ca" status: 200 len: 1182 microversion: 2.1 time: 0.269188 Oct 04 20:44:12.078529 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1204/2344] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:44:11 2022] GET /compute/v2.1/servers/17f61077-3e1c-4d86-b364-b22e4e40b3ca => generated 1182 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:44:12.230919 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-95571a0d-65ff-4eaf-95c9-7967a91e46bc req-f86c3efd-3c31-446c-831b-369545bdc68e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0a14e22-0620-4912-9893-62974c80978a", "name": "network-vif-plugged", "status": "completed", "tag": "24c541fa-d6dd-41ae-99d3-45a43da2f893"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:44:12.241699 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-95571a0d-65ff-4eaf-95c9-7967a91e46bc req-f86c3efd-3c31-446c-831b-369545bdc68e service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:12.247604 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-95571a0d-65ff-4eaf-95c9-7967a91e46bc req-f86c3efd-3c31-446c-831b-369545bdc68e service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:12.248322 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-95571a0d-65ff-4eaf-95c9-7967a91e46bc req-f86c3efd-3c31-446c-831b-369545bdc68e service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:12.285288 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-95571a0d-65ff-4eaf-95c9-7967a91e46bc req-f86c3efd-3c31-446c-831b-369545bdc68e service nova] Creating event network-vif-plugged:24c541fa-d6dd-41ae-99d3-45a43da2f893 for instance c0a14e22-0620-4912-9893-62974c80978a on n-h1-854823-8 Oct 04 20:44:12.295765 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-95571a0d-65ff-4eaf-95c9-7967a91e46bc req-f86c3efd-3c31-446c-831b-369545bdc68e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.211985 Oct 04 20:44:12.296908 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1205/2345] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:44:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:44:12.308342 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-49714c89-4bd8-4e1a-b937-eb37e5cfef88 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:44:12.314507 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-49714c89-4bd8-4e1a-b937-eb37e5cfef88 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] [instance: 0f127014-9e6f-47e6-b8a5-94ca91e0836c] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:44:12.469348 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-49714c89-4bd8-4e1a-b937-eb37e5cfef88 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87dcc7baf63f4ae6bfe0a099adffd408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7097bc12179446f6a3e1fac8434d5c64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:44:12.476904 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-49714c89-4bd8-4e1a-b937-eb37e5cfef88 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] 10.222.0.33 "GET /compute/v2.1/servers/0f127014-9e6f-47e6-b8a5-94ca91e0836c" status: 200 len: 1193 microversion: 2.1 time: 0.178493 Oct 04 20:44:12.481599 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1206/2346] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:44:12 2022] GET /compute/v2.1/servers/0f127014-9e6f-47e6-b8a5-94ca91e0836c => generated 1193 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:44:12.486590 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-9bdc4f41-fb1d-46a6-bbc8-52de39a95751 tempest-QuotaClassesAdminTestJSON-1567535924 tempest-QuotaClassesAdminTestJSON-1567535924-project-admin] Action: 'update', calling method: .version_select at 0x7f3c7888d310>, body: {"quota_class_set": {"cores": 120, "fixed_ips": 99, "floating_ips": 99, "injected_file_content_bytes": 10340, "injected_file_path_bytes": 355, "injected_files": 105, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "security_group_rules": 99, "security_groups": 99}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:44:12.780193 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_api:SELECT=88,nova_api:UPDATE=6,nova_api:INSERT=6 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:44:13.303724 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-9bdc4f41-fb1d-46a6-bbc8-52de39a95751 tempest-QuotaClassesAdminTestJSON-1567535924 tempest-QuotaClassesAdminTestJSON-1567535924-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 290 microversion: 2.1 time: 0.820693 Oct 04 20:44:13.318663 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1207/2347] 10.222.0.33 () {60 vars in 1206 bytes} [Tue Oct 4 20:44:12 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 290 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:44:13.327983 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-8a09ee45-5216-48c6-ac22-6f9aaa1e1f68 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:44:13.328601 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-8a09ee45-5216-48c6-ac22-6f9aaa1e1f68 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] [instance: c0a14e22-0620-4912-9893-62974c80978a] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:44:13.348769 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8a09ee45-5216-48c6-ac22-6f9aaa1e1f68 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:13.349268 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8a09ee45-5216-48c6-ac22-6f9aaa1e1f68 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:13.349694 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8a09ee45-5216-48c6-ac22-6f9aaa1e1f68 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:13.350428 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8a09ee45-5216-48c6-ac22-6f9aaa1e1f68 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:13.350885 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8a09ee45-5216-48c6-ac22-6f9aaa1e1f68 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:13.351314 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8a09ee45-5216-48c6-ac22-6f9aaa1e1f68 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:13.997157 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.network.neutron [None req-98d80a8d-b2fb-40d5-bf64-cfd3368339ac tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] [instance: 659f073c-b8c2-48d3-8c09-fef755291460] Building network info cache for instance {{(pid=128801) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 04 20:44:14.267394 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell0:SELECT=2 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:44:14.805717 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-8a09ee45-5216-48c6-ac22-6f9aaa1e1f68 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28399882314945d787a3af6eb59935c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5392c67506f7445ab33d62b191558f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:44:14.824317 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-8a09ee45-5216-48c6-ac22-6f9aaa1e1f68 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28399882314945d787a3af6eb59935c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5392c67506f7445ab33d62b191558f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:44:14.826395 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-8a09ee45-5216-48c6-ac22-6f9aaa1e1f68 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28399882314945d787a3af6eb59935c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5392c67506f7445ab33d62b191558f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:44:14.829345 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-8a09ee45-5216-48c6-ac22-6f9aaa1e1f68 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] 10.222.0.33 "GET /compute/v2.1/servers/c0a14e22-0620-4912-9893-62974c80978a" status: 200 len: 1879 microversion: 2.32 time: 1.509432 Oct 04 20:44:14.832433 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1208/2348] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:44:13 2022] GET /compute/v2.1/servers/c0a14e22-0620-4912-9893-62974c80978a => generated 1879 bytes in 1513 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:44:14.866277 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-d80816a5-63eb-4881-8be1-6957d506e2c9 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:44:14.866944 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-d80816a5-63eb-4881-8be1-6957d506e2c9 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] [instance: c147993c-5773-4b76-93bc-62c0cbb6044a] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:44:14.886490 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d80816a5-63eb-4881-8be1-6957d506e2c9 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:14.893701 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d80816a5-63eb-4881-8be1-6957d506e2c9 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:14.895064 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d80816a5-63eb-4881-8be1-6957d506e2c9 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:14.897065 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d80816a5-63eb-4881-8be1-6957d506e2c9 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:14.898957 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d80816a5-63eb-4881-8be1-6957d506e2c9 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:14.899552 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d80816a5-63eb-4881-8be1-6957d506e2c9 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:15.903530 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-d80816a5-63eb-4881-8be1-6957d506e2c9 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e1e240b20e41e8b90e0d630e0d6b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a44744f2bb4130b9a49065b49cf854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:44:15.930476 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-d80816a5-63eb-4881-8be1-6957d506e2c9 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] 10.222.0.33 "GET /compute/v2.1/servers/c147993c-5773-4b76-93bc-62c0cbb6044a" status: 200 len: 1334 microversion: 2.1 time: 1.074095 Oct 04 20:44:15.934434 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1209/2349] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:44:14 2022] GET /compute/v2.1/servers/c147993c-5773-4b76-93bc-62c0cbb6044a => generated 1334 bytes in 1102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:44:15.945386 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-319e0464-caa9-4e72-bf34-fe3a3924df81 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:44:15.949318 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-319e0464-caa9-4e72-bf34-fe3a3924df81 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] [instance: 17f61077-3e1c-4d86-b364-b22e4e40b3ca] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:44:15.968551 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-319e0464-caa9-4e72-bf34-fe3a3924df81 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:15.971007 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-319e0464-caa9-4e72-bf34-fe3a3924df81 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:15.973896 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-319e0464-caa9-4e72-bf34-fe3a3924df81 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:15.974881 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-319e0464-caa9-4e72-bf34-fe3a3924df81 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:15.975498 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-319e0464-caa9-4e72-bf34-fe3a3924df81 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:15.977894 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-319e0464-caa9-4e72-bf34-fe3a3924df81 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:16.117305 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-319e0464-caa9-4e72-bf34-fe3a3924df81 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '800db3a57ada47eca381b00189fdbf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66ec8ea91b04deb90b679589e0495bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:44:16.127982 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-319e0464-caa9-4e72-bf34-fe3a3924df81 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] 10.222.0.33 "GET /compute/v2.1/servers/17f61077-3e1c-4d86-b364-b22e4e40b3ca" status: 200 len: 1182 microversion: 2.1 time: 0.190303 Oct 04 20:44:16.128585 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1210/2350] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:44:15 2022] GET /compute/v2.1/servers/17f61077-3e1c-4d86-b364-b22e4e40b3ca => generated 1182 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:44:16.150030 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-40e0eb47-50f8-4c52-9527-0e82caaa2f83 tempest-QuotaClassesAdminTestJSON-1567535924 tempest-QuotaClassesAdminTestJSON-1567535924-project-admin] Calling method '.version_select at 0x7f3c7499a670>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:44:16.163115 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-40e0eb47-50f8-4c52-9527-0e82caaa2f83 tempest-QuotaClassesAdminTestJSON-1567535924 tempest-QuotaClassesAdminTestJSON-1567535924-project-admin] 10.222.0.33 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 307 microversion: 2.1 time: 0.018163 Oct 04 20:44:16.164993 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1211/2351] 10.222.0.33 () {58 vars in 1185 bytes} [Tue Oct 4 20:44:16 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 307 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:44:16.278129 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-ea2dd315-fdba-431a-b6c7-3fde1a6f791f req-20e16e0e-9a18-4223-903f-024a5805fc3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17f61077-3e1c-4d86-b364-b22e4e40b3ca", "name": "network-vif-deleted", "tag": "f185090f-7c96-46b5-b51f-76a45035b6a4"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:44:16.292391 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-ea2dd315-fdba-431a-b6c7-3fde1a6f791f req-20e16e0e-9a18-4223-903f-024a5805fc3d service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:16.293245 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-ea2dd315-fdba-431a-b6c7-3fde1a6f791f req-20e16e0e-9a18-4223-903f-024a5805fc3d service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:16.293974 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-ea2dd315-fdba-431a-b6c7-3fde1a6f791f req-20e16e0e-9a18-4223-903f-024a5805fc3d service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:16.309168 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-ea2dd315-fdba-431a-b6c7-3fde1a6f791f req-20e16e0e-9a18-4223-903f-024a5805fc3d service nova] Creating event network-vif-deleted:f185090f-7c96-46b5-b51f-76a45035b6a4 for instance 17f61077-3e1c-4d86-b364-b22e4e40b3ca on n-h2-854823-8 Oct 04 20:44:16.319113 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-ea2dd315-fdba-431a-b6c7-3fde1a6f791f req-20e16e0e-9a18-4223-903f-024a5805fc3d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.152289 Oct 04 20:44:16.320567 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1212/2352] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:44:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:44:16.342286 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-6072c1c2-2b5a-4348-98cd-11a6327751fe tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:44:16.346448 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-6072c1c2-2b5a-4348-98cd-11a6327751fe tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] [instance: 0f127014-9e6f-47e6-b8a5-94ca91e0836c] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:44:16.360711 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6072c1c2-2b5a-4348-98cd-11a6327751fe tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:16.361545 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6072c1c2-2b5a-4348-98cd-11a6327751fe tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:16.362145 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6072c1c2-2b5a-4348-98cd-11a6327751fe tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:16.363229 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6072c1c2-2b5a-4348-98cd-11a6327751fe tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:16.363936 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6072c1c2-2b5a-4348-98cd-11a6327751fe tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:16.364514 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6072c1c2-2b5a-4348-98cd-11a6327751fe tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:16.591573 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-6072c1c2-2b5a-4348-98cd-11a6327751fe tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87dcc7baf63f4ae6bfe0a099adffd408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7097bc12179446f6a3e1fac8434d5c64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:44:16.601573 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-6072c1c2-2b5a-4348-98cd-11a6327751fe tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] 10.222.0.33 "GET /compute/v2.1/servers/0f127014-9e6f-47e6-b8a5-94ca91e0836c" status: 200 len: 1251 microversion: 2.1 time: 0.278095 Oct 04 20:44:16.602182 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1213/2353] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:44:16 2022] GET /compute/v2.1/servers/0f127014-9e6f-47e6-b8a5-94ca91e0836c => generated 1251 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:44:16.615387 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-27a07309-2165-40cb-8cae-80ae1bdd1b55 req-6639551c-ef21-4320-94ef-e22b3f4814a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0a14e22-0620-4912-9893-62974c80978a", "name": "network-vif-plugged", "status": "completed", "tag": "06028cc3-2b0b-4175-9579-b3aaf701fc68"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:44:16.644621 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-27a07309-2165-40cb-8cae-80ae1bdd1b55 req-6639551c-ef21-4320-94ef-e22b3f4814a2 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:16.645449 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-27a07309-2165-40cb-8cae-80ae1bdd1b55 req-6639551c-ef21-4320-94ef-e22b3f4814a2 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:16.646019 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-27a07309-2165-40cb-8cae-80ae1bdd1b55 req-6639551c-ef21-4320-94ef-e22b3f4814a2 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:16.662065 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-27a07309-2165-40cb-8cae-80ae1bdd1b55 req-6639551c-ef21-4320-94ef-e22b3f4814a2 service nova] Creating event network-vif-plugged:06028cc3-2b0b-4175-9579-b3aaf701fc68 for instance c0a14e22-0620-4912-9893-62974c80978a on n-h1-854823-8 Oct 04 20:44:16.680536 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-27a07309-2165-40cb-8cae-80ae1bdd1b55 req-6639551c-ef21-4320-94ef-e22b3f4814a2 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072686 Oct 04 20:44:16.681505 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1214/2354] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:44:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:44:16.695373 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-f122fd09-cf47-4cd9-8cc4-35e0f016b412 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Action: 'create', calling method: .version_select at 0x7f3c7885cf70>, body: {"keypair": {"name": "tempest-keypair-2092395144", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOPiG3aygXoiqUc5QzjB96Khak1IbACyPuTJKvEh8yRhrJiXjx96K4w7yOOKzaJ6sZRbIw8ID3JXRi+gc5JvmmMxVUvZhK8QEOOVEdSVTfFqFnYQPvdD1B/os3DJVPinJw=="}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:44:16.740493 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-f122fd09-cf47-4cd9-8cc4-35e0f016b412 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Getting quotas for project fc7f38600b5041ad8e66a12d77b940fa. Resources: {'key_pairs'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:44:16.749413 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-f122fd09-cf47-4cd9-8cc4-35e0f016b412 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Getting quotas for user d9e4b00964014a0383f79597652bd428 and project fc7f38600b5041ad8e66a12d77b940fa. Resources: {'key_pairs'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:44:16.784233 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-f122fd09-cf47-4cd9-8cc4-35e0f016b412 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.101527 Oct 04 20:44:16.784876 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1215/2355] 10.222.0.33 () {60 vars in 1159 bytes} [Tue Oct 4 20:44:16 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:44:16.881630 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-cdd2df96-e47a-47e5-9725-4040409d9c58 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Action: 'create', calling method: .version_select at 0x7f3c7890c940>, body: {"keypair": {"name": "tempest-keypair-1394842687", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOajkn7Jt56z/DzAQ3rMRKpMRJk51jnHX6Zp/0vymQm/ZdzwIT5qAHADrOf3puXZKTkpqCWrTRxNvCiqA9dj53Zie7uMYCZoXZC1E3gvS8ec1EpuASJke8LiC80F1A9UDw=="}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:44:16.902856 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-cdd2df96-e47a-47e5-9725-4040409d9c58 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Getting quotas for project 8b0670d1bd99424780a70e69d57a2166. Resources: {'key_pairs'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:44:16.908974 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-cdd2df96-e47a-47e5-9725-4040409d9c58 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Getting quotas for user eac650232cc04810b1340dc2f0edadcc and project 8b0670d1bd99424780a70e69d57a2166. Resources: {'key_pairs'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:44:16.952665 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-cdd2df96-e47a-47e5-9725-4040409d9c58 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.166227 Oct 04 20:44:16.953655 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1216/2356] 10.222.0.33 () {60 vars in 1159 bytes} [Tue Oct 4 20:44:16 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:44:16.959133 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-a669201a-5c75-4fed-90ff-270763b1618c tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:44:16.959879 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-a669201a-5c75-4fed-90ff-270763b1618c tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] [instance: c0a14e22-0620-4912-9893-62974c80978a] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:44:16.981339 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a669201a-5c75-4fed-90ff-270763b1618c tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:16.981894 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a669201a-5c75-4fed-90ff-270763b1618c tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:16.982496 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a669201a-5c75-4fed-90ff-270763b1618c tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:16.984122 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a669201a-5c75-4fed-90ff-270763b1618c tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:16.984931 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a669201a-5c75-4fed-90ff-270763b1618c tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:16.985714 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a669201a-5c75-4fed-90ff-270763b1618c tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:17.118978 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.network.neutron [None req-98d80a8d-b2fb-40d5-bf64-cfd3368339ac tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] [instance: 659f073c-b8c2-48d3-8c09-fef755291460] Updating instance_info_cache with network_info: [{"id": "267a2eeb-d782-40d7-865d-522dfe433aa5", "address": "fa:16:3e:1a:0b:04", "network": {"id": "8041a123-3203-48c7-8a2d-6c4dad3abeb6", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1176833900-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "2f258cb1ecd049078b201eb41692735a", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap267a2eeb-d7", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128801) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 04 20:44:17.144652 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-98d80a8d-b2fb-40d5-bf64-cfd3368339ac tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Releasing lock "refresh_cache-659f073c-b8c2-48d3-8c09-fef755291460" {{(pid=128801) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 04 20:44:17.145954 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-98d80a8d-b2fb-40d5-bf64-cfd3368339ac tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] 10.222.0.33 "POST /compute/v2.1/servers/659f073c-b8c2-48d3-8c09-fef755291460/action" status: 202 len: 0 microversion: 2.1 time: 6.000412 Oct 04 20:44:17.147344 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1141/2357] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 20:44:11 2022] POST /compute/v2.1/servers/659f073c-b8c2-48d3-8c09-fef755291460/action => generated 0 bytes in 6009 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 04 20:44:17.155890 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-79f624ba-5b5b-41a8-a25d-480570a7c53a tempest-QuotaClassesAdminTestJSON-1567535924 tempest-QuotaClassesAdminTestJSON-1567535924-project-admin] Action: 'update', calling method: .version_select at 0x7f3c743eef70>, body: {"quota_class_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:44:17.396426 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-79f624ba-5b5b-41a8-a25d-480570a7c53a tempest-QuotaClassesAdminTestJSON-1567535924 tempest-QuotaClassesAdminTestJSON-1567535924-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 286 microversion: 2.1 time: 0.245434 Oct 04 20:44:17.398148 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1142/2358] 10.222.0.33 () {60 vars in 1206 bytes} [Tue Oct 4 20:44:17 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 286 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:44:17.555551 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-637c69dc-9b3c-48db-b659-485b21e0e27c req-8e1f9cf6-8f48-48c4-87d9-6257987f2956 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c147993c-5773-4b76-93bc-62c0cbb6044a", "tag": "ce227d9f-091c-4a59-94a6-70391aac4f0c"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:44:17.585416 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-637c69dc-9b3c-48db-b659-485b21e0e27c req-8e1f9cf6-8f48-48c4-87d9-6257987f2956 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:17.586307 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-637c69dc-9b3c-48db-b659-485b21e0e27c req-8e1f9cf6-8f48-48c4-87d9-6257987f2956 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:17.589959 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-637c69dc-9b3c-48db-b659-485b21e0e27c req-8e1f9cf6-8f48-48c4-87d9-6257987f2956 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:17.617780 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-637c69dc-9b3c-48db-b659-485b21e0e27c req-8e1f9cf6-8f48-48c4-87d9-6257987f2956 service nova] Creating event network-changed:ce227d9f-091c-4a59-94a6-70391aac4f0c for instance c147993c-5773-4b76-93bc-62c0cbb6044a on n-h2-854823-8 Oct 04 20:44:17.629509 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-637c69dc-9b3c-48db-b659-485b21e0e27c req-8e1f9cf6-8f48-48c4-87d9-6257987f2956 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.229786 Oct 04 20:44:17.635145 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1143/2359] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:44:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:44:17.646573 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9c4e1779-fa1d-45d3-ad9f-15aafdeb4fb1 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:44:17.648468 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-9c4e1779-fa1d-45d3-ad9f-15aafdeb4fb1 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] [instance: c147993c-5773-4b76-93bc-62c0cbb6044a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:44:17.668232 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9c4e1779-fa1d-45d3-ad9f-15aafdeb4fb1 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:17.670068 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9c4e1779-fa1d-45d3-ad9f-15aafdeb4fb1 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:17.671935 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9c4e1779-fa1d-45d3-ad9f-15aafdeb4fb1 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:17.673647 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9c4e1779-fa1d-45d3-ad9f-15aafdeb4fb1 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:17.674840 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9c4e1779-fa1d-45d3-ad9f-15aafdeb4fb1 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:17.675574 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9c4e1779-fa1d-45d3-ad9f-15aafdeb4fb1 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:18.437581 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-a669201a-5c75-4fed-90ff-270763b1618c tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28399882314945d787a3af6eb59935c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5392c67506f7445ab33d62b191558f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:44:18.452140 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-a669201a-5c75-4fed-90ff-270763b1618c tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28399882314945d787a3af6eb59935c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5392c67506f7445ab33d62b191558f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:44:18.453665 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-a669201a-5c75-4fed-90ff-270763b1618c tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28399882314945d787a3af6eb59935c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5392c67506f7445ab33d62b191558f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:44:18.455143 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-a669201a-5c75-4fed-90ff-270763b1618c tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] 10.222.0.33 "GET /compute/v2.1/servers/c0a14e22-0620-4912-9893-62974c80978a" status: 200 len: 1879 microversion: 2.32 time: 1.500262 Oct 04 20:44:18.463753 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1217/2360] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:44:16 2022] GET /compute/v2.1/servers/c0a14e22-0620-4912-9893-62974c80978a => generated 1879 bytes in 1510 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:44:18.478577 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-568a07bc-ce61-4d20-bfdd-5a039e431cff tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:44:18.480011 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-568a07bc-ce61-4d20-bfdd-5a039e431cff tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] [instance: 17f61077-3e1c-4d86-b364-b22e4e40b3ca] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:44:18.513561 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-568a07bc-ce61-4d20-bfdd-5a039e431cff tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:18.514139 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-568a07bc-ce61-4d20-bfdd-5a039e431cff tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:18.514623 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-568a07bc-ce61-4d20-bfdd-5a039e431cff tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:18.515379 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-568a07bc-ce61-4d20-bfdd-5a039e431cff tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:18.515843 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-568a07bc-ce61-4d20-bfdd-5a039e431cff tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:18.516269 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-568a07bc-ce61-4d20-bfdd-5a039e431cff tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:18.696096 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-568a07bc-ce61-4d20-bfdd-5a039e431cff tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '800db3a57ada47eca381b00189fdbf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66ec8ea91b04deb90b679589e0495bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:44:18.699356 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:44:18.713202 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-568a07bc-ce61-4d20-bfdd-5a039e431cff tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] 10.222.0.33 "GET /compute/v2.1/servers/17f61077-3e1c-4d86-b364-b22e4e40b3ca" status: 200 len: 1182 microversion: 2.1 time: 0.239994 Oct 04 20:44:18.715247 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-9c4e1779-fa1d-45d3-ad9f-15aafdeb4fb1 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e1e240b20e41e8b90e0d630e0d6b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a44744f2bb4130b9a49065b49cf854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:44:18.733593 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1218/2361] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:44:18 2022] GET /compute/v2.1/servers/17f61077-3e1c-4d86-b364-b22e4e40b3ca => generated 1182 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:44:18.736917 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-9c4e1779-fa1d-45d3-ad9f-15aafdeb4fb1 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] 10.222.0.33 "GET /compute/v2.1/servers/c147993c-5773-4b76-93bc-62c0cbb6044a" status: 200 len: 1334 microversion: 2.1 time: 1.100019 Oct 04 20:44:18.737600 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1144/2362] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:44:17 2022] GET /compute/v2.1/servers/c147993c-5773-4b76-93bc-62c0cbb6044a => generated 1334 bytes in 1101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:44:18.747790 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-43556df6-1ffb-4895-a3f9-977a7d4d837e tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:44:18.750225 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-43556df6-1ffb-4895-a3f9-977a7d4d837e tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] [instance: 8ef51f7d-45b1-4d48-8611-5c7805f52d15] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:44:18.752824 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-36938d1d-8247-46de-8caf-5803dec126e1 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:44:18.754982 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-36938d1d-8247-46de-8caf-5803dec126e1 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] [instance: 0f127014-9e6f-47e6-b8a5-94ca91e0836c] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:44:18.768357 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-43556df6-1ffb-4895-a3f9-977a7d4d837e tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:18.768485 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-36938d1d-8247-46de-8caf-5803dec126e1 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:18.768903 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-36938d1d-8247-46de-8caf-5803dec126e1 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:18.769334 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-36938d1d-8247-46de-8caf-5803dec126e1 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:18.770042 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-36938d1d-8247-46de-8caf-5803dec126e1 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:18.770538 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-36938d1d-8247-46de-8caf-5803dec126e1 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:18.770959 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-36938d1d-8247-46de-8caf-5803dec126e1 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:18.771243 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-43556df6-1ffb-4895-a3f9-977a7d4d837e tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:18.771917 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-43556df6-1ffb-4895-a3f9-977a7d4d837e tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:18.775318 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-43556df6-1ffb-4895-a3f9-977a7d4d837e tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:18.778755 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-43556df6-1ffb-4895-a3f9-977a7d4d837e tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:18.779523 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-43556df6-1ffb-4895-a3f9-977a7d4d837e tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:18.814916 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.wsgi [None req-43556df6-1ffb-4895-a3f9-977a7d4d837e tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] HTTP exception thrown: Instance 8ef51f7d-45b1-4d48-8611-5c7805f52d15 could not be found. Oct 04 20:44:18.816992 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-43556df6-1ffb-4895-a3f9-977a7d4d837e tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Request method failure captured: Oct 04 20:44:18.816992 n-d-854823-8 devstack@n-api.service[128802]: request: DELETE /compute/v2.1/servers/8ef51f7d-45b1-4d48-8611-5c7805f52d15 HTTP/1.1 Oct 04 20:44:18.816992 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 20:44:18.816992 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 20:44:18.816992 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 20:44:18.816992 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 0 Oct 04 20:44:18.816992 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 20:44:18.816992 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 20:44:18.816992 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 20:44:18.816992 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 20:44:18.816992 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPJrCXn9qkai-t0ssRtB2hHbsXxnP5vBOsXLyrdpMENqm1lUMebcltiaPpyMILmcvIN8llVIUttogRG2DF_WtLJWYaQ5u4-061o1eVh20ZNBGxnAtXnxMrwm1GWR6CkNd6wvaFrzIuArFkGOfhkVebmLChRySZyfWaukv6J6WbRuDoGI Oct 04 20:44:18.816992 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 20:44:18.816992 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 20:44:18.816992 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 20:44:18.816992 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 20:44:18.816992 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 20:44:18.816992 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 20:44:18.816992 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: 2f258cb1ecd049078b201eb41692735a Oct 04 20:44:18.816992 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-2034231916 Oct 04 20:44:18.816992 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 20:44:18.816992 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 20:44:18.816992 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_2f258cb1ecd049078b201eb41692735a", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2f258cb1ecd049078b201eb41692735a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2f258cb1ecd049078b201eb41692735a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/2f258cb1ecd049078b201eb41692735a"}]}] Oct 04 20:44:18.816992 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-2034231916 Oct 04 20:44:18.816992 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: 2f258cb1ecd049078b201eb41692735a Oct 04 20:44:18.816992 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-2034231916 Oct 04 20:44:18.816992 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-FloatingIPsAssociationTestJSON-2034231916-project Oct 04 20:44:18.816992 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 20:44:18.816992 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 20:44:18.816992 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: 07c500628d414c9983836c33563b38bc Oct 04 20:44:18.816992 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-2034231916-project Oct 04 20:44:18.816992 n-d-854823-8 devstack@n-api.service[128802]: method: > Oct 04 20:44:18.816992 n-d-854823-8 devstack@n-api.service[128802]: exception: Instance 8ef51f7d-45b1-4d48-8611-5c7805f52d15 could not be found. Oct 04 20:44:18.816992 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'id': '8ef51f7d-45b1-4d48-8611-5c7805f52d15'} Oct 04 20:44:18.816992 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:44:18.816992 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:44:18.816992 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:44:18.816992 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:44:18.816992 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:44:18.816992 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:44:18.816992 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:44:18.816992 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:44:18.816992 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:44:18.816992 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:44:18.816992 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ef51f7d-45b1-4d48-8611-5c7805f52d15 could not be found. Oct 04 20:44:18.816992 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:44:18.816992 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:44:18.816992 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:44:18.816992 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:44:18.816992 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:44:18.816992 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:44:18.816992 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:44:18.816992 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:44:18.816992 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:44:18.816992 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:44:18.816992 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 20:44:18.816992 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 20:44:18.816992 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 20:44:18.816992 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 20:44:18.816992 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:44:18.816992 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:44:18.816992 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:44:18.816992 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:44:18.820499 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ef51f7d-45b1-4d48-8611-5c7805f52d15 could not be found. Oct 04 20:44:18.820499 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:44:18.820499 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:44:18.820499 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:44:18.820499 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:44:18.820499 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:44:18.820499 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:44:18.820499 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:44:18.820499 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:44:18.820499 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ef51f7d-45b1-4d48-8611-5c7805f52d15 could not be found. Oct 04 20:44:18.820499 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:44:18.826670 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-43556df6-1ffb-4895-a3f9-977a7d4d837e tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Returning 404 to user: Instance 8ef51f7d-45b1-4d48-8611-5c7805f52d15 could not be found. {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:44:18.827868 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-43556df6-1ffb-4895-a3f9-977a7d4d837e tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] 10.222.0.33 "DELETE /compute/v2.1/servers/8ef51f7d-45b1-4d48-8611-5c7805f52d15" status: 404 len: 111 microversion: 2.1 time: 0.092445 Oct 04 20:44:18.830253 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1219/2363] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 20:44:18 2022] DELETE /compute/v2.1/servers/8ef51f7d-45b1-4d48-8611-5c7805f52d15 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:44:18.837250 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-f91c00b1-0b00-47db-9614-fc28cc3f50f9 req-25bf452c-84c1-4240-80a3-d80d9427322c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "659f073c-b8c2-48d3-8c09-fef755291460", "tag": "267a2eeb-d782-40d7-865d-522dfe433aa5"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:44:18.868283 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-f91c00b1-0b00-47db-9614-fc28cc3f50f9 req-25bf452c-84c1-4240-80a3-d80d9427322c service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:18.869127 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-f91c00b1-0b00-47db-9614-fc28cc3f50f9 req-25bf452c-84c1-4240-80a3-d80d9427322c service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:18.870588 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-f91c00b1-0b00-47db-9614-fc28cc3f50f9 req-25bf452c-84c1-4240-80a3-d80d9427322c service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:18.888513 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-f91c00b1-0b00-47db-9614-fc28cc3f50f9 req-25bf452c-84c1-4240-80a3-d80d9427322c service nova] Creating event network-changed:267a2eeb-d782-40d7-865d-522dfe433aa5 for instance 659f073c-b8c2-48d3-8c09-fef755291460 on n-h2-854823-8 Oct 04 20:44:18.894077 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-f91c00b1-0b00-47db-9614-fc28cc3f50f9 req-25bf452c-84c1-4240-80a3-d80d9427322c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061898 Oct 04 20:44:18.895589 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1220/2364] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:44:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:44:18.901886 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-4e931a72-3514-4878-ab1b-5f8d3da754f8 req-154ee7a1-6ac8-49b8-a685-7e259e4acd02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0a14e22-0620-4912-9893-62974c80978a", "name": "network-vif-plugged", "status": "completed", "tag": "41720b8f-0f05-4932-ad4e-fda7403fd530"}, {"server_uuid": "c0a14e22-0620-4912-9893-62974c80978a", "name": "network-vif-plugged", "status": "completed", "tag": "5f2c3d14-997c-4225-a9eb-1379adba5e6c"}, {"server_uuid": "c0a14e22-0620-4912-9893-62974c80978a", "name": "network-vif-plugged", "status": "completed", "tag": "dfc19e40-1e2b-4560-8ac7-cb603e8ca4ab"}, {"server_uuid": "c0a14e22-0620-4912-9893-62974c80978a", "name": "network-vif-plugged", "status": "completed", "tag": "6a2a59c6-7fc0-4c9d-9f8a-2a71aff6748a"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:44:18.930865 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-4e931a72-3514-4878-ab1b-5f8d3da754f8 req-154ee7a1-6ac8-49b8-a685-7e259e4acd02 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:18.933557 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-4e931a72-3514-4878-ab1b-5f8d3da754f8 req-154ee7a1-6ac8-49b8-a685-7e259e4acd02 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:18.934506 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-4e931a72-3514-4878-ab1b-5f8d3da754f8 req-154ee7a1-6ac8-49b8-a685-7e259e4acd02 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:18.956213 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-4e931a72-3514-4878-ab1b-5f8d3da754f8 req-154ee7a1-6ac8-49b8-a685-7e259e4acd02 service nova] Creating event network-vif-plugged:41720b8f-0f05-4932-ad4e-fda7403fd530 for instance c0a14e22-0620-4912-9893-62974c80978a on n-h1-854823-8 Oct 04 20:44:18.966502 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-4e931a72-3514-4878-ab1b-5f8d3da754f8 req-154ee7a1-6ac8-49b8-a685-7e259e4acd02 service nova] Creating event network-vif-plugged:5f2c3d14-997c-4225-a9eb-1379adba5e6c for instance c0a14e22-0620-4912-9893-62974c80978a on n-h1-854823-8 Oct 04 20:44:18.968402 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-4e931a72-3514-4878-ab1b-5f8d3da754f8 req-154ee7a1-6ac8-49b8-a685-7e259e4acd02 service nova] Creating event network-vif-plugged:dfc19e40-1e2b-4560-8ac7-cb603e8ca4ab for instance c0a14e22-0620-4912-9893-62974c80978a on n-h1-854823-8 Oct 04 20:44:18.969457 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-4e931a72-3514-4878-ab1b-5f8d3da754f8 req-154ee7a1-6ac8-49b8-a685-7e259e4acd02 service nova] Creating event network-vif-plugged:6a2a59c6-7fc0-4c9d-9f8a-2a71aff6748a for instance c0a14e22-0620-4912-9893-62974c80978a on n-h1-854823-8 Oct 04 20:44:18.984166 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-4e931a72-3514-4878-ab1b-5f8d3da754f8 req-154ee7a1-6ac8-49b8-a685-7e259e4acd02 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.086824 Oct 04 20:44:18.987122 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1221/2365] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:44:18 2022] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:44:18.996246 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-3126c569-2099-4dcb-a36c-1a9dde531910 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:44:19.000697 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-3126c569-2099-4dcb-a36c-1a9dde531910 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] [instance: 8ef51f7d-45b1-4d48-8611-5c7805f52d15] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:44:19.020564 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3126c569-2099-4dcb-a36c-1a9dde531910 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:19.021448 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3126c569-2099-4dcb-a36c-1a9dde531910 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:19.022103 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3126c569-2099-4dcb-a36c-1a9dde531910 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:19.023133 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3126c569-2099-4dcb-a36c-1a9dde531910 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:19.023797 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3126c569-2099-4dcb-a36c-1a9dde531910 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:19.024849 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3126c569-2099-4dcb-a36c-1a9dde531910 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:19.058670 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.wsgi [None req-3126c569-2099-4dcb-a36c-1a9dde531910 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] HTTP exception thrown: Instance 8ef51f7d-45b1-4d48-8611-5c7805f52d15 could not be found. Oct 04 20:44:19.063223 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-3126c569-2099-4dcb-a36c-1a9dde531910 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Request method failure captured: Oct 04 20:44:19.063223 n-d-854823-8 devstack@n-api.service[128802]: request: GET /compute/v2.1/servers/8ef51f7d-45b1-4d48-8611-5c7805f52d15 HTTP/1.1 Oct 04 20:44:19.063223 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 20:44:19.063223 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 20:44:19.063223 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 20:44:19.063223 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 0 Oct 04 20:44:19.063223 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 20:44:19.063223 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 20:44:19.063223 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 20:44:19.063223 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 20:44:19.063223 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPJrCXn9qkai-t0ssRtB2hHbsXxnP5vBOsXLyrdpMENqm1lUMebcltiaPpyMILmcvIN8llVIUttogRG2DF_WtLJWYaQ5u4-061o1eVh20ZNBGxnAtXnxMrwm1GWR6CkNd6wvaFrzIuArFkGOfhkVebmLChRySZyfWaukv6J6WbRuDoGI Oct 04 20:44:19.063223 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 20:44:19.063223 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 20:44:19.063223 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 20:44:19.063223 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 20:44:19.063223 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 20:44:19.063223 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 20:44:19.063223 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: 2f258cb1ecd049078b201eb41692735a Oct 04 20:44:19.063223 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-2034231916 Oct 04 20:44:19.063223 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 20:44:19.063223 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 20:44:19.063223 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_2f258cb1ecd049078b201eb41692735a", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2f258cb1ecd049078b201eb41692735a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2f258cb1ecd049078b201eb41692735a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/2f258cb1ecd049078b201eb41692735a"}]}] Oct 04 20:44:19.063223 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-2034231916 Oct 04 20:44:19.063223 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: 2f258cb1ecd049078b201eb41692735a Oct 04 20:44:19.063223 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-2034231916 Oct 04 20:44:19.063223 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-FloatingIPsAssociationTestJSON-2034231916-project Oct 04 20:44:19.063223 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 20:44:19.063223 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 20:44:19.063223 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: 07c500628d414c9983836c33563b38bc Oct 04 20:44:19.063223 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-2034231916-project Oct 04 20:44:19.063223 n-d-854823-8 devstack@n-api.service[128802]: method: > Oct 04 20:44:19.063223 n-d-854823-8 devstack@n-api.service[128802]: exception: Instance 8ef51f7d-45b1-4d48-8611-5c7805f52d15 could not be found. Oct 04 20:44:19.063223 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'id': '8ef51f7d-45b1-4d48-8611-5c7805f52d15'} Oct 04 20:44:19.063223 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:44:19.063223 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:44:19.063223 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:44:19.063223 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:44:19.063223 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:44:19.063223 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:44:19.063223 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:44:19.063223 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:44:19.063223 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:44:19.063223 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:44:19.063223 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ef51f7d-45b1-4d48-8611-5c7805f52d15 could not be found. Oct 04 20:44:19.063223 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:44:19.063223 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:44:19.063223 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:44:19.063223 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:44:19.063223 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:44:19.063223 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:44:19.063223 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:44:19.063223 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:44:19.063223 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:44:19.063223 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:44:19.063223 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:44:19.063223 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:44:19.063223 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:44:19.063223 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:44:19.063223 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:44:19.063223 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:44:19.063223 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ef51f7d-45b1-4d48-8611-5c7805f52d15 could not be found. Oct 04 20:44:19.063223 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:44:19.063223 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:44:19.066722 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:44:19.066722 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:44:19.066722 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:44:19.066722 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:44:19.066722 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:44:19.066722 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:44:19.066722 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ef51f7d-45b1-4d48-8611-5c7805f52d15 could not be found. Oct 04 20:44:19.066722 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:44:19.071069 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-3126c569-2099-4dcb-a36c-1a9dde531910 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Returning 404 to user: Instance 8ef51f7d-45b1-4d48-8611-5c7805f52d15 could not be found. {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:44:19.074052 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-3126c569-2099-4dcb-a36c-1a9dde531910 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] 10.222.0.33 "GET /compute/v2.1/servers/8ef51f7d-45b1-4d48-8611-5c7805f52d15" status: 404 len: 111 microversion: 2.1 time: 0.085420 Oct 04 20:44:19.076611 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1222/2366] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:44:18 2022] GET /compute/v2.1/servers/8ef51f7d-45b1-4d48-8611-5c7805f52d15 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:44:19.087376 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-a76fcdac-b971-4d14-8db3-703a3a3b0721 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Calling method '.version_select at 0x7f3c7890c670>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:44:19.756720 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-36938d1d-8247-46de-8caf-5803dec126e1 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87dcc7baf63f4ae6bfe0a099adffd408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7097bc12179446f6a3e1fac8434d5c64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:44:19.770651 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-36938d1d-8247-46de-8caf-5803dec126e1 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] 10.222.0.33 "GET /compute/v2.1/servers/0f127014-9e6f-47e6-b8a5-94ca91e0836c" status: 200 len: 1293 microversion: 2.1 time: 1.020736 Oct 04 20:44:19.779909 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1145/2367] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:44:18 2022] GET /compute/v2.1/servers/0f127014-9e6f-47e6-b8a5-94ca91e0836c => generated 1293 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:44:19.796318 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-72341185-9fc4-42a0-9180-1c25181f42b5 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:44:19.797236 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-72341185-9fc4-42a0-9180-1c25181f42b5 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] [instance: c0a14e22-0620-4912-9893-62974c80978a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:44:19.812144 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-72341185-9fc4-42a0-9180-1c25181f42b5 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:19.812976 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-72341185-9fc4-42a0-9180-1c25181f42b5 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:19.813654 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-72341185-9fc4-42a0-9180-1c25181f42b5 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:19.814594 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-72341185-9fc4-42a0-9180-1c25181f42b5 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:19.815251 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-72341185-9fc4-42a0-9180-1c25181f42b5 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:19.815874 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-72341185-9fc4-42a0-9180-1c25181f42b5 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:20.845624 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:44:21.413416 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-72341185-9fc4-42a0-9180-1c25181f42b5 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28399882314945d787a3af6eb59935c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5392c67506f7445ab33d62b191558f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:44:21.429146 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-72341185-9fc4-42a0-9180-1c25181f42b5 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28399882314945d787a3af6eb59935c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5392c67506f7445ab33d62b191558f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:44:21.433465 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-72341185-9fc4-42a0-9180-1c25181f42b5 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28399882314945d787a3af6eb59935c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5392c67506f7445ab33d62b191558f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:44:21.438299 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-72341185-9fc4-42a0-9180-1c25181f42b5 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] 10.222.0.33 "GET /compute/v2.1/servers/c0a14e22-0620-4912-9893-62974c80978a" status: 200 len: 1879 microversion: 2.32 time: 1.657141 Oct 04 20:44:21.440637 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1146/2368] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:44:19 2022] GET /compute/v2.1/servers/c0a14e22-0620-4912-9893-62974c80978a => generated 1879 bytes in 1660 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:44:21.448624 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2fdd2ffb-d61b-4324-a07f-e402fbcf3abc tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:44:21.451853 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-2fdd2ffb-d61b-4324-a07f-e402fbcf3abc tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] [instance: 17f61077-3e1c-4d86-b364-b22e4e40b3ca] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:44:21.468352 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2fdd2ffb-d61b-4324-a07f-e402fbcf3abc tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:21.469364 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2fdd2ffb-d61b-4324-a07f-e402fbcf3abc tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:21.470463 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2fdd2ffb-d61b-4324-a07f-e402fbcf3abc tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:21.476566 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2fdd2ffb-d61b-4324-a07f-e402fbcf3abc tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:21.477405 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2fdd2ffb-d61b-4324-a07f-e402fbcf3abc tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:21.478078 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2fdd2ffb-d61b-4324-a07f-e402fbcf3abc tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:21.514116 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-2fdd2ffb-d61b-4324-a07f-e402fbcf3abc tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] HTTP exception thrown: Instance 17f61077-3e1c-4d86-b364-b22e4e40b3ca could not be found. Oct 04 20:44:21.517830 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2fdd2ffb-d61b-4324-a07f-e402fbcf3abc tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Request method failure captured: Oct 04 20:44:21.517830 n-d-854823-8 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/17f61077-3e1c-4d86-b364-b22e4e40b3ca HTTP/1.1 Oct 04 20:44:21.517830 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:44:21.517830 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:44:21.517830 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:44:21.517830 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 0 Oct 04 20:44:21.517830 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:44:21.517830 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:44:21.517830 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:44:21.517830 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:44:21.517830 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJl4WjK2XOBz3Jib2KCFRRv_VVnIEfTQGHoxZM5XJ5BSJtLq13YunIRMsvibZAHFSEforKQvXOJN7Mpa7ib-OsivWWjd0zFvYVOTkOZ9HJyr7xiC3a5IANK9maJs5GcpkRWx5DiN4avmq2Y6KfQPe2M0iIN_3U2JOMkAmLVevv57Lk8 Oct 04 20:44:21.517830 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:44:21.517830 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:44:21.517830 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:44:21.517830 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:44:21.517830 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:44:21.517830 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:44:21.517830 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: d66ec8ea91b04deb90b679589e0495bb Oct 04 20:44:21.517830 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-LiveMigrationTest-856257328 Oct 04 20:44:21.517830 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 20:44:21.517830 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 20:44:21.517830 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d66ec8ea91b04deb90b679589e0495bb", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d66ec8ea91b04deb90b679589e0495bb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d66ec8ea91b04deb90b679589e0495bb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d66ec8ea91b04deb90b679589e0495bb"}]}] Oct 04 20:44:21.517830 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-LiveMigrationTest-856257328 Oct 04 20:44:21.517830 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: d66ec8ea91b04deb90b679589e0495bb Oct 04 20:44:21.517830 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-LiveMigrationTest-856257328 Oct 04 20:44:21.517830 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-LiveMigrationTest-856257328-project Oct 04 20:44:21.517830 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:44:21.517830 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:44:21.517830 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: 800db3a57ada47eca381b00189fdbf0a Oct 04 20:44:21.517830 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-LiveMigrationTest-856257328-project Oct 04 20:44:21.517830 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 20:44:21.517830 n-d-854823-8 devstack@n-api.service[128801]: exception: Instance 17f61077-3e1c-4d86-b364-b22e4e40b3ca could not be found. Oct 04 20:44:21.517830 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': '17f61077-3e1c-4d86-b364-b22e4e40b3ca'} Oct 04 20:44:21.517830 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:44:21.517830 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:44:21.517830 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:44:21.517830 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:44:21.517830 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:44:21.517830 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:44:21.517830 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:44:21.517830 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:44:21.517830 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:44:21.517830 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:44:21.517830 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 17f61077-3e1c-4d86-b364-b22e4e40b3ca could not be found. Oct 04 20:44:21.517830 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:44:21.517830 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:44:21.517830 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:44:21.517830 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:44:21.517830 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:44:21.517830 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:44:21.517830 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:44:21.517830 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:44:21.517830 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:44:21.517830 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:44:21.517830 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:44:21.517830 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:44:21.517830 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:44:21.517830 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:44:21.517830 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:44:21.517830 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:44:21.517830 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17f61077-3e1c-4d86-b364-b22e4e40b3ca could not be found. Oct 04 20:44:21.517830 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:44:21.517830 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:44:21.517830 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:44:21.521791 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:44:21.521791 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:44:21.521791 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:44:21.521791 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:44:21.521791 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:44:21.521791 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17f61077-3e1c-4d86-b364-b22e4e40b3ca could not be found. Oct 04 20:44:21.521791 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:44:21.524793 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2fdd2ffb-d61b-4324-a07f-e402fbcf3abc tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Returning 404 to user: Instance 17f61077-3e1c-4d86-b364-b22e4e40b3ca could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:44:21.526794 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-2fdd2ffb-d61b-4324-a07f-e402fbcf3abc tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] 10.222.0.33 "GET /compute/v2.1/servers/17f61077-3e1c-4d86-b364-b22e4e40b3ca" status: 404 len: 111 microversion: 2.1 time: 0.084901 Oct 04 20:44:21.528531 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1147/2369] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:44:21 2022] GET /compute/v2.1/servers/17f61077-3e1c-4d86-b364-b22e4e40b3ca => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:44:21.549387 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ca6a62e8-bfa2-4dfc-b2a3-e77791bcc886 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:44:21.551063 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ca6a62e8-bfa2-4dfc-b2a3-e77791bcc886 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] [instance: c147993c-5773-4b76-93bc-62c0cbb6044a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:44:21.571733 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ca6a62e8-bfa2-4dfc-b2a3-e77791bcc886 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:21.573921 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ca6a62e8-bfa2-4dfc-b2a3-e77791bcc886 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:21.575539 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ca6a62e8-bfa2-4dfc-b2a3-e77791bcc886 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:21.576568 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ca6a62e8-bfa2-4dfc-b2a3-e77791bcc886 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:21.577409 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ca6a62e8-bfa2-4dfc-b2a3-e77791bcc886 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:21.578217 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ca6a62e8-bfa2-4dfc-b2a3-e77791bcc886 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:22.502112 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-ca6a62e8-bfa2-4dfc-b2a3-e77791bcc886 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e1e240b20e41e8b90e0d630e0d6b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a44744f2bb4130b9a49065b49cf854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:44:22.510260 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ca6a62e8-bfa2-4dfc-b2a3-e77791bcc886 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] 10.222.0.33 "GET /compute/v2.1/servers/c147993c-5773-4b76-93bc-62c0cbb6044a" status: 200 len: 1334 microversion: 2.1 time: 0.980392 Oct 04 20:44:22.511082 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1148/2370] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:44:21 2022] GET /compute/v2.1/servers/c147993c-5773-4b76-93bc-62c0cbb6044a => generated 1334 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:44:22.526589 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-f5b3dd1a-4827-4cc8-85eb-a3ad0c4774a5 req-eaf1a679-c568-418d-8908-9614d0c466f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c147993c-5773-4b76-93bc-62c0cbb6044a", "tag": "836586b9-492b-4387-b626-cc2fd5463aef"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:44:22.550593 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-f5b3dd1a-4827-4cc8-85eb-a3ad0c4774a5 req-eaf1a679-c568-418d-8908-9614d0c466f6 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:22.551082 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-f5b3dd1a-4827-4cc8-85eb-a3ad0c4774a5 req-eaf1a679-c568-418d-8908-9614d0c466f6 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:22.551519 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-f5b3dd1a-4827-4cc8-85eb-a3ad0c4774a5 req-eaf1a679-c568-418d-8908-9614d0c466f6 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:22.587051 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-f5b3dd1a-4827-4cc8-85eb-a3ad0c4774a5 req-eaf1a679-c568-418d-8908-9614d0c466f6 service nova] Creating event network-changed:836586b9-492b-4387-b626-cc2fd5463aef for instance c147993c-5773-4b76-93bc-62c0cbb6044a on n-h2-854823-8 Oct 04 20:44:22.597224 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-f5b3dd1a-4827-4cc8-85eb-a3ad0c4774a5 req-eaf1a679-c568-418d-8908-9614d0c466f6 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084862 Oct 04 20:44:22.601605 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1149/2371] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:44:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:44:22.618277 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1a0a5e33-868f-4c81-a0de-d8270b1209f9 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:44:22.629160 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-1a0a5e33-868f-4c81-a0de-d8270b1209f9 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] [instance: 0f127014-9e6f-47e6-b8a5-94ca91e0836c] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:44:22.655725 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1a0a5e33-868f-4c81-a0de-d8270b1209f9 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:22.656231 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1a0a5e33-868f-4c81-a0de-d8270b1209f9 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:22.656832 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1a0a5e33-868f-4c81-a0de-d8270b1209f9 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:22.657588 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1a0a5e33-868f-4c81-a0de-d8270b1209f9 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:22.658059 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1a0a5e33-868f-4c81-a0de-d8270b1209f9 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:22.658515 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1a0a5e33-868f-4c81-a0de-d8270b1209f9 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:23.370633 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-1a0a5e33-868f-4c81-a0de-d8270b1209f9 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87dcc7baf63f4ae6bfe0a099adffd408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7097bc12179446f6a3e1fac8434d5c64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:44:23.383088 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-1a0a5e33-868f-4c81-a0de-d8270b1209f9 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] 10.222.0.33 "GET /compute/v2.1/servers/0f127014-9e6f-47e6-b8a5-94ca91e0836c" status: 200 len: 1293 microversion: 2.1 time: 0.779063 Oct 04 20:44:23.384315 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1150/2372] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:44:22 2022] GET /compute/v2.1/servers/0f127014-9e6f-47e6-b8a5-94ca91e0836c => generated 1293 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:44:23.389479 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-fda8e5e9-4fdf-4196-a3f6-98c25f45a886 req-17474bae-3d66-4453-8e5f-c5ed367aac07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0a14e22-0620-4912-9893-62974c80978a", "name": "network-vif-plugged", "status": "completed", "tag": "3aae6729-b226-4156-a8f1-4164c26d5309"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:44:23.402543 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-fda8e5e9-4fdf-4196-a3f6-98c25f45a886 req-17474bae-3d66-4453-8e5f-c5ed367aac07 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:23.403477 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-fda8e5e9-4fdf-4196-a3f6-98c25f45a886 req-17474bae-3d66-4453-8e5f-c5ed367aac07 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:23.404153 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-fda8e5e9-4fdf-4196-a3f6-98c25f45a886 req-17474bae-3d66-4453-8e5f-c5ed367aac07 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:23.419574 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-fda8e5e9-4fdf-4196-a3f6-98c25f45a886 req-17474bae-3d66-4453-8e5f-c5ed367aac07 service nova] Creating event network-vif-plugged:3aae6729-b226-4156-a8f1-4164c26d5309 for instance c0a14e22-0620-4912-9893-62974c80978a on n-h1-854823-8 Oct 04 20:44:23.426814 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-fda8e5e9-4fdf-4196-a3f6-98c25f45a886 req-17474bae-3d66-4453-8e5f-c5ed367aac07 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040488 Oct 04 20:44:23.428887 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1151/2373] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:44:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:44:23.437310 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-46cd1ece-9577-48e1-9f64-cd2ca39d0988 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-457986815", "imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f233dbb4-a3a0-4530-9ca7-211ce7f5e292"}], "security_groups": [{"name": "tempest-securitygroup--245177723"}], "key_name": "tempest-keypair-1394842687", "user_data": "}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:44:23.626669 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-a76fcdac-b971-4d14-8db3-703a3a3b0721 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] 10.222.0.33 "DELETE /compute/v2.1/os-floating-ips/ffd78ef7-a042-4aa3-a55f-e9372d50057c" status: 202 len: 0 microversion: 2.1 time: 4.545678 Oct 04 20:44:23.627213 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1223/2374] 10.222.0.33 () {58 vars in 1263 bytes} [Tue Oct 4 20:44:19 2022] DELETE /compute/v2.1/os-floating-ips/ffd78ef7-a042-4aa3-a55f-e9372d50057c => generated 0 bytes in 4548 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:44:23.631980 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-26d3bf92-52b9-4515-8157-40402e8b6da4 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:44:23.632543 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-26d3bf92-52b9-4515-8157-40402e8b6da4 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] [instance: c0a14e22-0620-4912-9893-62974c80978a] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:44:23.648796 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-26d3bf92-52b9-4515-8157-40402e8b6da4 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:23.649301 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-26d3bf92-52b9-4515-8157-40402e8b6da4 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:23.649866 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-26d3bf92-52b9-4515-8157-40402e8b6da4 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:23.651814 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-26d3bf92-52b9-4515-8157-40402e8b6da4 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:23.653877 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-26d3bf92-52b9-4515-8157-40402e8b6da4 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:23.654524 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-26d3bf92-52b9-4515-8157-40402e8b6da4 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:23.948562 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.network.neutron [None req-46cd1ece-9577-48e1-9f64-cd2ca39d0988 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] validate_networks() for [('f233dbb4-a3a0-4530-9ca7-211ce7f5e292', None, None, None, None, None)] {{(pid=128801) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:44:24.317340 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-26d3bf92-52b9-4515-8157-40402e8b6da4 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28399882314945d787a3af6eb59935c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5392c67506f7445ab33d62b191558f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:44:24.334058 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-26d3bf92-52b9-4515-8157-40402e8b6da4 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28399882314945d787a3af6eb59935c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5392c67506f7445ab33d62b191558f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:44:24.335576 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-26d3bf92-52b9-4515-8157-40402e8b6da4 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28399882314945d787a3af6eb59935c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5392c67506f7445ab33d62b191558f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:44:24.336758 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-26d3bf92-52b9-4515-8157-40402e8b6da4 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] 10.222.0.33 "GET /compute/v2.1/servers/c0a14e22-0620-4912-9893-62974c80978a" status: 200 len: 1879 microversion: 2.32 time: 0.708649 Oct 04 20:44:24.340853 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1224/2375] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:44:23 2022] GET /compute/v2.1/servers/c0a14e22-0620-4912-9893-62974c80978a => generated 1879 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:44:24.346210 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-febdf171-7f13-4bdd-ad80-090ca931ab78 req-22c0177e-56a5-42e5-9e33-9665d4dc4b71 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f127014-9e6f-47e6-b8a5-94ca91e0836c", "tag": "41cf3ea7-346f-4732-8f44-216a5cd39ef1"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:44:24.358429 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-febdf171-7f13-4bdd-ad80-090ca931ab78 req-22c0177e-56a5-42e5-9e33-9665d4dc4b71 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:24.359320 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-febdf171-7f13-4bdd-ad80-090ca931ab78 req-22c0177e-56a5-42e5-9e33-9665d4dc4b71 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:24.360406 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-febdf171-7f13-4bdd-ad80-090ca931ab78 req-22c0177e-56a5-42e5-9e33-9665d4dc4b71 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:24.399598 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-febdf171-7f13-4bdd-ad80-090ca931ab78 req-22c0177e-56a5-42e5-9e33-9665d4dc4b71 service nova] Creating event network-changed:41cf3ea7-346f-4732-8f44-216a5cd39ef1 for instance 0f127014-9e6f-47e6-b8a5-94ca91e0836c on n-h1-854823-8 Oct 04 20:44:24.408368 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-febdf171-7f13-4bdd-ad80-090ca931ab78 req-22c0177e-56a5-42e5-9e33-9665d4dc4b71 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066199 Oct 04 20:44:24.412380 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1225/2376] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:44:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:44:24.436882 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-248a0db7-0d70-4d4e-bed6-4551991da165 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-655608880", "imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1b6eb29e-dbc2-4007-8946-b5a4c5a89268"}], "security_groups": [{"name": "tempest-securitygroup--767346951"}], "key_name": "tempest-keypair-2092395144", "user_data": "}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:44:24.499894 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=11,nova_api:UPDATE=8 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:44:24.793944 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.network.neutron [None req-248a0db7-0d70-4d4e-bed6-4551991da165 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] validate_networks() for [('1b6eb29e-dbc2-4007-8946-b5a4c5a89268', None, None, None, None, None)] {{(pid=128802) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:44:24.890877 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-46cd1ece-9577-48e1-9f64-cd2ca39d0988 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Flavor limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:44:24.891358 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-46cd1ece-9577-48e1-9f64-cd2ca39d0988 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Image limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:44:24.891971 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-46cd1ece-9577-48e1-9f64-cd2ca39d0988 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Flavor pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:44:24.892628 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-46cd1ece-9577-48e1-9f64-cd2ca39d0988 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Image pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:44:24.893058 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-46cd1ece-9577-48e1-9f64-cd2ca39d0988 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:44:24.905773 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-46cd1ece-9577-48e1-9f64-cd2ca39d0988 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:24.908493 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-46cd1ece-9577-48e1-9f64-cd2ca39d0988 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:24.909126 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-46cd1ece-9577-48e1-9f64-cd2ca39d0988 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:24.912490 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-46cd1ece-9577-48e1-9f64-cd2ca39d0988 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:24.913174 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-46cd1ece-9577-48e1-9f64-cd2ca39d0988 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:24.913624 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-46cd1ece-9577-48e1-9f64-cd2ca39d0988 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:24.952969 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-46cd1ece-9577-48e1-9f64-cd2ca39d0988 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Getting quotas for project 8b0670d1bd99424780a70e69d57a2166. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:44:24.965135 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-46cd1ece-9577-48e1-9f64-cd2ca39d0988 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Getting quotas for user eac650232cc04810b1340dc2f0edadcc and project 8b0670d1bd99424780a70e69d57a2166. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:44:24.981249 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-46cd1ece-9577-48e1-9f64-cd2ca39d0988 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Going to run 1 instances... {{(pid=128801) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:44:24.984042 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-46cd1ece-9577-48e1-9f64-cd2ca39d0988 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: 4d46fff2-b04d-41aa-ada0-2023ab545b48] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='15b24725-0c99-4bcf-b1fb-907cdf8e2d63',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128801) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:44:25.038740 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-46cd1ece-9577-48e1-9f64-cd2ca39d0988 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.607864 Oct 04 20:44:25.039947 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1152/2377] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 20:44:23 2022] POST /compute/v2.1/servers => generated 408 bytes in 1610 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 20:44:25.045783 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c1a0fece-51d1-44b5-bb2d-a1031a3b87cf tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:44:25.046824 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c1a0fece-51d1-44b5-bb2d-a1031a3b87cf tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] [instance: c147993c-5773-4b76-93bc-62c0cbb6044a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:44:25.055277 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c1a0fece-51d1-44b5-bb2d-a1031a3b87cf tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:25.055956 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c1a0fece-51d1-44b5-bb2d-a1031a3b87cf tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:25.056723 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c1a0fece-51d1-44b5-bb2d-a1031a3b87cf tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:25.057747 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c1a0fece-51d1-44b5-bb2d-a1031a3b87cf tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:25.058843 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c1a0fece-51d1-44b5-bb2d-a1031a3b87cf tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:25.059431 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c1a0fece-51d1-44b5-bb2d-a1031a3b87cf tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:25.398706 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c1a0fece-51d1-44b5-bb2d-a1031a3b87cf tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e1e240b20e41e8b90e0d630e0d6b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a44744f2bb4130b9a49065b49cf854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:44:25.408383 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c1a0fece-51d1-44b5-bb2d-a1031a3b87cf tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] 10.222.0.33 "GET /compute/v2.1/servers/c147993c-5773-4b76-93bc-62c0cbb6044a" status: 200 len: 1334 microversion: 2.1 time: 0.367089 Oct 04 20:44:25.426530 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1153/2378] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:44:25 2022] GET /compute/v2.1/servers/c147993c-5773-4b76-93bc-62c0cbb6044a => generated 1334 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:44:25.431409 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2142f8b0-d23b-48a4-af9c-ccd7d06b8ef7 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:44:25.432226 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-2142f8b0-d23b-48a4-af9c-ccd7d06b8ef7 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] [instance: 659f073c-b8c2-48d3-8c09-fef755291460] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:44:25.443548 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2142f8b0-d23b-48a4-af9c-ccd7d06b8ef7 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:25.444057 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2142f8b0-d23b-48a4-af9c-ccd7d06b8ef7 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:25.444499 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2142f8b0-d23b-48a4-af9c-ccd7d06b8ef7 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:25.445219 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2142f8b0-d23b-48a4-af9c-ccd7d06b8ef7 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:25.445677 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2142f8b0-d23b-48a4-af9c-ccd7d06b8ef7 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:25.446098 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2142f8b0-d23b-48a4-af9c-ccd7d06b8ef7 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:25.481709 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-2142f8b0-d23b-48a4-af9c-ccd7d06b8ef7 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] [instance: 659f073c-b8c2-48d3-8c09-fef755291460] Going to try to terminate instance {{(pid=128801) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:44:25.637784 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-2142f8b0-d23b-48a4-af9c-ccd7d06b8ef7 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] 10.222.0.33 "DELETE /compute/v2.1/servers/659f073c-b8c2-48d3-8c09-fef755291460" status: 204 len: 0 microversion: 2.1 time: 0.221803 Oct 04 20:44:25.638822 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1154/2379] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 20:44:25 2022] DELETE /compute/v2.1/servers/659f073c-b8c2-48d3-8c09-fef755291460 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:44:25.653651 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e870afc8-8ed0-40af-a696-80db7d9aa186 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:44:25.654573 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e870afc8-8ed0-40af-a696-80db7d9aa186 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] [instance: 0f127014-9e6f-47e6-b8a5-94ca91e0836c] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:44:25.668908 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e870afc8-8ed0-40af-a696-80db7d9aa186 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:25.669512 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e870afc8-8ed0-40af-a696-80db7d9aa186 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:25.669989 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e870afc8-8ed0-40af-a696-80db7d9aa186 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:25.670846 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e870afc8-8ed0-40af-a696-80db7d9aa186 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:25.679300 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e870afc8-8ed0-40af-a696-80db7d9aa186 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:25.680016 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e870afc8-8ed0-40af-a696-80db7d9aa186 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:25.688725 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-248a0db7-0d70-4d4e-bed6-4551991da165 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Flavor limits 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:44:25.689287 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-248a0db7-0d70-4d4e-bed6-4551991da165 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Image limits 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:44:25.689869 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-248a0db7-0d70-4d4e-bed6-4551991da165 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Flavor pref 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:44:25.690405 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-248a0db7-0d70-4d4e-bed6-4551991da165 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Image pref 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:44:25.691054 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-248a0db7-0d70-4d4e-bed6-4551991da165 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:44:25.710882 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-248a0db7-0d70-4d4e-bed6-4551991da165 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:25.717360 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-248a0db7-0d70-4d4e-bed6-4551991da165 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:25.718256 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-248a0db7-0d70-4d4e-bed6-4551991da165 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:25.719338 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-248a0db7-0d70-4d4e-bed6-4551991da165 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:25.720039 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-248a0db7-0d70-4d4e-bed6-4551991da165 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:25.720688 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-248a0db7-0d70-4d4e-bed6-4551991da165 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:25.762673 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-248a0db7-0d70-4d4e-bed6-4551991da165 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Getting quotas for project fc7f38600b5041ad8e66a12d77b940fa. Resources: {'ram', 'instances', 'cores'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:44:25.769151 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-248a0db7-0d70-4d4e-bed6-4551991da165 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Getting quotas for user d9e4b00964014a0383f79597652bd428 and project fc7f38600b5041ad8e66a12d77b940fa. Resources: {'ram', 'instances', 'cores'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:44:25.785745 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-248a0db7-0d70-4d4e-bed6-4551991da165 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Going to run 1 instances... {{(pid=128802) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:44:25.788898 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-248a0db7-0d70-4d4e-bed6-4551991da165 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] [instance: 07fdb076-59a4-4c77-a42b-07fa92bcf408] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='15b24725-0c99-4bcf-b1fb-907cdf8e2d63',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128802) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:44:25.887594 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-248a0db7-0d70-4d4e-bed6-4551991da165 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.469396 Oct 04 20:44:25.889746 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1226/2380] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 20:44:24 2022] POST /compute/v2.1/servers => generated 401 bytes in 1476 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 20:44:25.901240 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-2a8d55f2-9e27-4092-b05d-55f5f48959de tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:44:25.902316 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-2a8d55f2-9e27-4092-b05d-55f5f48959de tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: 4d46fff2-b04d-41aa-ada0-2023ab545b48] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:44:25.911252 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2a8d55f2-9e27-4092-b05d-55f5f48959de tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:25.911902 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2a8d55f2-9e27-4092-b05d-55f5f48959de tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:25.912585 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2a8d55f2-9e27-4092-b05d-55f5f48959de tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:25.913438 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2a8d55f2-9e27-4092-b05d-55f5f48959de tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:25.914039 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2a8d55f2-9e27-4092-b05d-55f5f48959de tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:25.914914 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2a8d55f2-9e27-4092-b05d-55f5f48959de tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:26.070705 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-2a8d55f2-9e27-4092-b05d-55f5f48959de tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac650232cc04810b1340dc2f0edadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b0670d1bd99424780a70e69d57a2166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:44:26.076186 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e870afc8-8ed0-40af-a696-80db7d9aa186 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87dcc7baf63f4ae6bfe0a099adffd408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7097bc12179446f6a3e1fac8434d5c64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:44:26.091899 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e870afc8-8ed0-40af-a696-80db7d9aa186 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] 10.222.0.33 "GET /compute/v2.1/servers/0f127014-9e6f-47e6-b8a5-94ca91e0836c" status: 200 len: 1293 microversion: 2.1 time: 0.451127 Oct 04 20:44:26.093383 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-2a8d55f2-9e27-4092-b05d-55f5f48959de tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48" status: 200 len: 1234 microversion: 2.1 time: 0.201893 Oct 04 20:44:26.093984 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1155/2381] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:44:25 2022] GET /compute/v2.1/servers/0f127014-9e6f-47e6-b8a5-94ca91e0836c => generated 1293 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:44:26.136949 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1227/2382] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:44:25 2022] GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48 => generated 1234 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:44:26.150134 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-9a94093c-cf76-490b-92a7-758e810aaac6 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:44:26.159419 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-9a94093c-cf76-490b-92a7-758e810aaac6 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] [instance: c0a14e22-0620-4912-9893-62974c80978a] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:44:26.184684 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9a94093c-cf76-490b-92a7-758e810aaac6 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:26.185171 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9a94093c-cf76-490b-92a7-758e810aaac6 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:26.185604 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9a94093c-cf76-490b-92a7-758e810aaac6 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:26.186319 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9a94093c-cf76-490b-92a7-758e810aaac6 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:26.189026 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9a94093c-cf76-490b-92a7-758e810aaac6 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:26.189834 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9a94093c-cf76-490b-92a7-758e810aaac6 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:26.341534 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-3f163d9a-8843-42b5-ab5b-258b0e024cd4 tempest-QuotasAdminTestJSON-198957168 tempest-QuotasAdminTestJSON-198957168-project-admin] Calling method '.version_select at 0x7f3c743fe1f0>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:44:26.429195 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-3f163d9a-8843-42b5-ab5b-258b0e024cd4 tempest-QuotasAdminTestJSON-198957168 tempest-QuotasAdminTestJSON-198957168-project-admin] 10.222.0.33 "GET /compute/v2.1/os-quota-sets/e9be9f2aeefc4db3b153c34f776718a7" status: 200 len: 371 microversion: 2.1 time: 0.333409 Oct 04 20:44:26.434043 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1156/2383] 10.222.0.33 () {58 vars in 1242 bytes} [Tue Oct 4 20:44:26 2022] GET /compute/v2.1/os-quota-sets/e9be9f2aeefc4db3b153c34f776718a7 => generated 371 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:44:26.437849 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-de75266e-9e45-4863-a144-10b659c5facc tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:44:26.438502 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-de75266e-9e45-4863-a144-10b659c5facc tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] [instance: 659f073c-b8c2-48d3-8c09-fef755291460] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:44:26.461443 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-de75266e-9e45-4863-a144-10b659c5facc tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:26.462909 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-de75266e-9e45-4863-a144-10b659c5facc tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:26.463951 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-de75266e-9e45-4863-a144-10b659c5facc tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:26.464618 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-de75266e-9e45-4863-a144-10b659c5facc tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:26.465147 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-de75266e-9e45-4863-a144-10b659c5facc tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:26.465817 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-de75266e-9e45-4863-a144-10b659c5facc tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:26.535512 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-9a94093c-cf76-490b-92a7-758e810aaac6 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28399882314945d787a3af6eb59935c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5392c67506f7445ab33d62b191558f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:44:26.558567 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-9a94093c-cf76-490b-92a7-758e810aaac6 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28399882314945d787a3af6eb59935c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5392c67506f7445ab33d62b191558f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:44:26.560084 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-9a94093c-cf76-490b-92a7-758e810aaac6 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28399882314945d787a3af6eb59935c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5392c67506f7445ab33d62b191558f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:44:26.561588 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-9a94093c-cf76-490b-92a7-758e810aaac6 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] 10.222.0.33 "GET /compute/v2.1/servers/c0a14e22-0620-4912-9893-62974c80978a" status: 200 len: 1879 microversion: 2.32 time: 0.418284 Oct 04 20:44:26.562665 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1228/2384] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:44:26 2022] GET /compute/v2.1/servers/c0a14e22-0620-4912-9893-62974c80978a => generated 1879 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:44:26.580414 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-2d732cde-a76f-469b-9458-f99ac8c4c99d tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:44:26.581292 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-2d732cde-a76f-469b-9458-f99ac8c4c99d tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] [instance: 07fdb076-59a4-4c77-a42b-07fa92bcf408] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:44:26.656495 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-2d732cde-a76f-469b-9458-f99ac8c4c99d tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e4b00964014a0383f79597652bd428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7f38600b5041ad8e66a12d77b940fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:44:26.663897 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-2d732cde-a76f-469b-9458-f99ac8c4c99d tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] 10.222.0.33 "GET /compute/v2.1/servers/07fdb076-59a4-4c77-a42b-07fa92bcf408" status: 200 len: 1241 microversion: 2.1 time: 0.099683 Oct 04 20:44:26.665199 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1229/2385] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:44:26 2022] GET /compute/v2.1/servers/07fdb076-59a4-4c77-a42b-07fa92bcf408 => generated 1241 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:44:26.670781 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-1fe36806-09d8-4a70-a9d9-1b5cc1dd1862 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:44:26.671351 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-1fe36806-09d8-4a70-a9d9-1b5cc1dd1862 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] [instance: 83df4756-40e2-4fc6-be48-48a82dd4572a] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:44:26.675330 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-de75266e-9e45-4863-a144-10b659c5facc tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07c500628d414c9983836c33563b38bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f258cb1ecd049078b201eb41692735a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:44:26.679062 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1fe36806-09d8-4a70-a9d9-1b5cc1dd1862 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:26.679856 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1fe36806-09d8-4a70-a9d9-1b5cc1dd1862 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:26.680479 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1fe36806-09d8-4a70-a9d9-1b5cc1dd1862 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:26.681419 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1fe36806-09d8-4a70-a9d9-1b5cc1dd1862 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:26.682073 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1fe36806-09d8-4a70-a9d9-1b5cc1dd1862 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:26.682576 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1fe36806-09d8-4a70-a9d9-1b5cc1dd1862 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:26.693115 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-de75266e-9e45-4863-a144-10b659c5facc tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] 10.222.0.33 "GET /compute/v2.1/servers/659f073c-b8c2-48d3-8c09-fef755291460" status: 200 len: 1526 microversion: 2.1 time: 0.259650 Oct 04 20:44:26.703054 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1157/2386] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:44:26 2022] GET /compute/v2.1/servers/659f073c-b8c2-48d3-8c09-fef755291460 => generated 1526 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:44:26.719587 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-3e2e9fa2-d36e-4012-82a9-854ce6255420 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:44:26.721572 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-3e2e9fa2-d36e-4012-82a9-854ce6255420 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] [instance: c147993c-5773-4b76-93bc-62c0cbb6044a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:44:26.724815 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=6,nova_api:UPDATE=13 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:44:26.736059 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3e2e9fa2-d36e-4012-82a9-854ce6255420 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:26.737031 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3e2e9fa2-d36e-4012-82a9-854ce6255420 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:26.737168 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-1fe36806-09d8-4a70-a9d9-1b5cc1dd1862 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] [instance: 83df4756-40e2-4fc6-be48-48a82dd4572a] Going to try to terminate instance {{(pid=128802) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:44:26.737838 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3e2e9fa2-d36e-4012-82a9-854ce6255420 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:26.739265 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3e2e9fa2-d36e-4012-82a9-854ce6255420 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:26.739960 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3e2e9fa2-d36e-4012-82a9-854ce6255420 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:26.740933 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3e2e9fa2-d36e-4012-82a9-854ce6255420 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:26.909916 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-1fe36806-09d8-4a70-a9d9-1b5cc1dd1862 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] 10.222.0.33 "DELETE /compute/v2.1/servers/83df4756-40e2-4fc6-be48-48a82dd4572a" status: 204 len: 0 microversion: 2.1 time: 0.241979 Oct 04 20:44:26.911490 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1230/2387] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 20:44:26 2022] DELETE /compute/v2.1/servers/83df4756-40e2-4fc6-be48-48a82dd4572a => generated 0 bytes in 246 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:44:26.924813 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-d8f9fb1e-7b42-47f8-a30b-88d5ef738b9f tempest-QuotasAdminTestJSON-198957168 tempest-QuotasAdminTestJSON-198957168-project-admin] Action: 'update', calling method: .version_select at 0x7f3c788c9160>, body: {"quota_set": {"ram": "5120"}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:44:27.059772 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d8f9fb1e-7b42-47f8-a30b-88d5ef738b9f tempest-QuotasAdminTestJSON-198957168 tempest-QuotasAdminTestJSON-198957168-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:27.061473 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d8f9fb1e-7b42-47f8-a30b-88d5ef738b9f tempest-QuotasAdminTestJSON-198957168 tempest-QuotasAdminTestJSON-198957168-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:27.063116 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d8f9fb1e-7b42-47f8-a30b-88d5ef738b9f tempest-QuotasAdminTestJSON-198957168 tempest-QuotasAdminTestJSON-198957168-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:27.064757 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d8f9fb1e-7b42-47f8-a30b-88d5ef738b9f tempest-QuotasAdminTestJSON-198957168 tempest-QuotasAdminTestJSON-198957168-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:27.065906 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d8f9fb1e-7b42-47f8-a30b-88d5ef738b9f tempest-QuotasAdminTestJSON-198957168 tempest-QuotasAdminTestJSON-198957168-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:27.067489 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d8f9fb1e-7b42-47f8-a30b-88d5ef738b9f tempest-QuotasAdminTestJSON-198957168 tempest-QuotasAdminTestJSON-198957168-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:27.203212 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-d8f9fb1e-7b42-47f8-a30b-88d5ef738b9f tempest-QuotasAdminTestJSON-198957168 tempest-QuotasAdminTestJSON-198957168-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-quota-sets/e9be9f2aeefc4db3b153c34f776718a7" status: 200 len: 328 microversion: 2.1 time: 0.288688 Oct 04 20:44:27.204561 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1231/2388] 10.222.0.33 () {60 vars in 1262 bytes} [Tue Oct 4 20:44:26 2022] PUT /compute/v2.1/os-quota-sets/e9be9f2aeefc4db3b153c34f776718a7 => generated 328 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:44:27.220891 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-23280ba7-80ea-45eb-953a-8ac9a1915a48 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:44:27.221649 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-23280ba7-80ea-45eb-953a-8ac9a1915a48 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] [instance: 83df4756-40e2-4fc6-be48-48a82dd4572a] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:44:27.229823 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-23280ba7-80ea-45eb-953a-8ac9a1915a48 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:27.230319 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-23280ba7-80ea-45eb-953a-8ac9a1915a48 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:27.230803 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-23280ba7-80ea-45eb-953a-8ac9a1915a48 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:27.231524 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-23280ba7-80ea-45eb-953a-8ac9a1915a48 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:27.231984 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-23280ba7-80ea-45eb-953a-8ac9a1915a48 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:27.232536 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-23280ba7-80ea-45eb-953a-8ac9a1915a48 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:27.774848 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-23280ba7-80ea-45eb-953a-8ac9a1915a48 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '800db3a57ada47eca381b00189fdbf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66ec8ea91b04deb90b679589e0495bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:44:27.790019 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-23280ba7-80ea-45eb-953a-8ac9a1915a48 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] 10.222.0.33 "GET /compute/v2.1/servers/83df4756-40e2-4fc6-be48-48a82dd4572a" status: 200 len: 1668 microversion: 2.1 time: 0.583420 Oct 04 20:44:27.793247 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1232/2389] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:44:27 2022] GET /compute/v2.1/servers/83df4756-40e2-4fc6-be48-48a82dd4572a => generated 1668 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:44:27.796404 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-3e2e9fa2-d36e-4012-82a9-854ce6255420 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e1e240b20e41e8b90e0d630e0d6b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a44744f2bb4130b9a49065b49cf854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:44:27.805510 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-3e2e9fa2-d36e-4012-82a9-854ce6255420 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] 10.222.0.33 "GET /compute/v2.1/servers/c147993c-5773-4b76-93bc-62c0cbb6044a" status: 200 len: 1334 microversion: 2.1 time: 1.091314 Oct 04 20:44:27.810713 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-462a3e3e-3e02-4eeb-976a-18a7be77a368 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:44:27.811683 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-462a3e3e-3e02-4eeb-976a-18a7be77a368 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] [instance: 0f127014-9e6f-47e6-b8a5-94ca91e0836c] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:44:27.814269 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1158/2390] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:44:26 2022] GET /compute/v2.1/servers/c147993c-5773-4b76-93bc-62c0cbb6044a => generated 1334 bytes in 1110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:44:27.825603 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-40a00fd6-2aea-4cbf-9f45-98973135d97f tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:44:27.827141 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-40a00fd6-2aea-4cbf-9f45-98973135d97f tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: 4d46fff2-b04d-41aa-ada0-2023ab545b48] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:44:27.829958 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-462a3e3e-3e02-4eeb-976a-18a7be77a368 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:27.831022 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-462a3e3e-3e02-4eeb-976a-18a7be77a368 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:27.833881 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-462a3e3e-3e02-4eeb-976a-18a7be77a368 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:27.835449 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-462a3e3e-3e02-4eeb-976a-18a7be77a368 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:27.840163 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-40a00fd6-2aea-4cbf-9f45-98973135d97f tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:27.840909 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-462a3e3e-3e02-4eeb-976a-18a7be77a368 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:27.841229 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-40a00fd6-2aea-4cbf-9f45-98973135d97f tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:27.841473 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-462a3e3e-3e02-4eeb-976a-18a7be77a368 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:27.842078 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-40a00fd6-2aea-4cbf-9f45-98973135d97f tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:27.843038 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-40a00fd6-2aea-4cbf-9f45-98973135d97f tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:27.843717 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-40a00fd6-2aea-4cbf-9f45-98973135d97f tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:27.844344 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-40a00fd6-2aea-4cbf-9f45-98973135d97f tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:28.020084 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-40a00fd6-2aea-4cbf-9f45-98973135d97f tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac650232cc04810b1340dc2f0edadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b0670d1bd99424780a70e69d57a2166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:44:28.029717 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-40a00fd6-2aea-4cbf-9f45-98973135d97f tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48" status: 200 len: 1296 microversion: 2.1 time: 0.211587 Oct 04 20:44:28.030302 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1159/2391] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:44:27 2022] GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48 => generated 1296 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:44:28.054064 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2785aea6-2dbb-410c-8815-79c70df55f67 tempest-QuotasAdminTestJSON-198957168 tempest-QuotasAdminTestJSON-198957168-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:44:28.071625 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-2785aea6-2dbb-410c-8815-79c70df55f67 tempest-QuotasAdminTestJSON-198957168 tempest-QuotasAdminTestJSON-198957168-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-quota-sets/e9be9f2aeefc4db3b153c34f776718a7" status: 202 len: 0 microversion: 2.1 time: 0.023400 Oct 04 20:44:28.073056 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1160/2392] 10.222.0.33 () {58 vars in 1245 bytes} [Tue Oct 4 20:44:28 2022] DELETE /compute/v2.1/os-quota-sets/e9be9f2aeefc4db3b153c34f776718a7 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:44:28.082920 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-4e9935f1-118a-4691-9d89-41df7700d54d tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:44:28.084433 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-4e9935f1-118a-4691-9d89-41df7700d54d tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] [instance: c0a14e22-0620-4912-9893-62974c80978a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:44:28.095797 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4e9935f1-118a-4691-9d89-41df7700d54d tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:28.096513 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4e9935f1-118a-4691-9d89-41df7700d54d tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:28.105034 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4e9935f1-118a-4691-9d89-41df7700d54d tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:28.106322 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4e9935f1-118a-4691-9d89-41df7700d54d tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:28.107014 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4e9935f1-118a-4691-9d89-41df7700d54d tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:28.107636 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4e9935f1-118a-4691-9d89-41df7700d54d tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:28.379432 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-462a3e3e-3e02-4eeb-976a-18a7be77a368 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87dcc7baf63f4ae6bfe0a099adffd408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7097bc12179446f6a3e1fac8434d5c64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:44:28.392307 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-462a3e3e-3e02-4eeb-976a-18a7be77a368 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] 10.222.0.33 "GET /compute/v2.1/servers/0f127014-9e6f-47e6-b8a5-94ca91e0836c" status: 200 len: 1293 microversion: 2.1 time: 0.596591 Oct 04 20:44:28.406382 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1233/2393] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:44:27 2022] GET /compute/v2.1/servers/0f127014-9e6f-47e6-b8a5-94ca91e0836c => generated 1293 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:44:28.406382 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-03cbd1c1-c509-4237-bd65-87684d9fec87 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:44:28.406382 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-03cbd1c1-c509-4237-bd65-87684d9fec87 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] [instance: 07fdb076-59a4-4c77-a42b-07fa92bcf408] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:44:28.412157 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-03cbd1c1-c509-4237-bd65-87684d9fec87 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:28.412157 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-03cbd1c1-c509-4237-bd65-87684d9fec87 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:28.412157 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-03cbd1c1-c509-4237-bd65-87684d9fec87 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:28.413063 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-03cbd1c1-c509-4237-bd65-87684d9fec87 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:28.413572 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-03cbd1c1-c509-4237-bd65-87684d9fec87 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:28.414532 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-03cbd1c1-c509-4237-bd65-87684d9fec87 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:28.527553 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-03cbd1c1-c509-4237-bd65-87684d9fec87 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e4b00964014a0383f79597652bd428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7f38600b5041ad8e66a12d77b940fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:44:28.537594 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-03cbd1c1-c509-4237-bd65-87684d9fec87 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] 10.222.0.33 "GET /compute/v2.1/servers/07fdb076-59a4-4c77-a42b-07fa92bcf408" status: 200 len: 1299 microversion: 2.1 time: 0.142520 Oct 04 20:44:28.551422 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1234/2394] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:44:28 2022] GET /compute/v2.1/servers/07fdb076-59a4-4c77-a42b-07fa92bcf408 => generated 1299 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:44:28.559162 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-3939f058-7827-4392-b837-107b82708c08 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:44:28.560426 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-3939f058-7827-4392-b837-107b82708c08 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] [instance: 659f073c-b8c2-48d3-8c09-fef755291460] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:44:28.567466 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3939f058-7827-4392-b837-107b82708c08 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:28.567947 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3939f058-7827-4392-b837-107b82708c08 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:28.568380 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3939f058-7827-4392-b837-107b82708c08 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:28.569090 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3939f058-7827-4392-b837-107b82708c08 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:28.569989 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3939f058-7827-4392-b837-107b82708c08 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:28.569989 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3939f058-7827-4392-b837-107b82708c08 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:28.612011 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-4e9935f1-118a-4691-9d89-41df7700d54d tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28399882314945d787a3af6eb59935c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5392c67506f7445ab33d62b191558f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:44:28.616369 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=95,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=2,nova_cell1:RELEASE=1,nova_cell1:INSERT=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:44:28.629566 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-4e9935f1-118a-4691-9d89-41df7700d54d tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28399882314945d787a3af6eb59935c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5392c67506f7445ab33d62b191558f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:44:28.632572 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-4e9935f1-118a-4691-9d89-41df7700d54d tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28399882314945d787a3af6eb59935c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5392c67506f7445ab33d62b191558f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:44:28.634166 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-4e9935f1-118a-4691-9d89-41df7700d54d tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] 10.222.0.33 "GET /compute/v2.1/servers/c0a14e22-0620-4912-9893-62974c80978a" status: 200 len: 2829 microversion: 2.32 time: 0.559746 Oct 04 20:44:28.635664 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1161/2395] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:44:28 2022] GET /compute/v2.1/servers/c0a14e22-0620-4912-9893-62974c80978a => generated 2829 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:44:28.640663 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-35630e5c-ec5a-426f-8a62-a66df857ddbc tempest-QuotasAdminTestJSON-198957168 tempest-QuotasAdminTestJSON-198957168-project-admin] Calling method '.version_select at 0x7f3c746ca820>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:44:28.763550 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-35630e5c-ec5a-426f-8a62-a66df857ddbc tempest-QuotasAdminTestJSON-198957168 tempest-QuotasAdminTestJSON-198957168-project-admin] 10.222.0.33 "GET /compute/v2.1/os-quota-sets/e9be9f2aeefc4db3b153c34f776718a7" status: 200 len: 371 microversion: 2.1 time: 0.126472 Oct 04 20:44:28.769939 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-3939f058-7827-4392-b837-107b82708c08 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07c500628d414c9983836c33563b38bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f258cb1ecd049078b201eb41692735a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:44:28.786218 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1162/2396] 10.222.0.33 () {58 vars in 1242 bytes} [Tue Oct 4 20:44:28 2022] GET /compute/v2.1/os-quota-sets/e9be9f2aeefc4db3b153c34f776718a7 => generated 371 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:44:28.787332 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-3939f058-7827-4392-b837-107b82708c08 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] 10.222.0.33 "GET /compute/v2.1/servers/659f073c-b8c2-48d3-8c09-fef755291460" status: 200 len: 1484 microversion: 2.1 time: 0.232342 Oct 04 20:44:28.789613 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1235/2397] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:44:28 2022] GET /compute/v2.1/servers/659f073c-b8c2-48d3-8c09-fef755291460 => generated 1484 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:44:28.793538 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-932878c0-f923-403c-bfda-2d5ba51f2a32 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:44:28.794037 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-932878c0-f923-403c-bfda-2d5ba51f2a32 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] [instance: c0a14e22-0620-4912-9893-62974c80978a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:44:28.812999 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-932878c0-f923-403c-bfda-2d5ba51f2a32 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:28.814189 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-932878c0-f923-403c-bfda-2d5ba51f2a32 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:28.814809 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-932878c0-f923-403c-bfda-2d5ba51f2a32 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:28.816050 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-932878c0-f923-403c-bfda-2d5ba51f2a32 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:28.817248 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-932878c0-f923-403c-bfda-2d5ba51f2a32 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:28.817530 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-dcec9159-734a-4da5-b10c-6ea4a1101b7f tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:44:28.817987 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-932878c0-f923-403c-bfda-2d5ba51f2a32 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:28.818510 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-dcec9159-734a-4da5-b10c-6ea4a1101b7f tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] [instance: 83df4756-40e2-4fc6-be48-48a82dd4572a] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:44:28.835780 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dcec9159-734a-4da5-b10c-6ea4a1101b7f tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:28.835780 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dcec9159-734a-4da5-b10c-6ea4a1101b7f tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:28.836380 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dcec9159-734a-4da5-b10c-6ea4a1101b7f tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:28.837130 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dcec9159-734a-4da5-b10c-6ea4a1101b7f tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:28.837594 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dcec9159-734a-4da5-b10c-6ea4a1101b7f tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:28.840288 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dcec9159-734a-4da5-b10c-6ea4a1101b7f tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:29.178808 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-932878c0-f923-403c-bfda-2d5ba51f2a32 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] 10.222.0.33 "GET /compute/v2.1/servers/c0a14e22-0620-4912-9893-62974c80978a/os-interface" status: 200 len: 1829 microversion: 2.32 time: 0.390920 Oct 04 20:44:29.197228 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1163/2398] 10.222.0.33 () {60 vars in 1316 bytes} [Tue Oct 4 20:44:28 2022] GET /compute/v2.1/servers/c0a14e22-0620-4912-9893-62974c80978a/os-interface => generated 1829 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:44:29.203831 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-59bf03a9-88ce-4fdc-abd3-dd4350d2834e tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:44:29.205041 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-59bf03a9-88ce-4fdc-abd3-dd4350d2834e tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] [instance: c147993c-5773-4b76-93bc-62c0cbb6044a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:44:29.226672 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-59bf03a9-88ce-4fdc-abd3-dd4350d2834e tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:29.233054 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-59bf03a9-88ce-4fdc-abd3-dd4350d2834e tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:29.234251 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-59bf03a9-88ce-4fdc-abd3-dd4350d2834e tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:29.235264 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-59bf03a9-88ce-4fdc-abd3-dd4350d2834e tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:29.238007 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-59bf03a9-88ce-4fdc-abd3-dd4350d2834e tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:29.238993 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-59bf03a9-88ce-4fdc-abd3-dd4350d2834e tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:29.486935 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-dcec9159-734a-4da5-b10c-6ea4a1101b7f tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '800db3a57ada47eca381b00189fdbf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66ec8ea91b04deb90b679589e0495bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:44:29.497115 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-dcec9159-734a-4da5-b10c-6ea4a1101b7f tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] 10.222.0.33 "GET /compute/v2.1/servers/83df4756-40e2-4fc6-be48-48a82dd4572a" status: 200 len: 1668 microversion: 2.1 time: 0.684372 Oct 04 20:44:29.498238 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1236/2399] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:44:28 2022] GET /compute/v2.1/servers/83df4756-40e2-4fc6-be48-48a82dd4572a => generated 1668 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:44:29.512651 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-de904ef2-95f0-4ca1-81f4-1c9c96d4b966 req-3eb05694-7656-4716-b24c-58149d10b7db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "659f073c-b8c2-48d3-8c09-fef755291460", "name": "network-vif-deleted", "tag": "267a2eeb-d782-40d7-865d-522dfe433aa5"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:44:29.524389 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-de904ef2-95f0-4ca1-81f4-1c9c96d4b966 req-3eb05694-7656-4716-b24c-58149d10b7db service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:29.525081 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-de904ef2-95f0-4ca1-81f4-1c9c96d4b966 req-3eb05694-7656-4716-b24c-58149d10b7db service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:29.526206 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-de904ef2-95f0-4ca1-81f4-1c9c96d4b966 req-3eb05694-7656-4716-b24c-58149d10b7db service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:29.539455 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-de904ef2-95f0-4ca1-81f4-1c9c96d4b966 req-3eb05694-7656-4716-b24c-58149d10b7db service nova] Creating event network-vif-deleted:267a2eeb-d782-40d7-865d-522dfe433aa5 for instance 659f073c-b8c2-48d3-8c09-fef755291460 on n-h2-854823-8 Oct 04 20:44:29.545306 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-de904ef2-95f0-4ca1-81f4-1c9c96d4b966 req-3eb05694-7656-4716-b24c-58149d10b7db service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046559 Oct 04 20:44:29.547500 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1237/2400] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:44:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:44:29.557314 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-971ce253-7463-486e-882b-731349bbc1ab tempest-QuotasAdminTestJSON-198957168 tempest-QuotasAdminTestJSON-198957168-project-admin] Calling method '.version_select at 0x7f3c74805280>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:44:29.820633 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-971ce253-7463-486e-882b-731349bbc1ab tempest-QuotasAdminTestJSON-198957168 tempest-QuotasAdminTestJSON-198957168-project-admin] 10.222.0.33 "GET /compute/v2.1/os-quota-sets/60f7ce4dcd2d4f449ea5b9822900387a/defaults" status: 200 len: 371 microversion: 2.1 time: 0.271743 Oct 04 20:44:29.822951 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1238/2401] 10.222.0.33 () {58 vars in 1269 bytes} [Tue Oct 4 20:44:29 2022] GET /compute/v2.1/os-quota-sets/60f7ce4dcd2d4f449ea5b9822900387a/defaults => generated 371 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:44:29.843939 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-7b29998b-5fb3-4b2f-ae00-321b7b3ac89a tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:44:29.844703 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-7b29998b-5fb3-4b2f-ae00-321b7b3ac89a tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: 4d46fff2-b04d-41aa-ada0-2023ab545b48] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:44:29.866005 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7b29998b-5fb3-4b2f-ae00-321b7b3ac89a tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:29.866568 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7b29998b-5fb3-4b2f-ae00-321b7b3ac89a tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:29.867206 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7b29998b-5fb3-4b2f-ae00-321b7b3ac89a tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:29.868279 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7b29998b-5fb3-4b2f-ae00-321b7b3ac89a tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:29.868938 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7b29998b-5fb3-4b2f-ae00-321b7b3ac89a tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:29.869705 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7b29998b-5fb3-4b2f-ae00-321b7b3ac89a tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:29.988673 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-59bf03a9-88ce-4fdc-abd3-dd4350d2834e tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e1e240b20e41e8b90e0d630e0d6b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a44744f2bb4130b9a49065b49cf854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:44:29.997124 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-59bf03a9-88ce-4fdc-abd3-dd4350d2834e tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] 10.222.0.33 "GET /compute/v2.1/servers/c147993c-5773-4b76-93bc-62c0cbb6044a" status: 200 len: 1334 microversion: 2.1 time: 0.798270 Oct 04 20:44:29.997598 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1164/2402] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:44:29 2022] GET /compute/v2.1/servers/c147993c-5773-4b76-93bc-62c0cbb6044a => generated 1334 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:44:30.011721 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-7b29998b-5fb3-4b2f-ae00-321b7b3ac89a tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac650232cc04810b1340dc2f0edadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b0670d1bd99424780a70e69d57a2166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:44:30.020881 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-7b29998b-5fb3-4b2f-ae00-321b7b3ac89a tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48" status: 200 len: 1296 microversion: 2.1 time: 0.196512 Oct 04 20:44:30.021490 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1239/2403] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:44:29 2022] GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48 => generated 1296 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:44:30.024587 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-19d5a8d7-547a-4dd1-8d1d-e3dac45498d9 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:44:30.026070 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-19d5a8d7-547a-4dd1-8d1d-e3dac45498d9 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] [instance: 0f127014-9e6f-47e6-b8a5-94ca91e0836c] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:44:30.031191 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-a2a5fee6-291a-4dc9-ba96-44a36fd49f03 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:44:30.031809 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-a2a5fee6-291a-4dc9-ba96-44a36fd49f03 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] [instance: 07fdb076-59a4-4c77-a42b-07fa92bcf408] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:44:30.052220 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-19d5a8d7-547a-4dd1-8d1d-e3dac45498d9 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:30.052724 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-19d5a8d7-547a-4dd1-8d1d-e3dac45498d9 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:30.053158 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-19d5a8d7-547a-4dd1-8d1d-e3dac45498d9 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:30.055540 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-19d5a8d7-547a-4dd1-8d1d-e3dac45498d9 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:30.059102 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a2a5fee6-291a-4dc9-ba96-44a36fd49f03 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:30.059867 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-19d5a8d7-547a-4dd1-8d1d-e3dac45498d9 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:30.060472 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-19d5a8d7-547a-4dd1-8d1d-e3dac45498d9 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:30.064094 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a2a5fee6-291a-4dc9-ba96-44a36fd49f03 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:30.068891 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a2a5fee6-291a-4dc9-ba96-44a36fd49f03 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:30.073570 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a2a5fee6-291a-4dc9-ba96-44a36fd49f03 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:30.074255 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a2a5fee6-291a-4dc9-ba96-44a36fd49f03 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:30.075727 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a2a5fee6-291a-4dc9-ba96-44a36fd49f03 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:30.627948 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-19d5a8d7-547a-4dd1-8d1d-e3dac45498d9 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87dcc7baf63f4ae6bfe0a099adffd408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7097bc12179446f6a3e1fac8434d5c64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:44:30.645789 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-19d5a8d7-547a-4dd1-8d1d-e3dac45498d9 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] 10.222.0.33 "GET /compute/v2.1/servers/0f127014-9e6f-47e6-b8a5-94ca91e0836c" status: 200 len: 1293 microversion: 2.1 time: 0.647069 Oct 04 20:44:30.664990 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1165/2404] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:44:29 2022] GET /compute/v2.1/servers/0f127014-9e6f-47e6-b8a5-94ca91e0836c => generated 1293 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:44:30.673443 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-6c95fbeb-9b12-4246-ac15-3be3c7066a7d req-d55533e1-d29b-4929-b6c4-169cf001cf4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f127014-9e6f-47e6-b8a5-94ca91e0836c", "name": "network-vif-plugged", "status": "completed", "tag": "41cf3ea7-346f-4732-8f44-216a5cd39ef1"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:44:30.687161 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-6c95fbeb-9b12-4246-ac15-3be3c7066a7d req-d55533e1-d29b-4929-b6c4-169cf001cf4b service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:30.699600 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-6c95fbeb-9b12-4246-ac15-3be3c7066a7d req-d55533e1-d29b-4929-b6c4-169cf001cf4b service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:30.700384 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-6c95fbeb-9b12-4246-ac15-3be3c7066a7d req-d55533e1-d29b-4929-b6c4-169cf001cf4b service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:30.723360 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-6c95fbeb-9b12-4246-ac15-3be3c7066a7d req-d55533e1-d29b-4929-b6c4-169cf001cf4b service nova] Creating event network-vif-plugged:41cf3ea7-346f-4732-8f44-216a5cd39ef1 for instance 0f127014-9e6f-47e6-b8a5-94ca91e0836c on n-h1-854823-8 Oct 04 20:44:30.730446 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-6c95fbeb-9b12-4246-ac15-3be3c7066a7d req-d55533e1-d29b-4929-b6c4-169cf001cf4b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061584 Oct 04 20:44:30.731129 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1166/2405] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:44:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:44:30.752048 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-035b3759-4ec7-4db4-85b8-5730be1bafb8 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:44:30.752774 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-035b3759-4ec7-4db4-85b8-5730be1bafb8 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] [instance: 659f073c-b8c2-48d3-8c09-fef755291460] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:44:30.777757 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-a2a5fee6-291a-4dc9-ba96-44a36fd49f03 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e4b00964014a0383f79597652bd428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7f38600b5041ad8e66a12d77b940fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:44:30.779160 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-035b3759-4ec7-4db4-85b8-5730be1bafb8 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:30.779950 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-035b3759-4ec7-4db4-85b8-5730be1bafb8 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:30.780545 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-035b3759-4ec7-4db4-85b8-5730be1bafb8 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:30.781423 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-035b3759-4ec7-4db4-85b8-5730be1bafb8 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:30.782032 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-035b3759-4ec7-4db4-85b8-5730be1bafb8 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:30.782636 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-035b3759-4ec7-4db4-85b8-5730be1bafb8 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:30.801893 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-a2a5fee6-291a-4dc9-ba96-44a36fd49f03 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] 10.222.0.33 "GET /compute/v2.1/servers/07fdb076-59a4-4c77-a42b-07fa92bcf408" status: 200 len: 1366 microversion: 2.1 time: 0.779301 Oct 04 20:44:30.803994 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1240/2406] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:44:30 2022] GET /compute/v2.1/servers/07fdb076-59a4-4c77-a42b-07fa92bcf408 => generated 1366 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:44:30.812899 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-035b3759-4ec7-4db4-85b8-5730be1bafb8 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] HTTP exception thrown: Instance 659f073c-b8c2-48d3-8c09-fef755291460 could not be found. Oct 04 20:44:30.814446 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-035b3759-4ec7-4db4-85b8-5730be1bafb8 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Request method failure captured: Oct 04 20:44:30.814446 n-d-854823-8 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/659f073c-b8c2-48d3-8c09-fef755291460 HTTP/1.1 Oct 04 20:44:30.814446 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:44:30.814446 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:44:30.814446 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:44:30.814446 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 0 Oct 04 20:44:30.814446 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:44:30.814446 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:44:30.814446 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:44:30.814446 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:44:30.814446 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJrCXn9qkai-t0ssRtB2hHbsXxnP5vBOsXLyrdpMENqm1lUMebcltiaPpyMILmcvIN8llVIUttogRG2DF_WtLJWYaQ5u4-061o1eVh20ZNBGxnAtXnxMrwm1GWR6CkNd6wvaFrzIuArFkGOfhkVebmLChRySZyfWaukv6J6WbRuDoGI Oct 04 20:44:30.814446 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:44:30.814446 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:44:30.814446 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:44:30.814446 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:44:30.814446 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:44:30.814446 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:44:30.814446 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: 2f258cb1ecd049078b201eb41692735a Oct 04 20:44:30.814446 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-2034231916 Oct 04 20:44:30.814446 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 20:44:30.814446 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 20:44:30.814446 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_2f258cb1ecd049078b201eb41692735a", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2f258cb1ecd049078b201eb41692735a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2f258cb1ecd049078b201eb41692735a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/2f258cb1ecd049078b201eb41692735a"}]}] Oct 04 20:44:30.814446 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-2034231916 Oct 04 20:44:30.814446 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: 2f258cb1ecd049078b201eb41692735a Oct 04 20:44:30.814446 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-2034231916 Oct 04 20:44:30.814446 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-FloatingIPsAssociationTestJSON-2034231916-project Oct 04 20:44:30.814446 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:44:30.814446 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:44:30.814446 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: 07c500628d414c9983836c33563b38bc Oct 04 20:44:30.814446 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-2034231916-project Oct 04 20:44:30.814446 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 20:44:30.814446 n-d-854823-8 devstack@n-api.service[128801]: exception: Instance 659f073c-b8c2-48d3-8c09-fef755291460 could not be found. Oct 04 20:44:30.814446 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': '659f073c-b8c2-48d3-8c09-fef755291460'} Oct 04 20:44:30.814446 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:44:30.814446 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:44:30.814446 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:44:30.814446 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:44:30.814446 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:44:30.814446 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:44:30.814446 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:44:30.814446 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:44:30.814446 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:44:30.814446 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:44:30.814446 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 659f073c-b8c2-48d3-8c09-fef755291460 could not be found. Oct 04 20:44:30.814446 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:44:30.814446 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:44:30.814446 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:44:30.814446 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:44:30.814446 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:44:30.814446 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:44:30.814446 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:44:30.814446 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:44:30.814446 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:44:30.814446 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:44:30.814446 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:44:30.814446 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:44:30.814446 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:44:30.814446 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:44:30.814446 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:44:30.814446 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:44:30.814446 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 659f073c-b8c2-48d3-8c09-fef755291460 could not be found. Oct 04 20:44:30.814446 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:44:30.814446 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:44:30.818564 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:44:30.818564 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:44:30.818564 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:44:30.818564 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:44:30.818564 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:44:30.818564 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:44:30.818564 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 659f073c-b8c2-48d3-8c09-fef755291460 could not be found. Oct 04 20:44:30.818564 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:44:30.822487 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-8b28ce4d-a55c-4170-ae4d-0b92acfc17cb tempest-QuotasAdminTestJSON-198957168 tempest-QuotasAdminTestJSON-198957168-project-admin] Action: 'update', calling method: .version_select at 0x7f3c74805160>, body: {"quota_set": {"ram": "5120"}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:44:30.831298 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-035b3759-4ec7-4db4-85b8-5730be1bafb8 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] Returning 404 to user: Instance 659f073c-b8c2-48d3-8c09-fef755291460 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:44:30.832188 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-035b3759-4ec7-4db4-85b8-5730be1bafb8 tempest-FloatingIPsAssociationTestJSON-2034231916 tempest-FloatingIPsAssociationTestJSON-2034231916-project] 10.222.0.33 "GET /compute/v2.1/servers/659f073c-b8c2-48d3-8c09-fef755291460" status: 404 len: 111 microversion: 2.1 time: 0.100038 Oct 04 20:44:30.832774 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1167/2407] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:44:30 2022] GET /compute/v2.1/servers/659f073c-b8c2-48d3-8c09-fef755291460 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:44:30.838684 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b6cd0ee9-00bd-429e-a4a7-eb8d9d127a52 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:44:30.839496 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b6cd0ee9-00bd-429e-a4a7-eb8d9d127a52 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] [instance: 83df4756-40e2-4fc6-be48-48a82dd4572a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:44:30.860233 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b6cd0ee9-00bd-429e-a4a7-eb8d9d127a52 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:30.861400 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b6cd0ee9-00bd-429e-a4a7-eb8d9d127a52 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:30.861990 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b6cd0ee9-00bd-429e-a4a7-eb8d9d127a52 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:30.862886 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b6cd0ee9-00bd-429e-a4a7-eb8d9d127a52 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:30.869631 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b6cd0ee9-00bd-429e-a4a7-eb8d9d127a52 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:30.870380 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b6cd0ee9-00bd-429e-a4a7-eb8d9d127a52 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:30.954107 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b6cd0ee9-00bd-429e-a4a7-eb8d9d127a52 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:30.956979 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b6cd0ee9-00bd-429e-a4a7-eb8d9d127a52 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:30.959134 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b6cd0ee9-00bd-429e-a4a7-eb8d9d127a52 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:30.959746 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-b6cd0ee9-00bd-429e-a4a7-eb8d9d127a52 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lazy-loading 'fault' on Instance uuid 83df4756-40e2-4fc6-be48-48a82dd4572a {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:44:31.051496 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-b6cd0ee9-00bd-429e-a4a7-eb8d9d127a52 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '800db3a57ada47eca381b00189fdbf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66ec8ea91b04deb90b679589e0495bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:44:31.061781 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b6cd0ee9-00bd-429e-a4a7-eb8d9d127a52 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] 10.222.0.33 "GET /compute/v2.1/servers/83df4756-40e2-4fc6-be48-48a82dd4572a" status: 200 len: 1325 microversion: 2.1 time: 0.227555 Oct 04 20:44:31.062396 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1168/2408] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:44:30 2022] GET /compute/v2.1/servers/83df4756-40e2-4fc6-be48-48a82dd4572a => generated 1325 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:44:31.068859 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-537112fb-4916-4193-add9-1749cb0c6a50 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:44:31.069634 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-537112fb-4916-4193-add9-1749cb0c6a50 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] [instance: c147993c-5773-4b76-93bc-62c0cbb6044a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:44:31.084799 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell0:SELECT=75,nova_cell0:UPDATE=12 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:44:31.094241 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8b28ce4d-a55c-4170-ae4d-0b92acfc17cb tempest-QuotasAdminTestJSON-198957168 tempest-QuotasAdminTestJSON-198957168-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:31.095009 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8b28ce4d-a55c-4170-ae4d-0b92acfc17cb tempest-QuotasAdminTestJSON-198957168 tempest-QuotasAdminTestJSON-198957168-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:31.095544 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-537112fb-4916-4193-add9-1749cb0c6a50 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:31.096237 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-537112fb-4916-4193-add9-1749cb0c6a50 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:31.096818 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8b28ce4d-a55c-4170-ae4d-0b92acfc17cb tempest-QuotasAdminTestJSON-198957168 tempest-QuotasAdminTestJSON-198957168-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:31.097719 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8b28ce4d-a55c-4170-ae4d-0b92acfc17cb tempest-QuotasAdminTestJSON-198957168 tempest-QuotasAdminTestJSON-198957168-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:31.098369 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-537112fb-4916-4193-add9-1749cb0c6a50 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:31.099227 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-537112fb-4916-4193-add9-1749cb0c6a50 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:31.099834 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8b28ce4d-a55c-4170-ae4d-0b92acfc17cb tempest-QuotasAdminTestJSON-198957168 tempest-QuotasAdminTestJSON-198957168-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:31.100494 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-537112fb-4916-4193-add9-1749cb0c6a50 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:31.101067 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8b28ce4d-a55c-4170-ae4d-0b92acfc17cb tempest-QuotasAdminTestJSON-198957168 tempest-QuotasAdminTestJSON-198957168-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:31.102202 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-537112fb-4916-4193-add9-1749cb0c6a50 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:31.226661 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-8b28ce4d-a55c-4170-ae4d-0b92acfc17cb tempest-QuotasAdminTestJSON-198957168 tempest-QuotasAdminTestJSON-198957168-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-quota-sets/158322683c574452804655f1ca28f733" status: 200 len: 328 microversion: 2.1 time: 0.420084 Oct 04 20:44:31.229312 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1241/2409] 10.222.0.33 () {60 vars in 1262 bytes} [Tue Oct 4 20:44:30 2022] PUT /compute/v2.1/os-quota-sets/158322683c574452804655f1ca28f733 => generated 328 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:44:31.234298 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-7372c897-4686-4387-992c-a86b7b9b48ed tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:44:31.235103 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-7372c897-4686-4387-992c-a86b7b9b48ed tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: 4d46fff2-b04d-41aa-ada0-2023ab545b48] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:44:31.243199 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7372c897-4686-4387-992c-a86b7b9b48ed tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:31.243960 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7372c897-4686-4387-992c-a86b7b9b48ed tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:31.245601 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7372c897-4686-4387-992c-a86b7b9b48ed tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:31.246670 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7372c897-4686-4387-992c-a86b7b9b48ed tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:31.247281 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7372c897-4686-4387-992c-a86b7b9b48ed tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:31.248234 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7372c897-4686-4387-992c-a86b7b9b48ed tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:31.930761 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-537112fb-4916-4193-add9-1749cb0c6a50 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e1e240b20e41e8b90e0d630e0d6b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a44744f2bb4130b9a49065b49cf854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:44:31.940043 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-537112fb-4916-4193-add9-1749cb0c6a50 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] 10.222.0.33 "GET /compute/v2.1/servers/c147993c-5773-4b76-93bc-62c0cbb6044a" status: 200 len: 1334 microversion: 2.1 time: 0.874929 Oct 04 20:44:31.954914 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1169/2410] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:44:31 2022] GET /compute/v2.1/servers/c147993c-5773-4b76-93bc-62c0cbb6044a => generated 1334 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:44:31.960205 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-686ec7c4-eadc-493a-aaf2-0cb19349b798 tempest-QuotasAdminTestJSON-198957168 tempest-QuotasAdminTestJSON-198957168-project-admin] Calling method '.version_select at 0x7f3c743feaf0>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:44:32.049215 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=19 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:44:32.051906 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-686ec7c4-eadc-493a-aaf2-0cb19349b798 tempest-QuotasAdminTestJSON-198957168 tempest-QuotasAdminTestJSON-198957168-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:32.052498 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-686ec7c4-eadc-493a-aaf2-0cb19349b798 tempest-QuotasAdminTestJSON-198957168 tempest-QuotasAdminTestJSON-198957168-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:32.053134 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-686ec7c4-eadc-493a-aaf2-0cb19349b798 tempest-QuotasAdminTestJSON-198957168 tempest-QuotasAdminTestJSON-198957168-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:32.054114 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-686ec7c4-eadc-493a-aaf2-0cb19349b798 tempest-QuotasAdminTestJSON-198957168 tempest-QuotasAdminTestJSON-198957168-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:32.054908 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-686ec7c4-eadc-493a-aaf2-0cb19349b798 tempest-QuotasAdminTestJSON-198957168 tempest-QuotasAdminTestJSON-198957168-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:32.056606 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-686ec7c4-eadc-493a-aaf2-0cb19349b798 tempest-QuotasAdminTestJSON-198957168 tempest-QuotasAdminTestJSON-198957168-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:32.082422 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-686ec7c4-eadc-493a-aaf2-0cb19349b798 tempest-QuotasAdminTestJSON-198957168 tempest-QuotasAdminTestJSON-198957168-project-admin] 10.222.0.33 "GET /compute/v2.1/os-quota-sets/158322683c574452804655f1ca28f733/detail" status: 200 len: 916 microversion: 2.1 time: 0.126002 Oct 04 20:44:32.084102 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1170/2411] 10.222.0.33 () {58 vars in 1263 bytes} [Tue Oct 4 20:44:31 2022] GET /compute/v2.1/os-quota-sets/158322683c574452804655f1ca28f733/detail => generated 916 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:44:32.092794 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-ada23848-821f-4446-9423-af991fbe9457 req-dc662989-3bb9-407c-9380-2f34d7d145a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83df4756-40e2-4fc6-be48-48a82dd4572a", "name": "network-vif-deleted", "tag": "df81fac5-fbf3-4eb9-bad4-4478b0098ba4"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:44:32.120514 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-ada23848-821f-4446-9423-af991fbe9457 req-dc662989-3bb9-407c-9380-2f34d7d145a4 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:32.121512 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-ada23848-821f-4446-9423-af991fbe9457 req-dc662989-3bb9-407c-9380-2f34d7d145a4 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:32.123811 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-ada23848-821f-4446-9423-af991fbe9457 req-dc662989-3bb9-407c-9380-2f34d7d145a4 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:32.154680 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-ada23848-821f-4446-9423-af991fbe9457 req-dc662989-3bb9-407c-9380-2f34d7d145a4 service nova] Creating event network-vif-deleted:df81fac5-fbf3-4eb9-bad4-4478b0098ba4 for instance 83df4756-40e2-4fc6-be48-48a82dd4572a on n-h2-854823-8 Oct 04 20:44:32.167887 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-ada23848-821f-4446-9423-af991fbe9457 req-dc662989-3bb9-407c-9380-2f34d7d145a4 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082125 Oct 04 20:44:32.169881 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1171/2412] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:44:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:44:32.175496 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d7cb8464-b1cc-42ca-982b-91c1d50878c3 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:44:32.176552 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d7cb8464-b1cc-42ca-982b-91c1d50878c3 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] [instance: 0f127014-9e6f-47e6-b8a5-94ca91e0836c] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:44:32.187351 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d7cb8464-b1cc-42ca-982b-91c1d50878c3 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:32.188019 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d7cb8464-b1cc-42ca-982b-91c1d50878c3 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:32.189016 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d7cb8464-b1cc-42ca-982b-91c1d50878c3 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:32.190076 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d7cb8464-b1cc-42ca-982b-91c1d50878c3 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:32.191275 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d7cb8464-b1cc-42ca-982b-91c1d50878c3 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:32.192033 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d7cb8464-b1cc-42ca-982b-91c1d50878c3 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:32.222177 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-7372c897-4686-4387-992c-a86b7b9b48ed tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac650232cc04810b1340dc2f0edadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b0670d1bd99424780a70e69d57a2166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:44:32.230717 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:44:32.233286 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-7372c897-4686-4387-992c-a86b7b9b48ed tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48" status: 200 len: 1363 microversion: 2.1 time: 1.002702 Oct 04 20:44:32.239192 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1242/2413] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:44:31 2022] GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48 => generated 1363 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:44:32.255602 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-960ac555-2941-49e5-81c2-b7275c7cd517 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:44:32.256653 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-960ac555-2941-49e5-81c2-b7275c7cd517 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] [instance: 07fdb076-59a4-4c77-a42b-07fa92bcf408] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:44:32.271441 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-960ac555-2941-49e5-81c2-b7275c7cd517 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:32.273243 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-960ac555-2941-49e5-81c2-b7275c7cd517 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:32.274843 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-960ac555-2941-49e5-81c2-b7275c7cd517 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:32.277567 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-960ac555-2941-49e5-81c2-b7275c7cd517 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:32.283436 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-960ac555-2941-49e5-81c2-b7275c7cd517 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:32.284048 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-960ac555-2941-49e5-81c2-b7275c7cd517 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:32.667655 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d7cb8464-b1cc-42ca-982b-91c1d50878c3 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87dcc7baf63f4ae6bfe0a099adffd408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7097bc12179446f6a3e1fac8434d5c64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:44:32.677836 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d7cb8464-b1cc-42ca-982b-91c1d50878c3 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] 10.222.0.33 "GET /compute/v2.1/servers/0f127014-9e6f-47e6-b8a5-94ca91e0836c" status: 200 len: 1293 microversion: 2.1 time: 0.506534 Oct 04 20:44:32.678696 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1172/2414] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:44:32 2022] GET /compute/v2.1/servers/0f127014-9e6f-47e6-b8a5-94ca91e0836c => generated 1293 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:44:32.684793 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c52e4884-35ee-4a7a-8269-d196c12d9cd8 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:44:32.685892 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c52e4884-35ee-4a7a-8269-d196c12d9cd8 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] [instance: 83df4756-40e2-4fc6-be48-48a82dd4572a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:44:32.695831 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c52e4884-35ee-4a7a-8269-d196c12d9cd8 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:32.696648 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c52e4884-35ee-4a7a-8269-d196c12d9cd8 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:32.697834 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c52e4884-35ee-4a7a-8269-d196c12d9cd8 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:32.699594 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-960ac555-2941-49e5-81c2-b7275c7cd517 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e4b00964014a0383f79597652bd428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7f38600b5041ad8e66a12d77b940fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:44:32.700010 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c52e4884-35ee-4a7a-8269-d196c12d9cd8 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:32.700676 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c52e4884-35ee-4a7a-8269-d196c12d9cd8 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:32.701512 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c52e4884-35ee-4a7a-8269-d196c12d9cd8 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:32.716642 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-960ac555-2941-49e5-81c2-b7275c7cd517 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] 10.222.0.33 "GET /compute/v2.1/servers/07fdb076-59a4-4c77-a42b-07fa92bcf408" status: 200 len: 1366 microversion: 2.1 time: 0.476044 Oct 04 20:44:32.717801 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1243/2415] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:44:32 2022] GET /compute/v2.1/servers/07fdb076-59a4-4c77-a42b-07fa92bcf408 => generated 1366 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:44:32.720645 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-c52e4884-35ee-4a7a-8269-d196c12d9cd8 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] HTTP exception thrown: Instance 83df4756-40e2-4fc6-be48-48a82dd4572a could not be found. Oct 04 20:44:32.722506 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c52e4884-35ee-4a7a-8269-d196c12d9cd8 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Request method failure captured: Oct 04 20:44:32.722506 n-d-854823-8 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/83df4756-40e2-4fc6-be48-48a82dd4572a HTTP/1.1 Oct 04 20:44:32.722506 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:44:32.722506 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:44:32.722506 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:44:32.722506 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 0 Oct 04 20:44:32.722506 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:44:32.722506 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:44:32.722506 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:44:32.722506 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:44:32.722506 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJl4WjK2XOBz3Jib2KCFRRv_VVnIEfTQGHoxZM5XJ5BSJtLq13YunIRMsvibZAHFSEforKQvXOJN7Mpa7ib-OsivWWjd0zFvYVOTkOZ9HJyr7xiC3a5IANK9maJs5GcpkRWx5DiN4avmq2Y6KfQPe2M0iIN_3U2JOMkAmLVevv57Lk8 Oct 04 20:44:32.722506 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:44:32.722506 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:44:32.722506 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:44:32.722506 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:44:32.722506 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:44:32.722506 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:44:32.722506 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: d66ec8ea91b04deb90b679589e0495bb Oct 04 20:44:32.722506 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-LiveMigrationTest-856257328 Oct 04 20:44:32.722506 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 20:44:32.722506 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 20:44:32.722506 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d66ec8ea91b04deb90b679589e0495bb", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d66ec8ea91b04deb90b679589e0495bb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d66ec8ea91b04deb90b679589e0495bb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d66ec8ea91b04deb90b679589e0495bb"}]}] Oct 04 20:44:32.722506 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-LiveMigrationTest-856257328 Oct 04 20:44:32.722506 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: d66ec8ea91b04deb90b679589e0495bb Oct 04 20:44:32.722506 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-LiveMigrationTest-856257328 Oct 04 20:44:32.722506 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-LiveMigrationTest-856257328-project Oct 04 20:44:32.722506 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:44:32.722506 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:44:32.722506 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: 800db3a57ada47eca381b00189fdbf0a Oct 04 20:44:32.722506 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-LiveMigrationTest-856257328-project Oct 04 20:44:32.722506 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 20:44:32.722506 n-d-854823-8 devstack@n-api.service[128801]: exception: Instance 83df4756-40e2-4fc6-be48-48a82dd4572a could not be found. Oct 04 20:44:32.722506 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': '83df4756-40e2-4fc6-be48-48a82dd4572a'} Oct 04 20:44:32.722506 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:44:32.722506 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:44:32.722506 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:44:32.722506 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:44:32.722506 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:44:32.722506 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:44:32.722506 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:44:32.722506 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:44:32.722506 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:44:32.722506 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:44:32.722506 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 83df4756-40e2-4fc6-be48-48a82dd4572a could not be found. Oct 04 20:44:32.722506 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:44:32.722506 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:44:32.722506 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:44:32.722506 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:44:32.722506 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:44:32.722506 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:44:32.722506 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:44:32.722506 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:44:32.722506 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:44:32.722506 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:44:32.722506 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:44:32.722506 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:44:32.722506 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:44:32.722506 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:44:32.722506 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:44:32.722506 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:44:32.722506 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 83df4756-40e2-4fc6-be48-48a82dd4572a could not be found. Oct 04 20:44:32.722506 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:44:32.722506 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:44:32.722506 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:44:32.725975 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:44:32.725975 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:44:32.725975 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:44:32.725975 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:44:32.725975 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:44:32.725975 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 83df4756-40e2-4fc6-be48-48a82dd4572a could not be found. Oct 04 20:44:32.725975 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:44:32.726387 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-07c93220-8448-43ec-aa7c-ba7c5f182c25 tempest-QuotasAdminTestJSON-198957168 tempest-QuotasAdminTestJSON-198957168-project-admin] Action: 'update', calling method: .version_select at 0x7f3c74778b80>, body: {"quota_set": {"ram": "2048"}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:44:32.727935 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c52e4884-35ee-4a7a-8269-d196c12d9cd8 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Returning 404 to user: Instance 83df4756-40e2-4fc6-be48-48a82dd4572a could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:44:32.729642 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c52e4884-35ee-4a7a-8269-d196c12d9cd8 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] 10.222.0.33 "GET /compute/v2.1/servers/83df4756-40e2-4fc6-be48-48a82dd4572a" status: 404 len: 111 microversion: 2.1 time: 0.049735 Oct 04 20:44:32.730751 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1173/2416] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:44:32 2022] GET /compute/v2.1/servers/83df4756-40e2-4fc6-be48-48a82dd4572a => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:44:32.763530 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ca2e15b7-a324-4cfe-8c5b-acddc99c00bd tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Calling method '.version_select at 0x7f3c745bf820>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:44:32.793365 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ca2e15b7-a324-4cfe-8c5b-acddc99c00bd tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2007695224" status: 202 len: 0 microversion: 2.1 time: 0.042375 Oct 04 20:44:32.794847 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1174/2417] 10.222.0.33 () {58 vars in 1221 bytes} [Tue Oct 4 20:44:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2007695224 => generated 0 bytes in 61 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:44:32.800724 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-956b0296-5229-4ead-9ad6-4fd2cdda539e req-1ae3bcac-177c-46c6-b9d1-2f0a87722274 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c147993c-5773-4b76-93bc-62c0cbb6044a", "name": "network-vif-plugged", "status": "completed", "tag": "ce227d9f-091c-4a59-94a6-70391aac4f0c"}, {"server_uuid": "c147993c-5773-4b76-93bc-62c0cbb6044a", "name": "network-vif-plugged", "status": "completed", "tag": "836586b9-492b-4387-b626-cc2fd5463aef"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:44:32.827362 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-956b0296-5229-4ead-9ad6-4fd2cdda539e req-1ae3bcac-177c-46c6-b9d1-2f0a87722274 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:32.828654 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-956b0296-5229-4ead-9ad6-4fd2cdda539e req-1ae3bcac-177c-46c6-b9d1-2f0a87722274 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:32.830422 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-956b0296-5229-4ead-9ad6-4fd2cdda539e req-1ae3bcac-177c-46c6-b9d1-2f0a87722274 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:32.834010 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-07c93220-8448-43ec-aa7c-ba7c5f182c25 tempest-QuotasAdminTestJSON-198957168 tempest-QuotasAdminTestJSON-198957168-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:32.836389 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-07c93220-8448-43ec-aa7c-ba7c5f182c25 tempest-QuotasAdminTestJSON-198957168 tempest-QuotasAdminTestJSON-198957168-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:32.838596 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-07c93220-8448-43ec-aa7c-ba7c5f182c25 tempest-QuotasAdminTestJSON-198957168 tempest-QuotasAdminTestJSON-198957168-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:32.842373 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-07c93220-8448-43ec-aa7c-ba7c5f182c25 tempest-QuotasAdminTestJSON-198957168 tempest-QuotasAdminTestJSON-198957168-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:32.843247 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-07c93220-8448-43ec-aa7c-ba7c5f182c25 tempest-QuotasAdminTestJSON-198957168 tempest-QuotasAdminTestJSON-198957168-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:32.844721 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-07c93220-8448-43ec-aa7c-ba7c5f182c25 tempest-QuotasAdminTestJSON-198957168 tempest-QuotasAdminTestJSON-198957168-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:32.868654 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-956b0296-5229-4ead-9ad6-4fd2cdda539e req-1ae3bcac-177c-46c6-b9d1-2f0a87722274 service nova] Creating event network-vif-plugged:ce227d9f-091c-4a59-94a6-70391aac4f0c for instance c147993c-5773-4b76-93bc-62c0cbb6044a on n-h2-854823-8 Oct 04 20:44:32.869843 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-956b0296-5229-4ead-9ad6-4fd2cdda539e req-1ae3bcac-177c-46c6-b9d1-2f0a87722274 service nova] Creating event network-vif-plugged:836586b9-492b-4387-b626-cc2fd5463aef for instance c147993c-5773-4b76-93bc-62c0cbb6044a on n-h2-854823-8 Oct 04 20:44:32.881952 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-956b0296-5229-4ead-9ad6-4fd2cdda539e req-1ae3bcac-177c-46c6-b9d1-2f0a87722274 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.084698 Oct 04 20:44:32.883118 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1175/2418] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:44:32 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:44:32.924402 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-07c93220-8448-43ec-aa7c-ba7c5f182c25 tempest-QuotasAdminTestJSON-198957168 tempest-QuotasAdminTestJSON-198957168-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:32.925171 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-07c93220-8448-43ec-aa7c-ba7c5f182c25 tempest-QuotasAdminTestJSON-198957168 tempest-QuotasAdminTestJSON-198957168-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:32.925827 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-07c93220-8448-43ec-aa7c-ba7c5f182c25 tempest-QuotasAdminTestJSON-198957168 tempest-QuotasAdminTestJSON-198957168-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:32.926775 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-07c93220-8448-43ec-aa7c-ba7c5f182c25 tempest-QuotasAdminTestJSON-198957168 tempest-QuotasAdminTestJSON-198957168-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:32.927462 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-07c93220-8448-43ec-aa7c-ba7c5f182c25 tempest-QuotasAdminTestJSON-198957168 tempest-QuotasAdminTestJSON-198957168-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:32.928107 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-07c93220-8448-43ec-aa7c-ba7c5f182c25 tempest-QuotasAdminTestJSON-198957168 tempest-QuotasAdminTestJSON-198957168-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:32.967507 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ab51b810-7eae-45f4-a915-37c935716807 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:44:32.970702 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ab51b810-7eae-45f4-a915-37c935716807 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] [instance: c147993c-5773-4b76-93bc-62c0cbb6044a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:44:32.991334 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ab51b810-7eae-45f4-a915-37c935716807 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:32.991863 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ab51b810-7eae-45f4-a915-37c935716807 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:32.993552 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ab51b810-7eae-45f4-a915-37c935716807 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:32.995792 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ab51b810-7eae-45f4-a915-37c935716807 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:32.997745 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ab51b810-7eae-45f4-a915-37c935716807 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:32.998951 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ab51b810-7eae-45f4-a915-37c935716807 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:33.000598 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:44:33.082274 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-07c93220-8448-43ec-aa7c-ba7c5f182c25 tempest-QuotasAdminTestJSON-198957168 tempest-QuotasAdminTestJSON-198957168-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-quota-sets/158322683c574452804655f1ca28f733?user_id=ff7243e15ba54b8ca760684bf183b28b" status: 200 len: 328 microversion: 2.1 time: 0.361657 Oct 04 20:44:33.092730 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1244/2419] 10.222.0.33 () {60 vars in 1343 bytes} [Tue Oct 4 20:44:32 2022] PUT /compute/v2.1/os-quota-sets/158322683c574452804655f1ca28f733?user_id=ff7243e15ba54b8ca760684bf183b28b => generated 328 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:44:33.099207 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-f6247c5a-8d30-4c73-a552-ee919f2f9e7f tempest-QuotasAdminTestJSON-198957168 tempest-QuotasAdminTestJSON-198957168-project-admin] Calling method '.version_select at 0x7f3c7480e820>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:44:33.238783 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-f6247c5a-8d30-4c73-a552-ee919f2f9e7f tempest-QuotasAdminTestJSON-198957168 tempest-QuotasAdminTestJSON-198957168-project-admin] 10.222.0.33 "GET /compute/v2.1/os-quota-sets/158322683c574452804655f1ca28f733?user_id=ff7243e15ba54b8ca760684bf183b28b" status: 200 len: 370 microversion: 2.1 time: 0.144748 Oct 04 20:44:33.250198 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1245/2420] 10.222.0.33 () {58 vars in 1323 bytes} [Tue Oct 4 20:44:33 2022] GET /compute/v2.1/os-quota-sets/158322683c574452804655f1ca28f733?user_id=ff7243e15ba54b8ca760684bf183b28b => generated 370 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:44:33.256537 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-ba66c9c9-754a-42c2-ab40-90affbc71cdc req-524be1ad-f8c1-4e72-8228-34e020f2982c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0a14e22-0620-4912-9893-62974c80978a", "tag": "06028cc3-2b0b-4175-9579-b3aaf701fc68"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:44:33.268907 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-ba66c9c9-754a-42c2-ab40-90affbc71cdc req-524be1ad-f8c1-4e72-8228-34e020f2982c service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:33.270138 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-ba66c9c9-754a-42c2-ab40-90affbc71cdc req-524be1ad-f8c1-4e72-8228-34e020f2982c service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:33.271340 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-ba66c9c9-754a-42c2-ab40-90affbc71cdc req-524be1ad-f8c1-4e72-8228-34e020f2982c service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:33.312090 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-ba66c9c9-754a-42c2-ab40-90affbc71cdc req-524be1ad-f8c1-4e72-8228-34e020f2982c service nova] Creating event network-changed:06028cc3-2b0b-4175-9579-b3aaf701fc68 for instance c0a14e22-0620-4912-9893-62974c80978a on n-h1-854823-8 Oct 04 20:44:33.328802 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-ba66c9c9-754a-42c2-ab40-90affbc71cdc req-524be1ad-f8c1-4e72-8228-34e020f2982c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072762 Oct 04 20:44:33.330515 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1246/2421] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:44:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:44:33.341619 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-e20d4dc1-8e42-4362-9e8d-0ab596b428d8 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:44:33.343329 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-e20d4dc1-8e42-4362-9e8d-0ab596b428d8 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: 4d46fff2-b04d-41aa-ada0-2023ab545b48] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:44:33.355979 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e20d4dc1-8e42-4362-9e8d-0ab596b428d8 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:33.356348 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e20d4dc1-8e42-4362-9e8d-0ab596b428d8 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:33.356803 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e20d4dc1-8e42-4362-9e8d-0ab596b428d8 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:33.358095 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e20d4dc1-8e42-4362-9e8d-0ab596b428d8 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:33.358648 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e20d4dc1-8e42-4362-9e8d-0ab596b428d8 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:33.359421 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e20d4dc1-8e42-4362-9e8d-0ab596b428d8 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:33.407417 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-ab51b810-7eae-45f4-a915-37c935716807 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e1e240b20e41e8b90e0d630e0d6b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a44744f2bb4130b9a49065b49cf854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:44:33.415277 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ab51b810-7eae-45f4-a915-37c935716807 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] 10.222.0.33 "GET /compute/v2.1/servers/c147993c-5773-4b76-93bc-62c0cbb6044a" status: 200 len: 1334 microversion: 2.1 time: 0.453258 Oct 04 20:44:33.430919 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1176/2422] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:44:32 2022] GET /compute/v2.1/servers/c147993c-5773-4b76-93bc-62c0cbb6044a => generated 1334 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:44:33.707814 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-07bc9ca8-ca6e-45b2-a951-1ad603ac37cf tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:44:33.708684 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-07bc9ca8-ca6e-45b2-a951-1ad603ac37cf tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] [instance: 0f127014-9e6f-47e6-b8a5-94ca91e0836c] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:44:33.721427 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-07bc9ca8-ca6e-45b2-a951-1ad603ac37cf tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:33.721934 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-07bc9ca8-ca6e-45b2-a951-1ad603ac37cf tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:33.734425 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-07bc9ca8-ca6e-45b2-a951-1ad603ac37cf tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:33.735428 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-07bc9ca8-ca6e-45b2-a951-1ad603ac37cf tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:33.735923 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-07bc9ca8-ca6e-45b2-a951-1ad603ac37cf tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:33.736360 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-07bc9ca8-ca6e-45b2-a951-1ad603ac37cf tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:33.835239 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-e20d4dc1-8e42-4362-9e8d-0ab596b428d8 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac650232cc04810b1340dc2f0edadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b0670d1bd99424780a70e69d57a2166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:44:33.847216 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-e20d4dc1-8e42-4362-9e8d-0ab596b428d8 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48" status: 200 len: 1363 microversion: 2.1 time: 0.515335 Oct 04 20:44:33.864213 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1247/2423] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:44:33 2022] GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48 => generated 1363 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:44:33.875507 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-709c281f-8d60-4281-a243-4784c011b975 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:44:33.876335 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-709c281f-8d60-4281-a243-4784c011b975 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] [instance: 07fdb076-59a4-4c77-a42b-07fa92bcf408] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:44:33.886968 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-709c281f-8d60-4281-a243-4784c011b975 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:33.887731 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-709c281f-8d60-4281-a243-4784c011b975 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:33.888315 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-709c281f-8d60-4281-a243-4784c011b975 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:33.889222 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-709c281f-8d60-4281-a243-4784c011b975 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:33.889826 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-709c281f-8d60-4281-a243-4784c011b975 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:33.890422 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-709c281f-8d60-4281-a243-4784c011b975 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:34.156519 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-07bc9ca8-ca6e-45b2-a951-1ad603ac37cf tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87dcc7baf63f4ae6bfe0a099adffd408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7097bc12179446f6a3e1fac8434d5c64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:44:34.178226 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-07bc9ca8-ca6e-45b2-a951-1ad603ac37cf tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] 10.222.0.33 "GET /compute/v2.1/servers/0f127014-9e6f-47e6-b8a5-94ca91e0836c" status: 200 len: 1474 microversion: 2.1 time: 0.480913 Oct 04 20:44:34.180019 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1177/2424] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:44:33 2022] GET /compute/v2.1/servers/0f127014-9e6f-47e6-b8a5-94ca91e0836c => generated 1474 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:44:34.194774 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c6843b55-8759-45e3-bc77-7f92e26a7d50 tempest-QuotasAdminTestJSON-198957168 tempest-QuotasAdminTestJSON-198957168-project-admin] Calling method '.version_select at 0x7f3c75249550>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:44:34.267079 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-709c281f-8d60-4281-a243-4784c011b975 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e4b00964014a0383f79597652bd428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7f38600b5041ad8e66a12d77b940fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:44:34.276593 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-709c281f-8d60-4281-a243-4784c011b975 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] 10.222.0.33 "GET /compute/v2.1/servers/07fdb076-59a4-4c77-a42b-07fa92bcf408" status: 200 len: 1366 microversion: 2.1 time: 0.409968 Oct 04 20:44:34.277560 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1248/2425] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:44:33 2022] GET /compute/v2.1/servers/07fdb076-59a4-4c77-a42b-07fa92bcf408 => generated 1366 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:44:34.297310 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-9fc1b727-61b9-408b-af5a-3a48ceaed09d req-d0f35cf1-7609-449f-afbb-96aa866411e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07fdb076-59a4-4c77-a42b-07fa92bcf408", "tag": "6c6f9c50-74c0-4f1b-ac6e-dd96429aa674"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:44:34.307947 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-9fc1b727-61b9-408b-af5a-3a48ceaed09d req-d0f35cf1-7609-449f-afbb-96aa866411e9 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:34.308585 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-9fc1b727-61b9-408b-af5a-3a48ceaed09d req-d0f35cf1-7609-449f-afbb-96aa866411e9 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:34.309196 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-9fc1b727-61b9-408b-af5a-3a48ceaed09d req-d0f35cf1-7609-449f-afbb-96aa866411e9 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:34.331821 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-9fc1b727-61b9-408b-af5a-3a48ceaed09d req-d0f35cf1-7609-449f-afbb-96aa866411e9 service nova] Creating event network-changed:6c6f9c50-74c0-4f1b-ac6e-dd96429aa674 for instance 07fdb076-59a4-4c77-a42b-07fa92bcf408 on n-h1-854823-8 Oct 04 20:44:34.344858 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-9fc1b727-61b9-408b-af5a-3a48ceaed09d req-d0f35cf1-7609-449f-afbb-96aa866411e9 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051113 Oct 04 20:44:34.347136 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1249/2426] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:44:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:44:34.438359 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-5b067a50-63e6-403e-9850-2703c1810fac tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:44:34.439456 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-5b067a50-63e6-403e-9850-2703c1810fac tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] [instance: c147993c-5773-4b76-93bc-62c0cbb6044a] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:44:34.452465 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5b067a50-63e6-403e-9850-2703c1810fac tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:34.453113 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5b067a50-63e6-403e-9850-2703c1810fac tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:34.453656 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5b067a50-63e6-403e-9850-2703c1810fac tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:34.454561 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5b067a50-63e6-403e-9850-2703c1810fac tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:34.455195 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5b067a50-63e6-403e-9850-2703c1810fac tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:34.456511 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5b067a50-63e6-403e-9850-2703c1810fac tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:34.648272 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c6843b55-8759-45e3-bc77-7f92e26a7d50 tempest-QuotasAdminTestJSON-198957168 tempest-QuotasAdminTestJSON-198957168-project-admin] 10.222.0.33 "GET /compute/v2.1/os-quota-sets/60f7ce4dcd2d4f449ea5b9822900387a/defaults" status: 200 len: 371 microversion: 2.1 time: 0.465386 Oct 04 20:44:34.662494 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1178/2427] 10.222.0.33 () {58 vars in 1269 bytes} [Tue Oct 4 20:44:34 2022] GET /compute/v2.1/os-quota-sets/60f7ce4dcd2d4f449ea5b9822900387a/defaults => generated 371 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:44:34.673220 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e0634073-56e5-44f5-ae3a-f14f39a0dac2 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-989298932", "imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:44:34.770065 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-5b067a50-63e6-403e-9850-2703c1810fac tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e1e240b20e41e8b90e0d630e0d6b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a44744f2bb4130b9a49065b49cf854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:44:34.781401 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-5b067a50-63e6-403e-9850-2703c1810fac tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] 10.222.0.33 "GET /compute/v2.1/servers/c147993c-5773-4b76-93bc-62c0cbb6044a" status: 200 len: 1334 microversion: 2.1 time: 0.346617 Oct 04 20:44:34.782018 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1250/2428] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:44:34 2022] GET /compute/v2.1/servers/c147993c-5773-4b76-93bc-62c0cbb6044a => generated 1334 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:44:34.798064 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-d4f55457-64f6-40ae-af98-faaa1fd913d7 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:44:34.799005 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-d4f55457-64f6-40ae-af98-faaa1fd913d7 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] [instance: 8a72de6a-64a0-4ec7-a613-576f8ac02af3] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:44:34.816029 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.network.neutron [None req-e0634073-56e5-44f5-ae3a-f14f39a0dac2 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] validate_networks() for [('a32beee4-b00b-48d9-8656-e7b824aeffce', None, None, None, None, None)] {{(pid=128801) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:44:34.817109 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d4f55457-64f6-40ae-af98-faaa1fd913d7 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:34.817803 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d4f55457-64f6-40ae-af98-faaa1fd913d7 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:34.818248 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d4f55457-64f6-40ae-af98-faaa1fd913d7 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:34.819001 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d4f55457-64f6-40ae-af98-faaa1fd913d7 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:34.819464 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d4f55457-64f6-40ae-af98-faaa1fd913d7 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:34.819893 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d4f55457-64f6-40ae-af98-faaa1fd913d7 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:34.870264 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-d4f55457-64f6-40ae-af98-faaa1fd913d7 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] [instance: 8a72de6a-64a0-4ec7-a613-576f8ac02af3] Going to try to terminate instance {{(pid=128802) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:44:35.028908 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-d4f55457-64f6-40ae-af98-faaa1fd913d7 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] 10.222.0.33 "DELETE /compute/v2.1/servers/8a72de6a-64a0-4ec7-a613-576f8ac02af3" status: 204 len: 0 microversion: 2.1 time: 0.242874 Oct 04 20:44:35.029684 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1251/2429] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 20:44:34 2022] DELETE /compute/v2.1/servers/8a72de6a-64a0-4ec7-a613-576f8ac02af3 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:44:35.048655 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-712cc26c-88ec-4824-8a1a-97831f35feda tempest-QuotasAdminTestJSON-198957168 tempest-QuotasAdminTestJSON-198957168-project-admin] Action: 'update', calling method: .version_select at 0x7f3c74805280>, body: {"quota_set": {"force": true, "metadata_items": 256, "ram": 10240, "key_pairs": 200, "instances": 20, "server_groups": 20, "server_group_members": 20, "cores": 2, "fixed_ips": 10, "floating_ips": 20, "security_group_rules": 20, "security_groups": 20, "injected_file_content_bytes": 20480, "injected_file_path_bytes": 512, "injected_files": 10}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:44:35.194141 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-712cc26c-88ec-4824-8a1a-97831f35feda tempest-QuotasAdminTestJSON-198957168 tempest-QuotasAdminTestJSON-198957168-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:35.194846 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-712cc26c-88ec-4824-8a1a-97831f35feda tempest-QuotasAdminTestJSON-198957168 tempest-QuotasAdminTestJSON-198957168-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:35.195543 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-712cc26c-88ec-4824-8a1a-97831f35feda tempest-QuotasAdminTestJSON-198957168 tempest-QuotasAdminTestJSON-198957168-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:35.196421 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-712cc26c-88ec-4824-8a1a-97831f35feda tempest-QuotasAdminTestJSON-198957168 tempest-QuotasAdminTestJSON-198957168-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:35.197718 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-712cc26c-88ec-4824-8a1a-97831f35feda tempest-QuotasAdminTestJSON-198957168 tempest-QuotasAdminTestJSON-198957168-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:35.198357 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-712cc26c-88ec-4824-8a1a-97831f35feda tempest-QuotasAdminTestJSON-198957168 tempest-QuotasAdminTestJSON-198957168-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:35.487815 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-712cc26c-88ec-4824-8a1a-97831f35feda tempest-QuotasAdminTestJSON-198957168 tempest-QuotasAdminTestJSON-198957168-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-quota-sets/60f7ce4dcd2d4f449ea5b9822900387a" status: 200 len: 329 microversion: 2.1 time: 0.456603 Oct 04 20:44:35.489631 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1252/2430] 10.222.0.33 () {60 vars in 1263 bytes} [Tue Oct 4 20:44:35 2022] PUT /compute/v2.1/os-quota-sets/60f7ce4dcd2d4f449ea5b9822900387a => generated 329 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:44:35.497362 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-3b16fecc-7af1-4cd1-ba4d-84b1eec8aabb tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:44:35.498287 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-3b16fecc-7af1-4cd1-ba4d-84b1eec8aabb tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: 4d46fff2-b04d-41aa-ada0-2023ab545b48] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:44:35.504764 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3b16fecc-7af1-4cd1-ba4d-84b1eec8aabb tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:35.505453 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3b16fecc-7af1-4cd1-ba4d-84b1eec8aabb tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:35.505889 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3b16fecc-7af1-4cd1-ba4d-84b1eec8aabb tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:35.506680 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3b16fecc-7af1-4cd1-ba4d-84b1eec8aabb tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:35.507284 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3b16fecc-7af1-4cd1-ba4d-84b1eec8aabb tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:35.507710 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3b16fecc-7af1-4cd1-ba4d-84b1eec8aabb tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:36.351415 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-3b16fecc-7af1-4cd1-ba4d-84b1eec8aabb tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac650232cc04810b1340dc2f0edadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b0670d1bd99424780a70e69d57a2166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:44:36.365299 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-3b16fecc-7af1-4cd1-ba4d-84b1eec8aabb tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48" status: 200 len: 1363 microversion: 2.1 time: 0.874328 Oct 04 20:44:36.381294 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1253/2431] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:44:35 2022] GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48 => generated 1363 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:44:36.388434 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-c4878000-a8cd-4b0c-b6ba-dae34c1bb216 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:44:36.391307 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-c4878000-a8cd-4b0c-b6ba-dae34c1bb216 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] [instance: 8a72de6a-64a0-4ec7-a613-576f8ac02af3] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:44:36.397814 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c4878000-a8cd-4b0c-b6ba-dae34c1bb216 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:36.398679 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c4878000-a8cd-4b0c-b6ba-dae34c1bb216 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:36.399223 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c4878000-a8cd-4b0c-b6ba-dae34c1bb216 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:36.400195 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c4878000-a8cd-4b0c-b6ba-dae34c1bb216 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:36.400930 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c4878000-a8cd-4b0c-b6ba-dae34c1bb216 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:36.401543 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c4878000-a8cd-4b0c-b6ba-dae34c1bb216 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:36.619474 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-e0634073-56e5-44f5-ae3a-f14f39a0dac2 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Flavor limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:44:36.620743 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-e0634073-56e5-44f5-ae3a-f14f39a0dac2 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Image limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:44:36.621506 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-e0634073-56e5-44f5-ae3a-f14f39a0dac2 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Flavor pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:44:36.621935 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-e0634073-56e5-44f5-ae3a-f14f39a0dac2 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Image pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:44:36.622563 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-e0634073-56e5-44f5-ae3a-f14f39a0dac2 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:44:36.630923 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-c4878000-a8cd-4b0c-b6ba-dae34c1bb216 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '800db3a57ada47eca381b00189fdbf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66ec8ea91b04deb90b679589e0495bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:44:36.633085 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e0634073-56e5-44f5-ae3a-f14f39a0dac2 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:36.633578 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e0634073-56e5-44f5-ae3a-f14f39a0dac2 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:36.634020 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e0634073-56e5-44f5-ae3a-f14f39a0dac2 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:36.635451 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e0634073-56e5-44f5-ae3a-f14f39a0dac2 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:36.636077 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e0634073-56e5-44f5-ae3a-f14f39a0dac2 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:36.636518 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e0634073-56e5-44f5-ae3a-f14f39a0dac2 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:36.656178 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-c4878000-a8cd-4b0c-b6ba-dae34c1bb216 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] 10.222.0.33 "GET /compute/v2.1/servers/8a72de6a-64a0-4ec7-a613-576f8ac02af3" status: 200 len: 1280 microversion: 2.1 time: 0.287889 Oct 04 20:44:36.657339 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-e0634073-56e5-44f5-ae3a-f14f39a0dac2 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Getting quotas for project 7097bc12179446f6a3e1fac8434d5c64. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:44:36.660434 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1254/2432] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:44:36 2022] GET /compute/v2.1/servers/8a72de6a-64a0-4ec7-a613-576f8ac02af3 => generated 1280 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:44:36.674745 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-c00f2210-4ae3-4164-a418-014047d96c81 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:44:36.675595 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-c00f2210-4ae3-4164-a418-014047d96c81 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] [instance: 07fdb076-59a4-4c77-a42b-07fa92bcf408] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:44:36.679708 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-e0634073-56e5-44f5-ae3a-f14f39a0dac2 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Getting quotas for user 87dcc7baf63f4ae6bfe0a099adffd408 and project 7097bc12179446f6a3e1fac8434d5c64. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:44:36.684257 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c00f2210-4ae3-4164-a418-014047d96c81 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:36.686537 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c00f2210-4ae3-4164-a418-014047d96c81 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:36.687244 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c00f2210-4ae3-4164-a418-014047d96c81 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:36.688508 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c00f2210-4ae3-4164-a418-014047d96c81 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:36.689699 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c00f2210-4ae3-4164-a418-014047d96c81 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:36.690676 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c00f2210-4ae3-4164-a418-014047d96c81 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:36.697508 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e0634073-56e5-44f5-ae3a-f14f39a0dac2 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Going to run 1 instances... {{(pid=128801) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:44:36.700589 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e0634073-56e5-44f5-ae3a-f14f39a0dac2 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] [instance: 77790f1c-897a-4539-bb73-aaa39c83b235] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='15b24725-0c99-4bcf-b1fb-907cdf8e2d63',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128801) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:44:36.760986 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e0634073-56e5-44f5-ae3a-f14f39a0dac2 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.096693 Oct 04 20:44:36.766507 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1179/2433] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 20:44:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 2103 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 20:44:36.780035 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-e950d2aa-7f98-4bea-a951-99216e10f6e4 req-d6ca6dbe-1b85-4468-a327-9610d0524e4d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d46fff2-b04d-41aa-ada0-2023ab545b48", "tag": "39e1fcde-c40c-4b4b-8edd-7565faaf4580"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:44:36.794836 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-e950d2aa-7f98-4bea-a951-99216e10f6e4 req-d6ca6dbe-1b85-4468-a327-9610d0524e4d service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:36.796431 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-e950d2aa-7f98-4bea-a951-99216e10f6e4 req-d6ca6dbe-1b85-4468-a327-9610d0524e4d service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:36.796890 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-e950d2aa-7f98-4bea-a951-99216e10f6e4 req-d6ca6dbe-1b85-4468-a327-9610d0524e4d service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:36.809279 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-e950d2aa-7f98-4bea-a951-99216e10f6e4 req-d6ca6dbe-1b85-4468-a327-9610d0524e4d service nova] Creating event network-changed:39e1fcde-c40c-4b4b-8edd-7565faaf4580 for instance 4d46fff2-b04d-41aa-ada0-2023ab545b48 on n-h1-854823-8 Oct 04 20:44:36.815125 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-e950d2aa-7f98-4bea-a951-99216e10f6e4 req-d6ca6dbe-1b85-4468-a327-9610d0524e4d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047026 Oct 04 20:44:36.816052 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1180/2434] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:44:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:44:36.823092 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1602c363-1d1f-460d-ab4c-8821c2f10a85 tempest-QuotasAdminTestJSON-198957168 tempest-QuotasAdminTestJSON-198957168-project-admin] Action: 'update', calling method: .version_select at 0x7f3c7431f8b0>, body: {"quota_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1, "server_group_members": 10, "server_groups": 10}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:44:36.937687 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-c00f2210-4ae3-4164-a418-014047d96c81 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e4b00964014a0383f79597652bd428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7f38600b5041ad8e66a12d77b940fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:44:36.950583 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-c00f2210-4ae3-4164-a418-014047d96c81 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] 10.222.0.33 "GET /compute/v2.1/servers/07fdb076-59a4-4c77-a42b-07fa92bcf408" status: 200 len: 1366 microversion: 2.1 time: 0.288594 Oct 04 20:44:36.951178 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1255/2435] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:44:36 2022] GET /compute/v2.1/servers/07fdb076-59a4-4c77-a42b-07fa92bcf408 => generated 1366 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:44:36.956272 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-ccc6f83e-14ba-4b4a-9d00-cae49d89558e tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:44:36.967539 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-ccc6f83e-14ba-4b4a-9d00-cae49d89558e tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] [instance: c147993c-5773-4b76-93bc-62c0cbb6044a] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:44:36.973062 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1602c363-1d1f-460d-ab4c-8821c2f10a85 tempest-QuotasAdminTestJSON-198957168 tempest-QuotasAdminTestJSON-198957168-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:36.974195 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1602c363-1d1f-460d-ab4c-8821c2f10a85 tempest-QuotasAdminTestJSON-198957168 tempest-QuotasAdminTestJSON-198957168-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:36.974973 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1602c363-1d1f-460d-ab4c-8821c2f10a85 tempest-QuotasAdminTestJSON-198957168 tempest-QuotasAdminTestJSON-198957168-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:36.975993 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1602c363-1d1f-460d-ab4c-8821c2f10a85 tempest-QuotasAdminTestJSON-198957168 tempest-QuotasAdminTestJSON-198957168-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:36.976371 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ccc6f83e-14ba-4b4a-9d00-cae49d89558e tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:36.976867 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ccc6f83e-14ba-4b4a-9d00-cae49d89558e tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:36.977309 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ccc6f83e-14ba-4b4a-9d00-cae49d89558e tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:36.977696 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1602c363-1d1f-460d-ab4c-8821c2f10a85 tempest-QuotasAdminTestJSON-198957168 tempest-QuotasAdminTestJSON-198957168-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:36.978071 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ccc6f83e-14ba-4b4a-9d00-cae49d89558e tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:36.978878 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1602c363-1d1f-460d-ab4c-8821c2f10a85 tempest-QuotasAdminTestJSON-198957168 tempest-QuotasAdminTestJSON-198957168-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:36.979154 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ccc6f83e-14ba-4b4a-9d00-cae49d89558e tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:36.979594 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ccc6f83e-14ba-4b4a-9d00-cae49d89558e tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:37.232149 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=83,nova_api:DELETE=3,nova_api:INSERT=9,nova_api:UPDATE=5 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:44:37.282941 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-ccc6f83e-14ba-4b4a-9d00-cae49d89558e tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e1e240b20e41e8b90e0d630e0d6b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a44744f2bb4130b9a49065b49cf854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:44:37.293830 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-ccc6f83e-14ba-4b4a-9d00-cae49d89558e tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] 10.222.0.33 "GET /compute/v2.1/servers/c147993c-5773-4b76-93bc-62c0cbb6044a" status: 200 len: 1670 microversion: 2.1 time: 0.341312 Oct 04 20:44:37.295166 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1256/2436] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:44:36 2022] GET /compute/v2.1/servers/c147993c-5773-4b76-93bc-62c0cbb6044a => generated 1670 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:44:37.310578 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-71591035-b4d7-4a3f-8337-2e285ae588b1 req-2ad1eba0-6a17-4fd9-ba1b-b50b0861135f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a72de6a-64a0-4ec7-a613-576f8ac02af3", "name": "network-vif-deleted", "tag": "ae521132-718e-4290-aca2-064b766ac78a"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:44:37.324509 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-71591035-b4d7-4a3f-8337-2e285ae588b1 req-2ad1eba0-6a17-4fd9-ba1b-b50b0861135f service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:37.325508 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-71591035-b4d7-4a3f-8337-2e285ae588b1 req-2ad1eba0-6a17-4fd9-ba1b-b50b0861135f service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:37.326389 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-71591035-b4d7-4a3f-8337-2e285ae588b1 req-2ad1eba0-6a17-4fd9-ba1b-b50b0861135f service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:37.340950 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-71591035-b4d7-4a3f-8337-2e285ae588b1 req-2ad1eba0-6a17-4fd9-ba1b-b50b0861135f service nova] Creating event network-vif-deleted:ae521132-718e-4290-aca2-064b766ac78a for instance 8a72de6a-64a0-4ec7-a613-576f8ac02af3 on n-h2-854823-8 Oct 04 20:44:37.347304 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-71591035-b4d7-4a3f-8337-2e285ae588b1 req-2ad1eba0-6a17-4fd9-ba1b-b50b0861135f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050425 Oct 04 20:44:37.348745 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1257/2437] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:44:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:44:37.358040 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-e626bf32-13ad-4b9f-87c4-1b02e3aa56a9 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:44:37.359071 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-e626bf32-13ad-4b9f-87c4-1b02e3aa56a9 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] [instance: 77790f1c-897a-4539-bb73-aaa39c83b235] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:44:37.381662 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-e626bf32-13ad-4b9f-87c4-1b02e3aa56a9 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] [instance: 77790f1c-897a-4539-bb73-aaa39c83b235] Going to try to terminate instance {{(pid=128802) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:44:37.581028 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-1602c363-1d1f-460d-ab4c-8821c2f10a85 tempest-QuotasAdminTestJSON-198957168 tempest-QuotasAdminTestJSON-198957168-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-quota-sets/60f7ce4dcd2d4f449ea5b9822900387a" status: 200 len: 329 microversion: 2.1 time: 0.763426 Oct 04 20:44:37.592747 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1181/2438] 10.222.0.33 () {60 vars in 1263 bytes} [Tue Oct 4 20:44:36 2022] PUT /compute/v2.1/os-quota-sets/60f7ce4dcd2d4f449ea5b9822900387a => generated 329 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:44:37.623085 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9906b66e-0f85-4f3f-8979-e8666e0a3fe1 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:44:37.625249 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-9906b66e-0f85-4f3f-8979-e8666e0a3fe1 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] [instance: c147993c-5773-4b76-93bc-62c0cbb6044a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:44:37.644070 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9906b66e-0f85-4f3f-8979-e8666e0a3fe1 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:37.644706 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9906b66e-0f85-4f3f-8979-e8666e0a3fe1 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:37.645369 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9906b66e-0f85-4f3f-8979-e8666e0a3fe1 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:37.646561 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9906b66e-0f85-4f3f-8979-e8666e0a3fe1 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:37.647242 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9906b66e-0f85-4f3f-8979-e8666e0a3fe1 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:37.647918 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9906b66e-0f85-4f3f-8979-e8666e0a3fe1 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:37.682198 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-9906b66e-0f85-4f3f-8979-e8666e0a3fe1 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] 10.222.0.33 "GET /compute/v2.1/servers/c147993c-5773-4b76-93bc-62c0cbb6044a/ips" status: 200 len: 180 microversion: 2.1 time: 0.088120 Oct 04 20:44:37.683050 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1182/2439] 10.222.0.33 () {58 vars in 1248 bytes} [Tue Oct 4 20:44:37 2022] GET /compute/v2.1/servers/c147993c-5773-4b76-93bc-62c0cbb6044a/ips => generated 180 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:44:37.688996 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-26671804-26e5-4c0e-a2b5-454c89863c5e tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:44:37.690271 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-26671804-26e5-4c0e-a2b5-454c89863c5e tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: 4d46fff2-b04d-41aa-ada0-2023ab545b48] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:44:37.699750 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-26671804-26e5-4c0e-a2b5-454c89863c5e tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:37.700623 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-26671804-26e5-4c0e-a2b5-454c89863c5e tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:37.701611 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-26671804-26e5-4c0e-a2b5-454c89863c5e tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:37.716471 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-26671804-26e5-4c0e-a2b5-454c89863c5e tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:37.718153 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-26671804-26e5-4c0e-a2b5-454c89863c5e tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:37.719244 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-26671804-26e5-4c0e-a2b5-454c89863c5e tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:37.870760 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.scheduler.client.report [None req-e626bf32-13ad-4b9f-87c4-1b02e3aa56a9 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Deleted allocations for instance 77790f1c-897a-4539-bb73-aaa39c83b235 Oct 04 20:44:37.906551 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-e626bf32-13ad-4b9f-87c4-1b02e3aa56a9 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] 10.222.0.33 "DELETE /compute/v2.1/servers/77790f1c-897a-4539-bb73-aaa39c83b235" status: 204 len: 0 microversion: 2.1 time: 0.555878 Oct 04 20:44:37.907981 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1258/2440] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 20:44:37 2022] DELETE /compute/v2.1/servers/77790f1c-897a-4539-bb73-aaa39c83b235 => generated 0 bytes in 558 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:44:37.913627 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-9f7d443d-1ecb-46c3-af79-45741e410fbe tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:44:37.915467 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-9f7d443d-1ecb-46c3-af79-45741e410fbe tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] [instance: 8a72de6a-64a0-4ec7-a613-576f8ac02af3] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:44:37.933025 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9f7d443d-1ecb-46c3-af79-45741e410fbe tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:37.933650 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9f7d443d-1ecb-46c3-af79-45741e410fbe tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:37.934153 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9f7d443d-1ecb-46c3-af79-45741e410fbe tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:37.935190 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9f7d443d-1ecb-46c3-af79-45741e410fbe tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:37.935861 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9f7d443d-1ecb-46c3-af79-45741e410fbe tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:37.936436 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9f7d443d-1ecb-46c3-af79-45741e410fbe tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:37.957008 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.wsgi [None req-9f7d443d-1ecb-46c3-af79-45741e410fbe tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] HTTP exception thrown: Instance 8a72de6a-64a0-4ec7-a613-576f8ac02af3 could not be found. Oct 04 20:44:37.959190 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-9f7d443d-1ecb-46c3-af79-45741e410fbe tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Request method failure captured: Oct 04 20:44:37.959190 n-d-854823-8 devstack@n-api.service[128802]: request: GET /compute/v2.1/servers/8a72de6a-64a0-4ec7-a613-576f8ac02af3 HTTP/1.1 Oct 04 20:44:37.959190 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 20:44:37.959190 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 20:44:37.959190 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 20:44:37.959190 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 0 Oct 04 20:44:37.959190 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 20:44:37.959190 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 20:44:37.959190 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 20:44:37.959190 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 20:44:37.959190 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPJl4WjK2XOBz3Jib2KCFRRv_VVnIEfTQGHoxZM5XJ5BSJtLq13YunIRMsvibZAHFSEforKQvXOJN7Mpa7ib-OsivWWjd0zFvYVOTkOZ9HJyr7xiC3a5IANK9maJs5GcpkRWx5DiN4avmq2Y6KfQPe2M0iIN_3U2JOMkAmLVevv57Lk8 Oct 04 20:44:37.959190 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 20:44:37.959190 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 20:44:37.959190 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 20:44:37.959190 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 20:44:37.959190 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 20:44:37.959190 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 20:44:37.959190 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: d66ec8ea91b04deb90b679589e0495bb Oct 04 20:44:37.959190 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-LiveMigrationTest-856257328 Oct 04 20:44:37.959190 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 20:44:37.959190 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 20:44:37.959190 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d66ec8ea91b04deb90b679589e0495bb", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d66ec8ea91b04deb90b679589e0495bb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d66ec8ea91b04deb90b679589e0495bb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d66ec8ea91b04deb90b679589e0495bb"}]}] Oct 04 20:44:37.959190 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-LiveMigrationTest-856257328 Oct 04 20:44:37.959190 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: d66ec8ea91b04deb90b679589e0495bb Oct 04 20:44:37.959190 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-LiveMigrationTest-856257328 Oct 04 20:44:37.959190 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-LiveMigrationTest-856257328-project Oct 04 20:44:37.959190 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 20:44:37.959190 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 20:44:37.959190 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: 800db3a57ada47eca381b00189fdbf0a Oct 04 20:44:37.959190 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-LiveMigrationTest-856257328-project Oct 04 20:44:37.959190 n-d-854823-8 devstack@n-api.service[128802]: method: > Oct 04 20:44:37.959190 n-d-854823-8 devstack@n-api.service[128802]: exception: Instance 8a72de6a-64a0-4ec7-a613-576f8ac02af3 could not be found. Oct 04 20:44:37.959190 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'id': '8a72de6a-64a0-4ec7-a613-576f8ac02af3'} Oct 04 20:44:37.959190 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:44:37.959190 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:44:37.959190 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:44:37.959190 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:44:37.959190 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:44:37.959190 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:44:37.959190 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:44:37.959190 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:44:37.959190 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:44:37.959190 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:44:37.959190 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a72de6a-64a0-4ec7-a613-576f8ac02af3 could not be found. Oct 04 20:44:37.959190 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:44:37.959190 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:44:37.959190 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:44:37.959190 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:44:37.959190 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:44:37.959190 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:44:37.959190 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:44:37.959190 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:44:37.959190 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:44:37.959190 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:44:37.959190 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:44:37.959190 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:44:37.959190 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:44:37.959190 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:44:37.959190 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:44:37.959190 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:44:37.959190 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a72de6a-64a0-4ec7-a613-576f8ac02af3 could not be found. Oct 04 20:44:37.959190 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:44:37.959190 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:44:37.959190 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:44:37.964567 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:44:37.964567 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:44:37.964567 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:44:37.964567 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:44:37.964567 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:44:37.964567 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a72de6a-64a0-4ec7-a613-576f8ac02af3 could not be found. Oct 04 20:44:37.964567 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:44:37.964567 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-9f7d443d-1ecb-46c3-af79-45741e410fbe tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Returning 404 to user: Instance 8a72de6a-64a0-4ec7-a613-576f8ac02af3 could not be found. {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:44:37.964567 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-9f7d443d-1ecb-46c3-af79-45741e410fbe tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] 10.222.0.33 "GET /compute/v2.1/servers/8a72de6a-64a0-4ec7-a613-576f8ac02af3" status: 404 len: 111 microversion: 2.1 time: 0.051729 Oct 04 20:44:37.964567 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1259/2441] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:44:37 2022] GET /compute/v2.1/servers/8a72de6a-64a0-4ec7-a613-576f8ac02af3 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:44:37.969054 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-da2adb74-3cd0-4abd-a0eb-05cd8836ad2f tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:44:37.969582 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-da2adb74-3cd0-4abd-a0eb-05cd8836ad2f tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] [instance: c147993c-5773-4b76-93bc-62c0cbb6044a] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:44:37.977300 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-da2adb74-3cd0-4abd-a0eb-05cd8836ad2f tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:37.977791 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-da2adb74-3cd0-4abd-a0eb-05cd8836ad2f tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:37.978863 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-da2adb74-3cd0-4abd-a0eb-05cd8836ad2f tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:37.979652 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-da2adb74-3cd0-4abd-a0eb-05cd8836ad2f tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:37.980258 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-da2adb74-3cd0-4abd-a0eb-05cd8836ad2f tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:37.981444 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-da2adb74-3cd0-4abd-a0eb-05cd8836ad2f tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:38.019506 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-da2adb74-3cd0-4abd-a0eb-05cd8836ad2f tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] [instance: c147993c-5773-4b76-93bc-62c0cbb6044a] Going to try to terminate instance {{(pid=128802) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:44:38.043631 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-26671804-26e5-4c0e-a2b5-454c89863c5e tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac650232cc04810b1340dc2f0edadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b0670d1bd99424780a70e69d57a2166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:44:38.052620 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-26671804-26e5-4c0e-a2b5-454c89863c5e tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48" status: 200 len: 1363 microversion: 2.1 time: 0.368269 Oct 04 20:44:38.067597 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1183/2442] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:44:37 2022] GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48 => generated 1363 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:44:38.073522 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-902e34aa-7195-41b0-902d-0271e34e01b6 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:44:38.074103 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-902e34aa-7195-41b0-902d-0271e34e01b6 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] [instance: 77790f1c-897a-4539-bb73-aaa39c83b235] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:44:38.084441 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-902e34aa-7195-41b0-902d-0271e34e01b6 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:38.085017 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-902e34aa-7195-41b0-902d-0271e34e01b6 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:38.085459 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-902e34aa-7195-41b0-902d-0271e34e01b6 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:38.086190 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-902e34aa-7195-41b0-902d-0271e34e01b6 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:38.086710 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-902e34aa-7195-41b0-902d-0271e34e01b6 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:38.089162 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-902e34aa-7195-41b0-902d-0271e34e01b6 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:38.124841 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-902e34aa-7195-41b0-902d-0271e34e01b6 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] HTTP exception thrown: Instance 77790f1c-897a-4539-bb73-aaa39c83b235 could not be found. Oct 04 20:44:38.126387 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-902e34aa-7195-41b0-902d-0271e34e01b6 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Request method failure captured: Oct 04 20:44:38.126387 n-d-854823-8 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/77790f1c-897a-4539-bb73-aaa39c83b235 HTTP/1.1 Oct 04 20:44:38.126387 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:44:38.126387 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:44:38.126387 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:44:38.126387 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 0 Oct 04 20:44:38.126387 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:44:38.126387 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:44:38.126387 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:44:38.126387 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:44:38.126387 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJsSwF2ySar2LJQGdSe43g0QAYtjP4_BPyLRwM7Cr4_8Oz_X-RTScy1BL0ogt-qe3YNvQGTaYbVbGoUGx7pHqiHpbZftU7_TcvDA_zpgTfxGGH91CR74RG6crXL2bxRs87dSvsLYuOWMw7_AQjTpWetc1HBlb5th2rD-ko2SN3gLGSA Oct 04 20:44:38.126387 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:44:38.126387 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:44:38.126387 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:44:38.126387 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:44:38.126387 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:44:38.126387 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:44:38.126387 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: 7097bc12179446f6a3e1fac8434d5c64 Oct 04 20:44:38.126387 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-ServersTestJSON-927611194 Oct 04 20:44:38.126387 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 20:44:38.126387 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 20:44:38.126387 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_7097bc12179446f6a3e1fac8434d5c64", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7097bc12179446f6a3e1fac8434d5c64"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7097bc12179446f6a3e1fac8434d5c64"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/7097bc12179446f6a3e1fac8434d5c64"}]}] Oct 04 20:44:38.126387 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-ServersTestJSON-927611194 Oct 04 20:44:38.126387 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: 7097bc12179446f6a3e1fac8434d5c64 Oct 04 20:44:38.126387 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ServersTestJSON-927611194 Oct 04 20:44:38.126387 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-ServersTestJSON-927611194-project Oct 04 20:44:38.126387 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:44:38.126387 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:44:38.126387 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: 87dcc7baf63f4ae6bfe0a099adffd408 Oct 04 20:44:38.126387 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-ServersTestJSON-927611194-project Oct 04 20:44:38.126387 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 20:44:38.126387 n-d-854823-8 devstack@n-api.service[128801]: exception: Instance 77790f1c-897a-4539-bb73-aaa39c83b235 could not be found. Oct 04 20:44:38.126387 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': '77790f1c-897a-4539-bb73-aaa39c83b235'} Oct 04 20:44:38.126387 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:44:38.126387 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:44:38.126387 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:44:38.126387 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:44:38.126387 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:44:38.126387 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:44:38.126387 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:44:38.126387 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:44:38.126387 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:44:38.126387 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:44:38.126387 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 77790f1c-897a-4539-bb73-aaa39c83b235 could not be found. Oct 04 20:44:38.126387 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:44:38.126387 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:44:38.126387 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:44:38.126387 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:44:38.126387 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:44:38.126387 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:44:38.126387 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:44:38.126387 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:44:38.126387 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:44:38.126387 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:44:38.126387 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:44:38.126387 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:44:38.126387 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:44:38.126387 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:44:38.126387 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:44:38.126387 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:44:38.126387 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77790f1c-897a-4539-bb73-aaa39c83b235 could not be found. Oct 04 20:44:38.126387 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:44:38.126387 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:44:38.126387 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:44:38.126387 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:44:38.130696 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:44:38.130696 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:44:38.130696 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:44:38.130696 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:44:38.130696 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77790f1c-897a-4539-bb73-aaa39c83b235 could not be found. Oct 04 20:44:38.130696 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:44:38.130696 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-902e34aa-7195-41b0-902d-0271e34e01b6 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Returning 404 to user: Instance 77790f1c-897a-4539-bb73-aaa39c83b235 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:44:38.130696 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-902e34aa-7195-41b0-902d-0271e34e01b6 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] 10.222.0.33 "GET /compute/v2.1/servers/77790f1c-897a-4539-bb73-aaa39c83b235" status: 404 len: 111 microversion: 2.1 time: 0.059238 Oct 04 20:44:38.130696 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1184/2443] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:44:38 2022] GET /compute/v2.1/servers/77790f1c-897a-4539-bb73-aaa39c83b235 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:44:38.137087 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ef4c4384-5c0c-448b-b6dc-04e3625455e7 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:44:38.137662 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ef4c4384-5c0c-448b-b6dc-04e3625455e7 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] [instance: 62b98bc7-657a-42c2-b501-ae4d926cfa2f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:44:38.156331 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ef4c4384-5c0c-448b-b6dc-04e3625455e7 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:38.159049 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ef4c4384-5c0c-448b-b6dc-04e3625455e7 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:38.159549 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ef4c4384-5c0c-448b-b6dc-04e3625455e7 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:38.160281 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ef4c4384-5c0c-448b-b6dc-04e3625455e7 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:38.160443 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_api:SELECT=83,nova_api:UPDATE=2,nova_api:INSERT=14,nova_api:DELETE=1 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:44:38.160749 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ef4c4384-5c0c-448b-b6dc-04e3625455e7 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:38.161178 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ef4c4384-5c0c-448b-b6dc-04e3625455e7 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:38.214011 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-da2adb74-3cd0-4abd-a0eb-05cd8836ad2f tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] 10.222.0.33 "DELETE /compute/v2.1/servers/c147993c-5773-4b76-93bc-62c0cbb6044a" status: 204 len: 0 microversion: 2.1 time: 0.249037 Oct 04 20:44:38.217224 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1260/2444] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 20:44:37 2022] DELETE /compute/v2.1/servers/c147993c-5773-4b76-93bc-62c0cbb6044a => generated 0 bytes in 254 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:44:38.228798 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-77f9f1fd-3685-44db-86b2-3335c7580b2a tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:44:38.233637 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ef4c4384-5c0c-448b-b6dc-04e3625455e7 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] [instance: 62b98bc7-657a-42c2-b501-ae4d926cfa2f] Going to try to terminate instance {{(pid=128801) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:44:38.234419 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-77f9f1fd-3685-44db-86b2-3335c7580b2a tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] [instance: 07fdb076-59a4-4c77-a42b-07fa92bcf408] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:44:38.250328 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-77f9f1fd-3685-44db-86b2-3335c7580b2a tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:38.251274 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-77f9f1fd-3685-44db-86b2-3335c7580b2a tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:38.251928 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-77f9f1fd-3685-44db-86b2-3335c7580b2a tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:38.252837 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-77f9f1fd-3685-44db-86b2-3335c7580b2a tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:38.255625 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-77f9f1fd-3685-44db-86b2-3335c7580b2a tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:38.256083 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-77f9f1fd-3685-44db-86b2-3335c7580b2a tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:38.288632 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:44:38.375162 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ef4c4384-5c0c-448b-b6dc-04e3625455e7 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] 10.222.0.33 "DELETE /compute/v2.1/servers/62b98bc7-657a-42c2-b501-ae4d926cfa2f" status: 204 len: 0 microversion: 2.1 time: 0.244677 Oct 04 20:44:38.378787 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1185/2445] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 20:44:38 2022] DELETE /compute/v2.1/servers/62b98bc7-657a-42c2-b501-ae4d926cfa2f => generated 0 bytes in 246 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:44:38.382774 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-668f3129-eec6-4ff3-88ac-bc9b3a6acf53 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:44:38.383559 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-668f3129-eec6-4ff3-88ac-bc9b3a6acf53 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] [instance: c147993c-5773-4b76-93bc-62c0cbb6044a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:44:38.392300 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-668f3129-eec6-4ff3-88ac-bc9b3a6acf53 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:38.392857 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-668f3129-eec6-4ff3-88ac-bc9b3a6acf53 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:38.393556 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-668f3129-eec6-4ff3-88ac-bc9b3a6acf53 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:38.394397 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-668f3129-eec6-4ff3-88ac-bc9b3a6acf53 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:38.395068 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-668f3129-eec6-4ff3-88ac-bc9b3a6acf53 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:38.395680 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-668f3129-eec6-4ff3-88ac-bc9b3a6acf53 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:38.748255 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-77f9f1fd-3685-44db-86b2-3335c7580b2a tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e4b00964014a0383f79597652bd428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7f38600b5041ad8e66a12d77b940fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:44:38.757475 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-77f9f1fd-3685-44db-86b2-3335c7580b2a tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] 10.222.0.33 "GET /compute/v2.1/servers/07fdb076-59a4-4c77-a42b-07fa92bcf408" status: 200 len: 1366 microversion: 2.1 time: 0.538740 Oct 04 20:44:38.758432 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1261/2446] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:44:38 2022] GET /compute/v2.1/servers/07fdb076-59a4-4c77-a42b-07fa92bcf408 => generated 1366 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:44:38.764335 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-72af216e-dfcf-44b6-970c-4f58ef96ea1f tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1489389444", "imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63", "flavorRef": "452", "accessIPv6": "2001:2001::3", "networks": [{"uuid": "a32beee4-b00b-48d9-8656-e7b824aeffce"}]}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:44:38.770843 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-668f3129-eec6-4ff3-88ac-bc9b3a6acf53 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e1e240b20e41e8b90e0d630e0d6b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a44744f2bb4130b9a49065b49cf854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:44:38.776677 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:44:38.783766 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-668f3129-eec6-4ff3-88ac-bc9b3a6acf53 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] 10.222.0.33 "GET /compute/v2.1/servers/c147993c-5773-4b76-93bc-62c0cbb6044a" status: 200 len: 1676 microversion: 2.1 time: 0.405976 Oct 04 20:44:38.784689 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1186/2447] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:44:38 2022] GET /compute/v2.1/servers/c147993c-5773-4b76-93bc-62c0cbb6044a => generated 1676 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:44:38.791415 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7816bae3-b654-4c98-a7d1-befc6f2a0389 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:44:38.792557 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-7816bae3-b654-4c98-a7d1-befc6f2a0389 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] [instance: 62b98bc7-657a-42c2-b501-ae4d926cfa2f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:44:38.801996 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7816bae3-b654-4c98-a7d1-befc6f2a0389 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:38.803109 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7816bae3-b654-4c98-a7d1-befc6f2a0389 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:38.803867 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7816bae3-b654-4c98-a7d1-befc6f2a0389 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:38.804995 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7816bae3-b654-4c98-a7d1-befc6f2a0389 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:38.805714 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7816bae3-b654-4c98-a7d1-befc6f2a0389 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:38.806417 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7816bae3-b654-4c98-a7d1-befc6f2a0389 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:38.832777 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.network.neutron [None req-72af216e-dfcf-44b6-970c-4f58ef96ea1f tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] validate_networks() for [('a32beee4-b00b-48d9-8656-e7b824aeffce', None, None, None, None, None)] {{(pid=128802) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:44:39.208661 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-7816bae3-b654-4c98-a7d1-befc6f2a0389 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '800db3a57ada47eca381b00189fdbf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66ec8ea91b04deb90b679589e0495bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:44:39.221362 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-7816bae3-b654-4c98-a7d1-befc6f2a0389 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] 10.222.0.33 "GET /compute/v2.1/servers/62b98bc7-657a-42c2-b501-ae4d926cfa2f" status: 200 len: 1500 microversion: 2.1 time: 0.435589 Oct 04 20:44:39.234277 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1187/2448] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:44:38 2022] GET /compute/v2.1/servers/62b98bc7-657a-42c2-b501-ae4d926cfa2f => generated 1500 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:44:39.249695 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-77e56fcb-534b-4cd8-a9ae-c7034ea3a4b2 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:44:39.250322 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-77e56fcb-534b-4cd8-a9ae-c7034ea3a4b2 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: 4d46fff2-b04d-41aa-ada0-2023ab545b48] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:44:39.267866 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-77e56fcb-534b-4cd8-a9ae-c7034ea3a4b2 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:39.268471 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-77e56fcb-534b-4cd8-a9ae-c7034ea3a4b2 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:39.268969 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-77e56fcb-534b-4cd8-a9ae-c7034ea3a4b2 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:39.269704 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-77e56fcb-534b-4cd8-a9ae-c7034ea3a4b2 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:39.270158 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-77e56fcb-534b-4cd8-a9ae-c7034ea3a4b2 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:39.272454 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-77e56fcb-534b-4cd8-a9ae-c7034ea3a4b2 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:39.607528 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-77e56fcb-534b-4cd8-a9ae-c7034ea3a4b2 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac650232cc04810b1340dc2f0edadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b0670d1bd99424780a70e69d57a2166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:44:39.616190 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-77e56fcb-534b-4cd8-a9ae-c7034ea3a4b2 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48" status: 200 len: 1363 microversion: 2.1 time: 0.389469 Oct 04 20:44:39.621066 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1188/2449] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:44:39 2022] GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48 => generated 1363 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:44:39.666694 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-72af216e-dfcf-44b6-970c-4f58ef96ea1f tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Flavor limits 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:44:39.667159 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-72af216e-dfcf-44b6-970c-4f58ef96ea1f tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Image limits 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:44:39.668099 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-72af216e-dfcf-44b6-970c-4f58ef96ea1f tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Flavor pref 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:44:39.668586 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-72af216e-dfcf-44b6-970c-4f58ef96ea1f tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Image pref 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:44:39.670569 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-72af216e-dfcf-44b6-970c-4f58ef96ea1f tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:44:39.702386 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-bfc820eb-ccf4-477f-a40d-79e3efd33bc2 req-78c4303a-4679-4521-9086-7b49b30e470e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07fdb076-59a4-4c77-a42b-07fa92bcf408", "name": "network-vif-plugged", "status": "completed", "tag": "6c6f9c50-74c0-4f1b-ac6e-dd96429aa674"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:44:39.707162 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-72af216e-dfcf-44b6-970c-4f58ef96ea1f tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:39.717944 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-72af216e-dfcf-44b6-970c-4f58ef96ea1f tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:39.718910 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-bfc820eb-ccf4-477f-a40d-79e3efd33bc2 req-78c4303a-4679-4521-9086-7b49b30e470e service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:39.719501 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-bfc820eb-ccf4-477f-a40d-79e3efd33bc2 req-78c4303a-4679-4521-9086-7b49b30e470e service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:39.720769 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-bfc820eb-ccf4-477f-a40d-79e3efd33bc2 req-78c4303a-4679-4521-9086-7b49b30e470e service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:39.721151 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-72af216e-dfcf-44b6-970c-4f58ef96ea1f tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:39.722458 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-72af216e-dfcf-44b6-970c-4f58ef96ea1f tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:39.722972 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-72af216e-dfcf-44b6-970c-4f58ef96ea1f tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:39.723417 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-72af216e-dfcf-44b6-970c-4f58ef96ea1f tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:39.735161 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-bfc820eb-ccf4-477f-a40d-79e3efd33bc2 req-78c4303a-4679-4521-9086-7b49b30e470e service nova] Creating event network-vif-plugged:6c6f9c50-74c0-4f1b-ac6e-dd96429aa674 for instance 07fdb076-59a4-4c77-a42b-07fa92bcf408 on n-h1-854823-8 Oct 04 20:44:39.740213 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-bfc820eb-ccf4-477f-a40d-79e3efd33bc2 req-78c4303a-4679-4521-9086-7b49b30e470e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045260 Oct 04 20:44:39.741854 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1189/2450] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:44:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 20:44:39.784128 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b6cdc38e-1ce9-4fbd-9616-cd79a988209b tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:44:39.784970 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b6cdc38e-1ce9-4fbd-9616-cd79a988209b tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] [instance: 07fdb076-59a4-4c77-a42b-07fa92bcf408] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:44:39.793808 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b6cdc38e-1ce9-4fbd-9616-cd79a988209b tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:39.794573 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b6cdc38e-1ce9-4fbd-9616-cd79a988209b tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:39.795163 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b6cdc38e-1ce9-4fbd-9616-cd79a988209b tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:39.796082 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b6cdc38e-1ce9-4fbd-9616-cd79a988209b tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:39.805365 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b6cdc38e-1ce9-4fbd-9616-cd79a988209b tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:39.807996 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b6cdc38e-1ce9-4fbd-9616-cd79a988209b tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:39.813230 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-72af216e-dfcf-44b6-970c-4f58ef96ea1f tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Getting quotas for project 7097bc12179446f6a3e1fac8434d5c64. Resources: {'ram', 'instances', 'cores'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:44:39.831927 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-72af216e-dfcf-44b6-970c-4f58ef96ea1f tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Getting quotas for user 87dcc7baf63f4ae6bfe0a099adffd408 and project 7097bc12179446f6a3e1fac8434d5c64. Resources: {'ram', 'instances', 'cores'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:44:39.867462 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-72af216e-dfcf-44b6-970c-4f58ef96ea1f tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Going to run 1 instances... {{(pid=128802) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:44:39.874331 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-72af216e-dfcf-44b6-970c-4f58ef96ea1f tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] [instance: 797893a5-beaa-4f69-be4c-66592fb3fb33] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='15b24725-0c99-4bcf-b1fb-907cdf8e2d63',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128802) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:44:39.974397 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-72af216e-dfcf-44b6-970c-4f58ef96ea1f tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.213679 Oct 04 20:44:39.983407 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1262/2451] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 20:44:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 1224 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 20:44:39.995362 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-0220475a-cc8d-41b7-a2c1-206a51fad0db tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:44:39.996954 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-0220475a-cc8d-41b7-a2c1-206a51fad0db tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] [instance: c147993c-5773-4b76-93bc-62c0cbb6044a] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:44:40.016740 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0220475a-cc8d-41b7-a2c1-206a51fad0db tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:40.022379 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0220475a-cc8d-41b7-a2c1-206a51fad0db tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:40.023885 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0220475a-cc8d-41b7-a2c1-206a51fad0db tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:40.025594 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0220475a-cc8d-41b7-a2c1-206a51fad0db tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:40.026964 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0220475a-cc8d-41b7-a2c1-206a51fad0db tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:40.027434 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0220475a-cc8d-41b7-a2c1-206a51fad0db tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:40.168050 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-b6cdc38e-1ce9-4fbd-9616-cd79a988209b tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e4b00964014a0383f79597652bd428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7f38600b5041ad8e66a12d77b940fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:44:40.179073 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b6cdc38e-1ce9-4fbd-9616-cd79a988209b tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] 10.222.0.33 "GET /compute/v2.1/servers/07fdb076-59a4-4c77-a42b-07fa92bcf408" status: 200 len: 1366 microversion: 2.1 time: 0.397546 Oct 04 20:44:40.179713 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1190/2452] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:44:39 2022] GET /compute/v2.1/servers/07fdb076-59a4-4c77-a42b-07fa92bcf408 => generated 1366 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:44:40.192731 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-72af85ec-13a1-4856-98ee-82e06bfe6195 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:44:40.193441 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-72af85ec-13a1-4856-98ee-82e06bfe6195 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] [instance: 797893a5-beaa-4f69-be4c-66592fb3fb33] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:44:40.330509 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-72af85ec-13a1-4856-98ee-82e06bfe6195 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87dcc7baf63f4ae6bfe0a099adffd408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7097bc12179446f6a3e1fac8434d5c64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:44:40.339607 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-72af85ec-13a1-4856-98ee-82e06bfe6195 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] 10.222.0.33 "GET /compute/v2.1/servers/797893a5-beaa-4f69-be4c-66592fb3fb33" status: 200 len: 1221 microversion: 2.1 time: 0.158861 Oct 04 20:44:40.340399 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1191/2453] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:44:40 2022] GET /compute/v2.1/servers/797893a5-beaa-4f69-be4c-66592fb3fb33 => generated 1221 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:44:40.364708 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-72b4e1b9-5a41-47b8-a1f0-5645898192e4 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:44:40.365776 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-72b4e1b9-5a41-47b8-a1f0-5645898192e4 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] [instance: 62b98bc7-657a-42c2-b501-ae4d926cfa2f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:44:40.375921 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-72b4e1b9-5a41-47b8-a1f0-5645898192e4 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:40.376575 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-72b4e1b9-5a41-47b8-a1f0-5645898192e4 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:40.377040 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-72b4e1b9-5a41-47b8-a1f0-5645898192e4 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:40.377925 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-72b4e1b9-5a41-47b8-a1f0-5645898192e4 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:40.378646 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-72b4e1b9-5a41-47b8-a1f0-5645898192e4 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:40.379273 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-72b4e1b9-5a41-47b8-a1f0-5645898192e4 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:40.613560 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-0220475a-cc8d-41b7-a2c1-206a51fad0db tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e1e240b20e41e8b90e0d630e0d6b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a44744f2bb4130b9a49065b49cf854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:44:40.623539 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-0220475a-cc8d-41b7-a2c1-206a51fad0db tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] 10.222.0.33 "GET /compute/v2.1/servers/c147993c-5773-4b76-93bc-62c0cbb6044a" status: 200 len: 1676 microversion: 2.1 time: 0.638828 Oct 04 20:44:40.625098 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1263/2454] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:44:39 2022] GET /compute/v2.1/servers/c147993c-5773-4b76-93bc-62c0cbb6044a => generated 1676 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:44:40.647598 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-45c5f4e7-bcbc-4be2-870c-974f3bda204d tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:44:40.648489 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-45c5f4e7-bcbc-4be2-870c-974f3bda204d tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: 4d46fff2-b04d-41aa-ada0-2023ab545b48] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:44:40.656186 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-45c5f4e7-bcbc-4be2-870c-974f3bda204d tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:40.656960 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-45c5f4e7-bcbc-4be2-870c-974f3bda204d tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:40.657960 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-45c5f4e7-bcbc-4be2-870c-974f3bda204d tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:40.658916 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-45c5f4e7-bcbc-4be2-870c-974f3bda204d tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:40.659647 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-45c5f4e7-bcbc-4be2-870c-974f3bda204d tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:40.660347 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-45c5f4e7-bcbc-4be2-870c-974f3bda204d tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:40.856591 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-72b4e1b9-5a41-47b8-a1f0-5645898192e4 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '800db3a57ada47eca381b00189fdbf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66ec8ea91b04deb90b679589e0495bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:44:40.870120 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-72b4e1b9-5a41-47b8-a1f0-5645898192e4 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] 10.222.0.33 "GET /compute/v2.1/servers/62b98bc7-657a-42c2-b501-ae4d926cfa2f" status: 200 len: 1500 microversion: 2.1 time: 0.510068 Oct 04 20:44:40.890297 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1192/2455] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:44:40 2022] GET /compute/v2.1/servers/62b98bc7-657a-42c2-b501-ae4d926cfa2f => generated 1500 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:44:40.919818 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-45c5f4e7-bcbc-4be2-870c-974f3bda204d tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac650232cc04810b1340dc2f0edadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b0670d1bd99424780a70e69d57a2166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:44:40.939771 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-45c5f4e7-bcbc-4be2-870c-974f3bda204d tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48" status: 200 len: 1363 microversion: 2.1 time: 0.296895 Oct 04 20:44:40.940925 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1264/2456] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:44:40 2022] GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48 => generated 1363 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:44:41.125723 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-40b28c2e-4328-4444-a547-6320f20f7c65 req-9abaaa4e-e557-4684-9183-53f5ffd68c62 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c147993c-5773-4b76-93bc-62c0cbb6044a", "name": "network-vif-deleted", "tag": "836586b9-492b-4387-b626-cc2fd5463aef"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:44:41.155273 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-40b28c2e-4328-4444-a547-6320f20f7c65 req-9abaaa4e-e557-4684-9183-53f5ffd68c62 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:41.157400 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-40b28c2e-4328-4444-a547-6320f20f7c65 req-9abaaa4e-e557-4684-9183-53f5ffd68c62 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:41.160682 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-40b28c2e-4328-4444-a547-6320f20f7c65 req-9abaaa4e-e557-4684-9183-53f5ffd68c62 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:41.196366 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-40b28c2e-4328-4444-a547-6320f20f7c65 req-9abaaa4e-e557-4684-9183-53f5ffd68c62 service nova] Creating event network-vif-deleted:836586b9-492b-4387-b626-cc2fd5463aef for instance c147993c-5773-4b76-93bc-62c0cbb6044a on n-h2-854823-8 Oct 04 20:44:41.206541 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-8bde5a5b-66ff-4973-a7f7-7cebfe937929 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:44:41.207634 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-8bde5a5b-66ff-4973-a7f7-7cebfe937929 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] [instance: 07fdb076-59a4-4c77-a42b-07fa92bcf408] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:44:41.207750 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-40b28c2e-4328-4444-a547-6320f20f7c65 req-9abaaa4e-e557-4684-9183-53f5ffd68c62 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085526 Oct 04 20:44:41.209759 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1193/2457] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:44:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:44:41.223277 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8bde5a5b-66ff-4973-a7f7-7cebfe937929 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:41.224103 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8bde5a5b-66ff-4973-a7f7-7cebfe937929 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:41.224760 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8bde5a5b-66ff-4973-a7f7-7cebfe937929 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:41.225738 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8bde5a5b-66ff-4973-a7f7-7cebfe937929 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:41.226476 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8bde5a5b-66ff-4973-a7f7-7cebfe937929 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:41.227316 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8bde5a5b-66ff-4973-a7f7-7cebfe937929 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:41.365171 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-dd3cb197-d5b3-4bf6-bf0d-e5a461436f1b tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:44:41.365878 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-dd3cb197-d5b3-4bf6-bf0d-e5a461436f1b tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] [instance: 797893a5-beaa-4f69-be4c-66592fb3fb33] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:44:41.393328 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dd3cb197-d5b3-4bf6-bf0d-e5a461436f1b tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:41.393820 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dd3cb197-d5b3-4bf6-bf0d-e5a461436f1b tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:41.394256 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dd3cb197-d5b3-4bf6-bf0d-e5a461436f1b tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:41.394991 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dd3cb197-d5b3-4bf6-bf0d-e5a461436f1b tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:41.414208 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dd3cb197-d5b3-4bf6-bf0d-e5a461436f1b tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:41.418652 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dd3cb197-d5b3-4bf6-bf0d-e5a461436f1b tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:41.526135 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-8bde5a5b-66ff-4973-a7f7-7cebfe937929 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e4b00964014a0383f79597652bd428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7f38600b5041ad8e66a12d77b940fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:44:41.540225 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-8bde5a5b-66ff-4973-a7f7-7cebfe937929 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] 10.222.0.33 "GET /compute/v2.1/servers/07fdb076-59a4-4c77-a42b-07fa92bcf408" status: 200 len: 1366 microversion: 2.1 time: 0.338697 Oct 04 20:44:41.558635 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1265/2458] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:44:41 2022] GET /compute/v2.1/servers/07fdb076-59a4-4c77-a42b-07fa92bcf408 => generated 1366 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:44:41.565428 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-c9fa8929-1ac2-4a5b-ba51-9a62b9c18f5d req-a44131f5-ecb3-45e1-878c-af3095c0eff0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62b98bc7-657a-42c2-b501-ae4d926cfa2f", "name": "network-vif-deleted", "tag": "7e9ad1e9-b4f0-48a2-b19c-30f06d92c931"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:44:41.579674 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-c9fa8929-1ac2-4a5b-ba51-9a62b9c18f5d req-a44131f5-ecb3-45e1-878c-af3095c0eff0 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:41.580643 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-c9fa8929-1ac2-4a5b-ba51-9a62b9c18f5d req-a44131f5-ecb3-45e1-878c-af3095c0eff0 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:41.581298 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-c9fa8929-1ac2-4a5b-ba51-9a62b9c18f5d req-a44131f5-ecb3-45e1-878c-af3095c0eff0 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:41.633217 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-c9fa8929-1ac2-4a5b-ba51-9a62b9c18f5d req-a44131f5-ecb3-45e1-878c-af3095c0eff0 service nova] Creating event network-vif-deleted:7e9ad1e9-b4f0-48a2-b19c-30f06d92c931 for instance 62b98bc7-657a-42c2-b501-ae4d926cfa2f on n-h2-854823-8 Oct 04 20:44:41.650895 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-c9fa8929-1ac2-4a5b-ba51-9a62b9c18f5d req-a44131f5-ecb3-45e1-878c-af3095c0eff0 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090047 Oct 04 20:44:41.655082 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1266/2459] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:44:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:44:41.668021 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-e28c823b-ee68-42b9-ac20-25fbecfdaa26 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:44:41.669247 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-e28c823b-ee68-42b9-ac20-25fbecfdaa26 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] [instance: c147993c-5773-4b76-93bc-62c0cbb6044a] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:44:41.674588 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-dd3cb197-d5b3-4bf6-bf0d-e5a461436f1b tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87dcc7baf63f4ae6bfe0a099adffd408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7097bc12179446f6a3e1fac8434d5c64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:44:41.685438 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e28c823b-ee68-42b9-ac20-25fbecfdaa26 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:41.690887 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-dd3cb197-d5b3-4bf6-bf0d-e5a461436f1b tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] 10.222.0.33 "GET /compute/v2.1/servers/797893a5-beaa-4f69-be4c-66592fb3fb33" status: 200 len: 1273 microversion: 2.1 time: 0.330311 Oct 04 20:44:41.692544 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e28c823b-ee68-42b9-ac20-25fbecfdaa26 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:41.693350 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e28c823b-ee68-42b9-ac20-25fbecfdaa26 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:41.694112 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1194/2460] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:44:41 2022] GET /compute/v2.1/servers/797893a5-beaa-4f69-be4c-66592fb3fb33 => generated 1273 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:44:41.695573 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e28c823b-ee68-42b9-ac20-25fbecfdaa26 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:41.696494 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e28c823b-ee68-42b9-ac20-25fbecfdaa26 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:41.697288 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e28c823b-ee68-42b9-ac20-25fbecfdaa26 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:41.772083 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-50009456-b541-45b7-907f-5a5ab1cf953d req-861436ec-4cf5-4f19-8824-6dc17bd9c532 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d46fff2-b04d-41aa-ada0-2023ab545b48", "name": "network-vif-plugged", "status": "completed", "tag": "39e1fcde-c40c-4b4b-8edd-7565faaf4580"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:44:41.783993 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-50009456-b541-45b7-907f-5a5ab1cf953d req-861436ec-4cf5-4f19-8824-6dc17bd9c532 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:41.784703 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-50009456-b541-45b7-907f-5a5ab1cf953d req-861436ec-4cf5-4f19-8824-6dc17bd9c532 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:41.785293 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-50009456-b541-45b7-907f-5a5ab1cf953d req-861436ec-4cf5-4f19-8824-6dc17bd9c532 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:41.813453 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-50009456-b541-45b7-907f-5a5ab1cf953d req-861436ec-4cf5-4f19-8824-6dc17bd9c532 service nova] Creating event network-vif-plugged:39e1fcde-c40c-4b4b-8edd-7565faaf4580 for instance 4d46fff2-b04d-41aa-ada0-2023ab545b48 on n-h1-854823-8 Oct 04 20:44:41.823429 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-50009456-b541-45b7-907f-5a5ab1cf953d req-861436ec-4cf5-4f19-8824-6dc17bd9c532 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053834 Oct 04 20:44:41.833325 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1195/2461] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:44:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 20:44:41.879604 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-e28c823b-ee68-42b9-ac20-25fbecfdaa26 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e1e240b20e41e8b90e0d630e0d6b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a44744f2bb4130b9a49065b49cf854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:44:41.898001 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-e28c823b-ee68-42b9-ac20-25fbecfdaa26 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] 10.222.0.33 "GET /compute/v2.1/servers/c147993c-5773-4b76-93bc-62c0cbb6044a" status: 200 len: 1454 microversion: 2.1 time: 0.240455 Oct 04 20:44:41.898575 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e84d78e5-79c7-49b3-ac6b-00e84c627fb0 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:44:41.901013 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e84d78e5-79c7-49b3-ac6b-00e84c627fb0 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] [instance: 62b98bc7-657a-42c2-b501-ae4d926cfa2f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:44:41.909175 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1267/2462] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:44:41 2022] GET /compute/v2.1/servers/c147993c-5773-4b76-93bc-62c0cbb6044a => generated 1454 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:44:41.937478 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e84d78e5-79c7-49b3-ac6b-00e84c627fb0 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:41.939543 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e84d78e5-79c7-49b3-ac6b-00e84c627fb0 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:41.941097 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e84d78e5-79c7-49b3-ac6b-00e84c627fb0 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:41.941951 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e84d78e5-79c7-49b3-ac6b-00e84c627fb0 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:41.945455 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e84d78e5-79c7-49b3-ac6b-00e84c627fb0 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:41.946429 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e84d78e5-79c7-49b3-ac6b-00e84c627fb0 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:41.966029 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-787e8b99-015d-48c3-9748-030c1adcc003 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:44:41.968214 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-787e8b99-015d-48c3-9748-030c1adcc003 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: 4d46fff2-b04d-41aa-ada0-2023ab545b48] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:44:41.985088 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-787e8b99-015d-48c3-9748-030c1adcc003 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:41.989107 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-787e8b99-015d-48c3-9748-030c1adcc003 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:41.992526 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-787e8b99-015d-48c3-9748-030c1adcc003 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:41.997354 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-787e8b99-015d-48c3-9748-030c1adcc003 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:41.998552 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-787e8b99-015d-48c3-9748-030c1adcc003 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:42.001395 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-787e8b99-015d-48c3-9748-030c1adcc003 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:42.477467 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e84d78e5-79c7-49b3-ac6b-00e84c627fb0 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '800db3a57ada47eca381b00189fdbf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66ec8ea91b04deb90b679589e0495bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:44:42.488542 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e84d78e5-79c7-49b3-ac6b-00e84c627fb0 tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] 10.222.0.33 "GET /compute/v2.1/servers/62b98bc7-657a-42c2-b501-ae4d926cfa2f" status: 200 len: 1295 microversion: 2.1 time: 0.595309 Oct 04 20:44:42.491007 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1196/2463] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:44:41 2022] GET /compute/v2.1/servers/62b98bc7-657a-42c2-b501-ae4d926cfa2f => generated 1295 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:44:42.575557 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c5de8d06-3ae2-462a-b218-808df41ca9e6 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:44:42.576209 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c5de8d06-3ae2-462a-b218-808df41ca9e6 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] [instance: 07fdb076-59a4-4c77-a42b-07fa92bcf408] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:44:42.588666 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c5de8d06-3ae2-462a-b218-808df41ca9e6 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:42.589154 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c5de8d06-3ae2-462a-b218-808df41ca9e6 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:42.589619 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c5de8d06-3ae2-462a-b218-808df41ca9e6 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:42.590360 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c5de8d06-3ae2-462a-b218-808df41ca9e6 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:42.590863 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c5de8d06-3ae2-462a-b218-808df41ca9e6 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:42.591202 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c5de8d06-3ae2-462a-b218-808df41ca9e6 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:42.612371 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-787e8b99-015d-48c3-9748-030c1adcc003 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac650232cc04810b1340dc2f0edadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b0670d1bd99424780a70e69d57a2166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:44:42.625108 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-787e8b99-015d-48c3-9748-030c1adcc003 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48" status: 200 len: 1363 microversion: 2.1 time: 0.664456 Oct 04 20:44:42.625590 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1268/2464] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:44:41 2022] GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48 => generated 1363 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:44:42.833593 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-a502ce6a-797c-4e10-8903-05635047ce43 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-UnshelveToHostMultiNodesTest-server-1589129371", "imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63", "flavorRef": "452", "networks": "none"}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:44:42.845471 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c5de8d06-3ae2-462a-b218-808df41ca9e6 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e4b00964014a0383f79597652bd428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7f38600b5041ad8e66a12d77b940fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:44:42.858939 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c5de8d06-3ae2-462a-b218-808df41ca9e6 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] 10.222.0.33 "GET /compute/v2.1/servers/07fdb076-59a4-4c77-a42b-07fa92bcf408" status: 200 len: 1556 microversion: 2.1 time: 0.290057 Oct 04 20:44:42.864355 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1197/2465] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:44:42 2022] GET /compute/v2.1/servers/07fdb076-59a4-4c77-a42b-07fa92bcf408 => generated 1556 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:44:42.874110 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-cbffe814-0ea5-4aaa-b8c5-6b9b11fe2356 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:44:42.874767 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-cbffe814-0ea5-4aaa-b8c5-6b9b11fe2356 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] [instance: 797893a5-beaa-4f69-be4c-66592fb3fb33] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:44:42.901279 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cbffe814-0ea5-4aaa-b8c5-6b9b11fe2356 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:42.902649 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cbffe814-0ea5-4aaa-b8c5-6b9b11fe2356 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:42.903247 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cbffe814-0ea5-4aaa-b8c5-6b9b11fe2356 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:42.904306 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cbffe814-0ea5-4aaa-b8c5-6b9b11fe2356 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:42.904921 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cbffe814-0ea5-4aaa-b8c5-6b9b11fe2356 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:42.905505 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cbffe814-0ea5-4aaa-b8c5-6b9b11fe2356 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:42.937702 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-a502ce6a-797c-4e10-8903-05635047ce43 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Flavor limits 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:44:42.938124 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-a502ce6a-797c-4e10-8903-05635047ce43 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Image limits 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:44:42.943115 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-a502ce6a-797c-4e10-8903-05635047ce43 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Flavor pref 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:44:42.943792 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-a502ce6a-797c-4e10-8903-05635047ce43 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Image pref 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:44:42.947935 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-a502ce6a-797c-4e10-8903-05635047ce43 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:44:42.968065 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a502ce6a-797c-4e10-8903-05635047ce43 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:42.968749 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a502ce6a-797c-4e10-8903-05635047ce43 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:42.969155 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a502ce6a-797c-4e10-8903-05635047ce43 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:42.969975 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a502ce6a-797c-4e10-8903-05635047ce43 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:42.970902 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a502ce6a-797c-4e10-8903-05635047ce43 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:42.971334 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a502ce6a-797c-4e10-8903-05635047ce43 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:43.012254 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-a502ce6a-797c-4e10-8903-05635047ce43 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Getting quotas for project 19288828ae3341cdb3672abf6a1eed4f. Resources: {'ram', 'instances', 'cores'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:44:43.020384 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-a502ce6a-797c-4e10-8903-05635047ce43 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Getting quotas for user 3d4c5bb0cce64c54b7b02c35b0277e7b and project 19288828ae3341cdb3672abf6a1eed4f. Resources: {'ram', 'instances', 'cores'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:44:43.037027 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-a502ce6a-797c-4e10-8903-05635047ce43 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Going to run 1 instances... {{(pid=128802) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:44:43.039719 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-a502ce6a-797c-4e10-8903-05635047ce43 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] [instance: 39d66e18-289f-4674-b66c-146d68ef9133] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='15b24725-0c99-4bcf-b1fb-907cdf8e2d63',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128802) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:44:43.110106 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-a502ce6a-797c-4e10-8903-05635047ce43 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.91 time: 0.482939 Oct 04 20:44:43.111789 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1269/2466] 10.222.0.33 () {62 vars in 1188 bytes} [Tue Oct 4 20:44:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 485 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 04 20:44:43.117543 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-5f53be83-da81-415b-a335-fe38e75ce6dc tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:44:43.121817 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-5f53be83-da81-415b-a335-fe38e75ce6dc tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] [instance: 07fdb076-59a4-4c77-a42b-07fa92bcf408] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:44:43.130108 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-cbffe814-0ea5-4aaa-b8c5-6b9b11fe2356 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87dcc7baf63f4ae6bfe0a099adffd408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7097bc12179446f6a3e1fac8434d5c64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:44:43.163522 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-cbffe814-0ea5-4aaa-b8c5-6b9b11fe2356 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] 10.222.0.33 "GET /compute/v2.1/servers/797893a5-beaa-4f69-be4c-66592fb3fb33" status: 200 len: 1279 microversion: 2.1 time: 0.293197 Oct 04 20:44:43.165827 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1198/2467] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:44:42 2022] GET /compute/v2.1/servers/797893a5-beaa-4f69-be4c-66592fb3fb33 => generated 1279 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:44:43.166948 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5f53be83-da81-415b-a335-fe38e75ce6dc tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:43.169062 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5f53be83-da81-415b-a335-fe38e75ce6dc tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:43.172675 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5f53be83-da81-415b-a335-fe38e75ce6dc tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:43.176731 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5f53be83-da81-415b-a335-fe38e75ce6dc tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:43.177393 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5f53be83-da81-415b-a335-fe38e75ce6dc tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:43.178131 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5f53be83-da81-415b-a335-fe38e75ce6dc tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:43.184947 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8e49bf39-2b23-4309-85c2-64459b9d5012 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:44:43.187870 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-8e49bf39-2b23-4309-85c2-64459b9d5012 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] [instance: c147993c-5773-4b76-93bc-62c0cbb6044a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:44:43.201931 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8e49bf39-2b23-4309-85c2-64459b9d5012 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:43.206627 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8e49bf39-2b23-4309-85c2-64459b9d5012 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:43.207260 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8e49bf39-2b23-4309-85c2-64459b9d5012 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:43.209237 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8e49bf39-2b23-4309-85c2-64459b9d5012 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:43.210833 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8e49bf39-2b23-4309-85c2-64459b9d5012 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:43.211628 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8e49bf39-2b23-4309-85c2-64459b9d5012 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:43.270526 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8e49bf39-2b23-4309-85c2-64459b9d5012 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:43.271279 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8e49bf39-2b23-4309-85c2-64459b9d5012 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:43.272094 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8e49bf39-2b23-4309-85c2-64459b9d5012 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:43.274272 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-8e49bf39-2b23-4309-85c2-64459b9d5012 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Lazy-loading 'fault' on Instance uuid c147993c-5773-4b76-93bc-62c0cbb6044a {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:44:44.102861 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-8e49bf39-2b23-4309-85c2-64459b9d5012 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e1e240b20e41e8b90e0d630e0d6b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a44744f2bb4130b9a49065b49cf854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:44:44.111580 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-8e49bf39-2b23-4309-85c2-64459b9d5012 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] 10.222.0.33 "GET /compute/v2.1/servers/c147993c-5773-4b76-93bc-62c0cbb6044a" status: 200 len: 1303 microversion: 2.1 time: 0.939790 Oct 04 20:44:44.130868 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1199/2468] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:44:43 2022] GET /compute/v2.1/servers/c147993c-5773-4b76-93bc-62c0cbb6044a => generated 1303 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:44:44.140249 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5ccdb068-1e92-4591-a272-c79695cefefe tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:44:44.141174 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-5ccdb068-1e92-4591-a272-c79695cefefe tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] [instance: 39d66e18-289f-4674-b66c-146d68ef9133] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:44:44.147907 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5ccdb068-1e92-4591-a272-c79695cefefe tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:44.148771 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5ccdb068-1e92-4591-a272-c79695cefefe tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:44.149445 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5ccdb068-1e92-4591-a272-c79695cefefe tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:44.151417 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5ccdb068-1e92-4591-a272-c79695cefefe tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:44.152144 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5ccdb068-1e92-4591-a272-c79695cefefe tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:44.152832 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5ccdb068-1e92-4591-a272-c79695cefefe tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:44.215777 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-5f53be83-da81-415b-a335-fe38e75ce6dc tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] 10.222.0.33 "GET /compute/v2.1/servers/07fdb076-59a4-4c77-a42b-07fa92bcf408/os-interface" status: 200 len: 285 microversion: 2.1 time: 1.102743 Oct 04 20:44:44.218052 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1270/2469] 10.222.0.33 () {58 vars in 1275 bytes} [Tue Oct 4 20:44:43 2022] GET /compute/v2.1/servers/07fdb076-59a4-4c77-a42b-07fa92bcf408/os-interface => generated 285 bytes in 1106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:44:44.223756 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-6ae430b4-ae8a-40f1-9e5a-e79048e9e89d req-12ef552e-1954-4358-8a1a-1c4e7aaadefa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c147993c-5773-4b76-93bc-62c0cbb6044a", "name": "network-vif-deleted", "tag": "ce227d9f-091c-4a59-94a6-70391aac4f0c"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:44:44.263793 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-6ae430b4-ae8a-40f1-9e5a-e79048e9e89d req-12ef552e-1954-4358-8a1a-1c4e7aaadefa service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:44.264444 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-6ae430b4-ae8a-40f1-9e5a-e79048e9e89d req-12ef552e-1954-4358-8a1a-1c4e7aaadefa service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:44.265263 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-6ae430b4-ae8a-40f1-9e5a-e79048e9e89d req-12ef552e-1954-4358-8a1a-1c4e7aaadefa service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:44.288362 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-6ae430b4-ae8a-40f1-9e5a-e79048e9e89d req-12ef552e-1954-4358-8a1a-1c4e7aaadefa service nova] Creating event network-vif-deleted:ce227d9f-091c-4a59-94a6-70391aac4f0c for instance c147993c-5773-4b76-93bc-62c0cbb6044a on n-h2-854823-8 Oct 04 20:44:44.301393 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-6ae430b4-ae8a-40f1-9e5a-e79048e9e89d req-12ef552e-1954-4358-8a1a-1c4e7aaadefa service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081642 Oct 04 20:44:44.302573 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1271/2470] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:44:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:44:44.308428 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-8568b651-3279-496a-ae95-0b5a4f328feb tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:44:44.312540 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-8568b651-3279-496a-ae95-0b5a4f328feb tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] [instance: 62b98bc7-657a-42c2-b501-ae4d926cfa2f] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:44:44.323657 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-5ccdb068-1e92-4591-a272-c79695cefefe tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:44:44.334186 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-5ccdb068-1e92-4591-a272-c79695cefefe tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:44:44.340898 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8568b651-3279-496a-ae95-0b5a4f328feb tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:44.347655 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-5ccdb068-1e92-4591-a272-c79695cefefe tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:44:44.349839 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8568b651-3279-496a-ae95-0b5a4f328feb tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:44.351201 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8568b651-3279-496a-ae95-0b5a4f328feb tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:44.355187 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8568b651-3279-496a-ae95-0b5a4f328feb tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:44.357031 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8568b651-3279-496a-ae95-0b5a4f328feb tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:44.357573 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8568b651-3279-496a-ae95-0b5a4f328feb tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:44.366211 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5ccdb068-1e92-4591-a272-c79695cefefe tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] 10.222.0.33 "GET /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133" status: 200 len: 1458 microversion: 2.91 time: 0.234104 Oct 04 20:44:44.371140 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1200/2471] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:44:44 2022] GET /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133 => generated 1458 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:44:44.376180 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7d0e49b6-8269-4f58-85cf-6b880cd2c8b7 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:44:44.387645 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-7d0e49b6-8269-4f58-85cf-6b880cd2c8b7 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: 4d46fff2-b04d-41aa-ada0-2023ab545b48] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:44:44.404294 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.wsgi [None req-8568b651-3279-496a-ae95-0b5a4f328feb tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] HTTP exception thrown: Instance 62b98bc7-657a-42c2-b501-ae4d926cfa2f could not be found. Oct 04 20:44:44.407919 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7d0e49b6-8269-4f58-85cf-6b880cd2c8b7 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:44.408465 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-8568b651-3279-496a-ae95-0b5a4f328feb tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Request method failure captured: Oct 04 20:44:44.408465 n-d-854823-8 devstack@n-api.service[128802]: request: GET /compute/v2.1/servers/62b98bc7-657a-42c2-b501-ae4d926cfa2f HTTP/1.1 Oct 04 20:44:44.408465 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 20:44:44.408465 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 20:44:44.408465 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 20:44:44.408465 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 0 Oct 04 20:44:44.408465 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 20:44:44.408465 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 20:44:44.408465 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 20:44:44.408465 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 20:44:44.408465 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPJl4WjK2XOBz3Jib2KCFRRv_VVnIEfTQGHoxZM5XJ5BSJtLq13YunIRMsvibZAHFSEforKQvXOJN7Mpa7ib-OsivWWjd0zFvYVOTkOZ9HJyr7xiC3a5IANK9maJs5GcpkRWx5DiN4avmq2Y6KfQPe2M0iIN_3U2JOMkAmLVevv57Lk8 Oct 04 20:44:44.408465 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 20:44:44.408465 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 20:44:44.408465 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 20:44:44.408465 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 20:44:44.408465 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 20:44:44.408465 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 20:44:44.408465 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: d66ec8ea91b04deb90b679589e0495bb Oct 04 20:44:44.408465 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-LiveMigrationTest-856257328 Oct 04 20:44:44.408465 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 20:44:44.408465 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 20:44:44.408465 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d66ec8ea91b04deb90b679589e0495bb", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d66ec8ea91b04deb90b679589e0495bb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d66ec8ea91b04deb90b679589e0495bb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d66ec8ea91b04deb90b679589e0495bb"}]}] Oct 04 20:44:44.408465 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-LiveMigrationTest-856257328 Oct 04 20:44:44.408465 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: d66ec8ea91b04deb90b679589e0495bb Oct 04 20:44:44.408465 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-LiveMigrationTest-856257328 Oct 04 20:44:44.408465 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-LiveMigrationTest-856257328-project Oct 04 20:44:44.408465 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 20:44:44.408465 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 20:44:44.408465 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: 800db3a57ada47eca381b00189fdbf0a Oct 04 20:44:44.408465 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-LiveMigrationTest-856257328-project Oct 04 20:44:44.408465 n-d-854823-8 devstack@n-api.service[128802]: method: > Oct 04 20:44:44.408465 n-d-854823-8 devstack@n-api.service[128802]: exception: Instance 62b98bc7-657a-42c2-b501-ae4d926cfa2f could not be found. Oct 04 20:44:44.408465 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'id': '62b98bc7-657a-42c2-b501-ae4d926cfa2f'} Oct 04 20:44:44.408465 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:44:44.408465 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:44:44.408465 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:44:44.408465 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:44:44.408465 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:44:44.408465 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:44:44.408465 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:44:44.408465 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:44:44.408465 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:44:44.408465 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:44:44.408465 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62b98bc7-657a-42c2-b501-ae4d926cfa2f could not be found. Oct 04 20:44:44.408465 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:44:44.408465 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:44:44.408465 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:44:44.408465 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:44:44.408465 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:44:44.408465 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:44:44.408465 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:44:44.408465 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:44:44.408465 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:44:44.408465 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:44:44.408465 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:44:44.408465 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:44:44.408465 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:44:44.408465 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:44:44.408465 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:44:44.408465 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:44:44.408465 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62b98bc7-657a-42c2-b501-ae4d926cfa2f could not be found. Oct 04 20:44:44.408465 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:44:44.408465 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:44:44.408465 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:44:44.412311 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:44:44.412311 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:44:44.412311 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:44:44.412311 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:44:44.412311 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:44:44.412311 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62b98bc7-657a-42c2-b501-ae4d926cfa2f could not be found. Oct 04 20:44:44.412311 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:44:44.412311 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-8568b651-3279-496a-ae95-0b5a4f328feb tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] Returning 404 to user: Instance 62b98bc7-657a-42c2-b501-ae4d926cfa2f could not be found. {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:44:44.412311 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-8568b651-3279-496a-ae95-0b5a4f328feb tempest-LiveMigrationTest-856257328 tempest-LiveMigrationTest-856257328-project] 10.222.0.33 "GET /compute/v2.1/servers/62b98bc7-657a-42c2-b501-ae4d926cfa2f" status: 404 len: 111 microversion: 2.1 time: 0.106008 Oct 04 20:44:44.416319 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7d0e49b6-8269-4f58-85cf-6b880cd2c8b7 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:44.417100 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7d0e49b6-8269-4f58-85cf-6b880cd2c8b7 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:44.418121 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7d0e49b6-8269-4f58-85cf-6b880cd2c8b7 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:44.418851 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7d0e49b6-8269-4f58-85cf-6b880cd2c8b7 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:44.419496 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7d0e49b6-8269-4f58-85cf-6b880cd2c8b7 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:44.420975 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1272/2472] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:44:44 2022] GET /compute/v2.1/servers/62b98bc7-657a-42c2-b501-ae4d926cfa2f => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:44:44.434771 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-9a9113cc-5b64-433b-bd31-f01e20f3af9c tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:44:44.448180 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-9a9113cc-5b64-433b-bd31-f01e20f3af9c tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] [instance: 797893a5-beaa-4f69-be4c-66592fb3fb33] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:44:44.475455 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9a9113cc-5b64-433b-bd31-f01e20f3af9c tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:44.481948 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9a9113cc-5b64-433b-bd31-f01e20f3af9c tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:44.485122 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9a9113cc-5b64-433b-bd31-f01e20f3af9c tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:44.486121 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9a9113cc-5b64-433b-bd31-f01e20f3af9c tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:44.488341 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9a9113cc-5b64-433b-bd31-f01e20f3af9c tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:44.489512 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9a9113cc-5b64-433b-bd31-f01e20f3af9c tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:45.052327 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-7d0e49b6-8269-4f58-85cf-6b880cd2c8b7 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac650232cc04810b1340dc2f0edadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b0670d1bd99424780a70e69d57a2166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:44:45.062696 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-7d0e49b6-8269-4f58-85cf-6b880cd2c8b7 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48" status: 200 len: 1550 microversion: 2.1 time: 0.690146 Oct 04 20:44:45.085715 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1201/2473] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:44:44 2022] GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48 => generated 1550 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:44:45.097743 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d976916d-a5ba-4644-a616-6a6e357f882b tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:44:45.098547 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d976916d-a5ba-4644-a616-6a6e357f882b tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: 4d46fff2-b04d-41aa-ada0-2023ab545b48] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:44:45.105897 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d976916d-a5ba-4644-a616-6a6e357f882b tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:45.107190 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d976916d-a5ba-4644-a616-6a6e357f882b tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:45.107843 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d976916d-a5ba-4644-a616-6a6e357f882b tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:45.108975 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d976916d-a5ba-4644-a616-6a6e357f882b tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:45.110553 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d976916d-a5ba-4644-a616-6a6e357f882b tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:45.111606 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d976916d-a5ba-4644-a616-6a6e357f882b tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:45.216576 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-9a9113cc-5b64-433b-bd31-f01e20f3af9c tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87dcc7baf63f4ae6bfe0a099adffd408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7097bc12179446f6a3e1fac8434d5c64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:44:45.229800 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-9a9113cc-5b64-433b-bd31-f01e20f3af9c tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] 10.222.0.33 "GET /compute/v2.1/servers/797893a5-beaa-4f69-be4c-66592fb3fb33" status: 200 len: 1321 microversion: 2.1 time: 0.807573 Oct 04 20:44:45.231480 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1273/2474] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:44:44 2022] GET /compute/v2.1/servers/797893a5-beaa-4f69-be4c-66592fb3fb33 => generated 1321 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:44:45.253855 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d976916d-a5ba-4644-a616-6a6e357f882b tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.166409 Oct 04 20:44:45.258076 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-8b615ac3-dae2-4192-b316-d93f8d066f6f tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:44:45.259886 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-8b615ac3-dae2-4192-b316-d93f8d066f6f tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] [instance: c147993c-5773-4b76-93bc-62c0cbb6044a] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:44:45.265345 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1202/2475] 10.222.0.33 () {58 vars in 1275 bytes} [Tue Oct 4 20:44:45 2022] GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48/os-interface => generated 284 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:44:45.271453 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8b615ac3-dae2-4192-b316-d93f8d066f6f tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:45.272234 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8b615ac3-dae2-4192-b316-d93f8d066f6f tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:45.272862 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8b615ac3-dae2-4192-b316-d93f8d066f6f tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:45.273724 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8b615ac3-dae2-4192-b316-d93f8d066f6f tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:45.274378 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8b615ac3-dae2-4192-b316-d93f8d066f6f tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:45.275696 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8b615ac3-dae2-4192-b316-d93f8d066f6f tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:45.295132 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.wsgi [None req-8b615ac3-dae2-4192-b316-d93f8d066f6f tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] HTTP exception thrown: Instance c147993c-5773-4b76-93bc-62c0cbb6044a could not be found. Oct 04 20:44:45.297432 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-8b615ac3-dae2-4192-b316-d93f8d066f6f tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Request method failure captured: Oct 04 20:44:45.297432 n-d-854823-8 devstack@n-api.service[128802]: request: GET /compute/v2.1/servers/c147993c-5773-4b76-93bc-62c0cbb6044a HTTP/1.1 Oct 04 20:44:45.297432 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 20:44:45.297432 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 20:44:45.297432 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 20:44:45.297432 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 0 Oct 04 20:44:45.297432 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 20:44:45.297432 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 20:44:45.297432 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 20:44:45.297432 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 20:44:45.297432 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPJq9Qd71BosERLHbwV3kJJWPjGgXRnAwIsYo-uTAcHoKIBlN0RgqoukzyD4CEpzEOP916ZiJwcS_DodM5R8KTlQ7aQf1i8Ls6prjaCrz8FEtf6YqeRUj-v5zUGmRZXvKIkY9aYzCIXc6KOjqiXdqOBIUhPEGUrYHrpacXgcHwXicA98 Oct 04 20:44:45.297432 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 20:44:45.297432 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 20:44:45.297432 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 20:44:45.297432 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 20:44:45.297432 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 20:44:45.297432 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 20:44:45.297432 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: a6a44744f2bb4130b9a49065b49cf854 Oct 04 20:44:45.297432 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-ServersTestMultiNic-1546118216 Oct 04 20:44:45.297432 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 20:44:45.297432 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 20:44:45.297432 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a6a44744f2bb4130b9a49065b49cf854", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a6a44744f2bb4130b9a49065b49cf854"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a6a44744f2bb4130b9a49065b49cf854"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a6a44744f2bb4130b9a49065b49cf854"}]}] Oct 04 20:44:45.297432 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-ServersTestMultiNic-1546118216 Oct 04 20:44:45.297432 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: a6a44744f2bb4130b9a49065b49cf854 Oct 04 20:44:45.297432 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-ServersTestMultiNic-1546118216 Oct 04 20:44:45.297432 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-ServersTestMultiNic-1546118216-project Oct 04 20:44:45.297432 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 20:44:45.297432 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 20:44:45.297432 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: e3e1e240b20e41e8b90e0d630e0d6b46 Oct 04 20:44:45.297432 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-ServersTestMultiNic-1546118216-project Oct 04 20:44:45.297432 n-d-854823-8 devstack@n-api.service[128802]: method: > Oct 04 20:44:45.297432 n-d-854823-8 devstack@n-api.service[128802]: exception: Instance c147993c-5773-4b76-93bc-62c0cbb6044a could not be found. Oct 04 20:44:45.297432 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'id': 'c147993c-5773-4b76-93bc-62c0cbb6044a'} Oct 04 20:44:45.297432 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:44:45.297432 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:44:45.297432 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:44:45.297432 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:44:45.297432 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:44:45.297432 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:44:45.297432 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:44:45.297432 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:44:45.297432 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:44:45.297432 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:44:45.297432 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c147993c-5773-4b76-93bc-62c0cbb6044a could not be found. Oct 04 20:44:45.297432 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:44:45.297432 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:44:45.297432 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:44:45.297432 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:44:45.297432 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:44:45.297432 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:44:45.297432 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:44:45.297432 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:44:45.297432 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:44:45.297432 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:44:45.297432 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:44:45.297432 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:44:45.297432 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:44:45.297432 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:44:45.297432 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:44:45.297432 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:44:45.297432 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c147993c-5773-4b76-93bc-62c0cbb6044a could not be found. Oct 04 20:44:45.297432 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:44:45.297432 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:44:45.297432 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:44:45.301588 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:44:45.301588 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:44:45.301588 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:44:45.301588 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:44:45.301588 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:44:45.301588 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c147993c-5773-4b76-93bc-62c0cbb6044a could not be found. Oct 04 20:44:45.301588 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:44:45.318211 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-8b615ac3-dae2-4192-b316-d93f8d066f6f tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Returning 404 to user: Instance c147993c-5773-4b76-93bc-62c0cbb6044a could not be found. {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:44:45.321012 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-8b615ac3-dae2-4192-b316-d93f8d066f6f tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] 10.222.0.33 "GET /compute/v2.1/servers/c147993c-5773-4b76-93bc-62c0cbb6044a" status: 404 len: 111 microversion: 2.1 time: 0.070840 Oct 04 20:44:45.322921 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1274/2476] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:44:45 2022] GET /compute/v2.1/servers/c147993c-5773-4b76-93bc-62c0cbb6044a => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:44:45.407086 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-374c44f2-4d7c-4fb1-89c6-fb0587c0eeb4 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:44:45.407722 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-374c44f2-4d7c-4fb1-89c6-fb0587c0eeb4 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] [instance: 39d66e18-289f-4674-b66c-146d68ef9133] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:44:45.418283 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-374c44f2-4d7c-4fb1-89c6-fb0587c0eeb4 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:45.418806 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-374c44f2-4d7c-4fb1-89c6-fb0587c0eeb4 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:45.419247 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-374c44f2-4d7c-4fb1-89c6-fb0587c0eeb4 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:45.419949 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-374c44f2-4d7c-4fb1-89c6-fb0587c0eeb4 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:45.420401 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-374c44f2-4d7c-4fb1-89c6-fb0587c0eeb4 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:45.420822 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-374c44f2-4d7c-4fb1-89c6-fb0587c0eeb4 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:45.581770 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-374c44f2-4d7c-4fb1-89c6-fb0587c0eeb4 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:44:45.595315 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-374c44f2-4d7c-4fb1-89c6-fb0587c0eeb4 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:44:45.597063 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-374c44f2-4d7c-4fb1-89c6-fb0587c0eeb4 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:44:45.607444 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-374c44f2-4d7c-4fb1-89c6-fb0587c0eeb4 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] 10.222.0.33 "GET /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133" status: 200 len: 1524 microversion: 2.91 time: 0.206319 Oct 04 20:44:45.608656 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1203/2477] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:44:45 2022] GET /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133 => generated 1524 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 20:44:46.257014 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-cf13b512-f3a6-47c8-a991-771dcd872766 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:44:46.260173 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-cf13b512-f3a6-47c8-a991-771dcd872766 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] [instance: 797893a5-beaa-4f69-be4c-66592fb3fb33] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:44:46.268545 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cf13b512-f3a6-47c8-a991-771dcd872766 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:46.269431 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cf13b512-f3a6-47c8-a991-771dcd872766 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:46.270038 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cf13b512-f3a6-47c8-a991-771dcd872766 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:46.270983 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cf13b512-f3a6-47c8-a991-771dcd872766 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:46.271594 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cf13b512-f3a6-47c8-a991-771dcd872766 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:46.273337 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cf13b512-f3a6-47c8-a991-771dcd872766 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:46.561048 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-6c4293bf-5533-4827-8a61-a358bd9ead6a req-946cf98c-3ae8-4b25-a5d0-85f214feb5cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "797893a5-beaa-4f69-be4c-66592fb3fb33", "tag": "1699d26e-69fc-42fc-8457-a5e83b7e153e"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:44:46.580694 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-6c4293bf-5533-4827-8a61-a358bd9ead6a req-946cf98c-3ae8-4b25-a5d0-85f214feb5cf service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:46.582490 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-6c4293bf-5533-4827-8a61-a358bd9ead6a req-946cf98c-3ae8-4b25-a5d0-85f214feb5cf service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:46.583587 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-6c4293bf-5533-4827-8a61-a358bd9ead6a req-946cf98c-3ae8-4b25-a5d0-85f214feb5cf service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:46.609739 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-6c4293bf-5533-4827-8a61-a358bd9ead6a req-946cf98c-3ae8-4b25-a5d0-85f214feb5cf service nova] Creating event network-changed:1699d26e-69fc-42fc-8457-a5e83b7e153e for instance 797893a5-beaa-4f69-be4c-66592fb3fb33 on n-h2-854823-8 Oct 04 20:44:46.616992 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-6c4293bf-5533-4827-8a61-a358bd9ead6a req-946cf98c-3ae8-4b25-a5d0-85f214feb5cf service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063192 Oct 04 20:44:46.619933 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1204/2478] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:44:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:44:46.637727 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5e5733f0-4f5b-4ded-8bcf-9c3d1cb46cee tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:44:46.638706 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-5e5733f0-4f5b-4ded-8bcf-9c3d1cb46cee tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] [instance: 39d66e18-289f-4674-b66c-146d68ef9133] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:44:46.642290 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=82,nova_api:UPDATE=10,nova_api:INSERT=8 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:44:46.646684 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5e5733f0-4f5b-4ded-8bcf-9c3d1cb46cee tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:46.647362 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5e5733f0-4f5b-4ded-8bcf-9c3d1cb46cee tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:46.647961 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5e5733f0-4f5b-4ded-8bcf-9c3d1cb46cee tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:46.648857 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5e5733f0-4f5b-4ded-8bcf-9c3d1cb46cee tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:46.649698 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5e5733f0-4f5b-4ded-8bcf-9c3d1cb46cee tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:46.650452 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5e5733f0-4f5b-4ded-8bcf-9c3d1cb46cee tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:46.992419 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=8 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:44:47.109825 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-5e5733f0-4f5b-4ded-8bcf-9c3d1cb46cee tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:44:47.123311 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-5e5733f0-4f5b-4ded-8bcf-9c3d1cb46cee tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:44:47.125002 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-5e5733f0-4f5b-4ded-8bcf-9c3d1cb46cee tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:44:47.131800 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5e5733f0-4f5b-4ded-8bcf-9c3d1cb46cee tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] 10.222.0.33 "GET /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133" status: 200 len: 1512 microversion: 2.91 time: 0.498909 Oct 04 20:44:47.150559 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1205/2479] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:44:46 2022] GET /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133 => generated 1512 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 20:44:47.291458 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-cf13b512-f3a6-47c8-a991-771dcd872766 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87dcc7baf63f4ae6bfe0a099adffd408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7097bc12179446f6a3e1fac8434d5c64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:44:47.314178 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-cf13b512-f3a6-47c8-a991-771dcd872766 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] 10.222.0.33 "GET /compute/v2.1/servers/797893a5-beaa-4f69-be4c-66592fb3fb33" status: 200 len: 1321 microversion: 2.1 time: 1.063307 Oct 04 20:44:47.329835 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1275/2480] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:44:46 2022] GET /compute/v2.1/servers/797893a5-beaa-4f69-be4c-66592fb3fb33 => generated 1321 bytes in 1065 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:44:48.165647 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8b1922e5-6428-4b93-9833-0ee5aa1bf0b3 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:44:48.166724 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-8b1922e5-6428-4b93-9833-0ee5aa1bf0b3 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] [instance: 39d66e18-289f-4674-b66c-146d68ef9133] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:44:48.183995 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8b1922e5-6428-4b93-9833-0ee5aa1bf0b3 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:48.186152 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8b1922e5-6428-4b93-9833-0ee5aa1bf0b3 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:48.187555 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8b1922e5-6428-4b93-9833-0ee5aa1bf0b3 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:48.188471 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8b1922e5-6428-4b93-9833-0ee5aa1bf0b3 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:48.189239 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8b1922e5-6428-4b93-9833-0ee5aa1bf0b3 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:48.189847 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8b1922e5-6428-4b93-9833-0ee5aa1bf0b3 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:48.338106 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-c6dd380e-7092-4a91-9f27-ef6bd34ceebc tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:44:48.338839 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-c6dd380e-7092-4a91-9f27-ef6bd34ceebc tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] [instance: 797893a5-beaa-4f69-be4c-66592fb3fb33] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:44:48.356508 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c6dd380e-7092-4a91-9f27-ef6bd34ceebc tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:48.357022 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c6dd380e-7092-4a91-9f27-ef6bd34ceebc tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:48.357467 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c6dd380e-7092-4a91-9f27-ef6bd34ceebc tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:48.358196 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c6dd380e-7092-4a91-9f27-ef6bd34ceebc tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:48.358783 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c6dd380e-7092-4a91-9f27-ef6bd34ceebc tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:48.359104 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c6dd380e-7092-4a91-9f27-ef6bd34ceebc tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:48.535605 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-8b1922e5-6428-4b93-9833-0ee5aa1bf0b3 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:44:48.557288 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-8b1922e5-6428-4b93-9833-0ee5aa1bf0b3 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:44:48.559191 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-8b1922e5-6428-4b93-9833-0ee5aa1bf0b3 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:44:48.570429 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-8b1922e5-6428-4b93-9833-0ee5aa1bf0b3 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] 10.222.0.33 "GET /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133" status: 200 len: 1533 microversion: 2.91 time: 0.411700 Oct 04 20:44:48.571027 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1206/2481] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:44:48 2022] GET /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133 => generated 1533 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:44:48.737858 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f9514b0e-4f9d-4ca3-a34a-495fdae0ca98 tempest-UnshelveToHostMultiNodesTest-1871197656 tempest-UnshelveToHostMultiNodesTest-1871197656-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:44:48.739366 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f9514b0e-4f9d-4ca3-a34a-495fdae0ca98 tempest-UnshelveToHostMultiNodesTest-1871197656 tempest-UnshelveToHostMultiNodesTest-1871197656-project-admin] [instance: 39d66e18-289f-4674-b66c-146d68ef9133] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:44:48.747915 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f9514b0e-4f9d-4ca3-a34a-495fdae0ca98 tempest-UnshelveToHostMultiNodesTest-1871197656 tempest-UnshelveToHostMultiNodesTest-1871197656-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:48.752493 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f9514b0e-4f9d-4ca3-a34a-495fdae0ca98 tempest-UnshelveToHostMultiNodesTest-1871197656 tempest-UnshelveToHostMultiNodesTest-1871197656-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:48.753134 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f9514b0e-4f9d-4ca3-a34a-495fdae0ca98 tempest-UnshelveToHostMultiNodesTest-1871197656 tempest-UnshelveToHostMultiNodesTest-1871197656-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:48.758678 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f9514b0e-4f9d-4ca3-a34a-495fdae0ca98 tempest-UnshelveToHostMultiNodesTest-1871197656 tempest-UnshelveToHostMultiNodesTest-1871197656-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:48.759466 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f9514b0e-4f9d-4ca3-a34a-495fdae0ca98 tempest-UnshelveToHostMultiNodesTest-1871197656 tempest-UnshelveToHostMultiNodesTest-1871197656-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:48.760147 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f9514b0e-4f9d-4ca3-a34a-495fdae0ca98 tempest-UnshelveToHostMultiNodesTest-1871197656 tempest-UnshelveToHostMultiNodesTest-1871197656-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:48.773181 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=100 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:44:48.809573 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-c6dd380e-7092-4a91-9f27-ef6bd34ceebc tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87dcc7baf63f4ae6bfe0a099adffd408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7097bc12179446f6a3e1fac8434d5c64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:44:48.824436 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-c6dd380e-7092-4a91-9f27-ef6bd34ceebc tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] 10.222.0.33 "GET /compute/v2.1/servers/797893a5-beaa-4f69-be4c-66592fb3fb33" status: 200 len: 1321 microversion: 2.1 time: 0.490571 Oct 04 20:44:48.826613 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1276/2482] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:44:48 2022] GET /compute/v2.1/servers/797893a5-beaa-4f69-be4c-66592fb3fb33 => generated 1321 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:44:48.837724 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-84423bf5-2b8d-4691-8fbf-542e805f38a6 req-71587a13-8d98-4ecd-9af3-44c25a38a281 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07fdb076-59a4-4c77-a42b-07fa92bcf408", "tag": "6c6f9c50-74c0-4f1b-ac6e-dd96429aa674"}, {"name": "network-changed", "server_uuid": "4d46fff2-b04d-41aa-ada0-2023ab545b48", "tag": "39e1fcde-c40c-4b4b-8edd-7565faaf4580"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:44:48.880603 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-84423bf5-2b8d-4691-8fbf-542e805f38a6 req-71587a13-8d98-4ecd-9af3-44c25a38a281 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:48.881278 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-84423bf5-2b8d-4691-8fbf-542e805f38a6 req-71587a13-8d98-4ecd-9af3-44c25a38a281 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:48.882714 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-84423bf5-2b8d-4691-8fbf-542e805f38a6 req-71587a13-8d98-4ecd-9af3-44c25a38a281 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:48.907931 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-84423bf5-2b8d-4691-8fbf-542e805f38a6 req-71587a13-8d98-4ecd-9af3-44c25a38a281 service nova] Creating event network-changed:6c6f9c50-74c0-4f1b-ac6e-dd96429aa674 for instance 07fdb076-59a4-4c77-a42b-07fa92bcf408 on n-h1-854823-8 Oct 04 20:44:48.908800 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-84423bf5-2b8d-4691-8fbf-542e805f38a6 req-71587a13-8d98-4ecd-9af3-44c25a38a281 service nova] Creating event network-changed:39e1fcde-c40c-4b4b-8edd-7565faaf4580 for instance 4d46fff2-b04d-41aa-ada0-2023ab545b48 on n-h1-854823-8 Oct 04 20:44:48.916703 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-84423bf5-2b8d-4691-8fbf-542e805f38a6 req-71587a13-8d98-4ecd-9af3-44c25a38a281 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.086926 Oct 04 20:44:48.917564 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1277/2483] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:44:48 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:44:48.972055 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-f9514b0e-4f9d-4ca3-a34a-495fdae0ca98 tempest-UnshelveToHostMultiNodesTest-1871197656 tempest-UnshelveToHostMultiNodesTest-1871197656-project-admin] Lazy-loading 'services' on Instance uuid 39d66e18-289f-4674-b66c-146d68ef9133 {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:44:49.014003 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f9514b0e-4f9d-4ca3-a34a-495fdae0ca98 tempest-UnshelveToHostMultiNodesTest-1871197656 tempest-UnshelveToHostMultiNodesTest-1871197656-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133" status: 200 len: 1938 microversion: 2.91 time: 0.410096 Oct 04 20:44:49.036576 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1207/2484] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:44:48 2022] GET /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133 => generated 1938 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:44:49.051545 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-4a57acbe-1337-4344-b6fd-acb156c1da92 tempest-UnshelveToHostMultiNodesTest-1871197656 tempest-UnshelveToHostMultiNodesTest-1871197656-project-admin] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:44:49.052564 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-4a57acbe-1337-4344-b6fd-acb156c1da92 tempest-UnshelveToHostMultiNodesTest-1871197656 tempest-UnshelveToHostMultiNodesTest-1871197656-project-admin] [instance: 39d66e18-289f-4674-b66c-146d68ef9133] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:44:49.059679 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4a57acbe-1337-4344-b6fd-acb156c1da92 tempest-UnshelveToHostMultiNodesTest-1871197656 tempest-UnshelveToHostMultiNodesTest-1871197656-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:49.060897 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4a57acbe-1337-4344-b6fd-acb156c1da92 tempest-UnshelveToHostMultiNodesTest-1871197656 tempest-UnshelveToHostMultiNodesTest-1871197656-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:49.061500 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4a57acbe-1337-4344-b6fd-acb156c1da92 tempest-UnshelveToHostMultiNodesTest-1871197656 tempest-UnshelveToHostMultiNodesTest-1871197656-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:49.062403 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4a57acbe-1337-4344-b6fd-acb156c1da92 tempest-UnshelveToHostMultiNodesTest-1871197656 tempest-UnshelveToHostMultiNodesTest-1871197656-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:49.063065 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4a57acbe-1337-4344-b6fd-acb156c1da92 tempest-UnshelveToHostMultiNodesTest-1871197656 tempest-UnshelveToHostMultiNodesTest-1871197656-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:49.063670 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4a57acbe-1337-4344-b6fd-acb156c1da92 tempest-UnshelveToHostMultiNodesTest-1871197656 tempest-UnshelveToHostMultiNodesTest-1871197656-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:49.249061 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.objects.instance [None req-4a57acbe-1337-4344-b6fd-acb156c1da92 tempest-UnshelveToHostMultiNodesTest-1871197656 tempest-UnshelveToHostMultiNodesTest-1871197656-project-admin] Lazy-loading 'services' on Instance uuid 39d66e18-289f-4674-b66c-146d68ef9133 {{(pid=128802) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:44:49.269427 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-4a57acbe-1337-4344-b6fd-acb156c1da92 tempest-UnshelveToHostMultiNodesTest-1871197656 tempest-UnshelveToHostMultiNodesTest-1871197656-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133" status: 200 len: 1938 microversion: 2.91 time: 0.223423 Oct 04 20:44:49.270828 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1278/2485] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:44:49 2022] GET /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133 => generated 1938 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:44:49.301042 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e2c65883-7a8b-4ef1-9768-abdb9cb83878 tempest-UnshelveToHostMultiNodesTest-1871197656 tempest-UnshelveToHostMultiNodesTest-1871197656-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:44:49.307453 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e2c65883-7a8b-4ef1-9768-abdb9cb83878 tempest-UnshelveToHostMultiNodesTest-1871197656 tempest-UnshelveToHostMultiNodesTest-1871197656-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:49.308694 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e2c65883-7a8b-4ef1-9768-abdb9cb83878 tempest-UnshelveToHostMultiNodesTest-1871197656 tempest-UnshelveToHostMultiNodesTest-1871197656-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:49.309357 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e2c65883-7a8b-4ef1-9768-abdb9cb83878 tempest-UnshelveToHostMultiNodesTest-1871197656 tempest-UnshelveToHostMultiNodesTest-1871197656-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:49.310983 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e2c65883-7a8b-4ef1-9768-abdb9cb83878 tempest-UnshelveToHostMultiNodesTest-1871197656 tempest-UnshelveToHostMultiNodesTest-1871197656-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:49.311625 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e2c65883-7a8b-4ef1-9768-abdb9cb83878 tempest-UnshelveToHostMultiNodesTest-1871197656 tempest-UnshelveToHostMultiNodesTest-1871197656-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:49.312222 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e2c65883-7a8b-4ef1-9768-abdb9cb83878 tempest-UnshelveToHostMultiNodesTest-1871197656 tempest-UnshelveToHostMultiNodesTest-1871197656-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:49.356782 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e2c65883-7a8b-4ef1-9768-abdb9cb83878 tempest-UnshelveToHostMultiNodesTest-1871197656 tempest-UnshelveToHostMultiNodesTest-1871197656-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 498 microversion: 2.91 time: 0.060820 Oct 04 20:44:49.373228 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-06ede4b9-4c92-46fe-955d-3eafbb40a495 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:44:49.374372 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-06ede4b9-4c92-46fe-955d-3eafbb40a495 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] [instance: 39d66e18-289f-4674-b66c-146d68ef9133] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:44:49.379115 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1208/2486] 10.222.0.33 () {60 vars in 1217 bytes} [Tue Oct 4 20:44:49 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 498 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 20:44:49.383490 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-06ede4b9-4c92-46fe-955d-3eafbb40a495 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:49.385629 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-06ede4b9-4c92-46fe-955d-3eafbb40a495 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:49.386307 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-06ede4b9-4c92-46fe-955d-3eafbb40a495 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:49.387284 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-06ede4b9-4c92-46fe-955d-3eafbb40a495 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:49.387961 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-06ede4b9-4c92-46fe-955d-3eafbb40a495 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:49.388607 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-06ede4b9-4c92-46fe-955d-3eafbb40a495 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:49.419189 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.objects.instance [None req-06ede4b9-4c92-46fe-955d-3eafbb40a495 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lazy-loading 'flavor' on Instance uuid 39d66e18-289f-4674-b66c-146d68ef9133 {{(pid=128802) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:44:49.732519 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-06ede4b9-4c92-46fe-955d-3eafbb40a495 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] 10.222.0.33 "POST /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133/action" status: 202 len: 0 microversion: 2.91 time: 0.365503 Oct 04 20:44:49.734730 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1279/2487] 10.222.0.33 () {62 vars in 1319 bytes} [Tue Oct 4 20:44:49 2022] POST /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133/action => generated 0 bytes in 369 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:44:49.743706 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-867f3c57-05d8-4a52-b808-083f5b492eac tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:44:49.744641 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-867f3c57-05d8-4a52-b808-083f5b492eac tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] [instance: 39d66e18-289f-4674-b66c-146d68ef9133] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:44:49.756541 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-867f3c57-05d8-4a52-b808-083f5b492eac tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:49.757199 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-867f3c57-05d8-4a52-b808-083f5b492eac tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:49.759514 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-867f3c57-05d8-4a52-b808-083f5b492eac tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:49.760605 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-867f3c57-05d8-4a52-b808-083f5b492eac tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:49.761158 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-867f3c57-05d8-4a52-b808-083f5b492eac tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:49.762871 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-867f3c57-05d8-4a52-b808-083f5b492eac tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:49.856243 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-e557f349-e0be-4fe4-a4dc-a68675e17d9f tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:44:49.856960 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-e557f349-e0be-4fe4-a4dc-a68675e17d9f tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] [instance: 797893a5-beaa-4f69-be4c-66592fb3fb33] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:44:49.870705 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e557f349-e0be-4fe4-a4dc-a68675e17d9f tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:49.871200 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e557f349-e0be-4fe4-a4dc-a68675e17d9f tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:49.871640 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e557f349-e0be-4fe4-a4dc-a68675e17d9f tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:49.878920 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e557f349-e0be-4fe4-a4dc-a68675e17d9f tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:49.879628 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e557f349-e0be-4fe4-a4dc-a68675e17d9f tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:49.880084 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e557f349-e0be-4fe4-a4dc-a68675e17d9f tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:49.947256 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-867f3c57-05d8-4a52-b808-083f5b492eac tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:44:49.970680 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-867f3c57-05d8-4a52-b808-083f5b492eac tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:44:49.973623 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-867f3c57-05d8-4a52-b808-083f5b492eac tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:44:49.985073 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-867f3c57-05d8-4a52-b808-083f5b492eac tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] 10.222.0.33 "GET /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133" status: 200 len: 1539 microversion: 2.91 time: 0.245575 Oct 04 20:44:49.986183 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1209/2488] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:44:49 2022] GET /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133 => generated 1539 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:44:50.555904 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7586d545-503b-4545-b3f1-6720ea2e7490 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:44:50.557091 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-7586d545-503b-4545-b3f1-6720ea2e7490 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] [instance: c147993c-5773-4b76-93bc-62c0cbb6044a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:44:50.566284 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=43 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:44:50.570032 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7586d545-503b-4545-b3f1-6720ea2e7490 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:50.570711 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7586d545-503b-4545-b3f1-6720ea2e7490 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:50.571846 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7586d545-503b-4545-b3f1-6720ea2e7490 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:50.572739 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7586d545-503b-4545-b3f1-6720ea2e7490 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:50.573350 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7586d545-503b-4545-b3f1-6720ea2e7490 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:50.574169 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7586d545-503b-4545-b3f1-6720ea2e7490 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:50.604998 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-7586d545-503b-4545-b3f1-6720ea2e7490 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] HTTP exception thrown: Instance c147993c-5773-4b76-93bc-62c0cbb6044a could not be found. Oct 04 20:44:50.607597 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7586d545-503b-4545-b3f1-6720ea2e7490 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Request method failure captured: Oct 04 20:44:50.607597 n-d-854823-8 devstack@n-api.service[128801]: request: DELETE /compute/v2.1/servers/c147993c-5773-4b76-93bc-62c0cbb6044a HTTP/1.1 Oct 04 20:44:50.607597 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:44:50.607597 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:44:50.607597 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:44:50.607597 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 0 Oct 04 20:44:50.607597 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:44:50.607597 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:44:50.607597 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:44:50.607597 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:44:50.607597 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJq9Qd71BosERLHbwV3kJJWPjGgXRnAwIsYo-uTAcHoKIBlN0RgqoukzyD4CEpzEOP916ZiJwcS_DodM5R8KTlQ7aQf1i8Ls6prjaCrz8FEtf6YqeRUj-v5zUGmRZXvKIkY9aYzCIXc6KOjqiXdqOBIUhPEGUrYHrpacXgcHwXicA98 Oct 04 20:44:50.607597 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:44:50.607597 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:44:50.607597 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:44:50.607597 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:44:50.607597 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:44:50.607597 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:44:50.607597 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: a6a44744f2bb4130b9a49065b49cf854 Oct 04 20:44:50.607597 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-ServersTestMultiNic-1546118216 Oct 04 20:44:50.607597 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 20:44:50.607597 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 20:44:50.607597 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a6a44744f2bb4130b9a49065b49cf854", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a6a44744f2bb4130b9a49065b49cf854"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a6a44744f2bb4130b9a49065b49cf854"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a6a44744f2bb4130b9a49065b49cf854"}]}] Oct 04 20:44:50.607597 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-ServersTestMultiNic-1546118216 Oct 04 20:44:50.607597 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: a6a44744f2bb4130b9a49065b49cf854 Oct 04 20:44:50.607597 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ServersTestMultiNic-1546118216 Oct 04 20:44:50.607597 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-ServersTestMultiNic-1546118216-project Oct 04 20:44:50.607597 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:44:50.607597 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:44:50.607597 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: e3e1e240b20e41e8b90e0d630e0d6b46 Oct 04 20:44:50.607597 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-ServersTestMultiNic-1546118216-project Oct 04 20:44:50.607597 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 20:44:50.607597 n-d-854823-8 devstack@n-api.service[128801]: exception: Instance c147993c-5773-4b76-93bc-62c0cbb6044a could not be found. Oct 04 20:44:50.607597 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': 'c147993c-5773-4b76-93bc-62c0cbb6044a'} Oct 04 20:44:50.607597 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:44:50.607597 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:44:50.607597 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:44:50.607597 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:44:50.607597 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:44:50.607597 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:44:50.607597 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:44:50.607597 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:44:50.607597 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:44:50.607597 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:44:50.607597 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c147993c-5773-4b76-93bc-62c0cbb6044a could not be found. Oct 04 20:44:50.607597 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:44:50.607597 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:44:50.607597 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:44:50.607597 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:44:50.607597 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:44:50.607597 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:44:50.607597 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:44:50.607597 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:44:50.607597 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:44:50.607597 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:44:50.607597 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 20:44:50.607597 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 20:44:50.607597 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 20:44:50.607597 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 20:44:50.607597 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:44:50.607597 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:44:50.607597 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:44:50.607597 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:44:50.613276 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c147993c-5773-4b76-93bc-62c0cbb6044a could not be found. Oct 04 20:44:50.613276 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:44:50.613276 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:44:50.613276 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:44:50.613276 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:44:50.613276 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:44:50.613276 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:44:50.613276 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:44:50.613276 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:44:50.613276 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c147993c-5773-4b76-93bc-62c0cbb6044a could not be found. Oct 04 20:44:50.613276 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:44:50.615221 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7586d545-503b-4545-b3f1-6720ea2e7490 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Returning 404 to user: Instance c147993c-5773-4b76-93bc-62c0cbb6044a could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:44:50.621212 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-7586d545-503b-4545-b3f1-6720ea2e7490 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] 10.222.0.33 "DELETE /compute/v2.1/servers/c147993c-5773-4b76-93bc-62c0cbb6044a" status: 404 len: 111 microversion: 2.1 time: 0.069929 Oct 04 20:44:50.625653 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1210/2489] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 20:44:50 2022] DELETE /compute/v2.1/servers/c147993c-5773-4b76-93bc-62c0cbb6044a => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:44:50.631699 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-05813393-987b-4981-8c88-54fe4437bb96 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:44:50.632554 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-05813393-987b-4981-8c88-54fe4437bb96 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] [instance: c147993c-5773-4b76-93bc-62c0cbb6044a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:44:50.642417 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-05813393-987b-4981-8c88-54fe4437bb96 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:50.643076 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-05813393-987b-4981-8c88-54fe4437bb96 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:50.643619 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-05813393-987b-4981-8c88-54fe4437bb96 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:50.644551 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-05813393-987b-4981-8c88-54fe4437bb96 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:50.645195 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-05813393-987b-4981-8c88-54fe4437bb96 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:50.646067 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-05813393-987b-4981-8c88-54fe4437bb96 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:50.663629 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-05813393-987b-4981-8c88-54fe4437bb96 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] HTTP exception thrown: Instance c147993c-5773-4b76-93bc-62c0cbb6044a could not be found. Oct 04 20:44:50.665336 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-05813393-987b-4981-8c88-54fe4437bb96 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Request method failure captured: Oct 04 20:44:50.665336 n-d-854823-8 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/c147993c-5773-4b76-93bc-62c0cbb6044a HTTP/1.1 Oct 04 20:44:50.665336 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:44:50.665336 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:44:50.665336 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:44:50.665336 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 0 Oct 04 20:44:50.665336 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:44:50.665336 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:44:50.665336 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:44:50.665336 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:44:50.665336 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJq9Qd71BosERLHbwV3kJJWPjGgXRnAwIsYo-uTAcHoKIBlN0RgqoukzyD4CEpzEOP916ZiJwcS_DodM5R8KTlQ7aQf1i8Ls6prjaCrz8FEtf6YqeRUj-v5zUGmRZXvKIkY9aYzCIXc6KOjqiXdqOBIUhPEGUrYHrpacXgcHwXicA98 Oct 04 20:44:50.665336 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:44:50.665336 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:44:50.665336 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:44:50.665336 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:44:50.665336 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:44:50.665336 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:44:50.665336 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: a6a44744f2bb4130b9a49065b49cf854 Oct 04 20:44:50.665336 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-ServersTestMultiNic-1546118216 Oct 04 20:44:50.665336 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 20:44:50.665336 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 20:44:50.665336 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a6a44744f2bb4130b9a49065b49cf854", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a6a44744f2bb4130b9a49065b49cf854"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a6a44744f2bb4130b9a49065b49cf854"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a6a44744f2bb4130b9a49065b49cf854"}]}] Oct 04 20:44:50.665336 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-ServersTestMultiNic-1546118216 Oct 04 20:44:50.665336 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: a6a44744f2bb4130b9a49065b49cf854 Oct 04 20:44:50.665336 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ServersTestMultiNic-1546118216 Oct 04 20:44:50.665336 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-ServersTestMultiNic-1546118216-project Oct 04 20:44:50.665336 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:44:50.665336 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:44:50.665336 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: e3e1e240b20e41e8b90e0d630e0d6b46 Oct 04 20:44:50.665336 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-ServersTestMultiNic-1546118216-project Oct 04 20:44:50.665336 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 20:44:50.665336 n-d-854823-8 devstack@n-api.service[128801]: exception: Instance c147993c-5773-4b76-93bc-62c0cbb6044a could not be found. Oct 04 20:44:50.665336 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': 'c147993c-5773-4b76-93bc-62c0cbb6044a'} Oct 04 20:44:50.665336 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:44:50.665336 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:44:50.665336 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:44:50.665336 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:44:50.665336 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:44:50.665336 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:44:50.665336 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:44:50.665336 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:44:50.665336 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:44:50.665336 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:44:50.665336 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c147993c-5773-4b76-93bc-62c0cbb6044a could not be found. Oct 04 20:44:50.665336 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:44:50.665336 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:44:50.665336 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:44:50.665336 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:44:50.665336 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:44:50.665336 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:44:50.665336 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:44:50.665336 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:44:50.665336 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:44:50.665336 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:44:50.665336 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:44:50.665336 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:44:50.665336 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:44:50.665336 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:44:50.665336 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:44:50.665336 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:44:50.665336 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c147993c-5773-4b76-93bc-62c0cbb6044a could not be found. Oct 04 20:44:50.665336 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:44:50.665336 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:44:50.665336 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:44:50.669830 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:44:50.669830 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:44:50.669830 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:44:50.669830 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:44:50.669830 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:44:50.669830 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c147993c-5773-4b76-93bc-62c0cbb6044a could not be found. Oct 04 20:44:50.669830 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:44:50.671702 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-05813393-987b-4981-8c88-54fe4437bb96 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Returning 404 to user: Instance c147993c-5773-4b76-93bc-62c0cbb6044a could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:44:50.684798 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-05813393-987b-4981-8c88-54fe4437bb96 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] 10.222.0.33 "GET /compute/v2.1/servers/c147993c-5773-4b76-93bc-62c0cbb6044a" status: 404 len: 111 microversion: 2.1 time: 0.056744 Oct 04 20:44:50.691883 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1211/2490] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:44:50 2022] GET /compute/v2.1/servers/c147993c-5773-4b76-93bc-62c0cbb6044a => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:44:50.707095 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-84dc8159-ee39-4a1d-971f-ff76ed06a115 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:44:50.713118 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-84dc8159-ee39-4a1d-971f-ff76ed06a115 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] [instance: 2bae38c5-cec9-444b-8879-dcb7eb2822e6] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:44:50.720490 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-84dc8159-ee39-4a1d-971f-ff76ed06a115 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:50.721672 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-84dc8159-ee39-4a1d-971f-ff76ed06a115 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:50.722640 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-84dc8159-ee39-4a1d-971f-ff76ed06a115 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:50.723779 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-84dc8159-ee39-4a1d-971f-ff76ed06a115 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:50.724505 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-84dc8159-ee39-4a1d-971f-ff76ed06a115 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:50.725162 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-84dc8159-ee39-4a1d-971f-ff76ed06a115 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:50.744997 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-84dc8159-ee39-4a1d-971f-ff76ed06a115 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] HTTP exception thrown: Instance 2bae38c5-cec9-444b-8879-dcb7eb2822e6 could not be found. Oct 04 20:44:50.747024 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-84dc8159-ee39-4a1d-971f-ff76ed06a115 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Request method failure captured: Oct 04 20:44:50.747024 n-d-854823-8 devstack@n-api.service[128801]: request: DELETE /compute/v2.1/servers/2bae38c5-cec9-444b-8879-dcb7eb2822e6 HTTP/1.1 Oct 04 20:44:50.747024 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:44:50.747024 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:44:50.747024 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:44:50.747024 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 0 Oct 04 20:44:50.747024 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:44:50.747024 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:44:50.747024 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:44:50.747024 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:44:50.747024 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJq9Qd71BosERLHbwV3kJJWPjGgXRnAwIsYo-uTAcHoKIBlN0RgqoukzyD4CEpzEOP916ZiJwcS_DodM5R8KTlQ7aQf1i8Ls6prjaCrz8FEtf6YqeRUj-v5zUGmRZXvKIkY9aYzCIXc6KOjqiXdqOBIUhPEGUrYHrpacXgcHwXicA98 Oct 04 20:44:50.747024 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:44:50.747024 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:44:50.747024 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:44:50.747024 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:44:50.747024 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:44:50.747024 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:44:50.747024 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: a6a44744f2bb4130b9a49065b49cf854 Oct 04 20:44:50.747024 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-ServersTestMultiNic-1546118216 Oct 04 20:44:50.747024 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 20:44:50.747024 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 20:44:50.747024 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a6a44744f2bb4130b9a49065b49cf854", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a6a44744f2bb4130b9a49065b49cf854"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a6a44744f2bb4130b9a49065b49cf854"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a6a44744f2bb4130b9a49065b49cf854"}]}] Oct 04 20:44:50.747024 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-ServersTestMultiNic-1546118216 Oct 04 20:44:50.747024 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: a6a44744f2bb4130b9a49065b49cf854 Oct 04 20:44:50.747024 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ServersTestMultiNic-1546118216 Oct 04 20:44:50.747024 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-ServersTestMultiNic-1546118216-project Oct 04 20:44:50.747024 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:44:50.747024 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:44:50.747024 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: e3e1e240b20e41e8b90e0d630e0d6b46 Oct 04 20:44:50.747024 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-ServersTestMultiNic-1546118216-project Oct 04 20:44:50.747024 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 20:44:50.747024 n-d-854823-8 devstack@n-api.service[128801]: exception: Instance 2bae38c5-cec9-444b-8879-dcb7eb2822e6 could not be found. Oct 04 20:44:50.747024 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': '2bae38c5-cec9-444b-8879-dcb7eb2822e6'} Oct 04 20:44:50.747024 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:44:50.747024 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:44:50.747024 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:44:50.747024 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:44:50.747024 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:44:50.747024 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:44:50.747024 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:44:50.747024 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:44:50.747024 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:44:50.747024 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:44:50.747024 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2bae38c5-cec9-444b-8879-dcb7eb2822e6 could not be found. Oct 04 20:44:50.747024 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:44:50.747024 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:44:50.747024 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:44:50.747024 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:44:50.747024 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:44:50.747024 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:44:50.747024 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:44:50.747024 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:44:50.747024 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:44:50.747024 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:44:50.747024 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 20:44:50.747024 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 20:44:50.747024 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 20:44:50.747024 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 20:44:50.747024 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:44:50.747024 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:44:50.747024 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:44:50.747024 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:44:50.750594 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2bae38c5-cec9-444b-8879-dcb7eb2822e6 could not be found. Oct 04 20:44:50.750594 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:44:50.750594 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:44:50.750594 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:44:50.750594 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:44:50.750594 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:44:50.750594 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:44:50.750594 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:44:50.750594 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:44:50.750594 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2bae38c5-cec9-444b-8879-dcb7eb2822e6 could not be found. Oct 04 20:44:50.750594 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:44:50.752775 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-84dc8159-ee39-4a1d-971f-ff76ed06a115 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Returning 404 to user: Instance 2bae38c5-cec9-444b-8879-dcb7eb2822e6 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:44:50.754007 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-84dc8159-ee39-4a1d-971f-ff76ed06a115 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] 10.222.0.33 "DELETE /compute/v2.1/servers/2bae38c5-cec9-444b-8879-dcb7eb2822e6" status: 404 len: 111 microversion: 2.1 time: 0.060576 Oct 04 20:44:50.754880 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1212/2491] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 20:44:50 2022] DELETE /compute/v2.1/servers/2bae38c5-cec9-444b-8879-dcb7eb2822e6 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:44:50.764733 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8cebbc80-d5c7-40af-9542-10ea62d41793 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:44:50.766492 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-8cebbc80-d5c7-40af-9542-10ea62d41793 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] [instance: 2bae38c5-cec9-444b-8879-dcb7eb2822e6] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:44:50.773861 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8cebbc80-d5c7-40af-9542-10ea62d41793 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:50.775242 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8cebbc80-d5c7-40af-9542-10ea62d41793 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:50.776016 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8cebbc80-d5c7-40af-9542-10ea62d41793 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:50.776955 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8cebbc80-d5c7-40af-9542-10ea62d41793 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:50.777591 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8cebbc80-d5c7-40af-9542-10ea62d41793 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:50.778311 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8cebbc80-d5c7-40af-9542-10ea62d41793 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:50.797406 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-8cebbc80-d5c7-40af-9542-10ea62d41793 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] HTTP exception thrown: Instance 2bae38c5-cec9-444b-8879-dcb7eb2822e6 could not be found. Oct 04 20:44:50.799474 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8cebbc80-d5c7-40af-9542-10ea62d41793 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Request method failure captured: Oct 04 20:44:50.799474 n-d-854823-8 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/2bae38c5-cec9-444b-8879-dcb7eb2822e6 HTTP/1.1 Oct 04 20:44:50.799474 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:44:50.799474 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:44:50.799474 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:44:50.799474 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 0 Oct 04 20:44:50.799474 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:44:50.799474 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:44:50.799474 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:44:50.799474 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:44:50.799474 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJq9Qd71BosERLHbwV3kJJWPjGgXRnAwIsYo-uTAcHoKIBlN0RgqoukzyD4CEpzEOP916ZiJwcS_DodM5R8KTlQ7aQf1i8Ls6prjaCrz8FEtf6YqeRUj-v5zUGmRZXvKIkY9aYzCIXc6KOjqiXdqOBIUhPEGUrYHrpacXgcHwXicA98 Oct 04 20:44:50.799474 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:44:50.799474 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:44:50.799474 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:44:50.799474 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:44:50.799474 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:44:50.799474 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:44:50.799474 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: a6a44744f2bb4130b9a49065b49cf854 Oct 04 20:44:50.799474 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-ServersTestMultiNic-1546118216 Oct 04 20:44:50.799474 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 20:44:50.799474 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 20:44:50.799474 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a6a44744f2bb4130b9a49065b49cf854", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a6a44744f2bb4130b9a49065b49cf854"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a6a44744f2bb4130b9a49065b49cf854"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a6a44744f2bb4130b9a49065b49cf854"}]}] Oct 04 20:44:50.799474 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-ServersTestMultiNic-1546118216 Oct 04 20:44:50.799474 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: a6a44744f2bb4130b9a49065b49cf854 Oct 04 20:44:50.799474 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ServersTestMultiNic-1546118216 Oct 04 20:44:50.799474 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-ServersTestMultiNic-1546118216-project Oct 04 20:44:50.799474 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:44:50.799474 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:44:50.799474 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: e3e1e240b20e41e8b90e0d630e0d6b46 Oct 04 20:44:50.799474 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-ServersTestMultiNic-1546118216-project Oct 04 20:44:50.799474 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 20:44:50.799474 n-d-854823-8 devstack@n-api.service[128801]: exception: Instance 2bae38c5-cec9-444b-8879-dcb7eb2822e6 could not be found. Oct 04 20:44:50.799474 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': '2bae38c5-cec9-444b-8879-dcb7eb2822e6'} Oct 04 20:44:50.799474 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:44:50.799474 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:44:50.799474 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:44:50.799474 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:44:50.799474 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:44:50.799474 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:44:50.799474 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:44:50.799474 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:44:50.799474 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:44:50.799474 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:44:50.799474 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2bae38c5-cec9-444b-8879-dcb7eb2822e6 could not be found. Oct 04 20:44:50.799474 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:44:50.799474 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:44:50.799474 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:44:50.799474 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:44:50.799474 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:44:50.799474 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:44:50.799474 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:44:50.799474 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:44:50.799474 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:44:50.799474 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:44:50.799474 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:44:50.799474 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:44:50.799474 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:44:50.799474 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:44:50.799474 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:44:50.799474 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:44:50.799474 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2bae38c5-cec9-444b-8879-dcb7eb2822e6 could not be found. Oct 04 20:44:50.799474 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:44:50.799474 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:44:50.799474 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:44:50.804620 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:44:50.804620 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:44:50.804620 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:44:50.804620 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:44:50.804620 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:44:50.804620 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2bae38c5-cec9-444b-8879-dcb7eb2822e6 could not be found. Oct 04 20:44:50.804620 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:44:50.805849 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8cebbc80-d5c7-40af-9542-10ea62d41793 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] Returning 404 to user: Instance 2bae38c5-cec9-444b-8879-dcb7eb2822e6 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:44:50.808860 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-8cebbc80-d5c7-40af-9542-10ea62d41793 tempest-ServersTestMultiNic-1546118216 tempest-ServersTestMultiNic-1546118216-project] 10.222.0.33 "GET /compute/v2.1/servers/2bae38c5-cec9-444b-8879-dcb7eb2822e6" status: 404 len: 111 microversion: 2.1 time: 0.049690 Oct 04 20:44:50.820897 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1213/2492] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:44:50 2022] GET /compute/v2.1/servers/2bae38c5-cec9-444b-8879-dcb7eb2822e6 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 20:44:50.903343 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-e557f349-e0be-4fe4-a4dc-a68675e17d9f tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87dcc7baf63f4ae6bfe0a099adffd408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7097bc12179446f6a3e1fac8434d5c64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:44:50.912365 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:44:50.922313 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-e557f349-e0be-4fe4-a4dc-a68675e17d9f tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] 10.222.0.33 "GET /compute/v2.1/servers/797893a5-beaa-4f69-be4c-66592fb3fb33" status: 200 len: 1321 microversion: 2.1 time: 1.072251 Oct 04 20:44:50.924328 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1280/2493] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:44:49 2022] GET /compute/v2.1/servers/797893a5-beaa-4f69-be4c-66592fb3fb33 => generated 1321 bytes in 1076 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:44:51.019683 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a5b90bc1-89de-4330-9a0d-cf3966819ce4 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:44:51.020834 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a5b90bc1-89de-4330-9a0d-cf3966819ce4 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] [instance: 39d66e18-289f-4674-b66c-146d68ef9133] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:44:51.032571 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a5b90bc1-89de-4330-9a0d-cf3966819ce4 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:51.033607 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a5b90bc1-89de-4330-9a0d-cf3966819ce4 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:51.034279 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a5b90bc1-89de-4330-9a0d-cf3966819ce4 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:51.040040 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a5b90bc1-89de-4330-9a0d-cf3966819ce4 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:51.041824 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a5b90bc1-89de-4330-9a0d-cf3966819ce4 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:51.044604 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a5b90bc1-89de-4330-9a0d-cf3966819ce4 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:51.188652 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-a5b90bc1-89de-4330-9a0d-cf3966819ce4 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:44:51.201459 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-a5b90bc1-89de-4330-9a0d-cf3966819ce4 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:44:51.207285 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-a5b90bc1-89de-4330-9a0d-cf3966819ce4 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:44:51.221329 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a5b90bc1-89de-4330-9a0d-cf3966819ce4 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] 10.222.0.33 "GET /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133" status: 200 len: 1539 microversion: 2.91 time: 0.207065 Oct 04 20:44:51.224554 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1214/2494] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:44:51 2022] GET /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133 => generated 1539 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:44:51.961626 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-5beae0dc-5d06-4e77-9b60-ed7f881ad2c5 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:44:51.966300 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-5beae0dc-5d06-4e77-9b60-ed7f881ad2c5 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] [instance: 797893a5-beaa-4f69-be4c-66592fb3fb33] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:44:51.992739 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5beae0dc-5d06-4e77-9b60-ed7f881ad2c5 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:51.993654 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5beae0dc-5d06-4e77-9b60-ed7f881ad2c5 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:51.994613 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5beae0dc-5d06-4e77-9b60-ed7f881ad2c5 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:51.995728 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5beae0dc-5d06-4e77-9b60-ed7f881ad2c5 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:51.996487 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5beae0dc-5d06-4e77-9b60-ed7f881ad2c5 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:51.997073 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5beae0dc-5d06-4e77-9b60-ed7f881ad2c5 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:52.257545 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-35bff33d-0ee5-45e7-b0f7-9decbd71586b tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:44:52.259831 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-35bff33d-0ee5-45e7-b0f7-9decbd71586b tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] [instance: 39d66e18-289f-4674-b66c-146d68ef9133] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:44:52.276783 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-35bff33d-0ee5-45e7-b0f7-9decbd71586b tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:52.277551 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-35bff33d-0ee5-45e7-b0f7-9decbd71586b tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:52.278168 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-35bff33d-0ee5-45e7-b0f7-9decbd71586b tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:52.279086 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-35bff33d-0ee5-45e7-b0f7-9decbd71586b tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:52.279696 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-35bff33d-0ee5-45e7-b0f7-9decbd71586b tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:52.280292 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-35bff33d-0ee5-45e7-b0f7-9decbd71586b tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:52.441999 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-5beae0dc-5d06-4e77-9b60-ed7f881ad2c5 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87dcc7baf63f4ae6bfe0a099adffd408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7097bc12179446f6a3e1fac8434d5c64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:44:52.454290 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-35bff33d-0ee5-45e7-b0f7-9decbd71586b tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:44:52.457536 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-5beae0dc-5d06-4e77-9b60-ed7f881ad2c5 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] 10.222.0.33 "GET /compute/v2.1/servers/797893a5-beaa-4f69-be4c-66592fb3fb33" status: 200 len: 1321 microversion: 2.1 time: 0.511916 Oct 04 20:44:52.461963 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1281/2495] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:44:51 2022] GET /compute/v2.1/servers/797893a5-beaa-4f69-be4c-66592fb3fb33 => generated 1321 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:44:52.482634 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-35bff33d-0ee5-45e7-b0f7-9decbd71586b tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:44:52.487219 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-35bff33d-0ee5-45e7-b0f7-9decbd71586b tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:44:52.494893 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-35bff33d-0ee5-45e7-b0f7-9decbd71586b tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] 10.222.0.33 "GET /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133" status: 200 len: 1539 microversion: 2.91 time: 0.241189 Oct 04 20:44:52.496583 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1215/2496] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:44:52 2022] GET /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133 => generated 1539 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 20:44:53.156908 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-46a45e1d-b29d-4279-9766-f45b805f271f req-d9824d7c-c3b4-474c-8ae4-2341b86b3168 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "797893a5-beaa-4f69-be4c-66592fb3fb33", "name": "network-vif-plugged", "status": "completed", "tag": "1699d26e-69fc-42fc-8457-a5e83b7e153e"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:44:53.171532 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell0:SELECT=17 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:44:53.172856 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell0:SELECT=71 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:44:53.185140 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-46a45e1d-b29d-4279-9766-f45b805f271f req-d9824d7c-c3b4-474c-8ae4-2341b86b3168 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:53.185631 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-46a45e1d-b29d-4279-9766-f45b805f271f req-d9824d7c-c3b4-474c-8ae4-2341b86b3168 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:53.186063 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-46a45e1d-b29d-4279-9766-f45b805f271f req-d9824d7c-c3b4-474c-8ae4-2341b86b3168 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:53.208142 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-46a45e1d-b29d-4279-9766-f45b805f271f req-d9824d7c-c3b4-474c-8ae4-2341b86b3168 service nova] Creating event network-vif-plugged:1699d26e-69fc-42fc-8457-a5e83b7e153e for instance 797893a5-beaa-4f69-be4c-66592fb3fb33 on n-h2-854823-8 Oct 04 20:44:53.221908 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-46a45e1d-b29d-4279-9766-f45b805f271f req-d9824d7c-c3b4-474c-8ae4-2341b86b3168 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070278 Oct 04 20:44:53.223229 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1282/2497] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:44:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:44:53.494847 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-51bf6881-2c6d-4de2-990b-ae29f2780981 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:44:53.496108 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-51bf6881-2c6d-4de2-990b-ae29f2780981 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] [instance: 797893a5-beaa-4f69-be4c-66592fb3fb33] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:44:53.516057 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-51bf6881-2c6d-4de2-990b-ae29f2780981 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:53.516586 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-51bf6881-2c6d-4de2-990b-ae29f2780981 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:53.518225 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-51bf6881-2c6d-4de2-990b-ae29f2780981 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:53.521174 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-51bf6881-2c6d-4de2-990b-ae29f2780981 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:53.523383 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-51bf6881-2c6d-4de2-990b-ae29f2780981 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:53.525257 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-51bf6881-2c6d-4de2-990b-ae29f2780981 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:53.532382 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-060c7bd7-5acb-4cd4-b592-f410fa8e0744 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:44:53.533148 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-060c7bd7-5acb-4cd4-b592-f410fa8e0744 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] [instance: 39d66e18-289f-4674-b66c-146d68ef9133] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:44:53.551268 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-060c7bd7-5acb-4cd4-b592-f410fa8e0744 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:53.551763 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-060c7bd7-5acb-4cd4-b592-f410fa8e0744 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:53.552207 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-060c7bd7-5acb-4cd4-b592-f410fa8e0744 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:53.552911 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-060c7bd7-5acb-4cd4-b592-f410fa8e0744 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:53.553359 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-060c7bd7-5acb-4cd4-b592-f410fa8e0744 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:53.553782 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-060c7bd7-5acb-4cd4-b592-f410fa8e0744 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:53.719885 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-060c7bd7-5acb-4cd4-b592-f410fa8e0744 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:44:53.750986 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-060c7bd7-5acb-4cd4-b592-f410fa8e0744 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:44:53.753119 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-060c7bd7-5acb-4cd4-b592-f410fa8e0744 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:44:53.761611 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-060c7bd7-5acb-4cd4-b592-f410fa8e0744 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] 10.222.0.33 "GET /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133" status: 200 len: 1539 microversion: 2.91 time: 0.233983 Oct 04 20:44:53.763421 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1283/2498] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:44:53 2022] GET /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133 => generated 1539 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 20:44:53.851308 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-51bf6881-2c6d-4de2-990b-ae29f2780981 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87dcc7baf63f4ae6bfe0a099adffd408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7097bc12179446f6a3e1fac8434d5c64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:44:53.862127 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-51bf6881-2c6d-4de2-990b-ae29f2780981 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] 10.222.0.33 "GET /compute/v2.1/servers/797893a5-beaa-4f69-be4c-66592fb3fb33" status: 200 len: 1321 microversion: 2.1 time: 0.378239 Oct 04 20:44:53.865295 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1216/2499] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:44:53 2022] GET /compute/v2.1/servers/797893a5-beaa-4f69-be4c-66592fb3fb33 => generated 1321 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:44:54.037871 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-fa08561e-bce0-4840-ac70-c91053f71309 tempest-FloatingIPsNegativeTestJSON-2090400122 tempest-FloatingIPsNegativeTestJSON-2090400122-project] Calling method '.version_select at 0x7f3c7450b4c0>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:44:54.183650 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-fa08561e-bce0-4840-ac70-c91053f71309 tempest-FloatingIPsNegativeTestJSON-2090400122 tempest-FloatingIPsNegativeTestJSON-2090400122-project] 10.222.0.33 "GET /compute/v2.1/os-floating-ips" status: 200 len: 20 microversion: 2.1 time: 0.273637 Oct 04 20:44:54.185067 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1284/2500] 10.222.0.33 () {58 vars in 1149 bytes} [Tue Oct 4 20:44:53 2022] GET /compute/v2.1/os-floating-ips => generated 20 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 20:44:54.205155 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9cc1e71c-2adb-488f-be20-29e53c083891 tempest-FloatingIPsNegativeTestJSON-2090400122 tempest-FloatingIPsNegativeTestJSON-2090400122-project] Action: 'create', calling method: .version_select at 0x7f3c74a65d30>, body: {"pool": "non_exist_pool"} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:44:54.308568 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-9cc1e71c-2adb-488f-be20-29e53c083891 tempest-FloatingIPsNegativeTestJSON-2090400122 tempest-FloatingIPsNegativeTestJSON-2090400122-project] HTTP exception thrown: Floating IP pool not found. Oct 04 20:44:54.310127 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9cc1e71c-2adb-488f-be20-29e53c083891 tempest-FloatingIPsNegativeTestJSON-2090400122 tempest-FloatingIPsNegativeTestJSON-2090400122-project] Request method failure captured: Oct 04 20:44:54.310127 n-d-854823-8 devstack@n-api.service[128801]: request: POST /compute/v2.1/os-floating-ips HTTP/1.1 Oct 04 20:44:54.310127 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:44:54.310127 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:44:54.310127 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:44:54.310127 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 26 Oct 04 20:44:54.310127 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:44:54.310127 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:44:54.310127 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:44:54.310127 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:44:54.310127 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJtFZb4gHlQrBpsI8gtzW7wHenLZBWBW3LwWqgT7CnsWqyD5rzACWQxA2EbwgohU20OsgPcNQvAMlfRUWN-B6hsfcAFApgZmO2tQTcJAD1ofQq_L0_C8X6Qtl53hb7m93bFDTKTgDAKKn_u2y6cW6wiovT46hr-MUsceevgoqOB3G7U Oct 04 20:44:54.310127 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:44:54.310127 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:44:54.310127 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:44:54.310127 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:44:54.310127 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:44:54.310127 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:44:54.310127 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: f8747343884a4523a56384ca7bf55482 Oct 04 20:44:54.310127 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-2090400122 Oct 04 20:44:54.310127 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 20:44:54.310127 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 20:44:54.310127 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f8747343884a4523a56384ca7bf55482", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f8747343884a4523a56384ca7bf55482"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f8747343884a4523a56384ca7bf55482"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f8747343884a4523a56384ca7bf55482"}]}] Oct 04 20:44:54.310127 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-2090400122 Oct 04 20:44:54.310127 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: f8747343884a4523a56384ca7bf55482 Oct 04 20:44:54.310127 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-2090400122 Oct 04 20:44:54.310127 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-FloatingIPsNegativeTestJSON-2090400122-project Oct 04 20:44:54.310127 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:44:54.310127 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:44:54.310127 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: 3f4e9ab628894a1fa4171c9bf1353106 Oct 04 20:44:54.310127 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-2090400122-project Oct 04 20:44:54.310127 n-d-854823-8 devstack@n-api.service[128801]: Oct 04 20:44:54.310127 n-d-854823-8 devstack@n-api.service[128801]: {"pool": "non_exist_pool"} Oct 04 20:44:54.310127 n-d-854823-8 devstack@n-api.service[128801]: method: Oct 04 20:44:54.310127 n-d-854823-8 devstack@n-api.service[128801]: exception: Floating IP pool not found. Oct 04 20:44:54.310127 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'body': {'pool': 'non_exist_pool'}} Oct 04 20:44:54.310127 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:44:54.310127 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:44:54.310127 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 127, in create Oct 04 20:44:54.310127 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi address = self.network_api.allocate_floating_ip(context, pool) Oct 04 20:44:54.310127 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2972, in allocate_floating_ip Oct 04 20:44:54.310127 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi pool_id = self._get_floating_ip_pool_id_by_name_or_id(client, pool) Oct 04 20:44:54.310127 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2962, in _get_floating_ip_pool_id_by_name_or_id Oct 04 20:44:54.310127 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpPoolNotFound() Oct 04 20:44:54.310127 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpPoolNotFound: Floating IP pool not found. Oct 04 20:44:54.310127 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:44:54.310127 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:44:54.310127 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:44:54.310127 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:44:54.310127 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:44:54.310127 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:44:54.310127 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:44:54.310127 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:44:54.310127 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:44:54.310127 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:44:54.310127 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:44:54.310127 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:44:54.310127 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 142, in create Oct 04 20:44:54.310127 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:44:54.310127 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP pool not found. Oct 04 20:44:54.310127 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:44:54.310127 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:44:54.310127 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:44:54.310127 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:44:54.310127 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:44:54.310127 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:44:54.310127 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:44:54.310127 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:44:54.314997 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP pool not found. Oct 04 20:44:54.314997 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:44:54.316210 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9cc1e71c-2adb-488f-be20-29e53c083891 tempest-FloatingIPsNegativeTestJSON-2090400122 tempest-FloatingIPsNegativeTestJSON-2090400122-project] Returning 404 to user: Floating IP pool not found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:44:54.318121 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-9cc1e71c-2adb-488f-be20-29e53c083891 tempest-FloatingIPsNegativeTestJSON-2090400122 tempest-FloatingIPsNegativeTestJSON-2090400122-project] 10.222.0.33 "POST /compute/v2.1/os-floating-ips" status: 404 len: 73 microversion: 2.1 time: 0.123762 Oct 04 20:44:54.319312 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1217/2501] 10.222.0.33 () {60 vars in 1170 bytes} [Tue Oct 4 20:44:54 2022] POST /compute/v2.1/os-floating-ips => generated 73 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 20:44:54.330928 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-244d3cdd-afc7-4567-9d45-851ee13ef4bb tempest-FloatingIPsNegativeTestJSON-2090400122 tempest-FloatingIPsNegativeTestJSON-2090400122-project] Calling method '.version_select at 0x7f3c7450d3a0>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:44:54.405540 n-d-854823-8 devstack@n-api.service[128802]: DEBUG neutronclient.v2_0.client [None req-244d3cdd-afc7-4567-9d45-851ee13ef4bb tempest-FloatingIPsNegativeTestJSON-2090400122 tempest-FloatingIPsNegativeTestJSON-2090400122-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 122a8d3b-03c8-4098-b840-55ddf2911c32 could not be found", "detail": ""}} {{(pid=128802) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 20:44:54.406370 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.wsgi [None req-244d3cdd-afc7-4567-9d45-851ee13ef4bb tempest-FloatingIPsNegativeTestJSON-2090400122 tempest-FloatingIPsNegativeTestJSON-2090400122-project] HTTP exception thrown: Floating IP not found for ID 122a8d3b-03c8-4098-b840-55ddf2911c32 Oct 04 20:44:54.408546 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-244d3cdd-afc7-4567-9d45-851ee13ef4bb tempest-FloatingIPsNegativeTestJSON-2090400122 tempest-FloatingIPsNegativeTestJSON-2090400122-project] Request method failure captured: Oct 04 20:44:54.408546 n-d-854823-8 devstack@n-api.service[128802]: request: DELETE /compute/v2.1/os-floating-ips/122a8d3b-03c8-4098-b840-55ddf2911c32 HTTP/1.1 Oct 04 20:44:54.408546 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 20:44:54.408546 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 20:44:54.408546 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 20:44:54.408546 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 0 Oct 04 20:44:54.408546 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 20:44:54.408546 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 20:44:54.408546 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 20:44:54.408546 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 20:44:54.408546 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPJtFZb4gHlQrBpsI8gtzW7wHenLZBWBW3LwWqgT7CnsWqyD5rzACWQxA2EbwgohU20OsgPcNQvAMlfRUWN-B6hsfcAFApgZmO2tQTcJAD1ofQq_L0_C8X6Qtl53hb7m93bFDTKTgDAKKn_u2y6cW6wiovT46hr-MUsceevgoqOB3G7U Oct 04 20:44:54.408546 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 20:44:54.408546 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 20:44:54.408546 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 20:44:54.408546 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 20:44:54.408546 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 20:44:54.408546 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 20:44:54.408546 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: f8747343884a4523a56384ca7bf55482 Oct 04 20:44:54.408546 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-2090400122 Oct 04 20:44:54.408546 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 20:44:54.408546 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 20:44:54.408546 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f8747343884a4523a56384ca7bf55482", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f8747343884a4523a56384ca7bf55482"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f8747343884a4523a56384ca7bf55482"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f8747343884a4523a56384ca7bf55482"}]}] Oct 04 20:44:54.408546 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-2090400122 Oct 04 20:44:54.408546 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: f8747343884a4523a56384ca7bf55482 Oct 04 20:44:54.408546 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-2090400122 Oct 04 20:44:54.408546 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-FloatingIPsNegativeTestJSON-2090400122-project Oct 04 20:44:54.408546 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 20:44:54.408546 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 20:44:54.408546 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: 3f4e9ab628894a1fa4171c9bf1353106 Oct 04 20:44:54.408546 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-2090400122-project Oct 04 20:44:54.408546 n-d-854823-8 devstack@n-api.service[128802]: method: Oct 04 20:44:54.408546 n-d-854823-8 devstack@n-api.service[128802]: exception: Floating IP not found for ID 122a8d3b-03c8-4098-b840-55ddf2911c32 Oct 04 20:44:54.408546 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'id': '122a8d3b-03c8-4098-b840-55ddf2911c32'} Oct 04 20:44:54.408546 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:44:54.408546 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:44:54.408546 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 04 20:44:54.408546 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 04 20:44:54.408546 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:44:54.408546 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:44:54.408546 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 04 20:44:54.408546 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 04 20:44:54.408546 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:44:54.408546 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:44:54.408546 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 20:44:54.408546 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 20:44:54.408546 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:44:54.408546 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:44:54.408546 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:44:54.408546 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:44:54.408546 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:44:54.408546 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:44:54.408546 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 20:44:54.408546 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 20:44:54.408546 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:44:54.408546 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:44:54.408546 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 20:44:54.408546 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 20:44:54.408546 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 20:44:54.408546 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 20:44:54.408546 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 122a8d3b-03c8-4098-b840-55ddf2911c32 could not be found Oct 04 20:44:54.408546 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2ddfeb00-4861-49d0-8384-3e8d630fe1b6'] Oct 04 20:44:54.413560 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:44:54.413560 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:44:54.413560 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:44:54.413560 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:44:54.413560 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Oct 04 20:44:54.413560 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 04 20:44:54.413560 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 04 20:44:54.413560 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 04 20:44:54.413560 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 122a8d3b-03c8-4098-b840-55ddf2911c32. Oct 04 20:44:54.413560 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:44:54.413560 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:44:54.413560 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:44:54.413560 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:44:54.413560 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:44:54.413560 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:44:54.413560 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:44:54.413560 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:44:54.413560 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:44:54.413560 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:44:54.413560 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:44:54.413560 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:44:54.413560 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Oct 04 20:44:54.413560 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 04 20:44:54.413560 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 122a8d3b-03c8-4098-b840-55ddf2911c32 Oct 04 20:44:54.413560 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:44:54.413560 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:44:54.413560 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:44:54.413560 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:44:54.413560 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:44:54.413560 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:44:54.413560 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:44:54.413560 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:44:54.413560 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 122a8d3b-03c8-4098-b840-55ddf2911c32 Oct 04 20:44:54.413560 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:44:54.413560 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-244d3cdd-afc7-4567-9d45-851ee13ef4bb tempest-FloatingIPsNegativeTestJSON-2090400122 tempest-FloatingIPsNegativeTestJSON-2090400122-project] Returning 404 to user: Floating IP not found for ID 122a8d3b-03c8-4098-b840-55ddf2911c32 {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:44:54.416942 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-244d3cdd-afc7-4567-9d45-851ee13ef4bb tempest-FloatingIPsNegativeTestJSON-2090400122 tempest-FloatingIPsNegativeTestJSON-2090400122-project] 10.222.0.33 "DELETE /compute/v2.1/os-floating-ips/122a8d3b-03c8-4098-b840-55ddf2911c32" status: 404 len: 111 microversion: 2.1 time: 0.091197 Oct 04 20:44:54.417649 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1285/2502] 10.222.0.33 () {58 vars in 1263 bytes} [Tue Oct 4 20:44:54 2022] DELETE /compute/v2.1/os-floating-ips/122a8d3b-03c8-4098-b840-55ddf2911c32 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:44:54.807665 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a5e1c153-a1ad-47f7-8ec8-c66275bb96ab tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:44:54.809596 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a5e1c153-a1ad-47f7-8ec8-c66275bb96ab tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] [instance: 39d66e18-289f-4674-b66c-146d68ef9133] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:44:54.827994 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a5e1c153-a1ad-47f7-8ec8-c66275bb96ab tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:54.836067 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a5e1c153-a1ad-47f7-8ec8-c66275bb96ab tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:54.837707 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a5e1c153-a1ad-47f7-8ec8-c66275bb96ab tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:54.844638 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a5e1c153-a1ad-47f7-8ec8-c66275bb96ab tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:54.847302 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a5e1c153-a1ad-47f7-8ec8-c66275bb96ab tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:54.847803 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a5e1c153-a1ad-47f7-8ec8-c66275bb96ab tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:54.890883 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-e9025f3d-59bf-4afe-a633-d70c7ca94e88 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:44:54.891992 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-e9025f3d-59bf-4afe-a633-d70c7ca94e88 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] [instance: 797893a5-beaa-4f69-be4c-66592fb3fb33] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:44:54.908799 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e9025f3d-59bf-4afe-a633-d70c7ca94e88 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:54.909704 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e9025f3d-59bf-4afe-a633-d70c7ca94e88 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:54.911053 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e9025f3d-59bf-4afe-a633-d70c7ca94e88 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:54.912026 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e9025f3d-59bf-4afe-a633-d70c7ca94e88 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:54.914836 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e9025f3d-59bf-4afe-a633-d70c7ca94e88 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:54.920543 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e9025f3d-59bf-4afe-a633-d70c7ca94e88 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:54.978997 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-a5e1c153-a1ad-47f7-8ec8-c66275bb96ab tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:44:54.992967 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-a5e1c153-a1ad-47f7-8ec8-c66275bb96ab tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:44:55.004449 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-a5e1c153-a1ad-47f7-8ec8-c66275bb96ab tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:44:55.023997 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a5e1c153-a1ad-47f7-8ec8-c66275bb96ab tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] 10.222.0.33 "GET /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133" status: 200 len: 1539 microversion: 2.91 time: 0.233407 Oct 04 20:44:55.039023 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1218/2503] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:44:54 2022] GET /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133 => generated 1539 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:44:55.252834 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-e9025f3d-59bf-4afe-a633-d70c7ca94e88 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87dcc7baf63f4ae6bfe0a099adffd408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7097bc12179446f6a3e1fac8434d5c64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:44:55.261211 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-e9025f3d-59bf-4afe-a633-d70c7ca94e88 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] 10.222.0.33 "GET /compute/v2.1/servers/797893a5-beaa-4f69-be4c-66592fb3fb33" status: 200 len: 1502 microversion: 2.1 time: 0.375059 Oct 04 20:44:55.262358 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1286/2504] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:44:54 2022] GET /compute/v2.1/servers/797893a5-beaa-4f69-be4c-66592fb3fb33 => generated 1502 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:44:55.285961 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8655fd2e-f431-4e7f-ac96-dc46ec9b3d3b tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:44:55.287643 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-8655fd2e-f431-4e7f-ac96-dc46ec9b3d3b tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] [instance: 797893a5-beaa-4f69-be4c-66592fb3fb33] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:44:55.295570 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8655fd2e-f431-4e7f-ac96-dc46ec9b3d3b tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:55.296324 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8655fd2e-f431-4e7f-ac96-dc46ec9b3d3b tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:55.297001 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8655fd2e-f431-4e7f-ac96-dc46ec9b3d3b tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:55.297923 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8655fd2e-f431-4e7f-ac96-dc46ec9b3d3b tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:55.298845 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8655fd2e-f431-4e7f-ac96-dc46ec9b3d3b tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:55.300109 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8655fd2e-f431-4e7f-ac96-dc46ec9b3d3b tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:55.566620 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-8655fd2e-f431-4e7f-ac96-dc46ec9b3d3b tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87dcc7baf63f4ae6bfe0a099adffd408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7097bc12179446f6a3e1fac8434d5c64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:44:55.582497 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-8655fd2e-f431-4e7f-ac96-dc46ec9b3d3b tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] 10.222.0.33 "GET /compute/v2.1/servers/797893a5-beaa-4f69-be4c-66592fb3fb33" status: 200 len: 1502 microversion: 2.1 time: 0.300256 Oct 04 20:44:55.584740 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1219/2505] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:44:55 2022] GET /compute/v2.1/servers/797893a5-beaa-4f69-be4c-66592fb3fb33 => generated 1502 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:44:55.614525 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-55b20486-e433-4f46-a3ca-dbf040071ac8 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:44:55.615161 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-55b20486-e433-4f46-a3ca-dbf040071ac8 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] [instance: 797893a5-beaa-4f69-be4c-66592fb3fb33] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:44:55.623933 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-55b20486-e433-4f46-a3ca-dbf040071ac8 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:55.624702 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-55b20486-e433-4f46-a3ca-dbf040071ac8 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:55.625349 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-55b20486-e433-4f46-a3ca-dbf040071ac8 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:55.626250 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-55b20486-e433-4f46-a3ca-dbf040071ac8 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:55.628191 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-55b20486-e433-4f46-a3ca-dbf040071ac8 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:55.628820 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-55b20486-e433-4f46-a3ca-dbf040071ac8 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:55.676976 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-55b20486-e433-4f46-a3ca-dbf040071ac8 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] [instance: 797893a5-beaa-4f69-be4c-66592fb3fb33] Going to try to terminate instance {{(pid=128802) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:44:55.794593 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-55b20486-e433-4f46-a3ca-dbf040071ac8 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] 10.222.0.33 "DELETE /compute/v2.1/servers/797893a5-beaa-4f69-be4c-66592fb3fb33" status: 204 len: 0 microversion: 2.1 time: 0.185941 Oct 04 20:44:55.798159 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1287/2506] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 20:44:55 2022] DELETE /compute/v2.1/servers/797893a5-beaa-4f69-be4c-66592fb3fb33 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:44:55.803629 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1d3531f5-c892-4472-8695-6d57edabad40 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:44:55.804246 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-1d3531f5-c892-4472-8695-6d57edabad40 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] [instance: 797893a5-beaa-4f69-be4c-66592fb3fb33] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:44:55.817762 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1d3531f5-c892-4472-8695-6d57edabad40 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:55.819471 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1d3531f5-c892-4472-8695-6d57edabad40 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:55.820219 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1d3531f5-c892-4472-8695-6d57edabad40 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:55.821397 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1d3531f5-c892-4472-8695-6d57edabad40 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:55.822156 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1d3531f5-c892-4472-8695-6d57edabad40 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:55.822957 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1d3531f5-c892-4472-8695-6d57edabad40 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:56.064997 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-c5da34a0-97c6-4ef2-96e1-5c6a59715476 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:44:56.066115 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-c5da34a0-97c6-4ef2-96e1-5c6a59715476 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] [instance: 39d66e18-289f-4674-b66c-146d68ef9133] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:44:56.075402 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c5da34a0-97c6-4ef2-96e1-5c6a59715476 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:56.075916 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c5da34a0-97c6-4ef2-96e1-5c6a59715476 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:56.076364 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c5da34a0-97c6-4ef2-96e1-5c6a59715476 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:56.077103 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c5da34a0-97c6-4ef2-96e1-5c6a59715476 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:56.077560 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c5da34a0-97c6-4ef2-96e1-5c6a59715476 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:56.077991 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c5da34a0-97c6-4ef2-96e1-5c6a59715476 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:56.230300 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-c5da34a0-97c6-4ef2-96e1-5c6a59715476 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:44:56.240421 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-1d3531f5-c892-4472-8695-6d57edabad40 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87dcc7baf63f4ae6bfe0a099adffd408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7097bc12179446f6a3e1fac8434d5c64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:44:56.255721 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-c5da34a0-97c6-4ef2-96e1-5c6a59715476 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:44:56.259366 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-1d3531f5-c892-4472-8695-6d57edabad40 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] 10.222.0.33 "GET /compute/v2.1/servers/797893a5-beaa-4f69-be4c-66592fb3fb33" status: 200 len: 1508 microversion: 2.1 time: 0.458863 Oct 04 20:44:56.260217 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1220/2507] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:44:55 2022] GET /compute/v2.1/servers/797893a5-beaa-4f69-be4c-66592fb3fb33 => generated 1508 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:44:56.275955 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-c5da34a0-97c6-4ef2-96e1-5c6a59715476 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:44:56.280881 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-c5da34a0-97c6-4ef2-96e1-5c6a59715476 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] 10.222.0.33 "GET /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133" status: 200 len: 1539 microversion: 2.91 time: 0.223139 Oct 04 20:44:56.282419 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1288/2508] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:44:56 2022] GET /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133 => generated 1539 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:44:57.293975 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-de940783-dfde-4bfe-9975-fcf8d049c44a tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:44:57.295936 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-de940783-dfde-4bfe-9975-fcf8d049c44a tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] [instance: 797893a5-beaa-4f69-be4c-66592fb3fb33] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:44:57.306644 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-de940783-dfde-4bfe-9975-fcf8d049c44a tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:57.307651 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-de940783-dfde-4bfe-9975-fcf8d049c44a tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:57.308314 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-de940783-dfde-4bfe-9975-fcf8d049c44a tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:57.309280 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-de940783-dfde-4bfe-9975-fcf8d049c44a tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:57.309958 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-de940783-dfde-4bfe-9975-fcf8d049c44a tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:57.310650 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-de940783-dfde-4bfe-9975-fcf8d049c44a tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:57.318561 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-c33d39a9-3394-4909-b5f3-aebc350600e9 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:44:57.319259 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-c33d39a9-3394-4909-b5f3-aebc350600e9 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] [instance: 39d66e18-289f-4674-b66c-146d68ef9133] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:44:57.334525 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c33d39a9-3394-4909-b5f3-aebc350600e9 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:57.335047 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c33d39a9-3394-4909-b5f3-aebc350600e9 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:57.335545 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c33d39a9-3394-4909-b5f3-aebc350600e9 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:57.336272 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c33d39a9-3394-4909-b5f3-aebc350600e9 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:57.336743 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c33d39a9-3394-4909-b5f3-aebc350600e9 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:57.337179 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c33d39a9-3394-4909-b5f3-aebc350600e9 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:57.593058 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-c33d39a9-3394-4909-b5f3-aebc350600e9 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:44:57.608721 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-c33d39a9-3394-4909-b5f3-aebc350600e9 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:44:57.610474 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-c33d39a9-3394-4909-b5f3-aebc350600e9 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:44:57.617457 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2,nova_api:INSERT=6 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:44:57.620346 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-c33d39a9-3394-4909-b5f3-aebc350600e9 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] 10.222.0.33 "GET /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133" status: 200 len: 1539 microversion: 2.91 time: 0.305666 Oct 04 20:44:57.621410 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1289/2509] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:44:57 2022] GET /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133 => generated 1539 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:44:57.773833 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-de940783-dfde-4bfe-9975-fcf8d049c44a tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87dcc7baf63f4ae6bfe0a099adffd408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7097bc12179446f6a3e1fac8434d5c64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:44:57.786528 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-de940783-dfde-4bfe-9975-fcf8d049c44a tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] 10.222.0.33 "GET /compute/v2.1/servers/797893a5-beaa-4f69-be4c-66592fb3fb33" status: 200 len: 1508 microversion: 2.1 time: 0.499669 Oct 04 20:44:57.787784 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1221/2510] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:44:57 2022] GET /compute/v2.1/servers/797893a5-beaa-4f69-be4c-66592fb3fb33 => generated 1508 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:44:58.652944 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-dc0f2fc1-50ce-41a3-aa7e-e3a03042f9d9 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:44:58.654679 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-dc0f2fc1-50ce-41a3-aa7e-e3a03042f9d9 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] [instance: 39d66e18-289f-4674-b66c-146d68ef9133] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:44:58.655243 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-2579e66d-5f3e-4a98-bdd2-5fa9ea5733ea req-fb9ba643-06a1-4527-9a92-a12a1ad27ba3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "797893a5-beaa-4f69-be4c-66592fb3fb33", "name": "network-vif-deleted", "tag": "1699d26e-69fc-42fc-8457-a5e83b7e153e"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:44:58.667391 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dc0f2fc1-50ce-41a3-aa7e-e3a03042f9d9 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:58.672771 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dc0f2fc1-50ce-41a3-aa7e-e3a03042f9d9 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:58.673723 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dc0f2fc1-50ce-41a3-aa7e-e3a03042f9d9 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:58.679584 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dc0f2fc1-50ce-41a3-aa7e-e3a03042f9d9 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:58.682748 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dc0f2fc1-50ce-41a3-aa7e-e3a03042f9d9 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:58.684895 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dc0f2fc1-50ce-41a3-aa7e-e3a03042f9d9 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:58.740754 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-2579e66d-5f3e-4a98-bdd2-5fa9ea5733ea req-fb9ba643-06a1-4527-9a92-a12a1ad27ba3 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:58.743847 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-2579e66d-5f3e-4a98-bdd2-5fa9ea5733ea req-fb9ba643-06a1-4527-9a92-a12a1ad27ba3 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:58.749187 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-2579e66d-5f3e-4a98-bdd2-5fa9ea5733ea req-fb9ba643-06a1-4527-9a92-a12a1ad27ba3 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:58.839206 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-2579e66d-5f3e-4a98-bdd2-5fa9ea5733ea req-fb9ba643-06a1-4527-9a92-a12a1ad27ba3 service nova] Creating event network-vif-deleted:1699d26e-69fc-42fc-8457-a5e83b7e153e for instance 797893a5-beaa-4f69-be4c-66592fb3fb33 on n-h2-854823-8 Oct 04 20:44:58.851879 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-2579e66d-5f3e-4a98-bdd2-5fa9ea5733ea req-fb9ba643-06a1-4527-9a92-a12a1ad27ba3 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.207449 Oct 04 20:44:58.854375 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1290/2511] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:44:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:44:58.873327 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-e2e773b5-6432-4cf2-9975-0c8e0ae83735 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:44:58.880260 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-e2e773b5-6432-4cf2-9975-0c8e0ae83735 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] [instance: 797893a5-beaa-4f69-be4c-66592fb3fb33] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:44:58.882456 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-dc0f2fc1-50ce-41a3-aa7e-e3a03042f9d9 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:44:58.900059 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-dc0f2fc1-50ce-41a3-aa7e-e3a03042f9d9 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:44:58.902250 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-dc0f2fc1-50ce-41a3-aa7e-e3a03042f9d9 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:44:58.917158 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-dc0f2fc1-50ce-41a3-aa7e-e3a03042f9d9 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] 10.222.0.33 "GET /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133" status: 200 len: 1539 microversion: 2.91 time: 0.269434 Oct 04 20:44:58.923640 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e2e773b5-6432-4cf2-9975-0c8e0ae83735 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:58.925838 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1222/2512] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:44:58 2022] GET /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133 => generated 1539 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 20:44:58.928015 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e2e773b5-6432-4cf2-9975-0c8e0ae83735 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:58.928502 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e2e773b5-6432-4cf2-9975-0c8e0ae83735 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:58.931790 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e2e773b5-6432-4cf2-9975-0c8e0ae83735 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:58.934663 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e2e773b5-6432-4cf2-9975-0c8e0ae83735 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:58.935124 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e2e773b5-6432-4cf2-9975-0c8e0ae83735 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:59.061394 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e2e773b5-6432-4cf2-9975-0c8e0ae83735 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:59.067369 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e2e773b5-6432-4cf2-9975-0c8e0ae83735 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:59.068055 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e2e773b5-6432-4cf2-9975-0c8e0ae83735 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:59.068672 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.objects.instance [None req-e2e773b5-6432-4cf2-9975-0c8e0ae83735 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lazy-loading 'fault' on Instance uuid 797893a5-beaa-4f69-be4c-66592fb3fb33 {{(pid=128802) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:44:59.214695 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-e2e773b5-6432-4cf2-9975-0c8e0ae83735 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87dcc7baf63f4ae6bfe0a099adffd408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7097bc12179446f6a3e1fac8434d5c64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:44:59.229194 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-e2e773b5-6432-4cf2-9975-0c8e0ae83735 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] 10.222.0.33 "GET /compute/v2.1/servers/797893a5-beaa-4f69-be4c-66592fb3fb33" status: 200 len: 1311 microversion: 2.1 time: 0.371857 Oct 04 20:44:59.232154 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1291/2513] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:44:58 2022] GET /compute/v2.1/servers/797893a5-beaa-4f69-be4c-66592fb3fb33 => generated 1311 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:44:59.950453 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e50eb895-904c-4f89-a1e2-a5591acea790 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:44:59.951109 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e50eb895-904c-4f89-a1e2-a5591acea790 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] [instance: 39d66e18-289f-4674-b66c-146d68ef9133] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:44:59.953145 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:44:59.959797 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e50eb895-904c-4f89-a1e2-a5591acea790 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:59.961042 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e50eb895-904c-4f89-a1e2-a5591acea790 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:59.961809 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e50eb895-904c-4f89-a1e2-a5591acea790 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:44:59.963351 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e50eb895-904c-4f89-a1e2-a5591acea790 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:44:59.964039 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e50eb895-904c-4f89-a1e2-a5591acea790 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:44:59.964661 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e50eb895-904c-4f89-a1e2-a5591acea790 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:00.054582 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e50eb895-904c-4f89-a1e2-a5591acea790 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:00.074042 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e50eb895-904c-4f89-a1e2-a5591acea790 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:00.076494 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e50eb895-904c-4f89-a1e2-a5591acea790 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:00.093287 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e50eb895-904c-4f89-a1e2-a5591acea790 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] 10.222.0.33 "GET /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133" status: 200 len: 1539 microversion: 2.91 time: 0.145145 Oct 04 20:45:00.093948 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1223/2514] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:44:59 2022] GET /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133 => generated 1539 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:45:00.262166 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-6d529545-e5e1-4711-bbf0-407f5850482a tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:00.263801 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-6d529545-e5e1-4711-bbf0-407f5850482a tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] [instance: 797893a5-beaa-4f69-be4c-66592fb3fb33] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:00.272277 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6d529545-e5e1-4711-bbf0-407f5850482a tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:00.272950 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6d529545-e5e1-4711-bbf0-407f5850482a tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:00.273440 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6d529545-e5e1-4711-bbf0-407f5850482a tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:00.275176 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6d529545-e5e1-4711-bbf0-407f5850482a tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:00.275791 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6d529545-e5e1-4711-bbf0-407f5850482a tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:00.276463 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6d529545-e5e1-4711-bbf0-407f5850482a tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:00.292219 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.wsgi [None req-6d529545-e5e1-4711-bbf0-407f5850482a tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] HTTP exception thrown: Instance 797893a5-beaa-4f69-be4c-66592fb3fb33 could not be found. Oct 04 20:45:00.293771 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-6d529545-e5e1-4711-bbf0-407f5850482a tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Request method failure captured: Oct 04 20:45:00.293771 n-d-854823-8 devstack@n-api.service[128802]: request: GET /compute/v2.1/servers/797893a5-beaa-4f69-be4c-66592fb3fb33 HTTP/1.1 Oct 04 20:45:00.293771 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 20:45:00.293771 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 20:45:00.293771 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 20:45:00.293771 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 0 Oct 04 20:45:00.293771 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 20:45:00.293771 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 20:45:00.293771 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 20:45:00.293771 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 20:45:00.293771 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPJsSwF2ySar2LJQGdSe43g0QAYtjP4_BPyLRwM7Cr4_8Oz_X-RTScy1BL0ogt-qe3YNvQGTaYbVbGoUGx7pHqiHpbZftU7_TcvDA_zpgTfxGGH91CR74RG6crXL2bxRs87dSvsLYuOWMw7_AQjTpWetc1HBlb5th2rD-ko2SN3gLGSA Oct 04 20:45:00.293771 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 20:45:00.293771 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 20:45:00.293771 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 20:45:00.293771 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 20:45:00.293771 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 20:45:00.293771 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 20:45:00.293771 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: 7097bc12179446f6a3e1fac8434d5c64 Oct 04 20:45:00.293771 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-ServersTestJSON-927611194 Oct 04 20:45:00.293771 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 20:45:00.293771 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 20:45:00.293771 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_7097bc12179446f6a3e1fac8434d5c64", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7097bc12179446f6a3e1fac8434d5c64"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7097bc12179446f6a3e1fac8434d5c64"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/7097bc12179446f6a3e1fac8434d5c64"}]}] Oct 04 20:45:00.293771 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-ServersTestJSON-927611194 Oct 04 20:45:00.293771 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: 7097bc12179446f6a3e1fac8434d5c64 Oct 04 20:45:00.293771 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-ServersTestJSON-927611194 Oct 04 20:45:00.293771 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-ServersTestJSON-927611194-project Oct 04 20:45:00.293771 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 20:45:00.293771 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 20:45:00.293771 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: 87dcc7baf63f4ae6bfe0a099adffd408 Oct 04 20:45:00.293771 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-ServersTestJSON-927611194-project Oct 04 20:45:00.293771 n-d-854823-8 devstack@n-api.service[128802]: method: > Oct 04 20:45:00.293771 n-d-854823-8 devstack@n-api.service[128802]: exception: Instance 797893a5-beaa-4f69-be4c-66592fb3fb33 could not be found. Oct 04 20:45:00.293771 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'id': '797893a5-beaa-4f69-be4c-66592fb3fb33'} Oct 04 20:45:00.293771 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:45:00.293771 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:45:00.293771 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:45:00.293771 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:45:00.293771 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:45:00.293771 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:45:00.293771 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:45:00.293771 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:45:00.293771 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:45:00.293771 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:45:00.293771 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 797893a5-beaa-4f69-be4c-66592fb3fb33 could not be found. Oct 04 20:45:00.293771 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:45:00.293771 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:45:00.293771 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:45:00.293771 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:45:00.293771 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:45:00.293771 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:45:00.293771 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:45:00.293771 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:45:00.293771 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:45:00.293771 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:45:00.293771 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:45:00.293771 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:45:00.293771 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:45:00.293771 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:45:00.293771 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:45:00.293771 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:45:00.293771 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 797893a5-beaa-4f69-be4c-66592fb3fb33 could not be found. Oct 04 20:45:00.293771 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:45:00.293771 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:45:00.293771 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:45:00.293771 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:45:00.298391 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:45:00.298391 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:45:00.298391 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:45:00.298391 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:45:00.298391 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 797893a5-beaa-4f69-be4c-66592fb3fb33 could not be found. Oct 04 20:45:00.298391 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:45:00.300783 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-6d529545-e5e1-4711-bbf0-407f5850482a tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Returning 404 to user: Instance 797893a5-beaa-4f69-be4c-66592fb3fb33 could not be found. {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:45:00.301865 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-6d529545-e5e1-4711-bbf0-407f5850482a tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] 10.222.0.33 "GET /compute/v2.1/servers/797893a5-beaa-4f69-be4c-66592fb3fb33" status: 404 len: 111 microversion: 2.1 time: 0.045842 Oct 04 20:45:00.304522 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1292/2515] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:45:00 2022] GET /compute/v2.1/servers/797893a5-beaa-4f69-be4c-66592fb3fb33 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:45:00.317695 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-08ecec34-695b-4d48-8fa3-680c28f763e3 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Action: 'create', calling method: .version_select at 0x7f3c74437c10>, body: {"keypair": {"name": "tempest-key-1018566517", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBlDFwFingE2Tq2IkjoYBWv+edm+GbR/h7R05dZGHjE1w0qeGDYZc245M/lihKBsHmUczr8SJTVgztgB92GD/XDghbBJ5v5YuxgFvCRHlXQUdFfx1cpqH67PcfNMn4rzpw=="}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:45:00.336890 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-08ecec34-695b-4d48-8fa3-680c28f763e3 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Getting quotas for project 7097bc12179446f6a3e1fac8434d5c64. Resources: {'key_pairs'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:45:00.344447 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-08ecec34-695b-4d48-8fa3-680c28f763e3 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Getting quotas for user 87dcc7baf63f4ae6bfe0a099adffd408 and project 7097bc12179446f6a3e1fac8434d5c64. Resources: {'key_pairs'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:45:00.377860 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-08ecec34-695b-4d48-8fa3-680c28f763e3 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 382 microversion: 2.1 time: 0.064184 Oct 04 20:45:00.385497 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1224/2516] 10.222.0.33 () {60 vars in 1159 bytes} [Tue Oct 4 20:45:00 2022] POST /compute/v2.1/os-keypairs => generated 382 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:45:00.396385 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-fdf512b0-6a0c-41ae-8a21-61e80b308e5b tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Calling method '.version_select at 0x7f3c7450dd30>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:00.404890 n-d-854823-8 devstack@n-api.service[128802]: WARNING oslo_db.sqlalchemy.utils [None req-fdf512b0-6a0c-41ae-8a21-61e80b308e5b tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 04 20:45:00.448147 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-fdf512b0-6a0c-41ae-8a21-61e80b308e5b tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] 10.222.0.33 "GET /compute/v2.1/os-keypairs" status: 200 len: 351 microversion: 2.1 time: 0.059522 Oct 04 20:45:00.448738 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1293/2517] 10.222.0.33 () {58 vars in 1137 bytes} [Tue Oct 4 20:45:00 2022] GET /compute/v2.1/os-keypairs => generated 351 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:45:00.591840 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-580ce91b-a037-4d41-97af-e5d331bc2251 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-555213463", "imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63", "flavorRef": "452", "key_name": "tempest-key-1018566517", "networks": [{"uuid": "a32beee4-b00b-48d9-8656-e7b824aeffce"}]}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:45:00.664301 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.network.neutron [None req-580ce91b-a037-4d41-97af-e5d331bc2251 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] validate_networks() for [('a32beee4-b00b-48d9-8656-e7b824aeffce', None, None, None, None, None)] {{(pid=128801) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:45:01.121504 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-6f2375d9-b452-48f4-90e7-a0eb50f7e628 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:01.122152 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-6f2375d9-b452-48f4-90e7-a0eb50f7e628 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] [instance: 39d66e18-289f-4674-b66c-146d68ef9133] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:01.132517 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6f2375d9-b452-48f4-90e7-a0eb50f7e628 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:01.133289 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6f2375d9-b452-48f4-90e7-a0eb50f7e628 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:01.134234 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6f2375d9-b452-48f4-90e7-a0eb50f7e628 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:01.134983 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6f2375d9-b452-48f4-90e7-a0eb50f7e628 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:01.135740 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6f2375d9-b452-48f4-90e7-a0eb50f7e628 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:01.136394 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6f2375d9-b452-48f4-90e7-a0eb50f7e628 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:01.253433 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-6f2375d9-b452-48f4-90e7-a0eb50f7e628 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:01.265095 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-6f2375d9-b452-48f4-90e7-a0eb50f7e628 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:01.271010 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-6f2375d9-b452-48f4-90e7-a0eb50f7e628 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:01.278562 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-6f2375d9-b452-48f4-90e7-a0eb50f7e628 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] 10.222.0.33 "GET /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133" status: 200 len: 1539 microversion: 2.91 time: 0.161268 Oct 04 20:45:01.288696 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1294/2518] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:45:01 2022] GET /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133 => generated 1539 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 20:45:01.535228 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-580ce91b-a037-4d41-97af-e5d331bc2251 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Flavor limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:45:01.536322 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-580ce91b-a037-4d41-97af-e5d331bc2251 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Image limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:45:01.536995 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-580ce91b-a037-4d41-97af-e5d331bc2251 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Flavor pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:45:01.537377 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-580ce91b-a037-4d41-97af-e5d331bc2251 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Image pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:45:01.537828 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-580ce91b-a037-4d41-97af-e5d331bc2251 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:45:01.550098 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-580ce91b-a037-4d41-97af-e5d331bc2251 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:01.550812 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-580ce91b-a037-4d41-97af-e5d331bc2251 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:01.551423 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-580ce91b-a037-4d41-97af-e5d331bc2251 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:01.552319 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-580ce91b-a037-4d41-97af-e5d331bc2251 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:01.552926 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-580ce91b-a037-4d41-97af-e5d331bc2251 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:01.553507 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-580ce91b-a037-4d41-97af-e5d331bc2251 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:01.575823 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-580ce91b-a037-4d41-97af-e5d331bc2251 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Getting quotas for project 7097bc12179446f6a3e1fac8434d5c64. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:45:01.581556 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-580ce91b-a037-4d41-97af-e5d331bc2251 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Getting quotas for user 87dcc7baf63f4ae6bfe0a099adffd408 and project 7097bc12179446f6a3e1fac8434d5c64. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:45:01.597023 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-580ce91b-a037-4d41-97af-e5d331bc2251 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Going to run 1 instances... {{(pid=128801) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:45:01.599652 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-580ce91b-a037-4d41-97af-e5d331bc2251 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] [instance: c43e082f-7e3b-49bd-b206-4f3f231750da] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='15b24725-0c99-4bcf-b1fb-907cdf8e2d63',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128801) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:45:01.659327 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-580ce91b-a037-4d41-97af-e5d331bc2251 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.071669 Oct 04 20:45:01.667380 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1225/2519] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 20:45:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 1076 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 20:45:01.674319 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-9651d13a-aa47-421a-9562-83fada87edb5 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:01.675794 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-9651d13a-aa47-421a-9562-83fada87edb5 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] [instance: c43e082f-7e3b-49bd-b206-4f3f231750da] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:01.816871 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-9651d13a-aa47-421a-9562-83fada87edb5 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87dcc7baf63f4ae6bfe0a099adffd408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7097bc12179446f6a3e1fac8434d5c64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:01.828343 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-9651d13a-aa47-421a-9562-83fada87edb5 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] 10.222.0.33 "GET /compute/v2.1/servers/c43e082f-7e3b-49bd-b206-4f3f231750da" status: 200 len: 1228 microversion: 2.1 time: 0.157673 Oct 04 20:45:01.846863 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1295/2520] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:45:01 2022] GET /compute/v2.1/servers/c43e082f-7e3b-49bd-b206-4f3f231750da => generated 1228 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:45:02.320379 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c703fae4-144b-481c-a621-ccf347dcbbdc tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:02.321772 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c703fae4-144b-481c-a621-ccf347dcbbdc tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] [instance: 39d66e18-289f-4674-b66c-146d68ef9133] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:02.334930 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c703fae4-144b-481c-a621-ccf347dcbbdc tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:02.336747 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c703fae4-144b-481c-a621-ccf347dcbbdc tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:02.338192 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c703fae4-144b-481c-a621-ccf347dcbbdc tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:02.339263 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c703fae4-144b-481c-a621-ccf347dcbbdc tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:02.340554 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c703fae4-144b-481c-a621-ccf347dcbbdc tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:02.341441 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c703fae4-144b-481c-a621-ccf347dcbbdc tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:02.512495 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c703fae4-144b-481c-a621-ccf347dcbbdc tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:02.528872 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c703fae4-144b-481c-a621-ccf347dcbbdc tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:02.534213 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c703fae4-144b-481c-a621-ccf347dcbbdc tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:02.546839 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c703fae4-144b-481c-a621-ccf347dcbbdc tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] 10.222.0.33 "GET /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133" status: 200 len: 1539 microversion: 2.91 time: 0.241778 Oct 04 20:45:02.548041 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1226/2521] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:45:02 2022] GET /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133 => generated 1539 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:45:02.861786 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-5ec918e7-ef4a-4d3d-b2e7-a40c96e92456 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:02.865622 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-5ec918e7-ef4a-4d3d-b2e7-a40c96e92456 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] [instance: c43e082f-7e3b-49bd-b206-4f3f231750da] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:02.878571 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5ec918e7-ef4a-4d3d-b2e7-a40c96e92456 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:02.879068 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5ec918e7-ef4a-4d3d-b2e7-a40c96e92456 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:02.879506 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5ec918e7-ef4a-4d3d-b2e7-a40c96e92456 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:02.880216 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5ec918e7-ef4a-4d3d-b2e7-a40c96e92456 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:02.880671 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5ec918e7-ef4a-4d3d-b2e7-a40c96e92456 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:02.881098 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5ec918e7-ef4a-4d3d-b2e7-a40c96e92456 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:02.976011 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-5ec918e7-ef4a-4d3d-b2e7-a40c96e92456 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87dcc7baf63f4ae6bfe0a099adffd408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7097bc12179446f6a3e1fac8434d5c64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:02.985783 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-5ec918e7-ef4a-4d3d-b2e7-a40c96e92456 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] 10.222.0.33 "GET /compute/v2.1/servers/c43e082f-7e3b-49bd-b206-4f3f231750da" status: 200 len: 1280 microversion: 2.1 time: 0.135890 Oct 04 20:45:02.998420 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1296/2522] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:45:02 2022] GET /compute/v2.1/servers/c43e082f-7e3b-49bd-b206-4f3f231750da => generated 1280 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:45:03.580066 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1499adc0-0a3a-4e75-ab13-5dc0c6514abc tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:03.581618 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-1499adc0-0a3a-4e75-ab13-5dc0c6514abc tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] [instance: 39d66e18-289f-4674-b66c-146d68ef9133] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:03.591920 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1499adc0-0a3a-4e75-ab13-5dc0c6514abc tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:03.592987 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1499adc0-0a3a-4e75-ab13-5dc0c6514abc tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:03.593670 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1499adc0-0a3a-4e75-ab13-5dc0c6514abc tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:03.594603 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1499adc0-0a3a-4e75-ab13-5dc0c6514abc tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:03.595208 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1499adc0-0a3a-4e75-ab13-5dc0c6514abc tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:03.595984 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1499adc0-0a3a-4e75-ab13-5dc0c6514abc tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:03.701186 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-1499adc0-0a3a-4e75-ab13-5dc0c6514abc tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:03.714498 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-1499adc0-0a3a-4e75-ab13-5dc0c6514abc tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:03.716736 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-1499adc0-0a3a-4e75-ab13-5dc0c6514abc tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:03.731245 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-1499adc0-0a3a-4e75-ab13-5dc0c6514abc tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] 10.222.0.33 "GET /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133" status: 200 len: 1539 microversion: 2.91 time: 0.157869 Oct 04 20:45:03.734961 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1227/2523] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:45:03 2022] GET /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133 => generated 1539 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:45:04.012109 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-aaf8d0ba-a08b-474e-9a42-77b2629d3e1b tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:04.012863 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-aaf8d0ba-a08b-474e-9a42-77b2629d3e1b tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] [instance: c43e082f-7e3b-49bd-b206-4f3f231750da] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:04.020789 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-aaf8d0ba-a08b-474e-9a42-77b2629d3e1b tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:04.021626 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-aaf8d0ba-a08b-474e-9a42-77b2629d3e1b tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:04.022270 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-aaf8d0ba-a08b-474e-9a42-77b2629d3e1b tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:04.023368 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-aaf8d0ba-a08b-474e-9a42-77b2629d3e1b tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:04.024861 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-aaf8d0ba-a08b-474e-9a42-77b2629d3e1b tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:04.025609 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-aaf8d0ba-a08b-474e-9a42-77b2629d3e1b tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:04.109748 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-aaf8d0ba-a08b-474e-9a42-77b2629d3e1b tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87dcc7baf63f4ae6bfe0a099adffd408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7097bc12179446f6a3e1fac8434d5c64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:04.119317 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-aaf8d0ba-a08b-474e-9a42-77b2629d3e1b tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] 10.222.0.33 "GET /compute/v2.1/servers/c43e082f-7e3b-49bd-b206-4f3f231750da" status: 200 len: 1286 microversion: 2.1 time: 0.111748 Oct 04 20:45:04.120632 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1297/2524] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:45:04 2022] GET /compute/v2.1/servers/c43e082f-7e3b-49bd-b206-4f3f231750da => generated 1286 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:45:04.763894 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-57ea58c6-6a8a-4c2d-8bf9-d93f6868ee4c tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:04.764514 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-57ea58c6-6a8a-4c2d-8bf9-d93f6868ee4c tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] [instance: 39d66e18-289f-4674-b66c-146d68ef9133] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:04.776496 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-57ea58c6-6a8a-4c2d-8bf9-d93f6868ee4c tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:04.787905 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-57ea58c6-6a8a-4c2d-8bf9-d93f6868ee4c tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:04.789815 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-57ea58c6-6a8a-4c2d-8bf9-d93f6868ee4c tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:04.794858 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-57ea58c6-6a8a-4c2d-8bf9-d93f6868ee4c tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:04.796295 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-57ea58c6-6a8a-4c2d-8bf9-d93f6868ee4c tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:04.797049 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-57ea58c6-6a8a-4c2d-8bf9-d93f6868ee4c tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:04.919901 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-57ea58c6-6a8a-4c2d-8bf9-d93f6868ee4c tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:04.929668 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-57ea58c6-6a8a-4c2d-8bf9-d93f6868ee4c tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:04.932164 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-57ea58c6-6a8a-4c2d-8bf9-d93f6868ee4c tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:04.943552 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-57ea58c6-6a8a-4c2d-8bf9-d93f6868ee4c tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] 10.222.0.33 "GET /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133" status: 200 len: 1539 microversion: 2.91 time: 0.185596 Oct 04 20:45:04.948262 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1228/2525] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:45:04 2022] GET /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133 => generated 1539 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:45:05.147899 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-ca366714-adaf-4f2d-b806-b780d4b276e5 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:05.148499 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-ca366714-adaf-4f2d-b806-b780d4b276e5 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] [instance: c43e082f-7e3b-49bd-b206-4f3f231750da] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:05.166059 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ca366714-adaf-4f2d-b806-b780d4b276e5 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:05.168577 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ca366714-adaf-4f2d-b806-b780d4b276e5 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:05.169381 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ca366714-adaf-4f2d-b806-b780d4b276e5 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:05.171531 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ca366714-adaf-4f2d-b806-b780d4b276e5 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:05.173615 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ca366714-adaf-4f2d-b806-b780d4b276e5 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:05.176468 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ca366714-adaf-4f2d-b806-b780d4b276e5 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:05.670956 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-ca366714-adaf-4f2d-b806-b780d4b276e5 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87dcc7baf63f4ae6bfe0a099adffd408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7097bc12179446f6a3e1fac8434d5c64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:05.679401 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-ca366714-adaf-4f2d-b806-b780d4b276e5 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] 10.222.0.33 "GET /compute/v2.1/servers/c43e082f-7e3b-49bd-b206-4f3f231750da" status: 200 len: 1328 microversion: 2.1 time: 0.535600 Oct 04 20:45:05.682771 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1298/2526] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:45:05 2022] GET /compute/v2.1/servers/c43e082f-7e3b-49bd-b206-4f3f231750da => generated 1328 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:45:05.878320 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-4042d73a-617f-439d-ba1f-3dab75f5ccc7 tempest-QuotaClassesAdmin257Test-335462659 tempest-QuotaClassesAdmin257Test-335462659-project-admin] Calling method '.version_select at 0x7f3c740cb9d0>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:05.894276 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-4042d73a-617f-439d-ba1f-3dab75f5ccc7 tempest-QuotaClassesAdmin257Test-335462659 tempest-QuotaClassesAdmin257Test-335462659-project-admin] 10.222.0.33 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 172 microversion: 2.57 time: 0.230795 Oct 04 20:45:05.898628 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1229/2527] 10.222.0.33 () {60 vars in 1226 bytes} [Tue Oct 4 20:45:05 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 172 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 20:45:05.910418 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-6181ca24-70bc-4fc3-b3e9-2923c889c081 tempest-QuotaClassesAdmin257Test-335462659 tempest-QuotaClassesAdmin257Test-335462659-project-admin] Action: 'update', calling method: .version_select at 0x7f3c789578b0>, body: {"quota_class_set": {"cores": 120, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "server_group_members": 110, "server_groups": 110}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:45:05.983591 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-34daca1e-29f8-4e86-83d8-1a8a61b1b2c2 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:05.984618 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-34daca1e-29f8-4e86-83d8-1a8a61b1b2c2 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] [instance: 39d66e18-289f-4674-b66c-146d68ef9133] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:05.995381 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:45:05.999761 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-34daca1e-29f8-4e86-83d8-1a8a61b1b2c2 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:06.001344 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-34daca1e-29f8-4e86-83d8-1a8a61b1b2c2 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:06.001908 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-34daca1e-29f8-4e86-83d8-1a8a61b1b2c2 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:06.002661 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-34daca1e-29f8-4e86-83d8-1a8a61b1b2c2 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:06.003623 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-34daca1e-29f8-4e86-83d8-1a8a61b1b2c2 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:06.004358 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-34daca1e-29f8-4e86-83d8-1a8a61b1b2c2 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:06.077379 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=100 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:45:06.118539 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-6181ca24-70bc-4fc3-b3e9-2923c889c081 tempest-QuotaClassesAdmin257Test-335462659 tempest-QuotaClassesAdmin257Test-335462659-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 159 microversion: 2.57 time: 0.211278 Oct 04 20:45:06.120107 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1299/2528] 10.222.0.33 () {62 vars in 1247 bytes} [Tue Oct 4 20:45:05 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 159 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 20:45:06.131725 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-be47596c-7d25-4939-923f-39b67b9ffd76 tempest-QuotaClassesAdmin257Test-335462659 tempest-QuotaClassesAdmin257Test-335462659-project-admin] Calling method '.version_select at 0x7f3c748059d0>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:06.160331 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-be47596c-7d25-4939-923f-39b67b9ffd76 tempest-QuotaClassesAdmin257Test-335462659 tempest-QuotaClassesAdmin257Test-335462659-project-admin] 10.222.0.33 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 176 microversion: 2.57 time: 0.032862 Oct 04 20:45:06.162475 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1300/2529] 10.222.0.33 () {60 vars in 1226 bytes} [Tue Oct 4 20:45:06 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 176 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 04 20:45:06.190546 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-5d75f486-31f8-4079-bd9e-7e0de6109569 tempest-QuotaClassesAdmin257Test-335462659 tempest-QuotaClassesAdmin257Test-335462659-project-admin] Action: 'update', calling method: .version_select at 0x7f3c74778940>, body: {"quota_class_set": {"cores": 20, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "server_group_members": 10, "server_groups": 10}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:45:06.284432 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-34daca1e-29f8-4e86-83d8-1a8a61b1b2c2 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:06.299952 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-34daca1e-29f8-4e86-83d8-1a8a61b1b2c2 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:06.301416 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-34daca1e-29f8-4e86-83d8-1a8a61b1b2c2 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:06.309850 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-5d75f486-31f8-4079-bd9e-7e0de6109569 tempest-QuotaClassesAdmin257Test-335462659 tempest-QuotaClassesAdmin257Test-335462659-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 155 microversion: 2.57 time: 0.128698 Oct 04 20:45:06.310534 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1301/2530] 10.222.0.33 () {62 vars in 1247 bytes} [Tue Oct 4 20:45:06 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 155 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 04 20:45:06.341017 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-34daca1e-29f8-4e86-83d8-1a8a61b1b2c2 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] 10.222.0.33 "GET /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133" status: 200 len: 1539 microversion: 2.91 time: 0.362762 Oct 04 20:45:06.341656 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1230/2531] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:45:05 2022] GET /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133 => generated 1539 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:45:06.708308 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-992de68b-1b0a-4804-bea4-733f1236fd31 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:06.709518 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-992de68b-1b0a-4804-bea4-733f1236fd31 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] [instance: c43e082f-7e3b-49bd-b206-4f3f231750da] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:06.717138 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-992de68b-1b0a-4804-bea4-733f1236fd31 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:06.719100 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-992de68b-1b0a-4804-bea4-733f1236fd31 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:06.719782 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-992de68b-1b0a-4804-bea4-733f1236fd31 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:06.721248 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-992de68b-1b0a-4804-bea4-733f1236fd31 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:06.722478 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-992de68b-1b0a-4804-bea4-733f1236fd31 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:06.723428 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-992de68b-1b0a-4804-bea4-733f1236fd31 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:07.072741 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-992de68b-1b0a-4804-bea4-733f1236fd31 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87dcc7baf63f4ae6bfe0a099adffd408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7097bc12179446f6a3e1fac8434d5c64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:07.087871 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-992de68b-1b0a-4804-bea4-733f1236fd31 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] 10.222.0.33 "GET /compute/v2.1/servers/c43e082f-7e3b-49bd-b206-4f3f231750da" status: 200 len: 1328 microversion: 2.1 time: 0.380133 Oct 04 20:45:07.090138 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1302/2532] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:45:06 2022] GET /compute/v2.1/servers/c43e082f-7e3b-49bd-b206-4f3f231750da => generated 1328 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:45:07.370836 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e4939a44-127b-4eb0-8b0f-d1c6410bb01d tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:07.372236 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e4939a44-127b-4eb0-8b0f-d1c6410bb01d tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] [instance: 39d66e18-289f-4674-b66c-146d68ef9133] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:07.392626 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e4939a44-127b-4eb0-8b0f-d1c6410bb01d tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:07.393381 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e4939a44-127b-4eb0-8b0f-d1c6410bb01d tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:07.394087 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e4939a44-127b-4eb0-8b0f-d1c6410bb01d tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:07.395504 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e4939a44-127b-4eb0-8b0f-d1c6410bb01d tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:07.396182 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e4939a44-127b-4eb0-8b0f-d1c6410bb01d tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:07.396821 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e4939a44-127b-4eb0-8b0f-d1c6410bb01d tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:07.537804 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e4939a44-127b-4eb0-8b0f-d1c6410bb01d tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:07.547371 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e4939a44-127b-4eb0-8b0f-d1c6410bb01d tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:07.553854 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e4939a44-127b-4eb0-8b0f-d1c6410bb01d tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:07.560595 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e4939a44-127b-4eb0-8b0f-d1c6410bb01d tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] 10.222.0.33 "GET /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133" status: 200 len: 1539 microversion: 2.91 time: 0.195170 Oct 04 20:45:07.563188 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1231/2533] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:45:07 2022] GET /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133 => generated 1539 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:45:08.003295 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-4873f7da-0a4a-41a7-b0fe-e61ee5783382 req-14f49c9c-c8dc-4d81-9961-7c94d4bc1913 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c43e082f-7e3b-49bd-b206-4f3f231750da", "tag": "b3a9409e-f717-447b-bf77-cf3450976c64"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:45:08.022875 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-4873f7da-0a4a-41a7-b0fe-e61ee5783382 req-14f49c9c-c8dc-4d81-9961-7c94d4bc1913 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:08.026927 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-4873f7da-0a4a-41a7-b0fe-e61ee5783382 req-14f49c9c-c8dc-4d81-9961-7c94d4bc1913 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:08.027376 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-4873f7da-0a4a-41a7-b0fe-e61ee5783382 req-14f49c9c-c8dc-4d81-9961-7c94d4bc1913 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:08.062839 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-4873f7da-0a4a-41a7-b0fe-e61ee5783382 req-14f49c9c-c8dc-4d81-9961-7c94d4bc1913 service nova] Creating event network-changed:b3a9409e-f717-447b-bf77-cf3450976c64 for instance c43e082f-7e3b-49bd-b206-4f3f231750da on n-h2-854823-8 Oct 04 20:45:08.075342 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-4873f7da-0a4a-41a7-b0fe-e61ee5783382 req-14f49c9c-c8dc-4d81-9961-7c94d4bc1913 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075548 Oct 04 20:45:08.076095 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1303/2534] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:45:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:45:08.110169 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1dc7cec7-1fd3-491f-8b45-da5dece23a73 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:08.110807 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-1dc7cec7-1fd3-491f-8b45-da5dece23a73 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] [instance: c43e082f-7e3b-49bd-b206-4f3f231750da] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:08.119431 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1dc7cec7-1fd3-491f-8b45-da5dece23a73 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:08.129211 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1dc7cec7-1fd3-491f-8b45-da5dece23a73 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:08.131929 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1dc7cec7-1fd3-491f-8b45-da5dece23a73 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:08.132852 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1dc7cec7-1fd3-491f-8b45-da5dece23a73 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:08.143147 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1dc7cec7-1fd3-491f-8b45-da5dece23a73 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:08.143573 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1dc7cec7-1fd3-491f-8b45-da5dece23a73 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:08.413563 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-1dc7cec7-1fd3-491f-8b45-da5dece23a73 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87dcc7baf63f4ae6bfe0a099adffd408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7097bc12179446f6a3e1fac8434d5c64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:08.428423 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-1dc7cec7-1fd3-491f-8b45-da5dece23a73 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] 10.222.0.33 "GET /compute/v2.1/servers/c43e082f-7e3b-49bd-b206-4f3f231750da" status: 200 len: 1328 microversion: 2.1 time: 0.320926 Oct 04 20:45:08.429248 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1232/2535] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:45:08 2022] GET /compute/v2.1/servers/c43e082f-7e3b-49bd-b206-4f3f231750da => generated 1328 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:45:08.595707 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-f982ac99-a93c-4b0d-b5f6-6615baeb91f6 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:08.596565 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-f982ac99-a93c-4b0d-b5f6-6615baeb91f6 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] [instance: 39d66e18-289f-4674-b66c-146d68ef9133] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:08.615343 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f982ac99-a93c-4b0d-b5f6-6615baeb91f6 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:08.618546 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f982ac99-a93c-4b0d-b5f6-6615baeb91f6 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:08.620620 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f982ac99-a93c-4b0d-b5f6-6615baeb91f6 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:08.622231 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f982ac99-a93c-4b0d-b5f6-6615baeb91f6 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:08.626745 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f982ac99-a93c-4b0d-b5f6-6615baeb91f6 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:08.627545 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f982ac99-a93c-4b0d-b5f6-6615baeb91f6 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:08.760236 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-f982ac99-a93c-4b0d-b5f6-6615baeb91f6 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:08.774922 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-f982ac99-a93c-4b0d-b5f6-6615baeb91f6 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:08.778539 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-f982ac99-a93c-4b0d-b5f6-6615baeb91f6 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:08.792774 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-f982ac99-a93c-4b0d-b5f6-6615baeb91f6 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] 10.222.0.33 "GET /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133" status: 200 len: 1539 microversion: 2.91 time: 0.201087 Oct 04 20:45:08.794772 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1304/2536] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:45:08 2022] GET /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133 => generated 1539 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:45:09.454419 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9d29ed87-dff5-4a9e-ba67-585ea8ce55b8 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:09.455287 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-9d29ed87-dff5-4a9e-ba67-585ea8ce55b8 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] [instance: c43e082f-7e3b-49bd-b206-4f3f231750da] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:09.472953 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9d29ed87-dff5-4a9e-ba67-585ea8ce55b8 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:09.473963 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9d29ed87-dff5-4a9e-ba67-585ea8ce55b8 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:09.474404 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9d29ed87-dff5-4a9e-ba67-585ea8ce55b8 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:09.478285 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9d29ed87-dff5-4a9e-ba67-585ea8ce55b8 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:09.479031 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9d29ed87-dff5-4a9e-ba67-585ea8ce55b8 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:09.481308 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9d29ed87-dff5-4a9e-ba67-585ea8ce55b8 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:09.834076 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-9d29ed87-dff5-4a9e-ba67-585ea8ce55b8 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87dcc7baf63f4ae6bfe0a099adffd408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7097bc12179446f6a3e1fac8434d5c64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:09.834689 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-135eccb2-8f75-4344-9150-6650b73228a3 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:09.836249 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-135eccb2-8f75-4344-9150-6650b73228a3 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] [instance: 39d66e18-289f-4674-b66c-146d68ef9133] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:09.845384 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-135eccb2-8f75-4344-9150-6650b73228a3 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:09.847994 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-135eccb2-8f75-4344-9150-6650b73228a3 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:09.858004 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-135eccb2-8f75-4344-9150-6650b73228a3 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:09.860116 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-135eccb2-8f75-4344-9150-6650b73228a3 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:09.862048 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-135eccb2-8f75-4344-9150-6650b73228a3 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:09.862739 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-135eccb2-8f75-4344-9150-6650b73228a3 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:09.867074 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-9d29ed87-dff5-4a9e-ba67-585ea8ce55b8 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] 10.222.0.33 "GET /compute/v2.1/servers/c43e082f-7e3b-49bd-b206-4f3f231750da" status: 200 len: 1328 microversion: 2.1 time: 0.410422 Oct 04 20:45:09.871214 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1233/2537] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:45:09 2022] GET /compute/v2.1/servers/c43e082f-7e3b-49bd-b206-4f3f231750da => generated 1328 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:45:09.901556 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:45:10.136108 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-135eccb2-8f75-4344-9150-6650b73228a3 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:10.155175 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-135eccb2-8f75-4344-9150-6650b73228a3 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:10.161867 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-135eccb2-8f75-4344-9150-6650b73228a3 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:10.185793 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-135eccb2-8f75-4344-9150-6650b73228a3 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] 10.222.0.33 "GET /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133" status: 200 len: 1539 microversion: 2.91 time: 0.357981 Oct 04 20:45:10.186421 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1305/2538] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:45:09 2022] GET /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133 => generated 1539 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 20:45:10.898383 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-fe36fdd0-76e1-4b3a-bafb-5cbf390fdbb9 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:10.900541 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-fe36fdd0-76e1-4b3a-bafb-5cbf390fdbb9 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] [instance: c43e082f-7e3b-49bd-b206-4f3f231750da] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:10.918917 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fe36fdd0-76e1-4b3a-bafb-5cbf390fdbb9 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:10.919774 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fe36fdd0-76e1-4b3a-bafb-5cbf390fdbb9 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:10.920455 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fe36fdd0-76e1-4b3a-bafb-5cbf390fdbb9 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:10.921400 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fe36fdd0-76e1-4b3a-bafb-5cbf390fdbb9 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:10.922067 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fe36fdd0-76e1-4b3a-bafb-5cbf390fdbb9 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:10.922741 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fe36fdd0-76e1-4b3a-bafb-5cbf390fdbb9 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:11.218557 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-460531dc-fe4c-47fe-ab57-652537b454fb tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:11.219178 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-460531dc-fe4c-47fe-ab57-652537b454fb tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] [instance: 39d66e18-289f-4674-b66c-146d68ef9133] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:11.232253 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-460531dc-fe4c-47fe-ab57-652537b454fb tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:11.232763 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-460531dc-fe4c-47fe-ab57-652537b454fb tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:11.233206 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-460531dc-fe4c-47fe-ab57-652537b454fb tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:11.233930 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-460531dc-fe4c-47fe-ab57-652537b454fb tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:11.234407 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-460531dc-fe4c-47fe-ab57-652537b454fb tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:11.234838 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-460531dc-fe4c-47fe-ab57-652537b454fb tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:11.474762 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-fe36fdd0-76e1-4b3a-bafb-5cbf390fdbb9 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87dcc7baf63f4ae6bfe0a099adffd408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7097bc12179446f6a3e1fac8434d5c64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:11.489113 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-fe36fdd0-76e1-4b3a-bafb-5cbf390fdbb9 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] 10.222.0.33 "GET /compute/v2.1/servers/c43e082f-7e3b-49bd-b206-4f3f231750da" status: 200 len: 1328 microversion: 2.1 time: 0.595808 Oct 04 20:45:11.490481 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1234/2539] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:45:10 2022] GET /compute/v2.1/servers/c43e082f-7e3b-49bd-b206-4f3f231750da => generated 1328 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:45:11.524423 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-460531dc-fe4c-47fe-ab57-652537b454fb tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:11.563421 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-460531dc-fe4c-47fe-ab57-652537b454fb tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:11.587547 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-460531dc-fe4c-47fe-ab57-652537b454fb tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:11.601157 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-460531dc-fe4c-47fe-ab57-652537b454fb tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] 10.222.0.33 "GET /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133" status: 200 len: 1539 microversion: 2.91 time: 0.388017 Oct 04 20:45:11.624821 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1306/2540] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:45:11 2022] GET /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133 => generated 1539 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:45:11.798402 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:45:11.943939 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b7e81b79-b3a2-459f-a7d2-222517a32c3c tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1215405361", "imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63", "flavorRef": "452", "networks": [{"uuid": "4c0a9fa9-b96b-431d-88f1-03cf1e898d51"}]}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:45:12.031980 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.network.neutron [None req-b7e81b79-b3a2-459f-a7d2-222517a32c3c tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] validate_networks() for [('4c0a9fa9-b96b-431d-88f1-03cf1e898d51', None, None, None, None, None)] {{(pid=128801) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:45:12.570001 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-74a2eca6-39f2-4166-8611-8deed898ebcc tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsV221TestJSON-server-1522886997", "imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63", "flavorRef": "452", "networks": [{"uuid": "047f52ae-f28e-4e12-946a-bef50434d83f"}]}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:45:12.640204 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.network.neutron [None req-74a2eca6-39f2-4166-8611-8deed898ebcc tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] validate_networks() for [('047f52ae-f28e-4e12-946a-bef50434d83f', None, None, None, None, None)] {{(pid=128802) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:45:12.737305 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-b7e81b79-b3a2-459f-a7d2-222517a32c3c tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Flavor limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:45:12.737901 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-b7e81b79-b3a2-459f-a7d2-222517a32c3c tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Image limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:45:12.738514 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-b7e81b79-b3a2-459f-a7d2-222517a32c3c tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Flavor pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:45:12.739421 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-b7e81b79-b3a2-459f-a7d2-222517a32c3c tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Image pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:45:12.740065 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-b7e81b79-b3a2-459f-a7d2-222517a32c3c tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:45:12.749865 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b7e81b79-b3a2-459f-a7d2-222517a32c3c tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:12.751029 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b7e81b79-b3a2-459f-a7d2-222517a32c3c tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:12.751665 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b7e81b79-b3a2-459f-a7d2-222517a32c3c tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:12.752593 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b7e81b79-b3a2-459f-a7d2-222517a32c3c tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:12.753362 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b7e81b79-b3a2-459f-a7d2-222517a32c3c tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:12.754003 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b7e81b79-b3a2-459f-a7d2-222517a32c3c tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:12.775790 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-b7e81b79-b3a2-459f-a7d2-222517a32c3c tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Getting quotas for project 3f3fadcd7d4043daa0a6aba27ba814d5. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:45:12.781915 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-b7e81b79-b3a2-459f-a7d2-222517a32c3c tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Getting quotas for user aca59cd50bf74a36bb1e4427cd50fbb3 and project 3f3fadcd7d4043daa0a6aba27ba814d5. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:45:12.797625 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b7e81b79-b3a2-459f-a7d2-222517a32c3c tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Going to run 1 instances... {{(pid=128801) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:45:12.800655 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b7e81b79-b3a2-459f-a7d2-222517a32c3c tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] [instance: c79c0cc3-17e6-4c35-b17e-c76c9b7e9e39] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='15b24725-0c99-4bcf-b1fb-907cdf8e2d63',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128801) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:45:12.927455 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b7e81b79-b3a2-459f-a7d2-222517a32c3c tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.137086 Oct 04 20:45:12.929027 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1235/2541] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 20:45:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 1142 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 20:45:12.949270 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e2269179-da4a-4465-8ee1-92eb5d26a7b2 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:12.950538 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e2269179-da4a-4465-8ee1-92eb5d26a7b2 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] [instance: c43e082f-7e3b-49bd-b206-4f3f231750da] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:12.963311 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e2269179-da4a-4465-8ee1-92eb5d26a7b2 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:12.963950 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e2269179-da4a-4465-8ee1-92eb5d26a7b2 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:12.965245 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e2269179-da4a-4465-8ee1-92eb5d26a7b2 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:12.967078 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e2269179-da4a-4465-8ee1-92eb5d26a7b2 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:12.967946 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e2269179-da4a-4465-8ee1-92eb5d26a7b2 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:12.969330 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e2269179-da4a-4465-8ee1-92eb5d26a7b2 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:13.228128 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e2269179-da4a-4465-8ee1-92eb5d26a7b2 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87dcc7baf63f4ae6bfe0a099adffd408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7097bc12179446f6a3e1fac8434d5c64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:13.248632 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e2269179-da4a-4465-8ee1-92eb5d26a7b2 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] 10.222.0.33 "GET /compute/v2.1/servers/c43e082f-7e3b-49bd-b206-4f3f231750da" status: 200 len: 1328 microversion: 2.1 time: 0.314169 Oct 04 20:45:13.249987 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1236/2542] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:45:12 2022] GET /compute/v2.1/servers/c43e082f-7e3b-49bd-b206-4f3f231750da => generated 1328 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:45:13.264111 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d396a23d-368b-47fd-b1aa-feef9b7b30d2 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:13.264723 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d396a23d-368b-47fd-b1aa-feef9b7b30d2 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] [instance: 39d66e18-289f-4674-b66c-146d68ef9133] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:13.290854 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d396a23d-368b-47fd-b1aa-feef9b7b30d2 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:13.293100 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d396a23d-368b-47fd-b1aa-feef9b7b30d2 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:13.294077 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d396a23d-368b-47fd-b1aa-feef9b7b30d2 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:13.300196 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d396a23d-368b-47fd-b1aa-feef9b7b30d2 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:13.301494 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d396a23d-368b-47fd-b1aa-feef9b7b30d2 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:13.303765 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d396a23d-368b-47fd-b1aa-feef9b7b30d2 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:13.481781 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d396a23d-368b-47fd-b1aa-feef9b7b30d2 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:13.499100 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d396a23d-368b-47fd-b1aa-feef9b7b30d2 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:13.506985 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d396a23d-368b-47fd-b1aa-feef9b7b30d2 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:13.518296 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d396a23d-368b-47fd-b1aa-feef9b7b30d2 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] 10.222.0.33 "GET /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133" status: 200 len: 1539 microversion: 2.91 time: 0.267076 Oct 04 20:45:13.519615 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1237/2543] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:45:13 2022] GET /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133 => generated 1539 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:45:13.527795 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-309e0835-6a2f-400b-ad44-58e2d560296e tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:13.528415 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-309e0835-6a2f-400b-ad44-58e2d560296e tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] [instance: c79c0cc3-17e6-4c35-b17e-c76c9b7e9e39] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:13.669108 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-309e0835-6a2f-400b-ad44-58e2d560296e tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aca59cd50bf74a36bb1e4427cd50fbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3fadcd7d4043daa0a6aba27ba814d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:13.671274 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-74a2eca6-39f2-4166-8611-8deed898ebcc tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Flavor limits 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:45:13.672390 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-74a2eca6-39f2-4166-8611-8deed898ebcc tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Image limits 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:45:13.673133 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-74a2eca6-39f2-4166-8611-8deed898ebcc tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Flavor pref 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:45:13.673761 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-74a2eca6-39f2-4166-8611-8deed898ebcc tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Image pref 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:45:13.674553 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-74a2eca6-39f2-4166-8611-8deed898ebcc tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:45:13.678912 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-309e0835-6a2f-400b-ad44-58e2d560296e tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] 10.222.0.33 "GET /compute/v2.1/servers/c79c0cc3-17e6-4c35-b17e-c76c9b7e9e39" status: 200 len: 1208 microversion: 2.1 time: 0.156686 Oct 04 20:45:13.680313 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1238/2544] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:45:13 2022] GET /compute/v2.1/servers/c79c0cc3-17e6-4c35-b17e-c76c9b7e9e39 => generated 1208 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:45:13.697250 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-74a2eca6-39f2-4166-8611-8deed898ebcc tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:13.697250 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-74a2eca6-39f2-4166-8611-8deed898ebcc tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:13.697250 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-74a2eca6-39f2-4166-8611-8deed898ebcc tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:13.697250 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-74a2eca6-39f2-4166-8611-8deed898ebcc tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:13.697250 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-74a2eca6-39f2-4166-8611-8deed898ebcc tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:13.697250 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-74a2eca6-39f2-4166-8611-8deed898ebcc tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:13.709838 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-74a2eca6-39f2-4166-8611-8deed898ebcc tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Getting quotas for project ad0c55e5899c472a88528599880689cc. Resources: {'ram', 'instances', 'cores'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:45:13.718538 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-74a2eca6-39f2-4166-8611-8deed898ebcc tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Getting quotas for user 77e1ca325fc147eaaf49b067ab20cd52 and project ad0c55e5899c472a88528599880689cc. Resources: {'ram', 'instances', 'cores'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:45:13.719712 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9f55af7a-686b-477d-a587-b80ab2a5b824 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Calling method '.version_select at 0x7f3c740dad30>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:13.736532 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-74a2eca6-39f2-4166-8611-8deed898ebcc tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Going to run 1 instances... {{(pid=128802) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:45:13.739628 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-74a2eca6-39f2-4166-8611-8deed898ebcc tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] [instance: 8d3bd4d5-93f3-44f6-ba25-407fe841a180] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='15b24725-0c99-4bcf-b1fb-907cdf8e2d63',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128802) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:45:13.801117 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-74a2eca6-39f2-4166-8611-8deed898ebcc tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.21 time: 1.309714 Oct 04 20:45:13.802489 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1307/2545] 10.222.0.33 () {62 vars in 1188 bytes} [Tue Oct 4 20:45:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 1312 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Oct 04 20:45:13.804728 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-9f55af7a-686b-477d-a587-b80ab2a5b824 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] 10.222.0.33 "GET /compute/v2.1/images/89571f97-013e-48fe-a213-64b35354aafa" status: 200 len: 662 microversion: 2.1 time: 0.089275 Oct 04 20:45:13.805335 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1239/2546] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 20:45:13 2022] GET /compute/v2.1/images/89571f97-013e-48fe-a213-64b35354aafa => generated 662 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:45:13.809193 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-da849c11-2be2-4c86-bbf7-6f0c996608b8 req-da618f08-deea-4b44-8f30-90efd1cc9b24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c43e082f-7e3b-49bd-b206-4f3f231750da", "name": "network-vif-plugged", "status": "completed", "tag": "b3a9409e-f717-447b-bf77-cf3450976c64"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:45:13.819574 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e3899870-c9e0-4d74-b53d-9077be6ea39d tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:13.819867 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-da849c11-2be2-4c86-bbf7-6f0c996608b8 req-da618f08-deea-4b44-8f30-90efd1cc9b24 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:13.820071 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-da849c11-2be2-4c86-bbf7-6f0c996608b8 req-da618f08-deea-4b44-8f30-90efd1cc9b24 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:13.820512 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-da849c11-2be2-4c86-bbf7-6f0c996608b8 req-da618f08-deea-4b44-8f30-90efd1cc9b24 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:13.822419 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e3899870-c9e0-4d74-b53d-9077be6ea39d tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] [instance: 8d3bd4d5-93f3-44f6-ba25-407fe841a180] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:13.832184 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-da849c11-2be2-4c86-bbf7-6f0c996608b8 req-da618f08-deea-4b44-8f30-90efd1cc9b24 service nova] Creating event network-vif-plugged:b3a9409e-f717-447b-bf77-cf3450976c64 for instance c43e082f-7e3b-49bd-b206-4f3f231750da on n-h2-854823-8 Oct 04 20:45:13.838718 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-da849c11-2be2-4c86-bbf7-6f0c996608b8 req-da618f08-deea-4b44-8f30-90efd1cc9b24 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034539 Oct 04 20:45:13.839706 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1308/2547] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:45:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:45:13.846921 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-db66d0a1-204f-47b4-9bf7-1d20c5b3bd8a tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Calling method '.version_select at 0x7f3c74758f70>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:13.904635 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-db66d0a1-204f-47b4-9bf7-1d20c5b3bd8a tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] 10.222.0.33 "GET /compute/v2.1/images/89571f97-013e-48fe-a213-64b35354aafa" status: 200 len: 662 microversion: 2.1 time: 0.063509 Oct 04 20:45:13.905582 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1309/2548] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 20:45:13 2022] GET /compute/v2.1/images/89571f97-013e-48fe-a213-64b35354aafa => generated 662 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:45:13.950329 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e3899870-c9e0-4d74-b53d-9077be6ea39d tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e1ca325fc147eaaf49b067ab20cd52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0c55e5899c472a88528599880689cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:13.960261 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e3899870-c9e0-4d74-b53d-9077be6ea39d tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77e1ca325fc147eaaf49b067ab20cd52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0c55e5899c472a88528599880689cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:13.962649 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e3899870-c9e0-4d74-b53d-9077be6ea39d tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77e1ca325fc147eaaf49b067ab20cd52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0c55e5899c472a88528599880689cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:13.964646 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e3899870-c9e0-4d74-b53d-9077be6ea39d tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] 10.222.0.33 "GET /compute/v2.1/servers/8d3bd4d5-93f3-44f6-ba25-407fe841a180" status: 200 len: 1259 microversion: 2.21 time: 0.154403 Oct 04 20:45:13.965791 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1240/2549] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:45:13 2022] GET /compute/v2.1/servers/8d3bd4d5-93f3-44f6-ba25-407fe841a180 => generated 1259 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 20:45:14.278522 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-37ff04e3-b4ca-4f44-b08f-8d1521731b3d tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:14.279329 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-37ff04e3-b4ca-4f44-b08f-8d1521731b3d tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] [instance: c43e082f-7e3b-49bd-b206-4f3f231750da] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:14.285441 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=14,nova_api:INSERT=5 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:45:14.287164 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-37ff04e3-b4ca-4f44-b08f-8d1521731b3d tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:14.287718 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-37ff04e3-b4ca-4f44-b08f-8d1521731b3d tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:14.288165 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-37ff04e3-b4ca-4f44-b08f-8d1521731b3d tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:14.289025 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-37ff04e3-b4ca-4f44-b08f-8d1521731b3d tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:14.289574 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-37ff04e3-b4ca-4f44-b08f-8d1521731b3d tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:14.289982 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-37ff04e3-b4ca-4f44-b08f-8d1521731b3d tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:14.488978 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-37ff04e3-b4ca-4f44-b08f-8d1521731b3d tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87dcc7baf63f4ae6bfe0a099adffd408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7097bc12179446f6a3e1fac8434d5c64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:14.499753 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-37ff04e3-b4ca-4f44-b08f-8d1521731b3d tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] 10.222.0.33 "GET /compute/v2.1/servers/c43e082f-7e3b-49bd-b206-4f3f231750da" status: 200 len: 1328 microversion: 2.1 time: 0.225867 Oct 04 20:45:14.500748 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1310/2550] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:45:14 2022] GET /compute/v2.1/servers/c43e082f-7e3b-49bd-b206-4f3f231750da => generated 1328 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:45:14.554917 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-bbf9c224-c311-412c-b3d4-c618aaf59215 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:14.555802 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-bbf9c224-c311-412c-b3d4-c618aaf59215 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] [instance: 39d66e18-289f-4674-b66c-146d68ef9133] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:14.567373 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bbf9c224-c311-412c-b3d4-c618aaf59215 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:14.568111 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bbf9c224-c311-412c-b3d4-c618aaf59215 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:14.568665 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bbf9c224-c311-412c-b3d4-c618aaf59215 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:14.569459 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bbf9c224-c311-412c-b3d4-c618aaf59215 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:14.570033 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bbf9c224-c311-412c-b3d4-c618aaf59215 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:14.570723 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bbf9c224-c311-412c-b3d4-c618aaf59215 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:14.645119 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-bbf9c224-c311-412c-b3d4-c618aaf59215 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:14.654688 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-bbf9c224-c311-412c-b3d4-c618aaf59215 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:14.656415 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-bbf9c224-c311-412c-b3d4-c618aaf59215 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:14.662659 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-bbf9c224-c311-412c-b3d4-c618aaf59215 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] 10.222.0.33 "GET /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133" status: 200 len: 1539 microversion: 2.91 time: 0.114503 Oct 04 20:45:14.663609 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1241/2551] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:45:14 2022] GET /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133 => generated 1539 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:45:14.719742 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-11de4ed6-8a23-4423-a2a7-a9d36bf4e8ae tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:14.721134 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-11de4ed6-8a23-4423-a2a7-a9d36bf4e8ae tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] [instance: c79c0cc3-17e6-4c35-b17e-c76c9b7e9e39] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:14.731000 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-11de4ed6-8a23-4423-a2a7-a9d36bf4e8ae tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:14.731616 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-11de4ed6-8a23-4423-a2a7-a9d36bf4e8ae tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:14.732263 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-11de4ed6-8a23-4423-a2a7-a9d36bf4e8ae tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:14.733813 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-11de4ed6-8a23-4423-a2a7-a9d36bf4e8ae tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:14.734622 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-11de4ed6-8a23-4423-a2a7-a9d36bf4e8ae tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:14.735299 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-11de4ed6-8a23-4423-a2a7-a9d36bf4e8ae tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:14.824756 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-11de4ed6-8a23-4423-a2a7-a9d36bf4e8ae tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aca59cd50bf74a36bb1e4427cd50fbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3fadcd7d4043daa0a6aba27ba814d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:14.835060 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-11de4ed6-8a23-4423-a2a7-a9d36bf4e8ae tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] 10.222.0.33 "GET /compute/v2.1/servers/c79c0cc3-17e6-4c35-b17e-c76c9b7e9e39" status: 200 len: 1260 microversion: 2.1 time: 0.134450 Oct 04 20:45:14.835805 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1311/2552] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:45:14 2022] GET /compute/v2.1/servers/c79c0cc3-17e6-4c35-b17e-c76c9b7e9e39 => generated 1260 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:45:14.991837 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-787730aa-a712-41c7-9c6d-5cac6e7298c7 tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:14.992623 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-787730aa-a712-41c7-9c6d-5cac6e7298c7 tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] [instance: 8d3bd4d5-93f3-44f6-ba25-407fe841a180] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:15.000630 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-787730aa-a712-41c7-9c6d-5cac6e7298c7 tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:15.001242 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-787730aa-a712-41c7-9c6d-5cac6e7298c7 tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:15.001766 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-787730aa-a712-41c7-9c6d-5cac6e7298c7 tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:15.002502 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-787730aa-a712-41c7-9c6d-5cac6e7298c7 tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:15.003196 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-787730aa-a712-41c7-9c6d-5cac6e7298c7 tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:15.003670 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-787730aa-a712-41c7-9c6d-5cac6e7298c7 tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:15.087861 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-787730aa-a712-41c7-9c6d-5cac6e7298c7 tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e1ca325fc147eaaf49b067ab20cd52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0c55e5899c472a88528599880689cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:15.102632 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-787730aa-a712-41c7-9c6d-5cac6e7298c7 tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77e1ca325fc147eaaf49b067ab20cd52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0c55e5899c472a88528599880689cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:15.109217 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-787730aa-a712-41c7-9c6d-5cac6e7298c7 tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77e1ca325fc147eaaf49b067ab20cd52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0c55e5899c472a88528599880689cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:15.111598 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-787730aa-a712-41c7-9c6d-5cac6e7298c7 tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] 10.222.0.33 "GET /compute/v2.1/servers/8d3bd4d5-93f3-44f6-ba25-407fe841a180" status: 200 len: 1255 microversion: 2.21 time: 0.124247 Oct 04 20:45:15.114801 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1242/2553] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:45:14 2022] GET /compute/v2.1/servers/8d3bd4d5-93f3-44f6-ba25-407fe841a180 => generated 1255 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:45:15.455962 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-6f5daff4-095a-44ef-a55a-4cb34be1b30d tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Calling method '.version_select at 0x7f3c7450d940>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:15.522092 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-6f5daff4-095a-44ef-a55a-4cb34be1b30d tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] 10.222.0.33 "GET /compute/v2.1/images/85e195a0-9c00-4243-9e00-452d60faac3a" status: 200 len: 662 microversion: 2.1 time: 0.069899 Oct 04 20:45:15.526440 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-dca137b5-70c3-45ba-8914-14bb44c4d468 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:15.527045 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1312/2554] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 20:45:15 2022] GET /compute/v2.1/images/85e195a0-9c00-4243-9e00-452d60faac3a => generated 662 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:45:15.527328 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-dca137b5-70c3-45ba-8914-14bb44c4d468 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] [instance: c43e082f-7e3b-49bd-b206-4f3f231750da] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:15.541689 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dca137b5-70c3-45ba-8914-14bb44c4d468 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:15.542282 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dca137b5-70c3-45ba-8914-14bb44c4d468 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:15.542708 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-517dd8b2-94cb-4040-be0a-b4a8dc90236a tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Calling method '.version_select at 0x7f3c7890c940>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:15.544546 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dca137b5-70c3-45ba-8914-14bb44c4d468 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:15.547179 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dca137b5-70c3-45ba-8914-14bb44c4d468 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:15.547942 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dca137b5-70c3-45ba-8914-14bb44c4d468 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:15.548652 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dca137b5-70c3-45ba-8914-14bb44c4d468 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:15.622641 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-517dd8b2-94cb-4040-be0a-b4a8dc90236a tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] 10.222.0.33 "GET /compute/v2.1/images/85e195a0-9c00-4243-9e00-452d60faac3a" status: 200 len: 662 microversion: 2.1 time: 0.088576 Oct 04 20:45:15.624399 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1313/2555] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 20:45:15 2022] GET /compute/v2.1/images/85e195a0-9c00-4243-9e00-452d60faac3a => generated 662 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:45:15.709602 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-821d2327-3849-4126-9c47-e6bcf4ab65b9 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:15.713280 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-821d2327-3849-4126-9c47-e6bcf4ab65b9 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] [instance: 39d66e18-289f-4674-b66c-146d68ef9133] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:15.749165 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-821d2327-3849-4126-9c47-e6bcf4ab65b9 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:15.752632 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-821d2327-3849-4126-9c47-e6bcf4ab65b9 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:15.753733 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-821d2327-3849-4126-9c47-e6bcf4ab65b9 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:15.757207 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-821d2327-3849-4126-9c47-e6bcf4ab65b9 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:15.760254 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-821d2327-3849-4126-9c47-e6bcf4ab65b9 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:15.761195 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-821d2327-3849-4126-9c47-e6bcf4ab65b9 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:15.854157 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-dca137b5-70c3-45ba-8914-14bb44c4d468 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87dcc7baf63f4ae6bfe0a099adffd408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7097bc12179446f6a3e1fac8434d5c64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:15.869333 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-dca137b5-70c3-45ba-8914-14bb44c4d468 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] 10.222.0.33 "GET /compute/v2.1/servers/c43e082f-7e3b-49bd-b206-4f3f231750da" status: 200 len: 1508 microversion: 2.1 time: 0.349193 Oct 04 20:45:15.875404 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1243/2556] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:45:15 2022] GET /compute/v2.1/servers/c43e082f-7e3b-49bd-b206-4f3f231750da => generated 1508 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:45:15.891807 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-53f34f2b-ec5c-4e4b-b1b8-c9a4f09843b7 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:15.893149 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-53f34f2b-ec5c-4e4b-b1b8-c9a4f09843b7 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] [instance: c79c0cc3-17e6-4c35-b17e-c76c9b7e9e39] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:15.912778 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-53f34f2b-ec5c-4e4b-b1b8-c9a4f09843b7 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:15.916066 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-53f34f2b-ec5c-4e4b-b1b8-c9a4f09843b7 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:15.918471 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-53f34f2b-ec5c-4e4b-b1b8-c9a4f09843b7 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:15.920486 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-53f34f2b-ec5c-4e4b-b1b8-c9a4f09843b7 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:15.923126 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-53f34f2b-ec5c-4e4b-b1b8-c9a4f09843b7 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:15.924145 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-53f34f2b-ec5c-4e4b-b1b8-c9a4f09843b7 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:15.960510 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-821d2327-3849-4126-9c47-e6bcf4ab65b9 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:15.975356 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-821d2327-3849-4126-9c47-e6bcf4ab65b9 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:15.977776 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-821d2327-3849-4126-9c47-e6bcf4ab65b9 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:15.984750 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-821d2327-3849-4126-9c47-e6bcf4ab65b9 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] 10.222.0.33 "GET /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133" status: 200 len: 1539 microversion: 2.91 time: 0.296286 Oct 04 20:45:15.985869 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1314/2557] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:45:15 2022] GET /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133 => generated 1539 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 20:45:16.002655 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-1788e2a6-46d8-4988-ac89-5f227e3852e8 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:16.003664 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-1788e2a6-46d8-4988-ac89-5f227e3852e8 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] [instance: c43e082f-7e3b-49bd-b206-4f3f231750da] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:16.014008 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1788e2a6-46d8-4988-ac89-5f227e3852e8 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:16.014860 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1788e2a6-46d8-4988-ac89-5f227e3852e8 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:16.015503 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1788e2a6-46d8-4988-ac89-5f227e3852e8 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:16.016421 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1788e2a6-46d8-4988-ac89-5f227e3852e8 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:16.017078 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1788e2a6-46d8-4988-ac89-5f227e3852e8 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:16.017728 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1788e2a6-46d8-4988-ac89-5f227e3852e8 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:16.031410 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-53f34f2b-ec5c-4e4b-b1b8-c9a4f09843b7 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aca59cd50bf74a36bb1e4427cd50fbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3fadcd7d4043daa0a6aba27ba814d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:16.041671 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-53f34f2b-ec5c-4e4b-b1b8-c9a4f09843b7 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] 10.222.0.33 "GET /compute/v2.1/servers/c79c0cc3-17e6-4c35-b17e-c76c9b7e9e39" status: 200 len: 1278 microversion: 2.1 time: 0.164818 Oct 04 20:45:16.054366 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1244/2558] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:45:15 2022] GET /compute/v2.1/servers/c79c0cc3-17e6-4c35-b17e-c76c9b7e9e39 => generated 1278 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:45:16.139673 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-21a22511-95d3-4e84-8ceb-0489692c8588 tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:16.140420 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-21a22511-95d3-4e84-8ceb-0489692c8588 tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] [instance: 8d3bd4d5-93f3-44f6-ba25-407fe841a180] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:16.152549 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-21a22511-95d3-4e84-8ceb-0489692c8588 tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:16.155596 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-21a22511-95d3-4e84-8ceb-0489692c8588 tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:16.156830 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-21a22511-95d3-4e84-8ceb-0489692c8588 tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:16.157726 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-21a22511-95d3-4e84-8ceb-0489692c8588 tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:16.158521 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-21a22511-95d3-4e84-8ceb-0489692c8588 tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:16.159195 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-21a22511-95d3-4e84-8ceb-0489692c8588 tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:16.222393 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-1788e2a6-46d8-4988-ac89-5f227e3852e8 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87dcc7baf63f4ae6bfe0a099adffd408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7097bc12179446f6a3e1fac8434d5c64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:16.233839 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-1788e2a6-46d8-4988-ac89-5f227e3852e8 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] 10.222.0.33 "GET /compute/v2.1/servers/c43e082f-7e3b-49bd-b206-4f3f231750da" status: 200 len: 1508 microversion: 2.1 time: 0.246708 Oct 04 20:45:16.243892 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1315/2559] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:45:15 2022] GET /compute/v2.1/servers/c43e082f-7e3b-49bd-b206-4f3f231750da => generated 1508 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:45:16.256282 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-21a22511-95d3-4e84-8ceb-0489692c8588 tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e1ca325fc147eaaf49b067ab20cd52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0c55e5899c472a88528599880689cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:16.260150 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-cf09f69c-3874-46c7-a55d-edf7ac6a366c tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:16.261687 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-cf09f69c-3874-46c7-a55d-edf7ac6a366c tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] [instance: c43e082f-7e3b-49bd-b206-4f3f231750da] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:16.270481 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-21a22511-95d3-4e84-8ceb-0489692c8588 tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77e1ca325fc147eaaf49b067ab20cd52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0c55e5899c472a88528599880689cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:16.271813 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cf09f69c-3874-46c7-a55d-edf7ac6a366c tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:16.272348 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cf09f69c-3874-46c7-a55d-edf7ac6a366c tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:16.272787 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cf09f69c-3874-46c7-a55d-edf7ac6a366c tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:16.273094 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-21a22511-95d3-4e84-8ceb-0489692c8588 tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77e1ca325fc147eaaf49b067ab20cd52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0c55e5899c472a88528599880689cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:16.273888 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cf09f69c-3874-46c7-a55d-edf7ac6a366c tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:16.274427 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cf09f69c-3874-46c7-a55d-edf7ac6a366c tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:16.274858 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cf09f69c-3874-46c7-a55d-edf7ac6a366c tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:16.275625 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-21a22511-95d3-4e84-8ceb-0489692c8588 tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] 10.222.0.33 "GET /compute/v2.1/servers/8d3bd4d5-93f3-44f6-ba25-407fe841a180" status: 200 len: 1311 microversion: 2.21 time: 0.139962 Oct 04 20:45:16.276481 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1245/2560] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:45:16 2022] GET /compute/v2.1/servers/8d3bd4d5-93f3-44f6-ba25-407fe841a180 => generated 1311 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:45:16.309039 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-cf09f69c-3874-46c7-a55d-edf7ac6a366c tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] [instance: c43e082f-7e3b-49bd-b206-4f3f231750da] Going to try to terminate instance {{(pid=128802) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:45:16.423748 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-cf09f69c-3874-46c7-a55d-edf7ac6a366c tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] 10.222.0.33 "DELETE /compute/v2.1/servers/c43e082f-7e3b-49bd-b206-4f3f231750da" status: 204 len: 0 microversion: 2.1 time: 0.168819 Oct 04 20:45:16.424410 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1316/2561] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 20:45:16 2022] DELETE /compute/v2.1/servers/c43e082f-7e3b-49bd-b206-4f3f231750da => generated 0 bytes in 170 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:45:16.439713 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d7ddc9b6-4086-46b1-b331-bee430874bbb tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:16.442377 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d7ddc9b6-4086-46b1-b331-bee430874bbb tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] [instance: c43e082f-7e3b-49bd-b206-4f3f231750da] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:16.461767 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d7ddc9b6-4086-46b1-b331-bee430874bbb tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:16.463764 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d7ddc9b6-4086-46b1-b331-bee430874bbb tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:16.463764 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d7ddc9b6-4086-46b1-b331-bee430874bbb tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:16.467116 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d7ddc9b6-4086-46b1-b331-bee430874bbb tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:16.468851 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d7ddc9b6-4086-46b1-b331-bee430874bbb tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:16.469313 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d7ddc9b6-4086-46b1-b331-bee430874bbb tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:16.759173 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d7ddc9b6-4086-46b1-b331-bee430874bbb tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87dcc7baf63f4ae6bfe0a099adffd408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7097bc12179446f6a3e1fac8434d5c64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:16.772262 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d7ddc9b6-4086-46b1-b331-bee430874bbb tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] 10.222.0.33 "GET /compute/v2.1/servers/c43e082f-7e3b-49bd-b206-4f3f231750da" status: 200 len: 1514 microversion: 2.1 time: 0.342167 Oct 04 20:45:16.773077 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1246/2562] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:45:16 2022] GET /compute/v2.1/servers/c43e082f-7e3b-49bd-b206-4f3f231750da => generated 1514 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:45:17.019808 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-45102387-0cd8-4244-93bb-454a02c00e38 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:17.020514 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-45102387-0cd8-4244-93bb-454a02c00e38 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] [instance: 39d66e18-289f-4674-b66c-146d68ef9133] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:17.031503 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-45102387-0cd8-4244-93bb-454a02c00e38 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:17.032000 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-45102387-0cd8-4244-93bb-454a02c00e38 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:17.038503 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-45102387-0cd8-4244-93bb-454a02c00e38 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:17.039344 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-45102387-0cd8-4244-93bb-454a02c00e38 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:17.040068 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-45102387-0cd8-4244-93bb-454a02c00e38 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:17.041025 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-45102387-0cd8-4244-93bb-454a02c00e38 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:17.065505 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-57b21d0a-91de-4167-b503-d3cbcdcd50bb tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:17.066119 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-57b21d0a-91de-4167-b503-d3cbcdcd50bb tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] [instance: c79c0cc3-17e6-4c35-b17e-c76c9b7e9e39] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:17.080480 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-57b21d0a-91de-4167-b503-d3cbcdcd50bb tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:17.080979 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-57b21d0a-91de-4167-b503-d3cbcdcd50bb tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:17.081418 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-57b21d0a-91de-4167-b503-d3cbcdcd50bb tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:17.082121 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-57b21d0a-91de-4167-b503-d3cbcdcd50bb tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:17.082864 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-57b21d0a-91de-4167-b503-d3cbcdcd50bb tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:17.083288 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-57b21d0a-91de-4167-b503-d3cbcdcd50bb tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:17.152024 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-45102387-0cd8-4244-93bb-454a02c00e38 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:17.181449 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-45102387-0cd8-4244-93bb-454a02c00e38 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:17.183116 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-45102387-0cd8-4244-93bb-454a02c00e38 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:17.201959 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-45102387-0cd8-4244-93bb-454a02c00e38 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] 10.222.0.33 "GET /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133" status: 200 len: 1539 microversion: 2.91 time: 0.187380 Oct 04 20:45:17.238798 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1317/2563] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:45:17 2022] GET /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133 => generated 1539 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:45:17.304478 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-7b1e4dd4-6b67-48ce-ba5e-1fc09f9c005e tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:17.305142 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-7b1e4dd4-6b67-48ce-ba5e-1fc09f9c005e tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] [instance: 8d3bd4d5-93f3-44f6-ba25-407fe841a180] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:17.315560 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7b1e4dd4-6b67-48ce-ba5e-1fc09f9c005e tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:17.316206 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7b1e4dd4-6b67-48ce-ba5e-1fc09f9c005e tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:17.317155 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7b1e4dd4-6b67-48ce-ba5e-1fc09f9c005e tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:17.318830 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7b1e4dd4-6b67-48ce-ba5e-1fc09f9c005e tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:17.319669 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7b1e4dd4-6b67-48ce-ba5e-1fc09f9c005e tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:17.330370 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7b1e4dd4-6b67-48ce-ba5e-1fc09f9c005e tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:17.372969 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-57b21d0a-91de-4167-b503-d3cbcdcd50bb tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aca59cd50bf74a36bb1e4427cd50fbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3fadcd7d4043daa0a6aba27ba814d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:17.383012 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-57b21d0a-91de-4167-b503-d3cbcdcd50bb tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] 10.222.0.33 "GET /compute/v2.1/servers/c79c0cc3-17e6-4c35-b17e-c76c9b7e9e39" status: 200 len: 1308 microversion: 2.1 time: 0.321573 Oct 04 20:45:17.385056 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1247/2564] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:45:17 2022] GET /compute/v2.1/servers/c79c0cc3-17e6-4c35-b17e-c76c9b7e9e39 => generated 1308 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:45:17.390127 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-340d8922-735d-43a5-82d1-f0e05e33fdc5 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Calling method '.version_select at 0x7f3c740cb0d0>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:17.463854 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-340d8922-735d-43a5-82d1-f0e05e33fdc5 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] 10.222.0.33 "GET /compute/v2.1/images/78cea246-4b2b-4af1-91d5-5a19ce9f53d5" status: 200 len: 661 microversion: 2.1 time: 0.077260 Oct 04 20:45:17.464489 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1248/2565] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 20:45:17 2022] GET /compute/v2.1/images/78cea246-4b2b-4af1-91d5-5a19ce9f53d5 => generated 661 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:45:17.472013 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-7b1e4dd4-6b67-48ce-ba5e-1fc09f9c005e tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e1ca325fc147eaaf49b067ab20cd52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0c55e5899c472a88528599880689cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:17.481529 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-54cf81dc-c661-4434-8506-0834f617f82c tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Calling method '.version_select at 0x7f3c740ac5e0>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:17.487657 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-7b1e4dd4-6b67-48ce-ba5e-1fc09f9c005e tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77e1ca325fc147eaaf49b067ab20cd52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0c55e5899c472a88528599880689cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:17.499910 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-7b1e4dd4-6b67-48ce-ba5e-1fc09f9c005e tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77e1ca325fc147eaaf49b067ab20cd52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0c55e5899c472a88528599880689cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:17.505942 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-7b1e4dd4-6b67-48ce-ba5e-1fc09f9c005e tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] 10.222.0.33 "GET /compute/v2.1/servers/8d3bd4d5-93f3-44f6-ba25-407fe841a180" status: 200 len: 1319 microversion: 2.21 time: 0.205297 Oct 04 20:45:17.511077 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1318/2566] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:45:17 2022] GET /compute/v2.1/servers/8d3bd4d5-93f3-44f6-ba25-407fe841a180 => generated 1319 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 20:45:17.550279 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-54cf81dc-c661-4434-8506-0834f617f82c tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] 10.222.0.33 "GET /compute/v2.1/images/78cea246-4b2b-4af1-91d5-5a19ce9f53d5" status: 200 len: 661 microversion: 2.1 time: 0.074692 Oct 04 20:45:17.551338 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1249/2567] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 20:45:17 2022] GET /compute/v2.1/images/78cea246-4b2b-4af1-91d5-5a19ce9f53d5 => generated 661 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:45:17.679011 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-e0595fc4-66d9-4b35-aeac-386aff560e38 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-2030330762", "imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63", "flavorRef": "452"}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:45:17.753901 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.network.neutron [None req-e0595fc4-66d9-4b35-aeac-386aff560e38 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] validate_networks() for None {{(pid=128802) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:45:17.799633 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d17ceea0-9e53-4056-a9a5-1f37906f305e tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:17.800550 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d17ceea0-9e53-4056-a9a5-1f37906f305e tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] [instance: c43e082f-7e3b-49bd-b206-4f3f231750da] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:17.810320 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d17ceea0-9e53-4056-a9a5-1f37906f305e tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:17.811123 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d17ceea0-9e53-4056-a9a5-1f37906f305e tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:17.811773 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d17ceea0-9e53-4056-a9a5-1f37906f305e tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:17.813063 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d17ceea0-9e53-4056-a9a5-1f37906f305e tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:17.813797 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d17ceea0-9e53-4056-a9a5-1f37906f305e tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:17.814502 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d17ceea0-9e53-4056-a9a5-1f37906f305e tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:18.287743 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d17ceea0-9e53-4056-a9a5-1f37906f305e tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87dcc7baf63f4ae6bfe0a099adffd408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7097bc12179446f6a3e1fac8434d5c64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:18.298802 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d17ceea0-9e53-4056-a9a5-1f37906f305e tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] 10.222.0.33 "GET /compute/v2.1/servers/c43e082f-7e3b-49bd-b206-4f3f231750da" status: 200 len: 1514 microversion: 2.1 time: 0.505690 Oct 04 20:45:18.300237 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1250/2568] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:45:17 2022] GET /compute/v2.1/servers/c43e082f-7e3b-49bd-b206-4f3f231750da => generated 1514 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:45:18.305604 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6ac9f75e-cfe8-4d7a-9aaf-ef9906bb4b87 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:18.306537 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-6ac9f75e-cfe8-4d7a-9aaf-ef9906bb4b87 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] [instance: 39d66e18-289f-4674-b66c-146d68ef9133] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:18.315932 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6ac9f75e-cfe8-4d7a-9aaf-ef9906bb4b87 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:18.316423 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6ac9f75e-cfe8-4d7a-9aaf-ef9906bb4b87 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:18.316857 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6ac9f75e-cfe8-4d7a-9aaf-ef9906bb4b87 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:18.317554 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6ac9f75e-cfe8-4d7a-9aaf-ef9906bb4b87 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:18.318006 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6ac9f75e-cfe8-4d7a-9aaf-ef9906bb4b87 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:18.318455 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6ac9f75e-cfe8-4d7a-9aaf-ef9906bb4b87 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:18.340115 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-e0595fc4-66d9-4b35-aeac-386aff560e38 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Flavor limits 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:45:18.341982 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-e0595fc4-66d9-4b35-aeac-386aff560e38 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Image limits 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:45:18.342658 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-e0595fc4-66d9-4b35-aeac-386aff560e38 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Flavor pref 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:45:18.343377 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-e0595fc4-66d9-4b35-aeac-386aff560e38 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Image pref 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:45:18.343996 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-e0595fc4-66d9-4b35-aeac-386aff560e38 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:45:18.356046 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e0595fc4-66d9-4b35-aeac-386aff560e38 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:18.356651 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e0595fc4-66d9-4b35-aeac-386aff560e38 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:18.357181 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e0595fc4-66d9-4b35-aeac-386aff560e38 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:18.358006 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e0595fc4-66d9-4b35-aeac-386aff560e38 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:18.358719 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e0595fc4-66d9-4b35-aeac-386aff560e38 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:18.359329 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e0595fc4-66d9-4b35-aeac-386aff560e38 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:18.384804 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-e0595fc4-66d9-4b35-aeac-386aff560e38 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Getting quotas for project b5f86a1d45a94f41bcd1a73694454a0d. Resources: {'ram', 'instances', 'cores'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:45:18.391429 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-e0595fc4-66d9-4b35-aeac-386aff560e38 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Getting quotas for user c0967736982942f0b62db2e0546666cf and project b5f86a1d45a94f41bcd1a73694454a0d. Resources: {'ram', 'instances', 'cores'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:45:18.399103 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-6ac9f75e-cfe8-4d7a-9aaf-ef9906bb4b87 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:18.416883 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-e0595fc4-66d9-4b35-aeac-386aff560e38 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Going to run 1 instances... {{(pid=128802) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:45:18.420237 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-6ac9f75e-cfe8-4d7a-9aaf-ef9906bb4b87 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:18.421327 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-e0595fc4-66d9-4b35-aeac-386aff560e38 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] [instance: 291474d2-a375-4974-abec-713900c08119] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='15b24725-0c99-4bcf-b1fb-907cdf8e2d63',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128802) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:45:18.421678 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-6ac9f75e-cfe8-4d7a-9aaf-ef9906bb4b87 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:18.437945 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-6ac9f75e-cfe8-4d7a-9aaf-ef9906bb4b87 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] 10.222.0.33 "GET /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133" status: 200 len: 1539 microversion: 2.91 time: 0.136354 Oct 04 20:45:18.439336 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1251/2569] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:45:18 2022] GET /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133 => generated 1539 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:45:18.456238 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6b5b0150-94e5-4bd5-9da6-11c6c2636a53 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:18.457231 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-6b5b0150-94e5-4bd5-9da6-11c6c2636a53 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] [instance: c79c0cc3-17e6-4c35-b17e-c76c9b7e9e39] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:18.464507 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6b5b0150-94e5-4bd5-9da6-11c6c2636a53 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:18.465475 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6b5b0150-94e5-4bd5-9da6-11c6c2636a53 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:18.465890 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6b5b0150-94e5-4bd5-9da6-11c6c2636a53 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:18.466638 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6b5b0150-94e5-4bd5-9da6-11c6c2636a53 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:18.467097 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6b5b0150-94e5-4bd5-9da6-11c6c2636a53 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:18.467516 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6b5b0150-94e5-4bd5-9da6-11c6c2636a53 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:18.534123 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-e0595fc4-66d9-4b35-aeac-386aff560e38 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.859877 Oct 04 20:45:18.535836 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1319/2570] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 20:45:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 862 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 20:45:18.543399 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-e0f41cb9-e1b8-48a4-9239-93b618bb90f5 tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:18.544307 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-e0f41cb9-e1b8-48a4-9239-93b618bb90f5 tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] [instance: 8d3bd4d5-93f3-44f6-ba25-407fe841a180] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:18.563679 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e0f41cb9-e1b8-48a4-9239-93b618bb90f5 tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:18.565106 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e0f41cb9-e1b8-48a4-9239-93b618bb90f5 tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:18.566215 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e0f41cb9-e1b8-48a4-9239-93b618bb90f5 tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:18.567381 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e0f41cb9-e1b8-48a4-9239-93b618bb90f5 tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:18.567811 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e0f41cb9-e1b8-48a4-9239-93b618bb90f5 tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:18.568251 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e0f41cb9-e1b8-48a4-9239-93b618bb90f5 tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:18.730479 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-e0f41cb9-e1b8-48a4-9239-93b618bb90f5 tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e1ca325fc147eaaf49b067ab20cd52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0c55e5899c472a88528599880689cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:18.749535 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-e0f41cb9-e1b8-48a4-9239-93b618bb90f5 tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77e1ca325fc147eaaf49b067ab20cd52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0c55e5899c472a88528599880689cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:18.751389 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-e0f41cb9-e1b8-48a4-9239-93b618bb90f5 tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77e1ca325fc147eaaf49b067ab20cd52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0c55e5899c472a88528599880689cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:18.752970 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-e0f41cb9-e1b8-48a4-9239-93b618bb90f5 tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] 10.222.0.33 "GET /compute/v2.1/servers/8d3bd4d5-93f3-44f6-ba25-407fe841a180" status: 200 len: 1317 microversion: 2.21 time: 0.215767 Oct 04 20:45:18.782372 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1320/2571] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:45:18 2022] GET /compute/v2.1/servers/8d3bd4d5-93f3-44f6-ba25-407fe841a180 => generated 1317 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:45:18.782372 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-29e67a67-63e1-406d-b54f-03f51fc85602 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-1771521304", "imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63", "flavorRef": "452"}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:45:18.868543 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.network.neutron [None req-29e67a67-63e1-406d-b54f-03f51fc85602 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] validate_networks() for None {{(pid=128802) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:45:18.969479 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-6b5b0150-94e5-4bd5-9da6-11c6c2636a53 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aca59cd50bf74a36bb1e4427cd50fbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3fadcd7d4043daa0a6aba27ba814d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:18.975503 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=100 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:45:18.981754 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-6b5b0150-94e5-4bd5-9da6-11c6c2636a53 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] 10.222.0.33 "GET /compute/v2.1/servers/c79c0cc3-17e6-4c35-b17e-c76c9b7e9e39" status: 200 len: 1308 microversion: 2.1 time: 0.538386 Oct 04 20:45:18.988932 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1252/2572] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:45:18 2022] GET /compute/v2.1/servers/c79c0cc3-17e6-4c35-b17e-c76c9b7e9e39 => generated 1308 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:45:19.323983 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b570e630-9fdb-414b-be2d-46bd44bc93aa tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:19.324669 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b570e630-9fdb-414b-be2d-46bd44bc93aa tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] [instance: c43e082f-7e3b-49bd-b206-4f3f231750da] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:19.331732 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b570e630-9fdb-414b-be2d-46bd44bc93aa tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:19.341511 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b570e630-9fdb-414b-be2d-46bd44bc93aa tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:19.344599 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b570e630-9fdb-414b-be2d-46bd44bc93aa tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:19.351612 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b570e630-9fdb-414b-be2d-46bd44bc93aa tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:19.355970 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b570e630-9fdb-414b-be2d-46bd44bc93aa tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:19.356769 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b570e630-9fdb-414b-be2d-46bd44bc93aa tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:19.399523 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-29e67a67-63e1-406d-b54f-03f51fc85602 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Flavor limits 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:45:19.400035 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-29e67a67-63e1-406d-b54f-03f51fc85602 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Image limits 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:45:19.400456 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-29e67a67-63e1-406d-b54f-03f51fc85602 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Flavor pref 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:45:19.400825 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-29e67a67-63e1-406d-b54f-03f51fc85602 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Image pref 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:45:19.401235 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-29e67a67-63e1-406d-b54f-03f51fc85602 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:45:19.417754 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-29e67a67-63e1-406d-b54f-03f51fc85602 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:19.422013 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-29e67a67-63e1-406d-b54f-03f51fc85602 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:19.422803 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-29e67a67-63e1-406d-b54f-03f51fc85602 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:19.423830 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-29e67a67-63e1-406d-b54f-03f51fc85602 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:19.424497 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-29e67a67-63e1-406d-b54f-03f51fc85602 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:19.425162 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-29e67a67-63e1-406d-b54f-03f51fc85602 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:19.471444 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-29e67a67-63e1-406d-b54f-03f51fc85602 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Getting quotas for project b5f86a1d45a94f41bcd1a73694454a0d. Resources: {'ram', 'instances', 'cores'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:45:19.506784 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-b570e630-9fdb-414b-be2d-46bd44bc93aa tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87dcc7baf63f4ae6bfe0a099adffd408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7097bc12179446f6a3e1fac8434d5c64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:19.521353 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-29e67a67-63e1-406d-b54f-03f51fc85602 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Getting quotas for user c0967736982942f0b62db2e0546666cf and project b5f86a1d45a94f41bcd1a73694454a0d. Resources: {'ram', 'instances', 'cores'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:45:19.525760 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b570e630-9fdb-414b-be2d-46bd44bc93aa tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] 10.222.0.33 "GET /compute/v2.1/servers/c43e082f-7e3b-49bd-b206-4f3f231750da" status: 200 len: 1472 microversion: 2.1 time: 0.206428 Oct 04 20:45:19.538504 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1253/2573] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:45:19 2022] GET /compute/v2.1/servers/c43e082f-7e3b-49bd-b206-4f3f231750da => generated 1472 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:45:19.543899 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-1812cd9e-5043-4780-a080-4ae29a52b7aa req-0e0cd8f0-fe94-4bdc-a00e-8476785f4f04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c43e082f-7e3b-49bd-b206-4f3f231750da", "name": "network-vif-deleted", "tag": "b3a9409e-f717-447b-bf77-cf3450976c64"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:45:19.561209 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-1812cd9e-5043-4780-a080-4ae29a52b7aa req-0e0cd8f0-fe94-4bdc-a00e-8476785f4f04 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:19.562981 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-1812cd9e-5043-4780-a080-4ae29a52b7aa req-0e0cd8f0-fe94-4bdc-a00e-8476785f4f04 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:19.567035 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-1812cd9e-5043-4780-a080-4ae29a52b7aa req-0e0cd8f0-fe94-4bdc-a00e-8476785f4f04 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:19.573276 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-29e67a67-63e1-406d-b54f-03f51fc85602 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Going to run 1 instances... {{(pid=128802) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:45:19.578807 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-29e67a67-63e1-406d-b54f-03f51fc85602 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] [instance: 8917de21-2b45-4249-ae17-17f679d4856f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='15b24725-0c99-4bcf-b1fb-907cdf8e2d63',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128802) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:45:19.596711 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-1812cd9e-5043-4780-a080-4ae29a52b7aa req-0e0cd8f0-fe94-4bdc-a00e-8476785f4f04 service nova] Creating event network-vif-deleted:b3a9409e-f717-447b-bf77-cf3450976c64 for instance c43e082f-7e3b-49bd-b206-4f3f231750da on n-h2-854823-8 Oct 04 20:45:19.606045 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-1812cd9e-5043-4780-a080-4ae29a52b7aa req-0e0cd8f0-fe94-4bdc-a00e-8476785f4f04 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065419 Oct 04 20:45:19.607457 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1254/2574] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:45:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:45:19.616780 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a115940d-c07e-4a5f-a730-ecac37c429ef tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:19.621075 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a115940d-c07e-4a5f-a730-ecac37c429ef tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] [instance: 39d66e18-289f-4674-b66c-146d68ef9133] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:19.630166 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a115940d-c07e-4a5f-a730-ecac37c429ef tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:19.630166 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a115940d-c07e-4a5f-a730-ecac37c429ef tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:19.630696 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a115940d-c07e-4a5f-a730-ecac37c429ef tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:19.632135 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a115940d-c07e-4a5f-a730-ecac37c429ef tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:19.632666 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a115940d-c07e-4a5f-a730-ecac37c429ef tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:19.633182 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a115940d-c07e-4a5f-a730-ecac37c429ef tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:19.735492 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-29e67a67-63e1-406d-b54f-03f51fc85602 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.963724 Oct 04 20:45:19.744452 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1321/2575] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 20:45:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 975 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 20:45:19.771688 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-8bbf9108-8d7f-456b-b027-c5f97bd60d79 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:19.773141 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-8bbf9108-8d7f-456b-b027-c5f97bd60d79 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] [instance: 8917de21-2b45-4249-ae17-17f679d4856f] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:19.807558 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-a115940d-c07e-4a5f-a730-ecac37c429ef tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:19.827658 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-a115940d-c07e-4a5f-a730-ecac37c429ef tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:19.829451 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-a115940d-c07e-4a5f-a730-ecac37c429ef tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:19.838017 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a115940d-c07e-4a5f-a730-ecac37c429ef tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] 10.222.0.33 "GET /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133" status: 200 len: 1539 microversion: 2.91 time: 0.227874 Oct 04 20:45:19.838890 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1255/2576] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:45:19 2022] GET /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133 => generated 1539 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:45:19.850234 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-cc78a8e2-8fb6-4a32-b738-78c4f5d02204 tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:19.851235 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-cc78a8e2-8fb6-4a32-b738-78c4f5d02204 tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] [instance: 8d3bd4d5-93f3-44f6-ba25-407fe841a180] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:19.867494 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cc78a8e2-8fb6-4a32-b738-78c4f5d02204 tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:19.868335 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cc78a8e2-8fb6-4a32-b738-78c4f5d02204 tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:19.869110 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cc78a8e2-8fb6-4a32-b738-78c4f5d02204 tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:19.869998 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cc78a8e2-8fb6-4a32-b738-78c4f5d02204 tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:19.874113 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cc78a8e2-8fb6-4a32-b738-78c4f5d02204 tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:19.874877 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cc78a8e2-8fb6-4a32-b738-78c4f5d02204 tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:19.937846 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-8bbf9108-8d7f-456b-b027-c5f97bd60d79 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0967736982942f0b62db2e0546666cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f86a1d45a94f41bcd1a73694454a0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:19.945209 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-8bbf9108-8d7f-456b-b027-c5f97bd60d79 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] 10.222.0.33 "GET /compute/v2.1/servers/8917de21-2b45-4249-ae17-17f679d4856f" status: 200 len: 1218 microversion: 2.1 time: 0.198103 Oct 04 20:45:19.946494 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1322/2577] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:45:19 2022] GET /compute/v2.1/servers/8917de21-2b45-4249-ae17-17f679d4856f => generated 1218 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:45:20.012954 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-2e74fe03-f81f-4084-bca9-64d88241c43b tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:20.013576 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-2e74fe03-f81f-4084-bca9-64d88241c43b tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] [instance: c79c0cc3-17e6-4c35-b17e-c76c9b7e9e39] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:20.032333 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2e74fe03-f81f-4084-bca9-64d88241c43b tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:20.032836 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2e74fe03-f81f-4084-bca9-64d88241c43b tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:20.033655 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2e74fe03-f81f-4084-bca9-64d88241c43b tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:20.034425 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2e74fe03-f81f-4084-bca9-64d88241c43b tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:20.034891 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2e74fe03-f81f-4084-bca9-64d88241c43b tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:20.035315 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2e74fe03-f81f-4084-bca9-64d88241c43b tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:20.285962 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-cc78a8e2-8fb6-4a32-b738-78c4f5d02204 tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e1ca325fc147eaaf49b067ab20cd52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0c55e5899c472a88528599880689cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:20.299741 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-cc78a8e2-8fb6-4a32-b738-78c4f5d02204 tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77e1ca325fc147eaaf49b067ab20cd52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0c55e5899c472a88528599880689cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:20.302871 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-cc78a8e2-8fb6-4a32-b738-78c4f5d02204 tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77e1ca325fc147eaaf49b067ab20cd52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0c55e5899c472a88528599880689cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:20.305276 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-cc78a8e2-8fb6-4a32-b738-78c4f5d02204 tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] 10.222.0.33 "GET /compute/v2.1/servers/8d3bd4d5-93f3-44f6-ba25-407fe841a180" status: 200 len: 1359 microversion: 2.21 time: 0.458722 Oct 04 20:45:20.307189 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1256/2578] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:45:19 2022] GET /compute/v2.1/servers/8d3bd4d5-93f3-44f6-ba25-407fe841a180 => generated 1359 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:45:20.365493 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-2e74fe03-f81f-4084-bca9-64d88241c43b tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aca59cd50bf74a36bb1e4427cd50fbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3fadcd7d4043daa0a6aba27ba814d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:20.378977 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-2e74fe03-f81f-4084-bca9-64d88241c43b tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] 10.222.0.33 "GET /compute/v2.1/servers/c79c0cc3-17e6-4c35-b17e-c76c9b7e9e39" status: 200 len: 1308 microversion: 2.1 time: 0.369971 Oct 04 20:45:20.381138 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1323/2579] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:45:20 2022] GET /compute/v2.1/servers/c79c0cc3-17e6-4c35-b17e-c76c9b7e9e39 => generated 1308 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:45:20.554492 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0e59dd41-ea52-4573-b88b-1dcf6ceb895f tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:20.555224 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-0e59dd41-ea52-4573-b88b-1dcf6ceb895f tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] [instance: c43e082f-7e3b-49bd-b206-4f3f231750da] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:20.564551 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0e59dd41-ea52-4573-b88b-1dcf6ceb895f tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:20.569187 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0e59dd41-ea52-4573-b88b-1dcf6ceb895f tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:20.569745 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0e59dd41-ea52-4573-b88b-1dcf6ceb895f tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:20.570859 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0e59dd41-ea52-4573-b88b-1dcf6ceb895f tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:20.571905 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0e59dd41-ea52-4573-b88b-1dcf6ceb895f tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:20.575390 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0e59dd41-ea52-4573-b88b-1dcf6ceb895f tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:20.647953 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0e59dd41-ea52-4573-b88b-1dcf6ceb895f tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:20.649299 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0e59dd41-ea52-4573-b88b-1dcf6ceb895f tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:20.650512 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0e59dd41-ea52-4573-b88b-1dcf6ceb895f tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:20.651449 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-0e59dd41-ea52-4573-b88b-1dcf6ceb895f tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lazy-loading 'fault' on Instance uuid c43e082f-7e3b-49bd-b206-4f3f231750da {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:45:20.753197 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-0e59dd41-ea52-4573-b88b-1dcf6ceb895f tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87dcc7baf63f4ae6bfe0a099adffd408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7097bc12179446f6a3e1fac8434d5c64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:20.768661 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-0e59dd41-ea52-4573-b88b-1dcf6ceb895f tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] 10.222.0.33 "GET /compute/v2.1/servers/c43e082f-7e3b-49bd-b206-4f3f231750da" status: 200 len: 1318 microversion: 2.1 time: 0.217943 Oct 04 20:45:20.770600 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1257/2580] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:45:20 2022] GET /compute/v2.1/servers/c43e082f-7e3b-49bd-b206-4f3f231750da => generated 1318 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:45:20.871160 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-081fec72-7996-4a14-adca-1f6abf722289 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:20.871707 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-081fec72-7996-4a14-adca-1f6abf722289 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] [instance: 39d66e18-289f-4674-b66c-146d68ef9133] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:20.877871 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-081fec72-7996-4a14-adca-1f6abf722289 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:20.878384 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-081fec72-7996-4a14-adca-1f6abf722289 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:20.878831 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-081fec72-7996-4a14-adca-1f6abf722289 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:20.879533 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-081fec72-7996-4a14-adca-1f6abf722289 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:20.879989 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-081fec72-7996-4a14-adca-1f6abf722289 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:20.880999 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-081fec72-7996-4a14-adca-1f6abf722289 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:20.971655 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a99c0b7f-cfbc-4d41-b065-581fc76fdbac tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:20.972319 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a99c0b7f-cfbc-4d41-b065-581fc76fdbac tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] [instance: 8917de21-2b45-4249-ae17-17f679d4856f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:20.979520 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a99c0b7f-cfbc-4d41-b065-581fc76fdbac tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:20.980008 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a99c0b7f-cfbc-4d41-b065-581fc76fdbac tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:20.980437 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a99c0b7f-cfbc-4d41-b065-581fc76fdbac tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:20.981133 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a99c0b7f-cfbc-4d41-b065-581fc76fdbac tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:20.981611 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a99c0b7f-cfbc-4d41-b065-581fc76fdbac tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:20.982035 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a99c0b7f-cfbc-4d41-b065-581fc76fdbac tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:21.268387 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-081fec72-7996-4a14-adca-1f6abf722289 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:21.277015 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-081fec72-7996-4a14-adca-1f6abf722289 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:21.278475 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-081fec72-7996-4a14-adca-1f6abf722289 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:21.283358 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-081fec72-7996-4a14-adca-1f6abf722289 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] 10.222.0.33 "GET /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133" status: 200 len: 1560 microversion: 2.91 time: 0.416451 Oct 04 20:45:21.283973 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1324/2581] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:45:20 2022] GET /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133 => generated 1560 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:45:21.321465 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-a99c0b7f-cfbc-4d41-b065-581fc76fdbac tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0967736982942f0b62db2e0546666cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f86a1d45a94f41bcd1a73694454a0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:21.329894 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a99c0b7f-cfbc-4d41-b065-581fc76fdbac tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] 10.222.0.33 "GET /compute/v2.1/servers/8917de21-2b45-4249-ae17-17f679d4856f" status: 200 len: 1270 microversion: 2.1 time: 0.361966 Oct 04 20:45:21.345665 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1258/2582] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:45:20 2022] GET /compute/v2.1/servers/8917de21-2b45-4249-ae17-17f679d4856f => generated 1270 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:45:21.345855 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-b5c10572-d8c9-458a-b5a9-198b5bef1bcb tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:21.345855 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-b5c10572-d8c9-458a-b5a9-198b5bef1bcb tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] [instance: 8d3bd4d5-93f3-44f6-ba25-407fe841a180] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:21.345855 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b5c10572-d8c9-458a-b5a9-198b5bef1bcb tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:21.345855 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b5c10572-d8c9-458a-b5a9-198b5bef1bcb tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:21.345855 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b5c10572-d8c9-458a-b5a9-198b5bef1bcb tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:21.345855 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b5c10572-d8c9-458a-b5a9-198b5bef1bcb tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:21.345855 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b5c10572-d8c9-458a-b5a9-198b5bef1bcb tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:21.345855 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b5c10572-d8c9-458a-b5a9-198b5bef1bcb tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:21.405648 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-537f06b3-8bfa-4679-af2d-0d5ec37e0083 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:21.406265 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-537f06b3-8bfa-4679-af2d-0d5ec37e0083 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] [instance: c79c0cc3-17e6-4c35-b17e-c76c9b7e9e39] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:21.412348 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-537f06b3-8bfa-4679-af2d-0d5ec37e0083 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:21.412834 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-537f06b3-8bfa-4679-af2d-0d5ec37e0083 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:21.413271 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-537f06b3-8bfa-4679-af2d-0d5ec37e0083 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:21.413962 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-537f06b3-8bfa-4679-af2d-0d5ec37e0083 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:21.416913 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-537f06b3-8bfa-4679-af2d-0d5ec37e0083 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:21.416913 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-537f06b3-8bfa-4679-af2d-0d5ec37e0083 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:21.686553 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-b5c10572-d8c9-458a-b5a9-198b5bef1bcb tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e1ca325fc147eaaf49b067ab20cd52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0c55e5899c472a88528599880689cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:21.698380 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-b5c10572-d8c9-458a-b5a9-198b5bef1bcb tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77e1ca325fc147eaaf49b067ab20cd52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0c55e5899c472a88528599880689cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:21.700050 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-b5c10572-d8c9-458a-b5a9-198b5bef1bcb tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77e1ca325fc147eaaf49b067ab20cd52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0c55e5899c472a88528599880689cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:21.701444 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-b5c10572-d8c9-458a-b5a9-198b5bef1bcb tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] 10.222.0.33 "GET /compute/v2.1/servers/8d3bd4d5-93f3-44f6-ba25-407fe841a180" status: 200 len: 1359 microversion: 2.21 time: 0.372981 Oct 04 20:45:21.715070 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1325/2583] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:45:21 2022] GET /compute/v2.1/servers/8d3bd4d5-93f3-44f6-ba25-407fe841a180 => generated 1359 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 20:45:21.727846 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-9f016176-6127-4fc4-b3c4-4032ce48eab5 req-771f897f-76a3-4e7c-8124-a99c8cf2e87c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c79c0cc3-17e6-4c35-b17e-c76c9b7e9e39", "tag": "f2fef876-3f0a-43e8-af74-a8f0135c6b3f"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:45:21.737521 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-9f016176-6127-4fc4-b3c4-4032ce48eab5 req-771f897f-76a3-4e7c-8124-a99c8cf2e87c service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:21.738006 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-9f016176-6127-4fc4-b3c4-4032ce48eab5 req-771f897f-76a3-4e7c-8124-a99c8cf2e87c service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:21.738468 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-9f016176-6127-4fc4-b3c4-4032ce48eab5 req-771f897f-76a3-4e7c-8124-a99c8cf2e87c service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:21.750895 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-537f06b3-8bfa-4679-af2d-0d5ec37e0083 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aca59cd50bf74a36bb1e4427cd50fbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3fadcd7d4043daa0a6aba27ba814d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:21.751861 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-9f016176-6127-4fc4-b3c4-4032ce48eab5 req-771f897f-76a3-4e7c-8124-a99c8cf2e87c service nova] Creating event network-changed:f2fef876-3f0a-43e8-af74-a8f0135c6b3f for instance c79c0cc3-17e6-4c35-b17e-c76c9b7e9e39 on n-h2-854823-8 Oct 04 20:45:21.759706 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-9f016176-6127-4fc4-b3c4-4032ce48eab5 req-771f897f-76a3-4e7c-8124-a99c8cf2e87c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043327 Oct 04 20:45:21.760661 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1326/2584] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:45:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:45:21.768254 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-537f06b3-8bfa-4679-af2d-0d5ec37e0083 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] 10.222.0.33 "GET /compute/v2.1/servers/c79c0cc3-17e6-4c35-b17e-c76c9b7e9e39" status: 200 len: 1308 microversion: 2.1 time: 0.366183 Oct 04 20:45:21.770000 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1259/2585] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:45:21 2022] GET /compute/v2.1/servers/c79c0cc3-17e6-4c35-b17e-c76c9b7e9e39 => generated 1308 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:45:21.801239 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-7aa9e468-2757-42c7-8b43-5b3d6a0ea8bb tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:21.801972 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-7aa9e468-2757-42c7-8b43-5b3d6a0ea8bb tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] [instance: c43e082f-7e3b-49bd-b206-4f3f231750da] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:21.816532 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-a3329489-3e97-41fb-b6c0-11cdae117441 req-ae719325-56b0-4d9d-be0b-2e94fdc7f21a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d3bd4d5-93f3-44f6-ba25-407fe841a180", "tag": "af188aff-36f2-4e40-9ac2-436505b0767c"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:45:21.816826 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7aa9e468-2757-42c7-8b43-5b3d6a0ea8bb tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:21.830182 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-a3329489-3e97-41fb-b6c0-11cdae117441 req-ae719325-56b0-4d9d-be0b-2e94fdc7f21a service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:21.830559 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7aa9e468-2757-42c7-8b43-5b3d6a0ea8bb tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:21.831144 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-a3329489-3e97-41fb-b6c0-11cdae117441 req-ae719325-56b0-4d9d-be0b-2e94fdc7f21a service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:21.831414 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7aa9e468-2757-42c7-8b43-5b3d6a0ea8bb tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:21.831759 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-a3329489-3e97-41fb-b6c0-11cdae117441 req-ae719325-56b0-4d9d-be0b-2e94fdc7f21a service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:21.833050 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7aa9e468-2757-42c7-8b43-5b3d6a0ea8bb tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:21.833670 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7aa9e468-2757-42c7-8b43-5b3d6a0ea8bb tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:21.834277 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7aa9e468-2757-42c7-8b43-5b3d6a0ea8bb tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:21.847050 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-a3329489-3e97-41fb-b6c0-11cdae117441 req-ae719325-56b0-4d9d-be0b-2e94fdc7f21a service nova] Creating event network-changed:af188aff-36f2-4e40-9ac2-436505b0767c for instance 8d3bd4d5-93f3-44f6-ba25-407fe841a180 on n-h2-854823-8 Oct 04 20:45:21.852196 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.wsgi [None req-7aa9e468-2757-42c7-8b43-5b3d6a0ea8bb tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] HTTP exception thrown: Instance c43e082f-7e3b-49bd-b206-4f3f231750da could not be found. Oct 04 20:45:21.853570 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-a3329489-3e97-41fb-b6c0-11cdae117441 req-ae719325-56b0-4d9d-be0b-2e94fdc7f21a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041143 Oct 04 20:45:21.853983 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-7aa9e468-2757-42c7-8b43-5b3d6a0ea8bb tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Request method failure captured: Oct 04 20:45:21.853983 n-d-854823-8 devstack@n-api.service[128802]: request: GET /compute/v2.1/servers/c43e082f-7e3b-49bd-b206-4f3f231750da HTTP/1.1 Oct 04 20:45:21.853983 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 20:45:21.853983 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 20:45:21.853983 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 20:45:21.853983 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 0 Oct 04 20:45:21.853983 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 20:45:21.853983 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 20:45:21.853983 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 20:45:21.853983 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 20:45:21.853983 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPJsSwF2ySar2LJQGdSe43g0QAYtjP4_BPyLRwM7Cr4_8Oz_X-RTScy1BL0ogt-qe3YNvQGTaYbVbGoUGx7pHqiHpbZftU7_TcvDA_zpgTfxGGH91CR74RG6crXL2bxRs87dSvsLYuOWMw7_AQjTpWetc1HBlb5th2rD-ko2SN3gLGSA Oct 04 20:45:21.853983 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 20:45:21.853983 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 20:45:21.853983 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 20:45:21.853983 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 20:45:21.853983 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 20:45:21.853983 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 20:45:21.853983 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: 7097bc12179446f6a3e1fac8434d5c64 Oct 04 20:45:21.853983 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-ServersTestJSON-927611194 Oct 04 20:45:21.853983 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 20:45:21.853983 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 20:45:21.853983 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_7097bc12179446f6a3e1fac8434d5c64", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7097bc12179446f6a3e1fac8434d5c64"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7097bc12179446f6a3e1fac8434d5c64"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/7097bc12179446f6a3e1fac8434d5c64"}]}] Oct 04 20:45:21.853983 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-ServersTestJSON-927611194 Oct 04 20:45:21.853983 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: 7097bc12179446f6a3e1fac8434d5c64 Oct 04 20:45:21.853983 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-ServersTestJSON-927611194 Oct 04 20:45:21.853983 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-ServersTestJSON-927611194-project Oct 04 20:45:21.853983 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 20:45:21.853983 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 20:45:21.853983 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: 87dcc7baf63f4ae6bfe0a099adffd408 Oct 04 20:45:21.853983 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-ServersTestJSON-927611194-project Oct 04 20:45:21.853983 n-d-854823-8 devstack@n-api.service[128802]: method: > Oct 04 20:45:21.853983 n-d-854823-8 devstack@n-api.service[128802]: exception: Instance c43e082f-7e3b-49bd-b206-4f3f231750da could not be found. Oct 04 20:45:21.853983 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'id': 'c43e082f-7e3b-49bd-b206-4f3f231750da'} Oct 04 20:45:21.853983 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:45:21.853983 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:45:21.853983 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:45:21.853983 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:45:21.853983 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:45:21.853983 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:45:21.853983 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:45:21.853983 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:45:21.853983 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:45:21.853983 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:45:21.853983 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c43e082f-7e3b-49bd-b206-4f3f231750da could not be found. Oct 04 20:45:21.853983 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:45:21.853983 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:45:21.853983 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:45:21.853983 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:45:21.853983 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:45:21.853983 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:45:21.853983 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:45:21.853983 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:45:21.853983 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:45:21.853983 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:45:21.853983 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:45:21.853983 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:45:21.853983 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:45:21.853983 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:45:21.853983 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:45:21.853983 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:45:21.853983 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c43e082f-7e3b-49bd-b206-4f3f231750da could not be found. Oct 04 20:45:21.853983 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:45:21.853983 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:45:21.853983 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:45:21.853983 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:45:21.857669 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:45:21.857669 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:45:21.857669 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:45:21.857669 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:45:21.857669 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c43e082f-7e3b-49bd-b206-4f3f231750da could not be found. Oct 04 20:45:21.857669 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:45:21.857669 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-7aa9e468-2757-42c7-8b43-5b3d6a0ea8bb tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Returning 404 to user: Instance c43e082f-7e3b-49bd-b206-4f3f231750da could not be found. {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:45:21.857669 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-7aa9e468-2757-42c7-8b43-5b3d6a0ea8bb tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] 10.222.0.33 "GET /compute/v2.1/servers/c43e082f-7e3b-49bd-b206-4f3f231750da" status: 404 len: 111 microversion: 2.1 time: 0.063893 Oct 04 20:45:21.857669 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1327/2586] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:45:21 2022] GET /compute/v2.1/servers/c43e082f-7e3b-49bd-b206-4f3f231750da => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:45:21.859739 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1260/2587] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:45:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 20:45:21.864387 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-e87fa5ab-d7cb-45ce-8f4d-7bb6e0981718 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Calling method '.version_select at 0x7f3c74f4d4c0>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:21.884245 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-e87fa5ab-d7cb-45ce-8f4d-7bb6e0981718 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-key-1018566517" status: 202 len: 0 microversion: 2.1 time: 0.023699 Oct 04 20:45:21.884914 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1328/2588] 10.222.0.33 () {58 vars in 1209 bytes} [Tue Oct 4 20:45:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-key-1018566517 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:45:21.994913 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-39b65489-b936-4894-ac20-adfc28598c37 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-346403381", "imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63", "flavorRef": "452", "networks": [{"uuid": "a32beee4-b00b-48d9-8656-e7b824aeffce"}]}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:45:22.055772 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.network.neutron [None req-39b65489-b936-4894-ac20-adfc28598c37 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] validate_networks() for [('a32beee4-b00b-48d9-8656-e7b824aeffce', None, None, None, None, None)] {{(pid=128801) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:45:22.313231 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-97ec4e86-42b7-4f45-9a1f-9c282cd304b8 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:22.313849 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-97ec4e86-42b7-4f45-9a1f-9c282cd304b8 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] [instance: 39d66e18-289f-4674-b66c-146d68ef9133] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:22.321901 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-97ec4e86-42b7-4f45-9a1f-9c282cd304b8 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:22.322704 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-97ec4e86-42b7-4f45-9a1f-9c282cd304b8 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:22.323300 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-97ec4e86-42b7-4f45-9a1f-9c282cd304b8 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:22.324183 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-97ec4e86-42b7-4f45-9a1f-9c282cd304b8 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:22.325348 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-97ec4e86-42b7-4f45-9a1f-9c282cd304b8 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:22.326094 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-97ec4e86-42b7-4f45-9a1f-9c282cd304b8 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:22.331576 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:45:22.528601 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-97ec4e86-42b7-4f45-9a1f-9c282cd304b8 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:22.542645 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-97ec4e86-42b7-4f45-9a1f-9c282cd304b8 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:22.543925 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-97ec4e86-42b7-4f45-9a1f-9c282cd304b8 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:22.549709 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-97ec4e86-42b7-4f45-9a1f-9c282cd304b8 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] 10.222.0.33 "GET /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133" status: 200 len: 1560 microversion: 2.91 time: 0.241440 Oct 04 20:45:22.559143 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1329/2589] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:45:22 2022] GET /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133 => generated 1560 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:45:22.569345 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-f3e589ff-82d0-4ef4-a16c-d27cc35e7d55 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:22.571173 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-f3e589ff-82d0-4ef4-a16c-d27cc35e7d55 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] [instance: 8917de21-2b45-4249-ae17-17f679d4856f] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:22.580559 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f3e589ff-82d0-4ef4-a16c-d27cc35e7d55 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:22.581242 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f3e589ff-82d0-4ef4-a16c-d27cc35e7d55 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:22.581779 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f3e589ff-82d0-4ef4-a16c-d27cc35e7d55 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:22.582911 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f3e589ff-82d0-4ef4-a16c-d27cc35e7d55 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:22.583483 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f3e589ff-82d0-4ef4-a16c-d27cc35e7d55 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:22.584185 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f3e589ff-82d0-4ef4-a16c-d27cc35e7d55 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:22.721437 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-f3e589ff-82d0-4ef4-a16c-d27cc35e7d55 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0967736982942f0b62db2e0546666cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f86a1d45a94f41bcd1a73694454a0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:22.732010 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-f3e589ff-82d0-4ef4-a16c-d27cc35e7d55 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] 10.222.0.33 "GET /compute/v2.1/servers/8917de21-2b45-4249-ae17-17f679d4856f" status: 200 len: 1276 microversion: 2.1 time: 0.171569 Oct 04 20:45:22.733389 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1330/2590] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:45:22 2022] GET /compute/v2.1/servers/8917de21-2b45-4249-ae17-17f679d4856f => generated 1276 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:45:22.738980 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-d7079996-00d4-4e2f-817f-c71df2a00e60 tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:22.739802 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-d7079996-00d4-4e2f-817f-c71df2a00e60 tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] [instance: 8d3bd4d5-93f3-44f6-ba25-407fe841a180] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:22.746226 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d7079996-00d4-4e2f-817f-c71df2a00e60 tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:22.747407 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d7079996-00d4-4e2f-817f-c71df2a00e60 tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:22.748206 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d7079996-00d4-4e2f-817f-c71df2a00e60 tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:22.749117 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d7079996-00d4-4e2f-817f-c71df2a00e60 tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:22.749573 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d7079996-00d4-4e2f-817f-c71df2a00e60 tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:22.750084 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d7079996-00d4-4e2f-817f-c71df2a00e60 tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:22.766595 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:45:23.186726 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-d7079996-00d4-4e2f-817f-c71df2a00e60 tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e1ca325fc147eaaf49b067ab20cd52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0c55e5899c472a88528599880689cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:23.191211 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-39b65489-b936-4894-ac20-adfc28598c37 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Flavor limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:45:23.191850 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-39b65489-b936-4894-ac20-adfc28598c37 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Image limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:45:23.196139 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-39b65489-b936-4894-ac20-adfc28598c37 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Flavor pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:45:23.196766 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-39b65489-b936-4894-ac20-adfc28598c37 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Image pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:45:23.197343 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-39b65489-b936-4894-ac20-adfc28598c37 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:45:23.211918 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-d7079996-00d4-4e2f-817f-c71df2a00e60 tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77e1ca325fc147eaaf49b067ab20cd52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0c55e5899c472a88528599880689cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:23.215498 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-d7079996-00d4-4e2f-817f-c71df2a00e60 tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77e1ca325fc147eaaf49b067ab20cd52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0c55e5899c472a88528599880689cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:23.216690 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-d7079996-00d4-4e2f-817f-c71df2a00e60 tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] 10.222.0.33 "GET /compute/v2.1/servers/8d3bd4d5-93f3-44f6-ba25-407fe841a180" status: 200 len: 1359 microversion: 2.21 time: 0.482212 Oct 04 20:45:23.218401 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=23 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:45:23.220627 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-39b65489-b936-4894-ac20-adfc28598c37 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:23.221424 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1331/2591] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:45:22 2022] GET /compute/v2.1/servers/8d3bd4d5-93f3-44f6-ba25-407fe841a180 => generated 1359 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:45:23.222081 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-39b65489-b936-4894-ac20-adfc28598c37 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:23.222566 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-39b65489-b936-4894-ac20-adfc28598c37 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:23.227982 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-c6fd0464-4d00-45cf-8089-559289f897c5 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:23.229092 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-39b65489-b936-4894-ac20-adfc28598c37 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:23.229761 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-39b65489-b936-4894-ac20-adfc28598c37 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:23.230403 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-39b65489-b936-4894-ac20-adfc28598c37 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:23.235136 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-c6fd0464-4d00-45cf-8089-559289f897c5 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] [instance: c79c0cc3-17e6-4c35-b17e-c76c9b7e9e39] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:23.250106 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c6fd0464-4d00-45cf-8089-559289f897c5 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:23.253143 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c6fd0464-4d00-45cf-8089-559289f897c5 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:23.254867 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c6fd0464-4d00-45cf-8089-559289f897c5 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:23.256117 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c6fd0464-4d00-45cf-8089-559289f897c5 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:23.257375 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c6fd0464-4d00-45cf-8089-559289f897c5 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:23.261076 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c6fd0464-4d00-45cf-8089-559289f897c5 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:23.279266 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-39b65489-b936-4894-ac20-adfc28598c37 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Getting quotas for project 7097bc12179446f6a3e1fac8434d5c64. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:45:23.293081 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-39b65489-b936-4894-ac20-adfc28598c37 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Getting quotas for user 87dcc7baf63f4ae6bfe0a099adffd408 and project 7097bc12179446f6a3e1fac8434d5c64. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:45:23.322650 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-39b65489-b936-4894-ac20-adfc28598c37 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Going to run 1 instances... {{(pid=128801) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:45:23.328952 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-39b65489-b936-4894-ac20-adfc28598c37 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] [instance: bdfb94ca-ded6-4af0-bd9f-59fc877c4c0a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='15b24725-0c99-4bcf-b1fb-907cdf8e2d63',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128801) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:45:23.347885 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:45:23.400316 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-39b65489-b936-4894-ac20-adfc28598c37 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.409644 Oct 04 20:45:23.407783 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1261/2592] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 20:45:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 1417 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 20:45:23.413003 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-399c323e-e11c-4a61-a112-543451e7e161 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:23.413707 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-399c323e-e11c-4a61-a112-543451e7e161 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] [instance: bdfb94ca-ded6-4af0-bd9f-59fc877c4c0a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:23.580923 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-399c323e-e11c-4a61-a112-543451e7e161 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87dcc7baf63f4ae6bfe0a099adffd408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7097bc12179446f6a3e1fac8434d5c64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:23.593495 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-399c323e-e11c-4a61-a112-543451e7e161 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] 10.222.0.33 "GET /compute/v2.1/servers/bdfb94ca-ded6-4af0-bd9f-59fc877c4c0a" status: 200 len: 1208 microversion: 2.1 time: 0.184133 Oct 04 20:45:23.602320 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1262/2593] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:45:23 2022] GET /compute/v2.1/servers/bdfb94ca-ded6-4af0-bd9f-59fc877c4c0a => generated 1208 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:45:23.616317 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-305622ae-1b07-4216-bae8-859adca52275 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:23.618667 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-305622ae-1b07-4216-bae8-859adca52275 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] [instance: 39d66e18-289f-4674-b66c-146d68ef9133] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:23.636785 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-305622ae-1b07-4216-bae8-859adca52275 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:23.637233 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-305622ae-1b07-4216-bae8-859adca52275 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:23.639815 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-c6fd0464-4d00-45cf-8089-559289f897c5 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aca59cd50bf74a36bb1e4427cd50fbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3fadcd7d4043daa0a6aba27ba814d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:23.640926 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-305622ae-1b07-4216-bae8-859adca52275 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:23.641794 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-305622ae-1b07-4216-bae8-859adca52275 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:23.642995 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-305622ae-1b07-4216-bae8-859adca52275 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:23.643893 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-305622ae-1b07-4216-bae8-859adca52275 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:23.652631 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-c6fd0464-4d00-45cf-8089-559289f897c5 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] 10.222.0.33 "GET /compute/v2.1/servers/c79c0cc3-17e6-4c35-b17e-c76c9b7e9e39" status: 200 len: 1308 microversion: 2.1 time: 0.428650 Oct 04 20:45:23.653494 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1332/2594] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:45:23 2022] GET /compute/v2.1/servers/c79c0cc3-17e6-4c35-b17e-c76c9b7e9e39 => generated 1308 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:45:23.756800 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-8de97604-aab5-46a3-86ea-37b66a6fec76 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:23.757427 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-8de97604-aab5-46a3-86ea-37b66a6fec76 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] [instance: 8917de21-2b45-4249-ae17-17f679d4856f] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:23.767835 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8de97604-aab5-46a3-86ea-37b66a6fec76 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:23.768340 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8de97604-aab5-46a3-86ea-37b66a6fec76 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:23.768880 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8de97604-aab5-46a3-86ea-37b66a6fec76 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:23.773795 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8de97604-aab5-46a3-86ea-37b66a6fec76 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:23.774955 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8de97604-aab5-46a3-86ea-37b66a6fec76 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:23.775801 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8de97604-aab5-46a3-86ea-37b66a6fec76 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:23.776667 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-305622ae-1b07-4216-bae8-859adca52275 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:23.789848 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-305622ae-1b07-4216-bae8-859adca52275 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:23.792630 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-305622ae-1b07-4216-bae8-859adca52275 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:23.799194 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-305622ae-1b07-4216-bae8-859adca52275 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] 10.222.0.33 "GET /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133" status: 200 len: 1560 microversion: 2.91 time: 0.195417 Oct 04 20:45:23.801188 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1263/2595] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:45:23 2022] GET /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133 => generated 1560 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:45:23.824660 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2d608e47-f450-45e3-a70b-7eb75d3fb00d tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:23.825497 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-2d608e47-f450-45e3-a70b-7eb75d3fb00d tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] [instance: 07fdb076-59a4-4c77-a42b-07fa92bcf408] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:23.833066 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2d608e47-f450-45e3-a70b-7eb75d3fb00d tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:23.833946 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2d608e47-f450-45e3-a70b-7eb75d3fb00d tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:23.834586 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2d608e47-f450-45e3-a70b-7eb75d3fb00d tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:23.835527 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2d608e47-f450-45e3-a70b-7eb75d3fb00d tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:23.836178 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2d608e47-f450-45e3-a70b-7eb75d3fb00d tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:23.836832 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2d608e47-f450-45e3-a70b-7eb75d3fb00d tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:23.877795 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-2d608e47-f450-45e3-a70b-7eb75d3fb00d tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] 10.222.0.33 "GET /compute/v2.1/servers/07fdb076-59a4-4c77-a42b-07fa92bcf408/ips" status: 200 len: 150 microversion: 2.1 time: 0.074412 Oct 04 20:45:23.882669 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1264/2596] 10.222.0.33 () {58 vars in 1248 bytes} [Tue Oct 4 20:45:23 2022] GET /compute/v2.1/servers/07fdb076-59a4-4c77-a42b-07fa92bcf408/ips => generated 150 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:45:23.897524 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b8a0bb50-cb64-4daf-9a11-06c3d063b378 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5b1a385d-80d1-4f7a-bf6d-29b6df8272f1"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:45:23.902223 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b8a0bb50-cb64-4daf-9a11-06c3d063b378 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] [instance: 07fdb076-59a4-4c77-a42b-07fa92bcf408] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:23.911095 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b8a0bb50-cb64-4daf-9a11-06c3d063b378 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:23.911979 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b8a0bb50-cb64-4daf-9a11-06c3d063b378 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:23.912635 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b8a0bb50-cb64-4daf-9a11-06c3d063b378 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:23.913666 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b8a0bb50-cb64-4daf-9a11-06c3d063b378 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:23.915572 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b8a0bb50-cb64-4daf-9a11-06c3d063b378 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:23.916091 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b8a0bb50-cb64-4daf-9a11-06c3d063b378 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:24.078384 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-b8a0bb50-cb64-4daf-9a11-06c3d063b378 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] HTTP exception thrown: Invalid volume: volume 5b1a385d-80d1-4f7a-bf6d-29b6df8272f1 is already attached to instances: d849cb42-dfe6-4225-814a-90bef2839739 Oct 04 20:45:24.094954 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b8a0bb50-cb64-4daf-9a11-06c3d063b378 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Request method failure captured: Oct 04 20:45:24.094954 n-d-854823-8 devstack@n-api.service[128801]: request: POST /compute/v2.1/servers/07fdb076-59a4-4c77-a42b-07fa92bcf408/os-volume_attachments HTTP/1.1 Oct 04 20:45:24.094954 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:45:24.094954 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:45:24.094954 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:45:24.094954 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 74 Oct 04 20:45:24.094954 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:45:24.094954 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:45:24.094954 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:45:24.094954 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:45:24.094954 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJq81PAuDsDZpxdj7sHNmNgvbOtGh6iX1oPKSmvHZUw9x7ULWvp7QM5iDniQ-MHWL89bpVZnLKWftCcZuFrmOzCFwz5uJr5u54napWSUn77riQgg7pFlU7FKzu5ArjbUA7EV4GWtihdoiqsY9U5RhjRJWZh-5HATJMChglPcLjaAY6g Oct 04 20:45:24.094954 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:45:24.094954 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:45:24.094954 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:45:24.094954 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:45:24.094954 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:45:24.094954 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:45:24.094954 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: fc7f38600b5041ad8e66a12d77b940fa Oct 04 20:45:24.094954 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-AttachVolumeNegativeTest-16853026 Oct 04 20:45:24.094954 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 20:45:24.094954 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 20:45:24.094954 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_fc7f38600b5041ad8e66a12d77b940fa", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fc7f38600b5041ad8e66a12d77b940fa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fc7f38600b5041ad8e66a12d77b940fa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/fc7f38600b5041ad8e66a12d77b940fa"}]}] Oct 04 20:45:24.094954 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-AttachVolumeNegativeTest-16853026 Oct 04 20:45:24.094954 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: fc7f38600b5041ad8e66a12d77b940fa Oct 04 20:45:24.094954 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-16853026 Oct 04 20:45:24.094954 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-AttachVolumeNegativeTest-16853026-project Oct 04 20:45:24.094954 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:45:24.094954 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:45:24.094954 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: d9e4b00964014a0383f79597652bd428 Oct 04 20:45:24.094954 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-AttachVolumeNegativeTest-16853026-project Oct 04 20:45:24.094954 n-d-854823-8 devstack@n-api.service[128801]: Oct 04 20:45:24.094954 n-d-854823-8 devstack@n-api.service[128801]: {"volumeAttachment": {"volumeId": "5b1a385d-80d1-4f7a-bf6d-29b6df8272f1"}} Oct 04 20:45:24.094954 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 20:45:24.094954 n-d-854823-8 devstack@n-api.service[128801]: exception: Invalid volume: volume 5b1a385d-80d1-4f7a-bf6d-29b6df8272f1 is already attached to instances: d849cb42-dfe6-4225-814a-90bef2839739 Oct 04 20:45:24.094954 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'server_id': '07fdb076-59a4-4c77-a42b-07fa92bcf408', 'body': {'volumeAttachment': {'volumeId': '5b1a385d-80d1-4f7a-bf6d-29b6df8272f1'}}} Oct 04 20:45:24.094954 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:45:24.094954 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:45:24.094954 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 04 20:45:24.094954 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 04 20:45:24.094954 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 20:45:24.094954 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 20:45:24.094954 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 04 20:45:24.094954 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 04 20:45:24.094954 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 04 20:45:24.094954 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 04 20:45:24.094954 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 04 20:45:24.094954 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 04 20:45:24.094954 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 5b1a385d-80d1-4f7a-bf6d-29b6df8272f1 is already attached to instances: d849cb42-dfe6-4225-814a-90bef2839739 Oct 04 20:45:24.094954 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:45:24.094954 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:45:24.094954 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:45:24.094954 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:45:24.094954 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:45:24.094954 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:45:24.094954 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:45:24.094954 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:45:24.094954 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:45:24.094954 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:45:24.094954 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:45:24.094954 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:45:24.094954 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:45:24.094954 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:45:24.100037 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:45:24.100037 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:45:24.100037 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 04 20:45:24.100037 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 04 20:45:24.100037 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 5b1a385d-80d1-4f7a-bf6d-29b6df8272f1 is already attached to instances: d849cb42-dfe6-4225-814a-90bef2839739 Oct 04 20:45:24.100037 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:45:24.100037 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:45:24.100037 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:45:24.100037 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:45:24.100037 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:45:24.100037 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:45:24.100037 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:45:24.100037 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:45:24.100037 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 5b1a385d-80d1-4f7a-bf6d-29b6df8272f1 is already attached to instances: d849cb42-dfe6-4225-814a-90bef2839739 Oct 04 20:45:24.100037 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:45:24.100037 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b8a0bb50-cb64-4daf-9a11-06c3d063b378 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Returning 400 to user: Invalid volume: volume 5b1a385d-80d1-4f7a-bf6d-29b6df8272f1 is already attached to instances: d849cb42-dfe6-4225-814a-90bef2839739 {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:45:24.104085 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b8a0bb50-cb64-4daf-9a11-06c3d063b378 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] 10.222.0.33 "POST /compute/v2.1/servers/07fdb076-59a4-4c77-a42b-07fa92bcf408/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.211563 Oct 04 20:45:24.108065 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1265/2597] 10.222.0.33 () {60 vars in 1323 bytes} [Tue Oct 4 20:45:23 2022] POST /compute/v2.1/servers/07fdb076-59a4-4c77-a42b-07fa92bcf408/os-volume_attachments => generated 174 bytes in 214 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 20:45:24.115442 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-cc950c85-1167-497a-bd89-cc15ac706fe2 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:24.115948 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-cc950c85-1167-497a-bd89-cc15ac706fe2 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] [instance: 07fdb076-59a4-4c77-a42b-07fa92bcf408] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:24.120434 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-8de97604-aab5-46a3-86ea-37b66a6fec76 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0967736982942f0b62db2e0546666cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f86a1d45a94f41bcd1a73694454a0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:24.131615 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-8de97604-aab5-46a3-86ea-37b66a6fec76 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] 10.222.0.33 "GET /compute/v2.1/servers/8917de21-2b45-4249-ae17-17f679d4856f" status: 200 len: 1318 microversion: 2.1 time: 0.379851 Oct 04 20:45:24.132476 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1333/2598] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:45:23 2022] GET /compute/v2.1/servers/8917de21-2b45-4249-ae17-17f679d4856f => generated 1318 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:45:24.150332 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cc950c85-1167-497a-bd89-cc15ac706fe2 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:24.150868 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cc950c85-1167-497a-bd89-cc15ac706fe2 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:24.151877 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cc950c85-1167-497a-bd89-cc15ac706fe2 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:24.152139 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cc950c85-1167-497a-bd89-cc15ac706fe2 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:24.152606 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cc950c85-1167-497a-bd89-cc15ac706fe2 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:24.153036 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cc950c85-1167-497a-bd89-cc15ac706fe2 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:24.184963 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-cc950c85-1167-497a-bd89-cc15ac706fe2 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] [instance: 07fdb076-59a4-4c77-a42b-07fa92bcf408] Going to try to terminate instance {{(pid=128801) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:45:24.247529 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-d0e2a6a3-7499-4125-b595-fcdb9aed588e tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:24.248070 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-d0e2a6a3-7499-4125-b595-fcdb9aed588e tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] [instance: 8d3bd4d5-93f3-44f6-ba25-407fe841a180] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:24.256137 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d0e2a6a3-7499-4125-b595-fcdb9aed588e tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:24.256625 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d0e2a6a3-7499-4125-b595-fcdb9aed588e tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:24.257116 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d0e2a6a3-7499-4125-b595-fcdb9aed588e tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:24.258583 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d0e2a6a3-7499-4125-b595-fcdb9aed588e tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:24.263097 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d0e2a6a3-7499-4125-b595-fcdb9aed588e tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:24.263835 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d0e2a6a3-7499-4125-b595-fcdb9aed588e tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:24.321996 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-cc950c85-1167-497a-bd89-cc15ac706fe2 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] 10.222.0.33 "DELETE /compute/v2.1/servers/07fdb076-59a4-4c77-a42b-07fa92bcf408" status: 204 len: 0 microversion: 2.1 time: 0.210841 Oct 04 20:45:24.323390 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1266/2599] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 20:45:24 2022] DELETE /compute/v2.1/servers/07fdb076-59a4-4c77-a42b-07fa92bcf408 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 20:45:24.342310 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8a8c8601-be0e-4a24-b2f1-4c45e50ebdd4 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:24.343304 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-8a8c8601-be0e-4a24-b2f1-4c45e50ebdd4 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] [instance: 07fdb076-59a4-4c77-a42b-07fa92bcf408] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:24.356063 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8a8c8601-be0e-4a24-b2f1-4c45e50ebdd4 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:24.356563 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8a8c8601-be0e-4a24-b2f1-4c45e50ebdd4 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:24.357981 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8a8c8601-be0e-4a24-b2f1-4c45e50ebdd4 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:24.358740 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8a8c8601-be0e-4a24-b2f1-4c45e50ebdd4 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:24.359370 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8a8c8601-be0e-4a24-b2f1-4c45e50ebdd4 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:24.359953 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8a8c8601-be0e-4a24-b2f1-4c45e50ebdd4 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:24.652698 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-d0e2a6a3-7499-4125-b595-fcdb9aed588e tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e1ca325fc147eaaf49b067ab20cd52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0c55e5899c472a88528599880689cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:24.661536 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-d0e2a6a3-7499-4125-b595-fcdb9aed588e tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77e1ca325fc147eaaf49b067ab20cd52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0c55e5899c472a88528599880689cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:24.667464 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-d0e2a6a3-7499-4125-b595-fcdb9aed588e tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77e1ca325fc147eaaf49b067ab20cd52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0c55e5899c472a88528599880689cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:24.669260 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-d0e2a6a3-7499-4125-b595-fcdb9aed588e tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] 10.222.0.33 "GET /compute/v2.1/servers/8d3bd4d5-93f3-44f6-ba25-407fe841a180" status: 200 len: 1359 microversion: 2.21 time: 0.425746 Oct 04 20:45:24.677216 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-8a8c8601-be0e-4a24-b2f1-4c45e50ebdd4 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e4b00964014a0383f79597652bd428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7f38600b5041ad8e66a12d77b940fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:24.677386 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1334/2600] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:45:24 2022] GET /compute/v2.1/servers/8d3bd4d5-93f3-44f6-ba25-407fe841a180 => generated 1359 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 20:45:24.692870 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-8a8c8601-be0e-4a24-b2f1-4c45e50ebdd4 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] 10.222.0.33 "GET /compute/v2.1/servers/07fdb076-59a4-4c77-a42b-07fa92bcf408" status: 200 len: 1681 microversion: 2.1 time: 0.362275 Oct 04 20:45:24.693583 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-9cf81e4b-75ab-43c4-8d50-3908c998500a tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:24.694379 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-9cf81e4b-75ab-43c4-8d50-3908c998500a tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] [instance: bdfb94ca-ded6-4af0-bd9f-59fc877c4c0a] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:24.698683 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1267/2601] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:45:24 2022] GET /compute/v2.1/servers/07fdb076-59a4-4c77-a42b-07fa92bcf408 => generated 1681 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:45:24.705146 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-640ffc91-a153-424c-85a5-a0552aa4a611 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:24.705984 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-640ffc91-a153-424c-85a5-a0552aa4a611 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] [instance: c79c0cc3-17e6-4c35-b17e-c76c9b7e9e39] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:24.710559 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9cf81e4b-75ab-43c4-8d50-3908c998500a tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:24.712691 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9cf81e4b-75ab-43c4-8d50-3908c998500a tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:24.714228 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9cf81e4b-75ab-43c4-8d50-3908c998500a tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:24.715597 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9cf81e4b-75ab-43c4-8d50-3908c998500a tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:24.717223 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9cf81e4b-75ab-43c4-8d50-3908c998500a tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:24.718529 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9cf81e4b-75ab-43c4-8d50-3908c998500a tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:24.723375 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-640ffc91-a153-424c-85a5-a0552aa4a611 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:24.724456 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-640ffc91-a153-424c-85a5-a0552aa4a611 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:24.725042 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-640ffc91-a153-424c-85a5-a0552aa4a611 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:24.726066 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-640ffc91-a153-424c-85a5-a0552aa4a611 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:24.726774 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-640ffc91-a153-424c-85a5-a0552aa4a611 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:24.727367 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-640ffc91-a153-424c-85a5-a0552aa4a611 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:24.865099 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-9cf81e4b-75ab-43c4-8d50-3908c998500a tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87dcc7baf63f4ae6bfe0a099adffd408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7097bc12179446f6a3e1fac8434d5c64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:24.891719 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-9cf81e4b-75ab-43c4-8d50-3908c998500a tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] 10.222.0.33 "GET /compute/v2.1/servers/bdfb94ca-ded6-4af0-bd9f-59fc877c4c0a" status: 200 len: 1260 microversion: 2.1 time: 0.212484 Oct 04 20:45:24.893837 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1335/2602] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:45:24 2022] GET /compute/v2.1/servers/bdfb94ca-ded6-4af0-bd9f-59fc877c4c0a => generated 1260 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:45:24.911422 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-c2a0d767-7364-417f-8802-bc4116839d03 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:24.912442 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-c2a0d767-7364-417f-8802-bc4116839d03 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] [instance: 39d66e18-289f-4674-b66c-146d68ef9133] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:24.923092 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c2a0d767-7364-417f-8802-bc4116839d03 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:24.924230 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c2a0d767-7364-417f-8802-bc4116839d03 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:24.924995 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c2a0d767-7364-417f-8802-bc4116839d03 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:24.926445 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c2a0d767-7364-417f-8802-bc4116839d03 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:24.927192 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c2a0d767-7364-417f-8802-bc4116839d03 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:24.927838 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c2a0d767-7364-417f-8802-bc4116839d03 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:24.982793 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-640ffc91-a153-424c-85a5-a0552aa4a611 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aca59cd50bf74a36bb1e4427cd50fbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3fadcd7d4043daa0a6aba27ba814d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:25.000024 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-640ffc91-a153-424c-85a5-a0552aa4a611 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] 10.222.0.33 "GET /compute/v2.1/servers/c79c0cc3-17e6-4c35-b17e-c76c9b7e9e39" status: 200 len: 1308 microversion: 2.1 time: 0.299773 Oct 04 20:45:25.001349 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1268/2603] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:45:24 2022] GET /compute/v2.1/servers/c79c0cc3-17e6-4c35-b17e-c76c9b7e9e39 => generated 1308 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:45:25.020026 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-b9489435-e944-4fc6-b449-4eb2bdd1effd req-8f059c84-a4e2-496d-816c-b1c6c9df5bc3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "291474d2-a375-4974-abec-713900c08119", "tag": "744df6f8-0df8-4ff2-b842-56de1314bff3"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:45:25.032016 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-b9489435-e944-4fc6-b449-4eb2bdd1effd req-8f059c84-a4e2-496d-816c-b1c6c9df5bc3 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:25.032850 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-b9489435-e944-4fc6-b449-4eb2bdd1effd req-8f059c84-a4e2-496d-816c-b1c6c9df5bc3 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:25.033450 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-b9489435-e944-4fc6-b449-4eb2bdd1effd req-8f059c84-a4e2-496d-816c-b1c6c9df5bc3 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:25.049999 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-b9489435-e944-4fc6-b449-4eb2bdd1effd req-8f059c84-a4e2-496d-816c-b1c6c9df5bc3 service nova] Creating event network-changed:744df6f8-0df8-4ff2-b842-56de1314bff3 for instance 291474d2-a375-4974-abec-713900c08119 on n-h1-854823-8 Oct 04 20:45:25.057000 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-b9489435-e944-4fc6-b449-4eb2bdd1effd req-8f059c84-a4e2-496d-816c-b1c6c9df5bc3 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052161 Oct 04 20:45:25.057693 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1269/2604] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:45:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:45:25.078511 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-c2a0d767-7364-417f-8802-bc4116839d03 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:25.089727 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-c2a0d767-7364-417f-8802-bc4116839d03 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:25.091879 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-c2a0d767-7364-417f-8802-bc4116839d03 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:25.100000 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-c2a0d767-7364-417f-8802-bc4116839d03 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] 10.222.0.33 "GET /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133" status: 200 len: 1555 microversion: 2.91 time: 0.204580 Oct 04 20:45:25.100601 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1336/2605] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:45:24 2022] GET /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133 => generated 1555 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:45:25.157485 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-33f839d8-bcc8-4d00-9ba4-879b30562c2d tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:25.159051 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-33f839d8-bcc8-4d00-9ba4-879b30562c2d tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] [instance: 8917de21-2b45-4249-ae17-17f679d4856f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:25.187484 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-33f839d8-bcc8-4d00-9ba4-879b30562c2d tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:25.188684 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-33f839d8-bcc8-4d00-9ba4-879b30562c2d tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:25.189367 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-33f839d8-bcc8-4d00-9ba4-879b30562c2d tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:25.191072 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-33f839d8-bcc8-4d00-9ba4-879b30562c2d tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:25.191777 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-33f839d8-bcc8-4d00-9ba4-879b30562c2d tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:25.192506 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-33f839d8-bcc8-4d00-9ba4-879b30562c2d tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:25.386832 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-33f839d8-bcc8-4d00-9ba4-879b30562c2d tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0967736982942f0b62db2e0546666cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f86a1d45a94f41bcd1a73694454a0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:25.397077 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-33f839d8-bcc8-4d00-9ba4-879b30562c2d tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] 10.222.0.33 "GET /compute/v2.1/servers/8917de21-2b45-4249-ae17-17f679d4856f" status: 200 len: 1318 microversion: 2.1 time: 0.245093 Oct 04 20:45:25.400641 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1270/2606] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:45:25 2022] GET /compute/v2.1/servers/8917de21-2b45-4249-ae17-17f679d4856f => generated 1318 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:45:25.529155 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-f8ad534d-4c86-4d98-a931-7042d680b31a req-9110f2d8-7e63-4472-8392-18b910995a92 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8917de21-2b45-4249-ae17-17f679d4856f", "tag": "ec043ecd-8aa4-4125-9877-75f2ddd3f7ee"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:45:25.573658 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-f8ad534d-4c86-4d98-a931-7042d680b31a req-9110f2d8-7e63-4472-8392-18b910995a92 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:25.586374 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-f8ad534d-4c86-4d98-a931-7042d680b31a req-9110f2d8-7e63-4472-8392-18b910995a92 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:25.587353 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-f8ad534d-4c86-4d98-a931-7042d680b31a req-9110f2d8-7e63-4472-8392-18b910995a92 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:25.610895 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-f8ad534d-4c86-4d98-a931-7042d680b31a req-9110f2d8-7e63-4472-8392-18b910995a92 service nova] Creating event network-changed:ec043ecd-8aa4-4125-9877-75f2ddd3f7ee for instance 8917de21-2b45-4249-ae17-17f679d4856f on n-h2-854823-8 Oct 04 20:45:25.629963 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-f8ad534d-4c86-4d98-a931-7042d680b31a req-9110f2d8-7e63-4472-8392-18b910995a92 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107756 Oct 04 20:45:25.631568 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1337/2607] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:45:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:45:25.679415 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-9adc7bbe-aa74-48bb-8ef8-93f1711a82b5 req-e4ecf66d-f72a-43e7-aa2c-d7e84a4fc9d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c79c0cc3-17e6-4c35-b17e-c76c9b7e9e39", "name": "network-vif-plugged", "status": "completed", "tag": "f2fef876-3f0a-43e8-af74-a8f0135c6b3f"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:45:25.720722 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-433eb4ae-f835-4acd-804f-126d44b9a1ae tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:25.722783 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-433eb4ae-f835-4acd-804f-126d44b9a1ae tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] [instance: 8d3bd4d5-93f3-44f6-ba25-407fe841a180] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:25.725785 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:45:25.735064 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-433eb4ae-f835-4acd-804f-126d44b9a1ae tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:25.736044 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-433eb4ae-f835-4acd-804f-126d44b9a1ae tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:25.740896 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-433eb4ae-f835-4acd-804f-126d44b9a1ae tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:25.742143 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-433eb4ae-f835-4acd-804f-126d44b9a1ae tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:25.743073 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-433eb4ae-f835-4acd-804f-126d44b9a1ae tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:25.743673 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-433eb4ae-f835-4acd-804f-126d44b9a1ae tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:25.747569 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-9adc7bbe-aa74-48bb-8ef8-93f1711a82b5 req-e4ecf66d-f72a-43e7-aa2c-d7e84a4fc9d4 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:25.749799 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-9adc7bbe-aa74-48bb-8ef8-93f1711a82b5 req-e4ecf66d-f72a-43e7-aa2c-d7e84a4fc9d4 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:25.750219 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-9adc7bbe-aa74-48bb-8ef8-93f1711a82b5 req-e4ecf66d-f72a-43e7-aa2c-d7e84a4fc9d4 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:25.806493 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-9adc7bbe-aa74-48bb-8ef8-93f1711a82b5 req-e4ecf66d-f72a-43e7-aa2c-d7e84a4fc9d4 service nova] Creating event network-vif-plugged:f2fef876-3f0a-43e8-af74-a8f0135c6b3f for instance c79c0cc3-17e6-4c35-b17e-c76c9b7e9e39 on n-h2-854823-8 Oct 04 20:45:25.820520 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-9adc7bbe-aa74-48bb-8ef8-93f1711a82b5 req-e4ecf66d-f72a-43e7-aa2c-d7e84a4fc9d4 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.145968 Oct 04 20:45:25.824846 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1271/2608] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:45:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:45:25.842001 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0a7c1b9a-0dc4-407a-9eee-cdbe332664ad tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:25.843032 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-0a7c1b9a-0dc4-407a-9eee-cdbe332664ad tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] [instance: 07fdb076-59a4-4c77-a42b-07fa92bcf408] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:25.867248 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0a7c1b9a-0dc4-407a-9eee-cdbe332664ad tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:25.867832 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0a7c1b9a-0dc4-407a-9eee-cdbe332664ad tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:25.868643 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0a7c1b9a-0dc4-407a-9eee-cdbe332664ad tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:25.869532 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0a7c1b9a-0dc4-407a-9eee-cdbe332664ad tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:25.870154 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0a7c1b9a-0dc4-407a-9eee-cdbe332664ad tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:25.870775 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0a7c1b9a-0dc4-407a-9eee-cdbe332664ad tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:25.875598 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:45:26.201400 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-433eb4ae-f835-4acd-804f-126d44b9a1ae tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e1ca325fc147eaaf49b067ab20cd52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0c55e5899c472a88528599880689cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:26.212044 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-433eb4ae-f835-4acd-804f-126d44b9a1ae tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77e1ca325fc147eaaf49b067ab20cd52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0c55e5899c472a88528599880689cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:26.213626 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-433eb4ae-f835-4acd-804f-126d44b9a1ae tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77e1ca325fc147eaaf49b067ab20cd52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0c55e5899c472a88528599880689cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:26.214817 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-433eb4ae-f835-4acd-804f-126d44b9a1ae tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] 10.222.0.33 "GET /compute/v2.1/servers/8d3bd4d5-93f3-44f6-ba25-407fe841a180" status: 200 len: 1359 microversion: 2.21 time: 0.518057 Oct 04 20:45:26.230791 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1338/2609] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:45:25 2022] GET /compute/v2.1/servers/8d3bd4d5-93f3-44f6-ba25-407fe841a180 => generated 1359 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 20:45:26.235713 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-d5fa5fdd-a12d-4f26-ad58-e3f97b2d1653 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:26.236592 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-d5fa5fdd-a12d-4f26-ad58-e3f97b2d1653 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] [instance: bdfb94ca-ded6-4af0-bd9f-59fc877c4c0a] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:26.249888 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d5fa5fdd-a12d-4f26-ad58-e3f97b2d1653 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:26.250432 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d5fa5fdd-a12d-4f26-ad58-e3f97b2d1653 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:26.251015 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d5fa5fdd-a12d-4f26-ad58-e3f97b2d1653 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:26.251741 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d5fa5fdd-a12d-4f26-ad58-e3f97b2d1653 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:26.252203 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d5fa5fdd-a12d-4f26-ad58-e3f97b2d1653 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:26.252632 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d5fa5fdd-a12d-4f26-ad58-e3f97b2d1653 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:26.336514 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-0a7c1b9a-0dc4-407a-9eee-cdbe332664ad tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e4b00964014a0383f79597652bd428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7f38600b5041ad8e66a12d77b940fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:26.349762 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-0a7c1b9a-0dc4-407a-9eee-cdbe332664ad tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] 10.222.0.33 "GET /compute/v2.1/servers/07fdb076-59a4-4c77-a42b-07fa92bcf408" status: 200 len: 1681 microversion: 2.1 time: 0.523474 Oct 04 20:45:26.350381 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1272/2610] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:45:25 2022] GET /compute/v2.1/servers/07fdb076-59a4-4c77-a42b-07fa92bcf408 => generated 1681 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:45:26.361644 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-57d966da-f91f-4132-b4f2-52160146765b tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:26.363198 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-57d966da-f91f-4132-b4f2-52160146765b tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] [instance: c79c0cc3-17e6-4c35-b17e-c76c9b7e9e39] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:26.379655 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-57d966da-f91f-4132-b4f2-52160146765b tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:26.380409 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-57d966da-f91f-4132-b4f2-52160146765b tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:26.381294 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-57d966da-f91f-4132-b4f2-52160146765b tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:26.382191 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-57d966da-f91f-4132-b4f2-52160146765b tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:26.383029 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-57d966da-f91f-4132-b4f2-52160146765b tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:26.383905 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-57d966da-f91f-4132-b4f2-52160146765b tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:26.420889 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-d5fa5fdd-a12d-4f26-ad58-e3f97b2d1653 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87dcc7baf63f4ae6bfe0a099adffd408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7097bc12179446f6a3e1fac8434d5c64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:26.429852 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-d5fa5fdd-a12d-4f26-ad58-e3f97b2d1653 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] 10.222.0.33 "GET /compute/v2.1/servers/bdfb94ca-ded6-4af0-bd9f-59fc877c4c0a" status: 200 len: 1260 microversion: 2.1 time: 0.197778 Oct 04 20:45:26.430513 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1339/2611] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:45:26 2022] GET /compute/v2.1/servers/bdfb94ca-ded6-4af0-bd9f-59fc877c4c0a => generated 1260 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:45:26.435803 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-1ab355ac-7880-496e-ad91-32707b44452d tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:26.436413 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-1ab355ac-7880-496e-ad91-32707b44452d tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] [instance: 39d66e18-289f-4674-b66c-146d68ef9133] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:26.443063 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1ab355ac-7880-496e-ad91-32707b44452d tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:26.443741 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1ab355ac-7880-496e-ad91-32707b44452d tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:26.444615 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1ab355ac-7880-496e-ad91-32707b44452d tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:26.445710 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1ab355ac-7880-496e-ad91-32707b44452d tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:26.446486 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1ab355ac-7880-496e-ad91-32707b44452d tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:26.447075 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1ab355ac-7880-496e-ad91-32707b44452d tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:27.057195 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-1ab355ac-7880-496e-ad91-32707b44452d tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:27.073927 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-1ab355ac-7880-496e-ad91-32707b44452d tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:27.076579 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-1ab355ac-7880-496e-ad91-32707b44452d tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:27.089249 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-1ab355ac-7880-496e-ad91-32707b44452d tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] 10.222.0.33 "GET /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133" status: 200 len: 1555 microversion: 2.91 time: 0.653968 Oct 04 20:45:27.090843 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1340/2612] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:45:26 2022] GET /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133 => generated 1555 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:45:27.107373 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-19717a38-9a3b-48d5-a799-c568c79a933e tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:27.110122 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-19717a38-9a3b-48d5-a799-c568c79a933e tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] [instance: c0a14e22-0620-4912-9893-62974c80978a] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:27.127328 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-19717a38-9a3b-48d5-a799-c568c79a933e tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:27.128102 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-19717a38-9a3b-48d5-a799-c568c79a933e tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:27.128901 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-19717a38-9a3b-48d5-a799-c568c79a933e tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:27.129806 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-19717a38-9a3b-48d5-a799-c568c79a933e tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:27.130430 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-19717a38-9a3b-48d5-a799-c568c79a933e tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:27.131056 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-19717a38-9a3b-48d5-a799-c568c79a933e tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:27.554971 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-57d966da-f91f-4132-b4f2-52160146765b tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aca59cd50bf74a36bb1e4427cd50fbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3fadcd7d4043daa0a6aba27ba814d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:27.567674 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-57d966da-f91f-4132-b4f2-52160146765b tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] 10.222.0.33 "GET /compute/v2.1/servers/c79c0cc3-17e6-4c35-b17e-c76c9b7e9e39" status: 200 len: 1308 microversion: 2.1 time: 1.214224 Oct 04 20:45:27.576822 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1273/2613] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:45:26 2022] GET /compute/v2.1/servers/c79c0cc3-17e6-4c35-b17e-c76c9b7e9e39 => generated 1308 bytes in 1221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:45:27.587074 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c846321a-fffe-4e44-b319-fbd736a70cf6 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:27.588044 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c846321a-fffe-4e44-b319-fbd736a70cf6 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] [instance: 8917de21-2b45-4249-ae17-17f679d4856f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:27.594303 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c846321a-fffe-4e44-b319-fbd736a70cf6 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:27.595135 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c846321a-fffe-4e44-b319-fbd736a70cf6 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:27.595787 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c846321a-fffe-4e44-b319-fbd736a70cf6 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:27.596855 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c846321a-fffe-4e44-b319-fbd736a70cf6 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:27.597664 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c846321a-fffe-4e44-b319-fbd736a70cf6 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:27.598304 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c846321a-fffe-4e44-b319-fbd736a70cf6 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:27.935601 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-19717a38-9a3b-48d5-a799-c568c79a933e tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28399882314945d787a3af6eb59935c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5392c67506f7445ab33d62b191558f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:27.948194 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-19717a38-9a3b-48d5-a799-c568c79a933e tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28399882314945d787a3af6eb59935c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5392c67506f7445ab33d62b191558f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:27.950269 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-19717a38-9a3b-48d5-a799-c568c79a933e tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28399882314945d787a3af6eb59935c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5392c67506f7445ab33d62b191558f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:27.952057 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-19717a38-9a3b-48d5-a799-c568c79a933e tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] 10.222.0.33 "GET /compute/v2.1/servers/c0a14e22-0620-4912-9893-62974c80978a" status: 200 len: 2947 microversion: 2.32 time: 0.859891 Oct 04 20:45:27.953236 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1341/2614] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:45:27 2022] GET /compute/v2.1/servers/c0a14e22-0620-4912-9893-62974c80978a => generated 2947 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:45:27.971016 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-5fb21174-4953-411e-8bdd-68e9473c61e8 tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:27.972033 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-5fb21174-4953-411e-8bdd-68e9473c61e8 tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] [instance: 8d3bd4d5-93f3-44f6-ba25-407fe841a180] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:27.983759 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5fb21174-4953-411e-8bdd-68e9473c61e8 tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:27.985695 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5fb21174-4953-411e-8bdd-68e9473c61e8 tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:27.986269 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5fb21174-4953-411e-8bdd-68e9473c61e8 tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:27.987805 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5fb21174-4953-411e-8bdd-68e9473c61e8 tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:27.989824 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5fb21174-4953-411e-8bdd-68e9473c61e8 tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:27.991755 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5fb21174-4953-411e-8bdd-68e9473c61e8 tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:28.043070 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c846321a-fffe-4e44-b319-fbd736a70cf6 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0967736982942f0b62db2e0546666cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f86a1d45a94f41bcd1a73694454a0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:28.056357 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c846321a-fffe-4e44-b319-fbd736a70cf6 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] 10.222.0.33 "GET /compute/v2.1/servers/8917de21-2b45-4249-ae17-17f679d4856f" status: 200 len: 1318 microversion: 2.1 time: 0.477786 Oct 04 20:45:28.067482 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1274/2615] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:45:27 2022] GET /compute/v2.1/servers/8917de21-2b45-4249-ae17-17f679d4856f => generated 1318 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:45:28.089614 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-07e98a93-1c05-4a86-8069-60c1184948b6 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:28.090765 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-07e98a93-1c05-4a86-8069-60c1184948b6 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] [instance: 07fdb076-59a4-4c77-a42b-07fa92bcf408] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:28.106581 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-07e98a93-1c05-4a86-8069-60c1184948b6 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:28.107420 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-07e98a93-1c05-4a86-8069-60c1184948b6 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:28.108031 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-07e98a93-1c05-4a86-8069-60c1184948b6 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:28.112110 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-07e98a93-1c05-4a86-8069-60c1184948b6 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:28.112913 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-07e98a93-1c05-4a86-8069-60c1184948b6 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:28.113531 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-07e98a93-1c05-4a86-8069-60c1184948b6 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:28.348391 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-07e98a93-1c05-4a86-8069-60c1184948b6 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e4b00964014a0383f79597652bd428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7f38600b5041ad8e66a12d77b940fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:28.360357 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-07e98a93-1c05-4a86-8069-60c1184948b6 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] 10.222.0.33 "GET /compute/v2.1/servers/07fdb076-59a4-4c77-a42b-07fa92bcf408" status: 200 len: 1614 microversion: 2.1 time: 0.280857 Oct 04 20:45:28.381980 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1275/2616] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:45:28 2022] GET /compute/v2.1/servers/07fdb076-59a4-4c77-a42b-07fa92bcf408 => generated 1614 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:45:28.392055 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d54e759d-ad46-449f-929f-9327c0360405 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:28.394699 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d54e759d-ad46-449f-929f-9327c0360405 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] [instance: bdfb94ca-ded6-4af0-bd9f-59fc877c4c0a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:28.413141 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d54e759d-ad46-449f-929f-9327c0360405 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:28.415132 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d54e759d-ad46-449f-929f-9327c0360405 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:28.416739 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d54e759d-ad46-449f-929f-9327c0360405 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:28.420921 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d54e759d-ad46-449f-929f-9327c0360405 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:28.421686 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d54e759d-ad46-449f-929f-9327c0360405 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:28.423816 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d54e759d-ad46-449f-929f-9327c0360405 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:28.730650 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-5fb21174-4953-411e-8bdd-68e9473c61e8 tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e1ca325fc147eaaf49b067ab20cd52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0c55e5899c472a88528599880689cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:28.750404 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-5fb21174-4953-411e-8bdd-68e9473c61e8 tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77e1ca325fc147eaaf49b067ab20cd52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0c55e5899c472a88528599880689cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:28.752192 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-5fb21174-4953-411e-8bdd-68e9473c61e8 tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77e1ca325fc147eaaf49b067ab20cd52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0c55e5899c472a88528599880689cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:28.753622 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-5fb21174-4953-411e-8bdd-68e9473c61e8 tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] 10.222.0.33 "GET /compute/v2.1/servers/8d3bd4d5-93f3-44f6-ba25-407fe841a180" status: 200 len: 1359 microversion: 2.21 time: 0.799132 Oct 04 20:45:28.754212 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1342/2617] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:45:27 2022] GET /compute/v2.1/servers/8d3bd4d5-93f3-44f6-ba25-407fe841a180 => generated 1359 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:45:28.763070 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-8905ebd3-e353-41d3-8070-8df62a7152e4 req-40ca7a90-0c38-4247-91fd-34609397a353 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d3bd4d5-93f3-44f6-ba25-407fe841a180", "name": "network-vif-plugged", "status": "completed", "tag": "af188aff-36f2-4e40-9ac2-436505b0767c"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:45:28.794323 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-8905ebd3-e353-41d3-8070-8df62a7152e4 req-40ca7a90-0c38-4247-91fd-34609397a353 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:28.796956 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-8905ebd3-e353-41d3-8070-8df62a7152e4 req-40ca7a90-0c38-4247-91fd-34609397a353 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:28.797397 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-8905ebd3-e353-41d3-8070-8df62a7152e4 req-40ca7a90-0c38-4247-91fd-34609397a353 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:28.827176 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-8905ebd3-e353-41d3-8070-8df62a7152e4 req-40ca7a90-0c38-4247-91fd-34609397a353 service nova] Creating event network-vif-plugged:af188aff-36f2-4e40-9ac2-436505b0767c for instance 8d3bd4d5-93f3-44f6-ba25-407fe841a180 on n-h2-854823-8 Oct 04 20:45:28.839274 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-8905ebd3-e353-41d3-8070-8df62a7152e4 req-40ca7a90-0c38-4247-91fd-34609397a353 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082921 Oct 04 20:45:28.842904 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1343/2618] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:45:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:45:28.855107 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-0a9bfd08-4c85-42c7-9986-b330ff456e11 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:28.855710 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-0a9bfd08-4c85-42c7-9986-b330ff456e11 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] [instance: c0a14e22-0620-4912-9893-62974c80978a] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:28.873182 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0a9bfd08-4c85-42c7-9986-b330ff456e11 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:28.873687 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0a9bfd08-4c85-42c7-9986-b330ff456e11 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:28.874308 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0a9bfd08-4c85-42c7-9986-b330ff456e11 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:28.877794 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0a9bfd08-4c85-42c7-9986-b330ff456e11 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:28.878574 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0a9bfd08-4c85-42c7-9986-b330ff456e11 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:28.879199 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0a9bfd08-4c85-42c7-9986-b330ff456e11 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:29.225251 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-0a9bfd08-4c85-42c7-9986-b330ff456e11 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] 10.222.0.33 "GET /compute/v2.1/servers/c0a14e22-0620-4912-9893-62974c80978a/os-interface" status: 200 len: 1829 microversion: 2.32 time: 0.380820 Oct 04 20:45:29.226057 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1344/2619] 10.222.0.33 () {60 vars in 1316 bytes} [Tue Oct 4 20:45:28 2022] GET /compute/v2.1/servers/c0a14e22-0620-4912-9893-62974c80978a/os-interface => generated 1829 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:45:29.231489 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-b70d51fc-0dd5-405a-97a4-635106507d42 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:29.232384 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-b70d51fc-0dd5-405a-97a4-635106507d42 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] [instance: 39d66e18-289f-4674-b66c-146d68ef9133] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:29.237806 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d54e759d-ad46-449f-929f-9327c0360405 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87dcc7baf63f4ae6bfe0a099adffd408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7097bc12179446f6a3e1fac8434d5c64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:29.244832 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b70d51fc-0dd5-405a-97a4-635106507d42 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:29.247196 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b70d51fc-0dd5-405a-97a4-635106507d42 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:29.247967 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d54e759d-ad46-449f-929f-9327c0360405 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] 10.222.0.33 "GET /compute/v2.1/servers/bdfb94ca-ded6-4af0-bd9f-59fc877c4c0a" status: 200 len: 1308 microversion: 2.1 time: 0.864686 Oct 04 20:45:29.248258 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b70d51fc-0dd5-405a-97a4-635106507d42 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:29.250575 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b70d51fc-0dd5-405a-97a4-635106507d42 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:29.252523 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b70d51fc-0dd5-405a-97a4-635106507d42 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:29.253090 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b70d51fc-0dd5-405a-97a4-635106507d42 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:29.262779 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1276/2620] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:45:28 2022] GET /compute/v2.1/servers/bdfb94ca-ded6-4af0-bd9f-59fc877c4c0a => generated 1308 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:45:29.279464 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6fa6eb79-2909-4908-ad4b-89a6bdae5824 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:29.280397 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-6fa6eb79-2909-4908-ad4b-89a6bdae5824 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] [instance: c79c0cc3-17e6-4c35-b17e-c76c9b7e9e39] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:29.291164 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6fa6eb79-2909-4908-ad4b-89a6bdae5824 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:29.291670 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6fa6eb79-2909-4908-ad4b-89a6bdae5824 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:29.292116 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6fa6eb79-2909-4908-ad4b-89a6bdae5824 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:29.292830 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6fa6eb79-2909-4908-ad4b-89a6bdae5824 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:29.293286 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6fa6eb79-2909-4908-ad4b-89a6bdae5824 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:29.301993 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6fa6eb79-2909-4908-ad4b-89a6bdae5824 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:29.450681 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell0:SELECT=6 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:45:29.479010 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-b70d51fc-0dd5-405a-97a4-635106507d42 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:29.505932 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-b70d51fc-0dd5-405a-97a4-635106507d42 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:29.512924 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-b70d51fc-0dd5-405a-97a4-635106507d42 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:29.534870 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-b70d51fc-0dd5-405a-97a4-635106507d42 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] 10.222.0.33 "GET /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133" status: 200 len: 1555 microversion: 2.91 time: 0.306339 Oct 04 20:45:29.536144 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1345/2621] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:45:29 2022] GET /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133 => generated 1555 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:45:29.550735 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-31eb9ddb-f6fe-4c72-948a-a4e04306c42b tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:29.562507 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-31eb9ddb-f6fe-4c72-948a-a4e04306c42b tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] [instance: 8917de21-2b45-4249-ae17-17f679d4856f] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:29.581969 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-31eb9ddb-f6fe-4c72-948a-a4e04306c42b tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:29.582936 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-31eb9ddb-f6fe-4c72-948a-a4e04306c42b tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:29.583385 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-31eb9ddb-f6fe-4c72-948a-a4e04306c42b tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:29.584104 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-31eb9ddb-f6fe-4c72-948a-a4e04306c42b tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:29.589307 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-31eb9ddb-f6fe-4c72-948a-a4e04306c42b tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:29.590049 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-31eb9ddb-f6fe-4c72-948a-a4e04306c42b tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:29.693903 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-6fa6eb79-2909-4908-ad4b-89a6bdae5824 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aca59cd50bf74a36bb1e4427cd50fbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3fadcd7d4043daa0a6aba27ba814d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:29.723007 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-6fa6eb79-2909-4908-ad4b-89a6bdae5824 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] 10.222.0.33 "GET /compute/v2.1/servers/c79c0cc3-17e6-4c35-b17e-c76c9b7e9e39" status: 200 len: 1489 microversion: 2.1 time: 0.458647 Oct 04 20:45:29.724592 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1277/2622] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:45:29 2022] GET /compute/v2.1/servers/c79c0cc3-17e6-4c35-b17e-c76c9b7e9e39 => generated 1489 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:45:29.735427 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1274f210-6c68-4be5-9f8e-f9045785494c tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:29.736300 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-1274f210-6c68-4be5-9f8e-f9045785494c tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] [instance: 07fdb076-59a4-4c77-a42b-07fa92bcf408] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:29.752691 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1274f210-6c68-4be5-9f8e-f9045785494c tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:29.753522 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1274f210-6c68-4be5-9f8e-f9045785494c tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:29.754175 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1274f210-6c68-4be5-9f8e-f9045785494c tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:29.755038 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1274f210-6c68-4be5-9f8e-f9045785494c tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:29.761727 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1274f210-6c68-4be5-9f8e-f9045785494c tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:29.762549 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1274f210-6c68-4be5-9f8e-f9045785494c tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:29.903124 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-1274f210-6c68-4be5-9f8e-f9045785494c tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e4b00964014a0383f79597652bd428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7f38600b5041ad8e66a12d77b940fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:29.917534 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-1274f210-6c68-4be5-9f8e-f9045785494c tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] 10.222.0.33 "GET /compute/v2.1/servers/07fdb076-59a4-4c77-a42b-07fa92bcf408" status: 200 len: 1614 microversion: 2.1 time: 0.191313 Oct 04 20:45:29.918778 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1278/2623] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:45:29 2022] GET /compute/v2.1/servers/07fdb076-59a4-4c77-a42b-07fa92bcf408 => generated 1614 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:45:29.942722 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell0:SELECT=34,nova_cell0:UPDATE=2 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:45:29.954450 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-bed31965-655a-4ebf-871f-153b6132f04a tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:45:29.956546 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-bed31965-655a-4ebf-871f-153b6132f04a tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] [instance: c79c0cc3-17e6-4c35-b17e-c76c9b7e9e39] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:29.973163 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bed31965-655a-4ebf-871f-153b6132f04a tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:29.975878 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bed31965-655a-4ebf-871f-153b6132f04a tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:29.977287 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bed31965-655a-4ebf-871f-153b6132f04a tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:29.985284 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bed31965-655a-4ebf-871f-153b6132f04a tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:29.986468 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bed31965-655a-4ebf-871f-153b6132f04a tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:29.987165 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bed31965-655a-4ebf-871f-153b6132f04a tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:30.034984 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-31eb9ddb-f6fe-4c72-948a-a4e04306c42b tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0967736982942f0b62db2e0546666cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f86a1d45a94f41bcd1a73694454a0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:30.055589 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-31eb9ddb-f6fe-4c72-948a-a4e04306c42b tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] 10.222.0.33 "GET /compute/v2.1/servers/8917de21-2b45-4249-ae17-17f679d4856f" status: 200 len: 1318 microversion: 2.1 time: 0.514965 Oct 04 20:45:30.067653 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1346/2624] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:45:29 2022] GET /compute/v2.1/servers/8917de21-2b45-4249-ae17-17f679d4856f => generated 1318 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:45:30.088986 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-c8c59179-527d-4005-9c37-1f219a46bb20 tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:30.090022 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-c8c59179-527d-4005-9c37-1f219a46bb20 tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] [instance: 8d3bd4d5-93f3-44f6-ba25-407fe841a180] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:30.112781 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c8c59179-527d-4005-9c37-1f219a46bb20 tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:30.116079 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c8c59179-527d-4005-9c37-1f219a46bb20 tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:30.119082 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c8c59179-527d-4005-9c37-1f219a46bb20 tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:30.120356 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c8c59179-527d-4005-9c37-1f219a46bb20 tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:30.123635 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c8c59179-527d-4005-9c37-1f219a46bb20 tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:30.125458 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c8c59179-527d-4005-9c37-1f219a46bb20 tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:30.137317 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-bed31965-655a-4ebf-871f-153b6132f04a tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] 10.222.0.33 "POST /compute/v2.1/servers/c79c0cc3-17e6-4c35-b17e-c76c9b7e9e39/action" status: 202 len: 0 microversion: 2.1 time: 0.200153 Oct 04 20:45:30.144029 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1279/2625] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 20:45:29 2022] POST /compute/v2.1/servers/c79c0cc3-17e6-4c35-b17e-c76c9b7e9e39/action => generated 0 bytes in 225 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:45:30.159490 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-2d5cac23-a1fd-4715-b093-50cc26ab5241 req-24c6e92b-4b18-4a63-9706-a4849878d9aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07fdb076-59a4-4c77-a42b-07fa92bcf408", "name": "network-vif-deleted", "tag": "6c6f9c50-74c0-4f1b-ac6e-dd96429aa674"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:45:30.172501 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-2d5cac23-a1fd-4715-b093-50cc26ab5241 req-24c6e92b-4b18-4a63-9706-a4849878d9aa service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:30.174036 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-2d5cac23-a1fd-4715-b093-50cc26ab5241 req-24c6e92b-4b18-4a63-9706-a4849878d9aa service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:30.176241 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-2d5cac23-a1fd-4715-b093-50cc26ab5241 req-24c6e92b-4b18-4a63-9706-a4849878d9aa service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:30.184428 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=100 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:45:30.196980 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-2d5cac23-a1fd-4715-b093-50cc26ab5241 req-24c6e92b-4b18-4a63-9706-a4849878d9aa service nova] Creating event network-vif-deleted:6c6f9c50-74c0-4f1b-ac6e-dd96429aa674 for instance 07fdb076-59a4-4c77-a42b-07fa92bcf408 on n-h1-854823-8 Oct 04 20:45:30.202985 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-2d5cac23-a1fd-4715-b093-50cc26ab5241 req-24c6e92b-4b18-4a63-9706-a4849878d9aa service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057193 Oct 04 20:45:30.208611 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1280/2626] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:45:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:45:30.215365 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2984213f-83df-4749-bbca-b6b1401e190a tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:30.216386 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-2984213f-83df-4749-bbca-b6b1401e190a tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] [instance: c79c0cc3-17e6-4c35-b17e-c76c9b7e9e39] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:30.224209 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2984213f-83df-4749-bbca-b6b1401e190a tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:30.224919 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2984213f-83df-4749-bbca-b6b1401e190a tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:30.225533 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2984213f-83df-4749-bbca-b6b1401e190a tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:30.227025 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2984213f-83df-4749-bbca-b6b1401e190a tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:30.241025 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2984213f-83df-4749-bbca-b6b1401e190a tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:30.242890 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2984213f-83df-4749-bbca-b6b1401e190a tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:30.481705 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-c8c59179-527d-4005-9c37-1f219a46bb20 tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e1ca325fc147eaaf49b067ab20cd52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0c55e5899c472a88528599880689cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:30.496522 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-c8c59179-527d-4005-9c37-1f219a46bb20 tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77e1ca325fc147eaaf49b067ab20cd52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0c55e5899c472a88528599880689cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:30.501636 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-c8c59179-527d-4005-9c37-1f219a46bb20 tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77e1ca325fc147eaaf49b067ab20cd52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0c55e5899c472a88528599880689cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:30.503229 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-c8c59179-527d-4005-9c37-1f219a46bb20 tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] 10.222.0.33 "GET /compute/v2.1/servers/8d3bd4d5-93f3-44f6-ba25-407fe841a180" status: 200 len: 1359 microversion: 2.21 time: 0.434384 Oct 04 20:45:30.506233 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1347/2627] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:45:30 2022] GET /compute/v2.1/servers/8d3bd4d5-93f3-44f6-ba25-407fe841a180 => generated 1359 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:45:30.533598 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-2984213f-83df-4749-bbca-b6b1401e190a tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aca59cd50bf74a36bb1e4427cd50fbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3fadcd7d4043daa0a6aba27ba814d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:30.536982 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-a33c4bd5-5a60-4926-ab91-b74d4e0e8df1 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:30.539103 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-a33c4bd5-5a60-4926-ab91-b74d4e0e8df1 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] [instance: bdfb94ca-ded6-4af0-bd9f-59fc877c4c0a] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:30.548452 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-2984213f-83df-4749-bbca-b6b1401e190a tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] 10.222.0.33 "GET /compute/v2.1/servers/c79c0cc3-17e6-4c35-b17e-c76c9b7e9e39" status: 200 len: 1494 microversion: 2.1 time: 0.337614 Oct 04 20:45:30.554756 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1281/2628] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:45:30 2022] GET /compute/v2.1/servers/c79c0cc3-17e6-4c35-b17e-c76c9b7e9e39 => generated 1494 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:45:30.568133 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a33c4bd5-5a60-4926-ab91-b74d4e0e8df1 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:30.568133 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a33c4bd5-5a60-4926-ab91-b74d4e0e8df1 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:30.568133 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a33c4bd5-5a60-4926-ab91-b74d4e0e8df1 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:30.568133 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a33c4bd5-5a60-4926-ab91-b74d4e0e8df1 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:30.568133 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a33c4bd5-5a60-4926-ab91-b74d4e0e8df1 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:30.568133 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a33c4bd5-5a60-4926-ab91-b74d4e0e8df1 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:30.575031 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a0485baa-5ab2-4c78-9ee5-c8dd47685193 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:30.575882 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a0485baa-5ab2-4c78-9ee5-c8dd47685193 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: 4d46fff2-b04d-41aa-ada0-2023ab545b48] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:30.585546 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a0485baa-5ab2-4c78-9ee5-c8dd47685193 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:30.587100 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a0485baa-5ab2-4c78-9ee5-c8dd47685193 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:30.587752 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a0485baa-5ab2-4c78-9ee5-c8dd47685193 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:30.588969 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a0485baa-5ab2-4c78-9ee5-c8dd47685193 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:30.589596 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a0485baa-5ab2-4c78-9ee5-c8dd47685193 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:30.590689 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a0485baa-5ab2-4c78-9ee5-c8dd47685193 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:30.869610 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-a0485baa-5ab2-4c78-9ee5-c8dd47685193 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac650232cc04810b1340dc2f0edadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b0670d1bd99424780a70e69d57a2166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:30.887986 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a0485baa-5ab2-4c78-9ee5-c8dd47685193 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48" status: 200 len: 1669 microversion: 2.1 time: 0.320674 Oct 04 20:45:30.888808 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1282/2629] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:45:30 2022] GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48 => generated 1669 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:45:30.919161 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e105271e-fe4c-4b6c-a551-b49cde3d9dad tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:30.920052 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e105271e-fe4c-4b6c-a551-b49cde3d9dad tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] [instance: 39d66e18-289f-4674-b66c-146d68ef9133] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:30.936883 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e105271e-fe4c-4b6c-a551-b49cde3d9dad tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:30.937649 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e105271e-fe4c-4b6c-a551-b49cde3d9dad tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:30.938961 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e105271e-fe4c-4b6c-a551-b49cde3d9dad tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:30.940429 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e105271e-fe4c-4b6c-a551-b49cde3d9dad tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:30.942702 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e105271e-fe4c-4b6c-a551-b49cde3d9dad tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:30.955396 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e105271e-fe4c-4b6c-a551-b49cde3d9dad tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:31.120410 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-a33c4bd5-5a60-4926-ab91-b74d4e0e8df1 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87dcc7baf63f4ae6bfe0a099adffd408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7097bc12179446f6a3e1fac8434d5c64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:31.131528 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e105271e-fe4c-4b6c-a551-b49cde3d9dad tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:31.136646 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-a33c4bd5-5a60-4926-ab91-b74d4e0e8df1 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] 10.222.0.33 "GET /compute/v2.1/servers/bdfb94ca-ded6-4af0-bd9f-59fc877c4c0a" status: 200 len: 1308 microversion: 2.1 time: 0.612487 Oct 04 20:45:31.138847 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1348/2630] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:45:30 2022] GET /compute/v2.1/servers/bdfb94ca-ded6-4af0-bd9f-59fc877c4c0a => generated 1308 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:45:31.148033 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-80dc8faa-3dea-44e8-8733-58ca82aaf26a tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:31.153107 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e105271e-fe4c-4b6c-a551-b49cde3d9dad tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:31.153833 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-80dc8faa-3dea-44e8-8733-58ca82aaf26a tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: 4d46fff2-b04d-41aa-ada0-2023ab545b48] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:31.161599 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e105271e-fe4c-4b6c-a551-b49cde3d9dad tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:31.168811 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-80dc8faa-3dea-44e8-8733-58ca82aaf26a tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:31.171175 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-80dc8faa-3dea-44e8-8733-58ca82aaf26a tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:31.173794 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-80dc8faa-3dea-44e8-8733-58ca82aaf26a tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:31.175261 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-80dc8faa-3dea-44e8-8733-58ca82aaf26a tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:31.175887 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-80dc8faa-3dea-44e8-8733-58ca82aaf26a tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:31.178306 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-80dc8faa-3dea-44e8-8733-58ca82aaf26a tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:31.193236 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e105271e-fe4c-4b6c-a551-b49cde3d9dad tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] 10.222.0.33 "GET /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133" status: 200 len: 1555 microversion: 2.91 time: 0.280627 Oct 04 20:45:31.198961 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1283/2631] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:45:30 2022] GET /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133 => generated 1555 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:45:31.213295 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-400ee273-2ee0-4e46-b3e2-8834e8dcbce9 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:31.213512 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-400ee273-2ee0-4e46-b3e2-8834e8dcbce9 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] [instance: 07fdb076-59a4-4c77-a42b-07fa92bcf408] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:31.232347 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-400ee273-2ee0-4e46-b3e2-8834e8dcbce9 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:31.232854 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-400ee273-2ee0-4e46-b3e2-8834e8dcbce9 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:31.233298 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-400ee273-2ee0-4e46-b3e2-8834e8dcbce9 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:31.234011 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-400ee273-2ee0-4e46-b3e2-8834e8dcbce9 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:31.234493 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-400ee273-2ee0-4e46-b3e2-8834e8dcbce9 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:31.234921 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-400ee273-2ee0-4e46-b3e2-8834e8dcbce9 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:31.391612 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-400ee273-2ee0-4e46-b3e2-8834e8dcbce9 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:31.393039 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-400ee273-2ee0-4e46-b3e2-8834e8dcbce9 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:31.394919 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-400ee273-2ee0-4e46-b3e2-8834e8dcbce9 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:31.396288 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-400ee273-2ee0-4e46-b3e2-8834e8dcbce9 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lazy-loading 'fault' on Instance uuid 07fdb076-59a4-4c77-a42b-07fa92bcf408 {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:45:31.559999 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-400ee273-2ee0-4e46-b3e2-8834e8dcbce9 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e4b00964014a0383f79597652bd428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7f38600b5041ad8e66a12d77b940fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:31.591273 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-400ee273-2ee0-4e46-b3e2-8834e8dcbce9 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] 10.222.0.33 "GET /compute/v2.1/servers/07fdb076-59a4-4c77-a42b-07fa92bcf408" status: 200 len: 1331 microversion: 2.1 time: 0.385644 Oct 04 20:45:31.592367 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1284/2632] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:45:31 2022] GET /compute/v2.1/servers/07fdb076-59a4-4c77-a42b-07fa92bcf408 => generated 1331 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:45:31.616521 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-3496e3a4-a050-4859-96ce-35b6a24a5d7f tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:31.617947 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-3496e3a4-a050-4859-96ce-35b6a24a5d7f tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] [instance: 8917de21-2b45-4249-ae17-17f679d4856f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:31.632906 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3496e3a4-a050-4859-96ce-35b6a24a5d7f tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:31.633714 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3496e3a4-a050-4859-96ce-35b6a24a5d7f tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:31.634932 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3496e3a4-a050-4859-96ce-35b6a24a5d7f tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:31.639390 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3496e3a4-a050-4859-96ce-35b6a24a5d7f tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:31.655519 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3496e3a4-a050-4859-96ce-35b6a24a5d7f tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:31.656889 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3496e3a4-a050-4859-96ce-35b6a24a5d7f tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:31.747733 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-80dc8faa-3dea-44e8-8733-58ca82aaf26a tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac650232cc04810b1340dc2f0edadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b0670d1bd99424780a70e69d57a2166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:31.761851 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-80dc8faa-3dea-44e8-8733-58ca82aaf26a tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48" status: 200 len: 1669 microversion: 2.1 time: 0.621162 Oct 04 20:45:31.762478 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1349/2633] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:45:31 2022] GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48 => generated 1669 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:45:31.782288 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-b1fcbfe8-de87-4e9e-a9a2-96d351ad1e73 req-07fcc523-1e57-4e3d-b8b6-b68bae6646f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bdfb94ca-ded6-4af0-bd9f-59fc877c4c0a", "tag": "2f68ae5c-502d-4266-a29b-038838a4abd1"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:45:31.810566 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-b1fcbfe8-de87-4e9e-a9a2-96d351ad1e73 req-07fcc523-1e57-4e3d-b8b6-b68bae6646f5 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:31.812612 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-b1fcbfe8-de87-4e9e-a9a2-96d351ad1e73 req-07fcc523-1e57-4e3d-b8b6-b68bae6646f5 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:31.813063 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-b1fcbfe8-de87-4e9e-a9a2-96d351ad1e73 req-07fcc523-1e57-4e3d-b8b6-b68bae6646f5 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:31.862197 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-b1fcbfe8-de87-4e9e-a9a2-96d351ad1e73 req-07fcc523-1e57-4e3d-b8b6-b68bae6646f5 service nova] Creating event network-changed:2f68ae5c-502d-4266-a29b-038838a4abd1 for instance bdfb94ca-ded6-4af0-bd9f-59fc877c4c0a on n-h1-854823-8 Oct 04 20:45:31.875811 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-b1fcbfe8-de87-4e9e-a9a2-96d351ad1e73 req-07fcc523-1e57-4e3d-b8b6-b68bae6646f5 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112071 Oct 04 20:45:31.876614 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1350/2634] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:45:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:45:31.881856 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-07864d12-80a3-4c55-a45e-53d2ea2b51ee tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:31.882289 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-07864d12-80a3-4c55-a45e-53d2ea2b51ee tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] [instance: 8d3bd4d5-93f3-44f6-ba25-407fe841a180] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:31.929285 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-07864d12-80a3-4c55-a45e-53d2ea2b51ee tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:31.929285 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-07864d12-80a3-4c55-a45e-53d2ea2b51ee tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:31.929285 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-07864d12-80a3-4c55-a45e-53d2ea2b51ee tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:31.944809 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-07864d12-80a3-4c55-a45e-53d2ea2b51ee tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:31.945943 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-07864d12-80a3-4c55-a45e-53d2ea2b51ee tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:31.946443 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-07864d12-80a3-4c55-a45e-53d2ea2b51ee tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:32.069039 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-3496e3a4-a050-4859-96ce-35b6a24a5d7f tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0967736982942f0b62db2e0546666cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f86a1d45a94f41bcd1a73694454a0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:32.084326 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-3496e3a4-a050-4859-96ce-35b6a24a5d7f tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] 10.222.0.33 "GET /compute/v2.1/servers/8917de21-2b45-4249-ae17-17f679d4856f" status: 200 len: 1318 microversion: 2.1 time: 0.483616 Oct 04 20:45:32.107631 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1285/2635] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:45:31 2022] GET /compute/v2.1/servers/8917de21-2b45-4249-ae17-17f679d4856f => generated 1318 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:45:32.155409 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-590c94fc-e3c5-4e8a-8cfd-e916e1a0e7c9 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:32.162191 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-590c94fc-e3c5-4e8a-8cfd-e916e1a0e7c9 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] [instance: c79c0cc3-17e6-4c35-b17e-c76c9b7e9e39] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:32.195909 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-590c94fc-e3c5-4e8a-8cfd-e916e1a0e7c9 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:32.197960 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-590c94fc-e3c5-4e8a-8cfd-e916e1a0e7c9 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:32.198669 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-590c94fc-e3c5-4e8a-8cfd-e916e1a0e7c9 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:32.201011 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-590c94fc-e3c5-4e8a-8cfd-e916e1a0e7c9 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:32.204101 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-590c94fc-e3c5-4e8a-8cfd-e916e1a0e7c9 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:32.205380 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-590c94fc-e3c5-4e8a-8cfd-e916e1a0e7c9 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:32.521531 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-07864d12-80a3-4c55-a45e-53d2ea2b51ee tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e1ca325fc147eaaf49b067ab20cd52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0c55e5899c472a88528599880689cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:32.534160 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-07864d12-80a3-4c55-a45e-53d2ea2b51ee tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77e1ca325fc147eaaf49b067ab20cd52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0c55e5899c472a88528599880689cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:32.541144 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-07864d12-80a3-4c55-a45e-53d2ea2b51ee tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77e1ca325fc147eaaf49b067ab20cd52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0c55e5899c472a88528599880689cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:32.543242 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-07864d12-80a3-4c55-a45e-53d2ea2b51ee tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] 10.222.0.33 "GET /compute/v2.1/servers/8d3bd4d5-93f3-44f6-ba25-407fe841a180" status: 200 len: 1552 microversion: 2.21 time: 0.665137 Oct 04 20:45:32.544357 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1351/2636] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:45:31 2022] GET /compute/v2.1/servers/8d3bd4d5-93f3-44f6-ba25-407fe841a180 => generated 1552 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:45:32.557863 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-5ce7835e-c091-49a9-b586-100d06fe7f78 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:32.559239 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-5ce7835e-c091-49a9-b586-100d06fe7f78 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: 4d46fff2-b04d-41aa-ada0-2023ab545b48] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:32.572864 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5ce7835e-c091-49a9-b586-100d06fe7f78 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:32.573629 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5ce7835e-c091-49a9-b586-100d06fe7f78 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:32.575466 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5ce7835e-c091-49a9-b586-100d06fe7f78 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:32.576972 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5ce7835e-c091-49a9-b586-100d06fe7f78 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:32.578159 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5ce7835e-c091-49a9-b586-100d06fe7f78 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:32.578827 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5ce7835e-c091-49a9-b586-100d06fe7f78 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:32.611933 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-590c94fc-e3c5-4e8a-8cfd-e916e1a0e7c9 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aca59cd50bf74a36bb1e4427cd50fbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3fadcd7d4043daa0a6aba27ba814d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:32.621804 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-590c94fc-e3c5-4e8a-8cfd-e916e1a0e7c9 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] 10.222.0.33 "GET /compute/v2.1/servers/c79c0cc3-17e6-4c35-b17e-c76c9b7e9e39" status: 200 len: 1474 microversion: 2.1 time: 0.512711 Oct 04 20:45:32.623463 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1286/2637] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:45:32 2022] GET /compute/v2.1/servers/c79c0cc3-17e6-4c35-b17e-c76c9b7e9e39 => generated 1474 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:45:32.644080 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ece011c4-8256-4cae-8157-15affba7d894 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:32.645255 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ece011c4-8256-4cae-8157-15affba7d894 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] [instance: bdfb94ca-ded6-4af0-bd9f-59fc877c4c0a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:32.652994 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ece011c4-8256-4cae-8157-15affba7d894 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:32.660330 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ece011c4-8256-4cae-8157-15affba7d894 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:32.662033 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ece011c4-8256-4cae-8157-15affba7d894 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:32.665622 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ece011c4-8256-4cae-8157-15affba7d894 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:32.667106 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ece011c4-8256-4cae-8157-15affba7d894 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:32.667800 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ece011c4-8256-4cae-8157-15affba7d894 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:32.877629 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-5ce7835e-c091-49a9-b586-100d06fe7f78 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac650232cc04810b1340dc2f0edadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b0670d1bd99424780a70e69d57a2166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:32.904062 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-5ce7835e-c091-49a9-b586-100d06fe7f78 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48" status: 200 len: 1669 microversion: 2.1 time: 0.358282 Oct 04 20:45:32.905315 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1352/2638] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:45:32 2022] GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48 => generated 1669 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:45:32.910447 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-1b2d9201-f81a-4b66-9445-85fc12dbec92 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:32.915224 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-1b2d9201-f81a-4b66-9445-85fc12dbec92 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] [instance: 39d66e18-289f-4674-b66c-146d68ef9133] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:32.927953 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1b2d9201-f81a-4b66-9445-85fc12dbec92 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:32.928472 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1b2d9201-f81a-4b66-9445-85fc12dbec92 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:32.928921 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1b2d9201-f81a-4b66-9445-85fc12dbec92 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:32.929680 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1b2d9201-f81a-4b66-9445-85fc12dbec92 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:32.930134 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1b2d9201-f81a-4b66-9445-85fc12dbec92 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:32.930584 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1b2d9201-f81a-4b66-9445-85fc12dbec92 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:33.001896 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-ece011c4-8256-4cae-8157-15affba7d894 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87dcc7baf63f4ae6bfe0a099adffd408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7097bc12179446f6a3e1fac8434d5c64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:33.015683 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ece011c4-8256-4cae-8157-15affba7d894 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] 10.222.0.33 "GET /compute/v2.1/servers/bdfb94ca-ded6-4af0-bd9f-59fc877c4c0a" status: 200 len: 1308 microversion: 2.1 time: 0.390319 Oct 04 20:45:33.017448 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1287/2639] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:45:32 2022] GET /compute/v2.1/servers/bdfb94ca-ded6-4af0-bd9f-59fc877c4c0a => generated 1308 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:45:33.026739 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-2a07b7ca-46d2-4bb3-a83c-ec0c70680d93 req-f257b5ef-5d7e-4a86-8401-0795bf79cf83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8917de21-2b45-4249-ae17-17f679d4856f", "name": "network-vif-plugged", "status": "completed", "tag": "ec043ecd-8aa4-4125-9877-75f2ddd3f7ee"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:45:33.057027 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-2a07b7ca-46d2-4bb3-a83c-ec0c70680d93 req-f257b5ef-5d7e-4a86-8401-0795bf79cf83 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:33.060983 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-1b2d9201-f81a-4b66-9445-85fc12dbec92 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:33.061220 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-2a07b7ca-46d2-4bb3-a83c-ec0c70680d93 req-f257b5ef-5d7e-4a86-8401-0795bf79cf83 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:33.061695 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-2a07b7ca-46d2-4bb3-a83c-ec0c70680d93 req-f257b5ef-5d7e-4a86-8401-0795bf79cf83 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:33.069527 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:45:33.072802 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-1b2d9201-f81a-4b66-9445-85fc12dbec92 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:33.075468 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-1b2d9201-f81a-4b66-9445-85fc12dbec92 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:33.081832 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-1b2d9201-f81a-4b66-9445-85fc12dbec92 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] 10.222.0.33 "GET /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133" status: 200 len: 1555 microversion: 2.91 time: 0.174854 Oct 04 20:45:33.083329 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-2a07b7ca-46d2-4bb3-a83c-ec0c70680d93 req-f257b5ef-5d7e-4a86-8401-0795bf79cf83 service nova] Creating event network-vif-plugged:ec043ecd-8aa4-4125-9877-75f2ddd3f7ee for instance 8917de21-2b45-4249-ae17-17f679d4856f on n-h2-854823-8 Oct 04 20:45:33.083726 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1353/2640] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:45:32 2022] GET /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133 => generated 1555 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:45:33.089200 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-76a75b25-71af-4bff-8664-334549093a59 tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:33.090770 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-76a75b25-71af-4bff-8664-334549093a59 tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] [instance: 8d3bd4d5-93f3-44f6-ba25-407fe841a180] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:33.093658 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-2a07b7ca-46d2-4bb3-a83c-ec0c70680d93 req-f257b5ef-5d7e-4a86-8401-0795bf79cf83 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073414 Oct 04 20:45:33.094773 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1288/2641] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:45:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:45:33.098898 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-76a75b25-71af-4bff-8664-334549093a59 tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:33.099393 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-76a75b25-71af-4bff-8664-334549093a59 tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:33.099824 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-76a75b25-71af-4bff-8664-334549093a59 tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:33.100528 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-76a75b25-71af-4bff-8664-334549093a59 tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:33.100974 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-76a75b25-71af-4bff-8664-334549093a59 tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:33.101430 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-76a75b25-71af-4bff-8664-334549093a59 tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:33.105322 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-49ef4cb7-ac33-4c83-9c83-9974e322d0a7 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:33.111164 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-49ef4cb7-ac33-4c83-9c83-9974e322d0a7 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] [instance: 07fdb076-59a4-4c77-a42b-07fa92bcf408] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:33.121333 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-49ef4cb7-ac33-4c83-9c83-9974e322d0a7 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:33.121999 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-49ef4cb7-ac33-4c83-9c83-9974e322d0a7 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:33.122691 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-49ef4cb7-ac33-4c83-9c83-9974e322d0a7 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:33.123516 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-49ef4cb7-ac33-4c83-9c83-9974e322d0a7 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:33.124080 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-49ef4cb7-ac33-4c83-9c83-9974e322d0a7 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:33.125006 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-49ef4cb7-ac33-4c83-9c83-9974e322d0a7 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:33.152577 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-49ef4cb7-ac33-4c83-9c83-9974e322d0a7 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] HTTP exception thrown: Instance 07fdb076-59a4-4c77-a42b-07fa92bcf408 could not be found. Oct 04 20:45:33.155019 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-49ef4cb7-ac33-4c83-9c83-9974e322d0a7 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Request method failure captured: Oct 04 20:45:33.155019 n-d-854823-8 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/07fdb076-59a4-4c77-a42b-07fa92bcf408 HTTP/1.1 Oct 04 20:45:33.155019 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:45:33.155019 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:45:33.155019 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:45:33.155019 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 0 Oct 04 20:45:33.155019 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:45:33.155019 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:45:33.155019 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:45:33.155019 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:45:33.155019 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJq81PAuDsDZpxdj7sHNmNgvbOtGh6iX1oPKSmvHZUw9x7ULWvp7QM5iDniQ-MHWL89bpVZnLKWftCcZuFrmOzCFwz5uJr5u54napWSUn77riQgg7pFlU7FKzu5ArjbUA7EV4GWtihdoiqsY9U5RhjRJWZh-5HATJMChglPcLjaAY6g Oct 04 20:45:33.155019 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:45:33.155019 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:45:33.155019 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:45:33.155019 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:45:33.155019 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:45:33.155019 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:45:33.155019 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: fc7f38600b5041ad8e66a12d77b940fa Oct 04 20:45:33.155019 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-AttachVolumeNegativeTest-16853026 Oct 04 20:45:33.155019 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 20:45:33.155019 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 20:45:33.155019 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_fc7f38600b5041ad8e66a12d77b940fa", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fc7f38600b5041ad8e66a12d77b940fa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fc7f38600b5041ad8e66a12d77b940fa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/fc7f38600b5041ad8e66a12d77b940fa"}]}] Oct 04 20:45:33.155019 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-AttachVolumeNegativeTest-16853026 Oct 04 20:45:33.155019 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: fc7f38600b5041ad8e66a12d77b940fa Oct 04 20:45:33.155019 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-16853026 Oct 04 20:45:33.155019 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-AttachVolumeNegativeTest-16853026-project Oct 04 20:45:33.155019 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:45:33.155019 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:45:33.155019 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: d9e4b00964014a0383f79597652bd428 Oct 04 20:45:33.155019 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-AttachVolumeNegativeTest-16853026-project Oct 04 20:45:33.155019 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 20:45:33.155019 n-d-854823-8 devstack@n-api.service[128801]: exception: Instance 07fdb076-59a4-4c77-a42b-07fa92bcf408 could not be found. Oct 04 20:45:33.155019 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': '07fdb076-59a4-4c77-a42b-07fa92bcf408'} Oct 04 20:45:33.155019 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:45:33.155019 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:45:33.155019 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:45:33.155019 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:45:33.155019 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:45:33.155019 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:45:33.155019 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:45:33.155019 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:45:33.155019 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:45:33.155019 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:45:33.155019 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 07fdb076-59a4-4c77-a42b-07fa92bcf408 could not be found. Oct 04 20:45:33.155019 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:45:33.155019 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:45:33.155019 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:45:33.155019 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:45:33.155019 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:45:33.155019 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:45:33.155019 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:45:33.155019 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:45:33.155019 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:45:33.155019 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:45:33.155019 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:45:33.155019 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:45:33.155019 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:45:33.155019 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:45:33.155019 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:45:33.155019 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:45:33.155019 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 07fdb076-59a4-4c77-a42b-07fa92bcf408 could not be found. Oct 04 20:45:33.155019 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:45:33.155019 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:45:33.155019 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:45:33.159558 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:45:33.159558 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:45:33.159558 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:45:33.159558 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:45:33.159558 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:45:33.159558 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 07fdb076-59a4-4c77-a42b-07fa92bcf408 could not be found. Oct 04 20:45:33.159558 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:45:33.160292 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-76a75b25-71af-4bff-8664-334549093a59 tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] [instance: 8d3bd4d5-93f3-44f6-ba25-407fe841a180] Going to try to terminate instance {{(pid=128802) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:45:33.160668 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-49ef4cb7-ac33-4c83-9c83-9974e322d0a7 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Returning 404 to user: Instance 07fdb076-59a4-4c77-a42b-07fa92bcf408 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:45:33.161903 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-49ef4cb7-ac33-4c83-9c83-9974e322d0a7 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] 10.222.0.33 "GET /compute/v2.1/servers/07fdb076-59a4-4c77-a42b-07fa92bcf408" status: 404 len: 111 microversion: 2.1 time: 0.065089 Oct 04 20:45:33.170136 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1289/2642] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:45:33 2022] GET /compute/v2.1/servers/07fdb076-59a4-4c77-a42b-07fa92bcf408 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:45:33.176393 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-849aa8e0-9606-47a1-a1d0-6d6be50bdf1d tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-429450023"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:45:33.178886 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-849aa8e0-9606-47a1-a1d0-6d6be50bdf1d tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] [instance: c79c0cc3-17e6-4c35-b17e-c76c9b7e9e39] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:33.187666 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-849aa8e0-9606-47a1-a1d0-6d6be50bdf1d tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:33.188261 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-849aa8e0-9606-47a1-a1d0-6d6be50bdf1d tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:33.188772 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-849aa8e0-9606-47a1-a1d0-6d6be50bdf1d tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:33.189554 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-849aa8e0-9606-47a1-a1d0-6d6be50bdf1d tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:33.190734 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-849aa8e0-9606-47a1-a1d0-6d6be50bdf1d tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:33.191258 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-849aa8e0-9606-47a1-a1d0-6d6be50bdf1d tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:33.254583 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:45:33.311410 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-76a75b25-71af-4bff-8664-334549093a59 tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] 10.222.0.33 "DELETE /compute/v2.1/servers/8d3bd4d5-93f3-44f6-ba25-407fe841a180" status: 204 len: 0 microversion: 2.21 time: 0.226082 Oct 04 20:45:33.314716 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1354/2643] 10.222.0.33 () {60 vars in 1280 bytes} [Tue Oct 4 20:45:33 2022] DELETE /compute/v2.1/servers/8d3bd4d5-93f3-44f6-ba25-407fe841a180 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 20:45:33.322704 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-96a8b07e-2081-4749-a549-d32089514b29 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-722974459"}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:45:33.325583 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-96a8b07e-2081-4749-a549-d32089514b29 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: 4d46fff2-b04d-41aa-ada0-2023ab545b48] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:33.336041 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-96a8b07e-2081-4749-a549-d32089514b29 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:33.336999 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-96a8b07e-2081-4749-a549-d32089514b29 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:33.338059 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-96a8b07e-2081-4749-a549-d32089514b29 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:33.339097 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-96a8b07e-2081-4749-a549-d32089514b29 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:33.339776 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-96a8b07e-2081-4749-a549-d32089514b29 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:33.340556 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-96a8b07e-2081-4749-a549-d32089514b29 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:33.564210 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-849aa8e0-9606-47a1-a1d0-6d6be50bdf1d tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] 10.222.0.33 "POST /compute/v2.1/servers/c79c0cc3-17e6-4c35-b17e-c76c9b7e9e39/action" status: 202 len: 0 microversion: 2.1 time: 0.392269 Oct 04 20:45:33.566430 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1290/2644] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 20:45:33 2022] POST /compute/v2.1/servers/c79c0cc3-17e6-4c35-b17e-c76c9b7e9e39/action => generated 0 bytes in 394 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 04 20:45:33.581192 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-939c41c5-c634-4655-9f46-1f049df315f6 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:33.583427 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-939c41c5-c634-4655-9f46-1f049df315f6 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] [instance: 8917de21-2b45-4249-ae17-17f679d4856f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:33.588913 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=7 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:45:33.591648 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-939c41c5-c634-4655-9f46-1f049df315f6 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:33.592121 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-939c41c5-c634-4655-9f46-1f049df315f6 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:33.592670 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-939c41c5-c634-4655-9f46-1f049df315f6 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:33.593504 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-939c41c5-c634-4655-9f46-1f049df315f6 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:33.594060 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-939c41c5-c634-4655-9f46-1f049df315f6 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:33.594571 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-939c41c5-c634-4655-9f46-1f049df315f6 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:33.706477 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-96a8b07e-2081-4749-a549-d32089514b29 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "POST /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48/action" status: 202 len: 0 microversion: 2.1 time: 0.389901 Oct 04 20:45:33.708441 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1355/2645] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 20:45:33 2022] POST /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48/action => generated 0 bytes in 393 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Oct 04 20:45:33.716570 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-8d0016e1-dfb0-436e-b9a1-9806f8fa88fb tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Calling method '.version_select at 0x7f3c746e54c0>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:33.748711 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-8d0016e1-dfb0-436e-b9a1-9806f8fa88fb tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2092395144" status: 202 len: 0 microversion: 2.1 time: 0.032820 Oct 04 20:45:33.748711 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1356/2646] 10.222.0.33 () {58 vars in 1221 bytes} [Tue Oct 4 20:45:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2092395144 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:45:33.754090 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-7367cefb-a34c-4963-95be-1b4d926c1b88 tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:33.755114 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-7367cefb-a34c-4963-95be-1b4d926c1b88 tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] [instance: 8d3bd4d5-93f3-44f6-ba25-407fe841a180] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:33.763833 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7367cefb-a34c-4963-95be-1b4d926c1b88 tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:33.764393 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7367cefb-a34c-4963-95be-1b4d926c1b88 tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:33.764949 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7367cefb-a34c-4963-95be-1b4d926c1b88 tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:33.765727 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7367cefb-a34c-4963-95be-1b4d926c1b88 tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:33.766217 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7367cefb-a34c-4963-95be-1b4d926c1b88 tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:33.766676 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7367cefb-a34c-4963-95be-1b4d926c1b88 tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:33.801311 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-939c41c5-c634-4655-9f46-1f049df315f6 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0967736982942f0b62db2e0546666cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f86a1d45a94f41bcd1a73694454a0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:33.815437 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-939c41c5-c634-4655-9f46-1f049df315f6 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] 10.222.0.33 "GET /compute/v2.1/servers/8917de21-2b45-4249-ae17-17f679d4856f" status: 200 len: 1318 microversion: 2.1 time: 0.248717 Oct 04 20:45:33.816521 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1291/2647] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:45:33 2022] GET /compute/v2.1/servers/8917de21-2b45-4249-ae17-17f679d4856f => generated 1318 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:45:33.827298 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2e8ab25b-b2c6-47b7-82d7-7273ec31e6ef tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Calling method '.version_select at 0x7f3c740a7670>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:33.889581 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-2e8ab25b-b2c6-47b7-82d7-7273ec31e6ef tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] 10.222.0.33 "GET /compute/v2.1/images/cd92b355-ed64-4588-875e-1d5d7d57c8a4" status: 200 len: 1411 microversion: 2.1 time: 0.071882 Oct 04 20:45:33.890709 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1292/2648] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 20:45:33 2022] GET /compute/v2.1/images/cd92b355-ed64-4588-875e-1d5d7d57c8a4 => generated 1411 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:45:33.926756 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-7367cefb-a34c-4963-95be-1b4d926c1b88 tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e1ca325fc147eaaf49b067ab20cd52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0c55e5899c472a88528599880689cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:33.937002 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-7367cefb-a34c-4963-95be-1b4d926c1b88 tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77e1ca325fc147eaaf49b067ab20cd52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0c55e5899c472a88528599880689cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:33.938808 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-7367cefb-a34c-4963-95be-1b4d926c1b88 tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77e1ca325fc147eaaf49b067ab20cd52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0c55e5899c472a88528599880689cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:33.940166 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-7367cefb-a34c-4963-95be-1b4d926c1b88 tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] 10.222.0.33 "GET /compute/v2.1/servers/8d3bd4d5-93f3-44f6-ba25-407fe841a180" status: 200 len: 1558 microversion: 2.21 time: 0.190918 Oct 04 20:45:33.940897 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1357/2649] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:45:33 2022] GET /compute/v2.1/servers/8d3bd4d5-93f3-44f6-ba25-407fe841a180 => generated 1558 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:45:34.046007 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-679b5a9d-f993-42a8-8a97-8270dd293452 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:34.046815 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-679b5a9d-f993-42a8-8a97-8270dd293452 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] [instance: bdfb94ca-ded6-4af0-bd9f-59fc877c4c0a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:34.061663 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-679b5a9d-f993-42a8-8a97-8270dd293452 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:34.062736 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-679b5a9d-f993-42a8-8a97-8270dd293452 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:34.063402 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-679b5a9d-f993-42a8-8a97-8270dd293452 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:34.065540 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-679b5a9d-f993-42a8-8a97-8270dd293452 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:34.067400 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-679b5a9d-f993-42a8-8a97-8270dd293452 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:34.068005 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-679b5a9d-f993-42a8-8a97-8270dd293452 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:34.112946 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-776b657f-76f6-40f3-9953-e84cafcfd240 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:34.113555 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-776b657f-76f6-40f3-9953-e84cafcfd240 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] [instance: 39d66e18-289f-4674-b66c-146d68ef9133] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:34.124150 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-776b657f-76f6-40f3-9953-e84cafcfd240 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:34.124814 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-776b657f-76f6-40f3-9953-e84cafcfd240 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:34.126741 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-776b657f-76f6-40f3-9953-e84cafcfd240 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:34.127861 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-776b657f-76f6-40f3-9953-e84cafcfd240 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:34.130921 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-776b657f-76f6-40f3-9953-e84cafcfd240 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:34.131371 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-776b657f-76f6-40f3-9953-e84cafcfd240 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:34.237157 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-776b657f-76f6-40f3-9953-e84cafcfd240 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:34.247496 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-776b657f-76f6-40f3-9953-e84cafcfd240 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:34.255320 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-776b657f-76f6-40f3-9953-e84cafcfd240 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:34.261339 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-776b657f-76f6-40f3-9953-e84cafcfd240 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] 10.222.0.33 "GET /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133" status: 200 len: 1555 microversion: 2.91 time: 0.152370 Oct 04 20:45:34.275367 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1358/2650] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:45:34 2022] GET /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133 => generated 1555 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:45:34.410791 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-679b5a9d-f993-42a8-8a97-8270dd293452 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87dcc7baf63f4ae6bfe0a099adffd408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7097bc12179446f6a3e1fac8434d5c64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:34.421210 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-679b5a9d-f993-42a8-8a97-8270dd293452 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] 10.222.0.33 "GET /compute/v2.1/servers/bdfb94ca-ded6-4af0-bd9f-59fc877c4c0a" status: 200 len: 1308 microversion: 2.1 time: 0.379067 Oct 04 20:45:34.427681 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1293/2651] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:45:34 2022] GET /compute/v2.1/servers/bdfb94ca-ded6-4af0-bd9f-59fc877c4c0a => generated 1308 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:45:34.846926 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-dff98d90-cd88-4c5b-b2e8-991c1b3b6de2 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:34.847552 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-dff98d90-cd88-4c5b-b2e8-991c1b3b6de2 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] [instance: 8917de21-2b45-4249-ae17-17f679d4856f] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:34.874500 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7185a460-dbee-4652-8189-7a31ca336d58 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:34.876003 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-7185a460-dbee-4652-8189-7a31ca336d58 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] [instance: d849cb42-dfe6-4225-814a-90bef2839739] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:34.887567 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7185a460-dbee-4652-8189-7a31ca336d58 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:34.888410 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7185a460-dbee-4652-8189-7a31ca336d58 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:34.889162 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7185a460-dbee-4652-8189-7a31ca336d58 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:34.890084 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7185a460-dbee-4652-8189-7a31ca336d58 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:34.890786 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7185a460-dbee-4652-8189-7a31ca336d58 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:34.891428 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7185a460-dbee-4652-8189-7a31ca336d58 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:34.909884 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dff98d90-cd88-4c5b-b2e8-991c1b3b6de2 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:34.910404 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dff98d90-cd88-4c5b-b2e8-991c1b3b6de2 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:34.918358 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dff98d90-cd88-4c5b-b2e8-991c1b3b6de2 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:34.928697 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dff98d90-cd88-4c5b-b2e8-991c1b3b6de2 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:34.929197 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dff98d90-cd88-4c5b-b2e8-991c1b3b6de2 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:34.929680 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dff98d90-cd88-4c5b-b2e8-991c1b3b6de2 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:35.137204 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-7185a460-dbee-4652-8189-7a31ca336d58 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lazy-loading 'services' on Instance uuid d849cb42-dfe6-4225-814a-90bef2839739 {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:45:35.169554 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-dff98d90-cd88-4c5b-b2e8-991c1b3b6de2 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0967736982942f0b62db2e0546666cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f86a1d45a94f41bcd1a73694454a0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:35.177901 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-dff98d90-cd88-4c5b-b2e8-991c1b3b6de2 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] 10.222.0.33 "GET /compute/v2.1/servers/8917de21-2b45-4249-ae17-17f679d4856f" status: 200 len: 1318 microversion: 2.1 time: 0.335197 Oct 04 20:45:35.195670 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1359/2652] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:45:34 2022] GET /compute/v2.1/servers/8917de21-2b45-4249-ae17-17f679d4856f => generated 1318 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:45:35.219434 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-399a3a26-e66e-4593-bb34-27b5d8df5a89 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Calling method '.version_select at 0x7f3c7885c790>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:35.308571 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-399a3a26-e66e-4593-bb34-27b5d8df5a89 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] 10.222.0.33 "GET /compute/v2.1/images/cd92b355-ed64-4588-875e-1d5d7d57c8a4" status: 200 len: 1411 microversion: 2.1 time: 0.111439 Oct 04 20:45:35.309485 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1360/2653] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 20:45:35 2022] GET /compute/v2.1/images/cd92b355-ed64-4588-875e-1d5d7d57c8a4 => generated 1411 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:45:35.315800 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-163888b8-f3ec-4941-980c-fbbba4b07972 tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:35.317676 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-163888b8-f3ec-4941-980c-fbbba4b07972 tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] [instance: 8d3bd4d5-93f3-44f6-ba25-407fe841a180] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:35.324844 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-163888b8-f3ec-4941-980c-fbbba4b07972 tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:35.325327 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-163888b8-f3ec-4941-980c-fbbba4b07972 tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:35.325763 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-163888b8-f3ec-4941-980c-fbbba4b07972 tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:35.326583 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-163888b8-f3ec-4941-980c-fbbba4b07972 tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:35.327895 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-163888b8-f3ec-4941-980c-fbbba4b07972 tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:35.328327 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-163888b8-f3ec-4941-980c-fbbba4b07972 tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:35.365917 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-7185a460-dbee-4652-8189-7a31ca336d58 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] 10.222.0.33 "DELETE /compute/v2.1/servers/d849cb42-dfe6-4225-814a-90bef2839739/os-volume_attachments/5b1a385d-80d1-4f7a-bf6d-29b6df8272f1" status: 202 len: 0 microversion: 2.1 time: 0.496989 Oct 04 20:45:35.367885 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1294/2654] 10.222.0.33 () {58 vars in 1416 bytes} [Tue Oct 4 20:45:34 2022] DELETE /compute/v2.1/servers/d849cb42-dfe6-4225-814a-90bef2839739/os-volume_attachments/5b1a385d-80d1-4f7a-bf6d-29b6df8272f1 => generated 0 bytes in 500 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 20:45:35.375905 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-da50de23-c690-411d-8ab7-4b7a4165f983 req-d35db1db-49f3-494b-b53e-3db01767dd94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "291474d2-a375-4974-abec-713900c08119", "name": "network-vif-plugged", "status": "completed", "tag": "744df6f8-0df8-4ff2-b842-56de1314bff3"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:45:35.392164 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-da50de23-c690-411d-8ab7-4b7a4165f983 req-d35db1db-49f3-494b-b53e-3db01767dd94 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:35.392864 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-da50de23-c690-411d-8ab7-4b7a4165f983 req-d35db1db-49f3-494b-b53e-3db01767dd94 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:35.393456 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-da50de23-c690-411d-8ab7-4b7a4165f983 req-d35db1db-49f3-494b-b53e-3db01767dd94 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:35.414435 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-da50de23-c690-411d-8ab7-4b7a4165f983 req-d35db1db-49f3-494b-b53e-3db01767dd94 service nova] Creating event network-vif-plugged:744df6f8-0df8-4ff2-b842-56de1314bff3 for instance 291474d2-a375-4974-abec-713900c08119 on n-h1-854823-8 Oct 04 20:45:35.422748 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-da50de23-c690-411d-8ab7-4b7a4165f983 req-d35db1db-49f3-494b-b53e-3db01767dd94 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052913 Oct 04 20:45:35.423616 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1295/2655] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:45:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:45:35.431271 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-80c9a54b-9823-4f2e-834a-254fe14f2082 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:35.431974 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-80c9a54b-9823-4f2e-834a-254fe14f2082 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] [instance: 39d66e18-289f-4674-b66c-146d68ef9133] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:35.462514 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-80c9a54b-9823-4f2e-834a-254fe14f2082 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:35.463016 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-80c9a54b-9823-4f2e-834a-254fe14f2082 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:35.463453 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-80c9a54b-9823-4f2e-834a-254fe14f2082 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:35.464160 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-80c9a54b-9823-4f2e-834a-254fe14f2082 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:35.464622 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-80c9a54b-9823-4f2e-834a-254fe14f2082 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:35.465047 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-80c9a54b-9823-4f2e-834a-254fe14f2082 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:35.566788 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-163888b8-f3ec-4941-980c-fbbba4b07972 tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e1ca325fc147eaaf49b067ab20cd52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0c55e5899c472a88528599880689cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:35.579885 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-163888b8-f3ec-4941-980c-fbbba4b07972 tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77e1ca325fc147eaaf49b067ab20cd52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0c55e5899c472a88528599880689cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:35.581845 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-163888b8-f3ec-4941-980c-fbbba4b07972 tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77e1ca325fc147eaaf49b067ab20cd52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0c55e5899c472a88528599880689cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:35.583704 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-163888b8-f3ec-4941-980c-fbbba4b07972 tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] 10.222.0.33 "GET /compute/v2.1/servers/8d3bd4d5-93f3-44f6-ba25-407fe841a180" status: 200 len: 1558 microversion: 2.21 time: 0.273153 Oct 04 20:45:35.588548 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1361/2656] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:45:35 2022] GET /compute/v2.1/servers/8d3bd4d5-93f3-44f6-ba25-407fe841a180 => generated 1558 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:45:35.594838 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-58e7d55f-7ee6-4b85-b93e-b0089176ceee tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:35.597903 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-58e7d55f-7ee6-4b85-b93e-b0089176ceee tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] [instance: d849cb42-dfe6-4225-814a-90bef2839739] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:35.606304 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-58e7d55f-7ee6-4b85-b93e-b0089176ceee tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:35.607033 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-58e7d55f-7ee6-4b85-b93e-b0089176ceee tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:35.607749 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-58e7d55f-7ee6-4b85-b93e-b0089176ceee tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:35.608939 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-58e7d55f-7ee6-4b85-b93e-b0089176ceee tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:35.609632 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-58e7d55f-7ee6-4b85-b93e-b0089176ceee tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:35.610205 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-58e7d55f-7ee6-4b85-b93e-b0089176ceee tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:35.636094 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-80c9a54b-9823-4f2e-834a-254fe14f2082 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:35.652757 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-80c9a54b-9823-4f2e-834a-254fe14f2082 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:35.654216 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-80c9a54b-9823-4f2e-834a-254fe14f2082 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:35.667451 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-80c9a54b-9823-4f2e-834a-254fe14f2082 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] 10.222.0.33 "GET /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133" status: 200 len: 1555 microversion: 2.91 time: 0.242411 Oct 04 20:45:35.668121 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1296/2657] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:45:35 2022] GET /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133 => generated 1555 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:45:35.668633 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-58e7d55f-7ee6-4b85-b93e-b0089176ceee tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] 10.222.0.33 "GET /compute/v2.1/servers/d849cb42-dfe6-4225-814a-90bef2839739/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077948 Oct 04 20:45:35.674425 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1362/2658] 10.222.0.33 () {58 vars in 1302 bytes} [Tue Oct 4 20:45:35 2022] GET /compute/v2.1/servers/d849cb42-dfe6-4225-814a-90bef2839739/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:45:35.713017 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5691e1af-84f9-4297-8df2-b57913552215 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:35.714022 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-5691e1af-84f9-4297-8df2-b57913552215 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] [instance: bdfb94ca-ded6-4af0-bd9f-59fc877c4c0a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:35.721088 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5691e1af-84f9-4297-8df2-b57913552215 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:35.722189 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5691e1af-84f9-4297-8df2-b57913552215 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:35.723070 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5691e1af-84f9-4297-8df2-b57913552215 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:35.723958 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5691e1af-84f9-4297-8df2-b57913552215 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:35.724569 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5691e1af-84f9-4297-8df2-b57913552215 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:35.725153 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5691e1af-84f9-4297-8df2-b57913552215 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:35.890509 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-5691e1af-84f9-4297-8df2-b57913552215 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87dcc7baf63f4ae6bfe0a099adffd408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7097bc12179446f6a3e1fac8434d5c64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:35.899421 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5691e1af-84f9-4297-8df2-b57913552215 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] 10.222.0.33 "GET /compute/v2.1/servers/bdfb94ca-ded6-4af0-bd9f-59fc877c4c0a" status: 200 len: 1308 microversion: 2.1 time: 0.214948 Oct 04 20:45:35.900923 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1297/2659] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:45:35 2022] GET /compute/v2.1/servers/bdfb94ca-ded6-4af0-bd9f-59fc877c4c0a => generated 1308 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:45:36.212583 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-802ae5a1-99ef-409f-99fa-56be243f0c5d tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:36.213874 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-802ae5a1-99ef-409f-99fa-56be243f0c5d tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] [instance: 8917de21-2b45-4249-ae17-17f679d4856f] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:36.222175 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-802ae5a1-99ef-409f-99fa-56be243f0c5d tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:36.223039 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-802ae5a1-99ef-409f-99fa-56be243f0c5d tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:36.223505 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-802ae5a1-99ef-409f-99fa-56be243f0c5d tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:36.228384 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-802ae5a1-99ef-409f-99fa-56be243f0c5d tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:36.228889 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-802ae5a1-99ef-409f-99fa-56be243f0c5d tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:36.229348 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-802ae5a1-99ef-409f-99fa-56be243f0c5d tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:36.325163 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6f55032d-56fa-4de8-9d0d-dc7566a7a413 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Calling method '.version_select at 0x7f3c740bcee0>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:36.430201 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-6f55032d-56fa-4de8-9d0d-dc7566a7a413 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] 10.222.0.33 "GET /compute/v2.1/images/cd92b355-ed64-4588-875e-1d5d7d57c8a4" status: 200 len: 1411 microversion: 2.1 time: 0.108812 Oct 04 20:45:36.443288 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1298/2660] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 20:45:36 2022] GET /compute/v2.1/images/cd92b355-ed64-4588-875e-1d5d7d57c8a4 => generated 1411 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:45:36.505781 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-802ae5a1-99ef-409f-99fa-56be243f0c5d tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0967736982942f0b62db2e0546666cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f86a1d45a94f41bcd1a73694454a0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:36.510129 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:45:36.517483 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-802ae5a1-99ef-409f-99fa-56be243f0c5d tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] 10.222.0.33 "GET /compute/v2.1/servers/8917de21-2b45-4249-ae17-17f679d4856f" status: 200 len: 1318 microversion: 2.1 time: 0.312017 Oct 04 20:45:36.522778 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1363/2661] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:45:36 2022] GET /compute/v2.1/servers/8917de21-2b45-4249-ae17-17f679d4856f => generated 1318 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:45:36.612994 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-55ddebf9-c0e1-4ef6-969c-ec36b595f7fa tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:36.616964 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-55ddebf9-c0e1-4ef6-969c-ec36b595f7fa tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] [instance: 8d3bd4d5-93f3-44f6-ba25-407fe841a180] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:36.626191 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-55ddebf9-c0e1-4ef6-969c-ec36b595f7fa tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:36.627082 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-55ddebf9-c0e1-4ef6-969c-ec36b595f7fa tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:36.627662 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-55ddebf9-c0e1-4ef6-969c-ec36b595f7fa tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:36.628518 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-55ddebf9-c0e1-4ef6-969c-ec36b595f7fa tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:36.629218 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-55ddebf9-c0e1-4ef6-969c-ec36b595f7fa tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:36.629910 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-55ddebf9-c0e1-4ef6-969c-ec36b595f7fa tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:36.682637 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-1ee9ce39-a14c-4347-a550-d2aa97f40f77 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:36.685076 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-1ee9ce39-a14c-4347-a550-d2aa97f40f77 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] [instance: d849cb42-dfe6-4225-814a-90bef2839739] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:36.702229 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1ee9ce39-a14c-4347-a550-d2aa97f40f77 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:36.702769 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1ee9ce39-a14c-4347-a550-d2aa97f40f77 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:36.703215 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1ee9ce39-a14c-4347-a550-d2aa97f40f77 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:36.703944 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1ee9ce39-a14c-4347-a550-d2aa97f40f77 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:36.704404 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1ee9ce39-a14c-4347-a550-d2aa97f40f77 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:36.704839 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1ee9ce39-a14c-4347-a550-d2aa97f40f77 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:36.795518 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-1ee9ce39-a14c-4347-a550-d2aa97f40f77 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] 10.222.0.33 "GET /compute/v2.1/servers/d849cb42-dfe6-4225-814a-90bef2839739/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.113487 Oct 04 20:45:36.796479 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1364/2662] 10.222.0.33 () {58 vars in 1302 bytes} [Tue Oct 4 20:45:36 2022] GET /compute/v2.1/servers/d849cb42-dfe6-4225-814a-90bef2839739/os-volume_attachments => generated 197 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:45:36.802720 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-55ddebf9-c0e1-4ef6-969c-ec36b595f7fa tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e1ca325fc147eaaf49b067ab20cd52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0c55e5899c472a88528599880689cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:36.810528 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-8a7db5d8-7b37-445a-ae2d-cc3a3a6721f7 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:36.811164 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-8a7db5d8-7b37-445a-ae2d-cc3a3a6721f7 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] [instance: 39d66e18-289f-4674-b66c-146d68ef9133] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:36.814704 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-55ddebf9-c0e1-4ef6-969c-ec36b595f7fa tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77e1ca325fc147eaaf49b067ab20cd52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0c55e5899c472a88528599880689cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:36.816588 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-55ddebf9-c0e1-4ef6-969c-ec36b595f7fa tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77e1ca325fc147eaaf49b067ab20cd52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0c55e5899c472a88528599880689cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:36.818011 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-55ddebf9-c0e1-4ef6-969c-ec36b595f7fa tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] 10.222.0.33 "GET /compute/v2.1/servers/8d3bd4d5-93f3-44f6-ba25-407fe841a180" status: 200 len: 1558 microversion: 2.21 time: 0.209619 Oct 04 20:45:36.831192 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8a7db5d8-7b37-445a-ae2d-cc3a3a6721f7 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:36.831693 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8a7db5d8-7b37-445a-ae2d-cc3a3a6721f7 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:36.832392 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8a7db5d8-7b37-445a-ae2d-cc3a3a6721f7 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:36.833082 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1299/2663] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:45:36 2022] GET /compute/v2.1/servers/8d3bd4d5-93f3-44f6-ba25-407fe841a180 => generated 1558 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:45:36.833197 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8a7db5d8-7b37-445a-ae2d-cc3a3a6721f7 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:36.837989 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8a7db5d8-7b37-445a-ae2d-cc3a3a6721f7 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:36.837989 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8a7db5d8-7b37-445a-ae2d-cc3a3a6721f7 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:36.923167 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-fa2084d3-82c7-44dc-b57f-6352b4d9ad05 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:36.923931 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-fa2084d3-82c7-44dc-b57f-6352b4d9ad05 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] [instance: bdfb94ca-ded6-4af0-bd9f-59fc877c4c0a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:36.937251 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fa2084d3-82c7-44dc-b57f-6352b4d9ad05 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:36.937855 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fa2084d3-82c7-44dc-b57f-6352b4d9ad05 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:36.947728 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fa2084d3-82c7-44dc-b57f-6352b4d9ad05 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:36.948551 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fa2084d3-82c7-44dc-b57f-6352b4d9ad05 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:36.949031 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fa2084d3-82c7-44dc-b57f-6352b4d9ad05 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:36.949469 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fa2084d3-82c7-44dc-b57f-6352b4d9ad05 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:36.985944 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-8a7db5d8-7b37-445a-ae2d-cc3a3a6721f7 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:37.002998 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-8a7db5d8-7b37-445a-ae2d-cc3a3a6721f7 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:37.006863 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-8a7db5d8-7b37-445a-ae2d-cc3a3a6721f7 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:37.017174 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-8a7db5d8-7b37-445a-ae2d-cc3a3a6721f7 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] 10.222.0.33 "GET /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133" status: 200 len: 1555 microversion: 2.91 time: 0.219611 Oct 04 20:45:37.053952 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1365/2664] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:45:36 2022] GET /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133 => generated 1555 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:45:37.255026 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-fa2084d3-82c7-44dc-b57f-6352b4d9ad05 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87dcc7baf63f4ae6bfe0a099adffd408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7097bc12179446f6a3e1fac8434d5c64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:37.267076 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-fa2084d3-82c7-44dc-b57f-6352b4d9ad05 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] 10.222.0.33 "GET /compute/v2.1/servers/bdfb94ca-ded6-4af0-bd9f-59fc877c4c0a" status: 200 len: 1308 microversion: 2.1 time: 0.347806 Oct 04 20:45:37.283555 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1300/2665] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:45:36 2022] GET /compute/v2.1/servers/bdfb94ca-ded6-4af0-bd9f-59fc877c4c0a => generated 1308 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:45:37.449749 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-2b9674c6-9bbc-4ef5-8dee-28fdfecbb351 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Calling method '.version_select at 0x7f3c7428b820>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:37.461588 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-590b06ff-4219-4a6f-9e74-afa68c82fc87 req-cf52d27e-b9a2-459a-b72e-0ad75a7e39f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d3bd4d5-93f3-44f6-ba25-407fe841a180", "name": "network-vif-deleted", "tag": "af188aff-36f2-4e40-9ac2-436505b0767c"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:45:37.482069 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-590b06ff-4219-4a6f-9e74-afa68c82fc87 req-cf52d27e-b9a2-459a-b72e-0ad75a7e39f4 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:37.482921 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-590b06ff-4219-4a6f-9e74-afa68c82fc87 req-cf52d27e-b9a2-459a-b72e-0ad75a7e39f4 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:37.483559 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-590b06ff-4219-4a6f-9e74-afa68c82fc87 req-cf52d27e-b9a2-459a-b72e-0ad75a7e39f4 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:37.518646 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-2b9674c6-9bbc-4ef5-8dee-28fdfecbb351 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] 10.222.0.33 "GET /compute/v2.1/images/cd92b355-ed64-4588-875e-1d5d7d57c8a4" status: 200 len: 1411 microversion: 2.1 time: 0.074291 Oct 04 20:45:37.519825 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1366/2666] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 20:45:37 2022] GET /compute/v2.1/images/cd92b355-ed64-4588-875e-1d5d7d57c8a4 => generated 1411 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:45:37.545850 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-590b06ff-4219-4a6f-9e74-afa68c82fc87 req-cf52d27e-b9a2-459a-b72e-0ad75a7e39f4 service nova] Creating event network-vif-deleted:af188aff-36f2-4e40-9ac2-436505b0767c for instance 8d3bd4d5-93f3-44f6-ba25-407fe841a180 on n-h2-854823-8 Oct 04 20:45:37.556871 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-f0e2412b-3c03-4340-8e89-8f43870fe6c3 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:37.557515 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-f0e2412b-3c03-4340-8e89-8f43870fe6c3 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] [instance: 8917de21-2b45-4249-ae17-17f679d4856f] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:37.565206 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-590b06ff-4219-4a6f-9e74-afa68c82fc87 req-cf52d27e-b9a2-459a-b72e-0ad75a7e39f4 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115760 Oct 04 20:45:37.567011 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1301/2667] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:45:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 20:45:37.575833 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f0e2412b-3c03-4340-8e89-8f43870fe6c3 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:37.576362 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f0e2412b-3c03-4340-8e89-8f43870fe6c3 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:37.577757 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f0e2412b-3c03-4340-8e89-8f43870fe6c3 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:37.578648 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f0e2412b-3c03-4340-8e89-8f43870fe6c3 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:37.581534 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f0e2412b-3c03-4340-8e89-8f43870fe6c3 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:37.582644 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f0e2412b-3c03-4340-8e89-8f43870fe6c3 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:37.825782 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a1fee684-1c85-4e52-9f49-d1cc8a6a0023 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:37.832470 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a1fee684-1c85-4e52-9f49-d1cc8a6a0023 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] [instance: d849cb42-dfe6-4225-814a-90bef2839739] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:37.855576 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a1fee684-1c85-4e52-9f49-d1cc8a6a0023 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:37.856081 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a1fee684-1c85-4e52-9f49-d1cc8a6a0023 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:37.856518 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a1fee684-1c85-4e52-9f49-d1cc8a6a0023 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:37.857263 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a1fee684-1c85-4e52-9f49-d1cc8a6a0023 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:37.862862 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a1fee684-1c85-4e52-9f49-d1cc8a6a0023 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:37.863748 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a1fee684-1c85-4e52-9f49-d1cc8a6a0023 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:37.866048 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-f0e2412b-3c03-4340-8e89-8f43870fe6c3 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0967736982942f0b62db2e0546666cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f86a1d45a94f41bcd1a73694454a0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:37.881821 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-f0e2412b-3c03-4340-8e89-8f43870fe6c3 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] 10.222.0.33 "GET /compute/v2.1/servers/8917de21-2b45-4249-ae17-17f679d4856f" status: 200 len: 1468 microversion: 2.1 time: 0.329176 Oct 04 20:45:37.884496 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1367/2668] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:45:37 2022] GET /compute/v2.1/servers/8917de21-2b45-4249-ae17-17f679d4856f => generated 1468 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:45:37.896435 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-a19c2d22-fac7-4f0c-880b-3be43f823cc1 tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:37.897576 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-a19c2d22-fac7-4f0c-880b-3be43f823cc1 tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] [instance: 8d3bd4d5-93f3-44f6-ba25-407fe841a180] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:37.914860 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a19c2d22-fac7-4f0c-880b-3be43f823cc1 tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:37.916525 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a19c2d22-fac7-4f0c-880b-3be43f823cc1 tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:37.919934 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a19c2d22-fac7-4f0c-880b-3be43f823cc1 tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:37.920803 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a19c2d22-fac7-4f0c-880b-3be43f823cc1 tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:37.924679 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a19c2d22-fac7-4f0c-880b-3be43f823cc1 tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:37.925273 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a19c2d22-fac7-4f0c-880b-3be43f823cc1 tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:37.975175 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a1fee684-1c85-4e52-9f49-d1cc8a6a0023 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] 10.222.0.33 "GET /compute/v2.1/servers/d849cb42-dfe6-4225-814a-90bef2839739/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.169551 Oct 04 20:45:37.981775 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1302/2669] 10.222.0.33 () {58 vars in 1302 bytes} [Tue Oct 4 20:45:37 2022] GET /compute/v2.1/servers/d849cb42-dfe6-4225-814a-90bef2839739/os-volume_attachments => generated 197 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:45:37.987615 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e80f50a5-52bc-48a1-bbdf-a7f2c22ef5f1 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:37.988539 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e80f50a5-52bc-48a1-bbdf-a7f2c22ef5f1 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] [instance: 291474d2-a375-4974-abec-713900c08119] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:37.995407 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e80f50a5-52bc-48a1-bbdf-a7f2c22ef5f1 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:37.997313 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e80f50a5-52bc-48a1-bbdf-a7f2c22ef5f1 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:37.998051 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e80f50a5-52bc-48a1-bbdf-a7f2c22ef5f1 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:37.999042 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e80f50a5-52bc-48a1-bbdf-a7f2c22ef5f1 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:37.999729 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e80f50a5-52bc-48a1-bbdf-a7f2c22ef5f1 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:38.000393 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e80f50a5-52bc-48a1-bbdf-a7f2c22ef5f1 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:38.008314 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a19c2d22-fac7-4f0c-880b-3be43f823cc1 tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:38.012640 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a19c2d22-fac7-4f0c-880b-3be43f823cc1 tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:38.013118 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a19c2d22-fac7-4f0c-880b-3be43f823cc1 tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:38.015668 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.objects.instance [None req-a19c2d22-fac7-4f0c-880b-3be43f823cc1 tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Lazy-loading 'fault' on Instance uuid 8d3bd4d5-93f3-44f6-ba25-407fe841a180 {{(pid=128802) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:45:38.202369 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-a19c2d22-fac7-4f0c-880b-3be43f823cc1 tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e1ca325fc147eaaf49b067ab20cd52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0c55e5899c472a88528599880689cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:38.214768 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-a19c2d22-fac7-4f0c-880b-3be43f823cc1 tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77e1ca325fc147eaaf49b067ab20cd52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0c55e5899c472a88528599880689cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:38.219197 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-a19c2d22-fac7-4f0c-880b-3be43f823cc1 tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77e1ca325fc147eaaf49b067ab20cd52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0c55e5899c472a88528599880689cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:38.222947 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-a19c2d22-fac7-4f0c-880b-3be43f823cc1 tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] 10.222.0.33 "GET /compute/v2.1/servers/8d3bd4d5-93f3-44f6-ba25-407fe841a180" status: 200 len: 1349 microversion: 2.21 time: 0.337350 Oct 04 20:45:38.235460 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1368/2670] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:45:37 2022] GET /compute/v2.1/servers/8d3bd4d5-93f3-44f6-ba25-407fe841a180 => generated 1349 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:45:38.235996 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-32268060-fa01-4397-bf87-5752134301b5 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:38.243379 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-32268060-fa01-4397-bf87-5752134301b5 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] [instance: 39d66e18-289f-4674-b66c-146d68ef9133] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:38.250214 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-32268060-fa01-4397-bf87-5752134301b5 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:38.251202 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-32268060-fa01-4397-bf87-5752134301b5 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:38.251834 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-32268060-fa01-4397-bf87-5752134301b5 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:38.252861 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-32268060-fa01-4397-bf87-5752134301b5 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:38.253687 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-32268060-fa01-4397-bf87-5752134301b5 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:38.254385 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-32268060-fa01-4397-bf87-5752134301b5 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:38.305647 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e80f50a5-52bc-48a1-bbdf-a7f2c22ef5f1 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0967736982942f0b62db2e0546666cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f86a1d45a94f41bcd1a73694454a0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:38.318610 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e80f50a5-52bc-48a1-bbdf-a7f2c22ef5f1 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] 10.222.0.33 "GET /compute/v2.1/servers/291474d2-a375-4974-abec-713900c08119" status: 200 len: 1467 microversion: 2.1 time: 0.334384 Oct 04 20:45:38.321413 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1303/2671] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:45:37 2022] GET /compute/v2.1/servers/291474d2-a375-4974-abec-713900c08119 => generated 1467 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:45:38.326246 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e220d58d-ba36-4fcc-b4eb-54f2ae8fbcdd tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:38.327118 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e220d58d-ba36-4fcc-b4eb-54f2ae8fbcdd tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] [instance: bdfb94ca-ded6-4af0-bd9f-59fc877c4c0a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:38.331407 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=97,nova_api:UPDATE=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:45:38.335302 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e220d58d-ba36-4fcc-b4eb-54f2ae8fbcdd tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:38.336571 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e220d58d-ba36-4fcc-b4eb-54f2ae8fbcdd tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:38.347832 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e220d58d-ba36-4fcc-b4eb-54f2ae8fbcdd tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:38.349943 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e220d58d-ba36-4fcc-b4eb-54f2ae8fbcdd tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:38.358592 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e220d58d-ba36-4fcc-b4eb-54f2ae8fbcdd tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:38.359370 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e220d58d-ba36-4fcc-b4eb-54f2ae8fbcdd tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:38.384739 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-32268060-fa01-4397-bf87-5752134301b5 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:38.398819 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-32268060-fa01-4397-bf87-5752134301b5 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:38.401128 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-32268060-fa01-4397-bf87-5752134301b5 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:38.432053 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-32268060-fa01-4397-bf87-5752134301b5 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] 10.222.0.33 "GET /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133" status: 200 len: 1555 microversion: 2.91 time: 0.206060 Oct 04 20:45:38.448407 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1369/2672] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:45:38 2022] GET /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133 => generated 1555 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:45:38.462982 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-440ceae6-1fcd-4566-b550-b799cbd81a6c tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1840117918"}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:45:38.466500 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-440ceae6-1fcd-4566-b550-b799cbd81a6c tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] [instance: 291474d2-a375-4974-abec-713900c08119] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:38.489509 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-440ceae6-1fcd-4566-b550-b799cbd81a6c tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:38.491674 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-440ceae6-1fcd-4566-b550-b799cbd81a6c tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:38.508483 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-440ceae6-1fcd-4566-b550-b799cbd81a6c tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:38.511147 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-440ceae6-1fcd-4566-b550-b799cbd81a6c tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:38.512245 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-440ceae6-1fcd-4566-b550-b799cbd81a6c tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:38.514621 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-440ceae6-1fcd-4566-b550-b799cbd81a6c tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:38.678099 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e220d58d-ba36-4fcc-b4eb-54f2ae8fbcdd tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87dcc7baf63f4ae6bfe0a099adffd408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7097bc12179446f6a3e1fac8434d5c64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:38.691148 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e220d58d-ba36-4fcc-b4eb-54f2ae8fbcdd tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] 10.222.0.33 "GET /compute/v2.1/servers/bdfb94ca-ded6-4af0-bd9f-59fc877c4c0a" status: 200 len: 1308 microversion: 2.1 time: 0.368437 Oct 04 20:45:38.691837 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1304/2673] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:45:38 2022] GET /compute/v2.1/servers/bdfb94ca-ded6-4af0-bd9f-59fc877c4c0a => generated 1308 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:45:38.706526 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d6e91786-05e4-47b8-95b4-f1766776f2a4 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Calling method '.version_select at 0x7f3c740ac790>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:38.927416 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d6e91786-05e4-47b8-95b4-f1766776f2a4 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] 10.222.0.33 "GET /compute/v2.1/images/cd92b355-ed64-4588-875e-1d5d7d57c8a4" status: 200 len: 1411 microversion: 2.1 time: 0.234524 Oct 04 20:45:38.938853 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1305/2674] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 20:45:38 2022] GET /compute/v2.1/images/cd92b355-ed64-4588-875e-1d5d7d57c8a4 => generated 1411 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:45:38.944183 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-f404f582-2ef8-4515-b5ec-d4cf4d4baec6 req-06b893a2-033a-46fd-a84b-776a8b636092 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bdfb94ca-ded6-4af0-bd9f-59fc877c4c0a", "name": "network-vif-plugged", "status": "completed", "tag": "2f68ae5c-502d-4266-a29b-038838a4abd1"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:45:38.978296 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-440ceae6-1fcd-4566-b550-b799cbd81a6c tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] 10.222.0.33 "POST /compute/v2.1/servers/291474d2-a375-4974-abec-713900c08119/action" status: 202 len: 0 microversion: 2.1 time: 0.524551 Oct 04 20:45:38.983666 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1370/2675] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 20:45:38 2022] POST /compute/v2.1/servers/291474d2-a375-4974-abec-713900c08119/action => generated 0 bytes in 534 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 04 20:45:38.995680 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-0697db0a-7b36-42fd-ad4a-de155afafd50 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:39.002209 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-0697db0a-7b36-42fd-ad4a-de155afafd50 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] [instance: d849cb42-dfe6-4225-814a-90bef2839739] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:39.004833 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-f404f582-2ef8-4515-b5ec-d4cf4d4baec6 req-06b893a2-033a-46fd-a84b-776a8b636092 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:39.020378 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-f404f582-2ef8-4515-b5ec-d4cf4d4baec6 req-06b893a2-033a-46fd-a84b-776a8b636092 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:39.021181 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-f404f582-2ef8-4515-b5ec-d4cf4d4baec6 req-06b893a2-033a-46fd-a84b-776a8b636092 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:39.039813 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0697db0a-7b36-42fd-ad4a-de155afafd50 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:39.041565 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0697db0a-7b36-42fd-ad4a-de155afafd50 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:39.042024 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0697db0a-7b36-42fd-ad4a-de155afafd50 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:39.044516 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0697db0a-7b36-42fd-ad4a-de155afafd50 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:39.044993 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0697db0a-7b36-42fd-ad4a-de155afafd50 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:39.045432 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0697db0a-7b36-42fd-ad4a-de155afafd50 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:39.068185 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-f404f582-2ef8-4515-b5ec-d4cf4d4baec6 req-06b893a2-033a-46fd-a84b-776a8b636092 service nova] Creating event network-vif-plugged:2f68ae5c-502d-4266-a29b-038838a4abd1 for instance bdfb94ca-ded6-4af0-bd9f-59fc877c4c0a on n-h1-854823-8 Oct 04 20:45:39.090821 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-f404f582-2ef8-4515-b5ec-d4cf4d4baec6 req-06b893a2-033a-46fd-a84b-776a8b636092 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.146156 Oct 04 20:45:39.092019 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1306/2676] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:45:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:45:39.115887 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c8e6f25d-3470-47ac-99fa-006677d21bd6 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Calling method '.version_select at 0x7f3c745bf280>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:39.182667 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-0697db0a-7b36-42fd-ad4a-de155afafd50 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] 10.222.0.33 "GET /compute/v2.1/servers/d849cb42-dfe6-4225-814a-90bef2839739/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.197573 Oct 04 20:45:39.186612 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1371/2677] 10.222.0.33 () {58 vars in 1302 bytes} [Tue Oct 4 20:45:38 2022] GET /compute/v2.1/servers/d849cb42-dfe6-4225-814a-90bef2839739/os-volume_attachments => generated 197 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:45:39.251903 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-0bc259c7-45d9-40c5-8526-3cd36a3bbef0 tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:39.252670 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-0bc259c7-45d9-40c5-8526-3cd36a3bbef0 tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] [instance: 8d3bd4d5-93f3-44f6-ba25-407fe841a180] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:39.274871 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0bc259c7-45d9-40c5-8526-3cd36a3bbef0 tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:39.275375 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0bc259c7-45d9-40c5-8526-3cd36a3bbef0 tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:39.275821 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0bc259c7-45d9-40c5-8526-3cd36a3bbef0 tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:39.276536 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0bc259c7-45d9-40c5-8526-3cd36a3bbef0 tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:39.292536 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0bc259c7-45d9-40c5-8526-3cd36a3bbef0 tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:39.293111 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0bc259c7-45d9-40c5-8526-3cd36a3bbef0 tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:39.332859 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.wsgi [None req-0bc259c7-45d9-40c5-8526-3cd36a3bbef0 tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] HTTP exception thrown: Instance 8d3bd4d5-93f3-44f6-ba25-407fe841a180 could not be found. Oct 04 20:45:39.338377 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-0bc259c7-45d9-40c5-8526-3cd36a3bbef0 tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Request method failure captured: Oct 04 20:45:39.338377 n-d-854823-8 devstack@n-api.service[128802]: request: GET /compute/v2.1/servers/8d3bd4d5-93f3-44f6-ba25-407fe841a180 HTTP/1.1 Oct 04 20:45:39.338377 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 20:45:39.338377 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 20:45:39.338377 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 20:45:39.338377 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 0 Oct 04 20:45:39.338377 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 20:45:39.338377 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 20:45:39.338377 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 20:45:39.338377 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 20:45:39.338377 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPJtYxeyaQLTBHmU6v5ufuQMWH_nruUNecIkTdE9MiSnxtBfviA9_behE8CD0ExEQ9qGvMSa6vJwBbXSeiNpnvSFjcmmD2boSPIHJkhsozBHQrLl_8orm4N9O1GD9nr3cYHMsHfEQ4CnYaeTm9LD5BcvzLhKyC4PuIN6Gr0u8vkw78N8 Oct 04 20:45:39.338377 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 20:45:39.338377 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 20:45:39.338377 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 20:45:39.338377 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 20:45:39.338377 n-d-854823-8 devstack@n-api.service[128802]: X-Openstack-Nova-Api-Version: 2.21 Oct 04 20:45:39.338377 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 20:45:39.338377 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 20:45:39.338377 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: ad0c55e5899c472a88528599880689cc Oct 04 20:45:39.338377 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-InstanceActionsV221TestJSON-120844341 Oct 04 20:45:39.338377 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 20:45:39.338377 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 20:45:39.338377 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ad0c55e5899c472a88528599880689cc", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ad0c55e5899c472a88528599880689cc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ad0c55e5899c472a88528599880689cc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ad0c55e5899c472a88528599880689cc"}]}] Oct 04 20:45:39.338377 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-InstanceActionsV221TestJSON-120844341 Oct 04 20:45:39.338377 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: ad0c55e5899c472a88528599880689cc Oct 04 20:45:39.338377 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-120844341 Oct 04 20:45:39.338377 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-InstanceActionsV221TestJSON-120844341-project Oct 04 20:45:39.338377 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 20:45:39.338377 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 20:45:39.338377 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: 77e1ca325fc147eaaf49b067ab20cd52 Oct 04 20:45:39.338377 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-InstanceActionsV221TestJSON-120844341-project Oct 04 20:45:39.338377 n-d-854823-8 devstack@n-api.service[128802]: method: > Oct 04 20:45:39.338377 n-d-854823-8 devstack@n-api.service[128802]: exception: Instance 8d3bd4d5-93f3-44f6-ba25-407fe841a180 could not be found. Oct 04 20:45:39.338377 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'id': '8d3bd4d5-93f3-44f6-ba25-407fe841a180'} Oct 04 20:45:39.338377 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:45:39.338377 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:45:39.338377 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:45:39.338377 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:45:39.338377 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:45:39.338377 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:45:39.338377 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:45:39.338377 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:45:39.338377 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:45:39.338377 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:45:39.338377 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d3bd4d5-93f3-44f6-ba25-407fe841a180 could not be found. Oct 04 20:45:39.338377 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:45:39.338377 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:45:39.338377 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:45:39.338377 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:45:39.338377 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:45:39.338377 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:45:39.338377 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:45:39.338377 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:45:39.338377 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:45:39.338377 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:45:39.338377 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:45:39.338377 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:45:39.338377 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:45:39.338377 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:45:39.338377 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:45:39.338377 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:45:39.338377 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d3bd4d5-93f3-44f6-ba25-407fe841a180 could not be found. Oct 04 20:45:39.338377 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:45:39.338377 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:45:39.342165 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:45:39.342165 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:45:39.342165 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:45:39.342165 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:45:39.342165 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:45:39.342165 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:45:39.342165 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d3bd4d5-93f3-44f6-ba25-407fe841a180 could not be found. Oct 04 20:45:39.342165 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:45:39.342165 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-0bc259c7-45d9-40c5-8526-3cd36a3bbef0 tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Returning 404 to user: Instance 8d3bd4d5-93f3-44f6-ba25-407fe841a180 could not be found. {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:45:39.342165 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-0bc259c7-45d9-40c5-8526-3cd36a3bbef0 tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] 10.222.0.33 "GET /compute/v2.1/servers/8d3bd4d5-93f3-44f6-ba25-407fe841a180" status: 404 len: 111 microversion: 2.21 time: 0.092919 Oct 04 20:45:39.344566 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1372/2678] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:45:39 2022] GET /compute/v2.1/servers/8d3bd4d5-93f3-44f6-ba25-407fe841a180 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 20:45:39.359357 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-39cf4232-96ab-40cb-92b5-53746ad45640 tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Calling method '.version_select at 0x7f3c7432b5e0>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:39.362015 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-39cf4232-96ab-40cb-92b5-53746ad45640 tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] [instance: 8d3bd4d5-93f3-44f6-ba25-407fe841a180] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:39.380930 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-39cf4232-96ab-40cb-92b5-53746ad45640 tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:39.386358 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-39cf4232-96ab-40cb-92b5-53746ad45640 tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:39.386897 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-39cf4232-96ab-40cb-92b5-53746ad45640 tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:39.387769 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-39cf4232-96ab-40cb-92b5-53746ad45640 tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:39.388250 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-39cf4232-96ab-40cb-92b5-53746ad45640 tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:39.388947 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-39cf4232-96ab-40cb-92b5-53746ad45640 tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:39.583643 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-39cf4232-96ab-40cb-92b5-53746ad45640 tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] 10.222.0.33 "GET /compute/v2.1/servers/8d3bd4d5-93f3-44f6-ba25-407fe841a180/os-instance-actions" status: 200 len: 611 microversion: 2.21 time: 0.233352 Oct 04 20:45:39.593219 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1373/2679] 10.222.0.33 () {60 vars in 1337 bytes} [Tue Oct 4 20:45:39 2022] GET /compute/v2.1/servers/8d3bd4d5-93f3-44f6-ba25-407fe841a180/os-instance-actions => generated 611 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 20:45:39.597741 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-b1a05cae-d58f-4092-a83b-36403da518e5 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:39.607730 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-b1a05cae-d58f-4092-a83b-36403da518e5 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] [instance: 39d66e18-289f-4674-b66c-146d68ef9133] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:39.627771 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b1a05cae-d58f-4092-a83b-36403da518e5 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:39.628290 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b1a05cae-d58f-4092-a83b-36403da518e5 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:39.628966 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b1a05cae-d58f-4092-a83b-36403da518e5 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:39.631969 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b1a05cae-d58f-4092-a83b-36403da518e5 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:39.633060 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b1a05cae-d58f-4092-a83b-36403da518e5 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:39.633507 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b1a05cae-d58f-4092-a83b-36403da518e5 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:39.830278 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-b1a05cae-d58f-4092-a83b-36403da518e5 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:39.866026 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-b1a05cae-d58f-4092-a83b-36403da518e5 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:39.869895 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-b1a05cae-d58f-4092-a83b-36403da518e5 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:39.896659 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-b1a05cae-d58f-4092-a83b-36403da518e5 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] 10.222.0.33 "GET /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133" status: 200 len: 1555 microversion: 2.91 time: 0.308880 Oct 04 20:45:39.924546 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1374/2680] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:45:39 2022] GET /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133 => generated 1555 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:45:39.938465 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-ea81c1b4-1896-48a1-b6b4-64295c70565e tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:39.939336 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-ea81c1b4-1896-48a1-b6b4-64295c70565e tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] [instance: 8d3bd4d5-93f3-44f6-ba25-407fe841a180] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:39.949398 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ea81c1b4-1896-48a1-b6b4-64295c70565e tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:39.950280 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ea81c1b4-1896-48a1-b6b4-64295c70565e tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:39.950992 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ea81c1b4-1896-48a1-b6b4-64295c70565e tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:39.951941 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ea81c1b4-1896-48a1-b6b4-64295c70565e tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:39.952631 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ea81c1b4-1896-48a1-b6b4-64295c70565e tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:39.953276 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ea81c1b4-1896-48a1-b6b4-64295c70565e tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:39.971360 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.wsgi [None req-ea81c1b4-1896-48a1-b6b4-64295c70565e tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] HTTP exception thrown: Instance 8d3bd4d5-93f3-44f6-ba25-407fe841a180 could not be found. Oct 04 20:45:39.973446 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-ea81c1b4-1896-48a1-b6b4-64295c70565e tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Request method failure captured: Oct 04 20:45:39.973446 n-d-854823-8 devstack@n-api.service[128802]: request: DELETE /compute/v2.1/servers/8d3bd4d5-93f3-44f6-ba25-407fe841a180 HTTP/1.1 Oct 04 20:45:39.973446 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 20:45:39.973446 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 20:45:39.973446 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 20:45:39.973446 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 0 Oct 04 20:45:39.973446 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 20:45:39.973446 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 20:45:39.973446 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 20:45:39.973446 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 20:45:39.973446 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPJtYxeyaQLTBHmU6v5ufuQMWH_nruUNecIkTdE9MiSnxtBfviA9_behE8CD0ExEQ9qGvMSa6vJwBbXSeiNpnvSFjcmmD2boSPIHJkhsozBHQrLl_8orm4N9O1GD9nr3cYHMsHfEQ4CnYaeTm9LD5BcvzLhKyC4PuIN6Gr0u8vkw78N8 Oct 04 20:45:39.973446 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 20:45:39.973446 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 20:45:39.973446 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 20:45:39.973446 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 20:45:39.973446 n-d-854823-8 devstack@n-api.service[128802]: X-Openstack-Nova-Api-Version: 2.21 Oct 04 20:45:39.973446 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 20:45:39.973446 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 20:45:39.973446 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: ad0c55e5899c472a88528599880689cc Oct 04 20:45:39.973446 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-InstanceActionsV221TestJSON-120844341 Oct 04 20:45:39.973446 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 20:45:39.973446 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 20:45:39.973446 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ad0c55e5899c472a88528599880689cc", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ad0c55e5899c472a88528599880689cc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ad0c55e5899c472a88528599880689cc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ad0c55e5899c472a88528599880689cc"}]}] Oct 04 20:45:39.973446 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-InstanceActionsV221TestJSON-120844341 Oct 04 20:45:39.973446 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: ad0c55e5899c472a88528599880689cc Oct 04 20:45:39.973446 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-120844341 Oct 04 20:45:39.973446 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-InstanceActionsV221TestJSON-120844341-project Oct 04 20:45:39.973446 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 20:45:39.973446 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 20:45:39.973446 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: 77e1ca325fc147eaaf49b067ab20cd52 Oct 04 20:45:39.973446 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-InstanceActionsV221TestJSON-120844341-project Oct 04 20:45:39.973446 n-d-854823-8 devstack@n-api.service[128802]: method: > Oct 04 20:45:39.973446 n-d-854823-8 devstack@n-api.service[128802]: exception: Instance 8d3bd4d5-93f3-44f6-ba25-407fe841a180 could not be found. Oct 04 20:45:39.973446 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'id': '8d3bd4d5-93f3-44f6-ba25-407fe841a180'} Oct 04 20:45:39.973446 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:45:39.973446 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:45:39.973446 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:45:39.973446 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:45:39.973446 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:45:39.973446 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:45:39.973446 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:45:39.973446 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:45:39.973446 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:45:39.973446 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:45:39.973446 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d3bd4d5-93f3-44f6-ba25-407fe841a180 could not be found. Oct 04 20:45:39.973446 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:45:39.973446 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:45:39.973446 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:45:39.973446 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:45:39.973446 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:45:39.973446 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:45:39.973446 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:45:39.973446 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:45:39.973446 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:45:39.973446 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:45:39.973446 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 20:45:39.973446 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 20:45:39.973446 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 20:45:39.973446 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 20:45:39.973446 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:45:39.973446 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:45:39.973446 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:45:39.973446 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:45:39.978240 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d3bd4d5-93f3-44f6-ba25-407fe841a180 could not be found. Oct 04 20:45:39.978240 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:45:39.978240 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:45:39.978240 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:45:39.978240 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:45:39.978240 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:45:39.978240 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:45:39.978240 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:45:39.978240 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:45:39.978240 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d3bd4d5-93f3-44f6-ba25-407fe841a180 could not be found. Oct 04 20:45:39.978240 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:45:39.981431 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-ea81c1b4-1896-48a1-b6b4-64295c70565e tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Returning 404 to user: Instance 8d3bd4d5-93f3-44f6-ba25-407fe841a180 could not be found. {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:45:39.982680 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-ea81c1b4-1896-48a1-b6b4-64295c70565e tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] 10.222.0.33 "DELETE /compute/v2.1/servers/8d3bd4d5-93f3-44f6-ba25-407fe841a180" status: 404 len: 111 microversion: 2.21 time: 0.056672 Oct 04 20:45:39.986700 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1375/2681] 10.222.0.33 () {60 vars in 1280 bytes} [Tue Oct 4 20:45:39 2022] DELETE /compute/v2.1/servers/8d3bd4d5-93f3-44f6-ba25-407fe841a180 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 20:45:39.991920 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-b32d0b3c-7a4e-498d-9188-0a8c2f287da1 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:39.992821 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-b32d0b3c-7a4e-498d-9188-0a8c2f287da1 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] [instance: bdfb94ca-ded6-4af0-bd9f-59fc877c4c0a] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:39.999444 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b32d0b3c-7a4e-498d-9188-0a8c2f287da1 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:40.000257 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b32d0b3c-7a4e-498d-9188-0a8c2f287da1 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:40.003367 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b32d0b3c-7a4e-498d-9188-0a8c2f287da1 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:40.004413 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b32d0b3c-7a4e-498d-9188-0a8c2f287da1 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:40.005106 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b32d0b3c-7a4e-498d-9188-0a8c2f287da1 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:40.005758 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b32d0b3c-7a4e-498d-9188-0a8c2f287da1 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:40.252496 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-b32d0b3c-7a4e-498d-9188-0a8c2f287da1 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87dcc7baf63f4ae6bfe0a099adffd408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7097bc12179446f6a3e1fac8434d5c64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:40.261598 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-b32d0b3c-7a4e-498d-9188-0a8c2f287da1 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] 10.222.0.33 "GET /compute/v2.1/servers/bdfb94ca-ded6-4af0-bd9f-59fc877c4c0a" status: 200 len: 1308 microversion: 2.1 time: 0.273534 Oct 04 20:45:40.262516 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1376/2682] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:45:39 2022] GET /compute/v2.1/servers/bdfb94ca-ded6-4af0-bd9f-59fc877c4c0a => generated 1308 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:45:40.267270 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-3bfe370d-eae4-4359-a93a-effd5974003e tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Calling method '.version_select at 0x7f3c7420f0d0>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:42.573633 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c8e6f25d-3470-47ac-99fa-006677d21bd6 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] 10.222.0.33 "GET /compute/v2.1/images/9fbc16b1-0e5d-475b-b380-8e5a6992900a" status: 200 len: 1455 microversion: 2.1 time: 3.480221 Oct 04 20:45:42.574219 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1307/2683] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 20:45:39 2022] GET /compute/v2.1/images/9fbc16b1-0e5d-475b-b380-8e5a6992900a => generated 1455 bytes in 3481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:45:42.591392 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-27b2e858-90ef-41ea-9d31-0f5e3782cf00 tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:42.594619 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-27b2e858-90ef-41ea-9d31-0f5e3782cf00 tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] [instance: 8d3bd4d5-93f3-44f6-ba25-407fe841a180] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:42.611544 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-27b2e858-90ef-41ea-9d31-0f5e3782cf00 tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:42.614925 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-27b2e858-90ef-41ea-9d31-0f5e3782cf00 tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:42.616231 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-27b2e858-90ef-41ea-9d31-0f5e3782cf00 tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:42.620117 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-27b2e858-90ef-41ea-9d31-0f5e3782cf00 tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:42.621947 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-27b2e858-90ef-41ea-9d31-0f5e3782cf00 tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:42.623218 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-27b2e858-90ef-41ea-9d31-0f5e3782cf00 tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:42.667350 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-27b2e858-90ef-41ea-9d31-0f5e3782cf00 tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] HTTP exception thrown: Instance 8d3bd4d5-93f3-44f6-ba25-407fe841a180 could not be found. Oct 04 20:45:42.669014 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-27b2e858-90ef-41ea-9d31-0f5e3782cf00 tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Request method failure captured: Oct 04 20:45:42.669014 n-d-854823-8 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/8d3bd4d5-93f3-44f6-ba25-407fe841a180 HTTP/1.1 Oct 04 20:45:42.669014 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:45:42.669014 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:45:42.669014 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:45:42.669014 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 0 Oct 04 20:45:42.669014 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:45:42.669014 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:45:42.669014 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:45:42.669014 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:45:42.669014 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJtYxeyaQLTBHmU6v5ufuQMWH_nruUNecIkTdE9MiSnxtBfviA9_behE8CD0ExEQ9qGvMSa6vJwBbXSeiNpnvSFjcmmD2boSPIHJkhsozBHQrLl_8orm4N9O1GD9nr3cYHMsHfEQ4CnYaeTm9LD5BcvzLhKyC4PuIN6Gr0u8vkw78N8 Oct 04 20:45:42.669014 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:45:42.669014 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:45:42.669014 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:45:42.669014 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:45:42.669014 n-d-854823-8 devstack@n-api.service[128801]: X-Openstack-Nova-Api-Version: 2.21 Oct 04 20:45:42.669014 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:45:42.669014 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:45:42.669014 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: ad0c55e5899c472a88528599880689cc Oct 04 20:45:42.669014 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-InstanceActionsV221TestJSON-120844341 Oct 04 20:45:42.669014 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 20:45:42.669014 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 20:45:42.669014 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ad0c55e5899c472a88528599880689cc", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ad0c55e5899c472a88528599880689cc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ad0c55e5899c472a88528599880689cc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ad0c55e5899c472a88528599880689cc"}]}] Oct 04 20:45:42.669014 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-InstanceActionsV221TestJSON-120844341 Oct 04 20:45:42.669014 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: ad0c55e5899c472a88528599880689cc Oct 04 20:45:42.669014 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-120844341 Oct 04 20:45:42.669014 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-InstanceActionsV221TestJSON-120844341-project Oct 04 20:45:42.669014 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:45:42.669014 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:45:42.669014 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: 77e1ca325fc147eaaf49b067ab20cd52 Oct 04 20:45:42.669014 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-InstanceActionsV221TestJSON-120844341-project Oct 04 20:45:42.669014 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 20:45:42.669014 n-d-854823-8 devstack@n-api.service[128801]: exception: Instance 8d3bd4d5-93f3-44f6-ba25-407fe841a180 could not be found. Oct 04 20:45:42.669014 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': '8d3bd4d5-93f3-44f6-ba25-407fe841a180'} Oct 04 20:45:42.669014 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:45:42.669014 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:45:42.669014 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:45:42.669014 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:45:42.669014 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:45:42.669014 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:45:42.669014 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:45:42.669014 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:45:42.669014 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:45:42.669014 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:45:42.669014 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d3bd4d5-93f3-44f6-ba25-407fe841a180 could not be found. Oct 04 20:45:42.669014 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:45:42.669014 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:45:42.669014 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:45:42.669014 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:45:42.669014 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:45:42.669014 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:45:42.669014 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:45:42.669014 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:45:42.669014 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:45:42.669014 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:45:42.669014 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:45:42.669014 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:45:42.669014 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:45:42.669014 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:45:42.669014 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:45:42.669014 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:45:42.669014 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d3bd4d5-93f3-44f6-ba25-407fe841a180 could not be found. Oct 04 20:45:42.669014 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:45:42.669014 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:45:42.673536 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:45:42.673536 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:45:42.673536 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:45:42.673536 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:45:42.673536 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:45:42.673536 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:45:42.673536 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d3bd4d5-93f3-44f6-ba25-407fe841a180 could not be found. Oct 04 20:45:42.673536 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:45:42.678777 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-27b2e858-90ef-41ea-9d31-0f5e3782cf00 tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] Returning 404 to user: Instance 8d3bd4d5-93f3-44f6-ba25-407fe841a180 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:45:42.687779 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-27b2e858-90ef-41ea-9d31-0f5e3782cf00 tempest-InstanceActionsV221TestJSON-120844341 tempest-InstanceActionsV221TestJSON-120844341-project] 10.222.0.33 "GET /compute/v2.1/servers/8d3bd4d5-93f3-44f6-ba25-407fe841a180" status: 404 len: 111 microversion: 2.21 time: 0.102152 Oct 04 20:45:42.690631 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1308/2684] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:45:42 2022] GET /compute/v2.1/servers/8d3bd4d5-93f3-44f6-ba25-407fe841a180 => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 20:45:42.708942 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-31f16f7f-addc-42b3-8e9e-f28031917e02 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:42.718082 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-31f16f7f-addc-42b3-8e9e-f28031917e02 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] [instance: d849cb42-dfe6-4225-814a-90bef2839739] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:42.733199 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-31f16f7f-addc-42b3-8e9e-f28031917e02 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:42.735418 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-31f16f7f-addc-42b3-8e9e-f28031917e02 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:42.736362 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-31f16f7f-addc-42b3-8e9e-f28031917e02 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:42.737569 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-31f16f7f-addc-42b3-8e9e-f28031917e02 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:42.738623 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-31f16f7f-addc-42b3-8e9e-f28031917e02 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:42.740602 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-31f16f7f-addc-42b3-8e9e-f28031917e02 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:42.800890 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-3bfe370d-eae4-4359-a93a-effd5974003e tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] 10.222.0.33 "GET /compute/v2.1/images/cd92b355-ed64-4588-875e-1d5d7d57c8a4" status: 200 len: 1411 microversion: 2.1 time: 2.537309 Oct 04 20:45:42.801599 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1377/2685] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 20:45:40 2022] GET /compute/v2.1/images/cd92b355-ed64-4588-875e-1d5d7d57c8a4 => generated 1411 bytes in 2539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:45:42.812957 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-93318c6c-cc80-4a24-b0a2-692ba9c2ad02 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:42.813577 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-93318c6c-cc80-4a24-b0a2-692ba9c2ad02 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] [instance: 39d66e18-289f-4674-b66c-146d68ef9133] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:42.829001 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-31f16f7f-addc-42b3-8e9e-f28031917e02 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] 10.222.0.33 "GET /compute/v2.1/servers/d849cb42-dfe6-4225-814a-90bef2839739/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.137012 Oct 04 20:45:42.829594 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1309/2686] 10.222.0.33 () {58 vars in 1302 bytes} [Tue Oct 4 20:45:42 2022] GET /compute/v2.1/servers/d849cb42-dfe6-4225-814a-90bef2839739/os-volume_attachments => generated 197 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:45:42.834377 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-93318c6c-cc80-4a24-b0a2-692ba9c2ad02 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:42.835946 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-93318c6c-cc80-4a24-b0a2-692ba9c2ad02 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:42.836571 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-93318c6c-cc80-4a24-b0a2-692ba9c2ad02 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:42.837450 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-93318c6c-cc80-4a24-b0a2-692ba9c2ad02 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:42.838132 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-93318c6c-cc80-4a24-b0a2-692ba9c2ad02 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:42.838249 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-63c965ad-8b3c-4a67-89bb-5f4cea1c3355 req-79f880dd-676c-461a-9653-de96ad0d0722 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c79c0cc3-17e6-4c35-b17e-c76c9b7e9e39", "name": "network-vif-plugged", "status": "completed", "tag": "f2fef876-3f0a-43e8-af74-a8f0135c6b3f"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:45:42.838954 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-93318c6c-cc80-4a24-b0a2-692ba9c2ad02 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:42.887627 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-63c965ad-8b3c-4a67-89bb-5f4cea1c3355 req-79f880dd-676c-461a-9653-de96ad0d0722 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:42.888109 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-63c965ad-8b3c-4a67-89bb-5f4cea1c3355 req-79f880dd-676c-461a-9653-de96ad0d0722 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:42.888539 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-63c965ad-8b3c-4a67-89bb-5f4cea1c3355 req-79f880dd-676c-461a-9653-de96ad0d0722 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:42.912451 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-63c965ad-8b3c-4a67-89bb-5f4cea1c3355 req-79f880dd-676c-461a-9653-de96ad0d0722 service nova] Creating event network-vif-plugged:f2fef876-3f0a-43e8-af74-a8f0135c6b3f for instance c79c0cc3-17e6-4c35-b17e-c76c9b7e9e39 on n-h2-854823-8 Oct 04 20:45:42.923283 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-63c965ad-8b3c-4a67-89bb-5f4cea1c3355 req-79f880dd-676c-461a-9653-de96ad0d0722 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088733 Oct 04 20:45:42.926171 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1310/2687] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:45:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:45:42.934064 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6929e98a-34bb-46a7-b8c6-726e8c297421 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:42.935278 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-6929e98a-34bb-46a7-b8c6-726e8c297421 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] [instance: bdfb94ca-ded6-4af0-bd9f-59fc877c4c0a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:42.942779 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6929e98a-34bb-46a7-b8c6-726e8c297421 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:42.943498 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6929e98a-34bb-46a7-b8c6-726e8c297421 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:42.944115 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6929e98a-34bb-46a7-b8c6-726e8c297421 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:42.946602 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6929e98a-34bb-46a7-b8c6-726e8c297421 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:42.947300 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6929e98a-34bb-46a7-b8c6-726e8c297421 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:42.947894 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6929e98a-34bb-46a7-b8c6-726e8c297421 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:42.984764 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:45:43.005058 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-93318c6c-cc80-4a24-b0a2-692ba9c2ad02 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:43.023653 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-93318c6c-cc80-4a24-b0a2-692ba9c2ad02 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:43.030463 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-93318c6c-cc80-4a24-b0a2-692ba9c2ad02 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:43.044182 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:45:43.046956 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-93318c6c-cc80-4a24-b0a2-692ba9c2ad02 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] 10.222.0.33 "GET /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133" status: 200 len: 1555 microversion: 2.91 time: 0.244127 Oct 04 20:45:43.048159 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1378/2688] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:45:42 2022] GET /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133 => generated 1555 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:45:43.376489 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-6929e98a-34bb-46a7-b8c6-726e8c297421 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87dcc7baf63f4ae6bfe0a099adffd408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7097bc12179446f6a3e1fac8434d5c64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:43.390520 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-6929e98a-34bb-46a7-b8c6-726e8c297421 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] 10.222.0.33 "GET /compute/v2.1/servers/bdfb94ca-ded6-4af0-bd9f-59fc877c4c0a" status: 200 len: 1489 microversion: 2.1 time: 0.461984 Oct 04 20:45:43.394761 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1311/2689] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:45:42 2022] GET /compute/v2.1/servers/bdfb94ca-ded6-4af0-bd9f-59fc877c4c0a => generated 1489 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:45:43.559836 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-192a22b8-26bd-49d4-95ff-6a3d0a05e18e tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-346403381", "imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63", "flavorRef": "452", "networks": [{"uuid": "a32beee4-b00b-48d9-8656-e7b824aeffce"}]}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:45:43.591188 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7e96db5b-2dba-48d9-a4fc-f90aeaa81604 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Calling method '.version_select at 0x7f3c6fa4d8b0>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:52.942106 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=10 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:45:53.010911 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:45:53.383204 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:45:53.646533 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_api:SELECT=3 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:45:56.543584 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-7e96db5b-2dba-48d9-a4fc-f90aeaa81604 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] 10.222.0.33 "GET /compute/v2.1/images/9fbc16b1-0e5d-475b-b380-8e5a6992900a" status: 200 len: 1455 microversion: 2.1 time: 12.958167 Oct 04 20:45:56.544238 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.network.neutron [None req-192a22b8-26bd-49d4-95ff-6a3d0a05e18e tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] validate_networks() for [('a32beee4-b00b-48d9-8656-e7b824aeffce', None, None, None, None, None)] {{(pid=128802) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:45:56.547392 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1312/2690] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 20:45:43 2022] GET /compute/v2.1/images/9fbc16b1-0e5d-475b-b380-8e5a6992900a => generated 1455 bytes in 12962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:45:56.559815 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-48e4670a-4971-41e1-99a8-015f0fbca89e tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Calling method '.version_select at 0x7f3c6fa5cd30>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:56.624871 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-48e4670a-4971-41e1-99a8-015f0fbca89e tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] 10.222.0.33 "GET /compute/v2.1/images/cd92b355-ed64-4588-875e-1d5d7d57c8a4" status: 200 len: 1411 microversion: 2.1 time: 0.076279 Oct 04 20:45:56.626307 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1313/2691] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 20:45:56 2022] GET /compute/v2.1/images/cd92b355-ed64-4588-875e-1d5d7d57c8a4 => generated 1411 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:45:56.638747 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-79d81f54-01bb-44c0-828f-a7d76ae9543d tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:56.642660 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-79d81f54-01bb-44c0-828f-a7d76ae9543d tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] [instance: d849cb42-dfe6-4225-814a-90bef2839739] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:56.651715 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-79d81f54-01bb-44c0-828f-a7d76ae9543d tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:56.654672 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-79d81f54-01bb-44c0-828f-a7d76ae9543d tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:56.655688 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-79d81f54-01bb-44c0-828f-a7d76ae9543d tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:56.656602 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-79d81f54-01bb-44c0-828f-a7d76ae9543d tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:56.657367 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-79d81f54-01bb-44c0-828f-a7d76ae9543d tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:56.657956 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-79d81f54-01bb-44c0-828f-a7d76ae9543d tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:56.699152 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-79d81f54-01bb-44c0-828f-a7d76ae9543d tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] 10.222.0.33 "GET /compute/v2.1/servers/d849cb42-dfe6-4225-814a-90bef2839739/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.070176 Oct 04 20:45:56.700401 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1314/2692] 10.222.0.33 () {58 vars in 1302 bytes} [Tue Oct 4 20:45:56 2022] GET /compute/v2.1/servers/d849cb42-dfe6-4225-814a-90bef2839739/os-volume_attachments => generated 25 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 20:45:56.706029 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-38195549-07ce-46ef-833c-75bc16c736fa tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:56.707283 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-38195549-07ce-46ef-833c-75bc16c736fa tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] [instance: 39d66e18-289f-4674-b66c-146d68ef9133] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:56.718421 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-38195549-07ce-46ef-833c-75bc16c736fa tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:56.719931 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-38195549-07ce-46ef-833c-75bc16c736fa tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:56.721060 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-38195549-07ce-46ef-833c-75bc16c736fa tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:56.722646 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-38195549-07ce-46ef-833c-75bc16c736fa tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:56.723276 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-38195549-07ce-46ef-833c-75bc16c736fa tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:56.724381 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-38195549-07ce-46ef-833c-75bc16c736fa tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:56.857176 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-38195549-07ce-46ef-833c-75bc16c736fa tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:56.869106 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-38195549-07ce-46ef-833c-75bc16c736fa tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:56.870997 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-38195549-07ce-46ef-833c-75bc16c736fa tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:56.876654 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-38195549-07ce-46ef-833c-75bc16c736fa tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] 10.222.0.33 "GET /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133" status: 200 len: 1480 microversion: 2.91 time: 0.174751 Oct 04 20:45:56.891534 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1315/2693] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:45:56 2022] GET /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133 => generated 1480 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:45:56.907833 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-c292219c-9e12-47d3-b7ea-bfb3734ff56f req-a3767a77-a6b5-4ed6-8165-a502bc2c5785 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d46fff2-b04d-41aa-ada0-2023ab545b48", "name": "network-vif-plugged", "status": "completed", "tag": "39e1fcde-c40c-4b4b-8edd-7565faaf4580"}, {"server_uuid": "291474d2-a375-4974-abec-713900c08119", "name": "network-vif-plugged", "status": "completed", "tag": "744df6f8-0df8-4ff2-b842-56de1314bff3"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:45:56.919986 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-c292219c-9e12-47d3-b7ea-bfb3734ff56f req-a3767a77-a6b5-4ed6-8165-a502bc2c5785 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:56.920805 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-c292219c-9e12-47d3-b7ea-bfb3734ff56f req-a3767a77-a6b5-4ed6-8165-a502bc2c5785 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:56.921459 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-c292219c-9e12-47d3-b7ea-bfb3734ff56f req-a3767a77-a6b5-4ed6-8165-a502bc2c5785 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:56.940067 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-c292219c-9e12-47d3-b7ea-bfb3734ff56f req-a3767a77-a6b5-4ed6-8165-a502bc2c5785 service nova] Creating event network-vif-plugged:39e1fcde-c40c-4b4b-8edd-7565faaf4580 for instance 4d46fff2-b04d-41aa-ada0-2023ab545b48 on n-h1-854823-8 Oct 04 20:45:56.941323 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-c292219c-9e12-47d3-b7ea-bfb3734ff56f req-a3767a77-a6b5-4ed6-8165-a502bc2c5785 service nova] Creating event network-vif-plugged:744df6f8-0df8-4ff2-b842-56de1314bff3 for instance 291474d2-a375-4974-abec-713900c08119 on n-h1-854823-8 Oct 04 20:45:56.950433 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-c292219c-9e12-47d3-b7ea-bfb3734ff56f req-a3767a77-a6b5-4ed6-8165-a502bc2c5785 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.057224 Oct 04 20:45:56.952253 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1316/2694] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:45:56 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:45:57.216048 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-4881feb2-b22f-4161-a4a4-49bcd79e4564 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-2015269677", "imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63", "flavorRef": "452", "networks": [{"uuid": "63b585d7-f845-43fa-9535-e29d267d7c9d"}]}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:45:57.286019 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.network.neutron [None req-4881feb2-b22f-4161-a4a4-49bcd79e4564 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] validate_networks() for [('63b585d7-f845-43fa-9535-e29d267d7c9d', None, None, None, None, None)] {{(pid=128801) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:45:57.295674 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-192a22b8-26bd-49d4-95ff-6a3d0a05e18e tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Flavor limits 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:45:57.296309 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-192a22b8-26bd-49d4-95ff-6a3d0a05e18e tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Image limits 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:45:57.296973 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-192a22b8-26bd-49d4-95ff-6a3d0a05e18e tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Flavor pref 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:45:57.297551 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-192a22b8-26bd-49d4-95ff-6a3d0a05e18e tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Image pref 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:45:57.298139 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-192a22b8-26bd-49d4-95ff-6a3d0a05e18e tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:45:57.309873 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-192a22b8-26bd-49d4-95ff-6a3d0a05e18e tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:57.310642 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-192a22b8-26bd-49d4-95ff-6a3d0a05e18e tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:57.311254 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-192a22b8-26bd-49d4-95ff-6a3d0a05e18e tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:57.312156 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-192a22b8-26bd-49d4-95ff-6a3d0a05e18e tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:57.312784 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-192a22b8-26bd-49d4-95ff-6a3d0a05e18e tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:57.313383 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-192a22b8-26bd-49d4-95ff-6a3d0a05e18e tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:57.336258 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-192a22b8-26bd-49d4-95ff-6a3d0a05e18e tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Getting quotas for project 7097bc12179446f6a3e1fac8434d5c64. Resources: {'ram', 'instances', 'cores'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:45:57.341963 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-192a22b8-26bd-49d4-95ff-6a3d0a05e18e tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Getting quotas for user 87dcc7baf63f4ae6bfe0a099adffd408 and project 7097bc12179446f6a3e1fac8434d5c64. Resources: {'ram', 'instances', 'cores'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:45:57.356741 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-192a22b8-26bd-49d4-95ff-6a3d0a05e18e tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Going to run 1 instances... {{(pid=128802) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:45:57.360716 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-192a22b8-26bd-49d4-95ff-6a3d0a05e18e tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] [instance: b65c8ce2-8537-4f84-ba63-5b913f6adc81] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='15b24725-0c99-4bcf-b1fb-907cdf8e2d63',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128802) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:45:57.417637 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-192a22b8-26bd-49d4-95ff-6a3d0a05e18e tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 13.867112 Oct 04 20:45:57.424413 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1379/2695] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 20:45:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 13874 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 20:45:57.431395 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-91bf049a-4a14-43c4-a1ca-5dbe03d1cc37 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:57.432266 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-91bf049a-4a14-43c4-a1ca-5dbe03d1cc37 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: 4d46fff2-b04d-41aa-ada0-2023ab545b48] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:57.439695 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-91bf049a-4a14-43c4-a1ca-5dbe03d1cc37 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:57.440605 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-91bf049a-4a14-43c4-a1ca-5dbe03d1cc37 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:57.441044 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-91bf049a-4a14-43c4-a1ca-5dbe03d1cc37 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:57.441755 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-91bf049a-4a14-43c4-a1ca-5dbe03d1cc37 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:57.442215 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-91bf049a-4a14-43c4-a1ca-5dbe03d1cc37 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:57.442680 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-91bf049a-4a14-43c4-a1ca-5dbe03d1cc37 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:57.644243 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-91bf049a-4a14-43c4-a1ca-5dbe03d1cc37 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac650232cc04810b1340dc2f0edadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b0670d1bd99424780a70e69d57a2166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:57.659309 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-91bf049a-4a14-43c4-a1ca-5dbe03d1cc37 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48" status: 200 len: 1669 microversion: 2.1 time: 0.233420 Oct 04 20:45:57.661366 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1380/2696] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:45:57 2022] GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48 => generated 1669 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:45:57.670187 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-69f833f9-b94a-41c2-8815-21d501f5a45d tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:57.670745 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-69f833f9-b94a-41c2-8815-21d501f5a45d tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] [instance: d849cb42-dfe6-4225-814a-90bef2839739] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:57.680700 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-69f833f9-b94a-41c2-8815-21d501f5a45d tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:57.681466 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-69f833f9-b94a-41c2-8815-21d501f5a45d tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:57.681912 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-69f833f9-b94a-41c2-8815-21d501f5a45d tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:57.683235 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-69f833f9-b94a-41c2-8815-21d501f5a45d tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:57.683778 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-69f833f9-b94a-41c2-8815-21d501f5a45d tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:57.684963 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-69f833f9-b94a-41c2-8815-21d501f5a45d tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:57.724592 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-69f833f9-b94a-41c2-8815-21d501f5a45d tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] [instance: d849cb42-dfe6-4225-814a-90bef2839739] Going to try to terminate instance {{(pid=128802) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:45:57.870104 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-69f833f9-b94a-41c2-8815-21d501f5a45d tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] 10.222.0.33 "DELETE /compute/v2.1/servers/d849cb42-dfe6-4225-814a-90bef2839739" status: 204 len: 0 microversion: 2.1 time: 0.207231 Oct 04 20:45:57.870740 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1381/2697] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 20:45:57 2022] DELETE /compute/v2.1/servers/d849cb42-dfe6-4225-814a-90bef2839739 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:45:57.876997 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-4881feb2-b22f-4161-a4a4-49bcd79e4564 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Flavor limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:45:57.877547 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-4881feb2-b22f-4161-a4a4-49bcd79e4564 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Image limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:45:57.877885 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-4881feb2-b22f-4161-a4a4-49bcd79e4564 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Flavor pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:45:57.878241 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-66d2fd95-ae39-4fd7-9dd3-39bc9b63a519 tempest-UnshelveToHostMultiNodesTest-1871197656 tempest-UnshelveToHostMultiNodesTest-1871197656-project-admin] Action: 'action', calling method: >, body: {"unshelve": {"host": "n-h2-854823-8"}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:45:57.878391 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-4881feb2-b22f-4161-a4a4-49bcd79e4564 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Image pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:45:57.878729 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-4881feb2-b22f-4161-a4a4-49bcd79e4564 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:45:57.881341 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-66d2fd95-ae39-4fd7-9dd3-39bc9b63a519 tempest-UnshelveToHostMultiNodesTest-1871197656 tempest-UnshelveToHostMultiNodesTest-1871197656-project-admin] [instance: 39d66e18-289f-4674-b66c-146d68ef9133] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:57.892018 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-66d2fd95-ae39-4fd7-9dd3-39bc9b63a519 tempest-UnshelveToHostMultiNodesTest-1871197656 tempest-UnshelveToHostMultiNodesTest-1871197656-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:57.892552 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-66d2fd95-ae39-4fd7-9dd3-39bc9b63a519 tempest-UnshelveToHostMultiNodesTest-1871197656 tempest-UnshelveToHostMultiNodesTest-1871197656-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:57.892989 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-66d2fd95-ae39-4fd7-9dd3-39bc9b63a519 tempest-UnshelveToHostMultiNodesTest-1871197656 tempest-UnshelveToHostMultiNodesTest-1871197656-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:57.893711 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-66d2fd95-ae39-4fd7-9dd3-39bc9b63a519 tempest-UnshelveToHostMultiNodesTest-1871197656 tempest-UnshelveToHostMultiNodesTest-1871197656-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:57.894165 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-66d2fd95-ae39-4fd7-9dd3-39bc9b63a519 tempest-UnshelveToHostMultiNodesTest-1871197656 tempest-UnshelveToHostMultiNodesTest-1871197656-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:57.894776 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-66d2fd95-ae39-4fd7-9dd3-39bc9b63a519 tempest-UnshelveToHostMultiNodesTest-1871197656 tempest-UnshelveToHostMultiNodesTest-1871197656-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:57.907575 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4881feb2-b22f-4161-a4a4-49bcd79e4564 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:57.908377 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4881feb2-b22f-4161-a4a4-49bcd79e4564 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:57.909154 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4881feb2-b22f-4161-a4a4-49bcd79e4564 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:57.910646 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4881feb2-b22f-4161-a4a4-49bcd79e4564 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:57.911488 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4881feb2-b22f-4161-a4a4-49bcd79e4564 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:57.912174 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4881feb2-b22f-4161-a4a4-49bcd79e4564 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:57.987392 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-4881feb2-b22f-4161-a4a4-49bcd79e4564 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Getting quotas for project 91111396aabd4306b66e14b5abd822ad. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:45:57.992879 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-66d2fd95-ae39-4fd7-9dd3-39bc9b63a519 tempest-UnshelveToHostMultiNodesTest-1871197656 tempest-UnshelveToHostMultiNodesTest-1871197656-project-admin] [instance: 39d66e18-289f-4674-b66c-146d68ef9133] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "n-h2-854823-8". {{(pid=128802) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 04 20:45:57.995975 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-4881feb2-b22f-4161-a4a4-49bcd79e4564 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Getting quotas for user 12dc6570db03431187680f51349e55d3 and project 91111396aabd4306b66e14b5abd822ad. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:45:58.029417 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-4881feb2-b22f-4161-a4a4-49bcd79e4564 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Going to run 1 instances... {{(pid=128801) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:45:58.033347 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-4881feb2-b22f-4161-a4a4-49bcd79e4564 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] [instance: 39e846c1-6876-42ef-b290-f733516e1051] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='15b24725-0c99-4bcf-b1fb-907cdf8e2d63',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128801) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:45:58.127281 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-4881feb2-b22f-4161-a4a4-49bcd79e4564 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.172681 Oct 04 20:45:58.128059 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1317/2698] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 20:45:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 1175 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 20:45:58.135556 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-88fe396f-4a60-44d3-9329-b9bd0c2ac217 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:58.137143 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-88fe396f-4a60-44d3-9329-b9bd0c2ac217 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] [instance: b65c8ce2-8537-4f84-ba63-5b913f6adc81] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:58.175564 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-66d2fd95-ae39-4fd7-9dd3-39bc9b63a519 tempest-UnshelveToHostMultiNodesTest-1871197656 tempest-UnshelveToHostMultiNodesTest-1871197656-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133/action" status: 202 len: 0 microversion: 2.91 time: 0.302631 Oct 04 20:45:58.182862 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1382/2699] 10.222.0.33 () {62 vars in 1319 bytes} [Tue Oct 4 20:45:57 2022] POST /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133/action => generated 0 bytes in 311 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:45:58.192458 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-c507d57e-d940-47e0-98bf-e2c1173feb7f tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Calling method '.version_select at 0x7f3c78957f70>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:58.234978 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-88fe396f-4a60-44d3-9329-b9bd0c2ac217 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87dcc7baf63f4ae6bfe0a099adffd408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7097bc12179446f6a3e1fac8434d5c64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:58.246643 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-88fe396f-4a60-44d3-9329-b9bd0c2ac217 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] 10.222.0.33 "GET /compute/v2.1/servers/b65c8ce2-8537-4f84-ba63-5b913f6adc81" status: 200 len: 1208 microversion: 2.1 time: 0.117213 Oct 04 20:45:58.255942 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1318/2700] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:45:58 2022] GET /compute/v2.1/servers/b65c8ce2-8537-4f84-ba63-5b913f6adc81 => generated 1208 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:45:58.264597 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-cc2f9a03-43b1-4d96-b29a-25af99e4d695 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Calling method '.version_select at 0x7f3c740549d0>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:58.492759 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-c507d57e-d940-47e0-98bf-e2c1173feb7f tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] 10.222.0.33 "GET /compute/v2.1/images/9fbc16b1-0e5d-475b-b380-8e5a6992900a" status: 200 len: 1464 microversion: 2.1 time: 0.308589 Oct 04 20:45:58.509186 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1383/2701] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 20:45:58 2022] GET /compute/v2.1/images/9fbc16b1-0e5d-475b-b380-8e5a6992900a => generated 1464 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:45:58.518702 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-d18c1bae-4171-4398-9b34-ee34fe77537f tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-2-1573556810"}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:45:58.529957 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-d18c1bae-4171-4398-9b34-ee34fe77537f tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: 4d46fff2-b04d-41aa-ada0-2023ab545b48] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:58.541215 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d18c1bae-4171-4398-9b34-ee34fe77537f tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:58.541965 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d18c1bae-4171-4398-9b34-ee34fe77537f tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:58.542427 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d18c1bae-4171-4398-9b34-ee34fe77537f tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:58.543202 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d18c1bae-4171-4398-9b34-ee34fe77537f tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:58.544060 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d18c1bae-4171-4398-9b34-ee34fe77537f tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:58.544522 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d18c1bae-4171-4398-9b34-ee34fe77537f tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:58.587711 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-cc2f9a03-43b1-4d96-b29a-25af99e4d695 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] 10.222.0.33 "GET /compute/v2.1/images/cd92b355-ed64-4588-875e-1d5d7d57c8a4" status: 200 len: 1411 microversion: 2.1 time: 0.321862 Oct 04 20:45:58.588581 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1319/2702] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 20:45:58 2022] GET /compute/v2.1/images/cd92b355-ed64-4588-875e-1d5d7d57c8a4 => generated 1411 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:45:58.602373 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-92f8f369-15d4-4a7a-a707-6987fd43557c tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:58.603885 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-92f8f369-15d4-4a7a-a707-6987fd43557c tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] [instance: d849cb42-dfe6-4225-814a-90bef2839739] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:58.612720 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-92f8f369-15d4-4a7a-a707-6987fd43557c tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:58.613716 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-92f8f369-15d4-4a7a-a707-6987fd43557c tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:58.614472 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-92f8f369-15d4-4a7a-a707-6987fd43557c tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:58.615610 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-92f8f369-15d4-4a7a-a707-6987fd43557c tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:58.617151 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-92f8f369-15d4-4a7a-a707-6987fd43557c tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:58.618921 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-92f8f369-15d4-4a7a-a707-6987fd43557c tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:58.929142 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-92f8f369-15d4-4a7a-a707-6987fd43557c tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e4b00964014a0383f79597652bd428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7f38600b5041ad8e66a12d77b940fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:58.939295 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-92f8f369-15d4-4a7a-a707-6987fd43557c tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] 10.222.0.33 "GET /compute/v2.1/servers/d849cb42-dfe6-4225-814a-90bef2839739" status: 200 len: 1679 microversion: 2.1 time: 0.341776 Oct 04 20:45:58.940914 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1320/2703] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:45:58 2022] GET /compute/v2.1/servers/d849cb42-dfe6-4225-814a-90bef2839739 => generated 1679 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:45:58.946508 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-4adc27dc-557a-492b-92db-e5e7632460e7 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:58.947425 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-4adc27dc-557a-492b-92db-e5e7632460e7 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] [instance: 39d66e18-289f-4674-b66c-146d68ef9133] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:58.953961 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4adc27dc-557a-492b-92db-e5e7632460e7 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:58.954889 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4adc27dc-557a-492b-92db-e5e7632460e7 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:58.955612 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4adc27dc-557a-492b-92db-e5e7632460e7 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:58.956547 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4adc27dc-557a-492b-92db-e5e7632460e7 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:58.957921 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4adc27dc-557a-492b-92db-e5e7632460e7 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:58.958640 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4adc27dc-557a-492b-92db-e5e7632460e7 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:59.003984 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-d18c1bae-4171-4398-9b34-ee34fe77537f tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "POST /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48/action" status: 202 len: 0 microversion: 2.1 time: 0.493057 Oct 04 20:45:59.010101 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1384/2704] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 20:45:58 2022] POST /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48/action => generated 0 bytes in 500 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Oct 04 20:45:59.017460 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-43cdb7ac-b806-4160-a3b4-0b23e2915412 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-288335750", "imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63", "flavorRef": "452", "networks": [{"uuid": "63b585d7-f845-43fa-9535-e29d267d7c9d"}]}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:45:59.057936 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-4adc27dc-557a-492b-92db-e5e7632460e7 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:59.066430 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-4adc27dc-557a-492b-92db-e5e7632460e7 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:59.068990 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-4adc27dc-557a-492b-92db-e5e7632460e7 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:59.079472 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-4adc27dc-557a-492b-92db-e5e7632460e7 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] 10.222.0.33 "GET /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133" status: 200 len: 1488 microversion: 2.91 time: 0.136492 Oct 04 20:45:59.080941 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1321/2705] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:45:58 2022] GET /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133 => generated 1488 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:45:59.087086 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c50ab9e0-e708-4c53-864d-86248bd5ca57 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Calling method '.version_select at 0x7f3c6fa081f0>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:59.092508 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.network.neutron [None req-43cdb7ac-b806-4160-a3b4-0b23e2915412 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] validate_networks() for [('63b585d7-f845-43fa-9535-e29d267d7c9d', None, None, None, None, None)] {{(pid=128802) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:45:59.192626 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c50ab9e0-e708-4c53-864d-86248bd5ca57 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] 10.222.0.33 "GET /compute/v2.1/images/9fbc16b1-0e5d-475b-b380-8e5a6992900a" status: 200 len: 1464 microversion: 2.1 time: 0.110397 Oct 04 20:45:59.193527 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1322/2706] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 20:45:59 2022] GET /compute/v2.1/images/9fbc16b1-0e5d-475b-b380-8e5a6992900a => generated 1464 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:45:59.214132 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7a743800-3f04-4c9b-9a55-aea02b942b09 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:59.215177 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-7a743800-3f04-4c9b-9a55-aea02b942b09 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] [instance: 291474d2-a375-4974-abec-713900c08119] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:59.225042 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7a743800-3f04-4c9b-9a55-aea02b942b09 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:59.228862 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7a743800-3f04-4c9b-9a55-aea02b942b09 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:59.229770 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7a743800-3f04-4c9b-9a55-aea02b942b09 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:59.231249 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7a743800-3f04-4c9b-9a55-aea02b942b09 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:59.233899 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7a743800-3f04-4c9b-9a55-aea02b942b09 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:59.234851 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7a743800-3f04-4c9b-9a55-aea02b942b09 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:59.489752 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-7a743800-3f04-4c9b-9a55-aea02b942b09 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0967736982942f0b62db2e0546666cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f86a1d45a94f41bcd1a73694454a0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:59.503864 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-7a743800-3f04-4c9b-9a55-aea02b942b09 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] 10.222.0.33 "GET /compute/v2.1/servers/291474d2-a375-4974-abec-713900c08119" status: 200 len: 1467 microversion: 2.1 time: 0.294340 Oct 04 20:45:59.511119 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1323/2707] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:45:59 2022] GET /compute/v2.1/servers/291474d2-a375-4974-abec-713900c08119 => generated 1467 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:45:59.518500 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9d26609c-dcbe-4c73-80ad-04f52f2bcfc6 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:45:59.519687 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-9d26609c-dcbe-4c73-80ad-04f52f2bcfc6 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] [instance: b65c8ce2-8537-4f84-ba63-5b913f6adc81] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:59.527782 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9d26609c-dcbe-4c73-80ad-04f52f2bcfc6 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:59.528827 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9d26609c-dcbe-4c73-80ad-04f52f2bcfc6 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:59.529504 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9d26609c-dcbe-4c73-80ad-04f52f2bcfc6 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:59.530676 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9d26609c-dcbe-4c73-80ad-04f52f2bcfc6 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:59.532421 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9d26609c-dcbe-4c73-80ad-04f52f2bcfc6 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:59.533173 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9d26609c-dcbe-4c73-80ad-04f52f2bcfc6 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:59.638176 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-9d26609c-dcbe-4c73-80ad-04f52f2bcfc6 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87dcc7baf63f4ae6bfe0a099adffd408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7097bc12179446f6a3e1fac8434d5c64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:45:59.649416 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-9d26609c-dcbe-4c73-80ad-04f52f2bcfc6 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] 10.222.0.33 "GET /compute/v2.1/servers/b65c8ce2-8537-4f84-ba63-5b913f6adc81" status: 200 len: 1212 microversion: 2.1 time: 0.136186 Oct 04 20:45:59.662958 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1324/2708] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:45:59 2022] GET /compute/v2.1/servers/b65c8ce2-8537-4f84-ba63-5b913f6adc81 => generated 1212 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:45:59.671493 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c52a1388-3217-43f8-a791-a81117528a2e tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-249639661"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:45:59.674592 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c52a1388-3217-43f8-a791-a81117528a2e tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] [instance: 8917de21-2b45-4249-ae17-17f679d4856f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:45:59.681612 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c52a1388-3217-43f8-a791-a81117528a2e tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:59.682487 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c52a1388-3217-43f8-a791-a81117528a2e tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:59.683407 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c52a1388-3217-43f8-a791-a81117528a2e tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:59.684372 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c52a1388-3217-43f8-a791-a81117528a2e tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:59.685045 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c52a1388-3217-43f8-a791-a81117528a2e tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:59.685748 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c52a1388-3217-43f8-a791-a81117528a2e tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:59.802799 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-43cdb7ac-b806-4160-a3b4-0b23e2915412 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Flavor limits 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:45:59.804340 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-43cdb7ac-b806-4160-a3b4-0b23e2915412 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Image limits 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:45:59.805134 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-43cdb7ac-b806-4160-a3b4-0b23e2915412 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Flavor pref 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:45:59.806038 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-43cdb7ac-b806-4160-a3b4-0b23e2915412 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Image pref 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:45:59.806657 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-43cdb7ac-b806-4160-a3b4-0b23e2915412 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:45:59.817687 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-43cdb7ac-b806-4160-a3b4-0b23e2915412 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:59.818434 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-43cdb7ac-b806-4160-a3b4-0b23e2915412 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:59.819081 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-43cdb7ac-b806-4160-a3b4-0b23e2915412 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:59.820636 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-43cdb7ac-b806-4160-a3b4-0b23e2915412 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:45:59.821341 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-43cdb7ac-b806-4160-a3b4-0b23e2915412 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:45:59.821920 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-43cdb7ac-b806-4160-a3b4-0b23e2915412 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:45:59.843870 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-43cdb7ac-b806-4160-a3b4-0b23e2915412 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Getting quotas for project 91111396aabd4306b66e14b5abd822ad. Resources: {'ram', 'instances', 'cores'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:45:59.850163 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-43cdb7ac-b806-4160-a3b4-0b23e2915412 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Getting quotas for user 12dc6570db03431187680f51349e55d3 and project 91111396aabd4306b66e14b5abd822ad. Resources: {'ram', 'instances', 'cores'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:45:59.865995 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-43cdb7ac-b806-4160-a3b4-0b23e2915412 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Going to run 1 instances... {{(pid=128802) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:45:59.869523 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-43cdb7ac-b806-4160-a3b4-0b23e2915412 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] [instance: 7bbbbf6d-9e62-426b-85b4-d523110a05ef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='15b24725-0c99-4bcf-b1fb-907cdf8e2d63',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128802) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:45:59.989269 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-43cdb7ac-b806-4160-a3b4-0b23e2915412 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.977441 Oct 04 20:45:59.990357 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1385/2709] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 20:45:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 979 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 20:46:00.000343 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-3abb7c5b-3242-4029-89fe-1a39783c5576 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Calling method '.version_select at 0x7f3c743d1700>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:00.158143 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-3abb7c5b-3242-4029-89fe-1a39783c5576 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] 10.222.0.33 "GET /compute/v2.1/images/cd92b355-ed64-4588-875e-1d5d7d57c8a4" status: 200 len: 1411 microversion: 2.1 time: 0.167071 Oct 04 20:46:00.169402 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1386/2710] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 20:45:59 2022] GET /compute/v2.1/images/cd92b355-ed64-4588-875e-1d5d7d57c8a4 => generated 1411 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:46:00.181850 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-5b0d1cc6-02fe-4d7b-a18e-a833a591bfcc tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:00.182501 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-5b0d1cc6-02fe-4d7b-a18e-a833a591bfcc tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] [instance: d849cb42-dfe6-4225-814a-90bef2839739] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:00.200085 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c52a1388-3217-43f8-a791-a81117528a2e tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] 10.222.0.33 "POST /compute/v2.1/servers/8917de21-2b45-4249-ae17-17f679d4856f/action" status: 202 len: 0 microversion: 2.1 time: 0.534838 Oct 04 20:46:00.203944 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1325/2711] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 20:45:59 2022] POST /compute/v2.1/servers/8917de21-2b45-4249-ae17-17f679d4856f/action => generated 0 bytes in 539 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 04 20:46:00.215503 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9f6c59d7-1812-4d0e-b769-aad4600fcf32 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1801296535", "imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63", "flavorRef": "451", "networks": [{"uuid": "63b585d7-f845-43fa-9535-e29d267d7c9d"}]}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:46:00.219606 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5b0d1cc6-02fe-4d7b-a18e-a833a591bfcc tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:00.220584 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5b0d1cc6-02fe-4d7b-a18e-a833a591bfcc tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:00.221376 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5b0d1cc6-02fe-4d7b-a18e-a833a591bfcc tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:00.227233 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5b0d1cc6-02fe-4d7b-a18e-a833a591bfcc tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:00.233373 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5b0d1cc6-02fe-4d7b-a18e-a833a591bfcc tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:00.233894 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5b0d1cc6-02fe-4d7b-a18e-a833a591bfcc tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:00.477377 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.network.neutron [None req-9f6c59d7-1812-4d0e-b769-aad4600fcf32 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] validate_networks() for [('63b585d7-f845-43fa-9535-e29d267d7c9d', None, None, None, None, None)] {{(pid=128801) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:46:00.954023 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-5b0d1cc6-02fe-4d7b-a18e-a833a591bfcc tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e4b00964014a0383f79597652bd428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7f38600b5041ad8e66a12d77b940fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:00.968754 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-5b0d1cc6-02fe-4d7b-a18e-a833a591bfcc tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] 10.222.0.33 "GET /compute/v2.1/servers/d849cb42-dfe6-4225-814a-90bef2839739" status: 200 len: 1679 microversion: 2.1 time: 0.798193 Oct 04 20:46:00.984133 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1387/2712] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:46:00 2022] GET /compute/v2.1/servers/d849cb42-dfe6-4225-814a-90bef2839739 => generated 1679 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:46:00.997619 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-c9cc4c35-da06-4835-aa71-81d9ebd9a033 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:01.000993 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-c9cc4c35-da06-4835-aa71-81d9ebd9a033 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] [instance: 39d66e18-289f-4674-b66c-146d68ef9133] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:01.030841 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c9cc4c35-da06-4835-aa71-81d9ebd9a033 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:01.030841 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c9cc4c35-da06-4835-aa71-81d9ebd9a033 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:01.039756 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c9cc4c35-da06-4835-aa71-81d9ebd9a033 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:01.043479 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c9cc4c35-da06-4835-aa71-81d9ebd9a033 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:01.044005 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c9cc4c35-da06-4835-aa71-81d9ebd9a033 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:01.046756 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c9cc4c35-da06-4835-aa71-81d9ebd9a033 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:01.696861 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-c9cc4c35-da06-4835-aa71-81d9ebd9a033 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:01.721271 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-c9cc4c35-da06-4835-aa71-81d9ebd9a033 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:01.723718 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-c9cc4c35-da06-4835-aa71-81d9ebd9a033 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:01.734029 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-c9cc4c35-da06-4835-aa71-81d9ebd9a033 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] 10.222.0.33 "GET /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133" status: 200 len: 1546 microversion: 2.91 time: 0.748702 Oct 04 20:46:01.734805 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1388/2713] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:46:00 2022] GET /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133 => generated 1546 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:46:01.770628 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-cb2920f0-dac7-49a0-977d-4425d25abf2f tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Calling method '.version_select at 0x7f3c7422fd30>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:01.840057 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-cb2920f0-dac7-49a0-977d-4425d25abf2f tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] 10.222.0.33 "GET /compute/v2.1/images/b73cf850-8f12-4af6-a477-48d47ca8c95f" status: 200 len: 1454 microversion: 2.1 time: 0.073236 Oct 04 20:46:01.840639 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1389/2714] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 20:46:01 2022] GET /compute/v2.1/images/b73cf850-8f12-4af6-a477-48d47ca8c95f => generated 1454 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:46:01.860825 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-f29e6424-aa11-4e95-a907-23fb7a41e8f5 req-2d8b1759-963a-4495-9429-c1cebe6d0124 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "291474d2-a375-4974-abec-713900c08119", "name": "network-vif-unplugged", "status": "completed", "tag": "744df6f8-0df8-4ff2-b842-56de1314bff3"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:46:01.883783 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-9f6c59d7-1812-4d0e-b769-aad4600fcf32 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Flavor limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:46:01.885096 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-9f6c59d7-1812-4d0e-b769-aad4600fcf32 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Image limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:46:01.885818 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-9f6c59d7-1812-4d0e-b769-aad4600fcf32 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Flavor pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:46:01.886485 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-9f6c59d7-1812-4d0e-b769-aad4600fcf32 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Image pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:46:01.887275 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-9f6c59d7-1812-4d0e-b769-aad4600fcf32 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:46:01.890759 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-f29e6424-aa11-4e95-a907-23fb7a41e8f5 req-2d8b1759-963a-4495-9429-c1cebe6d0124 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:01.891460 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-f29e6424-aa11-4e95-a907-23fb7a41e8f5 req-2d8b1759-963a-4495-9429-c1cebe6d0124 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:01.892056 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-f29e6424-aa11-4e95-a907-23fb7a41e8f5 req-2d8b1759-963a-4495-9429-c1cebe6d0124 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:01.898441 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9f6c59d7-1812-4d0e-b769-aad4600fcf32 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:01.899044 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9f6c59d7-1812-4d0e-b769-aad4600fcf32 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:01.899585 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9f6c59d7-1812-4d0e-b769-aad4600fcf32 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:01.900451 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9f6c59d7-1812-4d0e-b769-aad4600fcf32 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:01.901008 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9f6c59d7-1812-4d0e-b769-aad4600fcf32 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:01.901543 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9f6c59d7-1812-4d0e-b769-aad4600fcf32 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:01.923783 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-f29e6424-aa11-4e95-a907-23fb7a41e8f5 req-2d8b1759-963a-4495-9429-c1cebe6d0124 service nova] Creating event network-vif-unplugged:744df6f8-0df8-4ff2-b842-56de1314bff3 for instance 291474d2-a375-4974-abec-713900c08119 on n-h1-854823-8 Oct 04 20:46:01.925502 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-9f6c59d7-1812-4d0e-b769-aad4600fcf32 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Getting quotas for project 91111396aabd4306b66e14b5abd822ad. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:46:01.932752 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-9f6c59d7-1812-4d0e-b769-aad4600fcf32 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Getting quotas for user 12dc6570db03431187680f51349e55d3 and project 91111396aabd4306b66e14b5abd822ad. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:46:01.932975 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-f29e6424-aa11-4e95-a907-23fb7a41e8f5 req-2d8b1759-963a-4495-9429-c1cebe6d0124 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.089395 Oct 04 20:46:01.933579 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1390/2715] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:46:01 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:46:01.943830 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-8ee773f4-dc8b-4bbb-bad2-53d35f85a99c tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:01.945396 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-8ee773f4-dc8b-4bbb-bad2-53d35f85a99c tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] [instance: b65c8ce2-8537-4f84-ba63-5b913f6adc81] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:01.950467 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-9f6c59d7-1812-4d0e-b769-aad4600fcf32 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Going to run 1 instances... {{(pid=128801) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:46:01.953254 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-9f6c59d7-1812-4d0e-b769-aad4600fcf32 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] [instance: db0b522b-4140-4587-9c1b-0e62d778dce4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='15b24725-0c99-4bcf-b1fb-907cdf8e2d63',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128801) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:46:01.958415 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8ee773f4-dc8b-4bbb-bad2-53d35f85a99c tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:01.959042 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8ee773f4-dc8b-4bbb-bad2-53d35f85a99c tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:01.959478 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8ee773f4-dc8b-4bbb-bad2-53d35f85a99c tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:01.960706 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8ee773f4-dc8b-4bbb-bad2-53d35f85a99c tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:01.961161 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8ee773f4-dc8b-4bbb-bad2-53d35f85a99c tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:01.961653 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8ee773f4-dc8b-4bbb-bad2-53d35f85a99c tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:02.041438 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-9f6c59d7-1812-4d0e-b769-aad4600fcf32 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.835730 Oct 04 20:46:02.044710 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1326/2716] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 20:46:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 1840 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 20:46:02.059570 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-8ee773f4-dc8b-4bbb-bad2-53d35f85a99c tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87dcc7baf63f4ae6bfe0a099adffd408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7097bc12179446f6a3e1fac8434d5c64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:02.064932 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-94bd9de3-8574-4877-8a21-b9b984372c67 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Calling method '.version_select at 0x7f3c6fa488b0>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:02.070395 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-8ee773f4-dc8b-4bbb-bad2-53d35f85a99c tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] 10.222.0.33 "GET /compute/v2.1/servers/b65c8ce2-8537-4f84-ba63-5b913f6adc81" status: 200 len: 1204 microversion: 2.1 time: 0.134135 Oct 04 20:46:02.070395 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1391/2717] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:46:01 2022] GET /compute/v2.1/servers/b65c8ce2-8537-4f84-ba63-5b913f6adc81 => generated 1204 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:46:02.092219 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-8e07970e-0a74-49d0-986f-d9c9e4cfa5a6 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:02.094373 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-8e07970e-0a74-49d0-986f-d9c9e4cfa5a6 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] [instance: d849cb42-dfe6-4225-814a-90bef2839739] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:02.099918 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8e07970e-0a74-49d0-986f-d9c9e4cfa5a6 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:02.101971 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8e07970e-0a74-49d0-986f-d9c9e4cfa5a6 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:02.102453 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8e07970e-0a74-49d0-986f-d9c9e4cfa5a6 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:02.103352 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8e07970e-0a74-49d0-986f-d9c9e4cfa5a6 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:02.103681 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8e07970e-0a74-49d0-986f-d9c9e4cfa5a6 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:02.104111 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8e07970e-0a74-49d0-986f-d9c9e4cfa5a6 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:02.179515 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-94bd9de3-8574-4877-8a21-b9b984372c67 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] 10.222.0.33 "GET /compute/v2.1/images/cd92b355-ed64-4588-875e-1d5d7d57c8a4" status: 200 len: 1411 microversion: 2.1 time: 0.131929 Oct 04 20:46:02.180494 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1327/2718] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 20:46:02 2022] GET /compute/v2.1/images/cd92b355-ed64-4588-875e-1d5d7d57c8a4 => generated 1411 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:46:02.202448 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-0712d666-8e02-4ec9-87a5-21f11b5e5259 req-f1125732-686f-414f-a886-e9ddd6204373 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d849cb42-dfe6-4225-814a-90bef2839739", "name": "network-vif-deleted", "tag": "43c43378-662f-421f-8638-f0585d16813b"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:46:02.248974 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-0712d666-8e02-4ec9-87a5-21f11b5e5259 req-f1125732-686f-414f-a886-e9ddd6204373 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:02.252513 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-0712d666-8e02-4ec9-87a5-21f11b5e5259 req-f1125732-686f-414f-a886-e9ddd6204373 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:02.254880 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-0712d666-8e02-4ec9-87a5-21f11b5e5259 req-f1125732-686f-414f-a886-e9ddd6204373 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:02.278326 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-8e07970e-0a74-49d0-986f-d9c9e4cfa5a6 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e4b00964014a0383f79597652bd428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7f38600b5041ad8e66a12d77b940fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:02.287341 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-8e07970e-0a74-49d0-986f-d9c9e4cfa5a6 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] 10.222.0.33 "GET /compute/v2.1/servers/d849cb42-dfe6-4225-814a-90bef2839739" status: 200 len: 1612 microversion: 2.1 time: 0.198986 Oct 04 20:46:02.302963 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-0712d666-8e02-4ec9-87a5-21f11b5e5259 req-f1125732-686f-414f-a886-e9ddd6204373 service nova] Creating event network-vif-deleted:43c43378-662f-421f-8638-f0585d16813b for instance d849cb42-dfe6-4225-814a-90bef2839739 on n-h2-854823-8 Oct 04 20:46:02.312640 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1392/2719] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:46:02 2022] GET /compute/v2.1/servers/d849cb42-dfe6-4225-814a-90bef2839739 => generated 1612 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:46:02.321618 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-e917c254-0e61-4fb0-9db5-0c9e246f648b tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:02.322827 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-e917c254-0e61-4fb0-9db5-0c9e246f648b tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] [instance: db0b522b-4140-4587-9c1b-0e62d778dce4] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:02.324021 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-0712d666-8e02-4ec9-87a5-21f11b5e5259 req-f1125732-686f-414f-a886-e9ddd6204373 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.139191 Oct 04 20:46:02.330695 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1328/2720] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:46:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:46:02.469957 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-e917c254-0e61-4fb0-9db5-0c9e246f648b tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12dc6570db03431187680f51349e55d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91111396aabd4306b66e14b5abd822ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:02.482014 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-e917c254-0e61-4fb0-9db5-0c9e246f648b tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] 10.222.0.33 "GET /compute/v2.1/servers/db0b522b-4140-4587-9c1b-0e62d778dce4" status: 200 len: 1221 microversion: 2.1 time: 0.167991 Oct 04 20:46:02.487566 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1393/2721] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:46:02 2022] GET /compute/v2.1/servers/db0b522b-4140-4587-9c1b-0e62d778dce4 => generated 1221 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:46:02.768539 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5d0ba7c0-9198-466e-a698-535ad4189604 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:02.769483 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-5d0ba7c0-9198-466e-a698-535ad4189604 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] [instance: 39d66e18-289f-4674-b66c-146d68ef9133] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:02.793909 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5d0ba7c0-9198-466e-a698-535ad4189604 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:02.796875 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5d0ba7c0-9198-466e-a698-535ad4189604 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:02.797523 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5d0ba7c0-9198-466e-a698-535ad4189604 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:02.800325 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5d0ba7c0-9198-466e-a698-535ad4189604 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:02.801077 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5d0ba7c0-9198-466e-a698-535ad4189604 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:02.801730 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5d0ba7c0-9198-466e-a698-535ad4189604 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:02.856201 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-959f3c3d-34cb-4ae1-9065-db693452460c tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Calling method '.version_select at 0x7f3c7420f160>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:02.953809 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-5d0ba7c0-9198-466e-a698-535ad4189604 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:02.966675 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-5d0ba7c0-9198-466e-a698-535ad4189604 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:02.971526 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-5d0ba7c0-9198-466e-a698-535ad4189604 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:02.980297 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5d0ba7c0-9198-466e-a698-535ad4189604 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] 10.222.0.33 "GET /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133" status: 200 len: 1546 microversion: 2.91 time: 0.216067 Oct 04 20:46:03.000567 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1329/2722] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:46:02 2022] GET /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133 => generated 1546 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:46:03.102881 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f6a0e7d7-1757-49da-b07d-4abf6525bcba tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:03.105928 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f6a0e7d7-1757-49da-b07d-4abf6525bcba tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] [instance: b65c8ce2-8537-4f84-ba63-5b913f6adc81] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:03.150268 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f6a0e7d7-1757-49da-b07d-4abf6525bcba tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:03.154944 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f6a0e7d7-1757-49da-b07d-4abf6525bcba tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:03.156795 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f6a0e7d7-1757-49da-b07d-4abf6525bcba tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:03.158746 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f6a0e7d7-1757-49da-b07d-4abf6525bcba tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:03.177121 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f6a0e7d7-1757-49da-b07d-4abf6525bcba tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:03.181892 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f6a0e7d7-1757-49da-b07d-4abf6525bcba tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:03.437378 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f6a0e7d7-1757-49da-b07d-4abf6525bcba tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87dcc7baf63f4ae6bfe0a099adffd408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7097bc12179446f6a3e1fac8434d5c64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:03.465049 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f6a0e7d7-1757-49da-b07d-4abf6525bcba tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] 10.222.0.33 "GET /compute/v2.1/servers/b65c8ce2-8537-4f84-ba63-5b913f6adc81" status: 200 len: 1260 microversion: 2.1 time: 0.376493 Oct 04 20:46:03.466702 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1330/2723] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:46:03 2022] GET /compute/v2.1/servers/b65c8ce2-8537-4f84-ba63-5b913f6adc81 => generated 1260 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:46:03.531334 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0ae5d0d5-aee5-49d1-893b-250e6930277d tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Calling method '.version_select at 0x7f3c74054c10>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:09.837853 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell0:SELECT=4 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:46:11.914164 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=4 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:46:11.940736 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=14 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:46:12.171103 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-0ae5d0d5-aee5-49d1-893b-250e6930277d tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] 10.222.0.33 "GET /compute/v2.1/images/cd92b355-ed64-4588-875e-1d5d7d57c8a4" status: 200 len: 1420 microversion: 2.1 time: 8.702826 Oct 04 20:46:12.171547 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1331/2724] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 20:46:03 2022] GET /compute/v2.1/images/cd92b355-ed64-4588-875e-1d5d7d57c8a4 => generated 1420 bytes in 8704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:46:12.172402 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-959f3c3d-34cb-4ae1-9065-db693452460c tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] 10.222.0.33 "GET /compute/v2.1/images/b73cf850-8f12-4af6-a477-48d47ca8c95f" status: 200 len: 1454 microversion: 2.1 time: 9.320083 Oct 04 20:46:12.173699 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1394/2725] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 20:46:02 2022] GET /compute/v2.1/images/b73cf850-8f12-4af6-a477-48d47ca8c95f => generated 1454 bytes in 9322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:46:12.178503 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-912313bf-671b-49fa-ba8b-1efcfb5ac10c tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:12.179623 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-912313bf-671b-49fa-ba8b-1efcfb5ac10c tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] [instance: db0b522b-4140-4587-9c1b-0e62d778dce4] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:12.179999 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8ef9c99b-1467-4a07-a0f0-0c923e857583 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:12.180614 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-8ef9c99b-1467-4a07-a0f0-0c923e857583 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] [instance: d849cb42-dfe6-4225-814a-90bef2839739] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:12.186766 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-912313bf-671b-49fa-ba8b-1efcfb5ac10c tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:12.187509 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-912313bf-671b-49fa-ba8b-1efcfb5ac10c tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:12.188130 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-912313bf-671b-49fa-ba8b-1efcfb5ac10c tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:12.189002 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-912313bf-671b-49fa-ba8b-1efcfb5ac10c tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:12.189384 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8ef9c99b-1467-4a07-a0f0-0c923e857583 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:12.189779 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-912313bf-671b-49fa-ba8b-1efcfb5ac10c tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:12.190009 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8ef9c99b-1467-4a07-a0f0-0c923e857583 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:12.190552 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8ef9c99b-1467-4a07-a0f0-0c923e857583 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:12.190735 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-912313bf-671b-49fa-ba8b-1efcfb5ac10c tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:12.191493 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8ef9c99b-1467-4a07-a0f0-0c923e857583 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:12.191953 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8ef9c99b-1467-4a07-a0f0-0c923e857583 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:12.192474 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8ef9c99b-1467-4a07-a0f0-0c923e857583 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:12.213046 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-8ef9c99b-1467-4a07-a0f0-0c923e857583 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] HTTP exception thrown: Instance d849cb42-dfe6-4225-814a-90bef2839739 could not be found. Oct 04 20:46:12.215474 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8ef9c99b-1467-4a07-a0f0-0c923e857583 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Request method failure captured: Oct 04 20:46:12.215474 n-d-854823-8 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/d849cb42-dfe6-4225-814a-90bef2839739 HTTP/1.1 Oct 04 20:46:12.215474 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:46:12.215474 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:46:12.215474 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:46:12.215474 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 0 Oct 04 20:46:12.215474 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:46:12.215474 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:46:12.215474 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:46:12.215474 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:46:12.215474 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJq81PAuDsDZpxdj7sHNmNgvbOtGh6iX1oPKSmvHZUw9x7ULWvp7QM5iDniQ-MHWL89bpVZnLKWftCcZuFrmOzCFwz5uJr5u54napWSUn77riQgg7pFlU7FKzu5ArjbUA7EV4GWtihdoiqsY9U5RhjRJWZh-5HATJMChglPcLjaAY6g Oct 04 20:46:12.215474 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:46:12.215474 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:46:12.215474 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:46:12.215474 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:46:12.215474 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:46:12.215474 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:46:12.215474 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: fc7f38600b5041ad8e66a12d77b940fa Oct 04 20:46:12.215474 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-AttachVolumeNegativeTest-16853026 Oct 04 20:46:12.215474 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 20:46:12.215474 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 20:46:12.215474 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_fc7f38600b5041ad8e66a12d77b940fa", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fc7f38600b5041ad8e66a12d77b940fa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fc7f38600b5041ad8e66a12d77b940fa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/fc7f38600b5041ad8e66a12d77b940fa"}]}] Oct 04 20:46:12.215474 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-AttachVolumeNegativeTest-16853026 Oct 04 20:46:12.215474 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: fc7f38600b5041ad8e66a12d77b940fa Oct 04 20:46:12.215474 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-16853026 Oct 04 20:46:12.215474 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-AttachVolumeNegativeTest-16853026-project Oct 04 20:46:12.215474 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:46:12.215474 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:46:12.215474 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: d9e4b00964014a0383f79597652bd428 Oct 04 20:46:12.215474 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-AttachVolumeNegativeTest-16853026-project Oct 04 20:46:12.215474 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 20:46:12.215474 n-d-854823-8 devstack@n-api.service[128801]: exception: Instance d849cb42-dfe6-4225-814a-90bef2839739 could not be found. Oct 04 20:46:12.215474 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': 'd849cb42-dfe6-4225-814a-90bef2839739'} Oct 04 20:46:12.215474 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:46:12.215474 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:46:12.215474 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:46:12.215474 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:46:12.215474 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:46:12.215474 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:46:12.215474 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:46:12.215474 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:46:12.215474 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:46:12.215474 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:46:12.215474 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d849cb42-dfe6-4225-814a-90bef2839739 could not be found. Oct 04 20:46:12.215474 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:46:12.215474 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:46:12.215474 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:46:12.215474 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:46:12.215474 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:46:12.215474 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:46:12.215474 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:46:12.215474 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:46:12.215474 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:46:12.215474 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:46:12.215474 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:46:12.215474 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:46:12.215474 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:46:12.215474 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:46:12.215474 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:46:12.215474 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:46:12.215474 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d849cb42-dfe6-4225-814a-90bef2839739 could not be found. Oct 04 20:46:12.215474 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:46:12.215474 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:46:12.215474 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:46:12.220182 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:46:12.220182 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:46:12.220182 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:46:12.220182 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:46:12.220182 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:46:12.220182 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d849cb42-dfe6-4225-814a-90bef2839739 could not be found. Oct 04 20:46:12.220182 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:46:12.220182 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8ef9c99b-1467-4a07-a0f0-0c923e857583 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Returning 404 to user: Instance d849cb42-dfe6-4225-814a-90bef2839739 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:46:12.220182 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-8ef9c99b-1467-4a07-a0f0-0c923e857583 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] 10.222.0.33 "GET /compute/v2.1/servers/d849cb42-dfe6-4225-814a-90bef2839739" status: 404 len: 111 microversion: 2.1 time: 0.041654 Oct 04 20:46:12.220182 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1332/2726] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:46:12 2022] GET /compute/v2.1/servers/d849cb42-dfe6-4225-814a-90bef2839739 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:46:12.227830 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-26658a1e-a5fe-44ec-a7ec-4159018b0ecc req-21780324-8723-42a3-9d33-fab059700e94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d46fff2-b04d-41aa-ada0-2023ab545b48", "name": "network-vif-unplugged", "status": "completed", "tag": "39e1fcde-c40c-4b4b-8edd-7565faaf4580"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:46:12.252012 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-26658a1e-a5fe-44ec-a7ec-4159018b0ecc req-21780324-8723-42a3-9d33-fab059700e94 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:12.252773 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-26658a1e-a5fe-44ec-a7ec-4159018b0ecc req-21780324-8723-42a3-9d33-fab059700e94 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:12.253377 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-26658a1e-a5fe-44ec-a7ec-4159018b0ecc req-21780324-8723-42a3-9d33-fab059700e94 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:12.273831 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-26658a1e-a5fe-44ec-a7ec-4159018b0ecc req-21780324-8723-42a3-9d33-fab059700e94 service nova] Creating event network-vif-unplugged:39e1fcde-c40c-4b4b-8edd-7565faaf4580 for instance 4d46fff2-b04d-41aa-ada0-2023ab545b48 on n-h1-854823-8 Oct 04 20:46:12.280273 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-26658a1e-a5fe-44ec-a7ec-4159018b0ecc req-21780324-8723-42a3-9d33-fab059700e94 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.060808 Oct 04 20:46:12.281277 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1333/2727] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:46:12 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:46:12.287246 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-440f442e-7ecb-4fae-b471-e687377e575c tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:12.288618 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-440f442e-7ecb-4fae-b471-e687377e575c tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] [instance: 39d66e18-289f-4674-b66c-146d68ef9133] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:12.295052 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-440f442e-7ecb-4fae-b471-e687377e575c tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:12.295618 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-440f442e-7ecb-4fae-b471-e687377e575c tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:12.296120 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-440f442e-7ecb-4fae-b471-e687377e575c tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:12.296818 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-440f442e-7ecb-4fae-b471-e687377e575c tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:12.297283 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-440f442e-7ecb-4fae-b471-e687377e575c tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:12.297701 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-440f442e-7ecb-4fae-b471-e687377e575c tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:12.379606 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-912313bf-671b-49fa-ba8b-1efcfb5ac10c tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12dc6570db03431187680f51349e55d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91111396aabd4306b66e14b5abd822ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:12.389128 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-912313bf-671b-49fa-ba8b-1efcfb5ac10c tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] 10.222.0.33 "GET /compute/v2.1/servers/db0b522b-4140-4587-9c1b-0e62d778dce4" status: 200 len: 1321 microversion: 2.1 time: 0.214011 Oct 04 20:46:12.389721 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1395/2728] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:46:12 2022] GET /compute/v2.1/servers/db0b522b-4140-4587-9c1b-0e62d778dce4 => generated 1321 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:46:12.398013 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-440f442e-7ecb-4fae-b471-e687377e575c tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:12.403451 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-c2e97fec-4236-4f26-a0d4-a84162e9508e tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:12.408828 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-440f442e-7ecb-4fae-b471-e687377e575c tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:12.410289 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-440f442e-7ecb-4fae-b471-e687377e575c tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:12.411258 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-c2e97fec-4236-4f26-a0d4-a84162e9508e tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] [instance: b65c8ce2-8537-4f84-ba63-5b913f6adc81] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:12.421526 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-440f442e-7ecb-4fae-b471-e687377e575c tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] 10.222.0.33 "GET /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133" status: 200 len: 1546 microversion: 2.91 time: 0.138879 Oct 04 20:46:12.422420 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c2e97fec-4236-4f26-a0d4-a84162e9508e tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:12.422989 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1334/2729] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:46:12 2022] GET /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133 => generated 1546 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:46:12.423604 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c2e97fec-4236-4f26-a0d4-a84162e9508e tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:12.424240 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c2e97fec-4236-4f26-a0d4-a84162e9508e tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:12.425251 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c2e97fec-4236-4f26-a0d4-a84162e9508e tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:12.425882 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c2e97fec-4236-4f26-a0d4-a84162e9508e tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:12.426520 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c2e97fec-4236-4f26-a0d4-a84162e9508e tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:12.436844 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-89eb988d-18f1-400d-b283-7f0f48dbd702 req-d3935d0c-bf4f-4aac-b1a1-24c2b86f228a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39e846c1-6876-42ef-b290-f733516e1051", "tag": "41e834af-e651-4065-b00f-f0cead495d74"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:46:12.458786 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-89eb988d-18f1-400d-b283-7f0f48dbd702 req-d3935d0c-bf4f-4aac-b1a1-24c2b86f228a service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:12.459417 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-89eb988d-18f1-400d-b283-7f0f48dbd702 req-d3935d0c-bf4f-4aac-b1a1-24c2b86f228a service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:12.460734 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-89eb988d-18f1-400d-b283-7f0f48dbd702 req-d3935d0c-bf4f-4aac-b1a1-24c2b86f228a service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:12.473187 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-89eb988d-18f1-400d-b283-7f0f48dbd702 req-d3935d0c-bf4f-4aac-b1a1-24c2b86f228a service nova] Creating event network-changed:41e834af-e651-4065-b00f-f0cead495d74 for instance 39e846c1-6876-42ef-b290-f733516e1051 on n-h2-854823-8 Oct 04 20:46:12.476227 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell0:SELECT=14 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:46:12.483967 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-89eb988d-18f1-400d-b283-7f0f48dbd702 req-d3935d0c-bf4f-4aac-b1a1-24c2b86f228a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059654 Oct 04 20:46:12.484804 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1335/2730] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:46:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:46:12.498975 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-6fda11ed-f2c4-4037-9f76-32d4ccebb456 req-dc064833-3736-470c-af8c-730d104a4643 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7bbbbf6d-9e62-426b-85b4-d523110a05ef", "tag": "7fcf08a9-d9e7-40ee-b109-178e0b1acd57"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:46:12.516599 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-6fda11ed-f2c4-4037-9f76-32d4ccebb456 req-dc064833-3736-470c-af8c-730d104a4643 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:12.517250 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-6fda11ed-f2c4-4037-9f76-32d4ccebb456 req-dc064833-3736-470c-af8c-730d104a4643 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:12.517785 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-6fda11ed-f2c4-4037-9f76-32d4ccebb456 req-dc064833-3736-470c-af8c-730d104a4643 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:12.541092 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-6fda11ed-f2c4-4037-9f76-32d4ccebb456 req-dc064833-3736-470c-af8c-730d104a4643 service nova] Creating event network-changed:7fcf08a9-d9e7-40ee-b109-178e0b1acd57 for instance 7bbbbf6d-9e62-426b-85b4-d523110a05ef on n-h2-854823-8 Oct 04 20:46:12.544566 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-6fda11ed-f2c4-4037-9f76-32d4ccebb456 req-dc064833-3736-470c-af8c-730d104a4643 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058610 Oct 04 20:46:12.545609 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1336/2731] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:46:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:46:12.553945 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-aef94051-0b78-43a1-af99-001a16abfbf2 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Calling method '.version_select at 0x7f3c6fa20b80>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:12.605315 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-aef94051-0b78-43a1-af99-001a16abfbf2 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] 10.222.0.33 "GET /compute/v2.1/images/cd92b355-ed64-4588-875e-1d5d7d57c8a4" status: 200 len: 1420 microversion: 2.1 time: 0.058208 Oct 04 20:46:12.615463 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1337/2732] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 20:46:12 2022] GET /compute/v2.1/images/cd92b355-ed64-4588-875e-1d5d7d57c8a4 => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:46:12.615578 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-c2e97fec-4236-4f26-a0d4-a84162e9508e tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87dcc7baf63f4ae6bfe0a099adffd408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7097bc12179446f6a3e1fac8434d5c64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:12.615735 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-049db2ba-5320-42e5-86b1-7d28fd01c5a5 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Calling method '.version_select at 0x7f3c6fa5c940>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:12.619039 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-c2e97fec-4236-4f26-a0d4-a84162e9508e tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] 10.222.0.33 "GET /compute/v2.1/servers/b65c8ce2-8537-4f84-ba63-5b913f6adc81" status: 200 len: 1308 microversion: 2.1 time: 0.227859 Oct 04 20:46:12.619682 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1396/2733] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:46:12 2022] GET /compute/v2.1/servers/b65c8ce2-8537-4f84-ba63-5b913f6adc81 => generated 1308 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:46:12.624418 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-a0835e4f-a23a-4eb1-9646-67cc020b9478 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Calling method '.version_select at 0x7f3c74176160>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:12.647668 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-049db2ba-5320-42e5-86b1-7d28fd01c5a5 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-738414864" status: 202 len: 0 microversion: 2.1 time: 0.039011 Oct 04 20:46:12.648898 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1338/2734] 10.222.0.33 () {58 vars in 1218 bytes} [Tue Oct 4 20:46:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-738414864 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:46:13.189755 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-746155c2-dde9-493d-818a-dadc63268c36 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Calling method '.version_select at 0x7f3c6fa08ee0>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:13.539890 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-a0835e4f-a23a-4eb1-9646-67cc020b9478 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] 10.222.0.33 "DELETE /compute/v2.1/images/cd92b355-ed64-4588-875e-1d5d7d57c8a4" status: 204 len: 0 microversion: 2.1 time: 0.916234 Oct 04 20:46:13.539890 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1397/2735] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:46:12 2022] DELETE /compute/v2.1/images/cd92b355-ed64-4588-875e-1d5d7d57c8a4 => generated 0 bytes in 918 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:46:13.544439 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-24facd54-8e8f-4e61-af30-6ccc904e40ee tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:13.547723 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-24facd54-8e8f-4e61-af30-6ccc904e40ee tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] [instance: db0b522b-4140-4587-9c1b-0e62d778dce4] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:13.565264 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-24facd54-8e8f-4e61-af30-6ccc904e40ee tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:13.566050 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-24facd54-8e8f-4e61-af30-6ccc904e40ee tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:13.566679 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-24facd54-8e8f-4e61-af30-6ccc904e40ee tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:13.569256 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-24facd54-8e8f-4e61-af30-6ccc904e40ee tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:13.570037 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-24facd54-8e8f-4e61-af30-6ccc904e40ee tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:13.570653 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-24facd54-8e8f-4e61-af30-6ccc904e40ee tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:13.610634 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-746155c2-dde9-493d-818a-dadc63268c36 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] 10.222.0.33 "GET /compute/v2.1/images/b73cf850-8f12-4af6-a477-48d47ca8c95f" status: 200 len: 1454 microversion: 2.1 time: 0.425019 Oct 04 20:46:13.618517 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1339/2736] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 20:46:13 2022] GET /compute/v2.1/images/b73cf850-8f12-4af6-a477-48d47ca8c95f => generated 1454 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:46:13.618517 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-bbfe6264-ed56-48f3-ba8f-401a2dc51037 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:13.618517 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-bbfe6264-ed56-48f3-ba8f-401a2dc51037 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] [instance: 39d66e18-289f-4674-b66c-146d68ef9133] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:13.625883 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bbfe6264-ed56-48f3-ba8f-401a2dc51037 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:13.626502 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bbfe6264-ed56-48f3-ba8f-401a2dc51037 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:13.627325 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bbfe6264-ed56-48f3-ba8f-401a2dc51037 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:13.628305 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bbfe6264-ed56-48f3-ba8f-401a2dc51037 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:13.628949 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bbfe6264-ed56-48f3-ba8f-401a2dc51037 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:13.629378 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bbfe6264-ed56-48f3-ba8f-401a2dc51037 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:13.779359 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-bbfe6264-ed56-48f3-ba8f-401a2dc51037 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:13.794084 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-bbfe6264-ed56-48f3-ba8f-401a2dc51037 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:13.798063 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-bbfe6264-ed56-48f3-ba8f-401a2dc51037 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:13.811484 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-bbfe6264-ed56-48f3-ba8f-401a2dc51037 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] 10.222.0.33 "GET /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133" status: 200 len: 1546 microversion: 2.91 time: 0.198464 Oct 04 20:46:13.812127 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1340/2737] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:46:13 2022] GET /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133 => generated 1546 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:46:13.823480 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f852ac06-85ae-4220-b620-7fc4e39ac263 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:13.824269 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f852ac06-85ae-4220-b620-7fc4e39ac263 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] [instance: c79c0cc3-17e6-4c35-b17e-c76c9b7e9e39] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:13.830576 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-24facd54-8e8f-4e61-af30-6ccc904e40ee tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12dc6570db03431187680f51349e55d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91111396aabd4306b66e14b5abd822ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:13.840156 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f852ac06-85ae-4220-b620-7fc4e39ac263 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:13.840875 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f852ac06-85ae-4220-b620-7fc4e39ac263 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:13.841312 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f852ac06-85ae-4220-b620-7fc4e39ac263 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:13.842056 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f852ac06-85ae-4220-b620-7fc4e39ac263 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:13.842545 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f852ac06-85ae-4220-b620-7fc4e39ac263 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:13.843194 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f852ac06-85ae-4220-b620-7fc4e39ac263 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:13.848969 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-24facd54-8e8f-4e61-af30-6ccc904e40ee tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] 10.222.0.33 "GET /compute/v2.1/servers/db0b522b-4140-4587-9c1b-0e62d778dce4" status: 200 len: 1321 microversion: 2.1 time: 0.309224 Oct 04 20:46:13.850117 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1398/2738] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:46:13 2022] GET /compute/v2.1/servers/db0b522b-4140-4587-9c1b-0e62d778dce4 => generated 1321 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:46:13.860205 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-58dbfc7d-0224-4a8b-8181-b8442f015842 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Action: 'create', calling method: .version_select at 0x7f3c78957700>, body: {"keypair": {"name": "tempest-keypair-1555414461", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAHbbwlHLOO2WHd04wW3UM3k0kIbGvehXrim4UtSqLr3QegZorO9o9RJV/vIfFmwGFH5y0PThokRgxdmXEedwK0NdF+L0Mag/0dInY4UzDvGbtWTGduHs5uzn4+FbPnCDA=="}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:46:13.884576 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-58dbfc7d-0224-4a8b-8181-b8442f015842 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Getting quotas for project fc7f38600b5041ad8e66a12d77b940fa. Resources: {'key_pairs'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:46:13.890835 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-58dbfc7d-0224-4a8b-8181-b8442f015842 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Getting quotas for user d9e4b00964014a0383f79597652bd428 and project fc7f38600b5041ad8e66a12d77b940fa. Resources: {'key_pairs'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:46:13.895431 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f852ac06-85ae-4220-b620-7fc4e39ac263 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] [instance: c79c0cc3-17e6-4c35-b17e-c76c9b7e9e39] Going to try to terminate instance {{(pid=128801) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:46:13.934470 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-58dbfc7d-0224-4a8b-8181-b8442f015842 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.082602 Oct 04 20:46:13.941235 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1399/2739] 10.222.0.33 () {60 vars in 1159 bytes} [Tue Oct 4 20:46:13 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:46:13.941235 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-9b774509-91ec-488e-8175-2260cdda2729 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:13.941235 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-9b774509-91ec-488e-8175-2260cdda2729 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] [instance: b65c8ce2-8537-4f84-ba63-5b913f6adc81] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:13.949249 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:46:13.958681 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9b774509-91ec-488e-8175-2260cdda2729 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:13.959252 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9b774509-91ec-488e-8175-2260cdda2729 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:13.960289 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9b774509-91ec-488e-8175-2260cdda2729 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:13.961004 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9b774509-91ec-488e-8175-2260cdda2729 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:13.961464 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9b774509-91ec-488e-8175-2260cdda2729 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:13.961896 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9b774509-91ec-488e-8175-2260cdda2729 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:13.979422 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:46:14.031849 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f852ac06-85ae-4220-b620-7fc4e39ac263 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] 10.222.0.33 "DELETE /compute/v2.1/servers/c79c0cc3-17e6-4c35-b17e-c76c9b7e9e39" status: 204 len: 0 microversion: 2.1 time: 0.218298 Oct 04 20:46:14.037752 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1341/2740] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 20:46:13 2022] DELETE /compute/v2.1/servers/c79c0cc3-17e6-4c35-b17e-c76c9b7e9e39 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:46:14.257479 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-9b774509-91ec-488e-8175-2260cdda2729 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87dcc7baf63f4ae6bfe0a099adffd408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7097bc12179446f6a3e1fac8434d5c64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:14.260682 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-63dc46a4-0572-4fa1-ba56-fa5d10bcafb5 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-993802437", "imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63", "flavorRef": "452", "networks": [{"uuid": "4c0a9fa9-b96b-431d-88f1-03cf1e898d51"}]}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:46:14.267365 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-9b774509-91ec-488e-8175-2260cdda2729 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] 10.222.0.33 "GET /compute/v2.1/servers/b65c8ce2-8537-4f84-ba63-5b913f6adc81" status: 200 len: 1308 microversion: 2.1 time: 0.331008 Oct 04 20:46:14.283105 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1400/2741] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:46:13 2022] GET /compute/v2.1/servers/b65c8ce2-8537-4f84-ba63-5b913f6adc81 => generated 1308 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:46:14.296684 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-7918302c-d278-49e9-8951-253f7e08721b req-bda5007f-3524-4f4a-90af-9155563c8965 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d46fff2-b04d-41aa-ada0-2023ab545b48", "name": "network-vif-plugged", "status": "completed", "tag": "39e1fcde-c40c-4b4b-8edd-7565faaf4580"}, {"server_uuid": "8917de21-2b45-4249-ae17-17f679d4856f", "name": "network-vif-plugged", "status": "completed", "tag": "ec043ecd-8aa4-4125-9877-75f2ddd3f7ee"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:46:14.309463 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-7918302c-d278-49e9-8951-253f7e08721b req-bda5007f-3524-4f4a-90af-9155563c8965 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:14.310136 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-7918302c-d278-49e9-8951-253f7e08721b req-bda5007f-3524-4f4a-90af-9155563c8965 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:14.310625 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-7918302c-d278-49e9-8951-253f7e08721b req-bda5007f-3524-4f4a-90af-9155563c8965 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:14.343967 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-7918302c-d278-49e9-8951-253f7e08721b req-bda5007f-3524-4f4a-90af-9155563c8965 service nova] Creating event network-vif-plugged:39e1fcde-c40c-4b4b-8edd-7565faaf4580 for instance 4d46fff2-b04d-41aa-ada0-2023ab545b48 on n-h1-854823-8 Oct 04 20:46:14.344919 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-7918302c-d278-49e9-8951-253f7e08721b req-bda5007f-3524-4f4a-90af-9155563c8965 service nova] Creating event network-vif-plugged:ec043ecd-8aa4-4125-9877-75f2ddd3f7ee for instance 8917de21-2b45-4249-ae17-17f679d4856f on n-h2-854823-8 Oct 04 20:46:14.362489 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-7918302c-d278-49e9-8951-253f7e08721b req-bda5007f-3524-4f4a-90af-9155563c8965 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.069214 Oct 04 20:46:14.363500 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1401/2742] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:46:14 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 20:46:14.521149 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-86224f0a-f9c6-4ba1-b5a8-14ec8eaf3507 req-deea66dd-9793-49e5-9be0-9c739c135a57 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b65c8ce2-8537-4f84-ba63-5b913f6adc81", "tag": "c218b278-1665-4ab3-bc63-10e43ce32a5c"}, {"name": "network-changed", "server_uuid": "db0b522b-4140-4587-9c1b-0e62d778dce4", "tag": "4a163c71-363b-465d-9722-52f73cd8baca"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:46:14.568517 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-86224f0a-f9c6-4ba1-b5a8-14ec8eaf3507 req-deea66dd-9793-49e5-9be0-9c739c135a57 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:14.571964 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-86224f0a-f9c6-4ba1-b5a8-14ec8eaf3507 req-deea66dd-9793-49e5-9be0-9c739c135a57 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:14.581115 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-86224f0a-f9c6-4ba1-b5a8-14ec8eaf3507 req-deea66dd-9793-49e5-9be0-9c739c135a57 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:14.614027 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-86224f0a-f9c6-4ba1-b5a8-14ec8eaf3507 req-deea66dd-9793-49e5-9be0-9c739c135a57 service nova] Creating event network-changed:c218b278-1665-4ab3-bc63-10e43ce32a5c for instance b65c8ce2-8537-4f84-ba63-5b913f6adc81 on n-h2-854823-8 Oct 04 20:46:14.614977 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-86224f0a-f9c6-4ba1-b5a8-14ec8eaf3507 req-deea66dd-9793-49e5-9be0-9c739c135a57 service nova] Creating event network-changed:4a163c71-363b-465d-9722-52f73cd8baca for instance db0b522b-4140-4587-9c1b-0e62d778dce4 on n-h1-854823-8 Oct 04 20:46:14.629329 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-86224f0a-f9c6-4ba1-b5a8-14ec8eaf3507 req-deea66dd-9793-49e5-9be0-9c739c135a57 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.113238 Oct 04 20:46:14.630626 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1402/2743] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:46:14 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 20:46:14.640373 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-36ac491b-aebf-4742-b3c1-868498abd342 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Calling method '.version_select at 0x7f3c74176700>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:14.777970 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.network.neutron [None req-63dc46a4-0572-4fa1-ba56-fa5d10bcafb5 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] validate_networks() for [('4c0a9fa9-b96b-431d-88f1-03cf1e898d51', None, None, None, None, None)] {{(pid=128801) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:46:14.802626 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-36ac491b-aebf-4742-b3c1-868498abd342 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] 10.222.0.33 "GET /compute/v2.1/images/b73cf850-8f12-4af6-a477-48d47ca8c95f" status: 200 len: 1454 microversion: 2.1 time: 0.169291 Oct 04 20:46:14.803830 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1403/2744] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 20:46:14 2022] GET /compute/v2.1/images/b73cf850-8f12-4af6-a477-48d47ca8c95f => generated 1454 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:46:14.849108 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-defa0164-ff77-46dd-a5af-1470e121ce4a tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:14.849937 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-defa0164-ff77-46dd-a5af-1470e121ce4a tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] [instance: 39d66e18-289f-4674-b66c-146d68ef9133] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:14.873495 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-defa0164-ff77-46dd-a5af-1470e121ce4a tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:14.873993 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-defa0164-ff77-46dd-a5af-1470e121ce4a tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:14.876155 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-defa0164-ff77-46dd-a5af-1470e121ce4a tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:14.879464 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-defa0164-ff77-46dd-a5af-1470e121ce4a tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:14.885197 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-defa0164-ff77-46dd-a5af-1470e121ce4a tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:14.886098 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-defa0164-ff77-46dd-a5af-1470e121ce4a tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:15.089574 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-defa0164-ff77-46dd-a5af-1470e121ce4a tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:15.123345 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-defa0164-ff77-46dd-a5af-1470e121ce4a tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:15.124786 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-defa0164-ff77-46dd-a5af-1470e121ce4a tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:15.140752 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-defa0164-ff77-46dd-a5af-1470e121ce4a tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] 10.222.0.33 "GET /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133" status: 200 len: 1546 microversion: 2.91 time: 0.297920 Oct 04 20:46:15.154367 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1404/2745] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:46:14 2022] GET /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133 => generated 1546 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 20:46:15.154367 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-b03e8057-a408-4eaf-b6d3-1a851bfccbee tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:15.154677 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-b03e8057-a408-4eaf-b6d3-1a851bfccbee tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] [instance: db0b522b-4140-4587-9c1b-0e62d778dce4] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:15.168158 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b03e8057-a408-4eaf-b6d3-1a851bfccbee tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:15.168650 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b03e8057-a408-4eaf-b6d3-1a851bfccbee tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:15.169564 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b03e8057-a408-4eaf-b6d3-1a851bfccbee tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:15.170281 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b03e8057-a408-4eaf-b6d3-1a851bfccbee tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:15.170778 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b03e8057-a408-4eaf-b6d3-1a851bfccbee tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:15.171206 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b03e8057-a408-4eaf-b6d3-1a851bfccbee tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:15.673589 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-b03e8057-a408-4eaf-b6d3-1a851bfccbee tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12dc6570db03431187680f51349e55d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91111396aabd4306b66e14b5abd822ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:15.684641 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-b03e8057-a408-4eaf-b6d3-1a851bfccbee tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] 10.222.0.33 "GET /compute/v2.1/servers/db0b522b-4140-4587-9c1b-0e62d778dce4" status: 200 len: 1321 microversion: 2.1 time: 0.540842 Oct 04 20:46:15.685568 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1405/2746] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:46:15 2022] GET /compute/v2.1/servers/db0b522b-4140-4587-9c1b-0e62d778dce4 => generated 1321 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:46:15.690398 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-d50cc233-a815-4549-b6f9-05c464a1d9b6 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:15.691330 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-d50cc233-a815-4549-b6f9-05c464a1d9b6 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] [instance: b65c8ce2-8537-4f84-ba63-5b913f6adc81] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:15.698460 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d50cc233-a815-4549-b6f9-05c464a1d9b6 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:15.699228 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d50cc233-a815-4549-b6f9-05c464a1d9b6 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:15.699880 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d50cc233-a815-4549-b6f9-05c464a1d9b6 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:15.700818 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d50cc233-a815-4549-b6f9-05c464a1d9b6 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:15.701477 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d50cc233-a815-4549-b6f9-05c464a1d9b6 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:15.710606 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d50cc233-a815-4549-b6f9-05c464a1d9b6 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:15.961489 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-63dc46a4-0572-4fa1-ba56-fa5d10bcafb5 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Flavor limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:46:15.962915 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-63dc46a4-0572-4fa1-ba56-fa5d10bcafb5 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Image limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:46:15.964124 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-63dc46a4-0572-4fa1-ba56-fa5d10bcafb5 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Flavor pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:46:15.964771 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-63dc46a4-0572-4fa1-ba56-fa5d10bcafb5 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Image pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:46:15.965397 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-63dc46a4-0572-4fa1-ba56-fa5d10bcafb5 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:46:15.979498 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-63dc46a4-0572-4fa1-ba56-fa5d10bcafb5 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:15.980597 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-63dc46a4-0572-4fa1-ba56-fa5d10bcafb5 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:15.981352 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-63dc46a4-0572-4fa1-ba56-fa5d10bcafb5 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:15.982560 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-63dc46a4-0572-4fa1-ba56-fa5d10bcafb5 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:15.983414 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-63dc46a4-0572-4fa1-ba56-fa5d10bcafb5 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:15.984212 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-63dc46a4-0572-4fa1-ba56-fa5d10bcafb5 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:16.002587 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-d50cc233-a815-4549-b6f9-05c464a1d9b6 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87dcc7baf63f4ae6bfe0a099adffd408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7097bc12179446f6a3e1fac8434d5c64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:16.012217 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-d50cc233-a815-4549-b6f9-05c464a1d9b6 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] 10.222.0.33 "GET /compute/v2.1/servers/b65c8ce2-8537-4f84-ba63-5b913f6adc81" status: 200 len: 1308 microversion: 2.1 time: 0.324249 Oct 04 20:46:16.013688 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1406/2747] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:46:15 2022] GET /compute/v2.1/servers/b65c8ce2-8537-4f84-ba63-5b913f6adc81 => generated 1308 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:46:16.026287 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-8808ccd0-6884-4356-bbce-b995e0288125 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Calling method '.version_select at 0x7f3c74f4d5e0>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:16.029942 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-63dc46a4-0572-4fa1-ba56-fa5d10bcafb5 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Getting quotas for project 3f3fadcd7d4043daa0a6aba27ba814d5. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:46:16.036343 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:46:16.045681 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-63dc46a4-0572-4fa1-ba56-fa5d10bcafb5 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Getting quotas for user aca59cd50bf74a36bb1e4427cd50fbb3 and project 3f3fadcd7d4043daa0a6aba27ba814d5. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:46:16.063282 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-63dc46a4-0572-4fa1-ba56-fa5d10bcafb5 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Going to run 1 instances... {{(pid=128801) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:46:16.075085 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-63dc46a4-0572-4fa1-ba56-fa5d10bcafb5 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] [instance: 815db889-a211-4eab-90f8-7ca46d7102a4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='15b24725-0c99-4bcf-b1fb-907cdf8e2d63',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128801) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:46:16.091012 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-8808ccd0-6884-4356-bbce-b995e0288125 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] 10.222.0.33 "GET /compute/v2.1/images/b73cf850-8f12-4af6-a477-48d47ca8c95f" status: 200 len: 1454 microversion: 2.1 time: 0.073262 Oct 04 20:46:16.093240 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1407/2748] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 20:46:16 2022] GET /compute/v2.1/images/b73cf850-8f12-4af6-a477-48d47ca8c95f => generated 1454 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:46:16.164060 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-63dc46a4-0572-4fa1-ba56-fa5d10bcafb5 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.909722 Oct 04 20:46:16.171453 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1342/2749] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 20:46:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 1918 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 20:46:16.174055 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-0d97cbb2-a134-4e83-8a07-b267f05ecd43 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:16.174927 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-0d97cbb2-a134-4e83-8a07-b267f05ecd43 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] [instance: 39d66e18-289f-4674-b66c-146d68ef9133] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:16.182121 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0d97cbb2-a134-4e83-8a07-b267f05ecd43 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:16.182876 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0d97cbb2-a134-4e83-8a07-b267f05ecd43 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:16.183499 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0d97cbb2-a134-4e83-8a07-b267f05ecd43 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:16.184424 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0d97cbb2-a134-4e83-8a07-b267f05ecd43 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:16.185029 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0d97cbb2-a134-4e83-8a07-b267f05ecd43 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:16.185604 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0d97cbb2-a134-4e83-8a07-b267f05ecd43 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:16.197964 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-87af9c27-5739-416f-bfee-4eb1a03a2666 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:16.198629 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-87af9c27-5739-416f-bfee-4eb1a03a2666 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] [instance: 815db889-a211-4eab-90f8-7ca46d7102a4] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:16.359084 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-0d97cbb2-a134-4e83-8a07-b267f05ecd43 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:16.365651 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-87af9c27-5739-416f-bfee-4eb1a03a2666 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aca59cd50bf74a36bb1e4427cd50fbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3fadcd7d4043daa0a6aba27ba814d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:16.372600 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-0d97cbb2-a134-4e83-8a07-b267f05ecd43 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:16.373755 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-87af9c27-5739-416f-bfee-4eb1a03a2666 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] 10.222.0.33 "GET /compute/v2.1/servers/815db889-a211-4eab-90f8-7ca46d7102a4" status: 200 len: 1207 microversion: 2.1 time: 0.194015 Oct 04 20:46:16.377282 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-0d97cbb2-a134-4e83-8a07-b267f05ecd43 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:16.386126 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=7,nova_api:UPDATE=2 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:46:16.388199 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-0d97cbb2-a134-4e83-8a07-b267f05ecd43 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] 10.222.0.33 "GET /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133" status: 200 len: 1546 microversion: 2.91 time: 0.218858 Oct 04 20:46:16.389545 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1408/2751] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:46:16 2022] GET /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133 => generated 1546 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 20:46:16.389922 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1343/2751] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:46:16 2022] GET /compute/v2.1/servers/815db889-a211-4eab-90f8-7ca46d7102a4 => generated 1207 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:46:16.716732 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-28fb8681-af5b-433d-9e60-7e631a0dc2dc tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:16.719010 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-28fb8681-af5b-433d-9e60-7e631a0dc2dc tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] [instance: db0b522b-4140-4587-9c1b-0e62d778dce4] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:16.753714 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-5fbf800b-5513-459f-8c2d-aaafb238e3b1 req-fd23572b-44fe-49a1-8e74-a524a7970f30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db0b522b-4140-4587-9c1b-0e62d778dce4", "name": "network-vif-plugged", "status": "completed", "tag": "4a163c71-363b-465d-9722-52f73cd8baca"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:46:16.788330 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-28fb8681-af5b-433d-9e60-7e631a0dc2dc tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:16.795052 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-28fb8681-af5b-433d-9e60-7e631a0dc2dc tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:16.795512 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-28fb8681-af5b-433d-9e60-7e631a0dc2dc tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:16.796323 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-28fb8681-af5b-433d-9e60-7e631a0dc2dc tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:16.796793 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-28fb8681-af5b-433d-9e60-7e631a0dc2dc tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:16.797230 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-28fb8681-af5b-433d-9e60-7e631a0dc2dc tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:16.800620 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-5fbf800b-5513-459f-8c2d-aaafb238e3b1 req-fd23572b-44fe-49a1-8e74-a524a7970f30 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:16.801103 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-5fbf800b-5513-459f-8c2d-aaafb238e3b1 req-fd23572b-44fe-49a1-8e74-a524a7970f30 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:16.801539 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-5fbf800b-5513-459f-8c2d-aaafb238e3b1 req-fd23572b-44fe-49a1-8e74-a524a7970f30 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:16.852663 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-5fbf800b-5513-459f-8c2d-aaafb238e3b1 req-fd23572b-44fe-49a1-8e74-a524a7970f30 service nova] Creating event network-vif-plugged:4a163c71-363b-465d-9722-52f73cd8baca for instance db0b522b-4140-4587-9c1b-0e62d778dce4 on n-h1-854823-8 Oct 04 20:46:16.871673 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-5fbf800b-5513-459f-8c2d-aaafb238e3b1 req-fd23572b-44fe-49a1-8e74-a524a7970f30 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115947 Oct 04 20:46:16.874849 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1344/2752] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:46:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:46:17.039497 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-99e3fc7d-6650-4ddf-95df-ad2eb7458dbe tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:17.040481 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-99e3fc7d-6650-4ddf-95df-ad2eb7458dbe tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] [instance: b65c8ce2-8537-4f84-ba63-5b913f6adc81] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:17.052423 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-99e3fc7d-6650-4ddf-95df-ad2eb7458dbe tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:17.056417 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-99e3fc7d-6650-4ddf-95df-ad2eb7458dbe tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:17.057085 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-99e3fc7d-6650-4ddf-95df-ad2eb7458dbe tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:17.058583 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-99e3fc7d-6650-4ddf-95df-ad2eb7458dbe tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:17.060869 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-99e3fc7d-6650-4ddf-95df-ad2eb7458dbe tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:17.063539 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-99e3fc7d-6650-4ddf-95df-ad2eb7458dbe tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:17.251447 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-28fb8681-af5b-433d-9e60-7e631a0dc2dc tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12dc6570db03431187680f51349e55d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91111396aabd4306b66e14b5abd822ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:17.264258 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-28fb8681-af5b-433d-9e60-7e631a0dc2dc tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] 10.222.0.33 "GET /compute/v2.1/servers/db0b522b-4140-4587-9c1b-0e62d778dce4" status: 200 len: 1321 microversion: 2.1 time: 0.554917 Oct 04 20:46:17.267077 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1409/2753] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:46:16 2022] GET /compute/v2.1/servers/db0b522b-4140-4587-9c1b-0e62d778dce4 => generated 1321 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:46:17.277921 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-4996dedd-992d-4687-b1b7-ee21cfb52b7c tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Calling method '.version_select at 0x7f3c78905040>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:17.378808 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-4996dedd-992d-4687-b1b7-ee21cfb52b7c tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] 10.222.0.33 "GET /compute/v2.1/images/b73cf850-8f12-4af6-a477-48d47ca8c95f" status: 200 len: 1454 microversion: 2.1 time: 0.110438 Oct 04 20:46:17.379697 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1410/2754] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 20:46:17 2022] GET /compute/v2.1/images/b73cf850-8f12-4af6-a477-48d47ca8c95f => generated 1454 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:46:17.401954 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-fcdea881-9e1a-4630-9b3a-08f8b37f67c5 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:17.402965 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-fcdea881-9e1a-4630-9b3a-08f8b37f67c5 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] [instance: 815db889-a211-4eab-90f8-7ca46d7102a4] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:17.416587 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fcdea881-9e1a-4630-9b3a-08f8b37f67c5 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:17.417080 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fcdea881-9e1a-4630-9b3a-08f8b37f67c5 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:17.417512 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fcdea881-9e1a-4630-9b3a-08f8b37f67c5 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:17.422622 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fcdea881-9e1a-4630-9b3a-08f8b37f67c5 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:17.423321 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fcdea881-9e1a-4630-9b3a-08f8b37f67c5 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:17.423904 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fcdea881-9e1a-4630-9b3a-08f8b37f67c5 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:17.523056 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-fcdea881-9e1a-4630-9b3a-08f8b37f67c5 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aca59cd50bf74a36bb1e4427cd50fbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3fadcd7d4043daa0a6aba27ba814d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:17.529042 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-99e3fc7d-6650-4ddf-95df-ad2eb7458dbe tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87dcc7baf63f4ae6bfe0a099adffd408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7097bc12179446f6a3e1fac8434d5c64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:17.533754 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-fcdea881-9e1a-4630-9b3a-08f8b37f67c5 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] 10.222.0.33 "GET /compute/v2.1/servers/815db889-a211-4eab-90f8-7ca46d7102a4" status: 200 len: 1203 microversion: 2.1 time: 0.135677 Oct 04 20:46:17.535672 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1411/2755] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:46:17 2022] GET /compute/v2.1/servers/815db889-a211-4eab-90f8-7ca46d7102a4 => generated 1203 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:46:17.538966 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-99e3fc7d-6650-4ddf-95df-ad2eb7458dbe tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] 10.222.0.33 "GET /compute/v2.1/servers/b65c8ce2-8537-4f84-ba63-5b913f6adc81" status: 200 len: 1308 microversion: 2.1 time: 0.504053 Oct 04 20:46:17.542229 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-76ef96b9-7f91-4e3b-a0d2-db3634820741 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:17.543113 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-76ef96b9-7f91-4e3b-a0d2-db3634820741 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] [instance: 39d66e18-289f-4674-b66c-146d68ef9133] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:17.543969 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1345/2756] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:46:17 2022] GET /compute/v2.1/servers/b65c8ce2-8537-4f84-ba63-5b913f6adc81 => generated 1308 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:46:17.549749 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7be16c6c-ffdf-4e79-bd4b-10870adacddd tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2017632179", "imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1b6eb29e-dbc2-4007-8946-b5a4c5a89268"}], "security_groups": [{"name": "tempest-securitygroup--579396373"}], "key_name": "tempest-keypair-1555414461", "user_data": "}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:46:17.550901 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-76ef96b9-7f91-4e3b-a0d2-db3634820741 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:17.551684 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-76ef96b9-7f91-4e3b-a0d2-db3634820741 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:17.552343 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-76ef96b9-7f91-4e3b-a0d2-db3634820741 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:17.553381 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-76ef96b9-7f91-4e3b-a0d2-db3634820741 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:17.554129 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-76ef96b9-7f91-4e3b-a0d2-db3634820741 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:17.554925 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-76ef96b9-7f91-4e3b-a0d2-db3634820741 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:17.659816 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-76ef96b9-7f91-4e3b-a0d2-db3634820741 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:17.674608 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-76ef96b9-7f91-4e3b-a0d2-db3634820741 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:17.675987 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-76ef96b9-7f91-4e3b-a0d2-db3634820741 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:17.706889 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-76ef96b9-7f91-4e3b-a0d2-db3634820741 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] 10.222.0.33 "GET /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133" status: 200 len: 1546 microversion: 2.91 time: 0.163176 Oct 04 20:46:17.707810 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1412/2757] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:46:17 2022] GET /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133 => generated 1546 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:46:17.759007 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.network.neutron [None req-7be16c6c-ffdf-4e79-bd4b-10870adacddd tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] validate_networks() for [('1b6eb29e-dbc2-4007-8946-b5a4c5a89268', None, None, None, None, None)] {{(pid=128801) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:46:18.298866 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-cc41a07d-52f8-47c1-8329-1177360f1560 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:18.300103 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-cc41a07d-52f8-47c1-8329-1177360f1560 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] [instance: db0b522b-4140-4587-9c1b-0e62d778dce4] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:18.315540 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cc41a07d-52f8-47c1-8329-1177360f1560 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:18.321827 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cc41a07d-52f8-47c1-8329-1177360f1560 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:18.322309 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cc41a07d-52f8-47c1-8329-1177360f1560 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:18.323070 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cc41a07d-52f8-47c1-8329-1177360f1560 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:18.323527 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cc41a07d-52f8-47c1-8329-1177360f1560 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:18.323950 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cc41a07d-52f8-47c1-8329-1177360f1560 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:19.069343 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-cc41a07d-52f8-47c1-8329-1177360f1560 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12dc6570db03431187680f51349e55d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91111396aabd4306b66e14b5abd822ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:19.082590 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-cc41a07d-52f8-47c1-8329-1177360f1560 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] 10.222.0.33 "GET /compute/v2.1/servers/db0b522b-4140-4587-9c1b-0e62d778dce4" status: 200 len: 1321 microversion: 2.1 time: 0.796535 Oct 04 20:46:19.087248 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1413/2758] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:46:18 2022] GET /compute/v2.1/servers/db0b522b-4140-4587-9c1b-0e62d778dce4 => generated 1321 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:46:19.114369 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-564930ab-e458-40cd-a17b-9dc6756e2234 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Calling method '.version_select at 0x7f3c7419f550>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:20.011867 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-7be16c6c-ffdf-4e79-bd4b-10870adacddd tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Flavor limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:46:20.012455 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-7be16c6c-ffdf-4e79-bd4b-10870adacddd tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Image limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:46:20.012853 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-7be16c6c-ffdf-4e79-bd4b-10870adacddd tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Flavor pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:46:20.014041 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-7be16c6c-ffdf-4e79-bd4b-10870adacddd tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Image pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:46:20.014638 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-7be16c6c-ffdf-4e79-bd4b-10870adacddd tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:46:20.039336 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7be16c6c-ffdf-4e79-bd4b-10870adacddd tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:20.039843 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7be16c6c-ffdf-4e79-bd4b-10870adacddd tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:20.040289 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7be16c6c-ffdf-4e79-bd4b-10870adacddd tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:20.042103 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7be16c6c-ffdf-4e79-bd4b-10870adacddd tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:20.042850 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7be16c6c-ffdf-4e79-bd4b-10870adacddd tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:20.044002 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7be16c6c-ffdf-4e79-bd4b-10870adacddd tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:20.072732 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-7be16c6c-ffdf-4e79-bd4b-10870adacddd tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Getting quotas for project fc7f38600b5041ad8e66a12d77b940fa. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:46:20.080323 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-7be16c6c-ffdf-4e79-bd4b-10870adacddd tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Getting quotas for user d9e4b00964014a0383f79597652bd428 and project fc7f38600b5041ad8e66a12d77b940fa. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:46:20.104413 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-7be16c6c-ffdf-4e79-bd4b-10870adacddd tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Going to run 1 instances... {{(pid=128801) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:46:20.107298 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-7be16c6c-ffdf-4e79-bd4b-10870adacddd tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] [instance: c703a086-cf9d-4d12-8a18-623e454bcb64] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='15b24725-0c99-4bcf-b1fb-907cdf8e2d63',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128801) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:46:20.169142 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-7be16c6c-ffdf-4e79-bd4b-10870adacddd tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.623907 Oct 04 20:46:20.180265 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1346/2759] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 20:46:17 2022] POST /compute/v2.1/servers => generated 401 bytes in 2636 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 20:46:20.188798 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-241c1e0e-27b1-4858-ba2c-dd6097a5fb49 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:20.189978 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-241c1e0e-27b1-4858-ba2c-dd6097a5fb49 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] [instance: 815db889-a211-4eab-90f8-7ca46d7102a4] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:20.211426 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-241c1e0e-27b1-4858-ba2c-dd6097a5fb49 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:20.213585 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-241c1e0e-27b1-4858-ba2c-dd6097a5fb49 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:20.216429 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-241c1e0e-27b1-4858-ba2c-dd6097a5fb49 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:20.217367 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-241c1e0e-27b1-4858-ba2c-dd6097a5fb49 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:20.217974 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-241c1e0e-27b1-4858-ba2c-dd6097a5fb49 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:20.218601 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-241c1e0e-27b1-4858-ba2c-dd6097a5fb49 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:20.367663 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-241c1e0e-27b1-4858-ba2c-dd6097a5fb49 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aca59cd50bf74a36bb1e4427cd50fbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3fadcd7d4043daa0a6aba27ba814d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:20.397599 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-241c1e0e-27b1-4858-ba2c-dd6097a5fb49 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] 10.222.0.33 "GET /compute/v2.1/servers/815db889-a211-4eab-90f8-7ca46d7102a4" status: 200 len: 1265 microversion: 2.1 time: 0.211506 Oct 04 20:46:20.412009 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1347/2760] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:46:20 2022] GET /compute/v2.1/servers/815db889-a211-4eab-90f8-7ca46d7102a4 => generated 1265 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:46:20.413202 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2455d91a-1357-43e3-9caa-07ce45613e3b tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:20.415760 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-2455d91a-1357-43e3-9caa-07ce45613e3b tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] [instance: b65c8ce2-8537-4f84-ba63-5b913f6adc81] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:20.433963 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2455d91a-1357-43e3-9caa-07ce45613e3b tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:20.435707 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2455d91a-1357-43e3-9caa-07ce45613e3b tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:20.436240 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2455d91a-1357-43e3-9caa-07ce45613e3b tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:20.440279 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2455d91a-1357-43e3-9caa-07ce45613e3b tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:20.441234 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2455d91a-1357-43e3-9caa-07ce45613e3b tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:20.444933 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2455d91a-1357-43e3-9caa-07ce45613e3b tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:20.794387 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-2455d91a-1357-43e3-9caa-07ce45613e3b tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87dcc7baf63f4ae6bfe0a099adffd408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7097bc12179446f6a3e1fac8434d5c64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:20.804061 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-2455d91a-1357-43e3-9caa-07ce45613e3b tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] 10.222.0.33 "GET /compute/v2.1/servers/b65c8ce2-8537-4f84-ba63-5b913f6adc81" status: 200 len: 1308 microversion: 2.1 time: 0.401915 Oct 04 20:46:20.806859 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1348/2761] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:46:20 2022] GET /compute/v2.1/servers/b65c8ce2-8537-4f84-ba63-5b913f6adc81 => generated 1308 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:46:20.828872 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f445d363-f3db-40a2-8ed8-48c768af9a7c tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:20.829617 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f445d363-f3db-40a2-8ed8-48c768af9a7c tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] [instance: 39d66e18-289f-4674-b66c-146d68ef9133] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:20.844414 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f445d363-f3db-40a2-8ed8-48c768af9a7c tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:20.844914 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f445d363-f3db-40a2-8ed8-48c768af9a7c tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:20.845331 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f445d363-f3db-40a2-8ed8-48c768af9a7c tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:20.846043 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f445d363-f3db-40a2-8ed8-48c768af9a7c tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:20.849194 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f445d363-f3db-40a2-8ed8-48c768af9a7c tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:20.850876 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f445d363-f3db-40a2-8ed8-48c768af9a7c tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:21.124950 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f445d363-f3db-40a2-8ed8-48c768af9a7c tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:21.137900 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f445d363-f3db-40a2-8ed8-48c768af9a7c tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:21.140707 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f445d363-f3db-40a2-8ed8-48c768af9a7c tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:21.160091 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f445d363-f3db-40a2-8ed8-48c768af9a7c tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] 10.222.0.33 "GET /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133" status: 200 len: 1546 microversion: 2.91 time: 0.351203 Oct 04 20:46:21.175819 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1349/2762] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:46:20 2022] GET /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133 => generated 1546 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:46:21.209144 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-ecf3aa5f-193f-448b-a093-ccd134292e35 req-07604bbe-1ede-4471-bed4-2f086413d6f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c79c0cc3-17e6-4c35-b17e-c76c9b7e9e39", "name": "network-vif-unplugged", "status": "completed", "tag": "f2fef876-3f0a-43e8-af74-a8f0135c6b3f"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:46:21.259974 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-ecf3aa5f-193f-448b-a093-ccd134292e35 req-07604bbe-1ede-4471-bed4-2f086413d6f7 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:21.261924 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-ecf3aa5f-193f-448b-a093-ccd134292e35 req-07604bbe-1ede-4471-bed4-2f086413d6f7 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:21.262504 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-ecf3aa5f-193f-448b-a093-ccd134292e35 req-07604bbe-1ede-4471-bed4-2f086413d6f7 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:21.301630 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-ecf3aa5f-193f-448b-a093-ccd134292e35 req-07604bbe-1ede-4471-bed4-2f086413d6f7 service nova] Creating event network-vif-unplugged:f2fef876-3f0a-43e8-af74-a8f0135c6b3f for instance c79c0cc3-17e6-4c35-b17e-c76c9b7e9e39 on n-h2-854823-8 Oct 04 20:46:21.319346 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-ecf3aa5f-193f-448b-a093-ccd134292e35 req-07604bbe-1ede-4471-bed4-2f086413d6f7 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.138263 Oct 04 20:46:21.323520 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1350/2763] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:46:21 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:46:21.339658 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8b92b387-9e52-4f48-a4ce-f3c18519455f tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:21.346167 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-8b92b387-9e52-4f48-a4ce-f3c18519455f tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] [instance: db0b522b-4140-4587-9c1b-0e62d778dce4] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:21.365352 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8b92b387-9e52-4f48-a4ce-f3c18519455f tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:21.367396 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8b92b387-9e52-4f48-a4ce-f3c18519455f tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:21.368975 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8b92b387-9e52-4f48-a4ce-f3c18519455f tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:21.369983 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8b92b387-9e52-4f48-a4ce-f3c18519455f tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:21.371406 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8b92b387-9e52-4f48-a4ce-f3c18519455f tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:21.372077 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8b92b387-9e52-4f48-a4ce-f3c18519455f tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:21.545661 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-8b92b387-9e52-4f48-a4ce-f3c18519455f tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12dc6570db03431187680f51349e55d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91111396aabd4306b66e14b5abd822ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:21.555985 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-8b92b387-9e52-4f48-a4ce-f3c18519455f tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] 10.222.0.33 "GET /compute/v2.1/servers/db0b522b-4140-4587-9c1b-0e62d778dce4" status: 200 len: 1511 microversion: 2.1 time: 0.231121 Oct 04 20:46:21.562801 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1351/2764] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:46:21 2022] GET /compute/v2.1/servers/db0b522b-4140-4587-9c1b-0e62d778dce4 => generated 1511 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:46:21.573981 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-571189da-476d-4a4e-bfcb-bd44561a094b tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:21.576584 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-571189da-476d-4a4e-bfcb-bd44561a094b tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] [instance: c703a086-cf9d-4d12-8a18-623e454bcb64] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:21.595687 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-571189da-476d-4a4e-bfcb-bd44561a094b tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:21.596533 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-571189da-476d-4a4e-bfcb-bd44561a094b tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:21.597299 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-571189da-476d-4a4e-bfcb-bd44561a094b tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:21.598233 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-571189da-476d-4a4e-bfcb-bd44561a094b tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:21.603542 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-571189da-476d-4a4e-bfcb-bd44561a094b tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:21.604248 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-571189da-476d-4a4e-bfcb-bd44561a094b tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:21.791542 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-571189da-476d-4a4e-bfcb-bd44561a094b tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e4b00964014a0383f79597652bd428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7f38600b5041ad8e66a12d77b940fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:21.853420 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-571189da-476d-4a4e-bfcb-bd44561a094b tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] 10.222.0.33 "GET /compute/v2.1/servers/c703a086-cf9d-4d12-8a18-623e454bcb64" status: 200 len: 1238 microversion: 2.1 time: 0.287067 Oct 04 20:46:21.856174 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1352/2765] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:46:21 2022] GET /compute/v2.1/servers/c703a086-cf9d-4d12-8a18-623e454bcb64 => generated 1238 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:46:21.874019 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-30cbe6c7-ecff-4d97-a657-7cdabb110ec2 req-ea8cd621-e71a-4db7-8f35-adb5bf10cb9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c79c0cc3-17e6-4c35-b17e-c76c9b7e9e39", "name": "network-vif-deleted", "tag": "f2fef876-3f0a-43e8-af74-a8f0135c6b3f"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:46:21.911460 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-30cbe6c7-ecff-4d97-a657-7cdabb110ec2 req-ea8cd621-e71a-4db7-8f35-adb5bf10cb9c service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:21.918726 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-30cbe6c7-ecff-4d97-a657-7cdabb110ec2 req-ea8cd621-e71a-4db7-8f35-adb5bf10cb9c service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:21.919306 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-30cbe6c7-ecff-4d97-a657-7cdabb110ec2 req-ea8cd621-e71a-4db7-8f35-adb5bf10cb9c service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:21.948748 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-30cbe6c7-ecff-4d97-a657-7cdabb110ec2 req-ea8cd621-e71a-4db7-8f35-adb5bf10cb9c service nova] Creating event network-vif-deleted:f2fef876-3f0a-43e8-af74-a8f0135c6b3f for instance c79c0cc3-17e6-4c35-b17e-c76c9b7e9e39 on n-h2-854823-8 Oct 04 20:46:21.963814 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-30cbe6c7-ecff-4d97-a657-7cdabb110ec2 req-ea8cd621-e71a-4db7-8f35-adb5bf10cb9c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105745 Oct 04 20:46:21.967180 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1353/2766] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:46:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:46:21.989208 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ef37dd36-29bc-44af-afbb-b74e79d8cd4e tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:21.995084 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ef37dd36-29bc-44af-afbb-b74e79d8cd4e tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] [instance: 815db889-a211-4eab-90f8-7ca46d7102a4] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:22.016075 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ef37dd36-29bc-44af-afbb-b74e79d8cd4e tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:22.017483 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ef37dd36-29bc-44af-afbb-b74e79d8cd4e tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:22.017934 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ef37dd36-29bc-44af-afbb-b74e79d8cd4e tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:22.023267 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ef37dd36-29bc-44af-afbb-b74e79d8cd4e tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:22.028785 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ef37dd36-29bc-44af-afbb-b74e79d8cd4e tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:22.029746 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ef37dd36-29bc-44af-afbb-b74e79d8cd4e tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:22.634363 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-ef37dd36-29bc-44af-afbb-b74e79d8cd4e tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aca59cd50bf74a36bb1e4427cd50fbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3fadcd7d4043daa0a6aba27ba814d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:22.656636 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ef37dd36-29bc-44af-afbb-b74e79d8cd4e tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] 10.222.0.33 "GET /compute/v2.1/servers/815db889-a211-4eab-90f8-7ca46d7102a4" status: 200 len: 1307 microversion: 2.1 time: 0.685554 Oct 04 20:46:22.678295 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1354/2767] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:46:21 2022] GET /compute/v2.1/servers/815db889-a211-4eab-90f8-7ca46d7102a4 => generated 1307 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:46:22.694864 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-097bbf92-3a47-4b84-ab87-a051662166b6 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:22.695562 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-097bbf92-3a47-4b84-ab87-a051662166b6 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] [instance: 39e846c1-6876-42ef-b290-f733516e1051] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:22.732325 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-097bbf92-3a47-4b84-ab87-a051662166b6 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:22.735973 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-097bbf92-3a47-4b84-ab87-a051662166b6 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:22.736436 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-097bbf92-3a47-4b84-ab87-a051662166b6 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:22.737194 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-097bbf92-3a47-4b84-ab87-a051662166b6 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:22.738331 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-097bbf92-3a47-4b84-ab87-a051662166b6 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:22.738331 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-097bbf92-3a47-4b84-ab87-a051662166b6 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:23.644944 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-097bbf92-3a47-4b84-ab87-a051662166b6 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12dc6570db03431187680f51349e55d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91111396aabd4306b66e14b5abd822ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:23.658540 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-097bbf92-3a47-4b84-ab87-a051662166b6 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] 10.222.0.33 "GET /compute/v2.1/servers/39e846c1-6876-42ef-b290-f733516e1051" status: 200 len: 1321 microversion: 2.1 time: 0.975479 Oct 04 20:46:23.663521 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1355/2768] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:46:22 2022] GET /compute/v2.1/servers/39e846c1-6876-42ef-b290-f733516e1051 => generated 1321 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:46:23.671436 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-15de3953-888d-47a3-860d-a99ad3c61cb3 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:23.672301 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-15de3953-888d-47a3-860d-a99ad3c61cb3 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] [instance: b65c8ce2-8537-4f84-ba63-5b913f6adc81] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:23.714891 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-15de3953-888d-47a3-860d-a99ad3c61cb3 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:23.715667 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-15de3953-888d-47a3-860d-a99ad3c61cb3 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:23.716293 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-15de3953-888d-47a3-860d-a99ad3c61cb3 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:23.717265 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-15de3953-888d-47a3-860d-a99ad3c61cb3 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:23.721404 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-15de3953-888d-47a3-860d-a99ad3c61cb3 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:23.723277 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-15de3953-888d-47a3-860d-a99ad3c61cb3 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:23.901880 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell0:SELECT=4 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:46:24.199563 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-15de3953-888d-47a3-860d-a99ad3c61cb3 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87dcc7baf63f4ae6bfe0a099adffd408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7097bc12179446f6a3e1fac8434d5c64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:24.235650 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-15de3953-888d-47a3-860d-a99ad3c61cb3 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] 10.222.0.33 "GET /compute/v2.1/servers/b65c8ce2-8537-4f84-ba63-5b913f6adc81" status: 200 len: 1308 microversion: 2.1 time: 0.568731 Oct 04 20:46:24.237023 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1356/2769] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:46:23 2022] GET /compute/v2.1/servers/b65c8ce2-8537-4f84-ba63-5b913f6adc81 => generated 1308 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:46:24.248554 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d40bd807-4648-497d-80a5-bbad6b407799 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:24.259983 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d40bd807-4648-497d-80a5-bbad6b407799 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] [instance: 39d66e18-289f-4674-b66c-146d68ef9133] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:24.300950 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d40bd807-4648-497d-80a5-bbad6b407799 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:24.301892 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d40bd807-4648-497d-80a5-bbad6b407799 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:24.304035 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d40bd807-4648-497d-80a5-bbad6b407799 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:24.305543 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d40bd807-4648-497d-80a5-bbad6b407799 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:24.309266 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d40bd807-4648-497d-80a5-bbad6b407799 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:24.310433 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d40bd807-4648-497d-80a5-bbad6b407799 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:24.551246 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d40bd807-4648-497d-80a5-bbad6b407799 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:24.563638 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d40bd807-4648-497d-80a5-bbad6b407799 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:24.588703 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d40bd807-4648-497d-80a5-bbad6b407799 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:24.603999 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d40bd807-4648-497d-80a5-bbad6b407799 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] 10.222.0.33 "GET /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133" status: 200 len: 1546 microversion: 2.91 time: 0.363194 Oct 04 20:46:24.608576 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1357/2770] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:46:24 2022] GET /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133 => generated 1546 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:46:24.620284 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8bb6f7e9-e7e1-4536-831a-a7fe71d9f264 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:24.622945 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-8bb6f7e9-e7e1-4536-831a-a7fe71d9f264 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] [instance: c703a086-cf9d-4d12-8a18-623e454bcb64] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:24.649023 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8bb6f7e9-e7e1-4536-831a-a7fe71d9f264 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:24.650678 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8bb6f7e9-e7e1-4536-831a-a7fe71d9f264 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:24.651345 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8bb6f7e9-e7e1-4536-831a-a7fe71d9f264 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:24.652438 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8bb6f7e9-e7e1-4536-831a-a7fe71d9f264 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:24.653330 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8bb6f7e9-e7e1-4536-831a-a7fe71d9f264 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:24.654111 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8bb6f7e9-e7e1-4536-831a-a7fe71d9f264 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:24.784334 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-8bb6f7e9-e7e1-4536-831a-a7fe71d9f264 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e4b00964014a0383f79597652bd428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7f38600b5041ad8e66a12d77b940fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:24.792362 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-8bb6f7e9-e7e1-4536-831a-a7fe71d9f264 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] 10.222.0.33 "GET /compute/v2.1/servers/c703a086-cf9d-4d12-8a18-623e454bcb64" status: 200 len: 1300 microversion: 2.1 time: 0.182525 Oct 04 20:46:24.810850 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1358/2771] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:46:24 2022] GET /compute/v2.1/servers/c703a086-cf9d-4d12-8a18-623e454bcb64 => generated 1300 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:46:24.818372 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-fc615c97-7bab-4b76-aaaf-e1253958675d req-53027330-b18b-4a94-a0e0-f8afde4be347 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "815db889-a211-4eab-90f8-7ca46d7102a4", "tag": "61e1947b-dc51-4d3d-8739-b8435daa871f"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:46:24.836899 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-fc615c97-7bab-4b76-aaaf-e1253958675d req-53027330-b18b-4a94-a0e0-f8afde4be347 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:24.837775 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-fc615c97-7bab-4b76-aaaf-e1253958675d req-53027330-b18b-4a94-a0e0-f8afde4be347 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:24.838473 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-fc615c97-7bab-4b76-aaaf-e1253958675d req-53027330-b18b-4a94-a0e0-f8afde4be347 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:24.898391 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-fc615c97-7bab-4b76-aaaf-e1253958675d req-53027330-b18b-4a94-a0e0-f8afde4be347 service nova] Creating event network-changed:61e1947b-dc51-4d3d-8739-b8435daa871f for instance 815db889-a211-4eab-90f8-7ca46d7102a4 on n-h1-854823-8 Oct 04 20:46:24.906634 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-fc615c97-7bab-4b76-aaaf-e1253958675d req-53027330-b18b-4a94-a0e0-f8afde4be347 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094199 Oct 04 20:46:24.909108 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1359/2772] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:46:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:46:24.915526 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e43c3277-8a56-4038-a756-e7f551e1812f tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:24.917147 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e43c3277-8a56-4038-a756-e7f551e1812f tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] [instance: 815db889-a211-4eab-90f8-7ca46d7102a4] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:24.946057 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e43c3277-8a56-4038-a756-e7f551e1812f tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:24.949287 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e43c3277-8a56-4038-a756-e7f551e1812f tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:24.955359 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e43c3277-8a56-4038-a756-e7f551e1812f tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:24.957338 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e43c3277-8a56-4038-a756-e7f551e1812f tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:24.959921 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e43c3277-8a56-4038-a756-e7f551e1812f tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:24.960563 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e43c3277-8a56-4038-a756-e7f551e1812f tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:25.176987 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e43c3277-8a56-4038-a756-e7f551e1812f tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aca59cd50bf74a36bb1e4427cd50fbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3fadcd7d4043daa0a6aba27ba814d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:25.202741 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e43c3277-8a56-4038-a756-e7f551e1812f tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] 10.222.0.33 "GET /compute/v2.1/servers/815db889-a211-4eab-90f8-7ca46d7102a4" status: 200 len: 1307 microversion: 2.1 time: 0.291314 Oct 04 20:46:25.220572 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1360/2773] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:46:24 2022] GET /compute/v2.1/servers/815db889-a211-4eab-90f8-7ca46d7102a4 => generated 1307 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:46:25.238777 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a0368383-98d8-4501-aa35-4e02efbd2f4d tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:25.241054 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a0368383-98d8-4501-aa35-4e02efbd2f4d tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] [instance: 39e846c1-6876-42ef-b290-f733516e1051] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:25.257439 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a0368383-98d8-4501-aa35-4e02efbd2f4d tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:25.259839 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a0368383-98d8-4501-aa35-4e02efbd2f4d tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:25.259839 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a0368383-98d8-4501-aa35-4e02efbd2f4d tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:25.262258 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a0368383-98d8-4501-aa35-4e02efbd2f4d tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:25.265337 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a0368383-98d8-4501-aa35-4e02efbd2f4d tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:25.265875 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a0368383-98d8-4501-aa35-4e02efbd2f4d tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:25.514928 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-a0368383-98d8-4501-aa35-4e02efbd2f4d tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12dc6570db03431187680f51349e55d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91111396aabd4306b66e14b5abd822ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:25.527892 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a0368383-98d8-4501-aa35-4e02efbd2f4d tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] 10.222.0.33 "GET /compute/v2.1/servers/39e846c1-6876-42ef-b290-f733516e1051" status: 200 len: 1321 microversion: 2.1 time: 0.305147 Oct 04 20:46:25.550435 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1361/2774] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:46:25 2022] GET /compute/v2.1/servers/39e846c1-6876-42ef-b290-f733516e1051 => generated 1321 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:46:25.565560 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ebbe31e8-f8f4-4640-8f4c-46c1e261a03e tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:25.571210 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ebbe31e8-f8f4-4640-8f4c-46c1e261a03e tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] [instance: b65c8ce2-8537-4f84-ba63-5b913f6adc81] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:25.582635 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ebbe31e8-f8f4-4640-8f4c-46c1e261a03e tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:25.583494 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ebbe31e8-f8f4-4640-8f4c-46c1e261a03e tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:25.585670 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ebbe31e8-f8f4-4640-8f4c-46c1e261a03e tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:25.589394 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ebbe31e8-f8f4-4640-8f4c-46c1e261a03e tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:25.605327 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ebbe31e8-f8f4-4640-8f4c-46c1e261a03e tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:25.606886 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ebbe31e8-f8f4-4640-8f4c-46c1e261a03e tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:25.637633 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:46:25.954934 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-ebbe31e8-f8f4-4640-8f4c-46c1e261a03e tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87dcc7baf63f4ae6bfe0a099adffd408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7097bc12179446f6a3e1fac8434d5c64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:25.969083 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ebbe31e8-f8f4-4640-8f4c-46c1e261a03e tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] 10.222.0.33 "GET /compute/v2.1/servers/b65c8ce2-8537-4f84-ba63-5b913f6adc81" status: 200 len: 1308 microversion: 2.1 time: 0.413330 Oct 04 20:46:25.971977 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1362/2775] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:46:25 2022] GET /compute/v2.1/servers/b65c8ce2-8537-4f84-ba63-5b913f6adc81 => generated 1308 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:46:25.999215 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6b443f39-48fd-4e0f-b70c-c2e22c338e3c tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:26.000095 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-6b443f39-48fd-4e0f-b70c-c2e22c338e3c tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] [instance: 39d66e18-289f-4674-b66c-146d68ef9133] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:26.007765 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6b443f39-48fd-4e0f-b70c-c2e22c338e3c tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:26.008854 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6b443f39-48fd-4e0f-b70c-c2e22c338e3c tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:26.009657 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6b443f39-48fd-4e0f-b70c-c2e22c338e3c tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:26.011269 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6b443f39-48fd-4e0f-b70c-c2e22c338e3c tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:26.012036 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6b443f39-48fd-4e0f-b70c-c2e22c338e3c tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:26.013012 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6b443f39-48fd-4e0f-b70c-c2e22c338e3c tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:26.155493 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-6b443f39-48fd-4e0f-b70c-c2e22c338e3c tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:26.174887 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-6b443f39-48fd-4e0f-b70c-c2e22c338e3c tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:26.175495 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-6b443f39-48fd-4e0f-b70c-c2e22c338e3c tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:26.192156 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-6b443f39-48fd-4e0f-b70c-c2e22c338e3c tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] 10.222.0.33 "GET /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133" status: 200 len: 1546 microversion: 2.91 time: 0.218319 Oct 04 20:46:26.202374 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1363/2776] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:46:25 2022] GET /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133 => generated 1546 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:46:26.214863 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2e052f85-b3ba-4377-8d9a-197b5e8bae20 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:26.214863 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-2e052f85-b3ba-4377-8d9a-197b5e8bae20 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] [instance: c703a086-cf9d-4d12-8a18-623e454bcb64] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:26.223677 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2e052f85-b3ba-4377-8d9a-197b5e8bae20 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:26.225380 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2e052f85-b3ba-4377-8d9a-197b5e8bae20 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:26.228948 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2e052f85-b3ba-4377-8d9a-197b5e8bae20 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:26.229917 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2e052f85-b3ba-4377-8d9a-197b5e8bae20 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:26.230891 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2e052f85-b3ba-4377-8d9a-197b5e8bae20 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:26.231873 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2e052f85-b3ba-4377-8d9a-197b5e8bae20 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:26.526208 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-2e052f85-b3ba-4377-8d9a-197b5e8bae20 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e4b00964014a0383f79597652bd428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7f38600b5041ad8e66a12d77b940fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:26.543205 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-2e052f85-b3ba-4377-8d9a-197b5e8bae20 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] 10.222.0.33 "GET /compute/v2.1/servers/c703a086-cf9d-4d12-8a18-623e454bcb64" status: 200 len: 1367 microversion: 2.1 time: 0.347705 Oct 04 20:46:26.547136 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1364/2777] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:46:26 2022] GET /compute/v2.1/servers/c703a086-cf9d-4d12-8a18-623e454bcb64 => generated 1367 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:46:26.554148 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-05465320-75ab-495b-b839-fac738404bef req-437b4af7-a9bb-402f-ab7a-8abf5be38e39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39e846c1-6876-42ef-b290-f733516e1051", "name": "network-vif-plugged", "status": "completed", "tag": "41e834af-e651-4065-b00f-f0cead495d74"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:46:26.566774 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-05465320-75ab-495b-b839-fac738404bef req-437b4af7-a9bb-402f-ab7a-8abf5be38e39 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:26.567665 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-05465320-75ab-495b-b839-fac738404bef req-437b4af7-a9bb-402f-ab7a-8abf5be38e39 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:26.568447 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-05465320-75ab-495b-b839-fac738404bef req-437b4af7-a9bb-402f-ab7a-8abf5be38e39 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:26.586682 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-05465320-75ab-495b-b839-fac738404bef req-437b4af7-a9bb-402f-ab7a-8abf5be38e39 service nova] Creating event network-vif-plugged:41e834af-e651-4065-b00f-f0cead495d74 for instance 39e846c1-6876-42ef-b290-f733516e1051 on n-h2-854823-8 Oct 04 20:46:26.593222 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-05465320-75ab-495b-b839-fac738404bef req-437b4af7-a9bb-402f-ab7a-8abf5be38e39 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044362 Oct 04 20:46:26.594279 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1365/2778] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:46:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:46:26.601741 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-23b9eafb-a211-402a-b4ca-a632d67bc724 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:26.603072 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-23b9eafb-a211-402a-b4ca-a632d67bc724 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] [instance: 815db889-a211-4eab-90f8-7ca46d7102a4] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:26.611510 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-23b9eafb-a211-402a-b4ca-a632d67bc724 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:26.612769 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-23b9eafb-a211-402a-b4ca-a632d67bc724 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:26.613396 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-23b9eafb-a211-402a-b4ca-a632d67bc724 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:26.614594 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-23b9eafb-a211-402a-b4ca-a632d67bc724 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:26.616053 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-23b9eafb-a211-402a-b4ca-a632d67bc724 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:26.616659 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-23b9eafb-a211-402a-b4ca-a632d67bc724 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:26.920332 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-23b9eafb-a211-402a-b4ca-a632d67bc724 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aca59cd50bf74a36bb1e4427cd50fbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3fadcd7d4043daa0a6aba27ba814d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:26.934394 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-23b9eafb-a211-402a-b4ca-a632d67bc724 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] 10.222.0.33 "GET /compute/v2.1/servers/815db889-a211-4eab-90f8-7ca46d7102a4" status: 200 len: 1307 microversion: 2.1 time: 0.338146 Oct 04 20:46:26.946390 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1366/2779] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:46:26 2022] GET /compute/v2.1/servers/815db889-a211-4eab-90f8-7ca46d7102a4 => generated 1307 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:46:26.946390 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d8d5da37-5bf0-4b76-9fc4-9ceb4bfb7127 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:26.946390 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d8d5da37-5bf0-4b76-9fc4-9ceb4bfb7127 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] [instance: 39e846c1-6876-42ef-b290-f733516e1051] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:26.957840 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d8d5da37-5bf0-4b76-9fc4-9ceb4bfb7127 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:26.958533 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d8d5da37-5bf0-4b76-9fc4-9ceb4bfb7127 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:26.958805 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d8d5da37-5bf0-4b76-9fc4-9ceb4bfb7127 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:26.960149 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d8d5da37-5bf0-4b76-9fc4-9ceb4bfb7127 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:26.961059 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d8d5da37-5bf0-4b76-9fc4-9ceb4bfb7127 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:26.961332 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d8d5da37-5bf0-4b76-9fc4-9ceb4bfb7127 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:27.454662 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d8d5da37-5bf0-4b76-9fc4-9ceb4bfb7127 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12dc6570db03431187680f51349e55d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91111396aabd4306b66e14b5abd822ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:27.469104 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d8d5da37-5bf0-4b76-9fc4-9ceb4bfb7127 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] 10.222.0.33 "GET /compute/v2.1/servers/39e846c1-6876-42ef-b290-f733516e1051" status: 200 len: 1321 microversion: 2.1 time: 0.532525 Oct 04 20:46:27.470096 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1367/2780] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:46:26 2022] GET /compute/v2.1/servers/39e846c1-6876-42ef-b290-f733516e1051 => generated 1321 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:46:27.486469 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-dffaad9f-7f07-4906-bb7c-d2522bebaaa0 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:27.487469 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-dffaad9f-7f07-4906-bb7c-d2522bebaaa0 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] [instance: b65c8ce2-8537-4f84-ba63-5b913f6adc81] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:27.496117 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dffaad9f-7f07-4906-bb7c-d2522bebaaa0 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:27.500090 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dffaad9f-7f07-4906-bb7c-d2522bebaaa0 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:27.501983 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dffaad9f-7f07-4906-bb7c-d2522bebaaa0 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:27.505414 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dffaad9f-7f07-4906-bb7c-d2522bebaaa0 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:27.509006 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dffaad9f-7f07-4906-bb7c-d2522bebaaa0 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:27.509532 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dffaad9f-7f07-4906-bb7c-d2522bebaaa0 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:28.039991 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-dffaad9f-7f07-4906-bb7c-d2522bebaaa0 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87dcc7baf63f4ae6bfe0a099adffd408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7097bc12179446f6a3e1fac8434d5c64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:28.051045 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-dffaad9f-7f07-4906-bb7c-d2522bebaaa0 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] 10.222.0.33 "GET /compute/v2.1/servers/b65c8ce2-8537-4f84-ba63-5b913f6adc81" status: 200 len: 1308 microversion: 2.1 time: 0.577275 Oct 04 20:46:28.053137 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1368/2781] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:46:27 2022] GET /compute/v2.1/servers/b65c8ce2-8537-4f84-ba63-5b913f6adc81 => generated 1308 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:46:28.057935 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5ab8fd99-c4c2-4573-b920-5d9b58beaecf tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:28.058593 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-5ab8fd99-c4c2-4573-b920-5d9b58beaecf tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] [instance: 39d66e18-289f-4674-b66c-146d68ef9133] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:28.078979 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5ab8fd99-c4c2-4573-b920-5d9b58beaecf tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:28.079495 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5ab8fd99-c4c2-4573-b920-5d9b58beaecf tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:28.079938 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5ab8fd99-c4c2-4573-b920-5d9b58beaecf tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:28.080672 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5ab8fd99-c4c2-4573-b920-5d9b58beaecf tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:28.081134 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5ab8fd99-c4c2-4573-b920-5d9b58beaecf tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:28.081824 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5ab8fd99-c4c2-4573-b920-5d9b58beaecf tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:28.233531 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-5ab8fd99-c4c2-4573-b920-5d9b58beaecf tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:28.246464 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-5ab8fd99-c4c2-4573-b920-5d9b58beaecf tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:28.252837 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-5ab8fd99-c4c2-4573-b920-5d9b58beaecf tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:28.265506 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5ab8fd99-c4c2-4573-b920-5d9b58beaecf tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] 10.222.0.33 "GET /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133" status: 200 len: 1546 microversion: 2.91 time: 0.211257 Oct 04 20:46:28.292918 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1369/2782] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:46:28 2022] GET /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133 => generated 1546 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:46:28.305056 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-40edafd8-86f9-412d-8fc8-67e79c3606de tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:28.305690 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-40edafd8-86f9-412d-8fc8-67e79c3606de tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] [instance: c703a086-cf9d-4d12-8a18-623e454bcb64] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:28.315269 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_api:SELECT=11 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:46:28.317705 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-40edafd8-86f9-412d-8fc8-67e79c3606de tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:28.318184 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-40edafd8-86f9-412d-8fc8-67e79c3606de tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:28.323943 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-40edafd8-86f9-412d-8fc8-67e79c3606de tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:28.324751 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-40edafd8-86f9-412d-8fc8-67e79c3606de tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:28.325237 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-40edafd8-86f9-412d-8fc8-67e79c3606de tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:28.325664 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-40edafd8-86f9-412d-8fc8-67e79c3606de tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:28.944854 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-40edafd8-86f9-412d-8fc8-67e79c3606de tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e4b00964014a0383f79597652bd428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7f38600b5041ad8e66a12d77b940fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:28.955044 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-40edafd8-86f9-412d-8fc8-67e79c3606de tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] 10.222.0.33 "GET /compute/v2.1/servers/c703a086-cf9d-4d12-8a18-623e454bcb64" status: 200 len: 1367 microversion: 2.1 time: 0.660906 Oct 04 20:46:28.972863 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1370/2783] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:46:28 2022] GET /compute/v2.1/servers/c703a086-cf9d-4d12-8a18-623e454bcb64 => generated 1367 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:46:28.999822 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-97ced152-1c8f-4d0b-ae8d-d59ee4ea9a27 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:29.000558 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-97ced152-1c8f-4d0b-ae8d-d59ee4ea9a27 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] [instance: 815db889-a211-4eab-90f8-7ca46d7102a4] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:29.025027 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-97ced152-1c8f-4d0b-ae8d-d59ee4ea9a27 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:29.035216 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-97ced152-1c8f-4d0b-ae8d-d59ee4ea9a27 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:29.035821 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-97ced152-1c8f-4d0b-ae8d-d59ee4ea9a27 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:29.041708 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-97ced152-1c8f-4d0b-ae8d-d59ee4ea9a27 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:29.042448 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-97ced152-1c8f-4d0b-ae8d-d59ee4ea9a27 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:29.042678 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-97ced152-1c8f-4d0b-ae8d-d59ee4ea9a27 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:29.073973 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=56 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:46:29.281415 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-97ced152-1c8f-4d0b-ae8d-d59ee4ea9a27 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aca59cd50bf74a36bb1e4427cd50fbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3fadcd7d4043daa0a6aba27ba814d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:29.296021 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-97ced152-1c8f-4d0b-ae8d-d59ee4ea9a27 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] 10.222.0.33 "GET /compute/v2.1/servers/815db889-a211-4eab-90f8-7ca46d7102a4" status: 200 len: 1307 microversion: 2.1 time: 0.318379 Oct 04 20:46:29.298045 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1371/2784] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:46:28 2022] GET /compute/v2.1/servers/815db889-a211-4eab-90f8-7ca46d7102a4 => generated 1307 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:46:29.311385 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-449700ad-f8fe-4cd2-a43c-ae9b063d241d tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:29.313536 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-449700ad-f8fe-4cd2-a43c-ae9b063d241d tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] [instance: 39e846c1-6876-42ef-b290-f733516e1051] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:29.333631 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-449700ad-f8fe-4cd2-a43c-ae9b063d241d tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:29.337343 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-449700ad-f8fe-4cd2-a43c-ae9b063d241d tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:29.338568 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-449700ad-f8fe-4cd2-a43c-ae9b063d241d tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:29.341251 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-449700ad-f8fe-4cd2-a43c-ae9b063d241d tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:29.343212 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-449700ad-f8fe-4cd2-a43c-ae9b063d241d tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:29.343550 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-449700ad-f8fe-4cd2-a43c-ae9b063d241d tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:29.639944 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-449700ad-f8fe-4cd2-a43c-ae9b063d241d tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12dc6570db03431187680f51349e55d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91111396aabd4306b66e14b5abd822ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:29.656046 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-449700ad-f8fe-4cd2-a43c-ae9b063d241d tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] 10.222.0.33 "GET /compute/v2.1/servers/39e846c1-6876-42ef-b290-f733516e1051" status: 200 len: 1511 microversion: 2.1 time: 0.355157 Oct 04 20:46:29.670372 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1372/2785] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:46:29 2022] GET /compute/v2.1/servers/39e846c1-6876-42ef-b290-f733516e1051 => generated 1511 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:46:29.672818 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-4f49b3c2-536c-41e8-83c3-34cfe1e99299 req-c287d3de-afb3-4f01-b7ce-1a706e228aa4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7bbbbf6d-9e62-426b-85b4-d523110a05ef", "name": "network-vif-plugged", "status": "completed", "tag": "7fcf08a9-d9e7-40ee-b109-178e0b1acd57"}, {"server_uuid": "b65c8ce2-8537-4f84-ba63-5b913f6adc81", "name": "network-vif-plugged", "status": "completed", "tag": "c218b278-1665-4ab3-bc63-10e43ce32a5c"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:46:29.696081 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-4f49b3c2-536c-41e8-83c3-34cfe1e99299 req-c287d3de-afb3-4f01-b7ce-1a706e228aa4 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:29.696573 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-4f49b3c2-536c-41e8-83c3-34cfe1e99299 req-c287d3de-afb3-4f01-b7ce-1a706e228aa4 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:29.697004 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-4f49b3c2-536c-41e8-83c3-34cfe1e99299 req-c287d3de-afb3-4f01-b7ce-1a706e228aa4 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:29.743373 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-4f49b3c2-536c-41e8-83c3-34cfe1e99299 req-c287d3de-afb3-4f01-b7ce-1a706e228aa4 service nova] Creating event network-vif-plugged:7fcf08a9-d9e7-40ee-b109-178e0b1acd57 for instance 7bbbbf6d-9e62-426b-85b4-d523110a05ef on n-h2-854823-8 Oct 04 20:46:29.745581 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-4f49b3c2-536c-41e8-83c3-34cfe1e99299 req-c287d3de-afb3-4f01-b7ce-1a706e228aa4 service nova] Creating event network-vif-plugged:c218b278-1665-4ab3-bc63-10e43ce32a5c for instance b65c8ce2-8537-4f84-ba63-5b913f6adc81 on n-h2-854823-8 Oct 04 20:46:29.764147 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-4f49b3c2-536c-41e8-83c3-34cfe1e99299 req-c287d3de-afb3-4f01-b7ce-1a706e228aa4 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.102839 Oct 04 20:46:29.765076 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1373/2786] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:46:29 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:46:29.770380 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-bb9dbbe9-7c94-40c2-8227-19f7b6bb1b42 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:29.772500 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-bb9dbbe9-7c94-40c2-8227-19f7b6bb1b42 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] [instance: b65c8ce2-8537-4f84-ba63-5b913f6adc81] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:29.791761 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bb9dbbe9-7c94-40c2-8227-19f7b6bb1b42 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:29.792265 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bb9dbbe9-7c94-40c2-8227-19f7b6bb1b42 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:29.792703 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bb9dbbe9-7c94-40c2-8227-19f7b6bb1b42 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:29.795866 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bb9dbbe9-7c94-40c2-8227-19f7b6bb1b42 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:29.796278 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bb9dbbe9-7c94-40c2-8227-19f7b6bb1b42 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:29.796745 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bb9dbbe9-7c94-40c2-8227-19f7b6bb1b42 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:30.060950 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=4 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:46:30.096512 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=14 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:46:30.147748 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-bb9dbbe9-7c94-40c2-8227-19f7b6bb1b42 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87dcc7baf63f4ae6bfe0a099adffd408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7097bc12179446f6a3e1fac8434d5c64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:30.162173 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-bb9dbbe9-7c94-40c2-8227-19f7b6bb1b42 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] 10.222.0.33 "GET /compute/v2.1/servers/b65c8ce2-8537-4f84-ba63-5b913f6adc81" status: 200 len: 1308 microversion: 2.1 time: 0.395745 Oct 04 20:46:30.162812 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1374/2787] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:46:29 2022] GET /compute/v2.1/servers/b65c8ce2-8537-4f84-ba63-5b913f6adc81 => generated 1308 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:46:30.175385 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2e6fe019-e69b-4fbe-b66e-afb0c0031a2d tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:30.176017 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-2e6fe019-e69b-4fbe-b66e-afb0c0031a2d tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] [instance: 39d66e18-289f-4674-b66c-146d68ef9133] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:30.192387 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:46:30.194601 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2e6fe019-e69b-4fbe-b66e-afb0c0031a2d tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:30.195181 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2e6fe019-e69b-4fbe-b66e-afb0c0031a2d tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:30.195634 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2e6fe019-e69b-4fbe-b66e-afb0c0031a2d tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:30.196330 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2e6fe019-e69b-4fbe-b66e-afb0c0031a2d tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:30.196833 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2e6fe019-e69b-4fbe-b66e-afb0c0031a2d tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:30.197263 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2e6fe019-e69b-4fbe-b66e-afb0c0031a2d tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:30.368841 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-2e6fe019-e69b-4fbe-b66e-afb0c0031a2d tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:30.379194 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-2e6fe019-e69b-4fbe-b66e-afb0c0031a2d tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:30.383151 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-2e6fe019-e69b-4fbe-b66e-afb0c0031a2d tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:30.388564 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-2e6fe019-e69b-4fbe-b66e-afb0c0031a2d tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] 10.222.0.33 "GET /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133" status: 200 len: 1546 microversion: 2.91 time: 0.224653 Oct 04 20:46:30.407460 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1375/2788] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:46:30 2022] GET /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133 => generated 1546 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:46:30.413351 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-568fa3e7-4a1f-4dea-a595-e2a3530ab67d req-1fde17b8-6799-47d6-8e0d-8f9a049eebb1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c703a086-cf9d-4d12-8a18-623e454bcb64", "tag": "be986445-0031-49e4-b37c-8a38b40174cd"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:46:30.425950 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-568fa3e7-4a1f-4dea-a595-e2a3530ab67d req-1fde17b8-6799-47d6-8e0d-8f9a049eebb1 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:30.427335 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-568fa3e7-4a1f-4dea-a595-e2a3530ab67d req-1fde17b8-6799-47d6-8e0d-8f9a049eebb1 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:30.428583 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-568fa3e7-4a1f-4dea-a595-e2a3530ab67d req-1fde17b8-6799-47d6-8e0d-8f9a049eebb1 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:30.442226 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-568fa3e7-4a1f-4dea-a595-e2a3530ab67d req-1fde17b8-6799-47d6-8e0d-8f9a049eebb1 service nova] Creating event network-changed:be986445-0031-49e4-b37c-8a38b40174cd for instance c703a086-cf9d-4d12-8a18-623e454bcb64 on n-h1-854823-8 Oct 04 20:46:30.449784 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-568fa3e7-4a1f-4dea-a595-e2a3530ab67d req-1fde17b8-6799-47d6-8e0d-8f9a049eebb1 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040861 Oct 04 20:46:30.454231 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1376/2789] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:46:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:46:30.461287 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ee2c17ad-2940-405b-b804-b99fecbcc111 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:30.462125 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ee2c17ad-2940-405b-b804-b99fecbcc111 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] [instance: 7bbbbf6d-9e62-426b-85b4-d523110a05ef] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:30.479787 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ee2c17ad-2940-405b-b804-b99fecbcc111 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:30.480464 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ee2c17ad-2940-405b-b804-b99fecbcc111 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:30.481410 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ee2c17ad-2940-405b-b804-b99fecbcc111 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:30.483766 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ee2c17ad-2940-405b-b804-b99fecbcc111 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:30.484338 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ee2c17ad-2940-405b-b804-b99fecbcc111 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:30.485161 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ee2c17ad-2940-405b-b804-b99fecbcc111 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:30.766118 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-ee2c17ad-2940-405b-b804-b99fecbcc111 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12dc6570db03431187680f51349e55d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91111396aabd4306b66e14b5abd822ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:30.774781 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ee2c17ad-2940-405b-b804-b99fecbcc111 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] 10.222.0.33 "GET /compute/v2.1/servers/7bbbbf6d-9e62-426b-85b4-d523110a05ef" status: 200 len: 1320 microversion: 2.1 time: 0.319104 Oct 04 20:46:30.775721 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1377/2790] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:46:30 2022] GET /compute/v2.1/servers/7bbbbf6d-9e62-426b-85b4-d523110a05ef => generated 1320 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:46:30.780735 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-4a0aece8-9233-4b64-bfb2-4089303c1b8d tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:30.781339 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-4a0aece8-9233-4b64-bfb2-4089303c1b8d tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] [instance: c703a086-cf9d-4d12-8a18-623e454bcb64] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:30.794254 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4a0aece8-9233-4b64-bfb2-4089303c1b8d tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:30.794951 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4a0aece8-9233-4b64-bfb2-4089303c1b8d tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:30.795390 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4a0aece8-9233-4b64-bfb2-4089303c1b8d tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:30.796173 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4a0aece8-9233-4b64-bfb2-4089303c1b8d tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:30.796606 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4a0aece8-9233-4b64-bfb2-4089303c1b8d tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:30.797031 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4a0aece8-9233-4b64-bfb2-4089303c1b8d tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:31.039985 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-4a0aece8-9233-4b64-bfb2-4089303c1b8d tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e4b00964014a0383f79597652bd428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7f38600b5041ad8e66a12d77b940fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:31.055708 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-4a0aece8-9233-4b64-bfb2-4089303c1b8d tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] 10.222.0.33 "GET /compute/v2.1/servers/c703a086-cf9d-4d12-8a18-623e454bcb64" status: 200 len: 1367 microversion: 2.1 time: 0.278711 Oct 04 20:46:31.066438 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1378/2791] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:46:30 2022] GET /compute/v2.1/servers/c703a086-cf9d-4d12-8a18-623e454bcb64 => generated 1367 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:46:31.071782 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d29409b4-f311-4823-bc1f-5ac92e985ce8 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:31.072405 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d29409b4-f311-4823-bc1f-5ac92e985ce8 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] [instance: 815db889-a211-4eab-90f8-7ca46d7102a4] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:31.090953 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d29409b4-f311-4823-bc1f-5ac92e985ce8 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:31.091468 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d29409b4-f311-4823-bc1f-5ac92e985ce8 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:31.091898 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d29409b4-f311-4823-bc1f-5ac92e985ce8 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:31.092609 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d29409b4-f311-4823-bc1f-5ac92e985ce8 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:31.093063 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d29409b4-f311-4823-bc1f-5ac92e985ce8 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:31.093494 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d29409b4-f311-4823-bc1f-5ac92e985ce8 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:31.395245 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d29409b4-f311-4823-bc1f-5ac92e985ce8 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aca59cd50bf74a36bb1e4427cd50fbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3fadcd7d4043daa0a6aba27ba814d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:31.407266 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d29409b4-f311-4823-bc1f-5ac92e985ce8 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] 10.222.0.33 "GET /compute/v2.1/servers/815db889-a211-4eab-90f8-7ca46d7102a4" status: 200 len: 1307 microversion: 2.1 time: 0.338066 Oct 04 20:46:31.408116 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1379/2792] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:46:31 2022] GET /compute/v2.1/servers/815db889-a211-4eab-90f8-7ca46d7102a4 => generated 1307 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:46:31.413418 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-68fb2cd5-c131-435f-9d18-d39e351acd2b tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:31.414126 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-68fb2cd5-c131-435f-9d18-d39e351acd2b tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] [instance: b65c8ce2-8537-4f84-ba63-5b913f6adc81] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:31.426015 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-68fb2cd5-c131-435f-9d18-d39e351acd2b tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:31.427138 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-68fb2cd5-c131-435f-9d18-d39e351acd2b tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:31.427696 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-68fb2cd5-c131-435f-9d18-d39e351acd2b tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:31.428909 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-68fb2cd5-c131-435f-9d18-d39e351acd2b tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:31.429480 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-68fb2cd5-c131-435f-9d18-d39e351acd2b tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:31.429993 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-68fb2cd5-c131-435f-9d18-d39e351acd2b tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:31.725059 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-68fb2cd5-c131-435f-9d18-d39e351acd2b tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87dcc7baf63f4ae6bfe0a099adffd408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7097bc12179446f6a3e1fac8434d5c64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:31.739127 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-68fb2cd5-c131-435f-9d18-d39e351acd2b tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] 10.222.0.33 "GET /compute/v2.1/servers/b65c8ce2-8537-4f84-ba63-5b913f6adc81" status: 200 len: 1308 microversion: 2.1 time: 0.326932 Oct 04 20:46:31.740575 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1380/2793] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:46:31 2022] GET /compute/v2.1/servers/b65c8ce2-8537-4f84-ba63-5b913f6adc81 => generated 1308 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:46:31.749186 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-92d9a232-a98a-4b67-9baa-5bc66f778811 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:31.758414 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-92d9a232-a98a-4b67-9baa-5bc66f778811 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] [instance: 39d66e18-289f-4674-b66c-146d68ef9133] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:31.782090 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-92d9a232-a98a-4b67-9baa-5bc66f778811 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:31.782541 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-92d9a232-a98a-4b67-9baa-5bc66f778811 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:31.783363 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-92d9a232-a98a-4b67-9baa-5bc66f778811 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:31.783692 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-92d9a232-a98a-4b67-9baa-5bc66f778811 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:31.784153 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-92d9a232-a98a-4b67-9baa-5bc66f778811 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:31.784579 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-92d9a232-a98a-4b67-9baa-5bc66f778811 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:31.813065 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=100 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:46:32.001121 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-92d9a232-a98a-4b67-9baa-5bc66f778811 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:32.023435 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-92d9a232-a98a-4b67-9baa-5bc66f778811 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:32.030263 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-92d9a232-a98a-4b67-9baa-5bc66f778811 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:32.056572 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-92d9a232-a98a-4b67-9baa-5bc66f778811 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] 10.222.0.33 "GET /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133" status: 200 len: 1546 microversion: 2.91 time: 0.312665 Oct 04 20:46:32.058651 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1381/2794] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:46:31 2022] GET /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133 => generated 1546 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:46:32.075717 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-198a2c33-702d-4540-ba96-a0e3472bb8ed tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:32.079639 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-198a2c33-702d-4540-ba96-a0e3472bb8ed tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] [instance: 7bbbbf6d-9e62-426b-85b4-d523110a05ef] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:32.110005 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-198a2c33-702d-4540-ba96-a0e3472bb8ed tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:32.115085 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-198a2c33-702d-4540-ba96-a0e3472bb8ed tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:32.116070 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-198a2c33-702d-4540-ba96-a0e3472bb8ed tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:32.117791 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-198a2c33-702d-4540-ba96-a0e3472bb8ed tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:32.121303 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-198a2c33-702d-4540-ba96-a0e3472bb8ed tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:32.123900 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-198a2c33-702d-4540-ba96-a0e3472bb8ed tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:32.894713 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-198a2c33-702d-4540-ba96-a0e3472bb8ed tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12dc6570db03431187680f51349e55d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91111396aabd4306b66e14b5abd822ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:32.906550 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-198a2c33-702d-4540-ba96-a0e3472bb8ed tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] 10.222.0.33 "GET /compute/v2.1/servers/7bbbbf6d-9e62-426b-85b4-d523110a05ef" status: 200 len: 1320 microversion: 2.1 time: 0.844857 Oct 04 20:46:32.922411 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1382/2795] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:46:32 2022] GET /compute/v2.1/servers/7bbbbf6d-9e62-426b-85b4-d523110a05ef => generated 1320 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:46:32.931956 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-48116a2f-e21d-4865-95e8-93f656731a6d req-673d619d-10eb-48aa-a1aa-524a288837f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "815db889-a211-4eab-90f8-7ca46d7102a4", "name": "network-vif-plugged", "status": "completed", "tag": "61e1947b-dc51-4d3d-8739-b8435daa871f"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:46:32.949050 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-48116a2f-e21d-4865-95e8-93f656731a6d req-673d619d-10eb-48aa-a1aa-524a288837f3 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:32.949789 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-48116a2f-e21d-4865-95e8-93f656731a6d req-673d619d-10eb-48aa-a1aa-524a288837f3 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:32.950222 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-48116a2f-e21d-4865-95e8-93f656731a6d req-673d619d-10eb-48aa-a1aa-524a288837f3 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:32.967022 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-48116a2f-e21d-4865-95e8-93f656731a6d req-673d619d-10eb-48aa-a1aa-524a288837f3 service nova] Creating event network-vif-plugged:61e1947b-dc51-4d3d-8739-b8435daa871f for instance 815db889-a211-4eab-90f8-7ca46d7102a4 on n-h1-854823-8 Oct 04 20:46:32.972675 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-48116a2f-e21d-4865-95e8-93f656731a6d req-673d619d-10eb-48aa-a1aa-524a288837f3 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056035 Oct 04 20:46:32.973291 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1383/2796] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:46:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:46:32.979516 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-51bbc7d0-8d07-43ca-a075-955b6824a956 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:32.980322 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-51bbc7d0-8d07-43ca-a075-955b6824a956 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] [instance: c703a086-cf9d-4d12-8a18-623e454bcb64] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:33.002301 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-51bbc7d0-8d07-43ca-a075-955b6824a956 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:33.002839 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-51bbc7d0-8d07-43ca-a075-955b6824a956 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:33.003273 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-51bbc7d0-8d07-43ca-a075-955b6824a956 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:33.004222 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-51bbc7d0-8d07-43ca-a075-955b6824a956 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:33.004676 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-51bbc7d0-8d07-43ca-a075-955b6824a956 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:33.005185 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-51bbc7d0-8d07-43ca-a075-955b6824a956 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:33.247065 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-51bbc7d0-8d07-43ca-a075-955b6824a956 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e4b00964014a0383f79597652bd428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7f38600b5041ad8e66a12d77b940fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:33.261043 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-51bbc7d0-8d07-43ca-a075-955b6824a956 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] 10.222.0.33 "GET /compute/v2.1/servers/c703a086-cf9d-4d12-8a18-623e454bcb64" status: 200 len: 1367 microversion: 2.1 time: 0.286353 Oct 04 20:46:33.281905 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1384/2797] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:46:32 2022] GET /compute/v2.1/servers/c703a086-cf9d-4d12-8a18-623e454bcb64 => generated 1367 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:46:33.288057 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e0b1a10b-62c6-4414-a6df-6707a3c5f3f8 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:33.288897 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e0b1a10b-62c6-4414-a6df-6707a3c5f3f8 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] [instance: 815db889-a211-4eab-90f8-7ca46d7102a4] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:33.298375 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e0b1a10b-62c6-4414-a6df-6707a3c5f3f8 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:33.299605 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e0b1a10b-62c6-4414-a6df-6707a3c5f3f8 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:33.300052 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e0b1a10b-62c6-4414-a6df-6707a3c5f3f8 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:33.300800 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e0b1a10b-62c6-4414-a6df-6707a3c5f3f8 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:33.301260 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e0b1a10b-62c6-4414-a6df-6707a3c5f3f8 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:33.301689 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e0b1a10b-62c6-4414-a6df-6707a3c5f3f8 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:33.490248 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e0b1a10b-62c6-4414-a6df-6707a3c5f3f8 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aca59cd50bf74a36bb1e4427cd50fbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3fadcd7d4043daa0a6aba27ba814d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:33.504959 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e0b1a10b-62c6-4414-a6df-6707a3c5f3f8 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] 10.222.0.33 "GET /compute/v2.1/servers/815db889-a211-4eab-90f8-7ca46d7102a4" status: 200 len: 1307 microversion: 2.1 time: 0.221773 Oct 04 20:46:33.505624 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1385/2798] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:46:33 2022] GET /compute/v2.1/servers/815db889-a211-4eab-90f8-7ca46d7102a4 => generated 1307 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:46:33.510965 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-bbbe662a-4725-488e-90a8-d18cb15665c3 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:33.511885 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-bbbe662a-4725-488e-90a8-d18cb15665c3 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] [instance: b65c8ce2-8537-4f84-ba63-5b913f6adc81] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:33.520925 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bbbe662a-4725-488e-90a8-d18cb15665c3 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:33.521994 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bbbe662a-4725-488e-90a8-d18cb15665c3 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:33.522798 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bbbe662a-4725-488e-90a8-d18cb15665c3 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:33.523660 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bbbe662a-4725-488e-90a8-d18cb15665c3 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:33.525068 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bbbe662a-4725-488e-90a8-d18cb15665c3 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:33.525579 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bbbe662a-4725-488e-90a8-d18cb15665c3 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:33.718758 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-bbbe662a-4725-488e-90a8-d18cb15665c3 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87dcc7baf63f4ae6bfe0a099adffd408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7097bc12179446f6a3e1fac8434d5c64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:33.728765 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-bbbe662a-4725-488e-90a8-d18cb15665c3 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] 10.222.0.33 "GET /compute/v2.1/servers/b65c8ce2-8537-4f84-ba63-5b913f6adc81" status: 200 len: 1488 microversion: 2.1 time: 0.221946 Oct 04 20:46:33.746482 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1386/2799] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:46:33 2022] GET /compute/v2.1/servers/b65c8ce2-8537-4f84-ba63-5b913f6adc81 => generated 1488 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:46:33.746482 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-37c50669-ea3e-4ede-88b7-7516cb88bb1a tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:33.746482 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-37c50669-ea3e-4ede-88b7-7516cb88bb1a tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] [instance: 39d66e18-289f-4674-b66c-146d68ef9133] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:33.752411 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-37c50669-ea3e-4ede-88b7-7516cb88bb1a tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:33.752930 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-37c50669-ea3e-4ede-88b7-7516cb88bb1a tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:33.753430 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-37c50669-ea3e-4ede-88b7-7516cb88bb1a tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:33.754173 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-37c50669-ea3e-4ede-88b7-7516cb88bb1a tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:33.754691 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-37c50669-ea3e-4ede-88b7-7516cb88bb1a tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:33.756558 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-37c50669-ea3e-4ede-88b7-7516cb88bb1a tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:33.873248 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-37c50669-ea3e-4ede-88b7-7516cb88bb1a tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:33.883241 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-37c50669-ea3e-4ede-88b7-7516cb88bb1a tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:33.884993 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-37c50669-ea3e-4ede-88b7-7516cb88bb1a tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:33.894427 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-37c50669-ea3e-4ede-88b7-7516cb88bb1a tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] 10.222.0.33 "GET /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133" status: 200 len: 1546 microversion: 2.91 time: 0.163729 Oct 04 20:46:33.895235 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1387/2800] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:46:33 2022] GET /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133 => generated 1546 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:46:33.900140 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-abcda991-d39f-436e-a84b-636c3763a556 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:33.900749 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-abcda991-d39f-436e-a84b-636c3763a556 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] [instance: bdfb94ca-ded6-4af0-bd9f-59fc877c4c0a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:33.906617 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-abcda991-d39f-436e-a84b-636c3763a556 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:33.907513 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-abcda991-d39f-436e-a84b-636c3763a556 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:33.907754 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-abcda991-d39f-436e-a84b-636c3763a556 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:33.908450 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-abcda991-d39f-436e-a84b-636c3763a556 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:33.909145 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-abcda991-d39f-436e-a84b-636c3763a556 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:33.909811 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-abcda991-d39f-436e-a84b-636c3763a556 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:34.006751 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-564930ab-e458-40cd-a17b-9dc6756e2234 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] 10.222.0.33 "GET /compute/v2.1/images/b73cf850-8f12-4af6-a477-48d47ca8c95f" status: 200 len: 1454 microversion: 2.1 time: 14.917296 Oct 04 20:46:34.008036 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1414/2801] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 20:46:19 2022] GET /compute/v2.1/images/b73cf850-8f12-4af6-a477-48d47ca8c95f => generated 1454 bytes in 14920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:46:34.022322 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-7cfaa734-3f4a-4d24-8aa7-4d6211d56884 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:34.022992 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-7cfaa734-3f4a-4d24-8aa7-4d6211d56884 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] [instance: 7bbbbf6d-9e62-426b-85b4-d523110a05ef] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:34.040093 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7cfaa734-3f4a-4d24-8aa7-4d6211d56884 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:34.040625 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7cfaa734-3f4a-4d24-8aa7-4d6211d56884 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:34.041067 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7cfaa734-3f4a-4d24-8aa7-4d6211d56884 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:34.043482 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7cfaa734-3f4a-4d24-8aa7-4d6211d56884 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:34.044557 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7cfaa734-3f4a-4d24-8aa7-4d6211d56884 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:34.045728 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7cfaa734-3f4a-4d24-8aa7-4d6211d56884 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:34.512674 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-abcda991-d39f-436e-a84b-636c3763a556 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87dcc7baf63f4ae6bfe0a099adffd408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7097bc12179446f6a3e1fac8434d5c64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:34.524992 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-abcda991-d39f-436e-a84b-636c3763a556 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] 10.222.0.33 "GET /compute/v2.1/servers/bdfb94ca-ded6-4af0-bd9f-59fc877c4c0a" status: 200 len: 1489 microversion: 2.1 time: 0.628839 Oct 04 20:46:34.532701 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1388/2802] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:46:33 2022] GET /compute/v2.1/servers/bdfb94ca-ded6-4af0-bd9f-59fc877c4c0a => generated 1489 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:46:34.539632 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-385efbfe-46e6-4178-9d13-8d2760debb9b tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:34.540631 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-385efbfe-46e6-4178-9d13-8d2760debb9b tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: 4d46fff2-b04d-41aa-ada0-2023ab545b48] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:34.549038 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-385efbfe-46e6-4178-9d13-8d2760debb9b tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:34.550514 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-385efbfe-46e6-4178-9d13-8d2760debb9b tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:34.551711 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-385efbfe-46e6-4178-9d13-8d2760debb9b tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:34.553243 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-385efbfe-46e6-4178-9d13-8d2760debb9b tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:34.553992 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-385efbfe-46e6-4178-9d13-8d2760debb9b tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:34.554583 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-385efbfe-46e6-4178-9d13-8d2760debb9b tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:34.563580 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-7cfaa734-3f4a-4d24-8aa7-4d6211d56884 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12dc6570db03431187680f51349e55d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91111396aabd4306b66e14b5abd822ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:34.589444 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-7cfaa734-3f4a-4d24-8aa7-4d6211d56884 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] 10.222.0.33 "GET /compute/v2.1/servers/7bbbbf6d-9e62-426b-85b4-d523110a05ef" status: 200 len: 1510 microversion: 2.1 time: 0.577295 Oct 04 20:46:34.590694 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1415/2803] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:46:34 2022] GET /compute/v2.1/servers/7bbbbf6d-9e62-426b-85b4-d523110a05ef => generated 1510 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:46:34.602767 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-f52a91f1-4514-47ba-86de-d11f9e287af1 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:34.603756 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-f52a91f1-4514-47ba-86de-d11f9e287af1 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] [instance: c703a086-cf9d-4d12-8a18-623e454bcb64] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:34.628064 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f52a91f1-4514-47ba-86de-d11f9e287af1 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:34.629377 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f52a91f1-4514-47ba-86de-d11f9e287af1 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:34.631283 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f52a91f1-4514-47ba-86de-d11f9e287af1 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:34.634423 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f52a91f1-4514-47ba-86de-d11f9e287af1 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:34.634938 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f52a91f1-4514-47ba-86de-d11f9e287af1 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:34.635376 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f52a91f1-4514-47ba-86de-d11f9e287af1 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:34.793090 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-385efbfe-46e6-4178-9d13-8d2760debb9b tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac650232cc04810b1340dc2f0edadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b0670d1bd99424780a70e69d57a2166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:34.801135 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-385efbfe-46e6-4178-9d13-8d2760debb9b tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48" status: 200 len: 1669 microversion: 2.1 time: 0.267375 Oct 04 20:46:34.801944 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1389/2804] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:46:34 2022] GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48 => generated 1669 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:46:34.806487 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-752b39d6-ad70-495a-9a7d-c301ad5554a5 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:34.807088 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-752b39d6-ad70-495a-9a7d-c301ad5554a5 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] [instance: 815db889-a211-4eab-90f8-7ca46d7102a4] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:34.813093 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-752b39d6-ad70-495a-9a7d-c301ad5554a5 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:34.813679 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-752b39d6-ad70-495a-9a7d-c301ad5554a5 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:34.814068 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-752b39d6-ad70-495a-9a7d-c301ad5554a5 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:34.814851 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-752b39d6-ad70-495a-9a7d-c301ad5554a5 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:34.815309 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-752b39d6-ad70-495a-9a7d-c301ad5554a5 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:34.815710 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-752b39d6-ad70-495a-9a7d-c301ad5554a5 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:34.816877 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-f52a91f1-4514-47ba-86de-d11f9e287af1 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e4b00964014a0383f79597652bd428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7f38600b5041ad8e66a12d77b940fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:34.826000 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-f52a91f1-4514-47ba-86de-d11f9e287af1 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] 10.222.0.33 "GET /compute/v2.1/servers/c703a086-cf9d-4d12-8a18-623e454bcb64" status: 200 len: 1367 microversion: 2.1 time: 0.233181 Oct 04 20:46:34.826608 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1416/2805] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:46:34 2022] GET /compute/v2.1/servers/c703a086-cf9d-4d12-8a18-623e454bcb64 => generated 1367 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:46:34.831117 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-d7baee35-a935-476f-8b72-d3804ee43db4 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:34.832808 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-d7baee35-a935-476f-8b72-d3804ee43db4 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] [instance: b65c8ce2-8537-4f84-ba63-5b913f6adc81] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:34.839357 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d7baee35-a935-476f-8b72-d3804ee43db4 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:34.839830 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d7baee35-a935-476f-8b72-d3804ee43db4 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:34.840255 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d7baee35-a935-476f-8b72-d3804ee43db4 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:34.840946 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d7baee35-a935-476f-8b72-d3804ee43db4 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:34.841424 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d7baee35-a935-476f-8b72-d3804ee43db4 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:34.841994 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d7baee35-a935-476f-8b72-d3804ee43db4 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:35.020572 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-752b39d6-ad70-495a-9a7d-c301ad5554a5 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aca59cd50bf74a36bb1e4427cd50fbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3fadcd7d4043daa0a6aba27ba814d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:35.031043 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-752b39d6-ad70-495a-9a7d-c301ad5554a5 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] 10.222.0.33 "GET /compute/v2.1/servers/815db889-a211-4eab-90f8-7ca46d7102a4" status: 200 len: 1488 microversion: 2.1 time: 0.228007 Oct 04 20:46:35.043086 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1390/2806] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:46:34 2022] GET /compute/v2.1/servers/815db889-a211-4eab-90f8-7ca46d7102a4 => generated 1488 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:46:35.048214 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-aca519f1-36d1-40a7-8e81-3e3f49367ceb tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:35.054840 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-aca519f1-36d1-40a7-8e81-3e3f49367ceb tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '12dc6570db03431187680f51349e55d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91111396aabd4306b66e14b5abd822ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:35.055013 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-d7baee35-a935-476f-8b72-d3804ee43db4 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87dcc7baf63f4ae6bfe0a099adffd408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7097bc12179446f6a3e1fac8434d5c64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:35.055724 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-aca519f1-36d1-40a7-8e81-3e3f49367ceb tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '91111396aabd4306b66e14b5abd822ad'} {{(pid=128801) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 20:46:35.062978 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-d7baee35-a935-476f-8b72-d3804ee43db4 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] 10.222.0.33 "GET /compute/v2.1/servers/b65c8ce2-8537-4f84-ba63-5b913f6adc81" status: 200 len: 1488 microversion: 2.1 time: 0.235413 Oct 04 20:46:35.063558 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1417/2807] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:46:34 2022] GET /compute/v2.1/servers/b65c8ce2-8537-4f84-ba63-5b913f6adc81 => generated 1488 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:46:35.066849 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-aca519f1-36d1-40a7-8e81-3e3f49367ceb tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:35.067326 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-aca519f1-36d1-40a7-8e81-3e3f49367ceb tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:35.067753 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-aca519f1-36d1-40a7-8e81-3e3f49367ceb tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:35.068942 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-27190c28-1243-4980-906f-47cbcd8fd0b3 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-3-379699919"}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:46:35.069069 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-aca519f1-36d1-40a7-8e81-3e3f49367ceb tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:35.069514 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-aca519f1-36d1-40a7-8e81-3e3f49367ceb tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:35.069930 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-aca519f1-36d1-40a7-8e81-3e3f49367ceb tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:35.071747 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-27190c28-1243-4980-906f-47cbcd8fd0b3 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: 4d46fff2-b04d-41aa-ada0-2023ab545b48] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:35.078612 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-27190c28-1243-4980-906f-47cbcd8fd0b3 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:35.079197 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-27190c28-1243-4980-906f-47cbcd8fd0b3 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:35.079657 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-27190c28-1243-4980-906f-47cbcd8fd0b3 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:35.080399 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-27190c28-1243-4980-906f-47cbcd8fd0b3 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:35.081091 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-27190c28-1243-4980-906f-47cbcd8fd0b3 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:35.081940 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-27190c28-1243-4980-906f-47cbcd8fd0b3 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:35.176384 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.multi_cell_list [None req-aca519f1-36d1-40a7-8e81-3e3f49367ceb tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128801) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 20:46:35.260068 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-aca519f1-36d1-40a7-8e81-3e3f49367ceb tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12dc6570db03431187680f51349e55d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91111396aabd4306b66e14b5abd822ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:35.267244 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-aca519f1-36d1-40a7-8e81-3e3f49367ceb tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:35.267738 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-aca519f1-36d1-40a7-8e81-3e3f49367ceb tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:35.268180 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-aca519f1-36d1-40a7-8e81-3e3f49367ceb tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:35.314635 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-27190c28-1243-4980-906f-47cbcd8fd0b3 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "POST /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48/action" status: 202 len: 0 microversion: 2.1 time: 0.249629 Oct 04 20:46:35.315372 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1418/2808] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 20:46:35 2022] POST /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48/action => generated 0 bytes in 251 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Oct 04 20:46:35.322698 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-f4b60bc0-bc81-48fc-9507-273a416cd402 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:35.324367 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-f4b60bc0-bc81-48fc-9507-273a416cd402 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] [instance: 39d66e18-289f-4674-b66c-146d68ef9133] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:35.331286 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f4b60bc0-bc81-48fc-9507-273a416cd402 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:35.332163 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f4b60bc0-bc81-48fc-9507-273a416cd402 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:35.332708 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f4b60bc0-bc81-48fc-9507-273a416cd402 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:35.333465 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f4b60bc0-bc81-48fc-9507-273a416cd402 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:35.334688 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f4b60bc0-bc81-48fc-9507-273a416cd402 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:35.335300 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f4b60bc0-bc81-48fc-9507-273a416cd402 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:35.413179 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-aca519f1-36d1-40a7-8e81-3e3f49367ceb tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] 10.222.0.33 "GET /compute/v2.1/servers/detail?flavor=451" status: 200 len: 1514 microversion: 2.1 time: 0.368901 Oct 04 20:46:35.426366 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1391/2809] 10.222.0.33 () {58 vars in 1167 bytes} [Tue Oct 4 20:46:35 2022] GET /compute/v2.1/servers/detail?flavor=451 => generated 1514 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:46:35.426366 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1377efd2-4a31-4ec6-b25f-437f93088873 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Calling method '.version_select at 0x7f3c6fa4dc10>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:35.436536 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-f4b60bc0-bc81-48fc-9507-273a416cd402 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:35.445263 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-f4b60bc0-bc81-48fc-9507-273a416cd402 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:35.447390 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-f4b60bc0-bc81-48fc-9507-273a416cd402 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:35.453741 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-f4b60bc0-bc81-48fc-9507-273a416cd402 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] 10.222.0.33 "GET /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133" status: 200 len: 1533 microversion: 2.91 time: 0.137043 Oct 04 20:46:35.458175 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1419/2810] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:46:35 2022] GET /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133 => generated 1533 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:46:35.464679 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-a595de1c-2f38-4fa1-9105-616087d4d162 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:46:35.470914 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a595de1c-2f38-4fa1-9105-616087d4d162 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:35.471456 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a595de1c-2f38-4fa1-9105-616087d4d162 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:35.471961 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a595de1c-2f38-4fa1-9105-616087d4d162 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:35.486843 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-1377efd2-4a31-4ec6-b25f-437f93088873 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] 10.222.0.33 "GET /compute/v2.1/images/b73cf850-8f12-4af6-a477-48d47ca8c95f" status: 200 len: 1463 microversion: 2.1 time: 0.070752 Oct 04 20:46:35.487424 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1392/2811] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 20:46:35 2022] GET /compute/v2.1/images/b73cf850-8f12-4af6-a477-48d47ca8c95f => generated 1463 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:46:35.493373 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-72137149-84e1-4ca7-b9b8-2bd0a7d47450 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:35.494084 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-72137149-84e1-4ca7-b9b8-2bd0a7d47450 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] [instance: b65c8ce2-8537-4f84-ba63-5b913f6adc81] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:35.509882 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-72137149-84e1-4ca7-b9b8-2bd0a7d47450 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:35.510840 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-72137149-84e1-4ca7-b9b8-2bd0a7d47450 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:35.511277 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-72137149-84e1-4ca7-b9b8-2bd0a7d47450 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:35.512269 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-72137149-84e1-4ca7-b9b8-2bd0a7d47450 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:35.513330 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-72137149-84e1-4ca7-b9b8-2bd0a7d47450 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:35.514454 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-72137149-84e1-4ca7-b9b8-2bd0a7d47450 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:35.544985 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-72137149-84e1-4ca7-b9b8-2bd0a7d47450 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] [instance: b65c8ce2-8537-4f84-ba63-5b913f6adc81] Going to try to terminate instance {{(pid=128801) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:46:35.548220 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-a595de1c-2f38-4fa1-9105-616087d4d162 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] [instance: 815db889-a211-4eab-90f8-7ca46d7102a4] Going to try to stop instance {{(pid=128802) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 04 20:46:35.596730 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-a595de1c-2f38-4fa1-9105-616087d4d162 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] 10.222.0.33 "POST /compute/v2.1/servers/815db889-a211-4eab-90f8-7ca46d7102a4/action" status: 202 len: 0 microversion: 2.1 time: 0.137027 Oct 04 20:46:35.597619 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1420/2812] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 20:46:35 2022] POST /compute/v2.1/servers/815db889-a211-4eab-90f8-7ca46d7102a4/action => generated 0 bytes in 139 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:46:35.604363 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-412e2617-8bb0-4d8c-8af7-acc4c42c672b tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:35.605153 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-412e2617-8bb0-4d8c-8af7-acc4c42c672b tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: 4d46fff2-b04d-41aa-ada0-2023ab545b48] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:35.612662 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-412e2617-8bb0-4d8c-8af7-acc4c42c672b tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:35.613521 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-412e2617-8bb0-4d8c-8af7-acc4c42c672b tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:35.614267 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-412e2617-8bb0-4d8c-8af7-acc4c42c672b tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:35.615912 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-412e2617-8bb0-4d8c-8af7-acc4c42c672b tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:35.616691 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-412e2617-8bb0-4d8c-8af7-acc4c42c672b tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:35.617297 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-412e2617-8bb0-4d8c-8af7-acc4c42c672b tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:35.633613 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-72137149-84e1-4ca7-b9b8-2bd0a7d47450 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] 10.222.0.33 "DELETE /compute/v2.1/servers/b65c8ce2-8537-4f84-ba63-5b913f6adc81" status: 204 len: 0 microversion: 2.1 time: 0.144364 Oct 04 20:46:35.638506 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1393/2813] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 20:46:35 2022] DELETE /compute/v2.1/servers/b65c8ce2-8537-4f84-ba63-5b913f6adc81 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:46:35.644710 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-28397896-9e15-43c5-8ee0-5c5161971522 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:35.650280 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-28397896-9e15-43c5-8ee0-5c5161971522 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '12dc6570db03431187680f51349e55d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91111396aabd4306b66e14b5abd822ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:35.651445 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-28397896-9e15-43c5-8ee0-5c5161971522 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-2015269677', 'deleted': False, 'project_id': '91111396aabd4306b66e14b5abd822ad'} {{(pid=128801) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 20:46:35.657191 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-28397896-9e15-43c5-8ee0-5c5161971522 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:35.657868 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-28397896-9e15-43c5-8ee0-5c5161971522 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:35.658303 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-28397896-9e15-43c5-8ee0-5c5161971522 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:35.659458 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-28397896-9e15-43c5-8ee0-5c5161971522 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:35.659575 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-28397896-9e15-43c5-8ee0-5c5161971522 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:35.659926 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-28397896-9e15-43c5-8ee0-5c5161971522 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:35.768757 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.multi_cell_list [None req-28397896-9e15-43c5-8ee0-5c5161971522 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128801) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 20:46:35.776206 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-412e2617-8bb0-4d8c-8af7-acc4c42c672b tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac650232cc04810b1340dc2f0edadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b0670d1bd99424780a70e69d57a2166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:35.785580 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-412e2617-8bb0-4d8c-8af7-acc4c42c672b tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48" status: 200 len: 1679 microversion: 2.1 time: 0.186844 Oct 04 20:46:35.796155 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1421/2814] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:46:35 2022] GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48 => generated 1679 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:46:35.803225 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-60ecd6e9-20e9-4a6b-aecf-82f52b8fa63a tempest-UnshelveToHostMultiNodesTest-1871197656 tempest-UnshelveToHostMultiNodesTest-1871197656-project-admin] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:35.804200 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-60ecd6e9-20e9-4a6b-aecf-82f52b8fa63a tempest-UnshelveToHostMultiNodesTest-1871197656 tempest-UnshelveToHostMultiNodesTest-1871197656-project-admin] [instance: 39d66e18-289f-4674-b66c-146d68ef9133] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:35.811292 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-60ecd6e9-20e9-4a6b-aecf-82f52b8fa63a tempest-UnshelveToHostMultiNodesTest-1871197656 tempest-UnshelveToHostMultiNodesTest-1871197656-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:35.812172 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-60ecd6e9-20e9-4a6b-aecf-82f52b8fa63a tempest-UnshelveToHostMultiNodesTest-1871197656 tempest-UnshelveToHostMultiNodesTest-1871197656-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:35.812382 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-60ecd6e9-20e9-4a6b-aecf-82f52b8fa63a tempest-UnshelveToHostMultiNodesTest-1871197656 tempest-UnshelveToHostMultiNodesTest-1871197656-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:35.813028 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-60ecd6e9-20e9-4a6b-aecf-82f52b8fa63a tempest-UnshelveToHostMultiNodesTest-1871197656 tempest-UnshelveToHostMultiNodesTest-1871197656-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:35.813994 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-60ecd6e9-20e9-4a6b-aecf-82f52b8fa63a tempest-UnshelveToHostMultiNodesTest-1871197656 tempest-UnshelveToHostMultiNodesTest-1871197656-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:35.814118 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-60ecd6e9-20e9-4a6b-aecf-82f52b8fa63a tempest-UnshelveToHostMultiNodesTest-1871197656 tempest-UnshelveToHostMultiNodesTest-1871197656-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:35.847486 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-28397896-9e15-43c5-8ee0-5c5161971522 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12dc6570db03431187680f51349e55d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91111396aabd4306b66e14b5abd822ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:35.855633 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-28397896-9e15-43c5-8ee0-5c5161971522 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:35.856208 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-28397896-9e15-43c5-8ee0-5c5161971522 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:35.856677 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-28397896-9e15-43c5-8ee0-5c5161971522 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:35.911402 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.objects.instance [None req-60ecd6e9-20e9-4a6b-aecf-82f52b8fa63a tempest-UnshelveToHostMultiNodesTest-1871197656 tempest-UnshelveToHostMultiNodesTest-1871197656-project-admin] Lazy-loading 'services' on Instance uuid 39d66e18-289f-4674-b66c-146d68ef9133 {{(pid=128802) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:46:35.930273 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-60ecd6e9-20e9-4a6b-aecf-82f52b8fa63a tempest-UnshelveToHostMultiNodesTest-1871197656 tempest-UnshelveToHostMultiNodesTest-1871197656-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133" status: 200 len: 1938 microversion: 2.91 time: 0.132907 Oct 04 20:46:35.930965 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1422/2815] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:46:35 2022] GET /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133 => generated 1938 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:46:35.935674 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-f8e1045b-a533-4d25-8a19-38ef7ecec3f6 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Calling method '.version_select at 0x7f3c787fddc0>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:35.993491 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-f8e1045b-a533-4d25-8a19-38ef7ecec3f6 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] 10.222.0.33 "GET /compute/v2.1/images/b73cf850-8f12-4af6-a477-48d47ca8c95f" status: 200 len: 1463 microversion: 2.1 time: 0.061231 Oct 04 20:46:35.994261 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1423/2816] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 20:46:35 2022] GET /compute/v2.1/images/b73cf850-8f12-4af6-a477-48d47ca8c95f => generated 1463 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:46:35.998499 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-28397896-9e15-43c5-8ee0-5c5161971522 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] 10.222.0.33 "GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-2015269677" status: 200 len: 1514 microversion: 2.1 time: 0.358428 Oct 04 20:46:36.001957 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1394/2817] 10.222.0.33 () {58 vars in 1263 bytes} [Tue Oct 4 20:46:35 2022] GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-2015269677 => generated 1514 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:46:36.004325 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-82366a7b-d684-4924-acce-801afd89cb8e tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:36.004982 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-82366a7b-d684-4924-acce-801afd89cb8e tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] [instance: 815db889-a211-4eab-90f8-7ca46d7102a4] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:36.007457 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-409f6e30-3f93-4c41-988e-4e8486d73332 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:36.008359 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-409f6e30-3f93-4c41-988e-4e8486d73332 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] [instance: b65c8ce2-8537-4f84-ba63-5b913f6adc81] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:36.012909 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-82366a7b-d684-4924-acce-801afd89cb8e tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:36.013416 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-82366a7b-d684-4924-acce-801afd89cb8e tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:36.013837 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-82366a7b-d684-4924-acce-801afd89cb8e tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:36.014428 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-409f6e30-3f93-4c41-988e-4e8486d73332 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:36.014556 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-82366a7b-d684-4924-acce-801afd89cb8e tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:36.014906 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-409f6e30-3f93-4c41-988e-4e8486d73332 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:36.015026 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-82366a7b-d684-4924-acce-801afd89cb8e tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:36.015335 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-409f6e30-3f93-4c41-988e-4e8486d73332 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:36.015447 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-82366a7b-d684-4924-acce-801afd89cb8e tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:36.016012 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-409f6e30-3f93-4c41-988e-4e8486d73332 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:36.016466 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-409f6e30-3f93-4c41-988e-4e8486d73332 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:36.016885 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-409f6e30-3f93-4c41-988e-4e8486d73332 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:36.212455 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-82366a7b-d684-4924-acce-801afd89cb8e tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aca59cd50bf74a36bb1e4427cd50fbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3fadcd7d4043daa0a6aba27ba814d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:36.216429 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-409f6e30-3f93-4c41-988e-4e8486d73332 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87dcc7baf63f4ae6bfe0a099adffd408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7097bc12179446f6a3e1fac8434d5c64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:36.220664 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-82366a7b-d684-4924-acce-801afd89cb8e tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] 10.222.0.33 "GET /compute/v2.1/servers/815db889-a211-4eab-90f8-7ca46d7102a4" status: 200 len: 1498 microversion: 2.1 time: 0.220984 Oct 04 20:46:36.221221 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1424/2818] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:46:35 2022] GET /compute/v2.1/servers/815db889-a211-4eab-90f8-7ca46d7102a4 => generated 1498 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:46:36.224460 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-409f6e30-3f93-4c41-988e-4e8486d73332 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] 10.222.0.33 "GET /compute/v2.1/servers/b65c8ce2-8537-4f84-ba63-5b913f6adc81" status: 200 len: 1494 microversion: 2.1 time: 0.222769 Oct 04 20:46:36.225283 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1395/2819] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:46:36 2022] GET /compute/v2.1/servers/b65c8ce2-8537-4f84-ba63-5b913f6adc81 => generated 1494 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:46:36.231791 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-4849bdfa-4503-4186-b045-981144388c0a tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:36.232628 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-4849bdfa-4503-4186-b045-981144388c0a tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] [instance: c703a086-cf9d-4d12-8a18-623e454bcb64] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:36.238925 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4849bdfa-4503-4186-b045-981144388c0a tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:36.239598 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4849bdfa-4503-4186-b045-981144388c0a tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:36.240691 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4849bdfa-4503-4186-b045-981144388c0a tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:36.241461 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4849bdfa-4503-4186-b045-981144388c0a tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:36.241945 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4849bdfa-4503-4186-b045-981144388c0a tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:36.242402 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4849bdfa-4503-4186-b045-981144388c0a tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:36.243596 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8f7ed1fb-ce91-4ea4-bf01-8d4b6aa3b6a7 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:46:36.244247 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-8f7ed1fb-ce91-4ea4-bf01-8d4b6aa3b6a7 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] [instance: 39d66e18-289f-4674-b66c-146d68ef9133] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:36.250183 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8f7ed1fb-ce91-4ea4-bf01-8d4b6aa3b6a7 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:36.250692 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8f7ed1fb-ce91-4ea4-bf01-8d4b6aa3b6a7 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:36.251121 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8f7ed1fb-ce91-4ea4-bf01-8d4b6aa3b6a7 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:36.251809 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8f7ed1fb-ce91-4ea4-bf01-8d4b6aa3b6a7 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:36.252293 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8f7ed1fb-ce91-4ea4-bf01-8d4b6aa3b6a7 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:36.252713 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8f7ed1fb-ce91-4ea4-bf01-8d4b6aa3b6a7 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:36.269812 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:46:36.277205 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-8f7ed1fb-ce91-4ea4-bf01-8d4b6aa3b6a7 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lazy-loading 'flavor' on Instance uuid 39d66e18-289f-4674-b66c-146d68ef9133 {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:46:36.382679 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-4849bdfa-4503-4186-b045-981144388c0a tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e4b00964014a0383f79597652bd428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7f38600b5041ad8e66a12d77b940fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:36.390372 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-4849bdfa-4503-4186-b045-981144388c0a tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] 10.222.0.33 "GET /compute/v2.1/servers/c703a086-cf9d-4d12-8a18-623e454bcb64" status: 200 len: 1367 microversion: 2.1 time: 0.168197 Oct 04 20:46:36.390946 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1425/2820] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:46:36 2022] GET /compute/v2.1/servers/c703a086-cf9d-4d12-8a18-623e454bcb64 => generated 1367 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:46:36.395212 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-1320fa2c-f781-4409-bc71-237b97b7ab81 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:36.395801 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-1320fa2c-f781-4409-bc71-237b97b7ab81 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] [instance: 8917de21-2b45-4249-ae17-17f679d4856f] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:36.402214 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1320fa2c-f781-4409-bc71-237b97b7ab81 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:36.403049 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1320fa2c-f781-4409-bc71-237b97b7ab81 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:36.403650 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1320fa2c-f781-4409-bc71-237b97b7ab81 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:36.405767 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1320fa2c-f781-4409-bc71-237b97b7ab81 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:36.405767 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1320fa2c-f781-4409-bc71-237b97b7ab81 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:36.405961 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1320fa2c-f781-4409-bc71-237b97b7ab81 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:36.468128 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-8f7ed1fb-ce91-4ea4-bf01-8d4b6aa3b6a7 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] 10.222.0.33 "POST /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133/action" status: 202 len: 0 microversion: 2.91 time: 0.241388 Oct 04 20:46:36.468740 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1396/2821] 10.222.0.33 () {62 vars in 1319 bytes} [Tue Oct 4 20:46:36 2022] POST /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133/action => generated 0 bytes in 243 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:46:36.473879 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-41d3da5f-6afc-45f3-9afb-d81af6d4af6d tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:36.479396 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-41d3da5f-6afc-45f3-9afb-d81af6d4af6d tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '12dc6570db03431187680f51349e55d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91111396aabd4306b66e14b5abd822ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:36.480297 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-41d3da5f-6afc-45f3-9afb-d81af6d4af6d tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '91111396aabd4306b66e14b5abd822ad'} {{(pid=128801) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 20:46:36.486207 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-41d3da5f-6afc-45f3-9afb-d81af6d4af6d tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:36.486207 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-41d3da5f-6afc-45f3-9afb-d81af6d4af6d tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:36.486600 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-41d3da5f-6afc-45f3-9afb-d81af6d4af6d tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:36.487614 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-41d3da5f-6afc-45f3-9afb-d81af6d4af6d tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:36.487793 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-41d3da5f-6afc-45f3-9afb-d81af6d4af6d tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:36.488218 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-41d3da5f-6afc-45f3-9afb-d81af6d4af6d tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:36.546920 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-1320fa2c-f781-4409-bc71-237b97b7ab81 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0967736982942f0b62db2e0546666cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f86a1d45a94f41bcd1a73694454a0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:36.555432 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-1320fa2c-f781-4409-bc71-237b97b7ab81 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] 10.222.0.33 "GET /compute/v2.1/servers/8917de21-2b45-4249-ae17-17f679d4856f" status: 200 len: 1468 microversion: 2.1 time: 0.163548 Oct 04 20:46:36.556004 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1426/2822] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:46:36 2022] GET /compute/v2.1/servers/8917de21-2b45-4249-ae17-17f679d4856f => generated 1468 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:46:36.560486 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-399c65cf-003e-4cbe-9254-6e46e62b83bb tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:36.561136 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-399c65cf-003e-4cbe-9254-6e46e62b83bb tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] [instance: 39d66e18-289f-4674-b66c-146d68ef9133] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:36.569171 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-399c65cf-003e-4cbe-9254-6e46e62b83bb tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:36.569660 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-399c65cf-003e-4cbe-9254-6e46e62b83bb tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:36.570094 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-399c65cf-003e-4cbe-9254-6e46e62b83bb tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:36.570818 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-399c65cf-003e-4cbe-9254-6e46e62b83bb tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:36.571333 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-399c65cf-003e-4cbe-9254-6e46e62b83bb tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:36.571809 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-399c65cf-003e-4cbe-9254-6e46e62b83bb tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:36.588064 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.multi_cell_list [None req-41d3da5f-6afc-45f3-9afb-d81af6d4af6d tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128801) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 20:46:36.645100 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-399c65cf-003e-4cbe-9254-6e46e62b83bb tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:36.654238 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-399c65cf-003e-4cbe-9254-6e46e62b83bb tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:36.655716 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-399c65cf-003e-4cbe-9254-6e46e62b83bb tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:36.660773 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-399c65cf-003e-4cbe-9254-6e46e62b83bb tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] 10.222.0.33 "GET /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133" status: 200 len: 1539 microversion: 2.91 time: 0.103818 Oct 04 20:46:36.661485 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1427/2823] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:46:36 2022] GET /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133 => generated 1539 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:46:36.663131 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-41d3da5f-6afc-45f3-9afb-d81af6d4af6d tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12dc6570db03431187680f51349e55d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91111396aabd4306b66e14b5abd822ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:36.666925 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-89084d34-9a5e-46de-be86-ffd41643b251 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-2057581041"}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:46:36.669298 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-89084d34-9a5e-46de-be86-ffd41643b251 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] [instance: 291474d2-a375-4974-abec-713900c08119] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:36.670551 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-41d3da5f-6afc-45f3-9afb-d81af6d4af6d tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:36.671037 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-41d3da5f-6afc-45f3-9afb-d81af6d4af6d tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:36.671465 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-41d3da5f-6afc-45f3-9afb-d81af6d4af6d tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:36.687163 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-89084d34-9a5e-46de-be86-ffd41643b251 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:36.687696 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-89084d34-9a5e-46de-be86-ffd41643b251 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:36.688173 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-89084d34-9a5e-46de-be86-ffd41643b251 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:36.688923 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-89084d34-9a5e-46de-be86-ffd41643b251 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:36.689421 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-89084d34-9a5e-46de-be86-ffd41643b251 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:36.689849 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-89084d34-9a5e-46de-be86-ffd41643b251 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:36.809103 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-41d3da5f-6afc-45f3-9afb-d81af6d4af6d tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] 10.222.0.33 "GET /compute/v2.1/servers/detail?status=active" status: 200 len: 4515 microversion: 2.1 time: 0.338947 Oct 04 20:46:36.810407 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1397/2824] 10.222.0.33 () {58 vars in 1173 bytes} [Tue Oct 4 20:46:36 2022] GET /compute/v2.1/servers/detail?status=active => generated 4515 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:46:36.815377 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-112c119d-99f1-4aca-84ea-fe272dd22d81 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:36.816340 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-112c119d-99f1-4aca-84ea-fe272dd22d81 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: 4d46fff2-b04d-41aa-ada0-2023ab545b48] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:36.825182 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-112c119d-99f1-4aca-84ea-fe272dd22d81 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:36.825808 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-112c119d-99f1-4aca-84ea-fe272dd22d81 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:36.826270 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-112c119d-99f1-4aca-84ea-fe272dd22d81 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:36.827314 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-112c119d-99f1-4aca-84ea-fe272dd22d81 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:36.828031 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-112c119d-99f1-4aca-84ea-fe272dd22d81 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:36.828576 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-112c119d-99f1-4aca-84ea-fe272dd22d81 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:36.879405 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:46:36.904624 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-89084d34-9a5e-46de-be86-ffd41643b251 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] 10.222.0.33 "POST /compute/v2.1/servers/291474d2-a375-4974-abec-713900c08119/action" status: 202 len: 0 microversion: 2.1 time: 0.241197 Oct 04 20:46:36.905177 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1428/2825] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 20:46:36 2022] POST /compute/v2.1/servers/291474d2-a375-4974-abec-713900c08119/action => generated 0 bytes in 243 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 04 20:46:36.910329 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-ddac9a8c-454c-462d-9a9e-ab039ef1a542 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:36.916456 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-ddac9a8c-454c-462d-9a9e-ab039ef1a542 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '12dc6570db03431187680f51349e55d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91111396aabd4306b66e14b5abd822ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:36.916915 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.compute.servers [None req-ddac9a8c-454c-462d-9a9e-ab039ef1a542 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Removing options 'limit' from query {{(pid=128802) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 04 20:46:36.917751 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-ddac9a8c-454c-462d-9a9e-ab039ef1a542 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Searching by: {'deleted': False, 'project_id': '91111396aabd4306b66e14b5abd822ad'} {{(pid=128802) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 20:46:36.925026 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ddac9a8c-454c-462d-9a9e-ab039ef1a542 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:36.925533 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ddac9a8c-454c-462d-9a9e-ab039ef1a542 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:36.925963 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ddac9a8c-454c-462d-9a9e-ab039ef1a542 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:36.926710 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ddac9a8c-454c-462d-9a9e-ab039ef1a542 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:36.927156 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ddac9a8c-454c-462d-9a9e-ab039ef1a542 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:36.928195 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ddac9a8c-454c-462d-9a9e-ab039ef1a542 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:36.965578 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-ddac9a8c-454c-462d-9a9e-ab039ef1a542 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12dc6570db03431187680f51349e55d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91111396aabd4306b66e14b5abd822ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:36.971953 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ddac9a8c-454c-462d-9a9e-ab039ef1a542 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:36.972565 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ddac9a8c-454c-462d-9a9e-ab039ef1a542 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:36.972999 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ddac9a8c-454c-462d-9a9e-ab039ef1a542 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:36.991620 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-112c119d-99f1-4aca-84ea-fe272dd22d81 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac650232cc04810b1340dc2f0edadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b0670d1bd99424780a70e69d57a2166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:37.002871 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-112c119d-99f1-4aca-84ea-fe272dd22d81 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48" status: 200 len: 1687 microversion: 2.1 time: 0.191228 Oct 04 20:46:37.003586 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1398/2826] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:46:36 2022] GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48 => generated 1687 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:46:37.008608 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ce78bf03-432a-4a9c-9646-76a7b8be85c4 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Calling method '.version_select at 0x7f3c6fa08040>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:37.061529 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ce78bf03-432a-4a9c-9646-76a7b8be85c4 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] 10.222.0.33 "GET /compute/v2.1/images/0f050377-ae76-45a1-9386-5340e96ea493" status: 200 len: 1455 microversion: 2.1 time: 0.056456 Oct 04 20:46:37.062137 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1399/2827] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 20:46:37 2022] GET /compute/v2.1/images/0f050377-ae76-45a1-9386-5340e96ea493 => generated 1455 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:46:37.109961 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-ddac9a8c-454c-462d-9a9e-ab039ef1a542 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] 10.222.0.33 "GET /compute/v2.1/servers/detail?limit=1" status: 200 len: 1660 microversion: 2.1 time: 0.203573 Oct 04 20:46:37.110608 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1429/2828] 10.222.0.33 () {58 vars in 1161 bytes} [Tue Oct 4 20:46:36 2022] GET /compute/v2.1/servers/detail?limit=1 => generated 1660 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:46:37.134739 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c14ad322-a9e1-4352-8aff-ee7b89f2365d tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:37.139575 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c14ad322-a9e1-4352-8aff-ee7b89f2365d tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '12dc6570db03431187680f51349e55d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91111396aabd4306b66e14b5abd822ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:37.140321 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c14ad322-a9e1-4352-8aff-ee7b89f2365d tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '91111396aabd4306b66e14b5abd822ad'} {{(pid=128801) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 20:46:37.145605 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c14ad322-a9e1-4352-8aff-ee7b89f2365d tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:37.146092 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c14ad322-a9e1-4352-8aff-ee7b89f2365d tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:37.147177 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c14ad322-a9e1-4352-8aff-ee7b89f2365d tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:37.148005 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c14ad322-a9e1-4352-8aff-ee7b89f2365d tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:37.148468 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c14ad322-a9e1-4352-8aff-ee7b89f2365d tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:37.148899 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c14ad322-a9e1-4352-8aff-ee7b89f2365d tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:37.238382 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.multi_cell_list [None req-c14ad322-a9e1-4352-8aff-ee7b89f2365d tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128801) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 20:46:37.244003 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-65f576c5-bfdf-49af-bfb5-d2e2782c75ff tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:37.244748 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-65f576c5-bfdf-49af-bfb5-d2e2782c75ff tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] [instance: 815db889-a211-4eab-90f8-7ca46d7102a4] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:37.251043 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-65f576c5-bfdf-49af-bfb5-d2e2782c75ff tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:37.251530 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-65f576c5-bfdf-49af-bfb5-d2e2782c75ff tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:37.251989 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-65f576c5-bfdf-49af-bfb5-d2e2782c75ff tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:37.252686 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-65f576c5-bfdf-49af-bfb5-d2e2782c75ff tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:37.253133 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-65f576c5-bfdf-49af-bfb5-d2e2782c75ff tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:37.253555 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-65f576c5-bfdf-49af-bfb5-d2e2782c75ff tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:37.304273 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c14ad322-a9e1-4352-8aff-ee7b89f2365d tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] 10.222.0.33 "GET /compute/v2.1/servers?status=active" status: 200 len: 1011 microversion: 2.1 time: 0.173907 Oct 04 20:46:37.305079 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1400/2829] 10.222.0.33 () {58 vars in 1152 bytes} [Tue Oct 4 20:46:37 2022] GET /compute/v2.1/servers?status=active => generated 1011 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:46:37.311047 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-04dc96a5-7f1f-47c9-af31-89aee3fab80f tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:37.312732 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-04dc96a5-7f1f-47c9-af31-89aee3fab80f tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] [instance: b65c8ce2-8537-4f84-ba63-5b913f6adc81] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:37.317996 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-04dc96a5-7f1f-47c9-af31-89aee3fab80f tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:37.319149 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-04dc96a5-7f1f-47c9-af31-89aee3fab80f tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:37.319577 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-04dc96a5-7f1f-47c9-af31-89aee3fab80f tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:37.320286 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-04dc96a5-7f1f-47c9-af31-89aee3fab80f tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:37.320746 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-04dc96a5-7f1f-47c9-af31-89aee3fab80f tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:37.321180 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-04dc96a5-7f1f-47c9-af31-89aee3fab80f tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:37.463797 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-65f576c5-bfdf-49af-bfb5-d2e2782c75ff tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aca59cd50bf74a36bb1e4427cd50fbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3fadcd7d4043daa0a6aba27ba814d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:37.471880 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-65f576c5-bfdf-49af-bfb5-d2e2782c75ff tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] 10.222.0.33 "GET /compute/v2.1/servers/815db889-a211-4eab-90f8-7ca46d7102a4" status: 200 len: 1498 microversion: 2.1 time: 0.231890 Oct 04 20:46:37.472657 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1430/2830] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:46:37 2022] GET /compute/v2.1/servers/815db889-a211-4eab-90f8-7ca46d7102a4 => generated 1498 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:46:37.477702 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-2bc8b9fb-7873-482a-ad30-fd29069b5807 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:37.482833 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-2bc8b9fb-7873-482a-ad30-fd29069b5807 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '12dc6570db03431187680f51349e55d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91111396aabd4306b66e14b5abd822ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:37.483485 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.compute.servers [None req-2bc8b9fb-7873-482a-ad30-fd29069b5807 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Removing options 'limit' from query {{(pid=128802) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 04 20:46:37.484288 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-2bc8b9fb-7873-482a-ad30-fd29069b5807 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Searching by: {'deleted': False, 'project_id': '91111396aabd4306b66e14b5abd822ad'} {{(pid=128802) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 20:46:37.489553 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2bc8b9fb-7873-482a-ad30-fd29069b5807 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:37.490309 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2bc8b9fb-7873-482a-ad30-fd29069b5807 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:37.490947 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2bc8b9fb-7873-482a-ad30-fd29069b5807 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:37.491850 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2bc8b9fb-7873-482a-ad30-fd29069b5807 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:37.492461 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2bc8b9fb-7873-482a-ad30-fd29069b5807 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:37.493784 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2bc8b9fb-7873-482a-ad30-fd29069b5807 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:37.525414 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.multi_cell_list [None req-2bc8b9fb-7873-482a-ad30-fd29069b5807 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128802) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 20:46:37.528877 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-04dc96a5-7f1f-47c9-af31-89aee3fab80f tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87dcc7baf63f4ae6bfe0a099adffd408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7097bc12179446f6a3e1fac8434d5c64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:37.540928 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-04dc96a5-7f1f-47c9-af31-89aee3fab80f tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] 10.222.0.33 "GET /compute/v2.1/servers/b65c8ce2-8537-4f84-ba63-5b913f6adc81" status: 200 len: 1494 microversion: 2.1 time: 0.234403 Oct 04 20:46:37.542374 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1401/2831] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:46:37 2022] GET /compute/v2.1/servers/b65c8ce2-8537-4f84-ba63-5b913f6adc81 => generated 1494 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:46:37.548254 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-293e7fe7-1af7-424b-8373-94770c3eb9b2 req-2e7b7052-7295-411a-957f-e044557bb959 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c703a086-cf9d-4d12-8a18-623e454bcb64", "name": "network-vif-plugged", "status": "completed", "tag": "be986445-0031-49e4-b37c-8a38b40174cd"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:46:37.558234 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-2bc8b9fb-7873-482a-ad30-fd29069b5807 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] 10.222.0.33 "GET /compute/v2.1/servers?limit=100000" status: 200 len: 1011 microversion: 2.1 time: 0.084067 Oct 04 20:46:37.560703 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-293e7fe7-1af7-424b-8373-94770c3eb9b2 req-2e7b7052-7295-411a-957f-e044557bb959 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:37.561441 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-293e7fe7-1af7-424b-8373-94770c3eb9b2 req-2e7b7052-7295-411a-957f-e044557bb959 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:37.562088 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-293e7fe7-1af7-424b-8373-94770c3eb9b2 req-2e7b7052-7295-411a-957f-e044557bb959 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:37.566611 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1431/2832] 10.222.0.33 () {58 vars in 1150 bytes} [Tue Oct 4 20:46:37 2022] GET /compute/v2.1/servers?limit=100000 => generated 1011 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:46:37.572080 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-238bea17-46e1-46ac-8043-5f47317adbee tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:37.572701 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-238bea17-46e1-46ac-8043-5f47317adbee tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] [instance: c703a086-cf9d-4d12-8a18-623e454bcb64] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:37.576365 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-293e7fe7-1af7-424b-8373-94770c3eb9b2 req-2e7b7052-7295-411a-957f-e044557bb959 service nova] Creating event network-vif-plugged:be986445-0031-49e4-b37c-8a38b40174cd for instance c703a086-cf9d-4d12-8a18-623e454bcb64 on n-h1-854823-8 Oct 04 20:46:37.580148 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-238bea17-46e1-46ac-8043-5f47317adbee tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:37.581175 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-238bea17-46e1-46ac-8043-5f47317adbee tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:37.582049 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-238bea17-46e1-46ac-8043-5f47317adbee tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:37.582656 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-293e7fe7-1af7-424b-8373-94770c3eb9b2 req-2e7b7052-7295-411a-957f-e044557bb959 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038605 Oct 04 20:46:37.583345 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-238bea17-46e1-46ac-8043-5f47317adbee tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:37.583660 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1402/2833] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:46:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:46:37.585118 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-238bea17-46e1-46ac-8043-5f47317adbee tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:37.585608 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-238bea17-46e1-46ac-8043-5f47317adbee tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:37.591206 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-98667177-e201-4a97-bb4a-89ed43272f9c tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:37.598084 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-98667177-e201-4a97-bb4a-89ed43272f9c tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '12dc6570db03431187680f51349e55d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91111396aabd4306b66e14b5abd822ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:37.600494 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-98667177-e201-4a97-bb4a-89ed43272f9c tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Searching by: {'deleted': False, 'project_id': '91111396aabd4306b66e14b5abd822ad'} {{(pid=128801) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 20:46:37.606809 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-98667177-e201-4a97-bb4a-89ed43272f9c tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:37.607610 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-98667177-e201-4a97-bb4a-89ed43272f9c tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:37.608268 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-98667177-e201-4a97-bb4a-89ed43272f9c tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:37.609770 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-98667177-e201-4a97-bb4a-89ed43272f9c tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:37.610675 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-98667177-e201-4a97-bb4a-89ed43272f9c tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:37.611358 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-98667177-e201-4a97-bb4a-89ed43272f9c tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:37.654056 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.multi_cell_list [None req-98667177-e201-4a97-bb4a-89ed43272f9c tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128801) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 20:46:37.697368 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-98667177-e201-4a97-bb4a-89ed43272f9c tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] 10.222.0.33 "GET /compute/v2.1/servers" status: 200 len: 1011 microversion: 2.1 time: 0.111649 Oct 04 20:46:37.700991 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1403/2834] 10.222.0.33 () {58 vars in 1125 bytes} [Tue Oct 4 20:46:37 2022] GET /compute/v2.1/servers => generated 1011 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:46:37.705392 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-4e9d83b3-e7fd-4066-a697-7720b2c6b274 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:37.706842 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-4e9d83b3-e7fd-4066-a697-7720b2c6b274 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] [instance: 39d66e18-289f-4674-b66c-146d68ef9133] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:37.716875 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4e9d83b3-e7fd-4066-a697-7720b2c6b274 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:37.717442 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4e9d83b3-e7fd-4066-a697-7720b2c6b274 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:37.717930 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4e9d83b3-e7fd-4066-a697-7720b2c6b274 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:37.718715 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4e9d83b3-e7fd-4066-a697-7720b2c6b274 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:37.719180 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4e9d83b3-e7fd-4066-a697-7720b2c6b274 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:37.719720 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4e9d83b3-e7fd-4066-a697-7720b2c6b274 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:37.827104 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-4e9d83b3-e7fd-4066-a697-7720b2c6b274 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:37.846686 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-4e9d83b3-e7fd-4066-a697-7720b2c6b274 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:37.848134 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-4e9d83b3-e7fd-4066-a697-7720b2c6b274 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:37.854156 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-4e9d83b3-e7fd-4066-a697-7720b2c6b274 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] 10.222.0.33 "GET /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133" status: 200 len: 1539 microversion: 2.91 time: 0.154271 Oct 04 20:46:37.854784 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1404/2835] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:46:37 2022] GET /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133 => generated 1539 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:46:37.873362 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9fa71c83-15e6-43c1-a081-2fab3a01d2a2 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:37.881408 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-9fa71c83-15e6-43c1-a081-2fab3a01d2a2 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '12dc6570db03431187680f51349e55d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91111396aabd4306b66e14b5abd822ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:37.883587 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-9fa71c83-15e6-43c1-a081-2fab3a01d2a2 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '91111396aabd4306b66e14b5abd822ad'} {{(pid=128801) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 20:46:37.890455 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-238bea17-46e1-46ac-8043-5f47317adbee tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e4b00964014a0383f79597652bd428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7f38600b5041ad8e66a12d77b940fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:37.898729 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-238bea17-46e1-46ac-8043-5f47317adbee tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] 10.222.0.33 "GET /compute/v2.1/servers/c703a086-cf9d-4d12-8a18-623e454bcb64" status: 200 len: 1367 microversion: 2.1 time: 0.330994 Oct 04 20:46:37.898924 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9fa71c83-15e6-43c1-a081-2fab3a01d2a2 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:37.899203 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9fa71c83-15e6-43c1-a081-2fab3a01d2a2 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:37.900128 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9fa71c83-15e6-43c1-a081-2fab3a01d2a2 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:37.900855 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9fa71c83-15e6-43c1-a081-2fab3a01d2a2 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:37.901307 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9fa71c83-15e6-43c1-a081-2fab3a01d2a2 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:37.901730 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9fa71c83-15e6-43c1-a081-2fab3a01d2a2 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:37.914943 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1432/2836] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:46:37 2022] GET /compute/v2.1/servers/c703a086-cf9d-4d12-8a18-623e454bcb64 => generated 1367 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:46:38.002684 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.multi_cell_list [None req-9fa71c83-15e6-43c1-a081-2fab3a01d2a2 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128801) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 20:46:38.026590 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-903ba3ff-112d-47da-9343-dfb21946aa52 req-d80be827-7019-4a9d-9315-16eae9b1e8eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b65c8ce2-8537-4f84-ba63-5b913f6adc81", "name": "network-vif-deleted", "tag": "c218b278-1665-4ab3-bc63-10e43ce32a5c"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:46:38.044310 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-903ba3ff-112d-47da-9343-dfb21946aa52 req-d80be827-7019-4a9d-9315-16eae9b1e8eb service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:38.044719 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-903ba3ff-112d-47da-9343-dfb21946aa52 req-d80be827-7019-4a9d-9315-16eae9b1e8eb service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:38.045144 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-903ba3ff-112d-47da-9343-dfb21946aa52 req-d80be827-7019-4a9d-9315-16eae9b1e8eb service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:38.073332 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-903ba3ff-112d-47da-9343-dfb21946aa52 req-d80be827-7019-4a9d-9315-16eae9b1e8eb service nova] Creating event network-vif-deleted:c218b278-1665-4ab3-bc63-10e43ce32a5c for instance b65c8ce2-8537-4f84-ba63-5b913f6adc81 on n-h2-854823-8 Oct 04 20:46:38.079970 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-903ba3ff-112d-47da-9343-dfb21946aa52 req-d80be827-7019-4a9d-9315-16eae9b1e8eb service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058028 Oct 04 20:46:38.081580 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1433/2837] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:46:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 20:46:38.087999 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-a8959f64-f952-4b88-ad34-de5226f1dc02 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:38.088903 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-a8959f64-f952-4b88-ad34-de5226f1dc02 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: 4d46fff2-b04d-41aa-ada0-2023ab545b48] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:38.091347 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-9fa71c83-15e6-43c1-a081-2fab3a01d2a2 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] 10.222.0.33 "GET /compute/v2.1/servers?flavor=451" status: 200 len: 346 microversion: 2.1 time: 0.222639 Oct 04 20:46:38.100646 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1405/2838] 10.222.0.33 () {58 vars in 1146 bytes} [Tue Oct 4 20:46:37 2022] GET /compute/v2.1/servers?flavor=451 => generated 346 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:46:38.100830 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a8959f64-f952-4b88-ad34-de5226f1dc02 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:38.100830 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a8959f64-f952-4b88-ad34-de5226f1dc02 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:38.100830 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a8959f64-f952-4b88-ad34-de5226f1dc02 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:38.100830 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a8959f64-f952-4b88-ad34-de5226f1dc02 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:38.100830 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a8959f64-f952-4b88-ad34-de5226f1dc02 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:38.100830 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a8959f64-f952-4b88-ad34-de5226f1dc02 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:38.101907 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-48513e12-d89a-48f4-81bf-ed5e165dcf03 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Calling method '.version_select at 0x7f3c740541f0>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:38.160994 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-48513e12-d89a-48f4-81bf-ed5e165dcf03 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] 10.222.0.33 "GET /compute/v2.1/images/0f050377-ae76-45a1-9386-5340e96ea493" status: 200 len: 1455 microversion: 2.1 time: 0.067315 Oct 04 20:46:38.162380 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1406/2839] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 20:46:38 2022] GET /compute/v2.1/images/0f050377-ae76-45a1-9386-5340e96ea493 => generated 1455 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:46:38.169114 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f1c146aa-7f10-4a80-806e-e3ffbc7803bb tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:38.175566 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f1c146aa-7f10-4a80-806e-e3ffbc7803bb tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '12dc6570db03431187680f51349e55d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91111396aabd4306b66e14b5abd822ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:38.176434 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.compute.servers [None req-f1c146aa-7f10-4a80-806e-e3ffbc7803bb tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Removing options 'limit' from query {{(pid=128801) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 04 20:46:38.177200 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f1c146aa-7f10-4a80-806e-e3ffbc7803bb tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Searching by: {'deleted': False, 'project_id': '91111396aabd4306b66e14b5abd822ad'} {{(pid=128801) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 20:46:38.182949 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f1c146aa-7f10-4a80-806e-e3ffbc7803bb tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:38.183692 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f1c146aa-7f10-4a80-806e-e3ffbc7803bb tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:38.184213 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f1c146aa-7f10-4a80-806e-e3ffbc7803bb tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:38.185308 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f1c146aa-7f10-4a80-806e-e3ffbc7803bb tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:38.185936 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f1c146aa-7f10-4a80-806e-e3ffbc7803bb tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:38.186680 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f1c146aa-7f10-4a80-806e-e3ffbc7803bb tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:38.215828 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f1c146aa-7f10-4a80-806e-e3ffbc7803bb tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] 10.222.0.33 "GET /compute/v2.1/servers?limit=1" status: 200 len: 485 microversion: 2.1 time: 0.052399 Oct 04 20:46:38.216998 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1407/2840] 10.222.0.33 () {58 vars in 1140 bytes} [Tue Oct 4 20:46:38 2022] GET /compute/v2.1/servers?limit=1 => generated 485 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:46:38.231481 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-01bebfd0-789a-4b1e-932c-58ed9aa55d9c tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:38.237799 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-01bebfd0-789a-4b1e-932c-58ed9aa55d9c tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '12dc6570db03431187680f51349e55d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91111396aabd4306b66e14b5abd822ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:38.238626 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-01bebfd0-789a-4b1e-932c-58ed9aa55d9c tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-2015269677', 'deleted': False, 'project_id': '91111396aabd4306b66e14b5abd822ad'} {{(pid=128801) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 20:46:38.244713 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-01bebfd0-789a-4b1e-932c-58ed9aa55d9c tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:38.245341 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-01bebfd0-789a-4b1e-932c-58ed9aa55d9c tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:38.246249 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-01bebfd0-789a-4b1e-932c-58ed9aa55d9c tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:38.247107 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-01bebfd0-789a-4b1e-932c-58ed9aa55d9c tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:38.247656 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-01bebfd0-789a-4b1e-932c-58ed9aa55d9c tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:38.248244 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-01bebfd0-789a-4b1e-932c-58ed9aa55d9c tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:38.308601 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-a8959f64-f952-4b88-ad34-de5226f1dc02 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac650232cc04810b1340dc2f0edadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b0670d1bd99424780a70e69d57a2166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:38.320429 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-a8959f64-f952-4b88-ad34-de5226f1dc02 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48" status: 200 len: 1687 microversion: 2.1 time: 0.237623 Oct 04 20:46:38.335595 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1434/2841] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:46:38 2022] GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48 => generated 1687 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:46:38.357669 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.multi_cell_list [None req-01bebfd0-789a-4b1e-932c-58ed9aa55d9c tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128801) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 20:46:38.421822 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-01bebfd0-789a-4b1e-932c-58ed9aa55d9c tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] 10.222.0.33 "GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-2015269677" status: 200 len: 346 microversion: 2.1 time: 0.195192 Oct 04 20:46:38.422838 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1408/2842] 10.222.0.33 () {58 vars in 1242 bytes} [Tue Oct 4 20:46:38 2022] GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-2015269677 => generated 346 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 20:46:38.436676 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-e2fedfaf-f3bd-4ded-88c7-c2a20b008b90 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:46:38.445711 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e2fedfaf-f3bd-4ded-88c7-c2a20b008b90 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:38.446201 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e2fedfaf-f3bd-4ded-88c7-c2a20b008b90 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:38.446782 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e2fedfaf-f3bd-4ded-88c7-c2a20b008b90 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:38.469272 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-e2fedfaf-f3bd-4ded-88c7-c2a20b008b90 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] [instance: 39e846c1-6876-42ef-b290-f733516e1051] Going to try to stop instance {{(pid=128802) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 04 20:46:38.500619 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-38b0ce80-a8fa-448a-891b-8074876a7d71 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:38.501227 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-38b0ce80-a8fa-448a-891b-8074876a7d71 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] [instance: 815db889-a211-4eab-90f8-7ca46d7102a4] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:38.508270 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-38b0ce80-a8fa-448a-891b-8074876a7d71 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:38.508797 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-38b0ce80-a8fa-448a-891b-8074876a7d71 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:38.509221 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-38b0ce80-a8fa-448a-891b-8074876a7d71 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:38.510101 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-38b0ce80-a8fa-448a-891b-8074876a7d71 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:38.510592 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-38b0ce80-a8fa-448a-891b-8074876a7d71 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:38.511078 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-38b0ce80-a8fa-448a-891b-8074876a7d71 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:38.513874 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-e2fedfaf-f3bd-4ded-88c7-c2a20b008b90 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] 10.222.0.33 "POST /compute/v2.1/servers/39e846c1-6876-42ef-b290-f733516e1051/action" status: 202 len: 0 microversion: 2.1 time: 0.081448 Oct 04 20:46:38.514519 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1435/2843] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 20:46:38 2022] POST /compute/v2.1/servers/39e846c1-6876-42ef-b290-f733516e1051/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:46:38.523089 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-15ad029c-83cb-4697-9eb3-da4500854fa1 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:38.523775 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-15ad029c-83cb-4697-9eb3-da4500854fa1 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] [instance: 39e846c1-6876-42ef-b290-f733516e1051] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:38.529796 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-15ad029c-83cb-4697-9eb3-da4500854fa1 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:38.530272 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-15ad029c-83cb-4697-9eb3-da4500854fa1 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:38.530756 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-15ad029c-83cb-4697-9eb3-da4500854fa1 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:38.531438 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-15ad029c-83cb-4697-9eb3-da4500854fa1 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:38.531884 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-15ad029c-83cb-4697-9eb3-da4500854fa1 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:38.532313 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-15ad029c-83cb-4697-9eb3-da4500854fa1 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:38.715090 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-38b0ce80-a8fa-448a-891b-8074876a7d71 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aca59cd50bf74a36bb1e4427cd50fbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3fadcd7d4043daa0a6aba27ba814d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:38.717393 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-15ad029c-83cb-4697-9eb3-da4500854fa1 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12dc6570db03431187680f51349e55d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91111396aabd4306b66e14b5abd822ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:38.723442 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-38b0ce80-a8fa-448a-891b-8074876a7d71 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] 10.222.0.33 "GET /compute/v2.1/servers/815db889-a211-4eab-90f8-7ca46d7102a4" status: 200 len: 1498 microversion: 2.1 time: 0.226761 Oct 04 20:46:38.724046 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1409/2844] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:46:38 2022] GET /compute/v2.1/servers/815db889-a211-4eab-90f8-7ca46d7102a4 => generated 1498 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:46:38.726166 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-15ad029c-83cb-4697-9eb3-da4500854fa1 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] 10.222.0.33 "GET /compute/v2.1/servers/39e846c1-6876-42ef-b290-f733516e1051" status: 200 len: 1521 microversion: 2.1 time: 0.207199 Oct 04 20:46:38.726769 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1436/2845] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:46:38 2022] GET /compute/v2.1/servers/39e846c1-6876-42ef-b290-f733516e1051 => generated 1521 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:46:38.738111 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-874a1017-2ad1-42f1-9117-18612c5baa63 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:38.738934 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-874a1017-2ad1-42f1-9117-18612c5baa63 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] [instance: b65c8ce2-8537-4f84-ba63-5b913f6adc81] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:38.745671 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-874a1017-2ad1-42f1-9117-18612c5baa63 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:38.746144 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-874a1017-2ad1-42f1-9117-18612c5baa63 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:38.746613 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-874a1017-2ad1-42f1-9117-18612c5baa63 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:38.747314 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-874a1017-2ad1-42f1-9117-18612c5baa63 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:38.747768 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-874a1017-2ad1-42f1-9117-18612c5baa63 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:38.748188 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-874a1017-2ad1-42f1-9117-18612c5baa63 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:38.779922 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-874a1017-2ad1-42f1-9117-18612c5baa63 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:38.780404 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-874a1017-2ad1-42f1-9117-18612c5baa63 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:38.780835 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-874a1017-2ad1-42f1-9117-18612c5baa63 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:38.781279 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-874a1017-2ad1-42f1-9117-18612c5baa63 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lazy-loading 'fault' on Instance uuid b65c8ce2-8537-4f84-ba63-5b913f6adc81 {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:46:38.822870 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-874a1017-2ad1-42f1-9117-18612c5baa63 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87dcc7baf63f4ae6bfe0a099adffd408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7097bc12179446f6a3e1fac8434d5c64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:38.830404 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-874a1017-2ad1-42f1-9117-18612c5baa63 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] 10.222.0.33 "GET /compute/v2.1/servers/b65c8ce2-8537-4f84-ba63-5b913f6adc81" status: 200 len: 1298 microversion: 2.1 time: 0.096162 Oct 04 20:46:38.830978 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1410/2846] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:46:38 2022] GET /compute/v2.1/servers/b65c8ce2-8537-4f84-ba63-5b913f6adc81 => generated 1298 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:46:38.885303 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-28a27d4c-7577-44b4-b891-fab080120e46 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:38.885954 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-28a27d4c-7577-44b4-b891-fab080120e46 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] [instance: 39d66e18-289f-4674-b66c-146d68ef9133] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:38.891956 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-28a27d4c-7577-44b4-b891-fab080120e46 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:38.892437 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-28a27d4c-7577-44b4-b891-fab080120e46 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:38.892925 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-28a27d4c-7577-44b4-b891-fab080120e46 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:38.893624 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-28a27d4c-7577-44b4-b891-fab080120e46 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:38.894077 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-28a27d4c-7577-44b4-b891-fab080120e46 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:38.894524 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-28a27d4c-7577-44b4-b891-fab080120e46 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:38.923377 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6867bdb2-60cb-49cc-a93f-4c0331a9ff80 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:38.923991 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-6867bdb2-60cb-49cc-a93f-4c0331a9ff80 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] [instance: c703a086-cf9d-4d12-8a18-623e454bcb64] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:38.930620 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6867bdb2-60cb-49cc-a93f-4c0331a9ff80 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:38.931127 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6867bdb2-60cb-49cc-a93f-4c0331a9ff80 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:38.931562 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6867bdb2-60cb-49cc-a93f-4c0331a9ff80 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:38.932260 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6867bdb2-60cb-49cc-a93f-4c0331a9ff80 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:38.932718 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6867bdb2-60cb-49cc-a93f-4c0331a9ff80 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:38.933143 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6867bdb2-60cb-49cc-a93f-4c0331a9ff80 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:38.965170 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-28a27d4c-7577-44b4-b891-fab080120e46 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:38.973698 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-28a27d4c-7577-44b4-b891-fab080120e46 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:38.975662 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-28a27d4c-7577-44b4-b891-fab080120e46 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:38.980730 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-28a27d4c-7577-44b4-b891-fab080120e46 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] 10.222.0.33 "GET /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133" status: 200 len: 1539 microversion: 2.91 time: 0.101068 Oct 04 20:46:38.981311 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1437/2847] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:46:38 2022] GET /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133 => generated 1539 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:46:39.080897 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-6867bdb2-60cb-49cc-a93f-4c0331a9ff80 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e4b00964014a0383f79597652bd428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7f38600b5041ad8e66a12d77b940fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:39.089214 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-6867bdb2-60cb-49cc-a93f-4c0331a9ff80 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] 10.222.0.33 "GET /compute/v2.1/servers/c703a086-cf9d-4d12-8a18-623e454bcb64" status: 200 len: 1367 microversion: 2.1 time: 0.169778 Oct 04 20:46:39.089792 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1411/2848] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:46:38 2022] GET /compute/v2.1/servers/c703a086-cf9d-4d12-8a18-623e454bcb64 => generated 1367 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:46:39.177061 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-a5973729-f607-4e45-9a64-822166f2863f tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Calling method '.version_select at 0x7f3c78905670>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:39.222151 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-a5973729-f607-4e45-9a64-822166f2863f tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] 10.222.0.33 "GET /compute/v2.1/images/0f050377-ae76-45a1-9386-5340e96ea493" status: 200 len: 1455 microversion: 2.1 time: 0.048862 Oct 04 20:46:39.222770 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1438/2849] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 20:46:39 2022] GET /compute/v2.1/images/0f050377-ae76-45a1-9386-5340e96ea493 => generated 1455 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:46:39.346079 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-dfc3cf30-e1a3-4549-b6c8-42f5a20ef43b tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:39.346808 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-dfc3cf30-e1a3-4549-b6c8-42f5a20ef43b tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: 4d46fff2-b04d-41aa-ada0-2023ab545b48] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:39.354047 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dfc3cf30-e1a3-4549-b6c8-42f5a20ef43b tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:39.354648 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dfc3cf30-e1a3-4549-b6c8-42f5a20ef43b tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:39.355156 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dfc3cf30-e1a3-4549-b6c8-42f5a20ef43b tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:39.355932 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dfc3cf30-e1a3-4549-b6c8-42f5a20ef43b tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:39.356471 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dfc3cf30-e1a3-4549-b6c8-42f5a20ef43b tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:39.356960 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dfc3cf30-e1a3-4549-b6c8-42f5a20ef43b tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:39.361378 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:46:39.496493 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-dfc3cf30-e1a3-4549-b6c8-42f5a20ef43b tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac650232cc04810b1340dc2f0edadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b0670d1bd99424780a70e69d57a2166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:39.504202 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-dfc3cf30-e1a3-4549-b6c8-42f5a20ef43b tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48" status: 200 len: 1687 microversion: 2.1 time: 0.161926 Oct 04 20:46:39.504781 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1412/2850] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:46:39 2022] GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48 => generated 1687 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:46:39.602398 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-66891e51-1b6a-4130-82c5-5c59f71ea9a4 req-b0fedb28-8713-4c22-9830-4f44ae1c17ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d46fff2-b04d-41aa-ada0-2023ab545b48", "name": "network-vif-unplugged", "status": "completed", "tag": "39e1fcde-c40c-4b4b-8edd-7565faaf4580"}, {"server_uuid": "8917de21-2b45-4249-ae17-17f679d4856f", "name": "network-vif-unplugged", "status": "completed", "tag": "ec043ecd-8aa4-4125-9877-75f2ddd3f7ee"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:46:39.613248 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-66891e51-1b6a-4130-82c5-5c59f71ea9a4 req-b0fedb28-8713-4c22-9830-4f44ae1c17ac service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:39.613748 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-66891e51-1b6a-4130-82c5-5c59f71ea9a4 req-b0fedb28-8713-4c22-9830-4f44ae1c17ac service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:39.614171 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-66891e51-1b6a-4130-82c5-5c59f71ea9a4 req-b0fedb28-8713-4c22-9830-4f44ae1c17ac service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:39.626418 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-66891e51-1b6a-4130-82c5-5c59f71ea9a4 req-b0fedb28-8713-4c22-9830-4f44ae1c17ac service nova] Creating event network-vif-unplugged:39e1fcde-c40c-4b4b-8edd-7565faaf4580 for instance 4d46fff2-b04d-41aa-ada0-2023ab545b48 on n-h1-854823-8 Oct 04 20:46:39.626925 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-66891e51-1b6a-4130-82c5-5c59f71ea9a4 req-b0fedb28-8713-4c22-9830-4f44ae1c17ac service nova] Creating event network-vif-unplugged:ec043ecd-8aa4-4125-9877-75f2ddd3f7ee for instance 8917de21-2b45-4249-ae17-17f679d4856f on n-h2-854823-8 Oct 04 20:46:39.635935 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-66891e51-1b6a-4130-82c5-5c59f71ea9a4 req-b0fedb28-8713-4c22-9830-4f44ae1c17ac service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 358 microversion: 2.1 time: 0.038029 Oct 04 20:46:39.636519 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1439/2851] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:46:39 2022] POST /compute/v2.1/os-server-external-events => generated 358 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:46:39.746594 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d1fd8f06-3853-433e-b750-0e5d1e7aa4a7 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:39.747132 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d1fd8f06-3853-433e-b750-0e5d1e7aa4a7 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] [instance: 815db889-a211-4eab-90f8-7ca46d7102a4] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:39.750500 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-787f320e-de68-4d95-9bed-cde206b9df1e tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:39.751731 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-787f320e-de68-4d95-9bed-cde206b9df1e tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] [instance: 39e846c1-6876-42ef-b290-f733516e1051] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:39.754102 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d1fd8f06-3853-433e-b750-0e5d1e7aa4a7 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:39.754601 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d1fd8f06-3853-433e-b750-0e5d1e7aa4a7 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:39.755042 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d1fd8f06-3853-433e-b750-0e5d1e7aa4a7 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:39.757250 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d1fd8f06-3853-433e-b750-0e5d1e7aa4a7 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:39.757919 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d1fd8f06-3853-433e-b750-0e5d1e7aa4a7 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:39.758369 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d1fd8f06-3853-433e-b750-0e5d1e7aa4a7 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:39.758857 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-787f320e-de68-4d95-9bed-cde206b9df1e tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:39.759332 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-787f320e-de68-4d95-9bed-cde206b9df1e tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:39.759758 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-787f320e-de68-4d95-9bed-cde206b9df1e tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:39.760477 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-787f320e-de68-4d95-9bed-cde206b9df1e tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:39.760920 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-787f320e-de68-4d95-9bed-cde206b9df1e tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:39.761630 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-787f320e-de68-4d95-9bed-cde206b9df1e tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:39.997241 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d1fd8f06-3853-433e-b750-0e5d1e7aa4a7 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aca59cd50bf74a36bb1e4427cd50fbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3fadcd7d4043daa0a6aba27ba814d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:40.000563 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-787f320e-de68-4d95-9bed-cde206b9df1e tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12dc6570db03431187680f51349e55d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91111396aabd4306b66e14b5abd822ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:40.007372 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d1fd8f06-3853-433e-b750-0e5d1e7aa4a7 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] 10.222.0.33 "GET /compute/v2.1/servers/815db889-a211-4eab-90f8-7ca46d7102a4" status: 200 len: 1498 microversion: 2.1 time: 0.264550 Oct 04 20:46:40.008551 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1413/2852] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:46:39 2022] GET /compute/v2.1/servers/815db889-a211-4eab-90f8-7ca46d7102a4 => generated 1498 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:46:40.013457 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b59b4d06-7ba9-4a9c-be5c-9add2e90062f tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:40.014205 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b59b4d06-7ba9-4a9c-be5c-9add2e90062f tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] [instance: b65c8ce2-8537-4f84-ba63-5b913f6adc81] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:40.020863 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-787f320e-de68-4d95-9bed-cde206b9df1e tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] 10.222.0.33 "GET /compute/v2.1/servers/39e846c1-6876-42ef-b290-f733516e1051" status: 200 len: 1521 microversion: 2.1 time: 0.275225 Oct 04 20:46:40.023248 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1440/2853] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:46:39 2022] GET /compute/v2.1/servers/39e846c1-6876-42ef-b290-f733516e1051 => generated 1521 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:46:40.025922 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b59b4d06-7ba9-4a9c-be5c-9add2e90062f tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:40.026475 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b59b4d06-7ba9-4a9c-be5c-9add2e90062f tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:40.026955 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b59b4d06-7ba9-4a9c-be5c-9add2e90062f tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:40.027740 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b59b4d06-7ba9-4a9c-be5c-9add2e90062f tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:40.028198 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b59b4d06-7ba9-4a9c-be5c-9add2e90062f tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:40.028553 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-5d49f617-dac0-41ec-86ec-b83ad4e3aa31 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:40.028670 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b59b4d06-7ba9-4a9c-be5c-9add2e90062f tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:40.029339 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-5d49f617-dac0-41ec-86ec-b83ad4e3aa31 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] [instance: 39d66e18-289f-4674-b66c-146d68ef9133] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:40.036582 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5d49f617-dac0-41ec-86ec-b83ad4e3aa31 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:40.037073 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5d49f617-dac0-41ec-86ec-b83ad4e3aa31 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:40.037511 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5d49f617-dac0-41ec-86ec-b83ad4e3aa31 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:40.038216 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5d49f617-dac0-41ec-86ec-b83ad4e3aa31 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:40.038691 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5d49f617-dac0-41ec-86ec-b83ad4e3aa31 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:40.039117 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5d49f617-dac0-41ec-86ec-b83ad4e3aa31 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:40.045639 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-b59b4d06-7ba9-4a9c-be5c-9add2e90062f tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] HTTP exception thrown: Instance b65c8ce2-8537-4f84-ba63-5b913f6adc81 could not be found. Oct 04 20:46:40.047804 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b59b4d06-7ba9-4a9c-be5c-9add2e90062f tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Request method failure captured: Oct 04 20:46:40.047804 n-d-854823-8 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/b65c8ce2-8537-4f84-ba63-5b913f6adc81 HTTP/1.1 Oct 04 20:46:40.047804 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:46:40.047804 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:46:40.047804 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:46:40.047804 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 0 Oct 04 20:46:40.047804 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:46:40.047804 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:46:40.047804 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:46:40.047804 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:46:40.047804 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJsSwF2ySar2LJQGdSe43g0QAYtjP4_BPyLRwM7Cr4_8Oz_X-RTScy1BL0ogt-qe3YNvQGTaYbVbGoUGx7pHqiHpbZftU7_TcvDA_zpgTfxGGH91CR74RG6crXL2bxRs87dSvsLYuOWMw7_AQjTpWetc1HBlb5th2rD-ko2SN3gLGSA Oct 04 20:46:40.047804 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:46:40.047804 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:46:40.047804 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:46:40.047804 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:46:40.047804 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:46:40.047804 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:46:40.047804 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: 7097bc12179446f6a3e1fac8434d5c64 Oct 04 20:46:40.047804 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-ServersTestJSON-927611194 Oct 04 20:46:40.047804 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 20:46:40.047804 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 20:46:40.047804 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_7097bc12179446f6a3e1fac8434d5c64", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7097bc12179446f6a3e1fac8434d5c64"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7097bc12179446f6a3e1fac8434d5c64"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/7097bc12179446f6a3e1fac8434d5c64"}]}] Oct 04 20:46:40.047804 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-ServersTestJSON-927611194 Oct 04 20:46:40.047804 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: 7097bc12179446f6a3e1fac8434d5c64 Oct 04 20:46:40.047804 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ServersTestJSON-927611194 Oct 04 20:46:40.047804 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-ServersTestJSON-927611194-project Oct 04 20:46:40.047804 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:46:40.047804 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:46:40.047804 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: 87dcc7baf63f4ae6bfe0a099adffd408 Oct 04 20:46:40.047804 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-ServersTestJSON-927611194-project Oct 04 20:46:40.047804 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 20:46:40.047804 n-d-854823-8 devstack@n-api.service[128801]: exception: Instance b65c8ce2-8537-4f84-ba63-5b913f6adc81 could not be found. Oct 04 20:46:40.047804 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': 'b65c8ce2-8537-4f84-ba63-5b913f6adc81'} Oct 04 20:46:40.047804 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:46:40.047804 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:46:40.047804 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:46:40.047804 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:46:40.047804 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:46:40.047804 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:46:40.047804 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:46:40.047804 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:46:40.047804 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:46:40.047804 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:46:40.047804 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b65c8ce2-8537-4f84-ba63-5b913f6adc81 could not be found. Oct 04 20:46:40.047804 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:46:40.047804 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:46:40.047804 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:46:40.047804 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:46:40.047804 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:46:40.047804 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:46:40.047804 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:46:40.047804 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:46:40.047804 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:46:40.047804 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:46:40.047804 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:46:40.047804 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:46:40.047804 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:46:40.047804 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:46:40.047804 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:46:40.047804 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:46:40.047804 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b65c8ce2-8537-4f84-ba63-5b913f6adc81 could not be found. Oct 04 20:46:40.047804 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:46:40.047804 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:46:40.047804 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:46:40.047804 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:46:40.053089 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:46:40.053089 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:46:40.053089 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:46:40.053089 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:46:40.053089 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b65c8ce2-8537-4f84-ba63-5b913f6adc81 could not be found. Oct 04 20:46:40.053089 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:46:40.053089 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b59b4d06-7ba9-4a9c-be5c-9add2e90062f tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Returning 404 to user: Instance b65c8ce2-8537-4f84-ba63-5b913f6adc81 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:46:40.053089 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b59b4d06-7ba9-4a9c-be5c-9add2e90062f tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] 10.222.0.33 "GET /compute/v2.1/servers/b65c8ce2-8537-4f84-ba63-5b913f6adc81" status: 404 len: 111 microversion: 2.1 time: 0.039667 Oct 04 20:46:40.053089 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1414/2854] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:46:40 2022] GET /compute/v2.1/servers/b65c8ce2-8537-4f84-ba63-5b913f6adc81 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:46:40.059289 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d1077847-3e45-4e4b-bdda-322f4e41437a tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:40.059783 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d1077847-3e45-4e4b-bdda-322f4e41437a tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] [instance: bdfb94ca-ded6-4af0-bd9f-59fc877c4c0a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:40.062625 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:46:40.065982 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d1077847-3e45-4e4b-bdda-322f4e41437a tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:40.066503 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d1077847-3e45-4e4b-bdda-322f4e41437a tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:40.066936 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d1077847-3e45-4e4b-bdda-322f4e41437a tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:40.067635 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d1077847-3e45-4e4b-bdda-322f4e41437a tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:40.068687 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d1077847-3e45-4e4b-bdda-322f4e41437a tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:40.069121 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d1077847-3e45-4e4b-bdda-322f4e41437a tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:40.097719 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d1077847-3e45-4e4b-bdda-322f4e41437a tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] [instance: bdfb94ca-ded6-4af0-bd9f-59fc877c4c0a] Going to try to terminate instance {{(pid=128801) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:46:40.113498 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-5d49f617-dac0-41ec-86ec-b83ad4e3aa31 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:40.122621 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-5d49f617-dac0-41ec-86ec-b83ad4e3aa31 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:40.124074 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-5d49f617-dac0-41ec-86ec-b83ad4e3aa31 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:40.129161 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-5d49f617-dac0-41ec-86ec-b83ad4e3aa31 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] 10.222.0.33 "GET /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133" status: 200 len: 1539 microversion: 2.91 time: 0.104763 Oct 04 20:46:40.129655 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1441/2855] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:46:40 2022] GET /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133 => generated 1539 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:46:40.137483 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-dea03776-7fbc-4f7f-bdd8-d4f727d2be01 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:40.138111 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-dea03776-7fbc-4f7f-bdd8-d4f727d2be01 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] [instance: c703a086-cf9d-4d12-8a18-623e454bcb64] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:40.144514 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dea03776-7fbc-4f7f-bdd8-d4f727d2be01 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:40.144987 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dea03776-7fbc-4f7f-bdd8-d4f727d2be01 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:40.145415 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dea03776-7fbc-4f7f-bdd8-d4f727d2be01 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:40.146127 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dea03776-7fbc-4f7f-bdd8-d4f727d2be01 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:40.146592 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dea03776-7fbc-4f7f-bdd8-d4f727d2be01 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:40.147011 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dea03776-7fbc-4f7f-bdd8-d4f727d2be01 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:40.214440 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d1077847-3e45-4e4b-bdda-322f4e41437a tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] 10.222.0.33 "DELETE /compute/v2.1/servers/bdfb94ca-ded6-4af0-bd9f-59fc877c4c0a" status: 204 len: 0 microversion: 2.1 time: 0.158244 Oct 04 20:46:40.215157 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1415/2856] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 20:46:40 2022] DELETE /compute/v2.1/servers/bdfb94ca-ded6-4af0-bd9f-59fc877c4c0a => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 20:46:40.227640 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5e713f34-4003-47b9-bd76-7fe2b4355126 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:40.228346 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-5e713f34-4003-47b9-bd76-7fe2b4355126 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] [instance: bdfb94ca-ded6-4af0-bd9f-59fc877c4c0a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:40.237238 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5e713f34-4003-47b9-bd76-7fe2b4355126 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:40.238124 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5e713f34-4003-47b9-bd76-7fe2b4355126 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:40.238962 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5e713f34-4003-47b9-bd76-7fe2b4355126 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:40.240238 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5e713f34-4003-47b9-bd76-7fe2b4355126 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:40.241035 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5e713f34-4003-47b9-bd76-7fe2b4355126 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:40.241702 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5e713f34-4003-47b9-bd76-7fe2b4355126 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:40.298824 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-dea03776-7fbc-4f7f-bdd8-d4f727d2be01 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e4b00964014a0383f79597652bd428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7f38600b5041ad8e66a12d77b940fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:40.307085 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-dea03776-7fbc-4f7f-bdd8-d4f727d2be01 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] 10.222.0.33 "GET /compute/v2.1/servers/c703a086-cf9d-4d12-8a18-623e454bcb64" status: 200 len: 1556 microversion: 2.1 time: 0.176431 Oct 04 20:46:40.307926 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1442/2857] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:46:40 2022] GET /compute/v2.1/servers/c703a086-cf9d-4d12-8a18-623e454bcb64 => generated 1556 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:46:40.312284 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-f65458cb-6774-4f5e-a957-b34ceeef7e65 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Calling method '.version_select at 0x7f3c74176940>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:40.371888 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-f65458cb-6774-4f5e-a957-b34ceeef7e65 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] 10.222.0.33 "GET /compute/v2.1/images/0f050377-ae76-45a1-9386-5340e96ea493" status: 200 len: 1455 microversion: 2.1 time: 0.062884 Oct 04 20:46:40.372770 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1443/2858] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 20:46:40 2022] GET /compute/v2.1/images/0f050377-ae76-45a1-9386-5340e96ea493 => generated 1455 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:46:40.377567 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-3648a61a-3751-4626-81e0-df790be4d54f tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:40.378113 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-3648a61a-3751-4626-81e0-df790be4d54f tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] [instance: c703a086-cf9d-4d12-8a18-623e454bcb64] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:40.387183 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3648a61a-3751-4626-81e0-df790be4d54f tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:40.387652 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3648a61a-3751-4626-81e0-df790be4d54f tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:40.388153 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3648a61a-3751-4626-81e0-df790be4d54f tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:40.388856 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3648a61a-3751-4626-81e0-df790be4d54f tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:40.389305 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3648a61a-3751-4626-81e0-df790be4d54f tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:40.389775 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3648a61a-3751-4626-81e0-df790be4d54f tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:40.432270 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-5e713f34-4003-47b9-bd76-7fe2b4355126 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87dcc7baf63f4ae6bfe0a099adffd408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7097bc12179446f6a3e1fac8434d5c64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:40.442435 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5e713f34-4003-47b9-bd76-7fe2b4355126 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] 10.222.0.33 "GET /compute/v2.1/servers/bdfb94ca-ded6-4af0-bd9f-59fc877c4c0a" status: 200 len: 1495 microversion: 2.1 time: 0.222042 Oct 04 20:46:40.442647 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1416/2859] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:46:40 2022] GET /compute/v2.1/servers/bdfb94ca-ded6-4af0-bd9f-59fc877c4c0a => generated 1495 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:46:40.495950 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-3648a61a-3751-4626-81e0-df790be4d54f tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] 10.222.0.33 "GET /compute/v2.1/servers/c703a086-cf9d-4d12-8a18-623e454bcb64/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.122084 Oct 04 20:46:40.496719 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1444/2860] 10.222.0.33 () {58 vars in 1275 bytes} [Tue Oct 4 20:46:40 2022] GET /compute/v2.1/servers/c703a086-cf9d-4d12-8a18-623e454bcb64/os-interface => generated 284 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:46:40.528780 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d0c152b4-9ff6-45f8-9c24-da6e192f004e tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:40.529585 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d0c152b4-9ff6-45f8-9c24-da6e192f004e tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: 4d46fff2-b04d-41aa-ada0-2023ab545b48] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:40.543363 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d0c152b4-9ff6-45f8-9c24-da6e192f004e tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:40.544013 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d0c152b4-9ff6-45f8-9c24-da6e192f004e tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:40.544542 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d0c152b4-9ff6-45f8-9c24-da6e192f004e tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:40.545341 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d0c152b4-9ff6-45f8-9c24-da6e192f004e tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:40.545889 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d0c152b4-9ff6-45f8-9c24-da6e192f004e tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:40.546439 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d0c152b4-9ff6-45f8-9c24-da6e192f004e tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:40.716209 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d0c152b4-9ff6-45f8-9c24-da6e192f004e tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac650232cc04810b1340dc2f0edadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b0670d1bd99424780a70e69d57a2166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:40.725217 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d0c152b4-9ff6-45f8-9c24-da6e192f004e tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48" status: 200 len: 1682 microversion: 2.1 time: 0.199499 Oct 04 20:46:40.727520 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1417/2861] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:46:40 2022] GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48 => generated 1682 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:46:41.032230 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-619aae45-b435-43d4-ba28-fe2b887a0a7e tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:41.032826 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-619aae45-b435-43d4-ba28-fe2b887a0a7e tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] [instance: 815db889-a211-4eab-90f8-7ca46d7102a4] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:41.045477 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6484838b-7caa-4712-92fb-d201167723de tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:41.046135 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-6484838b-7caa-4712-92fb-d201167723de tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] [instance: 39e846c1-6876-42ef-b290-f733516e1051] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:41.055439 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6484838b-7caa-4712-92fb-d201167723de tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:41.057803 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-619aae45-b435-43d4-ba28-fe2b887a0a7e tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:41.058317 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6484838b-7caa-4712-92fb-d201167723de tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:41.058785 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6484838b-7caa-4712-92fb-d201167723de tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:41.059537 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6484838b-7caa-4712-92fb-d201167723de tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:41.059988 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6484838b-7caa-4712-92fb-d201167723de tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:41.060408 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6484838b-7caa-4712-92fb-d201167723de tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:41.063366 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-619aae45-b435-43d4-ba28-fe2b887a0a7e tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:41.066120 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-619aae45-b435-43d4-ba28-fe2b887a0a7e tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:41.070669 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-619aae45-b435-43d4-ba28-fe2b887a0a7e tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:41.071796 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-619aae45-b435-43d4-ba28-fe2b887a0a7e tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:41.072449 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-619aae45-b435-43d4-ba28-fe2b887a0a7e tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:41.389268 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-6484838b-7caa-4712-92fb-d201167723de tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12dc6570db03431187680f51349e55d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91111396aabd4306b66e14b5abd822ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:41.397607 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-6484838b-7caa-4712-92fb-d201167723de tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] 10.222.0.33 "GET /compute/v2.1/servers/39e846c1-6876-42ef-b290-f733516e1051" status: 200 len: 1521 microversion: 2.1 time: 0.355783 Oct 04 20:46:41.404512 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-619aae45-b435-43d4-ba28-fe2b887a0a7e tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aca59cd50bf74a36bb1e4427cd50fbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3fadcd7d4043daa0a6aba27ba814d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:41.413216 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-619aae45-b435-43d4-ba28-fe2b887a0a7e tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] 10.222.0.33 "GET /compute/v2.1/servers/815db889-a211-4eab-90f8-7ca46d7102a4" status: 200 len: 1498 microversion: 2.1 time: 0.385980 Oct 04 20:46:41.426751 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1418/2862] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:46:41 2022] GET /compute/v2.1/servers/39e846c1-6876-42ef-b290-f733516e1051 => generated 1521 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:46:41.435334 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1445/2863] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:46:41 2022] GET /compute/v2.1/servers/815db889-a211-4eab-90f8-7ca46d7102a4 => generated 1498 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:46:41.442278 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-ba049b8b-852e-443d-9cb3-96a06e546e8c tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Calling method '.version_select at 0x7f3c74f4dd30>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:41.442758 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-14766c03-0124-4311-8cd1-b595cbaaf11b tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:41.443715 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-14766c03-0124-4311-8cd1-b595cbaaf11b tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] [instance: 39d66e18-289f-4674-b66c-146d68ef9133] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:41.457284 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-14766c03-0124-4311-8cd1-b595cbaaf11b tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:41.457920 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-14766c03-0124-4311-8cd1-b595cbaaf11b tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:41.458527 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-14766c03-0124-4311-8cd1-b595cbaaf11b tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:41.471674 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-14766c03-0124-4311-8cd1-b595cbaaf11b tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:41.472548 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-14766c03-0124-4311-8cd1-b595cbaaf11b tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:41.476474 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-14766c03-0124-4311-8cd1-b595cbaaf11b tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:41.525124 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-ba049b8b-852e-443d-9cb3-96a06e546e8c tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] 10.222.0.33 "GET /compute/v2.1/images/0f050377-ae76-45a1-9386-5340e96ea493" status: 200 len: 1455 microversion: 2.1 time: 0.088588 Oct 04 20:46:41.527374 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1446/2864] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 20:46:41 2022] GET /compute/v2.1/images/0f050377-ae76-45a1-9386-5340e96ea493 => generated 1455 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:46:41.535087 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-13be1d23-f7e3-4313-a51d-b89de5adf142 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:41.543355 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-13be1d23-f7e3-4313-a51d-b89de5adf142 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] [instance: bdfb94ca-ded6-4af0-bd9f-59fc877c4c0a] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:41.552000 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-13be1d23-f7e3-4313-a51d-b89de5adf142 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:41.553626 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-13be1d23-f7e3-4313-a51d-b89de5adf142 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:41.554247 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-13be1d23-f7e3-4313-a51d-b89de5adf142 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:41.555531 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-13be1d23-f7e3-4313-a51d-b89de5adf142 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:41.558493 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-13be1d23-f7e3-4313-a51d-b89de5adf142 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:41.558945 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-13be1d23-f7e3-4313-a51d-b89de5adf142 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:41.613118 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-14766c03-0124-4311-8cd1-b595cbaaf11b tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:41.626394 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-14766c03-0124-4311-8cd1-b595cbaaf11b tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:41.626394 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-14766c03-0124-4311-8cd1-b595cbaaf11b tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:41.633528 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-14766c03-0124-4311-8cd1-b595cbaaf11b tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] 10.222.0.33 "GET /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133" status: 200 len: 1539 microversion: 2.91 time: 0.205299 Oct 04 20:46:41.647455 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1419/2865] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:46:41 2022] GET /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133 => generated 1539 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:46:41.737683 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-eea79229-7aad-4c82-891c-e7a732c9f0b6 req-fd5df77a-465c-4cf2-9c5d-ec01941eb6ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c703a086-cf9d-4d12-8a18-623e454bcb64", "tag": "be986445-0031-49e4-b37c-8a38b40174cd"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:46:41.749532 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-eea79229-7aad-4c82-891c-e7a732c9f0b6 req-fd5df77a-465c-4cf2-9c5d-ec01941eb6ee service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:41.750228 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-eea79229-7aad-4c82-891c-e7a732c9f0b6 req-fd5df77a-465c-4cf2-9c5d-ec01941eb6ee service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:41.750873 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-eea79229-7aad-4c82-891c-e7a732c9f0b6 req-fd5df77a-465c-4cf2-9c5d-ec01941eb6ee service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:41.764701 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-eea79229-7aad-4c82-891c-e7a732c9f0b6 req-fd5df77a-465c-4cf2-9c5d-ec01941eb6ee service nova] Creating event network-changed:be986445-0031-49e4-b37c-8a38b40174cd for instance c703a086-cf9d-4d12-8a18-623e454bcb64 on n-h1-854823-8 Oct 04 20:46:41.770279 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-eea79229-7aad-4c82-891c-e7a732c9f0b6 req-fd5df77a-465c-4cf2-9c5d-ec01941eb6ee service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036122 Oct 04 20:46:41.776393 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1420/2866] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:46:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 20:46:41.784345 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9424bdfa-ce29-40fa-8f12-e3dc76816293 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:41.785320 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-9424bdfa-ce29-40fa-8f12-e3dc76816293 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: 4d46fff2-b04d-41aa-ada0-2023ab545b48] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:41.793467 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9424bdfa-ce29-40fa-8f12-e3dc76816293 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:41.794354 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9424bdfa-ce29-40fa-8f12-e3dc76816293 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:41.794953 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9424bdfa-ce29-40fa-8f12-e3dc76816293 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:41.795849 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9424bdfa-ce29-40fa-8f12-e3dc76816293 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:41.796464 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9424bdfa-ce29-40fa-8f12-e3dc76816293 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:41.797045 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9424bdfa-ce29-40fa-8f12-e3dc76816293 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:41.824429 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-13be1d23-f7e3-4313-a51d-b89de5adf142 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87dcc7baf63f4ae6bfe0a099adffd408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7097bc12179446f6a3e1fac8434d5c64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:41.833251 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-13be1d23-f7e3-4313-a51d-b89de5adf142 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] 10.222.0.33 "GET /compute/v2.1/servers/bdfb94ca-ded6-4af0-bd9f-59fc877c4c0a" status: 200 len: 1495 microversion: 2.1 time: 0.304015 Oct 04 20:46:41.834196 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1447/2867] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:46:41 2022] GET /compute/v2.1/servers/bdfb94ca-ded6-4af0-bd9f-59fc877c4c0a => generated 1495 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:46:41.995070 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-8bfe589f-42d6-4dd1-961c-120e3a355f16 req-585d82ee-859e-4279-b21e-19bda4339a11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d46fff2-b04d-41aa-ada0-2023ab545b48", "name": "network-vif-plugged", "status": "completed", "tag": "39e1fcde-c40c-4b4b-8edd-7565faaf4580"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:46:42.027938 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-8bfe589f-42d6-4dd1-961c-120e3a355f16 req-585d82ee-859e-4279-b21e-19bda4339a11 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:42.028715 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-8bfe589f-42d6-4dd1-961c-120e3a355f16 req-585d82ee-859e-4279-b21e-19bda4339a11 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:42.029023 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-9424bdfa-ce29-40fa-8f12-e3dc76816293 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac650232cc04810b1340dc2f0edadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b0670d1bd99424780a70e69d57a2166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:42.029786 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-8bfe589f-42d6-4dd1-961c-120e3a355f16 req-585d82ee-859e-4279-b21e-19bda4339a11 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:42.041441 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-9424bdfa-ce29-40fa-8f12-e3dc76816293 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48" status: 200 len: 1682 microversion: 2.1 time: 0.263571 Oct 04 20:46:42.067227 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1421/2868] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:46:41 2022] GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48 => generated 1682 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:46:42.067858 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-8bfe589f-42d6-4dd1-961c-120e3a355f16 req-585d82ee-859e-4279-b21e-19bda4339a11 service nova] Creating event network-vif-plugged:39e1fcde-c40c-4b4b-8edd-7565faaf4580 for instance 4d46fff2-b04d-41aa-ada0-2023ab545b48 on n-h1-854823-8 Oct 04 20:46:42.078786 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-8bfe589f-42d6-4dd1-961c-120e3a355f16 req-585d82ee-859e-4279-b21e-19bda4339a11 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089912 Oct 04 20:46:42.079689 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1448/2869] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:46:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 20:46:42.441404 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a85087c3-0d17-439a-af57-0c51dce27845 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:42.446688 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a85087c3-0d17-439a-af57-0c51dce27845 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] [instance: 39e846c1-6876-42ef-b290-f733516e1051] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:42.457980 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a85087c3-0d17-439a-af57-0c51dce27845 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:42.459656 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a85087c3-0d17-439a-af57-0c51dce27845 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:42.460278 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a85087c3-0d17-439a-af57-0c51dce27845 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:42.461140 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a85087c3-0d17-439a-af57-0c51dce27845 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:42.462231 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a85087c3-0d17-439a-af57-0c51dce27845 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:42.462485 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-6bc299e1-29b4-443e-8cd0-168b26eeb2fb tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:42.463303 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-6bc299e1-29b4-443e-8cd0-168b26eeb2fb tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] [instance: 815db889-a211-4eab-90f8-7ca46d7102a4] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:42.464033 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a85087c3-0d17-439a-af57-0c51dce27845 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:42.479235 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6bc299e1-29b4-443e-8cd0-168b26eeb2fb tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:42.479879 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6bc299e1-29b4-443e-8cd0-168b26eeb2fb tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:42.480420 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6bc299e1-29b4-443e-8cd0-168b26eeb2fb tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:42.481235 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6bc299e1-29b4-443e-8cd0-168b26eeb2fb tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:42.481814 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6bc299e1-29b4-443e-8cd0-168b26eeb2fb tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:42.482363 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6bc299e1-29b4-443e-8cd0-168b26eeb2fb tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:42.521369 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:46:42.957660 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-6bc299e1-29b4-443e-8cd0-168b26eeb2fb tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aca59cd50bf74a36bb1e4427cd50fbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3fadcd7d4043daa0a6aba27ba814d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:42.970447 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-6bc299e1-29b4-443e-8cd0-168b26eeb2fb tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] 10.222.0.33 "GET /compute/v2.1/servers/815db889-a211-4eab-90f8-7ca46d7102a4" status: 200 len: 1498 microversion: 2.1 time: 0.512795 Oct 04 20:46:42.971037 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1449/2870] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:46:42 2022] GET /compute/v2.1/servers/815db889-a211-4eab-90f8-7ca46d7102a4 => generated 1498 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:46:42.976974 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-296c5141-48bd-41db-adbf-8d0994329323 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Calling method '.version_select at 0x7f3c74118160>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:42.998370 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-a85087c3-0d17-439a-af57-0c51dce27845 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12dc6570db03431187680f51349e55d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91111396aabd4306b66e14b5abd822ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:43.019822 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a85087c3-0d17-439a-af57-0c51dce27845 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] 10.222.0.33 "GET /compute/v2.1/servers/39e846c1-6876-42ef-b290-f733516e1051" status: 200 len: 1521 microversion: 2.1 time: 0.582780 Oct 04 20:46:43.042384 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1422/2871] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:46:42 2022] GET /compute/v2.1/servers/39e846c1-6876-42ef-b290-f733516e1051 => generated 1521 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:46:43.048395 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f03df589-8c43-4f1b-be21-f170157d20a3 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:43.049003 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f03df589-8c43-4f1b-be21-f170157d20a3 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] [instance: 39d66e18-289f-4674-b66c-146d68ef9133] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:43.062040 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f03df589-8c43-4f1b-be21-f170157d20a3 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:43.076805 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f03df589-8c43-4f1b-be21-f170157d20a3 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:43.078853 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f03df589-8c43-4f1b-be21-f170157d20a3 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:43.080380 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f03df589-8c43-4f1b-be21-f170157d20a3 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:43.083324 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f03df589-8c43-4f1b-be21-f170157d20a3 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:43.085335 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f03df589-8c43-4f1b-be21-f170157d20a3 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:43.187317 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f03df589-8c43-4f1b-be21-f170157d20a3 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:43.197522 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f03df589-8c43-4f1b-be21-f170157d20a3 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:43.199339 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f03df589-8c43-4f1b-be21-f170157d20a3 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:43.205229 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f03df589-8c43-4f1b-be21-f170157d20a3 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] 10.222.0.33 "GET /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133" status: 200 len: 1539 microversion: 2.91 time: 0.161740 Oct 04 20:46:43.206652 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1423/2872] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:46:43 2022] GET /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133 => generated 1539 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:46:43.212130 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-312c4f29-d620-43c0-b1d1-f87179d9be16 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:43.212729 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-312c4f29-d620-43c0-b1d1-f87179d9be16 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] [instance: bdfb94ca-ded6-4af0-bd9f-59fc877c4c0a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:43.218745 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-312c4f29-d620-43c0-b1d1-f87179d9be16 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:43.219236 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-312c4f29-d620-43c0-b1d1-f87179d9be16 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:43.219666 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-312c4f29-d620-43c0-b1d1-f87179d9be16 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:43.222685 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-312c4f29-d620-43c0-b1d1-f87179d9be16 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:43.223308 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-312c4f29-d620-43c0-b1d1-f87179d9be16 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:43.223906 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-312c4f29-d620-43c0-b1d1-f87179d9be16 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:43.276577 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-312c4f29-d620-43c0-b1d1-f87179d9be16 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:43.277277 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-312c4f29-d620-43c0-b1d1-f87179d9be16 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:43.277708 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-312c4f29-d620-43c0-b1d1-f87179d9be16 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:43.278154 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-312c4f29-d620-43c0-b1d1-f87179d9be16 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lazy-loading 'fault' on Instance uuid bdfb94ca-ded6-4af0-bd9f-59fc877c4c0a {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:46:43.386790 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-296c5141-48bd-41db-adbf-8d0994329323 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] 10.222.0.33 "GET /compute/v2.1/images/0f050377-ae76-45a1-9386-5340e96ea493" status: 200 len: 1455 microversion: 2.1 time: 0.414448 Oct 04 20:46:43.388283 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1450/2873] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 20:46:42 2022] GET /compute/v2.1/images/0f050377-ae76-45a1-9386-5340e96ea493 => generated 1455 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:46:43.405040 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-312c4f29-d620-43c0-b1d1-f87179d9be16 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87dcc7baf63f4ae6bfe0a099adffd408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7097bc12179446f6a3e1fac8434d5c64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:43.416143 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-312c4f29-d620-43c0-b1d1-f87179d9be16 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] 10.222.0.33 "GET /compute/v2.1/servers/bdfb94ca-ded6-4af0-bd9f-59fc877c4c0a" status: 200 len: 1298 microversion: 2.1 time: 0.208120 Oct 04 20:46:43.417659 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-f9975a2d-d76f-4480-ab94-3aafd64f0a54 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:43.418761 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-f9975a2d-d76f-4480-ab94-3aafd64f0a54 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: 4d46fff2-b04d-41aa-ada0-2023ab545b48] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:43.431666 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1424/2874] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:46:43 2022] GET /compute/v2.1/servers/bdfb94ca-ded6-4af0-bd9f-59fc877c4c0a => generated 1298 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:46:43.451097 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f9975a2d-d76f-4480-ab94-3aafd64f0a54 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:43.451910 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f9975a2d-d76f-4480-ab94-3aafd64f0a54 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:43.452739 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f9975a2d-d76f-4480-ab94-3aafd64f0a54 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:43.453778 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f9975a2d-d76f-4480-ab94-3aafd64f0a54 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:43.454667 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f9975a2d-d76f-4480-ab94-3aafd64f0a54 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:43.455512 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f9975a2d-d76f-4480-ab94-3aafd64f0a54 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:43.656213 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-f9975a2d-d76f-4480-ab94-3aafd64f0a54 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac650232cc04810b1340dc2f0edadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b0670d1bd99424780a70e69d57a2166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:43.668972 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-f9975a2d-d76f-4480-ab94-3aafd64f0a54 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48" status: 200 len: 1682 microversion: 2.1 time: 0.279006 Oct 04 20:46:43.669670 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1451/2875] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:46:43 2022] GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48 => generated 1682 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:46:43.796407 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-5578d9d3-6a7a-4144-9c7e-3ebc2c4ec5f0 req-8165eea6-1f7b-4174-a06d-a31a587b332d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bdfb94ca-ded6-4af0-bd9f-59fc877c4c0a", "name": "network-vif-deleted", "tag": "2f68ae5c-502d-4266-a29b-038838a4abd1"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:46:43.813525 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-5578d9d3-6a7a-4144-9c7e-3ebc2c4ec5f0 req-8165eea6-1f7b-4174-a06d-a31a587b332d service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:43.814767 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-5578d9d3-6a7a-4144-9c7e-3ebc2c4ec5f0 req-8165eea6-1f7b-4174-a06d-a31a587b332d service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:43.815717 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-5578d9d3-6a7a-4144-9c7e-3ebc2c4ec5f0 req-8165eea6-1f7b-4174-a06d-a31a587b332d service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:43.831686 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-5578d9d3-6a7a-4144-9c7e-3ebc2c4ec5f0 req-8165eea6-1f7b-4174-a06d-a31a587b332d service nova] Creating event network-vif-deleted:2f68ae5c-502d-4266-a29b-038838a4abd1 for instance bdfb94ca-ded6-4af0-bd9f-59fc877c4c0a on n-h1-854823-8 Oct 04 20:46:43.840877 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-5578d9d3-6a7a-4144-9c7e-3ebc2c4ec5f0 req-8165eea6-1f7b-4174-a06d-a31a587b332d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054668 Oct 04 20:46:43.845900 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1425/2876] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:46:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:46:43.996425 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-8840c5ed-9c97-42b2-aa60-6791e29b7b35 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:43.996976 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-8840c5ed-9c97-42b2-aa60-6791e29b7b35 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] [instance: 815db889-a211-4eab-90f8-7ca46d7102a4] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:44.008403 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8840c5ed-9c97-42b2-aa60-6791e29b7b35 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:44.008907 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8840c5ed-9c97-42b2-aa60-6791e29b7b35 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:44.016381 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8840c5ed-9c97-42b2-aa60-6791e29b7b35 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:44.017543 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8840c5ed-9c97-42b2-aa60-6791e29b7b35 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:44.018055 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8840c5ed-9c97-42b2-aa60-6791e29b7b35 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:44.021170 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8840c5ed-9c97-42b2-aa60-6791e29b7b35 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:44.053791 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e00f4f6e-d144-4900-9525-efbb4a40b585 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:44.055688 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e00f4f6e-d144-4900-9525-efbb4a40b585 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] [instance: 39e846c1-6876-42ef-b290-f733516e1051] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:44.071862 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e00f4f6e-d144-4900-9525-efbb4a40b585 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:44.072618 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e00f4f6e-d144-4900-9525-efbb4a40b585 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:44.073251 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e00f4f6e-d144-4900-9525-efbb4a40b585 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:44.074143 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e00f4f6e-d144-4900-9525-efbb4a40b585 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:44.074814 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e00f4f6e-d144-4900-9525-efbb4a40b585 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:44.075420 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e00f4f6e-d144-4900-9525-efbb4a40b585 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:44.310176 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-8840c5ed-9c97-42b2-aa60-6791e29b7b35 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aca59cd50bf74a36bb1e4427cd50fbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3fadcd7d4043daa0a6aba27ba814d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:44.320176 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-8840c5ed-9c97-42b2-aa60-6791e29b7b35 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] 10.222.0.33 "GET /compute/v2.1/servers/815db889-a211-4eab-90f8-7ca46d7102a4" status: 200 len: 1498 microversion: 2.1 time: 0.328585 Oct 04 20:46:44.326668 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1452/2877] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:46:43 2022] GET /compute/v2.1/servers/815db889-a211-4eab-90f8-7ca46d7102a4 => generated 1498 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:46:44.332941 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-1d4bfa66-69d3-47ee-8e2c-94584fa97709 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:44.333895 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-1d4bfa66-69d3-47ee-8e2c-94584fa97709 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] [instance: 39d66e18-289f-4674-b66c-146d68ef9133] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:44.340718 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1d4bfa66-69d3-47ee-8e2c-94584fa97709 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:44.341528 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1d4bfa66-69d3-47ee-8e2c-94584fa97709 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:44.342193 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1d4bfa66-69d3-47ee-8e2c-94584fa97709 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:44.353865 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e00f4f6e-d144-4900-9525-efbb4a40b585 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12dc6570db03431187680f51349e55d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91111396aabd4306b66e14b5abd822ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:44.362846 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e00f4f6e-d144-4900-9525-efbb4a40b585 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] 10.222.0.33 "GET /compute/v2.1/servers/39e846c1-6876-42ef-b290-f733516e1051" status: 200 len: 1521 microversion: 2.1 time: 0.319345 Oct 04 20:46:44.367639 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1d4bfa66-69d3-47ee-8e2c-94584fa97709 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:44.368460 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1d4bfa66-69d3-47ee-8e2c-94584fa97709 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:44.368960 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1426/2878] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:46:44 2022] GET /compute/v2.1/servers/39e846c1-6876-42ef-b290-f733516e1051 => generated 1521 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:46:44.369643 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1d4bfa66-69d3-47ee-8e2c-94584fa97709 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:44.404157 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-db57f682-93a5-47f6-ab64-17c314170ad1 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Calling method '.version_select at 0x7f3c7431f8b0>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:44.475673 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-1d4bfa66-69d3-47ee-8e2c-94584fa97709 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:44.509249 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-1d4bfa66-69d3-47ee-8e2c-94584fa97709 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:44.515818 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-1d4bfa66-69d3-47ee-8e2c-94584fa97709 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:44.535682 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-1d4bfa66-69d3-47ee-8e2c-94584fa97709 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] 10.222.0.33 "GET /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133" status: 200 len: 1539 microversion: 2.91 time: 0.207476 Oct 04 20:46:44.551266 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1453/2879] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:46:44 2022] GET /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133 => generated 1539 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:46:44.577725 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-7b2f1e82-c7b5-45d3-a77a-23dd6047721d tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:44.578655 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-7b2f1e82-c7b5-45d3-a77a-23dd6047721d tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] [instance: bdfb94ca-ded6-4af0-bd9f-59fc877c4c0a] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:44.587105 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7b2f1e82-c7b5-45d3-a77a-23dd6047721d tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:44.588011 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7b2f1e82-c7b5-45d3-a77a-23dd6047721d tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:44.588671 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7b2f1e82-c7b5-45d3-a77a-23dd6047721d tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:44.589622 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7b2f1e82-c7b5-45d3-a77a-23dd6047721d tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:44.590324 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7b2f1e82-c7b5-45d3-a77a-23dd6047721d tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:44.590988 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7b2f1e82-c7b5-45d3-a77a-23dd6047721d tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:44.607281 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.wsgi [None req-7b2f1e82-c7b5-45d3-a77a-23dd6047721d tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] HTTP exception thrown: Instance bdfb94ca-ded6-4af0-bd9f-59fc877c4c0a could not be found. Oct 04 20:46:44.609571 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-7b2f1e82-c7b5-45d3-a77a-23dd6047721d tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Request method failure captured: Oct 04 20:46:44.609571 n-d-854823-8 devstack@n-api.service[128802]: request: GET /compute/v2.1/servers/bdfb94ca-ded6-4af0-bd9f-59fc877c4c0a HTTP/1.1 Oct 04 20:46:44.609571 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 20:46:44.609571 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 20:46:44.609571 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 20:46:44.609571 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 0 Oct 04 20:46:44.609571 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 20:46:44.609571 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 20:46:44.609571 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 20:46:44.609571 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 20:46:44.609571 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPJsSwF2ySar2LJQGdSe43g0QAYtjP4_BPyLRwM7Cr4_8Oz_X-RTScy1BL0ogt-qe3YNvQGTaYbVbGoUGx7pHqiHpbZftU7_TcvDA_zpgTfxGGH91CR74RG6crXL2bxRs87dSvsLYuOWMw7_AQjTpWetc1HBlb5th2rD-ko2SN3gLGSA Oct 04 20:46:44.609571 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 20:46:44.609571 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 20:46:44.609571 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 20:46:44.609571 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 20:46:44.609571 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 20:46:44.609571 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 20:46:44.609571 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: 7097bc12179446f6a3e1fac8434d5c64 Oct 04 20:46:44.609571 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-ServersTestJSON-927611194 Oct 04 20:46:44.609571 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 20:46:44.609571 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 20:46:44.609571 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_7097bc12179446f6a3e1fac8434d5c64", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7097bc12179446f6a3e1fac8434d5c64"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7097bc12179446f6a3e1fac8434d5c64"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/7097bc12179446f6a3e1fac8434d5c64"}]}] Oct 04 20:46:44.609571 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-ServersTestJSON-927611194 Oct 04 20:46:44.609571 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: 7097bc12179446f6a3e1fac8434d5c64 Oct 04 20:46:44.609571 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-ServersTestJSON-927611194 Oct 04 20:46:44.609571 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-ServersTestJSON-927611194-project Oct 04 20:46:44.609571 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 20:46:44.609571 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 20:46:44.609571 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: 87dcc7baf63f4ae6bfe0a099adffd408 Oct 04 20:46:44.609571 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-ServersTestJSON-927611194-project Oct 04 20:46:44.609571 n-d-854823-8 devstack@n-api.service[128802]: method: > Oct 04 20:46:44.609571 n-d-854823-8 devstack@n-api.service[128802]: exception: Instance bdfb94ca-ded6-4af0-bd9f-59fc877c4c0a could not be found. Oct 04 20:46:44.609571 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'id': 'bdfb94ca-ded6-4af0-bd9f-59fc877c4c0a'} Oct 04 20:46:44.609571 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:46:44.609571 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:46:44.609571 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:46:44.609571 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:46:44.609571 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:46:44.609571 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:46:44.609571 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:46:44.609571 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:46:44.609571 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:46:44.609571 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:46:44.609571 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bdfb94ca-ded6-4af0-bd9f-59fc877c4c0a could not be found. Oct 04 20:46:44.609571 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:46:44.609571 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:46:44.609571 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:46:44.609571 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:46:44.609571 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:46:44.609571 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:46:44.609571 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:46:44.609571 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:46:44.609571 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:46:44.609571 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:46:44.609571 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:46:44.609571 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:46:44.609571 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:46:44.609571 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:46:44.609571 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:46:44.609571 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:46:44.609571 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bdfb94ca-ded6-4af0-bd9f-59fc877c4c0a could not be found. Oct 04 20:46:44.609571 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:46:44.609571 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:46:44.609571 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:46:44.609571 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:46:44.613567 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:46:44.613567 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:46:44.613567 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:46:44.613567 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:46:44.613567 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bdfb94ca-ded6-4af0-bd9f-59fc877c4c0a could not be found. Oct 04 20:46:44.613567 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:46:44.616164 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-7b2f1e82-c7b5-45d3-a77a-23dd6047721d tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Returning 404 to user: Instance bdfb94ca-ded6-4af0-bd9f-59fc877c4c0a could not be found. {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:46:44.617484 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-7b2f1e82-c7b5-45d3-a77a-23dd6047721d tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] 10.222.0.33 "GET /compute/v2.1/servers/bdfb94ca-ded6-4af0-bd9f-59fc877c4c0a" status: 404 len: 111 microversion: 2.1 time: 0.064702 Oct 04 20:46:44.622046 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1454/2880] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:46:44 2022] GET /compute/v2.1/servers/bdfb94ca-ded6-4af0-bd9f-59fc877c4c0a => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:46:44.637779 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-583b8334-8003-4d22-8dad-7b10d18cd4b0 req-1e49663a-56c1-4c23-b233-56d5d9129b53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "291474d2-a375-4974-abec-713900c08119", "name": "network-vif-plugged", "status": "completed", "tag": "744df6f8-0df8-4ff2-b842-56de1314bff3"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:46:44.651571 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-583b8334-8003-4d22-8dad-7b10d18cd4b0 req-1e49663a-56c1-4c23-b233-56d5d9129b53 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:44.652632 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-583b8334-8003-4d22-8dad-7b10d18cd4b0 req-1e49663a-56c1-4c23-b233-56d5d9129b53 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:44.653526 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-583b8334-8003-4d22-8dad-7b10d18cd4b0 req-1e49663a-56c1-4c23-b233-56d5d9129b53 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:44.669195 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-583b8334-8003-4d22-8dad-7b10d18cd4b0 req-1e49663a-56c1-4c23-b233-56d5d9129b53 service nova] Creating event network-vif-plugged:744df6f8-0df8-4ff2-b842-56de1314bff3 for instance 291474d2-a375-4974-abec-713900c08119 on n-h1-854823-8 Oct 04 20:46:44.677162 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-583b8334-8003-4d22-8dad-7b10d18cd4b0 req-1e49663a-56c1-4c23-b233-56d5d9129b53 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044589 Oct 04 20:46:44.681449 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1455/2881] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:46:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:46:44.715817 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-05e0ca84-2db3-4276-98ce-590a72fded42 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:44.716942 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-05e0ca84-2db3-4276-98ce-590a72fded42 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: 4d46fff2-b04d-41aa-ada0-2023ab545b48] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:44.724559 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-05e0ca84-2db3-4276-98ce-590a72fded42 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:44.725414 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-05e0ca84-2db3-4276-98ce-590a72fded42 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:44.726091 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-05e0ca84-2db3-4276-98ce-590a72fded42 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:44.727315 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-05e0ca84-2db3-4276-98ce-590a72fded42 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:44.728730 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-05e0ca84-2db3-4276-98ce-590a72fded42 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:44.729387 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-05e0ca84-2db3-4276-98ce-590a72fded42 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:44.950611 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-05e0ca84-2db3-4276-98ce-590a72fded42 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac650232cc04810b1340dc2f0edadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b0670d1bd99424780a70e69d57a2166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:44.968772 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-05e0ca84-2db3-4276-98ce-590a72fded42 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48" status: 200 len: 1682 microversion: 2.1 time: 0.273726 Oct 04 20:46:44.970034 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1456/2882] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:46:44 2022] GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48 => generated 1682 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:46:44.976786 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-d637024a-21cc-4994-b19d-5ed2afc389cf tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1956601304", "imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63", "flavorRef": "452", "networks": [{"uuid": "a32beee4-b00b-48d9-8656-e7b824aeffce"}]}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:46:46.659906 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=6 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:46:46.962940 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell0:SELECT=2 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:46:47.507741 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell0:SELECT=4 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:46:48.290389 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=16 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:46:53.056248 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.network.neutron [None req-d637024a-21cc-4994-b19d-5ed2afc389cf tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] validate_networks() for [('a32beee4-b00b-48d9-8656-e7b824aeffce', None, None, None, None, None)] {{(pid=128802) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:46:53.060452 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-db57f682-93a5-47f6-ab64-17c314170ad1 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] 10.222.0.33 "GET /compute/v2.1/images/0f050377-ae76-45a1-9386-5340e96ea493" status: 200 len: 1455 microversion: 2.1 time: 8.660810 Oct 04 20:46:53.065360 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1427/2883] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 20:46:44 2022] GET /compute/v2.1/images/0f050377-ae76-45a1-9386-5340e96ea493 => generated 1455 bytes in 8667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:46:53.091591 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-471ec18d-3d49-46d8-a682-c6ffbd2166d3 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:53.092518 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-471ec18d-3d49-46d8-a682-c6ffbd2166d3 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] [instance: 815db889-a211-4eab-90f8-7ca46d7102a4] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:53.106393 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-471ec18d-3d49-46d8-a682-c6ffbd2166d3 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:53.107047 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-471ec18d-3d49-46d8-a682-c6ffbd2166d3 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:53.107588 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-471ec18d-3d49-46d8-a682-c6ffbd2166d3 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:53.108387 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-471ec18d-3d49-46d8-a682-c6ffbd2166d3 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:53.109083 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-471ec18d-3d49-46d8-a682-c6ffbd2166d3 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:53.109721 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-471ec18d-3d49-46d8-a682-c6ffbd2166d3 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:53.419032 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-471ec18d-3d49-46d8-a682-c6ffbd2166d3 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aca59cd50bf74a36bb1e4427cd50fbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3fadcd7d4043daa0a6aba27ba814d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:53.428666 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-471ec18d-3d49-46d8-a682-c6ffbd2166d3 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] 10.222.0.33 "GET /compute/v2.1/servers/815db889-a211-4eab-90f8-7ca46d7102a4" status: 200 len: 1498 microversion: 2.1 time: 0.349628 Oct 04 20:46:53.429250 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1428/2884] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:46:53 2022] GET /compute/v2.1/servers/815db889-a211-4eab-90f8-7ca46d7102a4 => generated 1498 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:46:53.434077 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f9d1a7ca-9c6f-4ca9-aa38-65b5704d7458 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:53.434731 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f9d1a7ca-9c6f-4ca9-aa38-65b5704d7458 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] [instance: 39e846c1-6876-42ef-b290-f733516e1051] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:53.445419 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f9d1a7ca-9c6f-4ca9-aa38-65b5704d7458 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:53.445905 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f9d1a7ca-9c6f-4ca9-aa38-65b5704d7458 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:53.446213 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f9d1a7ca-9c6f-4ca9-aa38-65b5704d7458 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:53.446947 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f9d1a7ca-9c6f-4ca9-aa38-65b5704d7458 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:53.461077 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f9d1a7ca-9c6f-4ca9-aa38-65b5704d7458 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:53.461740 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f9d1a7ca-9c6f-4ca9-aa38-65b5704d7458 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:53.702151 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-d637024a-21cc-4994-b19d-5ed2afc389cf tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Flavor limits 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:46:53.702754 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-d637024a-21cc-4994-b19d-5ed2afc389cf tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Image limits 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:46:53.703257 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-d637024a-21cc-4994-b19d-5ed2afc389cf tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Flavor pref 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:46:53.703654 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-d637024a-21cc-4994-b19d-5ed2afc389cf tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Image pref 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:46:53.704077 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-d637024a-21cc-4994-b19d-5ed2afc389cf tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:46:53.719374 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d637024a-21cc-4994-b19d-5ed2afc389cf tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:53.719864 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d637024a-21cc-4994-b19d-5ed2afc389cf tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:53.720305 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d637024a-21cc-4994-b19d-5ed2afc389cf tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:53.721036 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d637024a-21cc-4994-b19d-5ed2afc389cf tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:53.721417 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f9d1a7ca-9c6f-4ca9-aa38-65b5704d7458 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12dc6570db03431187680f51349e55d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91111396aabd4306b66e14b5abd822ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:53.721546 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d637024a-21cc-4994-b19d-5ed2afc389cf tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:53.721905 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d637024a-21cc-4994-b19d-5ed2afc389cf tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:53.725118 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:46:53.733371 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f9d1a7ca-9c6f-4ca9-aa38-65b5704d7458 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] 10.222.0.33 "GET /compute/v2.1/servers/39e846c1-6876-42ef-b290-f733516e1051" status: 200 len: 1521 microversion: 2.1 time: 0.302921 Oct 04 20:46:53.734137 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1429/2885] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:46:53 2022] GET /compute/v2.1/servers/39e846c1-6876-42ef-b290-f733516e1051 => generated 1521 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:46:53.739541 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c011ed5f-cd80-433a-abf9-ce0ea435e58e tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:53.740668 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c011ed5f-cd80-433a-abf9-ce0ea435e58e tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] [instance: 39d66e18-289f-4674-b66c-146d68ef9133] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:53.750832 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-d637024a-21cc-4994-b19d-5ed2afc389cf tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Getting quotas for project 7097bc12179446f6a3e1fac8434d5c64. Resources: {'ram', 'instances', 'cores'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:46:53.751670 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c011ed5f-cd80-433a-abf9-ce0ea435e58e tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:53.752392 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c011ed5f-cd80-433a-abf9-ce0ea435e58e tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:53.753063 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c011ed5f-cd80-433a-abf9-ce0ea435e58e tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:53.754218 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c011ed5f-cd80-433a-abf9-ce0ea435e58e tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:53.756882 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c011ed5f-cd80-433a-abf9-ce0ea435e58e tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:53.757661 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c011ed5f-cd80-433a-abf9-ce0ea435e58e tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:53.760218 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-d637024a-21cc-4994-b19d-5ed2afc389cf tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Getting quotas for user 87dcc7baf63f4ae6bfe0a099adffd408 and project 7097bc12179446f6a3e1fac8434d5c64. Resources: {'ram', 'instances', 'cores'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:46:53.770033 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_api:SELECT=100 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:46:53.780721 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-d637024a-21cc-4994-b19d-5ed2afc389cf tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Going to run 1 instances... {{(pid=128802) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:46:53.783111 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-d637024a-21cc-4994-b19d-5ed2afc389cf tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] [instance: 32237627-3fea-48d4-959f-3a2aa519adf3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='15b24725-0c99-4bcf-b1fb-907cdf8e2d63',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128802) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:46:53.849597 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-d637024a-21cc-4994-b19d-5ed2afc389cf tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 8.877034 Oct 04 20:46:53.851523 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c011ed5f-cd80-433a-abf9-ce0ea435e58e tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:53.857680 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1457/2886] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 20:46:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 8887 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 20:46:53.865139 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c011ed5f-cd80-433a-abf9-ce0ea435e58e tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:53.866625 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c011ed5f-cd80-433a-abf9-ce0ea435e58e tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:53.868820 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-02b8c7f5-6dd3-47a7-bf28-f288cb3ff492 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:53.870104 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-02b8c7f5-6dd3-47a7-bf28-f288cb3ff492 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: 4d46fff2-b04d-41aa-ada0-2023ab545b48] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:53.886192 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c011ed5f-cd80-433a-abf9-ce0ea435e58e tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] 10.222.0.33 "GET /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133" status: 200 len: 1539 microversion: 2.91 time: 0.150704 Oct 04 20:46:53.887019 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1430/2887] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:46:53 2022] GET /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133 => generated 1539 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:46:53.902787 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-02b8c7f5-6dd3-47a7-bf28-f288cb3ff492 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:53.903674 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-02b8c7f5-6dd3-47a7-bf28-f288cb3ff492 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:53.904335 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-02b8c7f5-6dd3-47a7-bf28-f288cb3ff492 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:53.905251 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-02b8c7f5-6dd3-47a7-bf28-f288cb3ff492 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:53.906489 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-02b8c7f5-6dd3-47a7-bf28-f288cb3ff492 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:53.907164 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-02b8c7f5-6dd3-47a7-bf28-f288cb3ff492 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:53.913661 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d606572e-c738-403f-a37c-43cfbae89b73 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:53.914285 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d606572e-c738-403f-a37c-43cfbae89b73 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] [instance: 32237627-3fea-48d4-959f-3a2aa519adf3] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:54.062063 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d606572e-c738-403f-a37c-43cfbae89b73 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87dcc7baf63f4ae6bfe0a099adffd408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7097bc12179446f6a3e1fac8434d5c64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:54.074858 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d606572e-c738-403f-a37c-43cfbae89b73 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] 10.222.0.33 "GET /compute/v2.1/servers/32237627-3fea-48d4-959f-3a2aa519adf3" status: 200 len: 1209 microversion: 2.1 time: 0.170072 Oct 04 20:46:54.075496 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1431/2888] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:46:53 2022] GET /compute/v2.1/servers/32237627-3fea-48d4-959f-3a2aa519adf3 => generated 1209 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:46:54.080872 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-efd56c7f-b33f-438e-9c11-4741e7226f20 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Calling method '.version_select at 0x7f3c7431f1f0>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:54.167192 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-02b8c7f5-6dd3-47a7-bf28-f288cb3ff492 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac650232cc04810b1340dc2f0edadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b0670d1bd99424780a70e69d57a2166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:54.176913 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-02b8c7f5-6dd3-47a7-bf28-f288cb3ff492 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48" status: 200 len: 1669 microversion: 2.1 time: 0.313798 Oct 04 20:46:54.180457 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1458/2889] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:46:53 2022] GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48 => generated 1669 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:46:54.359413 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-efd56c7f-b33f-438e-9c11-4741e7226f20 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] 10.222.0.33 "GET /compute/v2.1/images/0f050377-ae76-45a1-9386-5340e96ea493" status: 200 len: 1455 microversion: 2.1 time: 0.282132 Oct 04 20:46:54.360794 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1432/2890] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 20:46:54 2022] GET /compute/v2.1/images/0f050377-ae76-45a1-9386-5340e96ea493 => generated 1455 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:46:54.441159 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-8b633973-8550-446a-87c0-6be7bc3fc000 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:54.441776 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-8b633973-8550-446a-87c0-6be7bc3fc000 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: 4d46fff2-b04d-41aa-ada0-2023ab545b48] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:54.454077 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-aad28396-70f3-44ab-ad62-23c63572e78d tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:54.454740 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-aad28396-70f3-44ab-ad62-23c63572e78d tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] [instance: 815db889-a211-4eab-90f8-7ca46d7102a4] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:54.460698 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8b633973-8550-446a-87c0-6be7bc3fc000 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:54.461424 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8b633973-8550-446a-87c0-6be7bc3fc000 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:54.461424 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8b633973-8550-446a-87c0-6be7bc3fc000 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:54.462272 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8b633973-8550-446a-87c0-6be7bc3fc000 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:54.462989 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8b633973-8550-446a-87c0-6be7bc3fc000 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:54.463313 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8b633973-8550-446a-87c0-6be7bc3fc000 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:54.468067 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-aad28396-70f3-44ab-ad62-23c63572e78d tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:54.468589 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-aad28396-70f3-44ab-ad62-23c63572e78d tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:54.469039 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-aad28396-70f3-44ab-ad62-23c63572e78d tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:54.469788 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-aad28396-70f3-44ab-ad62-23c63572e78d tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:54.470240 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-aad28396-70f3-44ab-ad62-23c63572e78d tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:54.470695 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-aad28396-70f3-44ab-ad62-23c63572e78d tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:54.681862 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-aad28396-70f3-44ab-ad62-23c63572e78d tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aca59cd50bf74a36bb1e4427cd50fbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3fadcd7d4043daa0a6aba27ba814d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:54.685217 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-8b633973-8550-446a-87c0-6be7bc3fc000 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac650232cc04810b1340dc2f0edadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b0670d1bd99424780a70e69d57a2166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:54.691953 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-aad28396-70f3-44ab-ad62-23c63572e78d tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] 10.222.0.33 "GET /compute/v2.1/servers/815db889-a211-4eab-90f8-7ca46d7102a4" status: 200 len: 1498 microversion: 2.1 time: 0.242620 Oct 04 20:46:54.692566 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1433/2891] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:46:54 2022] GET /compute/v2.1/servers/815db889-a211-4eab-90f8-7ca46d7102a4 => generated 1498 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:46:54.694545 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-8b633973-8550-446a-87c0-6be7bc3fc000 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48" status: 200 len: 1669 microversion: 2.1 time: 0.257340 Oct 04 20:46:54.695118 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1459/2892] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:46:54 2022] GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48 => generated 1669 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:46:54.759106 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5ec068b8-febc-4459-bccf-f7d6172fc15b tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:54.759834 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-5ec068b8-febc-4459-bccf-f7d6172fc15b tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] [instance: 39e846c1-6876-42ef-b290-f733516e1051] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:54.766004 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5ec068b8-febc-4459-bccf-f7d6172fc15b tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:54.766541 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5ec068b8-febc-4459-bccf-f7d6172fc15b tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:54.766982 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5ec068b8-febc-4459-bccf-f7d6172fc15b tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:54.767680 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5ec068b8-febc-4459-bccf-f7d6172fc15b tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:54.768137 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5ec068b8-febc-4459-bccf-f7d6172fc15b tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:54.768561 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5ec068b8-febc-4459-bccf-f7d6172fc15b tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:54.918588 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-89185118-7ff1-4a54-98fa-6bbd616c0f01 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:54.919514 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-89185118-7ff1-4a54-98fa-6bbd616c0f01 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] [instance: 39d66e18-289f-4674-b66c-146d68ef9133] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:54.928006 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-89185118-7ff1-4a54-98fa-6bbd616c0f01 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:54.928867 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-89185118-7ff1-4a54-98fa-6bbd616c0f01 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:54.929975 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-89185118-7ff1-4a54-98fa-6bbd616c0f01 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:54.935008 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-5ec068b8-febc-4459-bccf-f7d6172fc15b tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12dc6570db03431187680f51349e55d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91111396aabd4306b66e14b5abd822ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:54.935153 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-89185118-7ff1-4a54-98fa-6bbd616c0f01 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:54.935504 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-89185118-7ff1-4a54-98fa-6bbd616c0f01 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:54.936137 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-89185118-7ff1-4a54-98fa-6bbd616c0f01 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:54.944737 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5ec068b8-febc-4459-bccf-f7d6172fc15b tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] 10.222.0.33 "GET /compute/v2.1/servers/39e846c1-6876-42ef-b290-f733516e1051" status: 200 len: 1521 microversion: 2.1 time: 0.190405 Oct 04 20:46:54.945771 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1434/2893] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:46:54 2022] GET /compute/v2.1/servers/39e846c1-6876-42ef-b290-f733516e1051 => generated 1521 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:46:55.012677 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-89185118-7ff1-4a54-98fa-6bbd616c0f01 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:55.021640 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-89185118-7ff1-4a54-98fa-6bbd616c0f01 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:55.023135 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-89185118-7ff1-4a54-98fa-6bbd616c0f01 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:55.030413 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-89185118-7ff1-4a54-98fa-6bbd616c0f01 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] 10.222.0.33 "GET /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133" status: 200 len: 1539 microversion: 2.91 time: 0.116188 Oct 04 20:46:55.040482 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1460/2894] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:46:54 2022] GET /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133 => generated 1539 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:46:55.103204 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c9339313-8764-4cd3-9955-899e6ad64ac9 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:55.103904 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c9339313-8764-4cd3-9955-899e6ad64ac9 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] [instance: 32237627-3fea-48d4-959f-3a2aa519adf3] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:55.118664 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c9339313-8764-4cd3-9955-899e6ad64ac9 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:55.119182 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c9339313-8764-4cd3-9955-899e6ad64ac9 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:55.119592 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c9339313-8764-4cd3-9955-899e6ad64ac9 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:55.120366 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c9339313-8764-4cd3-9955-899e6ad64ac9 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:55.120742 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c9339313-8764-4cd3-9955-899e6ad64ac9 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:55.121196 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c9339313-8764-4cd3-9955-899e6ad64ac9 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:55.201087 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c9339313-8764-4cd3-9955-899e6ad64ac9 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87dcc7baf63f4ae6bfe0a099adffd408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7097bc12179446f6a3e1fac8434d5c64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:55.210756 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c9339313-8764-4cd3-9955-899e6ad64ac9 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] 10.222.0.33 "GET /compute/v2.1/servers/32237627-3fea-48d4-959f-3a2aa519adf3" status: 200 len: 1261 microversion: 2.1 time: 0.111991 Oct 04 20:46:55.211500 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1435/2895] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:46:55 2022] GET /compute/v2.1/servers/32237627-3fea-48d4-959f-3a2aa519adf3 => generated 1261 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:46:55.377462 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-1d2347f2-3681-45c2-af35-f58e094438db tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Calling method '.version_select at 0x7f3c74198d30>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:55.424854 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-1d2347f2-3681-45c2-af35-f58e094438db tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] 10.222.0.33 "GET /compute/v2.1/images/0f050377-ae76-45a1-9386-5340e96ea493" status: 200 len: 1464 microversion: 2.1 time: 0.052475 Oct 04 20:46:55.425425 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1461/2896] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 20:46:55 2022] GET /compute/v2.1/images/0f050377-ae76-45a1-9386-5340e96ea493 => generated 1464 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:46:55.439200 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e1469b00-0cc9-4c11-94ea-d4b1af05c782 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Calling method '.version_select at 0x7f3c7517a670>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:55.484624 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e1469b00-0cc9-4c11-94ea-d4b1af05c782 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] 10.222.0.33 "GET /compute/v2.1/images/0f050377-ae76-45a1-9386-5340e96ea493" status: 200 len: 1464 microversion: 2.1 time: 0.049140 Oct 04 20:46:55.485200 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1436/2897] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 20:46:55 2022] GET /compute/v2.1/images/0f050377-ae76-45a1-9386-5340e96ea493 => generated 1464 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:46:55.500768 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-420cc35a-1a85-4958-aca7-a1cf83922cdf tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:55.501376 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-420cc35a-1a85-4958-aca7-a1cf83922cdf tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] [instance: 291474d2-a375-4974-abec-713900c08119] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:55.508940 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-420cc35a-1a85-4958-aca7-a1cf83922cdf tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:55.509576 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-420cc35a-1a85-4958-aca7-a1cf83922cdf tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:55.510068 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-420cc35a-1a85-4958-aca7-a1cf83922cdf tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:55.510784 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-420cc35a-1a85-4958-aca7-a1cf83922cdf tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:55.511232 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-420cc35a-1a85-4958-aca7-a1cf83922cdf tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:55.511649 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-420cc35a-1a85-4958-aca7-a1cf83922cdf tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:55.604300 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-cafc7452-e2dc-427d-97a4-eed882338a44 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:55.604922 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-cafc7452-e2dc-427d-97a4-eed882338a44 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: 4d46fff2-b04d-41aa-ada0-2023ab545b48] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:55.611184 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cafc7452-e2dc-427d-97a4-eed882338a44 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:55.612032 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cafc7452-e2dc-427d-97a4-eed882338a44 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:55.612469 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cafc7452-e2dc-427d-97a4-eed882338a44 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:55.613164 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cafc7452-e2dc-427d-97a4-eed882338a44 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:55.613614 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cafc7452-e2dc-427d-97a4-eed882338a44 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:55.614032 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cafc7452-e2dc-427d-97a4-eed882338a44 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:55.672263 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-420cc35a-1a85-4958-aca7-a1cf83922cdf tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0967736982942f0b62db2e0546666cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f86a1d45a94f41bcd1a73694454a0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:55.681357 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-420cc35a-1a85-4958-aca7-a1cf83922cdf tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] 10.222.0.33 "GET /compute/v2.1/servers/291474d2-a375-4974-abec-713900c08119" status: 200 len: 1467 microversion: 2.1 time: 0.184401 Oct 04 20:46:55.682138 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1462/2898] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:46:55 2022] GET /compute/v2.1/servers/291474d2-a375-4974-abec-713900c08119 => generated 1467 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:46:55.719534 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-08b90caf-0d65-4b63-a435-23877740a6bb tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Calling method '.version_select at 0x7f3c74127af0>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:55.774635 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-cafc7452-e2dc-427d-97a4-eed882338a44 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac650232cc04810b1340dc2f0edadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b0670d1bd99424780a70e69d57a2166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:55.782506 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-cafc7452-e2dc-427d-97a4-eed882338a44 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48" status: 200 len: 1669 microversion: 2.1 time: 0.186482 Oct 04 20:46:55.783919 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1437/2899] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:46:55 2022] GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48 => generated 1669 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:46:55.789312 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ec36df87-21ad-4e79-aa1e-849bf8bb5ab5 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:55.790168 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ec36df87-21ad-4e79-aa1e-849bf8bb5ab5 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] [instance: 815db889-a211-4eab-90f8-7ca46d7102a4] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:55.796166 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ec36df87-21ad-4e79-aa1e-849bf8bb5ab5 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:55.796896 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ec36df87-21ad-4e79-aa1e-849bf8bb5ab5 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:55.797523 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ec36df87-21ad-4e79-aa1e-849bf8bb5ab5 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:55.798438 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ec36df87-21ad-4e79-aa1e-849bf8bb5ab5 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:55.799075 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ec36df87-21ad-4e79-aa1e-849bf8bb5ab5 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:55.799682 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ec36df87-21ad-4e79-aa1e-849bf8bb5ab5 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:55.861386 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-08b90caf-0d65-4b63-a435-23877740a6bb tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] 10.222.0.33 "GET /compute/v2.1/images?changes-since=2022-10-04T20%3A45%3A16Z" status: 200 len: 1902 microversion: 2.1 time: 0.151467 Oct 04 20:46:55.862368 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1463/2900] 10.222.0.33 () {58 vars in 1199 bytes} [Tue Oct 4 20:46:55 2022] GET /compute/v2.1/images?changes-since=2022-10-04T20%3A45%3A16Z => generated 1902 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:46:55.872567 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-31da311a-9b84-4327-a3c9-cb18c8d01df9 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:55.873271 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-31da311a-9b84-4327-a3c9-cb18c8d01df9 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: 4d46fff2-b04d-41aa-ada0-2023ab545b48] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:55.881204 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-31da311a-9b84-4327-a3c9-cb18c8d01df9 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:55.881731 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-31da311a-9b84-4327-a3c9-cb18c8d01df9 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:55.882182 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-31da311a-9b84-4327-a3c9-cb18c8d01df9 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:55.882939 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-31da311a-9b84-4327-a3c9-cb18c8d01df9 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:55.883389 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-31da311a-9b84-4327-a3c9-cb18c8d01df9 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:55.884052 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-31da311a-9b84-4327-a3c9-cb18c8d01df9 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:55.989959 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-ec36df87-21ad-4e79-aa1e-849bf8bb5ab5 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aca59cd50bf74a36bb1e4427cd50fbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3fadcd7d4043daa0a6aba27ba814d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:56.006732 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ec36df87-21ad-4e79-aa1e-849bf8bb5ab5 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] 10.222.0.33 "GET /compute/v2.1/servers/815db889-a211-4eab-90f8-7ca46d7102a4" status: 200 len: 1498 microversion: 2.1 time: 0.221108 Oct 04 20:46:56.008128 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1438/2901] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:46:55 2022] GET /compute/v2.1/servers/815db889-a211-4eab-90f8-7ca46d7102a4 => generated 1498 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:46:56.029581 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-40c4b897-1c3a-4a2b-a688-d27a03deb220 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Calling method '.version_select at 0x7f3c74429dc0>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:56.066706 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-31da311a-9b84-4327-a3c9-cb18c8d01df9 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac650232cc04810b1340dc2f0edadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b0670d1bd99424780a70e69d57a2166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:56.076073 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-31da311a-9b84-4327-a3c9-cb18c8d01df9 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48" status: 200 len: 1669 microversion: 2.1 time: 0.212401 Oct 04 20:46:56.076784 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1464/2902] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:46:55 2022] GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48 => generated 1669 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:46:56.082067 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-a3ed8ad9-14d4-43d9-a702-1d7b31a4f94e tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:56.083056 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-a3ed8ad9-14d4-43d9-a702-1d7b31a4f94e tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] [instance: 39e846c1-6876-42ef-b290-f733516e1051] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:56.090318 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a3ed8ad9-14d4-43d9-a702-1d7b31a4f94e tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:56.091145 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a3ed8ad9-14d4-43d9-a702-1d7b31a4f94e tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:56.091784 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a3ed8ad9-14d4-43d9-a702-1d7b31a4f94e tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:56.092703 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a3ed8ad9-14d4-43d9-a702-1d7b31a4f94e tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:56.093517 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a3ed8ad9-14d4-43d9-a702-1d7b31a4f94e tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:56.094314 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a3ed8ad9-14d4-43d9-a702-1d7b31a4f94e tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:56.133400 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-40c4b897-1c3a-4a2b-a688-d27a03deb220 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] 10.222.0.33 "GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-1270691715" status: 200 len: 485 microversion: 2.1 time: 0.123564 Oct 04 20:46:56.133996 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1439/2903] 10.222.0.33 () {58 vars in 1231 bytes} [Tue Oct 4 20:46:56 2022] GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-1270691715 => generated 485 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:46:56.140737 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-437d61b7-7411-420c-8877-0d18088032d9 req-e8b99805-7a63-4d16-8f15-5a3aca9927f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d46fff2-b04d-41aa-ada0-2023ab545b48", "name": "network-vif-unplugged", "status": "completed", "tag": "39e1fcde-c40c-4b4b-8edd-7565faaf4580"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:46:56.148948 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-437d61b7-7411-420c-8877-0d18088032d9 req-e8b99805-7a63-4d16-8f15-5a3aca9927f9 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:56.149420 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-437d61b7-7411-420c-8877-0d18088032d9 req-e8b99805-7a63-4d16-8f15-5a3aca9927f9 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:56.149843 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-437d61b7-7411-420c-8877-0d18088032d9 req-e8b99805-7a63-4d16-8f15-5a3aca9927f9 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:56.161653 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-437d61b7-7411-420c-8877-0d18088032d9 req-e8b99805-7a63-4d16-8f15-5a3aca9927f9 service nova] Creating event network-vif-unplugged:39e1fcde-c40c-4b4b-8edd-7565faaf4580 for instance 4d46fff2-b04d-41aa-ada0-2023ab545b48 on n-h1-854823-8 Oct 04 20:46:56.166959 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-437d61b7-7411-420c-8877-0d18088032d9 req-e8b99805-7a63-4d16-8f15-5a3aca9927f9 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031729 Oct 04 20:46:56.167901 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1440/2904] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:46:56 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:46:56.174561 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-40d75ecc-8a1c-4fb6-80e9-4ba5e3a8b911 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:56.175261 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-40d75ecc-8a1c-4fb6-80e9-4ba5e3a8b911 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] [instance: 39d66e18-289f-4674-b66c-146d68ef9133] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:56.182668 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-40d75ecc-8a1c-4fb6-80e9-4ba5e3a8b911 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:56.183430 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-40d75ecc-8a1c-4fb6-80e9-4ba5e3a8b911 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:56.183868 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-40d75ecc-8a1c-4fb6-80e9-4ba5e3a8b911 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:56.184571 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-40d75ecc-8a1c-4fb6-80e9-4ba5e3a8b911 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:56.185024 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-40d75ecc-8a1c-4fb6-80e9-4ba5e3a8b911 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:56.185449 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-40d75ecc-8a1c-4fb6-80e9-4ba5e3a8b911 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:56.269017 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-40d75ecc-8a1c-4fb6-80e9-4ba5e3a8b911 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:56.273446 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-a3ed8ad9-14d4-43d9-a702-1d7b31a4f94e tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12dc6570db03431187680f51349e55d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91111396aabd4306b66e14b5abd822ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:56.278670 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-40d75ecc-8a1c-4fb6-80e9-4ba5e3a8b911 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:56.280128 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-40d75ecc-8a1c-4fb6-80e9-4ba5e3a8b911 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:56.281354 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-a3ed8ad9-14d4-43d9-a702-1d7b31a4f94e tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] 10.222.0.33 "GET /compute/v2.1/servers/39e846c1-6876-42ef-b290-f733516e1051" status: 200 len: 1521 microversion: 2.1 time: 0.203227 Oct 04 20:46:56.282444 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1465/2905] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:46:56 2022] GET /compute/v2.1/servers/39e846c1-6876-42ef-b290-f733516e1051 => generated 1521 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:46:56.286081 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-40d75ecc-8a1c-4fb6-80e9-4ba5e3a8b911 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] 10.222.0.33 "GET /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133" status: 200 len: 1539 microversion: 2.91 time: 0.116472 Oct 04 20:46:56.287951 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-96ce583a-63c4-4bd8-8280-5af63470a7be tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:56.288768 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-96ce583a-63c4-4bd8-8280-5af63470a7be tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: 4d46fff2-b04d-41aa-ada0-2023ab545b48] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:56.295104 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-96ce583a-63c4-4bd8-8280-5af63470a7be tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:56.295789 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-96ce583a-63c4-4bd8-8280-5af63470a7be tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:56.296435 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-96ce583a-63c4-4bd8-8280-5af63470a7be tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:56.297657 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-96ce583a-63c4-4bd8-8280-5af63470a7be tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:56.298292 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-96ce583a-63c4-4bd8-8280-5af63470a7be tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:56.298922 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-96ce583a-63c4-4bd8-8280-5af63470a7be tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:56.300178 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1441/2906] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:46:56 2022] GET /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133 => generated 1539 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:46:56.305529 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1c294d34-7939-4688-b11a-f792627289ce tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Calling method '.version_select at 0x7f3c74303c10>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:56.401060 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-1c294d34-7939-4688-b11a-f792627289ce tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] 10.222.0.33 "GET /compute/v2.1/images?server=291474d2-a375-4974-abec-713900c08119" status: 200 len: 958 microversion: 2.1 time: 0.099544 Oct 04 20:46:56.401926 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1442/2907] 10.222.0.33 () {58 vars in 1209 bytes} [Tue Oct 4 20:46:56 2022] GET /compute/v2.1/images?server=291474d2-a375-4974-abec-713900c08119 => generated 958 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:46:56.407310 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-82cf7c74-fe3f-45ac-8320-44f3ab578b0e tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:56.407916 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-82cf7c74-fe3f-45ac-8320-44f3ab578b0e tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] [instance: 32237627-3fea-48d4-959f-3a2aa519adf3] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:56.414722 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-82cf7c74-fe3f-45ac-8320-44f3ab578b0e tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:56.415209 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-82cf7c74-fe3f-45ac-8320-44f3ab578b0e tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:56.415641 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-82cf7c74-fe3f-45ac-8320-44f3ab578b0e tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:56.416402 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-82cf7c74-fe3f-45ac-8320-44f3ab578b0e tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:56.416857 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-82cf7c74-fe3f-45ac-8320-44f3ab578b0e tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:56.417279 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-82cf7c74-fe3f-45ac-8320-44f3ab578b0e tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:56.470388 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-96ce583a-63c4-4bd8-8280-5af63470a7be tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac650232cc04810b1340dc2f0edadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b0670d1bd99424780a70e69d57a2166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:56.479032 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-96ce583a-63c4-4bd8-8280-5af63470a7be tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48" status: 200 len: 1669 microversion: 2.1 time: 0.195139 Oct 04 20:46:56.479408 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1466/2908] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:46:56 2022] GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48 => generated 1669 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:46:56.485292 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-de916509-fb44-499d-a9df-d23d2b6b0bb9 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Calling method '.version_select at 0x7f3c7416a0d0>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:56.487110 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-82cf7c74-fe3f-45ac-8320-44f3ab578b0e tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87dcc7baf63f4ae6bfe0a099adffd408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7097bc12179446f6a3e1fac8434d5c64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:56.502554 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-82cf7c74-fe3f-45ac-8320-44f3ab578b0e tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] 10.222.0.33 "GET /compute/v2.1/servers/32237627-3fea-48d4-959f-3a2aa519adf3" status: 200 len: 1267 microversion: 2.1 time: 0.099205 Oct 04 20:46:56.503645 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1443/2909] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:46:56 2022] GET /compute/v2.1/servers/32237627-3fea-48d4-959f-3a2aa519adf3 => generated 1267 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:46:56.511337 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c31150ec-db31-4ede-b9d9-421116e4a90a tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:46:56.514307 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c31150ec-db31-4ede-b9d9-421116e4a90a tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: 4d46fff2-b04d-41aa-ada0-2023ab545b48] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:56.521372 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c31150ec-db31-4ede-b9d9-421116e4a90a tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:56.522153 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c31150ec-db31-4ede-b9d9-421116e4a90a tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:56.522843 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c31150ec-db31-4ede-b9d9-421116e4a90a tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:56.523793 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c31150ec-db31-4ede-b9d9-421116e4a90a tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:56.524455 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c31150ec-db31-4ede-b9d9-421116e4a90a tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:56.525085 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c31150ec-db31-4ede-b9d9-421116e4a90a tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:56.552002 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-de916509-fb44-499d-a9df-d23d2b6b0bb9 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] 10.222.0.33 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.33%2Fcompute%2Fv2.1%2Fservers%2F8917de21-2b45-4249-ae17-17f679d4856f" status: 200 len: 484 microversion: 2.1 time: 0.071167 Oct 04 20:46:56.552981 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1467/2910] 10.222.0.33 () {58 vars in 1317 bytes} [Tue Oct 4 20:46:56 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.33%2Fcompute%2Fv2.1%2Fservers%2F8917de21-2b45-4249-ae17-17f679d4856f => generated 484 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:46:56.564694 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-4354a174-c7d2-4fb7-9d1c-78a8de6bee34 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Calling method '.version_select at 0x7f3c741981f0>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:56.624265 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-4354a174-c7d2-4fb7-9d1c-78a8de6bee34 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] 10.222.0.33 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.33%2Fcompute%2Fservers%2F8917de21-2b45-4249-ae17-17f679d4856f" status: 200 len: 484 microversion: 2.1 time: 0.063237 Oct 04 20:46:56.635647 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1468/2911] 10.222.0.33 () {58 vars in 1303 bytes} [Tue Oct 4 20:46:56 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.33%2Fcompute%2Fservers%2F8917de21-2b45-4249-ae17-17f679d4856f => generated 484 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 20:46:56.653323 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-1c424144-ed42-49e3-9e3f-97b60118b055 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Calling method '.version_select at 0x7f3c74198550>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:56.668884 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c31150ec-db31-4ede-b9d9-421116e4a90a tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "POST /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48/action" status: 202 len: 0 microversion: 2.1 time: 0.159806 Oct 04 20:46:56.673671 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1444/2912] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 20:46:56 2022] POST /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48/action => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:46:56.695421 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-20b4b79e-e264-434a-bc2e-692876babf60 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:56.697477 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-20b4b79e-e264-434a-bc2e-692876babf60 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: 4d46fff2-b04d-41aa-ada0-2023ab545b48] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:56.726853 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-20b4b79e-e264-434a-bc2e-692876babf60 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:56.727371 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-20b4b79e-e264-434a-bc2e-692876babf60 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:56.727853 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-20b4b79e-e264-434a-bc2e-692876babf60 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:56.728576 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-20b4b79e-e264-434a-bc2e-692876babf60 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:56.729323 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-20b4b79e-e264-434a-bc2e-692876babf60 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:56.729960 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-20b4b79e-e264-434a-bc2e-692876babf60 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:56.830408 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-1c424144-ed42-49e3-9e3f-97b60118b055 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] 10.222.0.33 "GET /compute/v2.1/images?status=ACTIVE" status: 200 len: 3281 microversion: 2.1 time: 0.192977 Oct 04 20:46:56.831014 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1469/2913] 10.222.0.33 () {58 vars in 1149 bytes} [Tue Oct 4 20:46:56 2022] GET /compute/v2.1/images?status=ACTIVE => generated 3281 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:46:56.853519 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-dfd184cc-59b6-4ab7-bac7-2726bd1785f2 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Calling method '.version_select at 0x7f3c74118ee0>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:56.982375 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-20b4b79e-e264-434a-bc2e-692876babf60 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac650232cc04810b1340dc2f0edadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b0670d1bd99424780a70e69d57a2166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:56.991235 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-20b4b79e-e264-434a-bc2e-692876babf60 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48" status: 200 len: 1671 microversion: 2.1 time: 0.315420 Oct 04 20:46:56.992013 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1445/2914] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:46:56 2022] GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48 => generated 1671 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:46:57.001806 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-dfd184cc-59b6-4ab7-bac7-2726bd1785f2 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] 10.222.0.33 "GET /compute/v2.1/images?type=snapshot" status: 200 len: 1430 microversion: 2.1 time: 0.155233 Oct 04 20:46:57.002869 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1470/2915] 10.222.0.33 () {58 vars in 1149 bytes} [Tue Oct 4 20:46:56 2022] GET /compute/v2.1/images?type=snapshot => generated 1430 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:46:57.022490 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f5a982ea-0ab7-4717-a946-7646eba6b079 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Calling method '.version_select at 0x7f3c746be040>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:57.043497 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-e1fa888e-cb64-49e8-82ce-ceeb261fbf45 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:57.044104 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-e1fa888e-cb64-49e8-82ce-ceeb261fbf45 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] [instance: 815db889-a211-4eab-90f8-7ca46d7102a4] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:57.050550 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e1fa888e-cb64-49e8-82ce-ceeb261fbf45 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:57.051346 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e1fa888e-cb64-49e8-82ce-ceeb261fbf45 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:57.051838 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e1fa888e-cb64-49e8-82ce-ceeb261fbf45 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:57.053367 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e1fa888e-cb64-49e8-82ce-ceeb261fbf45 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:57.054029 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e1fa888e-cb64-49e8-82ce-ceeb261fbf45 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:57.054682 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e1fa888e-cb64-49e8-82ce-ceeb261fbf45 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:57.105668 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f5a982ea-0ab7-4717-a946-7646eba6b079 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] 10.222.0.33 "GET /compute/v2.1/images?limit=1" status: 200 len: 622 microversion: 2.1 time: 0.087129 Oct 04 20:46:57.106628 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1446/2916] 10.222.0.33 () {58 vars in 1137 bytes} [Tue Oct 4 20:46:57 2022] GET /compute/v2.1/images?limit=1 => generated 622 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:46:57.120419 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-295178d9-df89-4f69-81a2-106f7838dd4f tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Calling method '.version_select at 0x7f3c743fe9d0>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:57.237388 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-295178d9-df89-4f69-81a2-106f7838dd4f tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] 10.222.0.33 "GET /compute/v2.1/images/detail?changes-since=2022-10-04T20%3A45%3A11Z" status: 200 len: 6334 microversion: 2.1 time: 0.120714 Oct 04 20:46:57.250864 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1447/2917] 10.222.0.33 () {58 vars in 1220 bytes} [Tue Oct 4 20:46:57 2022] GET /compute/v2.1/images/detail?changes-since=2022-10-04T20%3A45%3A11Z => generated 6334 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:46:57.260805 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-3b77e084-4446-4452-905b-43b074b14df6 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Calling method '.version_select at 0x7f3c74429dc0>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:57.277240 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-e1fa888e-cb64-49e8-82ce-ceeb261fbf45 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aca59cd50bf74a36bb1e4427cd50fbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3fadcd7d4043daa0a6aba27ba814d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:57.287059 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-e1fa888e-cb64-49e8-82ce-ceeb261fbf45 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] 10.222.0.33 "GET /compute/v2.1/servers/815db889-a211-4eab-90f8-7ca46d7102a4" status: 200 len: 1498 microversion: 2.1 time: 0.246658 Oct 04 20:46:57.288730 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1471/2918] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:46:57 2022] GET /compute/v2.1/servers/815db889-a211-4eab-90f8-7ca46d7102a4 => generated 1498 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:46:57.308842 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-65b1cd94-a070-4800-9fa4-5bac21b4d2bc tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:57.310206 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-65b1cd94-a070-4800-9fa4-5bac21b4d2bc tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] [instance: 39e846c1-6876-42ef-b290-f733516e1051] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:57.319644 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-65b1cd94-a070-4800-9fa4-5bac21b4d2bc tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:57.321177 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-65b1cd94-a070-4800-9fa4-5bac21b4d2bc tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:57.322124 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-65b1cd94-a070-4800-9fa4-5bac21b4d2bc tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:57.323137 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-65b1cd94-a070-4800-9fa4-5bac21b4d2bc tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:57.323824 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-65b1cd94-a070-4800-9fa4-5bac21b4d2bc tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:57.325273 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-65b1cd94-a070-4800-9fa4-5bac21b4d2bc tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:57.371461 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-3b77e084-4446-4452-905b-43b074b14df6 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] 10.222.0.33 "GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-1270691715" status: 200 len: 665 microversion: 2.1 time: 0.116141 Oct 04 20:46:57.383536 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1448/2919] 10.222.0.33 () {58 vars in 1252 bytes} [Tue Oct 4 20:46:57 2022] GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-1270691715 => generated 665 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:46:57.383536 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c4aa26db-ae4c-4aec-9517-f26da4936282 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:57.383536 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c4aa26db-ae4c-4aec-9517-f26da4936282 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] [instance: 39d66e18-289f-4674-b66c-146d68ef9133] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:57.385553 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c4aa26db-ae4c-4aec-9517-f26da4936282 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:57.386195 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c4aa26db-ae4c-4aec-9517-f26da4936282 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:57.386659 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c4aa26db-ae4c-4aec-9517-f26da4936282 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:57.387363 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c4aa26db-ae4c-4aec-9517-f26da4936282 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:57.387809 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c4aa26db-ae4c-4aec-9517-f26da4936282 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:57.388471 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c4aa26db-ae4c-4aec-9517-f26da4936282 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:57.485203 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c4aa26db-ae4c-4aec-9517-f26da4936282 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:57.494235 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c4aa26db-ae4c-4aec-9517-f26da4936282 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:57.495736 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c4aa26db-ae4c-4aec-9517-f26da4936282 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:57.500744 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c4aa26db-ae4c-4aec-9517-f26da4936282 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] 10.222.0.33 "GET /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133" status: 200 len: 1539 microversion: 2.91 time: 0.127211 Oct 04 20:46:57.501319 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1449/2920] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:46:57 2022] GET /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133 => generated 1539 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:46:57.507075 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f60ba539-2cab-4a15-8cb3-3a331673cc67 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Calling method '.version_select at 0x7f3c7456c280>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:57.568353 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f60ba539-2cab-4a15-8cb3-3a331673cc67 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] 10.222.0.33 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.33%2Fcompute%2Fv2.1%2Fservers%2F8917de21-2b45-4249-ae17-17f679d4856f" status: 200 len: 1466 microversion: 2.1 time: 0.065718 Oct 04 20:46:57.579150 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1450/2921] 10.222.0.33 () {58 vars in 1338 bytes} [Tue Oct 4 20:46:57 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.33%2Fcompute%2Fv2.1%2Fservers%2F8917de21-2b45-4249-ae17-17f679d4856f => generated 1466 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:46:57.582898 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-65b1cd94-a070-4800-9fa4-5bac21b4d2bc tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12dc6570db03431187680f51349e55d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91111396aabd4306b66e14b5abd822ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:57.584643 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-96a90a4d-78ed-4518-8ca8-908ca4efbf1f tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:57.585268 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-96a90a4d-78ed-4518-8ca8-908ca4efbf1f tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] [instance: 32237627-3fea-48d4-959f-3a2aa519adf3] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:57.591454 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-96a90a4d-78ed-4518-8ca8-908ca4efbf1f tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:57.591673 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-65b1cd94-a070-4800-9fa4-5bac21b4d2bc tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] 10.222.0.33 "GET /compute/v2.1/servers/39e846c1-6876-42ef-b290-f733516e1051" status: 200 len: 1521 microversion: 2.1 time: 0.287603 Oct 04 20:46:57.591947 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-96a90a4d-78ed-4518-8ca8-908ca4efbf1f tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:57.592392 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-96a90a4d-78ed-4518-8ca8-908ca4efbf1f tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:57.592968 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1472/2922] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:46:57 2022] GET /compute/v2.1/servers/39e846c1-6876-42ef-b290-f733516e1051 => generated 1521 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:46:57.597954 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-1a073f5c-7306-4c3e-8726-2af3fec51ec5 req-72042592-6af6-401b-9c65-3dda17df0421 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32237627-3fea-48d4-959f-3a2aa519adf3", "tag": "397f83d3-7c45-4acb-949d-c35a707bccac"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:46:57.607495 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-96a90a4d-78ed-4518-8ca8-908ca4efbf1f tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:57.608101 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-96a90a4d-78ed-4518-8ca8-908ca4efbf1f tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:57.608568 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-96a90a4d-78ed-4518-8ca8-908ca4efbf1f tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:57.609394 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-1a073f5c-7306-4c3e-8726-2af3fec51ec5 req-72042592-6af6-401b-9c65-3dda17df0421 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:57.610106 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-1a073f5c-7306-4c3e-8726-2af3fec51ec5 req-72042592-6af6-401b-9c65-3dda17df0421 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:57.610791 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-1a073f5c-7306-4c3e-8726-2af3fec51ec5 req-72042592-6af6-401b-9c65-3dda17df0421 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:57.625981 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-1a073f5c-7306-4c3e-8726-2af3fec51ec5 req-72042592-6af6-401b-9c65-3dda17df0421 service nova] Creating event network-changed:397f83d3-7c45-4acb-949d-c35a707bccac for instance 32237627-3fea-48d4-959f-3a2aa519adf3 on n-h2-854823-8 Oct 04 20:46:57.631094 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-1a073f5c-7306-4c3e-8726-2af3fec51ec5 req-72042592-6af6-401b-9c65-3dda17df0421 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036670 Oct 04 20:46:57.632472 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1473/2923] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:46:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:46:57.644455 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-6703f11d-f418-4aa5-8fe2-01408eb3da02 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Calling method '.version_select at 0x7f3c741180d0>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:57.711514 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-6703f11d-f418-4aa5-8fe2-01408eb3da02 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] 10.222.0.33 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.33%2Fcompute%2Fservers%2F8917de21-2b45-4249-ae17-17f679d4856f" status: 200 len: 1466 microversion: 2.1 time: 0.077784 Oct 04 20:46:57.712495 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1474/2924] 10.222.0.33 () {58 vars in 1324 bytes} [Tue Oct 4 20:46:57 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.33%2Fcompute%2Fservers%2F8917de21-2b45-4249-ae17-17f679d4856f => generated 1466 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:46:57.731355 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-fe0a5713-cd11-4330-8a6e-45b430ee923b tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Calling method '.version_select at 0x7f3c74198ee0>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:57.847856 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-fe0a5713-cd11-4330-8a6e-45b430ee923b tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] 10.222.0.33 "GET /compute/v2.1/images/detail?status=ACTIVE" status: 200 len: 7109 microversion: 2.1 time: 0.120522 Oct 04 20:46:57.849716 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1475/2925] 10.222.0.33 () {58 vars in 1170 bytes} [Tue Oct 4 20:46:57 2022] GET /compute/v2.1/images/detail?status=ACTIVE => generated 7109 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:46:57.872099 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-2502542f-7398-4e3b-bfde-096c83deddc7 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Calling method '.version_select at 0x7f3c744bc790>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:57.963838 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-2502542f-7398-4e3b-bfde-096c83deddc7 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] 10.222.0.33 "GET /compute/v2.1/images/detail?type=snapshot" status: 200 len: 4376 microversion: 2.1 time: 0.096117 Oct 04 20:46:57.964693 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1476/2926] 10.222.0.33 () {58 vars in 1170 bytes} [Tue Oct 4 20:46:57 2022] GET /compute/v2.1/images/detail?type=snapshot => generated 4376 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:46:57.985679 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-f3992748-b69f-4272-9111-c5429bf18385 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Calling method '.version_select at 0x7f3c740fab80>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:58.054064 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-f3992748-b69f-4272-9111-c5429bf18385 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] 10.222.0.33 "GET /compute/v2.1/images/15b24725-0c99-4bcf-b1fb-907cdf8e2d63" status: 200 len: 784 microversion: 2.1 time: 0.075623 Oct 04 20:46:58.055005 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1477/2927] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 20:46:57 2022] GET /compute/v2.1/images/15b24725-0c99-4bcf-b1fb-907cdf8e2d63 => generated 784 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 20:46:58.061472 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-f903cd60-7601-4b9f-9fb5-a2078629ef81 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:58.062222 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-f903cd60-7601-4b9f-9fb5-a2078629ef81 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: 4d46fff2-b04d-41aa-ada0-2023ab545b48] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:58.074334 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f903cd60-7601-4b9f-9fb5-a2078629ef81 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:58.074856 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f903cd60-7601-4b9f-9fb5-a2078629ef81 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:58.075592 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f903cd60-7601-4b9f-9fb5-a2078629ef81 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:58.077410 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f903cd60-7601-4b9f-9fb5-a2078629ef81 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:58.077887 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f903cd60-7601-4b9f-9fb5-a2078629ef81 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:58.078321 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f903cd60-7601-4b9f-9fb5-a2078629ef81 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:58.133622 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-96a90a4d-78ed-4518-8ca8-908ca4efbf1f tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87dcc7baf63f4ae6bfe0a099adffd408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7097bc12179446f6a3e1fac8434d5c64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:58.143701 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-96a90a4d-78ed-4518-8ca8-908ca4efbf1f tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] 10.222.0.33 "GET /compute/v2.1/servers/32237627-3fea-48d4-959f-3a2aa519adf3" status: 200 len: 1309 microversion: 2.1 time: 0.567881 Oct 04 20:46:58.144542 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1451/2928] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:46:57 2022] GET /compute/v2.1/servers/32237627-3fea-48d4-959f-3a2aa519adf3 => generated 1309 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:46:58.162888 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a2c184d5-853a-4f04-8fcd-de576749faff tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Calling method '.version_select at 0x7f3c746be670>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:58.218484 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a2c184d5-853a-4f04-8fcd-de576749faff tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] 10.222.0.33 "GET /compute/v2.1/images/detail?limit=1" status: 200 len: 1611 microversion: 2.1 time: 0.070407 Oct 04 20:46:58.223064 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1452/2929] 10.222.0.33 () {58 vars in 1158 bytes} [Tue Oct 4 20:46:58 2022] GET /compute/v2.1/images/detail?limit=1 => generated 1611 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:46:58.226013 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-5b535ae4-3b54-499c-825a-cae2166f349b req-6c3071e7-1417-4e31-b690-c743559825b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "291474d2-a375-4974-abec-713900c08119", "name": "network-vif-unplugged", "status": "completed", "tag": "744df6f8-0df8-4ff2-b842-56de1314bff3"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:46:58.237527 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-5b535ae4-3b54-499c-825a-cae2166f349b req-6c3071e7-1417-4e31-b690-c743559825b5 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:58.238385 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-5b535ae4-3b54-499c-825a-cae2166f349b req-6c3071e7-1417-4e31-b690-c743559825b5 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:58.238556 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-5b535ae4-3b54-499c-825a-cae2166f349b req-6c3071e7-1417-4e31-b690-c743559825b5 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:58.250079 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-5b535ae4-3b54-499c-825a-cae2166f349b req-6c3071e7-1417-4e31-b690-c743559825b5 service nova] Creating event network-vif-unplugged:744df6f8-0df8-4ff2-b842-56de1314bff3 for instance 291474d2-a375-4974-abec-713900c08119 on n-h1-854823-8 Oct 04 20:46:58.255509 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-5b535ae4-3b54-499c-825a-cae2166f349b req-6c3071e7-1417-4e31-b690-c743559825b5 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034003 Oct 04 20:46:58.256557 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1453/2930] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:46:58 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:46:58.262065 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-02c0b71b-4149-4ecd-8a64-5c7b6d364551 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Calling method '.version_select at 0x7f3c745bfaf0>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:58.276439 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-f903cd60-7601-4b9f-9fb5-a2078629ef81 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac650232cc04810b1340dc2f0edadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b0670d1bd99424780a70e69d57a2166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:58.288103 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-f903cd60-7601-4b9f-9fb5-a2078629ef81 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48" status: 200 len: 1676 microversion: 2.1 time: 0.231849 Oct 04 20:46:58.288702 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1478/2931] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:46:58 2022] GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48 => generated 1676 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:46:58.313817 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-6df5f978-6f5c-4bb4-a889-ed8e4bf02154 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:58.314452 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-6df5f978-6f5c-4bb4-a889-ed8e4bf02154 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] [instance: 815db889-a211-4eab-90f8-7ca46d7102a4] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:58.323198 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6df5f978-6f5c-4bb4-a889-ed8e4bf02154 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:58.323800 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6df5f978-6f5c-4bb4-a889-ed8e4bf02154 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:58.324310 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6df5f978-6f5c-4bb4-a889-ed8e4bf02154 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:58.325017 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6df5f978-6f5c-4bb4-a889-ed8e4bf02154 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:58.325640 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6df5f978-6f5c-4bb4-a889-ed8e4bf02154 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:58.326157 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6df5f978-6f5c-4bb4-a889-ed8e4bf02154 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:58.479760 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-6df5f978-6f5c-4bb4-a889-ed8e4bf02154 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aca59cd50bf74a36bb1e4427cd50fbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3fadcd7d4043daa0a6aba27ba814d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:58.482169 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=100 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:46:58.488962 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-6df5f978-6f5c-4bb4-a889-ed8e4bf02154 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] 10.222.0.33 "GET /compute/v2.1/servers/815db889-a211-4eab-90f8-7ca46d7102a4" status: 200 len: 1498 microversion: 2.1 time: 0.179565 Oct 04 20:46:58.490076 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1479/2932] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:46:58 2022] GET /compute/v2.1/servers/815db889-a211-4eab-90f8-7ca46d7102a4 => generated 1498 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:46:58.532067 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-42abb87e-21e5-4140-be3c-ac5cab887788 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:58.532881 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-42abb87e-21e5-4140-be3c-ac5cab887788 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] [instance: 39d66e18-289f-4674-b66c-146d68ef9133] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:58.541158 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-42abb87e-21e5-4140-be3c-ac5cab887788 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:58.541738 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-42abb87e-21e5-4140-be3c-ac5cab887788 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:58.542488 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-42abb87e-21e5-4140-be3c-ac5cab887788 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:58.543204 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-42abb87e-21e5-4140-be3c-ac5cab887788 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:58.543666 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-42abb87e-21e5-4140-be3c-ac5cab887788 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:58.544095 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-42abb87e-21e5-4140-be3c-ac5cab887788 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:58.623688 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-42abb87e-21e5-4140-be3c-ac5cab887788 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:58.633154 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-42abb87e-21e5-4140-be3c-ac5cab887788 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:58.634612 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-42abb87e-21e5-4140-be3c-ac5cab887788 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:58.640437 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-42abb87e-21e5-4140-be3c-ac5cab887788 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] 10.222.0.33 "GET /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133" status: 200 len: 1560 microversion: 2.91 time: 0.113285 Oct 04 20:46:58.641326 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1480/2933] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:46:58 2022] GET /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133 => generated 1560 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 20:46:58.646523 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-c10a7032-265f-444f-9869-95f609dce2d1 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:58.647113 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-c10a7032-265f-444f-9869-95f609dce2d1 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] [instance: 39e846c1-6876-42ef-b290-f733516e1051] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:58.653541 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c10a7032-265f-444f-9869-95f609dce2d1 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:58.654180 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c10a7032-265f-444f-9869-95f609dce2d1 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:58.654718 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c10a7032-265f-444f-9869-95f609dce2d1 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:58.655413 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c10a7032-265f-444f-9869-95f609dce2d1 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:58.656082 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c10a7032-265f-444f-9869-95f609dce2d1 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:58.656505 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c10a7032-265f-444f-9869-95f609dce2d1 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:58.737339 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-02c0b71b-4149-4ecd-8a64-5c7b6d364551 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] 10.222.0.33 "DELETE /compute/v2.1/images/0f050377-ae76-45a1-9386-5340e96ea493" status: 204 len: 0 microversion: 2.1 time: 0.479510 Oct 04 20:46:58.738220 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1454/2934] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:46:58 2022] DELETE /compute/v2.1/images/0f050377-ae76-45a1-9386-5340e96ea493 => generated 0 bytes in 481 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:46:58.746668 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ad1a6736-289b-4497-a685-9dde76e711b9 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Calling method '.version_select at 0x7f3c745f4700>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:58.810059 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-c10a7032-265f-444f-9869-95f609dce2d1 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12dc6570db03431187680f51349e55d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91111396aabd4306b66e14b5abd822ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:58.818469 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-c10a7032-265f-444f-9869-95f609dce2d1 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] 10.222.0.33 "GET /compute/v2.1/servers/39e846c1-6876-42ef-b290-f733516e1051" status: 200 len: 1521 microversion: 2.1 time: 0.176003 Oct 04 20:46:58.819107 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1481/2935] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:46:58 2022] GET /compute/v2.1/servers/39e846c1-6876-42ef-b290-f733516e1051 => generated 1521 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:46:59.163093 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ad1a6736-289b-4497-a685-9dde76e711b9 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] 10.222.0.33 "DELETE /compute/v2.1/images/b73cf850-8f12-4af6-a477-48d47ca8c95f" status: 204 len: 0 microversion: 2.1 time: 0.420321 Oct 04 20:46:59.163671 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1455/2936] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:46:58 2022] DELETE /compute/v2.1/images/b73cf850-8f12-4af6-a477-48d47ca8c95f => generated 0 bytes in 422 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 20:46:59.169036 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-6e383409-fc65-40af-859e-69573b8b3928 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:59.169663 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-6e383409-fc65-40af-859e-69573b8b3928 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] [instance: 32237627-3fea-48d4-959f-3a2aa519adf3] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:59.171357 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-64091a37-216a-4456-8b41-cb71c2f4af91 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Calling method '.version_select at 0x7f3c746be8b0>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:59.177342 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6e383409-fc65-40af-859e-69573b8b3928 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:59.177828 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6e383409-fc65-40af-859e-69573b8b3928 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:59.178267 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6e383409-fc65-40af-859e-69573b8b3928 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:59.179066 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6e383409-fc65-40af-859e-69573b8b3928 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:59.179438 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6e383409-fc65-40af-859e-69573b8b3928 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:59.179868 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6e383409-fc65-40af-859e-69573b8b3928 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:59.311483 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-6e383409-fc65-40af-859e-69573b8b3928 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87dcc7baf63f4ae6bfe0a099adffd408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7097bc12179446f6a3e1fac8434d5c64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:59.320106 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-6e383409-fc65-40af-859e-69573b8b3928 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] 10.222.0.33 "GET /compute/v2.1/servers/32237627-3fea-48d4-959f-3a2aa519adf3" status: 200 len: 1309 microversion: 2.1 time: 0.155862 Oct 04 20:46:59.324724 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1482/2937] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:46:59 2022] GET /compute/v2.1/servers/32237627-3fea-48d4-959f-3a2aa519adf3 => generated 1309 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:46:59.334851 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-3e026bfc-3f7f-46d0-8e58-22673678e6ec tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:59.335832 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-3e026bfc-3f7f-46d0-8e58-22673678e6ec tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: 4d46fff2-b04d-41aa-ada0-2023ab545b48] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:59.343546 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3e026bfc-3f7f-46d0-8e58-22673678e6ec tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:59.344027 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3e026bfc-3f7f-46d0-8e58-22673678e6ec tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:59.344453 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3e026bfc-3f7f-46d0-8e58-22673678e6ec tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:59.345302 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3e026bfc-3f7f-46d0-8e58-22673678e6ec tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:59.345747 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3e026bfc-3f7f-46d0-8e58-22673678e6ec tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:59.346164 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3e026bfc-3f7f-46d0-8e58-22673678e6ec tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:59.481101 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-3e026bfc-3f7f-46d0-8e58-22673678e6ec tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac650232cc04810b1340dc2f0edadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b0670d1bd99424780a70e69d57a2166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:59.489142 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-3e026bfc-3f7f-46d0-8e58-22673678e6ec tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48" status: 200 len: 1669 microversion: 2.1 time: 0.163429 Oct 04 20:46:59.490560 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1483/2938] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:46:59 2022] GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48 => generated 1669 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:46:59.512880 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-08cce378-2c5f-495f-b69c-f968a097b224 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:46:59.515200 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-08cce378-2c5f-495f-b69c-f968a097b224 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: 4d46fff2-b04d-41aa-ada0-2023ab545b48] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:59.521202 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-08cce378-2c5f-495f-b69c-f968a097b224 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:59.521685 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-08cce378-2c5f-495f-b69c-f968a097b224 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:59.522120 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-08cce378-2c5f-495f-b69c-f968a097b224 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:59.522840 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-08cce378-2c5f-495f-b69c-f968a097b224 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:59.523289 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-08cce378-2c5f-495f-b69c-f968a097b224 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:59.523707 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-08cce378-2c5f-495f-b69c-f968a097b224 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:59.576654 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-08cce378-2c5f-495f-b69c-f968a097b224 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "POST /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48/action" status: 200 len: 321 microversion: 2.1 time: 0.067340 Oct 04 20:46:59.582065 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1484/2939] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 20:46:59 2022] POST /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48/action => generated 321 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 20:46:59.583632 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-6051a121-c90c-44fe-9f45-b3b4880ba632 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:59.584405 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-6051a121-c90c-44fe-9f45-b3b4880ba632 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] [instance: 815db889-a211-4eab-90f8-7ca46d7102a4] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:59.592498 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6051a121-c90c-44fe-9f45-b3b4880ba632 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:59.592979 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6051a121-c90c-44fe-9f45-b3b4880ba632 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:59.593406 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6051a121-c90c-44fe-9f45-b3b4880ba632 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:59.594250 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6051a121-c90c-44fe-9f45-b3b4880ba632 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:59.594589 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6051a121-c90c-44fe-9f45-b3b4880ba632 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:59.595011 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6051a121-c90c-44fe-9f45-b3b4880ba632 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:59.601951 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-64091a37-216a-4456-8b41-cb71c2f4af91 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] 10.222.0.33 "DELETE /compute/v2.1/images/9fbc16b1-0e5d-475b-b380-8e5a6992900a" status: 204 len: 0 microversion: 2.1 time: 0.434131 Oct 04 20:46:59.603162 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1456/2940] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:46:59 2022] DELETE /compute/v2.1/images/9fbc16b1-0e5d-475b-b380-8e5a6992900a => generated 0 bytes in 436 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 20:46:59.608012 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d822150c-522f-481c-b92c-5838d33a9cc9 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:59.608811 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d822150c-522f-481c-b92c-5838d33a9cc9 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: 4d46fff2-b04d-41aa-ada0-2023ab545b48] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:59.617330 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d822150c-522f-481c-b92c-5838d33a9cc9 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:59.617903 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d822150c-522f-481c-b92c-5838d33a9cc9 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:59.618612 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d822150c-522f-481c-b92c-5838d33a9cc9 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:59.619422 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d822150c-522f-481c-b92c-5838d33a9cc9 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:59.619889 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d822150c-522f-481c-b92c-5838d33a9cc9 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:59.620327 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d822150c-522f-481c-b92c-5838d33a9cc9 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:59.845749 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-6051a121-c90c-44fe-9f45-b3b4880ba632 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aca59cd50bf74a36bb1e4427cd50fbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3fadcd7d4043daa0a6aba27ba814d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:59.850007 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d822150c-522f-481c-b92c-5838d33a9cc9 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac650232cc04810b1340dc2f0edadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b0670d1bd99424780a70e69d57a2166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:59.855017 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-6051a121-c90c-44fe-9f45-b3b4880ba632 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] 10.222.0.33 "GET /compute/v2.1/servers/815db889-a211-4eab-90f8-7ca46d7102a4" status: 200 len: 1498 microversion: 2.1 time: 0.276551 Oct 04 20:46:59.855849 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1485/2941] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:46:59 2022] GET /compute/v2.1/servers/815db889-a211-4eab-90f8-7ca46d7102a4 => generated 1498 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:46:59.860183 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d822150c-522f-481c-b92c-5838d33a9cc9 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48" status: 200 len: 1669 microversion: 2.1 time: 0.255610 Oct 04 20:46:59.865003 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-2adace63-7097-46b6-bff1-96c8021ce3d3 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:59.865644 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-2adace63-7097-46b6-bff1-96c8021ce3d3 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] [instance: 8917de21-2b45-4249-ae17-17f679d4856f] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:59.875879 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2adace63-7097-46b6-bff1-96c8021ce3d3 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:59.876838 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2adace63-7097-46b6-bff1-96c8021ce3d3 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:59.877711 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2adace63-7097-46b6-bff1-96c8021ce3d3 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:59.878589 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1457/2942] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:46:59 2022] GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48 => generated 1669 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:46:59.879644 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2adace63-7097-46b6-bff1-96c8021ce3d3 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:59.880711 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2adace63-7097-46b6-bff1-96c8021ce3d3 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:59.881539 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2adace63-7097-46b6-bff1-96c8021ce3d3 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:59.886949 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-54caf18c-aa90-4ad6-aeb9-f21e48e66bda tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:59.887862 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-54caf18c-aa90-4ad6-aeb9-f21e48e66bda tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] [instance: 39d66e18-289f-4674-b66c-146d68ef9133] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:46:59.894525 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-54caf18c-aa90-4ad6-aeb9-f21e48e66bda tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:59.895219 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-54caf18c-aa90-4ad6-aeb9-f21e48e66bda tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:59.896436 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-54caf18c-aa90-4ad6-aeb9-f21e48e66bda tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:59.897552 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-54caf18c-aa90-4ad6-aeb9-f21e48e66bda tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:46:59.898169 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-54caf18c-aa90-4ad6-aeb9-f21e48e66bda tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:46:59.898788 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-54caf18c-aa90-4ad6-aeb9-f21e48e66bda tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:46:59.915537 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-2adace63-7097-46b6-bff1-96c8021ce3d3 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] [instance: 8917de21-2b45-4249-ae17-17f679d4856f] Going to try to terminate instance {{(pid=128802) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:46:59.975997 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-54caf18c-aa90-4ad6-aeb9-f21e48e66bda tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:59.985719 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-54caf18c-aa90-4ad6-aeb9-f21e48e66bda tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:59.987223 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-54caf18c-aa90-4ad6-aeb9-f21e48e66bda tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:46:59.993216 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-54caf18c-aa90-4ad6-aeb9-f21e48e66bda tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] 10.222.0.33 "GET /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133" status: 200 len: 1560 microversion: 2.91 time: 0.113461 Oct 04 20:46:59.993839 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1458/2943] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:46:59 2022] GET /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133 => generated 1560 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:46:59.999056 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-33a5d05b-09e7-44a3-a5da-65c3094a2d39 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:46:59.999666 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-33a5d05b-09e7-44a3-a5da-65c3094a2d39 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] [instance: 39e846c1-6876-42ef-b290-f733516e1051] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:00.006425 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-33a5d05b-09e7-44a3-a5da-65c3094a2d39 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:00.007491 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-33a5d05b-09e7-44a3-a5da-65c3094a2d39 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:00.007994 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-33a5d05b-09e7-44a3-a5da-65c3094a2d39 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:00.009102 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-33a5d05b-09e7-44a3-a5da-65c3094a2d39 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:00.009274 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-33a5d05b-09e7-44a3-a5da-65c3094a2d39 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:00.009889 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-33a5d05b-09e7-44a3-a5da-65c3094a2d39 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:00.016735 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-2adace63-7097-46b6-bff1-96c8021ce3d3 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] 10.222.0.33 "DELETE /compute/v2.1/servers/8917de21-2b45-4249-ae17-17f679d4856f" status: 204 len: 0 microversion: 2.1 time: 0.156908 Oct 04 20:47:00.020360 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1486/2944] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 20:46:59 2022] DELETE /compute/v2.1/servers/8917de21-2b45-4249-ae17-17f679d4856f => generated 0 bytes in 161 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:47:00.023109 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-67f830a8-59ff-4eec-8ee8-e11d873b102b tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:00.023868 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-67f830a8-59ff-4eec-8ee8-e11d873b102b tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: 4d46fff2-b04d-41aa-ada0-2023ab545b48] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:00.030624 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-67f830a8-59ff-4eec-8ee8-e11d873b102b tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:00.031158 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-67f830a8-59ff-4eec-8ee8-e11d873b102b tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:00.032622 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-67f830a8-59ff-4eec-8ee8-e11d873b102b tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:00.032622 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-67f830a8-59ff-4eec-8ee8-e11d873b102b tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:00.033094 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-67f830a8-59ff-4eec-8ee8-e11d873b102b tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:00.033528 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-67f830a8-59ff-4eec-8ee8-e11d873b102b tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:00.228425 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-33a5d05b-09e7-44a3-a5da-65c3094a2d39 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12dc6570db03431187680f51349e55d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91111396aabd4306b66e14b5abd822ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:00.231096 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:47:00.232375 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-67f830a8-59ff-4eec-8ee8-e11d873b102b tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac650232cc04810b1340dc2f0edadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b0670d1bd99424780a70e69d57a2166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:00.239113 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-33a5d05b-09e7-44a3-a5da-65c3094a2d39 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] 10.222.0.33 "GET /compute/v2.1/servers/39e846c1-6876-42ef-b290-f733516e1051" status: 200 len: 1521 microversion: 2.1 time: 0.243769 Oct 04 20:47:00.240095 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1459/2945] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:46:59 2022] GET /compute/v2.1/servers/39e846c1-6876-42ef-b290-f733516e1051 => generated 1521 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:47:00.253080 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-67f830a8-59ff-4eec-8ee8-e11d873b102b tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48" status: 200 len: 1669 microversion: 2.1 time: 0.222679 Oct 04 20:47:00.253080 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1487/2946] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:47:00 2022] GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48 => generated 1669 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:47:00.253080 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-45616409-6b1d-442e-897f-1018218555f2 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:00.253080 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-45616409-6b1d-442e-897f-1018218555f2 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] [instance: 8917de21-2b45-4249-ae17-17f679d4856f] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:00.256052 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-45616409-6b1d-442e-897f-1018218555f2 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:00.256546 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-45616409-6b1d-442e-897f-1018218555f2 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:00.256969 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-45616409-6b1d-442e-897f-1018218555f2 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:00.257676 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-45616409-6b1d-442e-897f-1018218555f2 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:00.258163 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-45616409-6b1d-442e-897f-1018218555f2 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:00.258940 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-45616409-6b1d-442e-897f-1018218555f2 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:00.263938 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b25ccd69-0f47-40c5-8d91-36f2b52a2b66 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:00.264635 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b25ccd69-0f47-40c5-8d91-36f2b52a2b66 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: 4d46fff2-b04d-41aa-ada0-2023ab545b48] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:00.276195 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b25ccd69-0f47-40c5-8d91-36f2b52a2b66 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:00.276994 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b25ccd69-0f47-40c5-8d91-36f2b52a2b66 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:00.278279 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b25ccd69-0f47-40c5-8d91-36f2b52a2b66 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:00.279234 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b25ccd69-0f47-40c5-8d91-36f2b52a2b66 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:00.279881 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b25ccd69-0f47-40c5-8d91-36f2b52a2b66 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:00.280959 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b25ccd69-0f47-40c5-8d91-36f2b52a2b66 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:00.469164 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-45616409-6b1d-442e-897f-1018218555f2 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0967736982942f0b62db2e0546666cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f86a1d45a94f41bcd1a73694454a0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:00.477633 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-45616409-6b1d-442e-897f-1018218555f2 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] 10.222.0.33 "GET /compute/v2.1/servers/8917de21-2b45-4249-ae17-17f679d4856f" status: 200 len: 1474 microversion: 2.1 time: 0.234216 Oct 04 20:47:00.479921 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1488/2947] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:47:00 2022] GET /compute/v2.1/servers/8917de21-2b45-4249-ae17-17f679d4856f => generated 1474 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:47:00.480661 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-b25ccd69-0f47-40c5-8d91-36f2b52a2b66 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac650232cc04810b1340dc2f0edadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b0670d1bd99424780a70e69d57a2166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:00.484721 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-1f0abead-2aeb-4eb3-b048-b133f84ed69e tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:00.485353 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-1f0abead-2aeb-4eb3-b048-b133f84ed69e tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] [instance: 32237627-3fea-48d4-959f-3a2aa519adf3] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:00.488504 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b25ccd69-0f47-40c5-8d91-36f2b52a2b66 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48" status: 200 len: 1669 microversion: 2.1 time: 0.228702 Oct 04 20:47:00.491437 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1f0abead-2aeb-4eb3-b048-b133f84ed69e tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:00.491919 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1f0abead-2aeb-4eb3-b048-b133f84ed69e tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:00.492347 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1f0abead-2aeb-4eb3-b048-b133f84ed69e tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:00.493038 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1f0abead-2aeb-4eb3-b048-b133f84ed69e tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:00.493503 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1f0abead-2aeb-4eb3-b048-b133f84ed69e tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:00.493928 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1f0abead-2aeb-4eb3-b048-b133f84ed69e tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:00.497842 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1460/2948] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:47:00 2022] GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48 => generated 1669 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:47:00.511213 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7a4c07ca-2090-43bb-95bc-f4b905aa29fe tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:00.511844 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-7a4c07ca-2090-43bb-95bc-f4b905aa29fe tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: 4d46fff2-b04d-41aa-ada0-2023ab545b48] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:00.518272 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7a4c07ca-2090-43bb-95bc-f4b905aa29fe tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:00.518813 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7a4c07ca-2090-43bb-95bc-f4b905aa29fe tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:00.519256 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7a4c07ca-2090-43bb-95bc-f4b905aa29fe tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:00.519956 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7a4c07ca-2090-43bb-95bc-f4b905aa29fe tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:00.520415 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7a4c07ca-2090-43bb-95bc-f4b905aa29fe tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:00.521479 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7a4c07ca-2090-43bb-95bc-f4b905aa29fe tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:00.686471 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-1f0abead-2aeb-4eb3-b048-b133f84ed69e tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87dcc7baf63f4ae6bfe0a099adffd408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7097bc12179446f6a3e1fac8434d5c64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:00.695120 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-1f0abead-2aeb-4eb3-b048-b133f84ed69e tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] 10.222.0.33 "GET /compute/v2.1/servers/32237627-3fea-48d4-959f-3a2aa519adf3" status: 200 len: 1309 microversion: 2.1 time: 0.214159 Oct 04 20:47:00.695757 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1489/2949] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:47:00 2022] GET /compute/v2.1/servers/32237627-3fea-48d4-959f-3a2aa519adf3 => generated 1309 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:47:00.701916 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-7a4c07ca-2090-43bb-95bc-f4b905aa29fe tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac650232cc04810b1340dc2f0edadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b0670d1bd99424780a70e69d57a2166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:00.711792 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-7a4c07ca-2090-43bb-95bc-f4b905aa29fe tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48" status: 200 len: 1669 microversion: 2.1 time: 0.204661 Oct 04 20:47:00.712366 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1461/2950] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:47:00 2022] GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48 => generated 1669 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:47:00.818767 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-2873cd11-10b3-48f3-95b6-111674556d32 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1725403369", "imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63", "flavorRef": "452", "networks": [{"uuid": "f233dbb4-a3a0-4530-9ca7-211ce7f5e292"}]}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:47:00.873077 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.network.neutron [None req-2873cd11-10b3-48f3-95b6-111674556d32 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] validate_networks() for [('f233dbb4-a3a0-4530-9ca7-211ce7f5e292', None, None, None, None, None)] {{(pid=128802) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:47:00.878851 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-63a9de9a-c646-472e-b740-dc8b558fe33b tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:00.879523 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-63a9de9a-c646-472e-b740-dc8b558fe33b tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] [instance: 815db889-a211-4eab-90f8-7ca46d7102a4] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:00.887321 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-63a9de9a-c646-472e-b740-dc8b558fe33b tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:00.887819 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-63a9de9a-c646-472e-b740-dc8b558fe33b tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:00.888256 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-63a9de9a-c646-472e-b740-dc8b558fe33b tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:00.888959 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-63a9de9a-c646-472e-b740-dc8b558fe33b tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:00.889411 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-63a9de9a-c646-472e-b740-dc8b558fe33b tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:00.889840 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-63a9de9a-c646-472e-b740-dc8b558fe33b tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:01.083776 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-63a9de9a-c646-472e-b740-dc8b558fe33b tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aca59cd50bf74a36bb1e4427cd50fbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3fadcd7d4043daa0a6aba27ba814d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:01.091516 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-63a9de9a-c646-472e-b740-dc8b558fe33b tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] 10.222.0.33 "GET /compute/v2.1/servers/815db889-a211-4eab-90f8-7ca46d7102a4" status: 200 len: 1498 microversion: 2.1 time: 0.216499 Oct 04 20:47:01.092100 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1462/2951] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:47:00 2022] GET /compute/v2.1/servers/815db889-a211-4eab-90f8-7ca46d7102a4 => generated 1498 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:47:01.097246 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8a61cd25-206e-47e2-92e5-4a9439977514 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:01.097846 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-8a61cd25-206e-47e2-92e5-4a9439977514 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] [instance: 39d66e18-289f-4674-b66c-146d68ef9133] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:01.103692 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8a61cd25-206e-47e2-92e5-4a9439977514 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:01.104175 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8a61cd25-206e-47e2-92e5-4a9439977514 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:01.104599 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8a61cd25-206e-47e2-92e5-4a9439977514 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:01.105281 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8a61cd25-206e-47e2-92e5-4a9439977514 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:01.105731 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8a61cd25-206e-47e2-92e5-4a9439977514 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:01.106150 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8a61cd25-206e-47e2-92e5-4a9439977514 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:01.216744 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-8a61cd25-206e-47e2-92e5-4a9439977514 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:01.225501 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-8a61cd25-206e-47e2-92e5-4a9439977514 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:01.227038 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-8a61cd25-206e-47e2-92e5-4a9439977514 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:01.231917 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-8a61cd25-206e-47e2-92e5-4a9439977514 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] 10.222.0.33 "GET /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133" status: 200 len: 1560 microversion: 2.91 time: 0.138859 Oct 04 20:47:01.232493 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1463/2952] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:47:01 2022] GET /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133 => generated 1560 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:47:01.263830 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6baf500f-13a9-4bc5-ae43-66e4c8e58ba4 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:01.264450 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-6baf500f-13a9-4bc5-ae43-66e4c8e58ba4 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] [instance: 39e846c1-6876-42ef-b290-f733516e1051] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:01.270405 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6baf500f-13a9-4bc5-ae43-66e4c8e58ba4 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:01.271041 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6baf500f-13a9-4bc5-ae43-66e4c8e58ba4 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:01.271483 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6baf500f-13a9-4bc5-ae43-66e4c8e58ba4 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:01.272186 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6baf500f-13a9-4bc5-ae43-66e4c8e58ba4 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:01.272647 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6baf500f-13a9-4bc5-ae43-66e4c8e58ba4 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:01.273074 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6baf500f-13a9-4bc5-ae43-66e4c8e58ba4 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:01.403424 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-2873cd11-10b3-48f3-95b6-111674556d32 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Flavor limits 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:47:01.403848 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-2873cd11-10b3-48f3-95b6-111674556d32 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Image limits 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:47:01.404351 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-2873cd11-10b3-48f3-95b6-111674556d32 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Flavor pref 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:47:01.404760 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-2873cd11-10b3-48f3-95b6-111674556d32 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Image pref 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:47:01.405167 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-2873cd11-10b3-48f3-95b6-111674556d32 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:47:01.414715 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2873cd11-10b3-48f3-95b6-111674556d32 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:01.415195 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2873cd11-10b3-48f3-95b6-111674556d32 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:01.415625 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2873cd11-10b3-48f3-95b6-111674556d32 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:01.416349 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2873cd11-10b3-48f3-95b6-111674556d32 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:01.418749 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2873cd11-10b3-48f3-95b6-111674556d32 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:01.418749 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2873cd11-10b3-48f3-95b6-111674556d32 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:01.430955 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-6baf500f-13a9-4bc5-ae43-66e4c8e58ba4 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12dc6570db03431187680f51349e55d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91111396aabd4306b66e14b5abd822ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:01.437362 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-2873cd11-10b3-48f3-95b6-111674556d32 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Getting quotas for project 8b0670d1bd99424780a70e69d57a2166. Resources: {'ram', 'instances', 'cores'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:47:01.438694 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-6baf500f-13a9-4bc5-ae43-66e4c8e58ba4 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] 10.222.0.33 "GET /compute/v2.1/servers/39e846c1-6876-42ef-b290-f733516e1051" status: 200 len: 1521 microversion: 2.1 time: 0.178693 Oct 04 20:47:01.439273 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1464/2953] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:47:01 2022] GET /compute/v2.1/servers/39e846c1-6876-42ef-b290-f733516e1051 => generated 1521 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:47:01.442783 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-2873cd11-10b3-48f3-95b6-111674556d32 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Getting quotas for user eac650232cc04810b1340dc2f0edadcc and project 8b0670d1bd99424780a70e69d57a2166. Resources: {'ram', 'instances', 'cores'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:47:01.455400 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-2873cd11-10b3-48f3-95b6-111674556d32 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Going to run 1 instances... {{(pid=128802) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:47:01.457961 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-2873cd11-10b3-48f3-95b6-111674556d32 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: fde3f6fc-61e1-4b21-8b91-e95c2db3d48c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='15b24725-0c99-4bcf-b1fb-907cdf8e2d63',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128802) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:47:01.503982 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-3d101c58-2b95-49c7-90e0-a4096df14c8c tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:01.505108 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-2873cd11-10b3-48f3-95b6-111674556d32 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.690662 Oct 04 20:47:01.505898 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-3d101c58-2b95-49c7-90e0-a4096df14c8c tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] [instance: 8917de21-2b45-4249-ae17-17f679d4856f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:01.506600 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1490/2954] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 20:47:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 692 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 20:47:01.515980 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3d101c58-2b95-49c7-90e0-a4096df14c8c tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:01.516778 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3d101c58-2b95-49c7-90e0-a4096df14c8c tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:01.517656 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3d101c58-2b95-49c7-90e0-a4096df14c8c tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:01.518598 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3d101c58-2b95-49c7-90e0-a4096df14c8c tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:01.518899 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-6f9fc42b-77a1-4c47-82c7-9dd86bbcc7ff tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:01.519608 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-6f9fc42b-77a1-4c47-82c7-9dd86bbcc7ff tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: fde3f6fc-61e1-4b21-8b91-e95c2db3d48c] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:01.519740 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3d101c58-2b95-49c7-90e0-a4096df14c8c tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:01.520373 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3d101c58-2b95-49c7-90e0-a4096df14c8c tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:01.581576 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-6f9fc42b-77a1-4c47-82c7-9dd86bbcc7ff tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac650232cc04810b1340dc2f0edadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b0670d1bd99424780a70e69d57a2166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:01.590396 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-6f9fc42b-77a1-4c47-82c7-9dd86bbcc7ff tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "GET /compute/v2.1/servers/fde3f6fc-61e1-4b21-8b91-e95c2db3d48c" status: 200 len: 1215 microversion: 2.1 time: 0.077084 Oct 04 20:47:01.591365 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1491/2955] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:47:01 2022] GET /compute/v2.1/servers/fde3f6fc-61e1-4b21-8b91-e95c2db3d48c => generated 1215 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:47:01.718556 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-04008be4-7aff-4523-842c-4b13e30675b4 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:01.719073 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-04008be4-7aff-4523-842c-4b13e30675b4 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] [instance: 32237627-3fea-48d4-959f-3a2aa519adf3] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:01.726149 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-3d101c58-2b95-49c7-90e0-a4096df14c8c tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0967736982942f0b62db2e0546666cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f86a1d45a94f41bcd1a73694454a0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:01.727224 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-04008be4-7aff-4523-842c-4b13e30675b4 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:01.728353 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-04008be4-7aff-4523-842c-4b13e30675b4 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:01.729390 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-04008be4-7aff-4523-842c-4b13e30675b4 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:01.730935 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-04008be4-7aff-4523-842c-4b13e30675b4 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:01.732161 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-04008be4-7aff-4523-842c-4b13e30675b4 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:01.733826 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-04008be4-7aff-4523-842c-4b13e30675b4 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:01.735251 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-3d101c58-2b95-49c7-90e0-a4096df14c8c tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] 10.222.0.33 "GET /compute/v2.1/servers/8917de21-2b45-4249-ae17-17f679d4856f" status: 200 len: 1474 microversion: 2.1 time: 0.235723 Oct 04 20:47:01.746058 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1465/2956] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:47:01 2022] GET /compute/v2.1/servers/8917de21-2b45-4249-ae17-17f679d4856f => generated 1474 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:47:01.879650 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-aa4d5b6e-2b87-4f2b-9c4c-dbc1ee2e476c req-eda60dba-4634-4f25-842f-73b779642d02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32237627-3fea-48d4-959f-3a2aa519adf3", "name": "network-vif-plugged", "status": "completed", "tag": "397f83d3-7c45-4acb-949d-c35a707bccac"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:47:01.898268 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:47:01.899262 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-04008be4-7aff-4523-842c-4b13e30675b4 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87dcc7baf63f4ae6bfe0a099adffd408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7097bc12179446f6a3e1fac8434d5c64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:01.902329 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-aa4d5b6e-2b87-4f2b-9c4c-dbc1ee2e476c req-eda60dba-4634-4f25-842f-73b779642d02 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:01.902885 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-aa4d5b6e-2b87-4f2b-9c4c-dbc1ee2e476c req-eda60dba-4634-4f25-842f-73b779642d02 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:01.903318 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-aa4d5b6e-2b87-4f2b-9c4c-dbc1ee2e476c req-eda60dba-4634-4f25-842f-73b779642d02 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:01.914652 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-04008be4-7aff-4523-842c-4b13e30675b4 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] 10.222.0.33 "GET /compute/v2.1/servers/32237627-3fea-48d4-959f-3a2aa519adf3" status: 200 len: 1309 microversion: 2.1 time: 0.199794 Oct 04 20:47:01.915567 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1492/2957] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:47:01 2022] GET /compute/v2.1/servers/32237627-3fea-48d4-959f-3a2aa519adf3 => generated 1309 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:47:01.928256 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-aa4d5b6e-2b87-4f2b-9c4c-dbc1ee2e476c req-eda60dba-4634-4f25-842f-73b779642d02 service nova] Creating event network-vif-plugged:397f83d3-7c45-4acb-949d-c35a707bccac for instance 32237627-3fea-48d4-959f-3a2aa519adf3 on n-h2-854823-8 Oct 04 20:47:01.948960 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-aa4d5b6e-2b87-4f2b-9c4c-dbc1ee2e476c req-eda60dba-4634-4f25-842f-73b779642d02 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072756 Oct 04 20:47:01.951572 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1466/2958] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:47:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:47:02.117115 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-5ecc194b-b3e5-4a0f-802f-0b4e60b251d6 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:02.117842 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-5ecc194b-b3e5-4a0f-802f-0b4e60b251d6 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] [instance: 815db889-a211-4eab-90f8-7ca46d7102a4] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:02.124736 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5ecc194b-b3e5-4a0f-802f-0b4e60b251d6 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:02.125429 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5ecc194b-b3e5-4a0f-802f-0b4e60b251d6 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:02.126051 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5ecc194b-b3e5-4a0f-802f-0b4e60b251d6 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:02.126981 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5ecc194b-b3e5-4a0f-802f-0b4e60b251d6 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:02.127595 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5ecc194b-b3e5-4a0f-802f-0b4e60b251d6 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:02.128262 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5ecc194b-b3e5-4a0f-802f-0b4e60b251d6 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:02.260113 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a55eab8b-e962-41c9-bef8-a0072123e26c tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:02.261044 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a55eab8b-e962-41c9-bef8-a0072123e26c tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] [instance: 39d66e18-289f-4674-b66c-146d68ef9133] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:02.267858 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a55eab8b-e962-41c9-bef8-a0072123e26c tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:02.268717 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a55eab8b-e962-41c9-bef8-a0072123e26c tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:02.269464 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a55eab8b-e962-41c9-bef8-a0072123e26c tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:02.271224 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a55eab8b-e962-41c9-bef8-a0072123e26c tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:02.272000 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a55eab8b-e962-41c9-bef8-a0072123e26c tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:02.272692 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a55eab8b-e962-41c9-bef8-a0072123e26c tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:02.316111 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-5ecc194b-b3e5-4a0f-802f-0b4e60b251d6 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aca59cd50bf74a36bb1e4427cd50fbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3fadcd7d4043daa0a6aba27ba814d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:02.324766 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-5ecc194b-b3e5-4a0f-802f-0b4e60b251d6 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] 10.222.0.33 "GET /compute/v2.1/servers/815db889-a211-4eab-90f8-7ca46d7102a4" status: 200 len: 1475 microversion: 2.1 time: 0.214370 Oct 04 20:47:02.338781 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1493/2959] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:47:02 2022] GET /compute/v2.1/servers/815db889-a211-4eab-90f8-7ca46d7102a4 => generated 1475 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:47:02.348129 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-f9af12c1-7377-42f5-ad59-2b6018358baa tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-27709645"}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:47:02.351790 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-f9af12c1-7377-42f5-ad59-2b6018358baa tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] [instance: 815db889-a211-4eab-90f8-7ca46d7102a4] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:02.366193 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f9af12c1-7377-42f5-ad59-2b6018358baa tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:02.366774 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f9af12c1-7377-42f5-ad59-2b6018358baa tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:02.367218 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f9af12c1-7377-42f5-ad59-2b6018358baa tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:02.367946 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f9af12c1-7377-42f5-ad59-2b6018358baa tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:02.368400 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f9af12c1-7377-42f5-ad59-2b6018358baa tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:02.368944 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f9af12c1-7377-42f5-ad59-2b6018358baa tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:02.377193 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-a55eab8b-e962-41c9-bef8-a0072123e26c tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:02.386802 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-a55eab8b-e962-41c9-bef8-a0072123e26c tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:02.389662 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-a55eab8b-e962-41c9-bef8-a0072123e26c tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:02.396807 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a55eab8b-e962-41c9-bef8-a0072123e26c tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] 10.222.0.33 "GET /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133" status: 200 len: 1555 microversion: 2.91 time: 0.140194 Oct 04 20:47:02.397960 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1467/2960] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:47:02 2022] GET /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133 => generated 1555 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 20:47:02.462750 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d3958d8f-30a5-4fc6-97e4-ee2b22467ce3 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:02.463364 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d3958d8f-30a5-4fc6-97e4-ee2b22467ce3 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] [instance: 39e846c1-6876-42ef-b290-f733516e1051] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:02.472560 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d3958d8f-30a5-4fc6-97e4-ee2b22467ce3 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:02.477482 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d3958d8f-30a5-4fc6-97e4-ee2b22467ce3 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:02.477814 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d3958d8f-30a5-4fc6-97e4-ee2b22467ce3 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:02.478564 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d3958d8f-30a5-4fc6-97e4-ee2b22467ce3 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:02.479021 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d3958d8f-30a5-4fc6-97e4-ee2b22467ce3 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:02.479441 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d3958d8f-30a5-4fc6-97e4-ee2b22467ce3 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:02.704800 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-f9af12c1-7377-42f5-ad59-2b6018358baa tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] 10.222.0.33 "POST /compute/v2.1/servers/815db889-a211-4eab-90f8-7ca46d7102a4/action" status: 202 len: 0 microversion: 2.1 time: 0.356548 Oct 04 20:47:02.707465 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1494/2961] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 20:47:02 2022] POST /compute/v2.1/servers/815db889-a211-4eab-90f8-7ca46d7102a4/action => generated 0 bytes in 364 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 04 20:47:02.714727 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-c4fd64b2-a573-4f8f-a184-ab9fd8874054 req-ffb11e69-c81b-4f16-a43e-528a254fb2de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8917de21-2b45-4249-ae17-17f679d4856f", "name": "network-vif-deleted", "tag": "ec043ecd-8aa4-4125-9877-75f2ddd3f7ee"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:47:02.732291 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-c4fd64b2-a573-4f8f-a184-ab9fd8874054 req-ffb11e69-c81b-4f16-a43e-528a254fb2de service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:02.733171 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-c4fd64b2-a573-4f8f-a184-ab9fd8874054 req-ffb11e69-c81b-4f16-a43e-528a254fb2de service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:02.734526 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-c4fd64b2-a573-4f8f-a184-ab9fd8874054 req-ffb11e69-c81b-4f16-a43e-528a254fb2de service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:02.748987 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-c4fd64b2-a573-4f8f-a184-ab9fd8874054 req-ffb11e69-c81b-4f16-a43e-528a254fb2de service nova] Creating event network-vif-deleted:ec043ecd-8aa4-4125-9877-75f2ddd3f7ee for instance 8917de21-2b45-4249-ae17-17f679d4856f on n-h2-854823-8 Oct 04 20:47:02.754317 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-c4fd64b2-a573-4f8f-a184-ab9fd8874054 req-ffb11e69-c81b-4f16-a43e-528a254fb2de service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044464 Oct 04 20:47:02.756029 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1495/2962] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:47:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:47:02.762477 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-f67df354-8178-4ef1-b516-b4afa1c78652 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:02.763433 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-f67df354-8178-4ef1-b516-b4afa1c78652 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: fde3f6fc-61e1-4b21-8b91-e95c2db3d48c] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:02.769980 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f67df354-8178-4ef1-b516-b4afa1c78652 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:02.771961 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f67df354-8178-4ef1-b516-b4afa1c78652 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:02.772616 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f67df354-8178-4ef1-b516-b4afa1c78652 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:02.776443 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f67df354-8178-4ef1-b516-b4afa1c78652 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:02.777010 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f67df354-8178-4ef1-b516-b4afa1c78652 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:02.777513 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f67df354-8178-4ef1-b516-b4afa1c78652 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:02.782335 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:47:02.798293 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d3958d8f-30a5-4fc6-97e4-ee2b22467ce3 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12dc6570db03431187680f51349e55d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91111396aabd4306b66e14b5abd822ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:02.816814 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d3958d8f-30a5-4fc6-97e4-ee2b22467ce3 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] 10.222.0.33 "GET /compute/v2.1/servers/39e846c1-6876-42ef-b290-f733516e1051" status: 200 len: 1521 microversion: 2.1 time: 0.359024 Oct 04 20:47:02.827185 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1468/2963] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:47:02 2022] GET /compute/v2.1/servers/39e846c1-6876-42ef-b290-f733516e1051 => generated 1521 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:47:02.843510 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a188fb7f-b9e9-4260-bd95-10b52749045d tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Calling method '.version_select at 0x7f3c74de1280>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:02.903509 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-f67df354-8178-4ef1-b516-b4afa1c78652 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac650232cc04810b1340dc2f0edadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b0670d1bd99424780a70e69d57a2166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:02.911571 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-f67df354-8178-4ef1-b516-b4afa1c78652 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "GET /compute/v2.1/servers/fde3f6fc-61e1-4b21-8b91-e95c2db3d48c" status: 200 len: 1211 microversion: 2.1 time: 0.153974 Oct 04 20:47:02.924189 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a188fb7f-b9e9-4260-bd95-10b52749045d tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] 10.222.0.33 "GET /compute/v2.1/images/5804f6f0-d786-4197-9403-11c4a65faccd" status: 200 len: 1410 microversion: 2.1 time: 0.090570 Oct 04 20:47:02.925001 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1469/2964] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 20:47:02 2022] GET /compute/v2.1/images/5804f6f0-d786-4197-9403-11c4a65faccd => generated 1410 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:47:02.928012 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1496/2965] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:47:02 2022] GET /compute/v2.1/servers/fde3f6fc-61e1-4b21-8b91-e95c2db3d48c => generated 1211 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:47:02.936626 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ec70728f-4e54-44e1-86a9-88d0aef6d0f4 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:02.938320 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ec70728f-4e54-44e1-86a9-88d0aef6d0f4 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] [instance: 8917de21-2b45-4249-ae17-17f679d4856f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:02.945229 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-a42004e4-2c07-4fbe-b8b0-4df2ca8846f4 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:02.946079 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-a42004e4-2c07-4fbe-b8b0-4df2ca8846f4 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] [instance: 32237627-3fea-48d4-959f-3a2aa519adf3] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:02.954628 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ec70728f-4e54-44e1-86a9-88d0aef6d0f4 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:02.955364 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ec70728f-4e54-44e1-86a9-88d0aef6d0f4 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:02.955558 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ec70728f-4e54-44e1-86a9-88d0aef6d0f4 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:02.956443 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a42004e4-2c07-4fbe-b8b0-4df2ca8846f4 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:02.956577 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ec70728f-4e54-44e1-86a9-88d0aef6d0f4 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:02.956981 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ec70728f-4e54-44e1-86a9-88d0aef6d0f4 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:02.957409 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ec70728f-4e54-44e1-86a9-88d0aef6d0f4 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:02.958009 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a42004e4-2c07-4fbe-b8b0-4df2ca8846f4 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:02.959188 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a42004e4-2c07-4fbe-b8b0-4df2ca8846f4 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:02.960047 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a42004e4-2c07-4fbe-b8b0-4df2ca8846f4 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:02.960657 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a42004e4-2c07-4fbe-b8b0-4df2ca8846f4 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:02.961231 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a42004e4-2c07-4fbe-b8b0-4df2ca8846f4 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:03.094881 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-ec70728f-4e54-44e1-86a9-88d0aef6d0f4 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0967736982942f0b62db2e0546666cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f86a1d45a94f41bcd1a73694454a0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:03.110172 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ec70728f-4e54-44e1-86a9-88d0aef6d0f4 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] 10.222.0.33 "GET /compute/v2.1/servers/8917de21-2b45-4249-ae17-17f679d4856f" status: 200 len: 1303 microversion: 2.1 time: 0.184233 Oct 04 20:47:03.111373 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1470/2966] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:47:02 2022] GET /compute/v2.1/servers/8917de21-2b45-4249-ae17-17f679d4856f => generated 1303 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:47:03.191377 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-a42004e4-2c07-4fbe-b8b0-4df2ca8846f4 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87dcc7baf63f4ae6bfe0a099adffd408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7097bc12179446f6a3e1fac8434d5c64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:03.201408 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-a42004e4-2c07-4fbe-b8b0-4df2ca8846f4 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] 10.222.0.33 "GET /compute/v2.1/servers/32237627-3fea-48d4-959f-3a2aa519adf3" status: 200 len: 1309 microversion: 2.1 time: 0.265138 Oct 04 20:47:03.202106 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1497/2967] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:47:02 2022] GET /compute/v2.1/servers/32237627-3fea-48d4-959f-3a2aa519adf3 => generated 1309 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:47:03.425106 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-80d1b431-1ed6-4aea-8568-3de4ef9b1280 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:03.425715 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-80d1b431-1ed6-4aea-8568-3de4ef9b1280 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] [instance: 39d66e18-289f-4674-b66c-146d68ef9133] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:03.433717 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-80d1b431-1ed6-4aea-8568-3de4ef9b1280 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:03.434281 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-80d1b431-1ed6-4aea-8568-3de4ef9b1280 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:03.434654 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-80d1b431-1ed6-4aea-8568-3de4ef9b1280 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:03.435352 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-80d1b431-1ed6-4aea-8568-3de4ef9b1280 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:03.435834 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-80d1b431-1ed6-4aea-8568-3de4ef9b1280 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:03.436254 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-80d1b431-1ed6-4aea-8568-3de4ef9b1280 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:03.513692 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-80d1b431-1ed6-4aea-8568-3de4ef9b1280 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:03.522563 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-80d1b431-1ed6-4aea-8568-3de4ef9b1280 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:03.524327 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-80d1b431-1ed6-4aea-8568-3de4ef9b1280 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:03.530185 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-80d1b431-1ed6-4aea-8568-3de4ef9b1280 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] 10.222.0.33 "GET /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133" status: 200 len: 1555 microversion: 2.91 time: 0.108952 Oct 04 20:47:03.530805 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1471/2968] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:47:03 2022] GET /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133 => generated 1555 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:47:03.854186 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-5e1c3b39-626b-4cd7-b1e2-88ebbba0d982 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:03.854947 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-5e1c3b39-626b-4cd7-b1e2-88ebbba0d982 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] [instance: 39e846c1-6876-42ef-b290-f733516e1051] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:03.868181 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5e1c3b39-626b-4cd7-b1e2-88ebbba0d982 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:03.868684 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5e1c3b39-626b-4cd7-b1e2-88ebbba0d982 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:03.869125 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5e1c3b39-626b-4cd7-b1e2-88ebbba0d982 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:03.869843 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5e1c3b39-626b-4cd7-b1e2-88ebbba0d982 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:03.870296 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5e1c3b39-626b-4cd7-b1e2-88ebbba0d982 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:03.874093 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5e1c3b39-626b-4cd7-b1e2-88ebbba0d982 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:03.935460 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-038924b1-e93e-4c28-a6cd-ce323bbae25b tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:03.936122 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-038924b1-e93e-4c28-a6cd-ce323bbae25b tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: fde3f6fc-61e1-4b21-8b91-e95c2db3d48c] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:03.942712 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-038924b1-e93e-4c28-a6cd-ce323bbae25b tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:03.943195 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-038924b1-e93e-4c28-a6cd-ce323bbae25b tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:03.943628 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-038924b1-e93e-4c28-a6cd-ce323bbae25b tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:03.944324 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-038924b1-e93e-4c28-a6cd-ce323bbae25b tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:03.944771 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-038924b1-e93e-4c28-a6cd-ce323bbae25b tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:03.945190 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-038924b1-e93e-4c28-a6cd-ce323bbae25b tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:04.039366 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-038924b1-e93e-4c28-a6cd-ce323bbae25b tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac650232cc04810b1340dc2f0edadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b0670d1bd99424780a70e69d57a2166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:04.049705 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-038924b1-e93e-4c28-a6cd-ce323bbae25b tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "GET /compute/v2.1/servers/fde3f6fc-61e1-4b21-8b91-e95c2db3d48c" status: 200 len: 1267 microversion: 2.1 time: 0.118216 Oct 04 20:47:04.065503 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1472/2969] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:47:03 2022] GET /compute/v2.1/servers/fde3f6fc-61e1-4b21-8b91-e95c2db3d48c => generated 1267 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:47:04.070967 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6008bc4f-f408-4f55-8709-edd7cb3ffd0d tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Calling method '.version_select at 0x7f3c74f3d8b0>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:04.076912 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:47:04.090391 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-5e1c3b39-626b-4cd7-b1e2-88ebbba0d982 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12dc6570db03431187680f51349e55d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91111396aabd4306b66e14b5abd822ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:04.101488 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-5e1c3b39-626b-4cd7-b1e2-88ebbba0d982 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] 10.222.0.33 "GET /compute/v2.1/servers/39e846c1-6876-42ef-b290-f733516e1051" status: 200 len: 1521 microversion: 2.1 time: 0.254542 Oct 04 20:47:04.102086 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1498/2970] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:47:03 2022] GET /compute/v2.1/servers/39e846c1-6876-42ef-b290-f733516e1051 => generated 1521 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:47:04.134950 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-6008bc4f-f408-4f55-8709-edd7cb3ffd0d tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] 10.222.0.33 "GET /compute/v2.1/images/5804f6f0-d786-4197-9403-11c4a65faccd" status: 200 len: 1410 microversion: 2.1 time: 0.068260 Oct 04 20:47:04.135426 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-7fef6af4-a7f9-43dc-8240-005be1b98cf1 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:04.135842 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1473/2971] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 20:47:04 2022] GET /compute/v2.1/images/5804f6f0-d786-4197-9403-11c4a65faccd => generated 1410 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:47:04.143950 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-7fef6af4-a7f9-43dc-8240-005be1b98cf1 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] [instance: 8917de21-2b45-4249-ae17-17f679d4856f] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:04.151245 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7fef6af4-a7f9-43dc-8240-005be1b98cf1 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:04.152330 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7fef6af4-a7f9-43dc-8240-005be1b98cf1 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:04.152330 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7fef6af4-a7f9-43dc-8240-005be1b98cf1 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:04.153001 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7fef6af4-a7f9-43dc-8240-005be1b98cf1 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:04.153552 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7fef6af4-a7f9-43dc-8240-005be1b98cf1 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:04.154029 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7fef6af4-a7f9-43dc-8240-005be1b98cf1 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:04.197204 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7fef6af4-a7f9-43dc-8240-005be1b98cf1 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:04.198118 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7fef6af4-a7f9-43dc-8240-005be1b98cf1 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:04.198843 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7fef6af4-a7f9-43dc-8240-005be1b98cf1 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:04.199563 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.objects.instance [None req-7fef6af4-a7f9-43dc-8240-005be1b98cf1 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Lazy-loading 'fault' on Instance uuid 8917de21-2b45-4249-ae17-17f679d4856f {{(pid=128802) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:47:04.227056 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-4b6734d6-1d6a-4b0f-8b44-b64e4bfbd25b tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:04.227706 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-4b6734d6-1d6a-4b0f-8b44-b64e4bfbd25b tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] [instance: 32237627-3fea-48d4-959f-3a2aa519adf3] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:04.238923 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4b6734d6-1d6a-4b0f-8b44-b64e4bfbd25b tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:04.239453 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4b6734d6-1d6a-4b0f-8b44-b64e4bfbd25b tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:04.239926 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4b6734d6-1d6a-4b0f-8b44-b64e4bfbd25b tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:04.240587 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4b6734d6-1d6a-4b0f-8b44-b64e4bfbd25b tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:04.241038 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4b6734d6-1d6a-4b0f-8b44-b64e4bfbd25b tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:04.241454 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4b6734d6-1d6a-4b0f-8b44-b64e4bfbd25b tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:04.286393 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-7fef6af4-a7f9-43dc-8240-005be1b98cf1 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0967736982942f0b62db2e0546666cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f86a1d45a94f41bcd1a73694454a0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:04.295853 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-7fef6af4-a7f9-43dc-8240-005be1b98cf1 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] 10.222.0.33 "GET /compute/v2.1/servers/8917de21-2b45-4249-ae17-17f679d4856f" status: 200 len: 1308 microversion: 2.1 time: 0.164208 Oct 04 20:47:04.296539 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1499/2972] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:47:04 2022] GET /compute/v2.1/servers/8917de21-2b45-4249-ae17-17f679d4856f => generated 1308 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:47:04.547001 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-4b6734d6-1d6a-4b0f-8b44-b64e4bfbd25b tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87dcc7baf63f4ae6bfe0a099adffd408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7097bc12179446f6a3e1fac8434d5c64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:04.559463 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-4aaf348f-2401-406c-b861-93af754161a6 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:04.560079 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-4aaf348f-2401-406c-b861-93af754161a6 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] [instance: 39d66e18-289f-4674-b66c-146d68ef9133] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:04.560735 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-4b6734d6-1d6a-4b0f-8b44-b64e4bfbd25b tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] 10.222.0.33 "GET /compute/v2.1/servers/32237627-3fea-48d4-959f-3a2aa519adf3" status: 200 len: 1490 microversion: 2.1 time: 0.338271 Oct 04 20:47:04.576001 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1474/2973] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:47:04 2022] GET /compute/v2.1/servers/32237627-3fea-48d4-959f-3a2aa519adf3 => generated 1490 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:47:04.581259 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4aaf348f-2401-406c-b861-93af754161a6 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:04.582623 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4aaf348f-2401-406c-b861-93af754161a6 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:04.584571 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4aaf348f-2401-406c-b861-93af754161a6 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:04.587272 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4aaf348f-2401-406c-b861-93af754161a6 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:04.588339 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4aaf348f-2401-406c-b861-93af754161a6 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:04.588978 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4aaf348f-2401-406c-b861-93af754161a6 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:04.601805 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-08a18130-927a-4cc7-bd58-96b4d3272958 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Action: 'update', calling method: >, body: {"server": {"accessIPv4": "1.1.1.1", "accessIPv6": "::babe:202:202"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:47:04.613854 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-08a18130-927a-4cc7-bd58-96b4d3272958 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] [instance: 32237627-3fea-48d4-959f-3a2aa519adf3] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:04.633775 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-08a18130-927a-4cc7-bd58-96b4d3272958 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:04.634544 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-08a18130-927a-4cc7-bd58-96b4d3272958 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:04.635185 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-08a18130-927a-4cc7-bd58-96b4d3272958 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:04.636042 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-08a18130-927a-4cc7-bd58-96b4d3272958 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:04.637804 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-08a18130-927a-4cc7-bd58-96b4d3272958 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:04.638745 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-08a18130-927a-4cc7-bd58-96b4d3272958 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:04.746488 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-4aaf348f-2401-406c-b861-93af754161a6 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:04.757382 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-4aaf348f-2401-406c-b861-93af754161a6 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:04.759433 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-4aaf348f-2401-406c-b861-93af754161a6 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:04.762975 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:47:04.766396 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-4aaf348f-2401-406c-b861-93af754161a6 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] 10.222.0.33 "GET /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133" status: 200 len: 1555 microversion: 2.91 time: 0.211485 Oct 04 20:47:04.786374 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1500/2974] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:47:04 2022] GET /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133 => generated 1555 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:47:04.794902 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-08a18130-927a-4cc7-bd58-96b4d3272958 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] 10.222.0.33 "PUT /compute/v2.1/servers/32237627-3fea-48d4-959f-3a2aa519adf3" status: 200 len: 1085 microversion: 2.1 time: 0.201641 Oct 04 20:47:04.800249 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1475/2975] 10.222.0.33 () {60 vars in 1256 bytes} [Tue Oct 4 20:47:04 2022] PUT /compute/v2.1/servers/32237627-3fea-48d4-959f-3a2aa519adf3 => generated 1085 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:47:04.818248 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-3998a18b-f9a5-4269-ad4c-16d800b3a787 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:04.818887 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-3998a18b-f9a5-4269-ad4c-16d800b3a787 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] [instance: 32237627-3fea-48d4-959f-3a2aa519adf3] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:04.825611 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3998a18b-f9a5-4269-ad4c-16d800b3a787 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:04.826326 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3998a18b-f9a5-4269-ad4c-16d800b3a787 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:04.826782 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3998a18b-f9a5-4269-ad4c-16d800b3a787 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:04.827482 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3998a18b-f9a5-4269-ad4c-16d800b3a787 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:04.827936 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3998a18b-f9a5-4269-ad4c-16d800b3a787 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:04.828370 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3998a18b-f9a5-4269-ad4c-16d800b3a787 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:05.008446 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-3998a18b-f9a5-4269-ad4c-16d800b3a787 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87dcc7baf63f4ae6bfe0a099adffd408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7097bc12179446f6a3e1fac8434d5c64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:05.019029 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-3998a18b-f9a5-4269-ad4c-16d800b3a787 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] 10.222.0.33 "GET /compute/v2.1/servers/32237627-3fea-48d4-959f-3a2aa519adf3" status: 200 len: 1511 microversion: 2.1 time: 0.205131 Oct 04 20:47:05.036143 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1501/2976] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:47:04 2022] GET /compute/v2.1/servers/32237627-3fea-48d4-959f-3a2aa519adf3 => generated 1511 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:47:05.042057 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-3469a153-b299-467c-87b9-087c41689834 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:05.042689 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-3469a153-b299-467c-87b9-087c41689834 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] [instance: 32237627-3fea-48d4-959f-3a2aa519adf3] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:05.049802 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3469a153-b299-467c-87b9-087c41689834 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:05.050291 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3469a153-b299-467c-87b9-087c41689834 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:05.050915 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3469a153-b299-467c-87b9-087c41689834 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:05.051702 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3469a153-b299-467c-87b9-087c41689834 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:05.052348 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3469a153-b299-467c-87b9-087c41689834 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:05.052832 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3469a153-b299-467c-87b9-087c41689834 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:05.072432 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-73e6908c-a91d-4d94-b630-966843586b98 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:05.073041 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-73e6908c-a91d-4d94-b630-966843586b98 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: fde3f6fc-61e1-4b21-8b91-e95c2db3d48c] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:05.081439 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-73e6908c-a91d-4d94-b630-966843586b98 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:05.087096 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-73e6908c-a91d-4d94-b630-966843586b98 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:05.087948 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-73e6908c-a91d-4d94-b630-966843586b98 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:05.090092 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-73e6908c-a91d-4d94-b630-966843586b98 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:05.091648 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-73e6908c-a91d-4d94-b630-966843586b98 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:05.092236 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-73e6908c-a91d-4d94-b630-966843586b98 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:05.223392 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-73e6908c-a91d-4d94-b630-966843586b98 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac650232cc04810b1340dc2f0edadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b0670d1bd99424780a70e69d57a2166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:05.240324 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-73e6908c-a91d-4d94-b630-966843586b98 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "GET /compute/v2.1/servers/fde3f6fc-61e1-4b21-8b91-e95c2db3d48c" status: 200 len: 1273 microversion: 2.1 time: 0.170616 Oct 04 20:47:05.254370 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1502/2977] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:47:05 2022] GET /compute/v2.1/servers/fde3f6fc-61e1-4b21-8b91-e95c2db3d48c => generated 1273 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:47:05.254370 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-03922517-4551-4c12-9b00-31639802a109 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:05.254370 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-03922517-4551-4c12-9b00-31639802a109 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] [instance: 39e846c1-6876-42ef-b290-f733516e1051] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:05.256739 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-03922517-4551-4c12-9b00-31639802a109 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:05.256739 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-03922517-4551-4c12-9b00-31639802a109 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:05.256739 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-03922517-4551-4c12-9b00-31639802a109 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:05.257057 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-03922517-4551-4c12-9b00-31639802a109 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:05.258068 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-03922517-4551-4c12-9b00-31639802a109 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:05.258068 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-03922517-4551-4c12-9b00-31639802a109 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:05.309862 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-3469a153-b299-467c-87b9-087c41689834 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87dcc7baf63f4ae6bfe0a099adffd408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7097bc12179446f6a3e1fac8434d5c64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:05.328280 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-3469a153-b299-467c-87b9-087c41689834 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] 10.222.0.33 "GET /compute/v2.1/servers/32237627-3fea-48d4-959f-3a2aa519adf3" status: 200 len: 1511 microversion: 2.1 time: 0.285391 Oct 04 20:47:05.329335 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1476/2978] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:47:05 2022] GET /compute/v2.1/servers/32237627-3fea-48d4-959f-3a2aa519adf3 => generated 1511 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:47:05.340512 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e4d6437f-b3f5-497d-95bb-972bd757a1bf tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Calling method '.version_select at 0x7f3c74ff1550>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:05.408556 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e4d6437f-b3f5-497d-95bb-972bd757a1bf tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] 10.222.0.33 "GET /compute/v2.1/images/5804f6f0-d786-4197-9403-11c4a65faccd" status: 200 len: 1410 microversion: 2.1 time: 0.078206 Oct 04 20:47:05.421457 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1477/2979] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 20:47:05 2022] GET /compute/v2.1/images/5804f6f0-d786-4197-9403-11c4a65faccd => generated 1410 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:47:05.427475 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f555de5b-113c-47e5-a09c-fad48988bf43 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:05.428282 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f555de5b-113c-47e5-a09c-fad48988bf43 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] [instance: 8917de21-2b45-4249-ae17-17f679d4856f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:05.435971 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f555de5b-113c-47e5-a09c-fad48988bf43 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:05.436720 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f555de5b-113c-47e5-a09c-fad48988bf43 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:05.437387 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f555de5b-113c-47e5-a09c-fad48988bf43 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:05.438249 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f555de5b-113c-47e5-a09c-fad48988bf43 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:05.438940 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f555de5b-113c-47e5-a09c-fad48988bf43 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:05.439532 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f555de5b-113c-47e5-a09c-fad48988bf43 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:05.462840 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-f555de5b-113c-47e5-a09c-fad48988bf43 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] HTTP exception thrown: Instance 8917de21-2b45-4249-ae17-17f679d4856f could not be found. Oct 04 20:47:05.464775 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f555de5b-113c-47e5-a09c-fad48988bf43 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Request method failure captured: Oct 04 20:47:05.464775 n-d-854823-8 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/8917de21-2b45-4249-ae17-17f679d4856f HTTP/1.1 Oct 04 20:47:05.464775 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:47:05.464775 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:47:05.464775 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:47:05.464775 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 0 Oct 04 20:47:05.464775 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:47:05.464775 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:47:05.464775 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:47:05.464775 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:47:05.464775 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJtWArqyogZMwpE-j09gr-22ch7iWmenfMPnqPrxZQiKXyrLOZH-U2EuJx7rXrNJbsmHJbOWQknxG0xwpqQnDFzrfpjMdNtSWwAVE7eLo2dWo5IlDwqJyswbCGVys2fXjSqVQ2Io5xdnpkKMji9bQP5p2VGElnwZm2OCZ0UFRRkt54E Oct 04 20:47:05.464775 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:47:05.464775 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:47:05.464775 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:47:05.464775 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:47:05.464775 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:47:05.464775 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:47:05.464775 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: b5f86a1d45a94f41bcd1a73694454a0d Oct 04 20:47:05.464775 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-ListImageFiltersTestJSON-1176779314 Oct 04 20:47:05.464775 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 20:47:05.464775 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 20:47:05.464775 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b5f86a1d45a94f41bcd1a73694454a0d", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b5f86a1d45a94f41bcd1a73694454a0d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b5f86a1d45a94f41bcd1a73694454a0d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b5f86a1d45a94f41bcd1a73694454a0d"}]}] Oct 04 20:47:05.464775 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-ListImageFiltersTestJSON-1176779314 Oct 04 20:47:05.464775 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: b5f86a1d45a94f41bcd1a73694454a0d Oct 04 20:47:05.464775 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-1176779314 Oct 04 20:47:05.464775 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-ListImageFiltersTestJSON-1176779314-project Oct 04 20:47:05.464775 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:47:05.464775 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:47:05.464775 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: c0967736982942f0b62db2e0546666cf Oct 04 20:47:05.464775 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-ListImageFiltersTestJSON-1176779314-project Oct 04 20:47:05.464775 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 20:47:05.464775 n-d-854823-8 devstack@n-api.service[128801]: exception: Instance 8917de21-2b45-4249-ae17-17f679d4856f could not be found. Oct 04 20:47:05.464775 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': '8917de21-2b45-4249-ae17-17f679d4856f'} Oct 04 20:47:05.464775 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:47:05.464775 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:47:05.464775 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:47:05.464775 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:47:05.464775 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:47:05.464775 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:47:05.464775 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:47:05.464775 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:47:05.464775 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:47:05.464775 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:47:05.464775 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8917de21-2b45-4249-ae17-17f679d4856f could not be found. Oct 04 20:47:05.464775 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:47:05.464775 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:47:05.464775 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:47:05.464775 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:47:05.464775 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:47:05.464775 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:47:05.464775 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:47:05.464775 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:47:05.464775 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:47:05.464775 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:47:05.464775 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:47:05.464775 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:47:05.464775 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:47:05.464775 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:47:05.464775 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:47:05.464775 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:47:05.464775 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8917de21-2b45-4249-ae17-17f679d4856f could not be found. Oct 04 20:47:05.464775 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:47:05.464775 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:47:05.464775 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:47:05.469624 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:47:05.469624 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:47:05.469624 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:47:05.469624 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:47:05.469624 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:47:05.469624 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8917de21-2b45-4249-ae17-17f679d4856f could not be found. Oct 04 20:47:05.469624 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:47:05.471200 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f555de5b-113c-47e5-a09c-fad48988bf43 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Returning 404 to user: Instance 8917de21-2b45-4249-ae17-17f679d4856f could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:47:05.472647 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f555de5b-113c-47e5-a09c-fad48988bf43 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] 10.222.0.33 "GET /compute/v2.1/servers/8917de21-2b45-4249-ae17-17f679d4856f" status: 404 len: 111 microversion: 2.1 time: 0.049400 Oct 04 20:47:05.474456 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1478/2980] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:47:05 2022] GET /compute/v2.1/servers/8917de21-2b45-4249-ae17-17f679d4856f => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:47:05.481659 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b1097552-6d5e-4308-ac0b-c6a5f1417c74 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:05.482830 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b1097552-6d5e-4308-ac0b-c6a5f1417c74 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] [instance: 32237627-3fea-48d4-959f-3a2aa519adf3] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:05.489758 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b1097552-6d5e-4308-ac0b-c6a5f1417c74 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:05.490609 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b1097552-6d5e-4308-ac0b-c6a5f1417c74 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:05.491489 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b1097552-6d5e-4308-ac0b-c6a5f1417c74 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:05.492980 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b1097552-6d5e-4308-ac0b-c6a5f1417c74 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:05.493605 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b1097552-6d5e-4308-ac0b-c6a5f1417c74 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:05.503572 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-03922517-4551-4c12-9b00-31639802a109 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12dc6570db03431187680f51349e55d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91111396aabd4306b66e14b5abd822ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:05.507353 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b1097552-6d5e-4308-ac0b-c6a5f1417c74 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:05.519063 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-03922517-4551-4c12-9b00-31639802a109 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] 10.222.0.33 "GET /compute/v2.1/servers/39e846c1-6876-42ef-b290-f733516e1051" status: 200 len: 1521 microversion: 2.1 time: 0.275915 Oct 04 20:47:05.522264 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1503/2981] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:47:05 2022] GET /compute/v2.1/servers/39e846c1-6876-42ef-b290-f733516e1051 => generated 1521 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:47:05.526954 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-4544b6b5-0261-44d4-83d4-d59172a5348d tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:05.527444 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-4544b6b5-0261-44d4-83d4-d59172a5348d tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] [instance: 291474d2-a375-4974-abec-713900c08119] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:05.541255 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4544b6b5-0261-44d4-83d4-d59172a5348d tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:05.541986 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4544b6b5-0261-44d4-83d4-d59172a5348d tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:05.542661 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4544b6b5-0261-44d4-83d4-d59172a5348d tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:05.543549 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4544b6b5-0261-44d4-83d4-d59172a5348d tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:05.545203 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4544b6b5-0261-44d4-83d4-d59172a5348d tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:05.546490 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4544b6b5-0261-44d4-83d4-d59172a5348d tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:05.572171 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b1097552-6d5e-4308-ac0b-c6a5f1417c74 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] [instance: 32237627-3fea-48d4-959f-3a2aa519adf3] Going to try to terminate instance {{(pid=128801) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:47:05.589209 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-4544b6b5-0261-44d4-83d4-d59172a5348d tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] [instance: 291474d2-a375-4974-abec-713900c08119] Going to try to terminate instance {{(pid=128802) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:47:05.659441 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:47:05.778016 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-4544b6b5-0261-44d4-83d4-d59172a5348d tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] 10.222.0.33 "DELETE /compute/v2.1/servers/291474d2-a375-4974-abec-713900c08119" status: 204 len: 0 microversion: 2.1 time: 0.254325 Oct 04 20:47:05.781801 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1504/2982] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 20:47:05 2022] DELETE /compute/v2.1/servers/291474d2-a375-4974-abec-713900c08119 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:47:05.788382 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b1097552-6d5e-4308-ac0b-c6a5f1417c74 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] 10.222.0.33 "DELETE /compute/v2.1/servers/32237627-3fea-48d4-959f-3a2aa519adf3" status: 204 len: 0 microversion: 2.1 time: 0.312225 Oct 04 20:47:05.789838 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1479/2983] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 20:47:05 2022] DELETE /compute/v2.1/servers/32237627-3fea-48d4-959f-3a2aa519adf3 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:47:05.793184 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-4fa238e9-188f-483f-ab5f-077c7a3d6036 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:05.794052 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-4fa238e9-188f-483f-ab5f-077c7a3d6036 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] [instance: 291474d2-a375-4974-abec-713900c08119] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:05.802671 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f01bb6d2-8154-4084-9c7f-099ca7a13775 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:05.802913 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4fa238e9-188f-483f-ab5f-077c7a3d6036 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:05.803446 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4fa238e9-188f-483f-ab5f-077c7a3d6036 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:05.803994 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4fa238e9-188f-483f-ab5f-077c7a3d6036 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:05.804277 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f01bb6d2-8154-4084-9c7f-099ca7a13775 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] [instance: 39d66e18-289f-4674-b66c-146d68ef9133] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:05.804853 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4fa238e9-188f-483f-ab5f-077c7a3d6036 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:05.806218 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4fa238e9-188f-483f-ab5f-077c7a3d6036 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:05.806686 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4fa238e9-188f-483f-ab5f-077c7a3d6036 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:05.812187 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f01bb6d2-8154-4084-9c7f-099ca7a13775 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:05.812927 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f01bb6d2-8154-4084-9c7f-099ca7a13775 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:05.813662 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f01bb6d2-8154-4084-9c7f-099ca7a13775 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:05.814625 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f01bb6d2-8154-4084-9c7f-099ca7a13775 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:05.815294 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f01bb6d2-8154-4084-9c7f-099ca7a13775 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:05.815905 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f01bb6d2-8154-4084-9c7f-099ca7a13775 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:05.951711 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f01bb6d2-8154-4084-9c7f-099ca7a13775 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:05.965973 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f01bb6d2-8154-4084-9c7f-099ca7a13775 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:05.970604 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f01bb6d2-8154-4084-9c7f-099ca7a13775 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:05.977576 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f01bb6d2-8154-4084-9c7f-099ca7a13775 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] 10.222.0.33 "GET /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133" status: 200 len: 1555 microversion: 2.91 time: 0.179691 Oct 04 20:47:05.978935 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1480/2984] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:47:05 2022] GET /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133 => generated 1555 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:47:05.985808 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0fe40e5d-564a-4a46-b0b0-a56cf9178a8f tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:05.986697 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-0fe40e5d-564a-4a46-b0b0-a56cf9178a8f tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] [instance: 32237627-3fea-48d4-959f-3a2aa519adf3] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:06.008360 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0fe40e5d-564a-4a46-b0b0-a56cf9178a8f tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:06.014185 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0fe40e5d-564a-4a46-b0b0-a56cf9178a8f tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:06.016784 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0fe40e5d-564a-4a46-b0b0-a56cf9178a8f tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:06.020175 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0fe40e5d-564a-4a46-b0b0-a56cf9178a8f tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:06.022231 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0fe40e5d-564a-4a46-b0b0-a56cf9178a8f tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:06.023979 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0fe40e5d-564a-4a46-b0b0-a56cf9178a8f tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:06.112963 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-4fa238e9-188f-483f-ab5f-077c7a3d6036 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0967736982942f0b62db2e0546666cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f86a1d45a94f41bcd1a73694454a0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:06.129121 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-4fa238e9-188f-483f-ab5f-077c7a3d6036 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] 10.222.0.33 "GET /compute/v2.1/servers/291474d2-a375-4974-abec-713900c08119" status: 200 len: 1473 microversion: 2.1 time: 0.345536 Oct 04 20:47:06.153198 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1505/2985] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:47:05 2022] GET /compute/v2.1/servers/291474d2-a375-4974-abec-713900c08119 => generated 1473 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:47:06.211436 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-2bbd6abd-08d5-45c2-a212-c144e2270640 req-63cbfecf-425c-47ea-9caf-6192f8f23179 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "815db889-a211-4eab-90f8-7ca46d7102a4", "name": "network-vif-plugged", "status": "completed", "tag": "61e1947b-dc51-4d3d-8739-b8435daa871f"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:47:06.242184 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-2bbd6abd-08d5-45c2-a212-c144e2270640 req-63cbfecf-425c-47ea-9caf-6192f8f23179 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:06.242720 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-2bbd6abd-08d5-45c2-a212-c144e2270640 req-63cbfecf-425c-47ea-9caf-6192f8f23179 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:06.243258 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-2bbd6abd-08d5-45c2-a212-c144e2270640 req-63cbfecf-425c-47ea-9caf-6192f8f23179 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:06.341082 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-2bbd6abd-08d5-45c2-a212-c144e2270640 req-63cbfecf-425c-47ea-9caf-6192f8f23179 service nova] Creating event network-vif-plugged:61e1947b-dc51-4d3d-8739-b8435daa871f for instance 815db889-a211-4eab-90f8-7ca46d7102a4 on n-h1-854823-8 Oct 04 20:47:06.387572 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-2bbd6abd-08d5-45c2-a212-c144e2270640 req-63cbfecf-425c-47ea-9caf-6192f8f23179 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.181327 Oct 04 20:47:06.389424 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1506/2986] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:47:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:47:06.394784 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-0fe40e5d-564a-4a46-b0b0-a56cf9178a8f tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87dcc7baf63f4ae6bfe0a099adffd408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7097bc12179446f6a3e1fac8434d5c64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:06.400453 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-dfaedcfa-c6e7-4e4e-a901-6fd66471c8ba tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:06.401278 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-dfaedcfa-c6e7-4e4e-a901-6fd66471c8ba tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: fde3f6fc-61e1-4b21-8b91-e95c2db3d48c] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:06.405064 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-0fe40e5d-564a-4a46-b0b0-a56cf9178a8f tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] 10.222.0.33 "GET /compute/v2.1/servers/32237627-3fea-48d4-959f-3a2aa519adf3" status: 200 len: 1517 microversion: 2.1 time: 0.424830 Oct 04 20:47:06.409488 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dfaedcfa-c6e7-4e4e-a901-6fd66471c8ba tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:06.411129 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dfaedcfa-c6e7-4e4e-a901-6fd66471c8ba tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:06.423022 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1481/2987] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:47:05 2022] GET /compute/v2.1/servers/32237627-3fea-48d4-959f-3a2aa519adf3 => generated 1517 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:47:06.426483 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dfaedcfa-c6e7-4e4e-a901-6fd66471c8ba tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:06.427713 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dfaedcfa-c6e7-4e4e-a901-6fd66471c8ba tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:06.428195 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dfaedcfa-c6e7-4e4e-a901-6fd66471c8ba tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:06.428628 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dfaedcfa-c6e7-4e4e-a901-6fd66471c8ba tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:06.443250 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9b54c30c-d5e8-447b-aa5e-f966376667a2 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Calling method '.version_select at 0x7f3c74e05f70>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:06.528520 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-9b54c30c-d5e8-447b-aa5e-f966376667a2 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] 10.222.0.33 "GET /compute/v2.1/images/5804f6f0-d786-4197-9403-11c4a65faccd" status: 200 len: 1410 microversion: 2.1 time: 0.089651 Oct 04 20:47:06.529134 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1482/2988] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 20:47:06 2022] GET /compute/v2.1/images/5804f6f0-d786-4197-9403-11c4a65faccd => generated 1410 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:47:06.546309 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-539e31c5-23a2-4411-a14a-fa3137699308 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:06.547211 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-539e31c5-23a2-4411-a14a-fa3137699308 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] [instance: 39e846c1-6876-42ef-b290-f733516e1051] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:06.556238 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-539e31c5-23a2-4411-a14a-fa3137699308 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:06.556985 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-539e31c5-23a2-4411-a14a-fa3137699308 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:06.558139 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-539e31c5-23a2-4411-a14a-fa3137699308 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:06.559057 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-539e31c5-23a2-4411-a14a-fa3137699308 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:06.559677 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-539e31c5-23a2-4411-a14a-fa3137699308 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:06.560253 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-539e31c5-23a2-4411-a14a-fa3137699308 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:06.598316 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-dfaedcfa-c6e7-4e4e-a901-6fd66471c8ba tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac650232cc04810b1340dc2f0edadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b0670d1bd99424780a70e69d57a2166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:06.608615 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-dfaedcfa-c6e7-4e4e-a901-6fd66471c8ba tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "GET /compute/v2.1/servers/fde3f6fc-61e1-4b21-8b91-e95c2db3d48c" status: 200 len: 1315 microversion: 2.1 time: 0.216308 Oct 04 20:47:06.623646 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1507/2989] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:47:06 2022] GET /compute/v2.1/servers/fde3f6fc-61e1-4b21-8b91-e95c2db3d48c => generated 1315 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:47:06.739728 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-539e31c5-23a2-4411-a14a-fa3137699308 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12dc6570db03431187680f51349e55d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91111396aabd4306b66e14b5abd822ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:06.749282 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-539e31c5-23a2-4411-a14a-fa3137699308 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] 10.222.0.33 "GET /compute/v2.1/servers/39e846c1-6876-42ef-b290-f733516e1051" status: 200 len: 1521 microversion: 2.1 time: 0.206324 Oct 04 20:47:06.762370 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1483/2990] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:47:06 2022] GET /compute/v2.1/servers/39e846c1-6876-42ef-b290-f733516e1051 => generated 1521 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:47:07.012576 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-6f73310f-3e96-45ea-9dd7-1cfb5a5e3609 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:07.013113 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-6f73310f-3e96-45ea-9dd7-1cfb5a5e3609 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] [instance: 39d66e18-289f-4674-b66c-146d68ef9133] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:07.020097 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6f73310f-3e96-45ea-9dd7-1cfb5a5e3609 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:07.020924 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6f73310f-3e96-45ea-9dd7-1cfb5a5e3609 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:07.021677 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6f73310f-3e96-45ea-9dd7-1cfb5a5e3609 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:07.022525 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6f73310f-3e96-45ea-9dd7-1cfb5a5e3609 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:07.023331 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6f73310f-3e96-45ea-9dd7-1cfb5a5e3609 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:07.024027 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6f73310f-3e96-45ea-9dd7-1cfb5a5e3609 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:07.031754 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-3801b022-2c07-48cd-a1f9-0c260d11b427 req-e6305930-3057-4898-80c2-a5b0b03d717c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fde3f6fc-61e1-4b21-8b91-e95c2db3d48c", "tag": "ecd76bad-a328-479e-bee1-f8412f546d83"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:47:07.045028 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-3801b022-2c07-48cd-a1f9-0c260d11b427 req-e6305930-3057-4898-80c2-a5b0b03d717c service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:07.047368 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-3801b022-2c07-48cd-a1f9-0c260d11b427 req-e6305930-3057-4898-80c2-a5b0b03d717c service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:07.047868 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-3801b022-2c07-48cd-a1f9-0c260d11b427 req-e6305930-3057-4898-80c2-a5b0b03d717c service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:07.071170 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-3801b022-2c07-48cd-a1f9-0c260d11b427 req-e6305930-3057-4898-80c2-a5b0b03d717c service nova] Creating event network-changed:ecd76bad-a328-479e-bee1-f8412f546d83 for instance fde3f6fc-61e1-4b21-8b91-e95c2db3d48c on n-h2-854823-8 Oct 04 20:47:07.076985 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-3801b022-2c07-48cd-a1f9-0c260d11b427 req-e6305930-3057-4898-80c2-a5b0b03d717c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049260 Oct 04 20:47:07.078522 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1484/2991] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:47:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 20:47:07.113021 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-6f73310f-3e96-45ea-9dd7-1cfb5a5e3609 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:07.122831 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-6f73310f-3e96-45ea-9dd7-1cfb5a5e3609 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:07.124258 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-6f73310f-3e96-45ea-9dd7-1cfb5a5e3609 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:07.131215 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-6f73310f-3e96-45ea-9dd7-1cfb5a5e3609 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] 10.222.0.33 "GET /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133" status: 200 len: 1555 microversion: 2.91 time: 0.124424 Oct 04 20:47:07.132322 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1508/2992] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:47:07 2022] GET /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133 => generated 1555 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 20:47:07.161680 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-562c4307-134e-48f2-8536-8a53cbc4189a tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:07.162537 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-562c4307-134e-48f2-8536-8a53cbc4189a tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] [instance: 291474d2-a375-4974-abec-713900c08119] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:07.168932 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-562c4307-134e-48f2-8536-8a53cbc4189a tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:07.169529 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-562c4307-134e-48f2-8536-8a53cbc4189a tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:07.170011 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-562c4307-134e-48f2-8536-8a53cbc4189a tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:07.170797 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-562c4307-134e-48f2-8536-8a53cbc4189a tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:07.171318 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-562c4307-134e-48f2-8536-8a53cbc4189a tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:07.171809 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-562c4307-134e-48f2-8536-8a53cbc4189a tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:07.334279 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-562c4307-134e-48f2-8536-8a53cbc4189a tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0967736982942f0b62db2e0546666cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f86a1d45a94f41bcd1a73694454a0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:07.345704 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-562c4307-134e-48f2-8536-8a53cbc4189a tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] 10.222.0.33 "GET /compute/v2.1/servers/291474d2-a375-4974-abec-713900c08119" status: 200 len: 1473 microversion: 2.1 time: 0.188692 Oct 04 20:47:07.346653 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1485/2993] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:47:07 2022] GET /compute/v2.1/servers/291474d2-a375-4974-abec-713900c08119 => generated 1473 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:47:07.434131 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-4626eb86-cd69-4e73-b40d-d889769a10dc tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:07.434766 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-4626eb86-cd69-4e73-b40d-d889769a10dc tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] [instance: 32237627-3fea-48d4-959f-3a2aa519adf3] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:07.443015 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4626eb86-cd69-4e73-b40d-d889769a10dc tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:07.454059 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4626eb86-cd69-4e73-b40d-d889769a10dc tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:07.454795 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4626eb86-cd69-4e73-b40d-d889769a10dc tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:07.455743 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4626eb86-cd69-4e73-b40d-d889769a10dc tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:07.456614 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4626eb86-cd69-4e73-b40d-d889769a10dc tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:07.457932 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4626eb86-cd69-4e73-b40d-d889769a10dc tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:07.544531 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-24051f07-2bc8-4302-8a02-11a0e30901c8 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Calling method '.version_select at 0x7f3c745f4e50>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:07.930473 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-4626eb86-cd69-4e73-b40d-d889769a10dc tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87dcc7baf63f4ae6bfe0a099adffd408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7097bc12179446f6a3e1fac8434d5c64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:07.943312 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-4626eb86-cd69-4e73-b40d-d889769a10dc tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] 10.222.0.33 "GET /compute/v2.1/servers/32237627-3fea-48d4-959f-3a2aa519adf3" status: 200 len: 1517 microversion: 2.1 time: 0.512346 Oct 04 20:47:07.949168 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1509/2994] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:47:07 2022] GET /compute/v2.1/servers/32237627-3fea-48d4-959f-3a2aa519adf3 => generated 1517 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:47:07.966321 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-a866de43-01bf-436b-843a-278783db50f5 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:07.967042 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-a866de43-01bf-436b-843a-278783db50f5 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: fde3f6fc-61e1-4b21-8b91-e95c2db3d48c] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:07.977239 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a866de43-01bf-436b-843a-278783db50f5 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:07.979142 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a866de43-01bf-436b-843a-278783db50f5 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:07.981067 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a866de43-01bf-436b-843a-278783db50f5 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:07.982748 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a866de43-01bf-436b-843a-278783db50f5 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:07.986018 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a866de43-01bf-436b-843a-278783db50f5 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:07.987195 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a866de43-01bf-436b-843a-278783db50f5 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:08.741914 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-a866de43-01bf-436b-843a-278783db50f5 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac650232cc04810b1340dc2f0edadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b0670d1bd99424780a70e69d57a2166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:08.752521 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-a866de43-01bf-436b-843a-278783db50f5 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "GET /compute/v2.1/servers/fde3f6fc-61e1-4b21-8b91-e95c2db3d48c" status: 200 len: 1315 microversion: 2.1 time: 0.802198 Oct 04 20:47:08.753119 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1510/2995] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:47:07 2022] GET /compute/v2.1/servers/fde3f6fc-61e1-4b21-8b91-e95c2db3d48c => generated 1315 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:47:08.776426 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-d2550ccd-a88c-400a-aff0-ee8abf1a5a91 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:08.789417 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-d2550ccd-a88c-400a-aff0-ee8abf1a5a91 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] [instance: 39e846c1-6876-42ef-b290-f733516e1051] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:08.799347 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d2550ccd-a88c-400a-aff0-ee8abf1a5a91 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:08.800112 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d2550ccd-a88c-400a-aff0-ee8abf1a5a91 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:08.800700 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d2550ccd-a88c-400a-aff0-ee8abf1a5a91 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:08.801599 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d2550ccd-a88c-400a-aff0-ee8abf1a5a91 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:08.807860 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d2550ccd-a88c-400a-aff0-ee8abf1a5a91 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:08.808315 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d2550ccd-a88c-400a-aff0-ee8abf1a5a91 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:08.838822 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:47:09.361128 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-d2550ccd-a88c-400a-aff0-ee8abf1a5a91 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12dc6570db03431187680f51349e55d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91111396aabd4306b66e14b5abd822ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:09.407484 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-d2550ccd-a88c-400a-aff0-ee8abf1a5a91 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] 10.222.0.33 "GET /compute/v2.1/servers/39e846c1-6876-42ef-b290-f733516e1051" status: 200 len: 1521 microversion: 2.1 time: 0.644658 Oct 04 20:47:09.428387 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1511/2996] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:47:08 2022] GET /compute/v2.1/servers/39e846c1-6876-42ef-b290-f733516e1051 => generated 1521 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:47:09.432973 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-cda55ea4-76b3-4135-909e-341cc7ef94e9 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:09.435237 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-cda55ea4-76b3-4135-909e-341cc7ef94e9 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] [instance: 39d66e18-289f-4674-b66c-146d68ef9133] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:09.462993 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cda55ea4-76b3-4135-909e-341cc7ef94e9 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:09.463500 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cda55ea4-76b3-4135-909e-341cc7ef94e9 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:09.463952 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cda55ea4-76b3-4135-909e-341cc7ef94e9 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:09.471157 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cda55ea4-76b3-4135-909e-341cc7ef94e9 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:09.472298 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cda55ea4-76b3-4135-909e-341cc7ef94e9 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:09.475348 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cda55ea4-76b3-4135-909e-341cc7ef94e9 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:09.631181 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-cda55ea4-76b3-4135-909e-341cc7ef94e9 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:09.644546 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-cda55ea4-76b3-4135-909e-341cc7ef94e9 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:09.651252 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-cda55ea4-76b3-4135-909e-341cc7ef94e9 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:09.674969 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-cda55ea4-76b3-4135-909e-341cc7ef94e9 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] 10.222.0.33 "GET /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133" status: 200 len: 1555 microversion: 2.91 time: 0.250038 Oct 04 20:47:09.690051 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1512/2997] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:47:09 2022] GET /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133 => generated 1555 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:47:09.705097 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-b5b6d253-5c82-44ac-a3e3-6b44d2bd4147 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:09.705712 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-b5b6d253-5c82-44ac-a3e3-6b44d2bd4147 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] [instance: 291474d2-a375-4974-abec-713900c08119] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:09.741728 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b5b6d253-5c82-44ac-a3e3-6b44d2bd4147 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:09.742263 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b5b6d253-5c82-44ac-a3e3-6b44d2bd4147 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:09.742905 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b5b6d253-5c82-44ac-a3e3-6b44d2bd4147 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:09.743479 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b5b6d253-5c82-44ac-a3e3-6b44d2bd4147 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:09.743931 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b5b6d253-5c82-44ac-a3e3-6b44d2bd4147 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:09.744349 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b5b6d253-5c82-44ac-a3e3-6b44d2bd4147 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:09.883914 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b5b6d253-5c82-44ac-a3e3-6b44d2bd4147 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:09.884879 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b5b6d253-5c82-44ac-a3e3-6b44d2bd4147 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:09.885310 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b5b6d253-5c82-44ac-a3e3-6b44d2bd4147 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:09.896163 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.objects.instance [None req-b5b6d253-5c82-44ac-a3e3-6b44d2bd4147 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Lazy-loading 'fault' on Instance uuid 291474d2-a375-4974-abec-713900c08119 {{(pid=128802) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:47:10.034578 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-b5b6d253-5c82-44ac-a3e3-6b44d2bd4147 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0967736982942f0b62db2e0546666cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f86a1d45a94f41bcd1a73694454a0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:10.054407 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-b5b6d253-5c82-44ac-a3e3-6b44d2bd4147 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] 10.222.0.33 "GET /compute/v2.1/servers/291474d2-a375-4974-abec-713900c08119" status: 200 len: 1308 microversion: 2.1 time: 0.362837 Oct 04 20:47:10.055322 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1513/2998] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:47:09 2022] GET /compute/v2.1/servers/291474d2-a375-4974-abec-713900c08119 => generated 1308 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:47:10.060035 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-278e58a0-10fb-4d21-8fbb-4e6f7b0f2e52 req-89caedaa-a59b-4be6-8823-0d075f55f010 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32237627-3fea-48d4-959f-3a2aa519adf3", "name": "network-vif-deleted", "tag": "397f83d3-7c45-4acb-949d-c35a707bccac"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:47:10.088410 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-278e58a0-10fb-4d21-8fbb-4e6f7b0f2e52 req-89caedaa-a59b-4be6-8823-0d075f55f010 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:10.089133 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-278e58a0-10fb-4d21-8fbb-4e6f7b0f2e52 req-89caedaa-a59b-4be6-8823-0d075f55f010 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:10.089797 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-278e58a0-10fb-4d21-8fbb-4e6f7b0f2e52 req-89caedaa-a59b-4be6-8823-0d075f55f010 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:10.114668 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-278e58a0-10fb-4d21-8fbb-4e6f7b0f2e52 req-89caedaa-a59b-4be6-8823-0d075f55f010 service nova] Creating event network-vif-deleted:397f83d3-7c45-4acb-949d-c35a707bccac for instance 32237627-3fea-48d4-959f-3a2aa519adf3 on n-h2-854823-8 Oct 04 20:47:10.127784 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-278e58a0-10fb-4d21-8fbb-4e6f7b0f2e52 req-89caedaa-a59b-4be6-8823-0d075f55f010 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071052 Oct 04 20:47:10.128695 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1514/2999] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:47:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:47:10.136748 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-67021102-7737-4a1b-9761-37e5ad21dec6 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:10.143431 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-67021102-7737-4a1b-9761-37e5ad21dec6 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] [instance: 32237627-3fea-48d4-959f-3a2aa519adf3] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:10.157482 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-67021102-7737-4a1b-9761-37e5ad21dec6 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:10.158899 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-67021102-7737-4a1b-9761-37e5ad21dec6 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:10.159507 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-67021102-7737-4a1b-9761-37e5ad21dec6 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:10.163467 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-67021102-7737-4a1b-9761-37e5ad21dec6 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:10.164146 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-67021102-7737-4a1b-9761-37e5ad21dec6 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:10.164770 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-67021102-7737-4a1b-9761-37e5ad21dec6 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:10.265528 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-67021102-7737-4a1b-9761-37e5ad21dec6 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:10.268393 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-67021102-7737-4a1b-9761-37e5ad21dec6 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:10.270986 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-67021102-7737-4a1b-9761-37e5ad21dec6 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:10.273443 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.objects.instance [None req-67021102-7737-4a1b-9761-37e5ad21dec6 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lazy-loading 'fault' on Instance uuid 32237627-3fea-48d4-959f-3a2aa519adf3 {{(pid=128802) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:47:10.424377 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-67021102-7737-4a1b-9761-37e5ad21dec6 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87dcc7baf63f4ae6bfe0a099adffd408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7097bc12179446f6a3e1fac8434d5c64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:10.435365 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-67021102-7737-4a1b-9761-37e5ad21dec6 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] 10.222.0.33 "GET /compute/v2.1/servers/32237627-3fea-48d4-959f-3a2aa519adf3" status: 200 len: 1320 microversion: 2.1 time: 0.303874 Oct 04 20:47:10.436560 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1515/3000] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:47:10 2022] GET /compute/v2.1/servers/32237627-3fea-48d4-959f-3a2aa519adf3 => generated 1320 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:47:10.452713 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-6113e927-1053-4a19-acf5-7bbaa13b7c95 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:10.453586 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-6113e927-1053-4a19-acf5-7bbaa13b7c95 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: fde3f6fc-61e1-4b21-8b91-e95c2db3d48c] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:10.482895 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6113e927-1053-4a19-acf5-7bbaa13b7c95 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:10.486469 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6113e927-1053-4a19-acf5-7bbaa13b7c95 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:10.488270 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6113e927-1053-4a19-acf5-7bbaa13b7c95 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:10.491103 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6113e927-1053-4a19-acf5-7bbaa13b7c95 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:10.492598 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6113e927-1053-4a19-acf5-7bbaa13b7c95 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:10.496545 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6113e927-1053-4a19-acf5-7bbaa13b7c95 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:10.916648 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-6113e927-1053-4a19-acf5-7bbaa13b7c95 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac650232cc04810b1340dc2f0edadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b0670d1bd99424780a70e69d57a2166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:10.927696 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-6113e927-1053-4a19-acf5-7bbaa13b7c95 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "GET /compute/v2.1/servers/fde3f6fc-61e1-4b21-8b91-e95c2db3d48c" status: 200 len: 1315 microversion: 2.1 time: 0.488137 Oct 04 20:47:10.950336 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1516/3001] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:47:10 2022] GET /compute/v2.1/servers/fde3f6fc-61e1-4b21-8b91-e95c2db3d48c => generated 1315 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:47:10.955293 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-adbc349a-ee20-4171-8e6f-8ca91e5f6311 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:10.956166 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-adbc349a-ee20-4171-8e6f-8ca91e5f6311 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] [instance: 39e846c1-6876-42ef-b290-f733516e1051] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:10.963337 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-adbc349a-ee20-4171-8e6f-8ca91e5f6311 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:10.963836 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-adbc349a-ee20-4171-8e6f-8ca91e5f6311 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:10.964276 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-adbc349a-ee20-4171-8e6f-8ca91e5f6311 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:10.967590 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-adbc349a-ee20-4171-8e6f-8ca91e5f6311 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:10.970696 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-adbc349a-ee20-4171-8e6f-8ca91e5f6311 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:10.971216 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-adbc349a-ee20-4171-8e6f-8ca91e5f6311 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:11.297116 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-adbc349a-ee20-4171-8e6f-8ca91e5f6311 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12dc6570db03431187680f51349e55d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91111396aabd4306b66e14b5abd822ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:11.305123 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-adbc349a-ee20-4171-8e6f-8ca91e5f6311 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] 10.222.0.33 "GET /compute/v2.1/servers/39e846c1-6876-42ef-b290-f733516e1051" status: 200 len: 1498 microversion: 2.1 time: 0.353524 Oct 04 20:47:11.309232 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1517/3002] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:47:10 2022] GET /compute/v2.1/servers/39e846c1-6876-42ef-b290-f733516e1051 => generated 1498 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:47:11.321253 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-7d442631-8860-4f23-9e5e-247f88b07350 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:11.322431 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-7d442631-8860-4f23-9e5e-247f88b07350 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] [instance: 39d66e18-289f-4674-b66c-146d68ef9133] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:11.332109 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7d442631-8860-4f23-9e5e-247f88b07350 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:11.339478 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7d442631-8860-4f23-9e5e-247f88b07350 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:11.340202 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7d442631-8860-4f23-9e5e-247f88b07350 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:11.341131 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7d442631-8860-4f23-9e5e-247f88b07350 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:11.341761 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7d442631-8860-4f23-9e5e-247f88b07350 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:11.343121 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7d442631-8860-4f23-9e5e-247f88b07350 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:11.425593 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell0:SELECT=4 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:47:11.446129 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-7d442631-8860-4f23-9e5e-247f88b07350 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:11.460542 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-7d442631-8860-4f23-9e5e-247f88b07350 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:11.462676 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-7d442631-8860-4f23-9e5e-247f88b07350 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:11.468345 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-7d442631-8860-4f23-9e5e-247f88b07350 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] 10.222.0.33 "GET /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133" status: 200 len: 1555 microversion: 2.91 time: 0.157846 Oct 04 20:47:11.469131 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1518/3003] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:47:11 2022] GET /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133 => generated 1555 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:47:11.476955 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-601671f2-c862-4c50-b7bf-d0af14d6b68a tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:11.477847 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-601671f2-c862-4c50-b7bf-d0af14d6b68a tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] [instance: 291474d2-a375-4974-abec-713900c08119] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:11.485152 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-601671f2-c862-4c50-b7bf-d0af14d6b68a tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:11.485850 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-601671f2-c862-4c50-b7bf-d0af14d6b68a tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:11.486495 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-601671f2-c862-4c50-b7bf-d0af14d6b68a tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:11.487378 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-601671f2-c862-4c50-b7bf-d0af14d6b68a tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:11.487992 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-601671f2-c862-4c50-b7bf-d0af14d6b68a tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:11.488574 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-601671f2-c862-4c50-b7bf-d0af14d6b68a tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:11.509782 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.wsgi [None req-601671f2-c862-4c50-b7bf-d0af14d6b68a tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] HTTP exception thrown: Instance 291474d2-a375-4974-abec-713900c08119 could not be found. Oct 04 20:47:11.511950 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-601671f2-c862-4c50-b7bf-d0af14d6b68a tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Request method failure captured: Oct 04 20:47:11.511950 n-d-854823-8 devstack@n-api.service[128802]: request: GET /compute/v2.1/servers/291474d2-a375-4974-abec-713900c08119 HTTP/1.1 Oct 04 20:47:11.511950 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 20:47:11.511950 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 20:47:11.511950 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 20:47:11.511950 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 0 Oct 04 20:47:11.511950 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 20:47:11.511950 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 20:47:11.511950 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 20:47:11.511950 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 20:47:11.511950 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPJtWArqyogZMwpE-j09gr-22ch7iWmenfMPnqPrxZQiKXyrLOZH-U2EuJx7rXrNJbsmHJbOWQknxG0xwpqQnDFzrfpjMdNtSWwAVE7eLo2dWo5IlDwqJyswbCGVys2fXjSqVQ2Io5xdnpkKMji9bQP5p2VGElnwZm2OCZ0UFRRkt54E Oct 04 20:47:11.511950 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 20:47:11.511950 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 20:47:11.511950 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 20:47:11.511950 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 20:47:11.511950 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 20:47:11.511950 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 20:47:11.511950 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: b5f86a1d45a94f41bcd1a73694454a0d Oct 04 20:47:11.511950 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-ListImageFiltersTestJSON-1176779314 Oct 04 20:47:11.511950 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 20:47:11.511950 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 20:47:11.511950 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b5f86a1d45a94f41bcd1a73694454a0d", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b5f86a1d45a94f41bcd1a73694454a0d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b5f86a1d45a94f41bcd1a73694454a0d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b5f86a1d45a94f41bcd1a73694454a0d"}]}] Oct 04 20:47:11.511950 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-ListImageFiltersTestJSON-1176779314 Oct 04 20:47:11.511950 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: b5f86a1d45a94f41bcd1a73694454a0d Oct 04 20:47:11.511950 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-1176779314 Oct 04 20:47:11.511950 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-ListImageFiltersTestJSON-1176779314-project Oct 04 20:47:11.511950 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 20:47:11.511950 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 20:47:11.511950 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: c0967736982942f0b62db2e0546666cf Oct 04 20:47:11.511950 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-ListImageFiltersTestJSON-1176779314-project Oct 04 20:47:11.511950 n-d-854823-8 devstack@n-api.service[128802]: method: > Oct 04 20:47:11.511950 n-d-854823-8 devstack@n-api.service[128802]: exception: Instance 291474d2-a375-4974-abec-713900c08119 could not be found. Oct 04 20:47:11.511950 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'id': '291474d2-a375-4974-abec-713900c08119'} Oct 04 20:47:11.511950 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:47:11.511950 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:47:11.511950 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:47:11.511950 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:47:11.511950 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:47:11.511950 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:47:11.511950 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:47:11.511950 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:47:11.511950 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:47:11.511950 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:47:11.511950 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 291474d2-a375-4974-abec-713900c08119 could not be found. Oct 04 20:47:11.511950 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:47:11.511950 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:47:11.511950 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:47:11.511950 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:47:11.511950 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:47:11.511950 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:47:11.511950 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:47:11.511950 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:47:11.511950 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:47:11.511950 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:47:11.511950 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:47:11.511950 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:47:11.511950 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:47:11.511950 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:47:11.511950 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:47:11.511950 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:47:11.511950 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 291474d2-a375-4974-abec-713900c08119 could not be found. Oct 04 20:47:11.511950 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:47:11.511950 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:47:11.511950 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:47:11.516664 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:47:11.516664 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:47:11.516664 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:47:11.516664 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:47:11.516664 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:47:11.516664 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 291474d2-a375-4974-abec-713900c08119 could not be found. Oct 04 20:47:11.516664 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:47:11.518302 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-601671f2-c862-4c50-b7bf-d0af14d6b68a tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Returning 404 to user: Instance 291474d2-a375-4974-abec-713900c08119 could not be found. {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:47:11.519385 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-601671f2-c862-4c50-b7bf-d0af14d6b68a tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] 10.222.0.33 "GET /compute/v2.1/servers/291474d2-a375-4974-abec-713900c08119" status: 404 len: 111 microversion: 2.1 time: 0.049161 Oct 04 20:47:11.520144 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1519/3004] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:47:11 2022] GET /compute/v2.1/servers/291474d2-a375-4974-abec-713900c08119 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:47:11.526700 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-11d84cd8-18f6-4657-91e5-e2f60bf9b348 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:11.536721 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-11d84cd8-18f6-4657-91e5-e2f60bf9b348 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '12dc6570db03431187680f51349e55d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91111396aabd4306b66e14b5abd822ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:11.538468 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-11d84cd8-18f6-4657-91e5-e2f60bf9b348 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Searching by: {'vm_state': ['stopped'], 'deleted': False, 'project_id': '91111396aabd4306b66e14b5abd822ad'} {{(pid=128802) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 20:47:11.547589 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-11d84cd8-18f6-4657-91e5-e2f60bf9b348 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:11.548666 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-11d84cd8-18f6-4657-91e5-e2f60bf9b348 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:11.549266 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-11d84cd8-18f6-4657-91e5-e2f60bf9b348 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:11.550328 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-11d84cd8-18f6-4657-91e5-e2f60bf9b348 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:11.551198 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-11d84cd8-18f6-4657-91e5-e2f60bf9b348 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:11.551956 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-11d84cd8-18f6-4657-91e5-e2f60bf9b348 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:11.588170 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell0:SELECT=14 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:47:11.593387 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.multi_cell_list [None req-11d84cd8-18f6-4657-91e5-e2f60bf9b348 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128802) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 20:47:11.631467 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-11d84cd8-18f6-4657-91e5-e2f60bf9b348 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] 10.222.0.33 "GET /compute/v2.1/servers?status=shutoff" status: 200 len: 346 microversion: 2.1 time: 0.109178 Oct 04 20:47:11.632697 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1520/3005] 10.222.0.33 () {58 vars in 1154 bytes} [Tue Oct 4 20:47:11 2022] GET /compute/v2.1/servers?status=shutoff => generated 346 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:47:11.640654 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-d81e68ae-7dc5-41d8-ac73-6a60b1e735ee tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:11.641732 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-d81e68ae-7dc5-41d8-ac73-6a60b1e735ee tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] [instance: 32237627-3fea-48d4-959f-3a2aa519adf3] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:11.652316 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d81e68ae-7dc5-41d8-ac73-6a60b1e735ee tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:11.653087 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d81e68ae-7dc5-41d8-ac73-6a60b1e735ee tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:11.653718 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d81e68ae-7dc5-41d8-ac73-6a60b1e735ee tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:11.654683 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d81e68ae-7dc5-41d8-ac73-6a60b1e735ee tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:11.655383 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d81e68ae-7dc5-41d8-ac73-6a60b1e735ee tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:11.655971 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d81e68ae-7dc5-41d8-ac73-6a60b1e735ee tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:11.678478 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.wsgi [None req-d81e68ae-7dc5-41d8-ac73-6a60b1e735ee tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] HTTP exception thrown: Instance 32237627-3fea-48d4-959f-3a2aa519adf3 could not be found. Oct 04 20:47:11.680520 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-d81e68ae-7dc5-41d8-ac73-6a60b1e735ee tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Request method failure captured: Oct 04 20:47:11.680520 n-d-854823-8 devstack@n-api.service[128802]: request: GET /compute/v2.1/servers/32237627-3fea-48d4-959f-3a2aa519adf3 HTTP/1.1 Oct 04 20:47:11.680520 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 20:47:11.680520 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 20:47:11.680520 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 20:47:11.680520 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 0 Oct 04 20:47:11.680520 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 20:47:11.680520 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 20:47:11.680520 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 20:47:11.680520 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 20:47:11.680520 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPJsSwF2ySar2LJQGdSe43g0QAYtjP4_BPyLRwM7Cr4_8Oz_X-RTScy1BL0ogt-qe3YNvQGTaYbVbGoUGx7pHqiHpbZftU7_TcvDA_zpgTfxGGH91CR74RG6crXL2bxRs87dSvsLYuOWMw7_AQjTpWetc1HBlb5th2rD-ko2SN3gLGSA Oct 04 20:47:11.680520 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 20:47:11.680520 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 20:47:11.680520 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 20:47:11.680520 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 20:47:11.680520 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 20:47:11.680520 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 20:47:11.680520 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: 7097bc12179446f6a3e1fac8434d5c64 Oct 04 20:47:11.680520 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-ServersTestJSON-927611194 Oct 04 20:47:11.680520 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 20:47:11.680520 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 20:47:11.680520 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_7097bc12179446f6a3e1fac8434d5c64", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7097bc12179446f6a3e1fac8434d5c64"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7097bc12179446f6a3e1fac8434d5c64"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/7097bc12179446f6a3e1fac8434d5c64"}]}] Oct 04 20:47:11.680520 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-ServersTestJSON-927611194 Oct 04 20:47:11.680520 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: 7097bc12179446f6a3e1fac8434d5c64 Oct 04 20:47:11.680520 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-ServersTestJSON-927611194 Oct 04 20:47:11.680520 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-ServersTestJSON-927611194-project Oct 04 20:47:11.680520 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 20:47:11.680520 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 20:47:11.680520 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: 87dcc7baf63f4ae6bfe0a099adffd408 Oct 04 20:47:11.680520 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-ServersTestJSON-927611194-project Oct 04 20:47:11.680520 n-d-854823-8 devstack@n-api.service[128802]: method: > Oct 04 20:47:11.680520 n-d-854823-8 devstack@n-api.service[128802]: exception: Instance 32237627-3fea-48d4-959f-3a2aa519adf3 could not be found. Oct 04 20:47:11.680520 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'id': '32237627-3fea-48d4-959f-3a2aa519adf3'} Oct 04 20:47:11.680520 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:47:11.680520 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:47:11.680520 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:47:11.680520 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:47:11.680520 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:47:11.680520 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:47:11.680520 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:47:11.680520 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:47:11.680520 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:47:11.680520 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:47:11.680520 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32237627-3fea-48d4-959f-3a2aa519adf3 could not be found. Oct 04 20:47:11.680520 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:47:11.680520 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:47:11.680520 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:47:11.680520 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:47:11.680520 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:47:11.680520 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:47:11.680520 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:47:11.680520 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:47:11.680520 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:47:11.680520 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:47:11.680520 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:47:11.680520 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:47:11.680520 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:47:11.680520 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:47:11.680520 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:47:11.680520 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:47:11.680520 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32237627-3fea-48d4-959f-3a2aa519adf3 could not be found. Oct 04 20:47:11.680520 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:47:11.680520 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:47:11.680520 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:47:11.680520 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:47:11.685460 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:47:11.685460 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:47:11.685460 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:47:11.685460 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:47:11.685460 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32237627-3fea-48d4-959f-3a2aa519adf3 could not be found. Oct 04 20:47:11.685460 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:47:11.687037 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-d81e68ae-7dc5-41d8-ac73-6a60b1e735ee tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Returning 404 to user: Instance 32237627-3fea-48d4-959f-3a2aa519adf3 could not be found. {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:47:11.688162 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-d81e68ae-7dc5-41d8-ac73-6a60b1e735ee tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] 10.222.0.33 "GET /compute/v2.1/servers/32237627-3fea-48d4-959f-3a2aa519adf3" status: 404 len: 111 microversion: 2.1 time: 0.054268 Oct 04 20:47:11.706925 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1521/3006] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:47:11 2022] GET /compute/v2.1/servers/32237627-3fea-48d4-959f-3a2aa519adf3 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:47:11.715482 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-97dc51cf-9506-4798-8248-59b870b2ad30 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Calling method '.version_select at 0x7f3c740c7ca0>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:14.683035 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-24051f07-2bc8-4302-8a02-11a0e30901c8 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] 10.222.0.33 "GET /compute/v2.1/images/5804f6f0-d786-4197-9403-11c4a65faccd" status: 200 len: 1410 microversion: 2.1 time: 7.142393 Oct 04 20:47:14.691559 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1486/3007] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 20:47:07 2022] GET /compute/v2.1/images/5804f6f0-d786-4197-9403-11c4a65faccd => generated 1410 bytes in 7144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:47:14.691559 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7cea1427-d558-4735-a866-88adc9a6997e tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:47:14.712724 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7cea1427-d558-4735-a866-88adc9a6997e tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:14.713520 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7cea1427-d558-4735-a866-88adc9a6997e tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:14.714174 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7cea1427-d558-4735-a866-88adc9a6997e tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:14.781916 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-7cea1427-d558-4735-a866-88adc9a6997e tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] [instance: 39e846c1-6876-42ef-b290-f733516e1051] Going to try to start instance {{(pid=128801) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 04 20:47:14.839860 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-7cea1427-d558-4735-a866-88adc9a6997e tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] 10.222.0.33 "POST /compute/v2.1/servers/39e846c1-6876-42ef-b290-f733516e1051/action" status: 202 len: 0 microversion: 2.1 time: 0.154914 Oct 04 20:47:14.840531 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1487/3008] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 20:47:14 2022] POST /compute/v2.1/servers/39e846c1-6876-42ef-b290-f733516e1051/action => generated 0 bytes in 156 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:47:14.846021 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b4ef7424-9142-4e86-8874-6feb30f2136e tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-676522441", "imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63", "flavorRef": "452", "networks": [{"uuid": "a32beee4-b00b-48d9-8656-e7b824aeffce"}]}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:47:15.021801 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-97dc51cf-9506-4798-8248-59b870b2ad30 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] 10.222.0.33 "DELETE /compute/v2.1/images/78cea246-4b2b-4af1-91d5-5a19ce9f53d5" status: 204 len: 0 microversion: 2.1 time: 3.312104 Oct 04 20:47:15.022805 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1522/3009] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:47:11 2022] DELETE /compute/v2.1/images/78cea246-4b2b-4af1-91d5-5a19ce9f53d5 => generated 0 bytes in 3315 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:47:15.038301 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-a7da7d8e-7819-4c19-9f00-e31b8e64836e tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:15.039387 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-a7da7d8e-7819-4c19-9f00-e31b8e64836e tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: fde3f6fc-61e1-4b21-8b91-e95c2db3d48c] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:15.055717 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a7da7d8e-7819-4c19-9f00-e31b8e64836e tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:15.056205 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a7da7d8e-7819-4c19-9f00-e31b8e64836e tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:15.056643 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a7da7d8e-7819-4c19-9f00-e31b8e64836e tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:15.059769 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a7da7d8e-7819-4c19-9f00-e31b8e64836e tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:15.060397 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a7da7d8e-7819-4c19-9f00-e31b8e64836e tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:15.061284 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a7da7d8e-7819-4c19-9f00-e31b8e64836e tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:15.159985 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.network.neutron [None req-b4ef7424-9142-4e86-8874-6feb30f2136e tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] validate_networks() for [('a32beee4-b00b-48d9-8656-e7b824aeffce', None, None, None, None, None)] {{(pid=128801) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:47:15.352764 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-a7da7d8e-7819-4c19-9f00-e31b8e64836e tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac650232cc04810b1340dc2f0edadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b0670d1bd99424780a70e69d57a2166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:15.363719 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-a7da7d8e-7819-4c19-9f00-e31b8e64836e tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "GET /compute/v2.1/servers/fde3f6fc-61e1-4b21-8b91-e95c2db3d48c" status: 200 len: 1315 microversion: 2.1 time: 0.339864 Oct 04 20:47:15.366216 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1523/3010] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:47:15 2022] GET /compute/v2.1/servers/fde3f6fc-61e1-4b21-8b91-e95c2db3d48c => generated 1315 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:47:15.374573 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-fa181caa-e146-4f6b-8d88-b1a44fac6bb7 req-cd8094eb-25e0-4531-be74-2bf53dfc97a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "291474d2-a375-4974-abec-713900c08119", "name": "network-vif-deleted", "tag": "744df6f8-0df8-4ff2-b842-56de1314bff3"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:47:15.388613 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-fa181caa-e146-4f6b-8d88-b1a44fac6bb7 req-cd8094eb-25e0-4531-be74-2bf53dfc97a3 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:15.389275 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-fa181caa-e146-4f6b-8d88-b1a44fac6bb7 req-cd8094eb-25e0-4531-be74-2bf53dfc97a3 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:15.390013 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-fa181caa-e146-4f6b-8d88-b1a44fac6bb7 req-cd8094eb-25e0-4531-be74-2bf53dfc97a3 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:15.405477 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-fa181caa-e146-4f6b-8d88-b1a44fac6bb7 req-cd8094eb-25e0-4531-be74-2bf53dfc97a3 service nova] Creating event network-vif-deleted:744df6f8-0df8-4ff2-b842-56de1314bff3 for instance 291474d2-a375-4974-abec-713900c08119 on n-h1-854823-8 Oct 04 20:47:15.416416 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-fa181caa-e146-4f6b-8d88-b1a44fac6bb7 req-cd8094eb-25e0-4531-be74-2bf53dfc97a3 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047954 Oct 04 20:47:15.418765 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1524/3011] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:47:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:47:15.424043 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-f6eb9a64-7058-4758-8cba-dae572e24677 req-12cf2bf6-48d1-44d1-b0ee-a747dcb5047b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fde3f6fc-61e1-4b21-8b91-e95c2db3d48c", "name": "network-vif-plugged", "status": "completed", "tag": "ecd76bad-a328-479e-bee1-f8412f546d83"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:47:15.438455 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-f6eb9a64-7058-4758-8cba-dae572e24677 req-12cf2bf6-48d1-44d1-b0ee-a747dcb5047b service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:15.439224 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-f6eb9a64-7058-4758-8cba-dae572e24677 req-12cf2bf6-48d1-44d1-b0ee-a747dcb5047b service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:15.439817 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-f6eb9a64-7058-4758-8cba-dae572e24677 req-12cf2bf6-48d1-44d1-b0ee-a747dcb5047b service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:15.457177 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-f6eb9a64-7058-4758-8cba-dae572e24677 req-12cf2bf6-48d1-44d1-b0ee-a747dcb5047b service nova] Creating event network-vif-plugged:ecd76bad-a328-479e-bee1-f8412f546d83 for instance fde3f6fc-61e1-4b21-8b91-e95c2db3d48c on n-h2-854823-8 Oct 04 20:47:15.462865 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-f6eb9a64-7058-4758-8cba-dae572e24677 req-12cf2bf6-48d1-44d1-b0ee-a747dcb5047b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042541 Oct 04 20:47:15.463686 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1525/3012] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:47:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:47:15.469184 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-0aae2f33-2bac-45b5-bfdd-67e3640192b3 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:15.469862 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-0aae2f33-2bac-45b5-bfdd-67e3640192b3 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] [instance: 39d66e18-289f-4674-b66c-146d68ef9133] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:15.481155 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0aae2f33-2bac-45b5-bfdd-67e3640192b3 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:15.481908 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0aae2f33-2bac-45b5-bfdd-67e3640192b3 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:15.482544 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0aae2f33-2bac-45b5-bfdd-67e3640192b3 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:15.483420 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0aae2f33-2bac-45b5-bfdd-67e3640192b3 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:15.484040 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0aae2f33-2bac-45b5-bfdd-67e3640192b3 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:15.484627 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0aae2f33-2bac-45b5-bfdd-67e3640192b3 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:15.616165 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-0aae2f33-2bac-45b5-bfdd-67e3640192b3 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:15.628342 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-0aae2f33-2bac-45b5-bfdd-67e3640192b3 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:15.630468 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-0aae2f33-2bac-45b5-bfdd-67e3640192b3 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:15.638979 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-0aae2f33-2bac-45b5-bfdd-67e3640192b3 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] 10.222.0.33 "GET /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133" status: 200 len: 1555 microversion: 2.91 time: 0.172288 Oct 04 20:47:15.638979 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1526/3013] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:47:15 2022] GET /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133 => generated 1555 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:47:15.645250 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-3df1d868-cd01-4fba-b47d-1d2262398e7d tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:15.646521 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-3df1d868-cd01-4fba-b47d-1d2262398e7d tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] [instance: 39e846c1-6876-42ef-b290-f733516e1051] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:15.654847 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3df1d868-cd01-4fba-b47d-1d2262398e7d tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:15.655854 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3df1d868-cd01-4fba-b47d-1d2262398e7d tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:15.656538 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3df1d868-cd01-4fba-b47d-1d2262398e7d tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:15.657267 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3df1d868-cd01-4fba-b47d-1d2262398e7d tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:15.657854 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3df1d868-cd01-4fba-b47d-1d2262398e7d tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:15.658454 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3df1d868-cd01-4fba-b47d-1d2262398e7d tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:16.268289 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-b4ef7424-9142-4e86-8874-6feb30f2136e tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Flavor limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:47:16.268813 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-b4ef7424-9142-4e86-8874-6feb30f2136e tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Image limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:47:16.269512 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-b4ef7424-9142-4e86-8874-6feb30f2136e tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Flavor pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:47:16.270049 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-b4ef7424-9142-4e86-8874-6feb30f2136e tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Image pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:47:16.271898 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-b4ef7424-9142-4e86-8874-6feb30f2136e tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:47:16.286453 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b4ef7424-9142-4e86-8874-6feb30f2136e tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:16.286956 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b4ef7424-9142-4e86-8874-6feb30f2136e tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:16.287595 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b4ef7424-9142-4e86-8874-6feb30f2136e tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:16.288495 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b4ef7424-9142-4e86-8874-6feb30f2136e tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:16.289125 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b4ef7424-9142-4e86-8874-6feb30f2136e tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:16.289714 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b4ef7424-9142-4e86-8874-6feb30f2136e tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:16.303520 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-3df1d868-cd01-4fba-b47d-1d2262398e7d tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12dc6570db03431187680f51349e55d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91111396aabd4306b66e14b5abd822ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:16.312153 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-3df1d868-cd01-4fba-b47d-1d2262398e7d tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] 10.222.0.33 "GET /compute/v2.1/servers/39e846c1-6876-42ef-b290-f733516e1051" status: 200 len: 1507 microversion: 2.1 time: 0.672301 Oct 04 20:47:16.327117 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1527/3014] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:47:15 2022] GET /compute/v2.1/servers/39e846c1-6876-42ef-b290-f733516e1051 => generated 1507 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:47:16.327236 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-b4ef7424-9142-4e86-8874-6feb30f2136e tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Getting quotas for project 7097bc12179446f6a3e1fac8434d5c64. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:47:16.327375 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-c53587ec-913d-4a56-b073-d48bf1efffd6 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Calling method '.version_select at 0x7f3c788c9160>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:16.327482 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-b4ef7424-9142-4e86-8874-6feb30f2136e tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Getting quotas for user 87dcc7baf63f4ae6bfe0a099adffd408 and project 7097bc12179446f6a3e1fac8434d5c64. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:47:16.348300 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b4ef7424-9142-4e86-8874-6feb30f2136e tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Going to run 1 instances... {{(pid=128801) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:47:16.351146 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b4ef7424-9142-4e86-8874-6feb30f2136e tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] [instance: 041f0f59-75c7-4d01-bc99-77cb871f0fef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='15b24725-0c99-4bcf-b1fb-907cdf8e2d63',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128801) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:47:16.415120 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b4ef7424-9142-4e86-8874-6feb30f2136e tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.573203 Oct 04 20:47:16.415844 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1488/3015] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 20:47:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 1575 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 20:47:16.421781 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d8d27862-718f-4c7e-815f-f021f2e5bd6f tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Calling method '.version_select at 0x7f3c7492ca60>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:16.671533 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-c53587ec-913d-4a56-b073-d48bf1efffd6 tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] 10.222.0.33 "DELETE /compute/v2.1/images/85e195a0-9c00-4243-9e00-452d60faac3a" status: 204 len: 0 microversion: 2.1 time: 0.356529 Oct 04 20:47:16.672116 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1528/3016] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:47:16 2022] DELETE /compute/v2.1/images/85e195a0-9c00-4243-9e00-452d60faac3a => generated 0 bytes in 358 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:47:16.682720 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-1c414380-40c4-45a8-b2ad-7cbd7d3c54b5 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:16.683363 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-1c414380-40c4-45a8-b2ad-7cbd7d3c54b5 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: fde3f6fc-61e1-4b21-8b91-e95c2db3d48c] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:16.723696 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1c414380-40c4-45a8-b2ad-7cbd7d3c54b5 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:16.724494 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1c414380-40c4-45a8-b2ad-7cbd7d3c54b5 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:16.726255 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1c414380-40c4-45a8-b2ad-7cbd7d3c54b5 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:16.729955 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d8d27862-718f-4c7e-815f-f021f2e5bd6f tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] 10.222.0.33 "GET /compute/v2.1/images/5804f6f0-d786-4197-9403-11c4a65faccd" status: 200 len: 1410 microversion: 2.1 time: 0.312845 Oct 04 20:47:16.731145 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1489/3017] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 20:47:16 2022] GET /compute/v2.1/images/5804f6f0-d786-4197-9403-11c4a65faccd => generated 1410 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:47:16.738532 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6f059749-9384-4646-b2b7-72b8f09caff1 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:16.740333 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-6f059749-9384-4646-b2b7-72b8f09caff1 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] [instance: 041f0f59-75c7-4d01-bc99-77cb871f0fef] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:16.747094 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1c414380-40c4-45a8-b2ad-7cbd7d3c54b5 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:16.747796 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1c414380-40c4-45a8-b2ad-7cbd7d3c54b5 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:16.748403 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1c414380-40c4-45a8-b2ad-7cbd7d3c54b5 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:16.804559 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-6f059749-9384-4646-b2b7-72b8f09caff1 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87dcc7baf63f4ae6bfe0a099adffd408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7097bc12179446f6a3e1fac8434d5c64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:16.815712 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-6f059749-9384-4646-b2b7-72b8f09caff1 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] 10.222.0.33 "GET /compute/v2.1/servers/041f0f59-75c7-4d01-bc99-77cb871f0fef" status: 200 len: 1208 microversion: 2.1 time: 0.083315 Oct 04 20:47:16.819051 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1490/3018] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:47:16 2022] GET /compute/v2.1/servers/041f0f59-75c7-4d01-bc99-77cb871f0fef => generated 1208 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:47:16.826817 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7bcd93af-20d8-486f-8137-a23bf7a14232 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:16.832147 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-7bcd93af-20d8-486f-8137-a23bf7a14232 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] [instance: 39d66e18-289f-4674-b66c-146d68ef9133] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:16.841566 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7bcd93af-20d8-486f-8137-a23bf7a14232 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:16.845098 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7bcd93af-20d8-486f-8137-a23bf7a14232 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:16.848280 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7bcd93af-20d8-486f-8137-a23bf7a14232 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:16.849713 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7bcd93af-20d8-486f-8137-a23bf7a14232 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:16.850421 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7bcd93af-20d8-486f-8137-a23bf7a14232 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:16.851213 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7bcd93af-20d8-486f-8137-a23bf7a14232 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:17.044361 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-7bcd93af-20d8-486f-8137-a23bf7a14232 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:17.061551 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-7bcd93af-20d8-486f-8137-a23bf7a14232 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:17.065950 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-7bcd93af-20d8-486f-8137-a23bf7a14232 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:17.080608 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-7bcd93af-20d8-486f-8137-a23bf7a14232 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] 10.222.0.33 "GET /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133" status: 200 len: 1537 microversion: 2.91 time: 0.257441 Oct 04 20:47:17.085841 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1491/3019] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:47:16 2022] GET /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133 => generated 1537 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:47:17.094880 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-30a49b98-9520-414b-bb8e-005b88ce004a tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] Calling method '.version_select at 0x7f3c74a1a280>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:17.101119 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-1c414380-40c4-45a8-b2ad-7cbd7d3c54b5 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac650232cc04810b1340dc2f0edadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b0670d1bd99424780a70e69d57a2166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:17.110875 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-1c414380-40c4-45a8-b2ad-7cbd7d3c54b5 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "GET /compute/v2.1/servers/fde3f6fc-61e1-4b21-8b91-e95c2db3d48c" status: 200 len: 1315 microversion: 2.1 time: 0.434195 Oct 04 20:47:17.111668 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1529/3020] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:47:16 2022] GET /compute/v2.1/servers/fde3f6fc-61e1-4b21-8b91-e95c2db3d48c => generated 1315 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:47:17.340936 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-55f07aee-84f6-43c7-a235-164554d14d6e tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:17.342617 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-55f07aee-84f6-43c7-a235-164554d14d6e tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] [instance: 39e846c1-6876-42ef-b290-f733516e1051] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:17.353650 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-55f07aee-84f6-43c7-a235-164554d14d6e tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:17.354906 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-55f07aee-84f6-43c7-a235-164554d14d6e tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:17.355668 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-55f07aee-84f6-43c7-a235-164554d14d6e tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:17.357817 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-55f07aee-84f6-43c7-a235-164554d14d6e tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:17.361372 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-55f07aee-84f6-43c7-a235-164554d14d6e tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:17.362230 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-55f07aee-84f6-43c7-a235-164554d14d6e tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:17.509120 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-30a49b98-9520-414b-bb8e-005b88ce004a tempest-ListImageFiltersTestJSON-1176779314 tempest-ListImageFiltersTestJSON-1176779314-project] 10.222.0.33 "DELETE /compute/v2.1/images/89571f97-013e-48fe-a213-64b35354aafa" status: 204 len: 0 microversion: 2.1 time: 0.421812 Oct 04 20:47:17.521011 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1492/3021] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:47:17 2022] DELETE /compute/v2.1/images/89571f97-013e-48fe-a213-64b35354aafa => generated 0 bytes in 424 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:47:17.584684 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-55f07aee-84f6-43c7-a235-164554d14d6e tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12dc6570db03431187680f51349e55d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91111396aabd4306b66e14b5abd822ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:17.592896 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-55f07aee-84f6-43c7-a235-164554d14d6e tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] 10.222.0.33 "GET /compute/v2.1/servers/39e846c1-6876-42ef-b290-f733516e1051" status: 200 len: 1507 microversion: 2.1 time: 0.258890 Oct 04 20:47:17.618433 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1530/3022] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:47:17 2022] GET /compute/v2.1/servers/39e846c1-6876-42ef-b290-f733516e1051 => generated 1507 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:47:17.749031 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-999adca3-2f7d-4421-b2fa-a0311ff1ef6b tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Calling method '.version_select at 0x7f3c74efa5e0>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:17.823139 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-999adca3-2f7d-4421-b2fa-a0311ff1ef6b tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] 10.222.0.33 "GET /compute/v2.1/images/5804f6f0-d786-4197-9403-11c4a65faccd" status: 200 len: 1410 microversion: 2.1 time: 0.077800 Oct 04 20:47:17.825924 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1493/3023] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 20:47:17 2022] GET /compute/v2.1/images/5804f6f0-d786-4197-9403-11c4a65faccd => generated 1410 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:47:17.841846 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-bbc156ca-21be-4efa-a9db-46a72dac537d tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:17.842793 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-bbc156ca-21be-4efa-a9db-46a72dac537d tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] [instance: 041f0f59-75c7-4d01-bc99-77cb871f0fef] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:17.851617 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bbc156ca-21be-4efa-a9db-46a72dac537d tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:17.853388 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bbc156ca-21be-4efa-a9db-46a72dac537d tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:17.854590 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bbc156ca-21be-4efa-a9db-46a72dac537d tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:17.856771 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bbc156ca-21be-4efa-a9db-46a72dac537d tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:17.857429 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bbc156ca-21be-4efa-a9db-46a72dac537d tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:17.858325 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bbc156ca-21be-4efa-a9db-46a72dac537d tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:17.948799 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-bbc156ca-21be-4efa-a9db-46a72dac537d tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87dcc7baf63f4ae6bfe0a099adffd408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7097bc12179446f6a3e1fac8434d5c64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:17.960701 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-bbc156ca-21be-4efa-a9db-46a72dac537d tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] 10.222.0.33 "GET /compute/v2.1/servers/041f0f59-75c7-4d01-bc99-77cb871f0fef" status: 200 len: 1260 microversion: 2.1 time: 0.123213 Oct 04 20:47:17.961498 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1531/3024] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:47:17 2022] GET /compute/v2.1/servers/041f0f59-75c7-4d01-bc99-77cb871f0fef => generated 1260 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:47:18.120679 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e8c61d15-96e1-49b2-b8a1-193a0379350c tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:18.121300 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e8c61d15-96e1-49b2-b8a1-193a0379350c tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] [instance: 39d66e18-289f-4674-b66c-146d68ef9133] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:18.133847 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-d81ee1e9-54f2-42f7-afbe-d1d2202354cb tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:18.134102 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e8c61d15-96e1-49b2-b8a1-193a0379350c tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:18.134102 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e8c61d15-96e1-49b2-b8a1-193a0379350c tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:18.134550 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e8c61d15-96e1-49b2-b8a1-193a0379350c tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:18.135255 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e8c61d15-96e1-49b2-b8a1-193a0379350c tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:18.135444 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-d81ee1e9-54f2-42f7-afbe-d1d2202354cb tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: fde3f6fc-61e1-4b21-8b91-e95c2db3d48c] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:18.135702 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e8c61d15-96e1-49b2-b8a1-193a0379350c tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:18.142310 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d81ee1e9-54f2-42f7-afbe-d1d2202354cb tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:18.144072 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e8c61d15-96e1-49b2-b8a1-193a0379350c tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:18.146706 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d81ee1e9-54f2-42f7-afbe-d1d2202354cb tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:18.151971 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d81ee1e9-54f2-42f7-afbe-d1d2202354cb tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:18.153006 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d81ee1e9-54f2-42f7-afbe-d1d2202354cb tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:18.153825 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d81ee1e9-54f2-42f7-afbe-d1d2202354cb tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:18.154460 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d81ee1e9-54f2-42f7-afbe-d1d2202354cb tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:18.188798 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=100 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:47:18.268095 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e8c61d15-96e1-49b2-b8a1-193a0379350c tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:18.286699 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e8c61d15-96e1-49b2-b8a1-193a0379350c tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:18.288816 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e8c61d15-96e1-49b2-b8a1-193a0379350c tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:18.304263 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e8c61d15-96e1-49b2-b8a1-193a0379350c tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] 10.222.0.33 "GET /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133" status: 200 len: 1537 microversion: 2.91 time: 0.190864 Oct 04 20:47:18.310078 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1494/3025] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:47:18 2022] GET /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133 => generated 1537 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:47:18.415226 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-d81ee1e9-54f2-42f7-afbe-d1d2202354cb tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac650232cc04810b1340dc2f0edadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b0670d1bd99424780a70e69d57a2166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:18.423466 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-d81ee1e9-54f2-42f7-afbe-d1d2202354cb tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "GET /compute/v2.1/servers/fde3f6fc-61e1-4b21-8b91-e95c2db3d48c" status: 200 len: 1315 microversion: 2.1 time: 0.294305 Oct 04 20:47:18.424364 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1532/3026] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:47:18 2022] GET /compute/v2.1/servers/fde3f6fc-61e1-4b21-8b91-e95c2db3d48c => generated 1315 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:47:18.621433 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-10e46a68-6aab-4e7b-9476-5273bf10af1a tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:18.622227 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-10e46a68-6aab-4e7b-9476-5273bf10af1a tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] [instance: 39e846c1-6876-42ef-b290-f733516e1051] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:18.629974 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-10e46a68-6aab-4e7b-9476-5273bf10af1a tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:18.630605 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-10e46a68-6aab-4e7b-9476-5273bf10af1a tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:18.631247 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-10e46a68-6aab-4e7b-9476-5273bf10af1a tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:18.632133 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-10e46a68-6aab-4e7b-9476-5273bf10af1a tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:18.632768 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-10e46a68-6aab-4e7b-9476-5273bf10af1a tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:18.633355 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-10e46a68-6aab-4e7b-9476-5273bf10af1a tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:18.836306 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-10e46a68-6aab-4e7b-9476-5273bf10af1a tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12dc6570db03431187680f51349e55d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91111396aabd4306b66e14b5abd822ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:18.844904 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-10e46a68-6aab-4e7b-9476-5273bf10af1a tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] 10.222.0.33 "GET /compute/v2.1/servers/39e846c1-6876-42ef-b290-f733516e1051" status: 200 len: 1507 microversion: 2.1 time: 0.231631 Oct 04 20:47:18.845199 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-5552653f-a1ca-4507-9725-78d9f87f242b tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Calling method '.version_select at 0x7f3c74128ca0>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:18.845706 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1495/3027] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:47:18 2022] GET /compute/v2.1/servers/39e846c1-6876-42ef-b290-f733516e1051 => generated 1507 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:47:18.906797 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-5552653f-a1ca-4507-9725-78d9f87f242b tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] 10.222.0.33 "GET /compute/v2.1/images/5804f6f0-d786-4197-9403-11c4a65faccd" status: 200 len: 1410 microversion: 2.1 time: 0.065200 Oct 04 20:47:18.917380 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1533/3028] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 20:47:18 2022] GET /compute/v2.1/images/5804f6f0-d786-4197-9403-11c4a65faccd => generated 1410 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:47:18.984869 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c3b63d01-875e-4282-81ba-ae9c9a8d391f tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:18.985824 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c3b63d01-875e-4282-81ba-ae9c9a8d391f tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] [instance: 041f0f59-75c7-4d01-bc99-77cb871f0fef] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:18.994326 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c3b63d01-875e-4282-81ba-ae9c9a8d391f tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:18.994839 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c3b63d01-875e-4282-81ba-ae9c9a8d391f tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:18.995278 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c3b63d01-875e-4282-81ba-ae9c9a8d391f tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:18.995981 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c3b63d01-875e-4282-81ba-ae9c9a8d391f tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:18.996433 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c3b63d01-875e-4282-81ba-ae9c9a8d391f tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:18.996855 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c3b63d01-875e-4282-81ba-ae9c9a8d391f tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:19.073000 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c3b63d01-875e-4282-81ba-ae9c9a8d391f tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87dcc7baf63f4ae6bfe0a099adffd408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7097bc12179446f6a3e1fac8434d5c64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:19.086117 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c3b63d01-875e-4282-81ba-ae9c9a8d391f tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] 10.222.0.33 "GET /compute/v2.1/servers/041f0f59-75c7-4d01-bc99-77cb871f0fef" status: 200 len: 1260 microversion: 2.1 time: 0.104939 Oct 04 20:47:19.087344 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1496/3029] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:47:18 2022] GET /compute/v2.1/servers/041f0f59-75c7-4d01-bc99-77cb871f0fef => generated 1260 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:47:19.341052 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-7b3dc72e-cba7-4dc1-87e3-e9666ae5aaf8 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:19.341675 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-7b3dc72e-cba7-4dc1-87e3-e9666ae5aaf8 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] [instance: 39d66e18-289f-4674-b66c-146d68ef9133] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:19.363523 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7b3dc72e-cba7-4dc1-87e3-e9666ae5aaf8 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:19.366365 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7b3dc72e-cba7-4dc1-87e3-e9666ae5aaf8 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:19.367749 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7b3dc72e-cba7-4dc1-87e3-e9666ae5aaf8 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:19.369177 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7b3dc72e-cba7-4dc1-87e3-e9666ae5aaf8 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:19.370522 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7b3dc72e-cba7-4dc1-87e3-e9666ae5aaf8 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:19.371355 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7b3dc72e-cba7-4dc1-87e3-e9666ae5aaf8 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:19.576413 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-7b3dc72e-cba7-4dc1-87e3-e9666ae5aaf8 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:19.586714 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-7b3dc72e-cba7-4dc1-87e3-e9666ae5aaf8 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:19.592357 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-7b3dc72e-cba7-4dc1-87e3-e9666ae5aaf8 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:19.604803 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-7b3dc72e-cba7-4dc1-87e3-e9666ae5aaf8 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] 10.222.0.33 "GET /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133" status: 200 len: 1540 microversion: 2.91 time: 0.272934 Oct 04 20:47:19.608806 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1534/3030] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:47:19 2022] GET /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133 => generated 1540 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:47:19.615298 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-2697f508-150d-43c6-a512-318f05bc0e89 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:19.622040 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-2697f508-150d-43c6-a512-318f05bc0e89 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: fde3f6fc-61e1-4b21-8b91-e95c2db3d48c] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:19.636289 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2697f508-150d-43c6-a512-318f05bc0e89 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:19.636831 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2697f508-150d-43c6-a512-318f05bc0e89 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:19.637267 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2697f508-150d-43c6-a512-318f05bc0e89 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:19.637968 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2697f508-150d-43c6-a512-318f05bc0e89 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:19.638561 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2697f508-150d-43c6-a512-318f05bc0e89 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:19.638845 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2697f508-150d-43c6-a512-318f05bc0e89 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:19.662497 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-daa4e085-22d6-4160-a841-7cf6cb023371 tempest-ListImagesTestJSON-1747738180 tempest-ListImagesTestJSON-1747738180-project] Calling method '.version_select at 0x7f3c74534790>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:19.749330 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-daa4e085-22d6-4160-a841-7cf6cb023371 tempest-ListImagesTestJSON-1747738180 tempest-ListImagesTestJSON-1747738180-project] 10.222.0.33 "GET /compute/v2.1/images/15b24725-0c99-4bcf-b1fb-907cdf8e2d63" status: 200 len: 784 microversion: 2.1 time: 0.367828 Oct 04 20:47:19.751109 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1497/3031] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 20:47:19 2022] GET /compute/v2.1/images/15b24725-0c99-4bcf-b1fb-907cdf8e2d63 => generated 784 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 20:47:19.766399 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b469a812-94a9-4ea6-b2b5-5f1411b6a4f0 tempest-UnshelveToHostMultiNodesTest-1871197656 tempest-UnshelveToHostMultiNodesTest-1871197656-project-admin] Action: 'action', calling method: >, body: {"unshelve": {"host": "n-h1-854823-8"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:47:19.768952 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b469a812-94a9-4ea6-b2b5-5f1411b6a4f0 tempest-UnshelveToHostMultiNodesTest-1871197656 tempest-UnshelveToHostMultiNodesTest-1871197656-project-admin] [instance: 39d66e18-289f-4674-b66c-146d68ef9133] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:19.779424 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b469a812-94a9-4ea6-b2b5-5f1411b6a4f0 tempest-UnshelveToHostMultiNodesTest-1871197656 tempest-UnshelveToHostMultiNodesTest-1871197656-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:19.779929 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b469a812-94a9-4ea6-b2b5-5f1411b6a4f0 tempest-UnshelveToHostMultiNodesTest-1871197656 tempest-UnshelveToHostMultiNodesTest-1871197656-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:19.780366 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b469a812-94a9-4ea6-b2b5-5f1411b6a4f0 tempest-UnshelveToHostMultiNodesTest-1871197656 tempest-UnshelveToHostMultiNodesTest-1871197656-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:19.781070 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b469a812-94a9-4ea6-b2b5-5f1411b6a4f0 tempest-UnshelveToHostMultiNodesTest-1871197656 tempest-UnshelveToHostMultiNodesTest-1871197656-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:19.781550 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b469a812-94a9-4ea6-b2b5-5f1411b6a4f0 tempest-UnshelveToHostMultiNodesTest-1871197656 tempest-UnshelveToHostMultiNodesTest-1871197656-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:19.782165 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b469a812-94a9-4ea6-b2b5-5f1411b6a4f0 tempest-UnshelveToHostMultiNodesTest-1871197656 tempest-UnshelveToHostMultiNodesTest-1871197656-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:19.872565 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b469a812-94a9-4ea6-b2b5-5f1411b6a4f0 tempest-UnshelveToHostMultiNodesTest-1871197656 tempest-UnshelveToHostMultiNodesTest-1871197656-project-admin] [instance: 39d66e18-289f-4674-b66c-146d68ef9133] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "n-h1-854823-8". {{(pid=128801) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 04 20:47:19.910102 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-2697f508-150d-43c6-a512-318f05bc0e89 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac650232cc04810b1340dc2f0edadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b0670d1bd99424780a70e69d57a2166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:19.918988 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-2697f508-150d-43c6-a512-318f05bc0e89 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "GET /compute/v2.1/servers/fde3f6fc-61e1-4b21-8b91-e95c2db3d48c" status: 200 len: 1503 microversion: 2.1 time: 0.308951 Oct 04 20:47:19.925309 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1535/3032] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:47:19 2022] GET /compute/v2.1/servers/fde3f6fc-61e1-4b21-8b91-e95c2db3d48c => generated 1503 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:47:19.930813 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-16d1f80a-ebaa-45f5-9ad2-2dfd9da50c9f tempest-ListImagesTestJSON-1747738180 tempest-ListImagesTestJSON-1747738180-project] Calling method '.version_select at 0x7f3c740ad790>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:19.981025 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b469a812-94a9-4ea6-b2b5-5f1411b6a4f0 tempest-UnshelveToHostMultiNodesTest-1871197656 tempest-UnshelveToHostMultiNodesTest-1871197656-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133/action" status: 202 len: 0 microversion: 2.91 time: 0.218488 Oct 04 20:47:19.982200 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1498/3033] 10.222.0.33 () {62 vars in 1319 bytes} [Tue Oct 4 20:47:19 2022] POST /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133/action => generated 0 bytes in 220 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:47:19.992216 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-65c9ea45-6d9b-4f8e-a118-0c8561c35841 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:19.992894 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-65c9ea45-6d9b-4f8e-a118-0c8561c35841 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] [instance: 39e846c1-6876-42ef-b290-f733516e1051] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:19.999747 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-65c9ea45-6d9b-4f8e-a118-0c8561c35841 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:20.000238 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-65c9ea45-6d9b-4f8e-a118-0c8561c35841 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:20.000781 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-65c9ea45-6d9b-4f8e-a118-0c8561c35841 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:20.001355 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-65c9ea45-6d9b-4f8e-a118-0c8561c35841 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:20.001946 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-65c9ea45-6d9b-4f8e-a118-0c8561c35841 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:20.002546 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-65c9ea45-6d9b-4f8e-a118-0c8561c35841 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:20.049933 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-16d1f80a-ebaa-45f5-9ad2-2dfd9da50c9f tempest-ListImagesTestJSON-1747738180 tempest-ListImagesTestJSON-1747738180-project] 10.222.0.33 "GET /compute/v2.1/images" status: 200 len: 445 microversion: 2.1 time: 0.123282 Oct 04 20:47:20.050553 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1536/3034] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 20:47:19 2022] GET /compute/v2.1/images => generated 445 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:47:20.066370 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-6d673f8f-0dca-4b75-88f6-8ce40cd754c0 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Calling method '.version_select at 0x7f3c741980d0>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:20.135004 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-6d673f8f-0dca-4b75-88f6-8ce40cd754c0 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] 10.222.0.33 "GET /compute/v2.1/images/5804f6f0-d786-4197-9403-11c4a65faccd" status: 200 len: 1410 microversion: 2.1 time: 0.081944 Oct 04 20:47:20.135590 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1537/3035] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 20:47:20 2022] GET /compute/v2.1/images/5804f6f0-d786-4197-9403-11c4a65faccd => generated 1410 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:47:20.152748 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-153fad72-1137-4be9-b318-73731b490d58 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:47:20.161493 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-153fad72-1137-4be9-b318-73731b490d58 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:20.162273 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-153fad72-1137-4be9-b318-73731b490d58 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:20.162893 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-153fad72-1137-4be9-b318-73731b490d58 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:20.213022 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-153fad72-1137-4be9-b318-73731b490d58 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: fde3f6fc-61e1-4b21-8b91-e95c2db3d48c] Going to try to stop instance {{(pid=128802) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 04 20:47:20.283484 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-153fad72-1137-4be9-b318-73731b490d58 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "POST /compute/v2.1/servers/fde3f6fc-61e1-4b21-8b91-e95c2db3d48c/action" status: 202 len: 0 microversion: 2.1 time: 0.132437 Oct 04 20:47:20.288608 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1538/3036] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 20:47:20 2022] POST /compute/v2.1/servers/fde3f6fc-61e1-4b21-8b91-e95c2db3d48c/action => generated 0 bytes in 138 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:47:20.293377 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-38652bc2-6903-47bf-8028-ef3a2559a198 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:20.294535 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-38652bc2-6903-47bf-8028-ef3a2559a198 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] [instance: 39d66e18-289f-4674-b66c-146d68ef9133] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:20.316877 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-38652bc2-6903-47bf-8028-ef3a2559a198 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:20.319322 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-38652bc2-6903-47bf-8028-ef3a2559a198 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:20.320259 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-38652bc2-6903-47bf-8028-ef3a2559a198 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:20.321272 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-38652bc2-6903-47bf-8028-ef3a2559a198 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:20.323494 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-38652bc2-6903-47bf-8028-ef3a2559a198 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:20.324144 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-38652bc2-6903-47bf-8028-ef3a2559a198 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:20.346627 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-65c9ea45-6d9b-4f8e-a118-0c8561c35841 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12dc6570db03431187680f51349e55d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91111396aabd4306b66e14b5abd822ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:20.360388 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-65c9ea45-6d9b-4f8e-a118-0c8561c35841 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] 10.222.0.33 "GET /compute/v2.1/servers/39e846c1-6876-42ef-b290-f733516e1051" status: 200 len: 1511 microversion: 2.1 time: 0.377078 Oct 04 20:47:20.374370 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1499/3037] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:47:19 2022] GET /compute/v2.1/servers/39e846c1-6876-42ef-b290-f733516e1051 => generated 1511 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:47:20.405282 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-64d75315-c5da-4b08-9227-d1deae92604f tempest-ListImagesTestJSON-1747738180 tempest-ListImagesTestJSON-1747738180-project] Calling method '.version_select at 0x7f3c744519d0>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:20.481792 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-64d75315-c5da-4b08-9227-d1deae92604f tempest-ListImagesTestJSON-1747738180 tempest-ListImagesTestJSON-1747738180-project] 10.222.0.33 "GET /compute/v2.1/images/detail" status: 200 len: 787 microversion: 2.1 time: 0.118479 Oct 04 20:47:20.482415 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1500/3038] 10.222.0.33 () {58 vars in 1143 bytes} [Tue Oct 4 20:47:20 2022] GET /compute/v2.1/images/detail => generated 787 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:47:20.486994 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-810a8274-ccea-4e63-a5c1-91684d553ea0 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:20.487768 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-810a8274-ccea-4e63-a5c1-91684d553ea0 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] [instance: 041f0f59-75c7-4d01-bc99-77cb871f0fef] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:20.494424 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-810a8274-ccea-4e63-a5c1-91684d553ea0 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:20.495113 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-810a8274-ccea-4e63-a5c1-91684d553ea0 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:20.495330 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-810a8274-ccea-4e63-a5c1-91684d553ea0 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:20.496216 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-810a8274-ccea-4e63-a5c1-91684d553ea0 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:20.496972 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-810a8274-ccea-4e63-a5c1-91684d553ea0 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:20.497567 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-810a8274-ccea-4e63-a5c1-91684d553ea0 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:20.516472 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-38652bc2-6903-47bf-8028-ef3a2559a198 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:20.533067 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-38652bc2-6903-47bf-8028-ef3a2559a198 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:20.534666 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-38652bc2-6903-47bf-8028-ef3a2559a198 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:20.559362 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-38652bc2-6903-47bf-8028-ef3a2559a198 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] 10.222.0.33 "GET /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133" status: 200 len: 1488 microversion: 2.91 time: 0.271981 Oct 04 20:47:20.561311 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1539/3039] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:47:20 2022] GET /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133 => generated 1488 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:47:20.571931 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-f6c8c491-4efb-4d0c-a386-9469e0a5850e tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:20.572548 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-f6c8c491-4efb-4d0c-a386-9469e0a5850e tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: fde3f6fc-61e1-4b21-8b91-e95c2db3d48c] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:20.578845 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f6c8c491-4efb-4d0c-a386-9469e0a5850e tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:20.579497 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f6c8c491-4efb-4d0c-a386-9469e0a5850e tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:20.579744 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f6c8c491-4efb-4d0c-a386-9469e0a5850e tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:20.581353 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f6c8c491-4efb-4d0c-a386-9469e0a5850e tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:20.581849 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f6c8c491-4efb-4d0c-a386-9469e0a5850e tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:20.582951 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f6c8c491-4efb-4d0c-a386-9469e0a5850e tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:20.613582 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-810a8274-ccea-4e63-a5c1-91684d553ea0 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87dcc7baf63f4ae6bfe0a099adffd408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7097bc12179446f6a3e1fac8434d5c64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:20.636261 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-810a8274-ccea-4e63-a5c1-91684d553ea0 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] 10.222.0.33 "GET /compute/v2.1/servers/041f0f59-75c7-4d01-bc99-77cb871f0fef" status: 200 len: 1266 microversion: 2.1 time: 0.152800 Oct 04 20:47:20.636860 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1501/3040] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:47:20 2022] GET /compute/v2.1/servers/041f0f59-75c7-4d01-bc99-77cb871f0fef => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:47:20.650269 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-624343ba-2d9d-4c0f-aab6-fc044967cd84 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:20.665264 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-624343ba-2d9d-4c0f-aab6-fc044967cd84 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '12dc6570db03431187680f51349e55d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91111396aabd4306b66e14b5abd822ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:20.665966 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.compute.servers [None req-624343ba-2d9d-4c0f-aab6-fc044967cd84 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Removing options 'limit' from query {{(pid=128801) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 04 20:47:20.666567 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-624343ba-2d9d-4c0f-aab6-fc044967cd84 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Searching by: {'deleted': False, 'project_id': '91111396aabd4306b66e14b5abd822ad'} {{(pid=128801) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 20:47:20.667831 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-624343ba-2d9d-4c0f-aab6-fc044967cd84 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:20.668500 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-624343ba-2d9d-4c0f-aab6-fc044967cd84 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:20.669100 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-624343ba-2d9d-4c0f-aab6-fc044967cd84 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:20.670010 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-624343ba-2d9d-4c0f-aab6-fc044967cd84 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:20.670719 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-624343ba-2d9d-4c0f-aab6-fc044967cd84 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:20.671140 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-624343ba-2d9d-4c0f-aab6-fc044967cd84 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:20.672788 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-624343ba-2d9d-4c0f-aab6-fc044967cd84 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] 10.222.0.33 "GET /compute/v2.1/servers?limit=0" status: 200 len: 15 microversion: 2.1 time: 0.034737 Oct 04 20:47:20.675504 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1502/3041] 10.222.0.33 () {58 vars in 1140 bytes} [Tue Oct 4 20:47:20 2022] GET /compute/v2.1/servers?limit=0 => generated 15 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 20:47:20.687218 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-498664a1-ced1-46f7-86cd-4576bcafe51d tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:20.688158 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-498664a1-ced1-46f7-86cd-4576bcafe51d tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] [instance: 39e846c1-6876-42ef-b290-f733516e1051] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:20.697107 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-498664a1-ced1-46f7-86cd-4576bcafe51d tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:20.697871 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-498664a1-ced1-46f7-86cd-4576bcafe51d tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:20.698538 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-498664a1-ced1-46f7-86cd-4576bcafe51d tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:20.699772 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-498664a1-ced1-46f7-86cd-4576bcafe51d tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:20.700284 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-498664a1-ced1-46f7-86cd-4576bcafe51d tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:20.700782 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-498664a1-ced1-46f7-86cd-4576bcafe51d tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:20.704582 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:47:20.883275 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-f6c8c491-4efb-4d0c-a386-9469e0a5850e tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac650232cc04810b1340dc2f0edadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b0670d1bd99424780a70e69d57a2166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:20.896004 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-f6c8c491-4efb-4d0c-a386-9469e0a5850e tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "GET /compute/v2.1/servers/fde3f6fc-61e1-4b21-8b91-e95c2db3d48c" status: 200 len: 1513 microversion: 2.1 time: 0.328373 Oct 04 20:47:20.897539 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1540/3042] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:47:20 2022] GET /compute/v2.1/servers/fde3f6fc-61e1-4b21-8b91-e95c2db3d48c => generated 1513 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:47:21.045556 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-498664a1-ced1-46f7-86cd-4576bcafe51d tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12dc6570db03431187680f51349e55d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91111396aabd4306b66e14b5abd822ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:21.066074 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-498664a1-ced1-46f7-86cd-4576bcafe51d tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] 10.222.0.33 "GET /compute/v2.1/servers/39e846c1-6876-42ef-b290-f733516e1051" status: 200 len: 1511 microversion: 2.1 time: 0.383154 Oct 04 20:47:21.068233 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1503/3043] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:47:20 2022] GET /compute/v2.1/servers/39e846c1-6876-42ef-b290-f733516e1051 => generated 1511 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:47:21.091684 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-dac32ccc-6087-4a05-a41e-479524d40827 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:21.092387 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-dac32ccc-6087-4a05-a41e-479524d40827 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] [instance: 7bbbbf6d-9e62-426b-85b4-d523110a05ef] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:21.101287 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dac32ccc-6087-4a05-a41e-479524d40827 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:21.107179 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dac32ccc-6087-4a05-a41e-479524d40827 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:21.107860 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dac32ccc-6087-4a05-a41e-479524d40827 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:21.110182 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dac32ccc-6087-4a05-a41e-479524d40827 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:21.110867 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dac32ccc-6087-4a05-a41e-479524d40827 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:21.115035 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dac32ccc-6087-4a05-a41e-479524d40827 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:21.151363 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2cd384e5-d801-4ac0-a45e-7becddad4049 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Calling method '.version_select at 0x7f3c746ca3a0>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:21.220364 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-2cd384e5-d801-4ac0-a45e-7becddad4049 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] 10.222.0.33 "GET /compute/v2.1/images/5804f6f0-d786-4197-9403-11c4a65faccd" status: 200 len: 1419 microversion: 2.1 time: 0.072718 Oct 04 20:47:21.228611 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1504/3044] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 20:47:21 2022] GET /compute/v2.1/images/5804f6f0-d786-4197-9403-11c4a65faccd => generated 1419 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:47:21.241667 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7f249a6b-185b-4791-961e-51c92e38ba96 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Calling method '.version_select at 0x7f3c74451940>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:21.315065 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-7f249a6b-185b-4791-961e-51c92e38ba96 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] 10.222.0.33 "GET /compute/v2.1/images/5804f6f0-d786-4197-9403-11c4a65faccd" status: 200 len: 1419 microversion: 2.1 time: 0.077844 Oct 04 20:47:21.315743 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1505/3045] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 20:47:21 2022] GET /compute/v2.1/images/5804f6f0-d786-4197-9403-11c4a65faccd => generated 1419 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:47:21.335541 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d1f8417c-ac36-40e8-a357-af8746b0151b tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Calling method '.version_select at 0x7f3c745349d0>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:21.408948 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-dac32ccc-6087-4a05-a41e-479524d40827 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12dc6570db03431187680f51349e55d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91111396aabd4306b66e14b5abd822ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:21.420320 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-dac32ccc-6087-4a05-a41e-479524d40827 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] 10.222.0.33 "GET /compute/v2.1/servers/7bbbbf6d-9e62-426b-85b4-d523110a05ef" status: 200 len: 1510 microversion: 2.1 time: 0.334014 Oct 04 20:47:21.427350 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1541/3046] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:47:21 2022] GET /compute/v2.1/servers/7bbbbf6d-9e62-426b-85b4-d523110a05ef => generated 1510 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:47:21.445224 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-8189b608-5e38-4145-8fd0-2a1f72bbb3ae tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:21.445981 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-8189b608-5e38-4145-8fd0-2a1f72bbb3ae tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] [instance: db0b522b-4140-4587-9c1b-0e62d778dce4] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:21.454079 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8189b608-5e38-4145-8fd0-2a1f72bbb3ae tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:21.455043 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8189b608-5e38-4145-8fd0-2a1f72bbb3ae tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:21.455698 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8189b608-5e38-4145-8fd0-2a1f72bbb3ae tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:21.457555 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8189b608-5e38-4145-8fd0-2a1f72bbb3ae tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:21.458438 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8189b608-5e38-4145-8fd0-2a1f72bbb3ae tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:21.459054 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8189b608-5e38-4145-8fd0-2a1f72bbb3ae tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:21.571134 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell0:SELECT=2 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:47:21.692779 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-8189b608-5e38-4145-8fd0-2a1f72bbb3ae tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12dc6570db03431187680f51349e55d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91111396aabd4306b66e14b5abd822ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:21.713099 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-8189b608-5e38-4145-8fd0-2a1f72bbb3ae tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] 10.222.0.33 "GET /compute/v2.1/servers/db0b522b-4140-4587-9c1b-0e62d778dce4" status: 200 len: 1511 microversion: 2.1 time: 0.273357 Oct 04 20:47:21.715111 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1542/3047] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:47:21 2022] GET /compute/v2.1/servers/db0b522b-4140-4587-9c1b-0e62d778dce4 => generated 1511 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:47:21.735318 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-3c3959e1-0577-4461-98d0-d331b1dc47b0 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:21.736052 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-3c3959e1-0577-4461-98d0-d331b1dc47b0 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] [instance: 39d66e18-289f-4674-b66c-146d68ef9133] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:21.744181 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3c3959e1-0577-4461-98d0-d331b1dc47b0 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:21.744837 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3c3959e1-0577-4461-98d0-d331b1dc47b0 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:21.745274 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3c3959e1-0577-4461-98d0-d331b1dc47b0 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:21.745990 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3c3959e1-0577-4461-98d0-d331b1dc47b0 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:21.746606 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3c3959e1-0577-4461-98d0-d331b1dc47b0 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:21.747094 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3c3959e1-0577-4461-98d0-d331b1dc47b0 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:21.875628 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-3c3959e1-0577-4461-98d0-d331b1dc47b0 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:21.894653 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-3c3959e1-0577-4461-98d0-d331b1dc47b0 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:21.897410 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-3c3959e1-0577-4461-98d0-d331b1dc47b0 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:21.902919 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:47:21.905522 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-3c3959e1-0577-4461-98d0-d331b1dc47b0 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] 10.222.0.33 "GET /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133" status: 200 len: 1546 microversion: 2.91 time: 0.181196 Oct 04 20:47:21.916088 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1543/3048] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:47:21 2022] GET /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133 => generated 1546 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:47:21.927739 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-2db40772-bd3f-493e-b7a6-b89c658c04bb tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:21.929058 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-2db40772-bd3f-493e-b7a6-b89c658c04bb tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] [instance: 041f0f59-75c7-4d01-bc99-77cb871f0fef] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:21.938191 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2db40772-bd3f-493e-b7a6-b89c658c04bb tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:21.939084 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2db40772-bd3f-493e-b7a6-b89c658c04bb tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:21.939838 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2db40772-bd3f-493e-b7a6-b89c658c04bb tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:21.940992 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2db40772-bd3f-493e-b7a6-b89c658c04bb tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:21.941648 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2db40772-bd3f-493e-b7a6-b89c658c04bb tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:21.942898 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2db40772-bd3f-493e-b7a6-b89c658c04bb tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:22.267690 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-2db40772-bd3f-493e-b7a6-b89c658c04bb tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87dcc7baf63f4ae6bfe0a099adffd408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7097bc12179446f6a3e1fac8434d5c64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:22.278951 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-2db40772-bd3f-493e-b7a6-b89c658c04bb tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] 10.222.0.33 "GET /compute/v2.1/servers/041f0f59-75c7-4d01-bc99-77cb871f0fef" status: 200 len: 1308 microversion: 2.1 time: 0.359608 Oct 04 20:47:22.279776 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1544/3049] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:47:21 2022] GET /compute/v2.1/servers/041f0f59-75c7-4d01-bc99-77cb871f0fef => generated 1308 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:47:22.312866 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d1f8417c-ac36-40e8-a357-af8746b0151b tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] 10.222.0.33 "DELETE /compute/v2.1/images/5804f6f0-d786-4197-9403-11c4a65faccd" status: 204 len: 0 microversion: 2.1 time: 0.983008 Oct 04 20:47:22.317909 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1506/3050] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:47:21 2022] DELETE /compute/v2.1/images/5804f6f0-d786-4197-9403-11c4a65faccd => generated 0 bytes in 986 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 20:47:22.321338 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-42353844-4926-43fd-a75a-b9594069ea5d tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:22.325127 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1acf479f-4e04-4111-88d2-557e64f9c0a8 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:22.326051 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-1acf479f-4e04-4111-88d2-557e64f9c0a8 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: fde3f6fc-61e1-4b21-8b91-e95c2db3d48c] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:22.327065 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-42353844-4926-43fd-a75a-b9594069ea5d tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '12dc6570db03431187680f51349e55d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91111396aabd4306b66e14b5abd822ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:22.327838 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-42353844-4926-43fd-a75a-b9594069ea5d tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Searching by: {'ip': '172.20.0.8', 'deleted': False, 'project_id': '91111396aabd4306b66e14b5abd822ad'} {{(pid=128802) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 20:47:22.339097 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1acf479f-4e04-4111-88d2-557e64f9c0a8 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:22.340060 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1acf479f-4e04-4111-88d2-557e64f9c0a8 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:22.340852 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1acf479f-4e04-4111-88d2-557e64f9c0a8 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:22.342160 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1acf479f-4e04-4111-88d2-557e64f9c0a8 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:22.342968 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1acf479f-4e04-4111-88d2-557e64f9c0a8 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:22.343549 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1acf479f-4e04-4111-88d2-557e64f9c0a8 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:22.572952 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-42353844-4926-43fd-a75a-b9594069ea5d tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:22.573455 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-42353844-4926-43fd-a75a-b9594069ea5d tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:22.573923 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-42353844-4926-43fd-a75a-b9594069ea5d tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:22.574643 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-42353844-4926-43fd-a75a-b9594069ea5d tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:22.575099 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-42353844-4926-43fd-a75a-b9594069ea5d tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:22.575700 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-42353844-4926-43fd-a75a-b9594069ea5d tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:22.675625 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.multi_cell_list [None req-42353844-4926-43fd-a75a-b9594069ea5d tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128802) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 20:47:22.729234 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-1acf479f-4e04-4111-88d2-557e64f9c0a8 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac650232cc04810b1340dc2f0edadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b0670d1bd99424780a70e69d57a2166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:22.741963 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-1acf479f-4e04-4111-88d2-557e64f9c0a8 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "GET /compute/v2.1/servers/fde3f6fc-61e1-4b21-8b91-e95c2db3d48c" status: 200 len: 1513 microversion: 2.1 time: 0.421123 Oct 04 20:47:22.743779 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1507/3051] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:47:22 2022] GET /compute/v2.1/servers/fde3f6fc-61e1-4b21-8b91-e95c2db3d48c => generated 1513 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:47:22.752560 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-42353844-4926-43fd-a75a-b9594069ea5d tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] 10.222.0.33 "GET /compute/v2.1/servers?ip=172.20.0.8" status: 200 len: 346 microversion: 2.1 time: 0.446870 Oct 04 20:47:22.754040 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1545/3052] 10.222.0.33 () {58 vars in 1152 bytes} [Tue Oct 4 20:47:22 2022] GET /compute/v2.1/servers?ip=172.20.0.8 => generated 346 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:47:22.759552 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-36ee439b-328a-4be5-84b4-325b1a7524b3 req-121c8a80-9b81-4044-b892-21d61f0791f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "041f0f59-75c7-4d01-bc99-77cb871f0fef", "tag": "d49f87ec-d567-4f79-9dfc-9996ce123a45"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:47:22.767186 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f838b7be-ae68-4097-896f-a8adb2a56d4e tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:22.767842 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f838b7be-ae68-4097-896f-a8adb2a56d4e tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] [instance: 815db889-a211-4eab-90f8-7ca46d7102a4] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:22.771853 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-36ee439b-328a-4be5-84b4-325b1a7524b3 req-121c8a80-9b81-4044-b892-21d61f0791f9 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:22.772594 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-36ee439b-328a-4be5-84b4-325b1a7524b3 req-121c8a80-9b81-4044-b892-21d61f0791f9 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:22.773165 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-36ee439b-328a-4be5-84b4-325b1a7524b3 req-121c8a80-9b81-4044-b892-21d61f0791f9 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:22.789938 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-36ee439b-328a-4be5-84b4-325b1a7524b3 req-121c8a80-9b81-4044-b892-21d61f0791f9 service nova] Creating event network-changed:d49f87ec-d567-4f79-9dfc-9996ce123a45 for instance 041f0f59-75c7-4d01-bc99-77cb871f0fef on n-h2-854823-8 Oct 04 20:47:22.790170 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f838b7be-ae68-4097-896f-a8adb2a56d4e tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:22.792728 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f838b7be-ae68-4097-896f-a8adb2a56d4e tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:22.794716 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f838b7be-ae68-4097-896f-a8adb2a56d4e tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:22.795599 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f838b7be-ae68-4097-896f-a8adb2a56d4e tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:22.797496 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f838b7be-ae68-4097-896f-a8adb2a56d4e tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:22.798146 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-36ee439b-328a-4be5-84b4-325b1a7524b3 req-121c8a80-9b81-4044-b892-21d61f0791f9 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041939 Oct 04 20:47:22.798721 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f838b7be-ae68-4097-896f-a8adb2a56d4e tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:22.799583 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1546/3053] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:47:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:47:22.855459 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f838b7be-ae68-4097-896f-a8adb2a56d4e tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] [instance: 815db889-a211-4eab-90f8-7ca46d7102a4] Going to try to terminate instance {{(pid=128801) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:47:23.039221 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f838b7be-ae68-4097-896f-a8adb2a56d4e tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] 10.222.0.33 "DELETE /compute/v2.1/servers/815db889-a211-4eab-90f8-7ca46d7102a4" status: 204 len: 0 microversion: 2.1 time: 0.293940 Oct 04 20:47:23.040186 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1508/3054] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 20:47:22 2022] DELETE /compute/v2.1/servers/815db889-a211-4eab-90f8-7ca46d7102a4 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:47:23.055528 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-64bd1837-5bb3-4e12-83fc-e36201ce656c tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:23.057078 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-64bd1837-5bb3-4e12-83fc-e36201ce656c tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] [instance: 39e846c1-6876-42ef-b290-f733516e1051] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:23.063689 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:47:23.068959 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-64bd1837-5bb3-4e12-83fc-e36201ce656c tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:23.069688 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-64bd1837-5bb3-4e12-83fc-e36201ce656c tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:23.070120 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-64bd1837-5bb3-4e12-83fc-e36201ce656c tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:23.071478 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-64bd1837-5bb3-4e12-83fc-e36201ce656c tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:23.071931 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-64bd1837-5bb3-4e12-83fc-e36201ce656c tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:23.072528 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-64bd1837-5bb3-4e12-83fc-e36201ce656c tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:23.079332 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-674622a5-c767-463b-8513-8be22fc331ea tempest-KeyPairsV22TestJSON-2006606734 tempest-KeyPairsV22TestJSON-2006606734-project] Action: 'create', calling method: .version_select at 0x7f3c740d8b80>, body: {"keypair": {"name": "tempest-keypair-675484208", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNfwL6Nzy/kJbowbIo726XCyYE/77DSS/xAmscFBnrwTTI1sR4jmIDIwFAeoRzMj8EwMGhKyrUUwhfe1V6M/YsUtLsA4ySELT6amiIbciC210A3/DHKxvQUMZeVNl/9NnA=="}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:47:23.112423 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-674622a5-c767-463b-8513-8be22fc331ea tempest-KeyPairsV22TestJSON-2006606734 tempest-KeyPairsV22TestJSON-2006606734-project] Getting quotas for project d5db6911e79446f99c92ddb032ecc680. Resources: {'key_pairs'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:47:23.124951 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-674622a5-c767-463b-8513-8be22fc331ea tempest-KeyPairsV22TestJSON-2006606734 tempest-KeyPairsV22TestJSON-2006606734-project] Getting quotas for user 752de40c2a9d45a4ad72de59a0785260 and project d5db6911e79446f99c92ddb032ecc680. Resources: {'key_pairs'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:47:23.171272 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-674622a5-c767-463b-8513-8be22fc331ea tempest-KeyPairsV22TestJSON-2006606734 tempest-KeyPairsV22TestJSON-2006606734-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.370009 Oct 04 20:47:23.178610 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1547/3055] 10.222.0.33 () {62 vars in 1199 bytes} [Tue Oct 4 20:47:22 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 374 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 04 20:47:23.181733 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-b9ce1f24-fa1d-4dfd-a004-2163b84d018c tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:23.182811 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-b9ce1f24-fa1d-4dfd-a004-2163b84d018c tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] [instance: 39d66e18-289f-4674-b66c-146d68ef9133] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:23.189538 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b9ce1f24-fa1d-4dfd-a004-2163b84d018c tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:23.190129 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b9ce1f24-fa1d-4dfd-a004-2163b84d018c tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:23.190688 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b9ce1f24-fa1d-4dfd-a004-2163b84d018c tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:23.191473 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b9ce1f24-fa1d-4dfd-a004-2163b84d018c tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:23.192565 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b9ce1f24-fa1d-4dfd-a004-2163b84d018c tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:23.193076 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b9ce1f24-fa1d-4dfd-a004-2163b84d018c tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:23.280600 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-b9ce1f24-fa1d-4dfd-a004-2163b84d018c tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:23.290253 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-b9ce1f24-fa1d-4dfd-a004-2163b84d018c tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:23.291763 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-b9ce1f24-fa1d-4dfd-a004-2163b84d018c tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:23.298518 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-b9ce1f24-fa1d-4dfd-a004-2163b84d018c tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] 10.222.0.33 "GET /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133" status: 200 len: 1546 microversion: 2.91 time: 0.122459 Oct 04 20:47:23.299622 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1548/3056] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:47:23 2022] GET /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133 => generated 1546 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:47:23.304875 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-21cc8b6c-1751-421f-b13c-1e3954478ba9 tempest-KeyPairsV22TestJSON-2006606734 tempest-KeyPairsV22TestJSON-2006606734-project] Calling method '.version_select at 0x7f3c74092820>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:23.305586 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-64bd1837-5bb3-4e12-83fc-e36201ce656c tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12dc6570db03431187680f51349e55d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91111396aabd4306b66e14b5abd822ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:23.313624 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-21cc8b6c-1751-421f-b13c-1e3954478ba9 tempest-KeyPairsV22TestJSON-2006606734 tempest-KeyPairsV22TestJSON-2006606734-project] 10.222.0.33 "GET /compute/v2.1/os-keypairs/tempest-keypair-675484208" status: 200 len: 512 microversion: 2.2 time: 0.012612 Oct 04 20:47:23.313827 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-64bd1837-5bb3-4e12-83fc-e36201ce656c tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] 10.222.0.33 "GET /compute/v2.1/servers/39e846c1-6876-42ef-b290-f733516e1051" status: 200 len: 1511 microversion: 2.1 time: 0.268993 Oct 04 20:47:23.314383 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1509/3057] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:47:23 2022] GET /compute/v2.1/servers/39e846c1-6876-42ef-b290-f733516e1051 => generated 1511 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:47:23.319667 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e7294e0c-cd6c-4859-b6a7-26af88c98b21 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1983981692", "imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63", "flavorRef": "452", "networks": [{"uuid": "4c0a9fa9-b96b-431d-88f1-03cf1e898d51"}]}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:47:23.321534 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1549/3058] 10.222.0.33 () {60 vars in 1255 bytes} [Tue Oct 4 20:47:23 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-675484208 => generated 512 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:47:23.326380 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-03104f2d-079e-49ec-8cd8-745416a02029 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:23.326991 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-03104f2d-079e-49ec-8cd8-745416a02029 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] [instance: 041f0f59-75c7-4d01-bc99-77cb871f0fef] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:23.334817 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-03104f2d-079e-49ec-8cd8-745416a02029 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:23.335301 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-03104f2d-079e-49ec-8cd8-745416a02029 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:23.335730 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-03104f2d-079e-49ec-8cd8-745416a02029 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:23.336420 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-03104f2d-079e-49ec-8cd8-745416a02029 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:23.336868 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-03104f2d-079e-49ec-8cd8-745416a02029 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:23.337288 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-03104f2d-079e-49ec-8cd8-745416a02029 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:23.374365 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.network.neutron [None req-e7294e0c-cd6c-4859-b6a7-26af88c98b21 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] validate_networks() for [('4c0a9fa9-b96b-431d-88f1-03cf1e898d51', None, None, None, None, None)] {{(pid=128801) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:47:23.558823 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-03104f2d-079e-49ec-8cd8-745416a02029 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87dcc7baf63f4ae6bfe0a099adffd408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7097bc12179446f6a3e1fac8434d5c64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:23.566610 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-03104f2d-079e-49ec-8cd8-745416a02029 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] 10.222.0.33 "GET /compute/v2.1/servers/041f0f59-75c7-4d01-bc99-77cb871f0fef" status: 200 len: 1308 microversion: 2.1 time: 0.244053 Oct 04 20:47:23.567235 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1550/3059] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:47:23 2022] GET /compute/v2.1/servers/041f0f59-75c7-4d01-bc99-77cb871f0fef => generated 1308 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:47:23.571729 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-cc529743-fc9d-442e-9bd4-761ee6e889e7 tempest-KeyPairsV22TestJSON-2006606734 tempest-KeyPairsV22TestJSON-2006606734-project] Calling method '.version_select at 0x7f3c740d8ca0>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:23.590954 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-cc529743-fc9d-442e-9bd4-761ee6e889e7 tempest-KeyPairsV22TestJSON-2006606734 tempest-KeyPairsV22TestJSON-2006606734-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-675484208" status: 204 len: 0 microversion: 2.2 time: 0.022692 Oct 04 20:47:23.591667 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1551/3060] 10.222.0.33 () {60 vars in 1258 bytes} [Tue Oct 4 20:47:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-675484208 => generated 0 bytes in 24 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:47:23.596259 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-126e53a0-04a2-4b4a-a9eb-e15d46638595 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:23.596947 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-126e53a0-04a2-4b4a-a9eb-e15d46638595 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] [instance: 7bbbbf6d-9e62-426b-85b4-d523110a05ef] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:23.604626 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-126e53a0-04a2-4b4a-a9eb-e15d46638595 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:23.605112 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-126e53a0-04a2-4b4a-a9eb-e15d46638595 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:23.605553 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-126e53a0-04a2-4b4a-a9eb-e15d46638595 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:23.606251 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-126e53a0-04a2-4b4a-a9eb-e15d46638595 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:23.606766 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-126e53a0-04a2-4b4a-a9eb-e15d46638595 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:23.607192 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-126e53a0-04a2-4b4a-a9eb-e15d46638595 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:23.844867 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-126e53a0-04a2-4b4a-a9eb-e15d46638595 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12dc6570db03431187680f51349e55d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91111396aabd4306b66e14b5abd822ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:23.852736 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-126e53a0-04a2-4b4a-a9eb-e15d46638595 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] 10.222.0.33 "GET /compute/v2.1/servers/7bbbbf6d-9e62-426b-85b4-d523110a05ef" status: 200 len: 1510 microversion: 2.1 time: 0.260033 Oct 04 20:47:23.853307 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1552/3061] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:47:23 2022] GET /compute/v2.1/servers/7bbbbf6d-9e62-426b-85b4-d523110a05ef => generated 1510 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:47:23.857902 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-fadb8e83-f1e9-449c-975a-a3eb2d2c83e3 tempest-KeyPairsV22TestJSON-2006606734 tempest-KeyPairsV22TestJSON-2006606734-project] Action: 'create', calling method: .version_select at 0x7f3c7409d700>, body: {"keypair": {"name": "tempest-keypair-1176607592", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIMahv7cPqxjIPpHuR1mLuTb/qvQr332ytX2ZAqDWvMPbe9uT1qAxjXbxJD+ETX5FXTlo1xJ/8ZQwYh+u4jBhFuwgC6FN9VykMQkp7lGLxFUmpz4G+t7Owb+RvKJHUfrGA=="}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:47:23.873937 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-fadb8e83-f1e9-449c-975a-a3eb2d2c83e3 tempest-KeyPairsV22TestJSON-2006606734 tempest-KeyPairsV22TestJSON-2006606734-project] Getting quotas for project d5db6911e79446f99c92ddb032ecc680. Resources: {'key_pairs'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:47:23.879154 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-fadb8e83-f1e9-449c-975a-a3eb2d2c83e3 tempest-KeyPairsV22TestJSON-2006606734 tempest-KeyPairsV22TestJSON-2006606734-project] Getting quotas for user 752de40c2a9d45a4ad72de59a0785260 and project d5db6911e79446f99c92ddb032ecc680. Resources: {'key_pairs'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:47:23.885859 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-e7294e0c-cd6c-4859-b6a7-26af88c98b21 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Flavor limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:47:23.886288 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-e7294e0c-cd6c-4859-b6a7-26af88c98b21 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Image limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:47:23.886795 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-e7294e0c-cd6c-4859-b6a7-26af88c98b21 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Flavor pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:47:23.887208 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-e7294e0c-cd6c-4859-b6a7-26af88c98b21 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Image pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:47:23.887626 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-e7294e0c-cd6c-4859-b6a7-26af88c98b21 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:47:23.898448 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e7294e0c-cd6c-4859-b6a7-26af88c98b21 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:23.899098 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e7294e0c-cd6c-4859-b6a7-26af88c98b21 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:23.899616 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e7294e0c-cd6c-4859-b6a7-26af88c98b21 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:23.900392 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e7294e0c-cd6c-4859-b6a7-26af88c98b21 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:23.900967 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e7294e0c-cd6c-4859-b6a7-26af88c98b21 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:23.901398 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e7294e0c-cd6c-4859-b6a7-26af88c98b21 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:23.904311 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-fadb8e83-f1e9-449c-975a-a3eb2d2c83e3 tempest-KeyPairsV22TestJSON-2006606734 tempest-KeyPairsV22TestJSON-2006606734-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.050008 Oct 04 20:47:23.905024 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1553/3062] 10.222.0.33 () {62 vars in 1199 bytes} [Tue Oct 4 20:47:23 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 51 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 04 20:47:23.909578 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-88bcab6c-5689-48bd-85ec-1b5fe66ca038 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:23.910178 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-88bcab6c-5689-48bd-85ec-1b5fe66ca038 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: fde3f6fc-61e1-4b21-8b91-e95c2db3d48c] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:23.916646 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-88bcab6c-5689-48bd-85ec-1b5fe66ca038 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:23.917127 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-88bcab6c-5689-48bd-85ec-1b5fe66ca038 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:23.917557 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-88bcab6c-5689-48bd-85ec-1b5fe66ca038 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:23.918245 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-88bcab6c-5689-48bd-85ec-1b5fe66ca038 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:23.918738 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-88bcab6c-5689-48bd-85ec-1b5fe66ca038 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:23.919192 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-88bcab6c-5689-48bd-85ec-1b5fe66ca038 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:23.920218 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-e7294e0c-cd6c-4859-b6a7-26af88c98b21 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Getting quotas for project 3f3fadcd7d4043daa0a6aba27ba814d5. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:47:23.925514 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-e7294e0c-cd6c-4859-b6a7-26af88c98b21 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Getting quotas for user aca59cd50bf74a36bb1e4427cd50fbb3 and project 3f3fadcd7d4043daa0a6aba27ba814d5. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:47:23.938202 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e7294e0c-cd6c-4859-b6a7-26af88c98b21 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Going to run 1 instances... {{(pid=128801) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:47:23.940647 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e7294e0c-cd6c-4859-b6a7-26af88c98b21 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] [instance: 8e0006b2-ed59-4ad1-a921-d1db19cb97b6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='15b24725-0c99-4bcf-b1fb-907cdf8e2d63',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128801) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:47:23.990378 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e7294e0c-cd6c-4859-b6a7-26af88c98b21 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.674757 Oct 04 20:47:23.991052 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1510/3063] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 20:47:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 676 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 20:47:24.000796 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1172e1c4-9280-4316-85b0-9e0f91b932e3 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:24.001515 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-1172e1c4-9280-4316-85b0-9e0f91b932e3 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] [instance: db0b522b-4140-4587-9c1b-0e62d778dce4] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:24.009866 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1172e1c4-9280-4316-85b0-9e0f91b932e3 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:24.010498 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1172e1c4-9280-4316-85b0-9e0f91b932e3 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:24.010998 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1172e1c4-9280-4316-85b0-9e0f91b932e3 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:24.011762 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1172e1c4-9280-4316-85b0-9e0f91b932e3 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:24.012569 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1172e1c4-9280-4316-85b0-9e0f91b932e3 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:24.012852 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1172e1c4-9280-4316-85b0-9e0f91b932e3 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:24.121739 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-88bcab6c-5689-48bd-85ec-1b5fe66ca038 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac650232cc04810b1340dc2f0edadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b0670d1bd99424780a70e69d57a2166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:24.131094 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-88bcab6c-5689-48bd-85ec-1b5fe66ca038 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "GET /compute/v2.1/servers/fde3f6fc-61e1-4b21-8b91-e95c2db3d48c" status: 200 len: 1513 microversion: 2.1 time: 0.225002 Oct 04 20:47:24.131716 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1554/3064] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:47:23 2022] GET /compute/v2.1/servers/fde3f6fc-61e1-4b21-8b91-e95c2db3d48c => generated 1513 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:47:24.136740 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-5a949209-7315-478f-97eb-f1e4ec966cc6 tempest-KeyPairsV22TestJSON-2006606734 tempest-KeyPairsV22TestJSON-2006606734-project] Calling method '.version_select at 0x7f3c74128a60>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:24.161928 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-5a949209-7315-478f-97eb-f1e4ec966cc6 tempest-KeyPairsV22TestJSON-2006606734 tempest-KeyPairsV22TestJSON-2006606734-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1176607592" status: 204 len: 0 microversion: 2.2 time: 0.028963 Oct 04 20:47:24.163092 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1555/3065] 10.222.0.33 () {60 vars in 1261 bytes} [Tue Oct 4 20:47:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1176607592 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:47:24.168317 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-1156937b-f7b8-40f4-88a3-c8600eca5449 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:24.169248 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-1156937b-f7b8-40f4-88a3-c8600eca5449 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] [instance: 8e0006b2-ed59-4ad1-a921-d1db19cb97b6] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:24.183458 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-1172e1c4-9280-4316-85b0-9e0f91b932e3 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12dc6570db03431187680f51349e55d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91111396aabd4306b66e14b5abd822ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:24.193140 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-1172e1c4-9280-4316-85b0-9e0f91b932e3 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] 10.222.0.33 "GET /compute/v2.1/servers/db0b522b-4140-4587-9c1b-0e62d778dce4" status: 200 len: 1511 microversion: 2.1 time: 0.200854 Oct 04 20:47:24.196883 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1511/3066] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:47:23 2022] GET /compute/v2.1/servers/db0b522b-4140-4587-9c1b-0e62d778dce4 => generated 1511 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:47:24.207139 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-9d817a64-1d80-4699-b59a-e8614f7b55df req-6b179355-4789-4fe5-839d-86fe325b6de0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "815db889-a211-4eab-90f8-7ca46d7102a4", "name": "network-vif-unplugged", "status": "completed", "tag": "61e1947b-dc51-4d3d-8739-b8435daa871f"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:47:24.220567 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-9d817a64-1d80-4699-b59a-e8614f7b55df req-6b179355-4789-4fe5-839d-86fe325b6de0 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:24.221178 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-9d817a64-1d80-4699-b59a-e8614f7b55df req-6b179355-4789-4fe5-839d-86fe325b6de0 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:24.221702 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-9d817a64-1d80-4699-b59a-e8614f7b55df req-6b179355-4789-4fe5-839d-86fe325b6de0 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:24.235122 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-9d817a64-1d80-4699-b59a-e8614f7b55df req-6b179355-4789-4fe5-839d-86fe325b6de0 service nova] Creating event network-vif-unplugged:61e1947b-dc51-4d3d-8739-b8435daa871f for instance 815db889-a211-4eab-90f8-7ca46d7102a4 on n-h1-854823-8 Oct 04 20:47:24.241093 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-9d817a64-1d80-4699-b59a-e8614f7b55df req-6b179355-4789-4fe5-839d-86fe325b6de0 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037627 Oct 04 20:47:24.241931 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1512/3067] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:47:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:47:24.248929 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-3ba37686-6796-4629-82b2-7d43732d84e3 tempest-KeyPairsV22TestJSON-2006606734 tempest-KeyPairsV22TestJSON-2006606734-project] Action: 'create', calling method: .version_select at 0x7f3c74a1aaf0>, body: {"keypair": {"name": "tempest-keypair-1419368869", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:47:24.265165 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-3ba37686-6796-4629-82b2-7d43732d84e3 tempest-KeyPairsV22TestJSON-2006606734 tempest-KeyPairsV22TestJSON-2006606734-project] Getting quotas for project d5db6911e79446f99c92ddb032ecc680. Resources: {'key_pairs'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:47:24.272181 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-3ba37686-6796-4629-82b2-7d43732d84e3 tempest-KeyPairsV22TestJSON-2006606734 tempest-KeyPairsV22TestJSON-2006606734-project] Getting quotas for user 752de40c2a9d45a4ad72de59a0785260 and project d5db6911e79446f99c92ddb032ecc680. Resources: {'key_pairs'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:47:24.274245 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-1156937b-f7b8-40f4-88a3-c8600eca5449 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aca59cd50bf74a36bb1e4427cd50fbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3fadcd7d4043daa0a6aba27ba814d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:24.287617 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-1156937b-f7b8-40f4-88a3-c8600eca5449 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] 10.222.0.33 "GET /compute/v2.1/servers/8e0006b2-ed59-4ad1-a921-d1db19cb97b6" status: 200 len: 1208 microversion: 2.1 time: 0.121410 Oct 04 20:47:24.289145 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1556/3068] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:47:24 2022] GET /compute/v2.1/servers/8e0006b2-ed59-4ad1-a921-d1db19cb97b6 => generated 1208 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:47:24.300982 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-d312076a-3ee5-4f40-80e8-6cc5c14a5066 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:24.308044 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-3ba37686-6796-4629-82b2-7d43732d84e3 tempest-KeyPairsV22TestJSON-2006606734 tempest-KeyPairsV22TestJSON-2006606734-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 201 len: 589 microversion: 2.2 time: 0.064231 Oct 04 20:47:24.310788 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1513/3069] 10.222.0.33 () {62 vars in 1199 bytes} [Tue Oct 4 20:47:24 2022] POST /compute/v2.1/os-keypairs => generated 589 bytes in 68 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 04 20:47:24.314935 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-d312076a-3ee5-4f40-80e8-6cc5c14a5066 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '12dc6570db03431187680f51349e55d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91111396aabd4306b66e14b5abd822ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:24.316003 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-d312076a-3ee5-4f40-80e8-6cc5c14a5066 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Searching by: {'deleted': False, 'project_id': '91111396aabd4306b66e14b5abd822ad'} {{(pid=128802) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 20:47:24.322443 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d312076a-3ee5-4f40-80e8-6cc5c14a5066 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:24.323233 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d312076a-3ee5-4f40-80e8-6cc5c14a5066 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:24.323450 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-494ac336-b1a2-476a-9572-37b459d20a2f tempest-KeyPairsV22TestJSON-2006606734 tempest-KeyPairsV22TestJSON-2006606734-project] Calling method '.version_select at 0x7f3c745bf430>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:24.325391 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d312076a-3ee5-4f40-80e8-6cc5c14a5066 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:24.326333 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d312076a-3ee5-4f40-80e8-6cc5c14a5066 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:24.326865 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d312076a-3ee5-4f40-80e8-6cc5c14a5066 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:24.327728 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d312076a-3ee5-4f40-80e8-6cc5c14a5066 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:24.357676 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:47:24.362509 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.multi_cell_list [None req-d312076a-3ee5-4f40-80e8-6cc5c14a5066 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128802) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 20:47:24.363464 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-494ac336-b1a2-476a-9572-37b459d20a2f tempest-KeyPairsV22TestJSON-2006606734 tempest-KeyPairsV22TestJSON-2006606734-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1419368869" status: 204 len: 0 microversion: 2.2 time: 0.046656 Oct 04 20:47:24.364364 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1514/3070] 10.222.0.33 () {60 vars in 1261 bytes} [Tue Oct 4 20:47:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1419368869 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 20:47:24.368726 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f66ea6ac-b50c-41d4-bc18-1f62d490b250 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:24.369454 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f66ea6ac-b50c-41d4-bc18-1f62d490b250 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] [instance: 39d66e18-289f-4674-b66c-146d68ef9133] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:24.377898 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f66ea6ac-b50c-41d4-bc18-1f62d490b250 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:24.378264 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f66ea6ac-b50c-41d4-bc18-1f62d490b250 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:24.378803 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f66ea6ac-b50c-41d4-bc18-1f62d490b250 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:24.379733 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f66ea6ac-b50c-41d4-bc18-1f62d490b250 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:24.380371 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f66ea6ac-b50c-41d4-bc18-1f62d490b250 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:24.380955 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f66ea6ac-b50c-41d4-bc18-1f62d490b250 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:24.411189 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-d312076a-3ee5-4f40-80e8-6cc5c14a5066 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12dc6570db03431187680f51349e55d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91111396aabd4306b66e14b5abd822ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:24.420814 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d312076a-3ee5-4f40-80e8-6cc5c14a5066 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:24.421371 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d312076a-3ee5-4f40-80e8-6cc5c14a5066 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:24.421809 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d312076a-3ee5-4f40-80e8-6cc5c14a5066 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:24.541459 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f66ea6ac-b50c-41d4-bc18-1f62d490b250 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:24.549905 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f66ea6ac-b50c-41d4-bc18-1f62d490b250 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:24.553819 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f66ea6ac-b50c-41d4-bc18-1f62d490b250 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:24.563160 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f66ea6ac-b50c-41d4-bc18-1f62d490b250 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] 10.222.0.33 "GET /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133" status: 200 len: 1546 microversion: 2.91 time: 0.198052 Oct 04 20:47:24.563734 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1515/3071] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:47:24 2022] GET /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133 => generated 1546 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:47:24.568820 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d0a4d347-d056-4d2c-819d-c99f4ea7f324 tempest-KeyPairsV22TestJSON-2006606734 tempest-KeyPairsV22TestJSON-2006606734-project] Action: 'create', calling method: .version_select at 0x7f3c749acca0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1666768655", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMgzoUwFWTkDuwIrhEvQjrcSONktXw/JR+LC3dqr49nJvxjHdFwImKjhAAsf/ytOvMfn5GAt2xymgFSHjIehweEAgVyzh9qmhIt8Q9PZbrZLpA35v/rLrqIFY1jmfyQtBA=="}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:47:24.595453 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-d0a4d347-d056-4d2c-819d-c99f4ea7f324 tempest-KeyPairsV22TestJSON-2006606734 tempest-KeyPairsV22TestJSON-2006606734-project] Getting quotas for project d5db6911e79446f99c92ddb032ecc680. Resources: {'key_pairs'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:47:24.601148 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-d0a4d347-d056-4d2c-819d-c99f4ea7f324 tempest-KeyPairsV22TestJSON-2006606734 tempest-KeyPairsV22TestJSON-2006606734-project] Getting quotas for user 752de40c2a9d45a4ad72de59a0785260 and project d5db6911e79446f99c92ddb032ecc680. Resources: {'key_pairs'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:47:24.631799 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d0a4d347-d056-4d2c-819d-c99f4ea7f324 tempest-KeyPairsV22TestJSON-2006606734 tempest-KeyPairsV22TestJSON-2006606734-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.065169 Oct 04 20:47:24.632865 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1516/3072] 10.222.0.33 () {62 vars in 1199 bytes} [Tue Oct 4 20:47:24 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 69 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 04 20:47:24.641103 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7bf8669b-6095-467e-bfb8-dfc11b597af2 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:24.641803 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-7bf8669b-6095-467e-bfb8-dfc11b597af2 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] [instance: 041f0f59-75c7-4d01-bc99-77cb871f0fef] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:24.659716 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7bf8669b-6095-467e-bfb8-dfc11b597af2 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:24.662823 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7bf8669b-6095-467e-bfb8-dfc11b597af2 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:24.663531 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7bf8669b-6095-467e-bfb8-dfc11b597af2 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:24.664488 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7bf8669b-6095-467e-bfb8-dfc11b597af2 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:24.665098 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7bf8669b-6095-467e-bfb8-dfc11b597af2 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:24.666477 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7bf8669b-6095-467e-bfb8-dfc11b597af2 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:24.670229 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-d312076a-3ee5-4f40-80e8-6cc5c14a5066 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] 10.222.0.33 "GET /compute/v2.1/servers/detail" status: 200 len: 4515 microversion: 2.1 time: 0.379615 Oct 04 20:47:24.671875 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1557/3073] 10.222.0.33 () {58 vars in 1146 bytes} [Tue Oct 4 20:47:24 2022] GET /compute/v2.1/servers/detail => generated 4515 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:47:24.678656 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-39294521-f4f3-4971-bd24-ef48d72e65bc tempest-KeyPairsV22TestJSON-2006606734 tempest-KeyPairsV22TestJSON-2006606734-project] Action: 'create', calling method: .version_select at 0x7f3c6fa854c0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1645256243", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOrO2kvTIJfIzfSQvcXUgcRz4wFzRK64QjkIXTdcV79TbjHECn8S3nuE+XwIPWfgPw7aMSdvacmffESS1kDCHZA7V4kgh7Gzf2SG5UzG1eJgPaQrtv5whhFkWTsvfdJEOA=="}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:47:24.725482 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-39294521-f4f3-4971-bd24-ef48d72e65bc tempest-KeyPairsV22TestJSON-2006606734 tempest-KeyPairsV22TestJSON-2006606734-project] Getting quotas for project d5db6911e79446f99c92ddb032ecc680. Resources: {'key_pairs'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:47:24.736812 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-39294521-f4f3-4971-bd24-ef48d72e65bc tempest-KeyPairsV22TestJSON-2006606734 tempest-KeyPairsV22TestJSON-2006606734-project] Getting quotas for user 752de40c2a9d45a4ad72de59a0785260 and project d5db6911e79446f99c92ddb032ecc680. Resources: {'key_pairs'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:47:24.769519 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-39294521-f4f3-4971-bd24-ef48d72e65bc tempest-KeyPairsV22TestJSON-2006606734 tempest-KeyPairsV22TestJSON-2006606734-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.096290 Oct 04 20:47:24.770570 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1558/3074] 10.222.0.33 () {62 vars in 1199 bytes} [Tue Oct 4 20:47:24 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 98 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 04 20:47:24.782308 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-a6c5a808-6e4e-4753-a178-b405f654e91f tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:24.789008 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-a6c5a808-6e4e-4753-a178-b405f654e91f tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '12dc6570db03431187680f51349e55d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91111396aabd4306b66e14b5abd822ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:24.792634 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-a6c5a808-6e4e-4753-a178-b405f654e91f tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Searching by: {'ip': '172.20.0.', 'deleted': False, 'project_id': '91111396aabd4306b66e14b5abd822ad'} {{(pid=128802) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 20:47:24.989815 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a6c5a808-6e4e-4753-a178-b405f654e91f tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:24.991227 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a6c5a808-6e4e-4753-a178-b405f654e91f tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:24.991925 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a6c5a808-6e4e-4753-a178-b405f654e91f tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:24.993021 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a6c5a808-6e4e-4753-a178-b405f654e91f tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:24.993691 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a6c5a808-6e4e-4753-a178-b405f654e91f tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:24.994799 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a6c5a808-6e4e-4753-a178-b405f654e91f tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:25.028097 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.multi_cell_list [None req-a6c5a808-6e4e-4753-a178-b405f654e91f tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128802) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 20:47:25.084791 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-a6c5a808-6e4e-4753-a178-b405f654e91f tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] 10.222.0.33 "GET /compute/v2.1/servers?ip=172.20.0." status: 200 len: 1011 microversion: 2.1 time: 0.312531 Oct 04 20:47:25.088329 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1559/3075] 10.222.0.33 () {58 vars in 1150 bytes} [Tue Oct 4 20:47:24 2022] GET /compute/v2.1/servers?ip=172.20.0. => generated 1011 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:47:25.093477 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-9ac0f359-5dc5-4db6-b466-29a7f775734d tempest-KeyPairsV22TestJSON-2006606734 tempest-KeyPairsV22TestJSON-2006606734-project] Action: 'create', calling method: .version_select at 0x7f3c7409d280>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-202800806", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLew+aXhJmHOS6GQz9EiYW8pkexskDbC+wL8XhDrOfKjIQJoozUsxEm0ImQ4SyOb+0dL5BA+wQjEUP0s5Oe/VmyXErV0Q4+l4h5x3P50nqZZ6vZ+XNcVRJ6ExlquvfGDwA=="}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:47:25.112783 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-9ac0f359-5dc5-4db6-b466-29a7f775734d tempest-KeyPairsV22TestJSON-2006606734 tempest-KeyPairsV22TestJSON-2006606734-project] Getting quotas for project d5db6911e79446f99c92ddb032ecc680. Resources: {'key_pairs'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:47:25.119824 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-9ac0f359-5dc5-4db6-b466-29a7f775734d tempest-KeyPairsV22TestJSON-2006606734 tempest-KeyPairsV22TestJSON-2006606734-project] Getting quotas for user 752de40c2a9d45a4ad72de59a0785260 and project d5db6911e79446f99c92ddb032ecc680. Resources: {'key_pairs'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:47:25.163478 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-9ac0f359-5dc5-4db6-b466-29a7f775734d tempest-KeyPairsV22TestJSON-2006606734 tempest-KeyPairsV22TestJSON-2006606734-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.072317 Oct 04 20:47:25.165594 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1560/3076] 10.222.0.33 () {62 vars in 1199 bytes} [Tue Oct 4 20:47:25 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 76 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 04 20:47:25.175783 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-eb074f42-b8c7-43e2-993d-deacda14ad85 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:25.176739 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-eb074f42-b8c7-43e2-993d-deacda14ad85 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] [instance: c703a086-cf9d-4d12-8a18-623e454bcb64] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:25.196311 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-eb074f42-b8c7-43e2-993d-deacda14ad85 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:25.198928 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-eb074f42-b8c7-43e2-993d-deacda14ad85 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:25.199557 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-eb074f42-b8c7-43e2-993d-deacda14ad85 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:25.202584 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-eb074f42-b8c7-43e2-993d-deacda14ad85 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:25.203274 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-eb074f42-b8c7-43e2-993d-deacda14ad85 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:25.205663 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-eb074f42-b8c7-43e2-993d-deacda14ad85 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:25.261596 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-eb074f42-b8c7-43e2-993d-deacda14ad85 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] 10.222.0.33 "GET /compute/v2.1/servers/c703a086-cf9d-4d12-8a18-623e454bcb64/ips" status: 200 len: 148 microversion: 2.1 time: 0.094224 Oct 04 20:47:25.262207 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1561/3077] 10.222.0.33 () {58 vars in 1248 bytes} [Tue Oct 4 20:47:25 2022] GET /compute/v2.1/servers/c703a086-cf9d-4d12-8a18-623e454bcb64/ips => generated 148 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:47:25.278195 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-984e356d-2aa9-4a42-896f-4f02d4af45bc tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:25.283502 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-984e356d-2aa9-4a42-896f-4f02d4af45bc tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '12dc6570db03431187680f51349e55d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91111396aabd4306b66e14b5abd822ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:25.284184 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-984e356d-2aa9-4a42-896f-4f02d4af45bc tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Searching by: {'name': '^.*\\-instance\\-[0-9]+$', 'deleted': False, 'project_id': '91111396aabd4306b66e14b5abd822ad'} {{(pid=128802) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 20:47:25.305793 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-984e356d-2aa9-4a42-896f-4f02d4af45bc tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:25.309207 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-984e356d-2aa9-4a42-896f-4f02d4af45bc tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:25.319469 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-984e356d-2aa9-4a42-896f-4f02d4af45bc tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:25.320685 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-984e356d-2aa9-4a42-896f-4f02d4af45bc tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:25.323976 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-984e356d-2aa9-4a42-896f-4f02d4af45bc tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:25.324597 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-984e356d-2aa9-4a42-896f-4f02d4af45bc tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:25.404651 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-7bf8669b-6095-467e-bfb8-dfc11b597af2 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87dcc7baf63f4ae6bfe0a099adffd408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7097bc12179446f6a3e1fac8434d5c64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:25.413825 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-7bf8669b-6095-467e-bfb8-dfc11b597af2 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] 10.222.0.33 "GET /compute/v2.1/servers/041f0f59-75c7-4d01-bc99-77cb871f0fef" status: 200 len: 1308 microversion: 2.1 time: 0.777603 Oct 04 20:47:25.414649 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1517/3078] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:47:24 2022] GET /compute/v2.1/servers/041f0f59-75c7-4d01-bc99-77cb871f0fef => generated 1308 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:47:25.428368 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1d3a1180-54ab-4884-befb-ffac7d85142c tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:25.431356 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-1d3a1180-54ab-4884-befb-ffac7d85142c tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: fde3f6fc-61e1-4b21-8b91-e95c2db3d48c] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:25.437851 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1d3a1180-54ab-4884-befb-ffac7d85142c tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:25.438658 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1d3a1180-54ab-4884-befb-ffac7d85142c tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:25.439482 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1d3a1180-54ab-4884-befb-ffac7d85142c tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:25.440508 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1d3a1180-54ab-4884-befb-ffac7d85142c tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:25.441209 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1d3a1180-54ab-4884-befb-ffac7d85142c tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:25.441921 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1d3a1180-54ab-4884-befb-ffac7d85142c tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:25.543852 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.multi_cell_list [None req-984e356d-2aa9-4a42-896f-4f02d4af45bc tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128802) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 20:47:25.670429 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-984e356d-2aa9-4a42-896f-4f02d4af45bc tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] 10.222.0.33 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24" status: 200 len: 1011 microversion: 2.1 time: 0.406924 Oct 04 20:47:25.670941 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1562/3079] 10.222.0.33 () {58 vars in 1212 bytes} [Tue Oct 4 20:47:25 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24 => generated 1011 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:47:25.675935 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-5459eb37-2d9f-4caa-a653-b24fe2a0bed4 tempest-KeyPairsV22TestJSON-2006606734 tempest-KeyPairsV22TestJSON-2006606734-project] Calling method '.version_select at 0x7f3c740d8b80>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:25.684429 n-d-854823-8 devstack@n-api.service[128802]: WARNING oslo_db.sqlalchemy.utils [None req-5459eb37-2d9f-4caa-a653-b24fe2a0bed4 tempest-KeyPairsV22TestJSON-2006606734 tempest-KeyPairsV22TestJSON-2006606734-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 04 20:47:25.703907 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-5459eb37-2d9f-4caa-a653-b24fe2a0bed4 tempest-KeyPairsV22TestJSON-2006606734 tempest-KeyPairsV22TestJSON-2006606734-project] 10.222.0.33 "GET /compute/v2.1/os-keypairs" status: 200 len: 1141 microversion: 2.2 time: 0.031893 Oct 04 20:47:25.706133 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1563/3080] 10.222.0.33 () {60 vars in 1177 bytes} [Tue Oct 4 20:47:25 2022] GET /compute/v2.1/os-keypairs => generated 1141 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:47:25.740200 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-254b73de-ca02-4817-8c8a-545bfffced28 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:25.740827 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-254b73de-ca02-4817-8c8a-545bfffced28 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] [instance: 8e0006b2-ed59-4ad1-a921-d1db19cb97b6] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:25.749445 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-254b73de-ca02-4817-8c8a-545bfffced28 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:25.750160 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-254b73de-ca02-4817-8c8a-545bfffced28 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:25.751234 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-254b73de-ca02-4817-8c8a-545bfffced28 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:25.752288 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-254b73de-ca02-4817-8c8a-545bfffced28 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:25.752939 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-254b73de-ca02-4817-8c8a-545bfffced28 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:25.753614 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-254b73de-ca02-4817-8c8a-545bfffced28 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:25.779723 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-1d3a1180-54ab-4884-befb-ffac7d85142c tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac650232cc04810b1340dc2f0edadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b0670d1bd99424780a70e69d57a2166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:25.793112 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-1d3a1180-54ab-4884-befb-ffac7d85142c tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "GET /compute/v2.1/servers/fde3f6fc-61e1-4b21-8b91-e95c2db3d48c" status: 200 len: 1513 microversion: 2.1 time: 0.377242 Oct 04 20:47:25.798611 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1518/3081] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:47:25 2022] GET /compute/v2.1/servers/fde3f6fc-61e1-4b21-8b91-e95c2db3d48c => generated 1513 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:47:25.813189 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-90f8b8f4-ee28-4bcd-8164-089881642e15 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:25.814446 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-90f8b8f4-ee28-4bcd-8164-089881642e15 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] [instance: 39d66e18-289f-4674-b66c-146d68ef9133] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:25.823686 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-90f8b8f4-ee28-4bcd-8164-089881642e15 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:25.826140 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-90f8b8f4-ee28-4bcd-8164-089881642e15 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:25.826765 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-90f8b8f4-ee28-4bcd-8164-089881642e15 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:25.832870 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-90f8b8f4-ee28-4bcd-8164-089881642e15 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:25.834283 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-90f8b8f4-ee28-4bcd-8164-089881642e15 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:25.835294 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-90f8b8f4-ee28-4bcd-8164-089881642e15 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:25.950081 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-254b73de-ca02-4817-8c8a-545bfffced28 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aca59cd50bf74a36bb1e4427cd50fbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3fadcd7d4043daa0a6aba27ba814d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:25.962066 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-254b73de-ca02-4817-8c8a-545bfffced28 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] 10.222.0.33 "GET /compute/v2.1/servers/8e0006b2-ed59-4ad1-a921-d1db19cb97b6" status: 200 len: 1268 microversion: 2.1 time: 0.254787 Oct 04 20:47:25.967010 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1564/3082] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:47:25 2022] GET /compute/v2.1/servers/8e0006b2-ed59-4ad1-a921-d1db19cb97b6 => generated 1268 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:47:25.998808 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-31b15c5d-3340-4db0-89de-36485aaf0ee4 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:26.029125 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-31b15c5d-3340-4db0-89de-36485aaf0ee4 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '12dc6570db03431187680f51349e55d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91111396aabd4306b66e14b5abd822ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:26.029923 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-31b15c5d-3340-4db0-89de-36485aaf0ee4 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Searching by: {'name': '^.*\\-instance\\-.*$', 'deleted': False, 'project_id': '91111396aabd4306b66e14b5abd822ad'} {{(pid=128802) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 20:47:26.035296 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-31b15c5d-3340-4db0-89de-36485aaf0ee4 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:26.036434 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-31b15c5d-3340-4db0-89de-36485aaf0ee4 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:26.037000 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-31b15c5d-3340-4db0-89de-36485aaf0ee4 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:26.037716 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-31b15c5d-3340-4db0-89de-36485aaf0ee4 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:26.038195 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-31b15c5d-3340-4db0-89de-36485aaf0ee4 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:26.045815 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-90f8b8f4-ee28-4bcd-8164-089881642e15 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:26.046505 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-31b15c5d-3340-4db0-89de-36485aaf0ee4 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:26.061398 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-90f8b8f4-ee28-4bcd-8164-089881642e15 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:26.063898 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-90f8b8f4-ee28-4bcd-8164-089881642e15 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:26.077560 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-90f8b8f4-ee28-4bcd-8164-089881642e15 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] 10.222.0.33 "GET /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133" status: 200 len: 1546 microversion: 2.91 time: 0.277354 Oct 04 20:47:26.091521 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1519/3083] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:47:25 2022] GET /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133 => generated 1546 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:47:26.091521 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-815d3cb7-4704-4042-967a-f047df3a2c1f tempest-KeyPairsV22TestJSON-2006606734 tempest-KeyPairsV22TestJSON-2006606734-project] Calling method '.version_select at 0x7f3c74410820>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:26.125921 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-815d3cb7-4704-4042-967a-f047df3a2c1f tempest-KeyPairsV22TestJSON-2006606734 tempest-KeyPairsV22TestJSON-2006606734-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-202800806" status: 204 len: 0 microversion: 2.2 time: 0.046594 Oct 04 20:47:26.130809 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1520/3084] 10.222.0.33 () {60 vars in 1318 bytes} [Tue Oct 4 20:47:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-202800806 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:47:26.140740 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-406d086b-43fb-4b79-8b9c-6ada962a9152 tempest-KeyPairsV22TestJSON-2006606734 tempest-KeyPairsV22TestJSON-2006606734-project] Calling method '.version_select at 0x7f3c749870d0>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:26.184398 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-406d086b-43fb-4b79-8b9c-6ada962a9152 tempest-KeyPairsV22TestJSON-2006606734 tempest-KeyPairsV22TestJSON-2006606734-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1645256243" status: 204 len: 0 microversion: 2.2 time: 0.052398 Oct 04 20:47:26.185187 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1521/3085] 10.222.0.33 () {60 vars in 1321 bytes} [Tue Oct 4 20:47:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1645256243 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:47:26.195317 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6a80249c-2e39-4b12-9bba-661c15126bd0 tempest-KeyPairsV22TestJSON-2006606734 tempest-KeyPairsV22TestJSON-2006606734-project] Calling method '.version_select at 0x7f3c7893ad30>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:26.222198 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-6a80249c-2e39-4b12-9bba-661c15126bd0 tempest-KeyPairsV22TestJSON-2006606734 tempest-KeyPairsV22TestJSON-2006606734-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1666768655" status: 204 len: 0 microversion: 2.2 time: 0.031971 Oct 04 20:47:26.223382 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1522/3086] 10.222.0.33 () {60 vars in 1321 bytes} [Tue Oct 4 20:47:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1666768655 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:47:26.236041 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-dea6ff5b-efc8-40d5-b9b8-eac973c4e5e3 tempest-KeyPairsV22TestJSON-2006606734 tempest-KeyPairsV22TestJSON-2006606734-project] Action: 'create', calling method: .version_select at 0x7f3c788bba60>, body: {"keypair": {"name": "tempest-keypair-1911899077", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI4ABQdxjOzDXryKEDmvUz7WX13/KLlBQyjDMD9B57O/pMCpWy4cCtz9c7iL3pOKxgZ+f+PvKEKSnVymUPMMrKeg7ZPK1zryyNsJLM3m5Ibi/pw6pEDdvUpvLMpbhW4tmg=="}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:47:26.241761 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.multi_cell_list [None req-31b15c5d-3340-4db0-89de-36485aaf0ee4 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128802) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 20:47:26.269350 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-dea6ff5b-efc8-40d5-b9b8-eac973c4e5e3 tempest-KeyPairsV22TestJSON-2006606734 tempest-KeyPairsV22TestJSON-2006606734-project] Getting quotas for project d5db6911e79446f99c92ddb032ecc680. Resources: {'key_pairs'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:47:26.277248 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-dea6ff5b-efc8-40d5-b9b8-eac973c4e5e3 tempest-KeyPairsV22TestJSON-2006606734 tempest-KeyPairsV22TestJSON-2006606734-project] Getting quotas for user 752de40c2a9d45a4ad72de59a0785260 and project d5db6911e79446f99c92ddb032ecc680. Resources: {'key_pairs'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:47:26.311610 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-dea6ff5b-efc8-40d5-b9b8-eac973c4e5e3 tempest-KeyPairsV22TestJSON-2006606734 tempest-KeyPairsV22TestJSON-2006606734-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.080059 Oct 04 20:47:26.312621 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1523/3087] 10.222.0.33 () {62 vars in 1199 bytes} [Tue Oct 4 20:47:26 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 82 msecs (HTTP/1.1 201) 9 headers in 362 bytes (2 switches on core 0) Oct 04 20:47:26.324219 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c3424cd3-6499-433e-8744-26ecdbd008a1 tempest-KeyPairsV22TestJSON-2006606734 tempest-KeyPairsV22TestJSON-2006606734-project] Calling method '.version_select at 0x7f3c74424820>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:26.334524 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c3424cd3-6499-433e-8744-26ecdbd008a1 tempest-KeyPairsV22TestJSON-2006606734 tempest-KeyPairsV22TestJSON-2006606734-project] 10.222.0.33 "GET /compute/v2.1/os-keypairs/tempest-keypair-1911899077" status: 200 len: 513 microversion: 2.2 time: 0.014551 Oct 04 20:47:26.336086 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1524/3088] 10.222.0.33 () {60 vars in 1258 bytes} [Tue Oct 4 20:47:26 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1911899077 => generated 513 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:47:26.347512 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-418877e1-e84f-43ca-b03e-ae832346ffd8 tempest-KeyPairsV22TestJSON-2006606734 tempest-KeyPairsV22TestJSON-2006606734-project] Calling method '.version_select at 0x7f3c749fb8b0>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:26.352048 n-d-854823-8 devstack@n-api.service[128801]: WARNING oslo_db.sqlalchemy.utils [None req-418877e1-e84f-43ca-b03e-ae832346ffd8 tempest-KeyPairsV22TestJSON-2006606734 tempest-KeyPairsV22TestJSON-2006606734-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 04 20:47:26.361128 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-31b15c5d-3340-4db0-89de-36485aaf0ee4 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] 10.222.0.33 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24" status: 200 len: 1011 microversion: 2.1 time: 0.369304 Oct 04 20:47:26.369739 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1565/3089] 10.222.0.33 () {58 vars in 1196 bytes} [Tue Oct 4 20:47:25 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24 => generated 1011 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:47:26.374901 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-f711a881-9eda-404c-847e-939666e4006d tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:26.377778 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-418877e1-e84f-43ca-b03e-ae832346ffd8 tempest-KeyPairsV22TestJSON-2006606734 tempest-KeyPairsV22TestJSON-2006606734-project] 10.222.0.33 "GET /compute/v2.1/os-keypairs" status: 200 len: 370 microversion: 2.2 time: 0.034060 Oct 04 20:47:26.378410 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1525/3090] 10.222.0.33 () {60 vars in 1177 bytes} [Tue Oct 4 20:47:26 2022] GET /compute/v2.1/os-keypairs => generated 370 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 20:47:26.389000 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-f711a881-9eda-404c-847e-939666e4006d tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '12dc6570db03431187680f51349e55d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91111396aabd4306b66e14b5abd822ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:26.391391 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-f711a881-9eda-404c-847e-939666e4006d tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Searching by: {'name': '2015269677', 'deleted': False, 'project_id': '91111396aabd4306b66e14b5abd822ad'} {{(pid=128802) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 20:47:26.395919 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ba32955c-a1e7-41eb-a88d-18c6a49a95fc tempest-KeyPairsV22TestJSON-2006606734 tempest-KeyPairsV22TestJSON-2006606734-project] Calling method '.version_select at 0x7f3c74987dc0>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:26.404545 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f711a881-9eda-404c-847e-939666e4006d tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:26.408633 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f711a881-9eda-404c-847e-939666e4006d tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:26.409533 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f711a881-9eda-404c-847e-939666e4006d tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:26.411216 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f711a881-9eda-404c-847e-939666e4006d tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:26.412175 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f711a881-9eda-404c-847e-939666e4006d tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:26.412972 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f711a881-9eda-404c-847e-939666e4006d tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:26.436109 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ba32955c-a1e7-41eb-a88d-18c6a49a95fc tempest-KeyPairsV22TestJSON-2006606734 tempest-KeyPairsV22TestJSON-2006606734-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1911899077" status: 204 len: 0 microversion: 2.2 time: 0.048970 Oct 04 20:47:26.437120 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1526/3091] 10.222.0.33 () {60 vars in 1261 bytes} [Tue Oct 4 20:47:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1911899077 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:47:26.444797 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b16760d3-2cc7-4968-ab35-72c21e82352b tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:26.447633 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b16760d3-2cc7-4968-ab35-72c21e82352b tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] [instance: 041f0f59-75c7-4d01-bc99-77cb871f0fef] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:26.465377 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b16760d3-2cc7-4968-ab35-72c21e82352b tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:26.466114 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b16760d3-2cc7-4968-ab35-72c21e82352b tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:26.466641 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b16760d3-2cc7-4968-ab35-72c21e82352b tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:26.467610 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b16760d3-2cc7-4968-ab35-72c21e82352b tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:26.468064 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b16760d3-2cc7-4968-ab35-72c21e82352b tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:26.477378 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b16760d3-2cc7-4968-ab35-72c21e82352b tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:26.925765 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.multi_cell_list [None req-f711a881-9eda-404c-847e-939666e4006d tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128802) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 20:47:27.074469 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-f711a881-9eda-404c-847e-939666e4006d tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] 10.222.0.33 "GET /compute/v2.1/servers?name=2015269677" status: 200 len: 346 microversion: 2.1 time: 0.703210 Oct 04 20:47:27.083783 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1566/3092] 10.222.0.33 () {58 vars in 1156 bytes} [Tue Oct 4 20:47:26 2022] GET /compute/v2.1/servers?name=2015269677 => generated 346 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:47:27.089285 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-47ac88e2-3a64-470c-a37f-9c97625b0437 tempest-KeyPairsV22TestJSON-2006606734 tempest-KeyPairsV22TestJSON-2006606734-project] Action: 'create', calling method: .version_select at 0x7f3c740d8c10>, body: {"keypair": {"name": "tempest-keypair-1705159869", "type": "x509"}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:47:27.129104 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-47ac88e2-3a64-470c-a37f-9c97625b0437 tempest-KeyPairsV22TestJSON-2006606734 tempest-KeyPairsV22TestJSON-2006606734-project] Getting quotas for project d5db6911e79446f99c92ddb032ecc680. Resources: {'key_pairs'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:47:27.141709 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-47ac88e2-3a64-470c-a37f-9c97625b0437 tempest-KeyPairsV22TestJSON-2006606734 tempest-KeyPairsV22TestJSON-2006606734-project] Getting quotas for user 752de40c2a9d45a4ad72de59a0785260 and project d5db6911e79446f99c92ddb032ecc680. Resources: {'key_pairs'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:47:27.156300 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:DELETE=2 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:47:27.182387 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.processutils [None req-47ac88e2-3a64-470c-a37f-9c97625b0437 tempest-KeyPairsV22TestJSON-2006606734 tempest-KeyPairsV22TestJSON-2006606734-project] Running cmd (subprocess): openssl req -x509 -nodes -days 3650 -config /tmp/tmpt525hmx0/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpt525hmx0/temp.key -subj /CN=752de40c2a9d45a4ad72de59a0785260 -extensions v3_req_client {{(pid=128802) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Oct 04 20:47:27.372993 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-b16760d3-2cc7-4968-ab35-72c21e82352b tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87dcc7baf63f4ae6bfe0a099adffd408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7097bc12179446f6a3e1fac8434d5c64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:27.382122 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b16760d3-2cc7-4968-ab35-72c21e82352b tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] 10.222.0.33 "GET /compute/v2.1/servers/041f0f59-75c7-4d01-bc99-77cb871f0fef" status: 200 len: 1308 microversion: 2.1 time: 0.943533 Oct 04 20:47:27.391056 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1527/3093] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:47:26 2022] GET /compute/v2.1/servers/041f0f59-75c7-4d01-bc99-77cb871f0fef => generated 1308 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:47:27.396718 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-3fc7758f-89ba-4a19-b76e-7830d55b8759 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:27.397506 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-3fc7758f-89ba-4a19-b76e-7830d55b8759 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: fde3f6fc-61e1-4b21-8b91-e95c2db3d48c] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:27.411768 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3fc7758f-89ba-4a19-b76e-7830d55b8759 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:27.412500 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3fc7758f-89ba-4a19-b76e-7830d55b8759 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:27.413119 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3fc7758f-89ba-4a19-b76e-7830d55b8759 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:27.413992 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3fc7758f-89ba-4a19-b76e-7830d55b8759 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:27.416462 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3fc7758f-89ba-4a19-b76e-7830d55b8759 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:27.417065 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3fc7758f-89ba-4a19-b76e-7830d55b8759 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:27.504568 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.processutils [None req-47ac88e2-3a64-470c-a37f-9c97625b0437 tempest-KeyPairsV22TestJSON-2006606734 tempest-KeyPairsV22TestJSON-2006606734-project] CMD "openssl req -x509 -nodes -days 3650 -config /tmp/tmpt525hmx0/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpt525hmx0/temp.key -subj /CN=752de40c2a9d45a4ad72de59a0785260 -extensions v3_req_client" returned: 0 in 0.322s {{(pid=128802) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Oct 04 20:47:27.506744 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.processutils [None req-47ac88e2-3a64-470c-a37f-9c97625b0437 tempest-KeyPairsV22TestJSON-2006606734 tempest-KeyPairsV22TestJSON-2006606734-project] Running cmd (subprocess): openssl pkcs12 -export -inkey /tmp/tmpt525hmx0/temp.key -password pass: {{(pid=128802) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Oct 04 20:47:27.574037 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.processutils [None req-47ac88e2-3a64-470c-a37f-9c97625b0437 tempest-KeyPairsV22TestJSON-2006606734 tempest-KeyPairsV22TestJSON-2006606734-project] CMD "openssl pkcs12 -export -inkey /tmp/tmpt525hmx0/temp.key -password pass:" returned: 0 in 0.067s {{(pid=128802) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Oct 04 20:47:27.657904 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-47ac88e2-3a64-470c-a37f-9c97625b0437 tempest-KeyPairsV22TestJSON-2006606734 tempest-KeyPairsV22TestJSON-2006606734-project] Getting quotas for project d5db6911e79446f99c92ddb032ecc680. Resources: {'key_pairs'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:47:27.671784 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-47ac88e2-3a64-470c-a37f-9c97625b0437 tempest-KeyPairsV22TestJSON-2006606734 tempest-KeyPairsV22TestJSON-2006606734-project] Getting quotas for user 752de40c2a9d45a4ad72de59a0785260 and project d5db6911e79446f99c92ddb032ecc680. Resources: {'key_pairs'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:47:27.726933 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-47ac88e2-3a64-470c-a37f-9c97625b0437 tempest-KeyPairsV22TestJSON-2006606734 tempest-KeyPairsV22TestJSON-2006606734-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 201 len: 4693 microversion: 2.2 time: 0.648047 Oct 04 20:47:27.728476 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1567/3094] 10.222.0.33 () {62 vars in 1198 bytes} [Tue Oct 4 20:47:27 2022] POST /compute/v2.1/os-keypairs => generated 4693 bytes in 650 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:47:27.742069 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-b8d3ba57-b9f9-4748-a6ba-e98c1ae45d04 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:27.745199 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-b8d3ba57-b9f9-4748-a6ba-e98c1ae45d04 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] [instance: 8e0006b2-ed59-4ad1-a921-d1db19cb97b6] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:27.764492 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b8d3ba57-b9f9-4748-a6ba-e98c1ae45d04 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:27.765201 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b8d3ba57-b9f9-4748-a6ba-e98c1ae45d04 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:27.765855 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b8d3ba57-b9f9-4748-a6ba-e98c1ae45d04 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:27.766821 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b8d3ba57-b9f9-4748-a6ba-e98c1ae45d04 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:27.771786 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b8d3ba57-b9f9-4748-a6ba-e98c1ae45d04 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:27.772619 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b8d3ba57-b9f9-4748-a6ba-e98c1ae45d04 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:28.031738 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-3fc7758f-89ba-4a19-b76e-7830d55b8759 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac650232cc04810b1340dc2f0edadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b0670d1bd99424780a70e69d57a2166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:28.049713 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-3fc7758f-89ba-4a19-b76e-7830d55b8759 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "GET /compute/v2.1/servers/fde3f6fc-61e1-4b21-8b91-e95c2db3d48c" status: 200 len: 1513 microversion: 2.1 time: 0.657207 Oct 04 20:47:28.050611 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1528/3095] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:47:27 2022] GET /compute/v2.1/servers/fde3f6fc-61e1-4b21-8b91-e95c2db3d48c => generated 1513 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:47:28.064369 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-533a45b8-2460-49a3-b921-fd2a35371c63 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:28.073372 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-533a45b8-2460-49a3-b921-fd2a35371c63 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '12dc6570db03431187680f51349e55d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91111396aabd4306b66e14b5abd822ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:28.074186 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-533a45b8-2460-49a3-b921-fd2a35371c63 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Searching by: {'name': '-instance', 'deleted': False, 'project_id': '91111396aabd4306b66e14b5abd822ad'} {{(pid=128801) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 20:47:28.094883 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-533a45b8-2460-49a3-b921-fd2a35371c63 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:28.095385 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-533a45b8-2460-49a3-b921-fd2a35371c63 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:28.099650 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-533a45b8-2460-49a3-b921-fd2a35371c63 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:28.100493 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-533a45b8-2460-49a3-b921-fd2a35371c63 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:28.100970 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-533a45b8-2460-49a3-b921-fd2a35371c63 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:28.104063 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-533a45b8-2460-49a3-b921-fd2a35371c63 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:28.205064 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-b8d3ba57-b9f9-4748-a6ba-e98c1ae45d04 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aca59cd50bf74a36bb1e4427cd50fbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3fadcd7d4043daa0a6aba27ba814d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:28.219075 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-b8d3ba57-b9f9-4748-a6ba-e98c1ae45d04 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] 10.222.0.33 "GET /compute/v2.1/servers/8e0006b2-ed59-4ad1-a921-d1db19cb97b6" status: 200 len: 1308 microversion: 2.1 time: 0.489024 Oct 04 20:47:28.230739 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1568/3096] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:47:27 2022] GET /compute/v2.1/servers/8e0006b2-ed59-4ad1-a921-d1db19cb97b6 => generated 1308 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:47:28.235750 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-cf76726e-9ac2-4c7c-ae15-09dfdee96d36 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:28.236358 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-cf76726e-9ac2-4c7c-ae15-09dfdee96d36 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] [instance: 39d66e18-289f-4674-b66c-146d68ef9133] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:28.253687 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cf76726e-9ac2-4c7c-ae15-09dfdee96d36 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:28.254790 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cf76726e-9ac2-4c7c-ae15-09dfdee96d36 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:28.255239 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cf76726e-9ac2-4c7c-ae15-09dfdee96d36 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:28.255955 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cf76726e-9ac2-4c7c-ae15-09dfdee96d36 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:28.256426 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cf76726e-9ac2-4c7c-ae15-09dfdee96d36 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:28.256861 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cf76726e-9ac2-4c7c-ae15-09dfdee96d36 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:28.303308 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.multi_cell_list [None req-533a45b8-2460-49a3-b921-fd2a35371c63 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128801) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 20:47:28.438119 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-533a45b8-2460-49a3-b921-fd2a35371c63 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] 10.222.0.33 "GET /compute/v2.1/servers?name=-instance" status: 200 len: 1011 microversion: 2.1 time: 0.377493 Oct 04 20:47:28.438778 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1529/3097] 10.222.0.33 () {58 vars in 1154 bytes} [Tue Oct 4 20:47:28 2022] GET /compute/v2.1/servers?name=-instance => generated 1011 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:47:28.450938 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-55aa3fb9-8f10-4d46-b07a-e6f6fde579f0 tempest-KeyPairsV22TestJSON-2006606734 tempest-KeyPairsV22TestJSON-2006606734-project] Calling method '.version_select at 0x7f3c74a1a9d0>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:28.468145 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=6,nova_api:DELETE=5 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:47:28.472619 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-55aa3fb9-8f10-4d46-b07a-e6f6fde579f0 tempest-KeyPairsV22TestJSON-2006606734 tempest-KeyPairsV22TestJSON-2006606734-project] 10.222.0.33 "GET /compute/v2.1/os-keypairs/tempest-keypair-1705159869" status: 200 len: 1534 microversion: 2.2 time: 0.032796 Oct 04 20:47:28.474218 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1530/3098] 10.222.0.33 () {60 vars in 1258 bytes} [Tue Oct 4 20:47:28 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1705159869 => generated 1534 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:47:28.479278 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5b062686-1a63-4cef-96ed-d5add2f0eaba tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b23a03a5-4bb4-4f6d-a4d9-0d451bd6740f"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:47:28.488242 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-5b062686-1a63-4cef-96ed-d5add2f0eaba tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] [instance: c703a086-cf9d-4d12-8a18-623e454bcb64] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:28.498267 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5b062686-1a63-4cef-96ed-d5add2f0eaba tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:28.499167 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5b062686-1a63-4cef-96ed-d5add2f0eaba tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:28.499793 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5b062686-1a63-4cef-96ed-d5add2f0eaba tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:28.512220 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5b062686-1a63-4cef-96ed-d5add2f0eaba tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:28.513062 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5b062686-1a63-4cef-96ed-d5add2f0eaba tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:28.513675 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5b062686-1a63-4cef-96ed-d5add2f0eaba tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:28.784222 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-cf76726e-9ac2-4c7c-ae15-09dfdee96d36 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:28.796118 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-cf76726e-9ac2-4c7c-ae15-09dfdee96d36 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:28.797598 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-cf76726e-9ac2-4c7c-ae15-09dfdee96d36 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:28.825289 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-cf76726e-9ac2-4c7c-ae15-09dfdee96d36 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] 10.222.0.33 "GET /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133" status: 200 len: 1546 microversion: 2.91 time: 0.593324 Oct 04 20:47:28.831786 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1569/3099] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:47:28 2022] GET /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133 => generated 1546 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:47:28.852054 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-668cb47a-869f-468f-bdf2-9c970ed40748 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:28.853901 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-668cb47a-869f-468f-bdf2-9c970ed40748 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] [instance: 041f0f59-75c7-4d01-bc99-77cb871f0fef] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:28.868763 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-668cb47a-869f-468f-bdf2-9c970ed40748 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:28.870212 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-668cb47a-869f-468f-bdf2-9c970ed40748 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:28.872770 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-668cb47a-869f-468f-bdf2-9c970ed40748 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:28.874235 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-668cb47a-869f-468f-bdf2-9c970ed40748 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:28.876902 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-668cb47a-869f-468f-bdf2-9c970ed40748 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:28.878128 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-668cb47a-869f-468f-bdf2-9c970ed40748 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:29.223026 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-668cb47a-869f-468f-bdf2-9c970ed40748 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87dcc7baf63f4ae6bfe0a099adffd408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7097bc12179446f6a3e1fac8434d5c64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:29.233255 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-668cb47a-869f-468f-bdf2-9c970ed40748 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] 10.222.0.33 "GET /compute/v2.1/servers/041f0f59-75c7-4d01-bc99-77cb871f0fef" status: 200 len: 1308 microversion: 2.1 time: 0.398718 Oct 04 20:47:29.244569 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1570/3100] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:47:28 2022] GET /compute/v2.1/servers/041f0f59-75c7-4d01-bc99-77cb871f0fef => generated 1308 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:47:29.260759 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-7f3ef84e-1148-47a0-95e1-6a9fcf103970 req-faf3eb94-5b83-4843-bc68-7cbb3286a4ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "041f0f59-75c7-4d01-bc99-77cb871f0fef", "name": "network-vif-plugged", "status": "completed", "tag": "d49f87ec-d567-4f79-9dfc-9996ce123a45"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:47:29.275981 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-7f3ef84e-1148-47a0-95e1-6a9fcf103970 req-faf3eb94-5b83-4843-bc68-7cbb3286a4ad service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:29.276462 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-7f3ef84e-1148-47a0-95e1-6a9fcf103970 req-faf3eb94-5b83-4843-bc68-7cbb3286a4ad service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:29.276898 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-7f3ef84e-1148-47a0-95e1-6a9fcf103970 req-faf3eb94-5b83-4843-bc68-7cbb3286a4ad service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:29.296753 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-7f3ef84e-1148-47a0-95e1-6a9fcf103970 req-faf3eb94-5b83-4843-bc68-7cbb3286a4ad service nova] Creating event network-vif-plugged:d49f87ec-d567-4f79-9dfc-9996ce123a45 for instance 041f0f59-75c7-4d01-bc99-77cb871f0fef on n-h2-854823-8 Oct 04 20:47:29.302924 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-7f3ef84e-1148-47a0-95e1-6a9fcf103970 req-faf3eb94-5b83-4843-bc68-7cbb3286a4ad service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056867 Oct 04 20:47:29.303843 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1571/3101] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:47:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:47:29.317184 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-48b9fdee-6579-4653-93f1-e99c810e1086 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:29.322265 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-48b9fdee-6579-4653-93f1-e99c810e1086 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '12dc6570db03431187680f51349e55d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91111396aabd4306b66e14b5abd822ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:29.323234 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-48b9fdee-6579-4653-93f1-e99c810e1086 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Searching by: {'name': 't-ListServerFiltersTestJSON-instance-201526967', 'deleted': False, 'project_id': '91111396aabd4306b66e14b5abd822ad'} {{(pid=128802) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 20:47:29.329016 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-48b9fdee-6579-4653-93f1-e99c810e1086 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:29.329497 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-48b9fdee-6579-4653-93f1-e99c810e1086 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:29.329935 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-48b9fdee-6579-4653-93f1-e99c810e1086 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:29.330952 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-48b9fdee-6579-4653-93f1-e99c810e1086 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:29.331410 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-48b9fdee-6579-4653-93f1-e99c810e1086 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:29.331869 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-48b9fdee-6579-4653-93f1-e99c810e1086 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:29.436629 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.multi_cell_list [None req-48b9fdee-6579-4653-93f1-e99c810e1086 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128802) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 20:47:29.512823 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-48b9fdee-6579-4653-93f1-e99c810e1086 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] 10.222.0.33 "GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-201526967" status: 200 len: 346 microversion: 2.1 time: 0.207347 Oct 04 20:47:29.514463 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1572/3102] 10.222.0.33 () {58 vars in 1228 bytes} [Tue Oct 4 20:47:29 2022] GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-201526967 => generated 346 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:47:29.521956 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-f966f279-625f-422a-8dda-d6169dd0928a tempest-KeyPairsV22TestJSON-2006606734 tempest-KeyPairsV22TestJSON-2006606734-project] Calling method '.version_select at 0x7f3c6fa85ca0>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:29.528955 n-d-854823-8 devstack@n-api.service[128802]: WARNING oslo_db.sqlalchemy.utils [None req-f966f279-625f-422a-8dda-d6169dd0928a tempest-KeyPairsV22TestJSON-2006606734 tempest-KeyPairsV22TestJSON-2006606734-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 04 20:47:29.544332 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-f966f279-625f-422a-8dda-d6169dd0928a tempest-KeyPairsV22TestJSON-2006606734 tempest-KeyPairsV22TestJSON-2006606734-project] 10.222.0.33 "GET /compute/v2.1/os-keypairs" status: 200 len: 1391 microversion: 2.2 time: 0.028151 Oct 04 20:47:29.544951 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1573/3103] 10.222.0.33 () {60 vars in 1177 bytes} [Tue Oct 4 20:47:29 2022] GET /compute/v2.1/os-keypairs => generated 1391 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:47:29.550939 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-d29c1a93-3d70-4d57-acb6-f82befbcb38d req-cdff1900-c82e-433c-8d68-5526b995138a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "815db889-a211-4eab-90f8-7ca46d7102a4", "name": "network-vif-deleted", "tag": "61e1947b-dc51-4d3d-8739-b8435daa871f"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:47:29.583375 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-d29c1a93-3d70-4d57-acb6-f82befbcb38d req-cdff1900-c82e-433c-8d68-5526b995138a service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:29.584071 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-d29c1a93-3d70-4d57-acb6-f82befbcb38d req-cdff1900-c82e-433c-8d68-5526b995138a service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:29.584511 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-d29c1a93-3d70-4d57-acb6-f82befbcb38d req-cdff1900-c82e-433c-8d68-5526b995138a service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:29.606024 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-d29c1a93-3d70-4d57-acb6-f82befbcb38d req-cdff1900-c82e-433c-8d68-5526b995138a service nova] Creating event network-vif-deleted:61e1947b-dc51-4d3d-8739-b8435daa871f for instance 815db889-a211-4eab-90f8-7ca46d7102a4 on n-h1-854823-8 Oct 04 20:47:29.616891 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-d29c1a93-3d70-4d57-acb6-f82befbcb38d req-cdff1900-c82e-433c-8d68-5526b995138a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070379 Oct 04 20:47:29.618098 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1574/3104] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:47:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:47:29.625520 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-4b91b40c-6b6c-4c7b-aa9c-e38c74526410 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:29.626252 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-4b91b40c-6b6c-4c7b-aa9c-e38c74526410 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: fde3f6fc-61e1-4b21-8b91-e95c2db3d48c] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:29.632676 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4b91b40c-6b6c-4c7b-aa9c-e38c74526410 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:29.633186 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4b91b40c-6b6c-4c7b-aa9c-e38c74526410 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:29.633610 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4b91b40c-6b6c-4c7b-aa9c-e38c74526410 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:29.634317 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4b91b40c-6b6c-4c7b-aa9c-e38c74526410 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:29.634797 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4b91b40c-6b6c-4c7b-aa9c-e38c74526410 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:29.635218 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4b91b40c-6b6c-4c7b-aa9c-e38c74526410 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:29.879006 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-4b91b40c-6b6c-4c7b-aa9c-e38c74526410 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac650232cc04810b1340dc2f0edadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b0670d1bd99424780a70e69d57a2166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:29.887494 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-4b91b40c-6b6c-4c7b-aa9c-e38c74526410 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "GET /compute/v2.1/servers/fde3f6fc-61e1-4b21-8b91-e95c2db3d48c" status: 200 len: 1513 microversion: 2.1 time: 0.267553 Oct 04 20:47:29.888411 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1575/3105] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:47:29 2022] GET /compute/v2.1/servers/fde3f6fc-61e1-4b21-8b91-e95c2db3d48c => generated 1513 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:47:29.893282 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-e4cdfcc0-be5d-4ea6-91dd-26454ba7bbbd tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:29.893901 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-e4cdfcc0-be5d-4ea6-91dd-26454ba7bbbd tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] [instance: 8e0006b2-ed59-4ad1-a921-d1db19cb97b6] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:29.901703 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e4cdfcc0-be5d-4ea6-91dd-26454ba7bbbd tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:29.901703 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e4cdfcc0-be5d-4ea6-91dd-26454ba7bbbd tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:29.901703 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e4cdfcc0-be5d-4ea6-91dd-26454ba7bbbd tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:29.902496 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e4cdfcc0-be5d-4ea6-91dd-26454ba7bbbd tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:29.902966 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e4cdfcc0-be5d-4ea6-91dd-26454ba7bbbd tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:29.903399 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e4cdfcc0-be5d-4ea6-91dd-26454ba7bbbd tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:30.074031 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-e4cdfcc0-be5d-4ea6-91dd-26454ba7bbbd tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aca59cd50bf74a36bb1e4427cd50fbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3fadcd7d4043daa0a6aba27ba814d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:30.082297 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-e4cdfcc0-be5d-4ea6-91dd-26454ba7bbbd tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] 10.222.0.33 "GET /compute/v2.1/servers/8e0006b2-ed59-4ad1-a921-d1db19cb97b6" status: 200 len: 1308 microversion: 2.1 time: 0.192541 Oct 04 20:47:30.083288 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1576/3106] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:47:29 2022] GET /compute/v2.1/servers/8e0006b2-ed59-4ad1-a921-d1db19cb97b6 => generated 1308 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:47:30.089684 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-6b011d83-59a1-4954-ae8c-369efed45091 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:30.089684 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-6b011d83-59a1-4954-ae8c-369efed45091 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] [instance: db0b522b-4140-4587-9c1b-0e62d778dce4] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:30.099869 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6b011d83-59a1-4954-ae8c-369efed45091 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:30.100364 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6b011d83-59a1-4954-ae8c-369efed45091 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:30.100810 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6b011d83-59a1-4954-ae8c-369efed45091 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:30.101524 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6b011d83-59a1-4954-ae8c-369efed45091 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:30.101978 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6b011d83-59a1-4954-ae8c-369efed45091 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:30.102430 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6b011d83-59a1-4954-ae8c-369efed45091 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:30.133926 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-6b011d83-59a1-4954-ae8c-369efed45091 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] [instance: db0b522b-4140-4587-9c1b-0e62d778dce4] Going to try to terminate instance {{(pid=128802) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:47:30.159789 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=100 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:47:30.232996 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-6b011d83-59a1-4954-ae8c-369efed45091 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] 10.222.0.33 "DELETE /compute/v2.1/servers/db0b522b-4140-4587-9c1b-0e62d778dce4" status: 204 len: 0 microversion: 2.1 time: 0.148285 Oct 04 20:47:30.233677 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1577/3107] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 20:47:30 2022] DELETE /compute/v2.1/servers/db0b522b-4140-4587-9c1b-0e62d778dce4 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:47:30.239817 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-9e8292af-62c4-4a4a-8047-6549dbd25b87 tempest-KeyPairsV22TestJSON-2006606734 tempest-KeyPairsV22TestJSON-2006606734-project] Calling method '.version_select at 0x7f3c74198b80>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:30.268640 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-9e8292af-62c4-4a4a-8047-6549dbd25b87 tempest-KeyPairsV22TestJSON-2006606734 tempest-KeyPairsV22TestJSON-2006606734-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1705159869" status: 204 len: 0 microversion: 2.2 time: 0.033339 Oct 04 20:47:30.269360 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1578/3108] 10.222.0.33 () {60 vars in 1261 bytes} [Tue Oct 4 20:47:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1705159869 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:47:30.275896 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-2e23a11d-f5fd-491b-992f-b677e4a6f2b6 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:30.276999 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-2e23a11d-f5fd-491b-992f-b677e4a6f2b6 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] [instance: 39d66e18-289f-4674-b66c-146d68ef9133] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:30.284897 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2e23a11d-f5fd-491b-992f-b677e4a6f2b6 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:30.285944 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2e23a11d-f5fd-491b-992f-b677e4a6f2b6 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:30.286706 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2e23a11d-f5fd-491b-992f-b677e4a6f2b6 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:30.287494 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2e23a11d-f5fd-491b-992f-b677e4a6f2b6 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:30.288203 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2e23a11d-f5fd-491b-992f-b677e4a6f2b6 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:30.288649 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2e23a11d-f5fd-491b-992f-b677e4a6f2b6 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:30.375747 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-2e23a11d-f5fd-491b-992f-b677e4a6f2b6 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:30.384179 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-2e23a11d-f5fd-491b-992f-b677e4a6f2b6 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:30.385706 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-2e23a11d-f5fd-491b-992f-b677e4a6f2b6 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:30.394249 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-2e23a11d-f5fd-491b-992f-b677e4a6f2b6 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] 10.222.0.33 "GET /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133" status: 200 len: 1546 microversion: 2.91 time: 0.122976 Oct 04 20:47:30.399116 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1579/3109] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:47:30 2022] GET /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133 => generated 1546 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:47:30.419154 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-c327123f-7a45-4ab4-be5d-4729cf61c3a0 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:30.421461 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-c327123f-7a45-4ab4-be5d-4729cf61c3a0 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] [instance: db0b522b-4140-4587-9c1b-0e62d778dce4] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:30.437142 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c327123f-7a45-4ab4-be5d-4729cf61c3a0 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:30.437832 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c327123f-7a45-4ab4-be5d-4729cf61c3a0 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:30.438411 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c327123f-7a45-4ab4-be5d-4729cf61c3a0 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:30.439414 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c327123f-7a45-4ab4-be5d-4729cf61c3a0 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:30.440036 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c327123f-7a45-4ab4-be5d-4729cf61c3a0 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:30.440688 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c327123f-7a45-4ab4-be5d-4729cf61c3a0 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:30.762609 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-c327123f-7a45-4ab4-be5d-4729cf61c3a0 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12dc6570db03431187680f51349e55d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91111396aabd4306b66e14b5abd822ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:30.777457 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-c327123f-7a45-4ab4-be5d-4729cf61c3a0 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] 10.222.0.33 "GET /compute/v2.1/servers/db0b522b-4140-4587-9c1b-0e62d778dce4" status: 200 len: 1517 microversion: 2.1 time: 0.369483 Oct 04 20:47:30.778299 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1580/3110] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:47:30 2022] GET /compute/v2.1/servers/db0b522b-4140-4587-9c1b-0e62d778dce4 => generated 1517 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:47:30.794569 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-c88d3e33-a1b0-4d44-a37f-f93a0d84abc9 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:30.794569 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-c88d3e33-a1b0-4d44-a37f-f93a0d84abc9 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] [instance: 041f0f59-75c7-4d01-bc99-77cb871f0fef] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:30.805542 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c88d3e33-a1b0-4d44-a37f-f93a0d84abc9 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:30.806047 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c88d3e33-a1b0-4d44-a37f-f93a0d84abc9 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:30.806524 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c88d3e33-a1b0-4d44-a37f-f93a0d84abc9 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:30.807317 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c88d3e33-a1b0-4d44-a37f-f93a0d84abc9 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:30.807795 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c88d3e33-a1b0-4d44-a37f-f93a0d84abc9 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:30.808207 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c88d3e33-a1b0-4d44-a37f-f93a0d84abc9 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:31.176371 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-c88d3e33-a1b0-4d44-a37f-f93a0d84abc9 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87dcc7baf63f4ae6bfe0a099adffd408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7097bc12179446f6a3e1fac8434d5c64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:31.189388 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-c88d3e33-a1b0-4d44-a37f-f93a0d84abc9 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] 10.222.0.33 "GET /compute/v2.1/servers/041f0f59-75c7-4d01-bc99-77cb871f0fef" status: 200 len: 1308 microversion: 2.1 time: 0.409917 Oct 04 20:47:31.189992 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1581/3111] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:47:30 2022] GET /compute/v2.1/servers/041f0f59-75c7-4d01-bc99-77cb871f0fef => generated 1308 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:47:31.197387 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-651f0cda-8837-4c62-ae0d-6cf4e9a97633 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:31.198085 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-651f0cda-8837-4c62-ae0d-6cf4e9a97633 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: fde3f6fc-61e1-4b21-8b91-e95c2db3d48c] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:31.215711 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-651f0cda-8837-4c62-ae0d-6cf4e9a97633 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:31.218180 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-651f0cda-8837-4c62-ae0d-6cf4e9a97633 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:31.221216 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-651f0cda-8837-4c62-ae0d-6cf4e9a97633 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:31.222093 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-651f0cda-8837-4c62-ae0d-6cf4e9a97633 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:31.222727 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-651f0cda-8837-4c62-ae0d-6cf4e9a97633 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:31.229872 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-651f0cda-8837-4c62-ae0d-6cf4e9a97633 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:31.403174 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-651f0cda-8837-4c62-ae0d-6cf4e9a97633 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac650232cc04810b1340dc2f0edadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b0670d1bd99424780a70e69d57a2166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:31.416265 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-651f0cda-8837-4c62-ae0d-6cf4e9a97633 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "GET /compute/v2.1/servers/fde3f6fc-61e1-4b21-8b91-e95c2db3d48c" status: 200 len: 1513 microversion: 2.1 time: 0.224272 Oct 04 20:47:31.417642 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1582/3112] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:47:31 2022] GET /compute/v2.1/servers/fde3f6fc-61e1-4b21-8b91-e95c2db3d48c => generated 1513 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:47:31.424068 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-157839c8-5c36-4b71-a06a-5c54a610cd67 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:31.425248 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-157839c8-5c36-4b71-a06a-5c54a610cd67 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] [instance: 8e0006b2-ed59-4ad1-a921-d1db19cb97b6] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:31.433503 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-157839c8-5c36-4b71-a06a-5c54a610cd67 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:31.434409 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-157839c8-5c36-4b71-a06a-5c54a610cd67 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:31.435222 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-157839c8-5c36-4b71-a06a-5c54a610cd67 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:31.436493 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-157839c8-5c36-4b71-a06a-5c54a610cd67 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:31.437327 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-157839c8-5c36-4b71-a06a-5c54a610cd67 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:31.438706 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-157839c8-5c36-4b71-a06a-5c54a610cd67 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:31.674370 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-157839c8-5c36-4b71-a06a-5c54a610cd67 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aca59cd50bf74a36bb1e4427cd50fbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3fadcd7d4043daa0a6aba27ba814d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:31.683011 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-157839c8-5c36-4b71-a06a-5c54a610cd67 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] 10.222.0.33 "GET /compute/v2.1/servers/8e0006b2-ed59-4ad1-a921-d1db19cb97b6" status: 200 len: 1308 microversion: 2.1 time: 0.264136 Oct 04 20:47:31.693052 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1583/3113] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:47:31 2022] GET /compute/v2.1/servers/8e0006b2-ed59-4ad1-a921-d1db19cb97b6 => generated 1308 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:47:31.696749 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-8ff2a84b-74aa-405a-9f7e-244d5d499243 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:31.697362 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-8ff2a84b-74aa-405a-9f7e-244d5d499243 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] [instance: 39d66e18-289f-4674-b66c-146d68ef9133] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:31.704169 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8ff2a84b-74aa-405a-9f7e-244d5d499243 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:31.704665 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8ff2a84b-74aa-405a-9f7e-244d5d499243 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:31.705105 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8ff2a84b-74aa-405a-9f7e-244d5d499243 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:31.708860 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8ff2a84b-74aa-405a-9f7e-244d5d499243 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:31.709128 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8ff2a84b-74aa-405a-9f7e-244d5d499243 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:31.709579 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8ff2a84b-74aa-405a-9f7e-244d5d499243 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:31.791876 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-8ff2a84b-74aa-405a-9f7e-244d5d499243 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:31.801812 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-8ff2a84b-74aa-405a-9f7e-244d5d499243 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:31.804355 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-8ff2a84b-74aa-405a-9f7e-244d5d499243 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:31.809836 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-8ff2a84b-74aa-405a-9f7e-244d5d499243 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] 10.222.0.33 "GET /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133" status: 200 len: 1546 microversion: 2.91 time: 0.116894 Oct 04 20:47:31.810671 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1584/3114] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:47:31 2022] GET /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133 => generated 1546 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:47:31.817368 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-f816c259-8f20-420b-9dea-667ee9302a6f req-3db28ebb-7de8-4c54-a8c9-17dc3d117606 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e0006b2-ed59-4ad1-a921-d1db19cb97b6", "tag": "dc42a420-def0-4262-941b-1c282e275581"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:47:31.835136 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-f816c259-8f20-420b-9dea-667ee9302a6f req-3db28ebb-7de8-4c54-a8c9-17dc3d117606 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:31.835631 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-f816c259-8f20-420b-9dea-667ee9302a6f req-3db28ebb-7de8-4c54-a8c9-17dc3d117606 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:31.836065 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-f816c259-8f20-420b-9dea-667ee9302a6f req-3db28ebb-7de8-4c54-a8c9-17dc3d117606 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:31.863132 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-f816c259-8f20-420b-9dea-667ee9302a6f req-3db28ebb-7de8-4c54-a8c9-17dc3d117606 service nova] Creating event network-changed:dc42a420-def0-4262-941b-1c282e275581 for instance 8e0006b2-ed59-4ad1-a921-d1db19cb97b6 on n-h2-854823-8 Oct 04 20:47:31.869187 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-f816c259-8f20-420b-9dea-667ee9302a6f req-3db28ebb-7de8-4c54-a8c9-17dc3d117606 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057198 Oct 04 20:47:31.869807 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1585/3115] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:47:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:47:31.874825 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-a4b284c3-0d3d-417d-8f53-beb29342fea0 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:31.875522 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-a4b284c3-0d3d-417d-8f53-beb29342fea0 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] [instance: db0b522b-4140-4587-9c1b-0e62d778dce4] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:31.883559 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a4b284c3-0d3d-417d-8f53-beb29342fea0 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:31.883983 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a4b284c3-0d3d-417d-8f53-beb29342fea0 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:31.884416 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a4b284c3-0d3d-417d-8f53-beb29342fea0 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:31.885144 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a4b284c3-0d3d-417d-8f53-beb29342fea0 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:31.885559 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a4b284c3-0d3d-417d-8f53-beb29342fea0 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:31.885979 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a4b284c3-0d3d-417d-8f53-beb29342fea0 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:32.080451 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-a4b284c3-0d3d-417d-8f53-beb29342fea0 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12dc6570db03431187680f51349e55d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91111396aabd4306b66e14b5abd822ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:32.089959 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-a4b284c3-0d3d-417d-8f53-beb29342fea0 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] 10.222.0.33 "GET /compute/v2.1/servers/db0b522b-4140-4587-9c1b-0e62d778dce4" status: 200 len: 1517 microversion: 2.1 time: 0.218997 Oct 04 20:47:32.090569 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1586/3116] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:47:31 2022] GET /compute/v2.1/servers/db0b522b-4140-4587-9c1b-0e62d778dce4 => generated 1517 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:47:32.217161 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-5e31e864-e547-4605-ae9f-d131da1296d9 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:32.217816 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-5e31e864-e547-4605-ae9f-d131da1296d9 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] [instance: 041f0f59-75c7-4d01-bc99-77cb871f0fef] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:32.225011 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5e31e864-e547-4605-ae9f-d131da1296d9 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:32.225690 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5e31e864-e547-4605-ae9f-d131da1296d9 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:32.226144 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5e31e864-e547-4605-ae9f-d131da1296d9 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:32.226913 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5e31e864-e547-4605-ae9f-d131da1296d9 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:32.227382 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5e31e864-e547-4605-ae9f-d131da1296d9 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:32.227816 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5e31e864-e547-4605-ae9f-d131da1296d9 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:32.472125 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-5e31e864-e547-4605-ae9f-d131da1296d9 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87dcc7baf63f4ae6bfe0a099adffd408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7097bc12179446f6a3e1fac8434d5c64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:32.487016 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-5e31e864-e547-4605-ae9f-d131da1296d9 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] 10.222.0.33 "GET /compute/v2.1/servers/041f0f59-75c7-4d01-bc99-77cb871f0fef" status: 200 len: 1488 microversion: 2.1 time: 0.274425 Oct 04 20:47:32.487613 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1587/3117] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:47:32 2022] GET /compute/v2.1/servers/041f0f59-75c7-4d01-bc99-77cb871f0fef => generated 1488 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:47:32.510288 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-4312298c-f3bc-4a5a-93b7-515a68fe3571 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:32.514415 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-4312298c-f3bc-4a5a-93b7-515a68fe3571 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: fde3f6fc-61e1-4b21-8b91-e95c2db3d48c] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:32.523090 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4312298c-f3bc-4a5a-93b7-515a68fe3571 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:32.523790 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4312298c-f3bc-4a5a-93b7-515a68fe3571 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:32.524232 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4312298c-f3bc-4a5a-93b7-515a68fe3571 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:32.525277 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4312298c-f3bc-4a5a-93b7-515a68fe3571 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:32.526156 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4312298c-f3bc-4a5a-93b7-515a68fe3571 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:32.527335 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4312298c-f3bc-4a5a-93b7-515a68fe3571 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:32.834594 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-4312298c-f3bc-4a5a-93b7-515a68fe3571 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac650232cc04810b1340dc2f0edadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b0670d1bd99424780a70e69d57a2166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:32.845559 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-4312298c-f3bc-4a5a-93b7-515a68fe3571 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "GET /compute/v2.1/servers/fde3f6fc-61e1-4b21-8b91-e95c2db3d48c" status: 200 len: 1513 microversion: 2.1 time: 0.352501 Oct 04 20:47:32.849056 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1588/3118] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:47:32 2022] GET /compute/v2.1/servers/fde3f6fc-61e1-4b21-8b91-e95c2db3d48c => generated 1513 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:47:32.862880 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-86d7c8bf-23a8-4ad5-8378-3655fe9cace3 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-627021550"}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:47:32.866475 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-86d7c8bf-23a8-4ad5-8378-3655fe9cace3 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] [instance: 041f0f59-75c7-4d01-bc99-77cb871f0fef] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:32.905226 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-86d7c8bf-23a8-4ad5-8378-3655fe9cace3 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:32.905739 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-86d7c8bf-23a8-4ad5-8378-3655fe9cace3 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:32.906163 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-86d7c8bf-23a8-4ad5-8378-3655fe9cace3 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:32.906922 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-86d7c8bf-23a8-4ad5-8378-3655fe9cace3 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:32.907346 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-86d7c8bf-23a8-4ad5-8378-3655fe9cace3 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:32.907772 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-86d7c8bf-23a8-4ad5-8378-3655fe9cace3 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:33.079315 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-86d7c8bf-23a8-4ad5-8378-3655fe9cace3 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] 10.222.0.33 "PUT /compute/v2.1/servers/041f0f59-75c7-4d01-bc99-77cb871f0fef" status: 200 len: 1073 microversion: 2.1 time: 0.228469 Oct 04 20:47:33.081627 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1589/3119] 10.222.0.33 () {60 vars in 1256 bytes} [Tue Oct 4 20:47:32 2022] PUT /compute/v2.1/servers/041f0f59-75c7-4d01-bc99-77cb871f0fef => generated 1073 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:47:33.093521 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-f38a6f04-b881-44e4-8b6b-6b9a957dbe92 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:33.097352 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-f38a6f04-b881-44e4-8b6b-6b9a957dbe92 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] [instance: 8e0006b2-ed59-4ad1-a921-d1db19cb97b6] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:33.114665 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f38a6f04-b881-44e4-8b6b-6b9a957dbe92 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:33.116897 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f38a6f04-b881-44e4-8b6b-6b9a957dbe92 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:33.117681 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f38a6f04-b881-44e4-8b6b-6b9a957dbe92 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:33.119343 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f38a6f04-b881-44e4-8b6b-6b9a957dbe92 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:33.121736 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f38a6f04-b881-44e4-8b6b-6b9a957dbe92 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:33.122443 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f38a6f04-b881-44e4-8b6b-6b9a957dbe92 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:33.357182 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-f38a6f04-b881-44e4-8b6b-6b9a957dbe92 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aca59cd50bf74a36bb1e4427cd50fbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3fadcd7d4043daa0a6aba27ba814d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:33.367000 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-f38a6f04-b881-44e4-8b6b-6b9a957dbe92 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] 10.222.0.33 "GET /compute/v2.1/servers/8e0006b2-ed59-4ad1-a921-d1db19cb97b6" status: 200 len: 1308 microversion: 2.1 time: 0.283007 Oct 04 20:47:33.368341 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1590/3120] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:47:33 2022] GET /compute/v2.1/servers/8e0006b2-ed59-4ad1-a921-d1db19cb97b6 => generated 1308 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:47:33.373041 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-af74611c-d403-4d70-872b-06692cfb9664 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:33.373651 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-af74611c-d403-4d70-872b-06692cfb9664 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] [instance: 39d66e18-289f-4674-b66c-146d68ef9133] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:33.381424 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-af74611c-d403-4d70-872b-06692cfb9664 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:33.381914 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-af74611c-d403-4d70-872b-06692cfb9664 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:33.382371 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-af74611c-d403-4d70-872b-06692cfb9664 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:33.383093 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-af74611c-d403-4d70-872b-06692cfb9664 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:33.383554 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-af74611c-d403-4d70-872b-06692cfb9664 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:33.383980 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-af74611c-d403-4d70-872b-06692cfb9664 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:33.461889 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-af74611c-d403-4d70-872b-06692cfb9664 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:33.471315 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-af74611c-d403-4d70-872b-06692cfb9664 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:33.473334 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-af74611c-d403-4d70-872b-06692cfb9664 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:33.479038 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-af74611c-d403-4d70-872b-06692cfb9664 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] 10.222.0.33 "GET /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133" status: 200 len: 1546 microversion: 2.91 time: 0.109578 Oct 04 20:47:33.479694 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1591/3121] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:47:33 2022] GET /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133 => generated 1546 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:47:33.484210 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-a28bfdf2-62af-4bfd-9475-842d431e8ae4 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:33.484819 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-a28bfdf2-62af-4bfd-9475-842d431e8ae4 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] [instance: 041f0f59-75c7-4d01-bc99-77cb871f0fef] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:33.500607 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a28bfdf2-62af-4bfd-9475-842d431e8ae4 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:33.501098 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a28bfdf2-62af-4bfd-9475-842d431e8ae4 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:33.501530 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a28bfdf2-62af-4bfd-9475-842d431e8ae4 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:33.502242 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a28bfdf2-62af-4bfd-9475-842d431e8ae4 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:33.502791 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a28bfdf2-62af-4bfd-9475-842d431e8ae4 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:33.503222 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a28bfdf2-62af-4bfd-9475-842d431e8ae4 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:33.638767 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-a28bfdf2-62af-4bfd-9475-842d431e8ae4 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87dcc7baf63f4ae6bfe0a099adffd408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7097bc12179446f6a3e1fac8434d5c64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:33.647445 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-a28bfdf2-62af-4bfd-9475-842d431e8ae4 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] 10.222.0.33 "GET /compute/v2.1/servers/041f0f59-75c7-4d01-bc99-77cb871f0fef" status: 200 len: 1499 microversion: 2.1 time: 0.166738 Oct 04 20:47:33.658427 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1592/3122] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:47:33 2022] GET /compute/v2.1/servers/041f0f59-75c7-4d01-bc99-77cb871f0fef => generated 1499 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:47:33.658427 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-bbeaf229-5718-4584-9a54-8369e3e2a449 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:33.658427 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-bbeaf229-5718-4584-9a54-8369e3e2a449 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] [instance: db0b522b-4140-4587-9c1b-0e62d778dce4] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:33.665866 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bbeaf229-5718-4584-9a54-8369e3e2a449 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:33.665866 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bbeaf229-5718-4584-9a54-8369e3e2a449 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:33.665866 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bbeaf229-5718-4584-9a54-8369e3e2a449 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:33.665866 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bbeaf229-5718-4584-9a54-8369e3e2a449 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:33.665866 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bbeaf229-5718-4584-9a54-8369e3e2a449 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:33.665866 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bbeaf229-5718-4584-9a54-8369e3e2a449 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:33.833719 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-bbeaf229-5718-4584-9a54-8369e3e2a449 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12dc6570db03431187680f51349e55d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91111396aabd4306b66e14b5abd822ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:33.841881 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-bbeaf229-5718-4584-9a54-8369e3e2a449 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] 10.222.0.33 "GET /compute/v2.1/servers/db0b522b-4140-4587-9c1b-0e62d778dce4" status: 200 len: 1517 microversion: 2.1 time: 0.192425 Oct 04 20:47:33.842709 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1593/3123] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:47:33 2022] GET /compute/v2.1/servers/db0b522b-4140-4587-9c1b-0e62d778dce4 => generated 1517 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:47:33.859203 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-802b172a-eae2-4304-9812-60e85eded7e8 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:33.860106 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-802b172a-eae2-4304-9812-60e85eded7e8 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] [instance: 041f0f59-75c7-4d01-bc99-77cb871f0fef] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:33.869329 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-802b172a-eae2-4304-9812-60e85eded7e8 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:33.871506 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-802b172a-eae2-4304-9812-60e85eded7e8 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:33.872196 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-802b172a-eae2-4304-9812-60e85eded7e8 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:33.872914 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-802b172a-eae2-4304-9812-60e85eded7e8 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:33.873371 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-802b172a-eae2-4304-9812-60e85eded7e8 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:33.873795 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-802b172a-eae2-4304-9812-60e85eded7e8 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:33.901424 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:47:34.036802 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-802b172a-eae2-4304-9812-60e85eded7e8 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87dcc7baf63f4ae6bfe0a099adffd408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7097bc12179446f6a3e1fac8434d5c64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:34.046195 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-802b172a-eae2-4304-9812-60e85eded7e8 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] 10.222.0.33 "GET /compute/v2.1/servers/041f0f59-75c7-4d01-bc99-77cb871f0fef" status: 200 len: 1499 microversion: 2.1 time: 0.194166 Oct 04 20:47:34.047990 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1594/3124] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:47:33 2022] GET /compute/v2.1/servers/041f0f59-75c7-4d01-bc99-77cb871f0fef => generated 1499 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:47:34.054532 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-cf24eaee-1d58-4b00-b4f9-799ba3f802ad tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:34.055997 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-cf24eaee-1d58-4b00-b4f9-799ba3f802ad tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: fde3f6fc-61e1-4b21-8b91-e95c2db3d48c] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:34.064137 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cf24eaee-1d58-4b00-b4f9-799ba3f802ad tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:34.064771 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cf24eaee-1d58-4b00-b4f9-799ba3f802ad tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:34.065243 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cf24eaee-1d58-4b00-b4f9-799ba3f802ad tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:34.065966 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cf24eaee-1d58-4b00-b4f9-799ba3f802ad tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:34.066517 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cf24eaee-1d58-4b00-b4f9-799ba3f802ad tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:34.067198 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cf24eaee-1d58-4b00-b4f9-799ba3f802ad tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:34.236253 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-cf24eaee-1d58-4b00-b4f9-799ba3f802ad tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac650232cc04810b1340dc2f0edadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b0670d1bd99424780a70e69d57a2166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:34.244841 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-cf24eaee-1d58-4b00-b4f9-799ba3f802ad tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "GET /compute/v2.1/servers/fde3f6fc-61e1-4b21-8b91-e95c2db3d48c" status: 200 len: 1513 microversion: 2.1 time: 0.195367 Oct 04 20:47:34.252615 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1595/3125] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:47:34 2022] GET /compute/v2.1/servers/fde3f6fc-61e1-4b21-8b91-e95c2db3d48c => generated 1513 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:47:34.252615 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-ded46fc9-23de-4595-914c-00a60890a755 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:47:34.260444 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ded46fc9-23de-4595-914c-00a60890a755 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:34.260933 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ded46fc9-23de-4595-914c-00a60890a755 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:34.261448 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ded46fc9-23de-4595-914c-00a60890a755 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:34.293646 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-ded46fc9-23de-4595-914c-00a60890a755 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] [instance: 041f0f59-75c7-4d01-bc99-77cb871f0fef] Going to try to stop instance {{(pid=128802) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 04 20:47:34.346107 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-ded46fc9-23de-4595-914c-00a60890a755 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] 10.222.0.33 "POST /compute/v2.1/servers/041f0f59-75c7-4d01-bc99-77cb871f0fef/action" status: 202 len: 0 microversion: 2.1 time: 0.099277 Oct 04 20:47:34.346997 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1596/3126] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 20:47:34 2022] POST /compute/v2.1/servers/041f0f59-75c7-4d01-bc99-77cb871f0fef/action => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:47:34.355477 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-15c3d937-c0f8-4b75-8c82-5edd577ea0ab tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:34.356441 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-15c3d937-c0f8-4b75-8c82-5edd577ea0ab tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] [instance: 041f0f59-75c7-4d01-bc99-77cb871f0fef] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:34.362850 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-15c3d937-c0f8-4b75-8c82-5edd577ea0ab tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:34.363540 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-15c3d937-c0f8-4b75-8c82-5edd577ea0ab tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:34.363989 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-15c3d937-c0f8-4b75-8c82-5edd577ea0ab tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:34.364759 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-15c3d937-c0f8-4b75-8c82-5edd577ea0ab tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:34.365406 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-15c3d937-c0f8-4b75-8c82-5edd577ea0ab tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:34.366049 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-15c3d937-c0f8-4b75-8c82-5edd577ea0ab tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:34.531889 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-15c3d937-c0f8-4b75-8c82-5edd577ea0ab tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87dcc7baf63f4ae6bfe0a099adffd408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7097bc12179446f6a3e1fac8434d5c64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:34.544725 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-15c3d937-c0f8-4b75-8c82-5edd577ea0ab tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] 10.222.0.33 "GET /compute/v2.1/servers/041f0f59-75c7-4d01-bc99-77cb871f0fef" status: 200 len: 1509 microversion: 2.1 time: 0.193057 Oct 04 20:47:34.545799 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1597/3127] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:47:34 2022] GET /compute/v2.1/servers/041f0f59-75c7-4d01-bc99-77cb871f0fef => generated 1509 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:47:34.551312 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-a37fd358-d9bb-4406-96f8-942f29614d14 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:34.552091 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-a37fd358-d9bb-4406-96f8-942f29614d14 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] [instance: 8e0006b2-ed59-4ad1-a921-d1db19cb97b6] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:34.558408 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a37fd358-d9bb-4406-96f8-942f29614d14 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:34.558900 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a37fd358-d9bb-4406-96f8-942f29614d14 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:34.559415 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a37fd358-d9bb-4406-96f8-942f29614d14 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:34.560431 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a37fd358-d9bb-4406-96f8-942f29614d14 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:34.560898 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a37fd358-d9bb-4406-96f8-942f29614d14 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:34.561331 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a37fd358-d9bb-4406-96f8-942f29614d14 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:34.740963 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-a37fd358-d9bb-4406-96f8-942f29614d14 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aca59cd50bf74a36bb1e4427cd50fbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3fadcd7d4043daa0a6aba27ba814d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:34.749700 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-a37fd358-d9bb-4406-96f8-942f29614d14 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] 10.222.0.33 "GET /compute/v2.1/servers/8e0006b2-ed59-4ad1-a921-d1db19cb97b6" status: 200 len: 1308 microversion: 2.1 time: 0.202989 Oct 04 20:47:34.751042 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1598/3128] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:47:34 2022] GET /compute/v2.1/servers/8e0006b2-ed59-4ad1-a921-d1db19cb97b6 => generated 1308 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:47:34.755834 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-d27ef803-a514-4765-8dc1-9ca4c27986e8 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:34.756448 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-d27ef803-a514-4765-8dc1-9ca4c27986e8 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] [instance: 39d66e18-289f-4674-b66c-146d68ef9133] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:34.763174 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d27ef803-a514-4765-8dc1-9ca4c27986e8 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:34.763671 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d27ef803-a514-4765-8dc1-9ca4c27986e8 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:34.764731 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d27ef803-a514-4765-8dc1-9ca4c27986e8 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:34.765443 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d27ef803-a514-4765-8dc1-9ca4c27986e8 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:34.765905 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d27ef803-a514-4765-8dc1-9ca4c27986e8 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:34.766336 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d27ef803-a514-4765-8dc1-9ca4c27986e8 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:34.852858 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-d27ef803-a514-4765-8dc1-9ca4c27986e8 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:34.861420 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-d27ef803-a514-4765-8dc1-9ca4c27986e8 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:34.863003 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-d27ef803-a514-4765-8dc1-9ca4c27986e8 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:34.868740 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-d27ef803-a514-4765-8dc1-9ca4c27986e8 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] 10.222.0.33 "GET /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133" status: 200 len: 1546 microversion: 2.91 time: 0.116652 Oct 04 20:47:34.869428 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1599/3129] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:47:34 2022] GET /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133 => generated 1546 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:47:35.088275 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-e8bcf373-4cda-40b9-b1a2-119811ba6125 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:35.088778 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-e8bcf373-4cda-40b9-b1a2-119811ba6125 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] [instance: c0a14e22-0620-4912-9893-62974c80978a] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:35.100790 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e8bcf373-4cda-40b9-b1a2-119811ba6125 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:35.101287 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e8bcf373-4cda-40b9-b1a2-119811ba6125 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:35.101732 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e8bcf373-4cda-40b9-b1a2-119811ba6125 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:35.102469 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e8bcf373-4cda-40b9-b1a2-119811ba6125 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:35.102927 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e8bcf373-4cda-40b9-b1a2-119811ba6125 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:35.103345 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e8bcf373-4cda-40b9-b1a2-119811ba6125 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:35.161479 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-e8bcf373-4cda-40b9-b1a2-119811ba6125 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] [instance: c0a14e22-0620-4912-9893-62974c80978a] Going to try to terminate instance {{(pid=128802) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:47:35.182509 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:47:35.202716 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5b062686-1a63-4cef-96ed-d5add2f0eaba tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] 10.222.0.33 "POST /compute/v2.1/servers/c703a086-cf9d-4d12-8a18-623e454bcb64/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 6.726990 Oct 04 20:47:35.209660 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1531/3130] 10.222.0.33 () {60 vars in 1323 bytes} [Tue Oct 4 20:47:28 2022] POST /compute/v2.1/servers/c703a086-cf9d-4d12-8a18-623e454bcb64/os-volume_attachments => generated 194 bytes in 6729 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:47:35.219404 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d12e1003-d484-4145-aa86-04bb86869138 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:35.220150 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d12e1003-d484-4145-aa86-04bb86869138 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] [instance: db0b522b-4140-4587-9c1b-0e62d778dce4] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:35.228781 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d12e1003-d484-4145-aa86-04bb86869138 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:35.229429 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d12e1003-d484-4145-aa86-04bb86869138 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:35.230655 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d12e1003-d484-4145-aa86-04bb86869138 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:35.231727 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d12e1003-d484-4145-aa86-04bb86869138 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:35.232116 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d12e1003-d484-4145-aa86-04bb86869138 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:35.234066 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d12e1003-d484-4145-aa86-04bb86869138 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:35.312160 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=1,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:47:35.366041 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-e8bcf373-4cda-40b9-b1a2-119811ba6125 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] 10.222.0.33 "DELETE /compute/v2.1/servers/c0a14e22-0620-4912-9893-62974c80978a" status: 204 len: 0 microversion: 2.32 time: 0.495224 Oct 04 20:47:35.367670 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1600/3131] 10.222.0.33 () {60 vars in 1280 bytes} [Tue Oct 4 20:47:34 2022] DELETE /compute/v2.1/servers/c0a14e22-0620-4912-9893-62974c80978a => generated 0 bytes in 497 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 20:47:35.373632 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-6a6662ad-eaeb-4c20-81f7-3235ec811ffd tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:35.374626 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-6a6662ad-eaeb-4c20-81f7-3235ec811ffd tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: fde3f6fc-61e1-4b21-8b91-e95c2db3d48c] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:35.383586 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6a6662ad-eaeb-4c20-81f7-3235ec811ffd tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:35.384328 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6a6662ad-eaeb-4c20-81f7-3235ec811ffd tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:35.386685 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6a6662ad-eaeb-4c20-81f7-3235ec811ffd tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:35.387614 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6a6662ad-eaeb-4c20-81f7-3235ec811ffd tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:35.388104 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6a6662ad-eaeb-4c20-81f7-3235ec811ffd tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:35.388803 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6a6662ad-eaeb-4c20-81f7-3235ec811ffd tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:35.465398 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d12e1003-d484-4145-aa86-04bb86869138 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12dc6570db03431187680f51349e55d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91111396aabd4306b66e14b5abd822ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:35.474908 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d12e1003-d484-4145-aa86-04bb86869138 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] 10.222.0.33 "GET /compute/v2.1/servers/db0b522b-4140-4587-9c1b-0e62d778dce4" status: 200 len: 1517 microversion: 2.1 time: 0.269708 Oct 04 20:47:35.476132 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1532/3132] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:47:35 2022] GET /compute/v2.1/servers/db0b522b-4140-4587-9c1b-0e62d778dce4 => generated 1517 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:47:35.482068 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e9715cb2-7dac-43ee-9965-47103349a6fc tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:35.482935 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e9715cb2-7dac-43ee-9965-47103349a6fc tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] [instance: c0a14e22-0620-4912-9893-62974c80978a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:35.503819 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e9715cb2-7dac-43ee-9965-47103349a6fc tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:35.505364 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e9715cb2-7dac-43ee-9965-47103349a6fc tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:35.506295 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e9715cb2-7dac-43ee-9965-47103349a6fc tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:35.507243 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e9715cb2-7dac-43ee-9965-47103349a6fc tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:35.507886 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e9715cb2-7dac-43ee-9965-47103349a6fc tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:35.508514 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e9715cb2-7dac-43ee-9965-47103349a6fc tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:35.755825 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-6a6662ad-eaeb-4c20-81f7-3235ec811ffd tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac650232cc04810b1340dc2f0edadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b0670d1bd99424780a70e69d57a2166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:35.764991 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e9715cb2-7dac-43ee-9965-47103349a6fc tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28399882314945d787a3af6eb59935c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5392c67506f7445ab33d62b191558f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:35.766041 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-6a6662ad-eaeb-4c20-81f7-3235ec811ffd tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "GET /compute/v2.1/servers/fde3f6fc-61e1-4b21-8b91-e95c2db3d48c" status: 200 len: 1513 microversion: 2.1 time: 0.396671 Oct 04 20:47:35.767335 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1601/3133] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:47:35 2022] GET /compute/v2.1/servers/fde3f6fc-61e1-4b21-8b91-e95c2db3d48c => generated 1513 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:47:35.778545 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-f0cbef16-f75e-407d-b885-60fe19d301c0 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:35.779501 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-f0cbef16-f75e-407d-b885-60fe19d301c0 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] [instance: 041f0f59-75c7-4d01-bc99-77cb871f0fef] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:35.781529 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e9715cb2-7dac-43ee-9965-47103349a6fc tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28399882314945d787a3af6eb59935c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5392c67506f7445ab33d62b191558f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:35.783188 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e9715cb2-7dac-43ee-9965-47103349a6fc tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28399882314945d787a3af6eb59935c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5392c67506f7445ab33d62b191558f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:35.788655 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e9715cb2-7dac-43ee-9965-47103349a6fc tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] 10.222.0.33 "GET /compute/v2.1/servers/c0a14e22-0620-4912-9893-62974c80978a" status: 200 len: 2953 microversion: 2.32 time: 0.311284 Oct 04 20:47:35.790917 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1533/3134] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:47:35 2022] GET /compute/v2.1/servers/c0a14e22-0620-4912-9893-62974c80978a => generated 2953 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:47:35.796985 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f0cbef16-f75e-407d-b885-60fe19d301c0 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:35.796985 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f0cbef16-f75e-407d-b885-60fe19d301c0 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:35.796985 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f0cbef16-f75e-407d-b885-60fe19d301c0 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:35.796985 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f0cbef16-f75e-407d-b885-60fe19d301c0 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:35.796985 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f0cbef16-f75e-407d-b885-60fe19d301c0 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:35.796985 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f0cbef16-f75e-407d-b885-60fe19d301c0 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:35.805015 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-62187630-5330-492b-9cfe-816bd25438da tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:35.805636 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-62187630-5330-492b-9cfe-816bd25438da tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] [instance: 8e0006b2-ed59-4ad1-a921-d1db19cb97b6] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:35.814483 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-62187630-5330-492b-9cfe-816bd25438da tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:35.814978 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-62187630-5330-492b-9cfe-816bd25438da tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:35.815416 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-62187630-5330-492b-9cfe-816bd25438da tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:35.817892 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-62187630-5330-492b-9cfe-816bd25438da tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:35.818995 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-62187630-5330-492b-9cfe-816bd25438da tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:35.819592 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-62187630-5330-492b-9cfe-816bd25438da tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:35.995410 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-f0cbef16-f75e-407d-b885-60fe19d301c0 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87dcc7baf63f4ae6bfe0a099adffd408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7097bc12179446f6a3e1fac8434d5c64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:36.010830 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-f0cbef16-f75e-407d-b885-60fe19d301c0 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] 10.222.0.33 "GET /compute/v2.1/servers/041f0f59-75c7-4d01-bc99-77cb871f0fef" status: 200 len: 1509 microversion: 2.1 time: 0.241604 Oct 04 20:47:36.024388 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1602/3135] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:47:35 2022] GET /compute/v2.1/servers/041f0f59-75c7-4d01-bc99-77cb871f0fef => generated 1509 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:47:36.036027 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-a454e0d9-4471-4e9d-8586-10068672d69a tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:36.036721 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-a454e0d9-4471-4e9d-8586-10068672d69a tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] [instance: 39d66e18-289f-4674-b66c-146d68ef9133] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:36.044049 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a454e0d9-4471-4e9d-8586-10068672d69a tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:36.045901 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a454e0d9-4471-4e9d-8586-10068672d69a tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:36.046552 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a454e0d9-4471-4e9d-8586-10068672d69a tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:36.047540 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a454e0d9-4471-4e9d-8586-10068672d69a tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:36.047671 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-62187630-5330-492b-9cfe-816bd25438da tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aca59cd50bf74a36bb1e4427cd50fbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3fadcd7d4043daa0a6aba27ba814d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:36.048004 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a454e0d9-4471-4e9d-8586-10068672d69a tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:36.051834 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a454e0d9-4471-4e9d-8586-10068672d69a tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:36.057428 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-62187630-5330-492b-9cfe-816bd25438da tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] 10.222.0.33 "GET /compute/v2.1/servers/8e0006b2-ed59-4ad1-a921-d1db19cb97b6" status: 200 len: 1308 microversion: 2.1 time: 0.265427 Oct 04 20:47:36.058979 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1534/3136] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:47:35 2022] GET /compute/v2.1/servers/8e0006b2-ed59-4ad1-a921-d1db19cb97b6 => generated 1308 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:47:36.149374 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-a454e0d9-4471-4e9d-8586-10068672d69a tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:36.163634 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-a454e0d9-4471-4e9d-8586-10068672d69a tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:36.164870 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-a454e0d9-4471-4e9d-8586-10068672d69a tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:36.174541 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-a454e0d9-4471-4e9d-8586-10068672d69a tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] 10.222.0.33 "GET /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133" status: 200 len: 1546 microversion: 2.91 time: 0.143552 Oct 04 20:47:36.175333 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1603/3137] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:47:36 2022] GET /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133 => generated 1546 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:47:36.500236 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-cb963dc0-0d85-406d-898a-993069955885 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:36.500852 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-cb963dc0-0d85-406d-898a-993069955885 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] [instance: db0b522b-4140-4587-9c1b-0e62d778dce4] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:36.503618 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=26 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:47:36.510302 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cb963dc0-0d85-406d-898a-993069955885 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:36.511144 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cb963dc0-0d85-406d-898a-993069955885 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:36.511584 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cb963dc0-0d85-406d-898a-993069955885 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:36.512290 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cb963dc0-0d85-406d-898a-993069955885 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:36.512747 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cb963dc0-0d85-406d-898a-993069955885 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:36.513194 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cb963dc0-0d85-406d-898a-993069955885 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:36.732061 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-e3e1da68-1815-42fe-b4b3-218489354108 req-88137d0f-94da-422f-a7de-45a3a58989e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e0006b2-ed59-4ad1-a921-d1db19cb97b6", "name": "network-vif-plugged", "status": "completed", "tag": "dc42a420-def0-4262-941b-1c282e275581"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:47:36.733580 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-cb963dc0-0d85-406d-898a-993069955885 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12dc6570db03431187680f51349e55d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91111396aabd4306b66e14b5abd822ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:36.742937 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-cb963dc0-0d85-406d-898a-993069955885 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] 10.222.0.33 "GET /compute/v2.1/servers/db0b522b-4140-4587-9c1b-0e62d778dce4" status: 200 len: 1517 microversion: 2.1 time: 0.246478 Oct 04 20:47:36.744170 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1535/3138] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:47:36 2022] GET /compute/v2.1/servers/db0b522b-4140-4587-9c1b-0e62d778dce4 => generated 1517 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:47:36.767478 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-e3e1da68-1815-42fe-b4b3-218489354108 req-88137d0f-94da-422f-a7de-45a3a58989e8 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:36.769313 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-e3e1da68-1815-42fe-b4b3-218489354108 req-88137d0f-94da-422f-a7de-45a3a58989e8 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:36.771950 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-e3e1da68-1815-42fe-b4b3-218489354108 req-88137d0f-94da-422f-a7de-45a3a58989e8 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:36.785624 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-e3e1da68-1815-42fe-b4b3-218489354108 req-88137d0f-94da-422f-a7de-45a3a58989e8 service nova] Creating event network-vif-plugged:dc42a420-def0-4262-941b-1c282e275581 for instance 8e0006b2-ed59-4ad1-a921-d1db19cb97b6 on n-h2-854823-8 Oct 04 20:47:36.792057 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-e3e1da68-1815-42fe-b4b3-218489354108 req-88137d0f-94da-422f-a7de-45a3a58989e8 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064977 Oct 04 20:47:36.792931 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f2b3dbd3-dd80-4f55-961e-502764dc4313 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:36.793504 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1604/3139] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:47:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 20:47:36.793627 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f2b3dbd3-dd80-4f55-961e-502764dc4313 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: fde3f6fc-61e1-4b21-8b91-e95c2db3d48c] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:36.804818 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f2b3dbd3-dd80-4f55-961e-502764dc4313 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:36.805649 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f2b3dbd3-dd80-4f55-961e-502764dc4313 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:36.806974 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f2b3dbd3-dd80-4f55-961e-502764dc4313 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:36.807704 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f2b3dbd3-dd80-4f55-961e-502764dc4313 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:36.810126 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f2b3dbd3-dd80-4f55-961e-502764dc4313 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:36.810612 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f2b3dbd3-dd80-4f55-961e-502764dc4313 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:36.821308 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-dca35079-436f-4891-b473-bfc4cac66df7 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:36.822724 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-dca35079-436f-4891-b473-bfc4cac66df7 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] [instance: c0a14e22-0620-4912-9893-62974c80978a] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:36.846736 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dca35079-436f-4891-b473-bfc4cac66df7 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:36.851782 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dca35079-436f-4891-b473-bfc4cac66df7 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:36.855188 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dca35079-436f-4891-b473-bfc4cac66df7 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:36.856186 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dca35079-436f-4891-b473-bfc4cac66df7 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:36.857596 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dca35079-436f-4891-b473-bfc4cac66df7 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:36.858096 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dca35079-436f-4891-b473-bfc4cac66df7 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:37.596800 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f2b3dbd3-dd80-4f55-961e-502764dc4313 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac650232cc04810b1340dc2f0edadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b0670d1bd99424780a70e69d57a2166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:37.608967 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f2b3dbd3-dd80-4f55-961e-502764dc4313 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "GET /compute/v2.1/servers/fde3f6fc-61e1-4b21-8b91-e95c2db3d48c" status: 200 len: 1513 microversion: 2.1 time: 0.820937 Oct 04 20:47:37.617113 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1536/3140] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:47:36 2022] GET /compute/v2.1/servers/fde3f6fc-61e1-4b21-8b91-e95c2db3d48c => generated 1513 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:47:37.642911 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ded63a95-8053-4a7e-a43d-632bcfa4e2d5 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:37.644041 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ded63a95-8053-4a7e-a43d-632bcfa4e2d5 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] [instance: 041f0f59-75c7-4d01-bc99-77cb871f0fef] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:37.659676 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-dca35079-436f-4891-b473-bfc4cac66df7 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28399882314945d787a3af6eb59935c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5392c67506f7445ab33d62b191558f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:37.665492 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ded63a95-8053-4a7e-a43d-632bcfa4e2d5 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:37.667911 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ded63a95-8053-4a7e-a43d-632bcfa4e2d5 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:37.669187 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ded63a95-8053-4a7e-a43d-632bcfa4e2d5 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:37.670235 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ded63a95-8053-4a7e-a43d-632bcfa4e2d5 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:37.672290 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ded63a95-8053-4a7e-a43d-632bcfa4e2d5 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:37.672742 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ded63a95-8053-4a7e-a43d-632bcfa4e2d5 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:37.674055 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-dca35079-436f-4891-b473-bfc4cac66df7 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28399882314945d787a3af6eb59935c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5392c67506f7445ab33d62b191558f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:37.675788 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-dca35079-436f-4891-b473-bfc4cac66df7 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28399882314945d787a3af6eb59935c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5392c67506f7445ab33d62b191558f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:37.677517 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-dca35079-436f-4891-b473-bfc4cac66df7 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] 10.222.0.33 "GET /compute/v2.1/servers/c0a14e22-0620-4912-9893-62974c80978a" status: 200 len: 2953 microversion: 2.32 time: 0.862283 Oct 04 20:47:37.678320 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1605/3141] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:47:36 2022] GET /compute/v2.1/servers/c0a14e22-0620-4912-9893-62974c80978a => generated 2953 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:47:37.683449 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-bc6c7f7a-4374-495a-8902-adb582d30e8b tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:37.684136 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-bc6c7f7a-4374-495a-8902-adb582d30e8b tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] [instance: 8e0006b2-ed59-4ad1-a921-d1db19cb97b6] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:37.689982 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell0:SELECT=28 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:47:37.692280 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bc6c7f7a-4374-495a-8902-adb582d30e8b tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:37.693075 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bc6c7f7a-4374-495a-8902-adb582d30e8b tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:37.693732 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bc6c7f7a-4374-495a-8902-adb582d30e8b tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:37.695008 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bc6c7f7a-4374-495a-8902-adb582d30e8b tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:37.695760 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bc6c7f7a-4374-495a-8902-adb582d30e8b tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:37.696274 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bc6c7f7a-4374-495a-8902-adb582d30e8b tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:37.909889 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-ded63a95-8053-4a7e-a43d-632bcfa4e2d5 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87dcc7baf63f4ae6bfe0a099adffd408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7097bc12179446f6a3e1fac8434d5c64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:37.913714 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-bc6c7f7a-4374-495a-8902-adb582d30e8b tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aca59cd50bf74a36bb1e4427cd50fbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3fadcd7d4043daa0a6aba27ba814d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:37.919448 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ded63a95-8053-4a7e-a43d-632bcfa4e2d5 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] 10.222.0.33 "GET /compute/v2.1/servers/041f0f59-75c7-4d01-bc99-77cb871f0fef" status: 200 len: 1509 microversion: 2.1 time: 0.300943 Oct 04 20:47:37.930363 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1537/3142] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:47:37 2022] GET /compute/v2.1/servers/041f0f59-75c7-4d01-bc99-77cb871f0fef => generated 1509 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:47:37.930586 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-bc6c7f7a-4374-495a-8902-adb582d30e8b tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] 10.222.0.33 "GET /compute/v2.1/servers/8e0006b2-ed59-4ad1-a921-d1db19cb97b6" status: 200 len: 1308 microversion: 2.1 time: 0.242888 Oct 04 20:47:37.930680 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-151c2679-45e6-4372-a5d9-9b49f19f9b68 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:37.930680 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-151c2679-45e6-4372-a5d9-9b49f19f9b68 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] [instance: 39d66e18-289f-4674-b66c-146d68ef9133] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:37.936816 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-151c2679-45e6-4372-a5d9-9b49f19f9b68 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:37.936816 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-151c2679-45e6-4372-a5d9-9b49f19f9b68 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:37.936816 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-151c2679-45e6-4372-a5d9-9b49f19f9b68 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:37.937315 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-151c2679-45e6-4372-a5d9-9b49f19f9b68 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:37.937875 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-151c2679-45e6-4372-a5d9-9b49f19f9b68 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:37.938388 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-151c2679-45e6-4372-a5d9-9b49f19f9b68 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:37.940417 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1606/3143] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:47:37 2022] GET /compute/v2.1/servers/8e0006b2-ed59-4ad1-a921-d1db19cb97b6 => generated 1308 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:47:37.945722 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-52fcc588-575b-4800-88f0-3d53fac8561b tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:37.946336 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-52fcc588-575b-4800-88f0-3d53fac8561b tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] [instance: db0b522b-4140-4587-9c1b-0e62d778dce4] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:37.952872 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-52fcc588-575b-4800-88f0-3d53fac8561b tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:37.953106 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-52fcc588-575b-4800-88f0-3d53fac8561b tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:37.953520 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-52fcc588-575b-4800-88f0-3d53fac8561b tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:37.954373 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-52fcc588-575b-4800-88f0-3d53fac8561b tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:37.954820 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-52fcc588-575b-4800-88f0-3d53fac8561b tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:37.955432 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-52fcc588-575b-4800-88f0-3d53fac8561b tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:38.035115 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-151c2679-45e6-4372-a5d9-9b49f19f9b68 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:38.039789 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-151c2679-45e6-4372-a5d9-9b49f19f9b68 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:38.041252 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-151c2679-45e6-4372-a5d9-9b49f19f9b68 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:38.046741 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-151c2679-45e6-4372-a5d9-9b49f19f9b68 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] 10.222.0.33 "GET /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133" status: 200 len: 1546 microversion: 2.91 time: 0.125069 Oct 04 20:47:38.047334 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1538/3144] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:47:37 2022] GET /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133 => generated 1546 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:47:38.130189 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-cd2da6d4-bfd6-48e2-97fd-073b902baa18 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Action: 'create', calling method: .version_select at 0x7f3c745bf5e0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1810366648", "description": "tempest-description-1977128090"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:47:38.169725 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-52fcc588-575b-4800-88f0-3d53fac8561b tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12dc6570db03431187680f51349e55d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91111396aabd4306b66e14b5abd822ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:38.178409 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-52fcc588-575b-4800-88f0-3d53fac8561b tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] 10.222.0.33 "GET /compute/v2.1/servers/db0b522b-4140-4587-9c1b-0e62d778dce4" status: 200 len: 1517 microversion: 2.1 time: 0.236396 Oct 04 20:47:38.178556 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=6 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:47:38.179421 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1607/3145] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:47:37 2022] GET /compute/v2.1/servers/db0b522b-4140-4587-9c1b-0e62d778dce4 => generated 1517 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:47:38.321839 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-cd2da6d4-bfd6-48e2-97fd-073b902baa18 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] 10.222.0.33 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.273421 Oct 04 20:47:38.322478 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1539/3146] 10.222.0.33 () {60 vars in 1180 bytes} [Tue Oct 4 20:47:38 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:47:38.337579 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-719a73e6-1849-4893-b217-265bc48694cc tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Action: 'create', calling method: .version_select at 0x7f3c787fdaf0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1667022549", "description": "tempest-description-281139192"}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:47:38.501254 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-719a73e6-1849-4893-b217-265bc48694cc tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] 10.222.0.33 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.169012 Oct 04 20:47:38.502290 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1608/3147] 10.222.0.33 () {60 vars in 1180 bytes} [Tue Oct 4 20:47:38 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:47:38.561091 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-74c7a225-eba2-4554-85b3-2b71d46d93c8 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-540110114", "imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63", "flavorRef": "452", "networks": [{"uuid": "d4324694-bd7d-4530-9426-16b84e542880"}]}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:47:38.624574 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.network.neutron [None req-74c7a225-eba2-4554-85b3-2b71d46d93c8 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] validate_networks() for [('d4324694-bd7d-4530-9426-16b84e542880', None, None, None, None, None)] {{(pid=128801) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:47:38.639177 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-95dd88f8-6aea-44ad-8950-07d56ea61e99 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:38.639819 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-95dd88f8-6aea-44ad-8950-07d56ea61e99 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: fde3f6fc-61e1-4b21-8b91-e95c2db3d48c] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:38.646670 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-95dd88f8-6aea-44ad-8950-07d56ea61e99 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:38.647158 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-95dd88f8-6aea-44ad-8950-07d56ea61e99 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:38.647601 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-95dd88f8-6aea-44ad-8950-07d56ea61e99 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:38.648390 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-95dd88f8-6aea-44ad-8950-07d56ea61e99 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:38.648783 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-95dd88f8-6aea-44ad-8950-07d56ea61e99 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:38.649212 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-95dd88f8-6aea-44ad-8950-07d56ea61e99 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:39.122974 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-95dd88f8-6aea-44ad-8950-07d56ea61e99 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac650232cc04810b1340dc2f0edadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b0670d1bd99424780a70e69d57a2166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:39.132197 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-95dd88f8-6aea-44ad-8950-07d56ea61e99 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "GET /compute/v2.1/servers/fde3f6fc-61e1-4b21-8b91-e95c2db3d48c" status: 200 len: 1513 microversion: 2.1 time: 0.496881 Oct 04 20:47:39.133526 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1609/3148] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:47:38 2022] GET /compute/v2.1/servers/fde3f6fc-61e1-4b21-8b91-e95c2db3d48c => generated 1513 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:47:39.138751 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-4a638b51-cedd-4bc5-8092-dce61925a679 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:39.139651 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-4a638b51-cedd-4bc5-8092-dce61925a679 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] [instance: c0a14e22-0620-4912-9893-62974c80978a] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:39.146165 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4a638b51-cedd-4bc5-8092-dce61925a679 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:39.146951 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4a638b51-cedd-4bc5-8092-dce61925a679 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:39.147635 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4a638b51-cedd-4bc5-8092-dce61925a679 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:39.148570 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4a638b51-cedd-4bc5-8092-dce61925a679 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:39.149276 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4a638b51-cedd-4bc5-8092-dce61925a679 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:39.149918 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4a638b51-cedd-4bc5-8092-dce61925a679 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:39.176815 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:47:39.361997 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell0:SELECT=14 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:47:39.540120 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-4a638b51-cedd-4bc5-8092-dce61925a679 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28399882314945d787a3af6eb59935c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5392c67506f7445ab33d62b191558f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:39.562989 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-4a638b51-cedd-4bc5-8092-dce61925a679 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28399882314945d787a3af6eb59935c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5392c67506f7445ab33d62b191558f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:39.567119 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-4a638b51-cedd-4bc5-8092-dce61925a679 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28399882314945d787a3af6eb59935c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5392c67506f7445ab33d62b191558f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:39.571187 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-4a638b51-cedd-4bc5-8092-dce61925a679 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] 10.222.0.33 "GET /compute/v2.1/servers/c0a14e22-0620-4912-9893-62974c80978a" status: 200 len: 2953 microversion: 2.32 time: 0.436025 Oct 04 20:47:39.586325 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1610/3149] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:47:39 2022] GET /compute/v2.1/servers/c0a14e22-0620-4912-9893-62974c80978a => generated 2953 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:47:39.591702 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-0152bc73-29c3-41c5-8be3-810359556668 req-c01f92c0-405c-4d71-be20-31e5e4cb276e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db0b522b-4140-4587-9c1b-0e62d778dce4", "name": "network-vif-unplugged", "status": "completed", "tag": "4a163c71-363b-465d-9722-52f73cd8baca"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:47:39.603493 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-0152bc73-29c3-41c5-8be3-810359556668 req-c01f92c0-405c-4d71-be20-31e5e4cb276e service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:39.604245 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-0152bc73-29c3-41c5-8be3-810359556668 req-c01f92c0-405c-4d71-be20-31e5e4cb276e service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:39.604853 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-0152bc73-29c3-41c5-8be3-810359556668 req-c01f92c0-405c-4d71-be20-31e5e4cb276e service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:39.617467 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-0152bc73-29c3-41c5-8be3-810359556668 req-c01f92c0-405c-4d71-be20-31e5e4cb276e service nova] Creating event network-vif-unplugged:4a163c71-363b-465d-9722-52f73cd8baca for instance db0b522b-4140-4587-9c1b-0e62d778dce4 on n-h1-854823-8 Oct 04 20:47:39.631917 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-0152bc73-29c3-41c5-8be3-810359556668 req-c01f92c0-405c-4d71-be20-31e5e4cb276e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044035 Oct 04 20:47:39.632538 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1611/3150] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:47:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:47:39.637845 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-a392dca5-f04d-44e9-8ed0-8ccf920c1aec tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:39.638599 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-a392dca5-f04d-44e9-8ed0-8ccf920c1aec tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] [instance: 041f0f59-75c7-4d01-bc99-77cb871f0fef] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:39.646867 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a392dca5-f04d-44e9-8ed0-8ccf920c1aec tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:39.647370 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a392dca5-f04d-44e9-8ed0-8ccf920c1aec tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:39.647814 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a392dca5-f04d-44e9-8ed0-8ccf920c1aec tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:39.648539 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a392dca5-f04d-44e9-8ed0-8ccf920c1aec tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:39.649007 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a392dca5-f04d-44e9-8ed0-8ccf920c1aec tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:39.649433 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a392dca5-f04d-44e9-8ed0-8ccf920c1aec tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:39.854797 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-74c7a225-eba2-4554-85b3-2b71d46d93c8 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Flavor limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:47:39.856606 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-74c7a225-eba2-4554-85b3-2b71d46d93c8 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Image limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:47:39.856606 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-74c7a225-eba2-4554-85b3-2b71d46d93c8 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Flavor pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:47:39.857235 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-74c7a225-eba2-4554-85b3-2b71d46d93c8 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Image pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:47:39.857869 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-74c7a225-eba2-4554-85b3-2b71d46d93c8 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:47:39.876853 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-74c7a225-eba2-4554-85b3-2b71d46d93c8 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:39.881187 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-74c7a225-eba2-4554-85b3-2b71d46d93c8 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:39.889168 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-74c7a225-eba2-4554-85b3-2b71d46d93c8 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:39.895364 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-74c7a225-eba2-4554-85b3-2b71d46d93c8 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:39.902525 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-74c7a225-eba2-4554-85b3-2b71d46d93c8 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:39.903386 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-74c7a225-eba2-4554-85b3-2b71d46d93c8 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:39.980406 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-74c7a225-eba2-4554-85b3-2b71d46d93c8 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Getting quotas for project 5338cf2146344042bc263bdc4f9d822b. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:47:39.994068 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-74c7a225-eba2-4554-85b3-2b71d46d93c8 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Getting quotas for user 6775b9d82b3444f6b728736f1d2b2806 and project 5338cf2146344042bc263bdc4f9d822b. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:47:40.010769 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-74c7a225-eba2-4554-85b3-2b71d46d93c8 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Going to run 1 instances... {{(pid=128801) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:47:40.013355 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-74c7a225-eba2-4554-85b3-2b71d46d93c8 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] [instance: 40a02873-d2c2-42b7-a0b7-2b6125d490f3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='15b24725-0c99-4bcf-b1fb-907cdf8e2d63',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128801) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:47:40.061719 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-a392dca5-f04d-44e9-8ed0-8ccf920c1aec tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87dcc7baf63f4ae6bfe0a099adffd408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7097bc12179446f6a3e1fac8434d5c64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:40.073926 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-a392dca5-f04d-44e9-8ed0-8ccf920c1aec tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] 10.222.0.33 "GET /compute/v2.1/servers/041f0f59-75c7-4d01-bc99-77cb871f0fef" status: 200 len: 1509 microversion: 2.1 time: 0.439707 Oct 04 20:47:40.075200 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1612/3151] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:47:39 2022] GET /compute/v2.1/servers/041f0f59-75c7-4d01-bc99-77cb871f0fef => generated 1509 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:47:40.081166 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-40c75c12-6d27-48b3-84f6-25e33a56cbda tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:40.083199 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-40c75c12-6d27-48b3-84f6-25e33a56cbda tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] [instance: 8e0006b2-ed59-4ad1-a921-d1db19cb97b6] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:40.087039 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-74c7a225-eba2-4554-85b3-2b71d46d93c8 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.532040 Oct 04 20:47:40.089572 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1540/3152] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 20:47:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 1535 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 20:47:40.091767 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-40c75c12-6d27-48b3-84f6-25e33a56cbda tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:40.092981 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-40c75c12-6d27-48b3-84f6-25e33a56cbda tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:40.096733 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b64bcc1d-c111-418c-b193-e5ffbee433cc tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:40.097657 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b64bcc1d-c111-418c-b193-e5ffbee433cc tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] [instance: 39d66e18-289f-4674-b66c-146d68ef9133] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:40.106695 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b64bcc1d-c111-418c-b193-e5ffbee433cc tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:40.107454 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b64bcc1d-c111-418c-b193-e5ffbee433cc tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:40.108124 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b64bcc1d-c111-418c-b193-e5ffbee433cc tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:40.109015 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b64bcc1d-c111-418c-b193-e5ffbee433cc tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:40.109628 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b64bcc1d-c111-418c-b193-e5ffbee433cc tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:40.110379 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b64bcc1d-c111-418c-b193-e5ffbee433cc tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:40.116016 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-40c75c12-6d27-48b3-84f6-25e33a56cbda tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:40.118303 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-40c75c12-6d27-48b3-84f6-25e33a56cbda tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:40.123472 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-40c75c12-6d27-48b3-84f6-25e33a56cbda tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:40.128775 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-40c75c12-6d27-48b3-84f6-25e33a56cbda tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:40.267599 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-b64bcc1d-c111-418c-b193-e5ffbee433cc tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:40.281758 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-b64bcc1d-c111-418c-b193-e5ffbee433cc tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:40.288043 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-b64bcc1d-c111-418c-b193-e5ffbee433cc tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:40.299442 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b64bcc1d-c111-418c-b193-e5ffbee433cc tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] 10.222.0.33 "GET /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133" status: 200 len: 1546 microversion: 2.91 time: 0.208168 Oct 04 20:47:40.305177 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1541/3153] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:47:40 2022] GET /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133 => generated 1546 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:47:40.335107 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-262eac97-6381-4e7b-93fd-42812405eee4 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:40.335719 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-262eac97-6381-4e7b-93fd-42812405eee4 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] [instance: db0b522b-4140-4587-9c1b-0e62d778dce4] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:40.355561 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-262eac97-6381-4e7b-93fd-42812405eee4 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:40.356264 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-262eac97-6381-4e7b-93fd-42812405eee4 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:40.360164 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-262eac97-6381-4e7b-93fd-42812405eee4 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:40.361308 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-262eac97-6381-4e7b-93fd-42812405eee4 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:40.362623 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-262eac97-6381-4e7b-93fd-42812405eee4 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:40.363272 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-262eac97-6381-4e7b-93fd-42812405eee4 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:40.436666 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-40c75c12-6d27-48b3-84f6-25e33a56cbda tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aca59cd50bf74a36bb1e4427cd50fbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3fadcd7d4043daa0a6aba27ba814d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:40.449174 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-40c75c12-6d27-48b3-84f6-25e33a56cbda tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] 10.222.0.33 "GET /compute/v2.1/servers/8e0006b2-ed59-4ad1-a921-d1db19cb97b6" status: 200 len: 1488 microversion: 2.1 time: 0.372609 Oct 04 20:47:40.450634 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1613/3154] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:47:40 2022] GET /compute/v2.1/servers/8e0006b2-ed59-4ad1-a921-d1db19cb97b6 => generated 1488 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:47:40.462661 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-2b4445f0-cc88-481a-85ac-b55bdf860130 req-cda1edc6-16ec-4341-8b3f-f77c08862eaa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db0b522b-4140-4587-9c1b-0e62d778dce4", "name": "network-vif-deleted", "tag": "4a163c71-363b-465d-9722-52f73cd8baca"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:47:40.507564 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-2b4445f0-cc88-481a-85ac-b55bdf860130 req-cda1edc6-16ec-4341-8b3f-f77c08862eaa service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:40.509121 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-2b4445f0-cc88-481a-85ac-b55bdf860130 req-cda1edc6-16ec-4341-8b3f-f77c08862eaa service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.027s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:40.512768 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-2b4445f0-cc88-481a-85ac-b55bdf860130 req-cda1edc6-16ec-4341-8b3f-f77c08862eaa service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:40.530638 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-262eac97-6381-4e7b-93fd-42812405eee4 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12dc6570db03431187680f51349e55d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91111396aabd4306b66e14b5abd822ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:40.546661 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-262eac97-6381-4e7b-93fd-42812405eee4 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] 10.222.0.33 "GET /compute/v2.1/servers/db0b522b-4140-4587-9c1b-0e62d778dce4" status: 200 len: 1306 microversion: 2.1 time: 0.240243 Oct 04 20:47:40.547816 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1542/3155] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:47:40 2022] GET /compute/v2.1/servers/db0b522b-4140-4587-9c1b-0e62d778dce4 => generated 1306 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:47:40.555709 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-283d9538-9218-4223-88b1-9928f2908c75 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:40.556595 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-283d9538-9218-4223-88b1-9928f2908c75 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] [instance: 40a02873-d2c2-42b7-a0b7-2b6125d490f3] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:40.587252 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-2b4445f0-cc88-481a-85ac-b55bdf860130 req-cda1edc6-16ec-4341-8b3f-f77c08862eaa service nova] Creating event network-vif-deleted:4a163c71-363b-465d-9722-52f73cd8baca for instance db0b522b-4140-4587-9c1b-0e62d778dce4 on n-h1-854823-8 Oct 04 20:47:40.600659 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-2b4445f0-cc88-481a-85ac-b55bdf860130 req-cda1edc6-16ec-4341-8b3f-f77c08862eaa service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.148596 Oct 04 20:47:40.608712 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1614/3156] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:47:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:47:40.635031 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-ee929384-1685-4c1f-aa68-5a10efbfb56b tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:40.638995 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-ee929384-1685-4c1f-aa68-5a10efbfb56b tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: fde3f6fc-61e1-4b21-8b91-e95c2db3d48c] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:40.642455 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-283d9538-9218-4223-88b1-9928f2908c75 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6775b9d82b3444f6b728736f1d2b2806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5338cf2146344042bc263bdc4f9d822b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:40.658652 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ee929384-1685-4c1f-aa68-5a10efbfb56b tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:40.661687 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ee929384-1685-4c1f-aa68-5a10efbfb56b tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:40.663494 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ee929384-1685-4c1f-aa68-5a10efbfb56b tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:40.665052 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ee929384-1685-4c1f-aa68-5a10efbfb56b tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:40.666128 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-283d9538-9218-4223-88b1-9928f2908c75 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] 10.222.0.33 "GET /compute/v2.1/servers/40a02873-d2c2-42b7-a0b7-2b6125d490f3" status: 200 len: 1215 microversion: 2.1 time: 0.116792 Oct 04 20:47:40.668453 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ee929384-1685-4c1f-aa68-5a10efbfb56b tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:40.668453 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ee929384-1685-4c1f-aa68-5a10efbfb56b tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:40.681542 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1543/3157] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:47:40 2022] GET /compute/v2.1/servers/40a02873-d2c2-42b7-a0b7-2b6125d490f3 => generated 1215 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:47:40.711928 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a2a7e568-7a18-4413-a999-ce0fab5f1a78 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:47:40.716722 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a2a7e568-7a18-4413-a999-ce0fab5f1a78 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] [instance: 8e0006b2-ed59-4ad1-a921-d1db19cb97b6] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:40.739169 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a2a7e568-7a18-4413-a999-ce0fab5f1a78 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:40.742516 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a2a7e568-7a18-4413-a999-ce0fab5f1a78 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:40.743287 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a2a7e568-7a18-4413-a999-ce0fab5f1a78 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:40.744212 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a2a7e568-7a18-4413-a999-ce0fab5f1a78 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:40.747062 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a2a7e568-7a18-4413-a999-ce0fab5f1a78 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:40.749865 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a2a7e568-7a18-4413-a999-ce0fab5f1a78 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:40.869844 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-a2a7e568-7a18-4413-a999-ce0fab5f1a78 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lazy-loading 'flavor' on Instance uuid 8e0006b2-ed59-4ad1-a921-d1db19cb97b6 {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:47:41.040826 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a2a7e568-7a18-4413-a999-ce0fab5f1a78 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] 10.222.0.33 "POST /compute/v2.1/servers/8e0006b2-ed59-4ad1-a921-d1db19cb97b6/action" status: 202 len: 0 microversion: 2.1 time: 0.357367 Oct 04 20:47:41.050547 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1544/3158] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 20:47:40 2022] POST /compute/v2.1/servers/8e0006b2-ed59-4ad1-a921-d1db19cb97b6/action => generated 0 bytes in 368 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:47:41.061766 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-446d97d5-c1f4-4d98-a468-e10a2ce2dae6 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:41.067265 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-446d97d5-c1f4-4d98-a468-e10a2ce2dae6 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] [instance: c0a14e22-0620-4912-9893-62974c80978a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:41.081951 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-446d97d5-c1f4-4d98-a468-e10a2ce2dae6 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:41.085028 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-446d97d5-c1f4-4d98-a468-e10a2ce2dae6 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:41.086228 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-446d97d5-c1f4-4d98-a468-e10a2ce2dae6 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:41.087322 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-446d97d5-c1f4-4d98-a468-e10a2ce2dae6 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:41.088963 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-446d97d5-c1f4-4d98-a468-e10a2ce2dae6 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:41.089929 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-446d97d5-c1f4-4d98-a468-e10a2ce2dae6 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:41.602040 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-446d97d5-c1f4-4d98-a468-e10a2ce2dae6 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28399882314945d787a3af6eb59935c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5392c67506f7445ab33d62b191558f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:41.618672 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-446d97d5-c1f4-4d98-a468-e10a2ce2dae6 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28399882314945d787a3af6eb59935c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5392c67506f7445ab33d62b191558f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:41.620705 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-446d97d5-c1f4-4d98-a468-e10a2ce2dae6 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28399882314945d787a3af6eb59935c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5392c67506f7445ab33d62b191558f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:41.622153 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-446d97d5-c1f4-4d98-a468-e10a2ce2dae6 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] 10.222.0.33 "GET /compute/v2.1/servers/c0a14e22-0620-4912-9893-62974c80978a" status: 200 len: 2953 microversion: 2.32 time: 0.569375 Oct 04 20:47:41.628243 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-ee929384-1685-4c1f-aa68-5a10efbfb56b tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac650232cc04810b1340dc2f0edadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b0670d1bd99424780a70e69d57a2166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:41.635343 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1545/3159] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:47:41 2022] GET /compute/v2.1/servers/c0a14e22-0620-4912-9893-62974c80978a => generated 2953 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:47:41.640453 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-61e26ca9-c37e-488b-9bf5-c6f37b2ccc33 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:41.645215 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-61e26ca9-c37e-488b-9bf5-c6f37b2ccc33 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] [instance: 8e0006b2-ed59-4ad1-a921-d1db19cb97b6] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:41.649128 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-ee929384-1685-4c1f-aa68-5a10efbfb56b tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "GET /compute/v2.1/servers/fde3f6fc-61e1-4b21-8b91-e95c2db3d48c" status: 200 len: 1513 microversion: 2.1 time: 1.038821 Oct 04 20:47:41.649917 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1615/3160] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:47:40 2022] GET /compute/v2.1/servers/fde3f6fc-61e1-4b21-8b91-e95c2db3d48c => generated 1513 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:47:41.654605 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-4d54f14e-5956-43ab-9dbc-277aa3575172 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:41.657673 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-4d54f14e-5956-43ab-9dbc-277aa3575172 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] [instance: 041f0f59-75c7-4d01-bc99-77cb871f0fef] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:41.674498 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-61e26ca9-c37e-488b-9bf5-c6f37b2ccc33 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:41.679816 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-61e26ca9-c37e-488b-9bf5-c6f37b2ccc33 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:41.681682 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4d54f14e-5956-43ab-9dbc-277aa3575172 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:41.682309 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-61e26ca9-c37e-488b-9bf5-c6f37b2ccc33 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:41.683214 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-61e26ca9-c37e-488b-9bf5-c6f37b2ccc33 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:41.686836 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4d54f14e-5956-43ab-9dbc-277aa3575172 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:41.687566 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-61e26ca9-c37e-488b-9bf5-c6f37b2ccc33 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:41.688184 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4d54f14e-5956-43ab-9dbc-277aa3575172 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:41.688780 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-61e26ca9-c37e-488b-9bf5-c6f37b2ccc33 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:41.689658 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4d54f14e-5956-43ab-9dbc-277aa3575172 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:41.691666 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4d54f14e-5956-43ab-9dbc-277aa3575172 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:41.694017 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4d54f14e-5956-43ab-9dbc-277aa3575172 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:42.063591 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-61e26ca9-c37e-488b-9bf5-c6f37b2ccc33 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aca59cd50bf74a36bb1e4427cd50fbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3fadcd7d4043daa0a6aba27ba814d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:42.072327 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-61e26ca9-c37e-488b-9bf5-c6f37b2ccc33 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] 10.222.0.33 "GET /compute/v2.1/servers/8e0006b2-ed59-4ad1-a921-d1db19cb97b6" status: 200 len: 1496 microversion: 2.1 time: 0.435517 Oct 04 20:47:42.072837 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1546/3161] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:47:41 2022] GET /compute/v2.1/servers/8e0006b2-ed59-4ad1-a921-d1db19cb97b6 => generated 1496 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:47:42.077508 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f01c8632-f2d9-43dc-b067-b31f19ae6922 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:42.087421 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f01c8632-f2d9-43dc-b067-b31f19ae6922 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] [instance: 39d66e18-289f-4674-b66c-146d68ef9133] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:42.099523 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f01c8632-f2d9-43dc-b067-b31f19ae6922 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:42.111145 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f01c8632-f2d9-43dc-b067-b31f19ae6922 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:42.111845 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f01c8632-f2d9-43dc-b067-b31f19ae6922 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:42.112774 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f01c8632-f2d9-43dc-b067-b31f19ae6922 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:42.113955 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f01c8632-f2d9-43dc-b067-b31f19ae6922 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:42.114885 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f01c8632-f2d9-43dc-b067-b31f19ae6922 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:42.226181 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-4d54f14e-5956-43ab-9dbc-277aa3575172 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87dcc7baf63f4ae6bfe0a099adffd408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7097bc12179446f6a3e1fac8434d5c64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:42.242641 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-4d54f14e-5956-43ab-9dbc-277aa3575172 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] 10.222.0.33 "GET /compute/v2.1/servers/041f0f59-75c7-4d01-bc99-77cb871f0fef" status: 200 len: 1509 microversion: 2.1 time: 0.591427 Oct 04 20:47:42.251046 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1616/3162] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:47:41 2022] GET /compute/v2.1/servers/041f0f59-75c7-4d01-bc99-77cb871f0fef => generated 1509 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:47:42.254491 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f01c8632-f2d9-43dc-b067-b31f19ae6922 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:42.263700 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f01c8632-f2d9-43dc-b067-b31f19ae6922 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:42.270254 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f01c8632-f2d9-43dc-b067-b31f19ae6922 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:42.271027 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-c45e1d23-2a10-40a6-9d5a-e16e6826e875 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:42.271805 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-c45e1d23-2a10-40a6-9d5a-e16e6826e875 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] [instance: db0b522b-4140-4587-9c1b-0e62d778dce4] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:42.282406 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f01c8632-f2d9-43dc-b067-b31f19ae6922 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] 10.222.0.33 "GET /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133" status: 200 len: 1546 microversion: 2.91 time: 0.208493 Oct 04 20:47:42.286980 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1547/3163] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:47:42 2022] GET /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133 => generated 1546 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:47:42.297214 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c45e1d23-2a10-40a6-9d5a-e16e6826e875 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:42.297724 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c45e1d23-2a10-40a6-9d5a-e16e6826e875 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:42.298162 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c45e1d23-2a10-40a6-9d5a-e16e6826e875 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:42.298928 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c45e1d23-2a10-40a6-9d5a-e16e6826e875 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:42.299385 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c45e1d23-2a10-40a6-9d5a-e16e6826e875 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:42.299814 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c45e1d23-2a10-40a6-9d5a-e16e6826e875 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:42.303215 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-77591850-d1b8-4c4a-8ae2-97052de6b36d tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:42.304241 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-77591850-d1b8-4c4a-8ae2-97052de6b36d tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] [instance: 40a02873-d2c2-42b7-a0b7-2b6125d490f3] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:42.314566 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-77591850-d1b8-4c4a-8ae2-97052de6b36d tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:42.318936 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-77591850-d1b8-4c4a-8ae2-97052de6b36d tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:42.319540 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-77591850-d1b8-4c4a-8ae2-97052de6b36d tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:42.320419 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-77591850-d1b8-4c4a-8ae2-97052de6b36d tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:42.321054 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-77591850-d1b8-4c4a-8ae2-97052de6b36d tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:42.321629 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-77591850-d1b8-4c4a-8ae2-97052de6b36d tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:42.349201 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.wsgi [None req-c45e1d23-2a10-40a6-9d5a-e16e6826e875 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] HTTP exception thrown: Instance db0b522b-4140-4587-9c1b-0e62d778dce4 could not be found. Oct 04 20:47:42.351064 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-c45e1d23-2a10-40a6-9d5a-e16e6826e875 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Request method failure captured: Oct 04 20:47:42.351064 n-d-854823-8 devstack@n-api.service[128802]: request: GET /compute/v2.1/servers/db0b522b-4140-4587-9c1b-0e62d778dce4 HTTP/1.1 Oct 04 20:47:42.351064 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 20:47:42.351064 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 20:47:42.351064 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 20:47:42.351064 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 0 Oct 04 20:47:42.351064 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 20:47:42.351064 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 20:47:42.351064 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 20:47:42.351064 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 20:47:42.351064 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPJuA25pY5gnij2GUImD-SeoqdUwrg36IJ00ci1xpid5rkQM_iu-hu9Kj4hz7bXCbbgwzkwDgSGrCuv5J0mFe0VOwO727nThjFElnHFGlINPkXZX80vX9nrbk5CSUaU0Wug41BK5JHF9vTIRe1sfED5uAcUvsrV9JrGz3UtCU4qQaKGU Oct 04 20:47:42.351064 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 20:47:42.351064 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 20:47:42.351064 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 20:47:42.351064 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 20:47:42.351064 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 20:47:42.351064 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 20:47:42.351064 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: 91111396aabd4306b66e14b5abd822ad Oct 04 20:47:42.351064 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-ListServerFiltersTestJSON-771158953 Oct 04 20:47:42.351064 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 20:47:42.351064 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 20:47:42.351064 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_91111396aabd4306b66e14b5abd822ad", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/91111396aabd4306b66e14b5abd822ad"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/91111396aabd4306b66e14b5abd822ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/91111396aabd4306b66e14b5abd822ad"}]}] Oct 04 20:47:42.351064 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-ListServerFiltersTestJSON-771158953 Oct 04 20:47:42.351064 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: 91111396aabd4306b66e14b5abd822ad Oct 04 20:47:42.351064 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-771158953 Oct 04 20:47:42.351064 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-ListServerFiltersTestJSON-771158953-project Oct 04 20:47:42.351064 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 20:47:42.351064 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 20:47:42.351064 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: 12dc6570db03431187680f51349e55d3 Oct 04 20:47:42.351064 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-ListServerFiltersTestJSON-771158953-project Oct 04 20:47:42.351064 n-d-854823-8 devstack@n-api.service[128802]: method: > Oct 04 20:47:42.351064 n-d-854823-8 devstack@n-api.service[128802]: exception: Instance db0b522b-4140-4587-9c1b-0e62d778dce4 could not be found. Oct 04 20:47:42.351064 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'id': 'db0b522b-4140-4587-9c1b-0e62d778dce4'} Oct 04 20:47:42.351064 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:47:42.351064 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:47:42.351064 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:47:42.351064 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:47:42.351064 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:47:42.351064 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:47:42.351064 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:47:42.351064 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:47:42.351064 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:47:42.351064 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:47:42.351064 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db0b522b-4140-4587-9c1b-0e62d778dce4 could not be found. Oct 04 20:47:42.351064 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:47:42.351064 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:47:42.351064 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:47:42.351064 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:47:42.351064 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:47:42.351064 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:47:42.351064 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:47:42.351064 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:47:42.351064 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:47:42.351064 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:47:42.351064 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:47:42.351064 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:47:42.351064 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:47:42.351064 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:47:42.351064 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:47:42.351064 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:47:42.351064 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db0b522b-4140-4587-9c1b-0e62d778dce4 could not be found. Oct 04 20:47:42.351064 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:47:42.351064 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:47:42.351064 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:47:42.356424 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:47:42.356424 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:47:42.356424 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:47:42.356424 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:47:42.356424 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:47:42.356424 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db0b522b-4140-4587-9c1b-0e62d778dce4 could not be found. Oct 04 20:47:42.356424 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:47:42.357994 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-c45e1d23-2a10-40a6-9d5a-e16e6826e875 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Returning 404 to user: Instance db0b522b-4140-4587-9c1b-0e62d778dce4 could not be found. {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:47:42.359485 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-c45e1d23-2a10-40a6-9d5a-e16e6826e875 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] 10.222.0.33 "GET /compute/v2.1/servers/db0b522b-4140-4587-9c1b-0e62d778dce4" status: 404 len: 111 microversion: 2.1 time: 0.106832 Oct 04 20:47:42.364293 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1617/3164] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:47:42 2022] GET /compute/v2.1/servers/db0b522b-4140-4587-9c1b-0e62d778dce4 => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:47:42.370563 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-488b0399-4487-4ea8-a772-6f35df2a9030 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:42.371344 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-488b0399-4487-4ea8-a772-6f35df2a9030 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] [instance: 7bbbbf6d-9e62-426b-85b4-d523110a05ef] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:42.378102 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-488b0399-4487-4ea8-a772-6f35df2a9030 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:42.379820 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-488b0399-4487-4ea8-a772-6f35df2a9030 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:42.380700 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-488b0399-4487-4ea8-a772-6f35df2a9030 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:42.381577 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-488b0399-4487-4ea8-a772-6f35df2a9030 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:42.382229 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-488b0399-4487-4ea8-a772-6f35df2a9030 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:42.382907 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-488b0399-4487-4ea8-a772-6f35df2a9030 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:42.432519 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-77591850-d1b8-4c4a-8ae2-97052de6b36d tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6775b9d82b3444f6b728736f1d2b2806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5338cf2146344042bc263bdc4f9d822b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:42.439220 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-488b0399-4487-4ea8-a772-6f35df2a9030 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] [instance: 7bbbbf6d-9e62-426b-85b4-d523110a05ef] Going to try to terminate instance {{(pid=128802) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:47:42.444824 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-77591850-d1b8-4c4a-8ae2-97052de6b36d tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] 10.222.0.33 "GET /compute/v2.1/servers/40a02873-d2c2-42b7-a0b7-2b6125d490f3" status: 200 len: 1267 microversion: 2.1 time: 0.155980 Oct 04 20:47:42.461727 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1548/3165] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:47:42 2022] GET /compute/v2.1/servers/40a02873-d2c2-42b7-a0b7-2b6125d490f3 => generated 1267 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:47:42.465740 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-c78b03a2-c05a-441e-ae40-8b014615eeca req-14598a28-b7aa-4686-bca3-206a5ba68b69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0a14e22-0620-4912-9893-62974c80978a", "name": "network-vif-unplugged", "status": "completed", "tag": "6a2a59c6-7fc0-4c9d-9f8a-2a71aff6748a"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:47:42.480269 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-c78b03a2-c05a-441e-ae40-8b014615eeca req-14598a28-b7aa-4686-bca3-206a5ba68b69 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:42.480771 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-c78b03a2-c05a-441e-ae40-8b014615eeca req-14598a28-b7aa-4686-bca3-206a5ba68b69 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:42.481201 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-c78b03a2-c05a-441e-ae40-8b014615eeca req-14598a28-b7aa-4686-bca3-206a5ba68b69 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:42.508716 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-c78b03a2-c05a-441e-ae40-8b014615eeca req-14598a28-b7aa-4686-bca3-206a5ba68b69 service nova] Creating event network-vif-unplugged:6a2a59c6-7fc0-4c9d-9f8a-2a71aff6748a for instance c0a14e22-0620-4912-9893-62974c80978a on n-h1-854823-8 Oct 04 20:47:42.522364 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-c78b03a2-c05a-441e-ae40-8b014615eeca req-14598a28-b7aa-4686-bca3-206a5ba68b69 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.072092 Oct 04 20:47:42.527011 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1549/3166] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:47:42 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:47:42.636504 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-488b0399-4487-4ea8-a772-6f35df2a9030 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] 10.222.0.33 "DELETE /compute/v2.1/servers/7bbbbf6d-9e62-426b-85b4-d523110a05ef" status: 204 len: 0 microversion: 2.1 time: 0.270519 Oct 04 20:47:42.638545 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1618/3167] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 20:47:42 2022] DELETE /compute/v2.1/servers/7bbbbf6d-9e62-426b-85b4-d523110a05ef => generated 0 bytes in 273 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:47:42.649539 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-bd13c368-f40d-432e-85e0-8edde37b0c3a tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:42.650986 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-bd13c368-f40d-432e-85e0-8edde37b0c3a tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] [instance: 7bbbbf6d-9e62-426b-85b4-d523110a05ef] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:42.672614 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-25a957b3-0578-46ae-99c9-7b70ae8ba3df tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:42.674085 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-25a957b3-0578-46ae-99c9-7b70ae8ba3df tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] [instance: c0a14e22-0620-4912-9893-62974c80978a] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:42.676954 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bd13c368-f40d-432e-85e0-8edde37b0c3a tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:42.680994 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bd13c368-f40d-432e-85e0-8edde37b0c3a tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:42.681598 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bd13c368-f40d-432e-85e0-8edde37b0c3a tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:42.694904 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bd13c368-f40d-432e-85e0-8edde37b0c3a tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:42.697795 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bd13c368-f40d-432e-85e0-8edde37b0c3a tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:42.698093 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bd13c368-f40d-432e-85e0-8edde37b0c3a tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:42.711011 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-25a957b3-0578-46ae-99c9-7b70ae8ba3df tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:42.711536 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-25a957b3-0578-46ae-99c9-7b70ae8ba3df tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:42.711982 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-25a957b3-0578-46ae-99c9-7b70ae8ba3df tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:42.715650 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-25a957b3-0578-46ae-99c9-7b70ae8ba3df tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:42.717141 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-25a957b3-0578-46ae-99c9-7b70ae8ba3df tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:42.718537 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=96,nova_cell1:UPDATE=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:47:42.719206 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-25a957b3-0578-46ae-99c9-7b70ae8ba3df tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:43.272201 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-25a957b3-0578-46ae-99c9-7b70ae8ba3df tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28399882314945d787a3af6eb59935c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5392c67506f7445ab33d62b191558f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:43.288807 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-25a957b3-0578-46ae-99c9-7b70ae8ba3df tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28399882314945d787a3af6eb59935c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5392c67506f7445ab33d62b191558f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:43.291452 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-25a957b3-0578-46ae-99c9-7b70ae8ba3df tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28399882314945d787a3af6eb59935c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5392c67506f7445ab33d62b191558f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:43.292968 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-25a957b3-0578-46ae-99c9-7b70ae8ba3df tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] 10.222.0.33 "GET /compute/v2.1/servers/c0a14e22-0620-4912-9893-62974c80978a" status: 200 len: 2932 microversion: 2.32 time: 0.625110 Oct 04 20:47:43.306624 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1619/3168] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:47:42 2022] GET /compute/v2.1/servers/c0a14e22-0620-4912-9893-62974c80978a => generated 2932 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 20:47:43.314059 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-3fa0e2a7-dabe-4220-b229-7bee81c5231e tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:43.314430 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-bd13c368-f40d-432e-85e0-8edde37b0c3a tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12dc6570db03431187680f51349e55d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91111396aabd4306b66e14b5abd822ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:43.314903 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-3fa0e2a7-dabe-4220-b229-7bee81c5231e tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: fde3f6fc-61e1-4b21-8b91-e95c2db3d48c] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:43.325538 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-bd13c368-f40d-432e-85e0-8edde37b0c3a tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] 10.222.0.33 "GET /compute/v2.1/servers/7bbbbf6d-9e62-426b-85b4-d523110a05ef" status: 200 len: 1516 microversion: 2.1 time: 0.682851 Oct 04 20:47:43.326066 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3fa0e2a7-dabe-4220-b229-7bee81c5231e tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:43.326476 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1550/3169] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:47:42 2022] GET /compute/v2.1/servers/7bbbbf6d-9e62-426b-85b4-d523110a05ef => generated 1516 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:47:43.327095 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3fa0e2a7-dabe-4220-b229-7bee81c5231e tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:43.328060 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3fa0e2a7-dabe-4220-b229-7bee81c5231e tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:43.329556 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3fa0e2a7-dabe-4220-b229-7bee81c5231e tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:43.330230 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3fa0e2a7-dabe-4220-b229-7bee81c5231e tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:43.331141 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3fa0e2a7-dabe-4220-b229-7bee81c5231e tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:43.336235 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8d8a1bfc-9c89-490b-ac9b-9dd6c9e62cdd tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:43.336886 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-8d8a1bfc-9c89-490b-ac9b-9dd6c9e62cdd tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] [instance: 8e0006b2-ed59-4ad1-a921-d1db19cb97b6] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:43.369657 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8d8a1bfc-9c89-490b-ac9b-9dd6c9e62cdd tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:43.370538 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8d8a1bfc-9c89-490b-ac9b-9dd6c9e62cdd tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:43.370998 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8d8a1bfc-9c89-490b-ac9b-9dd6c9e62cdd tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:43.371720 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8d8a1bfc-9c89-490b-ac9b-9dd6c9e62cdd tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:43.372180 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8d8a1bfc-9c89-490b-ac9b-9dd6c9e62cdd tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:43.372609 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8d8a1bfc-9c89-490b-ac9b-9dd6c9e62cdd tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:43.762772 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-8d8a1bfc-9c89-490b-ac9b-9dd6c9e62cdd tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aca59cd50bf74a36bb1e4427cd50fbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3fadcd7d4043daa0a6aba27ba814d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:43.779038 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-8d8a1bfc-9c89-490b-ac9b-9dd6c9e62cdd tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] 10.222.0.33 "GET /compute/v2.1/servers/8e0006b2-ed59-4ad1-a921-d1db19cb97b6" status: 200 len: 1479 microversion: 2.1 time: 0.448796 Oct 04 20:47:43.780076 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1551/3170] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:47:43 2022] GET /compute/v2.1/servers/8e0006b2-ed59-4ad1-a921-d1db19cb97b6 => generated 1479 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:47:43.788770 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-99522e36-6963-43fb-af4b-c667fc980a2b tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:43.790542 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-99522e36-6963-43fb-af4b-c667fc980a2b tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] [instance: 041f0f59-75c7-4d01-bc99-77cb871f0fef] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:43.790883 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-3fa0e2a7-dabe-4220-b229-7bee81c5231e tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac650232cc04810b1340dc2f0edadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b0670d1bd99424780a70e69d57a2166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:43.799021 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-99522e36-6963-43fb-af4b-c667fc980a2b tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:43.799727 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-99522e36-6963-43fb-af4b-c667fc980a2b tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:43.800444 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-99522e36-6963-43fb-af4b-c667fc980a2b tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:43.801674 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-99522e36-6963-43fb-af4b-c667fc980a2b tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:43.802299 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-99522e36-6963-43fb-af4b-c667fc980a2b tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:43.802443 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-3fa0e2a7-dabe-4220-b229-7bee81c5231e tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "GET /compute/v2.1/servers/fde3f6fc-61e1-4b21-8b91-e95c2db3d48c" status: 200 len: 1513 microversion: 2.1 time: 0.499020 Oct 04 20:47:43.803130 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-99522e36-6963-43fb-af4b-c667fc980a2b tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:43.807907 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1620/3171] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:47:43 2022] GET /compute/v2.1/servers/fde3f6fc-61e1-4b21-8b91-e95c2db3d48c => generated 1513 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:47:43.825441 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-57dddaac-957a-4757-bd3a-ddd0fc6fd087 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:43.826062 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-57dddaac-957a-4757-bd3a-ddd0fc6fd087 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] [instance: 39d66e18-289f-4674-b66c-146d68ef9133] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:43.843413 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-57dddaac-957a-4757-bd3a-ddd0fc6fd087 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:43.843923 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-57dddaac-957a-4757-bd3a-ddd0fc6fd087 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:43.844582 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-57dddaac-957a-4757-bd3a-ddd0fc6fd087 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:43.845587 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-57dddaac-957a-4757-bd3a-ddd0fc6fd087 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:43.846251 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-57dddaac-957a-4757-bd3a-ddd0fc6fd087 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:43.846875 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-57dddaac-957a-4757-bd3a-ddd0fc6fd087 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:44.037126 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-57dddaac-957a-4757-bd3a-ddd0fc6fd087 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:44.055824 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-57dddaac-957a-4757-bd3a-ddd0fc6fd087 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:44.057566 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-57dddaac-957a-4757-bd3a-ddd0fc6fd087 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:44.064250 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-57dddaac-957a-4757-bd3a-ddd0fc6fd087 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] 10.222.0.33 "GET /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133" status: 200 len: 1533 microversion: 2.91 time: 0.254850 Oct 04 20:47:44.065590 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1621/3172] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:47:43 2022] GET /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133 => generated 1533 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:47:44.074737 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-a2c6da29-2bf7-4847-a877-1e735720a691 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:44.075668 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-a2c6da29-2bf7-4847-a877-1e735720a691 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] [instance: 40a02873-d2c2-42b7-a0b7-2b6125d490f3] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:44.084979 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a2c6da29-2bf7-4847-a877-1e735720a691 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:44.085843 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a2c6da29-2bf7-4847-a877-1e735720a691 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:44.086566 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a2c6da29-2bf7-4847-a877-1e735720a691 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:44.087754 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a2c6da29-2bf7-4847-a877-1e735720a691 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:44.088408 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a2c6da29-2bf7-4847-a877-1e735720a691 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:44.089031 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a2c6da29-2bf7-4847-a877-1e735720a691 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:44.090627 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-99522e36-6963-43fb-af4b-c667fc980a2b tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87dcc7baf63f4ae6bfe0a099adffd408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7097bc12179446f6a3e1fac8434d5c64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:44.098848 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-99522e36-6963-43fb-af4b-c667fc980a2b tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] 10.222.0.33 "GET /compute/v2.1/servers/041f0f59-75c7-4d01-bc99-77cb871f0fef" status: 200 len: 1509 microversion: 2.1 time: 0.316849 Oct 04 20:47:44.103356 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1552/3173] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:47:43 2022] GET /compute/v2.1/servers/041f0f59-75c7-4d01-bc99-77cb871f0fef => generated 1509 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:47:44.112282 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c4858c0c-3f5c-4540-8e9f-feda3e49f572 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-911821551"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:47:44.117390 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c4858c0c-3f5c-4540-8e9f-feda3e49f572 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] [instance: 8e0006b2-ed59-4ad1-a921-d1db19cb97b6] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:44.133735 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c4858c0c-3f5c-4540-8e9f-feda3e49f572 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:44.135371 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c4858c0c-3f5c-4540-8e9f-feda3e49f572 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:44.136081 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c4858c0c-3f5c-4540-8e9f-feda3e49f572 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:44.139220 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c4858c0c-3f5c-4540-8e9f-feda3e49f572 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:44.140104 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c4858c0c-3f5c-4540-8e9f-feda3e49f572 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:44.142005 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c4858c0c-3f5c-4540-8e9f-feda3e49f572 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:44.614280 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c4858c0c-3f5c-4540-8e9f-feda3e49f572 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] 10.222.0.33 "POST /compute/v2.1/servers/8e0006b2-ed59-4ad1-a921-d1db19cb97b6/action" status: 202 len: 0 microversion: 2.1 time: 0.508716 Oct 04 20:47:44.634970 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1553/3174] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 20:47:44 2022] POST /compute/v2.1/servers/8e0006b2-ed59-4ad1-a921-d1db19cb97b6/action => generated 0 bytes in 531 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 04 20:47:44.649653 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-045e4ba4-e839-4688-9e7d-1a65528a8ef0 tempest-UnshelveToHostMultiNodesTest-1871197656 tempest-UnshelveToHostMultiNodesTest-1871197656-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:44.650688 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-045e4ba4-e839-4688-9e7d-1a65528a8ef0 tempest-UnshelveToHostMultiNodesTest-1871197656 tempest-UnshelveToHostMultiNodesTest-1871197656-project-admin] [instance: 39d66e18-289f-4674-b66c-146d68ef9133] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:44.677297 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-045e4ba4-e839-4688-9e7d-1a65528a8ef0 tempest-UnshelveToHostMultiNodesTest-1871197656 tempest-UnshelveToHostMultiNodesTest-1871197656-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:44.678190 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-045e4ba4-e839-4688-9e7d-1a65528a8ef0 tempest-UnshelveToHostMultiNodesTest-1871197656 tempest-UnshelveToHostMultiNodesTest-1871197656-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:44.679970 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-045e4ba4-e839-4688-9e7d-1a65528a8ef0 tempest-UnshelveToHostMultiNodesTest-1871197656 tempest-UnshelveToHostMultiNodesTest-1871197656-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:44.682887 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-045e4ba4-e839-4688-9e7d-1a65528a8ef0 tempest-UnshelveToHostMultiNodesTest-1871197656 tempest-UnshelveToHostMultiNodesTest-1871197656-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:44.683878 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-045e4ba4-e839-4688-9e7d-1a65528a8ef0 tempest-UnshelveToHostMultiNodesTest-1871197656 tempest-UnshelveToHostMultiNodesTest-1871197656-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:44.686026 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-045e4ba4-e839-4688-9e7d-1a65528a8ef0 tempest-UnshelveToHostMultiNodesTest-1871197656 tempest-UnshelveToHostMultiNodesTest-1871197656-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:44.911684 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-a2c6da29-2bf7-4847-a877-1e735720a691 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6775b9d82b3444f6b728736f1d2b2806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5338cf2146344042bc263bdc4f9d822b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:44.924091 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-a2c6da29-2bf7-4847-a877-1e735720a691 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] 10.222.0.33 "GET /compute/v2.1/servers/40a02873-d2c2-42b7-a0b7-2b6125d490f3" status: 200 len: 1315 microversion: 2.1 time: 0.855034 Oct 04 20:47:44.924686 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1622/3175] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:47:44 2022] GET /compute/v2.1/servers/40a02873-d2c2-42b7-a0b7-2b6125d490f3 => generated 1315 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:47:44.930468 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-7d6bac8f-4b18-46b8-b4b0-88a46ce10659 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:44.944437 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-7d6bac8f-4b18-46b8-b4b0-88a46ce10659 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] [instance: c0a14e22-0620-4912-9893-62974c80978a] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:44.959717 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-045e4ba4-e839-4688-9e7d-1a65528a8ef0 tempest-UnshelveToHostMultiNodesTest-1871197656 tempest-UnshelveToHostMultiNodesTest-1871197656-project-admin] Lazy-loading 'services' on Instance uuid 39d66e18-289f-4674-b66c-146d68ef9133 {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:47:44.965347 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7d6bac8f-4b18-46b8-b4b0-88a46ce10659 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:44.966036 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7d6bac8f-4b18-46b8-b4b0-88a46ce10659 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:44.966666 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7d6bac8f-4b18-46b8-b4b0-88a46ce10659 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:44.967703 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7d6bac8f-4b18-46b8-b4b0-88a46ce10659 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:44.968317 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7d6bac8f-4b18-46b8-b4b0-88a46ce10659 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:44.968898 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7d6bac8f-4b18-46b8-b4b0-88a46ce10659 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:45.007672 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-045e4ba4-e839-4688-9e7d-1a65528a8ef0 tempest-UnshelveToHostMultiNodesTest-1871197656 tempest-UnshelveToHostMultiNodesTest-1871197656-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133" status: 200 len: 1938 microversion: 2.91 time: 0.369094 Oct 04 20:47:45.024632 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1554/3176] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:47:44 2022] GET /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133 => generated 1938 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:47:45.045190 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-609a709b-b8c2-4847-8429-6b5f95acdebd tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:45.047071 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-609a709b-b8c2-4847-8429-6b5f95acdebd tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] [instance: 7bbbbf6d-9e62-426b-85b4-d523110a05ef] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:45.057019 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-609a709b-b8c2-4847-8429-6b5f95acdebd tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:45.057939 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-609a709b-b8c2-4847-8429-6b5f95acdebd tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:45.058720 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-609a709b-b8c2-4847-8429-6b5f95acdebd tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:45.059669 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-609a709b-b8c2-4847-8429-6b5f95acdebd tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:45.060313 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-609a709b-b8c2-4847-8429-6b5f95acdebd tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:45.060936 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-609a709b-b8c2-4847-8429-6b5f95acdebd tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:46.022941 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-609a709b-b8c2-4847-8429-6b5f95acdebd tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12dc6570db03431187680f51349e55d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91111396aabd4306b66e14b5abd822ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:46.047288 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-609a709b-b8c2-4847-8429-6b5f95acdebd tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] 10.222.0.33 "GET /compute/v2.1/servers/7bbbbf6d-9e62-426b-85b4-d523110a05ef" status: 200 len: 1516 microversion: 2.1 time: 1.021353 Oct 04 20:47:46.049985 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1555/3177] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:47:45 2022] GET /compute/v2.1/servers/7bbbbf6d-9e62-426b-85b4-d523110a05ef => generated 1516 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:47:46.072955 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0169a95a-5255-40d6-9c8e-8792dbb7648c tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Calling method '.version_select at 0x7f3c78828ee0>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:46.145390 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-0169a95a-5255-40d6-9c8e-8792dbb7648c tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] 10.222.0.33 "GET /compute/v2.1/images/802658f0-2596-4fe9-ad73-90b1f8423ede" status: 200 len: 1437 microversion: 2.1 time: 0.093397 Oct 04 20:47:46.146300 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1556/3178] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 20:47:46 2022] GET /compute/v2.1/images/802658f0-2596-4fe9-ad73-90b1f8423ede => generated 1437 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:47:46.156007 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-13cef430-ad38-4f8c-9bb8-601568b39452 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:46.156957 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-13cef430-ad38-4f8c-9bb8-601568b39452 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: fde3f6fc-61e1-4b21-8b91-e95c2db3d48c] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:46.184177 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-13cef430-ad38-4f8c-9bb8-601568b39452 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:46.185025 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-13cef430-ad38-4f8c-9bb8-601568b39452 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:46.185142 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-7d6bac8f-4b18-46b8-b4b0-88a46ce10659 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28399882314945d787a3af6eb59935c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5392c67506f7445ab33d62b191558f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:46.186510 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-13cef430-ad38-4f8c-9bb8-601568b39452 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:46.196009 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-13cef430-ad38-4f8c-9bb8-601568b39452 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:46.196970 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-13cef430-ad38-4f8c-9bb8-601568b39452 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:46.197622 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-13cef430-ad38-4f8c-9bb8-601568b39452 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:46.242331 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-7d6bac8f-4b18-46b8-b4b0-88a46ce10659 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28399882314945d787a3af6eb59935c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5392c67506f7445ab33d62b191558f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:46.245792 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-7d6bac8f-4b18-46b8-b4b0-88a46ce10659 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28399882314945d787a3af6eb59935c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5392c67506f7445ab33d62b191558f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:46.248135 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-7d6bac8f-4b18-46b8-b4b0-88a46ce10659 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] 10.222.0.33 "GET /compute/v2.1/servers/c0a14e22-0620-4912-9893-62974c80978a" status: 200 len: 2911 microversion: 2.32 time: 1.322146 Oct 04 20:47:46.249226 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1623/3179] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:47:44 2022] GET /compute/v2.1/servers/c0a14e22-0620-4912-9893-62974c80978a => generated 2911 bytes in 1324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:47:46.255239 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-44af5132-ffd1-4b68-a2f7-f87a505c8cbb tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:46.255950 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-44af5132-ffd1-4b68-a2f7-f87a505c8cbb tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] [instance: 39d66e18-289f-4674-b66c-146d68ef9133] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:46.263017 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-44af5132-ffd1-4b68-a2f7-f87a505c8cbb tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:46.263714 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-44af5132-ffd1-4b68-a2f7-f87a505c8cbb tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:46.264344 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-44af5132-ffd1-4b68-a2f7-f87a505c8cbb tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:46.265390 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-44af5132-ffd1-4b68-a2f7-f87a505c8cbb tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:46.266011 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-44af5132-ffd1-4b68-a2f7-f87a505c8cbb tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:46.266872 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-44af5132-ffd1-4b68-a2f7-f87a505c8cbb tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:46.325827 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-44af5132-ffd1-4b68-a2f7-f87a505c8cbb tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] [instance: 39d66e18-289f-4674-b66c-146d68ef9133] Going to try to terminate instance {{(pid=128802) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:47:46.497435 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-44af5132-ffd1-4b68-a2f7-f87a505c8cbb tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] 10.222.0.33 "DELETE /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133" status: 204 len: 0 microversion: 2.91 time: 0.245862 Oct 04 20:47:46.498667 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1624/3180] 10.222.0.33 () {60 vars in 1280 bytes} [Tue Oct 4 20:47:46 2022] DELETE /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 20:47:46.516630 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-f0646bed-53d0-4210-a475-bc4ddbe83e83 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:46.522970 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-f0646bed-53d0-4210-a475-bc4ddbe83e83 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] [instance: 041f0f59-75c7-4d01-bc99-77cb871f0fef] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:46.546975 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f0646bed-53d0-4210-a475-bc4ddbe83e83 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:46.549362 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f0646bed-53d0-4210-a475-bc4ddbe83e83 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:46.552390 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f0646bed-53d0-4210-a475-bc4ddbe83e83 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:46.558866 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f0646bed-53d0-4210-a475-bc4ddbe83e83 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:46.560044 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f0646bed-53d0-4210-a475-bc4ddbe83e83 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:46.560736 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f0646bed-53d0-4210-a475-bc4ddbe83e83 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:46.598522 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:47:46.647656 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-13cef430-ad38-4f8c-9bb8-601568b39452 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac650232cc04810b1340dc2f0edadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b0670d1bd99424780a70e69d57a2166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:46.663530 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-13cef430-ad38-4f8c-9bb8-601568b39452 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "GET /compute/v2.1/servers/fde3f6fc-61e1-4b21-8b91-e95c2db3d48c" status: 200 len: 1513 microversion: 2.1 time: 0.515736 Oct 04 20:47:46.670740 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1557/3181] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:47:46 2022] GET /compute/v2.1/servers/fde3f6fc-61e1-4b21-8b91-e95c2db3d48c => generated 1513 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:47:46.683679 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-8d54aedf-10c3-44bf-8853-8e5d73f9375b req-b8e84973-57bc-4a7e-a712-8d9025914521 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0a14e22-0620-4912-9893-62974c80978a", "name": "network-vif-unplugged", "status": "completed", "tag": "dfc19e40-1e2b-4560-8ac7-cb603e8ca4ab"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:47:46.706526 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-8d54aedf-10c3-44bf-8853-8e5d73f9375b req-b8e84973-57bc-4a7e-a712-8d9025914521 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:46.707809 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-8d54aedf-10c3-44bf-8853-8e5d73f9375b req-b8e84973-57bc-4a7e-a712-8d9025914521 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:46.708523 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-8d54aedf-10c3-44bf-8853-8e5d73f9375b req-b8e84973-57bc-4a7e-a712-8d9025914521 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:46.741374 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-8d54aedf-10c3-44bf-8853-8e5d73f9375b req-b8e84973-57bc-4a7e-a712-8d9025914521 service nova] Creating event network-vif-unplugged:dfc19e40-1e2b-4560-8ac7-cb603e8ca4ab for instance c0a14e22-0620-4912-9893-62974c80978a on n-h1-854823-8 Oct 04 20:47:46.752785 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-8d54aedf-10c3-44bf-8853-8e5d73f9375b req-b8e84973-57bc-4a7e-a712-8d9025914521 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.080512 Oct 04 20:47:46.753407 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1558/3182] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:47:46 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:47:46.767217 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-802afed8-7691-417b-89cb-75b271e8474c tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:46.768199 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-802afed8-7691-417b-89cb-75b271e8474c tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] [instance: 40a02873-d2c2-42b7-a0b7-2b6125d490f3] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:46.783403 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-802afed8-7691-417b-89cb-75b271e8474c tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:46.784143 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-802afed8-7691-417b-89cb-75b271e8474c tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:46.785980 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-802afed8-7691-417b-89cb-75b271e8474c tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:46.787227 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-802afed8-7691-417b-89cb-75b271e8474c tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:46.790145 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-802afed8-7691-417b-89cb-75b271e8474c tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:46.790791 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-802afed8-7691-417b-89cb-75b271e8474c tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:47.252106 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-f0646bed-53d0-4210-a475-bc4ddbe83e83 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87dcc7baf63f4ae6bfe0a099adffd408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7097bc12179446f6a3e1fac8434d5c64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:47.261433 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-f0646bed-53d0-4210-a475-bc4ddbe83e83 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] 10.222.0.33 "GET /compute/v2.1/servers/041f0f59-75c7-4d01-bc99-77cb871f0fef" status: 200 len: 1509 microversion: 2.1 time: 0.761178 Oct 04 20:47:47.267412 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1625/3183] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:47:46 2022] GET /compute/v2.1/servers/041f0f59-75c7-4d01-bc99-77cb871f0fef => generated 1509 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:47:47.273096 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-ae7c12a0-6dcc-4d4f-9308-90a5ee08e8fc req-3d80f6e1-6141-4cea-92f4-84aa66bc2073 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40a02873-d2c2-42b7-a0b7-2b6125d490f3", "tag": "ab3cba0a-dc15-4028-b7e0-d50faae0a9e5"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:47:47.301970 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-ae7c12a0-6dcc-4d4f-9308-90a5ee08e8fc req-3d80f6e1-6141-4cea-92f4-84aa66bc2073 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:47.310289 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-ae7c12a0-6dcc-4d4f-9308-90a5ee08e8fc req-3d80f6e1-6141-4cea-92f4-84aa66bc2073 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:47.310874 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-ae7c12a0-6dcc-4d4f-9308-90a5ee08e8fc req-3d80f6e1-6141-4cea-92f4-84aa66bc2073 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:47.332872 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-ae7c12a0-6dcc-4d4f-9308-90a5ee08e8fc req-3d80f6e1-6141-4cea-92f4-84aa66bc2073 service nova] Creating event network-changed:ab3cba0a-dc15-4028-b7e0-d50faae0a9e5 for instance 40a02873-d2c2-42b7-a0b7-2b6125d490f3 on n-h1-854823-8 Oct 04 20:47:47.337795 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-ae7c12a0-6dcc-4d4f-9308-90a5ee08e8fc req-3d80f6e1-6141-4cea-92f4-84aa66bc2073 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068940 Oct 04 20:47:47.339708 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1626/3184] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:47:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:47:47.347414 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-1ba244ee-e2f4-4a05-bb3a-9c844fc35056 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:47.348473 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-1ba244ee-e2f4-4a05-bb3a-9c844fc35056 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] [instance: 39d66e18-289f-4674-b66c-146d68ef9133] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:47.351544 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-802afed8-7691-417b-89cb-75b271e8474c tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6775b9d82b3444f6b728736f1d2b2806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5338cf2146344042bc263bdc4f9d822b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:47.355480 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1ba244ee-e2f4-4a05-bb3a-9c844fc35056 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:47.356271 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1ba244ee-e2f4-4a05-bb3a-9c844fc35056 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:47.357356 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1ba244ee-e2f4-4a05-bb3a-9c844fc35056 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:47.358304 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1ba244ee-e2f4-4a05-bb3a-9c844fc35056 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:47.359023 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1ba244ee-e2f4-4a05-bb3a-9c844fc35056 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:47.359696 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1ba244ee-e2f4-4a05-bb3a-9c844fc35056 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:47.375251 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-802afed8-7691-417b-89cb-75b271e8474c tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] 10.222.0.33 "GET /compute/v2.1/servers/40a02873-d2c2-42b7-a0b7-2b6125d490f3" status: 200 len: 1315 microversion: 2.1 time: 0.620341 Oct 04 20:47:47.380195 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1559/3185] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:47:46 2022] GET /compute/v2.1/servers/40a02873-d2c2-42b7-a0b7-2b6125d490f3 => generated 1315 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:47:47.397612 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-eb1ee247-8a31-4c83-ac48-7c66026bfad8 req-e726dd66-7339-4ba8-bb6d-ef090f2df83a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0a14e22-0620-4912-9893-62974c80978a", "name": "network-vif-deleted", "tag": "6a2a59c6-7fc0-4c9d-9f8a-2a71aff6748a"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:47:47.412862 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-eb1ee247-8a31-4c83-ac48-7c66026bfad8 req-e726dd66-7339-4ba8-bb6d-ef090f2df83a service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:47.413603 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-eb1ee247-8a31-4c83-ac48-7c66026bfad8 req-e726dd66-7339-4ba8-bb6d-ef090f2df83a service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:47.414619 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-eb1ee247-8a31-4c83-ac48-7c66026bfad8 req-e726dd66-7339-4ba8-bb6d-ef090f2df83a service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:47.431659 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-eb1ee247-8a31-4c83-ac48-7c66026bfad8 req-e726dd66-7339-4ba8-bb6d-ef090f2df83a service nova] Creating event network-vif-deleted:6a2a59c6-7fc0-4c9d-9f8a-2a71aff6748a for instance c0a14e22-0620-4912-9893-62974c80978a on n-h1-854823-8 Oct 04 20:47:47.437233 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-eb1ee247-8a31-4c83-ac48-7c66026bfad8 req-e726dd66-7339-4ba8-bb6d-ef090f2df83a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054125 Oct 04 20:47:47.438455 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1560/3186] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:47:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:47:47.446173 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8cafcf1c-38a5-4871-94d2-00fef12e6c6c tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:47.447090 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-8cafcf1c-38a5-4871-94d2-00fef12e6c6c tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] [instance: 7bbbbf6d-9e62-426b-85b4-d523110a05ef] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:47.455287 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8cafcf1c-38a5-4871-94d2-00fef12e6c6c tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:47.456446 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8cafcf1c-38a5-4871-94d2-00fef12e6c6c tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:47.457170 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8cafcf1c-38a5-4871-94d2-00fef12e6c6c tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:47.458129 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8cafcf1c-38a5-4871-94d2-00fef12e6c6c tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:47.458804 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8cafcf1c-38a5-4871-94d2-00fef12e6c6c tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:47.459233 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8cafcf1c-38a5-4871-94d2-00fef12e6c6c tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:47.467510 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-1ba244ee-e2f4-4a05-bb3a-9c844fc35056 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:47.476884 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-1ba244ee-e2f4-4a05-bb3a-9c844fc35056 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:47.479288 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-1ba244ee-e2f4-4a05-bb3a-9c844fc35056 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:47.485238 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-1ba244ee-e2f4-4a05-bb3a-9c844fc35056 tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] 10.222.0.33 "GET /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133" status: 200 len: 1539 microversion: 2.91 time: 0.143631 Oct 04 20:47:47.501508 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8cafcf1c-38a5-4871-94d2-00fef12e6c6c tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:47.501508 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8cafcf1c-38a5-4871-94d2-00fef12e6c6c tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:47.501856 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1627/3187] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:47:47 2022] GET /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133 => generated 1539 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:47:47.501957 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8cafcf1c-38a5-4871-94d2-00fef12e6c6c tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:47.501957 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-8cafcf1c-38a5-4871-94d2-00fef12e6c6c tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lazy-loading 'fault' on Instance uuid 7bbbbf6d-9e62-426b-85b4-d523110a05ef {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:47:47.508242 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-bd026800-bcf0-425a-8669-d2d645c08916 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Calling method '.version_select at 0x7f3c789059d0>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:47.548034 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-8cafcf1c-38a5-4871-94d2-00fef12e6c6c tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12dc6570db03431187680f51349e55d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91111396aabd4306b66e14b5abd822ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:47.559231 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-8cafcf1c-38a5-4871-94d2-00fef12e6c6c tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] 10.222.0.33 "GET /compute/v2.1/servers/7bbbbf6d-9e62-426b-85b4-d523110a05ef" status: 200 len: 1310 microversion: 2.1 time: 0.119254 Oct 04 20:47:47.560097 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1561/3188] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:47:47 2022] GET /compute/v2.1/servers/7bbbbf6d-9e62-426b-85b4-d523110a05ef => generated 1310 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:47:47.565886 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5fe71bf2-4714-4023-803f-f0d17cd51549 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:47.566699 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-5fe71bf2-4714-4023-803f-f0d17cd51549 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] [instance: c0a14e22-0620-4912-9893-62974c80978a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:47.568931 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-bd026800-bcf0-425a-8669-d2d645c08916 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] 10.222.0.33 "GET /compute/v2.1/images/802658f0-2596-4fe9-ad73-90b1f8423ede" status: 200 len: 1437 microversion: 2.1 time: 0.071614 Oct 04 20:47:47.569985 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1628/3189] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 20:47:47 2022] GET /compute/v2.1/images/802658f0-2596-4fe9-ad73-90b1f8423ede => generated 1437 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:47:47.574397 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5fe71bf2-4714-4023-803f-f0d17cd51549 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:47.575074 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5fe71bf2-4714-4023-803f-f0d17cd51549 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:47.575707 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5fe71bf2-4714-4023-803f-f0d17cd51549 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:47.576569 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5fe71bf2-4714-4023-803f-f0d17cd51549 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:47.577180 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5fe71bf2-4714-4023-803f-f0d17cd51549 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:47.577762 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5fe71bf2-4714-4023-803f-f0d17cd51549 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:47.695375 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-4c0a8605-962a-45b9-87eb-af2d38d81024 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:47.696398 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-4c0a8605-962a-45b9-87eb-af2d38d81024 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: fde3f6fc-61e1-4b21-8b91-e95c2db3d48c] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:47.703848 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4c0a8605-962a-45b9-87eb-af2d38d81024 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:47.704414 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4c0a8605-962a-45b9-87eb-af2d38d81024 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:47.705051 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4c0a8605-962a-45b9-87eb-af2d38d81024 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:47.706076 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4c0a8605-962a-45b9-87eb-af2d38d81024 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:47.706641 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4c0a8605-962a-45b9-87eb-af2d38d81024 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:47.707970 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4c0a8605-962a-45b9-87eb-af2d38d81024 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:47.884116 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-5fe71bf2-4714-4023-803f-f0d17cd51549 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28399882314945d787a3af6eb59935c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5392c67506f7445ab33d62b191558f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:47.893800 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-5fe71bf2-4714-4023-803f-f0d17cd51549 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28399882314945d787a3af6eb59935c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5392c67506f7445ab33d62b191558f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:47.899949 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-5fe71bf2-4714-4023-803f-f0d17cd51549 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28399882314945d787a3af6eb59935c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5392c67506f7445ab33d62b191558f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:47.901215 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5fe71bf2-4714-4023-803f-f0d17cd51549 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] 10.222.0.33 "GET /compute/v2.1/servers/c0a14e22-0620-4912-9893-62974c80978a" status: 200 len: 2864 microversion: 2.32 time: 0.340317 Oct 04 20:47:47.901777 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1562/3190] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:47:47 2022] GET /compute/v2.1/servers/c0a14e22-0620-4912-9893-62974c80978a => generated 2864 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:47:47.971409 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-4c0a8605-962a-45b9-87eb-af2d38d81024 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac650232cc04810b1340dc2f0edadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b0670d1bd99424780a70e69d57a2166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:47.979951 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-4c0a8605-962a-45b9-87eb-af2d38d81024 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "GET /compute/v2.1/servers/fde3f6fc-61e1-4b21-8b91-e95c2db3d48c" status: 200 len: 1513 microversion: 2.1 time: 0.292813 Oct 04 20:47:47.981179 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1629/3191] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:47:47 2022] GET /compute/v2.1/servers/fde3f6fc-61e1-4b21-8b91-e95c2db3d48c => generated 1513 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:47:48.297425 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5caffdd4-4ef0-41b3-9d06-14b32bfb8027 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:48.298489 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-5caffdd4-4ef0-41b3-9d06-14b32bfb8027 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] [instance: 041f0f59-75c7-4d01-bc99-77cb871f0fef] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:48.306211 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5caffdd4-4ef0-41b3-9d06-14b32bfb8027 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:48.306726 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5caffdd4-4ef0-41b3-9d06-14b32bfb8027 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:48.307157 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5caffdd4-4ef0-41b3-9d06-14b32bfb8027 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:48.307852 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5caffdd4-4ef0-41b3-9d06-14b32bfb8027 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:48.308487 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5caffdd4-4ef0-41b3-9d06-14b32bfb8027 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:48.308902 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5caffdd4-4ef0-41b3-9d06-14b32bfb8027 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:48.404056 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-a9312d38-56bf-4958-a0e3-c6da0c432e8b tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:48.405157 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-a9312d38-56bf-4958-a0e3-c6da0c432e8b tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] [instance: 40a02873-d2c2-42b7-a0b7-2b6125d490f3] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:48.412567 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a9312d38-56bf-4958-a0e3-c6da0c432e8b tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:48.414659 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a9312d38-56bf-4958-a0e3-c6da0c432e8b tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:48.415967 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a9312d38-56bf-4958-a0e3-c6da0c432e8b tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:48.417819 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a9312d38-56bf-4958-a0e3-c6da0c432e8b tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:48.418544 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a9312d38-56bf-4958-a0e3-c6da0c432e8b tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:48.419030 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a9312d38-56bf-4958-a0e3-c6da0c432e8b tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:48.592362 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-5caffdd4-4ef0-41b3-9d06-14b32bfb8027 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87dcc7baf63f4ae6bfe0a099adffd408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7097bc12179446f6a3e1fac8434d5c64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:48.608311 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5caffdd4-4ef0-41b3-9d06-14b32bfb8027 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] 10.222.0.33 "GET /compute/v2.1/servers/041f0f59-75c7-4d01-bc99-77cb871f0fef" status: 200 len: 1509 microversion: 2.1 time: 0.314864 Oct 04 20:47:48.608993 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1563/3192] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:47:48 2022] GET /compute/v2.1/servers/041f0f59-75c7-4d01-bc99-77cb871f0fef => generated 1509 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:47:48.615366 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-4f0b4d86-2b3d-4fcf-a9fb-37ec969fb69c tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:48.616264 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-4f0b4d86-2b3d-4fcf-a9fb-37ec969fb69c tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] [instance: 39d66e18-289f-4674-b66c-146d68ef9133] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:48.635373 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4f0b4d86-2b3d-4fcf-a9fb-37ec969fb69c tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:48.635966 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4f0b4d86-2b3d-4fcf-a9fb-37ec969fb69c tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:48.636479 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4f0b4d86-2b3d-4fcf-a9fb-37ec969fb69c tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:48.637280 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4f0b4d86-2b3d-4fcf-a9fb-37ec969fb69c tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:48.637817 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4f0b4d86-2b3d-4fcf-a9fb-37ec969fb69c tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:48.640316 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4f0b4d86-2b3d-4fcf-a9fb-37ec969fb69c tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:48.662807 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-a9312d38-56bf-4958-a0e3-c6da0c432e8b tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6775b9d82b3444f6b728736f1d2b2806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5338cf2146344042bc263bdc4f9d822b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:48.672191 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-a9312d38-56bf-4958-a0e3-c6da0c432e8b tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] 10.222.0.33 "GET /compute/v2.1/servers/40a02873-d2c2-42b7-a0b7-2b6125d490f3" status: 200 len: 1315 microversion: 2.1 time: 0.272320 Oct 04 20:47:48.673121 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1630/3193] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:47:48 2022] GET /compute/v2.1/servers/40a02873-d2c2-42b7-a0b7-2b6125d490f3 => generated 1315 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:47:48.686606 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-a60b48e2-a8ee-4299-bc5a-901ebc1aeb59 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Calling method '.version_select at 0x7f3c743d1430>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:48.758441 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-a60b48e2-a8ee-4299-bc5a-901ebc1aeb59 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] 10.222.0.33 "GET /compute/v2.1/images/802658f0-2596-4fe9-ad73-90b1f8423ede" status: 200 len: 1437 microversion: 2.1 time: 0.084015 Oct 04 20:47:48.759583 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1631/3194] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 20:47:48 2022] GET /compute/v2.1/images/802658f0-2596-4fe9-ad73-90b1f8423ede => generated 1437 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:47:48.773339 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-bac61d71-ffd2-4209-9b97-dce9e55d43de tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:48.774160 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-bac61d71-ffd2-4209-9b97-dce9e55d43de tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] [instance: 7bbbbf6d-9e62-426b-85b4-d523110a05ef] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:48.775563 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-4f0b4d86-2b3d-4fcf-a9fb-37ec969fb69c tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:48.781270 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bac61d71-ffd2-4209-9b97-dce9e55d43de tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:48.781971 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bac61d71-ffd2-4209-9b97-dce9e55d43de tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:48.782610 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bac61d71-ffd2-4209-9b97-dce9e55d43de tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:48.783474 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bac61d71-ffd2-4209-9b97-dce9e55d43de tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:48.784079 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bac61d71-ffd2-4209-9b97-dce9e55d43de tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:48.785140 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bac61d71-ffd2-4209-9b97-dce9e55d43de tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:48.793995 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-4f0b4d86-2b3d-4fcf-a9fb-37ec969fb69c tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:48.795828 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-4f0b4d86-2b3d-4fcf-a9fb-37ec969fb69c tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d4c5bb0cce64c54b7b02c35b0277e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19288828ae3341cdb3672abf6a1eed4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:48.802134 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-4f0b4d86-2b3d-4fcf-a9fb-37ec969fb69c tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] 10.222.0.33 "GET /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133" status: 200 len: 1539 microversion: 2.91 time: 0.191858 Oct 04 20:47:48.803119 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1564/3195] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:47:48 2022] GET /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133 => generated 1539 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:47:48.816784 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.wsgi [None req-bac61d71-ffd2-4209-9b97-dce9e55d43de tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] HTTP exception thrown: Instance 7bbbbf6d-9e62-426b-85b4-d523110a05ef could not be found. Oct 04 20:47:48.818791 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-bac61d71-ffd2-4209-9b97-dce9e55d43de tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Request method failure captured: Oct 04 20:47:48.818791 n-d-854823-8 devstack@n-api.service[128802]: request: GET /compute/v2.1/servers/7bbbbf6d-9e62-426b-85b4-d523110a05ef HTTP/1.1 Oct 04 20:47:48.818791 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 20:47:48.818791 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 20:47:48.818791 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 20:47:48.818791 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 0 Oct 04 20:47:48.818791 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 20:47:48.818791 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 20:47:48.818791 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 20:47:48.818791 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 20:47:48.818791 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPJuA25pY5gnij2GUImD-SeoqdUwrg36IJ00ci1xpid5rkQM_iu-hu9Kj4hz7bXCbbgwzkwDgSGrCuv5J0mFe0VOwO727nThjFElnHFGlINPkXZX80vX9nrbk5CSUaU0Wug41BK5JHF9vTIRe1sfED5uAcUvsrV9JrGz3UtCU4qQaKGU Oct 04 20:47:48.818791 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 20:47:48.818791 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 20:47:48.818791 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 20:47:48.818791 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 20:47:48.818791 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 20:47:48.818791 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 20:47:48.818791 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: 91111396aabd4306b66e14b5abd822ad Oct 04 20:47:48.818791 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-ListServerFiltersTestJSON-771158953 Oct 04 20:47:48.818791 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 20:47:48.818791 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 20:47:48.818791 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_91111396aabd4306b66e14b5abd822ad", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/91111396aabd4306b66e14b5abd822ad"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/91111396aabd4306b66e14b5abd822ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/91111396aabd4306b66e14b5abd822ad"}]}] Oct 04 20:47:48.818791 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-ListServerFiltersTestJSON-771158953 Oct 04 20:47:48.818791 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: 91111396aabd4306b66e14b5abd822ad Oct 04 20:47:48.818791 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-771158953 Oct 04 20:47:48.818791 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-ListServerFiltersTestJSON-771158953-project Oct 04 20:47:48.818791 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 20:47:48.818791 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 20:47:48.818791 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: 12dc6570db03431187680f51349e55d3 Oct 04 20:47:48.818791 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-ListServerFiltersTestJSON-771158953-project Oct 04 20:47:48.818791 n-d-854823-8 devstack@n-api.service[128802]: method: > Oct 04 20:47:48.818791 n-d-854823-8 devstack@n-api.service[128802]: exception: Instance 7bbbbf6d-9e62-426b-85b4-d523110a05ef could not be found. Oct 04 20:47:48.818791 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'id': '7bbbbf6d-9e62-426b-85b4-d523110a05ef'} Oct 04 20:47:48.818791 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:47:48.818791 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:47:48.818791 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:47:48.818791 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:47:48.818791 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:47:48.818791 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:47:48.818791 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:47:48.818791 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:47:48.818791 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:47:48.818791 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:47:48.818791 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7bbbbf6d-9e62-426b-85b4-d523110a05ef could not be found. Oct 04 20:47:48.818791 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:47:48.818791 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:47:48.818791 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:47:48.818791 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:47:48.818791 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:47:48.818791 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:47:48.818791 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:47:48.818791 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:47:48.818791 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:47:48.818791 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:47:48.818791 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:47:48.818791 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:47:48.818791 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:47:48.818791 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:47:48.818791 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:47:48.818791 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:47:48.818791 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7bbbbf6d-9e62-426b-85b4-d523110a05ef could not be found. Oct 04 20:47:48.818791 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:47:48.818791 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:47:48.818791 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:47:48.822784 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:47:48.822784 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:47:48.822784 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:47:48.822784 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:47:48.822784 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:47:48.822784 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7bbbbf6d-9e62-426b-85b4-d523110a05ef could not be found. Oct 04 20:47:48.822784 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:47:48.824426 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-bac61d71-ffd2-4209-9b97-dce9e55d43de tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Returning 404 to user: Instance 7bbbbf6d-9e62-426b-85b4-d523110a05ef could not be found. {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:47:48.825624 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-bac61d71-ffd2-4209-9b97-dce9e55d43de tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] 10.222.0.33 "GET /compute/v2.1/servers/7bbbbf6d-9e62-426b-85b4-d523110a05ef" status: 404 len: 111 microversion: 2.1 time: 0.064957 Oct 04 20:47:48.827580 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1632/3196] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:47:48 2022] GET /compute/v2.1/servers/7bbbbf6d-9e62-426b-85b4-d523110a05ef => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:47:48.835363 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-72bebcd9-59d3-42f6-a06e-f490d1168ad3 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:48.838891 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-72bebcd9-59d3-42f6-a06e-f490d1168ad3 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] [instance: 39e846c1-6876-42ef-b290-f733516e1051] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:48.844920 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-aa800932-8472-4639-8b08-c91c669ead81 req-41cd9a22-a696-4d17-9909-82f3012e66ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0a14e22-0620-4912-9893-62974c80978a", "name": "network-vif-unplugged", "status": "completed", "tag": "06028cc3-2b0b-4175-9579-b3aaf701fc68"}, {"server_uuid": "c0a14e22-0620-4912-9893-62974c80978a", "name": "network-vif-unplugged", "status": "completed", "tag": "3aae6729-b226-4156-a8f1-4164c26d5309"}, {"server_uuid": "c0a14e22-0620-4912-9893-62974c80978a", "name": "network-vif-unplugged", "status": "completed", "tag": "5f2c3d14-997c-4225-a9eb-1379adba5e6c"}, {"server_uuid": "8e0006b2-ed59-4ad1-a921-d1db19cb97b6", "name": "network-vif-plugged", "status": "completed", "tag": "dc42a420-def0-4262-941b-1c282e275581"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:47:48.849349 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-72bebcd9-59d3-42f6-a06e-f490d1168ad3 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:48.850620 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-72bebcd9-59d3-42f6-a06e-f490d1168ad3 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:48.851293 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-72bebcd9-59d3-42f6-a06e-f490d1168ad3 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:48.852043 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-72bebcd9-59d3-42f6-a06e-f490d1168ad3 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:48.852607 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-72bebcd9-59d3-42f6-a06e-f490d1168ad3 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:48.853758 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-72bebcd9-59d3-42f6-a06e-f490d1168ad3 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:48.858802 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-aa800932-8472-4639-8b08-c91c669ead81 req-41cd9a22-a696-4d17-9909-82f3012e66ad service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:48.859470 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-aa800932-8472-4639-8b08-c91c669ead81 req-41cd9a22-a696-4d17-9909-82f3012e66ad service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:48.860041 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-aa800932-8472-4639-8b08-c91c669ead81 req-41cd9a22-a696-4d17-9909-82f3012e66ad service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:48.875285 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-aa800932-8472-4639-8b08-c91c669ead81 req-41cd9a22-a696-4d17-9909-82f3012e66ad service nova] Creating event network-vif-unplugged:06028cc3-2b0b-4175-9579-b3aaf701fc68 for instance c0a14e22-0620-4912-9893-62974c80978a on n-h1-854823-8 Oct 04 20:47:48.876212 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-aa800932-8472-4639-8b08-c91c669ead81 req-41cd9a22-a696-4d17-9909-82f3012e66ad service nova] Creating event network-vif-unplugged:3aae6729-b226-4156-a8f1-4164c26d5309 for instance c0a14e22-0620-4912-9893-62974c80978a on n-h1-854823-8 Oct 04 20:47:48.876901 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-aa800932-8472-4639-8b08-c91c669ead81 req-41cd9a22-a696-4d17-9909-82f3012e66ad service nova] Creating event network-vif-unplugged:5f2c3d14-997c-4225-a9eb-1379adba5e6c for instance c0a14e22-0620-4912-9893-62974c80978a on n-h1-854823-8 Oct 04 20:47:48.877672 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-aa800932-8472-4639-8b08-c91c669ead81 req-41cd9a22-a696-4d17-9909-82f3012e66ad service nova] Creating event network-vif-plugged:dc42a420-def0-4262-941b-1c282e275581 for instance 8e0006b2-ed59-4ad1-a921-d1db19cb97b6 on n-h2-854823-8 Oct 04 20:47:48.886332 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-72bebcd9-59d3-42f6-a06e-f490d1168ad3 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] [instance: 39e846c1-6876-42ef-b290-f733516e1051] Going to try to terminate instance {{(pid=128801) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:47:48.887657 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-aa800932-8472-4639-8b08-c91c669ead81 req-41cd9a22-a696-4d17-9909-82f3012e66ad service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 702 microversion: 2.1 time: 0.050839 Oct 04 20:47:48.888285 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1633/3197] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:47:48 2022] POST /compute/v2.1/os-server-external-events => generated 702 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:47:48.930320 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-591c0578-ace7-4d36-932e-4ad6e1800108 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:48.931084 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-591c0578-ace7-4d36-932e-4ad6e1800108 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] [instance: c0a14e22-0620-4912-9893-62974c80978a] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:48.946967 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-591c0578-ace7-4d36-932e-4ad6e1800108 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:48.947463 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-591c0578-ace7-4d36-932e-4ad6e1800108 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:48.947885 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-591c0578-ace7-4d36-932e-4ad6e1800108 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:48.948601 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-591c0578-ace7-4d36-932e-4ad6e1800108 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:48.949055 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-591c0578-ace7-4d36-932e-4ad6e1800108 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:48.949548 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-591c0578-ace7-4d36-932e-4ad6e1800108 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:48.952652 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:47:49.015195 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:47:49.026769 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-72bebcd9-59d3-42f6-a06e-f490d1168ad3 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] 10.222.0.33 "DELETE /compute/v2.1/servers/39e846c1-6876-42ef-b290-f733516e1051" status: 204 len: 0 microversion: 2.1 time: 0.195784 Oct 04 20:47:49.028080 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1565/3198] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 20:47:48 2022] DELETE /compute/v2.1/servers/39e846c1-6876-42ef-b290-f733516e1051 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:47:49.033627 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c75cd07f-a939-4c29-a1fd-9a98936ba3ef tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:49.035797 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c75cd07f-a939-4c29-a1fd-9a98936ba3ef tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: fde3f6fc-61e1-4b21-8b91-e95c2db3d48c] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:49.045292 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c75cd07f-a939-4c29-a1fd-9a98936ba3ef tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:49.046032 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c75cd07f-a939-4c29-a1fd-9a98936ba3ef tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:49.046678 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c75cd07f-a939-4c29-a1fd-9a98936ba3ef tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:49.051645 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c75cd07f-a939-4c29-a1fd-9a98936ba3ef tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:49.052363 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c75cd07f-a939-4c29-a1fd-9a98936ba3ef tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:49.052992 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c75cd07f-a939-4c29-a1fd-9a98936ba3ef tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:49.256061 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-591c0578-ace7-4d36-932e-4ad6e1800108 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28399882314945d787a3af6eb59935c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5392c67506f7445ab33d62b191558f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:49.274203 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-591c0578-ace7-4d36-932e-4ad6e1800108 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28399882314945d787a3af6eb59935c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5392c67506f7445ab33d62b191558f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:49.275930 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-591c0578-ace7-4d36-932e-4ad6e1800108 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28399882314945d787a3af6eb59935c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5392c67506f7445ab33d62b191558f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:49.277215 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-591c0578-ace7-4d36-932e-4ad6e1800108 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] 10.222.0.33 "GET /compute/v2.1/servers/c0a14e22-0620-4912-9893-62974c80978a" status: 200 len: 2703 microversion: 2.32 time: 0.352311 Oct 04 20:47:49.279883 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1634/3199] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:47:48 2022] GET /compute/v2.1/servers/c0a14e22-0620-4912-9893-62974c80978a => generated 2703 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:47:49.305113 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-7d625d60-0bfa-48d4-86a0-30326efa6cac tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:49.305997 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-7d625d60-0bfa-48d4-86a0-30326efa6cac tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] [instance: 39e846c1-6876-42ef-b290-f733516e1051] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:49.311019 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c75cd07f-a939-4c29-a1fd-9a98936ba3ef tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac650232cc04810b1340dc2f0edadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b0670d1bd99424780a70e69d57a2166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:49.322795 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c75cd07f-a939-4c29-a1fd-9a98936ba3ef tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "GET /compute/v2.1/servers/fde3f6fc-61e1-4b21-8b91-e95c2db3d48c" status: 200 len: 1513 microversion: 2.1 time: 0.293242 Oct 04 20:47:49.328764 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7d625d60-0bfa-48d4-86a0-30326efa6cac tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:49.332690 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7d625d60-0bfa-48d4-86a0-30326efa6cac tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:49.333684 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7d625d60-0bfa-48d4-86a0-30326efa6cac tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:49.335147 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7d625d60-0bfa-48d4-86a0-30326efa6cac tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:49.339248 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7d625d60-0bfa-48d4-86a0-30326efa6cac tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:49.343520 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1566/3200] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:47:49 2022] GET /compute/v2.1/servers/fde3f6fc-61e1-4b21-8b91-e95c2db3d48c => generated 1513 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:47:49.344335 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7d625d60-0bfa-48d4-86a0-30326efa6cac tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:49.464756 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-ab252c5d-edf5-4eef-b171-84797bef650c req-32c51e61-799d-47b5-b940-6c9ab20fe88e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7bbbbf6d-9e62-426b-85b4-d523110a05ef", "name": "network-vif-deleted", "tag": "7fcf08a9-d9e7-40ee-b109-178e0b1acd57"}, {"server_uuid": "c0a14e22-0620-4912-9893-62974c80978a", "name": "network-vif-deleted", "tag": "06028cc3-2b0b-4175-9579-b3aaf701fc68"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:47:49.483429 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-ab252c5d-edf5-4eef-b171-84797bef650c req-32c51e61-799d-47b5-b940-6c9ab20fe88e service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:49.485042 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-ab252c5d-edf5-4eef-b171-84797bef650c req-32c51e61-799d-47b5-b940-6c9ab20fe88e service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:49.485680 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-ab252c5d-edf5-4eef-b171-84797bef650c req-32c51e61-799d-47b5-b940-6c9ab20fe88e service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:49.508188 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-ab252c5d-edf5-4eef-b171-84797bef650c req-32c51e61-799d-47b5-b940-6c9ab20fe88e service nova] Creating event network-vif-deleted:7fcf08a9-d9e7-40ee-b109-178e0b1acd57 for instance 7bbbbf6d-9e62-426b-85b4-d523110a05ef on n-h2-854823-8 Oct 04 20:47:49.519074 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-ab252c5d-edf5-4eef-b171-84797bef650c req-32c51e61-799d-47b5-b940-6c9ab20fe88e service nova] Creating event network-vif-deleted:06028cc3-2b0b-4175-9579-b3aaf701fc68 for instance c0a14e22-0620-4912-9893-62974c80978a on n-h1-854823-8 Oct 04 20:47:49.544592 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-ab252c5d-edf5-4eef-b171-84797bef650c req-32c51e61-799d-47b5-b940-6c9ab20fe88e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.088784 Oct 04 20:47:49.547628 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1567/3201] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:47:49 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:47:49.633934 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a9e5a35b-8b07-4b5d-9c63-351a5e5a58bb tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:49.635571 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a9e5a35b-8b07-4b5d-9c63-351a5e5a58bb tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] [instance: 041f0f59-75c7-4d01-bc99-77cb871f0fef] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:49.639169 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-7d625d60-0bfa-48d4-86a0-30326efa6cac tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12dc6570db03431187680f51349e55d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91111396aabd4306b66e14b5abd822ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:49.658004 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-7d625d60-0bfa-48d4-86a0-30326efa6cac tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] 10.222.0.33 "GET /compute/v2.1/servers/39e846c1-6876-42ef-b290-f733516e1051" status: 200 len: 1517 microversion: 2.1 time: 0.376657 Oct 04 20:47:49.661114 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1635/3202] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:47:49 2022] GET /compute/v2.1/servers/39e846c1-6876-42ef-b290-f733516e1051 => generated 1517 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:47:49.669321 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a9e5a35b-8b07-4b5d-9c63-351a5e5a58bb tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:49.671505 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a9e5a35b-8b07-4b5d-9c63-351a5e5a58bb tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:49.672002 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a9e5a35b-8b07-4b5d-9c63-351a5e5a58bb tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:49.673916 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a9e5a35b-8b07-4b5d-9c63-351a5e5a58bb tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:49.674732 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a9e5a35b-8b07-4b5d-9c63-351a5e5a58bb tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:49.676694 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a9e5a35b-8b07-4b5d-9c63-351a5e5a58bb tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:49.699617 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-9df3116b-7a7a-4c2c-9469-534202e06857 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:49.700579 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-9df3116b-7a7a-4c2c-9469-534202e06857 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] [instance: 40a02873-d2c2-42b7-a0b7-2b6125d490f3] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:49.724814 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9df3116b-7a7a-4c2c-9469-534202e06857 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:49.725625 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9df3116b-7a7a-4c2c-9469-534202e06857 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:49.726433 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9df3116b-7a7a-4c2c-9469-534202e06857 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:49.727607 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9df3116b-7a7a-4c2c-9469-534202e06857 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:49.728751 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9df3116b-7a7a-4c2c-9469-534202e06857 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:49.730722 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9df3116b-7a7a-4c2c-9469-534202e06857 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:49.956112 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:47:50.647959 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=8 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:47:50.715224 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-9df3116b-7a7a-4c2c-9469-534202e06857 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6775b9d82b3444f6b728736f1d2b2806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5338cf2146344042bc263bdc4f9d822b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:50.727276 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-9df3116b-7a7a-4c2c-9469-534202e06857 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] 10.222.0.33 "GET /compute/v2.1/servers/40a02873-d2c2-42b7-a0b7-2b6125d490f3" status: 200 len: 1315 microversion: 2.1 time: 1.033338 Oct 04 20:47:50.727886 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1636/3203] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:47:49 2022] GET /compute/v2.1/servers/40a02873-d2c2-42b7-a0b7-2b6125d490f3 => generated 1315 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:47:50.734886 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-2e23f045-e55c-4ff4-b628-da078941be92 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Calling method '.version_select at 0x7f3c7428b4c0>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:50.754672 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-a9e5a35b-8b07-4b5d-9c63-351a5e5a58bb tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87dcc7baf63f4ae6bfe0a099adffd408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7097bc12179446f6a3e1fac8434d5c64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:50.763454 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a9e5a35b-8b07-4b5d-9c63-351a5e5a58bb tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] 10.222.0.33 "GET /compute/v2.1/servers/041f0f59-75c7-4d01-bc99-77cb871f0fef" status: 200 len: 1509 microversion: 2.1 time: 1.134451 Oct 04 20:47:50.778372 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1568/3204] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:47:49 2022] GET /compute/v2.1/servers/041f0f59-75c7-4d01-bc99-77cb871f0fef => generated 1509 bytes in 1136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:47:50.778372 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e7e4812d-2fe3-4941-9b57-0f308e5ddfbe tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:50.778372 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e7e4812d-2fe3-4941-9b57-0f308e5ddfbe tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] [instance: 39d66e18-289f-4674-b66c-146d68ef9133] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:50.779946 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e7e4812d-2fe3-4941-9b57-0f308e5ddfbe tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:50.780935 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e7e4812d-2fe3-4941-9b57-0f308e5ddfbe tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:50.782506 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e7e4812d-2fe3-4941-9b57-0f308e5ddfbe tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:50.786577 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e7e4812d-2fe3-4941-9b57-0f308e5ddfbe tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:50.787364 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e7e4812d-2fe3-4941-9b57-0f308e5ddfbe tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:50.787914 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e7e4812d-2fe3-4941-9b57-0f308e5ddfbe tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:50.809685 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-e7e4812d-2fe3-4941-9b57-0f308e5ddfbe tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] HTTP exception thrown: Instance 39d66e18-289f-4674-b66c-146d68ef9133 could not be found. Oct 04 20:47:50.811690 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e7e4812d-2fe3-4941-9b57-0f308e5ddfbe tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Request method failure captured: Oct 04 20:47:50.811690 n-d-854823-8 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133 HTTP/1.1 Oct 04 20:47:50.811690 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:47:50.811690 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:47:50.811690 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:47:50.811690 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 0 Oct 04 20:47:50.811690 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:47:50.811690 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:47:50.811690 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:47:50.811690 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:47:50.811690 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJs5WszYhn4Nl3ZajLXA4NYVpw2DXa6xbQxx4-EmwMGca3iKaFlgPNUsgM8X7wKsahS4-1dYqPl6O8Vit7cZzbWrpGpK7sTBYZ3yUAb5s3JWnPoOCG7kPhJfyzvOeXpHa1bbS5FDgZul01HrjFhcpczdgQYj1-Ap2Y0lRi_TjX6t4Vs Oct 04 20:47:50.811690 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:47:50.811690 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:47:50.811690 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:47:50.811690 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:47:50.811690 n-d-854823-8 devstack@n-api.service[128801]: X-Openstack-Nova-Api-Version: 2.91 Oct 04 20:47:50.811690 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:47:50.811690 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:47:50.811690 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: 19288828ae3341cdb3672abf6a1eed4f Oct 04 20:47:50.811690 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-UnshelveToHostMultiNodesTest-932586261 Oct 04 20:47:50.811690 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 20:47:50.811690 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 20:47:50.811690 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_19288828ae3341cdb3672abf6a1eed4f", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/19288828ae3341cdb3672abf6a1eed4f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/19288828ae3341cdb3672abf6a1eed4f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/19288828ae3341cdb3672abf6a1eed4f"}]}] Oct 04 20:47:50.811690 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-UnshelveToHostMultiNodesTest-932586261 Oct 04 20:47:50.811690 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: 19288828ae3341cdb3672abf6a1eed4f Oct 04 20:47:50.811690 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-UnshelveToHostMultiNodesTest-932586261 Oct 04 20:47:50.811690 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-UnshelveToHostMultiNodesTest-932586261-project Oct 04 20:47:50.811690 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:47:50.811690 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:47:50.811690 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: 3d4c5bb0cce64c54b7b02c35b0277e7b Oct 04 20:47:50.811690 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-UnshelveToHostMultiNodesTest-932586261-project Oct 04 20:47:50.811690 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 20:47:50.811690 n-d-854823-8 devstack@n-api.service[128801]: exception: Instance 39d66e18-289f-4674-b66c-146d68ef9133 could not be found. Oct 04 20:47:50.811690 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': '39d66e18-289f-4674-b66c-146d68ef9133'} Oct 04 20:47:50.811690 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:47:50.811690 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:47:50.811690 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:47:50.811690 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:47:50.811690 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:47:50.811690 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:47:50.811690 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:47:50.811690 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:47:50.811690 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:47:50.811690 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:47:50.811690 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 39d66e18-289f-4674-b66c-146d68ef9133 could not be found. Oct 04 20:47:50.811690 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:47:50.811690 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:47:50.811690 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:47:50.811690 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:47:50.811690 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:47:50.811690 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:47:50.811690 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:47:50.811690 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:47:50.811690 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:47:50.811690 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:47:50.811690 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:47:50.811690 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:47:50.811690 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:47:50.811690 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:47:50.811690 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:47:50.811690 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:47:50.811690 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 39d66e18-289f-4674-b66c-146d68ef9133 could not be found. Oct 04 20:47:50.811690 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:47:50.811690 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:47:50.816662 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:47:50.816662 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:47:50.816662 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:47:50.816662 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:47:50.816662 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:47:50.816662 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:47:50.816662 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 39d66e18-289f-4674-b66c-146d68ef9133 could not be found. Oct 04 20:47:50.816662 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:47:50.820851 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e7e4812d-2fe3-4941-9b57-0f308e5ddfbe tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] Returning 404 to user: Instance 39d66e18-289f-4674-b66c-146d68ef9133 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:47:50.822137 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e7e4812d-2fe3-4941-9b57-0f308e5ddfbe tempest-UnshelveToHostMultiNodesTest-932586261 tempest-UnshelveToHostMultiNodesTest-932586261-project] 10.222.0.33 "GET /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133" status: 404 len: 111 microversion: 2.91 time: 0.056051 Oct 04 20:47:50.825587 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-2e23f045-e55c-4ff4-b628-da078941be92 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] 10.222.0.33 "GET /compute/v2.1/images/802658f0-2596-4fe9-ad73-90b1f8423ede" status: 200 len: 1437 microversion: 2.1 time: 0.095328 Oct 04 20:47:50.826576 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1637/3205] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 20:47:50 2022] GET /compute/v2.1/images/802658f0-2596-4fe9-ad73-90b1f8423ede => generated 1437 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:47:50.838126 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-1f07bc25-0480-4037-abbb-a5071ffd425d tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b23a03a5-4bb4-4f6d-a4d9-0d451bd6740f"}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:47:50.842392 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1569/3206] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:47:50 2022] GET /compute/v2.1/servers/39d66e18-289f-4674-b66c-146d68ef9133 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 20:47:50.848135 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-1f07bc25-0480-4037-abbb-a5071ffd425d tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] [instance: c703a086-cf9d-4d12-8a18-623e454bcb64] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:50.852219 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7493fb7e-9396-4735-af38-d0588e9c56b2 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:50.853011 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-7493fb7e-9396-4735-af38-d0588e9c56b2 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] [instance: c0a14e22-0620-4912-9893-62974c80978a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:50.861507 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7493fb7e-9396-4735-af38-d0588e9c56b2 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:50.862224 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7493fb7e-9396-4735-af38-d0588e9c56b2 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:50.862880 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7493fb7e-9396-4735-af38-d0588e9c56b2 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:50.864343 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7493fb7e-9396-4735-af38-d0588e9c56b2 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:50.865393 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7493fb7e-9396-4735-af38-d0588e9c56b2 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:50.865995 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7493fb7e-9396-4735-af38-d0588e9c56b2 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:50.868776 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1f07bc25-0480-4037-abbb-a5071ffd425d tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:50.871371 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1f07bc25-0480-4037-abbb-a5071ffd425d tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:50.872523 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1f07bc25-0480-4037-abbb-a5071ffd425d tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:50.875847 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1f07bc25-0480-4037-abbb-a5071ffd425d tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:50.876636 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1f07bc25-0480-4037-abbb-a5071ffd425d tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:50.877229 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1f07bc25-0480-4037-abbb-a5071ffd425d tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:51.055627 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.wsgi [None req-1f07bc25-0480-4037-abbb-a5071ffd425d tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] HTTP exception thrown: Invalid volume: volume b23a03a5-4bb4-4f6d-a4d9-0d451bd6740f is already attached to instances: c703a086-cf9d-4d12-8a18-623e454bcb64 Oct 04 20:47:51.063300 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-1f07bc25-0480-4037-abbb-a5071ffd425d tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Request method failure captured: Oct 04 20:47:51.063300 n-d-854823-8 devstack@n-api.service[128802]: request: POST /compute/v2.1/servers/c703a086-cf9d-4d12-8a18-623e454bcb64/os-volume_attachments HTTP/1.1 Oct 04 20:47:51.063300 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 20:47:51.063300 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 20:47:51.063300 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 20:47:51.063300 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 74 Oct 04 20:47:51.063300 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 20:47:51.063300 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 20:47:51.063300 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 20:47:51.063300 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 20:47:51.063300 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPJq81PAuDsDZpxdj7sHNmNgvbOtGh6iX1oPKSmvHZUw9x7ULWvp7QM5iDniQ-MHWL89bpVZnLKWftCcZuFrmOzCFwz5uJr5u54napWSUn77riQgg7pFlU7FKzu5ArjbUA7EV4GWtihdoiqsY9U5RhjRJWZh-5HATJMChglPcLjaAY6g Oct 04 20:47:51.063300 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 20:47:51.063300 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 20:47:51.063300 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 20:47:51.063300 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 20:47:51.063300 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 20:47:51.063300 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 20:47:51.063300 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: fc7f38600b5041ad8e66a12d77b940fa Oct 04 20:47:51.063300 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-AttachVolumeNegativeTest-16853026 Oct 04 20:47:51.063300 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 20:47:51.063300 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 20:47:51.063300 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_fc7f38600b5041ad8e66a12d77b940fa", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fc7f38600b5041ad8e66a12d77b940fa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fc7f38600b5041ad8e66a12d77b940fa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/fc7f38600b5041ad8e66a12d77b940fa"}]}] Oct 04 20:47:51.063300 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-AttachVolumeNegativeTest-16853026 Oct 04 20:47:51.063300 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: fc7f38600b5041ad8e66a12d77b940fa Oct 04 20:47:51.063300 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-16853026 Oct 04 20:47:51.063300 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-AttachVolumeNegativeTest-16853026-project Oct 04 20:47:51.063300 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 20:47:51.063300 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 20:47:51.063300 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: d9e4b00964014a0383f79597652bd428 Oct 04 20:47:51.063300 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-AttachVolumeNegativeTest-16853026-project Oct 04 20:47:51.063300 n-d-854823-8 devstack@n-api.service[128802]: Oct 04 20:47:51.063300 n-d-854823-8 devstack@n-api.service[128802]: {"volumeAttachment": {"volumeId": "b23a03a5-4bb4-4f6d-a4d9-0d451bd6740f"}} Oct 04 20:47:51.063300 n-d-854823-8 devstack@n-api.service[128802]: method: > Oct 04 20:47:51.063300 n-d-854823-8 devstack@n-api.service[128802]: exception: Invalid volume: volume b23a03a5-4bb4-4f6d-a4d9-0d451bd6740f is already attached to instances: c703a086-cf9d-4d12-8a18-623e454bcb64 Oct 04 20:47:51.063300 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'server_id': 'c703a086-cf9d-4d12-8a18-623e454bcb64', 'body': {'volumeAttachment': {'volumeId': 'b23a03a5-4bb4-4f6d-a4d9-0d451bd6740f'}}} Oct 04 20:47:51.063300 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:47:51.063300 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:47:51.063300 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 04 20:47:51.063300 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 04 20:47:51.063300 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 20:47:51.063300 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 20:47:51.063300 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 04 20:47:51.063300 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 04 20:47:51.063300 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 04 20:47:51.063300 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 04 20:47:51.063300 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 04 20:47:51.063300 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 04 20:47:51.063300 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume b23a03a5-4bb4-4f6d-a4d9-0d451bd6740f is already attached to instances: c703a086-cf9d-4d12-8a18-623e454bcb64 Oct 04 20:47:51.063300 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:47:51.063300 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:47:51.063300 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:47:51.063300 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:47:51.063300 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:47:51.063300 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:47:51.063300 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:47:51.063300 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:47:51.063300 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:47:51.063300 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:47:51.063300 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:47:51.063300 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:47:51.063300 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:47:51.063300 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:47:51.068238 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:47:51.068238 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:47:51.068238 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 04 20:47:51.068238 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 04 20:47:51.068238 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume b23a03a5-4bb4-4f6d-a4d9-0d451bd6740f is already attached to instances: c703a086-cf9d-4d12-8a18-623e454bcb64 Oct 04 20:47:51.068238 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:47:51.068238 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:47:51.068238 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:47:51.068238 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:47:51.068238 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:47:51.068238 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:47:51.068238 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:47:51.068238 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:47:51.068238 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume b23a03a5-4bb4-4f6d-a4d9-0d451bd6740f is already attached to instances: c703a086-cf9d-4d12-8a18-623e454bcb64 Oct 04 20:47:51.068238 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:47:51.068238 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-1f07bc25-0480-4037-abbb-a5071ffd425d tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Returning 400 to user: Invalid volume: volume b23a03a5-4bb4-4f6d-a4d9-0d451bd6740f is already attached to instances: c703a086-cf9d-4d12-8a18-623e454bcb64 {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:47:51.068238 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-1f07bc25-0480-4037-abbb-a5071ffd425d tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] 10.222.0.33 "POST /compute/v2.1/servers/c703a086-cf9d-4d12-8a18-623e454bcb64/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.235784 Oct 04 20:47:51.091437 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1638/3207] 10.222.0.33 () {60 vars in 1323 bytes} [Tue Oct 4 20:47:50 2022] POST /compute/v2.1/servers/c703a086-cf9d-4d12-8a18-623e454bcb64/os-volume_attachments => generated 174 bytes in 260 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 20:47:51.106630 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-094618a3-afb2-4086-8797-8dc09cfcdd56 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:51.107485 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-094618a3-afb2-4086-8797-8dc09cfcdd56 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: fde3f6fc-61e1-4b21-8b91-e95c2db3d48c] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:51.118139 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-094618a3-afb2-4086-8797-8dc09cfcdd56 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:51.118883 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-094618a3-afb2-4086-8797-8dc09cfcdd56 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:51.119516 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-094618a3-afb2-4086-8797-8dc09cfcdd56 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:51.120315 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-094618a3-afb2-4086-8797-8dc09cfcdd56 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:51.121761 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-094618a3-afb2-4086-8797-8dc09cfcdd56 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:51.122694 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-094618a3-afb2-4086-8797-8dc09cfcdd56 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:51.418612 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-7493fb7e-9396-4735-af38-d0588e9c56b2 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28399882314945d787a3af6eb59935c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5392c67506f7445ab33d62b191558f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:51.431074 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-7493fb7e-9396-4735-af38-d0588e9c56b2 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28399882314945d787a3af6eb59935c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5392c67506f7445ab33d62b191558f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:51.432548 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-7493fb7e-9396-4735-af38-d0588e9c56b2 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28399882314945d787a3af6eb59935c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5392c67506f7445ab33d62b191558f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:51.433795 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-7493fb7e-9396-4735-af38-d0588e9c56b2 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] 10.222.0.33 "GET /compute/v2.1/servers/c0a14e22-0620-4912-9893-62974c80978a" status: 200 len: 2323 microversion: 2.32 time: 0.590254 Oct 04 20:47:51.434373 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1570/3208] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:47:50 2022] GET /compute/v2.1/servers/c0a14e22-0620-4912-9893-62974c80978a => generated 2323 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:47:51.438892 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f17bae91-4c75-40d9-b55c-a4010e5b6e9e tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:51.439501 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f17bae91-4c75-40d9-b55c-a4010e5b6e9e tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] [instance: 39e846c1-6876-42ef-b290-f733516e1051] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:51.464211 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f17bae91-4c75-40d9-b55c-a4010e5b6e9e tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:51.468441 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f17bae91-4c75-40d9-b55c-a4010e5b6e9e tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:51.468890 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f17bae91-4c75-40d9-b55c-a4010e5b6e9e tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:51.469638 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f17bae91-4c75-40d9-b55c-a4010e5b6e9e tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:51.470099 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f17bae91-4c75-40d9-b55c-a4010e5b6e9e tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:51.470558 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f17bae91-4c75-40d9-b55c-a4010e5b6e9e tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:51.888888 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-094618a3-afb2-4086-8797-8dc09cfcdd56 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac650232cc04810b1340dc2f0edadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b0670d1bd99424780a70e69d57a2166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:51.904568 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-094618a3-afb2-4086-8797-8dc09cfcdd56 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "GET /compute/v2.1/servers/fde3f6fc-61e1-4b21-8b91-e95c2db3d48c" status: 200 len: 1490 microversion: 2.1 time: 0.810126 Oct 04 20:47:51.909125 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f17bae91-4c75-40d9-b55c-a4010e5b6e9e tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12dc6570db03431187680f51349e55d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91111396aabd4306b66e14b5abd822ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:51.919633 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1639/3209] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:47:51 2022] GET /compute/v2.1/servers/fde3f6fc-61e1-4b21-8b91-e95c2db3d48c => generated 1490 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:47:51.932534 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-43d07601-cf75-46d0-9c78-68d6049cbb0a tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:51.933382 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-43d07601-cf75-46d0-9c78-68d6049cbb0a tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] [instance: c703a086-cf9d-4d12-8a18-623e454bcb64] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:51.937454 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f17bae91-4c75-40d9-b55c-a4010e5b6e9e tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] 10.222.0.33 "GET /compute/v2.1/servers/39e846c1-6876-42ef-b290-f733516e1051" status: 200 len: 1517 microversion: 2.1 time: 0.491579 Oct 04 20:47:51.939327 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1571/3210] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:47:51 2022] GET /compute/v2.1/servers/39e846c1-6876-42ef-b290-f733516e1051 => generated 1517 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:47:51.944726 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-43d07601-cf75-46d0-9c78-68d6049cbb0a tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:51.945527 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-43d07601-cf75-46d0-9c78-68d6049cbb0a tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:51.950696 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-e5ce3bc7-23b6-46fd-aaa3-b0f2e8592d7e req-d95195f5-084a-43aa-bb23-4b78445b4008 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0a14e22-0620-4912-9893-62974c80978a", "name": "network-vif-deleted", "tag": "dfc19e40-1e2b-4560-8ac7-cb603e8ca4ab"}, {"server_uuid": "c0a14e22-0620-4912-9893-62974c80978a", "name": "network-vif-deleted", "tag": "3aae6729-b226-4156-a8f1-4164c26d5309"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:47:51.958060 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-43d07601-cf75-46d0-9c78-68d6049cbb0a tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:51.962071 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-43d07601-cf75-46d0-9c78-68d6049cbb0a tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:51.963034 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-43d07601-cf75-46d0-9c78-68d6049cbb0a tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:51.963594 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-43d07601-cf75-46d0-9c78-68d6049cbb0a tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:51.965096 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-e5ce3bc7-23b6-46fd-aaa3-b0f2e8592d7e req-d95195f5-084a-43aa-bb23-4b78445b4008 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:51.965580 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-e5ce3bc7-23b6-46fd-aaa3-b0f2e8592d7e req-d95195f5-084a-43aa-bb23-4b78445b4008 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:51.966091 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-e5ce3bc7-23b6-46fd-aaa3-b0f2e8592d7e req-d95195f5-084a-43aa-bb23-4b78445b4008 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:51.986329 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-e5ce3bc7-23b6-46fd-aaa3-b0f2e8592d7e req-d95195f5-084a-43aa-bb23-4b78445b4008 service nova] Creating event network-vif-deleted:dfc19e40-1e2b-4560-8ac7-cb603e8ca4ab for instance c0a14e22-0620-4912-9893-62974c80978a on n-h1-854823-8 Oct 04 20:47:51.987326 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-e5ce3bc7-23b6-46fd-aaa3-b0f2e8592d7e req-d95195f5-084a-43aa-bb23-4b78445b4008 service nova] Creating event network-vif-deleted:3aae6729-b226-4156-a8f1-4164c26d5309 for instance c0a14e22-0620-4912-9893-62974c80978a on n-h1-854823-8 Oct 04 20:47:51.996401 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-e5ce3bc7-23b6-46fd-aaa3-b0f2e8592d7e req-d95195f5-084a-43aa-bb23-4b78445b4008 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.055707 Oct 04 20:47:51.997641 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1572/3211] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:47:51 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:47:52.006261 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7d108180-5d9f-4650-8ecc-0a2a4101509e tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:52.007474 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-7d108180-5d9f-4650-8ecc-0a2a4101509e tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] [instance: 40a02873-d2c2-42b7-a0b7-2b6125d490f3] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:52.030676 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7d108180-5d9f-4650-8ecc-0a2a4101509e tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:52.033769 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7d108180-5d9f-4650-8ecc-0a2a4101509e tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:52.034562 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7d108180-5d9f-4650-8ecc-0a2a4101509e tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:52.040652 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7d108180-5d9f-4650-8ecc-0a2a4101509e tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:52.041512 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7d108180-5d9f-4650-8ecc-0a2a4101509e tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:52.042161 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7d108180-5d9f-4650-8ecc-0a2a4101509e tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:52.166214 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.objects.instance [None req-43d07601-cf75-46d0-9c78-68d6049cbb0a tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lazy-loading 'services' on Instance uuid c703a086-cf9d-4d12-8a18-623e454bcb64 {{(pid=128802) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:47:52.310150 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-43d07601-cf75-46d0-9c78-68d6049cbb0a tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] 10.222.0.33 "DELETE /compute/v2.1/servers/c703a086-cf9d-4d12-8a18-623e454bcb64/os-volume_attachments/b23a03a5-4bb4-4f6d-a4d9-0d451bd6740f" status: 202 len: 0 microversion: 2.1 time: 0.388828 Oct 04 20:47:52.311519 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1640/3212] 10.222.0.33 () {58 vars in 1416 bytes} [Tue Oct 4 20:47:51 2022] DELETE /compute/v2.1/servers/c703a086-cf9d-4d12-8a18-623e454bcb64/os-volume_attachments/b23a03a5-4bb4-4f6d-a4d9-0d451bd6740f => generated 0 bytes in 391 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:47:52.322886 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-14fba54f-fa23-4f4c-9c56-3872b7bbae01 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:52.337335 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-14fba54f-fa23-4f4c-9c56-3872b7bbae01 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] [instance: 041f0f59-75c7-4d01-bc99-77cb871f0fef] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:52.361947 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-14fba54f-fa23-4f4c-9c56-3872b7bbae01 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:52.366319 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-14fba54f-fa23-4f4c-9c56-3872b7bbae01 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:52.369936 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-14fba54f-fa23-4f4c-9c56-3872b7bbae01 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:52.373398 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-14fba54f-fa23-4f4c-9c56-3872b7bbae01 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:52.376950 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-14fba54f-fa23-4f4c-9c56-3872b7bbae01 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:52.381148 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-14fba54f-fa23-4f4c-9c56-3872b7bbae01 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:52.398782 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-7d108180-5d9f-4650-8ecc-0a2a4101509e tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6775b9d82b3444f6b728736f1d2b2806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5338cf2146344042bc263bdc4f9d822b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:52.417618 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-7d108180-5d9f-4650-8ecc-0a2a4101509e tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] 10.222.0.33 "GET /compute/v2.1/servers/40a02873-d2c2-42b7-a0b7-2b6125d490f3" status: 200 len: 1315 microversion: 2.1 time: 0.417624 Oct 04 20:47:52.418623 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1573/3213] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:47:51 2022] GET /compute/v2.1/servers/40a02873-d2c2-42b7-a0b7-2b6125d490f3 => generated 1315 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:47:52.428592 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b17f57dc-42d5-463d-9d81-42fc80b554e2 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Calling method '.version_select at 0x7f3c7893af70>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:52.509688 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b17f57dc-42d5-463d-9d81-42fc80b554e2 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] 10.222.0.33 "GET /compute/v2.1/images/802658f0-2596-4fe9-ad73-90b1f8423ede" status: 200 len: 1437 microversion: 2.1 time: 0.090029 Oct 04 20:47:52.510615 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1574/3214] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 20:47:52 2022] GET /compute/v2.1/images/802658f0-2596-4fe9-ad73-90b1f8423ede => generated 1437 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:47:52.523776 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ab7604f1-6a56-4f16-9557-2c51641e3eb3 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:47:52.529691 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ab7604f1-6a56-4f16-9557-2c51641e3eb3 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: 4d46fff2-b04d-41aa-ada0-2023ab545b48] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:52.551871 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ab7604f1-6a56-4f16-9557-2c51641e3eb3 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:52.552974 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ab7604f1-6a56-4f16-9557-2c51641e3eb3 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:52.553682 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ab7604f1-6a56-4f16-9557-2c51641e3eb3 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:52.554682 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ab7604f1-6a56-4f16-9557-2c51641e3eb3 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:52.555170 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ab7604f1-6a56-4f16-9557-2c51641e3eb3 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:52.555674 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ab7604f1-6a56-4f16-9557-2c51641e3eb3 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:52.867070 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ab7604f1-6a56-4f16-9557-2c51641e3eb3 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "POST /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48/action" status: 200 len: 177 microversion: 2.1 time: 0.348005 Oct 04 20:47:52.876782 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1575/3215] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 20:47:52 2022] POST /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48/action => generated 177 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:47:52.891784 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a33b428e-c517-46af-a979-f500f48ac504 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:52.898007 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a33b428e-c517-46af-a979-f500f48ac504 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] [instance: c703a086-cf9d-4d12-8a18-623e454bcb64] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:52.907931 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a33b428e-c517-46af-a979-f500f48ac504 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:52.909001 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a33b428e-c517-46af-a979-f500f48ac504 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:52.909629 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a33b428e-c517-46af-a979-f500f48ac504 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:52.911421 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a33b428e-c517-46af-a979-f500f48ac504 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:52.912120 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a33b428e-c517-46af-a979-f500f48ac504 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:52.912732 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a33b428e-c517-46af-a979-f500f48ac504 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:52.961628 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a33b428e-c517-46af-a979-f500f48ac504 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] 10.222.0.33 "GET /compute/v2.1/servers/c703a086-cf9d-4d12-8a18-623e454bcb64/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.087618 Oct 04 20:47:52.963989 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1576/3216] 10.222.0.33 () {58 vars in 1302 bytes} [Tue Oct 4 20:47:52 2022] GET /compute/v2.1/servers/c703a086-cf9d-4d12-8a18-623e454bcb64/os-volume_attachments => generated 197 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:47:52.971440 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ff040690-e19f-434d-8bee-2c74ec36fec3 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:52.973115 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ff040690-e19f-434d-8bee-2c74ec36fec3 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] [instance: c0a14e22-0620-4912-9893-62974c80978a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:52.980975 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ff040690-e19f-434d-8bee-2c74ec36fec3 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:52.981842 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ff040690-e19f-434d-8bee-2c74ec36fec3 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:52.982526 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ff040690-e19f-434d-8bee-2c74ec36fec3 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:52.983646 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ff040690-e19f-434d-8bee-2c74ec36fec3 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:52.984501 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ff040690-e19f-434d-8bee-2c74ec36fec3 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:52.985146 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ff040690-e19f-434d-8bee-2c74ec36fec3 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:53.133027 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-14fba54f-fa23-4f4c-9c56-3872b7bbae01 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87dcc7baf63f4ae6bfe0a099adffd408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7097bc12179446f6a3e1fac8434d5c64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:53.141067 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-14fba54f-fa23-4f4c-9c56-3872b7bbae01 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] 10.222.0.33 "GET /compute/v2.1/servers/041f0f59-75c7-4d01-bc99-77cb871f0fef" status: 200 len: 1509 microversion: 2.1 time: 0.828187 Oct 04 20:47:53.141671 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1641/3217] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:47:52 2022] GET /compute/v2.1/servers/041f0f59-75c7-4d01-bc99-77cb871f0fef => generated 1509 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:47:53.163889 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-6dff3b63-debd-4a34-ba38-96c7ab3d08b4 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:53.164544 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-6dff3b63-debd-4a34-ba38-96c7ab3d08b4 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: 4d46fff2-b04d-41aa-ada0-2023ab545b48] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:53.189391 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6dff3b63-debd-4a34-ba38-96c7ab3d08b4 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:53.190036 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6dff3b63-debd-4a34-ba38-96c7ab3d08b4 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:53.190764 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6dff3b63-debd-4a34-ba38-96c7ab3d08b4 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:53.192194 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6dff3b63-debd-4a34-ba38-96c7ab3d08b4 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:53.192828 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6dff3b63-debd-4a34-ba38-96c7ab3d08b4 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:53.193436 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6dff3b63-debd-4a34-ba38-96c7ab3d08b4 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:53.497944 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-ff040690-e19f-434d-8bee-2c74ec36fec3 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28399882314945d787a3af6eb59935c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5392c67506f7445ab33d62b191558f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:53.511248 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-ff040690-e19f-434d-8bee-2c74ec36fec3 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28399882314945d787a3af6eb59935c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5392c67506f7445ab33d62b191558f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:53.521400 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-ff040690-e19f-434d-8bee-2c74ec36fec3 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28399882314945d787a3af6eb59935c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5392c67506f7445ab33d62b191558f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:53.524155 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ff040690-e19f-434d-8bee-2c74ec36fec3 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] 10.222.0.33 "GET /compute/v2.1/servers/c0a14e22-0620-4912-9893-62974c80978a" status: 200 len: 1985 microversion: 2.32 time: 0.558827 Oct 04 20:47:53.525019 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1577/3218] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:47:52 2022] GET /compute/v2.1/servers/c0a14e22-0620-4912-9893-62974c80978a => generated 1985 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:47:53.589962 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-57713db7-6719-40d2-a6d3-61cf4cc2ccc5 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:53.593980 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-57713db7-6719-40d2-a6d3-61cf4cc2ccc5 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] [instance: 39e846c1-6876-42ef-b290-f733516e1051] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:53.632942 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-57713db7-6719-40d2-a6d3-61cf4cc2ccc5 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:53.638138 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-57713db7-6719-40d2-a6d3-61cf4cc2ccc5 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:53.639895 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-57713db7-6719-40d2-a6d3-61cf4cc2ccc5 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:53.646770 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-57713db7-6719-40d2-a6d3-61cf4cc2ccc5 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:53.648892 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-57713db7-6719-40d2-a6d3-61cf4cc2ccc5 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:53.649570 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-57713db7-6719-40d2-a6d3-61cf4cc2ccc5 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:53.668157 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-6dff3b63-debd-4a34-ba38-96c7ab3d08b4 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac650232cc04810b1340dc2f0edadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b0670d1bd99424780a70e69d57a2166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:53.681004 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-6dff3b63-debd-4a34-ba38-96c7ab3d08b4 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48" status: 200 len: 1669 microversion: 2.1 time: 0.538278 Oct 04 20:47:53.702602 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1642/3219] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:47:53 2022] GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48 => generated 1669 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:47:53.718312 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-b1225f67-7203-4f67-91ab-88cee1fa10cc tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:53.719013 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-b1225f67-7203-4f67-91ab-88cee1fa10cc tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] [instance: 40a02873-d2c2-42b7-a0b7-2b6125d490f3] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:53.758263 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:47:53.773862 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b1225f67-7203-4f67-91ab-88cee1fa10cc tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:53.779939 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b1225f67-7203-4f67-91ab-88cee1fa10cc tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:53.781123 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b1225f67-7203-4f67-91ab-88cee1fa10cc tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:53.786201 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b1225f67-7203-4f67-91ab-88cee1fa10cc tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:53.787441 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b1225f67-7203-4f67-91ab-88cee1fa10cc tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:53.788330 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b1225f67-7203-4f67-91ab-88cee1fa10cc tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:53.901673 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-57713db7-6719-40d2-a6d3-61cf4cc2ccc5 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12dc6570db03431187680f51349e55d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91111396aabd4306b66e14b5abd822ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:53.916371 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-57713db7-6719-40d2-a6d3-61cf4cc2ccc5 tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] 10.222.0.33 "GET /compute/v2.1/servers/39e846c1-6876-42ef-b290-f733516e1051" status: 200 len: 1306 microversion: 2.1 time: 0.389894 Oct 04 20:47:53.924769 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1578/3220] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:47:53 2022] GET /compute/v2.1/servers/39e846c1-6876-42ef-b290-f733516e1051 => generated 1306 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:47:53.942488 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6b7461ed-a56b-432f-9813-68e9e7205359 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Calling method '.version_select at 0x7f3c78808ca0>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:54.055774 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-6b7461ed-a56b-432f-9813-68e9e7205359 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] 10.222.0.33 "GET /compute/v2.1/images/802658f0-2596-4fe9-ad73-90b1f8423ede" status: 200 len: 1437 microversion: 2.1 time: 0.127505 Oct 04 20:47:54.056378 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1579/3221] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 20:47:53 2022] GET /compute/v2.1/images/802658f0-2596-4fe9-ad73-90b1f8423ede => generated 1437 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:47:54.065698 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-10dcde6e-3b35-4a8a-bfcc-3d490be76fd7 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:54.074717 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-10dcde6e-3b35-4a8a-bfcc-3d490be76fd7 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: 4d46fff2-b04d-41aa-ada0-2023ab545b48] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:54.106180 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-10dcde6e-3b35-4a8a-bfcc-3d490be76fd7 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:54.108019 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-10dcde6e-3b35-4a8a-bfcc-3d490be76fd7 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:54.108468 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-10dcde6e-3b35-4a8a-bfcc-3d490be76fd7 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:54.109865 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-10dcde6e-3b35-4a8a-bfcc-3d490be76fd7 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:54.114355 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-10dcde6e-3b35-4a8a-bfcc-3d490be76fd7 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:54.114867 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-10dcde6e-3b35-4a8a-bfcc-3d490be76fd7 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:54.217045 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-b1225f67-7203-4f67-91ab-88cee1fa10cc tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6775b9d82b3444f6b728736f1d2b2806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5338cf2146344042bc263bdc4f9d822b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:54.229086 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-b1225f67-7203-4f67-91ab-88cee1fa10cc tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] 10.222.0.33 "GET /compute/v2.1/servers/40a02873-d2c2-42b7-a0b7-2b6125d490f3" status: 200 len: 1315 microversion: 2.1 time: 0.527899 Oct 04 20:47:54.232318 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1643/3222] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:47:53 2022] GET /compute/v2.1/servers/40a02873-d2c2-42b7-a0b7-2b6125d490f3 => generated 1315 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:47:54.252165 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-4c1ecc62-0000-402a-b1f2-2bac381e5cbf tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:54.255882 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-4c1ecc62-0000-402a-b1f2-2bac381e5cbf tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] [instance: c703a086-cf9d-4d12-8a18-623e454bcb64] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:54.299767 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4c1ecc62-0000-402a-b1f2-2bac381e5cbf tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:54.301677 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4c1ecc62-0000-402a-b1f2-2bac381e5cbf tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:54.303336 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4c1ecc62-0000-402a-b1f2-2bac381e5cbf tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:54.304741 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4c1ecc62-0000-402a-b1f2-2bac381e5cbf tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:54.306797 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4c1ecc62-0000-402a-b1f2-2bac381e5cbf tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:54.309544 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4c1ecc62-0000-402a-b1f2-2bac381e5cbf tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:54.382115 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-10dcde6e-3b35-4a8a-bfcc-3d490be76fd7 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac650232cc04810b1340dc2f0edadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b0670d1bd99424780a70e69d57a2166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:54.398238 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-10dcde6e-3b35-4a8a-bfcc-3d490be76fd7 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48" status: 200 len: 1669 microversion: 2.1 time: 0.338967 Oct 04 20:47:54.400407 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1580/3223] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:47:54 2022] GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48 => generated 1669 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:47:54.407287 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-30a724b2-de01-4396-8d07-edb044f70ae0 req-456f5fc7-131f-4fdf-9806-f5b355e6ca32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39e846c1-6876-42ef-b290-f733516e1051", "name": "network-vif-deleted", "tag": "41e834af-e651-4065-b00f-f0cead495d74"}, {"server_uuid": "c0a14e22-0620-4912-9893-62974c80978a", "name": "network-vif-deleted", "tag": "5f2c3d14-997c-4225-a9eb-1379adba5e6c"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:47:54.417359 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-4c1ecc62-0000-402a-b1f2-2bac381e5cbf tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] 10.222.0.33 "GET /compute/v2.1/servers/c703a086-cf9d-4d12-8a18-623e454bcb64/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.183794 Oct 04 20:47:54.418728 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-30a724b2-de01-4396-8d07-edb044f70ae0 req-456f5fc7-131f-4fdf-9806-f5b355e6ca32 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:54.419287 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-30a724b2-de01-4396-8d07-edb044f70ae0 req-456f5fc7-131f-4fdf-9806-f5b355e6ca32 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:54.419803 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-30a724b2-de01-4396-8d07-edb044f70ae0 req-456f5fc7-131f-4fdf-9806-f5b355e6ca32 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:54.435163 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-30a724b2-de01-4396-8d07-edb044f70ae0 req-456f5fc7-131f-4fdf-9806-f5b355e6ca32 service nova] Creating event network-vif-deleted:41e834af-e651-4065-b00f-f0cead495d74 for instance 39e846c1-6876-42ef-b290-f733516e1051 on n-h2-854823-8 Oct 04 20:47:54.435759 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-30a724b2-de01-4396-8d07-edb044f70ae0 req-456f5fc7-131f-4fdf-9806-f5b355e6ca32 service nova] Creating event network-vif-deleted:5f2c3d14-997c-4225-a9eb-1379adba5e6c for instance c0a14e22-0620-4912-9893-62974c80978a on n-h1-854823-8 Oct 04 20:47:54.436725 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1644/3224] 10.222.0.33 () {58 vars in 1302 bytes} [Tue Oct 4 20:47:54 2022] GET /compute/v2.1/servers/c703a086-cf9d-4d12-8a18-623e454bcb64/os-volume_attachments => generated 197 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:47:54.448344 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-30a724b2-de01-4396-8d07-edb044f70ae0 req-456f5fc7-131f-4fdf-9806-f5b355e6ca32 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.044141 Oct 04 20:47:54.451219 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-d9daecf5-dc36-40d8-b50d-6d0351eda423 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:54.453782 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1581/3225] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:47:54 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:47:54.454865 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-d9daecf5-dc36-40d8-b50d-6d0351eda423 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] [instance: 041f0f59-75c7-4d01-bc99-77cb871f0fef] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:54.459640 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-782e881e-433d-4318-84d9-c71bddd61fcd tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:54.460636 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-782e881e-433d-4318-84d9-c71bddd61fcd tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: 4d46fff2-b04d-41aa-ada0-2023ab545b48] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:54.478416 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d9daecf5-dc36-40d8-b50d-6d0351eda423 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:54.479237 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d9daecf5-dc36-40d8-b50d-6d0351eda423 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:54.482381 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-782e881e-433d-4318-84d9-c71bddd61fcd tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:54.482993 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-782e881e-433d-4318-84d9-c71bddd61fcd tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:54.483509 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-782e881e-433d-4318-84d9-c71bddd61fcd tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:54.484538 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-782e881e-433d-4318-84d9-c71bddd61fcd tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:54.485076 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-782e881e-433d-4318-84d9-c71bddd61fcd tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:54.485593 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-782e881e-433d-4318-84d9-c71bddd61fcd tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:54.488188 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d9daecf5-dc36-40d8-b50d-6d0351eda423 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:54.493813 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d9daecf5-dc36-40d8-b50d-6d0351eda423 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:54.494836 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d9daecf5-dc36-40d8-b50d-6d0351eda423 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:54.496268 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d9daecf5-dc36-40d8-b50d-6d0351eda423 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:54.962547 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-d9daecf5-dc36-40d8-b50d-6d0351eda423 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87dcc7baf63f4ae6bfe0a099adffd408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7097bc12179446f6a3e1fac8434d5c64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:54.972354 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-d9daecf5-dc36-40d8-b50d-6d0351eda423 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] 10.222.0.33 "GET /compute/v2.1/servers/041f0f59-75c7-4d01-bc99-77cb871f0fef" status: 200 len: 1509 microversion: 2.1 time: 0.533340 Oct 04 20:47:54.976831 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1645/3226] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:47:54 2022] GET /compute/v2.1/servers/041f0f59-75c7-4d01-bc99-77cb871f0fef => generated 1509 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:47:54.983619 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-0034a009-0cac-45c5-9504-20b9b6ad4438 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:54.984328 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-0034a009-0cac-45c5-9504-20b9b6ad4438 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] [instance: c0a14e22-0620-4912-9893-62974c80978a] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:54.991311 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0034a009-0cac-45c5-9504-20b9b6ad4438 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:54.992065 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0034a009-0cac-45c5-9504-20b9b6ad4438 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:54.992728 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0034a009-0cac-45c5-9504-20b9b6ad4438 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:54.993934 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0034a009-0cac-45c5-9504-20b9b6ad4438 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:54.994657 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0034a009-0cac-45c5-9504-20b9b6ad4438 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:54.995325 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0034a009-0cac-45c5-9504-20b9b6ad4438 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:55.005496 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-782e881e-433d-4318-84d9-c71bddd61fcd tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac650232cc04810b1340dc2f0edadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b0670d1bd99424780a70e69d57a2166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:55.014982 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-782e881e-433d-4318-84d9-c71bddd61fcd tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48" status: 200 len: 1669 microversion: 2.1 time: 0.559794 Oct 04 20:47:55.016430 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1582/3227] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:47:54 2022] GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48 => generated 1669 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:47:55.021947 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-4153ca8f-4d44-4e97-899a-34aba5ace488 req-c0c80ba6-5678-4049-bc7f-b9a1cda66df4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40a02873-d2c2-42b7-a0b7-2b6125d490f3", "name": "network-vif-plugged", "status": "completed", "tag": "ab3cba0a-dc15-4028-b7e0-d50faae0a9e5"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:47:55.032570 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:47:55.034829 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-4153ca8f-4d44-4e97-899a-34aba5ace488 req-c0c80ba6-5678-4049-bc7f-b9a1cda66df4 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:55.036063 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-4153ca8f-4d44-4e97-899a-34aba5ace488 req-c0c80ba6-5678-4049-bc7f-b9a1cda66df4 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:55.036664 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-4153ca8f-4d44-4e97-899a-34aba5ace488 req-c0c80ba6-5678-4049-bc7f-b9a1cda66df4 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:55.055186 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-4153ca8f-4d44-4e97-899a-34aba5ace488 req-c0c80ba6-5678-4049-bc7f-b9a1cda66df4 service nova] Creating event network-vif-plugged:ab3cba0a-dc15-4028-b7e0-d50faae0a9e5 for instance 40a02873-d2c2-42b7-a0b7-2b6125d490f3 on n-h1-854823-8 Oct 04 20:47:55.062112 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-4153ca8f-4d44-4e97-899a-34aba5ace488 req-c0c80ba6-5678-4049-bc7f-b9a1cda66df4 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044335 Oct 04 20:47:55.063333 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1583/3228] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:47:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:47:55.071060 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a5258424-7cb8-4cc5-8acb-f71d3ae84fbe tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:55.072245 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a5258424-7cb8-4cc5-8acb-f71d3ae84fbe tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] [instance: 39e846c1-6876-42ef-b290-f733516e1051] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:55.081900 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a5258424-7cb8-4cc5-8acb-f71d3ae84fbe tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:55.082683 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a5258424-7cb8-4cc5-8acb-f71d3ae84fbe tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:55.083322 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a5258424-7cb8-4cc5-8acb-f71d3ae84fbe tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:55.084154 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a5258424-7cb8-4cc5-8acb-f71d3ae84fbe tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:55.084850 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a5258424-7cb8-4cc5-8acb-f71d3ae84fbe tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:55.085699 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a5258424-7cb8-4cc5-8acb-f71d3ae84fbe tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:55.109787 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-a5258424-7cb8-4cc5-8acb-f71d3ae84fbe tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] HTTP exception thrown: Instance 39e846c1-6876-42ef-b290-f733516e1051 could not be found. Oct 04 20:47:55.112105 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a5258424-7cb8-4cc5-8acb-f71d3ae84fbe tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Request method failure captured: Oct 04 20:47:55.112105 n-d-854823-8 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/39e846c1-6876-42ef-b290-f733516e1051 HTTP/1.1 Oct 04 20:47:55.112105 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:47:55.112105 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:47:55.112105 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:47:55.112105 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 0 Oct 04 20:47:55.112105 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:47:55.112105 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:47:55.112105 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:47:55.112105 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:47:55.112105 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJuA25pY5gnij2GUImD-SeoqdUwrg36IJ00ci1xpid5rkQM_iu-hu9Kj4hz7bXCbbgwzkwDgSGrCuv5J0mFe0VOwO727nThjFElnHFGlINPkXZX80vX9nrbk5CSUaU0Wug41BK5JHF9vTIRe1sfED5uAcUvsrV9JrGz3UtCU4qQaKGU Oct 04 20:47:55.112105 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:47:55.112105 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:47:55.112105 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:47:55.112105 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:47:55.112105 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:47:55.112105 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:47:55.112105 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: 91111396aabd4306b66e14b5abd822ad Oct 04 20:47:55.112105 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-ListServerFiltersTestJSON-771158953 Oct 04 20:47:55.112105 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 20:47:55.112105 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 20:47:55.112105 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_91111396aabd4306b66e14b5abd822ad", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/91111396aabd4306b66e14b5abd822ad"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/91111396aabd4306b66e14b5abd822ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/91111396aabd4306b66e14b5abd822ad"}]}] Oct 04 20:47:55.112105 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-ListServerFiltersTestJSON-771158953 Oct 04 20:47:55.112105 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: 91111396aabd4306b66e14b5abd822ad Oct 04 20:47:55.112105 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-771158953 Oct 04 20:47:55.112105 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-ListServerFiltersTestJSON-771158953-project Oct 04 20:47:55.112105 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:47:55.112105 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:47:55.112105 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: 12dc6570db03431187680f51349e55d3 Oct 04 20:47:55.112105 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-ListServerFiltersTestJSON-771158953-project Oct 04 20:47:55.112105 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 20:47:55.112105 n-d-854823-8 devstack@n-api.service[128801]: exception: Instance 39e846c1-6876-42ef-b290-f733516e1051 could not be found. Oct 04 20:47:55.112105 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': '39e846c1-6876-42ef-b290-f733516e1051'} Oct 04 20:47:55.112105 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:47:55.112105 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:47:55.112105 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:47:55.112105 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:47:55.112105 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:47:55.112105 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:47:55.112105 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:47:55.112105 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:47:55.112105 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:47:55.112105 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:47:55.112105 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 39e846c1-6876-42ef-b290-f733516e1051 could not be found. Oct 04 20:47:55.112105 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:47:55.112105 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:47:55.112105 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:47:55.112105 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:47:55.112105 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:47:55.112105 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:47:55.112105 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:47:55.112105 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:47:55.112105 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:47:55.112105 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:47:55.112105 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:47:55.112105 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:47:55.112105 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:47:55.112105 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:47:55.112105 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:47:55.112105 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:47:55.112105 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 39e846c1-6876-42ef-b290-f733516e1051 could not be found. Oct 04 20:47:55.112105 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:47:55.112105 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:47:55.112105 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:47:55.116705 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:47:55.116705 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:47:55.116705 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:47:55.116705 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:47:55.116705 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:47:55.116705 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 39e846c1-6876-42ef-b290-f733516e1051 could not be found. Oct 04 20:47:55.116705 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:47:55.119522 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a5258424-7cb8-4cc5-8acb-f71d3ae84fbe tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] Returning 404 to user: Instance 39e846c1-6876-42ef-b290-f733516e1051 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:47:55.121703 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a5258424-7cb8-4cc5-8acb-f71d3ae84fbe tempest-ListServerFiltersTestJSON-771158953 tempest-ListServerFiltersTestJSON-771158953-project] 10.222.0.33 "GET /compute/v2.1/servers/39e846c1-6876-42ef-b290-f733516e1051" status: 404 len: 111 microversion: 2.1 time: 0.056069 Oct 04 20:47:55.122644 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1584/3229] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:47:55 2022] GET /compute/v2.1/servers/39e846c1-6876-42ef-b290-f733516e1051 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:47:55.130940 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7d5a62f7-20d1-4716-af0f-5cc83745218b tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:55.131848 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-7d5a62f7-20d1-4716-af0f-5cc83745218b tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: 4d46fff2-b04d-41aa-ada0-2023ab545b48] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:55.139739 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7d5a62f7-20d1-4716-af0f-5cc83745218b tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:55.139978 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-0034a009-0cac-45c5-9504-20b9b6ad4438 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28399882314945d787a3af6eb59935c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5392c67506f7445ab33d62b191558f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:55.141216 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7d5a62f7-20d1-4716-af0f-5cc83745218b tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:55.141919 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7d5a62f7-20d1-4716-af0f-5cc83745218b tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:55.142883 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7d5a62f7-20d1-4716-af0f-5cc83745218b tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:55.143546 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7d5a62f7-20d1-4716-af0f-5cc83745218b tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:55.144216 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7d5a62f7-20d1-4716-af0f-5cc83745218b tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:55.160175 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-0034a009-0cac-45c5-9504-20b9b6ad4438 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28399882314945d787a3af6eb59935c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5392c67506f7445ab33d62b191558f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:55.163884 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-0034a009-0cac-45c5-9504-20b9b6ad4438 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28399882314945d787a3af6eb59935c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5392c67506f7445ab33d62b191558f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:55.171663 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-0034a009-0cac-45c5-9504-20b9b6ad4438 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] 10.222.0.33 "GET /compute/v2.1/servers/c0a14e22-0620-4912-9893-62974c80978a" status: 200 len: 1604 microversion: 2.32 time: 0.193651 Oct 04 20:47:55.176483 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1646/3230] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:47:54 2022] GET /compute/v2.1/servers/c0a14e22-0620-4912-9893-62974c80978a => generated 1604 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:47:55.186765 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-8c3b61ee-cb48-44bd-874e-8573e95fb2cf tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Calling method '.version_select at 0x7f3c787fd8b0>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:55.280239 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-8c3b61ee-cb48-44bd-874e-8573e95fb2cf tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] 10.222.0.33 "GET /compute/v2.1/images/802658f0-2596-4fe9-ad73-90b1f8423ede" status: 200 len: 1437 microversion: 2.1 time: 0.102333 Oct 04 20:47:55.280830 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1647/3231] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 20:47:55 2022] GET /compute/v2.1/images/802658f0-2596-4fe9-ad73-90b1f8423ede => generated 1437 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:47:55.288158 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-d0187908-3a76-4e54-80f9-25c809081ab1 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:55.297243 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-d0187908-3a76-4e54-80f9-25c809081ab1 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] [instance: 40a02873-d2c2-42b7-a0b7-2b6125d490f3] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:55.324942 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d0187908-3a76-4e54-80f9-25c809081ab1 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:55.325719 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d0187908-3a76-4e54-80f9-25c809081ab1 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:55.326328 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d0187908-3a76-4e54-80f9-25c809081ab1 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:55.327237 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d0187908-3a76-4e54-80f9-25c809081ab1 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:55.327858 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d0187908-3a76-4e54-80f9-25c809081ab1 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:55.328446 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d0187908-3a76-4e54-80f9-25c809081ab1 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:55.491835 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-7d5a62f7-20d1-4716-af0f-5cc83745218b tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac650232cc04810b1340dc2f0edadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b0670d1bd99424780a70e69d57a2166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:55.506360 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-7d5a62f7-20d1-4716-af0f-5cc83745218b tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48" status: 200 len: 1669 microversion: 2.1 time: 0.382375 Oct 04 20:47:55.522371 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1585/3232] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:47:55 2022] GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48 => generated 1669 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:47:55.522371 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6c66575c-02c8-4d50-928c-9c21e4ad2f93 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:55.524818 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-6c66575c-02c8-4d50-928c-9c21e4ad2f93 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] [instance: c703a086-cf9d-4d12-8a18-623e454bcb64] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:55.553480 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6c66575c-02c8-4d50-928c-9c21e4ad2f93 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:55.553989 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6c66575c-02c8-4d50-928c-9c21e4ad2f93 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:55.558685 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6c66575c-02c8-4d50-928c-9c21e4ad2f93 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:55.559500 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6c66575c-02c8-4d50-928c-9c21e4ad2f93 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:55.559990 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6c66575c-02c8-4d50-928c-9c21e4ad2f93 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:55.560421 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6c66575c-02c8-4d50-928c-9c21e4ad2f93 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:55.659248 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-6c66575c-02c8-4d50-928c-9c21e4ad2f93 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] 10.222.0.33 "GET /compute/v2.1/servers/c703a086-cf9d-4d12-8a18-623e454bcb64/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.149498 Oct 04 20:47:55.660428 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1586/3233] 10.222.0.33 () {58 vars in 1302 bytes} [Tue Oct 4 20:47:55 2022] GET /compute/v2.1/servers/c703a086-cf9d-4d12-8a18-623e454bcb64/os-volume_attachments => generated 197 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:47:55.713501 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-04b10aff-85b1-4c3c-aaf5-500931a45b2f tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-988338782", "imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63", "flavorRef": "452", "networks": [{"uuid": "f233dbb4-a3a0-4530-9ca7-211ce7f5e292"}]}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:47:55.784623 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-d0187908-3a76-4e54-80f9-25c809081ab1 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6775b9d82b3444f6b728736f1d2b2806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5338cf2146344042bc263bdc4f9d822b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:55.793741 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-d0187908-3a76-4e54-80f9-25c809081ab1 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] 10.222.0.33 "GET /compute/v2.1/servers/40a02873-d2c2-42b7-a0b7-2b6125d490f3" status: 200 len: 1315 microversion: 2.1 time: 0.511540 Oct 04 20:47:55.815833 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1648/3234] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:47:55 2022] GET /compute/v2.1/servers/40a02873-d2c2-42b7-a0b7-2b6125d490f3 => generated 1315 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:47:55.833322 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.network.neutron [None req-04b10aff-85b1-4c3c-aaf5-500931a45b2f tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] validate_networks() for [('f233dbb4-a3a0-4530-9ca7-211ce7f5e292', None, None, None, None, None)] {{(pid=128801) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:47:56.008088 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-c88acc2b-a481-4f82-973f-3aa352ff0d57 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:56.008713 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-c88acc2b-a481-4f82-973f-3aa352ff0d57 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] [instance: 041f0f59-75c7-4d01-bc99-77cb871f0fef] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:56.024520 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c88acc2b-a481-4f82-973f-3aa352ff0d57 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:56.025385 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c88acc2b-a481-4f82-973f-3aa352ff0d57 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:56.026014 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c88acc2b-a481-4f82-973f-3aa352ff0d57 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:56.030262 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c88acc2b-a481-4f82-973f-3aa352ff0d57 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:56.030970 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c88acc2b-a481-4f82-973f-3aa352ff0d57 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:56.031589 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c88acc2b-a481-4f82-973f-3aa352ff0d57 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:56.329719 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-c88acc2b-a481-4f82-973f-3aa352ff0d57 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87dcc7baf63f4ae6bfe0a099adffd408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7097bc12179446f6a3e1fac8434d5c64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:56.338997 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-c88acc2b-a481-4f82-973f-3aa352ff0d57 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] 10.222.0.33 "GET /compute/v2.1/servers/041f0f59-75c7-4d01-bc99-77cb871f0fef" status: 200 len: 1509 microversion: 2.1 time: 0.336819 Oct 04 20:47:56.347569 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1649/3235] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:47:56 2022] GET /compute/v2.1/servers/041f0f59-75c7-4d01-bc99-77cb871f0fef => generated 1509 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:47:56.367102 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-e951eea7-fe71-449b-bfdb-619ab79b094f tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:56.368047 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-e951eea7-fe71-449b-bfdb-619ab79b094f tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] [instance: c0a14e22-0620-4912-9893-62974c80978a] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:56.375173 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e951eea7-fe71-449b-bfdb-619ab79b094f tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:56.377708 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e951eea7-fe71-449b-bfdb-619ab79b094f tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:56.380932 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e951eea7-fe71-449b-bfdb-619ab79b094f tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:56.384413 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e951eea7-fe71-449b-bfdb-619ab79b094f tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:56.387484 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e951eea7-fe71-449b-bfdb-619ab79b094f tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:56.388163 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e951eea7-fe71-449b-bfdb-619ab79b094f tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:56.577666 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-e951eea7-fe71-449b-bfdb-619ab79b094f tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28399882314945d787a3af6eb59935c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5392c67506f7445ab33d62b191558f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:56.588363 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-e951eea7-fe71-449b-bfdb-619ab79b094f tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28399882314945d787a3af6eb59935c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5392c67506f7445ab33d62b191558f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:56.606114 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-e951eea7-fe71-449b-bfdb-619ab79b094f tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28399882314945d787a3af6eb59935c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5392c67506f7445ab33d62b191558f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:56.607403 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-e951eea7-fe71-449b-bfdb-619ab79b094f tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] 10.222.0.33 "GET /compute/v2.1/servers/c0a14e22-0620-4912-9893-62974c80978a" status: 200 len: 1604 microversion: 2.32 time: 0.257296 Oct 04 20:47:56.612601 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1650/3236] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:47:56 2022] GET /compute/v2.1/servers/c0a14e22-0620-4912-9893-62974c80978a => generated 1604 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:47:56.619777 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-1daa3292-19dc-4c6a-9841-005c17ec4688 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Calling method '.version_select at 0x7f3c787fd160>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:56.696524 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-04b10aff-85b1-4c3c-aaf5-500931a45b2f tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Flavor limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:47:56.696979 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-04b10aff-85b1-4c3c-aaf5-500931a45b2f tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Image limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:47:56.697416 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-04b10aff-85b1-4c3c-aaf5-500931a45b2f tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Flavor pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:47:56.698223 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-04b10aff-85b1-4c3c-aaf5-500931a45b2f tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Image pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:47:56.698754 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-04b10aff-85b1-4c3c-aaf5-500931a45b2f tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:47:56.715477 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-1daa3292-19dc-4c6a-9841-005c17ec4688 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] 10.222.0.33 "GET /compute/v2.1/images/802658f0-2596-4fe9-ad73-90b1f8423ede" status: 200 len: 1437 microversion: 2.1 time: 0.101272 Oct 04 20:47:56.724737 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1651/3237] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 20:47:56 2022] GET /compute/v2.1/images/802658f0-2596-4fe9-ad73-90b1f8423ede => generated 1437 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:47:56.727489 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-8b46f297-e0ea-420f-a939-22ec9148519b tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:56.737807 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-8b46f297-e0ea-420f-a939-22ec9148519b tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] [instance: c703a086-cf9d-4d12-8a18-623e454bcb64] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:56.740963 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-04b10aff-85b1-4c3c-aaf5-500931a45b2f tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:56.741466 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-04b10aff-85b1-4c3c-aaf5-500931a45b2f tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:56.741911 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-04b10aff-85b1-4c3c-aaf5-500931a45b2f tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:56.742679 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-04b10aff-85b1-4c3c-aaf5-500931a45b2f tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:56.743147 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-04b10aff-85b1-4c3c-aaf5-500931a45b2f tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:56.743580 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-04b10aff-85b1-4c3c-aaf5-500931a45b2f tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:56.760286 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8b46f297-e0ea-420f-a939-22ec9148519b tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:56.760796 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8b46f297-e0ea-420f-a939-22ec9148519b tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:56.761241 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8b46f297-e0ea-420f-a939-22ec9148519b tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:56.761959 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8b46f297-e0ea-420f-a939-22ec9148519b tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:56.762450 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8b46f297-e0ea-420f-a939-22ec9148519b tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:56.762898 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8b46f297-e0ea-420f-a939-22ec9148519b tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:56.796339 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-04b10aff-85b1-4c3c-aaf5-500931a45b2f tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Getting quotas for project 8b0670d1bd99424780a70e69d57a2166. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:47:56.805586 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-04b10aff-85b1-4c3c-aaf5-500931a45b2f tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Getting quotas for user eac650232cc04810b1340dc2f0edadcc and project 8b0670d1bd99424780a70e69d57a2166. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:47:56.835257 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-8b46f297-e0ea-420f-a939-22ec9148519b tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] 10.222.0.33 "GET /compute/v2.1/servers/c703a086-cf9d-4d12-8a18-623e454bcb64/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.117663 Oct 04 20:47:56.837657 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-04b10aff-85b1-4c3c-aaf5-500931a45b2f tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Going to run 1 instances... {{(pid=128801) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:47:56.838600 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1652/3238] 10.222.0.33 () {58 vars in 1302 bytes} [Tue Oct 4 20:47:56 2022] GET /compute/v2.1/servers/c703a086-cf9d-4d12-8a18-623e454bcb64/os-volume_attachments => generated 197 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:47:56.841749 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-04b10aff-85b1-4c3c-aaf5-500931a45b2f tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: ac3f41f1-ed37-4009-81e5-7bee0ee6ea69] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='15b24725-0c99-4bcf-b1fb-907cdf8e2d63',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128801) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:47:56.862857 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-bac5cdb4-a1fa-4941-a81d-64a203ef2d39 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:56.863580 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-bac5cdb4-a1fa-4941-a81d-64a203ef2d39 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] [instance: 40a02873-d2c2-42b7-a0b7-2b6125d490f3] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:56.887896 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bac5cdb4-a1fa-4941-a81d-64a203ef2d39 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:56.888682 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bac5cdb4-a1fa-4941-a81d-64a203ef2d39 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:56.889430 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bac5cdb4-a1fa-4941-a81d-64a203ef2d39 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:56.892788 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bac5cdb4-a1fa-4941-a81d-64a203ef2d39 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:56.897931 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bac5cdb4-a1fa-4941-a81d-64a203ef2d39 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:56.899933 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bac5cdb4-a1fa-4941-a81d-64a203ef2d39 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:56.974061 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-04b10aff-85b1-4c3c-aaf5-500931a45b2f tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.264762 Oct 04 20:47:56.987370 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1587/3239] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 20:47:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 1279 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 20:47:56.992896 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-85073c45-0e5e-4eba-9cd8-01c5a44ce23b tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:57.000947 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-85073c45-0e5e-4eba-9cd8-01c5a44ce23b tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: ac3f41f1-ed37-4009-81e5-7bee0ee6ea69] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:57.207305 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-85073c45-0e5e-4eba-9cd8-01c5a44ce23b tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac650232cc04810b1340dc2f0edadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b0670d1bd99424780a70e69d57a2166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:57.220381 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-85073c45-0e5e-4eba-9cd8-01c5a44ce23b tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "GET /compute/v2.1/servers/ac3f41f1-ed37-4009-81e5-7bee0ee6ea69" status: 200 len: 1214 microversion: 2.1 time: 0.231364 Oct 04 20:47:57.221315 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1588/3240] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:47:56 2022] GET /compute/v2.1/servers/ac3f41f1-ed37-4009-81e5-7bee0ee6ea69 => generated 1214 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:47:57.381944 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-750b7c31-3c25-4a65-9ec5-1a91a5b9668f tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:57.383032 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-750b7c31-3c25-4a65-9ec5-1a91a5b9668f tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] [instance: 041f0f59-75c7-4d01-bc99-77cb871f0fef] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:57.395578 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-bac5cdb4-a1fa-4941-a81d-64a203ef2d39 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6775b9d82b3444f6b728736f1d2b2806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5338cf2146344042bc263bdc4f9d822b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:57.398723 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-750b7c31-3c25-4a65-9ec5-1a91a5b9668f tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:57.400976 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-750b7c31-3c25-4a65-9ec5-1a91a5b9668f tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:57.402123 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-750b7c31-3c25-4a65-9ec5-1a91a5b9668f tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:57.406004 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-750b7c31-3c25-4a65-9ec5-1a91a5b9668f tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:57.406539 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-750b7c31-3c25-4a65-9ec5-1a91a5b9668f tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:57.406978 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-750b7c31-3c25-4a65-9ec5-1a91a5b9668f tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:57.412422 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-bac5cdb4-a1fa-4941-a81d-64a203ef2d39 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] 10.222.0.33 "GET /compute/v2.1/servers/40a02873-d2c2-42b7-a0b7-2b6125d490f3" status: 200 len: 1315 microversion: 2.1 time: 0.572718 Oct 04 20:47:57.417077 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1653/3241] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:47:56 2022] GET /compute/v2.1/servers/40a02873-d2c2-42b7-a0b7-2b6125d490f3 => generated 1315 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:47:57.640256 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-c97372f4-9957-4780-a1c0-9f8647db3b26 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:57.643043 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-c97372f4-9957-4780-a1c0-9f8647db3b26 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] [instance: c0a14e22-0620-4912-9893-62974c80978a] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:57.667792 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c97372f4-9957-4780-a1c0-9f8647db3b26 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:57.669823 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c97372f4-9957-4780-a1c0-9f8647db3b26 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:57.673134 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c97372f4-9957-4780-a1c0-9f8647db3b26 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:57.674010 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c97372f4-9957-4780-a1c0-9f8647db3b26 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:57.683051 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c97372f4-9957-4780-a1c0-9f8647db3b26 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:57.685016 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c97372f4-9957-4780-a1c0-9f8647db3b26 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:58.149273 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-c97372f4-9957-4780-a1c0-9f8647db3b26 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28399882314945d787a3af6eb59935c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5392c67506f7445ab33d62b191558f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:58.164066 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-750b7c31-3c25-4a65-9ec5-1a91a5b9668f tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87dcc7baf63f4ae6bfe0a099adffd408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7097bc12179446f6a3e1fac8434d5c64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:58.170332 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-c97372f4-9957-4780-a1c0-9f8647db3b26 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28399882314945d787a3af6eb59935c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5392c67506f7445ab33d62b191558f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:58.173352 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-750b7c31-3c25-4a65-9ec5-1a91a5b9668f tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] 10.222.0.33 "GET /compute/v2.1/servers/041f0f59-75c7-4d01-bc99-77cb871f0fef" status: 200 len: 1509 microversion: 2.1 time: 0.798193 Oct 04 20:47:58.179225 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1589/3242] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:47:57 2022] GET /compute/v2.1/servers/041f0f59-75c7-4d01-bc99-77cb871f0fef => generated 1509 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:47:58.185749 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-c97372f4-9957-4780-a1c0-9f8647db3b26 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28399882314945d787a3af6eb59935c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5392c67506f7445ab33d62b191558f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:58.199927 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-dd8857d7-73a9-448a-957e-8ee2c461551b tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Calling method '.version_select at 0x7f3c788bb5e0>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:58.205104 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-c97372f4-9957-4780-a1c0-9f8647db3b26 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] 10.222.0.33 "GET /compute/v2.1/servers/c0a14e22-0620-4912-9893-62974c80978a" status: 200 len: 1604 microversion: 2.32 time: 0.553511 Oct 04 20:47:58.206292 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1654/3243] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:47:57 2022] GET /compute/v2.1/servers/c0a14e22-0620-4912-9893-62974c80978a => generated 1604 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:47:58.212228 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-b951e203-5674-4628-8cef-910859fefa7c tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:58.220765 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-b951e203-5674-4628-8cef-910859fefa7c tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] [instance: c703a086-cf9d-4d12-8a18-623e454bcb64] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:58.237035 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b951e203-5674-4628-8cef-910859fefa7c tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:58.237994 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b951e203-5674-4628-8cef-910859fefa7c tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:58.238788 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b951e203-5674-4628-8cef-910859fefa7c tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:58.251183 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b951e203-5674-4628-8cef-910859fefa7c tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:58.252080 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b951e203-5674-4628-8cef-910859fefa7c tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:58.252752 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b951e203-5674-4628-8cef-910859fefa7c tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:58.311482 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-dd8857d7-73a9-448a-957e-8ee2c461551b tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] 10.222.0.33 "GET /compute/v2.1/images/802658f0-2596-4fe9-ad73-90b1f8423ede" status: 200 len: 1437 microversion: 2.1 time: 0.127810 Oct 04 20:47:58.323082 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1590/3244] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 20:47:58 2022] GET /compute/v2.1/images/802658f0-2596-4fe9-ad73-90b1f8423ede => generated 1437 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:47:58.328293 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-70037b78-815f-487e-bcba-1e9a7127a062 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:58.334965 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-b951e203-5674-4628-8cef-910859fefa7c tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] 10.222.0.33 "GET /compute/v2.1/servers/c703a086-cf9d-4d12-8a18-623e454bcb64/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.125314 Oct 04 20:47:58.340423 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1655/3245] 10.222.0.33 () {58 vars in 1302 bytes} [Tue Oct 4 20:47:58 2022] GET /compute/v2.1/servers/c703a086-cf9d-4d12-8a18-623e454bcb64/os-volume_attachments => generated 197 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:47:58.340979 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-70037b78-815f-487e-bcba-1e9a7127a062 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: ac3f41f1-ed37-4009-81e5-7bee0ee6ea69] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:58.352018 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-70037b78-815f-487e-bcba-1e9a7127a062 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:58.354921 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-70037b78-815f-487e-bcba-1e9a7127a062 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:58.357653 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-70037b78-815f-487e-bcba-1e9a7127a062 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:58.358612 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-70037b78-815f-487e-bcba-1e9a7127a062 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:58.359239 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-70037b78-815f-487e-bcba-1e9a7127a062 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:58.363498 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-70037b78-815f-487e-bcba-1e9a7127a062 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:58.371461 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:47:58.438832 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-ab1469e1-f780-42d0-b9f4-5fc8cb5b9d04 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:58.440110 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-ab1469e1-f780-42d0-b9f4-5fc8cb5b9d04 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] [instance: 40a02873-d2c2-42b7-a0b7-2b6125d490f3] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:58.453005 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ab1469e1-f780-42d0-b9f4-5fc8cb5b9d04 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:58.457987 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ab1469e1-f780-42d0-b9f4-5fc8cb5b9d04 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:58.460190 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ab1469e1-f780-42d0-b9f4-5fc8cb5b9d04 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:58.462300 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ab1469e1-f780-42d0-b9f4-5fc8cb5b9d04 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:58.467382 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ab1469e1-f780-42d0-b9f4-5fc8cb5b9d04 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:58.467982 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ab1469e1-f780-42d0-b9f4-5fc8cb5b9d04 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:58.788946 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-70037b78-815f-487e-bcba-1e9a7127a062 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac650232cc04810b1340dc2f0edadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b0670d1bd99424780a70e69d57a2166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:58.821560 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-70037b78-815f-487e-bcba-1e9a7127a062 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "GET /compute/v2.1/servers/ac3f41f1-ed37-4009-81e5-7bee0ee6ea69" status: 200 len: 1218 microversion: 2.1 time: 0.496980 Oct 04 20:47:58.824905 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1591/3246] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:47:58 2022] GET /compute/v2.1/servers/ac3f41f1-ed37-4009-81e5-7bee0ee6ea69 => generated 1218 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:47:59.110809 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-ab1469e1-f780-42d0-b9f4-5fc8cb5b9d04 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6775b9d82b3444f6b728736f1d2b2806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5338cf2146344042bc263bdc4f9d822b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:47:59.120952 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-ab1469e1-f780-42d0-b9f4-5fc8cb5b9d04 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] 10.222.0.33 "GET /compute/v2.1/servers/40a02873-d2c2-42b7-a0b7-2b6125d490f3" status: 200 len: 1503 microversion: 2.1 time: 0.687689 Oct 04 20:47:59.125178 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1656/3247] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:47:58 2022] GET /compute/v2.1/servers/40a02873-d2c2-42b7-a0b7-2b6125d490f3 => generated 1503 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:47:59.149081 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d8145b11-0bdf-4f76-8aac-0628ab75a493 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1810366648"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:47:59.150531 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d8145b11-0bdf-4f76-8aac-0628ab75a493 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] [instance: 40a02873-d2c2-42b7-a0b7-2b6125d490f3] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:59.167388 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d8145b11-0bdf-4f76-8aac-0628ab75a493 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:59.174809 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d8145b11-0bdf-4f76-8aac-0628ab75a493 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:59.179068 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d8145b11-0bdf-4f76-8aac-0628ab75a493 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:59.180029 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d8145b11-0bdf-4f76-8aac-0628ab75a493 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:59.184633 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d8145b11-0bdf-4f76-8aac-0628ab75a493 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:59.195116 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d8145b11-0bdf-4f76-8aac-0628ab75a493 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:59.211596 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-f05dec6c-44ae-4e86-a787-043083991123 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:47:59.213125 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-f05dec6c-44ae-4e86-a787-043083991123 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] [instance: 041f0f59-75c7-4d01-bc99-77cb871f0fef] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:47:59.221321 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f05dec6c-44ae-4e86-a787-043083991123 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:59.226089 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f05dec6c-44ae-4e86-a787-043083991123 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:59.234896 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f05dec6c-44ae-4e86-a787-043083991123 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:47:59.243950 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f05dec6c-44ae-4e86-a787-043083991123 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:47:59.247440 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f05dec6c-44ae-4e86-a787-043083991123 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:47:59.248172 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f05dec6c-44ae-4e86-a787-043083991123 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:00.021178 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-f05dec6c-44ae-4e86-a787-043083991123 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87dcc7baf63f4ae6bfe0a099adffd408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7097bc12179446f6a3e1fac8434d5c64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:00.030597 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-f05dec6c-44ae-4e86-a787-043083991123 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] 10.222.0.33 "GET /compute/v2.1/servers/041f0f59-75c7-4d01-bc99-77cb871f0fef" status: 200 len: 1509 microversion: 2.1 time: 0.822824 Oct 04 20:48:00.031211 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1657/3248] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:47:59 2022] GET /compute/v2.1/servers/041f0f59-75c7-4d01-bc99-77cb871f0fef => generated 1509 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:48:00.063405 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-7b28a4c7-cdec-48b1-8b53-1a2eec431961 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:00.064052 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-7b28a4c7-cdec-48b1-8b53-1a2eec431961 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] [instance: c0a14e22-0620-4912-9893-62974c80978a] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:00.078081 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7b28a4c7-cdec-48b1-8b53-1a2eec431961 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:00.087087 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7b28a4c7-cdec-48b1-8b53-1a2eec431961 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:00.087897 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7b28a4c7-cdec-48b1-8b53-1a2eec431961 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:00.091278 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7b28a4c7-cdec-48b1-8b53-1a2eec431961 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:00.091968 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7b28a4c7-cdec-48b1-8b53-1a2eec431961 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:00.092802 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7b28a4c7-cdec-48b1-8b53-1a2eec431961 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:00.224994 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.network.security_group_api [None req-d8145b11-0bdf-4f76-8aac-0628ab75a493 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Adding security group eb9a82fe-0716-4387-9aef-13d047bc739e to port ab3cba0a-dc15-4028-b7e0-d50faae0a9e5 Oct 04 20:48:00.359790 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-7b28a4c7-cdec-48b1-8b53-1a2eec431961 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28399882314945d787a3af6eb59935c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5392c67506f7445ab33d62b191558f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:00.375204 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-7b28a4c7-cdec-48b1-8b53-1a2eec431961 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28399882314945d787a3af6eb59935c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5392c67506f7445ab33d62b191558f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:00.377122 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-7b28a4c7-cdec-48b1-8b53-1a2eec431961 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28399882314945d787a3af6eb59935c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5392c67506f7445ab33d62b191558f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:00.379185 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-7b28a4c7-cdec-48b1-8b53-1a2eec431961 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] 10.222.0.33 "GET /compute/v2.1/servers/c0a14e22-0620-4912-9893-62974c80978a" status: 200 len: 1604 microversion: 2.32 time: 0.346390 Oct 04 20:48:00.381512 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1658/3249] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:48:00 2022] GET /compute/v2.1/servers/c0a14e22-0620-4912-9893-62974c80978a => generated 1604 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:48:00.421958 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-079e833f-38a9-42f7-a88f-4a1fde2430de tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Calling method '.version_select at 0x7f3c789de940>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:00.495342 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-079e833f-38a9-42f7-a88f-4a1fde2430de tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] 10.222.0.33 "GET /compute/v2.1/images/802658f0-2596-4fe9-ad73-90b1f8423ede" status: 200 len: 1437 microversion: 2.1 time: 0.112545 Oct 04 20:48:00.504898 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1659/3250] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 20:48:00 2022] GET /compute/v2.1/images/802658f0-2596-4fe9-ad73-90b1f8423ede => generated 1437 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:48:00.510125 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-8722486d-b814-4318-8e1e-445a988d478f tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:00.512507 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-8722486d-b814-4318-8e1e-445a988d478f tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] [instance: c703a086-cf9d-4d12-8a18-623e454bcb64] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:00.531480 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8722486d-b814-4318-8e1e-445a988d478f tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:00.531984 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8722486d-b814-4318-8e1e-445a988d478f tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:00.532429 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8722486d-b814-4318-8e1e-445a988d478f tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:00.533154 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8722486d-b814-4318-8e1e-445a988d478f tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:00.533620 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8722486d-b814-4318-8e1e-445a988d478f tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:00.534054 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8722486d-b814-4318-8e1e-445a988d478f tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:00.633397 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-8722486d-b814-4318-8e1e-445a988d478f tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] 10.222.0.33 "GET /compute/v2.1/servers/c703a086-cf9d-4d12-8a18-623e454bcb64/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.127150 Oct 04 20:48:00.633907 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1660/3251] 10.222.0.33 () {58 vars in 1302 bytes} [Tue Oct 4 20:48:00 2022] GET /compute/v2.1/servers/c703a086-cf9d-4d12-8a18-623e454bcb64/os-volume_attachments => generated 197 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:48:00.657384 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-575e4132-0e5b-497d-be98-96996a387da4 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:00.664157 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-575e4132-0e5b-497d-be98-96996a387da4 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: ac3f41f1-ed37-4009-81e5-7bee0ee6ea69] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:00.677398 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-575e4132-0e5b-497d-be98-96996a387da4 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:00.678205 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-575e4132-0e5b-497d-be98-96996a387da4 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:00.679556 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-575e4132-0e5b-497d-be98-96996a387da4 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:00.684079 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-575e4132-0e5b-497d-be98-96996a387da4 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:00.684809 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-575e4132-0e5b-497d-be98-96996a387da4 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:00.686165 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-575e4132-0e5b-497d-be98-96996a387da4 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:00.797130 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-575e4132-0e5b-497d-be98-96996a387da4 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac650232cc04810b1340dc2f0edadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b0670d1bd99424780a70e69d57a2166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:00.805724 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-575e4132-0e5b-497d-be98-96996a387da4 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "GET /compute/v2.1/servers/ac3f41f1-ed37-4009-81e5-7bee0ee6ea69" status: 200 len: 1272 microversion: 2.1 time: 0.156127 Oct 04 20:48:00.813380 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1661/3252] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:48:00 2022] GET /compute/v2.1/servers/ac3f41f1-ed37-4009-81e5-7bee0ee6ea69 => generated 1272 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:48:01.057572 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-e3fd76f9-3d26-4fc1-8028-f0815f5e6d18 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:01.059180 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-e3fd76f9-3d26-4fc1-8028-f0815f5e6d18 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] [instance: 041f0f59-75c7-4d01-bc99-77cb871f0fef] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:01.073743 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e3fd76f9-3d26-4fc1-8028-f0815f5e6d18 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:01.074641 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e3fd76f9-3d26-4fc1-8028-f0815f5e6d18 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:01.075274 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e3fd76f9-3d26-4fc1-8028-f0815f5e6d18 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:01.076448 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e3fd76f9-3d26-4fc1-8028-f0815f5e6d18 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:01.077073 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e3fd76f9-3d26-4fc1-8028-f0815f5e6d18 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:01.084330 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e3fd76f9-3d26-4fc1-8028-f0815f5e6d18 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:01.457780 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-e3fd76f9-3d26-4fc1-8028-f0815f5e6d18 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87dcc7baf63f4ae6bfe0a099adffd408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7097bc12179446f6a3e1fac8434d5c64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:01.475510 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-e3fd76f9-3d26-4fc1-8028-f0815f5e6d18 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] 10.222.0.33 "GET /compute/v2.1/servers/041f0f59-75c7-4d01-bc99-77cb871f0fef" status: 200 len: 1509 microversion: 2.1 time: 0.422282 Oct 04 20:48:01.476758 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1662/3253] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:48:01 2022] GET /compute/v2.1/servers/041f0f59-75c7-4d01-bc99-77cb871f0fef => generated 1509 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:48:01.482441 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-35520a59-174e-40db-aa42-4541b0400528 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:01.483875 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-35520a59-174e-40db-aa42-4541b0400528 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] [instance: c0a14e22-0620-4912-9893-62974c80978a] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:01.496953 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-35520a59-174e-40db-aa42-4541b0400528 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:01.500782 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-35520a59-174e-40db-aa42-4541b0400528 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:01.501498 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-35520a59-174e-40db-aa42-4541b0400528 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:01.502489 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-35520a59-174e-40db-aa42-4541b0400528 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:01.503125 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-35520a59-174e-40db-aa42-4541b0400528 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:01.505776 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-35520a59-174e-40db-aa42-4541b0400528 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:01.756085 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-35520a59-174e-40db-aa42-4541b0400528 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28399882314945d787a3af6eb59935c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5392c67506f7445ab33d62b191558f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:01.769466 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-35520a59-174e-40db-aa42-4541b0400528 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28399882314945d787a3af6eb59935c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5392c67506f7445ab33d62b191558f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:01.784338 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-35520a59-174e-40db-aa42-4541b0400528 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28399882314945d787a3af6eb59935c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5392c67506f7445ab33d62b191558f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:01.786745 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-35520a59-174e-40db-aa42-4541b0400528 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] 10.222.0.33 "GET /compute/v2.1/servers/c0a14e22-0620-4912-9893-62974c80978a" status: 200 len: 1604 microversion: 2.32 time: 0.308735 Oct 04 20:48:01.787880 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1663/3254] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:48:01 2022] GET /compute/v2.1/servers/c0a14e22-0620-4912-9893-62974c80978a => generated 1604 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:48:01.806490 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-6daa8a24-aa83-42ba-aca9-228d3d6c25d2 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Calling method '.version_select at 0x7f3c744ec280>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:01.909385 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-6daa8a24-aa83-42ba-aca9-228d3d6c25d2 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] 10.222.0.33 "GET /compute/v2.1/images/802658f0-2596-4fe9-ad73-90b1f8423ede" status: 200 len: 1437 microversion: 2.1 time: 0.120076 Oct 04 20:48:01.912135 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1664/3255] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 20:48:01 2022] GET /compute/v2.1/images/802658f0-2596-4fe9-ad73-90b1f8423ede => generated 1437 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:48:01.929227 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-8d0921d7-61de-4aaf-be8a-74f505607ef4 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:01.937503 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-8d0921d7-61de-4aaf-be8a-74f505607ef4 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] [instance: c703a086-cf9d-4d12-8a18-623e454bcb64] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:01.952999 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8d0921d7-61de-4aaf-be8a-74f505607ef4 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:01.955975 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8d0921d7-61de-4aaf-be8a-74f505607ef4 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:01.956800 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8d0921d7-61de-4aaf-be8a-74f505607ef4 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:01.957702 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8d0921d7-61de-4aaf-be8a-74f505607ef4 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:01.958319 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8d0921d7-61de-4aaf-be8a-74f505607ef4 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:01.959039 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8d0921d7-61de-4aaf-be8a-74f505607ef4 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:02.001095 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-8d0921d7-61de-4aaf-be8a-74f505607ef4 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] 10.222.0.33 "GET /compute/v2.1/servers/c703a086-cf9d-4d12-8a18-623e454bcb64/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.084307 Oct 04 20:48:02.019494 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1665/3256] 10.222.0.33 () {58 vars in 1302 bytes} [Tue Oct 4 20:48:01 2022] GET /compute/v2.1/servers/c703a086-cf9d-4d12-8a18-623e454bcb64/os-volume_attachments => generated 25 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 20:48:02.035666 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-41e756f0-adad-4941-ade7-bfb69024c410 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:02.036775 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-41e756f0-adad-4941-ade7-bfb69024c410 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: ac3f41f1-ed37-4009-81e5-7bee0ee6ea69] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:02.049694 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-41e756f0-adad-4941-ade7-bfb69024c410 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:02.051204 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-41e756f0-adad-4941-ade7-bfb69024c410 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:02.051806 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-41e756f0-adad-4941-ade7-bfb69024c410 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:02.053065 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-41e756f0-adad-4941-ade7-bfb69024c410 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:02.053800 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-41e756f0-adad-4941-ade7-bfb69024c410 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:02.054415 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-41e756f0-adad-4941-ade7-bfb69024c410 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:02.235993 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-41e756f0-adad-4941-ade7-bfb69024c410 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac650232cc04810b1340dc2f0edadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b0670d1bd99424780a70e69d57a2166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:02.259094 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-41e756f0-adad-4941-ade7-bfb69024c410 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "GET /compute/v2.1/servers/ac3f41f1-ed37-4009-81e5-7bee0ee6ea69" status: 200 len: 1272 microversion: 2.1 time: 0.236997 Oct 04 20:48:02.276866 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1666/3257] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:48:02 2022] GET /compute/v2.1/servers/ac3f41f1-ed37-4009-81e5-7bee0ee6ea69 => generated 1272 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:48:02.295098 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-5b81e168-6697-45d0-9c1e-543ec81e2f74 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:02.297016 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-5b81e168-6697-45d0-9c1e-543ec81e2f74 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] [instance: c703a086-cf9d-4d12-8a18-623e454bcb64] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:02.312507 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5b81e168-6697-45d0-9c1e-543ec81e2f74 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:02.314456 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5b81e168-6697-45d0-9c1e-543ec81e2f74 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:02.316361 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5b81e168-6697-45d0-9c1e-543ec81e2f74 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:02.318623 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5b81e168-6697-45d0-9c1e-543ec81e2f74 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:02.320231 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5b81e168-6697-45d0-9c1e-543ec81e2f74 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:02.320869 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5b81e168-6697-45d0-9c1e-543ec81e2f74 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:02.329665 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=100 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:48:02.393542 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-5b81e168-6697-45d0-9c1e-543ec81e2f74 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] [instance: c703a086-cf9d-4d12-8a18-623e454bcb64] Going to try to terminate instance {{(pid=128802) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:48:02.560491 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-5b81e168-6697-45d0-9c1e-543ec81e2f74 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] 10.222.0.33 "DELETE /compute/v2.1/servers/c703a086-cf9d-4d12-8a18-623e454bcb64" status: 204 len: 0 microversion: 2.1 time: 0.281800 Oct 04 20:48:02.565336 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1667/3258] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 20:48:02 2022] DELETE /compute/v2.1/servers/c703a086-cf9d-4d12-8a18-623e454bcb64 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:48:02.569140 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d8145b11-0bdf-4f76-8aac-0628ab75a493 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] 10.222.0.33 "POST /compute/v2.1/servers/40a02873-d2c2-42b7-a0b7-2b6125d490f3/action" status: 202 len: 0 microversion: 2.1 time: 3.423867 Oct 04 20:48:02.570278 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1592/3259] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 20:47:59 2022] POST /compute/v2.1/servers/40a02873-d2c2-42b7-a0b7-2b6125d490f3/action => generated 0 bytes in 3426 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:48:02.575134 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-413087f0-f209-42ca-b316-98ab8fc08eb5 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:02.576100 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-413087f0-f209-42ca-b316-98ab8fc08eb5 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] [instance: c703a086-cf9d-4d12-8a18-623e454bcb64] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:02.587454 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-92513618-872e-4a55-a1e0-01b81474ad37 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:02.591105 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-92513618-872e-4a55-a1e0-01b81474ad37 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] [instance: 041f0f59-75c7-4d01-bc99-77cb871f0fef] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:02.607280 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-92513618-872e-4a55-a1e0-01b81474ad37 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:02.609018 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-92513618-872e-4a55-a1e0-01b81474ad37 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:02.609610 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-413087f0-f209-42ca-b316-98ab8fc08eb5 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:02.610312 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-413087f0-f209-42ca-b316-98ab8fc08eb5 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:02.610904 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-413087f0-f209-42ca-b316-98ab8fc08eb5 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:02.611796 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-413087f0-f209-42ca-b316-98ab8fc08eb5 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:02.613518 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-92513618-872e-4a55-a1e0-01b81474ad37 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:02.614494 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-92513618-872e-4a55-a1e0-01b81474ad37 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:02.614967 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-92513618-872e-4a55-a1e0-01b81474ad37 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:02.615653 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-413087f0-f209-42ca-b316-98ab8fc08eb5 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:02.617315 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-413087f0-f209-42ca-b316-98ab8fc08eb5 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:02.618902 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-92513618-872e-4a55-a1e0-01b81474ad37 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:03.809462 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-413087f0-f209-42ca-b316-98ab8fc08eb5 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e4b00964014a0383f79597652bd428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7f38600b5041ad8e66a12d77b940fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:03.823774 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-413087f0-f209-42ca-b316-98ab8fc08eb5 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] 10.222.0.33 "GET /compute/v2.1/servers/c703a086-cf9d-4d12-8a18-623e454bcb64" status: 200 len: 1680 microversion: 2.1 time: 1.252248 Oct 04 20:48:03.844145 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1593/3260] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:48:02 2022] GET /compute/v2.1/servers/c703a086-cf9d-4d12-8a18-623e454bcb64 => generated 1680 bytes in 1273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:48:03.854547 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a0748cd4-15d4-42d9-b477-704a5404bd77 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1667022549"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:48:03.855371 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a0748cd4-15d4-42d9-b477-704a5404bd77 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] [instance: 40a02873-d2c2-42b7-a0b7-2b6125d490f3] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:03.874495 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a0748cd4-15d4-42d9-b477-704a5404bd77 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:03.875378 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a0748cd4-15d4-42d9-b477-704a5404bd77 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:03.876140 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a0748cd4-15d4-42d9-b477-704a5404bd77 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:03.877875 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a0748cd4-15d4-42d9-b477-704a5404bd77 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:03.879205 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a0748cd4-15d4-42d9-b477-704a5404bd77 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:03.880029 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a0748cd4-15d4-42d9-b477-704a5404bd77 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:04.257352 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-92513618-872e-4a55-a1e0-01b81474ad37 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87dcc7baf63f4ae6bfe0a099adffd408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7097bc12179446f6a3e1fac8434d5c64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:04.266681 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-92513618-872e-4a55-a1e0-01b81474ad37 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] 10.222.0.33 "GET /compute/v2.1/servers/041f0f59-75c7-4d01-bc99-77cb871f0fef" status: 200 len: 1509 microversion: 2.1 time: 1.699197 Oct 04 20:48:04.274928 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1668/3261] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:48:02 2022] GET /compute/v2.1/servers/041f0f59-75c7-4d01-bc99-77cb871f0fef => generated 1509 bytes in 1708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:48:04.282116 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-d637f9fb-dbe1-422c-8531-0a3984ad2d2c req-2e43a88b-f2c2-48dd-9461-549100665fbd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40a02873-d2c2-42b7-a0b7-2b6125d490f3", "tag": "ab3cba0a-dc15-4028-b7e0-d50faae0a9e5"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:48:04.312948 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-d637f9fb-dbe1-422c-8531-0a3984ad2d2c req-2e43a88b-f2c2-48dd-9461-549100665fbd service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:04.313688 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-d637f9fb-dbe1-422c-8531-0a3984ad2d2c req-2e43a88b-f2c2-48dd-9461-549100665fbd service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:04.314329 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-d637f9fb-dbe1-422c-8531-0a3984ad2d2c req-2e43a88b-f2c2-48dd-9461-549100665fbd service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:04.332887 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-d637f9fb-dbe1-422c-8531-0a3984ad2d2c req-2e43a88b-f2c2-48dd-9461-549100665fbd service nova] Creating event network-changed:ab3cba0a-dc15-4028-b7e0-d50faae0a9e5 for instance 40a02873-d2c2-42b7-a0b7-2b6125d490f3 on n-h1-854823-8 Oct 04 20:48:04.348003 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-d637f9fb-dbe1-422c-8531-0a3984ad2d2c req-2e43a88b-f2c2-48dd-9461-549100665fbd service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071147 Oct 04 20:48:04.349135 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1669/3262] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:48:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:48:04.367053 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-7006ed1b-4a8f-4b47-983d-2c0c7874388a tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:04.368209 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-7006ed1b-4a8f-4b47-983d-2c0c7874388a tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] [instance: c0a14e22-0620-4912-9893-62974c80978a] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:04.376299 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7006ed1b-4a8f-4b47-983d-2c0c7874388a tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:04.376993 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7006ed1b-4a8f-4b47-983d-2c0c7874388a tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:04.377556 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7006ed1b-4a8f-4b47-983d-2c0c7874388a tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:04.379831 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7006ed1b-4a8f-4b47-983d-2c0c7874388a tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:04.381038 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7006ed1b-4a8f-4b47-983d-2c0c7874388a tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:04.381590 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7006ed1b-4a8f-4b47-983d-2c0c7874388a tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:04.577552 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-7006ed1b-4a8f-4b47-983d-2c0c7874388a tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28399882314945d787a3af6eb59935c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5392c67506f7445ab33d62b191558f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:04.591196 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-7006ed1b-4a8f-4b47-983d-2c0c7874388a tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28399882314945d787a3af6eb59935c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5392c67506f7445ab33d62b191558f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:04.592664 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-7006ed1b-4a8f-4b47-983d-2c0c7874388a tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28399882314945d787a3af6eb59935c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5392c67506f7445ab33d62b191558f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:04.593889 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-7006ed1b-4a8f-4b47-983d-2c0c7874388a tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] 10.222.0.33 "GET /compute/v2.1/servers/c0a14e22-0620-4912-9893-62974c80978a" status: 200 len: 1604 microversion: 2.32 time: 0.243547 Oct 04 20:48:04.610652 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1670/3263] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:48:04 2022] GET /compute/v2.1/servers/c0a14e22-0620-4912-9893-62974c80978a => generated 1604 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:48:04.618354 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-821c4b35-ec7f-4579-9c67-6dd1f6d74347 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Calling method '.version_select at 0x7f3c74b42ca0>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:04.786825 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-821c4b35-ec7f-4579-9c67-6dd1f6d74347 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] 10.222.0.33 "GET /compute/v2.1/images/802658f0-2596-4fe9-ad73-90b1f8423ede" status: 200 len: 1437 microversion: 2.1 time: 0.184198 Oct 04 20:48:04.788286 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1671/3264] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 20:48:04 2022] GET /compute/v2.1/images/802658f0-2596-4fe9-ad73-90b1f8423ede => generated 1437 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:48:04.812061 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-22ddae21-658a-4e5a-ba56-5e32c011165c tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:04.814529 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-22ddae21-658a-4e5a-ba56-5e32c011165c tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: ac3f41f1-ed37-4009-81e5-7bee0ee6ea69] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:04.828808 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-22ddae21-658a-4e5a-ba56-5e32c011165c tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:04.829511 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-22ddae21-658a-4e5a-ba56-5e32c011165c tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:04.830146 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-22ddae21-658a-4e5a-ba56-5e32c011165c tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:04.831392 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-22ddae21-658a-4e5a-ba56-5e32c011165c tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:04.835055 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-22ddae21-658a-4e5a-ba56-5e32c011165c tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:04.835712 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-22ddae21-658a-4e5a-ba56-5e32c011165c tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:05.090331 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.network.security_group_api [None req-a0748cd4-15d4-42d9-b477-704a5404bd77 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Adding security group d1fec54a-a288-4997-9c3d-bbf495fa41d9 to port ab3cba0a-dc15-4028-b7e0-d50faae0a9e5 Oct 04 20:48:06.253811 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-22ddae21-658a-4e5a-ba56-5e32c011165c tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac650232cc04810b1340dc2f0edadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b0670d1bd99424780a70e69d57a2166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:06.295044 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-22ddae21-658a-4e5a-ba56-5e32c011165c tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "GET /compute/v2.1/servers/ac3f41f1-ed37-4009-81e5-7bee0ee6ea69" status: 200 len: 1314 microversion: 2.1 time: 1.502927 Oct 04 20:48:06.297472 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1672/3265] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:48:04 2022] GET /compute/v2.1/servers/ac3f41f1-ed37-4009-81e5-7bee0ee6ea69 => generated 1314 bytes in 1508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:48:06.314199 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-0e6ddae3-a852-444b-b594-1886e6a78574 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:06.317695 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-0e6ddae3-a852-444b-b594-1886e6a78574 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] [instance: c703a086-cf9d-4d12-8a18-623e454bcb64] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:06.334308 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0e6ddae3-a852-444b-b594-1886e6a78574 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:06.335106 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0e6ddae3-a852-444b-b594-1886e6a78574 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:06.339808 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0e6ddae3-a852-444b-b594-1886e6a78574 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:06.340940 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0e6ddae3-a852-444b-b594-1886e6a78574 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:06.341580 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0e6ddae3-a852-444b-b594-1886e6a78574 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:06.342334 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0e6ddae3-a852-444b-b594-1886e6a78574 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:06.666587 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-0e6ddae3-a852-444b-b594-1886e6a78574 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e4b00964014a0383f79597652bd428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7f38600b5041ad8e66a12d77b940fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:06.687415 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-0e6ddae3-a852-444b-b594-1886e6a78574 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] 10.222.0.33 "GET /compute/v2.1/servers/c703a086-cf9d-4d12-8a18-623e454bcb64" status: 200 len: 1613 microversion: 2.1 time: 0.387320 Oct 04 20:48:06.716982 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1673/3266] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:48:06 2022] GET /compute/v2.1/servers/c703a086-cf9d-4d12-8a18-623e454bcb64 => generated 1613 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:48:06.727180 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-15348a24-7650-4633-9d1b-972d1543a4ef tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:06.728069 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-15348a24-7650-4633-9d1b-972d1543a4ef tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] [instance: 041f0f59-75c7-4d01-bc99-77cb871f0fef] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:06.742253 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-15348a24-7650-4633-9d1b-972d1543a4ef tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:06.743037 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-15348a24-7650-4633-9d1b-972d1543a4ef tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:06.743673 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-15348a24-7650-4633-9d1b-972d1543a4ef tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:06.745273 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-15348a24-7650-4633-9d1b-972d1543a4ef tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:06.745933 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-15348a24-7650-4633-9d1b-972d1543a4ef tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:06.746590 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-15348a24-7650-4633-9d1b-972d1543a4ef tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:06.776779 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:48:07.219363 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=8 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:48:09.549570 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-15348a24-7650-4633-9d1b-972d1543a4ef tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87dcc7baf63f4ae6bfe0a099adffd408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7097bc12179446f6a3e1fac8434d5c64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:09.558650 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-15348a24-7650-4633-9d1b-972d1543a4ef tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] 10.222.0.33 "GET /compute/v2.1/servers/041f0f59-75c7-4d01-bc99-77cb871f0fef" status: 200 len: 1486 microversion: 2.1 time: 2.836725 Oct 04 20:48:09.563110 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1674/3267] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:48:06 2022] GET /compute/v2.1/servers/041f0f59-75c7-4d01-bc99-77cb871f0fef => generated 1486 bytes in 2844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:48:09.590742 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-cbf06e61-82cb-4dc2-9753-8344aceceb60 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:09.591614 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-cbf06e61-82cb-4dc2-9753-8344aceceb60 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] [instance: c0a14e22-0620-4912-9893-62974c80978a] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:09.616901 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a0748cd4-15d4-42d9-b477-704a5404bd77 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] 10.222.0.33 "POST /compute/v2.1/servers/40a02873-d2c2-42b7-a0b7-2b6125d490f3/action" status: 202 len: 0 microversion: 2.1 time: 5.771130 Oct 04 20:48:09.618428 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cbf06e61-82cb-4dc2-9753-8344aceceb60 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:09.619125 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cbf06e61-82cb-4dc2-9753-8344aceceb60 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:09.621315 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cbf06e61-82cb-4dc2-9753-8344aceceb60 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:09.621474 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1594/3268] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 20:48:03 2022] POST /compute/v2.1/servers/40a02873-d2c2-42b7-a0b7-2b6125d490f3/action => generated 0 bytes in 5776 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:48:09.624041 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cbf06e61-82cb-4dc2-9753-8344aceceb60 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:09.625824 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cbf06e61-82cb-4dc2-9753-8344aceceb60 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:09.627560 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-eb47dc66-9707-474e-9847-147bd43f9688 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Calling method '.version_select at 0x7f3c788bb9d0>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:09.628829 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cbf06e61-82cb-4dc2-9753-8344aceceb60 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:09.696883 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-eb47dc66-9707-474e-9847-147bd43f9688 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] 10.222.0.33 "GET /compute/v2.1/images/802658f0-2596-4fe9-ad73-90b1f8423ede" status: 200 len: 1437 microversion: 2.1 time: 0.074225 Oct 04 20:48:09.698163 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1595/3269] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 20:48:09 2022] GET /compute/v2.1/images/802658f0-2596-4fe9-ad73-90b1f8423ede => generated 1437 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:48:09.704401 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-dbc83890-7f85-443d-be8a-09332ba5975a tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:09.705613 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-dbc83890-7f85-443d-be8a-09332ba5975a tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: ac3f41f1-ed37-4009-81e5-7bee0ee6ea69] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:09.727914 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dbc83890-7f85-443d-be8a-09332ba5975a tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:09.730111 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dbc83890-7f85-443d-be8a-09332ba5975a tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:09.732702 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dbc83890-7f85-443d-be8a-09332ba5975a tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:09.735504 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dbc83890-7f85-443d-be8a-09332ba5975a tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:09.736253 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dbc83890-7f85-443d-be8a-09332ba5975a tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:09.736919 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dbc83890-7f85-443d-be8a-09332ba5975a tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:10.167562 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-cbf06e61-82cb-4dc2-9753-8344aceceb60 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28399882314945d787a3af6eb59935c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5392c67506f7445ab33d62b191558f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:10.189377 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-cbf06e61-82cb-4dc2-9753-8344aceceb60 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28399882314945d787a3af6eb59935c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5392c67506f7445ab33d62b191558f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:10.191443 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-cbf06e61-82cb-4dc2-9753-8344aceceb60 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28399882314945d787a3af6eb59935c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5392c67506f7445ab33d62b191558f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:10.206081 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-cbf06e61-82cb-4dc2-9753-8344aceceb60 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] 10.222.0.33 "GET /compute/v2.1/servers/c0a14e22-0620-4912-9893-62974c80978a" status: 200 len: 1604 microversion: 2.32 time: 0.641684 Oct 04 20:48:10.216108 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1675/3270] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:48:09 2022] GET /compute/v2.1/servers/c0a14e22-0620-4912-9893-62974c80978a => generated 1604 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:48:10.237816 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-8dae0f63-ff1f-4ec3-bcd4-c2958ded79ff tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:10.238555 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-8dae0f63-ff1f-4ec3-bcd4-c2958ded79ff tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] [instance: c703a086-cf9d-4d12-8a18-623e454bcb64] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:10.266822 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8dae0f63-ff1f-4ec3-bcd4-c2958ded79ff tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:10.267336 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8dae0f63-ff1f-4ec3-bcd4-c2958ded79ff tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:10.273614 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8dae0f63-ff1f-4ec3-bcd4-c2958ded79ff tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:10.274518 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8dae0f63-ff1f-4ec3-bcd4-c2958ded79ff tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:10.286786 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8dae0f63-ff1f-4ec3-bcd4-c2958ded79ff tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:10.288447 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8dae0f63-ff1f-4ec3-bcd4-c2958ded79ff tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:10.309286 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.wsgi [None req-8dae0f63-ff1f-4ec3-bcd4-c2958ded79ff tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] HTTP exception thrown: Instance c703a086-cf9d-4d12-8a18-623e454bcb64 could not be found. Oct 04 20:48:10.311241 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-8dae0f63-ff1f-4ec3-bcd4-c2958ded79ff tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Request method failure captured: Oct 04 20:48:10.311241 n-d-854823-8 devstack@n-api.service[128802]: request: GET /compute/v2.1/servers/c703a086-cf9d-4d12-8a18-623e454bcb64 HTTP/1.1 Oct 04 20:48:10.311241 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 20:48:10.311241 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 20:48:10.311241 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 20:48:10.311241 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 0 Oct 04 20:48:10.311241 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 20:48:10.311241 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 20:48:10.311241 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 20:48:10.311241 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 20:48:10.311241 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPJq81PAuDsDZpxdj7sHNmNgvbOtGh6iX1oPKSmvHZUw9x7ULWvp7QM5iDniQ-MHWL89bpVZnLKWftCcZuFrmOzCFwz5uJr5u54napWSUn77riQgg7pFlU7FKzu5ArjbUA7EV4GWtihdoiqsY9U5RhjRJWZh-5HATJMChglPcLjaAY6g Oct 04 20:48:10.311241 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 20:48:10.311241 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 20:48:10.311241 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 20:48:10.311241 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 20:48:10.311241 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 20:48:10.311241 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 20:48:10.311241 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: fc7f38600b5041ad8e66a12d77b940fa Oct 04 20:48:10.311241 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-AttachVolumeNegativeTest-16853026 Oct 04 20:48:10.311241 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 20:48:10.311241 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 20:48:10.311241 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_fc7f38600b5041ad8e66a12d77b940fa", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fc7f38600b5041ad8e66a12d77b940fa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fc7f38600b5041ad8e66a12d77b940fa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/fc7f38600b5041ad8e66a12d77b940fa"}]}] Oct 04 20:48:10.311241 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-AttachVolumeNegativeTest-16853026 Oct 04 20:48:10.311241 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: fc7f38600b5041ad8e66a12d77b940fa Oct 04 20:48:10.311241 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-16853026 Oct 04 20:48:10.311241 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-AttachVolumeNegativeTest-16853026-project Oct 04 20:48:10.311241 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 20:48:10.311241 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 20:48:10.311241 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: d9e4b00964014a0383f79597652bd428 Oct 04 20:48:10.311241 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-AttachVolumeNegativeTest-16853026-project Oct 04 20:48:10.311241 n-d-854823-8 devstack@n-api.service[128802]: method: > Oct 04 20:48:10.311241 n-d-854823-8 devstack@n-api.service[128802]: exception: Instance c703a086-cf9d-4d12-8a18-623e454bcb64 could not be found. Oct 04 20:48:10.311241 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'id': 'c703a086-cf9d-4d12-8a18-623e454bcb64'} Oct 04 20:48:10.311241 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:48:10.311241 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:48:10.311241 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:48:10.311241 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:48:10.311241 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:48:10.311241 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:48:10.311241 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:48:10.311241 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:48:10.311241 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:48:10.311241 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:48:10.311241 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c703a086-cf9d-4d12-8a18-623e454bcb64 could not be found. Oct 04 20:48:10.311241 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:48:10.311241 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:48:10.311241 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:48:10.311241 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:48:10.311241 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:48:10.311241 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:48:10.311241 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:48:10.311241 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:48:10.311241 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:48:10.311241 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:48:10.311241 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:48:10.311241 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:48:10.311241 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:48:10.311241 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:48:10.311241 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:48:10.311241 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:48:10.311241 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c703a086-cf9d-4d12-8a18-623e454bcb64 could not be found. Oct 04 20:48:10.311241 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:48:10.311241 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:48:10.311241 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:48:10.317634 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:48:10.317634 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:48:10.317634 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:48:10.317634 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:48:10.317634 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:48:10.317634 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c703a086-cf9d-4d12-8a18-623e454bcb64 could not be found. Oct 04 20:48:10.317634 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:48:10.320474 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-8dae0f63-ff1f-4ec3-bcd4-c2958ded79ff tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Returning 404 to user: Instance c703a086-cf9d-4d12-8a18-623e454bcb64 could not be found. {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:48:10.321540 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-8dae0f63-ff1f-4ec3-bcd4-c2958ded79ff tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] 10.222.0.33 "GET /compute/v2.1/servers/c703a086-cf9d-4d12-8a18-623e454bcb64" status: 404 len: 111 microversion: 2.1 time: 0.104154 Oct 04 20:48:10.323285 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1676/3271] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:48:10 2022] GET /compute/v2.1/servers/c703a086-cf9d-4d12-8a18-623e454bcb64 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:48:10.335290 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-3f75a8e7-d845-43fa-aea3-a73c61e15da4 req-7c0c29c1-1b2d-47cf-bf72-b342c7e36119 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c703a086-cf9d-4d12-8a18-623e454bcb64", "name": "network-vif-deleted", "tag": "be986445-0031-49e4-b37c-8a38b40174cd"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:48:10.350775 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-3f75a8e7-d845-43fa-aea3-a73c61e15da4 req-7c0c29c1-1b2d-47cf-bf72-b342c7e36119 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:10.352381 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-3f75a8e7-d845-43fa-aea3-a73c61e15da4 req-7c0c29c1-1b2d-47cf-bf72-b342c7e36119 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:10.352999 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-3f75a8e7-d845-43fa-aea3-a73c61e15da4 req-7c0c29c1-1b2d-47cf-bf72-b342c7e36119 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:10.390836 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-3f75a8e7-d845-43fa-aea3-a73c61e15da4 req-7c0c29c1-1b2d-47cf-bf72-b342c7e36119 service nova] Creating event network-vif-deleted:be986445-0031-49e4-b37c-8a38b40174cd for instance c703a086-cf9d-4d12-8a18-623e454bcb64 on n-h1-854823-8 Oct 04 20:48:10.405892 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-3f75a8e7-d845-43fa-aea3-a73c61e15da4 req-7c0c29c1-1b2d-47cf-bf72-b342c7e36119 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080414 Oct 04 20:48:10.406887 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1677/3272] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:48:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:48:10.421313 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-f2ff1285-e9b3-4356-b7d1-f1ffcf86d625 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-109080818"}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:48:10.426234 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-f2ff1285-e9b3-4356-b7d1-f1ffcf86d625 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] [instance: 041f0f59-75c7-4d01-bc99-77cb871f0fef] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:10.443449 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f2ff1285-e9b3-4356-b7d1-f1ffcf86d625 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:10.443948 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f2ff1285-e9b3-4356-b7d1-f1ffcf86d625 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:10.444912 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f2ff1285-e9b3-4356-b7d1-f1ffcf86d625 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:10.445639 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f2ff1285-e9b3-4356-b7d1-f1ffcf86d625 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:10.446096 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f2ff1285-e9b3-4356-b7d1-f1ffcf86d625 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:10.449064 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f2ff1285-e9b3-4356-b7d1-f1ffcf86d625 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:10.665163 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-f2ff1285-e9b3-4356-b7d1-f1ffcf86d625 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] 10.222.0.33 "PUT /compute/v2.1/servers/041f0f59-75c7-4d01-bc99-77cb871f0fef" status: 200 len: 1059 microversion: 2.1 time: 0.256952 Oct 04 20:48:10.665833 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1678/3273] 10.222.0.33 () {60 vars in 1256 bytes} [Tue Oct 4 20:48:10 2022] PUT /compute/v2.1/servers/041f0f59-75c7-4d01-bc99-77cb871f0fef => generated 1059 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:48:10.695274 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-cb39b66e-9fd7-415a-9f2d-1d44cdc4a4a4 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:10.695987 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-cb39b66e-9fd7-415a-9f2d-1d44cdc4a4a4 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] [instance: 40a02873-d2c2-42b7-a0b7-2b6125d490f3] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:10.709877 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cb39b66e-9fd7-415a-9f2d-1d44cdc4a4a4 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:10.710658 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cb39b66e-9fd7-415a-9f2d-1d44cdc4a4a4 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:10.711293 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cb39b66e-9fd7-415a-9f2d-1d44cdc4a4a4 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:10.712186 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cb39b66e-9fd7-415a-9f2d-1d44cdc4a4a4 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:10.712810 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cb39b66e-9fd7-415a-9f2d-1d44cdc4a4a4 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:10.713422 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cb39b66e-9fd7-415a-9f2d-1d44cdc4a4a4 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:10.854572 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-dbc83890-7f85-443d-be8a-09332ba5975a tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac650232cc04810b1340dc2f0edadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b0670d1bd99424780a70e69d57a2166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:10.872579 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-dbc83890-7f85-443d-be8a-09332ba5975a tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "GET /compute/v2.1/servers/ac3f41f1-ed37-4009-81e5-7bee0ee6ea69" status: 200 len: 1314 microversion: 2.1 time: 1.167002 Oct 04 20:48:10.880049 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1596/3274] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:48:09 2022] GET /compute/v2.1/servers/ac3f41f1-ed37-4009-81e5-7bee0ee6ea69 => generated 1314 bytes in 1180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:48:11.150899 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-cb39b66e-9fd7-415a-9f2d-1d44cdc4a4a4 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] 10.222.0.33 "GET /compute/v2.1/servers/40a02873-d2c2-42b7-a0b7-2b6125d490f3/os-security-groups" status: 200 len: 1158 microversion: 2.1 time: 0.463972 Oct 04 20:48:11.171713 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1679/3275] 10.222.0.33 () {58 vars in 1293 bytes} [Tue Oct 4 20:48:10 2022] GET /compute/v2.1/servers/40a02873-d2c2-42b7-a0b7-2b6125d490f3/os-security-groups => generated 1158 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:48:11.192414 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-bb25276c-b189-416d-a0e8-197aad3adc97 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Calling method '.version_select at 0x7f3c743993a0>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:11.270307 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-bb25276c-b189-416d-a0e8-197aad3adc97 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1555414461" status: 202 len: 0 microversion: 2.1 time: 0.095445 Oct 04 20:48:11.273481 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1680/3276] 10.222.0.33 () {58 vars in 1221 bytes} [Tue Oct 4 20:48:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1555414461 => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:48:11.326164 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-080d20df-ec61-4b29-8944-76524fac1031 tempest-ServerAddressesNegativeTestJSON-1549542698 tempest-ServerAddressesNegativeTestJSON-1549542698-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesNegativeTestJSON-server-861590374", "imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63", "flavorRef": "452", "networks": [{"uuid": "246a701c-5704-48bf-bced-8e5b47d64d68"}]}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:48:11.337162 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-f809f2f5-dbfb-4a4b-9f2b-0502828bcfa4 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:11.343165 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-f809f2f5-dbfb-4a4b-9f2b-0502828bcfa4 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] [instance: 041f0f59-75c7-4d01-bc99-77cb871f0fef] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:11.356345 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f809f2f5-dbfb-4a4b-9f2b-0502828bcfa4 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:11.358185 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f809f2f5-dbfb-4a4b-9f2b-0502828bcfa4 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:11.358866 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f809f2f5-dbfb-4a4b-9f2b-0502828bcfa4 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:11.360609 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f809f2f5-dbfb-4a4b-9f2b-0502828bcfa4 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:11.364644 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f809f2f5-dbfb-4a4b-9f2b-0502828bcfa4 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:11.365563 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f809f2f5-dbfb-4a4b-9f2b-0502828bcfa4 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:11.494801 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.network.neutron [None req-080d20df-ec61-4b29-8944-76524fac1031 tempest-ServerAddressesNegativeTestJSON-1549542698 tempest-ServerAddressesNegativeTestJSON-1549542698-project] validate_networks() for [('246a701c-5704-48bf-bced-8e5b47d64d68', None, None, None, None, None)] {{(pid=128801) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:48:12.116412 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-f809f2f5-dbfb-4a4b-9f2b-0502828bcfa4 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87dcc7baf63f4ae6bfe0a099adffd408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7097bc12179446f6a3e1fac8434d5c64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:12.132279 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-f809f2f5-dbfb-4a4b-9f2b-0502828bcfa4 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] 10.222.0.33 "GET /compute/v2.1/servers/041f0f59-75c7-4d01-bc99-77cb871f0fef" status: 200 len: 1486 microversion: 2.1 time: 0.856188 Oct 04 20:48:12.146643 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1681/3277] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:48:11 2022] GET /compute/v2.1/servers/041f0f59-75c7-4d01-bc99-77cb871f0fef => generated 1486 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:48:12.158751 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-60e0ff94-0073-492d-bff6-cad8f1ae3073 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Calling method '.version_select at 0x7f3c7450bb80>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:12.261986 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-60e0ff94-0073-492d-bff6-cad8f1ae3073 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] 10.222.0.33 "GET /compute/v2.1/images/802658f0-2596-4fe9-ad73-90b1f8423ede" status: 200 len: 1437 microversion: 2.1 time: 0.113645 Oct 04 20:48:12.272499 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1682/3278] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 20:48:12 2022] GET /compute/v2.1/images/802658f0-2596-4fe9-ad73-90b1f8423ede => generated 1437 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:48:12.279002 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-141c7d97-d6d0-4bea-a5c0-db3a2fdaed5e tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Action: 'create', calling method: .version_select at 0x7f3c744ec700>, body: {"security_group": {"name": " tempest-securitygroup -76642160 ", "description": "tempest-description-468222915"}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:48:13.249233 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-141c7d97-d6d0-4bea-a5c0-db3a2fdaed5e tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] 10.222.0.33 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 0.982862 Oct 04 20:48:13.260722 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1683/3279] 10.222.0.33 () {60 vars in 1180 bytes} [Tue Oct 4 20:48:12 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:48:13.280272 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-a730d36d-cd9d-4ed4-aa73-7db81be72177 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:13.282265 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-a730d36d-cd9d-4ed4-aa73-7db81be72177 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] [instance: c0a14e22-0620-4912-9893-62974c80978a] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:13.321434 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a730d36d-cd9d-4ed4-aa73-7db81be72177 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:13.327570 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a730d36d-cd9d-4ed4-aa73-7db81be72177 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:13.329155 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a730d36d-cd9d-4ed4-aa73-7db81be72177 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:13.332807 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a730d36d-cd9d-4ed4-aa73-7db81be72177 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:13.334948 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a730d36d-cd9d-4ed4-aa73-7db81be72177 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:13.336906 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a730d36d-cd9d-4ed4-aa73-7db81be72177 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:13.524071 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-a730d36d-cd9d-4ed4-aa73-7db81be72177 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28399882314945d787a3af6eb59935c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5392c67506f7445ab33d62b191558f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:13.533919 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-a730d36d-cd9d-4ed4-aa73-7db81be72177 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28399882314945d787a3af6eb59935c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5392c67506f7445ab33d62b191558f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:13.539903 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-a730d36d-cd9d-4ed4-aa73-7db81be72177 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28399882314945d787a3af6eb59935c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5392c67506f7445ab33d62b191558f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:13.543266 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-a730d36d-cd9d-4ed4-aa73-7db81be72177 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] 10.222.0.33 "GET /compute/v2.1/servers/c0a14e22-0620-4912-9893-62974c80978a" status: 200 len: 1604 microversion: 2.32 time: 0.279002 Oct 04 20:48:13.565434 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1684/3280] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:48:13 2022] GET /compute/v2.1/servers/c0a14e22-0620-4912-9893-62974c80978a => generated 1604 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:48:13.576113 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-0bb77d2d-bbba-4c2a-9398-c1b82495b696 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:13.576810 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-0bb77d2d-bbba-4c2a-9398-c1b82495b696 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: ac3f41f1-ed37-4009-81e5-7bee0ee6ea69] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:13.610236 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0bb77d2d-bbba-4c2a-9398-c1b82495b696 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:13.610794 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0bb77d2d-bbba-4c2a-9398-c1b82495b696 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:13.611565 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0bb77d2d-bbba-4c2a-9398-c1b82495b696 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:13.613180 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0bb77d2d-bbba-4c2a-9398-c1b82495b696 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:13.613839 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0bb77d2d-bbba-4c2a-9398-c1b82495b696 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:13.614504 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0bb77d2d-bbba-4c2a-9398-c1b82495b696 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:13.769793 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-080d20df-ec61-4b29-8944-76524fac1031 tempest-ServerAddressesNegativeTestJSON-1549542698 tempest-ServerAddressesNegativeTestJSON-1549542698-project] Flavor limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:48:13.770839 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-080d20df-ec61-4b29-8944-76524fac1031 tempest-ServerAddressesNegativeTestJSON-1549542698 tempest-ServerAddressesNegativeTestJSON-1549542698-project] Image limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:48:13.771685 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-080d20df-ec61-4b29-8944-76524fac1031 tempest-ServerAddressesNegativeTestJSON-1549542698 tempest-ServerAddressesNegativeTestJSON-1549542698-project] Flavor pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:48:13.772378 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-080d20df-ec61-4b29-8944-76524fac1031 tempest-ServerAddressesNegativeTestJSON-1549542698 tempest-ServerAddressesNegativeTestJSON-1549542698-project] Image pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:48:13.772960 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-080d20df-ec61-4b29-8944-76524fac1031 tempest-ServerAddressesNegativeTestJSON-1549542698 tempest-ServerAddressesNegativeTestJSON-1549542698-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:48:13.819166 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-080d20df-ec61-4b29-8944-76524fac1031 tempest-ServerAddressesNegativeTestJSON-1549542698 tempest-ServerAddressesNegativeTestJSON-1549542698-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:13.819956 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-080d20df-ec61-4b29-8944-76524fac1031 tempest-ServerAddressesNegativeTestJSON-1549542698 tempest-ServerAddressesNegativeTestJSON-1549542698-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:13.820653 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-080d20df-ec61-4b29-8944-76524fac1031 tempest-ServerAddressesNegativeTestJSON-1549542698 tempest-ServerAddressesNegativeTestJSON-1549542698-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:13.822686 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-080d20df-ec61-4b29-8944-76524fac1031 tempest-ServerAddressesNegativeTestJSON-1549542698 tempest-ServerAddressesNegativeTestJSON-1549542698-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:13.823440 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-080d20df-ec61-4b29-8944-76524fac1031 tempest-ServerAddressesNegativeTestJSON-1549542698 tempest-ServerAddressesNegativeTestJSON-1549542698-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:13.824891 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-080d20df-ec61-4b29-8944-76524fac1031 tempest-ServerAddressesNegativeTestJSON-1549542698 tempest-ServerAddressesNegativeTestJSON-1549542698-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:13.859792 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-080d20df-ec61-4b29-8944-76524fac1031 tempest-ServerAddressesNegativeTestJSON-1549542698 tempest-ServerAddressesNegativeTestJSON-1549542698-project] Getting quotas for project 031ee0beac0b4fd6b43a1030e07c82ea. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:48:13.866980 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-080d20df-ec61-4b29-8944-76524fac1031 tempest-ServerAddressesNegativeTestJSON-1549542698 tempest-ServerAddressesNegativeTestJSON-1549542698-project] Getting quotas for user b0fdccf8a4c74c56bd811a0092c92bd5 and project 031ee0beac0b4fd6b43a1030e07c82ea. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:48:13.908272 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-0bb77d2d-bbba-4c2a-9398-c1b82495b696 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac650232cc04810b1340dc2f0edadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b0670d1bd99424780a70e69d57a2166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:13.923026 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-0bb77d2d-bbba-4c2a-9398-c1b82495b696 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "GET /compute/v2.1/servers/ac3f41f1-ed37-4009-81e5-7bee0ee6ea69" status: 200 len: 1314 microversion: 2.1 time: 0.353775 Oct 04 20:48:13.925695 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1685/3281] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:48:13 2022] GET /compute/v2.1/servers/ac3f41f1-ed37-4009-81e5-7bee0ee6ea69 => generated 1314 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:48:13.939307 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-daec150a-b053-46f0-a504-3cebade32496 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:13.939866 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-080d20df-ec61-4b29-8944-76524fac1031 tempest-ServerAddressesNegativeTestJSON-1549542698 tempest-ServerAddressesNegativeTestJSON-1549542698-project] Going to run 1 instances... {{(pid=128801) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:48:13.939976 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-daec150a-b053-46f0-a504-3cebade32496 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] [instance: 041f0f59-75c7-4d01-bc99-77cb871f0fef] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:13.943757 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-080d20df-ec61-4b29-8944-76524fac1031 tempest-ServerAddressesNegativeTestJSON-1549542698 tempest-ServerAddressesNegativeTestJSON-1549542698-project] [instance: 7f1a706c-5002-4d52-83ba-f25ce7771d02] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='15b24725-0c99-4bcf-b1fb-907cdf8e2d63',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128801) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:48:13.972840 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-daec150a-b053-46f0-a504-3cebade32496 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:13.978967 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-daec150a-b053-46f0-a504-3cebade32496 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:13.980972 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-daec150a-b053-46f0-a504-3cebade32496 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:13.987887 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-daec150a-b053-46f0-a504-3cebade32496 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:13.988546 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-daec150a-b053-46f0-a504-3cebade32496 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:13.989163 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-daec150a-b053-46f0-a504-3cebade32496 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:14.063360 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-080d20df-ec61-4b29-8944-76524fac1031 tempest-ServerAddressesNegativeTestJSON-1549542698 tempest-ServerAddressesNegativeTestJSON-1549542698-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.181920 Oct 04 20:48:14.071187 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1597/3282] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 20:48:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 3190 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 20:48:14.077012 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-2497963a-27b8-429f-8449-8ee1a823f3d2 req-baac08b0-fb88-4f41-9d2a-e9e4e450718f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40a02873-d2c2-42b7-a0b7-2b6125d490f3", "tag": "ab3cba0a-dc15-4028-b7e0-d50faae0a9e5"}, {"name": "network-changed", "server_uuid": "ac3f41f1-ed37-4009-81e5-7bee0ee6ea69", "tag": "7dd86b49-5d26-4611-8fba-a348ac16a87c"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:48:14.090237 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-2497963a-27b8-429f-8449-8ee1a823f3d2 req-baac08b0-fb88-4f41-9d2a-e9e4e450718f service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:14.091801 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-2497963a-27b8-429f-8449-8ee1a823f3d2 req-baac08b0-fb88-4f41-9d2a-e9e4e450718f service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:14.092433 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-2497963a-27b8-429f-8449-8ee1a823f3d2 req-baac08b0-fb88-4f41-9d2a-e9e4e450718f service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:14.120721 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-2497963a-27b8-429f-8449-8ee1a823f3d2 req-baac08b0-fb88-4f41-9d2a-e9e4e450718f service nova] Creating event network-changed:ab3cba0a-dc15-4028-b7e0-d50faae0a9e5 for instance 40a02873-d2c2-42b7-a0b7-2b6125d490f3 on n-h1-854823-8 Oct 04 20:48:14.121429 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-2497963a-27b8-429f-8449-8ee1a823f3d2 req-baac08b0-fb88-4f41-9d2a-e9e4e450718f service nova] Creating event network-changed:7dd86b49-5d26-4611-8fba-a348ac16a87c for instance ac3f41f1-ed37-4009-81e5-7bee0ee6ea69 on n-h2-854823-8 Oct 04 20:48:14.135954 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-2497963a-27b8-429f-8449-8ee1a823f3d2 req-baac08b0-fb88-4f41-9d2a-e9e4e450718f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.063312 Oct 04 20:48:14.136827 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1598/3283] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:48:14 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:48:14.143305 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a20ef6a0-8b8e-4290-aed7-69a49d2de120 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Action: 'create', calling method: .version_select at 0x7f3c741f1670>, body: {"keypair": {"name": "tempest-keypair-2054016138", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJc3WatHtVxMmTS9GaajqGh8Tv3xeHjFsXthKY/EiicL5HZbY1ijgaOfDXkJal0sWrvW3RB6DSBBe1WMKxy/5/SVZquD3jQfcbDoPnQJ3hyo/SeR7GKhmPUHEf+B1ITSpg=="}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:48:14.161644 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-a20ef6a0-8b8e-4290-aed7-69a49d2de120 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Getting quotas for project fc7f38600b5041ad8e66a12d77b940fa. Resources: {'key_pairs'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:48:14.169949 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-a20ef6a0-8b8e-4290-aed7-69a49d2de120 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Getting quotas for user d9e4b00964014a0383f79597652bd428 and project fc7f38600b5041ad8e66a12d77b940fa. Resources: {'key_pairs'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:48:14.206922 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:48:14.216131 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a20ef6a0-8b8e-4290-aed7-69a49d2de120 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.077550 Oct 04 20:48:14.217552 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1599/3284] 10.222.0.33 () {60 vars in 1159 bytes} [Tue Oct 4 20:48:14 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:48:14.225599 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a44938c9-b4f1-4b37-b64c-424228d0cef2 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Calling method '.version_select at 0x7f3c788ab670>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:15.638102 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a44938c9-b4f1-4b37-b64c-424228d0cef2 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] 10.222.0.33 "GET /compute/v2.1/os-security-groups/f7c16f3f-c567-48bd-a2f7-07287ab49ce7" status: 200 len: 221 microversion: 2.1 time: 1.418461 Oct 04 20:48:15.638743 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1600/3285] 10.222.0.33 () {58 vars in 1269 bytes} [Tue Oct 4 20:48:14 2022] GET /compute/v2.1/os-security-groups/f7c16f3f-c567-48bd-a2f7-07287ab49ce7 => generated 221 bytes in 1420 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:48:15.646549 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0290bce1-441e-4c06-9b8b-27f6ef03778b tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Calling method '.version_select at 0x7f3c787f0670>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:15.724172 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-0290bce1-441e-4c06-9b8b-27f6ef03778b tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] 10.222.0.33 "GET /compute/v2.1/images/802658f0-2596-4fe9-ad73-90b1f8423ede" status: 200 len: 1446 microversion: 2.1 time: 0.083108 Oct 04 20:48:15.732564 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1601/3286] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 20:48:15 2022] GET /compute/v2.1/images/802658f0-2596-4fe9-ad73-90b1f8423ede => generated 1446 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:48:15.744960 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-12389a47-7775-4208-a535-f13ccc42f1f4 tempest-ServerAddressesNegativeTestJSON-1549542698 tempest-ServerAddressesNegativeTestJSON-1549542698-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:15.747147 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-12389a47-7775-4208-a535-f13ccc42f1f4 tempest-ServerAddressesNegativeTestJSON-1549542698 tempest-ServerAddressesNegativeTestJSON-1549542698-project] [instance: 7f1a706c-5002-4d52-83ba-f25ce7771d02] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:15.776480 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-12389a47-7775-4208-a535-f13ccc42f1f4 tempest-ServerAddressesNegativeTestJSON-1549542698 tempest-ServerAddressesNegativeTestJSON-1549542698-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:15.777506 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-12389a47-7775-4208-a535-f13ccc42f1f4 tempest-ServerAddressesNegativeTestJSON-1549542698 tempest-ServerAddressesNegativeTestJSON-1549542698-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:15.778233 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-12389a47-7775-4208-a535-f13ccc42f1f4 tempest-ServerAddressesNegativeTestJSON-1549542698 tempest-ServerAddressesNegativeTestJSON-1549542698-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:15.784082 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-12389a47-7775-4208-a535-f13ccc42f1f4 tempest-ServerAddressesNegativeTestJSON-1549542698 tempest-ServerAddressesNegativeTestJSON-1549542698-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:15.784721 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-12389a47-7775-4208-a535-f13ccc42f1f4 tempest-ServerAddressesNegativeTestJSON-1549542698 tempest-ServerAddressesNegativeTestJSON-1549542698-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:15.786690 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-12389a47-7775-4208-a535-f13ccc42f1f4 tempest-ServerAddressesNegativeTestJSON-1549542698 tempest-ServerAddressesNegativeTestJSON-1549542698-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:15.888946 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-daec150a-b053-46f0-a504-3cebade32496 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87dcc7baf63f4ae6bfe0a099adffd408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7097bc12179446f6a3e1fac8434d5c64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:15.900135 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-daec150a-b053-46f0-a504-3cebade32496 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] 10.222.0.33 "GET /compute/v2.1/servers/041f0f59-75c7-4d01-bc99-77cb871f0fef" status: 200 len: 1486 microversion: 2.1 time: 1.972455 Oct 04 20:48:15.901060 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1686/3287] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:48:13 2022] GET /compute/v2.1/servers/041f0f59-75c7-4d01-bc99-77cb871f0fef => generated 1486 bytes in 1975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:48:15.911087 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-03854c7f-f086-41e7-99f3-dc35a2010d2c tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:15.915543 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-03854c7f-f086-41e7-99f3-dc35a2010d2c tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] [instance: c0a14e22-0620-4912-9893-62974c80978a] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:15.927116 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-03854c7f-f086-41e7-99f3-dc35a2010d2c tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:15.927881 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-03854c7f-f086-41e7-99f3-dc35a2010d2c tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:15.928496 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-03854c7f-f086-41e7-99f3-dc35a2010d2c tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:15.929412 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-03854c7f-f086-41e7-99f3-dc35a2010d2c tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:15.930025 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-03854c7f-f086-41e7-99f3-dc35a2010d2c tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:15.930692 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-03854c7f-f086-41e7-99f3-dc35a2010d2c tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:16.107375 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-12389a47-7775-4208-a535-f13ccc42f1f4 tempest-ServerAddressesNegativeTestJSON-1549542698 tempest-ServerAddressesNegativeTestJSON-1549542698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0fdccf8a4c74c56bd811a0092c92bd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '031ee0beac0b4fd6b43a1030e07c82ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:16.116843 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-12389a47-7775-4208-a535-f13ccc42f1f4 tempest-ServerAddressesNegativeTestJSON-1549542698 tempest-ServerAddressesNegativeTestJSON-1549542698-project] 10.222.0.33 "GET /compute/v2.1/servers/7f1a706c-5002-4d52-83ba-f25ce7771d02" status: 200 len: 1276 microversion: 2.1 time: 0.383099 Oct 04 20:48:16.117425 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1602/3288] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:48:15 2022] GET /compute/v2.1/servers/7f1a706c-5002-4d52-83ba-f25ce7771d02 => generated 1276 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:48:16.127718 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-be01b1c5-f2e5-4422-bf4f-cdd910ae25c8 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:16.131344 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-03854c7f-f086-41e7-99f3-dc35a2010d2c tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28399882314945d787a3af6eb59935c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5392c67506f7445ab33d62b191558f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:16.134042 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:48:16.142137 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-be01b1c5-f2e5-4422-bf4f-cdd910ae25c8 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: ac3f41f1-ed37-4009-81e5-7bee0ee6ea69] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:16.148861 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-03854c7f-f086-41e7-99f3-dc35a2010d2c tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28399882314945d787a3af6eb59935c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5392c67506f7445ab33d62b191558f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:16.150569 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-03854c7f-f086-41e7-99f3-dc35a2010d2c tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28399882314945d787a3af6eb59935c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5392c67506f7445ab33d62b191558f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:16.152251 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-03854c7f-f086-41e7-99f3-dc35a2010d2c tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] 10.222.0.33 "GET /compute/v2.1/servers/c0a14e22-0620-4912-9893-62974c80978a" status: 200 len: 1604 microversion: 2.32 time: 0.250088 Oct 04 20:48:16.152427 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-be01b1c5-f2e5-4422-bf4f-cdd910ae25c8 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:16.152911 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-be01b1c5-f2e5-4422-bf4f-cdd910ae25c8 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:16.153344 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-be01b1c5-f2e5-4422-bf4f-cdd910ae25c8 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:16.154059 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-be01b1c5-f2e5-4422-bf4f-cdd910ae25c8 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:16.158863 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-be01b1c5-f2e5-4422-bf4f-cdd910ae25c8 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:16.160025 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-be01b1c5-f2e5-4422-bf4f-cdd910ae25c8 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:16.172694 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1687/3289] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:48:15 2022] GET /compute/v2.1/servers/c0a14e22-0620-4912-9893-62974c80978a => generated 1604 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:48:16.188379 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-1dcf11c3-f986-45d9-abcc-d4317b8dc2ff tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Calling method '.version_select at 0x7f3c7461f670>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:17.128902 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-be01b1c5-f2e5-4422-bf4f-cdd910ae25c8 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac650232cc04810b1340dc2f0edadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b0670d1bd99424780a70e69d57a2166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:17.143280 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-be01b1c5-f2e5-4422-bf4f-cdd910ae25c8 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "GET /compute/v2.1/servers/ac3f41f1-ed37-4009-81e5-7bee0ee6ea69" status: 200 len: 1314 microversion: 2.1 time: 1.019248 Oct 04 20:48:17.162712 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1603/3290] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:48:16 2022] GET /compute/v2.1/servers/ac3f41f1-ed37-4009-81e5-7bee0ee6ea69 => generated 1314 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:48:17.182046 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-bc7311f2-40fe-4db5-939d-8cbbf79cbaf8 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Calling method '.version_select at 0x7f3c788ab3a0>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:17.244934 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-bc7311f2-40fe-4db5-939d-8cbbf79cbaf8 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] 10.222.0.33 "GET /compute/v2.1/images/802658f0-2596-4fe9-ad73-90b1f8423ede" status: 200 len: 1446 microversion: 2.1 time: 0.080173 Oct 04 20:48:17.245541 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1604/3291] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 20:48:17 2022] GET /compute/v2.1/images/802658f0-2596-4fe9-ad73-90b1f8423ede => generated 1446 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:48:17.270665 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a7c2ba57-8ba6-4522-b3a4-6d2ca523f554 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:17.271480 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a7c2ba57-8ba6-4522-b3a4-6d2ca523f554 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] [instance: 041f0f59-75c7-4d01-bc99-77cb871f0fef] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:17.278140 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a7c2ba57-8ba6-4522-b3a4-6d2ca523f554 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:17.278990 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a7c2ba57-8ba6-4522-b3a4-6d2ca523f554 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:17.279592 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a7c2ba57-8ba6-4522-b3a4-6d2ca523f554 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:17.280500 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a7c2ba57-8ba6-4522-b3a4-6d2ca523f554 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:17.281117 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a7c2ba57-8ba6-4522-b3a4-6d2ca523f554 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:17.288305 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a7c2ba57-8ba6-4522-b3a4-6d2ca523f554 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:17.338035 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a7c2ba57-8ba6-4522-b3a4-6d2ca523f554 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] [instance: 041f0f59-75c7-4d01-bc99-77cb871f0fef] Going to try to terminate instance {{(pid=128801) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:48:17.584897 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a7c2ba57-8ba6-4522-b3a4-6d2ca523f554 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] 10.222.0.33 "DELETE /compute/v2.1/servers/041f0f59-75c7-4d01-bc99-77cb871f0fef" status: 204 len: 0 microversion: 2.1 time: 0.324614 Oct 04 20:48:17.585755 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1605/3292] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 20:48:17 2022] DELETE /compute/v2.1/servers/041f0f59-75c7-4d01-bc99-77cb871f0fef => generated 0 bytes in 327 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:48:17.592255 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-05575f5a-a6da-41b4-b7a8-e07433cd3497 req-36d15050-ef0e-483b-9587-86cf99277eb5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac3f41f1-ed37-4009-81e5-7bee0ee6ea69", "name": "network-vif-plugged", "status": "completed", "tag": "7dd86b49-5d26-4611-8fba-a348ac16a87c"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:48:17.629517 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-05575f5a-a6da-41b4-b7a8-e07433cd3497 req-36d15050-ef0e-483b-9587-86cf99277eb5 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:17.631329 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-05575f5a-a6da-41b4-b7a8-e07433cd3497 req-36d15050-ef0e-483b-9587-86cf99277eb5 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:17.632079 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-05575f5a-a6da-41b4-b7a8-e07433cd3497 req-36d15050-ef0e-483b-9587-86cf99277eb5 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:17.673742 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-05575f5a-a6da-41b4-b7a8-e07433cd3497 req-36d15050-ef0e-483b-9587-86cf99277eb5 service nova] Creating event network-vif-plugged:7dd86b49-5d26-4611-8fba-a348ac16a87c for instance ac3f41f1-ed37-4009-81e5-7bee0ee6ea69 on n-h2-854823-8 Oct 04 20:48:17.682083 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-05575f5a-a6da-41b4-b7a8-e07433cd3497 req-36d15050-ef0e-483b-9587-86cf99277eb5 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094173 Oct 04 20:48:17.683906 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1606/3293] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:48:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:48:17.710305 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7f61de88-90ca-4e9c-ab80-6b71b74a6dff tempest-ServerAddressesNegativeTestJSON-1549542698 tempest-ServerAddressesNegativeTestJSON-1549542698-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:17.726744 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-7f61de88-90ca-4e9c-ab80-6b71b74a6dff tempest-ServerAddressesNegativeTestJSON-1549542698 tempest-ServerAddressesNegativeTestJSON-1549542698-project] [instance: 7f1a706c-5002-4d52-83ba-f25ce7771d02] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:17.733842 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7f61de88-90ca-4e9c-ab80-6b71b74a6dff tempest-ServerAddressesNegativeTestJSON-1549542698 tempest-ServerAddressesNegativeTestJSON-1549542698-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:17.734778 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7f61de88-90ca-4e9c-ab80-6b71b74a6dff tempest-ServerAddressesNegativeTestJSON-1549542698 tempest-ServerAddressesNegativeTestJSON-1549542698-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:17.735447 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7f61de88-90ca-4e9c-ab80-6b71b74a6dff tempest-ServerAddressesNegativeTestJSON-1549542698 tempest-ServerAddressesNegativeTestJSON-1549542698-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:17.736405 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7f61de88-90ca-4e9c-ab80-6b71b74a6dff tempest-ServerAddressesNegativeTestJSON-1549542698 tempest-ServerAddressesNegativeTestJSON-1549542698-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:17.737131 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7f61de88-90ca-4e9c-ab80-6b71b74a6dff tempest-ServerAddressesNegativeTestJSON-1549542698 tempest-ServerAddressesNegativeTestJSON-1549542698-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:17.738011 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7f61de88-90ca-4e9c-ab80-6b71b74a6dff tempest-ServerAddressesNegativeTestJSON-1549542698 tempest-ServerAddressesNegativeTestJSON-1549542698-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:17.946237 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-7f61de88-90ca-4e9c-ab80-6b71b74a6dff tempest-ServerAddressesNegativeTestJSON-1549542698 tempest-ServerAddressesNegativeTestJSON-1549542698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0fdccf8a4c74c56bd811a0092c92bd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '031ee0beac0b4fd6b43a1030e07c82ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:17.961301 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-7f61de88-90ca-4e9c-ab80-6b71b74a6dff tempest-ServerAddressesNegativeTestJSON-1549542698 tempest-ServerAddressesNegativeTestJSON-1549542698-project] 10.222.0.33 "GET /compute/v2.1/servers/7f1a706c-5002-4d52-83ba-f25ce7771d02" status: 200 len: 1282 microversion: 2.1 time: 0.266456 Oct 04 20:48:17.964427 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1607/3294] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:48:17 2022] GET /compute/v2.1/servers/7f1a706c-5002-4d52-83ba-f25ce7771d02 => generated 1282 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:48:17.982156 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d016c27d-151b-4b3b-9fcd-0fcc6782cbcf tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:17.983826 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d016c27d-151b-4b3b-9fcd-0fcc6782cbcf tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] [instance: c0a14e22-0620-4912-9893-62974c80978a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:18.000935 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d016c27d-151b-4b3b-9fcd-0fcc6782cbcf tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:18.008523 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d016c27d-151b-4b3b-9fcd-0fcc6782cbcf tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:18.010104 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d016c27d-151b-4b3b-9fcd-0fcc6782cbcf tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:18.014521 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d016c27d-151b-4b3b-9fcd-0fcc6782cbcf tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:18.015267 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d016c27d-151b-4b3b-9fcd-0fcc6782cbcf tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:18.015807 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d016c27d-151b-4b3b-9fcd-0fcc6782cbcf tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:18.075419 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-1dcf11c3-f986-45d9-abcc-d4317b8dc2ff tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/f7c16f3f-c567-48bd-a2f7-07287ab49ce7" status: 202 len: 0 microversion: 2.1 time: 1.901048 Oct 04 20:48:18.076026 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1688/3295] 10.222.0.33 () {58 vars in 1272 bytes} [Tue Oct 4 20:48:16 2022] DELETE /compute/v2.1/os-security-groups/f7c16f3f-c567-48bd-a2f7-07287ab49ce7 => generated 0 bytes in 1903 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:48:18.082243 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-7736c3b3-3b19-4b73-b581-5bffe9ad2275 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Calling method '.version_select at 0x7f3c7450d670>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:18.190409 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d016c27d-151b-4b3b-9fcd-0fcc6782cbcf tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28399882314945d787a3af6eb59935c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5392c67506f7445ab33d62b191558f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:18.207411 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d016c27d-151b-4b3b-9fcd-0fcc6782cbcf tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28399882314945d787a3af6eb59935c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5392c67506f7445ab33d62b191558f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:18.211020 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d016c27d-151b-4b3b-9fcd-0fcc6782cbcf tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28399882314945d787a3af6eb59935c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5392c67506f7445ab33d62b191558f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:18.214827 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d016c27d-151b-4b3b-9fcd-0fcc6782cbcf tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] 10.222.0.33 "GET /compute/v2.1/servers/c0a14e22-0620-4912-9893-62974c80978a" status: 200 len: 1604 microversion: 2.32 time: 0.245343 Oct 04 20:48:18.215971 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1608/3296] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:48:17 2022] GET /compute/v2.1/servers/c0a14e22-0620-4912-9893-62974c80978a => generated 1604 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:48:18.225785 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-fb20cb93-3a70-4107-b0c0-6a66ac0f0413 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:18.226433 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-fb20cb93-3a70-4107-b0c0-6a66ac0f0413 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] [instance: 041f0f59-75c7-4d01-bc99-77cb871f0fef] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:18.248070 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fb20cb93-3a70-4107-b0c0-6a66ac0f0413 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:18.248565 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fb20cb93-3a70-4107-b0c0-6a66ac0f0413 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:18.249001 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fb20cb93-3a70-4107-b0c0-6a66ac0f0413 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:18.249700 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fb20cb93-3a70-4107-b0c0-6a66ac0f0413 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:18.250150 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fb20cb93-3a70-4107-b0c0-6a66ac0f0413 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:18.250594 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fb20cb93-3a70-4107-b0c0-6a66ac0f0413 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:18.715155 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-fb20cb93-3a70-4107-b0c0-6a66ac0f0413 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87dcc7baf63f4ae6bfe0a099adffd408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7097bc12179446f6a3e1fac8434d5c64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:18.733560 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-fb20cb93-3a70-4107-b0c0-6a66ac0f0413 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] 10.222.0.33 "GET /compute/v2.1/servers/041f0f59-75c7-4d01-bc99-77cb871f0fef" status: 200 len: 1492 microversion: 2.1 time: 0.512531 Oct 04 20:48:18.736492 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1609/3297] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:48:18 2022] GET /compute/v2.1/servers/041f0f59-75c7-4d01-bc99-77cb871f0fef => generated 1492 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:48:18.765122 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0d35a53f-3a2c-4de2-a3c5-1239613cb610 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1389630262", "imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1b6eb29e-dbc2-4007-8946-b5a4c5a89268"}], "security_groups": [{"name": "tempest-securitygroup--1025410160"}], "key_name": "tempest-keypair-2054016138", "user_data": "}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:48:19.355763 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.network.neutron [None req-0d35a53f-3a2c-4de2-a3c5-1239613cb610 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] validate_networks() for [('1b6eb29e-dbc2-4007-8946-b5a4c5a89268', None, None, None, None, None)] {{(pid=128801) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:48:19.694109 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-7736c3b3-3b19-4b73-b581-5bffe9ad2275 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] 10.222.0.33 "DELETE /compute/v2.1/images/802658f0-2596-4fe9-ad73-90b1f8423ede" status: 204 len: 0 microversion: 2.1 time: 1.616700 Oct 04 20:48:19.697186 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1689/3298] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:48:18 2022] DELETE /compute/v2.1/images/802658f0-2596-4fe9-ad73-90b1f8423ede => generated 0 bytes in 1620 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:48:19.709244 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-b62bafec-f0c4-4593-8bc4-9b0f0485238c tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Calling method '.version_select at 0x7f3c744ecdc0>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:19.905662 n-d-854823-8 devstack@n-api.service[128802]: DEBUG neutronclient.v2_0.client [None req-b62bafec-f0c4-4593-8bc4-9b0f0485238c tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group f7c16f3f-c567-48bd-a2f7-07287ab49ce7 does not exist", "detail": ""}} {{(pid=128802) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 20:48:19.906590 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.network.security_group_api [None req-b62bafec-f0c4-4593-8bc4-9b0f0485238c tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Neutron security group f7c16f3f-c567-48bd-a2f7-07287ab49ce7 not found {{(pid=128802) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 04 20:48:19.907289 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.wsgi [None req-b62bafec-f0c4-4593-8bc4-9b0f0485238c tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] HTTP exception thrown: Security group f7c16f3f-c567-48bd-a2f7-07287ab49ce7 does not exist Oct 04 20:48:19.907289 n-d-854823-8 devstack@n-api.service[128802]: Neutron server returns request_ids: ['req-96eb63b4-4ce0-4f24-9e37-d410dddc2b75'] Oct 04 20:48:19.910288 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-b62bafec-f0c4-4593-8bc4-9b0f0485238c tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Request method failure captured: Oct 04 20:48:19.910288 n-d-854823-8 devstack@n-api.service[128802]: request: GET /compute/v2.1/os-security-groups/f7c16f3f-c567-48bd-a2f7-07287ab49ce7 HTTP/1.1 Oct 04 20:48:19.910288 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 20:48:19.910288 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 20:48:19.910288 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 20:48:19.910288 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 0 Oct 04 20:48:19.910288 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 20:48:19.910288 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 20:48:19.910288 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 20:48:19.910288 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 20:48:19.910288 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPJvplJ2XtdAcke_gJrXE_KNLNy4K9GZxu4xJ3RC3ictvWfS6RkKIgxre3Ypn4Hea1fYOIvZNCiP-yxvq5D6SolLdjoz27YjvMYrrTV2S3thhTnsVyXyRm0AMTe4s528xDCu1J43IqMSUlnCB8IA8Xi7RGhGDp6gPtwX5ldwf-HyrWJg Oct 04 20:48:19.910288 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 20:48:19.910288 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 20:48:19.910288 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 20:48:19.910288 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 20:48:19.910288 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 20:48:19.910288 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 20:48:19.910288 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: 5338cf2146344042bc263bdc4f9d822b Oct 04 20:48:19.910288 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-SecurityGroupsTestJSON-969894548 Oct 04 20:48:19.910288 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 20:48:19.910288 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 20:48:19.910288 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5338cf2146344042bc263bdc4f9d822b", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5338cf2146344042bc263bdc4f9d822b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5338cf2146344042bc263bdc4f9d822b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5338cf2146344042bc263bdc4f9d822b"}]}] Oct 04 20:48:19.910288 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-SecurityGroupsTestJSON-969894548 Oct 04 20:48:19.910288 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: 5338cf2146344042bc263bdc4f9d822b Oct 04 20:48:19.910288 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-969894548 Oct 04 20:48:19.910288 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-SecurityGroupsTestJSON-969894548-project Oct 04 20:48:19.910288 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 20:48:19.910288 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 20:48:19.910288 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: 6775b9d82b3444f6b728736f1d2b2806 Oct 04 20:48:19.910288 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-SecurityGroupsTestJSON-969894548-project Oct 04 20:48:19.910288 n-d-854823-8 devstack@n-api.service[128802]: method: Oct 04 20:48:19.910288 n-d-854823-8 devstack@n-api.service[128802]: exception: Security group f7c16f3f-c567-48bd-a2f7-07287ab49ce7 does not exist Oct 04 20:48:19.910288 n-d-854823-8 devstack@n-api.service[128802]: Neutron server returns request_ids: ['req-96eb63b4-4ce0-4f24-9e37-d410dddc2b75'] Oct 04 20:48:19.910288 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'id': 'f7c16f3f-c567-48bd-a2f7-07287ab49ce7'} Oct 04 20:48:19.910288 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:48:19.910288 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:48:19.910288 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 04 20:48:19.910288 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 04 20:48:19.910288 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:48:19.910288 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:48:19.910288 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 04 20:48:19.910288 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 04 20:48:19.910288 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:48:19.910288 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:48:19.910288 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 20:48:19.910288 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 20:48:19.910288 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:48:19.910288 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:48:19.910288 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:48:19.910288 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:48:19.910288 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:48:19.910288 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:48:19.910288 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 20:48:19.910288 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 20:48:19.910288 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:48:19.910288 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:48:19.910288 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 20:48:19.910288 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 20:48:19.910288 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 20:48:19.910288 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 20:48:19.910288 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group f7c16f3f-c567-48bd-a2f7-07287ab49ce7 does not exist Oct 04 20:48:19.914678 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-96eb63b4-4ce0-4f24-9e37-d410dddc2b75'] Oct 04 20:48:19.914678 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:48:19.914678 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:48:19.914678 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:48:19.914678 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:48:19.914678 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 04 20:48:19.914678 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 04 20:48:19.914678 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 04 20:48:19.914678 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 04 20:48:19.914678 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group f7c16f3f-c567-48bd-a2f7-07287ab49ce7 does not exist Oct 04 20:48:19.914678 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-96eb63b4-4ce0-4f24-9e37-d410dddc2b75'] Oct 04 20:48:19.914678 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:48:19.914678 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:48:19.914678 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:48:19.914678 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:48:19.914678 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:48:19.914678 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:48:19.914678 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:48:19.914678 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:48:19.914678 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:48:19.914678 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:48:19.914678 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:48:19.914678 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:48:19.914678 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 04 20:48:19.914678 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 04 20:48:19.914678 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group f7c16f3f-c567-48bd-a2f7-07287ab49ce7 does not exist Oct 04 20:48:19.914678 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-96eb63b4-4ce0-4f24-9e37-d410dddc2b75'] Oct 04 20:48:19.914678 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:48:19.914678 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:48:19.914678 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:48:19.914678 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:48:19.914678 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:48:19.914678 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:48:19.914678 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:48:19.914678 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:48:19.914678 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group f7c16f3f-c567-48bd-a2f7-07287ab49ce7 does not exist Oct 04 20:48:19.914678 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-96eb63b4-4ce0-4f24-9e37-d410dddc2b75'] Oct 04 20:48:19.914678 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:48:19.919244 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-b62bafec-f0c4-4593-8bc4-9b0f0485238c tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Returning 404 to user: Security group f7c16f3f-c567-48bd-a2f7-07287ab49ce7 does not exist Oct 04 20:48:19.919244 n-d-854823-8 devstack@n-api.service[128802]: Neutron server returns request_ids: ['req-96eb63b4-4ce0-4f24-9e37-d410dddc2b75'] {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:48:19.920382 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-b62bafec-f0c4-4593-8bc4-9b0f0485238c tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] 10.222.0.33 "GET /compute/v2.1/os-security-groups/f7c16f3f-c567-48bd-a2f7-07287ab49ce7" status: 404 len: 194 microversion: 2.1 time: 0.222615 Oct 04 20:48:19.921432 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1690/3299] 10.222.0.33 () {58 vars in 1269 bytes} [Tue Oct 4 20:48:19 2022] GET /compute/v2.1/os-security-groups/f7c16f3f-c567-48bd-a2f7-07287ab49ce7 => generated 194 bytes in 224 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:48:19.929847 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-f6c2e5f8-c18e-4bf0-9e25-45385a07206a tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:19.934595 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-f6c2e5f8-c18e-4bf0-9e25-45385a07206a tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: ac3f41f1-ed37-4009-81e5-7bee0ee6ea69] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:19.954974 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f6c2e5f8-c18e-4bf0-9e25-45385a07206a tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:19.956757 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f6c2e5f8-c18e-4bf0-9e25-45385a07206a tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:19.957391 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f6c2e5f8-c18e-4bf0-9e25-45385a07206a tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:19.959449 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f6c2e5f8-c18e-4bf0-9e25-45385a07206a tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:19.961110 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f6c2e5f8-c18e-4bf0-9e25-45385a07206a tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:19.963896 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f6c2e5f8-c18e-4bf0-9e25-45385a07206a tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:20.264713 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-0d35a53f-3a2c-4de2-a3c5-1239613cb610 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Flavor limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:48:20.265144 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-0d35a53f-3a2c-4de2-a3c5-1239613cb610 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Image limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:48:20.265629 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-0d35a53f-3a2c-4de2-a3c5-1239613cb610 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Flavor pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:48:20.266049 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-0d35a53f-3a2c-4de2-a3c5-1239613cb610 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Image pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:48:20.266495 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-0d35a53f-3a2c-4de2-a3c5-1239613cb610 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:48:20.287259 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0d35a53f-3a2c-4de2-a3c5-1239613cb610 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:20.287761 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0d35a53f-3a2c-4de2-a3c5-1239613cb610 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:20.288203 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0d35a53f-3a2c-4de2-a3c5-1239613cb610 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:20.288944 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0d35a53f-3a2c-4de2-a3c5-1239613cb610 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:20.289401 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0d35a53f-3a2c-4de2-a3c5-1239613cb610 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:20.295653 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0d35a53f-3a2c-4de2-a3c5-1239613cb610 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:20.339946 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-0d35a53f-3a2c-4de2-a3c5-1239613cb610 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Getting quotas for project fc7f38600b5041ad8e66a12d77b940fa. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:48:20.351751 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-0d35a53f-3a2c-4de2-a3c5-1239613cb610 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Getting quotas for user d9e4b00964014a0383f79597652bd428 and project fc7f38600b5041ad8e66a12d77b940fa. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:48:20.389694 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-0d35a53f-3a2c-4de2-a3c5-1239613cb610 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Going to run 1 instances... {{(pid=128801) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:48:20.392754 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-0d35a53f-3a2c-4de2-a3c5-1239613cb610 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] [instance: f9938964-5f2f-4093-b5cb-967adbe97623] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='15b24725-0c99-4bcf-b1fb-907cdf8e2d63',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128801) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:48:20.536878 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-0d35a53f-3a2c-4de2-a3c5-1239613cb610 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.795723 Oct 04 20:48:20.538373 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1610/3300] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 20:48:18 2022] POST /compute/v2.1/servers => generated 402 bytes in 1798 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 20:48:20.545048 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a3e4eac7-7909-466c-a6a4-d6ea76bffaed tempest-ServerAddressesNegativeTestJSON-1549542698 tempest-ServerAddressesNegativeTestJSON-1549542698-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:20.545984 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a3e4eac7-7909-466c-a6a4-d6ea76bffaed tempest-ServerAddressesNegativeTestJSON-1549542698 tempest-ServerAddressesNegativeTestJSON-1549542698-project] [instance: 7f1a706c-5002-4d52-83ba-f25ce7771d02] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:20.551737 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-f6c2e5f8-c18e-4bf0-9e25-45385a07206a tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac650232cc04810b1340dc2f0edadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b0670d1bd99424780a70e69d57a2166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:20.561436 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-f6c2e5f8-c18e-4bf0-9e25-45385a07206a tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "GET /compute/v2.1/servers/ac3f41f1-ed37-4009-81e5-7bee0ee6ea69" status: 200 len: 1314 microversion: 2.1 time: 0.638700 Oct 04 20:48:20.566192 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1691/3301] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:48:19 2022] GET /compute/v2.1/servers/ac3f41f1-ed37-4009-81e5-7bee0ee6ea69 => generated 1314 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:48:20.571149 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a3e4eac7-7909-466c-a6a4-d6ea76bffaed tempest-ServerAddressesNegativeTestJSON-1549542698 tempest-ServerAddressesNegativeTestJSON-1549542698-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:20.574413 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-f0960d72-bc47-42f1-9aa1-c14ea4304dde tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:20.575310 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a3e4eac7-7909-466c-a6a4-d6ea76bffaed tempest-ServerAddressesNegativeTestJSON-1549542698 tempest-ServerAddressesNegativeTestJSON-1549542698-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:20.575998 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a3e4eac7-7909-466c-a6a4-d6ea76bffaed tempest-ServerAddressesNegativeTestJSON-1549542698 tempest-ServerAddressesNegativeTestJSON-1549542698-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:20.576937 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a3e4eac7-7909-466c-a6a4-d6ea76bffaed tempest-ServerAddressesNegativeTestJSON-1549542698 tempest-ServerAddressesNegativeTestJSON-1549542698-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:20.577626 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a3e4eac7-7909-466c-a6a4-d6ea76bffaed tempest-ServerAddressesNegativeTestJSON-1549542698 tempest-ServerAddressesNegativeTestJSON-1549542698-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:20.578558 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-f0960d72-bc47-42f1-9aa1-c14ea4304dde tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] [instance: c0a14e22-0620-4912-9893-62974c80978a] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:20.580506 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a3e4eac7-7909-466c-a6a4-d6ea76bffaed tempest-ServerAddressesNegativeTestJSON-1549542698 tempest-ServerAddressesNegativeTestJSON-1549542698-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:20.597210 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f0960d72-bc47-42f1-9aa1-c14ea4304dde tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:20.600770 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f0960d72-bc47-42f1-9aa1-c14ea4304dde tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:20.601482 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f0960d72-bc47-42f1-9aa1-c14ea4304dde tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:20.614933 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f0960d72-bc47-42f1-9aa1-c14ea4304dde tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:20.617193 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f0960d72-bc47-42f1-9aa1-c14ea4304dde tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:20.617865 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f0960d72-bc47-42f1-9aa1-c14ea4304dde tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:20.960437 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-f0960d72-bc47-42f1-9aa1-c14ea4304dde tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28399882314945d787a3af6eb59935c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5392c67506f7445ab33d62b191558f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:20.976629 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-f0960d72-bc47-42f1-9aa1-c14ea4304dde tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28399882314945d787a3af6eb59935c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5392c67506f7445ab33d62b191558f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:20.979483 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-f0960d72-bc47-42f1-9aa1-c14ea4304dde tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28399882314945d787a3af6eb59935c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5392c67506f7445ab33d62b191558f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:20.981938 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-f0960d72-bc47-42f1-9aa1-c14ea4304dde tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] 10.222.0.33 "GET /compute/v2.1/servers/c0a14e22-0620-4912-9893-62974c80978a" status: 200 len: 1604 microversion: 2.32 time: 0.413730 Oct 04 20:48:20.997580 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1692/3302] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:48:20 2022] GET /compute/v2.1/servers/c0a14e22-0620-4912-9893-62974c80978a => generated 1604 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:48:21.019160 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-5fcaccf2-2aa1-44b9-a7b6-c92e71f25a64 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:21.021532 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-5fcaccf2-2aa1-44b9-a7b6-c92e71f25a64 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] [instance: 8e0006b2-ed59-4ad1-a921-d1db19cb97b6] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:21.039036 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5fcaccf2-2aa1-44b9-a7b6-c92e71f25a64 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:21.040772 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5fcaccf2-2aa1-44b9-a7b6-c92e71f25a64 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:21.042414 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5fcaccf2-2aa1-44b9-a7b6-c92e71f25a64 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:21.043474 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5fcaccf2-2aa1-44b9-a7b6-c92e71f25a64 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:21.045277 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5fcaccf2-2aa1-44b9-a7b6-c92e71f25a64 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:21.045860 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5fcaccf2-2aa1-44b9-a7b6-c92e71f25a64 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:21.130664 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-5fcaccf2-2aa1-44b9-a7b6-c92e71f25a64 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] [instance: 8e0006b2-ed59-4ad1-a921-d1db19cb97b6] Going to try to terminate instance {{(pid=128802) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:48:21.366076 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-5fcaccf2-2aa1-44b9-a7b6-c92e71f25a64 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] 10.222.0.33 "DELETE /compute/v2.1/servers/8e0006b2-ed59-4ad1-a921-d1db19cb97b6" status: 204 len: 0 microversion: 2.1 time: 0.354548 Oct 04 20:48:21.367440 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1693/3303] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 20:48:20 2022] DELETE /compute/v2.1/servers/8e0006b2-ed59-4ad1-a921-d1db19cb97b6 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:48:21.400775 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-ba36c5d5-5969-4135-849c-dfc380739c0c req-a92c3201-1070-422c-8886-fb6c850f4961 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e0006b2-ed59-4ad1-a921-d1db19cb97b6", "name": "network-vif-unplugged", "status": "completed", "tag": "dc42a420-def0-4262-941b-1c282e275581"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:48:21.446471 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-ba36c5d5-5969-4135-849c-dfc380739c0c req-a92c3201-1070-422c-8886-fb6c850f4961 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:21.449779 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-ba36c5d5-5969-4135-849c-dfc380739c0c req-a92c3201-1070-422c-8886-fb6c850f4961 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:21.455383 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-ba36c5d5-5969-4135-849c-dfc380739c0c req-a92c3201-1070-422c-8886-fb6c850f4961 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:21.497256 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-ba36c5d5-5969-4135-849c-dfc380739c0c req-a92c3201-1070-422c-8886-fb6c850f4961 service nova] Creating event network-vif-unplugged:dc42a420-def0-4262-941b-1c282e275581 for instance 8e0006b2-ed59-4ad1-a921-d1db19cb97b6 on n-h2-854823-8 Oct 04 20:48:21.506132 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-ba36c5d5-5969-4135-849c-dfc380739c0c req-a92c3201-1070-422c-8886-fb6c850f4961 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.136252 Oct 04 20:48:21.509353 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1694/3304] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:48:21 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:48:21.533436 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-8eea32f3-63fe-4f21-8ade-a34e89a165f8 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:21.535255 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-8eea32f3-63fe-4f21-8ade-a34e89a165f8 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] [instance: 041f0f59-75c7-4d01-bc99-77cb871f0fef] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:21.571208 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8eea32f3-63fe-4f21-8ade-a34e89a165f8 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:21.572663 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8eea32f3-63fe-4f21-8ade-a34e89a165f8 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:21.574666 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8eea32f3-63fe-4f21-8ade-a34e89a165f8 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:21.581292 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8eea32f3-63fe-4f21-8ade-a34e89a165f8 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:21.581930 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8eea32f3-63fe-4f21-8ade-a34e89a165f8 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:21.582508 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8eea32f3-63fe-4f21-8ade-a34e89a165f8 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:21.763517 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-a3e4eac7-7909-466c-a6a4-d6ea76bffaed tempest-ServerAddressesNegativeTestJSON-1549542698 tempest-ServerAddressesNegativeTestJSON-1549542698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0fdccf8a4c74c56bd811a0092c92bd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '031ee0beac0b4fd6b43a1030e07c82ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:21.773866 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a3e4eac7-7909-466c-a6a4-d6ea76bffaed tempest-ServerAddressesNegativeTestJSON-1549542698 tempest-ServerAddressesNegativeTestJSON-1549542698-project] 10.222.0.33 "GET /compute/v2.1/servers/7f1a706c-5002-4d52-83ba-f25ce7771d02" status: 200 len: 1324 microversion: 2.1 time: 1.233983 Oct 04 20:48:21.790371 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1611/3305] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:48:20 2022] GET /compute/v2.1/servers/7f1a706c-5002-4d52-83ba-f25ce7771d02 => generated 1324 bytes in 1238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:48:21.790371 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e14f5ff7-a085-4dab-aec3-8fcd23e051e8 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Action: 'create', calling method: .version_select at 0x7f3c741f10d0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-739244378", "description": "tempest-description-462572512"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:48:21.824174 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-8eea32f3-63fe-4f21-8ade-a34e89a165f8 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87dcc7baf63f4ae6bfe0a099adffd408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7097bc12179446f6a3e1fac8434d5c64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:21.840782 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-8eea32f3-63fe-4f21-8ade-a34e89a165f8 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] 10.222.0.33 "GET /compute/v2.1/servers/041f0f59-75c7-4d01-bc99-77cb871f0fef" status: 200 len: 1450 microversion: 2.1 time: 0.326408 Oct 04 20:48:21.859270 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1695/3306] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:48:21 2022] GET /compute/v2.1/servers/041f0f59-75c7-4d01-bc99-77cb871f0fef => generated 1450 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:48:21.871149 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-bb2bd654-bfff-4da6-a4db-6aefc91eac22 req-37d28fb9-6a06-4a48-b451-7663a8f91e95 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f1a706c-5002-4d52-83ba-f25ce7771d02", "tag": "d37e8f40-c472-45b2-b146-135f62bbc03c"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:48:21.891377 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:48:21.894555 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-bb2bd654-bfff-4da6-a4db-6aefc91eac22 req-37d28fb9-6a06-4a48-b451-7663a8f91e95 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:21.895158 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-bb2bd654-bfff-4da6-a4db-6aefc91eac22 req-37d28fb9-6a06-4a48-b451-7663a8f91e95 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:21.895658 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-bb2bd654-bfff-4da6-a4db-6aefc91eac22 req-37d28fb9-6a06-4a48-b451-7663a8f91e95 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:21.933872 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-bb2bd654-bfff-4da6-a4db-6aefc91eac22 req-37d28fb9-6a06-4a48-b451-7663a8f91e95 service nova] Creating event network-changed:d37e8f40-c472-45b2-b146-135f62bbc03c for instance 7f1a706c-5002-4d52-83ba-f25ce7771d02 on n-h1-854823-8 Oct 04 20:48:21.958201 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-bb2bd654-bfff-4da6-a4db-6aefc91eac22 req-37d28fb9-6a06-4a48-b451-7663a8f91e95 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106804 Oct 04 20:48:21.958894 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1696/3307] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:48:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:48:21.972430 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-42ce61d6-e08e-4746-bdd4-9204e55cd313 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:21.976109 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-42ce61d6-e08e-4746-bdd4-9204e55cd313 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] [instance: f9938964-5f2f-4093-b5cb-967adbe97623] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:21.998752 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-42ce61d6-e08e-4746-bdd4-9204e55cd313 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:22.000372 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-42ce61d6-e08e-4746-bdd4-9204e55cd313 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:22.002924 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-42ce61d6-e08e-4746-bdd4-9204e55cd313 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:22.005717 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-42ce61d6-e08e-4746-bdd4-9204e55cd313 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:22.007784 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-42ce61d6-e08e-4746-bdd4-9204e55cd313 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:22.009104 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-42ce61d6-e08e-4746-bdd4-9204e55cd313 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:22.107581 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-42ce61d6-e08e-4746-bdd4-9204e55cd313 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e4b00964014a0383f79597652bd428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7f38600b5041ad8e66a12d77b940fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:22.122289 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-42ce61d6-e08e-4746-bdd4-9204e55cd313 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] 10.222.0.33 "GET /compute/v2.1/servers/f9938964-5f2f-4093-b5cb-967adbe97623" status: 200 len: 1246 microversion: 2.1 time: 0.159229 Oct 04 20:48:22.139796 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1697/3308] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:48:21 2022] GET /compute/v2.1/servers/f9938964-5f2f-4093-b5cb-967adbe97623 => generated 1246 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:48:22.151244 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-a3081798-ce44-40a9-9141-b06546074762 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:22.152219 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-a3081798-ce44-40a9-9141-b06546074762 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: ac3f41f1-ed37-4009-81e5-7bee0ee6ea69] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:22.160960 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a3081798-ce44-40a9-9141-b06546074762 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:22.162125 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a3081798-ce44-40a9-9141-b06546074762 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:22.162927 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a3081798-ce44-40a9-9141-b06546074762 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:22.164082 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a3081798-ce44-40a9-9141-b06546074762 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:22.164813 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a3081798-ce44-40a9-9141-b06546074762 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:22.165560 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a3081798-ce44-40a9-9141-b06546074762 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:22.250041 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e14f5ff7-a085-4dab-aec3-8fcd23e051e8 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] 10.222.0.33 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.470445 Oct 04 20:48:22.254974 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1612/3309] 10.222.0.33 () {60 vars in 1180 bytes} [Tue Oct 4 20:48:21 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:48:22.260885 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-3c19c8ca-49e0-4d20-a8c2-764ba5444140 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1164943522", "imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63", "flavorRef": "452", "networks": [{"uuid": "4c0a9fa9-b96b-431d-88f1-03cf1e898d51"}]}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:48:22.393055 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.network.neutron [None req-3c19c8ca-49e0-4d20-a8c2-764ba5444140 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] validate_networks() for [('4c0a9fa9-b96b-431d-88f1-03cf1e898d51', None, None, None, None, None)] {{(pid=128801) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:48:22.544206 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-a3081798-ce44-40a9-9141-b06546074762 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac650232cc04810b1340dc2f0edadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b0670d1bd99424780a70e69d57a2166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:22.556659 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-a3081798-ce44-40a9-9141-b06546074762 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "GET /compute/v2.1/servers/ac3f41f1-ed37-4009-81e5-7bee0ee6ea69" status: 200 len: 1502 microversion: 2.1 time: 0.411846 Oct 04 20:48:22.557602 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1698/3310] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:48:22 2022] GET /compute/v2.1/servers/ac3f41f1-ed37-4009-81e5-7bee0ee6ea69 => generated 1502 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:48:22.562799 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-b04201ba-f4ac-4260-800b-a764cff07930 req-40d2a42b-7d95-41fc-891f-a76b2b40ec80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "041f0f59-75c7-4d01-bc99-77cb871f0fef", "name": "network-vif-deleted", "tag": "d49f87ec-d567-4f79-9dfc-9996ce123a45"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:48:22.587487 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-b04201ba-f4ac-4260-800b-a764cff07930 req-40d2a42b-7d95-41fc-891f-a76b2b40ec80 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:22.587973 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-b04201ba-f4ac-4260-800b-a764cff07930 req-40d2a42b-7d95-41fc-891f-a76b2b40ec80 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:22.588406 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-b04201ba-f4ac-4260-800b-a764cff07930 req-40d2a42b-7d95-41fc-891f-a76b2b40ec80 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:22.633816 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-b04201ba-f4ac-4260-800b-a764cff07930 req-40d2a42b-7d95-41fc-891f-a76b2b40ec80 service nova] Creating event network-vif-deleted:d49f87ec-d567-4f79-9dfc-9996ce123a45 for instance 041f0f59-75c7-4d01-bc99-77cb871f0fef on n-h2-854823-8 Oct 04 20:48:22.648618 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-b04201ba-f4ac-4260-800b-a764cff07930 req-40d2a42b-7d95-41fc-891f-a76b2b40ec80 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089735 Oct 04 20:48:22.649552 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1699/3311] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:48:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:48:22.657982 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-95ec72e2-a81c-494d-9586-d3ae0330db29 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:22.658865 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-95ec72e2-a81c-494d-9586-d3ae0330db29 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] [instance: c0a14e22-0620-4912-9893-62974c80978a] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:22.676725 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-95ec72e2-a81c-494d-9586-d3ae0330db29 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:22.677222 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-95ec72e2-a81c-494d-9586-d3ae0330db29 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:22.677662 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-95ec72e2-a81c-494d-9586-d3ae0330db29 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:22.678440 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-95ec72e2-a81c-494d-9586-d3ae0330db29 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:22.678859 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-95ec72e2-a81c-494d-9586-d3ae0330db29 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:22.679365 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-95ec72e2-a81c-494d-9586-d3ae0330db29 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:22.913410 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-95ec72e2-a81c-494d-9586-d3ae0330db29 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28399882314945d787a3af6eb59935c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5392c67506f7445ab33d62b191558f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:22.952550 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-95ec72e2-a81c-494d-9586-d3ae0330db29 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28399882314945d787a3af6eb59935c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5392c67506f7445ab33d62b191558f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:22.957902 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-95ec72e2-a81c-494d-9586-d3ae0330db29 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28399882314945d787a3af6eb59935c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5392c67506f7445ab33d62b191558f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:22.959435 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-95ec72e2-a81c-494d-9586-d3ae0330db29 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] 10.222.0.33 "GET /compute/v2.1/servers/c0a14e22-0620-4912-9893-62974c80978a" status: 200 len: 1604 microversion: 2.32 time: 0.308681 Oct 04 20:48:22.962292 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1700/3312] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:48:22 2022] GET /compute/v2.1/servers/c0a14e22-0620-4912-9893-62974c80978a => generated 1604 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:48:22.996608 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-f2af8c9e-2716-4f8a-b8f9-508bdd4169e6 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Action: 'create', calling method: .version_select at 0x7f3c74679ee0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-999835386", "description": "tempest-description-673369558"}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:48:24.283572 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-3c19c8ca-49e0-4d20-a8c2-764ba5444140 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Flavor limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:48:24.285245 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-3c19c8ca-49e0-4d20-a8c2-764ba5444140 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Image limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:48:24.285392 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-3c19c8ca-49e0-4d20-a8c2-764ba5444140 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Flavor pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:48:24.285691 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-3c19c8ca-49e0-4d20-a8c2-764ba5444140 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Image pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:48:24.286290 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-3c19c8ca-49e0-4d20-a8c2-764ba5444140 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:48:24.312106 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3c19c8ca-49e0-4d20-a8c2-764ba5444140 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:24.312427 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3c19c8ca-49e0-4d20-a8c2-764ba5444140 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:24.312865 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3c19c8ca-49e0-4d20-a8c2-764ba5444140 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:24.313796 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3c19c8ca-49e0-4d20-a8c2-764ba5444140 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:24.314251 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3c19c8ca-49e0-4d20-a8c2-764ba5444140 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:24.314790 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3c19c8ca-49e0-4d20-a8c2-764ba5444140 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:24.343150 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-3c19c8ca-49e0-4d20-a8c2-764ba5444140 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Getting quotas for project 3f3fadcd7d4043daa0a6aba27ba814d5. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:48:24.351339 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-3c19c8ca-49e0-4d20-a8c2-764ba5444140 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Getting quotas for user aca59cd50bf74a36bb1e4427cd50fbb3 and project 3f3fadcd7d4043daa0a6aba27ba814d5. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:48:24.386481 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-3c19c8ca-49e0-4d20-a8c2-764ba5444140 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Going to run 1 instances... {{(pid=128801) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:48:24.390785 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-3c19c8ca-49e0-4d20-a8c2-764ba5444140 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] [instance: 9df70a8d-757f-4b92-ab73-6ad6cfc98953] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='15b24725-0c99-4bcf-b1fb-907cdf8e2d63',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128801) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:48:24.393555 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-f2af8c9e-2716-4f8a-b8f9-508bdd4169e6 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] 10.222.0.33 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 1.415596 Oct 04 20:48:24.394333 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1701/3313] 10.222.0.33 () {60 vars in 1180 bytes} [Tue Oct 4 20:48:22 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 1417 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:48:24.407156 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-222c091b-960f-4196-a9a6-a8caf59e9d51 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:48:24.409972 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-222c091b-960f-4196-a9a6-a8caf59e9d51 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: ac3f41f1-ed37-4009-81e5-7bee0ee6ea69] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:24.437174 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-222c091b-960f-4196-a9a6-a8caf59e9d51 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:24.443446 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-222c091b-960f-4196-a9a6-a8caf59e9d51 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:24.444260 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-222c091b-960f-4196-a9a6-a8caf59e9d51 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:24.445306 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-222c091b-960f-4196-a9a6-a8caf59e9d51 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:24.445922 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-222c091b-960f-4196-a9a6-a8caf59e9d51 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:24.446564 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-222c091b-960f-4196-a9a6-a8caf59e9d51 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:24.472943 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-3c19c8ca-49e0-4d20-a8c2-764ba5444140 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.216790 Oct 04 20:48:24.482438 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1613/3314] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 20:48:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 2225 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 20:48:24.494613 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e702585f-e7c1-4cc9-bdb3-94ab3c327f95 tempest-ServerAddressesNegativeTestJSON-1549542698 tempest-ServerAddressesNegativeTestJSON-1549542698-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:24.499374 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e702585f-e7c1-4cc9-bdb3-94ab3c327f95 tempest-ServerAddressesNegativeTestJSON-1549542698 tempest-ServerAddressesNegativeTestJSON-1549542698-project] [instance: 7f1a706c-5002-4d52-83ba-f25ce7771d02] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:24.512130 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e702585f-e7c1-4cc9-bdb3-94ab3c327f95 tempest-ServerAddressesNegativeTestJSON-1549542698 tempest-ServerAddressesNegativeTestJSON-1549542698-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:24.513627 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e702585f-e7c1-4cc9-bdb3-94ab3c327f95 tempest-ServerAddressesNegativeTestJSON-1549542698 tempest-ServerAddressesNegativeTestJSON-1549542698-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:24.514871 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e702585f-e7c1-4cc9-bdb3-94ab3c327f95 tempest-ServerAddressesNegativeTestJSON-1549542698 tempest-ServerAddressesNegativeTestJSON-1549542698-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:24.518011 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e702585f-e7c1-4cc9-bdb3-94ab3c327f95 tempest-ServerAddressesNegativeTestJSON-1549542698 tempest-ServerAddressesNegativeTestJSON-1549542698-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:24.523028 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e702585f-e7c1-4cc9-bdb3-94ab3c327f95 tempest-ServerAddressesNegativeTestJSON-1549542698 tempest-ServerAddressesNegativeTestJSON-1549542698-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:24.523723 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e702585f-e7c1-4cc9-bdb3-94ab3c327f95 tempest-ServerAddressesNegativeTestJSON-1549542698 tempest-ServerAddressesNegativeTestJSON-1549542698-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:24.602616 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-222c091b-960f-4196-a9a6-a8caf59e9d51 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "POST /compute/v2.1/servers/ac3f41f1-ed37-4009-81e5-7bee0ee6ea69/action" status: 200 len: 14 microversion: 2.1 time: 0.206713 Oct 04 20:48:24.607360 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1702/3315] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 20:48:24 2022] POST /compute/v2.1/servers/ac3f41f1-ed37-4009-81e5-7bee0ee6ea69/action => generated 14 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 20:48:24.618689 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-f532d116-2971-47ce-89c9-91d9a7f1a623 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:24.621517 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-f532d116-2971-47ce-89c9-91d9a7f1a623 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] [instance: 041f0f59-75c7-4d01-bc99-77cb871f0fef] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:24.641519 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f532d116-2971-47ce-89c9-91d9a7f1a623 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:24.645793 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f532d116-2971-47ce-89c9-91d9a7f1a623 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:24.646543 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f532d116-2971-47ce-89c9-91d9a7f1a623 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:24.647608 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f532d116-2971-47ce-89c9-91d9a7f1a623 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:24.648409 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f532d116-2971-47ce-89c9-91d9a7f1a623 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:24.649267 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f532d116-2971-47ce-89c9-91d9a7f1a623 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:24.685866 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.wsgi [None req-f532d116-2971-47ce-89c9-91d9a7f1a623 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] HTTP exception thrown: Instance 041f0f59-75c7-4d01-bc99-77cb871f0fef could not be found. Oct 04 20:48:24.688329 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-f532d116-2971-47ce-89c9-91d9a7f1a623 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Request method failure captured: Oct 04 20:48:24.688329 n-d-854823-8 devstack@n-api.service[128802]: request: GET /compute/v2.1/servers/041f0f59-75c7-4d01-bc99-77cb871f0fef HTTP/1.1 Oct 04 20:48:24.688329 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 20:48:24.688329 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 20:48:24.688329 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 20:48:24.688329 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 0 Oct 04 20:48:24.688329 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 20:48:24.688329 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 20:48:24.688329 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 20:48:24.688329 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 20:48:24.688329 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPJsSwF2ySar2LJQGdSe43g0QAYtjP4_BPyLRwM7Cr4_8Oz_X-RTScy1BL0ogt-qe3YNvQGTaYbVbGoUGx7pHqiHpbZftU7_TcvDA_zpgTfxGGH91CR74RG6crXL2bxRs87dSvsLYuOWMw7_AQjTpWetc1HBlb5th2rD-ko2SN3gLGSA Oct 04 20:48:24.688329 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 20:48:24.688329 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 20:48:24.688329 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 20:48:24.688329 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 20:48:24.688329 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 20:48:24.688329 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 20:48:24.688329 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: 7097bc12179446f6a3e1fac8434d5c64 Oct 04 20:48:24.688329 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-ServersTestJSON-927611194 Oct 04 20:48:24.688329 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 20:48:24.688329 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 20:48:24.688329 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_7097bc12179446f6a3e1fac8434d5c64", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7097bc12179446f6a3e1fac8434d5c64"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7097bc12179446f6a3e1fac8434d5c64"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/7097bc12179446f6a3e1fac8434d5c64"}]}] Oct 04 20:48:24.688329 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-ServersTestJSON-927611194 Oct 04 20:48:24.688329 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: 7097bc12179446f6a3e1fac8434d5c64 Oct 04 20:48:24.688329 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-ServersTestJSON-927611194 Oct 04 20:48:24.688329 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-ServersTestJSON-927611194-project Oct 04 20:48:24.688329 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 20:48:24.688329 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 20:48:24.688329 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: 87dcc7baf63f4ae6bfe0a099adffd408 Oct 04 20:48:24.688329 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-ServersTestJSON-927611194-project Oct 04 20:48:24.688329 n-d-854823-8 devstack@n-api.service[128802]: method: > Oct 04 20:48:24.688329 n-d-854823-8 devstack@n-api.service[128802]: exception: Instance 041f0f59-75c7-4d01-bc99-77cb871f0fef could not be found. Oct 04 20:48:24.688329 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'id': '041f0f59-75c7-4d01-bc99-77cb871f0fef'} Oct 04 20:48:24.688329 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:48:24.688329 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:48:24.688329 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:48:24.688329 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:48:24.688329 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:48:24.688329 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:48:24.688329 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:48:24.688329 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:48:24.688329 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:48:24.688329 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:48:24.688329 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 041f0f59-75c7-4d01-bc99-77cb871f0fef could not be found. Oct 04 20:48:24.688329 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:48:24.688329 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:48:24.688329 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:48:24.688329 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:48:24.688329 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:48:24.688329 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:48:24.688329 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:48:24.688329 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:48:24.688329 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:48:24.688329 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:48:24.688329 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:48:24.688329 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:48:24.688329 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:48:24.688329 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:48:24.688329 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:48:24.688329 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:48:24.688329 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 041f0f59-75c7-4d01-bc99-77cb871f0fef could not be found. Oct 04 20:48:24.688329 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:48:24.688329 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:48:24.688329 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:48:24.688329 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:48:24.694986 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:48:24.694986 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:48:24.694986 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:48:24.694986 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:48:24.694986 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 041f0f59-75c7-4d01-bc99-77cb871f0fef could not be found. Oct 04 20:48:24.694986 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:48:24.694986 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-f532d116-2971-47ce-89c9-91d9a7f1a623 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Returning 404 to user: Instance 041f0f59-75c7-4d01-bc99-77cb871f0fef could not be found. {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:48:24.694986 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-f532d116-2971-47ce-89c9-91d9a7f1a623 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] 10.222.0.33 "GET /compute/v2.1/servers/041f0f59-75c7-4d01-bc99-77cb871f0fef" status: 404 len: 111 microversion: 2.1 time: 0.080423 Oct 04 20:48:24.697489 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1703/3316] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:48:24 2022] GET /compute/v2.1/servers/041f0f59-75c7-4d01-bc99-77cb871f0fef => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:48:24.710647 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-a6653e60-3f99-4980-b67f-e43919068a0a tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:24.714120 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-a6653e60-3f99-4980-b67f-e43919068a0a tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] [instance: f9938964-5f2f-4093-b5cb-967adbe97623] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:24.733336 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a6653e60-3f99-4980-b67f-e43919068a0a tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:24.733837 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a6653e60-3f99-4980-b67f-e43919068a0a tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:24.734276 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a6653e60-3f99-4980-b67f-e43919068a0a tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:24.735022 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a6653e60-3f99-4980-b67f-e43919068a0a tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:24.735478 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a6653e60-3f99-4980-b67f-e43919068a0a tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:24.735903 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a6653e60-3f99-4980-b67f-e43919068a0a tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:25.041822 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-a6653e60-3f99-4980-b67f-e43919068a0a tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e4b00964014a0383f79597652bd428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7f38600b5041ad8e66a12d77b940fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:25.050505 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-a6653e60-3f99-4980-b67f-e43919068a0a tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] 10.222.0.33 "GET /compute/v2.1/servers/f9938964-5f2f-4093-b5cb-967adbe97623" status: 200 len: 1302 microversion: 2.1 time: 0.353139 Oct 04 20:48:25.051096 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1704/3317] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:48:24 2022] GET /compute/v2.1/servers/f9938964-5f2f-4093-b5cb-967adbe97623 => generated 1302 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:48:25.069493 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-1470aec4-9546-4068-b8c2-6dcd8ac09e65 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:25.077343 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-1470aec4-9546-4068-b8c2-6dcd8ac09e65 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] [instance: c0a14e22-0620-4912-9893-62974c80978a] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:25.099616 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1470aec4-9546-4068-b8c2-6dcd8ac09e65 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:25.102598 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1470aec4-9546-4068-b8c2-6dcd8ac09e65 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:25.114520 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1470aec4-9546-4068-b8c2-6dcd8ac09e65 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:25.117617 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1470aec4-9546-4068-b8c2-6dcd8ac09e65 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:25.119389 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1470aec4-9546-4068-b8c2-6dcd8ac09e65 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:25.123654 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1470aec4-9546-4068-b8c2-6dcd8ac09e65 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:25.394410 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-1470aec4-9546-4068-b8c2-6dcd8ac09e65 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28399882314945d787a3af6eb59935c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5392c67506f7445ab33d62b191558f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:25.414657 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-1470aec4-9546-4068-b8c2-6dcd8ac09e65 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28399882314945d787a3af6eb59935c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5392c67506f7445ab33d62b191558f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:25.417916 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-1470aec4-9546-4068-b8c2-6dcd8ac09e65 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28399882314945d787a3af6eb59935c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5392c67506f7445ab33d62b191558f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:25.422924 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-1470aec4-9546-4068-b8c2-6dcd8ac09e65 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] 10.222.0.33 "GET /compute/v2.1/servers/c0a14e22-0620-4912-9893-62974c80978a" status: 200 len: 1604 microversion: 2.32 time: 0.361441 Oct 04 20:48:25.425584 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1705/3318] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:48:25 2022] GET /compute/v2.1/servers/c0a14e22-0620-4912-9893-62974c80978a => generated 1604 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:48:25.444171 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-1392b271-81b7-4814-bab6-3932687fb8f0 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Action: 'create', calling method: .version_select at 0x7f3c7450d9d0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1798832857", "description": "tempest-description-726314470"}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:48:25.582376 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e702585f-e7c1-4cc9-bdb3-94ab3c327f95 tempest-ServerAddressesNegativeTestJSON-1549542698 tempest-ServerAddressesNegativeTestJSON-1549542698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0fdccf8a4c74c56bd811a0092c92bd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '031ee0beac0b4fd6b43a1030e07c82ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:25.598573 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e702585f-e7c1-4cc9-bdb3-94ab3c327f95 tempest-ServerAddressesNegativeTestJSON-1549542698 tempest-ServerAddressesNegativeTestJSON-1549542698-project] 10.222.0.33 "GET /compute/v2.1/servers/7f1a706c-5002-4d52-83ba-f25ce7771d02" status: 200 len: 1324 microversion: 2.1 time: 1.112974 Oct 04 20:48:25.601445 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1614/3319] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:48:24 2022] GET /compute/v2.1/servers/7f1a706c-5002-4d52-83ba-f25ce7771d02 => generated 1324 bytes in 1117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:48:25.631722 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d1352bc8-fa4a-4010-8905-c69d3684bf1a tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:25.632546 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d1352bc8-fa4a-4010-8905-c69d3684bf1a tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] [instance: 9df70a8d-757f-4b92-ab73-6ad6cfc98953] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:25.640224 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d1352bc8-fa4a-4010-8905-c69d3684bf1a tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:25.641204 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d1352bc8-fa4a-4010-8905-c69d3684bf1a tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:25.641797 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d1352bc8-fa4a-4010-8905-c69d3684bf1a tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:25.642814 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d1352bc8-fa4a-4010-8905-c69d3684bf1a tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:25.643983 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d1352bc8-fa4a-4010-8905-c69d3684bf1a tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:25.661760 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d1352bc8-fa4a-4010-8905-c69d3684bf1a tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:25.762238 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d1352bc8-fa4a-4010-8905-c69d3684bf1a tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aca59cd50bf74a36bb1e4427cd50fbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3fadcd7d4043daa0a6aba27ba814d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:25.781897 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d1352bc8-fa4a-4010-8905-c69d3684bf1a tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] 10.222.0.33 "GET /compute/v2.1/servers/9df70a8d-757f-4b92-ab73-6ad6cfc98953" status: 200 len: 1212 microversion: 2.1 time: 0.178116 Oct 04 20:48:25.785699 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1615/3320] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:48:25 2022] GET /compute/v2.1/servers/9df70a8d-757f-4b92-ab73-6ad6cfc98953 => generated 1212 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:48:25.799081 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-26d43ce1-b863-408f-94c4-b95e90fb054a tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:25.802663 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-26d43ce1-b863-408f-94c4-b95e90fb054a tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] [instance: 041f0f59-75c7-4d01-bc99-77cb871f0fef] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:25.821734 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-26d43ce1-b863-408f-94c4-b95e90fb054a tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:25.824585 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-26d43ce1-b863-408f-94c4-b95e90fb054a tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:25.826195 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-26d43ce1-b863-408f-94c4-b95e90fb054a tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:25.829783 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-26d43ce1-b863-408f-94c4-b95e90fb054a tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:25.831602 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-26d43ce1-b863-408f-94c4-b95e90fb054a tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:25.834209 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-26d43ce1-b863-408f-94c4-b95e90fb054a tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:25.843681 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:48:25.870628 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-1392b271-81b7-4814-bab6-3932687fb8f0 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] 10.222.0.33 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.440349 Oct 04 20:48:25.871382 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1706/3321] 10.222.0.33 () {60 vars in 1180 bytes} [Tue Oct 4 20:48:25 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:48:25.882685 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-26d43ce1-b863-408f-94c4-b95e90fb054a tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] HTTP exception thrown: Instance 041f0f59-75c7-4d01-bc99-77cb871f0fef could not be found. Oct 04 20:48:25.884197 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-8cef7c57-3696-4334-b822-ddf6afc18c15 req-6c8fdd02-0508-4b88-9930-3e4012500278 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e0006b2-ed59-4ad1-a921-d1db19cb97b6", "name": "network-vif-deleted", "tag": "dc42a420-def0-4262-941b-1c282e275581"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:48:25.888898 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-26d43ce1-b863-408f-94c4-b95e90fb054a tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Request method failure captured: Oct 04 20:48:25.888898 n-d-854823-8 devstack@n-api.service[128801]: request: DELETE /compute/v2.1/servers/041f0f59-75c7-4d01-bc99-77cb871f0fef HTTP/1.1 Oct 04 20:48:25.888898 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:48:25.888898 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:48:25.888898 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:48:25.888898 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 0 Oct 04 20:48:25.888898 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:48:25.888898 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:48:25.888898 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:48:25.888898 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:48:25.888898 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJsSwF2ySar2LJQGdSe43g0QAYtjP4_BPyLRwM7Cr4_8Oz_X-RTScy1BL0ogt-qe3YNvQGTaYbVbGoUGx7pHqiHpbZftU7_TcvDA_zpgTfxGGH91CR74RG6crXL2bxRs87dSvsLYuOWMw7_AQjTpWetc1HBlb5th2rD-ko2SN3gLGSA Oct 04 20:48:25.888898 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:48:25.888898 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:48:25.888898 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:48:25.888898 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:48:25.888898 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:48:25.888898 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:48:25.888898 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: 7097bc12179446f6a3e1fac8434d5c64 Oct 04 20:48:25.888898 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-ServersTestJSON-927611194 Oct 04 20:48:25.888898 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 20:48:25.888898 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 20:48:25.888898 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_7097bc12179446f6a3e1fac8434d5c64", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7097bc12179446f6a3e1fac8434d5c64"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7097bc12179446f6a3e1fac8434d5c64"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/7097bc12179446f6a3e1fac8434d5c64"}]}] Oct 04 20:48:25.888898 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-ServersTestJSON-927611194 Oct 04 20:48:25.888898 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: 7097bc12179446f6a3e1fac8434d5c64 Oct 04 20:48:25.888898 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ServersTestJSON-927611194 Oct 04 20:48:25.888898 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-ServersTestJSON-927611194-project Oct 04 20:48:25.888898 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:48:25.888898 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:48:25.888898 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: 87dcc7baf63f4ae6bfe0a099adffd408 Oct 04 20:48:25.888898 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-ServersTestJSON-927611194-project Oct 04 20:48:25.888898 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 20:48:25.888898 n-d-854823-8 devstack@n-api.service[128801]: exception: Instance 041f0f59-75c7-4d01-bc99-77cb871f0fef could not be found. Oct 04 20:48:25.888898 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': '041f0f59-75c7-4d01-bc99-77cb871f0fef'} Oct 04 20:48:25.888898 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:48:25.888898 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:48:25.888898 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:48:25.888898 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:48:25.888898 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:48:25.888898 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:48:25.888898 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:48:25.888898 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:48:25.888898 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:48:25.888898 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:48:25.888898 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 041f0f59-75c7-4d01-bc99-77cb871f0fef could not be found. Oct 04 20:48:25.888898 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:48:25.888898 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:48:25.888898 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:48:25.888898 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:48:25.888898 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:48:25.888898 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:48:25.888898 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:48:25.888898 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:48:25.888898 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:48:25.888898 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:48:25.888898 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 20:48:25.888898 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 20:48:25.888898 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 20:48:25.888898 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 20:48:25.888898 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:48:25.888898 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:48:25.888898 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:48:25.888898 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:48:25.888898 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 041f0f59-75c7-4d01-bc99-77cb871f0fef could not be found. Oct 04 20:48:25.895442 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:48:25.895442 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:48:25.895442 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:48:25.895442 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:48:25.895442 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:48:25.895442 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:48:25.895442 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:48:25.895442 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:48:25.895442 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 041f0f59-75c7-4d01-bc99-77cb871f0fef could not be found. Oct 04 20:48:25.895442 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:48:25.898131 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-26d43ce1-b863-408f-94c4-b95e90fb054a tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Returning 404 to user: Instance 041f0f59-75c7-4d01-bc99-77cb871f0fef could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:48:25.899159 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-26d43ce1-b863-408f-94c4-b95e90fb054a tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] 10.222.0.33 "DELETE /compute/v2.1/servers/041f0f59-75c7-4d01-bc99-77cb871f0fef" status: 404 len: 111 microversion: 2.1 time: 0.111673 Oct 04 20:48:25.899605 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-8cef7c57-3696-4334-b822-ddf6afc18c15 req-6c8fdd02-0508-4b88-9930-3e4012500278 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:25.899948 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1616/3322] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 20:48:25 2022] DELETE /compute/v2.1/servers/041f0f59-75c7-4d01-bc99-77cb871f0fef => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:48:25.905218 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-8cef7c57-3696-4334-b822-ddf6afc18c15 req-6c8fdd02-0508-4b88-9930-3e4012500278 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:25.905739 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-8cef7c57-3696-4334-b822-ddf6afc18c15 req-6c8fdd02-0508-4b88-9930-3e4012500278 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:25.911510 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-203604b6-a3d3-424f-a1cc-84546116c10a tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:48:25.914191 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-203604b6-a3d3-424f-a1cc-84546116c10a tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: ac3f41f1-ed37-4009-81e5-7bee0ee6ea69] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:25.925214 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-203604b6-a3d3-424f-a1cc-84546116c10a tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:25.925902 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-203604b6-a3d3-424f-a1cc-84546116c10a tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:25.926484 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-203604b6-a3d3-424f-a1cc-84546116c10a tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:25.927865 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-203604b6-a3d3-424f-a1cc-84546116c10a tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:25.928440 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-203604b6-a3d3-424f-a1cc-84546116c10a tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:25.928969 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-203604b6-a3d3-424f-a1cc-84546116c10a tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:25.951368 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-8cef7c57-3696-4334-b822-ddf6afc18c15 req-6c8fdd02-0508-4b88-9930-3e4012500278 service nova] Creating event network-vif-deleted:dc42a420-def0-4262-941b-1c282e275581 for instance 8e0006b2-ed59-4ad1-a921-d1db19cb97b6 on n-h2-854823-8 Oct 04 20:48:25.966888 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-8cef7c57-3696-4334-b822-ddf6afc18c15 req-6c8fdd02-0508-4b88-9930-3e4012500278 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091736 Oct 04 20:48:25.967557 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1707/3323] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:48:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:48:25.988528 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-1d09b153-fabc-439e-961e-0398cd170fdf tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Calling method '.version_select at 0x7f3c746624c0>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:26.024308 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-203604b6-a3d3-424f-a1cc-84546116c10a tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "POST /compute/v2.1/servers/ac3f41f1-ed37-4009-81e5-7bee0ee6ea69/action" status: 200 len: 14 microversion: 2.1 time: 0.118187 Oct 04 20:48:26.034686 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1617/3324] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 20:48:25 2022] POST /compute/v2.1/servers/ac3f41f1-ed37-4009-81e5-7bee0ee6ea69/action => generated 14 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 20:48:26.081724 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5de99077-e8a4-49ec-a0e1-763be48dc03a tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:26.086013 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-5de99077-e8a4-49ec-a0e1-763be48dc03a tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] [instance: 041f0f59-75c7-4d01-bc99-77cb871f0fef] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:26.107537 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5de99077-e8a4-49ec-a0e1-763be48dc03a tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:26.108768 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5de99077-e8a4-49ec-a0e1-763be48dc03a tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:26.109955 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5de99077-e8a4-49ec-a0e1-763be48dc03a tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:26.111142 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5de99077-e8a4-49ec-a0e1-763be48dc03a tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:26.113892 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5de99077-e8a4-49ec-a0e1-763be48dc03a tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:26.114933 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5de99077-e8a4-49ec-a0e1-763be48dc03a tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:26.195345 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-5de99077-e8a4-49ec-a0e1-763be48dc03a tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] HTTP exception thrown: Instance 041f0f59-75c7-4d01-bc99-77cb871f0fef could not be found. Oct 04 20:48:26.200826 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5de99077-e8a4-49ec-a0e1-763be48dc03a tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Request method failure captured: Oct 04 20:48:26.200826 n-d-854823-8 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/041f0f59-75c7-4d01-bc99-77cb871f0fef HTTP/1.1 Oct 04 20:48:26.200826 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:48:26.200826 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:48:26.200826 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:48:26.200826 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 0 Oct 04 20:48:26.200826 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:48:26.200826 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:48:26.200826 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:48:26.200826 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:48:26.200826 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJsSwF2ySar2LJQGdSe43g0QAYtjP4_BPyLRwM7Cr4_8Oz_X-RTScy1BL0ogt-qe3YNvQGTaYbVbGoUGx7pHqiHpbZftU7_TcvDA_zpgTfxGGH91CR74RG6crXL2bxRs87dSvsLYuOWMw7_AQjTpWetc1HBlb5th2rD-ko2SN3gLGSA Oct 04 20:48:26.200826 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:48:26.200826 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:48:26.200826 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:48:26.200826 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:48:26.200826 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:48:26.200826 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:48:26.200826 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: 7097bc12179446f6a3e1fac8434d5c64 Oct 04 20:48:26.200826 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-ServersTestJSON-927611194 Oct 04 20:48:26.200826 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 20:48:26.200826 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 20:48:26.200826 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_7097bc12179446f6a3e1fac8434d5c64", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7097bc12179446f6a3e1fac8434d5c64"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7097bc12179446f6a3e1fac8434d5c64"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/7097bc12179446f6a3e1fac8434d5c64"}]}] Oct 04 20:48:26.200826 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-ServersTestJSON-927611194 Oct 04 20:48:26.200826 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: 7097bc12179446f6a3e1fac8434d5c64 Oct 04 20:48:26.200826 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ServersTestJSON-927611194 Oct 04 20:48:26.200826 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-ServersTestJSON-927611194-project Oct 04 20:48:26.200826 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:48:26.200826 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:48:26.200826 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: 87dcc7baf63f4ae6bfe0a099adffd408 Oct 04 20:48:26.200826 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-ServersTestJSON-927611194-project Oct 04 20:48:26.200826 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 20:48:26.200826 n-d-854823-8 devstack@n-api.service[128801]: exception: Instance 041f0f59-75c7-4d01-bc99-77cb871f0fef could not be found. Oct 04 20:48:26.200826 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': '041f0f59-75c7-4d01-bc99-77cb871f0fef'} Oct 04 20:48:26.200826 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:48:26.200826 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:48:26.200826 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:48:26.200826 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:48:26.200826 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:48:26.200826 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:48:26.200826 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:48:26.200826 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:48:26.200826 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:48:26.200826 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:48:26.200826 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 041f0f59-75c7-4d01-bc99-77cb871f0fef could not be found. Oct 04 20:48:26.200826 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:48:26.200826 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:48:26.200826 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:48:26.200826 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:48:26.200826 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:48:26.200826 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:48:26.200826 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:48:26.200826 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:48:26.200826 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:48:26.200826 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:48:26.200826 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:48:26.200826 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:48:26.200826 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:48:26.200826 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:48:26.200826 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:48:26.200826 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:48:26.200826 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 041f0f59-75c7-4d01-bc99-77cb871f0fef could not be found. Oct 04 20:48:26.200826 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:48:26.200826 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:48:26.200826 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:48:26.200826 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:48:26.205371 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:48:26.205371 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:48:26.205371 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:48:26.205371 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:48:26.205371 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 041f0f59-75c7-4d01-bc99-77cb871f0fef could not be found. Oct 04 20:48:26.205371 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:48:26.210403 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5de99077-e8a4-49ec-a0e1-763be48dc03a tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Returning 404 to user: Instance 041f0f59-75c7-4d01-bc99-77cb871f0fef could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:48:26.213128 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5de99077-e8a4-49ec-a0e1-763be48dc03a tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] 10.222.0.33 "GET /compute/v2.1/servers/041f0f59-75c7-4d01-bc99-77cb871f0fef" status: 404 len: 111 microversion: 2.1 time: 0.173908 Oct 04 20:48:26.220485 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1618/3325] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:48:26 2022] GET /compute/v2.1/servers/041f0f59-75c7-4d01-bc99-77cb871f0fef => generated 111 bytes in 185 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:48:26.233617 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ae3a363a-898f-471c-9f87-b0541a5c8503 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:26.236718 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ae3a363a-898f-471c-9f87-b0541a5c8503 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] [instance: f9938964-5f2f-4093-b5cb-967adbe97623] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:26.247800 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ae3a363a-898f-471c-9f87-b0541a5c8503 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:26.251620 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ae3a363a-898f-471c-9f87-b0541a5c8503 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:26.252497 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ae3a363a-898f-471c-9f87-b0541a5c8503 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:26.254199 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ae3a363a-898f-471c-9f87-b0541a5c8503 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:26.254970 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ae3a363a-898f-471c-9f87-b0541a5c8503 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:26.255634 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ae3a363a-898f-471c-9f87-b0541a5c8503 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:26.465704 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-ae3a363a-898f-471c-9f87-b0541a5c8503 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e4b00964014a0383f79597652bd428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7f38600b5041ad8e66a12d77b940fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:26.489337 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ae3a363a-898f-471c-9f87-b0541a5c8503 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] 10.222.0.33 "GET /compute/v2.1/servers/f9938964-5f2f-4093-b5cb-967adbe97623" status: 200 len: 1300 microversion: 2.1 time: 0.266753 Oct 04 20:48:26.506270 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1619/3326] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:48:26 2022] GET /compute/v2.1/servers/f9938964-5f2f-4093-b5cb-967adbe97623 => generated 1300 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:48:26.515276 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1b15b4a2-aebd-4cb2-800e-157ac727244f tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:26.519117 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-1b15b4a2-aebd-4cb2-800e-157ac727244f tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] [instance: 32237627-3fea-48d4-959f-3a2aa519adf3] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:26.529507 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1b15b4a2-aebd-4cb2-800e-157ac727244f tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:26.535249 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1b15b4a2-aebd-4cb2-800e-157ac727244f tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:26.537618 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1b15b4a2-aebd-4cb2-800e-157ac727244f tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:26.538574 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1b15b4a2-aebd-4cb2-800e-157ac727244f tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:26.540804 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1b15b4a2-aebd-4cb2-800e-157ac727244f tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:26.541492 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1b15b4a2-aebd-4cb2-800e-157ac727244f tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:26.563736 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-1b15b4a2-aebd-4cb2-800e-157ac727244f tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] HTTP exception thrown: Instance 32237627-3fea-48d4-959f-3a2aa519adf3 could not be found. Oct 04 20:48:26.570117 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1b15b4a2-aebd-4cb2-800e-157ac727244f tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Request method failure captured: Oct 04 20:48:26.570117 n-d-854823-8 devstack@n-api.service[128801]: request: DELETE /compute/v2.1/servers/32237627-3fea-48d4-959f-3a2aa519adf3 HTTP/1.1 Oct 04 20:48:26.570117 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:48:26.570117 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:48:26.570117 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:48:26.570117 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 0 Oct 04 20:48:26.570117 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:48:26.570117 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:48:26.570117 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:48:26.570117 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:48:26.570117 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJsSwF2ySar2LJQGdSe43g0QAYtjP4_BPyLRwM7Cr4_8Oz_X-RTScy1BL0ogt-qe3YNvQGTaYbVbGoUGx7pHqiHpbZftU7_TcvDA_zpgTfxGGH91CR74RG6crXL2bxRs87dSvsLYuOWMw7_AQjTpWetc1HBlb5th2rD-ko2SN3gLGSA Oct 04 20:48:26.570117 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:48:26.570117 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:48:26.570117 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:48:26.570117 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:48:26.570117 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:48:26.570117 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:48:26.570117 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: 7097bc12179446f6a3e1fac8434d5c64 Oct 04 20:48:26.570117 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-ServersTestJSON-927611194 Oct 04 20:48:26.570117 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 20:48:26.570117 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 20:48:26.570117 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_7097bc12179446f6a3e1fac8434d5c64", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7097bc12179446f6a3e1fac8434d5c64"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7097bc12179446f6a3e1fac8434d5c64"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/7097bc12179446f6a3e1fac8434d5c64"}]}] Oct 04 20:48:26.570117 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-ServersTestJSON-927611194 Oct 04 20:48:26.570117 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: 7097bc12179446f6a3e1fac8434d5c64 Oct 04 20:48:26.570117 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ServersTestJSON-927611194 Oct 04 20:48:26.570117 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-ServersTestJSON-927611194-project Oct 04 20:48:26.570117 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:48:26.570117 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:48:26.570117 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: 87dcc7baf63f4ae6bfe0a099adffd408 Oct 04 20:48:26.570117 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-ServersTestJSON-927611194-project Oct 04 20:48:26.570117 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 20:48:26.570117 n-d-854823-8 devstack@n-api.service[128801]: exception: Instance 32237627-3fea-48d4-959f-3a2aa519adf3 could not be found. Oct 04 20:48:26.570117 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': '32237627-3fea-48d4-959f-3a2aa519adf3'} Oct 04 20:48:26.570117 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:48:26.570117 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:48:26.570117 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:48:26.570117 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:48:26.570117 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:48:26.570117 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:48:26.570117 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:48:26.570117 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:48:26.570117 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:48:26.570117 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:48:26.570117 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32237627-3fea-48d4-959f-3a2aa519adf3 could not be found. Oct 04 20:48:26.570117 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:48:26.570117 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:48:26.570117 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:48:26.570117 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:48:26.570117 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:48:26.570117 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:48:26.570117 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:48:26.570117 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:48:26.570117 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:48:26.570117 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:48:26.570117 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 20:48:26.570117 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 20:48:26.570117 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 20:48:26.570117 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 20:48:26.570117 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:48:26.570117 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:48:26.570117 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:48:26.570117 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:48:26.570117 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32237627-3fea-48d4-959f-3a2aa519adf3 could not be found. Oct 04 20:48:26.574283 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:48:26.574283 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:48:26.574283 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:48:26.574283 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:48:26.574283 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:48:26.574283 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:48:26.574283 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:48:26.574283 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:48:26.574283 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32237627-3fea-48d4-959f-3a2aa519adf3 could not be found. Oct 04 20:48:26.574283 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:48:26.577568 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1b15b4a2-aebd-4cb2-800e-157ac727244f tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Returning 404 to user: Instance 32237627-3fea-48d4-959f-3a2aa519adf3 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:48:26.586224 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-1b15b4a2-aebd-4cb2-800e-157ac727244f tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] 10.222.0.33 "DELETE /compute/v2.1/servers/32237627-3fea-48d4-959f-3a2aa519adf3" status: 404 len: 111 microversion: 2.1 time: 0.078704 Oct 04 20:48:26.587651 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1620/3327] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 20:48:26 2022] DELETE /compute/v2.1/servers/32237627-3fea-48d4-959f-3a2aa519adf3 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:48:26.592502 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-99866d95-1a30-489c-a4ab-30dc1a99d7e7 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:26.594083 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-99866d95-1a30-489c-a4ab-30dc1a99d7e7 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] [instance: c0a14e22-0620-4912-9893-62974c80978a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:26.609395 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-99866d95-1a30-489c-a4ab-30dc1a99d7e7 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:26.610097 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-99866d95-1a30-489c-a4ab-30dc1a99d7e7 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:26.610676 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-99866d95-1a30-489c-a4ab-30dc1a99d7e7 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:26.611489 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-99866d95-1a30-489c-a4ab-30dc1a99d7e7 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:26.618453 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-99866d95-1a30-489c-a4ab-30dc1a99d7e7 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:26.619276 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-99866d95-1a30-489c-a4ab-30dc1a99d7e7 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:26.680845 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-1d09b153-fabc-439e-961e-0398cd170fdf tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] 10.222.0.33 "GET /compute/v2.1/os-security-groups" status: 200 len: 1831 microversion: 2.1 time: 0.709986 Oct 04 20:48:26.682567 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1708/3328] 10.222.0.33 () {58 vars in 1158 bytes} [Tue Oct 4 20:48:25 2022] GET /compute/v2.1/os-security-groups => generated 1831 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:48:26.696458 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-725b00b2-37c1-4378-b337-7cd0b9074e5e tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:26.697772 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-725b00b2-37c1-4378-b337-7cd0b9074e5e tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] [instance: 32237627-3fea-48d4-959f-3a2aa519adf3] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:26.715175 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-725b00b2-37c1-4378-b337-7cd0b9074e5e tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:26.716105 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-725b00b2-37c1-4378-b337-7cd0b9074e5e tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:26.716749 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-725b00b2-37c1-4378-b337-7cd0b9074e5e tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:26.717684 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-725b00b2-37c1-4378-b337-7cd0b9074e5e tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:26.718331 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-725b00b2-37c1-4378-b337-7cd0b9074e5e tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:26.718996 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-725b00b2-37c1-4378-b337-7cd0b9074e5e tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:26.756595 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.wsgi [None req-725b00b2-37c1-4378-b337-7cd0b9074e5e tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] HTTP exception thrown: Instance 32237627-3fea-48d4-959f-3a2aa519adf3 could not be found. Oct 04 20:48:26.760205 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-725b00b2-37c1-4378-b337-7cd0b9074e5e tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Request method failure captured: Oct 04 20:48:26.760205 n-d-854823-8 devstack@n-api.service[128802]: request: GET /compute/v2.1/servers/32237627-3fea-48d4-959f-3a2aa519adf3 HTTP/1.1 Oct 04 20:48:26.760205 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 20:48:26.760205 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 20:48:26.760205 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 20:48:26.760205 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 0 Oct 04 20:48:26.760205 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 20:48:26.760205 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 20:48:26.760205 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 20:48:26.760205 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 20:48:26.760205 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPJsSwF2ySar2LJQGdSe43g0QAYtjP4_BPyLRwM7Cr4_8Oz_X-RTScy1BL0ogt-qe3YNvQGTaYbVbGoUGx7pHqiHpbZftU7_TcvDA_zpgTfxGGH91CR74RG6crXL2bxRs87dSvsLYuOWMw7_AQjTpWetc1HBlb5th2rD-ko2SN3gLGSA Oct 04 20:48:26.760205 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 20:48:26.760205 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 20:48:26.760205 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 20:48:26.760205 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 20:48:26.760205 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 20:48:26.760205 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 20:48:26.760205 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: 7097bc12179446f6a3e1fac8434d5c64 Oct 04 20:48:26.760205 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-ServersTestJSON-927611194 Oct 04 20:48:26.760205 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 20:48:26.760205 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 20:48:26.760205 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_7097bc12179446f6a3e1fac8434d5c64", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7097bc12179446f6a3e1fac8434d5c64"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7097bc12179446f6a3e1fac8434d5c64"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/7097bc12179446f6a3e1fac8434d5c64"}]}] Oct 04 20:48:26.760205 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-ServersTestJSON-927611194 Oct 04 20:48:26.760205 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: 7097bc12179446f6a3e1fac8434d5c64 Oct 04 20:48:26.760205 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-ServersTestJSON-927611194 Oct 04 20:48:26.760205 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-ServersTestJSON-927611194-project Oct 04 20:48:26.760205 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 20:48:26.760205 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 20:48:26.760205 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: 87dcc7baf63f4ae6bfe0a099adffd408 Oct 04 20:48:26.760205 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-ServersTestJSON-927611194-project Oct 04 20:48:26.760205 n-d-854823-8 devstack@n-api.service[128802]: method: > Oct 04 20:48:26.760205 n-d-854823-8 devstack@n-api.service[128802]: exception: Instance 32237627-3fea-48d4-959f-3a2aa519adf3 could not be found. Oct 04 20:48:26.760205 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'id': '32237627-3fea-48d4-959f-3a2aa519adf3'} Oct 04 20:48:26.760205 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:48:26.760205 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:48:26.760205 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:48:26.760205 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:48:26.760205 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:48:26.760205 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:48:26.760205 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:48:26.760205 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:48:26.760205 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:48:26.760205 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:48:26.760205 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32237627-3fea-48d4-959f-3a2aa519adf3 could not be found. Oct 04 20:48:26.760205 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:48:26.760205 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:48:26.760205 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:48:26.760205 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:48:26.760205 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:48:26.760205 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:48:26.760205 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:48:26.760205 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:48:26.760205 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:48:26.760205 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:48:26.760205 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:48:26.760205 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:48:26.760205 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:48:26.760205 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:48:26.760205 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:48:26.760205 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:48:26.760205 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32237627-3fea-48d4-959f-3a2aa519adf3 could not be found. Oct 04 20:48:26.760205 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:48:26.760205 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:48:26.760205 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:48:26.760205 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:48:26.764310 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:48:26.764310 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:48:26.764310 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:48:26.764310 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:48:26.764310 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32237627-3fea-48d4-959f-3a2aa519adf3 could not be found. Oct 04 20:48:26.764310 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:48:26.770155 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-725b00b2-37c1-4378-b337-7cd0b9074e5e tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Returning 404 to user: Instance 32237627-3fea-48d4-959f-3a2aa519adf3 could not be found. {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:48:26.775386 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-725b00b2-37c1-4378-b337-7cd0b9074e5e tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] 10.222.0.33 "GET /compute/v2.1/servers/32237627-3fea-48d4-959f-3a2aa519adf3" status: 404 len: 111 microversion: 2.1 time: 0.091053 Oct 04 20:48:26.779578 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1709/3329] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:48:26 2022] GET /compute/v2.1/servers/32237627-3fea-48d4-959f-3a2aa519adf3 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:48:26.787745 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-8b09581c-d759-4888-b934-c6c6e88201b8 tempest-ServerAddressesNegativeTestJSON-1549542698 tempest-ServerAddressesNegativeTestJSON-1549542698-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:26.799476 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-8b09581c-d759-4888-b934-c6c6e88201b8 tempest-ServerAddressesNegativeTestJSON-1549542698 tempest-ServerAddressesNegativeTestJSON-1549542698-project] [instance: 7f1a706c-5002-4d52-83ba-f25ce7771d02] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:26.806708 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8b09581c-d759-4888-b934-c6c6e88201b8 tempest-ServerAddressesNegativeTestJSON-1549542698 tempest-ServerAddressesNegativeTestJSON-1549542698-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:26.807345 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8b09581c-d759-4888-b934-c6c6e88201b8 tempest-ServerAddressesNegativeTestJSON-1549542698 tempest-ServerAddressesNegativeTestJSON-1549542698-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:26.807889 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8b09581c-d759-4888-b934-c6c6e88201b8 tempest-ServerAddressesNegativeTestJSON-1549542698 tempest-ServerAddressesNegativeTestJSON-1549542698-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:26.808858 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8b09581c-d759-4888-b934-c6c6e88201b8 tempest-ServerAddressesNegativeTestJSON-1549542698 tempest-ServerAddressesNegativeTestJSON-1549542698-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:26.809552 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8b09581c-d759-4888-b934-c6c6e88201b8 tempest-ServerAddressesNegativeTestJSON-1549542698 tempest-ServerAddressesNegativeTestJSON-1549542698-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:26.822902 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8b09581c-d759-4888-b934-c6c6e88201b8 tempest-ServerAddressesNegativeTestJSON-1549542698 tempest-ServerAddressesNegativeTestJSON-1549542698-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:26.889119 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-99866d95-1a30-489c-a4ab-30dc1a99d7e7 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28399882314945d787a3af6eb59935c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5392c67506f7445ab33d62b191558f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:26.911784 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-99866d95-1a30-489c-a4ab-30dc1a99d7e7 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28399882314945d787a3af6eb59935c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5392c67506f7445ab33d62b191558f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:26.913514 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-99866d95-1a30-489c-a4ab-30dc1a99d7e7 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28399882314945d787a3af6eb59935c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5392c67506f7445ab33d62b191558f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:26.918934 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-99866d95-1a30-489c-a4ab-30dc1a99d7e7 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] 10.222.0.33 "GET /compute/v2.1/servers/c0a14e22-0620-4912-9893-62974c80978a" status: 200 len: 1604 microversion: 2.32 time: 0.325955 Oct 04 20:48:26.919802 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1621/3330] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:48:26 2022] GET /compute/v2.1/servers/c0a14e22-0620-4912-9893-62974c80978a => generated 1604 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:48:26.926029 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ab9a59e3-e205-450a-9ddd-0ebcf217f1d5 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Calling method '.version_select at 0x7f3c7425bc10>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:27.230966 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-8b09581c-d759-4888-b934-c6c6e88201b8 tempest-ServerAddressesNegativeTestJSON-1549542698 tempest-ServerAddressesNegativeTestJSON-1549542698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0fdccf8a4c74c56bd811a0092c92bd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '031ee0beac0b4fd6b43a1030e07c82ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:27.255495 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-8b09581c-d759-4888-b934-c6c6e88201b8 tempest-ServerAddressesNegativeTestJSON-1549542698 tempest-ServerAddressesNegativeTestJSON-1549542698-project] 10.222.0.33 "GET /compute/v2.1/servers/7f1a706c-5002-4d52-83ba-f25ce7771d02" status: 200 len: 1324 microversion: 2.1 time: 0.470798 Oct 04 20:48:27.260935 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1710/3331] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:48:26 2022] GET /compute/v2.1/servers/7f1a706c-5002-4d52-83ba-f25ce7771d02 => generated 1324 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:48:27.276977 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-4ffbe946-735c-4593-9b5a-220c75c8a941 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:27.277728 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-4ffbe946-735c-4593-9b5a-220c75c8a941 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] [instance: b65c8ce2-8537-4f84-ba63-5b913f6adc81] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:27.294537 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4ffbe946-735c-4593-9b5a-220c75c8a941 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:27.297224 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4ffbe946-735c-4593-9b5a-220c75c8a941 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:27.298124 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4ffbe946-735c-4593-9b5a-220c75c8a941 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:27.303549 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4ffbe946-735c-4593-9b5a-220c75c8a941 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:27.304086 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4ffbe946-735c-4593-9b5a-220c75c8a941 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:27.304545 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4ffbe946-735c-4593-9b5a-220c75c8a941 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:27.356414 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.wsgi [None req-4ffbe946-735c-4593-9b5a-220c75c8a941 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] HTTP exception thrown: Instance b65c8ce2-8537-4f84-ba63-5b913f6adc81 could not be found. Oct 04 20:48:27.358581 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-4ffbe946-735c-4593-9b5a-220c75c8a941 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Request method failure captured: Oct 04 20:48:27.358581 n-d-854823-8 devstack@n-api.service[128802]: request: DELETE /compute/v2.1/servers/b65c8ce2-8537-4f84-ba63-5b913f6adc81 HTTP/1.1 Oct 04 20:48:27.358581 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 20:48:27.358581 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 20:48:27.358581 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 20:48:27.358581 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 0 Oct 04 20:48:27.358581 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 20:48:27.358581 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 20:48:27.358581 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 20:48:27.358581 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 20:48:27.358581 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPJsSwF2ySar2LJQGdSe43g0QAYtjP4_BPyLRwM7Cr4_8Oz_X-RTScy1BL0ogt-qe3YNvQGTaYbVbGoUGx7pHqiHpbZftU7_TcvDA_zpgTfxGGH91CR74RG6crXL2bxRs87dSvsLYuOWMw7_AQjTpWetc1HBlb5th2rD-ko2SN3gLGSA Oct 04 20:48:27.358581 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 20:48:27.358581 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 20:48:27.358581 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 20:48:27.358581 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 20:48:27.358581 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 20:48:27.358581 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 20:48:27.358581 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: 7097bc12179446f6a3e1fac8434d5c64 Oct 04 20:48:27.358581 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-ServersTestJSON-927611194 Oct 04 20:48:27.358581 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 20:48:27.358581 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 20:48:27.358581 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_7097bc12179446f6a3e1fac8434d5c64", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7097bc12179446f6a3e1fac8434d5c64"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7097bc12179446f6a3e1fac8434d5c64"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/7097bc12179446f6a3e1fac8434d5c64"}]}] Oct 04 20:48:27.358581 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-ServersTestJSON-927611194 Oct 04 20:48:27.358581 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: 7097bc12179446f6a3e1fac8434d5c64 Oct 04 20:48:27.358581 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-ServersTestJSON-927611194 Oct 04 20:48:27.358581 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-ServersTestJSON-927611194-project Oct 04 20:48:27.358581 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 20:48:27.358581 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 20:48:27.358581 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: 87dcc7baf63f4ae6bfe0a099adffd408 Oct 04 20:48:27.358581 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-ServersTestJSON-927611194-project Oct 04 20:48:27.358581 n-d-854823-8 devstack@n-api.service[128802]: method: > Oct 04 20:48:27.358581 n-d-854823-8 devstack@n-api.service[128802]: exception: Instance b65c8ce2-8537-4f84-ba63-5b913f6adc81 could not be found. Oct 04 20:48:27.358581 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'id': 'b65c8ce2-8537-4f84-ba63-5b913f6adc81'} Oct 04 20:48:27.358581 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:48:27.358581 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:48:27.358581 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:48:27.358581 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:48:27.358581 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:48:27.358581 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:48:27.358581 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:48:27.358581 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:48:27.358581 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:48:27.358581 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:48:27.358581 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b65c8ce2-8537-4f84-ba63-5b913f6adc81 could not be found. Oct 04 20:48:27.358581 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:48:27.358581 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:48:27.358581 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:48:27.358581 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:48:27.358581 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:48:27.358581 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:48:27.358581 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:48:27.358581 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:48:27.358581 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:48:27.358581 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:48:27.358581 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 20:48:27.358581 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 20:48:27.358581 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 20:48:27.358581 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 20:48:27.358581 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:48:27.358581 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:48:27.358581 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:48:27.358581 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:48:27.358581 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b65c8ce2-8537-4f84-ba63-5b913f6adc81 could not be found. Oct 04 20:48:27.364571 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:48:27.364571 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:48:27.364571 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:48:27.364571 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:48:27.364571 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:48:27.364571 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:48:27.364571 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:48:27.364571 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:48:27.364571 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b65c8ce2-8537-4f84-ba63-5b913f6adc81 could not be found. Oct 04 20:48:27.364571 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:48:27.366264 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-4ffbe946-735c-4593-9b5a-220c75c8a941 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Returning 404 to user: Instance b65c8ce2-8537-4f84-ba63-5b913f6adc81 could not be found. {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:48:27.367658 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-4ffbe946-735c-4593-9b5a-220c75c8a941 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] 10.222.0.33 "DELETE /compute/v2.1/servers/b65c8ce2-8537-4f84-ba63-5b913f6adc81" status: 404 len: 111 microversion: 2.1 time: 0.105285 Oct 04 20:48:27.368753 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1711/3332] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 20:48:27 2022] DELETE /compute/v2.1/servers/b65c8ce2-8537-4f84-ba63-5b913f6adc81 => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:48:27.374575 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-a0070919-4c2e-4656-8a5b-0d7fa429fabe tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:27.375718 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-a0070919-4c2e-4656-8a5b-0d7fa429fabe tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] [instance: 9df70a8d-757f-4b92-ab73-6ad6cfc98953] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:27.382222 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a0070919-4c2e-4656-8a5b-0d7fa429fabe tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:27.382991 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a0070919-4c2e-4656-8a5b-0d7fa429fabe tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:27.384250 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a0070919-4c2e-4656-8a5b-0d7fa429fabe tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:27.385168 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a0070919-4c2e-4656-8a5b-0d7fa429fabe tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:27.385776 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a0070919-4c2e-4656-8a5b-0d7fa429fabe tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:27.386419 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a0070919-4c2e-4656-8a5b-0d7fa429fabe tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:27.508545 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-a0070919-4c2e-4656-8a5b-0d7fa429fabe tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aca59cd50bf74a36bb1e4427cd50fbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3fadcd7d4043daa0a6aba27ba814d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:27.521117 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-a0070919-4c2e-4656-8a5b-0d7fa429fabe tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] 10.222.0.33 "GET /compute/v2.1/servers/9df70a8d-757f-4b92-ab73-6ad6cfc98953" status: 200 len: 1260 microversion: 2.1 time: 0.151081 Oct 04 20:48:27.521704 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1712/3333] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:48:27 2022] GET /compute/v2.1/servers/9df70a8d-757f-4b92-ab73-6ad6cfc98953 => generated 1260 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:48:27.536115 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-30c9e937-85d4-4970-919a-761964d9757f tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:48:27.539711 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-30c9e937-85d4-4970-919a-761964d9757f tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: ac3f41f1-ed37-4009-81e5-7bee0ee6ea69] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:27.556661 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-30c9e937-85d4-4970-919a-761964d9757f tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:27.557863 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-30c9e937-85d4-4970-919a-761964d9757f tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:27.559686 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-30c9e937-85d4-4970-919a-761964d9757f tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:27.561253 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-30c9e937-85d4-4970-919a-761964d9757f tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:27.564052 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-30c9e937-85d4-4970-919a-761964d9757f tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:27.564709 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-30c9e937-85d4-4970-919a-761964d9757f tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:27.610163 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ab9a59e3-e205-450a-9ddd-0ebcf217f1d5 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/6ee9aed4-6b8c-468f-bb28-937f3bc1eba7" status: 202 len: 0 microversion: 2.1 time: 0.689241 Oct 04 20:48:27.614912 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1622/3334] 10.222.0.33 () {58 vars in 1272 bytes} [Tue Oct 4 20:48:26 2022] DELETE /compute/v2.1/os-security-groups/6ee9aed4-6b8c-468f-bb28-937f3bc1eba7 => generated 0 bytes in 694 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:48:27.619776 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b8ad7ae2-4b3e-49e7-9df8-b31f3b449c51 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:27.620376 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b8ad7ae2-4b3e-49e7-9df8-b31f3b449c51 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] [instance: b65c8ce2-8537-4f84-ba63-5b913f6adc81] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:27.636642 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b8ad7ae2-4b3e-49e7-9df8-b31f3b449c51 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:27.637151 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b8ad7ae2-4b3e-49e7-9df8-b31f3b449c51 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:27.637595 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b8ad7ae2-4b3e-49e7-9df8-b31f3b449c51 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:27.638307 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b8ad7ae2-4b3e-49e7-9df8-b31f3b449c51 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:27.638797 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b8ad7ae2-4b3e-49e7-9df8-b31f3b449c51 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:27.639251 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b8ad7ae2-4b3e-49e7-9df8-b31f3b449c51 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:27.681409 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-b8ad7ae2-4b3e-49e7-9df8-b31f3b449c51 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] HTTP exception thrown: Instance b65c8ce2-8537-4f84-ba63-5b913f6adc81 could not be found. Oct 04 20:48:27.688931 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-30c9e937-85d4-4970-919a-761964d9757f tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "POST /compute/v2.1/servers/ac3f41f1-ed37-4009-81e5-7bee0ee6ea69/action" status: 200 len: 14 microversion: 2.1 time: 0.162939 Oct 04 20:48:27.690462 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1713/3335] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 20:48:27 2022] POST /compute/v2.1/servers/ac3f41f1-ed37-4009-81e5-7bee0ee6ea69/action => generated 14 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 20:48:27.695345 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b8ad7ae2-4b3e-49e7-9df8-b31f3b449c51 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Request method failure captured: Oct 04 20:48:27.695345 n-d-854823-8 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/b65c8ce2-8537-4f84-ba63-5b913f6adc81 HTTP/1.1 Oct 04 20:48:27.695345 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:48:27.695345 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:48:27.695345 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:48:27.695345 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 0 Oct 04 20:48:27.695345 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:48:27.695345 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:48:27.695345 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:48:27.695345 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:48:27.695345 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJsSwF2ySar2LJQGdSe43g0QAYtjP4_BPyLRwM7Cr4_8Oz_X-RTScy1BL0ogt-qe3YNvQGTaYbVbGoUGx7pHqiHpbZftU7_TcvDA_zpgTfxGGH91CR74RG6crXL2bxRs87dSvsLYuOWMw7_AQjTpWetc1HBlb5th2rD-ko2SN3gLGSA Oct 04 20:48:27.695345 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:48:27.695345 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:48:27.695345 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:48:27.695345 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:48:27.695345 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:48:27.695345 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:48:27.695345 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: 7097bc12179446f6a3e1fac8434d5c64 Oct 04 20:48:27.695345 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-ServersTestJSON-927611194 Oct 04 20:48:27.695345 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 20:48:27.695345 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 20:48:27.695345 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_7097bc12179446f6a3e1fac8434d5c64", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7097bc12179446f6a3e1fac8434d5c64"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7097bc12179446f6a3e1fac8434d5c64"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/7097bc12179446f6a3e1fac8434d5c64"}]}] Oct 04 20:48:27.695345 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-ServersTestJSON-927611194 Oct 04 20:48:27.695345 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: 7097bc12179446f6a3e1fac8434d5c64 Oct 04 20:48:27.695345 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ServersTestJSON-927611194 Oct 04 20:48:27.695345 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-ServersTestJSON-927611194-project Oct 04 20:48:27.695345 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:48:27.695345 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:48:27.695345 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: 87dcc7baf63f4ae6bfe0a099adffd408 Oct 04 20:48:27.695345 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-ServersTestJSON-927611194-project Oct 04 20:48:27.695345 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 20:48:27.695345 n-d-854823-8 devstack@n-api.service[128801]: exception: Instance b65c8ce2-8537-4f84-ba63-5b913f6adc81 could not be found. Oct 04 20:48:27.695345 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': 'b65c8ce2-8537-4f84-ba63-5b913f6adc81'} Oct 04 20:48:27.695345 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:48:27.695345 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:48:27.695345 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:48:27.695345 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:48:27.695345 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:48:27.695345 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:48:27.695345 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:48:27.695345 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:48:27.695345 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:48:27.695345 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:48:27.695345 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b65c8ce2-8537-4f84-ba63-5b913f6adc81 could not be found. Oct 04 20:48:27.695345 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:48:27.695345 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:48:27.695345 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:48:27.695345 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:48:27.695345 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:48:27.695345 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:48:27.695345 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:48:27.695345 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:48:27.695345 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:48:27.695345 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:48:27.695345 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:48:27.695345 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:48:27.695345 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:48:27.695345 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:48:27.695345 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:48:27.695345 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:48:27.695345 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b65c8ce2-8537-4f84-ba63-5b913f6adc81 could not be found. Oct 04 20:48:27.695345 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:48:27.695345 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:48:27.695345 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:48:27.695345 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:48:27.701123 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:48:27.701123 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:48:27.701123 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:48:27.701123 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:48:27.701123 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b65c8ce2-8537-4f84-ba63-5b913f6adc81 could not be found. Oct 04 20:48:27.701123 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:48:27.701123 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b8ad7ae2-4b3e-49e7-9df8-b31f3b449c51 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Returning 404 to user: Instance b65c8ce2-8537-4f84-ba63-5b913f6adc81 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:48:27.701123 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b8ad7ae2-4b3e-49e7-9df8-b31f3b449c51 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] 10.222.0.33 "GET /compute/v2.1/servers/b65c8ce2-8537-4f84-ba63-5b913f6adc81" status: 404 len: 111 microversion: 2.1 time: 0.081063 Oct 04 20:48:27.707128 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-49679d90-e722-49dd-bdb0-3d42df49164f tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:27.708286 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-49679d90-e722-49dd-bdb0-3d42df49164f tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] [instance: f9938964-5f2f-4093-b5cb-967adbe97623] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:27.717615 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1623/3336] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:48:27 2022] GET /compute/v2.1/servers/b65c8ce2-8537-4f84-ba63-5b913f6adc81 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:48:27.729835 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0e3709cd-719c-4ec8-b417-a600d25e8864 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Calling method '.version_select at 0x7f3c7425bdc0>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:27.742590 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-49679d90-e722-49dd-bdb0-3d42df49164f tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:27.743568 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-49679d90-e722-49dd-bdb0-3d42df49164f tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:27.748740 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-49679d90-e722-49dd-bdb0-3d42df49164f tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:27.750419 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-49679d90-e722-49dd-bdb0-3d42df49164f tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:27.751995 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-49679d90-e722-49dd-bdb0-3d42df49164f tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:27.753444 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-49679d90-e722-49dd-bdb0-3d42df49164f tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:27.767541 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:48:27.806564 n-d-854823-8 devstack@n-api.service[128801]: DEBUG neutronclient.v2_0.client [None req-0e3709cd-719c-4ec8-b417-a600d25e8864 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 6ee9aed4-6b8c-468f-bb28-937f3bc1eba7 does not exist", "detail": ""}} {{(pid=128801) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 20:48:27.807181 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.network.security_group_api [None req-0e3709cd-719c-4ec8-b417-a600d25e8864 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Neutron security group 6ee9aed4-6b8c-468f-bb28-937f3bc1eba7 not found {{(pid=128801) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 04 20:48:27.807675 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-0e3709cd-719c-4ec8-b417-a600d25e8864 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] HTTP exception thrown: Security group 6ee9aed4-6b8c-468f-bb28-937f3bc1eba7 does not exist Oct 04 20:48:27.807675 n-d-854823-8 devstack@n-api.service[128801]: Neutron server returns request_ids: ['req-707d2a97-cf20-4c8f-af94-9d7d325327d2'] Oct 04 20:48:27.809505 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0e3709cd-719c-4ec8-b417-a600d25e8864 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Request method failure captured: Oct 04 20:48:27.809505 n-d-854823-8 devstack@n-api.service[128801]: request: GET /compute/v2.1/os-security-groups/6ee9aed4-6b8c-468f-bb28-937f3bc1eba7 HTTP/1.1 Oct 04 20:48:27.809505 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:48:27.809505 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:48:27.809505 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:48:27.809505 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 0 Oct 04 20:48:27.809505 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:48:27.809505 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:48:27.809505 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:48:27.809505 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:48:27.809505 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJvplJ2XtdAcke_gJrXE_KNLNy4K9GZxu4xJ3RC3ictvWfS6RkKIgxre3Ypn4Hea1fYOIvZNCiP-yxvq5D6SolLdjoz27YjvMYrrTV2S3thhTnsVyXyRm0AMTe4s528xDCu1J43IqMSUlnCB8IA8Xi7RGhGDp6gPtwX5ldwf-HyrWJg Oct 04 20:48:27.809505 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:48:27.809505 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:48:27.809505 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:48:27.809505 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:48:27.809505 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:48:27.809505 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:48:27.809505 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: 5338cf2146344042bc263bdc4f9d822b Oct 04 20:48:27.809505 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-SecurityGroupsTestJSON-969894548 Oct 04 20:48:27.809505 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 20:48:27.809505 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 20:48:27.809505 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5338cf2146344042bc263bdc4f9d822b", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5338cf2146344042bc263bdc4f9d822b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5338cf2146344042bc263bdc4f9d822b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5338cf2146344042bc263bdc4f9d822b"}]}] Oct 04 20:48:27.809505 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-SecurityGroupsTestJSON-969894548 Oct 04 20:48:27.809505 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: 5338cf2146344042bc263bdc4f9d822b Oct 04 20:48:27.809505 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-969894548 Oct 04 20:48:27.809505 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-SecurityGroupsTestJSON-969894548-project Oct 04 20:48:27.809505 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:48:27.809505 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:48:27.809505 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: 6775b9d82b3444f6b728736f1d2b2806 Oct 04 20:48:27.809505 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-SecurityGroupsTestJSON-969894548-project Oct 04 20:48:27.809505 n-d-854823-8 devstack@n-api.service[128801]: method: Oct 04 20:48:27.809505 n-d-854823-8 devstack@n-api.service[128801]: exception: Security group 6ee9aed4-6b8c-468f-bb28-937f3bc1eba7 does not exist Oct 04 20:48:27.809505 n-d-854823-8 devstack@n-api.service[128801]: Neutron server returns request_ids: ['req-707d2a97-cf20-4c8f-af94-9d7d325327d2'] Oct 04 20:48:27.809505 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': '6ee9aed4-6b8c-468f-bb28-937f3bc1eba7'} Oct 04 20:48:27.809505 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:48:27.809505 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:48:27.809505 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 04 20:48:27.809505 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 04 20:48:27.809505 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:48:27.809505 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:48:27.809505 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 04 20:48:27.809505 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 04 20:48:27.809505 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:48:27.809505 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:48:27.809505 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 20:48:27.809505 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 20:48:27.809505 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:48:27.809505 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:48:27.809505 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:48:27.809505 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:48:27.809505 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:48:27.809505 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:48:27.809505 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 20:48:27.809505 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 20:48:27.809505 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:48:27.809505 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:48:27.809505 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 20:48:27.809505 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 20:48:27.809505 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 20:48:27.809505 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 20:48:27.809505 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 6ee9aed4-6b8c-468f-bb28-937f3bc1eba7 does not exist Oct 04 20:48:27.814448 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-707d2a97-cf20-4c8f-af94-9d7d325327d2'] Oct 04 20:48:27.814448 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:48:27.814448 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:48:27.814448 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:48:27.814448 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:48:27.814448 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 04 20:48:27.814448 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 04 20:48:27.814448 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 04 20:48:27.814448 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 04 20:48:27.814448 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 6ee9aed4-6b8c-468f-bb28-937f3bc1eba7 does not exist Oct 04 20:48:27.814448 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-707d2a97-cf20-4c8f-af94-9d7d325327d2'] Oct 04 20:48:27.814448 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:48:27.814448 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:48:27.814448 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:48:27.814448 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:48:27.814448 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:48:27.814448 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:48:27.814448 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:48:27.814448 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:48:27.814448 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:48:27.814448 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:48:27.814448 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:48:27.814448 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:48:27.814448 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 04 20:48:27.814448 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 04 20:48:27.814448 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 6ee9aed4-6b8c-468f-bb28-937f3bc1eba7 does not exist Oct 04 20:48:27.814448 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-707d2a97-cf20-4c8f-af94-9d7d325327d2'] Oct 04 20:48:27.814448 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:48:27.814448 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:48:27.814448 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:48:27.814448 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:48:27.814448 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:48:27.814448 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:48:27.814448 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:48:27.814448 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:48:27.814448 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 6ee9aed4-6b8c-468f-bb28-937f3bc1eba7 does not exist Oct 04 20:48:27.814448 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-707d2a97-cf20-4c8f-af94-9d7d325327d2'] Oct 04 20:48:27.814448 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:48:27.818995 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0e3709cd-719c-4ec8-b417-a600d25e8864 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Returning 404 to user: Security group 6ee9aed4-6b8c-468f-bb28-937f3bc1eba7 does not exist Oct 04 20:48:27.818995 n-d-854823-8 devstack@n-api.service[128801]: Neutron server returns request_ids: ['req-707d2a97-cf20-4c8f-af94-9d7d325327d2'] {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:48:27.820199 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-0e3709cd-719c-4ec8-b417-a600d25e8864 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] 10.222.0.33 "GET /compute/v2.1/os-security-groups/6ee9aed4-6b8c-468f-bb28-937f3bc1eba7" status: 404 len: 194 microversion: 2.1 time: 0.101524 Oct 04 20:48:27.824594 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1624/3337] 10.222.0.33 () {58 vars in 1269 bytes} [Tue Oct 4 20:48:27 2022] GET /compute/v2.1/os-security-groups/6ee9aed4-6b8c-468f-bb28-937f3bc1eba7 => generated 194 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:48:27.831402 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-83bbc943-c977-47e6-946c-827c25d26f41 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:27.832267 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-83bbc943-c977-47e6-946c-827c25d26f41 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] [instance: bdfb94ca-ded6-4af0-bd9f-59fc877c4c0a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:27.860720 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-83bbc943-c977-47e6-946c-827c25d26f41 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:27.861220 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-83bbc943-c977-47e6-946c-827c25d26f41 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:27.861667 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-83bbc943-c977-47e6-946c-827c25d26f41 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:27.867108 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-83bbc943-c977-47e6-946c-827c25d26f41 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:27.867582 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-83bbc943-c977-47e6-946c-827c25d26f41 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:27.868024 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-83bbc943-c977-47e6-946c-827c25d26f41 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:27.898929 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-83bbc943-c977-47e6-946c-827c25d26f41 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] HTTP exception thrown: Instance bdfb94ca-ded6-4af0-bd9f-59fc877c4c0a could not be found. Oct 04 20:48:27.900663 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-83bbc943-c977-47e6-946c-827c25d26f41 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Request method failure captured: Oct 04 20:48:27.900663 n-d-854823-8 devstack@n-api.service[128801]: request: DELETE /compute/v2.1/servers/bdfb94ca-ded6-4af0-bd9f-59fc877c4c0a HTTP/1.1 Oct 04 20:48:27.900663 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:48:27.900663 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:48:27.900663 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:48:27.900663 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 0 Oct 04 20:48:27.900663 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:48:27.900663 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:48:27.900663 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:48:27.900663 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:48:27.900663 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJsSwF2ySar2LJQGdSe43g0QAYtjP4_BPyLRwM7Cr4_8Oz_X-RTScy1BL0ogt-qe3YNvQGTaYbVbGoUGx7pHqiHpbZftU7_TcvDA_zpgTfxGGH91CR74RG6crXL2bxRs87dSvsLYuOWMw7_AQjTpWetc1HBlb5th2rD-ko2SN3gLGSA Oct 04 20:48:27.900663 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:48:27.900663 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:48:27.900663 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:48:27.900663 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:48:27.900663 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:48:27.900663 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:48:27.900663 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: 7097bc12179446f6a3e1fac8434d5c64 Oct 04 20:48:27.900663 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-ServersTestJSON-927611194 Oct 04 20:48:27.900663 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 20:48:27.900663 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 20:48:27.900663 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_7097bc12179446f6a3e1fac8434d5c64", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7097bc12179446f6a3e1fac8434d5c64"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7097bc12179446f6a3e1fac8434d5c64"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/7097bc12179446f6a3e1fac8434d5c64"}]}] Oct 04 20:48:27.900663 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-ServersTestJSON-927611194 Oct 04 20:48:27.900663 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: 7097bc12179446f6a3e1fac8434d5c64 Oct 04 20:48:27.900663 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ServersTestJSON-927611194 Oct 04 20:48:27.900663 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-ServersTestJSON-927611194-project Oct 04 20:48:27.900663 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:48:27.900663 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:48:27.900663 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: 87dcc7baf63f4ae6bfe0a099adffd408 Oct 04 20:48:27.900663 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-ServersTestJSON-927611194-project Oct 04 20:48:27.900663 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 20:48:27.900663 n-d-854823-8 devstack@n-api.service[128801]: exception: Instance bdfb94ca-ded6-4af0-bd9f-59fc877c4c0a could not be found. Oct 04 20:48:27.900663 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': 'bdfb94ca-ded6-4af0-bd9f-59fc877c4c0a'} Oct 04 20:48:27.900663 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:48:27.900663 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:48:27.900663 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:48:27.900663 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:48:27.900663 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:48:27.900663 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:48:27.900663 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:48:27.900663 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:48:27.900663 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:48:27.900663 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:48:27.900663 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bdfb94ca-ded6-4af0-bd9f-59fc877c4c0a could not be found. Oct 04 20:48:27.900663 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:48:27.900663 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:48:27.900663 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:48:27.900663 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:48:27.900663 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:48:27.900663 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:48:27.900663 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:48:27.900663 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:48:27.900663 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:48:27.900663 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:48:27.900663 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 20:48:27.900663 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 20:48:27.900663 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 20:48:27.900663 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 20:48:27.900663 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:48:27.900663 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:48:27.900663 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:48:27.900663 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:48:27.900663 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bdfb94ca-ded6-4af0-bd9f-59fc877c4c0a could not be found. Oct 04 20:48:27.905154 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:48:27.905154 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:48:27.905154 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:48:27.905154 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:48:27.905154 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:48:27.905154 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:48:27.905154 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:48:27.905154 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:48:27.905154 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bdfb94ca-ded6-4af0-bd9f-59fc877c4c0a could not be found. Oct 04 20:48:27.905154 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:48:27.906857 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-83bbc943-c977-47e6-946c-827c25d26f41 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Returning 404 to user: Instance bdfb94ca-ded6-4af0-bd9f-59fc877c4c0a could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:48:27.908418 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-83bbc943-c977-47e6-946c-827c25d26f41 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] 10.222.0.33 "DELETE /compute/v2.1/servers/bdfb94ca-ded6-4af0-bd9f-59fc877c4c0a" status: 404 len: 111 microversion: 2.1 time: 0.082610 Oct 04 20:48:27.909479 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1625/3338] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 20:48:27 2022] DELETE /compute/v2.1/servers/bdfb94ca-ded6-4af0-bd9f-59fc877c4c0a => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:48:27.922715 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b8288ca6-e8f7-4440-a45b-e9fc1be7bf75 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Calling method '.version_select at 0x7f3c7425b700>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:27.923588 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-49679d90-e722-49dd-bdb0-3d42df49164f tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e4b00964014a0383f79597652bd428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7f38600b5041ad8e66a12d77b940fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:27.936702 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-49679d90-e722-49dd-bdb0-3d42df49164f tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] 10.222.0.33 "GET /compute/v2.1/servers/f9938964-5f2f-4093-b5cb-967adbe97623" status: 200 len: 1300 microversion: 2.1 time: 0.243484 Oct 04 20:48:27.937558 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1714/3339] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:48:27 2022] GET /compute/v2.1/servers/f9938964-5f2f-4093-b5cb-967adbe97623 => generated 1300 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:48:27.977295 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-ec4e85a3-8187-44fb-8bcc-38877310dd97 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:27.978634 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-ec4e85a3-8187-44fb-8bcc-38877310dd97 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] [instance: bdfb94ca-ded6-4af0-bd9f-59fc877c4c0a] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:28.012072 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ec4e85a3-8187-44fb-8bcc-38877310dd97 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:28.017690 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ec4e85a3-8187-44fb-8bcc-38877310dd97 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:28.020861 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ec4e85a3-8187-44fb-8bcc-38877310dd97 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:28.023325 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ec4e85a3-8187-44fb-8bcc-38877310dd97 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:28.023815 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ec4e85a3-8187-44fb-8bcc-38877310dd97 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:28.024251 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ec4e85a3-8187-44fb-8bcc-38877310dd97 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:28.072180 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.wsgi [None req-ec4e85a3-8187-44fb-8bcc-38877310dd97 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] HTTP exception thrown: Instance bdfb94ca-ded6-4af0-bd9f-59fc877c4c0a could not be found. Oct 04 20:48:28.078695 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-ec4e85a3-8187-44fb-8bcc-38877310dd97 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Request method failure captured: Oct 04 20:48:28.078695 n-d-854823-8 devstack@n-api.service[128802]: request: GET /compute/v2.1/servers/bdfb94ca-ded6-4af0-bd9f-59fc877c4c0a HTTP/1.1 Oct 04 20:48:28.078695 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 20:48:28.078695 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 20:48:28.078695 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 20:48:28.078695 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 0 Oct 04 20:48:28.078695 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 20:48:28.078695 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 20:48:28.078695 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 20:48:28.078695 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 20:48:28.078695 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPJsSwF2ySar2LJQGdSe43g0QAYtjP4_BPyLRwM7Cr4_8Oz_X-RTScy1BL0ogt-qe3YNvQGTaYbVbGoUGx7pHqiHpbZftU7_TcvDA_zpgTfxGGH91CR74RG6crXL2bxRs87dSvsLYuOWMw7_AQjTpWetc1HBlb5th2rD-ko2SN3gLGSA Oct 04 20:48:28.078695 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 20:48:28.078695 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 20:48:28.078695 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 20:48:28.078695 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 20:48:28.078695 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 20:48:28.078695 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 20:48:28.078695 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: 7097bc12179446f6a3e1fac8434d5c64 Oct 04 20:48:28.078695 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-ServersTestJSON-927611194 Oct 04 20:48:28.078695 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 20:48:28.078695 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 20:48:28.078695 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_7097bc12179446f6a3e1fac8434d5c64", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7097bc12179446f6a3e1fac8434d5c64"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7097bc12179446f6a3e1fac8434d5c64"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/7097bc12179446f6a3e1fac8434d5c64"}]}] Oct 04 20:48:28.078695 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-ServersTestJSON-927611194 Oct 04 20:48:28.078695 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: 7097bc12179446f6a3e1fac8434d5c64 Oct 04 20:48:28.078695 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-ServersTestJSON-927611194 Oct 04 20:48:28.078695 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-ServersTestJSON-927611194-project Oct 04 20:48:28.078695 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 20:48:28.078695 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 20:48:28.078695 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: 87dcc7baf63f4ae6bfe0a099adffd408 Oct 04 20:48:28.078695 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-ServersTestJSON-927611194-project Oct 04 20:48:28.078695 n-d-854823-8 devstack@n-api.service[128802]: method: > Oct 04 20:48:28.078695 n-d-854823-8 devstack@n-api.service[128802]: exception: Instance bdfb94ca-ded6-4af0-bd9f-59fc877c4c0a could not be found. Oct 04 20:48:28.078695 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'id': 'bdfb94ca-ded6-4af0-bd9f-59fc877c4c0a'} Oct 04 20:48:28.078695 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:48:28.078695 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:48:28.078695 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:48:28.078695 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:48:28.078695 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:48:28.078695 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:48:28.078695 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:48:28.078695 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:48:28.078695 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:48:28.078695 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:48:28.078695 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bdfb94ca-ded6-4af0-bd9f-59fc877c4c0a could not be found. Oct 04 20:48:28.078695 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:48:28.078695 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:48:28.078695 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:48:28.078695 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:48:28.078695 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:48:28.078695 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:48:28.078695 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:48:28.078695 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:48:28.078695 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:48:28.078695 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:48:28.078695 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:48:28.078695 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:48:28.078695 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:48:28.078695 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:48:28.078695 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:48:28.078695 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:48:28.078695 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bdfb94ca-ded6-4af0-bd9f-59fc877c4c0a could not be found. Oct 04 20:48:28.078695 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:48:28.078695 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:48:28.078695 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:48:28.078695 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:48:28.085215 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:48:28.085215 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:48:28.085215 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:48:28.085215 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:48:28.085215 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bdfb94ca-ded6-4af0-bd9f-59fc877c4c0a could not be found. Oct 04 20:48:28.085215 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:48:28.090697 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-ec4e85a3-8187-44fb-8bcc-38877310dd97 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Returning 404 to user: Instance bdfb94ca-ded6-4af0-bd9f-59fc877c4c0a could not be found. {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:48:28.093499 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-ec4e85a3-8187-44fb-8bcc-38877310dd97 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] 10.222.0.33 "GET /compute/v2.1/servers/bdfb94ca-ded6-4af0-bd9f-59fc877c4c0a" status: 404 len: 111 microversion: 2.1 time: 0.126712 Oct 04 20:48:28.095777 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1715/3340] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:48:27 2022] GET /compute/v2.1/servers/bdfb94ca-ded6-4af0-bd9f-59fc877c4c0a => generated 111 bytes in 157 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:48:28.113639 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-3ae563f8-c1c7-41d9-adb3-dfecce9399d9 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:28.114573 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-3ae563f8-c1c7-41d9-adb3-dfecce9399d9 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] [instance: c0a14e22-0620-4912-9893-62974c80978a] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:28.135116 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3ae563f8-c1c7-41d9-adb3-dfecce9399d9 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:28.136022 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3ae563f8-c1c7-41d9-adb3-dfecce9399d9 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:28.138545 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3ae563f8-c1c7-41d9-adb3-dfecce9399d9 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:28.139791 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3ae563f8-c1c7-41d9-adb3-dfecce9399d9 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:28.141988 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3ae563f8-c1c7-41d9-adb3-dfecce9399d9 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:28.145619 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3ae563f8-c1c7-41d9-adb3-dfecce9399d9 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:28.231018 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3ae563f8-c1c7-41d9-adb3-dfecce9399d9 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:28.232296 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3ae563f8-c1c7-41d9-adb3-dfecce9399d9 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:28.232885 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3ae563f8-c1c7-41d9-adb3-dfecce9399d9 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:28.234058 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.objects.instance [None req-3ae563f8-c1c7-41d9-adb3-dfecce9399d9 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lazy-loading 'fault' on Instance uuid c0a14e22-0620-4912-9893-62974c80978a {{(pid=128802) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:48:28.388565 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-3ae563f8-c1c7-41d9-adb3-dfecce9399d9 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28399882314945d787a3af6eb59935c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5392c67506f7445ab33d62b191558f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:28.405299 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-3ae563f8-c1c7-41d9-adb3-dfecce9399d9 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '28399882314945d787a3af6eb59935c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5392c67506f7445ab33d62b191558f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:28.410800 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-3ae563f8-c1c7-41d9-adb3-dfecce9399d9 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '28399882314945d787a3af6eb59935c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5392c67506f7445ab33d62b191558f7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:28.413944 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-3ae563f8-c1c7-41d9-adb3-dfecce9399d9 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] 10.222.0.33 "GET /compute/v2.1/servers/c0a14e22-0620-4912-9893-62974c80978a" status: 200 len: 1609 microversion: 2.32 time: 0.313179 Oct 04 20:48:28.416671 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1716/3341] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:48:28 2022] GET /compute/v2.1/servers/c0a14e22-0620-4912-9893-62974c80978a => generated 1609 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:48:28.437433 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-5cdfa2c1-e9c9-48a3-ad84-ac5f7de00a77 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:28.439744 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-5cdfa2c1-e9c9-48a3-ad84-ac5f7de00a77 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] [instance: c43e082f-7e3b-49bd-b206-4f3f231750da] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:28.463191 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5cdfa2c1-e9c9-48a3-ad84-ac5f7de00a77 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:28.466774 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5cdfa2c1-e9c9-48a3-ad84-ac5f7de00a77 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:28.468025 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5cdfa2c1-e9c9-48a3-ad84-ac5f7de00a77 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:28.469494 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5cdfa2c1-e9c9-48a3-ad84-ac5f7de00a77 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:28.470238 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5cdfa2c1-e9c9-48a3-ad84-ac5f7de00a77 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:28.472697 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5cdfa2c1-e9c9-48a3-ad84-ac5f7de00a77 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:28.508155 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.wsgi [None req-5cdfa2c1-e9c9-48a3-ad84-ac5f7de00a77 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] HTTP exception thrown: Instance c43e082f-7e3b-49bd-b206-4f3f231750da could not be found. Oct 04 20:48:28.509752 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-5cdfa2c1-e9c9-48a3-ad84-ac5f7de00a77 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Request method failure captured: Oct 04 20:48:28.509752 n-d-854823-8 devstack@n-api.service[128802]: request: DELETE /compute/v2.1/servers/c43e082f-7e3b-49bd-b206-4f3f231750da HTTP/1.1 Oct 04 20:48:28.509752 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 20:48:28.509752 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 20:48:28.509752 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 20:48:28.509752 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 0 Oct 04 20:48:28.509752 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 20:48:28.509752 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 20:48:28.509752 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 20:48:28.509752 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 20:48:28.509752 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPJsSwF2ySar2LJQGdSe43g0QAYtjP4_BPyLRwM7Cr4_8Oz_X-RTScy1BL0ogt-qe3YNvQGTaYbVbGoUGx7pHqiHpbZftU7_TcvDA_zpgTfxGGH91CR74RG6crXL2bxRs87dSvsLYuOWMw7_AQjTpWetc1HBlb5th2rD-ko2SN3gLGSA Oct 04 20:48:28.509752 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 20:48:28.509752 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 20:48:28.509752 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 20:48:28.509752 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 20:48:28.509752 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 20:48:28.509752 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 20:48:28.509752 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: 7097bc12179446f6a3e1fac8434d5c64 Oct 04 20:48:28.509752 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-ServersTestJSON-927611194 Oct 04 20:48:28.509752 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 20:48:28.509752 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 20:48:28.509752 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_7097bc12179446f6a3e1fac8434d5c64", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7097bc12179446f6a3e1fac8434d5c64"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7097bc12179446f6a3e1fac8434d5c64"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/7097bc12179446f6a3e1fac8434d5c64"}]}] Oct 04 20:48:28.509752 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-ServersTestJSON-927611194 Oct 04 20:48:28.509752 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: 7097bc12179446f6a3e1fac8434d5c64 Oct 04 20:48:28.509752 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-ServersTestJSON-927611194 Oct 04 20:48:28.509752 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-ServersTestJSON-927611194-project Oct 04 20:48:28.509752 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 20:48:28.509752 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 20:48:28.509752 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: 87dcc7baf63f4ae6bfe0a099adffd408 Oct 04 20:48:28.509752 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-ServersTestJSON-927611194-project Oct 04 20:48:28.509752 n-d-854823-8 devstack@n-api.service[128802]: method: > Oct 04 20:48:28.509752 n-d-854823-8 devstack@n-api.service[128802]: exception: Instance c43e082f-7e3b-49bd-b206-4f3f231750da could not be found. Oct 04 20:48:28.509752 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'id': 'c43e082f-7e3b-49bd-b206-4f3f231750da'} Oct 04 20:48:28.509752 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:48:28.509752 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:48:28.509752 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:48:28.509752 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:48:28.509752 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:48:28.509752 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:48:28.509752 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:48:28.509752 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:48:28.509752 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:48:28.509752 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:48:28.509752 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c43e082f-7e3b-49bd-b206-4f3f231750da could not be found. Oct 04 20:48:28.509752 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:48:28.509752 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:48:28.509752 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:48:28.509752 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:48:28.509752 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:48:28.509752 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:48:28.509752 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:48:28.509752 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:48:28.509752 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:48:28.509752 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:48:28.509752 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 20:48:28.509752 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 20:48:28.509752 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 20:48:28.509752 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 20:48:28.509752 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:48:28.509752 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:48:28.509752 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:48:28.509752 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:48:28.509752 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c43e082f-7e3b-49bd-b206-4f3f231750da could not be found. Oct 04 20:48:28.514265 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:48:28.514265 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:48:28.514265 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:48:28.514265 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:48:28.514265 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:48:28.514265 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:48:28.514265 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:48:28.514265 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:48:28.514265 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c43e082f-7e3b-49bd-b206-4f3f231750da could not be found. Oct 04 20:48:28.514265 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:48:28.514265 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-5cdfa2c1-e9c9-48a3-ad84-ac5f7de00a77 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Returning 404 to user: Instance c43e082f-7e3b-49bd-b206-4f3f231750da could not be found. {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:48:28.515009 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-5cdfa2c1-e9c9-48a3-ad84-ac5f7de00a77 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] 10.222.0.33 "DELETE /compute/v2.1/servers/c43e082f-7e3b-49bd-b206-4f3f231750da" status: 404 len: 111 microversion: 2.1 time: 0.095963 Oct 04 20:48:28.519426 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1717/3342] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 20:48:28 2022] DELETE /compute/v2.1/servers/c43e082f-7e3b-49bd-b206-4f3f231750da => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:48:28.532213 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-f5ceae89-f4dd-419e-99ac-7e07f671794e tempest-ServerAddressesNegativeTestJSON-1549542698 tempest-ServerAddressesNegativeTestJSON-1549542698-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:28.532327 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-f5ceae89-f4dd-419e-99ac-7e07f671794e tempest-ServerAddressesNegativeTestJSON-1549542698 tempest-ServerAddressesNegativeTestJSON-1549542698-project] [instance: 7f1a706c-5002-4d52-83ba-f25ce7771d02] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:28.542128 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f5ceae89-f4dd-419e-99ac-7e07f671794e tempest-ServerAddressesNegativeTestJSON-1549542698 tempest-ServerAddressesNegativeTestJSON-1549542698-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:28.560649 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f5ceae89-f4dd-419e-99ac-7e07f671794e tempest-ServerAddressesNegativeTestJSON-1549542698 tempest-ServerAddressesNegativeTestJSON-1549542698-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:28.561191 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f5ceae89-f4dd-419e-99ac-7e07f671794e tempest-ServerAddressesNegativeTestJSON-1549542698 tempest-ServerAddressesNegativeTestJSON-1549542698-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:28.561953 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f5ceae89-f4dd-419e-99ac-7e07f671794e tempest-ServerAddressesNegativeTestJSON-1549542698 tempest-ServerAddressesNegativeTestJSON-1549542698-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:28.562460 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f5ceae89-f4dd-419e-99ac-7e07f671794e tempest-ServerAddressesNegativeTestJSON-1549542698 tempest-ServerAddressesNegativeTestJSON-1549542698-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:28.562893 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f5ceae89-f4dd-419e-99ac-7e07f671794e tempest-ServerAddressesNegativeTestJSON-1549542698 tempest-ServerAddressesNegativeTestJSON-1549542698-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:28.787882 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b8288ca6-e8f7-4440-a45b-e9fc1be7bf75 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/f9dc6aa8-2820-4bfa-8cb5-43eb063d7c92" status: 202 len: 0 microversion: 2.1 time: 0.877154 Oct 04 20:48:28.791479 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1626/3343] 10.222.0.33 () {58 vars in 1272 bytes} [Tue Oct 4 20:48:27 2022] DELETE /compute/v2.1/os-security-groups/f9dc6aa8-2820-4bfa-8cb5-43eb063d7c92 => generated 0 bytes in 878 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:48:28.794272 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-b1447470-a5b3-423b-a303-c293ae7c8455 req-440da87c-927f-4247-9b48-ac793f83e280 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f1a706c-5002-4d52-83ba-f25ce7771d02", "name": "network-vif-plugged", "status": "completed", "tag": "d37e8f40-c472-45b2-b146-135f62bbc03c"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:48:28.819576 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-b1447470-a5b3-423b-a303-c293ae7c8455 req-440da87c-927f-4247-9b48-ac793f83e280 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:28.819798 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-b1447470-a5b3-423b-a303-c293ae7c8455 req-440da87c-927f-4247-9b48-ac793f83e280 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:28.820110 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-b1447470-a5b3-423b-a303-c293ae7c8455 req-440da87c-927f-4247-9b48-ac793f83e280 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:28.851849 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-b1447470-a5b3-423b-a303-c293ae7c8455 req-440da87c-927f-4247-9b48-ac793f83e280 service nova] Creating event network-vif-plugged:d37e8f40-c472-45b2-b146-135f62bbc03c for instance 7f1a706c-5002-4d52-83ba-f25ce7771d02 on n-h1-854823-8 Oct 04 20:48:28.871086 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-b1447470-a5b3-423b-a303-c293ae7c8455 req-440da87c-927f-4247-9b48-ac793f83e280 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080923 Oct 04 20:48:28.872077 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1627/3344] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:48:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:48:28.878475 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5105c30f-0c89-47ef-b300-47ccf0c498cc tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:28.884593 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-5105c30f-0c89-47ef-b300-47ccf0c498cc tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] [instance: c43e082f-7e3b-49bd-b206-4f3f231750da] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:28.891716 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5105c30f-0c89-47ef-b300-47ccf0c498cc tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:28.892469 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5105c30f-0c89-47ef-b300-47ccf0c498cc tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:28.896222 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5105c30f-0c89-47ef-b300-47ccf0c498cc tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:28.897277 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5105c30f-0c89-47ef-b300-47ccf0c498cc tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:28.897906 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5105c30f-0c89-47ef-b300-47ccf0c498cc tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:28.898532 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5105c30f-0c89-47ef-b300-47ccf0c498cc tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:28.933504 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-5105c30f-0c89-47ef-b300-47ccf0c498cc tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] HTTP exception thrown: Instance c43e082f-7e3b-49bd-b206-4f3f231750da could not be found. Oct 04 20:48:28.936308 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5105c30f-0c89-47ef-b300-47ccf0c498cc tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Request method failure captured: Oct 04 20:48:28.936308 n-d-854823-8 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/c43e082f-7e3b-49bd-b206-4f3f231750da HTTP/1.1 Oct 04 20:48:28.936308 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:48:28.936308 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:48:28.936308 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:48:28.936308 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 0 Oct 04 20:48:28.936308 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:48:28.936308 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:48:28.936308 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:48:28.936308 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:48:28.936308 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJsSwF2ySar2LJQGdSe43g0QAYtjP4_BPyLRwM7Cr4_8Oz_X-RTScy1BL0ogt-qe3YNvQGTaYbVbGoUGx7pHqiHpbZftU7_TcvDA_zpgTfxGGH91CR74RG6crXL2bxRs87dSvsLYuOWMw7_AQjTpWetc1HBlb5th2rD-ko2SN3gLGSA Oct 04 20:48:28.936308 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:48:28.936308 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:48:28.936308 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:48:28.936308 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:48:28.936308 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:48:28.936308 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:48:28.936308 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: 7097bc12179446f6a3e1fac8434d5c64 Oct 04 20:48:28.936308 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-ServersTestJSON-927611194 Oct 04 20:48:28.936308 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 20:48:28.936308 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 20:48:28.936308 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_7097bc12179446f6a3e1fac8434d5c64", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7097bc12179446f6a3e1fac8434d5c64"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7097bc12179446f6a3e1fac8434d5c64"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/7097bc12179446f6a3e1fac8434d5c64"}]}] Oct 04 20:48:28.936308 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-ServersTestJSON-927611194 Oct 04 20:48:28.936308 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: 7097bc12179446f6a3e1fac8434d5c64 Oct 04 20:48:28.936308 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ServersTestJSON-927611194 Oct 04 20:48:28.936308 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-ServersTestJSON-927611194-project Oct 04 20:48:28.936308 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:48:28.936308 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:48:28.936308 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: 87dcc7baf63f4ae6bfe0a099adffd408 Oct 04 20:48:28.936308 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-ServersTestJSON-927611194-project Oct 04 20:48:28.936308 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 20:48:28.936308 n-d-854823-8 devstack@n-api.service[128801]: exception: Instance c43e082f-7e3b-49bd-b206-4f3f231750da could not be found. Oct 04 20:48:28.936308 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': 'c43e082f-7e3b-49bd-b206-4f3f231750da'} Oct 04 20:48:28.936308 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:48:28.936308 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:48:28.936308 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:48:28.936308 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:48:28.936308 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:48:28.936308 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:48:28.936308 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:48:28.936308 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:48:28.936308 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:48:28.936308 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:48:28.936308 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c43e082f-7e3b-49bd-b206-4f3f231750da could not be found. Oct 04 20:48:28.936308 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:48:28.936308 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:48:28.936308 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:48:28.936308 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:48:28.936308 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:48:28.936308 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:48:28.936308 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:48:28.936308 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:48:28.936308 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:48:28.936308 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:48:28.936308 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:48:28.936308 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:48:28.936308 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:48:28.936308 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:48:28.936308 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:48:28.936308 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:48:28.936308 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c43e082f-7e3b-49bd-b206-4f3f231750da could not be found. Oct 04 20:48:28.936308 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:48:28.936308 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:48:28.936308 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:48:28.936308 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:48:28.941751 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:48:28.941751 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:48:28.941751 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:48:28.941751 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:48:28.941751 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c43e082f-7e3b-49bd-b206-4f3f231750da could not be found. Oct 04 20:48:28.941751 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:48:28.943304 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5105c30f-0c89-47ef-b300-47ccf0c498cc tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Returning 404 to user: Instance c43e082f-7e3b-49bd-b206-4f3f231750da could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:48:28.943883 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5105c30f-0c89-47ef-b300-47ccf0c498cc tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] 10.222.0.33 "GET /compute/v2.1/servers/c43e082f-7e3b-49bd-b206-4f3f231750da" status: 404 len: 111 microversion: 2.1 time: 0.070208 Oct 04 20:48:28.948644 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1628/3345] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:48:28 2022] GET /compute/v2.1/servers/c43e082f-7e3b-49bd-b206-4f3f231750da => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:48:28.954132 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-24c719ce-b788-45c0-9fe6-d233b2bfa2a7 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:28.955338 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-24c719ce-b788-45c0-9fe6-d233b2bfa2a7 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] [instance: 9df70a8d-757f-4b92-ab73-6ad6cfc98953] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:28.966211 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-24c719ce-b788-45c0-9fe6-d233b2bfa2a7 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:28.967095 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-24c719ce-b788-45c0-9fe6-d233b2bfa2a7 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:28.967715 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-24c719ce-b788-45c0-9fe6-d233b2bfa2a7 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:28.970326 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-24c719ce-b788-45c0-9fe6-d233b2bfa2a7 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:28.972399 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-24c719ce-b788-45c0-9fe6-d233b2bfa2a7 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:28.973825 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-24c719ce-b788-45c0-9fe6-d233b2bfa2a7 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:29.146629 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-24c719ce-b788-45c0-9fe6-d233b2bfa2a7 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aca59cd50bf74a36bb1e4427cd50fbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3fadcd7d4043daa0a6aba27ba814d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:29.157183 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-24c719ce-b788-45c0-9fe6-d233b2bfa2a7 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] 10.222.0.33 "GET /compute/v2.1/servers/9df70a8d-757f-4b92-ab73-6ad6cfc98953" status: 200 len: 1266 microversion: 2.1 time: 0.209639 Oct 04 20:48:29.158860 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1629/3346] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:48:28 2022] GET /compute/v2.1/servers/9df70a8d-757f-4b92-ab73-6ad6cfc98953 => generated 1266 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:48:29.165300 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f33ab509-fe55-4730-946d-941b9ff58594 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:48:29.168302 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f33ab509-fe55-4730-946d-941b9ff58594 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: ac3f41f1-ed37-4009-81e5-7bee0ee6ea69] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:29.178522 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f33ab509-fe55-4730-946d-941b9ff58594 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:29.179352 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f33ab509-fe55-4730-946d-941b9ff58594 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:29.179940 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f33ab509-fe55-4730-946d-941b9ff58594 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:29.181673 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f33ab509-fe55-4730-946d-941b9ff58594 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:29.182287 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f33ab509-fe55-4730-946d-941b9ff58594 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:29.182889 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f33ab509-fe55-4730-946d-941b9ff58594 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:29.197374 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-f5ceae89-f4dd-419e-99ac-7e07f671794e tempest-ServerAddressesNegativeTestJSON-1549542698 tempest-ServerAddressesNegativeTestJSON-1549542698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0fdccf8a4c74c56bd811a0092c92bd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '031ee0beac0b4fd6b43a1030e07c82ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:29.207814 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-f5ceae89-f4dd-419e-99ac-7e07f671794e tempest-ServerAddressesNegativeTestJSON-1549542698 tempest-ServerAddressesNegativeTestJSON-1549542698-project] 10.222.0.33 "GET /compute/v2.1/servers/7f1a706c-5002-4d52-83ba-f25ce7771d02" status: 200 len: 1324 microversion: 2.1 time: 0.687217 Oct 04 20:48:29.222559 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1718/3347] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:48:28 2022] GET /compute/v2.1/servers/7f1a706c-5002-4d52-83ba-f25ce7771d02 => generated 1324 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:48:29.231581 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-d01174a6-8415-4d47-a45f-ecc3e3684ca4 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Calling method '.version_select at 0x7f3c7450b790>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:29.291530 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f33ab509-fe55-4730-946d-941b9ff58594 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "POST /compute/v2.1/servers/ac3f41f1-ed37-4009-81e5-7bee0ee6ea69/action" status: 200 len: 14 microversion: 2.1 time: 0.131139 Oct 04 20:48:29.292389 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1630/3348] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 20:48:29 2022] POST /compute/v2.1/servers/ac3f41f1-ed37-4009-81e5-7bee0ee6ea69/action => generated 14 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 20:48:29.298402 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-fe095ea5-093c-436b-9414-7b554f914254 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:29.299798 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-fe095ea5-093c-436b-9414-7b554f914254 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] [instance: 797893a5-beaa-4f69-be4c-66592fb3fb33] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:29.311507 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fe095ea5-093c-436b-9414-7b554f914254 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:29.312133 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fe095ea5-093c-436b-9414-7b554f914254 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:29.312844 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fe095ea5-093c-436b-9414-7b554f914254 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:29.313789 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fe095ea5-093c-436b-9414-7b554f914254 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:29.314797 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fe095ea5-093c-436b-9414-7b554f914254 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:29.316219 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fe095ea5-093c-436b-9414-7b554f914254 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:29.331838 n-d-854823-8 devstack@n-api.service[128802]: DEBUG neutronclient.v2_0.client [None req-d01174a6-8415-4d47-a45f-ecc3e3684ca4 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group f9dc6aa8-2820-4bfa-8cb5-43eb063d7c92 does not exist", "detail": ""}} {{(pid=128802) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 20:48:29.333265 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.network.security_group_api [None req-d01174a6-8415-4d47-a45f-ecc3e3684ca4 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Neutron security group f9dc6aa8-2820-4bfa-8cb5-43eb063d7c92 not found {{(pid=128802) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 04 20:48:29.333265 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.wsgi [None req-d01174a6-8415-4d47-a45f-ecc3e3684ca4 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] HTTP exception thrown: Security group f9dc6aa8-2820-4bfa-8cb5-43eb063d7c92 does not exist Oct 04 20:48:29.333265 n-d-854823-8 devstack@n-api.service[128802]: Neutron server returns request_ids: ['req-d8411a17-cac9-4e7b-a133-feca91832a07'] Oct 04 20:48:29.335292 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-d01174a6-8415-4d47-a45f-ecc3e3684ca4 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Request method failure captured: Oct 04 20:48:29.335292 n-d-854823-8 devstack@n-api.service[128802]: request: GET /compute/v2.1/os-security-groups/f9dc6aa8-2820-4bfa-8cb5-43eb063d7c92 HTTP/1.1 Oct 04 20:48:29.335292 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 20:48:29.335292 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 20:48:29.335292 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 20:48:29.335292 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 0 Oct 04 20:48:29.335292 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 20:48:29.335292 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 20:48:29.335292 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 20:48:29.335292 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 20:48:29.335292 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPJvplJ2XtdAcke_gJrXE_KNLNy4K9GZxu4xJ3RC3ictvWfS6RkKIgxre3Ypn4Hea1fYOIvZNCiP-yxvq5D6SolLdjoz27YjvMYrrTV2S3thhTnsVyXyRm0AMTe4s528xDCu1J43IqMSUlnCB8IA8Xi7RGhGDp6gPtwX5ldwf-HyrWJg Oct 04 20:48:29.335292 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 20:48:29.335292 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 20:48:29.335292 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 20:48:29.335292 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 20:48:29.335292 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 20:48:29.335292 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 20:48:29.335292 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: 5338cf2146344042bc263bdc4f9d822b Oct 04 20:48:29.335292 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-SecurityGroupsTestJSON-969894548 Oct 04 20:48:29.335292 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 20:48:29.335292 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 20:48:29.335292 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5338cf2146344042bc263bdc4f9d822b", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5338cf2146344042bc263bdc4f9d822b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5338cf2146344042bc263bdc4f9d822b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5338cf2146344042bc263bdc4f9d822b"}]}] Oct 04 20:48:29.335292 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-SecurityGroupsTestJSON-969894548 Oct 04 20:48:29.335292 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: 5338cf2146344042bc263bdc4f9d822b Oct 04 20:48:29.335292 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-969894548 Oct 04 20:48:29.335292 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-SecurityGroupsTestJSON-969894548-project Oct 04 20:48:29.335292 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 20:48:29.335292 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 20:48:29.335292 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: 6775b9d82b3444f6b728736f1d2b2806 Oct 04 20:48:29.335292 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-SecurityGroupsTestJSON-969894548-project Oct 04 20:48:29.335292 n-d-854823-8 devstack@n-api.service[128802]: method: Oct 04 20:48:29.335292 n-d-854823-8 devstack@n-api.service[128802]: exception: Security group f9dc6aa8-2820-4bfa-8cb5-43eb063d7c92 does not exist Oct 04 20:48:29.335292 n-d-854823-8 devstack@n-api.service[128802]: Neutron server returns request_ids: ['req-d8411a17-cac9-4e7b-a133-feca91832a07'] Oct 04 20:48:29.335292 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'id': 'f9dc6aa8-2820-4bfa-8cb5-43eb063d7c92'} Oct 04 20:48:29.335292 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:48:29.335292 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:48:29.335292 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 04 20:48:29.335292 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 04 20:48:29.335292 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:48:29.335292 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:48:29.335292 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 04 20:48:29.335292 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 04 20:48:29.335292 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:48:29.335292 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:48:29.335292 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 20:48:29.335292 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 20:48:29.335292 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:48:29.335292 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:48:29.335292 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:48:29.335292 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:48:29.335292 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:48:29.335292 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:48:29.335292 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 20:48:29.335292 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 20:48:29.335292 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:48:29.335292 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:48:29.335292 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 20:48:29.335292 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 20:48:29.335292 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 20:48:29.335292 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 20:48:29.335292 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group f9dc6aa8-2820-4bfa-8cb5-43eb063d7c92 does not exist Oct 04 20:48:29.340435 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d8411a17-cac9-4e7b-a133-feca91832a07'] Oct 04 20:48:29.340435 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:48:29.340435 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:48:29.340435 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:48:29.340435 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:48:29.340435 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 04 20:48:29.340435 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 04 20:48:29.340435 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 04 20:48:29.340435 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 04 20:48:29.340435 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group f9dc6aa8-2820-4bfa-8cb5-43eb063d7c92 does not exist Oct 04 20:48:29.340435 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d8411a17-cac9-4e7b-a133-feca91832a07'] Oct 04 20:48:29.340435 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:48:29.340435 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:48:29.340435 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:48:29.340435 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:48:29.340435 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:48:29.340435 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:48:29.340435 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:48:29.340435 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:48:29.340435 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:48:29.340435 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:48:29.340435 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:48:29.340435 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:48:29.340435 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 04 20:48:29.340435 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 04 20:48:29.340435 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group f9dc6aa8-2820-4bfa-8cb5-43eb063d7c92 does not exist Oct 04 20:48:29.340435 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d8411a17-cac9-4e7b-a133-feca91832a07'] Oct 04 20:48:29.340435 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:48:29.340435 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:48:29.340435 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:48:29.340435 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:48:29.340435 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:48:29.340435 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:48:29.340435 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:48:29.340435 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:48:29.340435 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group f9dc6aa8-2820-4bfa-8cb5-43eb063d7c92 does not exist Oct 04 20:48:29.340435 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d8411a17-cac9-4e7b-a133-feca91832a07'] Oct 04 20:48:29.340435 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:48:29.340435 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-d01174a6-8415-4d47-a45f-ecc3e3684ca4 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Returning 404 to user: Security group f9dc6aa8-2820-4bfa-8cb5-43eb063d7c92 does not exist Oct 04 20:48:29.340435 n-d-854823-8 devstack@n-api.service[128802]: Neutron server returns request_ids: ['req-d8411a17-cac9-4e7b-a133-feca91832a07'] {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:48:29.340435 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-d01174a6-8415-4d47-a45f-ecc3e3684ca4 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] 10.222.0.33 "GET /compute/v2.1/os-security-groups/f9dc6aa8-2820-4bfa-8cb5-43eb063d7c92" status: 404 len: 194 microversion: 2.1 time: 0.127378 Oct 04 20:48:29.340435 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1719/3349] 10.222.0.33 () {58 vars in 1269 bytes} [Tue Oct 4 20:48:29 2022] GET /compute/v2.1/os-security-groups/f9dc6aa8-2820-4bfa-8cb5-43eb063d7c92 => generated 194 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:48:29.350627 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-06eaf5bc-5496-4104-afb8-d0be76e27640 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:29.352321 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-06eaf5bc-5496-4104-afb8-d0be76e27640 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] [instance: f9938964-5f2f-4093-b5cb-967adbe97623] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:29.363452 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-fe095ea5-093c-436b-9414-7b554f914254 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] HTTP exception thrown: Instance 797893a5-beaa-4f69-be4c-66592fb3fb33 could not be found. Oct 04 20:48:29.365394 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-fe095ea5-093c-436b-9414-7b554f914254 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Request method failure captured: Oct 04 20:48:29.365394 n-d-854823-8 devstack@n-api.service[128801]: request: DELETE /compute/v2.1/servers/797893a5-beaa-4f69-be4c-66592fb3fb33 HTTP/1.1 Oct 04 20:48:29.365394 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:48:29.365394 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:48:29.365394 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:48:29.365394 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 0 Oct 04 20:48:29.365394 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:48:29.365394 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:48:29.365394 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:48:29.365394 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:48:29.365394 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJsSwF2ySar2LJQGdSe43g0QAYtjP4_BPyLRwM7Cr4_8Oz_X-RTScy1BL0ogt-qe3YNvQGTaYbVbGoUGx7pHqiHpbZftU7_TcvDA_zpgTfxGGH91CR74RG6crXL2bxRs87dSvsLYuOWMw7_AQjTpWetc1HBlb5th2rD-ko2SN3gLGSA Oct 04 20:48:29.365394 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:48:29.365394 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:48:29.365394 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:48:29.365394 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:48:29.365394 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:48:29.365394 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:48:29.365394 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: 7097bc12179446f6a3e1fac8434d5c64 Oct 04 20:48:29.365394 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-ServersTestJSON-927611194 Oct 04 20:48:29.365394 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 20:48:29.365394 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 20:48:29.365394 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_7097bc12179446f6a3e1fac8434d5c64", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7097bc12179446f6a3e1fac8434d5c64"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7097bc12179446f6a3e1fac8434d5c64"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/7097bc12179446f6a3e1fac8434d5c64"}]}] Oct 04 20:48:29.365394 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-ServersTestJSON-927611194 Oct 04 20:48:29.365394 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: 7097bc12179446f6a3e1fac8434d5c64 Oct 04 20:48:29.365394 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ServersTestJSON-927611194 Oct 04 20:48:29.365394 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-ServersTestJSON-927611194-project Oct 04 20:48:29.365394 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:48:29.365394 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:48:29.365394 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: 87dcc7baf63f4ae6bfe0a099adffd408 Oct 04 20:48:29.365394 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-ServersTestJSON-927611194-project Oct 04 20:48:29.365394 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 20:48:29.365394 n-d-854823-8 devstack@n-api.service[128801]: exception: Instance 797893a5-beaa-4f69-be4c-66592fb3fb33 could not be found. Oct 04 20:48:29.365394 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': '797893a5-beaa-4f69-be4c-66592fb3fb33'} Oct 04 20:48:29.365394 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:48:29.365394 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:48:29.365394 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:48:29.365394 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:48:29.365394 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:48:29.365394 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:48:29.365394 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:48:29.365394 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:48:29.365394 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:48:29.365394 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:48:29.365394 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 797893a5-beaa-4f69-be4c-66592fb3fb33 could not be found. Oct 04 20:48:29.365394 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:48:29.365394 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:48:29.365394 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:48:29.365394 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:48:29.365394 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:48:29.365394 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:48:29.365394 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:48:29.365394 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:48:29.365394 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:48:29.365394 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:48:29.365394 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 20:48:29.365394 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 20:48:29.365394 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 20:48:29.365394 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 20:48:29.365394 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:48:29.365394 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:48:29.365394 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:48:29.365394 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:48:29.365394 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 797893a5-beaa-4f69-be4c-66592fb3fb33 could not be found. Oct 04 20:48:29.370048 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:48:29.370048 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:48:29.370048 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:48:29.370048 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:48:29.370048 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:48:29.370048 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:48:29.370048 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:48:29.370048 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:48:29.370048 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 797893a5-beaa-4f69-be4c-66592fb3fb33 could not be found. Oct 04 20:48:29.370048 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:48:29.370880 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-06eaf5bc-5496-4104-afb8-d0be76e27640 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:29.370880 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-06eaf5bc-5496-4104-afb8-d0be76e27640 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:29.370880 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-06eaf5bc-5496-4104-afb8-d0be76e27640 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:29.370880 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-06eaf5bc-5496-4104-afb8-d0be76e27640 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:29.370880 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-06eaf5bc-5496-4104-afb8-d0be76e27640 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:29.371292 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-fe095ea5-093c-436b-9414-7b554f914254 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Returning 404 to user: Instance 797893a5-beaa-4f69-be4c-66592fb3fb33 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:48:29.371392 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-06eaf5bc-5496-4104-afb8-d0be76e27640 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:29.372264 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-fe095ea5-093c-436b-9414-7b554f914254 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] 10.222.0.33 "DELETE /compute/v2.1/servers/797893a5-beaa-4f69-be4c-66592fb3fb33" status: 404 len: 111 microversion: 2.1 time: 0.078460 Oct 04 20:48:29.372945 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1631/3350] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 20:48:29 2022] DELETE /compute/v2.1/servers/797893a5-beaa-4f69-be4c-66592fb3fb33 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:48:29.389942 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-925ee1d7-0998-4a9d-98c3-e03f58095cee tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Calling method '.version_select at 0x7f3c7425bf70>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:29.739653 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-06eaf5bc-5496-4104-afb8-d0be76e27640 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e4b00964014a0383f79597652bd428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7f38600b5041ad8e66a12d77b940fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:29.756371 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-06eaf5bc-5496-4104-afb8-d0be76e27640 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] 10.222.0.33 "GET /compute/v2.1/servers/f9938964-5f2f-4093-b5cb-967adbe97623" status: 200 len: 1368 microversion: 2.1 time: 0.414150 Oct 04 20:48:29.756894 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1720/3351] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:48:29 2022] GET /compute/v2.1/servers/f9938964-5f2f-4093-b5cb-967adbe97623 => generated 1368 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:48:29.761644 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-19e8289e-341d-4339-abf8-518533dd6df4 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:29.775298 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-19e8289e-341d-4339-abf8-518533dd6df4 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] [instance: 797893a5-beaa-4f69-be4c-66592fb3fb33] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:29.781486 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-19e8289e-341d-4339-abf8-518533dd6df4 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:29.781982 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-19e8289e-341d-4339-abf8-518533dd6df4 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:29.782476 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-19e8289e-341d-4339-abf8-518533dd6df4 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:29.783370 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-19e8289e-341d-4339-abf8-518533dd6df4 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:29.784228 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-19e8289e-341d-4339-abf8-518533dd6df4 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:29.784993 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-19e8289e-341d-4339-abf8-518533dd6df4 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:29.803748 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.wsgi [None req-19e8289e-341d-4339-abf8-518533dd6df4 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] HTTP exception thrown: Instance 797893a5-beaa-4f69-be4c-66592fb3fb33 could not be found. Oct 04 20:48:29.805746 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-19e8289e-341d-4339-abf8-518533dd6df4 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Request method failure captured: Oct 04 20:48:29.805746 n-d-854823-8 devstack@n-api.service[128802]: request: GET /compute/v2.1/servers/797893a5-beaa-4f69-be4c-66592fb3fb33 HTTP/1.1 Oct 04 20:48:29.805746 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 20:48:29.805746 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 20:48:29.805746 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 20:48:29.805746 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 0 Oct 04 20:48:29.805746 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 20:48:29.805746 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 20:48:29.805746 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 20:48:29.805746 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 20:48:29.805746 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPJsSwF2ySar2LJQGdSe43g0QAYtjP4_BPyLRwM7Cr4_8Oz_X-RTScy1BL0ogt-qe3YNvQGTaYbVbGoUGx7pHqiHpbZftU7_TcvDA_zpgTfxGGH91CR74RG6crXL2bxRs87dSvsLYuOWMw7_AQjTpWetc1HBlb5th2rD-ko2SN3gLGSA Oct 04 20:48:29.805746 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 20:48:29.805746 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 20:48:29.805746 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 20:48:29.805746 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 20:48:29.805746 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 20:48:29.805746 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 20:48:29.805746 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: 7097bc12179446f6a3e1fac8434d5c64 Oct 04 20:48:29.805746 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-ServersTestJSON-927611194 Oct 04 20:48:29.805746 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 20:48:29.805746 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 20:48:29.805746 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_7097bc12179446f6a3e1fac8434d5c64", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7097bc12179446f6a3e1fac8434d5c64"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7097bc12179446f6a3e1fac8434d5c64"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/7097bc12179446f6a3e1fac8434d5c64"}]}] Oct 04 20:48:29.805746 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-ServersTestJSON-927611194 Oct 04 20:48:29.805746 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: 7097bc12179446f6a3e1fac8434d5c64 Oct 04 20:48:29.805746 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-ServersTestJSON-927611194 Oct 04 20:48:29.805746 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-ServersTestJSON-927611194-project Oct 04 20:48:29.805746 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 20:48:29.805746 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 20:48:29.805746 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: 87dcc7baf63f4ae6bfe0a099adffd408 Oct 04 20:48:29.805746 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-ServersTestJSON-927611194-project Oct 04 20:48:29.805746 n-d-854823-8 devstack@n-api.service[128802]: method: > Oct 04 20:48:29.805746 n-d-854823-8 devstack@n-api.service[128802]: exception: Instance 797893a5-beaa-4f69-be4c-66592fb3fb33 could not be found. Oct 04 20:48:29.805746 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'id': '797893a5-beaa-4f69-be4c-66592fb3fb33'} Oct 04 20:48:29.805746 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:48:29.805746 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:48:29.805746 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:48:29.805746 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:48:29.805746 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:48:29.805746 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:48:29.805746 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:48:29.805746 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:48:29.805746 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:48:29.805746 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:48:29.805746 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 797893a5-beaa-4f69-be4c-66592fb3fb33 could not be found. Oct 04 20:48:29.805746 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:48:29.805746 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:48:29.805746 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:48:29.805746 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:48:29.805746 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:48:29.805746 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:48:29.805746 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:48:29.805746 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:48:29.805746 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:48:29.805746 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:48:29.805746 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:48:29.805746 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:48:29.805746 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:48:29.805746 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:48:29.805746 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:48:29.805746 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:48:29.805746 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 797893a5-beaa-4f69-be4c-66592fb3fb33 could not be found. Oct 04 20:48:29.805746 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:48:29.805746 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:48:29.805746 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:48:29.805746 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:48:29.810550 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:48:29.810550 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:48:29.810550 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:48:29.810550 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:48:29.810550 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 797893a5-beaa-4f69-be4c-66592fb3fb33 could not be found. Oct 04 20:48:29.810550 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:48:29.812578 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-19e8289e-341d-4339-abf8-518533dd6df4 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Returning 404 to user: Instance 797893a5-beaa-4f69-be4c-66592fb3fb33 could not be found. {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:48:29.813859 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-19e8289e-341d-4339-abf8-518533dd6df4 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] 10.222.0.33 "GET /compute/v2.1/servers/797893a5-beaa-4f69-be4c-66592fb3fb33" status: 404 len: 111 microversion: 2.1 time: 0.055831 Oct 04 20:48:29.815475 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1721/3352] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:48:29 2022] GET /compute/v2.1/servers/797893a5-beaa-4f69-be4c-66592fb3fb33 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:48:29.822117 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-c5b3fd3b-a7c5-4851-8bb4-d5f1a744d1ac tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:29.823253 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-c5b3fd3b-a7c5-4851-8bb4-d5f1a744d1ac tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] [instance: c0a14e22-0620-4912-9893-62974c80978a] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:29.830679 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c5b3fd3b-a7c5-4851-8bb4-d5f1a744d1ac tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:29.831841 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c5b3fd3b-a7c5-4851-8bb4-d5f1a744d1ac tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:29.832535 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c5b3fd3b-a7c5-4851-8bb4-d5f1a744d1ac tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:29.833682 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c5b3fd3b-a7c5-4851-8bb4-d5f1a744d1ac tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:29.834317 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c5b3fd3b-a7c5-4851-8bb4-d5f1a744d1ac tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:29.834986 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c5b3fd3b-a7c5-4851-8bb4-d5f1a744d1ac tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:29.852459 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.wsgi [None req-c5b3fd3b-a7c5-4851-8bb4-d5f1a744d1ac tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] HTTP exception thrown: Instance c0a14e22-0620-4912-9893-62974c80978a could not be found. Oct 04 20:48:29.854901 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-c5b3fd3b-a7c5-4851-8bb4-d5f1a744d1ac tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Request method failure captured: Oct 04 20:48:29.854901 n-d-854823-8 devstack@n-api.service[128802]: request: GET /compute/v2.1/servers/c0a14e22-0620-4912-9893-62974c80978a HTTP/1.1 Oct 04 20:48:29.854901 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 20:48:29.854901 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 20:48:29.854901 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 20:48:29.854901 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 0 Oct 04 20:48:29.854901 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 20:48:29.854901 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 20:48:29.854901 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 20:48:29.854901 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 20:48:29.854901 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPJpyTxIS1iBYZVyWVMY2cqw5DBKYtLHHXwKWiHW-Og8vznPsPBi5ljiJqzxbrWGD7wVGUdLN7jspvhXceNNH72AMDOPoOCg1eHg9h7Q_uxlJ5r9trKLgdGFKTeloXh-Pt5axqmdS5yJyozGUSYwKb_LVAkWWxCqGJjlMyqKe_viaaw8 Oct 04 20:48:29.854901 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 20:48:29.854901 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 20:48:29.854901 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 20:48:29.854901 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 20:48:29.854901 n-d-854823-8 devstack@n-api.service[128802]: X-Openstack-Nova-Api-Version: 2.32 Oct 04 20:48:29.854901 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 20:48:29.854901 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 20:48:29.854901 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: 5392c67506f7445ab33d62b191558f7b Oct 04 20:48:29.854901 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-TaggedBootDevicesTest-67949532 Oct 04 20:48:29.854901 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 20:48:29.854901 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 20:48:29.854901 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5392c67506f7445ab33d62b191558f7b", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5392c67506f7445ab33d62b191558f7b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5392c67506f7445ab33d62b191558f7b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5392c67506f7445ab33d62b191558f7b"}]}] Oct 04 20:48:29.854901 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-TaggedBootDevicesTest-67949532 Oct 04 20:48:29.854901 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: 5392c67506f7445ab33d62b191558f7b Oct 04 20:48:29.854901 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-TaggedBootDevicesTest-67949532 Oct 04 20:48:29.854901 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-TaggedBootDevicesTest-67949532-project Oct 04 20:48:29.854901 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 20:48:29.854901 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 20:48:29.854901 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: 28399882314945d787a3af6eb59935c0 Oct 04 20:48:29.854901 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-TaggedBootDevicesTest-67949532-project Oct 04 20:48:29.854901 n-d-854823-8 devstack@n-api.service[128802]: method: > Oct 04 20:48:29.854901 n-d-854823-8 devstack@n-api.service[128802]: exception: Instance c0a14e22-0620-4912-9893-62974c80978a could not be found. Oct 04 20:48:29.854901 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'id': 'c0a14e22-0620-4912-9893-62974c80978a'} Oct 04 20:48:29.854901 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:48:29.854901 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:48:29.854901 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:48:29.854901 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:48:29.854901 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:48:29.854901 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:48:29.854901 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:48:29.854901 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:48:29.854901 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:48:29.854901 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:48:29.854901 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0a14e22-0620-4912-9893-62974c80978a could not be found. Oct 04 20:48:29.854901 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:48:29.854901 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:48:29.854901 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:48:29.854901 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:48:29.854901 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:48:29.854901 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:48:29.854901 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:48:29.854901 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:48:29.854901 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:48:29.854901 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:48:29.854901 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:48:29.854901 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:48:29.854901 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:48:29.854901 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:48:29.854901 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:48:29.854901 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:48:29.854901 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0a14e22-0620-4912-9893-62974c80978a could not be found. Oct 04 20:48:29.854901 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:48:29.854901 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:48:29.854901 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:48:29.860432 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:48:29.860432 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:48:29.860432 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:48:29.860432 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:48:29.860432 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:48:29.860432 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0a14e22-0620-4912-9893-62974c80978a could not be found. Oct 04 20:48:29.860432 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:48:29.861912 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-c5b3fd3b-a7c5-4851-8bb4-d5f1a744d1ac tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Returning 404 to user: Instance c0a14e22-0620-4912-9893-62974c80978a could not be found. {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:48:29.863248 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-c5b3fd3b-a7c5-4851-8bb4-d5f1a744d1ac tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] 10.222.0.33 "GET /compute/v2.1/servers/c0a14e22-0620-4912-9893-62974c80978a" status: 404 len: 111 microversion: 2.32 time: 0.046369 Oct 04 20:48:29.864386 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1722/3353] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:48:29 2022] GET /compute/v2.1/servers/c0a14e22-0620-4912-9893-62974c80978a => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 20:48:29.869621 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-43f0ed87-56d1-49bf-a4fb-644ed66434da tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:29.870491 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-43f0ed87-56d1-49bf-a4fb-644ed66434da tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] [instance: 77790f1c-897a-4539-bb73-aaa39c83b235] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:29.878238 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-43f0ed87-56d1-49bf-a4fb-644ed66434da tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:29.879124 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-43f0ed87-56d1-49bf-a4fb-644ed66434da tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:29.879865 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-43f0ed87-56d1-49bf-a4fb-644ed66434da tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:29.880769 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-43f0ed87-56d1-49bf-a4fb-644ed66434da tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:29.881391 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-43f0ed87-56d1-49bf-a4fb-644ed66434da tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:29.881997 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-43f0ed87-56d1-49bf-a4fb-644ed66434da tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:29.899677 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.wsgi [None req-43f0ed87-56d1-49bf-a4fb-644ed66434da tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] HTTP exception thrown: Instance 77790f1c-897a-4539-bb73-aaa39c83b235 could not be found. Oct 04 20:48:29.916379 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-43f0ed87-56d1-49bf-a4fb-644ed66434da tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Request method failure captured: Oct 04 20:48:29.916379 n-d-854823-8 devstack@n-api.service[128802]: request: DELETE /compute/v2.1/servers/77790f1c-897a-4539-bb73-aaa39c83b235 HTTP/1.1 Oct 04 20:48:29.916379 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 20:48:29.916379 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 20:48:29.916379 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 20:48:29.916379 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 0 Oct 04 20:48:29.916379 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 20:48:29.916379 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 20:48:29.916379 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 20:48:29.916379 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 20:48:29.916379 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPJsSwF2ySar2LJQGdSe43g0QAYtjP4_BPyLRwM7Cr4_8Oz_X-RTScy1BL0ogt-qe3YNvQGTaYbVbGoUGx7pHqiHpbZftU7_TcvDA_zpgTfxGGH91CR74RG6crXL2bxRs87dSvsLYuOWMw7_AQjTpWetc1HBlb5th2rD-ko2SN3gLGSA Oct 04 20:48:29.916379 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 20:48:29.916379 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 20:48:29.916379 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 20:48:29.916379 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 20:48:29.916379 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 20:48:29.916379 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 20:48:29.916379 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: 7097bc12179446f6a3e1fac8434d5c64 Oct 04 20:48:29.916379 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-ServersTestJSON-927611194 Oct 04 20:48:29.916379 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 20:48:29.916379 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 20:48:29.916379 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_7097bc12179446f6a3e1fac8434d5c64", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7097bc12179446f6a3e1fac8434d5c64"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7097bc12179446f6a3e1fac8434d5c64"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/7097bc12179446f6a3e1fac8434d5c64"}]}] Oct 04 20:48:29.916379 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-ServersTestJSON-927611194 Oct 04 20:48:29.916379 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: 7097bc12179446f6a3e1fac8434d5c64 Oct 04 20:48:29.916379 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-ServersTestJSON-927611194 Oct 04 20:48:29.916379 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-ServersTestJSON-927611194-project Oct 04 20:48:29.916379 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 20:48:29.916379 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 20:48:29.916379 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: 87dcc7baf63f4ae6bfe0a099adffd408 Oct 04 20:48:29.916379 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-ServersTestJSON-927611194-project Oct 04 20:48:29.916379 n-d-854823-8 devstack@n-api.service[128802]: method: > Oct 04 20:48:29.916379 n-d-854823-8 devstack@n-api.service[128802]: exception: Instance 77790f1c-897a-4539-bb73-aaa39c83b235 could not be found. Oct 04 20:48:29.916379 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'id': '77790f1c-897a-4539-bb73-aaa39c83b235'} Oct 04 20:48:29.916379 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:48:29.916379 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:48:29.916379 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:48:29.916379 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:48:29.916379 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:48:29.916379 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:48:29.916379 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:48:29.916379 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:48:29.916379 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:48:29.916379 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:48:29.916379 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 77790f1c-897a-4539-bb73-aaa39c83b235 could not be found. Oct 04 20:48:29.916379 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:48:29.916379 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:48:29.916379 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:48:29.916379 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:48:29.916379 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:48:29.916379 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:48:29.916379 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:48:29.916379 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:48:29.916379 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:48:29.916379 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:48:29.916379 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 20:48:29.916379 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 20:48:29.916379 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 20:48:29.916379 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 20:48:29.916379 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:48:29.916379 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:48:29.916379 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:48:29.916379 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:48:29.916379 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77790f1c-897a-4539-bb73-aaa39c83b235 could not be found. Oct 04 20:48:29.921089 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:48:29.921089 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:48:29.921089 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:48:29.921089 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:48:29.921089 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:48:29.921089 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:48:29.921089 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:48:29.921089 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:48:29.921089 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77790f1c-897a-4539-bb73-aaa39c83b235 could not be found. Oct 04 20:48:29.921089 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:48:29.922870 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-43f0ed87-56d1-49bf-a4fb-644ed66434da tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Returning 404 to user: Instance 77790f1c-897a-4539-bb73-aaa39c83b235 could not be found. {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:48:29.923922 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-43f0ed87-56d1-49bf-a4fb-644ed66434da tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] 10.222.0.33 "DELETE /compute/v2.1/servers/77790f1c-897a-4539-bb73-aaa39c83b235" status: 404 len: 111 microversion: 2.1 time: 0.058443 Oct 04 20:48:29.925080 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1723/3354] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 20:48:29 2022] DELETE /compute/v2.1/servers/77790f1c-897a-4539-bb73-aaa39c83b235 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:48:29.929960 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-7d8135fc-24a2-40ae-905d-a18d54dcbbba tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Calling method '.version_select at 0x7f3c74662ca0>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:29.972179 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-7d8135fc-24a2-40ae-905d-a18d54dcbbba tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1396397535" status: 204 len: 0 microversion: 2.32 time: 0.045877 Oct 04 20:48:29.973319 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1724/3355] 10.222.0.33 () {60 vars in 1262 bytes} [Tue Oct 4 20:48:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1396397535 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 20:48:29.984528 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-7ccee8f9-fafe-4938-b4cb-8b61c85f8d19 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:29.988251 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-7ccee8f9-fafe-4938-b4cb-8b61c85f8d19 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] [instance: 77790f1c-897a-4539-bb73-aaa39c83b235] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:30.000495 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7ccee8f9-fafe-4938-b4cb-8b61c85f8d19 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:30.001004 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7ccee8f9-fafe-4938-b4cb-8b61c85f8d19 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:30.001444 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7ccee8f9-fafe-4938-b4cb-8b61c85f8d19 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:30.002170 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7ccee8f9-fafe-4938-b4cb-8b61c85f8d19 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:30.003207 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7ccee8f9-fafe-4938-b4cb-8b61c85f8d19 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:30.003645 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7ccee8f9-fafe-4938-b4cb-8b61c85f8d19 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:30.044876 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.wsgi [None req-7ccee8f9-fafe-4938-b4cb-8b61c85f8d19 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] HTTP exception thrown: Instance 77790f1c-897a-4539-bb73-aaa39c83b235 could not be found. Oct 04 20:48:30.048617 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-7ccee8f9-fafe-4938-b4cb-8b61c85f8d19 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Request method failure captured: Oct 04 20:48:30.048617 n-d-854823-8 devstack@n-api.service[128802]: request: GET /compute/v2.1/servers/77790f1c-897a-4539-bb73-aaa39c83b235 HTTP/1.1 Oct 04 20:48:30.048617 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 20:48:30.048617 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 20:48:30.048617 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 20:48:30.048617 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 0 Oct 04 20:48:30.048617 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 20:48:30.048617 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 20:48:30.048617 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 20:48:30.048617 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 20:48:30.048617 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPJsSwF2ySar2LJQGdSe43g0QAYtjP4_BPyLRwM7Cr4_8Oz_X-RTScy1BL0ogt-qe3YNvQGTaYbVbGoUGx7pHqiHpbZftU7_TcvDA_zpgTfxGGH91CR74RG6crXL2bxRs87dSvsLYuOWMw7_AQjTpWetc1HBlb5th2rD-ko2SN3gLGSA Oct 04 20:48:30.048617 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 20:48:30.048617 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 20:48:30.048617 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 20:48:30.048617 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 20:48:30.048617 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 20:48:30.048617 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 20:48:30.048617 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: 7097bc12179446f6a3e1fac8434d5c64 Oct 04 20:48:30.048617 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-ServersTestJSON-927611194 Oct 04 20:48:30.048617 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 20:48:30.048617 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 20:48:30.048617 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_7097bc12179446f6a3e1fac8434d5c64", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7097bc12179446f6a3e1fac8434d5c64"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7097bc12179446f6a3e1fac8434d5c64"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/7097bc12179446f6a3e1fac8434d5c64"}]}] Oct 04 20:48:30.048617 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-ServersTestJSON-927611194 Oct 04 20:48:30.048617 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: 7097bc12179446f6a3e1fac8434d5c64 Oct 04 20:48:30.048617 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-ServersTestJSON-927611194 Oct 04 20:48:30.048617 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-ServersTestJSON-927611194-project Oct 04 20:48:30.048617 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 20:48:30.048617 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 20:48:30.048617 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: 87dcc7baf63f4ae6bfe0a099adffd408 Oct 04 20:48:30.048617 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-ServersTestJSON-927611194-project Oct 04 20:48:30.048617 n-d-854823-8 devstack@n-api.service[128802]: method: > Oct 04 20:48:30.048617 n-d-854823-8 devstack@n-api.service[128802]: exception: Instance 77790f1c-897a-4539-bb73-aaa39c83b235 could not be found. Oct 04 20:48:30.048617 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'id': '77790f1c-897a-4539-bb73-aaa39c83b235'} Oct 04 20:48:30.048617 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:48:30.048617 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:48:30.048617 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:48:30.048617 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:48:30.048617 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:48:30.048617 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:48:30.048617 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:48:30.048617 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:48:30.048617 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:48:30.048617 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:48:30.048617 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 77790f1c-897a-4539-bb73-aaa39c83b235 could not be found. Oct 04 20:48:30.048617 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:48:30.048617 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:48:30.048617 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:48:30.048617 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:48:30.048617 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:48:30.048617 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:48:30.048617 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:48:30.048617 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:48:30.048617 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:48:30.048617 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:48:30.048617 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:48:30.048617 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:48:30.048617 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:48:30.048617 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:48:30.048617 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:48:30.048617 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:48:30.048617 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77790f1c-897a-4539-bb73-aaa39c83b235 could not be found. Oct 04 20:48:30.048617 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:48:30.048617 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:48:30.048617 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:48:30.048617 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:48:30.052803 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:48:30.052803 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:48:30.052803 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:48:30.052803 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:48:30.052803 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77790f1c-897a-4539-bb73-aaa39c83b235 could not be found. Oct 04 20:48:30.052803 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:48:30.052803 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-7ccee8f9-fafe-4938-b4cb-8b61c85f8d19 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Returning 404 to user: Instance 77790f1c-897a-4539-bb73-aaa39c83b235 could not be found. {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:48:30.052803 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-7ccee8f9-fafe-4938-b4cb-8b61c85f8d19 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] 10.222.0.33 "GET /compute/v2.1/servers/77790f1c-897a-4539-bb73-aaa39c83b235" status: 404 len: 111 microversion: 2.1 time: 0.074893 Oct 04 20:48:30.056836 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1725/3356] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:48:29 2022] GET /compute/v2.1/servers/77790f1c-897a-4539-bb73-aaa39c83b235 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:48:30.068605 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-601c16c1-1436-4d03-830f-dc19f9127564 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:30.069396 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-601c16c1-1436-4d03-830f-dc19f9127564 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] [instance: 0f127014-9e6f-47e6-b8a5-94ca91e0836c] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:30.075876 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-601c16c1-1436-4d03-830f-dc19f9127564 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:30.076780 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-601c16c1-1436-4d03-830f-dc19f9127564 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:30.077501 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-601c16c1-1436-4d03-830f-dc19f9127564 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:30.078573 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-601c16c1-1436-4d03-830f-dc19f9127564 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:30.079247 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-601c16c1-1436-4d03-830f-dc19f9127564 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:30.080355 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-601c16c1-1436-4d03-830f-dc19f9127564 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:30.138720 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-601c16c1-1436-4d03-830f-dc19f9127564 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] [instance: 0f127014-9e6f-47e6-b8a5-94ca91e0836c] Going to try to terminate instance {{(pid=128802) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:48:30.328656 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-601c16c1-1436-4d03-830f-dc19f9127564 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] 10.222.0.33 "DELETE /compute/v2.1/servers/0f127014-9e6f-47e6-b8a5-94ca91e0836c" status: 204 len: 0 microversion: 2.1 time: 0.268018 Oct 04 20:48:30.334489 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1726/3357] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 20:48:30 2022] DELETE /compute/v2.1/servers/0f127014-9e6f-47e6-b8a5-94ca91e0836c => generated 0 bytes in 274 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:48:30.440736 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-925ee1d7-0998-4a9d-98c3-e03f58095cee tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/9155f37f-55fc-44e3-b007-57d9465c2cfe" status: 202 len: 0 microversion: 2.1 time: 1.065940 Oct 04 20:48:30.442181 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1632/3358] 10.222.0.33 () {58 vars in 1272 bytes} [Tue Oct 4 20:48:29 2022] DELETE /compute/v2.1/os-security-groups/9155f37f-55fc-44e3-b007-57d9465c2cfe => generated 0 bytes in 1068 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:48:30.447859 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-fec2a4de-655e-4480-9f14-f135fc9730a6 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:30.448480 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-fec2a4de-655e-4480-9f14-f135fc9730a6 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] [instance: 9df70a8d-757f-4b92-ab73-6ad6cfc98953] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:30.463259 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fec2a4de-655e-4480-9f14-f135fc9730a6 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:30.463762 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fec2a4de-655e-4480-9f14-f135fc9730a6 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:30.464217 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fec2a4de-655e-4480-9f14-f135fc9730a6 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:30.464905 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fec2a4de-655e-4480-9f14-f135fc9730a6 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:30.465363 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fec2a4de-655e-4480-9f14-f135fc9730a6 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:30.465812 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fec2a4de-655e-4480-9f14-f135fc9730a6 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:30.663126 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-31b219fe-846f-4e44-8dd6-549d3f804f0d tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Action: 'create', calling method: .version_select at 0x7f3c740c7040>, body: {"keypair": {"name": "tempest-keypair-442592501", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIp2eNSq+0T7GH+y2SJuiqDleb80zFW2xOjm5iYDgzjBXCQJfO8ViBLxz8ymlWsueBv9m3zikirC8vqPtBC2eTnhVFx2zu2Qoi6hWx0DD7iuJebl2d65qAMoSs0wBCis9Q=="}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:48:30.684733 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-31b219fe-846f-4e44-8dd6-549d3f804f0d tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Getting quotas for project 09101effe9da463dabc2edaccdb83e06. Resources: {'key_pairs'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:48:30.693457 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-31b219fe-846f-4e44-8dd6-549d3f804f0d tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Getting quotas for user e8397c96a6dd4c65bdde07c91ca5e7fa and project 09101effe9da463dabc2edaccdb83e06. Resources: {'key_pairs'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:48:30.730262 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-31b219fe-846f-4e44-8dd6-549d3f804f0d tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.393871 Oct 04 20:48:30.731104 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1727/3359] 10.222.0.33 () {60 vars in 1159 bytes} [Tue Oct 4 20:48:30 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:48:30.736237 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-0d648ea6-036d-40bc-a40d-0225db47ee0d tempest-ServerAddressesNegativeTestJSON-1549542698 tempest-ServerAddressesNegativeTestJSON-1549542698-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:30.737751 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-0d648ea6-036d-40bc-a40d-0225db47ee0d tempest-ServerAddressesNegativeTestJSON-1549542698 tempest-ServerAddressesNegativeTestJSON-1549542698-project] [instance: 7f1a706c-5002-4d52-83ba-f25ce7771d02] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:30.745321 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0d648ea6-036d-40bc-a40d-0225db47ee0d tempest-ServerAddressesNegativeTestJSON-1549542698 tempest-ServerAddressesNegativeTestJSON-1549542698-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:30.745918 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0d648ea6-036d-40bc-a40d-0225db47ee0d tempest-ServerAddressesNegativeTestJSON-1549542698 tempest-ServerAddressesNegativeTestJSON-1549542698-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:30.746523 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0d648ea6-036d-40bc-a40d-0225db47ee0d tempest-ServerAddressesNegativeTestJSON-1549542698 tempest-ServerAddressesNegativeTestJSON-1549542698-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:30.747376 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0d648ea6-036d-40bc-a40d-0225db47ee0d tempest-ServerAddressesNegativeTestJSON-1549542698 tempest-ServerAddressesNegativeTestJSON-1549542698-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:30.747882 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0d648ea6-036d-40bc-a40d-0225db47ee0d tempest-ServerAddressesNegativeTestJSON-1549542698 tempest-ServerAddressesNegativeTestJSON-1549542698-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:30.749168 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0d648ea6-036d-40bc-a40d-0225db47ee0d tempest-ServerAddressesNegativeTestJSON-1549542698 tempest-ServerAddressesNegativeTestJSON-1549542698-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:30.943622 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-fec2a4de-655e-4480-9f14-f135fc9730a6 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aca59cd50bf74a36bb1e4427cd50fbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3fadcd7d4043daa0a6aba27ba814d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:30.956356 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-fec2a4de-655e-4480-9f14-f135fc9730a6 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] 10.222.0.33 "GET /compute/v2.1/servers/9df70a8d-757f-4b92-ab73-6ad6cfc98953" status: 200 len: 1308 microversion: 2.1 time: 0.511760 Oct 04 20:48:30.982264 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1633/3360] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:48:30 2022] GET /compute/v2.1/servers/9df70a8d-757f-4b92-ab73-6ad6cfc98953 => generated 1308 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:48:30.990097 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1e6a2d17-5720-43e8-b6d9-6ec0b92d0961 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:48:30.992379 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-1e6a2d17-5720-43e8-b6d9-6ec0b92d0961 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: ac3f41f1-ed37-4009-81e5-7bee0ee6ea69] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:31.004662 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1e6a2d17-5720-43e8-b6d9-6ec0b92d0961 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:31.005169 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1e6a2d17-5720-43e8-b6d9-6ec0b92d0961 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:31.005605 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1e6a2d17-5720-43e8-b6d9-6ec0b92d0961 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:31.009838 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1e6a2d17-5720-43e8-b6d9-6ec0b92d0961 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:31.010439 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1e6a2d17-5720-43e8-b6d9-6ec0b92d0961 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:31.010900 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1e6a2d17-5720-43e8-b6d9-6ec0b92d0961 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:31.107792 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-1e6a2d17-5720-43e8-b6d9-6ec0b92d0961 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "POST /compute/v2.1/servers/ac3f41f1-ed37-4009-81e5-7bee0ee6ea69/action" status: 200 len: 14 microversion: 2.1 time: 0.121610 Oct 04 20:48:31.111312 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1634/3361] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 20:48:30 2022] POST /compute/v2.1/servers/ac3f41f1-ed37-4009-81e5-7bee0ee6ea69/action => generated 14 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 20:48:31.117977 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b48a5562-db2d-4ce9-911d-8570abd51613 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:31.118970 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b48a5562-db2d-4ce9-911d-8570abd51613 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] [instance: 0f127014-9e6f-47e6-b8a5-94ca91e0836c] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:31.126384 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b48a5562-db2d-4ce9-911d-8570abd51613 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:31.127124 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b48a5562-db2d-4ce9-911d-8570abd51613 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:31.128518 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b48a5562-db2d-4ce9-911d-8570abd51613 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:31.129478 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b48a5562-db2d-4ce9-911d-8570abd51613 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:31.129932 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b48a5562-db2d-4ce9-911d-8570abd51613 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:31.130418 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b48a5562-db2d-4ce9-911d-8570abd51613 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:31.762539 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-0d648ea6-036d-40bc-a40d-0225db47ee0d tempest-ServerAddressesNegativeTestJSON-1549542698 tempest-ServerAddressesNegativeTestJSON-1549542698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0fdccf8a4c74c56bd811a0092c92bd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '031ee0beac0b4fd6b43a1030e07c82ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:31.773810 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-0d648ea6-036d-40bc-a40d-0225db47ee0d tempest-ServerAddressesNegativeTestJSON-1549542698 tempest-ServerAddressesNegativeTestJSON-1549542698-project] 10.222.0.33 "GET /compute/v2.1/servers/7f1a706c-5002-4d52-83ba-f25ce7771d02" status: 200 len: 1324 microversion: 2.1 time: 1.041570 Oct 04 20:48:31.774481 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1728/3362] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:48:30 2022] GET /compute/v2.1/servers/7f1a706c-5002-4d52-83ba-f25ce7771d02 => generated 1324 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:48:31.787358 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-3a133fbf-c8e7-4ab3-a500-6b0ac3e9ecff tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Calling method '.version_select at 0x7f3c740c74c0>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:31.952116 n-d-854823-8 devstack@n-api.service[128802]: DEBUG neutronclient.v2_0.client [None req-3a133fbf-c8e7-4ab3-a500-6b0ac3e9ecff tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 9155f37f-55fc-44e3-b007-57d9465c2cfe does not exist", "detail": ""}} {{(pid=128802) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 20:48:31.952400 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.network.security_group_api [None req-3a133fbf-c8e7-4ab3-a500-6b0ac3e9ecff tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Neutron security group 9155f37f-55fc-44e3-b007-57d9465c2cfe not found {{(pid=128802) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 04 20:48:31.953002 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.wsgi [None req-3a133fbf-c8e7-4ab3-a500-6b0ac3e9ecff tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] HTTP exception thrown: Security group 9155f37f-55fc-44e3-b007-57d9465c2cfe does not exist Oct 04 20:48:31.953002 n-d-854823-8 devstack@n-api.service[128802]: Neutron server returns request_ids: ['req-262af655-5abb-4570-aac5-292984c2dd37'] Oct 04 20:48:31.955703 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-3a133fbf-c8e7-4ab3-a500-6b0ac3e9ecff tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Request method failure captured: Oct 04 20:48:31.955703 n-d-854823-8 devstack@n-api.service[128802]: request: GET /compute/v2.1/os-security-groups/9155f37f-55fc-44e3-b007-57d9465c2cfe HTTP/1.1 Oct 04 20:48:31.955703 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 20:48:31.955703 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 20:48:31.955703 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 20:48:31.955703 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 0 Oct 04 20:48:31.955703 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 20:48:31.955703 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 20:48:31.955703 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 20:48:31.955703 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 20:48:31.955703 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPJvplJ2XtdAcke_gJrXE_KNLNy4K9GZxu4xJ3RC3ictvWfS6RkKIgxre3Ypn4Hea1fYOIvZNCiP-yxvq5D6SolLdjoz27YjvMYrrTV2S3thhTnsVyXyRm0AMTe4s528xDCu1J43IqMSUlnCB8IA8Xi7RGhGDp6gPtwX5ldwf-HyrWJg Oct 04 20:48:31.955703 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 20:48:31.955703 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 20:48:31.955703 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 20:48:31.955703 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 20:48:31.955703 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 20:48:31.955703 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 20:48:31.955703 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: 5338cf2146344042bc263bdc4f9d822b Oct 04 20:48:31.955703 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-SecurityGroupsTestJSON-969894548 Oct 04 20:48:31.955703 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 20:48:31.955703 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 20:48:31.955703 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5338cf2146344042bc263bdc4f9d822b", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5338cf2146344042bc263bdc4f9d822b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5338cf2146344042bc263bdc4f9d822b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5338cf2146344042bc263bdc4f9d822b"}]}] Oct 04 20:48:31.955703 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-SecurityGroupsTestJSON-969894548 Oct 04 20:48:31.955703 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: 5338cf2146344042bc263bdc4f9d822b Oct 04 20:48:31.955703 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-969894548 Oct 04 20:48:31.955703 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-SecurityGroupsTestJSON-969894548-project Oct 04 20:48:31.955703 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 20:48:31.955703 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 20:48:31.955703 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: 6775b9d82b3444f6b728736f1d2b2806 Oct 04 20:48:31.955703 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-SecurityGroupsTestJSON-969894548-project Oct 04 20:48:31.955703 n-d-854823-8 devstack@n-api.service[128802]: method: Oct 04 20:48:31.955703 n-d-854823-8 devstack@n-api.service[128802]: exception: Security group 9155f37f-55fc-44e3-b007-57d9465c2cfe does not exist Oct 04 20:48:31.955703 n-d-854823-8 devstack@n-api.service[128802]: Neutron server returns request_ids: ['req-262af655-5abb-4570-aac5-292984c2dd37'] Oct 04 20:48:31.955703 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'id': '9155f37f-55fc-44e3-b007-57d9465c2cfe'} Oct 04 20:48:31.955703 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:48:31.955703 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:48:31.955703 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 04 20:48:31.955703 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 04 20:48:31.955703 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:48:31.955703 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:48:31.955703 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 04 20:48:31.955703 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 04 20:48:31.955703 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:48:31.955703 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:48:31.955703 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 20:48:31.955703 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 20:48:31.955703 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:48:31.955703 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:48:31.955703 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:48:31.955703 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:48:31.955703 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:48:31.955703 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:48:31.955703 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 20:48:31.955703 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 20:48:31.955703 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:48:31.955703 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:48:31.955703 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 20:48:31.955703 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 20:48:31.955703 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 20:48:31.955703 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 20:48:31.955703 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 9155f37f-55fc-44e3-b007-57d9465c2cfe does not exist Oct 04 20:48:31.959690 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-262af655-5abb-4570-aac5-292984c2dd37'] Oct 04 20:48:31.959690 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:48:31.959690 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:48:31.959690 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:48:31.959690 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:48:31.959690 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 04 20:48:31.959690 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 04 20:48:31.959690 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 04 20:48:31.959690 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 04 20:48:31.959690 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 9155f37f-55fc-44e3-b007-57d9465c2cfe does not exist Oct 04 20:48:31.959690 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-262af655-5abb-4570-aac5-292984c2dd37'] Oct 04 20:48:31.959690 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:48:31.959690 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:48:31.959690 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:48:31.959690 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:48:31.959690 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:48:31.959690 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:48:31.959690 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:48:31.959690 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:48:31.959690 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:48:31.959690 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:48:31.959690 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:48:31.959690 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:48:31.959690 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 04 20:48:31.959690 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 04 20:48:31.959690 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 9155f37f-55fc-44e3-b007-57d9465c2cfe does not exist Oct 04 20:48:31.959690 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-262af655-5abb-4570-aac5-292984c2dd37'] Oct 04 20:48:31.959690 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:48:31.959690 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:48:31.959690 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:48:31.959690 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:48:31.959690 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:48:31.959690 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:48:31.959690 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:48:31.959690 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:48:31.959690 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 9155f37f-55fc-44e3-b007-57d9465c2cfe does not exist Oct 04 20:48:31.959690 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-262af655-5abb-4570-aac5-292984c2dd37'] Oct 04 20:48:31.959690 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:48:31.965535 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-3a133fbf-c8e7-4ab3-a500-6b0ac3e9ecff tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Returning 404 to user: Security group 9155f37f-55fc-44e3-b007-57d9465c2cfe does not exist Oct 04 20:48:31.965535 n-d-854823-8 devstack@n-api.service[128802]: Neutron server returns request_ids: ['req-262af655-5abb-4570-aac5-292984c2dd37'] {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:48:31.967243 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-3a133fbf-c8e7-4ab3-a500-6b0ac3e9ecff tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] 10.222.0.33 "GET /compute/v2.1/os-security-groups/9155f37f-55fc-44e3-b007-57d9465c2cfe" status: 404 len: 194 microversion: 2.1 time: 0.191272 Oct 04 20:48:31.972970 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1729/3363] 10.222.0.33 () {58 vars in 1269 bytes} [Tue Oct 4 20:48:31 2022] GET /compute/v2.1/os-security-groups/9155f37f-55fc-44e3-b007-57d9465c2cfe => generated 194 bytes in 198 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:48:31.979141 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-212363c0-3ea7-421e-8089-0edac1748c6b tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:31.980172 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-212363c0-3ea7-421e-8089-0edac1748c6b tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] [instance: f9938964-5f2f-4093-b5cb-967adbe97623] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:31.995670 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-212363c0-3ea7-421e-8089-0edac1748c6b tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:31.996248 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-212363c0-3ea7-421e-8089-0edac1748c6b tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:31.996752 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-212363c0-3ea7-421e-8089-0edac1748c6b tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:31.997684 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-212363c0-3ea7-421e-8089-0edac1748c6b tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:31.998210 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-212363c0-3ea7-421e-8089-0edac1748c6b tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:31.998780 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-212363c0-3ea7-421e-8089-0edac1748c6b tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:32.163027 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-b48a5562-db2d-4ce9-911d-8570abd51613 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87dcc7baf63f4ae6bfe0a099adffd408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7097bc12179446f6a3e1fac8434d5c64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:32.179525 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b48a5562-db2d-4ce9-911d-8570abd51613 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] 10.222.0.33 "GET /compute/v2.1/servers/0f127014-9e6f-47e6-b8a5-94ca91e0836c" status: 200 len: 1480 microversion: 2.1 time: 1.065075 Oct 04 20:48:32.180828 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1635/3364] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:48:31 2022] GET /compute/v2.1/servers/0f127014-9e6f-47e6-b8a5-94ca91e0836c => generated 1480 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:48:32.187207 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-0579130b-7585-4a64-99cb-36660380ca1c req-7d2cd0b9-a701-447f-8c77-6012ecb307d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9df70a8d-757f-4b92-ab73-6ad6cfc98953", "tag": "1c3eba25-64e5-469d-8f64-96e322b2e424"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:48:32.205124 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-0579130b-7585-4a64-99cb-36660380ca1c req-7d2cd0b9-a701-447f-8c77-6012ecb307d0 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:32.206894 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-0579130b-7585-4a64-99cb-36660380ca1c req-7d2cd0b9-a701-447f-8c77-6012ecb307d0 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:32.207590 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-0579130b-7585-4a64-99cb-36660380ca1c req-7d2cd0b9-a701-447f-8c77-6012ecb307d0 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:32.226949 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-0579130b-7585-4a64-99cb-36660380ca1c req-7d2cd0b9-a701-447f-8c77-6012ecb307d0 service nova] Creating event network-changed:1c3eba25-64e5-469d-8f64-96e322b2e424 for instance 9df70a8d-757f-4b92-ab73-6ad6cfc98953 on n-h1-854823-8 Oct 04 20:48:32.234818 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-0579130b-7585-4a64-99cb-36660380ca1c req-7d2cd0b9-a701-447f-8c77-6012ecb307d0 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051507 Oct 04 20:48:32.236694 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1636/3365] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:48:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:48:32.243080 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-53e4ada5-bd8c-4f76-91a3-c5c5ddc91ea8 req-a3dfdd73-3e62-4d8c-bfd4-89a13b765a2c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f9938964-5f2f-4093-b5cb-967adbe97623", "tag": "61e69e8f-66c4-464b-815e-298b89835c1f"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:48:32.255500 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-53e4ada5-bd8c-4f76-91a3-c5c5ddc91ea8 req-a3dfdd73-3e62-4d8c-bfd4-89a13b765a2c service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:32.256325 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-53e4ada5-bd8c-4f76-91a3-c5c5ddc91ea8 req-a3dfdd73-3e62-4d8c-bfd4-89a13b765a2c service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:32.257105 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-53e4ada5-bd8c-4f76-91a3-c5c5ddc91ea8 req-a3dfdd73-3e62-4d8c-bfd4-89a13b765a2c service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:32.274995 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-53e4ada5-bd8c-4f76-91a3-c5c5ddc91ea8 req-a3dfdd73-3e62-4d8c-bfd4-89a13b765a2c service nova] Creating event network-changed:61e69e8f-66c4-464b-815e-298b89835c1f for instance f9938964-5f2f-4093-b5cb-967adbe97623 on n-h2-854823-8 Oct 04 20:48:32.281314 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-53e4ada5-bd8c-4f76-91a3-c5c5ddc91ea8 req-a3dfdd73-3e62-4d8c-bfd4-89a13b765a2c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042188 Oct 04 20:48:32.282783 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1637/3366] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:48:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:48:32.291832 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-518cd3a6-6125-481f-bb90-392038860318 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Calling method '.version_select at 0x7f3c78839dc0>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:32.521540 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-212363c0-3ea7-421e-8089-0edac1748c6b tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e4b00964014a0383f79597652bd428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7f38600b5041ad8e66a12d77b940fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:32.529395 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-212363c0-3ea7-421e-8089-0edac1748c6b tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] 10.222.0.33 "GET /compute/v2.1/servers/f9938964-5f2f-4093-b5cb-967adbe97623" status: 200 len: 1368 microversion: 2.1 time: 0.554752 Oct 04 20:48:32.529977 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1730/3367] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:48:31 2022] GET /compute/v2.1/servers/f9938964-5f2f-4093-b5cb-967adbe97623 => generated 1368 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:48:32.541279 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-a7f1e163-a824-47df-8432-a5a60961e5a5 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:32.542479 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-a7f1e163-a824-47df-8432-a5a60961e5a5 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] [instance: 9df70a8d-757f-4b92-ab73-6ad6cfc98953] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:32.555567 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a7f1e163-a824-47df-8432-a5a60961e5a5 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:32.556337 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a7f1e163-a824-47df-8432-a5a60961e5a5 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:32.556974 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a7f1e163-a824-47df-8432-a5a60961e5a5 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:32.557761 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a7f1e163-a824-47df-8432-a5a60961e5a5 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:32.558198 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a7f1e163-a824-47df-8432-a5a60961e5a5 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:32.558842 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a7f1e163-a824-47df-8432-a5a60961e5a5 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:33.191745 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-a7f1e163-a824-47df-8432-a5a60961e5a5 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aca59cd50bf74a36bb1e4427cd50fbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3fadcd7d4043daa0a6aba27ba814d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:33.204519 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-a7f1e163-a824-47df-8432-a5a60961e5a5 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] 10.222.0.33 "GET /compute/v2.1/servers/9df70a8d-757f-4b92-ab73-6ad6cfc98953" status: 200 len: 1308 microversion: 2.1 time: 0.673443 Oct 04 20:48:33.206693 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1731/3368] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:48:32 2022] GET /compute/v2.1/servers/9df70a8d-757f-4b92-ab73-6ad6cfc98953 => generated 1308 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:48:33.213708 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-b305c1eb-94e5-42fa-a29a-39c3f1f10015 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:48:33.221080 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-b305c1eb-94e5-42fa-a29a-39c3f1f10015 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: ac3f41f1-ed37-4009-81e5-7bee0ee6ea69] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:33.233676 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b305c1eb-94e5-42fa-a29a-39c3f1f10015 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:33.234988 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b305c1eb-94e5-42fa-a29a-39c3f1f10015 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:33.235644 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b305c1eb-94e5-42fa-a29a-39c3f1f10015 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:33.236564 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b305c1eb-94e5-42fa-a29a-39c3f1f10015 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:33.237925 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b305c1eb-94e5-42fa-a29a-39c3f1f10015 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:33.240169 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b305c1eb-94e5-42fa-a29a-39c3f1f10015 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:33.308744 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-518cd3a6-6125-481f-bb90-392038860318 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] 10.222.0.33 "GET /compute/v2.1/os-security-groups" status: 200 len: 1158 microversion: 2.1 time: 1.023810 Oct 04 20:48:33.310723 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1638/3369] 10.222.0.33 () {58 vars in 1158 bytes} [Tue Oct 4 20:48:32 2022] GET /compute/v2.1/os-security-groups => generated 1158 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:48:33.317351 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-63f968b5-e3fa-4317-800e-60f936516672 tempest-ServerAddressesNegativeTestJSON-1549542698 tempest-ServerAddressesNegativeTestJSON-1549542698-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:33.320646 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-63f968b5-e3fa-4317-800e-60f936516672 tempest-ServerAddressesNegativeTestJSON-1549542698 tempest-ServerAddressesNegativeTestJSON-1549542698-project] [instance: 7f1a706c-5002-4d52-83ba-f25ce7771d02] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:33.332324 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-b305c1eb-94e5-42fa-a29a-39c3f1f10015 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "POST /compute/v2.1/servers/ac3f41f1-ed37-4009-81e5-7bee0ee6ea69/action" status: 200 len: 14 microversion: 2.1 time: 0.124039 Oct 04 20:48:33.333260 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1732/3370] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 20:48:33 2022] POST /compute/v2.1/servers/ac3f41f1-ed37-4009-81e5-7bee0ee6ea69/action => generated 14 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 20:48:33.336284 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-63f968b5-e3fa-4317-800e-60f936516672 tempest-ServerAddressesNegativeTestJSON-1549542698 tempest-ServerAddressesNegativeTestJSON-1549542698-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:33.337852 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-63f968b5-e3fa-4317-800e-60f936516672 tempest-ServerAddressesNegativeTestJSON-1549542698 tempest-ServerAddressesNegativeTestJSON-1549542698-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:33.338636 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-63f968b5-e3fa-4317-800e-60f936516672 tempest-ServerAddressesNegativeTestJSON-1549542698 tempest-ServerAddressesNegativeTestJSON-1549542698-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:33.339365 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-63f968b5-e3fa-4317-800e-60f936516672 tempest-ServerAddressesNegativeTestJSON-1549542698 tempest-ServerAddressesNegativeTestJSON-1549542698-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:33.339830 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-63f968b5-e3fa-4317-800e-60f936516672 tempest-ServerAddressesNegativeTestJSON-1549542698 tempest-ServerAddressesNegativeTestJSON-1549542698-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:33.340262 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-63f968b5-e3fa-4317-800e-60f936516672 tempest-ServerAddressesNegativeTestJSON-1549542698 tempest-ServerAddressesNegativeTestJSON-1549542698-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:33.342375 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-e6b5e5b4-8ff7-47d1-8667-42c853ca479d tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:33.343282 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-e6b5e5b4-8ff7-47d1-8667-42c853ca479d tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] [instance: 0f127014-9e6f-47e6-b8a5-94ca91e0836c] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:33.352386 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e6b5e5b4-8ff7-47d1-8667-42c853ca479d tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:33.353149 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e6b5e5b4-8ff7-47d1-8667-42c853ca479d tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:33.353748 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e6b5e5b4-8ff7-47d1-8667-42c853ca479d tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:33.354636 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e6b5e5b4-8ff7-47d1-8667-42c853ca479d tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:33.355247 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e6b5e5b4-8ff7-47d1-8667-42c853ca479d tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:33.355825 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e6b5e5b4-8ff7-47d1-8667-42c853ca479d tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:33.397005 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e6b5e5b4-8ff7-47d1-8667-42c853ca479d tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:33.397783 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e6b5e5b4-8ff7-47d1-8667-42c853ca479d tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:33.398400 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e6b5e5b4-8ff7-47d1-8667-42c853ca479d tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:33.399004 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.objects.instance [None req-e6b5e5b4-8ff7-47d1-8667-42c853ca479d tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lazy-loading 'fault' on Instance uuid 0f127014-9e6f-47e6-b8a5-94ca91e0836c {{(pid=128802) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:48:33.541557 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-e6b5e5b4-8ff7-47d1-8667-42c853ca479d tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87dcc7baf63f4ae6bfe0a099adffd408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7097bc12179446f6a3e1fac8434d5c64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:33.553376 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-e6b5e5b4-8ff7-47d1-8667-42c853ca479d tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] 10.222.0.33 "GET /compute/v2.1/servers/0f127014-9e6f-47e6-b8a5-94ca91e0836c" status: 200 len: 1283 microversion: 2.1 time: 0.218499 Oct 04 20:48:33.554566 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1733/3371] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:48:33 2022] GET /compute/v2.1/servers/0f127014-9e6f-47e6-b8a5-94ca91e0836c => generated 1283 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:48:33.561601 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-08de4165-403e-431b-a7f3-4c14148951ae tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Action: 'create', calling method: .version_select at 0x7f3c740c74c0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1847020395", "description": "tempest-description-1934579538"}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:48:33.737001 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-63f968b5-e3fa-4317-800e-60f936516672 tempest-ServerAddressesNegativeTestJSON-1549542698 tempest-ServerAddressesNegativeTestJSON-1549542698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0fdccf8a4c74c56bd811a0092c92bd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '031ee0beac0b4fd6b43a1030e07c82ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:33.746706 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-63f968b5-e3fa-4317-800e-60f936516672 tempest-ServerAddressesNegativeTestJSON-1549542698 tempest-ServerAddressesNegativeTestJSON-1549542698-project] 10.222.0.33 "GET /compute/v2.1/servers/7f1a706c-5002-4d52-83ba-f25ce7771d02" status: 200 len: 1522 microversion: 2.1 time: 0.434632 Oct 04 20:48:33.748000 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1639/3372] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:48:33 2022] GET /compute/v2.1/servers/7f1a706c-5002-4d52-83ba-f25ce7771d02 => generated 1522 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:48:33.753781 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-803133ef-cd4f-4a25-bea3-a6dafca6d5a4 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:33.754429 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-803133ef-cd4f-4a25-bea3-a6dafca6d5a4 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] [instance: f9938964-5f2f-4093-b5cb-967adbe97623] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:33.760221 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:48:33.762490 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-803133ef-cd4f-4a25-bea3-a6dafca6d5a4 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:33.763211 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-803133ef-cd4f-4a25-bea3-a6dafca6d5a4 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:33.763811 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-803133ef-cd4f-4a25-bea3-a6dafca6d5a4 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:33.764934 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-803133ef-cd4f-4a25-bea3-a6dafca6d5a4 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:33.765601 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-803133ef-cd4f-4a25-bea3-a6dafca6d5a4 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:33.766260 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-803133ef-cd4f-4a25-bea3-a6dafca6d5a4 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:33.901351 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-08de4165-403e-431b-a7f3-4c14148951ae tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] 10.222.0.33 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.345267 Oct 04 20:48:33.902476 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1734/3373] 10.222.0.33 () {60 vars in 1180 bytes} [Tue Oct 4 20:48:33 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:48:33.907593 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-31553085-06ab-420f-b5c9-86ca765f1037 tempest-ServerAddressesNegativeTestJSON-1549542698 tempest-ServerAddressesNegativeTestJSON-1549542698-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:33.910722 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-31553085-06ab-420f-b5c9-86ca765f1037 tempest-ServerAddressesNegativeTestJSON-1549542698 tempest-ServerAddressesNegativeTestJSON-1549542698-project] [instance: 7f1a706c-5002-4d52-83ba-f25ce7771d02] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:33.925924 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-31553085-06ab-420f-b5c9-86ca765f1037 tempest-ServerAddressesNegativeTestJSON-1549542698 tempest-ServerAddressesNegativeTestJSON-1549542698-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:33.927531 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-31553085-06ab-420f-b5c9-86ca765f1037 tempest-ServerAddressesNegativeTestJSON-1549542698 tempest-ServerAddressesNegativeTestJSON-1549542698-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:33.928066 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-31553085-06ab-420f-b5c9-86ca765f1037 tempest-ServerAddressesNegativeTestJSON-1549542698 tempest-ServerAddressesNegativeTestJSON-1549542698-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:33.928911 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-31553085-06ab-420f-b5c9-86ca765f1037 tempest-ServerAddressesNegativeTestJSON-1549542698 tempest-ServerAddressesNegativeTestJSON-1549542698-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:33.929912 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-31553085-06ab-420f-b5c9-86ca765f1037 tempest-ServerAddressesNegativeTestJSON-1549542698 tempest-ServerAddressesNegativeTestJSON-1549542698-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:33.930465 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-31553085-06ab-420f-b5c9-86ca765f1037 tempest-ServerAddressesNegativeTestJSON-1549542698 tempest-ServerAddressesNegativeTestJSON-1549542698-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:33.966915 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-803133ef-cd4f-4a25-bea3-a6dafca6d5a4 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e4b00964014a0383f79597652bd428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7f38600b5041ad8e66a12d77b940fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:33.978773 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.wsgi [None req-31553085-06ab-420f-b5c9-86ca765f1037 tempest-ServerAddressesNegativeTestJSON-1549542698 tempest-ServerAddressesNegativeTestJSON-1549542698-project] HTTP exception thrown: Instance is not a member of specified network Oct 04 20:48:33.979324 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-803133ef-cd4f-4a25-bea3-a6dafca6d5a4 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] 10.222.0.33 "GET /compute/v2.1/servers/f9938964-5f2f-4093-b5cb-967adbe97623" status: 200 len: 1368 microversion: 2.1 time: 0.229644 Oct 04 20:48:33.983299 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1640/3374] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:48:33 2022] GET /compute/v2.1/servers/f9938964-5f2f-4093-b5cb-967adbe97623 => generated 1368 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:48:33.987388 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-31553085-06ab-420f-b5c9-86ca765f1037 tempest-ServerAddressesNegativeTestJSON-1549542698 tempest-ServerAddressesNegativeTestJSON-1549542698-project] Request method failure captured: Oct 04 20:48:33.987388 n-d-854823-8 devstack@n-api.service[128802]: request: GET /compute/v2.1/servers/7f1a706c-5002-4d52-83ba-f25ce7771d02/ips/invalid HTTP/1.1 Oct 04 20:48:33.987388 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 20:48:33.987388 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 20:48:33.987388 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 20:48:33.987388 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 0 Oct 04 20:48:33.987388 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 20:48:33.987388 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 20:48:33.987388 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 20:48:33.987388 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 20:48:33.987388 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPJwJ-llCU7dgvJRbGvm2EnOabeEpCcfrF5kvj4mCkqhNcwR3fllpmEZDjJF3H5TfaUcyZVDWdvQ2tULcbATsNxhAM7C03Tlrdlkt9Af0_HW9G58ApK3J9iVCpvee3NaQybQ-NdR3DVuadhD7A5K1n_M4ZAVnV0TbS2LtsWW4g5NK23Q Oct 04 20:48:33.987388 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 20:48:33.987388 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 20:48:33.987388 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 20:48:33.987388 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 20:48:33.987388 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 20:48:33.987388 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 20:48:33.987388 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: 031ee0beac0b4fd6b43a1030e07c82ea Oct 04 20:48:33.987388 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1549542698 Oct 04 20:48:33.987388 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 20:48:33.987388 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 20:48:33.987388 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_031ee0beac0b4fd6b43a1030e07c82ea", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/031ee0beac0b4fd6b43a1030e07c82ea"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/031ee0beac0b4fd6b43a1030e07c82ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/031ee0beac0b4fd6b43a1030e07c82ea"}]}] Oct 04 20:48:33.987388 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1549542698 Oct 04 20:48:33.987388 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: 031ee0beac0b4fd6b43a1030e07c82ea Oct 04 20:48:33.987388 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1549542698 Oct 04 20:48:33.987388 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-ServerAddressesNegativeTestJSON-1549542698-project Oct 04 20:48:33.987388 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 20:48:33.987388 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 20:48:33.987388 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: b0fdccf8a4c74c56bd811a0092c92bd5 Oct 04 20:48:33.987388 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1549542698-project Oct 04 20:48:33.987388 n-d-854823-8 devstack@n-api.service[128802]: method: > Oct 04 20:48:33.987388 n-d-854823-8 devstack@n-api.service[128802]: exception: Instance is not a member of specified network Oct 04 20:48:33.987388 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'server_id': '7f1a706c-5002-4d52-83ba-f25ce7771d02', 'id': 'invalid'} Oct 04 20:48:33.987388 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:48:33.987388 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:48:33.987388 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:48:33.987388 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:48:33.987388 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:48:33.987388 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:48:33.987388 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:48:33.987388 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:48:33.987388 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 52, in show Oct 04 20:48:33.987388 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 04 20:48:33.987388 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance is not a member of specified network Oct 04 20:48:33.987388 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:48:33.987388 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:48:33.987388 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:48:33.987388 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:48:33.987388 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:48:33.987388 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:48:33.987388 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:48:33.987388 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:48:33.987388 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance is not a member of specified network Oct 04 20:48:33.987388 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:48:33.991871 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-31553085-06ab-420f-b5c9-86ca765f1037 tempest-ServerAddressesNegativeTestJSON-1549542698 tempest-ServerAddressesNegativeTestJSON-1549542698-project] Returning 404 to user: Instance is not a member of specified network {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:48:33.992716 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-31553085-06ab-420f-b5c9-86ca765f1037 tempest-ServerAddressesNegativeTestJSON-1549542698 tempest-ServerAddressesNegativeTestJSON-1549542698-project] 10.222.0.33 "GET /compute/v2.1/servers/7f1a706c-5002-4d52-83ba-f25ce7771d02/ips/invalid" status: 404 len: 91 microversion: 2.1 time: 0.089221 Oct 04 20:48:33.993622 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1735/3375] 10.222.0.33 () {58 vars in 1272 bytes} [Tue Oct 4 20:48:33 2022] GET /compute/v2.1/servers/7f1a706c-5002-4d52-83ba-f25ce7771d02/ips/invalid => generated 91 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 20:48:33.997223 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-dcaf0769-be6d-46a7-affc-eb45e6f162f6 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Action: 'create', calling method: .version_select at 0x7f3c742f5e50>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-140840780", "description": "tempest-description-1726175962"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:48:34.007608 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-6b8bd7ad-f393-4ec2-8e1e-242aa7f6175c tempest-ServerAddressesNegativeTestJSON-1549542698 tempest-ServerAddressesNegativeTestJSON-1549542698-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:34.008248 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-6b8bd7ad-f393-4ec2-8e1e-242aa7f6175c tempest-ServerAddressesNegativeTestJSON-1549542698 tempest-ServerAddressesNegativeTestJSON-1549542698-project] Failed to fetch instance by id 999 {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 04 20:48:34.009849 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.wsgi [None req-6b8bd7ad-f393-4ec2-8e1e-242aa7f6175c tempest-ServerAddressesNegativeTestJSON-1549542698 tempest-ServerAddressesNegativeTestJSON-1549542698-project] HTTP exception thrown: Instance 999 could not be found. Oct 04 20:48:34.011907 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-6b8bd7ad-f393-4ec2-8e1e-242aa7f6175c tempest-ServerAddressesNegativeTestJSON-1549542698 tempest-ServerAddressesNegativeTestJSON-1549542698-project] Request method failure captured: Oct 04 20:48:34.011907 n-d-854823-8 devstack@n-api.service[128802]: request: GET /compute/v2.1/servers/999/ips HTTP/1.1 Oct 04 20:48:34.011907 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 20:48:34.011907 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 20:48:34.011907 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 20:48:34.011907 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 0 Oct 04 20:48:34.011907 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 20:48:34.011907 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 20:48:34.011907 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 20:48:34.011907 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 20:48:34.011907 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPJwJ-llCU7dgvJRbGvm2EnOabeEpCcfrF5kvj4mCkqhNcwR3fllpmEZDjJF3H5TfaUcyZVDWdvQ2tULcbATsNxhAM7C03Tlrdlkt9Af0_HW9G58ApK3J9iVCpvee3NaQybQ-NdR3DVuadhD7A5K1n_M4ZAVnV0TbS2LtsWW4g5NK23Q Oct 04 20:48:34.011907 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 20:48:34.011907 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 20:48:34.011907 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 20:48:34.011907 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 20:48:34.011907 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 20:48:34.011907 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 20:48:34.011907 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: 031ee0beac0b4fd6b43a1030e07c82ea Oct 04 20:48:34.011907 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1549542698 Oct 04 20:48:34.011907 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 20:48:34.011907 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 20:48:34.011907 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_031ee0beac0b4fd6b43a1030e07c82ea", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/031ee0beac0b4fd6b43a1030e07c82ea"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/031ee0beac0b4fd6b43a1030e07c82ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/031ee0beac0b4fd6b43a1030e07c82ea"}]}] Oct 04 20:48:34.011907 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1549542698 Oct 04 20:48:34.011907 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: 031ee0beac0b4fd6b43a1030e07c82ea Oct 04 20:48:34.011907 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1549542698 Oct 04 20:48:34.011907 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-ServerAddressesNegativeTestJSON-1549542698-project Oct 04 20:48:34.011907 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 20:48:34.011907 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 20:48:34.011907 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: b0fdccf8a4c74c56bd811a0092c92bd5 Oct 04 20:48:34.011907 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1549542698-project Oct 04 20:48:34.011907 n-d-854823-8 devstack@n-api.service[128802]: method: > Oct 04 20:48:34.011907 n-d-854823-8 devstack@n-api.service[128802]: exception: Instance 999 could not be found. Oct 04 20:48:34.011907 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'server_id': '999'} Oct 04 20:48:34.011907 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:48:34.011907 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:48:34.011907 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:48:34.011907 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:48:34.011907 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 04 20:48:34.011907 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 04 20:48:34.011907 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Oct 04 20:48:34.011907 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:48:34.011907 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:48:34.011907 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:48:34.011907 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:48:34.011907 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:48:34.011907 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:48:34.011907 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:48:34.011907 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:48:34.011907 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:48:34.011907 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:48:34.011907 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 37, in index Oct 04 20:48:34.011907 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self._compute_api, context, server_id) Oct 04 20:48:34.011907 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:48:34.011907 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:48:34.011907 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Oct 04 20:48:34.011907 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:48:34.011907 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:48:34.011907 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:48:34.011907 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:48:34.011907 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:48:34.011907 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:48:34.011907 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:48:34.011907 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:48:34.011907 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Oct 04 20:48:34.011907 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:48:34.018762 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-6b8bd7ad-f393-4ec2-8e1e-242aa7f6175c tempest-ServerAddressesNegativeTestJSON-1549542698 tempest-ServerAddressesNegativeTestJSON-1549542698-project] Returning 404 to user: Instance 999 could not be found. {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:48:34.018762 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-6b8bd7ad-f393-4ec2-8e1e-242aa7f6175c tempest-ServerAddressesNegativeTestJSON-1549542698 tempest-ServerAddressesNegativeTestJSON-1549542698-project] 10.222.0.33 "GET /compute/v2.1/servers/999/ips" status: 404 len: 78 microversion: 2.1 time: 0.016524 Oct 04 20:48:34.018963 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1736/3376] 10.222.0.33 () {58 vars in 1149 bytes} [Tue Oct 4 20:48:33 2022] GET /compute/v2.1/servers/999/ips => generated 78 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 20:48:34.031123 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-0c783d5f-8cc5-4869-acb4-217151a24cbc tempest-ServerAddressesNegativeTestJSON-1549542698 tempest-ServerAddressesNegativeTestJSON-1549542698-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:34.031724 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-0c783d5f-8cc5-4869-acb4-217151a24cbc tempest-ServerAddressesNegativeTestJSON-1549542698 tempest-ServerAddressesNegativeTestJSON-1549542698-project] [instance: 7f1a706c-5002-4d52-83ba-f25ce7771d02] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:34.047724 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0c783d5f-8cc5-4869-acb4-217151a24cbc tempest-ServerAddressesNegativeTestJSON-1549542698 tempest-ServerAddressesNegativeTestJSON-1549542698-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:34.048544 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0c783d5f-8cc5-4869-acb4-217151a24cbc tempest-ServerAddressesNegativeTestJSON-1549542698 tempest-ServerAddressesNegativeTestJSON-1549542698-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:34.049448 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0c783d5f-8cc5-4869-acb4-217151a24cbc tempest-ServerAddressesNegativeTestJSON-1549542698 tempest-ServerAddressesNegativeTestJSON-1549542698-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:34.050618 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0c783d5f-8cc5-4869-acb4-217151a24cbc tempest-ServerAddressesNegativeTestJSON-1549542698 tempest-ServerAddressesNegativeTestJSON-1549542698-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:34.051560 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0c783d5f-8cc5-4869-acb4-217151a24cbc tempest-ServerAddressesNegativeTestJSON-1549542698 tempest-ServerAddressesNegativeTestJSON-1549542698-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:34.052160 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0c783d5f-8cc5-4869-acb4-217151a24cbc tempest-ServerAddressesNegativeTestJSON-1549542698 tempest-ServerAddressesNegativeTestJSON-1549542698-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:34.134399 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-0c783d5f-8cc5-4869-acb4-217151a24cbc tempest-ServerAddressesNegativeTestJSON-1549542698 tempest-ServerAddressesNegativeTestJSON-1549542698-project] [instance: 7f1a706c-5002-4d52-83ba-f25ce7771d02] Going to try to terminate instance {{(pid=128802) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:48:34.215598 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-dcaf0769-be6d-46a7-affc-eb45e6f162f6 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] 10.222.0.33 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.230700 Oct 04 20:48:34.216551 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1641/3377] 10.222.0.33 () {60 vars in 1180 bytes} [Tue Oct 4 20:48:33 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:48:34.223510 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8ca70a63-98b1-48f0-8c2c-637b0dd8b452 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1187286079", "imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63", "flavorRef": "452", "networks": [{"uuid": "5fa2c404-9fc1-4689-8f6f-05eb442252a3"}], "security_groups": [{"name": "tempest-securitygroup--1551602765"}], "key_name": "tempest-keypair-442592501", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:48:34.275874 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:48:34.335941 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=6 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:48:34.351622 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-0c783d5f-8cc5-4869-acb4-217151a24cbc tempest-ServerAddressesNegativeTestJSON-1549542698 tempest-ServerAddressesNegativeTestJSON-1549542698-project] 10.222.0.33 "DELETE /compute/v2.1/servers/7f1a706c-5002-4d52-83ba-f25ce7771d02" status: 204 len: 0 microversion: 2.1 time: 0.325614 Oct 04 20:48:34.352552 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1737/3378] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 20:48:34 2022] DELETE /compute/v2.1/servers/7f1a706c-5002-4d52-83ba-f25ce7771d02 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:48:34.358603 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-0b5c3b6a-2c79-4c33-9cfd-518b0c153ce9 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:34.359333 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-0b5c3b6a-2c79-4c33-9cfd-518b0c153ce9 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] [instance: 9df70a8d-757f-4b92-ab73-6ad6cfc98953] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:34.365804 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0b5c3b6a-2c79-4c33-9cfd-518b0c153ce9 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:34.366566 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0b5c3b6a-2c79-4c33-9cfd-518b0c153ce9 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:34.367027 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0b5c3b6a-2c79-4c33-9cfd-518b0c153ce9 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:34.368464 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0b5c3b6a-2c79-4c33-9cfd-518b0c153ce9 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:34.370506 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0b5c3b6a-2c79-4c33-9cfd-518b0c153ce9 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:34.371246 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0b5c3b6a-2c79-4c33-9cfd-518b0c153ce9 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:34.375855 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=22 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:48:34.488447 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.network.neutron [None req-8ca70a63-98b1-48f0-8c2c-637b0dd8b452 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] validate_networks() for [('5fa2c404-9fc1-4689-8f6f-05eb442252a3', None, None, None, None, None)] {{(pid=128801) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:48:34.768592 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-0b5c3b6a-2c79-4c33-9cfd-518b0c153ce9 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aca59cd50bf74a36bb1e4427cd50fbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3fadcd7d4043daa0a6aba27ba814d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:34.781926 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-0b5c3b6a-2c79-4c33-9cfd-518b0c153ce9 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] 10.222.0.33 "GET /compute/v2.1/servers/9df70a8d-757f-4b92-ab73-6ad6cfc98953" status: 200 len: 1308 microversion: 2.1 time: 0.428071 Oct 04 20:48:34.798474 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1738/3379] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:48:34 2022] GET /compute/v2.1/servers/9df70a8d-757f-4b92-ab73-6ad6cfc98953 => generated 1308 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:48:34.804714 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-7a417158-d6f1-423e-8969-1fa4a83ac08c req-8c2a29c3-c67c-4ee8-999c-aa8f7c8a3f34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f127014-9e6f-47e6-b8a5-94ca91e0836c", "name": "network-vif-deleted", "tag": "41cf3ea7-346f-4732-8f44-216a5cd39ef1"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:48:34.816095 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=1,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:48:34.821653 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-7a417158-d6f1-423e-8969-1fa4a83ac08c req-8c2a29c3-c67c-4ee8-999c-aa8f7c8a3f34 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:34.822212 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-7a417158-d6f1-423e-8969-1fa4a83ac08c req-8c2a29c3-c67c-4ee8-999c-aa8f7c8a3f34 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:34.822692 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-7a417158-d6f1-423e-8969-1fa4a83ac08c req-8c2a29c3-c67c-4ee8-999c-aa8f7c8a3f34 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:34.849635 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-7a417158-d6f1-423e-8969-1fa4a83ac08c req-8c2a29c3-c67c-4ee8-999c-aa8f7c8a3f34 service nova] Creating event network-vif-deleted:41cf3ea7-346f-4732-8f44-216a5cd39ef1 for instance 0f127014-9e6f-47e6-b8a5-94ca91e0836c on n-h1-854823-8 Oct 04 20:48:34.857448 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-7a417158-d6f1-423e-8969-1fa4a83ac08c req-8c2a29c3-c67c-4ee8-999c-aa8f7c8a3f34 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057225 Oct 04 20:48:34.868196 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1739/3380] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:48:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:48:34.875662 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-d2bca067-e62e-4fea-be7c-d22d56518c3c tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:48:34.878403 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-d2bca067-e62e-4fea-be7c-d22d56518c3c tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: ac3f41f1-ed37-4009-81e5-7bee0ee6ea69] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:34.884725 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d2bca067-e62e-4fea-be7c-d22d56518c3c tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:34.885228 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d2bca067-e62e-4fea-be7c-d22d56518c3c tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:34.885668 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d2bca067-e62e-4fea-be7c-d22d56518c3c tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:34.886406 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d2bca067-e62e-4fea-be7c-d22d56518c3c tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:34.886870 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d2bca067-e62e-4fea-be7c-d22d56518c3c tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:34.887292 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d2bca067-e62e-4fea-be7c-d22d56518c3c tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:34.972280 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-d2bca067-e62e-4fea-be7c-d22d56518c3c tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "POST /compute/v2.1/servers/ac3f41f1-ed37-4009-81e5-7bee0ee6ea69/action" status: 200 len: 16395 microversion: 2.1 time: 0.100163 Oct 04 20:48:34.979696 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1740/3381] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 20:48:34 2022] POST /compute/v2.1/servers/ac3f41f1-ed37-4009-81e5-7bee0ee6ea69/action => generated 16395 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 20:48:34.989718 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-5639a3ba-82de-4cdd-b9bb-5ff3188c538e tempest-ServerAddressesNegativeTestJSON-1549542698 tempest-ServerAddressesNegativeTestJSON-1549542698-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:34.990915 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-5639a3ba-82de-4cdd-b9bb-5ff3188c538e tempest-ServerAddressesNegativeTestJSON-1549542698 tempest-ServerAddressesNegativeTestJSON-1549542698-project] [instance: 7f1a706c-5002-4d52-83ba-f25ce7771d02] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:35.008695 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5639a3ba-82de-4cdd-b9bb-5ff3188c538e tempest-ServerAddressesNegativeTestJSON-1549542698 tempest-ServerAddressesNegativeTestJSON-1549542698-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:35.009612 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5639a3ba-82de-4cdd-b9bb-5ff3188c538e tempest-ServerAddressesNegativeTestJSON-1549542698 tempest-ServerAddressesNegativeTestJSON-1549542698-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:35.010294 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5639a3ba-82de-4cdd-b9bb-5ff3188c538e tempest-ServerAddressesNegativeTestJSON-1549542698 tempest-ServerAddressesNegativeTestJSON-1549542698-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:35.011342 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5639a3ba-82de-4cdd-b9bb-5ff3188c538e tempest-ServerAddressesNegativeTestJSON-1549542698 tempest-ServerAddressesNegativeTestJSON-1549542698-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:35.012022 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5639a3ba-82de-4cdd-b9bb-5ff3188c538e tempest-ServerAddressesNegativeTestJSON-1549542698 tempest-ServerAddressesNegativeTestJSON-1549542698-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:35.012680 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5639a3ba-82de-4cdd-b9bb-5ff3188c538e tempest-ServerAddressesNegativeTestJSON-1549542698 tempest-ServerAddressesNegativeTestJSON-1549542698-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:35.759192 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-5639a3ba-82de-4cdd-b9bb-5ff3188c538e tempest-ServerAddressesNegativeTestJSON-1549542698 tempest-ServerAddressesNegativeTestJSON-1549542698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0fdccf8a4c74c56bd811a0092c92bd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '031ee0beac0b4fd6b43a1030e07c82ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:35.768458 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-5639a3ba-82de-4cdd-b9bb-5ff3188c538e tempest-ServerAddressesNegativeTestJSON-1549542698 tempest-ServerAddressesNegativeTestJSON-1549542698-project] 10.222.0.33 "GET /compute/v2.1/servers/7f1a706c-5002-4d52-83ba-f25ce7771d02" status: 200 len: 1528 microversion: 2.1 time: 0.786286 Oct 04 20:48:35.769427 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1741/3382] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:48:34 2022] GET /compute/v2.1/servers/7f1a706c-5002-4d52-83ba-f25ce7771d02 => generated 1528 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:48:35.774209 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-86d72885-0d72-496c-aff2-afa9218718f1 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-2049448623", "imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63", "flavorRef": "452", "networks": [{"uuid": "d4324694-bd7d-4530-9426-16b84e542880"}]}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:48:35.839093 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.network.neutron [None req-86d72885-0d72-496c-aff2-afa9218718f1 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] validate_networks() for [('d4324694-bd7d-4530-9426-16b84e542880', None, None, None, None, None)] {{(pid=128802) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:48:36.209509 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-8ca70a63-98b1-48f0-8c2c-637b0dd8b452 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Flavor limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:48:36.211686 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-8ca70a63-98b1-48f0-8c2c-637b0dd8b452 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Image limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:48:36.212414 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-8ca70a63-98b1-48f0-8c2c-637b0dd8b452 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Flavor pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:48:36.213087 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-8ca70a63-98b1-48f0-8c2c-637b0dd8b452 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Image pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:48:36.213730 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-8ca70a63-98b1-48f0-8c2c-637b0dd8b452 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:48:36.238766 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8ca70a63-98b1-48f0-8c2c-637b0dd8b452 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:36.239637 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8ca70a63-98b1-48f0-8c2c-637b0dd8b452 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:36.241073 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8ca70a63-98b1-48f0-8c2c-637b0dd8b452 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:36.242114 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8ca70a63-98b1-48f0-8c2c-637b0dd8b452 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:36.243021 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8ca70a63-98b1-48f0-8c2c-637b0dd8b452 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:36.243677 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8ca70a63-98b1-48f0-8c2c-637b0dd8b452 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:36.292094 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-8ca70a63-98b1-48f0-8c2c-637b0dd8b452 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Getting quotas for project 09101effe9da463dabc2edaccdb83e06. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:48:36.306256 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-8ca70a63-98b1-48f0-8c2c-637b0dd8b452 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Getting quotas for user e8397c96a6dd4c65bdde07c91ca5e7fa and project 09101effe9da463dabc2edaccdb83e06. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:48:36.323948 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-8ca70a63-98b1-48f0-8c2c-637b0dd8b452 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Going to run 1 instances... {{(pid=128801) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:48:36.328101 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-8ca70a63-98b1-48f0-8c2c-637b0dd8b452 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] [instance: 9261e0b2-35ac-40f4-92d5-3b9ffaea23c4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='15b24725-0c99-4bcf-b1fb-907cdf8e2d63',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128801) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:48:36.434048 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-8ca70a63-98b1-48f0-8c2c-637b0dd8b452 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.215842 Oct 04 20:48:36.436797 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1642/3383] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 20:48:34 2022] POST /compute/v2.1/servers => generated 406 bytes in 2219 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 20:48:36.443182 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-604647c0-ce8d-479c-942b-e205b9b0ec56 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:36.444695 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-604647c0-ce8d-479c-942b-e205b9b0ec56 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] [instance: 0f127014-9e6f-47e6-b8a5-94ca91e0836c] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:36.458003 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-604647c0-ce8d-479c-942b-e205b9b0ec56 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:36.459042 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-604647c0-ce8d-479c-942b-e205b9b0ec56 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:36.459716 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-604647c0-ce8d-479c-942b-e205b9b0ec56 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:36.463523 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-604647c0-ce8d-479c-942b-e205b9b0ec56 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:36.464782 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-604647c0-ce8d-479c-942b-e205b9b0ec56 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:36.465296 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-604647c0-ce8d-479c-942b-e205b9b0ec56 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:36.513655 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-604647c0-ce8d-479c-942b-e205b9b0ec56 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] HTTP exception thrown: Instance 0f127014-9e6f-47e6-b8a5-94ca91e0836c could not be found. Oct 04 20:48:36.526583 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-604647c0-ce8d-479c-942b-e205b9b0ec56 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Request method failure captured: Oct 04 20:48:36.526583 n-d-854823-8 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/0f127014-9e6f-47e6-b8a5-94ca91e0836c HTTP/1.1 Oct 04 20:48:36.526583 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:48:36.526583 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:48:36.526583 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:48:36.526583 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 0 Oct 04 20:48:36.526583 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:48:36.526583 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:48:36.526583 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:48:36.526583 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:48:36.526583 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJsSwF2ySar2LJQGdSe43g0QAYtjP4_BPyLRwM7Cr4_8Oz_X-RTScy1BL0ogt-qe3YNvQGTaYbVbGoUGx7pHqiHpbZftU7_TcvDA_zpgTfxGGH91CR74RG6crXL2bxRs87dSvsLYuOWMw7_AQjTpWetc1HBlb5th2rD-ko2SN3gLGSA Oct 04 20:48:36.526583 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:48:36.526583 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:48:36.526583 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:48:36.526583 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:48:36.526583 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:48:36.526583 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:48:36.526583 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: 7097bc12179446f6a3e1fac8434d5c64 Oct 04 20:48:36.526583 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-ServersTestJSON-927611194 Oct 04 20:48:36.526583 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 20:48:36.526583 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 20:48:36.526583 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_7097bc12179446f6a3e1fac8434d5c64", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7097bc12179446f6a3e1fac8434d5c64"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7097bc12179446f6a3e1fac8434d5c64"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/7097bc12179446f6a3e1fac8434d5c64"}]}] Oct 04 20:48:36.526583 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-ServersTestJSON-927611194 Oct 04 20:48:36.526583 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: 7097bc12179446f6a3e1fac8434d5c64 Oct 04 20:48:36.526583 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ServersTestJSON-927611194 Oct 04 20:48:36.526583 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-ServersTestJSON-927611194-project Oct 04 20:48:36.526583 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:48:36.526583 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:48:36.526583 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: 87dcc7baf63f4ae6bfe0a099adffd408 Oct 04 20:48:36.526583 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-ServersTestJSON-927611194-project Oct 04 20:48:36.526583 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 20:48:36.526583 n-d-854823-8 devstack@n-api.service[128801]: exception: Instance 0f127014-9e6f-47e6-b8a5-94ca91e0836c could not be found. Oct 04 20:48:36.526583 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': '0f127014-9e6f-47e6-b8a5-94ca91e0836c'} Oct 04 20:48:36.526583 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:48:36.526583 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:48:36.526583 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:48:36.526583 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:48:36.526583 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:48:36.526583 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:48:36.526583 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:48:36.526583 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:48:36.526583 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:48:36.526583 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:48:36.526583 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f127014-9e6f-47e6-b8a5-94ca91e0836c could not be found. Oct 04 20:48:36.526583 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:48:36.526583 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:48:36.526583 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:48:36.526583 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:48:36.526583 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:48:36.526583 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:48:36.526583 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:48:36.526583 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:48:36.526583 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:48:36.526583 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:48:36.526583 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:48:36.526583 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:48:36.526583 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:48:36.526583 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:48:36.526583 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:48:36.526583 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:48:36.526583 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f127014-9e6f-47e6-b8a5-94ca91e0836c could not be found. Oct 04 20:48:36.526583 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:48:36.526583 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:48:36.526583 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:48:36.526583 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:48:36.530779 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:48:36.530779 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:48:36.530779 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:48:36.530779 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:48:36.530779 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f127014-9e6f-47e6-b8a5-94ca91e0836c could not be found. Oct 04 20:48:36.530779 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:48:36.530779 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-604647c0-ce8d-479c-942b-e205b9b0ec56 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] Returning 404 to user: Instance 0f127014-9e6f-47e6-b8a5-94ca91e0836c could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:48:36.530779 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-604647c0-ce8d-479c-942b-e205b9b0ec56 tempest-ServersTestJSON-927611194 tempest-ServersTestJSON-927611194-project] 10.222.0.33 "GET /compute/v2.1/servers/0f127014-9e6f-47e6-b8a5-94ca91e0836c" status: 404 len: 111 microversion: 2.1 time: 0.090482 Oct 04 20:48:36.535179 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1643/3384] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:48:36 2022] GET /compute/v2.1/servers/0f127014-9e6f-47e6-b8a5-94ca91e0836c => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:48:36.541578 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5c8b0dcc-3dcd-46a1-af7d-8b8337bd8431 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:36.542207 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-5c8b0dcc-3dcd-46a1-af7d-8b8337bd8431 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: 4d46fff2-b04d-41aa-ada0-2023ab545b48] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:36.560359 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5c8b0dcc-3dcd-46a1-af7d-8b8337bd8431 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:36.560863 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5c8b0dcc-3dcd-46a1-af7d-8b8337bd8431 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:36.561294 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5c8b0dcc-3dcd-46a1-af7d-8b8337bd8431 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:36.570977 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5c8b0dcc-3dcd-46a1-af7d-8b8337bd8431 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:36.571713 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5c8b0dcc-3dcd-46a1-af7d-8b8337bd8431 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:36.572891 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5c8b0dcc-3dcd-46a1-af7d-8b8337bd8431 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:37.367145 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-5c8b0dcc-3dcd-46a1-af7d-8b8337bd8431 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac650232cc04810b1340dc2f0edadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b0670d1bd99424780a70e69d57a2166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:37.383496 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5c8b0dcc-3dcd-46a1-af7d-8b8337bd8431 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48" status: 200 len: 1669 microversion: 2.1 time: 0.842042 Oct 04 20:48:37.394367 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1644/3385] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:48:36 2022] GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48 => generated 1669 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:48:37.406427 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-86c347a9-1537-408d-a647-05d6bef34d2d tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:37.406427 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-86c347a9-1537-408d-a647-05d6bef34d2d tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] [instance: f9938964-5f2f-4093-b5cb-967adbe97623] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:37.407142 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-86c347a9-1537-408d-a647-05d6bef34d2d tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:37.407818 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-86c347a9-1537-408d-a647-05d6bef34d2d tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:37.409230 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-86c347a9-1537-408d-a647-05d6bef34d2d tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:37.414209 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-86c347a9-1537-408d-a647-05d6bef34d2d tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:37.414923 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-86c347a9-1537-408d-a647-05d6bef34d2d tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:37.415548 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-86c347a9-1537-408d-a647-05d6bef34d2d tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:38.071890 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-86c347a9-1537-408d-a647-05d6bef34d2d tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e4b00964014a0383f79597652bd428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7f38600b5041ad8e66a12d77b940fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:38.102071 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-86c347a9-1537-408d-a647-05d6bef34d2d tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] 10.222.0.33 "GET /compute/v2.1/servers/f9938964-5f2f-4093-b5cb-967adbe97623" status: 200 len: 1368 microversion: 2.1 time: 0.716439 Oct 04 20:48:38.108349 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1645/3386] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:48:37 2022] GET /compute/v2.1/servers/f9938964-5f2f-4093-b5cb-967adbe97623 => generated 1368 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:48:38.123622 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8e57ffdb-6130-44c8-9ead-4acd40de6d92 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:38.124603 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-8e57ffdb-6130-44c8-9ead-4acd40de6d92 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] [instance: 9df70a8d-757f-4b92-ab73-6ad6cfc98953] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:38.148617 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8e57ffdb-6130-44c8-9ead-4acd40de6d92 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:38.150269 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8e57ffdb-6130-44c8-9ead-4acd40de6d92 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:38.151397 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8e57ffdb-6130-44c8-9ead-4acd40de6d92 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:38.154987 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8e57ffdb-6130-44c8-9ead-4acd40de6d92 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:38.155715 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8e57ffdb-6130-44c8-9ead-4acd40de6d92 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:38.157198 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8e57ffdb-6130-44c8-9ead-4acd40de6d92 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:38.193907 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-86d72885-0d72-496c-aff2-afa9218718f1 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Flavor limits 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:48:38.194467 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-86d72885-0d72-496c-aff2-afa9218718f1 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Image limits 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:48:38.195940 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-86d72885-0d72-496c-aff2-afa9218718f1 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Flavor pref 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:48:38.196489 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-86d72885-0d72-496c-aff2-afa9218718f1 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Image pref 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:48:38.196816 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-86d72885-0d72-496c-aff2-afa9218718f1 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:48:38.226093 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-86d72885-0d72-496c-aff2-afa9218718f1 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:38.226650 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-86d72885-0d72-496c-aff2-afa9218718f1 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:38.227099 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-86d72885-0d72-496c-aff2-afa9218718f1 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:38.230208 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-86d72885-0d72-496c-aff2-afa9218718f1 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:38.232619 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-86d72885-0d72-496c-aff2-afa9218718f1 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:38.233298 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-86d72885-0d72-496c-aff2-afa9218718f1 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:38.278377 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-86d72885-0d72-496c-aff2-afa9218718f1 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Getting quotas for project 5338cf2146344042bc263bdc4f9d822b. Resources: {'ram', 'instances', 'cores'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:48:38.300277 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-86d72885-0d72-496c-aff2-afa9218718f1 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Getting quotas for user 6775b9d82b3444f6b728736f1d2b2806 and project 5338cf2146344042bc263bdc4f9d822b. Resources: {'ram', 'instances', 'cores'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:48:38.317567 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-86d72885-0d72-496c-aff2-afa9218718f1 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Going to run 1 instances... {{(pid=128802) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:48:38.320428 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-86d72885-0d72-496c-aff2-afa9218718f1 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] [instance: 8526b237-847c-47b7-9f0b-8209c9a07b95] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='15b24725-0c99-4bcf-b1fb-907cdf8e2d63',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128802) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:48:38.428277 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-86d72885-0d72-496c-aff2-afa9218718f1 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.657871 Oct 04 20:48:38.429674 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1742/3387] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 20:48:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 2660 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 20:48:38.436837 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-cd2b1748-960f-407a-891c-c9abbf447d61 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:38.437008 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-cd2b1748-960f-407a-891c-c9abbf447d61 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] [instance: 9261e0b2-35ac-40f4-92d5-3b9ffaea23c4] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:38.445676 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cd2b1748-960f-407a-891c-c9abbf447d61 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:38.446951 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cd2b1748-960f-407a-891c-c9abbf447d61 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:38.448274 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cd2b1748-960f-407a-891c-c9abbf447d61 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:38.449296 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cd2b1748-960f-407a-891c-c9abbf447d61 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:38.450314 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cd2b1748-960f-407a-891c-c9abbf447d61 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:38.450964 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cd2b1748-960f-407a-891c-c9abbf447d61 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:38.889660 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-cd2b1748-960f-407a-891c-c9abbf447d61 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8397c96a6dd4c65bdde07c91ca5e7fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09101effe9da463dabc2edaccdb83e06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:38.901862 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-cd2b1748-960f-407a-891c-c9abbf447d61 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] 10.222.0.33 "GET /compute/v2.1/servers/9261e0b2-35ac-40f4-92d5-3b9ffaea23c4" status: 200 len: 1293 microversion: 2.1 time: 0.470903 Oct 04 20:48:38.921660 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1743/3388] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:48:38 2022] GET /compute/v2.1/servers/9261e0b2-35ac-40f4-92d5-3b9ffaea23c4 => generated 1293 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:48:38.930967 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-45f3bc48-bc9a-4782-b591-86ec58a00771 tempest-ServerAddressesNegativeTestJSON-1549542698 tempest-ServerAddressesNegativeTestJSON-1549542698-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:38.931820 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-45f3bc48-bc9a-4782-b591-86ec58a00771 tempest-ServerAddressesNegativeTestJSON-1549542698 tempest-ServerAddressesNegativeTestJSON-1549542698-project] [instance: 7f1a706c-5002-4d52-83ba-f25ce7771d02] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:38.941463 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-45f3bc48-bc9a-4782-b591-86ec58a00771 tempest-ServerAddressesNegativeTestJSON-1549542698 tempest-ServerAddressesNegativeTestJSON-1549542698-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:38.942324 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-45f3bc48-bc9a-4782-b591-86ec58a00771 tempest-ServerAddressesNegativeTestJSON-1549542698 tempest-ServerAddressesNegativeTestJSON-1549542698-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:38.943192 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-45f3bc48-bc9a-4782-b591-86ec58a00771 tempest-ServerAddressesNegativeTestJSON-1549542698 tempest-ServerAddressesNegativeTestJSON-1549542698-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:38.944075 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-45f3bc48-bc9a-4782-b591-86ec58a00771 tempest-ServerAddressesNegativeTestJSON-1549542698 tempest-ServerAddressesNegativeTestJSON-1549542698-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:38.944524 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-45f3bc48-bc9a-4782-b591-86ec58a00771 tempest-ServerAddressesNegativeTestJSON-1549542698 tempest-ServerAddressesNegativeTestJSON-1549542698-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:38.945050 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-45f3bc48-bc9a-4782-b591-86ec58a00771 tempest-ServerAddressesNegativeTestJSON-1549542698 tempest-ServerAddressesNegativeTestJSON-1549542698-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:38.947397 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-8e57ffdb-6130-44c8-9ead-4acd40de6d92 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aca59cd50bf74a36bb1e4427cd50fbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3fadcd7d4043daa0a6aba27ba814d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:38.956656 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-8e57ffdb-6130-44c8-9ead-4acd40de6d92 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] 10.222.0.33 "GET /compute/v2.1/servers/9df70a8d-757f-4b92-ab73-6ad6cfc98953" status: 200 len: 1308 microversion: 2.1 time: 0.845587 Oct 04 20:48:38.967031 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.wsgi [None req-45f3bc48-bc9a-4782-b591-86ec58a00771 tempest-ServerAddressesNegativeTestJSON-1549542698 tempest-ServerAddressesNegativeTestJSON-1549542698-project] HTTP exception thrown: Instance 7f1a706c-5002-4d52-83ba-f25ce7771d02 could not be found. Oct 04 20:48:38.969546 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-45f3bc48-bc9a-4782-b591-86ec58a00771 tempest-ServerAddressesNegativeTestJSON-1549542698 tempest-ServerAddressesNegativeTestJSON-1549542698-project] Request method failure captured: Oct 04 20:48:38.969546 n-d-854823-8 devstack@n-api.service[128802]: request: GET /compute/v2.1/servers/7f1a706c-5002-4d52-83ba-f25ce7771d02 HTTP/1.1 Oct 04 20:48:38.969546 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 20:48:38.969546 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 20:48:38.969546 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 20:48:38.969546 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 0 Oct 04 20:48:38.969546 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 20:48:38.969546 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 20:48:38.969546 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 20:48:38.969546 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 20:48:38.969546 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPJwJ-llCU7dgvJRbGvm2EnOabeEpCcfrF5kvj4mCkqhNcwR3fllpmEZDjJF3H5TfaUcyZVDWdvQ2tULcbATsNxhAM7C03Tlrdlkt9Af0_HW9G58ApK3J9iVCpvee3NaQybQ-NdR3DVuadhD7A5K1n_M4ZAVnV0TbS2LtsWW4g5NK23Q Oct 04 20:48:38.969546 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 20:48:38.969546 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 20:48:38.969546 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 20:48:38.969546 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 20:48:38.969546 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 20:48:38.969546 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 20:48:38.969546 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: 031ee0beac0b4fd6b43a1030e07c82ea Oct 04 20:48:38.969546 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1549542698 Oct 04 20:48:38.969546 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 20:48:38.969546 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 20:48:38.969546 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_031ee0beac0b4fd6b43a1030e07c82ea", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/031ee0beac0b4fd6b43a1030e07c82ea"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/031ee0beac0b4fd6b43a1030e07c82ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/031ee0beac0b4fd6b43a1030e07c82ea"}]}] Oct 04 20:48:38.969546 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1549542698 Oct 04 20:48:38.969546 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: 031ee0beac0b4fd6b43a1030e07c82ea Oct 04 20:48:38.969546 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1549542698 Oct 04 20:48:38.969546 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-ServerAddressesNegativeTestJSON-1549542698-project Oct 04 20:48:38.969546 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 20:48:38.969546 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 20:48:38.969546 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: b0fdccf8a4c74c56bd811a0092c92bd5 Oct 04 20:48:38.969546 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1549542698-project Oct 04 20:48:38.969546 n-d-854823-8 devstack@n-api.service[128802]: method: > Oct 04 20:48:38.969546 n-d-854823-8 devstack@n-api.service[128802]: exception: Instance 7f1a706c-5002-4d52-83ba-f25ce7771d02 could not be found. Oct 04 20:48:38.969546 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'id': '7f1a706c-5002-4d52-83ba-f25ce7771d02'} Oct 04 20:48:38.969546 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:48:38.969546 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:48:38.969546 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:48:38.969546 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:48:38.969546 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:48:38.969546 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:48:38.969546 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:48:38.969546 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:48:38.969546 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:48:38.969546 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:48:38.969546 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f1a706c-5002-4d52-83ba-f25ce7771d02 could not be found. Oct 04 20:48:38.969546 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:48:38.969546 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:48:38.969546 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:48:38.969546 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:48:38.969546 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:48:38.969546 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:48:38.969546 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:48:38.969546 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:48:38.969546 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:48:38.969546 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:48:38.969546 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:48:38.969546 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:48:38.969546 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:48:38.969546 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:48:38.969546 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:48:38.969546 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:48:38.969546 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f1a706c-5002-4d52-83ba-f25ce7771d02 could not be found. Oct 04 20:48:38.969546 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:48:38.969546 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:48:38.974512 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:48:38.974512 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:48:38.974512 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:48:38.974512 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:48:38.974512 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:48:38.974512 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:48:38.974512 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f1a706c-5002-4d52-83ba-f25ce7771d02 could not be found. Oct 04 20:48:38.974512 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:48:38.975709 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-45f3bc48-bc9a-4782-b591-86ec58a00771 tempest-ServerAddressesNegativeTestJSON-1549542698 tempest-ServerAddressesNegativeTestJSON-1549542698-project] Returning 404 to user: Instance 7f1a706c-5002-4d52-83ba-f25ce7771d02 could not be found. {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:48:38.976626 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-45f3bc48-bc9a-4782-b591-86ec58a00771 tempest-ServerAddressesNegativeTestJSON-1549542698 tempest-ServerAddressesNegativeTestJSON-1549542698-project] 10.222.0.33 "GET /compute/v2.1/servers/7f1a706c-5002-4d52-83ba-f25ce7771d02" status: 404 len: 111 microversion: 2.1 time: 0.053895 Oct 04 20:48:38.980740 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1744/3389] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:48:38 2022] GET /compute/v2.1/servers/7f1a706c-5002-4d52-83ba-f25ce7771d02 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:48:38.980899 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1646/3390] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:48:38 2022] GET /compute/v2.1/servers/9df70a8d-757f-4b92-ab73-6ad6cfc98953 => generated 1308 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:48:38.984082 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-ac425896-8914-4005-bc04-8286e8924fe9 req-94f80fb6-e9f4-4338-a917-9cb76e5e044d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f1a706c-5002-4d52-83ba-f25ce7771d02", "name": "network-vif-deleted", "tag": "d37e8f40-c472-45b2-b146-135f62bbc03c"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:48:38.987894 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-d8ad69af-2642-42c3-ad65-a9d5b9f93f57 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:38.988727 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-d8ad69af-2642-42c3-ad65-a9d5b9f93f57 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: 4d46fff2-b04d-41aa-ada0-2023ab545b48] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:39.003134 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-ac425896-8914-4005-bc04-8286e8924fe9 req-94f80fb6-e9f4-4338-a917-9cb76e5e044d service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:39.003621 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-ac425896-8914-4005-bc04-8286e8924fe9 req-94f80fb6-e9f4-4338-a917-9cb76e5e044d service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:39.004052 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-ac425896-8914-4005-bc04-8286e8924fe9 req-94f80fb6-e9f4-4338-a917-9cb76e5e044d service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:39.004485 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d8ad69af-2642-42c3-ad65-a9d5b9f93f57 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:39.005160 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d8ad69af-2642-42c3-ad65-a9d5b9f93f57 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:39.005956 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d8ad69af-2642-42c3-ad65-a9d5b9f93f57 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:39.007270 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d8ad69af-2642-42c3-ad65-a9d5b9f93f57 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:39.008274 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d8ad69af-2642-42c3-ad65-a9d5b9f93f57 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:39.008877 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d8ad69af-2642-42c3-ad65-a9d5b9f93f57 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:39.032939 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-ac425896-8914-4005-bc04-8286e8924fe9 req-94f80fb6-e9f4-4338-a917-9cb76e5e044d service nova] Creating event network-vif-deleted:d37e8f40-c472-45b2-b146-135f62bbc03c for instance 7f1a706c-5002-4d52-83ba-f25ce7771d02 on n-h1-854823-8 Oct 04 20:48:39.044791 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-ac425896-8914-4005-bc04-8286e8924fe9 req-94f80fb6-e9f4-4338-a917-9cb76e5e044d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065552 Oct 04 20:48:39.049992 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1647/3391] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:48:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:48:39.068623 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-d69e86bf-dc0a-4970-9e4b-1651f5c9d500 req-5576405e-b218-4619-b890-50c9a8bbdfdf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9df70a8d-757f-4b92-ab73-6ad6cfc98953", "name": "network-vif-plugged", "status": "completed", "tag": "1c3eba25-64e5-469d-8f64-96e322b2e424"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:48:39.089338 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-d69e86bf-dc0a-4970-9e4b-1651f5c9d500 req-5576405e-b218-4619-b890-50c9a8bbdfdf service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:39.089995 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-d69e86bf-dc0a-4970-9e4b-1651f5c9d500 req-5576405e-b218-4619-b890-50c9a8bbdfdf service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:39.090924 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-d69e86bf-dc0a-4970-9e4b-1651f5c9d500 req-5576405e-b218-4619-b890-50c9a8bbdfdf service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:39.114958 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-d69e86bf-dc0a-4970-9e4b-1651f5c9d500 req-5576405e-b218-4619-b890-50c9a8bbdfdf service nova] Creating event network-vif-plugged:1c3eba25-64e5-469d-8f64-96e322b2e424 for instance 9df70a8d-757f-4b92-ab73-6ad6cfc98953 on n-h1-854823-8 Oct 04 20:48:39.126286 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-d69e86bf-dc0a-4970-9e4b-1651f5c9d500 req-5576405e-b218-4619-b890-50c9a8bbdfdf service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072467 Oct 04 20:48:39.127709 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1648/3392] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:48:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:48:39.169758 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c1c09a46-7f19-47c0-a5ef-b6b4df1a3a88 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:39.172925 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c1c09a46-7f19-47c0-a5ef-b6b4df1a3a88 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] [instance: 8526b237-847c-47b7-9f0b-8209c9a07b95] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:39.380242 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c1c09a46-7f19-47c0-a5ef-b6b4df1a3a88 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6775b9d82b3444f6b728736f1d2b2806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5338cf2146344042bc263bdc4f9d822b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:39.389488 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c1c09a46-7f19-47c0-a5ef-b6b4df1a3a88 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] 10.222.0.33 "GET /compute/v2.1/servers/8526b237-847c-47b7-9f0b-8209c9a07b95" status: 200 len: 1216 microversion: 2.1 time: 0.259670 Oct 04 20:48:39.398154 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1649/3393] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:48:39 2022] GET /compute/v2.1/servers/8526b237-847c-47b7-9f0b-8209c9a07b95 => generated 1216 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:48:39.411165 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9b65219a-81e0-4d8a-962f-93c8d2860110 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:39.414573 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-9b65219a-81e0-4d8a-962f-93c8d2860110 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] [instance: f9938964-5f2f-4093-b5cb-967adbe97623] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:39.423578 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9b65219a-81e0-4d8a-962f-93c8d2860110 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:39.425246 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9b65219a-81e0-4d8a-962f-93c8d2860110 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:39.426554 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9b65219a-81e0-4d8a-962f-93c8d2860110 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:39.427541 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9b65219a-81e0-4d8a-962f-93c8d2860110 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:39.429496 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9b65219a-81e0-4d8a-962f-93c8d2860110 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:39.430293 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9b65219a-81e0-4d8a-962f-93c8d2860110 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:39.447985 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=100 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:48:39.591369 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-d8ad69af-2642-42c3-ad65-a9d5b9f93f57 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac650232cc04810b1340dc2f0edadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b0670d1bd99424780a70e69d57a2166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:39.600092 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-d8ad69af-2642-42c3-ad65-a9d5b9f93f57 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48" status: 200 len: 1669 microversion: 2.1 time: 0.621839 Oct 04 20:48:39.615185 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1745/3394] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:48:38 2022] GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48 => generated 1669 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:48:39.624691 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-3af30103-8e91-4eef-bd72-9150ce3f65bc tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:39.625639 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-3af30103-8e91-4eef-bd72-9150ce3f65bc tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: 4d46fff2-b04d-41aa-ada0-2023ab545b48] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:39.632229 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3af30103-8e91-4eef-bd72-9150ce3f65bc tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:39.633069 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3af30103-8e91-4eef-bd72-9150ce3f65bc tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:39.633782 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3af30103-8e91-4eef-bd72-9150ce3f65bc tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:39.634739 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3af30103-8e91-4eef-bd72-9150ce3f65bc tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:39.635443 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3af30103-8e91-4eef-bd72-9150ce3f65bc tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:39.636373 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3af30103-8e91-4eef-bd72-9150ce3f65bc tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:39.888012 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-9b65219a-81e0-4d8a-962f-93c8d2860110 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e4b00964014a0383f79597652bd428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7f38600b5041ad8e66a12d77b940fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:39.899124 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-9b65219a-81e0-4d8a-962f-93c8d2860110 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] 10.222.0.33 "GET /compute/v2.1/servers/f9938964-5f2f-4093-b5cb-967adbe97623" status: 200 len: 1368 microversion: 2.1 time: 0.498913 Oct 04 20:48:39.910791 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1650/3395] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:48:39 2022] GET /compute/v2.1/servers/f9938964-5f2f-4093-b5cb-967adbe97623 => generated 1368 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:48:39.920837 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-3a154304-37c5-4804-90eb-ece573a26208 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:39.921383 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-3a154304-37c5-4804-90eb-ece573a26208 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] [instance: c0a14e22-0620-4912-9893-62974c80978a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:39.928986 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3a154304-37c5-4804-90eb-ece573a26208 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:39.937911 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3a154304-37c5-4804-90eb-ece573a26208 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:39.938393 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3a154304-37c5-4804-90eb-ece573a26208 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:39.939170 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3a154304-37c5-4804-90eb-ece573a26208 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:39.939667 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3a154304-37c5-4804-90eb-ece573a26208 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:39.940790 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3a154304-37c5-4804-90eb-ece573a26208 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:39.973530 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-3a154304-37c5-4804-90eb-ece573a26208 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] HTTP exception thrown: Instance c0a14e22-0620-4912-9893-62974c80978a could not be found. Oct 04 20:48:39.976066 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-3a154304-37c5-4804-90eb-ece573a26208 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Request method failure captured: Oct 04 20:48:39.976066 n-d-854823-8 devstack@n-api.service[128801]: request: DELETE /compute/v2.1/servers/c0a14e22-0620-4912-9893-62974c80978a HTTP/1.1 Oct 04 20:48:39.976066 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:48:39.976066 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:48:39.976066 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:48:39.976066 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 0 Oct 04 20:48:39.976066 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:48:39.976066 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:48:39.976066 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:48:39.976066 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:48:39.976066 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJpyTxIS1iBYZVyWVMY2cqw5DBKYtLHHXwKWiHW-Og8vznPsPBi5ljiJqzxbrWGD7wVGUdLN7jspvhXceNNH72AMDOPoOCg1eHg9h7Q_uxlJ5r9trKLgdGFKTeloXh-Pt5axqmdS5yJyozGUSYwKb_LVAkWWxCqGJjlMyqKe_viaaw8 Oct 04 20:48:39.976066 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:48:39.976066 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:48:39.976066 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:48:39.976066 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:48:39.976066 n-d-854823-8 devstack@n-api.service[128801]: X-Openstack-Nova-Api-Version: 2.32 Oct 04 20:48:39.976066 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:48:39.976066 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:48:39.976066 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: 5392c67506f7445ab33d62b191558f7b Oct 04 20:48:39.976066 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-TaggedBootDevicesTest-67949532 Oct 04 20:48:39.976066 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 20:48:39.976066 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 20:48:39.976066 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5392c67506f7445ab33d62b191558f7b", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5392c67506f7445ab33d62b191558f7b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5392c67506f7445ab33d62b191558f7b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5392c67506f7445ab33d62b191558f7b"}]}] Oct 04 20:48:39.976066 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-TaggedBootDevicesTest-67949532 Oct 04 20:48:39.976066 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: 5392c67506f7445ab33d62b191558f7b Oct 04 20:48:39.976066 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-TaggedBootDevicesTest-67949532 Oct 04 20:48:39.976066 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-TaggedBootDevicesTest-67949532-project Oct 04 20:48:39.976066 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:48:39.976066 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:48:39.976066 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: 28399882314945d787a3af6eb59935c0 Oct 04 20:48:39.976066 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-TaggedBootDevicesTest-67949532-project Oct 04 20:48:39.976066 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 20:48:39.976066 n-d-854823-8 devstack@n-api.service[128801]: exception: Instance c0a14e22-0620-4912-9893-62974c80978a could not be found. Oct 04 20:48:39.976066 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': 'c0a14e22-0620-4912-9893-62974c80978a'} Oct 04 20:48:39.976066 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:48:39.976066 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:48:39.976066 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:48:39.976066 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:48:39.976066 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:48:39.976066 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:48:39.976066 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:48:39.976066 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:48:39.976066 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:48:39.976066 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:48:39.976066 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0a14e22-0620-4912-9893-62974c80978a could not be found. Oct 04 20:48:39.976066 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:48:39.976066 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:48:39.976066 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:48:39.976066 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:48:39.976066 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:48:39.976066 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:48:39.976066 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:48:39.976066 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:48:39.976066 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:48:39.976066 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:48:39.976066 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 20:48:39.976066 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 20:48:39.976066 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 20:48:39.976066 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 20:48:39.976066 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:48:39.976066 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:48:39.976066 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:48:39.976066 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:48:39.984238 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0a14e22-0620-4912-9893-62974c80978a could not be found. Oct 04 20:48:39.984238 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:48:39.984238 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:48:39.984238 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:48:39.984238 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:48:39.984238 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:48:39.984238 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:48:39.984238 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:48:39.984238 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:48:39.984238 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0a14e22-0620-4912-9893-62974c80978a could not be found. Oct 04 20:48:39.984238 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:48:39.984238 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-3a154304-37c5-4804-90eb-ece573a26208 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Returning 404 to user: Instance c0a14e22-0620-4912-9893-62974c80978a could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:48:39.984238 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-3a154304-37c5-4804-90eb-ece573a26208 tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] 10.222.0.33 "DELETE /compute/v2.1/servers/c0a14e22-0620-4912-9893-62974c80978a" status: 404 len: 111 microversion: 2.32 time: 0.065791 Oct 04 20:48:39.984238 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1651/3396] 10.222.0.33 () {60 vars in 1280 bytes} [Tue Oct 4 20:48:39 2022] DELETE /compute/v2.1/servers/c0a14e22-0620-4912-9893-62974c80978a => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 20:48:39.989683 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-3af30103-8e91-4eef-bd72-9150ce3f65bc tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac650232cc04810b1340dc2f0edadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b0670d1bd99424780a70e69d57a2166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:39.995824 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-026c7579-b97f-49f1-af3d-4e3ff425e24e tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:39.996427 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-026c7579-b97f-49f1-af3d-4e3ff425e24e tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] [instance: 9261e0b2-35ac-40f4-92d5-3b9ffaea23c4] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:40.003989 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-3af30103-8e91-4eef-bd72-9150ce3f65bc tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48" status: 200 len: 1669 microversion: 2.1 time: 0.382819 Oct 04 20:48:40.004890 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1746/3397] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:48:39 2022] GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48 => generated 1669 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:48:40.013451 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-d67531e1-4101-44ae-b21c-ffd5bb7287bb tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:40.015345 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-026c7579-b97f-49f1-af3d-4e3ff425e24e tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:40.016069 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-d67531e1-4101-44ae-b21c-ffd5bb7287bb tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] [instance: 9df70a8d-757f-4b92-ab73-6ad6cfc98953] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:40.018860 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-026c7579-b97f-49f1-af3d-4e3ff425e24e tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:40.020740 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-026c7579-b97f-49f1-af3d-4e3ff425e24e tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:40.026199 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d67531e1-4101-44ae-b21c-ffd5bb7287bb tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:40.027012 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-026c7579-b97f-49f1-af3d-4e3ff425e24e tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:40.027580 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-026c7579-b97f-49f1-af3d-4e3ff425e24e tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:40.028078 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-026c7579-b97f-49f1-af3d-4e3ff425e24e tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:40.032939 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d67531e1-4101-44ae-b21c-ffd5bb7287bb tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:40.034057 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d67531e1-4101-44ae-b21c-ffd5bb7287bb tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:40.034894 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d67531e1-4101-44ae-b21c-ffd5bb7287bb tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:40.039362 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d67531e1-4101-44ae-b21c-ffd5bb7287bb tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:40.039987 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d67531e1-4101-44ae-b21c-ffd5bb7287bb tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:40.206107 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-026c7579-b97f-49f1-af3d-4e3ff425e24e tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8397c96a6dd4c65bdde07c91ca5e7fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09101effe9da463dabc2edaccdb83e06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:40.215097 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-026c7579-b97f-49f1-af3d-4e3ff425e24e tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] 10.222.0.33 "GET /compute/v2.1/servers/9261e0b2-35ac-40f4-92d5-3b9ffaea23c4" status: 200 len: 1299 microversion: 2.1 time: 0.235921 Oct 04 20:48:40.216447 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1652/3398] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:48:39 2022] GET /compute/v2.1/servers/9261e0b2-35ac-40f4-92d5-3b9ffaea23c4 => generated 1299 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:48:40.222512 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5b06d40d-8355-45e5-9e5a-343c34cbe32e tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:40.223665 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-5b06d40d-8355-45e5-9e5a-343c34cbe32e tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] [instance: c0a14e22-0620-4912-9893-62974c80978a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:40.230155 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5b06d40d-8355-45e5-9e5a-343c34cbe32e tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:40.234663 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5b06d40d-8355-45e5-9e5a-343c34cbe32e tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:40.235360 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5b06d40d-8355-45e5-9e5a-343c34cbe32e tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:40.236348 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5b06d40d-8355-45e5-9e5a-343c34cbe32e tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:40.237887 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5b06d40d-8355-45e5-9e5a-343c34cbe32e tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:40.238683 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5b06d40d-8355-45e5-9e5a-343c34cbe32e tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:40.268988 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-5b06d40d-8355-45e5-9e5a-343c34cbe32e tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] HTTP exception thrown: Instance c0a14e22-0620-4912-9893-62974c80978a could not be found. Oct 04 20:48:40.270601 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5b06d40d-8355-45e5-9e5a-343c34cbe32e tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Request method failure captured: Oct 04 20:48:40.270601 n-d-854823-8 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/c0a14e22-0620-4912-9893-62974c80978a HTTP/1.1 Oct 04 20:48:40.270601 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:48:40.270601 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:48:40.270601 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:48:40.270601 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 0 Oct 04 20:48:40.270601 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:48:40.270601 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:48:40.270601 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:48:40.270601 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:48:40.270601 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJpyTxIS1iBYZVyWVMY2cqw5DBKYtLHHXwKWiHW-Og8vznPsPBi5ljiJqzxbrWGD7wVGUdLN7jspvhXceNNH72AMDOPoOCg1eHg9h7Q_uxlJ5r9trKLgdGFKTeloXh-Pt5axqmdS5yJyozGUSYwKb_LVAkWWxCqGJjlMyqKe_viaaw8 Oct 04 20:48:40.270601 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:48:40.270601 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:48:40.270601 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:48:40.270601 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:48:40.270601 n-d-854823-8 devstack@n-api.service[128801]: X-Openstack-Nova-Api-Version: 2.32 Oct 04 20:48:40.270601 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:48:40.270601 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:48:40.270601 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: 5392c67506f7445ab33d62b191558f7b Oct 04 20:48:40.270601 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-TaggedBootDevicesTest-67949532 Oct 04 20:48:40.270601 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 20:48:40.270601 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 20:48:40.270601 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5392c67506f7445ab33d62b191558f7b", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5392c67506f7445ab33d62b191558f7b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5392c67506f7445ab33d62b191558f7b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5392c67506f7445ab33d62b191558f7b"}]}] Oct 04 20:48:40.270601 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-TaggedBootDevicesTest-67949532 Oct 04 20:48:40.270601 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: 5392c67506f7445ab33d62b191558f7b Oct 04 20:48:40.270601 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-TaggedBootDevicesTest-67949532 Oct 04 20:48:40.270601 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-TaggedBootDevicesTest-67949532-project Oct 04 20:48:40.270601 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:48:40.270601 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:48:40.270601 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: 28399882314945d787a3af6eb59935c0 Oct 04 20:48:40.270601 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-TaggedBootDevicesTest-67949532-project Oct 04 20:48:40.270601 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 20:48:40.270601 n-d-854823-8 devstack@n-api.service[128801]: exception: Instance c0a14e22-0620-4912-9893-62974c80978a could not be found. Oct 04 20:48:40.270601 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': 'c0a14e22-0620-4912-9893-62974c80978a'} Oct 04 20:48:40.270601 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:48:40.270601 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:48:40.270601 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:48:40.270601 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:48:40.270601 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:48:40.270601 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:48:40.270601 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:48:40.270601 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:48:40.270601 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:48:40.270601 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:48:40.270601 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0a14e22-0620-4912-9893-62974c80978a could not be found. Oct 04 20:48:40.270601 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:48:40.270601 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:48:40.270601 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:48:40.270601 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:48:40.270601 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:48:40.270601 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:48:40.270601 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:48:40.270601 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:48:40.270601 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:48:40.270601 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:48:40.270601 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:48:40.270601 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:48:40.270601 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:48:40.270601 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:48:40.270601 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:48:40.270601 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:48:40.270601 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0a14e22-0620-4912-9893-62974c80978a could not be found. Oct 04 20:48:40.270601 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:48:40.270601 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:48:40.270601 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:48:40.274647 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:48:40.274647 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:48:40.274647 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:48:40.274647 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:48:40.274647 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:48:40.274647 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0a14e22-0620-4912-9893-62974c80978a could not be found. Oct 04 20:48:40.274647 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:48:40.274647 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5b06d40d-8355-45e5-9e5a-343c34cbe32e tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] Returning 404 to user: Instance c0a14e22-0620-4912-9893-62974c80978a could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:48:40.274647 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5b06d40d-8355-45e5-9e5a-343c34cbe32e tempest-TaggedBootDevicesTest-67949532 tempest-TaggedBootDevicesTest-67949532-project] 10.222.0.33 "GET /compute/v2.1/servers/c0a14e22-0620-4912-9893-62974c80978a" status: 404 len: 111 microversion: 2.32 time: 0.054164 Oct 04 20:48:40.274647 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1653/3399] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:48:40 2022] GET /compute/v2.1/servers/c0a14e22-0620-4912-9893-62974c80978a => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 20:48:40.277753 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6cca9577-7863-4ee9-84be-eb722c6e57af tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:40.278486 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-6cca9577-7863-4ee9-84be-eb722c6e57af tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: 4d46fff2-b04d-41aa-ada0-2023ab545b48] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:40.286109 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6cca9577-7863-4ee9-84be-eb722c6e57af tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:40.286641 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6cca9577-7863-4ee9-84be-eb722c6e57af tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:40.287085 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6cca9577-7863-4ee9-84be-eb722c6e57af tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:40.287801 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6cca9577-7863-4ee9-84be-eb722c6e57af tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:40.288384 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6cca9577-7863-4ee9-84be-eb722c6e57af tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:40.288816 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6cca9577-7863-4ee9-84be-eb722c6e57af tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:40.603470 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-d67531e1-4101-44ae-b21c-ffd5bb7287bb tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aca59cd50bf74a36bb1e4427cd50fbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3fadcd7d4043daa0a6aba27ba814d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:40.615001 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-d67531e1-4101-44ae-b21c-ffd5bb7287bb tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] 10.222.0.33 "GET /compute/v2.1/servers/9df70a8d-757f-4b92-ab73-6ad6cfc98953" status: 200 len: 1308 microversion: 2.1 time: 0.608278 Oct 04 20:48:40.627124 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1747/3400] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:48:40 2022] GET /compute/v2.1/servers/9df70a8d-757f-4b92-ab73-6ad6cfc98953 => generated 1308 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:48:40.636738 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-7afebc4a-ab30-4fd3-a60a-ee5a6ee04d39 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:40.638201 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-7afebc4a-ab30-4fd3-a60a-ee5a6ee04d39 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] [instance: 8526b237-847c-47b7-9f0b-8209c9a07b95] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:40.653864 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7afebc4a-ab30-4fd3-a60a-ee5a6ee04d39 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:40.655153 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7afebc4a-ab30-4fd3-a60a-ee5a6ee04d39 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:40.655829 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7afebc4a-ab30-4fd3-a60a-ee5a6ee04d39 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:40.657265 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7afebc4a-ab30-4fd3-a60a-ee5a6ee04d39 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:40.657940 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7afebc4a-ab30-4fd3-a60a-ee5a6ee04d39 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:40.659180 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7afebc4a-ab30-4fd3-a60a-ee5a6ee04d39 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:40.807339 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-7afebc4a-ab30-4fd3-a60a-ee5a6ee04d39 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6775b9d82b3444f6b728736f1d2b2806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5338cf2146344042bc263bdc4f9d822b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:40.827953 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-7afebc4a-ab30-4fd3-a60a-ee5a6ee04d39 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] 10.222.0.33 "GET /compute/v2.1/servers/8526b237-847c-47b7-9f0b-8209c9a07b95" status: 200 len: 1268 microversion: 2.1 time: 0.198815 Oct 04 20:48:40.831531 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1748/3401] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:48:40 2022] GET /compute/v2.1/servers/8526b237-847c-47b7-9f0b-8209c9a07b95 => generated 1268 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:48:40.928061 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-f9a12055-d84c-45d6-96f4-3af87ad2a5ba tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:40.928656 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-6cca9577-7863-4ee9-84be-eb722c6e57af tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac650232cc04810b1340dc2f0edadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b0670d1bd99424780a70e69d57a2166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:40.929211 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-f9a12055-d84c-45d6-96f4-3af87ad2a5ba tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] [instance: f9938964-5f2f-4093-b5cb-967adbe97623] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:40.941174 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f9a12055-d84c-45d6-96f4-3af87ad2a5ba tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:40.942130 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f9a12055-d84c-45d6-96f4-3af87ad2a5ba tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:40.942869 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f9a12055-d84c-45d6-96f4-3af87ad2a5ba tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:40.943784 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f9a12055-d84c-45d6-96f4-3af87ad2a5ba tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:40.944745 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f9a12055-d84c-45d6-96f4-3af87ad2a5ba tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:40.945374 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f9a12055-d84c-45d6-96f4-3af87ad2a5ba tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:40.946713 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-6cca9577-7863-4ee9-84be-eb722c6e57af tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48" status: 200 len: 1669 microversion: 2.1 time: 0.673061 Oct 04 20:48:40.947398 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1654/3402] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:48:40 2022] GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48 => generated 1669 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:48:40.976350 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-51284984-a5d5-4104-80b6-54d381359ab4 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Action: 'action', calling method: >, body: {"lock": {}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:48:40.977719 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-51284984-a5d5-4104-80b6-54d381359ab4 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: 4d46fff2-b04d-41aa-ada0-2023ab545b48] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:40.993223 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-51284984-a5d5-4104-80b6-54d381359ab4 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:40.994089 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-51284984-a5d5-4104-80b6-54d381359ab4 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:40.994755 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-51284984-a5d5-4104-80b6-54d381359ab4 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:40.995763 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-51284984-a5d5-4104-80b6-54d381359ab4 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:40.996411 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-51284984-a5d5-4104-80b6-54d381359ab4 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:40.997026 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-51284984-a5d5-4104-80b6-54d381359ab4 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:41.126476 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-51284984-a5d5-4104-80b6-54d381359ab4 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: 4d46fff2-b04d-41aa-ada0-2023ab545b48] Locking {{(pid=128801) lock /opt/stack/nova/nova/compute/api.py:4845}} Oct 04 20:48:41.274808 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-51284984-a5d5-4104-80b6-54d381359ab4 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "POST /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48/action" status: 202 len: 0 microversion: 2.1 time: 0.302042 Oct 04 20:48:41.276589 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1655/3403] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 20:48:40 2022] POST /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48/action => generated 0 bytes in 305 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 20:48:41.285029 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-cdcd34aa-20c3-4611-9935-21781e19f539 req-82028b47-d733-45bf-a665-ed4da8c49182 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9938964-5f2f-4093-b5cb-967adbe97623", "name": "network-vif-plugged", "status": "completed", "tag": "61e69e8f-66c4-464b-815e-298b89835c1f"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:48:41.320790 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-cdcd34aa-20c3-4611-9935-21781e19f539 req-82028b47-d733-45bf-a665-ed4da8c49182 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:41.321998 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-cdcd34aa-20c3-4611-9935-21781e19f539 req-82028b47-d733-45bf-a665-ed4da8c49182 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:41.322779 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-cdcd34aa-20c3-4611-9935-21781e19f539 req-82028b47-d733-45bf-a665-ed4da8c49182 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:41.348184 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-cdcd34aa-20c3-4611-9935-21781e19f539 req-82028b47-d733-45bf-a665-ed4da8c49182 service nova] Creating event network-vif-plugged:61e69e8f-66c4-464b-815e-298b89835c1f for instance f9938964-5f2f-4093-b5cb-967adbe97623 on n-h2-854823-8 Oct 04 20:48:41.358616 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-cdcd34aa-20c3-4611-9935-21781e19f539 req-82028b47-d733-45bf-a665-ed4da8c49182 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079733 Oct 04 20:48:41.359862 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1656/3404] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:48:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:48:41.370277 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2d4f4cfa-0b38-49a9-94f4-015152967d8f tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:41.371864 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-2d4f4cfa-0b38-49a9-94f4-015152967d8f tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] [instance: 9261e0b2-35ac-40f4-92d5-3b9ffaea23c4] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:41.382723 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2d4f4cfa-0b38-49a9-94f4-015152967d8f tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:41.383634 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2d4f4cfa-0b38-49a9-94f4-015152967d8f tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:41.384549 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2d4f4cfa-0b38-49a9-94f4-015152967d8f tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:41.395362 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2d4f4cfa-0b38-49a9-94f4-015152967d8f tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:41.398666 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2d4f4cfa-0b38-49a9-94f4-015152967d8f tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:41.399526 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2d4f4cfa-0b38-49a9-94f4-015152967d8f tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:41.621214 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-2d4f4cfa-0b38-49a9-94f4-015152967d8f tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8397c96a6dd4c65bdde07c91ca5e7fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09101effe9da463dabc2edaccdb83e06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:41.636898 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-2d4f4cfa-0b38-49a9-94f4-015152967d8f tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] 10.222.0.33 "GET /compute/v2.1/servers/9261e0b2-35ac-40f4-92d5-3b9ffaea23c4" status: 200 len: 1299 microversion: 2.1 time: 0.273801 Oct 04 20:48:41.637914 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1657/3405] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:48:41 2022] GET /compute/v2.1/servers/9261e0b2-35ac-40f4-92d5-3b9ffaea23c4 => generated 1299 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:48:41.644191 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-96dec065-e2fb-4e7f-aef9-b4e8edb5df6f tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:41.645214 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-96dec065-e2fb-4e7f-aef9-b4e8edb5df6f tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: 4d46fff2-b04d-41aa-ada0-2023ab545b48] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:41.652218 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-96dec065-e2fb-4e7f-aef9-b4e8edb5df6f tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:41.653027 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-96dec065-e2fb-4e7f-aef9-b4e8edb5df6f tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:41.654090 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-96dec065-e2fb-4e7f-aef9-b4e8edb5df6f tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:41.654931 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-96dec065-e2fb-4e7f-aef9-b4e8edb5df6f tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:41.656719 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-96dec065-e2fb-4e7f-aef9-b4e8edb5df6f tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:41.657282 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-96dec065-e2fb-4e7f-aef9-b4e8edb5df6f tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:41.769609 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-f9a12055-d84c-45d6-96f4-3af87ad2a5ba tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e4b00964014a0383f79597652bd428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7f38600b5041ad8e66a12d77b940fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:41.785178 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-f9a12055-d84c-45d6-96f4-3af87ad2a5ba tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] 10.222.0.33 "GET /compute/v2.1/servers/f9938964-5f2f-4093-b5cb-967adbe97623" status: 200 len: 1368 microversion: 2.1 time: 0.862611 Oct 04 20:48:41.786665 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1749/3406] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:48:40 2022] GET /compute/v2.1/servers/f9938964-5f2f-4093-b5cb-967adbe97623 => generated 1368 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:48:41.795299 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-c5f8c965-a2df-4c20-9ffb-c870af3707e7 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:41.796696 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-c5f8c965-a2df-4c20-9ffb-c870af3707e7 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] [instance: 9df70a8d-757f-4b92-ab73-6ad6cfc98953] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:41.808289 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c5f8c965-a2df-4c20-9ffb-c870af3707e7 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:41.809012 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c5f8c965-a2df-4c20-9ffb-c870af3707e7 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:41.809800 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c5f8c965-a2df-4c20-9ffb-c870af3707e7 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:41.811406 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c5f8c965-a2df-4c20-9ffb-c870af3707e7 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:41.812245 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c5f8c965-a2df-4c20-9ffb-c870af3707e7 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:41.813571 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c5f8c965-a2df-4c20-9ffb-c870af3707e7 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:42.580768 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-96dec065-e2fb-4e7f-aef9-b4e8edb5df6f tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac650232cc04810b1340dc2f0edadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b0670d1bd99424780a70e69d57a2166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:42.589054 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-96dec065-e2fb-4e7f-aef9-b4e8edb5df6f tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48" status: 200 len: 1669 microversion: 2.1 time: 0.949963 Oct 04 20:48:42.599357 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1658/3407] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:48:41 2022] GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48 => generated 1669 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:48:42.606202 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-56f9ab02-7803-4fcf-b3bf-fe06e61a6308 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:42.607311 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-56f9ab02-7803-4fcf-b3bf-fe06e61a6308 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] [instance: 8526b237-847c-47b7-9f0b-8209c9a07b95] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:42.617287 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-56f9ab02-7803-4fcf-b3bf-fe06e61a6308 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:42.618117 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-56f9ab02-7803-4fcf-b3bf-fe06e61a6308 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:42.618977 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-56f9ab02-7803-4fcf-b3bf-fe06e61a6308 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:42.620446 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-56f9ab02-7803-4fcf-b3bf-fe06e61a6308 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:42.621175 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-56f9ab02-7803-4fcf-b3bf-fe06e61a6308 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:42.622059 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-56f9ab02-7803-4fcf-b3bf-fe06e61a6308 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:42.630366 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-c5f8c965-a2df-4c20-9ffb-c870af3707e7 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aca59cd50bf74a36bb1e4427cd50fbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3fadcd7d4043daa0a6aba27ba814d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:42.639253 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-c5f8c965-a2df-4c20-9ffb-c870af3707e7 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] 10.222.0.33 "GET /compute/v2.1/servers/9df70a8d-757f-4b92-ab73-6ad6cfc98953" status: 200 len: 1488 microversion: 2.1 time: 0.851163 Oct 04 20:48:42.647290 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1750/3408] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:48:41 2022] GET /compute/v2.1/servers/9df70a8d-757f-4b92-ab73-6ad6cfc98953 => generated 1488 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:48:42.662589 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-c18be684-77c0-4b98-8f4b-2589f41f3066 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:48:42.669528 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c18be684-77c0-4b98-8f4b-2589f41f3066 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:42.670292 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c18be684-77c0-4b98-8f4b-2589f41f3066 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:42.670917 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c18be684-77c0-4b98-8f4b-2589f41f3066 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:42.709542 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.wsgi [None req-c18be684-77c0-4b98-8f4b-2589f41f3066 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] HTTP exception thrown: Instance 4d46fff2-b04d-41aa-ada0-2023ab545b48 is locked Oct 04 20:48:42.711382 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-c18be684-77c0-4b98-8f4b-2589f41f3066 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Request method failure captured: Oct 04 20:48:42.711382 n-d-854823-8 devstack@n-api.service[128802]: request: POST /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48/action HTTP/1.1 Oct 04 20:48:42.711382 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 20:48:42.711382 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 20:48:42.711382 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 20:48:42.711382 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 15 Oct 04 20:48:42.711382 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 20:48:42.711382 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 20:48:42.711382 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 20:48:42.711382 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 20:48:42.711382 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPJsfW5w9WW6HLdIS-vhuA3Aqgubdan3G4XN4Mz-kS5WBm_kV8MmkEfQ0VXyVBZGh_offIhP7k_7zeKcJerywXx22sbTVU7nn7Yk2TKQKkZk7TZieLYe5dW5fMpGMZVoLDxRDRs83mJz3B8SrRlYbnvScXHL2MTPSbeQInsaFtih26mQ Oct 04 20:48:42.711382 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 20:48:42.711382 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 20:48:42.711382 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 20:48:42.711382 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 20:48:42.711382 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 20:48:42.711382 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 20:48:42.711382 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: 8b0670d1bd99424780a70e69d57a2166 Oct 04 20:48:42.711382 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-ServerActionsTestJSON-1241178619 Oct 04 20:48:42.711382 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 20:48:42.711382 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 20:48:42.711382 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_8b0670d1bd99424780a70e69d57a2166", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8b0670d1bd99424780a70e69d57a2166"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8b0670d1bd99424780a70e69d57a2166"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/8b0670d1bd99424780a70e69d57a2166"}]}] Oct 04 20:48:42.711382 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-ServerActionsTestJSON-1241178619 Oct 04 20:48:42.711382 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: 8b0670d1bd99424780a70e69d57a2166 Oct 04 20:48:42.711382 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-ServerActionsTestJSON-1241178619 Oct 04 20:48:42.711382 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-ServerActionsTestJSON-1241178619-project Oct 04 20:48:42.711382 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 20:48:42.711382 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 20:48:42.711382 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: eac650232cc04810b1340dc2f0edadcc Oct 04 20:48:42.711382 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-ServerActionsTestJSON-1241178619-project Oct 04 20:48:42.711382 n-d-854823-8 devstack@n-api.service[128802]: Oct 04 20:48:42.711382 n-d-854823-8 devstack@n-api.service[128802]: {"os-stop": {}} Oct 04 20:48:42.711382 n-d-854823-8 devstack@n-api.service[128802]: method: > Oct 04 20:48:42.711382 n-d-854823-8 devstack@n-api.service[128802]: exception: Instance 4d46fff2-b04d-41aa-ada0-2023ab545b48 is locked Oct 04 20:48:42.711382 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'id': '4d46fff2-b04d-41aa-ada0-2023ab545b48', 'body': {'os-stop': {}}} Oct 04 20:48:42.711382 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:48:42.711382 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:48:42.711382 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1449, in _stop_server Oct 04 20:48:42.711382 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi self.compute_api.stop(context, instance) Oct 04 20:48:42.711382 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 240, in inner Oct 04 20:48:42.711382 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.InstanceIsLocked(instance_uuid=instance.uuid) Oct 04 20:48:42.711382 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.InstanceIsLocked: Instance 4d46fff2-b04d-41aa-ada0-2023ab545b48 is locked Oct 04 20:48:42.711382 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:48:42.711382 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:48:42.711382 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:48:42.711382 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:48:42.711382 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:48:42.711382 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:48:42.711382 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:48:42.711382 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:48:42.711382 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:48:42.711382 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:48:42.711382 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1451, in _stop_server Oct 04 20:48:42.711382 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=e.format_message()) Oct 04 20:48:42.711382 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Instance 4d46fff2-b04d-41aa-ada0-2023ab545b48 is locked Oct 04 20:48:42.711382 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:48:42.711382 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:48:42.711382 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:48:42.711382 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:48:42.711382 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:48:42.711382 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:48:42.711382 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:48:42.711382 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:48:42.711382 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d46fff2-b04d-41aa-ada0-2023ab545b48 is locked Oct 04 20:48:42.711382 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:48:42.720814 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-c18be684-77c0-4b98-8f4b-2589f41f3066 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Returning 409 to user: Instance 4d46fff2-b04d-41aa-ada0-2023ab545b48 is locked {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:48:42.722602 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-c18be684-77c0-4b98-8f4b-2589f41f3066 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "POST /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48/action" status: 409 len: 107 microversion: 2.1 time: 0.073952 Oct 04 20:48:42.732273 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1751/3409] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 20:48:42 2022] POST /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48/action => generated 107 bytes in 84 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 04 20:48:42.739843 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-10b924a6-32dd-45e8-b511-6ff9c98a0adf tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:42.741454 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-10b924a6-32dd-45e8-b511-6ff9c98a0adf tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] [instance: 9261e0b2-35ac-40f4-92d5-3b9ffaea23c4] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:42.762027 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-10b924a6-32dd-45e8-b511-6ff9c98a0adf tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:42.762552 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-10b924a6-32dd-45e8-b511-6ff9c98a0adf tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:42.762993 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-10b924a6-32dd-45e8-b511-6ff9c98a0adf tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:42.763711 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-10b924a6-32dd-45e8-b511-6ff9c98a0adf tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:42.764163 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-10b924a6-32dd-45e8-b511-6ff9c98a0adf tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:42.764586 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-10b924a6-32dd-45e8-b511-6ff9c98a0adf tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:43.018550 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-56f9ab02-7803-4fcf-b3bf-fe06e61a6308 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6775b9d82b3444f6b728736f1d2b2806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5338cf2146344042bc263bdc4f9d822b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:43.029607 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-56f9ab02-7803-4fcf-b3bf-fe06e61a6308 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] 10.222.0.33 "GET /compute/v2.1/servers/8526b237-847c-47b7-9f0b-8209c9a07b95" status: 200 len: 1274 microversion: 2.1 time: 0.428823 Oct 04 20:48:43.038626 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1659/3410] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:48:42 2022] GET /compute/v2.1/servers/8526b237-847c-47b7-9f0b-8209c9a07b95 => generated 1274 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:48:43.059821 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b6d97114-1721-4cdc-b210-c0faf1a723d3 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:48:43.060631 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b6d97114-1721-4cdc-b210-c0faf1a723d3 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: 4d46fff2-b04d-41aa-ada0-2023ab545b48] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:43.083312 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b6d97114-1721-4cdc-b210-c0faf1a723d3 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:43.084245 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b6d97114-1721-4cdc-b210-c0faf1a723d3 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:43.084888 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b6d97114-1721-4cdc-b210-c0faf1a723d3 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:43.086026 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b6d97114-1721-4cdc-b210-c0faf1a723d3 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:43.086958 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b6d97114-1721-4cdc-b210-c0faf1a723d3 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:43.087583 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b6d97114-1721-4cdc-b210-c0faf1a723d3 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:43.176451 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b6d97114-1721-4cdc-b210-c0faf1a723d3 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: 4d46fff2-b04d-41aa-ada0-2023ab545b48] Unlocking {{(pid=128801) unlock /opt/stack/nova/nova/compute/api.py:4874}} Oct 04 20:48:43.275925 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b6d97114-1721-4cdc-b210-c0faf1a723d3 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "POST /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48/action" status: 202 len: 0 microversion: 2.1 time: 0.228629 Oct 04 20:48:43.276621 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1660/3411] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 20:48:43 2022] POST /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48/action => generated 0 bytes in 230 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:48:43.283185 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a3f35c85-b826-4cdd-95eb-b4aa39148e11 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-448918805"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:48:43.289811 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a3f35c85-b826-4cdd-95eb-b4aa39148e11 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] [instance: 9df70a8d-757f-4b92-ab73-6ad6cfc98953] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:43.306451 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a3f35c85-b826-4cdd-95eb-b4aa39148e11 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:43.306956 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a3f35c85-b826-4cdd-95eb-b4aa39148e11 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:43.307398 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a3f35c85-b826-4cdd-95eb-b4aa39148e11 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:43.308115 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a3f35c85-b826-4cdd-95eb-b4aa39148e11 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:43.308577 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a3f35c85-b826-4cdd-95eb-b4aa39148e11 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:43.309013 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a3f35c85-b826-4cdd-95eb-b4aa39148e11 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:43.418926 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-10b924a6-32dd-45e8-b511-6ff9c98a0adf tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8397c96a6dd4c65bdde07c91ca5e7fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09101effe9da463dabc2edaccdb83e06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:43.434299 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-10b924a6-32dd-45e8-b511-6ff9c98a0adf tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] 10.222.0.33 "GET /compute/v2.1/servers/9261e0b2-35ac-40f4-92d5-3b9ffaea23c4" status: 200 len: 1367 microversion: 2.1 time: 0.699434 Oct 04 20:48:43.437523 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1752/3412] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:48:42 2022] GET /compute/v2.1/servers/9261e0b2-35ac-40f4-92d5-3b9ffaea23c4 => generated 1367 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:48:43.450661 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-b53780d1-72c0-4400-820c-ed5c9c479207 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:43.451760 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-b53780d1-72c0-4400-820c-ed5c9c479207 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] [instance: f9938964-5f2f-4093-b5cb-967adbe97623] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:43.468702 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b53780d1-72c0-4400-820c-ed5c9c479207 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:43.470465 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b53780d1-72c0-4400-820c-ed5c9c479207 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:43.474579 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b53780d1-72c0-4400-820c-ed5c9c479207 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:43.475615 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b53780d1-72c0-4400-820c-ed5c9c479207 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:43.482178 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b53780d1-72c0-4400-820c-ed5c9c479207 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:43.483109 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b53780d1-72c0-4400-820c-ed5c9c479207 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:43.869414 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a3f35c85-b826-4cdd-95eb-b4aa39148e11 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] 10.222.0.33 "POST /compute/v2.1/servers/9df70a8d-757f-4b92-ab73-6ad6cfc98953/action" status: 202 len: 0 microversion: 2.1 time: 0.591498 Oct 04 20:48:43.873842 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1661/3413] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 20:48:43 2022] POST /compute/v2.1/servers/9df70a8d-757f-4b92-ab73-6ad6cfc98953/action => generated 0 bytes in 597 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 04 20:48:43.882523 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a44337cc-dad6-45c1-a7d5-88f7ce407386 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:48:43.923015 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a44337cc-dad6-45c1-a7d5-88f7ce407386 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:43.938214 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a44337cc-dad6-45c1-a7d5-88f7ce407386 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:43.939081 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a44337cc-dad6-45c1-a7d5-88f7ce407386 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:43.982901 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=86,nova_cell1:INSERT=5,nova_cell1:UPDATE=9 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:48:44.031610 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a44337cc-dad6-45c1-a7d5-88f7ce407386 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: 4d46fff2-b04d-41aa-ada0-2023ab545b48] Going to try to stop instance {{(pid=128801) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 04 20:48:44.159490 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a44337cc-dad6-45c1-a7d5-88f7ce407386 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "POST /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48/action" status: 202 len: 0 microversion: 2.1 time: 0.283056 Oct 04 20:48:44.160399 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1662/3414] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 20:48:43 2022] POST /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48/action => generated 0 bytes in 286 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:48:44.190244 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9129c9cd-5a5f-4f50-a012-71f79c73865a tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Calling method '.version_select at 0x7f3c742f5040>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:44.299524 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-9129c9cd-5a5f-4f50-a012-71f79c73865a tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] 10.222.0.33 "GET /compute/v2.1/images/283d61a3-e33d-4288-a141-698ab1974c1f" status: 200 len: 1411 microversion: 2.1 time: 0.137056 Oct 04 20:48:44.310608 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1663/3415] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 20:48:44 2022] GET /compute/v2.1/images/283d61a3-e33d-4288-a141-698ab1974c1f => generated 1411 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:48:44.319027 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-27d5ad3c-de5e-4e54-93e8-e066f055cae1 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:44.320103 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-27d5ad3c-de5e-4e54-93e8-e066f055cae1 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] [instance: 8526b237-847c-47b7-9f0b-8209c9a07b95] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:44.329220 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-27d5ad3c-de5e-4e54-93e8-e066f055cae1 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:44.331354 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-27d5ad3c-de5e-4e54-93e8-e066f055cae1 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:44.332762 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-27d5ad3c-de5e-4e54-93e8-e066f055cae1 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:44.333795 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-27d5ad3c-de5e-4e54-93e8-e066f055cae1 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:44.334544 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-27d5ad3c-de5e-4e54-93e8-e066f055cae1 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:44.335261 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-27d5ad3c-de5e-4e54-93e8-e066f055cae1 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:44.633804 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-27d5ad3c-de5e-4e54-93e8-e066f055cae1 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6775b9d82b3444f6b728736f1d2b2806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5338cf2146344042bc263bdc4f9d822b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:44.653953 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-27d5ad3c-de5e-4e54-93e8-e066f055cae1 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] 10.222.0.33 "GET /compute/v2.1/servers/8526b237-847c-47b7-9f0b-8209c9a07b95" status: 200 len: 1274 microversion: 2.1 time: 0.341874 Oct 04 20:48:44.656619 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1664/3416] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:48:44 2022] GET /compute/v2.1/servers/8526b237-847c-47b7-9f0b-8209c9a07b95 => generated 1274 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:48:44.662807 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-bd9b29aa-f3b6-43f6-b61b-9fbd3db8ae68 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:44.663616 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-bd9b29aa-f3b6-43f6-b61b-9fbd3db8ae68 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: 4d46fff2-b04d-41aa-ada0-2023ab545b48] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:44.687775 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bd9b29aa-f3b6-43f6-b61b-9fbd3db8ae68 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:44.689073 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bd9b29aa-f3b6-43f6-b61b-9fbd3db8ae68 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:44.690087 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bd9b29aa-f3b6-43f6-b61b-9fbd3db8ae68 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:44.691245 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bd9b29aa-f3b6-43f6-b61b-9fbd3db8ae68 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:44.692197 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bd9b29aa-f3b6-43f6-b61b-9fbd3db8ae68 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:44.693999 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bd9b29aa-f3b6-43f6-b61b-9fbd3db8ae68 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:44.707090 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-b53780d1-72c0-4400-820c-ed5c9c479207 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e4b00964014a0383f79597652bd428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7f38600b5041ad8e66a12d77b940fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:44.718915 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-b53780d1-72c0-4400-820c-ed5c9c479207 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] 10.222.0.33 "GET /compute/v2.1/servers/f9938964-5f2f-4093-b5cb-967adbe97623" status: 200 len: 1558 microversion: 2.1 time: 1.279998 Oct 04 20:48:44.720177 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1753/3417] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:48:43 2022] GET /compute/v2.1/servers/f9938964-5f2f-4093-b5cb-967adbe97623 => generated 1558 bytes in 1282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:48:44.726013 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-244d2873-ec1c-428f-949d-4878e90a2448 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Calling method '.version_select at 0x7f3c7448cdc0>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:44.806940 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-244d2873-ec1c-428f-949d-4878e90a2448 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] 10.222.0.33 "GET /compute/v2.1/images/283d61a3-e33d-4288-a141-698ab1974c1f" status: 200 len: 1411 microversion: 2.1 time: 0.084682 Oct 04 20:48:44.820003 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1754/3418] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 20:48:44 2022] GET /compute/v2.1/images/283d61a3-e33d-4288-a141-698ab1974c1f => generated 1411 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:48:44.825435 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-9c3cbd08-1074-4be5-8e40-3462bb275c4c tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:44.826421 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-9c3cbd08-1074-4be5-8e40-3462bb275c4c tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] [instance: 9261e0b2-35ac-40f4-92d5-3b9ffaea23c4] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:44.836929 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9c3cbd08-1074-4be5-8e40-3462bb275c4c tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:44.837854 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9c3cbd08-1074-4be5-8e40-3462bb275c4c tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:44.838546 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9c3cbd08-1074-4be5-8e40-3462bb275c4c tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:44.840286 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9c3cbd08-1074-4be5-8e40-3462bb275c4c tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:44.841058 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9c3cbd08-1074-4be5-8e40-3462bb275c4c tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:44.841729 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9c3cbd08-1074-4be5-8e40-3462bb275c4c tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:45.325163 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-bd9b29aa-f3b6-43f6-b61b-9fbd3db8ae68 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac650232cc04810b1340dc2f0edadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b0670d1bd99424780a70e69d57a2166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:45.333474 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-bd9b29aa-f3b6-43f6-b61b-9fbd3db8ae68 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48" status: 200 len: 1679 microversion: 2.1 time: 0.675132 Oct 04 20:48:45.341455 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1665/3419] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:48:44 2022] GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48 => generated 1679 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:48:45.347327 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-097290d0-ba6d-473e-8ef9-89ab122763ca tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:45.351365 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-097290d0-ba6d-473e-8ef9-89ab122763ca tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] [instance: f9938964-5f2f-4093-b5cb-967adbe97623] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:45.365904 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-097290d0-ba6d-473e-8ef9-89ab122763ca tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:45.366640 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-097290d0-ba6d-473e-8ef9-89ab122763ca tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:45.367273 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-097290d0-ba6d-473e-8ef9-89ab122763ca tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:45.368286 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-097290d0-ba6d-473e-8ef9-89ab122763ca tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:45.375077 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-097290d0-ba6d-473e-8ef9-89ab122763ca tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:45.375867 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-097290d0-ba6d-473e-8ef9-89ab122763ca tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:45.658455 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-9c3cbd08-1074-4be5-8e40-3462bb275c4c tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8397c96a6dd4c65bdde07c91ca5e7fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09101effe9da463dabc2edaccdb83e06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:45.673388 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-9c3cbd08-1074-4be5-8e40-3462bb275c4c tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] 10.222.0.33 "GET /compute/v2.1/servers/9261e0b2-35ac-40f4-92d5-3b9ffaea23c4" status: 200 len: 1367 microversion: 2.1 time: 0.850682 Oct 04 20:48:45.676247 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1755/3420] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:48:44 2022] GET /compute/v2.1/servers/9261e0b2-35ac-40f4-92d5-3b9ffaea23c4 => generated 1367 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:48:45.700524 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-753340cd-c6dc-4555-8861-037f5a5848cd tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Calling method '.version_select at 0x7f3c789ee280>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:45.979976 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-753340cd-c6dc-4555-8861-037f5a5848cd tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] 10.222.0.33 "DELETE /compute/v2.1/images/283d61a3-e33d-4288-a141-698ab1974c1f" status: 204 len: 0 microversion: 2.1 time: 0.299797 Oct 04 20:48:45.981286 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1756/3421] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:48:45 2022] DELETE /compute/v2.1/images/283d61a3-e33d-4288-a141-698ab1974c1f => generated 0 bytes in 304 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:48:45.987296 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-61cf0e3a-1dad-49f4-aa76-6d943ba81825 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:45.988395 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-61cf0e3a-1dad-49f4-aa76-6d943ba81825 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] [instance: 8526b237-847c-47b7-9f0b-8209c9a07b95] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:46.009162 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-097290d0-ba6d-473e-8ef9-89ab122763ca tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] 10.222.0.33 "GET /compute/v2.1/servers/f9938964-5f2f-4093-b5cb-967adbe97623/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.666187 Oct 04 20:48:46.010749 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-61cf0e3a-1dad-49f4-aa76-6d943ba81825 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:46.012724 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-61cf0e3a-1dad-49f4-aa76-6d943ba81825 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:46.013775 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-61cf0e3a-1dad-49f4-aa76-6d943ba81825 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:46.019256 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1666/3422] 10.222.0.33 () {58 vars in 1275 bytes} [Tue Oct 4 20:48:45 2022] GET /compute/v2.1/servers/f9938964-5f2f-4093-b5cb-967adbe97623/os-interface => generated 285 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:48:46.024499 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-61cf0e3a-1dad-49f4-aa76-6d943ba81825 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:46.024615 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a086a3d4-ff66-4011-8f54-c4135e5a2442 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Calling method '.version_select at 0x7f3c740ce9d0>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:46.025006 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-61cf0e3a-1dad-49f4-aa76-6d943ba81825 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:46.025974 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-61cf0e3a-1dad-49f4-aa76-6d943ba81825 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:46.057656 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-a086a3d4-ff66-4011-8f54-c4135e5a2442 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] HTTP exception thrown: Image not found. Oct 04 20:48:46.059836 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a086a3d4-ff66-4011-8f54-c4135e5a2442 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Request method failure captured: Oct 04 20:48:46.059836 n-d-854823-8 devstack@n-api.service[128801]: request: GET /compute/v2.1/images/283d61a3-e33d-4288-a141-698ab1974c1f HTTP/1.1 Oct 04 20:48:46.059836 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:48:46.059836 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:48:46.059836 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:48:46.059836 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 0 Oct 04 20:48:46.059836 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:48:46.059836 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:48:46.059836 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:48:46.059836 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:48:46.059836 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJtXeGd1OSE1d-q7huwYmQVgHKPB2nY9Y_iBYLSsxIWf0ZLoIsms_J79v8rnvuCcLKCo45bauxqFKnjqGYX1AAx7FYuwRfC4K7DRdTmNl747g3WpVpopQX7HTqkFLqtLUTKzVUP1OfFEQpoHNLwfiO0ITJKfRxWFYCijK5r7I1sZPKU Oct 04 20:48:46.059836 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:48:46.059836 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:48:46.059836 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:48:46.059836 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:48:46.059836 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:48:46.059836 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:48:46.059836 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: 3f3fadcd7d4043daa0a6aba27ba814d5 Oct 04 20:48:46.059836 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-ImagesTestJSON-506982684 Oct 04 20:48:46.059836 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 20:48:46.059836 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 20:48:46.059836 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_3f3fadcd7d4043daa0a6aba27ba814d5", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3f3fadcd7d4043daa0a6aba27ba814d5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3f3fadcd7d4043daa0a6aba27ba814d5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/3f3fadcd7d4043daa0a6aba27ba814d5"}]}] Oct 04 20:48:46.059836 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-ImagesTestJSON-506982684 Oct 04 20:48:46.059836 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: 3f3fadcd7d4043daa0a6aba27ba814d5 Oct 04 20:48:46.059836 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ImagesTestJSON-506982684 Oct 04 20:48:46.059836 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-ImagesTestJSON-506982684-project Oct 04 20:48:46.059836 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:48:46.059836 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:48:46.059836 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: aca59cd50bf74a36bb1e4427cd50fbb3 Oct 04 20:48:46.059836 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-ImagesTestJSON-506982684-project Oct 04 20:48:46.059836 n-d-854823-8 devstack@n-api.service[128801]: method: Oct 04 20:48:46.059836 n-d-854823-8 devstack@n-api.service[128801]: exception: Image not found. Oct 04 20:48:46.059836 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': '283d61a3-e33d-4288-a141-698ab1974c1f'} Oct 04 20:48:46.059836 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:48:46.059836 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:48:46.059836 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 20:48:46.059836 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 20:48:46.059836 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 20:48:46.059836 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 20:48:46.059836 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 20:48:46.059836 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 20:48:46.059836 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 20:48:46.059836 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 20:48:46.059836 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 20:48:46.059836 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 20:48:46.059836 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 20:48:46.059836 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 20:48:46.059836 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 20:48:46.059836 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 20:48:46.059836 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 20:48:46.059836 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 20:48:46.059836 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 283d61a3-e33d-4288-a141-698ab1974c1f Oct 04 20:48:46.059836 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:48:46.059836 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:48:46.059836 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:48:46.059836 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:48:46.059836 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 04 20:48:46.059836 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 04 20:48:46.059836 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 04 20:48:46.059836 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 04 20:48:46.059836 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 04 20:48:46.059836 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 04 20:48:46.059836 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 04 20:48:46.059836 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 04 20:48:46.065463 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 20:48:46.065463 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 20:48:46.065463 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 20:48:46.065463 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 20:48:46.065463 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 20:48:46.065463 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 20:48:46.065463 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 20:48:46.065463 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 20:48:46.065463 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 20:48:46.065463 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 20:48:46.065463 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 20:48:46.065463 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 20:48:46.065463 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 20:48:46.065463 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 20:48:46.065463 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 20:48:46.065463 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 20:48:46.065463 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 283d61a3-e33d-4288-a141-698ab1974c1f could not be found. Oct 04 20:48:46.065463 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:48:46.065463 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:48:46.065463 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:48:46.065463 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:48:46.065463 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:48:46.065463 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:48:46.065463 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:48:46.065463 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:48:46.065463 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:48:46.065463 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:48:46.065463 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:48:46.065463 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:48:46.065463 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 04 20:48:46.065463 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 04 20:48:46.065463 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 20:48:46.065463 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:48:46.065463 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:48:46.065463 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:48:46.065463 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:48:46.065463 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:48:46.065463 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:48:46.065463 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:48:46.065463 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:48:46.065463 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 20:48:46.065463 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:48:46.065463 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a086a3d4-ff66-4011-8f54-c4135e5a2442 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Returning 404 to user: Image not found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:48:46.069510 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a086a3d4-ff66-4011-8f54-c4135e5a2442 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] 10.222.0.33 "GET /compute/v2.1/images/283d61a3-e33d-4288-a141-698ab1974c1f" status: 404 len: 62 microversion: 2.1 time: 0.044460 Oct 04 20:48:46.081993 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1667/3423] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 20:48:46 2022] GET /compute/v2.1/images/283d61a3-e33d-4288-a141-698ab1974c1f => generated 62 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 20:48:46.088219 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-06a14820-892c-42d5-8c32-f4f1a9634f1f tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:46.088839 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-06a14820-892c-42d5-8c32-f4f1a9634f1f tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] [instance: 9df70a8d-757f-4b92-ab73-6ad6cfc98953] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:46.100888 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-06a14820-892c-42d5-8c32-f4f1a9634f1f tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:46.101395 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-06a14820-892c-42d5-8c32-f4f1a9634f1f tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:46.101838 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-06a14820-892c-42d5-8c32-f4f1a9634f1f tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:46.102590 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-06a14820-892c-42d5-8c32-f4f1a9634f1f tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:46.103053 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-06a14820-892c-42d5-8c32-f4f1a9634f1f tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:46.108301 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-06a14820-892c-42d5-8c32-f4f1a9634f1f tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:46.256638 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:48:46.646994 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-61cf0e3a-1dad-49f4-aa76-6d943ba81825 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6775b9d82b3444f6b728736f1d2b2806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5338cf2146344042bc263bdc4f9d822b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:46.666420 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-61cf0e3a-1dad-49f4-aa76-6d943ba81825 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] 10.222.0.33 "GET /compute/v2.1/servers/8526b237-847c-47b7-9f0b-8209c9a07b95" status: 200 len: 1316 microversion: 2.1 time: 0.672739 Oct 04 20:48:46.667166 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1757/3424] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:48:45 2022] GET /compute/v2.1/servers/8526b237-847c-47b7-9f0b-8209c9a07b95 => generated 1316 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:48:46.672171 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-2fc072f5-b854-45bd-8e88-3c01f85fef17 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:46.672782 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-2fc072f5-b854-45bd-8e88-3c01f85fef17 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: 4d46fff2-b04d-41aa-ada0-2023ab545b48] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:46.683564 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2fc072f5-b854-45bd-8e88-3c01f85fef17 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:46.684061 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2fc072f5-b854-45bd-8e88-3c01f85fef17 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:46.684493 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2fc072f5-b854-45bd-8e88-3c01f85fef17 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:46.697571 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2fc072f5-b854-45bd-8e88-3c01f85fef17 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:46.707584 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2fc072f5-b854-45bd-8e88-3c01f85fef17 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:46.707584 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2fc072f5-b854-45bd-8e88-3c01f85fef17 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:46.991351 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-06a14820-892c-42d5-8c32-f4f1a9634f1f tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aca59cd50bf74a36bb1e4427cd50fbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3fadcd7d4043daa0a6aba27ba814d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:47.000739 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-06a14820-892c-42d5-8c32-f4f1a9634f1f tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] 10.222.0.33 "GET /compute/v2.1/servers/9df70a8d-757f-4b92-ab73-6ad6cfc98953" status: 200 len: 1506 microversion: 2.1 time: 0.917913 Oct 04 20:48:47.005469 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1668/3425] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:48:46 2022] GET /compute/v2.1/servers/9df70a8d-757f-4b92-ab73-6ad6cfc98953 => generated 1506 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:48:47.010482 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1a7afa88-1d03-4c28-bb6f-21752fced925 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:47.020552 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-1a7afa88-1d03-4c28-bb6f-21752fced925 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] [instance: 9261e0b2-35ac-40f4-92d5-3b9ffaea23c4] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:47.029851 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1a7afa88-1d03-4c28-bb6f-21752fced925 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:47.030613 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1a7afa88-1d03-4c28-bb6f-21752fced925 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:47.031233 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1a7afa88-1d03-4c28-bb6f-21752fced925 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:47.036958 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1a7afa88-1d03-4c28-bb6f-21752fced925 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:47.037676 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1a7afa88-1d03-4c28-bb6f-21752fced925 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:47.038449 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1a7afa88-1d03-4c28-bb6f-21752fced925 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:47.365805 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-2fc072f5-b854-45bd-8e88-3c01f85fef17 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac650232cc04810b1340dc2f0edadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b0670d1bd99424780a70e69d57a2166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:47.368491 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:48:47.401857 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-2fc072f5-b854-45bd-8e88-3c01f85fef17 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48" status: 200 len: 1679 microversion: 2.1 time: 0.733567 Oct 04 20:48:47.402480 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1758/3426] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:48:46 2022] GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48 => generated 1679 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:48:47.693694 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-1a80990b-fa27-4937-95b1-b765adb893b5 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:47.694226 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-1a80990b-fa27-4937-95b1-b765adb893b5 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] [instance: 8526b237-847c-47b7-9f0b-8209c9a07b95] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:47.710121 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1a80990b-fa27-4937-95b1-b765adb893b5 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:47.710862 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1a80990b-fa27-4937-95b1-b765adb893b5 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:47.711303 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1a80990b-fa27-4937-95b1-b765adb893b5 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:47.712012 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1a80990b-fa27-4937-95b1-b765adb893b5 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:47.712462 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1a80990b-fa27-4937-95b1-b765adb893b5 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:47.712887 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1a80990b-fa27-4937-95b1-b765adb893b5 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:48.154250 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-1a7afa88-1d03-4c28-bb6f-21752fced925 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8397c96a6dd4c65bdde07c91ca5e7fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09101effe9da463dabc2edaccdb83e06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:48.170464 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-1a7afa88-1d03-4c28-bb6f-21752fced925 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] 10.222.0.33 "GET /compute/v2.1/servers/9261e0b2-35ac-40f4-92d5-3b9ffaea23c4" status: 200 len: 1367 microversion: 2.1 time: 1.162917 Oct 04 20:48:48.172600 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1669/3427] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:48:47 2022] GET /compute/v2.1/servers/9261e0b2-35ac-40f4-92d5-3b9ffaea23c4 => generated 1367 bytes in 1166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:48:48.178985 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1451d910-f35a-4937-b3a7-a9f8426ad593 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:48.180257 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-1451d910-f35a-4937-b3a7-a9f8426ad593 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] [instance: 9df70a8d-757f-4b92-ab73-6ad6cfc98953] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:48.188784 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1451d910-f35a-4937-b3a7-a9f8426ad593 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:48.190092 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1451d910-f35a-4937-b3a7-a9f8426ad593 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:48.191068 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1451d910-f35a-4937-b3a7-a9f8426ad593 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:48.192561 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1451d910-f35a-4937-b3a7-a9f8426ad593 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:48.193420 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1451d910-f35a-4937-b3a7-a9f8426ad593 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:48.194083 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1451d910-f35a-4937-b3a7-a9f8426ad593 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:48.258328 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell0:SELECT=2 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:48:48.284784 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-1a80990b-fa27-4937-95b1-b765adb893b5 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6775b9d82b3444f6b728736f1d2b2806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5338cf2146344042bc263bdc4f9d822b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:48.313481 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell0:SELECT=10 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:48:48.325368 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-1a80990b-fa27-4937-95b1-b765adb893b5 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] 10.222.0.33 "GET /compute/v2.1/servers/8526b237-847c-47b7-9f0b-8209c9a07b95" status: 200 len: 1316 microversion: 2.1 time: 0.634166 Oct 04 20:48:48.328289 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1759/3428] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:48:47 2022] GET /compute/v2.1/servers/8526b237-847c-47b7-9f0b-8209c9a07b95 => generated 1316 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:48:48.442285 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-1ce40ef9-0455-4925-8b19-537f3e8a415e tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:48.443681 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-1ce40ef9-0455-4925-8b19-537f3e8a415e tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: 4d46fff2-b04d-41aa-ada0-2023ab545b48] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:48.489147 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1ce40ef9-0455-4925-8b19-537f3e8a415e tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:48.491549 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1ce40ef9-0455-4925-8b19-537f3e8a415e tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:48.493350 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1ce40ef9-0455-4925-8b19-537f3e8a415e tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:48.497169 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1ce40ef9-0455-4925-8b19-537f3e8a415e tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:48.498980 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1ce40ef9-0455-4925-8b19-537f3e8a415e tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:48.499366 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1ce40ef9-0455-4925-8b19-537f3e8a415e tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:48.721241 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-1451d910-f35a-4937-b3a7-a9f8426ad593 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aca59cd50bf74a36bb1e4427cd50fbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3fadcd7d4043daa0a6aba27ba814d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:48.737065 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-1451d910-f35a-4937-b3a7-a9f8426ad593 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] 10.222.0.33 "GET /compute/v2.1/servers/9df70a8d-757f-4b92-ab73-6ad6cfc98953" status: 200 len: 1488 microversion: 2.1 time: 0.563153 Oct 04 20:48:48.737663 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1670/3429] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:48:48 2022] GET /compute/v2.1/servers/9df70a8d-757f-4b92-ab73-6ad6cfc98953 => generated 1488 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:48:48.742774 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-cbde48af-171c-4ab3-a694-a29eba0291cb req-52b157ef-7774-464d-a210-a1f578040b74 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9261e0b2-35ac-40f4-92d5-3b9ffaea23c4", "tag": "09b39841-a772-4f30-a38c-731c97c36f85"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:48:48.761937 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-cbde48af-171c-4ab3-a694-a29eba0291cb req-52b157ef-7774-464d-a210-a1f578040b74 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:48.762580 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-cbde48af-171c-4ab3-a694-a29eba0291cb req-52b157ef-7774-464d-a210-a1f578040b74 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:48.763185 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-cbde48af-171c-4ab3-a694-a29eba0291cb req-52b157ef-7774-464d-a210-a1f578040b74 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:48.782101 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-cbde48af-171c-4ab3-a694-a29eba0291cb req-52b157ef-7774-464d-a210-a1f578040b74 service nova] Creating event network-changed:09b39841-a772-4f30-a38c-731c97c36f85 for instance 9261e0b2-35ac-40f4-92d5-3b9ffaea23c4 on n-h2-854823-8 Oct 04 20:48:48.789406 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-cbde48af-171c-4ab3-a694-a29eba0291cb req-52b157ef-7774-464d-a210-a1f578040b74 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050028 Oct 04 20:48:48.790672 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1671/3430] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:48:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:48:48.797681 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-b3ebbbc0-8f46-4919-8483-99c28c949e53 req-95aaa5ec-163c-4817-a235-5f218aabdacd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f9938964-5f2f-4093-b5cb-967adbe97623", "tag": "61e69e8f-66c4-464b-815e-298b89835c1f"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:48:48.814196 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-b3ebbbc0-8f46-4919-8483-99c28c949e53 req-95aaa5ec-163c-4817-a235-5f218aabdacd service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:48.820065 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-b3ebbbc0-8f46-4919-8483-99c28c949e53 req-95aaa5ec-163c-4817-a235-5f218aabdacd service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:48.820558 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-b3ebbbc0-8f46-4919-8483-99c28c949e53 req-95aaa5ec-163c-4817-a235-5f218aabdacd service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:48.853794 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-b3ebbbc0-8f46-4919-8483-99c28c949e53 req-95aaa5ec-163c-4817-a235-5f218aabdacd service nova] Creating event network-changed:61e69e8f-66c4-464b-815e-298b89835c1f for instance f9938964-5f2f-4093-b5cb-967adbe97623 on n-h2-854823-8 Oct 04 20:48:48.859451 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-b3ebbbc0-8f46-4919-8483-99c28c949e53 req-95aaa5ec-163c-4817-a235-5f218aabdacd service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067109 Oct 04 20:48:48.860853 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1672/3431] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:48:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:48:48.868846 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f9d93c7f-1ad6-48e7-8ca1-81140bf4e561 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:48.869912 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f9d93c7f-1ad6-48e7-8ca1-81140bf4e561 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] [instance: 9df70a8d-757f-4b92-ab73-6ad6cfc98953] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:48.877784 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f9d93c7f-1ad6-48e7-8ca1-81140bf4e561 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:48.878793 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f9d93c7f-1ad6-48e7-8ca1-81140bf4e561 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:48.879556 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f9d93c7f-1ad6-48e7-8ca1-81140bf4e561 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:48.880563 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f9d93c7f-1ad6-48e7-8ca1-81140bf4e561 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:48.881211 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f9d93c7f-1ad6-48e7-8ca1-81140bf4e561 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:48.882135 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f9d93c7f-1ad6-48e7-8ca1-81140bf4e561 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:48.923168 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f9d93c7f-1ad6-48e7-8ca1-81140bf4e561 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] [instance: 9df70a8d-757f-4b92-ab73-6ad6cfc98953] Going to try to terminate instance {{(pid=128801) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:48:49.088624 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f9d93c7f-1ad6-48e7-8ca1-81140bf4e561 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] 10.222.0.33 "DELETE /compute/v2.1/servers/9df70a8d-757f-4b92-ab73-6ad6cfc98953" status: 204 len: 0 microversion: 2.1 time: 0.224328 Oct 04 20:48:49.089813 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1673/3432] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 20:48:48 2022] DELETE /compute/v2.1/servers/9df70a8d-757f-4b92-ab73-6ad6cfc98953 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:48:49.105067 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6ec2da0c-c341-4b0a-95ca-b47a23a2d39a tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Calling method '.version_select at 0x7f3c741baaf0>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:49.150261 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-6ec2da0c-c341-4b0a-95ca-b47a23a2d39a tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] HTTP exception thrown: Image not found. Oct 04 20:48:49.152218 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6ec2da0c-c341-4b0a-95ca-b47a23a2d39a tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Request method failure captured: Oct 04 20:48:49.152218 n-d-854823-8 devstack@n-api.service[128801]: request: DELETE /compute/v2.1/images/283d61a3-e33d-4288-a141-698ab1974c1f HTTP/1.1 Oct 04 20:48:49.152218 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:48:49.152218 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:48:49.152218 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:48:49.152218 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 0 Oct 04 20:48:49.152218 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:48:49.152218 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:48:49.152218 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:48:49.152218 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:48:49.152218 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJtXeGd1OSE1d-q7huwYmQVgHKPB2nY9Y_iBYLSsxIWf0ZLoIsms_J79v8rnvuCcLKCo45bauxqFKnjqGYX1AAx7FYuwRfC4K7DRdTmNl747g3WpVpopQX7HTqkFLqtLUTKzVUP1OfFEQpoHNLwfiO0ITJKfRxWFYCijK5r7I1sZPKU Oct 04 20:48:49.152218 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:48:49.152218 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:48:49.152218 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:48:49.152218 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:48:49.152218 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:48:49.152218 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:48:49.152218 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: 3f3fadcd7d4043daa0a6aba27ba814d5 Oct 04 20:48:49.152218 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-ImagesTestJSON-506982684 Oct 04 20:48:49.152218 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 20:48:49.152218 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 20:48:49.152218 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_3f3fadcd7d4043daa0a6aba27ba814d5", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3f3fadcd7d4043daa0a6aba27ba814d5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3f3fadcd7d4043daa0a6aba27ba814d5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/3f3fadcd7d4043daa0a6aba27ba814d5"}]}] Oct 04 20:48:49.152218 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-ImagesTestJSON-506982684 Oct 04 20:48:49.152218 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: 3f3fadcd7d4043daa0a6aba27ba814d5 Oct 04 20:48:49.152218 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ImagesTestJSON-506982684 Oct 04 20:48:49.152218 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-ImagesTestJSON-506982684-project Oct 04 20:48:49.152218 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:48:49.152218 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:48:49.152218 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: aca59cd50bf74a36bb1e4427cd50fbb3 Oct 04 20:48:49.152218 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-ImagesTestJSON-506982684-project Oct 04 20:48:49.152218 n-d-854823-8 devstack@n-api.service[128801]: method: Oct 04 20:48:49.152218 n-d-854823-8 devstack@n-api.service[128801]: exception: Image not found. Oct 04 20:48:49.152218 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': '283d61a3-e33d-4288-a141-698ab1974c1f'} Oct 04 20:48:49.152218 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:48:49.152218 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:48:49.152218 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 04 20:48:49.152218 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 04 20:48:49.152218 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 20:48:49.152218 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 20:48:49.152218 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 20:48:49.152218 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 20:48:49.152218 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 04 20:48:49.152218 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 04 20:48:49.152218 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 04 20:48:49.152218 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 04 20:48:49.152218 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 20:48:49.152218 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 20:48:49.152218 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 20:48:49.152218 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 20:48:49.152218 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 283d61a3-e33d-4288-a141-698ab1974c1f to delete Oct 04 20:48:49.152218 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:48:49.152218 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:48:49.152218 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:48:49.152218 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:48:49.152218 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 04 20:48:49.152218 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 04 20:48:49.152218 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 04 20:48:49.152218 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 04 20:48:49.152218 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 04 20:48:49.152218 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 04 20:48:49.152218 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 283d61a3-e33d-4288-a141-698ab1974c1f could not be found. Oct 04 20:48:49.152218 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:48:49.152218 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:48:49.152218 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:48:49.152218 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:48:49.159472 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:48:49.159472 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:48:49.159472 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:48:49.159472 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:48:49.159472 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:48:49.159472 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:48:49.159472 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:48:49.159472 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:48:49.159472 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 04 20:48:49.159472 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 04 20:48:49.159472 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 20:48:49.159472 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:48:49.159472 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:48:49.159472 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:48:49.159472 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:48:49.159472 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:48:49.159472 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:48:49.159472 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:48:49.159472 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:48:49.159472 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 20:48:49.159472 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:48:49.159472 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6ec2da0c-c341-4b0a-95ca-b47a23a2d39a tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Returning 404 to user: Image not found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:48:49.159472 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-6ec2da0c-c341-4b0a-95ca-b47a23a2d39a tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] 10.222.0.33 "DELETE /compute/v2.1/images/283d61a3-e33d-4288-a141-698ab1974c1f" status: 404 len: 62 microversion: 2.1 time: 0.055354 Oct 04 20:48:49.159472 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1674/3433] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:48:49 2022] DELETE /compute/v2.1/images/283d61a3-e33d-4288-a141-698ab1974c1f => generated 62 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 20:48:49.163740 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-342ccf84-21b5-4aef-9f15-d74069b7b451 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:49.166908 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-342ccf84-21b5-4aef-9f15-d74069b7b451 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] [instance: 9df70a8d-757f-4b92-ab73-6ad6cfc98953] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:49.187378 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-342ccf84-21b5-4aef-9f15-d74069b7b451 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:49.189130 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-342ccf84-21b5-4aef-9f15-d74069b7b451 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:49.193805 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-342ccf84-21b5-4aef-9f15-d74069b7b451 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:49.194800 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-342ccf84-21b5-4aef-9f15-d74069b7b451 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:49.195471 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-342ccf84-21b5-4aef-9f15-d74069b7b451 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:49.196069 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-342ccf84-21b5-4aef-9f15-d74069b7b451 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:49.237998 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-342ccf84-21b5-4aef-9f15-d74069b7b451 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] [instance: 9df70a8d-757f-4b92-ab73-6ad6cfc98953] Going to try to terminate instance {{(pid=128801) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:48:49.302318 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.compute.api [None req-342ccf84-21b5-4aef-9f15-d74069b7b451 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] [instance: 9df70a8d-757f-4b92-ab73-6ad6cfc98953] Instance is already in deleting state, ignoring this request Oct 04 20:48:49.303992 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-342ccf84-21b5-4aef-9f15-d74069b7b451 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] 10.222.0.33 "DELETE /compute/v2.1/servers/9df70a8d-757f-4b92-ab73-6ad6cfc98953" status: 204 len: 0 microversion: 2.1 time: 0.145599 Oct 04 20:48:49.305342 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1675/3434] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 20:48:49 2022] DELETE /compute/v2.1/servers/9df70a8d-757f-4b92-ab73-6ad6cfc98953 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 20:48:49.310793 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9c26312c-9ea4-4d8c-9cbb-f9381e861ccd tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:49.311609 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-9c26312c-9ea4-4d8c-9cbb-f9381e861ccd tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] [instance: 9261e0b2-35ac-40f4-92d5-3b9ffaea23c4] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:49.331928 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-1ce40ef9-0455-4925-8b19-537f3e8a415e tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac650232cc04810b1340dc2f0edadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b0670d1bd99424780a70e69d57a2166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:49.335419 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9c26312c-9ea4-4d8c-9cbb-f9381e861ccd tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:49.339551 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9c26312c-9ea4-4d8c-9cbb-f9381e861ccd tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:49.339551 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9c26312c-9ea4-4d8c-9cbb-f9381e861ccd tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:49.339551 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9c26312c-9ea4-4d8c-9cbb-f9381e861ccd tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:49.340102 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9c26312c-9ea4-4d8c-9cbb-f9381e861ccd tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:49.340890 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9c26312c-9ea4-4d8c-9cbb-f9381e861ccd tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:49.347656 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-1ce40ef9-0455-4925-8b19-537f3e8a415e tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48" status: 200 len: 1679 microversion: 2.1 time: 0.920093 Oct 04 20:48:49.368609 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1760/3435] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:48:48 2022] GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48 => generated 1679 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:48:49.376656 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-390f02b8-cda3-43f2-a852-b80b419c933c tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:49.379545 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-390f02b8-cda3-43f2-a852-b80b419c933c tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] [instance: 9df70a8d-757f-4b92-ab73-6ad6cfc98953] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:49.389208 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-390f02b8-cda3-43f2-a852-b80b419c933c tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:49.389940 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-390f02b8-cda3-43f2-a852-b80b419c933c tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:49.390805 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-390f02b8-cda3-43f2-a852-b80b419c933c tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:49.392370 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-390f02b8-cda3-43f2-a852-b80b419c933c tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:49.394231 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-390f02b8-cda3-43f2-a852-b80b419c933c tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:49.394931 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-390f02b8-cda3-43f2-a852-b80b419c933c tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:49.402810 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=8 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:48:50.014331 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-390f02b8-cda3-43f2-a852-b80b419c933c tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aca59cd50bf74a36bb1e4427cd50fbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3fadcd7d4043daa0a6aba27ba814d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:50.027091 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-390f02b8-cda3-43f2-a852-b80b419c933c tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] 10.222.0.33 "GET /compute/v2.1/servers/9df70a8d-757f-4b92-ab73-6ad6cfc98953" status: 200 len: 1494 microversion: 2.1 time: 0.656395 Oct 04 20:48:50.030652 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1761/3436] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:48:49 2022] GET /compute/v2.1/servers/9df70a8d-757f-4b92-ab73-6ad6cfc98953 => generated 1494 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:48:50.040341 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-9b636422-2876-4e18-94d4-00668c15899b tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:50.041254 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-9b636422-2876-4e18-94d4-00668c15899b tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] [instance: 8526b237-847c-47b7-9f0b-8209c9a07b95] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:50.049467 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9b636422-2876-4e18-94d4-00668c15899b tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:50.050287 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9b636422-2876-4e18-94d4-00668c15899b tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:50.051089 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9b636422-2876-4e18-94d4-00668c15899b tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:50.052010 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9b636422-2876-4e18-94d4-00668c15899b tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:50.052665 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9b636422-2876-4e18-94d4-00668c15899b tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:50.053419 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9b636422-2876-4e18-94d4-00668c15899b tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:50.197797 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-9c26312c-9ea4-4d8c-9cbb-f9381e861ccd tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8397c96a6dd4c65bdde07c91ca5e7fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09101effe9da463dabc2edaccdb83e06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:50.208714 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-9c26312c-9ea4-4d8c-9cbb-f9381e861ccd tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] 10.222.0.33 "GET /compute/v2.1/servers/9261e0b2-35ac-40f4-92d5-3b9ffaea23c4" status: 200 len: 1367 microversion: 2.1 time: 0.902131 Oct 04 20:48:50.227109 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1676/3437] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:48:49 2022] GET /compute/v2.1/servers/9261e0b2-35ac-40f4-92d5-3b9ffaea23c4 => generated 1367 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:48:50.232974 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-eb813a66-4954-4b9c-8259-1ed7023d0e4e req-8789a4e2-503a-49fb-b0c9-b155605ed4e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9df70a8d-757f-4b92-ab73-6ad6cfc98953", "name": "network-vif-plugged", "status": "completed", "tag": "1c3eba25-64e5-469d-8f64-96e322b2e424"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:48:50.249430 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-eb813a66-4954-4b9c-8259-1ed7023d0e4e req-8789a4e2-503a-49fb-b0c9-b155605ed4e3 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:50.250104 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-eb813a66-4954-4b9c-8259-1ed7023d0e4e req-8789a4e2-503a-49fb-b0c9-b155605ed4e3 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:50.254769 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-eb813a66-4954-4b9c-8259-1ed7023d0e4e req-8789a4e2-503a-49fb-b0c9-b155605ed4e3 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:50.286991 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-eb813a66-4954-4b9c-8259-1ed7023d0e4e req-8789a4e2-503a-49fb-b0c9-b155605ed4e3 service nova] Creating event network-vif-plugged:1c3eba25-64e5-469d-8f64-96e322b2e424 for instance 9df70a8d-757f-4b92-ab73-6ad6cfc98953 on n-h1-854823-8 Oct 04 20:48:50.294536 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-eb813a66-4954-4b9c-8259-1ed7023d0e4e req-8789a4e2-503a-49fb-b0c9-b155605ed4e3 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064806 Oct 04 20:48:50.295982 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1677/3438] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:48:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:48:50.380629 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-59519e3e-c888-4827-b3f5-7f803d951d7d tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:50.381889 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-59519e3e-c888-4827-b3f5-7f803d951d7d tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: 4d46fff2-b04d-41aa-ada0-2023ab545b48] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:50.395412 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-59519e3e-c888-4827-b3f5-7f803d951d7d tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:50.396187 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-59519e3e-c888-4827-b3f5-7f803d951d7d tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:50.396955 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-59519e3e-c888-4827-b3f5-7f803d951d7d tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:50.397833 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-59519e3e-c888-4827-b3f5-7f803d951d7d tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:50.398483 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-59519e3e-c888-4827-b3f5-7f803d951d7d tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:50.399214 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-59519e3e-c888-4827-b3f5-7f803d951d7d tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:50.735175 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-9b636422-2876-4e18-94d4-00668c15899b tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6775b9d82b3444f6b728736f1d2b2806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5338cf2146344042bc263bdc4f9d822b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:50.744906 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-9b636422-2876-4e18-94d4-00668c15899b tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] 10.222.0.33 "GET /compute/v2.1/servers/8526b237-847c-47b7-9f0b-8209c9a07b95" status: 200 len: 1316 microversion: 2.1 time: 0.712940 Oct 04 20:48:50.750528 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1762/3439] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:48:50 2022] GET /compute/v2.1/servers/8526b237-847c-47b7-9f0b-8209c9a07b95 => generated 1316 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:48:50.752310 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-9b636422-2876-4e18-94d4-00668c15899b tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:50.759489 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-9b636422-2876-4e18-94d4-00668c15899b tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] 10.222.0.33 "GET /compute//" status: 200 len: 377 microversion: - time: 0.007822 Oct 04 20:48:50.760382 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1763/3440] 10.222.0.33 () {56 vars in 886 bytes} [Tue Oct 4 20:48:50 2022] GET /compute/ => generated 377 bytes in 9 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 04 20:48:50.770599 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-9b636422-2876-4e18-94d4-00668c15899b tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:50.771876 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-9b636422-2876-4e18-94d4-00668c15899b tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] 10.222.0.33 "GET /compute/v2/" status: 200 len: 379 microversion: 2.1 time: 0.003067 Oct 04 20:48:50.772786 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1764/3441] 10.222.0.33 () {54 vars in 1035 bytes} [Tue Oct 4 20:48:50 2022] GET /compute/v2/ => generated 379 bytes in 5 msecs (HTTP/1.1 200) 5 headers in 221 bytes (2 switches on core 0) Oct 04 20:48:50.800524 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-9b636422-2876-4e18-94d4-00668c15899b tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:50.801567 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-9b636422-2876-4e18-94d4-00668c15899b tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] 10.222.0.33 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001938 Oct 04 20:48:50.820233 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1765/3442] 10.222.0.33 () {54 vars in 1041 bytes} [Tue Oct 4 20:48:50 2022] GET /compute/v2.1/ => generated 388 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 20:48:50.821467 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-9b636422-2876-4e18-94d4-00668c15899b tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:50.822452 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-9b636422-2876-4e18-94d4-00668c15899b tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] 10.222.0.33 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001303 Oct 04 20:48:50.823858 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1766/3443] 10.222.0.33 () {56 vars in 886 bytes} [Tue Oct 4 20:48:50 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 04 20:48:50.912200 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-92137ccb-e527-46b4-82f4-067552614e57 req-5f0270ad-8e85-4967-9065-a081b2e3a713 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8526b237-847c-47b7-9f0b-8209c9a07b95", "tag": "8d64ffa9-7f66-45e5-ab1c-7b451118f90e"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:48:50.937449 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-92137ccb-e527-46b4-82f4-067552614e57 req-5f0270ad-8e85-4967-9065-a081b2e3a713 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:50.938156 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-92137ccb-e527-46b4-82f4-067552614e57 req-5f0270ad-8e85-4967-9065-a081b2e3a713 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:50.938819 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-92137ccb-e527-46b4-82f4-067552614e57 req-5f0270ad-8e85-4967-9065-a081b2e3a713 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:50.980220 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-92137ccb-e527-46b4-82f4-067552614e57 req-5f0270ad-8e85-4967-9065-a081b2e3a713 service nova] Creating event network-changed:8d64ffa9-7f66-45e5-ab1c-7b451118f90e for instance 8526b237-847c-47b7-9f0b-8209c9a07b95 on n-h1-854823-8 Oct 04 20:48:51.004880 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-92137ccb-e527-46b4-82f4-067552614e57 req-5f0270ad-8e85-4967-9065-a081b2e3a713 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096553 Oct 04 20:48:51.008544 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1767/3444] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:48:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:48:51.055730 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-59f25a39-2968-4cab-bacc-6854565163bf tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:51.056433 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-59f25a39-2968-4cab-bacc-6854565163bf tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] [instance: 9df70a8d-757f-4b92-ab73-6ad6cfc98953] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:51.075666 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-59f25a39-2968-4cab-bacc-6854565163bf tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:51.076222 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-59f25a39-2968-4cab-bacc-6854565163bf tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:51.076664 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-59f25a39-2968-4cab-bacc-6854565163bf tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:51.077398 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-59f25a39-2968-4cab-bacc-6854565163bf tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:51.077851 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-59f25a39-2968-4cab-bacc-6854565163bf tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:51.078276 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-59f25a39-2968-4cab-bacc-6854565163bf tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:51.495676 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-59519e3e-c888-4827-b3f5-7f803d951d7d tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac650232cc04810b1340dc2f0edadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b0670d1bd99424780a70e69d57a2166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:51.511453 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-59519e3e-c888-4827-b3f5-7f803d951d7d tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48" status: 200 len: 1679 microversion: 2.1 time: 1.138941 Oct 04 20:48:51.530862 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1678/3445] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:48:50 2022] GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48 => generated 1679 bytes in 1159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:48:51.546222 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0aa66f71-7461-4fba-a830-7d385dea1142 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:51.552679 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-0aa66f71-7461-4fba-a830-7d385dea1142 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] [instance: 9261e0b2-35ac-40f4-92d5-3b9ffaea23c4] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:51.575805 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0aa66f71-7461-4fba-a830-7d385dea1142 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:51.576849 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0aa66f71-7461-4fba-a830-7d385dea1142 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:51.577918 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0aa66f71-7461-4fba-a830-7d385dea1142 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:51.579221 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0aa66f71-7461-4fba-a830-7d385dea1142 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:51.587141 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0aa66f71-7461-4fba-a830-7d385dea1142 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:51.589077 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0aa66f71-7461-4fba-a830-7d385dea1142 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:51.901642 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-59f25a39-2968-4cab-bacc-6854565163bf tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aca59cd50bf74a36bb1e4427cd50fbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3fadcd7d4043daa0a6aba27ba814d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:51.920308 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-59f25a39-2968-4cab-bacc-6854565163bf tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] 10.222.0.33 "GET /compute/v2.1/servers/9df70a8d-757f-4b92-ab73-6ad6cfc98953" status: 200 len: 1494 microversion: 2.1 time: 0.865940 Oct 04 20:48:51.925522 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1768/3446] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:48:51 2022] GET /compute/v2.1/servers/9df70a8d-757f-4b92-ab73-6ad6cfc98953 => generated 1494 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:48:51.948255 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-cd9a1569-0ae6-43b7-a9bb-554f237b4884 req-132cebb9-31e9-4d56-8152-69c3f8220f86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9df70a8d-757f-4b92-ab73-6ad6cfc98953", "name": "network-vif-deleted", "tag": "1c3eba25-64e5-469d-8f64-96e322b2e424"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:48:51.998791 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-cd9a1569-0ae6-43b7-a9bb-554f237b4884 req-132cebb9-31e9-4d56-8152-69c3f8220f86 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:51.999291 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-cd9a1569-0ae6-43b7-a9bb-554f237b4884 req-132cebb9-31e9-4d56-8152-69c3f8220f86 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:52.004838 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-cd9a1569-0ae6-43b7-a9bb-554f237b4884 req-132cebb9-31e9-4d56-8152-69c3f8220f86 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:52.053051 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-cd9a1569-0ae6-43b7-a9bb-554f237b4884 req-132cebb9-31e9-4d56-8152-69c3f8220f86 service nova] Creating event network-vif-deleted:1c3eba25-64e5-469d-8f64-96e322b2e424 for instance 9df70a8d-757f-4b92-ab73-6ad6cfc98953 on n-h1-854823-8 Oct 04 20:48:52.074486 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-cd9a1569-0ae6-43b7-a9bb-554f237b4884 req-132cebb9-31e9-4d56-8152-69c3f8220f86 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.146737 Oct 04 20:48:52.076789 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1769/3447] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:48:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:48:52.088206 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-1d8adabc-1c1e-4c0a-bfbe-6311a04717dc tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:52.088924 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-1d8adabc-1c1e-4c0a-bfbe-6311a04717dc tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] [instance: 8526b237-847c-47b7-9f0b-8209c9a07b95] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:52.107255 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1d8adabc-1c1e-4c0a-bfbe-6311a04717dc tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:52.109507 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1d8adabc-1c1e-4c0a-bfbe-6311a04717dc tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:52.109967 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1d8adabc-1c1e-4c0a-bfbe-6311a04717dc tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:52.114444 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1d8adabc-1c1e-4c0a-bfbe-6311a04717dc tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:52.115229 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1d8adabc-1c1e-4c0a-bfbe-6311a04717dc tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:52.115830 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1d8adabc-1c1e-4c0a-bfbe-6311a04717dc tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:53.275029 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-0aa66f71-7461-4fba-a830-7d385dea1142 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8397c96a6dd4c65bdde07c91ca5e7fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09101effe9da463dabc2edaccdb83e06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:53.290966 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-0aa66f71-7461-4fba-a830-7d385dea1142 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] 10.222.0.33 "GET /compute/v2.1/servers/9261e0b2-35ac-40f4-92d5-3b9ffaea23c4" status: 200 len: 1367 microversion: 2.1 time: 1.750193 Oct 04 20:48:53.291906 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1679/3448] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:48:51 2022] GET /compute/v2.1/servers/9261e0b2-35ac-40f4-92d5-3b9ffaea23c4 => generated 1367 bytes in 1760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:48:53.297670 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-258de790-d93f-4af5-ae11-65bd321b732f req-10befe39-477f-4d16-b96b-94c65cebcefc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9df70a8d-757f-4b92-ab73-6ad6cfc98953", "name": "network-vif-unplugged", "status": "completed", "tag": "1c3eba25-64e5-469d-8f64-96e322b2e424"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:48:53.318970 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-258de790-d93f-4af5-ae11-65bd321b732f req-10befe39-477f-4d16-b96b-94c65cebcefc service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:53.319608 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-258de790-d93f-4af5-ae11-65bd321b732f req-10befe39-477f-4d16-b96b-94c65cebcefc service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:53.320046 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-258de790-d93f-4af5-ae11-65bd321b732f req-10befe39-477f-4d16-b96b-94c65cebcefc service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:53.342438 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-258de790-d93f-4af5-ae11-65bd321b732f req-10befe39-477f-4d16-b96b-94c65cebcefc service nova] Creating event network-vif-unplugged:1c3eba25-64e5-469d-8f64-96e322b2e424 for instance 9df70a8d-757f-4b92-ab73-6ad6cfc98953 on n-h1-854823-8 Oct 04 20:48:53.348497 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-258de790-d93f-4af5-ae11-65bd321b732f req-10befe39-477f-4d16-b96b-94c65cebcefc service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.055385 Oct 04 20:48:53.349635 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1680/3449] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:48:53 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:48:53.355871 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-daf612b0-9abe-4c1f-bfa8-81364a1ce59f tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:53.356865 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-daf612b0-9abe-4c1f-bfa8-81364a1ce59f tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: 4d46fff2-b04d-41aa-ada0-2023ab545b48] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:53.364205 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-daf612b0-9abe-4c1f-bfa8-81364a1ce59f tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:53.365007 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-daf612b0-9abe-4c1f-bfa8-81364a1ce59f tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:53.365629 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-daf612b0-9abe-4c1f-bfa8-81364a1ce59f tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:53.366546 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-daf612b0-9abe-4c1f-bfa8-81364a1ce59f tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:53.367815 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-daf612b0-9abe-4c1f-bfa8-81364a1ce59f tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:53.368411 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-daf612b0-9abe-4c1f-bfa8-81364a1ce59f tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:53.373695 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:48:53.438462 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-1d8adabc-1c1e-4c0a-bfbe-6311a04717dc tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6775b9d82b3444f6b728736f1d2b2806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5338cf2146344042bc263bdc4f9d822b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:53.451392 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-1d8adabc-1c1e-4c0a-bfbe-6311a04717dc tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] 10.222.0.33 "GET /compute/v2.1/servers/8526b237-847c-47b7-9f0b-8209c9a07b95" status: 200 len: 1316 microversion: 2.1 time: 1.371906 Oct 04 20:48:53.452589 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1770/3450] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:48:52 2022] GET /compute/v2.1/servers/8526b237-847c-47b7-9f0b-8209c9a07b95 => generated 1316 bytes in 1375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:48:53.464786 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-0892e0fc-a566-4a3d-801c-fca766d8748d tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:53.467116 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-0892e0fc-a566-4a3d-801c-fca766d8748d tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] [instance: 9df70a8d-757f-4b92-ab73-6ad6cfc98953] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:53.485284 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0892e0fc-a566-4a3d-801c-fca766d8748d tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:53.485793 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0892e0fc-a566-4a3d-801c-fca766d8748d tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:53.486306 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0892e0fc-a566-4a3d-801c-fca766d8748d tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:53.487061 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0892e0fc-a566-4a3d-801c-fca766d8748d tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:53.487518 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0892e0fc-a566-4a3d-801c-fca766d8748d tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:53.487946 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0892e0fc-a566-4a3d-801c-fca766d8748d tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:53.513645 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.wsgi [None req-0892e0fc-a566-4a3d-801c-fca766d8748d tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] HTTP exception thrown: Instance 9df70a8d-757f-4b92-ab73-6ad6cfc98953 could not be found. Oct 04 20:48:53.515524 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-0892e0fc-a566-4a3d-801c-fca766d8748d tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Request method failure captured: Oct 04 20:48:53.515524 n-d-854823-8 devstack@n-api.service[128802]: request: GET /compute/v2.1/servers/9df70a8d-757f-4b92-ab73-6ad6cfc98953 HTTP/1.1 Oct 04 20:48:53.515524 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 20:48:53.515524 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 20:48:53.515524 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 20:48:53.515524 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 0 Oct 04 20:48:53.515524 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 20:48:53.515524 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 20:48:53.515524 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 20:48:53.515524 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 20:48:53.515524 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPJtXeGd1OSE1d-q7huwYmQVgHKPB2nY9Y_iBYLSsxIWf0ZLoIsms_J79v8rnvuCcLKCo45bauxqFKnjqGYX1AAx7FYuwRfC4K7DRdTmNl747g3WpVpopQX7HTqkFLqtLUTKzVUP1OfFEQpoHNLwfiO0ITJKfRxWFYCijK5r7I1sZPKU Oct 04 20:48:53.515524 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 20:48:53.515524 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 20:48:53.515524 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 20:48:53.515524 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 20:48:53.515524 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 20:48:53.515524 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 20:48:53.515524 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: 3f3fadcd7d4043daa0a6aba27ba814d5 Oct 04 20:48:53.515524 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-ImagesTestJSON-506982684 Oct 04 20:48:53.515524 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 20:48:53.515524 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 20:48:53.515524 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_3f3fadcd7d4043daa0a6aba27ba814d5", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3f3fadcd7d4043daa0a6aba27ba814d5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3f3fadcd7d4043daa0a6aba27ba814d5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/3f3fadcd7d4043daa0a6aba27ba814d5"}]}] Oct 04 20:48:53.515524 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-ImagesTestJSON-506982684 Oct 04 20:48:53.515524 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: 3f3fadcd7d4043daa0a6aba27ba814d5 Oct 04 20:48:53.515524 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-ImagesTestJSON-506982684 Oct 04 20:48:53.515524 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-ImagesTestJSON-506982684-project Oct 04 20:48:53.515524 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 20:48:53.515524 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 20:48:53.515524 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: aca59cd50bf74a36bb1e4427cd50fbb3 Oct 04 20:48:53.515524 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-ImagesTestJSON-506982684-project Oct 04 20:48:53.515524 n-d-854823-8 devstack@n-api.service[128802]: method: > Oct 04 20:48:53.515524 n-d-854823-8 devstack@n-api.service[128802]: exception: Instance 9df70a8d-757f-4b92-ab73-6ad6cfc98953 could not be found. Oct 04 20:48:53.515524 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'id': '9df70a8d-757f-4b92-ab73-6ad6cfc98953'} Oct 04 20:48:53.515524 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:48:53.515524 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:48:53.515524 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:48:53.515524 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:48:53.515524 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:48:53.515524 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:48:53.515524 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:48:53.515524 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:48:53.515524 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:48:53.515524 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:48:53.515524 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9df70a8d-757f-4b92-ab73-6ad6cfc98953 could not be found. Oct 04 20:48:53.515524 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:48:53.515524 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:48:53.515524 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:48:53.515524 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:48:53.515524 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:48:53.515524 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:48:53.515524 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:48:53.515524 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:48:53.515524 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:48:53.515524 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:48:53.515524 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:48:53.515524 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:48:53.515524 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:48:53.515524 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:48:53.515524 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:48:53.515524 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:48:53.515524 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9df70a8d-757f-4b92-ab73-6ad6cfc98953 could not be found. Oct 04 20:48:53.515524 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:48:53.515524 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:48:53.515524 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:48:53.515524 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:48:53.521900 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:48:53.521900 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:48:53.521900 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:48:53.521900 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:48:53.521900 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9df70a8d-757f-4b92-ab73-6ad6cfc98953 could not be found. Oct 04 20:48:53.521900 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:48:53.521900 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-0892e0fc-a566-4a3d-801c-fca766d8748d tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Returning 404 to user: Instance 9df70a8d-757f-4b92-ab73-6ad6cfc98953 could not be found. {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:48:53.525246 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-0892e0fc-a566-4a3d-801c-fca766d8748d tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] 10.222.0.33 "GET /compute/v2.1/servers/9df70a8d-757f-4b92-ab73-6ad6cfc98953" status: 404 len: 111 microversion: 2.1 time: 0.070281 Oct 04 20:48:53.525822 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1771/3451] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:48:53 2022] GET /compute/v2.1/servers/9df70a8d-757f-4b92-ab73-6ad6cfc98953 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:48:53.544602 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-a975d38c-28b3-4c2e-938e-38ade8c52574 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Calling method '.version_select at 0x7f3c78957820>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:53.584781 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.wsgi [None req-a975d38c-28b3-4c2e-938e-38ade8c52574 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] HTTP exception thrown: Image not found. Oct 04 20:48:53.588927 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-a975d38c-28b3-4c2e-938e-38ade8c52574 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Request method failure captured: Oct 04 20:48:53.588927 n-d-854823-8 devstack@n-api.service[128802]: request: DELETE /compute/v2.1/images/802658f0-2596-4fe9-ad73-90b1f8423ede HTTP/1.1 Oct 04 20:48:53.588927 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 20:48:53.588927 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 20:48:53.588927 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 20:48:53.588927 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 0 Oct 04 20:48:53.588927 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 20:48:53.588927 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 20:48:53.588927 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 20:48:53.588927 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 20:48:53.588927 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPJtXeGd1OSE1d-q7huwYmQVgHKPB2nY9Y_iBYLSsxIWf0ZLoIsms_J79v8rnvuCcLKCo45bauxqFKnjqGYX1AAx7FYuwRfC4K7DRdTmNl747g3WpVpopQX7HTqkFLqtLUTKzVUP1OfFEQpoHNLwfiO0ITJKfRxWFYCijK5r7I1sZPKU Oct 04 20:48:53.588927 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 20:48:53.588927 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 20:48:53.588927 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 20:48:53.588927 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 20:48:53.588927 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 20:48:53.588927 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 20:48:53.588927 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: 3f3fadcd7d4043daa0a6aba27ba814d5 Oct 04 20:48:53.588927 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-ImagesTestJSON-506982684 Oct 04 20:48:53.588927 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 20:48:53.588927 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 20:48:53.588927 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_3f3fadcd7d4043daa0a6aba27ba814d5", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3f3fadcd7d4043daa0a6aba27ba814d5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3f3fadcd7d4043daa0a6aba27ba814d5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/3f3fadcd7d4043daa0a6aba27ba814d5"}]}] Oct 04 20:48:53.588927 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-ImagesTestJSON-506982684 Oct 04 20:48:53.588927 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: 3f3fadcd7d4043daa0a6aba27ba814d5 Oct 04 20:48:53.588927 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-ImagesTestJSON-506982684 Oct 04 20:48:53.588927 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-ImagesTestJSON-506982684-project Oct 04 20:48:53.588927 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 20:48:53.588927 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 20:48:53.588927 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: aca59cd50bf74a36bb1e4427cd50fbb3 Oct 04 20:48:53.588927 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-ImagesTestJSON-506982684-project Oct 04 20:48:53.588927 n-d-854823-8 devstack@n-api.service[128802]: method: Oct 04 20:48:53.588927 n-d-854823-8 devstack@n-api.service[128802]: exception: Image not found. Oct 04 20:48:53.588927 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'id': '802658f0-2596-4fe9-ad73-90b1f8423ede'} Oct 04 20:48:53.588927 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:48:53.588927 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:48:53.588927 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 04 20:48:53.588927 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 04 20:48:53.588927 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 20:48:53.588927 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 20:48:53.588927 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 20:48:53.588927 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 20:48:53.588927 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 04 20:48:53.588927 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 04 20:48:53.588927 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 04 20:48:53.588927 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 04 20:48:53.588927 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 20:48:53.588927 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 20:48:53.588927 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 20:48:53.588927 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 20:48:53.588927 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 802658f0-2596-4fe9-ad73-90b1f8423ede to delete Oct 04 20:48:53.588927 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:48:53.588927 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:48:53.588927 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:48:53.588927 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:48:53.588927 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 04 20:48:53.588927 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 04 20:48:53.588927 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 04 20:48:53.588927 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 04 20:48:53.588927 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 04 20:48:53.588927 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 04 20:48:53.588927 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 802658f0-2596-4fe9-ad73-90b1f8423ede could not be found. Oct 04 20:48:53.588927 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:48:53.588927 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:48:53.588927 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:48:53.588927 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:48:53.593791 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:48:53.593791 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:48:53.593791 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:48:53.593791 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:48:53.593791 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:48:53.593791 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:48:53.593791 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:48:53.593791 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:48:53.593791 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 04 20:48:53.593791 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 04 20:48:53.593791 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 20:48:53.593791 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:48:53.593791 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:48:53.593791 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:48:53.593791 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:48:53.593791 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:48:53.593791 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:48:53.593791 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:48:53.593791 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:48:53.593791 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 20:48:53.593791 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:48:53.598994 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-a975d38c-28b3-4c2e-938e-38ade8c52574 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Returning 404 to user: Image not found. {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:48:53.600033 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-a975d38c-28b3-4c2e-938e-38ade8c52574 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] 10.222.0.33 "DELETE /compute/v2.1/images/802658f0-2596-4fe9-ad73-90b1f8423ede" status: 404 len: 62 microversion: 2.1 time: 0.069985 Oct 04 20:48:53.601082 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1772/3452] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:48:53 2022] DELETE /compute/v2.1/images/802658f0-2596-4fe9-ad73-90b1f8423ede => generated 62 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 20:48:53.609819 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-a6cfe434-d1c2-4f5b-8815-6a3fa3e0efe4 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:53.612447 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-a6cfe434-d1c2-4f5b-8815-6a3fa3e0efe4 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] [instance: 8e0006b2-ed59-4ad1-a921-d1db19cb97b6] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:53.632185 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a6cfe434-d1c2-4f5b-8815-6a3fa3e0efe4 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:53.633091 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a6cfe434-d1c2-4f5b-8815-6a3fa3e0efe4 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:53.634957 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a6cfe434-d1c2-4f5b-8815-6a3fa3e0efe4 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:53.636670 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a6cfe434-d1c2-4f5b-8815-6a3fa3e0efe4 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:53.639081 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a6cfe434-d1c2-4f5b-8815-6a3fa3e0efe4 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:53.639843 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a6cfe434-d1c2-4f5b-8815-6a3fa3e0efe4 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:53.668128 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.wsgi [None req-a6cfe434-d1c2-4f5b-8815-6a3fa3e0efe4 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] HTTP exception thrown: Instance 8e0006b2-ed59-4ad1-a921-d1db19cb97b6 could not be found. Oct 04 20:48:53.676875 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-a6cfe434-d1c2-4f5b-8815-6a3fa3e0efe4 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Request method failure captured: Oct 04 20:48:53.676875 n-d-854823-8 devstack@n-api.service[128802]: request: DELETE /compute/v2.1/servers/8e0006b2-ed59-4ad1-a921-d1db19cb97b6 HTTP/1.1 Oct 04 20:48:53.676875 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 20:48:53.676875 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 20:48:53.676875 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 20:48:53.676875 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 0 Oct 04 20:48:53.676875 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 20:48:53.676875 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 20:48:53.676875 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 20:48:53.676875 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 20:48:53.676875 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPJtXeGd1OSE1d-q7huwYmQVgHKPB2nY9Y_iBYLSsxIWf0ZLoIsms_J79v8rnvuCcLKCo45bauxqFKnjqGYX1AAx7FYuwRfC4K7DRdTmNl747g3WpVpopQX7HTqkFLqtLUTKzVUP1OfFEQpoHNLwfiO0ITJKfRxWFYCijK5r7I1sZPKU Oct 04 20:48:53.676875 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 20:48:53.676875 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 20:48:53.676875 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 20:48:53.676875 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 20:48:53.676875 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 20:48:53.676875 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 20:48:53.676875 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: 3f3fadcd7d4043daa0a6aba27ba814d5 Oct 04 20:48:53.676875 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-ImagesTestJSON-506982684 Oct 04 20:48:53.676875 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 20:48:53.676875 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 20:48:53.676875 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_3f3fadcd7d4043daa0a6aba27ba814d5", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3f3fadcd7d4043daa0a6aba27ba814d5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3f3fadcd7d4043daa0a6aba27ba814d5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/3f3fadcd7d4043daa0a6aba27ba814d5"}]}] Oct 04 20:48:53.676875 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-ImagesTestJSON-506982684 Oct 04 20:48:53.676875 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: 3f3fadcd7d4043daa0a6aba27ba814d5 Oct 04 20:48:53.676875 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-ImagesTestJSON-506982684 Oct 04 20:48:53.676875 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-ImagesTestJSON-506982684-project Oct 04 20:48:53.676875 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 20:48:53.676875 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 20:48:53.676875 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: aca59cd50bf74a36bb1e4427cd50fbb3 Oct 04 20:48:53.676875 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-ImagesTestJSON-506982684-project Oct 04 20:48:53.676875 n-d-854823-8 devstack@n-api.service[128802]: method: > Oct 04 20:48:53.676875 n-d-854823-8 devstack@n-api.service[128802]: exception: Instance 8e0006b2-ed59-4ad1-a921-d1db19cb97b6 could not be found. Oct 04 20:48:53.676875 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'id': '8e0006b2-ed59-4ad1-a921-d1db19cb97b6'} Oct 04 20:48:53.676875 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:48:53.676875 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:48:53.676875 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:48:53.676875 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:48:53.676875 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:48:53.676875 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:48:53.676875 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:48:53.676875 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:48:53.676875 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:48:53.676875 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:48:53.676875 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e0006b2-ed59-4ad1-a921-d1db19cb97b6 could not be found. Oct 04 20:48:53.676875 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:48:53.676875 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:48:53.676875 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:48:53.676875 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:48:53.676875 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:48:53.676875 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:48:53.676875 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:48:53.676875 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:48:53.676875 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:48:53.676875 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:48:53.676875 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 20:48:53.676875 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 20:48:53.676875 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 20:48:53.676875 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 20:48:53.676875 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:48:53.676875 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:48:53.676875 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:48:53.676875 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:48:53.676875 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e0006b2-ed59-4ad1-a921-d1db19cb97b6 could not be found. Oct 04 20:48:53.683731 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:48:53.683731 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:48:53.683731 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:48:53.683731 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:48:53.683731 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:48:53.683731 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:48:53.683731 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:48:53.683731 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:48:53.683731 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e0006b2-ed59-4ad1-a921-d1db19cb97b6 could not be found. Oct 04 20:48:53.683731 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:48:53.688566 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-a6cfe434-d1c2-4f5b-8815-6a3fa3e0efe4 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Returning 404 to user: Instance 8e0006b2-ed59-4ad1-a921-d1db19cb97b6 could not be found. {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:48:53.690684 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-a6cfe434-d1c2-4f5b-8815-6a3fa3e0efe4 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] 10.222.0.33 "DELETE /compute/v2.1/servers/8e0006b2-ed59-4ad1-a921-d1db19cb97b6" status: 404 len: 111 microversion: 2.1 time: 0.085290 Oct 04 20:48:53.692663 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1773/3453] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 20:48:53 2022] DELETE /compute/v2.1/servers/8e0006b2-ed59-4ad1-a921-d1db19cb97b6 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:48:53.711419 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-dc5c1d0a-6057-40b3-ab32-5b684394dc9e tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:53.712150 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-dc5c1d0a-6057-40b3-ab32-5b684394dc9e tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] [instance: 8e0006b2-ed59-4ad1-a921-d1db19cb97b6] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:53.728313 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dc5c1d0a-6057-40b3-ab32-5b684394dc9e tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:53.730037 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dc5c1d0a-6057-40b3-ab32-5b684394dc9e tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:53.731397 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dc5c1d0a-6057-40b3-ab32-5b684394dc9e tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:53.732226 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dc5c1d0a-6057-40b3-ab32-5b684394dc9e tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:53.734264 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dc5c1d0a-6057-40b3-ab32-5b684394dc9e tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:53.734956 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dc5c1d0a-6057-40b3-ab32-5b684394dc9e tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:53.765088 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.wsgi [None req-dc5c1d0a-6057-40b3-ab32-5b684394dc9e tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] HTTP exception thrown: Instance 8e0006b2-ed59-4ad1-a921-d1db19cb97b6 could not be found. Oct 04 20:48:53.770005 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-daf612b0-9abe-4c1f-bfa8-81364a1ce59f tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac650232cc04810b1340dc2f0edadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b0670d1bd99424780a70e69d57a2166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:53.774857 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-dc5c1d0a-6057-40b3-ab32-5b684394dc9e tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Request method failure captured: Oct 04 20:48:53.774857 n-d-854823-8 devstack@n-api.service[128802]: request: GET /compute/v2.1/servers/8e0006b2-ed59-4ad1-a921-d1db19cb97b6 HTTP/1.1 Oct 04 20:48:53.774857 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 20:48:53.774857 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 20:48:53.774857 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 20:48:53.774857 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 0 Oct 04 20:48:53.774857 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 20:48:53.774857 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 20:48:53.774857 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 20:48:53.774857 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 20:48:53.774857 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPJtXeGd1OSE1d-q7huwYmQVgHKPB2nY9Y_iBYLSsxIWf0ZLoIsms_J79v8rnvuCcLKCo45bauxqFKnjqGYX1AAx7FYuwRfC4K7DRdTmNl747g3WpVpopQX7HTqkFLqtLUTKzVUP1OfFEQpoHNLwfiO0ITJKfRxWFYCijK5r7I1sZPKU Oct 04 20:48:53.774857 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 20:48:53.774857 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 20:48:53.774857 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 20:48:53.774857 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 20:48:53.774857 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 20:48:53.774857 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 20:48:53.774857 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: 3f3fadcd7d4043daa0a6aba27ba814d5 Oct 04 20:48:53.774857 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-ImagesTestJSON-506982684 Oct 04 20:48:53.774857 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 20:48:53.774857 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 20:48:53.774857 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_3f3fadcd7d4043daa0a6aba27ba814d5", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3f3fadcd7d4043daa0a6aba27ba814d5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3f3fadcd7d4043daa0a6aba27ba814d5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/3f3fadcd7d4043daa0a6aba27ba814d5"}]}] Oct 04 20:48:53.774857 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-ImagesTestJSON-506982684 Oct 04 20:48:53.774857 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: 3f3fadcd7d4043daa0a6aba27ba814d5 Oct 04 20:48:53.774857 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-ImagesTestJSON-506982684 Oct 04 20:48:53.774857 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-ImagesTestJSON-506982684-project Oct 04 20:48:53.774857 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 20:48:53.774857 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 20:48:53.774857 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: aca59cd50bf74a36bb1e4427cd50fbb3 Oct 04 20:48:53.774857 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-ImagesTestJSON-506982684-project Oct 04 20:48:53.774857 n-d-854823-8 devstack@n-api.service[128802]: method: > Oct 04 20:48:53.774857 n-d-854823-8 devstack@n-api.service[128802]: exception: Instance 8e0006b2-ed59-4ad1-a921-d1db19cb97b6 could not be found. Oct 04 20:48:53.774857 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'id': '8e0006b2-ed59-4ad1-a921-d1db19cb97b6'} Oct 04 20:48:53.774857 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:48:53.774857 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:48:53.774857 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:48:53.774857 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:48:53.774857 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:48:53.774857 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:48:53.774857 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:48:53.774857 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:48:53.774857 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:48:53.774857 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:48:53.774857 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e0006b2-ed59-4ad1-a921-d1db19cb97b6 could not be found. Oct 04 20:48:53.774857 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:48:53.774857 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:48:53.774857 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:48:53.774857 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:48:53.774857 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:48:53.774857 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:48:53.774857 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:48:53.774857 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:48:53.774857 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:48:53.774857 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:48:53.774857 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:48:53.774857 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:48:53.774857 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:48:53.774857 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:48:53.774857 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:48:53.774857 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:48:53.774857 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e0006b2-ed59-4ad1-a921-d1db19cb97b6 could not be found. Oct 04 20:48:53.774857 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:48:53.774857 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:48:53.774857 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:48:53.774857 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:48:53.780146 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:48:53.780146 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:48:53.780146 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:48:53.780146 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:48:53.780146 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e0006b2-ed59-4ad1-a921-d1db19cb97b6 could not be found. Oct 04 20:48:53.780146 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:48:53.781843 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-dc5c1d0a-6057-40b3-ab32-5b684394dc9e tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Returning 404 to user: Instance 8e0006b2-ed59-4ad1-a921-d1db19cb97b6 could not be found. {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:48:53.782898 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-dc5c1d0a-6057-40b3-ab32-5b684394dc9e tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] 10.222.0.33 "GET /compute/v2.1/servers/8e0006b2-ed59-4ad1-a921-d1db19cb97b6" status: 404 len: 111 microversion: 2.1 time: 0.085199 Oct 04 20:48:53.783974 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1774/3454] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:48:53 2022] GET /compute/v2.1/servers/8e0006b2-ed59-4ad1-a921-d1db19cb97b6 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:48:53.789438 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-daf612b0-9abe-4c1f-bfa8-81364a1ce59f tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48" status: 200 len: 1679 microversion: 2.1 time: 0.438220 Oct 04 20:48:53.802465 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1681/3455] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:48:53 2022] GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48 => generated 1679 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:48:53.811843 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-7d4c70e1-53a6-4138-819b-81472fb84ac6 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Calling method '.version_select at 0x7f3c74778c10>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:53.841464 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.wsgi [None req-7d4c70e1-53a6-4138-819b-81472fb84ac6 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] HTTP exception thrown: Image not found. Oct 04 20:48:53.843470 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-7d4c70e1-53a6-4138-819b-81472fb84ac6 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Request method failure captured: Oct 04 20:48:53.843470 n-d-854823-8 devstack@n-api.service[128802]: request: DELETE /compute/v2.1/images/5804f6f0-d786-4197-9403-11c4a65faccd HTTP/1.1 Oct 04 20:48:53.843470 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 20:48:53.843470 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 20:48:53.843470 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 20:48:53.843470 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 0 Oct 04 20:48:53.843470 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 20:48:53.843470 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 20:48:53.843470 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 20:48:53.843470 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 20:48:53.843470 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPJtXeGd1OSE1d-q7huwYmQVgHKPB2nY9Y_iBYLSsxIWf0ZLoIsms_J79v8rnvuCcLKCo45bauxqFKnjqGYX1AAx7FYuwRfC4K7DRdTmNl747g3WpVpopQX7HTqkFLqtLUTKzVUP1OfFEQpoHNLwfiO0ITJKfRxWFYCijK5r7I1sZPKU Oct 04 20:48:53.843470 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 20:48:53.843470 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 20:48:53.843470 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 20:48:53.843470 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 20:48:53.843470 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 20:48:53.843470 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 20:48:53.843470 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: 3f3fadcd7d4043daa0a6aba27ba814d5 Oct 04 20:48:53.843470 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-ImagesTestJSON-506982684 Oct 04 20:48:53.843470 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 20:48:53.843470 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 20:48:53.843470 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_3f3fadcd7d4043daa0a6aba27ba814d5", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3f3fadcd7d4043daa0a6aba27ba814d5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3f3fadcd7d4043daa0a6aba27ba814d5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/3f3fadcd7d4043daa0a6aba27ba814d5"}]}] Oct 04 20:48:53.843470 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-ImagesTestJSON-506982684 Oct 04 20:48:53.843470 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: 3f3fadcd7d4043daa0a6aba27ba814d5 Oct 04 20:48:53.843470 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-ImagesTestJSON-506982684 Oct 04 20:48:53.843470 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-ImagesTestJSON-506982684-project Oct 04 20:48:53.843470 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 20:48:53.843470 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 20:48:53.843470 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: aca59cd50bf74a36bb1e4427cd50fbb3 Oct 04 20:48:53.843470 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-ImagesTestJSON-506982684-project Oct 04 20:48:53.843470 n-d-854823-8 devstack@n-api.service[128802]: method: Oct 04 20:48:53.843470 n-d-854823-8 devstack@n-api.service[128802]: exception: Image not found. Oct 04 20:48:53.843470 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'id': '5804f6f0-d786-4197-9403-11c4a65faccd'} Oct 04 20:48:53.843470 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:48:53.843470 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:48:53.843470 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 04 20:48:53.843470 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 04 20:48:53.843470 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 20:48:53.843470 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 20:48:53.843470 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 20:48:53.843470 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 20:48:53.843470 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 04 20:48:53.843470 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 04 20:48:53.843470 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 04 20:48:53.843470 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 04 20:48:53.843470 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 20:48:53.843470 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 20:48:53.843470 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 20:48:53.843470 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 20:48:53.843470 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 5804f6f0-d786-4197-9403-11c4a65faccd to delete Oct 04 20:48:53.843470 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:48:53.843470 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:48:53.843470 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:48:53.843470 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:48:53.843470 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 04 20:48:53.843470 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 04 20:48:53.843470 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 04 20:48:53.843470 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 04 20:48:53.843470 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 04 20:48:53.843470 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 04 20:48:53.843470 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 5804f6f0-d786-4197-9403-11c4a65faccd could not be found. Oct 04 20:48:53.843470 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:48:53.843470 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:48:53.843470 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:48:53.843470 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:48:53.848617 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:48:53.848617 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:48:53.848617 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:48:53.848617 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:48:53.848617 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:48:53.848617 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:48:53.848617 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:48:53.848617 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:48:53.848617 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 04 20:48:53.848617 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 04 20:48:53.848617 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 20:48:53.848617 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:48:53.848617 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:48:53.848617 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:48:53.848617 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:48:53.848617 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:48:53.848617 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:48:53.848617 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:48:53.848617 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:48:53.848617 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 20:48:53.848617 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:48:53.852258 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-7d4c70e1-53a6-4138-819b-81472fb84ac6 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Returning 404 to user: Image not found. {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:48:53.852487 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-7d4c70e1-53a6-4138-819b-81472fb84ac6 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] 10.222.0.33 "DELETE /compute/v2.1/images/5804f6f0-d786-4197-9403-11c4a65faccd" status: 404 len: 62 microversion: 2.1 time: 0.062602 Oct 04 20:48:53.854790 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1775/3456] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:48:53 2022] DELETE /compute/v2.1/images/5804f6f0-d786-4197-9403-11c4a65faccd => generated 62 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 20:48:53.864298 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-de9b1c3d-29af-40bc-b911-e14735da7057 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:53.864993 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-de9b1c3d-29af-40bc-b911-e14735da7057 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] [instance: 815db889-a211-4eab-90f8-7ca46d7102a4] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:53.868339 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:48:53.874257 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-de9b1c3d-29af-40bc-b911-e14735da7057 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:53.875048 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-de9b1c3d-29af-40bc-b911-e14735da7057 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:53.875673 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-de9b1c3d-29af-40bc-b911-e14735da7057 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:53.877267 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-de9b1c3d-29af-40bc-b911-e14735da7057 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:53.877891 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-de9b1c3d-29af-40bc-b911-e14735da7057 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:53.878550 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-de9b1c3d-29af-40bc-b911-e14735da7057 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:53.905284 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-de9b1c3d-29af-40bc-b911-e14735da7057 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] HTTP exception thrown: Instance 815db889-a211-4eab-90f8-7ca46d7102a4 could not be found. Oct 04 20:48:53.907413 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-de9b1c3d-29af-40bc-b911-e14735da7057 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Request method failure captured: Oct 04 20:48:53.907413 n-d-854823-8 devstack@n-api.service[128801]: request: DELETE /compute/v2.1/servers/815db889-a211-4eab-90f8-7ca46d7102a4 HTTP/1.1 Oct 04 20:48:53.907413 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:48:53.907413 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:48:53.907413 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:48:53.907413 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 0 Oct 04 20:48:53.907413 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:48:53.907413 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:48:53.907413 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:48:53.907413 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:48:53.907413 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJtXeGd1OSE1d-q7huwYmQVgHKPB2nY9Y_iBYLSsxIWf0ZLoIsms_J79v8rnvuCcLKCo45bauxqFKnjqGYX1AAx7FYuwRfC4K7DRdTmNl747g3WpVpopQX7HTqkFLqtLUTKzVUP1OfFEQpoHNLwfiO0ITJKfRxWFYCijK5r7I1sZPKU Oct 04 20:48:53.907413 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:48:53.907413 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:48:53.907413 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:48:53.907413 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:48:53.907413 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:48:53.907413 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:48:53.907413 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: 3f3fadcd7d4043daa0a6aba27ba814d5 Oct 04 20:48:53.907413 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-ImagesTestJSON-506982684 Oct 04 20:48:53.907413 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 20:48:53.907413 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 20:48:53.907413 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_3f3fadcd7d4043daa0a6aba27ba814d5", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3f3fadcd7d4043daa0a6aba27ba814d5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3f3fadcd7d4043daa0a6aba27ba814d5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/3f3fadcd7d4043daa0a6aba27ba814d5"}]}] Oct 04 20:48:53.907413 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-ImagesTestJSON-506982684 Oct 04 20:48:53.907413 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: 3f3fadcd7d4043daa0a6aba27ba814d5 Oct 04 20:48:53.907413 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ImagesTestJSON-506982684 Oct 04 20:48:53.907413 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-ImagesTestJSON-506982684-project Oct 04 20:48:53.907413 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:48:53.907413 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:48:53.907413 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: aca59cd50bf74a36bb1e4427cd50fbb3 Oct 04 20:48:53.907413 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-ImagesTestJSON-506982684-project Oct 04 20:48:53.907413 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 20:48:53.907413 n-d-854823-8 devstack@n-api.service[128801]: exception: Instance 815db889-a211-4eab-90f8-7ca46d7102a4 could not be found. Oct 04 20:48:53.907413 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': '815db889-a211-4eab-90f8-7ca46d7102a4'} Oct 04 20:48:53.907413 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:48:53.907413 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:48:53.907413 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:48:53.907413 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:48:53.907413 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:48:53.907413 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:48:53.907413 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:48:53.907413 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:48:53.907413 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:48:53.907413 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:48:53.907413 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 815db889-a211-4eab-90f8-7ca46d7102a4 could not be found. Oct 04 20:48:53.907413 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:48:53.907413 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:48:53.907413 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:48:53.907413 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:48:53.907413 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:48:53.907413 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:48:53.907413 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:48:53.907413 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:48:53.907413 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:48:53.907413 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:48:53.907413 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 20:48:53.907413 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 20:48:53.907413 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 20:48:53.907413 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 20:48:53.907413 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:48:53.907413 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:48:53.907413 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:48:53.907413 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:48:53.907413 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 815db889-a211-4eab-90f8-7ca46d7102a4 could not be found. Oct 04 20:48:53.912255 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:48:53.912255 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:48:53.912255 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:48:53.912255 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:48:53.912255 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:48:53.912255 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:48:53.912255 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:48:53.912255 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:48:53.912255 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 815db889-a211-4eab-90f8-7ca46d7102a4 could not be found. Oct 04 20:48:53.912255 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:48:53.912255 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-de9b1c3d-29af-40bc-b911-e14735da7057 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Returning 404 to user: Instance 815db889-a211-4eab-90f8-7ca46d7102a4 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:48:53.912255 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-de9b1c3d-29af-40bc-b911-e14735da7057 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] 10.222.0.33 "DELETE /compute/v2.1/servers/815db889-a211-4eab-90f8-7ca46d7102a4" status: 404 len: 111 microversion: 2.1 time: 0.053042 Oct 04 20:48:53.917758 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1682/3457] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 20:48:53 2022] DELETE /compute/v2.1/servers/815db889-a211-4eab-90f8-7ca46d7102a4 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:48:53.927407 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-6f4dc15a-005d-46d2-a58e-b3e370a4387c tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:53.928014 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-6f4dc15a-005d-46d2-a58e-b3e370a4387c tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] [instance: 815db889-a211-4eab-90f8-7ca46d7102a4] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:53.938581 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6f4dc15a-005d-46d2-a58e-b3e370a4387c tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:53.939002 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6f4dc15a-005d-46d2-a58e-b3e370a4387c tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:53.940144 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6f4dc15a-005d-46d2-a58e-b3e370a4387c tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:53.941121 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6f4dc15a-005d-46d2-a58e-b3e370a4387c tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:53.941588 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6f4dc15a-005d-46d2-a58e-b3e370a4387c tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:53.942022 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6f4dc15a-005d-46d2-a58e-b3e370a4387c tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:53.965569 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.wsgi [None req-6f4dc15a-005d-46d2-a58e-b3e370a4387c tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] HTTP exception thrown: Instance 815db889-a211-4eab-90f8-7ca46d7102a4 could not be found. Oct 04 20:48:53.967812 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-6f4dc15a-005d-46d2-a58e-b3e370a4387c tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Request method failure captured: Oct 04 20:48:53.967812 n-d-854823-8 devstack@n-api.service[128802]: request: GET /compute/v2.1/servers/815db889-a211-4eab-90f8-7ca46d7102a4 HTTP/1.1 Oct 04 20:48:53.967812 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 20:48:53.967812 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 20:48:53.967812 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 20:48:53.967812 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 0 Oct 04 20:48:53.967812 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 20:48:53.967812 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 20:48:53.967812 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 20:48:53.967812 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 20:48:53.967812 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPJtXeGd1OSE1d-q7huwYmQVgHKPB2nY9Y_iBYLSsxIWf0ZLoIsms_J79v8rnvuCcLKCo45bauxqFKnjqGYX1AAx7FYuwRfC4K7DRdTmNl747g3WpVpopQX7HTqkFLqtLUTKzVUP1OfFEQpoHNLwfiO0ITJKfRxWFYCijK5r7I1sZPKU Oct 04 20:48:53.967812 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 20:48:53.967812 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 20:48:53.967812 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 20:48:53.967812 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 20:48:53.967812 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 20:48:53.967812 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 20:48:53.967812 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: 3f3fadcd7d4043daa0a6aba27ba814d5 Oct 04 20:48:53.967812 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-ImagesTestJSON-506982684 Oct 04 20:48:53.967812 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 20:48:53.967812 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 20:48:53.967812 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_3f3fadcd7d4043daa0a6aba27ba814d5", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3f3fadcd7d4043daa0a6aba27ba814d5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3f3fadcd7d4043daa0a6aba27ba814d5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/3f3fadcd7d4043daa0a6aba27ba814d5"}]}] Oct 04 20:48:53.967812 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-ImagesTestJSON-506982684 Oct 04 20:48:53.967812 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: 3f3fadcd7d4043daa0a6aba27ba814d5 Oct 04 20:48:53.967812 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-ImagesTestJSON-506982684 Oct 04 20:48:53.967812 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-ImagesTestJSON-506982684-project Oct 04 20:48:53.967812 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 20:48:53.967812 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 20:48:53.967812 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: aca59cd50bf74a36bb1e4427cd50fbb3 Oct 04 20:48:53.967812 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-ImagesTestJSON-506982684-project Oct 04 20:48:53.967812 n-d-854823-8 devstack@n-api.service[128802]: method: > Oct 04 20:48:53.967812 n-d-854823-8 devstack@n-api.service[128802]: exception: Instance 815db889-a211-4eab-90f8-7ca46d7102a4 could not be found. Oct 04 20:48:53.967812 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'id': '815db889-a211-4eab-90f8-7ca46d7102a4'} Oct 04 20:48:53.967812 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:48:53.967812 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:48:53.967812 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:48:53.967812 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:48:53.967812 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:48:53.967812 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:48:53.967812 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:48:53.967812 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:48:53.967812 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:48:53.967812 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:48:53.967812 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 815db889-a211-4eab-90f8-7ca46d7102a4 could not be found. Oct 04 20:48:53.967812 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:48:53.967812 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:48:53.967812 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:48:53.967812 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:48:53.967812 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:48:53.967812 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:48:53.967812 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:48:53.967812 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:48:53.967812 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:48:53.967812 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:48:53.967812 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:48:53.967812 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:48:53.967812 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:48:53.967812 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:48:53.967812 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:48:53.967812 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:48:53.967812 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 815db889-a211-4eab-90f8-7ca46d7102a4 could not be found. Oct 04 20:48:53.967812 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:48:53.967812 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:48:53.967812 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:48:53.967812 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:48:53.973823 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:48:53.973823 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:48:53.973823 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:48:53.973823 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:48:53.973823 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 815db889-a211-4eab-90f8-7ca46d7102a4 could not be found. Oct 04 20:48:53.973823 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:48:53.973823 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-6f4dc15a-005d-46d2-a58e-b3e370a4387c tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Returning 404 to user: Instance 815db889-a211-4eab-90f8-7ca46d7102a4 could not be found. {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:48:53.973823 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-6f4dc15a-005d-46d2-a58e-b3e370a4387c tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] 10.222.0.33 "GET /compute/v2.1/servers/815db889-a211-4eab-90f8-7ca46d7102a4" status: 404 len: 111 microversion: 2.1 time: 0.048113 Oct 04 20:48:53.979066 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-addcd4fe-9022-475a-9112-ea61138b71d8 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Calling method '.version_select at 0x7f3c6f510040>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:53.984342 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1776/3458] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:48:53 2022] GET /compute/v2.1/servers/815db889-a211-4eab-90f8-7ca46d7102a4 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:48:54.010855 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-addcd4fe-9022-475a-9112-ea61138b71d8 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] HTTP exception thrown: Image not found. Oct 04 20:48:54.012626 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-addcd4fe-9022-475a-9112-ea61138b71d8 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Request method failure captured: Oct 04 20:48:54.012626 n-d-854823-8 devstack@n-api.service[128801]: request: DELETE /compute/v2.1/images/cd92b355-ed64-4588-875e-1d5d7d57c8a4 HTTP/1.1 Oct 04 20:48:54.012626 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:48:54.012626 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:48:54.012626 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:48:54.012626 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 0 Oct 04 20:48:54.012626 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:48:54.012626 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:48:54.012626 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:48:54.012626 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:48:54.012626 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJtXeGd1OSE1d-q7huwYmQVgHKPB2nY9Y_iBYLSsxIWf0ZLoIsms_J79v8rnvuCcLKCo45bauxqFKnjqGYX1AAx7FYuwRfC4K7DRdTmNl747g3WpVpopQX7HTqkFLqtLUTKzVUP1OfFEQpoHNLwfiO0ITJKfRxWFYCijK5r7I1sZPKU Oct 04 20:48:54.012626 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:48:54.012626 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:48:54.012626 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:48:54.012626 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:48:54.012626 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:48:54.012626 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:48:54.012626 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: 3f3fadcd7d4043daa0a6aba27ba814d5 Oct 04 20:48:54.012626 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-ImagesTestJSON-506982684 Oct 04 20:48:54.012626 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 20:48:54.012626 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 20:48:54.012626 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_3f3fadcd7d4043daa0a6aba27ba814d5", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3f3fadcd7d4043daa0a6aba27ba814d5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3f3fadcd7d4043daa0a6aba27ba814d5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/3f3fadcd7d4043daa0a6aba27ba814d5"}]}] Oct 04 20:48:54.012626 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-ImagesTestJSON-506982684 Oct 04 20:48:54.012626 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: 3f3fadcd7d4043daa0a6aba27ba814d5 Oct 04 20:48:54.012626 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ImagesTestJSON-506982684 Oct 04 20:48:54.012626 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-ImagesTestJSON-506982684-project Oct 04 20:48:54.012626 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:48:54.012626 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:48:54.012626 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: aca59cd50bf74a36bb1e4427cd50fbb3 Oct 04 20:48:54.012626 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-ImagesTestJSON-506982684-project Oct 04 20:48:54.012626 n-d-854823-8 devstack@n-api.service[128801]: method: Oct 04 20:48:54.012626 n-d-854823-8 devstack@n-api.service[128801]: exception: Image not found. Oct 04 20:48:54.012626 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': 'cd92b355-ed64-4588-875e-1d5d7d57c8a4'} Oct 04 20:48:54.012626 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:48:54.012626 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:48:54.012626 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 04 20:48:54.012626 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 04 20:48:54.012626 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 20:48:54.012626 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 20:48:54.012626 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 20:48:54.012626 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 20:48:54.012626 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 04 20:48:54.012626 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 04 20:48:54.012626 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 04 20:48:54.012626 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 04 20:48:54.012626 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 20:48:54.012626 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 20:48:54.012626 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 20:48:54.012626 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 20:48:54.012626 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image cd92b355-ed64-4588-875e-1d5d7d57c8a4 to delete Oct 04 20:48:54.012626 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:48:54.012626 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:48:54.012626 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:48:54.012626 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:48:54.012626 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 04 20:48:54.012626 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 04 20:48:54.012626 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 04 20:48:54.012626 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 04 20:48:54.012626 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 04 20:48:54.012626 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 04 20:48:54.012626 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image cd92b355-ed64-4588-875e-1d5d7d57c8a4 could not be found. Oct 04 20:48:54.012626 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:48:54.012626 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:48:54.012626 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:48:54.012626 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:48:54.019769 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:48:54.019769 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:48:54.019769 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:48:54.019769 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:48:54.019769 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:48:54.019769 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:48:54.019769 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:48:54.019769 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:48:54.019769 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 04 20:48:54.019769 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 04 20:48:54.019769 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 20:48:54.019769 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:48:54.019769 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:48:54.019769 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:48:54.019769 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:48:54.019769 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:48:54.019769 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:48:54.019769 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:48:54.019769 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:48:54.019769 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 20:48:54.019769 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:48:54.019769 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-addcd4fe-9022-475a-9112-ea61138b71d8 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Returning 404 to user: Image not found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:48:54.019769 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-addcd4fe-9022-475a-9112-ea61138b71d8 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] 10.222.0.33 "DELETE /compute/v2.1/images/cd92b355-ed64-4588-875e-1d5d7d57c8a4" status: 404 len: 62 microversion: 2.1 time: 0.038857 Oct 04 20:48:54.023162 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-3a70652e-2406-4e7e-81fb-4c752ca046d3 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:54.023662 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-3a70652e-2406-4e7e-81fb-4c752ca046d3 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] [instance: c79c0cc3-17e6-4c35-b17e-c76c9b7e9e39] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:54.026535 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1683/3459] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:48:53 2022] DELETE /compute/v2.1/images/cd92b355-ed64-4588-875e-1d5d7d57c8a4 => generated 62 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 20:48:54.031669 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3a70652e-2406-4e7e-81fb-4c752ca046d3 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:54.032156 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3a70652e-2406-4e7e-81fb-4c752ca046d3 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:54.032593 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3a70652e-2406-4e7e-81fb-4c752ca046d3 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:54.033903 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3a70652e-2406-4e7e-81fb-4c752ca046d3 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:54.034419 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3a70652e-2406-4e7e-81fb-4c752ca046d3 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:54.034931 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3a70652e-2406-4e7e-81fb-4c752ca046d3 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:54.054713 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.wsgi [None req-3a70652e-2406-4e7e-81fb-4c752ca046d3 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] HTTP exception thrown: Instance c79c0cc3-17e6-4c35-b17e-c76c9b7e9e39 could not be found. Oct 04 20:48:54.056628 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-3a70652e-2406-4e7e-81fb-4c752ca046d3 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Request method failure captured: Oct 04 20:48:54.056628 n-d-854823-8 devstack@n-api.service[128802]: request: DELETE /compute/v2.1/servers/c79c0cc3-17e6-4c35-b17e-c76c9b7e9e39 HTTP/1.1 Oct 04 20:48:54.056628 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 20:48:54.056628 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 20:48:54.056628 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 20:48:54.056628 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 0 Oct 04 20:48:54.056628 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 20:48:54.056628 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 20:48:54.056628 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 20:48:54.056628 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 20:48:54.056628 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPJtXeGd1OSE1d-q7huwYmQVgHKPB2nY9Y_iBYLSsxIWf0ZLoIsms_J79v8rnvuCcLKCo45bauxqFKnjqGYX1AAx7FYuwRfC4K7DRdTmNl747g3WpVpopQX7HTqkFLqtLUTKzVUP1OfFEQpoHNLwfiO0ITJKfRxWFYCijK5r7I1sZPKU Oct 04 20:48:54.056628 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 20:48:54.056628 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 20:48:54.056628 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 20:48:54.056628 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 20:48:54.056628 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 20:48:54.056628 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 20:48:54.056628 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: 3f3fadcd7d4043daa0a6aba27ba814d5 Oct 04 20:48:54.056628 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-ImagesTestJSON-506982684 Oct 04 20:48:54.056628 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 20:48:54.056628 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 20:48:54.056628 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_3f3fadcd7d4043daa0a6aba27ba814d5", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3f3fadcd7d4043daa0a6aba27ba814d5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3f3fadcd7d4043daa0a6aba27ba814d5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/3f3fadcd7d4043daa0a6aba27ba814d5"}]}] Oct 04 20:48:54.056628 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-ImagesTestJSON-506982684 Oct 04 20:48:54.056628 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: 3f3fadcd7d4043daa0a6aba27ba814d5 Oct 04 20:48:54.056628 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-ImagesTestJSON-506982684 Oct 04 20:48:54.056628 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-ImagesTestJSON-506982684-project Oct 04 20:48:54.056628 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 20:48:54.056628 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 20:48:54.056628 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: aca59cd50bf74a36bb1e4427cd50fbb3 Oct 04 20:48:54.056628 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-ImagesTestJSON-506982684-project Oct 04 20:48:54.056628 n-d-854823-8 devstack@n-api.service[128802]: method: > Oct 04 20:48:54.056628 n-d-854823-8 devstack@n-api.service[128802]: exception: Instance c79c0cc3-17e6-4c35-b17e-c76c9b7e9e39 could not be found. Oct 04 20:48:54.056628 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'id': 'c79c0cc3-17e6-4c35-b17e-c76c9b7e9e39'} Oct 04 20:48:54.056628 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:48:54.056628 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:48:54.056628 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:48:54.056628 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:48:54.056628 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:48:54.056628 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:48:54.056628 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:48:54.056628 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:48:54.056628 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:48:54.056628 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:48:54.056628 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c79c0cc3-17e6-4c35-b17e-c76c9b7e9e39 could not be found. Oct 04 20:48:54.056628 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:48:54.056628 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:48:54.056628 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:48:54.056628 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:48:54.056628 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:48:54.056628 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:48:54.056628 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:48:54.056628 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:48:54.056628 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:48:54.056628 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:48:54.056628 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 20:48:54.056628 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 20:48:54.056628 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 20:48:54.056628 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 20:48:54.056628 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:48:54.056628 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:48:54.056628 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:48:54.056628 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:48:54.056628 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c79c0cc3-17e6-4c35-b17e-c76c9b7e9e39 could not be found. Oct 04 20:48:54.060765 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:48:54.060765 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:48:54.060765 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:48:54.060765 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:48:54.060765 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:48:54.060765 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:48:54.060765 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:48:54.060765 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:48:54.060765 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c79c0cc3-17e6-4c35-b17e-c76c9b7e9e39 could not be found. Oct 04 20:48:54.060765 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:48:54.060765 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-3a70652e-2406-4e7e-81fb-4c752ca046d3 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Returning 404 to user: Instance c79c0cc3-17e6-4c35-b17e-c76c9b7e9e39 could not be found. {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:48:54.060765 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-3a70652e-2406-4e7e-81fb-4c752ca046d3 tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] 10.222.0.33 "DELETE /compute/v2.1/servers/c79c0cc3-17e6-4c35-b17e-c76c9b7e9e39" status: 404 len: 111 microversion: 2.1 time: 0.038955 Oct 04 20:48:54.066852 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-530f7a7c-0162-443e-a1f8-b031bfadd22f tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:54.067465 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-530f7a7c-0162-443e-a1f8-b031bfadd22f tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] [instance: c79c0cc3-17e6-4c35-b17e-c76c9b7e9e39] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:54.071454 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1777/3460] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 20:48:54 2022] DELETE /compute/v2.1/servers/c79c0cc3-17e6-4c35-b17e-c76c9b7e9e39 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:48:54.074586 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-530f7a7c-0162-443e-a1f8-b031bfadd22f tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:54.075073 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-530f7a7c-0162-443e-a1f8-b031bfadd22f tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:54.076133 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-530f7a7c-0162-443e-a1f8-b031bfadd22f tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:54.076833 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-530f7a7c-0162-443e-a1f8-b031bfadd22f tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:54.078473 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-530f7a7c-0162-443e-a1f8-b031bfadd22f tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:54.079090 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-530f7a7c-0162-443e-a1f8-b031bfadd22f tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:54.094124 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-530f7a7c-0162-443e-a1f8-b031bfadd22f tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] HTTP exception thrown: Instance c79c0cc3-17e6-4c35-b17e-c76c9b7e9e39 could not be found. Oct 04 20:48:54.097495 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-530f7a7c-0162-443e-a1f8-b031bfadd22f tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Request method failure captured: Oct 04 20:48:54.097495 n-d-854823-8 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/c79c0cc3-17e6-4c35-b17e-c76c9b7e9e39 HTTP/1.1 Oct 04 20:48:54.097495 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:48:54.097495 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:48:54.097495 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:48:54.097495 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 0 Oct 04 20:48:54.097495 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:48:54.097495 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:48:54.097495 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:48:54.097495 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:48:54.097495 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJtXeGd1OSE1d-q7huwYmQVgHKPB2nY9Y_iBYLSsxIWf0ZLoIsms_J79v8rnvuCcLKCo45bauxqFKnjqGYX1AAx7FYuwRfC4K7DRdTmNl747g3WpVpopQX7HTqkFLqtLUTKzVUP1OfFEQpoHNLwfiO0ITJKfRxWFYCijK5r7I1sZPKU Oct 04 20:48:54.097495 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:48:54.097495 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:48:54.097495 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:48:54.097495 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:48:54.097495 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:48:54.097495 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:48:54.097495 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: 3f3fadcd7d4043daa0a6aba27ba814d5 Oct 04 20:48:54.097495 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-ImagesTestJSON-506982684 Oct 04 20:48:54.097495 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 20:48:54.097495 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 20:48:54.097495 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_3f3fadcd7d4043daa0a6aba27ba814d5", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3f3fadcd7d4043daa0a6aba27ba814d5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3f3fadcd7d4043daa0a6aba27ba814d5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/3f3fadcd7d4043daa0a6aba27ba814d5"}]}] Oct 04 20:48:54.097495 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-ImagesTestJSON-506982684 Oct 04 20:48:54.097495 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: 3f3fadcd7d4043daa0a6aba27ba814d5 Oct 04 20:48:54.097495 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ImagesTestJSON-506982684 Oct 04 20:48:54.097495 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-ImagesTestJSON-506982684-project Oct 04 20:48:54.097495 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:48:54.097495 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:48:54.097495 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: aca59cd50bf74a36bb1e4427cd50fbb3 Oct 04 20:48:54.097495 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-ImagesTestJSON-506982684-project Oct 04 20:48:54.097495 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 20:48:54.097495 n-d-854823-8 devstack@n-api.service[128801]: exception: Instance c79c0cc3-17e6-4c35-b17e-c76c9b7e9e39 could not be found. Oct 04 20:48:54.097495 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': 'c79c0cc3-17e6-4c35-b17e-c76c9b7e9e39'} Oct 04 20:48:54.097495 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:48:54.097495 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:48:54.097495 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:48:54.097495 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:48:54.097495 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:48:54.097495 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:48:54.097495 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:48:54.097495 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:48:54.097495 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:48:54.097495 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:48:54.097495 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c79c0cc3-17e6-4c35-b17e-c76c9b7e9e39 could not be found. Oct 04 20:48:54.097495 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:48:54.097495 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:48:54.097495 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:48:54.097495 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:48:54.097495 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:48:54.097495 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:48:54.097495 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:48:54.097495 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:48:54.097495 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:48:54.097495 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:48:54.097495 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:48:54.097495 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:48:54.097495 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:48:54.097495 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:48:54.097495 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:48:54.097495 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:48:54.097495 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c79c0cc3-17e6-4c35-b17e-c76c9b7e9e39 could not be found. Oct 04 20:48:54.097495 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:48:54.097495 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:48:54.097495 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:48:54.097495 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:48:54.105456 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:48:54.105456 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:48:54.105456 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:48:54.105456 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:48:54.105456 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c79c0cc3-17e6-4c35-b17e-c76c9b7e9e39 could not be found. Oct 04 20:48:54.105456 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:48:54.105456 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-530f7a7c-0162-443e-a1f8-b031bfadd22f tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] Returning 404 to user: Instance c79c0cc3-17e6-4c35-b17e-c76c9b7e9e39 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:48:54.105456 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-530f7a7c-0162-443e-a1f8-b031bfadd22f tempest-ImagesTestJSON-506982684 tempest-ImagesTestJSON-506982684-project] 10.222.0.33 "GET /compute/v2.1/servers/c79c0cc3-17e6-4c35-b17e-c76c9b7e9e39" status: 404 len: 111 microversion: 2.1 time: 0.037412 Oct 04 20:48:54.105456 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1684/3461] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:48:54 2022] GET /compute/v2.1/servers/c79c0cc3-17e6-4c35-b17e-c76c9b7e9e39 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:48:54.321935 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-795bdac3-8793-4f52-b3ce-049f0f30f5cf tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:54.322279 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-795bdac3-8793-4f52-b3ce-049f0f30f5cf tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] [instance: 9261e0b2-35ac-40f4-92d5-3b9ffaea23c4] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:54.332875 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-795bdac3-8793-4f52-b3ce-049f0f30f5cf tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:54.333504 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-795bdac3-8793-4f52-b3ce-049f0f30f5cf tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:54.334095 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-795bdac3-8793-4f52-b3ce-049f0f30f5cf tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:54.334840 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-795bdac3-8793-4f52-b3ce-049f0f30f5cf tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:54.337501 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-795bdac3-8793-4f52-b3ce-049f0f30f5cf tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:54.338461 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-795bdac3-8793-4f52-b3ce-049f0f30f5cf tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:54.479335 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e37fc246-af66-4d08-b736-44a5398d16d1 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:54.480871 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e37fc246-af66-4d08-b736-44a5398d16d1 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] [instance: 8526b237-847c-47b7-9f0b-8209c9a07b95] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:54.507112 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e37fc246-af66-4d08-b736-44a5398d16d1 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:54.507950 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e37fc246-af66-4d08-b736-44a5398d16d1 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:54.511490 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e37fc246-af66-4d08-b736-44a5398d16d1 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:54.512580 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e37fc246-af66-4d08-b736-44a5398d16d1 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:54.514418 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e37fc246-af66-4d08-b736-44a5398d16d1 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:54.516603 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e37fc246-af66-4d08-b736-44a5398d16d1 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:54.581798 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-795bdac3-8793-4f52-b3ce-049f0f30f5cf tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8397c96a6dd4c65bdde07c91ca5e7fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09101effe9da463dabc2edaccdb83e06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:54.591239 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-795bdac3-8793-4f52-b3ce-049f0f30f5cf tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] 10.222.0.33 "GET /compute/v2.1/servers/9261e0b2-35ac-40f4-92d5-3b9ffaea23c4" status: 200 len: 1367 microversion: 2.1 time: 0.275692 Oct 04 20:48:54.596932 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1778/3462] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:48:54 2022] GET /compute/v2.1/servers/9261e0b2-35ac-40f4-92d5-3b9ffaea23c4 => generated 1367 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:48:54.815706 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-e3788c73-7045-45f6-baf7-f87a0f807d81 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:54.817008 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-e3788c73-7045-45f6-baf7-f87a0f807d81 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: 4d46fff2-b04d-41aa-ada0-2023ab545b48] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:54.827450 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e3788c73-7045-45f6-baf7-f87a0f807d81 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:54.831096 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e3788c73-7045-45f6-baf7-f87a0f807d81 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:54.832198 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e3788c73-7045-45f6-baf7-f87a0f807d81 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:54.833987 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e3788c73-7045-45f6-baf7-f87a0f807d81 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:54.836827 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e3788c73-7045-45f6-baf7-f87a0f807d81 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:54.837474 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e3788c73-7045-45f6-baf7-f87a0f807d81 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:55.035115 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e37fc246-af66-4d08-b736-44a5398d16d1 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6775b9d82b3444f6b728736f1d2b2806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5338cf2146344042bc263bdc4f9d822b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:55.048331 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e37fc246-af66-4d08-b736-44a5398d16d1 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] 10.222.0.33 "GET /compute/v2.1/servers/8526b237-847c-47b7-9f0b-8209c9a07b95" status: 200 len: 1316 microversion: 2.1 time: 0.573756 Oct 04 20:48:55.052993 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1685/3463] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:48:54 2022] GET /compute/v2.1/servers/8526b237-847c-47b7-9f0b-8209c9a07b95 => generated 1316 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:48:55.259829 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-e3788c73-7045-45f6-baf7-f87a0f807d81 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac650232cc04810b1340dc2f0edadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b0670d1bd99424780a70e69d57a2166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:55.271461 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-e3788c73-7045-45f6-baf7-f87a0f807d81 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48" status: 200 len: 1679 microversion: 2.1 time: 0.462588 Oct 04 20:48:55.272336 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1779/3464] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:48:54 2022] GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48 => generated 1679 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:48:55.382194 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-4d18bea7-6808-46cd-b917-8206727bde5f req-ba60f374-8086-4465-991a-9a1fa274c378 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9261e0b2-35ac-40f4-92d5-3b9ffaea23c4", "name": "network-vif-plugged", "status": "completed", "tag": "09b39841-a772-4f30-a38c-731c97c36f85"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:48:55.405387 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-4d18bea7-6808-46cd-b917-8206727bde5f req-ba60f374-8086-4465-991a-9a1fa274c378 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:55.405869 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-4d18bea7-6808-46cd-b917-8206727bde5f req-ba60f374-8086-4465-991a-9a1fa274c378 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:55.406304 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-4d18bea7-6808-46cd-b917-8206727bde5f req-ba60f374-8086-4465-991a-9a1fa274c378 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:55.474534 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-4d18bea7-6808-46cd-b917-8206727bde5f req-ba60f374-8086-4465-991a-9a1fa274c378 service nova] Creating event network-vif-plugged:09b39841-a772-4f30-a38c-731c97c36f85 for instance 9261e0b2-35ac-40f4-92d5-3b9ffaea23c4 on n-h2-854823-8 Oct 04 20:48:55.487868 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-4d18bea7-6808-46cd-b917-8206727bde5f req-ba60f374-8086-4465-991a-9a1fa274c378 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109200 Oct 04 20:48:55.488482 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1686/3465] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:48:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:48:55.619905 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-a6bef506-1382-4126-a2b0-d075aecd16f0 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:55.621219 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-a6bef506-1382-4126-a2b0-d075aecd16f0 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] [instance: 9261e0b2-35ac-40f4-92d5-3b9ffaea23c4] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:55.632245 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a6bef506-1382-4126-a2b0-d075aecd16f0 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:55.635289 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a6bef506-1382-4126-a2b0-d075aecd16f0 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:55.638072 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a6bef506-1382-4126-a2b0-d075aecd16f0 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:55.639178 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a6bef506-1382-4126-a2b0-d075aecd16f0 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:55.641337 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a6bef506-1382-4126-a2b0-d075aecd16f0 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:55.643194 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a6bef506-1382-4126-a2b0-d075aecd16f0 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:56.077384 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-de67142d-f117-4a22-9344-729d33f315b3 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:56.078086 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-de67142d-f117-4a22-9344-729d33f315b3 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] [instance: 8526b237-847c-47b7-9f0b-8209c9a07b95] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:56.090332 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-de67142d-f117-4a22-9344-729d33f315b3 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:56.095402 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-de67142d-f117-4a22-9344-729d33f315b3 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:56.103067 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-de67142d-f117-4a22-9344-729d33f315b3 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:56.104094 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-de67142d-f117-4a22-9344-729d33f315b3 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:56.105275 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-de67142d-f117-4a22-9344-729d33f315b3 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:56.106194 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-de67142d-f117-4a22-9344-729d33f315b3 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:56.144882 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-a6bef506-1382-4126-a2b0-d075aecd16f0 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8397c96a6dd4c65bdde07c91ca5e7fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09101effe9da463dabc2edaccdb83e06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:56.160125 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-a6bef506-1382-4126-a2b0-d075aecd16f0 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] 10.222.0.33 "GET /compute/v2.1/servers/9261e0b2-35ac-40f4-92d5-3b9ffaea23c4" status: 200 len: 1367 microversion: 2.1 time: 0.543876 Oct 04 20:48:56.194575 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1780/3466] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:48:55 2022] GET /compute/v2.1/servers/9261e0b2-35ac-40f4-92d5-3b9ffaea23c4 => generated 1367 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:48:56.301606 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-f656c07c-0663-4213-bbe2-5d25c2b0550d tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:56.303029 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-f656c07c-0663-4213-bbe2-5d25c2b0550d tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: 4d46fff2-b04d-41aa-ada0-2023ab545b48] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:56.324571 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f656c07c-0663-4213-bbe2-5d25c2b0550d tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:56.326986 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f656c07c-0663-4213-bbe2-5d25c2b0550d tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:56.328874 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f656c07c-0663-4213-bbe2-5d25c2b0550d tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:56.331781 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f656c07c-0663-4213-bbe2-5d25c2b0550d tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:56.332614 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f656c07c-0663-4213-bbe2-5d25c2b0550d tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:56.336887 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f656c07c-0663-4213-bbe2-5d25c2b0550d tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:56.372536 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-de67142d-f117-4a22-9344-729d33f315b3 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6775b9d82b3444f6b728736f1d2b2806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5338cf2146344042bc263bdc4f9d822b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:56.385458 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-de67142d-f117-4a22-9344-729d33f315b3 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] 10.222.0.33 "GET /compute/v2.1/servers/8526b237-847c-47b7-9f0b-8209c9a07b95" status: 200 len: 1316 microversion: 2.1 time: 0.312047 Oct 04 20:48:56.386642 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1687/3467] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:48:56 2022] GET /compute/v2.1/servers/8526b237-847c-47b7-9f0b-8209c9a07b95 => generated 1316 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:48:56.598287 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-f656c07c-0663-4213-bbe2-5d25c2b0550d tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac650232cc04810b1340dc2f0edadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b0670d1bd99424780a70e69d57a2166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:56.611297 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-f656c07c-0663-4213-bbe2-5d25c2b0550d tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48" status: 200 len: 1656 microversion: 2.1 time: 0.316865 Oct 04 20:48:56.613753 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1781/3468] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:48:56 2022] GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48 => generated 1656 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:48:56.636990 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2c3a3a61-960f-4c4f-b002-4409cd7f167e tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:48:56.648122 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2c3a3a61-960f-4c4f-b002-4409cd7f167e tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:56.649765 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2c3a3a61-960f-4c4f-b002-4409cd7f167e tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:56.651619 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2c3a3a61-960f-4c4f-b002-4409cd7f167e tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:56.709276 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-2c3a3a61-960f-4c4f-b002-4409cd7f167e tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: 4d46fff2-b04d-41aa-ada0-2023ab545b48] Going to try to start instance {{(pid=128801) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 04 20:48:56.784128 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-2c3a3a61-960f-4c4f-b002-4409cd7f167e tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "POST /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48/action" status: 202 len: 0 microversion: 2.1 time: 0.151680 Oct 04 20:48:56.786267 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1688/3469] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 20:48:56 2022] POST /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48/action => generated 0 bytes in 156 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 20:48:56.793594 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-75831cce-5f8d-43fc-ae8a-611c1287ced9 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:56.795029 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-75831cce-5f8d-43fc-ae8a-611c1287ced9 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: 4d46fff2-b04d-41aa-ada0-2023ab545b48] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:56.802323 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-75831cce-5f8d-43fc-ae8a-611c1287ced9 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:56.803871 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-75831cce-5f8d-43fc-ae8a-611c1287ced9 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:56.804666 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-75831cce-5f8d-43fc-ae8a-611c1287ced9 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:56.805761 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-75831cce-5f8d-43fc-ae8a-611c1287ced9 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:56.806451 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-75831cce-5f8d-43fc-ae8a-611c1287ced9 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:56.807221 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-75831cce-5f8d-43fc-ae8a-611c1287ced9 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:57.191753 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-93c7e1c3-598c-43ff-8b20-10a871a40ca3 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:57.192541 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-93c7e1c3-598c-43ff-8b20-10a871a40ca3 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] [instance: 9261e0b2-35ac-40f4-92d5-3b9ffaea23c4] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:57.204458 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-93c7e1c3-598c-43ff-8b20-10a871a40ca3 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:57.208147 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-93c7e1c3-598c-43ff-8b20-10a871a40ca3 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:57.209858 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-93c7e1c3-598c-43ff-8b20-10a871a40ca3 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:57.210993 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-93c7e1c3-598c-43ff-8b20-10a871a40ca3 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:57.213379 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-93c7e1c3-598c-43ff-8b20-10a871a40ca3 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:57.213889 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-93c7e1c3-598c-43ff-8b20-10a871a40ca3 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:57.656117 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-75831cce-5f8d-43fc-ae8a-611c1287ced9 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac650232cc04810b1340dc2f0edadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b0670d1bd99424780a70e69d57a2166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:57.669583 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-75831cce-5f8d-43fc-ae8a-611c1287ced9 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48" status: 200 len: 1665 microversion: 2.1 time: 0.880012 Oct 04 20:48:57.670176 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1782/3470] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:48:56 2022] GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48 => generated 1665 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:48:57.688885 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-9df10f8b-ae52-461f-9be6-e1d98be827b4 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:57.690776 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-9df10f8b-ae52-461f-9be6-e1d98be827b4 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] [instance: 8526b237-847c-47b7-9f0b-8209c9a07b95] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:57.701088 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9df10f8b-ae52-461f-9be6-e1d98be827b4 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:57.701954 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9df10f8b-ae52-461f-9be6-e1d98be827b4 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:57.702636 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9df10f8b-ae52-461f-9be6-e1d98be827b4 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:57.703569 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9df10f8b-ae52-461f-9be6-e1d98be827b4 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:57.715557 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9df10f8b-ae52-461f-9be6-e1d98be827b4 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:57.717243 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9df10f8b-ae52-461f-9be6-e1d98be827b4 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:57.819893 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-93c7e1c3-598c-43ff-8b20-10a871a40ca3 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8397c96a6dd4c65bdde07c91ca5e7fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09101effe9da463dabc2edaccdb83e06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:57.832574 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-93c7e1c3-598c-43ff-8b20-10a871a40ca3 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] 10.222.0.33 "GET /compute/v2.1/servers/9261e0b2-35ac-40f4-92d5-3b9ffaea23c4" status: 200 len: 1367 microversion: 2.1 time: 0.645187 Oct 04 20:48:57.847993 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1689/3471] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:48:57 2022] GET /compute/v2.1/servers/9261e0b2-35ac-40f4-92d5-3b9ffaea23c4 => generated 1367 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:48:57.853413 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-52826bea-8ecb-460d-8a5b-b77f381d88c0 req-132f6e03-6a58-4f8e-ae67-199d6c32fa93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8526b237-847c-47b7-9f0b-8209c9a07b95", "name": "network-vif-plugged", "status": "completed", "tag": "8d64ffa9-7f66-45e5-ab1c-7b451118f90e"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:48:57.875669 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-52826bea-8ecb-460d-8a5b-b77f381d88c0 req-132f6e03-6a58-4f8e-ae67-199d6c32fa93 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:57.876211 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-52826bea-8ecb-460d-8a5b-b77f381d88c0 req-132f6e03-6a58-4f8e-ae67-199d6c32fa93 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:57.876580 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-52826bea-8ecb-460d-8a5b-b77f381d88c0 req-132f6e03-6a58-4f8e-ae67-199d6c32fa93 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:57.901699 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-52826bea-8ecb-460d-8a5b-b77f381d88c0 req-132f6e03-6a58-4f8e-ae67-199d6c32fa93 service nova] Creating event network-vif-plugged:8d64ffa9-7f66-45e5-ab1c-7b451118f90e for instance 8526b237-847c-47b7-9f0b-8209c9a07b95 on n-h1-854823-8 Oct 04 20:48:57.916186 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-52826bea-8ecb-460d-8a5b-b77f381d88c0 req-132f6e03-6a58-4f8e-ae67-199d6c32fa93 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079352 Oct 04 20:48:57.917090 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1690/3472] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:48:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:48:58.120741 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-9df10f8b-ae52-461f-9be6-e1d98be827b4 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6775b9d82b3444f6b728736f1d2b2806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5338cf2146344042bc263bdc4f9d822b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:58.135312 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-9df10f8b-ae52-461f-9be6-e1d98be827b4 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] 10.222.0.33 "GET /compute/v2.1/servers/8526b237-847c-47b7-9f0b-8209c9a07b95" status: 200 len: 1316 microversion: 2.1 time: 0.452193 Oct 04 20:48:58.152322 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1783/3473] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:48:57 2022] GET /compute/v2.1/servers/8526b237-847c-47b7-9f0b-8209c9a07b95 => generated 1316 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:48:58.703958 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-18c63af6-db42-4f87-b1ea-cb74ce826ab7 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:58.704982 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-18c63af6-db42-4f87-b1ea-cb74ce826ab7 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: 4d46fff2-b04d-41aa-ada0-2023ab545b48] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:58.715640 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-18c63af6-db42-4f87-b1ea-cb74ce826ab7 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:58.716128 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-18c63af6-db42-4f87-b1ea-cb74ce826ab7 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:58.717724 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-18c63af6-db42-4f87-b1ea-cb74ce826ab7 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:58.718494 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-18c63af6-db42-4f87-b1ea-cb74ce826ab7 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:58.719192 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-18c63af6-db42-4f87-b1ea-cb74ce826ab7 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:58.719985 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-18c63af6-db42-4f87-b1ea-cb74ce826ab7 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:58.860561 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-74512670-4b32-47d5-a154-48c33a0ac1e0 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:58.861197 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-74512670-4b32-47d5-a154-48c33a0ac1e0 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] [instance: 9261e0b2-35ac-40f4-92d5-3b9ffaea23c4] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:58.868439 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-74512670-4b32-47d5-a154-48c33a0ac1e0 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:58.868956 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-74512670-4b32-47d5-a154-48c33a0ac1e0 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:58.869384 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-74512670-4b32-47d5-a154-48c33a0ac1e0 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:58.870518 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-74512670-4b32-47d5-a154-48c33a0ac1e0 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:58.871197 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-74512670-4b32-47d5-a154-48c33a0ac1e0 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:58.871910 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-74512670-4b32-47d5-a154-48c33a0ac1e0 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:59.326905 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-18c63af6-db42-4f87-b1ea-cb74ce826ab7 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac650232cc04810b1340dc2f0edadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b0670d1bd99424780a70e69d57a2166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:59.341251 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-18c63af6-db42-4f87-b1ea-cb74ce826ab7 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48" status: 200 len: 1665 microversion: 2.1 time: 0.644947 Oct 04 20:48:59.362684 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1691/3474] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:48:58 2022] GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48 => generated 1665 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:48:59.364343 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-74512670-4b32-47d5-a154-48c33a0ac1e0 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8397c96a6dd4c65bdde07c91ca5e7fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09101effe9da463dabc2edaccdb83e06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:59.368851 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1aef0ceb-f08b-4685-bfd1-b3dde3fe6fdd tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:59.369728 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-1aef0ceb-f08b-4685-bfd1-b3dde3fe6fdd tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] [instance: 8526b237-847c-47b7-9f0b-8209c9a07b95] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:59.379426 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1aef0ceb-f08b-4685-bfd1-b3dde3fe6fdd tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:59.380282 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1aef0ceb-f08b-4685-bfd1-b3dde3fe6fdd tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:59.380959 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1aef0ceb-f08b-4685-bfd1-b3dde3fe6fdd tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:59.382046 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1aef0ceb-f08b-4685-bfd1-b3dde3fe6fdd tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:59.382769 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1aef0ceb-f08b-4685-bfd1-b3dde3fe6fdd tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:59.383433 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1aef0ceb-f08b-4685-bfd1-b3dde3fe6fdd tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:59.387392 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-74512670-4b32-47d5-a154-48c33a0ac1e0 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] 10.222.0.33 "GET /compute/v2.1/servers/9261e0b2-35ac-40f4-92d5-3b9ffaea23c4" status: 200 len: 1556 microversion: 2.1 time: 0.530174 Oct 04 20:48:59.400866 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1784/3475] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:48:58 2022] GET /compute/v2.1/servers/9261e0b2-35ac-40f4-92d5-3b9ffaea23c4 => generated 1556 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:48:59.421305 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-b1a2e5d1-b06f-461b-8209-a7760ed2cdad tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:48:59.422272 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-b1a2e5d1-b06f-461b-8209-a7760ed2cdad tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] [instance: 9261e0b2-35ac-40f4-92d5-3b9ffaea23c4] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:48:59.437674 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b1a2e5d1-b06f-461b-8209-a7760ed2cdad tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:59.439653 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b1a2e5d1-b06f-461b-8209-a7760ed2cdad tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:59.441561 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b1a2e5d1-b06f-461b-8209-a7760ed2cdad tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:59.446033 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b1a2e5d1-b06f-461b-8209-a7760ed2cdad tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:48:59.446885 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b1a2e5d1-b06f-461b-8209-a7760ed2cdad tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:48:59.447386 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b1a2e5d1-b06f-461b-8209-a7760ed2cdad tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:48:59.682873 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-b1a2e5d1-b06f-461b-8209-a7760ed2cdad tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] 10.222.0.33 "GET /compute/v2.1/servers/9261e0b2-35ac-40f4-92d5-3b9ffaea23c4/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.270959 Oct 04 20:48:59.683486 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1785/3476] 10.222.0.33 () {58 vars in 1275 bytes} [Tue Oct 4 20:48:59 2022] GET /compute/v2.1/servers/9261e0b2-35ac-40f4-92d5-3b9ffaea23c4/os-interface => generated 284 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 20:48:59.880084 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-1aef0ceb-f08b-4685-bfd1-b3dde3fe6fdd tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6775b9d82b3444f6b728736f1d2b2806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5338cf2146344042bc263bdc4f9d822b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:48:59.894443 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-1aef0ceb-f08b-4685-bfd1-b3dde3fe6fdd tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] 10.222.0.33 "GET /compute/v2.1/servers/8526b237-847c-47b7-9f0b-8209c9a07b95" status: 200 len: 1316 microversion: 2.1 time: 0.529723 Oct 04 20:48:59.914356 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1692/3477] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:48:59 2022] GET /compute/v2.1/servers/8526b237-847c-47b7-9f0b-8209c9a07b95 => generated 1316 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:49:00.375337 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-51490581-507a-4bad-ab54-c906efb89a4b tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:49:00.379352 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-51490581-507a-4bad-ab54-c906efb89a4b tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: 4d46fff2-b04d-41aa-ada0-2023ab545b48] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:49:00.397432 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-51490581-507a-4bad-ab54-c906efb89a4b tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:00.398228 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-51490581-507a-4bad-ab54-c906efb89a4b tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:00.403901 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-51490581-507a-4bad-ab54-c906efb89a4b tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:00.404967 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-51490581-507a-4bad-ab54-c906efb89a4b tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:00.406262 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-51490581-507a-4bad-ab54-c906efb89a4b tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:00.407666 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-51490581-507a-4bad-ab54-c906efb89a4b tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:00.451962 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=100 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:49:00.928921 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1d2e4aec-1ae7-4351-b3c5-d9987cebfb0c tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:49:00.931655 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-1d2e4aec-1ae7-4351-b3c5-d9987cebfb0c tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] [instance: 8526b237-847c-47b7-9f0b-8209c9a07b95] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:49:00.962828 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1d2e4aec-1ae7-4351-b3c5-d9987cebfb0c tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:00.965559 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1d2e4aec-1ae7-4351-b3c5-d9987cebfb0c tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:00.968830 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1d2e4aec-1ae7-4351-b3c5-d9987cebfb0c tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:00.970968 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1d2e4aec-1ae7-4351-b3c5-d9987cebfb0c tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:00.974201 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1d2e4aec-1ae7-4351-b3c5-d9987cebfb0c tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:00.978287 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1d2e4aec-1ae7-4351-b3c5-d9987cebfb0c tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:01.346707 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-51490581-507a-4bad-ab54-c906efb89a4b tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac650232cc04810b1340dc2f0edadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b0670d1bd99424780a70e69d57a2166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:49:01.366729 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-51490581-507a-4bad-ab54-c906efb89a4b tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48" status: 200 len: 1669 microversion: 2.1 time: 1.002065 Oct 04 20:49:01.367436 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1786/3478] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:49:00 2022] GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48 => generated 1669 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:49:01.390085 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-aaa8cc14-93b0-46f3-a418-8d72345d2840 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:49:01.391311 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-aaa8cc14-93b0-46f3-a418-8d72345d2840 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: 4d46fff2-b04d-41aa-ada0-2023ab545b48] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:49:01.417336 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-aaa8cc14-93b0-46f3-a418-8d72345d2840 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:01.417939 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-aaa8cc14-93b0-46f3-a418-8d72345d2840 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:01.417939 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-aaa8cc14-93b0-46f3-a418-8d72345d2840 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:01.417939 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-aaa8cc14-93b0-46f3-a418-8d72345d2840 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:01.417939 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-aaa8cc14-93b0-46f3-a418-8d72345d2840 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:01.417939 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-aaa8cc14-93b0-46f3-a418-8d72345d2840 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:01.423326 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-1d2e4aec-1ae7-4351-b3c5-d9987cebfb0c tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6775b9d82b3444f6b728736f1d2b2806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5338cf2146344042bc263bdc4f9d822b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:49:01.439083 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-1d2e4aec-1ae7-4351-b3c5-d9987cebfb0c tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] 10.222.0.33 "GET /compute/v2.1/servers/8526b237-847c-47b7-9f0b-8209c9a07b95" status: 200 len: 1504 microversion: 2.1 time: 0.521163 Oct 04 20:49:01.439681 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1693/3479] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:49:00 2022] GET /compute/v2.1/servers/8526b237-847c-47b7-9f0b-8209c9a07b95 => generated 1504 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:49:01.466404 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-adc4f11c-a302-4b88-981d-f07999c80521 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1847020395"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:49:01.466948 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-adc4f11c-a302-4b88-981d-f07999c80521 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] [instance: 8526b237-847c-47b7-9f0b-8209c9a07b95] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:49:01.484583 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-adc4f11c-a302-4b88-981d-f07999c80521 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:01.485080 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-adc4f11c-a302-4b88-981d-f07999c80521 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:01.485512 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-adc4f11c-a302-4b88-981d-f07999c80521 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:01.490075 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-adc4f11c-a302-4b88-981d-f07999c80521 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:01.490826 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-adc4f11c-a302-4b88-981d-f07999c80521 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:01.492358 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-adc4f11c-a302-4b88-981d-f07999c80521 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:01.880272 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-aaa8cc14-93b0-46f3-a418-8d72345d2840 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac650232cc04810b1340dc2f0edadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b0670d1bd99424780a70e69d57a2166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:49:01.902380 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-aaa8cc14-93b0-46f3-a418-8d72345d2840 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48" status: 200 len: 1669 microversion: 2.1 time: 0.516065 Oct 04 20:49:01.927155 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1787/3480] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:49:01 2022] GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48 => generated 1669 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:49:01.952183 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-1ac06d48-2216-4dfb-928e-f57d678bf34f tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:49:01.952994 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-1ac06d48-2216-4dfb-928e-f57d678bf34f tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: 4d46fff2-b04d-41aa-ada0-2023ab545b48] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:49:01.962260 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1ac06d48-2216-4dfb-928e-f57d678bf34f tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:01.963072 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1ac06d48-2216-4dfb-928e-f57d678bf34f tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:01.963918 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1ac06d48-2216-4dfb-928e-f57d678bf34f tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:01.964888 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1ac06d48-2216-4dfb-928e-f57d678bf34f tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:01.965566 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1ac06d48-2216-4dfb-928e-f57d678bf34f tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:01.966213 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1ac06d48-2216-4dfb-928e-f57d678bf34f tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:02.004942 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.network.security_group_api [None req-adc4f11c-a302-4b88-981d-f07999c80521 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Adding security group a71f58bf-5109-49de-adad-5cf36ec1b6a1 to port 8d64ffa9-7f66-45e5-ab1c-7b451118f90e Oct 04 20:49:02.146078 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-1ac06d48-2216-4dfb-928e-f57d678bf34f tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: 4d46fff2-b04d-41aa-ada0-2023ab545b48] Unlocking {{(pid=128802) unlock /opt/stack/nova/nova/compute/api.py:4874}} Oct 04 20:49:02.264301 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-1ac06d48-2216-4dfb-928e-f57d678bf34f tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "POST /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48/action" status: 202 len: 0 microversion: 2.1 time: 0.333807 Oct 04 20:49:02.265388 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1788/3481] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 20:49:01 2022] POST /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48/action => generated 0 bytes in 337 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:49:02.279730 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-49ef44c5-745c-4b98-8075-546d181cbfc5 req-b90840b7-f2ac-4f65-8e1f-230d664013f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9261e0b2-35ac-40f4-92d5-3b9ffaea23c4", "tag": "09b39841-a772-4f30-a38c-731c97c36f85"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:49:02.301637 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-49ef44c5-745c-4b98-8075-546d181cbfc5 req-b90840b7-f2ac-4f65-8e1f-230d664013f3 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:02.303154 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-49ef44c5-745c-4b98-8075-546d181cbfc5 req-b90840b7-f2ac-4f65-8e1f-230d664013f3 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:02.305128 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-49ef44c5-745c-4b98-8075-546d181cbfc5 req-b90840b7-f2ac-4f65-8e1f-230d664013f3 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:02.332546 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-49ef44c5-745c-4b98-8075-546d181cbfc5 req-b90840b7-f2ac-4f65-8e1f-230d664013f3 service nova] Creating event network-changed:09b39841-a772-4f30-a38c-731c97c36f85 for instance 9261e0b2-35ac-40f4-92d5-3b9ffaea23c4 on n-h2-854823-8 Oct 04 20:49:02.348061 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-49ef44c5-745c-4b98-8075-546d181cbfc5 req-b90840b7-f2ac-4f65-8e1f-230d664013f3 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080820 Oct 04 20:49:02.349869 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1789/3482] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:49:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:49:02.360749 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-3e8ad260-19a5-4285-ab17-b90723653c8b tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:49:02.366561 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-3e8ad260-19a5-4285-ab17-b90723653c8b tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: 4d46fff2-b04d-41aa-ada0-2023ab545b48] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:49:02.379137 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:49:02.382869 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3e8ad260-19a5-4285-ab17-b90723653c8b tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:02.385952 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3e8ad260-19a5-4285-ab17-b90723653c8b tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:02.386839 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3e8ad260-19a5-4285-ab17-b90723653c8b tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:02.388932 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3e8ad260-19a5-4285-ab17-b90723653c8b tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:02.390309 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3e8ad260-19a5-4285-ab17-b90723653c8b tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:02.390915 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3e8ad260-19a5-4285-ab17-b90723653c8b tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:03.152109 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-3e8ad260-19a5-4285-ab17-b90723653c8b tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac650232cc04810b1340dc2f0edadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b0670d1bd99424780a70e69d57a2166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:49:03.160534 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-3e8ad260-19a5-4285-ab17-b90723653c8b tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48" status: 200 len: 1669 microversion: 2.1 time: 0.808762 Oct 04 20:49:03.163068 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1790/3483] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:49:02 2022] GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48 => generated 1669 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:49:03.185347 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-e85f46ae-a3c1-48dc-9c52-20c361113f4b tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:49:03.186865 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-e85f46ae-a3c1-48dc-9c52-20c361113f4b tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: 4d46fff2-b04d-41aa-ada0-2023ab545b48] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:49:03.196291 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e85f46ae-a3c1-48dc-9c52-20c361113f4b tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:03.200716 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e85f46ae-a3c1-48dc-9c52-20c361113f4b tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:03.201372 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e85f46ae-a3c1-48dc-9c52-20c361113f4b tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:03.202106 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e85f46ae-a3c1-48dc-9c52-20c361113f4b tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:03.202604 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e85f46ae-a3c1-48dc-9c52-20c361113f4b tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:03.203044 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e85f46ae-a3c1-48dc-9c52-20c361113f4b tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:03.633062 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-e85f46ae-a3c1-48dc-9c52-20c361113f4b tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac650232cc04810b1340dc2f0edadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b0670d1bd99424780a70e69d57a2166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:49:03.644367 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-e85f46ae-a3c1-48dc-9c52-20c361113f4b tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48" status: 200 len: 1669 microversion: 2.1 time: 0.462758 Oct 04 20:49:03.644959 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1791/3484] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:49:03 2022] GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48 => generated 1669 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:49:03.668569 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-6c03b821-cb40-4418-be96-6e130f3c6895 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:49:03.669240 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-6c03b821-cb40-4418-be96-6e130f3c6895 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: 4d46fff2-b04d-41aa-ada0-2023ab545b48] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:49:03.692306 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6c03b821-cb40-4418-be96-6e130f3c6895 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:03.693288 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6c03b821-cb40-4418-be96-6e130f3c6895 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:03.693288 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6c03b821-cb40-4418-be96-6e130f3c6895 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:03.697212 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6c03b821-cb40-4418-be96-6e130f3c6895 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:03.697693 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6c03b821-cb40-4418-be96-6e130f3c6895 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:03.698158 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6c03b821-cb40-4418-be96-6e130f3c6895 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:04.107042 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-adc4f11c-a302-4b88-981d-f07999c80521 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] 10.222.0.33 "POST /compute/v2.1/servers/8526b237-847c-47b7-9f0b-8209c9a07b95/action" status: 202 len: 0 microversion: 2.1 time: 2.644329 Oct 04 20:49:04.107794 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1694/3485] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 20:49:01 2022] POST /compute/v2.1/servers/8526b237-847c-47b7-9f0b-8209c9a07b95/action => generated 0 bytes in 2646 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 20:49:04.120307 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2c425b3d-ffc4-4464-a99a-4dfa74b99f78 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Calling method '.version_select at 0x7f3c7882d940>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:49:04.572058 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-6c03b821-cb40-4418-be96-6e130f3c6895 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac650232cc04810b1340dc2f0edadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b0670d1bd99424780a70e69d57a2166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:49:04.591509 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-6c03b821-cb40-4418-be96-6e130f3c6895 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48" status: 200 len: 1669 microversion: 2.1 time: 0.927876 Oct 04 20:49:04.592640 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1792/3486] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:49:03 2022] GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48 => generated 1669 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:49:04.603331 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-114b27b3-1ee4-42db-9b4e-fc4ba3378619 req-0377aa8c-0cad-4782-a2fe-bcb7f733a6e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8526b237-847c-47b7-9f0b-8209c9a07b95", "tag": "8d64ffa9-7f66-45e5-ab1c-7b451118f90e"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:49:04.613821 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-114b27b3-1ee4-42db-9b4e-fc4ba3378619 req-0377aa8c-0cad-4782-a2fe-bcb7f733a6e0 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:04.614751 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-114b27b3-1ee4-42db-9b4e-fc4ba3378619 req-0377aa8c-0cad-4782-a2fe-bcb7f733a6e0 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:04.615366 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-114b27b3-1ee4-42db-9b4e-fc4ba3378619 req-0377aa8c-0cad-4782-a2fe-bcb7f733a6e0 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:04.650482 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-114b27b3-1ee4-42db-9b4e-fc4ba3378619 req-0377aa8c-0cad-4782-a2fe-bcb7f733a6e0 service nova] Creating event network-changed:8d64ffa9-7f66-45e5-ab1c-7b451118f90e for instance 8526b237-847c-47b7-9f0b-8209c9a07b95 on n-h1-854823-8 Oct 04 20:49:04.660584 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-114b27b3-1ee4-42db-9b4e-fc4ba3378619 req-0377aa8c-0cad-4782-a2fe-bcb7f733a6e0 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066682 Oct 04 20:49:04.661206 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1793/3487] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:49:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:49:04.677948 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-37258816-1acd-44c7-9a1b-a91abbd68e3c tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:49:04.683307 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-37258816-1acd-44c7-9a1b-a91abbd68e3c tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: 4d46fff2-b04d-41aa-ada0-2023ab545b48] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:49:04.711649 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-37258816-1acd-44c7-9a1b-a91abbd68e3c tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:04.712169 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-37258816-1acd-44c7-9a1b-a91abbd68e3c tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:04.712684 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-37258816-1acd-44c7-9a1b-a91abbd68e3c tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:04.713412 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-37258816-1acd-44c7-9a1b-a91abbd68e3c tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:04.713908 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-37258816-1acd-44c7-9a1b-a91abbd68e3c tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:04.725587 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-37258816-1acd-44c7-9a1b-a91abbd68e3c tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:04.887658 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-37258816-1acd-44c7-9a1b-a91abbd68e3c tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "POST /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48/action" status: 202 len: 0 microversion: 2.1 time: 0.220671 Oct 04 20:49:04.895255 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1794/3488] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 20:49:04 2022] POST /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48/action => generated 0 bytes in 233 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:49:04.904942 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-be9b3a80-90ea-45bc-8875-1c0d7dcb317e tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:49:04.913971 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-be9b3a80-90ea-45bc-8875-1c0d7dcb317e tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: 4d46fff2-b04d-41aa-ada0-2023ab545b48] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:49:04.941335 n-d-854823-8 devstack@n-api.service[128801]: DEBUG neutronclient.v2_0.client [None req-2c425b3d-ffc4-4464-a99a-4dfa74b99f78 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group a71f58bf-5109-49de-adad-5cf36ec1b6a1 in use.", "detail": ""}} {{(pid=128801) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 20:49:04.942401 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-2c425b3d-ffc4-4464-a99a-4dfa74b99f78 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] HTTP exception thrown: Security Group a71f58bf-5109-49de-adad-5cf36ec1b6a1 in use. Oct 04 20:49:04.942401 n-d-854823-8 devstack@n-api.service[128801]: Neutron server returns request_ids: ['req-e22d2a19-a75c-4519-af2c-023e10cfaf48'] Oct 04 20:49:04.943159 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-be9b3a80-90ea-45bc-8875-1c0d7dcb317e tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:04.943685 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-be9b3a80-90ea-45bc-8875-1c0d7dcb317e tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:04.944124 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-be9b3a80-90ea-45bc-8875-1c0d7dcb317e tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:04.944855 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-be9b3a80-90ea-45bc-8875-1c0d7dcb317e tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:04.945356 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-be9b3a80-90ea-45bc-8875-1c0d7dcb317e tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:04.945610 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2c425b3d-ffc4-4464-a99a-4dfa74b99f78 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Request method failure captured: Oct 04 20:49:04.945610 n-d-854823-8 devstack@n-api.service[128801]: request: DELETE /compute/v2.1/os-security-groups/a71f58bf-5109-49de-adad-5cf36ec1b6a1 HTTP/1.1 Oct 04 20:49:04.945610 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:49:04.945610 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:49:04.945610 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:49:04.945610 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 0 Oct 04 20:49:04.945610 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:49:04.945610 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:49:04.945610 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:49:04.945610 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:49:04.945610 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJvplJ2XtdAcke_gJrXE_KNLNy4K9GZxu4xJ3RC3ictvWfS6RkKIgxre3Ypn4Hea1fYOIvZNCiP-yxvq5D6SolLdjoz27YjvMYrrTV2S3thhTnsVyXyRm0AMTe4s528xDCu1J43IqMSUlnCB8IA8Xi7RGhGDp6gPtwX5ldwf-HyrWJg Oct 04 20:49:04.945610 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:49:04.945610 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:49:04.945610 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:49:04.945610 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:49:04.945610 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:49:04.945610 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:49:04.945610 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: 5338cf2146344042bc263bdc4f9d822b Oct 04 20:49:04.945610 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-SecurityGroupsTestJSON-969894548 Oct 04 20:49:04.945610 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 20:49:04.945610 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 20:49:04.945610 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5338cf2146344042bc263bdc4f9d822b", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5338cf2146344042bc263bdc4f9d822b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5338cf2146344042bc263bdc4f9d822b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5338cf2146344042bc263bdc4f9d822b"}]}] Oct 04 20:49:04.945610 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-SecurityGroupsTestJSON-969894548 Oct 04 20:49:04.945610 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: 5338cf2146344042bc263bdc4f9d822b Oct 04 20:49:04.945610 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-969894548 Oct 04 20:49:04.945610 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-SecurityGroupsTestJSON-969894548-project Oct 04 20:49:04.945610 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:49:04.945610 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:49:04.945610 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: 6775b9d82b3444f6b728736f1d2b2806 Oct 04 20:49:04.945610 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-SecurityGroupsTestJSON-969894548-project Oct 04 20:49:04.945610 n-d-854823-8 devstack@n-api.service[128801]: method: Oct 04 20:49:04.945610 n-d-854823-8 devstack@n-api.service[128801]: exception: Security Group a71f58bf-5109-49de-adad-5cf36ec1b6a1 in use. Oct 04 20:49:04.945610 n-d-854823-8 devstack@n-api.service[128801]: Neutron server returns request_ids: ['req-e22d2a19-a75c-4519-af2c-023e10cfaf48'] Oct 04 20:49:04.945610 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': 'a71f58bf-5109-49de-adad-5cf36ec1b6a1'} Oct 04 20:49:04.945610 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:49:04.945610 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:49:04.945610 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Oct 04 20:49:04.945610 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Oct 04 20:49:04.945610 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:49:04.945610 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:49:04.945610 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Oct 04 20:49:04.945610 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Oct 04 20:49:04.945610 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:49:04.945610 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:49:04.945610 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Oct 04 20:49:04.945610 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Oct 04 20:49:04.945610 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:49:04.945610 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:49:04.945610 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:49:04.945610 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:49:04.945610 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:49:04.945610 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:49:04.945610 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 20:49:04.945610 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 20:49:04.945610 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:49:04.945610 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:49:04.945610 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 20:49:04.945610 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 20:49:04.945610 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 20:49:04.945610 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 20:49:04.945610 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group a71f58bf-5109-49de-adad-5cf36ec1b6a1 in use. Oct 04 20:49:04.949760 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e22d2a19-a75c-4519-af2c-023e10cfaf48'] Oct 04 20:49:04.949760 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:49:04.949760 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:49:04.949760 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:49:04.949760 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:49:04.949760 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Oct 04 20:49:04.949760 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Oct 04 20:49:04.949760 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Oct 04 20:49:04.949760 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Oct 04 20:49:04.949760 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group a71f58bf-5109-49de-adad-5cf36ec1b6a1 in use. Oct 04 20:49:04.949760 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e22d2a19-a75c-4519-af2c-023e10cfaf48'] Oct 04 20:49:04.949760 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:49:04.949760 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:49:04.949760 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:49:04.949760 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:49:04.949760 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:49:04.949760 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:49:04.949760 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:49:04.949760 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:49:04.949760 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:49:04.949760 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:49:04.949760 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:49:04.949760 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:49:04.949760 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Oct 04 20:49:04.949760 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 04 20:49:04.949760 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group a71f58bf-5109-49de-adad-5cf36ec1b6a1 in use. Oct 04 20:49:04.949760 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e22d2a19-a75c-4519-af2c-023e10cfaf48'] Oct 04 20:49:04.949760 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:49:04.949760 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:49:04.949760 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:49:04.949760 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:49:04.949760 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:49:04.949760 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:49:04.949760 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:49:04.949760 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:49:04.949760 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group a71f58bf-5109-49de-adad-5cf36ec1b6a1 in use. Oct 04 20:49:04.949760 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e22d2a19-a75c-4519-af2c-023e10cfaf48'] Oct 04 20:49:04.949760 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:49:04.956385 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-be9b3a80-90ea-45bc-8875-1c0d7dcb317e tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:04.956904 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2c425b3d-ffc4-4464-a99a-4dfa74b99f78 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Returning 400 to user: Security Group a71f58bf-5109-49de-adad-5cf36ec1b6a1 in use. Oct 04 20:49:04.956904 n-d-854823-8 devstack@n-api.service[128801]: Neutron server returns request_ids: ['req-e22d2a19-a75c-4519-af2c-023e10cfaf48'] {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:49:04.956904 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-2c425b3d-ffc4-4464-a99a-4dfa74b99f78 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/a71f58bf-5109-49de-adad-5cf36ec1b6a1" status: 400 len: 185 microversion: 2.1 time: 0.833298 Oct 04 20:49:04.956904 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1695/3489] 10.222.0.33 () {58 vars in 1272 bytes} [Tue Oct 4 20:49:04 2022] DELETE /compute/v2.1/os-security-groups/a71f58bf-5109-49de-adad-5cf36ec1b6a1 => generated 185 bytes in 839 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 20:49:04.977102 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-bef793f6-850a-402d-833f-f4a830bfda0f tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:49:04.987063 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-bef793f6-850a-402d-833f-f4a830bfda0f tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] [instance: 8526b237-847c-47b7-9f0b-8209c9a07b95] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:49:04.996995 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bef793f6-850a-402d-833f-f4a830bfda0f tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:04.997777 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bef793f6-850a-402d-833f-f4a830bfda0f tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:04.998907 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bef793f6-850a-402d-833f-f4a830bfda0f tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:05.000241 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bef793f6-850a-402d-833f-f4a830bfda0f tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:05.001605 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bef793f6-850a-402d-833f-f4a830bfda0f tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:05.002445 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bef793f6-850a-402d-833f-f4a830bfda0f tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:05.131414 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-bef793f6-850a-402d-833f-f4a830bfda0f tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] 10.222.0.33 "POST /compute/v2.1/servers/8526b237-847c-47b7-9f0b-8209c9a07b95/action" status: 202 len: 0 microversion: 2.1 time: 0.175437 Oct 04 20:49:05.133293 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1696/3490] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 20:49:04 2022] POST /compute/v2.1/servers/8526b237-847c-47b7-9f0b-8209c9a07b95/action => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:49:05.149717 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-962622c7-4ec8-4261-8da9-153e38340370 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:49:05.151287 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-962622c7-4ec8-4261-8da9-153e38340370 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] [instance: 8526b237-847c-47b7-9f0b-8209c9a07b95] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:49:05.169320 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-962622c7-4ec8-4261-8da9-153e38340370 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:05.172759 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-962622c7-4ec8-4261-8da9-153e38340370 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:05.177369 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-962622c7-4ec8-4261-8da9-153e38340370 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:05.178461 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-962622c7-4ec8-4261-8da9-153e38340370 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:05.179159 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-962622c7-4ec8-4261-8da9-153e38340370 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:05.179775 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-962622c7-4ec8-4261-8da9-153e38340370 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:05.452648 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-be9b3a80-90ea-45bc-8875-1c0d7dcb317e tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac650232cc04810b1340dc2f0edadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b0670d1bd99424780a70e69d57a2166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:49:05.461640 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-be9b3a80-90ea-45bc-8875-1c0d7dcb317e tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48" status: 200 len: 1674 microversion: 2.1 time: 0.561040 Oct 04 20:49:05.478925 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1795/3491] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:49:04 2022] GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48 => generated 1674 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:49:05.561010 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-962622c7-4ec8-4261-8da9-153e38340370 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6775b9d82b3444f6b728736f1d2b2806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5338cf2146344042bc263bdc4f9d822b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:49:05.573061 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-962622c7-4ec8-4261-8da9-153e38340370 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] 10.222.0.33 "GET /compute/v2.1/servers/8526b237-847c-47b7-9f0b-8209c9a07b95" status: 200 len: 1575 microversion: 2.1 time: 0.435270 Oct 04 20:49:05.586373 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1697/3492] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:49:05 2022] GET /compute/v2.1/servers/8526b237-847c-47b7-9f0b-8209c9a07b95 => generated 1575 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:49:06.502929 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-62bc9f44-6a2c-47da-ab35-654abb39e3b3 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:49:06.504138 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-62bc9f44-6a2c-47da-ab35-654abb39e3b3 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: 4d46fff2-b04d-41aa-ada0-2023ab545b48] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:49:06.513347 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-62bc9f44-6a2c-47da-ab35-654abb39e3b3 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:06.515783 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-62bc9f44-6a2c-47da-ab35-654abb39e3b3 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:06.519463 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-62bc9f44-6a2c-47da-ab35-654abb39e3b3 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:06.520578 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-62bc9f44-6a2c-47da-ab35-654abb39e3b3 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:06.521753 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-62bc9f44-6a2c-47da-ab35-654abb39e3b3 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:06.522896 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-62bc9f44-6a2c-47da-ab35-654abb39e3b3 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:06.613649 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d2a70670-13c8-4d00-8da3-0c68bde6ba5d tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:49:06.614697 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d2a70670-13c8-4d00-8da3-0c68bde6ba5d tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] [instance: 8526b237-847c-47b7-9f0b-8209c9a07b95] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:49:06.622937 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d2a70670-13c8-4d00-8da3-0c68bde6ba5d tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:06.623526 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d2a70670-13c8-4d00-8da3-0c68bde6ba5d tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:06.624049 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d2a70670-13c8-4d00-8da3-0c68bde6ba5d tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:06.624855 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d2a70670-13c8-4d00-8da3-0c68bde6ba5d tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:06.625382 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d2a70670-13c8-4d00-8da3-0c68bde6ba5d tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:06.625883 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d2a70670-13c8-4d00-8da3-0c68bde6ba5d tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:06.896304 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d2a70670-13c8-4d00-8da3-0c68bde6ba5d tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6775b9d82b3444f6b728736f1d2b2806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5338cf2146344042bc263bdc4f9d822b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:49:06.904943 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d2a70670-13c8-4d00-8da3-0c68bde6ba5d tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] 10.222.0.33 "GET /compute/v2.1/servers/8526b237-847c-47b7-9f0b-8209c9a07b95" status: 200 len: 1575 microversion: 2.1 time: 0.302671 Oct 04 20:49:06.908506 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1698/3493] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:49:06 2022] GET /compute/v2.1/servers/8526b237-847c-47b7-9f0b-8209c9a07b95 => generated 1575 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:49:06.937267 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-62bc9f44-6a2c-47da-ab35-654abb39e3b3 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac650232cc04810b1340dc2f0edadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b0670d1bd99424780a70e69d57a2166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:49:06.947711 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-62bc9f44-6a2c-47da-ab35-654abb39e3b3 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48" status: 200 len: 1654 microversion: 2.1 time: 0.449350 Oct 04 20:49:06.952448 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1796/3494] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:49:06 2022] GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48 => generated 1654 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:49:06.976552 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-cde3798a-6a33-4ebe-b56f-4263beb277a7 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:49:06.977283 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-cde3798a-6a33-4ebe-b56f-4263beb277a7 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: 4d46fff2-b04d-41aa-ada0-2023ab545b48] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:49:06.986239 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cde3798a-6a33-4ebe-b56f-4263beb277a7 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:06.987142 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cde3798a-6a33-4ebe-b56f-4263beb277a7 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:06.987809 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cde3798a-6a33-4ebe-b56f-4263beb277a7 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:06.989333 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cde3798a-6a33-4ebe-b56f-4263beb277a7 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:06.990204 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cde3798a-6a33-4ebe-b56f-4263beb277a7 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:06.991065 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cde3798a-6a33-4ebe-b56f-4263beb277a7 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:07.073863 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:49:07.084891 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-cde3798a-6a33-4ebe-b56f-4263beb277a7 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "POST /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48/action" status: 202 len: 0 microversion: 2.1 time: 0.114839 Oct 04 20:49:07.091206 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1699/3495] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 20:49:06 2022] POST /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48/action => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:49:07.100230 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-c9ac65a5-61cc-44b5-b180-02a3086359dd tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:49:07.101164 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-c9ac65a5-61cc-44b5-b180-02a3086359dd tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: 4d46fff2-b04d-41aa-ada0-2023ab545b48] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:49:07.119296 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c9ac65a5-61cc-44b5-b180-02a3086359dd tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:07.120105 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c9ac65a5-61cc-44b5-b180-02a3086359dd tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:07.123242 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c9ac65a5-61cc-44b5-b180-02a3086359dd tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:07.124761 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c9ac65a5-61cc-44b5-b180-02a3086359dd tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:07.126912 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c9ac65a5-61cc-44b5-b180-02a3086359dd tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:07.127558 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c9ac65a5-61cc-44b5-b180-02a3086359dd tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:07.410711 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-c9ac65a5-61cc-44b5-b180-02a3086359dd tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac650232cc04810b1340dc2f0edadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b0670d1bd99424780a70e69d57a2166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:49:07.426472 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-c9ac65a5-61cc-44b5-b180-02a3086359dd tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48" status: 200 len: 1661 microversion: 2.1 time: 0.328230 Oct 04 20:49:07.430382 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1797/3496] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:49:07 2022] GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48 => generated 1661 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:49:07.671985 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-27f97832-2913-49bf-a34d-46ee979e0bae tempest-ImagesDeleteNegativeTestJSON-1009927120 tempest-ImagesDeleteNegativeTestJSON-1009927120-project] 10.222.0.33 "DELETE /compute/v2.1/images/" status: 404 len: 112 microversion: - time: 0.442056 Oct 04 20:49:07.672618 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1700/3497] 10.222.0.33 () {58 vars in 1128 bytes} [Tue Oct 4 20:49:07 2022] DELETE /compute/v2.1/images/ => generated 112 bytes in 444 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 04 20:49:07.683804 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-bc0a6063-eb7d-42c9-88e0-6c91cb8612a4 tempest-ImagesDeleteNegativeTestJSON-1009927120 tempest-ImagesDeleteNegativeTestJSON-1009927120-project] Calling method '.version_select at 0x7f3c7885c790>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:49:07.715783 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.wsgi [None req-bc0a6063-eb7d-42c9-88e0-6c91cb8612a4 tempest-ImagesDeleteNegativeTestJSON-1009927120 tempest-ImagesDeleteNegativeTestJSON-1009927120-project] HTTP exception thrown: Image not found. Oct 04 20:49:07.717849 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-bc0a6063-eb7d-42c9-88e0-6c91cb8612a4 tempest-ImagesDeleteNegativeTestJSON-1009927120 tempest-ImagesDeleteNegativeTestJSON-1009927120-project] Request method failure captured: Oct 04 20:49:07.717849 n-d-854823-8 devstack@n-api.service[128802]: request: DELETE /compute/v2.1/images/-1 HTTP/1.1 Oct 04 20:49:07.717849 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 20:49:07.717849 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 20:49:07.717849 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 20:49:07.717849 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 0 Oct 04 20:49:07.717849 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 20:49:07.717849 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 20:49:07.717849 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 20:49:07.717849 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 20:49:07.717849 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPJxDQU3S-tukabYchENr5jl1ei55ca22y7LWDhQ0OCPfpLNTcBTkiKtIOhBQ1DvSPH03NF5C1mMO_OZOBwSQ70FUK8JazhFVqdnAbTvTVkIrQ1xAY8hXwI8gQ2xRhXjC_6HEiUvIcn2YPXMsL6pw1KSYXKbN7668XovmGNbbasWq2nY Oct 04 20:49:07.717849 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 20:49:07.717849 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 20:49:07.717849 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 20:49:07.717849 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 20:49:07.717849 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 20:49:07.717849 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 20:49:07.717849 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: c92b57ae74af40b6b7bb95df6633cc10 Oct 04 20:49:07.717849 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1009927120 Oct 04 20:49:07.717849 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 20:49:07.717849 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 20:49:07.717849 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_c92b57ae74af40b6b7bb95df6633cc10", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c92b57ae74af40b6b7bb95df6633cc10"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c92b57ae74af40b6b7bb95df6633cc10"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/c92b57ae74af40b6b7bb95df6633cc10"}]}] Oct 04 20:49:07.717849 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1009927120 Oct 04 20:49:07.717849 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: c92b57ae74af40b6b7bb95df6633cc10 Oct 04 20:49:07.717849 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1009927120 Oct 04 20:49:07.717849 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-ImagesDeleteNegativeTestJSON-1009927120-project Oct 04 20:49:07.717849 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 20:49:07.717849 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 20:49:07.717849 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: b46368625d4a45a08fc6ce592d4fb10d Oct 04 20:49:07.717849 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1009927120-project Oct 04 20:49:07.717849 n-d-854823-8 devstack@n-api.service[128802]: method: Oct 04 20:49:07.717849 n-d-854823-8 devstack@n-api.service[128802]: exception: Image not found. Oct 04 20:49:07.717849 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'id': '-1'} Oct 04 20:49:07.717849 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:49:07.717849 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:49:07.717849 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 04 20:49:07.717849 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 04 20:49:07.717849 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 20:49:07.717849 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 20:49:07.717849 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 20:49:07.717849 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 20:49:07.717849 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 04 20:49:07.717849 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 04 20:49:07.717849 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 04 20:49:07.717849 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 04 20:49:07.717849 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 20:49:07.717849 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 20:49:07.717849 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 20:49:07.717849 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 20:49:07.717849 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image -1 to delete Oct 04 20:49:07.717849 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:49:07.717849 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:49:07.717849 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:49:07.717849 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:49:07.717849 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 04 20:49:07.717849 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 04 20:49:07.717849 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 04 20:49:07.717849 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 04 20:49:07.717849 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 04 20:49:07.717849 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 04 20:49:07.717849 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image -1 could not be found. Oct 04 20:49:07.717849 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:49:07.717849 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:49:07.717849 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:49:07.717849 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:49:07.723510 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:49:07.723510 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:49:07.723510 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:49:07.723510 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:49:07.723510 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:49:07.723510 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:49:07.723510 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:49:07.723510 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:49:07.723510 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 04 20:49:07.723510 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 04 20:49:07.723510 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 20:49:07.723510 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:49:07.723510 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:49:07.723510 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:49:07.723510 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:49:07.723510 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:49:07.723510 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:49:07.723510 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:49:07.723510 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:49:07.723510 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 20:49:07.723510 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:49:07.723510 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-bc0a6063-eb7d-42c9-88e0-6c91cb8612a4 tempest-ImagesDeleteNegativeTestJSON-1009927120 tempest-ImagesDeleteNegativeTestJSON-1009927120-project] Returning 404 to user: Image not found. {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:49:07.723510 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-bc0a6063-eb7d-42c9-88e0-6c91cb8612a4 tempest-ImagesDeleteNegativeTestJSON-1009927120 tempest-ImagesDeleteNegativeTestJSON-1009927120-project] 10.222.0.33 "DELETE /compute/v2.1/images/-1" status: 404 len: 62 microversion: 2.1 time: 0.043302 Oct 04 20:49:07.723510 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1798/3498] 10.222.0.33 () {58 vars in 1134 bytes} [Tue Oct 4 20:49:07 2022] DELETE /compute/v2.1/images/-1 => generated 62 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 20:49:07.732311 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2a8c0a7c-2260-4448-b525-05989f29b8a0 tempest-ImagesDeleteNegativeTestJSON-1009927120 tempest-ImagesDeleteNegativeTestJSON-1009927120-project] Calling method '.version_select at 0x7f3c6f510040>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:49:07.760498 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-2a8c0a7c-2260-4448-b525-05989f29b8a0 tempest-ImagesDeleteNegativeTestJSON-1009927120 tempest-ImagesDeleteNegativeTestJSON-1009927120-project] HTTP exception thrown: Image not found. Oct 04 20:49:07.763973 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2a8c0a7c-2260-4448-b525-05989f29b8a0 tempest-ImagesDeleteNegativeTestJSON-1009927120 tempest-ImagesDeleteNegativeTestJSON-1009927120-project] Request method failure captured: Oct 04 20:49:07.763973 n-d-854823-8 devstack@n-api.service[128801]: request: DELETE /compute/v2.1/images/a8feb29e-4bc6-4bf6-8b94-6286fadfcd3j HTTP/1.1 Oct 04 20:49:07.763973 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:49:07.763973 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:49:07.763973 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:49:07.763973 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 0 Oct 04 20:49:07.763973 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:49:07.763973 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:49:07.763973 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:49:07.763973 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:49:07.763973 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJxDQU3S-tukabYchENr5jl1ei55ca22y7LWDhQ0OCPfpLNTcBTkiKtIOhBQ1DvSPH03NF5C1mMO_OZOBwSQ70FUK8JazhFVqdnAbTvTVkIrQ1xAY8hXwI8gQ2xRhXjC_6HEiUvIcn2YPXMsL6pw1KSYXKbN7668XovmGNbbasWq2nY Oct 04 20:49:07.763973 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:49:07.763973 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:49:07.763973 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:49:07.763973 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:49:07.763973 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:49:07.763973 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:49:07.763973 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: c92b57ae74af40b6b7bb95df6633cc10 Oct 04 20:49:07.763973 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1009927120 Oct 04 20:49:07.763973 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 20:49:07.763973 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 20:49:07.763973 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_c92b57ae74af40b6b7bb95df6633cc10", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c92b57ae74af40b6b7bb95df6633cc10"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c92b57ae74af40b6b7bb95df6633cc10"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/c92b57ae74af40b6b7bb95df6633cc10"}]}] Oct 04 20:49:07.763973 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1009927120 Oct 04 20:49:07.763973 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: c92b57ae74af40b6b7bb95df6633cc10 Oct 04 20:49:07.763973 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1009927120 Oct 04 20:49:07.763973 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-ImagesDeleteNegativeTestJSON-1009927120-project Oct 04 20:49:07.763973 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:49:07.763973 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:49:07.763973 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: b46368625d4a45a08fc6ce592d4fb10d Oct 04 20:49:07.763973 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1009927120-project Oct 04 20:49:07.763973 n-d-854823-8 devstack@n-api.service[128801]: method: Oct 04 20:49:07.763973 n-d-854823-8 devstack@n-api.service[128801]: exception: Image not found. Oct 04 20:49:07.763973 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': 'a8feb29e-4bc6-4bf6-8b94-6286fadfcd3j'} Oct 04 20:49:07.763973 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:49:07.763973 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:49:07.763973 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 04 20:49:07.763973 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 04 20:49:07.763973 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 20:49:07.763973 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 20:49:07.763973 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 20:49:07.763973 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 20:49:07.763973 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 04 20:49:07.763973 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 04 20:49:07.763973 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 04 20:49:07.763973 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 04 20:49:07.763973 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 20:49:07.763973 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 20:49:07.763973 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 20:49:07.763973 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 20:49:07.763973 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image a8feb29e-4bc6-4bf6-8b94-6286fadfcd3j to delete Oct 04 20:49:07.763973 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:49:07.763973 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:49:07.763973 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:49:07.763973 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:49:07.763973 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 04 20:49:07.763973 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 04 20:49:07.763973 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 04 20:49:07.763973 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 04 20:49:07.763973 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 04 20:49:07.763973 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 04 20:49:07.763973 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image a8feb29e-4bc6-4bf6-8b94-6286fadfcd3j could not be found. Oct 04 20:49:07.763973 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:49:07.763973 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:49:07.763973 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:49:07.769424 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:49:07.769424 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:49:07.769424 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:49:07.769424 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:49:07.769424 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:49:07.769424 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:49:07.769424 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:49:07.769424 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:49:07.769424 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:49:07.769424 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 04 20:49:07.769424 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 04 20:49:07.769424 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 20:49:07.769424 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:49:07.769424 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:49:07.769424 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:49:07.769424 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:49:07.769424 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:49:07.769424 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:49:07.769424 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:49:07.769424 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:49:07.769424 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 20:49:07.769424 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:49:07.769424 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2a8c0a7c-2260-4448-b525-05989f29b8a0 tempest-ImagesDeleteNegativeTestJSON-1009927120 tempest-ImagesDeleteNegativeTestJSON-1009927120-project] Returning 404 to user: Image not found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:49:07.769424 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-2a8c0a7c-2260-4448-b525-05989f29b8a0 tempest-ImagesDeleteNegativeTestJSON-1009927120 tempest-ImagesDeleteNegativeTestJSON-1009927120-project] 10.222.0.33 "DELETE /compute/v2.1/images/a8feb29e-4bc6-4bf6-8b94-6286fadfcd3j" status: 404 len: 62 microversion: 2.1 time: 0.037679 Oct 04 20:49:07.769424 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1701/3499] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:49:07 2022] DELETE /compute/v2.1/images/a8feb29e-4bc6-4bf6-8b94-6286fadfcd3j => generated 62 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 20:49:07.784650 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-0cf30e62-d272-48d4-a8c4-f7f6e8f5f5c6 tempest-ImagesDeleteNegativeTestJSON-1009927120 tempest-ImagesDeleteNegativeTestJSON-1009927120-project] Calling method '.version_select at 0x7f3c74118af0>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:49:07.806680 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.wsgi [None req-0cf30e62-d272-48d4-a8c4-f7f6e8f5f5c6 tempest-ImagesDeleteNegativeTestJSON-1009927120 tempest-ImagesDeleteNegativeTestJSON-1009927120-project] HTTP exception thrown: Image not found. Oct 04 20:49:07.808528 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-0cf30e62-d272-48d4-a8c4-f7f6e8f5f5c6 tempest-ImagesDeleteNegativeTestJSON-1009927120 tempest-ImagesDeleteNegativeTestJSON-1009927120-project] Request method failure captured: Oct 04 20:49:07.808528 n-d-854823-8 devstack@n-api.service[128802]: request: DELETE /compute/v2.1/images/18b1bcce-138a-40ec-9790-964983520d941 HTTP/1.1 Oct 04 20:49:07.808528 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 20:49:07.808528 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 20:49:07.808528 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 20:49:07.808528 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 0 Oct 04 20:49:07.808528 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 20:49:07.808528 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 20:49:07.808528 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 20:49:07.808528 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 20:49:07.808528 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPJxDQU3S-tukabYchENr5jl1ei55ca22y7LWDhQ0OCPfpLNTcBTkiKtIOhBQ1DvSPH03NF5C1mMO_OZOBwSQ70FUK8JazhFVqdnAbTvTVkIrQ1xAY8hXwI8gQ2xRhXjC_6HEiUvIcn2YPXMsL6pw1KSYXKbN7668XovmGNbbasWq2nY Oct 04 20:49:07.808528 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 20:49:07.808528 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 20:49:07.808528 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 20:49:07.808528 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 20:49:07.808528 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 20:49:07.808528 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 20:49:07.808528 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: c92b57ae74af40b6b7bb95df6633cc10 Oct 04 20:49:07.808528 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1009927120 Oct 04 20:49:07.808528 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 20:49:07.808528 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 20:49:07.808528 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_c92b57ae74af40b6b7bb95df6633cc10", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c92b57ae74af40b6b7bb95df6633cc10"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c92b57ae74af40b6b7bb95df6633cc10"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/c92b57ae74af40b6b7bb95df6633cc10"}]}] Oct 04 20:49:07.808528 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1009927120 Oct 04 20:49:07.808528 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: c92b57ae74af40b6b7bb95df6633cc10 Oct 04 20:49:07.808528 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1009927120 Oct 04 20:49:07.808528 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-ImagesDeleteNegativeTestJSON-1009927120-project Oct 04 20:49:07.808528 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 20:49:07.808528 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 20:49:07.808528 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: b46368625d4a45a08fc6ce592d4fb10d Oct 04 20:49:07.808528 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1009927120-project Oct 04 20:49:07.808528 n-d-854823-8 devstack@n-api.service[128802]: method: Oct 04 20:49:07.808528 n-d-854823-8 devstack@n-api.service[128802]: exception: Image not found. Oct 04 20:49:07.808528 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'id': '18b1bcce-138a-40ec-9790-964983520d941'} Oct 04 20:49:07.808528 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:49:07.808528 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:49:07.808528 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 04 20:49:07.808528 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 04 20:49:07.808528 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 20:49:07.808528 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 20:49:07.808528 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 20:49:07.808528 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 20:49:07.808528 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 04 20:49:07.808528 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 04 20:49:07.808528 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 04 20:49:07.808528 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 04 20:49:07.808528 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 20:49:07.808528 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 20:49:07.808528 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 20:49:07.808528 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 20:49:07.808528 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 18b1bcce-138a-40ec-9790-964983520d941 to delete Oct 04 20:49:07.808528 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:49:07.808528 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:49:07.808528 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:49:07.808528 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:49:07.808528 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 04 20:49:07.808528 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 04 20:49:07.808528 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 04 20:49:07.808528 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 04 20:49:07.808528 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 04 20:49:07.808528 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 04 20:49:07.808528 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 18b1bcce-138a-40ec-9790-964983520d941 could not be found. Oct 04 20:49:07.808528 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:49:07.808528 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:49:07.808528 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:49:07.813293 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:49:07.813293 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:49:07.813293 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:49:07.813293 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:49:07.813293 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:49:07.813293 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:49:07.813293 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:49:07.813293 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:49:07.813293 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:49:07.813293 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 04 20:49:07.813293 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 04 20:49:07.813293 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 20:49:07.813293 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:49:07.813293 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:49:07.813293 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:49:07.813293 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:49:07.813293 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:49:07.813293 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:49:07.813293 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:49:07.813293 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:49:07.813293 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 20:49:07.813293 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:49:07.813293 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-0cf30e62-d272-48d4-a8c4-f7f6e8f5f5c6 tempest-ImagesDeleteNegativeTestJSON-1009927120 tempest-ImagesDeleteNegativeTestJSON-1009927120-project] Returning 404 to user: Image not found. {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:49:07.813293 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-0cf30e62-d272-48d4-a8c4-f7f6e8f5f5c6 tempest-ImagesDeleteNegativeTestJSON-1009927120 tempest-ImagesDeleteNegativeTestJSON-1009927120-project] 10.222.0.33 "DELETE /compute/v2.1/images/18b1bcce-138a-40ec-9790-964983520d941" status: 404 len: 62 microversion: 2.1 time: 0.037833 Oct 04 20:49:07.813293 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1799/3500] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 20:49:07 2022] DELETE /compute/v2.1/images/18b1bcce-138a-40ec-9790-964983520d941 => generated 62 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 20:49:07.823909 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-005bfd16-2617-49fb-b785-9565a885501e tempest-ImagesDeleteNegativeTestJSON-1009927120 tempest-ImagesDeleteNegativeTestJSON-1009927120-project] Calling method '.version_select at 0x7f3c6f510160>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:49:07.859904 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-005bfd16-2617-49fb-b785-9565a885501e tempest-ImagesDeleteNegativeTestJSON-1009927120 tempest-ImagesDeleteNegativeTestJSON-1009927120-project] HTTP exception thrown: Image not found. Oct 04 20:49:07.861871 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-005bfd16-2617-49fb-b785-9565a885501e tempest-ImagesDeleteNegativeTestJSON-1009927120 tempest-ImagesDeleteNegativeTestJSON-1009927120-project] Request method failure captured: Oct 04 20:49:07.861871 n-d-854823-8 devstack@n-api.service[128801]: request: DELETE /compute/v2.1/images/tempest-invalid-1800402922 HTTP/1.1 Oct 04 20:49:07.861871 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:49:07.861871 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:49:07.861871 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:49:07.861871 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 0 Oct 04 20:49:07.861871 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:49:07.861871 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:49:07.861871 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:49:07.861871 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:49:07.861871 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJxDQU3S-tukabYchENr5jl1ei55ca22y7LWDhQ0OCPfpLNTcBTkiKtIOhBQ1DvSPH03NF5C1mMO_OZOBwSQ70FUK8JazhFVqdnAbTvTVkIrQ1xAY8hXwI8gQ2xRhXjC_6HEiUvIcn2YPXMsL6pw1KSYXKbN7668XovmGNbbasWq2nY Oct 04 20:49:07.861871 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:49:07.861871 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:49:07.861871 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:49:07.861871 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:49:07.861871 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:49:07.861871 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:49:07.861871 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: c92b57ae74af40b6b7bb95df6633cc10 Oct 04 20:49:07.861871 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1009927120 Oct 04 20:49:07.861871 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 20:49:07.861871 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 20:49:07.861871 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_c92b57ae74af40b6b7bb95df6633cc10", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c92b57ae74af40b6b7bb95df6633cc10"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c92b57ae74af40b6b7bb95df6633cc10"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/c92b57ae74af40b6b7bb95df6633cc10"}]}] Oct 04 20:49:07.861871 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1009927120 Oct 04 20:49:07.861871 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: c92b57ae74af40b6b7bb95df6633cc10 Oct 04 20:49:07.861871 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1009927120 Oct 04 20:49:07.861871 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-ImagesDeleteNegativeTestJSON-1009927120-project Oct 04 20:49:07.861871 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:49:07.861871 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:49:07.861871 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: b46368625d4a45a08fc6ce592d4fb10d Oct 04 20:49:07.861871 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1009927120-project Oct 04 20:49:07.861871 n-d-854823-8 devstack@n-api.service[128801]: method: Oct 04 20:49:07.861871 n-d-854823-8 devstack@n-api.service[128801]: exception: Image not found. Oct 04 20:49:07.861871 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': 'tempest-invalid-1800402922'} Oct 04 20:49:07.861871 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:49:07.861871 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:49:07.861871 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 04 20:49:07.861871 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 04 20:49:07.861871 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 20:49:07.861871 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 20:49:07.861871 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 20:49:07.861871 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 20:49:07.861871 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 04 20:49:07.861871 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 04 20:49:07.861871 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 04 20:49:07.861871 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 04 20:49:07.861871 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 20:49:07.861871 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 20:49:07.861871 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 20:49:07.861871 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 20:49:07.861871 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image tempest-invalid-1800402922 to delete Oct 04 20:49:07.861871 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:49:07.861871 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:49:07.861871 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:49:07.861871 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:49:07.861871 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 04 20:49:07.861871 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 04 20:49:07.861871 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 04 20:49:07.861871 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 04 20:49:07.861871 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 04 20:49:07.861871 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 04 20:49:07.861871 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image tempest-invalid-1800402922 could not be found. Oct 04 20:49:07.861871 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:49:07.861871 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:49:07.861871 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:49:07.861871 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:49:07.866705 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:49:07.866705 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:49:07.866705 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:49:07.866705 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:49:07.866705 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:49:07.866705 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:49:07.866705 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:49:07.866705 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:49:07.866705 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 04 20:49:07.866705 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 04 20:49:07.866705 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 20:49:07.866705 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:49:07.866705 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:49:07.866705 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:49:07.866705 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:49:07.866705 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:49:07.866705 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:49:07.866705 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:49:07.866705 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:49:07.866705 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 20:49:07.866705 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:49:07.876083 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-005bfd16-2617-49fb-b785-9565a885501e tempest-ImagesDeleteNegativeTestJSON-1009927120 tempest-ImagesDeleteNegativeTestJSON-1009927120-project] Returning 404 to user: Image not found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:49:07.878244 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-005bfd16-2617-49fb-b785-9565a885501e tempest-ImagesDeleteNegativeTestJSON-1009927120 tempest-ImagesDeleteNegativeTestJSON-1009927120-project] 10.222.0.33 "DELETE /compute/v2.1/images/tempest-invalid-1800402922" status: 404 len: 62 microversion: 2.1 time: 0.059992 Oct 04 20:49:07.889606 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-1cc630b9-6d26-4513-ad98-c45456b43f90 tempest-ImagesDeleteNegativeTestJSON-1009927120 tempest-ImagesDeleteNegativeTestJSON-1009927120-project] Calling method '.version_select at 0x7f3c7885c040>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:49:07.893835 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1702/3501] 10.222.0.33 () {58 vars in 1206 bytes} [Tue Oct 4 20:49:07 2022] DELETE /compute/v2.1/images/tempest-invalid-1800402922 => generated 62 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 20:49:07.923777 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.wsgi [None req-1cc630b9-6d26-4513-ad98-c45456b43f90 tempest-ImagesDeleteNegativeTestJSON-1009927120 tempest-ImagesDeleteNegativeTestJSON-1009927120-project] HTTP exception thrown: Image not found. Oct 04 20:49:07.926128 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-1cc630b9-6d26-4513-ad98-c45456b43f90 tempest-ImagesDeleteNegativeTestJSON-1009927120 tempest-ImagesDeleteNegativeTestJSON-1009927120-project] Request method failure captured: Oct 04 20:49:07.926128 n-d-854823-8 devstack@n-api.service[128802]: request: DELETE /compute/v2.1/images/418bebe8-edf3-4029-a2a8-64a6c8d08c36 HTTP/1.1 Oct 04 20:49:07.926128 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 20:49:07.926128 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 20:49:07.926128 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 20:49:07.926128 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 0 Oct 04 20:49:07.926128 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 20:49:07.926128 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 20:49:07.926128 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 20:49:07.926128 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 20:49:07.926128 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPJxDQU3S-tukabYchENr5jl1ei55ca22y7LWDhQ0OCPfpLNTcBTkiKtIOhBQ1DvSPH03NF5C1mMO_OZOBwSQ70FUK8JazhFVqdnAbTvTVkIrQ1xAY8hXwI8gQ2xRhXjC_6HEiUvIcn2YPXMsL6pw1KSYXKbN7668XovmGNbbasWq2nY Oct 04 20:49:07.926128 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 20:49:07.926128 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 20:49:07.926128 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 20:49:07.926128 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 20:49:07.926128 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 20:49:07.926128 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 20:49:07.926128 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: c92b57ae74af40b6b7bb95df6633cc10 Oct 04 20:49:07.926128 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1009927120 Oct 04 20:49:07.926128 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 20:49:07.926128 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 20:49:07.926128 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_c92b57ae74af40b6b7bb95df6633cc10", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c92b57ae74af40b6b7bb95df6633cc10"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c92b57ae74af40b6b7bb95df6633cc10"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/c92b57ae74af40b6b7bb95df6633cc10"}]}] Oct 04 20:49:07.926128 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1009927120 Oct 04 20:49:07.926128 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: c92b57ae74af40b6b7bb95df6633cc10 Oct 04 20:49:07.926128 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1009927120 Oct 04 20:49:07.926128 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-ImagesDeleteNegativeTestJSON-1009927120-project Oct 04 20:49:07.926128 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 20:49:07.926128 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 20:49:07.926128 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: b46368625d4a45a08fc6ce592d4fb10d Oct 04 20:49:07.926128 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1009927120-project Oct 04 20:49:07.926128 n-d-854823-8 devstack@n-api.service[128802]: method: Oct 04 20:49:07.926128 n-d-854823-8 devstack@n-api.service[128802]: exception: Image not found. Oct 04 20:49:07.926128 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'id': '418bebe8-edf3-4029-a2a8-64a6c8d08c36'} Oct 04 20:49:07.926128 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:49:07.926128 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:49:07.926128 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 04 20:49:07.926128 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 04 20:49:07.926128 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 20:49:07.926128 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 20:49:07.926128 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 20:49:07.926128 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 20:49:07.926128 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 04 20:49:07.926128 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 04 20:49:07.926128 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 04 20:49:07.926128 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 04 20:49:07.926128 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 20:49:07.926128 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 20:49:07.926128 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 20:49:07.926128 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 20:49:07.926128 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 418bebe8-edf3-4029-a2a8-64a6c8d08c36 to delete Oct 04 20:49:07.926128 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:49:07.926128 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:49:07.926128 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:49:07.926128 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:49:07.926128 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 04 20:49:07.926128 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 04 20:49:07.926128 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 04 20:49:07.926128 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 04 20:49:07.926128 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 04 20:49:07.926128 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 04 20:49:07.926128 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 418bebe8-edf3-4029-a2a8-64a6c8d08c36 could not be found. Oct 04 20:49:07.926128 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:49:07.926128 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:49:07.926128 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:49:07.931092 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:49:07.931092 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:49:07.931092 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:49:07.931092 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:49:07.931092 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:49:07.931092 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:49:07.931092 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:49:07.931092 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:49:07.931092 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:49:07.931092 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 04 20:49:07.931092 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 04 20:49:07.931092 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 20:49:07.931092 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:49:07.931092 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:49:07.931092 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:49:07.931092 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:49:07.931092 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:49:07.931092 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:49:07.931092 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:49:07.931092 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:49:07.931092 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 20:49:07.931092 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:49:07.933328 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-1cc630b9-6d26-4513-ad98-c45456b43f90 tempest-ImagesDeleteNegativeTestJSON-1009927120 tempest-ImagesDeleteNegativeTestJSON-1009927120-project] Returning 404 to user: Image not found. {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:49:07.934096 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-1cc630b9-6d26-4513-ad98-c45456b43f90 tempest-ImagesDeleteNegativeTestJSON-1009927120 tempest-ImagesDeleteNegativeTestJSON-1009927120-project] 10.222.0.33 "DELETE /compute/v2.1/images/418bebe8-edf3-4029-a2a8-64a6c8d08c36" status: 404 len: 62 microversion: 2.1 time: 0.048960 Oct 04 20:49:07.935661 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a11bf97c-13a2-4cd3-a5c4-a809bcdc7208 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:49:07.936409 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a11bf97c-13a2-4cd3-a5c4-a809bcdc7208 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] [instance: 8526b237-847c-47b7-9f0b-8209c9a07b95] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:49:07.940325 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1800/3502] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:49:07 2022] DELETE /compute/v2.1/images/418bebe8-edf3-4029-a2a8-64a6c8d08c36 => generated 62 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 20:49:07.955719 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a11bf97c-13a2-4cd3-a5c4-a809bcdc7208 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:07.956238 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a11bf97c-13a2-4cd3-a5c4-a809bcdc7208 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:07.956878 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a11bf97c-13a2-4cd3-a5c4-a809bcdc7208 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:07.957422 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a11bf97c-13a2-4cd3-a5c4-a809bcdc7208 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:07.963276 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a11bf97c-13a2-4cd3-a5c4-a809bcdc7208 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:07.963718 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a11bf97c-13a2-4cd3-a5c4-a809bcdc7208 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:08.288723 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-a11bf97c-13a2-4cd3-a5c4-a809bcdc7208 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6775b9d82b3444f6b728736f1d2b2806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5338cf2146344042bc263bdc4f9d822b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:49:08.303898 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a11bf97c-13a2-4cd3-a5c4-a809bcdc7208 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] 10.222.0.33 "GET /compute/v2.1/servers/8526b237-847c-47b7-9f0b-8209c9a07b95" status: 200 len: 1573 microversion: 2.1 time: 0.369112 Oct 04 20:49:08.304538 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1703/3503] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:49:07 2022] GET /compute/v2.1/servers/8526b237-847c-47b7-9f0b-8209c9a07b95 => generated 1573 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:49:08.333634 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-2ae40682-c4f6-4e4b-a9be-b73fee1d7f72 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-140840780"}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:49:08.335593 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-2ae40682-c4f6-4e4b-a9be-b73fee1d7f72 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] [instance: 8526b237-847c-47b7-9f0b-8209c9a07b95] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:49:08.343513 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2ae40682-c4f6-4e4b-a9be-b73fee1d7f72 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:08.344003 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2ae40682-c4f6-4e4b-a9be-b73fee1d7f72 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:08.344790 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2ae40682-c4f6-4e4b-a9be-b73fee1d7f72 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:08.346246 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2ae40682-c4f6-4e4b-a9be-b73fee1d7f72 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:08.349105 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2ae40682-c4f6-4e4b-a9be-b73fee1d7f72 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:08.350210 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2ae40682-c4f6-4e4b-a9be-b73fee1d7f72 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:08.456907 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c2a39d40-faae-47c7-a964-65a424d5cf4c tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:49:08.458095 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c2a39d40-faae-47c7-a964-65a424d5cf4c tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: 4d46fff2-b04d-41aa-ada0-2023ab545b48] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:49:08.473703 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c2a39d40-faae-47c7-a964-65a424d5cf4c tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:08.475579 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c2a39d40-faae-47c7-a964-65a424d5cf4c tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:08.476599 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c2a39d40-faae-47c7-a964-65a424d5cf4c tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:08.477710 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c2a39d40-faae-47c7-a964-65a424d5cf4c tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:08.479654 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c2a39d40-faae-47c7-a964-65a424d5cf4c tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:08.481438 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c2a39d40-faae-47c7-a964-65a424d5cf4c tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:09.078517 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.network.security_group_api [None req-2ae40682-c4f6-4e4b-a9be-b73fee1d7f72 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Adding security group e86d7247-5a3d-42ab-837c-07e05ae4a269 to port 8d64ffa9-7f66-45e5-ab1c-7b451118f90e Oct 04 20:49:09.291291 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c2a39d40-faae-47c7-a964-65a424d5cf4c tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac650232cc04810b1340dc2f0edadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b0670d1bd99424780a70e69d57a2166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:49:09.307646 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c2a39d40-faae-47c7-a964-65a424d5cf4c tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48" status: 200 len: 1669 microversion: 2.1 time: 0.854800 Oct 04 20:49:09.309108 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1704/3504] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:49:08 2022] GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48 => generated 1669 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:49:09.332151 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8796a19f-ccd4-4c50-aece-6d97feaa6f75 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:49:09.332803 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-8796a19f-ccd4-4c50-aece-6d97feaa6f75 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: 4d46fff2-b04d-41aa-ada0-2023ab545b48] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:49:09.344847 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8796a19f-ccd4-4c50-aece-6d97feaa6f75 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:09.345396 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8796a19f-ccd4-4c50-aece-6d97feaa6f75 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:09.346185 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8796a19f-ccd4-4c50-aece-6d97feaa6f75 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:09.347003 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8796a19f-ccd4-4c50-aece-6d97feaa6f75 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:09.352831 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8796a19f-ccd4-4c50-aece-6d97feaa6f75 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:09.353416 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8796a19f-ccd4-4c50-aece-6d97feaa6f75 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:09.764935 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-8796a19f-ccd4-4c50-aece-6d97feaa6f75 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac650232cc04810b1340dc2f0edadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b0670d1bd99424780a70e69d57a2166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:49:09.777149 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-8796a19f-ccd4-4c50-aece-6d97feaa6f75 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48" status: 200 len: 1669 microversion: 2.1 time: 0.448985 Oct 04 20:49:09.779542 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1705/3505] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:49:09 2022] GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48 => generated 1669 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:49:09.806773 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a39732a5-27c5-4076-8a32-6afb1fd3c90a tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:49:09.809108 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a39732a5-27c5-4076-8a32-6afb1fd3c90a tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: 4d46fff2-b04d-41aa-ada0-2023ab545b48] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:49:09.824548 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a39732a5-27c5-4076-8a32-6afb1fd3c90a tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:09.825052 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a39732a5-27c5-4076-8a32-6afb1fd3c90a tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:09.829228 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a39732a5-27c5-4076-8a32-6afb1fd3c90a tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:09.830799 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a39732a5-27c5-4076-8a32-6afb1fd3c90a tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:09.833461 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a39732a5-27c5-4076-8a32-6afb1fd3c90a tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:09.833903 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a39732a5-27c5-4076-8a32-6afb1fd3c90a tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:09.960639 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-2ae40682-c4f6-4e4b-a9be-b73fee1d7f72 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] 10.222.0.33 "POST /compute/v2.1/servers/8526b237-847c-47b7-9f0b-8209c9a07b95/action" status: 202 len: 0 microversion: 2.1 time: 1.632249 Oct 04 20:49:09.971310 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1801/3506] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 20:49:08 2022] POST /compute/v2.1/servers/8526b237-847c-47b7-9f0b-8209c9a07b95/action => generated 0 bytes in 1637 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:49:09.972751 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-aef23699-0684-42b1-aa03-4c6b1ab5f08c tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Calling method '.version_select at 0x7f3c741bd550>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:49:10.274417 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-a39732a5-27c5-4076-8a32-6afb1fd3c90a tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac650232cc04810b1340dc2f0edadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b0670d1bd99424780a70e69d57a2166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:49:10.282818 n-d-854823-8 devstack@n-api.service[128802]: DEBUG neutronclient.v2_0.client [None req-aef23699-0684-42b1-aa03-4c6b1ab5f08c tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group e86d7247-5a3d-42ab-837c-07e05ae4a269 in use.", "detail": ""}} {{(pid=128802) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 20:49:10.284214 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.wsgi [None req-aef23699-0684-42b1-aa03-4c6b1ab5f08c tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] HTTP exception thrown: Security Group e86d7247-5a3d-42ab-837c-07e05ae4a269 in use. Oct 04 20:49:10.284214 n-d-854823-8 devstack@n-api.service[128802]: Neutron server returns request_ids: ['req-bef6e055-bbb0-4d2d-b654-6023e1f2ca9c'] Oct 04 20:49:10.286396 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-aef23699-0684-42b1-aa03-4c6b1ab5f08c tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Request method failure captured: Oct 04 20:49:10.286396 n-d-854823-8 devstack@n-api.service[128802]: request: DELETE /compute/v2.1/os-security-groups/e86d7247-5a3d-42ab-837c-07e05ae4a269 HTTP/1.1 Oct 04 20:49:10.286396 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 20:49:10.286396 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 20:49:10.286396 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 20:49:10.286396 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 0 Oct 04 20:49:10.286396 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 20:49:10.286396 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 20:49:10.286396 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 20:49:10.286396 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 20:49:10.286396 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPJvplJ2XtdAcke_gJrXE_KNLNy4K9GZxu4xJ3RC3ictvWfS6RkKIgxre3Ypn4Hea1fYOIvZNCiP-yxvq5D6SolLdjoz27YjvMYrrTV2S3thhTnsVyXyRm0AMTe4s528xDCu1J43IqMSUlnCB8IA8Xi7RGhGDp6gPtwX5ldwf-HyrWJg Oct 04 20:49:10.286396 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 20:49:10.286396 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 20:49:10.286396 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 20:49:10.286396 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 20:49:10.286396 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 20:49:10.286396 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 20:49:10.286396 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: 5338cf2146344042bc263bdc4f9d822b Oct 04 20:49:10.286396 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-SecurityGroupsTestJSON-969894548 Oct 04 20:49:10.286396 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 20:49:10.286396 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 20:49:10.286396 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5338cf2146344042bc263bdc4f9d822b", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5338cf2146344042bc263bdc4f9d822b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5338cf2146344042bc263bdc4f9d822b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5338cf2146344042bc263bdc4f9d822b"}]}] Oct 04 20:49:10.286396 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-SecurityGroupsTestJSON-969894548 Oct 04 20:49:10.286396 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: 5338cf2146344042bc263bdc4f9d822b Oct 04 20:49:10.286396 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-969894548 Oct 04 20:49:10.286396 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-SecurityGroupsTestJSON-969894548-project Oct 04 20:49:10.286396 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 20:49:10.286396 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 20:49:10.286396 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: 6775b9d82b3444f6b728736f1d2b2806 Oct 04 20:49:10.286396 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-SecurityGroupsTestJSON-969894548-project Oct 04 20:49:10.286396 n-d-854823-8 devstack@n-api.service[128802]: method: Oct 04 20:49:10.286396 n-d-854823-8 devstack@n-api.service[128802]: exception: Security Group e86d7247-5a3d-42ab-837c-07e05ae4a269 in use. Oct 04 20:49:10.286396 n-d-854823-8 devstack@n-api.service[128802]: Neutron server returns request_ids: ['req-bef6e055-bbb0-4d2d-b654-6023e1f2ca9c'] Oct 04 20:49:10.286396 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'id': 'e86d7247-5a3d-42ab-837c-07e05ae4a269'} Oct 04 20:49:10.286396 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:49:10.286396 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:49:10.286396 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Oct 04 20:49:10.286396 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Oct 04 20:49:10.286396 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:49:10.286396 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:49:10.286396 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Oct 04 20:49:10.286396 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Oct 04 20:49:10.286396 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:49:10.286396 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:49:10.286396 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Oct 04 20:49:10.286396 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Oct 04 20:49:10.286396 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:49:10.286396 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:49:10.286396 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:49:10.286396 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:49:10.286396 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:49:10.286396 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:49:10.286396 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 20:49:10.286396 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 20:49:10.286396 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:49:10.286396 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:49:10.286396 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 20:49:10.286396 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 20:49:10.286396 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 20:49:10.286396 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 20:49:10.286396 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group e86d7247-5a3d-42ab-837c-07e05ae4a269 in use. Oct 04 20:49:10.290305 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bef6e055-bbb0-4d2d-b654-6023e1f2ca9c'] Oct 04 20:49:10.290305 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:49:10.290305 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:49:10.290305 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:49:10.290305 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:49:10.290305 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Oct 04 20:49:10.290305 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Oct 04 20:49:10.290305 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Oct 04 20:49:10.290305 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Oct 04 20:49:10.290305 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group e86d7247-5a3d-42ab-837c-07e05ae4a269 in use. Oct 04 20:49:10.290305 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bef6e055-bbb0-4d2d-b654-6023e1f2ca9c'] Oct 04 20:49:10.290305 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:49:10.290305 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:49:10.290305 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:49:10.290305 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:49:10.290305 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:49:10.290305 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:49:10.290305 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:49:10.290305 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:49:10.290305 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:49:10.290305 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:49:10.290305 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:49:10.290305 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:49:10.290305 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Oct 04 20:49:10.290305 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 04 20:49:10.290305 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group e86d7247-5a3d-42ab-837c-07e05ae4a269 in use. Oct 04 20:49:10.290305 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bef6e055-bbb0-4d2d-b654-6023e1f2ca9c'] Oct 04 20:49:10.290305 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:49:10.290305 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:49:10.290305 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:49:10.290305 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:49:10.290305 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:49:10.290305 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:49:10.290305 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:49:10.290305 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:49:10.290305 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group e86d7247-5a3d-42ab-837c-07e05ae4a269 in use. Oct 04 20:49:10.290305 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bef6e055-bbb0-4d2d-b654-6023e1f2ca9c'] Oct 04 20:49:10.290305 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:49:10.296844 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-aef23699-0684-42b1-aa03-4c6b1ab5f08c tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Returning 400 to user: Security Group e86d7247-5a3d-42ab-837c-07e05ae4a269 in use. Oct 04 20:49:10.296844 n-d-854823-8 devstack@n-api.service[128802]: Neutron server returns request_ids: ['req-bef6e055-bbb0-4d2d-b654-6023e1f2ca9c'] {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:49:10.296844 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-aef23699-0684-42b1-aa03-4c6b1ab5f08c tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/e86d7247-5a3d-42ab-837c-07e05ae4a269" status: 400 len: 185 microversion: 2.1 time: 0.326026 Oct 04 20:49:10.296844 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1802/3507] 10.222.0.33 () {58 vars in 1272 bytes} [Tue Oct 4 20:49:09 2022] DELETE /compute/v2.1/os-security-groups/e86d7247-5a3d-42ab-837c-07e05ae4a269 => generated 185 bytes in 329 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 20:49:10.306846 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-a87de37e-3d33-4880-8725-e517229c1612 req-a8012ece-b973-4356-8624-4a4b96c76b88 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8526b237-847c-47b7-9f0b-8209c9a07b95", "tag": "8d64ffa9-7f66-45e5-ab1c-7b451118f90e"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:49:10.309931 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a39732a5-27c5-4076-8a32-6afb1fd3c90a tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48" status: 200 len: 1669 microversion: 2.1 time: 0.507401 Oct 04 20:49:10.316637 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1706/3508] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:49:09 2022] GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48 => generated 1669 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:49:10.324060 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-a87de37e-3d33-4880-8725-e517229c1612 req-a8012ece-b973-4356-8624-4a4b96c76b88 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:10.324866 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-a87de37e-3d33-4880-8725-e517229c1612 req-a8012ece-b973-4356-8624-4a4b96c76b88 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:10.325517 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-a87de37e-3d33-4880-8725-e517229c1612 req-a8012ece-b973-4356-8624-4a4b96c76b88 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:10.325656 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-15d59bc0-943a-4b97-985f-6c89becf0419 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:49:10.331918 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-15d59bc0-943a-4b97-985f-6c89becf0419 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] [instance: 8526b237-847c-47b7-9f0b-8209c9a07b95] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:49:10.341347 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-a87de37e-3d33-4880-8725-e517229c1612 req-a8012ece-b973-4356-8624-4a4b96c76b88 service nova] Creating event network-changed:8d64ffa9-7f66-45e5-ab1c-7b451118f90e for instance 8526b237-847c-47b7-9f0b-8209c9a07b95 on n-h1-854823-8 Oct 04 20:49:10.346261 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-15d59bc0-943a-4b97-985f-6c89becf0419 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:10.346813 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-15d59bc0-943a-4b97-985f-6c89becf0419 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:10.347319 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-15d59bc0-943a-4b97-985f-6c89becf0419 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:10.348121 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-15d59bc0-943a-4b97-985f-6c89becf0419 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:10.355988 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-15d59bc0-943a-4b97-985f-6c89becf0419 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:10.356447 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-15d59bc0-943a-4b97-985f-6c89becf0419 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:10.368905 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-a87de37e-3d33-4880-8725-e517229c1612 req-a8012ece-b973-4356-8624-4a4b96c76b88 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068363 Oct 04 20:49:10.369701 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1803/3509] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:49:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:49:10.382794 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-ae0ef2c3-fb52-4fc8-b6b1-849eb5ff97d0 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:49:10.384590 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-ae0ef2c3-fb52-4fc8-b6b1-849eb5ff97d0 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: 4d46fff2-b04d-41aa-ada0-2023ab545b48] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:49:10.392964 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ae0ef2c3-fb52-4fc8-b6b1-849eb5ff97d0 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:10.393986 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ae0ef2c3-fb52-4fc8-b6b1-849eb5ff97d0 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:10.394683 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ae0ef2c3-fb52-4fc8-b6b1-849eb5ff97d0 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:10.396159 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ae0ef2c3-fb52-4fc8-b6b1-849eb5ff97d0 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:10.396858 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ae0ef2c3-fb52-4fc8-b6b1-849eb5ff97d0 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:10.397857 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ae0ef2c3-fb52-4fc8-b6b1-849eb5ff97d0 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:10.429435 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-15d59bc0-943a-4b97-985f-6c89becf0419 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] [instance: 8526b237-847c-47b7-9f0b-8209c9a07b95] Going to try to terminate instance {{(pid=128801) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:49:10.622536 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-15d59bc0-943a-4b97-985f-6c89becf0419 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] 10.222.0.33 "DELETE /compute/v2.1/servers/8526b237-847c-47b7-9f0b-8209c9a07b95" status: 204 len: 0 microversion: 2.1 time: 0.303436 Oct 04 20:49:10.624396 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1707/3510] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 20:49:10 2022] DELETE /compute/v2.1/servers/8526b237-847c-47b7-9f0b-8209c9a07b95 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:49:10.638613 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-909e1b21-3be9-43ff-ad1a-87e0de7d2eac tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:49:10.640690 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-909e1b21-3be9-43ff-ad1a-87e0de7d2eac tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] [instance: 8526b237-847c-47b7-9f0b-8209c9a07b95] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:49:10.653384 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-909e1b21-3be9-43ff-ad1a-87e0de7d2eac tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:10.654468 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-909e1b21-3be9-43ff-ad1a-87e0de7d2eac tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:10.655111 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-909e1b21-3be9-43ff-ad1a-87e0de7d2eac tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:10.692678 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-909e1b21-3be9-43ff-ad1a-87e0de7d2eac tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:10.694101 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-909e1b21-3be9-43ff-ad1a-87e0de7d2eac tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:10.696432 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-909e1b21-3be9-43ff-ad1a-87e0de7d2eac tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:10.728702 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-ae0ef2c3-fb52-4fc8-b6b1-849eb5ff97d0 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac650232cc04810b1340dc2f0edadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b0670d1bd99424780a70e69d57a2166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:49:10.740405 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-ae0ef2c3-fb52-4fc8-b6b1-849eb5ff97d0 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48" status: 200 len: 1669 microversion: 2.1 time: 0.367270 Oct 04 20:49:10.744037 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1804/3511] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:49:10 2022] GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48 => generated 1669 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:49:10.768513 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-2d4c00d3-3ef3-45c3-a8a2-330018575fcf tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:49:10.769134 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-2d4c00d3-3ef3-45c3-a8a2-330018575fcf tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: 4d46fff2-b04d-41aa-ada0-2023ab545b48] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:49:10.783265 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2d4c00d3-3ef3-45c3-a8a2-330018575fcf tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:10.783695 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2d4c00d3-3ef3-45c3-a8a2-330018575fcf tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:10.790713 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2d4c00d3-3ef3-45c3-a8a2-330018575fcf tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:10.791502 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2d4c00d3-3ef3-45c3-a8a2-330018575fcf tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:10.791974 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2d4c00d3-3ef3-45c3-a8a2-330018575fcf tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:10.792408 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2d4c00d3-3ef3-45c3-a8a2-330018575fcf tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:11.007952 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-909e1b21-3be9-43ff-ad1a-87e0de7d2eac tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6775b9d82b3444f6b728736f1d2b2806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5338cf2146344042bc263bdc4f9d822b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:49:11.015690 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-909e1b21-3be9-43ff-ad1a-87e0de7d2eac tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] 10.222.0.33 "GET /compute/v2.1/servers/8526b237-847c-47b7-9f0b-8209c9a07b95" status: 200 len: 1647 microversion: 2.1 time: 0.385974 Oct 04 20:49:11.016849 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1708/3512] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:49:10 2022] GET /compute/v2.1/servers/8526b237-847c-47b7-9f0b-8209c9a07b95 => generated 1647 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:49:11.024478 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-2d4c00d3-3ef3-45c3-a8a2-330018575fcf tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac650232cc04810b1340dc2f0edadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b0670d1bd99424780a70e69d57a2166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:49:11.028208 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:49:11.036333 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-2d4c00d3-3ef3-45c3-a8a2-330018575fcf tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48" status: 200 len: 1669 microversion: 2.1 time: 0.272913 Oct 04 20:49:11.037136 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1805/3513] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:49:10 2022] GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48 => generated 1669 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:49:11.059696 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-25f91e60-5546-46d4-899b-2e409821b186 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:49:11.060605 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-25f91e60-5546-46d4-899b-2e409821b186 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: 4d46fff2-b04d-41aa-ada0-2023ab545b48] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:49:11.067974 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-25f91e60-5546-46d4-899b-2e409821b186 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:11.068487 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-25f91e60-5546-46d4-899b-2e409821b186 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:11.068929 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-25f91e60-5546-46d4-899b-2e409821b186 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:11.069633 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-25f91e60-5546-46d4-899b-2e409821b186 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:11.070113 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-25f91e60-5546-46d4-899b-2e409821b186 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:11.070821 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-25f91e60-5546-46d4-899b-2e409821b186 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:11.217704 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-25f91e60-5546-46d4-899b-2e409821b186 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac650232cc04810b1340dc2f0edadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b0670d1bd99424780a70e69d57a2166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:49:11.226917 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-25f91e60-5546-46d4-899b-2e409821b186 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48" status: 200 len: 1669 microversion: 2.1 time: 0.171060 Oct 04 20:49:11.228291 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1709/3514] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:49:11 2022] GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48 => generated 1669 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:49:12.046639 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-d20d1268-1dbf-413c-aced-bce97961c520 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:49:12.047340 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-d20d1268-1dbf-413c-aced-bce97961c520 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] [instance: 8526b237-847c-47b7-9f0b-8209c9a07b95] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:49:12.057798 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d20d1268-1dbf-413c-aced-bce97961c520 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:12.059393 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d20d1268-1dbf-413c-aced-bce97961c520 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:12.060095 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d20d1268-1dbf-413c-aced-bce97961c520 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:12.063741 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d20d1268-1dbf-413c-aced-bce97961c520 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:12.066070 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d20d1268-1dbf-413c-aced-bce97961c520 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:12.068023 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d20d1268-1dbf-413c-aced-bce97961c520 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:12.624676 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-d20d1268-1dbf-413c-aced-bce97961c520 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6775b9d82b3444f6b728736f1d2b2806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5338cf2146344042bc263bdc4f9d822b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:49:12.638644 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-d20d1268-1dbf-413c-aced-bce97961c520 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] 10.222.0.33 "GET /compute/v2.1/servers/8526b237-847c-47b7-9f0b-8209c9a07b95" status: 200 len: 1647 microversion: 2.1 time: 0.598400 Oct 04 20:49:12.645493 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1806/3515] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:49:12 2022] GET /compute/v2.1/servers/8526b237-847c-47b7-9f0b-8209c9a07b95 => generated 1647 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:49:13.362990 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-83120c62-c215-41ef-aabb-f9a9463fdc78 req-717b4ac5-683f-4d53-a212-0b86afa71457 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8526b237-847c-47b7-9f0b-8209c9a07b95", "name": "network-vif-deleted", "tag": "8d64ffa9-7f66-45e5-ab1c-7b451118f90e"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:49:13.403592 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-83120c62-c215-41ef-aabb-f9a9463fdc78 req-717b4ac5-683f-4d53-a212-0b86afa71457 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:13.410958 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-83120c62-c215-41ef-aabb-f9a9463fdc78 req-717b4ac5-683f-4d53-a212-0b86afa71457 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:13.411842 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-83120c62-c215-41ef-aabb-f9a9463fdc78 req-717b4ac5-683f-4d53-a212-0b86afa71457 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:13.460567 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-83120c62-c215-41ef-aabb-f9a9463fdc78 req-717b4ac5-683f-4d53-a212-0b86afa71457 service nova] Creating event network-vif-deleted:8d64ffa9-7f66-45e5-ab1c-7b451118f90e for instance 8526b237-847c-47b7-9f0b-8209c9a07b95 on n-h1-854823-8 Oct 04 20:49:13.472976 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-83120c62-c215-41ef-aabb-f9a9463fdc78 req-717b4ac5-683f-4d53-a212-0b86afa71457 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118549 Oct 04 20:49:13.476209 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1710/3516] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:49:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:49:13.667989 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-3a37c0ec-45d7-48d7-92a1-94dfad506113 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:49:13.668611 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-3a37c0ec-45d7-48d7-92a1-94dfad506113 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] [instance: 8526b237-847c-47b7-9f0b-8209c9a07b95] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:49:13.708300 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3a37c0ec-45d7-48d7-92a1-94dfad506113 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:13.710598 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3a37c0ec-45d7-48d7-92a1-94dfad506113 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:13.711257 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3a37c0ec-45d7-48d7-92a1-94dfad506113 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:13.715947 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3a37c0ec-45d7-48d7-92a1-94dfad506113 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:13.716442 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3a37c0ec-45d7-48d7-92a1-94dfad506113 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:13.721362 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3a37c0ec-45d7-48d7-92a1-94dfad506113 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:13.799074 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3a37c0ec-45d7-48d7-92a1-94dfad506113 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:13.799578 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3a37c0ec-45d7-48d7-92a1-94dfad506113 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:13.800017 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3a37c0ec-45d7-48d7-92a1-94dfad506113 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:13.801574 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.objects.instance [None req-3a37c0ec-45d7-48d7-92a1-94dfad506113 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Lazy-loading 'fault' on Instance uuid 8526b237-847c-47b7-9f0b-8209c9a07b95 {{(pid=128802) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:49:13.874872 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-3a37c0ec-45d7-48d7-92a1-94dfad506113 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6775b9d82b3444f6b728736f1d2b2806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5338cf2146344042bc263bdc4f9d822b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:49:13.884773 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-3a37c0ec-45d7-48d7-92a1-94dfad506113 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] 10.222.0.33 "GET /compute/v2.1/servers/8526b237-847c-47b7-9f0b-8209c9a07b95" status: 200 len: 1306 microversion: 2.1 time: 0.221534 Oct 04 20:49:13.895622 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1807/3517] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:49:13 2022] GET /compute/v2.1/servers/8526b237-847c-47b7-9f0b-8209c9a07b95 => generated 1306 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:49:14.920796 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0bbd53d7-9aad-4d21-8416-96ac88063f6e tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:49:14.921803 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-0bbd53d7-9aad-4d21-8416-96ac88063f6e tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] [instance: 8526b237-847c-47b7-9f0b-8209c9a07b95] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:49:14.946137 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0bbd53d7-9aad-4d21-8416-96ac88063f6e tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:14.949606 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0bbd53d7-9aad-4d21-8416-96ac88063f6e tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:14.950128 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0bbd53d7-9aad-4d21-8416-96ac88063f6e tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:14.956973 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0bbd53d7-9aad-4d21-8416-96ac88063f6e tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:14.957838 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0bbd53d7-9aad-4d21-8416-96ac88063f6e tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:14.959428 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0bbd53d7-9aad-4d21-8416-96ac88063f6e tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:14.994065 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-0bbd53d7-9aad-4d21-8416-96ac88063f6e tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] HTTP exception thrown: Instance 8526b237-847c-47b7-9f0b-8209c9a07b95 could not be found. Oct 04 20:49:14.998663 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0bbd53d7-9aad-4d21-8416-96ac88063f6e tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Request method failure captured: Oct 04 20:49:14.998663 n-d-854823-8 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/8526b237-847c-47b7-9f0b-8209c9a07b95 HTTP/1.1 Oct 04 20:49:14.998663 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:49:14.998663 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:49:14.998663 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:49:14.998663 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 0 Oct 04 20:49:14.998663 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:49:14.998663 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:49:14.998663 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:49:14.998663 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:49:14.998663 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJvplJ2XtdAcke_gJrXE_KNLNy4K9GZxu4xJ3RC3ictvWfS6RkKIgxre3Ypn4Hea1fYOIvZNCiP-yxvq5D6SolLdjoz27YjvMYrrTV2S3thhTnsVyXyRm0AMTe4s528xDCu1J43IqMSUlnCB8IA8Xi7RGhGDp6gPtwX5ldwf-HyrWJg Oct 04 20:49:14.998663 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:49:14.998663 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:49:14.998663 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:49:14.998663 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:49:14.998663 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:49:14.998663 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:49:14.998663 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: 5338cf2146344042bc263bdc4f9d822b Oct 04 20:49:14.998663 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-SecurityGroupsTestJSON-969894548 Oct 04 20:49:14.998663 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 20:49:14.998663 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 20:49:14.998663 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5338cf2146344042bc263bdc4f9d822b", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5338cf2146344042bc263bdc4f9d822b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5338cf2146344042bc263bdc4f9d822b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5338cf2146344042bc263bdc4f9d822b"}]}] Oct 04 20:49:14.998663 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-SecurityGroupsTestJSON-969894548 Oct 04 20:49:14.998663 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: 5338cf2146344042bc263bdc4f9d822b Oct 04 20:49:14.998663 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-969894548 Oct 04 20:49:14.998663 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-SecurityGroupsTestJSON-969894548-project Oct 04 20:49:14.998663 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:49:14.998663 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:49:14.998663 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: 6775b9d82b3444f6b728736f1d2b2806 Oct 04 20:49:14.998663 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-SecurityGroupsTestJSON-969894548-project Oct 04 20:49:14.998663 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 20:49:14.998663 n-d-854823-8 devstack@n-api.service[128801]: exception: Instance 8526b237-847c-47b7-9f0b-8209c9a07b95 could not be found. Oct 04 20:49:14.998663 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': '8526b237-847c-47b7-9f0b-8209c9a07b95'} Oct 04 20:49:14.998663 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:49:14.998663 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:49:14.998663 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:49:14.998663 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:49:14.998663 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:49:14.998663 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:49:14.998663 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:49:14.998663 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:49:14.998663 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:49:14.998663 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:49:14.998663 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8526b237-847c-47b7-9f0b-8209c9a07b95 could not be found. Oct 04 20:49:14.998663 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:49:14.998663 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:49:14.998663 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:49:14.998663 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:49:14.998663 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:49:14.998663 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:49:14.998663 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:49:14.998663 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:49:14.998663 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:49:14.998663 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:49:14.998663 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:49:14.998663 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:49:14.998663 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:49:14.998663 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:49:14.998663 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:49:14.998663 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:49:14.998663 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8526b237-847c-47b7-9f0b-8209c9a07b95 could not be found. Oct 04 20:49:14.998663 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:49:14.998663 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:49:14.998663 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:49:15.004969 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:49:15.004969 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:49:15.004969 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:49:15.004969 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:49:15.004969 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:49:15.004969 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8526b237-847c-47b7-9f0b-8209c9a07b95 could not be found. Oct 04 20:49:15.004969 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:49:15.004969 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0bbd53d7-9aad-4d21-8416-96ac88063f6e tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Returning 404 to user: Instance 8526b237-847c-47b7-9f0b-8209c9a07b95 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:49:15.004969 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-0bbd53d7-9aad-4d21-8416-96ac88063f6e tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] 10.222.0.33 "GET /compute/v2.1/servers/8526b237-847c-47b7-9f0b-8209c9a07b95" status: 404 len: 111 microversion: 2.1 time: 0.091957 Oct 04 20:49:15.012818 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-471b875f-73c9-4cbb-9dd7-bacd91171619 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Calling method '.version_select at 0x7f3c788c9550>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:49:15.019385 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1711/3518] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:49:14 2022] GET /compute/v2.1/servers/8526b237-847c-47b7-9f0b-8209c9a07b95 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:49:16.371737 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-471b875f-73c9-4cbb-9dd7-bacd91171619 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/a71f58bf-5109-49de-adad-5cf36ec1b6a1" status: 202 len: 0 microversion: 2.1 time: 1.362996 Oct 04 20:49:16.372529 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1808/3519] 10.222.0.33 () {58 vars in 1272 bytes} [Tue Oct 4 20:49:15 2022] DELETE /compute/v2.1/os-security-groups/a71f58bf-5109-49de-adad-5cf36ec1b6a1 => generated 0 bytes in 1365 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:49:16.381828 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c3fde17f-7cc1-41cf-b5a7-bc5a0a569880 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Calling method '.version_select at 0x7f3c6f57d430>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:49:17.092342 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c3fde17f-7cc1-41cf-b5a7-bc5a0a569880 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/e86d7247-5a3d-42ab-837c-07e05ae4a269" status: 202 len: 0 microversion: 2.1 time: 0.715202 Oct 04 20:49:17.093442 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1712/3520] 10.222.0.33 () {58 vars in 1272 bytes} [Tue Oct 4 20:49:16 2022] DELETE /compute/v2.1/os-security-groups/e86d7247-5a3d-42ab-837c-07e05ae4a269 => generated 0 bytes in 717 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 20:49:17.108407 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-e3bcbf2a-84b5-48f7-855b-c17fe4e5ec6e tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Action: 'create', calling method: .version_select at 0x7f3c788c91f0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1445426312", "description": "tempest-description-50792097"}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:49:18.021460 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-e3bcbf2a-84b5-48f7-855b-c17fe4e5ec6e tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] 10.222.0.33 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.916943 Oct 04 20:49:18.022444 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1809/3521] 10.222.0.33 () {60 vars in 1180 bytes} [Tue Oct 4 20:49:17 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:49:18.036662 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d362d64f-181b-421e-816f-9d7082cd80a2 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Action: 'update', calling method: .version_select at 0x7f3c6f504f70>, body: {"security_group": {"name": "tempest-sg-hth-550892086", "description": "tempest-description-hth-297429502"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:49:18.662172 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d362d64f-181b-421e-816f-9d7082cd80a2 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] 10.222.0.33 "PUT /compute/v2.1/os-security-groups/5c73bf65-1767-47d5-8682-0a0bf525e4b7" status: 200 len: 216 microversion: 2.1 time: 0.630860 Oct 04 20:49:18.663313 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1713/3522] 10.222.0.33 () {60 vars in 1290 bytes} [Tue Oct 4 20:49:18 2022] PUT /compute/v2.1/os-security-groups/5c73bf65-1767-47d5-8682-0a0bf525e4b7 => generated 216 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:49:18.676983 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-89c46737-b63b-4a2c-81df-88b7850f2460 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Calling method '.version_select at 0x7f3c7891c3a0>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:49:18.891986 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-89c46737-b63b-4a2c-81df-88b7850f2460 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] 10.222.0.33 "GET /compute/v2.1/os-security-groups/5c73bf65-1767-47d5-8682-0a0bf525e4b7" status: 200 len: 216 microversion: 2.1 time: 0.219819 Oct 04 20:49:18.905307 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1810/3523] 10.222.0.33 () {58 vars in 1269 bytes} [Tue Oct 4 20:49:18 2022] GET /compute/v2.1/os-security-groups/5c73bf65-1767-47d5-8682-0a0bf525e4b7 => generated 216 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:49:18.915397 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b532c105-5da0-458f-9c1a-7fe746ea7626 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Calling method '.version_select at 0x7f3c788abb80>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:49:19.813822 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b532c105-5da0-458f-9c1a-7fe746ea7626 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/5c73bf65-1767-47d5-8682-0a0bf525e4b7" status: 202 len: 0 microversion: 2.1 time: 0.906388 Oct 04 20:49:19.814682 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1714/3524] 10.222.0.33 () {58 vars in 1272 bytes} [Tue Oct 4 20:49:18 2022] DELETE /compute/v2.1/os-security-groups/5c73bf65-1767-47d5-8682-0a0bf525e4b7 => generated 0 bytes in 909 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:49:19.825690 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-c211f902-9528-43c1-a925-8e7569b497a6 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:49:19.826369 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-c211f902-9528-43c1-a925-8e7569b497a6 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] [instance: 8526b237-847c-47b7-9f0b-8209c9a07b95] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:49:19.835311 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c211f902-9528-43c1-a925-8e7569b497a6 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:19.835981 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c211f902-9528-43c1-a925-8e7569b497a6 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:19.837075 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c211f902-9528-43c1-a925-8e7569b497a6 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:19.839149 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c211f902-9528-43c1-a925-8e7569b497a6 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:19.839764 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c211f902-9528-43c1-a925-8e7569b497a6 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:19.841750 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c211f902-9528-43c1-a925-8e7569b497a6 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:19.888008 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.wsgi [None req-c211f902-9528-43c1-a925-8e7569b497a6 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] HTTP exception thrown: Instance 8526b237-847c-47b7-9f0b-8209c9a07b95 could not be found. Oct 04 20:49:19.890117 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-c211f902-9528-43c1-a925-8e7569b497a6 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Request method failure captured: Oct 04 20:49:19.890117 n-d-854823-8 devstack@n-api.service[128802]: request: DELETE /compute/v2.1/servers/8526b237-847c-47b7-9f0b-8209c9a07b95 HTTP/1.1 Oct 04 20:49:19.890117 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 20:49:19.890117 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 20:49:19.890117 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 20:49:19.890117 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 0 Oct 04 20:49:19.890117 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 20:49:19.890117 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 20:49:19.890117 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 20:49:19.890117 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 20:49:19.890117 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPJvplJ2XtdAcke_gJrXE_KNLNy4K9GZxu4xJ3RC3ictvWfS6RkKIgxre3Ypn4Hea1fYOIvZNCiP-yxvq5D6SolLdjoz27YjvMYrrTV2S3thhTnsVyXyRm0AMTe4s528xDCu1J43IqMSUlnCB8IA8Xi7RGhGDp6gPtwX5ldwf-HyrWJg Oct 04 20:49:19.890117 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 20:49:19.890117 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 20:49:19.890117 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 20:49:19.890117 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 20:49:19.890117 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 20:49:19.890117 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 20:49:19.890117 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: 5338cf2146344042bc263bdc4f9d822b Oct 04 20:49:19.890117 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-SecurityGroupsTestJSON-969894548 Oct 04 20:49:19.890117 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 20:49:19.890117 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 20:49:19.890117 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5338cf2146344042bc263bdc4f9d822b", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5338cf2146344042bc263bdc4f9d822b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5338cf2146344042bc263bdc4f9d822b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5338cf2146344042bc263bdc4f9d822b"}]}] Oct 04 20:49:19.890117 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-SecurityGroupsTestJSON-969894548 Oct 04 20:49:19.890117 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: 5338cf2146344042bc263bdc4f9d822b Oct 04 20:49:19.890117 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-969894548 Oct 04 20:49:19.890117 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-SecurityGroupsTestJSON-969894548-project Oct 04 20:49:19.890117 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 20:49:19.890117 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 20:49:19.890117 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: 6775b9d82b3444f6b728736f1d2b2806 Oct 04 20:49:19.890117 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-SecurityGroupsTestJSON-969894548-project Oct 04 20:49:19.890117 n-d-854823-8 devstack@n-api.service[128802]: method: > Oct 04 20:49:19.890117 n-d-854823-8 devstack@n-api.service[128802]: exception: Instance 8526b237-847c-47b7-9f0b-8209c9a07b95 could not be found. Oct 04 20:49:19.890117 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'id': '8526b237-847c-47b7-9f0b-8209c9a07b95'} Oct 04 20:49:19.890117 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:49:19.890117 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:49:19.890117 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:49:19.890117 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:49:19.890117 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:49:19.890117 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:49:19.890117 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:49:19.890117 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:49:19.890117 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:49:19.890117 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:49:19.890117 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8526b237-847c-47b7-9f0b-8209c9a07b95 could not be found. Oct 04 20:49:19.890117 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:49:19.890117 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:49:19.890117 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:49:19.890117 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:49:19.890117 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:49:19.890117 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:49:19.890117 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:49:19.890117 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:49:19.890117 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:49:19.890117 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:49:19.890117 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 20:49:19.890117 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 20:49:19.890117 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 20:49:19.890117 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 20:49:19.890117 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:49:19.890117 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:49:19.890117 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:49:19.890117 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:49:19.895822 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8526b237-847c-47b7-9f0b-8209c9a07b95 could not be found. Oct 04 20:49:19.895822 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:49:19.895822 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:49:19.895822 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:49:19.895822 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:49:19.895822 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:49:19.895822 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:49:19.895822 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:49:19.895822 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:49:19.895822 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8526b237-847c-47b7-9f0b-8209c9a07b95 could not be found. Oct 04 20:49:19.895822 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:49:19.901006 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-c211f902-9528-43c1-a925-8e7569b497a6 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Returning 404 to user: Instance 8526b237-847c-47b7-9f0b-8209c9a07b95 could not be found. {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:49:19.903319 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-c211f902-9528-43c1-a925-8e7569b497a6 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] 10.222.0.33 "DELETE /compute/v2.1/servers/8526b237-847c-47b7-9f0b-8209c9a07b95" status: 404 len: 111 microversion: 2.1 time: 0.084332 Oct 04 20:49:19.904359 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1811/3525] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 20:49:19 2022] DELETE /compute/v2.1/servers/8526b237-847c-47b7-9f0b-8209c9a07b95 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:49:19.913121 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a5cee829-ef5b-482f-8b9f-f376dbb7c86a tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:49:19.913859 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a5cee829-ef5b-482f-8b9f-f376dbb7c86a tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] [instance: 8526b237-847c-47b7-9f0b-8209c9a07b95] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:49:19.926864 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a5cee829-ef5b-482f-8b9f-f376dbb7c86a tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:19.927553 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a5cee829-ef5b-482f-8b9f-f376dbb7c86a tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:19.928825 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a5cee829-ef5b-482f-8b9f-f376dbb7c86a tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:19.937612 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a5cee829-ef5b-482f-8b9f-f376dbb7c86a tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:19.938280 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a5cee829-ef5b-482f-8b9f-f376dbb7c86a tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:19.940600 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a5cee829-ef5b-482f-8b9f-f376dbb7c86a tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:19.965870 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-a5cee829-ef5b-482f-8b9f-f376dbb7c86a tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] HTTP exception thrown: Instance 8526b237-847c-47b7-9f0b-8209c9a07b95 could not be found. Oct 04 20:49:19.970646 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a5cee829-ef5b-482f-8b9f-f376dbb7c86a tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Request method failure captured: Oct 04 20:49:19.970646 n-d-854823-8 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/8526b237-847c-47b7-9f0b-8209c9a07b95 HTTP/1.1 Oct 04 20:49:19.970646 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:49:19.970646 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:49:19.970646 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:49:19.970646 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 0 Oct 04 20:49:19.970646 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:49:19.970646 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:49:19.970646 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:49:19.970646 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:49:19.970646 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJvplJ2XtdAcke_gJrXE_KNLNy4K9GZxu4xJ3RC3ictvWfS6RkKIgxre3Ypn4Hea1fYOIvZNCiP-yxvq5D6SolLdjoz27YjvMYrrTV2S3thhTnsVyXyRm0AMTe4s528xDCu1J43IqMSUlnCB8IA8Xi7RGhGDp6gPtwX5ldwf-HyrWJg Oct 04 20:49:19.970646 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:49:19.970646 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:49:19.970646 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:49:19.970646 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:49:19.970646 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:49:19.970646 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:49:19.970646 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: 5338cf2146344042bc263bdc4f9d822b Oct 04 20:49:19.970646 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-SecurityGroupsTestJSON-969894548 Oct 04 20:49:19.970646 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 20:49:19.970646 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 20:49:19.970646 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5338cf2146344042bc263bdc4f9d822b", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5338cf2146344042bc263bdc4f9d822b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5338cf2146344042bc263bdc4f9d822b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5338cf2146344042bc263bdc4f9d822b"}]}] Oct 04 20:49:19.970646 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-SecurityGroupsTestJSON-969894548 Oct 04 20:49:19.970646 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: 5338cf2146344042bc263bdc4f9d822b Oct 04 20:49:19.970646 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-969894548 Oct 04 20:49:19.970646 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-SecurityGroupsTestJSON-969894548-project Oct 04 20:49:19.970646 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:49:19.970646 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:49:19.970646 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: 6775b9d82b3444f6b728736f1d2b2806 Oct 04 20:49:19.970646 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-SecurityGroupsTestJSON-969894548-project Oct 04 20:49:19.970646 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 20:49:19.970646 n-d-854823-8 devstack@n-api.service[128801]: exception: Instance 8526b237-847c-47b7-9f0b-8209c9a07b95 could not be found. Oct 04 20:49:19.970646 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': '8526b237-847c-47b7-9f0b-8209c9a07b95'} Oct 04 20:49:19.970646 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:49:19.970646 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:49:19.970646 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:49:19.970646 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:49:19.970646 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:49:19.970646 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:49:19.970646 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:49:19.970646 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:49:19.970646 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:49:19.970646 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:49:19.970646 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8526b237-847c-47b7-9f0b-8209c9a07b95 could not be found. Oct 04 20:49:19.970646 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:49:19.970646 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:49:19.970646 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:49:19.970646 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:49:19.970646 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:49:19.970646 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:49:19.970646 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:49:19.970646 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:49:19.970646 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:49:19.970646 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:49:19.970646 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:49:19.970646 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:49:19.970646 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:49:19.970646 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:49:19.970646 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:49:19.970646 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:49:19.970646 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8526b237-847c-47b7-9f0b-8209c9a07b95 could not be found. Oct 04 20:49:19.970646 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:49:19.970646 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:49:19.970646 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:49:19.975457 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:49:19.975457 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:49:19.975457 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:49:19.975457 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:49:19.975457 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:49:19.975457 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8526b237-847c-47b7-9f0b-8209c9a07b95 could not be found. Oct 04 20:49:19.975457 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:49:19.976760 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a5cee829-ef5b-482f-8b9f-f376dbb7c86a tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Returning 404 to user: Instance 8526b237-847c-47b7-9f0b-8209c9a07b95 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:49:19.979780 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a5cee829-ef5b-482f-8b9f-f376dbb7c86a tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] 10.222.0.33 "GET /compute/v2.1/servers/8526b237-847c-47b7-9f0b-8209c9a07b95" status: 404 len: 111 microversion: 2.1 time: 0.070719 Oct 04 20:49:19.980488 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1715/3526] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:49:19 2022] GET /compute/v2.1/servers/8526b237-847c-47b7-9f0b-8209c9a07b95 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:49:19.989533 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-32b09330-a871-44db-a8c6-a5c0b1e96370 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Calling method '.version_select at 0x7f3c74778160>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:49:20.059570 n-d-854823-8 devstack@n-api.service[128802]: DEBUG neutronclient.v2_0.client [None req-32b09330-a871-44db-a8c6-a5c0b1e96370 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group e86d7247-5a3d-42ab-837c-07e05ae4a269 does not exist", "detail": ""}} {{(pid=128802) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 20:49:20.060297 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.network.security_group_api [None req-32b09330-a871-44db-a8c6-a5c0b1e96370 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Neutron security group e86d7247-5a3d-42ab-837c-07e05ae4a269 not found {{(pid=128802) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 04 20:49:20.060935 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.wsgi [None req-32b09330-a871-44db-a8c6-a5c0b1e96370 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] HTTP exception thrown: Security group e86d7247-5a3d-42ab-837c-07e05ae4a269 does not exist Oct 04 20:49:20.060935 n-d-854823-8 devstack@n-api.service[128802]: Neutron server returns request_ids: ['req-7a0a750f-e6e4-4529-b066-9422c2b0e3c4'] Oct 04 20:49:20.063023 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-32b09330-a871-44db-a8c6-a5c0b1e96370 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Request method failure captured: Oct 04 20:49:20.063023 n-d-854823-8 devstack@n-api.service[128802]: request: DELETE /compute/v2.1/os-security-groups/e86d7247-5a3d-42ab-837c-07e05ae4a269 HTTP/1.1 Oct 04 20:49:20.063023 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 20:49:20.063023 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 20:49:20.063023 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 20:49:20.063023 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 0 Oct 04 20:49:20.063023 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 20:49:20.063023 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 20:49:20.063023 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 20:49:20.063023 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 20:49:20.063023 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPJvplJ2XtdAcke_gJrXE_KNLNy4K9GZxu4xJ3RC3ictvWfS6RkKIgxre3Ypn4Hea1fYOIvZNCiP-yxvq5D6SolLdjoz27YjvMYrrTV2S3thhTnsVyXyRm0AMTe4s528xDCu1J43IqMSUlnCB8IA8Xi7RGhGDp6gPtwX5ldwf-HyrWJg Oct 04 20:49:20.063023 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 20:49:20.063023 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 20:49:20.063023 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 20:49:20.063023 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 20:49:20.063023 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 20:49:20.063023 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 20:49:20.063023 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: 5338cf2146344042bc263bdc4f9d822b Oct 04 20:49:20.063023 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-SecurityGroupsTestJSON-969894548 Oct 04 20:49:20.063023 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 20:49:20.063023 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 20:49:20.063023 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5338cf2146344042bc263bdc4f9d822b", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5338cf2146344042bc263bdc4f9d822b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5338cf2146344042bc263bdc4f9d822b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5338cf2146344042bc263bdc4f9d822b"}]}] Oct 04 20:49:20.063023 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-SecurityGroupsTestJSON-969894548 Oct 04 20:49:20.063023 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: 5338cf2146344042bc263bdc4f9d822b Oct 04 20:49:20.063023 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-969894548 Oct 04 20:49:20.063023 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-SecurityGroupsTestJSON-969894548-project Oct 04 20:49:20.063023 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 20:49:20.063023 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 20:49:20.063023 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: 6775b9d82b3444f6b728736f1d2b2806 Oct 04 20:49:20.063023 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-SecurityGroupsTestJSON-969894548-project Oct 04 20:49:20.063023 n-d-854823-8 devstack@n-api.service[128802]: method: Oct 04 20:49:20.063023 n-d-854823-8 devstack@n-api.service[128802]: exception: Security group e86d7247-5a3d-42ab-837c-07e05ae4a269 does not exist Oct 04 20:49:20.063023 n-d-854823-8 devstack@n-api.service[128802]: Neutron server returns request_ids: ['req-7a0a750f-e6e4-4529-b066-9422c2b0e3c4'] Oct 04 20:49:20.063023 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'id': 'e86d7247-5a3d-42ab-837c-07e05ae4a269'} Oct 04 20:49:20.063023 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:49:20.063023 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:49:20.063023 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 04 20:49:20.063023 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 04 20:49:20.063023 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:49:20.063023 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:49:20.063023 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 04 20:49:20.063023 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 04 20:49:20.063023 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:49:20.063023 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:49:20.063023 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 20:49:20.063023 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 20:49:20.063023 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:49:20.063023 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:49:20.063023 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:49:20.063023 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:49:20.063023 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:49:20.063023 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:49:20.063023 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 20:49:20.063023 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 20:49:20.063023 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:49:20.063023 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:49:20.063023 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 20:49:20.063023 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 20:49:20.063023 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 20:49:20.063023 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 20:49:20.063023 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group e86d7247-5a3d-42ab-837c-07e05ae4a269 does not exist Oct 04 20:49:20.068834 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7a0a750f-e6e4-4529-b066-9422c2b0e3c4'] Oct 04 20:49:20.068834 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:49:20.068834 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:49:20.068834 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:49:20.068834 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:49:20.068834 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 04 20:49:20.068834 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 04 20:49:20.068834 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 04 20:49:20.068834 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 04 20:49:20.068834 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group e86d7247-5a3d-42ab-837c-07e05ae4a269 does not exist Oct 04 20:49:20.068834 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7a0a750f-e6e4-4529-b066-9422c2b0e3c4'] Oct 04 20:49:20.068834 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:49:20.068834 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:49:20.068834 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:49:20.068834 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:49:20.068834 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:49:20.068834 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:49:20.068834 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:49:20.068834 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:49:20.068834 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:49:20.068834 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:49:20.068834 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:49:20.068834 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:49:20.068834 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 04 20:49:20.068834 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 04 20:49:20.068834 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group e86d7247-5a3d-42ab-837c-07e05ae4a269 does not exist Oct 04 20:49:20.068834 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7a0a750f-e6e4-4529-b066-9422c2b0e3c4'] Oct 04 20:49:20.068834 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:49:20.068834 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:49:20.068834 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:49:20.068834 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:49:20.068834 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:49:20.068834 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:49:20.068834 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:49:20.068834 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:49:20.068834 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group e86d7247-5a3d-42ab-837c-07e05ae4a269 does not exist Oct 04 20:49:20.068834 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7a0a750f-e6e4-4529-b066-9422c2b0e3c4'] Oct 04 20:49:20.068834 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:49:20.068834 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-32b09330-a871-44db-a8c6-a5c0b1e96370 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Returning 404 to user: Security group e86d7247-5a3d-42ab-837c-07e05ae4a269 does not exist Oct 04 20:49:20.068834 n-d-854823-8 devstack@n-api.service[128802]: Neutron server returns request_ids: ['req-7a0a750f-e6e4-4529-b066-9422c2b0e3c4'] {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:49:20.076550 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-32b09330-a871-44db-a8c6-a5c0b1e96370 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/e86d7247-5a3d-42ab-837c-07e05ae4a269" status: 404 len: 194 microversion: 2.1 time: 0.085132 Oct 04 20:49:20.076550 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1812/3527] 10.222.0.33 () {58 vars in 1272 bytes} [Tue Oct 4 20:49:19 2022] DELETE /compute/v2.1/os-security-groups/e86d7247-5a3d-42ab-837c-07e05ae4a269 => generated 194 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:49:20.082633 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-58976a6d-4983-492e-93ea-d6fa62d00801 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Calling method '.version_select at 0x7f3c788abb80>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:49:20.216601 n-d-854823-8 devstack@n-api.service[128801]: DEBUG neutronclient.v2_0.client [None req-58976a6d-4983-492e-93ea-d6fa62d00801 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group a71f58bf-5109-49de-adad-5cf36ec1b6a1 does not exist", "detail": ""}} {{(pid=128801) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 20:49:20.217448 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.network.security_group_api [None req-58976a6d-4983-492e-93ea-d6fa62d00801 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Neutron security group a71f58bf-5109-49de-adad-5cf36ec1b6a1 not found {{(pid=128801) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 04 20:49:20.218634 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-58976a6d-4983-492e-93ea-d6fa62d00801 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] HTTP exception thrown: Security group a71f58bf-5109-49de-adad-5cf36ec1b6a1 does not exist Oct 04 20:49:20.218634 n-d-854823-8 devstack@n-api.service[128801]: Neutron server returns request_ids: ['req-94406468-cf59-4ca1-b7da-6fa87e1225aa'] Oct 04 20:49:20.220873 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-58976a6d-4983-492e-93ea-d6fa62d00801 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Request method failure captured: Oct 04 20:49:20.220873 n-d-854823-8 devstack@n-api.service[128801]: request: DELETE /compute/v2.1/os-security-groups/a71f58bf-5109-49de-adad-5cf36ec1b6a1 HTTP/1.1 Oct 04 20:49:20.220873 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:49:20.220873 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:49:20.220873 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:49:20.220873 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 0 Oct 04 20:49:20.220873 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:49:20.220873 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:49:20.220873 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:49:20.220873 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:49:20.220873 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJvplJ2XtdAcke_gJrXE_KNLNy4K9GZxu4xJ3RC3ictvWfS6RkKIgxre3Ypn4Hea1fYOIvZNCiP-yxvq5D6SolLdjoz27YjvMYrrTV2S3thhTnsVyXyRm0AMTe4s528xDCu1J43IqMSUlnCB8IA8Xi7RGhGDp6gPtwX5ldwf-HyrWJg Oct 04 20:49:20.220873 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:49:20.220873 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:49:20.220873 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:49:20.220873 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:49:20.220873 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:49:20.220873 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:49:20.220873 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: 5338cf2146344042bc263bdc4f9d822b Oct 04 20:49:20.220873 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-SecurityGroupsTestJSON-969894548 Oct 04 20:49:20.220873 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 20:49:20.220873 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 20:49:20.220873 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5338cf2146344042bc263bdc4f9d822b", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5338cf2146344042bc263bdc4f9d822b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5338cf2146344042bc263bdc4f9d822b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5338cf2146344042bc263bdc4f9d822b"}]}] Oct 04 20:49:20.220873 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-SecurityGroupsTestJSON-969894548 Oct 04 20:49:20.220873 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: 5338cf2146344042bc263bdc4f9d822b Oct 04 20:49:20.220873 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-969894548 Oct 04 20:49:20.220873 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-SecurityGroupsTestJSON-969894548-project Oct 04 20:49:20.220873 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:49:20.220873 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:49:20.220873 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: 6775b9d82b3444f6b728736f1d2b2806 Oct 04 20:49:20.220873 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-SecurityGroupsTestJSON-969894548-project Oct 04 20:49:20.220873 n-d-854823-8 devstack@n-api.service[128801]: method: Oct 04 20:49:20.220873 n-d-854823-8 devstack@n-api.service[128801]: exception: Security group a71f58bf-5109-49de-adad-5cf36ec1b6a1 does not exist Oct 04 20:49:20.220873 n-d-854823-8 devstack@n-api.service[128801]: Neutron server returns request_ids: ['req-94406468-cf59-4ca1-b7da-6fa87e1225aa'] Oct 04 20:49:20.220873 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': 'a71f58bf-5109-49de-adad-5cf36ec1b6a1'} Oct 04 20:49:20.220873 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:49:20.220873 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:49:20.220873 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 04 20:49:20.220873 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 04 20:49:20.220873 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:49:20.220873 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:49:20.220873 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 04 20:49:20.220873 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 04 20:49:20.220873 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:49:20.220873 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:49:20.220873 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 20:49:20.220873 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 20:49:20.220873 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:49:20.220873 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:49:20.220873 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:49:20.220873 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:49:20.220873 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:49:20.220873 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:49:20.220873 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 20:49:20.220873 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 20:49:20.220873 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:49:20.220873 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:49:20.220873 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 20:49:20.220873 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 20:49:20.220873 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 20:49:20.220873 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 20:49:20.220873 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group a71f58bf-5109-49de-adad-5cf36ec1b6a1 does not exist Oct 04 20:49:20.225908 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-94406468-cf59-4ca1-b7da-6fa87e1225aa'] Oct 04 20:49:20.225908 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:49:20.225908 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:49:20.225908 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:49:20.225908 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:49:20.225908 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 04 20:49:20.225908 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 04 20:49:20.225908 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 04 20:49:20.225908 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 04 20:49:20.225908 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group a71f58bf-5109-49de-adad-5cf36ec1b6a1 does not exist Oct 04 20:49:20.225908 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-94406468-cf59-4ca1-b7da-6fa87e1225aa'] Oct 04 20:49:20.225908 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:49:20.225908 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:49:20.225908 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:49:20.225908 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:49:20.225908 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:49:20.225908 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:49:20.225908 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:49:20.225908 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:49:20.225908 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:49:20.225908 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:49:20.225908 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:49:20.225908 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:49:20.225908 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 04 20:49:20.225908 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 04 20:49:20.225908 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group a71f58bf-5109-49de-adad-5cf36ec1b6a1 does not exist Oct 04 20:49:20.225908 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-94406468-cf59-4ca1-b7da-6fa87e1225aa'] Oct 04 20:49:20.225908 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:49:20.225908 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:49:20.225908 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:49:20.225908 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:49:20.225908 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:49:20.225908 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:49:20.225908 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:49:20.225908 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:49:20.225908 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group a71f58bf-5109-49de-adad-5cf36ec1b6a1 does not exist Oct 04 20:49:20.225908 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-94406468-cf59-4ca1-b7da-6fa87e1225aa'] Oct 04 20:49:20.225908 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:49:20.232101 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-58976a6d-4983-492e-93ea-d6fa62d00801 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Returning 404 to user: Security group a71f58bf-5109-49de-adad-5cf36ec1b6a1 does not exist Oct 04 20:49:20.232101 n-d-854823-8 devstack@n-api.service[128801]: Neutron server returns request_ids: ['req-94406468-cf59-4ca1-b7da-6fa87e1225aa'] {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:49:20.233152 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-58976a6d-4983-492e-93ea-d6fa62d00801 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/a71f58bf-5109-49de-adad-5cf36ec1b6a1" status: 404 len: 194 microversion: 2.1 time: 0.155645 Oct 04 20:49:20.234216 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1716/3528] 10.222.0.33 () {58 vars in 1272 bytes} [Tue Oct 4 20:49:20 2022] DELETE /compute/v2.1/os-security-groups/a71f58bf-5109-49de-adad-5cf36ec1b6a1 => generated 194 bytes in 159 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:49:20.244215 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-e4275fcc-08a0-4875-b06a-96a5841777d7 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Calling method '.version_select at 0x7f3c789349d0>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:49:20.337168 n-d-854823-8 devstack@n-api.service[128802]: DEBUG neutronclient.v2_0.client [None req-e4275fcc-08a0-4875-b06a-96a5841777d7 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 9155f37f-55fc-44e3-b007-57d9465c2cfe does not exist", "detail": ""}} {{(pid=128802) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 20:49:20.337795 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.network.security_group_api [None req-e4275fcc-08a0-4875-b06a-96a5841777d7 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Neutron security group 9155f37f-55fc-44e3-b007-57d9465c2cfe not found {{(pid=128802) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 04 20:49:20.338947 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.wsgi [None req-e4275fcc-08a0-4875-b06a-96a5841777d7 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] HTTP exception thrown: Security group 9155f37f-55fc-44e3-b007-57d9465c2cfe does not exist Oct 04 20:49:20.338947 n-d-854823-8 devstack@n-api.service[128802]: Neutron server returns request_ids: ['req-0734ec38-ee72-41f7-a1bd-2f206d3c47a1'] Oct 04 20:49:20.341871 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-e4275fcc-08a0-4875-b06a-96a5841777d7 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Request method failure captured: Oct 04 20:49:20.341871 n-d-854823-8 devstack@n-api.service[128802]: request: DELETE /compute/v2.1/os-security-groups/9155f37f-55fc-44e3-b007-57d9465c2cfe HTTP/1.1 Oct 04 20:49:20.341871 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 20:49:20.341871 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 20:49:20.341871 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 20:49:20.341871 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 0 Oct 04 20:49:20.341871 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 20:49:20.341871 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 20:49:20.341871 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 20:49:20.341871 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 20:49:20.341871 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPJvplJ2XtdAcke_gJrXE_KNLNy4K9GZxu4xJ3RC3ictvWfS6RkKIgxre3Ypn4Hea1fYOIvZNCiP-yxvq5D6SolLdjoz27YjvMYrrTV2S3thhTnsVyXyRm0AMTe4s528xDCu1J43IqMSUlnCB8IA8Xi7RGhGDp6gPtwX5ldwf-HyrWJg Oct 04 20:49:20.341871 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 20:49:20.341871 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 20:49:20.341871 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 20:49:20.341871 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 20:49:20.341871 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 20:49:20.341871 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 20:49:20.341871 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: 5338cf2146344042bc263bdc4f9d822b Oct 04 20:49:20.341871 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-SecurityGroupsTestJSON-969894548 Oct 04 20:49:20.341871 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 20:49:20.341871 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 20:49:20.341871 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5338cf2146344042bc263bdc4f9d822b", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5338cf2146344042bc263bdc4f9d822b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5338cf2146344042bc263bdc4f9d822b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5338cf2146344042bc263bdc4f9d822b"}]}] Oct 04 20:49:20.341871 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-SecurityGroupsTestJSON-969894548 Oct 04 20:49:20.341871 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: 5338cf2146344042bc263bdc4f9d822b Oct 04 20:49:20.341871 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-969894548 Oct 04 20:49:20.341871 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-SecurityGroupsTestJSON-969894548-project Oct 04 20:49:20.341871 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 20:49:20.341871 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 20:49:20.341871 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: 6775b9d82b3444f6b728736f1d2b2806 Oct 04 20:49:20.341871 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-SecurityGroupsTestJSON-969894548-project Oct 04 20:49:20.341871 n-d-854823-8 devstack@n-api.service[128802]: method: Oct 04 20:49:20.341871 n-d-854823-8 devstack@n-api.service[128802]: exception: Security group 9155f37f-55fc-44e3-b007-57d9465c2cfe does not exist Oct 04 20:49:20.341871 n-d-854823-8 devstack@n-api.service[128802]: Neutron server returns request_ids: ['req-0734ec38-ee72-41f7-a1bd-2f206d3c47a1'] Oct 04 20:49:20.341871 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'id': '9155f37f-55fc-44e3-b007-57d9465c2cfe'} Oct 04 20:49:20.341871 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:49:20.341871 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:49:20.341871 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 04 20:49:20.341871 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 04 20:49:20.341871 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:49:20.341871 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:49:20.341871 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 04 20:49:20.341871 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 04 20:49:20.341871 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:49:20.341871 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:49:20.341871 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 20:49:20.341871 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 20:49:20.341871 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:49:20.341871 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:49:20.341871 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:49:20.341871 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:49:20.341871 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:49:20.341871 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:49:20.341871 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 20:49:20.341871 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 20:49:20.341871 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:49:20.341871 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:49:20.341871 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 20:49:20.341871 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 20:49:20.341871 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 20:49:20.341871 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 20:49:20.341871 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 9155f37f-55fc-44e3-b007-57d9465c2cfe does not exist Oct 04 20:49:20.347810 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0734ec38-ee72-41f7-a1bd-2f206d3c47a1'] Oct 04 20:49:20.347810 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:49:20.347810 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:49:20.347810 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:49:20.347810 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:49:20.347810 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 04 20:49:20.347810 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 04 20:49:20.347810 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 04 20:49:20.347810 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 04 20:49:20.347810 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 9155f37f-55fc-44e3-b007-57d9465c2cfe does not exist Oct 04 20:49:20.347810 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0734ec38-ee72-41f7-a1bd-2f206d3c47a1'] Oct 04 20:49:20.347810 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:49:20.347810 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:49:20.347810 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:49:20.347810 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:49:20.347810 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:49:20.347810 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:49:20.347810 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:49:20.347810 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:49:20.347810 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:49:20.347810 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:49:20.347810 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:49:20.347810 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:49:20.347810 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 04 20:49:20.347810 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 04 20:49:20.347810 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 9155f37f-55fc-44e3-b007-57d9465c2cfe does not exist Oct 04 20:49:20.347810 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0734ec38-ee72-41f7-a1bd-2f206d3c47a1'] Oct 04 20:49:20.347810 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:49:20.347810 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:49:20.347810 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:49:20.347810 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:49:20.347810 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:49:20.347810 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:49:20.347810 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:49:20.347810 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:49:20.347810 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 9155f37f-55fc-44e3-b007-57d9465c2cfe does not exist Oct 04 20:49:20.347810 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0734ec38-ee72-41f7-a1bd-2f206d3c47a1'] Oct 04 20:49:20.347810 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:49:20.347810 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-e4275fcc-08a0-4875-b06a-96a5841777d7 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Returning 404 to user: Security group 9155f37f-55fc-44e3-b007-57d9465c2cfe does not exist Oct 04 20:49:20.347810 n-d-854823-8 devstack@n-api.service[128802]: Neutron server returns request_ids: ['req-0734ec38-ee72-41f7-a1bd-2f206d3c47a1'] {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:49:20.347810 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-e4275fcc-08a0-4875-b06a-96a5841777d7 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/9155f37f-55fc-44e3-b007-57d9465c2cfe" status: 404 len: 194 microversion: 2.1 time: 0.104350 Oct 04 20:49:20.347810 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1813/3529] 10.222.0.33 () {58 vars in 1272 bytes} [Tue Oct 4 20:49:20 2022] DELETE /compute/v2.1/os-security-groups/9155f37f-55fc-44e3-b007-57d9465c2cfe => generated 194 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:49:20.353812 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-20efa12f-91d8-4a9d-a717-093a0580382e tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Calling method '.version_select at 0x7f3c742085e0>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:49:20.570210 n-d-854823-8 devstack@n-api.service[128801]: DEBUG neutronclient.v2_0.client [None req-20efa12f-91d8-4a9d-a717-093a0580382e tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group f9dc6aa8-2820-4bfa-8cb5-43eb063d7c92 does not exist", "detail": ""}} {{(pid=128801) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 20:49:20.571862 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.network.security_group_api [None req-20efa12f-91d8-4a9d-a717-093a0580382e tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Neutron security group f9dc6aa8-2820-4bfa-8cb5-43eb063d7c92 not found {{(pid=128801) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 04 20:49:20.571862 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-20efa12f-91d8-4a9d-a717-093a0580382e tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] HTTP exception thrown: Security group f9dc6aa8-2820-4bfa-8cb5-43eb063d7c92 does not exist Oct 04 20:49:20.571862 n-d-854823-8 devstack@n-api.service[128801]: Neutron server returns request_ids: ['req-c40be58b-3046-4386-9bfb-3ee5f016668e'] Oct 04 20:49:20.573765 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-20efa12f-91d8-4a9d-a717-093a0580382e tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Request method failure captured: Oct 04 20:49:20.573765 n-d-854823-8 devstack@n-api.service[128801]: request: DELETE /compute/v2.1/os-security-groups/f9dc6aa8-2820-4bfa-8cb5-43eb063d7c92 HTTP/1.1 Oct 04 20:49:20.573765 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:49:20.573765 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:49:20.573765 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:49:20.573765 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 0 Oct 04 20:49:20.573765 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:49:20.573765 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:49:20.573765 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:49:20.573765 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:49:20.573765 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJvplJ2XtdAcke_gJrXE_KNLNy4K9GZxu4xJ3RC3ictvWfS6RkKIgxre3Ypn4Hea1fYOIvZNCiP-yxvq5D6SolLdjoz27YjvMYrrTV2S3thhTnsVyXyRm0AMTe4s528xDCu1J43IqMSUlnCB8IA8Xi7RGhGDp6gPtwX5ldwf-HyrWJg Oct 04 20:49:20.573765 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:49:20.573765 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:49:20.573765 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:49:20.573765 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:49:20.573765 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:49:20.573765 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:49:20.573765 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: 5338cf2146344042bc263bdc4f9d822b Oct 04 20:49:20.573765 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-SecurityGroupsTestJSON-969894548 Oct 04 20:49:20.573765 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 20:49:20.573765 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 20:49:20.573765 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5338cf2146344042bc263bdc4f9d822b", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5338cf2146344042bc263bdc4f9d822b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5338cf2146344042bc263bdc4f9d822b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5338cf2146344042bc263bdc4f9d822b"}]}] Oct 04 20:49:20.573765 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-SecurityGroupsTestJSON-969894548 Oct 04 20:49:20.573765 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: 5338cf2146344042bc263bdc4f9d822b Oct 04 20:49:20.573765 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-969894548 Oct 04 20:49:20.573765 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-SecurityGroupsTestJSON-969894548-project Oct 04 20:49:20.573765 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:49:20.573765 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:49:20.573765 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: 6775b9d82b3444f6b728736f1d2b2806 Oct 04 20:49:20.573765 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-SecurityGroupsTestJSON-969894548-project Oct 04 20:49:20.573765 n-d-854823-8 devstack@n-api.service[128801]: method: Oct 04 20:49:20.573765 n-d-854823-8 devstack@n-api.service[128801]: exception: Security group f9dc6aa8-2820-4bfa-8cb5-43eb063d7c92 does not exist Oct 04 20:49:20.573765 n-d-854823-8 devstack@n-api.service[128801]: Neutron server returns request_ids: ['req-c40be58b-3046-4386-9bfb-3ee5f016668e'] Oct 04 20:49:20.573765 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': 'f9dc6aa8-2820-4bfa-8cb5-43eb063d7c92'} Oct 04 20:49:20.573765 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:49:20.573765 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:49:20.573765 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 04 20:49:20.573765 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 04 20:49:20.573765 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:49:20.573765 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:49:20.573765 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 04 20:49:20.573765 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 04 20:49:20.573765 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:49:20.573765 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:49:20.573765 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 20:49:20.573765 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 20:49:20.573765 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:49:20.573765 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:49:20.573765 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:49:20.573765 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:49:20.573765 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:49:20.573765 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:49:20.573765 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 20:49:20.573765 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 20:49:20.573765 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:49:20.573765 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:49:20.573765 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 20:49:20.573765 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 20:49:20.573765 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 20:49:20.573765 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 20:49:20.573765 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group f9dc6aa8-2820-4bfa-8cb5-43eb063d7c92 does not exist Oct 04 20:49:20.580619 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c40be58b-3046-4386-9bfb-3ee5f016668e'] Oct 04 20:49:20.580619 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:49:20.580619 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:49:20.580619 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:49:20.580619 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:49:20.580619 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 04 20:49:20.580619 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 04 20:49:20.580619 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 04 20:49:20.580619 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 04 20:49:20.580619 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group f9dc6aa8-2820-4bfa-8cb5-43eb063d7c92 does not exist Oct 04 20:49:20.580619 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c40be58b-3046-4386-9bfb-3ee5f016668e'] Oct 04 20:49:20.580619 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:49:20.580619 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:49:20.580619 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:49:20.580619 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:49:20.580619 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:49:20.580619 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:49:20.580619 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:49:20.580619 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:49:20.580619 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:49:20.580619 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:49:20.580619 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:49:20.580619 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:49:20.580619 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 04 20:49:20.580619 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 04 20:49:20.580619 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group f9dc6aa8-2820-4bfa-8cb5-43eb063d7c92 does not exist Oct 04 20:49:20.580619 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c40be58b-3046-4386-9bfb-3ee5f016668e'] Oct 04 20:49:20.580619 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:49:20.580619 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:49:20.580619 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:49:20.580619 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:49:20.580619 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:49:20.580619 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:49:20.580619 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:49:20.580619 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:49:20.580619 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group f9dc6aa8-2820-4bfa-8cb5-43eb063d7c92 does not exist Oct 04 20:49:20.580619 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c40be58b-3046-4386-9bfb-3ee5f016668e'] Oct 04 20:49:20.580619 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:49:20.580619 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-20efa12f-91d8-4a9d-a717-093a0580382e tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Returning 404 to user: Security group f9dc6aa8-2820-4bfa-8cb5-43eb063d7c92 does not exist Oct 04 20:49:20.580619 n-d-854823-8 devstack@n-api.service[128801]: Neutron server returns request_ids: ['req-c40be58b-3046-4386-9bfb-3ee5f016668e'] {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:49:20.585779 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-20efa12f-91d8-4a9d-a717-093a0580382e tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/f9dc6aa8-2820-4bfa-8cb5-43eb063d7c92" status: 404 len: 194 microversion: 2.1 time: 0.236447 Oct 04 20:49:20.586381 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1717/3530] 10.222.0.33 () {58 vars in 1272 bytes} [Tue Oct 4 20:49:20 2022] DELETE /compute/v2.1/os-security-groups/f9dc6aa8-2820-4bfa-8cb5-43eb063d7c92 => generated 194 bytes in 238 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:49:20.597400 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-4356788b-9766-4e07-a1b0-acf89f45e6d5 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Calling method '.version_select at 0x7f3c74778040>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:49:20.666114 n-d-854823-8 devstack@n-api.service[128802]: DEBUG neutronclient.v2_0.client [None req-4356788b-9766-4e07-a1b0-acf89f45e6d5 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 6ee9aed4-6b8c-468f-bb28-937f3bc1eba7 does not exist", "detail": ""}} {{(pid=128802) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 20:49:20.667264 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.network.security_group_api [None req-4356788b-9766-4e07-a1b0-acf89f45e6d5 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Neutron security group 6ee9aed4-6b8c-468f-bb28-937f3bc1eba7 not found {{(pid=128802) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 04 20:49:20.667955 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.wsgi [None req-4356788b-9766-4e07-a1b0-acf89f45e6d5 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] HTTP exception thrown: Security group 6ee9aed4-6b8c-468f-bb28-937f3bc1eba7 does not exist Oct 04 20:49:20.667955 n-d-854823-8 devstack@n-api.service[128802]: Neutron server returns request_ids: ['req-23d80f88-5ce9-4e25-ab4a-021b82a20aa7'] Oct 04 20:49:20.669967 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-4356788b-9766-4e07-a1b0-acf89f45e6d5 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Request method failure captured: Oct 04 20:49:20.669967 n-d-854823-8 devstack@n-api.service[128802]: request: DELETE /compute/v2.1/os-security-groups/6ee9aed4-6b8c-468f-bb28-937f3bc1eba7 HTTP/1.1 Oct 04 20:49:20.669967 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 20:49:20.669967 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 20:49:20.669967 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 20:49:20.669967 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 0 Oct 04 20:49:20.669967 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 20:49:20.669967 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 20:49:20.669967 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 20:49:20.669967 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 20:49:20.669967 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPJvplJ2XtdAcke_gJrXE_KNLNy4K9GZxu4xJ3RC3ictvWfS6RkKIgxre3Ypn4Hea1fYOIvZNCiP-yxvq5D6SolLdjoz27YjvMYrrTV2S3thhTnsVyXyRm0AMTe4s528xDCu1J43IqMSUlnCB8IA8Xi7RGhGDp6gPtwX5ldwf-HyrWJg Oct 04 20:49:20.669967 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 20:49:20.669967 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 20:49:20.669967 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 20:49:20.669967 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 20:49:20.669967 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 20:49:20.669967 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 20:49:20.669967 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: 5338cf2146344042bc263bdc4f9d822b Oct 04 20:49:20.669967 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-SecurityGroupsTestJSON-969894548 Oct 04 20:49:20.669967 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 20:49:20.669967 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 20:49:20.669967 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5338cf2146344042bc263bdc4f9d822b", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5338cf2146344042bc263bdc4f9d822b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5338cf2146344042bc263bdc4f9d822b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5338cf2146344042bc263bdc4f9d822b"}]}] Oct 04 20:49:20.669967 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-SecurityGroupsTestJSON-969894548 Oct 04 20:49:20.669967 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: 5338cf2146344042bc263bdc4f9d822b Oct 04 20:49:20.669967 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-969894548 Oct 04 20:49:20.669967 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-SecurityGroupsTestJSON-969894548-project Oct 04 20:49:20.669967 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 20:49:20.669967 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 20:49:20.669967 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: 6775b9d82b3444f6b728736f1d2b2806 Oct 04 20:49:20.669967 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-SecurityGroupsTestJSON-969894548-project Oct 04 20:49:20.669967 n-d-854823-8 devstack@n-api.service[128802]: method: Oct 04 20:49:20.669967 n-d-854823-8 devstack@n-api.service[128802]: exception: Security group 6ee9aed4-6b8c-468f-bb28-937f3bc1eba7 does not exist Oct 04 20:49:20.669967 n-d-854823-8 devstack@n-api.service[128802]: Neutron server returns request_ids: ['req-23d80f88-5ce9-4e25-ab4a-021b82a20aa7'] Oct 04 20:49:20.669967 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'id': '6ee9aed4-6b8c-468f-bb28-937f3bc1eba7'} Oct 04 20:49:20.669967 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:49:20.669967 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:49:20.669967 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 04 20:49:20.669967 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 04 20:49:20.669967 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:49:20.669967 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:49:20.669967 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 04 20:49:20.669967 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 04 20:49:20.669967 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:49:20.669967 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:49:20.669967 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 20:49:20.669967 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 20:49:20.669967 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:49:20.669967 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:49:20.669967 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:49:20.669967 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:49:20.669967 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:49:20.669967 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:49:20.669967 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 20:49:20.669967 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 20:49:20.669967 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:49:20.669967 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:49:20.669967 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 20:49:20.669967 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 20:49:20.669967 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 20:49:20.669967 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 20:49:20.669967 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 6ee9aed4-6b8c-468f-bb28-937f3bc1eba7 does not exist Oct 04 20:49:20.676836 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-23d80f88-5ce9-4e25-ab4a-021b82a20aa7'] Oct 04 20:49:20.676836 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:49:20.676836 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:49:20.676836 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:49:20.676836 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:49:20.676836 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 04 20:49:20.676836 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 04 20:49:20.676836 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 04 20:49:20.676836 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 04 20:49:20.676836 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 6ee9aed4-6b8c-468f-bb28-937f3bc1eba7 does not exist Oct 04 20:49:20.676836 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-23d80f88-5ce9-4e25-ab4a-021b82a20aa7'] Oct 04 20:49:20.676836 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:49:20.676836 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:49:20.676836 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:49:20.676836 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:49:20.676836 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:49:20.676836 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:49:20.676836 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:49:20.676836 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:49:20.676836 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:49:20.676836 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:49:20.676836 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:49:20.676836 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:49:20.676836 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 04 20:49:20.676836 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 04 20:49:20.676836 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 6ee9aed4-6b8c-468f-bb28-937f3bc1eba7 does not exist Oct 04 20:49:20.676836 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-23d80f88-5ce9-4e25-ab4a-021b82a20aa7'] Oct 04 20:49:20.676836 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:49:20.676836 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:49:20.676836 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:49:20.676836 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:49:20.676836 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:49:20.676836 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:49:20.676836 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:49:20.676836 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:49:20.676836 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 6ee9aed4-6b8c-468f-bb28-937f3bc1eba7 does not exist Oct 04 20:49:20.676836 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-23d80f88-5ce9-4e25-ab4a-021b82a20aa7'] Oct 04 20:49:20.676836 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:49:20.692678 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-4356788b-9766-4e07-a1b0-acf89f45e6d5 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Returning 404 to user: Security group 6ee9aed4-6b8c-468f-bb28-937f3bc1eba7 does not exist Oct 04 20:49:20.692678 n-d-854823-8 devstack@n-api.service[128802]: Neutron server returns request_ids: ['req-23d80f88-5ce9-4e25-ab4a-021b82a20aa7'] {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:49:20.698061 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-4356788b-9766-4e07-a1b0-acf89f45e6d5 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/6ee9aed4-6b8c-468f-bb28-937f3bc1eba7" status: 404 len: 194 microversion: 2.1 time: 0.106739 Oct 04 20:49:20.702481 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1814/3531] 10.222.0.33 () {58 vars in 1272 bytes} [Tue Oct 4 20:49:20 2022] DELETE /compute/v2.1/os-security-groups/6ee9aed4-6b8c-468f-bb28-937f3bc1eba7 => generated 194 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:49:20.709923 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-de636c80-eaa2-43e6-b6d4-f78340bba893 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Calling method '.version_select at 0x7f3c7882d700>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:49:20.778000 n-d-854823-8 devstack@n-api.service[128801]: DEBUG neutronclient.v2_0.client [None req-de636c80-eaa2-43e6-b6d4-f78340bba893 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group f7c16f3f-c567-48bd-a2f7-07287ab49ce7 does not exist", "detail": ""}} {{(pid=128801) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 20:49:20.778792 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.network.security_group_api [None req-de636c80-eaa2-43e6-b6d4-f78340bba893 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Neutron security group f7c16f3f-c567-48bd-a2f7-07287ab49ce7 not found {{(pid=128801) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 04 20:49:20.779589 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-de636c80-eaa2-43e6-b6d4-f78340bba893 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] HTTP exception thrown: Security group f7c16f3f-c567-48bd-a2f7-07287ab49ce7 does not exist Oct 04 20:49:20.779589 n-d-854823-8 devstack@n-api.service[128801]: Neutron server returns request_ids: ['req-c7071a86-1086-4cee-ab91-cbbb4a31dc1e'] Oct 04 20:49:20.781809 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-de636c80-eaa2-43e6-b6d4-f78340bba893 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Request method failure captured: Oct 04 20:49:20.781809 n-d-854823-8 devstack@n-api.service[128801]: request: DELETE /compute/v2.1/os-security-groups/f7c16f3f-c567-48bd-a2f7-07287ab49ce7 HTTP/1.1 Oct 04 20:49:20.781809 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:49:20.781809 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:49:20.781809 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:49:20.781809 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 0 Oct 04 20:49:20.781809 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:49:20.781809 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:49:20.781809 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:49:20.781809 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:49:20.781809 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJvplJ2XtdAcke_gJrXE_KNLNy4K9GZxu4xJ3RC3ictvWfS6RkKIgxre3Ypn4Hea1fYOIvZNCiP-yxvq5D6SolLdjoz27YjvMYrrTV2S3thhTnsVyXyRm0AMTe4s528xDCu1J43IqMSUlnCB8IA8Xi7RGhGDp6gPtwX5ldwf-HyrWJg Oct 04 20:49:20.781809 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:49:20.781809 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:49:20.781809 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:49:20.781809 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:49:20.781809 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:49:20.781809 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:49:20.781809 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: 5338cf2146344042bc263bdc4f9d822b Oct 04 20:49:20.781809 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-SecurityGroupsTestJSON-969894548 Oct 04 20:49:20.781809 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 20:49:20.781809 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 20:49:20.781809 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5338cf2146344042bc263bdc4f9d822b", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5338cf2146344042bc263bdc4f9d822b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5338cf2146344042bc263bdc4f9d822b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5338cf2146344042bc263bdc4f9d822b"}]}] Oct 04 20:49:20.781809 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-SecurityGroupsTestJSON-969894548 Oct 04 20:49:20.781809 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: 5338cf2146344042bc263bdc4f9d822b Oct 04 20:49:20.781809 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-969894548 Oct 04 20:49:20.781809 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-SecurityGroupsTestJSON-969894548-project Oct 04 20:49:20.781809 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:49:20.781809 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:49:20.781809 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: 6775b9d82b3444f6b728736f1d2b2806 Oct 04 20:49:20.781809 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-SecurityGroupsTestJSON-969894548-project Oct 04 20:49:20.781809 n-d-854823-8 devstack@n-api.service[128801]: method: Oct 04 20:49:20.781809 n-d-854823-8 devstack@n-api.service[128801]: exception: Security group f7c16f3f-c567-48bd-a2f7-07287ab49ce7 does not exist Oct 04 20:49:20.781809 n-d-854823-8 devstack@n-api.service[128801]: Neutron server returns request_ids: ['req-c7071a86-1086-4cee-ab91-cbbb4a31dc1e'] Oct 04 20:49:20.781809 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': 'f7c16f3f-c567-48bd-a2f7-07287ab49ce7'} Oct 04 20:49:20.781809 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:49:20.781809 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:49:20.781809 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 04 20:49:20.781809 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 04 20:49:20.781809 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:49:20.781809 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:49:20.781809 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 04 20:49:20.781809 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 04 20:49:20.781809 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:49:20.781809 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:49:20.781809 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 20:49:20.781809 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 20:49:20.781809 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:49:20.781809 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:49:20.781809 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:49:20.781809 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:49:20.781809 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:49:20.781809 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:49:20.781809 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 20:49:20.781809 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 20:49:20.781809 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:49:20.781809 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:49:20.781809 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 20:49:20.781809 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 20:49:20.781809 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 20:49:20.781809 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 20:49:20.781809 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group f7c16f3f-c567-48bd-a2f7-07287ab49ce7 does not exist Oct 04 20:49:20.786515 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c7071a86-1086-4cee-ab91-cbbb4a31dc1e'] Oct 04 20:49:20.786515 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:49:20.786515 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:49:20.786515 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:49:20.786515 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:49:20.786515 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 04 20:49:20.786515 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 04 20:49:20.786515 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 04 20:49:20.786515 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 04 20:49:20.786515 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group f7c16f3f-c567-48bd-a2f7-07287ab49ce7 does not exist Oct 04 20:49:20.786515 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c7071a86-1086-4cee-ab91-cbbb4a31dc1e'] Oct 04 20:49:20.786515 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:49:20.786515 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:49:20.786515 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:49:20.786515 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:49:20.786515 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:49:20.786515 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:49:20.786515 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:49:20.786515 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:49:20.786515 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:49:20.786515 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:49:20.786515 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:49:20.786515 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:49:20.786515 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 04 20:49:20.786515 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 04 20:49:20.786515 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group f7c16f3f-c567-48bd-a2f7-07287ab49ce7 does not exist Oct 04 20:49:20.786515 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c7071a86-1086-4cee-ab91-cbbb4a31dc1e'] Oct 04 20:49:20.786515 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:49:20.786515 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:49:20.786515 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:49:20.786515 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:49:20.786515 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:49:20.786515 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:49:20.786515 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:49:20.786515 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:49:20.786515 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group f7c16f3f-c567-48bd-a2f7-07287ab49ce7 does not exist Oct 04 20:49:20.786515 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c7071a86-1086-4cee-ab91-cbbb4a31dc1e'] Oct 04 20:49:20.786515 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:49:20.786515 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-de636c80-eaa2-43e6-b6d4-f78340bba893 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Returning 404 to user: Security group f7c16f3f-c567-48bd-a2f7-07287ab49ce7 does not exist Oct 04 20:49:20.786515 n-d-854823-8 devstack@n-api.service[128801]: Neutron server returns request_ids: ['req-c7071a86-1086-4cee-ab91-cbbb4a31dc1e'] {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:49:20.786515 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-de636c80-eaa2-43e6-b6d4-f78340bba893 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/f7c16f3f-c567-48bd-a2f7-07287ab49ce7" status: 404 len: 194 microversion: 2.1 time: 0.078863 Oct 04 20:49:20.786515 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1718/3532] 10.222.0.33 () {58 vars in 1272 bytes} [Tue Oct 4 20:49:20 2022] DELETE /compute/v2.1/os-security-groups/f7c16f3f-c567-48bd-a2f7-07287ab49ce7 => generated 194 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:49:20.794070 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-f3f38bb2-55e3-480e-8f6f-3a428f006932 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:49:20.796336 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-f3f38bb2-55e3-480e-8f6f-3a428f006932 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] [instance: 40a02873-d2c2-42b7-a0b7-2b6125d490f3] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:49:20.806768 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f3f38bb2-55e3-480e-8f6f-3a428f006932 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:20.807505 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f3f38bb2-55e3-480e-8f6f-3a428f006932 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:20.807693 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f3f38bb2-55e3-480e-8f6f-3a428f006932 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:20.808399 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f3f38bb2-55e3-480e-8f6f-3a428f006932 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:20.819997 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f3f38bb2-55e3-480e-8f6f-3a428f006932 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:20.820602 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f3f38bb2-55e3-480e-8f6f-3a428f006932 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:20.887795 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-f3f38bb2-55e3-480e-8f6f-3a428f006932 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] [instance: 40a02873-d2c2-42b7-a0b7-2b6125d490f3] Going to try to terminate instance {{(pid=128802) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:49:21.121056 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-f3f38bb2-55e3-480e-8f6f-3a428f006932 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] 10.222.0.33 "DELETE /compute/v2.1/servers/40a02873-d2c2-42b7-a0b7-2b6125d490f3" status: 204 len: 0 microversion: 2.1 time: 0.329649 Oct 04 20:49:21.122018 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1815/3533] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 20:49:20 2022] DELETE /compute/v2.1/servers/40a02873-d2c2-42b7-a0b7-2b6125d490f3 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:49:21.132613 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d6171db7-7b74-4a36-b834-02f1923c84db tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:49:21.133234 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d6171db7-7b74-4a36-b834-02f1923c84db tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] [instance: 40a02873-d2c2-42b7-a0b7-2b6125d490f3] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:49:21.151633 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d6171db7-7b74-4a36-b834-02f1923c84db tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:21.152154 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d6171db7-7b74-4a36-b834-02f1923c84db tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:21.152602 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d6171db7-7b74-4a36-b834-02f1923c84db tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:21.153317 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d6171db7-7b74-4a36-b834-02f1923c84db tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:21.159744 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d6171db7-7b74-4a36-b834-02f1923c84db tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:21.162072 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d6171db7-7b74-4a36-b834-02f1923c84db tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:21.663172 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d6171db7-7b74-4a36-b834-02f1923c84db tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6775b9d82b3444f6b728736f1d2b2806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5338cf2146344042bc263bdc4f9d822b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:49:21.682093 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d6171db7-7b74-4a36-b834-02f1923c84db tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] 10.222.0.33 "GET /compute/v2.1/servers/40a02873-d2c2-42b7-a0b7-2b6125d490f3" status: 200 len: 1647 microversion: 2.1 time: 0.555367 Oct 04 20:49:21.698903 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1719/3534] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:49:21 2022] GET /compute/v2.1/servers/40a02873-d2c2-42b7-a0b7-2b6125d490f3 => generated 1647 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:49:22.570550 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-5ace4659-6764-46c5-b328-05fcbf0ff153 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:49:22.571111 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-5ace4659-6764-46c5-b328-05fcbf0ff153 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] [instance: f9938964-5f2f-4093-b5cb-967adbe97623] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:49:22.583881 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5ace4659-6764-46c5-b328-05fcbf0ff153 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:22.584374 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5ace4659-6764-46c5-b328-05fcbf0ff153 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:22.584816 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5ace4659-6764-46c5-b328-05fcbf0ff153 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:22.598087 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5ace4659-6764-46c5-b328-05fcbf0ff153 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:22.600000 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5ace4659-6764-46c5-b328-05fcbf0ff153 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:22.601113 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5ace4659-6764-46c5-b328-05fcbf0ff153 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:22.672729 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-5ace4659-6764-46c5-b328-05fcbf0ff153 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] 10.222.0.33 "GET /compute/v2.1/servers/f9938964-5f2f-4093-b5cb-967adbe97623/ips" status: 200 len: 149 microversion: 2.1 time: 0.106555 Oct 04 20:49:22.706809 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1816/3535] 10.222.0.33 () {58 vars in 1248 bytes} [Tue Oct 4 20:49:22 2022] GET /compute/v2.1/servers/f9938964-5f2f-4093-b5cb-967adbe97623/ips => generated 149 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:49:22.712127 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7e6c16a7-16ad-4ec4-a183-318218ad4465 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:49:22.712750 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-7e6c16a7-16ad-4ec4-a183-318218ad4465 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] [instance: 40a02873-d2c2-42b7-a0b7-2b6125d490f3] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:49:22.732085 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7e6c16a7-16ad-4ec4-a183-318218ad4465 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:22.732582 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7e6c16a7-16ad-4ec4-a183-318218ad4465 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:22.733028 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7e6c16a7-16ad-4ec4-a183-318218ad4465 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:22.743535 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7e6c16a7-16ad-4ec4-a183-318218ad4465 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:22.743990 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7e6c16a7-16ad-4ec4-a183-318218ad4465 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:22.745420 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7e6c16a7-16ad-4ec4-a183-318218ad4465 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:23.788104 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-7e6c16a7-16ad-4ec4-a183-318218ad4465 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6775b9d82b3444f6b728736f1d2b2806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5338cf2146344042bc263bdc4f9d822b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:49:23.806619 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-7e6c16a7-16ad-4ec4-a183-318218ad4465 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] 10.222.0.33 "GET /compute/v2.1/servers/40a02873-d2c2-42b7-a0b7-2b6125d490f3" status: 200 len: 1647 microversion: 2.1 time: 1.097697 Oct 04 20:49:23.808063 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1720/3536] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:49:22 2022] GET /compute/v2.1/servers/40a02873-d2c2-42b7-a0b7-2b6125d490f3 => generated 1647 bytes in 1100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:49:24.617928 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-eb1ccbcc-5d0d-4b2d-bf43-11ba01185441 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-163188167", "imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63", "flavorRef": "452", "networks": [{"uuid": "9dbf9434-4e8d-415e-bc95-1f3c19f28f1d"}]}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:49:24.680545 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-55d1f7b1-e9ce-4fbc-a8ce-f711a783c879 req-ebcefb0b-01f8-4450-b95a-d8b35a7ab004 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40a02873-d2c2-42b7-a0b7-2b6125d490f3", "name": "network-vif-deleted", "tag": "ab3cba0a-dc15-4028-b7e0-d50faae0a9e5"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:49:24.722620 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:49:24.732748 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-55d1f7b1-e9ce-4fbc-a8ce-f711a783c879 req-ebcefb0b-01f8-4450-b95a-d8b35a7ab004 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:24.733685 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-55d1f7b1-e9ce-4fbc-a8ce-f711a783c879 req-ebcefb0b-01f8-4450-b95a-d8b35a7ab004 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:24.734471 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-55d1f7b1-e9ce-4fbc-a8ce-f711a783c879 req-ebcefb0b-01f8-4450-b95a-d8b35a7ab004 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:24.768691 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.network.neutron [None req-eb1ccbcc-5d0d-4b2d-bf43-11ba01185441 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] validate_networks() for [('9dbf9434-4e8d-415e-bc95-1f3c19f28f1d', None, None, None, None, None)] {{(pid=128802) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:49:24.784866 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-55d1f7b1-e9ce-4fbc-a8ce-f711a783c879 req-ebcefb0b-01f8-4450-b95a-d8b35a7ab004 service nova] Creating event network-vif-deleted:ab3cba0a-dc15-4028-b7e0-d50faae0a9e5 for instance 40a02873-d2c2-42b7-a0b7-2b6125d490f3 on n-h1-854823-8 Oct 04 20:49:24.792049 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-55d1f7b1-e9ce-4fbc-a8ce-f711a783c879 req-ebcefb0b-01f8-4450-b95a-d8b35a7ab004 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.807995 Oct 04 20:49:24.793723 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1721/3537] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:49:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:49:24.831333 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-79f6b89e-6c56-4a3e-b48b-d6460db4ed2a tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:49:24.832810 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-79f6b89e-6c56-4a3e-b48b-d6460db4ed2a tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] [instance: 40a02873-d2c2-42b7-a0b7-2b6125d490f3] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:49:24.852667 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-79f6b89e-6c56-4a3e-b48b-d6460db4ed2a tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:24.853193 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-79f6b89e-6c56-4a3e-b48b-d6460db4ed2a tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:24.853645 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-79f6b89e-6c56-4a3e-b48b-d6460db4ed2a tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:24.858644 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-79f6b89e-6c56-4a3e-b48b-d6460db4ed2a tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:24.861310 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-79f6b89e-6c56-4a3e-b48b-d6460db4ed2a tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:24.862455 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-79f6b89e-6c56-4a3e-b48b-d6460db4ed2a tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:24.894108 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-79f6b89e-6c56-4a3e-b48b-d6460db4ed2a tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] HTTP exception thrown: Instance 40a02873-d2c2-42b7-a0b7-2b6125d490f3 could not be found. Oct 04 20:49:24.897322 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-79f6b89e-6c56-4a3e-b48b-d6460db4ed2a tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Request method failure captured: Oct 04 20:49:24.897322 n-d-854823-8 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/40a02873-d2c2-42b7-a0b7-2b6125d490f3 HTTP/1.1 Oct 04 20:49:24.897322 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:49:24.897322 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:49:24.897322 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:49:24.897322 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 0 Oct 04 20:49:24.897322 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:49:24.897322 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:49:24.897322 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:49:24.897322 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:49:24.897322 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJvplJ2XtdAcke_gJrXE_KNLNy4K9GZxu4xJ3RC3ictvWfS6RkKIgxre3Ypn4Hea1fYOIvZNCiP-yxvq5D6SolLdjoz27YjvMYrrTV2S3thhTnsVyXyRm0AMTe4s528xDCu1J43IqMSUlnCB8IA8Xi7RGhGDp6gPtwX5ldwf-HyrWJg Oct 04 20:49:24.897322 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:49:24.897322 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:49:24.897322 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:49:24.897322 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:49:24.897322 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:49:24.897322 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:49:24.897322 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: 5338cf2146344042bc263bdc4f9d822b Oct 04 20:49:24.897322 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-SecurityGroupsTestJSON-969894548 Oct 04 20:49:24.897322 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 20:49:24.897322 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 20:49:24.897322 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5338cf2146344042bc263bdc4f9d822b", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5338cf2146344042bc263bdc4f9d822b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5338cf2146344042bc263bdc4f9d822b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5338cf2146344042bc263bdc4f9d822b"}]}] Oct 04 20:49:24.897322 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-SecurityGroupsTestJSON-969894548 Oct 04 20:49:24.897322 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: 5338cf2146344042bc263bdc4f9d822b Oct 04 20:49:24.897322 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-969894548 Oct 04 20:49:24.897322 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-SecurityGroupsTestJSON-969894548-project Oct 04 20:49:24.897322 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:49:24.897322 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:49:24.897322 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: 6775b9d82b3444f6b728736f1d2b2806 Oct 04 20:49:24.897322 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-SecurityGroupsTestJSON-969894548-project Oct 04 20:49:24.897322 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 20:49:24.897322 n-d-854823-8 devstack@n-api.service[128801]: exception: Instance 40a02873-d2c2-42b7-a0b7-2b6125d490f3 could not be found. Oct 04 20:49:24.897322 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': '40a02873-d2c2-42b7-a0b7-2b6125d490f3'} Oct 04 20:49:24.897322 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:49:24.897322 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:49:24.897322 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:49:24.897322 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:49:24.897322 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:49:24.897322 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:49:24.897322 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:49:24.897322 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:49:24.897322 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:49:24.897322 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:49:24.897322 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 40a02873-d2c2-42b7-a0b7-2b6125d490f3 could not be found. Oct 04 20:49:24.897322 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:49:24.897322 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:49:24.897322 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:49:24.897322 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:49:24.897322 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:49:24.897322 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:49:24.897322 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:49:24.897322 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:49:24.897322 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:49:24.897322 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:49:24.897322 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:49:24.897322 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:49:24.897322 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:49:24.897322 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:49:24.897322 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:49:24.897322 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:49:24.897322 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40a02873-d2c2-42b7-a0b7-2b6125d490f3 could not be found. Oct 04 20:49:24.897322 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:49:24.897322 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:49:24.897322 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:49:24.903813 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:49:24.903813 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:49:24.903813 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:49:24.903813 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:49:24.903813 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:49:24.903813 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40a02873-d2c2-42b7-a0b7-2b6125d490f3 could not be found. Oct 04 20:49:24.903813 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:49:24.910913 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-79f6b89e-6c56-4a3e-b48b-d6460db4ed2a tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Returning 404 to user: Instance 40a02873-d2c2-42b7-a0b7-2b6125d490f3 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:49:24.913865 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-79f6b89e-6c56-4a3e-b48b-d6460db4ed2a tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] 10.222.0.33 "GET /compute/v2.1/servers/40a02873-d2c2-42b7-a0b7-2b6125d490f3" status: 404 len: 111 microversion: 2.1 time: 0.087644 Oct 04 20:49:24.914781 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1722/3538] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:49:24 2022] GET /compute/v2.1/servers/40a02873-d2c2-42b7-a0b7-2b6125d490f3 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:49:24.926119 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2f5008f7-49c5-44cf-8500-f99f0c803ece tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Calling method '.version_select at 0x7f3c74208040>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:49:25.476020 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-2f5008f7-49c5-44cf-8500-f99f0c803ece tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/d1fec54a-a288-4997-9c3d-bbf495fa41d9" status: 202 len: 0 microversion: 2.1 time: 0.555612 Oct 04 20:49:25.477207 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1723/3539] 10.222.0.33 () {58 vars in 1272 bytes} [Tue Oct 4 20:49:24 2022] DELETE /compute/v2.1/os-security-groups/d1fec54a-a288-4997-9c3d-bbf495fa41d9 => generated 0 bytes in 559 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 20:49:25.486031 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e9dae487-dcc9-4789-8d59-2defe4e82255 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] Calling method '.version_select at 0x7f3c742085e0>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:49:26.581162 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-eb1ccbcc-5d0d-4b2d-bf43-11ba01185441 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Flavor limits 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:49:26.581686 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-eb1ccbcc-5d0d-4b2d-bf43-11ba01185441 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Image limits 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:49:26.581845 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-eb1ccbcc-5d0d-4b2d-bf43-11ba01185441 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Flavor pref 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:49:26.582317 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-eb1ccbcc-5d0d-4b2d-bf43-11ba01185441 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Image pref 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:49:26.582843 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-eb1ccbcc-5d0d-4b2d-bf43-11ba01185441 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:49:26.611965 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-eb1ccbcc-5d0d-4b2d-bf43-11ba01185441 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:26.614685 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-eb1ccbcc-5d0d-4b2d-bf43-11ba01185441 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:26.615311 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-eb1ccbcc-5d0d-4b2d-bf43-11ba01185441 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:26.617561 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-eb1ccbcc-5d0d-4b2d-bf43-11ba01185441 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:26.622201 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-eb1ccbcc-5d0d-4b2d-bf43-11ba01185441 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:26.624693 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-eb1ccbcc-5d0d-4b2d-bf43-11ba01185441 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:26.678314 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e9dae487-dcc9-4789-8d59-2defe4e82255 tempest-SecurityGroupsTestJSON-969894548 tempest-SecurityGroupsTestJSON-969894548-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/eb9a82fe-0716-4387-9aef-13d047bc739e" status: 202 len: 0 microversion: 2.1 time: 1.196944 Oct 04 20:49:26.682252 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1724/3540] 10.222.0.33 () {58 vars in 1272 bytes} [Tue Oct 4 20:49:25 2022] DELETE /compute/v2.1/os-security-groups/eb9a82fe-0716-4387-9aef-13d047bc739e => generated 0 bytes in 1198 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 20:49:26.696995 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-eb1ccbcc-5d0d-4b2d-bf43-11ba01185441 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Getting quotas for project 82ae4960393c464c97669731c2084d0f. Resources: {'ram', 'instances', 'cores'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:49:26.715767 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-eb1ccbcc-5d0d-4b2d-bf43-11ba01185441 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Getting quotas for user e2c208ec9faf491385a9ab5b5932098d and project 82ae4960393c464c97669731c2084d0f. Resources: {'ram', 'instances', 'cores'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:49:26.755363 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-eb1ccbcc-5d0d-4b2d-bf43-11ba01185441 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Going to run 1 instances... {{(pid=128802) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:49:26.761324 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-eb1ccbcc-5d0d-4b2d-bf43-11ba01185441 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] [instance: be75ea00-7ffd-4b23-8a70-d16175082cdf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='15b24725-0c99-4bcf-b1fb-907cdf8e2d63',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128802) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:49:26.869933 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-bd51561c-3a90-45c4-b9ab-c05ae9ce9ebb tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "28ac85e3-cbb2-4665-ba0c-3f889593f1ff"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:49:26.873488 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-bd51561c-3a90-45c4-b9ab-c05ae9ce9ebb tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] [instance: f9938964-5f2f-4093-b5cb-967adbe97623] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:49:26.885316 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-eb1ccbcc-5d0d-4b2d-bf43-11ba01185441 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.036877 Oct 04 20:49:26.886747 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1817/3541] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 20:49:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 3039 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 20:49:26.897588 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bd51561c-3a90-45c4-b9ab-c05ae9ce9ebb tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:26.898095 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bd51561c-3a90-45c4-b9ab-c05ae9ce9ebb tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:26.899870 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-78cc77b8-08f9-4b80-8001-531fe022ae96 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:49:26.900732 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bd51561c-3a90-45c4-b9ab-c05ae9ce9ebb tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:26.900942 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-78cc77b8-08f9-4b80-8001-531fe022ae96 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] [instance: be75ea00-7ffd-4b23-8a70-d16175082cdf] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:49:26.901488 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bd51561c-3a90-45c4-b9ab-c05ae9ce9ebb tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:26.901966 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bd51561c-3a90-45c4-b9ab-c05ae9ce9ebb tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:26.902426 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bd51561c-3a90-45c4-b9ab-c05ae9ce9ebb tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:27.121333 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-78cc77b8-08f9-4b80-8001-531fe022ae96 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c208ec9faf491385a9ab5b5932098d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ae4960393c464c97669731c2084d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:49:27.134569 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-78cc77b8-08f9-4b80-8001-531fe022ae96 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] 10.222.0.33 "GET /compute/v2.1/servers/be75ea00-7ffd-4b23-8a70-d16175082cdf" status: 200 len: 1214 microversion: 2.1 time: 0.239703 Oct 04 20:49:27.136495 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1818/3542] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:49:26 2022] GET /compute/v2.1/servers/be75ea00-7ffd-4b23-8a70-d16175082cdf => generated 1214 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:49:27.609421 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-bd51561c-3a90-45c4-b9ab-c05ae9ce9ebb tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] 10.222.0.33 "POST /compute/v2.1/servers/f9938964-5f2f-4093-b5cb-967adbe97623/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.745357 Oct 04 20:49:27.614315 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1725/3543] 10.222.0.33 () {60 vars in 1323 bytes} [Tue Oct 4 20:49:26 2022] POST /compute/v2.1/servers/f9938964-5f2f-4093-b5cb-967adbe97623/os-volume_attachments => generated 194 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 20:49:28.165424 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-ff66dd13-f3c1-4244-a74c-216f1b50661d tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:49:28.167122 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-ff66dd13-f3c1-4244-a74c-216f1b50661d tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] [instance: be75ea00-7ffd-4b23-8a70-d16175082cdf] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:49:28.340117 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-ff66dd13-f3c1-4244-a74c-216f1b50661d tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c208ec9faf491385a9ab5b5932098d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ae4960393c464c97669731c2084d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:49:28.359339 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-ff66dd13-f3c1-4244-a74c-216f1b50661d tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] 10.222.0.33 "GET /compute/v2.1/servers/be75ea00-7ffd-4b23-8a70-d16175082cdf" status: 200 len: 1214 microversion: 2.1 time: 0.195588 Oct 04 20:49:28.363635 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1819/3544] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:49:28 2022] GET /compute/v2.1/servers/be75ea00-7ffd-4b23-8a70-d16175082cdf => generated 1214 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:49:29.400932 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c275e4e2-e48b-47b3-992f-0ada3a3ecc6b tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:49:29.401655 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c275e4e2-e48b-47b3-992f-0ada3a3ecc6b tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] [instance: be75ea00-7ffd-4b23-8a70-d16175082cdf] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:49:29.428177 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c275e4e2-e48b-47b3-992f-0ada3a3ecc6b tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:29.432657 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c275e4e2-e48b-47b3-992f-0ada3a3ecc6b tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:29.433214 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c275e4e2-e48b-47b3-992f-0ada3a3ecc6b tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:29.433963 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c275e4e2-e48b-47b3-992f-0ada3a3ecc6b tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:29.434468 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c275e4e2-e48b-47b3-992f-0ada3a3ecc6b tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:29.434902 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c275e4e2-e48b-47b3-992f-0ada3a3ecc6b tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:29.839629 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c275e4e2-e48b-47b3-992f-0ada3a3ecc6b tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c208ec9faf491385a9ab5b5932098d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ae4960393c464c97669731c2084d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:49:29.867333 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c275e4e2-e48b-47b3-992f-0ada3a3ecc6b tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] 10.222.0.33 "GET /compute/v2.1/servers/be75ea00-7ffd-4b23-8a70-d16175082cdf" status: 200 len: 1266 microversion: 2.1 time: 0.477735 Oct 04 20:49:29.868210 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1726/3545] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:49:29 2022] GET /compute/v2.1/servers/be75ea00-7ffd-4b23-8a70-d16175082cdf => generated 1266 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:49:30.893359 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-95ce81ba-9dfa-430e-8008-92e7e293b30e tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:49:30.902698 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-95ce81ba-9dfa-430e-8008-92e7e293b30e tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] [instance: be75ea00-7ffd-4b23-8a70-d16175082cdf] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:49:30.929161 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-95ce81ba-9dfa-430e-8008-92e7e293b30e tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:30.930186 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-95ce81ba-9dfa-430e-8008-92e7e293b30e tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:30.930963 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-95ce81ba-9dfa-430e-8008-92e7e293b30e tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:30.931977 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-95ce81ba-9dfa-430e-8008-92e7e293b30e tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:30.932686 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-95ce81ba-9dfa-430e-8008-92e7e293b30e tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:30.933344 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-95ce81ba-9dfa-430e-8008-92e7e293b30e tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:31.171678 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-95ce81ba-9dfa-430e-8008-92e7e293b30e tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c208ec9faf491385a9ab5b5932098d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ae4960393c464c97669731c2084d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:49:31.195990 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-95ce81ba-9dfa-430e-8008-92e7e293b30e tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] 10.222.0.33 "GET /compute/v2.1/servers/be75ea00-7ffd-4b23-8a70-d16175082cdf" status: 200 len: 1272 microversion: 2.1 time: 0.304352 Oct 04 20:49:31.208123 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1820/3546] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:49:30 2022] GET /compute/v2.1/servers/be75ea00-7ffd-4b23-8a70-d16175082cdf => generated 1272 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:49:32.236254 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-4c61da89-2a23-4911-ab58-5fae03beb140 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:49:32.237762 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-4c61da89-2a23-4911-ab58-5fae03beb140 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] [instance: be75ea00-7ffd-4b23-8a70-d16175082cdf] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:49:32.256320 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4c61da89-2a23-4911-ab58-5fae03beb140 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:32.259365 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4c61da89-2a23-4911-ab58-5fae03beb140 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:32.260346 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4c61da89-2a23-4911-ab58-5fae03beb140 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:32.262303 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4c61da89-2a23-4911-ab58-5fae03beb140 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:32.265476 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4c61da89-2a23-4911-ab58-5fae03beb140 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:32.269508 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4c61da89-2a23-4911-ab58-5fae03beb140 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:33.020005 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-4c61da89-2a23-4911-ab58-5fae03beb140 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c208ec9faf491385a9ab5b5932098d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ae4960393c464c97669731c2084d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:49:33.022795 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:INSERT=3,nova_cell1:SELECT=94,nova_cell1:UPDATE=3 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:49:33.042428 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-4c61da89-2a23-4911-ab58-5fae03beb140 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] 10.222.0.33 "GET /compute/v2.1/servers/be75ea00-7ffd-4b23-8a70-d16175082cdf" status: 200 len: 1314 microversion: 2.1 time: 0.810806 Oct 04 20:49:33.064190 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1727/3547] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:49:32 2022] GET /compute/v2.1/servers/be75ea00-7ffd-4b23-8a70-d16175082cdf => generated 1314 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:49:34.074650 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-5778d463-ef2e-484b-a89a-4416d0e15351 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:49:34.075857 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-5778d463-ef2e-484b-a89a-4416d0e15351 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] [instance: be75ea00-7ffd-4b23-8a70-d16175082cdf] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:49:34.081895 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:49:34.102619 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5778d463-ef2e-484b-a89a-4416d0e15351 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:34.103135 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5778d463-ef2e-484b-a89a-4416d0e15351 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:34.103734 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5778d463-ef2e-484b-a89a-4416d0e15351 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:34.104474 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5778d463-ef2e-484b-a89a-4416d0e15351 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:34.104937 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5778d463-ef2e-484b-a89a-4416d0e15351 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:34.105374 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5778d463-ef2e-484b-a89a-4416d0e15351 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:34.748337 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-5778d463-ef2e-484b-a89a-4416d0e15351 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c208ec9faf491385a9ab5b5932098d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ae4960393c464c97669731c2084d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:49:34.763314 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-5778d463-ef2e-484b-a89a-4416d0e15351 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] 10.222.0.33 "GET /compute/v2.1/servers/be75ea00-7ffd-4b23-8a70-d16175082cdf" status: 200 len: 1314 microversion: 2.1 time: 0.696468 Oct 04 20:49:34.765604 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1821/3548] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:49:34 2022] GET /compute/v2.1/servers/be75ea00-7ffd-4b23-8a70-d16175082cdf => generated 1314 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:49:35.546172 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-d6ac7f91-c30d-4649-bfa0-4b9aa948b71e req-880f005d-b1f0-4b0f-8eea-f1ca9d74d576 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be75ea00-7ffd-4b23-8a70-d16175082cdf", "tag": "4f94c735-13c5-41e3-9b88-b2c616a44951"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:49:35.572944 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-d6ac7f91-c30d-4649-bfa0-4b9aa948b71e req-880f005d-b1f0-4b0f-8eea-f1ca9d74d576 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:35.578126 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-d6ac7f91-c30d-4649-bfa0-4b9aa948b71e req-880f005d-b1f0-4b0f-8eea-f1ca9d74d576 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:35.579692 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-d6ac7f91-c30d-4649-bfa0-4b9aa948b71e req-880f005d-b1f0-4b0f-8eea-f1ca9d74d576 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:35.626157 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-d6ac7f91-c30d-4649-bfa0-4b9aa948b71e req-880f005d-b1f0-4b0f-8eea-f1ca9d74d576 service nova] Creating event network-changed:4f94c735-13c5-41e3-9b88-b2c616a44951 for instance be75ea00-7ffd-4b23-8a70-d16175082cdf on n-h1-854823-8 Oct 04 20:49:35.641880 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-d6ac7f91-c30d-4649-bfa0-4b9aa948b71e req-880f005d-b1f0-4b0f-8eea-f1ca9d74d576 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.462493 Oct 04 20:49:35.651297 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1728/3549] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:49:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:49:35.791155 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-da74cbab-a643-480a-a7b7-be56b45a3307 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:49:35.791948 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-da74cbab-a643-480a-a7b7-be56b45a3307 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] [instance: be75ea00-7ffd-4b23-8a70-d16175082cdf] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:49:35.808303 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-da74cbab-a643-480a-a7b7-be56b45a3307 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:35.809093 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-da74cbab-a643-480a-a7b7-be56b45a3307 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:35.810930 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-da74cbab-a643-480a-a7b7-be56b45a3307 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:35.814618 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-da74cbab-a643-480a-a7b7-be56b45a3307 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:35.815561 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-da74cbab-a643-480a-a7b7-be56b45a3307 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:35.816948 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-da74cbab-a643-480a-a7b7-be56b45a3307 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:36.272206 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-da74cbab-a643-480a-a7b7-be56b45a3307 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c208ec9faf491385a9ab5b5932098d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ae4960393c464c97669731c2084d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:49:36.302417 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-da74cbab-a643-480a-a7b7-be56b45a3307 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] 10.222.0.33 "GET /compute/v2.1/servers/be75ea00-7ffd-4b23-8a70-d16175082cdf" status: 200 len: 1314 microversion: 2.1 time: 0.516528 Oct 04 20:49:36.310542 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1822/3550] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:49:35 2022] GET /compute/v2.1/servers/be75ea00-7ffd-4b23-8a70-d16175082cdf => generated 1314 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:49:37.337852 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7491d425-b1a9-4515-8089-e34f4d4711ab tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:49:37.340613 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-7491d425-b1a9-4515-8089-e34f4d4711ab tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] [instance: be75ea00-7ffd-4b23-8a70-d16175082cdf] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:49:37.364670 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7491d425-b1a9-4515-8089-e34f4d4711ab tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:37.369019 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7491d425-b1a9-4515-8089-e34f4d4711ab tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:37.370148 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7491d425-b1a9-4515-8089-e34f4d4711ab tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:37.373571 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7491d425-b1a9-4515-8089-e34f4d4711ab tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:37.374629 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7491d425-b1a9-4515-8089-e34f4d4711ab tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:37.378379 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7491d425-b1a9-4515-8089-e34f4d4711ab tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:38.197450 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-7491d425-b1a9-4515-8089-e34f4d4711ab tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c208ec9faf491385a9ab5b5932098d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ae4960393c464c97669731c2084d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:49:38.209592 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-7491d425-b1a9-4515-8089-e34f4d4711ab tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] 10.222.0.33 "GET /compute/v2.1/servers/be75ea00-7ffd-4b23-8a70-d16175082cdf" status: 200 len: 1314 microversion: 2.1 time: 0.878982 Oct 04 20:49:38.217328 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1729/3551] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:49:37 2022] GET /compute/v2.1/servers/be75ea00-7ffd-4b23-8a70-d16175082cdf => generated 1314 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:49:39.258044 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-66fd2605-2593-4572-8d70-33b0c45c2169 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:49:39.259893 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-66fd2605-2593-4572-8d70-33b0c45c2169 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] [instance: be75ea00-7ffd-4b23-8a70-d16175082cdf] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:49:39.268953 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell0:SELECT=2 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:49:39.274812 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell0:SELECT=10 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:49:39.283539 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-66fd2605-2593-4572-8d70-33b0c45c2169 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:39.284360 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-66fd2605-2593-4572-8d70-33b0c45c2169 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:39.286196 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-66fd2605-2593-4572-8d70-33b0c45c2169 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:39.288946 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-66fd2605-2593-4572-8d70-33b0c45c2169 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:39.296081 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-66fd2605-2593-4572-8d70-33b0c45c2169 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:39.298459 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-66fd2605-2593-4572-8d70-33b0c45c2169 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:39.741339 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-66fd2605-2593-4572-8d70-33b0c45c2169 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c208ec9faf491385a9ab5b5932098d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ae4960393c464c97669731c2084d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:49:39.765049 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-66fd2605-2593-4572-8d70-33b0c45c2169 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] 10.222.0.33 "GET /compute/v2.1/servers/be75ea00-7ffd-4b23-8a70-d16175082cdf" status: 200 len: 1314 microversion: 2.1 time: 0.512528 Oct 04 20:49:39.768541 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1823/3552] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:49:39 2022] GET /compute/v2.1/servers/be75ea00-7ffd-4b23-8a70-d16175082cdf => generated 1314 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:49:40.794792 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1cacdf9c-723f-43a8-8af9-8a77d5842e50 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:49:40.796278 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-1cacdf9c-723f-43a8-8af9-8a77d5842e50 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] [instance: be75ea00-7ffd-4b23-8a70-d16175082cdf] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:49:40.813789 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1cacdf9c-723f-43a8-8af9-8a77d5842e50 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:40.815065 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1cacdf9c-723f-43a8-8af9-8a77d5842e50 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:40.815718 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1cacdf9c-723f-43a8-8af9-8a77d5842e50 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:40.816718 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1cacdf9c-723f-43a8-8af9-8a77d5842e50 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:40.817403 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1cacdf9c-723f-43a8-8af9-8a77d5842e50 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:40.818065 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1cacdf9c-723f-43a8-8af9-8a77d5842e50 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:41.099318 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-1cacdf9c-723f-43a8-8af9-8a77d5842e50 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c208ec9faf491385a9ab5b5932098d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ae4960393c464c97669731c2084d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:49:41.115176 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-1cacdf9c-723f-43a8-8af9-8a77d5842e50 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] 10.222.0.33 "GET /compute/v2.1/servers/be75ea00-7ffd-4b23-8a70-d16175082cdf" status: 200 len: 1314 microversion: 2.1 time: 0.325336 Oct 04 20:49:41.115780 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1730/3553] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:49:40 2022] GET /compute/v2.1/servers/be75ea00-7ffd-4b23-8a70-d16175082cdf => generated 1314 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:49:41.501305 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-df0dff4f-dcd8-45c9-a4d7-31c90ec60fd8 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e7847af5-dfc9-4048-ba6e-2c3fbb3ce5c4"}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:49:41.510804 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-df0dff4f-dcd8-45c9-a4d7-31c90ec60fd8 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] [instance: 9261e0b2-35ac-40f4-92d5-3b9ffaea23c4] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:49:41.534679 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-df0dff4f-dcd8-45c9-a4d7-31c90ec60fd8 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:41.546507 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-df0dff4f-dcd8-45c9-a4d7-31c90ec60fd8 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:41.547126 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-df0dff4f-dcd8-45c9-a4d7-31c90ec60fd8 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:41.547955 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-df0dff4f-dcd8-45c9-a4d7-31c90ec60fd8 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:41.548441 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-df0dff4f-dcd8-45c9-a4d7-31c90ec60fd8 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:41.548899 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-df0dff4f-dcd8-45c9-a4d7-31c90ec60fd8 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:42.116920 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=69,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:49:42.141415 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-55956ff4-86a5-4c28-9e9f-1878e6d0bc61 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:49:42.143132 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-55956ff4-86a5-4c28-9e9f-1878e6d0bc61 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] [instance: be75ea00-7ffd-4b23-8a70-d16175082cdf] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:49:42.160912 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-55956ff4-86a5-4c28-9e9f-1878e6d0bc61 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:42.162374 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-55956ff4-86a5-4c28-9e9f-1878e6d0bc61 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:42.163515 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-55956ff4-86a5-4c28-9e9f-1878e6d0bc61 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:42.165806 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-55956ff4-86a5-4c28-9e9f-1878e6d0bc61 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:42.166844 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-55956ff4-86a5-4c28-9e9f-1878e6d0bc61 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:42.168450 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-55956ff4-86a5-4c28-9e9f-1878e6d0bc61 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:42.170959 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-df0dff4f-dcd8-45c9-a4d7-31c90ec60fd8 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] 10.222.0.33 "POST /compute/v2.1/servers/9261e0b2-35ac-40f4-92d5-3b9ffaea23c4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.672702 Oct 04 20:49:42.189876 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1824/3554] 10.222.0.33 () {60 vars in 1323 bytes} [Tue Oct 4 20:49:41 2022] POST /compute/v2.1/servers/9261e0b2-35ac-40f4-92d5-3b9ffaea23c4/os-volume_attachments => generated 194 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:49:42.552572 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-55956ff4-86a5-4c28-9e9f-1878e6d0bc61 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c208ec9faf491385a9ab5b5932098d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ae4960393c464c97669731c2084d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:49:42.566130 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-55956ff4-86a5-4c28-9e9f-1878e6d0bc61 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] 10.222.0.33 "GET /compute/v2.1/servers/be75ea00-7ffd-4b23-8a70-d16175082cdf" status: 200 len: 1314 microversion: 2.1 time: 0.426851 Oct 04 20:49:42.566831 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1731/3555] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:49:42 2022] GET /compute/v2.1/servers/be75ea00-7ffd-4b23-8a70-d16175082cdf => generated 1314 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:49:43.599280 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b89b3e59-a8d8-4b24-94d0-8df8170f67c4 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:49:43.599899 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b89b3e59-a8d8-4b24-94d0-8df8170f67c4 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] [instance: be75ea00-7ffd-4b23-8a70-d16175082cdf] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:49:43.632506 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b89b3e59-a8d8-4b24-94d0-8df8170f67c4 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:43.633002 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b89b3e59-a8d8-4b24-94d0-8df8170f67c4 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:43.633440 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b89b3e59-a8d8-4b24-94d0-8df8170f67c4 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:43.634155 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b89b3e59-a8d8-4b24-94d0-8df8170f67c4 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:43.634644 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b89b3e59-a8d8-4b24-94d0-8df8170f67c4 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:43.635071 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b89b3e59-a8d8-4b24-94d0-8df8170f67c4 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:44.055095 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-fbc3d1bb-e58f-4390-8ef6-89b1de1d1481 req-51c813ba-8926-4c95-8f06-814052b908c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be75ea00-7ffd-4b23-8a70-d16175082cdf", "name": "network-vif-plugged", "status": "completed", "tag": "4f94c735-13c5-41e3-9b88-b2c616a44951"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:49:44.085313 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-b89b3e59-a8d8-4b24-94d0-8df8170f67c4 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c208ec9faf491385a9ab5b5932098d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ae4960393c464c97669731c2084d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:49:44.107578 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b89b3e59-a8d8-4b24-94d0-8df8170f67c4 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] 10.222.0.33 "GET /compute/v2.1/servers/be75ea00-7ffd-4b23-8a70-d16175082cdf" status: 200 len: 1314 microversion: 2.1 time: 0.514302 Oct 04 20:49:44.109251 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-fbc3d1bb-e58f-4390-8ef6-89b1de1d1481 req-51c813ba-8926-4c95-8f06-814052b908c3 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:44.109527 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1732/3556] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:49:43 2022] GET /compute/v2.1/servers/be75ea00-7ffd-4b23-8a70-d16175082cdf => generated 1314 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:49:44.110926 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-fbc3d1bb-e58f-4390-8ef6-89b1de1d1481 req-51c813ba-8926-4c95-8f06-814052b908c3 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:44.117113 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-fbc3d1bb-e58f-4390-8ef6-89b1de1d1481 req-51c813ba-8926-4c95-8f06-814052b908c3 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:44.154450 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-fbc3d1bb-e58f-4390-8ef6-89b1de1d1481 req-51c813ba-8926-4c95-8f06-814052b908c3 service nova] Creating event network-vif-plugged:4f94c735-13c5-41e3-9b88-b2c616a44951 for instance be75ea00-7ffd-4b23-8a70-d16175082cdf on n-h1-854823-8 Oct 04 20:49:44.165055 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-fbc3d1bb-e58f-4390-8ef6-89b1de1d1481 req-51c813ba-8926-4c95-8f06-814052b908c3 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.715342 Oct 04 20:49:44.166565 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1825/3557] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:49:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:49:44.753932 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f48ae0b3-3a64-47ec-a1c4-96abd9fac534 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:49:44.756723 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f48ae0b3-3a64-47ec-a1c4-96abd9fac534 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: 4d46fff2-b04d-41aa-ada0-2023ab545b48] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:49:44.779284 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f48ae0b3-3a64-47ec-a1c4-96abd9fac534 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:44.779782 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f48ae0b3-3a64-47ec-a1c4-96abd9fac534 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:44.783471 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f48ae0b3-3a64-47ec-a1c4-96abd9fac534 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:44.784747 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f48ae0b3-3a64-47ec-a1c4-96abd9fac534 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:44.786803 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f48ae0b3-3a64-47ec-a1c4-96abd9fac534 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:44.787537 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f48ae0b3-3a64-47ec-a1c4-96abd9fac534 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:45.030249 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f48ae0b3-3a64-47ec-a1c4-96abd9fac534 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "POST /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48/action" status: 202 len: 0 microversion: 2.1 time: 0.915883 Oct 04 20:49:45.034011 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1733/3558] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 20:49:44 2022] POST /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48/action => generated 0 bytes in 924 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:49:45.045743 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-f81117aa-01ed-4317-b9d6-cd203ad25edc tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:49:45.046815 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-f81117aa-01ed-4317-b9d6-cd203ad25edc tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: 4d46fff2-b04d-41aa-ada0-2023ab545b48] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:49:45.070684 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f81117aa-01ed-4317-b9d6-cd203ad25edc tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:45.073868 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f81117aa-01ed-4317-b9d6-cd203ad25edc tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:45.076292 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f81117aa-01ed-4317-b9d6-cd203ad25edc tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:45.077062 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f81117aa-01ed-4317-b9d6-cd203ad25edc tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:45.079548 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f81117aa-01ed-4317-b9d6-cd203ad25edc tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:45.082099 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f81117aa-01ed-4317-b9d6-cd203ad25edc tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:45.142526 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2bcc01ef-4ea2-4242-8726-a99ff690877d tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:49:45.146123 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-2bcc01ef-4ea2-4242-8726-a99ff690877d tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] [instance: be75ea00-7ffd-4b23-8a70-d16175082cdf] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:49:45.171596 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2bcc01ef-4ea2-4242-8726-a99ff690877d tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:45.184211 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2bcc01ef-4ea2-4242-8726-a99ff690877d tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:45.189200 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2bcc01ef-4ea2-4242-8726-a99ff690877d tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:45.191519 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2bcc01ef-4ea2-4242-8726-a99ff690877d tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:45.195564 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2bcc01ef-4ea2-4242-8726-a99ff690877d tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:45.201384 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2bcc01ef-4ea2-4242-8726-a99ff690877d tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:46.052542 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-2bcc01ef-4ea2-4242-8726-a99ff690877d tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c208ec9faf491385a9ab5b5932098d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ae4960393c464c97669731c2084d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:49:46.070674 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-2bcc01ef-4ea2-4242-8726-a99ff690877d tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] 10.222.0.33 "GET /compute/v2.1/servers/be75ea00-7ffd-4b23-8a70-d16175082cdf" status: 200 len: 1314 microversion: 2.1 time: 0.931220 Oct 04 20:49:46.073292 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1734/3559] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:49:45 2022] GET /compute/v2.1/servers/be75ea00-7ffd-4b23-8a70-d16175082cdf => generated 1314 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:49:46.095501 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2ef50692-d79f-4de0-b503-dba13318083f tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:49:46.099164 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-2ef50692-d79f-4de0-b503-dba13318083f tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] [instance: f9938964-5f2f-4093-b5cb-967adbe97623] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:49:46.114451 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2ef50692-d79f-4de0-b503-dba13318083f tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:46.125648 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2ef50692-d79f-4de0-b503-dba13318083f tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:46.126760 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2ef50692-d79f-4de0-b503-dba13318083f tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:46.128684 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2ef50692-d79f-4de0-b503-dba13318083f tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:46.135252 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2ef50692-d79f-4de0-b503-dba13318083f tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:46.137001 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2ef50692-d79f-4de0-b503-dba13318083f tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:46.387728 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-2ef50692-d79f-4de0-b503-dba13318083f tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lazy-loading 'services' on Instance uuid f9938964-5f2f-4093-b5cb-967adbe97623 {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:49:46.429638 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-f81117aa-01ed-4317-b9d6-cd203ad25edc tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac650232cc04810b1340dc2f0edadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b0670d1bd99424780a70e69d57a2166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:49:46.443650 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-f81117aa-01ed-4317-b9d6-cd203ad25edc tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48" status: 200 len: 1671 microversion: 2.1 time: 1.404282 Oct 04 20:49:46.464428 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1826/3560] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:49:45 2022] GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48 => generated 1671 bytes in 1426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:49:46.570102 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-2ef50692-d79f-4de0-b503-dba13318083f tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] 10.222.0.33 "DELETE /compute/v2.1/servers/f9938964-5f2f-4093-b5cb-967adbe97623/os-volume_attachments/28ac85e3-cbb2-4665-ba0c-3f889593f1ff" status: 202 len: 0 microversion: 2.1 time: 0.494466 Oct 04 20:49:46.571149 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1735/3561] 10.222.0.33 () {58 vars in 1416 bytes} [Tue Oct 4 20:49:46 2022] DELETE /compute/v2.1/servers/f9938964-5f2f-4093-b5cb-967adbe97623/os-volume_attachments/28ac85e3-cbb2-4665-ba0c-3f889593f1ff => generated 0 bytes in 497 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:49:46.580788 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-4e04423b-ba87-4818-8027-24236628531d tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:49:46.585322 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-4e04423b-ba87-4818-8027-24236628531d tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] [instance: f9938964-5f2f-4093-b5cb-967adbe97623] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:49:46.602783 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4e04423b-ba87-4818-8027-24236628531d tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:46.604142 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4e04423b-ba87-4818-8027-24236628531d tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:46.604808 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4e04423b-ba87-4818-8027-24236628531d tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:46.607141 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4e04423b-ba87-4818-8027-24236628531d tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:46.609743 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4e04423b-ba87-4818-8027-24236628531d tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:46.611208 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4e04423b-ba87-4818-8027-24236628531d tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:46.689960 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-4e04423b-ba87-4818-8027-24236628531d tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] 10.222.0.33 "GET /compute/v2.1/servers/f9938964-5f2f-4093-b5cb-967adbe97623/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.114677 Oct 04 20:49:46.690581 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1827/3562] 10.222.0.33 () {58 vars in 1302 bytes} [Tue Oct 4 20:49:46 2022] GET /compute/v2.1/servers/f9938964-5f2f-4093-b5cb-967adbe97623/os-volume_attachments => generated 197 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:49:47.104923 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-aa29fe8d-2359-462a-a2df-a14130092993 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:49:47.106645 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-aa29fe8d-2359-462a-a2df-a14130092993 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] [instance: be75ea00-7ffd-4b23-8a70-d16175082cdf] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:49:47.167248 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-aa29fe8d-2359-462a-a2df-a14130092993 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:47.171107 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-aa29fe8d-2359-462a-a2df-a14130092993 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:47.185863 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-aa29fe8d-2359-462a-a2df-a14130092993 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:47.189371 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-aa29fe8d-2359-462a-a2df-a14130092993 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:47.200727 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-aa29fe8d-2359-462a-a2df-a14130092993 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:47.208671 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-aa29fe8d-2359-462a-a2df-a14130092993 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:47.468569 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-cd9f3673-ce82-457f-8c81-e11c8a35e135 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:49:47.469299 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-cd9f3673-ce82-457f-8c81-e11c8a35e135 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: 4d46fff2-b04d-41aa-ada0-2023ab545b48] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:49:47.493052 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cd9f3673-ce82-457f-8c81-e11c8a35e135 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:47.493546 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cd9f3673-ce82-457f-8c81-e11c8a35e135 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:47.494022 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cd9f3673-ce82-457f-8c81-e11c8a35e135 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:47.494713 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cd9f3673-ce82-457f-8c81-e11c8a35e135 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:47.495171 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cd9f3673-ce82-457f-8c81-e11c8a35e135 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:47.495590 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cd9f3673-ce82-457f-8c81-e11c8a35e135 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:47.874434 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-aa29fe8d-2359-462a-a2df-a14130092993 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c208ec9faf491385a9ab5b5932098d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ae4960393c464c97669731c2084d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:49:47.895169 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-aa29fe8d-2359-462a-a2df-a14130092993 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] 10.222.0.33 "GET /compute/v2.1/servers/be75ea00-7ffd-4b23-8a70-d16175082cdf" status: 200 len: 1501 microversion: 2.1 time: 0.797699 Oct 04 20:49:47.913521 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1736/3563] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:49:47 2022] GET /compute/v2.1/servers/be75ea00-7ffd-4b23-8a70-d16175082cdf => generated 1501 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:49:47.929547 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-99639ea0-a18a-48e9-9c7f-fffb69b8ef6b tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:49:47.935965 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-99639ea0-a18a-48e9-9c7f-fffb69b8ef6b tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] [instance: f9938964-5f2f-4093-b5cb-967adbe97623] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:49:47.955885 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-99639ea0-a18a-48e9-9c7f-fffb69b8ef6b tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:47.957638 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-99639ea0-a18a-48e9-9c7f-fffb69b8ef6b tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:47.958590 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-99639ea0-a18a-48e9-9c7f-fffb69b8ef6b tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:47.959966 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-99639ea0-a18a-48e9-9c7f-fffb69b8ef6b tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:47.960688 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-99639ea0-a18a-48e9-9c7f-fffb69b8ef6b tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:47.961648 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-99639ea0-a18a-48e9-9c7f-fffb69b8ef6b tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:48.021286 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-99639ea0-a18a-48e9-9c7f-fffb69b8ef6b tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] 10.222.0.33 "GET /compute/v2.1/servers/f9938964-5f2f-4093-b5cb-967adbe97623/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.105400 Oct 04 20:49:48.022426 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1737/3564] 10.222.0.33 () {58 vars in 1302 bytes} [Tue Oct 4 20:49:47 2022] GET /compute/v2.1/servers/f9938964-5f2f-4093-b5cb-967adbe97623/os-volume_attachments => generated 197 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:49:48.047444 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-20368b64-b5f8-4c44-9cc8-8a1d0d5b797a tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:49:48.052163 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-20368b64-b5f8-4c44-9cc8-8a1d0d5b797a tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] [instance: be75ea00-7ffd-4b23-8a70-d16175082cdf] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:49:48.069703 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-20368b64-b5f8-4c44-9cc8-8a1d0d5b797a tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:48.070866 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-20368b64-b5f8-4c44-9cc8-8a1d0d5b797a tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:48.072913 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-20368b64-b5f8-4c44-9cc8-8a1d0d5b797a tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:48.073920 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-20368b64-b5f8-4c44-9cc8-8a1d0d5b797a tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:48.074689 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-20368b64-b5f8-4c44-9cc8-8a1d0d5b797a tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:48.075335 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-20368b64-b5f8-4c44-9cc8-8a1d0d5b797a tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:48.124754 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-20368b64-b5f8-4c44-9cc8-8a1d0d5b797a tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] [instance: be75ea00-7ffd-4b23-8a70-d16175082cdf] Going to try to terminate instance {{(pid=128801) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:49:48.303790 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-20368b64-b5f8-4c44-9cc8-8a1d0d5b797a tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] 10.222.0.33 "DELETE /compute/v2.1/servers/be75ea00-7ffd-4b23-8a70-d16175082cdf" status: 204 len: 0 microversion: 2.1 time: 0.268422 Oct 04 20:49:48.303930 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1738/3565] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 20:49:48 2022] DELETE /compute/v2.1/servers/be75ea00-7ffd-4b23-8a70-d16175082cdf => generated 0 bytes in 271 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:49:48.313703 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-515b3239-17ff-4583-8e48-b44167408887 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:49:48.314849 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-515b3239-17ff-4583-8e48-b44167408887 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] [instance: be75ea00-7ffd-4b23-8a70-d16175082cdf] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:49:48.325348 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-515b3239-17ff-4583-8e48-b44167408887 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:48.326189 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-515b3239-17ff-4583-8e48-b44167408887 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:48.326831 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-515b3239-17ff-4583-8e48-b44167408887 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:48.327737 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-515b3239-17ff-4583-8e48-b44167408887 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:48.328421 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-515b3239-17ff-4583-8e48-b44167408887 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:48.329418 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-515b3239-17ff-4583-8e48-b44167408887 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:48.431314 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-cd9f3673-ce82-457f-8c81-e11c8a35e135 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac650232cc04810b1340dc2f0edadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b0670d1bd99424780a70e69d57a2166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:49:48.471495 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-cd9f3673-ce82-457f-8c81-e11c8a35e135 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48" status: 200 len: 1671 microversion: 2.1 time: 1.005922 Oct 04 20:49:48.489218 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1828/3566] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:49:47 2022] GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48 => generated 1671 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:49:48.979385 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-515b3239-17ff-4583-8e48-b44167408887 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c208ec9faf491385a9ab5b5932098d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ae4960393c464c97669731c2084d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:49:48.996646 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-515b3239-17ff-4583-8e48-b44167408887 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] 10.222.0.33 "GET /compute/v2.1/servers/be75ea00-7ffd-4b23-8a70-d16175082cdf" status: 200 len: 1507 microversion: 2.1 time: 0.687784 Oct 04 20:49:49.004661 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1739/3567] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:49:48 2022] GET /compute/v2.1/servers/be75ea00-7ffd-4b23-8a70-d16175082cdf => generated 1507 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:49:49.038479 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-c0208ce4-bbaf-4f9c-9b19-bbfa013f524a tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:49:49.040858 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-c0208ce4-bbaf-4f9c-9b19-bbfa013f524a tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] [instance: f9938964-5f2f-4093-b5cb-967adbe97623] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:49:49.064715 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c0208ce4-bbaf-4f9c-9b19-bbfa013f524a tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:49.078363 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c0208ce4-bbaf-4f9c-9b19-bbfa013f524a tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:49.081521 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c0208ce4-bbaf-4f9c-9b19-bbfa013f524a tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:49.083839 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c0208ce4-bbaf-4f9c-9b19-bbfa013f524a tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:49.084549 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c0208ce4-bbaf-4f9c-9b19-bbfa013f524a tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:49.085229 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c0208ce4-bbaf-4f9c-9b19-bbfa013f524a tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:49.168093 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-c0208ce4-bbaf-4f9c-9b19-bbfa013f524a tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] 10.222.0.33 "GET /compute/v2.1/servers/f9938964-5f2f-4093-b5cb-967adbe97623/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.135175 Oct 04 20:49:49.177332 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1829/3568] 10.222.0.33 () {58 vars in 1302 bytes} [Tue Oct 4 20:49:49 2022] GET /compute/v2.1/servers/f9938964-5f2f-4093-b5cb-967adbe97623/os-volume_attachments => generated 197 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:49:49.502562 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1768d9ef-7046-43ee-96de-cbf59fe0427c tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:49:49.503755 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-1768d9ef-7046-43ee-96de-cbf59fe0427c tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: 4d46fff2-b04d-41aa-ada0-2023ab545b48] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:49:49.523308 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1768d9ef-7046-43ee-96de-cbf59fe0427c tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:49.524284 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1768d9ef-7046-43ee-96de-cbf59fe0427c tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:49.525913 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1768d9ef-7046-43ee-96de-cbf59fe0427c tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:49.528944 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1768d9ef-7046-43ee-96de-cbf59fe0427c tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:49.529973 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1768d9ef-7046-43ee-96de-cbf59fe0427c tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:49.531026 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1768d9ef-7046-43ee-96de-cbf59fe0427c tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:50.024546 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-fc23967d-0414-405e-a7a7-084b4c0ccacb tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:49:50.026074 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-fc23967d-0414-405e-a7a7-084b4c0ccacb tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] [instance: be75ea00-7ffd-4b23-8a70-d16175082cdf] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:49:50.041228 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fc23967d-0414-405e-a7a7-084b4c0ccacb tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:50.041995 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fc23967d-0414-405e-a7a7-084b4c0ccacb tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:50.042662 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fc23967d-0414-405e-a7a7-084b4c0ccacb tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:50.045014 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fc23967d-0414-405e-a7a7-084b4c0ccacb tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:50.045652 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fc23967d-0414-405e-a7a7-084b4c0ccacb tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:50.046848 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fc23967d-0414-405e-a7a7-084b4c0ccacb tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:50.226478 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-1768d9ef-7046-43ee-96de-cbf59fe0427c tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac650232cc04810b1340dc2f0edadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b0670d1bd99424780a70e69d57a2166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:49:50.245598 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-1768d9ef-7046-43ee-96de-cbf59fe0427c tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48" status: 200 len: 1671 microversion: 2.1 time: 0.749544 Oct 04 20:49:50.248911 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1740/3569] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:49:49 2022] GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48 => generated 1671 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:49:50.260300 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c06f13a1-99dc-4de5-9d4c-56f43139b650 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:49:50.282313 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c06f13a1-99dc-4de5-9d4c-56f43139b650 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] [instance: f9938964-5f2f-4093-b5cb-967adbe97623] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:49:50.304891 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c06f13a1-99dc-4de5-9d4c-56f43139b650 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:50.311150 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c06f13a1-99dc-4de5-9d4c-56f43139b650 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:50.311612 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c06f13a1-99dc-4de5-9d4c-56f43139b650 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:50.330983 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c06f13a1-99dc-4de5-9d4c-56f43139b650 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:50.334675 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c06f13a1-99dc-4de5-9d4c-56f43139b650 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:50.339817 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c06f13a1-99dc-4de5-9d4c-56f43139b650 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:50.427241 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:49:50.435550 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c06f13a1-99dc-4de5-9d4c-56f43139b650 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] 10.222.0.33 "GET /compute/v2.1/servers/f9938964-5f2f-4093-b5cb-967adbe97623/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.182319 Oct 04 20:49:50.441932 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1741/3570] 10.222.0.33 () {58 vars in 1302 bytes} [Tue Oct 4 20:49:50 2022] GET /compute/v2.1/servers/f9938964-5f2f-4093-b5cb-967adbe97623/os-volume_attachments => generated 197 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:49:51.110771 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-fc23967d-0414-405e-a7a7-084b4c0ccacb tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c208ec9faf491385a9ab5b5932098d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ae4960393c464c97669731c2084d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:49:51.124166 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-fc23967d-0414-405e-a7a7-084b4c0ccacb tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] 10.222.0.33 "GET /compute/v2.1/servers/be75ea00-7ffd-4b23-8a70-d16175082cdf" status: 200 len: 1507 microversion: 2.1 time: 1.103759 Oct 04 20:49:51.143871 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1830/3571] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:49:50 2022] GET /compute/v2.1/servers/be75ea00-7ffd-4b23-8a70-d16175082cdf => generated 1507 bytes in 1124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:49:51.278802 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-da0d3537-8865-4c89-8d7b-6d245be7898f tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:49:51.280333 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-da0d3537-8865-4c89-8d7b-6d245be7898f tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: 4d46fff2-b04d-41aa-ada0-2023ab545b48] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:49:51.298637 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-da0d3537-8865-4c89-8d7b-6d245be7898f tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:51.299415 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-da0d3537-8865-4c89-8d7b-6d245be7898f tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:51.303142 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-da0d3537-8865-4c89-8d7b-6d245be7898f tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:51.304100 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-da0d3537-8865-4c89-8d7b-6d245be7898f tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:51.304734 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-da0d3537-8865-4c89-8d7b-6d245be7898f tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:51.305441 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-da0d3537-8865-4c89-8d7b-6d245be7898f tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:51.449067 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-64522913-62ec-4e0f-b35a-59480df3a526 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:49:51.452146 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-64522913-62ec-4e0f-b35a-59480df3a526 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] [instance: f9938964-5f2f-4093-b5cb-967adbe97623] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:49:51.463714 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-64522913-62ec-4e0f-b35a-59480df3a526 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:51.463903 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-64522913-62ec-4e0f-b35a-59480df3a526 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:51.464740 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-64522913-62ec-4e0f-b35a-59480df3a526 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:51.465974 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-64522913-62ec-4e0f-b35a-59480df3a526 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:51.466983 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-64522913-62ec-4e0f-b35a-59480df3a526 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:51.467712 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-64522913-62ec-4e0f-b35a-59480df3a526 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:51.542726 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-64522913-62ec-4e0f-b35a-59480df3a526 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] 10.222.0.33 "GET /compute/v2.1/servers/f9938964-5f2f-4093-b5cb-967adbe97623/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.097426 Oct 04 20:49:51.546329 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1831/3572] 10.222.0.33 () {58 vars in 1302 bytes} [Tue Oct 4 20:49:51 2022] GET /compute/v2.1/servers/f9938964-5f2f-4093-b5cb-967adbe97623/os-volume_attachments => generated 197 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:49:51.878631 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-da0d3537-8865-4c89-8d7b-6d245be7898f tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac650232cc04810b1340dc2f0edadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b0670d1bd99424780a70e69d57a2166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:49:51.894215 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-da0d3537-8865-4c89-8d7b-6d245be7898f tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48" status: 200 len: 1669 microversion: 2.1 time: 0.620922 Oct 04 20:49:51.894864 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1742/3573] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:49:51 2022] GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48 => generated 1669 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:49:52.080944 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-e95f5f37-cff9-4119-a66d-aa8ccf318c1c req-665afd26-203e-480d-aa66-0d84efbbb8b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be75ea00-7ffd-4b23-8a70-d16175082cdf", "name": "network-vif-deleted", "tag": "4f94c735-13c5-41e3-9b88-b2c616a44951"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:49:52.103854 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-e95f5f37-cff9-4119-a66d-aa8ccf318c1c req-665afd26-203e-480d-aa66-0d84efbbb8b8 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:52.104806 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-e95f5f37-cff9-4119-a66d-aa8ccf318c1c req-665afd26-203e-480d-aa66-0d84efbbb8b8 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:52.106096 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-e95f5f37-cff9-4119-a66d-aa8ccf318c1c req-665afd26-203e-480d-aa66-0d84efbbb8b8 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:52.137470 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-e95f5f37-cff9-4119-a66d-aa8ccf318c1c req-665afd26-203e-480d-aa66-0d84efbbb8b8 service nova] Creating event network-vif-deleted:4f94c735-13c5-41e3-9b88-b2c616a44951 for instance be75ea00-7ffd-4b23-8a70-d16175082cdf on n-h1-854823-8 Oct 04 20:49:52.149513 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-805062bd-27f1-4f36-b3e7-6d83ba4ac9eb tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:49:52.150122 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-805062bd-27f1-4f36-b3e7-6d83ba4ac9eb tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] [instance: be75ea00-7ffd-4b23-8a70-d16175082cdf] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:49:52.164443 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-805062bd-27f1-4f36-b3e7-6d83ba4ac9eb tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:52.166124 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-805062bd-27f1-4f36-b3e7-6d83ba4ac9eb tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:52.166707 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-805062bd-27f1-4f36-b3e7-6d83ba4ac9eb tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:52.169278 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-e95f5f37-cff9-4119-a66d-aa8ccf318c1c req-665afd26-203e-480d-aa66-0d84efbbb8b8 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092353 Oct 04 20:49:52.172692 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-805062bd-27f1-4f36-b3e7-6d83ba4ac9eb tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:52.179071 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-805062bd-27f1-4f36-b3e7-6d83ba4ac9eb tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:52.179598 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-805062bd-27f1-4f36-b3e7-6d83ba4ac9eb tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:52.181819 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1832/3574] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:49:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:49:52.318264 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-805062bd-27f1-4f36-b3e7-6d83ba4ac9eb tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c208ec9faf491385a9ab5b5932098d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ae4960393c464c97669731c2084d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:49:52.331039 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-805062bd-27f1-4f36-b3e7-6d83ba4ac9eb tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] 10.222.0.33 "GET /compute/v2.1/servers/be75ea00-7ffd-4b23-8a70-d16175082cdf" status: 200 len: 1299 microversion: 2.1 time: 0.185694 Oct 04 20:49:52.332193 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1743/3575] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:49:52 2022] GET /compute/v2.1/servers/be75ea00-7ffd-4b23-8a70-d16175082cdf => generated 1299 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:49:52.556970 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-6b4d3c6f-46a1-4213-8c17-bb88f2804eeb tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:49:52.559870 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-6b4d3c6f-46a1-4213-8c17-bb88f2804eeb tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] [instance: f9938964-5f2f-4093-b5cb-967adbe97623] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:49:52.578501 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6b4d3c6f-46a1-4213-8c17-bb88f2804eeb tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:52.580621 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6b4d3c6f-46a1-4213-8c17-bb88f2804eeb tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:52.582680 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6b4d3c6f-46a1-4213-8c17-bb88f2804eeb tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:52.584041 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6b4d3c6f-46a1-4213-8c17-bb88f2804eeb tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:52.588645 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6b4d3c6f-46a1-4213-8c17-bb88f2804eeb tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:52.589839 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6b4d3c6f-46a1-4213-8c17-bb88f2804eeb tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:52.664162 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-6b4d3c6f-46a1-4213-8c17-bb88f2804eeb tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] 10.222.0.33 "GET /compute/v2.1/servers/f9938964-5f2f-4093-b5cb-967adbe97623/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.111986 Oct 04 20:49:52.670868 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1833/3576] 10.222.0.33 () {58 vars in 1302 bytes} [Tue Oct 4 20:49:52 2022] GET /compute/v2.1/servers/f9938964-5f2f-4093-b5cb-967adbe97623/os-volume_attachments => generated 197 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:49:53.361246 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-26015238-c87c-4a69-904f-c02a26f6ea1f tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:49:53.361950 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-26015238-c87c-4a69-904f-c02a26f6ea1f tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] [instance: be75ea00-7ffd-4b23-8a70-d16175082cdf] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:49:53.381169 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-26015238-c87c-4a69-904f-c02a26f6ea1f tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:53.382495 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-26015238-c87c-4a69-904f-c02a26f6ea1f tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:53.383128 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-26015238-c87c-4a69-904f-c02a26f6ea1f tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:53.387349 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-26015238-c87c-4a69-904f-c02a26f6ea1f tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:53.389424 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-26015238-c87c-4a69-904f-c02a26f6ea1f tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:53.390133 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-26015238-c87c-4a69-904f-c02a26f6ea1f tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:53.440212 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-26015238-c87c-4a69-904f-c02a26f6ea1f tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] HTTP exception thrown: Instance be75ea00-7ffd-4b23-8a70-d16175082cdf could not be found. Oct 04 20:49:53.445222 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-26015238-c87c-4a69-904f-c02a26f6ea1f tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Request method failure captured: Oct 04 20:49:53.445222 n-d-854823-8 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/be75ea00-7ffd-4b23-8a70-d16175082cdf HTTP/1.1 Oct 04 20:49:53.445222 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:49:53.445222 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:49:53.445222 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:49:53.445222 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 0 Oct 04 20:49:53.445222 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:49:53.445222 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:49:53.445222 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:49:53.445222 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:49:53.445222 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJxSZfevtBVnbE8xQF7FYm_FMbZNMYv-b1P0ldR6C6mOlBxOPHbcbefhyrqwXR1yI98_OYaoilQwhW17vvL2mv1TUMfEjVB0p9Z8xi6fxjKTzjqbSmmUYZRpw0KKdt3nuXH8mFLFoxIXJdxlVC2R9xsCLdqsVxY0fb8-x4eIUN27OLA Oct 04 20:49:53.445222 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:49:53.445222 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:49:53.445222 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:49:53.445222 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:49:53.445222 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:49:53.445222 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:49:53.445222 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: 82ae4960393c464c97669731c2084d0f Oct 04 20:49:53.445222 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-DeleteServersTestJSON-364705212 Oct 04 20:49:53.445222 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 20:49:53.445222 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 20:49:53.445222 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_82ae4960393c464c97669731c2084d0f", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/82ae4960393c464c97669731c2084d0f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/82ae4960393c464c97669731c2084d0f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/82ae4960393c464c97669731c2084d0f"}]}] Oct 04 20:49:53.445222 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-DeleteServersTestJSON-364705212 Oct 04 20:49:53.445222 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: 82ae4960393c464c97669731c2084d0f Oct 04 20:49:53.445222 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-DeleteServersTestJSON-364705212 Oct 04 20:49:53.445222 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-DeleteServersTestJSON-364705212-project Oct 04 20:49:53.445222 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:49:53.445222 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:49:53.445222 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: e2c208ec9faf491385a9ab5b5932098d Oct 04 20:49:53.445222 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-DeleteServersTestJSON-364705212-project Oct 04 20:49:53.445222 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 20:49:53.445222 n-d-854823-8 devstack@n-api.service[128801]: exception: Instance be75ea00-7ffd-4b23-8a70-d16175082cdf could not be found. Oct 04 20:49:53.445222 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': 'be75ea00-7ffd-4b23-8a70-d16175082cdf'} Oct 04 20:49:53.445222 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:49:53.445222 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:49:53.445222 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:49:53.445222 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:49:53.445222 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:49:53.445222 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:49:53.445222 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:49:53.445222 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:49:53.445222 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:49:53.445222 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:49:53.445222 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be75ea00-7ffd-4b23-8a70-d16175082cdf could not be found. Oct 04 20:49:53.445222 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:49:53.445222 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:49:53.445222 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:49:53.445222 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:49:53.445222 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:49:53.445222 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:49:53.445222 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:49:53.445222 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:49:53.445222 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:49:53.445222 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:49:53.445222 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:49:53.445222 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:49:53.445222 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:49:53.445222 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:49:53.445222 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:49:53.445222 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:49:53.445222 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be75ea00-7ffd-4b23-8a70-d16175082cdf could not be found. Oct 04 20:49:53.445222 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:49:53.445222 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:49:53.445222 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:49:53.451383 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:49:53.451383 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:49:53.451383 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:49:53.451383 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:49:53.451383 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:49:53.451383 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be75ea00-7ffd-4b23-8a70-d16175082cdf could not be found. Oct 04 20:49:53.451383 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:49:53.457480 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-26015238-c87c-4a69-904f-c02a26f6ea1f tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Returning 404 to user: Instance be75ea00-7ffd-4b23-8a70-d16175082cdf could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:49:53.461835 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-26015238-c87c-4a69-904f-c02a26f6ea1f tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] 10.222.0.33 "GET /compute/v2.1/servers/be75ea00-7ffd-4b23-8a70-d16175082cdf" status: 404 len: 111 microversion: 2.1 time: 0.108202 Oct 04 20:49:53.466307 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1744/3577] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:49:53 2022] GET /compute/v2.1/servers/be75ea00-7ffd-4b23-8a70-d16175082cdf => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:49:53.684433 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-56c5ec83-9a62-4285-b9e9-3037915bbc0c tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:49:53.687359 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-56c5ec83-9a62-4285-b9e9-3037915bbc0c tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] [instance: f9938964-5f2f-4093-b5cb-967adbe97623] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:49:53.708476 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-56c5ec83-9a62-4285-b9e9-3037915bbc0c tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:53.709524 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-56c5ec83-9a62-4285-b9e9-3037915bbc0c tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:53.716627 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-cf0017ee-c433-4632-bbb1-7d2516e6e51e tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-655761883", "imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63", "flavorRef": "452", "networks": [{"uuid": "9dbf9434-4e8d-415e-bc95-1f3c19f28f1d"}]}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:49:53.728025 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-56c5ec83-9a62-4285-b9e9-3037915bbc0c tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:53.736735 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-56c5ec83-9a62-4285-b9e9-3037915bbc0c tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:53.739704 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-56c5ec83-9a62-4285-b9e9-3037915bbc0c tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:53.740679 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-56c5ec83-9a62-4285-b9e9-3037915bbc0c tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:53.889587 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.network.neutron [None req-cf0017ee-c433-4632-bbb1-7d2516e6e51e tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] validate_networks() for [('9dbf9434-4e8d-415e-bc95-1f3c19f28f1d', None, None, None, None, None)] {{(pid=128801) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:49:53.930090 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-56c5ec83-9a62-4285-b9e9-3037915bbc0c tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] 10.222.0.33 "GET /compute/v2.1/servers/f9938964-5f2f-4093-b5cb-967adbe97623/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.247622 Oct 04 20:49:53.935826 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1834/3578] 10.222.0.33 () {58 vars in 1302 bytes} [Tue Oct 4 20:49:53 2022] GET /compute/v2.1/servers/f9938964-5f2f-4093-b5cb-967adbe97623/os-volume_attachments => generated 197 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:49:54.945667 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-a253ff04-223a-4a75-9559-787307fe03ae tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:49:54.948254 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-a253ff04-223a-4a75-9559-787307fe03ae tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] [instance: f9938964-5f2f-4093-b5cb-967adbe97623] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:49:54.962325 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a253ff04-223a-4a75-9559-787307fe03ae tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:54.963201 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a253ff04-223a-4a75-9559-787307fe03ae tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:54.963865 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a253ff04-223a-4a75-9559-787307fe03ae tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:54.965177 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a253ff04-223a-4a75-9559-787307fe03ae tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:54.965871 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a253ff04-223a-4a75-9559-787307fe03ae tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:54.966564 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a253ff04-223a-4a75-9559-787307fe03ae tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:55.084827 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-a253ff04-223a-4a75-9559-787307fe03ae tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] 10.222.0.33 "GET /compute/v2.1/servers/f9938964-5f2f-4093-b5cb-967adbe97623/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.144117 Oct 04 20:49:55.092600 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1835/3579] 10.222.0.33 () {58 vars in 1302 bytes} [Tue Oct 4 20:49:54 2022] GET /compute/v2.1/servers/f9938964-5f2f-4093-b5cb-967adbe97623/os-volume_attachments => generated 197 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 20:49:55.592721 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-cf0017ee-c433-4632-bbb1-7d2516e6e51e tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Flavor limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:49:55.593653 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-cf0017ee-c433-4632-bbb1-7d2516e6e51e tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Image limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:49:55.594364 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-cf0017ee-c433-4632-bbb1-7d2516e6e51e tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Flavor pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:49:55.594819 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-cf0017ee-c433-4632-bbb1-7d2516e6e51e tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Image pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:49:55.595403 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-cf0017ee-c433-4632-bbb1-7d2516e6e51e tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:49:55.597461 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:49:55.626598 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cf0017ee-c433-4632-bbb1-7d2516e6e51e tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:55.628041 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cf0017ee-c433-4632-bbb1-7d2516e6e51e tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:55.628567 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cf0017ee-c433-4632-bbb1-7d2516e6e51e tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:55.630084 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cf0017ee-c433-4632-bbb1-7d2516e6e51e tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:55.631452 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cf0017ee-c433-4632-bbb1-7d2516e6e51e tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:55.633381 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cf0017ee-c433-4632-bbb1-7d2516e6e51e tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:55.657956 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-cf0017ee-c433-4632-bbb1-7d2516e6e51e tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Getting quotas for project 82ae4960393c464c97669731c2084d0f. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:49:55.665931 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-cf0017ee-c433-4632-bbb1-7d2516e6e51e tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Getting quotas for user e2c208ec9faf491385a9ab5b5932098d and project 82ae4960393c464c97669731c2084d0f. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:49:55.682680 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-cf0017ee-c433-4632-bbb1-7d2516e6e51e tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Going to run 1 instances... {{(pid=128801) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:49:55.685407 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-cf0017ee-c433-4632-bbb1-7d2516e6e51e tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] [instance: 917274da-5116-42df-84b5-a30b85d40913] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='15b24725-0c99-4bcf-b1fb-907cdf8e2d63',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128801) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:49:55.760325 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-cf0017ee-c433-4632-bbb1-7d2516e6e51e tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.048602 Oct 04 20:49:55.761579 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1745/3580] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 20:49:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 2051 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 20:49:55.773831 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-4c2f7ed6-1b89-430b-b4ba-c65b0d6451a4 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:49:55.774792 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-4c2f7ed6-1b89-430b-b4ba-c65b0d6451a4 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] [instance: 917274da-5116-42df-84b5-a30b85d40913] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:49:55.924022 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-4c2f7ed6-1b89-430b-b4ba-c65b0d6451a4 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c208ec9faf491385a9ab5b5932098d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ae4960393c464c97669731c2084d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:49:55.947452 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-4c2f7ed6-1b89-430b-b4ba-c65b0d6451a4 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] 10.222.0.33 "GET /compute/v2.1/servers/917274da-5116-42df-84b5-a30b85d40913" status: 200 len: 1214 microversion: 2.1 time: 0.177556 Oct 04 20:49:55.951895 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1836/3581] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:49:55 2022] GET /compute/v2.1/servers/917274da-5116-42df-84b5-a30b85d40913 => generated 1214 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:49:56.098699 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-c6025138-f6a4-4481-940e-b329d6c603f6 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:49:56.101113 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-c6025138-f6a4-4481-940e-b329d6c603f6 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] [instance: f9938964-5f2f-4093-b5cb-967adbe97623] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:49:56.108760 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c6025138-f6a4-4481-940e-b329d6c603f6 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:56.109248 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c6025138-f6a4-4481-940e-b329d6c603f6 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:56.109787 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c6025138-f6a4-4481-940e-b329d6c603f6 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:56.110499 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c6025138-f6a4-4481-940e-b329d6c603f6 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:56.110958 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c6025138-f6a4-4481-940e-b329d6c603f6 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:56.111388 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c6025138-f6a4-4481-940e-b329d6c603f6 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:56.214181 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-c6025138-f6a4-4481-940e-b329d6c603f6 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] 10.222.0.33 "GET /compute/v2.1/servers/f9938964-5f2f-4093-b5cb-967adbe97623/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.107770 Oct 04 20:49:56.215425 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1837/3582] 10.222.0.33 () {58 vars in 1302 bytes} [Tue Oct 4 20:49:56 2022] GET /compute/v2.1/servers/f9938964-5f2f-4093-b5cb-967adbe97623/os-volume_attachments => generated 197 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 20:49:56.420277 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-12fd2fc6-0c08-4b28-9d79-ac25b0fa0a1b tempest-ServerGroup264TestJSON-1174245320 tempest-ServerGroup264TestJSON-1174245320-project] Action: 'create', calling method: .version_select at 0x7f3c6f534790>, body: {"server_group": {"name": "server-group", "policy": "affinity"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:49:56.471578 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-12fd2fc6-0c08-4b28-9d79-ac25b0fa0a1b tempest-ServerGroup264TestJSON-1174245320 tempest-ServerGroup264TestJSON-1174245320-project] Getting quotas for project bb8c25dd851547308477f4bff26c47fe. Resources: {'server_groups'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:49:56.479260 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-12fd2fc6-0c08-4b28-9d79-ac25b0fa0a1b tempest-ServerGroup264TestJSON-1174245320 tempest-ServerGroup264TestJSON-1174245320-project] Getting quotas for user f5330edc326749dc96604ddddbaad2fe and project bb8c25dd851547308477f4bff26c47fe. Resources: {'server_groups'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:49:56.561444 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-12fd2fc6-0c08-4b28-9d79-ac25b0fa0a1b tempest-ServerGroup264TestJSON-1174245320 tempest-ServerGroup264TestJSON-1174245320-project] Getting quotas for project bb8c25dd851547308477f4bff26c47fe. Resources: {'server_groups'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:49:56.569095 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-12fd2fc6-0c08-4b28-9d79-ac25b0fa0a1b tempest-ServerGroup264TestJSON-1174245320 tempest-ServerGroup264TestJSON-1174245320-project] Getting quotas for user f5330edc326749dc96604ddddbaad2fe and project bb8c25dd851547308477f4bff26c47fe. Resources: {'server_groups'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:49:56.586627 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-12fd2fc6-0c08-4b28-9d79-ac25b0fa0a1b tempest-ServerGroup264TestJSON-1174245320 tempest-ServerGroup264TestJSON-1174245320-project] 10.222.0.33 "POST /compute/v2.1/os-server-groups" status: 200 len: 235 microversion: 2.64 time: 0.783787 Oct 04 20:49:56.587912 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1746/3583] 10.222.0.33 () {62 vars in 1214 bytes} [Tue Oct 4 20:49:55 2022] POST /compute/v2.1/os-server-groups => generated 235 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 04 20:49:56.600143 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-f9f7a746-a144-4c23-b8d9-6e5d16bbde74 tempest-ServerGroup264TestJSON-1174245320 tempest-ServerGroup264TestJSON-1174245320-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:49:56.642177 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-f9f7a746-a144-4c23-b8d9-6e5d16bbde74 tempest-ServerGroup264TestJSON-1174245320 tempest-ServerGroup264TestJSON-1174245320-project] 10.222.0.33 "GET /compute/v2.1/os-server-groups" status: 200 len: 238 microversion: 2.64 time: 0.046058 Oct 04 20:49:56.652449 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1838/3584] 10.222.0.33 () {60 vars in 1193 bytes} [Tue Oct 4 20:49:56 2022] GET /compute/v2.1/os-server-groups => generated 238 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 20:49:56.658038 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e10bbdb9-5647-47c3-a026-6f88e30178fe tempest-ServerGroup264TestJSON-1174245320 tempest-ServerGroup264TestJSON-1174245320-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:49:56.676331 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e10bbdb9-5647-47c3-a026-6f88e30178fe tempest-ServerGroup264TestJSON-1174245320 tempest-ServerGroup264TestJSON-1174245320-project] 10.222.0.33 "GET /compute/v2.1/os-server-groups/3b7b8f9e-1714-469c-9fc8-5d43650d9fb1" status: 200 len: 235 microversion: 2.64 time: 0.025913 Oct 04 20:49:56.720416 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1747/3585] 10.222.0.33 () {60 vars in 1304 bytes} [Tue Oct 4 20:49:56 2022] GET /compute/v2.1/os-server-groups/3b7b8f9e-1714-469c-9fc8-5d43650d9fb1 => generated 235 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 20:49:56.732257 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-0b545c52-70f0-439f-8c83-afd7ef70d0ee tempest-ServerGroup264TestJSON-1174245320 tempest-ServerGroup264TestJSON-1174245320-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:49:56.783731 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-0b545c52-70f0-439f-8c83-afd7ef70d0ee tempest-ServerGroup264TestJSON-1174245320 tempest-ServerGroup264TestJSON-1174245320-project] 10.222.0.33 "DELETE /compute/v2.1/os-server-groups/3b7b8f9e-1714-469c-9fc8-5d43650d9fb1" status: 204 len: 0 microversion: 2.64 time: 0.052300 Oct 04 20:49:56.808178 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b2eab39b-033d-494b-bc6f-29861467fe4b tempest-ServerGroup264TestJSON-1174245320 tempest-ServerGroup264TestJSON-1174245320-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:49:56.811963 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1839/3586] 10.222.0.33 () {60 vars in 1307 bytes} [Tue Oct 4 20:49:56 2022] DELETE /compute/v2.1/os-server-groups/3b7b8f9e-1714-469c-9fc8-5d43650d9fb1 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 20:49:56.817943 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-b2eab39b-033d-494b-bc6f-29861467fe4b tempest-ServerGroup264TestJSON-1174245320 tempest-ServerGroup264TestJSON-1174245320-project] HTTP exception thrown: Instance group 3b7b8f9e-1714-469c-9fc8-5d43650d9fb1 could not be found. Oct 04 20:49:56.831380 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b2eab39b-033d-494b-bc6f-29861467fe4b tempest-ServerGroup264TestJSON-1174245320 tempest-ServerGroup264TestJSON-1174245320-project] Request method failure captured: Oct 04 20:49:56.831380 n-d-854823-8 devstack@n-api.service[128801]: request: DELETE /compute/v2.1/os-server-groups/3b7b8f9e-1714-469c-9fc8-5d43650d9fb1 HTTP/1.1 Oct 04 20:49:56.831380 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:49:56.831380 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:49:56.831380 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:49:56.831380 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 0 Oct 04 20:49:56.831380 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:49:56.831380 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:49:56.831380 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:49:56.831380 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:49:56.831380 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJxziACQyCMFiNV1Dqa3Qf9HqqF2ME8pmgXpvq1MUBA544dARHQWn6iqQXGhlmDYJV1FcckOBm_0NkK23pscLHHDxK-ygofTBvxWhrbb_O1rsVOWgkdisqSd7QHY9oYvUnrtPWxw0q1p6dw3o_MpvklKfqYfv93yB0olZAtWQJItCuU Oct 04 20:49:56.831380 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:49:56.831380 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:49:56.831380 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:49:56.831380 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:49:56.831380 n-d-854823-8 devstack@n-api.service[128801]: X-Openstack-Nova-Api-Version: 2.64 Oct 04 20:49:56.831380 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:49:56.831380 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:49:56.831380 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: bb8c25dd851547308477f4bff26c47fe Oct 04 20:49:56.831380 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-ServerGroup264TestJSON-1174245320 Oct 04 20:49:56.831380 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 20:49:56.831380 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 20:49:56.831380 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_bb8c25dd851547308477f4bff26c47fe", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bb8c25dd851547308477f4bff26c47fe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bb8c25dd851547308477f4bff26c47fe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/bb8c25dd851547308477f4bff26c47fe"}]}] Oct 04 20:49:56.831380 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-ServerGroup264TestJSON-1174245320 Oct 04 20:49:56.831380 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: bb8c25dd851547308477f4bff26c47fe Oct 04 20:49:56.831380 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ServerGroup264TestJSON-1174245320 Oct 04 20:49:56.831380 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-ServerGroup264TestJSON-1174245320-project Oct 04 20:49:56.831380 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:49:56.831380 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:49:56.831380 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: f5330edc326749dc96604ddddbaad2fe Oct 04 20:49:56.831380 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-ServerGroup264TestJSON-1174245320-project Oct 04 20:49:56.831380 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 20:49:56.831380 n-d-854823-8 devstack@n-api.service[128801]: exception: Instance group 3b7b8f9e-1714-469c-9fc8-5d43650d9fb1 could not be found. Oct 04 20:49:56.831380 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': '3b7b8f9e-1714-469c-9fc8-5d43650d9fb1'} Oct 04 20:49:56.831380 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:49:56.831380 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:49:56.831380 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 04 20:49:56.831380 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 04 20:49:56.831380 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 20:49:56.831380 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 20:49:56.831380 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 04 20:49:56.831380 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 04 20:49:56.831380 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 20:49:56.831380 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 20:49:56.831380 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 04 20:49:56.831380 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 04 20:49:56.831380 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 3b7b8f9e-1714-469c-9fc8-5d43650d9fb1 could not be found. Oct 04 20:49:56.831380 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:49:56.831380 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:49:56.831380 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:49:56.831380 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:49:56.831380 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:49:56.831380 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:49:56.831380 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:49:56.831380 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:49:56.831380 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:49:56.831380 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:49:56.831380 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 04 20:49:56.831380 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:49:56.831380 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 3b7b8f9e-1714-469c-9fc8-5d43650d9fb1 could not be found. Oct 04 20:49:56.831380 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:49:56.831380 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:49:56.831380 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:49:56.831380 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:49:56.838760 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:49:56.838760 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:49:56.838760 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:49:56.838760 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:49:56.838760 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 3b7b8f9e-1714-469c-9fc8-5d43650d9fb1 could not be found. Oct 04 20:49:56.838760 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:49:56.838760 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b2eab39b-033d-494b-bc6f-29861467fe4b tempest-ServerGroup264TestJSON-1174245320 tempest-ServerGroup264TestJSON-1174245320-project] Returning 404 to user: Instance group 3b7b8f9e-1714-469c-9fc8-5d43650d9fb1 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:49:56.838760 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b2eab39b-033d-494b-bc6f-29861467fe4b tempest-ServerGroup264TestJSON-1174245320 tempest-ServerGroup264TestJSON-1174245320-project] 10.222.0.33 "DELETE /compute/v2.1/os-server-groups/3b7b8f9e-1714-469c-9fc8-5d43650d9fb1" status: 404 len: 117 microversion: 2.64 time: 0.041585 Oct 04 20:49:56.838760 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1748/3587] 10.222.0.33 () {60 vars in 1307 bytes} [Tue Oct 4 20:49:56 2022] DELETE /compute/v2.1/os-server-groups/3b7b8f9e-1714-469c-9fc8-5d43650d9fb1 => generated 117 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 20:49:56.977010 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-13bc4ffd-9a31-4341-a2af-ce64299426a2 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:49:56.977631 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-13bc4ffd-9a31-4341-a2af-ce64299426a2 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] [instance: 917274da-5116-42df-84b5-a30b85d40913] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:49:56.990497 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-13bc4ffd-9a31-4341-a2af-ce64299426a2 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:56.991006 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-13bc4ffd-9a31-4341-a2af-ce64299426a2 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:56.991445 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-13bc4ffd-9a31-4341-a2af-ce64299426a2 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:56.992160 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-13bc4ffd-9a31-4341-a2af-ce64299426a2 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:56.992657 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-13bc4ffd-9a31-4341-a2af-ce64299426a2 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:56.993024 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-13bc4ffd-9a31-4341-a2af-ce64299426a2 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:57.229506 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-bfa08d16-92bb-455a-828e-0a07a84c3400 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:49:57.230918 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-13bc4ffd-9a31-4341-a2af-ce64299426a2 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c208ec9faf491385a9ab5b5932098d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ae4960393c464c97669731c2084d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:49:57.235476 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-bfa08d16-92bb-455a-828e-0a07a84c3400 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] [instance: f9938964-5f2f-4093-b5cb-967adbe97623] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:49:57.249488 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-13bc4ffd-9a31-4341-a2af-ce64299426a2 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] 10.222.0.33 "GET /compute/v2.1/servers/917274da-5116-42df-84b5-a30b85d40913" status: 200 len: 1210 microversion: 2.1 time: 0.275174 Oct 04 20:49:57.262137 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1840/3588] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:49:56 2022] GET /compute/v2.1/servers/917274da-5116-42df-84b5-a30b85d40913 => generated 1210 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:49:57.273181 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bfa08d16-92bb-455a-828e-0a07a84c3400 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:57.273759 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bfa08d16-92bb-455a-828e-0a07a84c3400 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:57.274244 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bfa08d16-92bb-455a-828e-0a07a84c3400 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:57.275067 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bfa08d16-92bb-455a-828e-0a07a84c3400 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:57.275533 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bfa08d16-92bb-455a-828e-0a07a84c3400 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:57.287133 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bfa08d16-92bb-455a-828e-0a07a84c3400 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:57.385456 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-bfa08d16-92bb-455a-828e-0a07a84c3400 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] 10.222.0.33 "GET /compute/v2.1/servers/f9938964-5f2f-4093-b5cb-967adbe97623/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.161662 Oct 04 20:49:57.387095 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1749/3589] 10.222.0.33 () {58 vars in 1302 bytes} [Tue Oct 4 20:49:57 2022] GET /compute/v2.1/servers/f9938964-5f2f-4093-b5cb-967adbe97623/os-volume_attachments => generated 197 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 20:49:58.283837 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-87fe3027-8e2a-48c0-9b68-bc0dfbca3d1e tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:49:58.285393 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-87fe3027-8e2a-48c0-9b68-bc0dfbca3d1e tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] [instance: 917274da-5116-42df-84b5-a30b85d40913] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:49:58.297610 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-87fe3027-8e2a-48c0-9b68-bc0dfbca3d1e tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:58.298734 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-87fe3027-8e2a-48c0-9b68-bc0dfbca3d1e tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:58.299561 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-87fe3027-8e2a-48c0-9b68-bc0dfbca3d1e tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:58.303410 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-87fe3027-8e2a-48c0-9b68-bc0dfbca3d1e tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:58.304404 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-87fe3027-8e2a-48c0-9b68-bc0dfbca3d1e tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:58.305520 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-87fe3027-8e2a-48c0-9b68-bc0dfbca3d1e tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:58.399726 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-355a6eaa-4daa-4827-be22-28511cc6db83 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:49:58.403649 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-355a6eaa-4daa-4827-be22-28511cc6db83 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] [instance: f9938964-5f2f-4093-b5cb-967adbe97623] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:49:58.426733 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-355a6eaa-4daa-4827-be22-28511cc6db83 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:58.427318 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-355a6eaa-4daa-4827-be22-28511cc6db83 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:58.427895 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-355a6eaa-4daa-4827-be22-28511cc6db83 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:58.430440 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-355a6eaa-4daa-4827-be22-28511cc6db83 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:58.430987 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-355a6eaa-4daa-4827-be22-28511cc6db83 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:58.431421 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-355a6eaa-4daa-4827-be22-28511cc6db83 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:58.546849 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-355a6eaa-4daa-4827-be22-28511cc6db83 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] 10.222.0.33 "GET /compute/v2.1/servers/f9938964-5f2f-4093-b5cb-967adbe97623/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.150111 Oct 04 20:49:58.554432 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1750/3590] 10.222.0.33 () {58 vars in 1302 bytes} [Tue Oct 4 20:49:58 2022] GET /compute/v2.1/servers/f9938964-5f2f-4093-b5cb-967adbe97623/os-volume_attachments => generated 25 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 20:49:58.595144 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-87fe3027-8e2a-48c0-9b68-bc0dfbca3d1e tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c208ec9faf491385a9ab5b5932098d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ae4960393c464c97669731c2084d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:49:58.609283 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-87fe3027-8e2a-48c0-9b68-bc0dfbca3d1e tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] 10.222.0.33 "GET /compute/v2.1/servers/917274da-5116-42df-84b5-a30b85d40913" status: 200 len: 1272 microversion: 2.1 time: 0.329227 Oct 04 20:49:58.638832 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1841/3591] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:49:58 2022] GET /compute/v2.1/servers/917274da-5116-42df-84b5-a30b85d40913 => generated 1272 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:49:58.796455 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c47f97f7-a8b2-4949-a539-645bcddfd91d tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:49:58.796989 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c47f97f7-a8b2-4949-a539-645bcddfd91d tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] [instance: f9938964-5f2f-4093-b5cb-967adbe97623] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:49:58.807843 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c47f97f7-a8b2-4949-a539-645bcddfd91d tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:58.808270 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c47f97f7-a8b2-4949-a539-645bcddfd91d tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:58.809043 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c47f97f7-a8b2-4949-a539-645bcddfd91d tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:58.812999 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c47f97f7-a8b2-4949-a539-645bcddfd91d tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:58.817999 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c47f97f7-a8b2-4949-a539-645bcddfd91d tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:58.824019 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c47f97f7-a8b2-4949-a539-645bcddfd91d tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:58.862416 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c47f97f7-a8b2-4949-a539-645bcddfd91d tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] [instance: f9938964-5f2f-4093-b5cb-967adbe97623] Going to try to terminate instance {{(pid=128801) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:49:59.009842 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c47f97f7-a8b2-4949-a539-645bcddfd91d tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] 10.222.0.33 "DELETE /compute/v2.1/servers/f9938964-5f2f-4093-b5cb-967adbe97623" status: 204 len: 0 microversion: 2.1 time: 0.216956 Oct 04 20:49:59.014510 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1751/3592] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 20:49:58 2022] DELETE /compute/v2.1/servers/f9938964-5f2f-4093-b5cb-967adbe97623 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:49:59.023496 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-fea05eb8-2479-401c-ac63-e047d68f6cbf tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:49:59.024943 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-fea05eb8-2479-401c-ac63-e047d68f6cbf tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] [instance: f9938964-5f2f-4093-b5cb-967adbe97623] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:49:59.041996 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fea05eb8-2479-401c-ac63-e047d68f6cbf tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:59.043354 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fea05eb8-2479-401c-ac63-e047d68f6cbf tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:59.043975 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fea05eb8-2479-401c-ac63-e047d68f6cbf tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:59.046261 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fea05eb8-2479-401c-ac63-e047d68f6cbf tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:59.047000 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fea05eb8-2479-401c-ac63-e047d68f6cbf tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:59.050663 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fea05eb8-2479-401c-ac63-e047d68f6cbf tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:59.651377 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-747ca39e-3d8f-4cfd-a8e7-f13cddcfa5e7 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:49:59.653420 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-747ca39e-3d8f-4cfd-a8e7-f13cddcfa5e7 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] [instance: 917274da-5116-42df-84b5-a30b85d40913] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:49:59.687636 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-747ca39e-3d8f-4cfd-a8e7-f13cddcfa5e7 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:59.692278 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-747ca39e-3d8f-4cfd-a8e7-f13cddcfa5e7 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:59.696690 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-747ca39e-3d8f-4cfd-a8e7-f13cddcfa5e7 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:49:59.697808 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-747ca39e-3d8f-4cfd-a8e7-f13cddcfa5e7 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:49:59.702156 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-747ca39e-3d8f-4cfd-a8e7-f13cddcfa5e7 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:49:59.703180 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-747ca39e-3d8f-4cfd-a8e7-f13cddcfa5e7 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:00.062209 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-fea05eb8-2479-401c-ac63-e047d68f6cbf tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e4b00964014a0383f79597652bd428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7f38600b5041ad8e66a12d77b940fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:50:00.082862 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-747ca39e-3d8f-4cfd-a8e7-f13cddcfa5e7 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c208ec9faf491385a9ab5b5932098d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ae4960393c464c97669731c2084d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:50:00.083163 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-fea05eb8-2479-401c-ac63-e047d68f6cbf tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] 10.222.0.33 "GET /compute/v2.1/servers/f9938964-5f2f-4093-b5cb-967adbe97623" status: 200 len: 1682 microversion: 2.1 time: 1.064570 Oct 04 20:50:00.087733 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1842/3593] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:49:59 2022] GET /compute/v2.1/servers/f9938964-5f2f-4093-b5cb-967adbe97623 => generated 1682 bytes in 1070 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:50:00.119924 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-747ca39e-3d8f-4cfd-a8e7-f13cddcfa5e7 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] 10.222.0.33 "GET /compute/v2.1/servers/917274da-5116-42df-84b5-a30b85d40913" status: 200 len: 1272 microversion: 2.1 time: 0.481732 Oct 04 20:50:00.123299 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1752/3594] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:49:59 2022] GET /compute/v2.1/servers/917274da-5116-42df-84b5-a30b85d40913 => generated 1272 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:50:01.121799 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-b1ce85dd-f2de-41fc-82b7-ade18cd9ff1d tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:01.124551 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-b1ce85dd-f2de-41fc-82b7-ade18cd9ff1d tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] [instance: f9938964-5f2f-4093-b5cb-967adbe97623] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:50:01.151818 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ce2df8fe-8044-4a8f-b76c-e3ad8b258d6d tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:01.152436 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ce2df8fe-8044-4a8f-b76c-e3ad8b258d6d tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] [instance: 917274da-5116-42df-84b5-a30b85d40913] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:50:01.155012 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b1ce85dd-f2de-41fc-82b7-ade18cd9ff1d tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:01.158285 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b1ce85dd-f2de-41fc-82b7-ade18cd9ff1d tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:01.161506 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b1ce85dd-f2de-41fc-82b7-ade18cd9ff1d tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:01.168353 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b1ce85dd-f2de-41fc-82b7-ade18cd9ff1d tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:01.168876 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b1ce85dd-f2de-41fc-82b7-ade18cd9ff1d tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:01.172361 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b1ce85dd-f2de-41fc-82b7-ade18cd9ff1d tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:01.176372 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ce2df8fe-8044-4a8f-b76c-e3ad8b258d6d tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:01.181359 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ce2df8fe-8044-4a8f-b76c-e3ad8b258d6d tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:01.182447 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ce2df8fe-8044-4a8f-b76c-e3ad8b258d6d tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:01.183556 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ce2df8fe-8044-4a8f-b76c-e3ad8b258d6d tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:01.193503 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ce2df8fe-8044-4a8f-b76c-e3ad8b258d6d tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:01.195266 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ce2df8fe-8044-4a8f-b76c-e3ad8b258d6d tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:02.255907 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-ce2df8fe-8044-4a8f-b76c-e3ad8b258d6d tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c208ec9faf491385a9ab5b5932098d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ae4960393c464c97669731c2084d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:50:02.269814 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ce2df8fe-8044-4a8f-b76c-e3ad8b258d6d tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] 10.222.0.33 "GET /compute/v2.1/servers/917274da-5116-42df-84b5-a30b85d40913" status: 200 len: 1314 microversion: 2.1 time: 1.119907 Oct 04 20:50:02.286087 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1753/3595] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:50:01 2022] GET /compute/v2.1/servers/917274da-5116-42df-84b5-a30b85d40913 => generated 1314 bytes in 1123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:50:02.286364 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-b1ce85dd-f2de-41fc-82b7-ade18cd9ff1d tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e4b00964014a0383f79597652bd428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7f38600b5041ad8e66a12d77b940fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:50:02.294927 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-b1ce85dd-f2de-41fc-82b7-ade18cd9ff1d tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] 10.222.0.33 "GET /compute/v2.1/servers/f9938964-5f2f-4093-b5cb-967adbe97623" status: 200 len: 1682 microversion: 2.1 time: 1.184461 Oct 04 20:50:02.298686 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1843/3596] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:50:01 2022] GET /compute/v2.1/servers/f9938964-5f2f-4093-b5cb-967adbe97623 => generated 1682 bytes in 1190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:50:03.296280 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-81f30198-6c42-4c17-ab25-3464bb3ea8c5 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:03.297949 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-81f30198-6c42-4c17-ab25-3464bb3ea8c5 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] [instance: 917274da-5116-42df-84b5-a30b85d40913] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:50:03.318149 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-81f30198-6c42-4c17-ab25-3464bb3ea8c5 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:03.320336 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-81f30198-6c42-4c17-ab25-3464bb3ea8c5 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:03.321985 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-81f30198-6c42-4c17-ab25-3464bb3ea8c5 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:03.323811 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-81f30198-6c42-4c17-ab25-3464bb3ea8c5 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:03.325297 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-81f30198-6c42-4c17-ab25-3464bb3ea8c5 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:03.326935 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-81f30198-6c42-4c17-ab25-3464bb3ea8c5 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:03.334120 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-32a54904-7863-4998-bb52-5b33f5354e44 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:03.335167 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-32a54904-7863-4998-bb52-5b33f5354e44 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] [instance: f9938964-5f2f-4093-b5cb-967adbe97623] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:50:03.360094 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-32a54904-7863-4998-bb52-5b33f5354e44 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:03.360792 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-32a54904-7863-4998-bb52-5b33f5354e44 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:03.361332 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-32a54904-7863-4998-bb52-5b33f5354e44 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:03.363316 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-32a54904-7863-4998-bb52-5b33f5354e44 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:03.365343 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-32a54904-7863-4998-bb52-5b33f5354e44 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:03.366743 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-32a54904-7863-4998-bb52-5b33f5354e44 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:03.660836 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-32a54904-7863-4998-bb52-5b33f5354e44 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e4b00964014a0383f79597652bd428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7f38600b5041ad8e66a12d77b940fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:50:03.679018 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-32a54904-7863-4998-bb52-5b33f5354e44 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] 10.222.0.33 "GET /compute/v2.1/servers/f9938964-5f2f-4093-b5cb-967adbe97623" status: 200 len: 1614 microversion: 2.1 time: 0.357209 Oct 04 20:50:03.680965 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1844/3597] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:50:03 2022] GET /compute/v2.1/servers/f9938964-5f2f-4093-b5cb-967adbe97623 => generated 1614 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:50:03.989786 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-81f30198-6c42-4c17-ab25-3464bb3ea8c5 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c208ec9faf491385a9ab5b5932098d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ae4960393c464c97669731c2084d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:50:03.997633 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-81f30198-6c42-4c17-ab25-3464bb3ea8c5 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] 10.222.0.33 "GET /compute/v2.1/servers/917274da-5116-42df-84b5-a30b85d40913" status: 200 len: 1314 microversion: 2.1 time: 0.708418 Oct 04 20:50:03.998224 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1754/3598] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:50:03 2022] GET /compute/v2.1/servers/917274da-5116-42df-84b5-a30b85d40913 => generated 1314 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:50:04.714731 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-665fc4d6-d09d-4e4a-8a4b-281d18850a64 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:04.715831 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-665fc4d6-d09d-4e4a-8a4b-281d18850a64 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] [instance: f9938964-5f2f-4093-b5cb-967adbe97623] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:50:04.720930 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_api:SELECT=53,nova_api:DELETE=3 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:50:04.745634 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-665fc4d6-d09d-4e4a-8a4b-281d18850a64 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:04.746146 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-665fc4d6-d09d-4e4a-8a4b-281d18850a64 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:04.746619 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-665fc4d6-d09d-4e4a-8a4b-281d18850a64 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:04.747330 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-665fc4d6-d09d-4e4a-8a4b-281d18850a64 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:04.772840 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-665fc4d6-d09d-4e4a-8a4b-281d18850a64 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:04.773806 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-665fc4d6-d09d-4e4a-8a4b-281d18850a64 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:04.811000 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-90e8f34a-6bb6-45ff-8432-9d61b5236c70 req-926e410e-83a6-4385-b663-62d0680e192b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9938964-5f2f-4093-b5cb-967adbe97623", "name": "network-vif-deleted", "tag": "61e69e8f-66c4-464b-815e-298b89835c1f"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:50:04.811702 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:50:04.847060 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-90e8f34a-6bb6-45ff-8432-9d61b5236c70 req-926e410e-83a6-4385-b663-62d0680e192b service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:04.851087 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-90e8f34a-6bb6-45ff-8432-9d61b5236c70 req-926e410e-83a6-4385-b663-62d0680e192b service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:04.853365 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-90e8f34a-6bb6-45ff-8432-9d61b5236c70 req-926e410e-83a6-4385-b663-62d0680e192b service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:04.926884 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-90e8f34a-6bb6-45ff-8432-9d61b5236c70 req-926e410e-83a6-4385-b663-62d0680e192b service nova] Creating event network-vif-deleted:61e69e8f-66c4-464b-815e-298b89835c1f for instance f9938964-5f2f-4093-b5cb-967adbe97623 on n-h2-854823-8 Oct 04 20:50:04.951109 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-90e8f34a-6bb6-45ff-8432-9d61b5236c70 req-926e410e-83a6-4385-b663-62d0680e192b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.145689 Oct 04 20:50:04.957759 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1755/3599] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:50:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Oct 04 20:50:05.029800 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-4693b29b-fc86-436c-87ae-fe291148e1e5 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:05.030723 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-4693b29b-fc86-436c-87ae-fe291148e1e5 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] [instance: 917274da-5116-42df-84b5-a30b85d40913] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:50:05.041984 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4693b29b-fc86-436c-87ae-fe291148e1e5 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:05.058523 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4693b29b-fc86-436c-87ae-fe291148e1e5 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:05.060679 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4693b29b-fc86-436c-87ae-fe291148e1e5 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:05.061556 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4693b29b-fc86-436c-87ae-fe291148e1e5 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:05.063615 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4693b29b-fc86-436c-87ae-fe291148e1e5 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:05.064319 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4693b29b-fc86-436c-87ae-fe291148e1e5 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:05.341786 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-665fc4d6-d09d-4e4a-8a4b-281d18850a64 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e4b00964014a0383f79597652bd428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7f38600b5041ad8e66a12d77b940fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:50:05.368678 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-665fc4d6-d09d-4e4a-8a4b-281d18850a64 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] 10.222.0.33 "GET /compute/v2.1/servers/f9938964-5f2f-4093-b5cb-967adbe97623" status: 200 len: 1614 microversion: 2.1 time: 0.663145 Oct 04 20:50:05.369287 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1845/3600] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:50:04 2022] GET /compute/v2.1/servers/f9938964-5f2f-4093-b5cb-967adbe97623 => generated 1614 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:50:05.649843 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:50:05.923425 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-4693b29b-fc86-436c-87ae-fe291148e1e5 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c208ec9faf491385a9ab5b5932098d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ae4960393c464c97669731c2084d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:50:05.938043 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-4693b29b-fc86-436c-87ae-fe291148e1e5 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] 10.222.0.33 "GET /compute/v2.1/servers/917274da-5116-42df-84b5-a30b85d40913" status: 200 len: 1314 microversion: 2.1 time: 0.912071 Oct 04 20:50:05.942739 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1756/3601] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:50:05 2022] GET /compute/v2.1/servers/917274da-5116-42df-84b5-a30b85d40913 => generated 1314 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:50:06.392752 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-c5ce2d88-7328-4514-b4f5-c4d494640d80 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:06.394180 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-c5ce2d88-7328-4514-b4f5-c4d494640d80 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] [instance: f9938964-5f2f-4093-b5cb-967adbe97623] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:50:06.398375 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell0:SELECT=2 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:50:06.407553 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c5ce2d88-7328-4514-b4f5-c4d494640d80 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:06.414781 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c5ce2d88-7328-4514-b4f5-c4d494640d80 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:06.419677 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c5ce2d88-7328-4514-b4f5-c4d494640d80 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:06.422854 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c5ce2d88-7328-4514-b4f5-c4d494640d80 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:06.423827 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c5ce2d88-7328-4514-b4f5-c4d494640d80 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:06.428739 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c5ce2d88-7328-4514-b4f5-c4d494640d80 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:06.482800 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.wsgi [None req-c5ce2d88-7328-4514-b4f5-c4d494640d80 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] HTTP exception thrown: Instance f9938964-5f2f-4093-b5cb-967adbe97623 could not be found. Oct 04 20:50:06.488877 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-c5ce2d88-7328-4514-b4f5-c4d494640d80 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Request method failure captured: Oct 04 20:50:06.488877 n-d-854823-8 devstack@n-api.service[128802]: request: GET /compute/v2.1/servers/f9938964-5f2f-4093-b5cb-967adbe97623 HTTP/1.1 Oct 04 20:50:06.488877 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 20:50:06.488877 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 20:50:06.488877 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 20:50:06.488877 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 0 Oct 04 20:50:06.488877 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 20:50:06.488877 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 20:50:06.488877 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 20:50:06.488877 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 20:50:06.488877 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPJq81PAuDsDZpxdj7sHNmNgvbOtGh6iX1oPKSmvHZUw9x7ULWvp7QM5iDniQ-MHWL89bpVZnLKWftCcZuFrmOzCFwz5uJr5u54napWSUn77riQgg7pFlU7FKzu5ArjbUA7EV4GWtihdoiqsY9U5RhjRJWZh-5HATJMChglPcLjaAY6g Oct 04 20:50:06.488877 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 20:50:06.488877 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 20:50:06.488877 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 20:50:06.488877 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 20:50:06.488877 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 20:50:06.488877 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 20:50:06.488877 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: fc7f38600b5041ad8e66a12d77b940fa Oct 04 20:50:06.488877 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-AttachVolumeNegativeTest-16853026 Oct 04 20:50:06.488877 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 20:50:06.488877 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 20:50:06.488877 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_fc7f38600b5041ad8e66a12d77b940fa", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fc7f38600b5041ad8e66a12d77b940fa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fc7f38600b5041ad8e66a12d77b940fa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/fc7f38600b5041ad8e66a12d77b940fa"}]}] Oct 04 20:50:06.488877 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-AttachVolumeNegativeTest-16853026 Oct 04 20:50:06.488877 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: fc7f38600b5041ad8e66a12d77b940fa Oct 04 20:50:06.488877 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-16853026 Oct 04 20:50:06.488877 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-AttachVolumeNegativeTest-16853026-project Oct 04 20:50:06.488877 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 20:50:06.488877 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 20:50:06.488877 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: d9e4b00964014a0383f79597652bd428 Oct 04 20:50:06.488877 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-AttachVolumeNegativeTest-16853026-project Oct 04 20:50:06.488877 n-d-854823-8 devstack@n-api.service[128802]: method: > Oct 04 20:50:06.488877 n-d-854823-8 devstack@n-api.service[128802]: exception: Instance f9938964-5f2f-4093-b5cb-967adbe97623 could not be found. Oct 04 20:50:06.488877 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'id': 'f9938964-5f2f-4093-b5cb-967adbe97623'} Oct 04 20:50:06.488877 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:50:06.488877 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:50:06.488877 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:50:06.488877 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:50:06.488877 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:50:06.488877 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:50:06.488877 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:50:06.488877 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:50:06.488877 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:50:06.488877 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:50:06.488877 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f9938964-5f2f-4093-b5cb-967adbe97623 could not be found. Oct 04 20:50:06.488877 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:50:06.488877 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:50:06.488877 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:50:06.488877 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:50:06.488877 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:50:06.488877 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:50:06.488877 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:50:06.488877 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:50:06.488877 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:50:06.488877 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:50:06.488877 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:50:06.488877 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:50:06.488877 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:50:06.488877 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:50:06.488877 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:50:06.488877 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:50:06.488877 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f9938964-5f2f-4093-b5cb-967adbe97623 could not be found. Oct 04 20:50:06.488877 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:50:06.488877 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:50:06.488877 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:50:06.494906 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:50:06.494906 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:50:06.494906 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:50:06.494906 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:50:06.494906 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:50:06.494906 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f9938964-5f2f-4093-b5cb-967adbe97623 could not be found. Oct 04 20:50:06.494906 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:50:06.494906 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-c5ce2d88-7328-4514-b4f5-c4d494640d80 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Returning 404 to user: Instance f9938964-5f2f-4093-b5cb-967adbe97623 could not be found. {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:50:06.494906 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-c5ce2d88-7328-4514-b4f5-c4d494640d80 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] 10.222.0.33 "GET /compute/v2.1/servers/f9938964-5f2f-4093-b5cb-967adbe97623" status: 404 len: 111 microversion: 2.1 time: 0.102030 Oct 04 20:50:06.494906 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1846/3602] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:50:06 2022] GET /compute/v2.1/servers/f9938964-5f2f-4093-b5cb-967adbe97623 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:50:06.500567 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-fb102a4f-472b-4901-817d-e9134e4e0e49 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Calling method '.version_select at 0x7f3c742f50d0>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:06.545202 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-fb102a4f-472b-4901-817d-e9134e4e0e49 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2054016138" status: 202 len: 0 microversion: 2.1 time: 0.049281 Oct 04 20:50:06.546479 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1757/3603] 10.222.0.33 () {58 vars in 1221 bytes} [Tue Oct 4 20:50:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2054016138 => generated 0 bytes in 51 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:50:06.976003 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-216aba6c-93e7-45cb-ae3e-98283fc645fd tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:06.976946 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-216aba6c-93e7-45cb-ae3e-98283fc645fd tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] [instance: 917274da-5116-42df-84b5-a30b85d40913] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:50:06.989703 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-216aba6c-93e7-45cb-ae3e-98283fc645fd tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:06.990203 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-216aba6c-93e7-45cb-ae3e-98283fc645fd tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:06.995456 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-216aba6c-93e7-45cb-ae3e-98283fc645fd tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:06.996302 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-216aba6c-93e7-45cb-ae3e-98283fc645fd tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:07.002094 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-216aba6c-93e7-45cb-ae3e-98283fc645fd tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:07.006062 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-216aba6c-93e7-45cb-ae3e-98283fc645fd tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:07.035533 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=14 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:50:07.044325 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-7acf86b2-709d-489c-bc0f-89a3389a2b65 req-c6eec5c8-e656-42e0-ba13-d9ef8c3009ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "917274da-5116-42df-84b5-a30b85d40913", "tag": "52e43a18-5913-41fd-b586-a390738db24f"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:50:07.113842 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-7acf86b2-709d-489c-bc0f-89a3389a2b65 req-c6eec5c8-e656-42e0-ba13-d9ef8c3009ce service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:07.117358 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-7acf86b2-709d-489c-bc0f-89a3389a2b65 req-c6eec5c8-e656-42e0-ba13-d9ef8c3009ce service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:07.117829 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-7acf86b2-709d-489c-bc0f-89a3389a2b65 req-c6eec5c8-e656-42e0-ba13-d9ef8c3009ce service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:07.139078 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-7acf86b2-709d-489c-bc0f-89a3389a2b65 req-c6eec5c8-e656-42e0-ba13-d9ef8c3009ce service nova] Creating event network-changed:52e43a18-5913-41fd-b586-a390738db24f for instance 917274da-5116-42df-84b5-a30b85d40913 on n-h1-854823-8 Oct 04 20:50:07.155273 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-7acf86b2-709d-489c-bc0f-89a3389a2b65 req-c6eec5c8-e656-42e0-ba13-d9ef8c3009ce service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116261 Oct 04 20:50:07.156585 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1758/3604] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:50:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:50:07.762452 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b806d477-40e5-4abe-a9b9-ef08f4a143f6 tempest-VolumesAdminNegativeTest-49231768 tempest-VolumesAdminNegativeTest-49231768-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "dc4ed459-f329-40cc-9e8f-42575d1044bf"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:50:07.765030 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b806d477-40e5-4abe-a9b9-ef08f4a143f6 tempest-VolumesAdminNegativeTest-49231768 tempest-VolumesAdminNegativeTest-49231768-project-admin] [instance: 9261e0b2-35ac-40f4-92d5-3b9ffaea23c4] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:50:07.775706 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b806d477-40e5-4abe-a9b9-ef08f4a143f6 tempest-VolumesAdminNegativeTest-49231768 tempest-VolumesAdminNegativeTest-49231768-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:07.776215 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b806d477-40e5-4abe-a9b9-ef08f4a143f6 tempest-VolumesAdminNegativeTest-49231768 tempest-VolumesAdminNegativeTest-49231768-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:07.776645 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b806d477-40e5-4abe-a9b9-ef08f4a143f6 tempest-VolumesAdminNegativeTest-49231768 tempest-VolumesAdminNegativeTest-49231768-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:07.777713 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b806d477-40e5-4abe-a9b9-ef08f4a143f6 tempest-VolumesAdminNegativeTest-49231768 tempest-VolumesAdminNegativeTest-49231768-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:07.778243 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b806d477-40e5-4abe-a9b9-ef08f4a143f6 tempest-VolumesAdminNegativeTest-49231768 tempest-VolumesAdminNegativeTest-49231768-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:07.778895 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b806d477-40e5-4abe-a9b9-ef08f4a143f6 tempest-VolumesAdminNegativeTest-49231768 tempest-VolumesAdminNegativeTest-49231768-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:07.960764 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-b806d477-40e5-4abe-a9b9-ef08f4a143f6 tempest-VolumesAdminNegativeTest-49231768 tempest-VolumesAdminNegativeTest-49231768-project-admin] HTTP exception thrown: Volume dc4ed459-f329-40cc-9e8f-42575d1044bf could not be found. Oct 04 20:50:07.994193 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b806d477-40e5-4abe-a9b9-ef08f4a143f6 tempest-VolumesAdminNegativeTest-49231768 tempest-VolumesAdminNegativeTest-49231768-project-admin] Request method failure captured: Oct 04 20:50:07.994193 n-d-854823-8 devstack@n-api.service[128801]: request: PUT /compute/v2.1/servers/9261e0b2-35ac-40f4-92d5-3b9ffaea23c4/os-volume_attachments/e7847af5-dfc9-4048-ba6e-2c3fbb3ce5c4 HTTP/1.1 Oct 04 20:50:07.994193 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:50:07.994193 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:50:07.994193 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:50:07.994193 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 74 Oct 04 20:50:07.994193 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:50:07.994193 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:50:07.994193 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:50:07.994193 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:50:07.994193 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJwdURG4-hR5yUzgNSRnVbVpaBlvcTRCbYW1fOFUzaOdrM7lH2P1GXQ4COFXgyh4VpM6B5o1nchKDcD--tdoidEQmEtlPBN4TRVIxlGX4LeJR3rRnFoqnp4PFfz99EzhuT4E9bm636PCPPvMMoQZjKoUvLRi1dGet0lgq-4bvnXa1j8 Oct 04 20:50:07.994193 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:50:07.994193 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:50:07.994193 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:50:07.994193 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:50:07.994193 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:50:07.994193 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:50:07.994193 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: 98ff0fa24d864a8f9db1bf7a3ad1547c Oct 04 20:50:07.994193 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-VolumesAdminNegativeTest-49231768 Oct 04 20:50:07.994193 n-d-854823-8 devstack@n-api.service[128801]: X-Role: admin,reader,member Oct 04 20:50:07.994193 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: admin,reader,member Oct 04 20:50:07.994193 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_98ff0fa24d864a8f9db1bf7a3ad1547c", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/98ff0fa24d864a8f9db1bf7a3ad1547c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/98ff0fa24d864a8f9db1bf7a3ad1547c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/98ff0fa24d864a8f9db1bf7a3ad1547c"}]}] Oct 04 20:50:07.994193 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-VolumesAdminNegativeTest-49231768 Oct 04 20:50:07.994193 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: 98ff0fa24d864a8f9db1bf7a3ad1547c Oct 04 20:50:07.994193 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-49231768 Oct 04 20:50:07.994193 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-VolumesAdminNegativeTest-49231768-project-admin Oct 04 20:50:07.994193 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:50:07.994193 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:50:07.994193 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: ad772061953443ce86ee6e85f185aadf Oct 04 20:50:07.994193 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-VolumesAdminNegativeTest-49231768-project-admin Oct 04 20:50:07.994193 n-d-854823-8 devstack@n-api.service[128801]: Oct 04 20:50:07.994193 n-d-854823-8 devstack@n-api.service[128801]: {"volumeAttachment": {"volumeId": "dc4ed459-f329-40cc-9e8f-42575d1044bf"}} Oct 04 20:50:07.994193 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 20:50:07.994193 n-d-854823-8 devstack@n-api.service[128801]: exception: Volume dc4ed459-f329-40cc-9e8f-42575d1044bf could not be found. Oct 04 20:50:07.994193 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'server_id': '9261e0b2-35ac-40f4-92d5-3b9ffaea23c4', 'id': 'e7847af5-dfc9-4048-ba6e-2c3fbb3ce5c4', 'body': {'volumeAttachment': {'volumeId': 'dc4ed459-f329-40cc-9e8f-42575d1044bf'}}} Oct 04 20:50:07.994193 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:50:07.994193 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:50:07.994193 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 20:50:07.994193 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 20:50:07.994193 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 04 20:50:07.994193 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 04 20:50:07.994193 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 04 20:50:07.994193 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 04 20:50:07.994193 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 20:50:07.994193 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 20:50:07.994193 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 20:50:07.994193 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 20:50:07.994193 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 20:50:07.994193 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 20:50:07.994193 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 20:50:07.994193 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 20:50:07.994193 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume dc4ed459-f329-40cc-9e8f-42575d1044bf could not be found. (HTTP 404) (Request-ID: req-87651d5d-0d7a-4df9-a575-0deefcd9795a) Oct 04 20:50:07.994193 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:50:07.994193 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:50:07.994193 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:50:07.994193 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:50:07.994193 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 436, in _update_volume_swap Oct 04 20:50:07.994193 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi new_volume = self.volume_api.get(context, new_volume_id) Oct 04 20:50:07.994193 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 04 20:50:07.994193 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 04 20:50:07.994193 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 04 20:50:08.000650 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 04 20:50:08.000650 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 04 20:50:08.000650 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 04 20:50:08.000650 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 20:50:08.000650 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 20:50:08.000650 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 04 20:50:08.000650 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 04 20:50:08.000650 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 04 20:50:08.000650 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 04 20:50:08.000650 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 20:50:08.000650 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 20:50:08.000650 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 20:50:08.000650 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 20:50:08.000650 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 20:50:08.000650 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 20:50:08.000650 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 20:50:08.000650 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 20:50:08.000650 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume dc4ed459-f329-40cc-9e8f-42575d1044bf could not be found. Oct 04 20:50:08.000650 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:50:08.000650 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:50:08.000650 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:50:08.000650 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:50:08.000650 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:50:08.000650 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:50:08.000650 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:50:08.000650 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:50:08.000650 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:50:08.000650 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:50:08.000650 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:50:08.000650 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:50:08.000650 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:50:08.000650 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:50:08.000650 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Oct 04 20:50:08.000650 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Oct 04 20:50:08.000650 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 445, in _update_volume_swap Oct 04 20:50:08.000650 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 04 20:50:08.000650 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Volume dc4ed459-f329-40cc-9e8f-42575d1044bf could not be found. Oct 04 20:50:08.000650 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:50:08.000650 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:50:08.000650 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:50:08.000650 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:50:08.000650 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:50:08.000650 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:50:08.000650 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:50:08.000650 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:50:08.000650 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume dc4ed459-f329-40cc-9e8f-42575d1044bf could not be found. Oct 04 20:50:08.000650 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:50:08.000650 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b806d477-40e5-4abe-a9b9-ef08f4a143f6 tempest-VolumesAdminNegativeTest-49231768 tempest-VolumesAdminNegativeTest-49231768-project-admin] Returning 400 to user: Volume dc4ed459-f329-40cc-9e8f-42575d1044bf could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:50:08.006207 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b806d477-40e5-4abe-a9b9-ef08f4a143f6 tempest-VolumesAdminNegativeTest-49231768 tempest-VolumesAdminNegativeTest-49231768-project-admin] 10.222.0.33 "PUT /compute/v2.1/servers/9261e0b2-35ac-40f4-92d5-3b9ffaea23c4/os-volume_attachments/e7847af5-dfc9-4048-ba6e-2c3fbb3ce5c4" status: 400 len: 107 microversion: 2.1 time: 0.780083 Oct 04 20:50:08.008523 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1759/3605] 10.222.0.33 () {60 vars in 1433 bytes} [Tue Oct 4 20:50:07 2022] PUT /compute/v2.1/servers/9261e0b2-35ac-40f4-92d5-3b9ffaea23c4/os-volume_attachments/e7847af5-dfc9-4048-ba6e-2c3fbb3ce5c4 => generated 107 bytes in 789 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 20:50:08.140142 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c5868925-e243-460d-9add-ed09345a357d tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:08.142107 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c5868925-e243-460d-9add-ed09345a357d tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] [instance: 9261e0b2-35ac-40f4-92d5-3b9ffaea23c4] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:50:08.165132 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c5868925-e243-460d-9add-ed09345a357d tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:08.166286 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c5868925-e243-460d-9add-ed09345a357d tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:08.168546 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c5868925-e243-460d-9add-ed09345a357d tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:08.169998 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c5868925-e243-460d-9add-ed09345a357d tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:08.175171 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c5868925-e243-460d-9add-ed09345a357d tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:08.176275 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c5868925-e243-460d-9add-ed09345a357d tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:08.286932 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-216aba6c-93e7-45cb-ae3e-98283fc645fd tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c208ec9faf491385a9ab5b5932098d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ae4960393c464c97669731c2084d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:50:08.300751 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-216aba6c-93e7-45cb-ae3e-98283fc645fd tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] 10.222.0.33 "GET /compute/v2.1/servers/917274da-5116-42df-84b5-a30b85d40913" status: 200 len: 1314 microversion: 2.1 time: 1.329990 Oct 04 20:50:08.302136 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1847/3606] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:50:06 2022] GET /compute/v2.1/servers/917274da-5116-42df-84b5-a30b85d40913 => generated 1314 bytes in 1332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:50:08.391728 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-c5868925-e243-460d-9add-ed09345a357d tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Lazy-loading 'services' on Instance uuid 9261e0b2-35ac-40f4-92d5-3b9ffaea23c4 {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:50:08.514484 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c5868925-e243-460d-9add-ed09345a357d tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] 10.222.0.33 "DELETE /compute/v2.1/servers/9261e0b2-35ac-40f4-92d5-3b9ffaea23c4/os-volume_attachments/e7847af5-dfc9-4048-ba6e-2c3fbb3ce5c4" status: 202 len: 0 microversion: 2.1 time: 0.379429 Oct 04 20:50:08.516909 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1760/3607] 10.222.0.33 () {58 vars in 1416 bytes} [Tue Oct 4 20:50:08 2022] DELETE /compute/v2.1/servers/9261e0b2-35ac-40f4-92d5-3b9ffaea23c4/os-volume_attachments/e7847af5-dfc9-4048-ba6e-2c3fbb3ce5c4 => generated 0 bytes in 383 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:50:08.531425 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-f7f36ecc-ebb9-4c0c-bde0-794a0d67a371 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:08.541423 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-f7f36ecc-ebb9-4c0c-bde0-794a0d67a371 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] [instance: 9261e0b2-35ac-40f4-92d5-3b9ffaea23c4] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:50:08.556236 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f7f36ecc-ebb9-4c0c-bde0-794a0d67a371 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:08.559323 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f7f36ecc-ebb9-4c0c-bde0-794a0d67a371 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:08.560502 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f7f36ecc-ebb9-4c0c-bde0-794a0d67a371 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:08.562075 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f7f36ecc-ebb9-4c0c-bde0-794a0d67a371 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:08.563527 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f7f36ecc-ebb9-4c0c-bde0-794a0d67a371 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:08.564371 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f7f36ecc-ebb9-4c0c-bde0-794a0d67a371 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:08.618545 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-f7f36ecc-ebb9-4c0c-bde0-794a0d67a371 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] 10.222.0.33 "GET /compute/v2.1/servers/9261e0b2-35ac-40f4-92d5-3b9ffaea23c4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.096074 Oct 04 20:50:08.624998 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1848/3608] 10.222.0.33 () {58 vars in 1302 bytes} [Tue Oct 4 20:50:08 2022] GET /compute/v2.1/servers/9261e0b2-35ac-40f4-92d5-3b9ffaea23c4/os-volume_attachments => generated 197 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:50:09.344597 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5f24e431-99ee-4709-a90b-4aa58d89bb56 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:09.345410 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-5f24e431-99ee-4709-a90b-4aa58d89bb56 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] [instance: 917274da-5116-42df-84b5-a30b85d40913] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:50:09.373498 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5f24e431-99ee-4709-a90b-4aa58d89bb56 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:09.374007 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5f24e431-99ee-4709-a90b-4aa58d89bb56 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:09.376804 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5f24e431-99ee-4709-a90b-4aa58d89bb56 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:09.377576 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5f24e431-99ee-4709-a90b-4aa58d89bb56 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:09.378065 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5f24e431-99ee-4709-a90b-4aa58d89bb56 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:09.378516 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5f24e431-99ee-4709-a90b-4aa58d89bb56 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:09.635073 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-51bee31c-17b7-4fd8-9228-b44a61561901 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:09.639135 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-51bee31c-17b7-4fd8-9228-b44a61561901 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] [instance: 9261e0b2-35ac-40f4-92d5-3b9ffaea23c4] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:50:09.689698 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-51bee31c-17b7-4fd8-9228-b44a61561901 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:09.690735 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-51bee31c-17b7-4fd8-9228-b44a61561901 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:09.696175 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-51bee31c-17b7-4fd8-9228-b44a61561901 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:09.697114 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-51bee31c-17b7-4fd8-9228-b44a61561901 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:09.706136 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-5f24e431-99ee-4709-a90b-4aa58d89bb56 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c208ec9faf491385a9ab5b5932098d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ae4960393c464c97669731c2084d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:50:09.712182 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-51bee31c-17b7-4fd8-9228-b44a61561901 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:09.714854 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-51bee31c-17b7-4fd8-9228-b44a61561901 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:09.720194 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5f24e431-99ee-4709-a90b-4aa58d89bb56 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] 10.222.0.33 "GET /compute/v2.1/servers/917274da-5116-42df-84b5-a30b85d40913" status: 200 len: 1314 microversion: 2.1 time: 0.391722 Oct 04 20:50:09.722912 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1761/3609] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:50:09 2022] GET /compute/v2.1/servers/917274da-5116-42df-84b5-a30b85d40913 => generated 1314 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:50:09.868578 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-51bee31c-17b7-4fd8-9228-b44a61561901 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] 10.222.0.33 "GET /compute/v2.1/servers/9261e0b2-35ac-40f4-92d5-3b9ffaea23c4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.240256 Oct 04 20:50:09.877460 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1849/3610] 10.222.0.33 () {58 vars in 1302 bytes} [Tue Oct 4 20:50:09 2022] GET /compute/v2.1/servers/9261e0b2-35ac-40f4-92d5-3b9ffaea23c4/os-volume_attachments => generated 197 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:50:10.747046 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1589eefb-8dc7-4406-ae26-8b3e6ece8125 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:10.747841 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-1589eefb-8dc7-4406-ae26-8b3e6ece8125 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] [instance: 917274da-5116-42df-84b5-a30b85d40913] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:50:10.768605 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1589eefb-8dc7-4406-ae26-8b3e6ece8125 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:10.769113 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1589eefb-8dc7-4406-ae26-8b3e6ece8125 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:10.769552 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1589eefb-8dc7-4406-ae26-8b3e6ece8125 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:10.772180 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1589eefb-8dc7-4406-ae26-8b3e6ece8125 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:10.772866 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1589eefb-8dc7-4406-ae26-8b3e6ece8125 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:10.773313 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1589eefb-8dc7-4406-ae26-8b3e6ece8125 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:10.883517 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-1ba5547d-73ba-4ef5-8cae-8eb3b896d739 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:10.888167 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-1ba5547d-73ba-4ef5-8cae-8eb3b896d739 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] [instance: 9261e0b2-35ac-40f4-92d5-3b9ffaea23c4] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:50:10.924585 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1ba5547d-73ba-4ef5-8cae-8eb3b896d739 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:10.929475 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1ba5547d-73ba-4ef5-8cae-8eb3b896d739 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:10.931443 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1ba5547d-73ba-4ef5-8cae-8eb3b896d739 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:10.934941 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1ba5547d-73ba-4ef5-8cae-8eb3b896d739 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:10.935578 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1ba5547d-73ba-4ef5-8cae-8eb3b896d739 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:10.938173 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1ba5547d-73ba-4ef5-8cae-8eb3b896d739 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:11.039513 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-1ba5547d-73ba-4ef5-8cae-8eb3b896d739 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] 10.222.0.33 "GET /compute/v2.1/servers/9261e0b2-35ac-40f4-92d5-3b9ffaea23c4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.160023 Oct 04 20:50:11.047925 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1850/3611] 10.222.0.33 () {58 vars in 1302 bytes} [Tue Oct 4 20:50:10 2022] GET /compute/v2.1/servers/9261e0b2-35ac-40f4-92d5-3b9ffaea23c4/os-volume_attachments => generated 197 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:50:11.217853 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-1589eefb-8dc7-4406-ae26-8b3e6ece8125 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c208ec9faf491385a9ab5b5932098d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ae4960393c464c97669731c2084d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:50:11.233467 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-1589eefb-8dc7-4406-ae26-8b3e6ece8125 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] 10.222.0.33 "GET /compute/v2.1/servers/917274da-5116-42df-84b5-a30b85d40913" status: 200 len: 1314 microversion: 2.1 time: 0.490326 Oct 04 20:50:11.240759 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1762/3612] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:50:10 2022] GET /compute/v2.1/servers/917274da-5116-42df-84b5-a30b85d40913 => generated 1314 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:50:11.487001 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-e52fdddf-9220-4571-ae6c-038aacd4ac53 req-67f60adb-676a-4b42-a559-84762f2a3cad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "917274da-5116-42df-84b5-a30b85d40913", "name": "network-vif-plugged", "status": "completed", "tag": "52e43a18-5913-41fd-b586-a390738db24f"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:50:11.521703 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-e52fdddf-9220-4571-ae6c-038aacd4ac53 req-67f60adb-676a-4b42-a559-84762f2a3cad service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:11.533069 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-e52fdddf-9220-4571-ae6c-038aacd4ac53 req-67f60adb-676a-4b42-a559-84762f2a3cad service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:11.533642 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-e52fdddf-9220-4571-ae6c-038aacd4ac53 req-67f60adb-676a-4b42-a559-84762f2a3cad service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:11.576931 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-e52fdddf-9220-4571-ae6c-038aacd4ac53 req-67f60adb-676a-4b42-a559-84762f2a3cad service nova] Creating event network-vif-plugged:52e43a18-5913-41fd-b586-a390738db24f for instance 917274da-5116-42df-84b5-a30b85d40913 on n-h1-854823-8 Oct 04 20:50:11.594146 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-e52fdddf-9220-4571-ae6c-038aacd4ac53 req-67f60adb-676a-4b42-a559-84762f2a3cad service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113166 Oct 04 20:50:11.595519 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1851/3613] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:50:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:50:12.055542 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a45135a9-e287-4040-b93c-26ad7c35a180 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:12.059301 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a45135a9-e287-4040-b93c-26ad7c35a180 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] [instance: 9261e0b2-35ac-40f4-92d5-3b9ffaea23c4] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:50:12.075962 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a45135a9-e287-4040-b93c-26ad7c35a180 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:12.076461 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a45135a9-e287-4040-b93c-26ad7c35a180 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:12.076899 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a45135a9-e287-4040-b93c-26ad7c35a180 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:12.077606 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a45135a9-e287-4040-b93c-26ad7c35a180 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:12.078817 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a45135a9-e287-4040-b93c-26ad7c35a180 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:12.079501 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a45135a9-e287-4040-b93c-26ad7c35a180 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:12.137456 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:50:12.166047 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a45135a9-e287-4040-b93c-26ad7c35a180 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] 10.222.0.33 "GET /compute/v2.1/servers/9261e0b2-35ac-40f4-92d5-3b9ffaea23c4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.115281 Oct 04 20:50:12.171317 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1763/3614] 10.222.0.33 () {58 vars in 1302 bytes} [Tue Oct 4 20:50:12 2022] GET /compute/v2.1/servers/9261e0b2-35ac-40f4-92d5-3b9ffaea23c4/os-volume_attachments => generated 197 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:50:12.261993 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-6a4f89b8-4b33-44ca-8952-5544114900f4 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:12.262774 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-6a4f89b8-4b33-44ca-8952-5544114900f4 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] [instance: 917274da-5116-42df-84b5-a30b85d40913] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:50:12.276521 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6a4f89b8-4b33-44ca-8952-5544114900f4 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:12.277024 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6a4f89b8-4b33-44ca-8952-5544114900f4 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:12.277466 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6a4f89b8-4b33-44ca-8952-5544114900f4 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:12.278193 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6a4f89b8-4b33-44ca-8952-5544114900f4 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:12.278671 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6a4f89b8-4b33-44ca-8952-5544114900f4 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:12.279102 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6a4f89b8-4b33-44ca-8952-5544114900f4 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:12.728618 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-6a4f89b8-4b33-44ca-8952-5544114900f4 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c208ec9faf491385a9ab5b5932098d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ae4960393c464c97669731c2084d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:50:12.741523 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-6a4f89b8-4b33-44ca-8952-5544114900f4 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] 10.222.0.33 "GET /compute/v2.1/servers/917274da-5116-42df-84b5-a30b85d40913" status: 200 len: 1314 microversion: 2.1 time: 0.483404 Oct 04 20:50:12.742757 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1852/3615] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:50:12 2022] GET /compute/v2.1/servers/917274da-5116-42df-84b5-a30b85d40913 => generated 1314 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:50:13.183703 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-788b3353-b986-4884-b89e-925d4ec8c874 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:13.189372 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-788b3353-b986-4884-b89e-925d4ec8c874 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] [instance: 9261e0b2-35ac-40f4-92d5-3b9ffaea23c4] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:50:13.206614 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-788b3353-b986-4884-b89e-925d4ec8c874 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:13.207377 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-788b3353-b986-4884-b89e-925d4ec8c874 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:13.208034 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-788b3353-b986-4884-b89e-925d4ec8c874 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:13.211771 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-788b3353-b986-4884-b89e-925d4ec8c874 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:13.212564 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-788b3353-b986-4884-b89e-925d4ec8c874 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:13.214303 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-788b3353-b986-4884-b89e-925d4ec8c874 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:13.292844 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-788b3353-b986-4884-b89e-925d4ec8c874 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] 10.222.0.33 "GET /compute/v2.1/servers/9261e0b2-35ac-40f4-92d5-3b9ffaea23c4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.116933 Oct 04 20:50:13.296571 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1764/3616] 10.222.0.33 () {58 vars in 1302 bytes} [Tue Oct 4 20:50:13 2022] GET /compute/v2.1/servers/9261e0b2-35ac-40f4-92d5-3b9ffaea23c4/os-volume_attachments => generated 197 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:50:13.767436 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-b4ea6661-291a-451b-a36b-542d3cfe8174 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:13.768307 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-b4ea6661-291a-451b-a36b-542d3cfe8174 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] [instance: 917274da-5116-42df-84b5-a30b85d40913] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:50:13.789266 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b4ea6661-291a-451b-a36b-542d3cfe8174 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:13.789895 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b4ea6661-291a-451b-a36b-542d3cfe8174 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:13.790324 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b4ea6661-291a-451b-a36b-542d3cfe8174 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:13.791075 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b4ea6661-291a-451b-a36b-542d3cfe8174 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:13.791541 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b4ea6661-291a-451b-a36b-542d3cfe8174 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:13.791999 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b4ea6661-291a-451b-a36b-542d3cfe8174 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:14.308649 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ef2238d5-814a-4fd9-a428-6e4d0e038b61 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:14.310945 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ef2238d5-814a-4fd9-a428-6e4d0e038b61 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] [instance: 9261e0b2-35ac-40f4-92d5-3b9ffaea23c4] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:50:14.331264 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ef2238d5-814a-4fd9-a428-6e4d0e038b61 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:14.334572 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ef2238d5-814a-4fd9-a428-6e4d0e038b61 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:14.335233 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ef2238d5-814a-4fd9-a428-6e4d0e038b61 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:14.337394 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ef2238d5-814a-4fd9-a428-6e4d0e038b61 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:14.338083 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ef2238d5-814a-4fd9-a428-6e4d0e038b61 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:14.339172 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ef2238d5-814a-4fd9-a428-6e4d0e038b61 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:14.425579 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ef2238d5-814a-4fd9-a428-6e4d0e038b61 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] 10.222.0.33 "GET /compute/v2.1/servers/9261e0b2-35ac-40f4-92d5-3b9ffaea23c4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.120921 Oct 04 20:50:14.428908 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1765/3617] 10.222.0.33 () {58 vars in 1302 bytes} [Tue Oct 4 20:50:14 2022] GET /compute/v2.1/servers/9261e0b2-35ac-40f4-92d5-3b9ffaea23c4/os-volume_attachments => generated 197 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 20:50:14.466229 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-b4ea6661-291a-451b-a36b-542d3cfe8174 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c208ec9faf491385a9ab5b5932098d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ae4960393c464c97669731c2084d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:50:14.475378 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-b4ea6661-291a-451b-a36b-542d3cfe8174 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] 10.222.0.33 "GET /compute/v2.1/servers/917274da-5116-42df-84b5-a30b85d40913" status: 200 len: 1501 microversion: 2.1 time: 0.713404 Oct 04 20:50:14.475935 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1853/3618] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:50:13 2022] GET /compute/v2.1/servers/917274da-5116-42df-84b5-a30b85d40913 => generated 1501 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:50:15.443241 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2a77eea5-8dbc-44e0-bcbf-d1692f202426 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:15.445451 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-2a77eea5-8dbc-44e0-bcbf-d1692f202426 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] [instance: 9261e0b2-35ac-40f4-92d5-3b9ffaea23c4] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:50:15.469304 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2a77eea5-8dbc-44e0-bcbf-d1692f202426 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:15.473080 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2a77eea5-8dbc-44e0-bcbf-d1692f202426 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:15.474088 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2a77eea5-8dbc-44e0-bcbf-d1692f202426 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:15.475256 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2a77eea5-8dbc-44e0-bcbf-d1692f202426 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:15.476827 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2a77eea5-8dbc-44e0-bcbf-d1692f202426 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:15.477547 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2a77eea5-8dbc-44e0-bcbf-d1692f202426 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:15.525510 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-2a77eea5-8dbc-44e0-bcbf-d1692f202426 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] 10.222.0.33 "GET /compute/v2.1/servers/9261e0b2-35ac-40f4-92d5-3b9ffaea23c4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.086408 Oct 04 20:50:15.527007 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1766/3619] 10.222.0.33 () {58 vars in 1302 bytes} [Tue Oct 4 20:50:15 2022] GET /compute/v2.1/servers/9261e0b2-35ac-40f4-92d5-3b9ffaea23c4/os-volume_attachments => generated 197 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:50:16.539169 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-4f8fb9dc-3e09-4ecd-9a87-ea08dcd08070 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:16.541436 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-4f8fb9dc-3e09-4ecd-9a87-ea08dcd08070 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] [instance: 9261e0b2-35ac-40f4-92d5-3b9ffaea23c4] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:50:16.560936 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4f8fb9dc-3e09-4ecd-9a87-ea08dcd08070 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:16.567005 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4f8fb9dc-3e09-4ecd-9a87-ea08dcd08070 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:16.567750 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4f8fb9dc-3e09-4ecd-9a87-ea08dcd08070 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:16.571761 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4f8fb9dc-3e09-4ecd-9a87-ea08dcd08070 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:16.573152 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4f8fb9dc-3e09-4ecd-9a87-ea08dcd08070 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:16.576525 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4f8fb9dc-3e09-4ecd-9a87-ea08dcd08070 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:16.719096 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-4f8fb9dc-3e09-4ecd-9a87-ea08dcd08070 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] 10.222.0.33 "GET /compute/v2.1/servers/9261e0b2-35ac-40f4-92d5-3b9ffaea23c4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.183687 Oct 04 20:50:16.735442 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1854/3620] 10.222.0.33 () {58 vars in 1302 bytes} [Tue Oct 4 20:50:16 2022] GET /compute/v2.1/servers/9261e0b2-35ac-40f4-92d5-3b9ffaea23c4/os-volume_attachments => generated 197 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:50:17.631080 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6e800642-6305-49f0-aae0-d8b210c3e6a6 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a3757927-8565-4d87-8606-9eee1b1b1119"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:50:17.634135 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-6e800642-6305-49f0-aae0-d8b210c3e6a6 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] [instance: 917274da-5116-42df-84b5-a30b85d40913] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:50:17.648693 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6e800642-6305-49f0-aae0-d8b210c3e6a6 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:17.652273 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6e800642-6305-49f0-aae0-d8b210c3e6a6 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:17.660084 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6e800642-6305-49f0-aae0-d8b210c3e6a6 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:17.661319 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6e800642-6305-49f0-aae0-d8b210c3e6a6 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:17.662024 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6e800642-6305-49f0-aae0-d8b210c3e6a6 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:17.662741 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6e800642-6305-49f0-aae0-d8b210c3e6a6 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:17.731922 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-54a0d398-f286-41e5-9e07-4233cac8d737 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:17.734205 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-54a0d398-f286-41e5-9e07-4233cac8d737 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] [instance: 9261e0b2-35ac-40f4-92d5-3b9ffaea23c4] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:50:17.752311 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-54a0d398-f286-41e5-9e07-4233cac8d737 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:17.753234 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-54a0d398-f286-41e5-9e07-4233cac8d737 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:17.764529 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-54a0d398-f286-41e5-9e07-4233cac8d737 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:17.767996 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-54a0d398-f286-41e5-9e07-4233cac8d737 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:17.768788 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-54a0d398-f286-41e5-9e07-4233cac8d737 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:17.775945 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-54a0d398-f286-41e5-9e07-4233cac8d737 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:17.865050 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-54a0d398-f286-41e5-9e07-4233cac8d737 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] 10.222.0.33 "GET /compute/v2.1/servers/9261e0b2-35ac-40f4-92d5-3b9ffaea23c4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.137029 Oct 04 20:50:17.866217 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1855/3621] 10.222.0.33 () {58 vars in 1302 bytes} [Tue Oct 4 20:50:17 2022] GET /compute/v2.1/servers/9261e0b2-35ac-40f4-92d5-3b9ffaea23c4/os-volume_attachments => generated 197 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 20:50:18.238605 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-6e800642-6305-49f0-aae0-d8b210c3e6a6 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] 10.222.0.33 "POST /compute/v2.1/servers/917274da-5116-42df-84b5-a30b85d40913/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.611616 Oct 04 20:50:18.271343 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1767/3622] 10.222.0.33 () {60 vars in 1323 bytes} [Tue Oct 4 20:50:17 2022] POST /compute/v2.1/servers/917274da-5116-42df-84b5-a30b85d40913/os-volume_attachments => generated 194 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:50:18.878774 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-37606147-5ea0-494d-8190-e394d956686d tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:18.880978 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-37606147-5ea0-494d-8190-e394d956686d tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] [instance: 9261e0b2-35ac-40f4-92d5-3b9ffaea23c4] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:50:18.897020 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-37606147-5ea0-494d-8190-e394d956686d tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:18.897511 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-37606147-5ea0-494d-8190-e394d956686d tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:18.897950 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-37606147-5ea0-494d-8190-e394d956686d tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:18.898692 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-37606147-5ea0-494d-8190-e394d956686d tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:18.899153 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-37606147-5ea0-494d-8190-e394d956686d tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:18.899582 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-37606147-5ea0-494d-8190-e394d956686d tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:18.992974 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-37606147-5ea0-494d-8190-e394d956686d tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] 10.222.0.33 "GET /compute/v2.1/servers/9261e0b2-35ac-40f4-92d5-3b9ffaea23c4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.118565 Oct 04 20:50:18.994883 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1856/3623] 10.222.0.33 () {58 vars in 1302 bytes} [Tue Oct 4 20:50:18 2022] GET /compute/v2.1/servers/9261e0b2-35ac-40f4-92d5-3b9ffaea23c4/os-volume_attachments => generated 25 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 20:50:19.479702 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8e258b1e-3149-421e-92fb-52e2089807df tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1267951140", "imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63", "flavorRef": "452", "networks": [{"uuid": "5fa2c404-9fc1-4689-8f6f-05eb442252a3"}]}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:50:19.596093 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.network.neutron [None req-8e258b1e-3149-421e-92fb-52e2089807df tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] validate_networks() for [('5fa2c404-9fc1-4689-8f6f-05eb442252a3', None, None, None, None, None)] {{(pid=128801) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:50:21.398928 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-8e258b1e-3149-421e-92fb-52e2089807df tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Flavor limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:50:21.399563 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-8e258b1e-3149-421e-92fb-52e2089807df tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Image limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:50:21.399823 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-8e258b1e-3149-421e-92fb-52e2089807df tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Flavor pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:50:21.400437 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-8e258b1e-3149-421e-92fb-52e2089807df tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Image pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:50:21.401058 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-8e258b1e-3149-421e-92fb-52e2089807df tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:50:21.426146 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8e258b1e-3149-421e-92fb-52e2089807df tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:21.430789 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8e258b1e-3149-421e-92fb-52e2089807df tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:21.433938 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8e258b1e-3149-421e-92fb-52e2089807df tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:21.436421 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8e258b1e-3149-421e-92fb-52e2089807df tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:21.439170 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8e258b1e-3149-421e-92fb-52e2089807df tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:21.439698 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8e258b1e-3149-421e-92fb-52e2089807df tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:21.542943 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-8e258b1e-3149-421e-92fb-52e2089807df tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Getting quotas for project 09101effe9da463dabc2edaccdb83e06. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:50:21.579799 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-8e258b1e-3149-421e-92fb-52e2089807df tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Getting quotas for user e8397c96a6dd4c65bdde07c91ca5e7fa and project 09101effe9da463dabc2edaccdb83e06. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:50:21.585418 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=5,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:50:21.668124 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-8e258b1e-3149-421e-92fb-52e2089807df tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Going to run 1 instances... {{(pid=128801) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:50:21.675615 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-8e258b1e-3149-421e-92fb-52e2089807df tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] [instance: 0f0dfbcf-cfc3-4af8-9142-956b74ade0bd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='15b24725-0c99-4bcf-b1fb-907cdf8e2d63',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128801) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:50:21.889666 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-8e258b1e-3149-421e-92fb-52e2089807df tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.416033 Oct 04 20:50:21.902076 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1768/3624] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 20:50:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 2429 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 20:50:21.914663 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-e5e5018c-5456-4aa5-8aac-6a7f7285a4fd tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:21.916151 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-e5e5018c-5456-4aa5-8aac-6a7f7285a4fd tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] [instance: 0f0dfbcf-cfc3-4af8-9142-956b74ade0bd] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:50:22.339684 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-e5e5018c-5456-4aa5-8aac-6a7f7285a4fd tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8397c96a6dd4c65bdde07c91ca5e7fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09101effe9da463dabc2edaccdb83e06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:50:22.351807 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-e5e5018c-5456-4aa5-8aac-6a7f7285a4fd tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] 10.222.0.33 "GET /compute/v2.1/servers/0f0dfbcf-cfc3-4af8-9142-956b74ade0bd" status: 200 len: 1218 microversion: 2.1 time: 0.440822 Oct 04 20:50:22.355695 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1857/3625] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:50:21 2022] GET /compute/v2.1/servers/0f0dfbcf-cfc3-4af8-9142-956b74ade0bd => generated 1218 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:50:23.382326 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-82042e4d-eac0-473d-a070-f784e5b9f4ed tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:23.383621 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-82042e4d-eac0-473d-a070-f784e5b9f4ed tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] [instance: 0f0dfbcf-cfc3-4af8-9142-956b74ade0bd] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:50:23.398491 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-82042e4d-eac0-473d-a070-f784e5b9f4ed tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:23.399199 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-82042e4d-eac0-473d-a070-f784e5b9f4ed tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:23.407407 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-82042e4d-eac0-473d-a070-f784e5b9f4ed tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:23.408731 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-82042e4d-eac0-473d-a070-f784e5b9f4ed tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:23.409403 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-82042e4d-eac0-473d-a070-f784e5b9f4ed tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:23.410004 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-82042e4d-eac0-473d-a070-f784e5b9f4ed tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:23.723313 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-82042e4d-eac0-473d-a070-f784e5b9f4ed tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8397c96a6dd4c65bdde07c91ca5e7fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09101effe9da463dabc2edaccdb83e06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:50:23.737553 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-82042e4d-eac0-473d-a070-f784e5b9f4ed tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] 10.222.0.33 "GET /compute/v2.1/servers/0f0dfbcf-cfc3-4af8-9142-956b74ade0bd" status: 200 len: 1214 microversion: 2.1 time: 0.360111 Oct 04 20:50:23.739068 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1769/3626] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:50:23 2022] GET /compute/v2.1/servers/0f0dfbcf-cfc3-4af8-9142-956b74ade0bd => generated 1214 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:50:24.556941 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-9e17684f-3a84-4bc0-9f6b-09df8aa18f52 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:24.557608 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-9e17684f-3a84-4bc0-9f6b-09df8aa18f52 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: 4d46fff2-b04d-41aa-ada0-2023ab545b48] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:50:24.573638 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9e17684f-3a84-4bc0-9f6b-09df8aa18f52 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:24.574120 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9e17684f-3a84-4bc0-9f6b-09df8aa18f52 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:24.593923 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9e17684f-3a84-4bc0-9f6b-09df8aa18f52 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:24.604479 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9e17684f-3a84-4bc0-9f6b-09df8aa18f52 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:24.605014 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9e17684f-3a84-4bc0-9f6b-09df8aa18f52 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:24.605498 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9e17684f-3a84-4bc0-9f6b-09df8aa18f52 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:24.763814 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b1719420-d611-4ea8-b3c4-7bc8ccad7ce0 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:24.764578 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b1719420-d611-4ea8-b3c4-7bc8ccad7ce0 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] [instance: 0f0dfbcf-cfc3-4af8-9142-956b74ade0bd] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:50:24.782489 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b1719420-d611-4ea8-b3c4-7bc8ccad7ce0 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:24.790753 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b1719420-d611-4ea8-b3c4-7bc8ccad7ce0 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:24.794735 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b1719420-d611-4ea8-b3c4-7bc8ccad7ce0 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:24.806893 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b1719420-d611-4ea8-b3c4-7bc8ccad7ce0 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:24.808088 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b1719420-d611-4ea8-b3c4-7bc8ccad7ce0 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:24.809756 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b1719420-d611-4ea8-b3c4-7bc8ccad7ce0 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:25.921405 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-9e17684f-3a84-4bc0-9f6b-09df8aa18f52 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac650232cc04810b1340dc2f0edadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b0670d1bd99424780a70e69d57a2166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:50:25.930686 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-b1719420-d611-4ea8-b3c4-7bc8ccad7ce0 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8397c96a6dd4c65bdde07c91ca5e7fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09101effe9da463dabc2edaccdb83e06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:50:25.933215 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-9e17684f-3a84-4bc0-9f6b-09df8aa18f52 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48" status: 200 len: 1669 microversion: 2.1 time: 1.379107 Oct 04 20:50:25.934636 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1858/3627] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:50:24 2022] GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48 => generated 1669 bytes in 1382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:50:25.959482 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b1719420-d611-4ea8-b3c4-7bc8ccad7ce0 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] 10.222.0.33 "GET /compute/v2.1/servers/0f0dfbcf-cfc3-4af8-9142-956b74ade0bd" status: 200 len: 1276 microversion: 2.1 time: 1.199526 Oct 04 20:50:25.960738 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1770/3628] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:50:24 2022] GET /compute/v2.1/servers/0f0dfbcf-cfc3-4af8-9142-956b74ade0bd => generated 1276 bytes in 1202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:50:25.972332 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5f94a805-ed04-4aea-bb67-3161010b0975 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:25.975363 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-5f94a805-ed04-4aea-bb67-3161010b0975 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] [instance: f9938964-5f2f-4093-b5cb-967adbe97623] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:50:25.992389 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5f94a805-ed04-4aea-bb67-3161010b0975 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:25.993285 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5f94a805-ed04-4aea-bb67-3161010b0975 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:25.995045 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5f94a805-ed04-4aea-bb67-3161010b0975 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:25.996301 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5f94a805-ed04-4aea-bb67-3161010b0975 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:25.997746 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5f94a805-ed04-4aea-bb67-3161010b0975 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:25.999174 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5f94a805-ed04-4aea-bb67-3161010b0975 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:26.033655 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-5f94a805-ed04-4aea-bb67-3161010b0975 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] HTTP exception thrown: Instance f9938964-5f2f-4093-b5cb-967adbe97623 could not be found. Oct 04 20:50:26.038959 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5f94a805-ed04-4aea-bb67-3161010b0975 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Request method failure captured: Oct 04 20:50:26.038959 n-d-854823-8 devstack@n-api.service[128801]: request: DELETE /compute/v2.1/servers/f9938964-5f2f-4093-b5cb-967adbe97623 HTTP/1.1 Oct 04 20:50:26.038959 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:50:26.038959 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:50:26.038959 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:50:26.038959 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 0 Oct 04 20:50:26.038959 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:50:26.038959 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:50:26.038959 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:50:26.038959 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:50:26.038959 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJq81PAuDsDZpxdj7sHNmNgvbOtGh6iX1oPKSmvHZUw9x7ULWvp7QM5iDniQ-MHWL89bpVZnLKWftCcZuFrmOzCFwz5uJr5u54napWSUn77riQgg7pFlU7FKzu5ArjbUA7EV4GWtihdoiqsY9U5RhjRJWZh-5HATJMChglPcLjaAY6g Oct 04 20:50:26.038959 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:50:26.038959 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:50:26.038959 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:50:26.038959 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:50:26.038959 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:50:26.038959 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:50:26.038959 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: fc7f38600b5041ad8e66a12d77b940fa Oct 04 20:50:26.038959 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-AttachVolumeNegativeTest-16853026 Oct 04 20:50:26.038959 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 20:50:26.038959 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 20:50:26.038959 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_fc7f38600b5041ad8e66a12d77b940fa", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fc7f38600b5041ad8e66a12d77b940fa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fc7f38600b5041ad8e66a12d77b940fa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/fc7f38600b5041ad8e66a12d77b940fa"}]}] Oct 04 20:50:26.038959 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-AttachVolumeNegativeTest-16853026 Oct 04 20:50:26.038959 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: fc7f38600b5041ad8e66a12d77b940fa Oct 04 20:50:26.038959 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-16853026 Oct 04 20:50:26.038959 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-AttachVolumeNegativeTest-16853026-project Oct 04 20:50:26.038959 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:50:26.038959 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:50:26.038959 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: d9e4b00964014a0383f79597652bd428 Oct 04 20:50:26.038959 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-AttachVolumeNegativeTest-16853026-project Oct 04 20:50:26.038959 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 20:50:26.038959 n-d-854823-8 devstack@n-api.service[128801]: exception: Instance f9938964-5f2f-4093-b5cb-967adbe97623 could not be found. Oct 04 20:50:26.038959 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': 'f9938964-5f2f-4093-b5cb-967adbe97623'} Oct 04 20:50:26.038959 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:50:26.038959 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:50:26.038959 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:50:26.038959 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:50:26.038959 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:50:26.038959 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:50:26.038959 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:50:26.038959 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:50:26.038959 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:50:26.038959 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:50:26.038959 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f9938964-5f2f-4093-b5cb-967adbe97623 could not be found. Oct 04 20:50:26.038959 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:50:26.038959 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:50:26.038959 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:50:26.038959 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:50:26.038959 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:50:26.038959 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:50:26.038959 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:50:26.038959 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:50:26.038959 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:50:26.038959 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:50:26.038959 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 20:50:26.038959 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 20:50:26.038959 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 20:50:26.038959 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 20:50:26.038959 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:50:26.038959 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:50:26.038959 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:50:26.038959 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:50:26.044838 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f9938964-5f2f-4093-b5cb-967adbe97623 could not be found. Oct 04 20:50:26.044838 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:50:26.044838 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:50:26.044838 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:50:26.044838 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:50:26.044838 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:50:26.044838 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:50:26.044838 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:50:26.044838 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:50:26.044838 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f9938964-5f2f-4093-b5cb-967adbe97623 could not be found. Oct 04 20:50:26.044838 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:50:26.048661 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5f94a805-ed04-4aea-bb67-3161010b0975 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Returning 404 to user: Instance f9938964-5f2f-4093-b5cb-967adbe97623 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:50:26.054078 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5f94a805-ed04-4aea-bb67-3161010b0975 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] 10.222.0.33 "DELETE /compute/v2.1/servers/f9938964-5f2f-4093-b5cb-967adbe97623" status: 404 len: 111 microversion: 2.1 time: 0.090017 Oct 04 20:50:26.055086 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1771/3629] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 20:50:25 2022] DELETE /compute/v2.1/servers/f9938964-5f2f-4093-b5cb-967adbe97623 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:50:26.068315 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-4703653c-857e-4345-be19-a304a4435484 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:26.072097 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-4703653c-857e-4345-be19-a304a4435484 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: 4d46fff2-b04d-41aa-ada0-2023ab545b48] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:50:26.083227 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4703653c-857e-4345-be19-a304a4435484 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:26.085272 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4703653c-857e-4345-be19-a304a4435484 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:26.086658 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4703653c-857e-4345-be19-a304a4435484 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:26.089207 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4703653c-857e-4345-be19-a304a4435484 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:26.090875 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4703653c-857e-4345-be19-a304a4435484 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:26.092410 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4703653c-857e-4345-be19-a304a4435484 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:26.229900 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-ebeb585f-5875-4a5b-b04a-8519001d9634 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1333323082", "imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:50:26.317383 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.network.neutron [None req-ebeb585f-5875-4a5b-b04a-8519001d9634 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] validate_networks() for [('49b17641-fc69-4832-b90f-432d80a0733f', None, None, None, None, None)] {{(pid=128802) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:50:26.948282 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-4703653c-857e-4345-be19-a304a4435484 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac650232cc04810b1340dc2f0edadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b0670d1bd99424780a70e69d57a2166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:50:26.961306 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-4703653c-857e-4345-be19-a304a4435484 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48" status: 200 len: 1669 microversion: 2.1 time: 0.901778 Oct 04 20:50:26.963662 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1772/3630] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:50:26 2022] GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48 => generated 1669 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:50:26.998021 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-70223d49-bcc4-4379-a82d-7e2529848072 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:26.998967 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-70223d49-bcc4-4379-a82d-7e2529848072 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] [instance: f9938964-5f2f-4093-b5cb-967adbe97623] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:50:27.011915 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-70223d49-bcc4-4379-a82d-7e2529848072 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:27.013527 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-70223d49-bcc4-4379-a82d-7e2529848072 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:27.014160 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-70223d49-bcc4-4379-a82d-7e2529848072 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:27.017585 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-70223d49-bcc4-4379-a82d-7e2529848072 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:27.018274 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-70223d49-bcc4-4379-a82d-7e2529848072 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:27.018926 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-70223d49-bcc4-4379-a82d-7e2529848072 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:27.045672 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-70223d49-bcc4-4379-a82d-7e2529848072 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] HTTP exception thrown: Instance f9938964-5f2f-4093-b5cb-967adbe97623 could not be found. Oct 04 20:50:27.047787 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-70223d49-bcc4-4379-a82d-7e2529848072 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Request method failure captured: Oct 04 20:50:27.047787 n-d-854823-8 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/f9938964-5f2f-4093-b5cb-967adbe97623 HTTP/1.1 Oct 04 20:50:27.047787 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:50:27.047787 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:50:27.047787 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:50:27.047787 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 0 Oct 04 20:50:27.047787 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:50:27.047787 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:50:27.047787 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:50:27.047787 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:50:27.047787 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJq81PAuDsDZpxdj7sHNmNgvbOtGh6iX1oPKSmvHZUw9x7ULWvp7QM5iDniQ-MHWL89bpVZnLKWftCcZuFrmOzCFwz5uJr5u54napWSUn77riQgg7pFlU7FKzu5ArjbUA7EV4GWtihdoiqsY9U5RhjRJWZh-5HATJMChglPcLjaAY6g Oct 04 20:50:27.047787 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:50:27.047787 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:50:27.047787 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:50:27.047787 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:50:27.047787 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:50:27.047787 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:50:27.047787 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: fc7f38600b5041ad8e66a12d77b940fa Oct 04 20:50:27.047787 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-AttachVolumeNegativeTest-16853026 Oct 04 20:50:27.047787 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 20:50:27.047787 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 20:50:27.047787 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_fc7f38600b5041ad8e66a12d77b940fa", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fc7f38600b5041ad8e66a12d77b940fa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fc7f38600b5041ad8e66a12d77b940fa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/fc7f38600b5041ad8e66a12d77b940fa"}]}] Oct 04 20:50:27.047787 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-AttachVolumeNegativeTest-16853026 Oct 04 20:50:27.047787 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: fc7f38600b5041ad8e66a12d77b940fa Oct 04 20:50:27.047787 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-16853026 Oct 04 20:50:27.047787 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-AttachVolumeNegativeTest-16853026-project Oct 04 20:50:27.047787 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:50:27.047787 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:50:27.047787 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: d9e4b00964014a0383f79597652bd428 Oct 04 20:50:27.047787 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-AttachVolumeNegativeTest-16853026-project Oct 04 20:50:27.047787 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 20:50:27.047787 n-d-854823-8 devstack@n-api.service[128801]: exception: Instance f9938964-5f2f-4093-b5cb-967adbe97623 could not be found. Oct 04 20:50:27.047787 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': 'f9938964-5f2f-4093-b5cb-967adbe97623'} Oct 04 20:50:27.047787 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:50:27.047787 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:50:27.047787 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:50:27.047787 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:50:27.047787 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:50:27.047787 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:50:27.047787 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:50:27.047787 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:50:27.047787 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:50:27.047787 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:50:27.047787 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f9938964-5f2f-4093-b5cb-967adbe97623 could not be found. Oct 04 20:50:27.047787 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:50:27.047787 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:50:27.047787 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:50:27.047787 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:50:27.047787 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:50:27.047787 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:50:27.047787 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:50:27.047787 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:50:27.047787 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:50:27.047787 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:50:27.047787 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:50:27.047787 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:50:27.047787 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:50:27.047787 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:50:27.047787 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:50:27.047787 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:50:27.047787 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f9938964-5f2f-4093-b5cb-967adbe97623 could not be found. Oct 04 20:50:27.047787 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:50:27.047787 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:50:27.047787 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:50:27.054033 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:50:27.054033 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:50:27.054033 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:50:27.054033 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:50:27.054033 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:50:27.054033 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f9938964-5f2f-4093-b5cb-967adbe97623 could not be found. Oct 04 20:50:27.054033 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:50:27.055425 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-70223d49-bcc4-4379-a82d-7e2529848072 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Returning 404 to user: Instance f9938964-5f2f-4093-b5cb-967adbe97623 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:50:27.056529 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-70223d49-bcc4-4379-a82d-7e2529848072 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] 10.222.0.33 "GET /compute/v2.1/servers/f9938964-5f2f-4093-b5cb-967adbe97623" status: 404 len: 111 microversion: 2.1 time: 0.072470 Oct 04 20:50:27.060918 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1773/3631] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:50:26 2022] GET /compute/v2.1/servers/f9938964-5f2f-4093-b5cb-967adbe97623 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:50:27.066559 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-511f8078-cc74-49c1-9c7d-db0326c2366b tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:27.068009 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-511f8078-cc74-49c1-9c7d-db0326c2366b tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: 4d46fff2-b04d-41aa-ada0-2023ab545b48] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:50:27.074815 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-511f8078-cc74-49c1-9c7d-db0326c2366b tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:27.075647 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-511f8078-cc74-49c1-9c7d-db0326c2366b tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:27.076322 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-511f8078-cc74-49c1-9c7d-db0326c2366b tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:27.077315 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-511f8078-cc74-49c1-9c7d-db0326c2366b tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:27.078555 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-511f8078-cc74-49c1-9c7d-db0326c2366b tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:27.079441 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-511f8078-cc74-49c1-9c7d-db0326c2366b tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:27.463723 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-ebeb585f-5875-4a5b-b04a-8519001d9634 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Flavor limits 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:50:27.465220 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-ebeb585f-5875-4a5b-b04a-8519001d9634 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Image limits 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:50:27.466931 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-ebeb585f-5875-4a5b-b04a-8519001d9634 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Flavor pref 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:50:27.467874 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-ebeb585f-5875-4a5b-b04a-8519001d9634 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Image pref 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:50:27.467874 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-ebeb585f-5875-4a5b-b04a-8519001d9634 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:50:27.487347 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ebeb585f-5875-4a5b-b04a-8519001d9634 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:27.488751 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ebeb585f-5875-4a5b-b04a-8519001d9634 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:27.490332 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ebeb585f-5875-4a5b-b04a-8519001d9634 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:27.492344 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ebeb585f-5875-4a5b-b04a-8519001d9634 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:27.492911 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ebeb585f-5875-4a5b-b04a-8519001d9634 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:27.493366 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ebeb585f-5875-4a5b-b04a-8519001d9634 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:27.540695 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-ebeb585f-5875-4a5b-b04a-8519001d9634 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Getting quotas for project 003eb03a265a496d8981e45c74b014f3. Resources: {'ram', 'instances', 'cores'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:50:27.554934 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-ebeb585f-5875-4a5b-b04a-8519001d9634 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Getting quotas for user 4dc4171c0ee14ebb8b5eff5e910ccf49 and project 003eb03a265a496d8981e45c74b014f3. Resources: {'ram', 'instances', 'cores'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:50:27.572186 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-ebeb585f-5875-4a5b-b04a-8519001d9634 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Going to run 1 instances... {{(pid=128802) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:50:27.577152 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-ebeb585f-5875-4a5b-b04a-8519001d9634 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] [instance: 1ed60bf8-87e6-4a70-be59-830bee5f8b6d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='15b24725-0c99-4bcf-b1fb-907cdf8e2d63',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128802) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:50:27.673868 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-ebeb585f-5875-4a5b-b04a-8519001d9634 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.737736 Oct 04 20:50:27.675497 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1859/3632] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 20:50:25 2022] POST /compute/v2.1/servers => generated 383 bytes in 1740 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 20:50:27.683348 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-56dade3f-12e7-46c1-9160-fcb24e3dca51 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:27.684936 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-56dade3f-12e7-46c1-9160-fcb24e3dca51 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] [instance: 0f0dfbcf-cfc3-4af8-9142-956b74ade0bd] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:50:27.697939 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-56dade3f-12e7-46c1-9160-fcb24e3dca51 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:27.698838 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-56dade3f-12e7-46c1-9160-fcb24e3dca51 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:27.699655 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-56dade3f-12e7-46c1-9160-fcb24e3dca51 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:27.700598 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-56dade3f-12e7-46c1-9160-fcb24e3dca51 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:27.716032 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-56dade3f-12e7-46c1-9160-fcb24e3dca51 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:27.717228 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-56dade3f-12e7-46c1-9160-fcb24e3dca51 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:28.042252 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-511f8078-cc74-49c1-9c7d-db0326c2366b tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac650232cc04810b1340dc2f0edadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b0670d1bd99424780a70e69d57a2166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:50:28.058733 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-56dade3f-12e7-46c1-9160-fcb24e3dca51 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8397c96a6dd4c65bdde07c91ca5e7fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09101effe9da463dabc2edaccdb83e06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:50:28.061676 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-511f8078-cc74-49c1-9c7d-db0326c2366b tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48" status: 200 len: 1669 microversion: 2.1 time: 0.998671 Oct 04 20:50:28.064939 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1774/3633] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:50:27 2022] GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48 => generated 1669 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:50:28.068624 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-56dade3f-12e7-46c1-9160-fcb24e3dca51 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] 10.222.0.33 "GET /compute/v2.1/servers/0f0dfbcf-cfc3-4af8-9142-956b74ade0bd" status: 200 len: 1276 microversion: 2.1 time: 0.391300 Oct 04 20:50:28.081573 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c0ad0c6e-b90e-465b-8a21-e178c39c1ee8 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:28.084794 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c0ad0c6e-b90e-465b-8a21-e178c39c1ee8 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] [instance: 1ed60bf8-87e6-4a70-be59-830bee5f8b6d] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:50:28.088609 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1860/3634] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:50:27 2022] GET /compute/v2.1/servers/0f0dfbcf-cfc3-4af8-9142-956b74ade0bd => generated 1276 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:50:28.106391 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-af4aaf70-9d63-4d61-b526-dd0be73e6ca1 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:28.108860 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-af4aaf70-9d63-4d61-b526-dd0be73e6ca1 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: 4d46fff2-b04d-41aa-ada0-2023ab545b48] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:50:28.122079 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-af4aaf70-9d63-4d61-b526-dd0be73e6ca1 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:28.124812 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-af4aaf70-9d63-4d61-b526-dd0be73e6ca1 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:28.129225 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-af4aaf70-9d63-4d61-b526-dd0be73e6ca1 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:28.130848 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-af4aaf70-9d63-4d61-b526-dd0be73e6ca1 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:28.131557 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-af4aaf70-9d63-4d61-b526-dd0be73e6ca1 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:28.132245 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-af4aaf70-9d63-4d61-b526-dd0be73e6ca1 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:28.536999 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c0ad0c6e-b90e-465b-8a21-e178c39c1ee8 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc4171c0ee14ebb8b5eff5e910ccf49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003eb03a265a496d8981e45c74b014f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:50:28.545695 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c0ad0c6e-b90e-465b-8a21-e178c39c1ee8 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] 10.222.0.33 "GET /compute/v2.1/servers/1ed60bf8-87e6-4a70-be59-830bee5f8b6d" status: 200 len: 1222 microversion: 2.1 time: 0.477839 Oct 04 20:50:28.562220 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1775/3635] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:50:28 2022] GET /compute/v2.1/servers/1ed60bf8-87e6-4a70-be59-830bee5f8b6d => generated 1222 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:50:28.707909 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-913102c7-7857-4b2f-9cd3-2a7ab1fd59a1 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1451044634", "imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:50:28.799524 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.network.neutron [None req-913102c7-7857-4b2f-9cd3-2a7ab1fd59a1 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] validate_networks() for [('49b17641-fc69-4832-b90f-432d80a0733f', None, None, None, None, None)] {{(pid=128801) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:50:29.458124 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-af4aaf70-9d63-4d61-b526-dd0be73e6ca1 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac650232cc04810b1340dc2f0edadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b0670d1bd99424780a70e69d57a2166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:50:29.479284 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-af4aaf70-9d63-4d61-b526-dd0be73e6ca1 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48" status: 200 len: 1669 microversion: 2.1 time: 1.389402 Oct 04 20:50:29.490616 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1861/3636] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:50:28 2022] GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48 => generated 1669 bytes in 1397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:50:29.503234 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-9ca05aa8-9f39-4562-ae4a-5f7b54d409cd tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:29.503869 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-9ca05aa8-9f39-4562-ae4a-5f7b54d409cd tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] [instance: 0f0dfbcf-cfc3-4af8-9142-956b74ade0bd] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:50:29.525752 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9ca05aa8-9f39-4562-ae4a-5f7b54d409cd tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:29.531941 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9ca05aa8-9f39-4562-ae4a-5f7b54d409cd tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:29.532718 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9ca05aa8-9f39-4562-ae4a-5f7b54d409cd tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:29.533643 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9ca05aa8-9f39-4562-ae4a-5f7b54d409cd tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:29.534270 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9ca05aa8-9f39-4562-ae4a-5f7b54d409cd tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:29.534954 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9ca05aa8-9f39-4562-ae4a-5f7b54d409cd tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:30.814099 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-9ca05aa8-9f39-4562-ae4a-5f7b54d409cd tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8397c96a6dd4c65bdde07c91ca5e7fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09101effe9da463dabc2edaccdb83e06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:50:30.826476 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-9ca05aa8-9f39-4562-ae4a-5f7b54d409cd tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] 10.222.0.33 "GET /compute/v2.1/servers/0f0dfbcf-cfc3-4af8-9142-956b74ade0bd" status: 200 len: 1318 microversion: 2.1 time: 1.337813 Oct 04 20:50:30.829231 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1862/3637] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:50:29 2022] GET /compute/v2.1/servers/0f0dfbcf-cfc3-4af8-9142-956b74ade0bd => generated 1318 bytes in 1342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:50:30.847762 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-7fb051e8-337e-4761-aeec-4eb0da45e5b3 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1063972224", "imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63", "flavorRef": "452", "networks": [{"uuid": "f233dbb4-a3a0-4530-9ca7-211ce7f5e292"}]}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:50:30.944994 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.network.neutron [None req-7fb051e8-337e-4761-aeec-4eb0da45e5b3 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] validate_networks() for [('f233dbb4-a3a0-4530-9ca7-211ce7f5e292', None, None, None, None, None)] {{(pid=128802) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:50:31.485675 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:50:32.807799 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-913102c7-7857-4b2f-9cd3-2a7ab1fd59a1 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Flavor limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:50:32.809070 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-913102c7-7857-4b2f-9cd3-2a7ab1fd59a1 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Image limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:50:32.809863 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-913102c7-7857-4b2f-9cd3-2a7ab1fd59a1 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Flavor pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:50:32.810587 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-913102c7-7857-4b2f-9cd3-2a7ab1fd59a1 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Image pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:50:32.811272 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-913102c7-7857-4b2f-9cd3-2a7ab1fd59a1 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:50:32.831417 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-913102c7-7857-4b2f-9cd3-2a7ab1fd59a1 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:32.833278 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-913102c7-7857-4b2f-9cd3-2a7ab1fd59a1 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:32.834386 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-913102c7-7857-4b2f-9cd3-2a7ab1fd59a1 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:32.835395 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-913102c7-7857-4b2f-9cd3-2a7ab1fd59a1 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:32.838532 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-913102c7-7857-4b2f-9cd3-2a7ab1fd59a1 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:32.839552 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-913102c7-7857-4b2f-9cd3-2a7ab1fd59a1 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:32.885897 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-913102c7-7857-4b2f-9cd3-2a7ab1fd59a1 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Getting quotas for project 003eb03a265a496d8981e45c74b014f3. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:50:32.924396 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-913102c7-7857-4b2f-9cd3-2a7ab1fd59a1 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Getting quotas for user 4dc4171c0ee14ebb8b5eff5e910ccf49 and project 003eb03a265a496d8981e45c74b014f3. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:50:32.977099 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-913102c7-7857-4b2f-9cd3-2a7ab1fd59a1 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Going to run 1 instances... {{(pid=128801) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:50:32.984472 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-913102c7-7857-4b2f-9cd3-2a7ab1fd59a1 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] [instance: f15ae3c9-8342-4ae9-b81e-2d7b1aecb2e8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='15b24725-0c99-4bcf-b1fb-907cdf8e2d63',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128801) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:50:33.120080 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-913102c7-7857-4b2f-9cd3-2a7ab1fd59a1 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.428261 Oct 04 20:50:33.120936 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1776/3638] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 20:50:28 2022] POST /compute/v2.1/servers => generated 383 bytes in 4430 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 20:50:33.156490 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-31a33f2e-c3a2-4e6b-b532-9b3c56513f9b tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:33.157643 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-31a33f2e-c3a2-4e6b-b532-9b3c56513f9b tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] [instance: 0f0dfbcf-cfc3-4af8-9142-956b74ade0bd] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:50:33.176203 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-31a33f2e-c3a2-4e6b-b532-9b3c56513f9b tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:33.176845 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-31a33f2e-c3a2-4e6b-b532-9b3c56513f9b tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:33.177967 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-31a33f2e-c3a2-4e6b-b532-9b3c56513f9b tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:33.178837 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-31a33f2e-c3a2-4e6b-b532-9b3c56513f9b tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:33.183389 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-31a33f2e-c3a2-4e6b-b532-9b3c56513f9b tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:33.183983 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-31a33f2e-c3a2-4e6b-b532-9b3c56513f9b tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:34.052200 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-7fb051e8-337e-4761-aeec-4eb0da45e5b3 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Flavor limits 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:50:34.053248 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-7fb051e8-337e-4761-aeec-4eb0da45e5b3 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Image limits 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:50:34.054275 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-7fb051e8-337e-4761-aeec-4eb0da45e5b3 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Flavor pref 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:50:34.054929 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-7fb051e8-337e-4761-aeec-4eb0da45e5b3 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Image pref 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:50:34.058821 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-7fb051e8-337e-4761-aeec-4eb0da45e5b3 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:50:34.079468 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7fb051e8-337e-4761-aeec-4eb0da45e5b3 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:34.088285 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7fb051e8-337e-4761-aeec-4eb0da45e5b3 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:34.089127 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7fb051e8-337e-4761-aeec-4eb0da45e5b3 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:34.090156 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7fb051e8-337e-4761-aeec-4eb0da45e5b3 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:34.090655 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7fb051e8-337e-4761-aeec-4eb0da45e5b3 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:34.091091 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7fb051e8-337e-4761-aeec-4eb0da45e5b3 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:34.192970 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-7fb051e8-337e-4761-aeec-4eb0da45e5b3 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Getting quotas for project 8b0670d1bd99424780a70e69d57a2166. Resources: {'ram', 'instances', 'cores'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:50:34.227833 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-7fb051e8-337e-4761-aeec-4eb0da45e5b3 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Getting quotas for user eac650232cc04810b1340dc2f0edadcc and project 8b0670d1bd99424780a70e69d57a2166. Resources: {'ram', 'instances', 'cores'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:50:34.277173 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-7fb051e8-337e-4761-aeec-4eb0da45e5b3 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Going to run 1 instances... {{(pid=128802) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:50:34.279433 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-7fb051e8-337e-4761-aeec-4eb0da45e5b3 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: db7ee8ad-13be-450c-b9a9-1da939dbc268] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='15b24725-0c99-4bcf-b1fb-907cdf8e2d63',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128802) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:50:34.424538 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-7fb051e8-337e-4761-aeec-4eb0da45e5b3 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.593853 Oct 04 20:50:34.430834 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1863/3639] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 20:50:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 3601 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 20:50:34.442175 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-d9a96e06-e81e-4386-a8de-fac01e7034e3 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:34.446788 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-d9a96e06-e81e-4386-a8de-fac01e7034e3 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] [instance: f15ae3c9-8342-4ae9-b81e-2d7b1aecb2e8] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:50:34.478158 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d9a96e06-e81e-4386-a8de-fac01e7034e3 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:34.478763 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d9a96e06-e81e-4386-a8de-fac01e7034e3 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:34.479217 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d9a96e06-e81e-4386-a8de-fac01e7034e3 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:34.479959 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d9a96e06-e81e-4386-a8de-fac01e7034e3 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:34.480421 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d9a96e06-e81e-4386-a8de-fac01e7034e3 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:34.480849 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d9a96e06-e81e-4386-a8de-fac01e7034e3 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:34.841344 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-d9a96e06-e81e-4386-a8de-fac01e7034e3 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc4171c0ee14ebb8b5eff5e910ccf49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003eb03a265a496d8981e45c74b014f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:50:34.860383 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-d9a96e06-e81e-4386-a8de-fac01e7034e3 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] 10.222.0.33 "GET /compute/v2.1/servers/f15ae3c9-8342-4ae9-b81e-2d7b1aecb2e8" status: 200 len: 1218 microversion: 2.1 time: 0.422045 Oct 04 20:50:34.861086 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1864/3640] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:50:34 2022] GET /compute/v2.1/servers/f15ae3c9-8342-4ae9-b81e-2d7b1aecb2e8 => generated 1218 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:50:34.875889 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-b90609e3-957d-4845-b514-ae8eb0b62e30 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:34.876398 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-b90609e3-957d-4845-b514-ae8eb0b62e30 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] [instance: c703a086-cf9d-4d12-8a18-623e454bcb64] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:50:34.906504 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b90609e3-957d-4845-b514-ae8eb0b62e30 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:34.907142 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b90609e3-957d-4845-b514-ae8eb0b62e30 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:34.907600 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b90609e3-957d-4845-b514-ae8eb0b62e30 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:34.908348 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b90609e3-957d-4845-b514-ae8eb0b62e30 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:34.908807 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b90609e3-957d-4845-b514-ae8eb0b62e30 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:34.910743 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-31a33f2e-c3a2-4e6b-b532-9b3c56513f9b tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8397c96a6dd4c65bdde07c91ca5e7fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09101effe9da463dabc2edaccdb83e06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:50:34.914872 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b90609e3-957d-4845-b514-ae8eb0b62e30 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:34.934115 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-31a33f2e-c3a2-4e6b-b532-9b3c56513f9b tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] 10.222.0.33 "GET /compute/v2.1/servers/0f0dfbcf-cfc3-4af8-9142-956b74ade0bd" status: 200 len: 1318 microversion: 2.1 time: 1.809039 Oct 04 20:50:34.942730 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1777/3641] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:50:33 2022] GET /compute/v2.1/servers/0f0dfbcf-cfc3-4af8-9142-956b74ade0bd => generated 1318 bytes in 1821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:50:34.944184 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=97 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:50:34.974167 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.wsgi [None req-b90609e3-957d-4845-b514-ae8eb0b62e30 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] HTTP exception thrown: Instance c703a086-cf9d-4d12-8a18-623e454bcb64 could not be found. Oct 04 20:50:34.982711 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-b90609e3-957d-4845-b514-ae8eb0b62e30 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Request method failure captured: Oct 04 20:50:34.982711 n-d-854823-8 devstack@n-api.service[128802]: request: DELETE /compute/v2.1/servers/c703a086-cf9d-4d12-8a18-623e454bcb64 HTTP/1.1 Oct 04 20:50:34.982711 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 20:50:34.982711 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 20:50:34.982711 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 20:50:34.982711 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 0 Oct 04 20:50:34.982711 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 20:50:34.982711 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 20:50:34.982711 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 20:50:34.982711 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 20:50:34.982711 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPJq81PAuDsDZpxdj7sHNmNgvbOtGh6iX1oPKSmvHZUw9x7ULWvp7QM5iDniQ-MHWL89bpVZnLKWftCcZuFrmOzCFwz5uJr5u54napWSUn77riQgg7pFlU7FKzu5ArjbUA7EV4GWtihdoiqsY9U5RhjRJWZh-5HATJMChglPcLjaAY6g Oct 04 20:50:34.982711 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 20:50:34.982711 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 20:50:34.982711 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 20:50:34.982711 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 20:50:34.982711 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 20:50:34.982711 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 20:50:34.982711 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: fc7f38600b5041ad8e66a12d77b940fa Oct 04 20:50:34.982711 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-AttachVolumeNegativeTest-16853026 Oct 04 20:50:34.982711 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 20:50:34.982711 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 20:50:34.982711 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_fc7f38600b5041ad8e66a12d77b940fa", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fc7f38600b5041ad8e66a12d77b940fa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fc7f38600b5041ad8e66a12d77b940fa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/fc7f38600b5041ad8e66a12d77b940fa"}]}] Oct 04 20:50:34.982711 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-AttachVolumeNegativeTest-16853026 Oct 04 20:50:34.982711 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: fc7f38600b5041ad8e66a12d77b940fa Oct 04 20:50:34.982711 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-16853026 Oct 04 20:50:34.982711 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-AttachVolumeNegativeTest-16853026-project Oct 04 20:50:34.982711 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 20:50:34.982711 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 20:50:34.982711 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: d9e4b00964014a0383f79597652bd428 Oct 04 20:50:34.982711 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-AttachVolumeNegativeTest-16853026-project Oct 04 20:50:34.982711 n-d-854823-8 devstack@n-api.service[128802]: method: > Oct 04 20:50:34.982711 n-d-854823-8 devstack@n-api.service[128802]: exception: Instance c703a086-cf9d-4d12-8a18-623e454bcb64 could not be found. Oct 04 20:50:34.982711 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'id': 'c703a086-cf9d-4d12-8a18-623e454bcb64'} Oct 04 20:50:34.982711 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:50:34.982711 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:50:34.982711 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:50:34.982711 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:50:34.982711 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:50:34.982711 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:50:34.982711 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:50:34.982711 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:50:34.982711 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:50:34.982711 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:50:34.982711 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c703a086-cf9d-4d12-8a18-623e454bcb64 could not be found. Oct 04 20:50:34.982711 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:50:34.982711 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:50:34.982711 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:50:34.982711 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:50:34.982711 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:50:34.982711 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:50:34.982711 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:50:34.982711 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:50:34.982711 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:50:34.982711 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:50:34.982711 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 20:50:34.982711 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 20:50:34.982711 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 20:50:34.982711 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 20:50:34.982711 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:50:34.982711 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:50:34.982711 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:50:34.982711 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:50:34.988421 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c703a086-cf9d-4d12-8a18-623e454bcb64 could not be found. Oct 04 20:50:34.988421 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:50:34.988421 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:50:34.988421 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:50:34.988421 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:50:34.988421 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:50:34.988421 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:50:34.988421 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:50:34.988421 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:50:34.988421 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c703a086-cf9d-4d12-8a18-623e454bcb64 could not be found. Oct 04 20:50:34.988421 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:50:34.989863 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-31e911e4-8139-4905-b7a2-5eadd2fc7345 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:34.989863 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-31e911e4-8139-4905-b7a2-5eadd2fc7345 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: db7ee8ad-13be-450c-b9a9-1da939dbc268] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:50:34.991488 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-b90609e3-957d-4845-b514-ae8eb0b62e30 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Returning 404 to user: Instance c703a086-cf9d-4d12-8a18-623e454bcb64 could not be found. {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:50:34.992596 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-b90609e3-957d-4845-b514-ae8eb0b62e30 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] 10.222.0.33 "DELETE /compute/v2.1/servers/c703a086-cf9d-4d12-8a18-623e454bcb64" status: 404 len: 111 microversion: 2.1 time: 0.130603 Oct 04 20:50:34.994427 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1865/3642] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 20:50:34 2022] DELETE /compute/v2.1/servers/c703a086-cf9d-4d12-8a18-623e454bcb64 => generated 111 bytes in 133 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:50:35.011923 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-89ffffaa-964d-44e8-ae10-b7ba2e20a87f tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:35.012877 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-89ffffaa-964d-44e8-ae10-b7ba2e20a87f tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] [instance: c703a086-cf9d-4d12-8a18-623e454bcb64] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:50:35.025128 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=6 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:50:35.026916 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-89ffffaa-964d-44e8-ae10-b7ba2e20a87f tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:35.034674 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-89ffffaa-964d-44e8-ae10-b7ba2e20a87f tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:35.035503 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-89ffffaa-964d-44e8-ae10-b7ba2e20a87f tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:35.036463 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-89ffffaa-964d-44e8-ae10-b7ba2e20a87f tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:35.037130 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-89ffffaa-964d-44e8-ae10-b7ba2e20a87f tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:35.037773 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-89ffffaa-964d-44e8-ae10-b7ba2e20a87f tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:35.071451 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.wsgi [None req-89ffffaa-964d-44e8-ae10-b7ba2e20a87f tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] HTTP exception thrown: Instance c703a086-cf9d-4d12-8a18-623e454bcb64 could not be found. Oct 04 20:50:35.080680 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-89ffffaa-964d-44e8-ae10-b7ba2e20a87f tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Request method failure captured: Oct 04 20:50:35.080680 n-d-854823-8 devstack@n-api.service[128802]: request: GET /compute/v2.1/servers/c703a086-cf9d-4d12-8a18-623e454bcb64 HTTP/1.1 Oct 04 20:50:35.080680 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 20:50:35.080680 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 20:50:35.080680 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 20:50:35.080680 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 0 Oct 04 20:50:35.080680 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 20:50:35.080680 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 20:50:35.080680 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 20:50:35.080680 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 20:50:35.080680 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPJq81PAuDsDZpxdj7sHNmNgvbOtGh6iX1oPKSmvHZUw9x7ULWvp7QM5iDniQ-MHWL89bpVZnLKWftCcZuFrmOzCFwz5uJr5u54napWSUn77riQgg7pFlU7FKzu5ArjbUA7EV4GWtihdoiqsY9U5RhjRJWZh-5HATJMChglPcLjaAY6g Oct 04 20:50:35.080680 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 20:50:35.080680 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 20:50:35.080680 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 20:50:35.080680 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 20:50:35.080680 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 20:50:35.080680 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 20:50:35.080680 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: fc7f38600b5041ad8e66a12d77b940fa Oct 04 20:50:35.080680 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-AttachVolumeNegativeTest-16853026 Oct 04 20:50:35.080680 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 20:50:35.080680 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 20:50:35.080680 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_fc7f38600b5041ad8e66a12d77b940fa", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fc7f38600b5041ad8e66a12d77b940fa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fc7f38600b5041ad8e66a12d77b940fa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/fc7f38600b5041ad8e66a12d77b940fa"}]}] Oct 04 20:50:35.080680 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-AttachVolumeNegativeTest-16853026 Oct 04 20:50:35.080680 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: fc7f38600b5041ad8e66a12d77b940fa Oct 04 20:50:35.080680 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-16853026 Oct 04 20:50:35.080680 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-AttachVolumeNegativeTest-16853026-project Oct 04 20:50:35.080680 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 20:50:35.080680 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 20:50:35.080680 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: d9e4b00964014a0383f79597652bd428 Oct 04 20:50:35.080680 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-AttachVolumeNegativeTest-16853026-project Oct 04 20:50:35.080680 n-d-854823-8 devstack@n-api.service[128802]: method: > Oct 04 20:50:35.080680 n-d-854823-8 devstack@n-api.service[128802]: exception: Instance c703a086-cf9d-4d12-8a18-623e454bcb64 could not be found. Oct 04 20:50:35.080680 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'id': 'c703a086-cf9d-4d12-8a18-623e454bcb64'} Oct 04 20:50:35.080680 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:50:35.080680 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:50:35.080680 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:50:35.080680 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:50:35.080680 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:50:35.080680 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:50:35.080680 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:50:35.080680 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:50:35.080680 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:50:35.080680 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:50:35.080680 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c703a086-cf9d-4d12-8a18-623e454bcb64 could not be found. Oct 04 20:50:35.080680 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:50:35.080680 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:50:35.080680 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:50:35.080680 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:50:35.080680 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:50:35.080680 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:50:35.080680 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:50:35.080680 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:50:35.080680 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:50:35.080680 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:50:35.080680 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:50:35.080680 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:50:35.080680 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:50:35.080680 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:50:35.080680 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:50:35.080680 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:50:35.080680 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c703a086-cf9d-4d12-8a18-623e454bcb64 could not be found. Oct 04 20:50:35.080680 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:50:35.080680 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:50:35.080680 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:50:35.086110 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:50:35.086110 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:50:35.086110 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:50:35.086110 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:50:35.086110 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:50:35.086110 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c703a086-cf9d-4d12-8a18-623e454bcb64 could not be found. Oct 04 20:50:35.086110 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:50:35.086110 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-89ffffaa-964d-44e8-ae10-b7ba2e20a87f tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Returning 404 to user: Instance c703a086-cf9d-4d12-8a18-623e454bcb64 could not be found. {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:50:35.088953 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-89ffffaa-964d-44e8-ae10-b7ba2e20a87f tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] 10.222.0.33 "GET /compute/v2.1/servers/c703a086-cf9d-4d12-8a18-623e454bcb64" status: 404 len: 111 microversion: 2.1 time: 0.086452 Oct 04 20:50:35.091953 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1866/3643] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:50:34 2022] GET /compute/v2.1/servers/c703a086-cf9d-4d12-8a18-623e454bcb64 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:50:35.118946 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-9140610c-771a-4fb1-a4c2-fbf99980b975 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:35.126087 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-9140610c-771a-4fb1-a4c2-fbf99980b975 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] [instance: 07fdb076-59a4-4c77-a42b-07fa92bcf408] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:50:35.144792 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9140610c-771a-4fb1-a4c2-fbf99980b975 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:35.145377 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9140610c-771a-4fb1-a4c2-fbf99980b975 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:35.145891 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9140610c-771a-4fb1-a4c2-fbf99980b975 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:35.146745 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9140610c-771a-4fb1-a4c2-fbf99980b975 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:35.151018 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9140610c-771a-4fb1-a4c2-fbf99980b975 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:35.151517 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9140610c-771a-4fb1-a4c2-fbf99980b975 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:35.168741 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.wsgi [None req-9140610c-771a-4fb1-a4c2-fbf99980b975 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] HTTP exception thrown: Instance 07fdb076-59a4-4c77-a42b-07fa92bcf408 could not be found. Oct 04 20:50:35.174381 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-9140610c-771a-4fb1-a4c2-fbf99980b975 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Request method failure captured: Oct 04 20:50:35.174381 n-d-854823-8 devstack@n-api.service[128802]: request: DELETE /compute/v2.1/servers/07fdb076-59a4-4c77-a42b-07fa92bcf408 HTTP/1.1 Oct 04 20:50:35.174381 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 20:50:35.174381 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 20:50:35.174381 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 20:50:35.174381 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 0 Oct 04 20:50:35.174381 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 20:50:35.174381 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 20:50:35.174381 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 20:50:35.174381 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 20:50:35.174381 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPJq81PAuDsDZpxdj7sHNmNgvbOtGh6iX1oPKSmvHZUw9x7ULWvp7QM5iDniQ-MHWL89bpVZnLKWftCcZuFrmOzCFwz5uJr5u54napWSUn77riQgg7pFlU7FKzu5ArjbUA7EV4GWtihdoiqsY9U5RhjRJWZh-5HATJMChglPcLjaAY6g Oct 04 20:50:35.174381 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 20:50:35.174381 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 20:50:35.174381 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 20:50:35.174381 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 20:50:35.174381 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 20:50:35.174381 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 20:50:35.174381 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: fc7f38600b5041ad8e66a12d77b940fa Oct 04 20:50:35.174381 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-AttachVolumeNegativeTest-16853026 Oct 04 20:50:35.174381 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 20:50:35.174381 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 20:50:35.174381 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_fc7f38600b5041ad8e66a12d77b940fa", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fc7f38600b5041ad8e66a12d77b940fa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fc7f38600b5041ad8e66a12d77b940fa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/fc7f38600b5041ad8e66a12d77b940fa"}]}] Oct 04 20:50:35.174381 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-AttachVolumeNegativeTest-16853026 Oct 04 20:50:35.174381 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: fc7f38600b5041ad8e66a12d77b940fa Oct 04 20:50:35.174381 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-16853026 Oct 04 20:50:35.174381 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-AttachVolumeNegativeTest-16853026-project Oct 04 20:50:35.174381 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 20:50:35.174381 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 20:50:35.174381 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: d9e4b00964014a0383f79597652bd428 Oct 04 20:50:35.174381 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-AttachVolumeNegativeTest-16853026-project Oct 04 20:50:35.174381 n-d-854823-8 devstack@n-api.service[128802]: method: > Oct 04 20:50:35.174381 n-d-854823-8 devstack@n-api.service[128802]: exception: Instance 07fdb076-59a4-4c77-a42b-07fa92bcf408 could not be found. Oct 04 20:50:35.174381 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'id': '07fdb076-59a4-4c77-a42b-07fa92bcf408'} Oct 04 20:50:35.174381 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:50:35.174381 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:50:35.174381 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:50:35.174381 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:50:35.174381 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:50:35.174381 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:50:35.174381 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:50:35.174381 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:50:35.174381 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:50:35.174381 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:50:35.174381 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 07fdb076-59a4-4c77-a42b-07fa92bcf408 could not be found. Oct 04 20:50:35.174381 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:50:35.174381 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:50:35.174381 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:50:35.174381 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:50:35.174381 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:50:35.174381 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:50:35.174381 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:50:35.174381 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:50:35.174381 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:50:35.174381 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:50:35.174381 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 20:50:35.174381 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 20:50:35.174381 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 20:50:35.174381 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 20:50:35.174381 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:50:35.174381 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:50:35.174381 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:50:35.174381 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:50:35.180107 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 07fdb076-59a4-4c77-a42b-07fa92bcf408 could not be found. Oct 04 20:50:35.180107 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:50:35.180107 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:50:35.180107 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:50:35.180107 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:50:35.180107 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:50:35.180107 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:50:35.180107 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:50:35.180107 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:50:35.180107 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 07fdb076-59a4-4c77-a42b-07fa92bcf408 could not be found. Oct 04 20:50:35.180107 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:50:35.181924 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-9140610c-771a-4fb1-a4c2-fbf99980b975 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Returning 404 to user: Instance 07fdb076-59a4-4c77-a42b-07fa92bcf408 could not be found. {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:50:35.184012 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-9140610c-771a-4fb1-a4c2-fbf99980b975 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] 10.222.0.33 "DELETE /compute/v2.1/servers/07fdb076-59a4-4c77-a42b-07fa92bcf408" status: 404 len: 111 microversion: 2.1 time: 0.085737 Oct 04 20:50:35.201676 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1867/3644] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 20:50:35 2022] DELETE /compute/v2.1/servers/07fdb076-59a4-4c77-a42b-07fa92bcf408 => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:50:35.216413 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-237d1f11-c522-47da-8684-c2d198c7be5d tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:35.217051 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-237d1f11-c522-47da-8684-c2d198c7be5d tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] [instance: 07fdb076-59a4-4c77-a42b-07fa92bcf408] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:50:35.236316 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-237d1f11-c522-47da-8684-c2d198c7be5d tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:35.239550 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-237d1f11-c522-47da-8684-c2d198c7be5d tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:35.240262 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-237d1f11-c522-47da-8684-c2d198c7be5d tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:35.242943 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-237d1f11-c522-47da-8684-c2d198c7be5d tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:35.245569 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-237d1f11-c522-47da-8684-c2d198c7be5d tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:35.246762 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-237d1f11-c522-47da-8684-c2d198c7be5d tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:35.261919 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-31e911e4-8139-4905-b7a2-5eadd2fc7345 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac650232cc04810b1340dc2f0edadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b0670d1bd99424780a70e69d57a2166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:50:35.288371 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-31e911e4-8139-4905-b7a2-5eadd2fc7345 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "GET /compute/v2.1/servers/db7ee8ad-13be-450c-b9a9-1da939dbc268" status: 200 len: 1215 microversion: 2.1 time: 0.321386 Oct 04 20:50:35.304253 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1778/3645] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:50:34 2022] GET /compute/v2.1/servers/db7ee8ad-13be-450c-b9a9-1da939dbc268 => generated 1215 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:50:35.315058 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.wsgi [None req-237d1f11-c522-47da-8684-c2d198c7be5d tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] HTTP exception thrown: Instance 07fdb076-59a4-4c77-a42b-07fa92bcf408 could not be found. Oct 04 20:50:35.321325 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-237d1f11-c522-47da-8684-c2d198c7be5d tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Request method failure captured: Oct 04 20:50:35.321325 n-d-854823-8 devstack@n-api.service[128802]: request: GET /compute/v2.1/servers/07fdb076-59a4-4c77-a42b-07fa92bcf408 HTTP/1.1 Oct 04 20:50:35.321325 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 20:50:35.321325 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 20:50:35.321325 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 20:50:35.321325 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 0 Oct 04 20:50:35.321325 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 20:50:35.321325 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 20:50:35.321325 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 20:50:35.321325 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 20:50:35.321325 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPJq81PAuDsDZpxdj7sHNmNgvbOtGh6iX1oPKSmvHZUw9x7ULWvp7QM5iDniQ-MHWL89bpVZnLKWftCcZuFrmOzCFwz5uJr5u54napWSUn77riQgg7pFlU7FKzu5ArjbUA7EV4GWtihdoiqsY9U5RhjRJWZh-5HATJMChglPcLjaAY6g Oct 04 20:50:35.321325 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 20:50:35.321325 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 20:50:35.321325 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 20:50:35.321325 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 20:50:35.321325 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 20:50:35.321325 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 20:50:35.321325 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: fc7f38600b5041ad8e66a12d77b940fa Oct 04 20:50:35.321325 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-AttachVolumeNegativeTest-16853026 Oct 04 20:50:35.321325 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 20:50:35.321325 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 20:50:35.321325 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_fc7f38600b5041ad8e66a12d77b940fa", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fc7f38600b5041ad8e66a12d77b940fa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fc7f38600b5041ad8e66a12d77b940fa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/fc7f38600b5041ad8e66a12d77b940fa"}]}] Oct 04 20:50:35.321325 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-AttachVolumeNegativeTest-16853026 Oct 04 20:50:35.321325 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: fc7f38600b5041ad8e66a12d77b940fa Oct 04 20:50:35.321325 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-16853026 Oct 04 20:50:35.321325 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-AttachVolumeNegativeTest-16853026-project Oct 04 20:50:35.321325 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 20:50:35.321325 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 20:50:35.321325 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: d9e4b00964014a0383f79597652bd428 Oct 04 20:50:35.321325 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-AttachVolumeNegativeTest-16853026-project Oct 04 20:50:35.321325 n-d-854823-8 devstack@n-api.service[128802]: method: > Oct 04 20:50:35.321325 n-d-854823-8 devstack@n-api.service[128802]: exception: Instance 07fdb076-59a4-4c77-a42b-07fa92bcf408 could not be found. Oct 04 20:50:35.321325 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'id': '07fdb076-59a4-4c77-a42b-07fa92bcf408'} Oct 04 20:50:35.321325 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:50:35.321325 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:50:35.321325 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:50:35.321325 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:50:35.321325 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:50:35.321325 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:50:35.321325 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:50:35.321325 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:50:35.321325 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:50:35.321325 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:50:35.321325 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 07fdb076-59a4-4c77-a42b-07fa92bcf408 could not be found. Oct 04 20:50:35.321325 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:50:35.321325 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:50:35.321325 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:50:35.321325 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:50:35.321325 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:50:35.321325 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:50:35.321325 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:50:35.321325 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:50:35.321325 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:50:35.321325 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:50:35.321325 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:50:35.321325 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:50:35.321325 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:50:35.321325 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:50:35.321325 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:50:35.321325 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:50:35.321325 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 07fdb076-59a4-4c77-a42b-07fa92bcf408 could not be found. Oct 04 20:50:35.321325 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:50:35.321325 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:50:35.321325 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:50:35.326766 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:50:35.326766 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:50:35.326766 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:50:35.326766 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:50:35.326766 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:50:35.326766 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 07fdb076-59a4-4c77-a42b-07fa92bcf408 could not be found. Oct 04 20:50:35.326766 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:50:35.329363 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-237d1f11-c522-47da-8684-c2d198c7be5d tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Returning 404 to user: Instance 07fdb076-59a4-4c77-a42b-07fa92bcf408 could not be found. {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:50:35.330475 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-237d1f11-c522-47da-8684-c2d198c7be5d tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] 10.222.0.33 "GET /compute/v2.1/servers/07fdb076-59a4-4c77-a42b-07fa92bcf408" status: 404 len: 111 microversion: 2.1 time: 0.126699 Oct 04 20:50:35.337141 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1868/3646] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:50:35 2022] GET /compute/v2.1/servers/07fdb076-59a4-4c77-a42b-07fa92bcf408 => generated 111 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:50:35.890414 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-83a5c948-700a-4729-8bf7-dba0e055e5c7 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:35.890999 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-83a5c948-700a-4729-8bf7-dba0e055e5c7 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] [instance: f15ae3c9-8342-4ae9-b81e-2d7b1aecb2e8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:50:35.905449 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-83a5c948-700a-4729-8bf7-dba0e055e5c7 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:35.909408 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-83a5c948-700a-4729-8bf7-dba0e055e5c7 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:35.915066 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-83a5c948-700a-4729-8bf7-dba0e055e5c7 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:35.916515 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-83a5c948-700a-4729-8bf7-dba0e055e5c7 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:35.918179 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-83a5c948-700a-4729-8bf7-dba0e055e5c7 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:35.918833 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-83a5c948-700a-4729-8bf7-dba0e055e5c7 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:35.971854 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-0aedf3f4-ac15-46ad-8e67-5157f1e4a76c tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:35.972882 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-0aedf3f4-ac15-46ad-8e67-5157f1e4a76c tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] [instance: 0f0dfbcf-cfc3-4af8-9142-956b74ade0bd] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:50:35.992580 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0aedf3f4-ac15-46ad-8e67-5157f1e4a76c tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:35.993106 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0aedf3f4-ac15-46ad-8e67-5157f1e4a76c tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:35.993561 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0aedf3f4-ac15-46ad-8e67-5157f1e4a76c tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:35.994323 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0aedf3f4-ac15-46ad-8e67-5157f1e4a76c tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:35.994812 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0aedf3f4-ac15-46ad-8e67-5157f1e4a76c tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:35.995246 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0aedf3f4-ac15-46ad-8e67-5157f1e4a76c tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:36.330281 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-83a5c948-700a-4729-8bf7-dba0e055e5c7 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc4171c0ee14ebb8b5eff5e910ccf49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003eb03a265a496d8981e45c74b014f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:50:36.340152 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-83a5c948-700a-4729-8bf7-dba0e055e5c7 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] 10.222.0.33 "GET /compute/v2.1/servers/f15ae3c9-8342-4ae9-b81e-2d7b1aecb2e8" status: 200 len: 1274 microversion: 2.1 time: 0.456701 Oct 04 20:50:36.343022 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1779/3647] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:50:35 2022] GET /compute/v2.1/servers/f15ae3c9-8342-4ae9-b81e-2d7b1aecb2e8 => generated 1274 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:50:36.361251 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-80f546d7-88b4-4a2b-bfb4-92353e75b821 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Action: 'create', calling method: .version_select at 0x7f3c742f5f70>, body: {"keypair": {"name": "tempest-keypair-1194998426", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFxPmok8sNmxUuieJX3H2/8EBSzN+8NMY0VAc8DJh9/mcJy0Yb9/hSsxBKF95HqwUC4YvwJ/vaDwGWrjsB86deu9fD493sqVRnxdmlVdPdTR7lz0hTJs71ZiI1up1ONuCw=="}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:50:36.427882 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-80f546d7-88b4-4a2b-bfb4-92353e75b821 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Getting quotas for project 659f3d4023b347d58bc0361db9ceead9. Resources: {'key_pairs'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:50:36.443668 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-80f546d7-88b4-4a2b-bfb4-92353e75b821 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Getting quotas for user b78af5c0485b4343900269160ef3e508 and project 659f3d4023b347d58bc0361db9ceead9. Resources: {'key_pairs'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:50:36.579349 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-80f546d7-88b4-4a2b-bfb4-92353e75b821 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.42 time: 0.233426 Oct 04 20:50:36.585412 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1780/3648] 10.222.0.33 () {62 vars in 1200 bytes} [Tue Oct 4 20:50:36 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 240 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 04 20:50:36.607984 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-fd96d774-e17d-4580-a3dc-4b71b2b9e1f3 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:36.609524 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-fd96d774-e17d-4580-a3dc-4b71b2b9e1f3 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: db7ee8ad-13be-450c-b9a9-1da939dbc268] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:50:36.648151 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fd96d774-e17d-4580-a3dc-4b71b2b9e1f3 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:36.654382 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fd96d774-e17d-4580-a3dc-4b71b2b9e1f3 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:36.657377 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fd96d774-e17d-4580-a3dc-4b71b2b9e1f3 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:36.658614 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fd96d774-e17d-4580-a3dc-4b71b2b9e1f3 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:36.660592 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fd96d774-e17d-4580-a3dc-4b71b2b9e1f3 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:36.664372 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fd96d774-e17d-4580-a3dc-4b71b2b9e1f3 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:37.120694 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-fd96d774-e17d-4580-a3dc-4b71b2b9e1f3 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac650232cc04810b1340dc2f0edadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b0670d1bd99424780a70e69d57a2166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:50:37.138945 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-fd96d774-e17d-4580-a3dc-4b71b2b9e1f3 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "GET /compute/v2.1/servers/db7ee8ad-13be-450c-b9a9-1da939dbc268" status: 200 len: 1267 microversion: 2.1 time: 0.543181 Oct 04 20:50:37.164830 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1781/3649] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:50:36 2022] GET /compute/v2.1/servers/db7ee8ad-13be-450c-b9a9-1da939dbc268 => generated 1267 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:50:37.175250 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e97e3f2d-fcd1-4b56-8bc9-88cc9cc4cec3 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:37.176326 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e97e3f2d-fcd1-4b56-8bc9-88cc9cc4cec3 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] [instance: 917274da-5116-42df-84b5-a30b85d40913] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:50:37.200135 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e97e3f2d-fcd1-4b56-8bc9-88cc9cc4cec3 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:37.201601 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e97e3f2d-fcd1-4b56-8bc9-88cc9cc4cec3 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:37.204727 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e97e3f2d-fcd1-4b56-8bc9-88cc9cc4cec3 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:37.205741 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e97e3f2d-fcd1-4b56-8bc9-88cc9cc4cec3 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:37.208049 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e97e3f2d-fcd1-4b56-8bc9-88cc9cc4cec3 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:37.209421 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e97e3f2d-fcd1-4b56-8bc9-88cc9cc4cec3 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:37.282782 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e97e3f2d-fcd1-4b56-8bc9-88cc9cc4cec3 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] [instance: 917274da-5116-42df-84b5-a30b85d40913] Going to try to terminate instance {{(pid=128801) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:50:37.416537 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:50:37.444580 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-0aedf3f4-ac15-46ad-8e67-5157f1e4a76c tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8397c96a6dd4c65bdde07c91ca5e7fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09101effe9da463dabc2edaccdb83e06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:50:37.473656 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-0aedf3f4-ac15-46ad-8e67-5157f1e4a76c tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] 10.222.0.33 "GET /compute/v2.1/servers/0f0dfbcf-cfc3-4af8-9142-956b74ade0bd" status: 200 len: 1318 microversion: 2.1 time: 1.496998 Oct 04 20:50:37.476872 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1869/3650] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:50:35 2022] GET /compute/v2.1/servers/0f0dfbcf-cfc3-4af8-9142-956b74ade0bd => generated 1318 bytes in 1512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:50:37.494175 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-bb037759-8539-43df-8659-ba4029cf68d1 req-4aa6bc03-3e36-4856-ba1d-df74b88a5bb9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f0dfbcf-cfc3-4af8-9142-956b74ade0bd", "tag": "c76b8ecf-b973-4c9a-a65e-80e935c2c4ea"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:50:37.522832 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-bb037759-8539-43df-8659-ba4029cf68d1 req-4aa6bc03-3e36-4856-ba1d-df74b88a5bb9 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:37.524255 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-bb037759-8539-43df-8659-ba4029cf68d1 req-4aa6bc03-3e36-4856-ba1d-df74b88a5bb9 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:37.524865 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-bb037759-8539-43df-8659-ba4029cf68d1 req-4aa6bc03-3e36-4856-ba1d-df74b88a5bb9 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:37.531124 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e97e3f2d-fcd1-4b56-8bc9-88cc9cc4cec3 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] 10.222.0.33 "DELETE /compute/v2.1/servers/917274da-5116-42df-84b5-a30b85d40913" status: 204 len: 0 microversion: 2.1 time: 0.364126 Oct 04 20:50:37.532375 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1782/3651] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 20:50:37 2022] DELETE /compute/v2.1/servers/917274da-5116-42df-84b5-a30b85d40913 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:50:37.551534 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c4fcddd8-2926-44be-8426-834821ed9cd6 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:37.552270 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c4fcddd8-2926-44be-8426-834821ed9cd6 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] [instance: f15ae3c9-8342-4ae9-b81e-2d7b1aecb2e8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:50:37.562658 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-bb037759-8539-43df-8659-ba4029cf68d1 req-4aa6bc03-3e36-4856-ba1d-df74b88a5bb9 service nova] Creating event network-changed:c76b8ecf-b973-4c9a-a65e-80e935c2c4ea for instance 0f0dfbcf-cfc3-4af8-9142-956b74ade0bd on n-h2-854823-8 Oct 04 20:50:37.571336 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c4fcddd8-2926-44be-8426-834821ed9cd6 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:37.571454 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c4fcddd8-2926-44be-8426-834821ed9cd6 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:37.571905 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c4fcddd8-2926-44be-8426-834821ed9cd6 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:37.583411 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-bb037759-8539-43df-8659-ba4029cf68d1 req-4aa6bc03-3e36-4856-ba1d-df74b88a5bb9 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104993 Oct 04 20:50:37.584276 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c4fcddd8-2926-44be-8426-834821ed9cd6 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:37.584890 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c4fcddd8-2926-44be-8426-834821ed9cd6 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:37.585589 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c4fcddd8-2926-44be-8426-834821ed9cd6 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:37.588729 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1870/3652] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:50:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:50:37.599433 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-788b916f-2c52-4286-909d-b83f74475c69 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:37.600159 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-788b916f-2c52-4286-909d-b83f74475c69 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] [instance: 917274da-5116-42df-84b5-a30b85d40913] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:50:37.620018 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-788b916f-2c52-4286-909d-b83f74475c69 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:37.620514 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-788b916f-2c52-4286-909d-b83f74475c69 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:37.620991 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-788b916f-2c52-4286-909d-b83f74475c69 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:37.622215 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-788b916f-2c52-4286-909d-b83f74475c69 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:37.622877 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-788b916f-2c52-4286-909d-b83f74475c69 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:37.623321 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-788b916f-2c52-4286-909d-b83f74475c69 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:37.832137 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c4fcddd8-2926-44be-8426-834821ed9cd6 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc4171c0ee14ebb8b5eff5e910ccf49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003eb03a265a496d8981e45c74b014f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:50:37.854580 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c4fcddd8-2926-44be-8426-834821ed9cd6 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] 10.222.0.33 "GET /compute/v2.1/servers/f15ae3c9-8342-4ae9-b81e-2d7b1aecb2e8" status: 200 len: 1280 microversion: 2.1 time: 0.318138 Oct 04 20:50:37.856370 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1783/3653] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:50:37 2022] GET /compute/v2.1/servers/f15ae3c9-8342-4ae9-b81e-2d7b1aecb2e8 => generated 1280 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:50:38.102774 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-788b916f-2c52-4286-909d-b83f74475c69 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c208ec9faf491385a9ab5b5932098d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ae4960393c464c97669731c2084d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:50:38.117732 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-788b916f-2c52-4286-909d-b83f74475c69 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] 10.222.0.33 "GET /compute/v2.1/servers/917274da-5116-42df-84b5-a30b85d40913" status: 200 len: 1553 microversion: 2.1 time: 0.525348 Oct 04 20:50:38.136691 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1871/3654] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:50:37 2022] GET /compute/v2.1/servers/917274da-5116-42df-84b5-a30b85d40913 => generated 1553 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:50:38.167802 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-36a0d2ab-f261-45cb-87c3-3d15636ac467 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:38.168414 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-36a0d2ab-f261-45cb-87c3-3d15636ac467 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: db7ee8ad-13be-450c-b9a9-1da939dbc268] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:50:38.179272 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-36a0d2ab-f261-45cb-87c3-3d15636ac467 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:38.180089 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-36a0d2ab-f261-45cb-87c3-3d15636ac467 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:38.180717 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-36a0d2ab-f261-45cb-87c3-3d15636ac467 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:38.181595 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-36a0d2ab-f261-45cb-87c3-3d15636ac467 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:38.182217 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-36a0d2ab-f261-45cb-87c3-3d15636ac467 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:38.182845 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-36a0d2ab-f261-45cb-87c3-3d15636ac467 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:38.286514 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-36a0d2ab-f261-45cb-87c3-3d15636ac467 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac650232cc04810b1340dc2f0edadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b0670d1bd99424780a70e69d57a2166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:50:38.308277 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-36a0d2ab-f261-45cb-87c3-3d15636ac467 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "GET /compute/v2.1/servers/db7ee8ad-13be-450c-b9a9-1da939dbc268" status: 200 len: 1273 microversion: 2.1 time: 0.144158 Oct 04 20:50:38.312170 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1784/3655] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:50:38 2022] GET /compute/v2.1/servers/db7ee8ad-13be-450c-b9a9-1da939dbc268 => generated 1273 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:50:38.499552 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-b52f593d-47b6-4fe3-b6b6-f4548a363b71 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:38.501536 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-b52f593d-47b6-4fe3-b6b6-f4548a363b71 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] [instance: 0f0dfbcf-cfc3-4af8-9142-956b74ade0bd] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:50:38.513732 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b52f593d-47b6-4fe3-b6b6-f4548a363b71 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:38.515301 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b52f593d-47b6-4fe3-b6b6-f4548a363b71 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:38.516253 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b52f593d-47b6-4fe3-b6b6-f4548a363b71 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:38.517346 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b52f593d-47b6-4fe3-b6b6-f4548a363b71 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:38.518104 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b52f593d-47b6-4fe3-b6b6-f4548a363b71 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:38.518817 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b52f593d-47b6-4fe3-b6b6-f4548a363b71 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:38.847678 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-b52f593d-47b6-4fe3-b6b6-f4548a363b71 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8397c96a6dd4c65bdde07c91ca5e7fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09101effe9da463dabc2edaccdb83e06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:50:38.863264 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-b52f593d-47b6-4fe3-b6b6-f4548a363b71 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] 10.222.0.33 "GET /compute/v2.1/servers/0f0dfbcf-cfc3-4af8-9142-956b74ade0bd" status: 200 len: 1318 microversion: 2.1 time: 0.363387 Oct 04 20:50:38.866548 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1872/3656] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:50:38 2022] GET /compute/v2.1/servers/0f0dfbcf-cfc3-4af8-9142-956b74ade0bd => generated 1318 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:50:38.882321 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8e8cb971-0bb1-4215-a997-587aaabc4b5a tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:38.883372 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-8e8cb971-0bb1-4215-a997-587aaabc4b5a tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] [instance: f15ae3c9-8342-4ae9-b81e-2d7b1aecb2e8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:50:38.898378 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8e8cb971-0bb1-4215-a997-587aaabc4b5a tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:38.899985 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8e8cb971-0bb1-4215-a997-587aaabc4b5a tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:38.901792 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8e8cb971-0bb1-4215-a997-587aaabc4b5a tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:38.903150 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8e8cb971-0bb1-4215-a997-587aaabc4b5a tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:38.905138 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8e8cb971-0bb1-4215-a997-587aaabc4b5a tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:38.906912 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8e8cb971-0bb1-4215-a997-587aaabc4b5a tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:39.147108 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-dc27cac4-75de-4cdd-bd59-518d8c2889f5 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:39.147761 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-dc27cac4-75de-4cdd-bd59-518d8c2889f5 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] [instance: 917274da-5116-42df-84b5-a30b85d40913] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:50:39.155998 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dc27cac4-75de-4cdd-bd59-518d8c2889f5 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:39.156497 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dc27cac4-75de-4cdd-bd59-518d8c2889f5 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:39.156942 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dc27cac4-75de-4cdd-bd59-518d8c2889f5 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:39.157655 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dc27cac4-75de-4cdd-bd59-518d8c2889f5 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:39.158117 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dc27cac4-75de-4cdd-bd59-518d8c2889f5 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:39.158591 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dc27cac4-75de-4cdd-bd59-518d8c2889f5 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:39.862263 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-8e8cb971-0bb1-4215-a997-587aaabc4b5a tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc4171c0ee14ebb8b5eff5e910ccf49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003eb03a265a496d8981e45c74b014f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:50:39.879522 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-8e8cb971-0bb1-4215-a997-587aaabc4b5a tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] 10.222.0.33 "GET /compute/v2.1/servers/f15ae3c9-8342-4ae9-b81e-2d7b1aecb2e8" status: 200 len: 1322 microversion: 2.1 time: 1.002496 Oct 04 20:50:39.895210 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1785/3657] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:50:38 2022] GET /compute/v2.1/servers/f15ae3c9-8342-4ae9-b81e-2d7b1aecb2e8 => generated 1322 bytes in 1019 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:50:39.906410 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d7810681-aa74-4231-a25f-5b1d744b2086 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:39.907394 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d7810681-aa74-4231-a25f-5b1d744b2086 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: db7ee8ad-13be-450c-b9a9-1da939dbc268] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:50:39.913843 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d7810681-aa74-4231-a25f-5b1d744b2086 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:39.914986 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d7810681-aa74-4231-a25f-5b1d744b2086 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:39.916844 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d7810681-aa74-4231-a25f-5b1d744b2086 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:39.917770 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d7810681-aa74-4231-a25f-5b1d744b2086 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:39.918421 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d7810681-aa74-4231-a25f-5b1d744b2086 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:39.919008 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d7810681-aa74-4231-a25f-5b1d744b2086 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:40.084195 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d7810681-aa74-4231-a25f-5b1d744b2086 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac650232cc04810b1340dc2f0edadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b0670d1bd99424780a70e69d57a2166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:50:40.097035 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d7810681-aa74-4231-a25f-5b1d744b2086 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "GET /compute/v2.1/servers/db7ee8ad-13be-450c-b9a9-1da939dbc268" status: 200 len: 1273 microversion: 2.1 time: 0.199254 Oct 04 20:50:40.099665 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1786/3658] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:50:39 2022] GET /compute/v2.1/servers/db7ee8ad-13be-450c-b9a9-1da939dbc268 => generated 1273 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:50:40.112605 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a348dd72-a614-4cff-9625-81f498881f59 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:40.114125 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a348dd72-a614-4cff-9625-81f498881f59 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] [instance: 0f0dfbcf-cfc3-4af8-9142-956b74ade0bd] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:50:40.127579 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a348dd72-a614-4cff-9625-81f498881f59 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:40.128451 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a348dd72-a614-4cff-9625-81f498881f59 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:40.129058 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a348dd72-a614-4cff-9625-81f498881f59 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:40.131760 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a348dd72-a614-4cff-9625-81f498881f59 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:40.133022 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a348dd72-a614-4cff-9625-81f498881f59 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:40.133887 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a348dd72-a614-4cff-9625-81f498881f59 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:40.164027 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-dc27cac4-75de-4cdd-bd59-518d8c2889f5 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c208ec9faf491385a9ab5b5932098d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ae4960393c464c97669731c2084d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:50:40.177803 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-dc27cac4-75de-4cdd-bd59-518d8c2889f5 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] 10.222.0.33 "GET /compute/v2.1/servers/917274da-5116-42df-84b5-a30b85d40913" status: 200 len: 1553 microversion: 2.1 time: 1.034585 Oct 04 20:50:40.197199 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1873/3659] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:50:39 2022] GET /compute/v2.1/servers/917274da-5116-42df-84b5-a30b85d40913 => generated 1553 bytes in 1038 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:50:40.912370 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-c03dfc65-02eb-40ac-a597-fe983f3edae5 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:40.913476 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-c03dfc65-02eb-40ac-a597-fe983f3edae5 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] [instance: f15ae3c9-8342-4ae9-b81e-2d7b1aecb2e8] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:50:40.937617 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c03dfc65-02eb-40ac-a597-fe983f3edae5 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:40.942379 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c03dfc65-02eb-40ac-a597-fe983f3edae5 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:40.943496 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c03dfc65-02eb-40ac-a597-fe983f3edae5 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:40.947314 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c03dfc65-02eb-40ac-a597-fe983f3edae5 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:40.947314 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c03dfc65-02eb-40ac-a597-fe983f3edae5 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:40.947565 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c03dfc65-02eb-40ac-a597-fe983f3edae5 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:41.110734 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-a348dd72-a614-4cff-9625-81f498881f59 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8397c96a6dd4c65bdde07c91ca5e7fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09101effe9da463dabc2edaccdb83e06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:50:41.120361 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a348dd72-a614-4cff-9625-81f498881f59 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] 10.222.0.33 "GET /compute/v2.1/servers/0f0dfbcf-cfc3-4af8-9142-956b74ade0bd" status: 200 len: 1318 microversion: 2.1 time: 1.018347 Oct 04 20:50:41.125554 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1787/3660] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:50:40 2022] GET /compute/v2.1/servers/0f0dfbcf-cfc3-4af8-9142-956b74ade0bd => generated 1318 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:50:41.133296 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b963e102-bae2-4d20-aeb7-c28ce00314b2 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:41.133915 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b963e102-bae2-4d20-aeb7-c28ce00314b2 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: db7ee8ad-13be-450c-b9a9-1da939dbc268] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:50:41.146457 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b963e102-bae2-4d20-aeb7-c28ce00314b2 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:41.147029 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b963e102-bae2-4d20-aeb7-c28ce00314b2 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:41.147536 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b963e102-bae2-4d20-aeb7-c28ce00314b2 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:41.148296 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b963e102-bae2-4d20-aeb7-c28ce00314b2 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:41.148819 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b963e102-bae2-4d20-aeb7-c28ce00314b2 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:41.149305 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b963e102-bae2-4d20-aeb7-c28ce00314b2 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:41.670012 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-c03dfc65-02eb-40ac-a597-fe983f3edae5 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc4171c0ee14ebb8b5eff5e910ccf49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003eb03a265a496d8981e45c74b014f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:50:41.722258 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-c03dfc65-02eb-40ac-a597-fe983f3edae5 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] 10.222.0.33 "GET /compute/v2.1/servers/f15ae3c9-8342-4ae9-b81e-2d7b1aecb2e8" status: 200 len: 1322 microversion: 2.1 time: 0.817132 Oct 04 20:50:41.725458 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1874/3661] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:50:40 2022] GET /compute/v2.1/servers/f15ae3c9-8342-4ae9-b81e-2d7b1aecb2e8 => generated 1322 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:50:41.737472 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-c746c07b-4632-4aad-9277-7439bb82b313 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:41.739861 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-c746c07b-4632-4aad-9277-7439bb82b313 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] [instance: d849cb42-dfe6-4225-814a-90bef2839739] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:50:41.755984 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c746c07b-4632-4aad-9277-7439bb82b313 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:41.756677 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c746c07b-4632-4aad-9277-7439bb82b313 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:41.757573 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c746c07b-4632-4aad-9277-7439bb82b313 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:41.758503 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c746c07b-4632-4aad-9277-7439bb82b313 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:41.759125 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c746c07b-4632-4aad-9277-7439bb82b313 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:41.759730 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c746c07b-4632-4aad-9277-7439bb82b313 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:41.788987 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.wsgi [None req-c746c07b-4632-4aad-9277-7439bb82b313 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] HTTP exception thrown: Instance d849cb42-dfe6-4225-814a-90bef2839739 could not be found. Oct 04 20:50:41.790799 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-c746c07b-4632-4aad-9277-7439bb82b313 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Request method failure captured: Oct 04 20:50:41.790799 n-d-854823-8 devstack@n-api.service[128802]: request: DELETE /compute/v2.1/servers/d849cb42-dfe6-4225-814a-90bef2839739 HTTP/1.1 Oct 04 20:50:41.790799 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 20:50:41.790799 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 20:50:41.790799 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 20:50:41.790799 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 0 Oct 04 20:50:41.790799 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 20:50:41.790799 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 20:50:41.790799 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 20:50:41.790799 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 20:50:41.790799 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPJq81PAuDsDZpxdj7sHNmNgvbOtGh6iX1oPKSmvHZUw9x7ULWvp7QM5iDniQ-MHWL89bpVZnLKWftCcZuFrmOzCFwz5uJr5u54napWSUn77riQgg7pFlU7FKzu5ArjbUA7EV4GWtihdoiqsY9U5RhjRJWZh-5HATJMChglPcLjaAY6g Oct 04 20:50:41.790799 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 20:50:41.790799 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 20:50:41.790799 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 20:50:41.790799 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 20:50:41.790799 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 20:50:41.790799 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 20:50:41.790799 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: fc7f38600b5041ad8e66a12d77b940fa Oct 04 20:50:41.790799 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-AttachVolumeNegativeTest-16853026 Oct 04 20:50:41.790799 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 20:50:41.790799 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 20:50:41.790799 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_fc7f38600b5041ad8e66a12d77b940fa", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fc7f38600b5041ad8e66a12d77b940fa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fc7f38600b5041ad8e66a12d77b940fa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/fc7f38600b5041ad8e66a12d77b940fa"}]}] Oct 04 20:50:41.790799 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-AttachVolumeNegativeTest-16853026 Oct 04 20:50:41.790799 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: fc7f38600b5041ad8e66a12d77b940fa Oct 04 20:50:41.790799 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-16853026 Oct 04 20:50:41.790799 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-AttachVolumeNegativeTest-16853026-project Oct 04 20:50:41.790799 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 20:50:41.790799 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 20:50:41.790799 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: d9e4b00964014a0383f79597652bd428 Oct 04 20:50:41.790799 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-AttachVolumeNegativeTest-16853026-project Oct 04 20:50:41.790799 n-d-854823-8 devstack@n-api.service[128802]: method: > Oct 04 20:50:41.790799 n-d-854823-8 devstack@n-api.service[128802]: exception: Instance d849cb42-dfe6-4225-814a-90bef2839739 could not be found. Oct 04 20:50:41.790799 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'id': 'd849cb42-dfe6-4225-814a-90bef2839739'} Oct 04 20:50:41.790799 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:50:41.790799 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:50:41.790799 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:50:41.790799 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:50:41.790799 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:50:41.790799 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:50:41.790799 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:50:41.790799 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:50:41.790799 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:50:41.790799 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:50:41.790799 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d849cb42-dfe6-4225-814a-90bef2839739 could not be found. Oct 04 20:50:41.790799 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:50:41.790799 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:50:41.790799 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:50:41.790799 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:50:41.790799 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:50:41.790799 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:50:41.790799 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:50:41.790799 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:50:41.790799 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:50:41.790799 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:50:41.790799 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 20:50:41.790799 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 20:50:41.790799 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 20:50:41.790799 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 20:50:41.790799 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:50:41.790799 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:50:41.790799 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:50:41.790799 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:50:41.795625 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d849cb42-dfe6-4225-814a-90bef2839739 could not be found. Oct 04 20:50:41.795625 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:50:41.795625 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:50:41.795625 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:50:41.795625 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:50:41.795625 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:50:41.795625 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:50:41.795625 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:50:41.795625 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:50:41.795625 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d849cb42-dfe6-4225-814a-90bef2839739 could not be found. Oct 04 20:50:41.795625 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:50:41.795625 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-c746c07b-4632-4aad-9277-7439bb82b313 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Returning 404 to user: Instance d849cb42-dfe6-4225-814a-90bef2839739 could not be found. {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:50:41.795625 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-c746c07b-4632-4aad-9277-7439bb82b313 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] 10.222.0.33 "DELETE /compute/v2.1/servers/d849cb42-dfe6-4225-814a-90bef2839739" status: 404 len: 111 microversion: 2.1 time: 0.064352 Oct 04 20:50:41.795625 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1875/3662] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 20:50:41 2022] DELETE /compute/v2.1/servers/d849cb42-dfe6-4225-814a-90bef2839739 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:50:41.797930 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-00ae39ee-fa2e-4442-a8c0-96c1aa5bebc6 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:41.798595 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-00ae39ee-fa2e-4442-a8c0-96c1aa5bebc6 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] [instance: 917274da-5116-42df-84b5-a30b85d40913] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:50:41.804847 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-00ae39ee-fa2e-4442-a8c0-96c1aa5bebc6 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:41.805351 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-00ae39ee-fa2e-4442-a8c0-96c1aa5bebc6 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:41.805790 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-00ae39ee-fa2e-4442-a8c0-96c1aa5bebc6 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:41.806541 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-00ae39ee-fa2e-4442-a8c0-96c1aa5bebc6 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:41.807001 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-00ae39ee-fa2e-4442-a8c0-96c1aa5bebc6 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:41.807705 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-00ae39ee-fa2e-4442-a8c0-96c1aa5bebc6 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:41.968568 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-b963e102-bae2-4d20-aeb7-c28ce00314b2 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac650232cc04810b1340dc2f0edadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b0670d1bd99424780a70e69d57a2166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:50:41.982386 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b963e102-bae2-4d20-aeb7-c28ce00314b2 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "GET /compute/v2.1/servers/db7ee8ad-13be-450c-b9a9-1da939dbc268" status: 200 len: 1315 microversion: 2.1 time: 0.855409 Oct 04 20:50:41.983889 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1788/3663] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:50:41 2022] GET /compute/v2.1/servers/db7ee8ad-13be-450c-b9a9-1da939dbc268 => generated 1315 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:50:41.989110 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-a3f7e092-3a1c-4759-b8f0-40d7373e9b7b req-5d3aad4c-401b-4316-bcd5-f59e7dfaa86b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1ed60bf8-87e6-4a70-be59-830bee5f8b6d", "tag": "d8248224-d191-4ad2-aa54-10fa1fd06154"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:50:42.000347 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-a3f7e092-3a1c-4759-b8f0-40d7373e9b7b req-5d3aad4c-401b-4316-bcd5-f59e7dfaa86b service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:42.001151 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-a3f7e092-3a1c-4759-b8f0-40d7373e9b7b req-5d3aad4c-401b-4316-bcd5-f59e7dfaa86b service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:42.001747 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-a3f7e092-3a1c-4759-b8f0-40d7373e9b7b req-5d3aad4c-401b-4316-bcd5-f59e7dfaa86b service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:42.028033 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-a3f7e092-3a1c-4759-b8f0-40d7373e9b7b req-5d3aad4c-401b-4316-bcd5-f59e7dfaa86b service nova] Creating event network-changed:d8248224-d191-4ad2-aa54-10fa1fd06154 for instance 1ed60bf8-87e6-4a70-be59-830bee5f8b6d on n-h1-854823-8 Oct 04 20:50:42.038495 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-a3f7e092-3a1c-4759-b8f0-40d7373e9b7b req-5d3aad4c-401b-4316-bcd5-f59e7dfaa86b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051336 Oct 04 20:50:42.039447 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1789/3664] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:50:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:50:42.055394 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-241c8411-13c4-4c2b-a68d-a7705c33b112 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:42.056919 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-241c8411-13c4-4c2b-a68d-a7705c33b112 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] [instance: d849cb42-dfe6-4225-814a-90bef2839739] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:50:42.073296 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-241c8411-13c4-4c2b-a68d-a7705c33b112 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:42.074100 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-241c8411-13c4-4c2b-a68d-a7705c33b112 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:42.078965 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-241c8411-13c4-4c2b-a68d-a7705c33b112 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:42.080218 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-241c8411-13c4-4c2b-a68d-a7705c33b112 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:42.080943 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-241c8411-13c4-4c2b-a68d-a7705c33b112 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:42.081534 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-241c8411-13c4-4c2b-a68d-a7705c33b112 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:42.116756 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-241c8411-13c4-4c2b-a68d-a7705c33b112 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] HTTP exception thrown: Instance d849cb42-dfe6-4225-814a-90bef2839739 could not be found. Oct 04 20:50:42.119862 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-241c8411-13c4-4c2b-a68d-a7705c33b112 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Request method failure captured: Oct 04 20:50:42.119862 n-d-854823-8 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/d849cb42-dfe6-4225-814a-90bef2839739 HTTP/1.1 Oct 04 20:50:42.119862 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:50:42.119862 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:50:42.119862 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:50:42.119862 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 0 Oct 04 20:50:42.119862 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:50:42.119862 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:50:42.119862 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:50:42.119862 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:50:42.119862 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJq81PAuDsDZpxdj7sHNmNgvbOtGh6iX1oPKSmvHZUw9x7ULWvp7QM5iDniQ-MHWL89bpVZnLKWftCcZuFrmOzCFwz5uJr5u54napWSUn77riQgg7pFlU7FKzu5ArjbUA7EV4GWtihdoiqsY9U5RhjRJWZh-5HATJMChglPcLjaAY6g Oct 04 20:50:42.119862 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:50:42.119862 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:50:42.119862 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:50:42.119862 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:50:42.119862 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:50:42.119862 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:50:42.119862 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: fc7f38600b5041ad8e66a12d77b940fa Oct 04 20:50:42.119862 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-AttachVolumeNegativeTest-16853026 Oct 04 20:50:42.119862 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 20:50:42.119862 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 20:50:42.119862 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_fc7f38600b5041ad8e66a12d77b940fa", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fc7f38600b5041ad8e66a12d77b940fa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fc7f38600b5041ad8e66a12d77b940fa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/fc7f38600b5041ad8e66a12d77b940fa"}]}] Oct 04 20:50:42.119862 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-AttachVolumeNegativeTest-16853026 Oct 04 20:50:42.119862 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: fc7f38600b5041ad8e66a12d77b940fa Oct 04 20:50:42.119862 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-16853026 Oct 04 20:50:42.119862 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-AttachVolumeNegativeTest-16853026-project Oct 04 20:50:42.119862 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:50:42.119862 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:50:42.119862 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: d9e4b00964014a0383f79597652bd428 Oct 04 20:50:42.119862 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-AttachVolumeNegativeTest-16853026-project Oct 04 20:50:42.119862 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 20:50:42.119862 n-d-854823-8 devstack@n-api.service[128801]: exception: Instance d849cb42-dfe6-4225-814a-90bef2839739 could not be found. Oct 04 20:50:42.119862 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': 'd849cb42-dfe6-4225-814a-90bef2839739'} Oct 04 20:50:42.119862 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:50:42.119862 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:50:42.119862 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:50:42.119862 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:50:42.119862 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:50:42.119862 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:50:42.119862 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:50:42.119862 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:50:42.119862 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:50:42.119862 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:50:42.119862 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d849cb42-dfe6-4225-814a-90bef2839739 could not be found. Oct 04 20:50:42.119862 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:50:42.119862 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:50:42.119862 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:50:42.119862 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:50:42.119862 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:50:42.119862 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:50:42.119862 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:50:42.119862 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:50:42.119862 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:50:42.119862 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:50:42.119862 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:50:42.119862 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:50:42.119862 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:50:42.119862 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:50:42.119862 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:50:42.119862 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:50:42.119862 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d849cb42-dfe6-4225-814a-90bef2839739 could not be found. Oct 04 20:50:42.119862 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:50:42.119862 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:50:42.119862 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:50:42.125467 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:50:42.125467 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:50:42.125467 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:50:42.125467 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:50:42.125467 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:50:42.125467 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d849cb42-dfe6-4225-814a-90bef2839739 could not be found. Oct 04 20:50:42.125467 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:50:42.129621 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-241c8411-13c4-4c2b-a68d-a7705c33b112 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] Returning 404 to user: Instance d849cb42-dfe6-4225-814a-90bef2839739 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:50:42.132691 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-241c8411-13c4-4c2b-a68d-a7705c33b112 tempest-AttachVolumeNegativeTest-16853026 tempest-AttachVolumeNegativeTest-16853026-project] 10.222.0.33 "GET /compute/v2.1/servers/d849cb42-dfe6-4225-814a-90bef2839739" status: 404 len: 111 microversion: 2.1 time: 0.088642 Oct 04 20:50:42.137142 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1790/3665] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:50:42 2022] GET /compute/v2.1/servers/d849cb42-dfe6-4225-814a-90bef2839739 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:50:42.148912 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-463fe0da-f8f6-41ea-855c-ac3525cb7c46 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:42.149517 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-463fe0da-f8f6-41ea-855c-ac3525cb7c46 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] [instance: 0f0dfbcf-cfc3-4af8-9142-956b74ade0bd] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:50:42.171283 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-463fe0da-f8f6-41ea-855c-ac3525cb7c46 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:42.172429 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-463fe0da-f8f6-41ea-855c-ac3525cb7c46 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:42.173133 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-463fe0da-f8f6-41ea-855c-ac3525cb7c46 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:42.174212 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-463fe0da-f8f6-41ea-855c-ac3525cb7c46 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:42.174871 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-463fe0da-f8f6-41ea-855c-ac3525cb7c46 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:42.175295 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-463fe0da-f8f6-41ea-855c-ac3525cb7c46 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:42.385535 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-00ae39ee-fa2e-4442-a8c0-96c1aa5bebc6 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c208ec9faf491385a9ab5b5932098d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ae4960393c464c97669731c2084d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:50:42.394908 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-00ae39ee-fa2e-4442-a8c0-96c1aa5bebc6 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] 10.222.0.33 "GET /compute/v2.1/servers/917274da-5116-42df-84b5-a30b85d40913" status: 200 len: 1553 microversion: 2.1 time: 0.600706 Oct 04 20:50:42.395490 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1876/3666] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:50:41 2022] GET /compute/v2.1/servers/917274da-5116-42df-84b5-a30b85d40913 => generated 1553 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:50:42.754123 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-9200fb42-9239-4733-812e-79d6d2a6f37d tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:42.755656 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-9200fb42-9239-4733-812e-79d6d2a6f37d tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] [instance: f15ae3c9-8342-4ae9-b81e-2d7b1aecb2e8] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:50:42.763219 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9200fb42-9239-4733-812e-79d6d2a6f37d tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:42.763992 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9200fb42-9239-4733-812e-79d6d2a6f37d tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:42.765436 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9200fb42-9239-4733-812e-79d6d2a6f37d tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:42.766706 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9200fb42-9239-4733-812e-79d6d2a6f37d tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:42.767747 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9200fb42-9239-4733-812e-79d6d2a6f37d tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:42.768361 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9200fb42-9239-4733-812e-79d6d2a6f37d tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:42.866766 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:50:43.128999 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-463fe0da-f8f6-41ea-855c-ac3525cb7c46 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8397c96a6dd4c65bdde07c91ca5e7fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09101effe9da463dabc2edaccdb83e06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:50:43.148760 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-463fe0da-f8f6-41ea-855c-ac3525cb7c46 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] 10.222.0.33 "GET /compute/v2.1/servers/0f0dfbcf-cfc3-4af8-9142-956b74ade0bd" status: 200 len: 1318 microversion: 2.1 time: 1.004590 Oct 04 20:50:43.156701 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1791/3667] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:50:42 2022] GET /compute/v2.1/servers/0f0dfbcf-cfc3-4af8-9142-956b74ade0bd => generated 1318 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:50:43.195263 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-3a726eef-0e5d-4370-8b0f-c6b83c5e2eb5 req-492cf77d-9b7e-4977-96f9-405009a779b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "917274da-5116-42df-84b5-a30b85d40913", "name": "network-vif-deleted", "tag": "52e43a18-5913-41fd-b586-a390738db24f"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:50:43.220031 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-3a726eef-0e5d-4370-8b0f-c6b83c5e2eb5 req-492cf77d-9b7e-4977-96f9-405009a779b4 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:43.220525 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-3a726eef-0e5d-4370-8b0f-c6b83c5e2eb5 req-492cf77d-9b7e-4977-96f9-405009a779b4 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:43.220965 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-3a726eef-0e5d-4370-8b0f-c6b83c5e2eb5 req-492cf77d-9b7e-4977-96f9-405009a779b4 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:43.256782 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-3a726eef-0e5d-4370-8b0f-c6b83c5e2eb5 req-492cf77d-9b7e-4977-96f9-405009a779b4 service nova] Creating event network-vif-deleted:52e43a18-5913-41fd-b586-a390738db24f for instance 917274da-5116-42df-84b5-a30b85d40913 on n-h1-854823-8 Oct 04 20:50:43.276895 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-3a726eef-0e5d-4370-8b0f-c6b83c5e2eb5 req-492cf77d-9b7e-4977-96f9-405009a779b4 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110951 Oct 04 20:50:43.277923 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1792/3668] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:50:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:50:43.290513 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-300a65b8-c8a2-49d7-ab53-c3bbd4ae44de tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:43.292584 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-300a65b8-c8a2-49d7-ab53-c3bbd4ae44de tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: db7ee8ad-13be-450c-b9a9-1da939dbc268] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:50:43.311936 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-300a65b8-c8a2-49d7-ab53-c3bbd4ae44de tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:43.314423 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-300a65b8-c8a2-49d7-ab53-c3bbd4ae44de tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:43.315067 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-300a65b8-c8a2-49d7-ab53-c3bbd4ae44de tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:43.317581 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-300a65b8-c8a2-49d7-ab53-c3bbd4ae44de tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:43.318086 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-300a65b8-c8a2-49d7-ab53-c3bbd4ae44de tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:43.320360 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-300a65b8-c8a2-49d7-ab53-c3bbd4ae44de tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:43.555020 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-9200fb42-9239-4733-812e-79d6d2a6f37d tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc4171c0ee14ebb8b5eff5e910ccf49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003eb03a265a496d8981e45c74b014f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:50:43.573616 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-9200fb42-9239-4733-812e-79d6d2a6f37d tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] 10.222.0.33 "GET /compute/v2.1/servers/f15ae3c9-8342-4ae9-b81e-2d7b1aecb2e8" status: 200 len: 1322 microversion: 2.1 time: 0.823890 Oct 04 20:50:43.615805 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1877/3669] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:50:42 2022] GET /compute/v2.1/servers/f15ae3c9-8342-4ae9-b81e-2d7b1aecb2e8 => generated 1322 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:50:43.633407 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-2e74973e-00da-43fa-8735-8384e734ae09 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:43.635121 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-2e74973e-00da-43fa-8735-8384e734ae09 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] [instance: 917274da-5116-42df-84b5-a30b85d40913] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:50:43.645588 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2e74973e-00da-43fa-8735-8384e734ae09 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:43.648033 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2e74973e-00da-43fa-8735-8384e734ae09 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:43.648815 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2e74973e-00da-43fa-8735-8384e734ae09 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:43.650272 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2e74973e-00da-43fa-8735-8384e734ae09 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:43.651191 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2e74973e-00da-43fa-8735-8384e734ae09 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:43.652862 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2e74973e-00da-43fa-8735-8384e734ae09 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:43.889418 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-2e74973e-00da-43fa-8735-8384e734ae09 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c208ec9faf491385a9ab5b5932098d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ae4960393c464c97669731c2084d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:50:43.904853 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-2e74973e-00da-43fa-8735-8384e734ae09 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] 10.222.0.33 "GET /compute/v2.1/servers/917274da-5116-42df-84b5-a30b85d40913" status: 200 len: 1345 microversion: 2.1 time: 0.280221 Oct 04 20:50:43.911301 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1878/3670] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:50:43 2022] GET /compute/v2.1/servers/917274da-5116-42df-84b5-a30b85d40913 => generated 1345 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:50:44.033583 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-7f293b5a-7d89-42f8-9cea-0e56688ece0d tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1315799367", "imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "28da411c-076d-43ee-be2a-22bdeaff53f4"}, {"port": "2466aff1-a3c9-4408-a313-35792d243535", "tag": "port-1"}, {"port": "1a515a36-7768-4003-81af-193aff7ba286", "tag": "port-2"}, {"uuid": "4fc8e38d-8882-4fe4-895d-1120015cda1e", "tag": "net-1"}, {"uuid": "4fc8e38d-8882-4fe4-895d-1120015cda1e"}, {"uuid": "423cf973-8cc4-416c-adc6-74540ccd6d72", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "423cf973-8cc4-416c-adc6-74540ccd6d72", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "e2f17c01-9abb-407b-91e0-3a08f53a819b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "f1913d1b-f0da-4e63-bfdd-2543ab50ec6f", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "a1d3d174-9cb2-41f0-8f67-cd520719c8c3", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--954891029"}], "key_name": "tempest-keypair-1194998426", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:50:44.141590 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell0:SELECT=4 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:50:44.178658 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-300a65b8-c8a2-49d7-ab53-c3bbd4ae44de tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac650232cc04810b1340dc2f0edadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b0670d1bd99424780a70e69d57a2166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:50:44.210296 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-300a65b8-c8a2-49d7-ab53-c3bbd4ae44de tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "GET /compute/v2.1/servers/db7ee8ad-13be-450c-b9a9-1da939dbc268" status: 200 len: 1315 microversion: 2.1 time: 0.928444 Oct 04 20:50:44.212370 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1793/3671] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:50:43 2022] GET /compute/v2.1/servers/db7ee8ad-13be-450c-b9a9-1da939dbc268 => generated 1315 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:50:44.252940 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-98f2fa7d-845d-47be-a4a3-4cd9e6591475 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:44.257516 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-98f2fa7d-845d-47be-a4a3-4cd9e6591475 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] [instance: 0f0dfbcf-cfc3-4af8-9142-956b74ade0bd] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:50:44.262988 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell0:SELECT=14 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:50:44.277603 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-98f2fa7d-845d-47be-a4a3-4cd9e6591475 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:44.278155 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-98f2fa7d-845d-47be-a4a3-4cd9e6591475 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:44.278646 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-98f2fa7d-845d-47be-a4a3-4cd9e6591475 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:44.279361 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-98f2fa7d-845d-47be-a4a3-4cd9e6591475 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:44.279814 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-98f2fa7d-845d-47be-a4a3-4cd9e6591475 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:44.280236 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-98f2fa7d-845d-47be-a4a3-4cd9e6591475 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:44.399904 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.network.neutron [None req-7f293b5a-7d89-42f8-9cea-0e56688ece0d tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] validate_networks() for [('28da411c-076d-43ee-be2a-22bdeaff53f4', None, None, None, None, None), (None, None, '2466aff1-a3c9-4408-a313-35792d243535', None, None, None), (None, None, '1a515a36-7768-4003-81af-193aff7ba286', None, None, None), ('4fc8e38d-8882-4fe4-895d-1120015cda1e', None, None, None, None, None), ('4fc8e38d-8882-4fe4-895d-1120015cda1e', None, None, None, None, None), ('423cf973-8cc4-416c-adc6-74540ccd6d72', '10.2.2.100', None, None, None, None), ('423cf973-8cc4-416c-adc6-74540ccd6d72', '10.2.2.200', None, None, None, None)] {{(pid=128802) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:50:44.978928 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-98f2fa7d-845d-47be-a4a3-4cd9e6591475 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8397c96a6dd4c65bdde07c91ca5e7fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09101effe9da463dabc2edaccdb83e06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:50:44.990698 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-98f2fa7d-845d-47be-a4a3-4cd9e6591475 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] 10.222.0.33 "GET /compute/v2.1/servers/0f0dfbcf-cfc3-4af8-9142-956b74ade0bd" status: 200 len: 1318 microversion: 2.1 time: 0.755442 Oct 04 20:50:44.992884 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1794/3672] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:50:44 2022] GET /compute/v2.1/servers/0f0dfbcf-cfc3-4af8-9142-956b74ade0bd => generated 1318 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:50:44.999492 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-3f053e71-a527-4a2d-a66e-8fe378dfb1f7 req-ef2c0e89-aa2b-4c25-91ad-952dc425b352 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f0dfbcf-cfc3-4af8-9142-956b74ade0bd", "name": "network-vif-plugged", "status": "completed", "tag": "c76b8ecf-b973-4c9a-a65e-80e935c2c4ea"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:50:45.017215 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-3f053e71-a527-4a2d-a66e-8fe378dfb1f7 req-ef2c0e89-aa2b-4c25-91ad-952dc425b352 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:45.032711 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-3f053e71-a527-4a2d-a66e-8fe378dfb1f7 req-ef2c0e89-aa2b-4c25-91ad-952dc425b352 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:45.035460 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-3f053e71-a527-4a2d-a66e-8fe378dfb1f7 req-ef2c0e89-aa2b-4c25-91ad-952dc425b352 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:45.107550 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-3f053e71-a527-4a2d-a66e-8fe378dfb1f7 req-ef2c0e89-aa2b-4c25-91ad-952dc425b352 service nova] Creating event network-vif-plugged:c76b8ecf-b973-4c9a-a65e-80e935c2c4ea for instance 0f0dfbcf-cfc3-4af8-9142-956b74ade0bd on n-h2-854823-8 Oct 04 20:50:45.132288 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-3f053e71-a527-4a2d-a66e-8fe378dfb1f7 req-ef2c0e89-aa2b-4c25-91ad-952dc425b352 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.137527 Oct 04 20:50:45.132927 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1795/3673] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:50:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:50:45.138119 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-40a693fa-e26d-46db-bc58-6a3f7002df64 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:45.138868 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-40a693fa-e26d-46db-bc58-6a3f7002df64 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] [instance: f15ae3c9-8342-4ae9-b81e-2d7b1aecb2e8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:50:45.152491 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-40a693fa-e26d-46db-bc58-6a3f7002df64 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:45.152989 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-40a693fa-e26d-46db-bc58-6a3f7002df64 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:45.153688 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-40a693fa-e26d-46db-bc58-6a3f7002df64 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:45.155207 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-40a693fa-e26d-46db-bc58-6a3f7002df64 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:45.155895 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-40a693fa-e26d-46db-bc58-6a3f7002df64 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:45.156543 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-40a693fa-e26d-46db-bc58-6a3f7002df64 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:45.693481 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-40a693fa-e26d-46db-bc58-6a3f7002df64 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc4171c0ee14ebb8b5eff5e910ccf49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003eb03a265a496d8981e45c74b014f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:50:45.736273 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-40a693fa-e26d-46db-bc58-6a3f7002df64 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] 10.222.0.33 "GET /compute/v2.1/servers/f15ae3c9-8342-4ae9-b81e-2d7b1aecb2e8" status: 200 len: 1322 microversion: 2.1 time: 0.595575 Oct 04 20:50:45.737640 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1796/3674] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:50:45 2022] GET /compute/v2.1/servers/f15ae3c9-8342-4ae9-b81e-2d7b1aecb2e8 => generated 1322 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:50:45.752901 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9258bbe4-3863-4a7c-8ead-828f68647733 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:45.753476 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-9258bbe4-3863-4a7c-8ead-828f68647733 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] [instance: 917274da-5116-42df-84b5-a30b85d40913] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:50:45.770236 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9258bbe4-3863-4a7c-8ead-828f68647733 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:45.770849 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9258bbe4-3863-4a7c-8ead-828f68647733 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:45.771669 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9258bbe4-3863-4a7c-8ead-828f68647733 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:45.773386 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9258bbe4-3863-4a7c-8ead-828f68647733 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:45.773861 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9258bbe4-3863-4a7c-8ead-828f68647733 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:45.777394 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9258bbe4-3863-4a7c-8ead-828f68647733 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:45.989146 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-9258bbe4-3863-4a7c-8ead-828f68647733 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c208ec9faf491385a9ab5b5932098d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ae4960393c464c97669731c2084d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:50:46.003198 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-9258bbe4-3863-4a7c-8ead-828f68647733 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] 10.222.0.33 "GET /compute/v2.1/servers/917274da-5116-42df-84b5-a30b85d40913" status: 200 len: 1345 microversion: 2.1 time: 0.263031 Oct 04 20:50:46.003709 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1797/3675] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:50:45 2022] GET /compute/v2.1/servers/917274da-5116-42df-84b5-a30b85d40913 => generated 1345 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:50:46.008502 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-9e33cfaa-9a5f-445b-a52d-8eb7ac9c8d8f req-9d012632-dfb6-4e50-ac31-2eabc8fcee2d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db7ee8ad-13be-450c-b9a9-1da939dbc268", "tag": "6f6e72a8-155e-4495-9560-85d30934edee"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:50:46.034935 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:50:46.037369 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-9e33cfaa-9a5f-445b-a52d-8eb7ac9c8d8f req-9d012632-dfb6-4e50-ac31-2eabc8fcee2d service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:46.041539 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-9e33cfaa-9a5f-445b-a52d-8eb7ac9c8d8f req-9d012632-dfb6-4e50-ac31-2eabc8fcee2d service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:46.041983 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-9e33cfaa-9a5f-445b-a52d-8eb7ac9c8d8f req-9d012632-dfb6-4e50-ac31-2eabc8fcee2d service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:46.056979 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-9e33cfaa-9a5f-445b-a52d-8eb7ac9c8d8f req-9d012632-dfb6-4e50-ac31-2eabc8fcee2d service nova] Creating event network-changed:6f6e72a8-155e-4495-9560-85d30934edee for instance db7ee8ad-13be-450c-b9a9-1da939dbc268 on n-h2-854823-8 Oct 04 20:50:46.063496 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-9e33cfaa-9a5f-445b-a52d-8eb7ac9c8d8f req-9d012632-dfb6-4e50-ac31-2eabc8fcee2d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058305 Oct 04 20:50:46.064644 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1798/3676] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:50:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:50:46.069907 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ac3f2975-ea7a-454b-b50d-2049564e69a3 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:46.070835 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ac3f2975-ea7a-454b-b50d-2049564e69a3 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: db7ee8ad-13be-450c-b9a9-1da939dbc268] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:50:46.079663 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ac3f2975-ea7a-454b-b50d-2049564e69a3 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:46.080385 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ac3f2975-ea7a-454b-b50d-2049564e69a3 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:46.080988 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ac3f2975-ea7a-454b-b50d-2049564e69a3 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:46.082079 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ac3f2975-ea7a-454b-b50d-2049564e69a3 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:46.082797 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ac3f2975-ea7a-454b-b50d-2049564e69a3 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:46.083390 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ac3f2975-ea7a-454b-b50d-2049564e69a3 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:46.493524 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=20 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:50:47.150078 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-ac3f2975-ea7a-454b-b50d-2049564e69a3 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac650232cc04810b1340dc2f0edadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b0670d1bd99424780a70e69d57a2166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:50:47.168343 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ac3f2975-ea7a-454b-b50d-2049564e69a3 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "GET /compute/v2.1/servers/db7ee8ad-13be-450c-b9a9-1da939dbc268" status: 200 len: 1315 microversion: 2.1 time: 1.102290 Oct 04 20:50:47.168943 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1799/3677] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:50:46 2022] GET /compute/v2.1/servers/db7ee8ad-13be-450c-b9a9-1da939dbc268 => generated 1315 bytes in 1104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:50:47.188212 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-e534c4fa-d0a5-48c5-8a1f-7c0a7eb611a4 req-0f594bc9-6ebd-4c70-9439-bd551351341c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f15ae3c9-8342-4ae9-b81e-2d7b1aecb2e8", "tag": "97d3322c-c45a-4f09-9239-8f930f5a19c4"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:50:47.207564 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-e534c4fa-d0a5-48c5-8a1f-7c0a7eb611a4 req-0f594bc9-6ebd-4c70-9439-bd551351341c service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:47.208308 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-e534c4fa-d0a5-48c5-8a1f-7c0a7eb611a4 req-0f594bc9-6ebd-4c70-9439-bd551351341c service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:47.209351 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-e534c4fa-d0a5-48c5-8a1f-7c0a7eb611a4 req-0f594bc9-6ebd-4c70-9439-bd551351341c service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:47.240498 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-e534c4fa-d0a5-48c5-8a1f-7c0a7eb611a4 req-0f594bc9-6ebd-4c70-9439-bd551351341c service nova] Creating event network-changed:97d3322c-c45a-4f09-9239-8f930f5a19c4 for instance f15ae3c9-8342-4ae9-b81e-2d7b1aecb2e8 on n-h1-854823-8 Oct 04 20:50:47.251864 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-e534c4fa-d0a5-48c5-8a1f-7c0a7eb611a4 req-0f594bc9-6ebd-4c70-9439-bd551351341c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075974 Oct 04 20:50:47.253447 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1800/3678] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:50:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:50:47.281676 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ebf4b4c6-a068-4c59-b6ea-dd1c2e083dba tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:47.285480 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ebf4b4c6-a068-4c59-b6ea-dd1c2e083dba tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] [instance: 0f0dfbcf-cfc3-4af8-9142-956b74ade0bd] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:50:47.302217 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ebf4b4c6-a068-4c59-b6ea-dd1c2e083dba tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:47.303532 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ebf4b4c6-a068-4c59-b6ea-dd1c2e083dba tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:47.304181 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ebf4b4c6-a068-4c59-b6ea-dd1c2e083dba tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:47.305367 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ebf4b4c6-a068-4c59-b6ea-dd1c2e083dba tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:47.310516 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ebf4b4c6-a068-4c59-b6ea-dd1c2e083dba tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:47.311585 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ebf4b4c6-a068-4c59-b6ea-dd1c2e083dba tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:48.154509 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-ebf4b4c6-a068-4c59-b6ea-dd1c2e083dba tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8397c96a6dd4c65bdde07c91ca5e7fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09101effe9da463dabc2edaccdb83e06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:50:48.171329 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ebf4b4c6-a068-4c59-b6ea-dd1c2e083dba tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] 10.222.0.33 "GET /compute/v2.1/servers/0f0dfbcf-cfc3-4af8-9142-956b74ade0bd" status: 200 len: 1508 microversion: 2.1 time: 0.916221 Oct 04 20:50:48.172251 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1801/3679] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:50:47 2022] GET /compute/v2.1/servers/0f0dfbcf-cfc3-4af8-9142-956b74ade0bd => generated 1508 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:50:48.178021 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-3107e989-c025-4ea1-87dd-18b9ac106eef tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:48.181670 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-3107e989-c025-4ea1-87dd-18b9ac106eef tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] [instance: f15ae3c9-8342-4ae9-b81e-2d7b1aecb2e8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:50:48.193115 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3107e989-c025-4ea1-87dd-18b9ac106eef tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:48.193370 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3107e989-c025-4ea1-87dd-18b9ac106eef tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:48.193623 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3107e989-c025-4ea1-87dd-18b9ac106eef tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:48.194418 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3107e989-c025-4ea1-87dd-18b9ac106eef tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:48.194936 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3107e989-c025-4ea1-87dd-18b9ac106eef tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:48.195384 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3107e989-c025-4ea1-87dd-18b9ac106eef tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:48.872078 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-3107e989-c025-4ea1-87dd-18b9ac106eef tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc4171c0ee14ebb8b5eff5e910ccf49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003eb03a265a496d8981e45c74b014f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:50:48.883699 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-3107e989-c025-4ea1-87dd-18b9ac106eef tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] 10.222.0.33 "GET /compute/v2.1/servers/f15ae3c9-8342-4ae9-b81e-2d7b1aecb2e8" status: 200 len: 1322 microversion: 2.1 time: 0.710171 Oct 04 20:50:48.887082 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1802/3680] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:50:48 2022] GET /compute/v2.1/servers/f15ae3c9-8342-4ae9-b81e-2d7b1aecb2e8 => generated 1322 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:50:48.909805 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-cdf8afb9-8e99-48cb-bab7-52ee711de878 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:48.910902 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-cdf8afb9-8e99-48cb-bab7-52ee711de878 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] [instance: 917274da-5116-42df-84b5-a30b85d40913] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:50:48.934938 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cdf8afb9-8e99-48cb-bab7-52ee711de878 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:48.935858 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cdf8afb9-8e99-48cb-bab7-52ee711de878 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:48.939379 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cdf8afb9-8e99-48cb-bab7-52ee711de878 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:48.943895 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cdf8afb9-8e99-48cb-bab7-52ee711de878 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:48.945133 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cdf8afb9-8e99-48cb-bab7-52ee711de878 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:48.947217 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cdf8afb9-8e99-48cb-bab7-52ee711de878 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:48.957298 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:50:49.297130 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-cdf8afb9-8e99-48cb-bab7-52ee711de878 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c208ec9faf491385a9ab5b5932098d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ae4960393c464c97669731c2084d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:50:49.332039 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-cdf8afb9-8e99-48cb-bab7-52ee711de878 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] 10.222.0.33 "GET /compute/v2.1/servers/917274da-5116-42df-84b5-a30b85d40913" status: 200 len: 1345 microversion: 2.1 time: 0.443599 Oct 04 20:50:49.336267 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1803/3681] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:50:48 2022] GET /compute/v2.1/servers/917274da-5116-42df-84b5-a30b85d40913 => generated 1345 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:50:49.352093 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-574bbdb0-cf48-4c31-a2d5-91f0ad88ebdd tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:49.361223 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-574bbdb0-cf48-4c31-a2d5-91f0ad88ebdd tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: db7ee8ad-13be-450c-b9a9-1da939dbc268] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:50:49.392428 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-574bbdb0-cf48-4c31-a2d5-91f0ad88ebdd tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:49.395915 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-574bbdb0-cf48-4c31-a2d5-91f0ad88ebdd tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:49.397389 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-574bbdb0-cf48-4c31-a2d5-91f0ad88ebdd tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:49.402301 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-574bbdb0-cf48-4c31-a2d5-91f0ad88ebdd tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:49.403028 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-574bbdb0-cf48-4c31-a2d5-91f0ad88ebdd tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:49.403568 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-574bbdb0-cf48-4c31-a2d5-91f0ad88ebdd tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:50.159456 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-574bbdb0-cf48-4c31-a2d5-91f0ad88ebdd tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac650232cc04810b1340dc2f0edadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b0670d1bd99424780a70e69d57a2166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:50:50.168401 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-574bbdb0-cf48-4c31-a2d5-91f0ad88ebdd tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "GET /compute/v2.1/servers/db7ee8ad-13be-450c-b9a9-1da939dbc268" status: 200 len: 1315 microversion: 2.1 time: 0.829981 Oct 04 20:50:50.176607 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1804/3682] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:50:49 2022] GET /compute/v2.1/servers/db7ee8ad-13be-450c-b9a9-1da939dbc268 => generated 1315 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:50:50.195700 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7948dcfd-dd1a-41b4-8742-f9d75a2061f6 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:50.196618 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-7948dcfd-dd1a-41b4-8742-f9d75a2061f6 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] [instance: f15ae3c9-8342-4ae9-b81e-2d7b1aecb2e8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:50:50.215051 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7948dcfd-dd1a-41b4-8742-f9d75a2061f6 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:50.217491 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7948dcfd-dd1a-41b4-8742-f9d75a2061f6 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:50.218875 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7948dcfd-dd1a-41b4-8742-f9d75a2061f6 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:50.221015 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7948dcfd-dd1a-41b4-8742-f9d75a2061f6 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:50.221499 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7948dcfd-dd1a-41b4-8742-f9d75a2061f6 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:50.222947 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7948dcfd-dd1a-41b4-8742-f9d75a2061f6 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:50.784102 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-7948dcfd-dd1a-41b4-8742-f9d75a2061f6 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc4171c0ee14ebb8b5eff5e910ccf49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003eb03a265a496d8981e45c74b014f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:50:50.817569 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-7948dcfd-dd1a-41b4-8742-f9d75a2061f6 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] 10.222.0.33 "GET /compute/v2.1/servers/f15ae3c9-8342-4ae9-b81e-2d7b1aecb2e8" status: 200 len: 1322 microversion: 2.1 time: 0.638716 Oct 04 20:50:50.819285 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1805/3683] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:50:50 2022] GET /compute/v2.1/servers/f15ae3c9-8342-4ae9-b81e-2d7b1aecb2e8 => generated 1322 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:50:50.831533 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-26c6e1f5-5c88-435c-9de5-da9467d129d9 req-fe336ed2-c2ba-4e00-a683-87f9c10e9988 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ed60bf8-87e6-4a70-be59-830bee5f8b6d", "name": "network-vif-plugged", "status": "completed", "tag": "d8248224-d191-4ad2-aa54-10fa1fd06154"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:50:50.872925 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-26c6e1f5-5c88-435c-9de5-da9467d129d9 req-fe336ed2-c2ba-4e00-a683-87f9c10e9988 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:50.873319 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-26c6e1f5-5c88-435c-9de5-da9467d129d9 req-fe336ed2-c2ba-4e00-a683-87f9c10e9988 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:50.882098 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-26c6e1f5-5c88-435c-9de5-da9467d129d9 req-fe336ed2-c2ba-4e00-a683-87f9c10e9988 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:50.922807 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-26c6e1f5-5c88-435c-9de5-da9467d129d9 req-fe336ed2-c2ba-4e00-a683-87f9c10e9988 service nova] Creating event network-vif-plugged:d8248224-d191-4ad2-aa54-10fa1fd06154 for instance 1ed60bf8-87e6-4a70-be59-830bee5f8b6d on n-h1-854823-8 Oct 04 20:50:50.939571 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-26c6e1f5-5c88-435c-9de5-da9467d129d9 req-fe336ed2-c2ba-4e00-a683-87f9c10e9988 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110231 Oct 04 20:50:50.939571 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1806/3684] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:50:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:50:50.944637 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ff430d3f-6d23-42e8-bec3-6dfbdde2a12b tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:50.945600 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ff430d3f-6d23-42e8-bec3-6dfbdde2a12b tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] [instance: 917274da-5116-42df-84b5-a30b85d40913] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:50:50.959838 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ff430d3f-6d23-42e8-bec3-6dfbdde2a12b tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:50.962118 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ff430d3f-6d23-42e8-bec3-6dfbdde2a12b tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:50.962812 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ff430d3f-6d23-42e8-bec3-6dfbdde2a12b tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:50.968462 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ff430d3f-6d23-42e8-bec3-6dfbdde2a12b tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:50.969295 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ff430d3f-6d23-42e8-bec3-6dfbdde2a12b tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:50.969913 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ff430d3f-6d23-42e8-bec3-6dfbdde2a12b tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:51.063929 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ff430d3f-6d23-42e8-bec3-6dfbdde2a12b tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:51.064807 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ff430d3f-6d23-42e8-bec3-6dfbdde2a12b tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:51.066641 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ff430d3f-6d23-42e8-bec3-6dfbdde2a12b tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:51.067952 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-ff430d3f-6d23-42e8-bec3-6dfbdde2a12b tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lazy-loading 'fault' on Instance uuid 917274da-5116-42df-84b5-a30b85d40913 {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:50:51.173960 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-ff430d3f-6d23-42e8-bec3-6dfbdde2a12b tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c208ec9faf491385a9ab5b5932098d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ae4960393c464c97669731c2084d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:50:51.182719 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ff430d3f-6d23-42e8-bec3-6dfbdde2a12b tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] 10.222.0.33 "GET /compute/v2.1/servers/917274da-5116-42df-84b5-a30b85d40913" status: 200 len: 1304 microversion: 2.1 time: 0.249588 Oct 04 20:50:51.183804 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1807/3685] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:50:50 2022] GET /compute/v2.1/servers/917274da-5116-42df-84b5-a30b85d40913 => generated 1304 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:50:51.190413 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-cc8f486b-b4b3-45a5-bb04-a8d3e0eeb4e2 tempest-VolumesAdminNegativeTest-49231768 tempest-VolumesAdminNegativeTest-49231768-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "9614f3ad-a20b-46c8-8661-18e42b997e2a"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:50:51.193245 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-cc8f486b-b4b3-45a5-bb04-a8d3e0eeb4e2 tempest-VolumesAdminNegativeTest-49231768 tempest-VolumesAdminNegativeTest-49231768-project-admin] [instance: 0f0dfbcf-cfc3-4af8-9142-956b74ade0bd] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:50:51.204556 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cc8f486b-b4b3-45a5-bb04-a8d3e0eeb4e2 tempest-VolumesAdminNegativeTest-49231768 tempest-VolumesAdminNegativeTest-49231768-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:51.205549 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cc8f486b-b4b3-45a5-bb04-a8d3e0eeb4e2 tempest-VolumesAdminNegativeTest-49231768 tempest-VolumesAdminNegativeTest-49231768-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:51.206511 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cc8f486b-b4b3-45a5-bb04-a8d3e0eeb4e2 tempest-VolumesAdminNegativeTest-49231768 tempest-VolumesAdminNegativeTest-49231768-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:51.208551 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cc8f486b-b4b3-45a5-bb04-a8d3e0eeb4e2 tempest-VolumesAdminNegativeTest-49231768 tempest-VolumesAdminNegativeTest-49231768-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:51.209260 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cc8f486b-b4b3-45a5-bb04-a8d3e0eeb4e2 tempest-VolumesAdminNegativeTest-49231768 tempest-VolumesAdminNegativeTest-49231768-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:51.209928 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cc8f486b-b4b3-45a5-bb04-a8d3e0eeb4e2 tempest-VolumesAdminNegativeTest-49231768 tempest-VolumesAdminNegativeTest-49231768-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:51.270228 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-cc8f486b-b4b3-45a5-bb04-a8d3e0eeb4e2 tempest-VolumesAdminNegativeTest-49231768 tempest-VolumesAdminNegativeTest-49231768-project-admin] HTTP exception thrown: Volume 2a194059-bde2-4aaf-9738-3efd3d76932d could not be found. Oct 04 20:50:51.272748 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-cc8f486b-b4b3-45a5-bb04-a8d3e0eeb4e2 tempest-VolumesAdminNegativeTest-49231768 tempest-VolumesAdminNegativeTest-49231768-project-admin] Request method failure captured: Oct 04 20:50:51.272748 n-d-854823-8 devstack@n-api.service[128801]: request: PUT /compute/v2.1/servers/0f0dfbcf-cfc3-4af8-9142-956b74ade0bd/os-volume_attachments/2a194059-bde2-4aaf-9738-3efd3d76932d HTTP/1.1 Oct 04 20:50:51.272748 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:50:51.272748 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:50:51.272748 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:50:51.272748 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 74 Oct 04 20:50:51.272748 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:50:51.272748 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:50:51.272748 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:50:51.272748 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:50:51.272748 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJwdURG4-hR5yUzgNSRnVbVpaBlvcTRCbYW1fOFUzaOdrM7lH2P1GXQ4COFXgyh4VpM6B5o1nchKDcD--tdoidEQmEtlPBN4TRVIxlGX4LeJR3rRnFoqnp4PFfz99EzhuT4E9bm636PCPPvMMoQZjKoUvLRi1dGet0lgq-4bvnXa1j8 Oct 04 20:50:51.272748 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:50:51.272748 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:50:51.272748 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:50:51.272748 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:50:51.272748 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:50:51.272748 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:50:51.272748 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: 98ff0fa24d864a8f9db1bf7a3ad1547c Oct 04 20:50:51.272748 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-VolumesAdminNegativeTest-49231768 Oct 04 20:50:51.272748 n-d-854823-8 devstack@n-api.service[128801]: X-Role: admin,reader,member Oct 04 20:50:51.272748 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: admin,reader,member Oct 04 20:50:51.272748 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_98ff0fa24d864a8f9db1bf7a3ad1547c", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/98ff0fa24d864a8f9db1bf7a3ad1547c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/98ff0fa24d864a8f9db1bf7a3ad1547c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/98ff0fa24d864a8f9db1bf7a3ad1547c"}]}] Oct 04 20:50:51.272748 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-VolumesAdminNegativeTest-49231768 Oct 04 20:50:51.272748 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: 98ff0fa24d864a8f9db1bf7a3ad1547c Oct 04 20:50:51.272748 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-49231768 Oct 04 20:50:51.272748 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-VolumesAdminNegativeTest-49231768-project-admin Oct 04 20:50:51.272748 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:50:51.272748 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:50:51.272748 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: ad772061953443ce86ee6e85f185aadf Oct 04 20:50:51.272748 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-VolumesAdminNegativeTest-49231768-project-admin Oct 04 20:50:51.272748 n-d-854823-8 devstack@n-api.service[128801]: Oct 04 20:50:51.272748 n-d-854823-8 devstack@n-api.service[128801]: {"volumeAttachment": {"volumeId": "9614f3ad-a20b-46c8-8661-18e42b997e2a"}} Oct 04 20:50:51.272748 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 20:50:51.272748 n-d-854823-8 devstack@n-api.service[128801]: exception: Volume 2a194059-bde2-4aaf-9738-3efd3d76932d could not be found. Oct 04 20:50:51.272748 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'server_id': '0f0dfbcf-cfc3-4af8-9142-956b74ade0bd', 'id': '2a194059-bde2-4aaf-9738-3efd3d76932d', 'body': {'volumeAttachment': {'volumeId': '9614f3ad-a20b-46c8-8661-18e42b997e2a'}}} Oct 04 20:50:51.272748 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:50:51.272748 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:50:51.272748 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 20:50:51.272748 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 20:50:51.272748 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 04 20:50:51.272748 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 04 20:50:51.272748 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 04 20:50:51.272748 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 04 20:50:51.272748 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 20:50:51.272748 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 20:50:51.272748 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 20:50:51.272748 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 20:50:51.272748 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 20:50:51.272748 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 20:50:51.272748 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 20:50:51.272748 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 20:50:51.272748 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2a194059-bde2-4aaf-9738-3efd3d76932d could not be found. (HTTP 404) (Request-ID: req-6fb681b2-e562-454d-8db9-1087bfef121f) Oct 04 20:50:51.272748 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:50:51.272748 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:50:51.272748 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:50:51.272748 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:50:51.272748 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 430, in _update_volume_swap Oct 04 20:50:51.272748 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi old_volume = self.volume_api.get(context, old_volume_id) Oct 04 20:50:51.272748 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 04 20:50:51.272748 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 04 20:50:51.272748 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 04 20:50:51.278032 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 04 20:50:51.278032 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 04 20:50:51.278032 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 04 20:50:51.278032 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 20:50:51.278032 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 20:50:51.278032 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 04 20:50:51.278032 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 04 20:50:51.278032 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 04 20:50:51.278032 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 04 20:50:51.278032 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 20:50:51.278032 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 20:50:51.278032 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 20:50:51.278032 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 20:50:51.278032 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 20:50:51.278032 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 20:50:51.278032 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 20:50:51.278032 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 20:50:51.278032 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2a194059-bde2-4aaf-9738-3efd3d76932d could not be found. Oct 04 20:50:51.278032 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:50:51.278032 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:50:51.278032 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:50:51.278032 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:50:51.278032 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:50:51.278032 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:50:51.278032 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:50:51.278032 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:50:51.278032 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:50:51.278032 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:50:51.278032 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:50:51.278032 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:50:51.278032 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:50:51.278032 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:50:51.278032 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Oct 04 20:50:51.278032 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Oct 04 20:50:51.278032 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 432, in _update_volume_swap Oct 04 20:50:51.278032 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:50:51.278032 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2a194059-bde2-4aaf-9738-3efd3d76932d could not be found. Oct 04 20:50:51.278032 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:50:51.278032 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:50:51.278032 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:50:51.278032 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:50:51.278032 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:50:51.278032 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:50:51.278032 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:50:51.278032 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:50:51.278032 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2a194059-bde2-4aaf-9738-3efd3d76932d could not be found. Oct 04 20:50:51.278032 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:50:51.278032 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-cc8f486b-b4b3-45a5-bb04-a8d3e0eeb4e2 tempest-VolumesAdminNegativeTest-49231768 tempest-VolumesAdminNegativeTest-49231768-project-admin] Returning 404 to user: Volume 2a194059-bde2-4aaf-9738-3efd3d76932d could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:50:51.283292 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-cc8f486b-b4b3-45a5-bb04-a8d3e0eeb4e2 tempest-VolumesAdminNegativeTest-49231768 tempest-VolumesAdminNegativeTest-49231768-project-admin] 10.222.0.33 "PUT /compute/v2.1/servers/0f0dfbcf-cfc3-4af8-9142-956b74ade0bd/os-volume_attachments/2a194059-bde2-4aaf-9738-3efd3d76932d" status: 404 len: 109 microversion: 2.1 time: 0.094555 Oct 04 20:50:51.288416 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1808/3686] 10.222.0.33 () {60 vars in 1433 bytes} [Tue Oct 4 20:50:51 2022] PUT /compute/v2.1/servers/0f0dfbcf-cfc3-4af8-9142-956b74ade0bd/os-volume_attachments/2a194059-bde2-4aaf-9738-3efd3d76932d => generated 109 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:50:51.293841 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2eeacbde-2f37-4758-88a7-e580f7d39bb3 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:51.300606 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-2eeacbde-2f37-4758-88a7-e580f7d39bb3 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: db7ee8ad-13be-450c-b9a9-1da939dbc268] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:50:51.310107 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2eeacbde-2f37-4758-88a7-e580f7d39bb3 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:51.310837 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2eeacbde-2f37-4758-88a7-e580f7d39bb3 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:51.311524 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2eeacbde-2f37-4758-88a7-e580f7d39bb3 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:51.312356 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2eeacbde-2f37-4758-88a7-e580f7d39bb3 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:51.312974 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2eeacbde-2f37-4758-88a7-e580f7d39bb3 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:51.313549 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2eeacbde-2f37-4758-88a7-e580f7d39bb3 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:52.867584 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-2eeacbde-2f37-4758-88a7-e580f7d39bb3 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac650232cc04810b1340dc2f0edadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b0670d1bd99424780a70e69d57a2166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:50:52.881793 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-2eeacbde-2f37-4758-88a7-e580f7d39bb3 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "GET /compute/v2.1/servers/db7ee8ad-13be-450c-b9a9-1da939dbc268" status: 200 len: 1315 microversion: 2.1 time: 1.597044 Oct 04 20:50:52.891339 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1809/3687] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:50:51 2022] GET /compute/v2.1/servers/db7ee8ad-13be-450c-b9a9-1da939dbc268 => generated 1315 bytes in 1606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:50:52.929876 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-583744a3-7ed2-4cf6-8a9c-45dc35334040 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:52.930669 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-583744a3-7ed2-4cf6-8a9c-45dc35334040 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] [instance: f15ae3c9-8342-4ae9-b81e-2d7b1aecb2e8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:50:52.961022 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-583744a3-7ed2-4cf6-8a9c-45dc35334040 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:52.961529 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-583744a3-7ed2-4cf6-8a9c-45dc35334040 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:52.961973 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-583744a3-7ed2-4cf6-8a9c-45dc35334040 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:52.966006 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-583744a3-7ed2-4cf6-8a9c-45dc35334040 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:52.968988 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-583744a3-7ed2-4cf6-8a9c-45dc35334040 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:52.969479 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-583744a3-7ed2-4cf6-8a9c-45dc35334040 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:53.427121 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-583744a3-7ed2-4cf6-8a9c-45dc35334040 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc4171c0ee14ebb8b5eff5e910ccf49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003eb03a265a496d8981e45c74b014f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:50:53.440830 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-583744a3-7ed2-4cf6-8a9c-45dc35334040 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] 10.222.0.33 "GET /compute/v2.1/servers/f15ae3c9-8342-4ae9-b81e-2d7b1aecb2e8" status: 200 len: 1322 microversion: 2.1 time: 0.528009 Oct 04 20:50:53.443739 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1810/3688] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:50:52 2022] GET /compute/v2.1/servers/f15ae3c9-8342-4ae9-b81e-2d7b1aecb2e8 => generated 1322 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:50:53.459595 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-db0984e4-f1d2-424f-9c95-6d64867edab5 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:53.460523 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-db0984e4-f1d2-424f-9c95-6d64867edab5 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] [instance: 917274da-5116-42df-84b5-a30b85d40913] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:50:53.470142 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-db0984e4-f1d2-424f-9c95-6d64867edab5 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:53.470611 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-db0984e4-f1d2-424f-9c95-6d64867edab5 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:53.471061 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-db0984e4-f1d2-424f-9c95-6d64867edab5 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:53.471754 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-db0984e4-f1d2-424f-9c95-6d64867edab5 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:53.472212 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-db0984e4-f1d2-424f-9c95-6d64867edab5 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:53.472635 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-db0984e4-f1d2-424f-9c95-6d64867edab5 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:53.501976 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-db0984e4-f1d2-424f-9c95-6d64867edab5 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] HTTP exception thrown: Instance 917274da-5116-42df-84b5-a30b85d40913 could not be found. Oct 04 20:50:53.503575 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-db0984e4-f1d2-424f-9c95-6d64867edab5 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Request method failure captured: Oct 04 20:50:53.503575 n-d-854823-8 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/917274da-5116-42df-84b5-a30b85d40913 HTTP/1.1 Oct 04 20:50:53.503575 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:50:53.503575 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:50:53.503575 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:50:53.503575 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 0 Oct 04 20:50:53.503575 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:50:53.503575 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:50:53.503575 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:50:53.503575 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:50:53.503575 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJxSZfevtBVnbE8xQF7FYm_FMbZNMYv-b1P0ldR6C6mOlBxOPHbcbefhyrqwXR1yI98_OYaoilQwhW17vvL2mv1TUMfEjVB0p9Z8xi6fxjKTzjqbSmmUYZRpw0KKdt3nuXH8mFLFoxIXJdxlVC2R9xsCLdqsVxY0fb8-x4eIUN27OLA Oct 04 20:50:53.503575 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:50:53.503575 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:50:53.503575 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:50:53.503575 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:50:53.503575 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:50:53.503575 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:50:53.503575 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: 82ae4960393c464c97669731c2084d0f Oct 04 20:50:53.503575 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-DeleteServersTestJSON-364705212 Oct 04 20:50:53.503575 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 20:50:53.503575 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 20:50:53.503575 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_82ae4960393c464c97669731c2084d0f", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/82ae4960393c464c97669731c2084d0f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/82ae4960393c464c97669731c2084d0f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/82ae4960393c464c97669731c2084d0f"}]}] Oct 04 20:50:53.503575 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-DeleteServersTestJSON-364705212 Oct 04 20:50:53.503575 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: 82ae4960393c464c97669731c2084d0f Oct 04 20:50:53.503575 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-DeleteServersTestJSON-364705212 Oct 04 20:50:53.503575 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-DeleteServersTestJSON-364705212-project Oct 04 20:50:53.503575 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:50:53.503575 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:50:53.503575 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: e2c208ec9faf491385a9ab5b5932098d Oct 04 20:50:53.503575 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-DeleteServersTestJSON-364705212-project Oct 04 20:50:53.503575 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 20:50:53.503575 n-d-854823-8 devstack@n-api.service[128801]: exception: Instance 917274da-5116-42df-84b5-a30b85d40913 could not be found. Oct 04 20:50:53.503575 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': '917274da-5116-42df-84b5-a30b85d40913'} Oct 04 20:50:53.503575 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:50:53.503575 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:50:53.503575 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:50:53.503575 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:50:53.503575 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:50:53.503575 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:50:53.503575 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:50:53.503575 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:50:53.503575 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:50:53.503575 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:50:53.503575 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 917274da-5116-42df-84b5-a30b85d40913 could not be found. Oct 04 20:50:53.503575 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:50:53.503575 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:50:53.503575 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:50:53.503575 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:50:53.503575 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:50:53.503575 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:50:53.503575 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:50:53.503575 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:50:53.503575 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:50:53.503575 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:50:53.503575 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:50:53.503575 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:50:53.503575 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:50:53.503575 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:50:53.503575 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:50:53.503575 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:50:53.503575 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 917274da-5116-42df-84b5-a30b85d40913 could not be found. Oct 04 20:50:53.503575 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:50:53.503575 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:50:53.503575 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:50:53.508810 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:50:53.508810 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:50:53.508810 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:50:53.508810 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:50:53.508810 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:50:53.508810 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 917274da-5116-42df-84b5-a30b85d40913 could not be found. Oct 04 20:50:53.508810 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:50:53.518563 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-db0984e4-f1d2-424f-9c95-6d64867edab5 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Returning 404 to user: Instance 917274da-5116-42df-84b5-a30b85d40913 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:50:53.519952 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-db0984e4-f1d2-424f-9c95-6d64867edab5 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] 10.222.0.33 "GET /compute/v2.1/servers/917274da-5116-42df-84b5-a30b85d40913" status: 404 len: 111 microversion: 2.1 time: 0.073262 Oct 04 20:50:53.520535 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1811/3689] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:50:53 2022] GET /compute/v2.1/servers/917274da-5116-42df-84b5-a30b85d40913 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:50:53.533239 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-70a6ed1f-bb46-41d6-997c-b372c9560fd2 req-26ac67a9-eb9b-4c95-9a79-16633e284b58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f15ae3c9-8342-4ae9-b81e-2d7b1aecb2e8", "name": "network-vif-plugged", "status": "completed", "tag": "97d3322c-c45a-4f09-9239-8f930f5a19c4"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:50:53.557038 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-70a6ed1f-bb46-41d6-997c-b372c9560fd2 req-26ac67a9-eb9b-4c95-9a79-16633e284b58 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:53.557748 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-70a6ed1f-bb46-41d6-997c-b372c9560fd2 req-26ac67a9-eb9b-4c95-9a79-16633e284b58 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:53.565919 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-70a6ed1f-bb46-41d6-997c-b372c9560fd2 req-26ac67a9-eb9b-4c95-9a79-16633e284b58 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:53.588311 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-70a6ed1f-bb46-41d6-997c-b372c9560fd2 req-26ac67a9-eb9b-4c95-9a79-16633e284b58 service nova] Creating event network-vif-plugged:97d3322c-c45a-4f09-9239-8f930f5a19c4 for instance f15ae3c9-8342-4ae9-b81e-2d7b1aecb2e8 on n-h1-854823-8 Oct 04 20:50:53.596289 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-70a6ed1f-bb46-41d6-997c-b372c9560fd2 req-26ac67a9-eb9b-4c95-9a79-16633e284b58 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071048 Oct 04 20:50:53.610498 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1812/3690] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:50:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:50:53.759245 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-686a2f1b-d894-49f9-a364-36add332d27e tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:53.762877 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-686a2f1b-d894-49f9-a364-36add332d27e tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] [instance: 917274da-5116-42df-84b5-a30b85d40913] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:50:53.783022 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-686a2f1b-d894-49f9-a364-36add332d27e tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:53.783519 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-686a2f1b-d894-49f9-a364-36add332d27e tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:53.788705 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-686a2f1b-d894-49f9-a364-36add332d27e tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:53.789650 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-686a2f1b-d894-49f9-a364-36add332d27e tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:53.793841 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-686a2f1b-d894-49f9-a364-36add332d27e tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:53.795678 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-686a2f1b-d894-49f9-a364-36add332d27e tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:53.838179 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-686a2f1b-d894-49f9-a364-36add332d27e tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] HTTP exception thrown: Instance 917274da-5116-42df-84b5-a30b85d40913 could not be found. Oct 04 20:50:53.841067 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-686a2f1b-d894-49f9-a364-36add332d27e tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Request method failure captured: Oct 04 20:50:53.841067 n-d-854823-8 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/917274da-5116-42df-84b5-a30b85d40913/os-volume_attachments HTTP/1.1 Oct 04 20:50:53.841067 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:50:53.841067 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:50:53.841067 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:50:53.841067 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 0 Oct 04 20:50:53.841067 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:50:53.841067 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:50:53.841067 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:50:53.841067 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:50:53.841067 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJxSZfevtBVnbE8xQF7FYm_FMbZNMYv-b1P0ldR6C6mOlBxOPHbcbefhyrqwXR1yI98_OYaoilQwhW17vvL2mv1TUMfEjVB0p9Z8xi6fxjKTzjqbSmmUYZRpw0KKdt3nuXH8mFLFoxIXJdxlVC2R9xsCLdqsVxY0fb8-x4eIUN27OLA Oct 04 20:50:53.841067 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:50:53.841067 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:50:53.841067 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:50:53.841067 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:50:53.841067 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:50:53.841067 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:50:53.841067 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: 82ae4960393c464c97669731c2084d0f Oct 04 20:50:53.841067 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-DeleteServersTestJSON-364705212 Oct 04 20:50:53.841067 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 20:50:53.841067 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 20:50:53.841067 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_82ae4960393c464c97669731c2084d0f", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/82ae4960393c464c97669731c2084d0f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/82ae4960393c464c97669731c2084d0f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/82ae4960393c464c97669731c2084d0f"}]}] Oct 04 20:50:53.841067 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-DeleteServersTestJSON-364705212 Oct 04 20:50:53.841067 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: 82ae4960393c464c97669731c2084d0f Oct 04 20:50:53.841067 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-DeleteServersTestJSON-364705212 Oct 04 20:50:53.841067 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-DeleteServersTestJSON-364705212-project Oct 04 20:50:53.841067 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:50:53.841067 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:50:53.841067 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: e2c208ec9faf491385a9ab5b5932098d Oct 04 20:50:53.841067 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-DeleteServersTestJSON-364705212-project Oct 04 20:50:53.841067 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 20:50:53.841067 n-d-854823-8 devstack@n-api.service[128801]: exception: Instance 917274da-5116-42df-84b5-a30b85d40913 could not be found. Oct 04 20:50:53.841067 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'server_id': '917274da-5116-42df-84b5-a30b85d40913'} Oct 04 20:50:53.841067 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:50:53.841067 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:50:53.841067 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:50:53.841067 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:50:53.841067 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:50:53.841067 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:50:53.841067 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:50:53.841067 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:50:53.841067 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:50:53.841067 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:50:53.841067 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 917274da-5116-42df-84b5-a30b85d40913 could not be found. Oct 04 20:50:53.841067 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:50:53.841067 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:50:53.841067 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:50:53.841067 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:50:53.841067 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:50:53.841067 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:50:53.841067 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:50:53.841067 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:50:53.841067 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:50:53.841067 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:50:53.841067 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 20:50:53.841067 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:50:53.841067 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 20:50:53.841067 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:50:53.841067 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Oct 04 20:50:53.841067 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Oct 04 20:50:53.841067 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:50:53.841067 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:50:53.846506 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 917274da-5116-42df-84b5-a30b85d40913 could not be found. Oct 04 20:50:53.846506 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:50:53.846506 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:50:53.846506 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:50:53.846506 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:50:53.846506 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:50:53.846506 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:50:53.846506 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:50:53.846506 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:50:53.846506 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 917274da-5116-42df-84b5-a30b85d40913 could not be found. Oct 04 20:50:53.846506 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:50:53.850705 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-686a2f1b-d894-49f9-a364-36add332d27e tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Returning 404 to user: Instance 917274da-5116-42df-84b5-a30b85d40913 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:50:53.854857 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-686a2f1b-d894-49f9-a364-36add332d27e tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] 10.222.0.33 "GET /compute/v2.1/servers/917274da-5116-42df-84b5-a30b85d40913/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.100055 Oct 04 20:50:53.861343 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1813/3691] 10.222.0.33 () {58 vars in 1302 bytes} [Tue Oct 4 20:50:53 2022] GET /compute/v2.1/servers/917274da-5116-42df-84b5-a30b85d40913/os-volume_attachments => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:50:53.897384 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=59 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:50:53.923080 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ec6a623c-efa9-47a8-b5d6-8e8249629796 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:53.925071 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ec6a623c-efa9-47a8-b5d6-8e8249629796 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: db7ee8ad-13be-450c-b9a9-1da939dbc268] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:50:53.949809 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ec6a623c-efa9-47a8-b5d6-8e8249629796 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:53.950295 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ec6a623c-efa9-47a8-b5d6-8e8249629796 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:53.950853 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ec6a623c-efa9-47a8-b5d6-8e8249629796 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:53.951596 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ec6a623c-efa9-47a8-b5d6-8e8249629796 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:53.964101 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ec6a623c-efa9-47a8-b5d6-8e8249629796 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:53.964985 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ec6a623c-efa9-47a8-b5d6-8e8249629796 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:54.212514 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-7f293b5a-7d89-42f8-9cea-0e56688ece0d tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Flavor limits 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:50:54.213090 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-7f293b5a-7d89-42f8-9cea-0e56688ece0d tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Image limits 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:50:54.213677 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-7f293b5a-7d89-42f8-9cea-0e56688ece0d tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Flavor pref 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:50:54.214199 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-7f293b5a-7d89-42f8-9cea-0e56688ece0d tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Image pref 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:50:54.214745 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-7f293b5a-7d89-42f8-9cea-0e56688ece0d tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:50:54.232533 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7f293b5a-7d89-42f8-9cea-0e56688ece0d tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:54.235451 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7f293b5a-7d89-42f8-9cea-0e56688ece0d tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:54.236052 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7f293b5a-7d89-42f8-9cea-0e56688ece0d tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:54.238916 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7f293b5a-7d89-42f8-9cea-0e56688ece0d tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:54.239880 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7f293b5a-7d89-42f8-9cea-0e56688ece0d tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:54.240583 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7f293b5a-7d89-42f8-9cea-0e56688ece0d tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:54.288870 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-7f293b5a-7d89-42f8-9cea-0e56688ece0d tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Getting quotas for project 659f3d4023b347d58bc0361db9ceead9. Resources: {'ram', 'instances', 'cores'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:50:54.295328 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-7f293b5a-7d89-42f8-9cea-0e56688ece0d tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Getting quotas for user b78af5c0485b4343900269160ef3e508 and project 659f3d4023b347d58bc0361db9ceead9. Resources: {'ram', 'instances', 'cores'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:50:54.457286 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-ec6a623c-efa9-47a8-b5d6-8e8249629796 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac650232cc04810b1340dc2f0edadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b0670d1bd99424780a70e69d57a2166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:50:54.476131 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ec6a623c-efa9-47a8-b5d6-8e8249629796 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "GET /compute/v2.1/servers/db7ee8ad-13be-450c-b9a9-1da939dbc268" status: 200 len: 1315 microversion: 2.1 time: 0.556008 Oct 04 20:50:54.481415 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1814/3692] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:50:53 2022] GET /compute/v2.1/servers/db7ee8ad-13be-450c-b9a9-1da939dbc268 => generated 1315 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:50:54.505369 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-537c167e-93cb-49ea-82cd-8764cde02293 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-814731120", "imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63", "flavorRef": "452", "networks": [{"uuid": "9dbf9434-4e8d-415e-bc95-1f3c19f28f1d"}]}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:50:54.595899 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.network.neutron [None req-537c167e-93cb-49ea-82cd-8764cde02293 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] validate_networks() for [('9dbf9434-4e8d-415e-bc95-1f3c19f28f1d', None, None, None, None, None)] {{(pid=128801) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:50:54.632159 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-7f293b5a-7d89-42f8-9cea-0e56688ece0d tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Going to run 1 instances... {{(pid=128802) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:50:54.638592 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-7f293b5a-7d89-42f8-9cea-0e56688ece0d tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] [instance: f8ba4e66-2997-4822-9c01-c570f5ae6e87] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='e2f17c01-9abb-407b-91e0-3a08f53a819b',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='f1913d1b-f0da-4e63-bfdd-2543ab50ec6f',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a1d3d174-9cb2-41f0-8f67-cd520719c8c3',volume_size=None,volume_type=None)] {{(pid=128802) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:50:55.392183 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-7f293b5a-7d89-42f8-9cea-0e56688ece0d tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.42 time: 11.362752 Oct 04 20:50:55.395278 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1879/3693] 10.222.0.33 () {62 vars in 1189 bytes} [Tue Oct 4 20:50:44 2022] POST /compute/v2.1/servers => generated 405 bytes in 11368 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Oct 04 20:50:55.414314 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-336b69f2-75cf-4966-af27-fda389e1a9ac tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:55.415527 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-336b69f2-75cf-4966-af27-fda389e1a9ac tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] [instance: f15ae3c9-8342-4ae9-b81e-2d7b1aecb2e8] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:50:55.432435 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-336b69f2-75cf-4966-af27-fda389e1a9ac tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:55.450017 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-336b69f2-75cf-4966-af27-fda389e1a9ac tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:55.453092 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-336b69f2-75cf-4966-af27-fda389e1a9ac tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:55.455447 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-336b69f2-75cf-4966-af27-fda389e1a9ac tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:55.456025 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-336b69f2-75cf-4966-af27-fda389e1a9ac tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:55.456480 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-336b69f2-75cf-4966-af27-fda389e1a9ac tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:56.136431 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-336b69f2-75cf-4966-af27-fda389e1a9ac tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc4171c0ee14ebb8b5eff5e910ccf49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003eb03a265a496d8981e45c74b014f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:50:56.151677 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-336b69f2-75cf-4966-af27-fda389e1a9ac tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] 10.222.0.33 "GET /compute/v2.1/servers/f15ae3c9-8342-4ae9-b81e-2d7b1aecb2e8" status: 200 len: 1517 microversion: 2.1 time: 0.752733 Oct 04 20:50:56.152705 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-537c167e-93cb-49ea-82cd-8764cde02293 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Flavor limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:50:56.153216 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-537c167e-93cb-49ea-82cd-8764cde02293 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Image limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:50:56.154091 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-537c167e-93cb-49ea-82cd-8764cde02293 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Flavor pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:50:56.154326 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1880/3694] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:50:55 2022] GET /compute/v2.1/servers/f15ae3c9-8342-4ae9-b81e-2d7b1aecb2e8 => generated 1517 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:50:56.154633 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-537c167e-93cb-49ea-82cd-8764cde02293 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Image pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:50:56.156846 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-537c167e-93cb-49ea-82cd-8764cde02293 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:50:56.165125 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-568d5a29-6b5e-42db-8eb3-acda4e1b14d8 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:56.169249 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-568d5a29-6b5e-42db-8eb3-acda4e1b14d8 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] [instance: f8ba4e66-2997-4822-9c01-c570f5ae6e87] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:50:56.172366 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-537c167e-93cb-49ea-82cd-8764cde02293 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:56.172960 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-537c167e-93cb-49ea-82cd-8764cde02293 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:56.174309 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-537c167e-93cb-49ea-82cd-8764cde02293 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:56.176045 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-537c167e-93cb-49ea-82cd-8764cde02293 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:56.177385 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-537c167e-93cb-49ea-82cd-8764cde02293 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:56.178933 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-537c167e-93cb-49ea-82cd-8764cde02293 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:56.221544 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-537c167e-93cb-49ea-82cd-8764cde02293 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Getting quotas for project 82ae4960393c464c97669731c2084d0f. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:50:56.231578 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-537c167e-93cb-49ea-82cd-8764cde02293 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Getting quotas for user e2c208ec9faf491385a9ab5b5932098d and project 82ae4960393c464c97669731c2084d0f. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:50:56.251469 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-537c167e-93cb-49ea-82cd-8764cde02293 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Going to run 1 instances... {{(pid=128801) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:50:56.256363 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-537c167e-93cb-49ea-82cd-8764cde02293 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] [instance: 96ee8e50-b054-4c37-91ec-abb5e4085c49] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='15b24725-0c99-4bcf-b1fb-907cdf8e2d63',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128801) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:50:56.321830 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-568d5a29-6b5e-42db-8eb3-acda4e1b14d8 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b78af5c0485b4343900269160ef3e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659f3d4023b347d58bc0361db9ceead9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:50:56.331560 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-568d5a29-6b5e-42db-8eb3-acda4e1b14d8 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b78af5c0485b4343900269160ef3e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659f3d4023b347d58bc0361db9ceead9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:50:56.337565 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-568d5a29-6b5e-42db-8eb3-acda4e1b14d8 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b78af5c0485b4343900269160ef3e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659f3d4023b347d58bc0361db9ceead9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:50:56.342551 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-568d5a29-6b5e-42db-8eb3-acda4e1b14d8 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] 10.222.0.33 "GET /compute/v2.1/servers/f8ba4e66-2997-4822-9c01-c570f5ae6e87" status: 200 len: 1286 microversion: 2.42 time: 0.183073 Oct 04 20:50:56.343471 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1881/3695] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:50:56 2022] GET /compute/v2.1/servers/f8ba4e66-2997-4822-9c01-c570f5ae6e87 => generated 1286 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:50:56.359216 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-a5139926-d8c0-4973-bf84-e85ab3b5b994 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:56.359897 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-a5139926-d8c0-4973-bf84-e85ab3b5b994 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: db7ee8ad-13be-450c-b9a9-1da939dbc268] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:50:56.373215 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-537c167e-93cb-49ea-82cd-8764cde02293 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.889815 Oct 04 20:50:56.378765 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1815/3696] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 20:50:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 1896 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 20:50:56.381345 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a5139926-d8c0-4973-bf84-e85ab3b5b994 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:56.381848 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a5139926-d8c0-4973-bf84-e85ab3b5b994 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:56.385341 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-58feed92-6d01-4dda-a707-5c9c372682f8 req-8f182218-13d3-4108-9f88-4382c979ef14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db7ee8ad-13be-450c-b9a9-1da939dbc268", "name": "network-vif-plugged", "status": "completed", "tag": "6f6e72a8-155e-4495-9560-85d30934edee"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:50:56.388575 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a5139926-d8c0-4973-bf84-e85ab3b5b994 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:56.389587 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a5139926-d8c0-4973-bf84-e85ab3b5b994 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:56.389898 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a5139926-d8c0-4973-bf84-e85ab3b5b994 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:56.390336 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a5139926-d8c0-4973-bf84-e85ab3b5b994 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:56.432110 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-58feed92-6d01-4dda-a707-5c9c372682f8 req-8f182218-13d3-4108-9f88-4382c979ef14 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:56.435626 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-58feed92-6d01-4dda-a707-5c9c372682f8 req-8f182218-13d3-4108-9f88-4382c979ef14 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:56.440622 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-58feed92-6d01-4dda-a707-5c9c372682f8 req-8f182218-13d3-4108-9f88-4382c979ef14 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:56.462878 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-58feed92-6d01-4dda-a707-5c9c372682f8 req-8f182218-13d3-4108-9f88-4382c979ef14 service nova] Creating event network-vif-plugged:6f6e72a8-155e-4495-9560-85d30934edee for instance db7ee8ad-13be-450c-b9a9-1da939dbc268 on n-h2-854823-8 Oct 04 20:50:56.480164 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-58feed92-6d01-4dda-a707-5c9c372682f8 req-8f182218-13d3-4108-9f88-4382c979ef14 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089293 Oct 04 20:50:56.485389 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1816/3697] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:50:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:50:56.497064 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-01fa74cc-25b8-40b3-bd20-c4f2c4971683 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:56.497685 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-01fa74cc-25b8-40b3-bd20-c4f2c4971683 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] [instance: 0f0dfbcf-cfc3-4af8-9142-956b74ade0bd] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:50:56.520700 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-01fa74cc-25b8-40b3-bd20-c4f2c4971683 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:56.521603 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-01fa74cc-25b8-40b3-bd20-c4f2c4971683 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:56.527900 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-01fa74cc-25b8-40b3-bd20-c4f2c4971683 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:56.530816 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-01fa74cc-25b8-40b3-bd20-c4f2c4971683 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:56.531670 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-01fa74cc-25b8-40b3-bd20-c4f2c4971683 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:56.541653 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-01fa74cc-25b8-40b3-bd20-c4f2c4971683 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:56.607174 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-01fa74cc-25b8-40b3-bd20-c4f2c4971683 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] [instance: 0f0dfbcf-cfc3-4af8-9142-956b74ade0bd] Going to try to terminate instance {{(pid=128801) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:50:56.747072 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-01fa74cc-25b8-40b3-bd20-c4f2c4971683 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] 10.222.0.33 "DELETE /compute/v2.1/servers/0f0dfbcf-cfc3-4af8-9142-956b74ade0bd" status: 204 len: 0 microversion: 2.1 time: 0.259186 Oct 04 20:50:56.753037 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1817/3698] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 20:50:56 2022] DELETE /compute/v2.1/servers/0f0dfbcf-cfc3-4af8-9142-956b74ade0bd => generated 0 bytes in 264 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:50:56.767626 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-928ed7c2-0e84-41f2-99c7-08cd6af3e1b4 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:50:56.773749 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-928ed7c2-0e84-41f2-99c7-08cd6af3e1b4 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] [instance: f15ae3c9-8342-4ae9-b81e-2d7b1aecb2e8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:50:56.804604 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-928ed7c2-0e84-41f2-99c7-08cd6af3e1b4 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:56.806755 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-928ed7c2-0e84-41f2-99c7-08cd6af3e1b4 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:56.809098 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-928ed7c2-0e84-41f2-99c7-08cd6af3e1b4 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:56.812033 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-928ed7c2-0e84-41f2-99c7-08cd6af3e1b4 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:56.813360 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-928ed7c2-0e84-41f2-99c7-08cd6af3e1b4 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:56.814123 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-928ed7c2-0e84-41f2-99c7-08cd6af3e1b4 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:56.861928 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-928ed7c2-0e84-41f2-99c7-08cd6af3e1b4 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lazy-loading 'flavor' on Instance uuid f15ae3c9-8342-4ae9-b81e-2d7b1aecb2e8 {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:50:56.893960 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-a5139926-d8c0-4973-bf84-e85ab3b5b994 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac650232cc04810b1340dc2f0edadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b0670d1bd99424780a70e69d57a2166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:50:56.906091 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-a5139926-d8c0-4973-bf84-e85ab3b5b994 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "GET /compute/v2.1/servers/db7ee8ad-13be-450c-b9a9-1da939dbc268" status: 200 len: 1315 microversion: 2.1 time: 0.559175 Oct 04 20:50:56.908470 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1882/3699] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:50:56 2022] GET /compute/v2.1/servers/db7ee8ad-13be-450c-b9a9-1da939dbc268 => generated 1315 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:50:56.917764 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-dc8f27de-98ba-4157-89dd-253782b970e7 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:56.922308 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-dc8f27de-98ba-4157-89dd-253782b970e7 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] [instance: 96ee8e50-b054-4c37-91ec-abb5e4085c49] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:50:57.053205 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-dc8f27de-98ba-4157-89dd-253782b970e7 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c208ec9faf491385a9ab5b5932098d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ae4960393c464c97669731c2084d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:50:57.069773 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-dc8f27de-98ba-4157-89dd-253782b970e7 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] 10.222.0.33 "GET /compute/v2.1/servers/96ee8e50-b054-4c37-91ec-abb5e4085c49" status: 200 len: 1214 microversion: 2.1 time: 0.154998 Oct 04 20:50:57.072139 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1883/3700] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:50:56 2022] GET /compute/v2.1/servers/96ee8e50-b054-4c37-91ec-abb5e4085c49 => generated 1214 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:50:57.073157 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-928ed7c2-0e84-41f2-99c7-08cd6af3e1b4 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] 10.222.0.33 "POST /compute/v2.1/servers/f15ae3c9-8342-4ae9-b81e-2d7b1aecb2e8/action" status: 200 len: 32 microversion: 2.1 time: 0.320284 Oct 04 20:50:57.079627 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1818/3701] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 20:50:56 2022] POST /compute/v2.1/servers/f15ae3c9-8342-4ae9-b81e-2d7b1aecb2e8/action => generated 32 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 20:50:57.084693 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-dfa6ac61-010d-49ea-9ef7-d3ff1a361825 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:57.085323 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-dfa6ac61-010d-49ea-9ef7-d3ff1a361825 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] [instance: 0f0dfbcf-cfc3-4af8-9142-956b74ade0bd] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:50:57.091571 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-69b2b0d5-48b4-4ccc-b85f-4f63f8a35f88 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:57.096067 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-69b2b0d5-48b4-4ccc-b85f-4f63f8a35f88 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] [instance: f15ae3c9-8342-4ae9-b81e-2d7b1aecb2e8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:50:57.104496 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dfa6ac61-010d-49ea-9ef7-d3ff1a361825 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:57.122322 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-69b2b0d5-48b4-4ccc-b85f-4f63f8a35f88 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:57.123936 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dfa6ac61-010d-49ea-9ef7-d3ff1a361825 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:57.126600 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dfa6ac61-010d-49ea-9ef7-d3ff1a361825 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:57.129364 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dfa6ac61-010d-49ea-9ef7-d3ff1a361825 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:57.134738 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dfa6ac61-010d-49ea-9ef7-d3ff1a361825 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:57.135233 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dfa6ac61-010d-49ea-9ef7-d3ff1a361825 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:57.135591 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-69b2b0d5-48b4-4ccc-b85f-4f63f8a35f88 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:57.137291 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-69b2b0d5-48b4-4ccc-b85f-4f63f8a35f88 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:57.139828 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-69b2b0d5-48b4-4ccc-b85f-4f63f8a35f88 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:57.141326 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-69b2b0d5-48b4-4ccc-b85f-4f63f8a35f88 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:57.145915 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-69b2b0d5-48b4-4ccc-b85f-4f63f8a35f88 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:57.867520 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-69b2b0d5-48b4-4ccc-b85f-4f63f8a35f88 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc4171c0ee14ebb8b5eff5e910ccf49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003eb03a265a496d8981e45c74b014f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:50:57.881763 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-69b2b0d5-48b4-4ccc-b85f-4f63f8a35f88 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] 10.222.0.33 "GET /compute/v2.1/servers/f15ae3c9-8342-4ae9-b81e-2d7b1aecb2e8" status: 200 len: 1523 microversion: 2.1 time: 0.800503 Oct 04 20:50:57.883379 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1819/3702] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:50:57 2022] GET /compute/v2.1/servers/f15ae3c9-8342-4ae9-b81e-2d7b1aecb2e8 => generated 1523 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:50:57.897036 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-dfa6ac61-010d-49ea-9ef7-d3ff1a361825 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8397c96a6dd4c65bdde07c91ca5e7fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09101effe9da463dabc2edaccdb83e06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:50:57.907743 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-033cef35-9cae-4385-9696-43df46329036 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:57.908629 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-033cef35-9cae-4385-9696-43df46329036 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] [instance: 96ee8e50-b054-4c37-91ec-abb5e4085c49] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:50:57.910594 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-dfa6ac61-010d-49ea-9ef7-d3ff1a361825 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] 10.222.0.33 "GET /compute/v2.1/servers/0f0dfbcf-cfc3-4af8-9142-956b74ade0bd" status: 200 len: 1514 microversion: 2.1 time: 0.836471 Oct 04 20:50:57.911626 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1884/3703] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:50:57 2022] GET /compute/v2.1/servers/0f0dfbcf-cfc3-4af8-9142-956b74ade0bd => generated 1514 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:50:57.915729 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-033cef35-9cae-4385-9696-43df46329036 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:57.917273 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-033cef35-9cae-4385-9696-43df46329036 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:57.917416 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-981d0844-3692-4a7e-9102-ddc45a25d7ff tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:57.917991 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-981d0844-3692-4a7e-9102-ddc45a25d7ff tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] [instance: f8ba4e66-2997-4822-9c01-c570f5ae6e87] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:50:57.918291 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-033cef35-9cae-4385-9696-43df46329036 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:57.919245 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-033cef35-9cae-4385-9696-43df46329036 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:57.919924 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-033cef35-9cae-4385-9696-43df46329036 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:57.921632 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-033cef35-9cae-4385-9696-43df46329036 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:57.933822 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-981d0844-3692-4a7e-9102-ddc45a25d7ff tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:57.936779 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-981d0844-3692-4a7e-9102-ddc45a25d7ff tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:57.937251 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-981d0844-3692-4a7e-9102-ddc45a25d7ff tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:57.937974 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-981d0844-3692-4a7e-9102-ddc45a25d7ff tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:57.938457 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-981d0844-3692-4a7e-9102-ddc45a25d7ff tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:57.941044 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-981d0844-3692-4a7e-9102-ddc45a25d7ff tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:57.950651 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:50:57.961677 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-033cef35-9cae-4385-9696-43df46329036 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] [instance: 96ee8e50-b054-4c37-91ec-abb5e4085c49] Going to try to terminate instance {{(pid=128801) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:50:58.001028 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-033cef35-9cae-4385-9696-43df46329036 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:58.001803 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-033cef35-9cae-4385-9696-43df46329036 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:58.002407 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-033cef35-9cae-4385-9696-43df46329036 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:58.066377 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-033cef35-9cae-4385-9696-43df46329036 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lazy-loading 'flavor' on Instance uuid 96ee8e50-b054-4c37-91ec-abb5e4085c49 {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:50:58.085015 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-033cef35-9cae-4385-9696-43df46329036 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lazy-loading 'system_metadata' on Instance uuid 96ee8e50-b054-4c37-91ec-abb5e4085c49 {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:50:58.161873 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-033cef35-9cae-4385-9696-43df46329036 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lazy-loading 'metadata' on Instance uuid 96ee8e50-b054-4c37-91ec-abb5e4085c49 {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:50:58.661616 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-981d0844-3692-4a7e-9102-ddc45a25d7ff tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b78af5c0485b4343900269160ef3e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659f3d4023b347d58bc0361db9ceead9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:50:58.683182 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-981d0844-3692-4a7e-9102-ddc45a25d7ff tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b78af5c0485b4343900269160ef3e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659f3d4023b347d58bc0361db9ceead9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:50:58.696818 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-981d0844-3692-4a7e-9102-ddc45a25d7ff tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b78af5c0485b4343900269160ef3e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659f3d4023b347d58bc0361db9ceead9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:50:58.698399 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-981d0844-3692-4a7e-9102-ddc45a25d7ff tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] 10.222.0.33 "GET /compute/v2.1/servers/f8ba4e66-2997-4822-9c01-c570f5ae6e87" status: 200 len: 1576 microversion: 2.42 time: 0.785797 Oct 04 20:50:58.699609 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1885/3704] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:50:57 2022] GET /compute/v2.1/servers/f8ba4e66-2997-4822-9c01-c570f5ae6e87 => generated 1576 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:50:58.706056 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-80a9a857-f931-4dea-a91d-aa1c00f8b672 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:58.707049 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-80a9a857-f931-4dea-a91d-aa1c00f8b672 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: db7ee8ad-13be-450c-b9a9-1da939dbc268] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:50:58.715315 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-80a9a857-f931-4dea-a91d-aa1c00f8b672 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:58.716140 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-80a9a857-f931-4dea-a91d-aa1c00f8b672 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:58.716850 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-80a9a857-f931-4dea-a91d-aa1c00f8b672 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:58.718467 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-80a9a857-f931-4dea-a91d-aa1c00f8b672 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:58.719243 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-80a9a857-f931-4dea-a91d-aa1c00f8b672 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:58.719905 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-80a9a857-f931-4dea-a91d-aa1c00f8b672 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:58.971102 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.scheduler.client.report [None req-033cef35-9cae-4385-9696-43df46329036 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Deleted allocations for instance 96ee8e50-b054-4c37-91ec-abb5e4085c49 Oct 04 20:50:58.998234 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-033cef35-9cae-4385-9696-43df46329036 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] 10.222.0.33 "DELETE /compute/v2.1/servers/96ee8e50-b054-4c37-91ec-abb5e4085c49" status: 204 len: 0 microversion: 2.1 time: 1.101264 Oct 04 20:50:59.000494 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1820/3705] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 20:50:57 2022] DELETE /compute/v2.1/servers/96ee8e50-b054-4c37-91ec-abb5e4085c49 => generated 0 bytes in 1104 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:50:59.211359 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-eb149b7d-01e7-4e61-b4a5-89c5818f429d tempest-VolumesSnapshotsTestJSON-1939288336 tempest-VolumesSnapshotsTestJSON-1939288336-project] Action: 'create', calling method: .version_select at 0x7f3c746be670>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-401080743"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:50:59.291771 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-80a9a857-f931-4dea-a91d-aa1c00f8b672 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac650232cc04810b1340dc2f0edadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b0670d1bd99424780a70e69d57a2166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:50:59.304023 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-80a9a857-f931-4dea-a91d-aa1c00f8b672 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "GET /compute/v2.1/servers/db7ee8ad-13be-450c-b9a9-1da939dbc268" status: 200 len: 1315 microversion: 2.1 time: 0.602976 Oct 04 20:50:59.306312 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1886/3706] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:50:58 2022] GET /compute/v2.1/servers/db7ee8ad-13be-450c-b9a9-1da939dbc268 => generated 1315 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:50:59.323844 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-418e00c8-87a0-4159-9977-bef532ef9655 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:59.325138 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-418e00c8-87a0-4159-9977-bef532ef9655 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] [instance: f15ae3c9-8342-4ae9-b81e-2d7b1aecb2e8] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:50:59.345569 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-418e00c8-87a0-4159-9977-bef532ef9655 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:59.347077 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-418e00c8-87a0-4159-9977-bef532ef9655 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:59.349676 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-418e00c8-87a0-4159-9977-bef532ef9655 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:59.351446 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-418e00c8-87a0-4159-9977-bef532ef9655 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:59.353663 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-418e00c8-87a0-4159-9977-bef532ef9655 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:59.355285 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-418e00c8-87a0-4159-9977-bef532ef9655 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:59.902869 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-eb149b7d-01e7-4e61-b4a5-89c5818f429d tempest-VolumesSnapshotsTestJSON-1939288336 tempest-VolumesSnapshotsTestJSON-1939288336-project] 10.222.0.33 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.901084 Oct 04 20:50:59.903516 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1821/3707] 10.222.0.33 () {60 vars in 1155 bytes} [Tue Oct 4 20:50:59 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 902 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 04 20:50:59.916696 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2378a1b3-4c03-4e04-8764-efb2f2884e02 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:50:59.917178 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-2378a1b3-4c03-4e04-8764-efb2f2884e02 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] [instance: 0f0dfbcf-cfc3-4af8-9142-956b74ade0bd] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:50:59.932469 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2378a1b3-4c03-4e04-8764-efb2f2884e02 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:59.932972 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2378a1b3-4c03-4e04-8764-efb2f2884e02 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:59.933418 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2378a1b3-4c03-4e04-8764-efb2f2884e02 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:50:59.934151 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2378a1b3-4c03-4e04-8764-efb2f2884e02 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:50:59.934624 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2378a1b3-4c03-4e04-8764-efb2f2884e02 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:50:59.935054 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2378a1b3-4c03-4e04-8764-efb2f2884e02 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:00.001906 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-418e00c8-87a0-4159-9977-bef532ef9655 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc4171c0ee14ebb8b5eff5e910ccf49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003eb03a265a496d8981e45c74b014f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:00.021703 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-418e00c8-87a0-4159-9977-bef532ef9655 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] 10.222.0.33 "GET /compute/v2.1/servers/f15ae3c9-8342-4ae9-b81e-2d7b1aecb2e8" status: 200 len: 1523 microversion: 2.1 time: 0.708864 Oct 04 20:51:00.025052 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1887/3708] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:50:59 2022] GET /compute/v2.1/servers/f15ae3c9-8342-4ae9-b81e-2d7b1aecb2e8 => generated 1523 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:51:00.043799 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-7319733b-5d64-423a-a77a-ead5c206d811 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:00.046358 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-7319733b-5d64-423a-a77a-ead5c206d811 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] [instance: 96ee8e50-b054-4c37-91ec-abb5e4085c49] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:51:00.077628 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7319733b-5d64-423a-a77a-ead5c206d811 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:00.081354 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7319733b-5d64-423a-a77a-ead5c206d811 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:00.083631 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7319733b-5d64-423a-a77a-ead5c206d811 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:00.084643 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7319733b-5d64-423a-a77a-ead5c206d811 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:00.087777 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7319733b-5d64-423a-a77a-ead5c206d811 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:00.088483 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7319733b-5d64-423a-a77a-ead5c206d811 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:00.139271 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.wsgi [None req-7319733b-5d64-423a-a77a-ead5c206d811 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] HTTP exception thrown: Instance 96ee8e50-b054-4c37-91ec-abb5e4085c49 could not be found. Oct 04 20:51:00.143818 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-7319733b-5d64-423a-a77a-ead5c206d811 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Request method failure captured: Oct 04 20:51:00.143818 n-d-854823-8 devstack@n-api.service[128802]: request: GET /compute/v2.1/servers/96ee8e50-b054-4c37-91ec-abb5e4085c49 HTTP/1.1 Oct 04 20:51:00.143818 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 20:51:00.143818 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 20:51:00.143818 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 20:51:00.143818 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 0 Oct 04 20:51:00.143818 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 20:51:00.143818 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 20:51:00.143818 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 20:51:00.143818 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 20:51:00.143818 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPJxSZfevtBVnbE8xQF7FYm_FMbZNMYv-b1P0ldR6C6mOlBxOPHbcbefhyrqwXR1yI98_OYaoilQwhW17vvL2mv1TUMfEjVB0p9Z8xi6fxjKTzjqbSmmUYZRpw0KKdt3nuXH8mFLFoxIXJdxlVC2R9xsCLdqsVxY0fb8-x4eIUN27OLA Oct 04 20:51:00.143818 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 20:51:00.143818 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 20:51:00.143818 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 20:51:00.143818 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 20:51:00.143818 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 20:51:00.143818 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 20:51:00.143818 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: 82ae4960393c464c97669731c2084d0f Oct 04 20:51:00.143818 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-DeleteServersTestJSON-364705212 Oct 04 20:51:00.143818 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 20:51:00.143818 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 20:51:00.143818 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_82ae4960393c464c97669731c2084d0f", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/82ae4960393c464c97669731c2084d0f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/82ae4960393c464c97669731c2084d0f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/82ae4960393c464c97669731c2084d0f"}]}] Oct 04 20:51:00.143818 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-DeleteServersTestJSON-364705212 Oct 04 20:51:00.143818 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: 82ae4960393c464c97669731c2084d0f Oct 04 20:51:00.143818 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-DeleteServersTestJSON-364705212 Oct 04 20:51:00.143818 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-DeleteServersTestJSON-364705212-project Oct 04 20:51:00.143818 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 20:51:00.143818 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 20:51:00.143818 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: e2c208ec9faf491385a9ab5b5932098d Oct 04 20:51:00.143818 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-DeleteServersTestJSON-364705212-project Oct 04 20:51:00.143818 n-d-854823-8 devstack@n-api.service[128802]: method: > Oct 04 20:51:00.143818 n-d-854823-8 devstack@n-api.service[128802]: exception: Instance 96ee8e50-b054-4c37-91ec-abb5e4085c49 could not be found. Oct 04 20:51:00.143818 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'id': '96ee8e50-b054-4c37-91ec-abb5e4085c49'} Oct 04 20:51:00.143818 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:51:00.143818 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:51:00.143818 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:51:00.143818 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:51:00.143818 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:51:00.143818 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:51:00.143818 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:51:00.143818 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:51:00.143818 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:51:00.143818 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:51:00.143818 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 96ee8e50-b054-4c37-91ec-abb5e4085c49 could not be found. Oct 04 20:51:00.143818 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:51:00.143818 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:51:00.143818 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:51:00.143818 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:51:00.143818 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:51:00.143818 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:51:00.143818 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:51:00.143818 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:51:00.143818 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:51:00.143818 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:51:00.143818 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:51:00.143818 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:51:00.143818 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:51:00.143818 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:51:00.143818 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:51:00.143818 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:51:00.143818 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 96ee8e50-b054-4c37-91ec-abb5e4085c49 could not be found. Oct 04 20:51:00.143818 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:51:00.143818 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:51:00.143818 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:51:00.150168 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:51:00.150168 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:51:00.150168 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:51:00.150168 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:51:00.150168 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:51:00.150168 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 96ee8e50-b054-4c37-91ec-abb5e4085c49 could not be found. Oct 04 20:51:00.150168 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:51:00.154230 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-7319733b-5d64-423a-a77a-ead5c206d811 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Returning 404 to user: Instance 96ee8e50-b054-4c37-91ec-abb5e4085c49 could not be found. {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:51:00.161455 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-7319733b-5d64-423a-a77a-ead5c206d811 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] 10.222.0.33 "GET /compute/v2.1/servers/96ee8e50-b054-4c37-91ec-abb5e4085c49" status: 404 len: 111 microversion: 2.1 time: 0.132190 Oct 04 20:51:00.167360 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1888/3709] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:51:00 2022] GET /compute/v2.1/servers/96ee8e50-b054-4c37-91ec-abb5e4085c49 => generated 111 bytes in 141 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:51:00.177446 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-76fbfbee-7b60-45ae-9fae-00268e41d5ad tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:00.185540 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-76fbfbee-7b60-45ae-9fae-00268e41d5ad tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] [instance: f8ba4e66-2997-4822-9c01-c570f5ae6e87] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:51:00.200303 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-76fbfbee-7b60-45ae-9fae-00268e41d5ad tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:00.201561 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-76fbfbee-7b60-45ae-9fae-00268e41d5ad tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:00.204302 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-76fbfbee-7b60-45ae-9fae-00268e41d5ad tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:00.205176 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-76fbfbee-7b60-45ae-9fae-00268e41d5ad tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:00.208168 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-76fbfbee-7b60-45ae-9fae-00268e41d5ad tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:00.208739 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-76fbfbee-7b60-45ae-9fae-00268e41d5ad tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:00.454193 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-76fbfbee-7b60-45ae-9fae-00268e41d5ad tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b78af5c0485b4343900269160ef3e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659f3d4023b347d58bc0361db9ceead9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:00.479177 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-76fbfbee-7b60-45ae-9fae-00268e41d5ad tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b78af5c0485b4343900269160ef3e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659f3d4023b347d58bc0361db9ceead9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:00.495978 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-76fbfbee-7b60-45ae-9fae-00268e41d5ad tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b78af5c0485b4343900269160ef3e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659f3d4023b347d58bc0361db9ceead9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:00.502314 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-76fbfbee-7b60-45ae-9fae-00268e41d5ad tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] 10.222.0.33 "GET /compute/v2.1/servers/f8ba4e66-2997-4822-9c01-c570f5ae6e87" status: 200 len: 1594 microversion: 2.42 time: 0.330018 Oct 04 20:51:00.503650 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1889/3710] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:51:00 2022] GET /compute/v2.1/servers/f8ba4e66-2997-4822-9c01-c570f5ae6e87 => generated 1594 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:51:00.515478 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-2378a1b3-4c03-4e04-8764-efb2f2884e02 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8397c96a6dd4c65bdde07c91ca5e7fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09101effe9da463dabc2edaccdb83e06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:00.524747 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-17676913-f133-4e52-8669-ce620cae7a21 tempest-VolumesSnapshotsTestJSON-1939288336 tempest-VolumesSnapshotsTestJSON-1939288336-project] Calling method '.version_select at 0x7f3c6f758430>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:00.535604 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-2378a1b3-4c03-4e04-8764-efb2f2884e02 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] 10.222.0.33 "GET /compute/v2.1/servers/0f0dfbcf-cfc3-4af8-9142-956b74ade0bd" status: 200 len: 1514 microversion: 2.1 time: 0.622841 Oct 04 20:51:00.541063 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1822/3711] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:50:59 2022] GET /compute/v2.1/servers/0f0dfbcf-cfc3-4af8-9142-956b74ade0bd => generated 1514 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:51:00.563453 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8e09f62a-42c5-4bd5-91fa-572cda5c0334 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:00.564143 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-8e09f62a-42c5-4bd5-91fa-572cda5c0334 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: db7ee8ad-13be-450c-b9a9-1da939dbc268] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:51:00.595554 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8e09f62a-42c5-4bd5-91fa-572cda5c0334 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:00.596089 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8e09f62a-42c5-4bd5-91fa-572cda5c0334 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:00.601709 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8e09f62a-42c5-4bd5-91fa-572cda5c0334 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:00.610099 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8e09f62a-42c5-4bd5-91fa-572cda5c0334 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:00.611142 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8e09f62a-42c5-4bd5-91fa-572cda5c0334 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:00.612521 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8e09f62a-42c5-4bd5-91fa-572cda5c0334 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:00.709582 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-17676913-f133-4e52-8669-ce620cae7a21 tempest-VolumesSnapshotsTestJSON-1939288336 tempest-VolumesSnapshotsTestJSON-1939288336-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/273b32af-aa4c-4bb3-9132-d3e91f3b8f2c" status: 200 len: 344 microversion: 2.1 time: 0.203398 Oct 04 20:51:00.723641 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1890/3712] 10.222.0.33 () {58 vars in 1245 bytes} [Tue Oct 4 20:51:00 2022] GET /compute/v2.1/os-volumes/273b32af-aa4c-4bb3-9132-d3e91f3b8f2c => generated 344 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:51:00.735152 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-09c345dd-8f45-472a-87ae-0d00a1619a25 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1850386458", "imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63", "flavorRef": "452", "networks": [{"uuid": "9dbf9434-4e8d-415e-bc95-1f3c19f28f1d"}]}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:51:00.838995 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.network.neutron [None req-09c345dd-8f45-472a-87ae-0d00a1619a25 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] validate_networks() for [('9dbf9434-4e8d-415e-bc95-1f3c19f28f1d', None, None, None, None, None)] {{(pid=128802) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:51:02.227546 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-8e09f62a-42c5-4bd5-91fa-572cda5c0334 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac650232cc04810b1340dc2f0edadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b0670d1bd99424780a70e69d57a2166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:02.240785 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-8e09f62a-42c5-4bd5-91fa-572cda5c0334 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "GET /compute/v2.1/servers/db7ee8ad-13be-450c-b9a9-1da939dbc268" status: 200 len: 1503 microversion: 2.1 time: 1.697658 Oct 04 20:51:02.260413 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1823/3713] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:51:00 2022] GET /compute/v2.1/servers/db7ee8ad-13be-450c-b9a9-1da939dbc268 => generated 1503 bytes in 1718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:51:02.268098 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-325f05c8-c756-4740-865d-a517962fc3a0 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:02.268877 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-325f05c8-c756-4740-865d-a517962fc3a0 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] [instance: f15ae3c9-8342-4ae9-b81e-2d7b1aecb2e8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:51:02.275425 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-325f05c8-c756-4740-865d-a517962fc3a0 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:02.276290 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-325f05c8-c756-4740-865d-a517962fc3a0 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:02.276991 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-325f05c8-c756-4740-865d-a517962fc3a0 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:02.277935 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-325f05c8-c756-4740-865d-a517962fc3a0 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:02.278668 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-325f05c8-c756-4740-865d-a517962fc3a0 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:02.279368 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-325f05c8-c756-4740-865d-a517962fc3a0 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:02.637488 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-325f05c8-c756-4740-865d-a517962fc3a0 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc4171c0ee14ebb8b5eff5e910ccf49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003eb03a265a496d8981e45c74b014f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:02.648367 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-325f05c8-c756-4740-865d-a517962fc3a0 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] 10.222.0.33 "GET /compute/v2.1/servers/f15ae3c9-8342-4ae9-b81e-2d7b1aecb2e8" status: 200 len: 1523 microversion: 2.1 time: 0.384720 Oct 04 20:51:02.668248 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1824/3714] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:51:02 2022] GET /compute/v2.1/servers/f15ae3c9-8342-4ae9-b81e-2d7b1aecb2e8 => generated 1523 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:51:02.674128 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-98a53cb2-4774-4336-8cf9-2f16f05fa6b7 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:02.675341 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-98a53cb2-4774-4336-8cf9-2f16f05fa6b7 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] [instance: f8ba4e66-2997-4822-9c01-c570f5ae6e87] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:51:02.690083 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-98a53cb2-4774-4336-8cf9-2f16f05fa6b7 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:02.690917 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-98a53cb2-4774-4336-8cf9-2f16f05fa6b7 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:02.691562 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-98a53cb2-4774-4336-8cf9-2f16f05fa6b7 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:02.692505 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-98a53cb2-4774-4336-8cf9-2f16f05fa6b7 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:02.693828 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-98a53cb2-4774-4336-8cf9-2f16f05fa6b7 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:02.694973 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-98a53cb2-4774-4336-8cf9-2f16f05fa6b7 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:02.944342 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-09c345dd-8f45-472a-87ae-0d00a1619a25 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Flavor limits 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:51:02.945404 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-09c345dd-8f45-472a-87ae-0d00a1619a25 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Image limits 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:51:02.945991 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-09c345dd-8f45-472a-87ae-0d00a1619a25 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Flavor pref 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:51:02.946460 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-09c345dd-8f45-472a-87ae-0d00a1619a25 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Image pref 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:51:02.947103 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-09c345dd-8f45-472a-87ae-0d00a1619a25 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:51:02.962065 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-09c345dd-8f45-472a-87ae-0d00a1619a25 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:02.968004 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-09c345dd-8f45-472a-87ae-0d00a1619a25 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:02.969122 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-09c345dd-8f45-472a-87ae-0d00a1619a25 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:02.970377 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-09c345dd-8f45-472a-87ae-0d00a1619a25 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:02.971248 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-09c345dd-8f45-472a-87ae-0d00a1619a25 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:02.971859 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-09c345dd-8f45-472a-87ae-0d00a1619a25 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:03.018594 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-09c345dd-8f45-472a-87ae-0d00a1619a25 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Getting quotas for project 82ae4960393c464c97669731c2084d0f. Resources: {'ram', 'instances', 'cores'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:51:03.028541 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-09c345dd-8f45-472a-87ae-0d00a1619a25 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Getting quotas for user e2c208ec9faf491385a9ab5b5932098d and project 82ae4960393c464c97669731c2084d0f. Resources: {'ram', 'instances', 'cores'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:51:03.047812 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-98a53cb2-4774-4336-8cf9-2f16f05fa6b7 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b78af5c0485b4343900269160ef3e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659f3d4023b347d58bc0361db9ceead9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:03.060584 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-09c345dd-8f45-472a-87ae-0d00a1619a25 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Going to run 1 instances... {{(pid=128802) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:51:03.063250 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-98a53cb2-4774-4336-8cf9-2f16f05fa6b7 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b78af5c0485b4343900269160ef3e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659f3d4023b347d58bc0361db9ceead9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:03.063430 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-09c345dd-8f45-472a-87ae-0d00a1619a25 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] [instance: e0ca65a5-b651-4473-b73f-af62bf6a6e92] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='15b24725-0c99-4bcf-b1fb-907cdf8e2d63',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128802) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:51:03.064739 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-98a53cb2-4774-4336-8cf9-2f16f05fa6b7 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b78af5c0485b4343900269160ef3e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659f3d4023b347d58bc0361db9ceead9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:03.065914 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-98a53cb2-4774-4336-8cf9-2f16f05fa6b7 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] 10.222.0.33 "GET /compute/v2.1/servers/f8ba4e66-2997-4822-9c01-c570f5ae6e87" status: 200 len: 1661 microversion: 2.42 time: 0.396321 Oct 04 20:51:03.086760 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1825/3715] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:51:02 2022] GET /compute/v2.1/servers/f8ba4e66-2997-4822-9c01-c570f5ae6e87 => generated 1661 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:51:03.095995 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7e17be85-debf-4e77-b7c7-f1b60081e7b2 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:03.096626 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-7e17be85-debf-4e77-b7c7-f1b60081e7b2 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] [instance: 0f0dfbcf-cfc3-4af8-9142-956b74ade0bd] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:51:03.106925 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7e17be85-debf-4e77-b7c7-f1b60081e7b2 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:03.107428 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7e17be85-debf-4e77-b7c7-f1b60081e7b2 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:03.108582 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7e17be85-debf-4e77-b7c7-f1b60081e7b2 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:03.109331 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7e17be85-debf-4e77-b7c7-f1b60081e7b2 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:03.109794 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7e17be85-debf-4e77-b7c7-f1b60081e7b2 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:03.110233 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7e17be85-debf-4e77-b7c7-f1b60081e7b2 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:03.142071 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-09c345dd-8f45-472a-87ae-0d00a1619a25 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.414649 Oct 04 20:51:03.148024 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1891/3716] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 20:51:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 2423 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 20:51:03.153707 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-7e17be85-debf-4e77-b7c7-f1b60081e7b2 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] HTTP exception thrown: Instance 0f0dfbcf-cfc3-4af8-9142-956b74ade0bd could not be found. Oct 04 20:51:03.155768 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7e17be85-debf-4e77-b7c7-f1b60081e7b2 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Request method failure captured: Oct 04 20:51:03.155768 n-d-854823-8 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/0f0dfbcf-cfc3-4af8-9142-956b74ade0bd HTTP/1.1 Oct 04 20:51:03.155768 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:51:03.155768 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:51:03.155768 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:51:03.155768 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 0 Oct 04 20:51:03.155768 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:51:03.155768 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:51:03.155768 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:51:03.155768 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:51:03.155768 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJwRZt6OsEymvbyiC_o8h8pd7a0mS3ym9OlONwt_v664BdUS1uwXxrvrb9UPLfWH1pzNGmLu8Zu7S1KiDxdWnCdRprtmaTgZi4BwmYWS1Pb-xXBarog3IQrdNL-MR5SF2e054Jc4_L5KrL6HNpPVbhq8XVgt7W0yRIsATX3XQIQnkME Oct 04 20:51:03.155768 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:51:03.155768 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:51:03.155768 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:51:03.155768 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:51:03.155768 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:51:03.155768 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:51:03.155768 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: 09101effe9da463dabc2edaccdb83e06 Oct 04 20:51:03.155768 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-VolumesAdminNegativeTest-688975349 Oct 04 20:51:03.155768 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 20:51:03.155768 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 20:51:03.155768 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_09101effe9da463dabc2edaccdb83e06", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/09101effe9da463dabc2edaccdb83e06"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/09101effe9da463dabc2edaccdb83e06"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/09101effe9da463dabc2edaccdb83e06"}]}] Oct 04 20:51:03.155768 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-VolumesAdminNegativeTest-688975349 Oct 04 20:51:03.155768 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: 09101effe9da463dabc2edaccdb83e06 Oct 04 20:51:03.155768 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-688975349 Oct 04 20:51:03.155768 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-VolumesAdminNegativeTest-688975349-project Oct 04 20:51:03.155768 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:51:03.155768 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:51:03.155768 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: e8397c96a6dd4c65bdde07c91ca5e7fa Oct 04 20:51:03.155768 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-VolumesAdminNegativeTest-688975349-project Oct 04 20:51:03.155768 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 20:51:03.155768 n-d-854823-8 devstack@n-api.service[128801]: exception: Instance 0f0dfbcf-cfc3-4af8-9142-956b74ade0bd could not be found. Oct 04 20:51:03.155768 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': '0f0dfbcf-cfc3-4af8-9142-956b74ade0bd'} Oct 04 20:51:03.155768 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:51:03.155768 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:51:03.155768 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:51:03.155768 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:51:03.155768 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:51:03.155768 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:51:03.155768 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:51:03.155768 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:51:03.155768 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:51:03.155768 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:51:03.155768 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f0dfbcf-cfc3-4af8-9142-956b74ade0bd could not be found. Oct 04 20:51:03.155768 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:51:03.155768 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:51:03.155768 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:51:03.155768 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:51:03.155768 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:51:03.155768 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:51:03.155768 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:51:03.155768 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:51:03.155768 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:51:03.155768 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:51:03.155768 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:51:03.155768 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:51:03.155768 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:51:03.155768 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:51:03.155768 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:51:03.155768 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:51:03.155768 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f0dfbcf-cfc3-4af8-9142-956b74ade0bd could not be found. Oct 04 20:51:03.155768 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:51:03.155768 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:51:03.155768 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:51:03.161311 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:51:03.161311 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:51:03.161311 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:51:03.161311 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:51:03.161311 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:51:03.161311 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f0dfbcf-cfc3-4af8-9142-956b74ade0bd could not be found. Oct 04 20:51:03.161311 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:51:03.164825 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-8a72f3fc-1e9d-46e0-bbde-46320bdccb6a req-c6ff6f3b-e075-4a87-bfa2-bae66eef19f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f0dfbcf-cfc3-4af8-9142-956b74ade0bd", "name": "network-vif-deleted", "tag": "c76b8ecf-b973-4c9a-a65e-80e935c2c4ea"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:51:03.166168 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7e17be85-debf-4e77-b7c7-f1b60081e7b2 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Returning 404 to user: Instance 0f0dfbcf-cfc3-4af8-9142-956b74ade0bd could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:51:03.167021 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-7e17be85-debf-4e77-b7c7-f1b60081e7b2 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] 10.222.0.33 "GET /compute/v2.1/servers/0f0dfbcf-cfc3-4af8-9142-956b74ade0bd" status: 404 len: 111 microversion: 2.1 time: 0.079188 Oct 04 20:51:03.167621 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1826/3717] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:51:03 2022] GET /compute/v2.1/servers/0f0dfbcf-cfc3-4af8-9142-956b74ade0bd => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:51:03.172922 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a27f9540-9bc7-4c7e-8f9c-1794551dac44 tempest-VolumesSnapshotsTestJSON-1939288336 tempest-VolumesSnapshotsTestJSON-1939288336-project] Calling method '.version_select at 0x7f3c7431f790>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:03.181652 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-8a72f3fc-1e9d-46e0-bbde-46320bdccb6a req-c6ff6f3b-e075-4a87-bfa2-bae66eef19f4 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:03.182170 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-8a72f3fc-1e9d-46e0-bbde-46320bdccb6a req-c6ff6f3b-e075-4a87-bfa2-bae66eef19f4 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:03.182619 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-8a72f3fc-1e9d-46e0-bbde-46320bdccb6a req-c6ff6f3b-e075-4a87-bfa2-bae66eef19f4 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:03.196183 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-8a72f3fc-1e9d-46e0-bbde-46320bdccb6a req-c6ff6f3b-e075-4a87-bfa2-bae66eef19f4 service nova] Creating event network-vif-deleted:c76b8ecf-b973-4c9a-a65e-80e935c2c4ea for instance 0f0dfbcf-cfc3-4af8-9142-956b74ade0bd on n-h2-854823-8 Oct 04 20:51:03.207350 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-8a72f3fc-1e9d-46e0-bbde-46320bdccb6a req-c6ff6f3b-e075-4a87-bfa2-bae66eef19f4 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057721 Oct 04 20:51:03.208717 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1892/3718] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:51:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:51:03.215027 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-957b94e0-5955-4359-8461-6bf575afc7bf tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "default"}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:51:03.216089 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-957b94e0-5955-4359-8461-6bf575afc7bf tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: db7ee8ad-13be-450c-b9a9-1da939dbc268] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:51:03.225621 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-957b94e0-5955-4359-8461-6bf575afc7bf tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:03.226241 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-957b94e0-5955-4359-8461-6bf575afc7bf tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:03.231286 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-957b94e0-5955-4359-8461-6bf575afc7bf tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:03.232590 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-957b94e0-5955-4359-8461-6bf575afc7bf tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:03.242998 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-957b94e0-5955-4359-8461-6bf575afc7bf tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:03.243679 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-957b94e0-5955-4359-8461-6bf575afc7bf tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:03.418814 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a27f9540-9bc7-4c7e-8f9c-1794551dac44 tempest-VolumesSnapshotsTestJSON-1939288336 tempest-VolumesSnapshotsTestJSON-1939288336-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/273b32af-aa4c-4bb3-9132-d3e91f3b8f2c" status: 200 len: 345 microversion: 2.1 time: 0.249968 Oct 04 20:51:03.419959 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1827/3719] 10.222.0.33 () {58 vars in 1245 bytes} [Tue Oct 4 20:51:03 2022] GET /compute/v2.1/os-volumes/273b32af-aa4c-4bb3-9132-d3e91f3b8f2c => generated 345 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:51:03.432531 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c99160af-4bf8-4814-a6ad-c7f609cf1d66 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:03.433477 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c99160af-4bf8-4814-a6ad-c7f609cf1d66 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] [instance: e0ca65a5-b651-4473-b73f-af62bf6a6e92] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:51:03.673213 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c99160af-4bf8-4814-a6ad-c7f609cf1d66 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c208ec9faf491385a9ab5b5932098d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ae4960393c464c97669731c2084d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:03.681820 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c99160af-4bf8-4814-a6ad-c7f609cf1d66 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] 10.222.0.33 "GET /compute/v2.1/servers/e0ca65a5-b651-4473-b73f-af62bf6a6e92" status: 200 len: 1215 microversion: 2.1 time: 0.259765 Oct 04 20:51:03.685487 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1828/3720] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:51:03 2022] GET /compute/v2.1/servers/e0ca65a5-b651-4473-b73f-af62bf6a6e92 => generated 1215 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:51:03.700496 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-732b8e12-a8d3-4320-8af2-782eae59e64a tempest-VolumesSnapshotsTestJSON-1939288336 tempest-VolumesSnapshotsTestJSON-1939288336-project] Action: 'create', calling method: .version_select at 0x7f3c7431f4c0>, body: {"snapshot": {"volume_id": "273b32af-aa4c-4bb3-9132-d3e91f3b8f2c", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1026302226"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:51:03.726248 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.network.security_group_api [None req-957b94e0-5955-4359-8461-6bf575afc7bf tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Removing security group 5c69237a-5ef0-4251-bc58-b2a82d66429c from port 6f6e72a8-155e-4495-9560-85d30934edee Oct 04 20:51:04.087727 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-732b8e12-a8d3-4320-8af2-782eae59e64a tempest-VolumesSnapshotsTestJSON-1939288336 tempest-VolumesSnapshotsTestJSON-1939288336-project] 10.222.0.33 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.400279 Oct 04 20:51:04.088456 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1829/3721] 10.222.0.33 () {60 vars in 1162 bytes} [Tue Oct 4 20:51:03 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:51:04.096384 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-fcff7daa-758b-4bbe-b368-abe578e520a6 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:04.097573 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-fcff7daa-758b-4bbe-b368-abe578e520a6 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] [instance: f15ae3c9-8342-4ae9-b81e-2d7b1aecb2e8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:51:04.114100 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fcff7daa-758b-4bbe-b368-abe578e520a6 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:04.116034 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fcff7daa-758b-4bbe-b368-abe578e520a6 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:04.116842 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fcff7daa-758b-4bbe-b368-abe578e520a6 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:04.118622 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fcff7daa-758b-4bbe-b368-abe578e520a6 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:04.119893 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fcff7daa-758b-4bbe-b368-abe578e520a6 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:04.120945 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fcff7daa-758b-4bbe-b368-abe578e520a6 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:04.725392 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-fcff7daa-758b-4bbe-b368-abe578e520a6 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc4171c0ee14ebb8b5eff5e910ccf49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003eb03a265a496d8981e45c74b014f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:04.742563 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-fcff7daa-758b-4bbe-b368-abe578e520a6 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] 10.222.0.33 "GET /compute/v2.1/servers/f15ae3c9-8342-4ae9-b81e-2d7b1aecb2e8" status: 200 len: 1523 microversion: 2.1 time: 0.652922 Oct 04 20:51:04.746168 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1830/3722] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:51:04 2022] GET /compute/v2.1/servers/f15ae3c9-8342-4ae9-b81e-2d7b1aecb2e8 => generated 1523 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:51:04.771558 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-dca1dc26-11c9-4bf8-bfac-8efb08b0c8cb tempest-VolumesSnapshotsTestJSON-1939288336 tempest-VolumesSnapshotsTestJSON-1939288336-project] Calling method '.version_select at 0x7f3c740cbdc0>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:04.822256 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-dca1dc26-11c9-4bf8-bfac-8efb08b0c8cb tempest-VolumesSnapshotsTestJSON-1939288336 tempest-VolumesSnapshotsTestJSON-1939288336-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/cb05edb4-5d08-4e55-b973-34ea91a79f29" status: 200 len: 287 microversion: 2.1 time: 0.074662 Oct 04 20:51:04.823002 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1831/3723] 10.222.0.33 () {58 vars in 1251 bytes} [Tue Oct 4 20:51:04 2022] GET /compute/v2.1/os-snapshots/cb05edb4-5d08-4e55-b973-34ea91a79f29 => generated 287 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:51:04.833982 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8aeea47c-3e89-443b-9ab8-88d96012a9c3 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:04.834795 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-8aeea47c-3e89-443b-9ab8-88d96012a9c3 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] [instance: f8ba4e66-2997-4822-9c01-c570f5ae6e87] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:51:04.841627 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8aeea47c-3e89-443b-9ab8-88d96012a9c3 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:04.843216 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8aeea47c-3e89-443b-9ab8-88d96012a9c3 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:04.843780 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8aeea47c-3e89-443b-9ab8-88d96012a9c3 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:04.844797 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8aeea47c-3e89-443b-9ab8-88d96012a9c3 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:04.845491 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8aeea47c-3e89-443b-9ab8-88d96012a9c3 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:04.846148 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8aeea47c-3e89-443b-9ab8-88d96012a9c3 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:05.020696 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-957b94e0-5955-4359-8461-6bf575afc7bf tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "POST /compute/v2.1/servers/db7ee8ad-13be-450c-b9a9-1da939dbc268/action" status: 202 len: 0 microversion: 2.1 time: 1.810326 Oct 04 20:51:05.022001 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1893/3724] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 20:51:03 2022] POST /compute/v2.1/servers/db7ee8ad-13be-450c-b9a9-1da939dbc268/action => generated 0 bytes in 1813 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:51:05.027718 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-ff12658d-f836-4cc8-bb50-010078e764c0 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:05.028660 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-ff12658d-f836-4cc8-bb50-010078e764c0 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] [instance: e0ca65a5-b651-4473-b73f-af62bf6a6e92] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:51:05.044636 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ff12658d-f836-4cc8-bb50-010078e764c0 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:05.047797 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ff12658d-f836-4cc8-bb50-010078e764c0 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:05.048504 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ff12658d-f836-4cc8-bb50-010078e764c0 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:05.051024 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ff12658d-f836-4cc8-bb50-010078e764c0 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:05.052280 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ff12658d-f836-4cc8-bb50-010078e764c0 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:05.053079 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ff12658d-f836-4cc8-bb50-010078e764c0 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:05.244574 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-ff12658d-f836-4cc8-bb50-010078e764c0 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c208ec9faf491385a9ab5b5932098d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ae4960393c464c97669731c2084d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:05.255910 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-ff12658d-f836-4cc8-bb50-010078e764c0 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] 10.222.0.33 "GET /compute/v2.1/servers/e0ca65a5-b651-4473-b73f-af62bf6a6e92" status: 200 len: 1267 microversion: 2.1 time: 0.232539 Oct 04 20:51:05.256786 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1894/3725] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:51:05 2022] GET /compute/v2.1/servers/e0ca65a5-b651-4473-b73f-af62bf6a6e92 => generated 1267 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:51:05.269087 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-e8687995-ec1a-4665-9905-60e6423b60e6 tempest-VolumesSnapshotsTestJSON-1939288336 tempest-VolumesSnapshotsTestJSON-1939288336-project] Calling method '.version_select at 0x7f3c6f75d700>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:05.369620 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-8aeea47c-3e89-443b-9ab8-88d96012a9c3 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b78af5c0485b4343900269160ef3e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659f3d4023b347d58bc0361db9ceead9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:05.383896 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-8aeea47c-3e89-443b-9ab8-88d96012a9c3 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b78af5c0485b4343900269160ef3e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659f3d4023b347d58bc0361db9ceead9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:05.393265 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-8aeea47c-3e89-443b-9ab8-88d96012a9c3 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b78af5c0485b4343900269160ef3e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659f3d4023b347d58bc0361db9ceead9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:05.395152 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-8aeea47c-3e89-443b-9ab8-88d96012a9c3 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] 10.222.0.33 "GET /compute/v2.1/servers/f8ba4e66-2997-4822-9c01-c570f5ae6e87" status: 200 len: 1707 microversion: 2.42 time: 0.571129 Oct 04 20:51:05.405350 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-e8687995-ec1a-4665-9905-60e6423b60e6 tempest-VolumesSnapshotsTestJSON-1939288336 tempest-VolumesSnapshotsTestJSON-1939288336-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.145643 Oct 04 20:51:05.410860 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1832/3726] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:51:04 2022] GET /compute/v2.1/servers/f8ba4e66-2997-4822-9c01-c570f5ae6e87 => generated 1707 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:51:05.413949 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1895/3727] 10.222.0.33 () {58 vars in 1140 bytes} [Tue Oct 4 20:51:05 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:51:05.423156 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-211004ac-9354-41aa-929a-c1bd7926ef13 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:05.423893 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-da9050bd-073b-44be-88cb-7fd2450ebbce req-3d27b285-4c51-42c0-a737-354b89090f97 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db7ee8ad-13be-450c-b9a9-1da939dbc268", "tag": "6f6e72a8-155e-4495-9560-85d30934edee"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:51:05.427563 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-211004ac-9354-41aa-929a-c1bd7926ef13 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: db7ee8ad-13be-450c-b9a9-1da939dbc268] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:51:05.440272 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=6 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:51:05.443119 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-211004ac-9354-41aa-929a-c1bd7926ef13 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:05.444594 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-211004ac-9354-41aa-929a-c1bd7926ef13 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:05.448253 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-211004ac-9354-41aa-929a-c1bd7926ef13 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:05.449592 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-211004ac-9354-41aa-929a-c1bd7926ef13 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:05.451527 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-211004ac-9354-41aa-929a-c1bd7926ef13 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:05.453807 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-da9050bd-073b-44be-88cb-7fd2450ebbce req-3d27b285-4c51-42c0-a737-354b89090f97 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:05.454597 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-211004ac-9354-41aa-929a-c1bd7926ef13 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:05.455193 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-da9050bd-073b-44be-88cb-7fd2450ebbce req-3d27b285-4c51-42c0-a737-354b89090f97 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:05.455813 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-da9050bd-073b-44be-88cb-7fd2450ebbce req-3d27b285-4c51-42c0-a737-354b89090f97 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:05.480062 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-da9050bd-073b-44be-88cb-7fd2450ebbce req-3d27b285-4c51-42c0-a737-354b89090f97 service nova] Creating event network-changed:6f6e72a8-155e-4495-9560-85d30934edee for instance db7ee8ad-13be-450c-b9a9-1da939dbc268 on n-h2-854823-8 Oct 04 20:51:05.487249 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-da9050bd-073b-44be-88cb-7fd2450ebbce req-3d27b285-4c51-42c0-a737-354b89090f97 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071671 Oct 04 20:51:05.489962 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1896/3728] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:51:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:51:05.496543 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-b74b005b-8afc-492a-9c30-5016ac065936 tempest-VolumesSnapshotsTestJSON-1939288336 tempest-VolumesSnapshotsTestJSON-1939288336-project] Calling method '.version_select at 0x7f3c6f75ea60>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:05.560262 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-b74b005b-8afc-492a-9c30-5016ac065936 tempest-VolumesSnapshotsTestJSON-1939288336 tempest-VolumesSnapshotsTestJSON-1939288336-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/cb05edb4-5d08-4e55-b973-34ea91a79f29" status: 200 len: 287 microversion: 2.1 time: 0.068871 Oct 04 20:51:05.569174 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1897/3729] 10.222.0.33 () {58 vars in 1251 bytes} [Tue Oct 4 20:51:05 2022] GET /compute/v2.1/os-snapshots/cb05edb4-5d08-4e55-b973-34ea91a79f29 => generated 287 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:51:05.775236 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-c3f6deef-83ea-4ce4-ba56-231ec186147f tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:05.776891 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-c3f6deef-83ea-4ce4-ba56-231ec186147f tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] [instance: f15ae3c9-8342-4ae9-b81e-2d7b1aecb2e8] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:51:05.781280 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-211004ac-9354-41aa-929a-c1bd7926ef13 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac650232cc04810b1340dc2f0edadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b0670d1bd99424780a70e69d57a2166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:05.789973 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c3f6deef-83ea-4ce4-ba56-231ec186147f tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:05.791837 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c3f6deef-83ea-4ce4-ba56-231ec186147f tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:05.793823 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c3f6deef-83ea-4ce4-ba56-231ec186147f tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:05.794195 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-211004ac-9354-41aa-929a-c1bd7926ef13 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "GET /compute/v2.1/servers/db7ee8ad-13be-450c-b9a9-1da939dbc268" status: 200 len: 1461 microversion: 2.1 time: 0.380526 Oct 04 20:51:05.795942 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c3f6deef-83ea-4ce4-ba56-231ec186147f tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:05.797014 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c3f6deef-83ea-4ce4-ba56-231ec186147f tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:05.798727 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c3f6deef-83ea-4ce4-ba56-231ec186147f tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:05.816055 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1833/3730] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:51:05 2022] GET /compute/v2.1/servers/db7ee8ad-13be-450c-b9a9-1da939dbc268 => generated 1461 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:51:05.839215 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-bb772c24-546e-42f5-92db-efcd5175502b tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:05.840249 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-bb772c24-546e-42f5-92db-efcd5175502b tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: 4d46fff2-b04d-41aa-ada0-2023ab545b48] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:51:05.853786 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bb772c24-546e-42f5-92db-efcd5175502b tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:05.854786 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bb772c24-546e-42f5-92db-efcd5175502b tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:05.855442 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bb772c24-546e-42f5-92db-efcd5175502b tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:05.857949 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bb772c24-546e-42f5-92db-efcd5175502b tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:05.858631 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bb772c24-546e-42f5-92db-efcd5175502b tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:05.860438 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bb772c24-546e-42f5-92db-efcd5175502b tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:06.206055 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:51:06.399614 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-c3f6deef-83ea-4ce4-ba56-231ec186147f tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc4171c0ee14ebb8b5eff5e910ccf49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003eb03a265a496d8981e45c74b014f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:06.411876 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-c3f6deef-83ea-4ce4-ba56-231ec186147f tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] 10.222.0.33 "GET /compute/v2.1/servers/f15ae3c9-8342-4ae9-b81e-2d7b1aecb2e8" status: 200 len: 1523 microversion: 2.1 time: 0.644496 Oct 04 20:51:06.429462 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1898/3731] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:51:05 2022] GET /compute/v2.1/servers/f15ae3c9-8342-4ae9-b81e-2d7b1aecb2e8 => generated 1523 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:51:06.444676 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-67f5c227-43f7-4079-8dc2-a0e45d944c77 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:06.445955 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-67f5c227-43f7-4079-8dc2-a0e45d944c77 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] [instance: e0ca65a5-b651-4473-b73f-af62bf6a6e92] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:51:06.475141 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-67f5c227-43f7-4079-8dc2-a0e45d944c77 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:06.476257 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-67f5c227-43f7-4079-8dc2-a0e45d944c77 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:06.476887 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-67f5c227-43f7-4079-8dc2-a0e45d944c77 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:06.477784 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-67f5c227-43f7-4079-8dc2-a0e45d944c77 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:06.478446 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-67f5c227-43f7-4079-8dc2-a0e45d944c77 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:06.479230 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-67f5c227-43f7-4079-8dc2-a0e45d944c77 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:06.630607 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-bb772c24-546e-42f5-92db-efcd5175502b tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac650232cc04810b1340dc2f0edadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b0670d1bd99424780a70e69d57a2166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:06.636782 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-67f5c227-43f7-4079-8dc2-a0e45d944c77 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c208ec9faf491385a9ab5b5932098d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ae4960393c464c97669731c2084d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:06.642513 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-bb772c24-546e-42f5-92db-efcd5175502b tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48" status: 200 len: 1669 microversion: 2.1 time: 0.807353 Oct 04 20:51:06.643117 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1834/3732] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:51:05 2022] GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48 => generated 1669 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:51:06.650099 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-67f5c227-43f7-4079-8dc2-a0e45d944c77 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] 10.222.0.33 "GET /compute/v2.1/servers/e0ca65a5-b651-4473-b73f-af62bf6a6e92" status: 200 len: 1273 microversion: 2.1 time: 0.215444 Oct 04 20:51:06.666094 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1899/3733] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:51:06 2022] GET /compute/v2.1/servers/e0ca65a5-b651-4473-b73f-af62bf6a6e92 => generated 1273 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:51:06.682483 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-2888d824-3699-44e6-854b-d521df5bca3d tempest-VolumesSnapshotsTestJSON-1939288336 tempest-VolumesSnapshotsTestJSON-1939288336-project] Calling method '.version_select at 0x7f3c7885cf70>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:06.684222 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7d52e6fb-b102-48b3-91b7-3a4cc3b540a5 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:06.685068 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-7d52e6fb-b102-48b3-91b7-3a4cc3b540a5 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] [instance: f8ba4e66-2997-4822-9c01-c570f5ae6e87] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:51:06.695716 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:51:06.699006 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7d52e6fb-b102-48b3-91b7-3a4cc3b540a5 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:06.702732 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7d52e6fb-b102-48b3-91b7-3a4cc3b540a5 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:06.703735 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7d52e6fb-b102-48b3-91b7-3a4cc3b540a5 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:06.704973 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7d52e6fb-b102-48b3-91b7-3a4cc3b540a5 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:06.705774 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7d52e6fb-b102-48b3-91b7-3a4cc3b540a5 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:06.707155 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7d52e6fb-b102-48b3-91b7-3a4cc3b540a5 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:06.751212 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-2888d824-3699-44e6-854b-d521df5bca3d tempest-VolumesSnapshotsTestJSON-1939288336 tempest-VolumesSnapshotsTestJSON-1939288336-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/cb05edb4-5d08-4e55-b973-34ea91a79f29" status: 200 len: 288 microversion: 2.1 time: 0.083607 Oct 04 20:51:06.758954 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1900/3734] 10.222.0.33 () {58 vars in 1251 bytes} [Tue Oct 4 20:51:06 2022] GET /compute/v2.1/os-snapshots/cb05edb4-5d08-4e55-b973-34ea91a79f29 => generated 288 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:51:06.766469 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-15932a42-8159-40fc-ae92-5b885f737fca tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:06.770238 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-15932a42-8159-40fc-ae92-5b885f737fca tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: 4d46fff2-b04d-41aa-ada0-2023ab545b48] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:51:06.787217 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-15932a42-8159-40fc-ae92-5b885f737fca tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:06.790752 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-15932a42-8159-40fc-ae92-5b885f737fca tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:06.794319 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-15932a42-8159-40fc-ae92-5b885f737fca tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:06.796068 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-15932a42-8159-40fc-ae92-5b885f737fca tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:06.800537 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-15932a42-8159-40fc-ae92-5b885f737fca tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:06.801663 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-15932a42-8159-40fc-ae92-5b885f737fca tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:07.821820 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-7d52e6fb-b102-48b3-91b7-3a4cc3b540a5 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b78af5c0485b4343900269160ef3e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659f3d4023b347d58bc0361db9ceead9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:07.833395 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-7d52e6fb-b102-48b3-91b7-3a4cc3b540a5 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b78af5c0485b4343900269160ef3e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659f3d4023b347d58bc0361db9ceead9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:07.835232 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-7d52e6fb-b102-48b3-91b7-3a4cc3b540a5 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b78af5c0485b4343900269160ef3e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659f3d4023b347d58bc0361db9ceead9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:07.836653 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-7d52e6fb-b102-48b3-91b7-3a4cc3b540a5 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] 10.222.0.33 "GET /compute/v2.1/servers/f8ba4e66-2997-4822-9c01-c570f5ae6e87" status: 200 len: 1753 microversion: 2.42 time: 1.181094 Oct 04 20:51:07.837994 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1835/3735] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:51:06 2022] GET /compute/v2.1/servers/f8ba4e66-2997-4822-9c01-c570f5ae6e87 => generated 1753 bytes in 1194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:51:07.854278 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f03e2045-f117-4dbf-8975-cd08ddb440af tempest-VolumesSnapshotsTestJSON-1939288336 tempest-VolumesSnapshotsTestJSON-1939288336-project] Calling method '.version_select at 0x7f3c740a73a0>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:07.896601 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-15932a42-8159-40fc-ae92-5b885f737fca tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac650232cc04810b1340dc2f0edadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b0670d1bd99424780a70e69d57a2166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:07.908022 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-15932a42-8159-40fc-ae92-5b885f737fca tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48" status: 200 len: 1669 microversion: 2.1 time: 1.147212 Oct 04 20:51:07.910791 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1901/3736] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:51:06 2022] GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48 => generated 1669 bytes in 1151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:51:07.921401 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-6fbc6afc-b8a4-4dd9-97a8-00baa002c8c8 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:07.923323 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-6fbc6afc-b8a4-4dd9-97a8-00baa002c8c8 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] [instance: f15ae3c9-8342-4ae9-b81e-2d7b1aecb2e8] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:51:07.942940 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6fbc6afc-b8a4-4dd9-97a8-00baa002c8c8 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:07.946459 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6fbc6afc-b8a4-4dd9-97a8-00baa002c8c8 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:07.947303 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6fbc6afc-b8a4-4dd9-97a8-00baa002c8c8 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:07.952290 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6fbc6afc-b8a4-4dd9-97a8-00baa002c8c8 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:07.954813 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6fbc6afc-b8a4-4dd9-97a8-00baa002c8c8 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:07.955587 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6fbc6afc-b8a4-4dd9-97a8-00baa002c8c8 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:08.028954 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f03e2045-f117-4dbf-8975-cd08ddb440af tempest-VolumesSnapshotsTestJSON-1939288336 tempest-VolumesSnapshotsTestJSON-1939288336-project] 10.222.0.33 "DELETE /compute/v2.1/os-snapshots/cb05edb4-5d08-4e55-b973-34ea91a79f29" status: 202 len: 0 microversion: 2.1 time: 0.188942 Oct 04 20:51:08.033490 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1836/3737] 10.222.0.33 () {58 vars in 1254 bytes} [Tue Oct 4 20:51:07 2022] DELETE /compute/v2.1/os-snapshots/cb05edb4-5d08-4e55-b973-34ea91a79f29 => generated 0 bytes in 194 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:51:08.038665 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7f430e3a-c0be-4bd2-bc2e-67f6a97ef595 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:08.039360 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-7f430e3a-c0be-4bd2-bc2e-67f6a97ef595 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] [instance: e0ca65a5-b651-4473-b73f-af62bf6a6e92] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:51:08.063453 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7f430e3a-c0be-4bd2-bc2e-67f6a97ef595 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:08.065990 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7f430e3a-c0be-4bd2-bc2e-67f6a97ef595 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:08.066519 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7f430e3a-c0be-4bd2-bc2e-67f6a97ef595 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:08.067275 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7f430e3a-c0be-4bd2-bc2e-67f6a97ef595 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:08.067745 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7f430e3a-c0be-4bd2-bc2e-67f6a97ef595 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:08.068180 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7f430e3a-c0be-4bd2-bc2e-67f6a97ef595 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:08.644361 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-6fbc6afc-b8a4-4dd9-97a8-00baa002c8c8 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc4171c0ee14ebb8b5eff5e910ccf49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003eb03a265a496d8981e45c74b014f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:08.653180 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-6fbc6afc-b8a4-4dd9-97a8-00baa002c8c8 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] 10.222.0.33 "GET /compute/v2.1/servers/f15ae3c9-8342-4ae9-b81e-2d7b1aecb2e8" status: 200 len: 1523 microversion: 2.1 time: 0.740077 Oct 04 20:51:08.658127 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1902/3738] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:51:07 2022] GET /compute/v2.1/servers/f15ae3c9-8342-4ae9-b81e-2d7b1aecb2e8 => generated 1523 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:51:08.671618 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-6845f7b8-d889-48d2-94d5-40731c1377d7 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:08.672649 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-6845f7b8-d889-48d2-94d5-40731c1377d7 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: 4d46fff2-b04d-41aa-ada0-2023ab545b48] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:51:08.674365 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-7f430e3a-c0be-4bd2-bc2e-67f6a97ef595 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c208ec9faf491385a9ab5b5932098d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ae4960393c464c97669731c2084d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:08.684826 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-7f430e3a-c0be-4bd2-bc2e-67f6a97ef595 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] 10.222.0.33 "GET /compute/v2.1/servers/e0ca65a5-b651-4473-b73f-af62bf6a6e92" status: 200 len: 1315 microversion: 2.1 time: 0.650171 Oct 04 20:51:08.689340 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6845f7b8-d889-48d2-94d5-40731c1377d7 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:08.690328 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6845f7b8-d889-48d2-94d5-40731c1377d7 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:08.692733 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6845f7b8-d889-48d2-94d5-40731c1377d7 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:08.693737 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6845f7b8-d889-48d2-94d5-40731c1377d7 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:08.695585 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1837/3739] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:51:08 2022] GET /compute/v2.1/servers/e0ca65a5-b651-4473-b73f-af62bf6a6e92 => generated 1315 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:51:08.696600 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6845f7b8-d889-48d2-94d5-40731c1377d7 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:08.697310 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6845f7b8-d889-48d2-94d5-40731c1377d7 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:08.721967 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d53d3b16-1350-4aeb-8f7e-fda2bf0c882e tempest-VolumesSnapshotsTestJSON-1939288336 tempest-VolumesSnapshotsTestJSON-1939288336-project] Calling method '.version_select at 0x7f3c746ca820>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:08.789362 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d53d3b16-1350-4aeb-8f7e-fda2bf0c882e tempest-VolumesSnapshotsTestJSON-1939288336 tempest-VolumesSnapshotsTestJSON-1939288336-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/cb05edb4-5d08-4e55-b973-34ea91a79f29" status: 200 len: 287 microversion: 2.1 time: 0.081111 Oct 04 20:51:08.790278 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1838/3740] 10.222.0.33 () {58 vars in 1251 bytes} [Tue Oct 4 20:51:08 2022] GET /compute/v2.1/os-snapshots/cb05edb4-5d08-4e55-b973-34ea91a79f29 => generated 287 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:51:08.865381 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a01a017e-1aea-4cda-ab9d-171773b25497 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:08.867341 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a01a017e-1aea-4cda-ab9d-171773b25497 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] [instance: f8ba4e66-2997-4822-9c01-c570f5ae6e87] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:51:08.898122 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a01a017e-1aea-4cda-ab9d-171773b25497 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:08.899119 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a01a017e-1aea-4cda-ab9d-171773b25497 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:08.899817 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a01a017e-1aea-4cda-ab9d-171773b25497 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:08.900799 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a01a017e-1aea-4cda-ab9d-171773b25497 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:08.903132 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a01a017e-1aea-4cda-ab9d-171773b25497 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:08.904963 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a01a017e-1aea-4cda-ab9d-171773b25497 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:09.103481 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-6845f7b8-d889-48d2-94d5-40731c1377d7 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac650232cc04810b1340dc2f0edadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b0670d1bd99424780a70e69d57a2166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:09.115412 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-6845f7b8-d889-48d2-94d5-40731c1377d7 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48" status: 200 len: 1669 microversion: 2.1 time: 0.454344 Oct 04 20:51:09.116593 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1903/3741] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:51:08 2022] GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48 => generated 1669 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:51:09.139962 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-93624038-76d9-4965-9af4-b3eac3f3d642 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:09.141511 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-93624038-76d9-4965-9af4-b3eac3f3d642 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: 4d46fff2-b04d-41aa-ada0-2023ab545b48] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:51:09.148519 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-93624038-76d9-4965-9af4-b3eac3f3d642 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:09.149377 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-93624038-76d9-4965-9af4-b3eac3f3d642 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:09.150093 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-93624038-76d9-4965-9af4-b3eac3f3d642 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:09.152034 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-93624038-76d9-4965-9af4-b3eac3f3d642 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:09.152733 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-93624038-76d9-4965-9af4-b3eac3f3d642 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:09.153475 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-93624038-76d9-4965-9af4-b3eac3f3d642 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:09.597315 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-a01a017e-1aea-4cda-ab9d-171773b25497 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b78af5c0485b4343900269160ef3e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659f3d4023b347d58bc0361db9ceead9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:09.608865 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-a01a017e-1aea-4cda-ab9d-171773b25497 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b78af5c0485b4343900269160ef3e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659f3d4023b347d58bc0361db9ceead9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:09.617377 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-a01a017e-1aea-4cda-ab9d-171773b25497 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b78af5c0485b4343900269160ef3e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659f3d4023b347d58bc0361db9ceead9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:09.618849 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a01a017e-1aea-4cda-ab9d-171773b25497 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] 10.222.0.33 "GET /compute/v2.1/servers/f8ba4e66-2997-4822-9c01-c570f5ae6e87" status: 200 len: 1753 microversion: 2.42 time: 0.758197 Oct 04 20:51:09.641540 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-93624038-76d9-4965-9af4-b3eac3f3d642 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac650232cc04810b1340dc2f0edadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b0670d1bd99424780a70e69d57a2166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:09.644437 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1839/3742] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:51:08 2022] GET /compute/v2.1/servers/f8ba4e66-2997-4822-9c01-c570f5ae6e87 => generated 1753 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 20:51:09.655931 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-93624038-76d9-4965-9af4-b3eac3f3d642 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48" status: 200 len: 1669 microversion: 2.1 time: 0.520706 Oct 04 20:51:09.666456 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1904/3743] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:51:09 2022] GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48 => generated 1669 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:51:09.697860 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-55a0098b-9399-4de9-9dfe-86914b929cf4 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:09.698814 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-55a0098b-9399-4de9-9dfe-86914b929cf4 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] [instance: f15ae3c9-8342-4ae9-b81e-2d7b1aecb2e8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:51:09.710168 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-55a0098b-9399-4de9-9dfe-86914b929cf4 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:09.711880 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-55a0098b-9399-4de9-9dfe-86914b929cf4 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:09.712577 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-55a0098b-9399-4de9-9dfe-86914b929cf4 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:09.714921 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-55a0098b-9399-4de9-9dfe-86914b929cf4 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:09.715776 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-55a0098b-9399-4de9-9dfe-86914b929cf4 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:09.716465 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-55a0098b-9399-4de9-9dfe-86914b929cf4 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:09.722904 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-1d055fc7-b0ce-4770-9d39-f79b279d5469 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:09.723524 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-1d055fc7-b0ce-4770-9d39-f79b279d5469 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] [instance: e0ca65a5-b651-4473-b73f-af62bf6a6e92] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:51:09.735492 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1d055fc7-b0ce-4770-9d39-f79b279d5469 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:09.736001 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1d055fc7-b0ce-4770-9d39-f79b279d5469 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:09.736447 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1d055fc7-b0ce-4770-9d39-f79b279d5469 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:09.737698 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1d055fc7-b0ce-4770-9d39-f79b279d5469 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:09.747800 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=11,nova_cell1:DELETE=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:51:09.748704 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1d055fc7-b0ce-4770-9d39-f79b279d5469 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:09.749177 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1d055fc7-b0ce-4770-9d39-f79b279d5469 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:09.754627 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=100 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:51:10.377896 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-55a0098b-9399-4de9-9dfe-86914b929cf4 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc4171c0ee14ebb8b5eff5e910ccf49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003eb03a265a496d8981e45c74b014f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:10.393268 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-55a0098b-9399-4de9-9dfe-86914b929cf4 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] 10.222.0.33 "GET /compute/v2.1/servers/f15ae3c9-8342-4ae9-b81e-2d7b1aecb2e8" status: 200 len: 1523 microversion: 2.1 time: 0.710512 Oct 04 20:51:10.393985 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1840/3744] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:51:09 2022] GET /compute/v2.1/servers/f15ae3c9-8342-4ae9-b81e-2d7b1aecb2e8 => generated 1523 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:51:10.419978 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-fe499e68-85a1-4eb5-bbf7-e5e0413a5f0e tempest-VolumesSnapshotsTestJSON-1939288336 tempest-VolumesSnapshotsTestJSON-1939288336-project] Calling method '.version_select at 0x7f3c743098b0>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:10.484438 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-fe499e68-85a1-4eb5-bbf7-e5e0413a5f0e tempest-VolumesSnapshotsTestJSON-1939288336 tempest-VolumesSnapshotsTestJSON-1939288336-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/cb05edb4-5d08-4e55-b973-34ea91a79f29" status: 200 len: 287 microversion: 2.1 time: 0.067970 Oct 04 20:51:10.485934 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1841/3745] 10.222.0.33 () {58 vars in 1251 bytes} [Tue Oct 4 20:51:10 2022] GET /compute/v2.1/os-snapshots/cb05edb4-5d08-4e55-b973-34ea91a79f29 => generated 287 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:51:10.493168 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-91725f2f-7355-4489-aaf7-67c4811b563e tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-547560438", "imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63", "flavorRef": "452", "networks": [{"uuid": "f233dbb4-a3a0-4530-9ca7-211ce7f5e292"}]}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:51:10.587701 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.network.neutron [None req-91725f2f-7355-4489-aaf7-67c4811b563e tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] validate_networks() for [('f233dbb4-a3a0-4530-9ca7-211ce7f5e292', None, None, None, None, None)] {{(pid=128801) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:51:10.850332 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-1d055fc7-b0ce-4770-9d39-f79b279d5469 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c208ec9faf491385a9ab5b5932098d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ae4960393c464c97669731c2084d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:10.864798 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-1d055fc7-b0ce-4770-9d39-f79b279d5469 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] 10.222.0.33 "GET /compute/v2.1/servers/e0ca65a5-b651-4473-b73f-af62bf6a6e92" status: 200 len: 1315 microversion: 2.1 time: 1.147324 Oct 04 20:51:10.871980 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1905/3746] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:51:09 2022] GET /compute/v2.1/servers/e0ca65a5-b651-4473-b73f-af62bf6a6e92 => generated 1315 bytes in 1155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:51:10.877489 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-5442117c-eefc-4b9c-959a-264494e160ae tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:10.878182 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-5442117c-eefc-4b9c-959a-264494e160ae tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] [instance: 9261e0b2-35ac-40f4-92d5-3b9ffaea23c4] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:51:10.895428 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5442117c-eefc-4b9c-959a-264494e160ae tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:10.896231 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5442117c-eefc-4b9c-959a-264494e160ae tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:10.896830 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5442117c-eefc-4b9c-959a-264494e160ae tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:10.897729 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5442117c-eefc-4b9c-959a-264494e160ae tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:10.898357 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5442117c-eefc-4b9c-959a-264494e160ae tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:10.900779 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5442117c-eefc-4b9c-959a-264494e160ae tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:10.961215 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-5442117c-eefc-4b9c-959a-264494e160ae tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] [instance: 9261e0b2-35ac-40f4-92d5-3b9ffaea23c4] Going to try to terminate instance {{(pid=128802) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:51:11.126176 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-5442117c-eefc-4b9c-959a-264494e160ae tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] 10.222.0.33 "DELETE /compute/v2.1/servers/9261e0b2-35ac-40f4-92d5-3b9ffaea23c4" status: 204 len: 0 microversion: 2.1 time: 0.252465 Oct 04 20:51:11.130809 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1906/3747] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 20:51:10 2022] DELETE /compute/v2.1/servers/9261e0b2-35ac-40f4-92d5-3b9ffaea23c4 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:51:11.136807 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-477d49ef-e301-43b9-b68b-b2dc9eec9e09 req-75ccbb71-3524-41cc-aa97-46ada27ab1cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0ca65a5-b651-4473-b73f-af62bf6a6e92", "tag": "3d12d7bd-c1dd-4c3f-a172-0bcbeab0de21"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:51:11.156712 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-477d49ef-e301-43b9-b68b-b2dc9eec9e09 req-75ccbb71-3524-41cc-aa97-46ada27ab1cd service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:11.157699 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-477d49ef-e301-43b9-b68b-b2dc9eec9e09 req-75ccbb71-3524-41cc-aa97-46ada27ab1cd service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:11.158562 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-477d49ef-e301-43b9-b68b-b2dc9eec9e09 req-75ccbb71-3524-41cc-aa97-46ada27ab1cd service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:11.177047 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-477d49ef-e301-43b9-b68b-b2dc9eec9e09 req-75ccbb71-3524-41cc-aa97-46ada27ab1cd service nova] Creating event network-changed:3d12d7bd-c1dd-4c3f-a172-0bcbeab0de21 for instance e0ca65a5-b651-4473-b73f-af62bf6a6e92 on n-h2-854823-8 Oct 04 20:51:11.183593 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-477d49ef-e301-43b9-b68b-b2dc9eec9e09 req-75ccbb71-3524-41cc-aa97-46ada27ab1cd service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051025 Oct 04 20:51:11.185252 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1907/3748] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:51:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:51:11.192734 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-a11f636c-bcc3-4979-b62b-dba34b429464 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:11.193884 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-a11f636c-bcc3-4979-b62b-dba34b429464 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] [instance: f8ba4e66-2997-4822-9c01-c570f5ae6e87] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:51:11.203643 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a11f636c-bcc3-4979-b62b-dba34b429464 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:11.204585 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a11f636c-bcc3-4979-b62b-dba34b429464 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:11.206448 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a11f636c-bcc3-4979-b62b-dba34b429464 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:11.207651 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a11f636c-bcc3-4979-b62b-dba34b429464 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:11.209015 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a11f636c-bcc3-4979-b62b-dba34b429464 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:11.209687 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a11f636c-bcc3-4979-b62b-dba34b429464 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:11.837027 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-a11f636c-bcc3-4979-b62b-dba34b429464 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b78af5c0485b4343900269160ef3e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659f3d4023b347d58bc0361db9ceead9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:11.860137 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-a11f636c-bcc3-4979-b62b-dba34b429464 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b78af5c0485b4343900269160ef3e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659f3d4023b347d58bc0361db9ceead9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:11.862642 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-a11f636c-bcc3-4979-b62b-dba34b429464 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b78af5c0485b4343900269160ef3e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659f3d4023b347d58bc0361db9ceead9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:11.864146 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-a11f636c-bcc3-4979-b62b-dba34b429464 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] 10.222.0.33 "GET /compute/v2.1/servers/f8ba4e66-2997-4822-9c01-c570f5ae6e87" status: 200 len: 1799 microversion: 2.42 time: 0.676337 Oct 04 20:51:11.866694 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1908/3749] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:51:11 2022] GET /compute/v2.1/servers/f8ba4e66-2997-4822-9c01-c570f5ae6e87 => generated 1799 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:51:11.876613 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-1dcb3ebb-1f36-4cd2-8c3a-c06cb1468b9b tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:11.880130 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-1dcb3ebb-1f36-4cd2-8c3a-c06cb1468b9b tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] [instance: 9261e0b2-35ac-40f4-92d5-3b9ffaea23c4] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:51:11.899716 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1dcb3ebb-1f36-4cd2-8c3a-c06cb1468b9b tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:11.900457 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1dcb3ebb-1f36-4cd2-8c3a-c06cb1468b9b tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:11.900987 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1dcb3ebb-1f36-4cd2-8c3a-c06cb1468b9b tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:11.901955 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1dcb3ebb-1f36-4cd2-8c3a-c06cb1468b9b tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:11.905424 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1dcb3ebb-1f36-4cd2-8c3a-c06cb1468b9b tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:11.906151 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1dcb3ebb-1f36-4cd2-8c3a-c06cb1468b9b tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:11.939487 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-91725f2f-7355-4489-aaf7-67c4811b563e tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Flavor limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:51:11.940731 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-91725f2f-7355-4489-aaf7-67c4811b563e tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Image limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:51:11.941429 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-91725f2f-7355-4489-aaf7-67c4811b563e tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Flavor pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:51:11.942061 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-91725f2f-7355-4489-aaf7-67c4811b563e tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Image pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:51:11.942771 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-91725f2f-7355-4489-aaf7-67c4811b563e tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:51:11.958536 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-91725f2f-7355-4489-aaf7-67c4811b563e tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:11.959041 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-91725f2f-7355-4489-aaf7-67c4811b563e tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:11.964753 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-91725f2f-7355-4489-aaf7-67c4811b563e tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:11.966059 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-91725f2f-7355-4489-aaf7-67c4811b563e tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:11.969097 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-91725f2f-7355-4489-aaf7-67c4811b563e tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:11.969941 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-91725f2f-7355-4489-aaf7-67c4811b563e tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:12.034834 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-91725f2f-7355-4489-aaf7-67c4811b563e tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Getting quotas for project 8b0670d1bd99424780a70e69d57a2166. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:51:12.042564 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-91725f2f-7355-4489-aaf7-67c4811b563e tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Getting quotas for user eac650232cc04810b1340dc2f0edadcc and project 8b0670d1bd99424780a70e69d57a2166. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:51:12.074677 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-91725f2f-7355-4489-aaf7-67c4811b563e tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Going to run 1 instances... {{(pid=128801) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:51:12.079255 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-91725f2f-7355-4489-aaf7-67c4811b563e tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: a0273e6e-eb85-4204-9bec-3707ad6612af] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='15b24725-0c99-4bcf-b1fb-907cdf8e2d63',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128801) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:51:12.154886 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-91725f2f-7355-4489-aaf7-67c4811b563e tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.666660 Oct 04 20:51:12.156301 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1842/3750] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 20:51:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 1669 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 20:51:12.162422 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5d08e7ca-1aa9-4532-bfbb-e1c4baac9b1f tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:12.164432 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-5d08e7ca-1aa9-4532-bfbb-e1c4baac9b1f tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] [instance: f15ae3c9-8342-4ae9-b81e-2d7b1aecb2e8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:51:12.172325 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5d08e7ca-1aa9-4532-bfbb-e1c4baac9b1f tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:12.173144 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5d08e7ca-1aa9-4532-bfbb-e1c4baac9b1f tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:12.174082 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5d08e7ca-1aa9-4532-bfbb-e1c4baac9b1f tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:12.175024 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5d08e7ca-1aa9-4532-bfbb-e1c4baac9b1f tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:12.175653 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5d08e7ca-1aa9-4532-bfbb-e1c4baac9b1f tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:12.176257 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5d08e7ca-1aa9-4532-bfbb-e1c4baac9b1f tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:12.377185 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-1dcb3ebb-1f36-4cd2-8c3a-c06cb1468b9b tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8397c96a6dd4c65bdde07c91ca5e7fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09101effe9da463dabc2edaccdb83e06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:12.386770 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-1dcb3ebb-1f36-4cd2-8c3a-c06cb1468b9b tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] 10.222.0.33 "GET /compute/v2.1/servers/9261e0b2-35ac-40f4-92d5-3b9ffaea23c4" status: 200 len: 1679 microversion: 2.1 time: 0.518661 Oct 04 20:51:12.395150 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1909/3751] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:51:11 2022] GET /compute/v2.1/servers/9261e0b2-35ac-40f4-92d5-3b9ffaea23c4 => generated 1679 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:51:12.409993 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-e7ca67fe-af2c-45b9-bc17-0e4341c54a77 tempest-VolumesSnapshotsTestJSON-1939288336 tempest-VolumesSnapshotsTestJSON-1939288336-project] Calling method '.version_select at 0x7f3c787fd9d0>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:12.484491 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.wsgi [None req-e7ca67fe-af2c-45b9-bc17-0e4341c54a77 tempest-VolumesSnapshotsTestJSON-1939288336 tempest-VolumesSnapshotsTestJSON-1939288336-project] HTTP exception thrown: Snapshot cb05edb4-5d08-4e55-b973-34ea91a79f29 could not be found. Oct 04 20:51:12.493998 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-e7ca67fe-af2c-45b9-bc17-0e4341c54a77 tempest-VolumesSnapshotsTestJSON-1939288336 tempest-VolumesSnapshotsTestJSON-1939288336-project] Request method failure captured: Oct 04 20:51:12.493998 n-d-854823-8 devstack@n-api.service[128802]: request: GET /compute/v2.1/os-snapshots/cb05edb4-5d08-4e55-b973-34ea91a79f29 HTTP/1.1 Oct 04 20:51:12.493998 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 20:51:12.493998 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 20:51:12.493998 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 20:51:12.493998 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 0 Oct 04 20:51:12.493998 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 20:51:12.493998 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 20:51:12.493998 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 20:51:12.493998 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 20:51:12.493998 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPJyyIut47vW-OiwuyAhHDcvam7qmB1WegjKoG22s_spcgrx-qt0rEStVqARZvKX_dRm1iTFplHuc81T3F4844iGSDfMa0mxT3EyBUAkIiaYrQhvtVkvbS5K7t-hKYw7d42kCfWZbKD4uCw7H8wpNg8OFQSJfVgggNMmSA0UlaZr9cvk Oct 04 20:51:12.493998 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 20:51:12.493998 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 20:51:12.493998 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 20:51:12.493998 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 20:51:12.493998 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 20:51:12.493998 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 20:51:12.493998 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: 78b42f403d6745899b754e1e351e3a09 Oct 04 20:51:12.493998 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1939288336 Oct 04 20:51:12.493998 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 20:51:12.493998 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 20:51:12.493998 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_78b42f403d6745899b754e1e351e3a09", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/78b42f403d6745899b754e1e351e3a09"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/78b42f403d6745899b754e1e351e3a09"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/78b42f403d6745899b754e1e351e3a09"}]}] Oct 04 20:51:12.493998 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1939288336 Oct 04 20:51:12.493998 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: 78b42f403d6745899b754e1e351e3a09 Oct 04 20:51:12.493998 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1939288336 Oct 04 20:51:12.493998 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-VolumesSnapshotsTestJSON-1939288336-project Oct 04 20:51:12.493998 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 20:51:12.493998 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 20:51:12.493998 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: 383d1ad326a9428aaa53d17afa76f9e6 Oct 04 20:51:12.493998 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1939288336-project Oct 04 20:51:12.493998 n-d-854823-8 devstack@n-api.service[128802]: method: Oct 04 20:51:12.493998 n-d-854823-8 devstack@n-api.service[128802]: exception: Snapshot cb05edb4-5d08-4e55-b973-34ea91a79f29 could not be found. Oct 04 20:51:12.493998 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'id': 'cb05edb4-5d08-4e55-b973-34ea91a79f29'} Oct 04 20:51:12.493998 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:51:12.493998 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:51:12.493998 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 04 20:51:12.493998 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 04 20:51:12.493998 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 04 20:51:12.493998 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 04 20:51:12.493998 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 04 20:51:12.493998 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 04 20:51:12.493998 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 20:51:12.493998 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 20:51:12.493998 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 20:51:12.493998 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 20:51:12.493998 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 20:51:12.493998 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 20:51:12.493998 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 20:51:12.493998 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 20:51:12.493998 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot cb05edb4-5d08-4e55-b973-34ea91a79f29 could not be found. (HTTP 404) (Request-ID: req-ea18d3f5-56b4-4776-8427-030c1ff33322) Oct 04 20:51:12.493998 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:51:12.493998 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:51:12.493998 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:51:12.493998 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:51:12.493998 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Oct 04 20:51:12.493998 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Oct 04 20:51:12.493998 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 04 20:51:12.493998 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 04 20:51:12.493998 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Oct 04 20:51:12.493998 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Oct 04 20:51:12.493998 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 04 20:51:12.493998 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 04 20:51:12.500672 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 04 20:51:12.500672 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 04 20:51:12.500672 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 04 20:51:12.500672 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 04 20:51:12.500672 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 04 20:51:12.500672 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 04 20:51:12.500672 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 20:51:12.500672 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 20:51:12.500672 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 20:51:12.500672 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 20:51:12.500672 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 20:51:12.500672 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 20:51:12.500672 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 20:51:12.500672 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 20:51:12.500672 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot cb05edb4-5d08-4e55-b973-34ea91a79f29 could not be found. Oct 04 20:51:12.500672 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:51:12.500672 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:51:12.500672 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:51:12.500672 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:51:12.500672 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:51:12.500672 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:51:12.500672 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:51:12.500672 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:51:12.500672 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:51:12.500672 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:51:12.500672 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:51:12.500672 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:51:12.500672 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Oct 04 20:51:12.500672 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:51:12.500672 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot cb05edb4-5d08-4e55-b973-34ea91a79f29 could not be found. Oct 04 20:51:12.500672 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:51:12.500672 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:51:12.500672 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:51:12.500672 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:51:12.500672 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:51:12.500672 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:51:12.500672 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:51:12.500672 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:51:12.500672 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot cb05edb4-5d08-4e55-b973-34ea91a79f29 could not be found. Oct 04 20:51:12.500672 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:51:12.512856 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-e7ca67fe-af2c-45b9-bc17-0e4341c54a77 tempest-VolumesSnapshotsTestJSON-1939288336 tempest-VolumesSnapshotsTestJSON-1939288336-project] Returning 404 to user: Snapshot cb05edb4-5d08-4e55-b973-34ea91a79f29 could not be found. {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:51:12.512856 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-e7ca67fe-af2c-45b9-bc17-0e4341c54a77 tempest-VolumesSnapshotsTestJSON-1939288336 tempest-VolumesSnapshotsTestJSON-1939288336-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/cb05edb4-5d08-4e55-b973-34ea91a79f29" status: 404 len: 111 microversion: 2.1 time: 0.110251 Oct 04 20:51:12.513185 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-5d08e7ca-1aa9-4532-bfbb-e1c4baac9b1f tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc4171c0ee14ebb8b5eff5e910ccf49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003eb03a265a496d8981e45c74b014f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:12.513903 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1910/3752] 10.222.0.33 () {58 vars in 1251 bytes} [Tue Oct 4 20:51:12 2022] GET /compute/v2.1/os-snapshots/cb05edb4-5d08-4e55-b973-34ea91a79f29 => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:51:12.520284 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-37867c6d-62ff-49c6-a43a-930481e0778e tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:12.521167 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-37867c6d-62ff-49c6-a43a-930481e0778e tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] [instance: e0ca65a5-b651-4473-b73f-af62bf6a6e92] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:51:12.529197 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-37867c6d-62ff-49c6-a43a-930481e0778e tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:12.531107 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-37867c6d-62ff-49c6-a43a-930481e0778e tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:12.531944 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-37867c6d-62ff-49c6-a43a-930481e0778e tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:12.532978 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-37867c6d-62ff-49c6-a43a-930481e0778e tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:12.533660 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-37867c6d-62ff-49c6-a43a-930481e0778e tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:12.534311 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5d08e7ca-1aa9-4532-bfbb-e1c4baac9b1f tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] 10.222.0.33 "GET /compute/v2.1/servers/f15ae3c9-8342-4ae9-b81e-2d7b1aecb2e8" status: 200 len: 1523 microversion: 2.1 time: 0.376348 Oct 04 20:51:12.534558 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-37867c6d-62ff-49c6-a43a-930481e0778e tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:12.538186 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1843/3753] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:51:12 2022] GET /compute/v2.1/servers/f15ae3c9-8342-4ae9-b81e-2d7b1aecb2e8 => generated 1523 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:51:12.583461 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9db5ae9d-a19a-41c8-a933-b017ea81dd57 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:12.586062 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-9db5ae9d-a19a-41c8-a933-b017ea81dd57 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: a0273e6e-eb85-4204-9bec-3707ad6612af] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:51:12.767170 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-9db5ae9d-a19a-41c8-a933-b017ea81dd57 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac650232cc04810b1340dc2f0edadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b0670d1bd99424780a70e69d57a2166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:12.781665 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-9db5ae9d-a19a-41c8-a933-b017ea81dd57 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "GET /compute/v2.1/servers/a0273e6e-eb85-4204-9bec-3707ad6612af" status: 200 len: 1214 microversion: 2.1 time: 0.240302 Oct 04 20:51:12.784195 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1844/3754] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:51:12 2022] GET /compute/v2.1/servers/a0273e6e-eb85-4204-9bec-3707ad6612af => generated 1214 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:51:12.795596 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-80810899-3309-4e43-a8ef-6a2954b6f7f8 tempest-VolumesSnapshotsTestJSON-1939288336 tempest-VolumesSnapshotsTestJSON-1939288336-project] Calling method '.version_select at 0x7f3c6fa324c0>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:12.906505 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-80810899-3309-4e43-a8ef-6a2954b6f7f8 tempest-VolumesSnapshotsTestJSON-1939288336 tempest-VolumesSnapshotsTestJSON-1939288336-project] 10.222.0.33 "DELETE /compute/v2.1/os-volumes/273b32af-aa4c-4bb3-9132-d3e91f3b8f2c" status: 202 len: 0 microversion: 2.1 time: 0.119810 Oct 04 20:51:12.908039 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1845/3755] 10.222.0.33 () {58 vars in 1248 bytes} [Tue Oct 4 20:51:12 2022] DELETE /compute/v2.1/os-volumes/273b32af-aa4c-4bb3-9132-d3e91f3b8f2c => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:51:12.914522 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c9e34ea9-34e9-4aee-b073-2e7e5259311e tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:12.916566 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c9e34ea9-34e9-4aee-b073-2e7e5259311e tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] [instance: f8ba4e66-2997-4822-9c01-c570f5ae6e87] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:51:12.937864 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c9e34ea9-34e9-4aee-b073-2e7e5259311e tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:12.939792 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c9e34ea9-34e9-4aee-b073-2e7e5259311e tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:12.941728 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c9e34ea9-34e9-4aee-b073-2e7e5259311e tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:12.944513 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c9e34ea9-34e9-4aee-b073-2e7e5259311e tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:12.945274 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c9e34ea9-34e9-4aee-b073-2e7e5259311e tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:12.947299 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c9e34ea9-34e9-4aee-b073-2e7e5259311e tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:12.990932 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell0:SELECT=4 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:51:13.037614 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell0:SELECT=16 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:51:13.335244 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-37867c6d-62ff-49c6-a43a-930481e0778e tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c208ec9faf491385a9ab5b5932098d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ae4960393c464c97669731c2084d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:13.344281 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-37867c6d-62ff-49c6-a43a-930481e0778e tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] 10.222.0.33 "GET /compute/v2.1/servers/e0ca65a5-b651-4473-b73f-af62bf6a6e92" status: 200 len: 1315 microversion: 2.1 time: 0.828424 Oct 04 20:51:13.367557 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c9e34ea9-34e9-4aee-b073-2e7e5259311e tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b78af5c0485b4343900269160ef3e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659f3d4023b347d58bc0361db9ceead9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:13.378466 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1911/3756] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:51:12 2022] GET /compute/v2.1/servers/e0ca65a5-b651-4473-b73f-af62bf6a6e92 => generated 1315 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:51:13.383483 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-d130d5fc-2353-4483-a8b7-79dfded01eb9 tempest-VolumesSnapshotsTestJSON-1939288336 tempest-VolumesSnapshotsTestJSON-1939288336-project] Calling method '.version_select at 0x7f3c741bd550>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:13.388464 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c9e34ea9-34e9-4aee-b073-2e7e5259311e tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b78af5c0485b4343900269160ef3e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659f3d4023b347d58bc0361db9ceead9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:13.394278 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c9e34ea9-34e9-4aee-b073-2e7e5259311e tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b78af5c0485b4343900269160ef3e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659f3d4023b347d58bc0361db9ceead9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:13.395642 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c9e34ea9-34e9-4aee-b073-2e7e5259311e tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] 10.222.0.33 "GET /compute/v2.1/servers/f8ba4e66-2997-4822-9c01-c570f5ae6e87" status: 200 len: 1845 microversion: 2.42 time: 0.486422 Oct 04 20:51:13.400071 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1846/3757] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:51:12 2022] GET /compute/v2.1/servers/f8ba4e66-2997-4822-9c01-c570f5ae6e87 => generated 1845 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:51:13.423954 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-78bf4593-3a41-415e-88c6-113cf0f17ff9 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:13.426181 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-78bf4593-3a41-415e-88c6-113cf0f17ff9 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] [instance: 9261e0b2-35ac-40f4-92d5-3b9ffaea23c4] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:51:13.449031 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-78bf4593-3a41-415e-88c6-113cf0f17ff9 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:13.454278 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-78bf4593-3a41-415e-88c6-113cf0f17ff9 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:13.455247 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-78bf4593-3a41-415e-88c6-113cf0f17ff9 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:13.462388 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-78bf4593-3a41-415e-88c6-113cf0f17ff9 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:13.463137 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-78bf4593-3a41-415e-88c6-113cf0f17ff9 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:13.463842 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-78bf4593-3a41-415e-88c6-113cf0f17ff9 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:13.512116 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-d130d5fc-2353-4483-a8b7-79dfded01eb9 tempest-VolumesSnapshotsTestJSON-1939288336 tempest-VolumesSnapshotsTestJSON-1939288336-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/273b32af-aa4c-4bb3-9132-d3e91f3b8f2c" status: 200 len: 344 microversion: 2.1 time: 0.132304 Oct 04 20:51:13.513665 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1912/3758] 10.222.0.33 () {58 vars in 1245 bytes} [Tue Oct 4 20:51:13 2022] GET /compute/v2.1/os-volumes/273b32af-aa4c-4bb3-9132-d3e91f3b8f2c => generated 344 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:51:13.527376 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-4eeb0769-ddad-4a92-b19a-9852082fd966 req-40db5932-46b7-468b-b272-0feba99db846 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8ba4e66-2997-4822-9c01-c570f5ae6e87", "tag": "6e6d2a48-9844-45c7-a3ac-b235535858ac"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:51:13.538901 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-4eeb0769-ddad-4a92-b19a-9852082fd966 req-40db5932-46b7-468b-b272-0feba99db846 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:13.539787 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-4eeb0769-ddad-4a92-b19a-9852082fd966 req-40db5932-46b7-468b-b272-0feba99db846 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:13.540469 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-4eeb0769-ddad-4a92-b19a-9852082fd966 req-40db5932-46b7-468b-b272-0feba99db846 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:13.553412 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-4eeb0769-ddad-4a92-b19a-9852082fd966 req-40db5932-46b7-468b-b272-0feba99db846 service nova] Creating event network-changed:6e6d2a48-9844-45c7-a3ac-b235535858ac for instance f8ba4e66-2997-4822-9c01-c570f5ae6e87 on n-h1-854823-8 Oct 04 20:51:13.561228 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-4eeb0769-ddad-4a92-b19a-9852082fd966 req-40db5932-46b7-468b-b272-0feba99db846 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037826 Oct 04 20:51:13.562417 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1913/3759] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:51:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:51:13.569308 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-960a3d9e-7899-4536-bcb7-b796b6069c2b tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:13.570492 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-960a3d9e-7899-4536-bcb7-b796b6069c2b tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] [instance: f15ae3c9-8342-4ae9-b81e-2d7b1aecb2e8] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:51:13.579831 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-960a3d9e-7899-4536-bcb7-b796b6069c2b tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:13.581207 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-960a3d9e-7899-4536-bcb7-b796b6069c2b tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:13.581949 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-960a3d9e-7899-4536-bcb7-b796b6069c2b tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:13.582969 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-960a3d9e-7899-4536-bcb7-b796b6069c2b tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:13.583984 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-960a3d9e-7899-4536-bcb7-b796b6069c2b tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:13.584665 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-960a3d9e-7899-4536-bcb7-b796b6069c2b tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:14.243085 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-78bf4593-3a41-415e-88c6-113cf0f17ff9 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8397c96a6dd4c65bdde07c91ca5e7fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09101effe9da463dabc2edaccdb83e06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:14.255065 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-78bf4593-3a41-415e-88c6-113cf0f17ff9 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] 10.222.0.33 "GET /compute/v2.1/servers/9261e0b2-35ac-40f4-92d5-3b9ffaea23c4" status: 200 len: 1679 microversion: 2.1 time: 0.842512 Oct 04 20:51:14.255665 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1847/3760] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:51:13 2022] GET /compute/v2.1/servers/9261e0b2-35ac-40f4-92d5-3b9ffaea23c4 => generated 1679 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:51:14.260452 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-46cdaba2-3728-4d4c-845e-65965422bf96 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:14.265006 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-960a3d9e-7899-4536-bcb7-b796b6069c2b tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc4171c0ee14ebb8b5eff5e910ccf49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003eb03a265a496d8981e45c74b014f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:14.267221 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-46cdaba2-3728-4d4c-845e-65965422bf96 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: a0273e6e-eb85-4204-9bec-3707ad6612af] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:51:14.281714 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-960a3d9e-7899-4536-bcb7-b796b6069c2b tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] 10.222.0.33 "GET /compute/v2.1/servers/f15ae3c9-8342-4ae9-b81e-2d7b1aecb2e8" status: 200 len: 1523 microversion: 2.1 time: 0.717746 Oct 04 20:51:14.282002 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-46cdaba2-3728-4d4c-845e-65965422bf96 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:14.282774 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-46cdaba2-3728-4d4c-845e-65965422bf96 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:14.283375 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-46cdaba2-3728-4d4c-845e-65965422bf96 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:14.284237 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-46cdaba2-3728-4d4c-845e-65965422bf96 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:14.284860 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-46cdaba2-3728-4d4c-845e-65965422bf96 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:14.285444 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-46cdaba2-3728-4d4c-845e-65965422bf96 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:14.286484 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1914/3761] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:51:13 2022] GET /compute/v2.1/servers/f15ae3c9-8342-4ae9-b81e-2d7b1aecb2e8 => generated 1523 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:51:14.369500 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-b56cc8a9-15d7-4299-86c8-ccb92a76339b tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:14.370434 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-b56cc8a9-15d7-4299-86c8-ccb92a76339b tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] [instance: e0ca65a5-b651-4473-b73f-af62bf6a6e92] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:51:14.390074 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b56cc8a9-15d7-4299-86c8-ccb92a76339b tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:14.391025 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b56cc8a9-15d7-4299-86c8-ccb92a76339b tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:14.391703 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b56cc8a9-15d7-4299-86c8-ccb92a76339b tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:14.392598 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b56cc8a9-15d7-4299-86c8-ccb92a76339b tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:14.393224 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b56cc8a9-15d7-4299-86c8-ccb92a76339b tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:14.394163 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b56cc8a9-15d7-4299-86c8-ccb92a76339b tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:14.482122 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-46cdaba2-3728-4d4c-845e-65965422bf96 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac650232cc04810b1340dc2f0edadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b0670d1bd99424780a70e69d57a2166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:14.499316 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-46cdaba2-3728-4d4c-845e-65965422bf96 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "GET /compute/v2.1/servers/a0273e6e-eb85-4204-9bec-3707ad6612af" status: 200 len: 1210 microversion: 2.1 time: 0.241225 Oct 04 20:51:14.500965 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1848/3762] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:51:14 2022] GET /compute/v2.1/servers/a0273e6e-eb85-4204-9bec-3707ad6612af => generated 1210 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:51:14.507576 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2317359f-e2c9-4349-b59a-588ebfdeafb9 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:14.508546 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-2317359f-e2c9-4349-b59a-588ebfdeafb9 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] [instance: f8ba4e66-2997-4822-9c01-c570f5ae6e87] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:51:14.517472 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2317359f-e2c9-4349-b59a-588ebfdeafb9 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:14.518302 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2317359f-e2c9-4349-b59a-588ebfdeafb9 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:14.518952 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2317359f-e2c9-4349-b59a-588ebfdeafb9 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:14.520214 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2317359f-e2c9-4349-b59a-588ebfdeafb9 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:14.521014 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2317359f-e2c9-4349-b59a-588ebfdeafb9 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:14.521606 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2317359f-e2c9-4349-b59a-588ebfdeafb9 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:15.035294 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-b56cc8a9-15d7-4299-86c8-ccb92a76339b tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c208ec9faf491385a9ab5b5932098d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ae4960393c464c97669731c2084d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:15.043793 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-b56cc8a9-15d7-4299-86c8-ccb92a76339b tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] 10.222.0.33 "GET /compute/v2.1/servers/e0ca65a5-b651-4473-b73f-af62bf6a6e92" status: 200 len: 1315 microversion: 2.1 time: 0.678369 Oct 04 20:51:15.063691 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1915/3763] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:51:14 2022] GET /compute/v2.1/servers/e0ca65a5-b651-4473-b73f-af62bf6a6e92 => generated 1315 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:51:15.072346 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-4efdb282-ac07-4812-915b-43f8a2c30c75 tempest-VolumesSnapshotsTestJSON-1939288336 tempest-VolumesSnapshotsTestJSON-1939288336-project] Calling method '.version_select at 0x7f3c6f73b700>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:15.177771 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-4efdb282-ac07-4812-915b-43f8a2c30c75 tempest-VolumesSnapshotsTestJSON-1939288336 tempest-VolumesSnapshotsTestJSON-1939288336-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/273b32af-aa4c-4bb3-9132-d3e91f3b8f2c" status: 200 len: 344 microversion: 2.1 time: 0.112604 Oct 04 20:51:15.178609 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1916/3764] 10.222.0.33 () {58 vars in 1245 bytes} [Tue Oct 4 20:51:15 2022] GET /compute/v2.1/os-volumes/273b32af-aa4c-4bb3-9132-d3e91f3b8f2c => generated 344 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:51:15.279188 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-6e70a44b-5b96-452d-bd1f-4d2367e29f60 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:15.281407 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-6e70a44b-5b96-452d-bd1f-4d2367e29f60 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] [instance: 9261e0b2-35ac-40f4-92d5-3b9ffaea23c4] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:51:15.323106 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6e70a44b-5b96-452d-bd1f-4d2367e29f60 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:15.324054 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6e70a44b-5b96-452d-bd1f-4d2367e29f60 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:15.324742 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6e70a44b-5b96-452d-bd1f-4d2367e29f60 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:15.326718 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6e70a44b-5b96-452d-bd1f-4d2367e29f60 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:15.327696 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6e70a44b-5b96-452d-bd1f-4d2367e29f60 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:15.328619 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6e70a44b-5b96-452d-bd1f-4d2367e29f60 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:15.533442 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-2317359f-e2c9-4349-b59a-588ebfdeafb9 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b78af5c0485b4343900269160ef3e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659f3d4023b347d58bc0361db9ceead9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:15.551194 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-2317359f-e2c9-4349-b59a-588ebfdeafb9 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b78af5c0485b4343900269160ef3e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659f3d4023b347d58bc0361db9ceead9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:15.552979 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-2317359f-e2c9-4349-b59a-588ebfdeafb9 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b78af5c0485b4343900269160ef3e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659f3d4023b347d58bc0361db9ceead9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:15.558652 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-2317359f-e2c9-4349-b59a-588ebfdeafb9 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] 10.222.0.33 "GET /compute/v2.1/servers/f8ba4e66-2997-4822-9c01-c570f5ae6e87" status: 200 len: 1866 microversion: 2.42 time: 1.055873 Oct 04 20:51:15.559883 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1849/3765] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:51:14 2022] GET /compute/v2.1/servers/f8ba4e66-2997-4822-9c01-c570f5ae6e87 => generated 1866 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:51:15.565859 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-241bfc99-cb76-470f-bb40-32ccf8b25013 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:15.566498 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-241bfc99-cb76-470f-bb40-32ccf8b25013 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] [instance: f15ae3c9-8342-4ae9-b81e-2d7b1aecb2e8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:51:15.586053 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-241bfc99-cb76-470f-bb40-32ccf8b25013 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:15.586512 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-241bfc99-cb76-470f-bb40-32ccf8b25013 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:15.586978 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-241bfc99-cb76-470f-bb40-32ccf8b25013 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:15.587916 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-241bfc99-cb76-470f-bb40-32ccf8b25013 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:15.588129 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-241bfc99-cb76-470f-bb40-32ccf8b25013 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:15.599249 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-241bfc99-cb76-470f-bb40-32ccf8b25013 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:16.127946 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-6e70a44b-5b96-452d-bd1f-4d2367e29f60 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8397c96a6dd4c65bdde07c91ca5e7fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09101effe9da463dabc2edaccdb83e06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:16.144246 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-6e70a44b-5b96-452d-bd1f-4d2367e29f60 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] 10.222.0.33 "GET /compute/v2.1/servers/9261e0b2-35ac-40f4-92d5-3b9ffaea23c4" status: 200 len: 1679 microversion: 2.1 time: 0.869214 Oct 04 20:51:16.166857 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1917/3766] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:51:15 2022] GET /compute/v2.1/servers/9261e0b2-35ac-40f4-92d5-3b9ffaea23c4 => generated 1679 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:51:16.178286 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-6a631120-a067-4273-8fe9-3c5b5ff1df27 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:16.182526 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-6a631120-a067-4273-8fe9-3c5b5ff1df27 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: a0273e6e-eb85-4204-9bec-3707ad6612af] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:51:16.199052 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6a631120-a067-4273-8fe9-3c5b5ff1df27 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:16.200497 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6a631120-a067-4273-8fe9-3c5b5ff1df27 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:16.202073 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6a631120-a067-4273-8fe9-3c5b5ff1df27 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:16.204892 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6a631120-a067-4273-8fe9-3c5b5ff1df27 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:16.205560 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6a631120-a067-4273-8fe9-3c5b5ff1df27 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:16.206204 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6a631120-a067-4273-8fe9-3c5b5ff1df27 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:16.304529 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-241bfc99-cb76-470f-bb40-32ccf8b25013 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc4171c0ee14ebb8b5eff5e910ccf49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003eb03a265a496d8981e45c74b014f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:16.323657 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-241bfc99-cb76-470f-bb40-32ccf8b25013 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] 10.222.0.33 "GET /compute/v2.1/servers/f15ae3c9-8342-4ae9-b81e-2d7b1aecb2e8" status: 200 len: 1523 microversion: 2.1 time: 0.761725 Oct 04 20:51:16.324921 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1850/3767] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:51:15 2022] GET /compute/v2.1/servers/f15ae3c9-8342-4ae9-b81e-2d7b1aecb2e8 => generated 1523 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:51:16.343737 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-34de11e3-9e73-47cb-b15d-e68947830bd9 req-b691abbf-60e5-4f0c-8ee1-4a75352de831 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8ba4e66-2997-4822-9c01-c570f5ae6e87", "tag": "2466aff1-a3c9-4408-a313-35792d243535"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:51:16.360895 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-34de11e3-9e73-47cb-b15d-e68947830bd9 req-b691abbf-60e5-4f0c-8ee1-4a75352de831 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:16.361658 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-34de11e3-9e73-47cb-b15d-e68947830bd9 req-b691abbf-60e5-4f0c-8ee1-4a75352de831 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:16.362291 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-34de11e3-9e73-47cb-b15d-e68947830bd9 req-b691abbf-60e5-4f0c-8ee1-4a75352de831 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:16.376602 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-34de11e3-9e73-47cb-b15d-e68947830bd9 req-b691abbf-60e5-4f0c-8ee1-4a75352de831 service nova] Creating event network-changed:2466aff1-a3c9-4408-a313-35792d243535 for instance f8ba4e66-2997-4822-9c01-c570f5ae6e87 on n-h1-854823-8 Oct 04 20:51:16.384457 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-34de11e3-9e73-47cb-b15d-e68947830bd9 req-b691abbf-60e5-4f0c-8ee1-4a75352de831 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056850 Oct 04 20:51:16.386116 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1851/3768] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:51:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:51:16.399056 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9321e654-6191-43f4-b3f6-721797ac5d19 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:16.399786 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-9321e654-6191-43f4-b3f6-721797ac5d19 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] [instance: e0ca65a5-b651-4473-b73f-af62bf6a6e92] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:51:16.415456 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9321e654-6191-43f4-b3f6-721797ac5d19 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:16.415961 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9321e654-6191-43f4-b3f6-721797ac5d19 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:16.416399 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9321e654-6191-43f4-b3f6-721797ac5d19 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:16.417113 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9321e654-6191-43f4-b3f6-721797ac5d19 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:16.417573 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9321e654-6191-43f4-b3f6-721797ac5d19 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:16.418001 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9321e654-6191-43f4-b3f6-721797ac5d19 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:16.540416 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-6a631120-a067-4273-8fe9-3c5b5ff1df27 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac650232cc04810b1340dc2f0edadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b0670d1bd99424780a70e69d57a2166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:16.555653 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-6a631120-a067-4273-8fe9-3c5b5ff1df27 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "GET /compute/v2.1/servers/a0273e6e-eb85-4204-9bec-3707ad6612af" status: 200 len: 1272 microversion: 2.1 time: 0.386945 Oct 04 20:51:16.559156 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1918/3769] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:51:16 2022] GET /compute/v2.1/servers/a0273e6e-eb85-4204-9bec-3707ad6612af => generated 1272 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:51:16.587056 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-b3ce30cb-4ca1-4211-9b33-5e7c64f86f38 tempest-VolumesSnapshotsTestJSON-1939288336 tempest-VolumesSnapshotsTestJSON-1939288336-project] Calling method '.version_select at 0x7f3c740ba0d0>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:16.633358 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.wsgi [None req-b3ce30cb-4ca1-4211-9b33-5e7c64f86f38 tempest-VolumesSnapshotsTestJSON-1939288336 tempest-VolumesSnapshotsTestJSON-1939288336-project] HTTP exception thrown: Volume 273b32af-aa4c-4bb3-9132-d3e91f3b8f2c could not be found. Oct 04 20:51:16.639331 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-b3ce30cb-4ca1-4211-9b33-5e7c64f86f38 tempest-VolumesSnapshotsTestJSON-1939288336 tempest-VolumesSnapshotsTestJSON-1939288336-project] Request method failure captured: Oct 04 20:51:16.639331 n-d-854823-8 devstack@n-api.service[128802]: request: GET /compute/v2.1/os-volumes/273b32af-aa4c-4bb3-9132-d3e91f3b8f2c HTTP/1.1 Oct 04 20:51:16.639331 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 20:51:16.639331 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 20:51:16.639331 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 20:51:16.639331 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 0 Oct 04 20:51:16.639331 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 20:51:16.639331 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 20:51:16.639331 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 20:51:16.639331 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 20:51:16.639331 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPJyyIut47vW-OiwuyAhHDcvam7qmB1WegjKoG22s_spcgrx-qt0rEStVqARZvKX_dRm1iTFplHuc81T3F4844iGSDfMa0mxT3EyBUAkIiaYrQhvtVkvbS5K7t-hKYw7d42kCfWZbKD4uCw7H8wpNg8OFQSJfVgggNMmSA0UlaZr9cvk Oct 04 20:51:16.639331 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 20:51:16.639331 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 20:51:16.639331 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 20:51:16.639331 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 20:51:16.639331 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 20:51:16.639331 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 20:51:16.639331 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: 78b42f403d6745899b754e1e351e3a09 Oct 04 20:51:16.639331 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1939288336 Oct 04 20:51:16.639331 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 20:51:16.639331 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 20:51:16.639331 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_78b42f403d6745899b754e1e351e3a09", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/78b42f403d6745899b754e1e351e3a09"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/78b42f403d6745899b754e1e351e3a09"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/78b42f403d6745899b754e1e351e3a09"}]}] Oct 04 20:51:16.639331 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1939288336 Oct 04 20:51:16.639331 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: 78b42f403d6745899b754e1e351e3a09 Oct 04 20:51:16.639331 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1939288336 Oct 04 20:51:16.639331 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-VolumesSnapshotsTestJSON-1939288336-project Oct 04 20:51:16.639331 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 20:51:16.639331 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 20:51:16.639331 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: 383d1ad326a9428aaa53d17afa76f9e6 Oct 04 20:51:16.639331 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1939288336-project Oct 04 20:51:16.639331 n-d-854823-8 devstack@n-api.service[128802]: method: Oct 04 20:51:16.639331 n-d-854823-8 devstack@n-api.service[128802]: exception: Volume 273b32af-aa4c-4bb3-9132-d3e91f3b8f2c could not be found. Oct 04 20:51:16.639331 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'id': '273b32af-aa4c-4bb3-9132-d3e91f3b8f2c'} Oct 04 20:51:16.639331 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:51:16.639331 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:51:16.639331 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 20:51:16.639331 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 20:51:16.639331 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 04 20:51:16.639331 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 04 20:51:16.639331 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 04 20:51:16.639331 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 04 20:51:16.639331 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 20:51:16.639331 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 20:51:16.639331 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 20:51:16.639331 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 20:51:16.639331 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 20:51:16.639331 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 20:51:16.639331 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 20:51:16.639331 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 20:51:16.639331 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 273b32af-aa4c-4bb3-9132-d3e91f3b8f2c could not be found. (HTTP 404) (Request-ID: req-aec788a1-4d25-4a34-9edf-1ea8b465ffca) Oct 04 20:51:16.639331 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:51:16.639331 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:51:16.639331 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:51:16.639331 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:51:16.639331 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 04 20:51:16.639331 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 04 20:51:16.639331 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 04 20:51:16.639331 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 04 20:51:16.639331 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 04 20:51:16.639331 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 04 20:51:16.639331 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 04 20:51:16.639331 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 04 20:51:16.639331 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 20:51:16.649760 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 20:51:16.649760 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 04 20:51:16.649760 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 04 20:51:16.649760 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 04 20:51:16.649760 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 04 20:51:16.649760 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 20:51:16.649760 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 20:51:16.649760 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 20:51:16.649760 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 20:51:16.649760 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 20:51:16.649760 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 20:51:16.649760 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 20:51:16.649760 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 20:51:16.649760 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 273b32af-aa4c-4bb3-9132-d3e91f3b8f2c could not be found. Oct 04 20:51:16.649760 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:51:16.649760 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:51:16.649760 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:51:16.649760 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:51:16.649760 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:51:16.649760 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:51:16.649760 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:51:16.649760 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:51:16.649760 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:51:16.649760 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:51:16.649760 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:51:16.649760 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:51:16.649760 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 04 20:51:16.649760 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:51:16.649760 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 273b32af-aa4c-4bb3-9132-d3e91f3b8f2c could not be found. Oct 04 20:51:16.649760 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:51:16.649760 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:51:16.649760 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:51:16.649760 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:51:16.649760 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:51:16.649760 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:51:16.649760 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:51:16.649760 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:51:16.649760 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 273b32af-aa4c-4bb3-9132-d3e91f3b8f2c could not be found. Oct 04 20:51:16.649760 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:51:16.649760 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-b3ce30cb-4ca1-4211-9b33-5e7c64f86f38 tempest-VolumesSnapshotsTestJSON-1939288336 tempest-VolumesSnapshotsTestJSON-1939288336-project] Returning 404 to user: Volume 273b32af-aa4c-4bb3-9132-d3e91f3b8f2c could not be found. {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:51:16.649760 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-b3ce30cb-4ca1-4211-9b33-5e7c64f86f38 tempest-VolumesSnapshotsTestJSON-1939288336 tempest-VolumesSnapshotsTestJSON-1939288336-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/273b32af-aa4c-4bb3-9132-d3e91f3b8f2c" status: 404 len: 109 microversion: 2.1 time: 0.067234 Oct 04 20:51:16.649760 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1919/3770] 10.222.0.33 () {58 vars in 1245 bytes} [Tue Oct 4 20:51:16 2022] GET /compute/v2.1/os-volumes/273b32af-aa4c-4bb3-9132-d3e91f3b8f2c => generated 109 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:51:16.658647 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-867a6902-7719-4e88-93f6-3e57d037566b tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:16.658647 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-867a6902-7719-4e88-93f6-3e57d037566b tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] [instance: f8ba4e66-2997-4822-9c01-c570f5ae6e87] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:51:16.688730 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-867a6902-7719-4e88-93f6-3e57d037566b tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:16.689989 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-867a6902-7719-4e88-93f6-3e57d037566b tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:16.689989 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-867a6902-7719-4e88-93f6-3e57d037566b tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:16.690388 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-867a6902-7719-4e88-93f6-3e57d037566b tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:16.696527 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-867a6902-7719-4e88-93f6-3e57d037566b tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:16.703705 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-867a6902-7719-4e88-93f6-3e57d037566b tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:18.912318 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-867a6902-7719-4e88-93f6-3e57d037566b tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b78af5c0485b4343900269160ef3e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659f3d4023b347d58bc0361db9ceead9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:18.918455 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-9321e654-6191-43f4-b3f6-721797ac5d19 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c208ec9faf491385a9ab5b5932098d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ae4960393c464c97669731c2084d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:18.924018 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-867a6902-7719-4e88-93f6-3e57d037566b tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b78af5c0485b4343900269160ef3e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659f3d4023b347d58bc0361db9ceead9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:18.931545 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-9321e654-6191-43f4-b3f6-721797ac5d19 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] 10.222.0.33 "GET /compute/v2.1/servers/e0ca65a5-b651-4473-b73f-af62bf6a6e92" status: 200 len: 1315 microversion: 2.1 time: 2.542562 Oct 04 20:51:18.933120 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1852/3771] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:51:16 2022] GET /compute/v2.1/servers/e0ca65a5-b651-4473-b73f-af62bf6a6e92 => generated 1315 bytes in 2546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:51:18.933596 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-867a6902-7719-4e88-93f6-3e57d037566b tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b78af5c0485b4343900269160ef3e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659f3d4023b347d58bc0361db9ceead9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:18.935213 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-867a6902-7719-4e88-93f6-3e57d037566b tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] 10.222.0.33 "GET /compute/v2.1/servers/f8ba4e66-2997-4822-9c01-c570f5ae6e87" status: 200 len: 1887 microversion: 2.42 time: 2.285054 Oct 04 20:51:18.937055 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1920/3772] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:51:16 2022] GET /compute/v2.1/servers/f8ba4e66-2997-4822-9c01-c570f5ae6e87 => generated 1887 bytes in 2287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:51:18.940013 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2156fa36-2bdc-4554-a1c1-84e4a35390a6 tempest-VolumesSnapshotsTestJSON-1939288336 tempest-VolumesSnapshotsTestJSON-1939288336-project] Calling method '.version_select at 0x7f3c74f3d790>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:18.956406 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-84f095d1-22f2-48de-ae5a-5bb1ebbf98c5 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:18.957345 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-84f095d1-22f2-48de-ae5a-5bb1ebbf98c5 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] [instance: 9261e0b2-35ac-40f4-92d5-3b9ffaea23c4] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:51:18.964018 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-84f095d1-22f2-48de-ae5a-5bb1ebbf98c5 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:18.964372 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-84f095d1-22f2-48de-ae5a-5bb1ebbf98c5 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:18.964800 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-84f095d1-22f2-48de-ae5a-5bb1ebbf98c5 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:18.970943 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-84f095d1-22f2-48de-ae5a-5bb1ebbf98c5 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:18.971445 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-84f095d1-22f2-48de-ae5a-5bb1ebbf98c5 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:18.971886 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-84f095d1-22f2-48de-ae5a-5bb1ebbf98c5 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:18.987459 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-2156fa36-2bdc-4554-a1c1-84e4a35390a6 tempest-VolumesSnapshotsTestJSON-1939288336 tempest-VolumesSnapshotsTestJSON-1939288336-project] HTTP exception thrown: Volume 273b32af-aa4c-4bb3-9132-d3e91f3b8f2c could not be found. Oct 04 20:51:18.990816 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2156fa36-2bdc-4554-a1c1-84e4a35390a6 tempest-VolumesSnapshotsTestJSON-1939288336 tempest-VolumesSnapshotsTestJSON-1939288336-project] Request method failure captured: Oct 04 20:51:18.990816 n-d-854823-8 devstack@n-api.service[128801]: request: DELETE /compute/v2.1/os-volumes/273b32af-aa4c-4bb3-9132-d3e91f3b8f2c HTTP/1.1 Oct 04 20:51:18.990816 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:51:18.990816 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:51:18.990816 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:51:18.990816 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 0 Oct 04 20:51:18.990816 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:51:18.990816 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:51:18.990816 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:51:18.990816 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:51:18.990816 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJyyIut47vW-OiwuyAhHDcvam7qmB1WegjKoG22s_spcgrx-qt0rEStVqARZvKX_dRm1iTFplHuc81T3F4844iGSDfMa0mxT3EyBUAkIiaYrQhvtVkvbS5K7t-hKYw7d42kCfWZbKD4uCw7H8wpNg8OFQSJfVgggNMmSA0UlaZr9cvk Oct 04 20:51:18.990816 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:51:18.990816 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:51:18.990816 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:51:18.990816 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:51:18.990816 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:51:18.990816 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:51:18.990816 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: 78b42f403d6745899b754e1e351e3a09 Oct 04 20:51:18.990816 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1939288336 Oct 04 20:51:18.990816 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 20:51:18.990816 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 20:51:18.990816 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_78b42f403d6745899b754e1e351e3a09", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/78b42f403d6745899b754e1e351e3a09"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/78b42f403d6745899b754e1e351e3a09"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/78b42f403d6745899b754e1e351e3a09"}]}] Oct 04 20:51:18.990816 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1939288336 Oct 04 20:51:18.990816 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: 78b42f403d6745899b754e1e351e3a09 Oct 04 20:51:18.990816 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1939288336 Oct 04 20:51:18.990816 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-VolumesSnapshotsTestJSON-1939288336-project Oct 04 20:51:18.990816 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:51:18.990816 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:51:18.990816 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: 383d1ad326a9428aaa53d17afa76f9e6 Oct 04 20:51:18.990816 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1939288336-project Oct 04 20:51:18.990816 n-d-854823-8 devstack@n-api.service[128801]: method: Oct 04 20:51:18.990816 n-d-854823-8 devstack@n-api.service[128801]: exception: Volume 273b32af-aa4c-4bb3-9132-d3e91f3b8f2c could not be found. Oct 04 20:51:18.990816 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': '273b32af-aa4c-4bb3-9132-d3e91f3b8f2c'} Oct 04 20:51:18.990816 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:51:18.990816 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:51:18.990816 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 20:51:18.990816 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 20:51:18.990816 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 04 20:51:18.990816 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 04 20:51:18.990816 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 04 20:51:18.990816 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 04 20:51:18.990816 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 04 20:51:18.990816 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 04 20:51:18.990816 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 04 20:51:18.990816 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 04 20:51:18.990816 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 20:51:18.990816 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 20:51:18.990816 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 20:51:18.990816 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 20:51:18.990816 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 273b32af-aa4c-4bb3-9132-d3e91f3b8f2c could not be found. (HTTP 404) (Request-ID: req-13ef28c2-0b1f-46b9-bbd1-363b1782d511) Oct 04 20:51:18.990816 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:51:18.990816 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:51:18.990816 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:51:18.990816 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:51:18.990816 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 04 20:51:18.990816 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 04 20:51:18.990816 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 04 20:51:18.990816 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 04 20:51:18.990816 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 04 20:51:18.990816 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 04 20:51:18.990816 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 04 20:51:18.990816 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 04 20:51:18.990816 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 20:51:18.995448 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 20:51:18.995448 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 04 20:51:18.995448 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 04 20:51:18.995448 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 04 20:51:18.995448 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 04 20:51:18.995448 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 04 20:51:18.995448 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 04 20:51:18.995448 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 04 20:51:18.995448 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 04 20:51:18.995448 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 20:51:18.995448 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 20:51:18.995448 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 20:51:18.995448 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 20:51:18.995448 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 273b32af-aa4c-4bb3-9132-d3e91f3b8f2c could not be found. Oct 04 20:51:18.995448 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:51:18.995448 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:51:18.995448 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:51:18.995448 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:51:18.995448 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:51:18.995448 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:51:18.995448 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:51:18.995448 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:51:18.995448 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:51:18.995448 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:51:18.995448 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:51:18.995448 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:51:18.995448 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 04 20:51:18.995448 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:51:18.995448 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 273b32af-aa4c-4bb3-9132-d3e91f3b8f2c could not be found. Oct 04 20:51:18.995448 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:51:18.995448 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:51:18.995448 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:51:18.995448 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:51:18.995448 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:51:18.995448 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:51:18.995448 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:51:18.995448 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:51:18.995448 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 273b32af-aa4c-4bb3-9132-d3e91f3b8f2c could not be found. Oct 04 20:51:18.995448 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:51:19.001236 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2156fa36-2bdc-4554-a1c1-84e4a35390a6 tempest-VolumesSnapshotsTestJSON-1939288336 tempest-VolumesSnapshotsTestJSON-1939288336-project] Returning 404 to user: Volume 273b32af-aa4c-4bb3-9132-d3e91f3b8f2c could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:51:19.002181 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-2156fa36-2bdc-4554-a1c1-84e4a35390a6 tempest-VolumesSnapshotsTestJSON-1939288336 tempest-VolumesSnapshotsTestJSON-1939288336-project] 10.222.0.33 "DELETE /compute/v2.1/os-volumes/273b32af-aa4c-4bb3-9132-d3e91f3b8f2c" status: 404 len: 109 microversion: 2.1 time: 0.067554 Oct 04 20:51:19.003152 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1853/3773] 10.222.0.33 () {58 vars in 1248 bytes} [Tue Oct 4 20:51:18 2022] DELETE /compute/v2.1/os-volumes/273b32af-aa4c-4bb3-9132-d3e91f3b8f2c => generated 109 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:51:19.012766 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a39e63ad-6653-4110-9ade-dbefc356710d tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:19.013485 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a39e63ad-6653-4110-9ade-dbefc356710d tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] [instance: f15ae3c9-8342-4ae9-b81e-2d7b1aecb2e8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:51:19.028995 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a39e63ad-6653-4110-9ade-dbefc356710d tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:19.030296 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a39e63ad-6653-4110-9ade-dbefc356710d tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:19.030760 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a39e63ad-6653-4110-9ade-dbefc356710d tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:19.031661 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a39e63ad-6653-4110-9ade-dbefc356710d tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:19.032118 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a39e63ad-6653-4110-9ade-dbefc356710d tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:19.032542 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a39e63ad-6653-4110-9ade-dbefc356710d tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:19.202520 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-84f095d1-22f2-48de-ae5a-5bb1ebbf98c5 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8397c96a6dd4c65bdde07c91ca5e7fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09101effe9da463dabc2edaccdb83e06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:19.212008 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-84f095d1-22f2-48de-ae5a-5bb1ebbf98c5 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] 10.222.0.33 "GET /compute/v2.1/servers/9261e0b2-35ac-40f4-92d5-3b9ffaea23c4" status: 200 len: 1611 microversion: 2.1 time: 0.273759 Oct 04 20:51:19.213128 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1921/3774] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:51:18 2022] GET /compute/v2.1/servers/9261e0b2-35ac-40f4-92d5-3b9ffaea23c4 => generated 1611 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:51:19.230735 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-0f925bb4-9c10-4e6a-a1dd-6d2b9e3f20ce tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:19.232645 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-0f925bb4-9c10-4e6a-a1dd-6d2b9e3f20ce tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: a0273e6e-eb85-4204-9bec-3707ad6612af] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:51:19.240004 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0f925bb4-9c10-4e6a-a1dd-6d2b9e3f20ce tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:19.240847 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0f925bb4-9c10-4e6a-a1dd-6d2b9e3f20ce tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:19.241498 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0f925bb4-9c10-4e6a-a1dd-6d2b9e3f20ce tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:19.243875 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0f925bb4-9c10-4e6a-a1dd-6d2b9e3f20ce tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:19.244846 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0f925bb4-9c10-4e6a-a1dd-6d2b9e3f20ce tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:19.245443 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0f925bb4-9c10-4e6a-a1dd-6d2b9e3f20ce tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:19.704910 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-a39e63ad-6653-4110-9ade-dbefc356710d tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc4171c0ee14ebb8b5eff5e910ccf49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003eb03a265a496d8981e45c74b014f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:19.719897 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a39e63ad-6653-4110-9ade-dbefc356710d tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] 10.222.0.33 "GET /compute/v2.1/servers/f15ae3c9-8342-4ae9-b81e-2d7b1aecb2e8" status: 200 len: 1523 microversion: 2.1 time: 0.715605 Oct 04 20:51:19.721029 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1854/3775] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:51:19 2022] GET /compute/v2.1/servers/f15ae3c9-8342-4ae9-b81e-2d7b1aecb2e8 => generated 1523 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:51:19.726937 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-e09fdcc2-7b33-4f17-9a45-9a1b30cd809a req-135151e8-b983-4d04-8085-9f5417db7dcd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8ba4e66-2997-4822-9c01-c570f5ae6e87", "tag": "1a515a36-7768-4003-81af-193aff7ba286"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:51:19.738053 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-e09fdcc2-7b33-4f17-9a45-9a1b30cd809a req-135151e8-b983-4d04-8085-9f5417db7dcd service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:19.738970 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-e09fdcc2-7b33-4f17-9a45-9a1b30cd809a req-135151e8-b983-4d04-8085-9f5417db7dcd service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:19.739693 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-e09fdcc2-7b33-4f17-9a45-9a1b30cd809a req-135151e8-b983-4d04-8085-9f5417db7dcd service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:19.753628 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-e09fdcc2-7b33-4f17-9a45-9a1b30cd809a req-135151e8-b983-4d04-8085-9f5417db7dcd service nova] Creating event network-changed:1a515a36-7768-4003-81af-193aff7ba286 for instance f8ba4e66-2997-4822-9c01-c570f5ae6e87 on n-h1-854823-8 Oct 04 20:51:19.759834 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-e09fdcc2-7b33-4f17-9a45-9a1b30cd809a req-135151e8-b983-4d04-8085-9f5417db7dcd service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037166 Oct 04 20:51:19.760882 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1855/3776] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:51:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:51:19.767514 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-8b1f8e53-1c22-4374-93c2-1fdd534082c4 req-11b05128-8fa0-4ab4-a895-9198dd4b2930 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0ca65a5-b651-4473-b73f-af62bf6a6e92", "name": "network-vif-plugged", "status": "completed", "tag": "3d12d7bd-c1dd-4c3f-a172-0bcbeab0de21"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:51:19.802655 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-8b1f8e53-1c22-4374-93c2-1fdd534082c4 req-11b05128-8fa0-4ab4-a895-9198dd4b2930 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:19.803522 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-8b1f8e53-1c22-4374-93c2-1fdd534082c4 req-11b05128-8fa0-4ab4-a895-9198dd4b2930 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:19.806407 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-8b1f8e53-1c22-4374-93c2-1fdd534082c4 req-11b05128-8fa0-4ab4-a895-9198dd4b2930 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:19.824788 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-8b1f8e53-1c22-4374-93c2-1fdd534082c4 req-11b05128-8fa0-4ab4-a895-9198dd4b2930 service nova] Creating event network-vif-plugged:3d12d7bd-c1dd-4c3f-a172-0bcbeab0de21 for instance e0ca65a5-b651-4473-b73f-af62bf6a6e92 on n-h2-854823-8 Oct 04 20:51:19.832988 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-8b1f8e53-1c22-4374-93c2-1fdd534082c4 req-11b05128-8fa0-4ab4-a895-9198dd4b2930 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070181 Oct 04 20:51:19.835410 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1856/3777] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:51:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:51:19.845853 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-584d306c-3f0b-4e32-b84c-2becad4f22db tempest-VolumesSnapshotsTestJSON-1939288336 tempest-VolumesSnapshotsTestJSON-1939288336-project] Calling method '.version_select at 0x7f3c74043b80>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:19.881670 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-584d306c-3f0b-4e32-b84c-2becad4f22db tempest-VolumesSnapshotsTestJSON-1939288336 tempest-VolumesSnapshotsTestJSON-1939288336-project] HTTP exception thrown: Volume 273b32af-aa4c-4bb3-9132-d3e91f3b8f2c could not be found. Oct 04 20:51:19.892140 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-584d306c-3f0b-4e32-b84c-2becad4f22db tempest-VolumesSnapshotsTestJSON-1939288336 tempest-VolumesSnapshotsTestJSON-1939288336-project] Request method failure captured: Oct 04 20:51:19.892140 n-d-854823-8 devstack@n-api.service[128801]: request: GET /compute/v2.1/os-volumes/273b32af-aa4c-4bb3-9132-d3e91f3b8f2c HTTP/1.1 Oct 04 20:51:19.892140 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:51:19.892140 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:51:19.892140 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:51:19.892140 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 0 Oct 04 20:51:19.892140 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:51:19.892140 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:51:19.892140 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:51:19.892140 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:51:19.892140 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJyyIut47vW-OiwuyAhHDcvam7qmB1WegjKoG22s_spcgrx-qt0rEStVqARZvKX_dRm1iTFplHuc81T3F4844iGSDfMa0mxT3EyBUAkIiaYrQhvtVkvbS5K7t-hKYw7d42kCfWZbKD4uCw7H8wpNg8OFQSJfVgggNMmSA0UlaZr9cvk Oct 04 20:51:19.892140 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:51:19.892140 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:51:19.892140 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:51:19.892140 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:51:19.892140 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:51:19.892140 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:51:19.892140 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: 78b42f403d6745899b754e1e351e3a09 Oct 04 20:51:19.892140 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1939288336 Oct 04 20:51:19.892140 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 20:51:19.892140 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 20:51:19.892140 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_78b42f403d6745899b754e1e351e3a09", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/78b42f403d6745899b754e1e351e3a09"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/78b42f403d6745899b754e1e351e3a09"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/78b42f403d6745899b754e1e351e3a09"}]}] Oct 04 20:51:19.892140 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1939288336 Oct 04 20:51:19.892140 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: 78b42f403d6745899b754e1e351e3a09 Oct 04 20:51:19.892140 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1939288336 Oct 04 20:51:19.892140 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-VolumesSnapshotsTestJSON-1939288336-project Oct 04 20:51:19.892140 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:51:19.892140 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:51:19.892140 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: 383d1ad326a9428aaa53d17afa76f9e6 Oct 04 20:51:19.892140 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1939288336-project Oct 04 20:51:19.892140 n-d-854823-8 devstack@n-api.service[128801]: method: Oct 04 20:51:19.892140 n-d-854823-8 devstack@n-api.service[128801]: exception: Volume 273b32af-aa4c-4bb3-9132-d3e91f3b8f2c could not be found. Oct 04 20:51:19.892140 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': '273b32af-aa4c-4bb3-9132-d3e91f3b8f2c'} Oct 04 20:51:19.892140 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:51:19.892140 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:51:19.892140 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 20:51:19.892140 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 20:51:19.892140 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 04 20:51:19.892140 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 04 20:51:19.892140 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 04 20:51:19.892140 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 04 20:51:19.892140 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 20:51:19.892140 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 20:51:19.892140 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 20:51:19.892140 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 20:51:19.892140 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 20:51:19.892140 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 20:51:19.892140 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 20:51:19.892140 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 20:51:19.892140 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 273b32af-aa4c-4bb3-9132-d3e91f3b8f2c could not be found. (HTTP 404) (Request-ID: req-5a8a8dca-3e0d-424c-ae7c-28f7eb23efc3) Oct 04 20:51:19.892140 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:51:19.892140 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:51:19.892140 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:51:19.892140 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:51:19.892140 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 04 20:51:19.892140 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 04 20:51:19.892140 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 04 20:51:19.892140 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 04 20:51:19.892140 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 04 20:51:19.892140 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 04 20:51:19.892140 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 04 20:51:19.892140 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 04 20:51:19.892140 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 20:51:19.898681 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 20:51:19.898681 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 04 20:51:19.898681 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 04 20:51:19.898681 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 04 20:51:19.898681 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 04 20:51:19.898681 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 20:51:19.898681 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 20:51:19.898681 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 20:51:19.898681 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 20:51:19.898681 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 20:51:19.898681 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 20:51:19.898681 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 20:51:19.898681 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 20:51:19.898681 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 273b32af-aa4c-4bb3-9132-d3e91f3b8f2c could not be found. Oct 04 20:51:19.898681 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:51:19.898681 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:51:19.898681 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:51:19.898681 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:51:19.898681 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:51:19.898681 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:51:19.898681 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:51:19.898681 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:51:19.898681 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:51:19.898681 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:51:19.898681 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:51:19.898681 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:51:19.898681 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 04 20:51:19.898681 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:51:19.898681 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 273b32af-aa4c-4bb3-9132-d3e91f3b8f2c could not be found. Oct 04 20:51:19.898681 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:51:19.898681 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:51:19.898681 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:51:19.898681 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:51:19.898681 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:51:19.898681 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:51:19.898681 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:51:19.898681 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:51:19.898681 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 273b32af-aa4c-4bb3-9132-d3e91f3b8f2c could not be found. Oct 04 20:51:19.898681 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:51:19.908674 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-584d306c-3f0b-4e32-b84c-2becad4f22db tempest-VolumesSnapshotsTestJSON-1939288336 tempest-VolumesSnapshotsTestJSON-1939288336-project] Returning 404 to user: Volume 273b32af-aa4c-4bb3-9132-d3e91f3b8f2c could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:51:19.908674 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-584d306c-3f0b-4e32-b84c-2becad4f22db tempest-VolumesSnapshotsTestJSON-1939288336 tempest-VolumesSnapshotsTestJSON-1939288336-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/273b32af-aa4c-4bb3-9132-d3e91f3b8f2c" status: 404 len: 109 microversion: 2.1 time: 0.070206 Oct 04 20:51:19.908674 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1857/3778] 10.222.0.33 () {58 vars in 1245 bytes} [Tue Oct 4 20:51:19 2022] GET /compute/v2.1/os-volumes/273b32af-aa4c-4bb3-9132-d3e91f3b8f2c => generated 109 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:51:19.959512 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-86ce5789-390c-4be1-aca9-d1768381808e req-d4184550-7729-43ca-90ae-86c6d18eca85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9261e0b2-35ac-40f4-92d5-3b9ffaea23c4", "name": "network-vif-deleted", "tag": "09b39841-a772-4f30-a38c-731c97c36f85"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:51:19.980356 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-0f925bb4-9c10-4e6a-a1dd-6d2b9e3f20ce tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac650232cc04810b1340dc2f0edadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b0670d1bd99424780a70e69d57a2166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:19.994125 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-0f925bb4-9c10-4e6a-a1dd-6d2b9e3f20ce tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "GET /compute/v2.1/servers/a0273e6e-eb85-4204-9bec-3707ad6612af" status: 200 len: 1314 microversion: 2.1 time: 0.779652 Oct 04 20:51:19.996181 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1922/3779] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:51:19 2022] GET /compute/v2.1/servers/a0273e6e-eb85-4204-9bec-3707ad6612af => generated 1314 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:51:20.007960 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-5b492534-dc5b-4fe3-844b-b7ebc57bd9e1 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:20.009796 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-5b492534-dc5b-4fe3-844b-b7ebc57bd9e1 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] [instance: e0ca65a5-b651-4473-b73f-af62bf6a6e92] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:51:20.010852 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-86ce5789-390c-4be1-aca9-d1768381808e req-d4184550-7729-43ca-90ae-86c6d18eca85 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:20.011650 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-86ce5789-390c-4be1-aca9-d1768381808e req-d4184550-7729-43ca-90ae-86c6d18eca85 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:20.012420 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-86ce5789-390c-4be1-aca9-d1768381808e req-d4184550-7729-43ca-90ae-86c6d18eca85 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:20.023744 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5b492534-dc5b-4fe3-844b-b7ebc57bd9e1 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:20.024250 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5b492534-dc5b-4fe3-844b-b7ebc57bd9e1 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:20.024698 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5b492534-dc5b-4fe3-844b-b7ebc57bd9e1 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:20.027860 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5b492534-dc5b-4fe3-844b-b7ebc57bd9e1 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:20.028345 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5b492534-dc5b-4fe3-844b-b7ebc57bd9e1 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:20.030456 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5b492534-dc5b-4fe3-844b-b7ebc57bd9e1 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:20.058383 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-86ce5789-390c-4be1-aca9-d1768381808e req-d4184550-7729-43ca-90ae-86c6d18eca85 service nova] Creating event network-vif-deleted:09b39841-a772-4f30-a38c-731c97c36f85 for instance 9261e0b2-35ac-40f4-92d5-3b9ffaea23c4 on n-h2-854823-8 Oct 04 20:51:20.075634 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-86ce5789-390c-4be1-aca9-d1768381808e req-d4184550-7729-43ca-90ae-86c6d18eca85 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127574 Oct 04 20:51:20.079074 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1858/3780] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:51:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:51:20.092918 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-18c26a83-4295-47be-91b9-a64fdac83293 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:20.094028 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-18c26a83-4295-47be-91b9-a64fdac83293 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] [instance: f8ba4e66-2997-4822-9c01-c570f5ae6e87] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:51:20.107499 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-18c26a83-4295-47be-91b9-a64fdac83293 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:20.110266 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-18c26a83-4295-47be-91b9-a64fdac83293 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:20.111451 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-18c26a83-4295-47be-91b9-a64fdac83293 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:20.113245 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-18c26a83-4295-47be-91b9-a64fdac83293 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:20.114213 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-18c26a83-4295-47be-91b9-a64fdac83293 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:20.115362 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-18c26a83-4295-47be-91b9-a64fdac83293 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:21.101803 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-5b492534-dc5b-4fe3-844b-b7ebc57bd9e1 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c208ec9faf491385a9ab5b5932098d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ae4960393c464c97669731c2084d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:21.113594 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-5b492534-dc5b-4fe3-844b-b7ebc57bd9e1 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] 10.222.0.33 "GET /compute/v2.1/servers/e0ca65a5-b651-4473-b73f-af62bf6a6e92" status: 200 len: 1315 microversion: 2.1 time: 1.116300 Oct 04 20:51:21.119112 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1923/3781] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:51:19 2022] GET /compute/v2.1/servers/e0ca65a5-b651-4473-b73f-af62bf6a6e92 => generated 1315 bytes in 1122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:51:21.131440 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-90138c8a-50a0-4558-8486-2acce2eb65e4 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:21.133034 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-90138c8a-50a0-4558-8486-2acce2eb65e4 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] [instance: 9261e0b2-35ac-40f4-92d5-3b9ffaea23c4] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:51:21.143599 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-90138c8a-50a0-4558-8486-2acce2eb65e4 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:21.144320 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-90138c8a-50a0-4558-8486-2acce2eb65e4 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:21.145124 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-90138c8a-50a0-4558-8486-2acce2eb65e4 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:21.146063 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-90138c8a-50a0-4558-8486-2acce2eb65e4 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:21.146774 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-90138c8a-50a0-4558-8486-2acce2eb65e4 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:21.147466 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-90138c8a-50a0-4558-8486-2acce2eb65e4 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:21.166414 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.wsgi [None req-90138c8a-50a0-4558-8486-2acce2eb65e4 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] HTTP exception thrown: Instance 9261e0b2-35ac-40f4-92d5-3b9ffaea23c4 could not be found. Oct 04 20:51:21.173517 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-90138c8a-50a0-4558-8486-2acce2eb65e4 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Request method failure captured: Oct 04 20:51:21.173517 n-d-854823-8 devstack@n-api.service[128802]: request: GET /compute/v2.1/servers/9261e0b2-35ac-40f4-92d5-3b9ffaea23c4 HTTP/1.1 Oct 04 20:51:21.173517 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 20:51:21.173517 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 20:51:21.173517 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 20:51:21.173517 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 0 Oct 04 20:51:21.173517 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 20:51:21.173517 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 20:51:21.173517 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 20:51:21.173517 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 20:51:21.173517 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPJwRZt6OsEymvbyiC_o8h8pd7a0mS3ym9OlONwt_v664BdUS1uwXxrvrb9UPLfWH1pzNGmLu8Zu7S1KiDxdWnCdRprtmaTgZi4BwmYWS1Pb-xXBarog3IQrdNL-MR5SF2e054Jc4_L5KrL6HNpPVbhq8XVgt7W0yRIsATX3XQIQnkME Oct 04 20:51:21.173517 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 20:51:21.173517 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 20:51:21.173517 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 20:51:21.173517 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 20:51:21.173517 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 20:51:21.173517 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 20:51:21.173517 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: 09101effe9da463dabc2edaccdb83e06 Oct 04 20:51:21.173517 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-VolumesAdminNegativeTest-688975349 Oct 04 20:51:21.173517 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 20:51:21.173517 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 20:51:21.173517 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_09101effe9da463dabc2edaccdb83e06", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/09101effe9da463dabc2edaccdb83e06"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/09101effe9da463dabc2edaccdb83e06"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/09101effe9da463dabc2edaccdb83e06"}]}] Oct 04 20:51:21.173517 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-VolumesAdminNegativeTest-688975349 Oct 04 20:51:21.173517 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: 09101effe9da463dabc2edaccdb83e06 Oct 04 20:51:21.173517 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-688975349 Oct 04 20:51:21.173517 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-VolumesAdminNegativeTest-688975349-project Oct 04 20:51:21.173517 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 20:51:21.173517 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 20:51:21.173517 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: e8397c96a6dd4c65bdde07c91ca5e7fa Oct 04 20:51:21.173517 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-VolumesAdminNegativeTest-688975349-project Oct 04 20:51:21.173517 n-d-854823-8 devstack@n-api.service[128802]: method: > Oct 04 20:51:21.173517 n-d-854823-8 devstack@n-api.service[128802]: exception: Instance 9261e0b2-35ac-40f4-92d5-3b9ffaea23c4 could not be found. Oct 04 20:51:21.173517 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'id': '9261e0b2-35ac-40f4-92d5-3b9ffaea23c4'} Oct 04 20:51:21.173517 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:51:21.173517 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:51:21.173517 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:51:21.173517 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:51:21.173517 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:51:21.173517 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:51:21.173517 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:51:21.173517 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:51:21.173517 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:51:21.173517 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:51:21.173517 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9261e0b2-35ac-40f4-92d5-3b9ffaea23c4 could not be found. Oct 04 20:51:21.173517 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:51:21.173517 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:51:21.173517 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:51:21.173517 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:51:21.173517 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:51:21.173517 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:51:21.173517 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:51:21.173517 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:51:21.173517 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:51:21.173517 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:51:21.173517 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:51:21.173517 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:51:21.173517 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:51:21.173517 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:51:21.173517 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:51:21.173517 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:51:21.173517 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9261e0b2-35ac-40f4-92d5-3b9ffaea23c4 could not be found. Oct 04 20:51:21.173517 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:51:21.173517 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:51:21.173517 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:51:21.178289 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:51:21.178289 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:51:21.178289 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:51:21.178289 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:51:21.178289 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:51:21.178289 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9261e0b2-35ac-40f4-92d5-3b9ffaea23c4 could not be found. Oct 04 20:51:21.178289 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:51:21.181594 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-90138c8a-50a0-4558-8486-2acce2eb65e4 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Returning 404 to user: Instance 9261e0b2-35ac-40f4-92d5-3b9ffaea23c4 could not be found. {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:51:21.182771 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-90138c8a-50a0-4558-8486-2acce2eb65e4 tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] 10.222.0.33 "GET /compute/v2.1/servers/9261e0b2-35ac-40f4-92d5-3b9ffaea23c4" status: 404 len: 111 microversion: 2.1 time: 0.062379 Oct 04 20:51:21.184719 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1924/3782] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:51:21 2022] GET /compute/v2.1/servers/9261e0b2-35ac-40f4-92d5-3b9ffaea23c4 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:51:21.191875 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-6f3779ca-7dd3-4daa-bdf8-6b156cdfba80 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:21.193641 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-6f3779ca-7dd3-4daa-bdf8-6b156cdfba80 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] [instance: f15ae3c9-8342-4ae9-b81e-2d7b1aecb2e8] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:51:21.200951 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6f3779ca-7dd3-4daa-bdf8-6b156cdfba80 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:21.202713 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6f3779ca-7dd3-4daa-bdf8-6b156cdfba80 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:21.203676 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6f3779ca-7dd3-4daa-bdf8-6b156cdfba80 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:21.204650 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6f3779ca-7dd3-4daa-bdf8-6b156cdfba80 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:21.205338 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6f3779ca-7dd3-4daa-bdf8-6b156cdfba80 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:21.206002 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6f3779ca-7dd3-4daa-bdf8-6b156cdfba80 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:21.228686 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-18c26a83-4295-47be-91b9-a64fdac83293 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b78af5c0485b4343900269160ef3e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659f3d4023b347d58bc0361db9ceead9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:21.238861 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-18c26a83-4295-47be-91b9-a64fdac83293 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b78af5c0485b4343900269160ef3e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659f3d4023b347d58bc0361db9ceead9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:21.240263 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-18c26a83-4295-47be-91b9-a64fdac83293 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b78af5c0485b4343900269160ef3e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659f3d4023b347d58bc0361db9ceead9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:21.241443 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-18c26a83-4295-47be-91b9-a64fdac83293 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] 10.222.0.33 "GET /compute/v2.1/servers/f8ba4e66-2997-4822-9c01-c570f5ae6e87" status: 200 len: 1887 microversion: 2.42 time: 1.160369 Oct 04 20:51:21.251810 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1859/3783] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:51:20 2022] GET /compute/v2.1/servers/f8ba4e66-2997-4822-9c01-c570f5ae6e87 => generated 1887 bytes in 1171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:51:21.270448 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e2d54704-a304-476b-9772-1dc57ed0ef03 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:21.271115 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e2d54704-a304-476b-9772-1dc57ed0ef03 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: a0273e6e-eb85-4204-9bec-3707ad6612af] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:51:21.279051 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e2d54704-a304-476b-9772-1dc57ed0ef03 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:21.280020 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e2d54704-a304-476b-9772-1dc57ed0ef03 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:21.280778 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e2d54704-a304-476b-9772-1dc57ed0ef03 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:21.282270 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e2d54704-a304-476b-9772-1dc57ed0ef03 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:21.283166 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e2d54704-a304-476b-9772-1dc57ed0ef03 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:21.283784 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e2d54704-a304-476b-9772-1dc57ed0ef03 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:21.668939 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e2d54704-a304-476b-9772-1dc57ed0ef03 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac650232cc04810b1340dc2f0edadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b0670d1bd99424780a70e69d57a2166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:21.682619 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e2d54704-a304-476b-9772-1dc57ed0ef03 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "GET /compute/v2.1/servers/a0273e6e-eb85-4204-9bec-3707ad6612af" status: 200 len: 1314 microversion: 2.1 time: 0.429543 Oct 04 20:51:21.683569 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1860/3784] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:51:21 2022] GET /compute/v2.1/servers/a0273e6e-eb85-4204-9bec-3707ad6612af => generated 1314 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:51:21.693753 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-24d546e4-6879-4041-bec2-25011771fbeb tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] Calling method '.version_select at 0x7f3c7517ab80>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:21.744885 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-24d546e4-6879-4041-bec2-25011771fbeb tempest-VolumesAdminNegativeTest-688975349 tempest-VolumesAdminNegativeTest-688975349-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-442592501" status: 202 len: 0 microversion: 2.1 time: 0.059683 Oct 04 20:51:21.745689 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1861/3785] 10.222.0.33 () {58 vars in 1218 bytes} [Tue Oct 4 20:51:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-442592501 => generated 0 bytes in 61 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:51:21.810187 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-65006775-fe64-4b9f-b490-612557d1d69f req-5d33729f-fd0c-4c33-90e9-2b02eae6d374 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8ba4e66-2997-4822-9c01-c570f5ae6e87", "tag": "4f9a97a3-f3e7-439e-b71b-172b65963073"}, {"name": "network-changed", "server_uuid": "f8ba4e66-2997-4822-9c01-c570f5ae6e87", "tag": "23c11bbd-118e-4951-9bf5-0c64ad430751"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:51:21.831917 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-65006775-fe64-4b9f-b490-612557d1d69f req-5d33729f-fd0c-4c33-90e9-2b02eae6d374 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:21.832862 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-65006775-fe64-4b9f-b490-612557d1d69f req-5d33729f-fd0c-4c33-90e9-2b02eae6d374 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:21.834826 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-65006775-fe64-4b9f-b490-612557d1d69f req-5d33729f-fd0c-4c33-90e9-2b02eae6d374 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:21.853713 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-65006775-fe64-4b9f-b490-612557d1d69f req-5d33729f-fd0c-4c33-90e9-2b02eae6d374 service nova] Creating event network-changed:4f9a97a3-f3e7-439e-b71b-172b65963073 for instance f8ba4e66-2997-4822-9c01-c570f5ae6e87 on n-h1-854823-8 Oct 04 20:51:21.854684 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-65006775-fe64-4b9f-b490-612557d1d69f req-5d33729f-fd0c-4c33-90e9-2b02eae6d374 service nova] Creating event network-changed:23c11bbd-118e-4951-9bf5-0c64ad430751 for instance f8ba4e66-2997-4822-9c01-c570f5ae6e87 on n-h1-854823-8 Oct 04 20:51:21.864572 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-65006775-fe64-4b9f-b490-612557d1d69f req-5d33729f-fd0c-4c33-90e9-2b02eae6d374 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.056928 Oct 04 20:51:21.866192 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1862/3786] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:51:21 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 20:51:21.919195 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-6f3779ca-7dd3-4daa-bdf8-6b156cdfba80 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc4171c0ee14ebb8b5eff5e910ccf49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003eb03a265a496d8981e45c74b014f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:21.928893 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-6f3779ca-7dd3-4daa-bdf8-6b156cdfba80 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] 10.222.0.33 "GET /compute/v2.1/servers/f15ae3c9-8342-4ae9-b81e-2d7b1aecb2e8" status: 200 len: 1523 microversion: 2.1 time: 0.742021 Oct 04 20:51:21.929506 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1925/3787] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:51:21 2022] GET /compute/v2.1/servers/f15ae3c9-8342-4ae9-b81e-2d7b1aecb2e8 => generated 1523 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:51:22.149129 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e90bb80b-a48a-46c3-b53a-4c93839cc021 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:22.151068 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e90bb80b-a48a-46c3-b53a-4c93839cc021 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] [instance: e0ca65a5-b651-4473-b73f-af62bf6a6e92] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:51:22.159115 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:51:22.163329 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e90bb80b-a48a-46c3-b53a-4c93839cc021 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:22.164758 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e90bb80b-a48a-46c3-b53a-4c93839cc021 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:22.166160 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e90bb80b-a48a-46c3-b53a-4c93839cc021 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:22.167128 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e90bb80b-a48a-46c3-b53a-4c93839cc021 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:22.169081 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e90bb80b-a48a-46c3-b53a-4c93839cc021 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:22.170050 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e90bb80b-a48a-46c3-b53a-4c93839cc021 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:22.272415 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-6ebb7770-5808-455c-88c9-0b1a17b03388 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:22.273037 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-6ebb7770-5808-455c-88c9-0b1a17b03388 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] [instance: f8ba4e66-2997-4822-9c01-c570f5ae6e87] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:51:22.284630 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6ebb7770-5808-455c-88c9-0b1a17b03388 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:22.286280 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6ebb7770-5808-455c-88c9-0b1a17b03388 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:22.287872 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6ebb7770-5808-455c-88c9-0b1a17b03388 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:22.289426 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6ebb7770-5808-455c-88c9-0b1a17b03388 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:22.292407 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6ebb7770-5808-455c-88c9-0b1a17b03388 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:22.293286 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6ebb7770-5808-455c-88c9-0b1a17b03388 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:22.306282 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:51:22.668621 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e90bb80b-a48a-46c3-b53a-4c93839cc021 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c208ec9faf491385a9ab5b5932098d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ae4960393c464c97669731c2084d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:22.680747 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e90bb80b-a48a-46c3-b53a-4c93839cc021 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] 10.222.0.33 "GET /compute/v2.1/servers/e0ca65a5-b651-4473-b73f-af62bf6a6e92" status: 200 len: 1315 microversion: 2.1 time: 0.538221 Oct 04 20:51:22.681346 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1863/3788] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:51:22 2022] GET /compute/v2.1/servers/e0ca65a5-b651-4473-b73f-af62bf6a6e92 => generated 1315 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:51:22.711901 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-34047000-8178-40d6-b4f0-f633b68517b7 req-de0fe979-f5c8-49da-bdcf-12892608ce1e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a0273e6e-eb85-4204-9bec-3707ad6612af", "tag": "b9c967b1-2617-432a-a85b-6d5bdf32c3a6"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:51:22.722996 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-34047000-8178-40d6-b4f0-f633b68517b7 req-de0fe979-f5c8-49da-bdcf-12892608ce1e service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:22.723847 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-34047000-8178-40d6-b4f0-f633b68517b7 req-de0fe979-f5c8-49da-bdcf-12892608ce1e service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:22.724451 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-34047000-8178-40d6-b4f0-f633b68517b7 req-de0fe979-f5c8-49da-bdcf-12892608ce1e service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:22.740090 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-34047000-8178-40d6-b4f0-f633b68517b7 req-de0fe979-f5c8-49da-bdcf-12892608ce1e service nova] Creating event network-changed:b9c967b1-2617-432a-a85b-6d5bdf32c3a6 for instance a0273e6e-eb85-4204-9bec-3707ad6612af on n-h2-854823-8 Oct 04 20:51:22.747158 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-34047000-8178-40d6-b4f0-f633b68517b7 req-de0fe979-f5c8-49da-bdcf-12892608ce1e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064390 Oct 04 20:51:22.749305 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1864/3789] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:51:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:51:22.755178 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-66234b17-6820-4d4f-a986-000f4470c733 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:22.756129 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-66234b17-6820-4d4f-a986-000f4470c733 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: a0273e6e-eb85-4204-9bec-3707ad6612af] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:51:22.763247 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-66234b17-6820-4d4f-a986-000f4470c733 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:22.764166 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-66234b17-6820-4d4f-a986-000f4470c733 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:22.764780 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-66234b17-6820-4d4f-a986-000f4470c733 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:22.765781 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-66234b17-6820-4d4f-a986-000f4470c733 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:22.766755 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-66234b17-6820-4d4f-a986-000f4470c733 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:22.767510 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-66234b17-6820-4d4f-a986-000f4470c733 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:22.775177 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=16 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:51:23.474766 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-6ebb7770-5808-455c-88c9-0b1a17b03388 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b78af5c0485b4343900269160ef3e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659f3d4023b347d58bc0361db9ceead9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:23.488807 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-6ebb7770-5808-455c-88c9-0b1a17b03388 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b78af5c0485b4343900269160ef3e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659f3d4023b347d58bc0361db9ceead9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:23.494067 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-6ebb7770-5808-455c-88c9-0b1a17b03388 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b78af5c0485b4343900269160ef3e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659f3d4023b347d58bc0361db9ceead9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:23.495607 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-6ebb7770-5808-455c-88c9-0b1a17b03388 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] 10.222.0.33 "GET /compute/v2.1/servers/f8ba4e66-2997-4822-9c01-c570f5ae6e87" status: 200 len: 1887 microversion: 2.42 time: 1.228114 Oct 04 20:51:23.496452 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1926/3790] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:51:22 2022] GET /compute/v2.1/servers/f8ba4e66-2997-4822-9c01-c570f5ae6e87 => generated 1887 bytes in 1230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 20:51:23.511627 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-9a39f9ed-1977-4833-ad6c-3d406693fb7d tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:23.512804 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-9a39f9ed-1977-4833-ad6c-3d406693fb7d tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] [instance: f15ae3c9-8342-4ae9-b81e-2d7b1aecb2e8] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:51:23.526768 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9a39f9ed-1977-4833-ad6c-3d406693fb7d tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:23.529138 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9a39f9ed-1977-4833-ad6c-3d406693fb7d tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:23.531273 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9a39f9ed-1977-4833-ad6c-3d406693fb7d tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:23.536487 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9a39f9ed-1977-4833-ad6c-3d406693fb7d tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:23.537272 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9a39f9ed-1977-4833-ad6c-3d406693fb7d tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:23.538303 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9a39f9ed-1977-4833-ad6c-3d406693fb7d tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:23.585863 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-66234b17-6820-4d4f-a986-000f4470c733 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac650232cc04810b1340dc2f0edadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b0670d1bd99424780a70e69d57a2166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:23.603004 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-66234b17-6820-4d4f-a986-000f4470c733 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "GET /compute/v2.1/servers/a0273e6e-eb85-4204-9bec-3707ad6612af" status: 200 len: 1314 microversion: 2.1 time: 0.852330 Oct 04 20:51:23.603603 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1865/3791] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:51:22 2022] GET /compute/v2.1/servers/a0273e6e-eb85-4204-9bec-3707ad6612af => generated 1314 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:51:23.705912 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-13bf8ad3-5dd1-4be2-bedf-db1052a60537 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:23.707636 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-13bf8ad3-5dd1-4be2-bedf-db1052a60537 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] [instance: e0ca65a5-b651-4473-b73f-af62bf6a6e92] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:51:23.715759 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-13bf8ad3-5dd1-4be2-bedf-db1052a60537 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:23.727100 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-13bf8ad3-5dd1-4be2-bedf-db1052a60537 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:23.727813 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-13bf8ad3-5dd1-4be2-bedf-db1052a60537 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:23.728768 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-13bf8ad3-5dd1-4be2-bedf-db1052a60537 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:23.729420 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-13bf8ad3-5dd1-4be2-bedf-db1052a60537 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:23.730036 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-13bf8ad3-5dd1-4be2-bedf-db1052a60537 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:23.930707 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-9a39f9ed-1977-4833-ad6c-3d406693fb7d tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc4171c0ee14ebb8b5eff5e910ccf49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003eb03a265a496d8981e45c74b014f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:23.940238 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-9a39f9ed-1977-4833-ad6c-3d406693fb7d tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] 10.222.0.33 "GET /compute/v2.1/servers/f15ae3c9-8342-4ae9-b81e-2d7b1aecb2e8" status: 200 len: 1523 microversion: 2.1 time: 0.437485 Oct 04 20:51:23.955173 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1927/3792] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:51:23 2022] GET /compute/v2.1/servers/f15ae3c9-8342-4ae9-b81e-2d7b1aecb2e8 => generated 1523 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:51:24.199430 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-13bf8ad3-5dd1-4be2-bedf-db1052a60537 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c208ec9faf491385a9ab5b5932098d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ae4960393c464c97669731c2084d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:24.222896 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-13bf8ad3-5dd1-4be2-bedf-db1052a60537 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] 10.222.0.33 "GET /compute/v2.1/servers/e0ca65a5-b651-4473-b73f-af62bf6a6e92" status: 200 len: 1501 microversion: 2.1 time: 0.513499 Oct 04 20:51:24.224434 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-d98df008-73aa-4d7d-a55b-f6233e63cd5e tempest-VolumesNegativeTest-926870087 tempest-VolumesNegativeTest-926870087-project] Action: 'create', calling method: .version_select at 0x7f3c6f73b790>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-640984542", "metadata": {"Type": "work"}}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:51:24.230551 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-d98df008-73aa-4d7d-a55b-f6233e63cd5e tempest-VolumesNegativeTest-926870087 tempest-VolumesNegativeTest-926870087-project] Request method failure captured: Oct 04 20:51:24.230551 n-d-854823-8 devstack@n-api.service[128802]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 04 20:51:24.230551 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 20:51:24.230551 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 20:51:24.230551 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 20:51:24.230551 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 121 Oct 04 20:51:24.230551 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 20:51:24.230551 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 20:51:24.230551 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 20:51:24.230551 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 20:51:24.230551 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPJzLehard_yeyQ4mge65HMuzrElH_GAj_65bEm9z3YXHxCErdM728GpdTmq_Q8y3ztES0auvhpggDhsbZeHCk3KmYA6u4r4OywCYfWbK-C097Vcjl7zTc3PMdhgY5ijC8r7fKMf4uQO9yP_F8m8PyJj_1KccJqLvRGGN1VPQ3mgGrec Oct 04 20:51:24.230551 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 20:51:24.230551 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 20:51:24.230551 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 20:51:24.230551 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 20:51:24.230551 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 20:51:24.230551 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 20:51:24.230551 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: 41d5616a1aeb4acd9ccc92d78982b63f Oct 04 20:51:24.230551 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-VolumesNegativeTest-926870087 Oct 04 20:51:24.230551 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 20:51:24.230551 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 20:51:24.230551 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_41d5616a1aeb4acd9ccc92d78982b63f", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/41d5616a1aeb4acd9ccc92d78982b63f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/41d5616a1aeb4acd9ccc92d78982b63f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/41d5616a1aeb4acd9ccc92d78982b63f"}]}] Oct 04 20:51:24.230551 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-VolumesNegativeTest-926870087 Oct 04 20:51:24.230551 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: 41d5616a1aeb4acd9ccc92d78982b63f Oct 04 20:51:24.230551 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-VolumesNegativeTest-926870087 Oct 04 20:51:24.230551 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-VolumesNegativeTest-926870087-project Oct 04 20:51:24.230551 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 20:51:24.230551 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 20:51:24.230551 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: 57d3882c7c124812b63df4b6b48bb88b Oct 04 20:51:24.230551 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-VolumesNegativeTest-926870087-project Oct 04 20:51:24.230551 n-d-854823-8 devstack@n-api.service[128802]: Oct 04 20:51:24.230551 n-d-854823-8 devstack@n-api.service[128802]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-640984542", "metadata": {"Type": "work"}}} Oct 04 20:51:24.230551 n-d-854823-8 devstack@n-api.service[128802]: method: Oct 04 20:51:24.230551 n-d-854823-8 devstack@n-api.service[128802]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 04 20:51:24.230551 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-640984542', 'metadata': {'Type': 'work'}}}} Oct 04 20:51:24.230551 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:51:24.230551 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:51:24.230551 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 20:51:24.230551 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 20:51:24.230551 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 20:51:24.230551 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise error Oct 04 20:51:24.230551 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Oct 04 20:51:24.230551 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:51:24.230551 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 04 20:51:24.230551 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 04 20:51:24.230551 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:51:24.230551 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 04 20:51:24.230551 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi '#$%' Oct 04 20:51:24.230551 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:51:24.230551 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:51:24.230551 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:51:24.230551 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:51:24.230551 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:51:24.230551 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:51:24.230551 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:51:24.230551 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:51:24.230551 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:51:24.230551 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:51:24.230551 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:51:24.230551 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:51:24.230551 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 20:51:24.230551 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 20:51:24.230551 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 20:51:24.230551 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 20:51:24.230551 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 20:51:24.230551 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 20:51:24.236032 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 04 20:51:24.236032 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:51:24.236032 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:51:24.236032 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:51:24.236032 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:51:24.236032 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:51:24.236032 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:51:24.236032 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 20:51:24.236032 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 20:51:24.236032 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 04 20:51:24.236032 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:51:24.238054 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-d98df008-73aa-4d7d-a55b-f6233e63cd5e tempest-VolumesNegativeTest-926870087 tempest-VolumesNegativeTest-926870087-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:51:24.239566 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-d98df008-73aa-4d7d-a55b-f6233e63cd5e tempest-VolumesNegativeTest-926870087 tempest-VolumesNegativeTest-926870087-project] 10.222.0.33 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.282823 Oct 04 20:51:24.240640 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1928/3793] 10.222.0.33 () {60 vars in 1156 bytes} [Tue Oct 4 20:51:23 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 285 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 20:51:24.242665 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1866/3794] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:51:23 2022] GET /compute/v2.1/servers/e0ca65a5-b651-4473-b73f-af62bf6a6e92 => generated 1501 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:51:24.254836 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-4885e95c-11cf-429f-8b26-ff954cdcce9b tempest-VolumesNegativeTest-926870087 tempest-VolumesNegativeTest-926870087-project] Action: 'create', calling method: .version_select at 0x7f3c6f75db80>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1860042671", "metadata": {"Type": "work"}}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:51:24.262771 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a99309ac-e3ec-4157-b392-f0543c0d9558 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:51:24.264506 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a99309ac-e3ec-4157-b392-f0543c0d9558 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] [instance: e0ca65a5-b651-4473-b73f-af62bf6a6e92] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:51:24.267765 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-4885e95c-11cf-429f-8b26-ff954cdcce9b tempest-VolumesNegativeTest-926870087 tempest-VolumesNegativeTest-926870087-project] Request method failure captured: Oct 04 20:51:24.267765 n-d-854823-8 devstack@n-api.service[128802]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 04 20:51:24.267765 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 20:51:24.267765 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 20:51:24.267765 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 20:51:24.267765 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 120 Oct 04 20:51:24.267765 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 20:51:24.267765 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 20:51:24.267765 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 20:51:24.267765 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 20:51:24.267765 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPJzLehard_yeyQ4mge65HMuzrElH_GAj_65bEm9z3YXHxCErdM728GpdTmq_Q8y3ztES0auvhpggDhsbZeHCk3KmYA6u4r4OywCYfWbK-C097Vcjl7zTc3PMdhgY5ijC8r7fKMf4uQO9yP_F8m8PyJj_1KccJqLvRGGN1VPQ3mgGrec Oct 04 20:51:24.267765 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 20:51:24.267765 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 20:51:24.267765 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 20:51:24.267765 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 20:51:24.267765 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 20:51:24.267765 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 20:51:24.267765 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: 41d5616a1aeb4acd9ccc92d78982b63f Oct 04 20:51:24.267765 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-VolumesNegativeTest-926870087 Oct 04 20:51:24.267765 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 20:51:24.267765 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 20:51:24.267765 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_41d5616a1aeb4acd9ccc92d78982b63f", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/41d5616a1aeb4acd9ccc92d78982b63f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/41d5616a1aeb4acd9ccc92d78982b63f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/41d5616a1aeb4acd9ccc92d78982b63f"}]}] Oct 04 20:51:24.267765 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-VolumesNegativeTest-926870087 Oct 04 20:51:24.267765 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: 41d5616a1aeb4acd9ccc92d78982b63f Oct 04 20:51:24.267765 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-VolumesNegativeTest-926870087 Oct 04 20:51:24.267765 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-VolumesNegativeTest-926870087-project Oct 04 20:51:24.267765 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 20:51:24.267765 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 20:51:24.267765 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: 57d3882c7c124812b63df4b6b48bb88b Oct 04 20:51:24.267765 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-VolumesNegativeTest-926870087-project Oct 04 20:51:24.267765 n-d-854823-8 devstack@n-api.service[128802]: Oct 04 20:51:24.267765 n-d-854823-8 devstack@n-api.service[128802]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1860042671", "metadata": {"Type": "work"}}} Oct 04 20:51:24.267765 n-d-854823-8 devstack@n-api.service[128802]: method: Oct 04 20:51:24.267765 n-d-854823-8 devstack@n-api.service[128802]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 04 20:51:24.267765 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1860042671', 'metadata': {'Type': 'work'}}}} Oct 04 20:51:24.267765 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:51:24.267765 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:51:24.267765 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 20:51:24.267765 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 20:51:24.267765 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 20:51:24.267765 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise error Oct 04 20:51:24.267765 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 04 20:51:24.267765 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:51:24.267765 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Oct 04 20:51:24.267765 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 04 20:51:24.267765 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:51:24.267765 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 04 20:51:24.267765 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi '0' Oct 04 20:51:24.267765 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:51:24.267765 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:51:24.267765 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:51:24.267765 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:51:24.267765 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:51:24.267765 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:51:24.267765 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:51:24.267765 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:51:24.267765 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:51:24.267765 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:51:24.267765 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:51:24.267765 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:51:24.267765 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 20:51:24.267765 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 20:51:24.267765 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 20:51:24.267765 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 20:51:24.267765 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 20:51:24.267765 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 20:51:24.272502 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 04 20:51:24.272502 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:51:24.272502 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:51:24.272502 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:51:24.272502 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:51:24.272502 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:51:24.272502 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:51:24.272502 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 20:51:24.272502 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 20:51:24.272502 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 04 20:51:24.272502 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:51:24.278959 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-4885e95c-11cf-429f-8b26-ff954cdcce9b tempest-VolumesNegativeTest-926870087 tempest-VolumesNegativeTest-926870087-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:51:24.284039 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-4885e95c-11cf-429f-8b26-ff954cdcce9b tempest-VolumesNegativeTest-926870087 tempest-VolumesNegativeTest-926870087-project] 10.222.0.33 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.037590 Oct 04 20:51:24.286646 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1929/3795] 10.222.0.33 () {60 vars in 1156 bytes} [Tue Oct 4 20:51:24 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 40 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 20:51:24.295257 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a99309ac-e3ec-4157-b392-f0543c0d9558 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:24.296543 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a99309ac-e3ec-4157-b392-f0543c0d9558 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:24.297638 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a99309ac-e3ec-4157-b392-f0543c0d9558 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:24.298635 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a99309ac-e3ec-4157-b392-f0543c0d9558 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:24.299318 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a99309ac-e3ec-4157-b392-f0543c0d9558 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:24.299968 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a99309ac-e3ec-4157-b392-f0543c0d9558 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:24.307132 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-d3072c1f-2d70-496c-a27c-d90aedca07a5 tempest-VolumesNegativeTest-926870087 tempest-VolumesNegativeTest-926870087-project] Action: 'create', calling method: .version_select at 0x7f3c6f711e50>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1643332112", "metadata": {"Type": "work"}}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:51:24.313100 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-d3072c1f-2d70-496c-a27c-d90aedca07a5 tempest-VolumesNegativeTest-926870087 tempest-VolumesNegativeTest-926870087-project] Request method failure captured: Oct 04 20:51:24.313100 n-d-854823-8 devstack@n-api.service[128802]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 04 20:51:24.313100 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 20:51:24.313100 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 20:51:24.313100 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 20:51:24.313100 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 119 Oct 04 20:51:24.313100 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 20:51:24.313100 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 20:51:24.313100 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 20:51:24.313100 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 20:51:24.313100 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPJzLehard_yeyQ4mge65HMuzrElH_GAj_65bEm9z3YXHxCErdM728GpdTmq_Q8y3ztES0auvhpggDhsbZeHCk3KmYA6u4r4OywCYfWbK-C097Vcjl7zTc3PMdhgY5ijC8r7fKMf4uQO9yP_F8m8PyJj_1KccJqLvRGGN1VPQ3mgGrec Oct 04 20:51:24.313100 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 20:51:24.313100 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 20:51:24.313100 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 20:51:24.313100 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 20:51:24.313100 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 20:51:24.313100 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 20:51:24.313100 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: 41d5616a1aeb4acd9ccc92d78982b63f Oct 04 20:51:24.313100 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-VolumesNegativeTest-926870087 Oct 04 20:51:24.313100 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 20:51:24.313100 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 20:51:24.313100 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_41d5616a1aeb4acd9ccc92d78982b63f", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/41d5616a1aeb4acd9ccc92d78982b63f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/41d5616a1aeb4acd9ccc92d78982b63f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/41d5616a1aeb4acd9ccc92d78982b63f"}]}] Oct 04 20:51:24.313100 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-VolumesNegativeTest-926870087 Oct 04 20:51:24.313100 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: 41d5616a1aeb4acd9ccc92d78982b63f Oct 04 20:51:24.313100 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-VolumesNegativeTest-926870087 Oct 04 20:51:24.313100 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-VolumesNegativeTest-926870087-project Oct 04 20:51:24.313100 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 20:51:24.313100 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 20:51:24.313100 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: 57d3882c7c124812b63df4b6b48bb88b Oct 04 20:51:24.313100 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-VolumesNegativeTest-926870087-project Oct 04 20:51:24.313100 n-d-854823-8 devstack@n-api.service[128802]: Oct 04 20:51:24.313100 n-d-854823-8 devstack@n-api.service[128802]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1643332112", "metadata": {"Type": "work"}}} Oct 04 20:51:24.313100 n-d-854823-8 devstack@n-api.service[128802]: method: Oct 04 20:51:24.313100 n-d-854823-8 devstack@n-api.service[128802]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 04 20:51:24.313100 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1643332112', 'metadata': {'Type': 'work'}}}} Oct 04 20:51:24.313100 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:51:24.313100 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:51:24.313100 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 20:51:24.313100 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 20:51:24.313100 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 20:51:24.313100 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise error Oct 04 20:51:24.313100 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Oct 04 20:51:24.313100 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:51:24.313100 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 04 20:51:24.313100 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 04 20:51:24.313100 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:51:24.313100 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 04 20:51:24.313100 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi '' Oct 04 20:51:24.313100 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:51:24.313100 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:51:24.313100 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:51:24.313100 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:51:24.313100 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:51:24.313100 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:51:24.313100 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:51:24.313100 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:51:24.313100 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:51:24.313100 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:51:24.313100 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:51:24.313100 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:51:24.313100 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 20:51:24.313100 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 20:51:24.313100 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 20:51:24.313100 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 20:51:24.313100 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 20:51:24.313100 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 20:51:24.317796 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 04 20:51:24.317796 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:51:24.317796 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:51:24.317796 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:51:24.317796 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:51:24.317796 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:51:24.317796 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:51:24.317796 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 20:51:24.317796 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 20:51:24.317796 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 04 20:51:24.317796 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:51:24.332596 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-d3072c1f-2d70-496c-a27c-d90aedca07a5 tempest-VolumesNegativeTest-926870087 tempest-VolumesNegativeTest-926870087-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:51:24.334141 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-d3072c1f-2d70-496c-a27c-d90aedca07a5 tempest-VolumesNegativeTest-926870087 tempest-VolumesNegativeTest-926870087-project] 10.222.0.33 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.042850 Oct 04 20:51:24.335440 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1930/3796] 10.222.0.33 () {60 vars in 1156 bytes} [Tue Oct 4 20:51:24 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 44 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 20:51:24.344816 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-f199d662-e70d-421e-8f08-53553869ed42 tempest-VolumesNegativeTest-926870087 tempest-VolumesNegativeTest-926870087-project] Calling method '.version_select at 0x7f3c6f7abb80>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:24.356679 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=100 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:51:24.405018 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.wsgi [None req-f199d662-e70d-421e-8f08-53553869ed42 tempest-VolumesNegativeTest-926870087 tempest-VolumesNegativeTest-926870087-project] HTTP exception thrown: Volume tempest-invalid-1228995957 could not be found. Oct 04 20:51:24.407897 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-f199d662-e70d-421e-8f08-53553869ed42 tempest-VolumesNegativeTest-926870087 tempest-VolumesNegativeTest-926870087-project] Request method failure captured: Oct 04 20:51:24.407897 n-d-854823-8 devstack@n-api.service[128802]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1228995957 HTTP/1.1 Oct 04 20:51:24.407897 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 20:51:24.407897 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 20:51:24.407897 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 20:51:24.407897 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 0 Oct 04 20:51:24.407897 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 20:51:24.407897 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 20:51:24.407897 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 20:51:24.407897 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 20:51:24.407897 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPJzLehard_yeyQ4mge65HMuzrElH_GAj_65bEm9z3YXHxCErdM728GpdTmq_Q8y3ztES0auvhpggDhsbZeHCk3KmYA6u4r4OywCYfWbK-C097Vcjl7zTc3PMdhgY5ijC8r7fKMf4uQO9yP_F8m8PyJj_1KccJqLvRGGN1VPQ3mgGrec Oct 04 20:51:24.407897 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 20:51:24.407897 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 20:51:24.407897 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 20:51:24.407897 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 20:51:24.407897 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 20:51:24.407897 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 20:51:24.407897 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: 41d5616a1aeb4acd9ccc92d78982b63f Oct 04 20:51:24.407897 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-VolumesNegativeTest-926870087 Oct 04 20:51:24.407897 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 20:51:24.407897 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 20:51:24.407897 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_41d5616a1aeb4acd9ccc92d78982b63f", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/41d5616a1aeb4acd9ccc92d78982b63f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/41d5616a1aeb4acd9ccc92d78982b63f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/41d5616a1aeb4acd9ccc92d78982b63f"}]}] Oct 04 20:51:24.407897 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-VolumesNegativeTest-926870087 Oct 04 20:51:24.407897 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: 41d5616a1aeb4acd9ccc92d78982b63f Oct 04 20:51:24.407897 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-VolumesNegativeTest-926870087 Oct 04 20:51:24.407897 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-VolumesNegativeTest-926870087-project Oct 04 20:51:24.407897 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 20:51:24.407897 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 20:51:24.407897 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: 57d3882c7c124812b63df4b6b48bb88b Oct 04 20:51:24.407897 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-VolumesNegativeTest-926870087-project Oct 04 20:51:24.407897 n-d-854823-8 devstack@n-api.service[128802]: method: Oct 04 20:51:24.407897 n-d-854823-8 devstack@n-api.service[128802]: exception: Volume tempest-invalid-1228995957 could not be found. Oct 04 20:51:24.407897 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'id': 'tempest-invalid-1228995957'} Oct 04 20:51:24.407897 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:51:24.407897 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:51:24.407897 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 20:51:24.407897 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 20:51:24.407897 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 04 20:51:24.407897 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 04 20:51:24.407897 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 04 20:51:24.407897 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 04 20:51:24.407897 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 04 20:51:24.407897 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 04 20:51:24.407897 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 04 20:51:24.407897 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 04 20:51:24.407897 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 20:51:24.407897 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 20:51:24.407897 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 20:51:24.407897 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 20:51:24.407897 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1228995957 could not be found. (HTTP 404) (Request-ID: req-e655beb5-9800-4ffb-b8cd-31ffa611e6a9) Oct 04 20:51:24.407897 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:51:24.407897 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:51:24.407897 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:51:24.407897 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:51:24.407897 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 04 20:51:24.407897 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 04 20:51:24.407897 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 04 20:51:24.407897 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 04 20:51:24.407897 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 04 20:51:24.407897 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 04 20:51:24.407897 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 04 20:51:24.407897 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 04 20:51:24.407897 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 20:51:24.415568 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 20:51:24.415568 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 04 20:51:24.415568 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 04 20:51:24.415568 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 04 20:51:24.415568 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 04 20:51:24.415568 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 04 20:51:24.415568 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 04 20:51:24.415568 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 04 20:51:24.415568 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 04 20:51:24.415568 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 20:51:24.415568 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 20:51:24.415568 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 20:51:24.415568 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 20:51:24.415568 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1228995957 could not be found. Oct 04 20:51:24.415568 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:51:24.415568 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:51:24.415568 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:51:24.415568 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:51:24.415568 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:51:24.415568 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:51:24.415568 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:51:24.415568 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:51:24.415568 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:51:24.415568 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:51:24.415568 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:51:24.415568 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:51:24.415568 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 04 20:51:24.415568 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:51:24.415568 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1228995957 could not be found. Oct 04 20:51:24.415568 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:51:24.415568 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:51:24.415568 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:51:24.415568 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:51:24.415568 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:51:24.415568 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:51:24.415568 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:51:24.415568 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:51:24.415568 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1228995957 could not be found. Oct 04 20:51:24.415568 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:51:24.415568 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-f199d662-e70d-421e-8f08-53553869ed42 tempest-VolumesNegativeTest-926870087 tempest-VolumesNegativeTest-926870087-project] Returning 404 to user: Volume tempest-invalid-1228995957 could not be found. {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:51:24.415568 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-f199d662-e70d-421e-8f08-53553869ed42 tempest-VolumesNegativeTest-926870087 tempest-VolumesNegativeTest-926870087-project] 10.222.0.33 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1228995957" status: 404 len: 99 microversion: 2.1 time: 0.072808 Oct 04 20:51:24.415568 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1931/3797] 10.222.0.33 () {58 vars in 1218 bytes} [Tue Oct 4 20:51:24 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1228995957 => generated 99 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 04 20:51:24.426499 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-913ae855-8b2c-4fc4-9260-246e5a3a2ce3 tempest-VolumesNegativeTest-926870087 tempest-VolumesNegativeTest-926870087-project] 10.222.0.33 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003768 Oct 04 20:51:24.428336 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1932/3798] 10.222.0.33 () {58 vars in 1140 bytes} [Tue Oct 4 20:51:24 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Oct 04 20:51:24.438546 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-a4fc6d17-8b61-46ba-b283-7e7aca8f8ead tempest-VolumesNegativeTest-926870087 tempest-VolumesNegativeTest-926870087-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004370 Oct 04 20:51:24.439031 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1933/3799] 10.222.0.33 () {58 vars in 1137 bytes} [Tue Oct 4 20:51:24 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Oct 04 20:51:24.449978 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-32ee16f9-d26e-4e24-b95f-e861a92d85fa tempest-VolumesNegativeTest-926870087 tempest-VolumesNegativeTest-926870087-project] Calling method '.version_select at 0x7f3c7450d1f0>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:24.463462 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a99309ac-e3ec-4157-b392-f0543c0d9558 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] 10.222.0.33 "POST /compute/v2.1/servers/e0ca65a5-b651-4473-b73f-af62bf6a6e92/action" status: 202 len: 0 microversion: 2.1 time: 0.214906 Oct 04 20:51:24.469298 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1867/3800] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 20:51:24 2022] POST /compute/v2.1/servers/e0ca65a5-b651-4473-b73f-af62bf6a6e92/action => generated 0 bytes in 222 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:51:24.477705 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-31c547ac-665e-4398-8c3e-e8cee1422fb6 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:24.479586 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-31c547ac-665e-4398-8c3e-e8cee1422fb6 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] [instance: e0ca65a5-b651-4473-b73f-af62bf6a6e92] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:51:24.490583 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-31c547ac-665e-4398-8c3e-e8cee1422fb6 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:24.491612 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-31c547ac-665e-4398-8c3e-e8cee1422fb6 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:24.492734 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-31c547ac-665e-4398-8c3e-e8cee1422fb6 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:24.493901 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-31c547ac-665e-4398-8c3e-e8cee1422fb6 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:24.495022 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-31c547ac-665e-4398-8c3e-e8cee1422fb6 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:24.495763 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-31c547ac-665e-4398-8c3e-e8cee1422fb6 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:24.501984 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.wsgi [None req-32ee16f9-d26e-4e24-b95f-e861a92d85fa tempest-VolumesNegativeTest-926870087 tempest-VolumesNegativeTest-926870087-project] HTTP exception thrown: Volume 1db6f32b-7d54-4850-b946-373de313c695 could not be found. Oct 04 20:51:24.503970 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-32ee16f9-d26e-4e24-b95f-e861a92d85fa tempest-VolumesNegativeTest-926870087 tempest-VolumesNegativeTest-926870087-project] Request method failure captured: Oct 04 20:51:24.503970 n-d-854823-8 devstack@n-api.service[128802]: request: DELETE /compute/v2.1/os-volumes/1db6f32b-7d54-4850-b946-373de313c695 HTTP/1.1 Oct 04 20:51:24.503970 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 20:51:24.503970 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 20:51:24.503970 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 20:51:24.503970 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 0 Oct 04 20:51:24.503970 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 20:51:24.503970 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 20:51:24.503970 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 20:51:24.503970 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 20:51:24.503970 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPJzLehard_yeyQ4mge65HMuzrElH_GAj_65bEm9z3YXHxCErdM728GpdTmq_Q8y3ztES0auvhpggDhsbZeHCk3KmYA6u4r4OywCYfWbK-C097Vcjl7zTc3PMdhgY5ijC8r7fKMf4uQO9yP_F8m8PyJj_1KccJqLvRGGN1VPQ3mgGrec Oct 04 20:51:24.503970 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 20:51:24.503970 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 20:51:24.503970 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 20:51:24.503970 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 20:51:24.503970 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 20:51:24.503970 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 20:51:24.503970 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: 41d5616a1aeb4acd9ccc92d78982b63f Oct 04 20:51:24.503970 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-VolumesNegativeTest-926870087 Oct 04 20:51:24.503970 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 20:51:24.503970 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 20:51:24.503970 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_41d5616a1aeb4acd9ccc92d78982b63f", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/41d5616a1aeb4acd9ccc92d78982b63f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/41d5616a1aeb4acd9ccc92d78982b63f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/41d5616a1aeb4acd9ccc92d78982b63f"}]}] Oct 04 20:51:24.503970 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-VolumesNegativeTest-926870087 Oct 04 20:51:24.503970 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: 41d5616a1aeb4acd9ccc92d78982b63f Oct 04 20:51:24.503970 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-VolumesNegativeTest-926870087 Oct 04 20:51:24.503970 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-VolumesNegativeTest-926870087-project Oct 04 20:51:24.503970 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 20:51:24.503970 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 20:51:24.503970 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: 57d3882c7c124812b63df4b6b48bb88b Oct 04 20:51:24.503970 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-VolumesNegativeTest-926870087-project Oct 04 20:51:24.503970 n-d-854823-8 devstack@n-api.service[128802]: method: Oct 04 20:51:24.503970 n-d-854823-8 devstack@n-api.service[128802]: exception: Volume 1db6f32b-7d54-4850-b946-373de313c695 could not be found. Oct 04 20:51:24.503970 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'id': '1db6f32b-7d54-4850-b946-373de313c695'} Oct 04 20:51:24.503970 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:51:24.503970 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:51:24.503970 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 20:51:24.503970 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 20:51:24.503970 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 04 20:51:24.503970 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 04 20:51:24.503970 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 04 20:51:24.503970 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 04 20:51:24.503970 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 04 20:51:24.503970 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 04 20:51:24.503970 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 04 20:51:24.503970 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 04 20:51:24.503970 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 20:51:24.503970 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 20:51:24.503970 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 20:51:24.503970 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 20:51:24.503970 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1db6f32b-7d54-4850-b946-373de313c695 could not be found. (HTTP 404) (Request-ID: req-8803dea1-cab2-468c-8358-2de2842af46e) Oct 04 20:51:24.503970 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:51:24.503970 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:51:24.503970 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:51:24.503970 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:51:24.503970 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 04 20:51:24.503970 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 04 20:51:24.503970 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 04 20:51:24.503970 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 04 20:51:24.503970 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 04 20:51:24.503970 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 04 20:51:24.503970 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 04 20:51:24.503970 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 04 20:51:24.503970 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 20:51:24.514951 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 20:51:24.514951 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 04 20:51:24.514951 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 04 20:51:24.514951 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 04 20:51:24.514951 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 04 20:51:24.514951 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 04 20:51:24.514951 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 04 20:51:24.514951 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 04 20:51:24.514951 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 04 20:51:24.514951 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 20:51:24.514951 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 20:51:24.514951 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 20:51:24.514951 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 20:51:24.514951 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1db6f32b-7d54-4850-b946-373de313c695 could not be found. Oct 04 20:51:24.514951 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:51:24.514951 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:51:24.514951 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:51:24.514951 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:51:24.514951 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:51:24.514951 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:51:24.514951 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:51:24.514951 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:51:24.514951 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:51:24.514951 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:51:24.514951 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:51:24.514951 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:51:24.514951 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 04 20:51:24.514951 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:51:24.514951 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1db6f32b-7d54-4850-b946-373de313c695 could not be found. Oct 04 20:51:24.514951 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:51:24.514951 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:51:24.514951 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:51:24.514951 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:51:24.514951 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:51:24.514951 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:51:24.514951 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:51:24.514951 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:51:24.514951 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1db6f32b-7d54-4850-b946-373de313c695 could not be found. Oct 04 20:51:24.514951 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:51:24.514951 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-32ee16f9-d26e-4e24-b95f-e861a92d85fa tempest-VolumesNegativeTest-926870087 tempest-VolumesNegativeTest-926870087-project] Returning 404 to user: Volume 1db6f32b-7d54-4850-b946-373de313c695 could not be found. {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:51:24.514951 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-32ee16f9-d26e-4e24-b95f-e861a92d85fa tempest-VolumesNegativeTest-926870087 tempest-VolumesNegativeTest-926870087-project] 10.222.0.33 "DELETE /compute/v2.1/os-volumes/1db6f32b-7d54-4850-b946-373de313c695" status: 404 len: 109 microversion: 2.1 time: 0.059183 Oct 04 20:51:24.514951 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1934/3801] 10.222.0.33 () {58 vars in 1248 bytes} [Tue Oct 4 20:51:24 2022] DELETE /compute/v2.1/os-volumes/1db6f32b-7d54-4850-b946-373de313c695 => generated 109 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 20:51:24.521557 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-6d7f113a-5e24-4d0d-8d5b-effc71020163 tempest-VolumesNegativeTest-926870087 tempest-VolumesNegativeTest-926870087-project] Calling method '.version_select at 0x7f3c787fdb80>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:24.584241 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.wsgi [None req-6d7f113a-5e24-4d0d-8d5b-effc71020163 tempest-VolumesNegativeTest-926870087 tempest-VolumesNegativeTest-926870087-project] HTTP exception thrown: Volume 6a116d38-c5d8-4d28-ae76-fd9e6b26c922 could not be found. Oct 04 20:51:24.586188 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-6d7f113a-5e24-4d0d-8d5b-effc71020163 tempest-VolumesNegativeTest-926870087 tempest-VolumesNegativeTest-926870087-project] Request method failure captured: Oct 04 20:51:24.586188 n-d-854823-8 devstack@n-api.service[128802]: request: GET /compute/v2.1/os-volumes/6a116d38-c5d8-4d28-ae76-fd9e6b26c922 HTTP/1.1 Oct 04 20:51:24.586188 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 20:51:24.586188 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 20:51:24.586188 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 20:51:24.586188 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 0 Oct 04 20:51:24.586188 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 20:51:24.586188 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 20:51:24.586188 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 20:51:24.586188 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 20:51:24.586188 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPJzLehard_yeyQ4mge65HMuzrElH_GAj_65bEm9z3YXHxCErdM728GpdTmq_Q8y3ztES0auvhpggDhsbZeHCk3KmYA6u4r4OywCYfWbK-C097Vcjl7zTc3PMdhgY5ijC8r7fKMf4uQO9yP_F8m8PyJj_1KccJqLvRGGN1VPQ3mgGrec Oct 04 20:51:24.586188 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 20:51:24.586188 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 20:51:24.586188 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 20:51:24.586188 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 20:51:24.586188 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 20:51:24.586188 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 20:51:24.586188 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: 41d5616a1aeb4acd9ccc92d78982b63f Oct 04 20:51:24.586188 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-VolumesNegativeTest-926870087 Oct 04 20:51:24.586188 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 20:51:24.586188 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 20:51:24.586188 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_41d5616a1aeb4acd9ccc92d78982b63f", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/41d5616a1aeb4acd9ccc92d78982b63f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/41d5616a1aeb4acd9ccc92d78982b63f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/41d5616a1aeb4acd9ccc92d78982b63f"}]}] Oct 04 20:51:24.586188 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-VolumesNegativeTest-926870087 Oct 04 20:51:24.586188 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: 41d5616a1aeb4acd9ccc92d78982b63f Oct 04 20:51:24.586188 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-VolumesNegativeTest-926870087 Oct 04 20:51:24.586188 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-VolumesNegativeTest-926870087-project Oct 04 20:51:24.586188 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 20:51:24.586188 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 20:51:24.586188 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: 57d3882c7c124812b63df4b6b48bb88b Oct 04 20:51:24.586188 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-VolumesNegativeTest-926870087-project Oct 04 20:51:24.586188 n-d-854823-8 devstack@n-api.service[128802]: method: Oct 04 20:51:24.586188 n-d-854823-8 devstack@n-api.service[128802]: exception: Volume 6a116d38-c5d8-4d28-ae76-fd9e6b26c922 could not be found. Oct 04 20:51:24.586188 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'id': '6a116d38-c5d8-4d28-ae76-fd9e6b26c922'} Oct 04 20:51:24.586188 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:51:24.586188 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:51:24.586188 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 20:51:24.586188 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 20:51:24.586188 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 04 20:51:24.586188 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 04 20:51:24.586188 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 04 20:51:24.586188 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 04 20:51:24.586188 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 20:51:24.586188 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 20:51:24.586188 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 20:51:24.586188 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 20:51:24.586188 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 20:51:24.586188 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 20:51:24.586188 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 20:51:24.586188 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 20:51:24.586188 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6a116d38-c5d8-4d28-ae76-fd9e6b26c922 could not be found. (HTTP 404) (Request-ID: req-11bd4e03-f78b-4065-b407-f8035884acbb) Oct 04 20:51:24.586188 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:51:24.586188 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:51:24.586188 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:51:24.586188 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:51:24.586188 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 04 20:51:24.586188 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 04 20:51:24.586188 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 04 20:51:24.586188 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 04 20:51:24.586188 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 04 20:51:24.586188 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 04 20:51:24.586188 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 04 20:51:24.586188 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 04 20:51:24.586188 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 20:51:24.599301 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 20:51:24.599301 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 04 20:51:24.599301 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 04 20:51:24.599301 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 04 20:51:24.599301 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 04 20:51:24.599301 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 20:51:24.599301 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 20:51:24.599301 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 20:51:24.599301 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 20:51:24.599301 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 20:51:24.599301 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 20:51:24.599301 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 20:51:24.599301 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 20:51:24.599301 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6a116d38-c5d8-4d28-ae76-fd9e6b26c922 could not be found. Oct 04 20:51:24.599301 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:51:24.599301 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:51:24.599301 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:51:24.599301 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:51:24.599301 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:51:24.599301 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:51:24.599301 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:51:24.599301 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:51:24.599301 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:51:24.599301 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:51:24.599301 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:51:24.599301 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:51:24.599301 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 04 20:51:24.599301 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:51:24.599301 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6a116d38-c5d8-4d28-ae76-fd9e6b26c922 could not be found. Oct 04 20:51:24.599301 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:51:24.599301 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:51:24.599301 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:51:24.599301 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:51:24.599301 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:51:24.599301 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:51:24.599301 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:51:24.599301 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:51:24.599301 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6a116d38-c5d8-4d28-ae76-fd9e6b26c922 could not be found. Oct 04 20:51:24.599301 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:51:24.599301 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-6d7f113a-5e24-4d0d-8d5b-effc71020163 tempest-VolumesNegativeTest-926870087 tempest-VolumesNegativeTest-926870087-project] Returning 404 to user: Volume 6a116d38-c5d8-4d28-ae76-fd9e6b26c922 could not be found. {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:51:24.599301 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-6d7f113a-5e24-4d0d-8d5b-effc71020163 tempest-VolumesNegativeTest-926870087 tempest-VolumesNegativeTest-926870087-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/6a116d38-c5d8-4d28-ae76-fd9e6b26c922" status: 404 len: 109 microversion: 2.1 time: 0.074543 Oct 04 20:51:24.599301 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1935/3802] 10.222.0.33 () {58 vars in 1245 bytes} [Tue Oct 4 20:51:24 2022] GET /compute/v2.1/os-volumes/6a116d38-c5d8-4d28-ae76-fd9e6b26c922 => generated 109 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 20:51:24.599301 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-c928f917-7cfc-47b2-8dc9-1f504ca6dd40 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:24.599301 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-c928f917-7cfc-47b2-8dc9-1f504ca6dd40 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] [instance: f8ba4e66-2997-4822-9c01-c570f5ae6e87] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:51:24.620805 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c928f917-7cfc-47b2-8dc9-1f504ca6dd40 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:24.621315 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c928f917-7cfc-47b2-8dc9-1f504ca6dd40 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:24.621763 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c928f917-7cfc-47b2-8dc9-1f504ca6dd40 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:24.622515 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c928f917-7cfc-47b2-8dc9-1f504ca6dd40 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:24.623556 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c928f917-7cfc-47b2-8dc9-1f504ca6dd40 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:24.623989 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c928f917-7cfc-47b2-8dc9-1f504ca6dd40 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:25.093519 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-31c547ac-665e-4398-8c3e-e8cee1422fb6 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c208ec9faf491385a9ab5b5932098d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ae4960393c464c97669731c2084d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:25.102410 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-31c547ac-665e-4398-8c3e-e8cee1422fb6 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] 10.222.0.33 "GET /compute/v2.1/servers/e0ca65a5-b651-4473-b73f-af62bf6a6e92" status: 200 len: 1506 microversion: 2.1 time: 0.631922 Oct 04 20:51:25.103708 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1868/3803] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:51:24 2022] GET /compute/v2.1/servers/e0ca65a5-b651-4473-b73f-af62bf6a6e92 => generated 1506 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:51:25.108738 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-edcb967b-9744-471e-9e4e-5c17e9393b69 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:25.116752 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-edcb967b-9744-471e-9e4e-5c17e9393b69 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: a0273e6e-eb85-4204-9bec-3707ad6612af] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:51:25.131957 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-edcb967b-9744-471e-9e4e-5c17e9393b69 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:25.134077 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-edcb967b-9744-471e-9e4e-5c17e9393b69 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:25.135626 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-edcb967b-9744-471e-9e4e-5c17e9393b69 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:25.137355 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-edcb967b-9744-471e-9e4e-5c17e9393b69 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:25.140402 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-edcb967b-9744-471e-9e4e-5c17e9393b69 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:25.142908 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-edcb967b-9744-471e-9e4e-5c17e9393b69 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:25.233023 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-c928f917-7cfc-47b2-8dc9-1f504ca6dd40 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b78af5c0485b4343900269160ef3e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659f3d4023b347d58bc0361db9ceead9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:25.243261 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-c928f917-7cfc-47b2-8dc9-1f504ca6dd40 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b78af5c0485b4343900269160ef3e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659f3d4023b347d58bc0361db9ceead9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:25.255858 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-c928f917-7cfc-47b2-8dc9-1f504ca6dd40 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b78af5c0485b4343900269160ef3e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659f3d4023b347d58bc0361db9ceead9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:25.257093 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-c928f917-7cfc-47b2-8dc9-1f504ca6dd40 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] 10.222.0.33 "GET /compute/v2.1/servers/f8ba4e66-2997-4822-9c01-c570f5ae6e87" status: 200 len: 1887 microversion: 2.42 time: 0.667997 Oct 04 20:51:25.257851 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1936/3804] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:51:24 2022] GET /compute/v2.1/servers/f8ba4e66-2997-4822-9c01-c570f5ae6e87 => generated 1887 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:51:25.262412 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-e4f9ffc7-e295-43b3-b0a9-acaf648a23aa req-3770a9c9-a1d0-40a9-8080-6de9f1faf76e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8ba4e66-2997-4822-9c01-c570f5ae6e87", "tag": "89bbad56-acc7-4db0-9c4c-a9fd89521acf"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:51:25.289196 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-e4f9ffc7-e295-43b3-b0a9-acaf648a23aa req-3770a9c9-a1d0-40a9-8080-6de9f1faf76e service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:25.289681 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-e4f9ffc7-e295-43b3-b0a9-acaf648a23aa req-3770a9c9-a1d0-40a9-8080-6de9f1faf76e service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:25.290105 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-e4f9ffc7-e295-43b3-b0a9-acaf648a23aa req-3770a9c9-a1d0-40a9-8080-6de9f1faf76e service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:25.303475 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-e4f9ffc7-e295-43b3-b0a9-acaf648a23aa req-3770a9c9-a1d0-40a9-8080-6de9f1faf76e service nova] Creating event network-changed:89bbad56-acc7-4db0-9c4c-a9fd89521acf for instance f8ba4e66-2997-4822-9c01-c570f5ae6e87 on n-h1-854823-8 Oct 04 20:51:25.308975 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-e4f9ffc7-e295-43b3-b0a9-acaf648a23aa req-3770a9c9-a1d0-40a9-8080-6de9f1faf76e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049611 Oct 04 20:51:25.309991 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1937/3805] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:51:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:51:25.316590 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-f930e9c8-6017-4a3a-a261-4629f8855f04 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:25.317299 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-f930e9c8-6017-4a3a-a261-4629f8855f04 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] [instance: f15ae3c9-8342-4ae9-b81e-2d7b1aecb2e8] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:51:25.324617 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f930e9c8-6017-4a3a-a261-4629f8855f04 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:25.325109 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f930e9c8-6017-4a3a-a261-4629f8855f04 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:25.325613 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f930e9c8-6017-4a3a-a261-4629f8855f04 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:25.327122 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f930e9c8-6017-4a3a-a261-4629f8855f04 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:25.327584 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f930e9c8-6017-4a3a-a261-4629f8855f04 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:25.328011 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f930e9c8-6017-4a3a-a261-4629f8855f04 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:25.876005 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-edcb967b-9744-471e-9e4e-5c17e9393b69 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac650232cc04810b1340dc2f0edadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b0670d1bd99424780a70e69d57a2166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:25.884203 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-edcb967b-9744-471e-9e4e-5c17e9393b69 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "GET /compute/v2.1/servers/a0273e6e-eb85-4204-9bec-3707ad6612af" status: 200 len: 1314 microversion: 2.1 time: 0.779002 Oct 04 20:51:25.885190 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1869/3806] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:51:25 2022] GET /compute/v2.1/servers/a0273e6e-eb85-4204-9bec-3707ad6612af => generated 1314 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:51:25.913291 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-f930e9c8-6017-4a3a-a261-4629f8855f04 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc4171c0ee14ebb8b5eff5e910ccf49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003eb03a265a496d8981e45c74b014f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:25.923557 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-f930e9c8-6017-4a3a-a261-4629f8855f04 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] 10.222.0.33 "GET /compute/v2.1/servers/f15ae3c9-8342-4ae9-b81e-2d7b1aecb2e8" status: 200 len: 1523 microversion: 2.1 time: 0.611482 Oct 04 20:51:25.924640 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1938/3807] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:51:25 2022] GET /compute/v2.1/servers/f15ae3c9-8342-4ae9-b81e-2d7b1aecb2e8 => generated 1523 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:51:26.131952 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2be81ba3-e0a1-4814-abd6-8d9ca170436c tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:26.132771 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-2be81ba3-e0a1-4814-abd6-8d9ca170436c tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] [instance: e0ca65a5-b651-4473-b73f-af62bf6a6e92] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:51:26.143755 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2be81ba3-e0a1-4814-abd6-8d9ca170436c tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:26.144254 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2be81ba3-e0a1-4814-abd6-8d9ca170436c tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:26.144687 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2be81ba3-e0a1-4814-abd6-8d9ca170436c tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:26.145388 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2be81ba3-e0a1-4814-abd6-8d9ca170436c tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:26.145840 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2be81ba3-e0a1-4814-abd6-8d9ca170436c tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:26.146262 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2be81ba3-e0a1-4814-abd6-8d9ca170436c tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:26.290005 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-5145aa32-045b-4283-a5a8-c95a2ab52781 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:26.291187 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-5145aa32-045b-4283-a5a8-c95a2ab52781 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] [instance: f8ba4e66-2997-4822-9c01-c570f5ae6e87] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:51:26.301198 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5145aa32-045b-4283-a5a8-c95a2ab52781 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:26.302169 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5145aa32-045b-4283-a5a8-c95a2ab52781 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:26.303656 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5145aa32-045b-4283-a5a8-c95a2ab52781 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:26.304679 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5145aa32-045b-4283-a5a8-c95a2ab52781 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:26.305354 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5145aa32-045b-4283-a5a8-c95a2ab52781 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:26.306066 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5145aa32-045b-4283-a5a8-c95a2ab52781 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:27.305451 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-2be81ba3-e0a1-4814-abd6-8d9ca170436c tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c208ec9faf491385a9ab5b5932098d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ae4960393c464c97669731c2084d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:27.315469 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-2be81ba3-e0a1-4814-abd6-8d9ca170436c tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] 10.222.0.33 "GET /compute/v2.1/servers/e0ca65a5-b651-4473-b73f-af62bf6a6e92" status: 200 len: 1486 microversion: 2.1 time: 1.187872 Oct 04 20:51:27.316677 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1870/3808] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:51:26 2022] GET /compute/v2.1/servers/e0ca65a5-b651-4473-b73f-af62bf6a6e92 => generated 1486 bytes in 1191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:51:27.323865 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7e0f1fd5-0cf9-4eca-bd25-117ae41f7ba1 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:27.324786 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-7e0f1fd5-0cf9-4eca-bd25-117ae41f7ba1 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: a0273e6e-eb85-4204-9bec-3707ad6612af] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:51:27.336023 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7e0f1fd5-0cf9-4eca-bd25-117ae41f7ba1 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:27.337068 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7e0f1fd5-0cf9-4eca-bd25-117ae41f7ba1 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:27.337505 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7e0f1fd5-0cf9-4eca-bd25-117ae41f7ba1 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:27.338218 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7e0f1fd5-0cf9-4eca-bd25-117ae41f7ba1 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:27.338688 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7e0f1fd5-0cf9-4eca-bd25-117ae41f7ba1 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:27.339114 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7e0f1fd5-0cf9-4eca-bd25-117ae41f7ba1 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:27.527003 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-5145aa32-045b-4283-a5a8-c95a2ab52781 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b78af5c0485b4343900269160ef3e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659f3d4023b347d58bc0361db9ceead9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:27.547642 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-5145aa32-045b-4283-a5a8-c95a2ab52781 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b78af5c0485b4343900269160ef3e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659f3d4023b347d58bc0361db9ceead9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:27.550595 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-5145aa32-045b-4283-a5a8-c95a2ab52781 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b78af5c0485b4343900269160ef3e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659f3d4023b347d58bc0361db9ceead9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:27.552537 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-5145aa32-045b-4283-a5a8-c95a2ab52781 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] 10.222.0.33 "GET /compute/v2.1/servers/f8ba4e66-2997-4822-9c01-c570f5ae6e87" status: 200 len: 1887 microversion: 2.42 time: 1.271424 Oct 04 20:51:27.553779 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1939/3809] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:51:26 2022] GET /compute/v2.1/servers/f8ba4e66-2997-4822-9c01-c570f5ae6e87 => generated 1887 bytes in 1274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:51:27.559351 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-7f54c052-5d9b-450d-a68e-1f5a7b5bc511 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:27.560269 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-7f54c052-5d9b-450d-a68e-1f5a7b5bc511 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] [instance: f15ae3c9-8342-4ae9-b81e-2d7b1aecb2e8] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:51:27.572501 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7f54c052-5d9b-450d-a68e-1f5a7b5bc511 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:27.573632 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7f54c052-5d9b-450d-a68e-1f5a7b5bc511 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:27.573786 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7f54c052-5d9b-450d-a68e-1f5a7b5bc511 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:27.574446 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7f54c052-5d9b-450d-a68e-1f5a7b5bc511 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:27.574955 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7f54c052-5d9b-450d-a68e-1f5a7b5bc511 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:27.575566 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7f54c052-5d9b-450d-a68e-1f5a7b5bc511 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:27.900100 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-7e0f1fd5-0cf9-4eca-bd25-117ae41f7ba1 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac650232cc04810b1340dc2f0edadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b0670d1bd99424780a70e69d57a2166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:27.911516 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-7e0f1fd5-0cf9-4eca-bd25-117ae41f7ba1 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "GET /compute/v2.1/servers/a0273e6e-eb85-4204-9bec-3707ad6612af" status: 200 len: 1314 microversion: 2.1 time: 0.593114 Oct 04 20:51:27.912948 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1871/3810] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:51:27 2022] GET /compute/v2.1/servers/a0273e6e-eb85-4204-9bec-3707ad6612af => generated 1314 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:51:27.919504 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6b3ddc0d-b9ad-4d81-9e64-701e45e75379 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:27.922595 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-6b3ddc0d-b9ad-4d81-9e64-701e45e75379 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] [instance: e0ca65a5-b651-4473-b73f-af62bf6a6e92] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:51:27.930786 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6b3ddc0d-b9ad-4d81-9e64-701e45e75379 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:27.931614 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6b3ddc0d-b9ad-4d81-9e64-701e45e75379 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:27.932521 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6b3ddc0d-b9ad-4d81-9e64-701e45e75379 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:27.934237 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6b3ddc0d-b9ad-4d81-9e64-701e45e75379 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:27.935390 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6b3ddc0d-b9ad-4d81-9e64-701e45e75379 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:27.937674 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6b3ddc0d-b9ad-4d81-9e64-701e45e75379 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:27.989331 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-6b3ddc0d-b9ad-4d81-9e64-701e45e75379 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] [instance: e0ca65a5-b651-4473-b73f-af62bf6a6e92] Going to try to terminate instance {{(pid=128801) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:51:28.107548 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-6b3ddc0d-b9ad-4d81-9e64-701e45e75379 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] 10.222.0.33 "DELETE /compute/v2.1/servers/e0ca65a5-b651-4473-b73f-af62bf6a6e92" status: 204 len: 0 microversion: 2.1 time: 0.191806 Oct 04 20:51:28.109059 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1872/3811] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 20:51:27 2022] DELETE /compute/v2.1/servers/e0ca65a5-b651-4473-b73f-af62bf6a6e92 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:51:28.119697 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-cc6b30b7-eb0e-42a4-a165-bb5cfebf543d req-9ebcc98a-a124-4f42-9b4e-6137f8b21a17 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8ba4e66-2997-4822-9c01-c570f5ae6e87", "tag": "ad4a640c-5df6-4e63-9966-9e83e88c558b"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:51:28.135151 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-cc6b30b7-eb0e-42a4-a165-bb5cfebf543d req-9ebcc98a-a124-4f42-9b4e-6137f8b21a17 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:28.135967 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-cc6b30b7-eb0e-42a4-a165-bb5cfebf543d req-9ebcc98a-a124-4f42-9b4e-6137f8b21a17 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:28.136598 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-cc6b30b7-eb0e-42a4-a165-bb5cfebf543d req-9ebcc98a-a124-4f42-9b4e-6137f8b21a17 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:28.151393 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-cc6b30b7-eb0e-42a4-a165-bb5cfebf543d req-9ebcc98a-a124-4f42-9b4e-6137f8b21a17 service nova] Creating event network-changed:ad4a640c-5df6-4e63-9966-9e83e88c558b for instance f8ba4e66-2997-4822-9c01-c570f5ae6e87 on n-h1-854823-8 Oct 04 20:51:28.158182 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-cc6b30b7-eb0e-42a4-a165-bb5cfebf543d req-9ebcc98a-a124-4f42-9b4e-6137f8b21a17 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047290 Oct 04 20:51:28.159464 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1873/3812] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:51:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:51:28.166180 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a351a8a8-4f92-4ada-862e-63673b12fbc9 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:28.167367 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a351a8a8-4f92-4ada-862e-63673b12fbc9 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] [instance: e0ca65a5-b651-4473-b73f-af62bf6a6e92] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:51:28.171018 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-7f54c052-5d9b-450d-a68e-1f5a7b5bc511 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc4171c0ee14ebb8b5eff5e910ccf49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003eb03a265a496d8981e45c74b014f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:28.175060 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a351a8a8-4f92-4ada-862e-63673b12fbc9 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:28.175818 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a351a8a8-4f92-4ada-862e-63673b12fbc9 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:28.176446 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a351a8a8-4f92-4ada-862e-63673b12fbc9 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:28.177311 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a351a8a8-4f92-4ada-862e-63673b12fbc9 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:28.178560 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a351a8a8-4f92-4ada-862e-63673b12fbc9 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:28.179159 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a351a8a8-4f92-4ada-862e-63673b12fbc9 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:28.183753 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-7f54c052-5d9b-450d-a68e-1f5a7b5bc511 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] 10.222.0.33 "GET /compute/v2.1/servers/f15ae3c9-8342-4ae9-b81e-2d7b1aecb2e8" status: 200 len: 1523 microversion: 2.1 time: 0.628712 Oct 04 20:51:28.187534 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1940/3813] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:51:27 2022] GET /compute/v2.1/servers/f15ae3c9-8342-4ae9-b81e-2d7b1aecb2e8 => generated 1523 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:51:28.470931 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-a351a8a8-4f92-4ada-862e-63673b12fbc9 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c208ec9faf491385a9ab5b5932098d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ae4960393c464c97669731c2084d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:28.479463 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a351a8a8-4f92-4ada-862e-63673b12fbc9 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] 10.222.0.33 "GET /compute/v2.1/servers/e0ca65a5-b651-4473-b73f-af62bf6a6e92" status: 200 len: 1492 microversion: 2.1 time: 0.318354 Oct 04 20:51:28.480284 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1874/3814] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:51:28 2022] GET /compute/v2.1/servers/e0ca65a5-b651-4473-b73f-af62bf6a6e92 => generated 1492 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:51:28.587271 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-292f6b6c-bb7d-4653-8288-5ff4981a6a79 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:28.588968 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-292f6b6c-bb7d-4653-8288-5ff4981a6a79 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] [instance: f8ba4e66-2997-4822-9c01-c570f5ae6e87] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:51:28.605742 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-292f6b6c-bb7d-4653-8288-5ff4981a6a79 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:28.606946 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-292f6b6c-bb7d-4653-8288-5ff4981a6a79 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:28.609565 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-292f6b6c-bb7d-4653-8288-5ff4981a6a79 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:28.610625 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-292f6b6c-bb7d-4653-8288-5ff4981a6a79 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:28.612370 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-292f6b6c-bb7d-4653-8288-5ff4981a6a79 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:28.614422 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-292f6b6c-bb7d-4653-8288-5ff4981a6a79 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:28.939764 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5ad857dd-e153-40e3-8c5d-e04f86bf5b7f tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:28.940791 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-5ad857dd-e153-40e3-8c5d-e04f86bf5b7f tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: a0273e6e-eb85-4204-9bec-3707ad6612af] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:51:28.952249 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5ad857dd-e153-40e3-8c5d-e04f86bf5b7f tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:28.953367 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5ad857dd-e153-40e3-8c5d-e04f86bf5b7f tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:28.954174 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5ad857dd-e153-40e3-8c5d-e04f86bf5b7f tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:28.955159 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5ad857dd-e153-40e3-8c5d-e04f86bf5b7f tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:28.955845 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5ad857dd-e153-40e3-8c5d-e04f86bf5b7f tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:28.956710 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5ad857dd-e153-40e3-8c5d-e04f86bf5b7f tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:28.984331 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-292f6b6c-bb7d-4653-8288-5ff4981a6a79 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b78af5c0485b4343900269160ef3e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659f3d4023b347d58bc0361db9ceead9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:29.000472 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-292f6b6c-bb7d-4653-8288-5ff4981a6a79 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b78af5c0485b4343900269160ef3e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659f3d4023b347d58bc0361db9ceead9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:29.005200 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-292f6b6c-bb7d-4653-8288-5ff4981a6a79 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b78af5c0485b4343900269160ef3e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659f3d4023b347d58bc0361db9ceead9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:29.008709 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-292f6b6c-bb7d-4653-8288-5ff4981a6a79 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] 10.222.0.33 "GET /compute/v2.1/servers/f8ba4e66-2997-4822-9c01-c570f5ae6e87" status: 200 len: 1875 microversion: 2.42 time: 0.432827 Oct 04 20:51:29.010960 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1941/3815] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:51:28 2022] GET /compute/v2.1/servers/f8ba4e66-2997-4822-9c01-c570f5ae6e87 => generated 1875 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:51:29.196160 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-5ad857dd-e153-40e3-8c5d-e04f86bf5b7f tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac650232cc04810b1340dc2f0edadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b0670d1bd99424780a70e69d57a2166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:29.206325 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5ad857dd-e153-40e3-8c5d-e04f86bf5b7f tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "GET /compute/v2.1/servers/a0273e6e-eb85-4204-9bec-3707ad6612af" status: 200 len: 1314 microversion: 2.1 time: 0.272211 Oct 04 20:51:29.210468 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1875/3816] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:51:28 2022] GET /compute/v2.1/servers/a0273e6e-eb85-4204-9bec-3707ad6612af => generated 1314 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:51:29.210642 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-0050c548-e461-44dd-82cd-52c860e92bbd tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:29.211040 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-0050c548-e461-44dd-82cd-52c860e92bbd tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] [instance: f15ae3c9-8342-4ae9-b81e-2d7b1aecb2e8] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:51:29.226277 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0050c548-e461-44dd-82cd-52c860e92bbd tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:29.227026 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0050c548-e461-44dd-82cd-52c860e92bbd tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:29.227459 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0050c548-e461-44dd-82cd-52c860e92bbd tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:29.228150 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0050c548-e461-44dd-82cd-52c860e92bbd tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:29.228771 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0050c548-e461-44dd-82cd-52c860e92bbd tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:29.229363 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0050c548-e461-44dd-82cd-52c860e92bbd tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:29.391256 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-0050c548-e461-44dd-82cd-52c860e92bbd tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc4171c0ee14ebb8b5eff5e910ccf49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003eb03a265a496d8981e45c74b014f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:29.400695 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-0050c548-e461-44dd-82cd-52c860e92bbd tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] 10.222.0.33 "GET /compute/v2.1/servers/f15ae3c9-8342-4ae9-b81e-2d7b1aecb2e8" status: 200 len: 1503 microversion: 2.1 time: 0.193968 Oct 04 20:51:29.401637 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1942/3817] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:51:29 2022] GET /compute/v2.1/servers/f15ae3c9-8342-4ae9-b81e-2d7b1aecb2e8 => generated 1503 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:51:29.428066 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-99b5d7c4-31ba-4177-9d74-799d789b0c0b tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:29.428683 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-99b5d7c4-31ba-4177-9d74-799d789b0c0b tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] [instance: 1ed60bf8-87e6-4a70-be59-830bee5f8b6d] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:51:29.435351 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-99b5d7c4-31ba-4177-9d74-799d789b0c0b tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:29.436345 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-99b5d7c4-31ba-4177-9d74-799d789b0c0b tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:29.436778 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-99b5d7c4-31ba-4177-9d74-799d789b0c0b tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:29.437813 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-99b5d7c4-31ba-4177-9d74-799d789b0c0b tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:29.437945 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-99b5d7c4-31ba-4177-9d74-799d789b0c0b tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:29.438433 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-99b5d7c4-31ba-4177-9d74-799d789b0c0b tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:29.503626 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-8aa51d17-1682-4f53-8637-4ac6045d1f27 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:29.504953 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-8aa51d17-1682-4f53-8637-4ac6045d1f27 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] [instance: e0ca65a5-b651-4473-b73f-af62bf6a6e92] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:51:29.525371 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8aa51d17-1682-4f53-8637-4ac6045d1f27 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:29.526256 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8aa51d17-1682-4f53-8637-4ac6045d1f27 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:29.526977 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8aa51d17-1682-4f53-8637-4ac6045d1f27 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:29.527946 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8aa51d17-1682-4f53-8637-4ac6045d1f27 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:29.528767 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8aa51d17-1682-4f53-8637-4ac6045d1f27 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:29.530001 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8aa51d17-1682-4f53-8637-4ac6045d1f27 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:29.867421 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-99b5d7c4-31ba-4177-9d74-799d789b0c0b tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc4171c0ee14ebb8b5eff5e910ccf49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003eb03a265a496d8981e45c74b014f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:29.879096 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-99b5d7c4-31ba-4177-9d74-799d789b0c0b tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] 10.222.0.33 "GET /compute/v2.1/servers/1ed60bf8-87e6-4a70-be59-830bee5f8b6d" status: 200 len: 1516 microversion: 2.1 time: 0.456544 Oct 04 20:51:29.879696 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1876/3818] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:51:29 2022] GET /compute/v2.1/servers/1ed60bf8-87e6-4a70-be59-830bee5f8b6d => generated 1516 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:51:29.906979 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a090fc0d-cb1c-4997-aa8b-1f7fb4d0e5c8 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:51:29.910054 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a090fc0d-cb1c-4997-aa8b-1f7fb4d0e5c8 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] [instance: a0d27fef-322f-45b6-8088-d0284b6f6ca7] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:51:29.928465 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-a090fc0d-cb1c-4997-aa8b-1f7fb4d0e5c8 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] HTTP exception thrown: Instance a0d27fef-322f-45b6-8088-d0284b6f6ca7 could not be found. Oct 04 20:51:29.937217 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a090fc0d-cb1c-4997-aa8b-1f7fb4d0e5c8 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Request method failure captured: Oct 04 20:51:29.937217 n-d-854823-8 devstack@n-api.service[128801]: request: POST /compute/v2.1/servers/a0d27fef-322f-45b6-8088-d0284b6f6ca7/action HTTP/1.1 Oct 04 20:51:29.937217 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:51:29.937217 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:51:29.937217 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:51:29.937217 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 14 Oct 04 20:51:29.937217 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:51:29.937217 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:51:29.937217 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:51:29.937217 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:51:29.937217 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJyQzA2j2TP516GvcpxgrBfRY2YO9l5F5hDF6OrxoVmO38Ubui7rW9ilb7hzquPDxl35ZSulQSvQlms9Io4ULkRGXw-K9Mq_8wy4teEQxOMGhx3owN2R9ZyECEeAocP_VsKpWXZTRpHKvfvEO-wS1AA94MTw8YrFoFgm4uO6w6GPzhQ Oct 04 20:51:29.937217 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:51:29.937217 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:51:29.937217 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:51:29.937217 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:51:29.937217 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:51:29.937217 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:51:29.937217 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: 003eb03a265a496d8981e45c74b014f3 Oct 04 20:51:29.937217 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2028044299 Oct 04 20:51:29.937217 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 20:51:29.937217 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 20:51:29.937217 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_003eb03a265a496d8981e45c74b014f3", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/003eb03a265a496d8981e45c74b014f3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/003eb03a265a496d8981e45c74b014f3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/003eb03a265a496d8981e45c74b014f3"}]}] Oct 04 20:51:29.937217 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2028044299 Oct 04 20:51:29.937217 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: 003eb03a265a496d8981e45c74b014f3 Oct 04 20:51:29.937217 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2028044299 Oct 04 20:51:29.937217 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-ServerRescueNegativeTestJSON-2028044299-project Oct 04 20:51:29.937217 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:51:29.937217 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:51:29.937217 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: 4dc4171c0ee14ebb8b5eff5e910ccf49 Oct 04 20:51:29.937217 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2028044299-project Oct 04 20:51:29.937217 n-d-854823-8 devstack@n-api.service[128801]: Oct 04 20:51:29.937217 n-d-854823-8 devstack@n-api.service[128801]: {"rescue": {}} Oct 04 20:51:29.937217 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 20:51:29.937217 n-d-854823-8 devstack@n-api.service[128801]: exception: Instance a0d27fef-322f-45b6-8088-d0284b6f6ca7 could not be found. Oct 04 20:51:29.937217 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': 'a0d27fef-322f-45b6-8088-d0284b6f6ca7', 'body': {'rescue': {}}} Oct 04 20:51:29.937217 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:51:29.937217 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:51:29.937217 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:51:29.937217 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:51:29.937217 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:51:29.937217 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:51:29.937217 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 20:51:29.937217 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 20:51:29.937217 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0d27fef-322f-45b6-8088-d0284b6f6ca7 could not be found. Oct 04 20:51:29.937217 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:51:29.937217 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:51:29.937217 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:51:29.937217 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:51:29.937217 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:51:29.937217 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:51:29.937217 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:51:29.937217 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:51:29.937217 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:51:29.937217 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:51:29.937217 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:51:29.937217 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:51:29.937217 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 53, in _rescue Oct 04 20:51:29.937217 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 04 20:51:29.937217 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:51:29.937217 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:51:29.937217 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0d27fef-322f-45b6-8088-d0284b6f6ca7 could not be found. Oct 04 20:51:29.937217 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:51:29.937217 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:51:29.937217 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:51:29.937217 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:51:29.943404 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:51:29.943404 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:51:29.943404 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:51:29.943404 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:51:29.943404 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0d27fef-322f-45b6-8088-d0284b6f6ca7 could not be found. Oct 04 20:51:29.943404 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:51:29.946286 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a090fc0d-cb1c-4997-aa8b-1f7fb4d0e5c8 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Returning 404 to user: Instance a0d27fef-322f-45b6-8088-d0284b6f6ca7 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:51:29.947423 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a090fc0d-cb1c-4997-aa8b-1f7fb4d0e5c8 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] 10.222.0.33 "POST /compute/v2.1/servers/a0d27fef-322f-45b6-8088-d0284b6f6ca7/action" status: 404 len: 111 microversion: 2.1 time: 0.045131 Oct 04 20:51:29.948577 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1877/3819] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 20:51:29 2022] POST /compute/v2.1/servers/a0d27fef-322f-45b6-8088-d0284b6f6ca7/action => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:51:29.958515 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-455f42ee-7b87-48e4-9b82-9efa3078cbe3 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:51:29.959417 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-455f42ee-7b87-48e4-9b82-9efa3078cbe3 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] [instance: 1ed60bf8-87e6-4a70-be59-830bee5f8b6d] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:51:29.968142 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-455f42ee-7b87-48e4-9b82-9efa3078cbe3 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:29.968975 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-455f42ee-7b87-48e4-9b82-9efa3078cbe3 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:29.969803 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-455f42ee-7b87-48e4-9b82-9efa3078cbe3 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:29.971021 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-455f42ee-7b87-48e4-9b82-9efa3078cbe3 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:29.971727 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-455f42ee-7b87-48e4-9b82-9efa3078cbe3 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:29.972386 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-455f42ee-7b87-48e4-9b82-9efa3078cbe3 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:30.032872 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-8aa51d17-1682-4f53-8637-4ac6045d1f27 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c208ec9faf491385a9ab5b5932098d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ae4960393c464c97669731c2084d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:30.055939 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-8aa51d17-1682-4f53-8637-4ac6045d1f27 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] 10.222.0.33 "GET /compute/v2.1/servers/e0ca65a5-b651-4473-b73f-af62bf6a6e92" status: 200 len: 1492 microversion: 2.1 time: 0.556495 Oct 04 20:51:30.060003 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1943/3820] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:51:29 2022] GET /compute/v2.1/servers/e0ca65a5-b651-4473-b73f-af62bf6a6e92 => generated 1492 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:51:30.084658 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-455f42ee-7b87-48e4-9b82-9efa3078cbe3 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] 10.222.0.33 "POST /compute/v2.1/servers/1ed60bf8-87e6-4a70-be59-830bee5f8b6d/action" status: 202 len: 0 microversion: 2.1 time: 0.129586 Oct 04 20:51:30.086444 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1878/3821] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 20:51:29 2022] POST /compute/v2.1/servers/1ed60bf8-87e6-4a70-be59-830bee5f8b6d/action => generated 0 bytes in 133 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:51:30.086740 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-72ec8caf-a30c-46da-a859-2368111a461d tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:30.088463 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-72ec8caf-a30c-46da-a859-2368111a461d tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] [instance: f8ba4e66-2997-4822-9c01-c570f5ae6e87] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:51:30.097277 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-36b49d91-4607-4fcf-a0f5-fe875fe782ad tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:30.099023 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-36b49d91-4607-4fcf-a0f5-fe875fe782ad tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] [instance: 1ed60bf8-87e6-4a70-be59-830bee5f8b6d] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:51:30.104317 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:51:30.110783 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-36b49d91-4607-4fcf-a0f5-fe875fe782ad tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:30.111718 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-72ec8caf-a30c-46da-a859-2368111a461d tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:30.111952 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-36b49d91-4607-4fcf-a0f5-fe875fe782ad tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:30.112881 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-36b49d91-4607-4fcf-a0f5-fe875fe782ad tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:30.114398 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-36b49d91-4607-4fcf-a0f5-fe875fe782ad tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:30.114567 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-72ec8caf-a30c-46da-a859-2368111a461d tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:30.115364 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-36b49d91-4607-4fcf-a0f5-fe875fe782ad tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:30.115892 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-36b49d91-4607-4fcf-a0f5-fe875fe782ad tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:30.116100 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-72ec8caf-a30c-46da-a859-2368111a461d tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:30.129874 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-72ec8caf-a30c-46da-a859-2368111a461d tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:30.132955 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-72ec8caf-a30c-46da-a859-2368111a461d tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:30.136618 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-72ec8caf-a30c-46da-a859-2368111a461d tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:30.784118 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-36b49d91-4607-4fcf-a0f5-fe875fe782ad tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc4171c0ee14ebb8b5eff5e910ccf49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003eb03a265a496d8981e45c74b014f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:30.792432 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-36b49d91-4607-4fcf-a0f5-fe875fe782ad tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] 10.222.0.33 "GET /compute/v2.1/servers/1ed60bf8-87e6-4a70-be59-830bee5f8b6d" status: 200 len: 1521 microversion: 2.1 time: 0.701211 Oct 04 20:51:30.803524 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1879/3822] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:51:30 2022] GET /compute/v2.1/servers/1ed60bf8-87e6-4a70-be59-830bee5f8b6d => generated 1521 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:51:30.810866 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-124aadf9-c9f8-45a5-9980-89ec1a72d402 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:30.811759 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-124aadf9-c9f8-45a5-9980-89ec1a72d402 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: a0273e6e-eb85-4204-9bec-3707ad6612af] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:51:30.819528 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-72ec8caf-a30c-46da-a859-2368111a461d tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b78af5c0485b4343900269160ef3e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659f3d4023b347d58bc0361db9ceead9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:30.844625 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-124aadf9-c9f8-45a5-9980-89ec1a72d402 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:30.845137 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-124aadf9-c9f8-45a5-9980-89ec1a72d402 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:30.845582 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-124aadf9-c9f8-45a5-9980-89ec1a72d402 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:30.846297 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-124aadf9-c9f8-45a5-9980-89ec1a72d402 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:30.846778 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-124aadf9-c9f8-45a5-9980-89ec1a72d402 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:30.852580 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-124aadf9-c9f8-45a5-9980-89ec1a72d402 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:30.856366 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-72ec8caf-a30c-46da-a859-2368111a461d tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b78af5c0485b4343900269160ef3e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659f3d4023b347d58bc0361db9ceead9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:30.864899 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-72ec8caf-a30c-46da-a859-2368111a461d tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b78af5c0485b4343900269160ef3e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659f3d4023b347d58bc0361db9ceead9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:30.871194 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-72ec8caf-a30c-46da-a859-2368111a461d tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] 10.222.0.33 "GET /compute/v2.1/servers/f8ba4e66-2997-4822-9c01-c570f5ae6e87" status: 200 len: 1875 microversion: 2.42 time: 0.806412 Oct 04 20:51:30.871950 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1944/3823] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:51:30 2022] GET /compute/v2.1/servers/f8ba4e66-2997-4822-9c01-c570f5ae6e87 => generated 1875 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:51:30.877688 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-83b4471f-94bd-4951-a42e-d106405420d0 req-bd3a2466-9c68-43d2-bf30-a98e6fd59249 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0273e6e-eb85-4204-9bec-3707ad6612af", "name": "network-vif-plugged", "status": "completed", "tag": "b9c967b1-2617-432a-a85b-6d5bdf32c3a6"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:51:30.914456 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-83b4471f-94bd-4951-a42e-d106405420d0 req-bd3a2466-9c68-43d2-bf30-a98e6fd59249 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:30.916989 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-83b4471f-94bd-4951-a42e-d106405420d0 req-bd3a2466-9c68-43d2-bf30-a98e6fd59249 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:30.922074 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-83b4471f-94bd-4951-a42e-d106405420d0 req-bd3a2466-9c68-43d2-bf30-a98e6fd59249 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:30.945413 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-83b4471f-94bd-4951-a42e-d106405420d0 req-bd3a2466-9c68-43d2-bf30-a98e6fd59249 service nova] Creating event network-vif-plugged:b9c967b1-2617-432a-a85b-6d5bdf32c3a6 for instance a0273e6e-eb85-4204-9bec-3707ad6612af on n-h2-854823-8 Oct 04 20:51:30.967348 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-83b4471f-94bd-4951-a42e-d106405420d0 req-bd3a2466-9c68-43d2-bf30-a98e6fd59249 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092285 Oct 04 20:51:30.970791 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1945/3824] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:51:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:51:31.093775 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-4337b7bc-2ef2-4ded-a1b1-7e1c7c9c8a5e tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:31.094748 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-4337b7bc-2ef2-4ded-a1b1-7e1c7c9c8a5e tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] [instance: e0ca65a5-b651-4473-b73f-af62bf6a6e92] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:51:31.109546 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4337b7bc-2ef2-4ded-a1b1-7e1c7c9c8a5e tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:31.112495 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4337b7bc-2ef2-4ded-a1b1-7e1c7c9c8a5e tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:31.113542 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4337b7bc-2ef2-4ded-a1b1-7e1c7c9c8a5e tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:31.114369 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4337b7bc-2ef2-4ded-a1b1-7e1c7c9c8a5e tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:31.114839 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4337b7bc-2ef2-4ded-a1b1-7e1c7c9c8a5e tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:31.115339 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4337b7bc-2ef2-4ded-a1b1-7e1c7c9c8a5e tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:31.583536 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-124aadf9-c9f8-45a5-9980-89ec1a72d402 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac650232cc04810b1340dc2f0edadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b0670d1bd99424780a70e69d57a2166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:31.591859 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-124aadf9-c9f8-45a5-9980-89ec1a72d402 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "GET /compute/v2.1/servers/a0273e6e-eb85-4204-9bec-3707ad6612af" status: 200 len: 1314 microversion: 2.1 time: 0.786490 Oct 04 20:51:31.609024 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1880/3825] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:51:30 2022] GET /compute/v2.1/servers/a0273e6e-eb85-4204-9bec-3707ad6612af => generated 1314 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:51:31.673978 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-4337b7bc-2ef2-4ded-a1b1-7e1c7c9c8a5e tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c208ec9faf491385a9ab5b5932098d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ae4960393c464c97669731c2084d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:31.688618 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-4337b7bc-2ef2-4ded-a1b1-7e1c7c9c8a5e tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] 10.222.0.33 "GET /compute/v2.1/servers/e0ca65a5-b651-4473-b73f-af62bf6a6e92" status: 200 len: 1492 microversion: 2.1 time: 0.603315 Oct 04 20:51:31.706475 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1946/3826] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:51:31 2022] GET /compute/v2.1/servers/e0ca65a5-b651-4473-b73f-af62bf6a6e92 => generated 1492 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:51:31.836649 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-25fc3803-1b19-499e-8e07-bbf985124568 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:31.837753 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-25fc3803-1b19-499e-8e07-bbf985124568 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] [instance: 1ed60bf8-87e6-4a70-be59-830bee5f8b6d] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:51:31.846657 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-25fc3803-1b19-499e-8e07-bbf985124568 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:31.847469 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-25fc3803-1b19-499e-8e07-bbf985124568 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:31.848142 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-25fc3803-1b19-499e-8e07-bbf985124568 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:31.850201 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-25fc3803-1b19-499e-8e07-bbf985124568 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:31.851102 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-25fc3803-1b19-499e-8e07-bbf985124568 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:31.852005 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-25fc3803-1b19-499e-8e07-bbf985124568 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:31.877163 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-d8da5077-46f3-43fc-bb3b-32e152e6a9d7 req-b5784d7b-1b68-42aa-b478-6fb80880ed9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0ca65a5-b651-4473-b73f-af62bf6a6e92", "name": "network-vif-deleted", "tag": "3d12d7bd-c1dd-4c3f-a172-0bcbeab0de21"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:51:31.896899 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-d8da5077-46f3-43fc-bb3b-32e152e6a9d7 req-b5784d7b-1b68-42aa-b478-6fb80880ed9d service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:31.897716 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-d8da5077-46f3-43fc-bb3b-32e152e6a9d7 req-b5784d7b-1b68-42aa-b478-6fb80880ed9d service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:31.898424 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-d8da5077-46f3-43fc-bb3b-32e152e6a9d7 req-b5784d7b-1b68-42aa-b478-6fb80880ed9d service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:31.921735 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-d8da5077-46f3-43fc-bb3b-32e152e6a9d7 req-b5784d7b-1b68-42aa-b478-6fb80880ed9d service nova] Creating event network-vif-deleted:3d12d7bd-c1dd-4c3f-a172-0bcbeab0de21 for instance e0ca65a5-b651-4473-b73f-af62bf6a6e92 on n-h2-854823-8 Oct 04 20:51:31.935936 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-d8da5077-46f3-43fc-bb3b-32e152e6a9d7 req-b5784d7b-1b68-42aa-b478-6fb80880ed9d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063288 Oct 04 20:51:31.936552 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1947/3827] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:51:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 20:51:31.964078 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-a18af317-856c-4ef9-a2d0-6d9c11cae5a1 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:31.964774 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-a18af317-856c-4ef9-a2d0-6d9c11cae5a1 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] [instance: f8ba4e66-2997-4822-9c01-c570f5ae6e87] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:51:31.972350 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a18af317-856c-4ef9-a2d0-6d9c11cae5a1 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:31.972903 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a18af317-856c-4ef9-a2d0-6d9c11cae5a1 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:31.973292 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a18af317-856c-4ef9-a2d0-6d9c11cae5a1 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:31.974019 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a18af317-856c-4ef9-a2d0-6d9c11cae5a1 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:31.974516 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a18af317-856c-4ef9-a2d0-6d9c11cae5a1 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:31.974950 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a18af317-856c-4ef9-a2d0-6d9c11cae5a1 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:32.410523 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-25fc3803-1b19-499e-8e07-bbf985124568 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc4171c0ee14ebb8b5eff5e910ccf49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003eb03a265a496d8981e45c74b014f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:32.445722 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-25fc3803-1b19-499e-8e07-bbf985124568 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] 10.222.0.33 "GET /compute/v2.1/servers/1ed60bf8-87e6-4a70-be59-830bee5f8b6d" status: 200 len: 1501 microversion: 2.1 time: 0.625301 Oct 04 20:51:32.450315 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1881/3828] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:51:31 2022] GET /compute/v2.1/servers/1ed60bf8-87e6-4a70-be59-830bee5f8b6d => generated 1501 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:51:32.476347 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-a18af317-856c-4ef9-a2d0-6d9c11cae5a1 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b78af5c0485b4343900269160ef3e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659f3d4023b347d58bc0361db9ceead9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:32.479620 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-62677e5c-a9d0-430f-a886-a6191d555d73 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:51:32.484885 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-62677e5c-a9d0-430f-a886-a6191d555d73 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] [instance: 1ed60bf8-87e6-4a70-be59-830bee5f8b6d] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:51:32.494538 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-a18af317-856c-4ef9-a2d0-6d9c11cae5a1 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b78af5c0485b4343900269160ef3e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659f3d4023b347d58bc0361db9ceead9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:32.498987 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-a18af317-856c-4ef9-a2d0-6d9c11cae5a1 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b78af5c0485b4343900269160ef3e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659f3d4023b347d58bc0361db9ceead9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:32.501085 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-a18af317-856c-4ef9-a2d0-6d9c11cae5a1 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] 10.222.0.33 "GET /compute/v2.1/servers/f8ba4e66-2997-4822-9c01-c570f5ae6e87" status: 200 len: 1875 microversion: 2.42 time: 0.561816 Oct 04 20:51:32.505587 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1948/3829] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:51:31 2022] GET /compute/v2.1/servers/f8ba4e66-2997-4822-9c01-c570f5ae6e87 => generated 1875 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:51:32.519690 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-62677e5c-a9d0-430f-a886-a6191d555d73 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:32.522901 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-62677e5c-a9d0-430f-a886-a6191d555d73 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:32.524547 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-62677e5c-a9d0-430f-a886-a6191d555d73 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:32.528244 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-62677e5c-a9d0-430f-a886-a6191d555d73 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:32.531090 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-62677e5c-a9d0-430f-a886-a6191d555d73 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:32.539076 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-62677e5c-a9d0-430f-a886-a6191d555d73 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:32.557073 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:51:32.616410 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-bd7339f8-e02b-46d3-b41d-2e16ae83f12d tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:32.617027 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-bd7339f8-e02b-46d3-b41d-2e16ae83f12d tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: a0273e6e-eb85-4204-9bec-3707ad6612af] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:51:32.632665 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bd7339f8-e02b-46d3-b41d-2e16ae83f12d tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:32.633250 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bd7339f8-e02b-46d3-b41d-2e16ae83f12d tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:32.633752 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bd7339f8-e02b-46d3-b41d-2e16ae83f12d tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:32.634517 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bd7339f8-e02b-46d3-b41d-2e16ae83f12d tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:32.649740 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bd7339f8-e02b-46d3-b41d-2e16ae83f12d tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:32.658222 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bd7339f8-e02b-46d3-b41d-2e16ae83f12d tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:32.665544 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-62677e5c-a9d0-430f-a886-a6191d555d73 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lazy-loading 'flavor' on Instance uuid 1ed60bf8-87e6-4a70-be59-830bee5f8b6d {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:51:32.734943 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-62677e5c-a9d0-430f-a886-a6191d555d73 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] HTTP exception thrown: Cannot 'rescue' instance 1ed60bf8-87e6-4a70-be59-830bee5f8b6d while it is in vm_state paused Oct 04 20:51:32.737540 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-62677e5c-a9d0-430f-a886-a6191d555d73 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Request method failure captured: Oct 04 20:51:32.737540 n-d-854823-8 devstack@n-api.service[128801]: request: POST /compute/v2.1/servers/1ed60bf8-87e6-4a70-be59-830bee5f8b6d/action HTTP/1.1 Oct 04 20:51:32.737540 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:51:32.737540 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:51:32.737540 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:51:32.737540 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 14 Oct 04 20:51:32.737540 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:51:32.737540 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:51:32.737540 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:51:32.737540 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:51:32.737540 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJyQzA2j2TP516GvcpxgrBfRY2YO9l5F5hDF6OrxoVmO38Ubui7rW9ilb7hzquPDxl35ZSulQSvQlms9Io4ULkRGXw-K9Mq_8wy4teEQxOMGhx3owN2R9ZyECEeAocP_VsKpWXZTRpHKvfvEO-wS1AA94MTw8YrFoFgm4uO6w6GPzhQ Oct 04 20:51:32.737540 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:51:32.737540 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:51:32.737540 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:51:32.737540 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:51:32.737540 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:51:32.737540 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:51:32.737540 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: 003eb03a265a496d8981e45c74b014f3 Oct 04 20:51:32.737540 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2028044299 Oct 04 20:51:32.737540 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 20:51:32.737540 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 20:51:32.737540 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_003eb03a265a496d8981e45c74b014f3", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/003eb03a265a496d8981e45c74b014f3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/003eb03a265a496d8981e45c74b014f3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/003eb03a265a496d8981e45c74b014f3"}]}] Oct 04 20:51:32.737540 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2028044299 Oct 04 20:51:32.737540 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: 003eb03a265a496d8981e45c74b014f3 Oct 04 20:51:32.737540 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2028044299 Oct 04 20:51:32.737540 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-ServerRescueNegativeTestJSON-2028044299-project Oct 04 20:51:32.737540 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:51:32.737540 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:51:32.737540 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: 4dc4171c0ee14ebb8b5eff5e910ccf49 Oct 04 20:51:32.737540 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2028044299-project Oct 04 20:51:32.737540 n-d-854823-8 devstack@n-api.service[128801]: Oct 04 20:51:32.737540 n-d-854823-8 devstack@n-api.service[128801]: {"rescue": {}} Oct 04 20:51:32.737540 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 20:51:32.737540 n-d-854823-8 devstack@n-api.service[128801]: exception: Cannot 'rescue' instance 1ed60bf8-87e6-4a70-be59-830bee5f8b6d while it is in vm_state paused Oct 04 20:51:32.737540 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': '1ed60bf8-87e6-4a70-be59-830bee5f8b6d', 'body': {'rescue': {}}} Oct 04 20:51:32.737540 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:51:32.737540 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:51:32.737540 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 62, in _rescue Oct 04 20:51:32.737540 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self.compute_api.rescue(context, instance, Oct 04 20:51:32.737540 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 04 20:51:32.737540 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 04 20:51:32.737540 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 20:51:32.737540 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 20:51:32.737540 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 04 20:51:32.737540 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 04 20:51:32.737540 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 1ed60bf8-87e6-4a70-be59-830bee5f8b6d in vm_state paused. Cannot rescue while the instance is in this state. Oct 04 20:51:32.737540 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:51:32.737540 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:51:32.737540 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:51:32.737540 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:51:32.737540 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:51:32.737540 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:51:32.737540 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:51:32.737540 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:51:32.737540 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:51:32.737540 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:51:32.737540 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:51:32.737540 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:51:32.737540 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 72, in _rescue Oct 04 20:51:32.737540 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Oct 04 20:51:32.737540 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 04 20:51:32.737540 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 04 20:51:32.737540 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rescue' instance 1ed60bf8-87e6-4a70-be59-830bee5f8b6d while it is in vm_state paused Oct 04 20:51:32.737540 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:51:32.743979 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:51:32.743979 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:51:32.743979 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:51:32.743979 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:51:32.743979 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:51:32.743979 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:51:32.743979 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:51:32.743979 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rescue' instance 1ed60bf8-87e6-4a70-be59-830bee5f8b6d while it is in vm_state paused Oct 04 20:51:32.743979 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:51:32.750780 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-62677e5c-a9d0-430f-a886-a6191d555d73 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Returning 409 to user: Cannot 'rescue' instance 1ed60bf8-87e6-4a70-be59-830bee5f8b6d while it is in vm_state paused {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:51:32.750780 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-62677e5c-a9d0-430f-a886-a6191d555d73 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] 10.222.0.33 "POST /compute/v2.1/servers/1ed60bf8-87e6-4a70-be59-830bee5f8b6d/action" status: 409 len: 144 microversion: 2.1 time: 0.273310 Oct 04 20:51:32.750780 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1882/3830] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 20:51:32 2022] POST /compute/v2.1/servers/1ed60bf8-87e6-4a70-be59-830bee5f8b6d/action => generated 144 bytes in 275 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 04 20:51:32.754763 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6e9c77a8-d5ea-4e2b-9722-9fe4de007724 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:32.755624 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-6e9c77a8-d5ea-4e2b-9722-9fe4de007724 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] [instance: e0ca65a5-b651-4473-b73f-af62bf6a6e92] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:51:32.780920 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6e9c77a8-d5ea-4e2b-9722-9fe4de007724 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:32.781737 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6e9c77a8-d5ea-4e2b-9722-9fe4de007724 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:32.782443 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6e9c77a8-d5ea-4e2b-9722-9fe4de007724 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:32.784627 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6e9c77a8-d5ea-4e2b-9722-9fe4de007724 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:32.785310 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6e9c77a8-d5ea-4e2b-9722-9fe4de007724 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:32.786892 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6e9c77a8-d5ea-4e2b-9722-9fe4de007724 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:32.835179 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6e9c77a8-d5ea-4e2b-9722-9fe4de007724 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:32.835680 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6e9c77a8-d5ea-4e2b-9722-9fe4de007724 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:32.836120 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6e9c77a8-d5ea-4e2b-9722-9fe4de007724 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:32.836771 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-6e9c77a8-d5ea-4e2b-9722-9fe4de007724 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lazy-loading 'fault' on Instance uuid e0ca65a5-b651-4473-b73f-af62bf6a6e92 {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:51:32.919622 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-6e9c77a8-d5ea-4e2b-9722-9fe4de007724 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c208ec9faf491385a9ab5b5932098d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ae4960393c464c97669731c2084d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:32.928814 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-6e9c77a8-d5ea-4e2b-9722-9fe4de007724 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] 10.222.0.33 "GET /compute/v2.1/servers/e0ca65a5-b651-4473-b73f-af62bf6a6e92" status: 200 len: 1305 microversion: 2.1 time: 0.178672 Oct 04 20:51:32.929793 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1883/3831] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:51:32 2022] GET /compute/v2.1/servers/e0ca65a5-b651-4473-b73f-af62bf6a6e92 => generated 1305 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:51:32.937710 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e1059990-63b7-487d-afed-c21ec4e443cb tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:51:32.938710 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e1059990-63b7-487d-afed-c21ec4e443cb tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] [instance: 1ed60bf8-87e6-4a70-be59-830bee5f8b6d] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:51:32.948098 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e1059990-63b7-487d-afed-c21ec4e443cb tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:32.948815 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e1059990-63b7-487d-afed-c21ec4e443cb tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:32.949488 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e1059990-63b7-487d-afed-c21ec4e443cb tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:32.950475 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e1059990-63b7-487d-afed-c21ec4e443cb tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:32.952071 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e1059990-63b7-487d-afed-c21ec4e443cb tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:32.952810 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e1059990-63b7-487d-afed-c21ec4e443cb tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:33.043972 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-bd7339f8-e02b-46d3-b41d-2e16ae83f12d tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac650232cc04810b1340dc2f0edadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b0670d1bd99424780a70e69d57a2166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:33.082220 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-bd7339f8-e02b-46d3-b41d-2e16ae83f12d tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "GET /compute/v2.1/servers/a0273e6e-eb85-4204-9bec-3707ad6612af" status: 200 len: 1501 microversion: 2.1 time: 0.466483 Oct 04 20:51:33.084269 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1949/3832] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:51:32 2022] GET /compute/v2.1/servers/a0273e6e-eb85-4204-9bec-3707ad6612af => generated 1501 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:51:33.105063 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e1059990-63b7-487d-afed-c21ec4e443cb tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] 10.222.0.33 "POST /compute/v2.1/servers/1ed60bf8-87e6-4a70-be59-830bee5f8b6d/action" status: 202 len: 0 microversion: 2.1 time: 0.173283 Oct 04 20:51:33.106407 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1884/3833] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 20:51:32 2022] POST /compute/v2.1/servers/1ed60bf8-87e6-4a70-be59-830bee5f8b6d/action => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:51:33.126832 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-4e9e53eb-2e32-4dcd-b8cf-7c1243d8c4f4 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:33.128131 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-4e9e53eb-2e32-4dcd-b8cf-7c1243d8c4f4 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] [instance: 1ed60bf8-87e6-4a70-be59-830bee5f8b6d] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:51:33.135038 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4e9e53eb-2e32-4dcd-b8cf-7c1243d8c4f4 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:33.135760 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4e9e53eb-2e32-4dcd-b8cf-7c1243d8c4f4 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:33.136391 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4e9e53eb-2e32-4dcd-b8cf-7c1243d8c4f4 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:33.137275 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4e9e53eb-2e32-4dcd-b8cf-7c1243d8c4f4 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:33.137894 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4e9e53eb-2e32-4dcd-b8cf-7c1243d8c4f4 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:33.139489 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4e9e53eb-2e32-4dcd-b8cf-7c1243d8c4f4 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:33.144289 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-af81a6e9-1b53-4966-a062-96927648732a tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:51:33.151074 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-af81a6e9-1b53-4966-a062-96927648732a tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: a0273e6e-eb85-4204-9bec-3707ad6612af] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:51:33.190180 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-af81a6e9-1b53-4966-a062-96927648732a tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:33.195177 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-af81a6e9-1b53-4966-a062-96927648732a tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:33.195665 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-af81a6e9-1b53-4966-a062-96927648732a tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:33.197676 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-af81a6e9-1b53-4966-a062-96927648732a tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:33.202073 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-af81a6e9-1b53-4966-a062-96927648732a tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:33.205516 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-af81a6e9-1b53-4966-a062-96927648732a tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:33.361674 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-af81a6e9-1b53-4966-a062-96927648732a tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "POST /compute/v2.1/servers/a0273e6e-eb85-4204-9bec-3707ad6612af/action" status: 202 len: 0 microversion: 2.1 time: 0.253142 Oct 04 20:51:33.363291 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1950/3834] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 20:51:33 2022] POST /compute/v2.1/servers/a0273e6e-eb85-4204-9bec-3707ad6612af/action => generated 0 bytes in 258 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:51:33.379989 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-0868f220-17d8-4274-92c9-44ccceb17ae5 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:33.381377 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-0868f220-17d8-4274-92c9-44ccceb17ae5 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: a0273e6e-eb85-4204-9bec-3707ad6612af] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:51:33.405668 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0868f220-17d8-4274-92c9-44ccceb17ae5 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:33.406831 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0868f220-17d8-4274-92c9-44ccceb17ae5 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:33.408282 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0868f220-17d8-4274-92c9-44ccceb17ae5 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:33.410577 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0868f220-17d8-4274-92c9-44ccceb17ae5 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:33.412196 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0868f220-17d8-4274-92c9-44ccceb17ae5 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:33.413613 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0868f220-17d8-4274-92c9-44ccceb17ae5 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:33.566756 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-4e9e53eb-2e32-4dcd-b8cf-7c1243d8c4f4 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc4171c0ee14ebb8b5eff5e910ccf49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003eb03a265a496d8981e45c74b014f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:33.585236 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-4e9e53eb-2e32-4dcd-b8cf-7c1243d8c4f4 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] 10.222.0.33 "GET /compute/v2.1/servers/1ed60bf8-87e6-4a70-be59-830bee5f8b6d" status: 200 len: 1508 microversion: 2.1 time: 0.473636 Oct 04 20:51:33.587118 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1885/3835] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:51:33 2022] GET /compute/v2.1/servers/1ed60bf8-87e6-4a70-be59-830bee5f8b6d => generated 1508 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:51:33.597092 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0763af18-9ed0-456e-82f3-d0d316a058c6 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:33.599316 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-0763af18-9ed0-456e-82f3-d0d316a058c6 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] [instance: f8ba4e66-2997-4822-9c01-c570f5ae6e87] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:51:33.608051 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0763af18-9ed0-456e-82f3-d0d316a058c6 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:33.609259 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0763af18-9ed0-456e-82f3-d0d316a058c6 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:33.610022 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0763af18-9ed0-456e-82f3-d0d316a058c6 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:33.611012 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0763af18-9ed0-456e-82f3-d0d316a058c6 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:33.614317 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0763af18-9ed0-456e-82f3-d0d316a058c6 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:33.615427 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0763af18-9ed0-456e-82f3-d0d316a058c6 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:34.366156 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-0868f220-17d8-4274-92c9-44ccceb17ae5 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac650232cc04810b1340dc2f0edadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b0670d1bd99424780a70e69d57a2166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:34.369770 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:51:34.382973 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-0868f220-17d8-4274-92c9-44ccceb17ae5 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "GET /compute/v2.1/servers/a0273e6e-eb85-4204-9bec-3707ad6612af" status: 200 len: 1506 microversion: 2.1 time: 1.012187 Oct 04 20:51:34.385371 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1951/3836] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:51:33 2022] GET /compute/v2.1/servers/a0273e6e-eb85-4204-9bec-3707ad6612af => generated 1506 bytes in 1019 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:51:34.393610 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-5e6972b3-4de3-4ed3-ac7a-60b18d639659 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:34.394999 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-5e6972b3-4de3-4ed3-ac7a-60b18d639659 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] [instance: e0ca65a5-b651-4473-b73f-af62bf6a6e92] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:51:34.414560 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5e6972b3-4de3-4ed3-ac7a-60b18d639659 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:34.415477 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5e6972b3-4de3-4ed3-ac7a-60b18d639659 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:34.416555 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5e6972b3-4de3-4ed3-ac7a-60b18d639659 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:34.417432 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5e6972b3-4de3-4ed3-ac7a-60b18d639659 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:34.418101 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5e6972b3-4de3-4ed3-ac7a-60b18d639659 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:34.418804 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5e6972b3-4de3-4ed3-ac7a-60b18d639659 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:34.441146 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.wsgi [None req-5e6972b3-4de3-4ed3-ac7a-60b18d639659 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] HTTP exception thrown: Instance e0ca65a5-b651-4473-b73f-af62bf6a6e92 could not be found. Oct 04 20:51:34.443026 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-5e6972b3-4de3-4ed3-ac7a-60b18d639659 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Request method failure captured: Oct 04 20:51:34.443026 n-d-854823-8 devstack@n-api.service[128802]: request: GET /compute/v2.1/servers/e0ca65a5-b651-4473-b73f-af62bf6a6e92 HTTP/1.1 Oct 04 20:51:34.443026 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 20:51:34.443026 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 20:51:34.443026 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 20:51:34.443026 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 0 Oct 04 20:51:34.443026 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 20:51:34.443026 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 20:51:34.443026 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 20:51:34.443026 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 20:51:34.443026 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPJxSZfevtBVnbE8xQF7FYm_FMbZNMYv-b1P0ldR6C6mOlBxOPHbcbefhyrqwXR1yI98_OYaoilQwhW17vvL2mv1TUMfEjVB0p9Z8xi6fxjKTzjqbSmmUYZRpw0KKdt3nuXH8mFLFoxIXJdxlVC2R9xsCLdqsVxY0fb8-x4eIUN27OLA Oct 04 20:51:34.443026 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 20:51:34.443026 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 20:51:34.443026 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 20:51:34.443026 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 20:51:34.443026 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 20:51:34.443026 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 20:51:34.443026 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: 82ae4960393c464c97669731c2084d0f Oct 04 20:51:34.443026 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-DeleteServersTestJSON-364705212 Oct 04 20:51:34.443026 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 20:51:34.443026 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 20:51:34.443026 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_82ae4960393c464c97669731c2084d0f", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/82ae4960393c464c97669731c2084d0f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/82ae4960393c464c97669731c2084d0f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/82ae4960393c464c97669731c2084d0f"}]}] Oct 04 20:51:34.443026 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-DeleteServersTestJSON-364705212 Oct 04 20:51:34.443026 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: 82ae4960393c464c97669731c2084d0f Oct 04 20:51:34.443026 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-DeleteServersTestJSON-364705212 Oct 04 20:51:34.443026 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-DeleteServersTestJSON-364705212-project Oct 04 20:51:34.443026 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 20:51:34.443026 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 20:51:34.443026 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: e2c208ec9faf491385a9ab5b5932098d Oct 04 20:51:34.443026 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-DeleteServersTestJSON-364705212-project Oct 04 20:51:34.443026 n-d-854823-8 devstack@n-api.service[128802]: method: > Oct 04 20:51:34.443026 n-d-854823-8 devstack@n-api.service[128802]: exception: Instance e0ca65a5-b651-4473-b73f-af62bf6a6e92 could not be found. Oct 04 20:51:34.443026 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'id': 'e0ca65a5-b651-4473-b73f-af62bf6a6e92'} Oct 04 20:51:34.443026 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:51:34.443026 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:51:34.443026 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:51:34.443026 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:51:34.443026 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:51:34.443026 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:51:34.443026 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:51:34.443026 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:51:34.443026 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:51:34.443026 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:51:34.443026 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e0ca65a5-b651-4473-b73f-af62bf6a6e92 could not be found. Oct 04 20:51:34.443026 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:51:34.443026 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:51:34.443026 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:51:34.443026 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:51:34.443026 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:51:34.443026 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:51:34.443026 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:51:34.443026 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:51:34.443026 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:51:34.443026 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:51:34.443026 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:51:34.443026 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:51:34.443026 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:51:34.443026 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:51:34.443026 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:51:34.443026 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:51:34.443026 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e0ca65a5-b651-4473-b73f-af62bf6a6e92 could not be found. Oct 04 20:51:34.443026 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:51:34.443026 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:51:34.443026 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:51:34.448289 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:51:34.448289 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:51:34.448289 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:51:34.448289 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:51:34.448289 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:51:34.448289 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e0ca65a5-b651-4473-b73f-af62bf6a6e92 could not be found. Oct 04 20:51:34.448289 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:51:34.450436 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-5e6972b3-4de3-4ed3-ac7a-60b18d639659 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Returning 404 to user: Instance e0ca65a5-b651-4473-b73f-af62bf6a6e92 could not be found. {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:51:34.452411 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-5e6972b3-4de3-4ed3-ac7a-60b18d639659 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] 10.222.0.33 "GET /compute/v2.1/servers/e0ca65a5-b651-4473-b73f-af62bf6a6e92" status: 404 len: 111 microversion: 2.1 time: 0.065847 Oct 04 20:51:34.453696 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1952/3837] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:51:34 2022] GET /compute/v2.1/servers/e0ca65a5-b651-4473-b73f-af62bf6a6e92 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:51:34.496071 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-0763af18-9ed0-456e-82f3-d0d316a058c6 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b78af5c0485b4343900269160ef3e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659f3d4023b347d58bc0361db9ceead9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:34.532183 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-0763af18-9ed0-456e-82f3-d0d316a058c6 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b78af5c0485b4343900269160ef3e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659f3d4023b347d58bc0361db9ceead9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:34.546080 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-0763af18-9ed0-456e-82f3-d0d316a058c6 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b78af5c0485b4343900269160ef3e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659f3d4023b347d58bc0361db9ceead9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:34.556706 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-0763af18-9ed0-456e-82f3-d0d316a058c6 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] 10.222.0.33 "GET /compute/v2.1/servers/f8ba4e66-2997-4822-9c01-c570f5ae6e87" status: 200 len: 1875 microversion: 2.42 time: 0.958845 Oct 04 20:51:34.557402 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1886/3838] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:51:33 2022] GET /compute/v2.1/servers/f8ba4e66-2997-4822-9c01-c570f5ae6e87 => generated 1875 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:51:34.612897 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-90a0a3f8-22c9-4800-a955-dc9dddbc4854 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:34.614019 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-90a0a3f8-22c9-4800-a955-dc9dddbc4854 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] [instance: 1ed60bf8-87e6-4a70-be59-830bee5f8b6d] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:51:34.626028 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-90a0a3f8-22c9-4800-a955-dc9dddbc4854 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:34.628727 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-90a0a3f8-22c9-4800-a955-dc9dddbc4854 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:34.631974 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-90a0a3f8-22c9-4800-a955-dc9dddbc4854 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:34.633915 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-90a0a3f8-22c9-4800-a955-dc9dddbc4854 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:34.635765 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-90a0a3f8-22c9-4800-a955-dc9dddbc4854 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:34.639764 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-90a0a3f8-22c9-4800-a955-dc9dddbc4854 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:34.781117 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8076bfaa-b167-4723-8a06-f05b65573b5a tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-304067237", "imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63", "flavorRef": "452", "networks": [{"uuid": "9dbf9434-4e8d-415e-bc95-1f3c19f28f1d"}]}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:51:34.916899 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.network.neutron [None req-8076bfaa-b167-4723-8a06-f05b65573b5a tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] validate_networks() for [('9dbf9434-4e8d-415e-bc95-1f3c19f28f1d', None, None, None, None, None)] {{(pid=128801) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:51:35.508045 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-90a0a3f8-22c9-4800-a955-dc9dddbc4854 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc4171c0ee14ebb8b5eff5e910ccf49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003eb03a265a496d8981e45c74b014f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:35.523519 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-90a0a3f8-22c9-4800-a955-dc9dddbc4854 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] 10.222.0.33 "GET /compute/v2.1/servers/1ed60bf8-87e6-4a70-be59-830bee5f8b6d" status: 200 len: 1516 microversion: 2.1 time: 0.916698 Oct 04 20:51:35.545183 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1953/3839] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:51:34 2022] GET /compute/v2.1/servers/1ed60bf8-87e6-4a70-be59-830bee5f8b6d => generated 1516 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:51:35.554644 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-2f7d8979-8ea6-4fae-b1ea-a1ef74b42f4c tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:35.555319 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-2f7d8979-8ea6-4fae-b1ea-a1ef74b42f4c tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: a0273e6e-eb85-4204-9bec-3707ad6612af] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:51:35.562288 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:51:35.564253 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2f7d8979-8ea6-4fae-b1ea-a1ef74b42f4c tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:35.566286 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2f7d8979-8ea6-4fae-b1ea-a1ef74b42f4c tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:35.566286 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2f7d8979-8ea6-4fae-b1ea-a1ef74b42f4c tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:35.566286 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2f7d8979-8ea6-4fae-b1ea-a1ef74b42f4c tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:35.568222 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2f7d8979-8ea6-4fae-b1ea-a1ef74b42f4c tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:35.568849 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2f7d8979-8ea6-4fae-b1ea-a1ef74b42f4c tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:35.925443 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-8076bfaa-b167-4723-8a06-f05b65573b5a tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Flavor limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:51:35.926058 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-8076bfaa-b167-4723-8a06-f05b65573b5a tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Image limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:51:35.926318 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-8076bfaa-b167-4723-8a06-f05b65573b5a tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Flavor pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:51:35.926975 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-8076bfaa-b167-4723-8a06-f05b65573b5a tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Image pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:51:35.927686 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-8076bfaa-b167-4723-8a06-f05b65573b5a tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:51:35.960320 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8076bfaa-b167-4723-8a06-f05b65573b5a tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:35.960818 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8076bfaa-b167-4723-8a06-f05b65573b5a tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:35.961261 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8076bfaa-b167-4723-8a06-f05b65573b5a tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:35.962006 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8076bfaa-b167-4723-8a06-f05b65573b5a tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:35.962527 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8076bfaa-b167-4723-8a06-f05b65573b5a tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:35.963082 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8076bfaa-b167-4723-8a06-f05b65573b5a tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:36.008637 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-8076bfaa-b167-4723-8a06-f05b65573b5a tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Getting quotas for project 82ae4960393c464c97669731c2084d0f. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:51:36.016134 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-8076bfaa-b167-4723-8a06-f05b65573b5a tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Getting quotas for user e2c208ec9faf491385a9ab5b5932098d and project 82ae4960393c464c97669731c2084d0f. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:51:36.046019 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-2f7d8979-8ea6-4fae-b1ea-a1ef74b42f4c tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac650232cc04810b1340dc2f0edadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b0670d1bd99424780a70e69d57a2166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:36.057667 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-8076bfaa-b167-4723-8a06-f05b65573b5a tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Going to run 1 instances... {{(pid=128801) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:51:36.063679 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-8076bfaa-b167-4723-8a06-f05b65573b5a tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] [instance: 30eb289d-d09c-43fa-af8a-3c6ee303f0af] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='15b24725-0c99-4bcf-b1fb-907cdf8e2d63',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128801) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:51:36.066855 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-2f7d8979-8ea6-4fae-b1ea-a1ef74b42f4c tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "GET /compute/v2.1/servers/a0273e6e-eb85-4204-9bec-3707ad6612af" status: 200 len: 1486 microversion: 2.1 time: 0.519662 Oct 04 20:51:36.073081 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1954/3840] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:51:35 2022] GET /compute/v2.1/servers/a0273e6e-eb85-4204-9bec-3707ad6612af => generated 1486 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:51:36.105070 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-9afa0dd2-471a-46b6-a519-f968c3e30af2 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:36.106024 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-9afa0dd2-471a-46b6-a519-f968c3e30af2 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] [instance: f8ba4e66-2997-4822-9c01-c570f5ae6e87] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:51:36.115974 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9afa0dd2-471a-46b6-a519-f968c3e30af2 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:36.116885 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9afa0dd2-471a-46b6-a519-f968c3e30af2 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:36.117497 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9afa0dd2-471a-46b6-a519-f968c3e30af2 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:36.118517 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9afa0dd2-471a-46b6-a519-f968c3e30af2 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:36.127097 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9afa0dd2-471a-46b6-a519-f968c3e30af2 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:36.127847 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9afa0dd2-471a-46b6-a519-f968c3e30af2 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:36.192810 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-8076bfaa-b167-4723-8a06-f05b65573b5a tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.417593 Oct 04 20:51:36.195453 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1887/3841] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 20:51:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 1421 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 20:51:36.206808 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ce49b6d8-7cfd-47a4-b0cb-b5275c608ed3 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:51:36.207846 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ce49b6d8-7cfd-47a4-b0cb-b5275c608ed3 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: a0273e6e-eb85-4204-9bec-3707ad6612af] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:51:36.214617 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ce49b6d8-7cfd-47a4-b0cb-b5275c608ed3 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:36.215620 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ce49b6d8-7cfd-47a4-b0cb-b5275c608ed3 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:36.216325 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ce49b6d8-7cfd-47a4-b0cb-b5275c608ed3 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:36.217848 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ce49b6d8-7cfd-47a4-b0cb-b5275c608ed3 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:36.218616 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ce49b6d8-7cfd-47a4-b0cb-b5275c608ed3 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:36.219743 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ce49b6d8-7cfd-47a4-b0cb-b5275c608ed3 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:36.251366 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-ce49b6d8-7cfd-47a4-b0cb-b5275c608ed3 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lazy-loading 'flavor' on Instance uuid a0273e6e-eb85-4204-9bec-3707ad6612af {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:51:36.485805 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-9afa0dd2-471a-46b6-a519-f968c3e30af2 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b78af5c0485b4343900269160ef3e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659f3d4023b347d58bc0361db9ceead9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:36.504175 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-9afa0dd2-471a-46b6-a519-f968c3e30af2 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b78af5c0485b4343900269160ef3e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659f3d4023b347d58bc0361db9ceead9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:36.506077 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-9afa0dd2-471a-46b6-a519-f968c3e30af2 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b78af5c0485b4343900269160ef3e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659f3d4023b347d58bc0361db9ceead9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:36.511083 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-9afa0dd2-471a-46b6-a519-f968c3e30af2 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] 10.222.0.33 "GET /compute/v2.1/servers/f8ba4e66-2997-4822-9c01-c570f5ae6e87" status: 200 len: 1875 microversion: 2.42 time: 0.425441 Oct 04 20:51:36.512674 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1955/3842] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:51:36 2022] GET /compute/v2.1/servers/f8ba4e66-2997-4822-9c01-c570f5ae6e87 => generated 1875 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:51:36.536025 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-db6b1b1f-647c-437c-b99e-8e80db5c0526 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:36.536973 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-db6b1b1f-647c-437c-b99e-8e80db5c0526 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] [instance: 30eb289d-d09c-43fa-af8a-3c6ee303f0af] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:51:36.746382 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-db6b1b1f-647c-437c-b99e-8e80db5c0526 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c208ec9faf491385a9ab5b5932098d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ae4960393c464c97669731c2084d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:36.757189 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ce49b6d8-7cfd-47a4-b0cb-b5275c608ed3 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "POST /compute/v2.1/servers/a0273e6e-eb85-4204-9bec-3707ad6612af/action" status: 202 len: 0 microversion: 2.1 time: 0.560440 Oct 04 20:51:36.758074 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1888/3843] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 20:51:36 2022] POST /compute/v2.1/servers/a0273e6e-eb85-4204-9bec-3707ad6612af/action => generated 0 bytes in 562 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:51:36.762409 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-db6b1b1f-647c-437c-b99e-8e80db5c0526 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] 10.222.0.33 "GET /compute/v2.1/servers/30eb289d-d09c-43fa-af8a-3c6ee303f0af" status: 200 len: 1214 microversion: 2.1 time: 0.241782 Oct 04 20:51:36.770679 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1956/3844] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:51:36 2022] GET /compute/v2.1/servers/30eb289d-d09c-43fa-af8a-3c6ee303f0af => generated 1214 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:51:36.777479 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0590c9d4-4cd2-4dbe-b8c1-a7ab489f7471 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:36.780318 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-0590c9d4-4cd2-4dbe-b8c1-a7ab489f7471 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: a0273e6e-eb85-4204-9bec-3707ad6612af] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:51:36.793294 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0590c9d4-4cd2-4dbe-b8c1-a7ab489f7471 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:36.793849 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0590c9d4-4cd2-4dbe-b8c1-a7ab489f7471 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:36.799456 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0590c9d4-4cd2-4dbe-b8c1-a7ab489f7471 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:36.804003 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0590c9d4-4cd2-4dbe-b8c1-a7ab489f7471 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:36.805336 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0590c9d4-4cd2-4dbe-b8c1-a7ab489f7471 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:36.806189 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0590c9d4-4cd2-4dbe-b8c1-a7ab489f7471 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:37.315456 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-0590c9d4-4cd2-4dbe-b8c1-a7ab489f7471 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac650232cc04810b1340dc2f0edadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b0670d1bd99424780a70e69d57a2166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:37.345545 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-0590c9d4-4cd2-4dbe-b8c1-a7ab489f7471 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "GET /compute/v2.1/servers/a0273e6e-eb85-4204-9bec-3707ad6612af" status: 200 len: 1492 microversion: 2.1 time: 0.574903 Oct 04 20:51:37.355148 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1889/3845] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:51:36 2022] GET /compute/v2.1/servers/a0273e6e-eb85-4204-9bec-3707ad6612af => generated 1492 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:51:37.546248 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-d9220c18-d179-4015-8982-8f1788588b84 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:37.551524 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-d9220c18-d179-4015-8982-8f1788588b84 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] [instance: f8ba4e66-2997-4822-9c01-c570f5ae6e87] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:51:37.565230 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d9220c18-d179-4015-8982-8f1788588b84 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:37.568132 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d9220c18-d179-4015-8982-8f1788588b84 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:37.584648 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d9220c18-d179-4015-8982-8f1788588b84 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:37.585406 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d9220c18-d179-4015-8982-8f1788588b84 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:37.585894 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d9220c18-d179-4015-8982-8f1788588b84 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:37.586391 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d9220c18-d179-4015-8982-8f1788588b84 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:37.793180 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-dac59db9-691a-429f-8385-c554056e3707 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:37.794083 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-dac59db9-691a-429f-8385-c554056e3707 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] [instance: 30eb289d-d09c-43fa-af8a-3c6ee303f0af] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:51:37.801731 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dac59db9-691a-429f-8385-c554056e3707 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:37.802480 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dac59db9-691a-429f-8385-c554056e3707 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:37.803091 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dac59db9-691a-429f-8385-c554056e3707 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:37.803968 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dac59db9-691a-429f-8385-c554056e3707 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:37.804589 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dac59db9-691a-429f-8385-c554056e3707 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:37.805186 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dac59db9-691a-429f-8385-c554056e3707 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:38.051021 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-dac59db9-691a-429f-8385-c554056e3707 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c208ec9faf491385a9ab5b5932098d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ae4960393c464c97669731c2084d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:38.077601 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-dac59db9-691a-429f-8385-c554056e3707 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] 10.222.0.33 "GET /compute/v2.1/servers/30eb289d-d09c-43fa-af8a-3c6ee303f0af" status: 200 len: 1266 microversion: 2.1 time: 0.287531 Oct 04 20:51:38.079077 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1890/3846] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:51:37 2022] GET /compute/v2.1/servers/30eb289d-d09c-43fa-af8a-3c6ee303f0af => generated 1266 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:51:38.205858 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-d9220c18-d179-4015-8982-8f1788588b84 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b78af5c0485b4343900269160ef3e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659f3d4023b347d58bc0361db9ceead9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:38.218464 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-d9220c18-d179-4015-8982-8f1788588b84 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b78af5c0485b4343900269160ef3e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659f3d4023b347d58bc0361db9ceead9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:38.219916 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-d9220c18-d179-4015-8982-8f1788588b84 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b78af5c0485b4343900269160ef3e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659f3d4023b347d58bc0361db9ceead9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:38.221245 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-d9220c18-d179-4015-8982-8f1788588b84 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] 10.222.0.33 "GET /compute/v2.1/servers/f8ba4e66-2997-4822-9c01-c570f5ae6e87" status: 200 len: 1875 microversion: 2.42 time: 0.679937 Oct 04 20:51:38.221662 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1957/3847] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:51:37 2022] GET /compute/v2.1/servers/f8ba4e66-2997-4822-9c01-c570f5ae6e87 => generated 1875 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:51:38.250676 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b3775b54-bc13-4ec3-88b5-282aff8c3f04 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:51:38.256399 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b3775b54-bc13-4ec3-88b5-282aff8c3f04 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] [instance: 1ed60bf8-87e6-4a70-be59-830bee5f8b6d] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:51:38.270740 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b3775b54-bc13-4ec3-88b5-282aff8c3f04 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:38.271429 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b3775b54-bc13-4ec3-88b5-282aff8c3f04 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:38.271885 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b3775b54-bc13-4ec3-88b5-282aff8c3f04 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:38.272806 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b3775b54-bc13-4ec3-88b5-282aff8c3f04 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:38.273432 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b3775b54-bc13-4ec3-88b5-282aff8c3f04 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:38.274477 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b3775b54-bc13-4ec3-88b5-282aff8c3f04 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:38.314720 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-b3775b54-bc13-4ec3-88b5-282aff8c3f04 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lazy-loading 'flavor' on Instance uuid 1ed60bf8-87e6-4a70-be59-830bee5f8b6d {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:51:38.380657 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-8832037d-9f3d-4096-830f-1d06f56cc11d tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:38.381449 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-8832037d-9f3d-4096-830f-1d06f56cc11d tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: a0273e6e-eb85-4204-9bec-3707ad6612af] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:51:38.391597 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8832037d-9f3d-4096-830f-1d06f56cc11d tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:38.394384 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8832037d-9f3d-4096-830f-1d06f56cc11d tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:38.394886 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8832037d-9f3d-4096-830f-1d06f56cc11d tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:38.397346 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8832037d-9f3d-4096-830f-1d06f56cc11d tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:38.399039 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8832037d-9f3d-4096-830f-1d06f56cc11d tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:38.399991 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8832037d-9f3d-4096-830f-1d06f56cc11d tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:38.500956 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b3775b54-bc13-4ec3-88b5-282aff8c3f04 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] 10.222.0.33 "POST /compute/v2.1/servers/1ed60bf8-87e6-4a70-be59-830bee5f8b6d/action" status: 200 len: 32 microversion: 2.1 time: 0.248308 Oct 04 20:51:38.500956 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1891/3848] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 20:51:38 2022] POST /compute/v2.1/servers/1ed60bf8-87e6-4a70-be59-830bee5f8b6d/action => generated 32 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 20:51:38.520375 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-642046e5-f182-4ec2-9384-6f361763a7da tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:38.523840 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-642046e5-f182-4ec2-9384-6f361763a7da tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] [instance: 1ed60bf8-87e6-4a70-be59-830bee5f8b6d] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:51:38.533519 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-642046e5-f182-4ec2-9384-6f361763a7da tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:38.548559 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-642046e5-f182-4ec2-9384-6f361763a7da tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:38.549154 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-642046e5-f182-4ec2-9384-6f361763a7da tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:38.550005 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-642046e5-f182-4ec2-9384-6f361763a7da tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:38.550599 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-642046e5-f182-4ec2-9384-6f361763a7da tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:38.551082 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-642046e5-f182-4ec2-9384-6f361763a7da tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:39.471709 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-8832037d-9f3d-4096-830f-1d06f56cc11d tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac650232cc04810b1340dc2f0edadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b0670d1bd99424780a70e69d57a2166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:39.489739 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-8832037d-9f3d-4096-830f-1d06f56cc11d tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "GET /compute/v2.1/servers/a0273e6e-eb85-4204-9bec-3707ad6612af" status: 200 len: 1513 microversion: 2.1 time: 1.113074 Oct 04 20:51:39.490910 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1958/3849] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:51:38 2022] GET /compute/v2.1/servers/a0273e6e-eb85-4204-9bec-3707ad6612af => generated 1513 bytes in 1116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:51:39.498713 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-06b6678a-1975-4c32-acab-6181360426a7 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:39.499575 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-06b6678a-1975-4c32-acab-6181360426a7 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] [instance: 30eb289d-d09c-43fa-af8a-3c6ee303f0af] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:51:39.511688 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-06b6678a-1975-4c32-acab-6181360426a7 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:39.513965 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-06b6678a-1975-4c32-acab-6181360426a7 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:39.514744 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-06b6678a-1975-4c32-acab-6181360426a7 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:39.516018 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-06b6678a-1975-4c32-acab-6181360426a7 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:39.518152 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-06b6678a-1975-4c32-acab-6181360426a7 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:39.519162 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-06b6678a-1975-4c32-acab-6181360426a7 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:39.598106 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-642046e5-f182-4ec2-9384-6f361763a7da tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc4171c0ee14ebb8b5eff5e910ccf49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003eb03a265a496d8981e45c74b014f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:39.606773 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-642046e5-f182-4ec2-9384-6f361763a7da tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] 10.222.0.33 "GET /compute/v2.1/servers/1ed60bf8-87e6-4a70-be59-830bee5f8b6d" status: 200 len: 1522 microversion: 2.1 time: 1.107713 Oct 04 20:51:39.607991 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1892/3850] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:51:38 2022] GET /compute/v2.1/servers/1ed60bf8-87e6-4a70-be59-830bee5f8b6d => generated 1522 bytes in 1110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:51:39.615393 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-09b326eb-587f-420d-a28b-8900152bd983 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:39.616502 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-09b326eb-587f-420d-a28b-8900152bd983 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] [instance: f8ba4e66-2997-4822-9c01-c570f5ae6e87] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:51:39.624070 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-09b326eb-587f-420d-a28b-8900152bd983 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:39.625093 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-09b326eb-587f-420d-a28b-8900152bd983 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:39.626450 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-09b326eb-587f-420d-a28b-8900152bd983 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:39.627484 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-09b326eb-587f-420d-a28b-8900152bd983 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:39.628191 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-09b326eb-587f-420d-a28b-8900152bd983 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:39.628840 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-09b326eb-587f-420d-a28b-8900152bd983 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:39.712710 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-06b6678a-1975-4c32-acab-6181360426a7 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c208ec9faf491385a9ab5b5932098d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ae4960393c464c97669731c2084d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:39.728889 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-06b6678a-1975-4c32-acab-6181360426a7 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] 10.222.0.33 "GET /compute/v2.1/servers/30eb289d-d09c-43fa-af8a-3c6ee303f0af" status: 200 len: 1272 microversion: 2.1 time: 0.236442 Oct 04 20:51:39.752283 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1959/3851] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:51:39 2022] GET /compute/v2.1/servers/30eb289d-d09c-43fa-af8a-3c6ee303f0af => generated 1272 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:51:40.151166 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-09b326eb-587f-420d-a28b-8900152bd983 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b78af5c0485b4343900269160ef3e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659f3d4023b347d58bc0361db9ceead9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:40.168689 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-09b326eb-587f-420d-a28b-8900152bd983 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b78af5c0485b4343900269160ef3e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659f3d4023b347d58bc0361db9ceead9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:40.170201 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-09b326eb-587f-420d-a28b-8900152bd983 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b78af5c0485b4343900269160ef3e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659f3d4023b347d58bc0361db9ceead9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:40.171413 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-09b326eb-587f-420d-a28b-8900152bd983 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] 10.222.0.33 "GET /compute/v2.1/servers/f8ba4e66-2997-4822-9c01-c570f5ae6e87" status: 200 len: 1875 microversion: 2.42 time: 0.562389 Oct 04 20:51:40.171988 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1893/3852] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:51:39 2022] GET /compute/v2.1/servers/f8ba4e66-2997-4822-9c01-c570f5ae6e87 => generated 1875 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:51:40.520573 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-e78b62f7-d996-44e6-9eff-3a59e2cfb4da tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:40.521796 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-e78b62f7-d996-44e6-9eff-3a59e2cfb4da tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: a0273e6e-eb85-4204-9bec-3707ad6612af] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:51:40.546353 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e78b62f7-d996-44e6-9eff-3a59e2cfb4da tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:40.546964 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e78b62f7-d996-44e6-9eff-3a59e2cfb4da tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:40.547423 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e78b62f7-d996-44e6-9eff-3a59e2cfb4da tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:40.567193 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e78b62f7-d996-44e6-9eff-3a59e2cfb4da tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:40.567705 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e78b62f7-d996-44e6-9eff-3a59e2cfb4da tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:40.577532 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e78b62f7-d996-44e6-9eff-3a59e2cfb4da tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:40.636054 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-55e50357-b837-4b04-8ea9-df4bc6d74e18 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:40.637210 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-55e50357-b837-4b04-8ea9-df4bc6d74e18 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] [instance: 1ed60bf8-87e6-4a70-be59-830bee5f8b6d] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:51:40.652605 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-55e50357-b837-4b04-8ea9-df4bc6d74e18 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:40.660193 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-55e50357-b837-4b04-8ea9-df4bc6d74e18 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:40.661042 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-55e50357-b837-4b04-8ea9-df4bc6d74e18 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:40.661932 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-55e50357-b837-4b04-8ea9-df4bc6d74e18 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:40.663414 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-55e50357-b837-4b04-8ea9-df4bc6d74e18 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:40.663992 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-55e50357-b837-4b04-8ea9-df4bc6d74e18 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:40.669076 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:51:41.556910 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-55e50357-b837-4b04-8ea9-df4bc6d74e18 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc4171c0ee14ebb8b5eff5e910ccf49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003eb03a265a496d8981e45c74b014f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:41.573684 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-55e50357-b837-4b04-8ea9-df4bc6d74e18 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] 10.222.0.33 "GET /compute/v2.1/servers/1ed60bf8-87e6-4a70-be59-830bee5f8b6d" status: 200 len: 1522 microversion: 2.1 time: 0.942070 Oct 04 20:51:41.578831 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1894/3853] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:51:40 2022] GET /compute/v2.1/servers/1ed60bf8-87e6-4a70-be59-830bee5f8b6d => generated 1522 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:51:41.596318 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f8a07f1d-5afd-4c7f-8ea1-71dc8e673721 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:41.599805 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f8a07f1d-5afd-4c7f-8ea1-71dc8e673721 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] [instance: 30eb289d-d09c-43fa-af8a-3c6ee303f0af] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:51:41.618716 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f8a07f1d-5afd-4c7f-8ea1-71dc8e673721 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:41.620803 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f8a07f1d-5afd-4c7f-8ea1-71dc8e673721 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:41.622184 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f8a07f1d-5afd-4c7f-8ea1-71dc8e673721 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:41.627832 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f8a07f1d-5afd-4c7f-8ea1-71dc8e673721 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:41.628943 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f8a07f1d-5afd-4c7f-8ea1-71dc8e673721 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:41.630091 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f8a07f1d-5afd-4c7f-8ea1-71dc8e673721 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:41.910628 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f8a07f1d-5afd-4c7f-8ea1-71dc8e673721 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c208ec9faf491385a9ab5b5932098d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ae4960393c464c97669731c2084d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:41.925029 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f8a07f1d-5afd-4c7f-8ea1-71dc8e673721 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] 10.222.0.33 "GET /compute/v2.1/servers/30eb289d-d09c-43fa-af8a-3c6ee303f0af" status: 200 len: 1272 microversion: 2.1 time: 0.344264 Oct 04 20:51:41.927062 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1895/3854] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:51:41 2022] GET /compute/v2.1/servers/30eb289d-d09c-43fa-af8a-3c6ee303f0af => generated 1272 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:51:41.940427 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f2336b39-4508-47af-b859-737599ed01bf tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:41.942677 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f2336b39-4508-47af-b859-737599ed01bf tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] [instance: f8ba4e66-2997-4822-9c01-c570f5ae6e87] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:51:41.960674 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f2336b39-4508-47af-b859-737599ed01bf tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:41.965372 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f2336b39-4508-47af-b859-737599ed01bf tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:41.967439 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f2336b39-4508-47af-b859-737599ed01bf tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:41.971130 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f2336b39-4508-47af-b859-737599ed01bf tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:41.973888 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f2336b39-4508-47af-b859-737599ed01bf tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:41.977557 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f2336b39-4508-47af-b859-737599ed01bf tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:42.231603 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-e78b62f7-d996-44e6-9eff-3a59e2cfb4da tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac650232cc04810b1340dc2f0edadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b0670d1bd99424780a70e69d57a2166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:42.244179 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-e78b62f7-d996-44e6-9eff-3a59e2cfb4da tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "GET /compute/v2.1/servers/a0273e6e-eb85-4204-9bec-3707ad6612af" status: 200 len: 1508 microversion: 2.1 time: 1.729299 Oct 04 20:51:42.246587 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1960/3855] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:51:40 2022] GET /compute/v2.1/servers/a0273e6e-eb85-4204-9bec-3707ad6612af => generated 1508 bytes in 1733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:51:42.565347 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f2336b39-4508-47af-b859-737599ed01bf tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b78af5c0485b4343900269160ef3e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659f3d4023b347d58bc0361db9ceead9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:42.597807 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f2336b39-4508-47af-b859-737599ed01bf tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b78af5c0485b4343900269160ef3e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659f3d4023b347d58bc0361db9ceead9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:42.610143 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f2336b39-4508-47af-b859-737599ed01bf tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b78af5c0485b4343900269160ef3e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659f3d4023b347d58bc0361db9ceead9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:42.611769 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-6c731178-9c57-4576-a04e-5d25b736969c tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:42.612805 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-6c731178-9c57-4576-a04e-5d25b736969c tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] [instance: 1ed60bf8-87e6-4a70-be59-830bee5f8b6d] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:51:42.614911 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f2336b39-4508-47af-b859-737599ed01bf tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] 10.222.0.33 "GET /compute/v2.1/servers/f8ba4e66-2997-4822-9c01-c570f5ae6e87" status: 200 len: 1875 microversion: 2.42 time: 0.685131 Oct 04 20:51:42.620416 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1896/3856] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:51:41 2022] GET /compute/v2.1/servers/f8ba4e66-2997-4822-9c01-c570f5ae6e87 => generated 1875 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:51:42.624184 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6c731178-9c57-4576-a04e-5d25b736969c tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:42.624683 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6c731178-9c57-4576-a04e-5d25b736969c tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:42.625119 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6c731178-9c57-4576-a04e-5d25b736969c tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:42.625827 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6c731178-9c57-4576-a04e-5d25b736969c tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:42.626282 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6c731178-9c57-4576-a04e-5d25b736969c tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:42.639664 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6c731178-9c57-4576-a04e-5d25b736969c tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:42.763983 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-56160931-b9f0-4e77-b16f-625d61282cad req-2a9fd7f3-ad55-4c4d-9b0c-487761f7062f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0273e6e-eb85-4204-9bec-3707ad6612af", "name": "network-vif-plugged", "status": "completed", "tag": "b9c967b1-2617-432a-a85b-6d5bdf32c3a6"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:51:42.791676 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-56160931-b9f0-4e77-b16f-625d61282cad req-2a9fd7f3-ad55-4c4d-9b0c-487761f7062f service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:42.795038 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-56160931-b9f0-4e77-b16f-625d61282cad req-2a9fd7f3-ad55-4c4d-9b0c-487761f7062f service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:42.795662 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-56160931-b9f0-4e77-b16f-625d61282cad req-2a9fd7f3-ad55-4c4d-9b0c-487761f7062f service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:42.835293 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-56160931-b9f0-4e77-b16f-625d61282cad req-2a9fd7f3-ad55-4c4d-9b0c-487761f7062f service nova] Creating event network-vif-plugged:b9c967b1-2617-432a-a85b-6d5bdf32c3a6 for instance a0273e6e-eb85-4204-9bec-3707ad6612af on n-h2-854823-8 Oct 04 20:51:42.847426 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-56160931-b9f0-4e77-b16f-625d61282cad req-2a9fd7f3-ad55-4c4d-9b0c-487761f7062f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088281 Oct 04 20:51:42.855686 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1897/3857] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:51:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:51:42.955677 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0d618225-f86d-426f-be17-5f61b4491baa tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:42.956649 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-0d618225-f86d-426f-be17-5f61b4491baa tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] [instance: 30eb289d-d09c-43fa-af8a-3c6ee303f0af] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:51:42.981114 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0d618225-f86d-426f-be17-5f61b4491baa tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:42.981629 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0d618225-f86d-426f-be17-5f61b4491baa tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:42.982871 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0d618225-f86d-426f-be17-5f61b4491baa tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:42.996685 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0d618225-f86d-426f-be17-5f61b4491baa tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:42.997203 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0d618225-f86d-426f-be17-5f61b4491baa tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:43.003825 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0d618225-f86d-426f-be17-5f61b4491baa tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:44.403146 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-6c731178-9c57-4576-a04e-5d25b736969c tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc4171c0ee14ebb8b5eff5e910ccf49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003eb03a265a496d8981e45c74b014f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:44.427641 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-6c731178-9c57-4576-a04e-5d25b736969c tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] 10.222.0.33 "GET /compute/v2.1/servers/1ed60bf8-87e6-4a70-be59-830bee5f8b6d" status: 200 len: 1522 microversion: 2.1 time: 1.820476 Oct 04 20:51:44.428488 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1961/3858] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:51:42 2022] GET /compute/v2.1/servers/1ed60bf8-87e6-4a70-be59-830bee5f8b6d => generated 1522 bytes in 1823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:51:44.464869 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-10e0cda3-b6bf-414e-b44f-e430e9491564 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:44.468295 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-10e0cda3-b6bf-414e-b44f-e430e9491564 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: a0273e6e-eb85-4204-9bec-3707ad6612af] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:51:44.487206 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-10e0cda3-b6bf-414e-b44f-e430e9491564 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:44.490372 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-10e0cda3-b6bf-414e-b44f-e430e9491564 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:44.491091 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-10e0cda3-b6bf-414e-b44f-e430e9491564 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:44.493743 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-10e0cda3-b6bf-414e-b44f-e430e9491564 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:44.495214 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-10e0cda3-b6bf-414e-b44f-e430e9491564 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:44.501875 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-10e0cda3-b6bf-414e-b44f-e430e9491564 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:44.680590 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-0d618225-f86d-426f-be17-5f61b4491baa tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c208ec9faf491385a9ab5b5932098d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ae4960393c464c97669731c2084d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:44.690825 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-0d618225-f86d-426f-be17-5f61b4491baa tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] 10.222.0.33 "GET /compute/v2.1/servers/30eb289d-d09c-43fa-af8a-3c6ee303f0af" status: 200 len: 1314 microversion: 2.1 time: 1.741132 Oct 04 20:51:44.691420 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1898/3859] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:51:42 2022] GET /compute/v2.1/servers/30eb289d-d09c-43fa-af8a-3c6ee303f0af => generated 1314 bytes in 1743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:51:44.710607 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-164a00d8-5e1e-4b3f-ac1d-857736005c8a tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:44.711446 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-164a00d8-5e1e-4b3f-ac1d-857736005c8a tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] [instance: f8ba4e66-2997-4822-9c01-c570f5ae6e87] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:51:44.725587 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-164a00d8-5e1e-4b3f-ac1d-857736005c8a tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:44.726255 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-164a00d8-5e1e-4b3f-ac1d-857736005c8a tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:44.726876 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-164a00d8-5e1e-4b3f-ac1d-857736005c8a tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:44.728001 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-164a00d8-5e1e-4b3f-ac1d-857736005c8a tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:44.728608 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-164a00d8-5e1e-4b3f-ac1d-857736005c8a tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:44.729216 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-164a00d8-5e1e-4b3f-ac1d-857736005c8a tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:45.958752 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-10e0cda3-b6bf-414e-b44f-e430e9491564 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac650232cc04810b1340dc2f0edadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b0670d1bd99424780a70e69d57a2166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:45.971865 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-10e0cda3-b6bf-414e-b44f-e430e9491564 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "GET /compute/v2.1/servers/a0273e6e-eb85-4204-9bec-3707ad6612af" status: 200 len: 1508 microversion: 2.1 time: 1.524172 Oct 04 20:51:45.980862 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1962/3860] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:51:44 2022] GET /compute/v2.1/servers/a0273e6e-eb85-4204-9bec-3707ad6612af => generated 1508 bytes in 1534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:51:45.999174 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:51:46.006841 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-8ff6c121-1367-4755-9a37-7592f92637b6 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:46.008549 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-8ff6c121-1367-4755-9a37-7592f92637b6 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] [instance: 1ed60bf8-87e6-4a70-be59-830bee5f8b6d] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:51:46.027869 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8ff6c121-1367-4755-9a37-7592f92637b6 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:46.031571 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8ff6c121-1367-4755-9a37-7592f92637b6 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:46.032507 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8ff6c121-1367-4755-9a37-7592f92637b6 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:46.035451 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8ff6c121-1367-4755-9a37-7592f92637b6 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:46.037656 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8ff6c121-1367-4755-9a37-7592f92637b6 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:46.038574 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8ff6c121-1367-4755-9a37-7592f92637b6 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:46.045790 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-164a00d8-5e1e-4b3f-ac1d-857736005c8a tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b78af5c0485b4343900269160ef3e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659f3d4023b347d58bc0361db9ceead9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:46.048932 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=6 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:51:46.069768 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-164a00d8-5e1e-4b3f-ac1d-857736005c8a tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b78af5c0485b4343900269160ef3e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659f3d4023b347d58bc0361db9ceead9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:46.072216 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-164a00d8-5e1e-4b3f-ac1d-857736005c8a tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b78af5c0485b4343900269160ef3e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659f3d4023b347d58bc0361db9ceead9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:46.074006 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-164a00d8-5e1e-4b3f-ac1d-857736005c8a tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] 10.222.0.33 "GET /compute/v2.1/servers/f8ba4e66-2997-4822-9c01-c570f5ae6e87" status: 200 len: 1875 microversion: 2.42 time: 1.381432 Oct 04 20:51:46.074953 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1899/3861] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:51:44 2022] GET /compute/v2.1/servers/f8ba4e66-2997-4822-9c01-c570f5ae6e87 => generated 1875 bytes in 1383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:51:46.109284 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-816a4bdc-afc8-4757-a909-512b688953fb tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:46.112778 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-816a4bdc-afc8-4757-a909-512b688953fb tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] [instance: 30eb289d-d09c-43fa-af8a-3c6ee303f0af] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:51:46.120414 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-816a4bdc-afc8-4757-a909-512b688953fb tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:46.121564 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-816a4bdc-afc8-4757-a909-512b688953fb tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:46.124186 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-816a4bdc-afc8-4757-a909-512b688953fb tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:46.125348 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-816a4bdc-afc8-4757-a909-512b688953fb tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:46.125981 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-816a4bdc-afc8-4757-a909-512b688953fb tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:46.126595 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-816a4bdc-afc8-4757-a909-512b688953fb tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:46.752748 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell0:SELECT=2 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:51:46.793783 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-8ff6c121-1367-4755-9a37-7592f92637b6 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc4171c0ee14ebb8b5eff5e910ccf49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003eb03a265a496d8981e45c74b014f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:46.807714 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-8ff6c121-1367-4755-9a37-7592f92637b6 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] 10.222.0.33 "GET /compute/v2.1/servers/1ed60bf8-87e6-4a70-be59-830bee5f8b6d" status: 200 len: 1522 microversion: 2.1 time: 0.812754 Oct 04 20:51:46.808788 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1963/3862] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:51:45 2022] GET /compute/v2.1/servers/1ed60bf8-87e6-4a70-be59-830bee5f8b6d => generated 1522 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:51:46.897631 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-816a4bdc-afc8-4757-a909-512b688953fb tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c208ec9faf491385a9ab5b5932098d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ae4960393c464c97669731c2084d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:46.907512 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-816a4bdc-afc8-4757-a909-512b688953fb tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] 10.222.0.33 "GET /compute/v2.1/servers/30eb289d-d09c-43fa-af8a-3c6ee303f0af" status: 200 len: 1314 microversion: 2.1 time: 0.811836 Oct 04 20:51:46.917625 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1900/3863] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:51:46 2022] GET /compute/v2.1/servers/30eb289d-d09c-43fa-af8a-3c6ee303f0af => generated 1314 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:51:47.008498 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-e6cf43c8-9316-4f08-b192-e7cb2139fa70 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:47.009911 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-e6cf43c8-9316-4f08-b192-e7cb2139fa70 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: a0273e6e-eb85-4204-9bec-3707ad6612af] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:51:47.027733 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e6cf43c8-9316-4f08-b192-e7cb2139fa70 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:47.031512 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e6cf43c8-9316-4f08-b192-e7cb2139fa70 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:47.032619 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e6cf43c8-9316-4f08-b192-e7cb2139fa70 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:47.035283 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e6cf43c8-9316-4f08-b192-e7cb2139fa70 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:47.036922 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e6cf43c8-9316-4f08-b192-e7cb2139fa70 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:47.038244 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e6cf43c8-9316-4f08-b192-e7cb2139fa70 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:47.105363 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7568da28-3096-4953-aca2-260a2ce1367c tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:47.106560 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-7568da28-3096-4953-aca2-260a2ce1367c tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] [instance: f8ba4e66-2997-4822-9c01-c570f5ae6e87] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:51:47.119496 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7568da28-3096-4953-aca2-260a2ce1367c tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:47.120136 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7568da28-3096-4953-aca2-260a2ce1367c tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:47.124413 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7568da28-3096-4953-aca2-260a2ce1367c tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:47.125314 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7568da28-3096-4953-aca2-260a2ce1367c tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:47.130606 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7568da28-3096-4953-aca2-260a2ce1367c tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:47.131237 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7568da28-3096-4953-aca2-260a2ce1367c tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:47.769510 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-e6cf43c8-9316-4f08-b192-e7cb2139fa70 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac650232cc04810b1340dc2f0edadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b0670d1bd99424780a70e69d57a2166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:47.781906 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-e6cf43c8-9316-4f08-b192-e7cb2139fa70 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "GET /compute/v2.1/servers/a0273e6e-eb85-4204-9bec-3707ad6612af" status: 200 len: 1508 microversion: 2.1 time: 0.776365 Oct 04 20:51:47.799184 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1964/3864] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:51:47 2022] GET /compute/v2.1/servers/a0273e6e-eb85-4204-9bec-3707ad6612af => generated 1508 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:51:47.808126 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-f6564c41-fcc3-447e-8890-4b4283589035 req-9257a568-be64-4c35-aa5b-d2553a3b55aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30eb289d-d09c-43fa-af8a-3c6ee303f0af", "tag": "7649f0f4-69ee-4996-bb52-e4994b8aadae"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:51:47.846882 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-7568da28-3096-4953-aca2-260a2ce1367c tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b78af5c0485b4343900269160ef3e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659f3d4023b347d58bc0361db9ceead9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:47.854460 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-f6564c41-fcc3-447e-8890-4b4283589035 req-9257a568-be64-4c35-aa5b-d2553a3b55aa service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:47.855560 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-f6564c41-fcc3-447e-8890-4b4283589035 req-9257a568-be64-4c35-aa5b-d2553a3b55aa service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:47.856528 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-7568da28-3096-4953-aca2-260a2ce1367c tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b78af5c0485b4343900269160ef3e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659f3d4023b347d58bc0361db9ceead9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:47.857986 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-f6564c41-fcc3-447e-8890-4b4283589035 req-9257a568-be64-4c35-aa5b-d2553a3b55aa service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:47.858125 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-7568da28-3096-4953-aca2-260a2ce1367c tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b78af5c0485b4343900269160ef3e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659f3d4023b347d58bc0361db9ceead9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:47.866771 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-7568da28-3096-4953-aca2-260a2ce1367c tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] 10.222.0.33 "GET /compute/v2.1/servers/f8ba4e66-2997-4822-9c01-c570f5ae6e87" status: 200 len: 1875 microversion: 2.42 time: 0.764784 Oct 04 20:51:47.871506 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1901/3865] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:51:47 2022] GET /compute/v2.1/servers/f8ba4e66-2997-4822-9c01-c570f5ae6e87 => generated 1875 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 20:51:47.878477 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-16a2307f-9758-4f41-bfa5-4a4493f47499 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:47.886207 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-16a2307f-9758-4f41-bfa5-4a4493f47499 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] [instance: 1ed60bf8-87e6-4a70-be59-830bee5f8b6d] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:51:47.902604 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-16a2307f-9758-4f41-bfa5-4a4493f47499 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:47.903308 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-16a2307f-9758-4f41-bfa5-4a4493f47499 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:47.904748 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-16a2307f-9758-4f41-bfa5-4a4493f47499 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:47.905663 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-16a2307f-9758-4f41-bfa5-4a4493f47499 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:47.906126 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-16a2307f-9758-4f41-bfa5-4a4493f47499 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:47.913424 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-16a2307f-9758-4f41-bfa5-4a4493f47499 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:47.948335 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-f6564c41-fcc3-447e-8890-4b4283589035 req-9257a568-be64-4c35-aa5b-d2553a3b55aa service nova] Creating event network-changed:7649f0f4-69ee-4996-bb52-e4994b8aadae for instance 30eb289d-d09c-43fa-af8a-3c6ee303f0af on n-h2-854823-8 Oct 04 20:51:47.986665 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-f6564c41-fcc3-447e-8890-4b4283589035 req-9257a568-be64-4c35-aa5b-d2553a3b55aa service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.177147 Oct 04 20:51:47.992898 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1965/3866] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:51:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:51:48.019677 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-b467b633-6050-475e-bae9-80ac71991d3b tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:48.021662 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-b467b633-6050-475e-bae9-80ac71991d3b tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] [instance: 30eb289d-d09c-43fa-af8a-3c6ee303f0af] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:51:48.050498 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b467b633-6050-475e-bae9-80ac71991d3b tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:48.051313 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b467b633-6050-475e-bae9-80ac71991d3b tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:48.051772 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b467b633-6050-475e-bae9-80ac71991d3b tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:48.052699 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b467b633-6050-475e-bae9-80ac71991d3b tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:48.056317 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b467b633-6050-475e-bae9-80ac71991d3b tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:48.058335 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b467b633-6050-475e-bae9-80ac71991d3b tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:49.597193 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-16a2307f-9758-4f41-bfa5-4a4493f47499 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc4171c0ee14ebb8b5eff5e910ccf49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003eb03a265a496d8981e45c74b014f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:49.610676 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-b467b633-6050-475e-bae9-80ac71991d3b tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c208ec9faf491385a9ab5b5932098d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ae4960393c464c97669731c2084d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:49.624930 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-b467b633-6050-475e-bae9-80ac71991d3b tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] 10.222.0.33 "GET /compute/v2.1/servers/30eb289d-d09c-43fa-af8a-3c6ee303f0af" status: 200 len: 1314 microversion: 2.1 time: 1.626614 Oct 04 20:51:49.625114 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-16a2307f-9758-4f41-bfa5-4a4493f47499 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] 10.222.0.33 "GET /compute/v2.1/servers/1ed60bf8-87e6-4a70-be59-830bee5f8b6d" status: 200 len: 1522 microversion: 2.1 time: 1.743512 Oct 04 20:51:49.626861 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1902/3867] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:51:47 2022] GET /compute/v2.1/servers/1ed60bf8-87e6-4a70-be59-830bee5f8b6d => generated 1522 bytes in 1753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:51:49.627202 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1966/3868] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:51:47 2022] GET /compute/v2.1/servers/30eb289d-d09c-43fa-af8a-3c6ee303f0af => generated 1314 bytes in 1633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:51:49.639888 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-e360a99e-377d-4e36-aa5d-26b9ae318159 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:49.640841 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-e360a99e-377d-4e36-aa5d-26b9ae318159 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] [instance: f8ba4e66-2997-4822-9c01-c570f5ae6e87] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:51:49.642748 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-69cd8f3d-4c9a-4370-9c14-9ab89791589f tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:49.644020 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-69cd8f3d-4c9a-4370-9c14-9ab89791589f tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: a0273e6e-eb85-4204-9bec-3707ad6612af] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:51:49.657524 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e360a99e-377d-4e36-aa5d-26b9ae318159 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:49.658426 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e360a99e-377d-4e36-aa5d-26b9ae318159 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:49.659068 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e360a99e-377d-4e36-aa5d-26b9ae318159 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:49.660096 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e360a99e-377d-4e36-aa5d-26b9ae318159 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:49.660719 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-69cd8f3d-4c9a-4370-9c14-9ab89791589f tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:49.661427 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e360a99e-377d-4e36-aa5d-26b9ae318159 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:49.663003 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e360a99e-377d-4e36-aa5d-26b9ae318159 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:49.664472 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-69cd8f3d-4c9a-4370-9c14-9ab89791589f tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:49.665132 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-69cd8f3d-4c9a-4370-9c14-9ab89791589f tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:49.667570 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-69cd8f3d-4c9a-4370-9c14-9ab89791589f tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:49.668974 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-69cd8f3d-4c9a-4370-9c14-9ab89791589f tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:49.669532 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-69cd8f3d-4c9a-4370-9c14-9ab89791589f tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:50.469345 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-69cd8f3d-4c9a-4370-9c14-9ab89791589f tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac650232cc04810b1340dc2f0edadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b0670d1bd99424780a70e69d57a2166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:50.477154 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-e360a99e-377d-4e36-aa5d-26b9ae318159 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b78af5c0485b4343900269160ef3e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659f3d4023b347d58bc0361db9ceead9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:50.479919 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-69cd8f3d-4c9a-4370-9c14-9ab89791589f tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "GET /compute/v2.1/servers/a0273e6e-eb85-4204-9bec-3707ad6612af" status: 200 len: 1508 microversion: 2.1 time: 0.849888 Oct 04 20:51:50.483874 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1903/3869] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:51:49 2022] GET /compute/v2.1/servers/a0273e6e-eb85-4204-9bec-3707ad6612af => generated 1508 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:51:50.506496 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-e360a99e-377d-4e36-aa5d-26b9ae318159 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b78af5c0485b4343900269160ef3e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659f3d4023b347d58bc0361db9ceead9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:50.512424 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-e360a99e-377d-4e36-aa5d-26b9ae318159 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b78af5c0485b4343900269160ef3e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659f3d4023b347d58bc0361db9ceead9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:50.514956 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-e360a99e-377d-4e36-aa5d-26b9ae318159 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] 10.222.0.33 "GET /compute/v2.1/servers/f8ba4e66-2997-4822-9c01-c570f5ae6e87" status: 200 len: 1875 microversion: 2.42 time: 0.886384 Oct 04 20:51:50.523592 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1967/3870] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:51:49 2022] GET /compute/v2.1/servers/f8ba4e66-2997-4822-9c01-c570f5ae6e87 => generated 1875 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:51:50.665206 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7655268c-09f0-490c-9000-f9de4b52b172 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:50.665810 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-7655268c-09f0-490c-9000-f9de4b52b172 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] [instance: 1ed60bf8-87e6-4a70-be59-830bee5f8b6d] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:51:50.674111 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7655268c-09f0-490c-9000-f9de4b52b172 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:50.674359 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-166ce386-3977-4629-b1a1-c2705b85230b tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:50.674804 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7655268c-09f0-490c-9000-f9de4b52b172 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:50.674989 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-166ce386-3977-4629-b1a1-c2705b85230b tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] [instance: 30eb289d-d09c-43fa-af8a-3c6ee303f0af] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:51:50.683004 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7655268c-09f0-490c-9000-f9de4b52b172 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:50.683839 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7655268c-09f0-490c-9000-f9de4b52b172 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:50.684380 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7655268c-09f0-490c-9000-f9de4b52b172 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:50.686457 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-166ce386-3977-4629-b1a1-c2705b85230b tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:50.686959 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-166ce386-3977-4629-b1a1-c2705b85230b tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:50.687398 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-166ce386-3977-4629-b1a1-c2705b85230b tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:50.691348 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-166ce386-3977-4629-b1a1-c2705b85230b tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:50.694501 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-166ce386-3977-4629-b1a1-c2705b85230b tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:50.695121 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-166ce386-3977-4629-b1a1-c2705b85230b tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:50.700196 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7655268c-09f0-490c-9000-f9de4b52b172 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:51.386817 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-7655268c-09f0-490c-9000-f9de4b52b172 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc4171c0ee14ebb8b5eff5e910ccf49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003eb03a265a496d8981e45c74b014f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:51.402211 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-7655268c-09f0-490c-9000-f9de4b52b172 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] 10.222.0.33 "GET /compute/v2.1/servers/1ed60bf8-87e6-4a70-be59-830bee5f8b6d" status: 200 len: 1522 microversion: 2.1 time: 0.735555 Oct 04 20:51:51.403403 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1904/3871] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:51:50 2022] GET /compute/v2.1/servers/1ed60bf8-87e6-4a70-be59-830bee5f8b6d => generated 1522 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:51:51.511937 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7069dea2-a0e9-48ff-aa1a-ff582049531c tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:51.512705 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-7069dea2-a0e9-48ff-aa1a-ff582049531c tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: a0273e6e-eb85-4204-9bec-3707ad6612af] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:51:51.522237 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7069dea2-a0e9-48ff-aa1a-ff582049531c tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:51.524353 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7069dea2-a0e9-48ff-aa1a-ff582049531c tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:51.530059 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7069dea2-a0e9-48ff-aa1a-ff582049531c tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:51.531076 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7069dea2-a0e9-48ff-aa1a-ff582049531c tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:51.531669 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7069dea2-a0e9-48ff-aa1a-ff582049531c tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:51.532212 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7069dea2-a0e9-48ff-aa1a-ff582049531c tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:51.730428 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-166ce386-3977-4629-b1a1-c2705b85230b tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c208ec9faf491385a9ab5b5932098d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ae4960393c464c97669731c2084d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:51.744485 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-166ce386-3977-4629-b1a1-c2705b85230b tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] 10.222.0.33 "GET /compute/v2.1/servers/30eb289d-d09c-43fa-af8a-3c6ee303f0af" status: 200 len: 1314 microversion: 2.1 time: 1.075073 Oct 04 20:51:51.761028 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1968/3872] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:51:50 2022] GET /compute/v2.1/servers/30eb289d-d09c-43fa-af8a-3c6ee303f0af => generated 1314 bytes in 1092 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:51:51.773020 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-a1cacade-66d8-46e1-b206-434395996ceb tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:51.777225 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-a1cacade-66d8-46e1-b206-434395996ceb tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] [instance: f8ba4e66-2997-4822-9c01-c570f5ae6e87] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:51:51.792365 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a1cacade-66d8-46e1-b206-434395996ceb tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:51.796217 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a1cacade-66d8-46e1-b206-434395996ceb tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:51.796833 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a1cacade-66d8-46e1-b206-434395996ceb tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:51.797705 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a1cacade-66d8-46e1-b206-434395996ceb tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:51.800971 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a1cacade-66d8-46e1-b206-434395996ceb tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:51.801597 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a1cacade-66d8-46e1-b206-434395996ceb tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:51.892929 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-7069dea2-a0e9-48ff-aa1a-ff582049531c tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac650232cc04810b1340dc2f0edadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b0670d1bd99424780a70e69d57a2166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:51.902195 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-7069dea2-a0e9-48ff-aa1a-ff582049531c tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "GET /compute/v2.1/servers/a0273e6e-eb85-4204-9bec-3707ad6612af" status: 200 len: 1508 microversion: 2.1 time: 0.395312 Oct 04 20:51:51.916626 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1905/3873] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:51:51 2022] GET /compute/v2.1/servers/a0273e6e-eb85-4204-9bec-3707ad6612af => generated 1508 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:51:52.437957 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-045bd7f0-a745-4932-84ad-da9e08df7e9d tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:52.439631 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-045bd7f0-a745-4932-84ad-da9e08df7e9d tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] [instance: 1ed60bf8-87e6-4a70-be59-830bee5f8b6d] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:51:52.451334 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-045bd7f0-a745-4932-84ad-da9e08df7e9d tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:52.452173 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-045bd7f0-a745-4932-84ad-da9e08df7e9d tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:52.452840 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-045bd7f0-a745-4932-84ad-da9e08df7e9d tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:52.456327 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-045bd7f0-a745-4932-84ad-da9e08df7e9d tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:52.458192 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-045bd7f0-a745-4932-84ad-da9e08df7e9d tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:52.459547 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-045bd7f0-a745-4932-84ad-da9e08df7e9d tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:53.076651 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-a1cacade-66d8-46e1-b206-434395996ceb tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b78af5c0485b4343900269160ef3e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659f3d4023b347d58bc0361db9ceead9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:53.095182 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-a1cacade-66d8-46e1-b206-434395996ceb tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b78af5c0485b4343900269160ef3e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659f3d4023b347d58bc0361db9ceead9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:53.108636 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-a1cacade-66d8-46e1-b206-434395996ceb tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b78af5c0485b4343900269160ef3e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659f3d4023b347d58bc0361db9ceead9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:53.113295 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-a1cacade-66d8-46e1-b206-434395996ceb tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] 10.222.0.33 "GET /compute/v2.1/servers/f8ba4e66-2997-4822-9c01-c570f5ae6e87" status: 200 len: 1875 microversion: 2.42 time: 1.346282 Oct 04 20:51:53.119838 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1969/3874] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:51:51 2022] GET /compute/v2.1/servers/f8ba4e66-2997-4822-9c01-c570f5ae6e87 => generated 1875 bytes in 1353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:51:53.146488 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-79d3d3c6-54e3-4558-828f-1567b2b54708 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:53.147711 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-79d3d3c6-54e3-4558-828f-1567b2b54708 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] [instance: 30eb289d-d09c-43fa-af8a-3c6ee303f0af] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:51:53.171215 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-79d3d3c6-54e3-4558-828f-1567b2b54708 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:53.171977 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-79d3d3c6-54e3-4558-828f-1567b2b54708 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:53.172572 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-79d3d3c6-54e3-4558-828f-1567b2b54708 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:53.177498 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-79d3d3c6-54e3-4558-828f-1567b2b54708 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:53.178613 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-79d3d3c6-54e3-4558-828f-1567b2b54708 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:53.181481 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-79d3d3c6-54e3-4558-828f-1567b2b54708 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:53.488709 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-045bd7f0-a745-4932-84ad-da9e08df7e9d tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc4171c0ee14ebb8b5eff5e910ccf49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003eb03a265a496d8981e45c74b014f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:53.513194 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-045bd7f0-a745-4932-84ad-da9e08df7e9d tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] 10.222.0.33 "GET /compute/v2.1/servers/1ed60bf8-87e6-4a70-be59-830bee5f8b6d" status: 200 len: 1522 microversion: 2.1 time: 1.083755 Oct 04 20:51:53.520076 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1906/3875] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:51:52 2022] GET /compute/v2.1/servers/1ed60bf8-87e6-4a70-be59-830bee5f8b6d => generated 1522 bytes in 1092 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:51:53.542541 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8ba67fbf-c0e0-4519-b4ce-0e1c8c01d20f tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:53.542843 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-8ba67fbf-c0e0-4519-b4ce-0e1c8c01d20f tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: a0273e6e-eb85-4204-9bec-3707ad6612af] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:51:53.575888 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8ba67fbf-c0e0-4519-b4ce-0e1c8c01d20f tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:53.576573 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8ba67fbf-c0e0-4519-b4ce-0e1c8c01d20f tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:53.598215 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8ba67fbf-c0e0-4519-b4ce-0e1c8c01d20f tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:53.599072 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8ba67fbf-c0e0-4519-b4ce-0e1c8c01d20f tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:53.599560 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8ba67fbf-c0e0-4519-b4ce-0e1c8c01d20f tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:53.599997 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8ba67fbf-c0e0-4519-b4ce-0e1c8c01d20f tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:53.603096 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-79d3d3c6-54e3-4558-828f-1567b2b54708 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c208ec9faf491385a9ab5b5932098d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ae4960393c464c97669731c2084d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:53.608799 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=100 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:51:53.620472 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-79d3d3c6-54e3-4558-828f-1567b2b54708 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] 10.222.0.33 "GET /compute/v2.1/servers/30eb289d-d09c-43fa-af8a-3c6ee303f0af" status: 200 len: 1314 microversion: 2.1 time: 0.499240 Oct 04 20:51:53.624785 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1970/3876] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:51:53 2022] GET /compute/v2.1/servers/30eb289d-d09c-43fa-af8a-3c6ee303f0af => generated 1314 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:51:54.146755 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-d0937864-45d5-4883-a810-760c6ecd675f tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:54.147665 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-d0937864-45d5-4883-a810-760c6ecd675f tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] [instance: f8ba4e66-2997-4822-9c01-c570f5ae6e87] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:51:54.165955 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d0937864-45d5-4883-a810-760c6ecd675f tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:54.168230 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d0937864-45d5-4883-a810-760c6ecd675f tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:54.168839 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d0937864-45d5-4883-a810-760c6ecd675f tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:54.173332 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d0937864-45d5-4883-a810-760c6ecd675f tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:54.174260 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d0937864-45d5-4883-a810-760c6ecd675f tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:54.175888 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d0937864-45d5-4883-a810-760c6ecd675f tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:54.191830 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-8ba67fbf-c0e0-4519-b4ce-0e1c8c01d20f tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac650232cc04810b1340dc2f0edadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b0670d1bd99424780a70e69d57a2166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:54.223145 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-8ba67fbf-c0e0-4519-b4ce-0e1c8c01d20f tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "GET /compute/v2.1/servers/a0273e6e-eb85-4204-9bec-3707ad6612af" status: 200 len: 1508 microversion: 2.1 time: 0.677705 Oct 04 20:51:54.229710 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1907/3877] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:51:53 2022] GET /compute/v2.1/servers/a0273e6e-eb85-4204-9bec-3707ad6612af => generated 1508 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:51:54.548394 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-eadd1e1d-eab2-4e3a-a8f7-6be230bd769f tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:54.549204 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-eadd1e1d-eab2-4e3a-a8f7-6be230bd769f tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] [instance: 1ed60bf8-87e6-4a70-be59-830bee5f8b6d] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:51:54.559363 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-eadd1e1d-eab2-4e3a-a8f7-6be230bd769f tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:54.559895 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-eadd1e1d-eab2-4e3a-a8f7-6be230bd769f tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:54.560438 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-eadd1e1d-eab2-4e3a-a8f7-6be230bd769f tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:54.561148 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-eadd1e1d-eab2-4e3a-a8f7-6be230bd769f tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:54.561597 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-eadd1e1d-eab2-4e3a-a8f7-6be230bd769f tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:54.566121 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-eadd1e1d-eab2-4e3a-a8f7-6be230bd769f tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:54.898566 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-d0937864-45d5-4883-a810-760c6ecd675f tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b78af5c0485b4343900269160ef3e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659f3d4023b347d58bc0361db9ceead9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:54.916481 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-d0937864-45d5-4883-a810-760c6ecd675f tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b78af5c0485b4343900269160ef3e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659f3d4023b347d58bc0361db9ceead9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:54.917941 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-d0937864-45d5-4883-a810-760c6ecd675f tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b78af5c0485b4343900269160ef3e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659f3d4023b347d58bc0361db9ceead9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:54.919730 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-d0937864-45d5-4883-a810-760c6ecd675f tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] 10.222.0.33 "GET /compute/v2.1/servers/f8ba4e66-2997-4822-9c01-c570f5ae6e87" status: 200 len: 1875 microversion: 2.42 time: 0.778891 Oct 04 20:51:54.920317 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1971/3878] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:51:54 2022] GET /compute/v2.1/servers/f8ba4e66-2997-4822-9c01-c570f5ae6e87 => generated 1875 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:51:55.431283 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-ad26a7b9-c7d2-4ed9-b4c1-72353d4a5ab0 tempest-FlavorsV2NegativeTest-103499561 tempest-FlavorsV2NegativeTest-103499561-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:55.441914 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-ad26a7b9-c7d2-4ed9-b4c1-72353d4a5ab0 tempest-FlavorsV2NegativeTest-103499561 tempest-FlavorsV2NegativeTest-103499561-project] 10.222.0.33 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.520441 Oct 04 20:51:55.442575 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1972/3879] 10.222.0.33 () {58 vars in 1137 bytes} [Tue Oct 4 20:51:54 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:51:55.447820 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-76611e97-5ff1-4a03-8c52-febc76d64c4b tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:55.448662 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-76611e97-5ff1-4a03-8c52-febc76d64c4b tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] [instance: 30eb289d-d09c-43fa-af8a-3c6ee303f0af] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:51:55.459001 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-76611e97-5ff1-4a03-8c52-febc76d64c4b tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:55.460405 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-76611e97-5ff1-4a03-8c52-febc76d64c4b tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:55.461114 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-76611e97-5ff1-4a03-8c52-febc76d64c4b tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:55.462046 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-76611e97-5ff1-4a03-8c52-febc76d64c4b tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:55.462755 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-76611e97-5ff1-4a03-8c52-febc76d64c4b tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:55.463518 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-76611e97-5ff1-4a03-8c52-febc76d64c4b tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:55.730996 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-eadd1e1d-eab2-4e3a-a8f7-6be230bd769f tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc4171c0ee14ebb8b5eff5e910ccf49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003eb03a265a496d8981e45c74b014f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:55.742999 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-eadd1e1d-eab2-4e3a-a8f7-6be230bd769f tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] 10.222.0.33 "GET /compute/v2.1/servers/1ed60bf8-87e6-4a70-be59-830bee5f8b6d" status: 200 len: 1522 microversion: 2.1 time: 1.199521 Oct 04 20:51:55.744066 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1908/3880] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:51:54 2022] GET /compute/v2.1/servers/1ed60bf8-87e6-4a70-be59-830bee5f8b6d => generated 1522 bytes in 1202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:51:55.766544 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-8462fde5-7441-400c-aab6-539dd767f295 req-d6b95cc7-8c23-4d7f-bf86-caac8ac8d74b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30eb289d-d09c-43fa-af8a-3c6ee303f0af", "name": "network-vif-plugged", "status": "completed", "tag": "7649f0f4-69ee-4996-bb52-e4994b8aadae"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:51:55.778865 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-8462fde5-7441-400c-aab6-539dd767f295 req-d6b95cc7-8c23-4d7f-bf86-caac8ac8d74b service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:55.779738 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-8462fde5-7441-400c-aab6-539dd767f295 req-d6b95cc7-8c23-4d7f-bf86-caac8ac8d74b service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:55.780322 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-8462fde5-7441-400c-aab6-539dd767f295 req-d6b95cc7-8c23-4d7f-bf86-caac8ac8d74b service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:55.793699 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-8462fde5-7441-400c-aab6-539dd767f295 req-d6b95cc7-8c23-4d7f-bf86-caac8ac8d74b service nova] Creating event network-vif-plugged:7649f0f4-69ee-4996-bb52-e4994b8aadae for instance 30eb289d-d09c-43fa-af8a-3c6ee303f0af on n-h2-854823-8 Oct 04 20:51:55.800062 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-8462fde5-7441-400c-aab6-539dd767f295 req-d6b95cc7-8c23-4d7f-bf86-caac8ac8d74b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041651 Oct 04 20:51:55.801238 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1909/3881] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:51:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:51:55.807295 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ddea0823-9ad3-45a5-ba2e-d5281563f905 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:55.808017 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-76611e97-5ff1-4a03-8c52-febc76d64c4b tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c208ec9faf491385a9ab5b5932098d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ae4960393c464c97669731c2084d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:55.808459 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ddea0823-9ad3-45a5-ba2e-d5281563f905 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: a0273e6e-eb85-4204-9bec-3707ad6612af] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:51:55.816108 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ddea0823-9ad3-45a5-ba2e-d5281563f905 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:55.816802 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ddea0823-9ad3-45a5-ba2e-d5281563f905 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:55.817239 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ddea0823-9ad3-45a5-ba2e-d5281563f905 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:55.818284 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ddea0823-9ad3-45a5-ba2e-d5281563f905 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:55.818952 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ddea0823-9ad3-45a5-ba2e-d5281563f905 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:55.819543 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ddea0823-9ad3-45a5-ba2e-d5281563f905 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:55.820646 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-76611e97-5ff1-4a03-8c52-febc76d64c4b tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] 10.222.0.33 "GET /compute/v2.1/servers/30eb289d-d09c-43fa-af8a-3c6ee303f0af" status: 200 len: 1314 microversion: 2.1 time: 0.376720 Oct 04 20:51:55.823760 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1973/3882] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:51:55 2022] GET /compute/v2.1/servers/30eb289d-d09c-43fa-af8a-3c6ee303f0af => generated 1314 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:51:55.955249 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-ac231004-ebab-4b3a-9d26-92e578562a04 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:55.956185 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-ac231004-ebab-4b3a-9d26-92e578562a04 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] [instance: f8ba4e66-2997-4822-9c01-c570f5ae6e87] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:51:55.975095 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ac231004-ebab-4b3a-9d26-92e578562a04 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:55.978942 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ac231004-ebab-4b3a-9d26-92e578562a04 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:55.979803 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ac231004-ebab-4b3a-9d26-92e578562a04 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:55.980651 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ac231004-ebab-4b3a-9d26-92e578562a04 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:55.981292 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ac231004-ebab-4b3a-9d26-92e578562a04 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:55.982556 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ac231004-ebab-4b3a-9d26-92e578562a04 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:56.674707 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-ac231004-ebab-4b3a-9d26-92e578562a04 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b78af5c0485b4343900269160ef3e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659f3d4023b347d58bc0361db9ceead9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:56.678837 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-ddea0823-9ad3-45a5-ba2e-d5281563f905 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac650232cc04810b1340dc2f0edadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b0670d1bd99424780a70e69d57a2166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:56.692003 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ddea0823-9ad3-45a5-ba2e-d5281563f905 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "GET /compute/v2.1/servers/a0273e6e-eb85-4204-9bec-3707ad6612af" status: 200 len: 1508 microversion: 2.1 time: 0.889394 Oct 04 20:51:56.692610 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1910/3883] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:51:55 2022] GET /compute/v2.1/servers/a0273e6e-eb85-4204-9bec-3707ad6612af => generated 1508 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:51:56.697385 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-ac231004-ebab-4b3a-9d26-92e578562a04 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b78af5c0485b4343900269160ef3e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659f3d4023b347d58bc0361db9ceead9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:56.703610 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-ac231004-ebab-4b3a-9d26-92e578562a04 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b78af5c0485b4343900269160ef3e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659f3d4023b347d58bc0361db9ceead9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:56.706591 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-ac231004-ebab-4b3a-9d26-92e578562a04 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] 10.222.0.33 "GET /compute/v2.1/servers/f8ba4e66-2997-4822-9c01-c570f5ae6e87" status: 200 len: 1875 microversion: 2.42 time: 0.756924 Oct 04 20:51:56.717748 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1974/3884] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:51:55 2022] GET /compute/v2.1/servers/f8ba4e66-2997-4822-9c01-c570f5ae6e87 => generated 1875 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:51:56.723574 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-afc5fc50-35d2-4983-b34a-f70c094a962a tempest-FlavorsV2NegativeTest-103499561 tempest-FlavorsV2NegativeTest-103499561-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-2071306773", "imageRef": "54f9d32b-cc9e-4a4b-885d-96fc3dad9ee9", "flavorRef": "452"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:51:56.770283 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-42e7b3b5-8394-4337-8cb3-3c0cc38a2c32 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:56.771419 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-42e7b3b5-8394-4337-8cb3-3c0cc38a2c32 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] [instance: 1ed60bf8-87e6-4a70-be59-830bee5f8b6d] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:51:56.778398 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-42e7b3b5-8394-4337-8cb3-3c0cc38a2c32 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:56.779457 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-42e7b3b5-8394-4337-8cb3-3c0cc38a2c32 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:56.780194 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-42e7b3b5-8394-4337-8cb3-3c0cc38a2c32 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:56.781557 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-42e7b3b5-8394-4337-8cb3-3c0cc38a2c32 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:56.782169 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-42e7b3b5-8394-4337-8cb3-3c0cc38a2c32 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:56.783044 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-42e7b3b5-8394-4337-8cb3-3c0cc38a2c32 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:56.821886 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.network.neutron [None req-afc5fc50-35d2-4983-b34a-f70c094a962a tempest-FlavorsV2NegativeTest-103499561 tempest-FlavorsV2NegativeTest-103499561-project] validate_networks() for None {{(pid=128801) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:51:57.403821 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-42e7b3b5-8394-4337-8cb3-3c0cc38a2c32 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc4171c0ee14ebb8b5eff5e910ccf49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003eb03a265a496d8981e45c74b014f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:57.413607 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-42e7b3b5-8394-4337-8cb3-3c0cc38a2c32 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] 10.222.0.33 "GET /compute/v2.1/servers/1ed60bf8-87e6-4a70-be59-830bee5f8b6d" status: 200 len: 1502 microversion: 2.1 time: 0.647316 Oct 04 20:51:57.420641 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1975/3885] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:51:56 2022] GET /compute/v2.1/servers/1ed60bf8-87e6-4a70-be59-830bee5f8b6d => generated 1502 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:51:57.427603 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-ba369e77-469a-4376-88ec-91e2853d10dd tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:57.428794 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-ba369e77-469a-4376-88ec-91e2853d10dd tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] [instance: 30eb289d-d09c-43fa-af8a-3c6ee303f0af] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:51:57.445426 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ba369e77-469a-4376-88ec-91e2853d10dd tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:57.445926 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ba369e77-469a-4376-88ec-91e2853d10dd tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:57.446364 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ba369e77-469a-4376-88ec-91e2853d10dd tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:57.447112 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ba369e77-469a-4376-88ec-91e2853d10dd tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:57.449758 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ba369e77-469a-4376-88ec-91e2853d10dd tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:57.451329 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ba369e77-469a-4376-88ec-91e2853d10dd tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:57.791655 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-afc5fc50-35d2-4983-b34a-f70c094a962a tempest-FlavorsV2NegativeTest-103499561 tempest-FlavorsV2NegativeTest-103499561-project] HTTP exception thrown: Flavor's memory is too small for requested image. Oct 04 20:51:57.793504 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-afc5fc50-35d2-4983-b34a-f70c094a962a tempest-FlavorsV2NegativeTest-103499561 tempest-FlavorsV2NegativeTest-103499561-project] Request method failure captured: Oct 04 20:51:57.793504 n-d-854823-8 devstack@n-api.service[128801]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 20:51:57.793504 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:51:57.793504 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:51:57.793504 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:51:57.793504 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 143 Oct 04 20:51:57.793504 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:51:57.793504 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:51:57.793504 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:51:57.793504 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:51:57.793504 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJzqtc_af_0P1IWMw09OEc91VkqgIvuphLXu6rReZwmtIjjiN7kMKkicBIVDZjdMOTVhL94ihM7WIf866HvKUw0vdKmGmXcDFcdeuW51tdwwlA0dJQS7h_KpSpM3TrKBV4nOI4q6Gm5UR-AK-ebO1SiMdiLxJM7G-g3pTZaTc2_8dJg Oct 04 20:51:57.793504 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:51:57.793504 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:51:57.793504 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:51:57.793504 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:51:57.793504 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:51:57.793504 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:51:57.793504 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: 7e85f15df328443b9af841aefaac4b4f Oct 04 20:51:57.793504 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-FlavorsV2NegativeTest-103499561 Oct 04 20:51:57.793504 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 20:51:57.793504 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 20:51:57.793504 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_7e85f15df328443b9af841aefaac4b4f", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7e85f15df328443b9af841aefaac4b4f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7e85f15df328443b9af841aefaac4b4f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/7e85f15df328443b9af841aefaac4b4f"}]}] Oct 04 20:51:57.793504 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-FlavorsV2NegativeTest-103499561 Oct 04 20:51:57.793504 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: 7e85f15df328443b9af841aefaac4b4f Oct 04 20:51:57.793504 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-FlavorsV2NegativeTest-103499561 Oct 04 20:51:57.793504 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-FlavorsV2NegativeTest-103499561-project Oct 04 20:51:57.793504 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:51:57.793504 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:51:57.793504 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: d49cd08da65742aea8fc985bb2ee12a7 Oct 04 20:51:57.793504 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-FlavorsV2NegativeTest-103499561-project Oct 04 20:51:57.793504 n-d-854823-8 devstack@n-api.service[128801]: Oct 04 20:51:57.793504 n-d-854823-8 devstack@n-api.service[128801]: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-2071306773", "imageRef": "54f9d32b-cc9e-4a4b-885d-96fc3dad9ee9", "flavorRef": "452"}} Oct 04 20:51:57.793504 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 20:51:57.793504 n-d-854823-8 devstack@n-api.service[128801]: exception: Flavor's memory is too small for requested image. Oct 04 20:51:57.793504 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'body': {'server': {'name': 'tempest-FlavorsV2NegativeTest-server-2071306773', 'imageRef': '54f9d32b-cc9e-4a4b-885d-96fc3dad9ee9', 'flavorRef': '452'}}} Oct 04 20:51:57.793504 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:51:57.793504 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:51:57.793504 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 20:51:57.793504 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 20:51:57.793504 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 20:51:57.793504 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 20:51:57.793504 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Oct 04 20:51:57.793504 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Oct 04 20:51:57.793504 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1019, in _checks_for_create_and_rebuild Oct 04 20:51:57.793504 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self._validate_flavor_image(context, image_id, image, Oct 04 20:51:57.793504 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 683, in _validate_flavor_image Oct 04 20:51:57.793504 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self._validate_flavor_image_nostatus( Oct 04 20:51:57.793504 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 751, in _validate_flavor_image_nostatus Oct 04 20:51:57.793504 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.FlavorMemoryTooSmall() Oct 04 20:51:57.793504 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.FlavorMemoryTooSmall: Flavor's memory is too small for requested image. Oct 04 20:51:57.793504 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:51:57.793504 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:51:57.793504 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:51:57.793504 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:51:57.793504 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:51:57.793504 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:51:57.793504 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:51:57.793504 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:51:57.793504 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:51:57.793504 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:51:57.793504 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:51:57.793504 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:51:57.793504 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:51:57.793504 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:51:57.800067 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:51:57.800067 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:51:57.800067 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 20:51:57.800067 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 868, in create Oct 04 20:51:57.800067 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 04 20:51:57.800067 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor's memory is too small for requested image. Oct 04 20:51:57.800067 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:51:57.800067 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:51:57.800067 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:51:57.800067 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:51:57.800067 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:51:57.800067 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:51:57.800067 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:51:57.800067 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:51:57.800067 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor's memory is too small for requested image. Oct 04 20:51:57.800067 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:51:57.800067 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-afc5fc50-35d2-4983-b34a-f70c094a962a tempest-FlavorsV2NegativeTest-103499561 tempest-FlavorsV2NegativeTest-103499561-project] Returning 400 to user: Flavor's memory is too small for requested image. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:51:57.800067 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-afc5fc50-35d2-4983-b34a-f70c094a962a tempest-FlavorsV2NegativeTest-103499561 tempest-FlavorsV2NegativeTest-103499561-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 400 len: 93 microversion: 2.1 time: 1.096231 Oct 04 20:51:57.800067 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1911/3886] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 20:51:56 2022] POST /compute/v2.1/servers => generated 93 bytes in 1103 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 04 20:51:57.827241 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6a6f19df-96fd-418d-9d8b-27c1e486b7d6 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2713ec61-1c3c-483c-bf54-4842d60f0c88"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:51:57.835915 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-6a6f19df-96fd-418d-9d8b-27c1e486b7d6 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] [instance: 1ed60bf8-87e6-4a70-be59-830bee5f8b6d] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:51:57.854591 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-ba369e77-469a-4376-88ec-91e2853d10dd tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c208ec9faf491385a9ab5b5932098d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ae4960393c464c97669731c2084d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:57.865652 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-ba369e77-469a-4376-88ec-91e2853d10dd tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] 10.222.0.33 "GET /compute/v2.1/servers/30eb289d-d09c-43fa-af8a-3c6ee303f0af" status: 200 len: 1314 microversion: 2.1 time: 0.443702 Oct 04 20:51:57.866458 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1976/3887] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:51:57 2022] GET /compute/v2.1/servers/30eb289d-d09c-43fa-af8a-3c6ee303f0af => generated 1314 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:51:57.876824 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6a6f19df-96fd-418d-9d8b-27c1e486b7d6 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:57.876824 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6a6f19df-96fd-418d-9d8b-27c1e486b7d6 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:57.878971 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6a6f19df-96fd-418d-9d8b-27c1e486b7d6 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:57.880185 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6a6f19df-96fd-418d-9d8b-27c1e486b7d6 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:57.885810 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6a6f19df-96fd-418d-9d8b-27c1e486b7d6 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:57.889781 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6a6f19df-96fd-418d-9d8b-27c1e486b7d6 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:57.890096 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-d46e0dd0-90e2-4faf-bc3b-9850ee0c1453 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:57.890939 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-d46e0dd0-90e2-4faf-bc3b-9850ee0c1453 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: a0273e6e-eb85-4204-9bec-3707ad6612af] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:51:57.899244 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d46e0dd0-90e2-4faf-bc3b-9850ee0c1453 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:57.900045 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d46e0dd0-90e2-4faf-bc3b-9850ee0c1453 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:57.900668 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d46e0dd0-90e2-4faf-bc3b-9850ee0c1453 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:57.901569 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d46e0dd0-90e2-4faf-bc3b-9850ee0c1453 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:57.901999 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d46e0dd0-90e2-4faf-bc3b-9850ee0c1453 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:57.902454 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d46e0dd0-90e2-4faf-bc3b-9850ee0c1453 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:57.971952 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-6a6f19df-96fd-418d-9d8b-27c1e486b7d6 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] HTTP exception thrown: Cannot 'attach_volume' instance 1ed60bf8-87e6-4a70-be59-830bee5f8b6d while it is in vm_state rescued Oct 04 20:51:57.981845 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6a6f19df-96fd-418d-9d8b-27c1e486b7d6 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Request method failure captured: Oct 04 20:51:57.981845 n-d-854823-8 devstack@n-api.service[128801]: request: POST /compute/v2.1/servers/1ed60bf8-87e6-4a70-be59-830bee5f8b6d/os-volume_attachments HTTP/1.1 Oct 04 20:51:57.981845 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:51:57.981845 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:51:57.981845 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:51:57.981845 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 74 Oct 04 20:51:57.981845 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:51:57.981845 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:51:57.981845 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:51:57.981845 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:51:57.981845 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJyQzA2j2TP516GvcpxgrBfRY2YO9l5F5hDF6OrxoVmO38Ubui7rW9ilb7hzquPDxl35ZSulQSvQlms9Io4ULkRGXw-K9Mq_8wy4teEQxOMGhx3owN2R9ZyECEeAocP_VsKpWXZTRpHKvfvEO-wS1AA94MTw8YrFoFgm4uO6w6GPzhQ Oct 04 20:51:57.981845 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:51:57.981845 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:51:57.981845 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:51:57.981845 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:51:57.981845 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:51:57.981845 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:51:57.981845 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: 003eb03a265a496d8981e45c74b014f3 Oct 04 20:51:57.981845 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2028044299 Oct 04 20:51:57.981845 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 20:51:57.981845 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 20:51:57.981845 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_003eb03a265a496d8981e45c74b014f3", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/003eb03a265a496d8981e45c74b014f3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/003eb03a265a496d8981e45c74b014f3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/003eb03a265a496d8981e45c74b014f3"}]}] Oct 04 20:51:57.981845 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2028044299 Oct 04 20:51:57.981845 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: 003eb03a265a496d8981e45c74b014f3 Oct 04 20:51:57.981845 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2028044299 Oct 04 20:51:57.981845 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-ServerRescueNegativeTestJSON-2028044299-project Oct 04 20:51:57.981845 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:51:57.981845 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:51:57.981845 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: 4dc4171c0ee14ebb8b5eff5e910ccf49 Oct 04 20:51:57.981845 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2028044299-project Oct 04 20:51:57.981845 n-d-854823-8 devstack@n-api.service[128801]: Oct 04 20:51:57.981845 n-d-854823-8 devstack@n-api.service[128801]: {"volumeAttachment": {"volumeId": "2713ec61-1c3c-483c-bf54-4842d60f0c88"}} Oct 04 20:51:57.981845 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 20:51:57.981845 n-d-854823-8 devstack@n-api.service[128801]: exception: Cannot 'attach_volume' instance 1ed60bf8-87e6-4a70-be59-830bee5f8b6d while it is in vm_state rescued Oct 04 20:51:57.981845 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'server_id': '1ed60bf8-87e6-4a70-be59-830bee5f8b6d', 'body': {'volumeAttachment': {'volumeId': '2713ec61-1c3c-483c-bf54-4842d60f0c88'}}} Oct 04 20:51:57.981845 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:51:57.981845 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:51:57.981845 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 04 20:51:57.981845 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 04 20:51:57.981845 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 20:51:57.981845 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 20:51:57.981845 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 04 20:51:57.981845 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 04 20:51:57.981845 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 1ed60bf8-87e6-4a70-be59-830bee5f8b6d in vm_state rescued. Cannot attach_volume while the instance is in this state. Oct 04 20:51:57.981845 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:51:57.981845 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:51:57.981845 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:51:57.981845 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:51:57.981845 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:51:57.981845 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:51:57.981845 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:51:57.981845 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:51:57.981845 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:51:57.981845 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:51:57.981845 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:51:57.981845 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:51:57.981845 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:51:57.981845 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:51:57.981845 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:51:57.981845 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:51:57.981845 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Oct 04 20:51:57.981845 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 04 20:51:57.985274 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 04 20:51:57.985274 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 04 20:51:57.985274 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 1ed60bf8-87e6-4a70-be59-830bee5f8b6d while it is in vm_state rescued Oct 04 20:51:57.985274 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:51:57.985274 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:51:57.985274 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:51:57.985274 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:51:57.985274 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:51:57.985274 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:51:57.985274 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:51:57.985274 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:51:57.985274 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 1ed60bf8-87e6-4a70-be59-830bee5f8b6d while it is in vm_state rescued Oct 04 20:51:57.985274 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:51:57.992983 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6a6f19df-96fd-418d-9d8b-27c1e486b7d6 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Returning 409 to user: Cannot 'attach_volume' instance 1ed60bf8-87e6-4a70-be59-830bee5f8b6d while it is in vm_state rescued {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:51:57.993869 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-6a6f19df-96fd-418d-9d8b-27c1e486b7d6 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] 10.222.0.33 "POST /compute/v2.1/servers/1ed60bf8-87e6-4a70-be59-830bee5f8b6d/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.196435 Oct 04 20:51:57.994484 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1912/3888] 10.222.0.33 () {60 vars in 1323 bytes} [Tue Oct 4 20:51:57 2022] POST /compute/v2.1/servers/1ed60bf8-87e6-4a70-be59-830bee5f8b6d/os-volume_attachments => generated 152 bytes in 197 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 04 20:51:58.016314 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e65a6a5c-36cb-4390-8cdd-34898f5d2c75 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:58.017107 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e65a6a5c-36cb-4390-8cdd-34898f5d2c75 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] [instance: f8ba4e66-2997-4822-9c01-c570f5ae6e87] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:51:58.030068 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e65a6a5c-36cb-4390-8cdd-34898f5d2c75 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:58.030592 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e65a6a5c-36cb-4390-8cdd-34898f5d2c75 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:58.038908 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e65a6a5c-36cb-4390-8cdd-34898f5d2c75 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:58.039788 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e65a6a5c-36cb-4390-8cdd-34898f5d2c75 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:58.040276 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e65a6a5c-36cb-4390-8cdd-34898f5d2c75 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:58.040714 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e65a6a5c-36cb-4390-8cdd-34898f5d2c75 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:58.106277 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=100 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:51:58.790362 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-d46e0dd0-90e2-4faf-bc3b-9850ee0c1453 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac650232cc04810b1340dc2f0edadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b0670d1bd99424780a70e69d57a2166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:58.806103 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-d46e0dd0-90e2-4faf-bc3b-9850ee0c1453 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "GET /compute/v2.1/servers/a0273e6e-eb85-4204-9bec-3707ad6612af" status: 200 len: 1508 microversion: 2.1 time: 0.920727 Oct 04 20:51:58.830987 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1977/3889] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:51:57 2022] GET /compute/v2.1/servers/a0273e6e-eb85-4204-9bec-3707ad6612af => generated 1508 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:51:58.839953 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-2867edeb-74b9-43ab-a36c-314a986c6ffc tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:51:58.845064 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-2867edeb-74b9-43ab-a36c-314a986c6ffc tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] [instance: 1ed60bf8-87e6-4a70-be59-830bee5f8b6d] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:51:58.859893 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2867edeb-74b9-43ab-a36c-314a986c6ffc tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:58.863906 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2867edeb-74b9-43ab-a36c-314a986c6ffc tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:58.864660 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2867edeb-74b9-43ab-a36c-314a986c6ffc tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:58.867833 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2867edeb-74b9-43ab-a36c-314a986c6ffc tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:58.868611 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2867edeb-74b9-43ab-a36c-314a986c6ffc tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:58.869299 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2867edeb-74b9-43ab-a36c-314a986c6ffc tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:58.911190 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e65a6a5c-36cb-4390-8cdd-34898f5d2c75 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b78af5c0485b4343900269160ef3e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659f3d4023b347d58bc0361db9ceead9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:58.929419 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e65a6a5c-36cb-4390-8cdd-34898f5d2c75 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b78af5c0485b4343900269160ef3e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659f3d4023b347d58bc0361db9ceead9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:58.936200 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e65a6a5c-36cb-4390-8cdd-34898f5d2c75 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b78af5c0485b4343900269160ef3e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659f3d4023b347d58bc0361db9ceead9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:58.940026 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e65a6a5c-36cb-4390-8cdd-34898f5d2c75 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] 10.222.0.33 "GET /compute/v2.1/servers/f8ba4e66-2997-4822-9c01-c570f5ae6e87" status: 200 len: 1875 microversion: 2.42 time: 0.944545 Oct 04 20:51:58.942249 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1913/3890] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:51:57 2022] GET /compute/v2.1/servers/f8ba4e66-2997-4822-9c01-c570f5ae6e87 => generated 1875 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:51:58.955983 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-197db2cd-89c4-426b-9c70-cf213a96b6b9 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:58.956856 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-197db2cd-89c4-426b-9c70-cf213a96b6b9 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] [instance: 30eb289d-d09c-43fa-af8a-3c6ee303f0af] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:51:58.976276 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-197db2cd-89c4-426b-9c70-cf213a96b6b9 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:58.979363 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-197db2cd-89c4-426b-9c70-cf213a96b6b9 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:58.980028 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-197db2cd-89c4-426b-9c70-cf213a96b6b9 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:58.980955 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-197db2cd-89c4-426b-9c70-cf213a96b6b9 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:58.986012 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-197db2cd-89c4-426b-9c70-cf213a96b6b9 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:58.986791 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-197db2cd-89c4-426b-9c70-cf213a96b6b9 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:59.068376 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-2867edeb-74b9-43ab-a36c-314a986c6ffc tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] 10.222.0.33 "POST /compute/v2.1/servers/1ed60bf8-87e6-4a70-be59-830bee5f8b6d/action" status: 202 len: 0 microversion: 2.1 time: 0.235862 Oct 04 20:51:59.069119 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1978/3891] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 20:51:58 2022] POST /compute/v2.1/servers/1ed60bf8-87e6-4a70-be59-830bee5f8b6d/action => generated 0 bytes in 238 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:51:59.085309 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-97b594cf-197e-459f-b8d8-46174a53332b tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:51:59.086063 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-97b594cf-197e-459f-b8d8-46174a53332b tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] [instance: 1ed60bf8-87e6-4a70-be59-830bee5f8b6d] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:51:59.103883 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-97b594cf-197e-459f-b8d8-46174a53332b tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:59.106762 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-97b594cf-197e-459f-b8d8-46174a53332b tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:59.107862 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-97b594cf-197e-459f-b8d8-46174a53332b tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:59.109951 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-97b594cf-197e-459f-b8d8-46174a53332b tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:51:59.111582 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-97b594cf-197e-459f-b8d8-46174a53332b tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:51:59.112035 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-97b594cf-197e-459f-b8d8-46174a53332b tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:51:59.955440 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-197db2cd-89c4-426b-9c70-cf213a96b6b9 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c208ec9faf491385a9ab5b5932098d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ae4960393c464c97669731c2084d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:51:59.955440 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-197db2cd-89c4-426b-9c70-cf213a96b6b9 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] 10.222.0.33 "GET /compute/v2.1/servers/30eb289d-d09c-43fa-af8a-3c6ee303f0af" status: 200 len: 1500 microversion: 2.1 time: 1.001779 Oct 04 20:51:59.955440 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1914/3892] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:51:58 2022] GET /compute/v2.1/servers/30eb289d-d09c-43fa-af8a-3c6ee303f0af => generated 1500 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:52:00.014684 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0195a2b9-3058-4610-b471-88a4f7282ab2 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:00.015332 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-0195a2b9-3058-4610-b471-88a4f7282ab2 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: a0273e6e-eb85-4204-9bec-3707ad6612af] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:00.032106 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0195a2b9-3058-4610-b471-88a4f7282ab2 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:00.032673 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0195a2b9-3058-4610-b471-88a4f7282ab2 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:00.033369 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0195a2b9-3058-4610-b471-88a4f7282ab2 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:00.034092 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0195a2b9-3058-4610-b471-88a4f7282ab2 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:00.034727 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0195a2b9-3058-4610-b471-88a4f7282ab2 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:00.040496 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0195a2b9-3058-4610-b471-88a4f7282ab2 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:00.095382 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-97b594cf-197e-459f-b8d8-46174a53332b tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc4171c0ee14ebb8b5eff5e910ccf49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003eb03a265a496d8981e45c74b014f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:00.105458 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-97b594cf-197e-459f-b8d8-46174a53332b tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] 10.222.0.33 "GET /compute/v2.1/servers/1ed60bf8-87e6-4a70-be59-830bee5f8b6d" status: 200 len: 1510 microversion: 2.1 time: 1.030831 Oct 04 20:52:00.107846 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1979/3893] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:51:59 2022] GET /compute/v2.1/servers/1ed60bf8-87e6-4a70-be59-830bee5f8b6d => generated 1510 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:52:00.119266 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-6fa44a5b-5dae-4a4e-ac77-158ae1c37673 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:52:00.120435 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-6fa44a5b-5dae-4a4e-ac77-158ae1c37673 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] [instance: 30eb289d-d09c-43fa-af8a-3c6ee303f0af] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:00.139267 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6fa44a5b-5dae-4a4e-ac77-158ae1c37673 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:00.139928 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6fa44a5b-5dae-4a4e-ac77-158ae1c37673 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:00.140498 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6fa44a5b-5dae-4a4e-ac77-158ae1c37673 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:00.141413 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6fa44a5b-5dae-4a4e-ac77-158ae1c37673 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:00.143942 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6fa44a5b-5dae-4a4e-ac77-158ae1c37673 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:00.144491 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6fa44a5b-5dae-4a4e-ac77-158ae1c37673 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:00.187783 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.objects.instance [None req-6fa44a5b-5dae-4a4e-ac77-158ae1c37673 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lazy-loading 'flavor' on Instance uuid 30eb289d-d09c-43fa-af8a-3c6ee303f0af {{(pid=128802) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:52:00.576188 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-0195a2b9-3058-4610-b471-88a4f7282ab2 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac650232cc04810b1340dc2f0edadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b0670d1bd99424780a70e69d57a2166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:00.600287 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-0195a2b9-3058-4610-b471-88a4f7282ab2 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "GET /compute/v2.1/servers/a0273e6e-eb85-4204-9bec-3707ad6612af" status: 200 len: 1508 microversion: 2.1 time: 0.649647 Oct 04 20:52:00.621362 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1915/3894] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:51:59 2022] GET /compute/v2.1/servers/a0273e6e-eb85-4204-9bec-3707ad6612af => generated 1508 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:52:00.629193 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b789902a-51ba-4afd-bc08-ebb6fe0a7772 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:00.630140 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b789902a-51ba-4afd-bc08-ebb6fe0a7772 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] [instance: f8ba4e66-2997-4822-9c01-c570f5ae6e87] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:00.636571 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=3 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:52:00.640669 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b789902a-51ba-4afd-bc08-ebb6fe0a7772 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:00.641606 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b789902a-51ba-4afd-bc08-ebb6fe0a7772 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:00.642257 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b789902a-51ba-4afd-bc08-ebb6fe0a7772 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:00.644979 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b789902a-51ba-4afd-bc08-ebb6fe0a7772 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:00.645728 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b789902a-51ba-4afd-bc08-ebb6fe0a7772 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:00.646791 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b789902a-51ba-4afd-bc08-ebb6fe0a7772 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:00.658711 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-6fa44a5b-5dae-4a4e-ac77-158ae1c37673 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] 10.222.0.33 "POST /compute/v2.1/servers/30eb289d-d09c-43fa-af8a-3c6ee303f0af/action" status: 202 len: 0 microversion: 2.1 time: 0.544151 Oct 04 20:52:00.659560 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1980/3895] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 20:52:00 2022] POST /compute/v2.1/servers/30eb289d-d09c-43fa-af8a-3c6ee303f0af/action => generated 0 bytes in 551 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:52:00.675250 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-4c687750-703d-4e83-85f4-ee4790cdc9fe tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:00.675814 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-4c687750-703d-4e83-85f4-ee4790cdc9fe tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] [instance: 30eb289d-d09c-43fa-af8a-3c6ee303f0af] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:00.698495 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4c687750-703d-4e83-85f4-ee4790cdc9fe tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:00.700320 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4c687750-703d-4e83-85f4-ee4790cdc9fe tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:00.700794 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4c687750-703d-4e83-85f4-ee4790cdc9fe tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:00.702635 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4c687750-703d-4e83-85f4-ee4790cdc9fe tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:00.705249 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4c687750-703d-4e83-85f4-ee4790cdc9fe tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:00.705715 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4c687750-703d-4e83-85f4-ee4790cdc9fe tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:01.264203 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-b789902a-51ba-4afd-bc08-ebb6fe0a7772 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b78af5c0485b4343900269160ef3e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659f3d4023b347d58bc0361db9ceead9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:01.277160 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-b789902a-51ba-4afd-bc08-ebb6fe0a7772 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b78af5c0485b4343900269160ef3e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659f3d4023b347d58bc0361db9ceead9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:01.279320 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-b789902a-51ba-4afd-bc08-ebb6fe0a7772 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b78af5c0485b4343900269160ef3e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659f3d4023b347d58bc0361db9ceead9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:01.280776 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b789902a-51ba-4afd-bc08-ebb6fe0a7772 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] 10.222.0.33 "GET /compute/v2.1/servers/f8ba4e66-2997-4822-9c01-c570f5ae6e87" status: 200 len: 1875 microversion: 2.42 time: 0.657798 Oct 04 20:52:01.281577 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1916/3896] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:52:00 2022] GET /compute/v2.1/servers/f8ba4e66-2997-4822-9c01-c570f5ae6e87 => generated 1875 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:52:01.290989 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b7d4a634-70eb-4c88-8e25-68e6baf51559 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:01.291985 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b7d4a634-70eb-4c88-8e25-68e6baf51559 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] [instance: 1ed60bf8-87e6-4a70-be59-830bee5f8b6d] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:01.301971 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b7d4a634-70eb-4c88-8e25-68e6baf51559 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:01.302935 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b7d4a634-70eb-4c88-8e25-68e6baf51559 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:01.303608 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b7d4a634-70eb-4c88-8e25-68e6baf51559 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:01.306235 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b7d4a634-70eb-4c88-8e25-68e6baf51559 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:01.308804 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b7d4a634-70eb-4c88-8e25-68e6baf51559 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:01.310500 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b7d4a634-70eb-4c88-8e25-68e6baf51559 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:01.374212 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-4c687750-703d-4e83-85f4-ee4790cdc9fe tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c208ec9faf491385a9ab5b5932098d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ae4960393c464c97669731c2084d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:01.402873 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-4c687750-703d-4e83-85f4-ee4790cdc9fe tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] 10.222.0.33 "GET /compute/v2.1/servers/30eb289d-d09c-43fa-af8a-3c6ee303f0af" status: 200 len: 1506 microversion: 2.1 time: 0.734202 Oct 04 20:52:01.407759 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1981/3897] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:52:00 2022] GET /compute/v2.1/servers/30eb289d-d09c-43fa-af8a-3c6ee303f0af => generated 1506 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:52:01.633925 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-b0de687d-88a0-48e8-a997-49bd9531701a tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:01.635033 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-b0de687d-88a0-48e8-a997-49bd9531701a tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: a0273e6e-eb85-4204-9bec-3707ad6612af] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:01.648936 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b0de687d-88a0-48e8-a997-49bd9531701a tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:01.649883 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b0de687d-88a0-48e8-a997-49bd9531701a tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:01.650633 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b0de687d-88a0-48e8-a997-49bd9531701a tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:01.652010 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b0de687d-88a0-48e8-a997-49bd9531701a tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:01.652934 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b0de687d-88a0-48e8-a997-49bd9531701a tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:01.655021 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b0de687d-88a0-48e8-a997-49bd9531701a tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:01.752406 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-b7d4a634-70eb-4c88-8e25-68e6baf51559 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc4171c0ee14ebb8b5eff5e910ccf49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003eb03a265a496d8981e45c74b014f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:01.772148 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b7d4a634-70eb-4c88-8e25-68e6baf51559 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] 10.222.0.33 "GET /compute/v2.1/servers/1ed60bf8-87e6-4a70-be59-830bee5f8b6d" status: 200 len: 1510 microversion: 2.1 time: 0.489264 Oct 04 20:52:01.786367 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1917/3898] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:52:01 2022] GET /compute/v2.1/servers/1ed60bf8-87e6-4a70-be59-830bee5f8b6d => generated 1510 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:52:02.115930 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-b0de687d-88a0-48e8-a997-49bd9531701a tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac650232cc04810b1340dc2f0edadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b0670d1bd99424780a70e69d57a2166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:02.126947 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-b0de687d-88a0-48e8-a997-49bd9531701a tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "GET /compute/v2.1/servers/a0273e6e-eb85-4204-9bec-3707ad6612af" status: 200 len: 1508 microversion: 2.1 time: 0.501546 Oct 04 20:52:02.127532 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1982/3899] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:52:01 2022] GET /compute/v2.1/servers/a0273e6e-eb85-4204-9bec-3707ad6612af => generated 1508 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:52:02.322631 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-29f41a59-0c5c-4423-a920-dd1c279368c4 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:02.323286 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-29f41a59-0c5c-4423-a920-dd1c279368c4 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] [instance: f8ba4e66-2997-4822-9c01-c570f5ae6e87] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:02.340158 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-29f41a59-0c5c-4423-a920-dd1c279368c4 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:02.341078 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-29f41a59-0c5c-4423-a920-dd1c279368c4 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:02.342067 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-29f41a59-0c5c-4423-a920-dd1c279368c4 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:02.343295 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-29f41a59-0c5c-4423-a920-dd1c279368c4 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:02.344009 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-29f41a59-0c5c-4423-a920-dd1c279368c4 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:02.344782 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-29f41a59-0c5c-4423-a920-dd1c279368c4 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:02.430888 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-d272b916-4ff8-4d87-9f11-e4252234202e tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:02.432322 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-d272b916-4ff8-4d87-9f11-e4252234202e tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] [instance: 30eb289d-d09c-43fa-af8a-3c6ee303f0af] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:02.476163 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d272b916-4ff8-4d87-9f11-e4252234202e tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:02.476859 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d272b916-4ff8-4d87-9f11-e4252234202e tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:02.483345 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d272b916-4ff8-4d87-9f11-e4252234202e tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:02.489963 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d272b916-4ff8-4d87-9f11-e4252234202e tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:02.490652 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d272b916-4ff8-4d87-9f11-e4252234202e tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:02.491111 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d272b916-4ff8-4d87-9f11-e4252234202e tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:03.322978 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-29f41a59-0c5c-4423-a920-dd1c279368c4 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b78af5c0485b4343900269160ef3e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659f3d4023b347d58bc0361db9ceead9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:03.336198 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-29f41a59-0c5c-4423-a920-dd1c279368c4 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b78af5c0485b4343900269160ef3e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659f3d4023b347d58bc0361db9ceead9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:03.337636 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-29f41a59-0c5c-4423-a920-dd1c279368c4 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b78af5c0485b4343900269160ef3e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659f3d4023b347d58bc0361db9ceead9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:03.338820 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-29f41a59-0c5c-4423-a920-dd1c279368c4 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] 10.222.0.33 "GET /compute/v2.1/servers/f8ba4e66-2997-4822-9c01-c570f5ae6e87" status: 200 len: 1875 microversion: 2.42 time: 1.020978 Oct 04 20:52:03.346739 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1918/3900] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:52:02 2022] GET /compute/v2.1/servers/f8ba4e66-2997-4822-9c01-c570f5ae6e87 => generated 1875 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:52:03.359129 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a22ac891-7abf-4eb5-a4f0-52d539954639 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:03.360161 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a22ac891-7abf-4eb5-a4f0-52d539954639 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] [instance: 1ed60bf8-87e6-4a70-be59-830bee5f8b6d] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:03.373873 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a22ac891-7abf-4eb5-a4f0-52d539954639 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:03.376662 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a22ac891-7abf-4eb5-a4f0-52d539954639 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:03.377208 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a22ac891-7abf-4eb5-a4f0-52d539954639 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:03.379067 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a22ac891-7abf-4eb5-a4f0-52d539954639 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:03.379659 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a22ac891-7abf-4eb5-a4f0-52d539954639 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:03.381089 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a22ac891-7abf-4eb5-a4f0-52d539954639 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:03.710632 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-a22ac891-7abf-4eb5-a4f0-52d539954639 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc4171c0ee14ebb8b5eff5e910ccf49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003eb03a265a496d8981e45c74b014f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:03.718057 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-d272b916-4ff8-4d87-9f11-e4252234202e tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c208ec9faf491385a9ab5b5932098d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ae4960393c464c97669731c2084d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:03.728945 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a22ac891-7abf-4eb5-a4f0-52d539954639 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] 10.222.0.33 "GET /compute/v2.1/servers/1ed60bf8-87e6-4a70-be59-830bee5f8b6d" status: 200 len: 1516 microversion: 2.1 time: 0.380644 Oct 04 20:52:03.729139 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-d272b916-4ff8-4d87-9f11-e4252234202e tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] 10.222.0.33 "GET /compute/v2.1/servers/30eb289d-d09c-43fa-af8a-3c6ee303f0af" status: 200 len: 1506 microversion: 2.1 time: 1.302615 Oct 04 20:52:03.731572 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1919/3901] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:52:03 2022] GET /compute/v2.1/servers/1ed60bf8-87e6-4a70-be59-830bee5f8b6d => generated 1516 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:52:03.742547 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-48b1013f-2586-4728-b95f-d2441b7e5ea2 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:03.743527 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-48b1013f-2586-4728-b95f-d2441b7e5ea2 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: a0273e6e-eb85-4204-9bec-3707ad6612af] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:03.745415 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1983/3902] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:52:02 2022] GET /compute/v2.1/servers/30eb289d-d09c-43fa-af8a-3c6ee303f0af => generated 1506 bytes in 1321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:52:03.772693 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-48b1013f-2586-4728-b95f-d2441b7e5ea2 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:03.773736 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-48b1013f-2586-4728-b95f-d2441b7e5ea2 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:03.774399 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-48b1013f-2586-4728-b95f-d2441b7e5ea2 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:03.777235 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-48b1013f-2586-4728-b95f-d2441b7e5ea2 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:03.777923 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-48b1013f-2586-4728-b95f-d2441b7e5ea2 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:03.778645 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-48b1013f-2586-4728-b95f-d2441b7e5ea2 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:04.316039 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-48b1013f-2586-4728-b95f-d2441b7e5ea2 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac650232cc04810b1340dc2f0edadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b0670d1bd99424780a70e69d57a2166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:04.324229 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-48b1013f-2586-4728-b95f-d2441b7e5ea2 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "GET /compute/v2.1/servers/a0273e6e-eb85-4204-9bec-3707ad6612af" status: 200 len: 1505 microversion: 2.1 time: 0.591016 Oct 04 20:52:04.331081 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1920/3903] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:52:03 2022] GET /compute/v2.1/servers/a0273e6e-eb85-4204-9bec-3707ad6612af => generated 1505 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:52:04.375694 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c5948786-dfea-4c27-943e-f7a741a237bd tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:04.376261 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c5948786-dfea-4c27-943e-f7a741a237bd tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] [instance: f8ba4e66-2997-4822-9c01-c570f5ae6e87] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:04.408728 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-de685a65-4830-4c1f-bae4-aa7bb11fd19c tempest-KeyPairsV2TestJSON-1898218821 tempest-KeyPairsV2TestJSON-1898218821-project] Action: 'create', calling method: .version_select at 0x7f3c6f61aca0>, body: {"keypair": {"name": "tempest-keypair-235962479", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBgEfmMorWRZ/7lzWrgSntssdNdzmgNDXIWLf+jC00eODeOdMDPyaVdWmLpCRSpRsyloriMQ/1ZFEvpeUkAVZotTI2i1FwhTAe6QvLvuv56dwBmqL/iDfVJ+CvSO7NyJ7A=="}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:52:04.416765 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c5948786-dfea-4c27-943e-f7a741a237bd tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:04.417326 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c5948786-dfea-4c27-943e-f7a741a237bd tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:04.422994 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c5948786-dfea-4c27-943e-f7a741a237bd tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:04.429791 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c5948786-dfea-4c27-943e-f7a741a237bd tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:04.430455 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c5948786-dfea-4c27-943e-f7a741a237bd tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:04.434895 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c5948786-dfea-4c27-943e-f7a741a237bd tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:04.496214 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-de685a65-4830-4c1f-bae4-aa7bb11fd19c tempest-KeyPairsV2TestJSON-1898218821 tempest-KeyPairsV2TestJSON-1898218821-project] Getting quotas for project 03d83d3a4ed14691bfedf250933bc331. Resources: {'key_pairs'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:52:04.507668 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-de685a65-4830-4c1f-bae4-aa7bb11fd19c tempest-KeyPairsV2TestJSON-1898218821 tempest-KeyPairsV2TestJSON-1898218821-project] Getting quotas for user f192ec3ba86c45ed9be4315a6dae73a3 and project 03d83d3a4ed14691bfedf250933bc331. Resources: {'key_pairs'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:52:04.557675 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-de685a65-4830-4c1f-bae4-aa7bb11fd19c tempest-KeyPairsV2TestJSON-1898218821 tempest-KeyPairsV2TestJSON-1898218821-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.803366 Oct 04 20:52:04.558656 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1984/3904] 10.222.0.33 () {60 vars in 1159 bytes} [Tue Oct 4 20:52:03 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:52:04.582027 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-c4bdfe21-bc53-426e-82d7-f894cab20bf9 tempest-KeyPairsV2TestJSON-1898218821 tempest-KeyPairsV2TestJSON-1898218821-project] Calling method '.version_select at 0x7f3c6f75e430>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:04.619842 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-c4bdfe21-bc53-426e-82d7-f894cab20bf9 tempest-KeyPairsV2TestJSON-1898218821 tempest-KeyPairsV2TestJSON-1898218821-project] 10.222.0.33 "GET /compute/v2.1/os-keypairs/tempest-keypair-235962479" status: 200 len: 497 microversion: 2.1 time: 0.050544 Oct 04 20:52:04.625375 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1985/3905] 10.222.0.33 () {58 vars in 1215 bytes} [Tue Oct 4 20:52:04 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-235962479 => generated 497 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:52:04.646233 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-c260240e-f8c1-487a-acf3-bee5bf186511 tempest-KeyPairsV2TestJSON-1898218821 tempest-KeyPairsV2TestJSON-1898218821-project] Calling method '.version_select at 0x7f3c6f66d9d0>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:04.711718 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-c260240e-f8c1-487a-acf3-bee5bf186511 tempest-KeyPairsV2TestJSON-1898218821 tempest-KeyPairsV2TestJSON-1898218821-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-235962479" status: 202 len: 0 microversion: 2.1 time: 0.072455 Oct 04 20:52:04.712636 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1986/3906] 10.222.0.33 () {58 vars in 1218 bytes} [Tue Oct 4 20:52:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-235962479 => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:52:04.735322 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-53f63eb2-9f01-4e18-8203-d9295db2e124 tempest-KeyPairsV2TestJSON-1898218821 tempest-KeyPairsV2TestJSON-1898218821-project] Action: 'create', calling method: .version_select at 0x7f3c6f5c3ca0>, body: {"keypair": {"name": "tempest-keypair-1485619181", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMQnUbD3kTP6PzhZrRPVwG8UkYqyhB6ltAnHoAqvUOMgfmgBYQL86Ed64BRW2oZSo5UW5q0kPnDIlWXRDoTIY7nEFL+n9kBfkPYLSryp8dm8MfdZlzOqBTctXBJeutK5Ew=="}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:52:04.777991 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-53f63eb2-9f01-4e18-8203-d9295db2e124 tempest-KeyPairsV2TestJSON-1898218821 tempest-KeyPairsV2TestJSON-1898218821-project] Getting quotas for project 03d83d3a4ed14691bfedf250933bc331. Resources: {'key_pairs'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:52:04.788712 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-53f63eb2-9f01-4e18-8203-d9295db2e124 tempest-KeyPairsV2TestJSON-1898218821 tempest-KeyPairsV2TestJSON-1898218821-project] Getting quotas for user f192ec3ba86c45ed9be4315a6dae73a3 and project 03d83d3a4ed14691bfedf250933bc331. Resources: {'key_pairs'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:52:04.843096 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-53f63eb2-9f01-4e18-8203-d9295db2e124 tempest-KeyPairsV2TestJSON-1898218821 tempest-KeyPairsV2TestJSON-1898218821-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.119797 Oct 04 20:52:04.844614 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1987/3907] 10.222.0.33 () {60 vars in 1159 bytes} [Tue Oct 4 20:52:04 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:52:04.859051 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-4a0a9b93-136a-48ab-8351-c7658a3ebd44 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:04.860980 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-4a0a9b93-136a-48ab-8351-c7658a3ebd44 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] [instance: 30eb289d-d09c-43fa-af8a-3c6ee303f0af] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:04.876301 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4a0a9b93-136a-48ab-8351-c7658a3ebd44 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:04.877182 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4a0a9b93-136a-48ab-8351-c7658a3ebd44 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:04.877664 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4a0a9b93-136a-48ab-8351-c7658a3ebd44 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:04.879950 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4a0a9b93-136a-48ab-8351-c7658a3ebd44 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:04.881014 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4a0a9b93-136a-48ab-8351-c7658a3ebd44 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:04.881727 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4a0a9b93-136a-48ab-8351-c7658a3ebd44 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:04.964107 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c5948786-dfea-4c27-943e-f7a741a237bd tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b78af5c0485b4343900269160ef3e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659f3d4023b347d58bc0361db9ceead9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:04.981078 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c5948786-dfea-4c27-943e-f7a741a237bd tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b78af5c0485b4343900269160ef3e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659f3d4023b347d58bc0361db9ceead9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:04.987840 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c5948786-dfea-4c27-943e-f7a741a237bd tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b78af5c0485b4343900269160ef3e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659f3d4023b347d58bc0361db9ceead9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:04.989153 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c5948786-dfea-4c27-943e-f7a741a237bd tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] 10.222.0.33 "GET /compute/v2.1/servers/f8ba4e66-2997-4822-9c01-c570f5ae6e87" status: 200 len: 1875 microversion: 2.42 time: 0.619152 Oct 04 20:52:04.992111 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1921/3908] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:52:04 2022] GET /compute/v2.1/servers/f8ba4e66-2997-4822-9c01-c570f5ae6e87 => generated 1875 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 20:52:05.019248 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-29127f18-5813-417f-9b24-17834eded6da tempest-KeyPairsV2TestJSON-1898218821 tempest-KeyPairsV2TestJSON-1898218821-project] Calling method '.version_select at 0x7f3c787f0430>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:05.044980 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-29127f18-5813-417f-9b24-17834eded6da tempest-KeyPairsV2TestJSON-1898218821 tempest-KeyPairsV2TestJSON-1898218821-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1485619181" status: 202 len: 0 microversion: 2.1 time: 0.029027 Oct 04 20:52:05.047088 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1922/3909] 10.222.0.33 () {58 vars in 1221 bytes} [Tue Oct 4 20:52:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1485619181 => generated 0 bytes in 54 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:52:05.065744 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-141e1675-4ed5-4c0c-b316-d44969ab3de8 tempest-KeyPairsV2TestJSON-1898218821 tempest-KeyPairsV2TestJSON-1898218821-project] Action: 'create', calling method: .version_select at 0x7f3c6fa4d040>, body: {"keypair": {"name": "tempest-keypair-2091700711", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:52:05.129386 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-141e1675-4ed5-4c0c-b316-d44969ab3de8 tempest-KeyPairsV2TestJSON-1898218821 tempest-KeyPairsV2TestJSON-1898218821-project] Getting quotas for project 03d83d3a4ed14691bfedf250933bc331. Resources: {'key_pairs'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:52:05.143442 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-141e1675-4ed5-4c0c-b316-d44969ab3de8 tempest-KeyPairsV2TestJSON-1898218821 tempest-KeyPairsV2TestJSON-1898218821-project] Getting quotas for user f192ec3ba86c45ed9be4315a6dae73a3 and project 03d83d3a4ed14691bfedf250933bc331. Resources: {'key_pairs'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:52:05.210671 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-141e1675-4ed5-4c0c-b316-d44969ab3de8 tempest-KeyPairsV2TestJSON-1898218821 tempest-KeyPairsV2TestJSON-1898218821-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 574 microversion: 2.1 time: 0.157696 Oct 04 20:52:05.211677 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1923/3910] 10.222.0.33 () {60 vars in 1159 bytes} [Tue Oct 4 20:52:05 2022] POST /compute/v2.1/os-keypairs => generated 574 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:52:05.222041 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-184d1787-b880-44e9-8334-a2f4ebf326c4 tempest-KeyPairsV2TestJSON-1898218821 tempest-KeyPairsV2TestJSON-1898218821-project] Calling method '.version_select at 0x7f3c788ab940>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:05.274025 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-184d1787-b880-44e9-8334-a2f4ebf326c4 tempest-KeyPairsV2TestJSON-1898218821 tempest-KeyPairsV2TestJSON-1898218821-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2091700711" status: 202 len: 0 microversion: 2.1 time: 0.055775 Oct 04 20:52:05.274665 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1924/3911] 10.222.0.33 () {58 vars in 1221 bytes} [Tue Oct 4 20:52:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2091700711 => generated 0 bytes in 57 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:52:05.280359 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-4a0a9b93-136a-48ab-8351-c7658a3ebd44 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c208ec9faf491385a9ab5b5932098d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ae4960393c464c97669731c2084d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:05.287055 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ec5c0b82-ff23-4534-8356-cac9dc86c07a tempest-KeyPairsV2TestJSON-1898218821 tempest-KeyPairsV2TestJSON-1898218821-project] Action: 'create', calling method: .version_select at 0x7f3c746bec10>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1291177105", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAGe7lKAOWdvsROL1VI66qpOIKY/ANg47c4sjRboO1QT+gOg6MiUt25Y6X3datwbt4q/BKnqQR8/0XepQ99trvmjTqJqWBD5uTK4jqstltSQwLxH0KxNZZ4Xi1B7csUsuA=="}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:52:05.292584 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-4a0a9b93-136a-48ab-8351-c7658a3ebd44 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] 10.222.0.33 "GET /compute/v2.1/servers/30eb289d-d09c-43fa-af8a-3c6ee303f0af" status: 200 len: 1506 microversion: 2.1 time: 0.446313 Oct 04 20:52:05.304037 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1988/3912] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:52:04 2022] GET /compute/v2.1/servers/30eb289d-d09c-43fa-af8a-3c6ee303f0af => generated 1506 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:52:05.321719 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-ec5c0b82-ff23-4534-8356-cac9dc86c07a tempest-KeyPairsV2TestJSON-1898218821 tempest-KeyPairsV2TestJSON-1898218821-project] Getting quotas for project 03d83d3a4ed14691bfedf250933bc331. Resources: {'key_pairs'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:52:05.330690 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-ec5c0b82-ff23-4534-8356-cac9dc86c07a tempest-KeyPairsV2TestJSON-1898218821 tempest-KeyPairsV2TestJSON-1898218821-project] Getting quotas for user f192ec3ba86c45ed9be4315a6dae73a3 and project 03d83d3a4ed14691bfedf250933bc331. Resources: {'key_pairs'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:52:05.351981 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-4c49d699-96ff-4a33-8904-5953c86c3ec4 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:05.352741 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-4c49d699-96ff-4a33-8904-5953c86c3ec4 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: a0273e6e-eb85-4204-9bec-3707ad6612af] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:05.361829 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4c49d699-96ff-4a33-8904-5953c86c3ec4 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:05.362371 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4c49d699-96ff-4a33-8904-5953c86c3ec4 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:05.362873 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4c49d699-96ff-4a33-8904-5953c86c3ec4 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:05.370788 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4c49d699-96ff-4a33-8904-5953c86c3ec4 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:05.371417 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4c49d699-96ff-4a33-8904-5953c86c3ec4 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:05.372557 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4c49d699-96ff-4a33-8904-5953c86c3ec4 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:05.390096 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ec5c0b82-ff23-4534-8356-cac9dc86c07a tempest-KeyPairsV2TestJSON-1898218821 tempest-KeyPairsV2TestJSON-1898218821-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.107630 Oct 04 20:52:05.394762 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1925/3913] 10.222.0.33 () {60 vars in 1159 bytes} [Tue Oct 4 20:52:05 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 20:52:05.405086 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5ff40ef6-7d4e-44fc-ada0-8933a965038d tempest-KeyPairsV2TestJSON-1898218821 tempest-KeyPairsV2TestJSON-1898218821-project] Action: 'create', calling method: .version_select at 0x7f3c78855f70>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1673685380", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLIp0cZzeiViUoNMjy7kTP8Q0yITISB3pu0LaP0V2v3924HHwhtkZIFj0t8MlSKlM+tx5li1peU2xaMZ547TFEpY2r/cLtnrbGaxgvb2OvhhPR0y8YOMhrbjnWgLloJlcw=="}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:52:05.427321 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:52:05.458206 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-5ff40ef6-7d4e-44fc-ada0-8933a965038d tempest-KeyPairsV2TestJSON-1898218821 tempest-KeyPairsV2TestJSON-1898218821-project] Getting quotas for project 03d83d3a4ed14691bfedf250933bc331. Resources: {'key_pairs'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:52:05.468095 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-5ff40ef6-7d4e-44fc-ada0-8933a965038d tempest-KeyPairsV2TestJSON-1898218821 tempest-KeyPairsV2TestJSON-1898218821-project] Getting quotas for user f192ec3ba86c45ed9be4315a6dae73a3 and project 03d83d3a4ed14691bfedf250933bc331. Resources: {'key_pairs'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:52:05.514227 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5ff40ef6-7d4e-44fc-ada0-8933a965038d tempest-KeyPairsV2TestJSON-1898218821 tempest-KeyPairsV2TestJSON-1898218821-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.112794 Oct 04 20:52:05.515789 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1926/3914] 10.222.0.33 () {60 vars in 1159 bytes} [Tue Oct 4 20:52:05 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:52:05.529062 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-61a815a0-56e6-438f-b7ce-beff856682ad tempest-KeyPairsV2TestJSON-1898218821 tempest-KeyPairsV2TestJSON-1898218821-project] Action: 'create', calling method: .version_select at 0x7f3c6f510940>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-708694237", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCAEjJ5iGRMDnGEuEL7BF3gf+fMaJzxVdT0s1RfiKvdU/f8uhFk2D194rYVbNI1H+xltveawHsAFU/Wbkw4EJi4f5yzowzec9EpF9RV1XA7pYCECkx7zYj7lOEci70vhJg=="}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:52:05.580733 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-61a815a0-56e6-438f-b7ce-beff856682ad tempest-KeyPairsV2TestJSON-1898218821 tempest-KeyPairsV2TestJSON-1898218821-project] Getting quotas for project 03d83d3a4ed14691bfedf250933bc331. Resources: {'key_pairs'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:52:05.593054 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-61a815a0-56e6-438f-b7ce-beff856682ad tempest-KeyPairsV2TestJSON-1898218821 tempest-KeyPairsV2TestJSON-1898218821-project] Getting quotas for user f192ec3ba86c45ed9be4315a6dae73a3 and project 03d83d3a4ed14691bfedf250933bc331. Resources: {'key_pairs'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:52:05.643796 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-4c49d699-96ff-4a33-8904-5953c86c3ec4 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac650232cc04810b1340dc2f0edadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b0670d1bd99424780a70e69d57a2166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:05.657828 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-4c49d699-96ff-4a33-8904-5953c86c3ec4 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "GET /compute/v2.1/servers/a0273e6e-eb85-4204-9bec-3707ad6612af" status: 200 len: 1505 microversion: 2.1 time: 0.310377 Oct 04 20:52:05.659430 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-61a815a0-56e6-438f-b7ce-beff856682ad tempest-KeyPairsV2TestJSON-1898218821 tempest-KeyPairsV2TestJSON-1898218821-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.134653 Oct 04 20:52:05.660649 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1989/3915] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:52:05 2022] GET /compute/v2.1/servers/a0273e6e-eb85-4204-9bec-3707ad6612af => generated 1505 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:52:05.676647 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1927/3916] 10.222.0.33 () {60 vars in 1159 bytes} [Tue Oct 4 20:52:05 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:52:05.709293 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-f9e1f43c-1fc8-4f4e-9a52-74da4afc7ceb tempest-KeyPairsV2TestJSON-1898218821 tempest-KeyPairsV2TestJSON-1898218821-project] Calling method '.version_select at 0x7f3c6f632700>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:05.717374 n-d-854823-8 devstack@n-api.service[128802]: WARNING oslo_db.sqlalchemy.utils [None req-f9e1f43c-1fc8-4f4e-9a52-74da4afc7ceb tempest-KeyPairsV2TestJSON-1898218821 tempest-KeyPairsV2TestJSON-1898218821-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 04 20:52:05.721997 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=2,nova_api:DELETE=1 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:52:05.724986 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-f9e1f43c-1fc8-4f4e-9a52-74da4afc7ceb tempest-KeyPairsV2TestJSON-1898218821 tempest-KeyPairsV2TestJSON-1898218821-project] 10.222.0.33 "GET /compute/v2.1/os-keypairs" status: 200 len: 1093 microversion: 2.1 time: 0.040514 Oct 04 20:52:05.725587 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1990/3917] 10.222.0.33 () {58 vars in 1137 bytes} [Tue Oct 4 20:52:05 2022] GET /compute/v2.1/os-keypairs => generated 1093 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:52:05.738083 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-eed736cc-686b-4013-ab98-ed1e0d183393 tempest-KeyPairsV2TestJSON-1898218821 tempest-KeyPairsV2TestJSON-1898218821-project] Calling method '.version_select at 0x7f3c788ab1f0>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:05.767389 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-eed736cc-686b-4013-ab98-ed1e0d183393 tempest-KeyPairsV2TestJSON-1898218821 tempest-KeyPairsV2TestJSON-1898218821-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-708694237" status: 202 len: 0 microversion: 2.1 time: 0.033684 Oct 04 20:52:05.768454 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1928/3918] 10.222.0.33 () {58 vars in 1275 bytes} [Tue Oct 4 20:52:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-708694237 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:52:05.777437 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-20e8e7db-c6a6-427c-95f9-adaff3f8743e tempest-KeyPairsV2TestJSON-1898218821 tempest-KeyPairsV2TestJSON-1898218821-project] Calling method '.version_select at 0x7f3c789571f0>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:05.839011 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-20e8e7db-c6a6-427c-95f9-adaff3f8743e tempest-KeyPairsV2TestJSON-1898218821 tempest-KeyPairsV2TestJSON-1898218821-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1673685380" status: 202 len: 0 microversion: 2.1 time: 0.065454 Oct 04 20:52:05.839817 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1991/3919] 10.222.0.33 () {58 vars in 1278 bytes} [Tue Oct 4 20:52:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1673685380 => generated 0 bytes in 67 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:52:05.861392 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ed472085-868a-42ba-9b1c-1987b6f793ed tempest-KeyPairsV2TestJSON-1898218821 tempest-KeyPairsV2TestJSON-1898218821-project] Calling method '.version_select at 0x7f3c6f510af0>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:05.920322 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ed472085-868a-42ba-9b1c-1987b6f793ed tempest-KeyPairsV2TestJSON-1898218821 tempest-KeyPairsV2TestJSON-1898218821-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1291177105" status: 202 len: 0 microversion: 2.1 time: 0.075177 Oct 04 20:52:05.921343 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1929/3920] 10.222.0.33 () {58 vars in 1278 bytes} [Tue Oct 4 20:52:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1291177105 => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:52:06.023663 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-27186de6-9164-464d-a7a3-e172b1afd700 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:06.024473 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-27186de6-9164-464d-a7a3-e172b1afd700 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] [instance: f8ba4e66-2997-4822-9c01-c570f5ae6e87] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:06.040237 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-27186de6-9164-464d-a7a3-e172b1afd700 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:06.040742 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-27186de6-9164-464d-a7a3-e172b1afd700 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:06.041212 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-27186de6-9164-464d-a7a3-e172b1afd700 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:06.042068 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-27186de6-9164-464d-a7a3-e172b1afd700 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:06.042730 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-27186de6-9164-464d-a7a3-e172b1afd700 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:06.050196 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-27186de6-9164-464d-a7a3-e172b1afd700 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:06.325373 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-272a6c93-15a0-42fc-8985-8b71d5f56a72 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:06.326793 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-272a6c93-15a0-42fc-8985-8b71d5f56a72 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] [instance: 30eb289d-d09c-43fa-af8a-3c6ee303f0af] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:06.350476 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-272a6c93-15a0-42fc-8985-8b71d5f56a72 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:06.351120 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-272a6c93-15a0-42fc-8985-8b71d5f56a72 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:06.351706 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-272a6c93-15a0-42fc-8985-8b71d5f56a72 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:06.352632 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-272a6c93-15a0-42fc-8985-8b71d5f56a72 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:06.353276 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-272a6c93-15a0-42fc-8985-8b71d5f56a72 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:06.353882 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-272a6c93-15a0-42fc-8985-8b71d5f56a72 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:06.394738 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-27186de6-9164-464d-a7a3-e172b1afd700 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b78af5c0485b4343900269160ef3e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659f3d4023b347d58bc0361db9ceead9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:06.411217 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-27186de6-9164-464d-a7a3-e172b1afd700 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b78af5c0485b4343900269160ef3e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659f3d4023b347d58bc0361db9ceead9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:06.415508 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-27186de6-9164-464d-a7a3-e172b1afd700 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b78af5c0485b4343900269160ef3e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659f3d4023b347d58bc0361db9ceead9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:06.417180 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-27186de6-9164-464d-a7a3-e172b1afd700 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] 10.222.0.33 "GET /compute/v2.1/servers/f8ba4e66-2997-4822-9c01-c570f5ae6e87" status: 200 len: 1875 microversion: 2.42 time: 0.399657 Oct 04 20:52:06.419715 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1992/3921] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:52:06 2022] GET /compute/v2.1/servers/f8ba4e66-2997-4822-9c01-c570f5ae6e87 => generated 1875 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:52:06.585967 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-272a6c93-15a0-42fc-8985-8b71d5f56a72 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c208ec9faf491385a9ab5b5932098d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ae4960393c464c97669731c2084d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:06.597412 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-c37df6b7-388b-4634-8514-f60623b9a72d tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Action: 'create', calling method: .version_select at 0x7f3c6f603940>, body: {"keypair": {"name": "tempest-keypair-1696294849", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNlsX1DwSnUPHW0vxVKNiDgmy2NV2dZU3XMI9iGk+1HSTj91iTsRN4mRC9OuAPxFJTcHTuuMxl+S3yNhke6Nj2FwrM1e0n4boHO6QVHpdSIDZpGTAdRRmDr38jzyQ6pI3g=="}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:52:06.615396 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-272a6c93-15a0-42fc-8985-8b71d5f56a72 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] 10.222.0.33 "GET /compute/v2.1/servers/30eb289d-d09c-43fa-af8a-3c6ee303f0af" status: 200 len: 1506 microversion: 2.1 time: 0.296596 Oct 04 20:52:06.626365 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1930/3922] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:52:06 2022] GET /compute/v2.1/servers/30eb289d-d09c-43fa-af8a-3c6ee303f0af => generated 1506 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:52:06.669878 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-c37df6b7-388b-4634-8514-f60623b9a72d tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Getting quotas for project 003eb03a265a496d8981e45c74b014f3. Resources: {'key_pairs'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:52:06.695088 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1c1c4529-3847-4941-bdf7-b52b92fe7af5 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:06.695911 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-1c1c4529-3847-4941-bdf7-b52b92fe7af5 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: a0273e6e-eb85-4204-9bec-3707ad6612af] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:06.707345 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-c37df6b7-388b-4634-8514-f60623b9a72d tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Getting quotas for user 4dc4171c0ee14ebb8b5eff5e910ccf49 and project 003eb03a265a496d8981e45c74b014f3. Resources: {'key_pairs'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:52:06.718560 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1c1c4529-3847-4941-bdf7-b52b92fe7af5 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:06.720658 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1c1c4529-3847-4941-bdf7-b52b92fe7af5 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:06.721040 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1c1c4529-3847-4941-bdf7-b52b92fe7af5 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:06.721795 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1c1c4529-3847-4941-bdf7-b52b92fe7af5 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:06.722260 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1c1c4529-3847-4941-bdf7-b52b92fe7af5 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:06.722768 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1c1c4529-3847-4941-bdf7-b52b92fe7af5 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:06.785849 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-c37df6b7-388b-4634-8514-f60623b9a72d tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.192457 Oct 04 20:52:06.796861 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1993/3923] 10.222.0.33 () {60 vars in 1159 bytes} [Tue Oct 4 20:52:06 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:52:06.870120 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-205389e2-5abd-4065-a53c-8839c825a596 req-b872d092-6b3e-4375-a26c-cc2258bf1c87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0273e6e-eb85-4204-9bec-3707ad6612af", "name": "network-vif-unplugged", "status": "completed", "tag": "b9c967b1-2617-432a-a85b-6d5bdf32c3a6"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:52:06.889663 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-205389e2-5abd-4065-a53c-8839c825a596 req-b872d092-6b3e-4375-a26c-cc2258bf1c87 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:06.890151 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-205389e2-5abd-4065-a53c-8839c825a596 req-b872d092-6b3e-4375-a26c-cc2258bf1c87 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:06.890637 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-205389e2-5abd-4065-a53c-8839c825a596 req-b872d092-6b3e-4375-a26c-cc2258bf1c87 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:06.941157 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-205389e2-5abd-4065-a53c-8839c825a596 req-b872d092-6b3e-4375-a26c-cc2258bf1c87 service nova] Creating event network-vif-unplugged:b9c967b1-2617-432a-a85b-6d5bdf32c3a6 for instance a0273e6e-eb85-4204-9bec-3707ad6612af on n-h2-854823-8 Oct 04 20:52:06.958192 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-205389e2-5abd-4065-a53c-8839c825a596 req-b872d092-6b3e-4375-a26c-cc2258bf1c87 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.092541 Oct 04 20:52:06.959434 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1994/3924] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:52:06 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 20:52:07.155077 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-1c1c4529-3847-4941-bdf7-b52b92fe7af5 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac650232cc04810b1340dc2f0edadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b0670d1bd99424780a70e69d57a2166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:07.162983 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-1c1c4529-3847-4941-bdf7-b52b92fe7af5 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "GET /compute/v2.1/servers/a0273e6e-eb85-4204-9bec-3707ad6612af" status: 200 len: 1505 microversion: 2.1 time: 0.477108 Oct 04 20:52:07.167229 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1931/3925] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:52:06 2022] GET /compute/v2.1/servers/a0273e6e-eb85-4204-9bec-3707ad6612af => generated 1505 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:52:07.456122 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-6ac8934e-2d85-463d-99b7-ee1d675a8616 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:07.456850 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-6ac8934e-2d85-463d-99b7-ee1d675a8616 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] [instance: f8ba4e66-2997-4822-9c01-c570f5ae6e87] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:07.472544 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6ac8934e-2d85-463d-99b7-ee1d675a8616 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:07.473781 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6ac8934e-2d85-463d-99b7-ee1d675a8616 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:07.477107 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6ac8934e-2d85-463d-99b7-ee1d675a8616 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:07.480859 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6ac8934e-2d85-463d-99b7-ee1d675a8616 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:07.486427 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6ac8934e-2d85-463d-99b7-ee1d675a8616 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:07.488633 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6ac8934e-2d85-463d-99b7-ee1d675a8616 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:07.640285 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-3cc4be8f-9488-4429-a7e7-08d52bfd68b2 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:07.640820 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-3cc4be8f-9488-4429-a7e7-08d52bfd68b2 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] [instance: 30eb289d-d09c-43fa-af8a-3c6ee303f0af] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:07.661773 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3cc4be8f-9488-4429-a7e7-08d52bfd68b2 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:07.662385 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3cc4be8f-9488-4429-a7e7-08d52bfd68b2 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:07.662847 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3cc4be8f-9488-4429-a7e7-08d52bfd68b2 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:07.664727 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3cc4be8f-9488-4429-a7e7-08d52bfd68b2 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:07.665210 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3cc4be8f-9488-4429-a7e7-08d52bfd68b2 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:07.665647 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3cc4be8f-9488-4429-a7e7-08d52bfd68b2 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:08.095250 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-3cc4be8f-9488-4429-a7e7-08d52bfd68b2 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c208ec9faf491385a9ab5b5932098d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ae4960393c464c97669731c2084d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:08.110297 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-3cc4be8f-9488-4429-a7e7-08d52bfd68b2 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] 10.222.0.33 "GET /compute/v2.1/servers/30eb289d-d09c-43fa-af8a-3c6ee303f0af" status: 200 len: 1506 microversion: 2.1 time: 0.470998 Oct 04 20:52:08.126375 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1932/3926] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:52:07 2022] GET /compute/v2.1/servers/30eb289d-d09c-43fa-af8a-3c6ee303f0af => generated 1506 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:52:08.137123 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-6ac8934e-2d85-463d-99b7-ee1d675a8616 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b78af5c0485b4343900269160ef3e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659f3d4023b347d58bc0361db9ceead9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:08.156330 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-6ac8934e-2d85-463d-99b7-ee1d675a8616 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b78af5c0485b4343900269160ef3e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659f3d4023b347d58bc0361db9ceead9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:08.160679 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-6ac8934e-2d85-463d-99b7-ee1d675a8616 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b78af5c0485b4343900269160ef3e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659f3d4023b347d58bc0361db9ceead9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:08.163122 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-6ac8934e-2d85-463d-99b7-ee1d675a8616 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] 10.222.0.33 "GET /compute/v2.1/servers/f8ba4e66-2997-4822-9c01-c570f5ae6e87" status: 200 len: 1875 microversion: 2.42 time: 0.715011 Oct 04 20:52:08.165609 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1995/3927] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:52:07 2022] GET /compute/v2.1/servers/f8ba4e66-2997-4822-9c01-c570f5ae6e87 => generated 1875 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:52:08.193543 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-cc06d411-9ac0-44c3-9fe3-66d3be313cae tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:08.194301 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-cc06d411-9ac0-44c3-9fe3-66d3be313cae tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: a0273e6e-eb85-4204-9bec-3707ad6612af] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:08.201220 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cc06d411-9ac0-44c3-9fe3-66d3be313cae tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:08.201833 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cc06d411-9ac0-44c3-9fe3-66d3be313cae tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:08.202287 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cc06d411-9ac0-44c3-9fe3-66d3be313cae tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:08.203311 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cc06d411-9ac0-44c3-9fe3-66d3be313cae tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:08.203776 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cc06d411-9ac0-44c3-9fe3-66d3be313cae tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:08.204208 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cc06d411-9ac0-44c3-9fe3-66d3be313cae tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:08.378818 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-cc06d411-9ac0-44c3-9fe3-66d3be313cae tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac650232cc04810b1340dc2f0edadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b0670d1bd99424780a70e69d57a2166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:08.389761 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-cc06d411-9ac0-44c3-9fe3-66d3be313cae tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "GET /compute/v2.1/servers/a0273e6e-eb85-4204-9bec-3707ad6612af" status: 200 len: 1448 microversion: 2.1 time: 0.200397 Oct 04 20:52:08.390935 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1933/3928] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:52:08 2022] GET /compute/v2.1/servers/a0273e6e-eb85-4204-9bec-3707ad6612af => generated 1448 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:52:08.414231 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-737427e6-beae-4861-8dc7-59262c6575ac tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:08.415194 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-737427e6-beae-4861-8dc7-59262c6575ac tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: 4d46fff2-b04d-41aa-ada0-2023ab545b48] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:08.422475 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-737427e6-beae-4861-8dc7-59262c6575ac tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:08.423177 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-737427e6-beae-4861-8dc7-59262c6575ac tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:08.423624 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-737427e6-beae-4861-8dc7-59262c6575ac tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:08.424599 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-737427e6-beae-4861-8dc7-59262c6575ac tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:08.425371 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-737427e6-beae-4861-8dc7-59262c6575ac tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:08.425948 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-737427e6-beae-4861-8dc7-59262c6575ac tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:08.648223 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-737427e6-beae-4861-8dc7-59262c6575ac tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac650232cc04810b1340dc2f0edadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b0670d1bd99424780a70e69d57a2166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:08.660137 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-737427e6-beae-4861-8dc7-59262c6575ac tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48" status: 200 len: 1669 microversion: 2.1 time: 0.250073 Oct 04 20:52:08.664481 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1996/3929] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:52:08 2022] GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48 => generated 1669 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:52:08.693632 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1bef550c-b381-403d-8bbb-af374658da50 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:08.694788 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-1bef550c-b381-403d-8bbb-af374658da50 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: 4d46fff2-b04d-41aa-ada0-2023ab545b48] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:08.710841 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1bef550c-b381-403d-8bbb-af374658da50 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:08.711504 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1bef550c-b381-403d-8bbb-af374658da50 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:08.714562 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1bef550c-b381-403d-8bbb-af374658da50 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:08.715460 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1bef550c-b381-403d-8bbb-af374658da50 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:08.716659 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1bef550c-b381-403d-8bbb-af374658da50 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:08.717200 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1bef550c-b381-403d-8bbb-af374658da50 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:08.923121 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-1bef550c-b381-403d-8bbb-af374658da50 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac650232cc04810b1340dc2f0edadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b0670d1bd99424780a70e69d57a2166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:08.933811 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-1bef550c-b381-403d-8bbb-af374658da50 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48" status: 200 len: 1669 microversion: 2.1 time: 0.245331 Oct 04 20:52:08.940463 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1934/3930] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:52:08 2022] GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48 => generated 1669 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:52:08.965112 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-2d66a4bc-f098-4f05-886f-3a04f9f9627b tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:08.966831 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-2d66a4bc-f098-4f05-886f-3a04f9f9627b tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: 4d46fff2-b04d-41aa-ada0-2023ab545b48] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:08.979053 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2d66a4bc-f098-4f05-886f-3a04f9f9627b tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:08.982227 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2d66a4bc-f098-4f05-886f-3a04f9f9627b tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:08.983356 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2d66a4bc-f098-4f05-886f-3a04f9f9627b tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:08.985237 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2d66a4bc-f098-4f05-886f-3a04f9f9627b tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:08.985850 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2d66a4bc-f098-4f05-886f-3a04f9f9627b tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:08.986431 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2d66a4bc-f098-4f05-886f-3a04f9f9627b tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:09.233915 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-2d66a4bc-f098-4f05-886f-3a04f9f9627b tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac650232cc04810b1340dc2f0edadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b0670d1bd99424780a70e69d57a2166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:09.244263 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-2d66a4bc-f098-4f05-886f-3a04f9f9627b tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48" status: 200 len: 1669 microversion: 2.1 time: 0.283108 Oct 04 20:52:09.249819 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1997/3931] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:52:08 2022] GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48 => generated 1669 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:52:09.260976 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-d7272d7b-8353-400c-9d92-15e1ac948fce tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:09.261929 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-d7272d7b-8353-400c-9d92-15e1ac948fce tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] [instance: 30eb289d-d09c-43fa-af8a-3c6ee303f0af] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:09.271469 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d7272d7b-8353-400c-9d92-15e1ac948fce tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:09.271974 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d7272d7b-8353-400c-9d92-15e1ac948fce tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:09.272542 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d7272d7b-8353-400c-9d92-15e1ac948fce tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:09.273280 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d7272d7b-8353-400c-9d92-15e1ac948fce tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:09.273752 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d7272d7b-8353-400c-9d92-15e1ac948fce tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:09.274215 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d7272d7b-8353-400c-9d92-15e1ac948fce tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:09.312101 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-115b3511-6631-4392-9a96-120816bae293 tempest-AbsoluteLimitsNegativeTestJSON-1156058271 tempest-AbsoluteLimitsNegativeTestJSON-1156058271-project] Calling method '.version_select at 0x7f3c6f9c0550>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:09.335774 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-115b3511-6631-4392-9a96-120816bae293 tempest-AbsoluteLimitsNegativeTestJSON-1156058271 tempest-AbsoluteLimitsNegativeTestJSON-1156058271-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:09.336520 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-115b3511-6631-4392-9a96-120816bae293 tempest-AbsoluteLimitsNegativeTestJSON-1156058271 tempest-AbsoluteLimitsNegativeTestJSON-1156058271-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:09.336998 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-115b3511-6631-4392-9a96-120816bae293 tempest-AbsoluteLimitsNegativeTestJSON-1156058271 tempest-AbsoluteLimitsNegativeTestJSON-1156058271-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:09.337739 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-115b3511-6631-4392-9a96-120816bae293 tempest-AbsoluteLimitsNegativeTestJSON-1156058271 tempest-AbsoluteLimitsNegativeTestJSON-1156058271-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:09.338196 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-115b3511-6631-4392-9a96-120816bae293 tempest-AbsoluteLimitsNegativeTestJSON-1156058271 tempest-AbsoluteLimitsNegativeTestJSON-1156058271-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:09.339793 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-115b3511-6631-4392-9a96-120816bae293 tempest-AbsoluteLimitsNegativeTestJSON-1156058271 tempest-AbsoluteLimitsNegativeTestJSON-1156058271-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:09.379631 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-115b3511-6631-4392-9a96-120816bae293 tempest-AbsoluteLimitsNegativeTestJSON-1156058271 tempest-AbsoluteLimitsNegativeTestJSON-1156058271-project] 10.222.0.33 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.302618 Oct 04 20:52:09.380342 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1935/3932] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 20:52:09 2022] GET /compute/v2.1/limits => generated 511 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:52:09.416647 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f1baa423-0aab-402e-89e1-871e47c5dba9 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:09.431941 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f1baa423-0aab-402e-89e1-871e47c5dba9 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] [instance: f8ba4e66-2997-4822-9c01-c570f5ae6e87] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:09.445311 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f1baa423-0aab-402e-89e1-871e47c5dba9 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:09.446671 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f1baa423-0aab-402e-89e1-871e47c5dba9 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:09.450580 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f1baa423-0aab-402e-89e1-871e47c5dba9 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:09.451880 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f1baa423-0aab-402e-89e1-871e47c5dba9 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:09.453535 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f1baa423-0aab-402e-89e1-871e47c5dba9 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:09.454238 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f1baa423-0aab-402e-89e1-871e47c5dba9 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:09.465017 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-d7272d7b-8353-400c-9d92-15e1ac948fce tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c208ec9faf491385a9ab5b5932098d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ae4960393c464c97669731c2084d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:09.474049 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-d7272d7b-8353-400c-9d92-15e1ac948fce tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] 10.222.0.33 "GET /compute/v2.1/servers/30eb289d-d09c-43fa-af8a-3c6ee303f0af" status: 200 len: 1506 microversion: 2.1 time: 0.222784 Oct 04 20:52:09.485055 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1998/3933] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:52:09 2022] GET /compute/v2.1/servers/30eb289d-d09c-43fa-af8a-3c6ee303f0af => generated 1506 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:52:09.510152 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-2a9970c4-a1d6-4de0-8158-12732512a406 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:09.511530 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-2a9970c4-a1d6-4de0-8158-12732512a406 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: 4d46fff2-b04d-41aa-ada0-2023ab545b48] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:09.528781 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2a9970c4-a1d6-4de0-8158-12732512a406 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:09.530254 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2a9970c4-a1d6-4de0-8158-12732512a406 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:09.530947 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2a9970c4-a1d6-4de0-8158-12732512a406 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:09.531816 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2a9970c4-a1d6-4de0-8158-12732512a406 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:09.532428 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2a9970c4-a1d6-4de0-8158-12732512a406 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:09.535747 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2a9970c4-a1d6-4de0-8158-12732512a406 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:10.023826 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-2a9970c4-a1d6-4de0-8158-12732512a406 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac650232cc04810b1340dc2f0edadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b0670d1bd99424780a70e69d57a2166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:10.029975 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f1baa423-0aab-402e-89e1-871e47c5dba9 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b78af5c0485b4343900269160ef3e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659f3d4023b347d58bc0361db9ceead9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:10.035085 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-2a9970c4-a1d6-4de0-8158-12732512a406 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48" status: 200 len: 1669 microversion: 2.1 time: 0.548673 Oct 04 20:52:10.052093 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f1baa423-0aab-402e-89e1-871e47c5dba9 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b78af5c0485b4343900269160ef3e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659f3d4023b347d58bc0361db9ceead9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:10.053649 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f1baa423-0aab-402e-89e1-871e47c5dba9 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b78af5c0485b4343900269160ef3e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659f3d4023b347d58bc0361db9ceead9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:10.053774 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 1999/3934] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:52:09 2022] GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48 => generated 1669 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:52:10.063362 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f1baa423-0aab-402e-89e1-871e47c5dba9 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] 10.222.0.33 "GET /compute/v2.1/servers/f8ba4e66-2997-4822-9c01-c570f5ae6e87" status: 200 len: 1875 microversion: 2.42 time: 0.658703 Oct 04 20:52:10.072258 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-45e4b274-407e-4bbc-b68a-b991dab00ad5 tempest-AbsoluteLimitsNegativeTestJSON-1156058271 tempest-AbsoluteLimitsNegativeTestJSON-1156058271-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-1170828720", "imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:52:10.080499 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1936/3935] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:52:09 2022] GET /compute/v2.1/servers/f8ba4e66-2997-4822-9c01-c570f5ae6e87 => generated 1875 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:52:10.099230 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-602bc1be-c667-4fc8-b4eb-6475a866809c tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:52:10.108374 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-602bc1be-c667-4fc8-b4eb-6475a866809c tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:10.109412 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-602bc1be-c667-4fc8-b4eb-6475a866809c tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:10.110084 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-602bc1be-c667-4fc8-b4eb-6475a866809c tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:10.175200 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-602bc1be-c667-4fc8-b4eb-6475a866809c tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: 4d46fff2-b04d-41aa-ada0-2023ab545b48] Going to try to stop instance {{(pid=128801) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 04 20:52:10.195821 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.network.neutron [None req-45e4b274-407e-4bbc-b68a-b991dab00ad5 tempest-AbsoluteLimitsNegativeTestJSON-1156058271 tempest-AbsoluteLimitsNegativeTestJSON-1156058271-project] validate_networks() for None {{(pid=128802) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:52:10.247411 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:52:10.265718 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-602bc1be-c667-4fc8-b4eb-6475a866809c tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "POST /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48/action" status: 202 len: 0 microversion: 2.1 time: 0.183843 Oct 04 20:52:10.268250 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1937/3936] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 20:52:10 2022] POST /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48/action => generated 0 bytes in 187 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:52:10.280716 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-cc5057a6-4156-4213-be3c-10c72246d473 req-4900b6e8-52d0-42eb-b1f7-f66988d7aafc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8ba4e66-2997-4822-9c01-c570f5ae6e87", "name": "network-vif-plugged", "status": "completed", "tag": "ad4a640c-5df6-4e63-9966-9e83e88c558b"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:52:10.306664 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-cc5057a6-4156-4213-be3c-10c72246d473 req-4900b6e8-52d0-42eb-b1f7-f66988d7aafc service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:10.310080 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-cc5057a6-4156-4213-be3c-10c72246d473 req-4900b6e8-52d0-42eb-b1f7-f66988d7aafc service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:10.310712 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-cc5057a6-4156-4213-be3c-10c72246d473 req-4900b6e8-52d0-42eb-b1f7-f66988d7aafc service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:10.346662 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-cc5057a6-4156-4213-be3c-10c72246d473 req-4900b6e8-52d0-42eb-b1f7-f66988d7aafc service nova] Creating event network-vif-plugged:ad4a640c-5df6-4e63-9966-9e83e88c558b for instance f8ba4e66-2997-4822-9c01-c570f5ae6e87 on n-h1-854823-8 Oct 04 20:52:10.362101 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-cc5057a6-4156-4213-be3c-10c72246d473 req-4900b6e8-52d0-42eb-b1f7-f66988d7aafc service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090724 Oct 04 20:52:10.363306 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1938/3937] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:52:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:52:10.374543 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-fa5c2759-4d94-4e4f-a89e-cbd67a1aa089 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:10.379107 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-fa5c2759-4d94-4e4f-a89e-cbd67a1aa089 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: 4d46fff2-b04d-41aa-ada0-2023ab545b48] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:10.395919 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fa5c2759-4d94-4e4f-a89e-cbd67a1aa089 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:10.397834 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fa5c2759-4d94-4e4f-a89e-cbd67a1aa089 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:10.399679 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fa5c2759-4d94-4e4f-a89e-cbd67a1aa089 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:10.400105 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fa5c2759-4d94-4e4f-a89e-cbd67a1aa089 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:10.400560 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fa5c2759-4d94-4e4f-a89e-cbd67a1aa089 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:10.403932 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fa5c2759-4d94-4e4f-a89e-cbd67a1aa089 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:10.913263 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-fa5c2759-4d94-4e4f-a89e-cbd67a1aa089 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac650232cc04810b1340dc2f0edadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b0670d1bd99424780a70e69d57a2166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:10.924857 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-fa5c2759-4d94-4e4f-a89e-cbd67a1aa089 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48" status: 200 len: 1679 microversion: 2.1 time: 0.560211 Oct 04 20:52:10.925604 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1939/3938] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:52:10 2022] GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48 => generated 1679 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:52:10.936265 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-cfe39ef3-bfbe-4e24-935b-979c679eac80 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:10.938120 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-cfe39ef3-bfbe-4e24-935b-979c679eac80 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] [instance: 30eb289d-d09c-43fa-af8a-3c6ee303f0af] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:10.944701 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=4,nova_api:INSERT=4 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:52:10.946788 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cfe39ef3-bfbe-4e24-935b-979c679eac80 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:10.949845 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cfe39ef3-bfbe-4e24-935b-979c679eac80 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:10.951536 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cfe39ef3-bfbe-4e24-935b-979c679eac80 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:10.953640 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cfe39ef3-bfbe-4e24-935b-979c679eac80 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:10.954318 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cfe39ef3-bfbe-4e24-935b-979c679eac80 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:10.954972 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cfe39ef3-bfbe-4e24-935b-979c679eac80 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:10.991730 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-45e4b274-407e-4bbc-b68a-b991dab00ad5 tempest-AbsoluteLimitsNegativeTestJSON-1156058271 tempest-AbsoluteLimitsNegativeTestJSON-1156058271-project] Getting quotas for project e3d610b827d345c7b6f2a1ad5e6bcef3. Resources: dict_keys(['metadata_items']) {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:52:11.001604 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-45e4b274-407e-4bbc-b68a-b991dab00ad5 tempest-AbsoluteLimitsNegativeTestJSON-1156058271 tempest-AbsoluteLimitsNegativeTestJSON-1156058271-project] Getting quotas for user 36bacb2a3640427292c24c66932d60c8 and project e3d610b827d345c7b6f2a1ad5e6bcef3. Resources: dict_keys(['metadata_items']) {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:52:11.017576 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.wsgi [None req-45e4b274-407e-4bbc-b68a-b991dab00ad5 tempest-AbsoluteLimitsNegativeTestJSON-1156058271 tempest-AbsoluteLimitsNegativeTestJSON-1156058271-project] HTTP exception thrown: Maximum number of metadata items exceeds 128 Oct 04 20:52:11.020533 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-45e4b274-407e-4bbc-b68a-b991dab00ad5 tempest-AbsoluteLimitsNegativeTestJSON-1156058271 tempest-AbsoluteLimitsNegativeTestJSON-1156058271-project] Request method failure captured: Oct 04 20:52:11.020533 n-d-854823-8 devstack@n-api.service[128802]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 20:52:11.020533 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 20:52:11.020533 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 20:52:11.020533 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 20:52:11.020533 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 1752 Oct 04 20:52:11.020533 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 20:52:11.020533 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 20:52:11.020533 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 20:52:11.020533 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 20:52:11.020533 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPJz4MkxwS2_MOXnb9qqRmksV5VaNmU3CedKbR3SuQyQ8y_FVNJ_KwDG4rGmolAHSfJ0fXB8gR4qZWVhfxGjjyx8ihDe5zAFaaY1z5XnSRxSfkoawN30AgatoXlg9Z69UuUNx-2vb7VFXDs4M8M7F2d0MnkQnEWiBJWX8pj5gVgo0eyA Oct 04 20:52:11.020533 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 20:52:11.020533 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 20:52:11.020533 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 20:52:11.020533 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 20:52:11.020533 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 20:52:11.020533 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 20:52:11.020533 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: e3d610b827d345c7b6f2a1ad5e6bcef3 Oct 04 20:52:11.020533 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-AbsoluteLimitsNegativeTestJSON-1156058271 Oct 04 20:52:11.020533 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 20:52:11.020533 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 20:52:11.020533 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_e3d610b827d345c7b6f2a1ad5e6bcef3", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e3d610b827d345c7b6f2a1ad5e6bcef3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e3d610b827d345c7b6f2a1ad5e6bcef3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/e3d610b827d345c7b6f2a1ad5e6bcef3"}]}] Oct 04 20:52:11.020533 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-AbsoluteLimitsNegativeTestJSON-1156058271 Oct 04 20:52:11.020533 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: e3d610b827d345c7b6f2a1ad5e6bcef3 Oct 04 20:52:11.020533 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-AbsoluteLimitsNegativeTestJSON-1156058271 Oct 04 20:52:11.020533 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-AbsoluteLimitsNegativeTestJSON-1156058271-project Oct 04 20:52:11.020533 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 20:52:11.020533 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 20:52:11.020533 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: 36bacb2a3640427292c24c66932d60c8 Oct 04 20:52:11.020533 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-AbsoluteLimitsNegativeTestJSON-1156058271-project Oct 04 20:52:11.020533 n-d-854823-8 devstack@n-api.service[128802]: Oct 04 20:52:11.020533 n-d-854823-8 devstack@n-api.service[128802]: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-1170828720", "imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} Oct 04 20:52:11.020533 n-d-854823-8 devstack@n-api.service[128802]: method: > Oct 04 20:52:11.020533 n-d-854823-8 devstack@n-api.service[128802]: exception: Maximum number of metadata items exceeds 128 Oct 04 20:52:11.022423 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'body': {'server': {'name': 'tempest-AbsoluteLimitsNegativeTestJSON-server-1170828720', 'imageRef': '15b24725-0c99-4bcf-b1fb-907cdf8e2d63', 'flavorRef': '452', 'metadata': {'0': '0', '1': '1', '2': '2', '3': '3', '4': '4', '5': '5', '6': '6', '7': '7', '8': '8', '9': '9', '10': '10', '11': '11', '12': '12', '13': '13', '14': '14', '15': '15', '16': '16', '17': '17', '18': '18', '19': '19', '20': '20', '21': '21', '22': '22', '23': '23', '24': '24', '25': '25', '26': '26', '27': '27', '28': '28', '29': '29', '30': '30', '31': '31', '32': '32', '33': '33', '34': '34', '35': '35', '36': '36', '37': '37', '38': '38', '39': '39', '40': '40', '41': '41', '42': '42', '43': '43', '44': '44', '45': '45', '46': '46', '47': '47', '48': '48', '49': '49', '50': '50', '51': '51', '52': '52', '53': '53', '54': '54', '55': '55', '56': '56', '57': '57', '58': '58', '59': '59', '60': '60', '61': '61', '62': '62', '63': '63', '64': '64', '65': '65', '66': '66', '67': '67', '68': '68', '69': '69', '70': '70', '71': '71', '72': '72', '73': '73', '74': '74', '75': '75', '76': '76', '77': '77', '78': '78', '79': '79', '80': '80', '81': '81', '82': '82', '83': '83', '84': '84', '85': '85', '86': '86', '87': '87', '88': '88', '89': '89', '90': '90', '91': '91', '92': '92', '93': '93', '94': '94', '95': '95', '96': '96', '97': '97', '98': '98', '99': '99', '100': '100', '101': '101', '102': '102', '103': '103', '104': '104', '105': '105', '106': '106', '107': '107', '108': '108', '109': '109', '110': '110', '111': '111', '112': '112', '113': '113', '114': '114', '115': '115', '116': '116', '117': '117', '118': '118', '119': '119', '120': '120', '121': '121', '122': '122', '123': '123', '124': '124', '125': '125', '126': '126', '127': '127', '128': '128'}}}} Oct 04 20:52:11.022423 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:52:11.022423 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:52:11.022423 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 476, in _check_metadata_properties_quota Oct 04 20:52:11.022423 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi objects.Quotas.limit_check(context, metadata_items=num_metadata) Oct 04 20:52:11.022423 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 20:52:11.022423 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 20:52:11.022423 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 290, in limit_check Oct 04 20:52:11.022423 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check( Oct 04 20:52:11.022423 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1118, in limit_check Oct 04 20:52:11.022423 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return self._driver.limit_check(context, self._resources, values, Oct 04 20:52:11.022423 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 468, in limit_check Oct 04 20:52:11.022423 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), quotas=quotas, Oct 04 20:52:11.022423 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['metadata_items'] Oct 04 20:52:11.022423 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:52:11.022423 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:52:11.022423 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:52:11.022423 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:52:11.022423 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 20:52:11.022423 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 20:52:11.022423 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 20:52:11.022423 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 20:52:11.022423 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Oct 04 20:52:11.022423 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Oct 04 20:52:11.022423 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1016, in _checks_for_create_and_rebuild Oct 04 20:52:11.022423 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi self._check_metadata_properties_quota(context, metadata) Oct 04 20:52:11.022423 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 483, in _check_metadata_properties_quota Oct 04 20:52:11.022423 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.MetadataLimitExceeded(allowed=quota_metadata) Oct 04 20:52:11.022423 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.MetadataLimitExceeded: Maximum number of metadata items exceeds 128 Oct 04 20:52:11.022423 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:52:11.022423 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:52:11.022423 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:52:11.022423 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:52:11.022423 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:52:11.022423 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:52:11.022423 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:52:11.022423 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:52:11.022423 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:52:11.022423 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:52:11.022423 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:52:11.022423 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:52:11.022423 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:52:11.022423 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:52:11.022423 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:52:11.024639 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:52:11.024639 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 20:52:11.024639 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 04 20:52:11.024639 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 04 20:52:11.024639 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Maximum number of metadata items exceeds 128 Oct 04 20:52:11.024639 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:52:11.024639 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:52:11.024639 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:52:11.024639 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:52:11.024639 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:52:11.024639 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:52:11.024639 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:52:11.024639 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:52:11.024639 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Maximum number of metadata items exceeds 128 Oct 04 20:52:11.024639 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:52:11.029900 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-45e4b274-407e-4bbc-b68a-b991dab00ad5 tempest-AbsoluteLimitsNegativeTestJSON-1156058271 tempest-AbsoluteLimitsNegativeTestJSON-1156058271-project] Returning 403 to user: Maximum number of metadata items exceeds 128 {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:52:11.031012 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-45e4b274-407e-4bbc-b68a-b991dab00ad5 tempest-AbsoluteLimitsNegativeTestJSON-1156058271 tempest-AbsoluteLimitsNegativeTestJSON-1156058271-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 403 len: 87 microversion: 2.1 time: 0.976299 Oct 04 20:52:11.032752 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2000/3939] 10.222.0.33 () {60 vars in 1148 bytes} [Tue Oct 4 20:52:10 2022] POST /compute/v2.1/servers => generated 87 bytes in 978 msecs (HTTP/1.1 403) 9 headers in 378 bytes (1 switches on core 0) Oct 04 20:52:11.045621 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-a17b9f99-2f14-4fc0-a62b-d6adeeb313ee tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1565057193", "imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "49b17641-fc69-4832-b90f-432d80a0733f"}], "security_groups": [{"name": "tempest-securitygroup--559291668"}], "key_name": "tempest-keypair-1696294849", "user_data": "}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:52:11.488448 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.network.neutron [None req-a17b9f99-2f14-4fc0-a62b-d6adeeb313ee tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] validate_networks() for [('49b17641-fc69-4832-b90f-432d80a0733f', None, None, None, None, None)] {{(pid=128802) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:52:11.561365 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-cfe39ef3-bfbe-4e24-935b-979c679eac80 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c208ec9faf491385a9ab5b5932098d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ae4960393c464c97669731c2084d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:11.571099 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-cfe39ef3-bfbe-4e24-935b-979c679eac80 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] 10.222.0.33 "GET /compute/v2.1/servers/30eb289d-d09c-43fa-af8a-3c6ee303f0af" status: 200 len: 1506 microversion: 2.1 time: 0.643822 Oct 04 20:52:11.572182 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1940/3940] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:52:10 2022] GET /compute/v2.1/servers/30eb289d-d09c-43fa-af8a-3c6ee303f0af => generated 1506 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:52:11.581591 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-fd9b6728-4d73-4b1d-8072-a9ce1a360d64 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:11.586223 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-fd9b6728-4d73-4b1d-8072-a9ce1a360d64 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] [instance: f8ba4e66-2997-4822-9c01-c570f5ae6e87] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:11.608676 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fd9b6728-4d73-4b1d-8072-a9ce1a360d64 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:11.609180 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fd9b6728-4d73-4b1d-8072-a9ce1a360d64 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:11.609812 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fd9b6728-4d73-4b1d-8072-a9ce1a360d64 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:11.611907 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fd9b6728-4d73-4b1d-8072-a9ce1a360d64 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:11.612717 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fd9b6728-4d73-4b1d-8072-a9ce1a360d64 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:11.615823 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fd9b6728-4d73-4b1d-8072-a9ce1a360d64 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:12.240836 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-fd9b6728-4d73-4b1d-8072-a9ce1a360d64 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b78af5c0485b4343900269160ef3e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659f3d4023b347d58bc0361db9ceead9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:12.263154 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-fd9b6728-4d73-4b1d-8072-a9ce1a360d64 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b78af5c0485b4343900269160ef3e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659f3d4023b347d58bc0361db9ceead9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:12.268073 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-fd9b6728-4d73-4b1d-8072-a9ce1a360d64 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b78af5c0485b4343900269160ef3e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659f3d4023b347d58bc0361db9ceead9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:12.273958 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-fd9b6728-4d73-4b1d-8072-a9ce1a360d64 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] 10.222.0.33 "GET /compute/v2.1/servers/f8ba4e66-2997-4822-9c01-c570f5ae6e87" status: 200 len: 1875 microversion: 2.42 time: 0.699058 Oct 04 20:52:12.275710 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1941/3941] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:52:11 2022] GET /compute/v2.1/servers/f8ba4e66-2997-4822-9c01-c570f5ae6e87 => generated 1875 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:52:12.290026 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-dee16bec-7f84-47ad-ac74-61cd2401d9cf tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:12.295299 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-dee16bec-7f84-47ad-ac74-61cd2401d9cf tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: 4d46fff2-b04d-41aa-ada0-2023ab545b48] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:12.314481 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dee16bec-7f84-47ad-ac74-61cd2401d9cf tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:12.314969 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dee16bec-7f84-47ad-ac74-61cd2401d9cf tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:12.315406 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dee16bec-7f84-47ad-ac74-61cd2401d9cf tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:12.316109 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dee16bec-7f84-47ad-ac74-61cd2401d9cf tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:12.316566 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dee16bec-7f84-47ad-ac74-61cd2401d9cf tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:12.316988 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dee16bec-7f84-47ad-ac74-61cd2401d9cf tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:12.844903 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-dee16bec-7f84-47ad-ac74-61cd2401d9cf tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac650232cc04810b1340dc2f0edadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b0670d1bd99424780a70e69d57a2166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:12.854064 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-dee16bec-7f84-47ad-ac74-61cd2401d9cf tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48" status: 200 len: 1679 microversion: 2.1 time: 0.573981 Oct 04 20:52:12.858511 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1942/3942] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:52:12 2022] GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48 => generated 1679 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:52:12.865317 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-bf781cc4-f893-48a0-98dc-795ff8bbb702 req-4d16e4da-874f-4207-858b-54c80d095db9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8ba4e66-2997-4822-9c01-c570f5ae6e87", "name": "network-vif-plugged", "status": "completed", "tag": "4f9a97a3-f3e7-439e-b71b-172b65963073"}, {"server_uuid": "f8ba4e66-2997-4822-9c01-c570f5ae6e87", "name": "network-vif-plugged", "status": "completed", "tag": "23c11bbd-118e-4951-9bf5-0c64ad430751"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:52:12.891181 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-bf781cc4-f893-48a0-98dc-795ff8bbb702 req-4d16e4da-874f-4207-858b-54c80d095db9 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:12.899109 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-bf781cc4-f893-48a0-98dc-795ff8bbb702 req-4d16e4da-874f-4207-858b-54c80d095db9 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:12.899818 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-bf781cc4-f893-48a0-98dc-795ff8bbb702 req-4d16e4da-874f-4207-858b-54c80d095db9 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:12.926327 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-bf781cc4-f893-48a0-98dc-795ff8bbb702 req-4d16e4da-874f-4207-858b-54c80d095db9 service nova] Creating event network-vif-plugged:4f9a97a3-f3e7-439e-b71b-172b65963073 for instance f8ba4e66-2997-4822-9c01-c570f5ae6e87 on n-h1-854823-8 Oct 04 20:52:12.927146 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-bf781cc4-f893-48a0-98dc-795ff8bbb702 req-4d16e4da-874f-4207-858b-54c80d095db9 service nova] Creating event network-vif-plugged:23c11bbd-118e-4951-9bf5-0c64ad430751 for instance f8ba4e66-2997-4822-9c01-c570f5ae6e87 on n-h1-854823-8 Oct 04 20:52:12.938167 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-bf781cc4-f893-48a0-98dc-795ff8bbb702 req-4d16e4da-874f-4207-858b-54c80d095db9 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.078194 Oct 04 20:52:12.942148 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1943/3943] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:52:12 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:52:12.950492 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-29f46d9f-4d69-45d9-b854-ad6c6349dd58 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:12.956768 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-29f46d9f-4d69-45d9-b854-ad6c6349dd58 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] [instance: 30eb289d-d09c-43fa-af8a-3c6ee303f0af] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:12.976244 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-29f46d9f-4d69-45d9-b854-ad6c6349dd58 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:12.977117 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-29f46d9f-4d69-45d9-b854-ad6c6349dd58 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:12.977761 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-29f46d9f-4d69-45d9-b854-ad6c6349dd58 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:12.978768 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-29f46d9f-4d69-45d9-b854-ad6c6349dd58 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:12.979461 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-29f46d9f-4d69-45d9-b854-ad6c6349dd58 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:12.980092 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-29f46d9f-4d69-45d9-b854-ad6c6349dd58 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:13.056057 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-a17b9f99-2f14-4fc0-a62b-d6adeeb313ee tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Flavor limits 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:52:13.056511 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-a17b9f99-2f14-4fc0-a62b-d6adeeb313ee tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Image limits 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:52:13.056939 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-a17b9f99-2f14-4fc0-a62b-d6adeeb313ee tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Flavor pref 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:52:13.057346 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-a17b9f99-2f14-4fc0-a62b-d6adeeb313ee tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Image pref 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:52:13.057877 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-a17b9f99-2f14-4fc0-a62b-d6adeeb313ee tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:52:13.075143 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a17b9f99-2f14-4fc0-a62b-d6adeeb313ee tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:13.075635 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a17b9f99-2f14-4fc0-a62b-d6adeeb313ee tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:13.076179 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a17b9f99-2f14-4fc0-a62b-d6adeeb313ee tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:13.078405 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a17b9f99-2f14-4fc0-a62b-d6adeeb313ee tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:13.080523 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a17b9f99-2f14-4fc0-a62b-d6adeeb313ee tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:13.081005 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a17b9f99-2f14-4fc0-a62b-d6adeeb313ee tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:13.125704 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-a17b9f99-2f14-4fc0-a62b-d6adeeb313ee tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Getting quotas for project 003eb03a265a496d8981e45c74b014f3. Resources: {'ram', 'instances', 'cores'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:52:13.134012 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-a17b9f99-2f14-4fc0-a62b-d6adeeb313ee tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Getting quotas for user 4dc4171c0ee14ebb8b5eff5e910ccf49 and project 003eb03a265a496d8981e45c74b014f3. Resources: {'ram', 'instances', 'cores'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:52:13.165637 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-a17b9f99-2f14-4fc0-a62b-d6adeeb313ee tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Going to run 1 instances... {{(pid=128802) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:52:13.169921 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-a17b9f99-2f14-4fc0-a62b-d6adeeb313ee tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] [instance: 866d0dd3-3c7e-4612-a132-48eb83ec2d16] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='15b24725-0c99-4bcf-b1fb-907cdf8e2d63',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128802) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:52:13.275035 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-a17b9f99-2f14-4fc0-a62b-d6adeeb313ee tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 2.230566 Oct 04 20:52:13.276108 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2001/3944] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 20:52:11 2022] POST /compute/v2.1/servers => generated 408 bytes in 2242 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 20:52:13.288193 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-729a2bc0-df2c-4353-b727-0058fda4aa1e tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:13.288728 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-729a2bc0-df2c-4353-b727-0058fda4aa1e tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] [instance: 866d0dd3-3c7e-4612-a132-48eb83ec2d16] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:13.459807 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-729a2bc0-df2c-4353-b727-0058fda4aa1e tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc4171c0ee14ebb8b5eff5e910ccf49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003eb03a265a496d8981e45c74b014f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:13.467955 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-729a2bc0-df2c-4353-b727-0058fda4aa1e tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] 10.222.0.33 "GET /compute/v2.1/servers/866d0dd3-3c7e-4612-a132-48eb83ec2d16" status: 200 len: 1246 microversion: 2.1 time: 0.184086 Oct 04 20:52:13.469537 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2002/3945] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:52:13 2022] GET /compute/v2.1/servers/866d0dd3-3c7e-4612-a132-48eb83ec2d16 => generated 1246 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:52:13.474794 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-410bb07d-5b23-42a3-8661-373e9e43b515 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:13.475606 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-410bb07d-5b23-42a3-8661-373e9e43b515 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] [instance: f8ba4e66-2997-4822-9c01-c570f5ae6e87] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:13.485031 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-410bb07d-5b23-42a3-8661-373e9e43b515 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:13.486905 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-410bb07d-5b23-42a3-8661-373e9e43b515 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:13.487664 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-410bb07d-5b23-42a3-8661-373e9e43b515 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:13.488531 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-410bb07d-5b23-42a3-8661-373e9e43b515 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:13.489145 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-410bb07d-5b23-42a3-8661-373e9e43b515 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:13.490534 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-410bb07d-5b23-42a3-8661-373e9e43b515 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:13.642804 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-29f46d9f-4d69-45d9-b854-ad6c6349dd58 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c208ec9faf491385a9ab5b5932098d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ae4960393c464c97669731c2084d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:13.664309 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-29f46d9f-4d69-45d9-b854-ad6c6349dd58 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] 10.222.0.33 "GET /compute/v2.1/servers/30eb289d-d09c-43fa-af8a-3c6ee303f0af" status: 200 len: 1506 microversion: 2.1 time: 0.720426 Oct 04 20:52:13.668074 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1944/3946] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:52:12 2022] GET /compute/v2.1/servers/30eb289d-d09c-43fa-af8a-3c6ee303f0af => generated 1506 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:52:13.882211 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-955765c0-94d7-41b8-945e-35877034d5a1 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:13.885484 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-955765c0-94d7-41b8-945e-35877034d5a1 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: 4d46fff2-b04d-41aa-ada0-2023ab545b48] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:13.899758 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-955765c0-94d7-41b8-945e-35877034d5a1 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:13.901560 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-955765c0-94d7-41b8-945e-35877034d5a1 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:13.902509 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-955765c0-94d7-41b8-945e-35877034d5a1 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:13.904982 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-955765c0-94d7-41b8-945e-35877034d5a1 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:13.906994 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-955765c0-94d7-41b8-945e-35877034d5a1 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:13.907857 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-955765c0-94d7-41b8-945e-35877034d5a1 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:14.756039 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-410bb07d-5b23-42a3-8661-373e9e43b515 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b78af5c0485b4343900269160ef3e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659f3d4023b347d58bc0361db9ceead9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:14.772064 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-410bb07d-5b23-42a3-8661-373e9e43b515 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b78af5c0485b4343900269160ef3e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659f3d4023b347d58bc0361db9ceead9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:14.778974 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-410bb07d-5b23-42a3-8661-373e9e43b515 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b78af5c0485b4343900269160ef3e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659f3d4023b347d58bc0361db9ceead9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:14.780888 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-410bb07d-5b23-42a3-8661-373e9e43b515 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] 10.222.0.33 "GET /compute/v2.1/servers/f8ba4e66-2997-4822-9c01-c570f5ae6e87" status: 200 len: 1875 microversion: 2.42 time: 1.309920 Oct 04 20:52:14.781868 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2003/3947] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:52:13 2022] GET /compute/v2.1/servers/f8ba4e66-2997-4822-9c01-c570f5ae6e87 => generated 1875 bytes in 1311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:52:14.791747 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-ea9c797d-2699-438e-87da-5d2e89b9a3b7 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:14.795154 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-ea9c797d-2699-438e-87da-5d2e89b9a3b7 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] [instance: 866d0dd3-3c7e-4612-a132-48eb83ec2d16] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:14.811535 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ea9c797d-2699-438e-87da-5d2e89b9a3b7 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:14.814116 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ea9c797d-2699-438e-87da-5d2e89b9a3b7 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:14.815242 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ea9c797d-2699-438e-87da-5d2e89b9a3b7 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:14.818374 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ea9c797d-2699-438e-87da-5d2e89b9a3b7 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:14.819083 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ea9c797d-2699-438e-87da-5d2e89b9a3b7 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:14.819742 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ea9c797d-2699-438e-87da-5d2e89b9a3b7 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:14.976723 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-ea9c797d-2699-438e-87da-5d2e89b9a3b7 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc4171c0ee14ebb8b5eff5e910ccf49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003eb03a265a496d8981e45c74b014f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:14.990188 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-ea9c797d-2699-438e-87da-5d2e89b9a3b7 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] 10.222.0.33 "GET /compute/v2.1/servers/866d0dd3-3c7e-4612-a132-48eb83ec2d16" status: 200 len: 1298 microversion: 2.1 time: 0.206841 Oct 04 20:52:14.994767 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2004/3948] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:52:14 2022] GET /compute/v2.1/servers/866d0dd3-3c7e-4612-a132-48eb83ec2d16 => generated 1298 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:52:15.002516 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-10624510-ec6e-49fc-98f6-a72f7627841d tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:15.005582 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-10624510-ec6e-49fc-98f6-a72f7627841d tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] [instance: 30eb289d-d09c-43fa-af8a-3c6ee303f0af] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:15.017878 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-10624510-ec6e-49fc-98f6-a72f7627841d tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:15.018839 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-10624510-ec6e-49fc-98f6-a72f7627841d tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:15.019229 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-10624510-ec6e-49fc-98f6-a72f7627841d tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:15.020383 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-10624510-ec6e-49fc-98f6-a72f7627841d tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:15.020963 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-10624510-ec6e-49fc-98f6-a72f7627841d tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:15.022299 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-10624510-ec6e-49fc-98f6-a72f7627841d tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:15.248116 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-955765c0-94d7-41b8-945e-35877034d5a1 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac650232cc04810b1340dc2f0edadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b0670d1bd99424780a70e69d57a2166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:15.281688 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-955765c0-94d7-41b8-945e-35877034d5a1 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48" status: 200 len: 1679 microversion: 2.1 time: 1.403248 Oct 04 20:52:15.282302 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1945/3949] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:52:13 2022] GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48 => generated 1679 bytes in 1406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:52:15.291526 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-58526ee4-5551-4338-852a-52e050ff6292 req-0491a6e8-df26-4f7a-bea5-0ffcdff0e1c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8ba4e66-2997-4822-9c01-c570f5ae6e87", "name": "network-vif-plugged", "status": "completed", "tag": "6e6d2a48-9844-45c7-a3ac-b235535858ac"}, {"server_uuid": "f8ba4e66-2997-4822-9c01-c570f5ae6e87", "name": "network-vif-plugged", "status": "completed", "tag": "2466aff1-a3c9-4408-a313-35792d243535"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:52:15.307234 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-58526ee4-5551-4338-852a-52e050ff6292 req-0491a6e8-df26-4f7a-bea5-0ffcdff0e1c1 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:15.307780 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-58526ee4-5551-4338-852a-52e050ff6292 req-0491a6e8-df26-4f7a-bea5-0ffcdff0e1c1 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:15.308248 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-58526ee4-5551-4338-852a-52e050ff6292 req-0491a6e8-df26-4f7a-bea5-0ffcdff0e1c1 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:15.330008 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-58526ee4-5551-4338-852a-52e050ff6292 req-0491a6e8-df26-4f7a-bea5-0ffcdff0e1c1 service nova] Creating event network-vif-plugged:6e6d2a48-9844-45c7-a3ac-b235535858ac for instance f8ba4e66-2997-4822-9c01-c570f5ae6e87 on n-h1-854823-8 Oct 04 20:52:15.331161 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-58526ee4-5551-4338-852a-52e050ff6292 req-0491a6e8-df26-4f7a-bea5-0ffcdff0e1c1 service nova] Creating event network-vif-plugged:2466aff1-a3c9-4408-a313-35792d243535 for instance f8ba4e66-2997-4822-9c01-c570f5ae6e87 on n-h1-854823-8 Oct 04 20:52:15.371071 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-58526ee4-5551-4338-852a-52e050ff6292 req-0491a6e8-df26-4f7a-bea5-0ffcdff0e1c1 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.079193 Oct 04 20:52:15.371990 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1946/3950] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:52:15 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:52:15.584371 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-10624510-ec6e-49fc-98f6-a72f7627841d tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c208ec9faf491385a9ab5b5932098d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ae4960393c464c97669731c2084d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:15.600906 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-10624510-ec6e-49fc-98f6-a72f7627841d tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] 10.222.0.33 "GET /compute/v2.1/servers/30eb289d-d09c-43fa-af8a-3c6ee303f0af" status: 200 len: 1506 microversion: 2.1 time: 0.604843 Oct 04 20:52:15.605135 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2005/3951] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:52:14 2022] GET /compute/v2.1/servers/30eb289d-d09c-43fa-af8a-3c6ee303f0af => generated 1506 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:52:15.813536 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9947ecfb-116c-4edd-8a32-a581f74de102 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:15.814258 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-9947ecfb-116c-4edd-8a32-a581f74de102 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] [instance: f8ba4e66-2997-4822-9c01-c570f5ae6e87] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:15.833325 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9947ecfb-116c-4edd-8a32-a581f74de102 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:15.833953 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9947ecfb-116c-4edd-8a32-a581f74de102 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:15.834447 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9947ecfb-116c-4edd-8a32-a581f74de102 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:15.835206 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9947ecfb-116c-4edd-8a32-a581f74de102 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:15.835676 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9947ecfb-116c-4edd-8a32-a581f74de102 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:15.836110 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9947ecfb-116c-4edd-8a32-a581f74de102 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:16.032369 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-302c4b8e-b75b-459f-9532-0961a96281b0 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:16.033843 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-302c4b8e-b75b-459f-9532-0961a96281b0 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] [instance: 866d0dd3-3c7e-4612-a132-48eb83ec2d16] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:16.042081 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-302c4b8e-b75b-459f-9532-0961a96281b0 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:16.042988 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-302c4b8e-b75b-459f-9532-0961a96281b0 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:16.044879 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-302c4b8e-b75b-459f-9532-0961a96281b0 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:16.046591 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-302c4b8e-b75b-459f-9532-0961a96281b0 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:16.047258 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-302c4b8e-b75b-459f-9532-0961a96281b0 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:16.048181 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-302c4b8e-b75b-459f-9532-0961a96281b0 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:16.314427 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-302c4b8e-b75b-459f-9532-0961a96281b0 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc4171c0ee14ebb8b5eff5e910ccf49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003eb03a265a496d8981e45c74b014f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:16.326723 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-302c4b8e-b75b-459f-9532-0961a96281b0 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] 10.222.0.33 "GET /compute/v2.1/servers/866d0dd3-3c7e-4612-a132-48eb83ec2d16" status: 200 len: 1304 microversion: 2.1 time: 0.312001 Oct 04 20:52:16.328930 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2006/3952] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:52:16 2022] GET /compute/v2.1/servers/866d0dd3-3c7e-4612-a132-48eb83ec2d16 => generated 1304 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:52:16.338151 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-4c829e84-d2c7-4f64-bf8a-7ae281eee65e tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:16.343131 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-4c829e84-d2c7-4f64-bf8a-7ae281eee65e tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: 4d46fff2-b04d-41aa-ada0-2023ab545b48] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:16.354444 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4c829e84-d2c7-4f64-bf8a-7ae281eee65e tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:16.355188 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4c829e84-d2c7-4f64-bf8a-7ae281eee65e tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:16.356590 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4c829e84-d2c7-4f64-bf8a-7ae281eee65e tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:16.359824 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4c829e84-d2c7-4f64-bf8a-7ae281eee65e tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:16.360456 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4c829e84-d2c7-4f64-bf8a-7ae281eee65e tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:16.363510 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4c829e84-d2c7-4f64-bf8a-7ae281eee65e tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:16.830902 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-9947ecfb-116c-4edd-8a32-a581f74de102 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b78af5c0485b4343900269160ef3e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659f3d4023b347d58bc0361db9ceead9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:16.849328 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-9947ecfb-116c-4edd-8a32-a581f74de102 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b78af5c0485b4343900269160ef3e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659f3d4023b347d58bc0361db9ceead9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:16.859994 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-9947ecfb-116c-4edd-8a32-a581f74de102 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b78af5c0485b4343900269160ef3e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659f3d4023b347d58bc0361db9ceead9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:16.862677 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-9947ecfb-116c-4edd-8a32-a581f74de102 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] 10.222.0.33 "GET /compute/v2.1/servers/f8ba4e66-2997-4822-9c01-c570f5ae6e87" status: 200 len: 1875 microversion: 2.42 time: 1.055859 Oct 04 20:52:16.863411 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1947/3953] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:52:15 2022] GET /compute/v2.1/servers/f8ba4e66-2997-4822-9c01-c570f5ae6e87 => generated 1875 bytes in 1057 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:52:16.875105 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-76751235-9120-4769-b577-101cfe612522 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:16.876003 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-76751235-9120-4769-b577-101cfe612522 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] [instance: 30eb289d-d09c-43fa-af8a-3c6ee303f0af] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:16.892123 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-76751235-9120-4769-b577-101cfe612522 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:16.892932 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-76751235-9120-4769-b577-101cfe612522 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:16.894225 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-76751235-9120-4769-b577-101cfe612522 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:16.896636 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-76751235-9120-4769-b577-101cfe612522 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:16.899175 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-76751235-9120-4769-b577-101cfe612522 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:16.899808 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-76751235-9120-4769-b577-101cfe612522 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:17.075677 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-4c829e84-d2c7-4f64-bf8a-7ae281eee65e tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac650232cc04810b1340dc2f0edadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b0670d1bd99424780a70e69d57a2166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:17.084422 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-4c829e84-d2c7-4f64-bf8a-7ae281eee65e tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48" status: 200 len: 1679 microversion: 2.1 time: 0.750270 Oct 04 20:52:17.094731 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2007/3954] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:52:16 2022] GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48 => generated 1679 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:52:17.354118 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-f1d7b102-88b3-4bae-8a63-09a2cbe92caa tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:17.358994 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-f1d7b102-88b3-4bae-8a63-09a2cbe92caa tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] [instance: 866d0dd3-3c7e-4612-a132-48eb83ec2d16] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:17.373244 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f1d7b102-88b3-4bae-8a63-09a2cbe92caa tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:17.373743 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f1d7b102-88b3-4bae-8a63-09a2cbe92caa tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:17.374308 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f1d7b102-88b3-4bae-8a63-09a2cbe92caa tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:17.375534 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f1d7b102-88b3-4bae-8a63-09a2cbe92caa tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:17.376304 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f1d7b102-88b3-4bae-8a63-09a2cbe92caa tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:17.376944 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f1d7b102-88b3-4bae-8a63-09a2cbe92caa tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:17.609669 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-f1d7b102-88b3-4bae-8a63-09a2cbe92caa tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc4171c0ee14ebb8b5eff5e910ccf49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003eb03a265a496d8981e45c74b014f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:17.610147 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-76751235-9120-4769-b577-101cfe612522 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c208ec9faf491385a9ab5b5932098d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ae4960393c464c97669731c2084d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:17.617887 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-f1d7b102-88b3-4bae-8a63-09a2cbe92caa tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] 10.222.0.33 "GET /compute/v2.1/servers/866d0dd3-3c7e-4612-a132-48eb83ec2d16" status: 200 len: 1304 microversion: 2.1 time: 0.268526 Oct 04 20:52:17.625024 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-76751235-9120-4769-b577-101cfe612522 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] 10.222.0.33 "GET /compute/v2.1/servers/30eb289d-d09c-43fa-af8a-3c6ee303f0af" status: 200 len: 1506 microversion: 2.1 time: 0.760331 Oct 04 20:52:17.628494 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1948/3955] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:52:16 2022] GET /compute/v2.1/servers/30eb289d-d09c-43fa-af8a-3c6ee303f0af => generated 1506 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:52:17.631378 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2008/3956] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:52:17 2022] GET /compute/v2.1/servers/866d0dd3-3c7e-4612-a132-48eb83ec2d16 => generated 1304 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:52:17.647240 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-c71d1385-3d18-458e-92ff-768e41460208 req-7defdd1e-56f8-4686-a54a-1d64299a9e46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8ba4e66-2997-4822-9c01-c570f5ae6e87", "name": "network-vif-plugged", "status": "completed", "tag": "89bbad56-acc7-4db0-9c4c-a9fd89521acf"}, {"server_uuid": "f8ba4e66-2997-4822-9c01-c570f5ae6e87", "name": "network-vif-plugged", "status": "completed", "tag": "1a515a36-7768-4003-81af-193aff7ba286"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:52:17.670190 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-c71d1385-3d18-458e-92ff-768e41460208 req-7defdd1e-56f8-4686-a54a-1d64299a9e46 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:17.672365 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-c71d1385-3d18-458e-92ff-768e41460208 req-7defdd1e-56f8-4686-a54a-1d64299a9e46 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:17.674546 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-c71d1385-3d18-458e-92ff-768e41460208 req-7defdd1e-56f8-4686-a54a-1d64299a9e46 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:17.706494 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-c71d1385-3d18-458e-92ff-768e41460208 req-7defdd1e-56f8-4686-a54a-1d64299a9e46 service nova] Creating event network-vif-plugged:89bbad56-acc7-4db0-9c4c-a9fd89521acf for instance f8ba4e66-2997-4822-9c01-c570f5ae6e87 on n-h1-854823-8 Oct 04 20:52:17.707016 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-c71d1385-3d18-458e-92ff-768e41460208 req-7defdd1e-56f8-4686-a54a-1d64299a9e46 service nova] Creating event network-vif-plugged:1a515a36-7768-4003-81af-193aff7ba286 for instance f8ba4e66-2997-4822-9c01-c570f5ae6e87 on n-h1-854823-8 Oct 04 20:52:17.724636 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-c71d1385-3d18-458e-92ff-768e41460208 req-7defdd1e-56f8-4686-a54a-1d64299a9e46 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.093556 Oct 04 20:52:17.725347 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1949/3957] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:52:17 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:52:17.898039 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-6e810ad9-3ab0-43a7-8ed3-8c3fe80b7da9 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:17.898839 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-6e810ad9-3ab0-43a7-8ed3-8c3fe80b7da9 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] [instance: f8ba4e66-2997-4822-9c01-c570f5ae6e87] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:17.910701 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6e810ad9-3ab0-43a7-8ed3-8c3fe80b7da9 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:17.911431 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6e810ad9-3ab0-43a7-8ed3-8c3fe80b7da9 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:17.913007 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6e810ad9-3ab0-43a7-8ed3-8c3fe80b7da9 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:17.915346 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6e810ad9-3ab0-43a7-8ed3-8c3fe80b7da9 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:17.915966 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6e810ad9-3ab0-43a7-8ed3-8c3fe80b7da9 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:17.916556 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6e810ad9-3ab0-43a7-8ed3-8c3fe80b7da9 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:18.115037 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b65eae08-6df8-4287-a7c3-1f34d4443577 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:18.115741 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b65eae08-6df8-4287-a7c3-1f34d4443577 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: 4d46fff2-b04d-41aa-ada0-2023ab545b48] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:18.129700 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b65eae08-6df8-4287-a7c3-1f34d4443577 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:18.130856 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b65eae08-6df8-4287-a7c3-1f34d4443577 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:18.131308 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b65eae08-6df8-4287-a7c3-1f34d4443577 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:18.136461 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b65eae08-6df8-4287-a7c3-1f34d4443577 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:18.136943 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b65eae08-6df8-4287-a7c3-1f34d4443577 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:18.137936 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b65eae08-6df8-4287-a7c3-1f34d4443577 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:18.774274 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-6e810ad9-3ab0-43a7-8ed3-8c3fe80b7da9 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b78af5c0485b4343900269160ef3e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659f3d4023b347d58bc0361db9ceead9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:18.796978 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-6e810ad9-3ab0-43a7-8ed3-8c3fe80b7da9 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b78af5c0485b4343900269160ef3e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659f3d4023b347d58bc0361db9ceead9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:18.803491 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-6e810ad9-3ab0-43a7-8ed3-8c3fe80b7da9 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b78af5c0485b4343900269160ef3e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659f3d4023b347d58bc0361db9ceead9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:18.806846 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-6e810ad9-3ab0-43a7-8ed3-8c3fe80b7da9 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] 10.222.0.33 "GET /compute/v2.1/servers/f8ba4e66-2997-4822-9c01-c570f5ae6e87" status: 200 len: 1875 microversion: 2.42 time: 0.912724 Oct 04 20:52:18.822591 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2009/3958] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:52:17 2022] GET /compute/v2.1/servers/f8ba4e66-2997-4822-9c01-c570f5ae6e87 => generated 1875 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:52:18.841623 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-71610206-b161-499f-a091-5e65a437e276 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:18.843390 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-71610206-b161-499f-a091-5e65a437e276 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] [instance: 30eb289d-d09c-43fa-af8a-3c6ee303f0af] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:18.860744 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-71610206-b161-499f-a091-5e65a437e276 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:18.862931 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-71610206-b161-499f-a091-5e65a437e276 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:18.863677 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-71610206-b161-499f-a091-5e65a437e276 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:18.873298 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-71610206-b161-499f-a091-5e65a437e276 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:18.874598 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-71610206-b161-499f-a091-5e65a437e276 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:18.875224 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-71610206-b161-499f-a091-5e65a437e276 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:18.907656 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-b65eae08-6df8-4287-a7c3-1f34d4443577 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac650232cc04810b1340dc2f0edadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b0670d1bd99424780a70e69d57a2166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:18.917046 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b65eae08-6df8-4287-a7c3-1f34d4443577 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48" status: 200 len: 1679 microversion: 2.1 time: 0.807348 Oct 04 20:52:18.919766 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1950/3959] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:52:18 2022] GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48 => generated 1679 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:52:18.930601 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-cd80ba43-a4c6-45ed-8388-2c5b7cc17474 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:18.931506 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-cd80ba43-a4c6-45ed-8388-2c5b7cc17474 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] [instance: 866d0dd3-3c7e-4612-a132-48eb83ec2d16] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:18.945940 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cd80ba43-a4c6-45ed-8388-2c5b7cc17474 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:18.954988 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cd80ba43-a4c6-45ed-8388-2c5b7cc17474 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:18.955884 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cd80ba43-a4c6-45ed-8388-2c5b7cc17474 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:18.956901 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cd80ba43-a4c6-45ed-8388-2c5b7cc17474 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:18.957579 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cd80ba43-a4c6-45ed-8388-2c5b7cc17474 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:18.958181 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cd80ba43-a4c6-45ed-8388-2c5b7cc17474 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:19.102306 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-cd80ba43-a4c6-45ed-8388-2c5b7cc17474 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc4171c0ee14ebb8b5eff5e910ccf49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003eb03a265a496d8981e45c74b014f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:19.111186 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-cd80ba43-a4c6-45ed-8388-2c5b7cc17474 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] 10.222.0.33 "GET /compute/v2.1/servers/866d0dd3-3c7e-4612-a132-48eb83ec2d16" status: 200 len: 1304 microversion: 2.1 time: 0.184798 Oct 04 20:52:19.127513 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1951/3960] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:52:18 2022] GET /compute/v2.1/servers/866d0dd3-3c7e-4612-a132-48eb83ec2d16 => generated 1304 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:52:19.360728 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-71610206-b161-499f-a091-5e65a437e276 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c208ec9faf491385a9ab5b5932098d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ae4960393c464c97669731c2084d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:19.384011 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-71610206-b161-499f-a091-5e65a437e276 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] 10.222.0.33 "GET /compute/v2.1/servers/30eb289d-d09c-43fa-af8a-3c6ee303f0af" status: 200 len: 1506 microversion: 2.1 time: 0.560078 Oct 04 20:52:19.386104 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2010/3961] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:52:18 2022] GET /compute/v2.1/servers/30eb289d-d09c-43fa-af8a-3c6ee303f0af => generated 1506 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:52:19.844868 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c609ea2c-8bce-4a94-b464-add62f45c6bd tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:19.845489 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c609ea2c-8bce-4a94-b464-add62f45c6bd tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] [instance: f8ba4e66-2997-4822-9c01-c570f5ae6e87] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:19.859209 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=18 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:52:19.859955 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:52:19.861589 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c609ea2c-8bce-4a94-b464-add62f45c6bd tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:19.862492 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c609ea2c-8bce-4a94-b464-add62f45c6bd tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:19.862592 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c609ea2c-8bce-4a94-b464-add62f45c6bd tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:19.863274 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c609ea2c-8bce-4a94-b464-add62f45c6bd tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:19.863690 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c609ea2c-8bce-4a94-b464-add62f45c6bd tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:19.864111 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c609ea2c-8bce-4a94-b464-add62f45c6bd tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:19.946186 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-6a91433c-70f3-423f-b641-0882ec88b2d3 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:19.946918 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-6a91433c-70f3-423f-b641-0882ec88b2d3 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: 4d46fff2-b04d-41aa-ada0-2023ab545b48] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:19.957601 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6a91433c-70f3-423f-b641-0882ec88b2d3 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:19.957796 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6a91433c-70f3-423f-b641-0882ec88b2d3 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:19.961033 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6a91433c-70f3-423f-b641-0882ec88b2d3 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:19.961799 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6a91433c-70f3-423f-b641-0882ec88b2d3 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:19.962252 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6a91433c-70f3-423f-b641-0882ec88b2d3 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:19.962707 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6a91433c-70f3-423f-b641-0882ec88b2d3 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:20.680625 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-6a91433c-70f3-423f-b641-0882ec88b2d3 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac650232cc04810b1340dc2f0edadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b0670d1bd99424780a70e69d57a2166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:20.695500 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-6a91433c-70f3-423f-b641-0882ec88b2d3 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48" status: 200 len: 1679 microversion: 2.1 time: 0.753425 Oct 04 20:52:20.696657 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2011/3962] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:52:19 2022] GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48 => generated 1679 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:52:20.718121 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-ebb7c8b4-314d-4d1f-b2e2-d989216b9ccb tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:20.721011 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-ebb7c8b4-314d-4d1f-b2e2-d989216b9ccb tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] [instance: 866d0dd3-3c7e-4612-a132-48eb83ec2d16] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:20.751993 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ebb7c8b4-314d-4d1f-b2e2-d989216b9ccb tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:20.752712 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ebb7c8b4-314d-4d1f-b2e2-d989216b9ccb tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:20.754805 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ebb7c8b4-314d-4d1f-b2e2-d989216b9ccb tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:20.757020 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ebb7c8b4-314d-4d1f-b2e2-d989216b9ccb tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:20.757688 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ebb7c8b4-314d-4d1f-b2e2-d989216b9ccb tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:20.760653 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ebb7c8b4-314d-4d1f-b2e2-d989216b9ccb tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:20.796512 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=100 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:52:21.021170 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c609ea2c-8bce-4a94-b464-add62f45c6bd tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b78af5c0485b4343900269160ef3e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659f3d4023b347d58bc0361db9ceead9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:21.043459 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c609ea2c-8bce-4a94-b464-add62f45c6bd tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b78af5c0485b4343900269160ef3e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659f3d4023b347d58bc0361db9ceead9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:21.045633 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c609ea2c-8bce-4a94-b464-add62f45c6bd tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b78af5c0485b4343900269160ef3e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659f3d4023b347d58bc0361db9ceead9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:21.047661 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c609ea2c-8bce-4a94-b464-add62f45c6bd tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] 10.222.0.33 "GET /compute/v2.1/servers/f8ba4e66-2997-4822-9c01-c570f5ae6e87" status: 200 len: 1875 microversion: 2.42 time: 1.206235 Oct 04 20:52:21.048410 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1952/3963] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:52:19 2022] GET /compute/v2.1/servers/f8ba4e66-2997-4822-9c01-c570f5ae6e87 => generated 1875 bytes in 1208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:52:21.075412 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-92344dd3-44db-4a11-959e-2bb2b30ff8bf tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:21.076580 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-92344dd3-44db-4a11-959e-2bb2b30ff8bf tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] [instance: 30eb289d-d09c-43fa-af8a-3c6ee303f0af] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:21.083253 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-92344dd3-44db-4a11-959e-2bb2b30ff8bf tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:21.083969 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-92344dd3-44db-4a11-959e-2bb2b30ff8bf tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:21.085001 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-92344dd3-44db-4a11-959e-2bb2b30ff8bf tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:21.086008 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-92344dd3-44db-4a11-959e-2bb2b30ff8bf tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:21.086761 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-92344dd3-44db-4a11-959e-2bb2b30ff8bf tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:21.087328 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-92344dd3-44db-4a11-959e-2bb2b30ff8bf tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:21.356590 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-ebb7c8b4-314d-4d1f-b2e2-d989216b9ccb tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc4171c0ee14ebb8b5eff5e910ccf49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003eb03a265a496d8981e45c74b014f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:21.368853 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-ebb7c8b4-314d-4d1f-b2e2-d989216b9ccb tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] 10.222.0.33 "GET /compute/v2.1/servers/866d0dd3-3c7e-4612-a132-48eb83ec2d16" status: 200 len: 1371 microversion: 2.1 time: 0.670519 Oct 04 20:52:21.370813 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2012/3964] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:52:20 2022] GET /compute/v2.1/servers/866d0dd3-3c7e-4612-a132-48eb83ec2d16 => generated 1371 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:52:21.550207 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-92344dd3-44db-4a11-959e-2bb2b30ff8bf tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c208ec9faf491385a9ab5b5932098d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ae4960393c464c97669731c2084d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:21.561298 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-92344dd3-44db-4a11-959e-2bb2b30ff8bf tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] 10.222.0.33 "GET /compute/v2.1/servers/30eb289d-d09c-43fa-af8a-3c6ee303f0af" status: 200 len: 1506 microversion: 2.1 time: 0.494800 Oct 04 20:52:21.562327 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1953/3965] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:52:21 2022] GET /compute/v2.1/servers/30eb289d-d09c-43fa-af8a-3c6ee303f0af => generated 1506 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:52:21.726938 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-b6ce37eb-3c13-4a72-838d-0b16d7290505 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:21.727612 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-b6ce37eb-3c13-4a72-838d-0b16d7290505 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: 4d46fff2-b04d-41aa-ada0-2023ab545b48] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:21.753686 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b6ce37eb-3c13-4a72-838d-0b16d7290505 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:21.754248 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b6ce37eb-3c13-4a72-838d-0b16d7290505 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:21.754733 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b6ce37eb-3c13-4a72-838d-0b16d7290505 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:21.759345 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b6ce37eb-3c13-4a72-838d-0b16d7290505 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:21.761548 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b6ce37eb-3c13-4a72-838d-0b16d7290505 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:21.762827 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b6ce37eb-3c13-4a72-838d-0b16d7290505 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:21.866074 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-bcad9d03-861c-4e1b-9a2c-2e83162be90c req-7e95c555-02ac-4791-be26-197cb81011c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "866d0dd3-3c7e-4612-a132-48eb83ec2d16", "tag": "0544b7b3-d2c3-439a-b134-c025dc0ed7a6"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:52:21.889400 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-bcad9d03-861c-4e1b-9a2c-2e83162be90c req-7e95c555-02ac-4791-be26-197cb81011c2 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:21.890435 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-bcad9d03-861c-4e1b-9a2c-2e83162be90c req-7e95c555-02ac-4791-be26-197cb81011c2 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:21.891404 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-bcad9d03-861c-4e1b-9a2c-2e83162be90c req-7e95c555-02ac-4791-be26-197cb81011c2 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:21.920759 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-bcad9d03-861c-4e1b-9a2c-2e83162be90c req-7e95c555-02ac-4791-be26-197cb81011c2 service nova] Creating event network-changed:0544b7b3-d2c3-439a-b134-c025dc0ed7a6 for instance 866d0dd3-3c7e-4612-a132-48eb83ec2d16 on n-h2-854823-8 Oct 04 20:52:21.941177 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-bcad9d03-861c-4e1b-9a2c-2e83162be90c req-7e95c555-02ac-4791-be26-197cb81011c2 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079438 Oct 04 20:52:21.943643 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1954/3966] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:52:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:52:22.081536 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c181e868-73f7-4a6e-aaea-daab84fe8a59 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:22.082544 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c181e868-73f7-4a6e-aaea-daab84fe8a59 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] [instance: f8ba4e66-2997-4822-9c01-c570f5ae6e87] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:22.097191 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c181e868-73f7-4a6e-aaea-daab84fe8a59 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:22.098859 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c181e868-73f7-4a6e-aaea-daab84fe8a59 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:22.104476 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c181e868-73f7-4a6e-aaea-daab84fe8a59 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:22.109819 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c181e868-73f7-4a6e-aaea-daab84fe8a59 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:22.110472 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c181e868-73f7-4a6e-aaea-daab84fe8a59 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:22.113085 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c181e868-73f7-4a6e-aaea-daab84fe8a59 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:23.044914 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-b6ce37eb-3c13-4a72-838d-0b16d7290505 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac650232cc04810b1340dc2f0edadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b0670d1bd99424780a70e69d57a2166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:23.056907 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-b6ce37eb-3c13-4a72-838d-0b16d7290505 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48" status: 200 len: 1656 microversion: 2.1 time: 1.335166 Oct 04 20:52:23.066715 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2013/3967] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:52:21 2022] GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48 => generated 1656 bytes in 1346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:52:23.079892 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-c8fe478b-dfe0-4130-8503-a50ab48d2891 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:23.081177 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-c8fe478b-dfe0-4130-8503-a50ab48d2891 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] [instance: 866d0dd3-3c7e-4612-a132-48eb83ec2d16] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:23.104860 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell0:SELECT=2 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:52:23.115671 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c8fe478b-dfe0-4130-8503-a50ab48d2891 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:23.116231 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c8fe478b-dfe0-4130-8503-a50ab48d2891 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:23.117365 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c8fe478b-dfe0-4130-8503-a50ab48d2891 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:23.118153 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c8fe478b-dfe0-4130-8503-a50ab48d2891 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:23.118659 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c8fe478b-dfe0-4130-8503-a50ab48d2891 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:23.119081 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c8fe478b-dfe0-4130-8503-a50ab48d2891 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:23.468076 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell0:SELECT=24 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:52:23.673946 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c181e868-73f7-4a6e-aaea-daab84fe8a59 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b78af5c0485b4343900269160ef3e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659f3d4023b347d58bc0361db9ceead9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:23.687479 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c181e868-73f7-4a6e-aaea-daab84fe8a59 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b78af5c0485b4343900269160ef3e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659f3d4023b347d58bc0361db9ceead9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:23.689248 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c181e868-73f7-4a6e-aaea-daab84fe8a59 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b78af5c0485b4343900269160ef3e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659f3d4023b347d58bc0361db9ceead9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:23.693328 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c181e868-73f7-4a6e-aaea-daab84fe8a59 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] 10.222.0.33 "GET /compute/v2.1/servers/f8ba4e66-2997-4822-9c01-c570f5ae6e87" status: 200 len: 2832 microversion: 2.42 time: 1.618623 Oct 04 20:52:23.697525 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1955/3968] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:52:22 2022] GET /compute/v2.1/servers/f8ba4e66-2997-4822-9c01-c570f5ae6e87 => generated 2832 bytes in 1623 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 20:52:23.718323 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f42688c1-dfbd-49ac-8e0e-bafc51a2e8b8 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:23.721911 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f42688c1-dfbd-49ac-8e0e-bafc51a2e8b8 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] [instance: 30eb289d-d09c-43fa-af8a-3c6ee303f0af] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:23.749429 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f42688c1-dfbd-49ac-8e0e-bafc51a2e8b8 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:23.750269 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f42688c1-dfbd-49ac-8e0e-bafc51a2e8b8 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:23.751905 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f42688c1-dfbd-49ac-8e0e-bafc51a2e8b8 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:23.753292 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f42688c1-dfbd-49ac-8e0e-bafc51a2e8b8 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:23.754245 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f42688c1-dfbd-49ac-8e0e-bafc51a2e8b8 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:23.756887 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f42688c1-dfbd-49ac-8e0e-bafc51a2e8b8 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:23.839953 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-c8fe478b-dfe0-4130-8503-a50ab48d2891 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc4171c0ee14ebb8b5eff5e910ccf49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003eb03a265a496d8981e45c74b014f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:23.856743 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-c8fe478b-dfe0-4130-8503-a50ab48d2891 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] 10.222.0.33 "GET /compute/v2.1/servers/866d0dd3-3c7e-4612-a132-48eb83ec2d16" status: 200 len: 1371 microversion: 2.1 time: 0.788634 Oct 04 20:52:23.874395 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2014/3969] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:52:23 2022] GET /compute/v2.1/servers/866d0dd3-3c7e-4612-a132-48eb83ec2d16 => generated 1371 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:52:23.878051 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-2bd1ebde-9d5c-4967-a3c3-09e1557bb047 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:52:23.895986 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2bd1ebde-9d5c-4967-a3c3-09e1557bb047 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:23.896488 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2bd1ebde-9d5c-4967-a3c3-09e1557bb047 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:23.896924 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2bd1ebde-9d5c-4967-a3c3-09e1557bb047 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:23.946449 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-2bd1ebde-9d5c-4967-a3c3-09e1557bb047 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: 4d46fff2-b04d-41aa-ada0-2023ab545b48] Going to try to start instance {{(pid=128802) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 04 20:52:24.066146 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-2bd1ebde-9d5c-4967-a3c3-09e1557bb047 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "POST /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48/action" status: 202 len: 0 microversion: 2.1 time: 0.191913 Oct 04 20:52:24.079563 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2015/3970] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 20:52:23 2022] POST /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48/action => generated 0 bytes in 206 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:52:24.093102 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-f5066f04-4ded-447e-9c46-c133a65b125c tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:24.093912 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-f5066f04-4ded-447e-9c46-c133a65b125c tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] [instance: f8ba4e66-2997-4822-9c01-c570f5ae6e87] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:24.107903 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f5066f04-4ded-447e-9c46-c133a65b125c tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:24.108637 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f5066f04-4ded-447e-9c46-c133a65b125c tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:24.109242 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f5066f04-4ded-447e-9c46-c133a65b125c tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:24.110377 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f5066f04-4ded-447e-9c46-c133a65b125c tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:24.111117 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f5066f04-4ded-447e-9c46-c133a65b125c tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:24.111864 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f5066f04-4ded-447e-9c46-c133a65b125c tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:24.347903 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-f5066f04-4ded-447e-9c46-c133a65b125c tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] 10.222.0.33 "GET /compute/v2.1/servers/f8ba4e66-2997-4822-9c01-c570f5ae6e87/os-interface" status: 200 len: 1830 microversion: 2.42 time: 0.266714 Oct 04 20:52:24.348508 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2016/3971] 10.222.0.33 () {60 vars in 1316 bytes} [Tue Oct 4 20:52:24 2022] GET /compute/v2.1/servers/f8ba4e66-2997-4822-9c01-c570f5ae6e87/os-interface => generated 1830 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:52:24.354716 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-7ae589e6-605a-47d7-94ef-8b55e192782c tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:24.356415 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-7ae589e6-605a-47d7-94ef-8b55e192782c tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: 4d46fff2-b04d-41aa-ada0-2023ab545b48] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:24.371257 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7ae589e6-605a-47d7-94ef-8b55e192782c tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:24.372408 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7ae589e6-605a-47d7-94ef-8b55e192782c tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:24.374979 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7ae589e6-605a-47d7-94ef-8b55e192782c tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:24.379223 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7ae589e6-605a-47d7-94ef-8b55e192782c tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:24.379721 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7ae589e6-605a-47d7-94ef-8b55e192782c tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:24.380158 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7ae589e6-605a-47d7-94ef-8b55e192782c tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:24.397147 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f42688c1-dfbd-49ac-8e0e-bafc51a2e8b8 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c208ec9faf491385a9ab5b5932098d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ae4960393c464c97669731c2084d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:24.407264 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f42688c1-dfbd-49ac-8e0e-bafc51a2e8b8 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] 10.222.0.33 "GET /compute/v2.1/servers/30eb289d-d09c-43fa-af8a-3c6ee303f0af" status: 200 len: 1506 microversion: 2.1 time: 0.708505 Oct 04 20:52:24.416205 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1956/3972] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:52:23 2022] GET /compute/v2.1/servers/30eb289d-d09c-43fa-af8a-3c6ee303f0af => generated 1506 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:52:24.881985 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2fdf49e4-9adc-4424-aae4-0eae0276f07e tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:24.882754 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-2fdf49e4-9adc-4424-aae4-0eae0276f07e tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] [instance: 866d0dd3-3c7e-4612-a132-48eb83ec2d16] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:24.896905 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2fdf49e4-9adc-4424-aae4-0eae0276f07e tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:24.900103 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2fdf49e4-9adc-4424-aae4-0eae0276f07e tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:24.900792 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2fdf49e4-9adc-4424-aae4-0eae0276f07e tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:24.901698 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2fdf49e4-9adc-4424-aae4-0eae0276f07e tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:24.910412 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2fdf49e4-9adc-4424-aae4-0eae0276f07e tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:24.911121 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2fdf49e4-9adc-4424-aae4-0eae0276f07e tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:25.247415 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-7ae589e6-605a-47d7-94ef-8b55e192782c tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac650232cc04810b1340dc2f0edadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b0670d1bd99424780a70e69d57a2166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:25.258045 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-7ae589e6-605a-47d7-94ef-8b55e192782c tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48" status: 200 len: 1665 microversion: 2.1 time: 0.908048 Oct 04 20:52:25.271646 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2017/3973] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:52:24 2022] GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48 => generated 1665 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:52:25.432415 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-2fdf49e4-9adc-4424-aae4-0eae0276f07e tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc4171c0ee14ebb8b5eff5e910ccf49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003eb03a265a496d8981e45c74b014f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:25.440559 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-35a28d0e-d92d-43a6-ae45-36adea747bb4 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:25.441165 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-35a28d0e-d92d-43a6-ae45-36adea747bb4 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] [instance: 30eb289d-d09c-43fa-af8a-3c6ee303f0af] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:25.444277 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=100 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:52:25.463481 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-35a28d0e-d92d-43a6-ae45-36adea747bb4 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:25.465446 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-2fdf49e4-9adc-4424-aae4-0eae0276f07e tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] 10.222.0.33 "GET /compute/v2.1/servers/866d0dd3-3c7e-4612-a132-48eb83ec2d16" status: 200 len: 1371 microversion: 2.1 time: 0.588110 Oct 04 20:52:25.466273 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-35a28d0e-d92d-43a6-ae45-36adea747bb4 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:25.466960 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-35a28d0e-d92d-43a6-ae45-36adea747bb4 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:25.467750 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1957/3974] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:52:24 2022] GET /compute/v2.1/servers/866d0dd3-3c7e-4612-a132-48eb83ec2d16 => generated 1371 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:52:25.468739 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-35a28d0e-d92d-43a6-ae45-36adea747bb4 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:25.469554 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-35a28d0e-d92d-43a6-ae45-36adea747bb4 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:25.470207 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-35a28d0e-d92d-43a6-ae45-36adea747bb4 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:26.273117 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-35a28d0e-d92d-43a6-ae45-36adea747bb4 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c208ec9faf491385a9ab5b5932098d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ae4960393c464c97669731c2084d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:26.290580 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a0a727cc-4198-44b4-9539-4060744d52bc tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:26.292328 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a0a727cc-4198-44b4-9539-4060744d52bc tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: 4d46fff2-b04d-41aa-ada0-2023ab545b48] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:26.302780 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-35a28d0e-d92d-43a6-ae45-36adea747bb4 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] 10.222.0.33 "GET /compute/v2.1/servers/30eb289d-d09c-43fa-af8a-3c6ee303f0af" status: 200 len: 1506 microversion: 2.1 time: 0.866159 Oct 04 20:52:26.307579 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2018/3975] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:52:25 2022] GET /compute/v2.1/servers/30eb289d-d09c-43fa-af8a-3c6ee303f0af => generated 1506 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:52:26.309490 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a0a727cc-4198-44b4-9539-4060744d52bc tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:26.312111 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a0a727cc-4198-44b4-9539-4060744d52bc tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:26.312709 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a0a727cc-4198-44b4-9539-4060744d52bc tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:26.314746 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a0a727cc-4198-44b4-9539-4060744d52bc tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:26.316085 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a0a727cc-4198-44b4-9539-4060744d52bc tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:26.316920 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a0a727cc-4198-44b4-9539-4060744d52bc tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:26.504047 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-7449af93-d119-4d6a-b2b1-61eae255bc31 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:26.506828 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-7449af93-d119-4d6a-b2b1-61eae255bc31 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] [instance: 866d0dd3-3c7e-4612-a132-48eb83ec2d16] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:26.533679 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7449af93-d119-4d6a-b2b1-61eae255bc31 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:26.534209 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7449af93-d119-4d6a-b2b1-61eae255bc31 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:26.534744 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7449af93-d119-4d6a-b2b1-61eae255bc31 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:26.535434 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7449af93-d119-4d6a-b2b1-61eae255bc31 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:26.535967 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7449af93-d119-4d6a-b2b1-61eae255bc31 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:26.536424 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7449af93-d119-4d6a-b2b1-61eae255bc31 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:26.983770 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-a0a727cc-4198-44b4-9539-4060744d52bc tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac650232cc04810b1340dc2f0edadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b0670d1bd99424780a70e69d57a2166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:27.000704 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a0a727cc-4198-44b4-9539-4060744d52bc tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48" status: 200 len: 1665 microversion: 2.1 time: 0.719409 Oct 04 20:52:27.001897 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1958/3976] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:52:26 2022] GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48 => generated 1665 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:52:27.332748 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d9dca7c4-343b-4679-8329-18128e080b90 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:27.342222 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d9dca7c4-343b-4679-8329-18128e080b90 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] [instance: 30eb289d-d09c-43fa-af8a-3c6ee303f0af] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:27.361949 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d9dca7c4-343b-4679-8329-18128e080b90 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:27.362731 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d9dca7c4-343b-4679-8329-18128e080b90 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:27.363330 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d9dca7c4-343b-4679-8329-18128e080b90 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:27.364200 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d9dca7c4-343b-4679-8329-18128e080b90 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:27.364816 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d9dca7c4-343b-4679-8329-18128e080b90 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:27.365462 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d9dca7c4-343b-4679-8329-18128e080b90 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:27.823145 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-7449af93-d119-4d6a-b2b1-61eae255bc31 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc4171c0ee14ebb8b5eff5e910ccf49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003eb03a265a496d8981e45c74b014f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:27.832984 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-7449af93-d119-4d6a-b2b1-61eae255bc31 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] 10.222.0.33 "GET /compute/v2.1/servers/866d0dd3-3c7e-4612-a132-48eb83ec2d16" status: 200 len: 1371 microversion: 2.1 time: 1.339197 Oct 04 20:52:27.834163 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2019/3977] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:52:26 2022] GET /compute/v2.1/servers/866d0dd3-3c7e-4612-a132-48eb83ec2d16 => generated 1371 bytes in 1341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:52:28.130449 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d9dca7c4-343b-4679-8329-18128e080b90 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c208ec9faf491385a9ab5b5932098d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ae4960393c464c97669731c2084d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:28.142774 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d9dca7c4-343b-4679-8329-18128e080b90 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] 10.222.0.33 "GET /compute/v2.1/servers/30eb289d-d09c-43fa-af8a-3c6ee303f0af" status: 200 len: 1527 microversion: 2.1 time: 0.813169 Oct 04 20:52:28.145298 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1959/3978] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:52:27 2022] GET /compute/v2.1/servers/30eb289d-d09c-43fa-af8a-3c6ee303f0af => generated 1527 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:52:28.156539 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7f278c90-d0ee-4fda-b9e8-1136cd835bf6 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:28.157506 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-7f278c90-d0ee-4fda-b9e8-1136cd835bf6 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: 4d46fff2-b04d-41aa-ada0-2023ab545b48] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:28.174308 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7f278c90-d0ee-4fda-b9e8-1136cd835bf6 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:28.174861 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7f278c90-d0ee-4fda-b9e8-1136cd835bf6 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:28.175305 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7f278c90-d0ee-4fda-b9e8-1136cd835bf6 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:28.176018 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7f278c90-d0ee-4fda-b9e8-1136cd835bf6 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:28.176472 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7f278c90-d0ee-4fda-b9e8-1136cd835bf6 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:28.179868 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7f278c90-d0ee-4fda-b9e8-1136cd835bf6 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:28.281642 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-f41b0f4a-0370-4797-8057-6bc45be1b4d1 tempest-SecurityGroupRulesNegativeTestJSON-1167498397 tempest-SecurityGroupRulesNegativeTestJSON-1167498397-project] Action: 'create', calling method: .version_select at 0x7f3c6f5e8040>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-24811413", "description": "tempest-description-2125840681"}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:52:28.655855 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-7f278c90-d0ee-4fda-b9e8-1136cd835bf6 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac650232cc04810b1340dc2f0edadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b0670d1bd99424780a70e69d57a2166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:28.669685 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-7f278c90-d0ee-4fda-b9e8-1136cd835bf6 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48" status: 200 len: 1669 microversion: 2.1 time: 0.521124 Oct 04 20:52:28.673021 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1960/3979] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:52:28 2022] GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48 => generated 1669 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:52:28.678820 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-9dd9f810-42bc-4192-b44e-2cefde1ee03e req-5118c1f9-29c2-4e89-b3e9-c6f19f432252 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8ba4e66-2997-4822-9c01-c570f5ae6e87", "tag": "6e6d2a48-9844-45c7-a3ac-b235535858ac"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:52:28.710554 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-9dd9f810-42bc-4192-b44e-2cefde1ee03e req-5118c1f9-29c2-4e89-b3e9-c6f19f432252 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:28.711331 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-9dd9f810-42bc-4192-b44e-2cefde1ee03e req-5118c1f9-29c2-4e89-b3e9-c6f19f432252 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:28.712060 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-9dd9f810-42bc-4192-b44e-2cefde1ee03e req-5118c1f9-29c2-4e89-b3e9-c6f19f432252 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:28.739239 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-9dd9f810-42bc-4192-b44e-2cefde1ee03e req-5118c1f9-29c2-4e89-b3e9-c6f19f432252 service nova] Creating event network-changed:6e6d2a48-9844-45c7-a3ac-b235535858ac for instance f8ba4e66-2997-4822-9c01-c570f5ae6e87 on n-h1-854823-8 Oct 04 20:52:28.748996 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-9dd9f810-42bc-4192-b44e-2cefde1ee03e req-5118c1f9-29c2-4e89-b3e9-c6f19f432252 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073504 Oct 04 20:52:28.750878 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1961/3980] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:52:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:52:28.758959 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0b1e462e-f7da-47b5-ba6d-9ae31171774d tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:28.760134 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-0b1e462e-f7da-47b5-ba6d-9ae31171774d tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: 4d46fff2-b04d-41aa-ada0-2023ab545b48] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:28.770737 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0b1e462e-f7da-47b5-ba6d-9ae31171774d tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:28.771749 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0b1e462e-f7da-47b5-ba6d-9ae31171774d tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:28.772560 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0b1e462e-f7da-47b5-ba6d-9ae31171774d tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:28.773483 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0b1e462e-f7da-47b5-ba6d-9ae31171774d tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:28.774322 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0b1e462e-f7da-47b5-ba6d-9ae31171774d tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:28.774988 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0b1e462e-f7da-47b5-ba6d-9ae31171774d tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:28.917226 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-f41b0f4a-0370-4797-8057-6bc45be1b4d1 tempest-SecurityGroupRulesNegativeTestJSON-1167498397 tempest-SecurityGroupRulesNegativeTestJSON-1167498397-project] 10.222.0.33 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 1.081465 Oct 04 20:52:28.922107 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2020/3981] 10.222.0.33 () {60 vars in 1180 bytes} [Tue Oct 4 20:52:27 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:52:28.927547 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-a0ed47ef-1ee6-410d-b5f4-b17e01c7e28e tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:28.928357 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-a0ed47ef-1ee6-410d-b5f4-b17e01c7e28e tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] [instance: 866d0dd3-3c7e-4612-a132-48eb83ec2d16] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:28.945723 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a0ed47ef-1ee6-410d-b5f4-b17e01c7e28e tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:28.948261 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a0ed47ef-1ee6-410d-b5f4-b17e01c7e28e tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:28.950036 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a0ed47ef-1ee6-410d-b5f4-b17e01c7e28e tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:28.952150 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a0ed47ef-1ee6-410d-b5f4-b17e01c7e28e tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:28.952876 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a0ed47ef-1ee6-410d-b5f4-b17e01c7e28e tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:28.955490 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a0ed47ef-1ee6-410d-b5f4-b17e01c7e28e tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:29.282072 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-0b1e462e-f7da-47b5-ba6d-9ae31171774d tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac650232cc04810b1340dc2f0edadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b0670d1bd99424780a70e69d57a2166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:29.297740 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-0b1e462e-f7da-47b5-ba6d-9ae31171774d tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48" status: 200 len: 1669 microversion: 2.1 time: 0.545325 Oct 04 20:52:29.298714 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1962/3982] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:52:28 2022] GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48 => generated 1669 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:52:29.303657 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ec499cc6-313d-4a72-874a-431cda212a63 tempest-SecurityGroupRulesNegativeTestJSON-1167498397 tempest-SecurityGroupRulesNegativeTestJSON-1167498397-project] Action: 'create', calling method: .version_select at 0x7f3c745345e0>, body: {"security_group_rule": {"parent_group_id": "0e598515-dfd3-44cf-9c98-1e1a4df46bec", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:52:29.400100 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-a0ed47ef-1ee6-410d-b5f4-b17e01c7e28e tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc4171c0ee14ebb8b5eff5e910ccf49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003eb03a265a496d8981e45c74b014f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:29.413895 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-a0ed47ef-1ee6-410d-b5f4-b17e01c7e28e tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] 10.222.0.33 "GET /compute/v2.1/servers/866d0dd3-3c7e-4612-a132-48eb83ec2d16" status: 200 len: 1371 microversion: 2.1 time: 0.487600 Oct 04 20:52:29.435732 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2021/3983] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:52:28 2022] GET /compute/v2.1/servers/866d0dd3-3c7e-4612-a132-48eb83ec2d16 => generated 1371 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:52:29.445347 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-194c8cca-4d5e-4661-8a83-2fa21601ff0f tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:29.448800 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-194c8cca-4d5e-4661-8a83-2fa21601ff0f tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] [instance: 30eb289d-d09c-43fa-af8a-3c6ee303f0af] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:29.460479 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:52:29.464189 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-194c8cca-4d5e-4661-8a83-2fa21601ff0f tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:29.464695 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-194c8cca-4d5e-4661-8a83-2fa21601ff0f tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:29.466120 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-194c8cca-4d5e-4661-8a83-2fa21601ff0f tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:29.468354 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-194c8cca-4d5e-4661-8a83-2fa21601ff0f tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:29.468731 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-194c8cca-4d5e-4661-8a83-2fa21601ff0f tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:29.469168 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-194c8cca-4d5e-4661-8a83-2fa21601ff0f tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:30.105811 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-194c8cca-4d5e-4661-8a83-2fa21601ff0f tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c208ec9faf491385a9ab5b5932098d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ae4960393c464c97669731c2084d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:30.117887 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-194c8cca-4d5e-4661-8a83-2fa21601ff0f tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] 10.222.0.33 "GET /compute/v2.1/servers/30eb289d-d09c-43fa-af8a-3c6ee303f0af" status: 200 len: 1522 microversion: 2.1 time: 0.680859 Oct 04 20:52:30.121851 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2022/3984] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:52:29 2022] GET /compute/v2.1/servers/30eb289d-d09c-43fa-af8a-3c6ee303f0af => generated 1522 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:52:30.140068 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-d5a12207-7509-4d9c-bdac-a5c4151a00dd tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:30.142555 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-d5a12207-7509-4d9c-bdac-a5c4151a00dd tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: 4d46fff2-b04d-41aa-ada0-2023ab545b48] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:30.160865 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d5a12207-7509-4d9c-bdac-a5c4151a00dd tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:30.161868 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d5a12207-7509-4d9c-bdac-a5c4151a00dd tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:30.163810 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d5a12207-7509-4d9c-bdac-a5c4151a00dd tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:30.164721 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d5a12207-7509-4d9c-bdac-a5c4151a00dd tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:30.167025 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d5a12207-7509-4d9c-bdac-a5c4151a00dd tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:30.167797 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d5a12207-7509-4d9c-bdac-a5c4151a00dd tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:30.586148 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ec499cc6-313d-4a72-874a-431cda212a63 tempest-SecurityGroupRulesNegativeTestJSON-1167498397 tempest-SecurityGroupRulesNegativeTestJSON-1167498397-project] 10.222.0.33 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 1.286075 Oct 04 20:52:30.587095 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1963/3985] 10.222.0.33 () {60 vars in 1195 bytes} [Tue Oct 4 20:52:29 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 1287 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:52:30.593479 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-54c90043-143b-4064-8c55-299b0a0e3ddb tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:30.594397 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-54c90043-143b-4064-8c55-299b0a0e3ddb tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] [instance: 866d0dd3-3c7e-4612-a132-48eb83ec2d16] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:30.601640 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-d5a12207-7509-4d9c-bdac-a5c4151a00dd tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac650232cc04810b1340dc2f0edadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b0670d1bd99424780a70e69d57a2166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:30.613781 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-d5a12207-7509-4d9c-bdac-a5c4151a00dd tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48" status: 200 len: 1669 microversion: 2.1 time: 0.488295 Oct 04 20:52:30.631301 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2023/3986] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:52:30 2022] GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48 => generated 1669 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:52:30.638001 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-54c90043-143b-4064-8c55-299b0a0e3ddb tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:30.638274 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-54c90043-143b-4064-8c55-299b0a0e3ddb tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:30.639898 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-54c90043-143b-4064-8c55-299b0a0e3ddb tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:30.640157 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-50a72ef8-519d-445e-836d-39f1ca40be44 tempest-SecurityGroupRulesNegativeTestJSON-1167498397 tempest-SecurityGroupRulesNegativeTestJSON-1167498397-project] Action: 'create', calling method: .version_select at 0x7f3c6f5f7d30>, body: {"security_group_rule": {"parent_group_id": "0e598515-dfd3-44cf-9c98-1e1a4df46bec", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:52:30.646874 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-54c90043-143b-4064-8c55-299b0a0e3ddb tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:30.648694 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-54c90043-143b-4064-8c55-299b0a0e3ddb tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:30.649505 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-54c90043-143b-4064-8c55-299b0a0e3ddb tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:30.865379 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.wsgi [None req-50a72ef8-519d-445e-836d-39f1ca40be44 tempest-SecurityGroupRulesNegativeTestJSON-1167498397 tempest-SecurityGroupRulesNegativeTestJSON-1167498397-project] HTTP exception thrown: This rule already exists in group 0e598515-dfd3-44cf-9c98-1e1a4df46bec Oct 04 20:52:30.868031 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-50a72ef8-519d-445e-836d-39f1ca40be44 tempest-SecurityGroupRulesNegativeTestJSON-1167498397 tempest-SecurityGroupRulesNegativeTestJSON-1167498397-project] Request method failure captured: Oct 04 20:52:30.868031 n-d-854823-8 devstack@n-api.service[128802]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 04 20:52:30.868031 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 20:52:30.868031 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 20:52:30.868031 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 20:52:30.868031 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 138 Oct 04 20:52:30.868031 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 20:52:30.868031 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 20:52:30.868031 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 20:52:30.868031 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 20:52:30.868031 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPJ0LcMfISyKByig7GM_j4o1hIV10bXRG2l7JkvcuoTfJxDJriqO6srj_S1eOB6sNCi15vy6TPRx1ePrmt5tT56lLETrgcSJ7IMtNYnHpFowEl-n7gGSz7JUSscSwPkc1W9yF0xq9xzy6ddwRIXvHqAUScNfdov8hFtte_udSWJyiGlY Oct 04 20:52:30.868031 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 20:52:30.868031 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 20:52:30.868031 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 20:52:30.868031 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 20:52:30.868031 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 20:52:30.868031 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 20:52:30.868031 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: fbf529844e0b41b79049d9c9dc8f627b Oct 04 20:52:30.868031 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1167498397 Oct 04 20:52:30.868031 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 20:52:30.868031 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 20:52:30.868031 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_fbf529844e0b41b79049d9c9dc8f627b", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fbf529844e0b41b79049d9c9dc8f627b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fbf529844e0b41b79049d9c9dc8f627b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/fbf529844e0b41b79049d9c9dc8f627b"}]}] Oct 04 20:52:30.868031 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1167498397 Oct 04 20:52:30.868031 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: fbf529844e0b41b79049d9c9dc8f627b Oct 04 20:52:30.868031 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1167498397 Oct 04 20:52:30.868031 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1167498397-project Oct 04 20:52:30.868031 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 20:52:30.868031 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 20:52:30.868031 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: d315a7741a32465496190ea1ddc886d6 Oct 04 20:52:30.868031 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1167498397-project Oct 04 20:52:30.868031 n-d-854823-8 devstack@n-api.service[128802]: Oct 04 20:52:30.868031 n-d-854823-8 devstack@n-api.service[128802]: {"security_group_rule": {"parent_group_id": "0e598515-dfd3-44cf-9c98-1e1a4df46bec", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Oct 04 20:52:30.868031 n-d-854823-8 devstack@n-api.service[128802]: method: Oct 04 20:52:30.868031 n-d-854823-8 devstack@n-api.service[128802]: exception: This rule already exists in group 0e598515-dfd3-44cf-9c98-1e1a4df46bec Oct 04 20:52:30.868031 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'body': {'security_group_rule': {'parent_group_id': '0e598515-dfd3-44cf-9c98-1e1a4df46bec', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Oct 04 20:52:30.868031 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:52:30.868031 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:52:30.868031 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 324, in create Oct 04 20:52:30.868031 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi security_group_api.create_security_group_rule( Oct 04 20:52:30.868031 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 186, in create_security_group_rule Oct 04 20:52:30.868031 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Oct 04 20:52:30.868031 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: This rule already exists in group 0e598515-dfd3-44cf-9c98-1e1a4df46bec Oct 04 20:52:30.868031 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:52:30.868031 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:52:30.868031 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:52:30.868031 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:52:30.868031 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:52:30.868031 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:52:30.868031 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:52:30.868031 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:52:30.868031 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:52:30.868031 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:52:30.868031 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:52:30.868031 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:52:30.868031 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 327, in create Oct 04 20:52:30.868031 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 04 20:52:30.868031 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: This rule already exists in group 0e598515-dfd3-44cf-9c98-1e1a4df46bec Oct 04 20:52:30.868031 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:52:30.868031 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:52:30.868031 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:52:30.868031 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:52:30.868031 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:52:30.868031 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:52:30.872127 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:52:30.872127 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:52:30.872127 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: This rule already exists in group 0e598515-dfd3-44cf-9c98-1e1a4df46bec Oct 04 20:52:30.872127 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:52:30.874068 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-50a72ef8-519d-445e-836d-39f1ca40be44 tempest-SecurityGroupRulesNegativeTestJSON-1167498397 tempest-SecurityGroupRulesNegativeTestJSON-1167498397-project] Returning 400 to user: This rule already exists in group 0e598515-dfd3-44cf-9c98-1e1a4df46bec {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:52:30.875419 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-50a72ef8-519d-445e-836d-39f1ca40be44 tempest-SecurityGroupRulesNegativeTestJSON-1167498397 tempest-SecurityGroupRulesNegativeTestJSON-1167498397-project] 10.222.0.33 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 114 microversion: 2.1 time: 0.243008 Oct 04 20:52:30.879879 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2024/3987] 10.222.0.33 () {60 vars in 1195 bytes} [Tue Oct 4 20:52:30 2022] POST /compute/v2.1/os-security-group-rules => generated 114 bytes in 248 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 20:52:30.893051 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-a0afe97e-e393-4b68-8d73-11af3cf5d12e tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:30.893727 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-a0afe97e-e393-4b68-8d73-11af3cf5d12e tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: 4d46fff2-b04d-41aa-ada0-2023ab545b48] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:30.911533 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a0afe97e-e393-4b68-8d73-11af3cf5d12e tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:30.913238 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a0afe97e-e393-4b68-8d73-11af3cf5d12e tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:30.915139 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a0afe97e-e393-4b68-8d73-11af3cf5d12e tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:30.917419 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a0afe97e-e393-4b68-8d73-11af3cf5d12e tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:30.919263 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a0afe97e-e393-4b68-8d73-11af3cf5d12e tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:30.921781 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a0afe97e-e393-4b68-8d73-11af3cf5d12e tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:30.960159 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-54c90043-143b-4064-8c55-299b0a0e3ddb tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc4171c0ee14ebb8b5eff5e910ccf49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003eb03a265a496d8981e45c74b014f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:30.975527 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-54c90043-143b-4064-8c55-299b0a0e3ddb tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] 10.222.0.33 "GET /compute/v2.1/servers/866d0dd3-3c7e-4612-a132-48eb83ec2d16" status: 200 len: 1371 microversion: 2.1 time: 0.384423 Oct 04 20:52:30.979779 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1964/3988] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:52:30 2022] GET /compute/v2.1/servers/866d0dd3-3c7e-4612-a132-48eb83ec2d16 => generated 1371 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:52:31.004860 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e4e15069-9baa-433e-bf1c-b7e5929cc31c tempest-SecurityGroupRulesNegativeTestJSON-1167498397 tempest-SecurityGroupRulesNegativeTestJSON-1167498397-project] Calling method '.version_select at 0x7f3c745355e0>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:31.320074 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-a0afe97e-e393-4b68-8d73-11af3cf5d12e tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac650232cc04810b1340dc2f0edadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b0670d1bd99424780a70e69d57a2166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:31.330247 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-a0afe97e-e393-4b68-8d73-11af3cf5d12e tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48" status: 200 len: 1669 microversion: 2.1 time: 0.448993 Oct 04 20:52:31.335483 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2025/3989] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:52:30 2022] GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48 => generated 1669 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:52:31.344081 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-969519ec-fff1-443f-8dea-4ef1ba590e30 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:31.347253 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-969519ec-fff1-443f-8dea-4ef1ba590e30 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] [instance: 30eb289d-d09c-43fa-af8a-3c6ee303f0af] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:31.365727 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-969519ec-fff1-443f-8dea-4ef1ba590e30 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:31.366496 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-969519ec-fff1-443f-8dea-4ef1ba590e30 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:31.367257 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-969519ec-fff1-443f-8dea-4ef1ba590e30 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:31.368155 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-969519ec-fff1-443f-8dea-4ef1ba590e30 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:31.370919 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-969519ec-fff1-443f-8dea-4ef1ba590e30 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:31.371955 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-969519ec-fff1-443f-8dea-4ef1ba590e30 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:31.767348 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-969519ec-fff1-443f-8dea-4ef1ba590e30 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c208ec9faf491385a9ab5b5932098d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ae4960393c464c97669731c2084d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:31.783760 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-969519ec-fff1-443f-8dea-4ef1ba590e30 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] 10.222.0.33 "GET /compute/v2.1/servers/30eb289d-d09c-43fa-af8a-3c6ee303f0af" status: 200 len: 1522 microversion: 2.1 time: 0.443665 Oct 04 20:52:31.784893 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2026/3990] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:52:31 2022] GET /compute/v2.1/servers/30eb289d-d09c-43fa-af8a-3c6ee303f0af => generated 1522 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:52:31.792974 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-8ac9b703-6e38-4eaf-855e-fa0ff7212a7f tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:31.799228 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-8ac9b703-6e38-4eaf-855e-fa0ff7212a7f tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: 4d46fff2-b04d-41aa-ada0-2023ab545b48] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:31.811376 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8ac9b703-6e38-4eaf-855e-fa0ff7212a7f tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:31.830616 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8ac9b703-6e38-4eaf-855e-fa0ff7212a7f tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:31.833776 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8ac9b703-6e38-4eaf-855e-fa0ff7212a7f tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:31.834930 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8ac9b703-6e38-4eaf-855e-fa0ff7212a7f tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:31.841269 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8ac9b703-6e38-4eaf-855e-fa0ff7212a7f tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:31.842147 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8ac9b703-6e38-4eaf-855e-fa0ff7212a7f tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:32.084425 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e4e15069-9baa-433e-bf1c-b7e5929cc31c tempest-SecurityGroupRulesNegativeTestJSON-1167498397 tempest-SecurityGroupRulesNegativeTestJSON-1167498397-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-group-rules/96673a95-ac6e-455f-97ca-b1cc519cfce3" status: 202 len: 0 microversion: 2.1 time: 1.097547 Oct 04 20:52:32.090591 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1965/3991] 10.222.0.33 () {58 vars in 1287 bytes} [Tue Oct 4 20:52:30 2022] DELETE /compute/v2.1/os-security-group-rules/96673a95-ac6e-455f-97ca-b1cc519cfce3 => generated 0 bytes in 1110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:52:32.103240 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e619bf27-8a84-4007-943b-1a82579287cf tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:32.104183 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e619bf27-8a84-4007-943b-1a82579287cf tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] [instance: 866d0dd3-3c7e-4612-a132-48eb83ec2d16] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:32.126322 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e619bf27-8a84-4007-943b-1a82579287cf tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:32.127090 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e619bf27-8a84-4007-943b-1a82579287cf tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:32.130058 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e619bf27-8a84-4007-943b-1a82579287cf tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:32.131821 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e619bf27-8a84-4007-943b-1a82579287cf tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:32.134150 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e619bf27-8a84-4007-943b-1a82579287cf tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:32.134815 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e619bf27-8a84-4007-943b-1a82579287cf tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:32.422524 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-8ac9b703-6e38-4eaf-855e-fa0ff7212a7f tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac650232cc04810b1340dc2f0edadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b0670d1bd99424780a70e69d57a2166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:32.430806 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-8ac9b703-6e38-4eaf-855e-fa0ff7212a7f tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48" status: 200 len: 1669 microversion: 2.1 time: 0.643784 Oct 04 20:52:32.433140 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2027/3992] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:52:31 2022] GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48 => generated 1669 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:52:32.449035 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-f23fff6f-f7c0-43e6-82e3-c4ec133f0d81 tempest-SecurityGroupRulesNegativeTestJSON-1167498397 tempest-SecurityGroupRulesNegativeTestJSON-1167498397-project] Action: 'create', calling method: .version_select at 0x7f3c6f632b80>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-483691123", "description": "tempest-description-1183662928"}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:52:32.509817 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e619bf27-8a84-4007-943b-1a82579287cf tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc4171c0ee14ebb8b5eff5e910ccf49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003eb03a265a496d8981e45c74b014f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:32.524353 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e619bf27-8a84-4007-943b-1a82579287cf tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] 10.222.0.33 "GET /compute/v2.1/servers/866d0dd3-3c7e-4612-a132-48eb83ec2d16" status: 200 len: 1371 microversion: 2.1 time: 0.430158 Oct 04 20:52:32.526054 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1966/3993] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:52:32 2022] GET /compute/v2.1/servers/866d0dd3-3c7e-4612-a132-48eb83ec2d16 => generated 1371 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:52:32.534388 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-999253f0-5aee-4f1d-993f-264851b1c868 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:52:32.535207 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-999253f0-5aee-4f1d-993f-264851b1c868 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: 4d46fff2-b04d-41aa-ada0-2023ab545b48] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:32.549275 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-999253f0-5aee-4f1d-993f-264851b1c868 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:32.550192 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-999253f0-5aee-4f1d-993f-264851b1c868 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:32.550911 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-999253f0-5aee-4f1d-993f-264851b1c868 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:32.551797 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-999253f0-5aee-4f1d-993f-264851b1c868 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:32.553247 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-999253f0-5aee-4f1d-993f-264851b1c868 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:32.554828 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-999253f0-5aee-4f1d-993f-264851b1c868 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:32.623852 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-999253f0-5aee-4f1d-993f-264851b1c868 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lazy-loading 'flavor' on Instance uuid 4d46fff2-b04d-41aa-ada0-2023ab545b48 {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:52:32.806377 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-f23fff6f-f7c0-43e6-82e3-c4ec133f0d81 tempest-SecurityGroupRulesNegativeTestJSON-1167498397 tempest-SecurityGroupRulesNegativeTestJSON-1167498397-project] 10.222.0.33 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.370085 Oct 04 20:52:32.807314 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2028/3994] 10.222.0.33 () {60 vars in 1180 bytes} [Tue Oct 4 20:52:32 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:52:32.813829 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-f5f4dd18-f8a7-4a16-8704-f36a789e77b4 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:32.816115 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-f5f4dd18-f8a7-4a16-8704-f36a789e77b4 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] [instance: 30eb289d-d09c-43fa-af8a-3c6ee303f0af] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:32.842326 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f5f4dd18-f8a7-4a16-8704-f36a789e77b4 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:32.845745 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f5f4dd18-f8a7-4a16-8704-f36a789e77b4 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:32.848584 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f5f4dd18-f8a7-4a16-8704-f36a789e77b4 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:32.849648 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f5f4dd18-f8a7-4a16-8704-f36a789e77b4 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:32.851350 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f5f4dd18-f8a7-4a16-8704-f36a789e77b4 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:32.855184 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f5f4dd18-f8a7-4a16-8704-f36a789e77b4 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:32.860800 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-999253f0-5aee-4f1d-993f-264851b1c868 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "POST /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48/action" status: 202 len: 0 microversion: 2.1 time: 0.333282 Oct 04 20:52:32.887570 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1967/3995] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 20:52:32 2022] POST /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48/action => generated 0 bytes in 360 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:52:32.905907 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b09b0494-a463-43d4-b68c-75c70464c942 tempest-SecurityGroupRulesNegativeTestJSON-1167498397 tempest-SecurityGroupRulesNegativeTestJSON-1167498397-project] Action: 'create', calling method: .version_select at 0x7f3c788ab0d0>, body: {"security_group_rule": {"parent_group_id": "956cba58-3cf2-4d1b-b95c-bf6d0bc172a4", "ip_protocol": "tcp", "from_port": 1061650556, "to_port": 22}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:52:33.346957 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-b09b0494-a463-43d4-b68c-75c70464c942 tempest-SecurityGroupRulesNegativeTestJSON-1167498397 tempest-SecurityGroupRulesNegativeTestJSON-1167498397-project] HTTP exception thrown: Invalid port range 1061650556:22. Former value cannot be greater than the later Oct 04 20:52:33.349081 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b09b0494-a463-43d4-b68c-75c70464c942 tempest-SecurityGroupRulesNegativeTestJSON-1167498397 tempest-SecurityGroupRulesNegativeTestJSON-1167498397-project] Request method failure captured: Oct 04 20:52:33.349081 n-d-854823-8 devstack@n-api.service[128801]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 04 20:52:33.349081 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:52:33.349081 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:52:33.349081 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:52:33.349081 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 146 Oct 04 20:52:33.349081 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:52:33.349081 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:52:33.349081 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:52:33.349081 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:52:33.349081 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJ0LcMfISyKByig7GM_j4o1hIV10bXRG2l7JkvcuoTfJxDJriqO6srj_S1eOB6sNCi15vy6TPRx1ePrmt5tT56lLETrgcSJ7IMtNYnHpFowEl-n7gGSz7JUSscSwPkc1W9yF0xq9xzy6ddwRIXvHqAUScNfdov8hFtte_udSWJyiGlY Oct 04 20:52:33.349081 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:52:33.349081 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:52:33.349081 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:52:33.349081 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:52:33.349081 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:52:33.349081 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:52:33.349081 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: fbf529844e0b41b79049d9c9dc8f627b Oct 04 20:52:33.349081 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1167498397 Oct 04 20:52:33.349081 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 20:52:33.349081 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 20:52:33.349081 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_fbf529844e0b41b79049d9c9dc8f627b", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fbf529844e0b41b79049d9c9dc8f627b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fbf529844e0b41b79049d9c9dc8f627b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/fbf529844e0b41b79049d9c9dc8f627b"}]}] Oct 04 20:52:33.349081 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1167498397 Oct 04 20:52:33.349081 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: fbf529844e0b41b79049d9c9dc8f627b Oct 04 20:52:33.349081 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1167498397 Oct 04 20:52:33.349081 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1167498397-project Oct 04 20:52:33.349081 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:52:33.349081 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:52:33.349081 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: d315a7741a32465496190ea1ddc886d6 Oct 04 20:52:33.349081 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1167498397-project Oct 04 20:52:33.349081 n-d-854823-8 devstack@n-api.service[128801]: Oct 04 20:52:33.349081 n-d-854823-8 devstack@n-api.service[128801]: {"security_group_rule": {"parent_group_id": "956cba58-3cf2-4d1b-b95c-bf6d0bc172a4", "ip_protocol": "tcp", "from_port": 1061650556, "to_port": 22}} Oct 04 20:52:33.349081 n-d-854823-8 devstack@n-api.service[128801]: method: Oct 04 20:52:33.349081 n-d-854823-8 devstack@n-api.service[128801]: exception: Invalid port range 1061650556:22. Former value cannot be greater than the later Oct 04 20:52:33.349081 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'body': {'security_group_rule': {'parent_group_id': '956cba58-3cf2-4d1b-b95c-bf6d0bc172a4', 'ip_protocol': 'tcp', 'from_port': 1061650556, 'to_port': 22}}} Oct 04 20:52:33.349081 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:52:33.349081 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:52:33.349081 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 04 20:52:33.349081 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 04 20:52:33.349081 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 04 20:52:33.349081 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 04 20:52:33.349081 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 04 20:52:33.349081 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 04 20:52:33.349081 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Oct 04 20:52:33.349081 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Oct 04 20:52:33.349081 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 1061650556:22. Former value cannot be greater than the later Oct 04 20:52:33.349081 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:52:33.349081 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:52:33.349081 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:52:33.349081 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:52:33.349081 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:52:33.349081 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:52:33.349081 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:52:33.349081 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:52:33.349081 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:52:33.349081 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:52:33.349081 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:52:33.349081 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:52:33.349081 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 04 20:52:33.349081 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 04 20:52:33.349081 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 1061650556:22. Former value cannot be greater than the later Oct 04 20:52:33.349081 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:52:33.353431 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:52:33.353431 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:52:33.353431 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:52:33.353431 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:52:33.353431 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:52:33.353431 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:52:33.353431 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:52:33.353431 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 1061650556:22. Former value cannot be greater than the later Oct 04 20:52:33.353431 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:52:33.353431 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b09b0494-a463-43d4-b68c-75c70464c942 tempest-SecurityGroupRulesNegativeTestJSON-1167498397 tempest-SecurityGroupRulesNegativeTestJSON-1167498397-project] Returning 400 to user: Invalid port range 1061650556:22. Former value cannot be greater than the later {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:52:33.353431 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b09b0494-a463-43d4-b68c-75c70464c942 tempest-SecurityGroupRulesNegativeTestJSON-1167498397 tempest-SecurityGroupRulesNegativeTestJSON-1167498397-project] 10.222.0.33 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 123 microversion: 2.1 time: 0.459419 Oct 04 20:52:33.356537 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1968/3996] 10.222.0.33 () {60 vars in 1195 bytes} [Tue Oct 4 20:52:32 2022] POST /compute/v2.1/os-security-group-rules => generated 123 bytes in 468 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 20:52:33.366283 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-989e43ce-2caf-4d60-8a31-ec8359098b79 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:33.366283 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-989e43ce-2caf-4d60-8a31-ec8359098b79 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: 4d46fff2-b04d-41aa-ada0-2023ab545b48] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:33.404878 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-989e43ce-2caf-4d60-8a31-ec8359098b79 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:33.414651 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-989e43ce-2caf-4d60-8a31-ec8359098b79 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:33.415471 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-989e43ce-2caf-4d60-8a31-ec8359098b79 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:33.419301 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-989e43ce-2caf-4d60-8a31-ec8359098b79 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:33.422409 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-989e43ce-2caf-4d60-8a31-ec8359098b79 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:33.434587 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-989e43ce-2caf-4d60-8a31-ec8359098b79 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:33.495405 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-f5f4dd18-f8a7-4a16-8704-f36a789e77b4 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c208ec9faf491385a9ab5b5932098d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ae4960393c464c97669731c2084d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:33.513057 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-f5f4dd18-f8a7-4a16-8704-f36a789e77b4 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] 10.222.0.33 "GET /compute/v2.1/servers/30eb289d-d09c-43fa-af8a-3c6ee303f0af" status: 200 len: 1522 microversion: 2.1 time: 0.704160 Oct 04 20:52:33.513914 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2029/3997] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:52:32 2022] GET /compute/v2.1/servers/30eb289d-d09c-43fa-af8a-3c6ee303f0af => generated 1522 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:52:33.553188 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-56d942fb-3b35-44b0-9d27-9a7801fd5e56 tempest-SecurityGroupRulesNegativeTestJSON-1167498397 tempest-SecurityGroupRulesNegativeTestJSON-1167498397-project] Action: 'create', calling method: .version_select at 0x7f3c6f632b80>, body: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-1282785351", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:52:33.563475 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.wsgi [None req-56d942fb-3b35-44b0-9d27-9a7801fd5e56 tempest-SecurityGroupRulesNegativeTestJSON-1167498397 tempest-SecurityGroupRulesNegativeTestJSON-1167498397-project] HTTP exception thrown: Security group id should be uuid Oct 04 20:52:33.573448 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-56d942fb-3b35-44b0-9d27-9a7801fd5e56 tempest-SecurityGroupRulesNegativeTestJSON-1167498397 tempest-SecurityGroupRulesNegativeTestJSON-1167498397-project] Request method failure captured: Oct 04 20:52:33.573448 n-d-854823-8 devstack@n-api.service[128802]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 04 20:52:33.573448 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 20:52:33.573448 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 20:52:33.573448 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 20:52:33.573448 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 131 Oct 04 20:52:33.573448 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 20:52:33.573448 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 20:52:33.573448 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 20:52:33.573448 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 20:52:33.573448 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPJ0LcMfISyKByig7GM_j4o1hIV10bXRG2l7JkvcuoTfJxDJriqO6srj_S1eOB6sNCi15vy6TPRx1ePrmt5tT56lLETrgcSJ7IMtNYnHpFowEl-n7gGSz7JUSscSwPkc1W9yF0xq9xzy6ddwRIXvHqAUScNfdov8hFtte_udSWJyiGlY Oct 04 20:52:33.573448 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 20:52:33.573448 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 20:52:33.573448 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 20:52:33.573448 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 20:52:33.573448 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 20:52:33.573448 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 20:52:33.573448 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: fbf529844e0b41b79049d9c9dc8f627b Oct 04 20:52:33.573448 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1167498397 Oct 04 20:52:33.573448 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 20:52:33.573448 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 20:52:33.573448 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_fbf529844e0b41b79049d9c9dc8f627b", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fbf529844e0b41b79049d9c9dc8f627b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fbf529844e0b41b79049d9c9dc8f627b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/fbf529844e0b41b79049d9c9dc8f627b"}]}] Oct 04 20:52:33.573448 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1167498397 Oct 04 20:52:33.573448 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: fbf529844e0b41b79049d9c9dc8f627b Oct 04 20:52:33.573448 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1167498397 Oct 04 20:52:33.573448 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1167498397-project Oct 04 20:52:33.573448 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 20:52:33.573448 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 20:52:33.573448 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: d315a7741a32465496190ea1ddc886d6 Oct 04 20:52:33.573448 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1167498397-project Oct 04 20:52:33.573448 n-d-854823-8 devstack@n-api.service[128802]: Oct 04 20:52:33.573448 n-d-854823-8 devstack@n-api.service[128802]: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-1282785351", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Oct 04 20:52:33.573448 n-d-854823-8 devstack@n-api.service[128802]: method: Oct 04 20:52:33.573448 n-d-854823-8 devstack@n-api.service[128802]: exception: Security group id should be uuid Oct 04 20:52:33.573448 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'tempest-non_int_id-1282785351', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Oct 04 20:52:33.573448 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:52:33.573448 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:52:33.573448 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 285, in create Oct 04 20:52:33.573448 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi parent_group_id = security_group_api.validate_id( Oct 04 20:52:33.573448 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 51, in validate_id Oct 04 20:52:33.573448 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Oct 04 20:52:33.573448 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security group id should be uuid Oct 04 20:52:33.573448 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:52:33.573448 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:52:33.573448 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:52:33.573448 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:52:33.573448 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:52:33.573448 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:52:33.573448 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:52:33.573448 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:52:33.573448 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:52:33.573448 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:52:33.573448 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:52:33.573448 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:52:33.573448 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 04 20:52:33.573448 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 04 20:52:33.573448 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security group id should be uuid Oct 04 20:52:33.573448 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:52:33.573448 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:52:33.573448 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:52:33.573448 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:52:33.573448 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:52:33.573448 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:52:33.573448 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:52:33.573448 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:52:33.577151 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group id should be uuid Oct 04 20:52:33.577151 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:52:33.584908 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-56d942fb-3b35-44b0-9d27-9a7801fd5e56 tempest-SecurityGroupRulesNegativeTestJSON-1167498397 tempest-SecurityGroupRulesNegativeTestJSON-1167498397-project] Returning 400 to user: Security group id should be uuid {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:52:33.589131 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-56d942fb-3b35-44b0-9d27-9a7801fd5e56 tempest-SecurityGroupRulesNegativeTestJSON-1167498397 tempest-SecurityGroupRulesNegativeTestJSON-1167498397-project] 10.222.0.33 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 76 microversion: 2.1 time: 0.049201 Oct 04 20:52:33.593497 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2030/3998] 10.222.0.33 () {60 vars in 1195 bytes} [Tue Oct 4 20:52:33 2022] POST /compute/v2.1/os-security-group-rules => generated 76 bytes in 79 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 04 20:52:33.611979 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-cdd16535-0012-4784-b7ea-be97ddab9f4c tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:33.612816 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-cdd16535-0012-4784-b7ea-be97ddab9f4c tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] [instance: 866d0dd3-3c7e-4612-a132-48eb83ec2d16] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:33.635806 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cdd16535-0012-4784-b7ea-be97ddab9f4c tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:33.636312 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cdd16535-0012-4784-b7ea-be97ddab9f4c tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:33.636812 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cdd16535-0012-4784-b7ea-be97ddab9f4c tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:33.639487 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cdd16535-0012-4784-b7ea-be97ddab9f4c tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:33.642287 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cdd16535-0012-4784-b7ea-be97ddab9f4c tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:33.643422 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cdd16535-0012-4784-b7ea-be97ddab9f4c tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:34.045147 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-989e43ce-2caf-4d60-8a31-ec8359098b79 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac650232cc04810b1340dc2f0edadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b0670d1bd99424780a70e69d57a2166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:34.076828 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-989e43ce-2caf-4d60-8a31-ec8359098b79 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48" status: 200 len: 1677 microversion: 2.1 time: 0.710961 Oct 04 20:52:34.078659 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1969/3999] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:52:33 2022] GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48 => generated 1677 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:52:34.094633 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f1478b28-791d-41dd-b9e1-65fb756500bf tempest-SecurityGroupRulesNegativeTestJSON-1167498397 tempest-SecurityGroupRulesNegativeTestJSON-1167498397-project] Action: 'create', calling method: .version_select at 0x7f3c788ab310>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1368624099", "description": "tempest-description-1866012084"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:52:34.332259 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-cdd16535-0012-4784-b7ea-be97ddab9f4c tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc4171c0ee14ebb8b5eff5e910ccf49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003eb03a265a496d8981e45c74b014f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:34.351195 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-cdd16535-0012-4784-b7ea-be97ddab9f4c tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] 10.222.0.33 "GET /compute/v2.1/servers/866d0dd3-3c7e-4612-a132-48eb83ec2d16" status: 200 len: 1371 microversion: 2.1 time: 0.752496 Oct 04 20:52:34.353167 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2031/4000] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:52:33 2022] GET /compute/v2.1/servers/866d0dd3-3c7e-4612-a132-48eb83ec2d16 => generated 1371 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:52:34.366020 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-a990f4b5-4027-407e-99af-151ba754f678 req-6e695194-9f44-4f0a-8e41-fb171fa655f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30eb289d-d09c-43fa-af8a-3c6ee303f0af", "name": "network-vif-plugged", "status": "completed", "tag": "7649f0f4-69ee-4996-bb52-e4994b8aadae"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:52:34.400632 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-a990f4b5-4027-407e-99af-151ba754f678 req-6e695194-9f44-4f0a-8e41-fb171fa655f8 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:34.409681 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-a990f4b5-4027-407e-99af-151ba754f678 req-6e695194-9f44-4f0a-8e41-fb171fa655f8 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:34.411436 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-a990f4b5-4027-407e-99af-151ba754f678 req-6e695194-9f44-4f0a-8e41-fb171fa655f8 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:34.457609 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-a990f4b5-4027-407e-99af-151ba754f678 req-6e695194-9f44-4f0a-8e41-fb171fa655f8 service nova] Creating event network-vif-plugged:7649f0f4-69ee-4996-bb52-e4994b8aadae for instance 30eb289d-d09c-43fa-af8a-3c6ee303f0af on n-h2-854823-8 Oct 04 20:52:34.476385 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-a990f4b5-4027-407e-99af-151ba754f678 req-6e695194-9f44-4f0a-8e41-fb171fa655f8 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119431 Oct 04 20:52:34.478903 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2032/4001] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:52:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:52:34.540476 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-cf7b1857-3c96-43d6-9638-2a54945e50dd tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:34.541283 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-cf7b1857-3c96-43d6-9638-2a54945e50dd tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] [instance: 30eb289d-d09c-43fa-af8a-3c6ee303f0af] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:34.570400 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cf7b1857-3c96-43d6-9638-2a54945e50dd tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:34.571352 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cf7b1857-3c96-43d6-9638-2a54945e50dd tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:34.573268 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cf7b1857-3c96-43d6-9638-2a54945e50dd tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:34.577227 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cf7b1857-3c96-43d6-9638-2a54945e50dd tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:34.579395 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cf7b1857-3c96-43d6-9638-2a54945e50dd tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:34.579911 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cf7b1857-3c96-43d6-9638-2a54945e50dd tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:34.648676 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:52:35.229579 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-cf7b1857-3c96-43d6-9638-2a54945e50dd tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c208ec9faf491385a9ab5b5932098d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ae4960393c464c97669731c2084d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:35.250398 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-cf7b1857-3c96-43d6-9638-2a54945e50dd tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] 10.222.0.33 "GET /compute/v2.1/servers/30eb289d-d09c-43fa-af8a-3c6ee303f0af" status: 200 len: 1522 microversion: 2.1 time: 0.715039 Oct 04 20:52:35.252859 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2033/4002] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:52:34 2022] GET /compute/v2.1/servers/30eb289d-d09c-43fa-af8a-3c6ee303f0af => generated 1522 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:52:35.264292 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f1478b28-791d-41dd-b9e1-65fb756500bf tempest-SecurityGroupRulesNegativeTestJSON-1167498397 tempest-SecurityGroupRulesNegativeTestJSON-1167498397-project] 10.222.0.33 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 1.184341 Oct 04 20:52:35.265376 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1970/4003] 10.222.0.33 () {60 vars in 1180 bytes} [Tue Oct 4 20:52:34 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 1186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:52:35.270044 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-051bb607-ac74-4c4d-82ae-2656201b5f5e tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:35.270960 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-051bb607-ac74-4c4d-82ae-2656201b5f5e tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: 4d46fff2-b04d-41aa-ada0-2023ab545b48] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:35.279762 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-017b7ce4-2d38-4dfc-b2a7-c57ee20b0c36 tempest-SecurityGroupRulesNegativeTestJSON-1167498397 tempest-SecurityGroupRulesNegativeTestJSON-1167498397-project] Action: 'create', calling method: .version_select at 0x7f3c6f3ebdc0>, body: {"security_group_rule": {"parent_group_id": "d51082d5-0c2c-433c-8e24-30500010192a", "ip_protocol": "tempest-999-1956958345", "from_port": 22, "to_port": 22}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:52:35.307119 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-051bb607-ac74-4c4d-82ae-2656201b5f5e tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:35.308223 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-051bb607-ac74-4c4d-82ae-2656201b5f5e tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:35.309588 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-051bb607-ac74-4c4d-82ae-2656201b5f5e tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:35.311852 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-051bb607-ac74-4c4d-82ae-2656201b5f5e tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:35.313041 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-051bb607-ac74-4c4d-82ae-2656201b5f5e tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:35.316560 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-051bb607-ac74-4c4d-82ae-2656201b5f5e tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:35.419254 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-017b7ce4-2d38-4dfc-b2a7-c57ee20b0c36 tempest-SecurityGroupRulesNegativeTestJSON-1167498397 tempest-SecurityGroupRulesNegativeTestJSON-1167498397-project] HTTP exception thrown: Invalid IP protocol tempest-999-1956958345. Oct 04 20:52:35.421781 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-017b7ce4-2d38-4dfc-b2a7-c57ee20b0c36 tempest-SecurityGroupRulesNegativeTestJSON-1167498397 tempest-SecurityGroupRulesNegativeTestJSON-1167498397-project] Request method failure captured: Oct 04 20:52:35.421781 n-d-854823-8 devstack@n-api.service[128801]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 04 20:52:35.421781 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:52:35.421781 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:52:35.421781 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:52:35.421781 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 157 Oct 04 20:52:35.421781 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:52:35.421781 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:52:35.421781 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:52:35.421781 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:52:35.421781 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJ0LcMfISyKByig7GM_j4o1hIV10bXRG2l7JkvcuoTfJxDJriqO6srj_S1eOB6sNCi15vy6TPRx1ePrmt5tT56lLETrgcSJ7IMtNYnHpFowEl-n7gGSz7JUSscSwPkc1W9yF0xq9xzy6ddwRIXvHqAUScNfdov8hFtte_udSWJyiGlY Oct 04 20:52:35.421781 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:52:35.421781 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:52:35.421781 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:52:35.421781 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:52:35.421781 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:52:35.421781 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:52:35.421781 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: fbf529844e0b41b79049d9c9dc8f627b Oct 04 20:52:35.421781 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1167498397 Oct 04 20:52:35.421781 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 20:52:35.421781 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 20:52:35.421781 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_fbf529844e0b41b79049d9c9dc8f627b", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fbf529844e0b41b79049d9c9dc8f627b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fbf529844e0b41b79049d9c9dc8f627b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/fbf529844e0b41b79049d9c9dc8f627b"}]}] Oct 04 20:52:35.421781 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1167498397 Oct 04 20:52:35.421781 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: fbf529844e0b41b79049d9c9dc8f627b Oct 04 20:52:35.421781 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1167498397 Oct 04 20:52:35.421781 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1167498397-project Oct 04 20:52:35.421781 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:52:35.421781 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:52:35.421781 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: d315a7741a32465496190ea1ddc886d6 Oct 04 20:52:35.421781 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1167498397-project Oct 04 20:52:35.421781 n-d-854823-8 devstack@n-api.service[128801]: Oct 04 20:52:35.421781 n-d-854823-8 devstack@n-api.service[128801]: {"security_group_rule": {"parent_group_id": "d51082d5-0c2c-433c-8e24-30500010192a", "ip_protocol": "tempest-999-1956958345", "from_port": 22, "to_port": 22}} Oct 04 20:52:35.421781 n-d-854823-8 devstack@n-api.service[128801]: method: Oct 04 20:52:35.421781 n-d-854823-8 devstack@n-api.service[128801]: exception: Invalid IP protocol tempest-999-1956958345. Oct 04 20:52:35.421781 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'd51082d5-0c2c-433c-8e24-30500010192a', 'ip_protocol': 'tempest-999-1956958345', 'from_port': 22, 'to_port': 22}}} Oct 04 20:52:35.421781 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:52:35.421781 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:52:35.421781 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 04 20:52:35.421781 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 04 20:52:35.421781 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 04 20:52:35.421781 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 04 20:52:35.421781 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 04 20:52:35.421781 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 04 20:52:35.421781 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 144, in _new_ingress_rule Oct 04 20:52:35.421781 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InvalidIpProtocol(protocol=ip_protocol) Oct 04 20:52:35.421781 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InvalidIpProtocol: Invalid IP protocol tempest-999-1956958345. Oct 04 20:52:35.421781 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:52:35.421781 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:52:35.421781 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:52:35.421781 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:52:35.421781 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:52:35.421781 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:52:35.421781 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:52:35.421781 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:52:35.421781 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:52:35.421781 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:52:35.421781 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:52:35.421781 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:52:35.421781 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 04 20:52:35.421781 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 04 20:52:35.421781 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid IP protocol tempest-999-1956958345. Oct 04 20:52:35.421781 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:52:35.421781 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:52:35.425243 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:52:35.425243 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:52:35.425243 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:52:35.425243 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:52:35.425243 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:52:35.425243 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:52:35.425243 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid IP protocol tempest-999-1956958345. Oct 04 20:52:35.425243 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:52:35.425243 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-017b7ce4-2d38-4dfc-b2a7-c57ee20b0c36 tempest-SecurityGroupRulesNegativeTestJSON-1167498397 tempest-SecurityGroupRulesNegativeTestJSON-1167498397-project] Returning 400 to user: Invalid IP protocol tempest-999-1956958345. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:52:35.425243 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-017b7ce4-2d38-4dfc-b2a7-c57ee20b0c36 tempest-SecurityGroupRulesNegativeTestJSON-1167498397 tempest-SecurityGroupRulesNegativeTestJSON-1167498397-project] 10.222.0.33 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 87 microversion: 2.1 time: 0.148348 Oct 04 20:52:35.425243 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1971/4004] 10.222.0.33 () {60 vars in 1195 bytes} [Tue Oct 4 20:52:35 2022] POST /compute/v2.1/os-security-group-rules => generated 87 bytes in 150 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Oct 04 20:52:35.438459 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5f1175e8-1a06-4304-be15-6d8dc863df47 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:35.439401 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-5f1175e8-1a06-4304-be15-6d8dc863df47 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] [instance: 866d0dd3-3c7e-4612-a132-48eb83ec2d16] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:35.453263 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5f1175e8-1a06-4304-be15-6d8dc863df47 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:35.455133 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5f1175e8-1a06-4304-be15-6d8dc863df47 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:35.455699 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5f1175e8-1a06-4304-be15-6d8dc863df47 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:35.456540 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5f1175e8-1a06-4304-be15-6d8dc863df47 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:35.461612 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5f1175e8-1a06-4304-be15-6d8dc863df47 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:35.464193 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5f1175e8-1a06-4304-be15-6d8dc863df47 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:35.825970 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-5f1175e8-1a06-4304-be15-6d8dc863df47 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc4171c0ee14ebb8b5eff5e910ccf49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003eb03a265a496d8981e45c74b014f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:35.840421 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5f1175e8-1a06-4304-be15-6d8dc863df47 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] 10.222.0.33 "GET /compute/v2.1/servers/866d0dd3-3c7e-4612-a132-48eb83ec2d16" status: 200 len: 1371 microversion: 2.1 time: 0.415011 Oct 04 20:52:35.844881 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1972/4005] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:52:35 2022] GET /compute/v2.1/servers/866d0dd3-3c7e-4612-a132-48eb83ec2d16 => generated 1371 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:52:35.853343 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6a9f39f8-4d55-4d3f-989d-aae4236261e5 tempest-SecurityGroupRulesNegativeTestJSON-1167498397 tempest-SecurityGroupRulesNegativeTestJSON-1167498397-project] Action: 'create', calling method: .version_select at 0x7f3c6fa3e3a0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1923187431", "description": "tempest-description-306426870"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:52:36.228468 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-6a9f39f8-4d55-4d3f-989d-aae4236261e5 tempest-SecurityGroupRulesNegativeTestJSON-1167498397 tempest-SecurityGroupRulesNegativeTestJSON-1167498397-project] 10.222.0.33 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.381896 Oct 04 20:52:36.229139 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1973/4006] 10.222.0.33 () {60 vars in 1180 bytes} [Tue Oct 4 20:52:35 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:52:36.243715 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-eddf997d-e87a-4536-be1c-605ae108e0bb tempest-SecurityGroupRulesNegativeTestJSON-1167498397 tempest-SecurityGroupRulesNegativeTestJSON-1167498397-project] Action: 'create', calling method: .version_select at 0x7f3c6f3e2670>, body: {"security_group_rule": {"parent_group_id": "da9e14c1-e997-4dd9-bbd7-affc8613faa9", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:52:36.353548 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-eddf997d-e87a-4536-be1c-605ae108e0bb tempest-SecurityGroupRulesNegativeTestJSON-1167498397 tempest-SecurityGroupRulesNegativeTestJSON-1167498397-project] HTTP exception thrown: Invalid port range 22:21. Former value cannot be greater than the later Oct 04 20:52:36.357074 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-eddf997d-e87a-4536-be1c-605ae108e0bb tempest-SecurityGroupRulesNegativeTestJSON-1167498397 tempest-SecurityGroupRulesNegativeTestJSON-1167498397-project] Request method failure captured: Oct 04 20:52:36.357074 n-d-854823-8 devstack@n-api.service[128801]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 04 20:52:36.357074 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:52:36.357074 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:52:36.357074 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:52:36.357074 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 138 Oct 04 20:52:36.357074 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:52:36.357074 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:52:36.357074 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:52:36.357074 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:52:36.357074 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJ0LcMfISyKByig7GM_j4o1hIV10bXRG2l7JkvcuoTfJxDJriqO6srj_S1eOB6sNCi15vy6TPRx1ePrmt5tT56lLETrgcSJ7IMtNYnHpFowEl-n7gGSz7JUSscSwPkc1W9yF0xq9xzy6ddwRIXvHqAUScNfdov8hFtte_udSWJyiGlY Oct 04 20:52:36.357074 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:52:36.357074 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:52:36.357074 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:52:36.357074 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:52:36.357074 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:52:36.357074 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:52:36.357074 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: fbf529844e0b41b79049d9c9dc8f627b Oct 04 20:52:36.357074 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1167498397 Oct 04 20:52:36.357074 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 20:52:36.357074 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 20:52:36.357074 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_fbf529844e0b41b79049d9c9dc8f627b", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fbf529844e0b41b79049d9c9dc8f627b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fbf529844e0b41b79049d9c9dc8f627b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/fbf529844e0b41b79049d9c9dc8f627b"}]}] Oct 04 20:52:36.357074 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1167498397 Oct 04 20:52:36.357074 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: fbf529844e0b41b79049d9c9dc8f627b Oct 04 20:52:36.357074 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1167498397 Oct 04 20:52:36.357074 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1167498397-project Oct 04 20:52:36.357074 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:52:36.357074 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:52:36.357074 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: d315a7741a32465496190ea1ddc886d6 Oct 04 20:52:36.357074 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1167498397-project Oct 04 20:52:36.357074 n-d-854823-8 devstack@n-api.service[128801]: Oct 04 20:52:36.357074 n-d-854823-8 devstack@n-api.service[128801]: {"security_group_rule": {"parent_group_id": "da9e14c1-e997-4dd9-bbd7-affc8613faa9", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} Oct 04 20:52:36.357074 n-d-854823-8 devstack@n-api.service[128801]: method: Oct 04 20:52:36.357074 n-d-854823-8 devstack@n-api.service[128801]: exception: Invalid port range 22:21. Former value cannot be greater than the later Oct 04 20:52:36.357074 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'da9e14c1-e997-4dd9-bbd7-affc8613faa9', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 21}}} Oct 04 20:52:36.357074 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:52:36.357074 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:52:36.357074 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 04 20:52:36.357074 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 04 20:52:36.357074 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 04 20:52:36.357074 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 04 20:52:36.357074 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 04 20:52:36.357074 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 04 20:52:36.357074 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Oct 04 20:52:36.357074 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Oct 04 20:52:36.357074 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:21. Former value cannot be greater than the later Oct 04 20:52:36.357074 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:52:36.357074 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:52:36.357074 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:52:36.357074 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:52:36.357074 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:52:36.357074 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:52:36.357074 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:52:36.357074 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:52:36.357074 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:52:36.357074 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:52:36.357074 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:52:36.357074 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:52:36.357074 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 04 20:52:36.357074 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 04 20:52:36.357074 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:21. Former value cannot be greater than the later Oct 04 20:52:36.357074 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:52:36.361313 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:52:36.361313 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:52:36.361313 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:52:36.361313 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:52:36.361313 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:52:36.361313 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:52:36.361313 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:52:36.361313 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:21. Former value cannot be greater than the later Oct 04 20:52:36.361313 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:52:36.365109 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-eddf997d-e87a-4536-be1c-605ae108e0bb tempest-SecurityGroupRulesNegativeTestJSON-1167498397 tempest-SecurityGroupRulesNegativeTestJSON-1167498397-project] Returning 400 to user: Invalid port range 22:21. Former value cannot be greater than the later {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:52:36.366440 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-eddf997d-e87a-4536-be1c-605ae108e0bb tempest-SecurityGroupRulesNegativeTestJSON-1167498397 tempest-SecurityGroupRulesNegativeTestJSON-1167498397-project] 10.222.0.33 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 115 microversion: 2.1 time: 0.126932 Oct 04 20:52:36.367663 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1974/4007] 10.222.0.33 () {60 vars in 1195 bytes} [Tue Oct 4 20:52:36 2022] POST /compute/v2.1/os-security-group-rules => generated 115 bytes in 129 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 04 20:52:36.380781 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0e05ba63-95b3-4160-adc2-b499ddf538d8 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:36.382060 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-0e05ba63-95b3-4160-adc2-b499ddf538d8 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] [instance: 30eb289d-d09c-43fa-af8a-3c6ee303f0af] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:36.417810 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0e05ba63-95b3-4160-adc2-b499ddf538d8 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:36.420170 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0e05ba63-95b3-4160-adc2-b499ddf538d8 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:36.422249 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0e05ba63-95b3-4160-adc2-b499ddf538d8 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:36.424827 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0e05ba63-95b3-4160-adc2-b499ddf538d8 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:36.426533 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0e05ba63-95b3-4160-adc2-b499ddf538d8 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:36.427299 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0e05ba63-95b3-4160-adc2-b499ddf538d8 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:36.601810 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-051bb607-ac74-4c4d-82ae-2656201b5f5e tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac650232cc04810b1340dc2f0edadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b0670d1bd99424780a70e69d57a2166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:36.618332 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-051bb607-ac74-4c4d-82ae-2656201b5f5e tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48" status: 200 len: 1660 microversion: 2.1 time: 1.363670 Oct 04 20:52:36.619171 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2034/4008] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:52:35 2022] GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48 => generated 1660 bytes in 1366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:52:36.636421 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-f2a71e64-0822-48ea-8867-331e9f09a850 tempest-SecurityGroupRulesNegativeTestJSON-1167498397 tempest-SecurityGroupRulesNegativeTestJSON-1167498397-project] Action: 'create', calling method: .version_select at 0x7f3c6f5c3ee0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1929016717", "description": "tempest-description-73336728"}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:52:36.680806 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-0e05ba63-95b3-4160-adc2-b499ddf538d8 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c208ec9faf491385a9ab5b5932098d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ae4960393c464c97669731c2084d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:36.710692 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-0e05ba63-95b3-4160-adc2-b499ddf538d8 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] 10.222.0.33 "GET /compute/v2.1/servers/30eb289d-d09c-43fa-af8a-3c6ee303f0af" status: 200 len: 1522 microversion: 2.1 time: 0.341703 Oct 04 20:52:36.711296 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1975/4009] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:52:36 2022] GET /compute/v2.1/servers/30eb289d-d09c-43fa-af8a-3c6ee303f0af => generated 1522 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:52:36.723431 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-dac947fe-a849-423b-9ffb-cca1c0662269 req-4e5cda69-576e-47de-9855-16c59909c1d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "866d0dd3-3c7e-4612-a132-48eb83ec2d16", "name": "network-vif-plugged", "status": "completed", "tag": "0544b7b3-d2c3-439a-b134-c025dc0ed7a6"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:52:36.754052 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-dac947fe-a849-423b-9ffb-cca1c0662269 req-4e5cda69-576e-47de-9855-16c59909c1d4 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:36.754617 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-dac947fe-a849-423b-9ffb-cca1c0662269 req-4e5cda69-576e-47de-9855-16c59909c1d4 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:36.755080 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-dac947fe-a849-423b-9ffb-cca1c0662269 req-4e5cda69-576e-47de-9855-16c59909c1d4 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:36.775759 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-dac947fe-a849-423b-9ffb-cca1c0662269 req-4e5cda69-576e-47de-9855-16c59909c1d4 service nova] Creating event network-vif-plugged:0544b7b3-d2c3-439a-b134-c025dc0ed7a6 for instance 866d0dd3-3c7e-4612-a132-48eb83ec2d16 on n-h2-854823-8 Oct 04 20:52:36.802433 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-dac947fe-a849-423b-9ffb-cca1c0662269 req-4e5cda69-576e-47de-9855-16c59909c1d4 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085428 Oct 04 20:52:36.804668 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1976/4010] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:52:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:52:36.819828 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0050dd7d-f1a6-4fdb-a8e7-e80b0b6acdd4 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:52:36.822182 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-0050dd7d-f1a6-4fdb-a8e7-e80b0b6acdd4 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: 4d46fff2-b04d-41aa-ada0-2023ab545b48] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:36.838488 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0050dd7d-f1a6-4fdb-a8e7-e80b0b6acdd4 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:36.842124 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0050dd7d-f1a6-4fdb-a8e7-e80b0b6acdd4 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:36.843415 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0050dd7d-f1a6-4fdb-a8e7-e80b0b6acdd4 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:36.846193 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0050dd7d-f1a6-4fdb-a8e7-e80b0b6acdd4 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:36.848532 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0050dd7d-f1a6-4fdb-a8e7-e80b0b6acdd4 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:36.851358 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0050dd7d-f1a6-4fdb-a8e7-e80b0b6acdd4 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:37.021104 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-0050dd7d-f1a6-4fdb-a8e7-e80b0b6acdd4 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "POST /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48/action" status: 202 len: 0 microversion: 2.1 time: 0.213573 Oct 04 20:52:37.026740 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1977/4011] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 20:52:36 2022] POST /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48/action => generated 0 bytes in 221 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:52:37.040809 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e0524bac-ad0d-4d16-a52d-e9dd11b26f2d tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:37.041538 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e0524bac-ad0d-4d16-a52d-e9dd11b26f2d tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] [instance: 866d0dd3-3c7e-4612-a132-48eb83ec2d16] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:37.056424 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e0524bac-ad0d-4d16-a52d-e9dd11b26f2d tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:37.056908 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e0524bac-ad0d-4d16-a52d-e9dd11b26f2d tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:37.062782 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e0524bac-ad0d-4d16-a52d-e9dd11b26f2d tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:37.063989 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e0524bac-ad0d-4d16-a52d-e9dd11b26f2d tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:37.065848 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e0524bac-ad0d-4d16-a52d-e9dd11b26f2d tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:37.065848 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e0524bac-ad0d-4d16-a52d-e9dd11b26f2d tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:37.160580 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-f2a71e64-0822-48ea-8867-331e9f09a850 tempest-SecurityGroupRulesNegativeTestJSON-1167498397 tempest-SecurityGroupRulesNegativeTestJSON-1167498397-project] 10.222.0.33 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 0.539529 Oct 04 20:52:37.162396 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2035/4012] 10.222.0.33 () {60 vars in 1180 bytes} [Tue Oct 4 20:52:36 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:52:37.167829 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-ad1a2a98-7ca0-492a-8e71-51a5bc18886e tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:37.170097 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-ad1a2a98-7ca0-492a-8e71-51a5bc18886e tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: 4d46fff2-b04d-41aa-ada0-2023ab545b48] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:37.193485 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ad1a2a98-7ca0-492a-8e71-51a5bc18886e tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:37.194619 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ad1a2a98-7ca0-492a-8e71-51a5bc18886e tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:37.195354 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ad1a2a98-7ca0-492a-8e71-51a5bc18886e tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:37.208625 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ad1a2a98-7ca0-492a-8e71-51a5bc18886e tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:37.209461 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ad1a2a98-7ca0-492a-8e71-51a5bc18886e tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:37.210642 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ad1a2a98-7ca0-492a-8e71-51a5bc18886e tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:37.678290 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e0524bac-ad0d-4d16-a52d-e9dd11b26f2d tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc4171c0ee14ebb8b5eff5e910ccf49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003eb03a265a496d8981e45c74b014f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:37.690895 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e0524bac-ad0d-4d16-a52d-e9dd11b26f2d tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] 10.222.0.33 "GET /compute/v2.1/servers/866d0dd3-3c7e-4612-a132-48eb83ec2d16" status: 200 len: 1371 microversion: 2.1 time: 0.662091 Oct 04 20:52:37.695697 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1978/4013] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:52:37 2022] GET /compute/v2.1/servers/866d0dd3-3c7e-4612-a132-48eb83ec2d16 => generated 1371 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:52:37.705172 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-108ff02b-bde3-4d3c-aa5f-b15bd18a251d tempest-SecurityGroupRulesNegativeTestJSON-1167498397 tempest-SecurityGroupRulesNegativeTestJSON-1167498397-project] Action: 'create', calling method: .version_select at 0x7f3c6f3e2b80>, body: {"security_group_rule": {"parent_group_id": "3a595765-b447-44b4-b759-3165aa0c443e", "ip_protocol": "tcp", "from_port": 22, "to_port": 436971471}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:52:37.818599 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-ad1a2a98-7ca0-492a-8e71-51a5bc18886e tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac650232cc04810b1340dc2f0edadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b0670d1bd99424780a70e69d57a2166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:37.830312 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-ad1a2a98-7ca0-492a-8e71-51a5bc18886e tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48" status: 200 len: 1666 microversion: 2.1 time: 0.666624 Oct 04 20:52:37.839414 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2036/4014] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:52:37 2022] GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48 => generated 1666 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:52:37.844680 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-6863e8c4-fbaa-4f5d-aa70-96dfab2bcb2a tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:37.845473 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-6863e8c4-fbaa-4f5d-aa70-96dfab2bcb2a tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] [instance: 30eb289d-d09c-43fa-af8a-3c6ee303f0af] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:37.869586 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6863e8c4-fbaa-4f5d-aa70-96dfab2bcb2a tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:37.870180 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6863e8c4-fbaa-4f5d-aa70-96dfab2bcb2a tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:37.870661 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6863e8c4-fbaa-4f5d-aa70-96dfab2bcb2a tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:37.872068 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6863e8c4-fbaa-4f5d-aa70-96dfab2bcb2a tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:37.872518 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6863e8c4-fbaa-4f5d-aa70-96dfab2bcb2a tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:37.873128 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6863e8c4-fbaa-4f5d-aa70-96dfab2bcb2a tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:37.937976 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-108ff02b-bde3-4d3c-aa5f-b15bd18a251d tempest-SecurityGroupRulesNegativeTestJSON-1167498397 tempest-SecurityGroupRulesNegativeTestJSON-1167498397-project] HTTP exception thrown: Invalid port range 22:436971471. Valid TCP ports should be between 1-65535 Oct 04 20:52:37.939922 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-108ff02b-bde3-4d3c-aa5f-b15bd18a251d tempest-SecurityGroupRulesNegativeTestJSON-1167498397 tempest-SecurityGroupRulesNegativeTestJSON-1167498397-project] Request method failure captured: Oct 04 20:52:37.939922 n-d-854823-8 devstack@n-api.service[128801]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 04 20:52:37.939922 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:52:37.939922 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:52:37.939922 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:52:37.939922 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 145 Oct 04 20:52:37.939922 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:52:37.939922 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:52:37.939922 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:52:37.939922 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:52:37.939922 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJ0LcMfISyKByig7GM_j4o1hIV10bXRG2l7JkvcuoTfJxDJriqO6srj_S1eOB6sNCi15vy6TPRx1ePrmt5tT56lLETrgcSJ7IMtNYnHpFowEl-n7gGSz7JUSscSwPkc1W9yF0xq9xzy6ddwRIXvHqAUScNfdov8hFtte_udSWJyiGlY Oct 04 20:52:37.939922 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:52:37.939922 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:52:37.939922 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:52:37.939922 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:52:37.939922 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:52:37.939922 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:52:37.939922 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: fbf529844e0b41b79049d9c9dc8f627b Oct 04 20:52:37.939922 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1167498397 Oct 04 20:52:37.939922 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 20:52:37.939922 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 20:52:37.939922 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_fbf529844e0b41b79049d9c9dc8f627b", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fbf529844e0b41b79049d9c9dc8f627b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fbf529844e0b41b79049d9c9dc8f627b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/fbf529844e0b41b79049d9c9dc8f627b"}]}] Oct 04 20:52:37.939922 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1167498397 Oct 04 20:52:37.939922 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: fbf529844e0b41b79049d9c9dc8f627b Oct 04 20:52:37.939922 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1167498397 Oct 04 20:52:37.939922 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1167498397-project Oct 04 20:52:37.939922 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:52:37.939922 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:52:37.939922 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: d315a7741a32465496190ea1ddc886d6 Oct 04 20:52:37.939922 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1167498397-project Oct 04 20:52:37.939922 n-d-854823-8 devstack@n-api.service[128801]: Oct 04 20:52:37.939922 n-d-854823-8 devstack@n-api.service[128801]: {"security_group_rule": {"parent_group_id": "3a595765-b447-44b4-b759-3165aa0c443e", "ip_protocol": "tcp", "from_port": 22, "to_port": 436971471}} Oct 04 20:52:37.939922 n-d-854823-8 devstack@n-api.service[128801]: method: Oct 04 20:52:37.939922 n-d-854823-8 devstack@n-api.service[128801]: exception: Invalid port range 22:436971471. Valid TCP ports should be between 1-65535 Oct 04 20:52:37.939922 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'body': {'security_group_rule': {'parent_group_id': '3a595765-b447-44b4-b759-3165aa0c443e', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 436971471}}} Oct 04 20:52:37.939922 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:52:37.939922 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:52:37.939922 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 04 20:52:37.939922 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 04 20:52:37.939922 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 04 20:52:37.939922 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 04 20:52:37.939922 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 04 20:52:37.939922 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 04 20:52:37.939922 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 157, in _new_ingress_rule Oct 04 20:52:37.939922 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Oct 04 20:52:37.939922 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:436971471. Valid TCP ports should be between 1-65535 Oct 04 20:52:37.939922 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:52:37.939922 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:52:37.939922 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:52:37.939922 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:52:37.939922 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:52:37.939922 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:52:37.939922 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:52:37.939922 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:52:37.939922 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:52:37.939922 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:52:37.939922 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:52:37.939922 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:52:37.939922 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 04 20:52:37.939922 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 04 20:52:37.939922 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:436971471. Valid TCP ports should be between 1-65535 Oct 04 20:52:37.939922 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:52:37.943714 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:52:37.943714 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:52:37.943714 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:52:37.943714 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:52:37.943714 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:52:37.943714 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:52:37.943714 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:52:37.943714 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:436971471. Valid TCP ports should be between 1-65535 Oct 04 20:52:37.943714 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:52:37.945390 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-108ff02b-bde3-4d3c-aa5f-b15bd18a251d tempest-SecurityGroupRulesNegativeTestJSON-1167498397 tempest-SecurityGroupRulesNegativeTestJSON-1167498397-project] Returning 400 to user: Invalid port range 22:436971471. Valid TCP ports should be between 1-65535 {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:52:37.946509 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-108ff02b-bde3-4d3c-aa5f-b15bd18a251d tempest-SecurityGroupRulesNegativeTestJSON-1167498397 tempest-SecurityGroupRulesNegativeTestJSON-1167498397-project] 10.222.0.33 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 118 microversion: 2.1 time: 0.249571 Oct 04 20:52:37.947273 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1979/4015] 10.222.0.33 () {60 vars in 1195 bytes} [Tue Oct 4 20:52:37 2022] POST /compute/v2.1/os-security-group-rules => generated 118 bytes in 251 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 20:52:37.958155 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-4d6e6c89-7999-4478-b4ae-3a5db656c55d tempest-SecurityGroupRulesNegativeTestJSON-1167498397 tempest-SecurityGroupRulesNegativeTestJSON-1167498397-project] Action: 'create', calling method: .version_select at 0x7f3c6fa4d040>, body: {"security_group_rule": {"parent_group_id": "5df9cec7-1283-45e2-8682-a7bc213f47a6", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:52:38.001335 n-d-854823-8 devstack@n-api.service[128801]: DEBUG neutronclient.v2_0.client [None req-4d6e6c89-7999-4478-b4ae-3a5db656c55d tempest-SecurityGroupRulesNegativeTestJSON-1167498397 tempest-SecurityGroupRulesNegativeTestJSON-1167498397-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 5df9cec7-1283-45e2-8682-a7bc213f47a6 does not exist", "detail": ""}} {{(pid=128801) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 20:52:38.002456 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.network.security_group_api [None req-4d6e6c89-7999-4478-b4ae-3a5db656c55d tempest-SecurityGroupRulesNegativeTestJSON-1167498397 tempest-SecurityGroupRulesNegativeTestJSON-1167498397-project] Neutron security group 5df9cec7-1283-45e2-8682-a7bc213f47a6 not found {{(pid=128801) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 04 20:52:38.003563 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-4d6e6c89-7999-4478-b4ae-3a5db656c55d tempest-SecurityGroupRulesNegativeTestJSON-1167498397 tempest-SecurityGroupRulesNegativeTestJSON-1167498397-project] HTTP exception thrown: Security group 5df9cec7-1283-45e2-8682-a7bc213f47a6 does not exist Oct 04 20:52:38.003563 n-d-854823-8 devstack@n-api.service[128801]: Neutron server returns request_ids: ['req-59177b84-c80a-4da1-b40b-a0ab53a4e908'] Oct 04 20:52:38.007217 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-4d6e6c89-7999-4478-b4ae-3a5db656c55d tempest-SecurityGroupRulesNegativeTestJSON-1167498397 tempest-SecurityGroupRulesNegativeTestJSON-1167498397-project] Request method failure captured: Oct 04 20:52:38.007217 n-d-854823-8 devstack@n-api.service[128801]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 04 20:52:38.007217 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:52:38.007217 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:52:38.007217 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:52:38.007217 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 138 Oct 04 20:52:38.007217 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:52:38.007217 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:52:38.007217 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:52:38.007217 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:52:38.007217 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJ0LcMfISyKByig7GM_j4o1hIV10bXRG2l7JkvcuoTfJxDJriqO6srj_S1eOB6sNCi15vy6TPRx1ePrmt5tT56lLETrgcSJ7IMtNYnHpFowEl-n7gGSz7JUSscSwPkc1W9yF0xq9xzy6ddwRIXvHqAUScNfdov8hFtte_udSWJyiGlY Oct 04 20:52:38.007217 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:52:38.007217 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:52:38.007217 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:52:38.007217 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:52:38.007217 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:52:38.007217 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:52:38.007217 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: fbf529844e0b41b79049d9c9dc8f627b Oct 04 20:52:38.007217 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1167498397 Oct 04 20:52:38.007217 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 20:52:38.007217 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 20:52:38.007217 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_fbf529844e0b41b79049d9c9dc8f627b", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fbf529844e0b41b79049d9c9dc8f627b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fbf529844e0b41b79049d9c9dc8f627b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/fbf529844e0b41b79049d9c9dc8f627b"}]}] Oct 04 20:52:38.007217 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1167498397 Oct 04 20:52:38.007217 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: fbf529844e0b41b79049d9c9dc8f627b Oct 04 20:52:38.007217 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1167498397 Oct 04 20:52:38.007217 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1167498397-project Oct 04 20:52:38.007217 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:52:38.007217 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:52:38.007217 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: d315a7741a32465496190ea1ddc886d6 Oct 04 20:52:38.007217 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1167498397-project Oct 04 20:52:38.007217 n-d-854823-8 devstack@n-api.service[128801]: Oct 04 20:52:38.007217 n-d-854823-8 devstack@n-api.service[128801]: {"security_group_rule": {"parent_group_id": "5df9cec7-1283-45e2-8682-a7bc213f47a6", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Oct 04 20:52:38.007217 n-d-854823-8 devstack@n-api.service[128801]: method: Oct 04 20:52:38.007217 n-d-854823-8 devstack@n-api.service[128801]: exception: Security group 5df9cec7-1283-45e2-8682-a7bc213f47a6 does not exist Oct 04 20:52:38.007217 n-d-854823-8 devstack@n-api.service[128801]: Neutron server returns request_ids: ['req-59177b84-c80a-4da1-b40b-a0ab53a4e908'] Oct 04 20:52:38.007217 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'body': {'security_group_rule': {'parent_group_id': '5df9cec7-1283-45e2-8682-a7bc213f47a6', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Oct 04 20:52:38.007217 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:52:38.007217 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:52:38.007217 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 04 20:52:38.007217 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 04 20:52:38.007217 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:52:38.007217 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:52:38.007217 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 04 20:52:38.007217 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 04 20:52:38.007217 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:52:38.007217 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:52:38.007217 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 20:52:38.007217 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 20:52:38.007217 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:52:38.007217 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:52:38.007217 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:52:38.007217 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:52:38.007217 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:52:38.007217 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:52:38.007217 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 20:52:38.007217 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 20:52:38.007217 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:52:38.007217 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:52:38.007217 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 20:52:38.007217 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 20:52:38.007217 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 20:52:38.010573 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 20:52:38.010573 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 5df9cec7-1283-45e2-8682-a7bc213f47a6 does not exist Oct 04 20:52:38.010573 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-59177b84-c80a-4da1-b40b-a0ab53a4e908'] Oct 04 20:52:38.010573 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:52:38.010573 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:52:38.010573 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:52:38.010573 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:52:38.010573 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 287, in create Oct 04 20:52:38.010573 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get( Oct 04 20:52:38.010573 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 04 20:52:38.010573 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 04 20:52:38.010573 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 5df9cec7-1283-45e2-8682-a7bc213f47a6 does not exist Oct 04 20:52:38.010573 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-59177b84-c80a-4da1-b40b-a0ab53a4e908'] Oct 04 20:52:38.010573 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:52:38.010573 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:52:38.010573 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:52:38.010573 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:52:38.010573 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:52:38.010573 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:52:38.010573 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:52:38.010573 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:52:38.010573 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:52:38.010573 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:52:38.010573 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:52:38.010573 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:52:38.010573 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 303, in create Oct 04 20:52:38.010573 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 04 20:52:38.010573 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 5df9cec7-1283-45e2-8682-a7bc213f47a6 does not exist Oct 04 20:52:38.010573 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-59177b84-c80a-4da1-b40b-a0ab53a4e908'] Oct 04 20:52:38.010573 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:52:38.010573 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:52:38.010573 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:52:38.010573 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:52:38.010573 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:52:38.010573 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:52:38.010573 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:52:38.010573 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:52:38.010573 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 5df9cec7-1283-45e2-8682-a7bc213f47a6 does not exist Oct 04 20:52:38.010573 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-59177b84-c80a-4da1-b40b-a0ab53a4e908'] Oct 04 20:52:38.010573 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:52:38.016637 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-4d6e6c89-7999-4478-b4ae-3a5db656c55d tempest-SecurityGroupRulesNegativeTestJSON-1167498397 tempest-SecurityGroupRulesNegativeTestJSON-1167498397-project] Returning 404 to user: Security group 5df9cec7-1283-45e2-8682-a7bc213f47a6 does not exist Oct 04 20:52:38.016637 n-d-854823-8 devstack@n-api.service[128801]: Neutron server returns request_ids: ['req-59177b84-c80a-4da1-b40b-a0ab53a4e908'] {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:52:38.019239 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-4d6e6c89-7999-4478-b4ae-3a5db656c55d tempest-SecurityGroupRulesNegativeTestJSON-1167498397 tempest-SecurityGroupRulesNegativeTestJSON-1167498397-project] 10.222.0.33 "POST /compute/v2.1/os-security-group-rules" status: 404 len: 194 microversion: 2.1 time: 0.065580 Oct 04 20:52:38.024104 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1980/4016] 10.222.0.33 () {60 vars in 1195 bytes} [Tue Oct 4 20:52:37 2022] POST /compute/v2.1/os-security-group-rules => generated 194 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:52:38.034280 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-cb505bc5-32d5-479e-b63a-5e4750a8ef23 tempest-SecurityGroupRulesNegativeTestJSON-1167498397 tempest-SecurityGroupRulesNegativeTestJSON-1167498397-project] Calling method '.version_select at 0x7f3c6f3e2b80>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:38.146175 n-d-854823-8 devstack@n-api.service[128801]: DEBUG neutronclient.v2_0.client [None req-cb505bc5-32d5-479e-b63a-5e4750a8ef23 tempest-SecurityGroupRulesNegativeTestJSON-1167498397 tempest-SecurityGroupRulesNegativeTestJSON-1167498397-project] Error message: {"NeutronError": {"type": "SecurityGroupRuleNotFound", "message": "Security group rule ee35ad05-170d-4b63-9715-ce3181151bc8 does not exist", "detail": ""}} {{(pid=128801) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 20:52:38.146844 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.network.security_group_api [None req-cb505bc5-32d5-479e-b63a-5e4750a8ef23 tempest-SecurityGroupRulesNegativeTestJSON-1167498397 tempest-SecurityGroupRulesNegativeTestJSON-1167498397-project] Neutron security group rule ee35ad05-170d-4b63-9715-ce3181151bc8 not found {{(pid=128801) get_rule /opt/stack/nova/nova/network/security_group_api.py:463}} Oct 04 20:52:38.147415 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-cb505bc5-32d5-479e-b63a-5e4750a8ef23 tempest-SecurityGroupRulesNegativeTestJSON-1167498397 tempest-SecurityGroupRulesNegativeTestJSON-1167498397-project] HTTP exception thrown: Security group rule ee35ad05-170d-4b63-9715-ce3181151bc8 does not exist Oct 04 20:52:38.147415 n-d-854823-8 devstack@n-api.service[128801]: Neutron server returns request_ids: ['req-352b3204-658c-46ad-af16-e3cbdd3fe488'] Oct 04 20:52:38.149513 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-cb505bc5-32d5-479e-b63a-5e4750a8ef23 tempest-SecurityGroupRulesNegativeTestJSON-1167498397 tempest-SecurityGroupRulesNegativeTestJSON-1167498397-project] Request method failure captured: Oct 04 20:52:38.149513 n-d-854823-8 devstack@n-api.service[128801]: request: DELETE /compute/v2.1/os-security-group-rules/ee35ad05-170d-4b63-9715-ce3181151bc8 HTTP/1.1 Oct 04 20:52:38.149513 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:52:38.149513 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:52:38.149513 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:52:38.149513 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 0 Oct 04 20:52:38.149513 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:52:38.149513 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:52:38.149513 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:52:38.149513 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:52:38.149513 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJ0LcMfISyKByig7GM_j4o1hIV10bXRG2l7JkvcuoTfJxDJriqO6srj_S1eOB6sNCi15vy6TPRx1ePrmt5tT56lLETrgcSJ7IMtNYnHpFowEl-n7gGSz7JUSscSwPkc1W9yF0xq9xzy6ddwRIXvHqAUScNfdov8hFtte_udSWJyiGlY Oct 04 20:52:38.149513 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:52:38.149513 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:52:38.149513 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:52:38.149513 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:52:38.149513 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:52:38.149513 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:52:38.149513 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: fbf529844e0b41b79049d9c9dc8f627b Oct 04 20:52:38.149513 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1167498397 Oct 04 20:52:38.149513 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 20:52:38.149513 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 20:52:38.149513 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_fbf529844e0b41b79049d9c9dc8f627b", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fbf529844e0b41b79049d9c9dc8f627b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fbf529844e0b41b79049d9c9dc8f627b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/fbf529844e0b41b79049d9c9dc8f627b"}]}] Oct 04 20:52:38.149513 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1167498397 Oct 04 20:52:38.149513 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: fbf529844e0b41b79049d9c9dc8f627b Oct 04 20:52:38.149513 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1167498397 Oct 04 20:52:38.149513 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1167498397-project Oct 04 20:52:38.149513 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:52:38.149513 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:52:38.149513 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: d315a7741a32465496190ea1ddc886d6 Oct 04 20:52:38.149513 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1167498397-project Oct 04 20:52:38.149513 n-d-854823-8 devstack@n-api.service[128801]: method: Oct 04 20:52:38.149513 n-d-854823-8 devstack@n-api.service[128801]: exception: Security group rule ee35ad05-170d-4b63-9715-ce3181151bc8 does not exist Oct 04 20:52:38.149513 n-d-854823-8 devstack@n-api.service[128801]: Neutron server returns request_ids: ['req-352b3204-658c-46ad-af16-e3cbdd3fe488'] Oct 04 20:52:38.149513 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': 'ee35ad05-170d-4b63-9715-ce3181151bc8'} Oct 04 20:52:38.149513 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:52:38.149513 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:52:38.149513 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 459, in get_rule Oct 04 20:52:38.149513 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi rule = neutron.show_security_group_rule( Oct 04 20:52:38.149513 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:52:38.149513 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:52:38.149513 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1092, in show_security_group_rule Oct 04 20:52:38.149513 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_rule_path % (security_group_rule), Oct 04 20:52:38.149513 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:52:38.149513 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:52:38.149513 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 20:52:38.149513 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 20:52:38.149513 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:52:38.149513 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:52:38.149513 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:52:38.149513 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:52:38.149513 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:52:38.149513 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:52:38.149513 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 20:52:38.149513 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 20:52:38.149513 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:52:38.149513 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:52:38.149513 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 20:52:38.149513 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 20:52:38.149513 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 20:52:38.149513 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 20:52:38.153342 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group rule ee35ad05-170d-4b63-9715-ce3181151bc8 does not exist Oct 04 20:52:38.153342 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-352b3204-658c-46ad-af16-e3cbdd3fe488'] Oct 04 20:52:38.153342 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:52:38.153342 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:52:38.153342 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:52:38.153342 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:52:38.153342 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 359, in delete Oct 04 20:52:38.153342 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi rule = security_group_api.get_rule(context, id) Oct 04 20:52:38.153342 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 464, in get_rule Oct 04 20:52:38.153342 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 04 20:52:38.153342 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group rule ee35ad05-170d-4b63-9715-ce3181151bc8 does not exist Oct 04 20:52:38.153342 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-352b3204-658c-46ad-af16-e3cbdd3fe488'] Oct 04 20:52:38.153342 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:52:38.153342 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:52:38.153342 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:52:38.153342 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:52:38.153342 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:52:38.153342 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:52:38.153342 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:52:38.153342 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:52:38.153342 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:52:38.153342 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:52:38.153342 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:52:38.153342 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:52:38.153342 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 365, in delete Oct 04 20:52:38.153342 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 04 20:52:38.153342 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group rule ee35ad05-170d-4b63-9715-ce3181151bc8 does not exist Oct 04 20:52:38.153342 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-352b3204-658c-46ad-af16-e3cbdd3fe488'] Oct 04 20:52:38.153342 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:52:38.153342 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:52:38.153342 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:52:38.153342 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:52:38.153342 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:52:38.153342 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:52:38.153342 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:52:38.153342 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:52:38.153342 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group rule ee35ad05-170d-4b63-9715-ce3181151bc8 does not exist Oct 04 20:52:38.153342 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-352b3204-658c-46ad-af16-e3cbdd3fe488'] Oct 04 20:52:38.153342 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:52:38.153342 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-cb505bc5-32d5-479e-b63a-5e4750a8ef23 tempest-SecurityGroupRulesNegativeTestJSON-1167498397 tempest-SecurityGroupRulesNegativeTestJSON-1167498397-project] Returning 404 to user: Security group rule ee35ad05-170d-4b63-9715-ce3181151bc8 does not exist Oct 04 20:52:38.153342 n-d-854823-8 devstack@n-api.service[128801]: Neutron server returns request_ids: ['req-352b3204-658c-46ad-af16-e3cbdd3fe488'] {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:52:38.153342 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-cb505bc5-32d5-479e-b63a-5e4750a8ef23 tempest-SecurityGroupRulesNegativeTestJSON-1167498397 tempest-SecurityGroupRulesNegativeTestJSON-1167498397-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-group-rules/ee35ad05-170d-4b63-9715-ce3181151bc8" status: 404 len: 199 microversion: 2.1 time: 0.125697 Oct 04 20:52:38.161320 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1981/4017] 10.222.0.33 () {58 vars in 1287 bytes} [Tue Oct 4 20:52:38 2022] DELETE /compute/v2.1/os-security-group-rules/ee35ad05-170d-4b63-9715-ce3181151bc8 => generated 199 bytes in 132 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:52:38.163612 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0715b637-2ff7-4c7c-ba44-523b761e38d1 tempest-SecurityGroupRulesNegativeTestJSON-1167498397 tempest-SecurityGroupRulesNegativeTestJSON-1167498397-project] Calling method '.version_select at 0x7f3c7893a700>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:39.210814 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-6863e8c4-fbaa-4f5d-aa70-96dfab2bcb2a tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c208ec9faf491385a9ab5b5932098d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ae4960393c464c97669731c2084d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:39.225428 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-6863e8c4-fbaa-4f5d-aa70-96dfab2bcb2a tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] 10.222.0.33 "GET /compute/v2.1/servers/30eb289d-d09c-43fa-af8a-3c6ee303f0af" status: 200 len: 1522 microversion: 2.1 time: 1.384463 Oct 04 20:52:39.231414 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2037/4018] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:52:37 2022] GET /compute/v2.1/servers/30eb289d-d09c-43fa-af8a-3c6ee303f0af => generated 1522 bytes in 1391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:52:39.257679 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-c5304fe3-3d3e-4b23-be2a-a71f1c70ef44 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:39.259431 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-c5304fe3-3d3e-4b23-be2a-a71f1c70ef44 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] [instance: 866d0dd3-3c7e-4612-a132-48eb83ec2d16] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:39.279015 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c5304fe3-3d3e-4b23-be2a-a71f1c70ef44 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:39.279577 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c5304fe3-3d3e-4b23-be2a-a71f1c70ef44 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:39.280011 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c5304fe3-3d3e-4b23-be2a-a71f1c70ef44 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:39.280761 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c5304fe3-3d3e-4b23-be2a-a71f1c70ef44 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:39.281227 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c5304fe3-3d3e-4b23-be2a-a71f1c70ef44 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:39.281662 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c5304fe3-3d3e-4b23-be2a-a71f1c70ef44 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:39.587896 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-0715b637-2ff7-4c7c-ba44-523b761e38d1 tempest-SecurityGroupRulesNegativeTestJSON-1167498397 tempest-SecurityGroupRulesNegativeTestJSON-1167498397-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/3a595765-b447-44b4-b759-3165aa0c443e" status: 202 len: 0 microversion: 2.1 time: 1.429693 Oct 04 20:52:39.588900 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1982/4019] 10.222.0.33 () {58 vars in 1272 bytes} [Tue Oct 4 20:52:38 2022] DELETE /compute/v2.1/os-security-groups/3a595765-b447-44b4-b759-3165aa0c443e => generated 0 bytes in 1431 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:52:39.595532 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-38af54aa-a1d7-4568-8014-74ac9b720d72 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:39.596199 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-38af54aa-a1d7-4568-8014-74ac9b720d72 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: 4d46fff2-b04d-41aa-ada0-2023ab545b48] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:39.615011 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-38af54aa-a1d7-4568-8014-74ac9b720d72 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:39.615602 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-38af54aa-a1d7-4568-8014-74ac9b720d72 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:39.616213 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-38af54aa-a1d7-4568-8014-74ac9b720d72 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:39.617109 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-38af54aa-a1d7-4568-8014-74ac9b720d72 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:39.617925 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-38af54aa-a1d7-4568-8014-74ac9b720d72 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:39.627647 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-38af54aa-a1d7-4568-8014-74ac9b720d72 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:39.677673 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-c5304fe3-3d3e-4b23-be2a-a71f1c70ef44 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc4171c0ee14ebb8b5eff5e910ccf49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003eb03a265a496d8981e45c74b014f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:39.695543 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-c5304fe3-3d3e-4b23-be2a-a71f1c70ef44 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] 10.222.0.33 "GET /compute/v2.1/servers/866d0dd3-3c7e-4612-a132-48eb83ec2d16" status: 200 len: 1565 microversion: 2.1 time: 0.455041 Oct 04 20:52:39.696731 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2038/4020] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:52:39 2022] GET /compute/v2.1/servers/866d0dd3-3c7e-4612-a132-48eb83ec2d16 => generated 1565 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:52:39.701728 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-dab3fef4-ce5e-4ec7-a48c-6f1b9b6a11d4 tempest-SecurityGroupRulesNegativeTestJSON-1167498397 tempest-SecurityGroupRulesNegativeTestJSON-1167498397-project] Calling method '.version_select at 0x7f3c6f6b68b0>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:40.156627 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-38af54aa-a1d7-4568-8014-74ac9b720d72 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac650232cc04810b1340dc2f0edadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b0670d1bd99424780a70e69d57a2166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:40.174151 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-38af54aa-a1d7-4568-8014-74ac9b720d72 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48" status: 200 len: 1666 microversion: 2.1 time: 0.584107 Oct 04 20:52:40.189446 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1983/4021] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:52:39 2022] GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48 => generated 1666 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:52:40.205501 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b726bf6f-2889-44ad-b4ee-699badff2470 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:40.206397 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b726bf6f-2889-44ad-b4ee-699badff2470 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] [instance: 866d0dd3-3c7e-4612-a132-48eb83ec2d16] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:40.218187 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b726bf6f-2889-44ad-b4ee-699badff2470 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:40.218710 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b726bf6f-2889-44ad-b4ee-699badff2470 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:40.219142 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b726bf6f-2889-44ad-b4ee-699badff2470 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:40.219849 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b726bf6f-2889-44ad-b4ee-699badff2470 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:40.220293 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b726bf6f-2889-44ad-b4ee-699badff2470 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:40.226457 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b726bf6f-2889-44ad-b4ee-699badff2470 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:40.284528 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:52:40.648291 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b726bf6f-2889-44ad-b4ee-699badff2470 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] 10.222.0.33 "GET /compute/v2.1/servers/866d0dd3-3c7e-4612-a132-48eb83ec2d16/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.457412 Oct 04 20:52:40.649654 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1984/4022] 10.222.0.33 () {58 vars in 1275 bytes} [Tue Oct 4 20:52:40 2022] GET /compute/v2.1/servers/866d0dd3-3c7e-4612-a132-48eb83ec2d16/os-interface => generated 284 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:52:40.656887 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7ce2031f-f923-4a76-ac96-a68a6a8cf412 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:40.658471 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-7ce2031f-f923-4a76-ac96-a68a6a8cf412 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] [instance: 30eb289d-d09c-43fa-af8a-3c6ee303f0af] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:40.682630 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7ce2031f-f923-4a76-ac96-a68a6a8cf412 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:40.697859 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7ce2031f-f923-4a76-ac96-a68a6a8cf412 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:40.707540 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7ce2031f-f923-4a76-ac96-a68a6a8cf412 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:40.712438 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7ce2031f-f923-4a76-ac96-a68a6a8cf412 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:40.713058 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7ce2031f-f923-4a76-ac96-a68a6a8cf412 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:40.713507 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7ce2031f-f923-4a76-ac96-a68a6a8cf412 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:40.838234 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-dab3fef4-ce5e-4ec7-a48c-6f1b9b6a11d4 tempest-SecurityGroupRulesNegativeTestJSON-1167498397 tempest-SecurityGroupRulesNegativeTestJSON-1167498397-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/da9e14c1-e997-4dd9-bbd7-affc8613faa9" status: 202 len: 0 microversion: 2.1 time: 1.140110 Oct 04 20:52:40.840409 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2039/4023] 10.222.0.33 () {58 vars in 1272 bytes} [Tue Oct 4 20:52:39 2022] DELETE /compute/v2.1/os-security-groups/da9e14c1-e997-4dd9-bbd7-affc8613faa9 => generated 0 bytes in 1142 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:52:40.848765 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-fcd8cbcf-1e54-46a9-a6c2-e0f8840edee7 tempest-SecurityGroupRulesNegativeTestJSON-1167498397 tempest-SecurityGroupRulesNegativeTestJSON-1167498397-project] Calling method '.version_select at 0x7f3c6f61a160>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:41.902431 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-7ce2031f-f923-4a76-ac96-a68a6a8cf412 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c208ec9faf491385a9ab5b5932098d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ae4960393c464c97669731c2084d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:41.922380 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-7ce2031f-f923-4a76-ac96-a68a6a8cf412 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] 10.222.0.33 "GET /compute/v2.1/servers/30eb289d-d09c-43fa-af8a-3c6ee303f0af" status: 200 len: 1522 microversion: 2.1 time: 1.270663 Oct 04 20:52:41.922992 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1985/4024] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:52:40 2022] GET /compute/v2.1/servers/30eb289d-d09c-43fa-af8a-3c6ee303f0af => generated 1522 bytes in 1272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:52:41.946508 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-cc7d6c09-f8f4-42c2-a013-6bb0ba0b6abe tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:41.947358 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-cc7d6c09-f8f4-42c2-a013-6bb0ba0b6abe tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: 4d46fff2-b04d-41aa-ada0-2023ab545b48] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:41.954493 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=70 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:52:41.956294 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cc7d6c09-f8f4-42c2-a013-6bb0ba0b6abe tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:41.957128 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cc7d6c09-f8f4-42c2-a013-6bb0ba0b6abe tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:41.957733 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cc7d6c09-f8f4-42c2-a013-6bb0ba0b6abe tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:41.958639 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cc7d6c09-f8f4-42c2-a013-6bb0ba0b6abe tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:41.959237 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cc7d6c09-f8f4-42c2-a013-6bb0ba0b6abe tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:41.959799 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cc7d6c09-f8f4-42c2-a013-6bb0ba0b6abe tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:42.667642 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-fcd8cbcf-1e54-46a9-a6c2-e0f8840edee7 tempest-SecurityGroupRulesNegativeTestJSON-1167498397 tempest-SecurityGroupRulesNegativeTestJSON-1167498397-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/d51082d5-0c2c-433c-8e24-30500010192a" status: 202 len: 0 microversion: 2.1 time: 1.822464 Oct 04 20:52:42.671866 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2040/4025] 10.222.0.33 () {58 vars in 1272 bytes} [Tue Oct 4 20:52:40 2022] DELETE /compute/v2.1/os-security-groups/d51082d5-0c2c-433c-8e24-30500010192a => generated 0 bytes in 1825 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:52:42.677104 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-302a6680-dc49-447f-956d-3ca078527cb1 tempest-SecurityGroupRulesNegativeTestJSON-1167498397 tempest-SecurityGroupRulesNegativeTestJSON-1167498397-project] Calling method '.version_select at 0x7f3c6f61a0d0>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:42.722535 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-cc7d6c09-f8f4-42c2-a013-6bb0ba0b6abe tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac650232cc04810b1340dc2f0edadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b0670d1bd99424780a70e69d57a2166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:42.731174 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-cc7d6c09-f8f4-42c2-a013-6bb0ba0b6abe tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48" status: 200 len: 1669 microversion: 2.1 time: 0.794931 Oct 04 20:52:42.734066 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1986/4026] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:52:41 2022] GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48 => generated 1669 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:52:42.768853 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-345ab557-ab0c-4250-91a6-7a4360da20db tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:42.769933 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-345ab557-ab0c-4250-91a6-7a4360da20db tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: 4d46fff2-b04d-41aa-ada0-2023ab545b48] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:42.780741 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-345ab557-ab0c-4250-91a6-7a4360da20db tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:42.781588 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-345ab557-ab0c-4250-91a6-7a4360da20db tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:42.782207 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-345ab557-ab0c-4250-91a6-7a4360da20db tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:42.783163 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-345ab557-ab0c-4250-91a6-7a4360da20db tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:42.784212 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-345ab557-ab0c-4250-91a6-7a4360da20db tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:42.786146 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-345ab557-ab0c-4250-91a6-7a4360da20db tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:43.267934 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-345ab557-ab0c-4250-91a6-7a4360da20db tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac650232cc04810b1340dc2f0edadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b0670d1bd99424780a70e69d57a2166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:43.280240 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-345ab557-ab0c-4250-91a6-7a4360da20db tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48" status: 200 len: 1669 microversion: 2.1 time: 0.519725 Oct 04 20:52:43.282915 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1987/4027] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:52:42 2022] GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48 => generated 1669 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:52:43.294576 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9b3a8f52-231e-477d-a9cd-1e1d815d9bc2 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:43.297716 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-9b3a8f52-231e-477d-a9cd-1e1d815d9bc2 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] [instance: 30eb289d-d09c-43fa-af8a-3c6ee303f0af] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:43.314105 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9b3a8f52-231e-477d-a9cd-1e1d815d9bc2 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:43.314899 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9b3a8f52-231e-477d-a9cd-1e1d815d9bc2 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:43.316444 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9b3a8f52-231e-477d-a9cd-1e1d815d9bc2 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:43.318754 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9b3a8f52-231e-477d-a9cd-1e1d815d9bc2 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:43.319677 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9b3a8f52-231e-477d-a9cd-1e1d815d9bc2 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:43.323110 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9b3a8f52-231e-477d-a9cd-1e1d815d9bc2 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:43.611177 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-302a6680-dc49-447f-956d-3ca078527cb1 tempest-SecurityGroupRulesNegativeTestJSON-1167498397 tempest-SecurityGroupRulesNegativeTestJSON-1167498397-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/956cba58-3cf2-4d1b-b95c-bf6d0bc172a4" status: 202 len: 0 microversion: 2.1 time: 0.938194 Oct 04 20:52:43.611956 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2041/4028] 10.222.0.33 () {58 vars in 1272 bytes} [Tue Oct 4 20:52:42 2022] DELETE /compute/v2.1/os-security-groups/956cba58-3cf2-4d1b-b95c-bf6d0bc172a4 => generated 0 bytes in 940 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 20:52:43.617079 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-e4e5145d-c738-4d3d-87da-9a4084fc525a tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:43.617862 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-e4e5145d-c738-4d3d-87da-9a4084fc525a tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: a0273e6e-eb85-4204-9bec-3707ad6612af] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:43.628393 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e4e5145d-c738-4d3d-87da-9a4084fc525a tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:43.630158 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e4e5145d-c738-4d3d-87da-9a4084fc525a tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:43.631593 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e4e5145d-c738-4d3d-87da-9a4084fc525a tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:43.632743 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e4e5145d-c738-4d3d-87da-9a4084fc525a tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:43.634680 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e4e5145d-c738-4d3d-87da-9a4084fc525a tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:43.636068 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e4e5145d-c738-4d3d-87da-9a4084fc525a tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:43.677950 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-e4e5145d-c738-4d3d-87da-9a4084fc525a tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: a0273e6e-eb85-4204-9bec-3707ad6612af] Going to try to terminate instance {{(pid=128802) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:52:43.686643 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.compute.api [None req-e4e5145d-c738-4d3d-87da-9a4084fc525a tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: a0273e6e-eb85-4204-9bec-3707ad6612af] Working on deleting snapshot ce170220-b16b-4938-9ce6-81dd45811d20 from shelved instance... Oct 04 20:52:44.090993 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-9b3a8f52-231e-477d-a9cd-1e1d815d9bc2 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c208ec9faf491385a9ab5b5932098d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ae4960393c464c97669731c2084d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:44.112634 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-9b3a8f52-231e-477d-a9cd-1e1d815d9bc2 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] 10.222.0.33 "GET /compute/v2.1/servers/30eb289d-d09c-43fa-af8a-3c6ee303f0af" status: 200 len: 1522 microversion: 2.1 time: 0.826080 Oct 04 20:52:44.129165 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1988/4029] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:52:43 2022] GET /compute/v2.1/servers/30eb289d-d09c-43fa-af8a-3c6ee303f0af => generated 1522 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:52:44.144871 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-83fe968e-f3d7-4323-8320-dcd59057d6c3 tempest-SecurityGroupRulesNegativeTestJSON-1167498397 tempest-SecurityGroupRulesNegativeTestJSON-1167498397-project] Calling method '.version_select at 0x7f3c6f3da5e0>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:45.189816 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-83fe968e-f3d7-4323-8320-dcd59057d6c3 tempest-SecurityGroupRulesNegativeTestJSON-1167498397 tempest-SecurityGroupRulesNegativeTestJSON-1167498397-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/0e598515-dfd3-44cf-9c98-1e1a4df46bec" status: 202 len: 0 microversion: 2.1 time: 1.058919 Oct 04 20:52:45.191256 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1989/4030] 10.222.0.33 () {58 vars in 1272 bytes} [Tue Oct 4 20:52:44 2022] DELETE /compute/v2.1/os-security-groups/0e598515-dfd3-44cf-9c98-1e1a4df46bec => generated 0 bytes in 1061 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:52:45.197329 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-556e24e4-a220-46cc-9b1f-65c0de2bef14 req-df878daf-8001-4ec2-862c-6131ca4e85c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "866d0dd3-3c7e-4612-a132-48eb83ec2d16", "tag": "0544b7b3-d2c3-439a-b134-c025dc0ed7a6"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:52:45.202227 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-e4e5145d-c738-4d3d-87da-9a4084fc525a tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: a0273e6e-eb85-4204-9bec-3707ad6612af] Doing local delete in cell 189ff13b-7538-4a71-a71c-1e7f1d3e1b46(cell1) {{(pid=128802) _delete /opt/stack/nova/nova/compute/api.py:2546}} Oct 04 20:52:45.202227 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e4e5145d-c738-4d3d-87da-9a4084fc525a tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:45.218519 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e4e5145d-c738-4d3d-87da-9a4084fc525a tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:45.222304 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e4e5145d-c738-4d3d-87da-9a4084fc525a tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:45.222802 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.compute.api [None req-e4e5145d-c738-4d3d-87da-9a4084fc525a tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: a0273e6e-eb85-4204-9bec-3707ad6612af] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Oct 04 20:52:45.241826 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.network.neutron [None req-e4e5145d-c738-4d3d-87da-9a4084fc525a tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: a0273e6e-eb85-4204-9bec-3707ad6612af] deallocate_for_instance() {{(pid=128802) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1780}} Oct 04 20:52:45.308003 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-556e24e4-a220-46cc-9b1f-65c0de2bef14 req-df878daf-8001-4ec2-862c-6131ca4e85c2 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:45.319546 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-556e24e4-a220-46cc-9b1f-65c0de2bef14 req-df878daf-8001-4ec2-862c-6131ca4e85c2 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:45.321725 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-556e24e4-a220-46cc-9b1f-65c0de2bef14 req-df878daf-8001-4ec2-862c-6131ca4e85c2 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:45.349656 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-556e24e4-a220-46cc-9b1f-65c0de2bef14 req-df878daf-8001-4ec2-862c-6131ca4e85c2 service nova] Creating event network-changed:0544b7b3-d2c3-439a-b134-c025dc0ed7a6 for instance 866d0dd3-3c7e-4612-a132-48eb83ec2d16 on n-h2-854823-8 Oct 04 20:52:45.368084 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-556e24e4-a220-46cc-9b1f-65c0de2bef14 req-df878daf-8001-4ec2-862c-6131ca4e85c2 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.175183 Oct 04 20:52:45.371247 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1990/4031] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:52:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:52:45.379256 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-227cae67-d29e-4232-bfee-b5aa6ea67976 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:45.380342 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-227cae67-d29e-4232-bfee-b5aa6ea67976 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] [instance: 30eb289d-d09c-43fa-af8a-3c6ee303f0af] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:45.395696 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-227cae67-d29e-4232-bfee-b5aa6ea67976 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:45.396687 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-227cae67-d29e-4232-bfee-b5aa6ea67976 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:45.397529 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-227cae67-d29e-4232-bfee-b5aa6ea67976 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:45.398431 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-227cae67-d29e-4232-bfee-b5aa6ea67976 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:45.399101 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-227cae67-d29e-4232-bfee-b5aa6ea67976 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:45.399899 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-227cae67-d29e-4232-bfee-b5aa6ea67976 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:46.822057 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-227cae67-d29e-4232-bfee-b5aa6ea67976 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c208ec9faf491385a9ab5b5932098d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ae4960393c464c97669731c2084d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:46.832130 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-227cae67-d29e-4232-bfee-b5aa6ea67976 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] 10.222.0.33 "GET /compute/v2.1/servers/30eb289d-d09c-43fa-af8a-3c6ee303f0af" status: 200 len: 1522 microversion: 2.1 time: 1.458820 Oct 04 20:52:46.853919 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1991/4032] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:52:45 2022] GET /compute/v2.1/servers/30eb289d-d09c-43fa-af8a-3c6ee303f0af => generated 1522 bytes in 1482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:52:47.869098 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-33efd890-a69f-452a-b535-bc1be678ea0c tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:47.869744 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-33efd890-a69f-452a-b535-bc1be678ea0c tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] [instance: 30eb289d-d09c-43fa-af8a-3c6ee303f0af] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:47.888910 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-33efd890-a69f-452a-b535-bc1be678ea0c tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:47.894801 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-33efd890-a69f-452a-b535-bc1be678ea0c tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:47.898817 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-33efd890-a69f-452a-b535-bc1be678ea0c tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:47.900745 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-33efd890-a69f-452a-b535-bc1be678ea0c tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:47.901938 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-33efd890-a69f-452a-b535-bc1be678ea0c tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:47.904034 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-33efd890-a69f-452a-b535-bc1be678ea0c tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:49.461080 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-33efd890-a69f-452a-b535-bc1be678ea0c tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c208ec9faf491385a9ab5b5932098d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ae4960393c464c97669731c2084d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:49.487801 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-33efd890-a69f-452a-b535-bc1be678ea0c tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] 10.222.0.33 "GET /compute/v2.1/servers/30eb289d-d09c-43fa-af8a-3c6ee303f0af" status: 200 len: 1522 microversion: 2.1 time: 1.622097 Oct 04 20:52:49.490682 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1992/4033] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:52:47 2022] GET /compute/v2.1/servers/30eb289d-d09c-43fa-af8a-3c6ee303f0af => generated 1522 bytes in 1627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:52:49.953397 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-83ae1741-b038-4200-bf75-b308854c3602 req-0eadb0c5-1b4f-480c-8fe8-ee5872021f76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0273e6e-eb85-4204-9bec-3707ad6612af", "name": "network-vif-deleted", "tag": "b9c967b1-2617-432a-a85b-6d5bdf32c3a6"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:52:49.957284 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.network.neutron [None req-e4e5145d-c738-4d3d-87da-9a4084fc525a tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: a0273e6e-eb85-4204-9bec-3707ad6612af] Updating instance_info_cache with network_info: [] {{(pid=128802) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 04 20:52:49.991995 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-83ae1741-b038-4200-bf75-b308854c3602 req-0eadb0c5-1b4f-480c-8fe8-ee5872021f76 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:49.993496 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-83ae1741-b038-4200-bf75-b308854c3602 req-0eadb0c5-1b4f-480c-8fe8-ee5872021f76 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:49.995457 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-83ae1741-b038-4200-bf75-b308854c3602 req-0eadb0c5-1b4f-480c-8fe8-ee5872021f76 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:50.091115 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.compute.server_external_events [req-83ae1741-b038-4200-bf75-b308854c3602 req-0eadb0c5-1b4f-480c-8fe8-ee5872021f76 service nova] Unable to find a host for instance a0273e6e-eb85-4204-9bec-3707ad6612af. Dropping event network-vif-deleted {{(pid=128801) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 04 20:52:50.101742 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-83ae1741-b038-4200-bf75-b308854c3602 req-0eadb0c5-1b4f-480c-8fe8-ee5872021f76 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.151444 Oct 04 20:52:50.104530 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1993/4034] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:52:49 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 163 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Oct 04 20:52:50.521821 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7dd06d68-1a5d-45f7-9bba-5bba3397a466 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:50.523710 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-7dd06d68-1a5d-45f7-9bba-5bba3397a466 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] [instance: 30eb289d-d09c-43fa-af8a-3c6ee303f0af] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:50.536047 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7dd06d68-1a5d-45f7-9bba-5bba3397a466 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:50.537134 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7dd06d68-1a5d-45f7-9bba-5bba3397a466 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:50.539861 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7dd06d68-1a5d-45f7-9bba-5bba3397a466 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:50.540928 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7dd06d68-1a5d-45f7-9bba-5bba3397a466 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:50.543739 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7dd06d68-1a5d-45f7-9bba-5bba3397a466 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:50.545187 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7dd06d68-1a5d-45f7-9bba-5bba3397a466 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:51.089932 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-e4e5145d-c738-4d3d-87da-9a4084fc525a tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "DELETE /compute/v2.1/servers/a0273e6e-eb85-4204-9bec-3707ad6612af" status: 204 len: 0 microversion: 2.1 time: 7.476609 Oct 04 20:52:51.090629 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2042/4035] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 20:52:43 2022] DELETE /compute/v2.1/servers/a0273e6e-eb85-4204-9bec-3707ad6612af => generated 0 bytes in 7478 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:52:51.104908 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-eac7bdf3-3d8c-4872-954e-3090da3f8319 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:51.108412 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-eac7bdf3-3d8c-4872-954e-3090da3f8319 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: a0273e6e-eb85-4204-9bec-3707ad6612af] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:51.125860 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-eac7bdf3-3d8c-4872-954e-3090da3f8319 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:51.133449 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-eac7bdf3-3d8c-4872-954e-3090da3f8319 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:51.133948 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-eac7bdf3-3d8c-4872-954e-3090da3f8319 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:51.134776 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-eac7bdf3-3d8c-4872-954e-3090da3f8319 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:51.135245 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-eac7bdf3-3d8c-4872-954e-3090da3f8319 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:51.135678 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-eac7bdf3-3d8c-4872-954e-3090da3f8319 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:51.169374 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.wsgi [None req-eac7bdf3-3d8c-4872-954e-3090da3f8319 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] HTTP exception thrown: Instance a0273e6e-eb85-4204-9bec-3707ad6612af could not be found. Oct 04 20:52:51.177427 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-eac7bdf3-3d8c-4872-954e-3090da3f8319 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Request method failure captured: Oct 04 20:52:51.177427 n-d-854823-8 devstack@n-api.service[128802]: request: GET /compute/v2.1/servers/a0273e6e-eb85-4204-9bec-3707ad6612af HTTP/1.1 Oct 04 20:52:51.177427 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 20:52:51.177427 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 20:52:51.177427 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 20:52:51.177427 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 0 Oct 04 20:52:51.177427 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 20:52:51.177427 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 20:52:51.177427 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 20:52:51.177427 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 20:52:51.177427 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPJsfW5w9WW6HLdIS-vhuA3Aqgubdan3G4XN4Mz-kS5WBm_kV8MmkEfQ0VXyVBZGh_offIhP7k_7zeKcJerywXx22sbTVU7nn7Yk2TKQKkZk7TZieLYe5dW5fMpGMZVoLDxRDRs83mJz3B8SrRlYbnvScXHL2MTPSbeQInsaFtih26mQ Oct 04 20:52:51.177427 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 20:52:51.177427 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 20:52:51.177427 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 20:52:51.177427 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 20:52:51.177427 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 20:52:51.177427 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 20:52:51.177427 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: 8b0670d1bd99424780a70e69d57a2166 Oct 04 20:52:51.177427 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-ServerActionsTestJSON-1241178619 Oct 04 20:52:51.177427 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 20:52:51.177427 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 20:52:51.177427 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_8b0670d1bd99424780a70e69d57a2166", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8b0670d1bd99424780a70e69d57a2166"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8b0670d1bd99424780a70e69d57a2166"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/8b0670d1bd99424780a70e69d57a2166"}]}] Oct 04 20:52:51.177427 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-ServerActionsTestJSON-1241178619 Oct 04 20:52:51.177427 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: 8b0670d1bd99424780a70e69d57a2166 Oct 04 20:52:51.177427 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-ServerActionsTestJSON-1241178619 Oct 04 20:52:51.177427 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-ServerActionsTestJSON-1241178619-project Oct 04 20:52:51.177427 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 20:52:51.177427 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 20:52:51.177427 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: eac650232cc04810b1340dc2f0edadcc Oct 04 20:52:51.177427 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-ServerActionsTestJSON-1241178619-project Oct 04 20:52:51.177427 n-d-854823-8 devstack@n-api.service[128802]: method: > Oct 04 20:52:51.177427 n-d-854823-8 devstack@n-api.service[128802]: exception: Instance a0273e6e-eb85-4204-9bec-3707ad6612af could not be found. Oct 04 20:52:51.177427 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'id': 'a0273e6e-eb85-4204-9bec-3707ad6612af'} Oct 04 20:52:51.177427 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:52:51.177427 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:52:51.177427 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:52:51.177427 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:52:51.177427 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:52:51.177427 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:52:51.177427 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:52:51.177427 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:52:51.177427 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:52:51.177427 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:52:51.177427 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0273e6e-eb85-4204-9bec-3707ad6612af could not be found. Oct 04 20:52:51.177427 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:52:51.177427 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:52:51.177427 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:52:51.177427 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:52:51.177427 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:52:51.177427 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:52:51.177427 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:52:51.177427 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:52:51.177427 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:52:51.177427 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:52:51.177427 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:52:51.177427 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:52:51.177427 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:52:51.177427 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:52:51.177427 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:52:51.177427 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:52:51.177427 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0273e6e-eb85-4204-9bec-3707ad6612af could not be found. Oct 04 20:52:51.177427 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:52:51.177427 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:52:51.177427 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:52:51.181387 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:52:51.181387 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:52:51.181387 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:52:51.181387 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:52:51.181387 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:52:51.181387 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0273e6e-eb85-4204-9bec-3707ad6612af could not be found. Oct 04 20:52:51.181387 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:52:51.184898 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-eac7bdf3-3d8c-4872-954e-3090da3f8319 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Returning 404 to user: Instance a0273e6e-eb85-4204-9bec-3707ad6612af could not be found. {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:52:51.186946 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-eac7bdf3-3d8c-4872-954e-3090da3f8319 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "GET /compute/v2.1/servers/a0273e6e-eb85-4204-9bec-3707ad6612af" status: 404 len: 111 microversion: 2.1 time: 0.092077 Oct 04 20:52:51.190779 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2043/4036] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:52:51 2022] GET /compute/v2.1/servers/a0273e6e-eb85-4204-9bec-3707ad6612af => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:52:51.209376 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-e29f28d3-6065-400f-9be5-54dc487221b1 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:51.215549 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-e29f28d3-6065-400f-9be5-54dc487221b1 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: db7ee8ad-13be-450c-b9a9-1da939dbc268] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:51.226835 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e29f28d3-6065-400f-9be5-54dc487221b1 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:51.229056 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e29f28d3-6065-400f-9be5-54dc487221b1 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:51.229694 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e29f28d3-6065-400f-9be5-54dc487221b1 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:51.231539 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e29f28d3-6065-400f-9be5-54dc487221b1 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:51.236020 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e29f28d3-6065-400f-9be5-54dc487221b1 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:51.239336 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e29f28d3-6065-400f-9be5-54dc487221b1 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:51.322902 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-7dd06d68-1a5d-45f7-9bba-5bba3397a466 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c208ec9faf491385a9ab5b5932098d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ae4960393c464c97669731c2084d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:51.330202 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-e29f28d3-6065-400f-9be5-54dc487221b1 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: db7ee8ad-13be-450c-b9a9-1da939dbc268] Going to try to terminate instance {{(pid=128802) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:52:51.342800 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-7dd06d68-1a5d-45f7-9bba-5bba3397a466 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] 10.222.0.33 "GET /compute/v2.1/servers/30eb289d-d09c-43fa-af8a-3c6ee303f0af" status: 200 len: 1522 microversion: 2.1 time: 0.825500 Oct 04 20:52:51.345695 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1994/4037] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:52:50 2022] GET /compute/v2.1/servers/30eb289d-d09c-43fa-af8a-3c6ee303f0af => generated 1522 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:52:51.546714 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-e29f28d3-6065-400f-9be5-54dc487221b1 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "DELETE /compute/v2.1/servers/db7ee8ad-13be-450c-b9a9-1da939dbc268" status: 204 len: 0 microversion: 2.1 time: 0.354304 Oct 04 20:52:51.547412 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2044/4038] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 20:52:51 2022] DELETE /compute/v2.1/servers/db7ee8ad-13be-450c-b9a9-1da939dbc268 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:52:51.556574 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-996e4c17-a828-4a13-9c1c-1de9f423f200 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:51.557916 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-996e4c17-a828-4a13-9c1c-1de9f423f200 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: db7ee8ad-13be-450c-b9a9-1da939dbc268] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:51.567722 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-996e4c17-a828-4a13-9c1c-1de9f423f200 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:51.568202 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-996e4c17-a828-4a13-9c1c-1de9f423f200 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:51.568634 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-996e4c17-a828-4a13-9c1c-1de9f423f200 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:51.576039 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-996e4c17-a828-4a13-9c1c-1de9f423f200 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:51.578309 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-996e4c17-a828-4a13-9c1c-1de9f423f200 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:51.579765 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-996e4c17-a828-4a13-9c1c-1de9f423f200 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:51.877719 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-996e4c17-a828-4a13-9c1c-1de9f423f200 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac650232cc04810b1340dc2f0edadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b0670d1bd99424780a70e69d57a2166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:51.887091 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-996e4c17-a828-4a13-9c1c-1de9f423f200 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "GET /compute/v2.1/servers/db7ee8ad-13be-450c-b9a9-1da939dbc268" status: 200 len: 1467 microversion: 2.1 time: 0.334102 Oct 04 20:52:51.887684 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1995/4039] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:52:51 2022] GET /compute/v2.1/servers/db7ee8ad-13be-450c-b9a9-1da939dbc268 => generated 1467 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:52:52.375655 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-a635de37-b7ef-41cc-8de7-b16715a977f1 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:52.376383 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-a635de37-b7ef-41cc-8de7-b16715a977f1 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] [instance: 30eb289d-d09c-43fa-af8a-3c6ee303f0af] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:52.386320 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a635de37-b7ef-41cc-8de7-b16715a977f1 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:52.388642 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a635de37-b7ef-41cc-8de7-b16715a977f1 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:52.389788 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a635de37-b7ef-41cc-8de7-b16715a977f1 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:52.391593 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a635de37-b7ef-41cc-8de7-b16715a977f1 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:52.392744 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a635de37-b7ef-41cc-8de7-b16715a977f1 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:52.393445 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a635de37-b7ef-41cc-8de7-b16715a977f1 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:52.914582 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e9a0c8d0-5ff8-46ba-a550-b30eeee9f91c tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:52.916002 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e9a0c8d0-5ff8-46ba-a550-b30eeee9f91c tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: db7ee8ad-13be-450c-b9a9-1da939dbc268] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:52.926962 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e9a0c8d0-5ff8-46ba-a550-b30eeee9f91c tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:52.927802 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e9a0c8d0-5ff8-46ba-a550-b30eeee9f91c tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:52.928454 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e9a0c8d0-5ff8-46ba-a550-b30eeee9f91c tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:52.930247 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e9a0c8d0-5ff8-46ba-a550-b30eeee9f91c tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:52.931006 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e9a0c8d0-5ff8-46ba-a550-b30eeee9f91c tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:52.931719 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e9a0c8d0-5ff8-46ba-a550-b30eeee9f91c tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:53.335780 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-a635de37-b7ef-41cc-8de7-b16715a977f1 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c208ec9faf491385a9ab5b5932098d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ae4960393c464c97669731c2084d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:53.351046 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-a635de37-b7ef-41cc-8de7-b16715a977f1 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] 10.222.0.33 "GET /compute/v2.1/servers/30eb289d-d09c-43fa-af8a-3c6ee303f0af" status: 200 len: 1522 microversion: 2.1 time: 0.976288 Oct 04 20:52:53.368143 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2045/4040] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:52:52 2022] GET /compute/v2.1/servers/30eb289d-d09c-43fa-af8a-3c6ee303f0af => generated 1522 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:52:53.390411 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e9a0c8d0-5ff8-46ba-a550-b30eeee9f91c tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac650232cc04810b1340dc2f0edadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b0670d1bd99424780a70e69d57a2166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:53.399519 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e9a0c8d0-5ff8-46ba-a550-b30eeee9f91c tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "GET /compute/v2.1/servers/db7ee8ad-13be-450c-b9a9-1da939dbc268" status: 200 len: 1467 microversion: 2.1 time: 0.489977 Oct 04 20:52:53.403414 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1996/4041] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:52:52 2022] GET /compute/v2.1/servers/db7ee8ad-13be-450c-b9a9-1da939dbc268 => generated 1467 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:52:54.381452 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-c71d3572-2009-4876-bc31-53b5b08f554a tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:54.382706 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-c71d3572-2009-4876-bc31-53b5b08f554a tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] [instance: 30eb289d-d09c-43fa-af8a-3c6ee303f0af] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:54.401898 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c71d3572-2009-4876-bc31-53b5b08f554a tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:54.403268 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c71d3572-2009-4876-bc31-53b5b08f554a tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:54.403887 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c71d3572-2009-4876-bc31-53b5b08f554a tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:54.404771 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c71d3572-2009-4876-bc31-53b5b08f554a tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:54.405382 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c71d3572-2009-4876-bc31-53b5b08f554a tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:54.411651 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c71d3572-2009-4876-bc31-53b5b08f554a tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:54.431028 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-cd318f00-d559-457e-9187-022e0ba8f0d2 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:54.431730 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-cd318f00-d559-457e-9187-022e0ba8f0d2 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: db7ee8ad-13be-450c-b9a9-1da939dbc268] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:54.447574 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cd318f00-d559-457e-9187-022e0ba8f0d2 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:54.448273 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cd318f00-d559-457e-9187-022e0ba8f0d2 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:54.452358 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cd318f00-d559-457e-9187-022e0ba8f0d2 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:54.453522 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cd318f00-d559-457e-9187-022e0ba8f0d2 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:54.454157 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cd318f00-d559-457e-9187-022e0ba8f0d2 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:54.454820 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cd318f00-d559-457e-9187-022e0ba8f0d2 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:54.463551 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=17,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2,nova_cell1:INSERT=1 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:52:55.140015 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-cd318f00-d559-457e-9187-022e0ba8f0d2 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac650232cc04810b1340dc2f0edadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b0670d1bd99424780a70e69d57a2166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:55.205067 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-cd318f00-d559-457e-9187-022e0ba8f0d2 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "GET /compute/v2.1/servers/db7ee8ad-13be-450c-b9a9-1da939dbc268" status: 200 len: 1467 microversion: 2.1 time: 0.779108 Oct 04 20:52:55.208311 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1997/4042] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:52:54 2022] GET /compute/v2.1/servers/db7ee8ad-13be-450c-b9a9-1da939dbc268 => generated 1467 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:52:55.625367 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-c71d3572-2009-4876-bc31-53b5b08f554a tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c208ec9faf491385a9ab5b5932098d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ae4960393c464c97669731c2084d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:55.635721 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-c71d3572-2009-4876-bc31-53b5b08f554a tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] 10.222.0.33 "GET /compute/v2.1/servers/30eb289d-d09c-43fa-af8a-3c6ee303f0af" status: 200 len: 1522 microversion: 2.1 time: 1.258057 Oct 04 20:52:55.645341 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2046/4043] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:52:54 2022] GET /compute/v2.1/servers/30eb289d-d09c-43fa-af8a-3c6ee303f0af => generated 1522 bytes in 1268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:52:55.738132 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-9ac4c382-705b-413a-8557-9721349dd6d1 req-9288edab-6e32-402d-8608-79fe619c30de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db7ee8ad-13be-450c-b9a9-1da939dbc268", "name": "network-vif-deleted", "tag": "6f6e72a8-155e-4495-9560-85d30934edee"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:52:55.763968 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-9ac4c382-705b-413a-8557-9721349dd6d1 req-9288edab-6e32-402d-8608-79fe619c30de service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:55.766165 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-9ac4c382-705b-413a-8557-9721349dd6d1 req-9288edab-6e32-402d-8608-79fe619c30de service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:55.773726 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-9ac4c382-705b-413a-8557-9721349dd6d1 req-9288edab-6e32-402d-8608-79fe619c30de service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:55.817583 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-9ac4c382-705b-413a-8557-9721349dd6d1 req-9288edab-6e32-402d-8608-79fe619c30de service nova] Creating event network-vif-deleted:6f6e72a8-155e-4495-9560-85d30934edee for instance db7ee8ad-13be-450c-b9a9-1da939dbc268 on n-h2-854823-8 Oct 04 20:52:55.833066 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-9ac4c382-705b-413a-8557-9721349dd6d1 req-9288edab-6e32-402d-8608-79fe619c30de service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100047 Oct 04 20:52:55.838109 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1998/4044] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:52:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 20:52:56.236725 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-d4262225-819d-4f28-b79a-b6ee802c3d64 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:56.237436 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-d4262225-819d-4f28-b79a-b6ee802c3d64 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: db7ee8ad-13be-450c-b9a9-1da939dbc268] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:56.252668 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d4262225-819d-4f28-b79a-b6ee802c3d64 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:56.253189 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d4262225-819d-4f28-b79a-b6ee802c3d64 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:56.253643 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d4262225-819d-4f28-b79a-b6ee802c3d64 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:56.254451 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d4262225-819d-4f28-b79a-b6ee802c3d64 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:56.259398 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d4262225-819d-4f28-b79a-b6ee802c3d64 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:56.260378 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d4262225-819d-4f28-b79a-b6ee802c3d64 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:56.342076 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d4262225-819d-4f28-b79a-b6ee802c3d64 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:56.343170 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d4262225-819d-4f28-b79a-b6ee802c3d64 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:56.343410 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d4262225-819d-4f28-b79a-b6ee802c3d64 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:56.343887 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.objects.instance [None req-d4262225-819d-4f28-b79a-b6ee802c3d64 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lazy-loading 'fault' on Instance uuid db7ee8ad-13be-450c-b9a9-1da939dbc268 {{(pid=128802) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:52:56.589044 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-d4262225-819d-4f28-b79a-b6ee802c3d64 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac650232cc04810b1340dc2f0edadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b0670d1bd99424780a70e69d57a2166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:56.603253 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-d4262225-819d-4f28-b79a-b6ee802c3d64 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "GET /compute/v2.1/servers/db7ee8ad-13be-450c-b9a9-1da939dbc268" status: 200 len: 1305 microversion: 2.1 time: 0.370834 Oct 04 20:52:56.605728 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2047/4045] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:52:56 2022] GET /compute/v2.1/servers/db7ee8ad-13be-450c-b9a9-1da939dbc268 => generated 1305 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:52:56.670767 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ab717afb-678b-474b-94bc-4863cc8824b6 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:56.671688 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ab717afb-678b-474b-94bc-4863cc8824b6 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] [instance: 30eb289d-d09c-43fa-af8a-3c6ee303f0af] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:56.687089 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ab717afb-678b-474b-94bc-4863cc8824b6 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:56.687590 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ab717afb-678b-474b-94bc-4863cc8824b6 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:56.692526 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ab717afb-678b-474b-94bc-4863cc8824b6 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:56.693616 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ab717afb-678b-474b-94bc-4863cc8824b6 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:56.694289 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ab717afb-678b-474b-94bc-4863cc8824b6 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:56.694947 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ab717afb-678b-474b-94bc-4863cc8824b6 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:57.192930 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-ab717afb-678b-474b-94bc-4863cc8824b6 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c208ec9faf491385a9ab5b5932098d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ae4960393c464c97669731c2084d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:57.212883 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ab717afb-678b-474b-94bc-4863cc8824b6 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] 10.222.0.33 "GET /compute/v2.1/servers/30eb289d-d09c-43fa-af8a-3c6ee303f0af" status: 200 len: 1504 microversion: 2.1 time: 0.548011 Oct 04 20:52:57.213486 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 1999/4046] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:52:56 2022] GET /compute/v2.1/servers/30eb289d-d09c-43fa-af8a-3c6ee303f0af => generated 1504 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:52:57.630394 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-e4583669-4add-4698-ba2d-93af29cf01bc tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:57.631797 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-e4583669-4add-4698-ba2d-93af29cf01bc tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: db7ee8ad-13be-450c-b9a9-1da939dbc268] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:57.641971 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e4583669-4add-4698-ba2d-93af29cf01bc tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:57.642509 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e4583669-4add-4698-ba2d-93af29cf01bc tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:57.642956 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e4583669-4add-4698-ba2d-93af29cf01bc tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:57.643938 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e4583669-4add-4698-ba2d-93af29cf01bc tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:57.644144 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e4583669-4add-4698-ba2d-93af29cf01bc tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:57.644579 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e4583669-4add-4698-ba2d-93af29cf01bc tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:57.662611 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.wsgi [None req-e4583669-4add-4698-ba2d-93af29cf01bc tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] HTTP exception thrown: Instance db7ee8ad-13be-450c-b9a9-1da939dbc268 could not be found. Oct 04 20:52:57.664461 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-e4583669-4add-4698-ba2d-93af29cf01bc tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Request method failure captured: Oct 04 20:52:57.664461 n-d-854823-8 devstack@n-api.service[128802]: request: GET /compute/v2.1/servers/db7ee8ad-13be-450c-b9a9-1da939dbc268 HTTP/1.1 Oct 04 20:52:57.664461 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 20:52:57.664461 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 20:52:57.664461 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 20:52:57.664461 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 0 Oct 04 20:52:57.664461 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 20:52:57.664461 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 20:52:57.664461 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 20:52:57.664461 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 20:52:57.664461 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPJsfW5w9WW6HLdIS-vhuA3Aqgubdan3G4XN4Mz-kS5WBm_kV8MmkEfQ0VXyVBZGh_offIhP7k_7zeKcJerywXx22sbTVU7nn7Yk2TKQKkZk7TZieLYe5dW5fMpGMZVoLDxRDRs83mJz3B8SrRlYbnvScXHL2MTPSbeQInsaFtih26mQ Oct 04 20:52:57.664461 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 20:52:57.664461 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 20:52:57.664461 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 20:52:57.664461 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 20:52:57.664461 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 20:52:57.664461 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 20:52:57.664461 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: 8b0670d1bd99424780a70e69d57a2166 Oct 04 20:52:57.664461 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-ServerActionsTestJSON-1241178619 Oct 04 20:52:57.664461 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 20:52:57.664461 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 20:52:57.664461 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_8b0670d1bd99424780a70e69d57a2166", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8b0670d1bd99424780a70e69d57a2166"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8b0670d1bd99424780a70e69d57a2166"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/8b0670d1bd99424780a70e69d57a2166"}]}] Oct 04 20:52:57.664461 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-ServerActionsTestJSON-1241178619 Oct 04 20:52:57.664461 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: 8b0670d1bd99424780a70e69d57a2166 Oct 04 20:52:57.664461 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-ServerActionsTestJSON-1241178619 Oct 04 20:52:57.664461 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-ServerActionsTestJSON-1241178619-project Oct 04 20:52:57.664461 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 20:52:57.664461 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 20:52:57.664461 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: eac650232cc04810b1340dc2f0edadcc Oct 04 20:52:57.664461 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-ServerActionsTestJSON-1241178619-project Oct 04 20:52:57.664461 n-d-854823-8 devstack@n-api.service[128802]: method: > Oct 04 20:52:57.664461 n-d-854823-8 devstack@n-api.service[128802]: exception: Instance db7ee8ad-13be-450c-b9a9-1da939dbc268 could not be found. Oct 04 20:52:57.664461 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'id': 'db7ee8ad-13be-450c-b9a9-1da939dbc268'} Oct 04 20:52:57.664461 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:52:57.664461 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:52:57.664461 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:52:57.664461 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:52:57.664461 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:52:57.664461 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:52:57.664461 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:52:57.664461 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:52:57.664461 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:52:57.664461 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:52:57.664461 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db7ee8ad-13be-450c-b9a9-1da939dbc268 could not be found. Oct 04 20:52:57.664461 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:52:57.664461 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:52:57.664461 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:52:57.664461 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:52:57.664461 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:52:57.664461 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:52:57.664461 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:52:57.664461 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:52:57.664461 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:52:57.664461 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:52:57.664461 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:52:57.664461 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:52:57.664461 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:52:57.664461 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:52:57.664461 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:52:57.664461 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:52:57.664461 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db7ee8ad-13be-450c-b9a9-1da939dbc268 could not be found. Oct 04 20:52:57.664461 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:52:57.664461 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:52:57.664461 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:52:57.669145 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:52:57.669145 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:52:57.669145 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:52:57.669145 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:52:57.669145 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:52:57.669145 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db7ee8ad-13be-450c-b9a9-1da939dbc268 could not be found. Oct 04 20:52:57.669145 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:52:57.669145 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-e4583669-4add-4698-ba2d-93af29cf01bc tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Returning 404 to user: Instance db7ee8ad-13be-450c-b9a9-1da939dbc268 could not be found. {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:52:57.669145 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-e4583669-4add-4698-ba2d-93af29cf01bc tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "GET /compute/v2.1/servers/db7ee8ad-13be-450c-b9a9-1da939dbc268" status: 404 len: 111 microversion: 2.1 time: 0.040588 Oct 04 20:52:57.669145 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2048/4047] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:52:57 2022] GET /compute/v2.1/servers/db7ee8ad-13be-450c-b9a9-1da939dbc268 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:52:57.675819 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-359a09b3-6616-4ca4-9082-800e0d73ffc7 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:57.676230 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-359a09b3-6616-4ca4-9082-800e0d73ffc7 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: ac3f41f1-ed37-4009-81e5-7bee0ee6ea69] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:57.688774 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-359a09b3-6616-4ca4-9082-800e0d73ffc7 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:57.689704 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-359a09b3-6616-4ca4-9082-800e0d73ffc7 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:57.690317 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-359a09b3-6616-4ca4-9082-800e0d73ffc7 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:57.691263 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-359a09b3-6616-4ca4-9082-800e0d73ffc7 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:57.691871 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-359a09b3-6616-4ca4-9082-800e0d73ffc7 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:57.692438 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-359a09b3-6616-4ca4-9082-800e0d73ffc7 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:57.733294 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-359a09b3-6616-4ca4-9082-800e0d73ffc7 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: ac3f41f1-ed37-4009-81e5-7bee0ee6ea69] Going to try to terminate instance {{(pid=128801) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:52:57.880508 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-359a09b3-6616-4ca4-9082-800e0d73ffc7 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "DELETE /compute/v2.1/servers/ac3f41f1-ed37-4009-81e5-7bee0ee6ea69" status: 204 len: 0 microversion: 2.1 time: 0.208595 Oct 04 20:52:57.888486 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2000/4048] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 20:52:57 2022] DELETE /compute/v2.1/servers/ac3f41f1-ed37-4009-81e5-7bee0ee6ea69 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:52:57.895827 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-0507317a-636d-43e9-8cb6-3a7940b3c54b tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:57.896869 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-0507317a-636d-43e9-8cb6-3a7940b3c54b tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: ac3f41f1-ed37-4009-81e5-7bee0ee6ea69] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:57.909676 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0507317a-636d-43e9-8cb6-3a7940b3c54b tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:57.910568 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0507317a-636d-43e9-8cb6-3a7940b3c54b tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:57.914047 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0507317a-636d-43e9-8cb6-3a7940b3c54b tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:57.914970 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0507317a-636d-43e9-8cb6-3a7940b3c54b tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:57.915999 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0507317a-636d-43e9-8cb6-3a7940b3c54b tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:57.919554 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0507317a-636d-43e9-8cb6-3a7940b3c54b tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:58.243032 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0f3a8c61-82bd-461f-bd7d-1906304fe0b7 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:58.244199 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-0f3a8c61-82bd-461f-bd7d-1906304fe0b7 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] [instance: 30eb289d-d09c-43fa-af8a-3c6ee303f0af] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:58.267764 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0f3a8c61-82bd-461f-bd7d-1906304fe0b7 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:58.268793 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0f3a8c61-82bd-461f-bd7d-1906304fe0b7 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:58.270746 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0f3a8c61-82bd-461f-bd7d-1906304fe0b7 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:58.278012 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-0507317a-636d-43e9-8cb6-3a7940b3c54b tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac650232cc04810b1340dc2f0edadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b0670d1bd99424780a70e69d57a2166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:58.279087 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0f3a8c61-82bd-461f-bd7d-1906304fe0b7 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:58.280643 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0f3a8c61-82bd-461f-bd7d-1906304fe0b7 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:58.283235 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0f3a8c61-82bd-461f-bd7d-1906304fe0b7 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:58.291077 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-0507317a-636d-43e9-8cb6-3a7940b3c54b tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "GET /compute/v2.1/servers/ac3f41f1-ed37-4009-81e5-7bee0ee6ea69" status: 200 len: 1508 microversion: 2.1 time: 0.401264 Oct 04 20:52:58.309278 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2049/4049] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:52:57 2022] GET /compute/v2.1/servers/ac3f41f1-ed37-4009-81e5-7bee0ee6ea69 => generated 1508 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:52:58.477902 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-0f3a8c61-82bd-461f-bd7d-1906304fe0b7 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c208ec9faf491385a9ab5b5932098d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ae4960393c464c97669731c2084d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:58.492259 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-0f3a8c61-82bd-461f-bd7d-1906304fe0b7 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] 10.222.0.33 "GET /compute/v2.1/servers/30eb289d-d09c-43fa-af8a-3c6ee303f0af" status: 200 len: 1504 microversion: 2.1 time: 0.254993 Oct 04 20:52:58.509597 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2001/4050] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:52:58 2022] GET /compute/v2.1/servers/30eb289d-d09c-43fa-af8a-3c6ee303f0af => generated 1504 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:52:59.326330 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-c9260aaa-4b6f-40e7-b315-f451e5233cab tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:59.327831 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-c9260aaa-4b6f-40e7-b315-f451e5233cab tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: ac3f41f1-ed37-4009-81e5-7bee0ee6ea69] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:59.335269 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c9260aaa-4b6f-40e7-b315-f451e5233cab tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:59.335935 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c9260aaa-4b6f-40e7-b315-f451e5233cab tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:59.336528 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c9260aaa-4b6f-40e7-b315-f451e5233cab tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:59.337392 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c9260aaa-4b6f-40e7-b315-f451e5233cab tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:59.338025 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c9260aaa-4b6f-40e7-b315-f451e5233cab tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:59.338625 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c9260aaa-4b6f-40e7-b315-f451e5233cab tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:59.519289 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-656da119-d738-4f2c-b895-e11c27f3ca50 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:52:59.519906 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-656da119-d738-4f2c-b895-e11c27f3ca50 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] [instance: 30eb289d-d09c-43fa-af8a-3c6ee303f0af] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:52:59.536289 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-656da119-d738-4f2c-b895-e11c27f3ca50 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:59.536888 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-656da119-d738-4f2c-b895-e11c27f3ca50 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:59.537392 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-656da119-d738-4f2c-b895-e11c27f3ca50 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:59.538170 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-656da119-d738-4f2c-b895-e11c27f3ca50 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:52:59.538730 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-656da119-d738-4f2c-b895-e11c27f3ca50 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:52:59.539219 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-656da119-d738-4f2c-b895-e11c27f3ca50 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:52:59.579331 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:52:59.794168 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-c9260aaa-4b6f-40e7-b315-f451e5233cab tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac650232cc04810b1340dc2f0edadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b0670d1bd99424780a70e69d57a2166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:59.806573 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-c9260aaa-4b6f-40e7-b315-f451e5233cab tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "GET /compute/v2.1/servers/ac3f41f1-ed37-4009-81e5-7bee0ee6ea69" status: 200 len: 1508 microversion: 2.1 time: 0.493747 Oct 04 20:52:59.831683 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2050/4051] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:52:59 2022] GET /compute/v2.1/servers/ac3f41f1-ed37-4009-81e5-7bee0ee6ea69 => generated 1508 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:52:59.908567 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-656da119-d738-4f2c-b895-e11c27f3ca50 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c208ec9faf491385a9ab5b5932098d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ae4960393c464c97669731c2084d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:52:59.919739 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-656da119-d738-4f2c-b895-e11c27f3ca50 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] 10.222.0.33 "GET /compute/v2.1/servers/30eb289d-d09c-43fa-af8a-3c6ee303f0af" status: 200 len: 1504 microversion: 2.1 time: 0.404833 Oct 04 20:52:59.920670 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2002/4052] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:52:59 2022] GET /compute/v2.1/servers/30eb289d-d09c-43fa-af8a-3c6ee303f0af => generated 1504 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:53:00.425196 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-f3c3d6ae-a998-44da-bbd4-86902ae42eb8 req-7caf2f48-1dfa-4dc4-9f01-59e78aef96f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30eb289d-d09c-43fa-af8a-3c6ee303f0af", "name": "network-vif-unplugged", "status": "completed", "tag": "7649f0f4-69ee-4996-bb52-e4994b8aadae"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:53:00.444024 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=2 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:53:00.452850 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-f3c3d6ae-a998-44da-bbd4-86902ae42eb8 req-7caf2f48-1dfa-4dc4-9f01-59e78aef96f9 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:00.455471 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-f3c3d6ae-a998-44da-bbd4-86902ae42eb8 req-7caf2f48-1dfa-4dc4-9f01-59e78aef96f9 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:00.459530 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-f3c3d6ae-a998-44da-bbd4-86902ae42eb8 req-7caf2f48-1dfa-4dc4-9f01-59e78aef96f9 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:00.489890 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-f3c3d6ae-a998-44da-bbd4-86902ae42eb8 req-7caf2f48-1dfa-4dc4-9f01-59e78aef96f9 service nova] Creating event network-vif-unplugged:7649f0f4-69ee-4996-bb52-e4994b8aadae for instance 30eb289d-d09c-43fa-af8a-3c6ee303f0af on n-h2-854823-8 Oct 04 20:53:00.511037 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-f3c3d6ae-a998-44da-bbd4-86902ae42eb8 req-7caf2f48-1dfa-4dc4-9f01-59e78aef96f9 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.100008 Oct 04 20:53:00.513163 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2051/4053] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:53:00 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:53:00.837684 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-93282a5b-4c12-4ef0-a7ed-52d3d4e2067e tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:53:00.841186 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-93282a5b-4c12-4ef0-a7ed-52d3d4e2067e tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: ac3f41f1-ed37-4009-81e5-7bee0ee6ea69] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:53:00.865815 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-93282a5b-4c12-4ef0-a7ed-52d3d4e2067e tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:00.866553 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-93282a5b-4c12-4ef0-a7ed-52d3d4e2067e tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:00.867161 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-93282a5b-4c12-4ef0-a7ed-52d3d4e2067e tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:00.867972 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-93282a5b-4c12-4ef0-a7ed-52d3d4e2067e tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:00.869155 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-93282a5b-4c12-4ef0-a7ed-52d3d4e2067e tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:00.876730 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-93282a5b-4c12-4ef0-a7ed-52d3d4e2067e tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:00.945684 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-04503f80-1fe4-475f-b3e2-ec74dfe7fa1e tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:53:00.946485 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-04503f80-1fe4-475f-b3e2-ec74dfe7fa1e tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] [instance: 30eb289d-d09c-43fa-af8a-3c6ee303f0af] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:53:00.962697 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-04503f80-1fe4-475f-b3e2-ec74dfe7fa1e tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:00.963059 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-04503f80-1fe4-475f-b3e2-ec74dfe7fa1e tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:00.963501 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-04503f80-1fe4-475f-b3e2-ec74dfe7fa1e tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:00.964963 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-04503f80-1fe4-475f-b3e2-ec74dfe7fa1e tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:00.965435 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-04503f80-1fe4-475f-b3e2-ec74dfe7fa1e tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:00.965971 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-04503f80-1fe4-475f-b3e2-ec74dfe7fa1e tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:01.928958 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-93282a5b-4c12-4ef0-a7ed-52d3d4e2067e tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac650232cc04810b1340dc2f0edadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b0670d1bd99424780a70e69d57a2166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:53:01.937178 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-93282a5b-4c12-4ef0-a7ed-52d3d4e2067e tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "GET /compute/v2.1/servers/ac3f41f1-ed37-4009-81e5-7bee0ee6ea69" status: 200 len: 1508 microversion: 2.1 time: 1.110123 Oct 04 20:53:01.953654 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2003/4054] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:53:00 2022] GET /compute/v2.1/servers/ac3f41f1-ed37-4009-81e5-7bee0ee6ea69 => generated 1508 bytes in 1112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:53:02.451578 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-04503f80-1fe4-475f-b3e2-ec74dfe7fa1e tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c208ec9faf491385a9ab5b5932098d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ae4960393c464c97669731c2084d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:53:02.471264 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-04503f80-1fe4-475f-b3e2-ec74dfe7fa1e tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] 10.222.0.33 "GET /compute/v2.1/servers/30eb289d-d09c-43fa-af8a-3c6ee303f0af" status: 200 len: 1507 microversion: 2.1 time: 1.529556 Oct 04 20:53:02.472516 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2052/4055] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:53:00 2022] GET /compute/v2.1/servers/30eb289d-d09c-43fa-af8a-3c6ee303f0af => generated 1507 bytes in 1532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:53:02.496384 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5563898c-5409-470b-ad22-2e49655ae404 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:53:02.500770 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-5563898c-5409-470b-ad22-2e49655ae404 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] [instance: 30eb289d-d09c-43fa-af8a-3c6ee303f0af] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:53:02.525259 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5563898c-5409-470b-ad22-2e49655ae404 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:02.530734 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5563898c-5409-470b-ad22-2e49655ae404 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:02.532658 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5563898c-5409-470b-ad22-2e49655ae404 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:02.534431 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5563898c-5409-470b-ad22-2e49655ae404 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:02.539091 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5563898c-5409-470b-ad22-2e49655ae404 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:02.540765 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5563898c-5409-470b-ad22-2e49655ae404 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:02.612523 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-5563898c-5409-470b-ad22-2e49655ae404 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] [instance: 30eb289d-d09c-43fa-af8a-3c6ee303f0af] Going to try to terminate instance {{(pid=128801) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:53:02.630125 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.compute.api [None req-5563898c-5409-470b-ad22-2e49655ae404 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] [instance: 30eb289d-d09c-43fa-af8a-3c6ee303f0af] Working on deleting snapshot bcaa8d1c-523c-4403-9c58-1daec0749039 from shelved instance... Oct 04 20:53:02.962744 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-445bbb77-3832-4200-a489-e359a3f2be7c tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:53:02.963907 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-445bbb77-3832-4200-a489-e359a3f2be7c tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: ac3f41f1-ed37-4009-81e5-7bee0ee6ea69] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:53:02.977111 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-445bbb77-3832-4200-a489-e359a3f2be7c tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:02.983605 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-445bbb77-3832-4200-a489-e359a3f2be7c tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:02.984437 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-445bbb77-3832-4200-a489-e359a3f2be7c tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:02.985748 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-445bbb77-3832-4200-a489-e359a3f2be7c tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:02.986374 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-445bbb77-3832-4200-a489-e359a3f2be7c tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:02.987341 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-445bbb77-3832-4200-a489-e359a3f2be7c tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:03.420338 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-445bbb77-3832-4200-a489-e359a3f2be7c tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac650232cc04810b1340dc2f0edadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b0670d1bd99424780a70e69d57a2166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:53:03.433808 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-445bbb77-3832-4200-a489-e359a3f2be7c tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "GET /compute/v2.1/servers/ac3f41f1-ed37-4009-81e5-7bee0ee6ea69" status: 200 len: 1508 microversion: 2.1 time: 0.475674 Oct 04 20:53:03.438696 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2053/4056] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:53:02 2022] GET /compute/v2.1/servers/ac3f41f1-ed37-4009-81e5-7bee0ee6ea69 => generated 1508 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:53:03.690383 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-9b989abe-f96b-41f5-8c82-a66a3d92d582 req-c618ac0c-3e3c-4bdd-a4da-0c626206e809 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac3f41f1-ed37-4009-81e5-7bee0ee6ea69", "name": "network-vif-deleted", "tag": "7dd86b49-5d26-4611-8fba-a348ac16a87c"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:53:03.729581 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-9b989abe-f96b-41f5-8c82-a66a3d92d582 req-c618ac0c-3e3c-4bdd-a4da-0c626206e809 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:03.730445 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-9b989abe-f96b-41f5-8c82-a66a3d92d582 req-c618ac0c-3e3c-4bdd-a4da-0c626206e809 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:03.731118 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-9b989abe-f96b-41f5-8c82-a66a3d92d582 req-c618ac0c-3e3c-4bdd-a4da-0c626206e809 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:03.751174 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-9b989abe-f96b-41f5-8c82-a66a3d92d582 req-c618ac0c-3e3c-4bdd-a4da-0c626206e809 service nova] Creating event network-vif-deleted:7dd86b49-5d26-4611-8fba-a348ac16a87c for instance ac3f41f1-ed37-4009-81e5-7bee0ee6ea69 on n-h2-854823-8 Oct 04 20:53:03.761728 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-9b989abe-f96b-41f5-8c82-a66a3d92d582 req-c618ac0c-3e3c-4bdd-a4da-0c626206e809 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073579 Oct 04 20:53:03.763171 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2054/4057] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:53:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:53:04.210316 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-5563898c-5409-470b-ad22-2e49655ae404 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] [instance: 30eb289d-d09c-43fa-af8a-3c6ee303f0af] Doing local delete in cell 189ff13b-7538-4a71-a71c-1e7f1d3e1b46(cell1) {{(pid=128801) _delete /opt/stack/nova/nova/compute/api.py:2546}} Oct 04 20:53:04.213651 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5563898c-5409-470b-ad22-2e49655ae404 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:04.215362 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5563898c-5409-470b-ad22-2e49655ae404 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:04.216823 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5563898c-5409-470b-ad22-2e49655ae404 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:04.217981 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.compute.api [None req-5563898c-5409-470b-ad22-2e49655ae404 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] [instance: 30eb289d-d09c-43fa-af8a-3c6ee303f0af] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Oct 04 20:53:04.230524 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.network.neutron [None req-5563898c-5409-470b-ad22-2e49655ae404 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] [instance: 30eb289d-d09c-43fa-af8a-3c6ee303f0af] deallocate_for_instance() {{(pid=128801) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1780}} Oct 04 20:53:04.476225 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-94842adf-7990-4f18-90a3-4872651d5518 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:53:04.482901 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-94842adf-7990-4f18-90a3-4872651d5518 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: ac3f41f1-ed37-4009-81e5-7bee0ee6ea69] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:53:04.503319 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-94842adf-7990-4f18-90a3-4872651d5518 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:04.504326 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-94842adf-7990-4f18-90a3-4872651d5518 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:04.505469 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-94842adf-7990-4f18-90a3-4872651d5518 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:04.506531 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-94842adf-7990-4f18-90a3-4872651d5518 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:04.507345 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-94842adf-7990-4f18-90a3-4872651d5518 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:04.508353 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-94842adf-7990-4f18-90a3-4872651d5518 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:04.552919 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-94842adf-7990-4f18-90a3-4872651d5518 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:04.553875 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-94842adf-7990-4f18-90a3-4872651d5518 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:04.554490 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-94842adf-7990-4f18-90a3-4872651d5518 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:04.555415 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.objects.instance [None req-94842adf-7990-4f18-90a3-4872651d5518 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lazy-loading 'fault' on Instance uuid ac3f41f1-ed37-4009-81e5-7bee0ee6ea69 {{(pid=128802) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:53:04.682437 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-94842adf-7990-4f18-90a3-4872651d5518 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac650232cc04810b1340dc2f0edadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b0670d1bd99424780a70e69d57a2166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:53:04.729564 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-94842adf-7990-4f18-90a3-4872651d5518 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "GET /compute/v2.1/servers/ac3f41f1-ed37-4009-81e5-7bee0ee6ea69" status: 200 len: 1304 microversion: 2.1 time: 0.271844 Oct 04 20:53:04.730729 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2055/4058] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:53:04 2022] GET /compute/v2.1/servers/ac3f41f1-ed37-4009-81e5-7bee0ee6ea69 => generated 1304 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:53:05.759452 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-3552b194-d183-4f5a-bc04-a3e8d39db219 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:53:05.760256 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-3552b194-d183-4f5a-bc04-a3e8d39db219 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: ac3f41f1-ed37-4009-81e5-7bee0ee6ea69] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:53:05.775645 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3552b194-d183-4f5a-bc04-a3e8d39db219 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:05.776118 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3552b194-d183-4f5a-bc04-a3e8d39db219 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:05.776597 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3552b194-d183-4f5a-bc04-a3e8d39db219 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:05.781773 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3552b194-d183-4f5a-bc04-a3e8d39db219 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:05.782275 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3552b194-d183-4f5a-bc04-a3e8d39db219 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:05.782767 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3552b194-d183-4f5a-bc04-a3e8d39db219 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:05.819136 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.wsgi [None req-3552b194-d183-4f5a-bc04-a3e8d39db219 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] HTTP exception thrown: Instance ac3f41f1-ed37-4009-81e5-7bee0ee6ea69 could not be found. Oct 04 20:53:05.837160 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-3552b194-d183-4f5a-bc04-a3e8d39db219 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Request method failure captured: Oct 04 20:53:05.837160 n-d-854823-8 devstack@n-api.service[128802]: request: GET /compute/v2.1/servers/ac3f41f1-ed37-4009-81e5-7bee0ee6ea69 HTTP/1.1 Oct 04 20:53:05.837160 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 20:53:05.837160 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 20:53:05.837160 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 20:53:05.837160 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 0 Oct 04 20:53:05.837160 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 20:53:05.837160 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 20:53:05.837160 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 20:53:05.837160 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 20:53:05.837160 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPJsfW5w9WW6HLdIS-vhuA3Aqgubdan3G4XN4Mz-kS5WBm_kV8MmkEfQ0VXyVBZGh_offIhP7k_7zeKcJerywXx22sbTVU7nn7Yk2TKQKkZk7TZieLYe5dW5fMpGMZVoLDxRDRs83mJz3B8SrRlYbnvScXHL2MTPSbeQInsaFtih26mQ Oct 04 20:53:05.837160 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 20:53:05.837160 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 20:53:05.837160 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 20:53:05.837160 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 20:53:05.837160 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 20:53:05.837160 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 20:53:05.837160 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: 8b0670d1bd99424780a70e69d57a2166 Oct 04 20:53:05.837160 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-ServerActionsTestJSON-1241178619 Oct 04 20:53:05.837160 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 20:53:05.837160 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 20:53:05.837160 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_8b0670d1bd99424780a70e69d57a2166", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8b0670d1bd99424780a70e69d57a2166"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8b0670d1bd99424780a70e69d57a2166"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/8b0670d1bd99424780a70e69d57a2166"}]}] Oct 04 20:53:05.837160 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-ServerActionsTestJSON-1241178619 Oct 04 20:53:05.837160 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: 8b0670d1bd99424780a70e69d57a2166 Oct 04 20:53:05.837160 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-ServerActionsTestJSON-1241178619 Oct 04 20:53:05.837160 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-ServerActionsTestJSON-1241178619-project Oct 04 20:53:05.837160 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 20:53:05.837160 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 20:53:05.837160 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: eac650232cc04810b1340dc2f0edadcc Oct 04 20:53:05.837160 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-ServerActionsTestJSON-1241178619-project Oct 04 20:53:05.837160 n-d-854823-8 devstack@n-api.service[128802]: method: > Oct 04 20:53:05.837160 n-d-854823-8 devstack@n-api.service[128802]: exception: Instance ac3f41f1-ed37-4009-81e5-7bee0ee6ea69 could not be found. Oct 04 20:53:05.837160 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'id': 'ac3f41f1-ed37-4009-81e5-7bee0ee6ea69'} Oct 04 20:53:05.837160 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:53:05.837160 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:53:05.837160 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:53:05.837160 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:53:05.837160 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:53:05.837160 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:53:05.837160 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:53:05.837160 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:53:05.837160 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:53:05.837160 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:53:05.837160 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac3f41f1-ed37-4009-81e5-7bee0ee6ea69 could not be found. Oct 04 20:53:05.837160 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:53:05.837160 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:53:05.837160 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:53:05.837160 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:53:05.837160 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:53:05.837160 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:53:05.837160 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:53:05.837160 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:53:05.837160 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:53:05.837160 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:53:05.837160 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:53:05.837160 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:53:05.837160 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:53:05.837160 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:53:05.837160 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:53:05.837160 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:53:05.837160 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac3f41f1-ed37-4009-81e5-7bee0ee6ea69 could not be found. Oct 04 20:53:05.837160 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:53:05.837160 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:53:05.837160 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:53:05.841821 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:53:05.841821 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:53:05.841821 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:53:05.841821 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:53:05.841821 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:53:05.841821 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac3f41f1-ed37-4009-81e5-7bee0ee6ea69 could not be found. Oct 04 20:53:05.841821 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:53:05.841821 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-3552b194-d183-4f5a-bc04-a3e8d39db219 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Returning 404 to user: Instance ac3f41f1-ed37-4009-81e5-7bee0ee6ea69 could not be found. {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:53:05.841821 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-3552b194-d183-4f5a-bc04-a3e8d39db219 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "GET /compute/v2.1/servers/ac3f41f1-ed37-4009-81e5-7bee0ee6ea69" status: 404 len: 111 microversion: 2.1 time: 0.084305 Oct 04 20:53:05.851313 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2056/4059] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:53:05 2022] GET /compute/v2.1/servers/ac3f41f1-ed37-4009-81e5-7bee0ee6ea69 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:53:05.859005 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.network.neutron [None req-5563898c-5409-470b-ad22-2e49655ae404 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] [instance: 30eb289d-d09c-43fa-af8a-3c6ee303f0af] Updating instance_info_cache with network_info: [] {{(pid=128801) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 04 20:53:05.869561 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-88a41a23-7513-4b4c-96b1-5494be047a50 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:53:05.870070 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-88a41a23-7513-4b4c-96b1-5494be047a50 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: fde3f6fc-61e1-4b21-8b91-e95c2db3d48c] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:53:05.900046 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-88a41a23-7513-4b4c-96b1-5494be047a50 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:05.903822 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-88a41a23-7513-4b4c-96b1-5494be047a50 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:05.905762 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-88a41a23-7513-4b4c-96b1-5494be047a50 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:05.906563 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-88a41a23-7513-4b4c-96b1-5494be047a50 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:05.907042 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-88a41a23-7513-4b4c-96b1-5494be047a50 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:05.907473 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-88a41a23-7513-4b4c-96b1-5494be047a50 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:05.996820 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-88a41a23-7513-4b4c-96b1-5494be047a50 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: fde3f6fc-61e1-4b21-8b91-e95c2db3d48c] Going to try to terminate instance {{(pid=128802) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:53:06.248965 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-88a41a23-7513-4b4c-96b1-5494be047a50 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "DELETE /compute/v2.1/servers/fde3f6fc-61e1-4b21-8b91-e95c2db3d48c" status: 204 len: 0 microversion: 2.1 time: 0.393965 Oct 04 20:53:06.251878 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2057/4060] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 20:53:05 2022] DELETE /compute/v2.1/servers/fde3f6fc-61e1-4b21-8b91-e95c2db3d48c => generated 0 bytes in 400 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:53:06.278889 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-c12580e3-1c02-4ce5-949c-a42f8415418e req-f49ac21f-0d8f-456b-bd1d-5a3304aeaada service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30eb289d-d09c-43fa-af8a-3c6ee303f0af", "name": "network-vif-deleted", "tag": "7649f0f4-69ee-4996-bb52-e4994b8aadae"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:53:06.292040 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-c12580e3-1c02-4ce5-949c-a42f8415418e req-f49ac21f-0d8f-456b-bd1d-5a3304aeaada service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:06.293306 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-c12580e3-1c02-4ce5-949c-a42f8415418e req-f49ac21f-0d8f-456b-bd1d-5a3304aeaada service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:06.293882 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-c12580e3-1c02-4ce5-949c-a42f8415418e req-f49ac21f-0d8f-456b-bd1d-5a3304aeaada service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:06.313023 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.compute.server_external_events [req-c12580e3-1c02-4ce5-949c-a42f8415418e req-f49ac21f-0d8f-456b-bd1d-5a3304aeaada service nova] Unable to find a host for instance 30eb289d-d09c-43fa-af8a-3c6ee303f0af. Dropping event network-vif-deleted {{(pid=128802) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 04 20:53:06.314168 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-c12580e3-1c02-4ce5-949c-a42f8415418e req-f49ac21f-0d8f-456b-bd1d-5a3304aeaada service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.059539 Oct 04 20:53:06.315541 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2058/4061] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:53:06 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 62 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 04 20:53:06.321054 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-dbc0345a-27fc-4165-8c61-9fb1114ec456 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:53:06.322229 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-dbc0345a-27fc-4165-8c61-9fb1114ec456 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: fde3f6fc-61e1-4b21-8b91-e95c2db3d48c] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:53:06.329904 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dbc0345a-27fc-4165-8c61-9fb1114ec456 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:06.330875 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dbc0345a-27fc-4165-8c61-9fb1114ec456 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:06.332171 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dbc0345a-27fc-4165-8c61-9fb1114ec456 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:06.333055 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dbc0345a-27fc-4165-8c61-9fb1114ec456 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:06.333668 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dbc0345a-27fc-4165-8c61-9fb1114ec456 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:06.334266 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dbc0345a-27fc-4165-8c61-9fb1114ec456 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:06.367013 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5563898c-5409-470b-ad22-2e49655ae404 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] 10.222.0.33 "DELETE /compute/v2.1/servers/30eb289d-d09c-43fa-af8a-3c6ee303f0af" status: 204 len: 0 microversion: 2.1 time: 3.876100 Oct 04 20:53:06.367623 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2004/4062] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 20:53:02 2022] DELETE /compute/v2.1/servers/30eb289d-d09c-43fa-af8a-3c6ee303f0af => generated 0 bytes in 3877 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:53:06.387876 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b64e70bc-0be6-42f1-b067-d1f2dcff2963 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:53:06.395822 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b64e70bc-0be6-42f1-b067-d1f2dcff2963 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] [instance: 30eb289d-d09c-43fa-af8a-3c6ee303f0af] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:53:06.405295 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b64e70bc-0be6-42f1-b067-d1f2dcff2963 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:06.406243 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b64e70bc-0be6-42f1-b067-d1f2dcff2963 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:06.414768 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b64e70bc-0be6-42f1-b067-d1f2dcff2963 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:06.416738 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b64e70bc-0be6-42f1-b067-d1f2dcff2963 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:06.418413 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b64e70bc-0be6-42f1-b067-d1f2dcff2963 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:06.419079 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b64e70bc-0be6-42f1-b067-d1f2dcff2963 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:06.440742 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-b64e70bc-0be6-42f1-b067-d1f2dcff2963 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] HTTP exception thrown: Instance 30eb289d-d09c-43fa-af8a-3c6ee303f0af could not be found. Oct 04 20:53:06.443156 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b64e70bc-0be6-42f1-b067-d1f2dcff2963 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Request method failure captured: Oct 04 20:53:06.443156 n-d-854823-8 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/30eb289d-d09c-43fa-af8a-3c6ee303f0af HTTP/1.1 Oct 04 20:53:06.443156 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:53:06.443156 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:53:06.443156 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:53:06.443156 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 0 Oct 04 20:53:06.443156 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:53:06.443156 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:53:06.443156 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:53:06.443156 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:53:06.443156 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJxSZfevtBVnbE8xQF7FYm_FMbZNMYv-b1P0ldR6C6mOlBxOPHbcbefhyrqwXR1yI98_OYaoilQwhW17vvL2mv1TUMfEjVB0p9Z8xi6fxjKTzjqbSmmUYZRpw0KKdt3nuXH8mFLFoxIXJdxlVC2R9xsCLdqsVxY0fb8-x4eIUN27OLA Oct 04 20:53:06.443156 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:53:06.443156 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:53:06.443156 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:53:06.443156 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:53:06.443156 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:53:06.443156 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:53:06.443156 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: 82ae4960393c464c97669731c2084d0f Oct 04 20:53:06.443156 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-DeleteServersTestJSON-364705212 Oct 04 20:53:06.443156 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 20:53:06.443156 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 20:53:06.443156 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_82ae4960393c464c97669731c2084d0f", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/82ae4960393c464c97669731c2084d0f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/82ae4960393c464c97669731c2084d0f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/82ae4960393c464c97669731c2084d0f"}]}] Oct 04 20:53:06.443156 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-DeleteServersTestJSON-364705212 Oct 04 20:53:06.443156 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: 82ae4960393c464c97669731c2084d0f Oct 04 20:53:06.443156 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-DeleteServersTestJSON-364705212 Oct 04 20:53:06.443156 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-DeleteServersTestJSON-364705212-project Oct 04 20:53:06.443156 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:53:06.443156 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:53:06.443156 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: e2c208ec9faf491385a9ab5b5932098d Oct 04 20:53:06.443156 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-DeleteServersTestJSON-364705212-project Oct 04 20:53:06.443156 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 20:53:06.443156 n-d-854823-8 devstack@n-api.service[128801]: exception: Instance 30eb289d-d09c-43fa-af8a-3c6ee303f0af could not be found. Oct 04 20:53:06.443156 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': '30eb289d-d09c-43fa-af8a-3c6ee303f0af'} Oct 04 20:53:06.443156 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:53:06.443156 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:53:06.443156 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:53:06.443156 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:53:06.443156 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:53:06.443156 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:53:06.443156 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:53:06.443156 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:53:06.443156 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:53:06.443156 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:53:06.443156 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 30eb289d-d09c-43fa-af8a-3c6ee303f0af could not be found. Oct 04 20:53:06.443156 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:53:06.443156 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:53:06.443156 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:53:06.443156 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:53:06.443156 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:53:06.443156 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:53:06.443156 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:53:06.443156 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:53:06.443156 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:53:06.443156 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:53:06.443156 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:53:06.443156 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:53:06.443156 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:53:06.443156 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:53:06.443156 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:53:06.443156 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:53:06.443156 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 30eb289d-d09c-43fa-af8a-3c6ee303f0af could not be found. Oct 04 20:53:06.443156 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:53:06.443156 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:53:06.443156 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:53:06.447752 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:53:06.447752 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:53:06.447752 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:53:06.447752 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:53:06.447752 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:53:06.447752 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 30eb289d-d09c-43fa-af8a-3c6ee303f0af could not be found. Oct 04 20:53:06.447752 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:53:06.449750 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b64e70bc-0be6-42f1-b067-d1f2dcff2963 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Returning 404 to user: Instance 30eb289d-d09c-43fa-af8a-3c6ee303f0af could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:53:06.451044 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b64e70bc-0be6-42f1-b067-d1f2dcff2963 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] 10.222.0.33 "GET /compute/v2.1/servers/30eb289d-d09c-43fa-af8a-3c6ee303f0af" status: 404 len: 111 microversion: 2.1 time: 0.068674 Oct 04 20:53:06.452226 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2005/4063] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:53:06 2022] GET /compute/v2.1/servers/30eb289d-d09c-43fa-af8a-3c6ee303f0af => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:53:06.706863 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-35bea16e-6021-4196-b958-1aed9f8c2116 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1801885729", "imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63", "flavorRef": "452", "networks": [{"uuid": "9dbf9434-4e8d-415e-bc95-1f3c19f28f1d"}]}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:53:06.824432 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.network.neutron [None req-35bea16e-6021-4196-b958-1aed9f8c2116 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] validate_networks() for [('9dbf9434-4e8d-415e-bc95-1f3c19f28f1d', None, None, None, None, None)] {{(pid=128801) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:53:07.210934 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-dbc0345a-27fc-4165-8c61-9fb1114ec456 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac650232cc04810b1340dc2f0edadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b0670d1bd99424780a70e69d57a2166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:53:07.236720 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-dbc0345a-27fc-4165-8c61-9fb1114ec456 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "GET /compute/v2.1/servers/fde3f6fc-61e1-4b21-8b91-e95c2db3d48c" status: 200 len: 1496 microversion: 2.1 time: 0.919876 Oct 04 20:53:07.239728 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2059/4064] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:53:06 2022] GET /compute/v2.1/servers/fde3f6fc-61e1-4b21-8b91-e95c2db3d48c => generated 1496 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:53:08.267565 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-5a6d1df7-cc9d-4e07-8207-55dd46687865 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:53:08.268353 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-5a6d1df7-cc9d-4e07-8207-55dd46687865 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: fde3f6fc-61e1-4b21-8b91-e95c2db3d48c] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:53:08.290914 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5a6d1df7-cc9d-4e07-8207-55dd46687865 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:08.291621 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5a6d1df7-cc9d-4e07-8207-55dd46687865 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:08.292571 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5a6d1df7-cc9d-4e07-8207-55dd46687865 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:08.294186 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5a6d1df7-cc9d-4e07-8207-55dd46687865 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:08.302935 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5a6d1df7-cc9d-4e07-8207-55dd46687865 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:08.303685 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5a6d1df7-cc9d-4e07-8207-55dd46687865 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:08.592378 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-5a6d1df7-cc9d-4e07-8207-55dd46687865 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac650232cc04810b1340dc2f0edadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b0670d1bd99424780a70e69d57a2166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:53:08.607492 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-5a6d1df7-cc9d-4e07-8207-55dd46687865 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "GET /compute/v2.1/servers/fde3f6fc-61e1-4b21-8b91-e95c2db3d48c" status: 200 len: 1454 microversion: 2.1 time: 0.347844 Oct 04 20:53:08.628141 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2060/4065] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:53:08 2022] GET /compute/v2.1/servers/fde3f6fc-61e1-4b21-8b91-e95c2db3d48c => generated 1454 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:53:08.641277 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-35bea16e-6021-4196-b958-1aed9f8c2116 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Flavor limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:53:08.641941 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-35bea16e-6021-4196-b958-1aed9f8c2116 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Image limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:53:08.642574 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-35bea16e-6021-4196-b958-1aed9f8c2116 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Flavor pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:53:08.644597 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-35bea16e-6021-4196-b958-1aed9f8c2116 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Image pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:53:08.645842 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-35bea16e-6021-4196-b958-1aed9f8c2116 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:53:08.698068 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-35bea16e-6021-4196-b958-1aed9f8c2116 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:08.701223 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-35bea16e-6021-4196-b958-1aed9f8c2116 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:08.704527 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-35bea16e-6021-4196-b958-1aed9f8c2116 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:08.705941 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-35bea16e-6021-4196-b958-1aed9f8c2116 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:08.708169 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-35bea16e-6021-4196-b958-1aed9f8c2116 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:08.708899 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-35bea16e-6021-4196-b958-1aed9f8c2116 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:08.776186 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-35bea16e-6021-4196-b958-1aed9f8c2116 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Getting quotas for project 82ae4960393c464c97669731c2084d0f. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:53:08.788563 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-35bea16e-6021-4196-b958-1aed9f8c2116 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Getting quotas for user e2c208ec9faf491385a9ab5b5932098d and project 82ae4960393c464c97669731c2084d0f. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:53:08.796704 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-e0724e01-5e96-4e5b-b420-fdf8b4f32894 req-12df1274-72f0-4870-92eb-221e541289b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fde3f6fc-61e1-4b21-8b91-e95c2db3d48c", "name": "network-vif-deleted", "tag": "ecd76bad-a328-479e-bee1-f8412f546d83"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:53:08.827748 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-e0724e01-5e96-4e5b-b420-fdf8b4f32894 req-12df1274-72f0-4870-92eb-221e541289b4 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:08.837722 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-35bea16e-6021-4196-b958-1aed9f8c2116 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Going to run 1 instances... {{(pid=128801) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:53:08.842015 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-e0724e01-5e96-4e5b-b420-fdf8b4f32894 req-12df1274-72f0-4870-92eb-221e541289b4 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:08.843681 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-e0724e01-5e96-4e5b-b420-fdf8b4f32894 req-12df1274-72f0-4870-92eb-221e541289b4 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:08.845847 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-35bea16e-6021-4196-b958-1aed9f8c2116 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] [instance: 9630289d-dcfd-4250-8910-a060f8696292] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='15b24725-0c99-4bcf-b1fb-907cdf8e2d63',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128801) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:53:08.867495 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-e0724e01-5e96-4e5b-b420-fdf8b4f32894 req-12df1274-72f0-4870-92eb-221e541289b4 service nova] Creating event network-vif-deleted:ecd76bad-a328-479e-bee1-f8412f546d83 for instance fde3f6fc-61e1-4b21-8b91-e95c2db3d48c on n-h2-854823-8 Oct 04 20:53:08.877029 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-e0724e01-5e96-4e5b-b420-fdf8b4f32894 req-12df1274-72f0-4870-92eb-221e541289b4 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109808 Oct 04 20:53:08.878326 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2061/4066] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:53:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:53:08.973712 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-35bea16e-6021-4196-b958-1aed9f8c2116 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.276840 Oct 04 20:53:08.985600 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2006/4067] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 20:53:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 2289 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 20:53:09.004105 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-9973b617-527d-4612-875d-b3edae8f201f tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:53:09.005216 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-9973b617-527d-4612-875d-b3edae8f201f tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] [instance: 9630289d-dcfd-4250-8910-a060f8696292] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:53:09.424772 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-9973b617-527d-4612-875d-b3edae8f201f tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c208ec9faf491385a9ab5b5932098d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ae4960393c464c97669731c2084d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:53:09.454625 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-9973b617-527d-4612-875d-b3edae8f201f tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] 10.222.0.33 "GET /compute/v2.1/servers/9630289d-dcfd-4250-8910-a060f8696292" status: 200 len: 1215 microversion: 2.1 time: 0.455411 Oct 04 20:53:09.466435 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2062/4068] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:53:08 2022] GET /compute/v2.1/servers/9630289d-dcfd-4250-8910-a060f8696292 => generated 1215 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:53:09.635420 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ad215633-79b3-48ea-ac58-5b6416c6471a tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:53:09.636978 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ad215633-79b3-48ea-ac58-5b6416c6471a tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: fde3f6fc-61e1-4b21-8b91-e95c2db3d48c] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:53:09.648318 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ad215633-79b3-48ea-ac58-5b6416c6471a tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:09.651999 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ad215633-79b3-48ea-ac58-5b6416c6471a tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:09.653541 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ad215633-79b3-48ea-ac58-5b6416c6471a tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:09.656102 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ad215633-79b3-48ea-ac58-5b6416c6471a tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:09.656989 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ad215633-79b3-48ea-ac58-5b6416c6471a tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:09.659207 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ad215633-79b3-48ea-ac58-5b6416c6471a tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:09.766285 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ad215633-79b3-48ea-ac58-5b6416c6471a tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:09.766954 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ad215633-79b3-48ea-ac58-5b6416c6471a tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:09.767648 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ad215633-79b3-48ea-ac58-5b6416c6471a tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:09.768328 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-ad215633-79b3-48ea-ac58-5b6416c6471a tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lazy-loading 'fault' on Instance uuid fde3f6fc-61e1-4b21-8b91-e95c2db3d48c {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:53:09.863350 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-ad215633-79b3-48ea-ac58-5b6416c6471a tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac650232cc04810b1340dc2f0edadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b0670d1bd99424780a70e69d57a2166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:53:09.876593 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ad215633-79b3-48ea-ac58-5b6416c6471a tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "GET /compute/v2.1/servers/fde3f6fc-61e1-4b21-8b91-e95c2db3d48c" status: 200 len: 1305 microversion: 2.1 time: 0.245455 Oct 04 20:53:09.882045 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2007/4069] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:53:09 2022] GET /compute/v2.1/servers/fde3f6fc-61e1-4b21-8b91-e95c2db3d48c => generated 1305 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:53:10.481815 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-c130d100-55e3-4ac1-86fe-843abafee440 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:53:10.483645 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-c130d100-55e3-4ac1-86fe-843abafee440 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] [instance: 9630289d-dcfd-4250-8910-a060f8696292] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:53:10.508224 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c130d100-55e3-4ac1-86fe-843abafee440 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:10.508935 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c130d100-55e3-4ac1-86fe-843abafee440 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:10.511173 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c130d100-55e3-4ac1-86fe-843abafee440 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:10.513425 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c130d100-55e3-4ac1-86fe-843abafee440 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:10.514454 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c130d100-55e3-4ac1-86fe-843abafee440 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:10.515174 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c130d100-55e3-4ac1-86fe-843abafee440 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:10.668746 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-c130d100-55e3-4ac1-86fe-843abafee440 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c208ec9faf491385a9ab5b5932098d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ae4960393c464c97669731c2084d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:53:10.683145 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-c130d100-55e3-4ac1-86fe-843abafee440 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] 10.222.0.33 "GET /compute/v2.1/servers/9630289d-dcfd-4250-8910-a060f8696292" status: 200 len: 1267 microversion: 2.1 time: 0.205667 Oct 04 20:53:10.685315 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2063/4070] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:53:10 2022] GET /compute/v2.1/servers/9630289d-dcfd-4250-8910-a060f8696292 => generated 1267 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:53:10.908710 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e0d82456-7ff2-4507-9369-0ced81dc47e3 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:53:10.910044 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e0d82456-7ff2-4507-9369-0ced81dc47e3 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: fde3f6fc-61e1-4b21-8b91-e95c2db3d48c] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:53:10.920907 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e0d82456-7ff2-4507-9369-0ced81dc47e3 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:10.921636 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e0d82456-7ff2-4507-9369-0ced81dc47e3 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:10.923879 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e0d82456-7ff2-4507-9369-0ced81dc47e3 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:10.924794 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e0d82456-7ff2-4507-9369-0ced81dc47e3 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:10.930467 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e0d82456-7ff2-4507-9369-0ced81dc47e3 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:10.931115 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e0d82456-7ff2-4507-9369-0ced81dc47e3 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:10.974323 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-e0d82456-7ff2-4507-9369-0ced81dc47e3 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] HTTP exception thrown: Instance fde3f6fc-61e1-4b21-8b91-e95c2db3d48c could not be found. Oct 04 20:53:10.976135 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e0d82456-7ff2-4507-9369-0ced81dc47e3 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Request method failure captured: Oct 04 20:53:10.976135 n-d-854823-8 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/fde3f6fc-61e1-4b21-8b91-e95c2db3d48c HTTP/1.1 Oct 04 20:53:10.976135 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:53:10.976135 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:53:10.976135 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:53:10.976135 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 0 Oct 04 20:53:10.976135 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:53:10.976135 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:53:10.976135 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:53:10.976135 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:53:10.976135 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJsfW5w9WW6HLdIS-vhuA3Aqgubdan3G4XN4Mz-kS5WBm_kV8MmkEfQ0VXyVBZGh_offIhP7k_7zeKcJerywXx22sbTVU7nn7Yk2TKQKkZk7TZieLYe5dW5fMpGMZVoLDxRDRs83mJz3B8SrRlYbnvScXHL2MTPSbeQInsaFtih26mQ Oct 04 20:53:10.976135 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:53:10.976135 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:53:10.976135 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:53:10.976135 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:53:10.976135 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:53:10.976135 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:53:10.976135 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: 8b0670d1bd99424780a70e69d57a2166 Oct 04 20:53:10.976135 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-ServerActionsTestJSON-1241178619 Oct 04 20:53:10.976135 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 20:53:10.976135 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 20:53:10.976135 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_8b0670d1bd99424780a70e69d57a2166", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8b0670d1bd99424780a70e69d57a2166"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8b0670d1bd99424780a70e69d57a2166"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/8b0670d1bd99424780a70e69d57a2166"}]}] Oct 04 20:53:10.976135 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-ServerActionsTestJSON-1241178619 Oct 04 20:53:10.976135 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: 8b0670d1bd99424780a70e69d57a2166 Oct 04 20:53:10.976135 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ServerActionsTestJSON-1241178619 Oct 04 20:53:10.976135 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-ServerActionsTestJSON-1241178619-project Oct 04 20:53:10.976135 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:53:10.976135 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:53:10.976135 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: eac650232cc04810b1340dc2f0edadcc Oct 04 20:53:10.976135 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-ServerActionsTestJSON-1241178619-project Oct 04 20:53:10.976135 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 20:53:10.976135 n-d-854823-8 devstack@n-api.service[128801]: exception: Instance fde3f6fc-61e1-4b21-8b91-e95c2db3d48c could not be found. Oct 04 20:53:10.976135 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': 'fde3f6fc-61e1-4b21-8b91-e95c2db3d48c'} Oct 04 20:53:10.976135 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:53:10.976135 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:53:10.976135 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:53:10.976135 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:53:10.976135 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:53:10.976135 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:53:10.976135 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:53:10.976135 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:53:10.976135 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:53:10.976135 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:53:10.976135 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fde3f6fc-61e1-4b21-8b91-e95c2db3d48c could not be found. Oct 04 20:53:10.976135 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:53:10.976135 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:53:10.976135 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:53:10.976135 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:53:10.976135 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:53:10.976135 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:53:10.976135 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:53:10.976135 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:53:10.976135 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:53:10.976135 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:53:10.976135 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:53:10.976135 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:53:10.976135 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:53:10.976135 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:53:10.976135 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:53:10.976135 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:53:10.976135 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fde3f6fc-61e1-4b21-8b91-e95c2db3d48c could not be found. Oct 04 20:53:10.976135 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:53:10.976135 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:53:10.976135 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:53:10.980370 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:53:10.980370 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:53:10.980370 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:53:10.980370 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:53:10.980370 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:53:10.980370 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fde3f6fc-61e1-4b21-8b91-e95c2db3d48c could not be found. Oct 04 20:53:10.980370 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:53:10.980370 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e0d82456-7ff2-4507-9369-0ced81dc47e3 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Returning 404 to user: Instance fde3f6fc-61e1-4b21-8b91-e95c2db3d48c could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:53:10.980370 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e0d82456-7ff2-4507-9369-0ced81dc47e3 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "GET /compute/v2.1/servers/fde3f6fc-61e1-4b21-8b91-e95c2db3d48c" status: 404 len: 111 microversion: 2.1 time: 0.072787 Oct 04 20:53:10.982454 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2008/4071] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:53:10 2022] GET /compute/v2.1/servers/fde3f6fc-61e1-4b21-8b91-e95c2db3d48c => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:53:10.991291 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-90435af2-7850-4638-af2d-3dd357a4832f tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:53:10.991826 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-90435af2-7850-4638-af2d-3dd357a4832f tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: 4d46fff2-b04d-41aa-ada0-2023ab545b48] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:53:11.006829 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-90435af2-7850-4638-af2d-3dd357a4832f tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:11.009241 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-90435af2-7850-4638-af2d-3dd357a4832f tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:11.009713 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-90435af2-7850-4638-af2d-3dd357a4832f tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:11.010487 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-90435af2-7850-4638-af2d-3dd357a4832f tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:11.011827 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-90435af2-7850-4638-af2d-3dd357a4832f tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:11.019525 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-90435af2-7850-4638-af2d-3dd357a4832f tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:11.092064 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-90435af2-7850-4638-af2d-3dd357a4832f tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: 4d46fff2-b04d-41aa-ada0-2023ab545b48] Going to try to terminate instance {{(pid=128802) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:53:11.216650 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:53:11.349722 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-90435af2-7850-4638-af2d-3dd357a4832f tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "DELETE /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48" status: 204 len: 0 microversion: 2.1 time: 0.366674 Oct 04 20:53:11.351096 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2064/4072] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 20:53:10 2022] DELETE /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 20:53:11.360069 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-198c470d-2fc1-47fd-a92c-9bca756588f5 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:53:11.361037 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-198c470d-2fc1-47fd-a92c-9bca756588f5 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: 4d46fff2-b04d-41aa-ada0-2023ab545b48] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:53:11.372901 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-198c470d-2fc1-47fd-a92c-9bca756588f5 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:11.373650 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-198c470d-2fc1-47fd-a92c-9bca756588f5 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:11.375410 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-198c470d-2fc1-47fd-a92c-9bca756588f5 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:11.376376 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-198c470d-2fc1-47fd-a92c-9bca756588f5 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:11.377490 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-198c470d-2fc1-47fd-a92c-9bca756588f5 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:11.378984 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-198c470d-2fc1-47fd-a92c-9bca756588f5 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:11.722511 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-6ed99bf9-696b-4173-b0d3-0165f81977aa tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:53:11.724631 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-6ed99bf9-696b-4173-b0d3-0165f81977aa tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] [instance: 9630289d-dcfd-4250-8910-a060f8696292] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:53:11.741727 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6ed99bf9-696b-4173-b0d3-0165f81977aa tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:11.742666 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6ed99bf9-696b-4173-b0d3-0165f81977aa tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:11.743255 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6ed99bf9-696b-4173-b0d3-0165f81977aa tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:11.745095 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6ed99bf9-696b-4173-b0d3-0165f81977aa tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:11.753805 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6ed99bf9-696b-4173-b0d3-0165f81977aa tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:11.754720 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6ed99bf9-696b-4173-b0d3-0165f81977aa tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:11.996436 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-6ed99bf9-696b-4173-b0d3-0165f81977aa tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c208ec9faf491385a9ab5b5932098d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ae4960393c464c97669731c2084d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:53:12.012741 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-6ed99bf9-696b-4173-b0d3-0165f81977aa tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] 10.222.0.33 "GET /compute/v2.1/servers/9630289d-dcfd-4250-8910-a060f8696292" status: 200 len: 1273 microversion: 2.1 time: 0.299256 Oct 04 20:53:12.015479 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2065/4073] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:53:11 2022] GET /compute/v2.1/servers/9630289d-dcfd-4250-8910-a060f8696292 => generated 1273 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:53:12.132147 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-198c470d-2fc1-47fd-a92c-9bca756588f5 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac650232cc04810b1340dc2f0edadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b0670d1bd99424780a70e69d57a2166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:53:12.146361 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-198c470d-2fc1-47fd-a92c-9bca756588f5 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48" status: 200 len: 1675 microversion: 2.1 time: 0.790113 Oct 04 20:53:12.147203 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2009/4074] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:53:11 2022] GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48 => generated 1675 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:53:13.043955 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-5039612a-bce2-4291-88f1-46d71bd7f880 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:53:13.045685 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-5039612a-bce2-4291-88f1-46d71bd7f880 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] [instance: 9630289d-dcfd-4250-8910-a060f8696292] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:53:13.059086 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5039612a-bce2-4291-88f1-46d71bd7f880 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:13.061654 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5039612a-bce2-4291-88f1-46d71bd7f880 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:13.062334 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5039612a-bce2-4291-88f1-46d71bd7f880 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:13.063282 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5039612a-bce2-4291-88f1-46d71bd7f880 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:13.066045 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5039612a-bce2-4291-88f1-46d71bd7f880 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:13.067210 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5039612a-bce2-4291-88f1-46d71bd7f880 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:13.172971 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-3cb89c18-a465-40b2-a8ed-49cbd8cf1dbb tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:53:13.174469 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-3cb89c18-a465-40b2-a8ed-49cbd8cf1dbb tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: 4d46fff2-b04d-41aa-ada0-2023ab545b48] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:53:13.186632 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:53:13.188163 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3cb89c18-a465-40b2-a8ed-49cbd8cf1dbb tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:13.188724 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3cb89c18-a465-40b2-a8ed-49cbd8cf1dbb tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:13.189197 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3cb89c18-a465-40b2-a8ed-49cbd8cf1dbb tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:13.195149 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3cb89c18-a465-40b2-a8ed-49cbd8cf1dbb tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:13.196246 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3cb89c18-a465-40b2-a8ed-49cbd8cf1dbb tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:13.198524 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3cb89c18-a465-40b2-a8ed-49cbd8cf1dbb tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:14.238014 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-5039612a-bce2-4291-88f1-46d71bd7f880 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c208ec9faf491385a9ab5b5932098d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ae4960393c464c97669731c2084d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:53:14.249918 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-5039612a-bce2-4291-88f1-46d71bd7f880 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] 10.222.0.33 "GET /compute/v2.1/servers/9630289d-dcfd-4250-8910-a060f8696292" status: 200 len: 1273 microversion: 2.1 time: 1.210596 Oct 04 20:53:14.256153 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2066/4075] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:53:13 2022] GET /compute/v2.1/servers/9630289d-dcfd-4250-8910-a060f8696292 => generated 1273 bytes in 1213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:53:14.772944 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-3cb89c18-a465-40b2-a8ed-49cbd8cf1dbb tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac650232cc04810b1340dc2f0edadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b0670d1bd99424780a70e69d57a2166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:53:14.800424 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-3cb89c18-a465-40b2-a8ed-49cbd8cf1dbb tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48" status: 200 len: 1675 microversion: 2.1 time: 1.622051 Oct 04 20:53:14.802837 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2010/4076] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:53:13 2022] GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48 => generated 1675 bytes in 1636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:53:15.201035 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-be1ecca6-2950-488a-9512-30411f47a319 tempest-SecurityGroupsNegativeTestJSON-468194898 tempest-SecurityGroupsNegativeTestJSON-468194898-project] Calling method '.version_select at 0x7f3c7899da60>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:53:15.279053 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7d884487-5924-4e20-875b-47905da1d437 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:53:15.279678 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-7d884487-5924-4e20-875b-47905da1d437 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] [instance: 9630289d-dcfd-4250-8910-a060f8696292] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:53:15.297174 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7d884487-5924-4e20-875b-47905da1d437 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:15.297745 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7d884487-5924-4e20-875b-47905da1d437 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:15.298184 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7d884487-5924-4e20-875b-47905da1d437 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:15.298926 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7d884487-5924-4e20-875b-47905da1d437 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:15.299389 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7d884487-5924-4e20-875b-47905da1d437 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:15.299818 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7d884487-5924-4e20-875b-47905da1d437 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:15.465369 n-d-854823-8 devstack@n-api.service[128802]: DEBUG neutronclient.v2_0.client [None req-be1ecca6-2950-488a-9512-30411f47a319 tempest-SecurityGroupsNegativeTestJSON-468194898 tempest-SecurityGroupsNegativeTestJSON-468194898-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group d3258419-abe3-404e-8d7c-38f6cf7d9ad3 does not exist", "detail": ""}} {{(pid=128802) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 20:53:15.466128 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.network.security_group_api [None req-be1ecca6-2950-488a-9512-30411f47a319 tempest-SecurityGroupsNegativeTestJSON-468194898 tempest-SecurityGroupsNegativeTestJSON-468194898-project] Neutron security group d3258419-abe3-404e-8d7c-38f6cf7d9ad3 not found {{(pid=128802) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 04 20:53:15.466733 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.wsgi [None req-be1ecca6-2950-488a-9512-30411f47a319 tempest-SecurityGroupsNegativeTestJSON-468194898 tempest-SecurityGroupsNegativeTestJSON-468194898-project] HTTP exception thrown: Security group d3258419-abe3-404e-8d7c-38f6cf7d9ad3 does not exist Oct 04 20:53:15.466733 n-d-854823-8 devstack@n-api.service[128802]: Neutron server returns request_ids: ['req-420ef9a0-bb0c-484b-a72d-e60db23e966a'] Oct 04 20:53:15.469046 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-be1ecca6-2950-488a-9512-30411f47a319 tempest-SecurityGroupsNegativeTestJSON-468194898 tempest-SecurityGroupsNegativeTestJSON-468194898-project] Request method failure captured: Oct 04 20:53:15.469046 n-d-854823-8 devstack@n-api.service[128802]: request: DELETE /compute/v2.1/os-security-groups/d3258419-abe3-404e-8d7c-38f6cf7d9ad3 HTTP/1.1 Oct 04 20:53:15.469046 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 20:53:15.469046 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 20:53:15.469046 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 20:53:15.469046 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 0 Oct 04 20:53:15.469046 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 20:53:15.469046 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 20:53:15.469046 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 20:53:15.469046 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 20:53:15.469046 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPJ06AnEVY7vxAgpe4Spn78jFa0awgVwze-da10AkTGZPqU-Ji4dBCOD8yiJWEpW_CjfUUHVGj_r9A2weNH__x8TD5A1xoTY0HzCtD6F53eQvvTJ_dsIW0-OjC_ea816jQPo_ly3BEWhY8PSViG3SoJvYjy8LNMkVoff9-9WkLtjsDes Oct 04 20:53:15.469046 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 20:53:15.469046 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 20:53:15.469046 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 20:53:15.469046 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 20:53:15.469046 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 20:53:15.469046 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 20:53:15.469046 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: b64fdc275d6c41ad9f3fb72b69663d27 Oct 04 20:53:15.469046 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-468194898 Oct 04 20:53:15.469046 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 20:53:15.469046 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 20:53:15.469046 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b64fdc275d6c41ad9f3fb72b69663d27", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b64fdc275d6c41ad9f3fb72b69663d27"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b64fdc275d6c41ad9f3fb72b69663d27"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b64fdc275d6c41ad9f3fb72b69663d27"}]}] Oct 04 20:53:15.469046 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-468194898 Oct 04 20:53:15.469046 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: b64fdc275d6c41ad9f3fb72b69663d27 Oct 04 20:53:15.469046 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-468194898 Oct 04 20:53:15.469046 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-SecurityGroupsNegativeTestJSON-468194898-project Oct 04 20:53:15.469046 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 20:53:15.469046 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 20:53:15.469046 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: 4ab63d1481534de0a7db32f98cebd9c4 Oct 04 20:53:15.469046 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-468194898-project Oct 04 20:53:15.469046 n-d-854823-8 devstack@n-api.service[128802]: method: Oct 04 20:53:15.469046 n-d-854823-8 devstack@n-api.service[128802]: exception: Security group d3258419-abe3-404e-8d7c-38f6cf7d9ad3 does not exist Oct 04 20:53:15.469046 n-d-854823-8 devstack@n-api.service[128802]: Neutron server returns request_ids: ['req-420ef9a0-bb0c-484b-a72d-e60db23e966a'] Oct 04 20:53:15.469046 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'id': 'd3258419-abe3-404e-8d7c-38f6cf7d9ad3'} Oct 04 20:53:15.469046 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:53:15.469046 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:53:15.469046 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 04 20:53:15.469046 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 04 20:53:15.469046 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:53:15.469046 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:53:15.469046 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 04 20:53:15.469046 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 04 20:53:15.469046 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:53:15.469046 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:53:15.469046 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 20:53:15.469046 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 20:53:15.469046 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:53:15.469046 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:53:15.469046 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:53:15.469046 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:53:15.469046 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:53:15.469046 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:53:15.469046 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 20:53:15.469046 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 20:53:15.469046 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:53:15.469046 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:53:15.469046 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 20:53:15.469046 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 20:53:15.469046 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 20:53:15.469046 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 20:53:15.469046 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group d3258419-abe3-404e-8d7c-38f6cf7d9ad3 does not exist Oct 04 20:53:15.473238 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-420ef9a0-bb0c-484b-a72d-e60db23e966a'] Oct 04 20:53:15.473238 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:53:15.473238 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:53:15.473238 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:53:15.473238 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:53:15.473238 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 04 20:53:15.473238 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 04 20:53:15.473238 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 04 20:53:15.473238 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 04 20:53:15.473238 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group d3258419-abe3-404e-8d7c-38f6cf7d9ad3 does not exist Oct 04 20:53:15.473238 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-420ef9a0-bb0c-484b-a72d-e60db23e966a'] Oct 04 20:53:15.473238 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:53:15.473238 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:53:15.473238 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:53:15.473238 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:53:15.473238 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:53:15.473238 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:53:15.473238 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:53:15.473238 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:53:15.473238 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:53:15.473238 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:53:15.473238 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:53:15.473238 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:53:15.473238 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 04 20:53:15.473238 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 04 20:53:15.473238 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group d3258419-abe3-404e-8d7c-38f6cf7d9ad3 does not exist Oct 04 20:53:15.473238 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-420ef9a0-bb0c-484b-a72d-e60db23e966a'] Oct 04 20:53:15.473238 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:53:15.473238 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:53:15.473238 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:53:15.473238 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:53:15.473238 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:53:15.473238 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:53:15.473238 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:53:15.473238 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:53:15.473238 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group d3258419-abe3-404e-8d7c-38f6cf7d9ad3 does not exist Oct 04 20:53:15.473238 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-420ef9a0-bb0c-484b-a72d-e60db23e966a'] Oct 04 20:53:15.473238 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:53:15.473238 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-be1ecca6-2950-488a-9512-30411f47a319 tempest-SecurityGroupsNegativeTestJSON-468194898 tempest-SecurityGroupsNegativeTestJSON-468194898-project] Returning 404 to user: Security group d3258419-abe3-404e-8d7c-38f6cf7d9ad3 does not exist Oct 04 20:53:15.473238 n-d-854823-8 devstack@n-api.service[128802]: Neutron server returns request_ids: ['req-420ef9a0-bb0c-484b-a72d-e60db23e966a'] {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:53:15.473238 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-be1ecca6-2950-488a-9512-30411f47a319 tempest-SecurityGroupsNegativeTestJSON-468194898 tempest-SecurityGroupsNegativeTestJSON-468194898-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/d3258419-abe3-404e-8d7c-38f6cf7d9ad3" status: 404 len: 194 microversion: 2.1 time: 0.789791 Oct 04 20:53:15.473238 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2067/4077] 10.222.0.33 () {58 vars in 1272 bytes} [Tue Oct 4 20:53:14 2022] DELETE /compute/v2.1/os-security-groups/d3258419-abe3-404e-8d7c-38f6cf7d9ad3 => generated 194 bytes in 791 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:53:15.491803 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-3a7c8d4c-fe29-4948-b0b0-c10e3d094a6c tempest-SecurityGroupsNegativeTestJSON-468194898 tempest-SecurityGroupsNegativeTestJSON-468194898-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/" status: 404 len: 112 microversion: - time: 0.012465 Oct 04 20:53:15.495461 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2068/4078] 10.222.0.33 () {58 vars in 1164 bytes} [Tue Oct 4 20:53:15 2022] DELETE /compute/v2.1/os-security-groups/ => generated 112 bytes in 19 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 04 20:53:15.511665 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-0ca247e8-5499-4231-b248-1a58170fa34f tempest-SecurityGroupsNegativeTestJSON-468194898 tempest-SecurityGroupsNegativeTestJSON-468194898-project] Calling method '.version_select at 0x7f3c78934280>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:53:16.409167 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-7d884487-5924-4e20-875b-47905da1d437 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c208ec9faf491385a9ab5b5932098d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ae4960393c464c97669731c2084d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:53:16.425518 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-7d884487-5924-4e20-875b-47905da1d437 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] 10.222.0.33 "GET /compute/v2.1/servers/9630289d-dcfd-4250-8910-a060f8696292" status: 200 len: 1315 microversion: 2.1 time: 1.148241 Oct 04 20:53:16.426294 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2011/4079] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:53:15 2022] GET /compute/v2.1/servers/9630289d-dcfd-4250-8910-a060f8696292 => generated 1315 bytes in 1153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:53:16.441564 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-03843d38-f405-433a-ad9e-0e24554b901e tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:53:16.443025 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-03843d38-f405-433a-ad9e-0e24554b901e tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: 4d46fff2-b04d-41aa-ada0-2023ab545b48] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:53:16.467119 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-03843d38-f405-433a-ad9e-0e24554b901e tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:16.467861 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-03843d38-f405-433a-ad9e-0e24554b901e tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:16.468454 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-03843d38-f405-433a-ad9e-0e24554b901e tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:16.469373 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-03843d38-f405-433a-ad9e-0e24554b901e tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:16.469978 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-03843d38-f405-433a-ad9e-0e24554b901e tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:16.470582 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-03843d38-f405-433a-ad9e-0e24554b901e tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:16.858754 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-03843d38-f405-433a-ad9e-0e24554b901e tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac650232cc04810b1340dc2f0edadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b0670d1bd99424780a70e69d57a2166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:53:16.880097 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-03843d38-f405-433a-ad9e-0e24554b901e tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48" status: 200 len: 1608 microversion: 2.1 time: 0.452409 Oct 04 20:53:16.884672 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2012/4080] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:53:16 2022] GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48 => generated 1608 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:53:17.029608 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-0ca247e8-5499-4231-b248-1a58170fa34f tempest-SecurityGroupsNegativeTestJSON-468194898 tempest-SecurityGroupsNegativeTestJSON-468194898-project] 10.222.0.33 "GET /compute/v2.1/os-security-groups" status: 200 len: 707 microversion: 2.1 time: 1.528118 Oct 04 20:53:17.030920 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2069/4081] 10.222.0.33 () {58 vars in 1158 bytes} [Tue Oct 4 20:53:15 2022] GET /compute/v2.1/os-security-groups => generated 707 bytes in 1530 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:53:17.048055 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-efd4f9b4-094c-4624-a3bd-4324bef52481 tempest-SecurityGroupsNegativeTestJSON-468194898 tempest-SecurityGroupsNegativeTestJSON-468194898-project] Calling method '.version_select at 0x7f3c6f3a61f0>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:53:17.454219 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-9d95370d-4daf-41c5-a125-666b3e4b753f tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:53:17.454987 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-9d95370d-4daf-41c5-a125-666b3e4b753f tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] [instance: 9630289d-dcfd-4250-8910-a060f8696292] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:53:17.474176 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9d95370d-4daf-41c5-a125-666b3e4b753f tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:17.477321 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9d95370d-4daf-41c5-a125-666b3e4b753f tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:17.481769 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9d95370d-4daf-41c5-a125-666b3e4b753f tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:17.483405 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9d95370d-4daf-41c5-a125-666b3e4b753f tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:17.484046 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9d95370d-4daf-41c5-a125-666b3e4b753f tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:17.484663 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9d95370d-4daf-41c5-a125-666b3e4b753f tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:18.675680 n-d-854823-8 devstack@n-api.service[128801]: DEBUG neutronclient.v2_0.client [None req-efd4f9b4-094c-4624-a3bd-4324bef52481 tempest-SecurityGroupsNegativeTestJSON-468194898 tempest-SecurityGroupsNegativeTestJSON-468194898-project] Error message: {"NeutronError": {"type": "SecurityGroupCannotRemoveDefault", "message": "Insufficient rights for removing default security group.", "detail": ""}} {{(pid=128801) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 20:53:18.676431 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-efd4f9b4-094c-4624-a3bd-4324bef52481 tempest-SecurityGroupsNegativeTestJSON-468194898 tempest-SecurityGroupsNegativeTestJSON-468194898-project] HTTP exception thrown: Insufficient rights for removing default security group. Oct 04 20:53:18.676431 n-d-854823-8 devstack@n-api.service[128801]: Neutron server returns request_ids: ['req-2102f538-d0b1-4381-9246-96e7a58ff701'] Oct 04 20:53:18.679173 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-efd4f9b4-094c-4624-a3bd-4324bef52481 tempest-SecurityGroupsNegativeTestJSON-468194898 tempest-SecurityGroupsNegativeTestJSON-468194898-project] Request method failure captured: Oct 04 20:53:18.679173 n-d-854823-8 devstack@n-api.service[128801]: request: DELETE /compute/v2.1/os-security-groups/77344a68-83ff-4535-bdba-5ea39aac3075 HTTP/1.1 Oct 04 20:53:18.679173 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:53:18.679173 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:53:18.679173 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:53:18.679173 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 0 Oct 04 20:53:18.679173 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:53:18.679173 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:53:18.679173 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:53:18.679173 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:53:18.679173 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJ06AnEVY7vxAgpe4Spn78jFa0awgVwze-da10AkTGZPqU-Ji4dBCOD8yiJWEpW_CjfUUHVGj_r9A2weNH__x8TD5A1xoTY0HzCtD6F53eQvvTJ_dsIW0-OjC_ea816jQPo_ly3BEWhY8PSViG3SoJvYjy8LNMkVoff9-9WkLtjsDes Oct 04 20:53:18.679173 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:53:18.679173 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:53:18.679173 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:53:18.679173 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:53:18.679173 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:53:18.679173 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:53:18.679173 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: b64fdc275d6c41ad9f3fb72b69663d27 Oct 04 20:53:18.679173 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-468194898 Oct 04 20:53:18.679173 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 20:53:18.679173 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 20:53:18.679173 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b64fdc275d6c41ad9f3fb72b69663d27", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b64fdc275d6c41ad9f3fb72b69663d27"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b64fdc275d6c41ad9f3fb72b69663d27"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b64fdc275d6c41ad9f3fb72b69663d27"}]}] Oct 04 20:53:18.679173 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-468194898 Oct 04 20:53:18.679173 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: b64fdc275d6c41ad9f3fb72b69663d27 Oct 04 20:53:18.679173 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-468194898 Oct 04 20:53:18.679173 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-SecurityGroupsNegativeTestJSON-468194898-project Oct 04 20:53:18.679173 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:53:18.679173 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:53:18.679173 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: 4ab63d1481534de0a7db32f98cebd9c4 Oct 04 20:53:18.679173 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-468194898-project Oct 04 20:53:18.679173 n-d-854823-8 devstack@n-api.service[128801]: method: Oct 04 20:53:18.679173 n-d-854823-8 devstack@n-api.service[128801]: exception: Insufficient rights for removing default security group. Oct 04 20:53:18.679173 n-d-854823-8 devstack@n-api.service[128801]: Neutron server returns request_ids: ['req-2102f538-d0b1-4381-9246-96e7a58ff701'] Oct 04 20:53:18.679173 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': '77344a68-83ff-4535-bdba-5ea39aac3075'} Oct 04 20:53:18.679173 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:53:18.679173 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:53:18.679173 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Oct 04 20:53:18.679173 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Oct 04 20:53:18.679173 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:53:18.679173 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:53:18.679173 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Oct 04 20:53:18.679173 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Oct 04 20:53:18.679173 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:53:18.679173 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:53:18.679173 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Oct 04 20:53:18.679173 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Oct 04 20:53:18.679173 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:53:18.679173 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:53:18.679173 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:53:18.679173 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:53:18.679173 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:53:18.679173 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:53:18.679173 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 20:53:18.679173 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 20:53:18.679173 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:53:18.679173 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:53:18.679173 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 20:53:18.679173 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 20:53:18.679173 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 20:53:18.679173 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 20:53:18.679173 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Insufficient rights for removing default security group. Oct 04 20:53:18.684120 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2102f538-d0b1-4381-9246-96e7a58ff701'] Oct 04 20:53:18.684120 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:53:18.684120 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:53:18.684120 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:53:18.684120 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:53:18.684120 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Oct 04 20:53:18.684120 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Oct 04 20:53:18.684120 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Oct 04 20:53:18.684120 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Oct 04 20:53:18.684120 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Insufficient rights for removing default security group. Oct 04 20:53:18.684120 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2102f538-d0b1-4381-9246-96e7a58ff701'] Oct 04 20:53:18.684120 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:53:18.684120 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:53:18.684120 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:53:18.684120 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:53:18.684120 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:53:18.684120 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:53:18.684120 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:53:18.684120 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:53:18.684120 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:53:18.684120 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:53:18.684120 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:53:18.684120 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:53:18.684120 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Oct 04 20:53:18.684120 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 04 20:53:18.684120 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Insufficient rights for removing default security group. Oct 04 20:53:18.684120 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2102f538-d0b1-4381-9246-96e7a58ff701'] Oct 04 20:53:18.684120 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:53:18.684120 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:53:18.684120 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:53:18.684120 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:53:18.684120 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:53:18.684120 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:53:18.684120 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:53:18.684120 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:53:18.684120 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Insufficient rights for removing default security group. Oct 04 20:53:18.684120 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2102f538-d0b1-4381-9246-96e7a58ff701'] Oct 04 20:53:18.684120 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:53:18.687610 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-efd4f9b4-094c-4624-a3bd-4324bef52481 tempest-SecurityGroupsNegativeTestJSON-468194898 tempest-SecurityGroupsNegativeTestJSON-468194898-project] Returning 400 to user: Insufficient rights for removing default security group. Oct 04 20:53:18.687610 n-d-854823-8 devstack@n-api.service[128801]: Neutron server returns request_ids: ['req-2102f538-d0b1-4381-9246-96e7a58ff701'] {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:53:18.688825 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-efd4f9b4-094c-4624-a3bd-4324bef52481 tempest-SecurityGroupsNegativeTestJSON-468194898 tempest-SecurityGroupsNegativeTestJSON-468194898-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/77344a68-83ff-4535-bdba-5ea39aac3075" status: 400 len: 182 microversion: 2.1 time: 1.646159 Oct 04 20:53:18.696592 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2013/4082] 10.222.0.33 () {58 vars in 1272 bytes} [Tue Oct 4 20:53:17 2022] DELETE /compute/v2.1/os-security-groups/77344a68-83ff-4535-bdba-5ea39aac3075 => generated 182 bytes in 1655 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 20:53:18.723018 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-9d95370d-4daf-41c5-a125-666b3e4b753f tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c208ec9faf491385a9ab5b5932098d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ae4960393c464c97669731c2084d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:53:18.724348 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7d9e6b6c-0334-4b46-bca7-95616551ed90 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:53:18.726805 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-7d9e6b6c-0334-4b46-bca7-95616551ed90 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: 4d46fff2-b04d-41aa-ada0-2023ab545b48] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:53:18.735670 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-9d95370d-4daf-41c5-a125-666b3e4b753f tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] 10.222.0.33 "GET /compute/v2.1/servers/9630289d-dcfd-4250-8910-a060f8696292" status: 200 len: 1315 microversion: 2.1 time: 1.287040 Oct 04 20:53:18.739783 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2070/4083] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:53:17 2022] GET /compute/v2.1/servers/9630289d-dcfd-4250-8910-a060f8696292 => generated 1315 bytes in 1292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:53:18.754504 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-0d475c70-a973-414f-96b7-c0d3dbb8237d tempest-SecurityGroupsNegativeTestJSON-468194898 tempest-SecurityGroupsNegativeTestJSON-468194898-project] Calling method '.version_select at 0x7f3c6f7bc790>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:53:18.768982 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:53:18.773541 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7d9e6b6c-0334-4b46-bca7-95616551ed90 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:18.778877 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7d9e6b6c-0334-4b46-bca7-95616551ed90 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:18.780497 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7d9e6b6c-0334-4b46-bca7-95616551ed90 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:18.783165 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7d9e6b6c-0334-4b46-bca7-95616551ed90 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:18.783871 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7d9e6b6c-0334-4b46-bca7-95616551ed90 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:18.784529 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7d9e6b6c-0334-4b46-bca7-95616551ed90 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:18.846526 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=6 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:53:18.911673 n-d-854823-8 devstack@n-api.service[128802]: DEBUG neutronclient.v2_0.client [None req-0d475c70-a973-414f-96b7-c0d3dbb8237d tempest-SecurityGroupsNegativeTestJSON-468194898 tempest-SecurityGroupsNegativeTestJSON-468194898-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 4bbe8ae2-23e3-4692-a4a1-9780f1134397 does not exist", "detail": ""}} {{(pid=128802) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 20:53:18.913304 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.network.security_group_api [None req-0d475c70-a973-414f-96b7-c0d3dbb8237d tempest-SecurityGroupsNegativeTestJSON-468194898 tempest-SecurityGroupsNegativeTestJSON-468194898-project] Neutron security group 4bbe8ae2-23e3-4692-a4a1-9780f1134397 not found {{(pid=128802) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 04 20:53:18.914465 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.wsgi [None req-0d475c70-a973-414f-96b7-c0d3dbb8237d tempest-SecurityGroupsNegativeTestJSON-468194898 tempest-SecurityGroupsNegativeTestJSON-468194898-project] HTTP exception thrown: Security group 4bbe8ae2-23e3-4692-a4a1-9780f1134397 does not exist Oct 04 20:53:18.914465 n-d-854823-8 devstack@n-api.service[128802]: Neutron server returns request_ids: ['req-bbf3113c-ee27-40aa-8a09-3cd85d3cdef4'] Oct 04 20:53:18.919008 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-0d475c70-a973-414f-96b7-c0d3dbb8237d tempest-SecurityGroupsNegativeTestJSON-468194898 tempest-SecurityGroupsNegativeTestJSON-468194898-project] Request method failure captured: Oct 04 20:53:18.919008 n-d-854823-8 devstack@n-api.service[128802]: request: GET /compute/v2.1/os-security-groups/4bbe8ae2-23e3-4692-a4a1-9780f1134397 HTTP/1.1 Oct 04 20:53:18.919008 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 20:53:18.919008 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 20:53:18.919008 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 20:53:18.919008 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 0 Oct 04 20:53:18.919008 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 20:53:18.919008 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 20:53:18.919008 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 20:53:18.919008 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 20:53:18.919008 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPJ06AnEVY7vxAgpe4Spn78jFa0awgVwze-da10AkTGZPqU-Ji4dBCOD8yiJWEpW_CjfUUHVGj_r9A2weNH__x8TD5A1xoTY0HzCtD6F53eQvvTJ_dsIW0-OjC_ea816jQPo_ly3BEWhY8PSViG3SoJvYjy8LNMkVoff9-9WkLtjsDes Oct 04 20:53:18.919008 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 20:53:18.919008 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 20:53:18.919008 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 20:53:18.919008 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 20:53:18.919008 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 20:53:18.919008 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 20:53:18.919008 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: b64fdc275d6c41ad9f3fb72b69663d27 Oct 04 20:53:18.919008 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-468194898 Oct 04 20:53:18.919008 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 20:53:18.919008 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 20:53:18.919008 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b64fdc275d6c41ad9f3fb72b69663d27", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b64fdc275d6c41ad9f3fb72b69663d27"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b64fdc275d6c41ad9f3fb72b69663d27"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b64fdc275d6c41ad9f3fb72b69663d27"}]}] Oct 04 20:53:18.919008 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-468194898 Oct 04 20:53:18.919008 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: b64fdc275d6c41ad9f3fb72b69663d27 Oct 04 20:53:18.919008 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-468194898 Oct 04 20:53:18.919008 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-SecurityGroupsNegativeTestJSON-468194898-project Oct 04 20:53:18.919008 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 20:53:18.919008 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 20:53:18.919008 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: 4ab63d1481534de0a7db32f98cebd9c4 Oct 04 20:53:18.919008 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-468194898-project Oct 04 20:53:18.919008 n-d-854823-8 devstack@n-api.service[128802]: method: Oct 04 20:53:18.919008 n-d-854823-8 devstack@n-api.service[128802]: exception: Security group 4bbe8ae2-23e3-4692-a4a1-9780f1134397 does not exist Oct 04 20:53:18.919008 n-d-854823-8 devstack@n-api.service[128802]: Neutron server returns request_ids: ['req-bbf3113c-ee27-40aa-8a09-3cd85d3cdef4'] Oct 04 20:53:18.919008 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'id': '4bbe8ae2-23e3-4692-a4a1-9780f1134397'} Oct 04 20:53:18.919008 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:53:18.919008 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:53:18.919008 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 04 20:53:18.919008 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 04 20:53:18.919008 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:53:18.919008 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:53:18.919008 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 04 20:53:18.919008 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 04 20:53:18.919008 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:53:18.919008 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:53:18.919008 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 20:53:18.919008 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 20:53:18.919008 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:53:18.919008 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:53:18.919008 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:53:18.919008 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:53:18.919008 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:53:18.919008 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:53:18.919008 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 20:53:18.919008 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 20:53:18.919008 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:53:18.919008 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:53:18.919008 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 20:53:18.919008 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 20:53:18.919008 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 20:53:18.919008 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 20:53:18.919008 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 4bbe8ae2-23e3-4692-a4a1-9780f1134397 does not exist Oct 04 20:53:18.923903 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bbf3113c-ee27-40aa-8a09-3cd85d3cdef4'] Oct 04 20:53:18.923903 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:53:18.923903 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:53:18.923903 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:53:18.923903 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:53:18.923903 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 04 20:53:18.923903 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 04 20:53:18.923903 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 04 20:53:18.923903 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 04 20:53:18.923903 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 4bbe8ae2-23e3-4692-a4a1-9780f1134397 does not exist Oct 04 20:53:18.923903 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bbf3113c-ee27-40aa-8a09-3cd85d3cdef4'] Oct 04 20:53:18.923903 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:53:18.923903 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:53:18.923903 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:53:18.923903 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:53:18.923903 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:53:18.923903 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:53:18.923903 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:53:18.923903 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:53:18.923903 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:53:18.923903 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:53:18.923903 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:53:18.923903 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:53:18.923903 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 04 20:53:18.923903 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 04 20:53:18.923903 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 4bbe8ae2-23e3-4692-a4a1-9780f1134397 does not exist Oct 04 20:53:18.923903 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bbf3113c-ee27-40aa-8a09-3cd85d3cdef4'] Oct 04 20:53:18.923903 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:53:18.923903 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:53:18.923903 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:53:18.923903 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:53:18.923903 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:53:18.923903 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:53:18.923903 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:53:18.923903 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:53:18.923903 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 4bbe8ae2-23e3-4692-a4a1-9780f1134397 does not exist Oct 04 20:53:18.923903 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bbf3113c-ee27-40aa-8a09-3cd85d3cdef4'] Oct 04 20:53:18.923903 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:53:18.929335 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-0d475c70-a973-414f-96b7-c0d3dbb8237d tempest-SecurityGroupsNegativeTestJSON-468194898 tempest-SecurityGroupsNegativeTestJSON-468194898-project] Returning 404 to user: Security group 4bbe8ae2-23e3-4692-a4a1-9780f1134397 does not exist Oct 04 20:53:18.929335 n-d-854823-8 devstack@n-api.service[128802]: Neutron server returns request_ids: ['req-bbf3113c-ee27-40aa-8a09-3cd85d3cdef4'] {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:53:18.930628 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-0d475c70-a973-414f-96b7-c0d3dbb8237d tempest-SecurityGroupsNegativeTestJSON-468194898 tempest-SecurityGroupsNegativeTestJSON-468194898-project] 10.222.0.33 "GET /compute/v2.1/os-security-groups/4bbe8ae2-23e3-4692-a4a1-9780f1134397" status: 404 len: 194 microversion: 2.1 time: 0.186754 Oct 04 20:53:18.931366 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2071/4084] 10.222.0.33 () {58 vars in 1269 bytes} [Tue Oct 4 20:53:18 2022] GET /compute/v2.1/os-security-groups/4bbe8ae2-23e3-4692-a4a1-9780f1134397 => generated 194 bytes in 190 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:53:18.945657 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-c8023d57-1859-4826-b5ea-0475920e23c8 req-76750788-43ed-430f-abdf-45e4e5162e11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d46fff2-b04d-41aa-ada0-2023ab545b48", "name": "network-vif-deleted", "tag": "39e1fcde-c40c-4b4b-8edd-7565faaf4580"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:53:18.958088 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-7d9e6b6c-0334-4b46-bca7-95616551ed90 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eac650232cc04810b1340dc2f0edadcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b0670d1bd99424780a70e69d57a2166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:53:18.988740 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-7d9e6b6c-0334-4b46-bca7-95616551ed90 tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48" status: 200 len: 1323 microversion: 2.1 time: 0.286225 Oct 04 20:53:18.991539 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2014/4085] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:53:18 2022] GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48 => generated 1323 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:53:19.003038 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-95b5dcb2-a89f-4792-89f7-1b590d83d553 tempest-SecurityGroupsNegativeTestJSON-468194898 tempest-SecurityGroupsNegativeTestJSON-468194898-project] Action: 'update', calling method: .version_select at 0x7f3c6f3da8b0>, body: {"security_group": {"name": "tempest-sg-1373033716", "description": "tempest-description-994198855"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:53:19.018233 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-c8023d57-1859-4826-b5ea-0475920e23c8 req-76750788-43ed-430f-abdf-45e4e5162e11 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:19.020080 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-c8023d57-1859-4826-b5ea-0475920e23c8 req-76750788-43ed-430f-abdf-45e4e5162e11 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:19.020703 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-c8023d57-1859-4826-b5ea-0475920e23c8 req-76750788-43ed-430f-abdf-45e4e5162e11 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:19.044010 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-c8023d57-1859-4826-b5ea-0475920e23c8 req-76750788-43ed-430f-abdf-45e4e5162e11 service nova] Creating event network-vif-deleted:39e1fcde-c40c-4b4b-8edd-7565faaf4580 for instance 4d46fff2-b04d-41aa-ada0-2023ab545b48 on n-h1-854823-8 Oct 04 20:53:19.051039 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-c8023d57-1859-4826-b5ea-0475920e23c8 req-76750788-43ed-430f-abdf-45e4e5162e11 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116632 Oct 04 20:53:19.054374 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2072/4086] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:53:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:53:19.091323 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-b4fd86f7-d459-40c8-be7d-2636e7ae69d2 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1ac5db40-fbff-4fe2-b7f4-28962356d9f9"}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:53:19.099096 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-b4fd86f7-d459-40c8-be7d-2636e7ae69d2 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] [instance: 866d0dd3-3c7e-4612-a132-48eb83ec2d16] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:53:19.110300 n-d-854823-8 devstack@n-api.service[128801]: DEBUG neutronclient.v2_0.client [None req-95b5dcb2-a89f-4792-89f7-1b590d83d553 tempest-SecurityGroupsNegativeTestJSON-468194898 tempest-SecurityGroupsNegativeTestJSON-468194898-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 1c1aa5c1-c2c5-402b-aef3-ee534f5d3b2e does not exist", "detail": ""}} {{(pid=128801) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 20:53:19.111361 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.network.security_group_api [None req-95b5dcb2-a89f-4792-89f7-1b590d83d553 tempest-SecurityGroupsNegativeTestJSON-468194898 tempest-SecurityGroupsNegativeTestJSON-468194898-project] Neutron security group 1c1aa5c1-c2c5-402b-aef3-ee534f5d3b2e not found {{(pid=128801) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 04 20:53:19.112092 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-95b5dcb2-a89f-4792-89f7-1b590d83d553 tempest-SecurityGroupsNegativeTestJSON-468194898 tempest-SecurityGroupsNegativeTestJSON-468194898-project] HTTP exception thrown: Security group 1c1aa5c1-c2c5-402b-aef3-ee534f5d3b2e does not exist Oct 04 20:53:19.112092 n-d-854823-8 devstack@n-api.service[128801]: Neutron server returns request_ids: ['req-2866060f-49a8-4ee1-b6e2-ebd8f5489566'] Oct 04 20:53:19.115597 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-95b5dcb2-a89f-4792-89f7-1b590d83d553 tempest-SecurityGroupsNegativeTestJSON-468194898 tempest-SecurityGroupsNegativeTestJSON-468194898-project] Request method failure captured: Oct 04 20:53:19.115597 n-d-854823-8 devstack@n-api.service[128801]: request: PUT /compute/v2.1/os-security-groups/1c1aa5c1-c2c5-402b-aef3-ee534f5d3b2e HTTP/1.1 Oct 04 20:53:19.115597 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:53:19.115597 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:53:19.115597 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:53:19.115597 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 101 Oct 04 20:53:19.115597 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:53:19.115597 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:53:19.115597 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:53:19.115597 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:53:19.115597 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJ06AnEVY7vxAgpe4Spn78jFa0awgVwze-da10AkTGZPqU-Ji4dBCOD8yiJWEpW_CjfUUHVGj_r9A2weNH__x8TD5A1xoTY0HzCtD6F53eQvvTJ_dsIW0-OjC_ea816jQPo_ly3BEWhY8PSViG3SoJvYjy8LNMkVoff9-9WkLtjsDes Oct 04 20:53:19.115597 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:53:19.115597 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:53:19.115597 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:53:19.115597 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:53:19.115597 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:53:19.115597 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:53:19.115597 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: b64fdc275d6c41ad9f3fb72b69663d27 Oct 04 20:53:19.115597 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-468194898 Oct 04 20:53:19.115597 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 20:53:19.115597 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 20:53:19.115597 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b64fdc275d6c41ad9f3fb72b69663d27", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b64fdc275d6c41ad9f3fb72b69663d27"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b64fdc275d6c41ad9f3fb72b69663d27"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b64fdc275d6c41ad9f3fb72b69663d27"}]}] Oct 04 20:53:19.115597 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-468194898 Oct 04 20:53:19.115597 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: b64fdc275d6c41ad9f3fb72b69663d27 Oct 04 20:53:19.115597 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-468194898 Oct 04 20:53:19.115597 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-SecurityGroupsNegativeTestJSON-468194898-project Oct 04 20:53:19.115597 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:53:19.115597 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:53:19.115597 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: 4ab63d1481534de0a7db32f98cebd9c4 Oct 04 20:53:19.115597 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-468194898-project Oct 04 20:53:19.115597 n-d-854823-8 devstack@n-api.service[128801]: Oct 04 20:53:19.115597 n-d-854823-8 devstack@n-api.service[128801]: {"security_group": {"name": "tempest-sg-1373033716", "description": "tempest-description-994198855"}} Oct 04 20:53:19.115597 n-d-854823-8 devstack@n-api.service[128801]: method: Oct 04 20:53:19.115597 n-d-854823-8 devstack@n-api.service[128801]: exception: Security group 1c1aa5c1-c2c5-402b-aef3-ee534f5d3b2e does not exist Oct 04 20:53:19.115597 n-d-854823-8 devstack@n-api.service[128801]: Neutron server returns request_ids: ['req-2866060f-49a8-4ee1-b6e2-ebd8f5489566'] Oct 04 20:53:19.115597 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': '1c1aa5c1-c2c5-402b-aef3-ee534f5d3b2e', 'body': {'security_group': {'name': 'tempest-sg-1373033716', 'description': 'tempest-description-994198855'}}} Oct 04 20:53:19.115597 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:53:19.115597 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:53:19.115597 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 04 20:53:19.115597 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 04 20:53:19.115597 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:53:19.115597 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:53:19.115597 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 04 20:53:19.115597 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 04 20:53:19.115597 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:53:19.115597 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:53:19.115597 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 20:53:19.115597 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 20:53:19.115597 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:53:19.115597 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:53:19.115597 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 20:53:19.115597 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 20:53:19.115597 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:53:19.115597 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:53:19.115597 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 20:53:19.115597 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 20:53:19.115597 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:53:19.115597 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:53:19.115597 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 20:53:19.115597 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 20:53:19.115597 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 20:53:19.120913 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 20:53:19.120913 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 1c1aa5c1-c2c5-402b-aef3-ee534f5d3b2e does not exist Oct 04 20:53:19.120913 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2866060f-49a8-4ee1-b6e2-ebd8f5489566'] Oct 04 20:53:19.120913 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:53:19.120913 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:53:19.120913 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:53:19.120913 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:53:19.120913 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 246, in update Oct 04 20:53:19.120913 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 04 20:53:19.120913 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 04 20:53:19.120913 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 04 20:53:19.120913 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 1c1aa5c1-c2c5-402b-aef3-ee534f5d3b2e does not exist Oct 04 20:53:19.120913 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2866060f-49a8-4ee1-b6e2-ebd8f5489566'] Oct 04 20:53:19.120913 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:53:19.120913 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:53:19.120913 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:53:19.120913 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:53:19.120913 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:53:19.120913 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:53:19.120913 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:53:19.120913 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:53:19.120913 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:53:19.120913 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:53:19.120913 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:53:19.120913 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:53:19.120913 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 248, in update Oct 04 20:53:19.120913 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 04 20:53:19.120913 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 1c1aa5c1-c2c5-402b-aef3-ee534f5d3b2e does not exist Oct 04 20:53:19.120913 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2866060f-49a8-4ee1-b6e2-ebd8f5489566'] Oct 04 20:53:19.120913 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:53:19.120913 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:53:19.120913 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:53:19.120913 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:53:19.120913 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:53:19.120913 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:53:19.120913 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:53:19.120913 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:53:19.120913 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 1c1aa5c1-c2c5-402b-aef3-ee534f5d3b2e does not exist Oct 04 20:53:19.120913 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2866060f-49a8-4ee1-b6e2-ebd8f5489566'] Oct 04 20:53:19.120913 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:53:19.120913 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-95b5dcb2-a89f-4792-89f7-1b590d83d553 tempest-SecurityGroupsNegativeTestJSON-468194898 tempest-SecurityGroupsNegativeTestJSON-468194898-project] Returning 404 to user: Security group 1c1aa5c1-c2c5-402b-aef3-ee534f5d3b2e does not exist Oct 04 20:53:19.120913 n-d-854823-8 devstack@n-api.service[128801]: Neutron server returns request_ids: ['req-2866060f-49a8-4ee1-b6e2-ebd8f5489566'] {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:53:19.120913 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-95b5dcb2-a89f-4792-89f7-1b590d83d553 tempest-SecurityGroupsNegativeTestJSON-468194898 tempest-SecurityGroupsNegativeTestJSON-468194898-project] 10.222.0.33 "PUT /compute/v2.1/os-security-groups/1c1aa5c1-c2c5-402b-aef3-ee534f5d3b2e" status: 404 len: 194 microversion: 2.1 time: 0.126415 Oct 04 20:53:19.130193 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2015/4087] 10.222.0.33 () {60 vars in 1290 bytes} [Tue Oct 4 20:53:18 2022] PUT /compute/v2.1/os-security-groups/1c1aa5c1-c2c5-402b-aef3-ee534f5d3b2e => generated 194 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:53:19.144801 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b4fd86f7-d459-40c8-be7d-2636e7ae69d2 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:19.145467 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b4fd86f7-d459-40c8-be7d-2636e7ae69d2 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:19.145938 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b4fd86f7-d459-40c8-be7d-2636e7ae69d2 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:19.146729 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b4fd86f7-d459-40c8-be7d-2636e7ae69d2 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:19.147201 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b4fd86f7-d459-40c8-be7d-2636e7ae69d2 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:19.147641 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b4fd86f7-d459-40c8-be7d-2636e7ae69d2 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:19.439730 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell0:SELECT=2 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:53:19.775342 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8f77efbd-b466-4fba-9662-482ee2fe09f6 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:53:19.775797 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-8f77efbd-b466-4fba-9662-482ee2fe09f6 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] [instance: 9630289d-dcfd-4250-8910-a060f8696292] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:53:19.780004 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-b4fd86f7-d459-40c8-be7d-2636e7ae69d2 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] 10.222.0.33 "POST /compute/v2.1/servers/866d0dd3-3c7e-4612-a132-48eb83ec2d16/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.695552 Oct 04 20:53:19.792171 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2073/4088] 10.222.0.33 () {60 vars in 1323 bytes} [Tue Oct 4 20:53:19 2022] POST /compute/v2.1/servers/866d0dd3-3c7e-4612-a132-48eb83ec2d16/os-volume_attachments => generated 194 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:53:19.809967 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8f77efbd-b466-4fba-9662-482ee2fe09f6 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:19.812135 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8f77efbd-b466-4fba-9662-482ee2fe09f6 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:19.815092 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8f77efbd-b466-4fba-9662-482ee2fe09f6 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:19.817326 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8f77efbd-b466-4fba-9662-482ee2fe09f6 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:19.817829 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8f77efbd-b466-4fba-9662-482ee2fe09f6 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:19.819361 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8f77efbd-b466-4fba-9662-482ee2fe09f6 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:19.903998 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=16,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:53:20.033498 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-1861a918-be6b-4037-bffe-b8bdfab1d9ce tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:53:20.034609 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-1861a918-be6b-4037-bffe-b8bdfab1d9ce tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] [instance: 4d46fff2-b04d-41aa-ada0-2023ab545b48] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:53:20.044297 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1861a918-be6b-4037-bffe-b8bdfab1d9ce tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:20.045247 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1861a918-be6b-4037-bffe-b8bdfab1d9ce tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:20.047051 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1861a918-be6b-4037-bffe-b8bdfab1d9ce tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:20.048327 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1861a918-be6b-4037-bffe-b8bdfab1d9ce tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:20.049744 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1861a918-be6b-4037-bffe-b8bdfab1d9ce tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:20.050436 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1861a918-be6b-4037-bffe-b8bdfab1d9ce tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:20.100823 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.wsgi [None req-1861a918-be6b-4037-bffe-b8bdfab1d9ce tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] HTTP exception thrown: Instance 4d46fff2-b04d-41aa-ada0-2023ab545b48 could not be found. Oct 04 20:53:20.102761 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-1861a918-be6b-4037-bffe-b8bdfab1d9ce tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Request method failure captured: Oct 04 20:53:20.102761 n-d-854823-8 devstack@n-api.service[128802]: request: GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48 HTTP/1.1 Oct 04 20:53:20.102761 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 20:53:20.102761 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 20:53:20.102761 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 20:53:20.102761 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 0 Oct 04 20:53:20.102761 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 20:53:20.102761 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 20:53:20.102761 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 20:53:20.102761 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 20:53:20.102761 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPJsfW5w9WW6HLdIS-vhuA3Aqgubdan3G4XN4Mz-kS5WBm_kV8MmkEfQ0VXyVBZGh_offIhP7k_7zeKcJerywXx22sbTVU7nn7Yk2TKQKkZk7TZieLYe5dW5fMpGMZVoLDxRDRs83mJz3B8SrRlYbnvScXHL2MTPSbeQInsaFtih26mQ Oct 04 20:53:20.102761 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 20:53:20.102761 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 20:53:20.102761 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 20:53:20.102761 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 20:53:20.102761 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 20:53:20.102761 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 20:53:20.102761 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: 8b0670d1bd99424780a70e69d57a2166 Oct 04 20:53:20.102761 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-ServerActionsTestJSON-1241178619 Oct 04 20:53:20.102761 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 20:53:20.102761 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 20:53:20.102761 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_8b0670d1bd99424780a70e69d57a2166", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8b0670d1bd99424780a70e69d57a2166"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8b0670d1bd99424780a70e69d57a2166"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/8b0670d1bd99424780a70e69d57a2166"}]}] Oct 04 20:53:20.102761 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-ServerActionsTestJSON-1241178619 Oct 04 20:53:20.102761 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: 8b0670d1bd99424780a70e69d57a2166 Oct 04 20:53:20.102761 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-ServerActionsTestJSON-1241178619 Oct 04 20:53:20.102761 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-ServerActionsTestJSON-1241178619-project Oct 04 20:53:20.102761 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 20:53:20.102761 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 20:53:20.102761 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: eac650232cc04810b1340dc2f0edadcc Oct 04 20:53:20.102761 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-ServerActionsTestJSON-1241178619-project Oct 04 20:53:20.102761 n-d-854823-8 devstack@n-api.service[128802]: method: > Oct 04 20:53:20.102761 n-d-854823-8 devstack@n-api.service[128802]: exception: Instance 4d46fff2-b04d-41aa-ada0-2023ab545b48 could not be found. Oct 04 20:53:20.102761 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'id': '4d46fff2-b04d-41aa-ada0-2023ab545b48'} Oct 04 20:53:20.102761 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:53:20.102761 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:53:20.102761 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:53:20.102761 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:53:20.102761 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:53:20.102761 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:53:20.102761 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:53:20.102761 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:53:20.102761 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:53:20.102761 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:53:20.102761 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d46fff2-b04d-41aa-ada0-2023ab545b48 could not be found. Oct 04 20:53:20.102761 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:53:20.102761 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:53:20.102761 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:53:20.102761 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:53:20.102761 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:53:20.102761 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:53:20.102761 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:53:20.102761 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:53:20.102761 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:53:20.102761 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:53:20.102761 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:53:20.102761 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:53:20.102761 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:53:20.102761 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:53:20.102761 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:53:20.102761 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:53:20.102761 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d46fff2-b04d-41aa-ada0-2023ab545b48 could not be found. Oct 04 20:53:20.102761 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:53:20.102761 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:53:20.102761 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:53:20.106373 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:53:20.106373 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:53:20.106373 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:53:20.106373 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:53:20.106373 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:53:20.106373 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d46fff2-b04d-41aa-ada0-2023ab545b48 could not be found. Oct 04 20:53:20.106373 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:53:20.106373 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-1861a918-be6b-4037-bffe-b8bdfab1d9ce tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Returning 404 to user: Instance 4d46fff2-b04d-41aa-ada0-2023ab545b48 could not be found. {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:53:20.106373 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-1861a918-be6b-4037-bffe-b8bdfab1d9ce tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48" status: 404 len: 111 microversion: 2.1 time: 0.079353 Oct 04 20:53:20.108339 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2074/4089] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:53:20 2022] GET /compute/v2.1/servers/4d46fff2-b04d-41aa-ada0-2023ab545b48 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:53:20.125644 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-54a8abdd-1a0b-4805-8f1d-b8324832916b tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] Calling method '.version_select at 0x7f3c6f5c3ee0>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:53:20.161836 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-54a8abdd-1a0b-4805-8f1d-b8324832916b tempest-ServerActionsTestJSON-1241178619 tempest-ServerActionsTestJSON-1241178619-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1394842687" status: 202 len: 0 microversion: 2.1 time: 0.052391 Oct 04 20:53:20.168019 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2075/4090] 10.222.0.33 () {58 vars in 1221 bytes} [Tue Oct 4 20:53:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1394842687 => generated 0 bytes in 59 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:53:20.992384 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-8f77efbd-b466-4fba-9662-482ee2fe09f6 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c208ec9faf491385a9ab5b5932098d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ae4960393c464c97669731c2084d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:53:21.005009 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-8f77efbd-b466-4fba-9662-482ee2fe09f6 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] 10.222.0.33 "GET /compute/v2.1/servers/9630289d-dcfd-4250-8910-a060f8696292" status: 200 len: 1315 microversion: 2.1 time: 1.242346 Oct 04 20:53:21.012009 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2016/4091] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:53:19 2022] GET /compute/v2.1/servers/9630289d-dcfd-4250-8910-a060f8696292 => generated 1315 bytes in 1251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:53:21.599953 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-b915f7f7-1cff-447c-9ec9-20efcf0e41c6 req-19896735-15da-4b9b-ae1f-2f38dceac301 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9630289d-dcfd-4250-8910-a060f8696292", "tag": "466d8872-1f41-40c1-9ab8-5a3dcff5497e"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:53:21.625020 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-b915f7f7-1cff-447c-9ec9-20efcf0e41c6 req-19896735-15da-4b9b-ae1f-2f38dceac301 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:21.626446 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-b915f7f7-1cff-447c-9ec9-20efcf0e41c6 req-19896735-15da-4b9b-ae1f-2f38dceac301 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:21.627394 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-b915f7f7-1cff-447c-9ec9-20efcf0e41c6 req-19896735-15da-4b9b-ae1f-2f38dceac301 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:21.671594 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-b915f7f7-1cff-447c-9ec9-20efcf0e41c6 req-19896735-15da-4b9b-ae1f-2f38dceac301 service nova] Creating event network-changed:466d8872-1f41-40c1-9ab8-5a3dcff5497e for instance 9630289d-dcfd-4250-8910-a060f8696292 on n-h2-854823-8 Oct 04 20:53:21.679081 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-b915f7f7-1cff-447c-9ec9-20efcf0e41c6 req-19896735-15da-4b9b-ae1f-2f38dceac301 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094306 Oct 04 20:53:21.680834 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2076/4092] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:53:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:53:21.779125 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-afce4568-50f6-43bb-8892-2b20112c4ded tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:53:21.780269 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-afce4568-50f6-43bb-8892-2b20112c4ded tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] [instance: f8ba4e66-2997-4822-9c01-c570f5ae6e87] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:53:21.794091 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-afce4568-50f6-43bb-8892-2b20112c4ded tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:21.796912 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-afce4568-50f6-43bb-8892-2b20112c4ded tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:21.797330 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-afce4568-50f6-43bb-8892-2b20112c4ded tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:21.806499 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-afce4568-50f6-43bb-8892-2b20112c4ded tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:21.807444 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-afce4568-50f6-43bb-8892-2b20112c4ded tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:21.808985 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-afce4568-50f6-43bb-8892-2b20112c4ded tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:22.040255 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-06132847-4200-456a-b278-eeb25208dac2 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:53:22.041212 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-06132847-4200-456a-b278-eeb25208dac2 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] [instance: 9630289d-dcfd-4250-8910-a060f8696292] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:53:22.054547 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-06132847-4200-456a-b278-eeb25208dac2 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:22.055350 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-06132847-4200-456a-b278-eeb25208dac2 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:22.059030 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-06132847-4200-456a-b278-eeb25208dac2 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:22.060083 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-06132847-4200-456a-b278-eeb25208dac2 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:22.060778 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-06132847-4200-456a-b278-eeb25208dac2 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:22.061560 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-06132847-4200-456a-b278-eeb25208dac2 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:23.475575 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-afce4568-50f6-43bb-8892-2b20112c4ded tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b78af5c0485b4343900269160ef3e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659f3d4023b347d58bc0361db9ceead9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:53:23.492706 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-afce4568-50f6-43bb-8892-2b20112c4ded tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b78af5c0485b4343900269160ef3e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659f3d4023b347d58bc0361db9ceead9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:53:23.494184 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-afce4568-50f6-43bb-8892-2b20112c4ded tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b78af5c0485b4343900269160ef3e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659f3d4023b347d58bc0361db9ceead9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:53:23.496243 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-afce4568-50f6-43bb-8892-2b20112c4ded tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] 10.222.0.33 "GET /compute/v2.1/servers/f8ba4e66-2997-4822-9c01-c570f5ae6e87" status: 200 len: 2951 microversion: 2.42 time: 1.722801 Oct 04 20:53:23.522750 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2017/4093] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:53:21 2022] GET /compute/v2.1/servers/f8ba4e66-2997-4822-9c01-c570f5ae6e87 => generated 2951 bytes in 1750 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:53:23.528732 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d6a49cea-28e9-44fe-bccb-d77fb082d97e tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:53:23.529236 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d6a49cea-28e9-44fe-bccb-d77fb082d97e tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] [instance: f8ba4e66-2997-4822-9c01-c570f5ae6e87] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:53:23.532935 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-06132847-4200-456a-b278-eeb25208dac2 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c208ec9faf491385a9ab5b5932098d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ae4960393c464c97669731c2084d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:53:23.535388 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d6a49cea-28e9-44fe-bccb-d77fb082d97e tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:23.536145 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d6a49cea-28e9-44fe-bccb-d77fb082d97e tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:23.537044 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d6a49cea-28e9-44fe-bccb-d77fb082d97e tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:23.537990 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d6a49cea-28e9-44fe-bccb-d77fb082d97e tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:23.538855 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d6a49cea-28e9-44fe-bccb-d77fb082d97e tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:23.539511 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d6a49cea-28e9-44fe-bccb-d77fb082d97e tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:23.547832 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-06132847-4200-456a-b278-eeb25208dac2 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] 10.222.0.33 "GET /compute/v2.1/servers/9630289d-dcfd-4250-8910-a060f8696292" status: 200 len: 1315 microversion: 2.1 time: 1.511676 Oct 04 20:53:23.562841 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2077/4094] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:53:22 2022] GET /compute/v2.1/servers/9630289d-dcfd-4250-8910-a060f8696292 => generated 1315 bytes in 1528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:53:23.889766 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d6a49cea-28e9-44fe-bccb-d77fb082d97e tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] 10.222.0.33 "GET /compute/v2.1/servers/f8ba4e66-2997-4822-9c01-c570f5ae6e87/os-interface" status: 200 len: 1830 microversion: 2.42 time: 0.365365 Oct 04 20:53:23.893273 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2018/4095] 10.222.0.33 () {60 vars in 1316 bytes} [Tue Oct 4 20:53:23 2022] GET /compute/v2.1/servers/f8ba4e66-2997-4822-9c01-c570f5ae6e87/os-interface => generated 1830 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:53:24.573209 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-40b7976a-7e07-495f-992a-c0be812d2f76 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:53:24.574776 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-40b7976a-7e07-495f-992a-c0be812d2f76 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] [instance: 9630289d-dcfd-4250-8910-a060f8696292] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:53:24.582376 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-40b7976a-7e07-495f-992a-c0be812d2f76 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:24.583147 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-40b7976a-7e07-495f-992a-c0be812d2f76 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:24.583797 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-40b7976a-7e07-495f-992a-c0be812d2f76 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:24.584742 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-40b7976a-7e07-495f-992a-c0be812d2f76 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:24.585445 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-40b7976a-7e07-495f-992a-c0be812d2f76 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:24.586115 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-40b7976a-7e07-495f-992a-c0be812d2f76 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:25.608393 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-40b7976a-7e07-495f-992a-c0be812d2f76 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c208ec9faf491385a9ab5b5932098d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ae4960393c464c97669731c2084d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:53:25.626125 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-40b7976a-7e07-495f-992a-c0be812d2f76 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] 10.222.0.33 "GET /compute/v2.1/servers/9630289d-dcfd-4250-8910-a060f8696292" status: 200 len: 1315 microversion: 2.1 time: 1.056712 Oct 04 20:53:25.639642 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2078/4096] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:53:24 2022] GET /compute/v2.1/servers/9630289d-dcfd-4250-8910-a060f8696292 => generated 1315 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:53:26.655341 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a36eff30-78f9-4f9b-ab72-59d50c3d406c tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:53:26.655814 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a36eff30-78f9-4f9b-ab72-59d50c3d406c tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] [instance: 9630289d-dcfd-4250-8910-a060f8696292] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:53:26.663525 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a36eff30-78f9-4f9b-ab72-59d50c3d406c tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:26.676181 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a36eff30-78f9-4f9b-ab72-59d50c3d406c tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:26.676656 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a36eff30-78f9-4f9b-ab72-59d50c3d406c tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:26.677406 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a36eff30-78f9-4f9b-ab72-59d50c3d406c tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:26.677881 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a36eff30-78f9-4f9b-ab72-59d50c3d406c tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:26.678291 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a36eff30-78f9-4f9b-ab72-59d50c3d406c tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:27.315261 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-a36eff30-78f9-4f9b-ab72-59d50c3d406c tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c208ec9faf491385a9ab5b5932098d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ae4960393c464c97669731c2084d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:53:27.328531 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a36eff30-78f9-4f9b-ab72-59d50c3d406c tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] 10.222.0.33 "GET /compute/v2.1/servers/9630289d-dcfd-4250-8910-a060f8696292" status: 200 len: 1315 microversion: 2.1 time: 0.679728 Oct 04 20:53:27.329198 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2019/4097] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:53:26 2022] GET /compute/v2.1/servers/9630289d-dcfd-4250-8910-a060f8696292 => generated 1315 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:53:28.355203 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-4394bc29-7d29-47ad-9670-58a6e14a1444 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:53:28.355855 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-4394bc29-7d29-47ad-9670-58a6e14a1444 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] [instance: 9630289d-dcfd-4250-8910-a060f8696292] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:53:28.362673 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4394bc29-7d29-47ad-9670-58a6e14a1444 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:28.363052 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4394bc29-7d29-47ad-9670-58a6e14a1444 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:28.363498 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4394bc29-7d29-47ad-9670-58a6e14a1444 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:28.364213 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4394bc29-7d29-47ad-9670-58a6e14a1444 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:28.364737 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4394bc29-7d29-47ad-9670-58a6e14a1444 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:28.365092 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4394bc29-7d29-47ad-9670-58a6e14a1444 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:28.450099 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-59f41193-8e2f-4674-b906-c8ad7d5ea4be req-bc2e0cc7-1386-4aa0-9841-517455c0827c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9630289d-dcfd-4250-8910-a060f8696292", "name": "network-vif-plugged", "status": "completed", "tag": "466d8872-1f41-40c1-9ab8-5a3dcff5497e"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:53:28.495997 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-59f41193-8e2f-4674-b906-c8ad7d5ea4be req-bc2e0cc7-1386-4aa0-9841-517455c0827c service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:28.497403 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-59f41193-8e2f-4674-b906-c8ad7d5ea4be req-bc2e0cc7-1386-4aa0-9841-517455c0827c service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:28.498095 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-59f41193-8e2f-4674-b906-c8ad7d5ea4be req-bc2e0cc7-1386-4aa0-9841-517455c0827c service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:28.515952 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-59f41193-8e2f-4674-b906-c8ad7d5ea4be req-bc2e0cc7-1386-4aa0-9841-517455c0827c service nova] Creating event network-vif-plugged:466d8872-1f41-40c1-9ab8-5a3dcff5497e for instance 9630289d-dcfd-4250-8910-a060f8696292 on n-h2-854823-8 Oct 04 20:53:28.525657 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-59f41193-8e2f-4674-b906-c8ad7d5ea4be req-bc2e0cc7-1386-4aa0-9841-517455c0827c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081666 Oct 04 20:53:28.527305 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2020/4098] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:53:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:53:28.997764 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-4394bc29-7d29-47ad-9670-58a6e14a1444 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c208ec9faf491385a9ab5b5932098d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ae4960393c464c97669731c2084d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:53:29.015221 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-4394bc29-7d29-47ad-9670-58a6e14a1444 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] 10.222.0.33 "GET /compute/v2.1/servers/9630289d-dcfd-4250-8910-a060f8696292" status: 200 len: 1315 microversion: 2.1 time: 0.664166 Oct 04 20:53:29.023172 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2079/4099] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:53:28 2022] GET /compute/v2.1/servers/9630289d-dcfd-4250-8910-a060f8696292 => generated 1315 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:53:30.040426 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ed5042de-0996-4c2d-8509-a7aad8280cbf tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:53:30.041125 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ed5042de-0996-4c2d-8509-a7aad8280cbf tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] [instance: 9630289d-dcfd-4250-8910-a060f8696292] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:53:30.052686 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ed5042de-0996-4c2d-8509-a7aad8280cbf tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:30.054834 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ed5042de-0996-4c2d-8509-a7aad8280cbf tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:30.055291 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ed5042de-0996-4c2d-8509-a7aad8280cbf tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:30.059219 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ed5042de-0996-4c2d-8509-a7aad8280cbf tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:30.059709 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ed5042de-0996-4c2d-8509-a7aad8280cbf tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:30.060187 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ed5042de-0996-4c2d-8509-a7aad8280cbf tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:30.627131 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-ed5042de-0996-4c2d-8509-a7aad8280cbf tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c208ec9faf491385a9ab5b5932098d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ae4960393c464c97669731c2084d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:53:30.639248 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ed5042de-0996-4c2d-8509-a7aad8280cbf tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] 10.222.0.33 "GET /compute/v2.1/servers/9630289d-dcfd-4250-8910-a060f8696292" status: 200 len: 1315 microversion: 2.1 time: 0.603130 Oct 04 20:53:30.640753 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2021/4100] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:53:30 2022] GET /compute/v2.1/servers/9630289d-dcfd-4250-8910-a060f8696292 => generated 1315 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:53:31.676065 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-1e5b1709-97c2-4742-b232-eddbadd4c7c0 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:53:31.678302 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-1e5b1709-97c2-4742-b232-eddbadd4c7c0 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] [instance: 9630289d-dcfd-4250-8910-a060f8696292] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:53:31.689327 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:53:31.692589 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1e5b1709-97c2-4742-b232-eddbadd4c7c0 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:31.694424 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1e5b1709-97c2-4742-b232-eddbadd4c7c0 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:31.695853 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1e5b1709-97c2-4742-b232-eddbadd4c7c0 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:31.696857 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1e5b1709-97c2-4742-b232-eddbadd4c7c0 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:31.697560 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1e5b1709-97c2-4742-b232-eddbadd4c7c0 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:31.698959 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1e5b1709-97c2-4742-b232-eddbadd4c7c0 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:33.231757 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-1e5b1709-97c2-4742-b232-eddbadd4c7c0 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c208ec9faf491385a9ab5b5932098d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ae4960393c464c97669731c2084d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:53:33.248302 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-1e5b1709-97c2-4742-b232-eddbadd4c7c0 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] 10.222.0.33 "GET /compute/v2.1/servers/9630289d-dcfd-4250-8910-a060f8696292" status: 200 len: 1501 microversion: 2.1 time: 1.586506 Oct 04 20:53:33.249787 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2080/4101] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:53:31 2022] GET /compute/v2.1/servers/9630289d-dcfd-4250-8910-a060f8696292 => generated 1501 bytes in 1592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:53:33.277873 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-76e7f6d9-0b0b-491a-9ab5-919fe5f9d60d tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:53:33.299781 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-76e7f6d9-0b0b-491a-9ab5-919fe5f9d60d tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:33.304666 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-76e7f6d9-0b0b-491a-9ab5-919fe5f9d60d tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:33.306039 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-76e7f6d9-0b0b-491a-9ab5-919fe5f9d60d tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:33.410933 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-76e7f6d9-0b0b-491a-9ab5-919fe5f9d60d tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] [instance: 9630289d-dcfd-4250-8910-a060f8696292] Going to try to stop instance {{(pid=128801) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 04 20:53:33.451006 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-c46dcabf-5906-4902-9b6a-74a6fd8e41d0 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:53:33.455197 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-c46dcabf-5906-4902-9b6a-74a6fd8e41d0 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] [instance: 866d0dd3-3c7e-4612-a132-48eb83ec2d16] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:53:33.478122 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c46dcabf-5906-4902-9b6a-74a6fd8e41d0 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:33.478800 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c46dcabf-5906-4902-9b6a-74a6fd8e41d0 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:33.479791 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c46dcabf-5906-4902-9b6a-74a6fd8e41d0 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:33.482135 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c46dcabf-5906-4902-9b6a-74a6fd8e41d0 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:33.484189 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c46dcabf-5906-4902-9b6a-74a6fd8e41d0 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:33.485082 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c46dcabf-5906-4902-9b6a-74a6fd8e41d0 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:33.522003 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-76e7f6d9-0b0b-491a-9ab5-919fe5f9d60d tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] 10.222.0.33 "POST /compute/v2.1/servers/9630289d-dcfd-4250-8910-a060f8696292/action" status: 202 len: 0 microversion: 2.1 time: 0.249316 Oct 04 20:53:33.524452 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2022/4102] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 20:53:33 2022] POST /compute/v2.1/servers/9630289d-dcfd-4250-8910-a060f8696292/action => generated 0 bytes in 253 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:53:33.540875 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-aed2ed0b-e741-49f5-8fc1-5b228bede0e9 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:53:33.543995 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-aed2ed0b-e741-49f5-8fc1-5b228bede0e9 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] [instance: 9630289d-dcfd-4250-8910-a060f8696292] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:53:33.577934 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-aed2ed0b-e741-49f5-8fc1-5b228bede0e9 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:33.579061 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-aed2ed0b-e741-49f5-8fc1-5b228bede0e9 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:33.580842 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-aed2ed0b-e741-49f5-8fc1-5b228bede0e9 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:33.583528 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.objects.instance [None req-c46dcabf-5906-4902-9b6a-74a6fd8e41d0 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lazy-loading 'flavor' on Instance uuid 866d0dd3-3c7e-4612-a132-48eb83ec2d16 {{(pid=128802) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:53:33.587351 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-aed2ed0b-e741-49f5-8fc1-5b228bede0e9 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:33.590212 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-aed2ed0b-e741-49f5-8fc1-5b228bede0e9 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:33.590954 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-aed2ed0b-e741-49f5-8fc1-5b228bede0e9 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:33.959550 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-c46dcabf-5906-4902-9b6a-74a6fd8e41d0 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] 10.222.0.33 "POST /compute/v2.1/servers/866d0dd3-3c7e-4612-a132-48eb83ec2d16/action" status: 200 len: 32 microversion: 2.1 time: 0.506555 Oct 04 20:53:33.960309 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2081/4103] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 20:53:33 2022] POST /compute/v2.1/servers/866d0dd3-3c7e-4612-a132-48eb83ec2d16/action => generated 32 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 04 20:53:34.002256 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-ada6a3cf-f443-416e-bbea-0f4fb41d8f39 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:53:34.004001 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-ada6a3cf-f443-416e-bbea-0f4fb41d8f39 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] [instance: 866d0dd3-3c7e-4612-a132-48eb83ec2d16] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:53:34.016706 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ada6a3cf-f443-416e-bbea-0f4fb41d8f39 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:34.017519 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ada6a3cf-f443-416e-bbea-0f4fb41d8f39 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:34.018733 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ada6a3cf-f443-416e-bbea-0f4fb41d8f39 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:34.020189 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ada6a3cf-f443-416e-bbea-0f4fb41d8f39 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:34.020857 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ada6a3cf-f443-416e-bbea-0f4fb41d8f39 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:34.021481 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ada6a3cf-f443-416e-bbea-0f4fb41d8f39 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:34.785338 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-aed2ed0b-e741-49f5-8fc1-5b228bede0e9 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c208ec9faf491385a9ab5b5932098d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ae4960393c464c97669731c2084d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:53:34.793953 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-aed2ed0b-e741-49f5-8fc1-5b228bede0e9 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] 10.222.0.33 "GET /compute/v2.1/servers/9630289d-dcfd-4250-8910-a060f8696292" status: 200 len: 1511 microversion: 2.1 time: 1.262529 Oct 04 20:53:34.801421 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2023/4104] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:53:33 2022] GET /compute/v2.1/servers/9630289d-dcfd-4250-8910-a060f8696292 => generated 1511 bytes in 1273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:53:34.835632 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-ada6a3cf-f443-416e-bbea-0f4fb41d8f39 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc4171c0ee14ebb8b5eff5e910ccf49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003eb03a265a496d8981e45c74b014f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:53:34.846189 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-ada6a3cf-f443-416e-bbea-0f4fb41d8f39 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] 10.222.0.33 "GET /compute/v2.1/servers/866d0dd3-3c7e-4612-a132-48eb83ec2d16" status: 200 len: 1736 microversion: 2.1 time: 0.865099 Oct 04 20:53:34.847513 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2082/4105] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:53:33 2022] GET /compute/v2.1/servers/866d0dd3-3c7e-4612-a132-48eb83ec2d16 => generated 1736 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:53:35.831933 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-34983e68-73fe-4598-a0f7-89f9955151ca tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:53:35.832748 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-34983e68-73fe-4598-a0f7-89f9955151ca tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] [instance: 9630289d-dcfd-4250-8910-a060f8696292] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:53:35.854291 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-34983e68-73fe-4598-a0f7-89f9955151ca tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:35.856801 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-34983e68-73fe-4598-a0f7-89f9955151ca tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:35.857466 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-34983e68-73fe-4598-a0f7-89f9955151ca tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:35.859611 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-34983e68-73fe-4598-a0f7-89f9955151ca tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:35.861505 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-34983e68-73fe-4598-a0f7-89f9955151ca tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:35.863165 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-34983e68-73fe-4598-a0f7-89f9955151ca tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:35.877031 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-054147ba-2fb6-49aa-9079-61ea4a08cf29 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:53:35.877854 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-054147ba-2fb6-49aa-9079-61ea4a08cf29 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] [instance: 866d0dd3-3c7e-4612-a132-48eb83ec2d16] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:53:35.888581 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-054147ba-2fb6-49aa-9079-61ea4a08cf29 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:35.889346 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-054147ba-2fb6-49aa-9079-61ea4a08cf29 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:35.890197 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-054147ba-2fb6-49aa-9079-61ea4a08cf29 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:35.891929 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-054147ba-2fb6-49aa-9079-61ea4a08cf29 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:35.892620 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-054147ba-2fb6-49aa-9079-61ea4a08cf29 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:35.893264 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-054147ba-2fb6-49aa-9079-61ea4a08cf29 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:36.957255 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-34983e68-73fe-4598-a0f7-89f9955151ca tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c208ec9faf491385a9ab5b5932098d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ae4960393c464c97669731c2084d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:53:36.970789 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-34983e68-73fe-4598-a0f7-89f9955151ca tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] 10.222.0.33 "GET /compute/v2.1/servers/9630289d-dcfd-4250-8910-a060f8696292" status: 200 len: 1511 microversion: 2.1 time: 1.145139 Oct 04 20:53:36.997901 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2024/4106] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:53:35 2022] GET /compute/v2.1/servers/9630289d-dcfd-4250-8910-a060f8696292 => generated 1511 bytes in 1174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:53:37.102028 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9f54b526-9d73-476f-8517-f95fbdea098d tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1960852040", "imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63", "flavorRef": "452", "networks": [{"uuid": "a8ab3947-7502-47aa-82ee-003685ca9719"}]}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:53:37.194160 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.network.neutron [None req-9f54b526-9d73-476f-8517-f95fbdea098d tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] validate_networks() for [('a8ab3947-7502-47aa-82ee-003685ca9719', None, None, None, None, None)] {{(pid=128801) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:53:37.557538 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-054147ba-2fb6-49aa-9079-61ea4a08cf29 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc4171c0ee14ebb8b5eff5e910ccf49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003eb03a265a496d8981e45c74b014f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:53:37.571577 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-054147ba-2fb6-49aa-9079-61ea4a08cf29 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] 10.222.0.33 "GET /compute/v2.1/servers/866d0dd3-3c7e-4612-a132-48eb83ec2d16" status: 200 len: 1736 microversion: 2.1 time: 1.703969 Oct 04 20:53:37.572179 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2083/4107] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:53:35 2022] GET /compute/v2.1/servers/866d0dd3-3c7e-4612-a132-48eb83ec2d16 => generated 1736 bytes in 1705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:53:38.009252 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-de281d85-ca44-45ca-8f82-cfe1da4bf11a tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:53:38.009878 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-de281d85-ca44-45ca-8f82-cfe1da4bf11a tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] [instance: 9630289d-dcfd-4250-8910-a060f8696292] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:53:38.024587 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-de281d85-ca44-45ca-8f82-cfe1da4bf11a tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:38.025098 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-de281d85-ca44-45ca-8f82-cfe1da4bf11a tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:38.025539 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-de281d85-ca44-45ca-8f82-cfe1da4bf11a tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:38.033820 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-de281d85-ca44-45ca-8f82-cfe1da4bf11a tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:38.034311 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-de281d85-ca44-45ca-8f82-cfe1da4bf11a tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:38.043173 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-de281d85-ca44-45ca-8f82-cfe1da4bf11a tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:38.081047 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:53:38.995759 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-9f54b526-9d73-476f-8517-f95fbdea098d tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Flavor limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:53:38.996393 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-9f54b526-9d73-476f-8517-f95fbdea098d tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Image limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:53:38.996909 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-9f54b526-9d73-476f-8517-f95fbdea098d tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Flavor pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:53:38.997476 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-9f54b526-9d73-476f-8517-f95fbdea098d tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Image pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:53:38.998285 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-9f54b526-9d73-476f-8517-f95fbdea098d tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:53:39.026113 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9f54b526-9d73-476f-8517-f95fbdea098d tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:39.028396 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9f54b526-9d73-476f-8517-f95fbdea098d tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:39.029008 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9f54b526-9d73-476f-8517-f95fbdea098d tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:39.031790 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9f54b526-9d73-476f-8517-f95fbdea098d tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:39.033059 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9f54b526-9d73-476f-8517-f95fbdea098d tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:39.037447 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9f54b526-9d73-476f-8517-f95fbdea098d tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:39.106370 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-9f54b526-9d73-476f-8517-f95fbdea098d tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Getting quotas for project 22ed328a1e964d46902dee5e1c7c7b74. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:53:39.122332 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-9f54b526-9d73-476f-8517-f95fbdea098d tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Getting quotas for user e93855201ca64c779f92a2a33979b81f and project 22ed328a1e964d46902dee5e1c7c7b74. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:53:39.164863 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-9f54b526-9d73-476f-8517-f95fbdea098d tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Going to run 1 instances... {{(pid=128801) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:53:39.170886 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-9f54b526-9d73-476f-8517-f95fbdea098d tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] [instance: 01fd3eb8-b195-4b9c-8d52-752e50be6f30] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='15b24725-0c99-4bcf-b1fb-907cdf8e2d63',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128801) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:53:39.318746 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-9f54b526-9d73-476f-8517-f95fbdea098d tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.313884 Oct 04 20:53:39.320379 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2025/4108] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 20:53:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 2322 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 20:53:39.327891 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5a82ed09-7212-4ca7-a8af-f48b60153c0a tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:53:39.328894 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-5a82ed09-7212-4ca7-a8af-f48b60153c0a tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] [instance: 866d0dd3-3c7e-4612-a132-48eb83ec2d16] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:53:39.359529 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5a82ed09-7212-4ca7-a8af-f48b60153c0a tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:39.361316 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5a82ed09-7212-4ca7-a8af-f48b60153c0a tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:39.361876 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5a82ed09-7212-4ca7-a8af-f48b60153c0a tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:39.363631 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5a82ed09-7212-4ca7-a8af-f48b60153c0a tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:39.365486 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5a82ed09-7212-4ca7-a8af-f48b60153c0a tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:39.366334 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5a82ed09-7212-4ca7-a8af-f48b60153c0a tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:39.704580 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-de281d85-ca44-45ca-8f82-cfe1da4bf11a tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c208ec9faf491385a9ab5b5932098d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ae4960393c464c97669731c2084d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:53:39.714022 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-de281d85-ca44-45ca-8f82-cfe1da4bf11a tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] 10.222.0.33 "GET /compute/v2.1/servers/9630289d-dcfd-4250-8910-a060f8696292" status: 200 len: 1511 microversion: 2.1 time: 1.708375 Oct 04 20:53:39.721467 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2084/4109] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:53:38 2022] GET /compute/v2.1/servers/9630289d-dcfd-4250-8910-a060f8696292 => generated 1511 bytes in 1717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:53:39.739097 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-ab01cbea-5e85-4f92-bea6-6de52ddd309b tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:53:39.740651 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-ab01cbea-5e85-4f92-bea6-6de52ddd309b tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] [instance: 01fd3eb8-b195-4b9c-8d52-752e50be6f30] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:53:39.958760 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-ab01cbea-5e85-4f92-bea6-6de52ddd309b tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e93855201ca64c779f92a2a33979b81f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed328a1e964d46902dee5e1c7c7b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:53:39.966982 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-ab01cbea-5e85-4f92-bea6-6de52ddd309b tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] 10.222.0.33 "GET /compute/v2.1/servers/01fd3eb8-b195-4b9c-8d52-752e50be6f30" status: 200 len: 1218 microversion: 2.1 time: 0.241031 Oct 04 20:53:39.967261 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2085/4110] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:53:39 2022] GET /compute/v2.1/servers/01fd3eb8-b195-4b9c-8d52-752e50be6f30 => generated 1218 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:53:40.059644 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-5a82ed09-7212-4ca7-a8af-f48b60153c0a tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc4171c0ee14ebb8b5eff5e910ccf49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003eb03a265a496d8981e45c74b014f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:53:40.071206 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5a82ed09-7212-4ca7-a8af-f48b60153c0a tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] 10.222.0.33 "GET /compute/v2.1/servers/866d0dd3-3c7e-4612-a132-48eb83ec2d16" status: 200 len: 1736 microversion: 2.1 time: 0.749425 Oct 04 20:53:40.077700 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2026/4111] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:53:39 2022] GET /compute/v2.1/servers/866d0dd3-3c7e-4612-a132-48eb83ec2d16 => generated 1736 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:53:40.747557 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-ba858e2d-b5ac-4c1d-8204-ee62667d72e9 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:53:40.748027 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-ba858e2d-b5ac-4c1d-8204-ee62667d72e9 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] [instance: 9630289d-dcfd-4250-8910-a060f8696292] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:53:40.765845 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ba858e2d-b5ac-4c1d-8204-ee62667d72e9 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:40.766815 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ba858e2d-b5ac-4c1d-8204-ee62667d72e9 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:40.767450 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ba858e2d-b5ac-4c1d-8204-ee62667d72e9 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:40.768777 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ba858e2d-b5ac-4c1d-8204-ee62667d72e9 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:40.769429 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ba858e2d-b5ac-4c1d-8204-ee62667d72e9 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:40.770043 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ba858e2d-b5ac-4c1d-8204-ee62667d72e9 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:40.992825 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d4a8004e-251d-4669-86ee-59da35f5105d tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:53:40.993446 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d4a8004e-251d-4669-86ee-59da35f5105d tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] [instance: 01fd3eb8-b195-4b9c-8d52-752e50be6f30] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:53:41.007848 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d4a8004e-251d-4669-86ee-59da35f5105d tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:41.008351 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d4a8004e-251d-4669-86ee-59da35f5105d tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:41.009106 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d4a8004e-251d-4669-86ee-59da35f5105d tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:41.010833 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d4a8004e-251d-4669-86ee-59da35f5105d tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:41.013345 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d4a8004e-251d-4669-86ee-59da35f5105d tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:41.013968 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d4a8004e-251d-4669-86ee-59da35f5105d tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:41.641493 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d4a8004e-251d-4669-86ee-59da35f5105d tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e93855201ca64c779f92a2a33979b81f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed328a1e964d46902dee5e1c7c7b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:53:41.667280 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d4a8004e-251d-4669-86ee-59da35f5105d tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] 10.222.0.33 "GET /compute/v2.1/servers/01fd3eb8-b195-4b9c-8d52-752e50be6f30" status: 200 len: 1270 microversion: 2.1 time: 0.674880 Oct 04 20:53:41.694126 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2027/4112] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:53:40 2022] GET /compute/v2.1/servers/01fd3eb8-b195-4b9c-8d52-752e50be6f30 => generated 1270 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:53:41.724207 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-417bc8ab-3110-4c4d-a8cc-eee23ea177ba tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:53:41.726488 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-417bc8ab-3110-4c4d-a8cc-eee23ea177ba tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] [instance: 866d0dd3-3c7e-4612-a132-48eb83ec2d16] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:53:41.745253 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-417bc8ab-3110-4c4d-a8cc-eee23ea177ba tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:41.746307 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-417bc8ab-3110-4c4d-a8cc-eee23ea177ba tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:41.746959 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-417bc8ab-3110-4c4d-a8cc-eee23ea177ba tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:41.747921 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-417bc8ab-3110-4c4d-a8cc-eee23ea177ba tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:41.748705 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-417bc8ab-3110-4c4d-a8cc-eee23ea177ba tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:41.750277 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-417bc8ab-3110-4c4d-a8cc-eee23ea177ba tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:42.132093 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-ba858e2d-b5ac-4c1d-8204-ee62667d72e9 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c208ec9faf491385a9ab5b5932098d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ae4960393c464c97669731c2084d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:53:42.148864 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-ba858e2d-b5ac-4c1d-8204-ee62667d72e9 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] 10.222.0.33 "GET /compute/v2.1/servers/9630289d-dcfd-4250-8910-a060f8696292" status: 200 len: 1511 microversion: 2.1 time: 1.406706 Oct 04 20:53:42.158888 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2086/4113] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:53:40 2022] GET /compute/v2.1/servers/9630289d-dcfd-4250-8910-a060f8696292 => generated 1511 bytes in 1416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:53:42.553676 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-417bc8ab-3110-4c4d-a8cc-eee23ea177ba tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc4171c0ee14ebb8b5eff5e910ccf49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003eb03a265a496d8981e45c74b014f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:53:42.566825 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-417bc8ab-3110-4c4d-a8cc-eee23ea177ba tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] 10.222.0.33 "GET /compute/v2.1/servers/866d0dd3-3c7e-4612-a132-48eb83ec2d16" status: 200 len: 1736 microversion: 2.1 time: 0.868444 Oct 04 20:53:42.568539 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2028/4114] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:53:41 2022] GET /compute/v2.1/servers/866d0dd3-3c7e-4612-a132-48eb83ec2d16 => generated 1736 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:53:42.694309 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-b584a908-ce8a-47ec-a132-a0b3c7de2b8c tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:53:42.695929 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-b584a908-ce8a-47ec-a132-a0b3c7de2b8c tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] [instance: 01fd3eb8-b195-4b9c-8d52-752e50be6f30] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:53:42.705933 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b584a908-ce8a-47ec-a132-a0b3c7de2b8c tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:42.707086 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b584a908-ce8a-47ec-a132-a0b3c7de2b8c tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:42.707810 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b584a908-ce8a-47ec-a132-a0b3c7de2b8c tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:42.708837 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b584a908-ce8a-47ec-a132-a0b3c7de2b8c tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:42.709572 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b584a908-ce8a-47ec-a132-a0b3c7de2b8c tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:42.710213 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b584a908-ce8a-47ec-a132-a0b3c7de2b8c tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:42.987593 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-b584a908-ce8a-47ec-a132-a0b3c7de2b8c tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e93855201ca64c779f92a2a33979b81f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed328a1e964d46902dee5e1c7c7b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:53:43.030783 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-b584a908-ce8a-47ec-a132-a0b3c7de2b8c tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] 10.222.0.33 "GET /compute/v2.1/servers/01fd3eb8-b195-4b9c-8d52-752e50be6f30" status: 200 len: 1276 microversion: 2.1 time: 0.341716 Oct 04 20:53:43.035136 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2087/4115] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:53:42 2022] GET /compute/v2.1/servers/01fd3eb8-b195-4b9c-8d52-752e50be6f30 => generated 1276 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:53:43.179893 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-853758bc-a28a-421a-8796-206df305502c tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:53:43.182220 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-853758bc-a28a-421a-8796-206df305502c tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] [instance: 9630289d-dcfd-4250-8910-a060f8696292] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:53:43.209752 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-853758bc-a28a-421a-8796-206df305502c tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:43.210547 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-853758bc-a28a-421a-8796-206df305502c tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:43.211906 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-853758bc-a28a-421a-8796-206df305502c tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:43.212861 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-853758bc-a28a-421a-8796-206df305502c tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:43.215014 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-853758bc-a28a-421a-8796-206df305502c tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:43.215644 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-853758bc-a28a-421a-8796-206df305502c tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:43.597949 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-d761c36e-7e3d-4fc9-a7be-b8f20d753a1d tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:53:43.599471 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-d761c36e-7e3d-4fc9-a7be-b8f20d753a1d tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] [instance: 866d0dd3-3c7e-4612-a132-48eb83ec2d16] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:53:43.612215 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d761c36e-7e3d-4fc9-a7be-b8f20d753a1d tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:43.612585 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d761c36e-7e3d-4fc9-a7be-b8f20d753a1d tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:43.613324 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d761c36e-7e3d-4fc9-a7be-b8f20d753a1d tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:43.616544 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d761c36e-7e3d-4fc9-a7be-b8f20d753a1d tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:43.617273 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d761c36e-7e3d-4fc9-a7be-b8f20d753a1d tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:43.621880 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d761c36e-7e3d-4fc9-a7be-b8f20d753a1d tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:44.388837 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-853758bc-a28a-421a-8796-206df305502c tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c208ec9faf491385a9ab5b5932098d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ae4960393c464c97669731c2084d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:53:44.416816 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-853758bc-a28a-421a-8796-206df305502c tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] 10.222.0.33 "GET /compute/v2.1/servers/9630289d-dcfd-4250-8910-a060f8696292" status: 200 len: 1511 microversion: 2.1 time: 1.244681 Oct 04 20:53:44.435978 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-d761c36e-7e3d-4fc9-a7be-b8f20d753a1d tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc4171c0ee14ebb8b5eff5e910ccf49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003eb03a265a496d8981e45c74b014f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:53:44.447751 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-d761c36e-7e3d-4fc9-a7be-b8f20d753a1d tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] 10.222.0.33 "GET /compute/v2.1/servers/866d0dd3-3c7e-4612-a132-48eb83ec2d16" status: 200 len: 1736 microversion: 2.1 time: 0.854823 Oct 04 20:53:44.451610 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2088/4116] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:53:43 2022] GET /compute/v2.1/servers/866d0dd3-3c7e-4612-a132-48eb83ec2d16 => generated 1736 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:53:44.453983 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2029/4117] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:53:43 2022] GET /compute/v2.1/servers/9630289d-dcfd-4250-8910-a060f8696292 => generated 1511 bytes in 1283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:53:44.466804 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-363ad42b-5174-4a30-a956-4aadab0c55ac tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:53:44.467792 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-363ad42b-5174-4a30-a956-4aadab0c55ac tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] [instance: 01fd3eb8-b195-4b9c-8d52-752e50be6f30] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:53:44.474222 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-363ad42b-5174-4a30-a956-4aadab0c55ac tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:44.475055 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-363ad42b-5174-4a30-a956-4aadab0c55ac tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:44.475708 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-363ad42b-5174-4a30-a956-4aadab0c55ac tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:44.476635 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-363ad42b-5174-4a30-a956-4aadab0c55ac tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:44.477303 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-363ad42b-5174-4a30-a956-4aadab0c55ac tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:44.478000 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-363ad42b-5174-4a30-a956-4aadab0c55ac tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:44.708546 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-363ad42b-5174-4a30-a956-4aadab0c55ac tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e93855201ca64c779f92a2a33979b81f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed328a1e964d46902dee5e1c7c7b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:53:44.721484 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-363ad42b-5174-4a30-a956-4aadab0c55ac tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] 10.222.0.33 "GET /compute/v2.1/servers/01fd3eb8-b195-4b9c-8d52-752e50be6f30" status: 200 len: 1276 microversion: 2.1 time: 0.268064 Oct 04 20:53:44.722170 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2089/4118] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:53:44 2022] GET /compute/v2.1/servers/01fd3eb8-b195-4b9c-8d52-752e50be6f30 => generated 1276 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:53:45.444697 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-38af8827-bc3f-414c-a2fb-a94cd9503273 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:53:45.445370 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-38af8827-bc3f-414c-a2fb-a94cd9503273 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] [instance: 9630289d-dcfd-4250-8910-a060f8696292] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:53:45.449875 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=3 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:53:45.470937 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-38af8827-bc3f-414c-a2fb-a94cd9503273 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:45.471426 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-38af8827-bc3f-414c-a2fb-a94cd9503273 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:45.475347 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-38af8827-bc3f-414c-a2fb-a94cd9503273 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:45.476631 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-38af8827-bc3f-414c-a2fb-a94cd9503273 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:45.477303 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-38af8827-bc3f-414c-a2fb-a94cd9503273 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:45.477739 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-38af8827-bc3f-414c-a2fb-a94cd9503273 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:45.483418 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-1b719b92-93dc-4083-8b1b-787c438095ee tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:53:45.484922 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-1b719b92-93dc-4083-8b1b-787c438095ee tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] [instance: 866d0dd3-3c7e-4612-a132-48eb83ec2d16] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:53:45.495475 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1b719b92-93dc-4083-8b1b-787c438095ee tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:45.496299 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1b719b92-93dc-4083-8b1b-787c438095ee tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:45.498150 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1b719b92-93dc-4083-8b1b-787c438095ee tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:45.499783 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1b719b92-93dc-4083-8b1b-787c438095ee tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:45.507726 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1b719b92-93dc-4083-8b1b-787c438095ee tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:45.512553 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1b719b92-93dc-4083-8b1b-787c438095ee tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:46.854045 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-38af8827-bc3f-414c-a2fb-a94cd9503273 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c208ec9faf491385a9ab5b5932098d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ae4960393c464c97669731c2084d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:53:46.865885 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-38af8827-bc3f-414c-a2fb-a94cd9503273 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] 10.222.0.33 "GET /compute/v2.1/servers/9630289d-dcfd-4250-8910-a060f8696292" status: 200 len: 1511 microversion: 2.1 time: 1.428438 Oct 04 20:53:46.878368 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2030/4119] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:53:45 2022] GET /compute/v2.1/servers/9630289d-dcfd-4250-8910-a060f8696292 => generated 1511 bytes in 1431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:53:46.878368 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-01ce4e25-5413-4e92-9a29-f9c4a69a0aee tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:53:46.887598 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-01ce4e25-5413-4e92-9a29-f9c4a69a0aee tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] [instance: 01fd3eb8-b195-4b9c-8d52-752e50be6f30] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:53:46.908152 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-01ce4e25-5413-4e92-9a29-f9c4a69a0aee tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:46.908674 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-01ce4e25-5413-4e92-9a29-f9c4a69a0aee tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:46.909128 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-01ce4e25-5413-4e92-9a29-f9c4a69a0aee tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:46.909871 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-01ce4e25-5413-4e92-9a29-f9c4a69a0aee tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:46.910336 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-01ce4e25-5413-4e92-9a29-f9c4a69a0aee tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:46.910796 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-01ce4e25-5413-4e92-9a29-f9c4a69a0aee tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:47.394467 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-1b719b92-93dc-4083-8b1b-787c438095ee tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc4171c0ee14ebb8b5eff5e910ccf49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003eb03a265a496d8981e45c74b014f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:53:47.409996 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-1b719b92-93dc-4083-8b1b-787c438095ee tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] 10.222.0.33 "GET /compute/v2.1/servers/866d0dd3-3c7e-4612-a132-48eb83ec2d16" status: 200 len: 1736 microversion: 2.1 time: 1.932838 Oct 04 20:53:47.410700 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2090/4120] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:53:45 2022] GET /compute/v2.1/servers/866d0dd3-3c7e-4612-a132-48eb83ec2d16 => generated 1736 bytes in 1938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:53:47.575013 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-01ce4e25-5413-4e92-9a29-f9c4a69a0aee tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e93855201ca64c779f92a2a33979b81f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed328a1e964d46902dee5e1c7c7b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:53:47.583995 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-01ce4e25-5413-4e92-9a29-f9c4a69a0aee tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] 10.222.0.33 "GET /compute/v2.1/servers/01fd3eb8-b195-4b9c-8d52-752e50be6f30" status: 200 len: 1318 microversion: 2.1 time: 0.714718 Oct 04 20:53:47.588743 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2031/4121] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:53:46 2022] GET /compute/v2.1/servers/01fd3eb8-b195-4b9c-8d52-752e50be6f30 => generated 1318 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:53:47.896242 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-fce5d045-a1ea-4105-86c6-0d2ca4da71f5 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:53:47.896892 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-fce5d045-a1ea-4105-86c6-0d2ca4da71f5 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] [instance: 9630289d-dcfd-4250-8910-a060f8696292] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:53:47.906972 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fce5d045-a1ea-4105-86c6-0d2ca4da71f5 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:47.907478 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fce5d045-a1ea-4105-86c6-0d2ca4da71f5 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:47.907929 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fce5d045-a1ea-4105-86c6-0d2ca4da71f5 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:47.909869 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fce5d045-a1ea-4105-86c6-0d2ca4da71f5 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:47.915755 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fce5d045-a1ea-4105-86c6-0d2ca4da71f5 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:47.916628 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fce5d045-a1ea-4105-86c6-0d2ca4da71f5 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:48.433654 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6f39dd85-d3aa-47dc-9087-1aa01b9a41c1 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:53:48.434694 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-6f39dd85-d3aa-47dc-9087-1aa01b9a41c1 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] [instance: 866d0dd3-3c7e-4612-a132-48eb83ec2d16] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:53:48.446706 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6f39dd85-d3aa-47dc-9087-1aa01b9a41c1 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:48.449235 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6f39dd85-d3aa-47dc-9087-1aa01b9a41c1 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:48.451684 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6f39dd85-d3aa-47dc-9087-1aa01b9a41c1 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:48.452899 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6f39dd85-d3aa-47dc-9087-1aa01b9a41c1 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:48.477601 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6f39dd85-d3aa-47dc-9087-1aa01b9a41c1 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:48.478533 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6f39dd85-d3aa-47dc-9087-1aa01b9a41c1 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:48.629252 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-fce5d045-a1ea-4105-86c6-0d2ca4da71f5 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c208ec9faf491385a9ab5b5932098d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ae4960393c464c97669731c2084d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:53:48.648247 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-fce5d045-a1ea-4105-86c6-0d2ca4da71f5 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] 10.222.0.33 "GET /compute/v2.1/servers/9630289d-dcfd-4250-8910-a060f8696292" status: 200 len: 1511 microversion: 2.1 time: 0.747626 Oct 04 20:53:48.649544 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2091/4122] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:53:47 2022] GET /compute/v2.1/servers/9630289d-dcfd-4250-8910-a060f8696292 => generated 1511 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:53:48.654880 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-22594176-2d68-4940-a2c0-ff2d96bd215d tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:53:48.655839 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-22594176-2d68-4940-a2c0-ff2d96bd215d tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] [instance: 01fd3eb8-b195-4b9c-8d52-752e50be6f30] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:53:48.694691 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-22594176-2d68-4940-a2c0-ff2d96bd215d tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:48.695684 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-22594176-2d68-4940-a2c0-ff2d96bd215d tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:48.696241 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-22594176-2d68-4940-a2c0-ff2d96bd215d tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:48.697260 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-22594176-2d68-4940-a2c0-ff2d96bd215d tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:48.698604 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-22594176-2d68-4940-a2c0-ff2d96bd215d tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:48.708020 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-22594176-2d68-4940-a2c0-ff2d96bd215d tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:49.075304 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:53:49.139910 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=6 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:53:49.231769 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-6f39dd85-d3aa-47dc-9087-1aa01b9a41c1 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc4171c0ee14ebb8b5eff5e910ccf49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003eb03a265a496d8981e45c74b014f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:53:49.253842 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-6f39dd85-d3aa-47dc-9087-1aa01b9a41c1 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] 10.222.0.33 "GET /compute/v2.1/servers/866d0dd3-3c7e-4612-a132-48eb83ec2d16" status: 200 len: 1736 microversion: 2.1 time: 0.824523 Oct 04 20:53:49.260956 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2032/4123] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:53:48 2022] GET /compute/v2.1/servers/866d0dd3-3c7e-4612-a132-48eb83ec2d16 => generated 1736 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:53:49.692310 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e7fa77fd-896b-4149-a128-e1d1e2db20eb tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:53:49.695153 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e7fa77fd-896b-4149-a128-e1d1e2db20eb tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] [instance: 9630289d-dcfd-4250-8910-a060f8696292] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:53:49.719241 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e7fa77fd-896b-4149-a128-e1d1e2db20eb tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:49.721202 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e7fa77fd-896b-4149-a128-e1d1e2db20eb tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:49.722981 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e7fa77fd-896b-4149-a128-e1d1e2db20eb tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:49.725137 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e7fa77fd-896b-4149-a128-e1d1e2db20eb tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:49.725792 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e7fa77fd-896b-4149-a128-e1d1e2db20eb tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:49.726447 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e7fa77fd-896b-4149-a128-e1d1e2db20eb tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:49.813886 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-22594176-2d68-4940-a2c0-ff2d96bd215d tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e93855201ca64c779f92a2a33979b81f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed328a1e964d46902dee5e1c7c7b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:53:49.824809 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-22594176-2d68-4940-a2c0-ff2d96bd215d tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] 10.222.0.33 "GET /compute/v2.1/servers/01fd3eb8-b195-4b9c-8d52-752e50be6f30" status: 200 len: 1318 microversion: 2.1 time: 1.173830 Oct 04 20:53:49.838858 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2092/4124] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:53:48 2022] GET /compute/v2.1/servers/01fd3eb8-b195-4b9c-8d52-752e50be6f30 => generated 1318 bytes in 1188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:53:50.290112 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-07a9a646-8198-40f7-8915-2a549ecc80fe tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:53:50.290892 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-07a9a646-8198-40f7-8915-2a549ecc80fe tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] [instance: 866d0dd3-3c7e-4612-a132-48eb83ec2d16] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:53:50.301170 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell0:SELECT=2 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:53:50.315818 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-07a9a646-8198-40f7-8915-2a549ecc80fe tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:50.321408 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-07a9a646-8198-40f7-8915-2a549ecc80fe tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:50.322010 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-07a9a646-8198-40f7-8915-2a549ecc80fe tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:50.327882 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-07a9a646-8198-40f7-8915-2a549ecc80fe tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:50.329594 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-07a9a646-8198-40f7-8915-2a549ecc80fe tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:50.331706 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-07a9a646-8198-40f7-8915-2a549ecc80fe tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:50.348958 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e7fa77fd-896b-4149-a128-e1d1e2db20eb tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c208ec9faf491385a9ab5b5932098d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ae4960393c464c97669731c2084d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:53:50.359265 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:53:50.366481 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e7fa77fd-896b-4149-a128-e1d1e2db20eb tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] 10.222.0.33 "GET /compute/v2.1/servers/9630289d-dcfd-4250-8910-a060f8696292" status: 200 len: 1511 microversion: 2.1 time: 0.691685 Oct 04 20:53:50.386434 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2033/4125] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:53:49 2022] GET /compute/v2.1/servers/9630289d-dcfd-4250-8910-a060f8696292 => generated 1511 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:53:50.850084 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7b0551c1-7f2c-4008-93b8-cd7c582d7040 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:53:50.851343 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-7b0551c1-7f2c-4008-93b8-cd7c582d7040 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] [instance: 01fd3eb8-b195-4b9c-8d52-752e50be6f30] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:53:50.862101 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7b0551c1-7f2c-4008-93b8-cd7c582d7040 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:50.862601 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7b0551c1-7f2c-4008-93b8-cd7c582d7040 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:50.863036 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7b0551c1-7f2c-4008-93b8-cd7c582d7040 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:50.871285 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7b0551c1-7f2c-4008-93b8-cd7c582d7040 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:50.871969 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7b0551c1-7f2c-4008-93b8-cd7c582d7040 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:50.872575 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7b0551c1-7f2c-4008-93b8-cd7c582d7040 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:50.878106 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-07a9a646-8198-40f7-8915-2a549ecc80fe tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc4171c0ee14ebb8b5eff5e910ccf49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003eb03a265a496d8981e45c74b014f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:53:50.895962 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-07a9a646-8198-40f7-8915-2a549ecc80fe tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] 10.222.0.33 "GET /compute/v2.1/servers/866d0dd3-3c7e-4612-a132-48eb83ec2d16" status: 200 len: 1736 microversion: 2.1 time: 0.613314 Oct 04 20:53:50.896700 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2093/4126] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:53:50 2022] GET /compute/v2.1/servers/866d0dd3-3c7e-4612-a132-48eb83ec2d16 => generated 1736 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:53:51.049218 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-b4a12b71-8984-4b4e-88f4-0225e222d973 req-1892d73e-c3cf-4b6a-815d-e8b2edd8ea1c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "01fd3eb8-b195-4b9c-8d52-752e50be6f30", "tag": "ce1cdf10-8100-44ae-9a55-7470bb0c09b0"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:53:51.060735 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-b4a12b71-8984-4b4e-88f4-0225e222d973 req-1892d73e-c3cf-4b6a-815d-e8b2edd8ea1c service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:51.061532 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-b4a12b71-8984-4b4e-88f4-0225e222d973 req-1892d73e-c3cf-4b6a-815d-e8b2edd8ea1c service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:51.062171 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-b4a12b71-8984-4b4e-88f4-0225e222d973 req-1892d73e-c3cf-4b6a-815d-e8b2edd8ea1c service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:51.075847 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-b4a12b71-8984-4b4e-88f4-0225e222d973 req-1892d73e-c3cf-4b6a-815d-e8b2edd8ea1c service nova] Creating event network-changed:ce1cdf10-8100-44ae-9a55-7470bb0c09b0 for instance 01fd3eb8-b195-4b9c-8d52-752e50be6f30 on n-h1-854823-8 Oct 04 20:53:51.083396 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-b4a12b71-8984-4b4e-88f4-0225e222d973 req-1892d73e-c3cf-4b6a-815d-e8b2edd8ea1c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037571 Oct 04 20:53:51.085048 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2094/4127] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:53:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:53:51.364732 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-7b0551c1-7f2c-4008-93b8-cd7c582d7040 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e93855201ca64c779f92a2a33979b81f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed328a1e964d46902dee5e1c7c7b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:53:51.380548 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-7b0551c1-7f2c-4008-93b8-cd7c582d7040 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] 10.222.0.33 "GET /compute/v2.1/servers/01fd3eb8-b195-4b9c-8d52-752e50be6f30" status: 200 len: 1318 microversion: 2.1 time: 0.534392 Oct 04 20:53:51.381700 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2034/4128] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:53:50 2022] GET /compute/v2.1/servers/01fd3eb8-b195-4b9c-8d52-752e50be6f30 => generated 1318 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:53:51.401916 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-7b1515ef-46ec-4e7e-b172-5a24e94910ee tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:53:51.403958 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-7b1515ef-46ec-4e7e-b172-5a24e94910ee tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] [instance: 9630289d-dcfd-4250-8910-a060f8696292] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:53:51.411847 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7b1515ef-46ec-4e7e-b172-5a24e94910ee tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:51.412617 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7b1515ef-46ec-4e7e-b172-5a24e94910ee tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:51.413205 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7b1515ef-46ec-4e7e-b172-5a24e94910ee tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:51.414119 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7b1515ef-46ec-4e7e-b172-5a24e94910ee tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:51.414887 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7b1515ef-46ec-4e7e-b172-5a24e94910ee tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:51.417807 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7b1515ef-46ec-4e7e-b172-5a24e94910ee tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:51.920557 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-4d2a4b1c-7790-465a-aadf-7200f9e29482 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:53:51.921160 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-4d2a4b1c-7790-465a-aadf-7200f9e29482 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] [instance: 866d0dd3-3c7e-4612-a132-48eb83ec2d16] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:53:51.933835 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4d2a4b1c-7790-465a-aadf-7200f9e29482 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:51.934599 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4d2a4b1c-7790-465a-aadf-7200f9e29482 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:51.935221 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4d2a4b1c-7790-465a-aadf-7200f9e29482 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:51.936098 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4d2a4b1c-7790-465a-aadf-7200f9e29482 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:51.939269 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4d2a4b1c-7790-465a-aadf-7200f9e29482 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:51.939899 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4d2a4b1c-7790-465a-aadf-7200f9e29482 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:51.943026 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-7b1515ef-46ec-4e7e-b172-5a24e94910ee tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c208ec9faf491385a9ab5b5932098d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ae4960393c464c97669731c2084d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:53:51.952299 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-7b1515ef-46ec-4e7e-b172-5a24e94910ee tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] 10.222.0.33 "GET /compute/v2.1/servers/9630289d-dcfd-4250-8910-a060f8696292" status: 200 len: 1511 microversion: 2.1 time: 0.555530 Oct 04 20:53:51.952837 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2095/4129] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:53:51 2022] GET /compute/v2.1/servers/9630289d-dcfd-4250-8910-a060f8696292 => generated 1511 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:53:52.318851 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-4d2a4b1c-7790-465a-aadf-7200f9e29482 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc4171c0ee14ebb8b5eff5e910ccf49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003eb03a265a496d8981e45c74b014f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:53:52.342882 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-4d2a4b1c-7790-465a-aadf-7200f9e29482 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] 10.222.0.33 "GET /compute/v2.1/servers/866d0dd3-3c7e-4612-a132-48eb83ec2d16" status: 200 len: 1736 microversion: 2.1 time: 0.426491 Oct 04 20:53:52.344114 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2035/4130] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:53:51 2022] GET /compute/v2.1/servers/866d0dd3-3c7e-4612-a132-48eb83ec2d16 => generated 1736 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:53:52.410370 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-7c7bc503-2a8f-486b-9eb7-6d0793bd8f5b tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:53:52.412831 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-7c7bc503-2a8f-486b-9eb7-6d0793bd8f5b tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] [instance: 01fd3eb8-b195-4b9c-8d52-752e50be6f30] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:53:52.426056 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7c7bc503-2a8f-486b-9eb7-6d0793bd8f5b tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:52.426888 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7c7bc503-2a8f-486b-9eb7-6d0793bd8f5b tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:52.427788 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7c7bc503-2a8f-486b-9eb7-6d0793bd8f5b tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:52.428867 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7c7bc503-2a8f-486b-9eb7-6d0793bd8f5b tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:52.430004 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7c7bc503-2a8f-486b-9eb7-6d0793bd8f5b tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:52.430638 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7c7bc503-2a8f-486b-9eb7-6d0793bd8f5b tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:52.983094 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-7c7bc503-2a8f-486b-9eb7-6d0793bd8f5b tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e93855201ca64c779f92a2a33979b81f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed328a1e964d46902dee5e1c7c7b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:53:52.987040 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e17343d6-ea7c-4210-a391-b304b20856b6 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:53:52.991510 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e17343d6-ea7c-4210-a391-b304b20856b6 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] [instance: 9630289d-dcfd-4250-8910-a060f8696292] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:53:53.006196 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e17343d6-ea7c-4210-a391-b304b20856b6 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:53.006721 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e17343d6-ea7c-4210-a391-b304b20856b6 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:53.007154 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e17343d6-ea7c-4210-a391-b304b20856b6 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:53.007859 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e17343d6-ea7c-4210-a391-b304b20856b6 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:53.008843 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-7c7bc503-2a8f-486b-9eb7-6d0793bd8f5b tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] 10.222.0.33 "GET /compute/v2.1/servers/01fd3eb8-b195-4b9c-8d52-752e50be6f30" status: 200 len: 1318 microversion: 2.1 time: 0.602763 Oct 04 20:53:53.010722 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2096/4131] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:53:52 2022] GET /compute/v2.1/servers/01fd3eb8-b195-4b9c-8d52-752e50be6f30 => generated 1318 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:53:53.021246 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e17343d6-ea7c-4210-a391-b304b20856b6 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:53.022497 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e17343d6-ea7c-4210-a391-b304b20856b6 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:53.356764 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e17343d6-ea7c-4210-a391-b304b20856b6 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c208ec9faf491385a9ab5b5932098d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ae4960393c464c97669731c2084d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:53:53.373198 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e17343d6-ea7c-4210-a391-b304b20856b6 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] 10.222.0.33 "GET /compute/v2.1/servers/9630289d-dcfd-4250-8910-a060f8696292" status: 200 len: 1511 microversion: 2.1 time: 0.397971 Oct 04 20:53:53.373856 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-39099265-d47b-4bdf-92c7-8e177f6ea25f tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:53:53.379370 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-39099265-d47b-4bdf-92c7-8e177f6ea25f tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] [instance: 866d0dd3-3c7e-4612-a132-48eb83ec2d16] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:53:53.395560 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-39099265-d47b-4bdf-92c7-8e177f6ea25f tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:53.396070 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-39099265-d47b-4bdf-92c7-8e177f6ea25f tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:53.398464 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-39099265-d47b-4bdf-92c7-8e177f6ea25f tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:53.398724 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2036/4132] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:53:52 2022] GET /compute/v2.1/servers/9630289d-dcfd-4250-8910-a060f8696292 => generated 1511 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:53:53.420215 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-39099265-d47b-4bdf-92c7-8e177f6ea25f tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:53.427103 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-39099265-d47b-4bdf-92c7-8e177f6ea25f tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:53.429490 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-39099265-d47b-4bdf-92c7-8e177f6ea25f tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:54.033091 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a5774091-3e60-4728-91c0-b4323fdbf94f tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:53:54.034413 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a5774091-3e60-4728-91c0-b4323fdbf94f tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] [instance: 01fd3eb8-b195-4b9c-8d52-752e50be6f30] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:53:54.044919 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a5774091-3e60-4728-91c0-b4323fdbf94f tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:54.045601 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a5774091-3e60-4728-91c0-b4323fdbf94f tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:54.046200 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a5774091-3e60-4728-91c0-b4323fdbf94f tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:54.047101 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a5774091-3e60-4728-91c0-b4323fdbf94f tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:54.047707 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a5774091-3e60-4728-91c0-b4323fdbf94f tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:54.048300 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a5774091-3e60-4728-91c0-b4323fdbf94f tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:54.313204 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-39099265-d47b-4bdf-92c7-8e177f6ea25f tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc4171c0ee14ebb8b5eff5e910ccf49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003eb03a265a496d8981e45c74b014f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:53:54.326521 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-39099265-d47b-4bdf-92c7-8e177f6ea25f tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] 10.222.0.33 "GET /compute/v2.1/servers/866d0dd3-3c7e-4612-a132-48eb83ec2d16" status: 200 len: 1736 microversion: 2.1 time: 0.959272 Oct 04 20:53:54.328804 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2097/4133] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:53:53 2022] GET /compute/v2.1/servers/866d0dd3-3c7e-4612-a132-48eb83ec2d16 => generated 1736 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:53:54.401958 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-7da8e68a-182d-44c4-a925-726f302c77ee tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:53:54.402797 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-7da8e68a-182d-44c4-a925-726f302c77ee tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] [instance: 9630289d-dcfd-4250-8910-a060f8696292] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:53:54.413963 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7da8e68a-182d-44c4-a925-726f302c77ee tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:54.414694 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7da8e68a-182d-44c4-a925-726f302c77ee tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:54.415141 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7da8e68a-182d-44c4-a925-726f302c77ee tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:54.422788 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7da8e68a-182d-44c4-a925-726f302c77ee tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:54.423411 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7da8e68a-182d-44c4-a925-726f302c77ee tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:54.423837 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7da8e68a-182d-44c4-a925-726f302c77ee tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:54.632985 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-a5774091-3e60-4728-91c0-b4323fdbf94f tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e93855201ca64c779f92a2a33979b81f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed328a1e964d46902dee5e1c7c7b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:53:54.642548 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a5774091-3e60-4728-91c0-b4323fdbf94f tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] 10.222.0.33 "GET /compute/v2.1/servers/01fd3eb8-b195-4b9c-8d52-752e50be6f30" status: 200 len: 1318 microversion: 2.1 time: 0.613192 Oct 04 20:53:54.655636 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2037/4134] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:53:54 2022] GET /compute/v2.1/servers/01fd3eb8-b195-4b9c-8d52-752e50be6f30 => generated 1318 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:53:54.884805 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-7da8e68a-182d-44c4-a925-726f302c77ee tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c208ec9faf491385a9ab5b5932098d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ae4960393c464c97669731c2084d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:53:54.893986 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-7da8e68a-182d-44c4-a925-726f302c77ee tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] 10.222.0.33 "GET /compute/v2.1/servers/9630289d-dcfd-4250-8910-a060f8696292" status: 200 len: 1511 microversion: 2.1 time: 0.496682 Oct 04 20:53:54.910749 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2098/4135] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:53:54 2022] GET /compute/v2.1/servers/9630289d-dcfd-4250-8910-a060f8696292 => generated 1511 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:53:55.356797 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5fa71c7f-997e-4c33-930c-566190ec623b tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:53:55.357533 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-5fa71c7f-997e-4c33-930c-566190ec623b tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] [instance: 866d0dd3-3c7e-4612-a132-48eb83ec2d16] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:53:55.364468 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5fa71c7f-997e-4c33-930c-566190ec623b tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:55.365263 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5fa71c7f-997e-4c33-930c-566190ec623b tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:55.365800 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5fa71c7f-997e-4c33-930c-566190ec623b tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:55.366637 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5fa71c7f-997e-4c33-930c-566190ec623b tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:55.367318 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5fa71c7f-997e-4c33-930c-566190ec623b tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:55.367828 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5fa71c7f-997e-4c33-930c-566190ec623b tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:55.620071 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-5fa71c7f-997e-4c33-930c-566190ec623b tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc4171c0ee14ebb8b5eff5e910ccf49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003eb03a265a496d8981e45c74b014f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:53:55.629423 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5fa71c7f-997e-4c33-930c-566190ec623b tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] 10.222.0.33 "GET /compute/v2.1/servers/866d0dd3-3c7e-4612-a132-48eb83ec2d16" status: 200 len: 1736 microversion: 2.1 time: 0.279007 Oct 04 20:53:55.630379 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2038/4136] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:53:55 2022] GET /compute/v2.1/servers/866d0dd3-3c7e-4612-a132-48eb83ec2d16 => generated 1736 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:53:55.667793 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-fe21c9c3-9196-495b-803e-6377ea97eb1a tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:53:55.669167 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-fe21c9c3-9196-495b-803e-6377ea97eb1a tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] [instance: 01fd3eb8-b195-4b9c-8d52-752e50be6f30] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:53:55.676742 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fe21c9c3-9196-495b-803e-6377ea97eb1a tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:55.677610 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fe21c9c3-9196-495b-803e-6377ea97eb1a tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:55.678261 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fe21c9c3-9196-495b-803e-6377ea97eb1a tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:55.679242 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fe21c9c3-9196-495b-803e-6377ea97eb1a tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:55.679914 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fe21c9c3-9196-495b-803e-6377ea97eb1a tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:55.680554 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fe21c9c3-9196-495b-803e-6377ea97eb1a tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:55.919671 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-98f17a59-08d9-4f9d-b745-e6b4430e5b93 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:53:55.921075 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-98f17a59-08d9-4f9d-b745-e6b4430e5b93 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] [instance: 9630289d-dcfd-4250-8910-a060f8696292] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:53:55.928013 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-98f17a59-08d9-4f9d-b745-e6b4430e5b93 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:55.928756 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-98f17a59-08d9-4f9d-b745-e6b4430e5b93 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:55.929365 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-98f17a59-08d9-4f9d-b745-e6b4430e5b93 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:55.930242 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-98f17a59-08d9-4f9d-b745-e6b4430e5b93 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:55.931634 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-98f17a59-08d9-4f9d-b745-e6b4430e5b93 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:55.932882 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-98f17a59-08d9-4f9d-b745-e6b4430e5b93 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:55.972629 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-fe21c9c3-9196-495b-803e-6377ea97eb1a tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e93855201ca64c779f92a2a33979b81f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed328a1e964d46902dee5e1c7c7b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:53:55.987538 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-fe21c9c3-9196-495b-803e-6377ea97eb1a tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] 10.222.0.33 "GET /compute/v2.1/servers/01fd3eb8-b195-4b9c-8d52-752e50be6f30" status: 200 len: 1318 microversion: 2.1 time: 0.323669 Oct 04 20:53:55.988278 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2099/4137] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:53:55 2022] GET /compute/v2.1/servers/01fd3eb8-b195-4b9c-8d52-752e50be6f30 => generated 1318 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:53:56.200996 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-98f17a59-08d9-4f9d-b745-e6b4430e5b93 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c208ec9faf491385a9ab5b5932098d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ae4960393c464c97669731c2084d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:53:56.211218 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-98f17a59-08d9-4f9d-b745-e6b4430e5b93 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] 10.222.0.33 "GET /compute/v2.1/servers/9630289d-dcfd-4250-8910-a060f8696292" status: 200 len: 1511 microversion: 2.1 time: 0.296724 Oct 04 20:53:56.211915 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2039/4138] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:53:55 2022] GET /compute/v2.1/servers/9630289d-dcfd-4250-8910-a060f8696292 => generated 1511 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:53:56.655789 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-06450015-37bd-4b7b-9c49-9321c23939b8 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:53:56.658867 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-06450015-37bd-4b7b-9c49-9321c23939b8 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] [instance: 866d0dd3-3c7e-4612-a132-48eb83ec2d16] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:53:56.665665 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-06450015-37bd-4b7b-9c49-9321c23939b8 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:56.666310 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-06450015-37bd-4b7b-9c49-9321c23939b8 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:56.666859 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-06450015-37bd-4b7b-9c49-9321c23939b8 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:56.667659 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-06450015-37bd-4b7b-9c49-9321c23939b8 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:56.668190 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-06450015-37bd-4b7b-9c49-9321c23939b8 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:56.668747 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-06450015-37bd-4b7b-9c49-9321c23939b8 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:56.745577 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-bc541591-1c05-4e88-9f61-be9a0a073a48 req-bc43815d-cf95-40d6-b4c5-1b02b5d691ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01fd3eb8-b195-4b9c-8d52-752e50be6f30", "name": "network-vif-plugged", "status": "completed", "tag": "ce1cdf10-8100-44ae-9a55-7470bb0c09b0"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:53:56.778232 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-bc541591-1c05-4e88-9f61-be9a0a073a48 req-bc43815d-cf95-40d6-b4c5-1b02b5d691ba service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:56.780084 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-bc541591-1c05-4e88-9f61-be9a0a073a48 req-bc43815d-cf95-40d6-b4c5-1b02b5d691ba service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:56.781249 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-bc541591-1c05-4e88-9f61-be9a0a073a48 req-bc43815d-cf95-40d6-b4c5-1b02b5d691ba service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:56.835067 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-bc541591-1c05-4e88-9f61-be9a0a073a48 req-bc43815d-cf95-40d6-b4c5-1b02b5d691ba service nova] Creating event network-vif-plugged:ce1cdf10-8100-44ae-9a55-7470bb0c09b0 for instance 01fd3eb8-b195-4b9c-8d52-752e50be6f30 on n-h1-854823-8 Oct 04 20:53:56.850303 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-bc541591-1c05-4e88-9f61-be9a0a073a48 req-bc43815d-cf95-40d6-b4c5-1b02b5d691ba service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113128 Oct 04 20:53:56.852155 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2040/4139] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:53:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 20:53:57.020201 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5bed31ee-368d-4ad0-9ba6-a621a8510f5a tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:53:57.021506 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-5bed31ee-368d-4ad0-9ba6-a621a8510f5a tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] [instance: 01fd3eb8-b195-4b9c-8d52-752e50be6f30] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:53:57.042865 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5bed31ee-368d-4ad0-9ba6-a621a8510f5a tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:57.044891 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5bed31ee-368d-4ad0-9ba6-a621a8510f5a tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:57.045963 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5bed31ee-368d-4ad0-9ba6-a621a8510f5a tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:57.046730 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5bed31ee-368d-4ad0-9ba6-a621a8510f5a tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:57.051829 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5bed31ee-368d-4ad0-9ba6-a621a8510f5a tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:57.052293 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5bed31ee-368d-4ad0-9ba6-a621a8510f5a tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:57.365502 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-06450015-37bd-4b7b-9c49-9321c23939b8 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc4171c0ee14ebb8b5eff5e910ccf49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003eb03a265a496d8981e45c74b014f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:53:57.384044 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-06450015-37bd-4b7b-9c49-9321c23939b8 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] 10.222.0.33 "GET /compute/v2.1/servers/866d0dd3-3c7e-4612-a132-48eb83ec2d16" status: 200 len: 1736 microversion: 2.1 time: 0.729416 Oct 04 20:53:57.386236 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2100/4140] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:53:56 2022] GET /compute/v2.1/servers/866d0dd3-3c7e-4612-a132-48eb83ec2d16 => generated 1736 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:53:57.402023 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-a1b5ed54-7d07-4fed-8288-031c86baf7ab tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:53:57.409466 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-a1b5ed54-7d07-4fed-8288-031c86baf7ab tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] [instance: 9630289d-dcfd-4250-8910-a060f8696292] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:53:57.429845 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a1b5ed54-7d07-4fed-8288-031c86baf7ab tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:57.430651 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a1b5ed54-7d07-4fed-8288-031c86baf7ab tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:57.431246 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a1b5ed54-7d07-4fed-8288-031c86baf7ab tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:57.433068 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a1b5ed54-7d07-4fed-8288-031c86baf7ab tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:57.433723 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a1b5ed54-7d07-4fed-8288-031c86baf7ab tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:57.434165 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a1b5ed54-7d07-4fed-8288-031c86baf7ab tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:57.659919 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-5bed31ee-368d-4ad0-9ba6-a621a8510f5a tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e93855201ca64c779f92a2a33979b81f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed328a1e964d46902dee5e1c7c7b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:53:57.669402 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5bed31ee-368d-4ad0-9ba6-a621a8510f5a tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] 10.222.0.33 "GET /compute/v2.1/servers/01fd3eb8-b195-4b9c-8d52-752e50be6f30" status: 200 len: 1318 microversion: 2.1 time: 0.660773 Oct 04 20:53:57.694537 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2041/4141] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:53:57 2022] GET /compute/v2.1/servers/01fd3eb8-b195-4b9c-8d52-752e50be6f30 => generated 1318 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:53:57.893207 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-a1b5ed54-7d07-4fed-8288-031c86baf7ab tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c208ec9faf491385a9ab5b5932098d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ae4960393c464c97669731c2084d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:53:57.912481 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-a1b5ed54-7d07-4fed-8288-031c86baf7ab tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] 10.222.0.33 "GET /compute/v2.1/servers/9630289d-dcfd-4250-8910-a060f8696292" status: 200 len: 1511 microversion: 2.1 time: 0.524271 Oct 04 20:53:57.913324 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2101/4142] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:53:57 2022] GET /compute/v2.1/servers/9630289d-dcfd-4250-8910-a060f8696292 => generated 1511 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:53:57.986493 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9b4ee470-d20a-4d1a-a43f-6de70fdfc676 tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesTestJSON-server-1107620739", "imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63", "flavorRef": "452", "networks": [{"uuid": "a479df96-01c1-4e73-9573-d1f25b3e1a4b"}]}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:53:58.066459 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.network.neutron [None req-9b4ee470-d20a-4d1a-a43f-6de70fdfc676 tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] validate_networks() for [('a479df96-01c1-4e73-9573-d1f25b3e1a4b', None, None, None, None, None)] {{(pid=128801) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:53:58.413264 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-b1f6a435-a4f9-4bbd-b2c6-bdc648cb001a tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:53:58.414599 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-b1f6a435-a4f9-4bbd-b2c6-bdc648cb001a tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] [instance: 866d0dd3-3c7e-4612-a132-48eb83ec2d16] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:53:58.426315 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b1f6a435-a4f9-4bbd-b2c6-bdc648cb001a tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:58.426857 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b1f6a435-a4f9-4bbd-b2c6-bdc648cb001a tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:58.429644 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b1f6a435-a4f9-4bbd-b2c6-bdc648cb001a tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:58.431099 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b1f6a435-a4f9-4bbd-b2c6-bdc648cb001a tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:58.433672 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b1f6a435-a4f9-4bbd-b2c6-bdc648cb001a tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:58.434541 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b1f6a435-a4f9-4bbd-b2c6-bdc648cb001a tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:59.133840 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-b1f6a435-a4f9-4bbd-b2c6-bdc648cb001a tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc4171c0ee14ebb8b5eff5e910ccf49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003eb03a265a496d8981e45c74b014f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:53:59.153046 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=100 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:53:59.164721 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-b1f6a435-a4f9-4bbd-b2c6-bdc648cb001a tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] 10.222.0.33 "GET /compute/v2.1/servers/866d0dd3-3c7e-4612-a132-48eb83ec2d16" status: 200 len: 1736 microversion: 2.1 time: 0.755661 Oct 04 20:53:59.176510 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2102/4143] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:53:58 2022] GET /compute/v2.1/servers/866d0dd3-3c7e-4612-a132-48eb83ec2d16 => generated 1736 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:53:59.191794 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-b48137f6-d1a3-42fe-aa1a-8565f7967344 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:53:59.195239 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-b48137f6-d1a3-42fe-aa1a-8565f7967344 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] [instance: 01fd3eb8-b195-4b9c-8d52-752e50be6f30] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:53:59.214275 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b48137f6-d1a3-42fe-aa1a-8565f7967344 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:59.226699 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b48137f6-d1a3-42fe-aa1a-8565f7967344 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:59.229286 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b48137f6-d1a3-42fe-aa1a-8565f7967344 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:53:59.235132 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b48137f6-d1a3-42fe-aa1a-8565f7967344 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:53:59.235875 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b48137f6-d1a3-42fe-aa1a-8565f7967344 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:53:59.236534 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b48137f6-d1a3-42fe-aa1a-8565f7967344 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:00.527397 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-9b4ee470-d20a-4d1a-a43f-6de70fdfc676 tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] Flavor limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:54:00.528639 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-9b4ee470-d20a-4d1a-a43f-6de70fdfc676 tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] Image limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:54:00.529331 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-9b4ee470-d20a-4d1a-a43f-6de70fdfc676 tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] Flavor pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:54:00.530442 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-9b4ee470-d20a-4d1a-a43f-6de70fdfc676 tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] Image pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:54:00.531211 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-9b4ee470-d20a-4d1a-a43f-6de70fdfc676 tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:54:00.553406 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9b4ee470-d20a-4d1a-a43f-6de70fdfc676 tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:00.555862 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9b4ee470-d20a-4d1a-a43f-6de70fdfc676 tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:00.558009 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9b4ee470-d20a-4d1a-a43f-6de70fdfc676 tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:00.565091 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9b4ee470-d20a-4d1a-a43f-6de70fdfc676 tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:00.566553 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9b4ee470-d20a-4d1a-a43f-6de70fdfc676 tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:00.567224 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9b4ee470-d20a-4d1a-a43f-6de70fdfc676 tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:00.612052 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-9b4ee470-d20a-4d1a-a43f-6de70fdfc676 tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] Getting quotas for project 87d49cd04ac04f578b78d43cca1cd2df. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:54:00.630804 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-9b4ee470-d20a-4d1a-a43f-6de70fdfc676 tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] Getting quotas for user 878cd5eab53247ae994c74a31c04f37b and project 87d49cd04ac04f578b78d43cca1cd2df. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:54:00.660438 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-9b4ee470-d20a-4d1a-a43f-6de70fdfc676 tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] Going to run 1 instances... {{(pid=128801) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:54:00.668856 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-9b4ee470-d20a-4d1a-a43f-6de70fdfc676 tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] [instance: 424127c5-245d-4486-a2e8-504cff0bcd85] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='15b24725-0c99-4bcf-b1fb-907cdf8e2d63',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128801) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:54:00.798486 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-9b4ee470-d20a-4d1a-a43f-6de70fdfc676 tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.101474 Oct 04 20:54:00.809325 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2042/4144] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 20:53:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 3113 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 20:54:00.820548 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-046552cf-c5fc-4866-9ebf-1e14a42d4e37 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:00.821335 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-046552cf-c5fc-4866-9ebf-1e14a42d4e37 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] [instance: 9630289d-dcfd-4250-8910-a060f8696292] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:00.844407 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-046552cf-c5fc-4866-9ebf-1e14a42d4e37 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:00.845372 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-046552cf-c5fc-4866-9ebf-1e14a42d4e37 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:00.846043 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-046552cf-c5fc-4866-9ebf-1e14a42d4e37 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:00.846987 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-046552cf-c5fc-4866-9ebf-1e14a42d4e37 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:00.847700 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-046552cf-c5fc-4866-9ebf-1e14a42d4e37 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:00.848720 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-046552cf-c5fc-4866-9ebf-1e14a42d4e37 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:00.858152 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-b48137f6-d1a3-42fe-aa1a-8565f7967344 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e93855201ca64c779f92a2a33979b81f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed328a1e964d46902dee5e1c7c7b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:00.867437 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-b48137f6-d1a3-42fe-aa1a-8565f7967344 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] 10.222.0.33 "GET /compute/v2.1/servers/01fd3eb8-b195-4b9c-8d52-752e50be6f30" status: 200 len: 1507 microversion: 2.1 time: 1.689153 Oct 04 20:54:00.883443 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2103/4145] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:53:59 2022] GET /compute/v2.1/servers/01fd3eb8-b195-4b9c-8d52-752e50be6f30 => generated 1507 bytes in 1706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:54:00.896421 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-58d20b00-d9fa-4430-bae9-2c2fd51c7659 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:00.897258 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-58d20b00-d9fa-4430-bae9-2c2fd51c7659 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] [instance: 866d0dd3-3c7e-4612-a132-48eb83ec2d16] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:00.903725 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-58d20b00-d9fa-4430-bae9-2c2fd51c7659 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:00.904443 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-58d20b00-d9fa-4430-bae9-2c2fd51c7659 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:00.905064 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-58d20b00-d9fa-4430-bae9-2c2fd51c7659 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:00.906179 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-58d20b00-d9fa-4430-bae9-2c2fd51c7659 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:00.906894 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-58d20b00-d9fa-4430-bae9-2c2fd51c7659 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:00.909036 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-58d20b00-d9fa-4430-bae9-2c2fd51c7659 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:01.713588 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-58d20b00-d9fa-4430-bae9-2c2fd51c7659 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc4171c0ee14ebb8b5eff5e910ccf49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003eb03a265a496d8981e45c74b014f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:01.753930 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-58d20b00-d9fa-4430-bae9-2c2fd51c7659 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] 10.222.0.33 "GET /compute/v2.1/servers/866d0dd3-3c7e-4612-a132-48eb83ec2d16" status: 200 len: 1736 microversion: 2.1 time: 0.868979 Oct 04 20:54:01.780308 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2104/4146] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:54:00 2022] GET /compute/v2.1/servers/866d0dd3-3c7e-4612-a132-48eb83ec2d16 => generated 1736 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:54:01.795527 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-965448d6-8c8b-4f88-a1b1-cc41e9f9c3b5 tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:01.797385 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-965448d6-8c8b-4f88-a1b1-cc41e9f9c3b5 tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] [instance: 424127c5-245d-4486-a2e8-504cff0bcd85] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:01.833272 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_api:SELECT=52 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:54:01.839332 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-965448d6-8c8b-4f88-a1b1-cc41e9f9c3b5 tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:01.840273 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-965448d6-8c8b-4f88-a1b1-cc41e9f9c3b5 tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:01.841669 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-965448d6-8c8b-4f88-a1b1-cc41e9f9c3b5 tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:01.847044 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-965448d6-8c8b-4f88-a1b1-cc41e9f9c3b5 tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:01.848810 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-965448d6-8c8b-4f88-a1b1-cc41e9f9c3b5 tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:01.849520 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-965448d6-8c8b-4f88-a1b1-cc41e9f9c3b5 tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:01.979855 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-965448d6-8c8b-4f88-a1b1-cc41e9f9c3b5 tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '878cd5eab53247ae994c74a31c04f37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d49cd04ac04f578b78d43cca1cd2df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:01.993331 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-965448d6-8c8b-4f88-a1b1-cc41e9f9c3b5 tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] 10.222.0.33 "GET /compute/v2.1/servers/424127c5-245d-4486-a2e8-504cff0bcd85" status: 200 len: 1221 microversion: 2.1 time: 0.211546 Oct 04 20:54:02.029269 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2105/4147] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:54:01 2022] GET /compute/v2.1/servers/424127c5-245d-4486-a2e8-504cff0bcd85 => generated 1221 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:54:02.049533 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-7debb2a6-6f19-40fe-8301-41e20d51d681 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:02.051660 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-7debb2a6-6f19-40fe-8301-41e20d51d681 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] [instance: 01fd3eb8-b195-4b9c-8d52-752e50be6f30] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:02.064229 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7debb2a6-6f19-40fe-8301-41e20d51d681 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:02.065118 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7debb2a6-6f19-40fe-8301-41e20d51d681 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:02.065745 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7debb2a6-6f19-40fe-8301-41e20d51d681 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:02.066625 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7debb2a6-6f19-40fe-8301-41e20d51d681 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:02.075023 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7debb2a6-6f19-40fe-8301-41e20d51d681 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:02.075229 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-046552cf-c5fc-4866-9ebf-1e14a42d4e37 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c208ec9faf491385a9ab5b5932098d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ae4960393c464c97669731c2084d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:02.076646 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7debb2a6-6f19-40fe-8301-41e20d51d681 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:02.086739 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-046552cf-c5fc-4866-9ebf-1e14a42d4e37 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] 10.222.0.33 "GET /compute/v2.1/servers/9630289d-dcfd-4250-8910-a060f8696292" status: 200 len: 1488 microversion: 2.1 time: 1.274871 Oct 04 20:54:02.087346 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2043/4148] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:54:00 2022] GET /compute/v2.1/servers/9630289d-dcfd-4250-8910-a060f8696292 => generated 1488 bytes in 1277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:54:02.116684 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0c9cdd72-ef42-466d-801e-6208ceec83ca tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:02.117382 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-0c9cdd72-ef42-466d-801e-6208ceec83ca tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] [instance: 9630289d-dcfd-4250-8910-a060f8696292] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:02.147553 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0c9cdd72-ef42-466d-801e-6208ceec83ca tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:02.148059 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0c9cdd72-ef42-466d-801e-6208ceec83ca tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:02.148504 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0c9cdd72-ef42-466d-801e-6208ceec83ca tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:02.150037 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0c9cdd72-ef42-466d-801e-6208ceec83ca tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:02.150037 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0c9cdd72-ef42-466d-801e-6208ceec83ca tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:02.150306 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0c9cdd72-ef42-466d-801e-6208ceec83ca tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:02.239509 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-0c9cdd72-ef42-466d-801e-6208ceec83ca tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] [instance: 9630289d-dcfd-4250-8910-a060f8696292] Going to try to terminate instance {{(pid=128801) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:54:02.438803 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-0c9cdd72-ef42-466d-801e-6208ceec83ca tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] 10.222.0.33 "DELETE /compute/v2.1/servers/9630289d-dcfd-4250-8910-a060f8696292" status: 204 len: 0 microversion: 2.1 time: 0.325787 Oct 04 20:54:02.442561 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2044/4149] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 20:54:02 2022] DELETE /compute/v2.1/servers/9630289d-dcfd-4250-8910-a060f8696292 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:54:02.448539 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7f53d6df-8815-4b4b-a738-33999c74d5de tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:02.449377 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-7f53d6df-8815-4b4b-a738-33999c74d5de tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] [instance: 9630289d-dcfd-4250-8910-a060f8696292] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:02.457954 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7f53d6df-8815-4b4b-a738-33999c74d5de tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:02.458526 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7f53d6df-8815-4b4b-a738-33999c74d5de tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:02.459160 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7f53d6df-8815-4b4b-a738-33999c74d5de tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:02.460012 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7f53d6df-8815-4b4b-a738-33999c74d5de tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:02.460622 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7f53d6df-8815-4b4b-a738-33999c74d5de tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:02.461198 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7f53d6df-8815-4b4b-a738-33999c74d5de tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:02.844353 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-7debb2a6-6f19-40fe-8301-41e20d51d681 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e93855201ca64c779f92a2a33979b81f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed328a1e964d46902dee5e1c7c7b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:02.857470 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-7debb2a6-6f19-40fe-8301-41e20d51d681 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] 10.222.0.33 "GET /compute/v2.1/servers/01fd3eb8-b195-4b9c-8d52-752e50be6f30" status: 200 len: 1507 microversion: 2.1 time: 0.826744 Oct 04 20:54:02.858261 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2106/4150] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:54:02 2022] GET /compute/v2.1/servers/01fd3eb8-b195-4b9c-8d52-752e50be6f30 => generated 1507 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:54:02.864972 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-aba6ed77-6513-45a5-b7ac-c48955556f0f tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:02.872893 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-aba6ed77-6513-45a5-b7ac-c48955556f0f tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] [instance: 866d0dd3-3c7e-4612-a132-48eb83ec2d16] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:02.897719 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-aba6ed77-6513-45a5-b7ac-c48955556f0f tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:02.898533 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-aba6ed77-6513-45a5-b7ac-c48955556f0f tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:02.899172 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-aba6ed77-6513-45a5-b7ac-c48955556f0f tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:02.901552 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-aba6ed77-6513-45a5-b7ac-c48955556f0f tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:02.902242 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-aba6ed77-6513-45a5-b7ac-c48955556f0f tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:02.902869 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-aba6ed77-6513-45a5-b7ac-c48955556f0f tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:03.058320 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-7f53d6df-8815-4b4b-a738-33999c74d5de tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c208ec9faf491385a9ab5b5932098d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ae4960393c464c97669731c2084d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:03.078787 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-7f53d6df-8815-4b4b-a738-33999c74d5de tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] 10.222.0.33 "GET /compute/v2.1/servers/9630289d-dcfd-4250-8910-a060f8696292" status: 200 len: 1494 microversion: 2.1 time: 0.634617 Oct 04 20:54:03.080518 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2045/4151] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:54:02 2022] GET /compute/v2.1/servers/9630289d-dcfd-4250-8910-a060f8696292 => generated 1494 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:54:03.085893 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-21dbdb84-32eb-4b8c-8378-6f833cdad36e tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63", "OS-DCF:diskConfig": "AUTO"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:54:03.090058 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-21dbdb84-32eb-4b8c-8378-6f833cdad36e tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] [instance: 01fd3eb8-b195-4b9c-8d52-752e50be6f30] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:03.099609 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-21dbdb84-32eb-4b8c-8378-6f833cdad36e tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:03.100792 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-21dbdb84-32eb-4b8c-8378-6f833cdad36e tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:03.101391 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-21dbdb84-32eb-4b8c-8378-6f833cdad36e tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:03.102285 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-21dbdb84-32eb-4b8c-8378-6f833cdad36e tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:03.104236 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-21dbdb84-32eb-4b8c-8378-6f833cdad36e tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:03.104850 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-21dbdb84-32eb-4b8c-8378-6f833cdad36e tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:03.228684 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-21dbdb84-32eb-4b8c-8378-6f833cdad36e tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Flavor limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:54:03.229458 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-21dbdb84-32eb-4b8c-8378-6f833cdad36e tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Image limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:54:03.229997 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-21dbdb84-32eb-4b8c-8378-6f833cdad36e tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Flavor pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:54:03.230754 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-21dbdb84-32eb-4b8c-8378-6f833cdad36e tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Image pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:54:03.231729 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-21dbdb84-32eb-4b8c-8378-6f833cdad36e tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:54:03.323203 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-21dbdb84-32eb-4b8c-8378-6f833cdad36e tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] [instance: 01fd3eb8-b195-4b9c-8d52-752e50be6f30] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:03.331389 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-21dbdb84-32eb-4b8c-8378-6f833cdad36e tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:03.332123 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-21dbdb84-32eb-4b8c-8378-6f833cdad36e tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:03.332567 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-21dbdb84-32eb-4b8c-8378-6f833cdad36e tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:03.333469 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-21dbdb84-32eb-4b8c-8378-6f833cdad36e tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:03.334120 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-21dbdb84-32eb-4b8c-8378-6f833cdad36e tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:03.334901 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-21dbdb84-32eb-4b8c-8378-6f833cdad36e tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:03.393430 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-21dbdb84-32eb-4b8c-8378-6f833cdad36e tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] 10.222.0.33 "POST /compute/v2.1/servers/01fd3eb8-b195-4b9c-8d52-752e50be6f30/action" status: 202 len: 1109 microversion: 2.1 time: 0.310841 Oct 04 20:54:03.395210 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2046/4152] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 20:54:03 2022] POST /compute/v2.1/servers/01fd3eb8-b195-4b9c-8d52-752e50be6f30/action => generated 1109 bytes in 313 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 04 20:54:03.403888 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-62f637da-7e6c-4cfc-9adf-681c889a92ab tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:03.404903 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-62f637da-7e6c-4cfc-9adf-681c889a92ab tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] [instance: 424127c5-245d-4486-a2e8-504cff0bcd85] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:03.413052 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-62f637da-7e6c-4cfc-9adf-681c889a92ab tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:03.414000 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-62f637da-7e6c-4cfc-9adf-681c889a92ab tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:03.414937 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-62f637da-7e6c-4cfc-9adf-681c889a92ab tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:03.416698 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-62f637da-7e6c-4cfc-9adf-681c889a92ab tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:03.417670 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-62f637da-7e6c-4cfc-9adf-681c889a92ab tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:03.418579 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-62f637da-7e6c-4cfc-9adf-681c889a92ab tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:03.560657 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-62f637da-7e6c-4cfc-9adf-681c889a92ab tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '878cd5eab53247ae994c74a31c04f37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d49cd04ac04f578b78d43cca1cd2df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:03.605298 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-62f637da-7e6c-4cfc-9adf-681c889a92ab tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] 10.222.0.33 "GET /compute/v2.1/servers/424127c5-245d-4486-a2e8-504cff0bcd85" status: 200 len: 1269 microversion: 2.1 time: 0.205081 Oct 04 20:54:03.611090 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2047/4153] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:54:03 2022] GET /compute/v2.1/servers/424127c5-245d-4486-a2e8-504cff0bcd85 => generated 1269 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:54:03.635448 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1a627d30-4ea4-4997-9eaf-2b6cb94dc21e tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:03.636948 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-1a627d30-4ea4-4997-9eaf-2b6cb94dc21e tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] [instance: 01fd3eb8-b195-4b9c-8d52-752e50be6f30] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:03.644629 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1a627d30-4ea4-4997-9eaf-2b6cb94dc21e tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:03.645492 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1a627d30-4ea4-4997-9eaf-2b6cb94dc21e tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:03.647384 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1a627d30-4ea4-4997-9eaf-2b6cb94dc21e tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:03.648924 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1a627d30-4ea4-4997-9eaf-2b6cb94dc21e tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:03.649599 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1a627d30-4ea4-4997-9eaf-2b6cb94dc21e tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:03.651737 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1a627d30-4ea4-4997-9eaf-2b6cb94dc21e tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:03.657067 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:54:03.729948 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-aba6ed77-6513-45a5-b7ac-c48955556f0f tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc4171c0ee14ebb8b5eff5e910ccf49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003eb03a265a496d8981e45c74b014f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:03.738273 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-aba6ed77-6513-45a5-b7ac-c48955556f0f tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] 10.222.0.33 "GET /compute/v2.1/servers/866d0dd3-3c7e-4612-a132-48eb83ec2d16" status: 200 len: 1736 microversion: 2.1 time: 0.876964 Oct 04 20:54:03.752497 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2107/4154] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:54:02 2022] GET /compute/v2.1/servers/866d0dd3-3c7e-4612-a132-48eb83ec2d16 => generated 1736 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:54:04.057315 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-1a627d30-4ea4-4997-9eaf-2b6cb94dc21e tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e93855201ca64c779f92a2a33979b81f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed328a1e964d46902dee5e1c7c7b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:04.065436 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-1a627d30-4ea4-4997-9eaf-2b6cb94dc21e tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] 10.222.0.33 "GET /compute/v2.1/servers/01fd3eb8-b195-4b9c-8d52-752e50be6f30" status: 200 len: 1514 microversion: 2.1 time: 0.452019 Oct 04 20:54:04.082629 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2048/4155] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:54:03 2022] GET /compute/v2.1/servers/01fd3eb8-b195-4b9c-8d52-752e50be6f30 => generated 1514 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:54:04.103688 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-849fd998-e817-4565-8ad4-e774c8c4ca26 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:04.104664 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-849fd998-e817-4565-8ad4-e774c8c4ca26 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] [instance: 9630289d-dcfd-4250-8910-a060f8696292] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:04.111438 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-849fd998-e817-4565-8ad4-e774c8c4ca26 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:04.112146 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-849fd998-e817-4565-8ad4-e774c8c4ca26 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:04.112939 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-849fd998-e817-4565-8ad4-e774c8c4ca26 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:04.113874 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-849fd998-e817-4565-8ad4-e774c8c4ca26 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:04.114503 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-849fd998-e817-4565-8ad4-e774c8c4ca26 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:04.115074 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-849fd998-e817-4565-8ad4-e774c8c4ca26 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:04.637735 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-88e48d75-797b-4020-85ee-eb36700a92cb tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:04.638379 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-88e48d75-797b-4020-85ee-eb36700a92cb tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] [instance: 424127c5-245d-4486-a2e8-504cff0bcd85] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:04.652704 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-88e48d75-797b-4020-85ee-eb36700a92cb tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:04.653204 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-88e48d75-797b-4020-85ee-eb36700a92cb tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:04.653835 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-88e48d75-797b-4020-85ee-eb36700a92cb tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:04.654596 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-88e48d75-797b-4020-85ee-eb36700a92cb tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:04.655059 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-88e48d75-797b-4020-85ee-eb36700a92cb tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:04.655485 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-88e48d75-797b-4020-85ee-eb36700a92cb tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:04.895750 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-88e48d75-797b-4020-85ee-eb36700a92cb tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '878cd5eab53247ae994c74a31c04f37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d49cd04ac04f578b78d43cca1cd2df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:04.923856 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-88e48d75-797b-4020-85ee-eb36700a92cb tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] 10.222.0.33 "GET /compute/v2.1/servers/424127c5-245d-4486-a2e8-504cff0bcd85" status: 200 len: 1275 microversion: 2.1 time: 0.287788 Oct 04 20:54:04.931210 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2049/4156] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:54:04 2022] GET /compute/v2.1/servers/424127c5-245d-4486-a2e8-504cff0bcd85 => generated 1275 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:54:04.980537 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f4747794-c809-47f5-b3d7-c09e73283693 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:04.985863 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f4747794-c809-47f5-b3d7-c09e73283693 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] [instance: 866d0dd3-3c7e-4612-a132-48eb83ec2d16] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:05.000179 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f4747794-c809-47f5-b3d7-c09e73283693 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:05.002291 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f4747794-c809-47f5-b3d7-c09e73283693 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:05.003344 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f4747794-c809-47f5-b3d7-c09e73283693 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:05.004325 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f4747794-c809-47f5-b3d7-c09e73283693 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:05.005792 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f4747794-c809-47f5-b3d7-c09e73283693 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:05.007120 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f4747794-c809-47f5-b3d7-c09e73283693 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:05.173175 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-849fd998-e817-4565-8ad4-e774c8c4ca26 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c208ec9faf491385a9ab5b5932098d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ae4960393c464c97669731c2084d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:05.182768 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-849fd998-e817-4565-8ad4-e774c8c4ca26 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] 10.222.0.33 "GET /compute/v2.1/servers/9630289d-dcfd-4250-8910-a060f8696292" status: 200 len: 1494 microversion: 2.1 time: 1.082998 Oct 04 20:54:05.201402 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2108/4157] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:54:04 2022] GET /compute/v2.1/servers/9630289d-dcfd-4250-8910-a060f8696292 => generated 1494 bytes in 1102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:54:05.208637 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-106dac72-3586-43ad-a01a-a6ff1104b0e4 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:05.209672 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-106dac72-3586-43ad-a01a-a6ff1104b0e4 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] [instance: 01fd3eb8-b195-4b9c-8d52-752e50be6f30] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:05.217235 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-106dac72-3586-43ad-a01a-a6ff1104b0e4 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:05.218074 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-106dac72-3586-43ad-a01a-a6ff1104b0e4 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:05.218774 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-106dac72-3586-43ad-a01a-a6ff1104b0e4 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:05.219708 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-106dac72-3586-43ad-a01a-a6ff1104b0e4 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:05.220678 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-106dac72-3586-43ad-a01a-a6ff1104b0e4 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:05.221343 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-106dac72-3586-43ad-a01a-a6ff1104b0e4 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:05.587800 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f4747794-c809-47f5-b3d7-c09e73283693 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc4171c0ee14ebb8b5eff5e910ccf49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003eb03a265a496d8981e45c74b014f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:05.597167 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f4747794-c809-47f5-b3d7-c09e73283693 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] 10.222.0.33 "GET /compute/v2.1/servers/866d0dd3-3c7e-4612-a132-48eb83ec2d16" status: 200 len: 1736 microversion: 2.1 time: 0.661739 Oct 04 20:54:05.601907 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2050/4158] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:54:04 2022] GET /compute/v2.1/servers/866d0dd3-3c7e-4612-a132-48eb83ec2d16 => generated 1736 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:54:05.823799 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-106dac72-3586-43ad-a01a-a6ff1104b0e4 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e93855201ca64c779f92a2a33979b81f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed328a1e964d46902dee5e1c7c7b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:05.840912 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-106dac72-3586-43ad-a01a-a6ff1104b0e4 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] 10.222.0.33 "GET /compute/v2.1/servers/01fd3eb8-b195-4b9c-8d52-752e50be6f30" status: 200 len: 1514 microversion: 2.1 time: 0.636960 Oct 04 20:54:05.843345 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2109/4159] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:54:05 2022] GET /compute/v2.1/servers/01fd3eb8-b195-4b9c-8d52-752e50be6f30 => generated 1514 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:54:05.957453 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d776fb5c-04a4-4c65-884e-71b4912b6f1e tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:05.958384 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d776fb5c-04a4-4c65-884e-71b4912b6f1e tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] [instance: 424127c5-245d-4486-a2e8-504cff0bcd85] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:05.972368 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d776fb5c-04a4-4c65-884e-71b4912b6f1e tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:05.973130 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d776fb5c-04a4-4c65-884e-71b4912b6f1e tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:05.973754 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d776fb5c-04a4-4c65-884e-71b4912b6f1e tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:05.983744 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d776fb5c-04a4-4c65-884e-71b4912b6f1e tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:05.984934 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d776fb5c-04a4-4c65-884e-71b4912b6f1e tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:05.985607 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d776fb5c-04a4-4c65-884e-71b4912b6f1e tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:06.153318 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d776fb5c-04a4-4c65-884e-71b4912b6f1e tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '878cd5eab53247ae994c74a31c04f37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d49cd04ac04f578b78d43cca1cd2df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:06.162554 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d776fb5c-04a4-4c65-884e-71b4912b6f1e tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] 10.222.0.33 "GET /compute/v2.1/servers/424127c5-245d-4486-a2e8-504cff0bcd85" status: 200 len: 1275 microversion: 2.1 time: 0.208804 Oct 04 20:54:06.169159 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2051/4160] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:54:05 2022] GET /compute/v2.1/servers/424127c5-245d-4486-a2e8-504cff0bcd85 => generated 1275 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:54:06.223048 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-5692704e-c1fe-4c2c-b004-3a04ddb05116 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:06.223606 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-5692704e-c1fe-4c2c-b004-3a04ddb05116 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] [instance: 9630289d-dcfd-4250-8910-a060f8696292] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:06.235386 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5692704e-c1fe-4c2c-b004-3a04ddb05116 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:06.237537 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5692704e-c1fe-4c2c-b004-3a04ddb05116 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:06.238901 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5692704e-c1fe-4c2c-b004-3a04ddb05116 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:06.240002 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5692704e-c1fe-4c2c-b004-3a04ddb05116 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:06.240716 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5692704e-c1fe-4c2c-b004-3a04ddb05116 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:06.241639 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5692704e-c1fe-4c2c-b004-3a04ddb05116 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:06.588856 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-5692704e-c1fe-4c2c-b004-3a04ddb05116 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c208ec9faf491385a9ab5b5932098d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ae4960393c464c97669731c2084d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:06.613084 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-5692704e-c1fe-4c2c-b004-3a04ddb05116 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] 10.222.0.33 "GET /compute/v2.1/servers/9630289d-dcfd-4250-8910-a060f8696292" status: 200 len: 1452 microversion: 2.1 time: 0.398416 Oct 04 20:54:06.614456 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2110/4161] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:54:06 2022] GET /compute/v2.1/servers/9630289d-dcfd-4250-8910-a060f8696292 => generated 1452 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:54:06.636213 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-41ccc335-6dd1-4dbf-bb0c-a3aceca11198 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:06.636825 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-41ccc335-6dd1-4dbf-bb0c-a3aceca11198 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] [instance: 866d0dd3-3c7e-4612-a132-48eb83ec2d16] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:06.663991 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-41ccc335-6dd1-4dbf-bb0c-a3aceca11198 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:06.664976 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-41ccc335-6dd1-4dbf-bb0c-a3aceca11198 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:06.665430 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-41ccc335-6dd1-4dbf-bb0c-a3aceca11198 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:06.666185 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-41ccc335-6dd1-4dbf-bb0c-a3aceca11198 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:06.666680 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-41ccc335-6dd1-4dbf-bb0c-a3aceca11198 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:06.667112 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-41ccc335-6dd1-4dbf-bb0c-a3aceca11198 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:06.870497 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-cdf1382e-1721-4775-9e3e-7bf2f99499cd tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:06.871421 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-cdf1382e-1721-4775-9e3e-7bf2f99499cd tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] [instance: 01fd3eb8-b195-4b9c-8d52-752e50be6f30] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:06.899015 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cdf1382e-1721-4775-9e3e-7bf2f99499cd tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:06.905793 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cdf1382e-1721-4775-9e3e-7bf2f99499cd tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:06.908390 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cdf1382e-1721-4775-9e3e-7bf2f99499cd tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:06.909267 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cdf1382e-1721-4775-9e3e-7bf2f99499cd tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:06.909926 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cdf1382e-1721-4775-9e3e-7bf2f99499cd tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:06.911868 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cdf1382e-1721-4775-9e3e-7bf2f99499cd tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:07.065823 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-41ccc335-6dd1-4dbf-bb0c-a3aceca11198 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc4171c0ee14ebb8b5eff5e910ccf49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003eb03a265a496d8981e45c74b014f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:07.077302 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-41ccc335-6dd1-4dbf-bb0c-a3aceca11198 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] 10.222.0.33 "GET /compute/v2.1/servers/866d0dd3-3c7e-4612-a132-48eb83ec2d16" status: 200 len: 1736 microversion: 2.1 time: 0.445671 Oct 04 20:54:07.083476 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2052/4162] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:54:06 2022] GET /compute/v2.1/servers/866d0dd3-3c7e-4612-a132-48eb83ec2d16 => generated 1736 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:54:07.094583 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-a320edb1-4e5e-4404-b3ad-e8160dbe7416 req-66dbfb0c-6810-4af3-971e-4779d8e3dd22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9630289d-dcfd-4250-8910-a060f8696292", "name": "network-vif-deleted", "tag": "466d8872-1f41-40c1-9ab8-5a3dcff5497e"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:54:07.116482 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-a320edb1-4e5e-4404-b3ad-e8160dbe7416 req-66dbfb0c-6810-4af3-971e-4779d8e3dd22 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:07.119704 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-a320edb1-4e5e-4404-b3ad-e8160dbe7416 req-66dbfb0c-6810-4af3-971e-4779d8e3dd22 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:07.123653 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-a320edb1-4e5e-4404-b3ad-e8160dbe7416 req-66dbfb0c-6810-4af3-971e-4779d8e3dd22 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:07.174793 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-a320edb1-4e5e-4404-b3ad-e8160dbe7416 req-66dbfb0c-6810-4af3-971e-4779d8e3dd22 service nova] Creating event network-vif-deleted:466d8872-1f41-40c1-9ab8-5a3dcff5497e for instance 9630289d-dcfd-4250-8910-a060f8696292 on n-h2-854823-8 Oct 04 20:54:07.204342 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-a320edb1-4e5e-4404-b3ad-e8160dbe7416 req-66dbfb0c-6810-4af3-971e-4779d8e3dd22 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119068 Oct 04 20:54:07.208922 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2053/4163] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:54:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:54:07.227748 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8d7bbe30-eaa6-4783-9b2f-db4269289266 tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:07.228828 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-8d7bbe30-eaa6-4783-9b2f-db4269289266 tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] [instance: 424127c5-245d-4486-a2e8-504cff0bcd85] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:07.246929 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8d7bbe30-eaa6-4783-9b2f-db4269289266 tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:07.247673 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8d7bbe30-eaa6-4783-9b2f-db4269289266 tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:07.249627 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8d7bbe30-eaa6-4783-9b2f-db4269289266 tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:07.251933 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8d7bbe30-eaa6-4783-9b2f-db4269289266 tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:07.253302 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8d7bbe30-eaa6-4783-9b2f-db4269289266 tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:07.254241 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8d7bbe30-eaa6-4783-9b2f-db4269289266 tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:07.581118 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-8d7bbe30-eaa6-4783-9b2f-db4269289266 tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '878cd5eab53247ae994c74a31c04f37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d49cd04ac04f578b78d43cca1cd2df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:07.600681 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-8d7bbe30-eaa6-4783-9b2f-db4269289266 tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] 10.222.0.33 "GET /compute/v2.1/servers/424127c5-245d-4486-a2e8-504cff0bcd85" status: 200 len: 1275 microversion: 2.1 time: 0.388530 Oct 04 20:54:07.605960 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2054/4164] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:54:07 2022] GET /compute/v2.1/servers/424127c5-245d-4486-a2e8-504cff0bcd85 => generated 1275 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:54:07.638021 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f27aac42-f2c8-4372-b9a0-fc166cd78297 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:07.640191 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f27aac42-f2c8-4372-b9a0-fc166cd78297 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] [instance: 9630289d-dcfd-4250-8910-a060f8696292] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:07.654275 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f27aac42-f2c8-4372-b9a0-fc166cd78297 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:07.657269 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f27aac42-f2c8-4372-b9a0-fc166cd78297 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:07.657740 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f27aac42-f2c8-4372-b9a0-fc166cd78297 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:07.658543 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f27aac42-f2c8-4372-b9a0-fc166cd78297 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:07.659017 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f27aac42-f2c8-4372-b9a0-fc166cd78297 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:07.659453 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f27aac42-f2c8-4372-b9a0-fc166cd78297 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:07.796508 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f27aac42-f2c8-4372-b9a0-fc166cd78297 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:07.797020 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f27aac42-f2c8-4372-b9a0-fc166cd78297 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:07.797481 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f27aac42-f2c8-4372-b9a0-fc166cd78297 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:07.797933 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-f27aac42-f2c8-4372-b9a0-fc166cd78297 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lazy-loading 'fault' on Instance uuid 9630289d-dcfd-4250-8910-a060f8696292 {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:54:07.882232 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-cdf1382e-1721-4775-9e3e-7bf2f99499cd tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e93855201ca64c779f92a2a33979b81f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed328a1e964d46902dee5e1c7c7b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:07.932974 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-cdf1382e-1721-4775-9e3e-7bf2f99499cd tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] 10.222.0.33 "GET /compute/v2.1/servers/01fd3eb8-b195-4b9c-8d52-752e50be6f30" status: 200 len: 1514 microversion: 2.1 time: 1.064003 Oct 04 20:54:07.937768 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2111/4165] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:54:06 2022] GET /compute/v2.1/servers/01fd3eb8-b195-4b9c-8d52-752e50be6f30 => generated 1514 bytes in 1072 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:54:08.019012 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f27aac42-f2c8-4372-b9a0-fc166cd78297 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c208ec9faf491385a9ab5b5932098d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ae4960393c464c97669731c2084d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:08.038652 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f27aac42-f2c8-4372-b9a0-fc166cd78297 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] 10.222.0.33 "GET /compute/v2.1/servers/9630289d-dcfd-4250-8910-a060f8696292" status: 200 len: 1305 microversion: 2.1 time: 0.405292 Oct 04 20:54:08.039971 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2055/4166] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:54:07 2022] GET /compute/v2.1/servers/9630289d-dcfd-4250-8910-a060f8696292 => generated 1305 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:54:08.111784 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-fbe3e48d-21c6-4e0d-94f9-5609784dd824 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:08.112967 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-fbe3e48d-21c6-4e0d-94f9-5609784dd824 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] [instance: 866d0dd3-3c7e-4612-a132-48eb83ec2d16] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:08.135728 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fbe3e48d-21c6-4e0d-94f9-5609784dd824 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:08.137313 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fbe3e48d-21c6-4e0d-94f9-5609784dd824 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:08.137948 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fbe3e48d-21c6-4e0d-94f9-5609784dd824 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:08.139149 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fbe3e48d-21c6-4e0d-94f9-5609784dd824 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:08.142400 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fbe3e48d-21c6-4e0d-94f9-5609784dd824 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:08.144491 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fbe3e48d-21c6-4e0d-94f9-5609784dd824 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:08.628092 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-64e15ef2-f0e0-407c-88ec-1f74e67add1e tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:08.628729 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-64e15ef2-f0e0-407c-88ec-1f74e67add1e tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] [instance: 424127c5-245d-4486-a2e8-504cff0bcd85] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:08.635728 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-64e15ef2-f0e0-407c-88ec-1f74e67add1e tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:08.636531 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-64e15ef2-f0e0-407c-88ec-1f74e67add1e tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:08.637193 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-64e15ef2-f0e0-407c-88ec-1f74e67add1e tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:08.638098 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-64e15ef2-f0e0-407c-88ec-1f74e67add1e tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:08.639243 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-64e15ef2-f0e0-407c-88ec-1f74e67add1e tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:08.639862 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-64e15ef2-f0e0-407c-88ec-1f74e67add1e tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:08.995471 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-fbe3e48d-21c6-4e0d-94f9-5609784dd824 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc4171c0ee14ebb8b5eff5e910ccf49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003eb03a265a496d8981e45c74b014f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:09.013213 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-fbe3e48d-21c6-4e0d-94f9-5609784dd824 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] 10.222.0.33 "GET /compute/v2.1/servers/866d0dd3-3c7e-4612-a132-48eb83ec2d16" status: 200 len: 1716 microversion: 2.1 time: 0.907153 Oct 04 20:54:09.015030 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2112/4167] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:54:08 2022] GET /compute/v2.1/servers/866d0dd3-3c7e-4612-a132-48eb83ec2d16 => generated 1716 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:54:09.021049 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-4711fe8e-4157-4030-bcef-ce9d25d6f292 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:09.022321 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-4711fe8e-4157-4030-bcef-ce9d25d6f292 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] [instance: 01fd3eb8-b195-4b9c-8d52-752e50be6f30] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:09.033282 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4711fe8e-4157-4030-bcef-ce9d25d6f292 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:09.034784 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4711fe8e-4157-4030-bcef-ce9d25d6f292 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:09.035549 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4711fe8e-4157-4030-bcef-ce9d25d6f292 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:09.036545 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4711fe8e-4157-4030-bcef-ce9d25d6f292 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:09.037403 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4711fe8e-4157-4030-bcef-ce9d25d6f292 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:09.038125 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4711fe8e-4157-4030-bcef-ce9d25d6f292 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:09.064253 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-64e15ef2-f0e0-407c-88ec-1f74e67add1e tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '878cd5eab53247ae994c74a31c04f37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d49cd04ac04f578b78d43cca1cd2df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:09.083535 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-64e15ef2-f0e0-407c-88ec-1f74e67add1e tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] 10.222.0.33 "GET /compute/v2.1/servers/424127c5-245d-4486-a2e8-504cff0bcd85" status: 200 len: 1317 microversion: 2.1 time: 0.459622 Oct 04 20:54:09.093295 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2056/4168] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:54:08 2022] GET /compute/v2.1/servers/424127c5-245d-4486-a2e8-504cff0bcd85 => generated 1317 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:54:09.101743 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-89dfd6e5-8d1d-490d-bef8-b16157f42e7d tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:09.107087 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-89dfd6e5-8d1d-490d-bef8-b16157f42e7d tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] [instance: 9630289d-dcfd-4250-8910-a060f8696292] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:09.125941 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-89dfd6e5-8d1d-490d-bef8-b16157f42e7d tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:09.126721 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-89dfd6e5-8d1d-490d-bef8-b16157f42e7d tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:09.127314 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-89dfd6e5-8d1d-490d-bef8-b16157f42e7d tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:09.128174 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-89dfd6e5-8d1d-490d-bef8-b16157f42e7d tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:09.131809 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-89dfd6e5-8d1d-490d-bef8-b16157f42e7d tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:09.132518 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-89dfd6e5-8d1d-490d-bef8-b16157f42e7d tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:09.152709 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-89dfd6e5-8d1d-490d-bef8-b16157f42e7d tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] HTTP exception thrown: Instance 9630289d-dcfd-4250-8910-a060f8696292 could not be found. Oct 04 20:54:09.159666 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-89dfd6e5-8d1d-490d-bef8-b16157f42e7d tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Request method failure captured: Oct 04 20:54:09.159666 n-d-854823-8 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/9630289d-dcfd-4250-8910-a060f8696292 HTTP/1.1 Oct 04 20:54:09.159666 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:54:09.159666 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:54:09.159666 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:54:09.159666 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 0 Oct 04 20:54:09.159666 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:54:09.159666 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:54:09.159666 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:54:09.159666 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:54:09.159666 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJxSZfevtBVnbE8xQF7FYm_FMbZNMYv-b1P0ldR6C6mOlBxOPHbcbefhyrqwXR1yI98_OYaoilQwhW17vvL2mv1TUMfEjVB0p9Z8xi6fxjKTzjqbSmmUYZRpw0KKdt3nuXH8mFLFoxIXJdxlVC2R9xsCLdqsVxY0fb8-x4eIUN27OLA Oct 04 20:54:09.159666 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:54:09.159666 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:54:09.159666 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:54:09.159666 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:54:09.159666 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:54:09.159666 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:54:09.159666 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: 82ae4960393c464c97669731c2084d0f Oct 04 20:54:09.159666 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-DeleteServersTestJSON-364705212 Oct 04 20:54:09.159666 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 20:54:09.159666 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 20:54:09.159666 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_82ae4960393c464c97669731c2084d0f", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/82ae4960393c464c97669731c2084d0f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/82ae4960393c464c97669731c2084d0f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/82ae4960393c464c97669731c2084d0f"}]}] Oct 04 20:54:09.159666 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-DeleteServersTestJSON-364705212 Oct 04 20:54:09.159666 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: 82ae4960393c464c97669731c2084d0f Oct 04 20:54:09.159666 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-DeleteServersTestJSON-364705212 Oct 04 20:54:09.159666 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-DeleteServersTestJSON-364705212-project Oct 04 20:54:09.159666 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:54:09.159666 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:54:09.159666 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: e2c208ec9faf491385a9ab5b5932098d Oct 04 20:54:09.159666 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-DeleteServersTestJSON-364705212-project Oct 04 20:54:09.159666 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 20:54:09.159666 n-d-854823-8 devstack@n-api.service[128801]: exception: Instance 9630289d-dcfd-4250-8910-a060f8696292 could not be found. Oct 04 20:54:09.159666 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': '9630289d-dcfd-4250-8910-a060f8696292'} Oct 04 20:54:09.159666 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:54:09.159666 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:54:09.159666 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:54:09.159666 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:54:09.159666 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:54:09.159666 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:54:09.159666 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:54:09.159666 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:54:09.159666 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:54:09.159666 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:54:09.159666 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9630289d-dcfd-4250-8910-a060f8696292 could not be found. Oct 04 20:54:09.159666 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:54:09.159666 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:54:09.159666 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:54:09.159666 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:54:09.159666 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:54:09.159666 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:54:09.159666 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:54:09.159666 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:54:09.159666 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:54:09.159666 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:54:09.159666 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:54:09.159666 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:54:09.159666 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:54:09.159666 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:54:09.159666 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:54:09.159666 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:54:09.159666 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9630289d-dcfd-4250-8910-a060f8696292 could not be found. Oct 04 20:54:09.159666 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:54:09.159666 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:54:09.159666 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:54:09.165126 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:54:09.165126 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:54:09.165126 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:54:09.165126 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:54:09.165126 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:54:09.165126 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9630289d-dcfd-4250-8910-a060f8696292 could not be found. Oct 04 20:54:09.165126 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:54:09.165126 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-89dfd6e5-8d1d-490d-bef8-b16157f42e7d tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Returning 404 to user: Instance 9630289d-dcfd-4250-8910-a060f8696292 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:54:09.165126 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-89dfd6e5-8d1d-490d-bef8-b16157f42e7d tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] 10.222.0.33 "GET /compute/v2.1/servers/9630289d-dcfd-4250-8910-a060f8696292" status: 404 len: 111 microversion: 2.1 time: 0.066572 Oct 04 20:54:09.167750 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2057/4169] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:54:09 2022] GET /compute/v2.1/servers/9630289d-dcfd-4250-8910-a060f8696292 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:54:09.199325 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-4f211a2a-0a89-4ea2-8614-2e16cf900868 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:09.199955 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-4f211a2a-0a89-4ea2-8614-2e16cf900868 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] [instance: 866d0dd3-3c7e-4612-a132-48eb83ec2d16] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:09.206452 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4f211a2a-0a89-4ea2-8614-2e16cf900868 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:09.207273 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4f211a2a-0a89-4ea2-8614-2e16cf900868 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:09.207986 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4f211a2a-0a89-4ea2-8614-2e16cf900868 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:09.208905 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4f211a2a-0a89-4ea2-8614-2e16cf900868 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:09.209564 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4f211a2a-0a89-4ea2-8614-2e16cf900868 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:09.210208 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4f211a2a-0a89-4ea2-8614-2e16cf900868 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:09.303154 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-4f211a2a-0a89-4ea2-8614-2e16cf900868 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] HTTP exception thrown: Cannot 'detach_volume' instance 866d0dd3-3c7e-4612-a132-48eb83ec2d16 while it is in vm_state rescued Oct 04 20:54:09.305179 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-4f211a2a-0a89-4ea2-8614-2e16cf900868 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Request method failure captured: Oct 04 20:54:09.305179 n-d-854823-8 devstack@n-api.service[128801]: request: DELETE /compute/v2.1/servers/866d0dd3-3c7e-4612-a132-48eb83ec2d16/os-volume_attachments/1ac5db40-fbff-4fe2-b7f4-28962356d9f9 HTTP/1.1 Oct 04 20:54:09.305179 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:54:09.305179 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:54:09.305179 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:54:09.305179 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 0 Oct 04 20:54:09.305179 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:54:09.305179 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:54:09.305179 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:54:09.305179 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:54:09.305179 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJyQzA2j2TP516GvcpxgrBfRY2YO9l5F5hDF6OrxoVmO38Ubui7rW9ilb7hzquPDxl35ZSulQSvQlms9Io4ULkRGXw-K9Mq_8wy4teEQxOMGhx3owN2R9ZyECEeAocP_VsKpWXZTRpHKvfvEO-wS1AA94MTw8YrFoFgm4uO6w6GPzhQ Oct 04 20:54:09.305179 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:54:09.305179 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:54:09.305179 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:54:09.305179 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:54:09.305179 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:54:09.305179 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:54:09.305179 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: 003eb03a265a496d8981e45c74b014f3 Oct 04 20:54:09.305179 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2028044299 Oct 04 20:54:09.305179 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 20:54:09.305179 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 20:54:09.305179 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_003eb03a265a496d8981e45c74b014f3", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/003eb03a265a496d8981e45c74b014f3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/003eb03a265a496d8981e45c74b014f3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/003eb03a265a496d8981e45c74b014f3"}]}] Oct 04 20:54:09.305179 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2028044299 Oct 04 20:54:09.305179 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: 003eb03a265a496d8981e45c74b014f3 Oct 04 20:54:09.305179 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2028044299 Oct 04 20:54:09.305179 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-ServerRescueNegativeTestJSON-2028044299-project Oct 04 20:54:09.305179 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:54:09.305179 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:54:09.305179 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: 4dc4171c0ee14ebb8b5eff5e910ccf49 Oct 04 20:54:09.305179 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2028044299-project Oct 04 20:54:09.305179 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 20:54:09.305179 n-d-854823-8 devstack@n-api.service[128801]: exception: Cannot 'detach_volume' instance 866d0dd3-3c7e-4612-a132-48eb83ec2d16 while it is in vm_state rescued Oct 04 20:54:09.305179 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'server_id': '866d0dd3-3c7e-4612-a132-48eb83ec2d16', 'id': '1ac5db40-fbff-4fe2-b7f4-28962356d9f9'} Oct 04 20:54:09.305179 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:54:09.305179 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:54:09.305179 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Oct 04 20:54:09.305179 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Oct 04 20:54:09.305179 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 20:54:09.305179 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 20:54:09.305179 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 04 20:54:09.305179 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 04 20:54:09.305179 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 866d0dd3-3c7e-4612-a132-48eb83ec2d16 in vm_state rescued. Cannot detach_volume while the instance is in this state. Oct 04 20:54:09.305179 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:54:09.305179 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:54:09.305179 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:54:09.305179 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:54:09.305179 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:54:09.305179 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:54:09.305179 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:54:09.305179 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:54:09.305179 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:54:09.305179 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:54:09.305179 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Oct 04 20:54:09.305179 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 04 20:54:09.305179 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 04 20:54:09.305179 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 04 20:54:09.305179 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 866d0dd3-3c7e-4612-a132-48eb83ec2d16 while it is in vm_state rescued Oct 04 20:54:09.305179 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:54:09.305179 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:54:09.305179 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:54:09.305179 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:54:09.309763 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:54:09.309763 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:54:09.309763 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:54:09.309763 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:54:09.309763 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 866d0dd3-3c7e-4612-a132-48eb83ec2d16 while it is in vm_state rescued Oct 04 20:54:09.309763 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:54:09.311136 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-4f211a2a-0a89-4ea2-8614-2e16cf900868 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Returning 409 to user: Cannot 'detach_volume' instance 866d0dd3-3c7e-4612-a132-48eb83ec2d16 while it is in vm_state rescued {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:54:09.312172 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-4f211a2a-0a89-4ea2-8614-2e16cf900868 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] 10.222.0.33 "DELETE /compute/v2.1/servers/866d0dd3-3c7e-4612-a132-48eb83ec2d16/os-volume_attachments/1ac5db40-fbff-4fe2-b7f4-28962356d9f9" status: 409 len: 152 microversion: 2.1 time: 0.117457 Oct 04 20:54:09.313214 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2058/4170] 10.222.0.33 () {58 vars in 1416 bytes} [Tue Oct 4 20:54:09 2022] DELETE /compute/v2.1/servers/866d0dd3-3c7e-4612-a132-48eb83ec2d16/os-volume_attachments/1ac5db40-fbff-4fe2-b7f4-28962356d9f9 => generated 152 bytes in 119 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Oct 04 20:54:09.318301 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1bbce61f-6360-4bf0-b558-c0a1e0bcf240 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-255600864", "imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63", "flavorRef": "452", "networks": [{"uuid": "9dbf9434-4e8d-415e-bc95-1f3c19f28f1d"}]}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:54:09.386196 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-4711fe8e-4157-4030-bcef-ce9d25d6f292 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e93855201ca64c779f92a2a33979b81f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed328a1e964d46902dee5e1c7c7b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:09.398388 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-4711fe8e-4157-4030-bcef-ce9d25d6f292 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] 10.222.0.33 "GET /compute/v2.1/servers/01fd3eb8-b195-4b9c-8d52-752e50be6f30" status: 200 len: 1514 microversion: 2.1 time: 0.381649 Oct 04 20:54:09.402436 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.network.neutron [None req-1bbce61f-6360-4bf0-b558-c0a1e0bcf240 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] validate_networks() for [('9dbf9434-4e8d-415e-bc95-1f3c19f28f1d', None, None, None, None, None)] {{(pid=128801) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:54:09.415878 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2113/4171] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:54:09 2022] GET /compute/v2.1/servers/01fd3eb8-b195-4b9c-8d52-752e50be6f30 => generated 1514 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:54:09.421331 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-d4bc9ad2-7b36-4cd9-a017-f9aed73e0263 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:54:09.422003 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-d4bc9ad2-7b36-4cd9-a017-f9aed73e0263 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] [instance: 866d0dd3-3c7e-4612-a132-48eb83ec2d16] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:09.429531 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d4bc9ad2-7b36-4cd9-a017-f9aed73e0263 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:09.430295 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d4bc9ad2-7b36-4cd9-a017-f9aed73e0263 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:09.430835 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d4bc9ad2-7b36-4cd9-a017-f9aed73e0263 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:09.431653 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d4bc9ad2-7b36-4cd9-a017-f9aed73e0263 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:09.432227 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d4bc9ad2-7b36-4cd9-a017-f9aed73e0263 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:09.432909 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d4bc9ad2-7b36-4cd9-a017-f9aed73e0263 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:09.505817 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-d4bc9ad2-7b36-4cd9-a017-f9aed73e0263 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] 10.222.0.33 "POST /compute/v2.1/servers/866d0dd3-3c7e-4612-a132-48eb83ec2d16/action" status: 202 len: 0 microversion: 2.1 time: 0.088367 Oct 04 20:54:09.506564 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2114/4172] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 20:54:09 2022] POST /compute/v2.1/servers/866d0dd3-3c7e-4612-a132-48eb83ec2d16/action => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:54:09.517309 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-8b279e05-73bf-4fff-85db-e2b61e26a172 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:09.518243 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-8b279e05-73bf-4fff-85db-e2b61e26a172 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] [instance: 866d0dd3-3c7e-4612-a132-48eb83ec2d16] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:09.526046 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8b279e05-73bf-4fff-85db-e2b61e26a172 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:09.526845 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8b279e05-73bf-4fff-85db-e2b61e26a172 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:09.527670 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8b279e05-73bf-4fff-85db-e2b61e26a172 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:09.529317 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8b279e05-73bf-4fff-85db-e2b61e26a172 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:09.531552 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8b279e05-73bf-4fff-85db-e2b61e26a172 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:09.532875 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8b279e05-73bf-4fff-85db-e2b61e26a172 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:09.989625 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-8b279e05-73bf-4fff-85db-e2b61e26a172 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc4171c0ee14ebb8b5eff5e910ccf49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003eb03a265a496d8981e45c74b014f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:09.999312 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-8b279e05-73bf-4fff-85db-e2b61e26a172 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] 10.222.0.33 "GET /compute/v2.1/servers/866d0dd3-3c7e-4612-a132-48eb83ec2d16" status: 200 len: 1724 microversion: 2.1 time: 0.487091 Oct 04 20:54:10.011764 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2115/4173] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:54:09 2022] GET /compute/v2.1/servers/866d0dd3-3c7e-4612-a132-48eb83ec2d16 => generated 1724 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:54:10.111012 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-291372cc-2319-47f7-a6fc-70a6dbd4ddbb tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:10.111902 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-291372cc-2319-47f7-a6fc-70a6dbd4ddbb tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] [instance: 424127c5-245d-4486-a2e8-504cff0bcd85] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:10.120728 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-291372cc-2319-47f7-a6fc-70a6dbd4ddbb tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:10.121536 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-291372cc-2319-47f7-a6fc-70a6dbd4ddbb tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:10.122167 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-291372cc-2319-47f7-a6fc-70a6dbd4ddbb tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:10.123097 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-291372cc-2319-47f7-a6fc-70a6dbd4ddbb tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:10.123560 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-291372cc-2319-47f7-a6fc-70a6dbd4ddbb tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:10.123990 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-291372cc-2319-47f7-a6fc-70a6dbd4ddbb tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:10.583268 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:54:10.645631 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=6 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:54:10.668494 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-291372cc-2319-47f7-a6fc-70a6dbd4ddbb tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '878cd5eab53247ae994c74a31c04f37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d49cd04ac04f578b78d43cca1cd2df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:10.678141 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-291372cc-2319-47f7-a6fc-70a6dbd4ddbb tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] 10.222.0.33 "GET /compute/v2.1/servers/424127c5-245d-4486-a2e8-504cff0bcd85" status: 200 len: 1317 microversion: 2.1 time: 0.571903 Oct 04 20:54:10.679457 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2116/4174] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:54:10 2022] GET /compute/v2.1/servers/424127c5-245d-4486-a2e8-504cff0bcd85 => generated 1317 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:54:10.689786 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-34b78a70-19f5-4519-a7cb-7903b41e33e1 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:10.690741 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-34b78a70-19f5-4519-a7cb-7903b41e33e1 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] [instance: 01fd3eb8-b195-4b9c-8d52-752e50be6f30] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:10.700900 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-34b78a70-19f5-4519-a7cb-7903b41e33e1 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:10.701741 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-34b78a70-19f5-4519-a7cb-7903b41e33e1 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:10.702781 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-34b78a70-19f5-4519-a7cb-7903b41e33e1 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:10.713873 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-34b78a70-19f5-4519-a7cb-7903b41e33e1 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:10.714413 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-34b78a70-19f5-4519-a7cb-7903b41e33e1 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:10.715100 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-34b78a70-19f5-4519-a7cb-7903b41e33e1 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:11.135912 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-1bbce61f-6360-4bf0-b558-c0a1e0bcf240 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Flavor limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:54:11.136346 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-1bbce61f-6360-4bf0-b558-c0a1e0bcf240 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Image limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:54:11.136828 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-1bbce61f-6360-4bf0-b558-c0a1e0bcf240 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Flavor pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:54:11.137246 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-1bbce61f-6360-4bf0-b558-c0a1e0bcf240 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Image pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:54:11.137828 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-1bbce61f-6360-4bf0-b558-c0a1e0bcf240 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:54:11.160900 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1bbce61f-6360-4bf0-b558-c0a1e0bcf240 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:11.161360 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1bbce61f-6360-4bf0-b558-c0a1e0bcf240 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:11.161805 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1bbce61f-6360-4bf0-b558-c0a1e0bcf240 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:11.162661 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1bbce61f-6360-4bf0-b558-c0a1e0bcf240 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:11.163125 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1bbce61f-6360-4bf0-b558-c0a1e0bcf240 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:11.163555 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1bbce61f-6360-4bf0-b558-c0a1e0bcf240 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:11.185302 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-1bbce61f-6360-4bf0-b558-c0a1e0bcf240 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Getting quotas for project 82ae4960393c464c97669731c2084d0f. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:54:11.194767 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-1bbce61f-6360-4bf0-b558-c0a1e0bcf240 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Getting quotas for user e2c208ec9faf491385a9ab5b5932098d and project 82ae4960393c464c97669731c2084d0f. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:54:11.210763 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-1bbce61f-6360-4bf0-b558-c0a1e0bcf240 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Going to run 1 instances... {{(pid=128801) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:54:11.214051 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-1bbce61f-6360-4bf0-b558-c0a1e0bcf240 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] [instance: ea3e8404-38fa-4d1c-8356-53887f2ff64a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='15b24725-0c99-4bcf-b1fb-907cdf8e2d63',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128801) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:54:11.268366 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-1bbce61f-6360-4bf0-b558-c0a1e0bcf240 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.953720 Oct 04 20:54:11.270328 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2059/4175] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 20:54:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 1956 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 20:54:11.276373 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-24043266-159f-4582-a8cb-8255cc123978 req-a55998ed-6442-4785-85c3-10cbf7cd8cd4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "424127c5-245d-4486-a2e8-504cff0bcd85", "tag": "850fb50d-9a2d-4230-abc3-54c00085fa63"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:54:11.282459 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:54:11.291027 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-24043266-159f-4582-a8cb-8255cc123978 req-a55998ed-6442-4785-85c3-10cbf7cd8cd4 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:11.291518 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-24043266-159f-4582-a8cb-8255cc123978 req-a55998ed-6442-4785-85c3-10cbf7cd8cd4 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:11.291976 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-24043266-159f-4582-a8cb-8255cc123978 req-a55998ed-6442-4785-85c3-10cbf7cd8cd4 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:11.305665 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-24043266-159f-4582-a8cb-8255cc123978 req-a55998ed-6442-4785-85c3-10cbf7cd8cd4 service nova] Creating event network-changed:850fb50d-9a2d-4230-abc3-54c00085fa63 for instance 424127c5-245d-4486-a2e8-504cff0bcd85 on n-h2-854823-8 Oct 04 20:54:11.313440 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-24043266-159f-4582-a8cb-8255cc123978 req-a55998ed-6442-4785-85c3-10cbf7cd8cd4 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041655 Oct 04 20:54:11.314677 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2060/4176] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:54:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:54:11.320228 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-63a58d3e-424d-475c-aa53-bdbbda3ba373 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:11.321115 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-63a58d3e-424d-475c-aa53-bdbbda3ba373 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] [instance: 866d0dd3-3c7e-4612-a132-48eb83ec2d16] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:11.330060 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-63a58d3e-424d-475c-aa53-bdbbda3ba373 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:11.330754 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-63a58d3e-424d-475c-aa53-bdbbda3ba373 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:11.331934 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-63a58d3e-424d-475c-aa53-bdbbda3ba373 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:11.332812 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-63a58d3e-424d-475c-aa53-bdbbda3ba373 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:11.333428 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-63a58d3e-424d-475c-aa53-bdbbda3ba373 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:11.334014 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-63a58d3e-424d-475c-aa53-bdbbda3ba373 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:11.446325 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-34b78a70-19f5-4519-a7cb-7903b41e33e1 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e93855201ca64c779f92a2a33979b81f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed328a1e964d46902dee5e1c7c7b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:11.455371 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-34b78a70-19f5-4519-a7cb-7903b41e33e1 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] 10.222.0.33 "GET /compute/v2.1/servers/01fd3eb8-b195-4b9c-8d52-752e50be6f30" status: 200 len: 1514 microversion: 2.1 time: 0.774652 Oct 04 20:54:11.455952 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2117/4177] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:54:10 2022] GET /compute/v2.1/servers/01fd3eb8-b195-4b9c-8d52-752e50be6f30 => generated 1514 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:54:11.468417 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-c95ee9a4-10df-4d10-9e3b-199e54e565d5 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:11.473361 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-c95ee9a4-10df-4d10-9e3b-199e54e565d5 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] [instance: ea3e8404-38fa-4d1c-8356-53887f2ff64a] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:12.022867 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-c95ee9a4-10df-4d10-9e3b-199e54e565d5 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c208ec9faf491385a9ab5b5932098d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ae4960393c464c97669731c2084d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:12.030652 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-c95ee9a4-10df-4d10-9e3b-199e54e565d5 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] 10.222.0.33 "GET /compute/v2.1/servers/ea3e8404-38fa-4d1c-8356-53887f2ff64a" status: 200 len: 1214 microversion: 2.1 time: 0.565977 Oct 04 20:54:12.034838 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2118/4178] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:54:11 2022] GET /compute/v2.1/servers/ea3e8404-38fa-4d1c-8356-53887f2ff64a => generated 1214 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:54:12.052067 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-54de5156-cbf0-4d90-a0d6-034203f4db0b tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:12.053149 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-54de5156-cbf0-4d90-a0d6-034203f4db0b tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] [instance: 424127c5-245d-4486-a2e8-504cff0bcd85] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:12.068650 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-54de5156-cbf0-4d90-a0d6-034203f4db0b tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:12.069138 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-54de5156-cbf0-4d90-a0d6-034203f4db0b tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:12.069564 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-54de5156-cbf0-4d90-a0d6-034203f4db0b tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:12.070331 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-54de5156-cbf0-4d90-a0d6-034203f4db0b tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:12.070822 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-54de5156-cbf0-4d90-a0d6-034203f4db0b tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:12.071254 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-54de5156-cbf0-4d90-a0d6-034203f4db0b tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:12.117538 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:54:12.395450 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-63a58d3e-424d-475c-aa53-bdbbda3ba373 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc4171c0ee14ebb8b5eff5e910ccf49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003eb03a265a496d8981e45c74b014f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:12.410094 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-63a58d3e-424d-475c-aa53-bdbbda3ba373 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] 10.222.0.33 "GET /compute/v2.1/servers/866d0dd3-3c7e-4612-a132-48eb83ec2d16" status: 200 len: 1724 microversion: 2.1 time: 1.090386 Oct 04 20:54:12.429697 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2061/4179] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:54:11 2022] GET /compute/v2.1/servers/866d0dd3-3c7e-4612-a132-48eb83ec2d16 => generated 1724 bytes in 1114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:54:12.486703 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ce1f1883-973f-4902-ba49-4ff95ed29c4a tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:12.487327 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ce1f1883-973f-4902-ba49-4ff95ed29c4a tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] [instance: 01fd3eb8-b195-4b9c-8d52-752e50be6f30] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:12.499484 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ce1f1883-973f-4902-ba49-4ff95ed29c4a tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:12.500598 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ce1f1883-973f-4902-ba49-4ff95ed29c4a tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:12.502101 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ce1f1883-973f-4902-ba49-4ff95ed29c4a tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:12.503258 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ce1f1883-973f-4902-ba49-4ff95ed29c4a tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:12.503870 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ce1f1883-973f-4902-ba49-4ff95ed29c4a tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:12.504517 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ce1f1883-973f-4902-ba49-4ff95ed29c4a tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:12.784015 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-54de5156-cbf0-4d90-a0d6-034203f4db0b tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '878cd5eab53247ae994c74a31c04f37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d49cd04ac04f578b78d43cca1cd2df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:12.794173 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-54de5156-cbf0-4d90-a0d6-034203f4db0b tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] 10.222.0.33 "GET /compute/v2.1/servers/424127c5-245d-4486-a2e8-504cff0bcd85" status: 200 len: 1317 microversion: 2.1 time: 0.757730 Oct 04 20:54:12.796435 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2119/4180] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:54:12 2022] GET /compute/v2.1/servers/424127c5-245d-4486-a2e8-504cff0bcd85 => generated 1317 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:54:12.978426 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-ce1f1883-973f-4902-ba49-4ff95ed29c4a tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e93855201ca64c779f92a2a33979b81f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed328a1e964d46902dee5e1c7c7b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:12.989105 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ce1f1883-973f-4902-ba49-4ff95ed29c4a tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] 10.222.0.33 "GET /compute/v2.1/servers/01fd3eb8-b195-4b9c-8d52-752e50be6f30" status: 200 len: 1514 microversion: 2.1 time: 0.509691 Oct 04 20:54:13.005716 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2062/4181] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:54:12 2022] GET /compute/v2.1/servers/01fd3eb8-b195-4b9c-8d52-752e50be6f30 => generated 1514 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:54:13.060382 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-e20eba2e-36e9-4be5-8c72-184b71b0f7bb tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:13.061456 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-e20eba2e-36e9-4be5-8c72-184b71b0f7bb tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] [instance: ea3e8404-38fa-4d1c-8356-53887f2ff64a] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:13.072714 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e20eba2e-36e9-4be5-8c72-184b71b0f7bb tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:13.073667 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e20eba2e-36e9-4be5-8c72-184b71b0f7bb tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:13.074293 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e20eba2e-36e9-4be5-8c72-184b71b0f7bb tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:13.076146 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e20eba2e-36e9-4be5-8c72-184b71b0f7bb tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:13.077123 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e20eba2e-36e9-4be5-8c72-184b71b0f7bb tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:13.077705 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e20eba2e-36e9-4be5-8c72-184b71b0f7bb tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:13.270323 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-e20eba2e-36e9-4be5-8c72-184b71b0f7bb tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c208ec9faf491385a9ab5b5932098d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ae4960393c464c97669731c2084d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:13.279446 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-e20eba2e-36e9-4be5-8c72-184b71b0f7bb tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] 10.222.0.33 "GET /compute/v2.1/servers/ea3e8404-38fa-4d1c-8356-53887f2ff64a" status: 200 len: 1272 microversion: 2.1 time: 0.223892 Oct 04 20:54:13.280351 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2120/4182] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:54:13 2022] GET /compute/v2.1/servers/ea3e8404-38fa-4d1c-8356-53887f2ff64a => generated 1272 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:54:13.440842 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8ceefb61-930f-4f0d-af82-82232fc6a5d9 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:13.441552 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-8ceefb61-930f-4f0d-af82-82232fc6a5d9 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] [instance: 866d0dd3-3c7e-4612-a132-48eb83ec2d16] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:13.457363 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8ceefb61-930f-4f0d-af82-82232fc6a5d9 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:13.457985 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8ceefb61-930f-4f0d-af82-82232fc6a5d9 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:13.458649 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8ceefb61-930f-4f0d-af82-82232fc6a5d9 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:13.459472 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8ceefb61-930f-4f0d-af82-82232fc6a5d9 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:13.460091 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8ceefb61-930f-4f0d-af82-82232fc6a5d9 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:13.460771 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8ceefb61-930f-4f0d-af82-82232fc6a5d9 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:13.820202 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-7fd4cc82-7c9a-43f8-9d7e-c81cc3c1ffc0 tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:13.820878 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-7fd4cc82-7c9a-43f8-9d7e-c81cc3c1ffc0 tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] [instance: 424127c5-245d-4486-a2e8-504cff0bcd85] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:13.832076 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7fd4cc82-7c9a-43f8-9d7e-c81cc3c1ffc0 tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:13.834124 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7fd4cc82-7c9a-43f8-9d7e-c81cc3c1ffc0 tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:13.835381 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7fd4cc82-7c9a-43f8-9d7e-c81cc3c1ffc0 tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:13.836844 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7fd4cc82-7c9a-43f8-9d7e-c81cc3c1ffc0 tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:13.839093 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7fd4cc82-7c9a-43f8-9d7e-c81cc3c1ffc0 tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:13.839708 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7fd4cc82-7c9a-43f8-9d7e-c81cc3c1ffc0 tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:13.959427 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-8ceefb61-930f-4f0d-af82-82232fc6a5d9 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc4171c0ee14ebb8b5eff5e910ccf49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003eb03a265a496d8981e45c74b014f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:13.970205 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-8ceefb61-930f-4f0d-af82-82232fc6a5d9 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] 10.222.0.33 "GET /compute/v2.1/servers/866d0dd3-3c7e-4612-a132-48eb83ec2d16" status: 200 len: 1724 microversion: 2.1 time: 0.534364 Oct 04 20:54:13.986670 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2063/4183] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:54:13 2022] GET /compute/v2.1/servers/866d0dd3-3c7e-4612-a132-48eb83ec2d16 => generated 1724 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:54:14.018216 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-09e7e057-b4ac-4165-9a8a-113acaed648c tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:14.019295 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-09e7e057-b4ac-4165-9a8a-113acaed648c tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] [instance: 01fd3eb8-b195-4b9c-8d52-752e50be6f30] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:14.027950 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-09e7e057-b4ac-4165-9a8a-113acaed648c tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:14.028438 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-09e7e057-b4ac-4165-9a8a-113acaed648c tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:14.029050 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-09e7e057-b4ac-4165-9a8a-113acaed648c tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:14.029918 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-09e7e057-b4ac-4165-9a8a-113acaed648c tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:14.030787 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-09e7e057-b4ac-4165-9a8a-113acaed648c tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:14.032000 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-09e7e057-b4ac-4165-9a8a-113acaed648c tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:14.424070 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-7fd4cc82-7c9a-43f8-9d7e-c81cc3c1ffc0 tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '878cd5eab53247ae994c74a31c04f37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d49cd04ac04f578b78d43cca1cd2df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:14.436390 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-7fd4cc82-7c9a-43f8-9d7e-c81cc3c1ffc0 tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] 10.222.0.33 "GET /compute/v2.1/servers/424127c5-245d-4486-a2e8-504cff0bcd85" status: 200 len: 1317 microversion: 2.1 time: 0.620271 Oct 04 20:54:14.436992 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2121/4184] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:54:13 2022] GET /compute/v2.1/servers/424127c5-245d-4486-a2e8-504cff0bcd85 => generated 1317 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:54:14.441998 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-1e46f1c0-3631-4db2-a093-65985d3dfa29 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:14.448378 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-1e46f1c0-3631-4db2-a093-65985d3dfa29 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] [instance: ea3e8404-38fa-4d1c-8356-53887f2ff64a] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:14.455534 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1e46f1c0-3631-4db2-a093-65985d3dfa29 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:14.456127 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1e46f1c0-3631-4db2-a093-65985d3dfa29 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:14.457537 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1e46f1c0-3631-4db2-a093-65985d3dfa29 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:14.458806 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1e46f1c0-3631-4db2-a093-65985d3dfa29 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:14.459479 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1e46f1c0-3631-4db2-a093-65985d3dfa29 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:14.460110 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1e46f1c0-3631-4db2-a093-65985d3dfa29 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:14.653145 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-1e46f1c0-3631-4db2-a093-65985d3dfa29 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c208ec9faf491385a9ab5b5932098d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ae4960393c464c97669731c2084d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:14.663781 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-1e46f1c0-3631-4db2-a093-65985d3dfa29 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] 10.222.0.33 "GET /compute/v2.1/servers/ea3e8404-38fa-4d1c-8356-53887f2ff64a" status: 200 len: 1272 microversion: 2.1 time: 0.225520 Oct 04 20:54:14.665737 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2122/4185] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:54:14 2022] GET /compute/v2.1/servers/ea3e8404-38fa-4d1c-8356-53887f2ff64a => generated 1272 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:54:14.993071 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-7c67a776-2696-48f4-9851-6b3c2b1e5023 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:14.993743 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-7c67a776-2696-48f4-9851-6b3c2b1e5023 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] [instance: 866d0dd3-3c7e-4612-a132-48eb83ec2d16] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:15.002744 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7c67a776-2696-48f4-9851-6b3c2b1e5023 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:15.003553 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7c67a776-2696-48f4-9851-6b3c2b1e5023 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:15.004199 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7c67a776-2696-48f4-9851-6b3c2b1e5023 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:15.005120 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7c67a776-2696-48f4-9851-6b3c2b1e5023 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:15.005593 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7c67a776-2696-48f4-9851-6b3c2b1e5023 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:15.006030 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7c67a776-2696-48f4-9851-6b3c2b1e5023 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:15.048441 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-09e7e057-b4ac-4165-9a8a-113acaed648c tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e93855201ca64c779f92a2a33979b81f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed328a1e964d46902dee5e1c7c7b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:15.056876 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-09e7e057-b4ac-4165-9a8a-113acaed648c tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] 10.222.0.33 "GET /compute/v2.1/servers/01fd3eb8-b195-4b9c-8d52-752e50be6f30" status: 200 len: 1514 microversion: 2.1 time: 1.043426 Oct 04 20:54:15.057330 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2064/4186] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:54:14 2022] GET /compute/v2.1/servers/01fd3eb8-b195-4b9c-8d52-752e50be6f30 => generated 1514 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:54:15.461727 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7ae1ec9f-acbf-4f4a-b531-0b176dc546d5 tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:15.462169 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-7ae1ec9f-acbf-4f4a-b531-0b176dc546d5 tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] [instance: 424127c5-245d-4486-a2e8-504cff0bcd85] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:15.477139 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7ae1ec9f-acbf-4f4a-b531-0b176dc546d5 tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:15.477592 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7ae1ec9f-acbf-4f4a-b531-0b176dc546d5 tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:15.478076 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7ae1ec9f-acbf-4f4a-b531-0b176dc546d5 tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:15.479591 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7ae1ec9f-acbf-4f4a-b531-0b176dc546d5 tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:15.480102 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7ae1ec9f-acbf-4f4a-b531-0b176dc546d5 tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:15.481298 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7ae1ec9f-acbf-4f4a-b531-0b176dc546d5 tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:15.633186 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-7c67a776-2696-48f4-9851-6b3c2b1e5023 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc4171c0ee14ebb8b5eff5e910ccf49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003eb03a265a496d8981e45c74b014f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:15.647559 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-7c67a776-2696-48f4-9851-6b3c2b1e5023 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] 10.222.0.33 "GET /compute/v2.1/servers/866d0dd3-3c7e-4612-a132-48eb83ec2d16" status: 200 len: 1730 microversion: 2.1 time: 0.658114 Oct 04 20:54:15.649221 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2123/4187] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:54:14 2022] GET /compute/v2.1/servers/866d0dd3-3c7e-4612-a132-48eb83ec2d16 => generated 1730 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:54:15.689610 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-5b667bd3-beb4-4718-a6f9-5468e8ce82ad tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:15.690606 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-5b667bd3-beb4-4718-a6f9-5468e8ce82ad tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] [instance: 866d0dd3-3c7e-4612-a132-48eb83ec2d16] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:15.713198 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5b667bd3-beb4-4718-a6f9-5468e8ce82ad tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:15.714019 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5b667bd3-beb4-4718-a6f9-5468e8ce82ad tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:15.714240 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5b667bd3-beb4-4718-a6f9-5468e8ce82ad tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:15.716700 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5b667bd3-beb4-4718-a6f9-5468e8ce82ad tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:15.717724 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5b667bd3-beb4-4718-a6f9-5468e8ce82ad tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:15.718164 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5b667bd3-beb4-4718-a6f9-5468e8ce82ad tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:15.912675 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-5b667bd3-beb4-4718-a6f9-5468e8ce82ad tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] 10.222.0.33 "GET /compute/v2.1/servers/866d0dd3-3c7e-4612-a132-48eb83ec2d16/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.237030 Oct 04 20:54:15.914379 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2124/4188] 10.222.0.33 () {58 vars in 1275 bytes} [Tue Oct 4 20:54:15 2022] GET /compute/v2.1/servers/866d0dd3-3c7e-4612-a132-48eb83ec2d16/os-interface => generated 284 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:54:15.927588 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-358e2187-cd81-43f0-b236-1909d689edfd tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:15.928461 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-358e2187-cd81-43f0-b236-1909d689edfd tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] [instance: ea3e8404-38fa-4d1c-8356-53887f2ff64a] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:15.937418 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-358e2187-cd81-43f0-b236-1909d689edfd tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:15.938289 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-358e2187-cd81-43f0-b236-1909d689edfd tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:15.938928 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-358e2187-cd81-43f0-b236-1909d689edfd tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:15.940016 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-358e2187-cd81-43f0-b236-1909d689edfd tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:15.941161 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-358e2187-cd81-43f0-b236-1909d689edfd tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:15.941803 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-358e2187-cd81-43f0-b236-1909d689edfd tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:16.166714 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-7ae1ec9f-acbf-4f4a-b531-0b176dc546d5 tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '878cd5eab53247ae994c74a31c04f37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d49cd04ac04f578b78d43cca1cd2df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:16.176002 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-7ae1ec9f-acbf-4f4a-b531-0b176dc546d5 tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] 10.222.0.33 "GET /compute/v2.1/servers/424127c5-245d-4486-a2e8-504cff0bcd85" status: 200 len: 1317 microversion: 2.1 time: 0.718140 Oct 04 20:54:16.176605 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2065/4189] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:54:15 2022] GET /compute/v2.1/servers/424127c5-245d-4486-a2e8-504cff0bcd85 => generated 1317 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:54:16.203502 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0fbbf34e-b405-4420-a97d-e5089231ad86 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:16.203502 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-0fbbf34e-b405-4420-a97d-e5089231ad86 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] [instance: 01fd3eb8-b195-4b9c-8d52-752e50be6f30] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:16.211070 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0fbbf34e-b405-4420-a97d-e5089231ad86 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:16.213357 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0fbbf34e-b405-4420-a97d-e5089231ad86 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:16.213872 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0fbbf34e-b405-4420-a97d-e5089231ad86 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:16.215780 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0fbbf34e-b405-4420-a97d-e5089231ad86 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:16.219004 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0fbbf34e-b405-4420-a97d-e5089231ad86 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:16.219676 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0fbbf34e-b405-4420-a97d-e5089231ad86 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:16.715788 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-358e2187-cd81-43f0-b236-1909d689edfd tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c208ec9faf491385a9ab5b5932098d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ae4960393c464c97669731c2084d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:16.728874 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-358e2187-cd81-43f0-b236-1909d689edfd tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] 10.222.0.33 "GET /compute/v2.1/servers/ea3e8404-38fa-4d1c-8356-53887f2ff64a" status: 200 len: 1314 microversion: 2.1 time: 0.812644 Oct 04 20:54:16.731092 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2125/4190] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:54:15 2022] GET /compute/v2.1/servers/ea3e8404-38fa-4d1c-8356-53887f2ff64a => generated 1314 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:54:16.854859 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-0fbbf34e-b405-4420-a97d-e5089231ad86 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e93855201ca64c779f92a2a33979b81f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed328a1e964d46902dee5e1c7c7b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:16.865116 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-0fbbf34e-b405-4420-a97d-e5089231ad86 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] 10.222.0.33 "GET /compute/v2.1/servers/01fd3eb8-b195-4b9c-8d52-752e50be6f30" status: 200 len: 1514 microversion: 2.1 time: 0.687454 Oct 04 20:54:16.868224 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2066/4191] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:54:16 2022] GET /compute/v2.1/servers/01fd3eb8-b195-4b9c-8d52-752e50be6f30 => generated 1514 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:54:17.214299 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-520505ad-dd73-4df1-8c8d-4983de245c1f tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:17.215285 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-520505ad-dd73-4df1-8c8d-4983de245c1f tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] [instance: 424127c5-245d-4486-a2e8-504cff0bcd85] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:17.232855 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-520505ad-dd73-4df1-8c8d-4983de245c1f tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:17.233146 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-520505ad-dd73-4df1-8c8d-4983de245c1f tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:17.233613 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-520505ad-dd73-4df1-8c8d-4983de245c1f tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:17.235920 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-520505ad-dd73-4df1-8c8d-4983de245c1f tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:17.237544 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-520505ad-dd73-4df1-8c8d-4983de245c1f tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:17.238071 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-520505ad-dd73-4df1-8c8d-4983de245c1f tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:17.756673 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0417f100-ca67-4051-b200-67039e448f99 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:17.758297 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-0417f100-ca67-4051-b200-67039e448f99 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] [instance: ea3e8404-38fa-4d1c-8356-53887f2ff64a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:17.771455 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0417f100-ca67-4051-b200-67039e448f99 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:17.774527 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0417f100-ca67-4051-b200-67039e448f99 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:17.775434 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0417f100-ca67-4051-b200-67039e448f99 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:17.778838 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0417f100-ca67-4051-b200-67039e448f99 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:17.779636 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0417f100-ca67-4051-b200-67039e448f99 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:17.780822 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0417f100-ca67-4051-b200-67039e448f99 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:17.792363 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=100 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:54:18.449113 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-520505ad-dd73-4df1-8c8d-4983de245c1f tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '878cd5eab53247ae994c74a31c04f37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d49cd04ac04f578b78d43cca1cd2df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:18.461863 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-0417f100-ca67-4051-b200-67039e448f99 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c208ec9faf491385a9ab5b5932098d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ae4960393c464c97669731c2084d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:18.470567 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-0417f100-ca67-4051-b200-67039e448f99 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] 10.222.0.33 "GET /compute/v2.1/servers/ea3e8404-38fa-4d1c-8356-53887f2ff64a" status: 200 len: 1314 microversion: 2.1 time: 0.718477 Oct 04 20:54:18.471151 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2067/4192] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:54:17 2022] GET /compute/v2.1/servers/ea3e8404-38fa-4d1c-8356-53887f2ff64a => generated 1314 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:54:18.482216 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-520505ad-dd73-4df1-8c8d-4983de245c1f tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] 10.222.0.33 "GET /compute/v2.1/servers/424127c5-245d-4486-a2e8-504cff0bcd85" status: 200 len: 1317 microversion: 2.1 time: 1.270677 Oct 04 20:54:18.483208 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2126/4193] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:54:17 2022] GET /compute/v2.1/servers/424127c5-245d-4486-a2e8-504cff0bcd85 => generated 1317 bytes in 1277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:54:18.488282 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-4355c3d4-bbbb-4a69-a3f0-0499449f0198 req-06129f19-cd0d-4054-8f81-c9a4c4a35432 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "866d0dd3-3c7e-4612-a132-48eb83ec2d16", "tag": "0544b7b3-d2c3-439a-b134-c025dc0ed7a6"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:54:18.502707 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-4355c3d4-bbbb-4a69-a3f0-0499449f0198 req-06129f19-cd0d-4054-8f81-c9a4c4a35432 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:18.502966 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-edbfbd20-32b4-4eae-8ccb-ccd389669ff8 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:18.503969 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-edbfbd20-32b4-4eae-8ccb-ccd389669ff8 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] [instance: 01fd3eb8-b195-4b9c-8d52-752e50be6f30] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:18.504686 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-4355c3d4-bbbb-4a69-a3f0-0499449f0198 req-06129f19-cd0d-4054-8f81-c9a4c4a35432 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:18.505490 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-4355c3d4-bbbb-4a69-a3f0-0499449f0198 req-06129f19-cd0d-4054-8f81-c9a4c4a35432 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:18.520314 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-edbfbd20-32b4-4eae-8ccb-ccd389669ff8 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:18.520819 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-edbfbd20-32b4-4eae-8ccb-ccd389669ff8 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:18.521262 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-edbfbd20-32b4-4eae-8ccb-ccd389669ff8 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:18.521982 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-edbfbd20-32b4-4eae-8ccb-ccd389669ff8 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:18.522480 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-edbfbd20-32b4-4eae-8ccb-ccd389669ff8 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:18.522910 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-edbfbd20-32b4-4eae-8ccb-ccd389669ff8 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:18.527246 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-4355c3d4-bbbb-4a69-a3f0-0499449f0198 req-06129f19-cd0d-4054-8f81-c9a4c4a35432 service nova] Creating event network-changed:0544b7b3-d2c3-439a-b134-c025dc0ed7a6 for instance 866d0dd3-3c7e-4612-a132-48eb83ec2d16 on n-h2-854823-8 Oct 04 20:54:18.536346 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-4355c3d4-bbbb-4a69-a3f0-0499449f0198 req-06129f19-cd0d-4054-8f81-c9a4c4a35432 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052028 Oct 04 20:54:18.537753 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2127/4194] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:54:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:54:18.830478 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-a6c692b8-565f-4f1e-85bc-24b831568042 req-ae42d984-63fe-4c50-bbb5-6f6b368a0715 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "424127c5-245d-4486-a2e8-504cff0bcd85", "name": "network-vif-plugged", "status": "completed", "tag": "850fb50d-9a2d-4230-abc3-54c00085fa63"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:54:18.850558 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-a6c692b8-565f-4f1e-85bc-24b831568042 req-ae42d984-63fe-4c50-bbb5-6f6b368a0715 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:18.852057 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-a6c692b8-565f-4f1e-85bc-24b831568042 req-ae42d984-63fe-4c50-bbb5-6f6b368a0715 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:18.852740 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-a6c692b8-565f-4f1e-85bc-24b831568042 req-ae42d984-63fe-4c50-bbb5-6f6b368a0715 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:18.874849 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-a6c692b8-565f-4f1e-85bc-24b831568042 req-ae42d984-63fe-4c50-bbb5-6f6b368a0715 service nova] Creating event network-vif-plugged:850fb50d-9a2d-4230-abc3-54c00085fa63 for instance 424127c5-245d-4486-a2e8-504cff0bcd85 on n-h2-854823-8 Oct 04 20:54:18.881783 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-a6c692b8-565f-4f1e-85bc-24b831568042 req-ae42d984-63fe-4c50-bbb5-6f6b368a0715 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057667 Oct 04 20:54:18.883404 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2128/4195] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:54:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 20:54:19.028388 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-edbfbd20-32b4-4eae-8ccb-ccd389669ff8 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e93855201ca64c779f92a2a33979b81f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed328a1e964d46902dee5e1c7c7b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:19.037624 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-edbfbd20-32b4-4eae-8ccb-ccd389669ff8 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] 10.222.0.33 "GET /compute/v2.1/servers/01fd3eb8-b195-4b9c-8d52-752e50be6f30" status: 200 len: 1514 microversion: 2.1 time: 0.554237 Oct 04 20:54:19.038856 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2068/4196] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:54:18 2022] GET /compute/v2.1/servers/01fd3eb8-b195-4b9c-8d52-752e50be6f30 => generated 1514 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:54:19.249626 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-5c532777-c19b-4364-ada6-d2d8b1b78ba3 req-77980bc3-33a3-449b-b93f-99dc5c18a652 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea3e8404-38fa-4d1c-8356-53887f2ff64a", "tag": "44aee782-feff-400a-94b5-8a0b4b41faa5"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:54:19.279713 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-5c532777-c19b-4364-ada6-d2d8b1b78ba3 req-77980bc3-33a3-449b-b93f-99dc5c18a652 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:19.280228 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-5c532777-c19b-4364-ada6-d2d8b1b78ba3 req-77980bc3-33a3-449b-b93f-99dc5c18a652 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:19.280670 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-5c532777-c19b-4364-ada6-d2d8b1b78ba3 req-77980bc3-33a3-449b-b93f-99dc5c18a652 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:19.303329 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-5c532777-c19b-4364-ada6-d2d8b1b78ba3 req-77980bc3-33a3-449b-b93f-99dc5c18a652 service nova] Creating event network-changed:44aee782-feff-400a-94b5-8a0b4b41faa5 for instance ea3e8404-38fa-4d1c-8356-53887f2ff64a on n-h1-854823-8 Oct 04 20:54:19.309499 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-5c532777-c19b-4364-ada6-d2d8b1b78ba3 req-77980bc3-33a3-449b-b93f-99dc5c18a652 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065515 Oct 04 20:54:19.310439 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2129/4197] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:54:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:54:19.495193 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-13066eaf-9ca7-40b4-88e3-336b37d6cd36 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:19.495819 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-13066eaf-9ca7-40b4-88e3-336b37d6cd36 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] [instance: ea3e8404-38fa-4d1c-8356-53887f2ff64a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:19.504078 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-13066eaf-9ca7-40b4-88e3-336b37d6cd36 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:19.504903 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-13066eaf-9ca7-40b4-88e3-336b37d6cd36 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:19.505558 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-13066eaf-9ca7-40b4-88e3-336b37d6cd36 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:19.506926 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-13066eaf-9ca7-40b4-88e3-336b37d6cd36 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:19.507590 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-13066eaf-9ca7-40b4-88e3-336b37d6cd36 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:19.508237 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-13066eaf-9ca7-40b4-88e3-336b37d6cd36 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:19.511655 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-867aa881-191f-46ed-bdfe-4df692742d55 tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:19.512480 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-867aa881-191f-46ed-bdfe-4df692742d55 tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] [instance: 424127c5-245d-4486-a2e8-504cff0bcd85] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:19.521773 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-867aa881-191f-46ed-bdfe-4df692742d55 tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:19.522276 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-867aa881-191f-46ed-bdfe-4df692742d55 tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:19.522749 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-867aa881-191f-46ed-bdfe-4df692742d55 tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:19.523937 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-867aa881-191f-46ed-bdfe-4df692742d55 tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:19.524467 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-867aa881-191f-46ed-bdfe-4df692742d55 tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:19.526078 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-867aa881-191f-46ed-bdfe-4df692742d55 tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:20.295271 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-13066eaf-9ca7-40b4-88e3-336b37d6cd36 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c208ec9faf491385a9ab5b5932098d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ae4960393c464c97669731c2084d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:20.327575 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-13066eaf-9ca7-40b4-88e3-336b37d6cd36 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] 10.222.0.33 "GET /compute/v2.1/servers/ea3e8404-38fa-4d1c-8356-53887f2ff64a" status: 200 len: 1314 microversion: 2.1 time: 0.837686 Oct 04 20:54:20.331732 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2069/4198] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:54:19 2022] GET /compute/v2.1/servers/ea3e8404-38fa-4d1c-8356-53887f2ff64a => generated 1314 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:54:20.332932 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-867aa881-191f-46ed-bdfe-4df692742d55 tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '878cd5eab53247ae994c74a31c04f37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d49cd04ac04f578b78d43cca1cd2df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:20.344769 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5acdae2a-658e-4bd3-a605-471ea5f2ceda tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:20.346950 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-5acdae2a-658e-4bd3-a605-471ea5f2ceda tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] [instance: 01fd3eb8-b195-4b9c-8d52-752e50be6f30] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:20.356546 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-867aa881-191f-46ed-bdfe-4df692742d55 tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] 10.222.0.33 "GET /compute/v2.1/servers/424127c5-245d-4486-a2e8-504cff0bcd85" status: 200 len: 1317 microversion: 2.1 time: 0.847915 Oct 04 20:54:20.356546 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2130/4199] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:54:19 2022] GET /compute/v2.1/servers/424127c5-245d-4486-a2e8-504cff0bcd85 => generated 1317 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:54:20.362706 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5acdae2a-658e-4bd3-a605-471ea5f2ceda tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:20.363959 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5acdae2a-658e-4bd3-a605-471ea5f2ceda tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:20.364651 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5acdae2a-658e-4bd3-a605-471ea5f2ceda tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:20.365453 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5acdae2a-658e-4bd3-a605-471ea5f2ceda tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:20.367592 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5acdae2a-658e-4bd3-a605-471ea5f2ceda tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:20.368242 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5acdae2a-658e-4bd3-a605-471ea5f2ceda tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:20.737154 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-6a5a5d20-d282-4143-92e8-a7869e4eb958 req-5a5a9c49-3b8e-4253-9fda-f237d3a2d824 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "866d0dd3-3c7e-4612-a132-48eb83ec2d16", "tag": "0544b7b3-d2c3-439a-b134-c025dc0ed7a6"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:54:20.750961 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-6a5a5d20-d282-4143-92e8-a7869e4eb958 req-5a5a9c49-3b8e-4253-9fda-f237d3a2d824 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:20.751841 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-6a5a5d20-d282-4143-92e8-a7869e4eb958 req-5a5a9c49-3b8e-4253-9fda-f237d3a2d824 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:20.752473 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-6a5a5d20-d282-4143-92e8-a7869e4eb958 req-5a5a9c49-3b8e-4253-9fda-f237d3a2d824 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:20.765786 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-6a5a5d20-d282-4143-92e8-a7869e4eb958 req-5a5a9c49-3b8e-4253-9fda-f237d3a2d824 service nova] Creating event network-changed:0544b7b3-d2c3-439a-b134-c025dc0ed7a6 for instance 866d0dd3-3c7e-4612-a132-48eb83ec2d16 on n-h2-854823-8 Oct 04 20:54:20.771579 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-6a5a5d20-d282-4143-92e8-a7869e4eb958 req-5a5a9c49-3b8e-4253-9fda-f237d3a2d824 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040412 Oct 04 20:54:20.772727 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2131/4200] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:54:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 20:54:20.829390 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-5acdae2a-658e-4bd3-a605-471ea5f2ceda tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e93855201ca64c779f92a2a33979b81f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed328a1e964d46902dee5e1c7c7b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:20.838040 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5acdae2a-658e-4bd3-a605-471ea5f2ceda tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] 10.222.0.33 "GET /compute/v2.1/servers/01fd3eb8-b195-4b9c-8d52-752e50be6f30" status: 200 len: 1514 microversion: 2.1 time: 0.504037 Oct 04 20:54:20.838659 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2070/4201] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:54:20 2022] GET /compute/v2.1/servers/01fd3eb8-b195-4b9c-8d52-752e50be6f30 => generated 1514 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:54:21.367676 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-af050847-e77b-4e73-9827-9aa8fa6e4c6a tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:21.370139 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-af050847-e77b-4e73-9827-9aa8fa6e4c6a tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] [instance: ea3e8404-38fa-4d1c-8356-53887f2ff64a] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:21.378991 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5187a6d2-1547-4714-b136-2c02dd4fc226 tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:21.380431 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-5187a6d2-1547-4714-b136-2c02dd4fc226 tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] [instance: 424127c5-245d-4486-a2e8-504cff0bcd85] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:21.386883 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:54:21.387349 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-af050847-e77b-4e73-9827-9aa8fa6e4c6a tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:21.388742 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=6 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:54:21.389217 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-af050847-e77b-4e73-9827-9aa8fa6e4c6a tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:21.390005 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-af050847-e77b-4e73-9827-9aa8fa6e4c6a tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:21.391082 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-af050847-e77b-4e73-9827-9aa8fa6e4c6a tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:21.394274 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-af050847-e77b-4e73-9827-9aa8fa6e4c6a tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:21.395219 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-af050847-e77b-4e73-9827-9aa8fa6e4c6a tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:21.396344 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5187a6d2-1547-4714-b136-2c02dd4fc226 tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:21.396853 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5187a6d2-1547-4714-b136-2c02dd4fc226 tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:21.397288 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5187a6d2-1547-4714-b136-2c02dd4fc226 tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:21.397991 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5187a6d2-1547-4714-b136-2c02dd4fc226 tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:21.398678 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5187a6d2-1547-4714-b136-2c02dd4fc226 tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:21.399273 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5187a6d2-1547-4714-b136-2c02dd4fc226 tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:21.941931 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-af050847-e77b-4e73-9827-9aa8fa6e4c6a tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c208ec9faf491385a9ab5b5932098d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ae4960393c464c97669731c2084d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:21.967548 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-5187a6d2-1547-4714-b136-2c02dd4fc226 tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '878cd5eab53247ae994c74a31c04f37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d49cd04ac04f578b78d43cca1cd2df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:21.994668 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-af050847-e77b-4e73-9827-9aa8fa6e4c6a tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] 10.222.0.33 "GET /compute/v2.1/servers/ea3e8404-38fa-4d1c-8356-53887f2ff64a" status: 200 len: 1314 microversion: 2.1 time: 0.638527 Oct 04 20:54:21.997793 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5187a6d2-1547-4714-b136-2c02dd4fc226 tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] 10.222.0.33 "GET /compute/v2.1/servers/424127c5-245d-4486-a2e8-504cff0bcd85" status: 200 len: 1506 microversion: 2.1 time: 0.624467 Oct 04 20:54:21.999230 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2132/4202] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:54:21 2022] GET /compute/v2.1/servers/ea3e8404-38fa-4d1c-8356-53887f2ff64a => generated 1314 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:54:22.000381 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2071/4203] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:54:21 2022] GET /compute/v2.1/servers/424127c5-245d-4486-a2e8-504cff0bcd85 => generated 1506 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:54:22.015111 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-9263d64a-a8b4-4c21-90e1-4972ec1edc64 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:22.016445 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-9263d64a-a8b4-4c21-90e1-4972ec1edc64 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] [instance: 01fd3eb8-b195-4b9c-8d52-752e50be6f30] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:22.033230 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-64d11298-5f79-435b-b138-a9351134b918 tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:22.033838 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-64d11298-5f79-435b-b138-a9351134b918 tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] [instance: 424127c5-245d-4486-a2e8-504cff0bcd85] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:22.041251 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell0:SELECT=2 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:54:22.045008 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-64d11298-5f79-435b-b138-a9351134b918 tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:22.045180 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9263d64a-a8b4-4c21-90e1-4972ec1edc64 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:22.045625 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9263d64a-a8b4-4c21-90e1-4972ec1edc64 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:22.046083 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9263d64a-a8b4-4c21-90e1-4972ec1edc64 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:22.046217 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-64d11298-5f79-435b-b138-a9351134b918 tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:22.046944 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-64d11298-5f79-435b-b138-a9351134b918 tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:22.049756 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-64d11298-5f79-435b-b138-a9351134b918 tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:22.050256 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-64d11298-5f79-435b-b138-a9351134b918 tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:22.050903 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-64d11298-5f79-435b-b138-a9351134b918 tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:22.051336 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9263d64a-a8b4-4c21-90e1-4972ec1edc64 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:22.051833 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9263d64a-a8b4-4c21-90e1-4972ec1edc64 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:22.052275 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9263d64a-a8b4-4c21-90e1-4972ec1edc64 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:22.101478 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-64d11298-5f79-435b-b138-a9351134b918 tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] 10.222.0.33 "GET /compute/v2.1/servers/424127c5-245d-4486-a2e8-504cff0bcd85/ips" status: 200 len: 109 microversion: 2.1 time: 0.072728 Oct 04 20:54:22.105825 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2072/4204] 10.222.0.33 () {58 vars in 1248 bytes} [Tue Oct 4 20:54:22 2022] GET /compute/v2.1/servers/424127c5-245d-4486-a2e8-504cff0bcd85/ips => generated 109 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:54:22.115311 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-dd12a308-c7fc-4eea-8608-99cb0af3b53e tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:22.115985 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-dd12a308-c7fc-4eea-8608-99cb0af3b53e tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] [instance: 424127c5-245d-4486-a2e8-504cff0bcd85] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:22.122709 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dd12a308-c7fc-4eea-8608-99cb0af3b53e tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:22.123421 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dd12a308-c7fc-4eea-8608-99cb0af3b53e tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:22.124033 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dd12a308-c7fc-4eea-8608-99cb0af3b53e tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:22.124898 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dd12a308-c7fc-4eea-8608-99cb0af3b53e tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:22.125500 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dd12a308-c7fc-4eea-8608-99cb0af3b53e tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:22.126070 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dd12a308-c7fc-4eea-8608-99cb0af3b53e tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:22.158693 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-dd12a308-c7fc-4eea-8608-99cb0af3b53e tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] 10.222.0.33 "GET /compute/v2.1/servers/424127c5-245d-4486-a2e8-504cff0bcd85/ips" status: 200 len: 109 microversion: 2.1 time: 0.047321 Oct 04 20:54:22.160123 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2073/4205] 10.222.0.33 () {58 vars in 1248 bytes} [Tue Oct 4 20:54:22 2022] GET /compute/v2.1/servers/424127c5-245d-4486-a2e8-504cff0bcd85/ips => generated 109 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:54:22.171699 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2727536b-308e-4028-9be6-7e851998f118 tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:22.173418 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-2727536b-308e-4028-9be6-7e851998f118 tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] [instance: 424127c5-245d-4486-a2e8-504cff0bcd85] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:22.182217 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2727536b-308e-4028-9be6-7e851998f118 tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:22.183954 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2727536b-308e-4028-9be6-7e851998f118 tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:22.184631 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2727536b-308e-4028-9be6-7e851998f118 tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:22.185846 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2727536b-308e-4028-9be6-7e851998f118 tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:22.186558 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2727536b-308e-4028-9be6-7e851998f118 tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:22.190681 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2727536b-308e-4028-9be6-7e851998f118 tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:22.225449 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-2727536b-308e-4028-9be6-7e851998f118 tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] 10.222.0.33 "GET /compute/v2.1/servers/424127c5-245d-4486-a2e8-504cff0bcd85/ips/tempest-ServerAddressesTestJSON-1583144868-network" status: 200 len: 94 microversion: 2.1 time: 0.057662 Oct 04 20:54:22.226450 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2074/4206] 10.222.0.33 () {58 vars in 1401 bytes} [Tue Oct 4 20:54:22 2022] GET /compute/v2.1/servers/424127c5-245d-4486-a2e8-504cff0bcd85/ips/tempest-ServerAddressesTestJSON-1583144868-network => generated 94 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 20:54:22.241881 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ac84ecbe-0c83-4d1b-8e27-90dfcdb7b404 tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:22.242690 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ac84ecbe-0c83-4d1b-8e27-90dfcdb7b404 tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] [instance: 424127c5-245d-4486-a2e8-504cff0bcd85] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:22.250773 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ac84ecbe-0c83-4d1b-8e27-90dfcdb7b404 tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:22.251586 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ac84ecbe-0c83-4d1b-8e27-90dfcdb7b404 tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:22.252183 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ac84ecbe-0c83-4d1b-8e27-90dfcdb7b404 tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:22.253058 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ac84ecbe-0c83-4d1b-8e27-90dfcdb7b404 tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:22.253668 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ac84ecbe-0c83-4d1b-8e27-90dfcdb7b404 tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:22.254116 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ac84ecbe-0c83-4d1b-8e27-90dfcdb7b404 tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:22.282318 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ac84ecbe-0c83-4d1b-8e27-90dfcdb7b404 tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] [instance: 424127c5-245d-4486-a2e8-504cff0bcd85] Going to try to terminate instance {{(pid=128801) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:54:22.407889 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ac84ecbe-0c83-4d1b-8e27-90dfcdb7b404 tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] 10.222.0.33 "DELETE /compute/v2.1/servers/424127c5-245d-4486-a2e8-504cff0bcd85" status: 204 len: 0 microversion: 2.1 time: 0.171039 Oct 04 20:54:22.409321 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2075/4207] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 20:54:22 2022] DELETE /compute/v2.1/servers/424127c5-245d-4486-a2e8-504cff0bcd85 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:54:22.419976 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-4864c44d-8b1a-4946-b544-f621189c5850 tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:22.420983 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-4864c44d-8b1a-4946-b544-f621189c5850 tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] [instance: 424127c5-245d-4486-a2e8-504cff0bcd85] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:22.428647 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4864c44d-8b1a-4946-b544-f621189c5850 tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:22.429358 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4864c44d-8b1a-4946-b544-f621189c5850 tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:22.429933 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4864c44d-8b1a-4946-b544-f621189c5850 tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:22.430850 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4864c44d-8b1a-4946-b544-f621189c5850 tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:22.431930 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4864c44d-8b1a-4946-b544-f621189c5850 tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:22.432872 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4864c44d-8b1a-4946-b544-f621189c5850 tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:23.034815 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-9263d64a-a8b4-4c21-90e1-4972ec1edc64 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e93855201ca64c779f92a2a33979b81f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed328a1e964d46902dee5e1c7c7b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:23.048292 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-9263d64a-a8b4-4c21-90e1-4972ec1edc64 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] 10.222.0.33 "GET /compute/v2.1/servers/01fd3eb8-b195-4b9c-8d52-752e50be6f30" status: 200 len: 1514 microversion: 2.1 time: 1.046215 Oct 04 20:54:23.049681 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2133/4208] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:54:22 2022] GET /compute/v2.1/servers/01fd3eb8-b195-4b9c-8d52-752e50be6f30 => generated 1514 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:54:23.062499 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-d7a1c108-36b5-4965-928f-4a0935fa905a tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:23.063573 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-d7a1c108-36b5-4965-928f-4a0935fa905a tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] [instance: ea3e8404-38fa-4d1c-8356-53887f2ff64a] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:23.078783 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d7a1c108-36b5-4965-928f-4a0935fa905a tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:23.080063 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d7a1c108-36b5-4965-928f-4a0935fa905a tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:23.080857 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d7a1c108-36b5-4965-928f-4a0935fa905a tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:23.082079 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d7a1c108-36b5-4965-928f-4a0935fa905a tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:23.082849 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d7a1c108-36b5-4965-928f-4a0935fa905a tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:23.083544 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d7a1c108-36b5-4965-928f-4a0935fa905a tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:23.305124 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-4864c44d-8b1a-4946-b544-f621189c5850 tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '878cd5eab53247ae994c74a31c04f37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d49cd04ac04f578b78d43cca1cd2df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:23.315707 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-4864c44d-8b1a-4946-b544-f621189c5850 tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] 10.222.0.33 "GET /compute/v2.1/servers/424127c5-245d-4486-a2e8-504cff0bcd85" status: 200 len: 1512 microversion: 2.1 time: 0.901423 Oct 04 20:54:23.316203 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2076/4209] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:54:22 2022] GET /compute/v2.1/servers/424127c5-245d-4486-a2e8-504cff0bcd85 => generated 1512 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:54:23.600215 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-d7a1c108-36b5-4965-928f-4a0935fa905a tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c208ec9faf491385a9ab5b5932098d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ae4960393c464c97669731c2084d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:23.609898 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-d7a1c108-36b5-4965-928f-4a0935fa905a tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] 10.222.0.33 "GET /compute/v2.1/servers/ea3e8404-38fa-4d1c-8356-53887f2ff64a" status: 200 len: 1314 microversion: 2.1 time: 0.558824 Oct 04 20:54:23.610597 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2134/4210] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:54:23 2022] GET /compute/v2.1/servers/ea3e8404-38fa-4d1c-8356-53887f2ff64a => generated 1314 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:54:24.076316 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2d7ec751-3d07-4a13-815b-6621d64e204b tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:24.077244 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-2d7ec751-3d07-4a13-815b-6621d64e204b tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] [instance: 01fd3eb8-b195-4b9c-8d52-752e50be6f30] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:24.084768 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2d7ec751-3d07-4a13-815b-6621d64e204b tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:24.085665 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2d7ec751-3d07-4a13-815b-6621d64e204b tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:24.086385 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2d7ec751-3d07-4a13-815b-6621d64e204b tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:24.087477 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2d7ec751-3d07-4a13-815b-6621d64e204b tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:24.088704 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2d7ec751-3d07-4a13-815b-6621d64e204b tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:24.089355 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2d7ec751-3d07-4a13-815b-6621d64e204b tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:24.342182 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-89295d1f-bf5b-49a3-9db1-366b55124ff1 tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:24.342835 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-89295d1f-bf5b-49a3-9db1-366b55124ff1 tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] [instance: 424127c5-245d-4486-a2e8-504cff0bcd85] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:24.354368 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-89295d1f-bf5b-49a3-9db1-366b55124ff1 tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:24.355801 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-89295d1f-bf5b-49a3-9db1-366b55124ff1 tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:24.356605 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-89295d1f-bf5b-49a3-9db1-366b55124ff1 tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:24.358728 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-89295d1f-bf5b-49a3-9db1-366b55124ff1 tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:24.361158 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-89295d1f-bf5b-49a3-9db1-366b55124ff1 tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:24.361790 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-89295d1f-bf5b-49a3-9db1-366b55124ff1 tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:24.465110 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-2d7ec751-3d07-4a13-815b-6621d64e204b tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e93855201ca64c779f92a2a33979b81f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed328a1e964d46902dee5e1c7c7b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:24.481919 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-2d7ec751-3d07-4a13-815b-6621d64e204b tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] 10.222.0.33 "GET /compute/v2.1/servers/01fd3eb8-b195-4b9c-8d52-752e50be6f30" status: 200 len: 1514 microversion: 2.1 time: 0.410460 Oct 04 20:54:24.483360 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2077/4211] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:54:24 2022] GET /compute/v2.1/servers/01fd3eb8-b195-4b9c-8d52-752e50be6f30 => generated 1514 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:54:24.738045 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-89295d1f-bf5b-49a3-9db1-366b55124ff1 tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '878cd5eab53247ae994c74a31c04f37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d49cd04ac04f578b78d43cca1cd2df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:24.757322 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-89295d1f-bf5b-49a3-9db1-366b55124ff1 tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] 10.222.0.33 "GET /compute/v2.1/servers/424127c5-245d-4486-a2e8-504cff0bcd85" status: 200 len: 1512 microversion: 2.1 time: 0.417585 Oct 04 20:54:24.760352 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2135/4212] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:54:24 2022] GET /compute/v2.1/servers/424127c5-245d-4486-a2e8-504cff0bcd85 => generated 1512 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:54:24.913791 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-18941740-7c33-442c-908c-0f8360988e67 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:24.917078 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-18941740-7c33-442c-908c-0f8360988e67 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] [instance: ea3e8404-38fa-4d1c-8356-53887f2ff64a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:24.933530 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-18941740-7c33-442c-908c-0f8360988e67 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:24.934199 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-18941740-7c33-442c-908c-0f8360988e67 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:24.934987 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-18941740-7c33-442c-908c-0f8360988e67 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:24.935959 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-18941740-7c33-442c-908c-0f8360988e67 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:24.936662 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-18941740-7c33-442c-908c-0f8360988e67 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:24.937365 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-18941740-7c33-442c-908c-0f8360988e67 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:24.939747 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-5c9e6557-e413-4380-929b-f7bc56ec487c req-b2486546-996e-41b8-97dc-3fe285803b34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea3e8404-38fa-4d1c-8356-53887f2ff64a", "name": "network-vif-plugged", "status": "completed", "tag": "44aee782-feff-400a-94b5-8a0b4b41faa5"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:54:24.957962 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-5c9e6557-e413-4380-929b-f7bc56ec487c req-b2486546-996e-41b8-97dc-3fe285803b34 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:24.958614 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-5c9e6557-e413-4380-929b-f7bc56ec487c req-b2486546-996e-41b8-97dc-3fe285803b34 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:24.959434 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-5c9e6557-e413-4380-929b-f7bc56ec487c req-b2486546-996e-41b8-97dc-3fe285803b34 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:24.980495 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-5c9e6557-e413-4380-929b-f7bc56ec487c req-b2486546-996e-41b8-97dc-3fe285803b34 service nova] Creating event network-vif-plugged:44aee782-feff-400a-94b5-8a0b4b41faa5 for instance ea3e8404-38fa-4d1c-8356-53887f2ff64a on n-h1-854823-8 Oct 04 20:54:24.986134 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-5c9e6557-e413-4380-929b-f7bc56ec487c req-b2486546-996e-41b8-97dc-3fe285803b34 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052477 Oct 04 20:54:24.987350 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2136/4213] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:54:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 20:54:25.506664 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-18941740-7c33-442c-908c-0f8360988e67 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c208ec9faf491385a9ab5b5932098d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ae4960393c464c97669731c2084d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:25.535055 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-b861b783-0714-4d15-a027-c0b582e61bbf tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:25.536167 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-b861b783-0714-4d15-a027-c0b582e61bbf tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] [instance: 01fd3eb8-b195-4b9c-8d52-752e50be6f30] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:25.536908 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-18941740-7c33-442c-908c-0f8360988e67 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] 10.222.0.33 "GET /compute/v2.1/servers/ea3e8404-38fa-4d1c-8356-53887f2ff64a" status: 200 len: 1314 microversion: 2.1 time: 0.907174 Oct 04 20:54:25.539176 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2078/4214] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:54:24 2022] GET /compute/v2.1/servers/ea3e8404-38fa-4d1c-8356-53887f2ff64a => generated 1314 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:54:25.555248 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-4f8f3a4f-9497-4e4c-ac91-444e038bad54 req-c7b27fb8-86b1-429a-a2e7-1b41264fba11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "424127c5-245d-4486-a2e8-504cff0bcd85", "name": "network-vif-deleted", "tag": "850fb50d-9a2d-4230-abc3-54c00085fa63"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:54:25.565916 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b861b783-0714-4d15-a027-c0b582e61bbf tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:25.566612 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b861b783-0714-4d15-a027-c0b582e61bbf tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:25.567777 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b861b783-0714-4d15-a027-c0b582e61bbf tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:25.575535 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b861b783-0714-4d15-a027-c0b582e61bbf tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:25.576357 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b861b783-0714-4d15-a027-c0b582e61bbf tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:25.577319 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b861b783-0714-4d15-a027-c0b582e61bbf tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:25.580524 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-4f8f3a4f-9497-4e4c-ac91-444e038bad54 req-c7b27fb8-86b1-429a-a2e7-1b41264fba11 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:25.581065 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-4f8f3a4f-9497-4e4c-ac91-444e038bad54 req-c7b27fb8-86b1-429a-a2e7-1b41264fba11 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:25.581515 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-4f8f3a4f-9497-4e4c-ac91-444e038bad54 req-c7b27fb8-86b1-429a-a2e7-1b41264fba11 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:25.600610 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-4f8f3a4f-9497-4e4c-ac91-444e038bad54 req-c7b27fb8-86b1-429a-a2e7-1b41264fba11 service nova] Creating event network-vif-deleted:850fb50d-9a2d-4230-abc3-54c00085fa63 for instance 424127c5-245d-4486-a2e8-504cff0bcd85 on n-h2-854823-8 Oct 04 20:54:25.613457 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-4f8f3a4f-9497-4e4c-ac91-444e038bad54 req-c7b27fb8-86b1-429a-a2e7-1b41264fba11 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072795 Oct 04 20:54:25.614067 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2079/4215] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:54:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:54:25.788145 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-65184b1b-abe5-40a9-85db-dad74216cb40 tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:25.789507 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-65184b1b-abe5-40a9-85db-dad74216cb40 tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] [instance: 424127c5-245d-4486-a2e8-504cff0bcd85] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:25.800354 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-65184b1b-abe5-40a9-85db-dad74216cb40 tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:25.801269 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-65184b1b-abe5-40a9-85db-dad74216cb40 tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:25.802122 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-65184b1b-abe5-40a9-85db-dad74216cb40 tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:25.804325 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-65184b1b-abe5-40a9-85db-dad74216cb40 tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:25.805022 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-65184b1b-abe5-40a9-85db-dad74216cb40 tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:25.805527 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-65184b1b-abe5-40a9-85db-dad74216cb40 tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:25.858616 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-65184b1b-abe5-40a9-85db-dad74216cb40 tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:25.859345 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-65184b1b-abe5-40a9-85db-dad74216cb40 tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:25.859941 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-65184b1b-abe5-40a9-85db-dad74216cb40 tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:25.860558 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-65184b1b-abe5-40a9-85db-dad74216cb40 tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] Lazy-loading 'fault' on Instance uuid 424127c5-245d-4486-a2e8-504cff0bcd85 {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:54:25.927200 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-65184b1b-abe5-40a9-85db-dad74216cb40 tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '878cd5eab53247ae994c74a31c04f37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d49cd04ac04f578b78d43cca1cd2df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:25.938246 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-65184b1b-abe5-40a9-85db-dad74216cb40 tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] 10.222.0.33 "GET /compute/v2.1/servers/424127c5-245d-4486-a2e8-504cff0bcd85" status: 200 len: 1307 microversion: 2.1 time: 0.156671 Oct 04 20:54:25.939372 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2080/4216] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:54:25 2022] GET /compute/v2.1/servers/424127c5-245d-4486-a2e8-504cff0bcd85 => generated 1307 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:54:25.944831 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-b861b783-0714-4d15-a027-c0b582e61bbf tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e93855201ca64c779f92a2a33979b81f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed328a1e964d46902dee5e1c7c7b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:25.965473 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-b861b783-0714-4d15-a027-c0b582e61bbf tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] 10.222.0.33 "GET /compute/v2.1/servers/01fd3eb8-b195-4b9c-8d52-752e50be6f30" status: 200 len: 1514 microversion: 2.1 time: 0.447627 Oct 04 20:54:25.968372 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2137/4217] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:54:25 2022] GET /compute/v2.1/servers/01fd3eb8-b195-4b9c-8d52-752e50be6f30 => generated 1514 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:54:26.563461 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1f4cb41c-b585-44e5-a0f9-efc694b2a265 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:26.564848 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-1f4cb41c-b585-44e5-a0f9-efc694b2a265 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] [instance: ea3e8404-38fa-4d1c-8356-53887f2ff64a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:26.578102 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1f4cb41c-b585-44e5-a0f9-efc694b2a265 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:26.579188 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1f4cb41c-b585-44e5-a0f9-efc694b2a265 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:26.579883 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1f4cb41c-b585-44e5-a0f9-efc694b2a265 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:26.580951 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1f4cb41c-b585-44e5-a0f9-efc694b2a265 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:26.582794 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1f4cb41c-b585-44e5-a0f9-efc694b2a265 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:26.583446 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1f4cb41c-b585-44e5-a0f9-efc694b2a265 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:26.969482 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-c7c74dc3-dd02-420c-b11e-fd8380c20d3b tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:26.971108 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-c7c74dc3-dd02-420c-b11e-fd8380c20d3b tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] [instance: 424127c5-245d-4486-a2e8-504cff0bcd85] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:26.980151 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c7c74dc3-dd02-420c-b11e-fd8380c20d3b tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:26.982163 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c7c74dc3-dd02-420c-b11e-fd8380c20d3b tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:26.987261 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c7c74dc3-dd02-420c-b11e-fd8380c20d3b tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:26.990151 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c7c74dc3-dd02-420c-b11e-fd8380c20d3b tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:26.993768 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c7c74dc3-dd02-420c-b11e-fd8380c20d3b tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:26.998717 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c7c74dc3-dd02-420c-b11e-fd8380c20d3b tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:27.030249 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.wsgi [None req-c7c74dc3-dd02-420c-b11e-fd8380c20d3b tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] HTTP exception thrown: Instance 424127c5-245d-4486-a2e8-504cff0bcd85 could not be found. Oct 04 20:54:27.034135 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-c7c74dc3-dd02-420c-b11e-fd8380c20d3b tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] Request method failure captured: Oct 04 20:54:27.034135 n-d-854823-8 devstack@n-api.service[128802]: request: GET /compute/v2.1/servers/424127c5-245d-4486-a2e8-504cff0bcd85 HTTP/1.1 Oct 04 20:54:27.034135 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 20:54:27.034135 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 20:54:27.034135 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 20:54:27.034135 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 0 Oct 04 20:54:27.034135 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 20:54:27.034135 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 20:54:27.034135 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 20:54:27.034135 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 20:54:27.034135 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPJ1ld99Ynhn3pSROT5yHf71udClwqVyW2vBNrID4ZVfq9nI1eTwOBQd32J7QMeOV4CohOwleYrCDLZYmZZmT6EVRbx7MhwVItPNXjG9eHt3-hgPhZ9giRQRKmT94me0OjhahipQxIyCcnPccjj9g36y7d-hDXMYV7wpWgTiea2Xwiqs Oct 04 20:54:27.034135 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 20:54:27.034135 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 20:54:27.034135 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 20:54:27.034135 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 20:54:27.034135 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 20:54:27.034135 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 20:54:27.034135 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: 87d49cd04ac04f578b78d43cca1cd2df Oct 04 20:54:27.034135 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-ServerAddressesTestJSON-1996693352 Oct 04 20:54:27.034135 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 20:54:27.034135 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 20:54:27.034135 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_87d49cd04ac04f578b78d43cca1cd2df", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/87d49cd04ac04f578b78d43cca1cd2df"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/87d49cd04ac04f578b78d43cca1cd2df"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/87d49cd04ac04f578b78d43cca1cd2df"}]}] Oct 04 20:54:27.034135 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-ServerAddressesTestJSON-1996693352 Oct 04 20:54:27.034135 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: 87d49cd04ac04f578b78d43cca1cd2df Oct 04 20:54:27.034135 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-ServerAddressesTestJSON-1996693352 Oct 04 20:54:27.034135 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-ServerAddressesTestJSON-1996693352-project Oct 04 20:54:27.034135 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 20:54:27.034135 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 20:54:27.034135 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: 878cd5eab53247ae994c74a31c04f37b Oct 04 20:54:27.034135 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-ServerAddressesTestJSON-1996693352-project Oct 04 20:54:27.034135 n-d-854823-8 devstack@n-api.service[128802]: method: > Oct 04 20:54:27.034135 n-d-854823-8 devstack@n-api.service[128802]: exception: Instance 424127c5-245d-4486-a2e8-504cff0bcd85 could not be found. Oct 04 20:54:27.034135 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'id': '424127c5-245d-4486-a2e8-504cff0bcd85'} Oct 04 20:54:27.034135 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:54:27.034135 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:54:27.034135 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:54:27.034135 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:54:27.034135 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:54:27.034135 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:54:27.034135 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:54:27.034135 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:54:27.034135 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:54:27.034135 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:54:27.034135 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 424127c5-245d-4486-a2e8-504cff0bcd85 could not be found. Oct 04 20:54:27.034135 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:54:27.034135 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:54:27.034135 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:54:27.034135 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:54:27.034135 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:54:27.034135 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:54:27.034135 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:54:27.034135 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:54:27.034135 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:54:27.034135 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:54:27.034135 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:54:27.034135 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:54:27.034135 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:54:27.034135 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:54:27.034135 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:54:27.034135 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:54:27.034135 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 424127c5-245d-4486-a2e8-504cff0bcd85 could not be found. Oct 04 20:54:27.034135 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:54:27.034135 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:54:27.034135 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:54:27.038213 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:54:27.038213 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:54:27.038213 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:54:27.038213 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:54:27.038213 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:54:27.038213 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 424127c5-245d-4486-a2e8-504cff0bcd85 could not be found. Oct 04 20:54:27.038213 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:54:27.040221 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-c7c74dc3-dd02-420c-b11e-fd8380c20d3b tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] Returning 404 to user: Instance 424127c5-245d-4486-a2e8-504cff0bcd85 could not be found. {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:54:27.042191 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-c7c74dc3-dd02-420c-b11e-fd8380c20d3b tempest-ServerAddressesTestJSON-1996693352 tempest-ServerAddressesTestJSON-1996693352-project] 10.222.0.33 "GET /compute/v2.1/servers/424127c5-245d-4486-a2e8-504cff0bcd85" status: 404 len: 111 microversion: 2.1 time: 0.082856 Oct 04 20:54:27.047280 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2138/4218] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:54:26 2022] GET /compute/v2.1/servers/424127c5-245d-4486-a2e8-504cff0bcd85 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 20:54:27.054916 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-e691f848-8814-4736-83f3-5bc09c34a9e7 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:27.056168 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-e691f848-8814-4736-83f3-5bc09c34a9e7 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] [instance: 01fd3eb8-b195-4b9c-8d52-752e50be6f30] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:27.065278 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e691f848-8814-4736-83f3-5bc09c34a9e7 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:27.066226 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e691f848-8814-4736-83f3-5bc09c34a9e7 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:27.067048 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e691f848-8814-4736-83f3-5bc09c34a9e7 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:27.068227 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e691f848-8814-4736-83f3-5bc09c34a9e7 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:27.068972 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e691f848-8814-4736-83f3-5bc09c34a9e7 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:27.070165 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e691f848-8814-4736-83f3-5bc09c34a9e7 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:27.240773 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-1f4cb41c-b585-44e5-a0f9-efc694b2a265 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c208ec9faf491385a9ab5b5932098d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ae4960393c464c97669731c2084d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:27.254725 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-1f4cb41c-b585-44e5-a0f9-efc694b2a265 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] 10.222.0.33 "GET /compute/v2.1/servers/ea3e8404-38fa-4d1c-8356-53887f2ff64a" status: 200 len: 1314 microversion: 2.1 time: 0.696577 Oct 04 20:54:27.255619 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2081/4219] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:54:26 2022] GET /compute/v2.1/servers/ea3e8404-38fa-4d1c-8356-53887f2ff64a => generated 1314 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:54:27.708398 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-e691f848-8814-4736-83f3-5bc09c34a9e7 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e93855201ca64c779f92a2a33979b81f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed328a1e964d46902dee5e1c7c7b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:27.717783 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-e691f848-8814-4736-83f3-5bc09c34a9e7 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] 10.222.0.33 "GET /compute/v2.1/servers/01fd3eb8-b195-4b9c-8d52-752e50be6f30" status: 200 len: 1514 microversion: 2.1 time: 0.669017 Oct 04 20:54:27.719148 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2139/4220] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:54:27 2022] GET /compute/v2.1/servers/01fd3eb8-b195-4b9c-8d52-752e50be6f30 => generated 1514 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:54:28.277626 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2a2c8460-4164-4a2e-9b07-94247955e1eb tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:28.278248 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-2a2c8460-4164-4a2e-9b07-94247955e1eb tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] [instance: ea3e8404-38fa-4d1c-8356-53887f2ff64a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:28.285362 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2a2c8460-4164-4a2e-9b07-94247955e1eb tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:28.286091 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2a2c8460-4164-4a2e-9b07-94247955e1eb tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:28.286611 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2a2c8460-4164-4a2e-9b07-94247955e1eb tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:28.287322 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2a2c8460-4164-4a2e-9b07-94247955e1eb tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:28.287779 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2a2c8460-4164-4a2e-9b07-94247955e1eb tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:28.288214 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2a2c8460-4164-4a2e-9b07-94247955e1eb tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:28.744839 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-7d2590a3-733c-4ed2-b07f-c2065f50f6d8 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:28.746926 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-7d2590a3-733c-4ed2-b07f-c2065f50f6d8 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] [instance: 01fd3eb8-b195-4b9c-8d52-752e50be6f30] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:28.755371 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7d2590a3-733c-4ed2-b07f-c2065f50f6d8 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:28.756252 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7d2590a3-733c-4ed2-b07f-c2065f50f6d8 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:28.756913 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7d2590a3-733c-4ed2-b07f-c2065f50f6d8 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:28.757839 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7d2590a3-733c-4ed2-b07f-c2065f50f6d8 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:28.758927 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7d2590a3-733c-4ed2-b07f-c2065f50f6d8 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:28.759668 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7d2590a3-733c-4ed2-b07f-c2065f50f6d8 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:28.780921 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=100 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:54:28.793604 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-2a2c8460-4164-4a2e-9b07-94247955e1eb tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c208ec9faf491385a9ab5b5932098d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ae4960393c464c97669731c2084d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:28.802091 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-2a2c8460-4164-4a2e-9b07-94247955e1eb tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] 10.222.0.33 "GET /compute/v2.1/servers/ea3e8404-38fa-4d1c-8356-53887f2ff64a" status: 200 len: 1500 microversion: 2.1 time: 0.528885 Oct 04 20:54:28.803087 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2082/4221] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:54:28 2022] GET /compute/v2.1/servers/ea3e8404-38fa-4d1c-8356-53887f2ff64a => generated 1500 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:54:28.827214 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-974e9385-6e1f-42ba-b804-1c863b40a5a5 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:54:28.828420 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-974e9385-6e1f-42ba-b804-1c863b40a5a5 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] [instance: ea3e8404-38fa-4d1c-8356-53887f2ff64a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:28.836951 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-974e9385-6e1f-42ba-b804-1c863b40a5a5 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:28.837984 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-974e9385-6e1f-42ba-b804-1c863b40a5a5 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:28.838623 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-974e9385-6e1f-42ba-b804-1c863b40a5a5 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:28.839430 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-974e9385-6e1f-42ba-b804-1c863b40a5a5 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:28.840010 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-974e9385-6e1f-42ba-b804-1c863b40a5a5 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:28.840652 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-974e9385-6e1f-42ba-b804-1c863b40a5a5 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:28.860725 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:54:28.873509 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-974e9385-6e1f-42ba-b804-1c863b40a5a5 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lazy-loading 'flavor' on Instance uuid ea3e8404-38fa-4d1c-8356-53887f2ff64a {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:54:29.077344 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-974e9385-6e1f-42ba-b804-1c863b40a5a5 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] 10.222.0.33 "POST /compute/v2.1/servers/ea3e8404-38fa-4d1c-8356-53887f2ff64a/action" status: 202 len: 0 microversion: 2.1 time: 0.254591 Oct 04 20:54:29.084159 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2083/4222] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 20:54:28 2022] POST /compute/v2.1/servers/ea3e8404-38fa-4d1c-8356-53887f2ff64a/action => generated 0 bytes in 261 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:54:29.091862 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-72336c66-25a7-4528-9540-6dba2da3f469 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:29.094899 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-72336c66-25a7-4528-9540-6dba2da3f469 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] [instance: ea3e8404-38fa-4d1c-8356-53887f2ff64a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:29.106076 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-72336c66-25a7-4528-9540-6dba2da3f469 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:29.107134 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-72336c66-25a7-4528-9540-6dba2da3f469 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:29.107908 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-72336c66-25a7-4528-9540-6dba2da3f469 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:29.109012 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-72336c66-25a7-4528-9540-6dba2da3f469 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:29.110292 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-72336c66-25a7-4528-9540-6dba2da3f469 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:29.111307 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-72336c66-25a7-4528-9540-6dba2da3f469 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:29.591819 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-7d2590a3-733c-4ed2-b07f-c2065f50f6d8 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e93855201ca64c779f92a2a33979b81f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed328a1e964d46902dee5e1c7c7b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:29.600614 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-7d2590a3-733c-4ed2-b07f-c2065f50f6d8 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] 10.222.0.33 "GET /compute/v2.1/servers/01fd3eb8-b195-4b9c-8d52-752e50be6f30" status: 200 len: 1514 microversion: 2.1 time: 0.863312 Oct 04 20:54:29.601677 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2140/4223] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:54:28 2022] GET /compute/v2.1/servers/01fd3eb8-b195-4b9c-8d52-752e50be6f30 => generated 1514 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:54:29.994815 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-72336c66-25a7-4528-9540-6dba2da3f469 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c208ec9faf491385a9ab5b5932098d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ae4960393c464c97669731c2084d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:30.003809 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-72336c66-25a7-4528-9540-6dba2da3f469 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] 10.222.0.33 "GET /compute/v2.1/servers/ea3e8404-38fa-4d1c-8356-53887f2ff64a" status: 200 len: 1508 microversion: 2.1 time: 0.917142 Oct 04 20:54:30.005348 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2084/4224] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:54:29 2022] GET /compute/v2.1/servers/ea3e8404-38fa-4d1c-8356-53887f2ff64a => generated 1508 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:54:30.624313 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-b3186133-4fd8-4fbd-852a-6033de30aea0 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:30.624921 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-b3186133-4fd8-4fbd-852a-6033de30aea0 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] [instance: 01fd3eb8-b195-4b9c-8d52-752e50be6f30] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:30.641772 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b3186133-4fd8-4fbd-852a-6033de30aea0 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:30.644976 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b3186133-4fd8-4fbd-852a-6033de30aea0 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:30.645658 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b3186133-4fd8-4fbd-852a-6033de30aea0 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:30.647435 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b3186133-4fd8-4fbd-852a-6033de30aea0 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:30.647873 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b3186133-4fd8-4fbd-852a-6033de30aea0 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:30.648315 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b3186133-4fd8-4fbd-852a-6033de30aea0 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:31.028776 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b503164b-58c2-40ef-8ac5-0693650bbf37 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:31.030060 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b503164b-58c2-40ef-8ac5-0693650bbf37 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] [instance: ea3e8404-38fa-4d1c-8356-53887f2ff64a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:31.037229 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b503164b-58c2-40ef-8ac5-0693650bbf37 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:31.038010 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b503164b-58c2-40ef-8ac5-0693650bbf37 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:31.038718 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b503164b-58c2-40ef-8ac5-0693650bbf37 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:31.039629 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b503164b-58c2-40ef-8ac5-0693650bbf37 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:31.040620 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b503164b-58c2-40ef-8ac5-0693650bbf37 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:31.041428 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b503164b-58c2-40ef-8ac5-0693650bbf37 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:31.488108 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-b3186133-4fd8-4fbd-852a-6033de30aea0 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e93855201ca64c779f92a2a33979b81f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed328a1e964d46902dee5e1c7c7b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:31.498850 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-b3186133-4fd8-4fbd-852a-6033de30aea0 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] 10.222.0.33 "GET /compute/v2.1/servers/01fd3eb8-b195-4b9c-8d52-752e50be6f30" status: 200 len: 1532 microversion: 2.1 time: 0.877816 Oct 04 20:54:31.515453 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2141/4225] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:54:30 2022] GET /compute/v2.1/servers/01fd3eb8-b195-4b9c-8d52-752e50be6f30 => generated 1532 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:54:31.754788 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-b503164b-58c2-40ef-8ac5-0693650bbf37 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c208ec9faf491385a9ab5b5932098d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ae4960393c464c97669731c2084d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:31.763848 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b503164b-58c2-40ef-8ac5-0693650bbf37 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] 10.222.0.33 "GET /compute/v2.1/servers/ea3e8404-38fa-4d1c-8356-53887f2ff64a" status: 200 len: 1491 microversion: 2.1 time: 0.739866 Oct 04 20:54:31.764591 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2085/4226] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:54:31 2022] GET /compute/v2.1/servers/ea3e8404-38fa-4d1c-8356-53887f2ff64a => generated 1491 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:54:31.787137 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-15325e10-5650-4744-81b1-c213636c987d tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:31.788344 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-15325e10-5650-4744-81b1-c213636c987d tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] [instance: ea3e8404-38fa-4d1c-8356-53887f2ff64a] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:31.796493 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-15325e10-5650-4744-81b1-c213636c987d tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:31.797359 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-15325e10-5650-4744-81b1-c213636c987d tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:31.798146 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-15325e10-5650-4744-81b1-c213636c987d tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:31.798890 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-15325e10-5650-4744-81b1-c213636c987d tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:31.799346 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-15325e10-5650-4744-81b1-c213636c987d tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:31.799997 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-15325e10-5650-4744-81b1-c213636c987d tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:31.843859 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-15325e10-5650-4744-81b1-c213636c987d tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] [instance: ea3e8404-38fa-4d1c-8356-53887f2ff64a] Going to try to terminate instance {{(pid=128802) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:54:31.911190 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_api:SELECT=78 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:54:31.930012 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-15325e10-5650-4744-81b1-c213636c987d tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] 10.222.0.33 "DELETE /compute/v2.1/servers/ea3e8404-38fa-4d1c-8356-53887f2ff64a" status: 204 len: 0 microversion: 2.1 time: 0.146139 Oct 04 20:54:31.930640 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2142/4227] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 20:54:31 2022] DELETE /compute/v2.1/servers/ea3e8404-38fa-4d1c-8356-53887f2ff64a => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:54:31.940156 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-29638696-45fa-41fd-b5ff-3d43f18d368c tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:31.940850 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-29638696-45fa-41fd-b5ff-3d43f18d368c tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] [instance: ea3e8404-38fa-4d1c-8356-53887f2ff64a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:31.948007 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-29638696-45fa-41fd-b5ff-3d43f18d368c tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:31.948584 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-29638696-45fa-41fd-b5ff-3d43f18d368c tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:31.949339 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-29638696-45fa-41fd-b5ff-3d43f18d368c tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:31.950142 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-29638696-45fa-41fd-b5ff-3d43f18d368c tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:31.950838 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-29638696-45fa-41fd-b5ff-3d43f18d368c tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:31.951387 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-29638696-45fa-41fd-b5ff-3d43f18d368c tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:32.282784 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-29638696-45fa-41fd-b5ff-3d43f18d368c tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c208ec9faf491385a9ab5b5932098d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ae4960393c464c97669731c2084d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:32.294019 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-29638696-45fa-41fd-b5ff-3d43f18d368c tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] 10.222.0.33 "GET /compute/v2.1/servers/ea3e8404-38fa-4d1c-8356-53887f2ff64a" status: 200 len: 1497 microversion: 2.1 time: 0.357928 Oct 04 20:54:32.295345 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2086/4228] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:54:31 2022] GET /compute/v2.1/servers/ea3e8404-38fa-4d1c-8356-53887f2ff64a => generated 1497 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:54:32.525391 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-0aa55683-a1fb-483a-8172-ab0af5d54de4 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:32.526294 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-0aa55683-a1fb-483a-8172-ab0af5d54de4 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] [instance: 01fd3eb8-b195-4b9c-8d52-752e50be6f30] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:32.534938 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0aa55683-a1fb-483a-8172-ab0af5d54de4 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:32.535708 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0aa55683-a1fb-483a-8172-ab0af5d54de4 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:32.536481 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0aa55683-a1fb-483a-8172-ab0af5d54de4 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:32.537488 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0aa55683-a1fb-483a-8172-ab0af5d54de4 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:32.538420 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0aa55683-a1fb-483a-8172-ab0af5d54de4 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:32.539057 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0aa55683-a1fb-483a-8172-ab0af5d54de4 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:32.850484 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-0aa55683-a1fb-483a-8172-ab0af5d54de4 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e93855201ca64c779f92a2a33979b81f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed328a1e964d46902dee5e1c7c7b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:32.866911 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-0aa55683-a1fb-483a-8172-ab0af5d54de4 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] 10.222.0.33 "GET /compute/v2.1/servers/01fd3eb8-b195-4b9c-8d52-752e50be6f30" status: 200 len: 1520 microversion: 2.1 time: 0.346297 Oct 04 20:54:32.868786 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2143/4229] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:54:32 2022] GET /compute/v2.1/servers/01fd3eb8-b195-4b9c-8d52-752e50be6f30 => generated 1520 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:54:33.321197 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c0b3b94c-077f-429d-aede-984cf8756959 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:33.323663 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c0b3b94c-077f-429d-aede-984cf8756959 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] [instance: ea3e8404-38fa-4d1c-8356-53887f2ff64a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:33.332196 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c0b3b94c-077f-429d-aede-984cf8756959 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:33.333643 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c0b3b94c-077f-429d-aede-984cf8756959 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:33.334291 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c0b3b94c-077f-429d-aede-984cf8756959 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:33.335446 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c0b3b94c-077f-429d-aede-984cf8756959 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:33.336670 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c0b3b94c-077f-429d-aede-984cf8756959 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:33.338831 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c0b3b94c-077f-429d-aede-984cf8756959 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:33.666519 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c0b3b94c-077f-429d-aede-984cf8756959 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c208ec9faf491385a9ab5b5932098d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ae4960393c464c97669731c2084d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:33.677210 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c0b3b94c-077f-429d-aede-984cf8756959 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] 10.222.0.33 "GET /compute/v2.1/servers/ea3e8404-38fa-4d1c-8356-53887f2ff64a" status: 200 len: 1497 microversion: 2.1 time: 0.358182 Oct 04 20:54:33.697132 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2087/4230] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:54:33 2022] GET /compute/v2.1/servers/ea3e8404-38fa-4d1c-8356-53887f2ff64a => generated 1497 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:54:33.899644 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-4d8578ed-dcfd-4ed5-af76-4750c0440246 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:33.901196 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-4d8578ed-dcfd-4ed5-af76-4750c0440246 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] [instance: 01fd3eb8-b195-4b9c-8d52-752e50be6f30] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:33.911115 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4d8578ed-dcfd-4ed5-af76-4750c0440246 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:33.912144 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4d8578ed-dcfd-4ed5-af76-4750c0440246 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:33.912809 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4d8578ed-dcfd-4ed5-af76-4750c0440246 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:33.913622 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4d8578ed-dcfd-4ed5-af76-4750c0440246 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:33.914187 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4d8578ed-dcfd-4ed5-af76-4750c0440246 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:33.914753 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4d8578ed-dcfd-4ed5-af76-4750c0440246 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:34.627552 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-1d8fc811-2906-4cde-887f-efa83059d72f req-a48ff020-aeb3-47dc-81f5-41b2ae4091bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01fd3eb8-b195-4b9c-8d52-752e50be6f30", "name": "network-vif-plugged", "status": "completed", "tag": "ce1cdf10-8100-44ae-9a55-7470bb0c09b0"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:54:34.638740 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-1d8fc811-2906-4cde-887f-efa83059d72f req-a48ff020-aeb3-47dc-81f5-41b2ae4091bc service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:34.639462 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-1d8fc811-2906-4cde-887f-efa83059d72f req-a48ff020-aeb3-47dc-81f5-41b2ae4091bc service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:34.640053 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-1d8fc811-2906-4cde-887f-efa83059d72f req-a48ff020-aeb3-47dc-81f5-41b2ae4091bc service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:34.647102 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-4d8578ed-dcfd-4ed5-af76-4750c0440246 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e93855201ca64c779f92a2a33979b81f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed328a1e964d46902dee5e1c7c7b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:34.657129 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-1d8fc811-2906-4cde-887f-efa83059d72f req-a48ff020-aeb3-47dc-81f5-41b2ae4091bc service nova] Creating event network-vif-plugged:ce1cdf10-8100-44ae-9a55-7470bb0c09b0 for instance 01fd3eb8-b195-4b9c-8d52-752e50be6f30 on n-h1-854823-8 Oct 04 20:54:34.662814 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-1d8fc811-2906-4cde-887f-efa83059d72f req-a48ff020-aeb3-47dc-81f5-41b2ae4091bc service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038685 Oct 04 20:54:34.663933 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2088/4231] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:54:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 20:54:34.668396 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-4d8578ed-dcfd-4ed5-af76-4750c0440246 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] 10.222.0.33 "GET /compute/v2.1/servers/01fd3eb8-b195-4b9c-8d52-752e50be6f30" status: 200 len: 1520 microversion: 2.1 time: 0.779953 Oct 04 20:54:34.683679 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2144/4232] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:54:33 2022] GET /compute/v2.1/servers/01fd3eb8-b195-4b9c-8d52-752e50be6f30 => generated 1520 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:54:34.708596 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-951da6b4-a8c9-4dbf-ac59-b303056bee99 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:34.711731 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-951da6b4-a8c9-4dbf-ac59-b303056bee99 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] [instance: ea3e8404-38fa-4d1c-8356-53887f2ff64a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:34.724923 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-951da6b4-a8c9-4dbf-ac59-b303056bee99 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:34.725757 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-951da6b4-a8c9-4dbf-ac59-b303056bee99 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:34.726376 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-951da6b4-a8c9-4dbf-ac59-b303056bee99 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:34.727344 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-951da6b4-a8c9-4dbf-ac59-b303056bee99 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:34.728769 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-951da6b4-a8c9-4dbf-ac59-b303056bee99 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:34.729623 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-951da6b4-a8c9-4dbf-ac59-b303056bee99 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:35.187664 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-951da6b4-a8c9-4dbf-ac59-b303056bee99 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c208ec9faf491385a9ab5b5932098d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ae4960393c464c97669731c2084d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:35.195974 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-951da6b4-a8c9-4dbf-ac59-b303056bee99 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] 10.222.0.33 "GET /compute/v2.1/servers/ea3e8404-38fa-4d1c-8356-53887f2ff64a" status: 200 len: 1497 microversion: 2.1 time: 0.492443 Oct 04 20:54:35.197209 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2089/4233] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:54:34 2022] GET /compute/v2.1/servers/ea3e8404-38fa-4d1c-8356-53887f2ff64a => generated 1497 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:54:35.699520 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8263a4a9-30ed-46a5-9c60-9e7e72e42879 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:35.700879 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-8263a4a9-30ed-46a5-9c60-9e7e72e42879 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] [instance: 01fd3eb8-b195-4b9c-8d52-752e50be6f30] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:35.716553 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8263a4a9-30ed-46a5-9c60-9e7e72e42879 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:35.718101 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8263a4a9-30ed-46a5-9c60-9e7e72e42879 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:35.718805 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8263a4a9-30ed-46a5-9c60-9e7e72e42879 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:35.720640 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8263a4a9-30ed-46a5-9c60-9e7e72e42879 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:35.721327 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8263a4a9-30ed-46a5-9c60-9e7e72e42879 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:35.722153 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8263a4a9-30ed-46a5-9c60-9e7e72e42879 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:35.762152 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-0ac3cb30-a491-4f8f-8934-a1ebfc465c6c req-785958cf-e96c-4024-b1a8-bdf5b6b918be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea3e8404-38fa-4d1c-8356-53887f2ff64a", "name": "network-vif-deleted", "tag": "44aee782-feff-400a-94b5-8a0b4b41faa5"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:54:35.790893 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-0ac3cb30-a491-4f8f-8934-a1ebfc465c6c req-785958cf-e96c-4024-b1a8-bdf5b6b918be service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:35.791390 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-0ac3cb30-a491-4f8f-8934-a1ebfc465c6c req-785958cf-e96c-4024-b1a8-bdf5b6b918be service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:35.791834 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-0ac3cb30-a491-4f8f-8934-a1ebfc465c6c req-785958cf-e96c-4024-b1a8-bdf5b6b918be service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:35.829082 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-0ac3cb30-a491-4f8f-8934-a1ebfc465c6c req-785958cf-e96c-4024-b1a8-bdf5b6b918be service nova] Creating event network-vif-deleted:44aee782-feff-400a-94b5-8a0b4b41faa5 for instance ea3e8404-38fa-4d1c-8356-53887f2ff64a on n-h1-854823-8 Oct 04 20:54:35.848416 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-0ac3cb30-a491-4f8f-8934-a1ebfc465c6c req-785958cf-e96c-4024-b1a8-bdf5b6b918be service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.223708 Oct 04 20:54:35.849056 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2145/4234] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:54:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:54:35.973659 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-8263a4a9-30ed-46a5-9c60-9e7e72e42879 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e93855201ca64c779f92a2a33979b81f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed328a1e964d46902dee5e1c7c7b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:35.983447 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-8263a4a9-30ed-46a5-9c60-9e7e72e42879 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] 10.222.0.33 "GET /compute/v2.1/servers/01fd3eb8-b195-4b9c-8d52-752e50be6f30" status: 200 len: 1520 microversion: 2.1 time: 0.292861 Oct 04 20:54:36.000114 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2090/4235] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:54:35 2022] GET /compute/v2.1/servers/01fd3eb8-b195-4b9c-8d52-752e50be6f30 => generated 1520 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:54:36.222170 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-d0687178-c27a-4f6c-b5ba-45a4f02d9c01 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:36.222935 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-d0687178-c27a-4f6c-b5ba-45a4f02d9c01 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] [instance: ea3e8404-38fa-4d1c-8356-53887f2ff64a] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:36.237307 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d0687178-c27a-4f6c-b5ba-45a4f02d9c01 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:36.238184 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d0687178-c27a-4f6c-b5ba-45a4f02d9c01 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:36.239813 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d0687178-c27a-4f6c-b5ba-45a4f02d9c01 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:36.241137 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d0687178-c27a-4f6c-b5ba-45a4f02d9c01 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:36.242416 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d0687178-c27a-4f6c-b5ba-45a4f02d9c01 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:36.245892 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d0687178-c27a-4f6c-b5ba-45a4f02d9c01 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:36.329449 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d0687178-c27a-4f6c-b5ba-45a4f02d9c01 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:36.329954 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d0687178-c27a-4f6c-b5ba-45a4f02d9c01 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:36.330849 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d0687178-c27a-4f6c-b5ba-45a4f02d9c01 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:36.330849 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.objects.instance [None req-d0687178-c27a-4f6c-b5ba-45a4f02d9c01 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lazy-loading 'fault' on Instance uuid ea3e8404-38fa-4d1c-8356-53887f2ff64a {{(pid=128802) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:54:36.436266 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-d0687178-c27a-4f6c-b5ba-45a4f02d9c01 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c208ec9faf491385a9ab5b5932098d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82ae4960393c464c97669731c2084d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:36.450960 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-d0687178-c27a-4f6c-b5ba-45a4f02d9c01 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] 10.222.0.33 "GET /compute/v2.1/servers/ea3e8404-38fa-4d1c-8356-53887f2ff64a" status: 200 len: 1304 microversion: 2.1 time: 0.231269 Oct 04 20:54:36.454493 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2146/4236] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:54:36 2022] GET /compute/v2.1/servers/ea3e8404-38fa-4d1c-8356-53887f2ff64a => generated 1304 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:54:37.007906 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b7c5391d-eff4-4480-8fff-782387c9bae1 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:37.008581 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b7c5391d-eff4-4480-8fff-782387c9bae1 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] [instance: 01fd3eb8-b195-4b9c-8d52-752e50be6f30] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:37.016457 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b7c5391d-eff4-4480-8fff-782387c9bae1 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:37.016951 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b7c5391d-eff4-4480-8fff-782387c9bae1 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:37.017388 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b7c5391d-eff4-4480-8fff-782387c9bae1 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:37.018100 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b7c5391d-eff4-4480-8fff-782387c9bae1 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:37.021496 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b7c5391d-eff4-4480-8fff-782387c9bae1 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:37.023045 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b7c5391d-eff4-4480-8fff-782387c9bae1 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:37.423914 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-b7c5391d-eff4-4480-8fff-782387c9bae1 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e93855201ca64c779f92a2a33979b81f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed328a1e964d46902dee5e1c7c7b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:37.435537 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b7c5391d-eff4-4480-8fff-782387c9bae1 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] 10.222.0.33 "GET /compute/v2.1/servers/01fd3eb8-b195-4b9c-8d52-752e50be6f30" status: 200 len: 1505 microversion: 2.1 time: 0.432038 Oct 04 20:54:37.451926 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2091/4237] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:54:37 2022] GET /compute/v2.1/servers/01fd3eb8-b195-4b9c-8d52-752e50be6f30 => generated 1505 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:54:37.461680 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-db6ad934-e84d-445c-8ec7-bf0c9d1cec4c tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:37.463193 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-db6ad934-e84d-445c-8ec7-bf0c9d1cec4c tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] [instance: 01fd3eb8-b195-4b9c-8d52-752e50be6f30] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:37.471305 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-db6ad934-e84d-445c-8ec7-bf0c9d1cec4c tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:37.472017 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-db6ad934-e84d-445c-8ec7-bf0c9d1cec4c tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:37.472690 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-db6ad934-e84d-445c-8ec7-bf0c9d1cec4c tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:37.473505 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-db6ad934-e84d-445c-8ec7-bf0c9d1cec4c tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:37.474034 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-db6ad934-e84d-445c-8ec7-bf0c9d1cec4c tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:37.474843 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-db6ad934-e84d-445c-8ec7-bf0c9d1cec4c tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:37.482993 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9007b0c7-91bd-4ad1-bd80-d69281612372 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:37.484145 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-9007b0c7-91bd-4ad1-bd80-d69281612372 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] [instance: ea3e8404-38fa-4d1c-8356-53887f2ff64a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:37.492206 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9007b0c7-91bd-4ad1-bd80-d69281612372 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:37.493793 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9007b0c7-91bd-4ad1-bd80-d69281612372 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:37.494799 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9007b0c7-91bd-4ad1-bd80-d69281612372 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:37.496272 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9007b0c7-91bd-4ad1-bd80-d69281612372 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:37.497323 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9007b0c7-91bd-4ad1-bd80-d69281612372 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:37.497852 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9007b0c7-91bd-4ad1-bd80-d69281612372 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:37.555382 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-9007b0c7-91bd-4ad1-bd80-d69281612372 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] HTTP exception thrown: Instance ea3e8404-38fa-4d1c-8356-53887f2ff64a could not be found. Oct 04 20:54:37.557321 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9007b0c7-91bd-4ad1-bd80-d69281612372 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Request method failure captured: Oct 04 20:54:37.557321 n-d-854823-8 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/ea3e8404-38fa-4d1c-8356-53887f2ff64a HTTP/1.1 Oct 04 20:54:37.557321 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:54:37.557321 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:54:37.557321 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:54:37.557321 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 0 Oct 04 20:54:37.557321 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:54:37.557321 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:54:37.557321 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:54:37.557321 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:54:37.557321 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJxSZfevtBVnbE8xQF7FYm_FMbZNMYv-b1P0ldR6C6mOlBxOPHbcbefhyrqwXR1yI98_OYaoilQwhW17vvL2mv1TUMfEjVB0p9Z8xi6fxjKTzjqbSmmUYZRpw0KKdt3nuXH8mFLFoxIXJdxlVC2R9xsCLdqsVxY0fb8-x4eIUN27OLA Oct 04 20:54:37.557321 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:54:37.557321 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:54:37.557321 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:54:37.557321 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:54:37.557321 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:54:37.557321 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:54:37.557321 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: 82ae4960393c464c97669731c2084d0f Oct 04 20:54:37.557321 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-DeleteServersTestJSON-364705212 Oct 04 20:54:37.557321 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 20:54:37.557321 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 20:54:37.557321 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_82ae4960393c464c97669731c2084d0f", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/82ae4960393c464c97669731c2084d0f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/82ae4960393c464c97669731c2084d0f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/82ae4960393c464c97669731c2084d0f"}]}] Oct 04 20:54:37.557321 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-DeleteServersTestJSON-364705212 Oct 04 20:54:37.557321 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: 82ae4960393c464c97669731c2084d0f Oct 04 20:54:37.557321 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-DeleteServersTestJSON-364705212 Oct 04 20:54:37.557321 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-DeleteServersTestJSON-364705212-project Oct 04 20:54:37.557321 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:54:37.557321 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:54:37.557321 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: e2c208ec9faf491385a9ab5b5932098d Oct 04 20:54:37.557321 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-DeleteServersTestJSON-364705212-project Oct 04 20:54:37.557321 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 20:54:37.557321 n-d-854823-8 devstack@n-api.service[128801]: exception: Instance ea3e8404-38fa-4d1c-8356-53887f2ff64a could not be found. Oct 04 20:54:37.557321 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': 'ea3e8404-38fa-4d1c-8356-53887f2ff64a'} Oct 04 20:54:37.557321 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:54:37.557321 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:54:37.557321 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:54:37.557321 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:54:37.557321 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:54:37.557321 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:54:37.557321 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:54:37.557321 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:54:37.557321 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:54:37.557321 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:54:37.557321 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea3e8404-38fa-4d1c-8356-53887f2ff64a could not be found. Oct 04 20:54:37.557321 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:54:37.557321 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:54:37.557321 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:54:37.557321 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:54:37.557321 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:54:37.557321 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:54:37.557321 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:54:37.557321 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:54:37.557321 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:54:37.557321 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:54:37.557321 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:54:37.557321 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:54:37.557321 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:54:37.557321 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:54:37.557321 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:54:37.557321 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:54:37.557321 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea3e8404-38fa-4d1c-8356-53887f2ff64a could not be found. Oct 04 20:54:37.557321 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:54:37.557321 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:54:37.557321 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:54:37.561263 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:54:37.561263 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:54:37.561263 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:54:37.561263 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:54:37.561263 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:54:37.561263 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea3e8404-38fa-4d1c-8356-53887f2ff64a could not be found. Oct 04 20:54:37.561263 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:54:37.561263 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9007b0c7-91bd-4ad1-bd80-d69281612372 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Returning 404 to user: Instance ea3e8404-38fa-4d1c-8356-53887f2ff64a could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:54:37.564634 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-9007b0c7-91bd-4ad1-bd80-d69281612372 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] 10.222.0.33 "GET /compute/v2.1/servers/ea3e8404-38fa-4d1c-8356-53887f2ff64a" status: 404 len: 111 microversion: 2.1 time: 0.084367 Oct 04 20:54:37.565936 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2092/4238] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:54:37 2022] GET /compute/v2.1/servers/ea3e8404-38fa-4d1c-8356-53887f2ff64a => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 20:54:37.587728 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2a946dbe-8b31-4dd8-9a0c-e7a5f5987a66 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:37.588430 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-2a946dbe-8b31-4dd8-9a0c-e7a5f5987a66 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] [instance: ea3e8404-38fa-4d1c-8356-53887f2ff64a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:37.600563 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2a946dbe-8b31-4dd8-9a0c-e7a5f5987a66 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:37.601310 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2a946dbe-8b31-4dd8-9a0c-e7a5f5987a66 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:37.603730 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2a946dbe-8b31-4dd8-9a0c-e7a5f5987a66 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:37.606597 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2a946dbe-8b31-4dd8-9a0c-e7a5f5987a66 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:37.607125 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2a946dbe-8b31-4dd8-9a0c-e7a5f5987a66 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:37.607569 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2a946dbe-8b31-4dd8-9a0c-e7a5f5987a66 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:37.632340 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-2a946dbe-8b31-4dd8-9a0c-e7a5f5987a66 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] HTTP exception thrown: Instance ea3e8404-38fa-4d1c-8356-53887f2ff64a could not be found. Oct 04 20:54:37.635697 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2a946dbe-8b31-4dd8-9a0c-e7a5f5987a66 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Request method failure captured: Oct 04 20:54:37.635697 n-d-854823-8 devstack@n-api.service[128801]: request: DELETE /compute/v2.1/servers/ea3e8404-38fa-4d1c-8356-53887f2ff64a HTTP/1.1 Oct 04 20:54:37.635697 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:54:37.635697 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:54:37.635697 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:54:37.635697 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 0 Oct 04 20:54:37.635697 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:54:37.635697 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:54:37.635697 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:54:37.635697 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:54:37.635697 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJxSZfevtBVnbE8xQF7FYm_FMbZNMYv-b1P0ldR6C6mOlBxOPHbcbefhyrqwXR1yI98_OYaoilQwhW17vvL2mv1TUMfEjVB0p9Z8xi6fxjKTzjqbSmmUYZRpw0KKdt3nuXH8mFLFoxIXJdxlVC2R9xsCLdqsVxY0fb8-x4eIUN27OLA Oct 04 20:54:37.635697 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:54:37.635697 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:54:37.635697 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:54:37.635697 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:54:37.635697 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:54:37.635697 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:54:37.635697 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: 82ae4960393c464c97669731c2084d0f Oct 04 20:54:37.635697 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-DeleteServersTestJSON-364705212 Oct 04 20:54:37.635697 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 20:54:37.635697 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 20:54:37.635697 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_82ae4960393c464c97669731c2084d0f", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/82ae4960393c464c97669731c2084d0f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/82ae4960393c464c97669731c2084d0f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/82ae4960393c464c97669731c2084d0f"}]}] Oct 04 20:54:37.635697 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-DeleteServersTestJSON-364705212 Oct 04 20:54:37.635697 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: 82ae4960393c464c97669731c2084d0f Oct 04 20:54:37.635697 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-DeleteServersTestJSON-364705212 Oct 04 20:54:37.635697 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-DeleteServersTestJSON-364705212-project Oct 04 20:54:37.635697 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:54:37.635697 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:54:37.635697 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: e2c208ec9faf491385a9ab5b5932098d Oct 04 20:54:37.635697 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-DeleteServersTestJSON-364705212-project Oct 04 20:54:37.635697 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 20:54:37.635697 n-d-854823-8 devstack@n-api.service[128801]: exception: Instance ea3e8404-38fa-4d1c-8356-53887f2ff64a could not be found. Oct 04 20:54:37.635697 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': 'ea3e8404-38fa-4d1c-8356-53887f2ff64a'} Oct 04 20:54:37.635697 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:54:37.635697 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:54:37.635697 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:54:37.635697 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:54:37.635697 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:54:37.635697 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:54:37.635697 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:54:37.635697 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:54:37.635697 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:54:37.635697 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:54:37.635697 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea3e8404-38fa-4d1c-8356-53887f2ff64a could not be found. Oct 04 20:54:37.635697 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:54:37.635697 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:54:37.635697 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:54:37.635697 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:54:37.635697 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:54:37.635697 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:54:37.635697 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:54:37.635697 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:54:37.635697 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:54:37.635697 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:54:37.635697 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 20:54:37.635697 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 20:54:37.635697 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 20:54:37.635697 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 20:54:37.635697 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:54:37.635697 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:54:37.635697 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:54:37.635697 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:54:37.640468 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea3e8404-38fa-4d1c-8356-53887f2ff64a could not be found. Oct 04 20:54:37.640468 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:54:37.640468 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:54:37.640468 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:54:37.640468 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:54:37.640468 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:54:37.640468 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:54:37.640468 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:54:37.640468 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:54:37.640468 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea3e8404-38fa-4d1c-8356-53887f2ff64a could not be found. Oct 04 20:54:37.640468 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:54:37.642599 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2a946dbe-8b31-4dd8-9a0c-e7a5f5987a66 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Returning 404 to user: Instance ea3e8404-38fa-4d1c-8356-53887f2ff64a could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:54:37.643646 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-2a946dbe-8b31-4dd8-9a0c-e7a5f5987a66 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] 10.222.0.33 "DELETE /compute/v2.1/servers/ea3e8404-38fa-4d1c-8356-53887f2ff64a" status: 404 len: 111 microversion: 2.1 time: 0.066764 Oct 04 20:54:37.644718 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2093/4239] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 20:54:37 2022] DELETE /compute/v2.1/servers/ea3e8404-38fa-4d1c-8356-53887f2ff64a => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:54:37.660324 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-bc032ed6-d68e-40fb-bd54-d2e17c908e02 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:37.661281 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-bc032ed6-d68e-40fb-bd54-d2e17c908e02 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] [instance: ea3e8404-38fa-4d1c-8356-53887f2ff64a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:37.678903 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bc032ed6-d68e-40fb-bd54-d2e17c908e02 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:37.679773 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bc032ed6-d68e-40fb-bd54-d2e17c908e02 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:37.683800 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bc032ed6-d68e-40fb-bd54-d2e17c908e02 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:37.686714 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bc032ed6-d68e-40fb-bd54-d2e17c908e02 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:37.689819 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bc032ed6-d68e-40fb-bd54-d2e17c908e02 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:37.691165 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bc032ed6-d68e-40fb-bd54-d2e17c908e02 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:37.719236 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-bc032ed6-d68e-40fb-bd54-d2e17c908e02 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] HTTP exception thrown: Instance ea3e8404-38fa-4d1c-8356-53887f2ff64a could not be found. Oct 04 20:54:37.721200 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-bc032ed6-d68e-40fb-bd54-d2e17c908e02 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Request method failure captured: Oct 04 20:54:37.721200 n-d-854823-8 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/ea3e8404-38fa-4d1c-8356-53887f2ff64a HTTP/1.1 Oct 04 20:54:37.721200 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:54:37.721200 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:54:37.721200 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:54:37.721200 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 0 Oct 04 20:54:37.721200 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:54:37.721200 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:54:37.721200 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:54:37.721200 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:54:37.721200 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJxSZfevtBVnbE8xQF7FYm_FMbZNMYv-b1P0ldR6C6mOlBxOPHbcbefhyrqwXR1yI98_OYaoilQwhW17vvL2mv1TUMfEjVB0p9Z8xi6fxjKTzjqbSmmUYZRpw0KKdt3nuXH8mFLFoxIXJdxlVC2R9xsCLdqsVxY0fb8-x4eIUN27OLA Oct 04 20:54:37.721200 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:54:37.721200 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:54:37.721200 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:54:37.721200 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:54:37.721200 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:54:37.721200 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:54:37.721200 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: 82ae4960393c464c97669731c2084d0f Oct 04 20:54:37.721200 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-DeleteServersTestJSON-364705212 Oct 04 20:54:37.721200 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 20:54:37.721200 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 20:54:37.721200 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_82ae4960393c464c97669731c2084d0f", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/82ae4960393c464c97669731c2084d0f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/82ae4960393c464c97669731c2084d0f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/82ae4960393c464c97669731c2084d0f"}]}] Oct 04 20:54:37.721200 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-DeleteServersTestJSON-364705212 Oct 04 20:54:37.721200 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: 82ae4960393c464c97669731c2084d0f Oct 04 20:54:37.721200 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-DeleteServersTestJSON-364705212 Oct 04 20:54:37.721200 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-DeleteServersTestJSON-364705212-project Oct 04 20:54:37.721200 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:54:37.721200 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:54:37.721200 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: e2c208ec9faf491385a9ab5b5932098d Oct 04 20:54:37.721200 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-DeleteServersTestJSON-364705212-project Oct 04 20:54:37.721200 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 20:54:37.721200 n-d-854823-8 devstack@n-api.service[128801]: exception: Instance ea3e8404-38fa-4d1c-8356-53887f2ff64a could not be found. Oct 04 20:54:37.721200 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': 'ea3e8404-38fa-4d1c-8356-53887f2ff64a'} Oct 04 20:54:37.721200 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:54:37.721200 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:54:37.721200 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:54:37.721200 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:54:37.721200 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:54:37.721200 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:54:37.721200 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:54:37.721200 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:54:37.721200 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:54:37.721200 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:54:37.721200 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea3e8404-38fa-4d1c-8356-53887f2ff64a could not be found. Oct 04 20:54:37.721200 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:54:37.721200 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:54:37.721200 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:54:37.721200 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:54:37.721200 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:54:37.721200 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:54:37.721200 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:54:37.721200 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:54:37.721200 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:54:37.721200 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:54:37.721200 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:54:37.721200 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:54:37.721200 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:54:37.721200 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:54:37.721200 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:54:37.721200 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:54:37.721200 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea3e8404-38fa-4d1c-8356-53887f2ff64a could not be found. Oct 04 20:54:37.721200 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:54:37.721200 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:54:37.721200 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:54:37.727418 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:54:37.727418 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:54:37.727418 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:54:37.727418 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:54:37.727418 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:54:37.727418 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea3e8404-38fa-4d1c-8356-53887f2ff64a could not be found. Oct 04 20:54:37.727418 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:54:37.727418 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-bc032ed6-d68e-40fb-bd54-d2e17c908e02 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Returning 404 to user: Instance ea3e8404-38fa-4d1c-8356-53887f2ff64a could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:54:37.727418 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-bc032ed6-d68e-40fb-bd54-d2e17c908e02 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] 10.222.0.33 "GET /compute/v2.1/servers/ea3e8404-38fa-4d1c-8356-53887f2ff64a" status: 404 len: 111 microversion: 2.1 time: 0.073789 Oct 04 20:54:37.727418 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2094/4240] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:54:37 2022] GET /compute/v2.1/servers/ea3e8404-38fa-4d1c-8356-53887f2ff64a => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:54:37.735385 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-16c0bb55-96d0-47ae-afc9-eb3e86f5b37e tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:37.737833 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-16c0bb55-96d0-47ae-afc9-eb3e86f5b37e tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] [instance: 9630289d-dcfd-4250-8910-a060f8696292] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:37.759391 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-16c0bb55-96d0-47ae-afc9-eb3e86f5b37e tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:37.760282 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-16c0bb55-96d0-47ae-afc9-eb3e86f5b37e tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:37.760967 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-16c0bb55-96d0-47ae-afc9-eb3e86f5b37e tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:37.761919 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-16c0bb55-96d0-47ae-afc9-eb3e86f5b37e tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:37.762627 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-16c0bb55-96d0-47ae-afc9-eb3e86f5b37e tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:37.763552 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-16c0bb55-96d0-47ae-afc9-eb3e86f5b37e tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:37.784201 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-16c0bb55-96d0-47ae-afc9-eb3e86f5b37e tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] HTTP exception thrown: Instance 9630289d-dcfd-4250-8910-a060f8696292 could not be found. Oct 04 20:54:37.786684 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-16c0bb55-96d0-47ae-afc9-eb3e86f5b37e tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Request method failure captured: Oct 04 20:54:37.786684 n-d-854823-8 devstack@n-api.service[128801]: request: DELETE /compute/v2.1/servers/9630289d-dcfd-4250-8910-a060f8696292 HTTP/1.1 Oct 04 20:54:37.786684 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:54:37.786684 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:54:37.786684 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:54:37.786684 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 0 Oct 04 20:54:37.786684 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:54:37.786684 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:54:37.786684 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:54:37.786684 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:54:37.786684 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJxSZfevtBVnbE8xQF7FYm_FMbZNMYv-b1P0ldR6C6mOlBxOPHbcbefhyrqwXR1yI98_OYaoilQwhW17vvL2mv1TUMfEjVB0p9Z8xi6fxjKTzjqbSmmUYZRpw0KKdt3nuXH8mFLFoxIXJdxlVC2R9xsCLdqsVxY0fb8-x4eIUN27OLA Oct 04 20:54:37.786684 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:54:37.786684 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:54:37.786684 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:54:37.786684 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:54:37.786684 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:54:37.786684 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:54:37.786684 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: 82ae4960393c464c97669731c2084d0f Oct 04 20:54:37.786684 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-DeleteServersTestJSON-364705212 Oct 04 20:54:37.786684 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 20:54:37.786684 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 20:54:37.786684 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_82ae4960393c464c97669731c2084d0f", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/82ae4960393c464c97669731c2084d0f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/82ae4960393c464c97669731c2084d0f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/82ae4960393c464c97669731c2084d0f"}]}] Oct 04 20:54:37.786684 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-DeleteServersTestJSON-364705212 Oct 04 20:54:37.786684 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: 82ae4960393c464c97669731c2084d0f Oct 04 20:54:37.786684 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-DeleteServersTestJSON-364705212 Oct 04 20:54:37.786684 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-DeleteServersTestJSON-364705212-project Oct 04 20:54:37.786684 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:54:37.786684 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:54:37.786684 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: e2c208ec9faf491385a9ab5b5932098d Oct 04 20:54:37.786684 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-DeleteServersTestJSON-364705212-project Oct 04 20:54:37.786684 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 20:54:37.786684 n-d-854823-8 devstack@n-api.service[128801]: exception: Instance 9630289d-dcfd-4250-8910-a060f8696292 could not be found. Oct 04 20:54:37.786684 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': '9630289d-dcfd-4250-8910-a060f8696292'} Oct 04 20:54:37.786684 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:54:37.786684 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:54:37.786684 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:54:37.786684 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:54:37.786684 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:54:37.786684 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:54:37.786684 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:54:37.786684 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:54:37.786684 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:54:37.786684 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:54:37.786684 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9630289d-dcfd-4250-8910-a060f8696292 could not be found. Oct 04 20:54:37.786684 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:54:37.786684 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:54:37.786684 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:54:37.786684 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:54:37.786684 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:54:37.786684 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:54:37.786684 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:54:37.786684 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:54:37.786684 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:54:37.786684 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:54:37.786684 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 20:54:37.786684 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 20:54:37.786684 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 20:54:37.786684 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 20:54:37.786684 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:54:37.786684 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:54:37.786684 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:54:37.786684 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:54:37.791521 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9630289d-dcfd-4250-8910-a060f8696292 could not be found. Oct 04 20:54:37.791521 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:54:37.791521 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:54:37.791521 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:54:37.791521 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:54:37.791521 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:54:37.791521 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:54:37.791521 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:54:37.791521 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:54:37.791521 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9630289d-dcfd-4250-8910-a060f8696292 could not be found. Oct 04 20:54:37.791521 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:54:37.793490 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-16c0bb55-96d0-47ae-afc9-eb3e86f5b37e tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Returning 404 to user: Instance 9630289d-dcfd-4250-8910-a060f8696292 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:54:37.795096 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-16c0bb55-96d0-47ae-afc9-eb3e86f5b37e tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] 10.222.0.33 "DELETE /compute/v2.1/servers/9630289d-dcfd-4250-8910-a060f8696292" status: 404 len: 111 microversion: 2.1 time: 0.063403 Oct 04 20:54:37.798812 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2095/4241] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 20:54:37 2022] DELETE /compute/v2.1/servers/9630289d-dcfd-4250-8910-a060f8696292 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:54:37.807643 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-78b691a2-cb92-4c76-8169-6fced5d9c07e tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:37.808275 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-78b691a2-cb92-4c76-8169-6fced5d9c07e tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] [instance: 9630289d-dcfd-4250-8910-a060f8696292] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:37.816361 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-78b691a2-cb92-4c76-8169-6fced5d9c07e tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:37.816861 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-78b691a2-cb92-4c76-8169-6fced5d9c07e tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:37.817809 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-78b691a2-cb92-4c76-8169-6fced5d9c07e tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:37.819228 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-78b691a2-cb92-4c76-8169-6fced5d9c07e tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:37.821752 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-78b691a2-cb92-4c76-8169-6fced5d9c07e tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:37.822828 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-78b691a2-cb92-4c76-8169-6fced5d9c07e tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:37.844350 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-78b691a2-cb92-4c76-8169-6fced5d9c07e tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] HTTP exception thrown: Instance 9630289d-dcfd-4250-8910-a060f8696292 could not be found. Oct 04 20:54:37.847935 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-78b691a2-cb92-4c76-8169-6fced5d9c07e tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Request method failure captured: Oct 04 20:54:37.847935 n-d-854823-8 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/9630289d-dcfd-4250-8910-a060f8696292 HTTP/1.1 Oct 04 20:54:37.847935 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:54:37.847935 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:54:37.847935 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:54:37.847935 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 0 Oct 04 20:54:37.847935 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:54:37.847935 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:54:37.847935 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:54:37.847935 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:54:37.847935 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJxSZfevtBVnbE8xQF7FYm_FMbZNMYv-b1P0ldR6C6mOlBxOPHbcbefhyrqwXR1yI98_OYaoilQwhW17vvL2mv1TUMfEjVB0p9Z8xi6fxjKTzjqbSmmUYZRpw0KKdt3nuXH8mFLFoxIXJdxlVC2R9xsCLdqsVxY0fb8-x4eIUN27OLA Oct 04 20:54:37.847935 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:54:37.847935 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:54:37.847935 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:54:37.847935 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:54:37.847935 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:54:37.847935 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:54:37.847935 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: 82ae4960393c464c97669731c2084d0f Oct 04 20:54:37.847935 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-DeleteServersTestJSON-364705212 Oct 04 20:54:37.847935 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 20:54:37.847935 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 20:54:37.847935 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_82ae4960393c464c97669731c2084d0f", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/82ae4960393c464c97669731c2084d0f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/82ae4960393c464c97669731c2084d0f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/82ae4960393c464c97669731c2084d0f"}]}] Oct 04 20:54:37.847935 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-DeleteServersTestJSON-364705212 Oct 04 20:54:37.847935 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: 82ae4960393c464c97669731c2084d0f Oct 04 20:54:37.847935 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-DeleteServersTestJSON-364705212 Oct 04 20:54:37.847935 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-DeleteServersTestJSON-364705212-project Oct 04 20:54:37.847935 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:54:37.847935 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:54:37.847935 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: e2c208ec9faf491385a9ab5b5932098d Oct 04 20:54:37.847935 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-DeleteServersTestJSON-364705212-project Oct 04 20:54:37.847935 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 20:54:37.847935 n-d-854823-8 devstack@n-api.service[128801]: exception: Instance 9630289d-dcfd-4250-8910-a060f8696292 could not be found. Oct 04 20:54:37.847935 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': '9630289d-dcfd-4250-8910-a060f8696292'} Oct 04 20:54:37.847935 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:54:37.847935 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:54:37.847935 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:54:37.847935 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:54:37.847935 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:54:37.847935 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:54:37.847935 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:54:37.847935 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:54:37.847935 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:54:37.847935 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:54:37.847935 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9630289d-dcfd-4250-8910-a060f8696292 could not be found. Oct 04 20:54:37.847935 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:54:37.847935 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:54:37.847935 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:54:37.847935 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:54:37.847935 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:54:37.847935 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:54:37.847935 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:54:37.847935 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:54:37.847935 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:54:37.847935 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:54:37.847935 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:54:37.847935 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:54:37.847935 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:54:37.847935 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:54:37.847935 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:54:37.847935 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:54:37.847935 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9630289d-dcfd-4250-8910-a060f8696292 could not be found. Oct 04 20:54:37.847935 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:54:37.847935 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:54:37.847935 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:54:37.853846 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:54:37.853846 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:54:37.853846 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:54:37.853846 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:54:37.853846 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:54:37.853846 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9630289d-dcfd-4250-8910-a060f8696292 could not be found. Oct 04 20:54:37.853846 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:54:37.855367 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-78b691a2-cb92-4c76-8169-6fced5d9c07e tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Returning 404 to user: Instance 9630289d-dcfd-4250-8910-a060f8696292 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:54:37.856984 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-78b691a2-cb92-4c76-8169-6fced5d9c07e tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] 10.222.0.33 "GET /compute/v2.1/servers/9630289d-dcfd-4250-8910-a060f8696292" status: 404 len: 111 microversion: 2.1 time: 0.056359 Oct 04 20:54:37.859140 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2096/4242] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:54:37 2022] GET /compute/v2.1/servers/9630289d-dcfd-4250-8910-a060f8696292 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:54:37.872160 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d3bbdde2-ade2-49f9-8bd1-3a3e4d2b08dc tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:37.872891 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d3bbdde2-ade2-49f9-8bd1-3a3e4d2b08dc tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] [instance: 30eb289d-d09c-43fa-af8a-3c6ee303f0af] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:37.887501 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-db6ad934-e84d-445c-8ec7-bf0c9d1cec4c tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e93855201ca64c779f92a2a33979b81f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed328a1e964d46902dee5e1c7c7b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:37.894795 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d3bbdde2-ade2-49f9-8bd1-3a3e4d2b08dc tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:37.895689 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d3bbdde2-ade2-49f9-8bd1-3a3e4d2b08dc tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:37.896387 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d3bbdde2-ade2-49f9-8bd1-3a3e4d2b08dc tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:37.898171 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d3bbdde2-ade2-49f9-8bd1-3a3e4d2b08dc tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:37.901702 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d3bbdde2-ade2-49f9-8bd1-3a3e4d2b08dc tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:37.904056 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d3bbdde2-ade2-49f9-8bd1-3a3e4d2b08dc tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:37.909060 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-db6ad934-e84d-445c-8ec7-bf0c9d1cec4c tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] 10.222.0.33 "GET /compute/v2.1/servers/01fd3eb8-b195-4b9c-8d52-752e50be6f30" status: 200 len: 1505 microversion: 2.1 time: 0.449346 Oct 04 20:54:37.909930 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2147/4243] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:54:37 2022] GET /compute/v2.1/servers/01fd3eb8-b195-4b9c-8d52-752e50be6f30 => generated 1505 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:54:37.925017 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-d3bbdde2-ade2-49f9-8bd1-3a3e4d2b08dc tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] HTTP exception thrown: Instance 30eb289d-d09c-43fa-af8a-3c6ee303f0af could not be found. Oct 04 20:54:37.927318 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d3bbdde2-ade2-49f9-8bd1-3a3e4d2b08dc tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Request method failure captured: Oct 04 20:54:37.927318 n-d-854823-8 devstack@n-api.service[128801]: request: DELETE /compute/v2.1/servers/30eb289d-d09c-43fa-af8a-3c6ee303f0af HTTP/1.1 Oct 04 20:54:37.927318 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:54:37.927318 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:54:37.927318 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:54:37.927318 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 0 Oct 04 20:54:37.927318 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:54:37.927318 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:54:37.927318 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:54:37.927318 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:54:37.927318 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJxSZfevtBVnbE8xQF7FYm_FMbZNMYv-b1P0ldR6C6mOlBxOPHbcbefhyrqwXR1yI98_OYaoilQwhW17vvL2mv1TUMfEjVB0p9Z8xi6fxjKTzjqbSmmUYZRpw0KKdt3nuXH8mFLFoxIXJdxlVC2R9xsCLdqsVxY0fb8-x4eIUN27OLA Oct 04 20:54:37.927318 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:54:37.927318 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:54:37.927318 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:54:37.927318 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:54:37.927318 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:54:37.927318 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:54:37.927318 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: 82ae4960393c464c97669731c2084d0f Oct 04 20:54:37.927318 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-DeleteServersTestJSON-364705212 Oct 04 20:54:37.927318 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 20:54:37.927318 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 20:54:37.927318 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_82ae4960393c464c97669731c2084d0f", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/82ae4960393c464c97669731c2084d0f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/82ae4960393c464c97669731c2084d0f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/82ae4960393c464c97669731c2084d0f"}]}] Oct 04 20:54:37.927318 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-DeleteServersTestJSON-364705212 Oct 04 20:54:37.927318 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: 82ae4960393c464c97669731c2084d0f Oct 04 20:54:37.927318 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-DeleteServersTestJSON-364705212 Oct 04 20:54:37.927318 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-DeleteServersTestJSON-364705212-project Oct 04 20:54:37.927318 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:54:37.927318 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:54:37.927318 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: e2c208ec9faf491385a9ab5b5932098d Oct 04 20:54:37.927318 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-DeleteServersTestJSON-364705212-project Oct 04 20:54:37.927318 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 20:54:37.927318 n-d-854823-8 devstack@n-api.service[128801]: exception: Instance 30eb289d-d09c-43fa-af8a-3c6ee303f0af could not be found. Oct 04 20:54:37.927318 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': '30eb289d-d09c-43fa-af8a-3c6ee303f0af'} Oct 04 20:54:37.927318 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:54:37.927318 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:54:37.927318 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:54:37.927318 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:54:37.927318 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:54:37.927318 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:54:37.927318 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:54:37.927318 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:54:37.927318 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:54:37.927318 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:54:37.927318 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 30eb289d-d09c-43fa-af8a-3c6ee303f0af could not be found. Oct 04 20:54:37.927318 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:54:37.927318 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:54:37.927318 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:54:37.927318 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:54:37.927318 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:54:37.927318 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:54:37.927318 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:54:37.927318 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:54:37.927318 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:54:37.927318 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:54:37.927318 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 20:54:37.927318 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 20:54:37.927318 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 20:54:37.927318 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 20:54:37.927318 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:54:37.927318 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:54:37.927318 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:54:37.927318 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:54:37.931493 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 30eb289d-d09c-43fa-af8a-3c6ee303f0af could not be found. Oct 04 20:54:37.931493 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:54:37.931493 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:54:37.931493 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:54:37.931493 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:54:37.931493 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:54:37.931493 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:54:37.931493 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:54:37.931493 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:54:37.931493 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 30eb289d-d09c-43fa-af8a-3c6ee303f0af could not be found. Oct 04 20:54:37.931493 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:54:37.936762 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d3bbdde2-ade2-49f9-8bd1-3a3e4d2b08dc tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Returning 404 to user: Instance 30eb289d-d09c-43fa-af8a-3c6ee303f0af could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:54:37.937994 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d3bbdde2-ade2-49f9-8bd1-3a3e4d2b08dc tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] 10.222.0.33 "DELETE /compute/v2.1/servers/30eb289d-d09c-43fa-af8a-3c6ee303f0af" status: 404 len: 111 microversion: 2.1 time: 0.074299 Oct 04 20:54:37.938557 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-e77eee8c-6c42-4caa-961b-a221d076d1a6 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:37.939099 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2097/4244] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 20:54:37 2022] DELETE /compute/v2.1/servers/30eb289d-d09c-43fa-af8a-3c6ee303f0af => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:54:37.942212 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-e77eee8c-6c42-4caa-961b-a221d076d1a6 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] [instance: 01fd3eb8-b195-4b9c-8d52-752e50be6f30] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:37.950374 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e77eee8c-6c42-4caa-961b-a221d076d1a6 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:37.951083 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e77eee8c-6c42-4caa-961b-a221d076d1a6 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:37.952021 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e77eee8c-6c42-4caa-961b-a221d076d1a6 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:37.953063 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e77eee8c-6c42-4caa-961b-a221d076d1a6 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:37.953932 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2aacb28f-528a-4f96-8bfb-822ba97149ec tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:37.954848 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e77eee8c-6c42-4caa-961b-a221d076d1a6 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:37.954968 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-2aacb28f-528a-4f96-8bfb-822ba97149ec tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] [instance: 30eb289d-d09c-43fa-af8a-3c6ee303f0af] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:37.955657 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e77eee8c-6c42-4caa-961b-a221d076d1a6 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:37.962788 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2aacb28f-528a-4f96-8bfb-822ba97149ec tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:37.965087 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2aacb28f-528a-4f96-8bfb-822ba97149ec tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:37.965766 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2aacb28f-528a-4f96-8bfb-822ba97149ec tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:37.966730 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2aacb28f-528a-4f96-8bfb-822ba97149ec tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:37.968051 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2aacb28f-528a-4f96-8bfb-822ba97149ec tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:37.968716 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2aacb28f-528a-4f96-8bfb-822ba97149ec tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:37.988007 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-2aacb28f-528a-4f96-8bfb-822ba97149ec tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] HTTP exception thrown: Instance 30eb289d-d09c-43fa-af8a-3c6ee303f0af could not be found. Oct 04 20:54:37.988805 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-e77eee8c-6c42-4caa-961b-a221d076d1a6 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] [instance: 01fd3eb8-b195-4b9c-8d52-752e50be6f30] Going to try to terminate instance {{(pid=128802) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:54:37.989994 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2aacb28f-528a-4f96-8bfb-822ba97149ec tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Request method failure captured: Oct 04 20:54:37.989994 n-d-854823-8 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/30eb289d-d09c-43fa-af8a-3c6ee303f0af HTTP/1.1 Oct 04 20:54:37.989994 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:54:37.989994 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:54:37.989994 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:54:37.989994 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 0 Oct 04 20:54:37.989994 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:54:37.989994 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:54:37.989994 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:54:37.989994 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:54:37.989994 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJxSZfevtBVnbE8xQF7FYm_FMbZNMYv-b1P0ldR6C6mOlBxOPHbcbefhyrqwXR1yI98_OYaoilQwhW17vvL2mv1TUMfEjVB0p9Z8xi6fxjKTzjqbSmmUYZRpw0KKdt3nuXH8mFLFoxIXJdxlVC2R9xsCLdqsVxY0fb8-x4eIUN27OLA Oct 04 20:54:37.989994 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:54:37.989994 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:54:37.989994 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:54:37.989994 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:54:37.989994 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:54:37.989994 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:54:37.989994 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: 82ae4960393c464c97669731c2084d0f Oct 04 20:54:37.989994 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-DeleteServersTestJSON-364705212 Oct 04 20:54:37.989994 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 20:54:37.989994 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 20:54:37.989994 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_82ae4960393c464c97669731c2084d0f", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/82ae4960393c464c97669731c2084d0f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/82ae4960393c464c97669731c2084d0f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/82ae4960393c464c97669731c2084d0f"}]}] Oct 04 20:54:37.989994 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-DeleteServersTestJSON-364705212 Oct 04 20:54:37.989994 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: 82ae4960393c464c97669731c2084d0f Oct 04 20:54:37.989994 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-DeleteServersTestJSON-364705212 Oct 04 20:54:37.989994 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-DeleteServersTestJSON-364705212-project Oct 04 20:54:37.989994 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:54:37.989994 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:54:37.989994 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: e2c208ec9faf491385a9ab5b5932098d Oct 04 20:54:37.989994 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-DeleteServersTestJSON-364705212-project Oct 04 20:54:37.989994 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 20:54:37.989994 n-d-854823-8 devstack@n-api.service[128801]: exception: Instance 30eb289d-d09c-43fa-af8a-3c6ee303f0af could not be found. Oct 04 20:54:37.989994 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': '30eb289d-d09c-43fa-af8a-3c6ee303f0af'} Oct 04 20:54:37.989994 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:54:37.989994 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:54:37.989994 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:54:37.989994 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:54:37.989994 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:54:37.989994 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:54:37.989994 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:54:37.989994 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:54:37.989994 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:54:37.989994 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:54:37.989994 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 30eb289d-d09c-43fa-af8a-3c6ee303f0af could not be found. Oct 04 20:54:37.989994 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:54:37.989994 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:54:37.989994 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:54:37.989994 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:54:37.989994 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:54:37.989994 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:54:37.989994 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:54:37.989994 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:54:37.989994 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:54:37.989994 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:54:37.989994 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:54:37.989994 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:54:37.989994 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:54:37.989994 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:54:37.989994 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:54:37.989994 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:54:37.989994 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 30eb289d-d09c-43fa-af8a-3c6ee303f0af could not be found. Oct 04 20:54:37.989994 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:54:37.989994 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:54:37.989994 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:54:37.998724 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:54:37.998724 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:54:37.998724 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:54:37.998724 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:54:37.998724 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:54:37.998724 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 30eb289d-d09c-43fa-af8a-3c6ee303f0af could not be found. Oct 04 20:54:37.998724 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:54:37.998724 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2aacb28f-528a-4f96-8bfb-822ba97149ec tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Returning 404 to user: Instance 30eb289d-d09c-43fa-af8a-3c6ee303f0af could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:54:37.998724 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-2aacb28f-528a-4f96-8bfb-822ba97149ec tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] 10.222.0.33 "GET /compute/v2.1/servers/30eb289d-d09c-43fa-af8a-3c6ee303f0af" status: 404 len: 111 microversion: 2.1 time: 0.046644 Oct 04 20:54:37.998724 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2098/4245] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:54:37 2022] GET /compute/v2.1/servers/30eb289d-d09c-43fa-af8a-3c6ee303f0af => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:54:38.009543 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5040ff93-4887-4fc5-a452-6a7bb62aa7a9 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:38.010189 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-5040ff93-4887-4fc5-a452-6a7bb62aa7a9 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] [instance: e0ca65a5-b651-4473-b73f-af62bf6a6e92] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:38.022002 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5040ff93-4887-4fc5-a452-6a7bb62aa7a9 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:38.022922 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5040ff93-4887-4fc5-a452-6a7bb62aa7a9 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:38.025018 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5040ff93-4887-4fc5-a452-6a7bb62aa7a9 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:38.026071 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5040ff93-4887-4fc5-a452-6a7bb62aa7a9 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:38.026854 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5040ff93-4887-4fc5-a452-6a7bb62aa7a9 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:38.027527 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5040ff93-4887-4fc5-a452-6a7bb62aa7a9 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:38.044234 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-5040ff93-4887-4fc5-a452-6a7bb62aa7a9 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] HTTP exception thrown: Instance e0ca65a5-b651-4473-b73f-af62bf6a6e92 could not be found. Oct 04 20:54:38.045828 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5040ff93-4887-4fc5-a452-6a7bb62aa7a9 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Request method failure captured: Oct 04 20:54:38.045828 n-d-854823-8 devstack@n-api.service[128801]: request: DELETE /compute/v2.1/servers/e0ca65a5-b651-4473-b73f-af62bf6a6e92 HTTP/1.1 Oct 04 20:54:38.045828 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:54:38.045828 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:54:38.045828 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:54:38.045828 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 0 Oct 04 20:54:38.045828 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:54:38.045828 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:54:38.045828 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:54:38.045828 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:54:38.045828 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJxSZfevtBVnbE8xQF7FYm_FMbZNMYv-b1P0ldR6C6mOlBxOPHbcbefhyrqwXR1yI98_OYaoilQwhW17vvL2mv1TUMfEjVB0p9Z8xi6fxjKTzjqbSmmUYZRpw0KKdt3nuXH8mFLFoxIXJdxlVC2R9xsCLdqsVxY0fb8-x4eIUN27OLA Oct 04 20:54:38.045828 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:54:38.045828 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:54:38.045828 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:54:38.045828 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:54:38.045828 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:54:38.045828 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:54:38.045828 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: 82ae4960393c464c97669731c2084d0f Oct 04 20:54:38.045828 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-DeleteServersTestJSON-364705212 Oct 04 20:54:38.045828 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 20:54:38.045828 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 20:54:38.045828 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_82ae4960393c464c97669731c2084d0f", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/82ae4960393c464c97669731c2084d0f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/82ae4960393c464c97669731c2084d0f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/82ae4960393c464c97669731c2084d0f"}]}] Oct 04 20:54:38.045828 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-DeleteServersTestJSON-364705212 Oct 04 20:54:38.045828 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: 82ae4960393c464c97669731c2084d0f Oct 04 20:54:38.045828 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-DeleteServersTestJSON-364705212 Oct 04 20:54:38.045828 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-DeleteServersTestJSON-364705212-project Oct 04 20:54:38.045828 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:54:38.045828 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:54:38.045828 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: e2c208ec9faf491385a9ab5b5932098d Oct 04 20:54:38.045828 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-DeleteServersTestJSON-364705212-project Oct 04 20:54:38.045828 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 20:54:38.045828 n-d-854823-8 devstack@n-api.service[128801]: exception: Instance e0ca65a5-b651-4473-b73f-af62bf6a6e92 could not be found. Oct 04 20:54:38.045828 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': 'e0ca65a5-b651-4473-b73f-af62bf6a6e92'} Oct 04 20:54:38.045828 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:54:38.045828 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:54:38.045828 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:54:38.045828 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:54:38.045828 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:54:38.045828 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:54:38.045828 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:54:38.045828 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:54:38.045828 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:54:38.045828 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:54:38.045828 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e0ca65a5-b651-4473-b73f-af62bf6a6e92 could not be found. Oct 04 20:54:38.045828 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:54:38.045828 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:54:38.045828 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:54:38.045828 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:54:38.045828 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:54:38.045828 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:54:38.045828 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:54:38.045828 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:54:38.045828 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:54:38.045828 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:54:38.045828 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 20:54:38.045828 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 20:54:38.045828 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 20:54:38.045828 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 20:54:38.045828 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:54:38.045828 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:54:38.045828 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:54:38.045828 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:54:38.049474 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e0ca65a5-b651-4473-b73f-af62bf6a6e92 could not be found. Oct 04 20:54:38.049474 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:54:38.049474 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:54:38.049474 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:54:38.049474 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:54:38.049474 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:54:38.049474 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:54:38.049474 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:54:38.049474 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:54:38.049474 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e0ca65a5-b651-4473-b73f-af62bf6a6e92 could not be found. Oct 04 20:54:38.049474 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:54:38.049474 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5040ff93-4887-4fc5-a452-6a7bb62aa7a9 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Returning 404 to user: Instance e0ca65a5-b651-4473-b73f-af62bf6a6e92 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:54:38.049474 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5040ff93-4887-4fc5-a452-6a7bb62aa7a9 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] 10.222.0.33 "DELETE /compute/v2.1/servers/e0ca65a5-b651-4473-b73f-af62bf6a6e92" status: 404 len: 111 microversion: 2.1 time: 0.049827 Oct 04 20:54:38.051018 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2099/4246] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 20:54:37 2022] DELETE /compute/v2.1/servers/e0ca65a5-b651-4473-b73f-af62bf6a6e92 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:54:38.058270 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ae2a228c-9dc5-470e-962e-5986fdc56d5d tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:38.059318 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ae2a228c-9dc5-470e-962e-5986fdc56d5d tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] [instance: e0ca65a5-b651-4473-b73f-af62bf6a6e92] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:38.066710 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ae2a228c-9dc5-470e-962e-5986fdc56d5d tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:38.067415 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ae2a228c-9dc5-470e-962e-5986fdc56d5d tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:38.068036 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ae2a228c-9dc5-470e-962e-5986fdc56d5d tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:38.068922 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ae2a228c-9dc5-470e-962e-5986fdc56d5d tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:38.069553 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ae2a228c-9dc5-470e-962e-5986fdc56d5d tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:38.070143 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ae2a228c-9dc5-470e-962e-5986fdc56d5d tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:38.092733 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-ae2a228c-9dc5-470e-962e-5986fdc56d5d tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] HTTP exception thrown: Instance e0ca65a5-b651-4473-b73f-af62bf6a6e92 could not be found. Oct 04 20:54:38.094797 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ae2a228c-9dc5-470e-962e-5986fdc56d5d tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Request method failure captured: Oct 04 20:54:38.094797 n-d-854823-8 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/e0ca65a5-b651-4473-b73f-af62bf6a6e92 HTTP/1.1 Oct 04 20:54:38.094797 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:54:38.094797 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:54:38.094797 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:54:38.094797 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 0 Oct 04 20:54:38.094797 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:54:38.094797 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:54:38.094797 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:54:38.094797 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:54:38.094797 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJxSZfevtBVnbE8xQF7FYm_FMbZNMYv-b1P0ldR6C6mOlBxOPHbcbefhyrqwXR1yI98_OYaoilQwhW17vvL2mv1TUMfEjVB0p9Z8xi6fxjKTzjqbSmmUYZRpw0KKdt3nuXH8mFLFoxIXJdxlVC2R9xsCLdqsVxY0fb8-x4eIUN27OLA Oct 04 20:54:38.094797 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:54:38.094797 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:54:38.094797 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:54:38.094797 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:54:38.094797 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:54:38.094797 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:54:38.094797 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: 82ae4960393c464c97669731c2084d0f Oct 04 20:54:38.094797 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-DeleteServersTestJSON-364705212 Oct 04 20:54:38.094797 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 20:54:38.094797 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 20:54:38.094797 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_82ae4960393c464c97669731c2084d0f", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/82ae4960393c464c97669731c2084d0f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/82ae4960393c464c97669731c2084d0f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/82ae4960393c464c97669731c2084d0f"}]}] Oct 04 20:54:38.094797 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-DeleteServersTestJSON-364705212 Oct 04 20:54:38.094797 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: 82ae4960393c464c97669731c2084d0f Oct 04 20:54:38.094797 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-DeleteServersTestJSON-364705212 Oct 04 20:54:38.094797 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-DeleteServersTestJSON-364705212-project Oct 04 20:54:38.094797 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:54:38.094797 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:54:38.094797 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: e2c208ec9faf491385a9ab5b5932098d Oct 04 20:54:38.094797 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-DeleteServersTestJSON-364705212-project Oct 04 20:54:38.094797 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 20:54:38.094797 n-d-854823-8 devstack@n-api.service[128801]: exception: Instance e0ca65a5-b651-4473-b73f-af62bf6a6e92 could not be found. Oct 04 20:54:38.094797 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': 'e0ca65a5-b651-4473-b73f-af62bf6a6e92'} Oct 04 20:54:38.094797 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:54:38.094797 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:54:38.094797 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:54:38.094797 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:54:38.094797 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:54:38.094797 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:54:38.094797 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:54:38.094797 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:54:38.094797 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:54:38.094797 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:54:38.094797 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e0ca65a5-b651-4473-b73f-af62bf6a6e92 could not be found. Oct 04 20:54:38.094797 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:54:38.094797 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:54:38.094797 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:54:38.094797 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:54:38.094797 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:54:38.094797 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:54:38.094797 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:54:38.094797 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:54:38.094797 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:54:38.094797 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:54:38.094797 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:54:38.094797 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:54:38.094797 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:54:38.094797 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:54:38.094797 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:54:38.094797 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:54:38.094797 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e0ca65a5-b651-4473-b73f-af62bf6a6e92 could not be found. Oct 04 20:54:38.094797 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:54:38.094797 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:54:38.094797 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:54:38.099315 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:54:38.099315 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:54:38.099315 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:54:38.099315 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:54:38.099315 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:54:38.099315 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e0ca65a5-b651-4473-b73f-af62bf6a6e92 could not be found. Oct 04 20:54:38.099315 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:54:38.101134 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ae2a228c-9dc5-470e-962e-5986fdc56d5d tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Returning 404 to user: Instance e0ca65a5-b651-4473-b73f-af62bf6a6e92 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:54:38.103014 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ae2a228c-9dc5-470e-962e-5986fdc56d5d tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] 10.222.0.33 "GET /compute/v2.1/servers/e0ca65a5-b651-4473-b73f-af62bf6a6e92" status: 404 len: 111 microversion: 2.1 time: 0.050045 Oct 04 20:54:38.107037 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2100/4247] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:54:38 2022] GET /compute/v2.1/servers/e0ca65a5-b651-4473-b73f-af62bf6a6e92 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:54:38.126882 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8d3d2e50-d1bd-4cbc-b41f-c0323577f4e6 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:38.130022 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-e77eee8c-6c42-4caa-961b-a221d076d1a6 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] 10.222.0.33 "DELETE /compute/v2.1/servers/01fd3eb8-b195-4b9c-8d52-752e50be6f30" status: 204 len: 0 microversion: 2.1 time: 0.194937 Oct 04 20:54:38.131139 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-8d3d2e50-d1bd-4cbc-b41f-c0323577f4e6 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] [instance: 96ee8e50-b054-4c37-91ec-abb5e4085c49] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:38.138450 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2148/4248] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 20:54:37 2022] DELETE /compute/v2.1/servers/01fd3eb8-b195-4b9c-8d52-752e50be6f30 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:54:38.163828 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8d3d2e50-d1bd-4cbc-b41f-c0323577f4e6 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:38.164624 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8d3d2e50-d1bd-4cbc-b41f-c0323577f4e6 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:38.165862 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8d3d2e50-d1bd-4cbc-b41f-c0323577f4e6 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:38.167674 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8d3d2e50-d1bd-4cbc-b41f-c0323577f4e6 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:38.168502 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8d3d2e50-d1bd-4cbc-b41f-c0323577f4e6 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:38.169202 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8d3d2e50-d1bd-4cbc-b41f-c0323577f4e6 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:38.191165 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-8d3d2e50-d1bd-4cbc-b41f-c0323577f4e6 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] HTTP exception thrown: Instance 96ee8e50-b054-4c37-91ec-abb5e4085c49 could not be found. Oct 04 20:54:38.193277 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8d3d2e50-d1bd-4cbc-b41f-c0323577f4e6 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Request method failure captured: Oct 04 20:54:38.193277 n-d-854823-8 devstack@n-api.service[128801]: request: DELETE /compute/v2.1/servers/96ee8e50-b054-4c37-91ec-abb5e4085c49 HTTP/1.1 Oct 04 20:54:38.193277 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:54:38.193277 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:54:38.193277 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:54:38.193277 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 0 Oct 04 20:54:38.193277 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:54:38.193277 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:54:38.193277 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:54:38.193277 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:54:38.193277 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJxSZfevtBVnbE8xQF7FYm_FMbZNMYv-b1P0ldR6C6mOlBxOPHbcbefhyrqwXR1yI98_OYaoilQwhW17vvL2mv1TUMfEjVB0p9Z8xi6fxjKTzjqbSmmUYZRpw0KKdt3nuXH8mFLFoxIXJdxlVC2R9xsCLdqsVxY0fb8-x4eIUN27OLA Oct 04 20:54:38.193277 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:54:38.193277 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:54:38.193277 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:54:38.193277 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:54:38.193277 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:54:38.193277 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:54:38.193277 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: 82ae4960393c464c97669731c2084d0f Oct 04 20:54:38.193277 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-DeleteServersTestJSON-364705212 Oct 04 20:54:38.193277 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 20:54:38.193277 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 20:54:38.193277 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_82ae4960393c464c97669731c2084d0f", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/82ae4960393c464c97669731c2084d0f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/82ae4960393c464c97669731c2084d0f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/82ae4960393c464c97669731c2084d0f"}]}] Oct 04 20:54:38.193277 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-DeleteServersTestJSON-364705212 Oct 04 20:54:38.193277 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: 82ae4960393c464c97669731c2084d0f Oct 04 20:54:38.193277 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-DeleteServersTestJSON-364705212 Oct 04 20:54:38.193277 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-DeleteServersTestJSON-364705212-project Oct 04 20:54:38.193277 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:54:38.193277 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:54:38.193277 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: e2c208ec9faf491385a9ab5b5932098d Oct 04 20:54:38.193277 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-DeleteServersTestJSON-364705212-project Oct 04 20:54:38.193277 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 20:54:38.193277 n-d-854823-8 devstack@n-api.service[128801]: exception: Instance 96ee8e50-b054-4c37-91ec-abb5e4085c49 could not be found. Oct 04 20:54:38.193277 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': '96ee8e50-b054-4c37-91ec-abb5e4085c49'} Oct 04 20:54:38.193277 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:54:38.193277 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:54:38.193277 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:54:38.193277 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:54:38.193277 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:54:38.193277 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:54:38.193277 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:54:38.193277 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:54:38.193277 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:54:38.193277 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:54:38.193277 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 96ee8e50-b054-4c37-91ec-abb5e4085c49 could not be found. Oct 04 20:54:38.193277 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:54:38.193277 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:54:38.193277 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:54:38.193277 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:54:38.193277 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:54:38.193277 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:54:38.193277 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:54:38.193277 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:54:38.193277 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:54:38.193277 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:54:38.193277 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 20:54:38.193277 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 20:54:38.193277 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 20:54:38.193277 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 20:54:38.193277 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:54:38.193277 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:54:38.193277 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:54:38.193277 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:54:38.196974 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 96ee8e50-b054-4c37-91ec-abb5e4085c49 could not be found. Oct 04 20:54:38.196974 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:54:38.196974 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:54:38.196974 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:54:38.196974 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:54:38.196974 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:54:38.196974 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:54:38.196974 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:54:38.196974 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:54:38.196974 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 96ee8e50-b054-4c37-91ec-abb5e4085c49 could not be found. Oct 04 20:54:38.196974 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:54:38.199253 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8d3d2e50-d1bd-4cbc-b41f-c0323577f4e6 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Returning 404 to user: Instance 96ee8e50-b054-4c37-91ec-abb5e4085c49 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:54:38.200533 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-8d3d2e50-d1bd-4cbc-b41f-c0323577f4e6 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] 10.222.0.33 "DELETE /compute/v2.1/servers/96ee8e50-b054-4c37-91ec-abb5e4085c49" status: 404 len: 111 microversion: 2.1 time: 0.080061 Oct 04 20:54:38.201416 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2101/4249] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 20:54:38 2022] DELETE /compute/v2.1/servers/96ee8e50-b054-4c37-91ec-abb5e4085c49 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:54:38.211323 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-1c1c8324-eb0c-4338-b818-80d0b1de196e tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:38.212743 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-1c1c8324-eb0c-4338-b818-80d0b1de196e tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] [instance: 96ee8e50-b054-4c37-91ec-abb5e4085c49] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:38.219875 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1c1c8324-eb0c-4338-b818-80d0b1de196e tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:38.220248 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1c1c8324-eb0c-4338-b818-80d0b1de196e tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:38.222384 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1c1c8324-eb0c-4338-b818-80d0b1de196e tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:38.233566 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1c1c8324-eb0c-4338-b818-80d0b1de196e tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:38.234294 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1c1c8324-eb0c-4338-b818-80d0b1de196e tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:38.234988 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1c1c8324-eb0c-4338-b818-80d0b1de196e tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:38.258308 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.wsgi [None req-1c1c8324-eb0c-4338-b818-80d0b1de196e tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] HTTP exception thrown: Instance 96ee8e50-b054-4c37-91ec-abb5e4085c49 could not be found. Oct 04 20:54:38.260316 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-1c1c8324-eb0c-4338-b818-80d0b1de196e tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Request method failure captured: Oct 04 20:54:38.260316 n-d-854823-8 devstack@n-api.service[128802]: request: GET /compute/v2.1/servers/96ee8e50-b054-4c37-91ec-abb5e4085c49 HTTP/1.1 Oct 04 20:54:38.260316 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 20:54:38.260316 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 20:54:38.260316 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 20:54:38.260316 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 0 Oct 04 20:54:38.260316 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 20:54:38.260316 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 20:54:38.260316 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 20:54:38.260316 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 20:54:38.260316 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPJxSZfevtBVnbE8xQF7FYm_FMbZNMYv-b1P0ldR6C6mOlBxOPHbcbefhyrqwXR1yI98_OYaoilQwhW17vvL2mv1TUMfEjVB0p9Z8xi6fxjKTzjqbSmmUYZRpw0KKdt3nuXH8mFLFoxIXJdxlVC2R9xsCLdqsVxY0fb8-x4eIUN27OLA Oct 04 20:54:38.260316 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 20:54:38.260316 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 20:54:38.260316 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 20:54:38.260316 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 20:54:38.260316 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 20:54:38.260316 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 20:54:38.260316 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: 82ae4960393c464c97669731c2084d0f Oct 04 20:54:38.260316 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-DeleteServersTestJSON-364705212 Oct 04 20:54:38.260316 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 20:54:38.260316 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 20:54:38.260316 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_82ae4960393c464c97669731c2084d0f", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/82ae4960393c464c97669731c2084d0f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/82ae4960393c464c97669731c2084d0f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/82ae4960393c464c97669731c2084d0f"}]}] Oct 04 20:54:38.260316 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-DeleteServersTestJSON-364705212 Oct 04 20:54:38.260316 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: 82ae4960393c464c97669731c2084d0f Oct 04 20:54:38.260316 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-DeleteServersTestJSON-364705212 Oct 04 20:54:38.260316 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-DeleteServersTestJSON-364705212-project Oct 04 20:54:38.260316 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 20:54:38.260316 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 20:54:38.260316 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: e2c208ec9faf491385a9ab5b5932098d Oct 04 20:54:38.260316 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-DeleteServersTestJSON-364705212-project Oct 04 20:54:38.260316 n-d-854823-8 devstack@n-api.service[128802]: method: > Oct 04 20:54:38.260316 n-d-854823-8 devstack@n-api.service[128802]: exception: Instance 96ee8e50-b054-4c37-91ec-abb5e4085c49 could not be found. Oct 04 20:54:38.260316 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'id': '96ee8e50-b054-4c37-91ec-abb5e4085c49'} Oct 04 20:54:38.260316 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:54:38.260316 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:54:38.260316 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:54:38.260316 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:54:38.260316 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:54:38.260316 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:54:38.260316 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:54:38.260316 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:54:38.260316 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:54:38.260316 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:54:38.260316 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 96ee8e50-b054-4c37-91ec-abb5e4085c49 could not be found. Oct 04 20:54:38.260316 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:54:38.260316 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:54:38.260316 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:54:38.260316 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:54:38.260316 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:54:38.260316 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:54:38.260316 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:54:38.260316 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:54:38.260316 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:54:38.260316 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:54:38.260316 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:54:38.260316 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:54:38.260316 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:54:38.260316 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:54:38.260316 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:54:38.260316 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:54:38.260316 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 96ee8e50-b054-4c37-91ec-abb5e4085c49 could not be found. Oct 04 20:54:38.260316 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:54:38.260316 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:54:38.260316 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:54:38.264245 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:54:38.264245 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:54:38.264245 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:54:38.264245 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:54:38.264245 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:54:38.264245 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 96ee8e50-b054-4c37-91ec-abb5e4085c49 could not be found. Oct 04 20:54:38.264245 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:54:38.264245 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-1c1c8324-eb0c-4338-b818-80d0b1de196e tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Returning 404 to user: Instance 96ee8e50-b054-4c37-91ec-abb5e4085c49 could not be found. {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:54:38.264245 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-1c1c8324-eb0c-4338-b818-80d0b1de196e tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] 10.222.0.33 "GET /compute/v2.1/servers/96ee8e50-b054-4c37-91ec-abb5e4085c49" status: 404 len: 111 microversion: 2.1 time: 0.056459 Oct 04 20:54:38.264245 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2149/4250] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:54:38 2022] GET /compute/v2.1/servers/96ee8e50-b054-4c37-91ec-abb5e4085c49 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 20:54:38.275220 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6092c748-6a35-4aac-8600-42669dee99cc tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1896796984", "imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63", "flavorRef": "452", "networks": [{"uuid": "a8ab3947-7502-47aa-82ee-003685ca9719"}]}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:54:38.367306 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.network.neutron [None req-6092c748-6a35-4aac-8600-42669dee99cc tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] validate_networks() for [('a8ab3947-7502-47aa-82ee-003685ca9719', None, None, None, None, None)] {{(pid=128801) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:54:40.192324 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-10ed620f-3d96-46c5-9435-cfb500a0c6ed tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-496322371", "imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63", "flavorRef": "452", "networks": "none"}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:54:40.278633 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-10ed620f-3d96-46c5-9435-cfb500a0c6ed tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Flavor limits 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:54:40.279274 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-10ed620f-3d96-46c5-9435-cfb500a0c6ed tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Image limits 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:54:40.280093 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-10ed620f-3d96-46c5-9435-cfb500a0c6ed tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Flavor pref 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:54:40.281575 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-10ed620f-3d96-46c5-9435-cfb500a0c6ed tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Image pref 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:54:40.282323 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-10ed620f-3d96-46c5-9435-cfb500a0c6ed tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:54:40.295953 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-10ed620f-3d96-46c5-9435-cfb500a0c6ed tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:40.296822 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-10ed620f-3d96-46c5-9435-cfb500a0c6ed tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:40.298081 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-10ed620f-3d96-46c5-9435-cfb500a0c6ed tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:40.299193 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-10ed620f-3d96-46c5-9435-cfb500a0c6ed tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:40.299897 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-10ed620f-3d96-46c5-9435-cfb500a0c6ed tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:40.301015 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-10ed620f-3d96-46c5-9435-cfb500a0c6ed tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:40.335292 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-10ed620f-3d96-46c5-9435-cfb500a0c6ed tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Getting quotas for project 589fcee1949d4820a8958ec55ce4b43a. Resources: {'ram', 'instances', 'cores'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:54:40.343642 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-10ed620f-3d96-46c5-9435-cfb500a0c6ed tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Getting quotas for user 4adee36830c640919981ae58bd326157 and project 589fcee1949d4820a8958ec55ce4b43a. Resources: {'ram', 'instances', 'cores'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:54:40.362151 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-10ed620f-3d96-46c5-9435-cfb500a0c6ed tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Going to run 1 instances... {{(pid=128802) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:54:40.367019 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-10ed620f-3d96-46c5-9435-cfb500a0c6ed tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] [instance: 91fdf7b5-677e-443b-b237-6160276f83c3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='15b24725-0c99-4bcf-b1fb-907cdf8e2d63',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128802) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:54:40.498183 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-6092c748-6a35-4aac-8600-42669dee99cc tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Flavor limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:54:40.498749 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-6092c748-6a35-4aac-8600-42669dee99cc tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Image limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:54:40.499105 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-6092c748-6a35-4aac-8600-42669dee99cc tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Flavor pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:54:40.499521 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-6092c748-6a35-4aac-8600-42669dee99cc tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Image pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:54:40.499942 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-6092c748-6a35-4aac-8600-42669dee99cc tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:54:40.505274 n-d-854823-8 devstack@n-api.service[128802]: ERROR oslo.messaging._drivers.impl_rabbit [None req-10ed620f-3d96-46c5-9435-cfb500a0c6ed tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] [a0fb272b-aaac-49d8-9519-edd5efa69eda] AMQP server on 10.222.0.33:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 20:54:40.515577 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6092c748-6a35-4aac-8600-42669dee99cc tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:40.515995 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6092c748-6a35-4aac-8600-42669dee99cc tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:40.516440 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6092c748-6a35-4aac-8600-42669dee99cc tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:40.517179 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6092c748-6a35-4aac-8600-42669dee99cc tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:40.517642 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6092c748-6a35-4aac-8600-42669dee99cc tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:40.518072 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6092c748-6a35-4aac-8600-42669dee99cc tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:40.566002 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-6092c748-6a35-4aac-8600-42669dee99cc tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Getting quotas for project 22ed328a1e964d46902dee5e1c7c7b74. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:54:40.581500 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-6092c748-6a35-4aac-8600-42669dee99cc tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Getting quotas for user e93855201ca64c779f92a2a33979b81f and project 22ed328a1e964d46902dee5e1c7c7b74. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:54:40.598334 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:54:40.620867 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-6092c748-6a35-4aac-8600-42669dee99cc tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Going to run 1 instances... {{(pid=128801) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:54:40.624660 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-6092c748-6a35-4aac-8600-42669dee99cc tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] [instance: 67656ca4-09a7-4e6b-bf3a-cfcd254e99e4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='15b24725-0c99-4bcf-b1fb-907cdf8e2d63',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128801) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:54:40.715594 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-6092c748-6a35-4aac-8600-42669dee99cc tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.445220 Oct 04 20:54:40.718968 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2102/4251] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 20:54:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 2449 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 20:54:40.730831 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-30b4a550-d492-4df3-9a23-fdda98283597 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:40.732750 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-30b4a550-d492-4df3-9a23-fdda98283597 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] [instance: 67656ca4-09a7-4e6b-bf3a-cfcd254e99e4] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:40.888521 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-30b4a550-d492-4df3-9a23-fdda98283597 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e93855201ca64c779f92a2a33979b81f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed328a1e964d46902dee5e1c7c7b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:40.898274 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-30b4a550-d492-4df3-9a23-fdda98283597 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] 10.222.0.33 "GET /compute/v2.1/servers/67656ca4-09a7-4e6b-bf3a-cfcd254e99e4" status: 200 len: 1218 microversion: 2.1 time: 0.172494 Oct 04 20:54:40.898890 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2103/4252] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:54:40 2022] GET /compute/v2.1/servers/67656ca4-09a7-4e6b-bf3a-cfcd254e99e4 => generated 1218 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:54:41.516443 n-d-854823-8 devstack@n-api.service[128802]: INFO oslo.messaging._drivers.impl_rabbit [None req-10ed620f-3d96-46c5-9435-cfb500a0c6ed tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] [a0fb272b-aaac-49d8-9519-edd5efa69eda] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 43664. Oct 04 20:54:41.521807 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-10ed620f-3d96-46c5-9435-cfb500a0c6ed tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 1.587259 Oct 04 20:54:41.523128 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2150/4253] 10.222.0.33 () {62 vars in 1188 bytes} [Tue Oct 4 20:54:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 1589 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 04 20:54:41.537041 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0c7d54a1-c452-43b2-badd-cbe81618397d tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:41.538023 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-0c7d54a1-c452-43b2-badd-cbe81618397d tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] [instance: 91fdf7b5-677e-443b-b237-6160276f83c3] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:41.905551 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-0c7d54a1-c452-43b2-badd-cbe81618397d tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4adee36830c640919981ae58bd326157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '589fcee1949d4820a8958ec55ce4b43a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:41.917594 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-0c7d54a1-c452-43b2-badd-cbe81618397d tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4adee36830c640919981ae58bd326157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '589fcee1949d4820a8958ec55ce4b43a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:41.920576 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-0c7d54a1-c452-43b2-badd-cbe81618397d tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4adee36830c640919981ae58bd326157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '589fcee1949d4820a8958ec55ce4b43a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:41.928735 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-1d8c2878-af12-4e92-93f8-5798b2080104 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:41.929369 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-1d8c2878-af12-4e92-93f8-5798b2080104 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] [instance: 67656ca4-09a7-4e6b-bf3a-cfcd254e99e4] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:41.942848 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-0c7d54a1-c452-43b2-badd-cbe81618397d tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] 10.222.0.33 "GET /compute/v2.1/servers/91fdf7b5-677e-443b-b237-6160276f83c3" status: 200 len: 1277 microversion: 2.47 time: 0.390299 Oct 04 20:54:41.944062 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2104/4254] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:54:41 2022] GET /compute/v2.1/servers/91fdf7b5-677e-443b-b237-6160276f83c3 => generated 1277 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:54:41.944294 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1d8c2878-af12-4e92-93f8-5798b2080104 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:41.945540 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1d8c2878-af12-4e92-93f8-5798b2080104 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:41.946204 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1d8c2878-af12-4e92-93f8-5798b2080104 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:41.949163 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1d8c2878-af12-4e92-93f8-5798b2080104 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:41.949789 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1d8c2878-af12-4e92-93f8-5798b2080104 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:41.952693 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1d8c2878-af12-4e92-93f8-5798b2080104 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:42.066687 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-4992d978-fa1f-440f-8dd7-c10e7ff6b3bb tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-980458603", "imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63", "flavorRef": "452", "networks": "none"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:54:42.143637 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-4992d978-fa1f-440f-8dd7-c10e7ff6b3bb tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Flavor limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:54:42.144504 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-4992d978-fa1f-440f-8dd7-c10e7ff6b3bb tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Image limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:54:42.145729 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-4992d978-fa1f-440f-8dd7-c10e7ff6b3bb tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Flavor pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:54:42.146865 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-4992d978-fa1f-440f-8dd7-c10e7ff6b3bb tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Image pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:54:42.148997 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-4992d978-fa1f-440f-8dd7-c10e7ff6b3bb tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:54:42.193060 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4992d978-fa1f-440f-8dd7-c10e7ff6b3bb tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:42.194136 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4992d978-fa1f-440f-8dd7-c10e7ff6b3bb tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:42.198281 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4992d978-fa1f-440f-8dd7-c10e7ff6b3bb tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:42.199983 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4992d978-fa1f-440f-8dd7-c10e7ff6b3bb tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:42.200643 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4992d978-fa1f-440f-8dd7-c10e7ff6b3bb tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:42.201274 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4992d978-fa1f-440f-8dd7-c10e7ff6b3bb tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:42.248064 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-4992d978-fa1f-440f-8dd7-c10e7ff6b3bb tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Getting quotas for project 589fcee1949d4820a8958ec55ce4b43a. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:54:42.262685 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-4992d978-fa1f-440f-8dd7-c10e7ff6b3bb tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Getting quotas for user 4adee36830c640919981ae58bd326157 and project 589fcee1949d4820a8958ec55ce4b43a. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:54:42.301044 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-4992d978-fa1f-440f-8dd7-c10e7ff6b3bb tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Going to run 1 instances... {{(pid=128801) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:54:42.308693 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-4992d978-fa1f-440f-8dd7-c10e7ff6b3bb tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] [instance: 601e4070-a868-49c6-b935-87eeeac4a826] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='15b24725-0c99-4bcf-b1fb-907cdf8e2d63',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128801) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:54:42.447661 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-4992d978-fa1f-440f-8dd7-c10e7ff6b3bb tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.385866 Oct 04 20:54:42.448374 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2105/4255] 10.222.0.33 () {62 vars in 1188 bytes} [Tue Oct 4 20:54:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 388 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 04 20:54:42.505983 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-325cd328-b55e-4ace-a093-8df79b908f9c tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:54:42.510118 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-1d8c2878-af12-4e92-93f8-5798b2080104 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e93855201ca64c779f92a2a33979b81f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed328a1e964d46902dee5e1c7c7b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:42.519518 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-1d8c2878-af12-4e92-93f8-5798b2080104 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] 10.222.0.33 "GET /compute/v2.1/servers/67656ca4-09a7-4e6b-bf3a-cfcd254e99e4" status: 200 len: 1214 microversion: 2.1 time: 0.596106 Oct 04 20:54:42.522399 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-325cd328-b55e-4ace-a093-8df79b908f9c tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] [instance: 601e4070-a868-49c6-b935-87eeeac4a826] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:42.535893 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2151/4256] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:54:41 2022] GET /compute/v2.1/servers/67656ca4-09a7-4e6b-bf3a-cfcd254e99e4 => generated 1214 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:54:42.553998 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-9534154a-1c6e-49ef-9f37-c4e6ea7b25ea req-c38177c8-c9bd-4d9c-b568-41e20b373627 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01fd3eb8-b195-4b9c-8d52-752e50be6f30", "name": "network-vif-deleted", "tag": "ce1cdf10-8100-44ae-9a55-7470bb0c09b0"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:54:42.600013 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-9534154a-1c6e-49ef-9f37-c4e6ea7b25ea req-c38177c8-c9bd-4d9c-b568-41e20b373627 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:42.600507 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-9534154a-1c6e-49ef-9f37-c4e6ea7b25ea req-c38177c8-c9bd-4d9c-b568-41e20b373627 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:42.607215 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-9534154a-1c6e-49ef-9f37-c4e6ea7b25ea req-c38177c8-c9bd-4d9c-b568-41e20b373627 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:42.660847 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-9534154a-1c6e-49ef-9f37-c4e6ea7b25ea req-c38177c8-c9bd-4d9c-b568-41e20b373627 service nova] Creating event network-vif-deleted:ce1cdf10-8100-44ae-9a55-7470bb0c09b0 for instance 01fd3eb8-b195-4b9c-8d52-752e50be6f30 on n-h1-854823-8 Oct 04 20:54:42.681417 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-9534154a-1c6e-49ef-9f37-c4e6ea7b25ea req-c38177c8-c9bd-4d9c-b568-41e20b373627 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.143120 Oct 04 20:54:42.690053 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2152/4257] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:54:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:54:42.708582 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-325cd328-b55e-4ace-a093-8df79b908f9c tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] 10.222.0.33 "PUT /compute/v2.1/servers/601e4070-a868-49c6-b935-87eeeac4a826" status: 200 len: 991 microversion: 2.47 time: 0.244401 Oct 04 20:54:42.713839 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2106/4258] 10.222.0.33 () {62 vars in 1297 bytes} [Tue Oct 4 20:54:42 2022] PUT /compute/v2.1/servers/601e4070-a868-49c6-b935-87eeeac4a826 => generated 991 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 20:54:42.739549 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-7544fd80-2c41-46be-a7ec-ca443ca9f28f tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:42.740672 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-7544fd80-2c41-46be-a7ec-ca443ca9f28f tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] [instance: 601e4070-a868-49c6-b935-87eeeac4a826] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:43.001065 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-7544fd80-2c41-46be-a7ec-ca443ca9f28f tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4adee36830c640919981ae58bd326157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '589fcee1949d4820a8958ec55ce4b43a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:43.024940 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-7544fd80-2c41-46be-a7ec-ca443ca9f28f tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4adee36830c640919981ae58bd326157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '589fcee1949d4820a8958ec55ce4b43a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:43.026885 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-7544fd80-2c41-46be-a7ec-ca443ca9f28f tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4adee36830c640919981ae58bd326157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '589fcee1949d4820a8958ec55ce4b43a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:43.031458 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-7544fd80-2c41-46be-a7ec-ca443ca9f28f tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] 10.222.0.33 "GET /compute/v2.1/servers/601e4070-a868-49c6-b935-87eeeac4a826" status: 200 len: 1277 microversion: 2.47 time: 0.296908 Oct 04 20:54:43.032043 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2153/4259] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:54:42 2022] GET /compute/v2.1/servers/601e4070-a868-49c6-b935-87eeeac4a826 => generated 1277 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:54:43.558672 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ab9f7da3-de7e-4af9-a3ab-c6a2b30e690b tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:43.559500 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ab9f7da3-de7e-4af9-a3ab-c6a2b30e690b tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] [instance: 67656ca4-09a7-4e6b-bf3a-cfcd254e99e4] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:43.578838 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ab9f7da3-de7e-4af9-a3ab-c6a2b30e690b tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:43.592817 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ab9f7da3-de7e-4af9-a3ab-c6a2b30e690b tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:43.593570 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ab9f7da3-de7e-4af9-a3ab-c6a2b30e690b tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:43.594536 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ab9f7da3-de7e-4af9-a3ab-c6a2b30e690b tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:43.601004 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ab9f7da3-de7e-4af9-a3ab-c6a2b30e690b tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:43.601717 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ab9f7da3-de7e-4af9-a3ab-c6a2b30e690b tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:43.953552 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-0fd9f0f8-b727-414e-96dc-302b94731057 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:43.954076 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-0fd9f0f8-b727-414e-96dc-302b94731057 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] [instance: 917274da-5116-42df-84b5-a30b85d40913] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:43.968016 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0fd9f0f8-b727-414e-96dc-302b94731057 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:43.968791 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0fd9f0f8-b727-414e-96dc-302b94731057 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:43.973887 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0fd9f0f8-b727-414e-96dc-302b94731057 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:43.974923 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0fd9f0f8-b727-414e-96dc-302b94731057 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:43.977127 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0fd9f0f8-b727-414e-96dc-302b94731057 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:43.979020 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0fd9f0f8-b727-414e-96dc-302b94731057 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:44.027537 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.wsgi [None req-0fd9f0f8-b727-414e-96dc-302b94731057 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] HTTP exception thrown: Instance 917274da-5116-42df-84b5-a30b85d40913 could not be found. Oct 04 20:54:44.029840 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-0fd9f0f8-b727-414e-96dc-302b94731057 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Request method failure captured: Oct 04 20:54:44.029840 n-d-854823-8 devstack@n-api.service[128802]: request: DELETE /compute/v2.1/servers/917274da-5116-42df-84b5-a30b85d40913 HTTP/1.1 Oct 04 20:54:44.029840 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 20:54:44.029840 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 20:54:44.029840 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 20:54:44.029840 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 0 Oct 04 20:54:44.029840 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 20:54:44.029840 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 20:54:44.029840 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 20:54:44.029840 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 20:54:44.029840 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPJxSZfevtBVnbE8xQF7FYm_FMbZNMYv-b1P0ldR6C6mOlBxOPHbcbefhyrqwXR1yI98_OYaoilQwhW17vvL2mv1TUMfEjVB0p9Z8xi6fxjKTzjqbSmmUYZRpw0KKdt3nuXH8mFLFoxIXJdxlVC2R9xsCLdqsVxY0fb8-x4eIUN27OLA Oct 04 20:54:44.029840 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 20:54:44.029840 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 20:54:44.029840 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 20:54:44.029840 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 20:54:44.029840 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 20:54:44.029840 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 20:54:44.029840 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: 82ae4960393c464c97669731c2084d0f Oct 04 20:54:44.029840 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-DeleteServersTestJSON-364705212 Oct 04 20:54:44.029840 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 20:54:44.029840 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 20:54:44.029840 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_82ae4960393c464c97669731c2084d0f", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/82ae4960393c464c97669731c2084d0f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/82ae4960393c464c97669731c2084d0f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/82ae4960393c464c97669731c2084d0f"}]}] Oct 04 20:54:44.029840 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-DeleteServersTestJSON-364705212 Oct 04 20:54:44.029840 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: 82ae4960393c464c97669731c2084d0f Oct 04 20:54:44.029840 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-DeleteServersTestJSON-364705212 Oct 04 20:54:44.029840 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-DeleteServersTestJSON-364705212-project Oct 04 20:54:44.029840 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 20:54:44.029840 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 20:54:44.029840 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: e2c208ec9faf491385a9ab5b5932098d Oct 04 20:54:44.029840 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-DeleteServersTestJSON-364705212-project Oct 04 20:54:44.029840 n-d-854823-8 devstack@n-api.service[128802]: method: > Oct 04 20:54:44.029840 n-d-854823-8 devstack@n-api.service[128802]: exception: Instance 917274da-5116-42df-84b5-a30b85d40913 could not be found. Oct 04 20:54:44.029840 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'id': '917274da-5116-42df-84b5-a30b85d40913'} Oct 04 20:54:44.029840 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:54:44.029840 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:54:44.029840 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:54:44.029840 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:54:44.029840 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:54:44.029840 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:54:44.029840 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:54:44.029840 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:54:44.029840 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:54:44.029840 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:54:44.029840 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 917274da-5116-42df-84b5-a30b85d40913 could not be found. Oct 04 20:54:44.029840 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:54:44.029840 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:54:44.029840 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:54:44.029840 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:54:44.029840 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:54:44.029840 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:54:44.029840 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:54:44.029840 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:54:44.029840 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:54:44.029840 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:54:44.029840 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 20:54:44.029840 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 20:54:44.029840 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 20:54:44.029840 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 20:54:44.029840 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:54:44.029840 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:54:44.029840 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:54:44.029840 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:54:44.033420 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 917274da-5116-42df-84b5-a30b85d40913 could not be found. Oct 04 20:54:44.033420 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:54:44.033420 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:54:44.033420 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:54:44.033420 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:54:44.033420 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:54:44.033420 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:54:44.033420 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:54:44.033420 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:54:44.033420 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 917274da-5116-42df-84b5-a30b85d40913 could not be found. Oct 04 20:54:44.033420 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:54:44.037629 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-0fd9f0f8-b727-414e-96dc-302b94731057 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Returning 404 to user: Instance 917274da-5116-42df-84b5-a30b85d40913 could not be found. {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:54:44.041157 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-0fd9f0f8-b727-414e-96dc-302b94731057 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] 10.222.0.33 "DELETE /compute/v2.1/servers/917274da-5116-42df-84b5-a30b85d40913" status: 404 len: 111 microversion: 2.1 time: 0.089749 Oct 04 20:54:44.041789 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2154/4260] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 20:54:43 2022] DELETE /compute/v2.1/servers/917274da-5116-42df-84b5-a30b85d40913 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 20:54:44.060203 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-a0592327-0295-4abb-9fa4-87dac0eef132 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:44.062184 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-a0592327-0295-4abb-9fa4-87dac0eef132 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] [instance: 917274da-5116-42df-84b5-a30b85d40913] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:44.077344 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a0592327-0295-4abb-9fa4-87dac0eef132 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:44.078022 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a0592327-0295-4abb-9fa4-87dac0eef132 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:44.078791 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a0592327-0295-4abb-9fa4-87dac0eef132 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:44.079908 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a0592327-0295-4abb-9fa4-87dac0eef132 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:44.080785 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a0592327-0295-4abb-9fa4-87dac0eef132 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:44.081461 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a0592327-0295-4abb-9fa4-87dac0eef132 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:44.124185 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.wsgi [None req-a0592327-0295-4abb-9fa4-87dac0eef132 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] HTTP exception thrown: Instance 917274da-5116-42df-84b5-a30b85d40913 could not be found. Oct 04 20:54:44.125920 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-a0592327-0295-4abb-9fa4-87dac0eef132 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Request method failure captured: Oct 04 20:54:44.125920 n-d-854823-8 devstack@n-api.service[128802]: request: GET /compute/v2.1/servers/917274da-5116-42df-84b5-a30b85d40913 HTTP/1.1 Oct 04 20:54:44.125920 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 20:54:44.125920 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 20:54:44.125920 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 20:54:44.125920 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 0 Oct 04 20:54:44.125920 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 20:54:44.125920 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 20:54:44.125920 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 20:54:44.125920 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 20:54:44.125920 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPJxSZfevtBVnbE8xQF7FYm_FMbZNMYv-b1P0ldR6C6mOlBxOPHbcbefhyrqwXR1yI98_OYaoilQwhW17vvL2mv1TUMfEjVB0p9Z8xi6fxjKTzjqbSmmUYZRpw0KKdt3nuXH8mFLFoxIXJdxlVC2R9xsCLdqsVxY0fb8-x4eIUN27OLA Oct 04 20:54:44.125920 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 20:54:44.125920 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 20:54:44.125920 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 20:54:44.125920 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 20:54:44.125920 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 20:54:44.125920 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 20:54:44.125920 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: 82ae4960393c464c97669731c2084d0f Oct 04 20:54:44.125920 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-DeleteServersTestJSON-364705212 Oct 04 20:54:44.125920 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 20:54:44.125920 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 20:54:44.125920 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_82ae4960393c464c97669731c2084d0f", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/82ae4960393c464c97669731c2084d0f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/82ae4960393c464c97669731c2084d0f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/82ae4960393c464c97669731c2084d0f"}]}] Oct 04 20:54:44.125920 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-DeleteServersTestJSON-364705212 Oct 04 20:54:44.125920 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: 82ae4960393c464c97669731c2084d0f Oct 04 20:54:44.125920 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-DeleteServersTestJSON-364705212 Oct 04 20:54:44.125920 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-DeleteServersTestJSON-364705212-project Oct 04 20:54:44.125920 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 20:54:44.125920 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 20:54:44.125920 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: e2c208ec9faf491385a9ab5b5932098d Oct 04 20:54:44.125920 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-DeleteServersTestJSON-364705212-project Oct 04 20:54:44.125920 n-d-854823-8 devstack@n-api.service[128802]: method: > Oct 04 20:54:44.125920 n-d-854823-8 devstack@n-api.service[128802]: exception: Instance 917274da-5116-42df-84b5-a30b85d40913 could not be found. Oct 04 20:54:44.125920 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'id': '917274da-5116-42df-84b5-a30b85d40913'} Oct 04 20:54:44.125920 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:54:44.125920 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:54:44.125920 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:54:44.125920 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:54:44.125920 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:54:44.125920 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:54:44.125920 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:54:44.125920 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:54:44.125920 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:54:44.125920 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:54:44.125920 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 917274da-5116-42df-84b5-a30b85d40913 could not be found. Oct 04 20:54:44.125920 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:54:44.125920 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:54:44.125920 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:54:44.125920 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:54:44.125920 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:54:44.125920 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:54:44.125920 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:54:44.125920 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:54:44.125920 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:54:44.125920 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:54:44.125920 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:54:44.125920 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:54:44.125920 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:54:44.125920 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:54:44.125920 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:54:44.125920 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:54:44.125920 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 917274da-5116-42df-84b5-a30b85d40913 could not be found. Oct 04 20:54:44.125920 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:54:44.125920 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:54:44.125920 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:54:44.130303 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:54:44.130303 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:54:44.130303 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:54:44.130303 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:54:44.130303 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:54:44.130303 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 917274da-5116-42df-84b5-a30b85d40913 could not be found. Oct 04 20:54:44.130303 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:54:44.130960 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-a0592327-0295-4abb-9fa4-87dac0eef132 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Returning 404 to user: Instance 917274da-5116-42df-84b5-a30b85d40913 could not be found. {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:54:44.132396 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-a0592327-0295-4abb-9fa4-87dac0eef132 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] 10.222.0.33 "GET /compute/v2.1/servers/917274da-5116-42df-84b5-a30b85d40913" status: 404 len: 111 microversion: 2.1 time: 0.086461 Oct 04 20:54:44.137132 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2155/4261] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:54:44 2022] GET /compute/v2.1/servers/917274da-5116-42df-84b5-a30b85d40913 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:54:44.142849 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-2f3daaa3-a067-455b-9e1f-79520a74d69d tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:44.143765 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-2f3daaa3-a067-455b-9e1f-79520a74d69d tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] [instance: 601e4070-a868-49c6-b935-87eeeac4a826] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:44.163757 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2f3daaa3-a067-455b-9e1f-79520a74d69d tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:44.165733 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2f3daaa3-a067-455b-9e1f-79520a74d69d tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:44.166641 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2f3daaa3-a067-455b-9e1f-79520a74d69d tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:44.170686 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2f3daaa3-a067-455b-9e1f-79520a74d69d tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:44.171749 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2f3daaa3-a067-455b-9e1f-79520a74d69d tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:44.173131 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2f3daaa3-a067-455b-9e1f-79520a74d69d tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:44.228003 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-ab9f7da3-de7e-4af9-a3ab-c6a2b30e690b tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e93855201ca64c779f92a2a33979b81f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed328a1e964d46902dee5e1c7c7b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:44.239917 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ab9f7da3-de7e-4af9-a3ab-c6a2b30e690b tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] 10.222.0.33 "GET /compute/v2.1/servers/67656ca4-09a7-4e6b-bf3a-cfcd254e99e4" status: 200 len: 1276 microversion: 2.1 time: 0.685448 Oct 04 20:54:44.240499 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2107/4262] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:54:43 2022] GET /compute/v2.1/servers/67656ca4-09a7-4e6b-bf3a-cfcd254e99e4 => generated 1276 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:54:44.261372 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8e626b1e-9510-4e87-89da-cfd4077d39ab tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:44.261372 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-8e626b1e-9510-4e87-89da-cfd4077d39ab tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] [instance: be75ea00-7ffd-4b23-8a70-d16175082cdf] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:44.284962 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8e626b1e-9510-4e87-89da-cfd4077d39ab tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:44.285465 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8e626b1e-9510-4e87-89da-cfd4077d39ab tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:44.288082 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8e626b1e-9510-4e87-89da-cfd4077d39ab tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:44.289095 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8e626b1e-9510-4e87-89da-cfd4077d39ab tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:44.291924 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8e626b1e-9510-4e87-89da-cfd4077d39ab tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:44.292573 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8e626b1e-9510-4e87-89da-cfd4077d39ab tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:44.329916 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-8e626b1e-9510-4e87-89da-cfd4077d39ab tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] HTTP exception thrown: Instance be75ea00-7ffd-4b23-8a70-d16175082cdf could not be found. Oct 04 20:54:44.331704 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8e626b1e-9510-4e87-89da-cfd4077d39ab tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Request method failure captured: Oct 04 20:54:44.331704 n-d-854823-8 devstack@n-api.service[128801]: request: DELETE /compute/v2.1/servers/be75ea00-7ffd-4b23-8a70-d16175082cdf HTTP/1.1 Oct 04 20:54:44.331704 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:54:44.331704 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:54:44.331704 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:54:44.331704 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 0 Oct 04 20:54:44.331704 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:54:44.331704 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:54:44.331704 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:54:44.331704 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:54:44.331704 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJxSZfevtBVnbE8xQF7FYm_FMbZNMYv-b1P0ldR6C6mOlBxOPHbcbefhyrqwXR1yI98_OYaoilQwhW17vvL2mv1TUMfEjVB0p9Z8xi6fxjKTzjqbSmmUYZRpw0KKdt3nuXH8mFLFoxIXJdxlVC2R9xsCLdqsVxY0fb8-x4eIUN27OLA Oct 04 20:54:44.331704 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:54:44.331704 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:54:44.331704 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:54:44.331704 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:54:44.331704 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:54:44.331704 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:54:44.331704 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: 82ae4960393c464c97669731c2084d0f Oct 04 20:54:44.331704 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-DeleteServersTestJSON-364705212 Oct 04 20:54:44.331704 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 20:54:44.331704 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 20:54:44.331704 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_82ae4960393c464c97669731c2084d0f", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/82ae4960393c464c97669731c2084d0f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/82ae4960393c464c97669731c2084d0f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/82ae4960393c464c97669731c2084d0f"}]}] Oct 04 20:54:44.331704 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-DeleteServersTestJSON-364705212 Oct 04 20:54:44.331704 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: 82ae4960393c464c97669731c2084d0f Oct 04 20:54:44.331704 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-DeleteServersTestJSON-364705212 Oct 04 20:54:44.331704 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-DeleteServersTestJSON-364705212-project Oct 04 20:54:44.331704 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:54:44.331704 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:54:44.331704 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: e2c208ec9faf491385a9ab5b5932098d Oct 04 20:54:44.331704 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-DeleteServersTestJSON-364705212-project Oct 04 20:54:44.331704 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 20:54:44.331704 n-d-854823-8 devstack@n-api.service[128801]: exception: Instance be75ea00-7ffd-4b23-8a70-d16175082cdf could not be found. Oct 04 20:54:44.331704 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': 'be75ea00-7ffd-4b23-8a70-d16175082cdf'} Oct 04 20:54:44.331704 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:54:44.331704 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:54:44.331704 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:54:44.331704 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:54:44.331704 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:54:44.331704 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:54:44.331704 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:54:44.331704 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:54:44.331704 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:54:44.331704 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:54:44.331704 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be75ea00-7ffd-4b23-8a70-d16175082cdf could not be found. Oct 04 20:54:44.331704 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:54:44.331704 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:54:44.331704 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:54:44.331704 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:54:44.331704 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:54:44.331704 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:54:44.331704 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:54:44.331704 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:54:44.331704 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:54:44.331704 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:54:44.331704 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 20:54:44.331704 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 20:54:44.331704 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 20:54:44.331704 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 20:54:44.331704 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:54:44.331704 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:54:44.331704 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:54:44.331704 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:54:44.335726 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be75ea00-7ffd-4b23-8a70-d16175082cdf could not be found. Oct 04 20:54:44.335726 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:54:44.335726 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:54:44.335726 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:54:44.335726 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:54:44.335726 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:54:44.335726 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:54:44.335726 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:54:44.335726 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:54:44.335726 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be75ea00-7ffd-4b23-8a70-d16175082cdf could not be found. Oct 04 20:54:44.335726 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:54:44.360000 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8e626b1e-9510-4e87-89da-cfd4077d39ab tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Returning 404 to user: Instance be75ea00-7ffd-4b23-8a70-d16175082cdf could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:54:44.360753 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-8e626b1e-9510-4e87-89da-cfd4077d39ab tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] 10.222.0.33 "DELETE /compute/v2.1/servers/be75ea00-7ffd-4b23-8a70-d16175082cdf" status: 404 len: 111 microversion: 2.1 time: 0.109181 Oct 04 20:54:44.366495 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2108/4263] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 20:54:44 2022] DELETE /compute/v2.1/servers/be75ea00-7ffd-4b23-8a70-d16175082cdf => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:54:44.377293 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5f0114c0-9720-4fa0-aeb2-38f78e813f73 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:44.377913 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-5f0114c0-9720-4fa0-aeb2-38f78e813f73 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] [instance: be75ea00-7ffd-4b23-8a70-d16175082cdf] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:44.411642 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5f0114c0-9720-4fa0-aeb2-38f78e813f73 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:44.412151 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5f0114c0-9720-4fa0-aeb2-38f78e813f73 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:44.412587 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5f0114c0-9720-4fa0-aeb2-38f78e813f73 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:44.413299 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5f0114c0-9720-4fa0-aeb2-38f78e813f73 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:44.413755 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5f0114c0-9720-4fa0-aeb2-38f78e813f73 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:44.414177 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5f0114c0-9720-4fa0-aeb2-38f78e813f73 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:44.459890 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-2f3daaa3-a067-455b-9e1f-79520a74d69d tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4adee36830c640919981ae58bd326157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '589fcee1949d4820a8958ec55ce4b43a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:44.480447 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-5f0114c0-9720-4fa0-aeb2-38f78e813f73 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] HTTP exception thrown: Instance be75ea00-7ffd-4b23-8a70-d16175082cdf could not be found. Oct 04 20:54:44.481638 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-2f3daaa3-a067-455b-9e1f-79520a74d69d tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4adee36830c640919981ae58bd326157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '589fcee1949d4820a8958ec55ce4b43a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:44.492375 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-2f3daaa3-a067-455b-9e1f-79520a74d69d tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4adee36830c640919981ae58bd326157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '589fcee1949d4820a8958ec55ce4b43a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:44.499497 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5f0114c0-9720-4fa0-aeb2-38f78e813f73 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Request method failure captured: Oct 04 20:54:44.499497 n-d-854823-8 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/be75ea00-7ffd-4b23-8a70-d16175082cdf HTTP/1.1 Oct 04 20:54:44.499497 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:54:44.499497 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:54:44.499497 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:54:44.499497 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 0 Oct 04 20:54:44.499497 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:54:44.499497 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:54:44.499497 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:54:44.499497 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:54:44.499497 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJxSZfevtBVnbE8xQF7FYm_FMbZNMYv-b1P0ldR6C6mOlBxOPHbcbefhyrqwXR1yI98_OYaoilQwhW17vvL2mv1TUMfEjVB0p9Z8xi6fxjKTzjqbSmmUYZRpw0KKdt3nuXH8mFLFoxIXJdxlVC2R9xsCLdqsVxY0fb8-x4eIUN27OLA Oct 04 20:54:44.499497 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:54:44.499497 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:54:44.499497 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:54:44.499497 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:54:44.499497 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:54:44.499497 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:54:44.499497 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: 82ae4960393c464c97669731c2084d0f Oct 04 20:54:44.499497 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-DeleteServersTestJSON-364705212 Oct 04 20:54:44.499497 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 20:54:44.499497 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 20:54:44.499497 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_82ae4960393c464c97669731c2084d0f", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/82ae4960393c464c97669731c2084d0f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/82ae4960393c464c97669731c2084d0f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/82ae4960393c464c97669731c2084d0f"}]}] Oct 04 20:54:44.499497 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-DeleteServersTestJSON-364705212 Oct 04 20:54:44.499497 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: 82ae4960393c464c97669731c2084d0f Oct 04 20:54:44.499497 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-DeleteServersTestJSON-364705212 Oct 04 20:54:44.499497 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-DeleteServersTestJSON-364705212-project Oct 04 20:54:44.499497 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:54:44.499497 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:54:44.499497 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: e2c208ec9faf491385a9ab5b5932098d Oct 04 20:54:44.499497 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-DeleteServersTestJSON-364705212-project Oct 04 20:54:44.499497 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 20:54:44.499497 n-d-854823-8 devstack@n-api.service[128801]: exception: Instance be75ea00-7ffd-4b23-8a70-d16175082cdf could not be found. Oct 04 20:54:44.499497 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': 'be75ea00-7ffd-4b23-8a70-d16175082cdf'} Oct 04 20:54:44.499497 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:54:44.499497 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:54:44.499497 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:54:44.499497 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:54:44.499497 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:54:44.499497 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:54:44.499497 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:54:44.499497 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:54:44.499497 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:54:44.499497 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:54:44.499497 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be75ea00-7ffd-4b23-8a70-d16175082cdf could not be found. Oct 04 20:54:44.499497 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:54:44.499497 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:54:44.499497 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:54:44.499497 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:54:44.499497 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:54:44.499497 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:54:44.499497 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:54:44.499497 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:54:44.499497 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:54:44.499497 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:54:44.499497 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:54:44.499497 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:54:44.499497 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:54:44.499497 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:54:44.499497 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:54:44.499497 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:54:44.499497 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be75ea00-7ffd-4b23-8a70-d16175082cdf could not be found. Oct 04 20:54:44.499497 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:54:44.499497 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:54:44.499497 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:54:44.504051 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:54:44.504051 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:54:44.504051 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:54:44.504051 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:54:44.504051 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:54:44.504051 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be75ea00-7ffd-4b23-8a70-d16175082cdf could not be found. Oct 04 20:54:44.504051 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:54:44.505583 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5f0114c0-9720-4fa0-aeb2-38f78e813f73 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] Returning 404 to user: Instance be75ea00-7ffd-4b23-8a70-d16175082cdf could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:54:44.508560 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5f0114c0-9720-4fa0-aeb2-38f78e813f73 tempest-DeleteServersTestJSON-364705212 tempest-DeleteServersTestJSON-364705212-project] 10.222.0.33 "GET /compute/v2.1/servers/be75ea00-7ffd-4b23-8a70-d16175082cdf" status: 404 len: 111 microversion: 2.1 time: 0.136841 Oct 04 20:54:44.510643 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2109/4264] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:54:44 2022] GET /compute/v2.1/servers/be75ea00-7ffd-4b23-8a70-d16175082cdf => generated 111 bytes in 139 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 20:54:44.514292 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-2f3daaa3-a067-455b-9e1f-79520a74d69d tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] 10.222.0.33 "GET /compute/v2.1/servers/601e4070-a868-49c6-b935-87eeeac4a826" status: 200 len: 1329 microversion: 2.47 time: 0.356708 Oct 04 20:54:44.518659 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2156/4265] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:54:44 2022] GET /compute/v2.1/servers/601e4070-a868-49c6-b935-87eeeac4a826 => generated 1329 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:54:45.268969 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b2d147e0-344c-4bb7-9a8d-0d04a5a43758 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:45.269558 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b2d147e0-344c-4bb7-9a8d-0d04a5a43758 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] [instance: 67656ca4-09a7-4e6b-bf3a-cfcd254e99e4] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:45.278445 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b2d147e0-344c-4bb7-9a8d-0d04a5a43758 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:45.282364 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b2d147e0-344c-4bb7-9a8d-0d04a5a43758 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:45.283799 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b2d147e0-344c-4bb7-9a8d-0d04a5a43758 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:45.284562 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b2d147e0-344c-4bb7-9a8d-0d04a5a43758 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:45.285026 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b2d147e0-344c-4bb7-9a8d-0d04a5a43758 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:45.288531 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b2d147e0-344c-4bb7-9a8d-0d04a5a43758 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:45.452174 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-b2d147e0-344c-4bb7-9a8d-0d04a5a43758 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e93855201ca64c779f92a2a33979b81f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed328a1e964d46902dee5e1c7c7b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:45.463944 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b2d147e0-344c-4bb7-9a8d-0d04a5a43758 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] 10.222.0.33 "GET /compute/v2.1/servers/67656ca4-09a7-4e6b-bf3a-cfcd254e99e4" status: 200 len: 1276 microversion: 2.1 time: 0.198777 Oct 04 20:54:45.465072 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2110/4266] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:54:45 2022] GET /compute/v2.1/servers/67656ca4-09a7-4e6b-bf3a-cfcd254e99e4 => generated 1276 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:54:45.546417 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-b9386ed4-5bd8-4866-9bfe-bd8c68861d93 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:45.547172 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-b9386ed4-5bd8-4866-9bfe-bd8c68861d93 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] [instance: 601e4070-a868-49c6-b935-87eeeac4a826] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:45.566613 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b9386ed4-5bd8-4866-9bfe-bd8c68861d93 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:45.567120 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b9386ed4-5bd8-4866-9bfe-bd8c68861d93 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:45.567572 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b9386ed4-5bd8-4866-9bfe-bd8c68861d93 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:45.568305 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b9386ed4-5bd8-4866-9bfe-bd8c68861d93 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:45.568773 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b9386ed4-5bd8-4866-9bfe-bd8c68861d93 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:45.569533 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b9386ed4-5bd8-4866-9bfe-bd8c68861d93 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:45.727088 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-b9386ed4-5bd8-4866-9bfe-bd8c68861d93 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4adee36830c640919981ae58bd326157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '589fcee1949d4820a8958ec55ce4b43a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:45.739557 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-b9386ed4-5bd8-4866-9bfe-bd8c68861d93 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4adee36830c640919981ae58bd326157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '589fcee1949d4820a8958ec55ce4b43a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:45.741684 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-b9386ed4-5bd8-4866-9bfe-bd8c68861d93 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4adee36830c640919981ae58bd326157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '589fcee1949d4820a8958ec55ce4b43a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:45.743822 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-b9386ed4-5bd8-4866-9bfe-bd8c68861d93 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] 10.222.0.33 "GET /compute/v2.1/servers/601e4070-a868-49c6-b935-87eeeac4a826" status: 200 len: 1335 microversion: 2.47 time: 0.200548 Oct 04 20:54:45.745510 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2157/4267] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:54:45 2022] GET /compute/v2.1/servers/601e4070-a868-49c6-b935-87eeeac4a826 => generated 1335 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:54:46.501749 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-66bf1e21-e61c-4f4a-91f1-711c8695b8be tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:46.504554 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-66bf1e21-e61c-4f4a-91f1-711c8695b8be tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] [instance: 67656ca4-09a7-4e6b-bf3a-cfcd254e99e4] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:46.523323 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-66bf1e21-e61c-4f4a-91f1-711c8695b8be tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:46.525923 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-66bf1e21-e61c-4f4a-91f1-711c8695b8be tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:46.527969 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-66bf1e21-e61c-4f4a-91f1-711c8695b8be tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:46.529647 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-66bf1e21-e61c-4f4a-91f1-711c8695b8be tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:46.530770 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-66bf1e21-e61c-4f4a-91f1-711c8695b8be tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:46.532171 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-66bf1e21-e61c-4f4a-91f1-711c8695b8be tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:46.581717 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:54:46.781005 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-85f229dc-2ef8-498d-a442-8cc97fab4bb3 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:46.782516 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-85f229dc-2ef8-498d-a442-8cc97fab4bb3 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] [instance: 601e4070-a868-49c6-b935-87eeeac4a826] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:46.795475 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-85f229dc-2ef8-498d-a442-8cc97fab4bb3 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:46.801958 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-85f229dc-2ef8-498d-a442-8cc97fab4bb3 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:46.802307 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-85f229dc-2ef8-498d-a442-8cc97fab4bb3 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:46.803104 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-85f229dc-2ef8-498d-a442-8cc97fab4bb3 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:46.803570 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-85f229dc-2ef8-498d-a442-8cc97fab4bb3 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:46.804000 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-85f229dc-2ef8-498d-a442-8cc97fab4bb3 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:46.850227 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:54:46.963716 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-85f229dc-2ef8-498d-a442-8cc97fab4bb3 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4adee36830c640919981ae58bd326157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '589fcee1949d4820a8958ec55ce4b43a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:46.972340 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-85f229dc-2ef8-498d-a442-8cc97fab4bb3 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4adee36830c640919981ae58bd326157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '589fcee1949d4820a8958ec55ce4b43a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:46.974415 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-85f229dc-2ef8-498d-a442-8cc97fab4bb3 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4adee36830c640919981ae58bd326157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '589fcee1949d4820a8958ec55ce4b43a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:46.975968 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-85f229dc-2ef8-498d-a442-8cc97fab4bb3 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] 10.222.0.33 "GET /compute/v2.1/servers/601e4070-a868-49c6-b935-87eeeac4a826" status: 200 len: 1335 microversion: 2.47 time: 0.200037 Oct 04 20:54:46.991455 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2158/4268] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:54:46 2022] GET /compute/v2.1/servers/601e4070-a868-49c6-b935-87eeeac4a826 => generated 1335 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:54:47.046093 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-66bf1e21-e61c-4f4a-91f1-711c8695b8be tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e93855201ca64c779f92a2a33979b81f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed328a1e964d46902dee5e1c7c7b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:47.075738 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-66bf1e21-e61c-4f4a-91f1-711c8695b8be tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] 10.222.0.33 "GET /compute/v2.1/servers/67656ca4-09a7-4e6b-bf3a-cfcd254e99e4" status: 200 len: 1318 microversion: 2.1 time: 0.589803 Oct 04 20:54:47.077793 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2111/4269] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:54:46 2022] GET /compute/v2.1/servers/67656ca4-09a7-4e6b-bf3a-cfcd254e99e4 => generated 1318 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:54:48.004220 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-ffa55aea-c8f8-4ea4-8cd5-7b207f08bffc tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:48.004839 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-ffa55aea-c8f8-4ea4-8cd5-7b207f08bffc tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] [instance: 601e4070-a868-49c6-b935-87eeeac4a826] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:48.021246 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ffa55aea-c8f8-4ea4-8cd5-7b207f08bffc tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:48.021741 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ffa55aea-c8f8-4ea4-8cd5-7b207f08bffc tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:48.022184 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ffa55aea-c8f8-4ea4-8cd5-7b207f08bffc tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:48.027240 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ffa55aea-c8f8-4ea4-8cd5-7b207f08bffc tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:48.027767 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ffa55aea-c8f8-4ea4-8cd5-7b207f08bffc tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:48.028215 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ffa55aea-c8f8-4ea4-8cd5-7b207f08bffc tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:48.102240 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8d075aa1-78e8-4654-95ca-06a3a0b1034e tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:48.104488 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-8d075aa1-78e8-4654-95ca-06a3a0b1034e tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] [instance: 67656ca4-09a7-4e6b-bf3a-cfcd254e99e4] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:48.116448 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8d075aa1-78e8-4654-95ca-06a3a0b1034e tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:48.117391 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8d075aa1-78e8-4654-95ca-06a3a0b1034e tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:48.118686 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8d075aa1-78e8-4654-95ca-06a3a0b1034e tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:48.119625 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8d075aa1-78e8-4654-95ca-06a3a0b1034e tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:48.120814 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8d075aa1-78e8-4654-95ca-06a3a0b1034e tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:48.121469 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8d075aa1-78e8-4654-95ca-06a3a0b1034e tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:48.344455 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-ffa55aea-c8f8-4ea4-8cd5-7b207f08bffc tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4adee36830c640919981ae58bd326157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '589fcee1949d4820a8958ec55ce4b43a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:48.360193 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-ffa55aea-c8f8-4ea4-8cd5-7b207f08bffc tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4adee36830c640919981ae58bd326157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '589fcee1949d4820a8958ec55ce4b43a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:48.361830 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-ffa55aea-c8f8-4ea4-8cd5-7b207f08bffc tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4adee36830c640919981ae58bd326157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '589fcee1949d4820a8958ec55ce4b43a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:48.363078 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-ffa55aea-c8f8-4ea4-8cd5-7b207f08bffc tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] 10.222.0.33 "GET /compute/v2.1/servers/601e4070-a868-49c6-b935-87eeeac4a826" status: 200 len: 1356 microversion: 2.47 time: 0.362920 Oct 04 20:54:48.364769 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2159/4270] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:54:47 2022] GET /compute/v2.1/servers/601e4070-a868-49c6-b935-87eeeac4a826 => generated 1356 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:54:48.394076 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-36dd8c80-b947-4871-af0f-f4abe67a027a tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63"}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:54:48.397184 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-36dd8c80-b947-4871-af0f-f4abe67a027a tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] [instance: 601e4070-a868-49c6-b935-87eeeac4a826] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:48.411386 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-36dd8c80-b947-4871-af0f-f4abe67a027a tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:48.412127 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-36dd8c80-b947-4871-af0f-f4abe67a027a tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:48.412733 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-36dd8c80-b947-4871-af0f-f4abe67a027a tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:48.413619 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-36dd8c80-b947-4871-af0f-f4abe67a027a tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:48.414231 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-36dd8c80-b947-4871-af0f-f4abe67a027a tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:48.417729 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-36dd8c80-b947-4871-af0f-f4abe67a027a tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:48.623333 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-36dd8c80-b947-4871-af0f-f4abe67a027a tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Flavor limits 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:54:48.624271 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-36dd8c80-b947-4871-af0f-f4abe67a027a tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Image limits 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:54:48.625003 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-36dd8c80-b947-4871-af0f-f4abe67a027a tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Flavor pref 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:54:48.625607 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-36dd8c80-b947-4871-af0f-f4abe67a027a tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Image pref 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:54:48.626464 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-36dd8c80-b947-4871-af0f-f4abe67a027a tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:54:48.630560 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-8d075aa1-78e8-4654-95ca-06a3a0b1034e tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e93855201ca64c779f92a2a33979b81f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed328a1e964d46902dee5e1c7c7b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:48.641357 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-8d075aa1-78e8-4654-95ca-06a3a0b1034e tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] 10.222.0.33 "GET /compute/v2.1/servers/67656ca4-09a7-4e6b-bf3a-cfcd254e99e4" status: 200 len: 1318 microversion: 2.1 time: 0.543961 Oct 04 20:54:48.645510 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2112/4271] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:54:48 2022] GET /compute/v2.1/servers/67656ca4-09a7-4e6b-bf3a-cfcd254e99e4 => generated 1318 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:54:48.658732 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-19156a89-faa7-4549-bce5-c40d3afb6e62 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:48.659371 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-19156a89-faa7-4549-bce5-c40d3afb6e62 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] [instance: 866d0dd3-3c7e-4612-a132-48eb83ec2d16] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:48.672301 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-19156a89-faa7-4549-bce5-c40d3afb6e62 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:48.675479 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-19156a89-faa7-4549-bce5-c40d3afb6e62 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:48.676201 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-19156a89-faa7-4549-bce5-c40d3afb6e62 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:48.677121 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-19156a89-faa7-4549-bce5-c40d3afb6e62 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:48.677779 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-19156a89-faa7-4549-bce5-c40d3afb6e62 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:48.680267 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-19156a89-faa7-4549-bce5-c40d3afb6e62 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:48.728263 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-36dd8c80-b947-4871-af0f-f4abe67a027a tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] [instance: 601e4070-a868-49c6-b935-87eeeac4a826] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:48.736413 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-36dd8c80-b947-4871-af0f-f4abe67a027a tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:48.738604 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-36dd8c80-b947-4871-af0f-f4abe67a027a tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:48.740233 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-36dd8c80-b947-4871-af0f-f4abe67a027a tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:48.742635 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-36dd8c80-b947-4871-af0f-f4abe67a027a tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:48.744773 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-36dd8c80-b947-4871-af0f-f4abe67a027a tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:48.746258 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-36dd8c80-b947-4871-af0f-f4abe67a027a tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:48.797449 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-36dd8c80-b947-4871-af0f-f4abe67a027a tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] 10.222.0.33 "POST /compute/v2.1/servers/601e4070-a868-49c6-b935-87eeeac4a826/action" status: 202 len: 1078 microversion: 2.47 time: 0.407296 Oct 04 20:54:48.798588 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2160/4272] 10.222.0.33 () {62 vars in 1319 bytes} [Tue Oct 4 20:54:48 2022] POST /compute/v2.1/servers/601e4070-a868-49c6-b935-87eeeac4a826/action => generated 1078 bytes in 409 msecs (HTTP/1.1 202) 10 headers in 454 bytes (2 switches on core 0) Oct 04 20:54:48.822138 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-4e742f6a-1f32-4406-b09d-b2e3ace84abb tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:48.822327 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-4e742f6a-1f32-4406-b09d-b2e3ace84abb tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] [instance: 601e4070-a868-49c6-b935-87eeeac4a826] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:48.830054 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4e742f6a-1f32-4406-b09d-b2e3ace84abb tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:48.831137 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4e742f6a-1f32-4406-b09d-b2e3ace84abb tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:48.831734 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4e742f6a-1f32-4406-b09d-b2e3ace84abb tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:48.833107 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4e742f6a-1f32-4406-b09d-b2e3ace84abb tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:48.833107 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4e742f6a-1f32-4406-b09d-b2e3ace84abb tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:48.833523 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4e742f6a-1f32-4406-b09d-b2e3ace84abb tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:48.916609 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-19156a89-faa7-4549-bce5-c40d3afb6e62 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lazy-loading 'services' on Instance uuid 866d0dd3-3c7e-4612-a132-48eb83ec2d16 {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:54:49.064576 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-19156a89-faa7-4549-bce5-c40d3afb6e62 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] 10.222.0.33 "DELETE /compute/v2.1/servers/866d0dd3-3c7e-4612-a132-48eb83ec2d16/os-volume_attachments/1ac5db40-fbff-4fe2-b7f4-28962356d9f9" status: 202 len: 0 microversion: 2.1 time: 0.416874 Oct 04 20:54:49.065868 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2113/4273] 10.222.0.33 () {58 vars in 1416 bytes} [Tue Oct 4 20:54:48 2022] DELETE /compute/v2.1/servers/866d0dd3-3c7e-4612-a132-48eb83ec2d16/os-volume_attachments/1ac5db40-fbff-4fe2-b7f4-28962356d9f9 => generated 0 bytes in 420 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:54:49.100602 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-eb7978c2-53f9-4e77-8e04-d7916c84dfac req-c4c8f736-b6ff-4426-aa07-f93f5a4a5a3b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "67656ca4-09a7-4e6b-bf3a-cfcd254e99e4", "tag": "520b47f9-ca55-4bc2-99bd-5d338296bb06"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:54:49.116235 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-eb7978c2-53f9-4e77-8e04-d7916c84dfac req-c4c8f736-b6ff-4426-aa07-f93f5a4a5a3b service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:49.119318 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-eb7978c2-53f9-4e77-8e04-d7916c84dfac req-c4c8f736-b6ff-4426-aa07-f93f5a4a5a3b service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:49.119946 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-eb7978c2-53f9-4e77-8e04-d7916c84dfac req-c4c8f736-b6ff-4426-aa07-f93f5a4a5a3b service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:49.137909 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-eb7978c2-53f9-4e77-8e04-d7916c84dfac req-c4c8f736-b6ff-4426-aa07-f93f5a4a5a3b service nova] Creating event network-changed:520b47f9-ca55-4bc2-99bd-5d338296bb06 for instance 67656ca4-09a7-4e6b-bf3a-cfcd254e99e4 on n-h2-854823-8 Oct 04 20:54:49.153717 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-eb7978c2-53f9-4e77-8e04-d7916c84dfac req-c4c8f736-b6ff-4426-aa07-f93f5a4a5a3b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085799 Oct 04 20:54:49.155023 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2114/4274] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:54:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:54:49.163040 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c0fa1e20-85a2-4c2a-9254-0f44c935ea9e tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:49.166026 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c0fa1e20-85a2-4c2a-9254-0f44c935ea9e tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] [instance: 866d0dd3-3c7e-4612-a132-48eb83ec2d16] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:49.186737 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c0fa1e20-85a2-4c2a-9254-0f44c935ea9e tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:49.188160 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c0fa1e20-85a2-4c2a-9254-0f44c935ea9e tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:49.188790 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c0fa1e20-85a2-4c2a-9254-0f44c935ea9e tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:49.190132 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c0fa1e20-85a2-4c2a-9254-0f44c935ea9e tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:49.191249 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c0fa1e20-85a2-4c2a-9254-0f44c935ea9e tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:49.192329 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c0fa1e20-85a2-4c2a-9254-0f44c935ea9e tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:49.326444 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c0fa1e20-85a2-4c2a-9254-0f44c935ea9e tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] 10.222.0.33 "GET /compute/v2.1/servers/866d0dd3-3c7e-4612-a132-48eb83ec2d16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.164071 Oct 04 20:54:49.328167 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2115/4275] 10.222.0.33 () {58 vars in 1302 bytes} [Tue Oct 4 20:54:49 2022] GET /compute/v2.1/servers/866d0dd3-3c7e-4612-a132-48eb83ec2d16/os-volume_attachments => generated 197 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:54:49.474390 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-4e742f6a-1f32-4406-b09d-b2e3ace84abb tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4adee36830c640919981ae58bd326157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '589fcee1949d4820a8958ec55ce4b43a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:49.485962 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-4e742f6a-1f32-4406-b09d-b2e3ace84abb tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4adee36830c640919981ae58bd326157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '589fcee1949d4820a8958ec55ce4b43a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:49.493522 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-4e742f6a-1f32-4406-b09d-b2e3ace84abb tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4adee36830c640919981ae58bd326157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '589fcee1949d4820a8958ec55ce4b43a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:49.501830 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-4e742f6a-1f32-4406-b09d-b2e3ace84abb tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] 10.222.0.33 "GET /compute/v2.1/servers/601e4070-a868-49c6-b935-87eeeac4a826" status: 200 len: 1365 microversion: 2.47 time: 0.685323 Oct 04 20:54:49.502761 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2161/4276] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:54:48 2022] GET /compute/v2.1/servers/601e4070-a868-49c6-b935-87eeeac4a826 => generated 1365 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:54:49.673460 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-4fe2c95c-a596-46b3-a68a-6212f1e54171 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:49.674079 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-4fe2c95c-a596-46b3-a68a-6212f1e54171 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] [instance: 67656ca4-09a7-4e6b-bf3a-cfcd254e99e4] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:49.683649 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4fe2c95c-a596-46b3-a68a-6212f1e54171 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:49.684146 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4fe2c95c-a596-46b3-a68a-6212f1e54171 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:49.684580 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4fe2c95c-a596-46b3-a68a-6212f1e54171 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:49.691154 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4fe2c95c-a596-46b3-a68a-6212f1e54171 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:49.691154 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4fe2c95c-a596-46b3-a68a-6212f1e54171 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:49.691154 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4fe2c95c-a596-46b3-a68a-6212f1e54171 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:50.294284 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-4fe2c95c-a596-46b3-a68a-6212f1e54171 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e93855201ca64c779f92a2a33979b81f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed328a1e964d46902dee5e1c7c7b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:50.303507 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-4fe2c95c-a596-46b3-a68a-6212f1e54171 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] 10.222.0.33 "GET /compute/v2.1/servers/67656ca4-09a7-4e6b-bf3a-cfcd254e99e4" status: 200 len: 1318 microversion: 2.1 time: 0.634770 Oct 04 20:54:50.318475 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2116/4277] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:54:49 2022] GET /compute/v2.1/servers/67656ca4-09a7-4e6b-bf3a-cfcd254e99e4 => generated 1318 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:54:50.341184 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-d51c1f97-aa11-444e-9c03-6b5133db0705 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:50.344120 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-d51c1f97-aa11-444e-9c03-6b5133db0705 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] [instance: 866d0dd3-3c7e-4612-a132-48eb83ec2d16] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:50.346890 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell0:SELECT=2 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:54:50.367917 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d51c1f97-aa11-444e-9c03-6b5133db0705 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:50.368452 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d51c1f97-aa11-444e-9c03-6b5133db0705 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:50.368898 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d51c1f97-aa11-444e-9c03-6b5133db0705 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:50.369620 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d51c1f97-aa11-444e-9c03-6b5133db0705 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:50.370078 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d51c1f97-aa11-444e-9c03-6b5133db0705 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:50.370541 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d51c1f97-aa11-444e-9c03-6b5133db0705 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:50.441986 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-d51c1f97-aa11-444e-9c03-6b5133db0705 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] 10.222.0.33 "GET /compute/v2.1/servers/866d0dd3-3c7e-4612-a132-48eb83ec2d16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.100493 Oct 04 20:54:50.448828 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2162/4278] 10.222.0.33 () {58 vars in 1302 bytes} [Tue Oct 4 20:54:50 2022] GET /compute/v2.1/servers/866d0dd3-3c7e-4612-a132-48eb83ec2d16/os-volume_attachments => generated 197 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:54:50.539651 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5e5e6ed0-9e83-4300-8c02-1e715714128d tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:50.540788 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-5e5e6ed0-9e83-4300-8c02-1e715714128d tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] [instance: 601e4070-a868-49c6-b935-87eeeac4a826] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:50.549791 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5e5e6ed0-9e83-4300-8c02-1e715714128d tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:50.554414 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5e5e6ed0-9e83-4300-8c02-1e715714128d tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:50.555268 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5e5e6ed0-9e83-4300-8c02-1e715714128d tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:50.556380 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5e5e6ed0-9e83-4300-8c02-1e715714128d tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:50.558562 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5e5e6ed0-9e83-4300-8c02-1e715714128d tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:50.562856 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5e5e6ed0-9e83-4300-8c02-1e715714128d tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:50.724311 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-5e5e6ed0-9e83-4300-8c02-1e715714128d tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4adee36830c640919981ae58bd326157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '589fcee1949d4820a8958ec55ce4b43a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:50.735438 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-5e5e6ed0-9e83-4300-8c02-1e715714128d tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4adee36830c640919981ae58bd326157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '589fcee1949d4820a8958ec55ce4b43a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:50.737254 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-5e5e6ed0-9e83-4300-8c02-1e715714128d tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4adee36830c640919981ae58bd326157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '589fcee1949d4820a8958ec55ce4b43a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:50.739715 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5e5e6ed0-9e83-4300-8c02-1e715714128d tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] 10.222.0.33 "GET /compute/v2.1/servers/601e4070-a868-49c6-b935-87eeeac4a826" status: 200 len: 1365 microversion: 2.47 time: 0.203785 Oct 04 20:54:50.757130 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2117/4279] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:54:50 2022] GET /compute/v2.1/servers/601e4070-a868-49c6-b935-87eeeac4a826 => generated 1365 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:54:51.347174 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-10e53b01-407a-4e42-b74d-e4025131432d tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:51.348526 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-10e53b01-407a-4e42-b74d-e4025131432d tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] [instance: 67656ca4-09a7-4e6b-bf3a-cfcd254e99e4] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:51.360903 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-10e53b01-407a-4e42-b74d-e4025131432d tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:51.361986 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-10e53b01-407a-4e42-b74d-e4025131432d tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:51.362927 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-10e53b01-407a-4e42-b74d-e4025131432d tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:51.364549 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-10e53b01-407a-4e42-b74d-e4025131432d tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:51.366720 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-10e53b01-407a-4e42-b74d-e4025131432d tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:51.367420 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-10e53b01-407a-4e42-b74d-e4025131432d tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:51.456328 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1b54a669-7214-4668-9479-fbaf3d88956b tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:51.458552 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-1b54a669-7214-4668-9479-fbaf3d88956b tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] [instance: 866d0dd3-3c7e-4612-a132-48eb83ec2d16] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:51.466162 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1b54a669-7214-4668-9479-fbaf3d88956b tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:51.466908 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1b54a669-7214-4668-9479-fbaf3d88956b tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:51.467535 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1b54a669-7214-4668-9479-fbaf3d88956b tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:51.468391 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1b54a669-7214-4668-9479-fbaf3d88956b tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:51.468994 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1b54a669-7214-4668-9479-fbaf3d88956b tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:51.469568 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1b54a669-7214-4668-9479-fbaf3d88956b tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:51.504622 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-1b54a669-7214-4668-9479-fbaf3d88956b tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] 10.222.0.33 "GET /compute/v2.1/servers/866d0dd3-3c7e-4612-a132-48eb83ec2d16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052173 Oct 04 20:54:51.505866 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2118/4280] 10.222.0.33 () {58 vars in 1302 bytes} [Tue Oct 4 20:54:51 2022] GET /compute/v2.1/servers/866d0dd3-3c7e-4612-a132-48eb83ec2d16/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:54:51.579310 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-10e53b01-407a-4e42-b74d-e4025131432d tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e93855201ca64c779f92a2a33979b81f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed328a1e964d46902dee5e1c7c7b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:51.592401 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-10e53b01-407a-4e42-b74d-e4025131432d tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] 10.222.0.33 "GET /compute/v2.1/servers/67656ca4-09a7-4e6b-bf3a-cfcd254e99e4" status: 200 len: 1318 microversion: 2.1 time: 0.252679 Oct 04 20:54:51.606374 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2163/4281] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:54:51 2022] GET /compute/v2.1/servers/67656ca4-09a7-4e6b-bf3a-cfcd254e99e4 => generated 1318 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:54:51.780574 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-028b573d-b64b-4133-a38a-3093c70dd408 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:51.781416 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-028b573d-b64b-4133-a38a-3093c70dd408 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] [instance: 601e4070-a868-49c6-b935-87eeeac4a826] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:51.794097 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-028b573d-b64b-4133-a38a-3093c70dd408 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:51.794901 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-028b573d-b64b-4133-a38a-3093c70dd408 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:51.795521 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-028b573d-b64b-4133-a38a-3093c70dd408 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:51.799535 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-028b573d-b64b-4133-a38a-3093c70dd408 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:51.800174 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-028b573d-b64b-4133-a38a-3093c70dd408 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:51.800761 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-028b573d-b64b-4133-a38a-3093c70dd408 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:52.096367 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-028b573d-b64b-4133-a38a-3093c70dd408 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4adee36830c640919981ae58bd326157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '589fcee1949d4820a8958ec55ce4b43a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:52.106271 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-028b573d-b64b-4133-a38a-3093c70dd408 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4adee36830c640919981ae58bd326157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '589fcee1949d4820a8958ec55ce4b43a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:52.116275 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-028b573d-b64b-4133-a38a-3093c70dd408 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4adee36830c640919981ae58bd326157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '589fcee1949d4820a8958ec55ce4b43a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:52.117516 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-028b573d-b64b-4133-a38a-3093c70dd408 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] 10.222.0.33 "GET /compute/v2.1/servers/601e4070-a868-49c6-b935-87eeeac4a826" status: 200 len: 1365 microversion: 2.47 time: 0.341316 Oct 04 20:54:52.131484 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2119/4282] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:54:51 2022] GET /compute/v2.1/servers/601e4070-a868-49c6-b935-87eeeac4a826 => generated 1365 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:54:52.518039 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-0e92589d-4692-49c7-ac1a-16b3ad633b68 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:52.520339 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-0e92589d-4692-49c7-ac1a-16b3ad633b68 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] [instance: 866d0dd3-3c7e-4612-a132-48eb83ec2d16] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:52.548589 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0e92589d-4692-49c7-ac1a-16b3ad633b68 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:52.549437 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0e92589d-4692-49c7-ac1a-16b3ad633b68 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:52.551267 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0e92589d-4692-49c7-ac1a-16b3ad633b68 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:52.561635 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0e92589d-4692-49c7-ac1a-16b3ad633b68 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:52.562948 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0e92589d-4692-49c7-ac1a-16b3ad633b68 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:52.564822 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0e92589d-4692-49c7-ac1a-16b3ad633b68 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:52.616863 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c8c6b906-b119-440a-b722-7b1385069b55 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:52.618191 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c8c6b906-b119-440a-b722-7b1385069b55 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] [instance: 67656ca4-09a7-4e6b-bf3a-cfcd254e99e4] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:52.620708 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=4 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:54:52.622141 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=16 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:54:52.647219 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c8c6b906-b119-440a-b722-7b1385069b55 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:52.648020 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c8c6b906-b119-440a-b722-7b1385069b55 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:52.651408 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c8c6b906-b119-440a-b722-7b1385069b55 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:52.652917 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c8c6b906-b119-440a-b722-7b1385069b55 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:52.657791 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c8c6b906-b119-440a-b722-7b1385069b55 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:52.659736 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c8c6b906-b119-440a-b722-7b1385069b55 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:52.662524 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-0e92589d-4692-49c7-ac1a-16b3ad633b68 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] 10.222.0.33 "GET /compute/v2.1/servers/866d0dd3-3c7e-4612-a132-48eb83ec2d16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.148758 Oct 04 20:54:52.663375 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2164/4283] 10.222.0.33 () {58 vars in 1302 bytes} [Tue Oct 4 20:54:52 2022] GET /compute/v2.1/servers/866d0dd3-3c7e-4612-a132-48eb83ec2d16/os-volume_attachments => generated 197 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:54:53.135729 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c8c6b906-b119-440a-b722-7b1385069b55 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e93855201ca64c779f92a2a33979b81f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed328a1e964d46902dee5e1c7c7b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:53.148528 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-74a5d8af-d236-4dc8-ae23-1d3fa35fc89e tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:53.149906 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-74a5d8af-d236-4dc8-ae23-1d3fa35fc89e tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] [instance: 601e4070-a868-49c6-b935-87eeeac4a826] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:53.152002 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c8c6b906-b119-440a-b722-7b1385069b55 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] 10.222.0.33 "GET /compute/v2.1/servers/67656ca4-09a7-4e6b-bf3a-cfcd254e99e4" status: 200 len: 1318 microversion: 2.1 time: 0.538331 Oct 04 20:54:53.154861 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2120/4284] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:54:52 2022] GET /compute/v2.1/servers/67656ca4-09a7-4e6b-bf3a-cfcd254e99e4 => generated 1318 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:54:53.159055 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell0:SELECT=8 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:54:53.160772 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-74a5d8af-d236-4dc8-ae23-1d3fa35fc89e tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:53.167428 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-74a5d8af-d236-4dc8-ae23-1d3fa35fc89e tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:53.168567 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-74a5d8af-d236-4dc8-ae23-1d3fa35fc89e tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:53.169489 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-74a5d8af-d236-4dc8-ae23-1d3fa35fc89e tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:53.170130 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-74a5d8af-d236-4dc8-ae23-1d3fa35fc89e tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:53.170588 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-74a5d8af-d236-4dc8-ae23-1d3fa35fc89e tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:53.360738 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-74a5d8af-d236-4dc8-ae23-1d3fa35fc89e tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4adee36830c640919981ae58bd326157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '589fcee1949d4820a8958ec55ce4b43a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:53.374831 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-74a5d8af-d236-4dc8-ae23-1d3fa35fc89e tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4adee36830c640919981ae58bd326157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '589fcee1949d4820a8958ec55ce4b43a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:53.381404 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-74a5d8af-d236-4dc8-ae23-1d3fa35fc89e tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4adee36830c640919981ae58bd326157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '589fcee1949d4820a8958ec55ce4b43a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:53.383147 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-74a5d8af-d236-4dc8-ae23-1d3fa35fc89e tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] 10.222.0.33 "GET /compute/v2.1/servers/601e4070-a868-49c6-b935-87eeeac4a826" status: 200 len: 1365 microversion: 2.47 time: 0.239074 Oct 04 20:54:53.384054 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2165/4285] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:54:53 2022] GET /compute/v2.1/servers/601e4070-a868-49c6-b935-87eeeac4a826 => generated 1365 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:54:53.674833 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e24f37c6-e541-43e9-ae14-02f310f5e854 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:53.677020 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e24f37c6-e541-43e9-ae14-02f310f5e854 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] [instance: 866d0dd3-3c7e-4612-a132-48eb83ec2d16] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:53.692970 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e24f37c6-e541-43e9-ae14-02f310f5e854 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:53.693448 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e24f37c6-e541-43e9-ae14-02f310f5e854 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:53.693871 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e24f37c6-e541-43e9-ae14-02f310f5e854 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:53.695114 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e24f37c6-e541-43e9-ae14-02f310f5e854 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:53.695114 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e24f37c6-e541-43e9-ae14-02f310f5e854 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:53.695437 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e24f37c6-e541-43e9-ae14-02f310f5e854 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:53.754248 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e24f37c6-e541-43e9-ae14-02f310f5e854 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] 10.222.0.33 "GET /compute/v2.1/servers/866d0dd3-3c7e-4612-a132-48eb83ec2d16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.083358 Oct 04 20:54:53.760149 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2121/4286] 10.222.0.33 () {58 vars in 1302 bytes} [Tue Oct 4 20:54:53 2022] GET /compute/v2.1/servers/866d0dd3-3c7e-4612-a132-48eb83ec2d16/os-volume_attachments => generated 197 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:54:54.176892 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-ff56c3dc-9179-41f8-ab59-def6748e83ea tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:54.178701 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-ff56c3dc-9179-41f8-ab59-def6748e83ea tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] [instance: 67656ca4-09a7-4e6b-bf3a-cfcd254e99e4] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:54.187167 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ff56c3dc-9179-41f8-ab59-def6748e83ea tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:54.189211 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ff56c3dc-9179-41f8-ab59-def6748e83ea tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:54.189998 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ff56c3dc-9179-41f8-ab59-def6748e83ea tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:54.190985 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ff56c3dc-9179-41f8-ab59-def6748e83ea tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:54.191637 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ff56c3dc-9179-41f8-ab59-def6748e83ea tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:54.192255 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ff56c3dc-9179-41f8-ab59-def6748e83ea tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:54.416214 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7446e8cf-a105-4fe8-bd0e-8a15ea3efda9 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:54.417090 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-7446e8cf-a105-4fe8-bd0e-8a15ea3efda9 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] [instance: 601e4070-a868-49c6-b935-87eeeac4a826] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:54.424795 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-ff56c3dc-9179-41f8-ab59-def6748e83ea tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e93855201ca64c779f92a2a33979b81f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed328a1e964d46902dee5e1c7c7b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:54.435436 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7446e8cf-a105-4fe8-bd0e-8a15ea3efda9 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:54.436274 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7446e8cf-a105-4fe8-bd0e-8a15ea3efda9 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:54.436720 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7446e8cf-a105-4fe8-bd0e-8a15ea3efda9 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:54.437437 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7446e8cf-a105-4fe8-bd0e-8a15ea3efda9 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:54.437893 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7446e8cf-a105-4fe8-bd0e-8a15ea3efda9 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:54.438315 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7446e8cf-a105-4fe8-bd0e-8a15ea3efda9 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:54.449344 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-ff56c3dc-9179-41f8-ab59-def6748e83ea tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] 10.222.0.33 "GET /compute/v2.1/servers/67656ca4-09a7-4e6b-bf3a-cfcd254e99e4" status: 200 len: 1318 microversion: 2.1 time: 0.276902 Oct 04 20:54:54.465585 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2166/4287] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:54:54 2022] GET /compute/v2.1/servers/67656ca4-09a7-4e6b-bf3a-cfcd254e99e4 => generated 1318 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:54:54.564102 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-7446e8cf-a105-4fe8-bd0e-8a15ea3efda9 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4adee36830c640919981ae58bd326157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '589fcee1949d4820a8958ec55ce4b43a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:54.574816 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-7446e8cf-a105-4fe8-bd0e-8a15ea3efda9 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4adee36830c640919981ae58bd326157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '589fcee1949d4820a8958ec55ce4b43a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:54.576789 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-7446e8cf-a105-4fe8-bd0e-8a15ea3efda9 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4adee36830c640919981ae58bd326157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '589fcee1949d4820a8958ec55ce4b43a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:54.579332 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-7446e8cf-a105-4fe8-bd0e-8a15ea3efda9 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] 10.222.0.33 "GET /compute/v2.1/servers/601e4070-a868-49c6-b935-87eeeac4a826" status: 200 len: 1365 microversion: 2.47 time: 0.166876 Oct 04 20:54:54.597590 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2122/4288] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:54:54 2022] GET /compute/v2.1/servers/601e4070-a868-49c6-b935-87eeeac4a826 => generated 1365 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 20:54:54.773616 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-40283b65-ab68-42d6-8b01-a2edab2d92c8 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:54.776432 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-40283b65-ab68-42d6-8b01-a2edab2d92c8 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] [instance: 866d0dd3-3c7e-4612-a132-48eb83ec2d16] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:54.788571 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-40283b65-ab68-42d6-8b01-a2edab2d92c8 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:54.793557 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-40283b65-ab68-42d6-8b01-a2edab2d92c8 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:54.794184 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-40283b65-ab68-42d6-8b01-a2edab2d92c8 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:54.796768 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-40283b65-ab68-42d6-8b01-a2edab2d92c8 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:54.797252 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-40283b65-ab68-42d6-8b01-a2edab2d92c8 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:54.797700 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-40283b65-ab68-42d6-8b01-a2edab2d92c8 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:54.842286 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-40283b65-ab68-42d6-8b01-a2edab2d92c8 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] 10.222.0.33 "GET /compute/v2.1/servers/866d0dd3-3c7e-4612-a132-48eb83ec2d16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.073857 Oct 04 20:54:54.847671 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2167/4289] 10.222.0.33 () {58 vars in 1302 bytes} [Tue Oct 4 20:54:54 2022] GET /compute/v2.1/servers/866d0dd3-3c7e-4612-a132-48eb83ec2d16/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:54:55.445208 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-85afa2e8-2ff6-4e02-831f-afa6a5b4da80 req-a759345e-5a53-40a6-9be4-ea890aee6a04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67656ca4-09a7-4e6b-bf3a-cfcd254e99e4", "name": "network-vif-plugged", "status": "completed", "tag": "520b47f9-ca55-4bc2-99bd-5d338296bb06"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:54:55.465519 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-85afa2e8-2ff6-4e02-831f-afa6a5b4da80 req-a759345e-5a53-40a6-9be4-ea890aee6a04 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:55.468784 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-85afa2e8-2ff6-4e02-831f-afa6a5b4da80 req-a759345e-5a53-40a6-9be4-ea890aee6a04 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:55.469639 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-85afa2e8-2ff6-4e02-831f-afa6a5b4da80 req-a759345e-5a53-40a6-9be4-ea890aee6a04 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:55.481168 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-e548a10e-e370-41cd-ad1d-7beb8fef77a3 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:55.481800 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-e548a10e-e370-41cd-ad1d-7beb8fef77a3 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] [instance: 67656ca4-09a7-4e6b-bf3a-cfcd254e99e4] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:55.494481 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-85afa2e8-2ff6-4e02-831f-afa6a5b4da80 req-a759345e-5a53-40a6-9be4-ea890aee6a04 service nova] Creating event network-vif-plugged:520b47f9-ca55-4bc2-99bd-5d338296bb06 for instance 67656ca4-09a7-4e6b-bf3a-cfcd254e99e4 on n-h2-854823-8 Oct 04 20:54:55.501544 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e548a10e-e370-41cd-ad1d-7beb8fef77a3 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:55.504455 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e548a10e-e370-41cd-ad1d-7beb8fef77a3 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:55.507411 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e548a10e-e370-41cd-ad1d-7beb8fef77a3 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:55.507561 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-85afa2e8-2ff6-4e02-831f-afa6a5b4da80 req-a759345e-5a53-40a6-9be4-ea890aee6a04 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.507425 Oct 04 20:54:55.510954 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2123/4290] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:54:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 20:54:55.511862 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e548a10e-e370-41cd-ad1d-7beb8fef77a3 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:55.514423 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e548a10e-e370-41cd-ad1d-7beb8fef77a3 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:55.517750 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e548a10e-e370-41cd-ad1d-7beb8fef77a3 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:55.610317 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-68c3fef0-80d8-4aac-ba20-428851d89215 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:55.611496 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-68c3fef0-80d8-4aac-ba20-428851d89215 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] [instance: 601e4070-a868-49c6-b935-87eeeac4a826] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:55.638464 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-68c3fef0-80d8-4aac-ba20-428851d89215 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:55.638963 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-68c3fef0-80d8-4aac-ba20-428851d89215 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:55.639416 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-68c3fef0-80d8-4aac-ba20-428851d89215 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:55.640113 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-68c3fef0-80d8-4aac-ba20-428851d89215 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:55.640569 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-68c3fef0-80d8-4aac-ba20-428851d89215 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:55.640999 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-68c3fef0-80d8-4aac-ba20-428851d89215 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:55.977013 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-68c3fef0-80d8-4aac-ba20-428851d89215 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4adee36830c640919981ae58bd326157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '589fcee1949d4820a8958ec55ce4b43a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:56.019101 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-68c3fef0-80d8-4aac-ba20-428851d89215 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4adee36830c640919981ae58bd326157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '589fcee1949d4820a8958ec55ce4b43a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:56.022746 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-68c3fef0-80d8-4aac-ba20-428851d89215 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4adee36830c640919981ae58bd326157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '589fcee1949d4820a8958ec55ce4b43a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:56.026586 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-68c3fef0-80d8-4aac-ba20-428851d89215 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] 10.222.0.33 "GET /compute/v2.1/servers/601e4070-a868-49c6-b935-87eeeac4a826" status: 200 len: 1365 microversion: 2.47 time: 0.421480 Oct 04 20:54:56.043923 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2124/4291] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:54:55 2022] GET /compute/v2.1/servers/601e4070-a868-49c6-b935-87eeeac4a826 => generated 1365 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:54:56.056728 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-92962c3e-7a2a-4f3d-882a-8b789612d9a7 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:56.059467 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-92962c3e-7a2a-4f3d-882a-8b789612d9a7 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] [instance: 866d0dd3-3c7e-4612-a132-48eb83ec2d16] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:56.066900 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-92962c3e-7a2a-4f3d-882a-8b789612d9a7 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:56.067728 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-92962c3e-7a2a-4f3d-882a-8b789612d9a7 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:56.068389 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-92962c3e-7a2a-4f3d-882a-8b789612d9a7 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:56.069328 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-92962c3e-7a2a-4f3d-882a-8b789612d9a7 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:56.070011 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-92962c3e-7a2a-4f3d-882a-8b789612d9a7 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:56.071612 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-92962c3e-7a2a-4f3d-882a-8b789612d9a7 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:56.114242 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-92962c3e-7a2a-4f3d-882a-8b789612d9a7 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] 10.222.0.33 "GET /compute/v2.1/servers/866d0dd3-3c7e-4612-a132-48eb83ec2d16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.068803 Oct 04 20:54:56.116452 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2125/4292] 10.222.0.33 () {58 vars in 1302 bytes} [Tue Oct 4 20:54:56 2022] GET /compute/v2.1/servers/866d0dd3-3c7e-4612-a132-48eb83ec2d16/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:54:56.281078 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-e548a10e-e370-41cd-ad1d-7beb8fef77a3 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e93855201ca64c779f92a2a33979b81f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed328a1e964d46902dee5e1c7c7b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:56.295487 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-e548a10e-e370-41cd-ad1d-7beb8fef77a3 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] 10.222.0.33 "GET /compute/v2.1/servers/67656ca4-09a7-4e6b-bf3a-cfcd254e99e4" status: 200 len: 1318 microversion: 2.1 time: 0.823568 Oct 04 20:54:56.298885 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2168/4293] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:54:55 2022] GET /compute/v2.1/servers/67656ca4-09a7-4e6b-bf3a-cfcd254e99e4 => generated 1318 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:54:57.070270 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5a874dda-e970-49ce-ac19-4895a3903b45 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:57.077293 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-5a874dda-e970-49ce-ac19-4895a3903b45 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] [instance: 601e4070-a868-49c6-b935-87eeeac4a826] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:57.096080 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5a874dda-e970-49ce-ac19-4895a3903b45 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:57.096586 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5a874dda-e970-49ce-ac19-4895a3903b45 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:57.097026 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5a874dda-e970-49ce-ac19-4895a3903b45 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:57.097744 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5a874dda-e970-49ce-ac19-4895a3903b45 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:57.098252 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5a874dda-e970-49ce-ac19-4895a3903b45 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:57.098740 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5a874dda-e970-49ce-ac19-4895a3903b45 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:57.133008 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-b75108e4-5bef-4a82-86b8-fcf23ed5d55a tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:57.136205 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-b75108e4-5bef-4a82-86b8-fcf23ed5d55a tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] [instance: 866d0dd3-3c7e-4612-a132-48eb83ec2d16] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:57.150095 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b75108e4-5bef-4a82-86b8-fcf23ed5d55a tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:57.150930 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b75108e4-5bef-4a82-86b8-fcf23ed5d55a tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:57.153522 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b75108e4-5bef-4a82-86b8-fcf23ed5d55a tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:57.154622 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b75108e4-5bef-4a82-86b8-fcf23ed5d55a tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:57.156563 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b75108e4-5bef-4a82-86b8-fcf23ed5d55a tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:57.157193 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b75108e4-5bef-4a82-86b8-fcf23ed5d55a tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:57.241066 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-b75108e4-5bef-4a82-86b8-fcf23ed5d55a tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] 10.222.0.33 "GET /compute/v2.1/servers/866d0dd3-3c7e-4612-a132-48eb83ec2d16/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.111764 Oct 04 20:54:57.248940 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2169/4294] 10.222.0.33 () {58 vars in 1302 bytes} [Tue Oct 4 20:54:57 2022] GET /compute/v2.1/servers/866d0dd3-3c7e-4612-a132-48eb83ec2d16/os-volume_attachments => generated 25 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 04 20:54:57.300804 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-5a874dda-e970-49ce-ac19-4895a3903b45 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4adee36830c640919981ae58bd326157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '589fcee1949d4820a8958ec55ce4b43a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:57.316917 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-5a874dda-e970-49ce-ac19-4895a3903b45 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4adee36830c640919981ae58bd326157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '589fcee1949d4820a8958ec55ce4b43a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:57.322036 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-5a874dda-e970-49ce-ac19-4895a3903b45 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4adee36830c640919981ae58bd326157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '589fcee1949d4820a8958ec55ce4b43a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:57.328431 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5a874dda-e970-49ce-ac19-4895a3903b45 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] 10.222.0.33 "GET /compute/v2.1/servers/601e4070-a868-49c6-b935-87eeeac4a826" status: 200 len: 1365 microversion: 2.47 time: 0.271199 Oct 04 20:54:57.329384 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2126/4295] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:54:57 2022] GET /compute/v2.1/servers/601e4070-a868-49c6-b935-87eeeac4a826 => generated 1365 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:54:57.334683 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-2766abd7-7aea-4c29-81cd-14db78a2a679 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:57.335729 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-2766abd7-7aea-4c29-81cd-14db78a2a679 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] [instance: 67656ca4-09a7-4e6b-bf3a-cfcd254e99e4] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:57.362143 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2766abd7-7aea-4c29-81cd-14db78a2a679 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:57.363028 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2766abd7-7aea-4c29-81cd-14db78a2a679 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:57.366777 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-33105898-b757-44e5-b934-5a1da2a6cf7d tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:54:57.374841 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-33105898-b757-44e5-b934-5a1da2a6cf7d tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] [instance: f15ae3c9-8342-4ae9-b81e-2d7b1aecb2e8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:57.374990 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2766abd7-7aea-4c29-81cd-14db78a2a679 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:57.378790 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2766abd7-7aea-4c29-81cd-14db78a2a679 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:57.381896 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2766abd7-7aea-4c29-81cd-14db78a2a679 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:57.383515 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2766abd7-7aea-4c29-81cd-14db78a2a679 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:57.388931 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-33105898-b757-44e5-b934-5a1da2a6cf7d tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:57.391957 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-33105898-b757-44e5-b934-5a1da2a6cf7d tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:57.393724 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-33105898-b757-44e5-b934-5a1da2a6cf7d tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:57.396035 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-33105898-b757-44e5-b934-5a1da2a6cf7d tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:57.399010 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-33105898-b757-44e5-b934-5a1da2a6cf7d tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:57.400762 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-33105898-b757-44e5-b934-5a1da2a6cf7d tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:57.454450 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-33105898-b757-44e5-b934-5a1da2a6cf7d tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] HTTP exception thrown: Cannot 'reboot' instance f15ae3c9-8342-4ae9-b81e-2d7b1aecb2e8 while it is in vm_state rescued Oct 04 20:54:57.455981 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-33105898-b757-44e5-b934-5a1da2a6cf7d tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Request method failure captured: Oct 04 20:54:57.455981 n-d-854823-8 devstack@n-api.service[128801]: request: POST /compute/v2.1/servers/f15ae3c9-8342-4ae9-b81e-2d7b1aecb2e8/action HTTP/1.1 Oct 04 20:54:57.455981 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:54:57.455981 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:54:57.455981 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:54:57.455981 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 28 Oct 04 20:54:57.455981 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:54:57.455981 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:54:57.455981 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:54:57.455981 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:54:57.455981 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJyQzA2j2TP516GvcpxgrBfRY2YO9l5F5hDF6OrxoVmO38Ubui7rW9ilb7hzquPDxl35ZSulQSvQlms9Io4ULkRGXw-K9Mq_8wy4teEQxOMGhx3owN2R9ZyECEeAocP_VsKpWXZTRpHKvfvEO-wS1AA94MTw8YrFoFgm4uO6w6GPzhQ Oct 04 20:54:57.455981 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:54:57.455981 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:54:57.455981 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:54:57.455981 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:54:57.455981 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:54:57.455981 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:54:57.455981 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: 003eb03a265a496d8981e45c74b014f3 Oct 04 20:54:57.455981 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2028044299 Oct 04 20:54:57.455981 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 20:54:57.455981 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 20:54:57.455981 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_003eb03a265a496d8981e45c74b014f3", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/003eb03a265a496d8981e45c74b014f3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/003eb03a265a496d8981e45c74b014f3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/003eb03a265a496d8981e45c74b014f3"}]}] Oct 04 20:54:57.455981 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2028044299 Oct 04 20:54:57.455981 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: 003eb03a265a496d8981e45c74b014f3 Oct 04 20:54:57.455981 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2028044299 Oct 04 20:54:57.455981 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-ServerRescueNegativeTestJSON-2028044299-project Oct 04 20:54:57.455981 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:54:57.455981 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:54:57.455981 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: 4dc4171c0ee14ebb8b5eff5e910ccf49 Oct 04 20:54:57.455981 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2028044299-project Oct 04 20:54:57.455981 n-d-854823-8 devstack@n-api.service[128801]: Oct 04 20:54:57.455981 n-d-854823-8 devstack@n-api.service[128801]: {"reboot": {"type": "HARD"}} Oct 04 20:54:57.455981 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 20:54:57.455981 n-d-854823-8 devstack@n-api.service[128801]: exception: Cannot 'reboot' instance f15ae3c9-8342-4ae9-b81e-2d7b1aecb2e8 while it is in vm_state rescued Oct 04 20:54:57.455981 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': 'f15ae3c9-8342-4ae9-b81e-2d7b1aecb2e8', 'body': {'reboot': {'type': 'HARD'}}} Oct 04 20:54:57.455981 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:54:57.455981 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:54:57.455981 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1036, in _action_reboot Oct 04 20:54:57.455981 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self.compute_api.reboot(context, instance, reboot_type) Oct 04 20:54:57.455981 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 20:54:57.455981 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 20:54:57.455981 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3552, in reboot Oct 04 20:54:57.455981 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self._hard_reboot(context, instance) Oct 04 20:54:57.455981 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 04 20:54:57.455981 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 04 20:54:57.455981 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f15ae3c9-8342-4ae9-b81e-2d7b1aecb2e8 in vm_state rescued. Cannot _hard_reboot while the instance is in this state. Oct 04 20:54:57.455981 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:54:57.455981 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:54:57.455981 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:54:57.455981 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:54:57.455981 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:54:57.455981 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:54:57.455981 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:54:57.455981 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:54:57.455981 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:54:57.455981 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:54:57.455981 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:54:57.455981 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:54:57.455981 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1040, in _action_reboot Oct 04 20:54:57.455981 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 04 20:54:57.455981 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 04 20:54:57.455981 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 04 20:54:57.460155 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'reboot' instance f15ae3c9-8342-4ae9-b81e-2d7b1aecb2e8 while it is in vm_state rescued Oct 04 20:54:57.460155 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:54:57.460155 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:54:57.460155 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:54:57.460155 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:54:57.460155 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:54:57.460155 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:54:57.460155 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:54:57.460155 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:54:57.460155 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'reboot' instance f15ae3c9-8342-4ae9-b81e-2d7b1aecb2e8 while it is in vm_state rescued Oct 04 20:54:57.460155 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:54:57.464376 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-33105898-b757-44e5-b934-5a1da2a6cf7d tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Returning 409 to user: Cannot 'reboot' instance f15ae3c9-8342-4ae9-b81e-2d7b1aecb2e8 while it is in vm_state rescued {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:54:57.468741 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-33105898-b757-44e5-b934-5a1da2a6cf7d tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] 10.222.0.33 "POST /compute/v2.1/servers/f15ae3c9-8342-4ae9-b81e-2d7b1aecb2e8/action" status: 409 len: 145 microversion: 2.1 time: 0.110274 Oct 04 20:54:57.473558 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2127/4296] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 20:54:57 2022] POST /compute/v2.1/servers/f15ae3c9-8342-4ae9-b81e-2d7b1aecb2e8/action => generated 145 bytes in 115 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Oct 04 20:54:57.480987 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-614c8273-12f8-4901-ae68-d2ebb8b0dcf1 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:54:57.501646 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-614c8273-12f8-4901-ae68-d2ebb8b0dcf1 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] [instance: f15ae3c9-8342-4ae9-b81e-2d7b1aecb2e8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:57.520541 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-614c8273-12f8-4901-ae68-d2ebb8b0dcf1 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:57.521055 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-614c8273-12f8-4901-ae68-d2ebb8b0dcf1 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:57.521499 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-614c8273-12f8-4901-ae68-d2ebb8b0dcf1 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:57.529213 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-614c8273-12f8-4901-ae68-d2ebb8b0dcf1 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:57.529961 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-614c8273-12f8-4901-ae68-d2ebb8b0dcf1 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:57.530887 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-614c8273-12f8-4901-ae68-d2ebb8b0dcf1 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:57.601911 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-614c8273-12f8-4901-ae68-d2ebb8b0dcf1 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] HTTP exception thrown: Cannot 'rebuild' instance f15ae3c9-8342-4ae9-b81e-2d7b1aecb2e8 while it is in vm_state rescued Oct 04 20:54:57.607004 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-614c8273-12f8-4901-ae68-d2ebb8b0dcf1 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Request method failure captured: Oct 04 20:54:57.607004 n-d-854823-8 devstack@n-api.service[128801]: request: POST /compute/v2.1/servers/f15ae3c9-8342-4ae9-b81e-2d7b1aecb2e8/action HTTP/1.1 Oct 04 20:54:57.607004 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:54:57.607004 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:54:57.607004 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:54:57.607004 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 65 Oct 04 20:54:57.607004 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:54:57.607004 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:54:57.607004 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:54:57.607004 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:54:57.607004 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJyQzA2j2TP516GvcpxgrBfRY2YO9l5F5hDF6OrxoVmO38Ubui7rW9ilb7hzquPDxl35ZSulQSvQlms9Io4ULkRGXw-K9Mq_8wy4teEQxOMGhx3owN2R9ZyECEeAocP_VsKpWXZTRpHKvfvEO-wS1AA94MTw8YrFoFgm4uO6w6GPzhQ Oct 04 20:54:57.607004 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:54:57.607004 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:54:57.607004 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:54:57.607004 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:54:57.607004 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:54:57.607004 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:54:57.607004 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: 003eb03a265a496d8981e45c74b014f3 Oct 04 20:54:57.607004 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2028044299 Oct 04 20:54:57.607004 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 20:54:57.607004 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 20:54:57.607004 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_003eb03a265a496d8981e45c74b014f3", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/003eb03a265a496d8981e45c74b014f3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/003eb03a265a496d8981e45c74b014f3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/003eb03a265a496d8981e45c74b014f3"}]}] Oct 04 20:54:57.607004 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2028044299 Oct 04 20:54:57.607004 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: 003eb03a265a496d8981e45c74b014f3 Oct 04 20:54:57.607004 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2028044299 Oct 04 20:54:57.607004 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-ServerRescueNegativeTestJSON-2028044299-project Oct 04 20:54:57.607004 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:54:57.607004 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:54:57.607004 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: 4dc4171c0ee14ebb8b5eff5e910ccf49 Oct 04 20:54:57.607004 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2028044299-project Oct 04 20:54:57.607004 n-d-854823-8 devstack@n-api.service[128801]: Oct 04 20:54:57.607004 n-d-854823-8 devstack@n-api.service[128801]: {"rebuild": {"imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63"}} Oct 04 20:54:57.607004 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 20:54:57.607004 n-d-854823-8 devstack@n-api.service[128801]: exception: Cannot 'rebuild' instance f15ae3c9-8342-4ae9-b81e-2d7b1aecb2e8 while it is in vm_state rescued Oct 04 20:54:57.607004 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': 'f15ae3c9-8342-4ae9-b81e-2d7b1aecb2e8', 'body': {'rebuild': {'imageRef': '15b24725-0c99-4bcf-b1fb-907cdf8e2d63'}}} Oct 04 20:54:57.607004 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:54:57.607004 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:54:57.607004 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1223, in _action_rebuild Oct 04 20:54:57.607004 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self.compute_api.rebuild(context, Oct 04 20:54:57.607004 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 04 20:54:57.607004 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 04 20:54:57.607004 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 04 20:54:57.607004 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 04 20:54:57.607004 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 20:54:57.607004 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 20:54:57.607004 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 04 20:54:57.607004 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 04 20:54:57.607004 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f15ae3c9-8342-4ae9-b81e-2d7b1aecb2e8 in vm_state rescued. Cannot rebuild while the instance is in this state. Oct 04 20:54:57.607004 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:54:57.607004 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:54:57.607004 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:54:57.607004 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:54:57.607004 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:54:57.607004 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:54:57.607004 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:54:57.607004 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:54:57.607004 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:54:57.607004 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:54:57.607004 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:54:57.607004 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:54:57.607004 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:54:57.607004 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:54:57.607004 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:54:57.612040 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:54:57.612040 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Oct 04 20:54:57.612040 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1231, in _action_rebuild Oct 04 20:54:57.612040 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 04 20:54:57.612040 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 04 20:54:57.612040 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 04 20:54:57.612040 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rebuild' instance f15ae3c9-8342-4ae9-b81e-2d7b1aecb2e8 while it is in vm_state rescued Oct 04 20:54:57.612040 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:54:57.612040 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:54:57.612040 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:54:57.612040 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:54:57.612040 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:54:57.612040 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:54:57.612040 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:54:57.612040 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:54:57.612040 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rebuild' instance f15ae3c9-8342-4ae9-b81e-2d7b1aecb2e8 while it is in vm_state rescued Oct 04 20:54:57.612040 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:54:57.615148 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-614c8273-12f8-4901-ae68-d2ebb8b0dcf1 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Returning 409 to user: Cannot 'rebuild' instance f15ae3c9-8342-4ae9-b81e-2d7b1aecb2e8 while it is in vm_state rescued {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:54:57.616554 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-614c8273-12f8-4901-ae68-d2ebb8b0dcf1 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] 10.222.0.33 "POST /compute/v2.1/servers/f15ae3c9-8342-4ae9-b81e-2d7b1aecb2e8/action" status: 409 len: 146 microversion: 2.1 time: 0.140420 Oct 04 20:54:57.617826 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2128/4297] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 20:54:57 2022] POST /compute/v2.1/servers/f15ae3c9-8342-4ae9-b81e-2d7b1aecb2e8/action => generated 146 bytes in 142 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 04 20:54:57.632100 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d87a4055-91b9-482c-8edd-36eb419df869 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:57.633673 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d87a4055-91b9-482c-8edd-36eb419df869 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] [instance: 866d0dd3-3c7e-4612-a132-48eb83ec2d16] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:57.648044 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d87a4055-91b9-482c-8edd-36eb419df869 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:57.652769 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d87a4055-91b9-482c-8edd-36eb419df869 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:57.653512 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d87a4055-91b9-482c-8edd-36eb419df869 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:57.655954 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d87a4055-91b9-482c-8edd-36eb419df869 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:57.657141 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d87a4055-91b9-482c-8edd-36eb419df869 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:57.657615 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d87a4055-91b9-482c-8edd-36eb419df869 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:57.736828 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:54:57.786855 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d87a4055-91b9-482c-8edd-36eb419df869 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] [instance: 866d0dd3-3c7e-4612-a132-48eb83ec2d16] Going to try to terminate instance {{(pid=128801) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:54:57.818598 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-2766abd7-7aea-4c29-81cd-14db78a2a679 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e93855201ca64c779f92a2a33979b81f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed328a1e964d46902dee5e1c7c7b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:57.834494 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-2766abd7-7aea-4c29-81cd-14db78a2a679 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] 10.222.0.33 "GET /compute/v2.1/servers/67656ca4-09a7-4e6b-bf3a-cfcd254e99e4" status: 200 len: 1508 microversion: 2.1 time: 0.509725 Oct 04 20:54:57.835192 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2170/4298] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:54:57 2022] GET /compute/v2.1/servers/67656ca4-09a7-4e6b-bf3a-cfcd254e99e4 => generated 1508 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:54:57.860082 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-5458ca75-6a8a-4d29-af85-c55446c2f154 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:57.860707 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-5458ca75-6a8a-4d29-af85-c55446c2f154 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] [instance: 67656ca4-09a7-4e6b-bf3a-cfcd254e99e4] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:57.878731 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5458ca75-6a8a-4d29-af85-c55446c2f154 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:57.879236 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5458ca75-6a8a-4d29-af85-c55446c2f154 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:57.879679 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5458ca75-6a8a-4d29-af85-c55446c2f154 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:57.880403 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5458ca75-6a8a-4d29-af85-c55446c2f154 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:57.880867 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5458ca75-6a8a-4d29-af85-c55446c2f154 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:57.881299 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5458ca75-6a8a-4d29-af85-c55446c2f154 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:58.005445 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d87a4055-91b9-482c-8edd-36eb419df869 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] 10.222.0.33 "DELETE /compute/v2.1/servers/866d0dd3-3c7e-4612-a132-48eb83ec2d16" status: 204 len: 0 microversion: 2.1 time: 0.381012 Oct 04 20:54:58.006746 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2129/4299] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 20:54:57 2022] DELETE /compute/v2.1/servers/866d0dd3-3c7e-4612-a132-48eb83ec2d16 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:54:58.019257 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c72ba224-83aa-4677-9f0e-a337429e861d tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:58.020817 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c72ba224-83aa-4677-9f0e-a337429e861d tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] [instance: 866d0dd3-3c7e-4612-a132-48eb83ec2d16] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:58.036159 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c72ba224-83aa-4677-9f0e-a337429e861d tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:58.038002 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c72ba224-83aa-4677-9f0e-a337429e861d tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:58.039540 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c72ba224-83aa-4677-9f0e-a337429e861d tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:58.042257 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c72ba224-83aa-4677-9f0e-a337429e861d tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:58.043055 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c72ba224-83aa-4677-9f0e-a337429e861d tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:58.044214 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c72ba224-83aa-4677-9f0e-a337429e861d tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:58.154279 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-5458ca75-6a8a-4d29-af85-c55446c2f154 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e93855201ca64c779f92a2a33979b81f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed328a1e964d46902dee5e1c7c7b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:58.168097 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-5458ca75-6a8a-4d29-af85-c55446c2f154 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] 10.222.0.33 "GET /compute/v2.1/servers/67656ca4-09a7-4e6b-bf3a-cfcd254e99e4" status: 200 len: 1508 microversion: 2.1 time: 0.311656 Oct 04 20:54:58.170737 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2171/4300] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:54:57 2022] GET /compute/v2.1/servers/67656ca4-09a7-4e6b-bf3a-cfcd254e99e4 => generated 1508 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:54:58.190517 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-233d72f9-984a-4bd8-a8a5-7d9340427ca1 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:54:58.193463 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-233d72f9-984a-4bd8-a8a5-7d9340427ca1 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] [instance: 67656ca4-09a7-4e6b-bf3a-cfcd254e99e4] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:58.206691 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-233d72f9-984a-4bd8-a8a5-7d9340427ca1 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:58.207442 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-233d72f9-984a-4bd8-a8a5-7d9340427ca1 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:58.208037 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-233d72f9-984a-4bd8-a8a5-7d9340427ca1 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:58.208911 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-233d72f9-984a-4bd8-a8a5-7d9340427ca1 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:58.209515 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-233d72f9-984a-4bd8-a8a5-7d9340427ca1 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:58.210092 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-233d72f9-984a-4bd8-a8a5-7d9340427ca1 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:58.313197 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:54:58.349792 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-233d72f9-984a-4bd8-a8a5-7d9340427ca1 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] 10.222.0.33 "PUT /compute/v2.1/servers/67656ca4-09a7-4e6b-bf3a-cfcd254e99e4" status: 200 len: 1080 microversion: 2.1 time: 0.163105 Oct 04 20:54:58.350720 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2172/4301] 10.222.0.33 () {60 vars in 1256 bytes} [Tue Oct 4 20:54:58 2022] PUT /compute/v2.1/servers/67656ca4-09a7-4e6b-bf3a-cfcd254e99e4 => generated 1080 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:54:58.370047 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-fa8eda6e-2a26-4d8a-ac50-4d2ce9dbb032 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:58.371674 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-fa8eda6e-2a26-4d8a-ac50-4d2ce9dbb032 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] [instance: 601e4070-a868-49c6-b935-87eeeac4a826] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:58.382883 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c72ba224-83aa-4677-9f0e-a337429e861d tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc4171c0ee14ebb8b5eff5e910ccf49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003eb03a265a496d8981e45c74b014f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:58.387249 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fa8eda6e-2a26-4d8a-ac50-4d2ce9dbb032 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:58.389226 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fa8eda6e-2a26-4d8a-ac50-4d2ce9dbb032 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:58.389947 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fa8eda6e-2a26-4d8a-ac50-4d2ce9dbb032 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:58.392727 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fa8eda6e-2a26-4d8a-ac50-4d2ce9dbb032 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:58.394104 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fa8eda6e-2a26-4d8a-ac50-4d2ce9dbb032 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:58.395450 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c72ba224-83aa-4677-9f0e-a337429e861d tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] 10.222.0.33 "GET /compute/v2.1/servers/866d0dd3-3c7e-4612-a132-48eb83ec2d16" status: 200 len: 1690 microversion: 2.1 time: 0.383416 Oct 04 20:54:58.395905 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fa8eda6e-2a26-4d8a-ac50-4d2ce9dbb032 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:58.401908 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2130/4302] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:54:58 2022] GET /compute/v2.1/servers/866d0dd3-3c7e-4612-a132-48eb83ec2d16 => generated 1690 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:54:58.411934 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-bef5e87e-230d-4d90-a4bb-b80de9549a7c tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:58.412841 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-bef5e87e-230d-4d90-a4bb-b80de9549a7c tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] [instance: 67656ca4-09a7-4e6b-bf3a-cfcd254e99e4] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:58.433345 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bef5e87e-230d-4d90-a4bb-b80de9549a7c tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:58.437397 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bef5e87e-230d-4d90-a4bb-b80de9549a7c tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:58.439540 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bef5e87e-230d-4d90-a4bb-b80de9549a7c tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:58.440955 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bef5e87e-230d-4d90-a4bb-b80de9549a7c tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:58.442745 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bef5e87e-230d-4d90-a4bb-b80de9549a7c tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:58.443427 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bef5e87e-230d-4d90-a4bb-b80de9549a7c tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:58.611446 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-fa8eda6e-2a26-4d8a-ac50-4d2ce9dbb032 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4adee36830c640919981ae58bd326157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '589fcee1949d4820a8958ec55ce4b43a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:58.627005 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-fa8eda6e-2a26-4d8a-ac50-4d2ce9dbb032 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4adee36830c640919981ae58bd326157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '589fcee1949d4820a8958ec55ce4b43a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:58.631560 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-fa8eda6e-2a26-4d8a-ac50-4d2ce9dbb032 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4adee36830c640919981ae58bd326157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '589fcee1949d4820a8958ec55ce4b43a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:58.636998 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-fa8eda6e-2a26-4d8a-ac50-4d2ce9dbb032 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] 10.222.0.33 "GET /compute/v2.1/servers/601e4070-a868-49c6-b935-87eeeac4a826" status: 200 len: 1365 microversion: 2.47 time: 0.280780 Oct 04 20:54:58.640371 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2173/4303] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:54:58 2022] GET /compute/v2.1/servers/601e4070-a868-49c6-b935-87eeeac4a826 => generated 1365 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:54:58.831320 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-bef5e87e-230d-4d90-a4bb-b80de9549a7c tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e93855201ca64c779f92a2a33979b81f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed328a1e964d46902dee5e1c7c7b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:58.840275 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-bef5e87e-230d-4d90-a4bb-b80de9549a7c tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] 10.222.0.33 "GET /compute/v2.1/servers/67656ca4-09a7-4e6b-bf3a-cfcd254e99e4" status: 200 len: 1506 microversion: 2.1 time: 0.436871 Oct 04 20:54:58.840855 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2131/4304] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:54:58 2022] GET /compute/v2.1/servers/67656ca4-09a7-4e6b-bf3a-cfcd254e99e4 => generated 1506 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:54:58.865069 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-dfc22e32-14c3-444a-af89-344364a8ae12 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:58.865763 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-dfc22e32-14c3-444a-af89-344364a8ae12 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] [instance: 67656ca4-09a7-4e6b-bf3a-cfcd254e99e4] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:58.875301 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dfc22e32-14c3-444a-af89-344364a8ae12 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:58.875799 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dfc22e32-14c3-444a-af89-344364a8ae12 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:58.877335 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dfc22e32-14c3-444a-af89-344364a8ae12 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:58.878487 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dfc22e32-14c3-444a-af89-344364a8ae12 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:58.879230 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dfc22e32-14c3-444a-af89-344364a8ae12 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:58.880025 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dfc22e32-14c3-444a-af89-344364a8ae12 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:59.076279 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-dfc22e32-14c3-444a-af89-344364a8ae12 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e93855201ca64c779f92a2a33979b81f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed328a1e964d46902dee5e1c7c7b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:59.086165 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-dfc22e32-14c3-444a-af89-344364a8ae12 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] 10.222.0.33 "GET /compute/v2.1/servers/67656ca4-09a7-4e6b-bf3a-cfcd254e99e4" status: 200 len: 1506 microversion: 2.1 time: 0.225465 Oct 04 20:54:59.088037 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2174/4305] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:54:58 2022] GET /compute/v2.1/servers/67656ca4-09a7-4e6b-bf3a-cfcd254e99e4 => generated 1506 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:54:59.113115 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f825bd0a-db82-4e3c-a4d6-a20a356df567 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:54:59.118536 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f825bd0a-db82-4e3c-a4d6-a20a356df567 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] [instance: 67656ca4-09a7-4e6b-bf3a-cfcd254e99e4] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:59.133384 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f825bd0a-db82-4e3c-a4d6-a20a356df567 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:59.134682 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f825bd0a-db82-4e3c-a4d6-a20a356df567 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:59.135296 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f825bd0a-db82-4e3c-a4d6-a20a356df567 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:59.137498 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f825bd0a-db82-4e3c-a4d6-a20a356df567 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:59.154368 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f825bd0a-db82-4e3c-a4d6-a20a356df567 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:59.156033 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f825bd0a-db82-4e3c-a4d6-a20a356df567 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:59.326955 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-f825bd0a-db82-4e3c-a4d6-a20a356df567 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Flavor limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:54:59.327439 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-f825bd0a-db82-4e3c-a4d6-a20a356df567 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Image limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:54:59.327959 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-f825bd0a-db82-4e3c-a4d6-a20a356df567 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Flavor pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:54:59.329118 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-f825bd0a-db82-4e3c-a4d6-a20a356df567 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Image pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:54:59.329593 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-f825bd0a-db82-4e3c-a4d6-a20a356df567 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:54:59.429649 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f825bd0a-db82-4e3c-a4d6-a20a356df567 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] [instance: 67656ca4-09a7-4e6b-bf3a-cfcd254e99e4] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:59.430944 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-68fcf628-b9d9-4d65-aa16-1207fa9b3a95 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:59.431871 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-68fcf628-b9d9-4d65-aa16-1207fa9b3a95 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] [instance: 866d0dd3-3c7e-4612-a132-48eb83ec2d16] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:59.432538 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:54:59.441329 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f825bd0a-db82-4e3c-a4d6-a20a356df567 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:59.441838 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f825bd0a-db82-4e3c-a4d6-a20a356df567 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:59.443008 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f825bd0a-db82-4e3c-a4d6-a20a356df567 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:59.443731 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-68fcf628-b9d9-4d65-aa16-1207fa9b3a95 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:59.443857 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f825bd0a-db82-4e3c-a4d6-a20a356df567 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:59.444274 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f825bd0a-db82-4e3c-a4d6-a20a356df567 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:59.444702 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f825bd0a-db82-4e3c-a4d6-a20a356df567 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:59.445624 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-68fcf628-b9d9-4d65-aa16-1207fa9b3a95 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:59.446154 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-68fcf628-b9d9-4d65-aa16-1207fa9b3a95 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:59.451005 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-68fcf628-b9d9-4d65-aa16-1207fa9b3a95 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:59.452221 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-68fcf628-b9d9-4d65-aa16-1207fa9b3a95 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:59.452924 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-68fcf628-b9d9-4d65-aa16-1207fa9b3a95 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:59.490442 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f825bd0a-db82-4e3c-a4d6-a20a356df567 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] 10.222.0.33 "POST /compute/v2.1/servers/67656ca4-09a7-4e6b-bf3a-cfcd254e99e4/action" status: 202 len: 1112 microversion: 2.1 time: 0.382214 Oct 04 20:54:59.504326 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2132/4306] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 20:54:59 2022] POST /compute/v2.1/servers/67656ca4-09a7-4e6b-bf3a-cfcd254e99e4/action => generated 1112 bytes in 398 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 04 20:54:59.516810 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5a289fd7-44ca-43d3-a579-9f8678485f63 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:59.518258 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-5a289fd7-44ca-43d3-a579-9f8678485f63 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] [instance: 67656ca4-09a7-4e6b-bf3a-cfcd254e99e4] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:59.528911 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5a289fd7-44ca-43d3-a579-9f8678485f63 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:59.530194 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5a289fd7-44ca-43d3-a579-9f8678485f63 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:59.531246 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5a289fd7-44ca-43d3-a579-9f8678485f63 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:59.532222 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5a289fd7-44ca-43d3-a579-9f8678485f63 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:54:59.532970 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5a289fd7-44ca-43d3-a579-9f8678485f63 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:54:59.533553 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5a289fd7-44ca-43d3-a579-9f8678485f63 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:54:59.953835 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-68fcf628-b9d9-4d65-aa16-1207fa9b3a95 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc4171c0ee14ebb8b5eff5e910ccf49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003eb03a265a496d8981e45c74b014f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:54:59.968125 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-68fcf628-b9d9-4d65-aa16-1207fa9b3a95 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] 10.222.0.33 "GET /compute/v2.1/servers/866d0dd3-3c7e-4612-a132-48eb83ec2d16" status: 200 len: 1690 microversion: 2.1 time: 0.543021 Oct 04 20:54:59.969762 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2175/4307] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:54:59 2022] GET /compute/v2.1/servers/866d0dd3-3c7e-4612-a132-48eb83ec2d16 => generated 1690 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:54:59.980151 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-de963f85-7c71-41de-badd-665c0ffa5dc7 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:54:59.981183 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-de963f85-7c71-41de-badd-665c0ffa5dc7 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] [instance: 601e4070-a868-49c6-b935-87eeeac4a826] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:54:59.992058 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:54:59.999764 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-de963f85-7c71-41de-badd-665c0ffa5dc7 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:00.000325 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-de963f85-7c71-41de-badd-665c0ffa5dc7 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:00.001022 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-de963f85-7c71-41de-badd-665c0ffa5dc7 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:00.002320 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-de963f85-7c71-41de-badd-665c0ffa5dc7 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:00.003503 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-de963f85-7c71-41de-badd-665c0ffa5dc7 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:00.004536 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-de963f85-7c71-41de-badd-665c0ffa5dc7 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:00.050978 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-5a289fd7-44ca-43d3-a579-9f8678485f63 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e93855201ca64c779f92a2a33979b81f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed328a1e964d46902dee5e1c7c7b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:00.061206 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5a289fd7-44ca-43d3-a579-9f8678485f63 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] 10.222.0.33 "GET /compute/v2.1/servers/67656ca4-09a7-4e6b-bf3a-cfcd254e99e4" status: 200 len: 1517 microversion: 2.1 time: 0.549425 Oct 04 20:55:00.064963 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2133/4308] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:54:59 2022] GET /compute/v2.1/servers/67656ca4-09a7-4e6b-bf3a-cfcd254e99e4 => generated 1517 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:55:00.165623 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-de963f85-7c71-41de-badd-665c0ffa5dc7 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4adee36830c640919981ae58bd326157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '589fcee1949d4820a8958ec55ce4b43a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:00.189397 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-de963f85-7c71-41de-badd-665c0ffa5dc7 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4adee36830c640919981ae58bd326157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '589fcee1949d4820a8958ec55ce4b43a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:00.202061 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-de963f85-7c71-41de-badd-665c0ffa5dc7 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4adee36830c640919981ae58bd326157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '589fcee1949d4820a8958ec55ce4b43a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:00.204379 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-de963f85-7c71-41de-badd-665c0ffa5dc7 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] 10.222.0.33 "GET /compute/v2.1/servers/601e4070-a868-49c6-b935-87eeeac4a826" status: 200 len: 1365 microversion: 2.47 time: 0.232647 Oct 04 20:55:00.208228 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2176/4309] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:54:59 2022] GET /compute/v2.1/servers/601e4070-a868-49c6-b935-87eeeac4a826 => generated 1365 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:55:01.010929 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7b30d8e0-5563-4e9e-b0e6-61f6421c6a32 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:55:01.015402 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-7b30d8e0-5563-4e9e-b0e6-61f6421c6a32 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] [instance: 866d0dd3-3c7e-4612-a132-48eb83ec2d16] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:55:01.034962 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7b30d8e0-5563-4e9e-b0e6-61f6421c6a32 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:01.035977 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7b30d8e0-5563-4e9e-b0e6-61f6421c6a32 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:01.043153 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7b30d8e0-5563-4e9e-b0e6-61f6421c6a32 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:01.044359 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7b30d8e0-5563-4e9e-b0e6-61f6421c6a32 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:01.044999 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7b30d8e0-5563-4e9e-b0e6-61f6421c6a32 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:01.045869 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7b30d8e0-5563-4e9e-b0e6-61f6421c6a32 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:01.091156 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-08ed466d-d8cb-43b6-b39f-548aea92f5e2 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:55:01.091784 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-08ed466d-d8cb-43b6-b39f-548aea92f5e2 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] [instance: 67656ca4-09a7-4e6b-bf3a-cfcd254e99e4] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:55:01.106901 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-08ed466d-d8cb-43b6-b39f-548aea92f5e2 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:01.109337 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-08ed466d-d8cb-43b6-b39f-548aea92f5e2 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:01.110888 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-08ed466d-d8cb-43b6-b39f-548aea92f5e2 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:01.115027 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-08ed466d-d8cb-43b6-b39f-548aea92f5e2 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:01.115538 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-08ed466d-d8cb-43b6-b39f-548aea92f5e2 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:01.115997 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-08ed466d-d8cb-43b6-b39f-548aea92f5e2 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:01.962227 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-08ed466d-d8cb-43b6-b39f-548aea92f5e2 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e93855201ca64c779f92a2a33979b81f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed328a1e964d46902dee5e1c7c7b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:01.973276 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-08ed466d-d8cb-43b6-b39f-548aea92f5e2 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] 10.222.0.33 "GET /compute/v2.1/servers/67656ca4-09a7-4e6b-bf3a-cfcd254e99e4" status: 200 len: 1517 microversion: 2.1 time: 0.887960 Oct 04 20:55:01.976534 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2177/4310] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:55:01 2022] GET /compute/v2.1/servers/67656ca4-09a7-4e6b-bf3a-cfcd254e99e4 => generated 1517 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:55:01.987837 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-178dfedb-cc52-4635-b311-c89387bccca7 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:55:01.989476 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-178dfedb-cc52-4635-b311-c89387bccca7 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] [instance: 601e4070-a868-49c6-b935-87eeeac4a826] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:55:02.003448 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-178dfedb-cc52-4635-b311-c89387bccca7 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:02.029557 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-178dfedb-cc52-4635-b311-c89387bccca7 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:02.030456 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-178dfedb-cc52-4635-b311-c89387bccca7 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:02.031511 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-178dfedb-cc52-4635-b311-c89387bccca7 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:02.032051 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-178dfedb-cc52-4635-b311-c89387bccca7 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:02.032643 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-178dfedb-cc52-4635-b311-c89387bccca7 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:02.051362 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-7b30d8e0-5563-4e9e-b0e6-61f6421c6a32 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc4171c0ee14ebb8b5eff5e910ccf49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003eb03a265a496d8981e45c74b014f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:02.061139 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-7b30d8e0-5563-4e9e-b0e6-61f6421c6a32 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] 10.222.0.33 "GET /compute/v2.1/servers/866d0dd3-3c7e-4612-a132-48eb83ec2d16" status: 200 len: 1690 microversion: 2.1 time: 1.067792 Oct 04 20:55:02.062328 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2134/4311] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:55:00 2022] GET /compute/v2.1/servers/866d0dd3-3c7e-4612-a132-48eb83ec2d16 => generated 1690 bytes in 1070 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:55:02.188006 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-178dfedb-cc52-4635-b311-c89387bccca7 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4adee36830c640919981ae58bd326157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '589fcee1949d4820a8958ec55ce4b43a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:02.204884 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-178dfedb-cc52-4635-b311-c89387bccca7 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4adee36830c640919981ae58bd326157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '589fcee1949d4820a8958ec55ce4b43a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:02.206671 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-178dfedb-cc52-4635-b311-c89387bccca7 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4adee36830c640919981ae58bd326157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '589fcee1949d4820a8958ec55ce4b43a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:02.209046 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-178dfedb-cc52-4635-b311-c89387bccca7 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] 10.222.0.33 "GET /compute/v2.1/servers/601e4070-a868-49c6-b935-87eeeac4a826" status: 200 len: 1365 microversion: 2.47 time: 0.230377 Oct 04 20:55:02.213588 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2178/4312] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:55:01 2022] GET /compute/v2.1/servers/601e4070-a868-49c6-b935-87eeeac4a826 => generated 1365 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:55:03.002502 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d9ca8342-587f-431e-b315-321e5012b655 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:55:03.003314 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d9ca8342-587f-431e-b315-321e5012b655 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] [instance: 67656ca4-09a7-4e6b-bf3a-cfcd254e99e4] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:55:03.010197 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d9ca8342-587f-431e-b315-321e5012b655 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:03.011101 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d9ca8342-587f-431e-b315-321e5012b655 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:03.011773 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d9ca8342-587f-431e-b315-321e5012b655 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:03.012709 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d9ca8342-587f-431e-b315-321e5012b655 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:03.013384 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d9ca8342-587f-431e-b315-321e5012b655 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:03.014065 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d9ca8342-587f-431e-b315-321e5012b655 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:03.085663 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-98fea56d-99cb-41f0-b31a-f81c5d3c85be tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:55:03.086393 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-98fea56d-99cb-41f0-b31a-f81c5d3c85be tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] [instance: 866d0dd3-3c7e-4612-a132-48eb83ec2d16] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:55:03.100408 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-98fea56d-99cb-41f0-b31a-f81c5d3c85be tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:03.102922 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-98fea56d-99cb-41f0-b31a-f81c5d3c85be tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:03.109188 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-98fea56d-99cb-41f0-b31a-f81c5d3c85be tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:03.110636 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-98fea56d-99cb-41f0-b31a-f81c5d3c85be tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:03.111802 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-98fea56d-99cb-41f0-b31a-f81c5d3c85be tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:03.113146 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-98fea56d-99cb-41f0-b31a-f81c5d3c85be tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:03.295518 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-98fea56d-99cb-41f0-b31a-f81c5d3c85be tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc4171c0ee14ebb8b5eff5e910ccf49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003eb03a265a496d8981e45c74b014f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:03.311189 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-98fea56d-99cb-41f0-b31a-f81c5d3c85be tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] 10.222.0.33 "GET /compute/v2.1/servers/866d0dd3-3c7e-4612-a132-48eb83ec2d16" status: 200 len: 1623 microversion: 2.1 time: 0.229685 Oct 04 20:55:03.312758 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2179/4313] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:55:03 2022] GET /compute/v2.1/servers/866d0dd3-3c7e-4612-a132-48eb83ec2d16 => generated 1623 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:55:03.318865 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-92d2c90f-bbcb-4c2c-b803-5ccf70f8a539 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:55:03.319842 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-92d2c90f-bbcb-4c2c-b803-5ccf70f8a539 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] [instance: 601e4070-a868-49c6-b935-87eeeac4a826] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:55:03.328914 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-92d2c90f-bbcb-4c2c-b803-5ccf70f8a539 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:03.330481 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-92d2c90f-bbcb-4c2c-b803-5ccf70f8a539 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:03.331544 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-92d2c90f-bbcb-4c2c-b803-5ccf70f8a539 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:03.333016 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-92d2c90f-bbcb-4c2c-b803-5ccf70f8a539 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:03.334514 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-92d2c90f-bbcb-4c2c-b803-5ccf70f8a539 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:03.339929 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-92d2c90f-bbcb-4c2c-b803-5ccf70f8a539 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:03.501078 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-92d2c90f-bbcb-4c2c-b803-5ccf70f8a539 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4adee36830c640919981ae58bd326157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '589fcee1949d4820a8958ec55ce4b43a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:03.516257 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d9ca8342-587f-431e-b315-321e5012b655 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e93855201ca64c779f92a2a33979b81f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed328a1e964d46902dee5e1c7c7b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:03.519272 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-92d2c90f-bbcb-4c2c-b803-5ccf70f8a539 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4adee36830c640919981ae58bd326157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '589fcee1949d4820a8958ec55ce4b43a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:03.523843 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-92d2c90f-bbcb-4c2c-b803-5ccf70f8a539 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4adee36830c640919981ae58bd326157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '589fcee1949d4820a8958ec55ce4b43a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:03.528819 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-92d2c90f-bbcb-4c2c-b803-5ccf70f8a539 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] 10.222.0.33 "GET /compute/v2.1/servers/601e4070-a868-49c6-b935-87eeeac4a826" status: 200 len: 1365 microversion: 2.47 time: 0.214434 Oct 04 20:55:03.530255 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2180/4314] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:55:03 2022] GET /compute/v2.1/servers/601e4070-a868-49c6-b935-87eeeac4a826 => generated 1365 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:55:03.530967 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d9ca8342-587f-431e-b315-321e5012b655 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] 10.222.0.33 "GET /compute/v2.1/servers/67656ca4-09a7-4e6b-bf3a-cfcd254e99e4" status: 200 len: 1517 microversion: 2.1 time: 0.531986 Oct 04 20:55:03.532140 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2135/4315] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:55:02 2022] GET /compute/v2.1/servers/67656ca4-09a7-4e6b-bf3a-cfcd254e99e4 => generated 1517 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:55:04.000461 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-9838edf3-2cae-4c58-8add-eae7ea1f3219 req-4cae9b84-5096-4554-9c55-d0df571aad27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "866d0dd3-3c7e-4612-a132-48eb83ec2d16", "name": "network-vif-deleted", "tag": "0544b7b3-d2c3-439a-b134-c025dc0ed7a6"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:55:04.033400 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-9838edf3-2cae-4c58-8add-eae7ea1f3219 req-4cae9b84-5096-4554-9c55-d0df571aad27 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:04.037043 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-9838edf3-2cae-4c58-8add-eae7ea1f3219 req-4cae9b84-5096-4554-9c55-d0df571aad27 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:04.037471 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-9838edf3-2cae-4c58-8add-eae7ea1f3219 req-4cae9b84-5096-4554-9c55-d0df571aad27 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:04.079264 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-9838edf3-2cae-4c58-8add-eae7ea1f3219 req-4cae9b84-5096-4554-9c55-d0df571aad27 service nova] Creating event network-vif-deleted:0544b7b3-d2c3-439a-b134-c025dc0ed7a6 for instance 866d0dd3-3c7e-4612-a132-48eb83ec2d16 on n-h2-854823-8 Oct 04 20:55:04.084599 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-9838edf3-2cae-4c58-8add-eae7ea1f3219 req-4cae9b84-5096-4554-9c55-d0df571aad27 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098216 Oct 04 20:55:04.085781 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2181/4316] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:55:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:55:04.339283 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2ee7a42a-a2a9-46ec-92a6-d89ec5dcca8d tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:55:04.340420 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-2ee7a42a-a2a9-46ec-92a6-d89ec5dcca8d tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] [instance: 866d0dd3-3c7e-4612-a132-48eb83ec2d16] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:55:04.367420 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2ee7a42a-a2a9-46ec-92a6-d89ec5dcca8d tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:04.369664 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2ee7a42a-a2a9-46ec-92a6-d89ec5dcca8d tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:04.370114 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2ee7a42a-a2a9-46ec-92a6-d89ec5dcca8d tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:04.373845 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2ee7a42a-a2a9-46ec-92a6-d89ec5dcca8d tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:04.379136 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2ee7a42a-a2a9-46ec-92a6-d89ec5dcca8d tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:04.379604 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2ee7a42a-a2a9-46ec-92a6-d89ec5dcca8d tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:04.453896 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2ee7a42a-a2a9-46ec-92a6-d89ec5dcca8d tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:04.454408 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2ee7a42a-a2a9-46ec-92a6-d89ec5dcca8d tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:04.458952 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2ee7a42a-a2a9-46ec-92a6-d89ec5dcca8d tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:04.460223 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-2ee7a42a-a2a9-46ec-92a6-d89ec5dcca8d tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lazy-loading 'fault' on Instance uuid 866d0dd3-3c7e-4612-a132-48eb83ec2d16 {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:55:04.564708 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-2ee7a42a-a2a9-46ec-92a6-d89ec5dcca8d tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc4171c0ee14ebb8b5eff5e910ccf49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003eb03a265a496d8981e45c74b014f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:04.570475 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-f3476a28-18e6-4b0f-bf31-1fba3b8b2496 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:55:04.578884 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-f3476a28-18e6-4b0f-bf31-1fba3b8b2496 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] [instance: 67656ca4-09a7-4e6b-bf3a-cfcd254e99e4] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:55:04.594588 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-2ee7a42a-a2a9-46ec-92a6-d89ec5dcca8d tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] 10.222.0.33 "GET /compute/v2.1/servers/866d0dd3-3c7e-4612-a132-48eb83ec2d16" status: 200 len: 1336 microversion: 2.1 time: 0.255108 Oct 04 20:55:04.597403 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2136/4317] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:55:04 2022] GET /compute/v2.1/servers/866d0dd3-3c7e-4612-a132-48eb83ec2d16 => generated 1336 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:55:04.615816 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-caf88d55-3b23-454a-9e73-3c414068f7f3 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:55:04.619656 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f3476a28-18e6-4b0f-bf31-1fba3b8b2496 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:04.620320 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f3476a28-18e6-4b0f-bf31-1fba3b8b2496 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:04.620887 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f3476a28-18e6-4b0f-bf31-1fba3b8b2496 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:04.621736 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f3476a28-18e6-4b0f-bf31-1fba3b8b2496 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:04.626826 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f3476a28-18e6-4b0f-bf31-1fba3b8b2496 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:04.627269 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-caf88d55-3b23-454a-9e73-3c414068f7f3 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] [instance: 601e4070-a868-49c6-b935-87eeeac4a826] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:55:04.627807 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f3476a28-18e6-4b0f-bf31-1fba3b8b2496 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:04.663209 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-caf88d55-3b23-454a-9e73-3c414068f7f3 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:04.663918 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-caf88d55-3b23-454a-9e73-3c414068f7f3 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:04.665359 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-caf88d55-3b23-454a-9e73-3c414068f7f3 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:04.667212 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-caf88d55-3b23-454a-9e73-3c414068f7f3 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:04.670512 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-caf88d55-3b23-454a-9e73-3c414068f7f3 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:04.675355 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-caf88d55-3b23-454a-9e73-3c414068f7f3 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:05.023459 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-caf88d55-3b23-454a-9e73-3c414068f7f3 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4adee36830c640919981ae58bd326157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '589fcee1949d4820a8958ec55ce4b43a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:05.044180 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-caf88d55-3b23-454a-9e73-3c414068f7f3 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4adee36830c640919981ae58bd326157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '589fcee1949d4820a8958ec55ce4b43a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:05.045610 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-caf88d55-3b23-454a-9e73-3c414068f7f3 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4adee36830c640919981ae58bd326157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '589fcee1949d4820a8958ec55ce4b43a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:05.057673 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-caf88d55-3b23-454a-9e73-3c414068f7f3 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] 10.222.0.33 "GET /compute/v2.1/servers/601e4070-a868-49c6-b935-87eeeac4a826" status: 200 len: 1365 microversion: 2.47 time: 0.459038 Oct 04 20:55:05.058322 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2137/4318] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:55:04 2022] GET /compute/v2.1/servers/601e4070-a868-49c6-b935-87eeeac4a826 => generated 1365 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:55:05.628443 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c0144f5a-6fd0-48ab-85ab-19ad2389cf16 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:55:05.630117 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c0144f5a-6fd0-48ab-85ab-19ad2389cf16 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] [instance: 866d0dd3-3c7e-4612-a132-48eb83ec2d16] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:55:05.646555 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c0144f5a-6fd0-48ab-85ab-19ad2389cf16 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:05.647291 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c0144f5a-6fd0-48ab-85ab-19ad2389cf16 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:05.647922 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c0144f5a-6fd0-48ab-85ab-19ad2389cf16 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:05.649718 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c0144f5a-6fd0-48ab-85ab-19ad2389cf16 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:05.650466 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c0144f5a-6fd0-48ab-85ab-19ad2389cf16 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:05.651192 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c0144f5a-6fd0-48ab-85ab-19ad2389cf16 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:05.706681 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-c0144f5a-6fd0-48ab-85ab-19ad2389cf16 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] HTTP exception thrown: Instance 866d0dd3-3c7e-4612-a132-48eb83ec2d16 could not be found. Oct 04 20:55:05.713962 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c0144f5a-6fd0-48ab-85ab-19ad2389cf16 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Request method failure captured: Oct 04 20:55:05.713962 n-d-854823-8 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/866d0dd3-3c7e-4612-a132-48eb83ec2d16 HTTP/1.1 Oct 04 20:55:05.713962 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:55:05.713962 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:55:05.713962 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:55:05.713962 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 0 Oct 04 20:55:05.713962 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:55:05.713962 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:55:05.713962 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:55:05.713962 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:55:05.713962 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJyQzA2j2TP516GvcpxgrBfRY2YO9l5F5hDF6OrxoVmO38Ubui7rW9ilb7hzquPDxl35ZSulQSvQlms9Io4ULkRGXw-K9Mq_8wy4teEQxOMGhx3owN2R9ZyECEeAocP_VsKpWXZTRpHKvfvEO-wS1AA94MTw8YrFoFgm4uO6w6GPzhQ Oct 04 20:55:05.713962 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:55:05.713962 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:55:05.713962 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:55:05.713962 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:55:05.713962 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:55:05.713962 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:55:05.713962 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: 003eb03a265a496d8981e45c74b014f3 Oct 04 20:55:05.713962 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2028044299 Oct 04 20:55:05.713962 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 20:55:05.713962 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 20:55:05.713962 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_003eb03a265a496d8981e45c74b014f3", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/003eb03a265a496d8981e45c74b014f3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/003eb03a265a496d8981e45c74b014f3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/003eb03a265a496d8981e45c74b014f3"}]}] Oct 04 20:55:05.713962 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2028044299 Oct 04 20:55:05.713962 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: 003eb03a265a496d8981e45c74b014f3 Oct 04 20:55:05.713962 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2028044299 Oct 04 20:55:05.713962 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-ServerRescueNegativeTestJSON-2028044299-project Oct 04 20:55:05.713962 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:55:05.713962 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:55:05.713962 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: 4dc4171c0ee14ebb8b5eff5e910ccf49 Oct 04 20:55:05.713962 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2028044299-project Oct 04 20:55:05.713962 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 20:55:05.713962 n-d-854823-8 devstack@n-api.service[128801]: exception: Instance 866d0dd3-3c7e-4612-a132-48eb83ec2d16 could not be found. Oct 04 20:55:05.713962 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': '866d0dd3-3c7e-4612-a132-48eb83ec2d16'} Oct 04 20:55:05.713962 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:55:05.713962 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:55:05.713962 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:55:05.713962 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:55:05.713962 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:55:05.713962 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:55:05.713962 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:55:05.713962 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:55:05.713962 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:55:05.713962 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:55:05.713962 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 866d0dd3-3c7e-4612-a132-48eb83ec2d16 could not be found. Oct 04 20:55:05.713962 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:55:05.713962 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:55:05.713962 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:55:05.713962 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:55:05.713962 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:55:05.713962 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:55:05.713962 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:55:05.713962 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:55:05.713962 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:55:05.713962 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:55:05.713962 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:55:05.713962 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:55:05.713962 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:55:05.713962 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:55:05.713962 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:55:05.713962 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:55:05.713962 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 866d0dd3-3c7e-4612-a132-48eb83ec2d16 could not be found. Oct 04 20:55:05.713962 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:55:05.713962 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:55:05.718148 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:55:05.718148 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:55:05.718148 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:55:05.718148 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:55:05.718148 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:55:05.718148 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:55:05.718148 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 866d0dd3-3c7e-4612-a132-48eb83ec2d16 could not be found. Oct 04 20:55:05.718148 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:55:05.718148 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c0144f5a-6fd0-48ab-85ab-19ad2389cf16 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Returning 404 to user: Instance 866d0dd3-3c7e-4612-a132-48eb83ec2d16 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:55:05.718977 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c0144f5a-6fd0-48ab-85ab-19ad2389cf16 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] 10.222.0.33 "GET /compute/v2.1/servers/866d0dd3-3c7e-4612-a132-48eb83ec2d16" status: 404 len: 111 microversion: 2.1 time: 0.095787 Oct 04 20:55:05.720109 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2138/4319] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:55:05 2022] GET /compute/v2.1/servers/866d0dd3-3c7e-4612-a132-48eb83ec2d16 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:55:05.728908 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2392a4bb-da74-4c05-93f3-724122b4dc25 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Calling method '.version_select at 0x7f3c6f338790>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:55:05.769349 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-2392a4bb-da74-4c05-93f3-724122b4dc25 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1696294849" status: 202 len: 0 microversion: 2.1 time: 0.045012 Oct 04 20:55:05.772567 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2139/4320] 10.222.0.33 () {58 vars in 1221 bytes} [Tue Oct 4 20:55:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1696294849 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 20:55:06.078099 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-f3476a28-18e6-4b0f-bf31-1fba3b8b2496 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e93855201ca64c779f92a2a33979b81f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed328a1e964d46902dee5e1c7c7b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:06.092197 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-dc5bdcbe-4081-466d-b0e1-7c709d3a6d9c tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:55:06.093139 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-dc5bdcbe-4081-466d-b0e1-7c709d3a6d9c tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] [instance: 601e4070-a868-49c6-b935-87eeeac4a826] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:55:06.094666 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-f3476a28-18e6-4b0f-bf31-1fba3b8b2496 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] 10.222.0.33 "GET /compute/v2.1/servers/67656ca4-09a7-4e6b-bf3a-cfcd254e99e4" status: 200 len: 1517 microversion: 2.1 time: 1.539715 Oct 04 20:55:06.095709 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2182/4321] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:55:04 2022] GET /compute/v2.1/servers/67656ca4-09a7-4e6b-bf3a-cfcd254e99e4 => generated 1517 bytes in 1542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:55:06.122927 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dc5bdcbe-4081-466d-b0e1-7c709d3a6d9c tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:06.123443 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dc5bdcbe-4081-466d-b0e1-7c709d3a6d9c tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:06.123882 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dc5bdcbe-4081-466d-b0e1-7c709d3a6d9c tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:06.124919 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dc5bdcbe-4081-466d-b0e1-7c709d3a6d9c tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:06.125577 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dc5bdcbe-4081-466d-b0e1-7c709d3a6d9c tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:06.126240 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dc5bdcbe-4081-466d-b0e1-7c709d3a6d9c tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:06.329180 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-dc5bdcbe-4081-466d-b0e1-7c709d3a6d9c tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4adee36830c640919981ae58bd326157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '589fcee1949d4820a8958ec55ce4b43a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:06.348208 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-dc5bdcbe-4081-466d-b0e1-7c709d3a6d9c tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4adee36830c640919981ae58bd326157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '589fcee1949d4820a8958ec55ce4b43a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:06.350571 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-dc5bdcbe-4081-466d-b0e1-7c709d3a6d9c tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4adee36830c640919981ae58bd326157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '589fcee1949d4820a8958ec55ce4b43a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:06.353120 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-dc5bdcbe-4081-466d-b0e1-7c709d3a6d9c tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] 10.222.0.33 "GET /compute/v2.1/servers/601e4070-a868-49c6-b935-87eeeac4a826" status: 200 len: 1365 microversion: 2.47 time: 0.267296 Oct 04 20:55:06.362429 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2140/4322] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:55:06 2022] GET /compute/v2.1/servers/601e4070-a868-49c6-b935-87eeeac4a826 => generated 1365 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 20:55:07.128370 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-25ce9881-4413-4a8a-adb3-315a0daeddd8 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:55:07.129151 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-25ce9881-4413-4a8a-adb3-315a0daeddd8 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] [instance: 67656ca4-09a7-4e6b-bf3a-cfcd254e99e4] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:55:07.154134 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-25ce9881-4413-4a8a-adb3-315a0daeddd8 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:07.154668 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-25ce9881-4413-4a8a-adb3-315a0daeddd8 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:07.155188 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-25ce9881-4413-4a8a-adb3-315a0daeddd8 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:07.155992 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-25ce9881-4413-4a8a-adb3-315a0daeddd8 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:07.156536 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-25ce9881-4413-4a8a-adb3-315a0daeddd8 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:07.157032 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-25ce9881-4413-4a8a-adb3-315a0daeddd8 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:07.383319 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-fccb9dcc-2108-4f57-9c8e-6e9b11fe11e7 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:55:07.385342 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-fccb9dcc-2108-4f57-9c8e-6e9b11fe11e7 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] [instance: 601e4070-a868-49c6-b935-87eeeac4a826] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:55:07.432877 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fccb9dcc-2108-4f57-9c8e-6e9b11fe11e7 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:07.436783 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fccb9dcc-2108-4f57-9c8e-6e9b11fe11e7 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:07.437501 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fccb9dcc-2108-4f57-9c8e-6e9b11fe11e7 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:07.438482 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fccb9dcc-2108-4f57-9c8e-6e9b11fe11e7 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:07.439196 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fccb9dcc-2108-4f57-9c8e-6e9b11fe11e7 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:07.439818 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fccb9dcc-2108-4f57-9c8e-6e9b11fe11e7 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:07.692693 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-fccb9dcc-2108-4f57-9c8e-6e9b11fe11e7 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4adee36830c640919981ae58bd326157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '589fcee1949d4820a8958ec55ce4b43a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:07.718995 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-fccb9dcc-2108-4f57-9c8e-6e9b11fe11e7 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4adee36830c640919981ae58bd326157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '589fcee1949d4820a8958ec55ce4b43a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:07.720544 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-fccb9dcc-2108-4f57-9c8e-6e9b11fe11e7 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4adee36830c640919981ae58bd326157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '589fcee1949d4820a8958ec55ce4b43a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:07.728738 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-25ce9881-4413-4a8a-adb3-315a0daeddd8 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e93855201ca64c779f92a2a33979b81f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed328a1e964d46902dee5e1c7c7b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:07.733174 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-fccb9dcc-2108-4f57-9c8e-6e9b11fe11e7 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] 10.222.0.33 "GET /compute/v2.1/servers/601e4070-a868-49c6-b935-87eeeac4a826" status: 200 len: 1365 microversion: 2.47 time: 0.355701 Oct 04 20:55:07.734610 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2141/4323] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:55:07 2022] GET /compute/v2.1/servers/601e4070-a868-49c6-b935-87eeeac4a826 => generated 1365 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:55:07.780788 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-25ce9881-4413-4a8a-adb3-315a0daeddd8 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] 10.222.0.33 "GET /compute/v2.1/servers/67656ca4-09a7-4e6b-bf3a-cfcd254e99e4" status: 200 len: 1517 microversion: 2.1 time: 0.661349 Oct 04 20:55:07.796178 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2183/4324] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:55:07 2022] GET /compute/v2.1/servers/67656ca4-09a7-4e6b-bf3a-cfcd254e99e4 => generated 1517 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:55:08.767478 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e9880d4d-9228-48c0-825f-e9aae134d4a7 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:55:08.769082 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e9880d4d-9228-48c0-825f-e9aae134d4a7 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] [instance: 601e4070-a868-49c6-b935-87eeeac4a826] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:55:08.796380 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e9880d4d-9228-48c0-825f-e9aae134d4a7 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:08.799741 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e9880d4d-9228-48c0-825f-e9aae134d4a7 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:08.801349 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e9880d4d-9228-48c0-825f-e9aae134d4a7 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:08.805764 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e9880d4d-9228-48c0-825f-e9aae134d4a7 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:08.807473 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e9880d4d-9228-48c0-825f-e9aae134d4a7 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:08.808131 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e9880d4d-9228-48c0-825f-e9aae134d4a7 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:08.811902 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-f8a19393-c381-43a2-9f98-11d0b563ab3e tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:55:08.815474 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-f8a19393-c381-43a2-9f98-11d0b563ab3e tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] [instance: 67656ca4-09a7-4e6b-bf3a-cfcd254e99e4] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:55:08.842818 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f8a19393-c381-43a2-9f98-11d0b563ab3e tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:08.844761 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f8a19393-c381-43a2-9f98-11d0b563ab3e tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:08.846262 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f8a19393-c381-43a2-9f98-11d0b563ab3e tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:08.850994 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f8a19393-c381-43a2-9f98-11d0b563ab3e tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:08.852094 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f8a19393-c381-43a2-9f98-11d0b563ab3e tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:08.854420 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f8a19393-c381-43a2-9f98-11d0b563ab3e tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:09.150446 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e9880d4d-9228-48c0-825f-e9aae134d4a7 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4adee36830c640919981ae58bd326157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '589fcee1949d4820a8958ec55ce4b43a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:09.172913 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e9880d4d-9228-48c0-825f-e9aae134d4a7 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4adee36830c640919981ae58bd326157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '589fcee1949d4820a8958ec55ce4b43a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:09.174417 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e9880d4d-9228-48c0-825f-e9aae134d4a7 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4adee36830c640919981ae58bd326157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '589fcee1949d4820a8958ec55ce4b43a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:09.175993 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e9880d4d-9228-48c0-825f-e9aae134d4a7 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] 10.222.0.33 "GET /compute/v2.1/servers/601e4070-a868-49c6-b935-87eeeac4a826" status: 200 len: 1365 microversion: 2.47 time: 0.418590 Oct 04 20:55:09.192895 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2142/4325] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:55:08 2022] GET /compute/v2.1/servers/601e4070-a868-49c6-b935-87eeeac4a826 => generated 1365 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:55:09.310045 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-f8a19393-c381-43a2-9f98-11d0b563ab3e tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e93855201ca64c779f92a2a33979b81f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed328a1e964d46902dee5e1c7c7b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:09.321197 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-f8a19393-c381-43a2-9f98-11d0b563ab3e tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] 10.222.0.33 "GET /compute/v2.1/servers/67656ca4-09a7-4e6b-bf3a-cfcd254e99e4" status: 200 len: 1517 microversion: 2.1 time: 0.517384 Oct 04 20:55:09.321832 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2184/4326] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:55:08 2022] GET /compute/v2.1/servers/67656ca4-09a7-4e6b-bf3a-cfcd254e99e4 => generated 1517 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:55:10.213139 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-474433d5-2472-4d2d-bb37-596a847cfdd0 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:55:10.216321 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-474433d5-2472-4d2d-bb37-596a847cfdd0 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] [instance: 601e4070-a868-49c6-b935-87eeeac4a826] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:55:10.255169 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-474433d5-2472-4d2d-bb37-596a847cfdd0 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:10.255792 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-474433d5-2472-4d2d-bb37-596a847cfdd0 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:10.257685 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-474433d5-2472-4d2d-bb37-596a847cfdd0 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:10.259435 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-474433d5-2472-4d2d-bb37-596a847cfdd0 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:10.259919 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-474433d5-2472-4d2d-bb37-596a847cfdd0 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:10.260357 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-474433d5-2472-4d2d-bb37-596a847cfdd0 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:10.349289 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-e3fd4c18-1c08-4715-8f56-be50338a6177 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:55:10.349686 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-e3fd4c18-1c08-4715-8f56-be50338a6177 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] [instance: 67656ca4-09a7-4e6b-bf3a-cfcd254e99e4] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:55:10.361135 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e3fd4c18-1c08-4715-8f56-be50338a6177 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:10.363092 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e3fd4c18-1c08-4715-8f56-be50338a6177 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:10.363550 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e3fd4c18-1c08-4715-8f56-be50338a6177 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:10.366463 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e3fd4c18-1c08-4715-8f56-be50338a6177 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:10.368664 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e3fd4c18-1c08-4715-8f56-be50338a6177 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:10.369700 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e3fd4c18-1c08-4715-8f56-be50338a6177 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:10.692723 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-474433d5-2472-4d2d-bb37-596a847cfdd0 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4adee36830c640919981ae58bd326157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '589fcee1949d4820a8958ec55ce4b43a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:10.706420 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:55:10.712601 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-474433d5-2472-4d2d-bb37-596a847cfdd0 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4adee36830c640919981ae58bd326157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '589fcee1949d4820a8958ec55ce4b43a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:10.717452 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-474433d5-2472-4d2d-bb37-596a847cfdd0 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4adee36830c640919981ae58bd326157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '589fcee1949d4820a8958ec55ce4b43a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:10.733341 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-474433d5-2472-4d2d-bb37-596a847cfdd0 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] 10.222.0.33 "GET /compute/v2.1/servers/601e4070-a868-49c6-b935-87eeeac4a826" status: 200 len: 1365 microversion: 2.47 time: 0.530245 Oct 04 20:55:10.758213 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2143/4327] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:55:10 2022] GET /compute/v2.1/servers/601e4070-a868-49c6-b935-87eeeac4a826 => generated 1365 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:55:11.004682 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-e3fd4c18-1c08-4715-8f56-be50338a6177 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e93855201ca64c779f92a2a33979b81f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed328a1e964d46902dee5e1c7c7b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:11.022818 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-e3fd4c18-1c08-4715-8f56-be50338a6177 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] 10.222.0.33 "GET /compute/v2.1/servers/67656ca4-09a7-4e6b-bf3a-cfcd254e99e4" status: 200 len: 1517 microversion: 2.1 time: 0.678122 Oct 04 20:55:11.023596 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2185/4328] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:55:10 2022] GET /compute/v2.1/servers/67656ca4-09a7-4e6b-bf3a-cfcd254e99e4 => generated 1517 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:55:11.765587 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-29f4881e-f253-4161-b15c-e4f93bcf2b18 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:55:11.766971 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-29f4881e-f253-4161-b15c-e4f93bcf2b18 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] [instance: 601e4070-a868-49c6-b935-87eeeac4a826] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:55:11.795986 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-29f4881e-f253-4161-b15c-e4f93bcf2b18 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:11.799961 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-29f4881e-f253-4161-b15c-e4f93bcf2b18 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:11.801915 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-29f4881e-f253-4161-b15c-e4f93bcf2b18 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:11.803277 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-29f4881e-f253-4161-b15c-e4f93bcf2b18 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:11.807537 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-29f4881e-f253-4161-b15c-e4f93bcf2b18 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:11.810446 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-29f4881e-f253-4161-b15c-e4f93bcf2b18 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:12.042063 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-29f4881e-f253-4161-b15c-e4f93bcf2b18 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4adee36830c640919981ae58bd326157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '589fcee1949d4820a8958ec55ce4b43a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:12.046829 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-e0ddb4e1-19ed-4a46-808f-70a8dabb57fb tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:55:12.047986 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-e0ddb4e1-19ed-4a46-808f-70a8dabb57fb tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] [instance: 67656ca4-09a7-4e6b-bf3a-cfcd254e99e4] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:55:12.054183 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-29f4881e-f253-4161-b15c-e4f93bcf2b18 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4adee36830c640919981ae58bd326157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '589fcee1949d4820a8958ec55ce4b43a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:12.061759 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-29f4881e-f253-4161-b15c-e4f93bcf2b18 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4adee36830c640919981ae58bd326157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '589fcee1949d4820a8958ec55ce4b43a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:12.067056 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-29f4881e-f253-4161-b15c-e4f93bcf2b18 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] 10.222.0.33 "GET /compute/v2.1/servers/601e4070-a868-49c6-b935-87eeeac4a826" status: 200 len: 1365 microversion: 2.47 time: 0.306389 Oct 04 20:55:12.069575 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e0ddb4e1-19ed-4a46-808f-70a8dabb57fb tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:12.071153 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e0ddb4e1-19ed-4a46-808f-70a8dabb57fb tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:12.072214 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e0ddb4e1-19ed-4a46-808f-70a8dabb57fb tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:12.075260 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e0ddb4e1-19ed-4a46-808f-70a8dabb57fb tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:12.075916 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e0ddb4e1-19ed-4a46-808f-70a8dabb57fb tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:12.076896 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e0ddb4e1-19ed-4a46-808f-70a8dabb57fb tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:12.091605 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2144/4329] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:55:11 2022] GET /compute/v2.1/servers/601e4070-a868-49c6-b935-87eeeac4a826 => generated 1365 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:55:12.810317 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-e0ddb4e1-19ed-4a46-808f-70a8dabb57fb tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e93855201ca64c779f92a2a33979b81f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed328a1e964d46902dee5e1c7c7b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:12.827221 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-e0ddb4e1-19ed-4a46-808f-70a8dabb57fb tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] 10.222.0.33 "GET /compute/v2.1/servers/67656ca4-09a7-4e6b-bf3a-cfcd254e99e4" status: 200 len: 1517 microversion: 2.1 time: 0.781568 Oct 04 20:55:12.828861 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2186/4330] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:55:12 2022] GET /compute/v2.1/servers/67656ca4-09a7-4e6b-bf3a-cfcd254e99e4 => generated 1517 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:55:13.100576 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5704b980-fb39-489d-8259-7ddf0990433f tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:55:13.101258 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-5704b980-fb39-489d-8259-7ddf0990433f tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] [instance: 601e4070-a868-49c6-b935-87eeeac4a826] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:55:13.118128 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5704b980-fb39-489d-8259-7ddf0990433f tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:13.118660 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5704b980-fb39-489d-8259-7ddf0990433f tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:13.119098 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5704b980-fb39-489d-8259-7ddf0990433f tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:13.123747 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5704b980-fb39-489d-8259-7ddf0990433f tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:13.124438 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5704b980-fb39-489d-8259-7ddf0990433f tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:13.124882 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5704b980-fb39-489d-8259-7ddf0990433f tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:13.325992 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-5704b980-fb39-489d-8259-7ddf0990433f tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4adee36830c640919981ae58bd326157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '589fcee1949d4820a8958ec55ce4b43a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:13.341575 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-5704b980-fb39-489d-8259-7ddf0990433f tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4adee36830c640919981ae58bd326157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '589fcee1949d4820a8958ec55ce4b43a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:13.345282 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-5704b980-fb39-489d-8259-7ddf0990433f tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4adee36830c640919981ae58bd326157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '589fcee1949d4820a8958ec55ce4b43a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:13.351385 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5704b980-fb39-489d-8259-7ddf0990433f tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] 10.222.0.33 "GET /compute/v2.1/servers/601e4070-a868-49c6-b935-87eeeac4a826" status: 200 len: 1365 microversion: 2.47 time: 0.255188 Oct 04 20:55:13.353979 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2145/4331] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:55:13 2022] GET /compute/v2.1/servers/601e4070-a868-49c6-b935-87eeeac4a826 => generated 1365 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:55:13.858563 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-144aef55-e766-4197-8b4a-d685af906abb tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:55:13.861421 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-144aef55-e766-4197-8b4a-d685af906abb tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] [instance: 67656ca4-09a7-4e6b-bf3a-cfcd254e99e4] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:55:13.895597 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-144aef55-e766-4197-8b4a-d685af906abb tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:13.896101 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-144aef55-e766-4197-8b4a-d685af906abb tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:13.896548 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-144aef55-e766-4197-8b4a-d685af906abb tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:13.897279 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-144aef55-e766-4197-8b4a-d685af906abb tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:13.909749 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-144aef55-e766-4197-8b4a-d685af906abb tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:13.910208 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-144aef55-e766-4197-8b4a-d685af906abb tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:14.475814 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-144aef55-e766-4197-8b4a-d685af906abb tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e93855201ca64c779f92a2a33979b81f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed328a1e964d46902dee5e1c7c7b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:14.487513 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-144aef55-e766-4197-8b4a-d685af906abb tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] 10.222.0.33 "GET /compute/v2.1/servers/67656ca4-09a7-4e6b-bf3a-cfcd254e99e4" status: 200 len: 1517 microversion: 2.1 time: 0.639714 Oct 04 20:55:14.489318 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a289e218-a4d7-4ea3-b09b-48bf5df14ab8 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-tempest.common.compute-instance-681760016", "imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63", "flavorRef": "452", "min_count": 2, "networks": [{"uuid": "0d88e810-91e7-4fd1-af36-97484029ba46"}]}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:55:14.514143 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2187/4332] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:55:13 2022] GET /compute/v2.1/servers/67656ca4-09a7-4e6b-bf3a-cfcd254e99e4 => generated 1517 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:55:14.529276 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-3e179db5-32ae-46d7-8f74-3123bbdf6c6e tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:55:14.552572 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-3e179db5-32ae-46d7-8f74-3123bbdf6c6e tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] [instance: 601e4070-a868-49c6-b935-87eeeac4a826] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:55:14.580796 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.network.neutron [None req-a289e218-a4d7-4ea3-b09b-48bf5df14ab8 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] validate_networks() for [('0d88e810-91e7-4fd1-af36-97484029ba46', None, None, None, None, None)] {{(pid=128801) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:55:14.588823 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3e179db5-32ae-46d7-8f74-3123bbdf6c6e tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:14.591042 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3e179db5-32ae-46d7-8f74-3123bbdf6c6e tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:14.591617 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3e179db5-32ae-46d7-8f74-3123bbdf6c6e tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:14.593611 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3e179db5-32ae-46d7-8f74-3123bbdf6c6e tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:14.600169 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3e179db5-32ae-46d7-8f74-3123bbdf6c6e tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:14.603015 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3e179db5-32ae-46d7-8f74-3123bbdf6c6e tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:14.984270 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-3e179db5-32ae-46d7-8f74-3123bbdf6c6e tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4adee36830c640919981ae58bd326157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '589fcee1949d4820a8958ec55ce4b43a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:14.996074 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-3e179db5-32ae-46d7-8f74-3123bbdf6c6e tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4adee36830c640919981ae58bd326157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '589fcee1949d4820a8958ec55ce4b43a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:15.000694 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-3e179db5-32ae-46d7-8f74-3123bbdf6c6e tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4adee36830c640919981ae58bd326157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '589fcee1949d4820a8958ec55ce4b43a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:15.004922 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-3e179db5-32ae-46d7-8f74-3123bbdf6c6e tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] 10.222.0.33 "GET /compute/v2.1/servers/601e4070-a868-49c6-b935-87eeeac4a826" status: 200 len: 1365 microversion: 2.47 time: 0.489140 Oct 04 20:55:15.007794 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2188/4333] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:55:14 2022] GET /compute/v2.1/servers/601e4070-a868-49c6-b935-87eeeac4a826 => generated 1365 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:55:15.531675 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-efe70e23-9bea-443b-9249-2e0150d93954 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:55:15.532837 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-efe70e23-9bea-443b-9249-2e0150d93954 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] [instance: 67656ca4-09a7-4e6b-bf3a-cfcd254e99e4] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:55:15.541319 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-efe70e23-9bea-443b-9249-2e0150d93954 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:15.550712 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-efe70e23-9bea-443b-9249-2e0150d93954 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:15.552012 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-efe70e23-9bea-443b-9249-2e0150d93954 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:15.553158 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-efe70e23-9bea-443b-9249-2e0150d93954 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:15.559708 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-efe70e23-9bea-443b-9249-2e0150d93954 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:15.560432 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-efe70e23-9bea-443b-9249-2e0150d93954 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:16.423824 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-efe70e23-9bea-443b-9249-2e0150d93954 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e93855201ca64c779f92a2a33979b81f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed328a1e964d46902dee5e1c7c7b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:16.427604 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=99 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:55:16.448964 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-efe70e23-9bea-443b-9249-2e0150d93954 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] 10.222.0.33 "GET /compute/v2.1/servers/67656ca4-09a7-4e6b-bf3a-cfcd254e99e4" status: 200 len: 1517 microversion: 2.1 time: 0.921084 Oct 04 20:55:16.450367 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2189/4334] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:55:15 2022] GET /compute/v2.1/servers/67656ca4-09a7-4e6b-bf3a-cfcd254e99e4 => generated 1517 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:55:16.465846 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-451f1ae0-8128-4013-a0ab-c39a987548ee tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:55:16.471806 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-451f1ae0-8128-4013-a0ab-c39a987548ee tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] [instance: 601e4070-a868-49c6-b935-87eeeac4a826] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:55:16.510959 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-451f1ae0-8128-4013-a0ab-c39a987548ee tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:16.511608 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-451f1ae0-8128-4013-a0ab-c39a987548ee tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:16.512153 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-451f1ae0-8128-4013-a0ab-c39a987548ee tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:16.512968 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-451f1ae0-8128-4013-a0ab-c39a987548ee tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:16.513661 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-451f1ae0-8128-4013-a0ab-c39a987548ee tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:16.514333 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-451f1ae0-8128-4013-a0ab-c39a987548ee tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:16.542673 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-a289e218-a4d7-4ea3-b09b-48bf5df14ab8 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Flavor limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:55:16.543594 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-a289e218-a4d7-4ea3-b09b-48bf5df14ab8 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Image limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:55:16.544165 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-a289e218-a4d7-4ea3-b09b-48bf5df14ab8 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Flavor pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:55:16.545001 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-a289e218-a4d7-4ea3-b09b-48bf5df14ab8 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Image pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:55:16.545869 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-a289e218-a4d7-4ea3-b09b-48bf5df14ab8 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:55:16.612106 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a289e218-a4d7-4ea3-b09b-48bf5df14ab8 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:16.612925 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a289e218-a4d7-4ea3-b09b-48bf5df14ab8 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:16.613627 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a289e218-a4d7-4ea3-b09b-48bf5df14ab8 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:16.626586 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a289e218-a4d7-4ea3-b09b-48bf5df14ab8 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:16.627387 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a289e218-a4d7-4ea3-b09b-48bf5df14ab8 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:16.628117 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a289e218-a4d7-4ea3-b09b-48bf5df14ab8 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:16.730772 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-a289e218-a4d7-4ea3-b09b-48bf5df14ab8 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Getting quotas for project c7df9bc3521c479d9c16d3516b014cc6. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:55:16.759080 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-a289e218-a4d7-4ea3-b09b-48bf5df14ab8 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Getting quotas for user 1d9061ddee3d48528f5849b2cc6a1d5b and project c7df9bc3521c479d9c16d3516b014cc6. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:55:16.800148 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a289e218-a4d7-4ea3-b09b-48bf5df14ab8 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Going to run 2 instances... {{(pid=128801) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:55:16.805270 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a289e218-a4d7-4ea3-b09b-48bf5df14ab8 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] [instance: 23613d5c-93a4-4da9-be4e-deac3d259cb5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='15b24725-0c99-4bcf-b1fb-907cdf8e2d63',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128801) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:55:16.828509 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-451f1ae0-8128-4013-a0ab-c39a987548ee tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4adee36830c640919981ae58bd326157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '589fcee1949d4820a8958ec55ce4b43a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:16.852172 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-451f1ae0-8128-4013-a0ab-c39a987548ee tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4adee36830c640919981ae58bd326157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '589fcee1949d4820a8958ec55ce4b43a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:16.862037 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-451f1ae0-8128-4013-a0ab-c39a987548ee tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4adee36830c640919981ae58bd326157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '589fcee1949d4820a8958ec55ce4b43a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:16.870863 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-451f1ae0-8128-4013-a0ab-c39a987548ee tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] 10.222.0.33 "GET /compute/v2.1/servers/601e4070-a868-49c6-b935-87eeeac4a826" status: 200 len: 1365 microversion: 2.47 time: 0.413656 Oct 04 20:55:16.875265 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2190/4335] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:55:16 2022] GET /compute/v2.1/servers/601e4070-a868-49c6-b935-87eeeac4a826 => generated 1365 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:55:16.922912 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a289e218-a4d7-4ea3-b09b-48bf5df14ab8 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] [instance: 0d82589c-f627-44b7-95cd-30e07a27a1a8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='15b24725-0c99-4bcf-b1fb-907cdf8e2d63',instance=,instance_uuid=23613d5c-93a4-4da9-be4e-deac3d259cb5,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128801) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:55:17.181606 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a289e218-a4d7-4ea3-b09b-48bf5df14ab8 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.888125 Oct 04 20:55:17.188234 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2146/4336] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 20:55:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 2896 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 20:55:17.199701 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-3ee917b6-b37e-4973-a06e-68f82a68db78 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:55:17.215490 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-3ee917b6-b37e-4973-a06e-68f82a68db78 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1d9061ddee3d48528f5849b2cc6a1d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7df9bc3521c479d9c16d3516b014cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:17.217499 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-3ee917b6-b37e-4973-a06e-68f82a68db78 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Searching by: {'deleted': False, 'project_id': 'c7df9bc3521c479d9c16d3516b014cc6'} {{(pid=128802) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 20:55:17.350259 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3ee917b6-b37e-4973-a06e-68f82a68db78 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:17.356515 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3ee917b6-b37e-4973-a06e-68f82a68db78 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:17.357206 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3ee917b6-b37e-4973-a06e-68f82a68db78 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:17.358185 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3ee917b6-b37e-4973-a06e-68f82a68db78 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:17.359405 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3ee917b6-b37e-4973-a06e-68f82a68db78 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:17.361805 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3ee917b6-b37e-4973-a06e-68f82a68db78 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:17.441402 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-3ee917b6-b37e-4973-a06e-68f82a68db78 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] 10.222.0.33 "GET /compute/v2.1/servers" status: 200 len: 675 microversion: 2.1 time: 0.245732 Oct 04 20:55:17.454362 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2191/4337] 10.222.0.33 () {58 vars in 1125 bytes} [Tue Oct 4 20:55:17 2022] GET /compute/v2.1/servers => generated 675 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:55:17.460545 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b5df8e95-3103-4f2a-b1c5-2ce16f0094ba tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:55:17.462449 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b5df8e95-3103-4f2a-b1c5-2ce16f0094ba tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] [instance: 0d82589c-f627-44b7-95cd-30e07a27a1a8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:55:17.489035 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-8cf568a7-3c86-41cf-b57a-5215aa3567b4 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:55:17.489905 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-8cf568a7-3c86-41cf-b57a-5215aa3567b4 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] [instance: 67656ca4-09a7-4e6b-bf3a-cfcd254e99e4] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:55:17.511074 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8cf568a7-3c86-41cf-b57a-5215aa3567b4 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:17.511890 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8cf568a7-3c86-41cf-b57a-5215aa3567b4 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:17.512501 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8cf568a7-3c86-41cf-b57a-5215aa3567b4 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:17.513407 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8cf568a7-3c86-41cf-b57a-5215aa3567b4 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:17.514603 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8cf568a7-3c86-41cf-b57a-5215aa3567b4 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:17.515227 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8cf568a7-3c86-41cf-b57a-5215aa3567b4 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:17.673579 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-b5df8e95-3103-4f2a-b1c5-2ce16f0094ba tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9061ddee3d48528f5849b2cc6a1d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7df9bc3521c479d9c16d3516b014cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:17.685726 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b5df8e95-3103-4f2a-b1c5-2ce16f0094ba tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] 10.222.0.33 "GET /compute/v2.1/servers/0d82589c-f627-44b7-95cd-30e07a27a1a8" status: 200 len: 1219 microversion: 2.1 time: 0.228145 Oct 04 20:55:17.686623 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2147/4338] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:55:17 2022] GET /compute/v2.1/servers/0d82589c-f627-44b7-95cd-30e07a27a1a8 => generated 1219 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:55:17.900866 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-233e6326-beee-4dbf-89f1-4b5790dad15a tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:55:17.901981 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-233e6326-beee-4dbf-89f1-4b5790dad15a tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] [instance: 601e4070-a868-49c6-b935-87eeeac4a826] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:55:17.934113 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-233e6326-beee-4dbf-89f1-4b5790dad15a tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:17.934966 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-233e6326-beee-4dbf-89f1-4b5790dad15a tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:17.936990 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-233e6326-beee-4dbf-89f1-4b5790dad15a tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:17.940333 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-233e6326-beee-4dbf-89f1-4b5790dad15a tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:17.942222 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-233e6326-beee-4dbf-89f1-4b5790dad15a tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:17.944188 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-233e6326-beee-4dbf-89f1-4b5790dad15a tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:18.765313 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-233e6326-beee-4dbf-89f1-4b5790dad15a tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4adee36830c640919981ae58bd326157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '589fcee1949d4820a8958ec55ce4b43a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:18.777709 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-233e6326-beee-4dbf-89f1-4b5790dad15a tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4adee36830c640919981ae58bd326157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '589fcee1949d4820a8958ec55ce4b43a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:18.786837 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-233e6326-beee-4dbf-89f1-4b5790dad15a tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4adee36830c640919981ae58bd326157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '589fcee1949d4820a8958ec55ce4b43a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:18.791285 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-233e6326-beee-4dbf-89f1-4b5790dad15a tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] 10.222.0.33 "GET /compute/v2.1/servers/601e4070-a868-49c6-b935-87eeeac4a826" status: 200 len: 1365 microversion: 2.47 time: 0.895632 Oct 04 20:55:18.800410 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2148/4339] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:55:17 2022] GET /compute/v2.1/servers/601e4070-a868-49c6-b935-87eeeac4a826 => generated 1365 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 20:55:18.819807 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-97015090-9224-4eae-9af6-98482b8f7f80 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:55:18.821374 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-97015090-9224-4eae-9af6-98482b8f7f80 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] [instance: 0d82589c-f627-44b7-95cd-30e07a27a1a8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:55:19.143227 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-8cf568a7-3c86-41cf-b57a-5215aa3567b4 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e93855201ca64c779f92a2a33979b81f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed328a1e964d46902dee5e1c7c7b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:19.164605 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-8cf568a7-3c86-41cf-b57a-5215aa3567b4 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] 10.222.0.33 "GET /compute/v2.1/servers/67656ca4-09a7-4e6b-bf3a-cfcd254e99e4" status: 200 len: 1517 microversion: 2.1 time: 1.679331 Oct 04 20:55:19.165225 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2192/4340] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:55:17 2022] GET /compute/v2.1/servers/67656ca4-09a7-4e6b-bf3a-cfcd254e99e4 => generated 1517 bytes in 1681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:55:19.236192 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-97015090-9224-4eae-9af6-98482b8f7f80 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9061ddee3d48528f5849b2cc6a1d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7df9bc3521c479d9c16d3516b014cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:19.245958 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-97015090-9224-4eae-9af6-98482b8f7f80 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] 10.222.0.33 "GET /compute/v2.1/servers/0d82589c-f627-44b7-95cd-30e07a27a1a8" status: 200 len: 1219 microversion: 2.1 time: 0.442410 Oct 04 20:55:19.271433 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2149/4341] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:55:18 2022] GET /compute/v2.1/servers/0d82589c-f627-44b7-95cd-30e07a27a1a8 => generated 1219 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:55:19.828832 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-df84d0a5-970f-47cf-ba32-74b2b1b322f0 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:55:19.829761 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-df84d0a5-970f-47cf-ba32-74b2b1b322f0 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] [instance: 601e4070-a868-49c6-b935-87eeeac4a826] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:55:19.851300 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-df84d0a5-970f-47cf-ba32-74b2b1b322f0 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:19.853758 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-df84d0a5-970f-47cf-ba32-74b2b1b322f0 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:19.855229 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-df84d0a5-970f-47cf-ba32-74b2b1b322f0 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:19.857939 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-df84d0a5-970f-47cf-ba32-74b2b1b322f0 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:19.859926 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-df84d0a5-970f-47cf-ba32-74b2b1b322f0 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:19.864171 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-df84d0a5-970f-47cf-ba32-74b2b1b322f0 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:20.189756 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-86b80550-c8c9-43ce-a733-3c092d63e74f tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:55:20.190405 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-86b80550-c8c9-43ce-a733-3c092d63e74f tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] [instance: 67656ca4-09a7-4e6b-bf3a-cfcd254e99e4] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:55:20.207733 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-86b80550-c8c9-43ce-a733-3c092d63e74f tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:20.210581 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-86b80550-c8c9-43ce-a733-3c092d63e74f tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:20.211775 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-86b80550-c8c9-43ce-a733-3c092d63e74f tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:20.213138 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-86b80550-c8c9-43ce-a733-3c092d63e74f tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:20.219048 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-86b80550-c8c9-43ce-a733-3c092d63e74f tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:20.219712 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-86b80550-c8c9-43ce-a733-3c092d63e74f tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:20.825006 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-df84d0a5-970f-47cf-ba32-74b2b1b322f0 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4adee36830c640919981ae58bd326157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '589fcee1949d4820a8958ec55ce4b43a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:20.834670 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-df84d0a5-970f-47cf-ba32-74b2b1b322f0 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4adee36830c640919981ae58bd326157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '589fcee1949d4820a8958ec55ce4b43a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:20.842233 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-df84d0a5-970f-47cf-ba32-74b2b1b322f0 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4adee36830c640919981ae58bd326157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '589fcee1949d4820a8958ec55ce4b43a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:20.844661 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-df84d0a5-970f-47cf-ba32-74b2b1b322f0 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] 10.222.0.33 "GET /compute/v2.1/servers/601e4070-a868-49c6-b935-87eeeac4a826" status: 200 len: 1365 microversion: 2.47 time: 1.020852 Oct 04 20:55:20.848152 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2193/4342] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:55:19 2022] GET /compute/v2.1/servers/601e4070-a868-49c6-b935-87eeeac4a826 => generated 1365 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:55:20.864511 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-aea2fe0a-74a6-4a41-85af-2fb7d6c3d493 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:55:20.865777 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-aea2fe0a-74a6-4a41-85af-2fb7d6c3d493 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] [instance: 0d82589c-f627-44b7-95cd-30e07a27a1a8] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:55:20.879719 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-aea2fe0a-74a6-4a41-85af-2fb7d6c3d493 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:20.881152 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-aea2fe0a-74a6-4a41-85af-2fb7d6c3d493 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:20.882900 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-aea2fe0a-74a6-4a41-85af-2fb7d6c3d493 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:20.886599 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-aea2fe0a-74a6-4a41-85af-2fb7d6c3d493 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:20.888698 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-aea2fe0a-74a6-4a41-85af-2fb7d6c3d493 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:20.892242 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-aea2fe0a-74a6-4a41-85af-2fb7d6c3d493 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:21.074671 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-86b80550-c8c9-43ce-a733-3c092d63e74f tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e93855201ca64c779f92a2a33979b81f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed328a1e964d46902dee5e1c7c7b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:21.092982 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-86b80550-c8c9-43ce-a733-3c092d63e74f tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] 10.222.0.33 "GET /compute/v2.1/servers/67656ca4-09a7-4e6b-bf3a-cfcd254e99e4" status: 200 len: 1517 microversion: 2.1 time: 0.903841 Oct 04 20:55:21.098231 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2150/4343] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:55:20 2022] GET /compute/v2.1/servers/67656ca4-09a7-4e6b-bf3a-cfcd254e99e4 => generated 1517 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:55:21.160387 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-aea2fe0a-74a6-4a41-85af-2fb7d6c3d493 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9061ddee3d48528f5849b2cc6a1d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7df9bc3521c479d9c16d3516b014cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:21.175004 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-aea2fe0a-74a6-4a41-85af-2fb7d6c3d493 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] 10.222.0.33 "GET /compute/v2.1/servers/0d82589c-f627-44b7-95cd-30e07a27a1a8" status: 200 len: 1277 microversion: 2.1 time: 0.325443 Oct 04 20:55:21.175669 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2194/4344] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:55:20 2022] GET /compute/v2.1/servers/0d82589c-f627-44b7-95cd-30e07a27a1a8 => generated 1277 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:55:21.886632 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-acea5407-7149-4ee5-9b22-adb33060019c tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:55:21.888418 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-acea5407-7149-4ee5-9b22-adb33060019c tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] [instance: 601e4070-a868-49c6-b935-87eeeac4a826] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:55:21.906669 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-acea5407-7149-4ee5-9b22-adb33060019c tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:21.907545 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-acea5407-7149-4ee5-9b22-adb33060019c tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:21.909793 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-acea5407-7149-4ee5-9b22-adb33060019c tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:21.910744 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-acea5407-7149-4ee5-9b22-adb33060019c tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:21.912235 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-acea5407-7149-4ee5-9b22-adb33060019c tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:21.912828 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-acea5407-7149-4ee5-9b22-adb33060019c tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:22.119659 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-acea5407-7149-4ee5-9b22-adb33060019c tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4adee36830c640919981ae58bd326157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '589fcee1949d4820a8958ec55ce4b43a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:22.124308 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-b4b085d4-1e19-4d00-b001-43daf530b480 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:55:22.124929 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-b4b085d4-1e19-4d00-b001-43daf530b480 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] [instance: 67656ca4-09a7-4e6b-bf3a-cfcd254e99e4] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:55:22.133586 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-acea5407-7149-4ee5-9b22-adb33060019c tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4adee36830c640919981ae58bd326157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '589fcee1949d4820a8958ec55ce4b43a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:22.136299 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-acea5407-7149-4ee5-9b22-adb33060019c tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4adee36830c640919981ae58bd326157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '589fcee1949d4820a8958ec55ce4b43a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:22.137900 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-acea5407-7149-4ee5-9b22-adb33060019c tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] 10.222.0.33 "GET /compute/v2.1/servers/601e4070-a868-49c6-b935-87eeeac4a826" status: 200 len: 1371 microversion: 2.47 time: 0.261216 Oct 04 20:55:22.145562 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b4b085d4-1e19-4d00-b001-43daf530b480 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:22.146298 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b4b085d4-1e19-4d00-b001-43daf530b480 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:22.146923 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b4b085d4-1e19-4d00-b001-43daf530b480 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:22.147828 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b4b085d4-1e19-4d00-b001-43daf530b480 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:22.148485 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b4b085d4-1e19-4d00-b001-43daf530b480 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:22.148643 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2151/4345] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:55:21 2022] GET /compute/v2.1/servers/601e4070-a868-49c6-b935-87eeeac4a826 => generated 1371 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:55:22.153765 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b4b085d4-1e19-4d00-b001-43daf530b480 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:22.202723 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f8b1e1d1-5669-4109-8ff9-be917bcd4dd4 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:55:22.203417 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f8b1e1d1-5669-4109-8ff9-be917bcd4dd4 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] [instance: 0d82589c-f627-44b7-95cd-30e07a27a1a8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:55:22.215925 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f8b1e1d1-5669-4109-8ff9-be917bcd4dd4 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:22.216434 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f8b1e1d1-5669-4109-8ff9-be917bcd4dd4 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:22.216876 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f8b1e1d1-5669-4109-8ff9-be917bcd4dd4 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:22.217594 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f8b1e1d1-5669-4109-8ff9-be917bcd4dd4 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:22.218091 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f8b1e1d1-5669-4109-8ff9-be917bcd4dd4 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:22.218551 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f8b1e1d1-5669-4109-8ff9-be917bcd4dd4 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:22.358542 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f8b1e1d1-5669-4109-8ff9-be917bcd4dd4 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9061ddee3d48528f5849b2cc6a1d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7df9bc3521c479d9c16d3516b014cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:22.366669 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f8b1e1d1-5669-4109-8ff9-be917bcd4dd4 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] 10.222.0.33 "GET /compute/v2.1/servers/0d82589c-f627-44b7-95cd-30e07a27a1a8" status: 200 len: 1277 microversion: 2.1 time: 0.168857 Oct 04 20:55:22.370676 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2152/4346] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:55:22 2022] GET /compute/v2.1/servers/0d82589c-f627-44b7-95cd-30e07a27a1a8 => generated 1277 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:55:22.849080 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-72f08259-a8a2-4a45-9c48-634b6863c495 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:55:22.849860 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-72f08259-a8a2-4a45-9c48-634b6863c495 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] [instance: f15ae3c9-8342-4ae9-b81e-2d7b1aecb2e8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:55:22.860420 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-72f08259-a8a2-4a45-9c48-634b6863c495 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:22.860908 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-72f08259-a8a2-4a45-9c48-634b6863c495 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:22.861345 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-72f08259-a8a2-4a45-9c48-634b6863c495 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:22.862056 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-72f08259-a8a2-4a45-9c48-634b6863c495 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:22.862555 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-72f08259-a8a2-4a45-9c48-634b6863c495 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:22.862953 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-72f08259-a8a2-4a45-9c48-634b6863c495 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:22.879267 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-b4b085d4-1e19-4d00-b001-43daf530b480 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e93855201ca64c779f92a2a33979b81f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed328a1e964d46902dee5e1c7c7b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:22.891457 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-b4b085d4-1e19-4d00-b001-43daf530b480 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] 10.222.0.33 "GET /compute/v2.1/servers/67656ca4-09a7-4e6b-bf3a-cfcd254e99e4" status: 200 len: 1517 microversion: 2.1 time: 0.769395 Oct 04 20:55:22.893373 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2195/4347] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:55:22 2022] GET /compute/v2.1/servers/67656ca4-09a7-4e6b-bf3a-cfcd254e99e4 => generated 1517 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:55:22.926675 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-72f08259-a8a2-4a45-9c48-634b6863c495 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] [instance: f15ae3c9-8342-4ae9-b81e-2d7b1aecb2e8] Going to try to terminate instance {{(pid=128801) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:55:23.040506 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-72f08259-a8a2-4a45-9c48-634b6863c495 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] 10.222.0.33 "DELETE /compute/v2.1/servers/f15ae3c9-8342-4ae9-b81e-2d7b1aecb2e8" status: 204 len: 0 microversion: 2.1 time: 0.194937 Oct 04 20:55:23.042381 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2153/4348] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 20:55:22 2022] DELETE /compute/v2.1/servers/f15ae3c9-8342-4ae9-b81e-2d7b1aecb2e8 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 20:55:23.052885 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-441d1e9a-6cd6-4af0-bc25-47a120bef478 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:55:23.054031 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-441d1e9a-6cd6-4af0-bc25-47a120bef478 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] [instance: f15ae3c9-8342-4ae9-b81e-2d7b1aecb2e8] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:55:23.074851 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-441d1e9a-6cd6-4af0-bc25-47a120bef478 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:23.075596 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-441d1e9a-6cd6-4af0-bc25-47a120bef478 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:23.077613 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-441d1e9a-6cd6-4af0-bc25-47a120bef478 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:23.078646 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-441d1e9a-6cd6-4af0-bc25-47a120bef478 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:23.079458 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-441d1e9a-6cd6-4af0-bc25-47a120bef478 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:23.080643 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-441d1e9a-6cd6-4af0-bc25-47a120bef478 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:23.169581 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-3a2e8716-05b2-4028-a772-de3ed7bf209f tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:55:23.170751 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-3a2e8716-05b2-4028-a772-de3ed7bf209f tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] [instance: 601e4070-a868-49c6-b935-87eeeac4a826] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:55:23.184690 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3a2e8716-05b2-4028-a772-de3ed7bf209f tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:23.185370 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3a2e8716-05b2-4028-a772-de3ed7bf209f tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:23.185822 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3a2e8716-05b2-4028-a772-de3ed7bf209f tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:23.187730 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3a2e8716-05b2-4028-a772-de3ed7bf209f tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:23.188365 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3a2e8716-05b2-4028-a772-de3ed7bf209f tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:23.188802 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3a2e8716-05b2-4028-a772-de3ed7bf209f tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:23.511137 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-3a2e8716-05b2-4028-a772-de3ed7bf209f tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4adee36830c640919981ae58bd326157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '589fcee1949d4820a8958ec55ce4b43a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:23.544368 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-3a2e8716-05b2-4028-a772-de3ed7bf209f tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4adee36830c640919981ae58bd326157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '589fcee1949d4820a8958ec55ce4b43a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:23.549992 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-3a2e8716-05b2-4028-a772-de3ed7bf209f tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4adee36830c640919981ae58bd326157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '589fcee1949d4820a8958ec55ce4b43a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:23.564376 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-3a2e8716-05b2-4028-a772-de3ed7bf209f tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] 10.222.0.33 "GET /compute/v2.1/servers/601e4070-a868-49c6-b935-87eeeac4a826" status: 200 len: 1371 microversion: 2.47 time: 0.398988 Oct 04 20:55:23.566604 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2154/4349] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:55:23 2022] GET /compute/v2.1/servers/601e4070-a868-49c6-b935-87eeeac4a826 => generated 1371 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 20:55:23.598526 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8f486aca-1342-4dd4-bf9d-a7a72c63780b tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:55:23.600934 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-8f486aca-1342-4dd4-bf9d-a7a72c63780b tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] [instance: 0d82589c-f627-44b7-95cd-30e07a27a1a8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:55:23.614574 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8f486aca-1342-4dd4-bf9d-a7a72c63780b tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:23.615079 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8f486aca-1342-4dd4-bf9d-a7a72c63780b tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:23.621011 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8f486aca-1342-4dd4-bf9d-a7a72c63780b tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:23.622060 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8f486aca-1342-4dd4-bf9d-a7a72c63780b tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:23.622769 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8f486aca-1342-4dd4-bf9d-a7a72c63780b tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:23.623371 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8f486aca-1342-4dd4-bf9d-a7a72c63780b tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:24.222039 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-441d1e9a-6cd6-4af0-bc25-47a120bef478 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc4171c0ee14ebb8b5eff5e910ccf49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003eb03a265a496d8981e45c74b014f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:24.246405 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-441d1e9a-6cd6-4af0-bc25-47a120bef478 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] 10.222.0.33 "GET /compute/v2.1/servers/f15ae3c9-8342-4ae9-b81e-2d7b1aecb2e8" status: 200 len: 1509 microversion: 2.1 time: 1.197978 Oct 04 20:55:24.274956 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2196/4350] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:55:23 2022] GET /compute/v2.1/servers/f15ae3c9-8342-4ae9-b81e-2d7b1aecb2e8 => generated 1509 bytes in 1227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:55:24.280492 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-febe8303-d0f2-4a11-a500-0e221503b377 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:55:24.281413 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-febe8303-d0f2-4a11-a500-0e221503b377 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] [instance: 67656ca4-09a7-4e6b-bf3a-cfcd254e99e4] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:55:24.303042 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-febe8303-d0f2-4a11-a500-0e221503b377 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:24.303803 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-febe8303-d0f2-4a11-a500-0e221503b377 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:24.304437 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-febe8303-d0f2-4a11-a500-0e221503b377 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:24.306033 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-febe8303-d0f2-4a11-a500-0e221503b377 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:24.306804 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-febe8303-d0f2-4a11-a500-0e221503b377 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:24.309272 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-febe8303-d0f2-4a11-a500-0e221503b377 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:24.773158 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-8f486aca-1342-4dd4-bf9d-a7a72c63780b tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9061ddee3d48528f5849b2cc6a1d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7df9bc3521c479d9c16d3516b014cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:24.787872 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-8f486aca-1342-4dd4-bf9d-a7a72c63780b tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] 10.222.0.33 "GET /compute/v2.1/servers/0d82589c-f627-44b7-95cd-30e07a27a1a8" status: 200 len: 1319 microversion: 2.1 time: 1.199372 Oct 04 20:55:24.788489 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2155/4351] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:55:23 2022] GET /compute/v2.1/servers/0d82589c-f627-44b7-95cd-30e07a27a1a8 => generated 1319 bytes in 1211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:55:24.802067 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-78fff566-4e8d-4002-8110-eabf6e9915c1 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:55:24.802771 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-78fff566-4e8d-4002-8110-eabf6e9915c1 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] [instance: 601e4070-a868-49c6-b935-87eeeac4a826] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:55:24.812180 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-78fff566-4e8d-4002-8110-eabf6e9915c1 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:24.813215 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-78fff566-4e8d-4002-8110-eabf6e9915c1 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:24.813665 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-78fff566-4e8d-4002-8110-eabf6e9915c1 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:24.815561 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-78fff566-4e8d-4002-8110-eabf6e9915c1 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:24.816035 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-78fff566-4e8d-4002-8110-eabf6e9915c1 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:24.816468 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-78fff566-4e8d-4002-8110-eabf6e9915c1 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:25.073521 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-78fff566-4e8d-4002-8110-eabf6e9915c1 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4adee36830c640919981ae58bd326157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '589fcee1949d4820a8958ec55ce4b43a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:25.090502 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-78fff566-4e8d-4002-8110-eabf6e9915c1 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4adee36830c640919981ae58bd326157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '589fcee1949d4820a8958ec55ce4b43a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:25.092399 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-78fff566-4e8d-4002-8110-eabf6e9915c1 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4adee36830c640919981ae58bd326157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '589fcee1949d4820a8958ec55ce4b43a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:25.093614 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-78fff566-4e8d-4002-8110-eabf6e9915c1 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] 10.222.0.33 "GET /compute/v2.1/servers/601e4070-a868-49c6-b935-87eeeac4a826" status: 200 len: 1371 microversion: 2.47 time: 0.299197 Oct 04 20:55:25.094200 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2156/4352] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:55:24 2022] GET /compute/v2.1/servers/601e4070-a868-49c6-b935-87eeeac4a826 => generated 1371 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:55:25.278092 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8e2f929d-1e6e-4bf7-b1f6-1f2c95073952 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:55:25.279674 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-8e2f929d-1e6e-4bf7-b1f6-1f2c95073952 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] [instance: f15ae3c9-8342-4ae9-b81e-2d7b1aecb2e8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:55:25.288526 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8e2f929d-1e6e-4bf7-b1f6-1f2c95073952 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:25.292805 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8e2f929d-1e6e-4bf7-b1f6-1f2c95073952 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:25.293740 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8e2f929d-1e6e-4bf7-b1f6-1f2c95073952 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:25.295618 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8e2f929d-1e6e-4bf7-b1f6-1f2c95073952 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:25.296400 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8e2f929d-1e6e-4bf7-b1f6-1f2c95073952 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:25.297504 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8e2f929d-1e6e-4bf7-b1f6-1f2c95073952 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:25.506025 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-febe8303-d0f2-4a11-a500-0e221503b377 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e93855201ca64c779f92a2a33979b81f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed328a1e964d46902dee5e1c7c7b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:25.523196 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-febe8303-d0f2-4a11-a500-0e221503b377 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] 10.222.0.33 "GET /compute/v2.1/servers/67656ca4-09a7-4e6b-bf3a-cfcd254e99e4" status: 200 len: 1517 microversion: 2.1 time: 1.246537 Oct 04 20:55:25.524134 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2197/4353] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:55:24 2022] GET /compute/v2.1/servers/67656ca4-09a7-4e6b-bf3a-cfcd254e99e4 => generated 1517 bytes in 1248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:55:25.812768 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-4c426fce-03a5-4821-9e8d-7d44d8443dc5 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:55:25.813385 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-4c426fce-03a5-4821-9e8d-7d44d8443dc5 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] [instance: 0d82589c-f627-44b7-95cd-30e07a27a1a8] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:55:25.823887 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4c426fce-03a5-4821-9e8d-7d44d8443dc5 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:25.824609 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4c426fce-03a5-4821-9e8d-7d44d8443dc5 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:25.825066 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4c426fce-03a5-4821-9e8d-7d44d8443dc5 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:25.825791 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4c426fce-03a5-4821-9e8d-7d44d8443dc5 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:25.826250 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4c426fce-03a5-4821-9e8d-7d44d8443dc5 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:25.841155 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4c426fce-03a5-4821-9e8d-7d44d8443dc5 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:26.249912 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-8e2f929d-1e6e-4bf7-b1f6-1f2c95073952 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc4171c0ee14ebb8b5eff5e910ccf49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003eb03a265a496d8981e45c74b014f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:26.285077 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-8e2f929d-1e6e-4bf7-b1f6-1f2c95073952 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] 10.222.0.33 "GET /compute/v2.1/servers/f15ae3c9-8342-4ae9-b81e-2d7b1aecb2e8" status: 200 len: 1509 microversion: 2.1 time: 1.006339 Oct 04 20:55:26.288424 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2157/4354] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:55:25 2022] GET /compute/v2.1/servers/f15ae3c9-8342-4ae9-b81e-2d7b1aecb2e8 => generated 1509 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:55:26.311245 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-4f13ff70-b403-4a49-ae1b-20e44173eda9 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:55:26.312058 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-4f13ff70-b403-4a49-ae1b-20e44173eda9 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] [instance: 601e4070-a868-49c6-b935-87eeeac4a826] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:55:26.326832 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4f13ff70-b403-4a49-ae1b-20e44173eda9 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:26.327683 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4f13ff70-b403-4a49-ae1b-20e44173eda9 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:26.328293 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4f13ff70-b403-4a49-ae1b-20e44173eda9 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:26.331138 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4f13ff70-b403-4a49-ae1b-20e44173eda9 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:26.331929 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4f13ff70-b403-4a49-ae1b-20e44173eda9 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:26.332510 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4f13ff70-b403-4a49-ae1b-20e44173eda9 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:26.405239 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-4c426fce-03a5-4821-9e8d-7d44d8443dc5 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9061ddee3d48528f5849b2cc6a1d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7df9bc3521c479d9c16d3516b014cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:26.430991 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-4c426fce-03a5-4821-9e8d-7d44d8443dc5 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] 10.222.0.33 "GET /compute/v2.1/servers/0d82589c-f627-44b7-95cd-30e07a27a1a8" status: 200 len: 1319 microversion: 2.1 time: 0.616881 Oct 04 20:55:26.457003 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2198/4355] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:55:25 2022] GET /compute/v2.1/servers/0d82589c-f627-44b7-95cd-30e07a27a1a8 => generated 1319 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:55:26.548706 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-2b55edd3-bc38-4e53-8a5c-0a2dbe507cd6 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:55:26.550157 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-2b55edd3-bc38-4e53-8a5c-0a2dbe507cd6 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] [instance: 67656ca4-09a7-4e6b-bf3a-cfcd254e99e4] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:55:26.558614 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2b55edd3-bc38-4e53-8a5c-0a2dbe507cd6 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:26.559101 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2b55edd3-bc38-4e53-8a5c-0a2dbe507cd6 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:26.564464 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2b55edd3-bc38-4e53-8a5c-0a2dbe507cd6 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:26.565257 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2b55edd3-bc38-4e53-8a5c-0a2dbe507cd6 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:26.565736 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2b55edd3-bc38-4e53-8a5c-0a2dbe507cd6 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:26.575324 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2b55edd3-bc38-4e53-8a5c-0a2dbe507cd6 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:26.674527 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:55:26.924647 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-4f13ff70-b403-4a49-ae1b-20e44173eda9 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4adee36830c640919981ae58bd326157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '589fcee1949d4820a8958ec55ce4b43a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:26.945299 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-4f13ff70-b403-4a49-ae1b-20e44173eda9 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4adee36830c640919981ae58bd326157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '589fcee1949d4820a8958ec55ce4b43a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:26.947907 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-4f13ff70-b403-4a49-ae1b-20e44173eda9 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4adee36830c640919981ae58bd326157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '589fcee1949d4820a8958ec55ce4b43a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:26.954625 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-4f13ff70-b403-4a49-ae1b-20e44173eda9 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] 10.222.0.33 "GET /compute/v2.1/servers/601e4070-a868-49c6-b935-87eeeac4a826" status: 200 len: 1356 microversion: 2.47 time: 0.662799 Oct 04 20:55:26.956719 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2158/4356] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:55:26 2022] GET /compute/v2.1/servers/601e4070-a868-49c6-b935-87eeeac4a826 => generated 1356 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:55:26.988524 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8c955e37-6506-4873-bc24-4a6acc5286cb tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:55:26.995621 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-8c955e37-6506-4873-bc24-4a6acc5286cb tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4adee36830c640919981ae58bd326157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '589fcee1949d4820a8958ec55ce4b43a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:26.996865 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-8c955e37-6506-4873-bc24-4a6acc5286cb tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Searching by: {'deleted': False, 'project_id': '589fcee1949d4820a8958ec55ce4b43a'} {{(pid=128801) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 20:55:27.003955 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8c955e37-6506-4873-bc24-4a6acc5286cb tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:27.004671 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8c955e37-6506-4873-bc24-4a6acc5286cb tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:27.005212 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8c955e37-6506-4873-bc24-4a6acc5286cb tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:27.006172 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8c955e37-6506-4873-bc24-4a6acc5286cb tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:27.006958 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8c955e37-6506-4873-bc24-4a6acc5286cb tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:27.007676 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8c955e37-6506-4873-bc24-4a6acc5286cb tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:27.196738 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.multi_cell_list [None req-8c955e37-6506-4873-bc24-4a6acc5286cb tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=128801) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 20:55:27.349529 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-8c955e37-6506-4873-bc24-4a6acc5286cb tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4adee36830c640919981ae58bd326157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '589fcee1949d4820a8958ec55ce4b43a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:27.383982 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell0:SELECT=2 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:55:27.388183 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8c955e37-6506-4873-bc24-4a6acc5286cb tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:27.389498 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8c955e37-6506-4873-bc24-4a6acc5286cb tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:27.390539 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8c955e37-6506-4873-bc24-4a6acc5286cb tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:27.413245 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-8c955e37-6506-4873-bc24-4a6acc5286cb tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4adee36830c640919981ae58bd326157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '589fcee1949d4820a8958ec55ce4b43a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:27.417905 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-8c955e37-6506-4873-bc24-4a6acc5286cb tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4adee36830c640919981ae58bd326157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '589fcee1949d4820a8958ec55ce4b43a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:27.719898 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-8c955e37-6506-4873-bc24-4a6acc5286cb tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] 10.222.0.33 "GET /compute/v2.1/servers/detail" status: 200 len: 2705 microversion: 2.47 time: 0.737900 Oct 04 20:55:27.721070 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2159/4357] 10.222.0.33 () {60 vars in 1187 bytes} [Tue Oct 4 20:55:26 2022] GET /compute/v2.1/servers/detail => generated 2705 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 20:55:27.726702 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-4d1b64ab-1065-453b-9b0b-3c531a3006e5 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:55:27.727701 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-4d1b64ab-1065-453b-9b0b-3c531a3006e5 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] [instance: f15ae3c9-8342-4ae9-b81e-2d7b1aecb2e8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:55:27.746630 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4d1b64ab-1065-453b-9b0b-3c531a3006e5 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:27.747271 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4d1b64ab-1065-453b-9b0b-3c531a3006e5 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:27.747913 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4d1b64ab-1065-453b-9b0b-3c531a3006e5 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:27.751621 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4d1b64ab-1065-453b-9b0b-3c531a3006e5 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:27.759125 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4d1b64ab-1065-453b-9b0b-3c531a3006e5 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:27.759553 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4d1b64ab-1065-453b-9b0b-3c531a3006e5 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:27.847250 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4d1b64ab-1065-453b-9b0b-3c531a3006e5 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:27.847913 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4d1b64ab-1065-453b-9b0b-3c531a3006e5 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:27.848378 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4d1b64ab-1065-453b-9b0b-3c531a3006e5 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:27.848873 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-4d1b64ab-1065-453b-9b0b-3c531a3006e5 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lazy-loading 'fault' on Instance uuid f15ae3c9-8342-4ae9-b81e-2d7b1aecb2e8 {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:55:27.852723 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:55:27.866934 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-2b55edd3-bc38-4e53-8a5c-0a2dbe507cd6 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e93855201ca64c779f92a2a33979b81f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed328a1e964d46902dee5e1c7c7b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:27.886377 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-2b55edd3-bc38-4e53-8a5c-0a2dbe507cd6 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] 10.222.0.33 "GET /compute/v2.1/servers/67656ca4-09a7-4e6b-bf3a-cfcd254e99e4" status: 200 len: 1517 microversion: 2.1 time: 1.341540 Oct 04 20:55:27.910796 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2199/4358] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:55:26 2022] GET /compute/v2.1/servers/67656ca4-09a7-4e6b-bf3a-cfcd254e99e4 => generated 1517 bytes in 1366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:55:28.158938 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-4d1b64ab-1065-453b-9b0b-3c531a3006e5 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc4171c0ee14ebb8b5eff5e910ccf49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003eb03a265a496d8981e45c74b014f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:28.177656 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-4d1b64ab-1065-453b-9b0b-3c531a3006e5 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] 10.222.0.33 "GET /compute/v2.1/servers/f15ae3c9-8342-4ae9-b81e-2d7b1aecb2e8" status: 200 len: 1312 microversion: 2.1 time: 0.455431 Oct 04 20:55:28.179707 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2160/4359] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:55:27 2022] GET /compute/v2.1/servers/f15ae3c9-8342-4ae9-b81e-2d7b1aecb2e8 => generated 1312 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:55:28.185032 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-cbeee64c-e5f3-461b-9674-6ffa50884b20 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:55:28.185917 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-cbeee64c-e5f3-461b-9674-6ffa50884b20 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] [instance: 0d82589c-f627-44b7-95cd-30e07a27a1a8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:55:28.197830 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cbeee64c-e5f3-461b-9674-6ffa50884b20 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:28.198625 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cbeee64c-e5f3-461b-9674-6ffa50884b20 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:28.199371 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cbeee64c-e5f3-461b-9674-6ffa50884b20 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:28.215091 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cbeee64c-e5f3-461b-9674-6ffa50884b20 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:28.218956 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cbeee64c-e5f3-461b-9674-6ffa50884b20 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:28.219671 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cbeee64c-e5f3-461b-9674-6ffa50884b20 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:28.228722 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-3980eff8-cafa-41c0-9b3c-c1a4dbf4cdc6 req-3f636325-c6b5-47bc-9ec3-9049e7e513c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f15ae3c9-8342-4ae9-b81e-2d7b1aecb2e8", "name": "network-vif-deleted", "tag": "97d3322c-c45a-4f09-9239-8f930f5a19c4"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:55:28.261813 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-3980eff8-cafa-41c0-9b3c-c1a4dbf4cdc6 req-3f636325-c6b5-47bc-9ec3-9049e7e513c6 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:28.265690 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-3980eff8-cafa-41c0-9b3c-c1a4dbf4cdc6 req-3f636325-c6b5-47bc-9ec3-9049e7e513c6 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:28.267391 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-3980eff8-cafa-41c0-9b3c-c1a4dbf4cdc6 req-3f636325-c6b5-47bc-9ec3-9049e7e513c6 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:28.287838 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-3980eff8-cafa-41c0-9b3c-c1a4dbf4cdc6 req-3f636325-c6b5-47bc-9ec3-9049e7e513c6 service nova] Creating event network-vif-deleted:97d3322c-c45a-4f09-9239-8f930f5a19c4 for instance f15ae3c9-8342-4ae9-b81e-2d7b1aecb2e8 on n-h1-854823-8 Oct 04 20:55:28.298707 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-3980eff8-cafa-41c0-9b3c-c1a4dbf4cdc6 req-3f636325-c6b5-47bc-9ec3-9049e7e513c6 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.383798 Oct 04 20:55:28.299921 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2200/4360] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:55:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:55:28.339375 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-fc251d9f-d3a9-4877-84a0-21152dd93a4c tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:55:28.347075 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-fc251d9f-d3a9-4877-84a0-21152dd93a4c tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] [instance: 601e4070-a868-49c6-b935-87eeeac4a826] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:55:28.361445 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fc251d9f-d3a9-4877-84a0-21152dd93a4c tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:28.362014 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fc251d9f-d3a9-4877-84a0-21152dd93a4c tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:28.369262 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fc251d9f-d3a9-4877-84a0-21152dd93a4c tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:28.372906 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fc251d9f-d3a9-4877-84a0-21152dd93a4c tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:28.373419 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fc251d9f-d3a9-4877-84a0-21152dd93a4c tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:28.374306 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fc251d9f-d3a9-4877-84a0-21152dd93a4c tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:28.495623 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-fc251d9f-d3a9-4877-84a0-21152dd93a4c tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] [instance: 601e4070-a868-49c6-b935-87eeeac4a826] Going to try to terminate instance {{(pid=128802) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:55:28.699773 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-fc251d9f-d3a9-4877-84a0-21152dd93a4c tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] 10.222.0.33 "DELETE /compute/v2.1/servers/601e4070-a868-49c6-b935-87eeeac4a826" status: 204 len: 0 microversion: 2.47 time: 0.397380 Oct 04 20:55:28.707587 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2201/4361] 10.222.0.33 () {60 vars in 1280 bytes} [Tue Oct 4 20:55:28 2022] DELETE /compute/v2.1/servers/601e4070-a868-49c6-b935-87eeeac4a826 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 20:55:28.944918 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-74863cca-29b4-45fe-9baa-321ea9caaf73 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:55:28.946217 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-74863cca-29b4-45fe-9baa-321ea9caaf73 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] [instance: f8ba4e66-2997-4822-9c01-c570f5ae6e87] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:55:28.957525 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-74863cca-29b4-45fe-9baa-321ea9caaf73 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:28.959974 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-74863cca-29b4-45fe-9baa-321ea9caaf73 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:28.960481 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-74863cca-29b4-45fe-9baa-321ea9caaf73 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:28.964022 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-74863cca-29b4-45fe-9baa-321ea9caaf73 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:28.964725 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-74863cca-29b4-45fe-9baa-321ea9caaf73 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:28.968931 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-74863cca-29b4-45fe-9baa-321ea9caaf73 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:29.040344 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-74863cca-29b4-45fe-9baa-321ea9caaf73 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] [instance: f8ba4e66-2997-4822-9c01-c570f5ae6e87] Going to try to terminate instance {{(pid=128802) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:55:29.187516 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-74863cca-29b4-45fe-9baa-321ea9caaf73 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] 10.222.0.33 "DELETE /compute/v2.1/servers/f8ba4e66-2997-4822-9c01-c570f5ae6e87" status: 204 len: 0 microversion: 2.42 time: 0.466098 Oct 04 20:55:29.189975 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2202/4362] 10.222.0.33 () {60 vars in 1280 bytes} [Tue Oct 4 20:55:28 2022] DELETE /compute/v2.1/servers/f8ba4e66-2997-4822-9c01-c570f5ae6e87 => generated 0 bytes in 482 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 20:55:29.203845 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-612a78f6-4ef2-4f8b-9f7f-61198107fab9 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:55:29.205859 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-612a78f6-4ef2-4f8b-9f7f-61198107fab9 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] [instance: 601e4070-a868-49c6-b935-87eeeac4a826] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:55:29.215694 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-612a78f6-4ef2-4f8b-9f7f-61198107fab9 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:29.217067 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-612a78f6-4ef2-4f8b-9f7f-61198107fab9 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:29.217697 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-612a78f6-4ef2-4f8b-9f7f-61198107fab9 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:29.218738 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-612a78f6-4ef2-4f8b-9f7f-61198107fab9 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:29.219369 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-612a78f6-4ef2-4f8b-9f7f-61198107fab9 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:29.219946 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-612a78f6-4ef2-4f8b-9f7f-61198107fab9 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:29.221022 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-cbeee64c-e5f3-461b-9674-6ffa50884b20 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9061ddee3d48528f5849b2cc6a1d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7df9bc3521c479d9c16d3516b014cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:29.233267 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-cbeee64c-e5f3-461b-9674-6ffa50884b20 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] 10.222.0.33 "GET /compute/v2.1/servers/0d82589c-f627-44b7-95cd-30e07a27a1a8" status: 200 len: 1319 microversion: 2.1 time: 1.051761 Oct 04 20:55:29.235554 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2161/4363] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:55:28 2022] GET /compute/v2.1/servers/0d82589c-f627-44b7-95cd-30e07a27a1a8 => generated 1319 bytes in 1055 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:55:29.248928 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-61b423ac-9797-4a6c-ac1c-a66a8133a6ea tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:55:29.250557 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-61b423ac-9797-4a6c-ac1c-a66a8133a6ea tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] [instance: 67656ca4-09a7-4e6b-bf3a-cfcd254e99e4] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:55:29.264609 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-61b423ac-9797-4a6c-ac1c-a66a8133a6ea tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:29.272883 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-61b423ac-9797-4a6c-ac1c-a66a8133a6ea tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:29.274006 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-61b423ac-9797-4a6c-ac1c-a66a8133a6ea tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:29.277937 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-61b423ac-9797-4a6c-ac1c-a66a8133a6ea tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:29.278469 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-61b423ac-9797-4a6c-ac1c-a66a8133a6ea tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:29.278903 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-61b423ac-9797-4a6c-ac1c-a66a8133a6ea tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:29.458041 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-612a78f6-4ef2-4f8b-9f7f-61198107fab9 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4adee36830c640919981ae58bd326157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '589fcee1949d4820a8958ec55ce4b43a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:29.482709 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-612a78f6-4ef2-4f8b-9f7f-61198107fab9 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4adee36830c640919981ae58bd326157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '589fcee1949d4820a8958ec55ce4b43a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:29.484169 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-612a78f6-4ef2-4f8b-9f7f-61198107fab9 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4adee36830c640919981ae58bd326157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '589fcee1949d4820a8958ec55ce4b43a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:29.485403 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-612a78f6-4ef2-4f8b-9f7f-61198107fab9 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] 10.222.0.33 "GET /compute/v2.1/servers/601e4070-a868-49c6-b935-87eeeac4a826" status: 200 len: 1362 microversion: 2.47 time: 0.290559 Oct 04 20:55:29.513478 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2203/4364] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:55:29 2022] GET /compute/v2.1/servers/601e4070-a868-49c6-b935-87eeeac4a826 => generated 1362 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:55:29.533398 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-ee65d0f2-6eae-4faf-b15e-eb226b2afe90 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:55:29.539028 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-ee65d0f2-6eae-4faf-b15e-eb226b2afe90 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] [instance: f8ba4e66-2997-4822-9c01-c570f5ae6e87] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:55:29.565929 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ee65d0f2-6eae-4faf-b15e-eb226b2afe90 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:29.578252 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ee65d0f2-6eae-4faf-b15e-eb226b2afe90 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:29.580890 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ee65d0f2-6eae-4faf-b15e-eb226b2afe90 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:29.582594 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ee65d0f2-6eae-4faf-b15e-eb226b2afe90 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:29.583342 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ee65d0f2-6eae-4faf-b15e-eb226b2afe90 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:29.587336 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ee65d0f2-6eae-4faf-b15e-eb226b2afe90 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:29.645299 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:55:30.286004 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-61b423ac-9797-4a6c-ac1c-a66a8133a6ea tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e93855201ca64c779f92a2a33979b81f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed328a1e964d46902dee5e1c7c7b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:30.299102 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-61b423ac-9797-4a6c-ac1c-a66a8133a6ea tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] 10.222.0.33 "GET /compute/v2.1/servers/67656ca4-09a7-4e6b-bf3a-cfcd254e99e4" status: 200 len: 1523 microversion: 2.1 time: 1.060086 Oct 04 20:55:30.299705 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2162/4365] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:55:29 2022] GET /compute/v2.1/servers/67656ca4-09a7-4e6b-bf3a-cfcd254e99e4 => generated 1523 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:55:30.304398 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7babed66-dd11-4626-8448-772a4a7942b9 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:55:30.319368 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-7babed66-dd11-4626-8448-772a4a7942b9 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] [instance: f15ae3c9-8342-4ae9-b81e-2d7b1aecb2e8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:55:30.331302 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=90,nova_api:DELETE=1,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:55:30.335076 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7babed66-dd11-4626-8448-772a4a7942b9 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:30.337769 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7babed66-dd11-4626-8448-772a4a7942b9 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:30.338482 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7babed66-dd11-4626-8448-772a4a7942b9 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:30.339877 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7babed66-dd11-4626-8448-772a4a7942b9 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:30.342289 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7babed66-dd11-4626-8448-772a4a7942b9 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:30.342773 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7babed66-dd11-4626-8448-772a4a7942b9 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:30.382564 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-7babed66-dd11-4626-8448-772a4a7942b9 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] HTTP exception thrown: Instance f15ae3c9-8342-4ae9-b81e-2d7b1aecb2e8 could not be found. Oct 04 20:55:30.389475 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7babed66-dd11-4626-8448-772a4a7942b9 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Request method failure captured: Oct 04 20:55:30.389475 n-d-854823-8 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/f15ae3c9-8342-4ae9-b81e-2d7b1aecb2e8 HTTP/1.1 Oct 04 20:55:30.389475 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:55:30.389475 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:55:30.389475 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:55:30.389475 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 0 Oct 04 20:55:30.389475 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:55:30.389475 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:55:30.389475 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:55:30.389475 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:55:30.389475 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJyQzA2j2TP516GvcpxgrBfRY2YO9l5F5hDF6OrxoVmO38Ubui7rW9ilb7hzquPDxl35ZSulQSvQlms9Io4ULkRGXw-K9Mq_8wy4teEQxOMGhx3owN2R9ZyECEeAocP_VsKpWXZTRpHKvfvEO-wS1AA94MTw8YrFoFgm4uO6w6GPzhQ Oct 04 20:55:30.389475 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:55:30.389475 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:55:30.389475 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:55:30.389475 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:55:30.389475 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:55:30.389475 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:55:30.389475 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: 003eb03a265a496d8981e45c74b014f3 Oct 04 20:55:30.389475 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2028044299 Oct 04 20:55:30.389475 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 20:55:30.389475 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 20:55:30.389475 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_003eb03a265a496d8981e45c74b014f3", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/003eb03a265a496d8981e45c74b014f3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/003eb03a265a496d8981e45c74b014f3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/003eb03a265a496d8981e45c74b014f3"}]}] Oct 04 20:55:30.389475 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2028044299 Oct 04 20:55:30.389475 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: 003eb03a265a496d8981e45c74b014f3 Oct 04 20:55:30.389475 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2028044299 Oct 04 20:55:30.389475 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-ServerRescueNegativeTestJSON-2028044299-project Oct 04 20:55:30.389475 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:55:30.389475 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:55:30.389475 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: 4dc4171c0ee14ebb8b5eff5e910ccf49 Oct 04 20:55:30.389475 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2028044299-project Oct 04 20:55:30.389475 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 20:55:30.389475 n-d-854823-8 devstack@n-api.service[128801]: exception: Instance f15ae3c9-8342-4ae9-b81e-2d7b1aecb2e8 could not be found. Oct 04 20:55:30.389475 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': 'f15ae3c9-8342-4ae9-b81e-2d7b1aecb2e8'} Oct 04 20:55:30.389475 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:55:30.389475 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:55:30.389475 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:55:30.389475 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:55:30.389475 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:55:30.389475 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:55:30.389475 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:55:30.389475 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:55:30.389475 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:55:30.389475 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:55:30.389475 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f15ae3c9-8342-4ae9-b81e-2d7b1aecb2e8 could not be found. Oct 04 20:55:30.389475 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:55:30.389475 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:55:30.389475 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:55:30.389475 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:55:30.389475 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:55:30.389475 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:55:30.389475 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:55:30.389475 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:55:30.389475 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:55:30.389475 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:55:30.389475 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:55:30.389475 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:55:30.389475 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:55:30.389475 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:55:30.389475 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:55:30.389475 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:55:30.389475 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f15ae3c9-8342-4ae9-b81e-2d7b1aecb2e8 could not be found. Oct 04 20:55:30.389475 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:55:30.389475 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:55:30.393888 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:55:30.393888 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:55:30.393888 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:55:30.393888 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:55:30.393888 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:55:30.393888 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:55:30.393888 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f15ae3c9-8342-4ae9-b81e-2d7b1aecb2e8 could not be found. Oct 04 20:55:30.393888 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:55:30.393888 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7babed66-dd11-4626-8448-772a4a7942b9 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Returning 404 to user: Instance f15ae3c9-8342-4ae9-b81e-2d7b1aecb2e8 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:55:30.394700 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-7babed66-dd11-4626-8448-772a4a7942b9 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] 10.222.0.33 "GET /compute/v2.1/servers/f15ae3c9-8342-4ae9-b81e-2d7b1aecb2e8" status: 404 len: 111 microversion: 2.1 time: 0.091390 Oct 04 20:55:30.395408 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2163/4366] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:55:30 2022] GET /compute/v2.1/servers/f15ae3c9-8342-4ae9-b81e-2d7b1aecb2e8 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:55:30.407122 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b8abad32-7a66-4eae-894f-d8a7a9113863 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:55:30.409602 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b8abad32-7a66-4eae-894f-d8a7a9113863 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] [instance: 0d82589c-f627-44b7-95cd-30e07a27a1a8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:55:30.435214 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b8abad32-7a66-4eae-894f-d8a7a9113863 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:30.435705 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b8abad32-7a66-4eae-894f-d8a7a9113863 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:30.436340 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b8abad32-7a66-4eae-894f-d8a7a9113863 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:30.437341 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b8abad32-7a66-4eae-894f-d8a7a9113863 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:30.438015 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b8abad32-7a66-4eae-894f-d8a7a9113863 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:30.439451 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b8abad32-7a66-4eae-894f-d8a7a9113863 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:30.589348 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-ee65d0f2-6eae-4faf-b15e-eb226b2afe90 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b78af5c0485b4343900269160ef3e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659f3d4023b347d58bc0361db9ceead9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:30.607594 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-ee65d0f2-6eae-4faf-b15e-eb226b2afe90 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b78af5c0485b4343900269160ef3e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659f3d4023b347d58bc0361db9ceead9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:30.611664 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-ee65d0f2-6eae-4faf-b15e-eb226b2afe90 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b78af5c0485b4343900269160ef3e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659f3d4023b347d58bc0361db9ceead9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:30.615512 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-ee65d0f2-6eae-4faf-b15e-eb226b2afe90 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] 10.222.0.33 "GET /compute/v2.1/servers/f8ba4e66-2997-4822-9c01-c570f5ae6e87" status: 200 len: 2957 microversion: 2.42 time: 1.098935 Oct 04 20:55:30.616117 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2204/4367] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:55:29 2022] GET /compute/v2.1/servers/f8ba4e66-2997-4822-9c01-c570f5ae6e87 => generated 2957 bytes in 1100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:55:30.631403 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-d3270dd0-9e2e-4c7f-a405-9dfc5400b6d2 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:55:30.631403 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-d3270dd0-9e2e-4c7f-a405-9dfc5400b6d2 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] [instance: 1ed60bf8-87e6-4a70-be59-830bee5f8b6d] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:55:30.643716 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_api:SELECT=68,nova_api:UPDATE=2 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:55:30.646439 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d3270dd0-9e2e-4c7f-a405-9dfc5400b6d2 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:30.648443 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d3270dd0-9e2e-4c7f-a405-9dfc5400b6d2 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:30.649332 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d3270dd0-9e2e-4c7f-a405-9dfc5400b6d2 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:30.653642 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d3270dd0-9e2e-4c7f-a405-9dfc5400b6d2 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:30.654207 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d3270dd0-9e2e-4c7f-a405-9dfc5400b6d2 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:30.654697 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d3270dd0-9e2e-4c7f-a405-9dfc5400b6d2 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:30.724333 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-d3270dd0-9e2e-4c7f-a405-9dfc5400b6d2 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] [instance: 1ed60bf8-87e6-4a70-be59-830bee5f8b6d] Going to try to terminate instance {{(pid=128802) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:55:30.874767 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-d3270dd0-9e2e-4c7f-a405-9dfc5400b6d2 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] 10.222.0.33 "DELETE /compute/v2.1/servers/1ed60bf8-87e6-4a70-be59-830bee5f8b6d" status: 204 len: 0 microversion: 2.1 time: 0.255031 Oct 04 20:55:30.879574 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2205/4368] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 20:55:30 2022] DELETE /compute/v2.1/servers/1ed60bf8-87e6-4a70-be59-830bee5f8b6d => generated 0 bytes in 263 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:55:30.887255 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-ba734864-48ca-46d3-b4e1-3d7c93e90125 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:55:30.888075 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-ba734864-48ca-46d3-b4e1-3d7c93e90125 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] [instance: 601e4070-a868-49c6-b935-87eeeac4a826] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:55:30.897921 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ba734864-48ca-46d3-b4e1-3d7c93e90125 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:30.898840 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ba734864-48ca-46d3-b4e1-3d7c93e90125 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:30.899642 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ba734864-48ca-46d3-b4e1-3d7c93e90125 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:30.901626 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ba734864-48ca-46d3-b4e1-3d7c93e90125 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:30.902661 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ba734864-48ca-46d3-b4e1-3d7c93e90125 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:30.903603 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ba734864-48ca-46d3-b4e1-3d7c93e90125 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:31.152409 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-ba734864-48ca-46d3-b4e1-3d7c93e90125 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4adee36830c640919981ae58bd326157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '589fcee1949d4820a8958ec55ce4b43a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:31.175254 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-ba734864-48ca-46d3-b4e1-3d7c93e90125 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4adee36830c640919981ae58bd326157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '589fcee1949d4820a8958ec55ce4b43a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:31.179055 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-ba734864-48ca-46d3-b4e1-3d7c93e90125 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4adee36830c640919981ae58bd326157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '589fcee1949d4820a8958ec55ce4b43a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:31.181802 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-ba734864-48ca-46d3-b4e1-3d7c93e90125 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] 10.222.0.33 "GET /compute/v2.1/servers/601e4070-a868-49c6-b935-87eeeac4a826" status: 200 len: 1362 microversion: 2.47 time: 0.300048 Oct 04 20:55:31.184108 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2206/4369] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:55:30 2022] GET /compute/v2.1/servers/601e4070-a868-49c6-b935-87eeeac4a826 => generated 1362 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:55:31.192718 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-ff6bc7e5-565a-48ee-aed3-341587d2fc9a tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:55:31.195996 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-ff6bc7e5-565a-48ee-aed3-341587d2fc9a tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] [instance: 1ed60bf8-87e6-4a70-be59-830bee5f8b6d] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:55:31.223741 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ff6bc7e5-565a-48ee-aed3-341587d2fc9a tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:31.224367 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ff6bc7e5-565a-48ee-aed3-341587d2fc9a tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:31.224921 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ff6bc7e5-565a-48ee-aed3-341587d2fc9a tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:31.225984 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ff6bc7e5-565a-48ee-aed3-341587d2fc9a tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:31.226641 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ff6bc7e5-565a-48ee-aed3-341587d2fc9a tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:31.227180 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ff6bc7e5-565a-48ee-aed3-341587d2fc9a tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:31.264410 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-b8abad32-7a66-4eae-894f-d8a7a9113863 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9061ddee3d48528f5849b2cc6a1d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7df9bc3521c479d9c16d3516b014cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:31.291130 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b8abad32-7a66-4eae-894f-d8a7a9113863 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] 10.222.0.33 "GET /compute/v2.1/servers/0d82589c-f627-44b7-95cd-30e07a27a1a8" status: 200 len: 1319 microversion: 2.1 time: 0.892783 Oct 04 20:55:31.292977 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2164/4370] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:55:30 2022] GET /compute/v2.1/servers/0d82589c-f627-44b7-95cd-30e07a27a1a8 => generated 1319 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:55:31.340265 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-3ff4376c-7d36-4a34-87f2-c379e980261b req-11a9b04c-b165-4e59-a4d2-16f61f452d07 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d82589c-f627-44b7-95cd-30e07a27a1a8", "tag": "7a30a586-1cc3-4182-97fb-c25126c9d342"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:55:31.361754 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-3ff4376c-7d36-4a34-87f2-c379e980261b req-11a9b04c-b165-4e59-a4d2-16f61f452d07 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:31.362587 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-3ff4376c-7d36-4a34-87f2-c379e980261b req-11a9b04c-b165-4e59-a4d2-16f61f452d07 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:31.363258 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-3ff4376c-7d36-4a34-87f2-c379e980261b req-11a9b04c-b165-4e59-a4d2-16f61f452d07 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:31.685816 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-ff6bc7e5-565a-48ee-aed3-341587d2fc9a tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc4171c0ee14ebb8b5eff5e910ccf49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003eb03a265a496d8981e45c74b014f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:31.707586 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-ff6bc7e5-565a-48ee-aed3-341587d2fc9a tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] 10.222.0.33 "GET /compute/v2.1/servers/1ed60bf8-87e6-4a70-be59-830bee5f8b6d" status: 200 len: 1522 microversion: 2.1 time: 0.520114 Oct 04 20:55:31.709052 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2207/4371] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:55:31 2022] GET /compute/v2.1/servers/1ed60bf8-87e6-4a70-be59-830bee5f8b6d => generated 1522 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:55:31.719509 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-e42d41e1-781c-477b-8f7c-2e15fede7956 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:55:31.720502 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-e42d41e1-781c-477b-8f7c-2e15fede7956 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] [instance: 67656ca4-09a7-4e6b-bf3a-cfcd254e99e4] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:55:31.735074 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e42d41e1-781c-477b-8f7c-2e15fede7956 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:31.739171 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e42d41e1-781c-477b-8f7c-2e15fede7956 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:31.747912 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e42d41e1-781c-477b-8f7c-2e15fede7956 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:31.748706 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e42d41e1-781c-477b-8f7c-2e15fede7956 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:31.751769 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e42d41e1-781c-477b-8f7c-2e15fede7956 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:31.754016 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e42d41e1-781c-477b-8f7c-2e15fede7956 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:31.944489 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-3ff4376c-7d36-4a34-87f2-c379e980261b req-11a9b04c-b165-4e59-a4d2-16f61f452d07 service nova] Creating event network-changed:7a30a586-1cc3-4182-97fb-c25126c9d342 for instance 0d82589c-f627-44b7-95cd-30e07a27a1a8 on n-h2-854823-8 Oct 04 20:55:31.951646 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-3ff4376c-7d36-4a34-87f2-c379e980261b req-11a9b04c-b165-4e59-a4d2-16f61f452d07 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.622515 Oct 04 20:55:31.954126 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2165/4372] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:55:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:55:31.960189 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-ef31419d-fffc-484c-9aed-9a0213789d77 req-46643be9-929d-41be-bbc6-f87f12e84326 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67656ca4-09a7-4e6b-bf3a-cfcd254e99e4", "name": "network-vif-unplugged", "status": "completed", "tag": "520b47f9-ca55-4bc2-99bd-5d338296bb06"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:55:31.972328 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-ef31419d-fffc-484c-9aed-9a0213789d77 req-46643be9-929d-41be-bbc6-f87f12e84326 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:31.973178 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-ef31419d-fffc-484c-9aed-9a0213789d77 req-46643be9-929d-41be-bbc6-f87f12e84326 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:31.974369 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-ef31419d-fffc-484c-9aed-9a0213789d77 req-46643be9-929d-41be-bbc6-f87f12e84326 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:31.988924 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-ef31419d-fffc-484c-9aed-9a0213789d77 req-46643be9-929d-41be-bbc6-f87f12e84326 service nova] Creating event network-vif-unplugged:520b47f9-ca55-4bc2-99bd-5d338296bb06 for instance 67656ca4-09a7-4e6b-bf3a-cfcd254e99e4 on n-h2-854823-8 Oct 04 20:55:31.996083 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-ef31419d-fffc-484c-9aed-9a0213789d77 req-46643be9-929d-41be-bbc6-f87f12e84326 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.040352 Oct 04 20:55:31.997545 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2166/4373] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:55:31 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:55:32.004667 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d3d27b95-0ead-49de-b6ce-ebfa43aa125b tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:55:32.005648 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d3d27b95-0ead-49de-b6ce-ebfa43aa125b tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] [instance: f8ba4e66-2997-4822-9c01-c570f5ae6e87] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:55:32.014119 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d3d27b95-0ead-49de-b6ce-ebfa43aa125b tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:32.015104 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d3d27b95-0ead-49de-b6ce-ebfa43aa125b tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:32.015727 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d3d27b95-0ead-49de-b6ce-ebfa43aa125b tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:32.016778 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d3d27b95-0ead-49de-b6ce-ebfa43aa125b tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:32.017652 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d3d27b95-0ead-49de-b6ce-ebfa43aa125b tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:32.018262 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d3d27b95-0ead-49de-b6ce-ebfa43aa125b tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:32.402527 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-e42d41e1-781c-477b-8f7c-2e15fede7956 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e93855201ca64c779f92a2a33979b81f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed328a1e964d46902dee5e1c7c7b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:32.417909 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-e42d41e1-781c-477b-8f7c-2e15fede7956 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] 10.222.0.33 "GET /compute/v2.1/servers/67656ca4-09a7-4e6b-bf3a-cfcd254e99e4" status: 200 len: 1523 microversion: 2.1 time: 0.707442 Oct 04 20:55:32.418763 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2208/4374] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:55:31 2022] GET /compute/v2.1/servers/67656ca4-09a7-4e6b-bf3a-cfcd254e99e4 => generated 1523 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:55:32.428242 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-8f79ad28-397e-4573-8686-7673d6c39f93 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:55:32.431167 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-8f79ad28-397e-4573-8686-7673d6c39f93 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] [instance: 601e4070-a868-49c6-b935-87eeeac4a826] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:55:32.441105 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8f79ad28-397e-4573-8686-7673d6c39f93 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:32.442884 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8f79ad28-397e-4573-8686-7673d6c39f93 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:32.443680 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8f79ad28-397e-4573-8686-7673d6c39f93 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:32.444583 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8f79ad28-397e-4573-8686-7673d6c39f93 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:32.445305 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8f79ad28-397e-4573-8686-7673d6c39f93 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:32.445905 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8f79ad28-397e-4573-8686-7673d6c39f93 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:32.473079 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d3d27b95-0ead-49de-b6ce-ebfa43aa125b tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b78af5c0485b4343900269160ef3e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659f3d4023b347d58bc0361db9ceead9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:32.488279 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d3d27b95-0ead-49de-b6ce-ebfa43aa125b tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b78af5c0485b4343900269160ef3e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659f3d4023b347d58bc0361db9ceead9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:32.489707 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d3d27b95-0ead-49de-b6ce-ebfa43aa125b tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b78af5c0485b4343900269160ef3e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659f3d4023b347d58bc0361db9ceead9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:32.491016 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d3d27b95-0ead-49de-b6ce-ebfa43aa125b tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] 10.222.0.33 "GET /compute/v2.1/servers/f8ba4e66-2997-4822-9c01-c570f5ae6e87" status: 200 len: 2957 microversion: 2.42 time: 0.492185 Oct 04 20:55:32.491578 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2167/4375] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:55:31 2022] GET /compute/v2.1/servers/f8ba4e66-2997-4822-9c01-c570f5ae6e87 => generated 2957 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:55:32.508128 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d5f0f431-6381-41f0-a20a-b6a99b3524ed tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:55:32.515356 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d5f0f431-6381-41f0-a20a-b6a99b3524ed tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] [instance: 0d82589c-f627-44b7-95cd-30e07a27a1a8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:55:32.524811 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d5f0f431-6381-41f0-a20a-b6a99b3524ed tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:32.525652 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d5f0f431-6381-41f0-a20a-b6a99b3524ed tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:32.527022 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d5f0f431-6381-41f0-a20a-b6a99b3524ed tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:32.528115 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d5f0f431-6381-41f0-a20a-b6a99b3524ed tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:32.528771 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d5f0f431-6381-41f0-a20a-b6a99b3524ed tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:32.529417 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d5f0f431-6381-41f0-a20a-b6a99b3524ed tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:32.565319 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-8f79ad28-397e-4573-8686-7673d6c39f93 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4adee36830c640919981ae58bd326157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '589fcee1949d4820a8958ec55ce4b43a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:32.576695 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-8f79ad28-397e-4573-8686-7673d6c39f93 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4adee36830c640919981ae58bd326157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '589fcee1949d4820a8958ec55ce4b43a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:32.581002 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-8f79ad28-397e-4573-8686-7673d6c39f93 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4adee36830c640919981ae58bd326157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '589fcee1949d4820a8958ec55ce4b43a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:32.586585 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-8f79ad28-397e-4573-8686-7673d6c39f93 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] 10.222.0.33 "GET /compute/v2.1/servers/601e4070-a868-49c6-b935-87eeeac4a826" status: 200 len: 1362 microversion: 2.47 time: 0.166060 Oct 04 20:55:32.602980 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2209/4376] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:55:32 2022] GET /compute/v2.1/servers/601e4070-a868-49c6-b935-87eeeac4a826 => generated 1362 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:55:32.707651 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d5f0f431-6381-41f0-a20a-b6a99b3524ed tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9061ddee3d48528f5849b2cc6a1d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7df9bc3521c479d9c16d3516b014cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:32.721592 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d5f0f431-6381-41f0-a20a-b6a99b3524ed tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] 10.222.0.33 "GET /compute/v2.1/servers/0d82589c-f627-44b7-95cd-30e07a27a1a8" status: 200 len: 1319 microversion: 2.1 time: 0.223530 Oct 04 20:55:32.722183 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2168/4377] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:55:32 2022] GET /compute/v2.1/servers/0d82589c-f627-44b7-95cd-30e07a27a1a8 => generated 1319 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:55:32.732773 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-e6b48125-a78a-47d0-bd64-561909d51963 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:55:32.733989 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-e6b48125-a78a-47d0-bd64-561909d51963 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] [instance: 1ed60bf8-87e6-4a70-be59-830bee5f8b6d] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:55:32.741072 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e6b48125-a78a-47d0-bd64-561909d51963 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:32.741577 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e6b48125-a78a-47d0-bd64-561909d51963 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:32.742592 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e6b48125-a78a-47d0-bd64-561909d51963 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:32.743646 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e6b48125-a78a-47d0-bd64-561909d51963 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:32.744114 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e6b48125-a78a-47d0-bd64-561909d51963 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:32.744553 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e6b48125-a78a-47d0-bd64-561909d51963 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:32.963200 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-e6b48125-a78a-47d0-bd64-561909d51963 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc4171c0ee14ebb8b5eff5e910ccf49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003eb03a265a496d8981e45c74b014f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:32.972262 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-e6b48125-a78a-47d0-bd64-561909d51963 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] 10.222.0.33 "GET /compute/v2.1/servers/1ed60bf8-87e6-4a70-be59-830bee5f8b6d" status: 200 len: 1522 microversion: 2.1 time: 0.243535 Oct 04 20:55:32.982379 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2210/4378] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:55:32 2022] GET /compute/v2.1/servers/1ed60bf8-87e6-4a70-be59-830bee5f8b6d => generated 1522 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:55:33.458690 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-17e44530-5230-427f-b96d-110b2e2562fe tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:55:33.463089 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-17e44530-5230-427f-b96d-110b2e2562fe tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] [instance: 67656ca4-09a7-4e6b-bf3a-cfcd254e99e4] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:55:33.475253 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-17e44530-5230-427f-b96d-110b2e2562fe tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:33.478011 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-17e44530-5230-427f-b96d-110b2e2562fe tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:33.478665 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-17e44530-5230-427f-b96d-110b2e2562fe tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:33.479544 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-17e44530-5230-427f-b96d-110b2e2562fe tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:33.480168 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-17e44530-5230-427f-b96d-110b2e2562fe tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:33.480798 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-17e44530-5230-427f-b96d-110b2e2562fe tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:33.521426 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-5b6c6bfb-37ea-4aa0-b5db-b21cc4ecfaba tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:55:33.522032 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-5b6c6bfb-37ea-4aa0-b5db-b21cc4ecfaba tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] [instance: f8ba4e66-2997-4822-9c01-c570f5ae6e87] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:55:33.533745 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5b6c6bfb-37ea-4aa0-b5db-b21cc4ecfaba tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:33.537561 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5b6c6bfb-37ea-4aa0-b5db-b21cc4ecfaba tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:33.538176 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5b6c6bfb-37ea-4aa0-b5db-b21cc4ecfaba tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:33.539822 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5b6c6bfb-37ea-4aa0-b5db-b21cc4ecfaba tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:33.549776 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5b6c6bfb-37ea-4aa0-b5db-b21cc4ecfaba tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:33.550225 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5b6c6bfb-37ea-4aa0-b5db-b21cc4ecfaba tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:34.001544 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-17e44530-5230-427f-b96d-110b2e2562fe tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e93855201ca64c779f92a2a33979b81f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed328a1e964d46902dee5e1c7c7b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:34.015140 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-17e44530-5230-427f-b96d-110b2e2562fe tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] 10.222.0.33 "GET /compute/v2.1/servers/67656ca4-09a7-4e6b-bf3a-cfcd254e99e4" status: 200 len: 1523 microversion: 2.1 time: 0.571765 Oct 04 20:55:34.032359 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2169/4379] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:55:33 2022] GET /compute/v2.1/servers/67656ca4-09a7-4e6b-bf3a-cfcd254e99e4 => generated 1523 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:55:34.050546 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2cacba37-c6e1-46e0-9866-51a5d8bb1f5b tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:55:34.051187 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-2cacba37-c6e1-46e0-9866-51a5d8bb1f5b tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] [instance: 601e4070-a868-49c6-b935-87eeeac4a826] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:55:34.068050 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2cacba37-c6e1-46e0-9866-51a5d8bb1f5b tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:34.068573 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2cacba37-c6e1-46e0-9866-51a5d8bb1f5b tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:34.070755 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2cacba37-c6e1-46e0-9866-51a5d8bb1f5b tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:34.071837 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2cacba37-c6e1-46e0-9866-51a5d8bb1f5b tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:34.072327 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2cacba37-c6e1-46e0-9866-51a5d8bb1f5b tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:34.072775 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2cacba37-c6e1-46e0-9866-51a5d8bb1f5b tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:34.086752 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-5b6c6bfb-37ea-4aa0-b5db-b21cc4ecfaba tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b78af5c0485b4343900269160ef3e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659f3d4023b347d58bc0361db9ceead9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:34.108385 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-5b6c6bfb-37ea-4aa0-b5db-b21cc4ecfaba tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b78af5c0485b4343900269160ef3e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659f3d4023b347d58bc0361db9ceead9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:34.113841 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-5b6c6bfb-37ea-4aa0-b5db-b21cc4ecfaba tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b78af5c0485b4343900269160ef3e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659f3d4023b347d58bc0361db9ceead9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:34.117609 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-5b6c6bfb-37ea-4aa0-b5db-b21cc4ecfaba tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] 10.222.0.33 "GET /compute/v2.1/servers/f8ba4e66-2997-4822-9c01-c570f5ae6e87" status: 200 len: 2957 microversion: 2.42 time: 0.600696 Oct 04 20:55:34.118759 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2211/4380] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:55:33 2022] GET /compute/v2.1/servers/f8ba4e66-2997-4822-9c01-c570f5ae6e87 => generated 2957 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:55:34.125008 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-53c243b7-dfbd-4819-ac02-60cd6a312616 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:55:34.131363 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-53c243b7-dfbd-4819-ac02-60cd6a312616 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] [instance: 0d82589c-f627-44b7-95cd-30e07a27a1a8] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:55:34.151220 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-53c243b7-dfbd-4819-ac02-60cd6a312616 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:34.152580 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-53c243b7-dfbd-4819-ac02-60cd6a312616 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:34.157248 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-53c243b7-dfbd-4819-ac02-60cd6a312616 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:34.162593 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-53c243b7-dfbd-4819-ac02-60cd6a312616 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:34.163093 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-53c243b7-dfbd-4819-ac02-60cd6a312616 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:34.163586 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-53c243b7-dfbd-4819-ac02-60cd6a312616 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:34.244181 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-2cacba37-c6e1-46e0-9866-51a5d8bb1f5b tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4adee36830c640919981ae58bd326157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '589fcee1949d4820a8958ec55ce4b43a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:34.260114 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-2cacba37-c6e1-46e0-9866-51a5d8bb1f5b tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4adee36830c640919981ae58bd326157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '589fcee1949d4820a8958ec55ce4b43a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:34.261588 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-2cacba37-c6e1-46e0-9866-51a5d8bb1f5b tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4adee36830c640919981ae58bd326157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '589fcee1949d4820a8958ec55ce4b43a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:34.262865 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-2cacba37-c6e1-46e0-9866-51a5d8bb1f5b tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] 10.222.0.33 "GET /compute/v2.1/servers/601e4070-a868-49c6-b935-87eeeac4a826" status: 200 len: 1362 microversion: 2.47 time: 0.237882 Oct 04 20:55:34.264374 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2170/4381] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:55:34 2022] GET /compute/v2.1/servers/601e4070-a868-49c6-b935-87eeeac4a826 => generated 1362 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:55:34.268942 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-3878e7d9-9f8b-448f-ba8a-d4fc65dfe306 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:55:34.269567 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-3878e7d9-9f8b-448f-ba8a-d4fc65dfe306 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] [instance: 1ed60bf8-87e6-4a70-be59-830bee5f8b6d] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:55:34.290678 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3878e7d9-9f8b-448f-ba8a-d4fc65dfe306 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:34.290678 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3878e7d9-9f8b-448f-ba8a-d4fc65dfe306 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:34.290678 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3878e7d9-9f8b-448f-ba8a-d4fc65dfe306 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:34.291280 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3878e7d9-9f8b-448f-ba8a-d4fc65dfe306 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:34.291732 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3878e7d9-9f8b-448f-ba8a-d4fc65dfe306 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:34.291851 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3878e7d9-9f8b-448f-ba8a-d4fc65dfe306 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:34.691272 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-3878e7d9-9f8b-448f-ba8a-d4fc65dfe306 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc4171c0ee14ebb8b5eff5e910ccf49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003eb03a265a496d8981e45c74b014f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:34.711951 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-3878e7d9-9f8b-448f-ba8a-d4fc65dfe306 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] 10.222.0.33 "GET /compute/v2.1/servers/1ed60bf8-87e6-4a70-be59-830bee5f8b6d" status: 200 len: 1522 microversion: 2.1 time: 0.446455 Oct 04 20:55:34.724534 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2171/4382] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:55:34 2022] GET /compute/v2.1/servers/1ed60bf8-87e6-4a70-be59-830bee5f8b6d => generated 1522 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:55:34.742359 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-6b94c30d-494b-41bc-98bc-de0233f724b2 req-71faedeb-a6f5-4621-b3c6-02bf14d5134f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23613d5c-93a4-4da9-be4e-deac3d259cb5", "tag": "88538d39-4580-482d-b0db-d076f79f963b"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:55:34.768974 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-6b94c30d-494b-41bc-98bc-de0233f724b2 req-71faedeb-a6f5-4621-b3c6-02bf14d5134f service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:34.769537 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-6b94c30d-494b-41bc-98bc-de0233f724b2 req-71faedeb-a6f5-4621-b3c6-02bf14d5134f service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:34.769988 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-6b94c30d-494b-41bc-98bc-de0233f724b2 req-71faedeb-a6f5-4621-b3c6-02bf14d5134f service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:34.821048 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-6b94c30d-494b-41bc-98bc-de0233f724b2 req-71faedeb-a6f5-4621-b3c6-02bf14d5134f service nova] Creating event network-changed:88538d39-4580-482d-b0db-d076f79f963b for instance 23613d5c-93a4-4da9-be4e-deac3d259cb5 on n-h1-854823-8 Oct 04 20:55:34.836666 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-6b94c30d-494b-41bc-98bc-de0233f724b2 req-71faedeb-a6f5-4621-b3c6-02bf14d5134f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103878 Oct 04 20:55:34.837634 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2172/4383] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:55:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:55:34.913004 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-53c243b7-dfbd-4819-ac02-60cd6a312616 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9061ddee3d48528f5849b2cc6a1d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7df9bc3521c479d9c16d3516b014cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:34.926610 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-53c243b7-dfbd-4819-ac02-60cd6a312616 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] 10.222.0.33 "GET /compute/v2.1/servers/0d82589c-f627-44b7-95cd-30e07a27a1a8" status: 200 len: 1319 microversion: 2.1 time: 0.806483 Oct 04 20:55:34.935488 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2212/4384] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:55:34 2022] GET /compute/v2.1/servers/0d82589c-f627-44b7-95cd-30e07a27a1a8 => generated 1319 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:55:35.044967 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-3e7f207e-31d0-4717-ba57-a1ec908285f5 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:55:35.045685 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-3e7f207e-31d0-4717-ba57-a1ec908285f5 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] [instance: 67656ca4-09a7-4e6b-bf3a-cfcd254e99e4] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:55:35.058788 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3e7f207e-31d0-4717-ba57-a1ec908285f5 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:35.059297 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3e7f207e-31d0-4717-ba57-a1ec908285f5 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:35.060373 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3e7f207e-31d0-4717-ba57-a1ec908285f5 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:35.063005 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3e7f207e-31d0-4717-ba57-a1ec908285f5 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:35.069245 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3e7f207e-31d0-4717-ba57-a1ec908285f5 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:35.072362 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3e7f207e-31d0-4717-ba57-a1ec908285f5 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:35.151374 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-b1f750a8-2caa-4780-a044-1ba3dd1fff30 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:55:35.152166 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-b1f750a8-2caa-4780-a044-1ba3dd1fff30 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] [instance: f8ba4e66-2997-4822-9c01-c570f5ae6e87] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:55:35.159740 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b1f750a8-2caa-4780-a044-1ba3dd1fff30 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:35.160242 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b1f750a8-2caa-4780-a044-1ba3dd1fff30 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:35.176445 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b1f750a8-2caa-4780-a044-1ba3dd1fff30 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:35.177332 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b1f750a8-2caa-4780-a044-1ba3dd1fff30 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:35.177829 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b1f750a8-2caa-4780-a044-1ba3dd1fff30 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:35.178276 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b1f750a8-2caa-4780-a044-1ba3dd1fff30 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:35.627343 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-3e7f207e-31d0-4717-ba57-a1ec908285f5 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e93855201ca64c779f92a2a33979b81f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed328a1e964d46902dee5e1c7c7b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:35.638688 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-3e7f207e-31d0-4717-ba57-a1ec908285f5 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] 10.222.0.33 "GET /compute/v2.1/servers/67656ca4-09a7-4e6b-bf3a-cfcd254e99e4" status: 200 len: 1523 microversion: 2.1 time: 0.601837 Oct 04 20:55:35.645379 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2173/4385] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:55:35 2022] GET /compute/v2.1/servers/67656ca4-09a7-4e6b-bf3a-cfcd254e99e4 => generated 1523 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:55:35.654531 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1027014c-881d-454e-9c42-19bc2995190d tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:55:35.656631 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-1027014c-881d-454e-9c42-19bc2995190d tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] [instance: 601e4070-a868-49c6-b935-87eeeac4a826] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:55:35.669178 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1027014c-881d-454e-9c42-19bc2995190d tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:35.669939 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1027014c-881d-454e-9c42-19bc2995190d tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:35.670811 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1027014c-881d-454e-9c42-19bc2995190d tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:35.671693 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1027014c-881d-454e-9c42-19bc2995190d tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:35.672312 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1027014c-881d-454e-9c42-19bc2995190d tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:35.673320 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1027014c-881d-454e-9c42-19bc2995190d tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:36.205154 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-b1f750a8-2caa-4780-a044-1ba3dd1fff30 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b78af5c0485b4343900269160ef3e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659f3d4023b347d58bc0361db9ceead9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:36.217253 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-b1f750a8-2caa-4780-a044-1ba3dd1fff30 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b78af5c0485b4343900269160ef3e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659f3d4023b347d58bc0361db9ceead9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:36.219906 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-b1f750a8-2caa-4780-a044-1ba3dd1fff30 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b78af5c0485b4343900269160ef3e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659f3d4023b347d58bc0361db9ceead9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:36.222253 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-b1f750a8-2caa-4780-a044-1ba3dd1fff30 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] 10.222.0.33 "GET /compute/v2.1/servers/f8ba4e66-2997-4822-9c01-c570f5ae6e87" status: 200 len: 2957 microversion: 2.42 time: 1.075706 Oct 04 20:55:36.223634 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2213/4386] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:55:35 2022] GET /compute/v2.1/servers/f8ba4e66-2997-4822-9c01-c570f5ae6e87 => generated 2957 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 20:55:36.229584 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-e3d1e72d-f563-43a4-a923-31438824a14e req-c71da831-6c47-4ee2-9a4f-fb8ad5fadc83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67656ca4-09a7-4e6b-bf3a-cfcd254e99e4", "name": "network-vif-plugged", "status": "completed", "tag": "520b47f9-ca55-4bc2-99bd-5d338296bb06"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:55:36.240122 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-e3d1e72d-f563-43a4-a923-31438824a14e req-c71da831-6c47-4ee2-9a4f-fb8ad5fadc83 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:36.241479 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-e3d1e72d-f563-43a4-a923-31438824a14e req-c71da831-6c47-4ee2-9a4f-fb8ad5fadc83 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:36.242813 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-e3d1e72d-f563-43a4-a923-31438824a14e req-c71da831-6c47-4ee2-9a4f-fb8ad5fadc83 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:36.246442 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-1027014c-881d-454e-9c42-19bc2995190d tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4adee36830c640919981ae58bd326157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '589fcee1949d4820a8958ec55ce4b43a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:36.256419 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-e3d1e72d-f563-43a4-a923-31438824a14e req-c71da831-6c47-4ee2-9a4f-fb8ad5fadc83 service nova] Creating event network-vif-plugged:520b47f9-ca55-4bc2-99bd-5d338296bb06 for instance 67656ca4-09a7-4e6b-bf3a-cfcd254e99e4 on n-h2-854823-8 Oct 04 20:55:36.261199 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-1027014c-881d-454e-9c42-19bc2995190d tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4adee36830c640919981ae58bd326157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '589fcee1949d4820a8958ec55ce4b43a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:36.262688 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-1027014c-881d-454e-9c42-19bc2995190d tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4adee36830c640919981ae58bd326157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '589fcee1949d4820a8958ec55ce4b43a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:36.263331 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-e3d1e72d-f563-43a4-a923-31438824a14e req-c71da831-6c47-4ee2-9a4f-fb8ad5fadc83 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037812 Oct 04 20:55:36.264502 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2214/4387] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:55:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:55:36.270365 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-1027014c-881d-454e-9c42-19bc2995190d tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] 10.222.0.33 "GET /compute/v2.1/servers/601e4070-a868-49c6-b935-87eeeac4a826" status: 200 len: 1362 microversion: 2.47 time: 0.621172 Oct 04 20:55:36.270966 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2174/4388] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:55:35 2022] GET /compute/v2.1/servers/601e4070-a868-49c6-b935-87eeeac4a826 => generated 1362 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:55:36.271951 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-095e9140-0892-49c5-be5e-36b3c7b37edc tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:55:36.274493 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-095e9140-0892-49c5-be5e-36b3c7b37edc tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] [instance: 1ed60bf8-87e6-4a70-be59-830bee5f8b6d] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:55:36.281299 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-095e9140-0892-49c5-be5e-36b3c7b37edc tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:36.282066 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7265dbec-6120-4b1b-b2c0-63fa243e4d18 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:55:36.282317 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-095e9140-0892-49c5-be5e-36b3c7b37edc tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:36.282994 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-095e9140-0892-49c5-be5e-36b3c7b37edc tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:36.284040 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-095e9140-0892-49c5-be5e-36b3c7b37edc tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:36.284708 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-095e9140-0892-49c5-be5e-36b3c7b37edc tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:36.285013 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-7265dbec-6120-4b1b-b2c0-63fa243e4d18 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] [instance: 0d82589c-f627-44b7-95cd-30e07a27a1a8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:55:36.285585 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-095e9140-0892-49c5-be5e-36b3c7b37edc tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:36.312632 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7265dbec-6120-4b1b-b2c0-63fa243e4d18 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:36.313430 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7265dbec-6120-4b1b-b2c0-63fa243e4d18 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:36.315709 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7265dbec-6120-4b1b-b2c0-63fa243e4d18 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:36.319939 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7265dbec-6120-4b1b-b2c0-63fa243e4d18 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:36.332978 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7265dbec-6120-4b1b-b2c0-63fa243e4d18 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:36.334614 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7265dbec-6120-4b1b-b2c0-63fa243e4d18 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:36.754848 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-095e9140-0892-49c5-be5e-36b3c7b37edc tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc4171c0ee14ebb8b5eff5e910ccf49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003eb03a265a496d8981e45c74b014f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:36.765957 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-095e9140-0892-49c5-be5e-36b3c7b37edc tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] 10.222.0.33 "GET /compute/v2.1/servers/1ed60bf8-87e6-4a70-be59-830bee5f8b6d" status: 200 len: 1522 microversion: 2.1 time: 0.499708 Oct 04 20:55:36.767061 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2215/4389] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:55:36 2022] GET /compute/v2.1/servers/1ed60bf8-87e6-4a70-be59-830bee5f8b6d => generated 1522 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:55:36.777462 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-5cc31709-808b-41a9-a3ce-f6192a85ee77 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:55:36.778093 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-5cc31709-808b-41a9-a3ce-f6192a85ee77 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] [instance: 67656ca4-09a7-4e6b-bf3a-cfcd254e99e4] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:55:36.795031 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5cc31709-808b-41a9-a3ce-f6192a85ee77 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:36.795525 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5cc31709-808b-41a9-a3ce-f6192a85ee77 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:36.795961 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5cc31709-808b-41a9-a3ce-f6192a85ee77 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:36.796668 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5cc31709-808b-41a9-a3ce-f6192a85ee77 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:36.797118 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5cc31709-808b-41a9-a3ce-f6192a85ee77 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:36.797537 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5cc31709-808b-41a9-a3ce-f6192a85ee77 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:36.823316 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-7265dbec-6120-4b1b-b2c0-63fa243e4d18 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9061ddee3d48528f5849b2cc6a1d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7df9bc3521c479d9c16d3516b014cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:36.837308 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-7265dbec-6120-4b1b-b2c0-63fa243e4d18 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] 10.222.0.33 "GET /compute/v2.1/servers/0d82589c-f627-44b7-95cd-30e07a27a1a8" status: 200 len: 1319 microversion: 2.1 time: 0.565219 Oct 04 20:55:36.837912 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2175/4390] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:55:36 2022] GET /compute/v2.1/servers/0d82589c-f627-44b7-95cd-30e07a27a1a8 => generated 1319 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:55:36.879753 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-b72e7765-2170-4a06-9bc6-c37e0ced90cc req-c7799397-f388-47ce-943d-979aaf4e0d3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ed60bf8-87e6-4a70-be59-830bee5f8b6d", "name": "network-vif-deleted", "tag": "d8248224-d191-4ad2-aa54-10fa1fd06154"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:55:36.896267 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-b72e7765-2170-4a06-9bc6-c37e0ced90cc req-c7799397-f388-47ce-943d-979aaf4e0d3a service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:36.899074 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-b72e7765-2170-4a06-9bc6-c37e0ced90cc req-c7799397-f388-47ce-943d-979aaf4e0d3a service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:36.899595 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-b72e7765-2170-4a06-9bc6-c37e0ced90cc req-c7799397-f388-47ce-943d-979aaf4e0d3a service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:36.919191 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-b72e7765-2170-4a06-9bc6-c37e0ced90cc req-c7799397-f388-47ce-943d-979aaf4e0d3a service nova] Creating event network-vif-deleted:d8248224-d191-4ad2-aa54-10fa1fd06154 for instance 1ed60bf8-87e6-4a70-be59-830bee5f8b6d on n-h1-854823-8 Oct 04 20:55:36.927769 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-b72e7765-2170-4a06-9bc6-c37e0ced90cc req-c7799397-f388-47ce-943d-979aaf4e0d3a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051448 Oct 04 20:55:36.928875 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2176/4391] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:55:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 20:55:37.256743 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-edcca42f-eebf-4771-add9-af5047498f07 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:55:37.259708 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-edcca42f-eebf-4771-add9-af5047498f07 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] [instance: f8ba4e66-2997-4822-9c01-c570f5ae6e87] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:55:37.265083 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:55:37.277083 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-edcca42f-eebf-4771-add9-af5047498f07 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:37.277767 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-edcca42f-eebf-4771-add9-af5047498f07 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:37.278416 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-edcca42f-eebf-4771-add9-af5047498f07 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:37.279309 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-edcca42f-eebf-4771-add9-af5047498f07 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:37.279922 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-edcca42f-eebf-4771-add9-af5047498f07 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:37.282232 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-edcca42f-eebf-4771-add9-af5047498f07 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:37.345770 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=12 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:55:37.491173 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-5cc31709-808b-41a9-a3ce-f6192a85ee77 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e93855201ca64c779f92a2a33979b81f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed328a1e964d46902dee5e1c7c7b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:37.504495 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-5cc31709-808b-41a9-a3ce-f6192a85ee77 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] 10.222.0.33 "GET /compute/v2.1/servers/67656ca4-09a7-4e6b-bf3a-cfcd254e99e4" status: 200 len: 1523 microversion: 2.1 time: 0.736161 Oct 04 20:55:37.505236 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2216/4392] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:55:36 2022] GET /compute/v2.1/servers/67656ca4-09a7-4e6b-bf3a-cfcd254e99e4 => generated 1523 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:55:37.512250 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-a4ac7c1d-881f-4b94-ae9c-26c49ba520ef tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:55:37.513799 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-a4ac7c1d-881f-4b94-ae9c-26c49ba520ef tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] [instance: 601e4070-a868-49c6-b935-87eeeac4a826] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:55:37.521290 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a4ac7c1d-881f-4b94-ae9c-26c49ba520ef tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:37.522118 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a4ac7c1d-881f-4b94-ae9c-26c49ba520ef tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:37.522838 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a4ac7c1d-881f-4b94-ae9c-26c49ba520ef tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:37.523738 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a4ac7c1d-881f-4b94-ae9c-26c49ba520ef tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:37.524342 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a4ac7c1d-881f-4b94-ae9c-26c49ba520ef tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:37.525000 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a4ac7c1d-881f-4b94-ae9c-26c49ba520ef tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:37.693309 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-a4ac7c1d-881f-4b94-ae9c-26c49ba520ef tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4adee36830c640919981ae58bd326157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '589fcee1949d4820a8958ec55ce4b43a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:37.708162 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-a4ac7c1d-881f-4b94-ae9c-26c49ba520ef tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4adee36830c640919981ae58bd326157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '589fcee1949d4820a8958ec55ce4b43a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:37.709615 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-a4ac7c1d-881f-4b94-ae9c-26c49ba520ef tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4adee36830c640919981ae58bd326157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '589fcee1949d4820a8958ec55ce4b43a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:37.716389 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-a4ac7c1d-881f-4b94-ae9c-26c49ba520ef tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] 10.222.0.33 "GET /compute/v2.1/servers/601e4070-a868-49c6-b935-87eeeac4a826" status: 200 len: 1362 microversion: 2.47 time: 0.209557 Oct 04 20:55:37.719581 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2217/4393] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:55:37 2022] GET /compute/v2.1/servers/601e4070-a868-49c6-b935-87eeeac4a826 => generated 1362 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:55:37.791061 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-8e82ee9c-9e9d-4776-b56e-d6f3ad7ec6b5 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:55:37.792182 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-8e82ee9c-9e9d-4776-b56e-d6f3ad7ec6b5 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] [instance: 1ed60bf8-87e6-4a70-be59-830bee5f8b6d] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:55:37.805303 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8e82ee9c-9e9d-4776-b56e-d6f3ad7ec6b5 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:37.806137 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8e82ee9c-9e9d-4776-b56e-d6f3ad7ec6b5 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:37.806829 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8e82ee9c-9e9d-4776-b56e-d6f3ad7ec6b5 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:37.808146 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8e82ee9c-9e9d-4776-b56e-d6f3ad7ec6b5 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:37.811554 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8e82ee9c-9e9d-4776-b56e-d6f3ad7ec6b5 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:37.812520 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8e82ee9c-9e9d-4776-b56e-d6f3ad7ec6b5 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:37.833170 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-edcca42f-eebf-4771-add9-af5047498f07 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b78af5c0485b4343900269160ef3e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659f3d4023b347d58bc0361db9ceead9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:37.848267 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-edcca42f-eebf-4771-add9-af5047498f07 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b78af5c0485b4343900269160ef3e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659f3d4023b347d58bc0361db9ceead9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:37.857571 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-edcca42f-eebf-4771-add9-af5047498f07 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b78af5c0485b4343900269160ef3e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659f3d4023b347d58bc0361db9ceead9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:37.860704 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-edcca42f-eebf-4771-add9-af5047498f07 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] 10.222.0.33 "GET /compute/v2.1/servers/f8ba4e66-2997-4822-9c01-c570f5ae6e87" status: 200 len: 2957 microversion: 2.42 time: 0.609443 Oct 04 20:55:37.864236 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2177/4394] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:55:37 2022] GET /compute/v2.1/servers/f8ba4e66-2997-4822-9c01-c570f5ae6e87 => generated 2957 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 20:55:37.869366 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8e82ee9c-9e9d-4776-b56e-d6f3ad7ec6b5 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:37.870165 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8e82ee9c-9e9d-4776-b56e-d6f3ad7ec6b5 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:37.870637 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8704e009-409d-4ad5-90f3-5b8b90042672 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:55:37.871114 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8e82ee9c-9e9d-4776-b56e-d6f3ad7ec6b5 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:37.871259 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-8704e009-409d-4ad5-90f3-5b8b90042672 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] [instance: 0d82589c-f627-44b7-95cd-30e07a27a1a8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:55:37.871887 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.objects.instance [None req-8e82ee9c-9e9d-4776-b56e-d6f3ad7ec6b5 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lazy-loading 'fault' on Instance uuid 1ed60bf8-87e6-4a70-be59-830bee5f8b6d {{(pid=128802) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:55:37.910325 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8704e009-409d-4ad5-90f3-5b8b90042672 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:37.911227 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8704e009-409d-4ad5-90f3-5b8b90042672 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:37.911950 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8704e009-409d-4ad5-90f3-5b8b90042672 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:37.914242 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8704e009-409d-4ad5-90f3-5b8b90042672 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:37.915309 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8704e009-409d-4ad5-90f3-5b8b90042672 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:37.916707 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8704e009-409d-4ad5-90f3-5b8b90042672 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:37.935807 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-8e82ee9c-9e9d-4776-b56e-d6f3ad7ec6b5 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc4171c0ee14ebb8b5eff5e910ccf49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003eb03a265a496d8981e45c74b014f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:37.945915 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-8e82ee9c-9e9d-4776-b56e-d6f3ad7ec6b5 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] 10.222.0.33 "GET /compute/v2.1/servers/1ed60bf8-87e6-4a70-be59-830bee5f8b6d" status: 200 len: 1312 microversion: 2.1 time: 0.160507 Oct 04 20:55:37.949926 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2218/4395] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:55:37 2022] GET /compute/v2.1/servers/1ed60bf8-87e6-4a70-be59-830bee5f8b6d => generated 1312 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:55:38.219362 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-8704e009-409d-4ad5-90f3-5b8b90042672 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9061ddee3d48528f5849b2cc6a1d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7df9bc3521c479d9c16d3516b014cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:38.230991 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-8704e009-409d-4ad5-90f3-5b8b90042672 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] 10.222.0.33 "GET /compute/v2.1/servers/0d82589c-f627-44b7-95cd-30e07a27a1a8" status: 200 len: 1319 microversion: 2.1 time: 0.365346 Oct 04 20:55:38.231572 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2178/4396] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:55:37 2022] GET /compute/v2.1/servers/0d82589c-f627-44b7-95cd-30e07a27a1a8 => generated 1319 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:55:38.532646 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-743c222e-5543-4992-984d-0880b650dea6 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:55:38.533268 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-743c222e-5543-4992-984d-0880b650dea6 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] [instance: 67656ca4-09a7-4e6b-bf3a-cfcd254e99e4] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:55:38.546707 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-743c222e-5543-4992-984d-0880b650dea6 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:38.547402 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-743c222e-5543-4992-984d-0880b650dea6 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:38.550669 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-743c222e-5543-4992-984d-0880b650dea6 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:38.551453 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-743c222e-5543-4992-984d-0880b650dea6 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:38.551944 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-743c222e-5543-4992-984d-0880b650dea6 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:38.552390 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-743c222e-5543-4992-984d-0880b650dea6 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:38.752698 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1b3b4b62-cb81-4b19-90f4-f01afa055aec tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:55:38.755139 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-1b3b4b62-cb81-4b19-90f4-f01afa055aec tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] [instance: 601e4070-a868-49c6-b935-87eeeac4a826] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:55:38.763737 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1b3b4b62-cb81-4b19-90f4-f01afa055aec tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:38.764529 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1b3b4b62-cb81-4b19-90f4-f01afa055aec tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:38.765259 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1b3b4b62-cb81-4b19-90f4-f01afa055aec tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:38.766421 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1b3b4b62-cb81-4b19-90f4-f01afa055aec tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:38.767229 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1b3b4b62-cb81-4b19-90f4-f01afa055aec tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:38.768036 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1b3b4b62-cb81-4b19-90f4-f01afa055aec tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:38.805896 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1b3b4b62-cb81-4b19-90f4-f01afa055aec tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:38.806685 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1b3b4b62-cb81-4b19-90f4-f01afa055aec tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:38.807131 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1b3b4b62-cb81-4b19-90f4-f01afa055aec tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:38.807600 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-1b3b4b62-cb81-4b19-90f4-f01afa055aec tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Lazy-loading 'fault' on Instance uuid 601e4070-a868-49c6-b935-87eeeac4a826 {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:55:38.875510 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-1b3b4b62-cb81-4b19-90f4-f01afa055aec tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4adee36830c640919981ae58bd326157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '589fcee1949d4820a8958ec55ce4b43a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:38.894566 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-743c222e-5543-4992-984d-0880b650dea6 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e93855201ca64c779f92a2a33979b81f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed328a1e964d46902dee5e1c7c7b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:38.894769 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-1b3b4b62-cb81-4b19-90f4-f01afa055aec tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4adee36830c640919981ae58bd326157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '589fcee1949d4820a8958ec55ce4b43a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:38.899160 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-1b3b4b62-cb81-4b19-90f4-f01afa055aec tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4adee36830c640919981ae58bd326157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '589fcee1949d4820a8958ec55ce4b43a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:38.902946 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-1b3b4b62-cb81-4b19-90f4-f01afa055aec tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] 10.222.0.33 "GET /compute/v2.1/servers/601e4070-a868-49c6-b935-87eeeac4a826" status: 200 len: 1367 microversion: 2.47 time: 0.154902 Oct 04 20:55:38.903400 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:55:38.903590 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2179/4397] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:55:38 2022] GET /compute/v2.1/servers/601e4070-a868-49c6-b935-87eeeac4a826 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:55:38.919435 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5b06ed9b-5c64-41ac-80d5-c8c77e1c5220 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:55:38.919435 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-5b06ed9b-5c64-41ac-80d5-c8c77e1c5220 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] [instance: f8ba4e66-2997-4822-9c01-c570f5ae6e87] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:55:38.933163 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-743c222e-5543-4992-984d-0880b650dea6 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] 10.222.0.33 "GET /compute/v2.1/servers/67656ca4-09a7-4e6b-bf3a-cfcd254e99e4" status: 200 len: 1508 microversion: 2.1 time: 0.394083 Oct 04 20:55:38.939797 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5b06ed9b-5c64-41ac-80d5-c8c77e1c5220 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:38.940079 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5b06ed9b-5c64-41ac-80d5-c8c77e1c5220 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:38.940529 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5b06ed9b-5c64-41ac-80d5-c8c77e1c5220 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:38.941247 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5b06ed9b-5c64-41ac-80d5-c8c77e1c5220 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:38.941717 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5b06ed9b-5c64-41ac-80d5-c8c77e1c5220 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:38.942141 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5b06ed9b-5c64-41ac-80d5-c8c77e1c5220 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:38.942282 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2219/4398] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:55:38 2022] GET /compute/v2.1/servers/67656ca4-09a7-4e6b-bf3a-cfcd254e99e4 => generated 1508 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:55:38.952584 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=100 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:55:38.963192 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-31cc37e1-d27f-4b07-9934-e6a18c843ede tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:55:38.964111 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-31cc37e1-d27f-4b07-9934-e6a18c843ede tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] [instance: 67656ca4-09a7-4e6b-bf3a-cfcd254e99e4] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:55:38.978071 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-31cc37e1-d27f-4b07-9934-e6a18c843ede tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:38.978615 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-31cc37e1-d27f-4b07-9934-e6a18c843ede tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:38.979059 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-31cc37e1-d27f-4b07-9934-e6a18c843ede tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:38.979780 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-31cc37e1-d27f-4b07-9934-e6a18c843ede tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:38.980245 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-31cc37e1-d27f-4b07-9934-e6a18c843ede tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:38.980675 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-31cc37e1-d27f-4b07-9934-e6a18c843ede tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:39.901049 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-5b06ed9b-5c64-41ac-80d5-c8c77e1c5220 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b78af5c0485b4343900269160ef3e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659f3d4023b347d58bc0361db9ceead9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:39.920868 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-5b06ed9b-5c64-41ac-80d5-c8c77e1c5220 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b78af5c0485b4343900269160ef3e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659f3d4023b347d58bc0361db9ceead9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:39.928108 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-31cc37e1-d27f-4b07-9934-e6a18c843ede tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e93855201ca64c779f92a2a33979b81f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed328a1e964d46902dee5e1c7c7b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:39.942799 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-5b06ed9b-5c64-41ac-80d5-c8c77e1c5220 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b78af5c0485b4343900269160ef3e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659f3d4023b347d58bc0361db9ceead9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:39.949155 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5b06ed9b-5c64-41ac-80d5-c8c77e1c5220 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] 10.222.0.33 "GET /compute/v2.1/servers/f8ba4e66-2997-4822-9c01-c570f5ae6e87" status: 200 len: 2957 microversion: 2.42 time: 1.044505 Oct 04 20:55:39.949895 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-31cc37e1-d27f-4b07-9934-e6a18c843ede tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] 10.222.0.33 "GET /compute/v2.1/servers/67656ca4-09a7-4e6b-bf3a-cfcd254e99e4" status: 200 len: 1508 microversion: 2.1 time: 0.989419 Oct 04 20:55:39.952111 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2180/4399] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:55:38 2022] GET /compute/v2.1/servers/f8ba4e66-2997-4822-9c01-c570f5ae6e87 => generated 2957 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:55:39.952510 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2220/4400] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:55:38 2022] GET /compute/v2.1/servers/67656ca4-09a7-4e6b-bf3a-cfcd254e99e4 => generated 1508 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:55:39.975408 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f06c0d1e-c3dc-4b26-a93c-3335f8f037d5 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:55:39.979222 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-d221c3b6-85d5-41d0-bc09-e55bb69c0ab0 req-3fe8adaf-4689-45b7-a78a-a123b4f1776c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8ba4e66-2997-4822-9c01-c570f5ae6e87", "name": "network-vif-unplugged", "status": "completed", "tag": "ad4a640c-5df6-4e63-9966-9e83e88c558b"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:55:39.979746 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f06c0d1e-c3dc-4b26-a93c-3335f8f037d5 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] [instance: 1ed60bf8-87e6-4a70-be59-830bee5f8b6d] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:55:40.024550 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-d221c3b6-85d5-41d0-bc09-e55bb69c0ab0 req-3fe8adaf-4689-45b7-a78a-a123b4f1776c service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:40.027562 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f06c0d1e-c3dc-4b26-a93c-3335f8f037d5 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:40.028773 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-d221c3b6-85d5-41d0-bc09-e55bb69c0ab0 req-3fe8adaf-4689-45b7-a78a-a123b4f1776c service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:40.031240 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f06c0d1e-c3dc-4b26-a93c-3335f8f037d5 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:40.031653 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-d221c3b6-85d5-41d0-bc09-e55bb69c0ab0 req-3fe8adaf-4689-45b7-a78a-a123b4f1776c service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:40.034443 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f06c0d1e-c3dc-4b26-a93c-3335f8f037d5 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:40.040621 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f06c0d1e-c3dc-4b26-a93c-3335f8f037d5 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:40.042021 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f06c0d1e-c3dc-4b26-a93c-3335f8f037d5 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:40.046847 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f06c0d1e-c3dc-4b26-a93c-3335f8f037d5 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:40.097326 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-d221c3b6-85d5-41d0-bc09-e55bb69c0ab0 req-3fe8adaf-4689-45b7-a78a-a123b4f1776c service nova] Creating event network-vif-unplugged:ad4a640c-5df6-4e63-9966-9e83e88c558b for instance f8ba4e66-2997-4822-9c01-c570f5ae6e87 on n-h1-854823-8 Oct 04 20:55:40.107584 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-f06c0d1e-c3dc-4b26-a93c-3335f8f037d5 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] HTTP exception thrown: Instance 1ed60bf8-87e6-4a70-be59-830bee5f8b6d could not be found. Oct 04 20:55:40.111675 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f06c0d1e-c3dc-4b26-a93c-3335f8f037d5 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Request method failure captured: Oct 04 20:55:40.111675 n-d-854823-8 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/1ed60bf8-87e6-4a70-be59-830bee5f8b6d HTTP/1.1 Oct 04 20:55:40.111675 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:55:40.111675 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:55:40.111675 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:55:40.111675 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 0 Oct 04 20:55:40.111675 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:55:40.111675 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:55:40.111675 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:55:40.111675 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:55:40.111675 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJyQzA2j2TP516GvcpxgrBfRY2YO9l5F5hDF6OrxoVmO38Ubui7rW9ilb7hzquPDxl35ZSulQSvQlms9Io4ULkRGXw-K9Mq_8wy4teEQxOMGhx3owN2R9ZyECEeAocP_VsKpWXZTRpHKvfvEO-wS1AA94MTw8YrFoFgm4uO6w6GPzhQ Oct 04 20:55:40.111675 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:55:40.111675 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:55:40.111675 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:55:40.111675 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:55:40.111675 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:55:40.111675 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:55:40.111675 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: 003eb03a265a496d8981e45c74b014f3 Oct 04 20:55:40.111675 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2028044299 Oct 04 20:55:40.111675 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 20:55:40.111675 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 20:55:40.111675 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_003eb03a265a496d8981e45c74b014f3", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/003eb03a265a496d8981e45c74b014f3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/003eb03a265a496d8981e45c74b014f3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/003eb03a265a496d8981e45c74b014f3"}]}] Oct 04 20:55:40.111675 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2028044299 Oct 04 20:55:40.111675 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: 003eb03a265a496d8981e45c74b014f3 Oct 04 20:55:40.111675 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2028044299 Oct 04 20:55:40.111675 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-ServerRescueNegativeTestJSON-2028044299-project Oct 04 20:55:40.111675 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:55:40.111675 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:55:40.111675 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: 4dc4171c0ee14ebb8b5eff5e910ccf49 Oct 04 20:55:40.111675 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2028044299-project Oct 04 20:55:40.111675 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 20:55:40.111675 n-d-854823-8 devstack@n-api.service[128801]: exception: Instance 1ed60bf8-87e6-4a70-be59-830bee5f8b6d could not be found. Oct 04 20:55:40.111675 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': '1ed60bf8-87e6-4a70-be59-830bee5f8b6d'} Oct 04 20:55:40.111675 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:55:40.111675 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:55:40.111675 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:55:40.111675 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:55:40.111675 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:55:40.111675 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:55:40.111675 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:55:40.111675 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:55:40.111675 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:55:40.111675 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:55:40.111675 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1ed60bf8-87e6-4a70-be59-830bee5f8b6d could not be found. Oct 04 20:55:40.111675 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:55:40.111675 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:55:40.111675 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:55:40.111675 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:55:40.111675 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:55:40.111675 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:55:40.111675 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:55:40.111675 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:55:40.111675 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:55:40.111675 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:55:40.111675 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:55:40.111675 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:55:40.111675 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:55:40.111675 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:55:40.111675 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:55:40.111675 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:55:40.111675 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1ed60bf8-87e6-4a70-be59-830bee5f8b6d could not be found. Oct 04 20:55:40.111675 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:55:40.111675 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:55:40.116304 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:55:40.116304 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:55:40.116304 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:55:40.116304 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:55:40.116304 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:55:40.116304 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:55:40.116304 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1ed60bf8-87e6-4a70-be59-830bee5f8b6d could not be found. Oct 04 20:55:40.116304 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:55:40.118806 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f06c0d1e-c3dc-4b26-a93c-3335f8f037d5 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] Returning 404 to user: Instance 1ed60bf8-87e6-4a70-be59-830bee5f8b6d could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:55:40.119825 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f06c0d1e-c3dc-4b26-a93c-3335f8f037d5 tempest-ServerRescueNegativeTestJSON-2028044299 tempest-ServerRescueNegativeTestJSON-2028044299-project] 10.222.0.33 "GET /compute/v2.1/servers/1ed60bf8-87e6-4a70-be59-830bee5f8b6d" status: 404 len: 111 microversion: 2.1 time: 0.166142 Oct 04 20:55:40.124070 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-d221c3b6-85d5-41d0-bc09-e55bb69c0ab0 req-3fe8adaf-4689-45b7-a78a-a123b4f1776c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.165686 Oct 04 20:55:40.124955 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2181/4401] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:55:39 2022] GET /compute/v2.1/servers/1ed60bf8-87e6-4a70-be59-830bee5f8b6d => generated 111 bytes in 172 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:55:40.126574 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2221/4402] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:55:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:55:40.130756 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ade9c933-8d10-41d6-a67a-22c93d5b0e89 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:55:40.131551 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ade9c933-8d10-41d6-a67a-22c93d5b0e89 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] [instance: 0d82589c-f627-44b7-95cd-30e07a27a1a8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:55:40.139232 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ade9c933-8d10-41d6-a67a-22c93d5b0e89 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:40.140070 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ade9c933-8d10-41d6-a67a-22c93d5b0e89 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:40.140660 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ade9c933-8d10-41d6-a67a-22c93d5b0e89 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:40.141528 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ade9c933-8d10-41d6-a67a-22c93d5b0e89 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:40.142191 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ade9c933-8d10-41d6-a67a-22c93d5b0e89 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:40.142869 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ade9c933-8d10-41d6-a67a-22c93d5b0e89 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:40.143687 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-0325e291-2413-460e-a8b9-28953c80ef10 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:55:40.144410 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-0325e291-2413-460e-a8b9-28953c80ef10 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] [instance: 601e4070-a868-49c6-b935-87eeeac4a826] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:55:40.166542 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0325e291-2413-460e-a8b9-28953c80ef10 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:40.167045 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0325e291-2413-460e-a8b9-28953c80ef10 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:40.177991 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0325e291-2413-460e-a8b9-28953c80ef10 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:40.179683 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0325e291-2413-460e-a8b9-28953c80ef10 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:40.180196 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0325e291-2413-460e-a8b9-28953c80ef10 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:40.180648 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0325e291-2413-460e-a8b9-28953c80ef10 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:40.221958 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.wsgi [None req-0325e291-2413-460e-a8b9-28953c80ef10 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] HTTP exception thrown: Instance 601e4070-a868-49c6-b935-87eeeac4a826 could not be found. Oct 04 20:55:40.224195 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-0325e291-2413-460e-a8b9-28953c80ef10 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Request method failure captured: Oct 04 20:55:40.224195 n-d-854823-8 devstack@n-api.service[128802]: request: GET /compute/v2.1/servers/601e4070-a868-49c6-b935-87eeeac4a826 HTTP/1.1 Oct 04 20:55:40.224195 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 20:55:40.224195 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 20:55:40.224195 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 20:55:40.224195 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 0 Oct 04 20:55:40.224195 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 20:55:40.224195 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 20:55:40.224195 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 20:55:40.224195 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 20:55:40.224195 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPJ2PQthzDRVNHfXPyQ1ukBQ1TWTR3nIwYtRiyLsRA6UDE1p_USPKybpA1YAYXqX6eqvRFjNKS_zi0vxnanjUdA24107dXM6bRzSN7Lkapbea1iZa7fpijN6pmMw5AXOm-3ruAma9zF5T8pwIPFcc4sIhOy9y0CFHT2JYi4oh-FZPg7s Oct 04 20:55:40.224195 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 20:55:40.224195 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 20:55:40.224195 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 20:55:40.224195 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 20:55:40.224195 n-d-854823-8 devstack@n-api.service[128802]: X-Openstack-Nova-Api-Version: 2.47 Oct 04 20:55:40.224195 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 20:55:40.224195 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 20:55:40.224195 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: 589fcee1949d4820a8958ec55ce4b43a Oct 04 20:55:40.224195 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-ServerShowV247Test-56655044 Oct 04 20:55:40.224195 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 20:55:40.224195 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 20:55:40.224195 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_589fcee1949d4820a8958ec55ce4b43a", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/589fcee1949d4820a8958ec55ce4b43a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/589fcee1949d4820a8958ec55ce4b43a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/589fcee1949d4820a8958ec55ce4b43a"}]}] Oct 04 20:55:40.224195 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-ServerShowV247Test-56655044 Oct 04 20:55:40.224195 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: 589fcee1949d4820a8958ec55ce4b43a Oct 04 20:55:40.224195 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-ServerShowV247Test-56655044 Oct 04 20:55:40.224195 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-ServerShowV247Test-56655044-project Oct 04 20:55:40.224195 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 20:55:40.224195 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 20:55:40.224195 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: 4adee36830c640919981ae58bd326157 Oct 04 20:55:40.224195 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-ServerShowV247Test-56655044-project Oct 04 20:55:40.224195 n-d-854823-8 devstack@n-api.service[128802]: method: > Oct 04 20:55:40.224195 n-d-854823-8 devstack@n-api.service[128802]: exception: Instance 601e4070-a868-49c6-b935-87eeeac4a826 could not be found. Oct 04 20:55:40.224195 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'id': '601e4070-a868-49c6-b935-87eeeac4a826'} Oct 04 20:55:40.224195 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:55:40.224195 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:55:40.224195 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:55:40.224195 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:55:40.224195 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:55:40.224195 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:55:40.224195 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:55:40.224195 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:55:40.224195 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:55:40.224195 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:55:40.224195 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 601e4070-a868-49c6-b935-87eeeac4a826 could not be found. Oct 04 20:55:40.224195 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:55:40.224195 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:55:40.224195 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:55:40.224195 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:55:40.224195 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:55:40.224195 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:55:40.224195 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:55:40.224195 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:55:40.224195 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:55:40.224195 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:55:40.224195 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:55:40.224195 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:55:40.224195 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:55:40.224195 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:55:40.224195 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:55:40.224195 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:55:40.224195 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 601e4070-a868-49c6-b935-87eeeac4a826 could not be found. Oct 04 20:55:40.224195 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:55:40.224195 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:55:40.224195 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:55:40.228649 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:55:40.228649 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:55:40.228649 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:55:40.228649 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:55:40.228649 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:55:40.228649 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 601e4070-a868-49c6-b935-87eeeac4a826 could not be found. Oct 04 20:55:40.228649 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:55:40.228649 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-0325e291-2413-460e-a8b9-28953c80ef10 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Returning 404 to user: Instance 601e4070-a868-49c6-b935-87eeeac4a826 could not be found. {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:55:40.228649 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-0325e291-2413-460e-a8b9-28953c80ef10 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] 10.222.0.33 "GET /compute/v2.1/servers/601e4070-a868-49c6-b935-87eeeac4a826" status: 404 len: 111 microversion: 2.47 time: 0.096183 Oct 04 20:55:40.237403 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2222/4403] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:55:40 2022] GET /compute/v2.1/servers/601e4070-a868-49c6-b935-87eeeac4a826 => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 20:55:40.245995 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-e8e8d139-5842-491c-9233-df38721befc9 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:55:40.246761 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-e8e8d139-5842-491c-9233-df38721befc9 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] [instance: 67656ca4-09a7-4e6b-bf3a-cfcd254e99e4] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:55:40.254020 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e8e8d139-5842-491c-9233-df38721befc9 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:40.254629 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e8e8d139-5842-491c-9233-df38721befc9 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:40.255215 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e8e8d139-5842-491c-9233-df38721befc9 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:40.255933 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e8e8d139-5842-491c-9233-df38721befc9 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:40.256394 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e8e8d139-5842-491c-9233-df38721befc9 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:40.256818 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e8e8d139-5842-491c-9233-df38721befc9 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:40.295678 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-e8e8d139-5842-491c-9233-df38721befc9 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] [instance: 67656ca4-09a7-4e6b-bf3a-cfcd254e99e4] Going to try to terminate instance {{(pid=128802) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:55:40.486550 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-e8e8d139-5842-491c-9233-df38721befc9 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] 10.222.0.33 "DELETE /compute/v2.1/servers/67656ca4-09a7-4e6b-bf3a-cfcd254e99e4" status: 204 len: 0 microversion: 2.1 time: 0.247370 Oct 04 20:55:40.487225 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2223/4404] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 20:55:40 2022] DELETE /compute/v2.1/servers/67656ca4-09a7-4e6b-bf3a-cfcd254e99e4 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:55:40.495825 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-80ba3716-f1e8-4e2a-8f31-b3efa99730ff tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:55:40.497721 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-80ba3716-f1e8-4e2a-8f31-b3efa99730ff tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] [instance: 91fdf7b5-677e-443b-b237-6160276f83c3] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:55:40.511988 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-80ba3716-f1e8-4e2a-8f31-b3efa99730ff tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:40.513756 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-80ba3716-f1e8-4e2a-8f31-b3efa99730ff tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:40.515506 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-80ba3716-f1e8-4e2a-8f31-b3efa99730ff tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:40.516538 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-80ba3716-f1e8-4e2a-8f31-b3efa99730ff tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:40.517366 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-80ba3716-f1e8-4e2a-8f31-b3efa99730ff tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:40.520953 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-80ba3716-f1e8-4e2a-8f31-b3efa99730ff tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:40.577337 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-80ba3716-f1e8-4e2a-8f31-b3efa99730ff tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] [instance: 91fdf7b5-677e-443b-b237-6160276f83c3] Going to try to terminate instance {{(pid=128802) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:55:40.738294 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-80ba3716-f1e8-4e2a-8f31-b3efa99730ff tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] 10.222.0.33 "DELETE /compute/v2.1/servers/91fdf7b5-677e-443b-b237-6160276f83c3" status: 204 len: 0 microversion: 2.47 time: 0.249239 Oct 04 20:55:40.743389 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2224/4405] 10.222.0.33 () {60 vars in 1280 bytes} [Tue Oct 4 20:55:40 2022] DELETE /compute/v2.1/servers/91fdf7b5-677e-443b-b237-6160276f83c3 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 20:55:40.750043 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-7c1e286d-40e3-445b-99c1-2267e9618cfe tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-444631544", "imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63", "flavorRef": "452", "networks": [{"uuid": "a8ab3947-7502-47aa-82ee-003685ca9719"}]}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:55:40.789625 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-ade9c933-8d10-41d6-a67a-22c93d5b0e89 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9061ddee3d48528f5849b2cc6a1d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7df9bc3521c479d9c16d3516b014cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:40.798831 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ade9c933-8d10-41d6-a67a-22c93d5b0e89 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] 10.222.0.33 "GET /compute/v2.1/servers/0d82589c-f627-44b7-95cd-30e07a27a1a8" status: 200 len: 1319 microversion: 2.1 time: 0.672563 Oct 04 20:55:40.819617 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2182/4406] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:55:40 2022] GET /compute/v2.1/servers/0d82589c-f627-44b7-95cd-30e07a27a1a8 => generated 1319 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:55:40.831860 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-70123b17-3f0f-4e66-8fb4-e55698f80c09 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:55:40.832698 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-70123b17-3f0f-4e66-8fb4-e55698f80c09 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] [instance: 91fdf7b5-677e-443b-b237-6160276f83c3] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:55:40.833733 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.network.neutron [None req-7c1e286d-40e3-445b-99c1-2267e9618cfe tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] validate_networks() for [('a8ab3947-7502-47aa-82ee-003685ca9719', None, None, None, None, None)] {{(pid=128802) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:55:40.849891 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-70123b17-3f0f-4e66-8fb4-e55698f80c09 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:40.850425 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-70123b17-3f0f-4e66-8fb4-e55698f80c09 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:40.850877 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-70123b17-3f0f-4e66-8fb4-e55698f80c09 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:40.852155 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-70123b17-3f0f-4e66-8fb4-e55698f80c09 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:40.852723 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-70123b17-3f0f-4e66-8fb4-e55698f80c09 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:40.853162 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-70123b17-3f0f-4e66-8fb4-e55698f80c09 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:41.033529 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-70123b17-3f0f-4e66-8fb4-e55698f80c09 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4adee36830c640919981ae58bd326157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '589fcee1949d4820a8958ec55ce4b43a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:41.052845 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-70123b17-3f0f-4e66-8fb4-e55698f80c09 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4adee36830c640919981ae58bd326157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '589fcee1949d4820a8958ec55ce4b43a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:41.054880 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-70123b17-3f0f-4e66-8fb4-e55698f80c09 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4adee36830c640919981ae58bd326157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '589fcee1949d4820a8958ec55ce4b43a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:41.056099 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-70123b17-3f0f-4e66-8fb4-e55698f80c09 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] 10.222.0.33 "GET /compute/v2.1/servers/91fdf7b5-677e-443b-b237-6160276f83c3" status: 200 len: 1362 microversion: 2.47 time: 0.233802 Oct 04 20:55:41.069380 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2183/4407] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:55:40 2022] GET /compute/v2.1/servers/91fdf7b5-677e-443b-b237-6160276f83c3 => generated 1362 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:55:41.069380 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ff53170d-f235-405c-998d-b54a6e4b6df2 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:55:41.069380 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ff53170d-f235-405c-998d-b54a6e4b6df2 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] [instance: f8ba4e66-2997-4822-9c01-c570f5ae6e87] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:55:41.079666 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ff53170d-f235-405c-998d-b54a6e4b6df2 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:41.080364 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ff53170d-f235-405c-998d-b54a6e4b6df2 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:41.080952 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ff53170d-f235-405c-998d-b54a6e4b6df2 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:41.091478 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ff53170d-f235-405c-998d-b54a6e4b6df2 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:41.092236 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ff53170d-f235-405c-998d-b54a6e4b6df2 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:41.092848 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ff53170d-f235-405c-998d-b54a6e4b6df2 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:41.787209 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-ff53170d-f235-405c-998d-b54a6e4b6df2 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b78af5c0485b4343900269160ef3e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659f3d4023b347d58bc0361db9ceead9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:41.801135 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-ff53170d-f235-405c-998d-b54a6e4b6df2 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b78af5c0485b4343900269160ef3e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659f3d4023b347d58bc0361db9ceead9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:41.803025 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-ff53170d-f235-405c-998d-b54a6e4b6df2 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b78af5c0485b4343900269160ef3e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659f3d4023b347d58bc0361db9ceead9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:41.806598 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ff53170d-f235-405c-998d-b54a6e4b6df2 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] 10.222.0.33 "GET /compute/v2.1/servers/f8ba4e66-2997-4822-9c01-c570f5ae6e87" status: 200 len: 2936 microversion: 2.42 time: 0.748220 Oct 04 20:55:41.807886 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2184/4408] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:55:41 2022] GET /compute/v2.1/servers/f8ba4e66-2997-4822-9c01-c570f5ae6e87 => generated 2936 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:55:41.831872 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-118dfbee-44cd-4bf7-8c01-33d042fd73c2 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:55:41.834660 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-118dfbee-44cd-4bf7-8c01-33d042fd73c2 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] [instance: 0d82589c-f627-44b7-95cd-30e07a27a1a8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:55:41.847030 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-118dfbee-44cd-4bf7-8c01-33d042fd73c2 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:41.850332 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-118dfbee-44cd-4bf7-8c01-33d042fd73c2 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:41.851272 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-118dfbee-44cd-4bf7-8c01-33d042fd73c2 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:41.856864 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-118dfbee-44cd-4bf7-8c01-33d042fd73c2 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:41.858523 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-118dfbee-44cd-4bf7-8c01-33d042fd73c2 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:41.859186 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-118dfbee-44cd-4bf7-8c01-33d042fd73c2 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:43.174940 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-118dfbee-44cd-4bf7-8c01-33d042fd73c2 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9061ddee3d48528f5849b2cc6a1d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7df9bc3521c479d9c16d3516b014cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:43.185289 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-118dfbee-44cd-4bf7-8c01-33d042fd73c2 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] 10.222.0.33 "GET /compute/v2.1/servers/0d82589c-f627-44b7-95cd-30e07a27a1a8" status: 200 len: 1319 microversion: 2.1 time: 1.361190 Oct 04 20:55:43.191124 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2185/4409] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:55:41 2022] GET /compute/v2.1/servers/0d82589c-f627-44b7-95cd-30e07a27a1a8 => generated 1319 bytes in 1368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:55:43.206167 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-513d34db-28ac-4f6b-89d1-af17fbbeb6e2 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:55:43.207052 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-513d34db-28ac-4f6b-89d1-af17fbbeb6e2 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] [instance: 91fdf7b5-677e-443b-b237-6160276f83c3] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:55:43.219632 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-513d34db-28ac-4f6b-89d1-af17fbbeb6e2 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:43.221049 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-513d34db-28ac-4f6b-89d1-af17fbbeb6e2 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:43.227432 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-513d34db-28ac-4f6b-89d1-af17fbbeb6e2 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:43.247509 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-513d34db-28ac-4f6b-89d1-af17fbbeb6e2 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:43.248279 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-513d34db-28ac-4f6b-89d1-af17fbbeb6e2 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:43.250334 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-513d34db-28ac-4f6b-89d1-af17fbbeb6e2 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:43.519481 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-7c1e286d-40e3-445b-99c1-2267e9618cfe tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Flavor limits 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:55:43.520050 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-7c1e286d-40e3-445b-99c1-2267e9618cfe tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Image limits 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:55:43.520517 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-7c1e286d-40e3-445b-99c1-2267e9618cfe tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Flavor pref 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:55:43.521388 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-7c1e286d-40e3-445b-99c1-2267e9618cfe tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Image pref 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:55:43.521388 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-7c1e286d-40e3-445b-99c1-2267e9618cfe tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:55:43.534909 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7c1e286d-40e3-445b-99c1-2267e9618cfe tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:43.535748 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7c1e286d-40e3-445b-99c1-2267e9618cfe tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:43.536291 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7c1e286d-40e3-445b-99c1-2267e9618cfe tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:43.537135 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7c1e286d-40e3-445b-99c1-2267e9618cfe tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:43.537843 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7c1e286d-40e3-445b-99c1-2267e9618cfe tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:43.538612 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7c1e286d-40e3-445b-99c1-2267e9618cfe tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:43.547037 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-513d34db-28ac-4f6b-89d1-af17fbbeb6e2 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4adee36830c640919981ae58bd326157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '589fcee1949d4820a8958ec55ce4b43a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:43.564970 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-513d34db-28ac-4f6b-89d1-af17fbbeb6e2 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4adee36830c640919981ae58bd326157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '589fcee1949d4820a8958ec55ce4b43a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:43.566473 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-513d34db-28ac-4f6b-89d1-af17fbbeb6e2 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4adee36830c640919981ae58bd326157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '589fcee1949d4820a8958ec55ce4b43a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:43.566832 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-7c1e286d-40e3-445b-99c1-2267e9618cfe tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Getting quotas for project 22ed328a1e964d46902dee5e1c7c7b74. Resources: {'ram', 'instances', 'cores'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:55:43.567686 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-513d34db-28ac-4f6b-89d1-af17fbbeb6e2 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] 10.222.0.33 "GET /compute/v2.1/servers/91fdf7b5-677e-443b-b237-6160276f83c3" status: 200 len: 1362 microversion: 2.47 time: 0.375536 Oct 04 20:55:43.568442 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2186/4410] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:55:43 2022] GET /compute/v2.1/servers/91fdf7b5-677e-443b-b237-6160276f83c3 => generated 1362 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:55:43.575769 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-e3a02be9-1f75-4692-ac45-82d7379a5da7 req-c4ce4fd7-3142-4217-bdef-ee92692379d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8ba4e66-2997-4822-9c01-c570f5ae6e87", "name": "network-vif-unplugged", "status": "completed", "tag": "23c11bbd-118e-4951-9bf5-0c64ad430751"}, {"server_uuid": "0d82589c-f627-44b7-95cd-30e07a27a1a8", "name": "network-vif-plugged", "status": "completed", "tag": "7a30a586-1cc3-4182-97fb-c25126c9d342"}, {"server_uuid": "f8ba4e66-2997-4822-9c01-c570f5ae6e87", "name": "network-vif-unplugged", "status": "completed", "tag": "4f9a97a3-f3e7-439e-b71b-172b65963073"}, {"server_uuid": "f8ba4e66-2997-4822-9c01-c570f5ae6e87", "name": "network-vif-unplugged", "status": "completed", "tag": "6e6d2a48-9844-45c7-a3ac-b235535858ac"}, {"server_uuid": "f8ba4e66-2997-4822-9c01-c570f5ae6e87", "name": "network-vif-unplugged", "status": "completed", "tag": "89bbad56-acc7-4db0-9c4c-a9fd89521acf"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:55:43.584145 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-7c1e286d-40e3-445b-99c1-2267e9618cfe tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Getting quotas for user e93855201ca64c779f92a2a33979b81f and project 22ed328a1e964d46902dee5e1c7c7b74. Resources: {'ram', 'instances', 'cores'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:55:43.597466 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-e3a02be9-1f75-4692-ac45-82d7379a5da7 req-c4ce4fd7-3142-4217-bdef-ee92692379d4 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:43.598489 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-e3a02be9-1f75-4692-ac45-82d7379a5da7 req-c4ce4fd7-3142-4217-bdef-ee92692379d4 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:43.599650 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-e3a02be9-1f75-4692-ac45-82d7379a5da7 req-c4ce4fd7-3142-4217-bdef-ee92692379d4 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:43.603663 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-7c1e286d-40e3-445b-99c1-2267e9618cfe tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Going to run 1 instances... {{(pid=128802) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:55:43.606240 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-7c1e286d-40e3-445b-99c1-2267e9618cfe tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] [instance: 3b4b8ffa-a834-442c-bdbe-a782eb376d28] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='15b24725-0c99-4bcf-b1fb-907cdf8e2d63',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128802) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:55:43.618106 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-e3a02be9-1f75-4692-ac45-82d7379a5da7 req-c4ce4fd7-3142-4217-bdef-ee92692379d4 service nova] Creating event network-vif-unplugged:23c11bbd-118e-4951-9bf5-0c64ad430751 for instance f8ba4e66-2997-4822-9c01-c570f5ae6e87 on n-h1-854823-8 Oct 04 20:55:43.618641 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-e3a02be9-1f75-4692-ac45-82d7379a5da7 req-c4ce4fd7-3142-4217-bdef-ee92692379d4 service nova] Creating event network-vif-plugged:7a30a586-1cc3-4182-97fb-c25126c9d342 for instance 0d82589c-f627-44b7-95cd-30e07a27a1a8 on n-h2-854823-8 Oct 04 20:55:43.619135 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-e3a02be9-1f75-4692-ac45-82d7379a5da7 req-c4ce4fd7-3142-4217-bdef-ee92692379d4 service nova] Creating event network-vif-unplugged:4f9a97a3-f3e7-439e-b71b-172b65963073 for instance f8ba4e66-2997-4822-9c01-c570f5ae6e87 on n-h1-854823-8 Oct 04 20:55:43.619941 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-e3a02be9-1f75-4692-ac45-82d7379a5da7 req-c4ce4fd7-3142-4217-bdef-ee92692379d4 service nova] Creating event network-vif-unplugged:6e6d2a48-9844-45c7-a3ac-b235535858ac for instance f8ba4e66-2997-4822-9c01-c570f5ae6e87 on n-h1-854823-8 Oct 04 20:55:43.620586 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-e3a02be9-1f75-4692-ac45-82d7379a5da7 req-c4ce4fd7-3142-4217-bdef-ee92692379d4 service nova] Creating event network-vif-unplugged:89bbad56-acc7-4db0-9c4c-a9fd89521acf for instance f8ba4e66-2997-4822-9c01-c570f5ae6e87 on n-h1-854823-8 Oct 04 20:55:43.639106 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-e3a02be9-1f75-4692-ac45-82d7379a5da7 req-c4ce4fd7-3142-4217-bdef-ee92692379d4 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 875 microversion: 2.1 time: 0.066203 Oct 04 20:55:43.646592 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2187/4411] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:55:43 2022] POST /compute/v2.1/os-server-external-events => generated 875 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:55:43.654040 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-66de0fc7-5e42-478b-9656-75cf66568833 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:55:43.655026 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-66de0fc7-5e42-478b-9656-75cf66568833 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] [instance: f8ba4e66-2997-4822-9c01-c570f5ae6e87] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:55:43.662050 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-66de0fc7-5e42-478b-9656-75cf66568833 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:43.662785 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-66de0fc7-5e42-478b-9656-75cf66568833 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:43.663382 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-66de0fc7-5e42-478b-9656-75cf66568833 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:43.664384 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-66de0fc7-5e42-478b-9656-75cf66568833 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:43.665006 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-66de0fc7-5e42-478b-9656-75cf66568833 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:43.665594 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-66de0fc7-5e42-478b-9656-75cf66568833 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:43.673283 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-7c1e286d-40e3-445b-99c1-2267e9618cfe tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.927902 Oct 04 20:55:43.674374 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2225/4412] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 20:55:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 2930 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 20:55:43.679793 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-909d91b7-cf78-4576-8f7c-04e51f3d6186 req-0b98362c-7fdb-4abf-a560-a11ef5958513 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8ba4e66-2997-4822-9c01-c570f5ae6e87", "name": "network-vif-deleted", "tag": "89bbad56-acc7-4db0-9c4c-a9fd89521acf"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:55:43.693295 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-909d91b7-cf78-4576-8f7c-04e51f3d6186 req-0b98362c-7fdb-4abf-a560-a11ef5958513 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:43.696458 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-909d91b7-cf78-4576-8f7c-04e51f3d6186 req-0b98362c-7fdb-4abf-a560-a11ef5958513 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:43.697529 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-909d91b7-cf78-4576-8f7c-04e51f3d6186 req-0b98362c-7fdb-4abf-a560-a11ef5958513 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:43.717741 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-909d91b7-cf78-4576-8f7c-04e51f3d6186 req-0b98362c-7fdb-4abf-a560-a11ef5958513 service nova] Creating event network-vif-deleted:89bbad56-acc7-4db0-9c4c-a9fd89521acf for instance f8ba4e66-2997-4822-9c01-c570f5ae6e87 on n-h1-854823-8 Oct 04 20:55:43.724049 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-909d91b7-cf78-4576-8f7c-04e51f3d6186 req-0b98362c-7fdb-4abf-a560-a11ef5958513 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048124 Oct 04 20:55:43.724957 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2226/4413] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:55:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:55:43.731657 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-63978d64-566c-41ab-b3fa-e3ca0d8c9275 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:55:43.732764 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-63978d64-566c-41ab-b3fa-e3ca0d8c9275 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] [instance: 3b4b8ffa-a834-442c-bdbe-a782eb376d28] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:55:43.870685 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-63978d64-566c-41ab-b3fa-e3ca0d8c9275 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e93855201ca64c779f92a2a33979b81f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed328a1e964d46902dee5e1c7c7b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:43.878059 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-63978d64-566c-41ab-b3fa-e3ca0d8c9275 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] 10.222.0.33 "GET /compute/v2.1/servers/3b4b8ffa-a834-442c-bdbe-a782eb376d28" status: 200 len: 1217 microversion: 2.1 time: 0.152065 Oct 04 20:55:43.878727 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2227/4414] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:55:43 2022] GET /compute/v2.1/servers/3b4b8ffa-a834-442c-bdbe-a782eb376d28 => generated 1217 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:55:44.215102 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-6601b045-20c7-46a3-96a7-4209a2532916 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:55:44.216096 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-6601b045-20c7-46a3-96a7-4209a2532916 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] [instance: 0d82589c-f627-44b7-95cd-30e07a27a1a8] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:55:44.239912 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6601b045-20c7-46a3-96a7-4209a2532916 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:44.243943 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6601b045-20c7-46a3-96a7-4209a2532916 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:44.244843 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6601b045-20c7-46a3-96a7-4209a2532916 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:44.245956 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6601b045-20c7-46a3-96a7-4209a2532916 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:44.246780 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6601b045-20c7-46a3-96a7-4209a2532916 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:44.247440 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6601b045-20c7-46a3-96a7-4209a2532916 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:44.511176 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-66de0fc7-5e42-478b-9656-75cf66568833 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b78af5c0485b4343900269160ef3e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659f3d4023b347d58bc0361db9ceead9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:44.536225 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-66de0fc7-5e42-478b-9656-75cf66568833 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b78af5c0485b4343900269160ef3e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659f3d4023b347d58bc0361db9ceead9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:44.543804 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-66de0fc7-5e42-478b-9656-75cf66568833 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b78af5c0485b4343900269160ef3e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659f3d4023b347d58bc0361db9ceead9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:44.546324 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-66de0fc7-5e42-478b-9656-75cf66568833 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] 10.222.0.33 "GET /compute/v2.1/servers/f8ba4e66-2997-4822-9c01-c570f5ae6e87" status: 200 len: 2869 microversion: 2.42 time: 0.898067 Oct 04 20:55:44.548290 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2188/4415] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:55:43 2022] GET /compute/v2.1/servers/f8ba4e66-2997-4822-9c01-c570f5ae6e87 => generated 2869 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:55:44.599587 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-3c79822a-bea6-4db5-a61c-8347667d5c54 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:55:44.600606 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-3c79822a-bea6-4db5-a61c-8347667d5c54 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] [instance: 91fdf7b5-677e-443b-b237-6160276f83c3] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:55:44.616374 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3c79822a-bea6-4db5-a61c-8347667d5c54 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:44.618361 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3c79822a-bea6-4db5-a61c-8347667d5c54 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:44.618942 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3c79822a-bea6-4db5-a61c-8347667d5c54 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:44.619725 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3c79822a-bea6-4db5-a61c-8347667d5c54 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:44.620195 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3c79822a-bea6-4db5-a61c-8347667d5c54 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:44.620734 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3c79822a-bea6-4db5-a61c-8347667d5c54 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:44.893672 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-3c79822a-bea6-4db5-a61c-8347667d5c54 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4adee36830c640919981ae58bd326157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '589fcee1949d4820a8958ec55ce4b43a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:44.934245 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-3c79822a-bea6-4db5-a61c-8347667d5c54 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4adee36830c640919981ae58bd326157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '589fcee1949d4820a8958ec55ce4b43a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:44.936182 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-3c79822a-bea6-4db5-a61c-8347667d5c54 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4adee36830c640919981ae58bd326157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '589fcee1949d4820a8958ec55ce4b43a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:44.945701 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-3c79822a-bea6-4db5-a61c-8347667d5c54 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] 10.222.0.33 "GET /compute/v2.1/servers/91fdf7b5-677e-443b-b237-6160276f83c3" status: 200 len: 1362 microversion: 2.47 time: 0.349240 Oct 04 20:55:44.947806 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2189/4416] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:55:44 2022] GET /compute/v2.1/servers/91fdf7b5-677e-443b-b237-6160276f83c3 => generated 1362 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:55:44.965161 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-52af9299-5dca-4231-947b-b87e22257cf2 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:55:44.969783 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-52af9299-5dca-4231-947b-b87e22257cf2 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] [instance: 3b4b8ffa-a834-442c-bdbe-a782eb376d28] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:55:44.995143 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-52af9299-5dca-4231-947b-b87e22257cf2 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:44.996935 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-52af9299-5dca-4231-947b-b87e22257cf2 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:44.998004 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-52af9299-5dca-4231-947b-b87e22257cf2 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:45.002001 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-52af9299-5dca-4231-947b-b87e22257cf2 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:45.003430 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-52af9299-5dca-4231-947b-b87e22257cf2 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:45.004752 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-52af9299-5dca-4231-947b-b87e22257cf2 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:45.014795 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-6601b045-20c7-46a3-96a7-4209a2532916 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9061ddee3d48528f5849b2cc6a1d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7df9bc3521c479d9c16d3516b014cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:45.044762 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-6601b045-20c7-46a3-96a7-4209a2532916 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] 10.222.0.33 "GET /compute/v2.1/servers/0d82589c-f627-44b7-95cd-30e07a27a1a8" status: 200 len: 1319 microversion: 2.1 time: 0.824948 Oct 04 20:55:45.049452 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2228/4417] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:55:44 2022] GET /compute/v2.1/servers/0d82589c-f627-44b7-95cd-30e07a27a1a8 => generated 1319 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:55:45.354764 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-52af9299-5dca-4231-947b-b87e22257cf2 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e93855201ca64c779f92a2a33979b81f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed328a1e964d46902dee5e1c7c7b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:45.367589 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-52af9299-5dca-4231-947b-b87e22257cf2 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] 10.222.0.33 "GET /compute/v2.1/servers/3b4b8ffa-a834-442c-bdbe-a782eb376d28" status: 200 len: 1269 microversion: 2.1 time: 0.413540 Oct 04 20:55:45.378630 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2190/4418] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:55:44 2022] GET /compute/v2.1/servers/3b4b8ffa-a834-442c-bdbe-a782eb376d28 => generated 1269 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:55:45.379319 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-ca2b3c58-2bac-4f05-96bd-6646292ff384 req-e09fdb4e-ed9d-4ff9-88a5-0b803a1576ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67656ca4-09a7-4e6b-bf3a-cfcd254e99e4", "name": "network-vif-deleted", "tag": "520b47f9-ca55-4bc2-99bd-5d338296bb06"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:55:45.385677 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-ca2b3c58-2bac-4f05-96bd-6646292ff384 req-e09fdb4e-ed9d-4ff9-88a5-0b803a1576ae service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:45.386887 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-ca2b3c58-2bac-4f05-96bd-6646292ff384 req-e09fdb4e-ed9d-4ff9-88a5-0b803a1576ae service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:45.395155 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-ca2b3c58-2bac-4f05-96bd-6646292ff384 req-e09fdb4e-ed9d-4ff9-88a5-0b803a1576ae service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:45.407957 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-ca2b3c58-2bac-4f05-96bd-6646292ff384 req-e09fdb4e-ed9d-4ff9-88a5-0b803a1576ae service nova] Creating event network-vif-deleted:520b47f9-ca55-4bc2-99bd-5d338296bb06 for instance 67656ca4-09a7-4e6b-bf3a-cfcd254e99e4 on n-h2-854823-8 Oct 04 20:55:45.425834 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-ca2b3c58-2bac-4f05-96bd-6646292ff384 req-e09fdb4e-ed9d-4ff9-88a5-0b803a1576ae service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060903 Oct 04 20:55:45.426920 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2229/4419] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:55:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 20:55:45.581478 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c3f1df04-fd39-49da-83ce-43150d9e5670 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:55:45.582109 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c3f1df04-fd39-49da-83ce-43150d9e5670 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] [instance: f8ba4e66-2997-4822-9c01-c570f5ae6e87] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:55:45.589481 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c3f1df04-fd39-49da-83ce-43150d9e5670 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:45.590574 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c3f1df04-fd39-49da-83ce-43150d9e5670 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:45.591250 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c3f1df04-fd39-49da-83ce-43150d9e5670 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:45.592175 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c3f1df04-fd39-49da-83ce-43150d9e5670 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:45.592842 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c3f1df04-fd39-49da-83ce-43150d9e5670 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:45.593481 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c3f1df04-fd39-49da-83ce-43150d9e5670 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:45.680020 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-ae0802cc-4602-4395-8db3-c75c8ab1ae54 req-3af2a1f6-0a3b-4290-9ce3-a384d29ec16b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23613d5c-93a4-4da9-be4e-deac3d259cb5", "name": "network-vif-plugged", "status": "completed", "tag": "88538d39-4580-482d-b0db-d076f79f963b"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:55:45.708724 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-ae0802cc-4602-4395-8db3-c75c8ab1ae54 req-3af2a1f6-0a3b-4290-9ce3-a384d29ec16b service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:45.711668 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-ae0802cc-4602-4395-8db3-c75c8ab1ae54 req-3af2a1f6-0a3b-4290-9ce3-a384d29ec16b service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:45.712370 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-ae0802cc-4602-4395-8db3-c75c8ab1ae54 req-3af2a1f6-0a3b-4290-9ce3-a384d29ec16b service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:45.736509 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-ae0802cc-4602-4395-8db3-c75c8ab1ae54 req-3af2a1f6-0a3b-4290-9ce3-a384d29ec16b service nova] Creating event network-vif-plugged:88538d39-4580-482d-b0db-d076f79f963b for instance 23613d5c-93a4-4da9-be4e-deac3d259cb5 on n-h1-854823-8 Oct 04 20:55:45.751794 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-ae0802cc-4602-4395-8db3-c75c8ab1ae54 req-3af2a1f6-0a3b-4290-9ce3-a384d29ec16b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077830 Oct 04 20:55:45.758872 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2230/4420] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:55:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:55:45.933616 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c3f1df04-fd39-49da-83ce-43150d9e5670 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b78af5c0485b4343900269160ef3e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659f3d4023b347d58bc0361db9ceead9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:45.944446 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c3f1df04-fd39-49da-83ce-43150d9e5670 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b78af5c0485b4343900269160ef3e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659f3d4023b347d58bc0361db9ceead9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:45.947609 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c3f1df04-fd39-49da-83ce-43150d9e5670 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b78af5c0485b4343900269160ef3e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659f3d4023b347d58bc0361db9ceead9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:45.949332 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c3f1df04-fd39-49da-83ce-43150d9e5670 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] 10.222.0.33 "GET /compute/v2.1/servers/f8ba4e66-2997-4822-9c01-c570f5ae6e87" status: 200 len: 2709 microversion: 2.42 time: 0.371742 Oct 04 20:55:45.968023 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2191/4421] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:55:45 2022] GET /compute/v2.1/servers/f8ba4e66-2997-4822-9c01-c570f5ae6e87 => generated 2709 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:55:45.981510 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-e24cd992-524a-41c6-b996-ef6de8c3e98c tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:55:45.982285 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-e24cd992-524a-41c6-b996-ef6de8c3e98c tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] [instance: 91fdf7b5-677e-443b-b237-6160276f83c3] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:55:45.996916 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e24cd992-524a-41c6-b996-ef6de8c3e98c tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:45.999566 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e24cd992-524a-41c6-b996-ef6de8c3e98c tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:46.000031 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e24cd992-524a-41c6-b996-ef6de8c3e98c tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:46.000781 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e24cd992-524a-41c6-b996-ef6de8c3e98c tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:46.004481 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e24cd992-524a-41c6-b996-ef6de8c3e98c tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:46.004939 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e24cd992-524a-41c6-b996-ef6de8c3e98c tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:46.010764 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-da5d3b21-1ae1-466a-9df9-267d2019c011 req-09423a50-63df-4e55-9923-6c082f317fef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8ba4e66-2997-4822-9c01-c570f5ae6e87", "name": "network-vif-deleted", "tag": "4f9a97a3-f3e7-439e-b71b-172b65963073"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:55:46.044375 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-da5d3b21-1ae1-466a-9df9-267d2019c011 req-09423a50-63df-4e55-9923-6c082f317fef service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:46.048056 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-da5d3b21-1ae1-466a-9df9-267d2019c011 req-09423a50-63df-4e55-9923-6c082f317fef service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:46.050080 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-da5d3b21-1ae1-466a-9df9-267d2019c011 req-09423a50-63df-4e55-9923-6c082f317fef service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:46.103749 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e24cd992-524a-41c6-b996-ef6de8c3e98c tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:46.104278 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e24cd992-524a-41c6-b996-ef6de8c3e98c tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:46.104668 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e24cd992-524a-41c6-b996-ef6de8c3e98c tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:46.105122 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.objects.instance [None req-e24cd992-524a-41c6-b996-ef6de8c3e98c tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Lazy-loading 'fault' on Instance uuid 91fdf7b5-677e-443b-b237-6160276f83c3 {{(pid=128802) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:55:46.118687 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-da5d3b21-1ae1-466a-9df9-267d2019c011 req-09423a50-63df-4e55-9923-6c082f317fef service nova] Creating event network-vif-deleted:4f9a97a3-f3e7-439e-b71b-172b65963073 for instance f8ba4e66-2997-4822-9c01-c570f5ae6e87 on n-h1-854823-8 Oct 04 20:55:46.131253 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-da5d3b21-1ae1-466a-9df9-267d2019c011 req-09423a50-63df-4e55-9923-6c082f317fef service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.134531 Oct 04 20:55:46.134608 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2192/4422] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:55:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:55:46.141066 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-4f3212ed-2670-40df-935b-051706d54fed tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:55:46.143644 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-4f3212ed-2670-40df-935b-051706d54fed tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] [instance: 0d82589c-f627-44b7-95cd-30e07a27a1a8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:55:46.152857 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4f3212ed-2670-40df-935b-051706d54fed tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:46.153842 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4f3212ed-2670-40df-935b-051706d54fed tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:46.154701 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4f3212ed-2670-40df-935b-051706d54fed tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:46.155812 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4f3212ed-2670-40df-935b-051706d54fed tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:46.156486 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4f3212ed-2670-40df-935b-051706d54fed tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:46.157148 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4f3212ed-2670-40df-935b-051706d54fed tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:46.248555 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-e24cd992-524a-41c6-b996-ef6de8c3e98c tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4adee36830c640919981ae58bd326157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '589fcee1949d4820a8958ec55ce4b43a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:46.263763 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-e24cd992-524a-41c6-b996-ef6de8c3e98c tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4adee36830c640919981ae58bd326157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '589fcee1949d4820a8958ec55ce4b43a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:46.267731 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-e24cd992-524a-41c6-b996-ef6de8c3e98c tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4adee36830c640919981ae58bd326157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '589fcee1949d4820a8958ec55ce4b43a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:46.287110 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-e24cd992-524a-41c6-b996-ef6de8c3e98c tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] 10.222.0.33 "GET /compute/v2.1/servers/91fdf7b5-677e-443b-b237-6160276f83c3" status: 200 len: 1367 microversion: 2.47 time: 0.310788 Oct 04 20:55:46.288467 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2231/4423] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:55:45 2022] GET /compute/v2.1/servers/91fdf7b5-677e-443b-b237-6160276f83c3 => generated 1367 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:55:46.403142 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-c03e0c56-8b0f-4962-bc43-c16b26c78713 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:55:46.403429 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-c03e0c56-8b0f-4962-bc43-c16b26c78713 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] [instance: 3b4b8ffa-a834-442c-bdbe-a782eb376d28] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:55:46.424129 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c03e0c56-8b0f-4962-bc43-c16b26c78713 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:46.424439 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c03e0c56-8b0f-4962-bc43-c16b26c78713 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:46.431595 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c03e0c56-8b0f-4962-bc43-c16b26c78713 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:46.436037 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c03e0c56-8b0f-4962-bc43-c16b26c78713 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:46.439855 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c03e0c56-8b0f-4962-bc43-c16b26c78713 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:46.443706 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c03e0c56-8b0f-4962-bc43-c16b26c78713 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:46.826080 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-c03e0c56-8b0f-4962-bc43-c16b26c78713 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e93855201ca64c779f92a2a33979b81f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed328a1e964d46902dee5e1c7c7b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:46.841101 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-c03e0c56-8b0f-4962-bc43-c16b26c78713 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] 10.222.0.33 "GET /compute/v2.1/servers/3b4b8ffa-a834-442c-bdbe-a782eb376d28" status: 200 len: 1275 microversion: 2.1 time: 0.451690 Oct 04 20:55:46.857345 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2232/4424] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:55:46 2022] GET /compute/v2.1/servers/3b4b8ffa-a834-442c-bdbe-a782eb376d28 => generated 1275 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:55:46.982937 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-939f8051-e3a2-4e50-8fdf-9f3e0577741c tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:55:46.983525 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-939f8051-e3a2-4e50-8fdf-9f3e0577741c tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] [instance: f8ba4e66-2997-4822-9c01-c570f5ae6e87] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:55:46.994170 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-939f8051-e3a2-4e50-8fdf-9f3e0577741c tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:46.994766 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-939f8051-e3a2-4e50-8fdf-9f3e0577741c tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:46.995630 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-939f8051-e3a2-4e50-8fdf-9f3e0577741c tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:46.996847 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-939f8051-e3a2-4e50-8fdf-9f3e0577741c tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:46.997412 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-939f8051-e3a2-4e50-8fdf-9f3e0577741c tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:46.997998 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-939f8051-e3a2-4e50-8fdf-9f3e0577741c tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:47.167942 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-4f3212ed-2670-40df-935b-051706d54fed tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9061ddee3d48528f5849b2cc6a1d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7df9bc3521c479d9c16d3516b014cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:47.178955 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-4f3212ed-2670-40df-935b-051706d54fed tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] 10.222.0.33 "GET /compute/v2.1/servers/0d82589c-f627-44b7-95cd-30e07a27a1a8" status: 200 len: 1319 microversion: 2.1 time: 1.042810 Oct 04 20:55:47.198685 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2193/4425] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:55:46 2022] GET /compute/v2.1/servers/0d82589c-f627-44b7-95cd-30e07a27a1a8 => generated 1319 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:55:47.315116 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6a672014-fa08-4031-be16-c0db2c80b604 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:55:47.316410 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-6a672014-fa08-4031-be16-c0db2c80b604 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] [instance: 91fdf7b5-677e-443b-b237-6160276f83c3] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:55:47.332539 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6a672014-fa08-4031-be16-c0db2c80b604 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:47.333262 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6a672014-fa08-4031-be16-c0db2c80b604 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:47.333895 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6a672014-fa08-4031-be16-c0db2c80b604 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:47.334828 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6a672014-fa08-4031-be16-c0db2c80b604 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:47.335663 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6a672014-fa08-4031-be16-c0db2c80b604 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:47.336302 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6a672014-fa08-4031-be16-c0db2c80b604 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:47.372186 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-6a672014-fa08-4031-be16-c0db2c80b604 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] HTTP exception thrown: Instance 91fdf7b5-677e-443b-b237-6160276f83c3 could not be found. Oct 04 20:55:47.374280 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6a672014-fa08-4031-be16-c0db2c80b604 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Request method failure captured: Oct 04 20:55:47.374280 n-d-854823-8 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/91fdf7b5-677e-443b-b237-6160276f83c3 HTTP/1.1 Oct 04 20:55:47.374280 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:55:47.374280 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:55:47.374280 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:55:47.374280 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 0 Oct 04 20:55:47.374280 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:55:47.374280 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:55:47.374280 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:55:47.374280 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:55:47.374280 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJ2PQthzDRVNHfXPyQ1ukBQ1TWTR3nIwYtRiyLsRA6UDE1p_USPKybpA1YAYXqX6eqvRFjNKS_zi0vxnanjUdA24107dXM6bRzSN7Lkapbea1iZa7fpijN6pmMw5AXOm-3ruAma9zF5T8pwIPFcc4sIhOy9y0CFHT2JYi4oh-FZPg7s Oct 04 20:55:47.374280 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:55:47.374280 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:55:47.374280 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:55:47.374280 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:55:47.374280 n-d-854823-8 devstack@n-api.service[128801]: X-Openstack-Nova-Api-Version: 2.47 Oct 04 20:55:47.374280 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:55:47.374280 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:55:47.374280 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: 589fcee1949d4820a8958ec55ce4b43a Oct 04 20:55:47.374280 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-ServerShowV247Test-56655044 Oct 04 20:55:47.374280 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 20:55:47.374280 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 20:55:47.374280 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_589fcee1949d4820a8958ec55ce4b43a", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/589fcee1949d4820a8958ec55ce4b43a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/589fcee1949d4820a8958ec55ce4b43a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/589fcee1949d4820a8958ec55ce4b43a"}]}] Oct 04 20:55:47.374280 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-ServerShowV247Test-56655044 Oct 04 20:55:47.374280 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: 589fcee1949d4820a8958ec55ce4b43a Oct 04 20:55:47.374280 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ServerShowV247Test-56655044 Oct 04 20:55:47.374280 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-ServerShowV247Test-56655044-project Oct 04 20:55:47.374280 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:55:47.374280 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:55:47.374280 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: 4adee36830c640919981ae58bd326157 Oct 04 20:55:47.374280 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-ServerShowV247Test-56655044-project Oct 04 20:55:47.374280 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 20:55:47.374280 n-d-854823-8 devstack@n-api.service[128801]: exception: Instance 91fdf7b5-677e-443b-b237-6160276f83c3 could not be found. Oct 04 20:55:47.374280 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': '91fdf7b5-677e-443b-b237-6160276f83c3'} Oct 04 20:55:47.374280 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:55:47.374280 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:55:47.374280 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:55:47.374280 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:55:47.374280 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:55:47.374280 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:55:47.374280 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:55:47.374280 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:55:47.374280 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:55:47.374280 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:55:47.374280 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 91fdf7b5-677e-443b-b237-6160276f83c3 could not be found. Oct 04 20:55:47.374280 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:55:47.374280 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:55:47.374280 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:55:47.374280 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:55:47.374280 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:55:47.374280 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:55:47.374280 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:55:47.374280 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:55:47.374280 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:55:47.374280 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:55:47.374280 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:55:47.374280 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:55:47.374280 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:55:47.374280 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:55:47.374280 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:55:47.374280 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:55:47.374280 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 91fdf7b5-677e-443b-b237-6160276f83c3 could not be found. Oct 04 20:55:47.374280 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:55:47.374280 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:55:47.374280 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:55:47.379737 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:55:47.379737 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:55:47.379737 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:55:47.379737 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:55:47.379737 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:55:47.379737 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 91fdf7b5-677e-443b-b237-6160276f83c3 could not be found. Oct 04 20:55:47.379737 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:55:47.382813 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6a672014-fa08-4031-be16-c0db2c80b604 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] Returning 404 to user: Instance 91fdf7b5-677e-443b-b237-6160276f83c3 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:55:47.384580 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-6a672014-fa08-4031-be16-c0db2c80b604 tempest-ServerShowV247Test-56655044 tempest-ServerShowV247Test-56655044-project] 10.222.0.33 "GET /compute/v2.1/servers/91fdf7b5-677e-443b-b237-6160276f83c3" status: 404 len: 111 microversion: 2.47 time: 0.075125 Oct 04 20:55:47.385943 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2194/4426] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:55:47 2022] GET /compute/v2.1/servers/91fdf7b5-677e-443b-b237-6160276f83c3 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 04 20:55:47.568760 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-939f8051-e3a2-4e50-8fdf-9f3e0577741c tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b78af5c0485b4343900269160ef3e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659f3d4023b347d58bc0361db9ceead9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:47.584223 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-939f8051-e3a2-4e50-8fdf-9f3e0577741c tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b78af5c0485b4343900269160ef3e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659f3d4023b347d58bc0361db9ceead9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:47.597300 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-939f8051-e3a2-4e50-8fdf-9f3e0577741c tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b78af5c0485b4343900269160ef3e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659f3d4023b347d58bc0361db9ceead9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:47.599634 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-939f8051-e3a2-4e50-8fdf-9f3e0577741c tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] 10.222.0.33 "GET /compute/v2.1/servers/f8ba4e66-2997-4822-9c01-c570f5ae6e87" status: 200 len: 2550 microversion: 2.42 time: 0.621212 Oct 04 20:55:47.601728 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2233/4427] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:55:46 2022] GET /compute/v2.1/servers/f8ba4e66-2997-4822-9c01-c570f5ae6e87 => generated 2550 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 20:55:47.869663 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ca7dfb73-e986-45af-99ab-ecd201e746f6 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:55:47.870307 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ca7dfb73-e986-45af-99ab-ecd201e746f6 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] [instance: 3b4b8ffa-a834-442c-bdbe-a782eb376d28] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:55:47.881374 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ca7dfb73-e986-45af-99ab-ecd201e746f6 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:47.881879 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ca7dfb73-e986-45af-99ab-ecd201e746f6 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:47.882429 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ca7dfb73-e986-45af-99ab-ecd201e746f6 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:47.883400 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ca7dfb73-e986-45af-99ab-ecd201e746f6 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:47.884234 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ca7dfb73-e986-45af-99ab-ecd201e746f6 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:47.884833 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ca7dfb73-e986-45af-99ab-ecd201e746f6 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:48.042189 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-ca7dfb73-e986-45af-99ab-ecd201e746f6 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e93855201ca64c779f92a2a33979b81f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed328a1e964d46902dee5e1c7c7b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:48.061705 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ca7dfb73-e986-45af-99ab-ecd201e746f6 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] 10.222.0.33 "GET /compute/v2.1/servers/3b4b8ffa-a834-442c-bdbe-a782eb376d28" status: 200 len: 1275 microversion: 2.1 time: 0.200169 Oct 04 20:55:48.086366 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2195/4428] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:55:47 2022] GET /compute/v2.1/servers/3b4b8ffa-a834-442c-bdbe-a782eb376d28 => generated 1275 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:55:48.208316 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-184a96ea-e3a1-4321-80cd-cb3fabc1a777 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:55:48.209196 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-184a96ea-e3a1-4321-80cd-cb3fabc1a777 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] [instance: 0d82589c-f627-44b7-95cd-30e07a27a1a8] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:55:48.222644 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-184a96ea-e3a1-4321-80cd-cb3fabc1a777 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:48.228027 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-184a96ea-e3a1-4321-80cd-cb3fabc1a777 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:48.228556 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-184a96ea-e3a1-4321-80cd-cb3fabc1a777 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:48.229324 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-184a96ea-e3a1-4321-80cd-cb3fabc1a777 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:48.230079 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-184a96ea-e3a1-4321-80cd-cb3fabc1a777 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:48.230764 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-184a96ea-e3a1-4321-80cd-cb3fabc1a777 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:48.250774 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-312ef403-6909-4c52-815a-be8a4fd146b3 req-7c651e46-3d13-4392-90cb-df7e324dbf82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8ba4e66-2997-4822-9c01-c570f5ae6e87", "name": "network-vif-deleted", "tag": "ad4a640c-5df6-4e63-9966-9e83e88c558b"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:55:48.306295 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-312ef403-6909-4c52-815a-be8a4fd146b3 req-7c651e46-3d13-4392-90cb-df7e324dbf82 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:48.310513 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-312ef403-6909-4c52-815a-be8a4fd146b3 req-7c651e46-3d13-4392-90cb-df7e324dbf82 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:48.311071 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-312ef403-6909-4c52-815a-be8a4fd146b3 req-7c651e46-3d13-4392-90cb-df7e324dbf82 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:48.340592 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-312ef403-6909-4c52-815a-be8a4fd146b3 req-7c651e46-3d13-4392-90cb-df7e324dbf82 service nova] Creating event network-vif-deleted:ad4a640c-5df6-4e63-9966-9e83e88c558b for instance f8ba4e66-2997-4822-9c01-c570f5ae6e87 on n-h1-854823-8 Oct 04 20:55:48.366864 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-312ef403-6909-4c52-815a-be8a4fd146b3 req-7c651e46-3d13-4392-90cb-df7e324dbf82 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121440 Oct 04 20:55:48.372879 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2196/4429] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:55:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:55:48.638893 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-55445a31-0239-4787-ba24-4812ad66c1d5 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:55:48.639704 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-55445a31-0239-4787-ba24-4812ad66c1d5 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] [instance: f8ba4e66-2997-4822-9c01-c570f5ae6e87] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:55:48.652238 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-55445a31-0239-4787-ba24-4812ad66c1d5 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:48.653451 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-55445a31-0239-4787-ba24-4812ad66c1d5 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:48.654372 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-55445a31-0239-4787-ba24-4812ad66c1d5 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:48.656401 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-55445a31-0239-4787-ba24-4812ad66c1d5 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:48.657681 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-55445a31-0239-4787-ba24-4812ad66c1d5 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:48.658544 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-55445a31-0239-4787-ba24-4812ad66c1d5 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:48.761267 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-184a96ea-e3a1-4321-80cd-cb3fabc1a777 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9061ddee3d48528f5849b2cc6a1d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7df9bc3521c479d9c16d3516b014cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:48.775694 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-184a96ea-e3a1-4321-80cd-cb3fabc1a777 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] 10.222.0.33 "GET /compute/v2.1/servers/0d82589c-f627-44b7-95cd-30e07a27a1a8" status: 200 len: 1506 microversion: 2.1 time: 0.571357 Oct 04 20:55:48.777036 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2234/4430] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:55:48 2022] GET /compute/v2.1/servers/0d82589c-f627-44b7-95cd-30e07a27a1a8 => generated 1506 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:55:48.803928 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-d772aac2-0f1f-4226-aa19-1729948b6a14 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:55:48.807093 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-d772aac2-0f1f-4226-aa19-1729948b6a14 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] [instance: 23613d5c-93a4-4da9-be4e-deac3d259cb5] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:55:48.829642 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d772aac2-0f1f-4226-aa19-1729948b6a14 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:48.830154 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d772aac2-0f1f-4226-aa19-1729948b6a14 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:48.830847 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d772aac2-0f1f-4226-aa19-1729948b6a14 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:48.831959 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d772aac2-0f1f-4226-aa19-1729948b6a14 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:48.833392 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d772aac2-0f1f-4226-aa19-1729948b6a14 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:48.837736 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d772aac2-0f1f-4226-aa19-1729948b6a14 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:49.738281 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-55445a31-0239-4787-ba24-4812ad66c1d5 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b78af5c0485b4343900269160ef3e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659f3d4023b347d58bc0361db9ceead9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:49.755147 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-55445a31-0239-4787-ba24-4812ad66c1d5 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b78af5c0485b4343900269160ef3e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659f3d4023b347d58bc0361db9ceead9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:49.756828 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-55445a31-0239-4787-ba24-4812ad66c1d5 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b78af5c0485b4343900269160ef3e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659f3d4023b347d58bc0361db9ceead9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:49.759954 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-55445a31-0239-4787-ba24-4812ad66c1d5 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] 10.222.0.33 "GET /compute/v2.1/servers/f8ba4e66-2997-4822-9c01-c570f5ae6e87" status: 200 len: 2393 microversion: 2.42 time: 1.125158 Oct 04 20:55:49.760553 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2197/4431] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:55:48 2022] GET /compute/v2.1/servers/f8ba4e66-2997-4822-9c01-c570f5ae6e87 => generated 2393 bytes in 1128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:55:49.783558 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d0d1db94-d639-4555-ba58-4c257f183c08 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:55:49.786128 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d0d1db94-d639-4555-ba58-4c257f183c08 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] [instance: 3b4b8ffa-a834-442c-bdbe-a782eb376d28] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:55:49.815260 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d0d1db94-d639-4555-ba58-4c257f183c08 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:49.816632 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d0d1db94-d639-4555-ba58-4c257f183c08 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:49.817303 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d0d1db94-d639-4555-ba58-4c257f183c08 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:49.819349 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d0d1db94-d639-4555-ba58-4c257f183c08 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:49.820905 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d0d1db94-d639-4555-ba58-4c257f183c08 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:49.821780 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d0d1db94-d639-4555-ba58-4c257f183c08 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:49.874557 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-d772aac2-0f1f-4226-aa19-1729948b6a14 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9061ddee3d48528f5849b2cc6a1d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7df9bc3521c479d9c16d3516b014cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:49.887674 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-d772aac2-0f1f-4226-aa19-1729948b6a14 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] 10.222.0.33 "GET /compute/v2.1/servers/23613d5c-93a4-4da9-be4e-deac3d259cb5" status: 200 len: 1506 microversion: 2.1 time: 1.089595 Oct 04 20:55:49.888592 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2235/4432] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:55:48 2022] GET /compute/v2.1/servers/23613d5c-93a4-4da9-be4e-deac3d259cb5 => generated 1506 bytes in 1091 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:55:49.917392 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-57475007-ecd5-4273-9afa-7adc5071f40d tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:55:49.917901 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-57475007-ecd5-4273-9afa-7adc5071f40d tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] [instance: 23613d5c-93a4-4da9-be4e-deac3d259cb5] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:55:49.920031 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:55:49.926516 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-57475007-ecd5-4273-9afa-7adc5071f40d tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:49.927008 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-57475007-ecd5-4273-9afa-7adc5071f40d tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:49.935087 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-57475007-ecd5-4273-9afa-7adc5071f40d tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:49.936157 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-57475007-ecd5-4273-9afa-7adc5071f40d tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:49.936824 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-57475007-ecd5-4273-9afa-7adc5071f40d tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:49.937596 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-57475007-ecd5-4273-9afa-7adc5071f40d tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:49.999658 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-57475007-ecd5-4273-9afa-7adc5071f40d tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] [instance: 23613d5c-93a4-4da9-be4e-deac3d259cb5] Going to try to terminate instance {{(pid=128802) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:55:50.125076 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:55:50.245565 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-57475007-ecd5-4273-9afa-7adc5071f40d tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] 10.222.0.33 "DELETE /compute/v2.1/servers/23613d5c-93a4-4da9-be4e-deac3d259cb5" status: 204 len: 0 microversion: 2.1 time: 0.332441 Oct 04 20:55:50.251139 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2236/4433] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 20:55:49 2022] DELETE /compute/v2.1/servers/23613d5c-93a4-4da9-be4e-deac3d259cb5 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 20:55:50.261968 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-da7291fe-ab2f-4817-aabf-1c9985da7410 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:55:50.262814 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-da7291fe-ab2f-4817-aabf-1c9985da7410 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] [instance: 0d82589c-f627-44b7-95cd-30e07a27a1a8] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:55:50.274107 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-da7291fe-ab2f-4817-aabf-1c9985da7410 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:50.275444 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-da7291fe-ab2f-4817-aabf-1c9985da7410 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:50.276160 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-da7291fe-ab2f-4817-aabf-1c9985da7410 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:50.278021 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-da7291fe-ab2f-4817-aabf-1c9985da7410 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:50.279719 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-da7291fe-ab2f-4817-aabf-1c9985da7410 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:50.280441 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-da7291fe-ab2f-4817-aabf-1c9985da7410 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:50.319613 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-da7291fe-ab2f-4817-aabf-1c9985da7410 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] [instance: 0d82589c-f627-44b7-95cd-30e07a27a1a8] Going to try to terminate instance {{(pid=128802) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:55:50.521330 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-da7291fe-ab2f-4817-aabf-1c9985da7410 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] 10.222.0.33 "DELETE /compute/v2.1/servers/0d82589c-f627-44b7-95cd-30e07a27a1a8" status: 204 len: 0 microversion: 2.1 time: 0.267847 Oct 04 20:55:50.536776 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2237/4434] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 20:55:50 2022] DELETE /compute/v2.1/servers/0d82589c-f627-44b7-95cd-30e07a27a1a8 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:55:50.560191 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-09c95214-090d-4494-818a-0ee9c2ab2f85 req-8d8230b6-8319-4fd1-b9f2-cc5c1ba91e4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8ba4e66-2997-4822-9c01-c570f5ae6e87", "name": "network-vif-deleted", "tag": "23c11bbd-118e-4951-9bf5-0c64ad430751"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:55:50.573824 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-09c95214-090d-4494-818a-0ee9c2ab2f85 req-8d8230b6-8319-4fd1-b9f2-cc5c1ba91e4b service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:50.574681 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-09c95214-090d-4494-818a-0ee9c2ab2f85 req-8d8230b6-8319-4fd1-b9f2-cc5c1ba91e4b service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:50.575331 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-09c95214-090d-4494-818a-0ee9c2ab2f85 req-8d8230b6-8319-4fd1-b9f2-cc5c1ba91e4b service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:50.592143 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-09c95214-090d-4494-818a-0ee9c2ab2f85 req-8d8230b6-8319-4fd1-b9f2-cc5c1ba91e4b service nova] Creating event network-vif-deleted:23c11bbd-118e-4951-9bf5-0c64ad430751 for instance f8ba4e66-2997-4822-9c01-c570f5ae6e87 on n-h1-854823-8 Oct 04 20:55:50.599766 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-09c95214-090d-4494-818a-0ee9c2ab2f85 req-8d8230b6-8319-4fd1-b9f2-cc5c1ba91e4b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059906 Oct 04 20:55:50.601580 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2238/4435] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:55:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:55:50.793279 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-3a4512f4-ba0a-4342-974f-3b90ba38d208 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:55:50.793993 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-3a4512f4-ba0a-4342-974f-3b90ba38d208 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] [instance: f8ba4e66-2997-4822-9c01-c570f5ae6e87] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:55:50.811401 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3a4512f4-ba0a-4342-974f-3b90ba38d208 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:50.820224 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3a4512f4-ba0a-4342-974f-3b90ba38d208 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:50.820720 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3a4512f4-ba0a-4342-974f-3b90ba38d208 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:50.821491 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3a4512f4-ba0a-4342-974f-3b90ba38d208 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:50.822436 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3a4512f4-ba0a-4342-974f-3b90ba38d208 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:50.822873 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3a4512f4-ba0a-4342-974f-3b90ba38d208 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:51.128769 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d0d1db94-d639-4555-ba58-4c257f183c08 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e93855201ca64c779f92a2a33979b81f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed328a1e964d46902dee5e1c7c7b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:51.139947 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d0d1db94-d639-4555-ba58-4c257f183c08 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] 10.222.0.33 "GET /compute/v2.1/servers/3b4b8ffa-a834-442c-bdbe-a782eb376d28" status: 200 len: 1317 microversion: 2.1 time: 1.375506 Oct 04 20:55:51.146139 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2198/4436] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:55:49 2022] GET /compute/v2.1/servers/3b4b8ffa-a834-442c-bdbe-a782eb376d28 => generated 1317 bytes in 1382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:55:51.154539 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1586a0d7-2c97-47a5-96eb-fd336de1699d tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateTestJSON-server-895589669", "imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63", "flavorRef": "452", "min_count": 1, "max_count": 2, "return_reservation_id": true, "networks": [{"uuid": "0d88e810-91e7-4fd1-af36-97484029ba46"}]}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:55:51.285712 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.network.neutron [None req-1586a0d7-2c97-47a5-96eb-fd336de1699d tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] validate_networks() for [('0d88e810-91e7-4fd1-af36-97484029ba46', None, None, None, None, None)] {{(pid=128801) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:55:51.437935 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-3a4512f4-ba0a-4342-974f-3b90ba38d208 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b78af5c0485b4343900269160ef3e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659f3d4023b347d58bc0361db9ceead9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:51.466870 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-3a4512f4-ba0a-4342-974f-3b90ba38d208 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b78af5c0485b4343900269160ef3e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659f3d4023b347d58bc0361db9ceead9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:51.468611 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-3a4512f4-ba0a-4342-974f-3b90ba38d208 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b78af5c0485b4343900269160ef3e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659f3d4023b347d58bc0361db9ceead9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:51.469900 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-3a4512f4-ba0a-4342-974f-3b90ba38d208 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] 10.222.0.33 "GET /compute/v2.1/servers/f8ba4e66-2997-4822-9c01-c570f5ae6e87" status: 200 len: 2347 microversion: 2.42 time: 0.682568 Oct 04 20:55:51.476366 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2239/4437] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:55:50 2022] GET /compute/v2.1/servers/f8ba4e66-2997-4822-9c01-c570f5ae6e87 => generated 2347 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 20:55:52.049950 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-f5cf63bf-2616-4968-ad1a-f256ee36c756 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV257Test-server-2041487210", "imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63", "flavorRef": "452", "networks": "none"}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:55:52.144994 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-f5cf63bf-2616-4968-ad1a-f256ee36c756 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Flavor limits 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:55:52.145633 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-f5cf63bf-2616-4968-ad1a-f256ee36c756 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Image limits 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:55:52.146117 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-f5cf63bf-2616-4968-ad1a-f256ee36c756 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Flavor pref 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:55:52.146591 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-f5cf63bf-2616-4968-ad1a-f256ee36c756 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Image pref 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:55:52.147007 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-f5cf63bf-2616-4968-ad1a-f256ee36c756 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:55:52.173365 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f5cf63bf-2616-4968-ad1a-f256ee36c756 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:52.173925 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f5cf63bf-2616-4968-ad1a-f256ee36c756 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:52.174407 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f5cf63bf-2616-4968-ad1a-f256ee36c756 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:52.175202 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f5cf63bf-2616-4968-ad1a-f256ee36c756 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:52.175658 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f5cf63bf-2616-4968-ad1a-f256ee36c756 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:52.177457 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f5cf63bf-2616-4968-ad1a-f256ee36c756 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:52.232996 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-f5cf63bf-2616-4968-ad1a-f256ee36c756 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Getting quotas for project c27d0f72dc5f404e969e7fcc9cb99d08. Resources: {'ram', 'instances', 'cores'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:55:52.250701 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-f5cf63bf-2616-4968-ad1a-f256ee36c756 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Getting quotas for user a2021a91a331491c96e79808bf8c32ab and project c27d0f72dc5f404e969e7fcc9cb99d08. Resources: {'ram', 'instances', 'cores'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:55:52.283683 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-f5cf63bf-2616-4968-ad1a-f256ee36c756 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Going to run 1 instances... {{(pid=128802) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:55:52.286047 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-f5cf63bf-2616-4968-ad1a-f256ee36c756 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] [instance: 913a7627-5c81-4c33-858b-35ac9adeb4da] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='15b24725-0c99-4bcf-b1fb-907cdf8e2d63',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128802) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:55:52.385217 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-f5cf63bf-2616-4968-ad1a-f256ee36c756 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.57 time: 0.545608 Oct 04 20:55:52.393801 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2240/4438] 10.222.0.33 () {62 vars in 1188 bytes} [Tue Oct 4 20:55:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 555 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Oct 04 20:55:52.403330 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-cc0121f2-8a2e-439b-a77f-cf107e99b6a1 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:55:52.404215 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-cc0121f2-8a2e-439b-a77f-cf107e99b6a1 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] [instance: 3b4b8ffa-a834-442c-bdbe-a782eb376d28] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:55:52.413187 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cc0121f2-8a2e-439b-a77f-cf107e99b6a1 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:52.414274 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cc0121f2-8a2e-439b-a77f-cf107e99b6a1 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:52.414832 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cc0121f2-8a2e-439b-a77f-cf107e99b6a1 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:52.415697 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cc0121f2-8a2e-439b-a77f-cf107e99b6a1 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:52.416390 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cc0121f2-8a2e-439b-a77f-cf107e99b6a1 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:52.417030 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cc0121f2-8a2e-439b-a77f-cf107e99b6a1 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:53.301132 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-cc0121f2-8a2e-439b-a77f-cf107e99b6a1 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e93855201ca64c779f92a2a33979b81f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed328a1e964d46902dee5e1c7c7b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:53.320921 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-cc0121f2-8a2e-439b-a77f-cf107e99b6a1 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] 10.222.0.33 "GET /compute/v2.1/servers/3b4b8ffa-a834-442c-bdbe-a782eb376d28" status: 200 len: 1317 microversion: 2.1 time: 0.924091 Oct 04 20:55:53.324382 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2241/4439] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:55:52 2022] GET /compute/v2.1/servers/3b4b8ffa-a834-442c-bdbe-a782eb376d28 => generated 1317 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:55:53.346650 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-447c8b09-43d9-4c7a-a8ae-87fefebc0994 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:55:53.348665 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-447c8b09-43d9-4c7a-a8ae-87fefebc0994 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] [instance: 913a7627-5c81-4c33-858b-35ac9adeb4da] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:55:53.367048 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-447c8b09-43d9-4c7a-a8ae-87fefebc0994 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:53.367576 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-447c8b09-43d9-4c7a-a8ae-87fefebc0994 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:53.370696 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-447c8b09-43d9-4c7a-a8ae-87fefebc0994 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:53.378202 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-447c8b09-43d9-4c7a-a8ae-87fefebc0994 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:53.379115 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-447c8b09-43d9-4c7a-a8ae-87fefebc0994 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:53.379991 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-447c8b09-43d9-4c7a-a8ae-87fefebc0994 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:53.658452 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-447c8b09-43d9-4c7a-a8ae-87fefebc0994 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2021a91a331491c96e79808bf8c32ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27d0f72dc5f404e969e7fcc9cb99d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:53.671969 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-447c8b09-43d9-4c7a-a8ae-87fefebc0994 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2021a91a331491c96e79808bf8c32ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27d0f72dc5f404e969e7fcc9cb99d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:53.677718 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-447c8b09-43d9-4c7a-a8ae-87fefebc0994 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2021a91a331491c96e79808bf8c32ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27d0f72dc5f404e969e7fcc9cb99d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:53.679620 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-447c8b09-43d9-4c7a-a8ae-87fefebc0994 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] 10.222.0.33 "GET /compute/v2.1/servers/913a7627-5c81-4c33-858b-35ac9adeb4da" status: 200 len: 1274 microversion: 2.57 time: 0.350690 Oct 04 20:55:53.682998 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2242/4440] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:55:53 2022] GET /compute/v2.1/servers/913a7627-5c81-4c33-858b-35ac9adeb4da => generated 1274 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:55:53.696228 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-d945fe31-3d2b-43cf-a792-ef3ed7c0eba3 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:55:53.697335 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-d945fe31-3d2b-43cf-a792-ef3ed7c0eba3 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] [instance: f8ba4e66-2997-4822-9c01-c570f5ae6e87] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:55:53.708724 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d945fe31-3d2b-43cf-a792-ef3ed7c0eba3 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:53.712940 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d945fe31-3d2b-43cf-a792-ef3ed7c0eba3 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:53.713986 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d945fe31-3d2b-43cf-a792-ef3ed7c0eba3 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:53.714924 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d945fe31-3d2b-43cf-a792-ef3ed7c0eba3 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:53.715548 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d945fe31-3d2b-43cf-a792-ef3ed7c0eba3 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:53.724970 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d945fe31-3d2b-43cf-a792-ef3ed7c0eba3 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:54.215359 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-d945fe31-3d2b-43cf-a792-ef3ed7c0eba3 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b78af5c0485b4343900269160ef3e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659f3d4023b347d58bc0361db9ceead9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:54.237152 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-d945fe31-3d2b-43cf-a792-ef3ed7c0eba3 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b78af5c0485b4343900269160ef3e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659f3d4023b347d58bc0361db9ceead9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:54.238410 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-d945fe31-3d2b-43cf-a792-ef3ed7c0eba3 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b78af5c0485b4343900269160ef3e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659f3d4023b347d58bc0361db9ceead9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:54.248183 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-d945fe31-3d2b-43cf-a792-ef3ed7c0eba3 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] 10.222.0.33 "GET /compute/v2.1/servers/f8ba4e66-2997-4822-9c01-c570f5ae6e87" status: 200 len: 1605 microversion: 2.42 time: 0.556871 Oct 04 20:55:54.255529 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2243/4441] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:55:53 2022] GET /compute/v2.1/servers/f8ba4e66-2997-4822-9c01-c570f5ae6e87 => generated 1605 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:55:54.272041 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-cbb0d61b-c5b0-4c40-9d39-c70ad512020e req-c293d94b-4e99-4490-acda-5746036c4fc7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8ba4e66-2997-4822-9c01-c570f5ae6e87", "name": "network-vif-deleted", "tag": "6e6d2a48-9844-45c7-a3ac-b235535858ac"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:55:54.317090 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-cbb0d61b-c5b0-4c40-9d39-c70ad512020e req-c293d94b-4e99-4490-acda-5746036c4fc7 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:54.317861 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-cbb0d61b-c5b0-4c40-9d39-c70ad512020e req-c293d94b-4e99-4490-acda-5746036c4fc7 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:54.326909 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-cbb0d61b-c5b0-4c40-9d39-c70ad512020e req-c293d94b-4e99-4490-acda-5746036c4fc7 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:54.365960 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-cbb0d61b-c5b0-4c40-9d39-c70ad512020e req-c293d94b-4e99-4490-acda-5746036c4fc7 service nova] Creating event network-vif-deleted:6e6d2a48-9844-45c7-a3ac-b235535858ac for instance f8ba4e66-2997-4822-9c01-c570f5ae6e87 on n-h1-854823-8 Oct 04 20:55:54.379993 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-cbb0d61b-c5b0-4c40-9d39-c70ad512020e req-c293d94b-4e99-4490-acda-5746036c4fc7 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122649 Oct 04 20:55:54.381701 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2244/4442] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:55:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:55:54.396071 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-e9f69d87-d076-4722-8450-e6a7711b9277 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:55:54.396792 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-e9f69d87-d076-4722-8450-e6a7711b9277 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] [instance: 3b4b8ffa-a834-442c-bdbe-a782eb376d28] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:55:54.413847 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e9f69d87-d076-4722-8450-e6a7711b9277 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:54.414799 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e9f69d87-d076-4722-8450-e6a7711b9277 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:54.415472 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e9f69d87-d076-4722-8450-e6a7711b9277 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:54.416472 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e9f69d87-d076-4722-8450-e6a7711b9277 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:54.419165 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e9f69d87-d076-4722-8450-e6a7711b9277 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:54.419642 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e9f69d87-d076-4722-8450-e6a7711b9277 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:55.579395 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-1586a0d7-2c97-47a5-96eb-fd336de1699d tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Flavor limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:55:55.579982 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-1586a0d7-2c97-47a5-96eb-fd336de1699d tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Image limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:55:55.581051 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-1586a0d7-2c97-47a5-96eb-fd336de1699d tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Flavor pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:55:55.581589 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-1586a0d7-2c97-47a5-96eb-fd336de1699d tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Image pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:55:55.582123 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-1586a0d7-2c97-47a5-96eb-fd336de1699d tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:55:55.611016 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1586a0d7-2c97-47a5-96eb-fd336de1699d tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:55.614447 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1586a0d7-2c97-47a5-96eb-fd336de1699d tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:55.618546 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1586a0d7-2c97-47a5-96eb-fd336de1699d tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:55.624822 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1586a0d7-2c97-47a5-96eb-fd336de1699d tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:55.625627 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1586a0d7-2c97-47a5-96eb-fd336de1699d tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:55.627765 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1586a0d7-2c97-47a5-96eb-fd336de1699d tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:55.736564 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-1586a0d7-2c97-47a5-96eb-fd336de1699d tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Getting quotas for project c7df9bc3521c479d9c16d3516b014cc6. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:55:55.759716 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-1586a0d7-2c97-47a5-96eb-fd336de1699d tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Getting quotas for user 1d9061ddee3d48528f5849b2cc6a1d5b and project c7df9bc3521c479d9c16d3516b014cc6. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:55:55.798050 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-1586a0d7-2c97-47a5-96eb-fd336de1699d tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Going to run 2 instances... {{(pid=128801) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:55:55.805638 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-1586a0d7-2c97-47a5-96eb-fd336de1699d tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] [instance: 0304aa72-7abd-40c3-a555-74179786e217] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='15b24725-0c99-4bcf-b1fb-907cdf8e2d63',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128801) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:55:55.896241 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-1586a0d7-2c97-47a5-96eb-fd336de1699d tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] [instance: e687d91c-29dd-4e32-9ddc-9b358e711870] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='15b24725-0c99-4bcf-b1fb-907cdf8e2d63',instance=,instance_uuid=0304aa72-7abd-40c3-a555-74179786e217,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128801) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:55:55.997918 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-1586a0d7-2c97-47a5-96eb-fd336de1699d tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 4.849930 Oct 04 20:55:56.002095 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2199/4443] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 20:55:51 2022] POST /compute/v2.1/servers => generated 32 bytes in 4855 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Oct 04 20:55:56.013280 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7ca5a29f-8989-42b0-b449-5b5dbfe0dd69 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:55:56.014276 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-7ca5a29f-8989-42b0-b449-5b5dbfe0dd69 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] [instance: 913a7627-5c81-4c33-858b-35ac9adeb4da] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:55:56.041173 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7ca5a29f-8989-42b0-b449-5b5dbfe0dd69 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:56.042014 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7ca5a29f-8989-42b0-b449-5b5dbfe0dd69 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:56.046256 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7ca5a29f-8989-42b0-b449-5b5dbfe0dd69 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:56.048834 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7ca5a29f-8989-42b0-b449-5b5dbfe0dd69 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:56.049424 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7ca5a29f-8989-42b0-b449-5b5dbfe0dd69 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:56.051149 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7ca5a29f-8989-42b0-b449-5b5dbfe0dd69 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:56.178334 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-e9f69d87-d076-4722-8450-e6a7711b9277 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e93855201ca64c779f92a2a33979b81f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed328a1e964d46902dee5e1c7c7b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:56.203081 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-e9f69d87-d076-4722-8450-e6a7711b9277 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] 10.222.0.33 "GET /compute/v2.1/servers/3b4b8ffa-a834-442c-bdbe-a782eb376d28" status: 200 len: 1317 microversion: 2.1 time: 1.819514 Oct 04 20:55:56.221192 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2245/4444] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:55:54 2022] GET /compute/v2.1/servers/3b4b8ffa-a834-442c-bdbe-a782eb376d28 => generated 1317 bytes in 1837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:55:56.247528 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-d7fa22cc-446b-4ee4-8baa-8ce1bbec3e45 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:55:56.248234 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-d7fa22cc-446b-4ee4-8baa-8ce1bbec3e45 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] [instance: f8ba4e66-2997-4822-9c01-c570f5ae6e87] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:55:56.302420 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-7ca5a29f-8989-42b0-b449-5b5dbfe0dd69 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2021a91a331491c96e79808bf8c32ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27d0f72dc5f404e969e7fcc9cb99d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:56.306897 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=100 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:55:56.314132 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d7fa22cc-446b-4ee4-8baa-8ce1bbec3e45 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:56.314772 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d7fa22cc-446b-4ee4-8baa-8ce1bbec3e45 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:56.315226 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d7fa22cc-446b-4ee4-8baa-8ce1bbec3e45 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:56.321412 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d7fa22cc-446b-4ee4-8baa-8ce1bbec3e45 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:56.321911 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d7fa22cc-446b-4ee4-8baa-8ce1bbec3e45 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:56.322157 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-7ca5a29f-8989-42b0-b449-5b5dbfe0dd69 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2021a91a331491c96e79808bf8c32ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27d0f72dc5f404e969e7fcc9cb99d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:56.322367 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d7fa22cc-446b-4ee4-8baa-8ce1bbec3e45 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:56.324157 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-7ca5a29f-8989-42b0-b449-5b5dbfe0dd69 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2021a91a331491c96e79808bf8c32ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27d0f72dc5f404e969e7fcc9cb99d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:56.328535 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-7ca5a29f-8989-42b0-b449-5b5dbfe0dd69 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] 10.222.0.33 "GET /compute/v2.1/servers/913a7627-5c81-4c33-858b-35ac9adeb4da" status: 200 len: 1336 microversion: 2.57 time: 0.325004 Oct 04 20:55:56.329300 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2200/4445] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:55:56 2022] GET /compute/v2.1/servers/913a7627-5c81-4c33-858b-35ac9adeb4da => generated 1336 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:55:56.348711 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-aa52097f-5df8-4455-a8bf-b030f0b5d86d tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:55:56.368413 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-aa52097f-5df8-4455-a8bf-b030f0b5d86d tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1d9061ddee3d48528f5849b2cc6a1d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7df9bc3521c479d9c16d3516b014cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:56.369216 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-aa52097f-5df8-4455-a8bf-b030f0b5d86d tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Searching by: {'deleted': False, 'project_id': 'c7df9bc3521c479d9c16d3516b014cc6'} {{(pid=128801) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 20:55:56.414531 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-aa52097f-5df8-4455-a8bf-b030f0b5d86d tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:56.415419 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-aa52097f-5df8-4455-a8bf-b030f0b5d86d tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:56.417987 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-aa52097f-5df8-4455-a8bf-b030f0b5d86d tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:56.419156 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-aa52097f-5df8-4455-a8bf-b030f0b5d86d tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:56.422115 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-aa52097f-5df8-4455-a8bf-b030f0b5d86d tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:56.422786 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-aa52097f-5df8-4455-a8bf-b030f0b5d86d tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:56.498617 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.multi_cell_list [None req-aa52097f-5df8-4455-a8bf-b030f0b5d86d tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Listed batch of 2 results from cell out of 998 limit. Returned 2 total so far. {{(pid=128801) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 20:55:56.595216 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-aa52097f-5df8-4455-a8bf-b030f0b5d86d tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] 10.222.0.33 "GET /compute/v2.1/servers" status: 200 len: 1333 microversion: 2.1 time: 0.255120 Oct 04 20:55:56.596663 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2201/4446] 10.222.0.33 () {58 vars in 1125 bytes} [Tue Oct 4 20:55:56 2022] GET /compute/v2.1/servers => generated 1333 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:55:56.614143 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-32536216-c2c9-4116-b4ed-d4b08198926d req-a0479adf-3b67-4f38-af38-a1a63a9f2489 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b4b8ffa-a834-442c-bdbe-a782eb376d28", "tag": "e538e2e8-c7fe-44c4-97ff-e5173ea38d94"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:55:56.649541 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-32536216-c2c9-4116-b4ed-d4b08198926d req-a0479adf-3b67-4f38-af38-a1a63a9f2489 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:56.650231 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-32536216-c2c9-4116-b4ed-d4b08198926d req-a0479adf-3b67-4f38-af38-a1a63a9f2489 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:56.650987 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-32536216-c2c9-4116-b4ed-d4b08198926d req-a0479adf-3b67-4f38-af38-a1a63a9f2489 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:56.654634 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-d7fa22cc-446b-4ee4-8baa-8ce1bbec3e45 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b78af5c0485b4343900269160ef3e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659f3d4023b347d58bc0361db9ceead9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:56.674917 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-d7fa22cc-446b-4ee4-8baa-8ce1bbec3e45 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b78af5c0485b4343900269160ef3e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659f3d4023b347d58bc0361db9ceead9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:56.676557 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-d7fa22cc-446b-4ee4-8baa-8ce1bbec3e45 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b78af5c0485b4343900269160ef3e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659f3d4023b347d58bc0361db9ceead9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:56.679505 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-d7fa22cc-446b-4ee4-8baa-8ce1bbec3e45 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] 10.222.0.33 "GET /compute/v2.1/servers/f8ba4e66-2997-4822-9c01-c570f5ae6e87" status: 200 len: 1605 microversion: 2.42 time: 0.457153 Oct 04 20:55:56.681864 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2246/4447] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:55:56 2022] GET /compute/v2.1/servers/f8ba4e66-2997-4822-9c01-c570f5ae6e87 => generated 1605 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:55:56.711588 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-32536216-c2c9-4116-b4ed-d4b08198926d req-a0479adf-3b67-4f38-af38-a1a63a9f2489 service nova] Creating event network-changed:e538e2e8-c7fe-44c4-97ff-e5173ea38d94 for instance 3b4b8ffa-a834-442c-bdbe-a782eb376d28 on n-h1-854823-8 Oct 04 20:55:56.717628 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-ecae3ead-40c7-470a-98ea-47d75ad4cab3 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:55:56.721017 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-ecae3ead-40c7-470a-98ea-47d75ad4cab3 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] [instance: e687d91c-29dd-4e32-9ddc-9b358e711870] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:55:56.728109 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-32536216-c2c9-4116-b4ed-d4b08198926d req-a0479adf-3b67-4f38-af38-a1a63a9f2489 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.128607 Oct 04 20:55:56.733060 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2202/4448] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:55:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:55:56.844678 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-6992eccc-642a-4769-b594-142fe86563d4 req-d760b9c2-867d-45da-98df-a40984cf66fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23613d5c-93a4-4da9-be4e-deac3d259cb5", "name": "network-vif-deleted", "tag": "88538d39-4580-482d-b0db-d076f79f963b"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:55:56.861698 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:55:56.868992 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-6992eccc-642a-4769-b594-142fe86563d4 req-d760b9c2-867d-45da-98df-a40984cf66fe service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:56.869464 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-6992eccc-642a-4769-b594-142fe86563d4 req-d760b9c2-867d-45da-98df-a40984cf66fe service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:56.889137 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-6992eccc-642a-4769-b594-142fe86563d4 req-d760b9c2-867d-45da-98df-a40984cf66fe service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:56.935270 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-6992eccc-642a-4769-b594-142fe86563d4 req-d760b9c2-867d-45da-98df-a40984cf66fe service nova] Creating event network-vif-deleted:88538d39-4580-482d-b0db-d076f79f963b for instance 23613d5c-93a4-4da9-be4e-deac3d259cb5 on n-h1-854823-8 Oct 04 20:55:56.952647 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-6992eccc-642a-4769-b594-142fe86563d4 req-d760b9c2-867d-45da-98df-a40984cf66fe service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111397 Oct 04 20:55:56.954508 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2203/4449] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:55:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:55:57.234893 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5e02f009-f56a-407f-a3d5-dbcd83ab8009 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:55:57.236003 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-5e02f009-f56a-407f-a3d5-dbcd83ab8009 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] [instance: 3b4b8ffa-a834-442c-bdbe-a782eb376d28] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:55:57.275729 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5e02f009-f56a-407f-a3d5-dbcd83ab8009 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:57.276241 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5e02f009-f56a-407f-a3d5-dbcd83ab8009 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:57.277222 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5e02f009-f56a-407f-a3d5-dbcd83ab8009 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:57.277415 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5e02f009-f56a-407f-a3d5-dbcd83ab8009 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:57.277876 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5e02f009-f56a-407f-a3d5-dbcd83ab8009 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:57.278301 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5e02f009-f56a-407f-a3d5-dbcd83ab8009 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:57.540504 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-ecae3ead-40c7-470a-98ea-47d75ad4cab3 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9061ddee3d48528f5849b2cc6a1d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7df9bc3521c479d9c16d3516b014cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:57.554971 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-ecae3ead-40c7-470a-98ea-47d75ad4cab3 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] 10.222.0.33 "GET /compute/v2.1/servers/e687d91c-29dd-4e32-9ddc-9b358e711870" status: 200 len: 1217 microversion: 2.1 time: 0.858803 Oct 04 20:55:57.558831 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2247/4450] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:55:56 2022] GET /compute/v2.1/servers/e687d91c-29dd-4e32-9ddc-9b358e711870 => generated 1217 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:55:57.572377 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-d3d786cb-ec76-4381-9ac1-5eaa3c934fcd tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:55:57.574275 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-d3d786cb-ec76-4381-9ac1-5eaa3c934fcd tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] [instance: 913a7627-5c81-4c33-858b-35ac9adeb4da] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:55:57.604025 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d3d786cb-ec76-4381-9ac1-5eaa3c934fcd tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:57.604802 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d3d786cb-ec76-4381-9ac1-5eaa3c934fcd tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:57.607388 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d3d786cb-ec76-4381-9ac1-5eaa3c934fcd tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:57.608331 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d3d786cb-ec76-4381-9ac1-5eaa3c934fcd tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:57.608961 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d3d786cb-ec76-4381-9ac1-5eaa3c934fcd tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:57.610621 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d3d786cb-ec76-4381-9ac1-5eaa3c934fcd tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:58.016006 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-d3d786cb-ec76-4381-9ac1-5eaa3c934fcd tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2021a91a331491c96e79808bf8c32ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27d0f72dc5f404e969e7fcc9cb99d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:58.042652 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-d3d786cb-ec76-4381-9ac1-5eaa3c934fcd tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2021a91a331491c96e79808bf8c32ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27d0f72dc5f404e969e7fcc9cb99d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:58.044367 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-d3d786cb-ec76-4381-9ac1-5eaa3c934fcd tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2021a91a331491c96e79808bf8c32ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27d0f72dc5f404e969e7fcc9cb99d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:58.045720 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-d3d786cb-ec76-4381-9ac1-5eaa3c934fcd tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] 10.222.0.33 "GET /compute/v2.1/servers/913a7627-5c81-4c33-858b-35ac9adeb4da" status: 200 len: 1357 microversion: 2.57 time: 0.481924 Oct 04 20:55:58.068123 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2248/4451] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:55:57 2022] GET /compute/v2.1/servers/913a7627-5c81-4c33-858b-35ac9adeb4da => generated 1357 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:55:58.099733 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-7eea5542-ffc9-4aa6-87cf-81917a3bbf50 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:55:58.103613 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-7eea5542-ffc9-4aa6-87cf-81917a3bbf50 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] [instance: f8ba4e66-2997-4822-9c01-c570f5ae6e87] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:55:58.114923 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7eea5542-ffc9-4aa6-87cf-81917a3bbf50 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:58.115725 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7eea5542-ffc9-4aa6-87cf-81917a3bbf50 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:58.117151 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7eea5542-ffc9-4aa6-87cf-81917a3bbf50 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:58.118258 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7eea5542-ffc9-4aa6-87cf-81917a3bbf50 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:58.118880 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7eea5542-ffc9-4aa6-87cf-81917a3bbf50 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:58.119675 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7eea5542-ffc9-4aa6-87cf-81917a3bbf50 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:58.309401 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-7eea5542-ffc9-4aa6-87cf-81917a3bbf50 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b78af5c0485b4343900269160ef3e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659f3d4023b347d58bc0361db9ceead9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:58.352184 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-7eea5542-ffc9-4aa6-87cf-81917a3bbf50 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b78af5c0485b4343900269160ef3e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659f3d4023b347d58bc0361db9ceead9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:58.354614 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-7eea5542-ffc9-4aa6-87cf-81917a3bbf50 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b78af5c0485b4343900269160ef3e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659f3d4023b347d58bc0361db9ceead9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:58.358187 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-7eea5542-ffc9-4aa6-87cf-81917a3bbf50 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] 10.222.0.33 "GET /compute/v2.1/servers/f8ba4e66-2997-4822-9c01-c570f5ae6e87" status: 200 len: 1605 microversion: 2.42 time: 0.287484 Oct 04 20:55:58.360540 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2249/4452] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:55:58 2022] GET /compute/v2.1/servers/f8ba4e66-2997-4822-9c01-c570f5ae6e87 => generated 1605 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:55:58.377550 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-3b763a8e-59d4-4e5c-8844-2f3ce092d1c9 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Action: 'action', calling method: >, body: {"rebuild": {"user_data": "ZWNobyAiaGVsbG8gd29ybGQi", "imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63"}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:55:58.385918 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-3b763a8e-59d4-4e5c-8844-2f3ce092d1c9 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] [instance: 913a7627-5c81-4c33-858b-35ac9adeb4da] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:55:58.403112 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3b763a8e-59d4-4e5c-8844-2f3ce092d1c9 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:58.405593 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3b763a8e-59d4-4e5c-8844-2f3ce092d1c9 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:58.406904 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3b763a8e-59d4-4e5c-8844-2f3ce092d1c9 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:58.408369 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3b763a8e-59d4-4e5c-8844-2f3ce092d1c9 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:58.409158 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3b763a8e-59d4-4e5c-8844-2f3ce092d1c9 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:58.409904 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3b763a8e-59d4-4e5c-8844-2f3ce092d1c9 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:58.416099 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-5e02f009-f56a-407f-a3d5-dbcd83ab8009 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e93855201ca64c779f92a2a33979b81f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed328a1e964d46902dee5e1c7c7b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:58.434334 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5e02f009-f56a-407f-a3d5-dbcd83ab8009 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] 10.222.0.33 "GET /compute/v2.1/servers/3b4b8ffa-a834-442c-bdbe-a782eb376d28" status: 200 len: 1317 microversion: 2.1 time: 1.206118 Oct 04 20:55:58.437116 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2204/4453] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:55:57 2022] GET /compute/v2.1/servers/3b4b8ffa-a834-442c-bdbe-a782eb376d28 => generated 1317 bytes in 1211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:55:58.592874 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-345fc602-adc0-482c-b08f-9cf1364c5653 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:55:58.593774 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-345fc602-adc0-482c-b08f-9cf1364c5653 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] [instance: e687d91c-29dd-4e32-9ddc-9b358e711870] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:55:58.639375 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-345fc602-adc0-482c-b08f-9cf1364c5653 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:58.639910 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-345fc602-adc0-482c-b08f-9cf1364c5653 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:58.640368 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-345fc602-adc0-482c-b08f-9cf1364c5653 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:58.641126 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-345fc602-adc0-482c-b08f-9cf1364c5653 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:58.641583 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-345fc602-adc0-482c-b08f-9cf1364c5653 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:58.642011 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-345fc602-adc0-482c-b08f-9cf1364c5653 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:58.650927 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-3b763a8e-59d4-4e5c-8844-2f3ce092d1c9 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Flavor limits 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:55:58.651517 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-3b763a8e-59d4-4e5c-8844-2f3ce092d1c9 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Image limits 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:55:58.652081 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-3b763a8e-59d4-4e5c-8844-2f3ce092d1c9 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Flavor pref 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:55:58.652629 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-3b763a8e-59d4-4e5c-8844-2f3ce092d1c9 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Image pref 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:55:58.653176 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-3b763a8e-59d4-4e5c-8844-2f3ce092d1c9 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:55:58.830466 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-345fc602-adc0-482c-b08f-9cf1364c5653 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9061ddee3d48528f5849b2cc6a1d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7df9bc3521c479d9c16d3516b014cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:58.843132 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-345fc602-adc0-482c-b08f-9cf1364c5653 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] 10.222.0.33 "GET /compute/v2.1/servers/e687d91c-29dd-4e32-9ddc-9b358e711870" status: 200 len: 1269 microversion: 2.1 time: 0.267775 Oct 04 20:55:58.843776 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2205/4454] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:55:58 2022] GET /compute/v2.1/servers/e687d91c-29dd-4e32-9ddc-9b358e711870 => generated 1269 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:55:58.860151 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-3b763a8e-59d4-4e5c-8844-2f3ce092d1c9 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] [instance: 913a7627-5c81-4c33-858b-35ac9adeb4da] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:55:58.860151 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3b763a8e-59d4-4e5c-8844-2f3ce092d1c9 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:58.860151 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3b763a8e-59d4-4e5c-8844-2f3ce092d1c9 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:58.860151 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3b763a8e-59d4-4e5c-8844-2f3ce092d1c9 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:58.861057 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3b763a8e-59d4-4e5c-8844-2f3ce092d1c9 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:58.861770 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3b763a8e-59d4-4e5c-8844-2f3ce092d1c9 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:58.862459 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3b763a8e-59d4-4e5c-8844-2f3ce092d1c9 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:58.926471 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-3b763a8e-59d4-4e5c-8844-2f3ce092d1c9 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] 10.222.0.33 "POST /compute/v2.1/servers/913a7627-5c81-4c33-858b-35ac9adeb4da/action" status: 202 len: 1138 microversion: 2.57 time: 0.561019 Oct 04 20:55:58.927889 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2250/4455] 10.222.0.33 () {62 vars in 1320 bytes} [Tue Oct 4 20:55:58 2022] POST /compute/v2.1/servers/913a7627-5c81-4c33-858b-35ac9adeb4da/action => generated 1138 bytes in 566 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 04 20:55:58.950069 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-64164f34-f4e2-4e90-95a8-1a8f2ebff5a4 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:55:58.951350 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-64164f34-f4e2-4e90-95a8-1a8f2ebff5a4 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] [instance: 913a7627-5c81-4c33-858b-35ac9adeb4da] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:55:58.958043 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-64164f34-f4e2-4e90-95a8-1a8f2ebff5a4 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:58.958819 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-64164f34-f4e2-4e90-95a8-1a8f2ebff5a4 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:58.959434 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-64164f34-f4e2-4e90-95a8-1a8f2ebff5a4 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:58.961148 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-64164f34-f4e2-4e90-95a8-1a8f2ebff5a4 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:58.961886 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-64164f34-f4e2-4e90-95a8-1a8f2ebff5a4 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:58.963343 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-64164f34-f4e2-4e90-95a8-1a8f2ebff5a4 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:59.044093 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-fa95c81d-4a2f-48d3-9694-8adfe25c49b6 req-a0d9e97d-173e-4f9a-b901-a08404233881 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d82589c-f627-44b7-95cd-30e07a27a1a8", "name": "network-vif-deleted", "tag": "7a30a586-1cc3-4182-97fb-c25126c9d342"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:55:59.080141 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-fa95c81d-4a2f-48d3-9694-8adfe25c49b6 req-a0d9e97d-173e-4f9a-b901-a08404233881 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:59.080910 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-fa95c81d-4a2f-48d3-9694-8adfe25c49b6 req-a0d9e97d-173e-4f9a-b901-a08404233881 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:59.081940 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-fa95c81d-4a2f-48d3-9694-8adfe25c49b6 req-a0d9e97d-173e-4f9a-b901-a08404233881 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:59.102812 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-fa95c81d-4a2f-48d3-9694-8adfe25c49b6 req-a0d9e97d-173e-4f9a-b901-a08404233881 service nova] Creating event network-vif-deleted:7a30a586-1cc3-4182-97fb-c25126c9d342 for instance 0d82589c-f627-44b7-95cd-30e07a27a1a8 on n-h2-854823-8 Oct 04 20:55:59.126233 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-64164f34-f4e2-4e90-95a8-1a8f2ebff5a4 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2021a91a331491c96e79808bf8c32ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27d0f72dc5f404e969e7fcc9cb99d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:59.154821 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-fa95c81d-4a2f-48d3-9694-8adfe25c49b6 req-a0d9e97d-173e-4f9a-b901-a08404233881 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114568 Oct 04 20:55:59.155468 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2251/4456] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:55:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 20:55:59.158731 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-64164f34-f4e2-4e90-95a8-1a8f2ebff5a4 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2021a91a331491c96e79808bf8c32ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27d0f72dc5f404e969e7fcc9cb99d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:59.166661 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-64164f34-f4e2-4e90-95a8-1a8f2ebff5a4 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2021a91a331491c96e79808bf8c32ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27d0f72dc5f404e969e7fcc9cb99d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:59.172068 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-64164f34-f4e2-4e90-95a8-1a8f2ebff5a4 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] 10.222.0.33 "GET /compute/v2.1/servers/913a7627-5c81-4c33-858b-35ac9adeb4da" status: 200 len: 1366 microversion: 2.57 time: 0.225764 Oct 04 20:55:59.188351 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2206/4457] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:55:58 2022] GET /compute/v2.1/servers/913a7627-5c81-4c33-858b-35ac9adeb4da => generated 1366 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:55:59.394911 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-c0b4e654-e1ee-47f7-840c-e400f0371d05 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:55:59.397005 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-c0b4e654-e1ee-47f7-840c-e400f0371d05 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] [instance: f8ba4e66-2997-4822-9c01-c570f5ae6e87] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:55:59.407488 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c0b4e654-e1ee-47f7-840c-e400f0371d05 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:59.418262 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c0b4e654-e1ee-47f7-840c-e400f0371d05 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:59.419275 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c0b4e654-e1ee-47f7-840c-e400f0371d05 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:59.420528 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c0b4e654-e1ee-47f7-840c-e400f0371d05 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:59.421658 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c0b4e654-e1ee-47f7-840c-e400f0371d05 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:59.422310 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c0b4e654-e1ee-47f7-840c-e400f0371d05 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:59.470564 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a880b64f-1d94-44a3-aaf4-7a98321f221d tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:55:59.471798 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a880b64f-1d94-44a3-aaf4-7a98321f221d tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] [instance: 3b4b8ffa-a834-442c-bdbe-a782eb376d28] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:55:59.493340 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a880b64f-1d94-44a3-aaf4-7a98321f221d tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:59.495360 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a880b64f-1d94-44a3-aaf4-7a98321f221d tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:59.499070 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a880b64f-1d94-44a3-aaf4-7a98321f221d tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:59.503752 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a880b64f-1d94-44a3-aaf4-7a98321f221d tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:59.506702 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a880b64f-1d94-44a3-aaf4-7a98321f221d tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:59.507830 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a880b64f-1d94-44a3-aaf4-7a98321f221d tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:59.732419 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-c0b4e654-e1ee-47f7-840c-e400f0371d05 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b78af5c0485b4343900269160ef3e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659f3d4023b347d58bc0361db9ceead9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:59.736833 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:55:59.750658 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-c0b4e654-e1ee-47f7-840c-e400f0371d05 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b78af5c0485b4343900269160ef3e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659f3d4023b347d58bc0361db9ceead9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:59.753476 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-c0b4e654-e1ee-47f7-840c-e400f0371d05 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b78af5c0485b4343900269160ef3e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659f3d4023b347d58bc0361db9ceead9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:55:59.760003 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-c0b4e654-e1ee-47f7-840c-e400f0371d05 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] 10.222.0.33 "GET /compute/v2.1/servers/f8ba4e66-2997-4822-9c01-c570f5ae6e87" status: 200 len: 1605 microversion: 2.42 time: 0.370038 Oct 04 20:55:59.784004 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2252/4458] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:55:59 2022] GET /compute/v2.1/servers/f8ba4e66-2997-4822-9c01-c570f5ae6e87 => generated 1605 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:55:59.879173 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-5a350baa-df61-423d-86ec-643b414c4dda tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:55:59.881073 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-5a350baa-df61-423d-86ec-643b414c4dda tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] [instance: e687d91c-29dd-4e32-9ddc-9b358e711870] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:55:59.906160 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5a350baa-df61-423d-86ec-643b414c4dda tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:59.911597 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5a350baa-df61-423d-86ec-643b414c4dda tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:59.912190 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5a350baa-df61-423d-86ec-643b414c4dda tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:55:59.913043 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5a350baa-df61-423d-86ec-643b414c4dda tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:55:59.915038 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5a350baa-df61-423d-86ec-643b414c4dda tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:55:59.915598 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5a350baa-df61-423d-86ec-643b414c4dda tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:00.082834 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-a880b64f-1d94-44a3-aaf4-7a98321f221d tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e93855201ca64c779f92a2a33979b81f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed328a1e964d46902dee5e1c7c7b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:56:00.091818 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a880b64f-1d94-44a3-aaf4-7a98321f221d tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] 10.222.0.33 "GET /compute/v2.1/servers/3b4b8ffa-a834-442c-bdbe-a782eb376d28" status: 200 len: 1317 microversion: 2.1 time: 0.626184 Oct 04 20:56:00.095362 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2207/4459] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:55:59 2022] GET /compute/v2.1/servers/3b4b8ffa-a834-442c-bdbe-a782eb376d28 => generated 1317 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:56:00.138912 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-5a350baa-df61-423d-86ec-643b414c4dda tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9061ddee3d48528f5849b2cc6a1d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7df9bc3521c479d9c16d3516b014cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:56:00.160687 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-5a350baa-df61-423d-86ec-643b414c4dda tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] 10.222.0.33 "GET /compute/v2.1/servers/e687d91c-29dd-4e32-9ddc-9b358e711870" status: 200 len: 1275 microversion: 2.1 time: 0.293574 Oct 04 20:56:00.161630 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2253/4460] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:55:59 2022] GET /compute/v2.1/servers/e687d91c-29dd-4e32-9ddc-9b358e711870 => generated 1275 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:56:00.205035 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-61142b39-aaa2-46b1-a9f0-8482f8fbf57b tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:56:00.206076 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-61142b39-aaa2-46b1-a9f0-8482f8fbf57b tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] [instance: 913a7627-5c81-4c33-858b-35ac9adeb4da] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:56:00.215433 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-61142b39-aaa2-46b1-a9f0-8482f8fbf57b tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:00.218758 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-61142b39-aaa2-46b1-a9f0-8482f8fbf57b tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:00.219468 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-61142b39-aaa2-46b1-a9f0-8482f8fbf57b tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:00.221529 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-61142b39-aaa2-46b1-a9f0-8482f8fbf57b tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:00.222233 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-61142b39-aaa2-46b1-a9f0-8482f8fbf57b tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:00.228292 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-61142b39-aaa2-46b1-a9f0-8482f8fbf57b tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:00.794115 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-be13c66d-7e3d-4902-948f-8ee8c0730103 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:56:00.795412 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-be13c66d-7e3d-4902-948f-8ee8c0730103 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] [instance: f8ba4e66-2997-4822-9c01-c570f5ae6e87] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:56:00.813429 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-be13c66d-7e3d-4902-948f-8ee8c0730103 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:00.814467 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-be13c66d-7e3d-4902-948f-8ee8c0730103 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:00.815802 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-be13c66d-7e3d-4902-948f-8ee8c0730103 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:00.818610 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-be13c66d-7e3d-4902-948f-8ee8c0730103 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:00.830290 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-be13c66d-7e3d-4902-948f-8ee8c0730103 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:00.833432 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-be13c66d-7e3d-4902-948f-8ee8c0730103 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:00.839239 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-61142b39-aaa2-46b1-a9f0-8482f8fbf57b tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2021a91a331491c96e79808bf8c32ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27d0f72dc5f404e969e7fcc9cb99d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:56:00.856343 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-61142b39-aaa2-46b1-a9f0-8482f8fbf57b tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2021a91a331491c96e79808bf8c32ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27d0f72dc5f404e969e7fcc9cb99d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:56:00.865155 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-61142b39-aaa2-46b1-a9f0-8482f8fbf57b tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2021a91a331491c96e79808bf8c32ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27d0f72dc5f404e969e7fcc9cb99d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:56:00.867073 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-61142b39-aaa2-46b1-a9f0-8482f8fbf57b tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] 10.222.0.33 "GET /compute/v2.1/servers/913a7627-5c81-4c33-858b-35ac9adeb4da" status: 200 len: 1366 microversion: 2.57 time: 0.666939 Oct 04 20:56:00.870812 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2208/4461] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:56:00 2022] GET /compute/v2.1/servers/913a7627-5c81-4c33-858b-35ac9adeb4da => generated 1366 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:56:01.110874 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-be13c66d-7e3d-4902-948f-8ee8c0730103 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b78af5c0485b4343900269160ef3e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659f3d4023b347d58bc0361db9ceead9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:56:01.122248 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-691e83bc-12fc-485b-b9dc-670f2052d260 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:56:01.123197 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-691e83bc-12fc-485b-b9dc-670f2052d260 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] [instance: 3b4b8ffa-a834-442c-bdbe-a782eb376d28] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:56:01.130513 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-be13c66d-7e3d-4902-948f-8ee8c0730103 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b78af5c0485b4343900269160ef3e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659f3d4023b347d58bc0361db9ceead9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:56:01.132983 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-be13c66d-7e3d-4902-948f-8ee8c0730103 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b78af5c0485b4343900269160ef3e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659f3d4023b347d58bc0361db9ceead9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:56:01.136586 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-be13c66d-7e3d-4902-948f-8ee8c0730103 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] 10.222.0.33 "GET /compute/v2.1/servers/f8ba4e66-2997-4822-9c01-c570f5ae6e87" status: 200 len: 1605 microversion: 2.42 time: 0.349164 Oct 04 20:56:01.137863 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-691e83bc-12fc-485b-b9dc-670f2052d260 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:01.138392 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-691e83bc-12fc-485b-b9dc-670f2052d260 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:01.138842 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-691e83bc-12fc-485b-b9dc-670f2052d260 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:01.139380 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2254/4462] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:56:00 2022] GET /compute/v2.1/servers/f8ba4e66-2997-4822-9c01-c570f5ae6e87 => generated 1605 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 20:56:01.139567 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-691e83bc-12fc-485b-b9dc-670f2052d260 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:01.152192 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-691e83bc-12fc-485b-b9dc-670f2052d260 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:01.152743 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-691e83bc-12fc-485b-b9dc-670f2052d260 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:01.190724 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-8a7aae83-86af-43c3-992b-ef713253d64c tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:56:01.191346 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-8a7aae83-86af-43c3-992b-ef713253d64c tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] [instance: e687d91c-29dd-4e32-9ddc-9b358e711870] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:56:01.203151 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8a7aae83-86af-43c3-992b-ef713253d64c tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:01.203657 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8a7aae83-86af-43c3-992b-ef713253d64c tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:01.204101 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8a7aae83-86af-43c3-992b-ef713253d64c tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:01.209509 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8a7aae83-86af-43c3-992b-ef713253d64c tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:01.211388 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8a7aae83-86af-43c3-992b-ef713253d64c tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:01.212494 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8a7aae83-86af-43c3-992b-ef713253d64c tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:02.192527 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell0:SELECT=4 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:56:02.203867 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-8a7aae83-86af-43c3-992b-ef713253d64c tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9061ddee3d48528f5849b2cc6a1d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7df9bc3521c479d9c16d3516b014cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:56:02.215527 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-8a7aae83-86af-43c3-992b-ef713253d64c tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] 10.222.0.33 "GET /compute/v2.1/servers/e687d91c-29dd-4e32-9ddc-9b358e711870" status: 200 len: 1317 microversion: 2.1 time: 1.029885 Oct 04 20:56:02.226896 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2255/4463] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:56:01 2022] GET /compute/v2.1/servers/e687d91c-29dd-4e32-9ddc-9b358e711870 => generated 1317 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:56:02.245548 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-278a31dd-e968-46ae-b8e0-d113b200aefd req-9304f9dc-8a28-40d4-b3d3-80fe66a975bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b4b8ffa-a834-442c-bdbe-a782eb376d28", "name": "network-vif-plugged", "status": "completed", "tag": "e538e2e8-c7fe-44c4-97ff-e5173ea38d94"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:56:02.266665 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-691e83bc-12fc-485b-b9dc-670f2052d260 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e93855201ca64c779f92a2a33979b81f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed328a1e964d46902dee5e1c7c7b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:56:02.269697 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-278a31dd-e968-46ae-b8e0-d113b200aefd req-9304f9dc-8a28-40d4-b3d3-80fe66a975bb service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:02.271035 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-278a31dd-e968-46ae-b8e0-d113b200aefd req-9304f9dc-8a28-40d4-b3d3-80fe66a975bb service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:02.271858 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-278a31dd-e968-46ae-b8e0-d113b200aefd req-9304f9dc-8a28-40d4-b3d3-80fe66a975bb service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:02.276929 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-691e83bc-12fc-485b-b9dc-670f2052d260 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] 10.222.0.33 "GET /compute/v2.1/servers/3b4b8ffa-a834-442c-bdbe-a782eb376d28" status: 200 len: 1317 microversion: 2.1 time: 1.158457 Oct 04 20:56:02.280948 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2209/4464] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:56:01 2022] GET /compute/v2.1/servers/3b4b8ffa-a834-442c-bdbe-a782eb376d28 => generated 1317 bytes in 1163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:56:02.285863 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f620dd4e-c088-4e52-a368-e4efd90d09b5 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:56:02.286518 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f620dd4e-c088-4e52-a368-e4efd90d09b5 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] [instance: 913a7627-5c81-4c33-858b-35ac9adeb4da] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:56:02.307049 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-278a31dd-e968-46ae-b8e0-d113b200aefd req-9304f9dc-8a28-40d4-b3d3-80fe66a975bb service nova] Creating event network-vif-plugged:e538e2e8-c7fe-44c4-97ff-e5173ea38d94 for instance 3b4b8ffa-a834-442c-bdbe-a782eb376d28 on n-h1-854823-8 Oct 04 20:56:02.309795 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f620dd4e-c088-4e52-a368-e4efd90d09b5 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:02.310306 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f620dd4e-c088-4e52-a368-e4efd90d09b5 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:02.310816 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f620dd4e-c088-4e52-a368-e4efd90d09b5 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:02.311520 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f620dd4e-c088-4e52-a368-e4efd90d09b5 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:02.311986 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f620dd4e-c088-4e52-a368-e4efd90d09b5 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:02.312428 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f620dd4e-c088-4e52-a368-e4efd90d09b5 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:02.321060 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-278a31dd-e968-46ae-b8e0-d113b200aefd req-9304f9dc-8a28-40d4-b3d3-80fe66a975bb service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085467 Oct 04 20:56:02.322849 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2256/4465] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:56:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:56:02.333676 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-78697b22-bc1d-494c-ae2b-beb1847948a2 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:56:02.336445 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-78697b22-bc1d-494c-ae2b-beb1847948a2 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] [instance: f8ba4e66-2997-4822-9c01-c570f5ae6e87] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:56:02.362888 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-78697b22-bc1d-494c-ae2b-beb1847948a2 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:02.363735 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-78697b22-bc1d-494c-ae2b-beb1847948a2 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:02.364403 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-78697b22-bc1d-494c-ae2b-beb1847948a2 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:02.365426 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-78697b22-bc1d-494c-ae2b-beb1847948a2 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:02.367829 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-78697b22-bc1d-494c-ae2b-beb1847948a2 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:02.368710 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-78697b22-bc1d-494c-ae2b-beb1847948a2 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:02.651624 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f620dd4e-c088-4e52-a368-e4efd90d09b5 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2021a91a331491c96e79808bf8c32ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27d0f72dc5f404e969e7fcc9cb99d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:56:02.667016 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f620dd4e-c088-4e52-a368-e4efd90d09b5 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2021a91a331491c96e79808bf8c32ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27d0f72dc5f404e969e7fcc9cb99d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:56:02.668516 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f620dd4e-c088-4e52-a368-e4efd90d09b5 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2021a91a331491c96e79808bf8c32ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27d0f72dc5f404e969e7fcc9cb99d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:56:02.669789 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f620dd4e-c088-4e52-a368-e4efd90d09b5 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] 10.222.0.33 "GET /compute/v2.1/servers/913a7627-5c81-4c33-858b-35ac9adeb4da" status: 200 len: 1366 microversion: 2.57 time: 0.387817 Oct 04 20:56:02.675012 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2210/4466] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:56:02 2022] GET /compute/v2.1/servers/913a7627-5c81-4c33-858b-35ac9adeb4da => generated 1366 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:56:02.699632 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-78697b22-bc1d-494c-ae2b-beb1847948a2 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b78af5c0485b4343900269160ef3e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659f3d4023b347d58bc0361db9ceead9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:56:02.711319 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-78697b22-bc1d-494c-ae2b-beb1847948a2 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b78af5c0485b4343900269160ef3e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659f3d4023b347d58bc0361db9ceead9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:56:02.715462 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-78697b22-bc1d-494c-ae2b-beb1847948a2 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b78af5c0485b4343900269160ef3e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659f3d4023b347d58bc0361db9ceead9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:56:02.726802 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-78697b22-bc1d-494c-ae2b-beb1847948a2 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] 10.222.0.33 "GET /compute/v2.1/servers/f8ba4e66-2997-4822-9c01-c570f5ae6e87" status: 200 len: 1605 microversion: 2.42 time: 0.390382 Oct 04 20:56:02.728025 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2257/4467] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:56:02 2022] GET /compute/v2.1/servers/f8ba4e66-2997-4822-9c01-c570f5ae6e87 => generated 1605 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:56:03.250751 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9d3b43ee-464a-4897-a15b-001f08584249 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:56:03.253100 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-9d3b43ee-464a-4897-a15b-001f08584249 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] [instance: e687d91c-29dd-4e32-9ddc-9b358e711870] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:56:03.266330 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9d3b43ee-464a-4897-a15b-001f08584249 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:03.267253 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9d3b43ee-464a-4897-a15b-001f08584249 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:03.268561 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9d3b43ee-464a-4897-a15b-001f08584249 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:03.269562 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9d3b43ee-464a-4897-a15b-001f08584249 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:03.270480 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9d3b43ee-464a-4897-a15b-001f08584249 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:03.271105 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9d3b43ee-464a-4897-a15b-001f08584249 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:03.316082 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-89e53c1b-0b6b-434f-8cd4-cb335662ba90 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:56:03.319146 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-89e53c1b-0b6b-434f-8cd4-cb335662ba90 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] [instance: 3b4b8ffa-a834-442c-bdbe-a782eb376d28] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:56:03.356012 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-89e53c1b-0b6b-434f-8cd4-cb335662ba90 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:03.357326 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-89e53c1b-0b6b-434f-8cd4-cb335662ba90 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:03.360655 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-89e53c1b-0b6b-434f-8cd4-cb335662ba90 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:03.361778 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-89e53c1b-0b6b-434f-8cd4-cb335662ba90 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:03.364696 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-89e53c1b-0b6b-434f-8cd4-cb335662ba90 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:03.365448 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-89e53c1b-0b6b-434f-8cd4-cb335662ba90 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:03.680090 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-89e53c1b-0b6b-434f-8cd4-cb335662ba90 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e93855201ca64c779f92a2a33979b81f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed328a1e964d46902dee5e1c7c7b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:56:03.722519 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-89e53c1b-0b6b-434f-8cd4-cb335662ba90 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] 10.222.0.33 "GET /compute/v2.1/servers/3b4b8ffa-a834-442c-bdbe-a782eb376d28" status: 200 len: 1317 microversion: 2.1 time: 0.413684 Oct 04 20:56:03.723968 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2258/4468] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:56:03 2022] GET /compute/v2.1/servers/3b4b8ffa-a834-442c-bdbe-a782eb376d28 => generated 1317 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:56:03.739063 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-9d3b43ee-464a-4897-a15b-001f08584249 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9061ddee3d48528f5849b2cc6a1d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7df9bc3521c479d9c16d3516b014cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:56:03.748160 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-3df2ee95-1729-4af0-9c90-9f562d26b41f tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:56:03.748539 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-9d3b43ee-464a-4897-a15b-001f08584249 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] 10.222.0.33 "GET /compute/v2.1/servers/e687d91c-29dd-4e32-9ddc-9b358e711870" status: 200 len: 1317 microversion: 2.1 time: 0.510621 Oct 04 20:56:03.750852 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-3df2ee95-1729-4af0-9c90-9f562d26b41f tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] [instance: 913a7627-5c81-4c33-858b-35ac9adeb4da] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:56:03.766438 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3df2ee95-1729-4af0-9c90-9f562d26b41f tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:03.767827 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2211/4469] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:56:03 2022] GET /compute/v2.1/servers/e687d91c-29dd-4e32-9ddc-9b358e711870 => generated 1317 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:56:03.768881 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3df2ee95-1729-4af0-9c90-9f562d26b41f tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:03.771962 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3df2ee95-1729-4af0-9c90-9f562d26b41f tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:03.773041 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3df2ee95-1729-4af0-9c90-9f562d26b41f tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:03.773915 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3df2ee95-1729-4af0-9c90-9f562d26b41f tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:03.774920 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e8f00ac0-b908-4891-b11c-5388acd1deca tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:56:03.775743 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e8f00ac0-b908-4891-b11c-5388acd1deca tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] [instance: f8ba4e66-2997-4822-9c01-c570f5ae6e87] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:56:03.775954 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3df2ee95-1729-4af0-9c90-9f562d26b41f tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:03.785412 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e8f00ac0-b908-4891-b11c-5388acd1deca tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:03.786660 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e8f00ac0-b908-4891-b11c-5388acd1deca tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:03.787280 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e8f00ac0-b908-4891-b11c-5388acd1deca tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:03.788403 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e8f00ac0-b908-4891-b11c-5388acd1deca tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:03.789243 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e8f00ac0-b908-4891-b11c-5388acd1deca tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:03.789948 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e8f00ac0-b908-4891-b11c-5388acd1deca tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:03.882557 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e8f00ac0-b908-4891-b11c-5388acd1deca tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b78af5c0485b4343900269160ef3e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659f3d4023b347d58bc0361db9ceead9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:56:03.901137 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e8f00ac0-b908-4891-b11c-5388acd1deca tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b78af5c0485b4343900269160ef3e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659f3d4023b347d58bc0361db9ceead9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:56:03.903037 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e8f00ac0-b908-4891-b11c-5388acd1deca tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b78af5c0485b4343900269160ef3e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659f3d4023b347d58bc0361db9ceead9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:56:03.904732 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e8f00ac0-b908-4891-b11c-5388acd1deca tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] 10.222.0.33 "GET /compute/v2.1/servers/f8ba4e66-2997-4822-9c01-c570f5ae6e87" status: 200 len: 1605 microversion: 2.42 time: 0.135169 Oct 04 20:56:03.905607 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2212/4470] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:56:03 2022] GET /compute/v2.1/servers/f8ba4e66-2997-4822-9c01-c570f5ae6e87 => generated 1605 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:56:03.989996 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-3df2ee95-1729-4af0-9c90-9f562d26b41f tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2021a91a331491c96e79808bf8c32ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27d0f72dc5f404e969e7fcc9cb99d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:56:04.010263 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-3df2ee95-1729-4af0-9c90-9f562d26b41f tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2021a91a331491c96e79808bf8c32ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27d0f72dc5f404e969e7fcc9cb99d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:56:04.012055 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-3df2ee95-1729-4af0-9c90-9f562d26b41f tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2021a91a331491c96e79808bf8c32ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27d0f72dc5f404e969e7fcc9cb99d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:56:04.013463 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-3df2ee95-1729-4af0-9c90-9f562d26b41f tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] 10.222.0.33 "GET /compute/v2.1/servers/913a7627-5c81-4c33-858b-35ac9adeb4da" status: 200 len: 1366 microversion: 2.57 time: 0.288043 Oct 04 20:56:04.014543 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2259/4471] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:56:03 2022] GET /compute/v2.1/servers/913a7627-5c81-4c33-858b-35ac9adeb4da => generated 1366 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:56:04.588986 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-d1b4b64d-7a08-431b-b7d3-9dc8f14c0338 req-6774db4f-b0d6-498c-b66d-5803bc762aa5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e687d91c-29dd-4e32-9ddc-9b358e711870", "tag": "c5b1c37e-84b1-4ccc-a345-24049ee9ef3f"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:56:04.625096 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-d1b4b64d-7a08-431b-b7d3-9dc8f14c0338 req-6774db4f-b0d6-498c-b66d-5803bc762aa5 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:04.625877 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-d1b4b64d-7a08-431b-b7d3-9dc8f14c0338 req-6774db4f-b0d6-498c-b66d-5803bc762aa5 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:04.626552 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-d1b4b64d-7a08-431b-b7d3-9dc8f14c0338 req-6774db4f-b0d6-498c-b66d-5803bc762aa5 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:04.640880 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-d1b4b64d-7a08-431b-b7d3-9dc8f14c0338 req-6774db4f-b0d6-498c-b66d-5803bc762aa5 service nova] Creating event network-changed:c5b1c37e-84b1-4ccc-a345-24049ee9ef3f for instance e687d91c-29dd-4e32-9ddc-9b358e711870 on n-h2-854823-8 Oct 04 20:56:04.647557 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-d1b4b64d-7a08-431b-b7d3-9dc8f14c0338 req-6774db4f-b0d6-498c-b66d-5803bc762aa5 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075858 Oct 04 20:56:04.649833 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2213/4472] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:56:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:56:04.747331 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-3c08fb7c-6333-4efc-8df6-18a129b278f3 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:56:04.748533 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-3c08fb7c-6333-4efc-8df6-18a129b278f3 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] [instance: 3b4b8ffa-a834-442c-bdbe-a782eb376d28] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:56:04.755883 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3c08fb7c-6333-4efc-8df6-18a129b278f3 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:04.756644 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3c08fb7c-6333-4efc-8df6-18a129b278f3 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:04.757708 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3c08fb7c-6333-4efc-8df6-18a129b278f3 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:04.758666 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3c08fb7c-6333-4efc-8df6-18a129b278f3 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:04.759322 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3c08fb7c-6333-4efc-8df6-18a129b278f3 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:04.759948 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3c08fb7c-6333-4efc-8df6-18a129b278f3 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:04.776371 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b409d9b4-2c94-44ec-ac2d-00a2e5ac5b2a tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:56:04.777469 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b409d9b4-2c94-44ec-ac2d-00a2e5ac5b2a tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] [instance: e687d91c-29dd-4e32-9ddc-9b358e711870] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:56:04.790145 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b409d9b4-2c94-44ec-ac2d-00a2e5ac5b2a tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:04.803138 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b409d9b4-2c94-44ec-ac2d-00a2e5ac5b2a tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:04.804425 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b409d9b4-2c94-44ec-ac2d-00a2e5ac5b2a tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:04.805442 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b409d9b4-2c94-44ec-ac2d-00a2e5ac5b2a tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:04.806077 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b409d9b4-2c94-44ec-ac2d-00a2e5ac5b2a tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:04.806723 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b409d9b4-2c94-44ec-ac2d-00a2e5ac5b2a tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:05.771794 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-3c08fb7c-6333-4efc-8df6-18a129b278f3 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e93855201ca64c779f92a2a33979b81f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed328a1e964d46902dee5e1c7c7b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:56:05.782175 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-3c08fb7c-6333-4efc-8df6-18a129b278f3 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] 10.222.0.33 "GET /compute/v2.1/servers/3b4b8ffa-a834-442c-bdbe-a782eb376d28" status: 200 len: 1506 microversion: 2.1 time: 1.038801 Oct 04 20:56:05.788463 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=6 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:56:05.795389 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2260/4473] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:56:04 2022] GET /compute/v2.1/servers/3b4b8ffa-a834-442c-bdbe-a782eb376d28 => generated 1506 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:56:05.795489 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-b409d9b4-2c94-44ec-ac2d-00a2e5ac5b2a tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9061ddee3d48528f5849b2cc6a1d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7df9bc3521c479d9c16d3516b014cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:56:05.800144 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-d0a29a1c-34be-4263-baa2-a1bcb90f5967 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:56:05.800765 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-d0a29a1c-34be-4263-baa2-a1bcb90f5967 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] [instance: f8ba4e66-2997-4822-9c01-c570f5ae6e87] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:56:05.809856 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d0a29a1c-34be-4263-baa2-a1bcb90f5967 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:05.810452 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d0a29a1c-34be-4263-baa2-a1bcb90f5967 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:05.810902 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d0a29a1c-34be-4263-baa2-a1bcb90f5967 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:05.811623 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d0a29a1c-34be-4263-baa2-a1bcb90f5967 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:05.812085 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d0a29a1c-34be-4263-baa2-a1bcb90f5967 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:05.812521 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d0a29a1c-34be-4263-baa2-a1bcb90f5967 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:05.852635 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b409d9b4-2c94-44ec-ac2d-00a2e5ac5b2a tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] 10.222.0.33 "GET /compute/v2.1/servers/e687d91c-29dd-4e32-9ddc-9b358e711870" status: 200 len: 1317 microversion: 2.1 time: 1.078856 Oct 04 20:56:05.853448 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2214/4474] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:56:04 2022] GET /compute/v2.1/servers/e687d91c-29dd-4e32-9ddc-9b358e711870 => generated 1317 bytes in 1082 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:56:05.864076 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0ab7c635-8d98-480a-b033-91e9b2fa2c98 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:56:05.867003 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-0ab7c635-8d98-480a-b033-91e9b2fa2c98 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] [instance: 913a7627-5c81-4c33-858b-35ac9adeb4da] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:56:05.908033 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0ab7c635-8d98-480a-b033-91e9b2fa2c98 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:05.911604 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0ab7c635-8d98-480a-b033-91e9b2fa2c98 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:05.912631 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0ab7c635-8d98-480a-b033-91e9b2fa2c98 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:05.926382 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0ab7c635-8d98-480a-b033-91e9b2fa2c98 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:05.926886 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0ab7c635-8d98-480a-b033-91e9b2fa2c98 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:05.933391 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0ab7c635-8d98-480a-b033-91e9b2fa2c98 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:06.165619 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-0ab7c635-8d98-480a-b033-91e9b2fa2c98 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2021a91a331491c96e79808bf8c32ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27d0f72dc5f404e969e7fcc9cb99d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:56:06.167070 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-d0a29a1c-34be-4263-baa2-a1bcb90f5967 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b78af5c0485b4343900269160ef3e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659f3d4023b347d58bc0361db9ceead9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:56:06.203021 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-0ab7c635-8d98-480a-b033-91e9b2fa2c98 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2021a91a331491c96e79808bf8c32ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27d0f72dc5f404e969e7fcc9cb99d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:56:06.205822 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-d0a29a1c-34be-4263-baa2-a1bcb90f5967 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b78af5c0485b4343900269160ef3e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659f3d4023b347d58bc0361db9ceead9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:56:06.207859 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-0ab7c635-8d98-480a-b033-91e9b2fa2c98 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2021a91a331491c96e79808bf8c32ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27d0f72dc5f404e969e7fcc9cb99d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:56:06.212504 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-d0a29a1c-34be-4263-baa2-a1bcb90f5967 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b78af5c0485b4343900269160ef3e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659f3d4023b347d58bc0361db9ceead9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:56:06.214493 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-0ab7c635-8d98-480a-b033-91e9b2fa2c98 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] 10.222.0.33 "GET /compute/v2.1/servers/913a7627-5c81-4c33-858b-35ac9adeb4da" status: 200 len: 1366 microversion: 2.57 time: 0.359388 Oct 04 20:56:06.231785 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2215/4475] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:56:05 2022] GET /compute/v2.1/servers/913a7627-5c81-4c33-858b-35ac9adeb4da => generated 1366 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:56:06.232014 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-d0a29a1c-34be-4263-baa2-a1bcb90f5967 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] 10.222.0.33 "GET /compute/v2.1/servers/f8ba4e66-2997-4822-9c01-c570f5ae6e87" status: 200 len: 1605 microversion: 2.42 time: 0.419694 Oct 04 20:56:06.232014 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2261/4476] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:56:05 2022] GET /compute/v2.1/servers/f8ba4e66-2997-4822-9c01-c570f5ae6e87 => generated 1605 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:56:06.239455 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-01b877c4-33ea-4160-b871-efdb04eff35c tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:56:06.240961 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-01b877c4-33ea-4160-b871-efdb04eff35c tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] [instance: 3b4b8ffa-a834-442c-bdbe-a782eb376d28] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:56:06.256176 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-01b877c4-33ea-4160-b871-efdb04eff35c tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:06.257309 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-01b877c4-33ea-4160-b871-efdb04eff35c tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:06.259666 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-01b877c4-33ea-4160-b871-efdb04eff35c tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:06.260994 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-01b877c4-33ea-4160-b871-efdb04eff35c tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:06.264815 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-01b877c4-33ea-4160-b871-efdb04eff35c tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:06.266050 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-01b877c4-33ea-4160-b871-efdb04eff35c tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:06.447359 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=4 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:56:06.662456 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-01b877c4-33ea-4160-b871-efdb04eff35c tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e93855201ca64c779f92a2a33979b81f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed328a1e964d46902dee5e1c7c7b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:56:06.673739 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-01b877c4-33ea-4160-b871-efdb04eff35c tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] 10.222.0.33 "GET /compute/v2.1/servers/3b4b8ffa-a834-442c-bdbe-a782eb376d28" status: 200 len: 1506 microversion: 2.1 time: 0.446026 Oct 04 20:56:06.677667 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2216/4477] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:56:06 2022] GET /compute/v2.1/servers/3b4b8ffa-a834-442c-bdbe-a782eb376d28 => generated 1506 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:56:06.701448 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-3d16632f-a3b1-412c-8959-434a30bb1326 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:56:06.705110 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-3d16632f-a3b1-412c-8959-434a30bb1326 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] [instance: 3b4b8ffa-a834-442c-bdbe-a782eb376d28] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:56:06.718753 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3d16632f-a3b1-412c-8959-434a30bb1326 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:06.722275 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3d16632f-a3b1-412c-8959-434a30bb1326 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:06.723861 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3d16632f-a3b1-412c-8959-434a30bb1326 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:06.725087 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3d16632f-a3b1-412c-8959-434a30bb1326 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:06.726883 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3d16632f-a3b1-412c-8959-434a30bb1326 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:06.732279 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3d16632f-a3b1-412c-8959-434a30bb1326 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:06.869534 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-3d16632f-a3b1-412c-8959-434a30bb1326 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] 10.222.0.33 "PUT /compute/v2.1/servers/3b4b8ffa-a834-442c-bdbe-a782eb376d28" status: 200 len: 1078 microversion: 2.1 time: 0.172299 Oct 04 20:56:06.876811 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6dff8dcb-5048-4408-96f4-73e5eaacae17 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:56:06.878242 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-6dff8dcb-5048-4408-96f4-73e5eaacae17 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] [instance: e687d91c-29dd-4e32-9ddc-9b358e711870] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:56:06.880970 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2262/4478] 10.222.0.33 () {60 vars in 1256 bytes} [Tue Oct 4 20:56:06 2022] PUT /compute/v2.1/servers/3b4b8ffa-a834-442c-bdbe-a782eb376d28 => generated 1078 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:56:06.889636 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6dff8dcb-5048-4408-96f4-73e5eaacae17 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:06.889842 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6dff8dcb-5048-4408-96f4-73e5eaacae17 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:06.890277 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6dff8dcb-5048-4408-96f4-73e5eaacae17 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:06.891023 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6dff8dcb-5048-4408-96f4-73e5eaacae17 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:06.891585 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6dff8dcb-5048-4408-96f4-73e5eaacae17 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:06.891921 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6dff8dcb-5048-4408-96f4-73e5eaacae17 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:06.904193 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-079cd494-3900-4ef9-a857-ca7a4800413d tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:56:06.905255 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-079cd494-3900-4ef9-a857-ca7a4800413d tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] [instance: 3b4b8ffa-a834-442c-bdbe-a782eb376d28] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:56:06.919383 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-079cd494-3900-4ef9-a857-ca7a4800413d tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:06.919887 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-079cd494-3900-4ef9-a857-ca7a4800413d tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:06.920327 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-079cd494-3900-4ef9-a857-ca7a4800413d tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:06.921229 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-079cd494-3900-4ef9-a857-ca7a4800413d tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:06.921882 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-079cd494-3900-4ef9-a857-ca7a4800413d tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:06.922516 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-079cd494-3900-4ef9-a857-ca7a4800413d tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:07.554757 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell0:SELECT=16 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:56:08.080344 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-079cd494-3900-4ef9-a857-ca7a4800413d tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e93855201ca64c779f92a2a33979b81f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed328a1e964d46902dee5e1c7c7b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:56:08.102183 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-079cd494-3900-4ef9-a857-ca7a4800413d tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] 10.222.0.33 "GET /compute/v2.1/servers/3b4b8ffa-a834-442c-bdbe-a782eb376d28" status: 200 len: 1504 microversion: 2.1 time: 1.202056 Oct 04 20:56:08.103243 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2263/4479] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:56:06 2022] GET /compute/v2.1/servers/3b4b8ffa-a834-442c-bdbe-a782eb376d28 => generated 1504 bytes in 1204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:56:08.119562 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-75f324fb-ab48-4183-8a2f-0a36bd32d994 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:56:08.120451 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-75f324fb-ab48-4183-8a2f-0a36bd32d994 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] [instance: 913a7627-5c81-4c33-858b-35ac9adeb4da] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:56:08.137330 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-75f324fb-ab48-4183-8a2f-0a36bd32d994 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:08.138093 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-75f324fb-ab48-4183-8a2f-0a36bd32d994 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:08.138732 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-75f324fb-ab48-4183-8a2f-0a36bd32d994 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:08.139652 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-75f324fb-ab48-4183-8a2f-0a36bd32d994 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:08.140270 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-75f324fb-ab48-4183-8a2f-0a36bd32d994 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:08.140857 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-75f324fb-ab48-4183-8a2f-0a36bd32d994 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:08.177860 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-6dff8dcb-5048-4408-96f4-73e5eaacae17 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9061ddee3d48528f5849b2cc6a1d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7df9bc3521c479d9c16d3516b014cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:56:08.188750 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-6dff8dcb-5048-4408-96f4-73e5eaacae17 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] 10.222.0.33 "GET /compute/v2.1/servers/e687d91c-29dd-4e32-9ddc-9b358e711870" status: 200 len: 1317 microversion: 2.1 time: 1.315896 Oct 04 20:56:08.203190 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2217/4480] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:56:06 2022] GET /compute/v2.1/servers/e687d91c-29dd-4e32-9ddc-9b358e711870 => generated 1317 bytes in 1331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:56:08.237110 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-cdbc6c6a-ac07-4cf0-81e9-23d69ccf6415 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:56:08.240682 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-cdbc6c6a-ac07-4cf0-81e9-23d69ccf6415 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] [instance: f8ba4e66-2997-4822-9c01-c570f5ae6e87] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:56:08.268208 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cdbc6c6a-ac07-4cf0-81e9-23d69ccf6415 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:08.269598 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cdbc6c6a-ac07-4cf0-81e9-23d69ccf6415 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:08.270214 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cdbc6c6a-ac07-4cf0-81e9-23d69ccf6415 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:08.272391 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cdbc6c6a-ac07-4cf0-81e9-23d69ccf6415 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:08.275714 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cdbc6c6a-ac07-4cf0-81e9-23d69ccf6415 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:08.277289 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cdbc6c6a-ac07-4cf0-81e9-23d69ccf6415 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:08.495653 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-cdbc6c6a-ac07-4cf0-81e9-23d69ccf6415 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b78af5c0485b4343900269160ef3e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659f3d4023b347d58bc0361db9ceead9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:56:08.511339 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-75f324fb-ab48-4183-8a2f-0a36bd32d994 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2021a91a331491c96e79808bf8c32ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27d0f72dc5f404e969e7fcc9cb99d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:56:08.520407 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-75f324fb-ab48-4183-8a2f-0a36bd32d994 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2021a91a331491c96e79808bf8c32ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27d0f72dc5f404e969e7fcc9cb99d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:56:08.523503 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-75f324fb-ab48-4183-8a2f-0a36bd32d994 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2021a91a331491c96e79808bf8c32ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27d0f72dc5f404e969e7fcc9cb99d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:56:08.524756 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-75f324fb-ab48-4183-8a2f-0a36bd32d994 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] 10.222.0.33 "GET /compute/v2.1/servers/913a7627-5c81-4c33-858b-35ac9adeb4da" status: 200 len: 1366 microversion: 2.57 time: 0.420213 Oct 04 20:56:08.524876 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-cdbc6c6a-ac07-4cf0-81e9-23d69ccf6415 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b78af5c0485b4343900269160ef3e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659f3d4023b347d58bc0361db9ceead9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:56:08.526036 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2264/4481] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:56:08 2022] GET /compute/v2.1/servers/913a7627-5c81-4c33-858b-35ac9adeb4da => generated 1366 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:56:08.548150 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-cdbc6c6a-ac07-4cf0-81e9-23d69ccf6415 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b78af5c0485b4343900269160ef3e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659f3d4023b347d58bc0361db9ceead9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:56:08.549074 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-258a97ef-45b2-4f50-b644-721d5f9ed63a req-d907b7dc-fc38-4a25-8db0-a8e4f89e20de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0304aa72-7abd-40c3-a555-74179786e217", "tag": "04839d2e-82f0-4e47-bf67-2d69ea25390b"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:56:08.549406 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-cdbc6c6a-ac07-4cf0-81e9-23d69ccf6415 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] 10.222.0.33 "GET /compute/v2.1/servers/f8ba4e66-2997-4822-9c01-c570f5ae6e87" status: 200 len: 1605 microversion: 2.42 time: 0.345211 Oct 04 20:56:08.549983 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2218/4482] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:56:08 2022] GET /compute/v2.1/servers/f8ba4e66-2997-4822-9c01-c570f5ae6e87 => generated 1605 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:56:08.570062 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-877b6a1d-8164-4493-b676-85a35dfb4bd4 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:56:08.570817 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-877b6a1d-8164-4493-b676-85a35dfb4bd4 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] [instance: 3b4b8ffa-a834-442c-bdbe-a782eb376d28] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:56:08.591535 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-877b6a1d-8164-4493-b676-85a35dfb4bd4 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:08.593288 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-877b6a1d-8164-4493-b676-85a35dfb4bd4 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:08.594222 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-877b6a1d-8164-4493-b676-85a35dfb4bd4 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:08.595262 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-877b6a1d-8164-4493-b676-85a35dfb4bd4 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:08.595889 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-877b6a1d-8164-4493-b676-85a35dfb4bd4 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:08.596534 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-877b6a1d-8164-4493-b676-85a35dfb4bd4 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:08.600354 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-258a97ef-45b2-4f50-b644-721d5f9ed63a req-d907b7dc-fc38-4a25-8db0-a8e4f89e20de service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:08.601208 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-258a97ef-45b2-4f50-b644-721d5f9ed63a req-d907b7dc-fc38-4a25-8db0-a8e4f89e20de service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:08.602161 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-258a97ef-45b2-4f50-b644-721d5f9ed63a req-d907b7dc-fc38-4a25-8db0-a8e4f89e20de service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:08.627930 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-258a97ef-45b2-4f50-b644-721d5f9ed63a req-d907b7dc-fc38-4a25-8db0-a8e4f89e20de service nova] Creating event network-changed:04839d2e-82f0-4e47-bf67-2d69ea25390b for instance 0304aa72-7abd-40c3-a555-74179786e217 on n-h1-854823-8 Oct 04 20:56:08.628897 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=100 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:56:08.644439 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-258a97ef-45b2-4f50-b644-721d5f9ed63a req-d907b7dc-fc38-4a25-8db0-a8e4f89e20de service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102695 Oct 04 20:56:08.645416 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2265/4483] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:56:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:56:09.235500 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-b166c0a2-8140-421b-9426-8818c0d764d1 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:56:09.236212 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-b166c0a2-8140-421b-9426-8818c0d764d1 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] [instance: e687d91c-29dd-4e32-9ddc-9b358e711870] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:56:09.254009 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b166c0a2-8140-421b-9426-8818c0d764d1 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:09.254553 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b166c0a2-8140-421b-9426-8818c0d764d1 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:09.254993 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b166c0a2-8140-421b-9426-8818c0d764d1 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:09.255890 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b166c0a2-8140-421b-9426-8818c0d764d1 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:09.256496 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b166c0a2-8140-421b-9426-8818c0d764d1 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:09.257811 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b166c0a2-8140-421b-9426-8818c0d764d1 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:09.392095 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-877b6a1d-8164-4493-b676-85a35dfb4bd4 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e93855201ca64c779f92a2a33979b81f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed328a1e964d46902dee5e1c7c7b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:56:09.408793 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-877b6a1d-8164-4493-b676-85a35dfb4bd4 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] 10.222.0.33 "GET /compute/v2.1/servers/3b4b8ffa-a834-442c-bdbe-a782eb376d28" status: 200 len: 1504 microversion: 2.1 time: 0.841368 Oct 04 20:56:09.410029 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2219/4484] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:56:08 2022] GET /compute/v2.1/servers/3b4b8ffa-a834-442c-bdbe-a782eb376d28 => generated 1504 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:56:09.438144 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-25a43cf6-906a-4f2e-9183-a0dc6df68084 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "MANUAL"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:56:09.441140 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-25a43cf6-906a-4f2e-9183-a0dc6df68084 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] [instance: 3b4b8ffa-a834-442c-bdbe-a782eb376d28] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:56:09.463088 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-25a43cf6-906a-4f2e-9183-a0dc6df68084 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:09.475052 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-25a43cf6-906a-4f2e-9183-a0dc6df68084 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:09.476178 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-25a43cf6-906a-4f2e-9183-a0dc6df68084 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:09.478016 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-25a43cf6-906a-4f2e-9183-a0dc6df68084 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:09.483670 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-25a43cf6-906a-4f2e-9183-a0dc6df68084 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:09.484358 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-25a43cf6-906a-4f2e-9183-a0dc6df68084 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:09.581379 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-25a43cf6-906a-4f2e-9183-a0dc6df68084 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] 10.222.0.33 "PUT /compute/v2.1/servers/3b4b8ffa-a834-442c-bdbe-a782eb376d28" status: 200 len: 1080 microversion: 2.1 time: 0.149493 Oct 04 20:56:09.585407 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2220/4485] 10.222.0.33 () {60 vars in 1256 bytes} [Tue Oct 4 20:56:09 2022] PUT /compute/v2.1/servers/3b4b8ffa-a834-442c-bdbe-a782eb376d28 => generated 1080 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:56:09.591051 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ff1f95b5-44ec-4c93-adc1-515215923a0e tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:56:09.591674 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ff1f95b5-44ec-4c93-adc1-515215923a0e tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] [instance: 913a7627-5c81-4c33-858b-35ac9adeb4da] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:56:09.599878 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ff1f95b5-44ec-4c93-adc1-515215923a0e tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:09.600383 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ff1f95b5-44ec-4c93-adc1-515215923a0e tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:09.602160 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ff1f95b5-44ec-4c93-adc1-515215923a0e tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:09.603923 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ff1f95b5-44ec-4c93-adc1-515215923a0e tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:09.605084 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ff1f95b5-44ec-4c93-adc1-515215923a0e tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:09.605736 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ff1f95b5-44ec-4c93-adc1-515215923a0e tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:09.764636 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-ff1f95b5-44ec-4c93-adc1-515215923a0e tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2021a91a331491c96e79808bf8c32ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27d0f72dc5f404e969e7fcc9cb99d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:56:09.779325 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-ff1f95b5-44ec-4c93-adc1-515215923a0e tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2021a91a331491c96e79808bf8c32ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27d0f72dc5f404e969e7fcc9cb99d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:56:09.780988 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-ff1f95b5-44ec-4c93-adc1-515215923a0e tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2021a91a331491c96e79808bf8c32ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27d0f72dc5f404e969e7fcc9cb99d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:56:09.782318 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ff1f95b5-44ec-4c93-adc1-515215923a0e tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] 10.222.0.33 "GET /compute/v2.1/servers/913a7627-5c81-4c33-858b-35ac9adeb4da" status: 200 len: 1366 microversion: 2.57 time: 0.195713 Oct 04 20:56:09.788882 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2221/4486] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:56:09 2022] GET /compute/v2.1/servers/913a7627-5c81-4c33-858b-35ac9adeb4da => generated 1366 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:56:09.800462 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-fa66a866-e446-4ee3-99c4-c9c061aa2a38 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:56:09.801088 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-fa66a866-e446-4ee3-99c4-c9c061aa2a38 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] [instance: f8ba4e66-2997-4822-9c01-c570f5ae6e87] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:56:09.814498 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fa66a866-e446-4ee3-99c4-c9c061aa2a38 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:09.815004 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fa66a866-e446-4ee3-99c4-c9c061aa2a38 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:09.815445 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fa66a866-e446-4ee3-99c4-c9c061aa2a38 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:09.820214 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fa66a866-e446-4ee3-99c4-c9c061aa2a38 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:09.820712 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fa66a866-e446-4ee3-99c4-c9c061aa2a38 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:09.821161 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fa66a866-e446-4ee3-99c4-c9c061aa2a38 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:10.036270 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-fa66a866-e446-4ee3-99c4-c9c061aa2a38 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b78af5c0485b4343900269160ef3e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659f3d4023b347d58bc0361db9ceead9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:56:10.050850 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-fa66a866-e446-4ee3-99c4-c9c061aa2a38 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b78af5c0485b4343900269160ef3e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659f3d4023b347d58bc0361db9ceead9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:56:10.052297 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-fa66a866-e446-4ee3-99c4-c9c061aa2a38 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b78af5c0485b4343900269160ef3e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659f3d4023b347d58bc0361db9ceead9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:56:10.053540 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-fa66a866-e446-4ee3-99c4-c9c061aa2a38 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] 10.222.0.33 "GET /compute/v2.1/servers/f8ba4e66-2997-4822-9c01-c570f5ae6e87" status: 200 len: 1605 microversion: 2.42 time: 0.263355 Oct 04 20:56:10.060101 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2222/4487] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:56:09 2022] GET /compute/v2.1/servers/f8ba4e66-2997-4822-9c01-c570f5ae6e87 => generated 1605 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:56:10.065098 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1972dffd-cb4f-4a1a-9587-2d6cf3427cb7 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:56:10.070961 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-1972dffd-cb4f-4a1a-9587-2d6cf3427cb7 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] [instance: 3b4b8ffa-a834-442c-bdbe-a782eb376d28] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:56:10.084354 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1972dffd-cb4f-4a1a-9587-2d6cf3427cb7 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:10.087046 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1972dffd-cb4f-4a1a-9587-2d6cf3427cb7 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:10.088246 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1972dffd-cb4f-4a1a-9587-2d6cf3427cb7 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:10.089592 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1972dffd-cb4f-4a1a-9587-2d6cf3427cb7 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:10.090889 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1972dffd-cb4f-4a1a-9587-2d6cf3427cb7 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:10.093646 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1972dffd-cb4f-4a1a-9587-2d6cf3427cb7 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:10.982279 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-b166c0a2-8140-421b-9426-8818c0d764d1 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9061ddee3d48528f5849b2cc6a1d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7df9bc3521c479d9c16d3516b014cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:56:10.993729 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-b166c0a2-8140-421b-9426-8818c0d764d1 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] 10.222.0.33 "GET /compute/v2.1/servers/e687d91c-29dd-4e32-9ddc-9b358e711870" status: 200 len: 1317 microversion: 2.1 time: 1.762542 Oct 04 20:56:10.995420 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2266/4488] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:56:09 2022] GET /compute/v2.1/servers/e687d91c-29dd-4e32-9ddc-9b358e711870 => generated 1317 bytes in 1765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:56:11.008532 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-60db0adc-7329-4cde-9d0b-1b37518d572b tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:56:11.009331 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-60db0adc-7329-4cde-9d0b-1b37518d572b tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] [instance: 913a7627-5c81-4c33-858b-35ac9adeb4da] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:56:11.020885 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-60db0adc-7329-4cde-9d0b-1b37518d572b tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:11.022190 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-60db0adc-7329-4cde-9d0b-1b37518d572b tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:11.023583 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-60db0adc-7329-4cde-9d0b-1b37518d572b tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:11.025625 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-60db0adc-7329-4cde-9d0b-1b37518d572b tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:11.027300 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-60db0adc-7329-4cde-9d0b-1b37518d572b tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:11.028427 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-60db0adc-7329-4cde-9d0b-1b37518d572b tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:11.316146 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-60db0adc-7329-4cde-9d0b-1b37518d572b tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2021a91a331491c96e79808bf8c32ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27d0f72dc5f404e969e7fcc9cb99d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:56:11.325078 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-60db0adc-7329-4cde-9d0b-1b37518d572b tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2021a91a331491c96e79808bf8c32ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27d0f72dc5f404e969e7fcc9cb99d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:56:11.338607 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-60db0adc-7329-4cde-9d0b-1b37518d572b tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2021a91a331491c96e79808bf8c32ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27d0f72dc5f404e969e7fcc9cb99d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:56:11.340055 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-60db0adc-7329-4cde-9d0b-1b37518d572b tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] 10.222.0.33 "GET /compute/v2.1/servers/913a7627-5c81-4c33-858b-35ac9adeb4da" status: 200 len: 1366 microversion: 2.57 time: 0.342921 Oct 04 20:56:11.340817 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2267/4489] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:56:10 2022] GET /compute/v2.1/servers/913a7627-5c81-4c33-858b-35ac9adeb4da => generated 1366 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:56:11.354788 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-31de82f0-4400-4a86-b3c0-6792be6ee62b tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:56:11.355851 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-31de82f0-4400-4a86-b3c0-6792be6ee62b tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] [instance: f8ba4e66-2997-4822-9c01-c570f5ae6e87] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:56:11.367628 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-1972dffd-cb4f-4a1a-9587-2d6cf3427cb7 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e93855201ca64c779f92a2a33979b81f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed328a1e964d46902dee5e1c7c7b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:56:11.369360 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-31de82f0-4400-4a86-b3c0-6792be6ee62b tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:11.370286 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-31de82f0-4400-4a86-b3c0-6792be6ee62b tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:11.371740 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-31de82f0-4400-4a86-b3c0-6792be6ee62b tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:11.372680 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-31de82f0-4400-4a86-b3c0-6792be6ee62b tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:11.374147 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-31de82f0-4400-4a86-b3c0-6792be6ee62b tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:11.376358 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-31de82f0-4400-4a86-b3c0-6792be6ee62b tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:11.378086 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-1972dffd-cb4f-4a1a-9587-2d6cf3427cb7 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] 10.222.0.33 "GET /compute/v2.1/servers/3b4b8ffa-a834-442c-bdbe-a782eb376d28" status: 200 len: 1506 microversion: 2.1 time: 1.315947 Oct 04 20:56:11.379080 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2223/4490] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:56:10 2022] GET /compute/v2.1/servers/3b4b8ffa-a834-442c-bdbe-a782eb376d28 => generated 1506 bytes in 1318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:56:11.401107 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-183d7544-7ded-4fe9-b2c0-e5e71086b869 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:56:11.401788 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-183d7544-7ded-4fe9-b2c0-e5e71086b869 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] [instance: 3b4b8ffa-a834-442c-bdbe-a782eb376d28] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:56:11.408663 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-183d7544-7ded-4fe9-b2c0-e5e71086b869 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:11.409156 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-183d7544-7ded-4fe9-b2c0-e5e71086b869 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:11.409589 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-183d7544-7ded-4fe9-b2c0-e5e71086b869 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:11.410292 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-183d7544-7ded-4fe9-b2c0-e5e71086b869 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:11.410851 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-183d7544-7ded-4fe9-b2c0-e5e71086b869 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:11.411276 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-183d7544-7ded-4fe9-b2c0-e5e71086b869 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:11.594753 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-31de82f0-4400-4a86-b3c0-6792be6ee62b tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b78af5c0485b4343900269160ef3e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659f3d4023b347d58bc0361db9ceead9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:56:11.613973 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-31de82f0-4400-4a86-b3c0-6792be6ee62b tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b78af5c0485b4343900269160ef3e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659f3d4023b347d58bc0361db9ceead9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:56:11.618565 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-31de82f0-4400-4a86-b3c0-6792be6ee62b tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b78af5c0485b4343900269160ef3e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659f3d4023b347d58bc0361db9ceead9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:56:11.622436 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-31de82f0-4400-4a86-b3c0-6792be6ee62b tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] 10.222.0.33 "GET /compute/v2.1/servers/f8ba4e66-2997-4822-9c01-c570f5ae6e87" status: 200 len: 1605 microversion: 2.42 time: 0.280189 Oct 04 20:56:11.634367 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2268/4491] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:56:11 2022] GET /compute/v2.1/servers/f8ba4e66-2997-4822-9c01-c570f5ae6e87 => generated 1605 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:56:11.934746 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-183d7544-7ded-4fe9-b2c0-e5e71086b869 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e93855201ca64c779f92a2a33979b81f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed328a1e964d46902dee5e1c7c7b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:56:11.945138 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-183d7544-7ded-4fe9-b2c0-e5e71086b869 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] 10.222.0.33 "GET /compute/v2.1/servers/3b4b8ffa-a834-442c-bdbe-a782eb376d28" status: 200 len: 1506 microversion: 2.1 time: 0.548295 Oct 04 20:56:11.969492 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2224/4492] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:56:11 2022] GET /compute/v2.1/servers/3b4b8ffa-a834-442c-bdbe-a782eb376d28 => generated 1506 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:56:11.974298 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-98f50223-239c-4bc2-88a4-953005f0c3c6 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:56:11.975086 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-98f50223-239c-4bc2-88a4-953005f0c3c6 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] [instance: 3b4b8ffa-a834-442c-bdbe-a782eb376d28] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:56:11.983681 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-98f50223-239c-4bc2-88a4-953005f0c3c6 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:11.995462 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-98f50223-239c-4bc2-88a4-953005f0c3c6 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:11.996052 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-98f50223-239c-4bc2-88a4-953005f0c3c6 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:11.997181 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-98f50223-239c-4bc2-88a4-953005f0c3c6 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:12.002132 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-98f50223-239c-4bc2-88a4-953005f0c3c6 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:12.002746 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-98f50223-239c-4bc2-88a4-953005f0c3c6 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:12.017433 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d150bee7-ca9e-42c1-a647-d74ccf1d4ef2 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:56:12.018363 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d150bee7-ca9e-42c1-a647-d74ccf1d4ef2 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] [instance: e687d91c-29dd-4e32-9ddc-9b358e711870] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:56:12.028327 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d150bee7-ca9e-42c1-a647-d74ccf1d4ef2 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:12.036069 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d150bee7-ca9e-42c1-a647-d74ccf1d4ef2 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:12.036798 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d150bee7-ca9e-42c1-a647-d74ccf1d4ef2 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:12.037785 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d150bee7-ca9e-42c1-a647-d74ccf1d4ef2 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:12.039018 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d150bee7-ca9e-42c1-a647-d74ccf1d4ef2 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:12.039697 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d150bee7-ca9e-42c1-a647-d74ccf1d4ef2 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:12.092074 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-98f50223-239c-4bc2-88a4-953005f0c3c6 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] [instance: 3b4b8ffa-a834-442c-bdbe-a782eb376d28] Going to try to terminate instance {{(pid=128802) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:56:12.137762 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:56:12.262096 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:56:12.297228 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-98f50223-239c-4bc2-88a4-953005f0c3c6 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] 10.222.0.33 "DELETE /compute/v2.1/servers/3b4b8ffa-a834-442c-bdbe-a782eb376d28" status: 204 len: 0 microversion: 2.1 time: 0.325960 Oct 04 20:56:12.300117 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2269/4493] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 20:56:11 2022] DELETE /compute/v2.1/servers/3b4b8ffa-a834-442c-bdbe-a782eb376d28 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:56:12.314862 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-488f07d7-8094-4e23-a16c-8e38ef762bf7 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:56:12.315495 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-488f07d7-8094-4e23-a16c-8e38ef762bf7 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] [instance: 3b4b8ffa-a834-442c-bdbe-a782eb376d28] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:56:12.335861 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-488f07d7-8094-4e23-a16c-8e38ef762bf7 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:12.336532 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-488f07d7-8094-4e23-a16c-8e38ef762bf7 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:12.339150 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-488f07d7-8094-4e23-a16c-8e38ef762bf7 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:12.341201 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-488f07d7-8094-4e23-a16c-8e38ef762bf7 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:12.341722 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-488f07d7-8094-4e23-a16c-8e38ef762bf7 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:12.342206 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-488f07d7-8094-4e23-a16c-8e38ef762bf7 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:12.399670 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-488f07d7-8094-4e23-a16c-8e38ef762bf7 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] [instance: 3b4b8ffa-a834-442c-bdbe-a782eb376d28] Going to try to terminate instance {{(pid=128802) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:56:12.449436 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.compute.api [None req-488f07d7-8094-4e23-a16c-8e38ef762bf7 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] [instance: 3b4b8ffa-a834-442c-bdbe-a782eb376d28] Instance is already in deleting state, ignoring this request Oct 04 20:56:12.450291 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-488f07d7-8094-4e23-a16c-8e38ef762bf7 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] 10.222.0.33 "DELETE /compute/v2.1/servers/3b4b8ffa-a834-442c-bdbe-a782eb376d28" status: 204 len: 0 microversion: 2.1 time: 0.146495 Oct 04 20:56:12.451606 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2270/4494] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 20:56:12 2022] DELETE /compute/v2.1/servers/3b4b8ffa-a834-442c-bdbe-a782eb376d28 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:56:12.456883 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-2827b3ad-ea71-41ad-9ff5-8e5712d24810 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:56:12.457503 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-2827b3ad-ea71-41ad-9ff5-8e5712d24810 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] [instance: 913a7627-5c81-4c33-858b-35ac9adeb4da] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:56:12.466750 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2827b3ad-ea71-41ad-9ff5-8e5712d24810 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:12.467274 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2827b3ad-ea71-41ad-9ff5-8e5712d24810 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:12.467740 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2827b3ad-ea71-41ad-9ff5-8e5712d24810 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:12.468463 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2827b3ad-ea71-41ad-9ff5-8e5712d24810 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:12.468924 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2827b3ad-ea71-41ad-9ff5-8e5712d24810 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:12.469354 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2827b3ad-ea71-41ad-9ff5-8e5712d24810 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:12.565025 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d150bee7-ca9e-42c1-a647-d74ccf1d4ef2 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9061ddee3d48528f5849b2cc6a1d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7df9bc3521c479d9c16d3516b014cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:56:12.574695 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d150bee7-ca9e-42c1-a647-d74ccf1d4ef2 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] 10.222.0.33 "GET /compute/v2.1/servers/e687d91c-29dd-4e32-9ddc-9b358e711870" status: 200 len: 1317 microversion: 2.1 time: 0.561156 Oct 04 20:56:12.575289 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2225/4495] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:56:12 2022] GET /compute/v2.1/servers/e687d91c-29dd-4e32-9ddc-9b358e711870 => generated 1317 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:56:12.601010 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-038aebd8-be79-4ea1-8ce3-21307c148978 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:56:12.601640 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-038aebd8-be79-4ea1-8ce3-21307c148978 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] [instance: 3b4b8ffa-a834-442c-bdbe-a782eb376d28] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:56:12.627436 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-038aebd8-be79-4ea1-8ce3-21307c148978 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:12.628309 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-038aebd8-be79-4ea1-8ce3-21307c148978 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:12.633037 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-038aebd8-be79-4ea1-8ce3-21307c148978 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:12.634114 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-038aebd8-be79-4ea1-8ce3-21307c148978 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:12.634784 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-038aebd8-be79-4ea1-8ce3-21307c148978 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:12.635821 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-038aebd8-be79-4ea1-8ce3-21307c148978 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:12.701839 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-2827b3ad-ea71-41ad-9ff5-8e5712d24810 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2021a91a331491c96e79808bf8c32ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27d0f72dc5f404e969e7fcc9cb99d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:56:12.732352 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-2827b3ad-ea71-41ad-9ff5-8e5712d24810 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2021a91a331491c96e79808bf8c32ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27d0f72dc5f404e969e7fcc9cb99d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:56:12.735206 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-2827b3ad-ea71-41ad-9ff5-8e5712d24810 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2021a91a331491c96e79808bf8c32ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27d0f72dc5f404e969e7fcc9cb99d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:56:12.736542 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-2827b3ad-ea71-41ad-9ff5-8e5712d24810 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] 10.222.0.33 "GET /compute/v2.1/servers/913a7627-5c81-4c33-858b-35ac9adeb4da" status: 200 len: 1366 microversion: 2.57 time: 0.283845 Oct 04 20:56:12.737350 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2271/4496] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:56:12 2022] GET /compute/v2.1/servers/913a7627-5c81-4c33-858b-35ac9adeb4da => generated 1366 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:56:12.764313 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-a1c1a79a-ee82-4286-ac66-3115058cb954 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:56:12.764941 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-a1c1a79a-ee82-4286-ac66-3115058cb954 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] [instance: f8ba4e66-2997-4822-9c01-c570f5ae6e87] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:56:12.774775 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a1c1a79a-ee82-4286-ac66-3115058cb954 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:12.775278 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a1c1a79a-ee82-4286-ac66-3115058cb954 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:12.775724 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a1c1a79a-ee82-4286-ac66-3115058cb954 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:12.776647 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a1c1a79a-ee82-4286-ac66-3115058cb954 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:12.777114 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a1c1a79a-ee82-4286-ac66-3115058cb954 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:12.777569 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a1c1a79a-ee82-4286-ac66-3115058cb954 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:12.987944 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-a1c1a79a-ee82-4286-ac66-3115058cb954 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b78af5c0485b4343900269160ef3e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659f3d4023b347d58bc0361db9ceead9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:56:13.017183 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-a1c1a79a-ee82-4286-ac66-3115058cb954 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b78af5c0485b4343900269160ef3e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659f3d4023b347d58bc0361db9ceead9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:56:13.027040 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-a1c1a79a-ee82-4286-ac66-3115058cb954 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b78af5c0485b4343900269160ef3e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659f3d4023b347d58bc0361db9ceead9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:56:13.028739 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-a1c1a79a-ee82-4286-ac66-3115058cb954 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] 10.222.0.33 "GET /compute/v2.1/servers/f8ba4e66-2997-4822-9c01-c570f5ae6e87" status: 200 len: 1605 microversion: 2.42 time: 0.275639 Oct 04 20:56:13.029922 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2272/4497] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:56:12 2022] GET /compute/v2.1/servers/f8ba4e66-2997-4822-9c01-c570f5ae6e87 => generated 1605 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:56:13.202081 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-038aebd8-be79-4ea1-8ce3-21307c148978 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e93855201ca64c779f92a2a33979b81f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed328a1e964d46902dee5e1c7c7b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:56:13.212466 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-038aebd8-be79-4ea1-8ce3-21307c148978 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] 10.222.0.33 "GET /compute/v2.1/servers/3b4b8ffa-a834-442c-bdbe-a782eb376d28" status: 200 len: 1512 microversion: 2.1 time: 0.616087 Oct 04 20:56:13.214872 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2226/4498] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:56:12 2022] GET /compute/v2.1/servers/3b4b8ffa-a834-442c-bdbe-a782eb376d28 => generated 1512 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:56:13.604280 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-b3863735-97cd-4401-86eb-ac4396b57e01 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:56:13.604987 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-b3863735-97cd-4401-86eb-ac4396b57e01 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] [instance: e687d91c-29dd-4e32-9ddc-9b358e711870] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:56:13.628434 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b3863735-97cd-4401-86eb-ac4396b57e01 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:13.628857 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b3863735-97cd-4401-86eb-ac4396b57e01 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:13.629297 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b3863735-97cd-4401-86eb-ac4396b57e01 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:13.636938 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b3863735-97cd-4401-86eb-ac4396b57e01 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:13.637576 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b3863735-97cd-4401-86eb-ac4396b57e01 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:13.638035 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b3863735-97cd-4401-86eb-ac4396b57e01 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:13.767798 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2188f9b8-ebcd-422c-b1aa-281fd74ba3cf tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:56:13.768436 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-2188f9b8-ebcd-422c-b1aa-281fd74ba3cf tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] [instance: 913a7627-5c81-4c33-858b-35ac9adeb4da] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:56:13.782205 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2188f9b8-ebcd-422c-b1aa-281fd74ba3cf tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:13.785432 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2188f9b8-ebcd-422c-b1aa-281fd74ba3cf tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:13.785941 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2188f9b8-ebcd-422c-b1aa-281fd74ba3cf tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:13.786864 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2188f9b8-ebcd-422c-b1aa-281fd74ba3cf tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:13.789002 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2188f9b8-ebcd-422c-b1aa-281fd74ba3cf tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:13.789648 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2188f9b8-ebcd-422c-b1aa-281fd74ba3cf tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:14.034189 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-2188f9b8-ebcd-422c-b1aa-281fd74ba3cf tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2021a91a331491c96e79808bf8c32ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27d0f72dc5f404e969e7fcc9cb99d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:56:14.050274 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-2188f9b8-ebcd-422c-b1aa-281fd74ba3cf tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2021a91a331491c96e79808bf8c32ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27d0f72dc5f404e969e7fcc9cb99d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:56:14.051866 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-2188f9b8-ebcd-422c-b1aa-281fd74ba3cf tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2021a91a331491c96e79808bf8c32ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27d0f72dc5f404e969e7fcc9cb99d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:56:14.053073 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-2188f9b8-ebcd-422c-b1aa-281fd74ba3cf tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] 10.222.0.33 "GET /compute/v2.1/servers/913a7627-5c81-4c33-858b-35ac9adeb4da" status: 200 len: 1366 microversion: 2.57 time: 0.290669 Oct 04 20:56:14.076499 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2227/4499] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:56:13 2022] GET /compute/v2.1/servers/913a7627-5c81-4c33-858b-35ac9adeb4da => generated 1366 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:56:14.082479 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-31829a25-11d5-4df8-a90a-a93b5c57772f req-192a9734-93b6-4ab6-bc6a-5a89c14a5665 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e687d91c-29dd-4e32-9ddc-9b358e711870", "name": "network-vif-plugged", "status": "completed", "tag": "c5b1c37e-84b1-4ccc-a345-24049ee9ef3f"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:56:14.110519 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-31829a25-11d5-4df8-a90a-a93b5c57772f req-192a9734-93b6-4ab6-bc6a-5a89c14a5665 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:14.111240 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-31829a25-11d5-4df8-a90a-a93b5c57772f req-192a9734-93b6-4ab6-bc6a-5a89c14a5665 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:14.111869 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-31829a25-11d5-4df8-a90a-a93b5c57772f req-192a9734-93b6-4ab6-bc6a-5a89c14a5665 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:14.129295 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-31829a25-11d5-4df8-a90a-a93b5c57772f req-192a9734-93b6-4ab6-bc6a-5a89c14a5665 service nova] Creating event network-vif-plugged:c5b1c37e-84b1-4ccc-a345-24049ee9ef3f for instance e687d91c-29dd-4e32-9ddc-9b358e711870 on n-h2-854823-8 Oct 04 20:56:14.136580 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-31829a25-11d5-4df8-a90a-a93b5c57772f req-192a9734-93b6-4ab6-bc6a-5a89c14a5665 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057533 Oct 04 20:56:14.137880 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2228/4500] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:56:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:56:14.143657 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-44d349b6-6f65-4314-99dd-898b0adc6fac tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:56:14.144616 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-44d349b6-6f65-4314-99dd-898b0adc6fac tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] [instance: f8ba4e66-2997-4822-9c01-c570f5ae6e87] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:56:14.152835 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-44d349b6-6f65-4314-99dd-898b0adc6fac tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:14.153599 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-44d349b6-6f65-4314-99dd-898b0adc6fac tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:14.154203 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-44d349b6-6f65-4314-99dd-898b0adc6fac tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:14.155844 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-44d349b6-6f65-4314-99dd-898b0adc6fac tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:14.156475 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-44d349b6-6f65-4314-99dd-898b0adc6fac tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:14.157067 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-44d349b6-6f65-4314-99dd-898b0adc6fac tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:14.175674 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-b3863735-97cd-4401-86eb-ac4396b57e01 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9061ddee3d48528f5849b2cc6a1d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7df9bc3521c479d9c16d3516b014cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:56:14.203562 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-b3863735-97cd-4401-86eb-ac4396b57e01 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] 10.222.0.33 "GET /compute/v2.1/servers/e687d91c-29dd-4e32-9ddc-9b358e711870" status: 200 len: 1317 microversion: 2.1 time: 0.604947 Oct 04 20:56:14.204435 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2273/4501] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:56:13 2022] GET /compute/v2.1/servers/e687d91c-29dd-4e32-9ddc-9b358e711870 => generated 1317 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:56:14.240799 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-b060778e-49e8-4b0f-8537-f4089b069315 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:56:14.243991 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-b060778e-49e8-4b0f-8537-f4089b069315 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] [instance: 3b4b8ffa-a834-442c-bdbe-a782eb376d28] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:56:14.262734 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b060778e-49e8-4b0f-8537-f4089b069315 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:14.264352 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b060778e-49e8-4b0f-8537-f4089b069315 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:14.266459 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b060778e-49e8-4b0f-8537-f4089b069315 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:14.267483 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b060778e-49e8-4b0f-8537-f4089b069315 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:14.270471 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b060778e-49e8-4b0f-8537-f4089b069315 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:14.271597 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b060778e-49e8-4b0f-8537-f4089b069315 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:14.853367 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-44d349b6-6f65-4314-99dd-898b0adc6fac tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b78af5c0485b4343900269160ef3e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659f3d4023b347d58bc0361db9ceead9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:56:14.864991 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-44d349b6-6f65-4314-99dd-898b0adc6fac tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b78af5c0485b4343900269160ef3e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659f3d4023b347d58bc0361db9ceead9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:56:14.875424 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-44d349b6-6f65-4314-99dd-898b0adc6fac tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b78af5c0485b4343900269160ef3e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659f3d4023b347d58bc0361db9ceead9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:56:14.876684 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-44d349b6-6f65-4314-99dd-898b0adc6fac tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] 10.222.0.33 "GET /compute/v2.1/servers/f8ba4e66-2997-4822-9c01-c570f5ae6e87" status: 200 len: 1605 microversion: 2.42 time: 0.737184 Oct 04 20:56:14.877261 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2229/4502] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:56:14 2022] GET /compute/v2.1/servers/f8ba4e66-2997-4822-9c01-c570f5ae6e87 => generated 1605 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:56:15.087169 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e82cc8b9-784a-413b-86f3-b4a90fb4761e tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:56:15.088066 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e82cc8b9-784a-413b-86f3-b4a90fb4761e tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] [instance: 913a7627-5c81-4c33-858b-35ac9adeb4da] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:56:15.094922 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e82cc8b9-784a-413b-86f3-b4a90fb4761e tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:15.095819 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e82cc8b9-784a-413b-86f3-b4a90fb4761e tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:15.099796 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e82cc8b9-784a-413b-86f3-b4a90fb4761e tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:15.101406 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e82cc8b9-784a-413b-86f3-b4a90fb4761e tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:15.102143 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e82cc8b9-784a-413b-86f3-b4a90fb4761e tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:15.102772 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e82cc8b9-784a-413b-86f3-b4a90fb4761e tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:15.359371 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e82cc8b9-784a-413b-86f3-b4a90fb4761e tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2021a91a331491c96e79808bf8c32ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27d0f72dc5f404e969e7fcc9cb99d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:56:15.387050 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-b060778e-49e8-4b0f-8537-f4089b069315 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e93855201ca64c779f92a2a33979b81f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed328a1e964d46902dee5e1c7c7b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:56:15.395677 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e82cc8b9-784a-413b-86f3-b4a90fb4761e tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2021a91a331491c96e79808bf8c32ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27d0f72dc5f404e969e7fcc9cb99d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:56:15.401298 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-b060778e-49e8-4b0f-8537-f4089b069315 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] 10.222.0.33 "GET /compute/v2.1/servers/3b4b8ffa-a834-442c-bdbe-a782eb376d28" status: 200 len: 1512 microversion: 2.1 time: 1.164344 Oct 04 20:56:15.402559 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e82cc8b9-784a-413b-86f3-b4a90fb4761e tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2021a91a331491c96e79808bf8c32ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27d0f72dc5f404e969e7fcc9cb99d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:56:15.406240 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e82cc8b9-784a-413b-86f3-b4a90fb4761e tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] 10.222.0.33 "GET /compute/v2.1/servers/913a7627-5c81-4c33-858b-35ac9adeb4da" status: 200 len: 1366 microversion: 2.57 time: 0.326317 Oct 04 20:56:15.407001 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2274/4503] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:56:14 2022] GET /compute/v2.1/servers/3b4b8ffa-a834-442c-bdbe-a782eb376d28 => generated 1512 bytes in 1171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:56:15.413658 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2230/4504] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:56:15 2022] GET /compute/v2.1/servers/913a7627-5c81-4c33-858b-35ac9adeb4da => generated 1366 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:56:15.423683 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-046c26e7-688e-48b1-8ca8-77a4b97b5ce2 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:56:15.424842 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-046c26e7-688e-48b1-8ca8-77a4b97b5ce2 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] [instance: e687d91c-29dd-4e32-9ddc-9b358e711870] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:56:15.445777 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-046c26e7-688e-48b1-8ca8-77a4b97b5ce2 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:15.448206 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-046c26e7-688e-48b1-8ca8-77a4b97b5ce2 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:15.456422 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-046c26e7-688e-48b1-8ca8-77a4b97b5ce2 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:15.457751 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-046c26e7-688e-48b1-8ca8-77a4b97b5ce2 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:15.460753 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-046c26e7-688e-48b1-8ca8-77a4b97b5ce2 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:15.461525 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-046c26e7-688e-48b1-8ca8-77a4b97b5ce2 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:15.909038 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a5d01fd2-bbc1-49a2-95fa-88e541662c03 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:56:15.909785 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a5d01fd2-bbc1-49a2-95fa-88e541662c03 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] [instance: f8ba4e66-2997-4822-9c01-c570f5ae6e87] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:56:15.924435 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a5d01fd2-bbc1-49a2-95fa-88e541662c03 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:15.925988 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a5d01fd2-bbc1-49a2-95fa-88e541662c03 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:15.929822 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a5d01fd2-bbc1-49a2-95fa-88e541662c03 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:15.930747 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a5d01fd2-bbc1-49a2-95fa-88e541662c03 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:15.931295 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a5d01fd2-bbc1-49a2-95fa-88e541662c03 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:15.931806 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a5d01fd2-bbc1-49a2-95fa-88e541662c03 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:16.027772 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-046c26e7-688e-48b1-8ca8-77a4b97b5ce2 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9061ddee3d48528f5849b2cc6a1d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7df9bc3521c479d9c16d3516b014cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:56:16.040753 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-046c26e7-688e-48b1-8ca8-77a4b97b5ce2 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] 10.222.0.33 "GET /compute/v2.1/servers/e687d91c-29dd-4e32-9ddc-9b358e711870" status: 200 len: 1317 microversion: 2.1 time: 0.631916 Oct 04 20:56:16.042367 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2275/4505] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:56:15 2022] GET /compute/v2.1/servers/e687d91c-29dd-4e32-9ddc-9b358e711870 => generated 1317 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:56:16.131443 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-a5d01fd2-bbc1-49a2-95fa-88e541662c03 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b78af5c0485b4343900269160ef3e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659f3d4023b347d58bc0361db9ceead9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:56:16.148972 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-a5d01fd2-bbc1-49a2-95fa-88e541662c03 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b78af5c0485b4343900269160ef3e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659f3d4023b347d58bc0361db9ceead9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:56:16.150481 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-a5d01fd2-bbc1-49a2-95fa-88e541662c03 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b78af5c0485b4343900269160ef3e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659f3d4023b347d58bc0361db9ceead9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:56:16.151700 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a5d01fd2-bbc1-49a2-95fa-88e541662c03 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] 10.222.0.33 "GET /compute/v2.1/servers/f8ba4e66-2997-4822-9c01-c570f5ae6e87" status: 200 len: 1605 microversion: 2.42 time: 0.247097 Oct 04 20:56:16.155143 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2231/4506] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:56:15 2022] GET /compute/v2.1/servers/f8ba4e66-2997-4822-9c01-c570f5ae6e87 => generated 1605 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 20:56:16.282612 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-addff49a-e420-47e0-ad41-cbe7d9b3399c req-0088a19a-da86-462f-a4b5-3295a326d64a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0304aa72-7abd-40c3-a555-74179786e217", "name": "network-vif-plugged", "status": "completed", "tag": "04839d2e-82f0-4e47-bf67-2d69ea25390b"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:56:16.303882 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-addff49a-e420-47e0-ad41-cbe7d9b3399c req-0088a19a-da86-462f-a4b5-3295a326d64a service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:16.304377 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-addff49a-e420-47e0-ad41-cbe7d9b3399c req-0088a19a-da86-462f-a4b5-3295a326d64a service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:16.309231 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-addff49a-e420-47e0-ad41-cbe7d9b3399c req-0088a19a-da86-462f-a4b5-3295a326d64a service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:16.334265 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-addff49a-e420-47e0-ad41-cbe7d9b3399c req-0088a19a-da86-462f-a4b5-3295a326d64a service nova] Creating event network-vif-plugged:04839d2e-82f0-4e47-bf67-2d69ea25390b for instance 0304aa72-7abd-40c3-a555-74179786e217 on n-h1-854823-8 Oct 04 20:56:16.341040 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-addff49a-e420-47e0-ad41-cbe7d9b3399c req-0088a19a-da86-462f-a4b5-3295a326d64a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063475 Oct 04 20:56:16.351091 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2276/4507] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:56:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:56:16.434981 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-64f942fc-68dd-4658-8759-cddd477fa4f7 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:56:16.435539 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-64f942fc-68dd-4658-8759-cddd477fa4f7 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] [instance: 3b4b8ffa-a834-442c-bdbe-a782eb376d28] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:56:16.443388 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-95ab4986-37a0-4df6-a9a3-748a80db322f tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:56:16.444751 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-95ab4986-37a0-4df6-a9a3-748a80db322f tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] [instance: 913a7627-5c81-4c33-858b-35ac9adeb4da] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:56:16.449517 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-64f942fc-68dd-4658-8759-cddd477fa4f7 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:16.450260 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-64f942fc-68dd-4658-8759-cddd477fa4f7 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:16.450887 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-64f942fc-68dd-4658-8759-cddd477fa4f7 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:16.452048 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-64f942fc-68dd-4658-8759-cddd477fa4f7 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:16.452671 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-64f942fc-68dd-4658-8759-cddd477fa4f7 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:16.453264 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-64f942fc-68dd-4658-8759-cddd477fa4f7 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:16.458084 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-95ab4986-37a0-4df6-a9a3-748a80db322f tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:16.458606 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-95ab4986-37a0-4df6-a9a3-748a80db322f tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:16.459220 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-95ab4986-37a0-4df6-a9a3-748a80db322f tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:16.460665 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-95ab4986-37a0-4df6-a9a3-748a80db322f tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:16.461734 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-95ab4986-37a0-4df6-a9a3-748a80db322f tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:16.462846 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-95ab4986-37a0-4df6-a9a3-748a80db322f tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:16.686017 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-95ab4986-37a0-4df6-a9a3-748a80db322f tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2021a91a331491c96e79808bf8c32ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27d0f72dc5f404e969e7fcc9cb99d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:56:16.689302 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-64f942fc-68dd-4658-8759-cddd477fa4f7 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e93855201ca64c779f92a2a33979b81f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed328a1e964d46902dee5e1c7c7b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:56:16.720959 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-95ab4986-37a0-4df6-a9a3-748a80db322f tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2021a91a331491c96e79808bf8c32ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27d0f72dc5f404e969e7fcc9cb99d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:56:16.722485 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-64f942fc-68dd-4658-8759-cddd477fa4f7 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] 10.222.0.33 "GET /compute/v2.1/servers/3b4b8ffa-a834-442c-bdbe-a782eb376d28" status: 200 len: 1470 microversion: 2.1 time: 0.291384 Oct 04 20:56:16.724202 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-95ab4986-37a0-4df6-a9a3-748a80db322f tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2021a91a331491c96e79808bf8c32ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27d0f72dc5f404e969e7fcc9cb99d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:56:16.737700 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2232/4508] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:56:16 2022] GET /compute/v2.1/servers/3b4b8ffa-a834-442c-bdbe-a782eb376d28 => generated 1470 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:56:16.752671 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-95ab4986-37a0-4df6-a9a3-748a80db322f tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] 10.222.0.33 "GET /compute/v2.1/servers/913a7627-5c81-4c33-858b-35ac9adeb4da" status: 200 len: 1366 microversion: 2.57 time: 0.314073 Oct 04 20:56:16.767918 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2277/4509] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:56:16 2022] GET /compute/v2.1/servers/913a7627-5c81-4c33-858b-35ac9adeb4da => generated 1366 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 20:56:16.822791 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-5d5f458a-4884-4ada-883d-68f10dc64482 req-bb927282-6f39-467c-b7c4-97d16b928971 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b4b8ffa-a834-442c-bdbe-a782eb376d28", "name": "network-vif-deleted", "tag": "e538e2e8-c7fe-44c4-97ff-e5173ea38d94"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:56:16.858796 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-5d5f458a-4884-4ada-883d-68f10dc64482 req-bb927282-6f39-467c-b7c4-97d16b928971 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:16.859578 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-5d5f458a-4884-4ada-883d-68f10dc64482 req-bb927282-6f39-467c-b7c4-97d16b928971 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:16.860132 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-5d5f458a-4884-4ada-883d-68f10dc64482 req-bb927282-6f39-467c-b7c4-97d16b928971 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:16.891457 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-5d5f458a-4884-4ada-883d-68f10dc64482 req-bb927282-6f39-467c-b7c4-97d16b928971 service nova] Creating event network-vif-deleted:e538e2e8-c7fe-44c4-97ff-e5173ea38d94 for instance 3b4b8ffa-a834-442c-bdbe-a782eb376d28 on n-h1-854823-8 Oct 04 20:56:16.906901 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-5d5f458a-4884-4ada-883d-68f10dc64482 req-bb927282-6f39-467c-b7c4-97d16b928971 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088535 Oct 04 20:56:16.908281 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2233/4510] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:56:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:56:17.067206 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-28b6623c-4216-462b-8c48-dd7fc9ea809f tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:56:17.067954 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-28b6623c-4216-462b-8c48-dd7fc9ea809f tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] [instance: e687d91c-29dd-4e32-9ddc-9b358e711870] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:56:17.086196 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-28b6623c-4216-462b-8c48-dd7fc9ea809f tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:17.086876 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-28b6623c-4216-462b-8c48-dd7fc9ea809f tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:17.087422 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-28b6623c-4216-462b-8c48-dd7fc9ea809f tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:17.088252 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-28b6623c-4216-462b-8c48-dd7fc9ea809f tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:17.088821 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-28b6623c-4216-462b-8c48-dd7fc9ea809f tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:17.089360 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-28b6623c-4216-462b-8c48-dd7fc9ea809f tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:17.186324 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-38fa7337-d48f-4bd7-bad0-332dc902cf31 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:56:17.187583 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-38fa7337-d48f-4bd7-bad0-332dc902cf31 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] [instance: f8ba4e66-2997-4822-9c01-c570f5ae6e87] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:56:17.205575 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-38fa7337-d48f-4bd7-bad0-332dc902cf31 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:17.206397 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-38fa7337-d48f-4bd7-bad0-332dc902cf31 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:17.207150 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-38fa7337-d48f-4bd7-bad0-332dc902cf31 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:17.208049 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-38fa7337-d48f-4bd7-bad0-332dc902cf31 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:17.209168 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-38fa7337-d48f-4bd7-bad0-332dc902cf31 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:17.210018 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-38fa7337-d48f-4bd7-bad0-332dc902cf31 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:17.298497 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-38fa7337-d48f-4bd7-bad0-332dc902cf31 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:17.299215 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-38fa7337-d48f-4bd7-bad0-332dc902cf31 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:17.301030 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-38fa7337-d48f-4bd7-bad0-332dc902cf31 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:17.301663 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-38fa7337-d48f-4bd7-bad0-332dc902cf31 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lazy-loading 'fault' on Instance uuid f8ba4e66-2997-4822-9c01-c570f5ae6e87 {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:56:17.474808 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-38fa7337-d48f-4bd7-bad0-332dc902cf31 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b78af5c0485b4343900269160ef3e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659f3d4023b347d58bc0361db9ceead9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:56:17.487486 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-38fa7337-d48f-4bd7-bad0-332dc902cf31 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b78af5c0485b4343900269160ef3e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659f3d4023b347d58bc0361db9ceead9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:56:17.491623 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-38fa7337-d48f-4bd7-bad0-332dc902cf31 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b78af5c0485b4343900269160ef3e508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659f3d4023b347d58bc0361db9ceead9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:56:17.498482 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-38fa7337-d48f-4bd7-bad0-332dc902cf31 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] 10.222.0.33 "GET /compute/v2.1/servers/f8ba4e66-2997-4822-9c01-c570f5ae6e87" status: 200 len: 1610 microversion: 2.42 time: 0.313796 Oct 04 20:56:17.499612 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2234/4511] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:56:17 2022] GET /compute/v2.1/servers/f8ba4e66-2997-4822-9c01-c570f5ae6e87 => generated 1610 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:56:17.708478 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-28b6623c-4216-462b-8c48-dd7fc9ea809f tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9061ddee3d48528f5849b2cc6a1d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7df9bc3521c479d9c16d3516b014cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:56:17.718592 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-28b6623c-4216-462b-8c48-dd7fc9ea809f tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] 10.222.0.33 "GET /compute/v2.1/servers/e687d91c-29dd-4e32-9ddc-9b358e711870" status: 200 len: 1504 microversion: 2.1 time: 0.655331 Oct 04 20:56:17.734380 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2278/4512] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:56:17 2022] GET /compute/v2.1/servers/e687d91c-29dd-4e32-9ddc-9b358e711870 => generated 1504 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:56:17.743688 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-77d05e87-7eed-45d7-851d-c185e35c1821 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:56:17.744476 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-77d05e87-7eed-45d7-851d-c185e35c1821 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] [instance: 0304aa72-7abd-40c3-a555-74179786e217] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:56:17.751308 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-77d05e87-7eed-45d7-851d-c185e35c1821 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:17.751805 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-77d05e87-7eed-45d7-851d-c185e35c1821 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:17.752253 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-77d05e87-7eed-45d7-851d-c185e35c1821 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:17.753132 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-77d05e87-7eed-45d7-851d-c185e35c1821 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:17.753668 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-77d05e87-7eed-45d7-851d-c185e35c1821 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:17.754102 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-77d05e87-7eed-45d7-851d-c185e35c1821 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:17.764999 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-0473a116-df38-4964-9def-fb199eb7e937 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:56:17.765971 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-0473a116-df38-4964-9def-fb199eb7e937 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] [instance: 3b4b8ffa-a834-442c-bdbe-a782eb376d28] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:56:17.773641 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0473a116-df38-4964-9def-fb199eb7e937 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:17.776577 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0473a116-df38-4964-9def-fb199eb7e937 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:17.781375 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0473a116-df38-4964-9def-fb199eb7e937 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:17.782385 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0473a116-df38-4964-9def-fb199eb7e937 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:17.784383 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0473a116-df38-4964-9def-fb199eb7e937 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:17.784997 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0473a116-df38-4964-9def-fb199eb7e937 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:17.844545 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0473a116-df38-4964-9def-fb199eb7e937 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:17.845036 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0473a116-df38-4964-9def-fb199eb7e937 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:17.845695 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0473a116-df38-4964-9def-fb199eb7e937 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:17.846311 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.objects.instance [None req-0473a116-df38-4964-9def-fb199eb7e937 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lazy-loading 'fault' on Instance uuid 3b4b8ffa-a834-442c-bdbe-a782eb376d28 {{(pid=128802) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:56:18.042435 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-0473a116-df38-4964-9def-fb199eb7e937 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e93855201ca64c779f92a2a33979b81f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22ed328a1e964d46902dee5e1c7c7b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:56:18.061623 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-0473a116-df38-4964-9def-fb199eb7e937 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] 10.222.0.33 "GET /compute/v2.1/servers/3b4b8ffa-a834-442c-bdbe-a782eb376d28" status: 200 len: 1307 microversion: 2.1 time: 0.300372 Oct 04 20:56:18.080620 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2279/4513] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:56:17 2022] GET /compute/v2.1/servers/3b4b8ffa-a834-442c-bdbe-a782eb376d28 => generated 1307 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:56:18.086649 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-01312b49-98f2-4e81-86d2-7e429e42c4d9 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:56:18.086954 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-01312b49-98f2-4e81-86d2-7e429e42c4d9 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] [instance: 913a7627-5c81-4c33-858b-35ac9adeb4da] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:56:18.094923 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-01312b49-98f2-4e81-86d2-7e429e42c4d9 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:18.095646 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-01312b49-98f2-4e81-86d2-7e429e42c4d9 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:18.096275 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-01312b49-98f2-4e81-86d2-7e429e42c4d9 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:18.097156 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-01312b49-98f2-4e81-86d2-7e429e42c4d9 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:18.097772 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-01312b49-98f2-4e81-86d2-7e429e42c4d9 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:18.098375 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-01312b49-98f2-4e81-86d2-7e429e42c4d9 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:18.178111 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-77d05e87-7eed-45d7-851d-c185e35c1821 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9061ddee3d48528f5849b2cc6a1d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7df9bc3521c479d9c16d3516b014cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:56:18.188766 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-77d05e87-7eed-45d7-851d-c185e35c1821 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] 10.222.0.33 "GET /compute/v2.1/servers/0304aa72-7abd-40c3-a555-74179786e217" status: 200 len: 1317 microversion: 2.1 time: 0.450517 Oct 04 20:56:18.189711 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2235/4514] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:56:17 2022] GET /compute/v2.1/servers/0304aa72-7abd-40c3-a555-74179786e217 => generated 1317 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:56:18.200915 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-01312b49-98f2-4e81-86d2-7e429e42c4d9 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2021a91a331491c96e79808bf8c32ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27d0f72dc5f404e969e7fcc9cb99d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:56:18.213964 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-01312b49-98f2-4e81-86d2-7e429e42c4d9 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2021a91a331491c96e79808bf8c32ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27d0f72dc5f404e969e7fcc9cb99d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:56:18.217986 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-01312b49-98f2-4e81-86d2-7e429e42c4d9 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2021a91a331491c96e79808bf8c32ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27d0f72dc5f404e969e7fcc9cb99d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:56:18.235813 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-01312b49-98f2-4e81-86d2-7e429e42c4d9 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] 10.222.0.33 "GET /compute/v2.1/servers/913a7627-5c81-4c33-858b-35ac9adeb4da" status: 200 len: 1366 microversion: 2.57 time: 0.153929 Oct 04 20:56:18.236989 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2280/4515] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:56:18 2022] GET /compute/v2.1/servers/913a7627-5c81-4c33-858b-35ac9adeb4da => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:56:18.531433 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1bf78c40-4412-4b8b-8a09-8e1d35c9afca tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:56:18.532053 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-1bf78c40-4412-4b8b-8a09-8e1d35c9afca tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] [instance: f8ba4e66-2997-4822-9c01-c570f5ae6e87] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:56:18.541091 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1bf78c40-4412-4b8b-8a09-8e1d35c9afca tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:18.541892 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1bf78c40-4412-4b8b-8a09-8e1d35c9afca tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:18.542528 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1bf78c40-4412-4b8b-8a09-8e1d35c9afca tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:18.543661 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1bf78c40-4412-4b8b-8a09-8e1d35c9afca tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:18.544314 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1bf78c40-4412-4b8b-8a09-8e1d35c9afca tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:18.545928 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1bf78c40-4412-4b8b-8a09-8e1d35c9afca tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:18.582529 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:56:18.585141 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-1bf78c40-4412-4b8b-8a09-8e1d35c9afca tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] HTTP exception thrown: Instance f8ba4e66-2997-4822-9c01-c570f5ae6e87 could not be found. Oct 04 20:56:18.587361 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1bf78c40-4412-4b8b-8a09-8e1d35c9afca tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Request method failure captured: Oct 04 20:56:18.587361 n-d-854823-8 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/f8ba4e66-2997-4822-9c01-c570f5ae6e87 HTTP/1.1 Oct 04 20:56:18.587361 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:56:18.587361 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:56:18.587361 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:56:18.587361 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 0 Oct 04 20:56:18.587361 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:56:18.587361 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:56:18.587361 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:56:18.587361 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:56:18.587361 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJxSP8kTdA37O7gyFQ7hyZrNgnRnKjxriobn4TLvtmTbjyY9Wrpp-XAh2F8addWN5YMO5RvtTKVmYVGpXJUD_Z0HBX-IaC7vAkvHMa7zrxze2rJyh7NECQ1gxo1Q5z1i-VgUAJ4odWYne6rSup_a4fn3Pw66rcExBKwlFT9CdgnCi-0 Oct 04 20:56:18.587361 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:56:18.587361 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:56:18.587361 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:56:18.587361 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:56:18.587361 n-d-854823-8 devstack@n-api.service[128801]: X-Openstack-Nova-Api-Version: 2.42 Oct 04 20:56:18.587361 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:56:18.587361 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:56:18.587361 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: 659f3d4023b347d58bc0361db9ceead9 Oct 04 20:56:18.587361 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-195875716 Oct 04 20:56:18.587361 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 20:56:18.587361 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 20:56:18.587361 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_659f3d4023b347d58bc0361db9ceead9", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/659f3d4023b347d58bc0361db9ceead9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/659f3d4023b347d58bc0361db9ceead9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/659f3d4023b347d58bc0361db9ceead9"}]}] Oct 04 20:56:18.587361 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-TaggedBootDevicesTest_v242-195875716 Oct 04 20:56:18.587361 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: 659f3d4023b347d58bc0361db9ceead9 Oct 04 20:56:18.587361 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-195875716 Oct 04 20:56:18.587361 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-TaggedBootDevicesTest_v242-195875716-project Oct 04 20:56:18.587361 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:56:18.587361 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:56:18.587361 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: b78af5c0485b4343900269160ef3e508 Oct 04 20:56:18.587361 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-TaggedBootDevicesTest_v242-195875716-project Oct 04 20:56:18.587361 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 20:56:18.587361 n-d-854823-8 devstack@n-api.service[128801]: exception: Instance f8ba4e66-2997-4822-9c01-c570f5ae6e87 could not be found. Oct 04 20:56:18.587361 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': 'f8ba4e66-2997-4822-9c01-c570f5ae6e87'} Oct 04 20:56:18.587361 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:56:18.587361 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:56:18.587361 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:56:18.587361 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:56:18.587361 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:56:18.587361 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:56:18.587361 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:56:18.587361 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:56:18.587361 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:56:18.587361 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:56:18.587361 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f8ba4e66-2997-4822-9c01-c570f5ae6e87 could not be found. Oct 04 20:56:18.587361 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:56:18.587361 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:56:18.587361 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:56:18.587361 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:56:18.587361 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:56:18.587361 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:56:18.587361 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:56:18.587361 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:56:18.587361 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:56:18.587361 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:56:18.587361 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:56:18.587361 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:56:18.587361 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:56:18.587361 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:56:18.587361 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:56:18.587361 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:56:18.587361 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8ba4e66-2997-4822-9c01-c570f5ae6e87 could not be found. Oct 04 20:56:18.587361 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:56:18.587361 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:56:18.592311 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:56:18.592311 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:56:18.592311 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:56:18.592311 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:56:18.592311 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:56:18.592311 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:56:18.592311 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8ba4e66-2997-4822-9c01-c570f5ae6e87 could not be found. Oct 04 20:56:18.592311 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:56:18.595057 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1bf78c40-4412-4b8b-8a09-8e1d35c9afca tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Returning 404 to user: Instance f8ba4e66-2997-4822-9c01-c570f5ae6e87 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:56:18.596061 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-1bf78c40-4412-4b8b-8a09-8e1d35c9afca tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] 10.222.0.33 "GET /compute/v2.1/servers/f8ba4e66-2997-4822-9c01-c570f5ae6e87" status: 404 len: 111 microversion: 2.42 time: 0.069677 Oct 04 20:56:18.607781 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-e795cda4-6096-4382-a3f9-704a520e2648 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Calling method '.version_select at 0x7f3c7416af70>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:56:18.612958 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2236/4516] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:56:18 2022] GET /compute/v2.1/servers/f8ba4e66-2997-4822-9c01-c570f5ae6e87 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 20:56:18.636410 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-e795cda4-6096-4382-a3f9-704a520e2648 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1194998426" status: 204 len: 0 microversion: 2.42 time: 0.033138 Oct 04 20:56:18.641241 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2281/4517] 10.222.0.33 () {60 vars in 1262 bytes} [Tue Oct 4 20:56:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1194998426 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 20:56:18.713009 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1bf78c40-4412-4b8b-8a09-8e1d35c9afca tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:56:18.714033 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-1bf78c40-4412-4b8b-8a09-8e1d35c9afca tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] 10.222.0.33 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001369 Oct 04 20:56:18.714394 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2237/4518] 10.222.0.33 () {56 vars in 886 bytes} [Tue Oct 4 20:56:18 2022] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 04 20:56:19.087361 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-c58db948-c372-4e37-9f60-18b53378a17d tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:56:19.089270 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-c58db948-c372-4e37-9f60-18b53378a17d tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] [instance: 3b4b8ffa-a834-442c-bdbe-a782eb376d28] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:56:19.111856 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c58db948-c372-4e37-9f60-18b53378a17d tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:19.112636 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c58db948-c372-4e37-9f60-18b53378a17d tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:19.119065 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c58db948-c372-4e37-9f60-18b53378a17d tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:19.120362 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c58db948-c372-4e37-9f60-18b53378a17d tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:19.121004 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c58db948-c372-4e37-9f60-18b53378a17d tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:19.121596 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c58db948-c372-4e37-9f60-18b53378a17d tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:19.149898 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.wsgi [None req-c58db948-c372-4e37-9f60-18b53378a17d tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] HTTP exception thrown: Instance 3b4b8ffa-a834-442c-bdbe-a782eb376d28 could not be found. Oct 04 20:56:19.152007 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-c58db948-c372-4e37-9f60-18b53378a17d tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Request method failure captured: Oct 04 20:56:19.152007 n-d-854823-8 devstack@n-api.service[128802]: request: GET /compute/v2.1/servers/3b4b8ffa-a834-442c-bdbe-a782eb376d28 HTTP/1.1 Oct 04 20:56:19.152007 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 20:56:19.152007 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 20:56:19.152007 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 20:56:19.152007 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 0 Oct 04 20:56:19.152007 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 20:56:19.152007 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 20:56:19.152007 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 20:56:19.152007 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 20:56:19.152007 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPJ1QihqoUZ7U5kqpSSDrvxVJZzhndox8WZco1oUKwJKRN3YztTxzpicJDoahImhmRx6vPcagQb6P3w2c8PtY9bM233YpypOz-gn4-PCqv2-YeLgLhvViN-oWRQ7U7iZQ-UlSKWUgLkog8KfQSmardXdVlZ1hhqhlI7iv-xYqzOCdZqg Oct 04 20:56:19.152007 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 20:56:19.152007 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 20:56:19.152007 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 20:56:19.152007 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 20:56:19.152007 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 20:56:19.152007 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 20:56:19.152007 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: 22ed328a1e964d46902dee5e1c7c7b74 Oct 04 20:56:19.152007 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-ServerDiskConfigTestJSON-2135457643 Oct 04 20:56:19.152007 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 20:56:19.152007 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 20:56:19.152007 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_22ed328a1e964d46902dee5e1c7c7b74", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/22ed328a1e964d46902dee5e1c7c7b74"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/22ed328a1e964d46902dee5e1c7c7b74"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/22ed328a1e964d46902dee5e1c7c7b74"}]}] Oct 04 20:56:19.152007 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-ServerDiskConfigTestJSON-2135457643 Oct 04 20:56:19.152007 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: 22ed328a1e964d46902dee5e1c7c7b74 Oct 04 20:56:19.152007 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-2135457643 Oct 04 20:56:19.152007 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-ServerDiskConfigTestJSON-2135457643-project Oct 04 20:56:19.152007 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 20:56:19.152007 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 20:56:19.152007 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: e93855201ca64c779f92a2a33979b81f Oct 04 20:56:19.152007 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-ServerDiskConfigTestJSON-2135457643-project Oct 04 20:56:19.152007 n-d-854823-8 devstack@n-api.service[128802]: method: > Oct 04 20:56:19.152007 n-d-854823-8 devstack@n-api.service[128802]: exception: Instance 3b4b8ffa-a834-442c-bdbe-a782eb376d28 could not be found. Oct 04 20:56:19.152007 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'id': '3b4b8ffa-a834-442c-bdbe-a782eb376d28'} Oct 04 20:56:19.152007 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:56:19.152007 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:56:19.152007 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:56:19.152007 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:56:19.152007 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:56:19.152007 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:56:19.152007 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:56:19.152007 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:56:19.152007 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:56:19.152007 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:56:19.152007 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b4b8ffa-a834-442c-bdbe-a782eb376d28 could not be found. Oct 04 20:56:19.152007 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:56:19.152007 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:56:19.152007 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:56:19.152007 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:56:19.152007 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:56:19.152007 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:56:19.152007 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:56:19.152007 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:56:19.152007 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:56:19.152007 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:56:19.152007 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:56:19.152007 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:56:19.152007 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:56:19.152007 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:56:19.152007 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:56:19.152007 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:56:19.152007 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b4b8ffa-a834-442c-bdbe-a782eb376d28 could not be found. Oct 04 20:56:19.152007 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:56:19.152007 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:56:19.152007 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:56:19.156896 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:56:19.156896 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:56:19.156896 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:56:19.156896 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:56:19.156896 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:56:19.156896 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b4b8ffa-a834-442c-bdbe-a782eb376d28 could not be found. Oct 04 20:56:19.156896 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:56:19.164464 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-c58db948-c372-4e37-9f60-18b53378a17d tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Returning 404 to user: Instance 3b4b8ffa-a834-442c-bdbe-a782eb376d28 could not be found. {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:56:19.165564 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-c58db948-c372-4e37-9f60-18b53378a17d tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] 10.222.0.33 "GET /compute/v2.1/servers/3b4b8ffa-a834-442c-bdbe-a782eb376d28" status: 404 len: 111 microversion: 2.1 time: 0.083870 Oct 04 20:56:19.174596 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-11aeeaaa-efdf-4ea7-a426-480b1dea04f0 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:56:19.175385 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-11aeeaaa-efdf-4ea7-a426-480b1dea04f0 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] [instance: 67656ca4-09a7-4e6b-bf3a-cfcd254e99e4] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:56:19.180833 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2282/4519] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:56:19 2022] GET /compute/v2.1/servers/3b4b8ffa-a834-442c-bdbe-a782eb376d28 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:56:19.186585 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-11aeeaaa-efdf-4ea7-a426-480b1dea04f0 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:19.187306 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-11aeeaaa-efdf-4ea7-a426-480b1dea04f0 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:19.187909 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-11aeeaaa-efdf-4ea7-a426-480b1dea04f0 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:19.188867 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-11aeeaaa-efdf-4ea7-a426-480b1dea04f0 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:19.189953 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-11aeeaaa-efdf-4ea7-a426-480b1dea04f0 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:19.190638 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-11aeeaaa-efdf-4ea7-a426-480b1dea04f0 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:19.207787 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-11aeeaaa-efdf-4ea7-a426-480b1dea04f0 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] HTTP exception thrown: Instance 67656ca4-09a7-4e6b-bf3a-cfcd254e99e4 could not be found. Oct 04 20:56:19.216446 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-2a9b9f4f-893e-403e-ab91-f2d5382c5ee0 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:56:19.217247 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-2a9b9f4f-893e-403e-ab91-f2d5382c5ee0 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] [instance: 0304aa72-7abd-40c3-a555-74179786e217] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:56:19.222918 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-11aeeaaa-efdf-4ea7-a426-480b1dea04f0 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Request method failure captured: Oct 04 20:56:19.222918 n-d-854823-8 devstack@n-api.service[128801]: request: DELETE /compute/v2.1/servers/67656ca4-09a7-4e6b-bf3a-cfcd254e99e4 HTTP/1.1 Oct 04 20:56:19.222918 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:56:19.222918 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:56:19.222918 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:56:19.222918 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 0 Oct 04 20:56:19.222918 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:56:19.222918 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:56:19.222918 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:56:19.222918 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:56:19.222918 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJ1QihqoUZ7U5kqpSSDrvxVJZzhndox8WZco1oUKwJKRN3YztTxzpicJDoahImhmRx6vPcagQb6P3w2c8PtY9bM233YpypOz-gn4-PCqv2-YeLgLhvViN-oWRQ7U7iZQ-UlSKWUgLkog8KfQSmardXdVlZ1hhqhlI7iv-xYqzOCdZqg Oct 04 20:56:19.222918 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:56:19.222918 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:56:19.222918 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:56:19.222918 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:56:19.222918 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:56:19.222918 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:56:19.222918 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: 22ed328a1e964d46902dee5e1c7c7b74 Oct 04 20:56:19.222918 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-ServerDiskConfigTestJSON-2135457643 Oct 04 20:56:19.222918 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 20:56:19.222918 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 20:56:19.222918 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_22ed328a1e964d46902dee5e1c7c7b74", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/22ed328a1e964d46902dee5e1c7c7b74"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/22ed328a1e964d46902dee5e1c7c7b74"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/22ed328a1e964d46902dee5e1c7c7b74"}]}] Oct 04 20:56:19.222918 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-ServerDiskConfigTestJSON-2135457643 Oct 04 20:56:19.222918 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: 22ed328a1e964d46902dee5e1c7c7b74 Oct 04 20:56:19.222918 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-2135457643 Oct 04 20:56:19.222918 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-ServerDiskConfigTestJSON-2135457643-project Oct 04 20:56:19.222918 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:56:19.222918 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:56:19.222918 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: e93855201ca64c779f92a2a33979b81f Oct 04 20:56:19.222918 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-ServerDiskConfigTestJSON-2135457643-project Oct 04 20:56:19.222918 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 20:56:19.222918 n-d-854823-8 devstack@n-api.service[128801]: exception: Instance 67656ca4-09a7-4e6b-bf3a-cfcd254e99e4 could not be found. Oct 04 20:56:19.222918 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': '67656ca4-09a7-4e6b-bf3a-cfcd254e99e4'} Oct 04 20:56:19.222918 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:56:19.222918 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:56:19.222918 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:56:19.222918 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:56:19.222918 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:56:19.222918 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:56:19.222918 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:56:19.222918 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:56:19.222918 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:56:19.222918 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:56:19.222918 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 67656ca4-09a7-4e6b-bf3a-cfcd254e99e4 could not be found. Oct 04 20:56:19.222918 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:56:19.222918 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:56:19.222918 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:56:19.222918 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:56:19.222918 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:56:19.222918 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:56:19.222918 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:56:19.222918 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:56:19.222918 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:56:19.222918 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:56:19.222918 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 20:56:19.222918 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 20:56:19.222918 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 20:56:19.222918 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 20:56:19.222918 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:56:19.222918 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:56:19.222918 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:56:19.222918 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:56:19.227662 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 67656ca4-09a7-4e6b-bf3a-cfcd254e99e4 could not be found. Oct 04 20:56:19.227662 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:56:19.227662 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:56:19.227662 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:56:19.227662 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:56:19.227662 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:56:19.227662 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:56:19.227662 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:56:19.227662 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:56:19.227662 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 67656ca4-09a7-4e6b-bf3a-cfcd254e99e4 could not be found. Oct 04 20:56:19.227662 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:56:19.227662 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-11aeeaaa-efdf-4ea7-a426-480b1dea04f0 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Returning 404 to user: Instance 67656ca4-09a7-4e6b-bf3a-cfcd254e99e4 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:56:19.227662 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-11aeeaaa-efdf-4ea7-a426-480b1dea04f0 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] 10.222.0.33 "DELETE /compute/v2.1/servers/67656ca4-09a7-4e6b-bf3a-cfcd254e99e4" status: 404 len: 111 microversion: 2.1 time: 0.054015 Oct 04 20:56:19.230044 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2a9b9f4f-893e-403e-ab91-f2d5382c5ee0 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:19.230595 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2a9b9f4f-893e-403e-ab91-f2d5382c5ee0 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:19.231036 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2a9b9f4f-893e-403e-ab91-f2d5382c5ee0 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:19.231762 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2a9b9f4f-893e-403e-ab91-f2d5382c5ee0 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:19.232220 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2a9b9f4f-893e-403e-ab91-f2d5382c5ee0 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:19.232645 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2a9b9f4f-893e-403e-ab91-f2d5382c5ee0 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:19.233183 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2238/4520] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 20:56:19 2022] DELETE /compute/v2.1/servers/67656ca4-09a7-4e6b-bf3a-cfcd254e99e4 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:56:19.238321 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-26afef07-c01c-4b26-8c7e-175a2a45825c tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:56:19.244687 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-26afef07-c01c-4b26-8c7e-175a2a45825c tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] [instance: 67656ca4-09a7-4e6b-bf3a-cfcd254e99e4] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:56:19.258783 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-26afef07-c01c-4b26-8c7e-175a2a45825c tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:19.259504 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-26afef07-c01c-4b26-8c7e-175a2a45825c tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:19.260117 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-26afef07-c01c-4b26-8c7e-175a2a45825c tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:19.261022 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-26afef07-c01c-4b26-8c7e-175a2a45825c tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:19.261486 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-26afef07-c01c-4b26-8c7e-175a2a45825c tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:19.261925 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-26afef07-c01c-4b26-8c7e-175a2a45825c tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:19.300786 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-26afef07-c01c-4b26-8c7e-175a2a45825c tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] HTTP exception thrown: Instance 67656ca4-09a7-4e6b-bf3a-cfcd254e99e4 could not be found. Oct 04 20:56:19.302398 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-26afef07-c01c-4b26-8c7e-175a2a45825c tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Request method failure captured: Oct 04 20:56:19.302398 n-d-854823-8 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/67656ca4-09a7-4e6b-bf3a-cfcd254e99e4 HTTP/1.1 Oct 04 20:56:19.302398 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:56:19.302398 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:56:19.302398 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:56:19.302398 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 0 Oct 04 20:56:19.302398 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:56:19.302398 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:56:19.302398 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:56:19.302398 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:56:19.302398 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJ1QihqoUZ7U5kqpSSDrvxVJZzhndox8WZco1oUKwJKRN3YztTxzpicJDoahImhmRx6vPcagQb6P3w2c8PtY9bM233YpypOz-gn4-PCqv2-YeLgLhvViN-oWRQ7U7iZQ-UlSKWUgLkog8KfQSmardXdVlZ1hhqhlI7iv-xYqzOCdZqg Oct 04 20:56:19.302398 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:56:19.302398 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:56:19.302398 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:56:19.302398 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:56:19.302398 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:56:19.302398 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:56:19.302398 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: 22ed328a1e964d46902dee5e1c7c7b74 Oct 04 20:56:19.302398 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-ServerDiskConfigTestJSON-2135457643 Oct 04 20:56:19.302398 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 20:56:19.302398 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 20:56:19.302398 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_22ed328a1e964d46902dee5e1c7c7b74", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/22ed328a1e964d46902dee5e1c7c7b74"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/22ed328a1e964d46902dee5e1c7c7b74"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/22ed328a1e964d46902dee5e1c7c7b74"}]}] Oct 04 20:56:19.302398 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-ServerDiskConfigTestJSON-2135457643 Oct 04 20:56:19.302398 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: 22ed328a1e964d46902dee5e1c7c7b74 Oct 04 20:56:19.302398 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-2135457643 Oct 04 20:56:19.302398 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-ServerDiskConfigTestJSON-2135457643-project Oct 04 20:56:19.302398 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:56:19.302398 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:56:19.302398 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: e93855201ca64c779f92a2a33979b81f Oct 04 20:56:19.302398 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-ServerDiskConfigTestJSON-2135457643-project Oct 04 20:56:19.302398 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 20:56:19.302398 n-d-854823-8 devstack@n-api.service[128801]: exception: Instance 67656ca4-09a7-4e6b-bf3a-cfcd254e99e4 could not be found. Oct 04 20:56:19.302398 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': '67656ca4-09a7-4e6b-bf3a-cfcd254e99e4'} Oct 04 20:56:19.302398 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:56:19.302398 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:56:19.302398 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:56:19.302398 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:56:19.302398 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:56:19.302398 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:56:19.302398 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:56:19.302398 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:56:19.302398 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:56:19.302398 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:56:19.302398 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 67656ca4-09a7-4e6b-bf3a-cfcd254e99e4 could not be found. Oct 04 20:56:19.302398 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:56:19.302398 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:56:19.302398 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:56:19.302398 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:56:19.302398 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:56:19.302398 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:56:19.302398 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:56:19.302398 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:56:19.302398 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:56:19.302398 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:56:19.302398 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:56:19.302398 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:56:19.302398 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:56:19.302398 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:56:19.302398 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:56:19.302398 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:56:19.302398 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 67656ca4-09a7-4e6b-bf3a-cfcd254e99e4 could not be found. Oct 04 20:56:19.302398 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:56:19.302398 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:56:19.302398 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:56:19.306316 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:56:19.306316 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:56:19.306316 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:56:19.306316 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:56:19.306316 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:56:19.306316 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 67656ca4-09a7-4e6b-bf3a-cfcd254e99e4 could not be found. Oct 04 20:56:19.306316 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:56:19.310226 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-26afef07-c01c-4b26-8c7e-175a2a45825c tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Returning 404 to user: Instance 67656ca4-09a7-4e6b-bf3a-cfcd254e99e4 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:56:19.311173 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-26afef07-c01c-4b26-8c7e-175a2a45825c tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] 10.222.0.33 "GET /compute/v2.1/servers/67656ca4-09a7-4e6b-bf3a-cfcd254e99e4" status: 404 len: 111 microversion: 2.1 time: 0.076800 Oct 04 20:56:19.312109 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2239/4521] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:56:19 2022] GET /compute/v2.1/servers/67656ca4-09a7-4e6b-bf3a-cfcd254e99e4 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:56:19.320263 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6d0d375e-c329-40f7-8f45-70aa8af7c335 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:56:19.321187 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-6d0d375e-c329-40f7-8f45-70aa8af7c335 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] [instance: 913a7627-5c81-4c33-858b-35ac9adeb4da] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:56:19.327843 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6d0d375e-c329-40f7-8f45-70aa8af7c335 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:19.328340 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6d0d375e-c329-40f7-8f45-70aa8af7c335 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:19.328772 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6d0d375e-c329-40f7-8f45-70aa8af7c335 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:19.330043 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6d0d375e-c329-40f7-8f45-70aa8af7c335 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:19.330901 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6d0d375e-c329-40f7-8f45-70aa8af7c335 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:19.331410 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6d0d375e-c329-40f7-8f45-70aa8af7c335 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:19.790878 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-6d0d375e-c329-40f7-8f45-70aa8af7c335 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2021a91a331491c96e79808bf8c32ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27d0f72dc5f404e969e7fcc9cb99d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:56:19.799960 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-6d0d375e-c329-40f7-8f45-70aa8af7c335 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2021a91a331491c96e79808bf8c32ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27d0f72dc5f404e969e7fcc9cb99d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:56:19.801759 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-6d0d375e-c329-40f7-8f45-70aa8af7c335 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2021a91a331491c96e79808bf8c32ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27d0f72dc5f404e969e7fcc9cb99d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:56:19.803225 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-6d0d375e-c329-40f7-8f45-70aa8af7c335 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] 10.222.0.33 "GET /compute/v2.1/servers/913a7627-5c81-4c33-858b-35ac9adeb4da" status: 200 len: 1366 microversion: 2.57 time: 0.486928 Oct 04 20:56:19.820777 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2240/4522] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:56:19 2022] GET /compute/v2.1/servers/913a7627-5c81-4c33-858b-35ac9adeb4da => generated 1366 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:56:19.833056 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2752f116-bde9-4ff4-9e8b-43d26db63b54 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:56:19.833895 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-2752f116-bde9-4ff4-9e8b-43d26db63b54 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] [instance: 01fd3eb8-b195-4b9c-8d52-752e50be6f30] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:56:19.842566 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2752f116-bde9-4ff4-9e8b-43d26db63b54 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:19.844132 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2752f116-bde9-4ff4-9e8b-43d26db63b54 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:19.845274 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2752f116-bde9-4ff4-9e8b-43d26db63b54 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:19.846335 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2752f116-bde9-4ff4-9e8b-43d26db63b54 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:19.847040 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2752f116-bde9-4ff4-9e8b-43d26db63b54 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:19.848124 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2752f116-bde9-4ff4-9e8b-43d26db63b54 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:19.868782 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-2752f116-bde9-4ff4-9e8b-43d26db63b54 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] HTTP exception thrown: Instance 01fd3eb8-b195-4b9c-8d52-752e50be6f30 could not be found. Oct 04 20:56:19.872038 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2752f116-bde9-4ff4-9e8b-43d26db63b54 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Request method failure captured: Oct 04 20:56:19.872038 n-d-854823-8 devstack@n-api.service[128801]: request: DELETE /compute/v2.1/servers/01fd3eb8-b195-4b9c-8d52-752e50be6f30 HTTP/1.1 Oct 04 20:56:19.872038 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:56:19.872038 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:56:19.872038 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:56:19.872038 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 0 Oct 04 20:56:19.872038 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:56:19.872038 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:56:19.872038 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:56:19.872038 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:56:19.872038 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJ1QihqoUZ7U5kqpSSDrvxVJZzhndox8WZco1oUKwJKRN3YztTxzpicJDoahImhmRx6vPcagQb6P3w2c8PtY9bM233YpypOz-gn4-PCqv2-YeLgLhvViN-oWRQ7U7iZQ-UlSKWUgLkog8KfQSmardXdVlZ1hhqhlI7iv-xYqzOCdZqg Oct 04 20:56:19.872038 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:56:19.872038 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:56:19.872038 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:56:19.872038 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:56:19.872038 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:56:19.872038 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:56:19.872038 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: 22ed328a1e964d46902dee5e1c7c7b74 Oct 04 20:56:19.872038 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-ServerDiskConfigTestJSON-2135457643 Oct 04 20:56:19.872038 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 20:56:19.872038 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 20:56:19.872038 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_22ed328a1e964d46902dee5e1c7c7b74", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/22ed328a1e964d46902dee5e1c7c7b74"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/22ed328a1e964d46902dee5e1c7c7b74"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/22ed328a1e964d46902dee5e1c7c7b74"}]}] Oct 04 20:56:19.872038 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-ServerDiskConfigTestJSON-2135457643 Oct 04 20:56:19.872038 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: 22ed328a1e964d46902dee5e1c7c7b74 Oct 04 20:56:19.872038 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-2135457643 Oct 04 20:56:19.872038 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-ServerDiskConfigTestJSON-2135457643-project Oct 04 20:56:19.872038 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:56:19.872038 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:56:19.872038 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: e93855201ca64c779f92a2a33979b81f Oct 04 20:56:19.872038 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-ServerDiskConfigTestJSON-2135457643-project Oct 04 20:56:19.872038 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 20:56:19.872038 n-d-854823-8 devstack@n-api.service[128801]: exception: Instance 01fd3eb8-b195-4b9c-8d52-752e50be6f30 could not be found. Oct 04 20:56:19.872038 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': '01fd3eb8-b195-4b9c-8d52-752e50be6f30'} Oct 04 20:56:19.872038 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:56:19.872038 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:56:19.872038 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:56:19.872038 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:56:19.872038 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:56:19.872038 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:56:19.872038 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:56:19.872038 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:56:19.872038 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:56:19.872038 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:56:19.872038 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 01fd3eb8-b195-4b9c-8d52-752e50be6f30 could not be found. Oct 04 20:56:19.872038 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:56:19.872038 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:56:19.872038 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:56:19.872038 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:56:19.872038 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:56:19.872038 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:56:19.872038 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:56:19.872038 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:56:19.872038 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:56:19.872038 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:56:19.872038 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 20:56:19.872038 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 20:56:19.872038 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 20:56:19.872038 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 20:56:19.872038 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:56:19.872038 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:56:19.872038 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:56:19.872038 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:56:19.875825 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 01fd3eb8-b195-4b9c-8d52-752e50be6f30 could not be found. Oct 04 20:56:19.875825 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:56:19.875825 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:56:19.875825 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:56:19.875825 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:56:19.875825 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:56:19.875825 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:56:19.875825 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:56:19.875825 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:56:19.875825 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 01fd3eb8-b195-4b9c-8d52-752e50be6f30 could not be found. Oct 04 20:56:19.875825 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:56:19.877819 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2752f116-bde9-4ff4-9e8b-43d26db63b54 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Returning 404 to user: Instance 01fd3eb8-b195-4b9c-8d52-752e50be6f30 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:56:19.878934 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-2752f116-bde9-4ff4-9e8b-43d26db63b54 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] 10.222.0.33 "DELETE /compute/v2.1/servers/01fd3eb8-b195-4b9c-8d52-752e50be6f30" status: 404 len: 111 microversion: 2.1 time: 0.056872 Oct 04 20:56:19.880023 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2241/4523] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 20:56:19 2022] DELETE /compute/v2.1/servers/01fd3eb8-b195-4b9c-8d52-752e50be6f30 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:56:19.888929 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-de73f2bf-3d2a-4431-ba4c-73dc0ad07958 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:56:19.889679 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-de73f2bf-3d2a-4431-ba4c-73dc0ad07958 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] [instance: 01fd3eb8-b195-4b9c-8d52-752e50be6f30] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:56:19.896082 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-de73f2bf-3d2a-4431-ba4c-73dc0ad07958 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:19.896690 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-de73f2bf-3d2a-4431-ba4c-73dc0ad07958 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:19.897910 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-de73f2bf-3d2a-4431-ba4c-73dc0ad07958 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:19.899155 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-de73f2bf-3d2a-4431-ba4c-73dc0ad07958 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:19.899723 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-de73f2bf-3d2a-4431-ba4c-73dc0ad07958 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:19.900316 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-de73f2bf-3d2a-4431-ba4c-73dc0ad07958 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:19.916011 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-de73f2bf-3d2a-4431-ba4c-73dc0ad07958 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] HTTP exception thrown: Instance 01fd3eb8-b195-4b9c-8d52-752e50be6f30 could not be found. Oct 04 20:56:19.918006 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-de73f2bf-3d2a-4431-ba4c-73dc0ad07958 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Request method failure captured: Oct 04 20:56:19.918006 n-d-854823-8 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/01fd3eb8-b195-4b9c-8d52-752e50be6f30 HTTP/1.1 Oct 04 20:56:19.918006 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:56:19.918006 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:56:19.918006 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:56:19.918006 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 0 Oct 04 20:56:19.918006 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:56:19.918006 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:56:19.918006 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:56:19.918006 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:56:19.918006 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJ1QihqoUZ7U5kqpSSDrvxVJZzhndox8WZco1oUKwJKRN3YztTxzpicJDoahImhmRx6vPcagQb6P3w2c8PtY9bM233YpypOz-gn4-PCqv2-YeLgLhvViN-oWRQ7U7iZQ-UlSKWUgLkog8KfQSmardXdVlZ1hhqhlI7iv-xYqzOCdZqg Oct 04 20:56:19.918006 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:56:19.918006 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:56:19.918006 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:56:19.918006 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:56:19.918006 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:56:19.918006 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:56:19.918006 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: 22ed328a1e964d46902dee5e1c7c7b74 Oct 04 20:56:19.918006 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-ServerDiskConfigTestJSON-2135457643 Oct 04 20:56:19.918006 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 20:56:19.918006 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 20:56:19.918006 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_22ed328a1e964d46902dee5e1c7c7b74", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/22ed328a1e964d46902dee5e1c7c7b74"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/22ed328a1e964d46902dee5e1c7c7b74"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/22ed328a1e964d46902dee5e1c7c7b74"}]}] Oct 04 20:56:19.918006 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-ServerDiskConfigTestJSON-2135457643 Oct 04 20:56:19.918006 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: 22ed328a1e964d46902dee5e1c7c7b74 Oct 04 20:56:19.918006 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-2135457643 Oct 04 20:56:19.918006 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-ServerDiskConfigTestJSON-2135457643-project Oct 04 20:56:19.918006 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:56:19.918006 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:56:19.918006 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: e93855201ca64c779f92a2a33979b81f Oct 04 20:56:19.918006 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-ServerDiskConfigTestJSON-2135457643-project Oct 04 20:56:19.918006 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 20:56:19.918006 n-d-854823-8 devstack@n-api.service[128801]: exception: Instance 01fd3eb8-b195-4b9c-8d52-752e50be6f30 could not be found. Oct 04 20:56:19.918006 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': '01fd3eb8-b195-4b9c-8d52-752e50be6f30'} Oct 04 20:56:19.918006 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:56:19.918006 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:56:19.918006 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:56:19.918006 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:56:19.918006 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:56:19.918006 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:56:19.918006 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:56:19.918006 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:56:19.918006 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:56:19.918006 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:56:19.918006 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 01fd3eb8-b195-4b9c-8d52-752e50be6f30 could not be found. Oct 04 20:56:19.918006 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:56:19.918006 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:56:19.918006 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:56:19.918006 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:56:19.918006 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:56:19.918006 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:56:19.918006 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:56:19.918006 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:56:19.918006 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:56:19.918006 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:56:19.918006 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:56:19.918006 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:56:19.918006 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:56:19.918006 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:56:19.918006 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:56:19.918006 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:56:19.918006 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 01fd3eb8-b195-4b9c-8d52-752e50be6f30 could not be found. Oct 04 20:56:19.918006 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:56:19.918006 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:56:19.918006 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:56:19.921936 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:56:19.921936 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:56:19.921936 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:56:19.921936 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:56:19.921936 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:56:19.921936 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 01fd3eb8-b195-4b9c-8d52-752e50be6f30 could not be found. Oct 04 20:56:19.921936 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:56:19.923688 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-de73f2bf-3d2a-4431-ba4c-73dc0ad07958 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] Returning 404 to user: Instance 01fd3eb8-b195-4b9c-8d52-752e50be6f30 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:56:19.924810 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-de73f2bf-3d2a-4431-ba4c-73dc0ad07958 tempest-ServerDiskConfigTestJSON-2135457643 tempest-ServerDiskConfigTestJSON-2135457643-project] 10.222.0.33 "GET /compute/v2.1/servers/01fd3eb8-b195-4b9c-8d52-752e50be6f30" status: 404 len: 111 microversion: 2.1 time: 0.039709 Oct 04 20:56:19.930229 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2242/4524] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:56:19 2022] GET /compute/v2.1/servers/01fd3eb8-b195-4b9c-8d52-752e50be6f30 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:56:20.347108 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-2a9b9f4f-893e-403e-ab91-f2d5382c5ee0 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9061ddee3d48528f5849b2cc6a1d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7df9bc3521c479d9c16d3516b014cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:56:20.362115 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-2a9b9f4f-893e-403e-ab91-f2d5382c5ee0 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] 10.222.0.33 "GET /compute/v2.1/servers/0304aa72-7abd-40c3-a555-74179786e217" status: 200 len: 1504 microversion: 2.1 time: 1.149290 Oct 04 20:56:20.363618 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2283/4525] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:56:19 2022] GET /compute/v2.1/servers/0304aa72-7abd-40c3-a555-74179786e217 => generated 1504 bytes in 1152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:56:20.389228 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-80d81bdc-fc6a-4810-a51b-2bef50feca1a tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:56:20.390460 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-80d81bdc-fc6a-4810-a51b-2bef50feca1a tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] [instance: 0304aa72-7abd-40c3-a555-74179786e217] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:56:20.397003 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-80d81bdc-fc6a-4810-a51b-2bef50feca1a tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:20.398070 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-80d81bdc-fc6a-4810-a51b-2bef50feca1a tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:20.399202 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-80d81bdc-fc6a-4810-a51b-2bef50feca1a tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:20.401296 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-80d81bdc-fc6a-4810-a51b-2bef50feca1a tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:20.402025 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-80d81bdc-fc6a-4810-a51b-2bef50feca1a tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:20.402768 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-80d81bdc-fc6a-4810-a51b-2bef50feca1a tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:20.435055 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-80d81bdc-fc6a-4810-a51b-2bef50feca1a tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] [instance: 0304aa72-7abd-40c3-a555-74179786e217] Going to try to terminate instance {{(pid=128801) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:56:20.562274 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-80d81bdc-fc6a-4810-a51b-2bef50feca1a tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] 10.222.0.33 "DELETE /compute/v2.1/servers/0304aa72-7abd-40c3-a555-74179786e217" status: 204 len: 0 microversion: 2.1 time: 0.174618 Oct 04 20:56:20.563998 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2243/4526] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 20:56:20 2022] DELETE /compute/v2.1/servers/0304aa72-7abd-40c3-a555-74179786e217 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:56:20.572569 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-94f9ef1d-7ba5-44be-818f-3ee6421fcb70 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:56:20.573613 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-94f9ef1d-7ba5-44be-818f-3ee6421fcb70 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] [instance: e687d91c-29dd-4e32-9ddc-9b358e711870] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:56:20.579666 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-94f9ef1d-7ba5-44be-818f-3ee6421fcb70 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:20.580804 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-94f9ef1d-7ba5-44be-818f-3ee6421fcb70 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:20.581478 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-94f9ef1d-7ba5-44be-818f-3ee6421fcb70 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:20.582443 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-94f9ef1d-7ba5-44be-818f-3ee6421fcb70 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:20.583127 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-94f9ef1d-7ba5-44be-818f-3ee6421fcb70 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:20.584025 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-94f9ef1d-7ba5-44be-818f-3ee6421fcb70 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:20.625315 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-94f9ef1d-7ba5-44be-818f-3ee6421fcb70 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] [instance: e687d91c-29dd-4e32-9ddc-9b358e711870] Going to try to terminate instance {{(pid=128802) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:56:20.670535 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:56:20.788810 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-94f9ef1d-7ba5-44be-818f-3ee6421fcb70 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] 10.222.0.33 "DELETE /compute/v2.1/servers/e687d91c-29dd-4e32-9ddc-9b358e711870" status: 204 len: 0 microversion: 2.1 time: 0.219492 Oct 04 20:56:20.790491 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2284/4527] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 20:56:20 2022] DELETE /compute/v2.1/servers/e687d91c-29dd-4e32-9ddc-9b358e711870 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:56:20.804243 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-3a21f3f9-9af7-4117-895c-f3ebb053b9c3 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:56:20.805467 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-3a21f3f9-9af7-4117-895c-f3ebb053b9c3 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] [instance: 0304aa72-7abd-40c3-a555-74179786e217] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:56:20.818511 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3a21f3f9-9af7-4117-895c-f3ebb053b9c3 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:20.819351 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3a21f3f9-9af7-4117-895c-f3ebb053b9c3 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:20.819981 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3a21f3f9-9af7-4117-895c-f3ebb053b9c3 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:20.821240 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3a21f3f9-9af7-4117-895c-f3ebb053b9c3 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:20.822307 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3a21f3f9-9af7-4117-895c-f3ebb053b9c3 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:20.824094 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3a21f3f9-9af7-4117-895c-f3ebb053b9c3 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:20.846252 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-b9f445db-65fc-4426-898f-de95f9f752d6 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:56:20.847699 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-b9f445db-65fc-4426-898f-de95f9f752d6 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] [instance: 913a7627-5c81-4c33-858b-35ac9adeb4da] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:56:20.875618 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b9f445db-65fc-4426-898f-de95f9f752d6 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:20.883086 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b9f445db-65fc-4426-898f-de95f9f752d6 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:20.885405 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b9f445db-65fc-4426-898f-de95f9f752d6 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:20.886401 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b9f445db-65fc-4426-898f-de95f9f752d6 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:20.890900 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b9f445db-65fc-4426-898f-de95f9f752d6 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:20.891634 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b9f445db-65fc-4426-898f-de95f9f752d6 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:21.200445 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-b9f445db-65fc-4426-898f-de95f9f752d6 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2021a91a331491c96e79808bf8c32ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27d0f72dc5f404e969e7fcc9cb99d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:56:21.214441 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-b9f445db-65fc-4426-898f-de95f9f752d6 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2021a91a331491c96e79808bf8c32ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27d0f72dc5f404e969e7fcc9cb99d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:56:21.219666 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-b9f445db-65fc-4426-898f-de95f9f752d6 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2021a91a331491c96e79808bf8c32ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27d0f72dc5f404e969e7fcc9cb99d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:56:21.226880 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-b9f445db-65fc-4426-898f-de95f9f752d6 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] 10.222.0.33 "GET /compute/v2.1/servers/913a7627-5c81-4c33-858b-35ac9adeb4da" status: 200 len: 1366 microversion: 2.57 time: 0.392781 Oct 04 20:56:21.228280 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2285/4528] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:56:20 2022] GET /compute/v2.1/servers/913a7627-5c81-4c33-858b-35ac9adeb4da => generated 1366 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:56:21.568798 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-3a21f3f9-9af7-4117-895c-f3ebb053b9c3 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9061ddee3d48528f5849b2cc6a1d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7df9bc3521c479d9c16d3516b014cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:56:21.583735 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-3a21f3f9-9af7-4117-895c-f3ebb053b9c3 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] 10.222.0.33 "GET /compute/v2.1/servers/0304aa72-7abd-40c3-a555-74179786e217" status: 200 len: 1510 microversion: 2.1 time: 0.788703 Oct 04 20:56:21.584175 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2244/4529] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:56:20 2022] GET /compute/v2.1/servers/0304aa72-7abd-40c3-a555-74179786e217 => generated 1510 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:56:22.257049 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-6020d95e-3a1b-456d-a747-25c8d7a06ae2 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:56:22.259519 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-6020d95e-3a1b-456d-a747-25c8d7a06ae2 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] [instance: 913a7627-5c81-4c33-858b-35ac9adeb4da] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:56:22.276701 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6020d95e-3a1b-456d-a747-25c8d7a06ae2 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:22.277618 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6020d95e-3a1b-456d-a747-25c8d7a06ae2 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:22.278239 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6020d95e-3a1b-456d-a747-25c8d7a06ae2 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:22.279427 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6020d95e-3a1b-456d-a747-25c8d7a06ae2 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:22.281756 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6020d95e-3a1b-456d-a747-25c8d7a06ae2 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:22.282434 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6020d95e-3a1b-456d-a747-25c8d7a06ae2 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:22.613784 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6e500890-bc3c-45d3-b88e-59637cc35ec3 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:56:22.615498 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-6e500890-bc3c-45d3-b88e-59637cc35ec3 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] [instance: 0304aa72-7abd-40c3-a555-74179786e217] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:56:22.630458 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6e500890-bc3c-45d3-b88e-59637cc35ec3 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:22.634228 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6e500890-bc3c-45d3-b88e-59637cc35ec3 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:22.634927 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6e500890-bc3c-45d3-b88e-59637cc35ec3 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:22.638483 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6e500890-bc3c-45d3-b88e-59637cc35ec3 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:22.641878 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6e500890-bc3c-45d3-b88e-59637cc35ec3 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:22.642579 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6e500890-bc3c-45d3-b88e-59637cc35ec3 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:23.233765 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-6020d95e-3a1b-456d-a747-25c8d7a06ae2 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2021a91a331491c96e79808bf8c32ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27d0f72dc5f404e969e7fcc9cb99d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:56:23.253921 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-6020d95e-3a1b-456d-a747-25c8d7a06ae2 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2021a91a331491c96e79808bf8c32ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27d0f72dc5f404e969e7fcc9cb99d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:56:23.263224 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-6020d95e-3a1b-456d-a747-25c8d7a06ae2 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2021a91a331491c96e79808bf8c32ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27d0f72dc5f404e969e7fcc9cb99d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:56:23.267075 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-6020d95e-3a1b-456d-a747-25c8d7a06ae2 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] 10.222.0.33 "GET /compute/v2.1/servers/913a7627-5c81-4c33-858b-35ac9adeb4da" status: 200 len: 1366 microversion: 2.57 time: 1.017627 Oct 04 20:56:23.270682 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2286/4530] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:56:22 2022] GET /compute/v2.1/servers/913a7627-5c81-4c33-858b-35ac9adeb4da => generated 1366 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:56:23.747111 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-6e500890-bc3c-45d3-b88e-59637cc35ec3 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9061ddee3d48528f5849b2cc6a1d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7df9bc3521c479d9c16d3516b014cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:56:23.771219 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-6e500890-bc3c-45d3-b88e-59637cc35ec3 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] 10.222.0.33 "GET /compute/v2.1/servers/0304aa72-7abd-40c3-a555-74179786e217" status: 200 len: 1510 microversion: 2.1 time: 1.163004 Oct 04 20:56:23.772419 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2245/4531] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:56:22 2022] GET /compute/v2.1/servers/0304aa72-7abd-40c3-a555-74179786e217 => generated 1510 bytes in 1165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:56:24.236476 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-d9ece831-93fd-4efc-8f97-ccbaa9dbd609 req-ff57c7c3-c456-4e85-bf0d-fc315e4e26c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0304aa72-7abd-40c3-a555-74179786e217", "name": "network-vif-deleted", "tag": "04839d2e-82f0-4e47-bf67-2d69ea25390b"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:56:24.265520 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-d9ece831-93fd-4efc-8f97-ccbaa9dbd609 req-ff57c7c3-c456-4e85-bf0d-fc315e4e26c7 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:24.266196 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-d9ece831-93fd-4efc-8f97-ccbaa9dbd609 req-ff57c7c3-c456-4e85-bf0d-fc315e4e26c7 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:24.266633 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-d9ece831-93fd-4efc-8f97-ccbaa9dbd609 req-ff57c7c3-c456-4e85-bf0d-fc315e4e26c7 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:24.280663 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-d9ece831-93fd-4efc-8f97-ccbaa9dbd609 req-ff57c7c3-c456-4e85-bf0d-fc315e4e26c7 service nova] Creating event network-vif-deleted:04839d2e-82f0-4e47-bf67-2d69ea25390b for instance 0304aa72-7abd-40c3-a555-74179786e217 on n-h1-854823-8 Oct 04 20:56:24.288301 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-d9ece831-93fd-4efc-8f97-ccbaa9dbd609 req-ff57c7c3-c456-4e85-bf0d-fc315e4e26c7 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061601 Oct 04 20:56:24.290719 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2287/4532] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:56:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 20:56:24.300876 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a7f0dea7-51be-414f-b0fb-c46f3ae91259 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:56:24.309942 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a7f0dea7-51be-414f-b0fb-c46f3ae91259 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] [instance: 913a7627-5c81-4c33-858b-35ac9adeb4da] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:56:24.329098 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a7f0dea7-51be-414f-b0fb-c46f3ae91259 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:24.330096 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a7f0dea7-51be-414f-b0fb-c46f3ae91259 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:24.331851 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a7f0dea7-51be-414f-b0fb-c46f3ae91259 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:24.333313 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a7f0dea7-51be-414f-b0fb-c46f3ae91259 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:24.334164 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a7f0dea7-51be-414f-b0fb-c46f3ae91259 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:24.336059 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a7f0dea7-51be-414f-b0fb-c46f3ae91259 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:24.570028 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-a7f0dea7-51be-414f-b0fb-c46f3ae91259 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2021a91a331491c96e79808bf8c32ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27d0f72dc5f404e969e7fcc9cb99d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:56:24.588605 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-a7f0dea7-51be-414f-b0fb-c46f3ae91259 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2021a91a331491c96e79808bf8c32ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27d0f72dc5f404e969e7fcc9cb99d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:56:24.593575 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-a7f0dea7-51be-414f-b0fb-c46f3ae91259 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2021a91a331491c96e79808bf8c32ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27d0f72dc5f404e969e7fcc9cb99d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:56:24.597272 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a7f0dea7-51be-414f-b0fb-c46f3ae91259 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] 10.222.0.33 "GET /compute/v2.1/servers/913a7627-5c81-4c33-858b-35ac9adeb4da" status: 200 len: 1366 microversion: 2.57 time: 0.298775 Oct 04 20:56:24.605054 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2246/4533] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:56:24 2022] GET /compute/v2.1/servers/913a7627-5c81-4c33-858b-35ac9adeb4da => generated 1366 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:56:24.797602 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-e6c2f1fa-baf9-4eee-ae39-44bafd0e23e1 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:56:24.798689 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-e6c2f1fa-baf9-4eee-ae39-44bafd0e23e1 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] [instance: 0304aa72-7abd-40c3-a555-74179786e217] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:56:24.813513 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e6c2f1fa-baf9-4eee-ae39-44bafd0e23e1 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:24.820632 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e6c2f1fa-baf9-4eee-ae39-44bafd0e23e1 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:24.821440 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e6c2f1fa-baf9-4eee-ae39-44bafd0e23e1 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:24.822461 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e6c2f1fa-baf9-4eee-ae39-44bafd0e23e1 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:24.823135 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e6c2f1fa-baf9-4eee-ae39-44bafd0e23e1 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:24.825714 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e6c2f1fa-baf9-4eee-ae39-44bafd0e23e1 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:24.883107 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e6c2f1fa-baf9-4eee-ae39-44bafd0e23e1 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:24.884119 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e6c2f1fa-baf9-4eee-ae39-44bafd0e23e1 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:24.884965 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e6c2f1fa-baf9-4eee-ae39-44bafd0e23e1 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:24.885660 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.objects.instance [None req-e6c2f1fa-baf9-4eee-ae39-44bafd0e23e1 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Lazy-loading 'fault' on Instance uuid 0304aa72-7abd-40c3-a555-74179786e217 {{(pid=128802) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:56:25.137497 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-fcba9bf5-acf7-42b9-a058-98a349486b48 req-fe3f7f3a-e7a5-4883-a9f0-d5dbca31e814 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e687d91c-29dd-4e32-9ddc-9b358e711870", "name": "network-vif-deleted", "tag": "c5b1c37e-84b1-4ccc-a345-24049ee9ef3f"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:56:25.152634 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-e6c2f1fa-baf9-4eee-ae39-44bafd0e23e1 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9061ddee3d48528f5849b2cc6a1d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7df9bc3521c479d9c16d3516b014cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:56:25.161391 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-e6c2f1fa-baf9-4eee-ae39-44bafd0e23e1 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] 10.222.0.33 "GET /compute/v2.1/servers/0304aa72-7abd-40c3-a555-74179786e217" status: 200 len: 1307 microversion: 2.1 time: 0.369127 Oct 04 20:56:25.164753 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2288/4534] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:56:24 2022] GET /compute/v2.1/servers/0304aa72-7abd-40c3-a555-74179786e217 => generated 1307 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:56:25.181246 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-fcba9bf5-acf7-42b9-a058-98a349486b48 req-fe3f7f3a-e7a5-4883-a9f0-d5dbca31e814 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:25.181744 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-fcba9bf5-acf7-42b9-a058-98a349486b48 req-fe3f7f3a-e7a5-4883-a9f0-d5dbca31e814 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:25.182177 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-fcba9bf5-acf7-42b9-a058-98a349486b48 req-fe3f7f3a-e7a5-4883-a9f0-d5dbca31e814 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:25.222966 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-fcba9bf5-acf7-42b9-a058-98a349486b48 req-fe3f7f3a-e7a5-4883-a9f0-d5dbca31e814 service nova] Creating event network-vif-deleted:c5b1c37e-84b1-4ccc-a345-24049ee9ef3f for instance e687d91c-29dd-4e32-9ddc-9b358e711870 on n-h2-854823-8 Oct 04 20:56:25.239737 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-fcba9bf5-acf7-42b9-a058-98a349486b48 req-fe3f7f3a-e7a5-4883-a9f0-d5dbca31e814 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106786 Oct 04 20:56:25.241830 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2247/4535] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:56:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:56:25.632484 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-d1dfb377-24cd-4915-be8e-a056818ad776 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:56:25.633815 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-d1dfb377-24cd-4915-be8e-a056818ad776 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] [instance: 913a7627-5c81-4c33-858b-35ac9adeb4da] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:56:25.641021 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d1dfb377-24cd-4915-be8e-a056818ad776 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:25.642278 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d1dfb377-24cd-4915-be8e-a056818ad776 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:25.643088 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d1dfb377-24cd-4915-be8e-a056818ad776 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:25.645731 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d1dfb377-24cd-4915-be8e-a056818ad776 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:25.646659 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d1dfb377-24cd-4915-be8e-a056818ad776 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:25.647845 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d1dfb377-24cd-4915-be8e-a056818ad776 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:25.781497 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-d1dfb377-24cd-4915-be8e-a056818ad776 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2021a91a331491c96e79808bf8c32ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27d0f72dc5f404e969e7fcc9cb99d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:56:25.793725 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-d1dfb377-24cd-4915-be8e-a056818ad776 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2021a91a331491c96e79808bf8c32ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27d0f72dc5f404e969e7fcc9cb99d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:56:25.795256 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-d1dfb377-24cd-4915-be8e-a056818ad776 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2021a91a331491c96e79808bf8c32ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27d0f72dc5f404e969e7fcc9cb99d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:56:25.797217 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-d1dfb377-24cd-4915-be8e-a056818ad776 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] 10.222.0.33 "GET /compute/v2.1/servers/913a7627-5c81-4c33-858b-35ac9adeb4da" status: 200 len: 1366 microversion: 2.57 time: 0.169246 Oct 04 20:56:25.798366 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2289/4536] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:56:25 2022] GET /compute/v2.1/servers/913a7627-5c81-4c33-858b-35ac9adeb4da => generated 1366 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:56:26.195932 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0cde265a-d8f9-48fb-9672-5e1db4f8ee5c tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:56:26.196760 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-0cde265a-d8f9-48fb-9672-5e1db4f8ee5c tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] [instance: 0304aa72-7abd-40c3-a555-74179786e217] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:56:26.208764 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0cde265a-d8f9-48fb-9672-5e1db4f8ee5c tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:26.210649 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0cde265a-d8f9-48fb-9672-5e1db4f8ee5c tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:26.211413 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0cde265a-d8f9-48fb-9672-5e1db4f8ee5c tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:26.212471 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0cde265a-d8f9-48fb-9672-5e1db4f8ee5c tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:26.213319 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0cde265a-d8f9-48fb-9672-5e1db4f8ee5c tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:26.216056 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0cde265a-d8f9-48fb-9672-5e1db4f8ee5c tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:26.246975 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-0cde265a-d8f9-48fb-9672-5e1db4f8ee5c tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] HTTP exception thrown: Instance 0304aa72-7abd-40c3-a555-74179786e217 could not be found. Oct 04 20:56:26.249371 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0cde265a-d8f9-48fb-9672-5e1db4f8ee5c tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Request method failure captured: Oct 04 20:56:26.249371 n-d-854823-8 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/0304aa72-7abd-40c3-a555-74179786e217 HTTP/1.1 Oct 04 20:56:26.249371 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:56:26.249371 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:56:26.249371 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:56:26.249371 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 0 Oct 04 20:56:26.249371 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:56:26.249371 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:56:26.249371 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:56:26.249371 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:56:26.249371 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJ2xHyCFj8mnxAvima-7qUJttlhpXhpCUPeh7l2s19XzOugyMg8cZnKOw8hUo1yzSBiUTDCec06ljwZGsRVcSIDPjfpFFBducGBs58qeQUowqwvHvWOXsKbhVHYDzdo4jjA8GgjADxMWD8jWKzU7PgvHtR5OAaoLGMq6FNDMOisMvjg Oct 04 20:56:26.249371 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:56:26.249371 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:56:26.249371 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:56:26.249371 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:56:26.249371 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:56:26.249371 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:56:26.249371 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: c7df9bc3521c479d9c16d3516b014cc6 Oct 04 20:56:26.249371 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-MultipleCreateTestJSON-440686010 Oct 04 20:56:26.249371 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 20:56:26.249371 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 20:56:26.249371 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_c7df9bc3521c479d9c16d3516b014cc6", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c7df9bc3521c479d9c16d3516b014cc6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c7df9bc3521c479d9c16d3516b014cc6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/c7df9bc3521c479d9c16d3516b014cc6"}]}] Oct 04 20:56:26.249371 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-MultipleCreateTestJSON-440686010 Oct 04 20:56:26.249371 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: c7df9bc3521c479d9c16d3516b014cc6 Oct 04 20:56:26.249371 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-MultipleCreateTestJSON-440686010 Oct 04 20:56:26.249371 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-MultipleCreateTestJSON-440686010-project Oct 04 20:56:26.249371 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:56:26.249371 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:56:26.249371 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: 1d9061ddee3d48528f5849b2cc6a1d5b Oct 04 20:56:26.249371 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-MultipleCreateTestJSON-440686010-project Oct 04 20:56:26.249371 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 20:56:26.249371 n-d-854823-8 devstack@n-api.service[128801]: exception: Instance 0304aa72-7abd-40c3-a555-74179786e217 could not be found. Oct 04 20:56:26.249371 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': '0304aa72-7abd-40c3-a555-74179786e217'} Oct 04 20:56:26.249371 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:56:26.249371 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:56:26.249371 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:56:26.249371 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:56:26.249371 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:56:26.249371 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:56:26.249371 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:56:26.249371 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:56:26.249371 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:56:26.249371 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:56:26.249371 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0304aa72-7abd-40c3-a555-74179786e217 could not be found. Oct 04 20:56:26.249371 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:56:26.249371 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:56:26.249371 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:56:26.249371 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:56:26.249371 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:56:26.249371 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:56:26.249371 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:56:26.249371 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:56:26.249371 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:56:26.249371 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:56:26.249371 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:56:26.249371 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:56:26.249371 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:56:26.249371 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:56:26.249371 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:56:26.249371 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:56:26.249371 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0304aa72-7abd-40c3-a555-74179786e217 could not be found. Oct 04 20:56:26.249371 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:56:26.249371 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:56:26.249371 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:56:26.255031 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:56:26.255031 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:56:26.255031 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:56:26.255031 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:56:26.255031 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:56:26.255031 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0304aa72-7abd-40c3-a555-74179786e217 could not be found. Oct 04 20:56:26.255031 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:56:26.255031 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0cde265a-d8f9-48fb-9672-5e1db4f8ee5c tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Returning 404 to user: Instance 0304aa72-7abd-40c3-a555-74179786e217 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:56:26.255031 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-0cde265a-d8f9-48fb-9672-5e1db4f8ee5c tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] 10.222.0.33 "GET /compute/v2.1/servers/0304aa72-7abd-40c3-a555-74179786e217" status: 404 len: 111 microversion: 2.1 time: 0.066883 Oct 04 20:56:26.255031 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2248/4537] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:56:26 2022] GET /compute/v2.1/servers/0304aa72-7abd-40c3-a555-74179786e217 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:56:26.263967 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-da4bbd21-8e11-4459-9e5e-618b853098ca tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:56:26.264585 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-da4bbd21-8e11-4459-9e5e-618b853098ca tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] [instance: e687d91c-29dd-4e32-9ddc-9b358e711870] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:56:26.272246 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-da4bbd21-8e11-4459-9e5e-618b853098ca tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:26.273003 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-da4bbd21-8e11-4459-9e5e-618b853098ca tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:26.273453 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-da4bbd21-8e11-4459-9e5e-618b853098ca tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:26.274405 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-da4bbd21-8e11-4459-9e5e-618b853098ca tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:26.274887 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-da4bbd21-8e11-4459-9e5e-618b853098ca tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:26.275308 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-da4bbd21-8e11-4459-9e5e-618b853098ca tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:26.309815 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-da4bbd21-8e11-4459-9e5e-618b853098ca tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:26.310727 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-da4bbd21-8e11-4459-9e5e-618b853098ca tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:26.311268 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-da4bbd21-8e11-4459-9e5e-618b853098ca tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:26.311797 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.objects.instance [None req-da4bbd21-8e11-4459-9e5e-618b853098ca tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Lazy-loading 'fault' on Instance uuid e687d91c-29dd-4e32-9ddc-9b358e711870 {{(pid=128802) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:56:26.378661 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-da4bbd21-8e11-4459-9e5e-618b853098ca tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d9061ddee3d48528f5849b2cc6a1d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7df9bc3521c479d9c16d3516b014cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:56:26.388245 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-da4bbd21-8e11-4459-9e5e-618b853098ca tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] 10.222.0.33 "GET /compute/v2.1/servers/e687d91c-29dd-4e32-9ddc-9b358e711870" status: 200 len: 1307 microversion: 2.1 time: 0.128249 Oct 04 20:56:26.389458 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2290/4538] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:56:26 2022] GET /compute/v2.1/servers/e687d91c-29dd-4e32-9ddc-9b358e711870 => generated 1307 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:56:26.833876 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2c939f40-fcb6-4bb1-86b7-66aec04d8308 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:56:26.835020 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-2c939f40-fcb6-4bb1-86b7-66aec04d8308 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] [instance: 913a7627-5c81-4c33-858b-35ac9adeb4da] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:56:26.842334 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2c939f40-fcb6-4bb1-86b7-66aec04d8308 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:26.843140 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2c939f40-fcb6-4bb1-86b7-66aec04d8308 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:26.843729 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2c939f40-fcb6-4bb1-86b7-66aec04d8308 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:26.844447 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2c939f40-fcb6-4bb1-86b7-66aec04d8308 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:26.844902 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2c939f40-fcb6-4bb1-86b7-66aec04d8308 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:26.845633 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2c939f40-fcb6-4bb1-86b7-66aec04d8308 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:27.058165 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-2c939f40-fcb6-4bb1-86b7-66aec04d8308 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2021a91a331491c96e79808bf8c32ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27d0f72dc5f404e969e7fcc9cb99d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:56:27.072718 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-2c939f40-fcb6-4bb1-86b7-66aec04d8308 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2021a91a331491c96e79808bf8c32ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27d0f72dc5f404e969e7fcc9cb99d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:56:27.078793 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-2c939f40-fcb6-4bb1-86b7-66aec04d8308 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2021a91a331491c96e79808bf8c32ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27d0f72dc5f404e969e7fcc9cb99d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:56:27.085986 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-2c939f40-fcb6-4bb1-86b7-66aec04d8308 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] 10.222.0.33 "GET /compute/v2.1/servers/913a7627-5c81-4c33-858b-35ac9adeb4da" status: 200 len: 1372 microversion: 2.57 time: 0.256417 Oct 04 20:56:27.087003 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2249/4539] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:56:26 2022] GET /compute/v2.1/servers/913a7627-5c81-4c33-858b-35ac9adeb4da => generated 1372 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:56:27.411277 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-17799edd-6b2d-4d44-876e-a32f67dfe689 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:56:27.411894 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-17799edd-6b2d-4d44-876e-a32f67dfe689 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] [instance: e687d91c-29dd-4e32-9ddc-9b358e711870] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:56:27.426886 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-17799edd-6b2d-4d44-876e-a32f67dfe689 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:27.427649 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-17799edd-6b2d-4d44-876e-a32f67dfe689 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:27.432273 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-17799edd-6b2d-4d44-876e-a32f67dfe689 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:27.434527 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-17799edd-6b2d-4d44-876e-a32f67dfe689 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:27.435243 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-17799edd-6b2d-4d44-876e-a32f67dfe689 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:27.435685 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-17799edd-6b2d-4d44-876e-a32f67dfe689 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:27.467231 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.wsgi [None req-17799edd-6b2d-4d44-876e-a32f67dfe689 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] HTTP exception thrown: Instance e687d91c-29dd-4e32-9ddc-9b358e711870 could not be found. Oct 04 20:56:27.468979 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-17799edd-6b2d-4d44-876e-a32f67dfe689 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Request method failure captured: Oct 04 20:56:27.468979 n-d-854823-8 devstack@n-api.service[128802]: request: GET /compute/v2.1/servers/e687d91c-29dd-4e32-9ddc-9b358e711870 HTTP/1.1 Oct 04 20:56:27.468979 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 20:56:27.468979 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 20:56:27.468979 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 20:56:27.468979 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 0 Oct 04 20:56:27.468979 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 20:56:27.468979 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 20:56:27.468979 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 20:56:27.468979 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 20:56:27.468979 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPJ2xHyCFj8mnxAvima-7qUJttlhpXhpCUPeh7l2s19XzOugyMg8cZnKOw8hUo1yzSBiUTDCec06ljwZGsRVcSIDPjfpFFBducGBs58qeQUowqwvHvWOXsKbhVHYDzdo4jjA8GgjADxMWD8jWKzU7PgvHtR5OAaoLGMq6FNDMOisMvjg Oct 04 20:56:27.468979 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 20:56:27.468979 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 20:56:27.468979 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 20:56:27.468979 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 20:56:27.468979 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 20:56:27.468979 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 20:56:27.468979 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: c7df9bc3521c479d9c16d3516b014cc6 Oct 04 20:56:27.468979 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-MultipleCreateTestJSON-440686010 Oct 04 20:56:27.468979 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 20:56:27.468979 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 20:56:27.468979 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_c7df9bc3521c479d9c16d3516b014cc6", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c7df9bc3521c479d9c16d3516b014cc6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c7df9bc3521c479d9c16d3516b014cc6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/c7df9bc3521c479d9c16d3516b014cc6"}]}] Oct 04 20:56:27.468979 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-MultipleCreateTestJSON-440686010 Oct 04 20:56:27.468979 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: c7df9bc3521c479d9c16d3516b014cc6 Oct 04 20:56:27.468979 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-MultipleCreateTestJSON-440686010 Oct 04 20:56:27.468979 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-MultipleCreateTestJSON-440686010-project Oct 04 20:56:27.468979 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 20:56:27.468979 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 20:56:27.468979 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: 1d9061ddee3d48528f5849b2cc6a1d5b Oct 04 20:56:27.468979 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-MultipleCreateTestJSON-440686010-project Oct 04 20:56:27.468979 n-d-854823-8 devstack@n-api.service[128802]: method: > Oct 04 20:56:27.468979 n-d-854823-8 devstack@n-api.service[128802]: exception: Instance e687d91c-29dd-4e32-9ddc-9b358e711870 could not be found. Oct 04 20:56:27.468979 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'id': 'e687d91c-29dd-4e32-9ddc-9b358e711870'} Oct 04 20:56:27.468979 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:56:27.468979 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:56:27.468979 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:56:27.468979 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:56:27.468979 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:56:27.468979 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:56:27.468979 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:56:27.468979 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:56:27.468979 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:56:27.468979 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:56:27.468979 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e687d91c-29dd-4e32-9ddc-9b358e711870 could not be found. Oct 04 20:56:27.468979 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:56:27.468979 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:56:27.468979 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:56:27.468979 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:56:27.468979 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:56:27.468979 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:56:27.468979 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:56:27.468979 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:56:27.468979 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:56:27.468979 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:56:27.468979 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:56:27.468979 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:56:27.468979 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:56:27.468979 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:56:27.468979 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:56:27.468979 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:56:27.468979 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e687d91c-29dd-4e32-9ddc-9b358e711870 could not be found. Oct 04 20:56:27.468979 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:56:27.468979 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:56:27.468979 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:56:27.473983 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:56:27.473983 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:56:27.473983 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:56:27.473983 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:56:27.473983 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:56:27.473983 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e687d91c-29dd-4e32-9ddc-9b358e711870 could not be found. Oct 04 20:56:27.473983 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:56:27.473983 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-17799edd-6b2d-4d44-876e-a32f67dfe689 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] Returning 404 to user: Instance e687d91c-29dd-4e32-9ddc-9b358e711870 could not be found. {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:56:27.475762 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-17799edd-6b2d-4d44-876e-a32f67dfe689 tempest-MultipleCreateTestJSON-440686010 tempest-MultipleCreateTestJSON-440686010-project] 10.222.0.33 "GET /compute/v2.1/servers/e687d91c-29dd-4e32-9ddc-9b358e711870" status: 404 len: 111 microversion: 2.1 time: 0.063207 Oct 04 20:56:27.476607 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2291/4540] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:56:27 2022] GET /compute/v2.1/servers/e687d91c-29dd-4e32-9ddc-9b358e711870 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:56:28.118254 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5c7b04ca-b9a5-4153-92cb-2c9ccf98c300 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:56:28.119762 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-5c7b04ca-b9a5-4153-92cb-2c9ccf98c300 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] [instance: 913a7627-5c81-4c33-858b-35ac9adeb4da] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:56:28.127335 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:56:28.130759 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5c7b04ca-b9a5-4153-92cb-2c9ccf98c300 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:28.133468 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5c7b04ca-b9a5-4153-92cb-2c9ccf98c300 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:28.134471 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5c7b04ca-b9a5-4153-92cb-2c9ccf98c300 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:28.135721 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5c7b04ca-b9a5-4153-92cb-2c9ccf98c300 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:28.136357 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5c7b04ca-b9a5-4153-92cb-2c9ccf98c300 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:28.137012 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5c7b04ca-b9a5-4153-92cb-2c9ccf98c300 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:28.325129 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-5c7b04ca-b9a5-4153-92cb-2c9ccf98c300 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2021a91a331491c96e79808bf8c32ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27d0f72dc5f404e969e7fcc9cb99d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:56:28.348232 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-5c7b04ca-b9a5-4153-92cb-2c9ccf98c300 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2021a91a331491c96e79808bf8c32ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27d0f72dc5f404e969e7fcc9cb99d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:56:28.349836 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-5c7b04ca-b9a5-4153-92cb-2c9ccf98c300 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2021a91a331491c96e79808bf8c32ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27d0f72dc5f404e969e7fcc9cb99d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:56:28.352637 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5c7b04ca-b9a5-4153-92cb-2c9ccf98c300 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] 10.222.0.33 "GET /compute/v2.1/servers/913a7627-5c81-4c33-858b-35ac9adeb4da" status: 200 len: 1372 microversion: 2.57 time: 0.239214 Oct 04 20:56:28.353243 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2250/4541] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:56:28 2022] GET /compute/v2.1/servers/913a7627-5c81-4c33-858b-35ac9adeb4da => generated 1372 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 20:56:29.387410 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-cd62049f-d8ec-4ead-89d0-4890bf569967 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:56:29.389959 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-cd62049f-d8ec-4ead-89d0-4890bf569967 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] [instance: 913a7627-5c81-4c33-858b-35ac9adeb4da] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:56:29.399590 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cd62049f-d8ec-4ead-89d0-4890bf569967 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:29.400410 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cd62049f-d8ec-4ead-89d0-4890bf569967 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:29.401094 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cd62049f-d8ec-4ead-89d0-4890bf569967 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:29.402496 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cd62049f-d8ec-4ead-89d0-4890bf569967 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:29.403605 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cd62049f-d8ec-4ead-89d0-4890bf569967 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:29.404833 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cd62049f-d8ec-4ead-89d0-4890bf569967 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:29.530064 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-cd62049f-d8ec-4ead-89d0-4890bf569967 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2021a91a331491c96e79808bf8c32ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27d0f72dc5f404e969e7fcc9cb99d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:56:29.554989 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-cd62049f-d8ec-4ead-89d0-4890bf569967 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2021a91a331491c96e79808bf8c32ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27d0f72dc5f404e969e7fcc9cb99d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:56:29.558986 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-cd62049f-d8ec-4ead-89d0-4890bf569967 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2021a91a331491c96e79808bf8c32ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27d0f72dc5f404e969e7fcc9cb99d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:56:29.561592 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-cd62049f-d8ec-4ead-89d0-4890bf569967 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] 10.222.0.33 "GET /compute/v2.1/servers/913a7627-5c81-4c33-858b-35ac9adeb4da" status: 200 len: 1357 microversion: 2.57 time: 0.178456 Oct 04 20:56:29.563197 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2292/4542] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:56:29 2022] GET /compute/v2.1/servers/913a7627-5c81-4c33-858b-35ac9adeb4da => generated 1357 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 20:56:29.593959 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-28f5e48c-4e30-4679-9cfb-3f8c7040283c tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:56:29.595171 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-28f5e48c-4e30-4679-9cfb-3f8c7040283c tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] [instance: 913a7627-5c81-4c33-858b-35ac9adeb4da] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:56:29.605226 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-28f5e48c-4e30-4679-9cfb-3f8c7040283c tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:29.606794 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-28f5e48c-4e30-4679-9cfb-3f8c7040283c tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:29.607796 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-28f5e48c-4e30-4679-9cfb-3f8c7040283c tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:29.608748 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-28f5e48c-4e30-4679-9cfb-3f8c7040283c tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:29.609855 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-28f5e48c-4e30-4679-9cfb-3f8c7040283c tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:29.610570 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-28f5e48c-4e30-4679-9cfb-3f8c7040283c tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:29.702949 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-28f5e48c-4e30-4679-9cfb-3f8c7040283c tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] [instance: 913a7627-5c81-4c33-858b-35ac9adeb4da] Going to try to terminate instance {{(pid=128801) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:56:29.903338 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-28f5e48c-4e30-4679-9cfb-3f8c7040283c tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] 10.222.0.33 "DELETE /compute/v2.1/servers/913a7627-5c81-4c33-858b-35ac9adeb4da" status: 204 len: 0 microversion: 2.57 time: 0.314241 Oct 04 20:56:29.908039 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2251/4543] 10.222.0.33 () {60 vars in 1280 bytes} [Tue Oct 4 20:56:29 2022] DELETE /compute/v2.1/servers/913a7627-5c81-4c33-858b-35ac9adeb4da => generated 0 bytes in 316 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 20:56:29.919571 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-7bd26321-e1b1-4b5d-b129-a846374816e4 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:56:29.920274 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-7bd26321-e1b1-4b5d-b129-a846374816e4 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] [instance: 913a7627-5c81-4c33-858b-35ac9adeb4da] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:56:29.936588 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7bd26321-e1b1-4b5d-b129-a846374816e4 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:29.939152 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7bd26321-e1b1-4b5d-b129-a846374816e4 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:29.939758 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7bd26321-e1b1-4b5d-b129-a846374816e4 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:29.941333 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7bd26321-e1b1-4b5d-b129-a846374816e4 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:29.946194 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7bd26321-e1b1-4b5d-b129-a846374816e4 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:29.947109 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7bd26321-e1b1-4b5d-b129-a846374816e4 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:30.204651 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-7bd26321-e1b1-4b5d-b129-a846374816e4 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2021a91a331491c96e79808bf8c32ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27d0f72dc5f404e969e7fcc9cb99d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:56:30.228995 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-7bd26321-e1b1-4b5d-b129-a846374816e4 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2021a91a331491c96e79808bf8c32ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27d0f72dc5f404e969e7fcc9cb99d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:56:30.231615 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-7bd26321-e1b1-4b5d-b129-a846374816e4 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2021a91a331491c96e79808bf8c32ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27d0f72dc5f404e969e7fcc9cb99d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:56:30.234051 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-7bd26321-e1b1-4b5d-b129-a846374816e4 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] 10.222.0.33 "GET /compute/v2.1/servers/913a7627-5c81-4c33-858b-35ac9adeb4da" status: 200 len: 1363 microversion: 2.57 time: 0.323656 Oct 04 20:56:30.235284 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2293/4544] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:56:29 2022] GET /compute/v2.1/servers/913a7627-5c81-4c33-858b-35ac9adeb4da => generated 1363 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:56:31.265445 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d916a8a4-8851-4402-b00d-b5c213f18dae tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:56:31.266175 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d916a8a4-8851-4402-b00d-b5c213f18dae tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] [instance: 913a7627-5c81-4c33-858b-35ac9adeb4da] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:56:31.289244 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d916a8a4-8851-4402-b00d-b5c213f18dae tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:31.290292 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d916a8a4-8851-4402-b00d-b5c213f18dae tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:31.290793 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d916a8a4-8851-4402-b00d-b5c213f18dae tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:31.291587 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d916a8a4-8851-4402-b00d-b5c213f18dae tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:31.291976 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d916a8a4-8851-4402-b00d-b5c213f18dae tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:31.292404 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d916a8a4-8851-4402-b00d-b5c213f18dae tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:31.498173 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d916a8a4-8851-4402-b00d-b5c213f18dae tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2021a91a331491c96e79808bf8c32ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27d0f72dc5f404e969e7fcc9cb99d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:56:31.514221 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d916a8a4-8851-4402-b00d-b5c213f18dae tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2021a91a331491c96e79808bf8c32ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27d0f72dc5f404e969e7fcc9cb99d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:56:31.515835 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d916a8a4-8851-4402-b00d-b5c213f18dae tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2021a91a331491c96e79808bf8c32ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27d0f72dc5f404e969e7fcc9cb99d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:56:31.519936 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d916a8a4-8851-4402-b00d-b5c213f18dae tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] 10.222.0.33 "GET /compute/v2.1/servers/913a7627-5c81-4c33-858b-35ac9adeb4da" status: 200 len: 1363 microversion: 2.57 time: 0.258753 Oct 04 20:56:31.520903 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2252/4545] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:56:31 2022] GET /compute/v2.1/servers/913a7627-5c81-4c33-858b-35ac9adeb4da => generated 1363 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:56:32.549426 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-900d4d25-6aa4-47e8-9894-ee272ef19577 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:56:32.551498 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-900d4d25-6aa4-47e8-9894-ee272ef19577 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] [instance: 913a7627-5c81-4c33-858b-35ac9adeb4da] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:56:32.570370 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1b093da3-8105-4374-a524-f2eb7d8e91f2 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:56:32.570961 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-1b093da3-8105-4374-a524-f2eb7d8e91f2 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] [instance: f8ba4e66-2997-4822-9c01-c570f5ae6e87] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:56:32.579672 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-900d4d25-6aa4-47e8-9894-ee272ef19577 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:32.581596 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-900d4d25-6aa4-47e8-9894-ee272ef19577 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:32.583568 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-900d4d25-6aa4-47e8-9894-ee272ef19577 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:32.586256 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-900d4d25-6aa4-47e8-9894-ee272ef19577 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:32.586579 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1b093da3-8105-4374-a524-f2eb7d8e91f2 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:32.592016 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1b093da3-8105-4374-a524-f2eb7d8e91f2 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:32.593803 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-900d4d25-6aa4-47e8-9894-ee272ef19577 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:32.594260 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-900d4d25-6aa4-47e8-9894-ee272ef19577 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:32.594524 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1b093da3-8105-4374-a524-f2eb7d8e91f2 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:32.595464 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1b093da3-8105-4374-a524-f2eb7d8e91f2 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:32.600536 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1b093da3-8105-4374-a524-f2eb7d8e91f2 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:32.601235 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1b093da3-8105-4374-a524-f2eb7d8e91f2 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:32.640076 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-1b093da3-8105-4374-a524-f2eb7d8e91f2 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] HTTP exception thrown: Instance f8ba4e66-2997-4822-9c01-c570f5ae6e87 could not be found. Oct 04 20:56:32.642467 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1b093da3-8105-4374-a524-f2eb7d8e91f2 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Request method failure captured: Oct 04 20:56:32.642467 n-d-854823-8 devstack@n-api.service[128801]: request: DELETE /compute/v2.1/servers/f8ba4e66-2997-4822-9c01-c570f5ae6e87 HTTP/1.1 Oct 04 20:56:32.642467 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:56:32.642467 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:56:32.642467 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:56:32.642467 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 0 Oct 04 20:56:32.642467 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:56:32.642467 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:56:32.642467 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:56:32.642467 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:56:32.642467 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJxSP8kTdA37O7gyFQ7hyZrNgnRnKjxriobn4TLvtmTbjyY9Wrpp-XAh2F8addWN5YMO5RvtTKVmYVGpXJUD_Z0HBX-IaC7vAkvHMa7zrxze2rJyh7NECQ1gxo1Q5z1i-VgUAJ4odWYne6rSup_a4fn3Pw66rcExBKwlFT9CdgnCi-0 Oct 04 20:56:32.642467 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:56:32.642467 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:56:32.642467 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:56:32.642467 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:56:32.642467 n-d-854823-8 devstack@n-api.service[128801]: X-Openstack-Nova-Api-Version: 2.42 Oct 04 20:56:32.642467 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:56:32.642467 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:56:32.642467 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: 659f3d4023b347d58bc0361db9ceead9 Oct 04 20:56:32.642467 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-195875716 Oct 04 20:56:32.642467 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 20:56:32.642467 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 20:56:32.642467 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_659f3d4023b347d58bc0361db9ceead9", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/659f3d4023b347d58bc0361db9ceead9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/659f3d4023b347d58bc0361db9ceead9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/659f3d4023b347d58bc0361db9ceead9"}]}] Oct 04 20:56:32.642467 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-TaggedBootDevicesTest_v242-195875716 Oct 04 20:56:32.642467 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: 659f3d4023b347d58bc0361db9ceead9 Oct 04 20:56:32.642467 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-195875716 Oct 04 20:56:32.642467 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-TaggedBootDevicesTest_v242-195875716-project Oct 04 20:56:32.642467 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:56:32.642467 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:56:32.642467 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: b78af5c0485b4343900269160ef3e508 Oct 04 20:56:32.642467 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-TaggedBootDevicesTest_v242-195875716-project Oct 04 20:56:32.642467 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 20:56:32.642467 n-d-854823-8 devstack@n-api.service[128801]: exception: Instance f8ba4e66-2997-4822-9c01-c570f5ae6e87 could not be found. Oct 04 20:56:32.642467 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': 'f8ba4e66-2997-4822-9c01-c570f5ae6e87'} Oct 04 20:56:32.642467 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:56:32.642467 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:56:32.642467 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:56:32.642467 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:56:32.642467 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:56:32.642467 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:56:32.642467 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:56:32.642467 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:56:32.642467 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:56:32.642467 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:56:32.642467 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f8ba4e66-2997-4822-9c01-c570f5ae6e87 could not be found. Oct 04 20:56:32.642467 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:56:32.642467 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:56:32.642467 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:56:32.642467 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:56:32.642467 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:56:32.642467 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:56:32.642467 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:56:32.642467 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:56:32.642467 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:56:32.642467 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:56:32.642467 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 20:56:32.642467 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 20:56:32.642467 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 20:56:32.642467 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 20:56:32.642467 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:56:32.642467 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:56:32.642467 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:56:32.642467 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:56:32.649077 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8ba4e66-2997-4822-9c01-c570f5ae6e87 could not be found. Oct 04 20:56:32.649077 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:56:32.649077 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:56:32.649077 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:56:32.649077 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:56:32.649077 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:56:32.649077 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:56:32.649077 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:56:32.649077 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:56:32.649077 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8ba4e66-2997-4822-9c01-c570f5ae6e87 could not be found. Oct 04 20:56:32.649077 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:56:32.649077 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1b093da3-8105-4374-a524-f2eb7d8e91f2 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Returning 404 to user: Instance f8ba4e66-2997-4822-9c01-c570f5ae6e87 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:56:32.649077 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-1b093da3-8105-4374-a524-f2eb7d8e91f2 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] 10.222.0.33 "DELETE /compute/v2.1/servers/f8ba4e66-2997-4822-9c01-c570f5ae6e87" status: 404 len: 111 microversion: 2.42 time: 0.079443 Oct 04 20:56:32.662523 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2253/4546] 10.222.0.33 () {60 vars in 1280 bytes} [Tue Oct 4 20:56:32 2022] DELETE /compute/v2.1/servers/f8ba4e66-2997-4822-9c01-c570f5ae6e87 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 04 20:56:32.672635 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a7078db0-4d7d-48b4-9ae6-b788632cc485 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:56:32.673276 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a7078db0-4d7d-48b4-9ae6-b788632cc485 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] [instance: f8ba4e66-2997-4822-9c01-c570f5ae6e87] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:56:32.691073 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-900d4d25-6aa4-47e8-9894-ee272ef19577 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:32.694933 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-900d4d25-6aa4-47e8-9894-ee272ef19577 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:32.695873 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a7078db0-4d7d-48b4-9ae6-b788632cc485 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:32.696345 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-900d4d25-6aa4-47e8-9894-ee272ef19577 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:32.696473 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a7078db0-4d7d-48b4-9ae6-b788632cc485 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:32.696816 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a7078db0-4d7d-48b4-9ae6-b788632cc485 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:32.697598 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a7078db0-4d7d-48b4-9ae6-b788632cc485 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:32.697814 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.objects.instance [None req-900d4d25-6aa4-47e8-9894-ee272ef19577 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Lazy-loading 'fault' on Instance uuid 913a7627-5c81-4c33-858b-35ac9adeb4da {{(pid=128802) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:56:32.698013 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a7078db0-4d7d-48b4-9ae6-b788632cc485 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:32.702721 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a7078db0-4d7d-48b4-9ae6-b788632cc485 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:32.771511 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-a7078db0-4d7d-48b4-9ae6-b788632cc485 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] HTTP exception thrown: Instance f8ba4e66-2997-4822-9c01-c570f5ae6e87 could not be found. Oct 04 20:56:32.775665 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a7078db0-4d7d-48b4-9ae6-b788632cc485 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Request method failure captured: Oct 04 20:56:32.775665 n-d-854823-8 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/f8ba4e66-2997-4822-9c01-c570f5ae6e87 HTTP/1.1 Oct 04 20:56:32.775665 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:56:32.775665 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:56:32.775665 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:56:32.775665 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 0 Oct 04 20:56:32.775665 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:56:32.775665 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:56:32.775665 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:56:32.775665 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:56:32.775665 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJxSP8kTdA37O7gyFQ7hyZrNgnRnKjxriobn4TLvtmTbjyY9Wrpp-XAh2F8addWN5YMO5RvtTKVmYVGpXJUD_Z0HBX-IaC7vAkvHMa7zrxze2rJyh7NECQ1gxo1Q5z1i-VgUAJ4odWYne6rSup_a4fn3Pw66rcExBKwlFT9CdgnCi-0 Oct 04 20:56:32.775665 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:56:32.775665 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:56:32.775665 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:56:32.775665 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:56:32.775665 n-d-854823-8 devstack@n-api.service[128801]: X-Openstack-Nova-Api-Version: 2.42 Oct 04 20:56:32.775665 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:56:32.775665 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:56:32.775665 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: 659f3d4023b347d58bc0361db9ceead9 Oct 04 20:56:32.775665 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-195875716 Oct 04 20:56:32.775665 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 20:56:32.775665 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 20:56:32.775665 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_659f3d4023b347d58bc0361db9ceead9", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/659f3d4023b347d58bc0361db9ceead9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/659f3d4023b347d58bc0361db9ceead9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/659f3d4023b347d58bc0361db9ceead9"}]}] Oct 04 20:56:32.775665 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-TaggedBootDevicesTest_v242-195875716 Oct 04 20:56:32.775665 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: 659f3d4023b347d58bc0361db9ceead9 Oct 04 20:56:32.775665 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-195875716 Oct 04 20:56:32.775665 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-TaggedBootDevicesTest_v242-195875716-project Oct 04 20:56:32.775665 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:56:32.775665 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:56:32.775665 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: b78af5c0485b4343900269160ef3e508 Oct 04 20:56:32.775665 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-TaggedBootDevicesTest_v242-195875716-project Oct 04 20:56:32.775665 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 20:56:32.775665 n-d-854823-8 devstack@n-api.service[128801]: exception: Instance f8ba4e66-2997-4822-9c01-c570f5ae6e87 could not be found. Oct 04 20:56:32.775665 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': 'f8ba4e66-2997-4822-9c01-c570f5ae6e87'} Oct 04 20:56:32.775665 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:56:32.775665 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:56:32.775665 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:56:32.775665 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:56:32.775665 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:56:32.775665 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:56:32.775665 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:56:32.775665 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:56:32.775665 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:56:32.775665 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:56:32.775665 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f8ba4e66-2997-4822-9c01-c570f5ae6e87 could not be found. Oct 04 20:56:32.775665 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:56:32.775665 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:56:32.775665 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:56:32.775665 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:56:32.775665 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:56:32.775665 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:56:32.775665 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:56:32.775665 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:56:32.775665 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:56:32.775665 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:56:32.775665 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:56:32.775665 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:56:32.775665 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:56:32.775665 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:56:32.775665 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:56:32.775665 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:56:32.775665 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8ba4e66-2997-4822-9c01-c570f5ae6e87 could not be found. Oct 04 20:56:32.775665 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:56:32.775665 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:56:32.781786 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:56:32.781786 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:56:32.781786 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:56:32.781786 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:56:32.781786 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:56:32.781786 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:56:32.781786 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8ba4e66-2997-4822-9c01-c570f5ae6e87 could not be found. Oct 04 20:56:32.781786 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:56:32.788593 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a7078db0-4d7d-48b4-9ae6-b788632cc485 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] Returning 404 to user: Instance f8ba4e66-2997-4822-9c01-c570f5ae6e87 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:56:32.789738 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a7078db0-4d7d-48b4-9ae6-b788632cc485 tempest-TaggedBootDevicesTest_v242-195875716 tempest-TaggedBootDevicesTest_v242-195875716-project] 10.222.0.33 "GET /compute/v2.1/servers/f8ba4e66-2997-4822-9c01-c570f5ae6e87" status: 404 len: 111 microversion: 2.42 time: 0.126061 Oct 04 20:56:32.793988 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2254/4547] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:56:32 2022] GET /compute/v2.1/servers/f8ba4e66-2997-4822-9c01-c570f5ae6e87 => generated 111 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 20:56:33.016164 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-900d4d25-6aa4-47e8-9894-ee272ef19577 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2021a91a331491c96e79808bf8c32ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27d0f72dc5f404e969e7fcc9cb99d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:56:33.051243 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-900d4d25-6aa4-47e8-9894-ee272ef19577 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2021a91a331491c96e79808bf8c32ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27d0f72dc5f404e969e7fcc9cb99d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:56:33.054468 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-900d4d25-6aa4-47e8-9894-ee272ef19577 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2021a91a331491c96e79808bf8c32ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c27d0f72dc5f404e969e7fcc9cb99d08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:56:33.056931 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-900d4d25-6aa4-47e8-9894-ee272ef19577 tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] 10.222.0.33 "GET /compute/v2.1/servers/913a7627-5c81-4c33-858b-35ac9adeb4da" status: 200 len: 1368 microversion: 2.57 time: 0.513155 Oct 04 20:56:33.066396 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2294/4548] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:56:32 2022] GET /compute/v2.1/servers/913a7627-5c81-4c33-858b-35ac9adeb4da => generated 1368 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:56:34.096327 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d3ccfc88-b0fa-4cac-ab1d-f4196115bcea tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:56:34.096920 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d3ccfc88-b0fa-4cac-ab1d-f4196115bcea tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] [instance: 913a7627-5c81-4c33-858b-35ac9adeb4da] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:56:34.107031 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d3ccfc88-b0fa-4cac-ab1d-f4196115bcea tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:34.109071 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d3ccfc88-b0fa-4cac-ab1d-f4196115bcea tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:34.109728 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d3ccfc88-b0fa-4cac-ab1d-f4196115bcea tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:34.110712 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d3ccfc88-b0fa-4cac-ab1d-f4196115bcea tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:34.111350 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d3ccfc88-b0fa-4cac-ab1d-f4196115bcea tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:34.111949 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d3ccfc88-b0fa-4cac-ab1d-f4196115bcea tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:34.168555 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-d3ccfc88-b0fa-4cac-ab1d-f4196115bcea tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] HTTP exception thrown: Instance 913a7627-5c81-4c33-858b-35ac9adeb4da could not be found. Oct 04 20:56:34.170440 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d3ccfc88-b0fa-4cac-ab1d-f4196115bcea tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Request method failure captured: Oct 04 20:56:34.170440 n-d-854823-8 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/913a7627-5c81-4c33-858b-35ac9adeb4da HTTP/1.1 Oct 04 20:56:34.170440 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:56:34.170440 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:56:34.170440 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:56:34.170440 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 0 Oct 04 20:56:34.170440 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:56:34.170440 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:56:34.170440 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:56:34.170440 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:56:34.170440 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJ3XsWljkGUtWeCBIQlfnspGKmk_8nKNptIIoX2tM_92NwDfo-8bY5-oztwzObcoylLu6MMN-Nduvqf8GuiRs5lrreacbkNIoNBUZnAqfE_8247AHg_YzCDbHVcpMTHgYsQgokghL4jnf5iOhTu4P7JQ8N_I5cNO9FOg-_5wPddPX5Q Oct 04 20:56:34.170440 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:56:34.170440 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:56:34.170440 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:56:34.170440 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:56:34.170440 n-d-854823-8 devstack@n-api.service[128801]: X-Openstack-Nova-Api-Version: 2.57 Oct 04 20:56:34.170440 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:56:34.170440 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:56:34.170440 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: c27d0f72dc5f404e969e7fcc9cb99d08 Oct 04 20:56:34.170440 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-ServerShowV257Test-920402868 Oct 04 20:56:34.170440 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 20:56:34.170440 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 20:56:34.170440 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_c27d0f72dc5f404e969e7fcc9cb99d08", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c27d0f72dc5f404e969e7fcc9cb99d08"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c27d0f72dc5f404e969e7fcc9cb99d08"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/c27d0f72dc5f404e969e7fcc9cb99d08"}]}] Oct 04 20:56:34.170440 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-ServerShowV257Test-920402868 Oct 04 20:56:34.170440 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: c27d0f72dc5f404e969e7fcc9cb99d08 Oct 04 20:56:34.170440 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ServerShowV257Test-920402868 Oct 04 20:56:34.170440 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-ServerShowV257Test-920402868-project Oct 04 20:56:34.170440 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:56:34.170440 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:56:34.170440 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: a2021a91a331491c96e79808bf8c32ab Oct 04 20:56:34.170440 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-ServerShowV257Test-920402868-project Oct 04 20:56:34.170440 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 20:56:34.170440 n-d-854823-8 devstack@n-api.service[128801]: exception: Instance 913a7627-5c81-4c33-858b-35ac9adeb4da could not be found. Oct 04 20:56:34.170440 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': '913a7627-5c81-4c33-858b-35ac9adeb4da'} Oct 04 20:56:34.170440 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:56:34.170440 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:56:34.170440 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:56:34.170440 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:56:34.170440 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:56:34.170440 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:56:34.170440 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:56:34.170440 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:56:34.170440 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:56:34.170440 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:56:34.170440 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 913a7627-5c81-4c33-858b-35ac9adeb4da could not be found. Oct 04 20:56:34.170440 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:56:34.170440 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:56:34.170440 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:56:34.170440 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:56:34.170440 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:56:34.170440 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:56:34.170440 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:56:34.170440 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:56:34.170440 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:56:34.170440 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:56:34.170440 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:56:34.170440 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:56:34.170440 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:56:34.170440 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:56:34.170440 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:56:34.170440 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:56:34.170440 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 913a7627-5c81-4c33-858b-35ac9adeb4da could not be found. Oct 04 20:56:34.170440 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:56:34.170440 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:56:34.170440 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:56:34.174896 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:56:34.174896 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:56:34.174896 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:56:34.174896 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:56:34.174896 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:56:34.174896 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 913a7627-5c81-4c33-858b-35ac9adeb4da could not be found. Oct 04 20:56:34.174896 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:56:34.176222 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d3ccfc88-b0fa-4cac-ab1d-f4196115bcea tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] Returning 404 to user: Instance 913a7627-5c81-4c33-858b-35ac9adeb4da could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:56:34.183530 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d3ccfc88-b0fa-4cac-ab1d-f4196115bcea tempest-ServerShowV257Test-920402868 tempest-ServerShowV257Test-920402868-project] 10.222.0.33 "GET /compute/v2.1/servers/913a7627-5c81-4c33-858b-35ac9adeb4da" status: 404 len: 111 microversion: 2.57 time: 0.091155 Oct 04 20:56:34.189282 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2255/4549] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:56:34 2022] GET /compute/v2.1/servers/913a7627-5c81-4c33-858b-35ac9adeb4da => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 20:56:53.606847 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_api:SELECT=68,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:56:53.607849 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=61,nova_cell1:INSERT=1 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:56:54.235259 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-c2c8ea81-4bf7-4082-9636-f5268002ffa7 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServersNegativeTestJSON-server-963081896", "imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63", "flavorRef": "452", "min_count": 3, "networks": [{"uuid": "a8281eed-77bc-4ed4-9c72-2fdf6649c4b9"}]}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:56:54.348246 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.network.neutron [None req-c2c8ea81-4bf7-4082-9636-f5268002ffa7 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] validate_networks() for [('a8281eed-77bc-4ed4-9c72-2fdf6649c4b9', None, None, None, None, None)] {{(pid=128802) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:56:55.123596 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-c2c8ea81-4bf7-4082-9636-f5268002ffa7 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Flavor limits 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:56:55.124061 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-c2c8ea81-4bf7-4082-9636-f5268002ffa7 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Image limits 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:56:55.124188 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-c2c8ea81-4bf7-4082-9636-f5268002ffa7 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Flavor pref 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:56:55.125184 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-c2c8ea81-4bf7-4082-9636-f5268002ffa7 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Image pref 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:56:55.126073 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-c2c8ea81-4bf7-4082-9636-f5268002ffa7 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:56:55.153556 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c2c8ea81-4bf7-4082-9636-f5268002ffa7 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:55.156273 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c2c8ea81-4bf7-4082-9636-f5268002ffa7 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:55.157542 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c2c8ea81-4bf7-4082-9636-f5268002ffa7 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:55.158872 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c2c8ea81-4bf7-4082-9636-f5268002ffa7 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:55.159568 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c2c8ea81-4bf7-4082-9636-f5268002ffa7 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:55.160333 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c2c8ea81-4bf7-4082-9636-f5268002ffa7 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:55.187783 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-c2c8ea81-4bf7-4082-9636-f5268002ffa7 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Getting quotas for project 76cb3acdf52a4016b1af1e1a70614243. Resources: {'ram', 'instances', 'cores'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:56:55.198409 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-c2c8ea81-4bf7-4082-9636-f5268002ffa7 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Getting quotas for user cc0d54ecb4da4d1795ff4a6bfe4ebc77 and project 76cb3acdf52a4016b1af1e1a70614243. Resources: {'ram', 'instances', 'cores'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:56:55.222266 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-c2c8ea81-4bf7-4082-9636-f5268002ffa7 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Going to run 3 instances... {{(pid=128802) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:56:55.225593 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-c2c8ea81-4bf7-4082-9636-f5268002ffa7 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] [instance: 5b67418e-7355-4fdd-ada2-7a36dd772d50] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='15b24725-0c99-4bcf-b1fb-907cdf8e2d63',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128802) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:56:55.298571 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-c2c8ea81-4bf7-4082-9636-f5268002ffa7 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] [instance: e078edba-e82a-4a6e-8661-638c352139c4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='15b24725-0c99-4bcf-b1fb-907cdf8e2d63',instance=,instance_uuid=5b67418e-7355-4fdd-ada2-7a36dd772d50,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128802) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:56:55.374710 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-c2c8ea81-4bf7-4082-9636-f5268002ffa7 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] [instance: 9e261662-c010-41bd-a875-8e47b106485b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='15b24725-0c99-4bcf-b1fb-907cdf8e2d63',instance=,instance_uuid=e078edba-e82a-4a6e-8661-638c352139c4,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128802) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:56:55.526928 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-c2c8ea81-4bf7-4082-9636-f5268002ffa7 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.928376 Oct 04 20:56:55.528234 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2295/4550] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 20:56:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 1930 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 20:56:55.541451 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-48f55445-4658-4c73-a296-7e001a36c468 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:56:55.585065 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-48f55445-4658-4c73-a296-7e001a36c468 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cc0d54ecb4da4d1795ff4a6bfe4ebc77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76cb3acdf52a4016b1af1e1a70614243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:56:55.587168 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-48f55445-4658-4c73-a296-7e001a36c468 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Searching by: {'deleted': False, 'project_id': '76cb3acdf52a4016b1af1e1a70614243'} {{(pid=128801) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 20:56:55.590127 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:56:55.590989 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:56:55.716337 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-48f55445-4658-4c73-a296-7e001a36c468 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:55.717034 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-48f55445-4658-4c73-a296-7e001a36c468 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:55.718300 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-48f55445-4658-4c73-a296-7e001a36c468 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:55.719807 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-48f55445-4658-4c73-a296-7e001a36c468 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:55.720482 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-48f55445-4658-4c73-a296-7e001a36c468 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:55.721096 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-48f55445-4658-4c73-a296-7e001a36c468 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:55.774412 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-48f55445-4658-4c73-a296-7e001a36c468 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] 10.222.0.33 "GET /compute/v2.1/servers" status: 200 len: 1015 microversion: 2.1 time: 0.236647 Oct 04 20:56:55.783089 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2256/4551] 10.222.0.33 () {58 vars in 1125 bytes} [Tue Oct 4 20:56:55 2022] GET /compute/v2.1/servers => generated 1015 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:56:55.793323 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-86ff4821-28d4-4ac6-90c3-856c27269cce tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:56:55.794176 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-86ff4821-28d4-4ac6-90c3-856c27269cce tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] [instance: 9e261662-c010-41bd-a875-8e47b106485b] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:56:55.944624 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-86ff4821-28d4-4ac6-90c3-856c27269cce tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0d54ecb4da4d1795ff4a6bfe4ebc77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76cb3acdf52a4016b1af1e1a70614243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:56:55.955001 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-86ff4821-28d4-4ac6-90c3-856c27269cce tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] 10.222.0.33 "GET /compute/v2.1/servers/9e261662-c010-41bd-a875-8e47b106485b" status: 200 len: 1222 microversion: 2.1 time: 0.168723 Oct 04 20:56:55.959790 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2296/4552] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:56:55 2022] GET /compute/v2.1/servers/9e261662-c010-41bd-a875-8e47b106485b => generated 1222 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:56:56.983426 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2af11542-1f98-4d65-92ac-512736bc2140 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:56:56.993936 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-2af11542-1f98-4d65-92ac-512736bc2140 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] [instance: 9e261662-c010-41bd-a875-8e47b106485b] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:56:57.296167 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-2af11542-1f98-4d65-92ac-512736bc2140 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0d54ecb4da4d1795ff4a6bfe4ebc77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76cb3acdf52a4016b1af1e1a70614243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:56:57.306751 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-2af11542-1f98-4d65-92ac-512736bc2140 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] 10.222.0.33 "GET /compute/v2.1/servers/9e261662-c010-41bd-a875-8e47b106485b" status: 200 len: 1222 microversion: 2.1 time: 0.327471 Oct 04 20:56:57.311555 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2257/4553] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:56:56 2022] GET /compute/v2.1/servers/9e261662-c010-41bd-a875-8e47b106485b => generated 1222 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:56:58.336171 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-e1de04f1-bf75-4913-953d-0573eb4ecf1c tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:56:58.337463 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-e1de04f1-bf75-4913-953d-0573eb4ecf1c tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] [instance: 9e261662-c010-41bd-a875-8e47b106485b] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:56:58.354261 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e1de04f1-bf75-4913-953d-0573eb4ecf1c tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:58.355881 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e1de04f1-bf75-4913-953d-0573eb4ecf1c tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:58.357841 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e1de04f1-bf75-4913-953d-0573eb4ecf1c tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:58.362861 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e1de04f1-bf75-4913-953d-0573eb4ecf1c tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:58.363875 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e1de04f1-bf75-4913-953d-0573eb4ecf1c tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:58.364586 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e1de04f1-bf75-4913-953d-0573eb4ecf1c tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:58.566430 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-e1de04f1-bf75-4913-953d-0573eb4ecf1c tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0d54ecb4da4d1795ff4a6bfe4ebc77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76cb3acdf52a4016b1af1e1a70614243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:56:58.582877 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-e1de04f1-bf75-4913-953d-0573eb4ecf1c tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] 10.222.0.33 "GET /compute/v2.1/servers/9e261662-c010-41bd-a875-8e47b106485b" status: 200 len: 1218 microversion: 2.1 time: 0.252202 Oct 04 20:56:58.583493 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2297/4554] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:56:58 2022] GET /compute/v2.1/servers/9e261662-c010-41bd-a875-8e47b106485b => generated 1218 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:56:59.613589 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-bee8770d-bf58-437f-936f-de615116d5bf tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:56:59.615302 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-bee8770d-bf58-437f-936f-de615116d5bf tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] [instance: 9e261662-c010-41bd-a875-8e47b106485b] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:56:59.639623 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bee8770d-bf58-437f-936f-de615116d5bf tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:59.643088 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bee8770d-bf58-437f-936f-de615116d5bf tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:59.644253 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bee8770d-bf58-437f-936f-de615116d5bf tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:59.659947 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bee8770d-bf58-437f-936f-de615116d5bf tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:56:59.663136 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bee8770d-bf58-437f-936f-de615116d5bf tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:56:59.663715 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bee8770d-bf58-437f-936f-de615116d5bf tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:56:59.857221 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-bee8770d-bf58-437f-936f-de615116d5bf tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0d54ecb4da4d1795ff4a6bfe4ebc77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76cb3acdf52a4016b1af1e1a70614243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:56:59.865451 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-bee8770d-bf58-437f-936f-de615116d5bf tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] 10.222.0.33 "GET /compute/v2.1/servers/9e261662-c010-41bd-a875-8e47b106485b" status: 200 len: 1274 microversion: 2.1 time: 0.257346 Oct 04 20:56:59.870745 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2258/4555] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:56:59 2022] GET /compute/v2.1/servers/9e261662-c010-41bd-a875-8e47b106485b => generated 1274 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:57:00.900414 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-4d037777-482e-4cb3-8272-f7de0a7dcb50 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:00.901036 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-4d037777-482e-4cb3-8272-f7de0a7dcb50 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] [instance: 9e261662-c010-41bd-a875-8e47b106485b] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:57:00.917875 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4d037777-482e-4cb3-8272-f7de0a7dcb50 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:00.918838 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4d037777-482e-4cb3-8272-f7de0a7dcb50 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:00.919537 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4d037777-482e-4cb3-8272-f7de0a7dcb50 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:00.920719 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4d037777-482e-4cb3-8272-f7de0a7dcb50 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:00.921328 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4d037777-482e-4cb3-8272-f7de0a7dcb50 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:00.922033 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4d037777-482e-4cb3-8272-f7de0a7dcb50 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:02.228215 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-4d037777-482e-4cb3-8272-f7de0a7dcb50 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0d54ecb4da4d1795ff4a6bfe4ebc77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76cb3acdf52a4016b1af1e1a70614243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:57:02.244465 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-4d037777-482e-4cb3-8272-f7de0a7dcb50 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] 10.222.0.33 "GET /compute/v2.1/servers/9e261662-c010-41bd-a875-8e47b106485b" status: 200 len: 1280 microversion: 2.1 time: 1.353365 Oct 04 20:57:02.248220 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2298/4556] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:57:00 2022] GET /compute/v2.1/servers/9e261662-c010-41bd-a875-8e47b106485b => generated 1280 bytes in 1359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:57:03.273187 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-87204adb-4040-474e-877b-86715ec0d831 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:03.273830 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-87204adb-4040-474e-877b-86715ec0d831 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] [instance: 9e261662-c010-41bd-a875-8e47b106485b] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:57:03.285502 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-87204adb-4040-474e-877b-86715ec0d831 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:03.288109 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-87204adb-4040-474e-877b-86715ec0d831 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:03.289865 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-87204adb-4040-474e-877b-86715ec0d831 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:03.290741 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-87204adb-4040-474e-877b-86715ec0d831 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:03.291179 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-87204adb-4040-474e-877b-86715ec0d831 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:03.291615 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-87204adb-4040-474e-877b-86715ec0d831 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:03.704300 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-01813574-cf27-4af0-9908-7a9ed311577b tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1905993830", "imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63", "flavorRef": "452", "networks": [{"uuid": "780a66b6-435f-46df-9c7b-6f763e190356"}]}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:57:03.829114 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.network.neutron [None req-01813574-cf27-4af0-9908-7a9ed311577b tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] validate_networks() for [('780a66b6-435f-46df-9c7b-6f763e190356', None, None, None, None, None)] {{(pid=128801) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:57:04.114422 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-87204adb-4040-474e-877b-86715ec0d831 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0d54ecb4da4d1795ff4a6bfe4ebc77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76cb3acdf52a4016b1af1e1a70614243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:57:04.125019 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-87204adb-4040-474e-877b-86715ec0d831 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] 10.222.0.33 "GET /compute/v2.1/servers/9e261662-c010-41bd-a875-8e47b106485b" status: 200 len: 1280 microversion: 2.1 time: 0.857435 Oct 04 20:57:04.128491 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2299/4557] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:57:03 2022] GET /compute/v2.1/servers/9e261662-c010-41bd-a875-8e47b106485b => generated 1280 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:57:05.154751 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-6004ea3f-8561-462a-a39c-2603f6fb2d97 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:05.156479 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-6004ea3f-8561-462a-a39c-2603f6fb2d97 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] [instance: 9e261662-c010-41bd-a875-8e47b106485b] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:57:05.171825 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6004ea3f-8561-462a-a39c-2603f6fb2d97 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:05.172347 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6004ea3f-8561-462a-a39c-2603f6fb2d97 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:05.175157 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6004ea3f-8561-462a-a39c-2603f6fb2d97 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:05.176335 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6004ea3f-8561-462a-a39c-2603f6fb2d97 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:05.178497 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6004ea3f-8561-462a-a39c-2603f6fb2d97 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:05.179024 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6004ea3f-8561-462a-a39c-2603f6fb2d97 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:05.179516 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell0:SELECT=2 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:57:05.753842 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:57:05.780890 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-6004ea3f-8561-462a-a39c-2603f6fb2d97 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0d54ecb4da4d1795ff4a6bfe4ebc77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76cb3acdf52a4016b1af1e1a70614243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:57:05.797047 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-6004ea3f-8561-462a-a39c-2603f6fb2d97 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] 10.222.0.33 "GET /compute/v2.1/servers/9e261662-c010-41bd-a875-8e47b106485b" status: 200 len: 1280 microversion: 2.1 time: 0.646609 Oct 04 20:57:05.797657 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2300/4558] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:57:05 2022] GET /compute/v2.1/servers/9e261662-c010-41bd-a875-8e47b106485b => generated 1280 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:57:05.989192 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-01813574-cf27-4af0-9908-7a9ed311577b tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Flavor limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:57:05.989946 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-01813574-cf27-4af0-9908-7a9ed311577b tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Image limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:57:05.990915 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-01813574-cf27-4af0-9908-7a9ed311577b tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Flavor pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:57:05.991384 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-01813574-cf27-4af0-9908-7a9ed311577b tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Image pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:57:05.991807 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-01813574-cf27-4af0-9908-7a9ed311577b tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:57:06.013454 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-01813574-cf27-4af0-9908-7a9ed311577b tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:06.019106 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-01813574-cf27-4af0-9908-7a9ed311577b tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:06.019319 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-01813574-cf27-4af0-9908-7a9ed311577b tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:06.024530 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-01813574-cf27-4af0-9908-7a9ed311577b tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:06.028831 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-01813574-cf27-4af0-9908-7a9ed311577b tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:06.029312 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-01813574-cf27-4af0-9908-7a9ed311577b tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:06.128644 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-01813574-cf27-4af0-9908-7a9ed311577b tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Getting quotas for project 65946afc398d4a9fb1c9095a4f946e07. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:57:06.157777 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-01813574-cf27-4af0-9908-7a9ed311577b tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Getting quotas for user 6513f5e908ac4d028cad6eeeebeab285 and project 65946afc398d4a9fb1c9095a4f946e07. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:57:06.198644 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-01813574-cf27-4af0-9908-7a9ed311577b tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Going to run 1 instances... {{(pid=128801) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:57:06.202242 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-01813574-cf27-4af0-9908-7a9ed311577b tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] [instance: 320f9a98-969f-473e-bc56-842bbd28dedc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='15b24725-0c99-4bcf-b1fb-907cdf8e2d63',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128801) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:57:06.337998 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-01813574-cf27-4af0-9908-7a9ed311577b tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.280704 Oct 04 20:57:06.350856 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-a191c2f2-a9d3-479a-a8d9-67f74b66302f tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:06.351548 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-a191c2f2-a9d3-479a-a8d9-67f74b66302f tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] [instance: 320f9a98-969f-473e-bc56-842bbd28dedc] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:57:06.353697 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2259/4559] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 20:57:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 3297 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 20:57:06.353861 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell0:SELECT=8 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:57:06.691547 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-a191c2f2-a9d3-479a-a8d9-67f74b66302f tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6513f5e908ac4d028cad6eeeebeab285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65946afc398d4a9fb1c9095a4f946e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:57:06.706898 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-a191c2f2-a9d3-479a-a8d9-67f74b66302f tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc" status: 200 len: 1217 microversion: 2.1 time: 0.360524 Oct 04 20:57:06.708770 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2301/4560] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:57:06 2022] GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc => generated 1217 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:57:06.822238 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-03a0ea23-3aef-4f24-a5f2-d97a8ac364b7 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:06.823603 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-03a0ea23-3aef-4f24-a5f2-d97a8ac364b7 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] [instance: 9e261662-c010-41bd-a875-8e47b106485b] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:57:06.831840 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-03a0ea23-3aef-4f24-a5f2-d97a8ac364b7 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:06.832622 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-03a0ea23-3aef-4f24-a5f2-d97a8ac364b7 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:06.833242 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-03a0ea23-3aef-4f24-a5f2-d97a8ac364b7 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:06.834273 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-03a0ea23-3aef-4f24-a5f2-d97a8ac364b7 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:06.835046 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-03a0ea23-3aef-4f24-a5f2-d97a8ac364b7 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:06.835754 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-03a0ea23-3aef-4f24-a5f2-d97a8ac364b7 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:07.732073 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-aa15b0c5-cd23-43a6-af9d-7e7b5f753c80 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:07.732529 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-aa15b0c5-cd23-43a6-af9d-7e7b5f753c80 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] [instance: 320f9a98-969f-473e-bc56-842bbd28dedc] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:57:07.753415 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-aa15b0c5-cd23-43a6-af9d-7e7b5f753c80 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:07.753923 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-aa15b0c5-cd23-43a6-af9d-7e7b5f753c80 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:07.764876 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-aa15b0c5-cd23-43a6-af9d-7e7b5f753c80 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:07.765729 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-aa15b0c5-cd23-43a6-af9d-7e7b5f753c80 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:07.766225 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-aa15b0c5-cd23-43a6-af9d-7e7b5f753c80 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:07.766693 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-aa15b0c5-cd23-43a6-af9d-7e7b5f753c80 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:08.756728 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-03a0ea23-3aef-4f24-a5f2-d97a8ac364b7 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0d54ecb4da4d1795ff4a6bfe4ebc77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76cb3acdf52a4016b1af1e1a70614243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:57:08.767416 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-03a0ea23-3aef-4f24-a5f2-d97a8ac364b7 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] 10.222.0.33 "GET /compute/v2.1/servers/9e261662-c010-41bd-a875-8e47b106485b" status: 200 len: 1322 microversion: 2.1 time: 1.951132 Oct 04 20:57:08.768347 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2260/4561] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:57:06 2022] GET /compute/v2.1/servers/9e261662-c010-41bd-a875-8e47b106485b => generated 1322 bytes in 1953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:57:09.058391 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-aa15b0c5-cd23-43a6-af9d-7e7b5f753c80 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6513f5e908ac4d028cad6eeeebeab285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65946afc398d4a9fb1c9095a4f946e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:57:09.086472 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-aa15b0c5-cd23-43a6-af9d-7e7b5f753c80 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc" status: 200 len: 1213 microversion: 2.1 time: 1.359090 Oct 04 20:57:09.087849 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2302/4562] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:57:07 2022] GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc => generated 1213 bytes in 1361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:57:09.795427 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-46bade4c-2728-4e2e-a30e-0069c5a4b79f tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:09.796199 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-46bade4c-2728-4e2e-a30e-0069c5a4b79f tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] [instance: 9e261662-c010-41bd-a875-8e47b106485b] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:57:09.815122 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-46bade4c-2728-4e2e-a30e-0069c5a4b79f tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:09.816061 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-46bade4c-2728-4e2e-a30e-0069c5a4b79f tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:09.818942 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-46bade4c-2728-4e2e-a30e-0069c5a4b79f tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:09.819939 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-46bade4c-2728-4e2e-a30e-0069c5a4b79f tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:09.820925 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-46bade4c-2728-4e2e-a30e-0069c5a4b79f tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:09.824739 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-46bade4c-2728-4e2e-a30e-0069c5a4b79f tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:10.122425 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-99fccfa3-8c40-4bdf-ab4e-e3097f51f46b tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:10.123030 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-99fccfa3-8c40-4bdf-ab4e-e3097f51f46b tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] [instance: 320f9a98-969f-473e-bc56-842bbd28dedc] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:57:10.142527 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-99fccfa3-8c40-4bdf-ab4e-e3097f51f46b tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:10.143244 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-99fccfa3-8c40-4bdf-ab4e-e3097f51f46b tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:10.143939 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-99fccfa3-8c40-4bdf-ab4e-e3097f51f46b tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:10.144863 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-99fccfa3-8c40-4bdf-ab4e-e3097f51f46b tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:10.145637 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-99fccfa3-8c40-4bdf-ab4e-e3097f51f46b tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:10.147081 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-99fccfa3-8c40-4bdf-ab4e-e3097f51f46b tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:10.320122 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-99fccfa3-8c40-4bdf-ab4e-e3097f51f46b tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6513f5e908ac4d028cad6eeeebeab285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65946afc398d4a9fb1c9095a4f946e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:57:10.328738 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-99fccfa3-8c40-4bdf-ab4e-e3097f51f46b tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc" status: 200 len: 1275 microversion: 2.1 time: 0.210456 Oct 04 20:57:10.329806 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2303/4563] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:57:10 2022] GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc => generated 1275 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:57:11.001512 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-46bade4c-2728-4e2e-a30e-0069c5a4b79f tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0d54ecb4da4d1795ff4a6bfe4ebc77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76cb3acdf52a4016b1af1e1a70614243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:57:11.012003 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-46bade4c-2728-4e2e-a30e-0069c5a4b79f tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] 10.222.0.33 "GET /compute/v2.1/servers/9e261662-c010-41bd-a875-8e47b106485b" status: 200 len: 1322 microversion: 2.1 time: 1.221411 Oct 04 20:57:11.013552 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2261/4564] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:57:09 2022] GET /compute/v2.1/servers/9e261662-c010-41bd-a875-8e47b106485b => generated 1322 bytes in 1224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:57:11.194701 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-edea9986-d5f6-40de-a834-fcab6ce6aaea req-a13ca8a6-da3a-4d6a-808f-85777910398d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e078edba-e82a-4a6e-8661-638c352139c4", "tag": "4423cf51-b7b4-4c1a-b717-d56a01d2cc5c"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:57:11.221716 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-edea9986-d5f6-40de-a834-fcab6ce6aaea req-a13ca8a6-da3a-4d6a-808f-85777910398d service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:11.222514 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-edea9986-d5f6-40de-a834-fcab6ce6aaea req-a13ca8a6-da3a-4d6a-808f-85777910398d service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:11.223159 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-edea9986-d5f6-40de-a834-fcab6ce6aaea req-a13ca8a6-da3a-4d6a-808f-85777910398d service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:11.241135 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-edea9986-d5f6-40de-a834-fcab6ce6aaea req-a13ca8a6-da3a-4d6a-808f-85777910398d service nova] Creating event network-changed:4423cf51-b7b4-4c1a-b717-d56a01d2cc5c for instance e078edba-e82a-4a6e-8661-638c352139c4 on n-h2-854823-8 Oct 04 20:57:11.253998 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-edea9986-d5f6-40de-a834-fcab6ce6aaea req-a13ca8a6-da3a-4d6a-808f-85777910398d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064098 Oct 04 20:57:11.255321 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2304/4565] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:57:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:57:11.352134 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1a7500a2-6072-42b3-abc1-f2bcd8d2e1b3 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:11.352748 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-1a7500a2-6072-42b3-abc1-f2bcd8d2e1b3 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] [instance: 320f9a98-969f-473e-bc56-842bbd28dedc] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:57:11.361166 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1a7500a2-6072-42b3-abc1-f2bcd8d2e1b3 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:11.361674 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1a7500a2-6072-42b3-abc1-f2bcd8d2e1b3 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:11.362095 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1a7500a2-6072-42b3-abc1-f2bcd8d2e1b3 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:11.362838 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1a7500a2-6072-42b3-abc1-f2bcd8d2e1b3 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:11.363291 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1a7500a2-6072-42b3-abc1-f2bcd8d2e1b3 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:11.363714 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1a7500a2-6072-42b3-abc1-f2bcd8d2e1b3 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:11.731176 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-1a7500a2-6072-42b3-abc1-f2bcd8d2e1b3 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6513f5e908ac4d028cad6eeeebeab285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65946afc398d4a9fb1c9095a4f946e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:57:11.745376 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-1a7500a2-6072-42b3-abc1-f2bcd8d2e1b3 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc" status: 200 len: 1275 microversion: 2.1 time: 0.396202 Oct 04 20:57:11.748372 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2262/4566] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:57:11 2022] GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc => generated 1275 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:57:11.750254 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-d21b380d-47ff-4c19-a85e-2926d3e926ce req-4dd087ce-dfe6-4c27-87e5-17983e581e2d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b67418e-7355-4fdd-ada2-7a36dd772d50", "tag": "2bcb6757-3e87-4ab6-acff-94770b3a1854"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:57:11.771647 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-d21b380d-47ff-4c19-a85e-2926d3e926ce req-4dd087ce-dfe6-4c27-87e5-17983e581e2d service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:11.772240 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-d21b380d-47ff-4c19-a85e-2926d3e926ce req-4dd087ce-dfe6-4c27-87e5-17983e581e2d service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:11.773008 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-d21b380d-47ff-4c19-a85e-2926d3e926ce req-4dd087ce-dfe6-4c27-87e5-17983e581e2d service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:11.789566 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-d21b380d-47ff-4c19-a85e-2926d3e926ce req-4dd087ce-dfe6-4c27-87e5-17983e581e2d service nova] Creating event network-changed:2bcb6757-3e87-4ab6-acff-94770b3a1854 for instance 5b67418e-7355-4fdd-ada2-7a36dd772d50 on n-h1-854823-8 Oct 04 20:57:11.797443 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-d21b380d-47ff-4c19-a85e-2926d3e926ce req-4dd087ce-dfe6-4c27-87e5-17983e581e2d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056284 Oct 04 20:57:11.798876 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2305/4567] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:57:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 20:57:12.038680 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a68117db-b3a7-4fe0-b758-89cd98a26931 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:12.040106 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a68117db-b3a7-4fe0-b758-89cd98a26931 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] [instance: 9e261662-c010-41bd-a875-8e47b106485b] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:57:12.064963 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a68117db-b3a7-4fe0-b758-89cd98a26931 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:12.066917 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a68117db-b3a7-4fe0-b758-89cd98a26931 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:12.068928 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a68117db-b3a7-4fe0-b758-89cd98a26931 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:12.069925 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a68117db-b3a7-4fe0-b758-89cd98a26931 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:12.073049 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a68117db-b3a7-4fe0-b758-89cd98a26931 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:12.074675 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a68117db-b3a7-4fe0-b758-89cd98a26931 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:12.794125 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-15cb8c62-920f-410d-9523-a678975be225 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:12.799049 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-15cb8c62-920f-410d-9523-a678975be225 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] [instance: 320f9a98-969f-473e-bc56-842bbd28dedc] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:57:12.855506 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-15cb8c62-920f-410d-9523-a678975be225 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:12.861077 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-15cb8c62-920f-410d-9523-a678975be225 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:12.868788 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-15cb8c62-920f-410d-9523-a678975be225 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:12.872904 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-15cb8c62-920f-410d-9523-a678975be225 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:12.873436 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-15cb8c62-920f-410d-9523-a678975be225 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:12.878614 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-15cb8c62-920f-410d-9523-a678975be225 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:13.886134 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-15cb8c62-920f-410d-9523-a678975be225 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6513f5e908ac4d028cad6eeeebeab285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65946afc398d4a9fb1c9095a4f946e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:57:13.895947 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-15cb8c62-920f-410d-9523-a678975be225 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc" status: 200 len: 1275 microversion: 2.1 time: 1.129930 Oct 04 20:57:13.900132 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2306/4568] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:57:12 2022] GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc => generated 1275 bytes in 1135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:57:14.419545 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-a68117db-b3a7-4fe0-b758-89cd98a26931 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0d54ecb4da4d1795ff4a6bfe4ebc77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76cb3acdf52a4016b1af1e1a70614243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:57:14.428906 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a68117db-b3a7-4fe0-b758-89cd98a26931 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] 10.222.0.33 "GET /compute/v2.1/servers/9e261662-c010-41bd-a875-8e47b106485b" status: 200 len: 1322 microversion: 2.1 time: 2.396240 Oct 04 20:57:14.437331 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2263/4569] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:57:12 2022] GET /compute/v2.1/servers/9e261662-c010-41bd-a875-8e47b106485b => generated 1322 bytes in 2406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:57:14.439319 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-a6207146-922d-4f0e-ae3b-d172dccebd02 tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Action: 'create', calling method: .version_select at 0x7f3c74198670>, body: {"server_group": {"name": "tempest-ServerGroupTestJSON-Server-Group-1515259120", "policies": ["affinity"]}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:57:14.456952 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-5097136c-0f18-40d4-819f-d70cfd114f15 req-2965e220-2cca-4547-abe3-13a5cfc61f96 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e261662-c010-41bd-a875-8e47b106485b", "tag": "bdf38a71-dc68-47d2-8e91-13ca82211cf4"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:57:14.497905 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-5097136c-0f18-40d4-819f-d70cfd114f15 req-2965e220-2cca-4547-abe3-13a5cfc61f96 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:14.498996 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-5097136c-0f18-40d4-819f-d70cfd114f15 req-2965e220-2cca-4547-abe3-13a5cfc61f96 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:14.500347 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-5097136c-0f18-40d4-819f-d70cfd114f15 req-2965e220-2cca-4547-abe3-13a5cfc61f96 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:14.503614 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-a6207146-922d-4f0e-ae3b-d172dccebd02 tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Getting quotas for project b3351642441347c4badf854104a0f38a. Resources: {'server_groups'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:57:14.531896 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-a6207146-922d-4f0e-ae3b-d172dccebd02 tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Getting quotas for user f9ce92a1863c43e387f3410c3f7081b5 and project b3351642441347c4badf854104a0f38a. Resources: {'server_groups'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:57:14.541346 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-5097136c-0f18-40d4-819f-d70cfd114f15 req-2965e220-2cca-4547-abe3-13a5cfc61f96 service nova] Creating event network-changed:bdf38a71-dc68-47d2-8e91-13ca82211cf4 for instance 9e261662-c010-41bd-a875-8e47b106485b on n-h2-854823-8 Oct 04 20:57:14.552181 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-5097136c-0f18-40d4-819f-d70cfd114f15 req-2965e220-2cca-4547-abe3-13a5cfc61f96 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108773 Oct 04 20:57:14.554191 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2264/4570] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:57:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:57:14.711039 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-a6207146-922d-4f0e-ae3b-d172dccebd02 tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Getting quotas for project b3351642441347c4badf854104a0f38a. Resources: {'server_groups'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:57:14.725585 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-a6207146-922d-4f0e-ae3b-d172dccebd02 tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Getting quotas for user f9ce92a1863c43e387f3410c3f7081b5 and project b3351642441347c4badf854104a0f38a. Resources: {'server_groups'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:57:14.765783 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-a6207146-922d-4f0e-ae3b-d172dccebd02 tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] 10.222.0.33 "POST /compute/v2.1/os-server-groups" status: 200 len: 184 microversion: 2.1 time: 0.863334 Oct 04 20:57:14.766432 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2307/4571] 10.222.0.33 () {60 vars in 1174 bytes} [Tue Oct 4 20:57:13 2022] POST /compute/v2.1/os-server-groups => generated 184 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:57:14.782041 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-59114c93-59de-4369-bd12-8437a4f6d648 tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Action: 'create', calling method: .version_select at 0x7f3c6fa3e550>, body: {"server_group": {"name": "tempest-server-group-1257452780", "policies": ["affinity"]}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:57:14.827509 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-59114c93-59de-4369-bd12-8437a4f6d648 tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Getting quotas for project b3351642441347c4badf854104a0f38a. Resources: {'server_groups'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:57:14.835413 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-59114c93-59de-4369-bd12-8437a4f6d648 tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Getting quotas for user f9ce92a1863c43e387f3410c3f7081b5 and project b3351642441347c4badf854104a0f38a. Resources: {'server_groups'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:57:14.924541 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-59114c93-59de-4369-bd12-8437a4f6d648 tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Getting quotas for project b3351642441347c4badf854104a0f38a. Resources: {'server_groups'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:57:14.927924 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-cf47a54b-37f1-43e5-99d2-db61ed3fcc5b tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:14.928955 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-cf47a54b-37f1-43e5-99d2-db61ed3fcc5b tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] [instance: 320f9a98-969f-473e-bc56-842bbd28dedc] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:57:14.933441 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-59114c93-59de-4369-bd12-8437a4f6d648 tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Getting quotas for user f9ce92a1863c43e387f3410c3f7081b5 and project b3351642441347c4badf854104a0f38a. Resources: {'server_groups'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:57:14.941196 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cf47a54b-37f1-43e5-99d2-db61ed3fcc5b tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:14.946428 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cf47a54b-37f1-43e5-99d2-db61ed3fcc5b tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:14.947233 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cf47a54b-37f1-43e5-99d2-db61ed3fcc5b tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:14.952777 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cf47a54b-37f1-43e5-99d2-db61ed3fcc5b tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:14.961569 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cf47a54b-37f1-43e5-99d2-db61ed3fcc5b tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:14.962713 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cf47a54b-37f1-43e5-99d2-db61ed3fcc5b tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:14.965204 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-59114c93-59de-4369-bd12-8437a4f6d648 tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] 10.222.0.33 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.180185 Oct 04 20:57:14.982433 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2265/4572] 10.222.0.33 () {60 vars in 1173 bytes} [Tue Oct 4 20:57:14 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:57:15.001280 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6cea600e-e259-44b5-9e57-5c5bcc0eeea9 tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Action: 'create', calling method: .version_select at 0x7f3c6f510040>, body: {"server_group": {"name": "tempest-server-group-1257452780", "policies": ["affinity"]}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:57:15.029288 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-6cea600e-e259-44b5-9e57-5c5bcc0eeea9 tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Getting quotas for project b3351642441347c4badf854104a0f38a. Resources: {'server_groups'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:57:15.038775 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-6cea600e-e259-44b5-9e57-5c5bcc0eeea9 tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Getting quotas for user f9ce92a1863c43e387f3410c3f7081b5 and project b3351642441347c4badf854104a0f38a. Resources: {'server_groups'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:57:15.140775 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-6cea600e-e259-44b5-9e57-5c5bcc0eeea9 tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Getting quotas for project b3351642441347c4badf854104a0f38a. Resources: {'server_groups'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:57:15.170684 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-6cea600e-e259-44b5-9e57-5c5bcc0eeea9 tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Getting quotas for user f9ce92a1863c43e387f3410c3f7081b5 and project b3351642441347c4badf854104a0f38a. Resources: {'server_groups'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:57:15.228679 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-6cea600e-e259-44b5-9e57-5c5bcc0eeea9 tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] 10.222.0.33 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.242849 Oct 04 20:57:15.230430 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2266/4573] 10.222.0.33 () {60 vars in 1173 bytes} [Tue Oct 4 20:57:14 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:57:15.242848 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-93652de7-af0d-476c-b170-dac45945fbeb tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:15.327218 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-93652de7-af0d-476c-b170-dac45945fbeb tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] 10.222.0.33 "DELETE /compute/v2.1/os-server-groups/56e0b05e-3abf-4906-9ee2-629c3eb80dd5" status: 204 len: 0 microversion: 2.1 time: 0.089876 Oct 04 20:57:15.328181 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2267/4574] 10.222.0.33 () {58 vars in 1266 bytes} [Tue Oct 4 20:57:15 2022] DELETE /compute/v2.1/os-server-groups/56e0b05e-3abf-4906-9ee2-629c3eb80dd5 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 20:57:15.340327 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b8fe06b6-afed-480f-aa64-8b903f1cf70d tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:15.400340 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b8fe06b6-afed-480f-aa64-8b903f1cf70d tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] 10.222.0.33 "GET /compute/v2.1/os-server-groups" status: 200 len: 335 microversion: 2.1 time: 0.067728 Oct 04 20:57:15.409015 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2268/4575] 10.222.0.33 () {58 vars in 1152 bytes} [Tue Oct 4 20:57:15 2022] GET /compute/v2.1/os-server-groups => generated 335 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:57:15.419688 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-79804147-7acb-4adb-9036-48427dde04b2 tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:15.423826 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=7,nova_api:DELETE=3 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:57:15.487447 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-79804147-7acb-4adb-9036-48427dde04b2 tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] 10.222.0.33 "DELETE /compute/v2.1/os-server-groups/b2c68336-1bd9-4ff4-811d-3d1495de46f0" status: 204 len: 0 microversion: 2.1 time: 0.075867 Oct 04 20:57:15.492220 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2269/4576] 10.222.0.33 () {58 vars in 1266 bytes} [Tue Oct 4 20:57:15 2022] DELETE /compute/v2.1/os-server-groups/b2c68336-1bd9-4ff4-811d-3d1495de46f0 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:57:15.497277 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-edbbad18-c2d5-4128-95cc-897daa1f115c tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:15.498314 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-edbbad18-c2d5-4128-95cc-897daa1f115c tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] [instance: 9e261662-c010-41bd-a875-8e47b106485b] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:57:15.517407 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-edbbad18-c2d5-4128-95cc-897daa1f115c tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:15.517919 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-edbbad18-c2d5-4128-95cc-897daa1f115c tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:15.518403 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-edbbad18-c2d5-4128-95cc-897daa1f115c tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:15.519431 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-edbbad18-c2d5-4128-95cc-897daa1f115c tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:15.519601 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-edbbad18-c2d5-4128-95cc-897daa1f115c tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:15.520020 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-edbbad18-c2d5-4128-95cc-897daa1f115c tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:15.554030 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-cf47a54b-37f1-43e5-99d2-db61ed3fcc5b tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6513f5e908ac4d028cad6eeeebeab285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65946afc398d4a9fb1c9095a4f946e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:57:15.569582 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-cf47a54b-37f1-43e5-99d2-db61ed3fcc5b tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc" status: 200 len: 1317 microversion: 2.1 time: 0.648323 Oct 04 20:57:15.570334 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2308/4577] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:57:14 2022] GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc => generated 1317 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:57:15.617263 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-8e64c765-97f5-4440-bed2-e3892df32ec4 tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:15.665421 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-8e64c765-97f5-4440-bed2-e3892df32ec4 tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] 10.222.0.33 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.065816 Oct 04 20:57:15.666025 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2309/4578] 10.222.0.33 () {58 vars in 1152 bytes} [Tue Oct 4 20:57:15 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:57:15.696757 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-d5ded02c-a8c3-4b02-9d0b-9b2e1e07da5d tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Action: 'create', calling method: .version_select at 0x7f3c6f5f7b80>, body: {"server_group": {"name": "tempest-server-group-450262005", "policies": ["affinity"]}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:57:15.756312 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-d5ded02c-a8c3-4b02-9d0b-9b2e1e07da5d tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Getting quotas for project b3351642441347c4badf854104a0f38a. Resources: {'server_groups'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:57:15.764978 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-d5ded02c-a8c3-4b02-9d0b-9b2e1e07da5d tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Getting quotas for user f9ce92a1863c43e387f3410c3f7081b5 and project b3351642441347c4badf854104a0f38a. Resources: {'server_groups'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:57:15.858587 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=13 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:57:15.872242 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-d5ded02c-a8c3-4b02-9d0b-9b2e1e07da5d tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Getting quotas for project b3351642441347c4badf854104a0f38a. Resources: {'server_groups'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:57:15.878008 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-d5ded02c-a8c3-4b02-9d0b-9b2e1e07da5d tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Getting quotas for user f9ce92a1863c43e387f3410c3f7081b5 and project b3351642441347c4badf854104a0f38a. Resources: {'server_groups'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:57:15.896688 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-d5ded02c-a8c3-4b02-9d0b-9b2e1e07da5d tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] 10.222.0.33 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.216384 Oct 04 20:57:15.908304 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2310/4579] 10.222.0.33 () {60 vars in 1173 bytes} [Tue Oct 4 20:57:15 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:57:15.914327 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-6b1c62dc-90b0-4822-8984-39bdc931a36c tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:15.965433 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-6b1c62dc-90b0-4822-8984-39bdc931a36c tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] 10.222.0.33 "DELETE /compute/v2.1/os-server-groups/cc3ef969-e0b3-44d1-81da-56bd4fd111f6" status: 204 len: 0 microversion: 2.1 time: 0.055455 Oct 04 20:57:15.967201 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2311/4580] 10.222.0.33 () {58 vars in 1266 bytes} [Tue Oct 4 20:57:15 2022] DELETE /compute/v2.1/os-server-groups/cc3ef969-e0b3-44d1-81da-56bd4fd111f6 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:57:15.977474 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-eff48fcb-e0c8-483f-8eb5-e463403f90df tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:16.003447 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-eff48fcb-e0c8-483f-8eb5-e463403f90df tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] 10.222.0.33 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.031603 Oct 04 20:57:16.004396 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2312/4581] 10.222.0.33 () {58 vars in 1152 bytes} [Tue Oct 4 20:57:15 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:57:16.016742 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-f40072b0-f883-419e-ac38-d9bf0241d9b5 tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Action: 'create', calling method: .version_select at 0x7f3c74399f70>, body: {"server_group": {"name": "tempest-server-group-830005233", "policies": ["anti-affinity"]}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:57:16.053579 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-f40072b0-f883-419e-ac38-d9bf0241d9b5 tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Getting quotas for project b3351642441347c4badf854104a0f38a. Resources: {'server_groups'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:57:16.061745 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-f40072b0-f883-419e-ac38-d9bf0241d9b5 tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Getting quotas for user f9ce92a1863c43e387f3410c3f7081b5 and project b3351642441347c4badf854104a0f38a. Resources: {'server_groups'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:57:16.081905 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:57:16.131120 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-f40072b0-f883-419e-ac38-d9bf0241d9b5 tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Getting quotas for project b3351642441347c4badf854104a0f38a. Resources: {'server_groups'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:57:16.138037 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-f40072b0-f883-419e-ac38-d9bf0241d9b5 tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Getting quotas for user f9ce92a1863c43e387f3410c3f7081b5 and project b3351642441347c4badf854104a0f38a. Resources: {'server_groups'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:57:16.157508 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-f40072b0-f883-419e-ac38-d9bf0241d9b5 tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] 10.222.0.33 "POST /compute/v2.1/os-server-groups" status: 200 len: 168 microversion: 2.1 time: 0.144700 Oct 04 20:57:16.168111 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2313/4582] 10.222.0.33 () {60 vars in 1173 bytes} [Tue Oct 4 20:57:16 2022] POST /compute/v2.1/os-server-groups => generated 168 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:57:16.175473 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-ef9e29b8-10fd-460c-95cd-b565b933b4f0 tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:16.220008 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-ef9e29b8-10fd-460c-95cd-b565b933b4f0 tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] 10.222.0.33 "DELETE /compute/v2.1/os-server-groups/7e133bdc-8011-422b-93f2-a102449a9a39" status: 204 len: 0 microversion: 2.1 time: 0.049503 Oct 04 20:57:16.224123 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2314/4583] 10.222.0.33 () {58 vars in 1266 bytes} [Tue Oct 4 20:57:16 2022] DELETE /compute/v2.1/os-server-groups/7e133bdc-8011-422b-93f2-a102449a9a39 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:57:16.229253 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-fa4860ee-b8ef-417d-ad2d-56e613e2b266 tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:16.243457 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-fa4860ee-b8ef-417d-ad2d-56e613e2b266 tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] 10.222.0.33 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.018373 Oct 04 20:57:16.267668 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2315/4584] 10.222.0.33 () {58 vars in 1152 bytes} [Tue Oct 4 20:57:16 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:57:16.394188 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-a537d522-84c9-44a9-9edc-95f2a84ab510 tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerGroupTestJSON-server-89044736", "imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63", "flavorRef": "452", "networks": [{"uuid": "ceff6015-403d-41e5-9235-8ee981fc7162"}]}, "os:scheduler_hints": {"group": "d31d1b38-de64-4f20-9704-57b38bc39f54"}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:57:16.496506 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.network.neutron [None req-a537d522-84c9-44a9-9edc-95f2a84ab510 tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] validate_networks() for [('ceff6015-403d-41e5-9235-8ee981fc7162', None, None, None, None, None)] {{(pid=128802) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:57:16.937047 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-edbbad18-c2d5-4128-95cc-897daa1f115c tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0d54ecb4da4d1795ff4a6bfe4ebc77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76cb3acdf52a4016b1af1e1a70614243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:57:16.949848 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-edbbad18-c2d5-4128-95cc-897daa1f115c tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] 10.222.0.33 "GET /compute/v2.1/servers/9e261662-c010-41bd-a875-8e47b106485b" status: 200 len: 1322 microversion: 2.1 time: 1.456432 Oct 04 20:57:16.967883 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2270/4585] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:57:15 2022] GET /compute/v2.1/servers/9e261662-c010-41bd-a875-8e47b106485b => generated 1322 bytes in 1475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:57:16.995520 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f21f4898-f4f3-4be7-bbe4-3612c3b8ff5b tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:16.996186 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f21f4898-f4f3-4be7-bbe4-3612c3b8ff5b tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] [instance: 320f9a98-969f-473e-bc56-842bbd28dedc] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:57:17.014728 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f21f4898-f4f3-4be7-bbe4-3612c3b8ff5b tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:17.016415 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f21f4898-f4f3-4be7-bbe4-3612c3b8ff5b tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:17.017852 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f21f4898-f4f3-4be7-bbe4-3612c3b8ff5b tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:17.018832 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f21f4898-f4f3-4be7-bbe4-3612c3b8ff5b tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:17.023800 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f21f4898-f4f3-4be7-bbe4-3612c3b8ff5b tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:17.024448 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f21f4898-f4f3-4be7-bbe4-3612c3b8ff5b tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:19.520408 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f21f4898-f4f3-4be7-bbe4-3612c3b8ff5b tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6513f5e908ac4d028cad6eeeebeab285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65946afc398d4a9fb1c9095a4f946e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:57:19.558112 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f21f4898-f4f3-4be7-bbe4-3612c3b8ff5b tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc" status: 200 len: 1317 microversion: 2.1 time: 2.588168 Oct 04 20:57:19.561221 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2271/4586] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:57:16 2022] GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc => generated 1317 bytes in 2592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:57:19.587098 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-60a4d190-bf7a-431b-8b6c-9162a78c954f tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:19.588104 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-60a4d190-bf7a-431b-8b6c-9162a78c954f tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] [instance: 9e261662-c010-41bd-a875-8e47b106485b] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:57:19.597208 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-60a4d190-bf7a-431b-8b6c-9162a78c954f tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:19.600249 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-60a4d190-bf7a-431b-8b6c-9162a78c954f tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:19.602668 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-60a4d190-bf7a-431b-8b6c-9162a78c954f tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:19.605854 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-60a4d190-bf7a-431b-8b6c-9162a78c954f tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:19.606497 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-60a4d190-bf7a-431b-8b6c-9162a78c954f tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:19.607020 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-60a4d190-bf7a-431b-8b6c-9162a78c954f tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:20.416415 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-60a4d190-bf7a-431b-8b6c-9162a78c954f tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0d54ecb4da4d1795ff4a6bfe4ebc77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76cb3acdf52a4016b1af1e1a70614243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:57:20.425046 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-60a4d190-bf7a-431b-8b6c-9162a78c954f tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] 10.222.0.33 "GET /compute/v2.1/servers/9e261662-c010-41bd-a875-8e47b106485b" status: 200 len: 1322 microversion: 2.1 time: 0.862480 Oct 04 20:57:20.425642 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2272/4587] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:57:19 2022] GET /compute/v2.1/servers/9e261662-c010-41bd-a875-8e47b106485b => generated 1322 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:57:20.438940 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-3b828625-493d-4243-8d5e-76ae62722766 req-2fd10fb5-3064-4336-9594-fad1ef72d5ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b67418e-7355-4fdd-ada2-7a36dd772d50", "name": "network-vif-plugged", "status": "completed", "tag": "2bcb6757-3e87-4ab6-acff-94770b3a1854"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:57:20.451583 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-3b828625-493d-4243-8d5e-76ae62722766 req-2fd10fb5-3064-4336-9594-fad1ef72d5ac service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:20.452375 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-3b828625-493d-4243-8d5e-76ae62722766 req-2fd10fb5-3064-4336-9594-fad1ef72d5ac service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:20.453351 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-3b828625-493d-4243-8d5e-76ae62722766 req-2fd10fb5-3064-4336-9594-fad1ef72d5ac service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:20.477186 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-3b828625-493d-4243-8d5e-76ae62722766 req-2fd10fb5-3064-4336-9594-fad1ef72d5ac service nova] Creating event network-vif-plugged:2bcb6757-3e87-4ab6-acff-94770b3a1854 for instance 5b67418e-7355-4fdd-ada2-7a36dd772d50 on n-h1-854823-8 Oct 04 20:57:20.486794 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-3b828625-493d-4243-8d5e-76ae62722766 req-2fd10fb5-3064-4336-9594-fad1ef72d5ac service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057803 Oct 04 20:57:20.487811 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2273/4588] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:57:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:57:20.591610 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-12e00598-05f5-4ffc-a53b-ac3130ba53b3 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:20.593440 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-12e00598-05f5-4ffc-a53b-ac3130ba53b3 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] [instance: 320f9a98-969f-473e-bc56-842bbd28dedc] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:57:20.611128 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-12e00598-05f5-4ffc-a53b-ac3130ba53b3 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:20.611761 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-12e00598-05f5-4ffc-a53b-ac3130ba53b3 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:20.613914 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-12e00598-05f5-4ffc-a53b-ac3130ba53b3 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:20.631175 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-12e00598-05f5-4ffc-a53b-ac3130ba53b3 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:20.634702 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-12e00598-05f5-4ffc-a53b-ac3130ba53b3 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:20.643112 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-12e00598-05f5-4ffc-a53b-ac3130ba53b3 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:20.966086 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-a537d522-84c9-44a9-9edc-95f2a84ab510 tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Flavor limits 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:57:20.967406 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-a537d522-84c9-44a9-9edc-95f2a84ab510 tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Image limits 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:57:20.969179 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-a537d522-84c9-44a9-9edc-95f2a84ab510 tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Flavor pref 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:57:20.970563 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-a537d522-84c9-44a9-9edc-95f2a84ab510 tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Image pref 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:57:20.971801 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-a537d522-84c9-44a9-9edc-95f2a84ab510 tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:57:20.995996 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a537d522-84c9-44a9-9edc-95f2a84ab510 tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:20.996762 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a537d522-84c9-44a9-9edc-95f2a84ab510 tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:20.997436 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a537d522-84c9-44a9-9edc-95f2a84ab510 tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:21.000292 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a537d522-84c9-44a9-9edc-95f2a84ab510 tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:21.001031 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a537d522-84c9-44a9-9edc-95f2a84ab510 tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:21.001571 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a537d522-84c9-44a9-9edc-95f2a84ab510 tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:21.038761 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-a537d522-84c9-44a9-9edc-95f2a84ab510 tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Getting quotas for project b3351642441347c4badf854104a0f38a. Resources: {'ram', 'instances', 'cores'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:57:21.045603 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-a537d522-84c9-44a9-9edc-95f2a84ab510 tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Getting quotas for user f9ce92a1863c43e387f3410c3f7081b5 and project b3351642441347c4badf854104a0f38a. Resources: {'ram', 'instances', 'cores'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:57:21.072935 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-a537d522-84c9-44a9-9edc-95f2a84ab510 tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Going to run 1 instances... {{(pid=128802) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:57:21.076453 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-a537d522-84c9-44a9-9edc-95f2a84ab510 tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] [instance: f5d7d242-102d-4791-92ba-96dc7b84172a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='15b24725-0c99-4bcf-b1fb-907cdf8e2d63',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128802) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:57:21.128076 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-a537d522-84c9-44a9-9edc-95f2a84ab510 tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=128802) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Oct 04 20:57:21.157401 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-a537d522-84c9-44a9-9edc-95f2a84ab510 tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Getting quotas for project b3351642441347c4badf854104a0f38a. Resources: {'server_group_members'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:57:21.165129 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-a537d522-84c9-44a9-9edc-95f2a84ab510 tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Getting quotas for user f9ce92a1863c43e387f3410c3f7081b5 and project b3351642441347c4badf854104a0f38a. Resources: {'server_group_members'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:57:21.323129 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-a537d522-84c9-44a9-9edc-95f2a84ab510 tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Getting quotas for project b3351642441347c4badf854104a0f38a. Resources: {'server_group_members'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:57:21.346545 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-a537d522-84c9-44a9-9edc-95f2a84ab510 tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Getting quotas for user f9ce92a1863c43e387f3410c3f7081b5 and project b3351642441347c4badf854104a0f38a. Resources: {'server_group_members'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:57:21.417416 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-a537d522-84c9-44a9-9edc-95f2a84ab510 tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.028877 Oct 04 20:57:21.429126 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2316/4589] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 20:57:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 5041 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 20:57:21.440672 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-28ff1d7f-99bd-4aea-8728-6d07750a2999 tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:21.441295 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-28ff1d7f-99bd-4aea-8728-6d07750a2999 tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] [instance: f5d7d242-102d-4791-92ba-96dc7b84172a] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:57:21.461396 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_api:SELECT=88,nova_api:DELETE=6,nova_api:INSERT=6 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:57:21.750708 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-12e00598-05f5-4ffc-a53b-ac3130ba53b3 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6513f5e908ac4d028cad6eeeebeab285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65946afc398d4a9fb1c9095a4f946e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:57:21.766518 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-28ff1d7f-99bd-4aea-8728-6d07750a2999 tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ce92a1863c43e387f3410c3f7081b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3351642441347c4badf854104a0f38a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:57:21.768047 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-12e00598-05f5-4ffc-a53b-ac3130ba53b3 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc" status: 200 len: 1317 microversion: 2.1 time: 1.178198 Oct 04 20:57:21.768834 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2274/4590] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:57:20 2022] GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc => generated 1317 bytes in 1186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:57:21.784046 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-28ff1d7f-99bd-4aea-8728-6d07750a2999 tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] 10.222.0.33 "GET /compute/v2.1/servers/f5d7d242-102d-4791-92ba-96dc7b84172a" status: 200 len: 1211 microversion: 2.1 time: 0.353677 Oct 04 20:57:21.784814 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2317/4591] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:57:21 2022] GET /compute/v2.1/servers/f5d7d242-102d-4791-92ba-96dc7b84172a => generated 1211 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:57:21.808061 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d8548b84-bbf4-4b0a-8e43-8767a9ab9cd2 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:21.809040 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d8548b84-bbf4-4b0a-8e43-8767a9ab9cd2 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] [instance: 9e261662-c010-41bd-a875-8e47b106485b] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:57:21.832641 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d8548b84-bbf4-4b0a-8e43-8767a9ab9cd2 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:21.834551 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d8548b84-bbf4-4b0a-8e43-8767a9ab9cd2 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:21.835010 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d8548b84-bbf4-4b0a-8e43-8767a9ab9cd2 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:21.837333 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d8548b84-bbf4-4b0a-8e43-8767a9ab9cd2 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:21.839751 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d8548b84-bbf4-4b0a-8e43-8767a9ab9cd2 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:21.841434 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d8548b84-bbf4-4b0a-8e43-8767a9ab9cd2 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:22.531488 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-0c6d38b1-c3d4-481b-836f-6c473fad0ff7 req-c9b5e6e2-8b39-44cf-9988-f03c84fab44b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e078edba-e82a-4a6e-8661-638c352139c4", "name": "network-vif-plugged", "status": "completed", "tag": "4423cf51-b7b4-4c1a-b717-d56a01d2cc5c"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:57:22.545942 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-0c6d38b1-c3d4-481b-836f-6c473fad0ff7 req-c9b5e6e2-8b39-44cf-9988-f03c84fab44b service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:22.546552 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-0c6d38b1-c3d4-481b-836f-6c473fad0ff7 req-c9b5e6e2-8b39-44cf-9988-f03c84fab44b service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:22.547049 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-0c6d38b1-c3d4-481b-836f-6c473fad0ff7 req-c9b5e6e2-8b39-44cf-9988-f03c84fab44b service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:22.560636 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-0c6d38b1-c3d4-481b-836f-6c473fad0ff7 req-c9b5e6e2-8b39-44cf-9988-f03c84fab44b service nova] Creating event network-vif-plugged:4423cf51-b7b4-4c1a-b717-d56a01d2cc5c for instance e078edba-e82a-4a6e-8661-638c352139c4 on n-h2-854823-8 Oct 04 20:57:22.566400 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-0c6d38b1-c3d4-481b-836f-6c473fad0ff7 req-c9b5e6e2-8b39-44cf-9988-f03c84fab44b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038904 Oct 04 20:57:22.573064 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2318/4592] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:57:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 20:57:22.794616 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-adcbb201-283b-44c2-89a5-2db0eb47d02a tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:22.795392 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-adcbb201-283b-44c2-89a5-2db0eb47d02a tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] [instance: 320f9a98-969f-473e-bc56-842bbd28dedc] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:57:22.812902 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-adcbb201-283b-44c2-89a5-2db0eb47d02a tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:22.813756 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-adcbb201-283b-44c2-89a5-2db0eb47d02a tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:22.814211 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-adcbb201-283b-44c2-89a5-2db0eb47d02a tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:22.814968 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-adcbb201-283b-44c2-89a5-2db0eb47d02a tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:22.815425 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-adcbb201-283b-44c2-89a5-2db0eb47d02a tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:22.816015 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-adcbb201-283b-44c2-89a5-2db0eb47d02a tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:23.178358 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d8548b84-bbf4-4b0a-8e43-8767a9ab9cd2 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0d54ecb4da4d1795ff4a6bfe4ebc77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76cb3acdf52a4016b1af1e1a70614243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:57:23.195405 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d8548b84-bbf4-4b0a-8e43-8767a9ab9cd2 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] 10.222.0.33 "GET /compute/v2.1/servers/9e261662-c010-41bd-a875-8e47b106485b" status: 200 len: 1322 microversion: 2.1 time: 1.415040 Oct 04 20:57:23.196023 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2275/4593] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:57:21 2022] GET /compute/v2.1/servers/9e261662-c010-41bd-a875-8e47b106485b => generated 1322 bytes in 1427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:57:23.201275 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1eb638a0-57df-4854-bd25-a0f1cbc82ade tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:23.202084 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-1eb638a0-57df-4854-bd25-a0f1cbc82ade tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] [instance: f5d7d242-102d-4791-92ba-96dc7b84172a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:57:23.209517 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1eb638a0-57df-4854-bd25-a0f1cbc82ade tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:23.210301 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1eb638a0-57df-4854-bd25-a0f1cbc82ade tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:23.211004 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1eb638a0-57df-4854-bd25-a0f1cbc82ade tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:23.211951 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1eb638a0-57df-4854-bd25-a0f1cbc82ade tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:23.212632 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1eb638a0-57df-4854-bd25-a0f1cbc82ade tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:23.213272 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1eb638a0-57df-4854-bd25-a0f1cbc82ade tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:23.445457 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-adcbb201-283b-44c2-89a5-2db0eb47d02a tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6513f5e908ac4d028cad6eeeebeab285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65946afc398d4a9fb1c9095a4f946e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:57:23.452936 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-1eb638a0-57df-4854-bd25-a0f1cbc82ade tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ce92a1863c43e387f3410c3f7081b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3351642441347c4badf854104a0f38a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:57:23.458044 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-adcbb201-283b-44c2-89a5-2db0eb47d02a tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc" status: 200 len: 1317 microversion: 2.1 time: 0.669344 Oct 04 20:57:23.461363 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-1eb638a0-57df-4854-bd25-a0f1cbc82ade tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] 10.222.0.33 "GET /compute/v2.1/servers/f5d7d242-102d-4791-92ba-96dc7b84172a" status: 200 len: 1263 microversion: 2.1 time: 0.264128 Oct 04 20:57:23.462204 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2319/4594] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:57:22 2022] GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc => generated 1317 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:57:23.472800 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2276/4595] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:57:23 2022] GET /compute/v2.1/servers/f5d7d242-102d-4791-92ba-96dc7b84172a => generated 1263 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:57:23.631296 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-2db47a19-4d8c-4402-a894-51e263ac3668 req-879a7ff0-735e-44eb-a985-31fa92289881 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "320f9a98-969f-473e-bc56-842bbd28dedc", "tag": "d2b3af35-3f6f-4a4b-91ec-14c17375542b"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:57:23.655140 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-2db47a19-4d8c-4402-a894-51e263ac3668 req-879a7ff0-735e-44eb-a985-31fa92289881 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:23.658967 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-2db47a19-4d8c-4402-a894-51e263ac3668 req-879a7ff0-735e-44eb-a985-31fa92289881 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:23.662330 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-2db47a19-4d8c-4402-a894-51e263ac3668 req-879a7ff0-735e-44eb-a985-31fa92289881 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:23.672719 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=65 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:57:23.694030 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-2db47a19-4d8c-4402-a894-51e263ac3668 req-879a7ff0-735e-44eb-a985-31fa92289881 service nova] Creating event network-changed:d2b3af35-3f6f-4a4b-91ec-14c17375542b for instance 320f9a98-969f-473e-bc56-842bbd28dedc on n-h1-854823-8 Oct 04 20:57:23.706461 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-2db47a19-4d8c-4402-a894-51e263ac3668 req-879a7ff0-735e-44eb-a985-31fa92289881 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077139 Oct 04 20:57:23.707155 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2320/4596] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:57:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:57:24.222547 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-4a160a80-467c-4040-b9e8-3ebc840136cc tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:24.224222 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-4a160a80-467c-4040-b9e8-3ebc840136cc tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] [instance: 9e261662-c010-41bd-a875-8e47b106485b] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:57:24.232068 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4a160a80-467c-4040-b9e8-3ebc840136cc tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:24.236009 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4a160a80-467c-4040-b9e8-3ebc840136cc tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:24.236715 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4a160a80-467c-4040-b9e8-3ebc840136cc tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:24.239211 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4a160a80-467c-4040-b9e8-3ebc840136cc tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:24.240031 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4a160a80-467c-4040-b9e8-3ebc840136cc tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:24.241690 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4a160a80-467c-4040-b9e8-3ebc840136cc tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:24.502679 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-2f963f78-44dd-4e69-aaec-443035f62cc2 tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:24.503775 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-2f963f78-44dd-4e69-aaec-443035f62cc2 tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] [instance: f5d7d242-102d-4791-92ba-96dc7b84172a] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:57:24.527098 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2f963f78-44dd-4e69-aaec-443035f62cc2 tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:24.528124 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2f963f78-44dd-4e69-aaec-443035f62cc2 tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:24.529426 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2f963f78-44dd-4e69-aaec-443035f62cc2 tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:24.531974 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2f963f78-44dd-4e69-aaec-443035f62cc2 tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:24.532650 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2f963f78-44dd-4e69-aaec-443035f62cc2 tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:24.534185 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2f963f78-44dd-4e69-aaec-443035f62cc2 tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:24.711927 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-2f963f78-44dd-4e69-aaec-443035f62cc2 tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ce92a1863c43e387f3410c3f7081b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3351642441347c4badf854104a0f38a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:57:24.721293 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-2f963f78-44dd-4e69-aaec-443035f62cc2 tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] 10.222.0.33 "GET /compute/v2.1/servers/f5d7d242-102d-4791-92ba-96dc7b84172a" status: 200 len: 1269 microversion: 2.1 time: 0.223536 Oct 04 20:57:24.722406 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2321/4597] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:57:24 2022] GET /compute/v2.1/servers/f5d7d242-102d-4791-92ba-96dc7b84172a => generated 1269 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:57:24.729453 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-7ac16693-0d94-46a3-9c0b-78438adb268c tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:24.730068 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-7ac16693-0d94-46a3-9c0b-78438adb268c tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] [instance: 320f9a98-969f-473e-bc56-842bbd28dedc] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:57:24.737291 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7ac16693-0d94-46a3-9c0b-78438adb268c tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:24.738004 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7ac16693-0d94-46a3-9c0b-78438adb268c tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:24.738758 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7ac16693-0d94-46a3-9c0b-78438adb268c tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:24.740379 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7ac16693-0d94-46a3-9c0b-78438adb268c tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:24.741637 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7ac16693-0d94-46a3-9c0b-78438adb268c tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:24.742374 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7ac16693-0d94-46a3-9c0b-78438adb268c tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:24.950406 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-4a160a80-467c-4040-b9e8-3ebc840136cc tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0d54ecb4da4d1795ff4a6bfe4ebc77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76cb3acdf52a4016b1af1e1a70614243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:57:24.964174 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-4a160a80-467c-4040-b9e8-3ebc840136cc tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] 10.222.0.33 "GET /compute/v2.1/servers/9e261662-c010-41bd-a875-8e47b106485b" status: 200 len: 1322 microversion: 2.1 time: 0.745228 Oct 04 20:57:24.978037 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2277/4598] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:57:24 2022] GET /compute/v2.1/servers/9e261662-c010-41bd-a875-8e47b106485b => generated 1322 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:57:25.358653 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-7ac16693-0d94-46a3-9c0b-78438adb268c tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6513f5e908ac4d028cad6eeeebeab285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65946afc398d4a9fb1c9095a4f946e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:57:25.371070 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-7ac16693-0d94-46a3-9c0b-78438adb268c tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc" status: 200 len: 1317 microversion: 2.1 time: 0.647472 Oct 04 20:57:25.395186 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2322/4599] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:57:24 2022] GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc => generated 1317 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:57:25.598410 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=24 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:57:25.604502 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-6267a757-09b6-47dc-a32a-81b5d7b2e689 req-f67f94b8-34ec-46f0-bef5-fc3371ce79e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e261662-c010-41bd-a875-8e47b106485b", "name": "network-vif-plugged", "status": "completed", "tag": "bdf38a71-dc68-47d2-8e91-13ca82211cf4"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:57:25.631064 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-6267a757-09b6-47dc-a32a-81b5d7b2e689 req-f67f94b8-34ec-46f0-bef5-fc3371ce79e6 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:25.631948 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-6267a757-09b6-47dc-a32a-81b5d7b2e689 req-f67f94b8-34ec-46f0-bef5-fc3371ce79e6 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:25.633807 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-6267a757-09b6-47dc-a32a-81b5d7b2e689 req-f67f94b8-34ec-46f0-bef5-fc3371ce79e6 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:25.660641 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-6267a757-09b6-47dc-a32a-81b5d7b2e689 req-f67f94b8-34ec-46f0-bef5-fc3371ce79e6 service nova] Creating event network-vif-plugged:bdf38a71-dc68-47d2-8e91-13ca82211cf4 for instance 9e261662-c010-41bd-a875-8e47b106485b on n-h2-854823-8 Oct 04 20:57:25.673580 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-6267a757-09b6-47dc-a32a-81b5d7b2e689 req-f67f94b8-34ec-46f0-bef5-fc3371ce79e6 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075602 Oct 04 20:57:25.674701 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2278/4600] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:57:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:57:25.761840 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-ea830d7e-a0e9-485c-8767-797981d60311 tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:25.761840 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-ea830d7e-a0e9-485c-8767-797981d60311 tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] [instance: f5d7d242-102d-4791-92ba-96dc7b84172a] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:57:25.776911 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ea830d7e-a0e9-485c-8767-797981d60311 tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:25.777437 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ea830d7e-a0e9-485c-8767-797981d60311 tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:25.778599 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ea830d7e-a0e9-485c-8767-797981d60311 tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:25.782086 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ea830d7e-a0e9-485c-8767-797981d60311 tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:25.783109 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ea830d7e-a0e9-485c-8767-797981d60311 tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:25.783800 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ea830d7e-a0e9-485c-8767-797981d60311 tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:25.991403 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2acc7f89-4e70-48a5-945b-6f9aaaed5b90 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:25.992129 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-2acc7f89-4e70-48a5-945b-6f9aaaed5b90 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] [instance: 9e261662-c010-41bd-a875-8e47b106485b] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:57:26.002716 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2acc7f89-4e70-48a5-945b-6f9aaaed5b90 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:26.003216 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2acc7f89-4e70-48a5-945b-6f9aaaed5b90 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:26.003663 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2acc7f89-4e70-48a5-945b-6f9aaaed5b90 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:26.004379 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2acc7f89-4e70-48a5-945b-6f9aaaed5b90 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:26.004847 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2acc7f89-4e70-48a5-945b-6f9aaaed5b90 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:26.005416 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2acc7f89-4e70-48a5-945b-6f9aaaed5b90 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:26.043052 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=83 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:57:27.133964 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-ea830d7e-a0e9-485c-8767-797981d60311 tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ce92a1863c43e387f3410c3f7081b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3351642441347c4badf854104a0f38a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:57:27.148963 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-ea830d7e-a0e9-485c-8767-797981d60311 tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] 10.222.0.33 "GET /compute/v2.1/servers/f5d7d242-102d-4791-92ba-96dc7b84172a" status: 200 len: 1311 microversion: 2.1 time: 1.402511 Oct 04 20:57:27.149315 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-2acc7f89-4e70-48a5-945b-6f9aaaed5b90 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0d54ecb4da4d1795ff4a6bfe4ebc77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76cb3acdf52a4016b1af1e1a70614243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:57:27.151276 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2323/4601] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:57:25 2022] GET /compute/v2.1/servers/f5d7d242-102d-4791-92ba-96dc7b84172a => generated 1311 bytes in 1405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:57:27.173209 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-e109dbe9-fc44-48c0-945a-8f9222d36747 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:27.173412 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-2acc7f89-4e70-48a5-945b-6f9aaaed5b90 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] 10.222.0.33 "GET /compute/v2.1/servers/9e261662-c010-41bd-a875-8e47b106485b" status: 200 len: 1322 microversion: 2.1 time: 1.185501 Oct 04 20:57:27.175667 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-e109dbe9-fc44-48c0-945a-8f9222d36747 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] [instance: 320f9a98-969f-473e-bc56-842bbd28dedc] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:57:27.195472 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e109dbe9-fc44-48c0-945a-8f9222d36747 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:27.196182 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e109dbe9-fc44-48c0-945a-8f9222d36747 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:27.196973 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e109dbe9-fc44-48c0-945a-8f9222d36747 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:27.197854 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e109dbe9-fc44-48c0-945a-8f9222d36747 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:27.198115 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2279/4602] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:57:25 2022] GET /compute/v2.1/servers/9e261662-c010-41bd-a875-8e47b106485b => generated 1322 bytes in 1212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:57:27.199002 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e109dbe9-fc44-48c0-945a-8f9222d36747 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:27.200179 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e109dbe9-fc44-48c0-945a-8f9222d36747 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:27.743402 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-e109dbe9-fc44-48c0-945a-8f9222d36747 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6513f5e908ac4d028cad6eeeebeab285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65946afc398d4a9fb1c9095a4f946e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:57:27.766133 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-e109dbe9-fc44-48c0-945a-8f9222d36747 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc" status: 200 len: 1317 microversion: 2.1 time: 0.607639 Oct 04 20:57:27.769082 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2324/4603] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:57:27 2022] GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc => generated 1317 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:57:28.175692 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-16f78eb9-5759-41fd-a4dd-03798fcac9b2 tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:28.176249 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-16f78eb9-5759-41fd-a4dd-03798fcac9b2 tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] [instance: f5d7d242-102d-4791-92ba-96dc7b84172a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:57:28.191540 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-16f78eb9-5759-41fd-a4dd-03798fcac9b2 tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:28.193314 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-16f78eb9-5759-41fd-a4dd-03798fcac9b2 tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:28.193892 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-16f78eb9-5759-41fd-a4dd-03798fcac9b2 tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:28.199559 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-16f78eb9-5759-41fd-a4dd-03798fcac9b2 tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:28.200342 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-16f78eb9-5759-41fd-a4dd-03798fcac9b2 tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:28.201781 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-16f78eb9-5759-41fd-a4dd-03798fcac9b2 tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:28.203226 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-f0248d12-b0d8-4557-8adf-15d702dc5778 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:28.204847 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-f0248d12-b0d8-4557-8adf-15d702dc5778 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] [instance: 9e261662-c010-41bd-a875-8e47b106485b] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:57:28.222726 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f0248d12-b0d8-4557-8adf-15d702dc5778 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:28.223228 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f0248d12-b0d8-4557-8adf-15d702dc5778 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:28.224630 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f0248d12-b0d8-4557-8adf-15d702dc5778 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:28.225495 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f0248d12-b0d8-4557-8adf-15d702dc5778 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:28.225952 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f0248d12-b0d8-4557-8adf-15d702dc5778 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:28.228586 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f0248d12-b0d8-4557-8adf-15d702dc5778 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:28.644604 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-f0248d12-b0d8-4557-8adf-15d702dc5778 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0d54ecb4da4d1795ff4a6bfe4ebc77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76cb3acdf52a4016b1af1e1a70614243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:57:28.661931 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-f0248d12-b0d8-4557-8adf-15d702dc5778 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] 10.222.0.33 "GET /compute/v2.1/servers/9e261662-c010-41bd-a875-8e47b106485b" status: 200 len: 1516 microversion: 2.1 time: 0.461578 Oct 04 20:57:28.663803 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2325/4604] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:57:28 2022] GET /compute/v2.1/servers/9e261662-c010-41bd-a875-8e47b106485b => generated 1516 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:57:28.698529 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-42bbef0f-0c7a-4fd3-8db0-4a375ffac404 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:28.699411 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-42bbef0f-0c7a-4fd3-8db0-4a375ffac404 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] [instance: e078edba-e82a-4a6e-8661-638c352139c4] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:57:28.719016 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-42bbef0f-0c7a-4fd3-8db0-4a375ffac404 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:28.719837 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-42bbef0f-0c7a-4fd3-8db0-4a375ffac404 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:28.722156 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-42bbef0f-0c7a-4fd3-8db0-4a375ffac404 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:28.723207 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-42bbef0f-0c7a-4fd3-8db0-4a375ffac404 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:28.726066 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-42bbef0f-0c7a-4fd3-8db0-4a375ffac404 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:28.727493 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-42bbef0f-0c7a-4fd3-8db0-4a375ffac404 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:28.782723 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-16f78eb9-5759-41fd-a4dd-03798fcac9b2 tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ce92a1863c43e387f3410c3f7081b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3351642441347c4badf854104a0f38a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:57:28.801133 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-16f78eb9-5759-41fd-a4dd-03798fcac9b2 tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] 10.222.0.33 "GET /compute/v2.1/servers/f5d7d242-102d-4791-92ba-96dc7b84172a" status: 200 len: 1311 microversion: 2.1 time: 0.630571 Oct 04 20:57:28.802671 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2280/4605] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:57:28 2022] GET /compute/v2.1/servers/f5d7d242-102d-4791-92ba-96dc7b84172a => generated 1311 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:57:28.819518 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8fd76b33-7a64-4a99-a67b-64d4b04c62b8 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:28.820726 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-8fd76b33-7a64-4a99-a67b-64d4b04c62b8 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] [instance: 320f9a98-969f-473e-bc56-842bbd28dedc] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:57:28.833359 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8fd76b33-7a64-4a99-a67b-64d4b04c62b8 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:28.835127 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8fd76b33-7a64-4a99-a67b-64d4b04c62b8 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:28.835656 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8fd76b33-7a64-4a99-a67b-64d4b04c62b8 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:28.836653 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8fd76b33-7a64-4a99-a67b-64d4b04c62b8 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:28.837218 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8fd76b33-7a64-4a99-a67b-64d4b04c62b8 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:28.837730 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8fd76b33-7a64-4a99-a67b-64d4b04c62b8 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:29.201097 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-8fd76b33-7a64-4a99-a67b-64d4b04c62b8 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6513f5e908ac4d028cad6eeeebeab285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65946afc398d4a9fb1c9095a4f946e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:57:29.236738 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-8fd76b33-7a64-4a99-a67b-64d4b04c62b8 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc" status: 200 len: 1317 microversion: 2.1 time: 0.430325 Oct 04 20:57:29.245864 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2281/4606] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:57:28 2022] GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc => generated 1317 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:57:29.262004 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-47743aef-a16b-4a36-a4f5-db3b91fcca5d req-22d199e7-c8c1-4e4a-bd3d-4870b1e10f4f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5d7d242-102d-4791-92ba-96dc7b84172a", "tag": "df23aac4-8d0f-4b97-9cf1-527775e6fa37"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:57:29.287223 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-47743aef-a16b-4a36-a4f5-db3b91fcca5d req-22d199e7-c8c1-4e4a-bd3d-4870b1e10f4f service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:29.287999 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-47743aef-a16b-4a36-a4f5-db3b91fcca5d req-22d199e7-c8c1-4e4a-bd3d-4870b1e10f4f service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:29.292471 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-47743aef-a16b-4a36-a4f5-db3b91fcca5d req-22d199e7-c8c1-4e4a-bd3d-4870b1e10f4f service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:29.301179 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-42bbef0f-0c7a-4fd3-8db0-4a375ffac404 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0d54ecb4da4d1795ff4a6bfe4ebc77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76cb3acdf52a4016b1af1e1a70614243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:57:29.312513 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-42bbef0f-0c7a-4fd3-8db0-4a375ffac404 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] 10.222.0.33 "GET /compute/v2.1/servers/e078edba-e82a-4a6e-8661-638c352139c4" status: 200 len: 1516 microversion: 2.1 time: 0.620166 Oct 04 20:57:29.318366 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2326/4607] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:57:28 2022] GET /compute/v2.1/servers/e078edba-e82a-4a6e-8661-638c352139c4 => generated 1516 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:57:29.339415 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-16624e51-033e-409b-897f-ea7924a4784d tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:29.340308 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-16624e51-033e-409b-897f-ea7924a4784d tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] [instance: 5b67418e-7355-4fdd-ada2-7a36dd772d50] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:57:29.347365 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-47743aef-a16b-4a36-a4f5-db3b91fcca5d req-22d199e7-c8c1-4e4a-bd3d-4870b1e10f4f service nova] Creating event network-changed:df23aac4-8d0f-4b97-9cf1-527775e6fa37 for instance f5d7d242-102d-4791-92ba-96dc7b84172a on n-h1-854823-8 Oct 04 20:57:29.352154 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-16624e51-033e-409b-897f-ea7924a4784d tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:29.353613 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-16624e51-033e-409b-897f-ea7924a4784d tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:29.354244 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-16624e51-033e-409b-897f-ea7924a4784d tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:29.357668 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-16624e51-033e-409b-897f-ea7924a4784d tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:29.358537 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-16624e51-033e-409b-897f-ea7924a4784d tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:29.359136 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-16624e51-033e-409b-897f-ea7924a4784d tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:29.366383 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-47743aef-a16b-4a36-a4f5-db3b91fcca5d req-22d199e7-c8c1-4e4a-bd3d-4870b1e10f4f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114697 Oct 04 20:57:29.368549 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2282/4608] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:57:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:57:29.753263 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-16624e51-033e-409b-897f-ea7924a4784d tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0d54ecb4da4d1795ff4a6bfe4ebc77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76cb3acdf52a4016b1af1e1a70614243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:57:29.766316 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-16624e51-033e-409b-897f-ea7924a4784d tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] 10.222.0.33 "GET /compute/v2.1/servers/5b67418e-7355-4fdd-ada2-7a36dd772d50" status: 200 len: 1515 microversion: 2.1 time: 0.427580 Oct 04 20:57:29.784180 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2327/4609] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:57:29 2022] GET /compute/v2.1/servers/5b67418e-7355-4fdd-ada2-7a36dd772d50 => generated 1515 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:57:29.797433 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-fd7f92fa-2898-4859-afd4-ae5fd9ee403c tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:29.798017 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-fd7f92fa-2898-4859-afd4-ae5fd9ee403c tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] [instance: 5b67418e-7355-4fdd-ada2-7a36dd772d50] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:57:29.816441 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fd7f92fa-2898-4859-afd4-ae5fd9ee403c tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:29.816939 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fd7f92fa-2898-4859-afd4-ae5fd9ee403c tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:29.817408 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fd7f92fa-2898-4859-afd4-ae5fd9ee403c tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:29.818116 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fd7f92fa-2898-4859-afd4-ae5fd9ee403c tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:29.818592 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fd7f92fa-2898-4859-afd4-ae5fd9ee403c tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:29.819013 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fd7f92fa-2898-4859-afd4-ae5fd9ee403c tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:29.831949 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-9fa26ea9-0262-426e-aba5-320d1f55609c tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:29.833731 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-9fa26ea9-0262-426e-aba5-320d1f55609c tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] [instance: f5d7d242-102d-4791-92ba-96dc7b84172a] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:57:29.845172 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9fa26ea9-0262-426e-aba5-320d1f55609c tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:29.850316 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9fa26ea9-0262-426e-aba5-320d1f55609c tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:29.851003 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9fa26ea9-0262-426e-aba5-320d1f55609c tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:29.851923 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9fa26ea9-0262-426e-aba5-320d1f55609c tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:29.852434 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9fa26ea9-0262-426e-aba5-320d1f55609c tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:29.853273 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9fa26ea9-0262-426e-aba5-320d1f55609c tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:29.870966 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-fd7f92fa-2898-4859-afd4-ae5fd9ee403c tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] [instance: 5b67418e-7355-4fdd-ada2-7a36dd772d50] Going to try to terminate instance {{(pid=128801) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:57:30.038071 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-fd7f92fa-2898-4859-afd4-ae5fd9ee403c tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] 10.222.0.33 "DELETE /compute/v2.1/servers/5b67418e-7355-4fdd-ada2-7a36dd772d50" status: 204 len: 0 microversion: 2.1 time: 0.248103 Oct 04 20:57:30.039001 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2283/4610] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 20:57:29 2022] DELETE /compute/v2.1/servers/5b67418e-7355-4fdd-ada2-7a36dd772d50 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:57:30.047425 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d4fbe07e-8ffa-481e-b35e-12851a89b2dc tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:30.048384 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d4fbe07e-8ffa-481e-b35e-12851a89b2dc tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] [instance: 5b67418e-7355-4fdd-ada2-7a36dd772d50] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:57:30.070971 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d4fbe07e-8ffa-481e-b35e-12851a89b2dc tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:30.074047 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d4fbe07e-8ffa-481e-b35e-12851a89b2dc tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:30.076357 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d4fbe07e-8ffa-481e-b35e-12851a89b2dc tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:30.077327 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d4fbe07e-8ffa-481e-b35e-12851a89b2dc tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:30.078075 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d4fbe07e-8ffa-481e-b35e-12851a89b2dc tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:30.078946 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d4fbe07e-8ffa-481e-b35e-12851a89b2dc tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:30.291425 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-9fa26ea9-0262-426e-aba5-320d1f55609c tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ce92a1863c43e387f3410c3f7081b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3351642441347c4badf854104a0f38a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:57:30.299265 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-9fa26ea9-0262-426e-aba5-320d1f55609c tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] 10.222.0.33 "GET /compute/v2.1/servers/f5d7d242-102d-4791-92ba-96dc7b84172a" status: 200 len: 1311 microversion: 2.1 time: 0.473490 Oct 04 20:57:30.319214 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2328/4611] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:57:29 2022] GET /compute/v2.1/servers/f5d7d242-102d-4791-92ba-96dc7b84172a => generated 1311 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:57:30.324131 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-30810bab-6bf1-4902-92e3-92139ae0657b tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:30.324738 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-30810bab-6bf1-4902-92e3-92139ae0657b tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] [instance: 320f9a98-969f-473e-bc56-842bbd28dedc] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:57:30.348272 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-30810bab-6bf1-4902-92e3-92139ae0657b tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:30.349346 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-30810bab-6bf1-4902-92e3-92139ae0657b tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:30.349788 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-30810bab-6bf1-4902-92e3-92139ae0657b tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:30.350543 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-30810bab-6bf1-4902-92e3-92139ae0657b tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:30.350998 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-30810bab-6bf1-4902-92e3-92139ae0657b tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:30.351418 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-30810bab-6bf1-4902-92e3-92139ae0657b tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:30.674701 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d4fbe07e-8ffa-481e-b35e-12851a89b2dc tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0d54ecb4da4d1795ff4a6bfe4ebc77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76cb3acdf52a4016b1af1e1a70614243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:57:30.711303 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d4fbe07e-8ffa-481e-b35e-12851a89b2dc tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] 10.222.0.33 "GET /compute/v2.1/servers/5b67418e-7355-4fdd-ada2-7a36dd772d50" status: 200 len: 1521 microversion: 2.1 time: 0.647903 Oct 04 20:57:30.712004 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2284/4612] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:57:30 2022] GET /compute/v2.1/servers/5b67418e-7355-4fdd-ada2-7a36dd772d50 => generated 1521 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:57:30.718131 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-3d66cde3-6e1d-4292-ba11-5fb65052176b req-d96d506b-81c5-49ac-84ea-ebe35f9e8185 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "320f9a98-969f-473e-bc56-842bbd28dedc", "name": "network-vif-plugged", "status": "completed", "tag": "d2b3af35-3f6f-4a4b-91ec-14c17375542b"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:57:30.734377 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-30810bab-6bf1-4902-92e3-92139ae0657b tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6513f5e908ac4d028cad6eeeebeab285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65946afc398d4a9fb1c9095a4f946e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:57:30.744152 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-30810bab-6bf1-4902-92e3-92139ae0657b tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc" status: 200 len: 1317 microversion: 2.1 time: 0.423761 Oct 04 20:57:30.746475 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2329/4613] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:57:30 2022] GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc => generated 1317 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:57:30.751332 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-3d66cde3-6e1d-4292-ba11-5fb65052176b req-d96d506b-81c5-49ac-84ea-ebe35f9e8185 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:30.752054 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-3d66cde3-6e1d-4292-ba11-5fb65052176b req-d96d506b-81c5-49ac-84ea-ebe35f9e8185 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:30.752696 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-3d66cde3-6e1d-4292-ba11-5fb65052176b req-d96d506b-81c5-49ac-84ea-ebe35f9e8185 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:30.773581 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-3d66cde3-6e1d-4292-ba11-5fb65052176b req-d96d506b-81c5-49ac-84ea-ebe35f9e8185 service nova] Creating event network-vif-plugged:d2b3af35-3f6f-4a4b-91ec-14c17375542b for instance 320f9a98-969f-473e-bc56-842bbd28dedc on n-h1-854823-8 Oct 04 20:57:30.779967 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-3d66cde3-6e1d-4292-ba11-5fb65052176b req-d96d506b-81c5-49ac-84ea-ebe35f9e8185 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065525 Oct 04 20:57:30.780708 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2285/4614] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:57:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:57:31.327022 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-ec289e20-d72d-41e4-833e-2937fbea82b3 tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:31.328227 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-ec289e20-d72d-41e4-833e-2937fbea82b3 tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] [instance: f5d7d242-102d-4791-92ba-96dc7b84172a] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:57:31.352394 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell0:SELECT=2 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:57:31.366741 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ec289e20-d72d-41e4-833e-2937fbea82b3 tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:31.367268 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ec289e20-d72d-41e4-833e-2937fbea82b3 tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:31.367718 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ec289e20-d72d-41e4-833e-2937fbea82b3 tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:31.368463 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ec289e20-d72d-41e4-833e-2937fbea82b3 tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:31.375391 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ec289e20-d72d-41e4-833e-2937fbea82b3 tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:31.375938 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ec289e20-d72d-41e4-833e-2937fbea82b3 tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:31.632731 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-ec289e20-d72d-41e4-833e-2937fbea82b3 tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ce92a1863c43e387f3410c3f7081b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3351642441347c4badf854104a0f38a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:57:31.640977 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-ec289e20-d72d-41e4-833e-2937fbea82b3 tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] 10.222.0.33 "GET /compute/v2.1/servers/f5d7d242-102d-4791-92ba-96dc7b84172a" status: 200 len: 1311 microversion: 2.1 time: 0.318277 Oct 04 20:57:31.641573 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2330/4615] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:57:31 2022] GET /compute/v2.1/servers/f5d7d242-102d-4791-92ba-96dc7b84172a => generated 1311 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:57:31.739345 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5db1e236-890e-44f6-a80b-3d274dae21ca tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:31.740899 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-5db1e236-890e-44f6-a80b-3d274dae21ca tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] [instance: 5b67418e-7355-4fdd-ada2-7a36dd772d50] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:57:31.749495 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5db1e236-890e-44f6-a80b-3d274dae21ca tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:31.750199 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5db1e236-890e-44f6-a80b-3d274dae21ca tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:31.751480 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5db1e236-890e-44f6-a80b-3d274dae21ca tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:31.752551 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5db1e236-890e-44f6-a80b-3d274dae21ca tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:31.753248 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5db1e236-890e-44f6-a80b-3d274dae21ca tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:31.753951 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5db1e236-890e-44f6-a80b-3d274dae21ca tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:31.769876 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-f8cd03a1-be72-4081-b09c-0bf1aec76566 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:31.772230 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-f8cd03a1-be72-4081-b09c-0bf1aec76566 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] [instance: 320f9a98-969f-473e-bc56-842bbd28dedc] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:57:31.783788 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell0:SELECT=42 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:57:31.788959 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f8cd03a1-be72-4081-b09c-0bf1aec76566 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:31.790536 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f8cd03a1-be72-4081-b09c-0bf1aec76566 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:31.791248 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f8cd03a1-be72-4081-b09c-0bf1aec76566 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:31.794568 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f8cd03a1-be72-4081-b09c-0bf1aec76566 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:31.796574 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f8cd03a1-be72-4081-b09c-0bf1aec76566 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:31.798089 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f8cd03a1-be72-4081-b09c-0bf1aec76566 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:32.547247 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-5db1e236-890e-44f6-a80b-3d274dae21ca tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0d54ecb4da4d1795ff4a6bfe4ebc77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76cb3acdf52a4016b1af1e1a70614243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:57:32.560019 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-f8cd03a1-be72-4081-b09c-0bf1aec76566 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6513f5e908ac4d028cad6eeeebeab285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65946afc398d4a9fb1c9095a4f946e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:57:32.561280 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5db1e236-890e-44f6-a80b-3d274dae21ca tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] 10.222.0.33 "GET /compute/v2.1/servers/5b67418e-7355-4fdd-ada2-7a36dd772d50" status: 200 len: 1521 microversion: 2.1 time: 0.827741 Oct 04 20:57:32.576138 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2286/4616] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:57:31 2022] GET /compute/v2.1/servers/5b67418e-7355-4fdd-ada2-7a36dd772d50 => generated 1521 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:57:32.595038 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-f8cd03a1-be72-4081-b09c-0bf1aec76566 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc" status: 200 len: 1317 microversion: 2.1 time: 0.828663 Oct 04 20:57:32.596518 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2331/4617] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:57:31 2022] GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc => generated 1317 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:57:32.670589 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c73a290c-c724-4cdc-8bb4-6e33761f41ce tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:32.671651 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c73a290c-c724-4cdc-8bb4-6e33761f41ce tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] [instance: f5d7d242-102d-4791-92ba-96dc7b84172a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:57:32.684569 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c73a290c-c724-4cdc-8bb4-6e33761f41ce tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:32.686029 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c73a290c-c724-4cdc-8bb4-6e33761f41ce tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:32.696426 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c73a290c-c724-4cdc-8bb4-6e33761f41ce tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:32.700766 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c73a290c-c724-4cdc-8bb4-6e33761f41ce tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:32.705811 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c73a290c-c724-4cdc-8bb4-6e33761f41ce tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:32.706398 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c73a290c-c724-4cdc-8bb4-6e33761f41ce tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:33.023989 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c73a290c-c724-4cdc-8bb4-6e33761f41ce tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ce92a1863c43e387f3410c3f7081b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3351642441347c4badf854104a0f38a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:57:33.032660 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c73a290c-c724-4cdc-8bb4-6e33761f41ce tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] 10.222.0.33 "GET /compute/v2.1/servers/f5d7d242-102d-4791-92ba-96dc7b84172a" status: 200 len: 1311 microversion: 2.1 time: 0.369998 Oct 04 20:57:33.047743 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2287/4618] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:57:32 2022] GET /compute/v2.1/servers/f5d7d242-102d-4791-92ba-96dc7b84172a => generated 1311 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:57:33.589242 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-91317133-6ea2-47a8-ac02-b4b9a16f11d2 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:33.590513 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-91317133-6ea2-47a8-ac02-b4b9a16f11d2 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] [instance: 5b67418e-7355-4fdd-ada2-7a36dd772d50] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:57:33.608392 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-91317133-6ea2-47a8-ac02-b4b9a16f11d2 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:33.608893 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-91317133-6ea2-47a8-ac02-b4b9a16f11d2 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:33.609714 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-91317133-6ea2-47a8-ac02-b4b9a16f11d2 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:33.610452 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-91317133-6ea2-47a8-ac02-b4b9a16f11d2 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:33.610912 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-91317133-6ea2-47a8-ac02-b4b9a16f11d2 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:33.611341 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-91317133-6ea2-47a8-ac02-b4b9a16f11d2 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:33.623104 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5b1804bc-fe14-4c71-ab48-7344a0c78de4 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:33.623726 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-5b1804bc-fe14-4c71-ab48-7344a0c78de4 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] [instance: 320f9a98-969f-473e-bc56-842bbd28dedc] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:57:33.633690 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5b1804bc-fe14-4c71-ab48-7344a0c78de4 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:33.634403 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5b1804bc-fe14-4c71-ab48-7344a0c78de4 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:33.634650 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5b1804bc-fe14-4c71-ab48-7344a0c78de4 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:33.635622 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5b1804bc-fe14-4c71-ab48-7344a0c78de4 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:33.637493 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5b1804bc-fe14-4c71-ab48-7344a0c78de4 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:33.638094 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5b1804bc-fe14-4c71-ab48-7344a0c78de4 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:33.994007 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-5b1804bc-fe14-4c71-ab48-7344a0c78de4 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6513f5e908ac4d028cad6eeeebeab285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65946afc398d4a9fb1c9095a4f946e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:57:34.003896 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5b1804bc-fe14-4c71-ab48-7344a0c78de4 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc" status: 200 len: 1505 microversion: 2.1 time: 0.384575 Oct 04 20:57:34.025058 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2288/4619] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:57:33 2022] GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc => generated 1505 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:57:34.056660 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-91317133-6ea2-47a8-ac02-b4b9a16f11d2 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0d54ecb4da4d1795ff4a6bfe4ebc77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76cb3acdf52a4016b1af1e1a70614243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:57:34.064173 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0102a214-1f83-4590-8bc1-80145db11fc6 tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:34.065249 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-0102a214-1f83-4590-8bc1-80145db11fc6 tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] [instance: f5d7d242-102d-4791-92ba-96dc7b84172a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:57:34.087426 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-91317133-6ea2-47a8-ac02-b4b9a16f11d2 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] 10.222.0.33 "GET /compute/v2.1/servers/5b67418e-7355-4fdd-ada2-7a36dd772d50" status: 200 len: 1521 microversion: 2.1 time: 0.503003 Oct 04 20:57:34.090790 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0102a214-1f83-4590-8bc1-80145db11fc6 tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:34.093019 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0102a214-1f83-4590-8bc1-80145db11fc6 tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:34.097388 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0102a214-1f83-4590-8bc1-80145db11fc6 tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:34.101064 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2332/4620] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:57:33 2022] GET /compute/v2.1/servers/5b67418e-7355-4fdd-ada2-7a36dd772d50 => generated 1521 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:57:34.106862 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0102a214-1f83-4590-8bc1-80145db11fc6 tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:34.109377 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0102a214-1f83-4590-8bc1-80145db11fc6 tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:34.118136 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0102a214-1f83-4590-8bc1-80145db11fc6 tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:34.394542 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-13a10bff-fe2c-4517-8ad8-e5230ea3fcf9 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-100406528", "imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63", "flavorRef": "452", "networks": [{"uuid": "780a66b6-435f-46df-9c7b-6f763e190356"}]}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:57:34.503275 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.network.neutron [None req-13a10bff-fe2c-4517-8ad8-e5230ea3fcf9 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] validate_networks() for [('780a66b6-435f-46df-9c7b-6f763e190356', None, None, None, None, None)] {{(pid=128802) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:57:34.920419 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-0102a214-1f83-4590-8bc1-80145db11fc6 tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ce92a1863c43e387f3410c3f7081b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3351642441347c4badf854104a0f38a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:57:34.932668 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-0102a214-1f83-4590-8bc1-80145db11fc6 tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] 10.222.0.33 "GET /compute/v2.1/servers/f5d7d242-102d-4791-92ba-96dc7b84172a" status: 200 len: 1311 microversion: 2.1 time: 0.872491 Oct 04 20:57:34.933802 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2289/4621] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:57:34 2022] GET /compute/v2.1/servers/f5d7d242-102d-4791-92ba-96dc7b84172a => generated 1311 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:57:35.122745 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f222dda2-b0ab-46b0-b4de-5c6923d1c11e tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:35.123422 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f222dda2-b0ab-46b0-b4de-5c6923d1c11e tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] [instance: 5b67418e-7355-4fdd-ada2-7a36dd772d50] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:57:35.133511 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f222dda2-b0ab-46b0-b4de-5c6923d1c11e tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:35.134188 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f222dda2-b0ab-46b0-b4de-5c6923d1c11e tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:35.134978 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f222dda2-b0ab-46b0-b4de-5c6923d1c11e tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:35.137671 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f222dda2-b0ab-46b0-b4de-5c6923d1c11e tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:35.145158 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f222dda2-b0ab-46b0-b4de-5c6923d1c11e tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:35.145828 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f222dda2-b0ab-46b0-b4de-5c6923d1c11e tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:35.333463 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f222dda2-b0ab-46b0-b4de-5c6923d1c11e tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0d54ecb4da4d1795ff4a6bfe4ebc77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76cb3acdf52a4016b1af1e1a70614243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:57:35.375190 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f222dda2-b0ab-46b0-b4de-5c6923d1c11e tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] 10.222.0.33 "GET /compute/v2.1/servers/5b67418e-7355-4fdd-ada2-7a36dd772d50" status: 200 len: 1479 microversion: 2.1 time: 0.254507 Oct 04 20:57:35.376550 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2290/4622] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:57:35 2022] GET /compute/v2.1/servers/5b67418e-7355-4fdd-ada2-7a36dd772d50 => generated 1479 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:57:35.618395 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-1551fd54-c3ef-4d36-a141-51991bf5cd59 req-8dc967fe-c373-40ac-a153-74c4e01a2805 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b67418e-7355-4fdd-ada2-7a36dd772d50", "name": "network-vif-deleted", "tag": "2bcb6757-3e87-4ab6-acff-94770b3a1854"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:57:35.631873 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-1551fd54-c3ef-4d36-a141-51991bf5cd59 req-8dc967fe-c373-40ac-a153-74c4e01a2805 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:35.635590 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-1551fd54-c3ef-4d36-a141-51991bf5cd59 req-8dc967fe-c373-40ac-a153-74c4e01a2805 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:35.636787 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-1551fd54-c3ef-4d36-a141-51991bf5cd59 req-8dc967fe-c373-40ac-a153-74c4e01a2805 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:35.656456 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-1551fd54-c3ef-4d36-a141-51991bf5cd59 req-8dc967fe-c373-40ac-a153-74c4e01a2805 service nova] Creating event network-vif-deleted:2bcb6757-3e87-4ab6-acff-94770b3a1854 for instance 5b67418e-7355-4fdd-ada2-7a36dd772d50 on n-h1-854823-8 Oct 04 20:57:35.666322 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-1551fd54-c3ef-4d36-a141-51991bf5cd59 req-8dc967fe-c373-40ac-a153-74c4e01a2805 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057800 Oct 04 20:57:35.667843 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2291/4623] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:57:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 20:57:35.799109 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-13a10bff-fe2c-4517-8ad8-e5230ea3fcf9 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Flavor limits 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:57:35.799663 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-13a10bff-fe2c-4517-8ad8-e5230ea3fcf9 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Image limits 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:57:35.802553 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-13a10bff-fe2c-4517-8ad8-e5230ea3fcf9 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Flavor pref 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:57:35.803435 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-13a10bff-fe2c-4517-8ad8-e5230ea3fcf9 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Image pref 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:57:35.805877 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-13a10bff-fe2c-4517-8ad8-e5230ea3fcf9 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:57:35.832867 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-13a10bff-fe2c-4517-8ad8-e5230ea3fcf9 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:35.835486 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-13a10bff-fe2c-4517-8ad8-e5230ea3fcf9 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:35.835936 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-13a10bff-fe2c-4517-8ad8-e5230ea3fcf9 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:35.836692 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-13a10bff-fe2c-4517-8ad8-e5230ea3fcf9 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:35.837142 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-13a10bff-fe2c-4517-8ad8-e5230ea3fcf9 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:35.840836 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-13a10bff-fe2c-4517-8ad8-e5230ea3fcf9 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:35.867350 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-13a10bff-fe2c-4517-8ad8-e5230ea3fcf9 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Getting quotas for project 65946afc398d4a9fb1c9095a4f946e07. Resources: {'ram', 'instances', 'cores'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:57:35.876219 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-13a10bff-fe2c-4517-8ad8-e5230ea3fcf9 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Getting quotas for user 6513f5e908ac4d028cad6eeeebeab285 and project 65946afc398d4a9fb1c9095a4f946e07. Resources: {'ram', 'instances', 'cores'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:57:35.891540 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-13a10bff-fe2c-4517-8ad8-e5230ea3fcf9 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Going to run 1 instances... {{(pid=128802) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:57:35.894536 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-13a10bff-fe2c-4517-8ad8-e5230ea3fcf9 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] [instance: 368d4aa4-81a1-43af-a69b-e5f7004da740] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='15b24725-0c99-4bcf-b1fb-907cdf8e2d63',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128802) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:57:35.963972 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-dc4f39f8-e3e1-456a-acda-791f8fcf84cc tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:35.965104 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-dc4f39f8-e3e1-456a-acda-791f8fcf84cc tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] [instance: f5d7d242-102d-4791-92ba-96dc7b84172a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:57:35.975798 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dc4f39f8-e3e1-456a-acda-791f8fcf84cc tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:35.977779 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dc4f39f8-e3e1-456a-acda-791f8fcf84cc tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:35.978911 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dc4f39f8-e3e1-456a-acda-791f8fcf84cc tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:35.979897 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dc4f39f8-e3e1-456a-acda-791f8fcf84cc tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:35.980989 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dc4f39f8-e3e1-456a-acda-791f8fcf84cc tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:35.982087 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dc4f39f8-e3e1-456a-acda-791f8fcf84cc tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:35.983773 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-13a10bff-fe2c-4517-8ad8-e5230ea3fcf9 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.593683 Oct 04 20:57:35.994604 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2333/4624] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 20:57:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 1600 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 20:57:36.025745 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-c0b2ab73-f60f-4f51-b798-bf40fd5a1e40 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:36.026423 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-c0b2ab73-f60f-4f51-b798-bf40fd5a1e40 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] [instance: 368d4aa4-81a1-43af-a69b-e5f7004da740] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:57:36.210055 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-c0b2ab73-f60f-4f51-b798-bf40fd5a1e40 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6513f5e908ac4d028cad6eeeebeab285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65946afc398d4a9fb1c9095a4f946e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:57:36.227926 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-c0b2ab73-f60f-4f51-b798-bf40fd5a1e40 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "GET /compute/v2.1/servers/368d4aa4-81a1-43af-a69b-e5f7004da740" status: 200 len: 1216 microversion: 2.1 time: 0.224014 Oct 04 20:57:36.230423 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2334/4625] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:57:35 2022] GET /compute/v2.1/servers/368d4aa4-81a1-43af-a69b-e5f7004da740 => generated 1216 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:57:36.400159 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-f61ff4fd-8e65-4dac-b443-8d5ff6070c57 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:36.400766 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-f61ff4fd-8e65-4dac-b443-8d5ff6070c57 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] [instance: 5b67418e-7355-4fdd-ada2-7a36dd772d50] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:57:36.409502 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f61ff4fd-8e65-4dac-b443-8d5ff6070c57 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:36.418153 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f61ff4fd-8e65-4dac-b443-8d5ff6070c57 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:36.420552 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f61ff4fd-8e65-4dac-b443-8d5ff6070c57 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:36.423442 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f61ff4fd-8e65-4dac-b443-8d5ff6070c57 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:36.430140 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f61ff4fd-8e65-4dac-b443-8d5ff6070c57 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:36.431302 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f61ff4fd-8e65-4dac-b443-8d5ff6070c57 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:36.586511 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f61ff4fd-8e65-4dac-b443-8d5ff6070c57 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:36.587006 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f61ff4fd-8e65-4dac-b443-8d5ff6070c57 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:36.587432 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f61ff4fd-8e65-4dac-b443-8d5ff6070c57 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:36.594294 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.objects.instance [None req-f61ff4fd-8e65-4dac-b443-8d5ff6070c57 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Lazy-loading 'fault' on Instance uuid 5b67418e-7355-4fdd-ada2-7a36dd772d50 {{(pid=128802) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:57:36.921078 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-f61ff4fd-8e65-4dac-b443-8d5ff6070c57 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0d54ecb4da4d1795ff4a6bfe4ebc77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76cb3acdf52a4016b1af1e1a70614243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:57:36.931911 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-f61ff4fd-8e65-4dac-b443-8d5ff6070c57 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] 10.222.0.33 "GET /compute/v2.1/servers/5b67418e-7355-4fdd-ada2-7a36dd772d50" status: 200 len: 1312 microversion: 2.1 time: 0.535520 Oct 04 20:57:36.940351 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2335/4626] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:57:36 2022] GET /compute/v2.1/servers/5b67418e-7355-4fdd-ada2-7a36dd772d50 => generated 1312 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:57:36.961027 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-82655fc0-d50e-43aa-a944-445c0ac4d0eb req-851e6cce-34ba-43a6-8ed6-008f77e7adb8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5d7d242-102d-4791-92ba-96dc7b84172a", "name": "network-vif-plugged", "status": "completed", "tag": "df23aac4-8d0f-4b97-9cf1-527775e6fa37"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:57:37.000213 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-82655fc0-d50e-43aa-a944-445c0ac4d0eb req-851e6cce-34ba-43a6-8ed6-008f77e7adb8 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:37.002278 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-82655fc0-d50e-43aa-a944-445c0ac4d0eb req-851e6cce-34ba-43a6-8ed6-008f77e7adb8 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:37.003932 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-82655fc0-d50e-43aa-a944-445c0ac4d0eb req-851e6cce-34ba-43a6-8ed6-008f77e7adb8 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:37.018858 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-dc4f39f8-e3e1-456a-acda-791f8fcf84cc tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ce92a1863c43e387f3410c3f7081b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3351642441347c4badf854104a0f38a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:57:37.041925 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-dc4f39f8-e3e1-456a-acda-791f8fcf84cc tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] 10.222.0.33 "GET /compute/v2.1/servers/f5d7d242-102d-4791-92ba-96dc7b84172a" status: 200 len: 1311 microversion: 2.1 time: 1.084192 Oct 04 20:57:37.042545 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2292/4627] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:57:35 2022] GET /compute/v2.1/servers/f5d7d242-102d-4791-92ba-96dc7b84172a => generated 1311 bytes in 1086 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:57:37.062156 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-82655fc0-d50e-43aa-a944-445c0ac4d0eb req-851e6cce-34ba-43a6-8ed6-008f77e7adb8 service nova] Creating event network-vif-plugged:df23aac4-8d0f-4b97-9cf1-527775e6fa37 for instance f5d7d242-102d-4791-92ba-96dc7b84172a on n-h1-854823-8 Oct 04 20:57:37.073685 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-82655fc0-d50e-43aa-a944-445c0ac4d0eb req-851e6cce-34ba-43a6-8ed6-008f77e7adb8 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131307 Oct 04 20:57:37.074472 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2336/4628] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:57:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:57:37.257040 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c4691a54-ebc8-406a-bcd1-24387d45f87f tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:37.257586 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c4691a54-ebc8-406a-bcd1-24387d45f87f tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] [instance: 368d4aa4-81a1-43af-a69b-e5f7004da740] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:57:37.271072 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c4691a54-ebc8-406a-bcd1-24387d45f87f tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:37.271643 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c4691a54-ebc8-406a-bcd1-24387d45f87f tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:37.272091 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c4691a54-ebc8-406a-bcd1-24387d45f87f tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:37.275157 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c4691a54-ebc8-406a-bcd1-24387d45f87f tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:37.275850 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c4691a54-ebc8-406a-bcd1-24387d45f87f tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:37.276452 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c4691a54-ebc8-406a-bcd1-24387d45f87f tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:37.549866 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c4691a54-ebc8-406a-bcd1-24387d45f87f tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6513f5e908ac4d028cad6eeeebeab285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65946afc398d4a9fb1c9095a4f946e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:57:37.582145 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c4691a54-ebc8-406a-bcd1-24387d45f87f tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "GET /compute/v2.1/servers/368d4aa4-81a1-43af-a69b-e5f7004da740" status: 200 len: 1212 microversion: 2.1 time: 0.328292 Oct 04 20:57:37.587297 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2293/4629] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:57:37 2022] GET /compute/v2.1/servers/368d4aa4-81a1-43af-a69b-e5f7004da740 => generated 1212 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:57:37.965618 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-fd486595-2438-49f7-84da-39ec64cafe34 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:37.966502 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-fd486595-2438-49f7-84da-39ec64cafe34 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] [instance: 5b67418e-7355-4fdd-ada2-7a36dd772d50] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:57:37.987619 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fd486595-2438-49f7-84da-39ec64cafe34 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:37.988121 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fd486595-2438-49f7-84da-39ec64cafe34 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:37.988576 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fd486595-2438-49f7-84da-39ec64cafe34 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:37.989831 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fd486595-2438-49f7-84da-39ec64cafe34 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:37.990135 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fd486595-2438-49f7-84da-39ec64cafe34 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:37.990707 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fd486595-2438-49f7-84da-39ec64cafe34 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:38.015295 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.wsgi [None req-fd486595-2438-49f7-84da-39ec64cafe34 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] HTTP exception thrown: Instance 5b67418e-7355-4fdd-ada2-7a36dd772d50 could not be found. Oct 04 20:57:38.023391 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-fd486595-2438-49f7-84da-39ec64cafe34 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Request method failure captured: Oct 04 20:57:38.023391 n-d-854823-8 devstack@n-api.service[128802]: request: GET /compute/v2.1/servers/5b67418e-7355-4fdd-ada2-7a36dd772d50 HTTP/1.1 Oct 04 20:57:38.023391 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 20:57:38.023391 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 20:57:38.023391 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 20:57:38.023391 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 0 Oct 04 20:57:38.023391 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 20:57:38.023391 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 20:57:38.023391 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 20:57:38.023391 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 20:57:38.023391 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPJ4VuT2cCVvV5gxG1iPB83Bxn6TBK7uhx9NXV5-9_fAcNWw9t-nXpd4t_HFZR-Q4b2SngVWjg1zGpKRiP1240ZfpcC1Uk8a3h8XpA4eQigNugjB_CpEPCs6qb_9FfT6Wcw0tdPLd1MeN4oZpsYagYrovtibHIgvswEBNsdy3mkIJgmY Oct 04 20:57:38.023391 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 20:57:38.023391 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 20:57:38.023391 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 20:57:38.023391 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 20:57:38.023391 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 20:57:38.023391 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 20:57:38.023391 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: 76cb3acdf52a4016b1af1e1a70614243 Oct 04 20:57:38.023391 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-ListServersNegativeTestJSON-1056031141 Oct 04 20:57:38.023391 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 20:57:38.023391 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 20:57:38.023391 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_76cb3acdf52a4016b1af1e1a70614243", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/76cb3acdf52a4016b1af1e1a70614243"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/76cb3acdf52a4016b1af1e1a70614243"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/76cb3acdf52a4016b1af1e1a70614243"}]}] Oct 04 20:57:38.023391 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-ListServersNegativeTestJSON-1056031141 Oct 04 20:57:38.023391 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: 76cb3acdf52a4016b1af1e1a70614243 Oct 04 20:57:38.023391 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1056031141 Oct 04 20:57:38.023391 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-ListServersNegativeTestJSON-1056031141-project Oct 04 20:57:38.023391 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 20:57:38.023391 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 20:57:38.023391 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: cc0d54ecb4da4d1795ff4a6bfe4ebc77 Oct 04 20:57:38.023391 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-ListServersNegativeTestJSON-1056031141-project Oct 04 20:57:38.023391 n-d-854823-8 devstack@n-api.service[128802]: method: > Oct 04 20:57:38.023391 n-d-854823-8 devstack@n-api.service[128802]: exception: Instance 5b67418e-7355-4fdd-ada2-7a36dd772d50 could not be found. Oct 04 20:57:38.023391 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'id': '5b67418e-7355-4fdd-ada2-7a36dd772d50'} Oct 04 20:57:38.023391 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:57:38.023391 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:57:38.023391 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:57:38.023391 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:57:38.023391 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:57:38.023391 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:57:38.023391 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:57:38.023391 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:57:38.023391 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:57:38.023391 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:57:38.023391 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b67418e-7355-4fdd-ada2-7a36dd772d50 could not be found. Oct 04 20:57:38.023391 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:57:38.023391 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:57:38.023391 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:57:38.023391 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:57:38.023391 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:57:38.023391 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:57:38.023391 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:57:38.023391 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:57:38.023391 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:57:38.023391 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:57:38.023391 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:57:38.023391 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:57:38.023391 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:57:38.023391 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:57:38.023391 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:57:38.023391 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:57:38.023391 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b67418e-7355-4fdd-ada2-7a36dd772d50 could not be found. Oct 04 20:57:38.023391 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:57:38.023391 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:57:38.028415 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:57:38.028415 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:57:38.028415 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:57:38.028415 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:57:38.028415 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:57:38.028415 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:57:38.028415 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b67418e-7355-4fdd-ada2-7a36dd772d50 could not be found. Oct 04 20:57:38.028415 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:57:38.028415 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-fd486595-2438-49f7-84da-39ec64cafe34 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Returning 404 to user: Instance 5b67418e-7355-4fdd-ada2-7a36dd772d50 could not be found. {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:57:38.028415 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-fd486595-2438-49f7-84da-39ec64cafe34 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] 10.222.0.33 "GET /compute/v2.1/servers/5b67418e-7355-4fdd-ada2-7a36dd772d50" status: 404 len: 111 microversion: 2.1 time: 0.066578 Oct 04 20:57:38.032515 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2337/4630] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:57:37 2022] GET /compute/v2.1/servers/5b67418e-7355-4fdd-ada2-7a36dd772d50 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:57:38.037871 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0b82ff4c-86ab-460b-adca-48b6c9027034 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:38.043473 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-0b82ff4c-86ab-460b-adca-48b6c9027034 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cc0d54ecb4da4d1795ff4a6bfe4ebc77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76cb3acdf52a4016b1af1e1a70614243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:57:38.044376 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-0b82ff4c-86ab-460b-adca-48b6c9027034 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Searching by: {'changes-since': datetime.datetime(2051, 1, 1, 12, 34, tzinfo=datetime.timezone.utc), 'vm_state': ['active'], 'project_id': '76cb3acdf52a4016b1af1e1a70614243'} {{(pid=128801) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 20:57:38.062992 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0b82ff4c-86ab-460b-adca-48b6c9027034 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:38.063473 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0b82ff4c-86ab-460b-adca-48b6c9027034 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:38.064288 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0b82ff4c-86ab-460b-adca-48b6c9027034 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:38.065200 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0b82ff4c-86ab-460b-adca-48b6c9027034 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:38.066013 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0b82ff4c-86ab-460b-adca-48b6c9027034 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:38.068408 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0b82ff4c-86ab-460b-adca-48b6c9027034 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:38.074401 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-89703406-068b-4223-a1cf-03875df65f9a tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:38.075040 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-89703406-068b-4223-a1cf-03875df65f9a tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] [instance: f5d7d242-102d-4791-92ba-96dc7b84172a] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:57:38.087641 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-89703406-068b-4223-a1cf-03875df65f9a tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:38.089484 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-89703406-068b-4223-a1cf-03875df65f9a tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:38.089948 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-89703406-068b-4223-a1cf-03875df65f9a tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:38.090707 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-89703406-068b-4223-a1cf-03875df65f9a tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:38.091175 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-89703406-068b-4223-a1cf-03875df65f9a tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:38.091612 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-89703406-068b-4223-a1cf-03875df65f9a tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:38.176168 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-0b82ff4c-86ab-460b-adca-48b6c9027034 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] 10.222.0.33 "GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE" status: 200 len: 15 microversion: 2.1 time: 0.142696 Oct 04 20:57:38.184664 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2294/4631] 10.222.0.33 () {58 vars in 1230 bytes} [Tue Oct 4 20:57:38 2022] GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE => generated 15 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 20:57:38.191084 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5b1fa598-0ff1-4312-89e4-7b276380632b tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:38.196704 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5b1fa598-0ff1-4312-89e4-7b276380632b tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Request method failure captured: Oct 04 20:57:38.196704 n-d-854823-8 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 HTTP/1.1 Oct 04 20:57:38.196704 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:57:38.196704 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:57:38.196704 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:57:38.196704 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 0 Oct 04 20:57:38.196704 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:57:38.196704 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:57:38.196704 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:57:38.196704 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:57:38.196704 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJ4VuT2cCVvV5gxG1iPB83Bxn6TBK7uhx9NXV5-9_fAcNWw9t-nXpd4t_HFZR-Q4b2SngVWjg1zGpKRiP1240ZfpcC1Uk8a3h8XpA4eQigNugjB_CpEPCs6qb_9FfT6Wcw0tdPLd1MeN4oZpsYagYrovtibHIgvswEBNsdy3mkIJgmY Oct 04 20:57:38.196704 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:57:38.196704 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:57:38.196704 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:57:38.196704 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:57:38.196704 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:57:38.196704 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:57:38.196704 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: 76cb3acdf52a4016b1af1e1a70614243 Oct 04 20:57:38.196704 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-ListServersNegativeTestJSON-1056031141 Oct 04 20:57:38.196704 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 20:57:38.196704 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 20:57:38.196704 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_76cb3acdf52a4016b1af1e1a70614243", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/76cb3acdf52a4016b1af1e1a70614243"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/76cb3acdf52a4016b1af1e1a70614243"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/76cb3acdf52a4016b1af1e1a70614243"}]}] Oct 04 20:57:38.196704 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-ListServersNegativeTestJSON-1056031141 Oct 04 20:57:38.196704 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: 76cb3acdf52a4016b1af1e1a70614243 Oct 04 20:57:38.196704 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1056031141 Oct 04 20:57:38.196704 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-ListServersNegativeTestJSON-1056031141-project Oct 04 20:57:38.196704 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:57:38.196704 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:57:38.196704 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: cc0d54ecb4da4d1795ff4a6bfe4ebc77 Oct 04 20:57:38.196704 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-ListServersNegativeTestJSON-1056031141-project Oct 04 20:57:38.196704 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 20:57:38.196704 n-d-854823-8 devstack@n-api.service[128801]: exception: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Oct 04 20:57:38.196704 n-d-854823-8 devstack@n-api.service[128801]: action_args: {} Oct 04 20:57:38.196704 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:57:38.196704 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:57:38.196704 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 20:57:38.196704 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 20:57:38.196704 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 20:57:38.196704 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise error Oct 04 20:57:38.196704 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '2011/01/01' is not a 'date-time' Oct 04 20:57:38.196704 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:57:38.196704 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['changes-since']['items']: Oct 04 20:57:38.196704 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi {'format': 'date-time', 'type': 'string'} Oct 04 20:57:38.196704 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:57:38.196704 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi On instance[0]: Oct 04 20:57:38.196704 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi '2011/01/01' Oct 04 20:57:38.196704 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:57:38.196704 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:57:38.196704 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:57:38.196704 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:57:38.196704 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:57:38.196704 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:57:38.196704 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:57:38.196704 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:57:38.196704 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:57:38.196704 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:57:38.196704 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 20:57:38.196704 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:57:38.196704 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 20:57:38.196704 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:57:38.196704 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 20:57:38.196704 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:57:38.196704 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 04 20:57:38.196704 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Oct 04 20:57:38.196704 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Oct 04 20:57:38.196704 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 20:57:38.201232 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 20:57:38.201232 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 20:57:38.201232 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 20:57:38.201232 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Oct 04 20:57:38.201232 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:57:38.201232 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:57:38.201232 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:57:38.201232 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:57:38.201232 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:57:38.201232 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:57:38.201232 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 20:57:38.201232 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 20:57:38.201232 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Oct 04 20:57:38.201232 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:57:38.201232 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5b1fa598-0ff1-4312-89e4-7b276380632b tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Returning 400 to user: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:57:38.201232 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5b1fa598-0ff1-4312-89e4-7b276380632b tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] 10.222.0.33 "GET /compute/v2.1/servers?changes-since=2011%2F01%2F01" status: 400 len: 146 microversion: 2.1 time: 0.012159 Oct 04 20:57:38.201232 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2295/4632] 10.222.0.33 () {58 vars in 1182 bytes} [Tue Oct 4 20:57:38 2022] GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 => generated 146 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 20:57:38.211411 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a3c94c46-b1a3-4b9f-adea-fcc50024e839 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:38.217171 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-a3c94c46-b1a3-4b9f-adea-fcc50024e839 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cc0d54ecb4da4d1795ff4a6bfe4ebc77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76cb3acdf52a4016b1af1e1a70614243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:57:38.218053 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a3c94c46-b1a3-4b9f-adea-fcc50024e839 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Searching by: {'deleted': False, 'project_id': '76cb3acdf52a4016b1af1e1a70614243'} {{(pid=128801) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 20:57:38.230635 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a3c94c46-b1a3-4b9f-adea-fcc50024e839 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:38.231118 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a3c94c46-b1a3-4b9f-adea-fcc50024e839 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:38.231550 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a3c94c46-b1a3-4b9f-adea-fcc50024e839 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:38.232646 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a3c94c46-b1a3-4b9f-adea-fcc50024e839 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:38.233100 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a3c94c46-b1a3-4b9f-adea-fcc50024e839 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:38.233883 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a3c94c46-b1a3-4b9f-adea-fcc50024e839 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:38.276228 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.multi_cell_list [None req-a3c94c46-b1a3-4b9f-adea-fcc50024e839 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=128801) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 20:57:38.314863 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a3c94c46-b1a3-4b9f-adea-fcc50024e839 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] 10.222.0.33 "GET /compute/v2.1/servers" status: 200 len: 681 microversion: 2.1 time: 0.109482 Oct 04 20:57:38.322549 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2296/4633] 10.222.0.33 () {58 vars in 1125 bytes} [Tue Oct 4 20:57:38 2022] GET /compute/v2.1/servers => generated 681 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:57:38.330845 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-df6aa5d5-5751-4be9-8275-58ac03a704da tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:38.340544 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-df6aa5d5-5751-4be9-8275-58ac03a704da tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cc0d54ecb4da4d1795ff4a6bfe4ebc77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76cb3acdf52a4016b1af1e1a70614243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:57:38.341247 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.compute.servers [None req-df6aa5d5-5751-4be9-8275-58ac03a704da tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Removing options 'limit' from query {{(pid=128801) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 04 20:57:38.342146 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-df6aa5d5-5751-4be9-8275-58ac03a704da tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Searching by: {'deleted': False, 'project_id': '76cb3acdf52a4016b1af1e1a70614243'} {{(pid=128801) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 20:57:38.351183 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-df6aa5d5-5751-4be9-8275-58ac03a704da tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:38.351918 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-df6aa5d5-5751-4be9-8275-58ac03a704da tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:38.352525 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-df6aa5d5-5751-4be9-8275-58ac03a704da tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:38.353506 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-df6aa5d5-5751-4be9-8275-58ac03a704da tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:38.354173 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-df6aa5d5-5751-4be9-8275-58ac03a704da tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:38.354962 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-df6aa5d5-5751-4be9-8275-58ac03a704da tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:38.383981 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:57:38.393820 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.multi_cell_list [None req-df6aa5d5-5751-4be9-8275-58ac03a704da tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Listed batch of 2 results from cell out of 102 limit. Returned 2 total so far. {{(pid=128801) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 20:57:38.411851 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-89703406-068b-4223-a1cf-03875df65f9a tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ce92a1863c43e387f3410c3f7081b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3351642441347c4badf854104a0f38a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:57:38.428419 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-89703406-068b-4223-a1cf-03875df65f9a tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] 10.222.0.33 "GET /compute/v2.1/servers/f5d7d242-102d-4791-92ba-96dc7b84172a" status: 200 len: 1311 microversion: 2.1 time: 0.358632 Oct 04 20:57:38.430454 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2338/4634] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:57:38 2022] GET /compute/v2.1/servers/f5d7d242-102d-4791-92ba-96dc7b84172a => generated 1311 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:57:38.460158 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-df6aa5d5-5751-4be9-8275-58ac03a704da tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] 10.222.0.33 "GET /compute/v2.1/servers?limit=102" status: 200 len: 681 microversion: 2.1 time: 0.135290 Oct 04 20:57:38.461894 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2297/4635] 10.222.0.33 () {58 vars in 1144 bytes} [Tue Oct 4 20:57:38 2022] GET /compute/v2.1/servers?limit=102 => generated 681 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:57:38.477081 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-76948cfb-ba25-4dde-a511-c4e4bf583358 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:38.484292 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-76948cfb-ba25-4dde-a511-c4e4bf583358 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Request method failure captured: Oct 04 20:57:38.484292 n-d-854823-8 devstack@n-api.service[128802]: request: GET /compute/v2.1/servers?limit=-1 HTTP/1.1 Oct 04 20:57:38.484292 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 20:57:38.484292 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 20:57:38.484292 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 20:57:38.484292 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 0 Oct 04 20:57:38.484292 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 20:57:38.484292 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 20:57:38.484292 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 20:57:38.484292 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 20:57:38.484292 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPJ4VuT2cCVvV5gxG1iPB83Bxn6TBK7uhx9NXV5-9_fAcNWw9t-nXpd4t_HFZR-Q4b2SngVWjg1zGpKRiP1240ZfpcC1Uk8a3h8XpA4eQigNugjB_CpEPCs6qb_9FfT6Wcw0tdPLd1MeN4oZpsYagYrovtibHIgvswEBNsdy3mkIJgmY Oct 04 20:57:38.484292 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 20:57:38.484292 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 20:57:38.484292 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 20:57:38.484292 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 20:57:38.484292 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 20:57:38.484292 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 20:57:38.484292 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: 76cb3acdf52a4016b1af1e1a70614243 Oct 04 20:57:38.484292 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-ListServersNegativeTestJSON-1056031141 Oct 04 20:57:38.484292 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 20:57:38.484292 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 20:57:38.484292 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_76cb3acdf52a4016b1af1e1a70614243", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/76cb3acdf52a4016b1af1e1a70614243"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/76cb3acdf52a4016b1af1e1a70614243"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/76cb3acdf52a4016b1af1e1a70614243"}]}] Oct 04 20:57:38.484292 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-ListServersNegativeTestJSON-1056031141 Oct 04 20:57:38.484292 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: 76cb3acdf52a4016b1af1e1a70614243 Oct 04 20:57:38.484292 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1056031141 Oct 04 20:57:38.484292 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-ListServersNegativeTestJSON-1056031141-project Oct 04 20:57:38.484292 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 20:57:38.484292 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 20:57:38.484292 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: cc0d54ecb4da4d1795ff4a6bfe4ebc77 Oct 04 20:57:38.484292 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-ListServersNegativeTestJSON-1056031141-project Oct 04 20:57:38.484292 n-d-854823-8 devstack@n-api.service[128802]: method: > Oct 04 20:57:38.484292 n-d-854823-8 devstack@n-api.service[128802]: exception: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Oct 04 20:57:38.484292 n-d-854823-8 devstack@n-api.service[128802]: action_args: {} Oct 04 20:57:38.484292 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:57:38.484292 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:57:38.484292 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 20:57:38.484292 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 20:57:38.484292 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 20:57:38.484292 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise error Oct 04 20:57:38.484292 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '-1' does not match '^[0-9]*$' Oct 04 20:57:38.484292 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:57:38.484292 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Oct 04 20:57:38.484292 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 04 20:57:38.484292 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi 'minimum': 0, Oct 04 20:57:38.484292 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 04 20:57:38.484292 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 04 20:57:38.484292 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:57:38.484292 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi On instance[0]: Oct 04 20:57:38.484292 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi '-1' Oct 04 20:57:38.484292 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:57:38.484292 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:57:38.484292 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:57:38.484292 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:57:38.484292 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:57:38.484292 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:57:38.484292 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:57:38.484292 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:57:38.484292 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:57:38.484292 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:57:38.484292 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 20:57:38.484292 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:57:38.484292 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 20:57:38.484292 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:57:38.484292 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 20:57:38.484292 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:57:38.484292 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 04 20:57:38.484292 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Oct 04 20:57:38.484292 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Oct 04 20:57:38.497107 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 20:57:38.497107 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 20:57:38.497107 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 20:57:38.497107 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 20:57:38.497107 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Oct 04 20:57:38.497107 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:57:38.497107 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:57:38.497107 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:57:38.497107 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:57:38.497107 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:57:38.497107 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:57:38.497107 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 20:57:38.497107 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 20:57:38.497107 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Oct 04 20:57:38.497107 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:57:38.497107 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-76948cfb-ba25-4dde-a511-c4e4bf583358 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Returning 400 to user: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:57:38.497107 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-76948cfb-ba25-4dde-a511-c4e4bf583358 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] 10.222.0.33 "GET /compute/v2.1/servers?limit=-1" status: 400 len: 127 microversion: 2.1 time: 0.015128 Oct 04 20:57:38.497107 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2339/4636] 10.222.0.33 () {58 vars in 1142 bytes} [Tue Oct 4 20:57:38 2022] GET /compute/v2.1/servers?limit=-1 => generated 127 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 20:57:38.500644 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-268fe371-5b48-48e8-ab22-33d7277efa2c tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:38.508515 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-268fe371-5b48-48e8-ab22-33d7277efa2c tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Request method failure captured: Oct 04 20:57:38.508515 n-d-854823-8 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers?limit=testing HTTP/1.1 Oct 04 20:57:38.508515 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:57:38.508515 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:57:38.508515 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:57:38.508515 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 0 Oct 04 20:57:38.508515 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:57:38.508515 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:57:38.508515 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:57:38.508515 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:57:38.508515 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJ4VuT2cCVvV5gxG1iPB83Bxn6TBK7uhx9NXV5-9_fAcNWw9t-nXpd4t_HFZR-Q4b2SngVWjg1zGpKRiP1240ZfpcC1Uk8a3h8XpA4eQigNugjB_CpEPCs6qb_9FfT6Wcw0tdPLd1MeN4oZpsYagYrovtibHIgvswEBNsdy3mkIJgmY Oct 04 20:57:38.508515 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:57:38.508515 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:57:38.508515 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:57:38.508515 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:57:38.508515 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:57:38.508515 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:57:38.508515 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: 76cb3acdf52a4016b1af1e1a70614243 Oct 04 20:57:38.508515 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-ListServersNegativeTestJSON-1056031141 Oct 04 20:57:38.508515 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 20:57:38.508515 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 20:57:38.508515 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_76cb3acdf52a4016b1af1e1a70614243", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/76cb3acdf52a4016b1af1e1a70614243"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/76cb3acdf52a4016b1af1e1a70614243"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/76cb3acdf52a4016b1af1e1a70614243"}]}] Oct 04 20:57:38.508515 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-ListServersNegativeTestJSON-1056031141 Oct 04 20:57:38.508515 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: 76cb3acdf52a4016b1af1e1a70614243 Oct 04 20:57:38.508515 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1056031141 Oct 04 20:57:38.508515 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-ListServersNegativeTestJSON-1056031141-project Oct 04 20:57:38.508515 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:57:38.508515 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:57:38.508515 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: cc0d54ecb4da4d1795ff4a6bfe4ebc77 Oct 04 20:57:38.508515 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-ListServersNegativeTestJSON-1056031141-project Oct 04 20:57:38.508515 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 20:57:38.508515 n-d-854823-8 devstack@n-api.service[128801]: exception: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Oct 04 20:57:38.508515 n-d-854823-8 devstack@n-api.service[128801]: action_args: {} Oct 04 20:57:38.508515 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:57:38.508515 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:57:38.508515 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 20:57:38.508515 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 20:57:38.508515 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 20:57:38.508515 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise error Oct 04 20:57:38.508515 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'testing' does not match '^[0-9]*$' Oct 04 20:57:38.508515 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:57:38.508515 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Oct 04 20:57:38.508515 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 04 20:57:38.508515 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi 'minimum': 0, Oct 04 20:57:38.508515 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 04 20:57:38.508515 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 04 20:57:38.508515 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:57:38.508515 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi On instance[0]: Oct 04 20:57:38.508515 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi 'testing' Oct 04 20:57:38.508515 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:57:38.508515 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:57:38.508515 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:57:38.508515 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:57:38.508515 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:57:38.508515 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:57:38.508515 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:57:38.508515 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:57:38.508515 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:57:38.508515 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:57:38.508515 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 20:57:38.508515 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:57:38.508515 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 20:57:38.508515 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:57:38.508515 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 20:57:38.508515 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:57:38.508515 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 04 20:57:38.508515 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Oct 04 20:57:38.508515 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Oct 04 20:57:38.517658 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 20:57:38.517658 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 20:57:38.517658 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 20:57:38.517658 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 20:57:38.517658 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Oct 04 20:57:38.517658 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:57:38.517658 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:57:38.517658 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:57:38.517658 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:57:38.517658 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:57:38.517658 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:57:38.517658 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 20:57:38.517658 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 20:57:38.517658 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Oct 04 20:57:38.517658 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:57:38.517658 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-268fe371-5b48-48e8-ab22-33d7277efa2c tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Returning 400 to user: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:57:38.517658 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-268fe371-5b48-48e8-ab22-33d7277efa2c tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] 10.222.0.33 "GET /compute/v2.1/servers?limit=testing" status: 400 len: 137 microversion: 2.1 time: 0.015815 Oct 04 20:57:38.517658 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2298/4637] 10.222.0.33 () {58 vars in 1152 bytes} [Tue Oct 4 20:57:38 2022] GET /compute/v2.1/servers?limit=testing => generated 137 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 20:57:38.536668 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-c04b9a10-f931-42e2-9e2b-3799c8ed37df tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:38.551050 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-c04b9a10-f931-42e2-9e2b-3799c8ed37df tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cc0d54ecb4da4d1795ff4a6bfe4ebc77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76cb3acdf52a4016b1af1e1a70614243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:57:38.552910 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-c04b9a10-f931-42e2-9e2b-3799c8ed37df tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Searching by: {'flavor': 'non_existing_flavor', 'deleted': False, 'project_id': '76cb3acdf52a4016b1af1e1a70614243'} {{(pid=128802) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 20:57:38.579928 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.compute.servers [None req-c04b9a10-f931-42e2-9e2b-3799c8ed37df tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Flavor 'non_existing_flavor' could not be found {{(pid=128802) _get_servers /opt/stack/nova/nova/api/openstack/compute/servers.py:336}} Oct 04 20:57:38.581413 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-c04b9a10-f931-42e2-9e2b-3799c8ed37df tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] 10.222.0.33 "GET /compute/v2.1/servers?flavor=non_existing_flavor" status: 200 len: 15 microversion: 2.1 time: 0.061233 Oct 04 20:57:38.588299 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2340/4638] 10.222.0.33 () {58 vars in 1178 bytes} [Tue Oct 4 20:57:38 2022] GET /compute/v2.1/servers?flavor=non_existing_flavor => generated 15 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 20:57:38.602210 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b85e70f0-9045-4479-9a2a-88f95f2483db tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:38.615671 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-453bac1e-3094-47d2-9926-7633867ca913 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:38.617029 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-b85e70f0-9045-4479-9a2a-88f95f2483db tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cc0d54ecb4da4d1795ff4a6bfe4ebc77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76cb3acdf52a4016b1af1e1a70614243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:57:38.617914 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-453bac1e-3094-47d2-9926-7633867ca913 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] [instance: 368d4aa4-81a1-43af-a69b-e5f7004da740] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:57:38.619461 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b85e70f0-9045-4479-9a2a-88f95f2483db tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Searching by: {'image': 'non_existing_image', 'deleted': False, 'project_id': '76cb3acdf52a4016b1af1e1a70614243'} {{(pid=128801) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 20:57:38.637446 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b85e70f0-9045-4479-9a2a-88f95f2483db tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:38.637956 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-453bac1e-3094-47d2-9926-7633867ca913 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:38.638828 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-453bac1e-3094-47d2-9926-7633867ca913 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:38.639690 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-453bac1e-3094-47d2-9926-7633867ca913 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:38.641143 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b85e70f0-9045-4479-9a2a-88f95f2483db tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:38.642514 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-453bac1e-3094-47d2-9926-7633867ca913 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:38.643196 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b85e70f0-9045-4479-9a2a-88f95f2483db tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:38.644745 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b85e70f0-9045-4479-9a2a-88f95f2483db tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:38.645265 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-453bac1e-3094-47d2-9926-7633867ca913 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:38.646842 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-453bac1e-3094-47d2-9926-7633867ca913 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:38.649353 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b85e70f0-9045-4479-9a2a-88f95f2483db tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:38.650192 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b85e70f0-9045-4479-9a2a-88f95f2483db tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:38.978294 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b85e70f0-9045-4479-9a2a-88f95f2483db tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] 10.222.0.33 "GET /compute/v2.1/servers?image=non_existing_image" status: 200 len: 15 microversion: 2.1 time: 0.381535 Oct 04 20:57:38.979349 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2299/4639] 10.222.0.33 () {58 vars in 1174 bytes} [Tue Oct 4 20:57:38 2022] GET /compute/v2.1/servers?image=non_existing_image => generated 15 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 20:57:38.998959 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0442c6e3-9eea-4fca-b61d-7553eb49ce26 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:39.011497 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-0442c6e3-9eea-4fca-b61d-7553eb49ce26 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cc0d54ecb4da4d1795ff4a6bfe4ebc77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76cb3acdf52a4016b1af1e1a70614243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:57:39.013426 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-0442c6e3-9eea-4fca-b61d-7553eb49ce26 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Searching by: {'name': 'non_existing_server_name', 'deleted': False, 'project_id': '76cb3acdf52a4016b1af1e1a70614243'} {{(pid=128801) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 20:57:39.024553 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0442c6e3-9eea-4fca-b61d-7553eb49ce26 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:39.026945 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0442c6e3-9eea-4fca-b61d-7553eb49ce26 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:39.029249 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0442c6e3-9eea-4fca-b61d-7553eb49ce26 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:39.031274 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0442c6e3-9eea-4fca-b61d-7553eb49ce26 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:39.032255 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0442c6e3-9eea-4fca-b61d-7553eb49ce26 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:39.034566 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0442c6e3-9eea-4fca-b61d-7553eb49ce26 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:39.157729 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-0442c6e3-9eea-4fca-b61d-7553eb49ce26 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] 10.222.0.33 "GET /compute/v2.1/servers?name=non_existing_server_name" status: 200 len: 15 microversion: 2.1 time: 0.168476 Oct 04 20:57:39.159419 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2300/4640] 10.222.0.33 () {58 vars in 1184 bytes} [Tue Oct 4 20:57:38 2022] GET /compute/v2.1/servers?name=non_existing_server_name => generated 15 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 20:57:39.177211 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-13fdf692-f8aa-4a0c-b4b1-03f212615c12 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:39.183367 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-13fdf692-f8aa-4a0c-b4b1-03f212615c12 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cc0d54ecb4da4d1795ff4a6bfe4ebc77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76cb3acdf52a4016b1af1e1a70614243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:57:39.184992 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-13fdf692-f8aa-4a0c-b4b1-03f212615c12 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Searching by: {'deleted': False, 'project_id': '76cb3acdf52a4016b1af1e1a70614243'} {{(pid=128801) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 20:57:39.194312 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-13fdf692-f8aa-4a0c-b4b1-03f212615c12 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:39.195259 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-13fdf692-f8aa-4a0c-b4b1-03f212615c12 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:39.196018 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-13fdf692-f8aa-4a0c-b4b1-03f212615c12 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:39.197094 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-13fdf692-f8aa-4a0c-b4b1-03f212615c12 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:39.198248 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-13fdf692-f8aa-4a0c-b4b1-03f212615c12 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:39.198903 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-13fdf692-f8aa-4a0c-b4b1-03f212615c12 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:39.243822 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.multi_cell_list [None req-13fdf692-f8aa-4a0c-b4b1-03f212615c12 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=128801) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 20:57:39.275563 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-453bac1e-3094-47d2-9926-7633867ca913 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6513f5e908ac4d028cad6eeeebeab285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65946afc398d4a9fb1c9095a4f946e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:57:39.283898 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-453bac1e-3094-47d2-9926-7633867ca913 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "GET /compute/v2.1/servers/368d4aa4-81a1-43af-a69b-e5f7004da740" status: 200 len: 1276 microversion: 2.1 time: 0.675227 Oct 04 20:57:39.284421 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2341/4641] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:57:38 2022] GET /compute/v2.1/servers/368d4aa4-81a1-43af-a69b-e5f7004da740 => generated 1276 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:57:39.317566 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-13fdf692-f8aa-4a0c-b4b1-03f212615c12 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0d54ecb4da4d1795ff4a6bfe4ebc77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76cb3acdf52a4016b1af1e1a70614243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:57:39.340217 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-13fdf692-f8aa-4a0c-b4b1-03f212615c12 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:39.341049 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-13fdf692-f8aa-4a0c-b4b1-03f212615c12 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:39.341937 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-13fdf692-f8aa-4a0c-b4b1-03f212615c12 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:39.456215 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-2b330fbb-7cb6-42d1-937d-c7466b767af4 tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:39.457022 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-2b330fbb-7cb6-42d1-937d-c7466b767af4 tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] [instance: f5d7d242-102d-4791-92ba-96dc7b84172a] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:57:39.486611 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2b330fbb-7cb6-42d1-937d-c7466b767af4 tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:39.487395 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2b330fbb-7cb6-42d1-937d-c7466b767af4 tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:39.488164 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2b330fbb-7cb6-42d1-937d-c7466b767af4 tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:39.489650 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2b330fbb-7cb6-42d1-937d-c7466b767af4 tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:39.490284 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2b330fbb-7cb6-42d1-937d-c7466b767af4 tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:39.490930 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2b330fbb-7cb6-42d1-937d-c7466b767af4 tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:39.494609 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=100 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:57:39.912380 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-13fdf692-f8aa-4a0c-b4b1-03f212615c12 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] 10.222.0.33 "GET /compute/v2.1/servers/detail" status: 200 len: 3025 microversion: 2.1 time: 0.742795 Oct 04 20:57:39.934571 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2301/4642] 10.222.0.33 () {58 vars in 1146 bytes} [Tue Oct 4 20:57:39 2022] GET /compute/v2.1/servers/detail => generated 3025 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:57:39.939817 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2bf5d047-3e34-4839-9a33-58b43b8e9c67 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:39.950984 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-2bf5d047-3e34-4839-9a33-58b43b8e9c67 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cc0d54ecb4da4d1795ff4a6bfe4ebc77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76cb3acdf52a4016b1af1e1a70614243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:57:39.950984 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-2bf5d047-3e34-4839-9a33-58b43b8e9c67 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] 10.222.0.33 "GET /compute/v2.1/servers?status=non_existing_status" status: 200 len: 15 microversion: 2.1 time: 0.011683 Oct 04 20:57:39.950984 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2302/4643] 10.222.0.33 () {58 vars in 1178 bytes} [Tue Oct 4 20:57:39 2022] GET /compute/v2.1/servers?status=non_existing_status => generated 15 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 20:57:39.961768 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e16e1a3c-d94e-4daa-be91-56f45b767430 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:39.967879 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e16e1a3c-d94e-4daa-be91-56f45b767430 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cc0d54ecb4da4d1795ff4a6bfe4ebc77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76cb3acdf52a4016b1af1e1a70614243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:57:39.969145 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e16e1a3c-d94e-4daa-be91-56f45b767430 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Searching by: {'deleted': False, 'project_id': '76cb3acdf52a4016b1af1e1a70614243'} {{(pid=128801) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 20:57:39.975840 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e16e1a3c-d94e-4daa-be91-56f45b767430 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:39.976557 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e16e1a3c-d94e-4daa-be91-56f45b767430 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:39.977358 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e16e1a3c-d94e-4daa-be91-56f45b767430 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:39.979157 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e16e1a3c-d94e-4daa-be91-56f45b767430 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:39.979820 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e16e1a3c-d94e-4daa-be91-56f45b767430 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:39.980429 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e16e1a3c-d94e-4daa-be91-56f45b767430 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:40.027708 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.multi_cell_list [None req-e16e1a3c-d94e-4daa-be91-56f45b767430 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=128801) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 20:57:40.090237 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-2b330fbb-7cb6-42d1-937d-c7466b767af4 tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ce92a1863c43e387f3410c3f7081b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3351642441347c4badf854104a0f38a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:57:40.100854 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e16e1a3c-d94e-4daa-be91-56f45b767430 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] 10.222.0.33 "GET /compute/v2.1/servers" status: 200 len: 681 microversion: 2.1 time: 0.144094 Oct 04 20:57:40.106884 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-2b330fbb-7cb6-42d1-937d-c7466b767af4 tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] 10.222.0.33 "GET /compute/v2.1/servers/f5d7d242-102d-4791-92ba-96dc7b84172a" status: 200 len: 1495 microversion: 2.1 time: 0.656846 Oct 04 20:57:40.107842 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2303/4644] 10.222.0.33 () {58 vars in 1125 bytes} [Tue Oct 4 20:57:39 2022] GET /compute/v2.1/servers => generated 681 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:57:40.121110 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2342/4645] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:57:39 2022] GET /compute/v2.1/servers/f5d7d242-102d-4791-92ba-96dc7b84172a => generated 1495 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:57:40.124979 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0b10bbd8-b11e-4a49-9e8c-1c648d95780d tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:40.128184 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-0b10bbd8-b11e-4a49-9e8c-1c648d95780d tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] [instance: 5b67418e-7355-4fdd-ada2-7a36dd772d50] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:57:40.142791 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-95601b0b-936f-46af-9fa0-545f1d1b12f7 tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:40.152051 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0b10bbd8-b11e-4a49-9e8c-1c648d95780d tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:40.153159 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0b10bbd8-b11e-4a49-9e8c-1c648d95780d tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:40.154597 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0b10bbd8-b11e-4a49-9e8c-1c648d95780d tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:40.158446 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0b10bbd8-b11e-4a49-9e8c-1c648d95780d tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:40.159369 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.compute.server_groups [None req-95601b0b-936f-46af-9fa0-545f1d1b12f7 tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Querying cell 189ff13b-7538-4a71-a71c-1e7f1d3e1b46(cell1) for 1 instances {{(pid=128802) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 04 20:57:40.159594 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0b10bbd8-b11e-4a49-9e8c-1c648d95780d tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:40.160038 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0b10bbd8-b11e-4a49-9e8c-1c648d95780d tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:40.160635 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-95601b0b-936f-46af-9fa0-545f1d1b12f7 tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:40.161842 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-95601b0b-936f-46af-9fa0-545f1d1b12f7 tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:40.163379 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-95601b0b-936f-46af-9fa0-545f1d1b12f7 tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:40.195822 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-0b10bbd8-b11e-4a49-9e8c-1c648d95780d tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] HTTP exception thrown: Instance 5b67418e-7355-4fdd-ada2-7a36dd772d50 could not be found. Oct 04 20:57:40.197417 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0b10bbd8-b11e-4a49-9e8c-1c648d95780d tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Request method failure captured: Oct 04 20:57:40.197417 n-d-854823-8 devstack@n-api.service[128801]: request: DELETE /compute/v2.1/servers/5b67418e-7355-4fdd-ada2-7a36dd772d50 HTTP/1.1 Oct 04 20:57:40.197417 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:57:40.197417 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:57:40.197417 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:57:40.197417 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 0 Oct 04 20:57:40.197417 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:57:40.197417 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:57:40.197417 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:57:40.197417 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:57:40.197417 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJ4VuT2cCVvV5gxG1iPB83Bxn6TBK7uhx9NXV5-9_fAcNWw9t-nXpd4t_HFZR-Q4b2SngVWjg1zGpKRiP1240ZfpcC1Uk8a3h8XpA4eQigNugjB_CpEPCs6qb_9FfT6Wcw0tdPLd1MeN4oZpsYagYrovtibHIgvswEBNsdy3mkIJgmY Oct 04 20:57:40.197417 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:57:40.197417 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:57:40.197417 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:57:40.197417 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:57:40.197417 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:57:40.197417 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:57:40.197417 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: 76cb3acdf52a4016b1af1e1a70614243 Oct 04 20:57:40.197417 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-ListServersNegativeTestJSON-1056031141 Oct 04 20:57:40.197417 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 20:57:40.197417 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 20:57:40.197417 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_76cb3acdf52a4016b1af1e1a70614243", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/76cb3acdf52a4016b1af1e1a70614243"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/76cb3acdf52a4016b1af1e1a70614243"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/76cb3acdf52a4016b1af1e1a70614243"}]}] Oct 04 20:57:40.197417 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-ListServersNegativeTestJSON-1056031141 Oct 04 20:57:40.197417 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: 76cb3acdf52a4016b1af1e1a70614243 Oct 04 20:57:40.197417 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1056031141 Oct 04 20:57:40.197417 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-ListServersNegativeTestJSON-1056031141-project Oct 04 20:57:40.197417 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:57:40.197417 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:57:40.197417 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: cc0d54ecb4da4d1795ff4a6bfe4ebc77 Oct 04 20:57:40.197417 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-ListServersNegativeTestJSON-1056031141-project Oct 04 20:57:40.197417 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 20:57:40.197417 n-d-854823-8 devstack@n-api.service[128801]: exception: Instance 5b67418e-7355-4fdd-ada2-7a36dd772d50 could not be found. Oct 04 20:57:40.197417 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': '5b67418e-7355-4fdd-ada2-7a36dd772d50'} Oct 04 20:57:40.197417 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:57:40.197417 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:57:40.197417 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:57:40.197417 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:57:40.197417 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:57:40.197417 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:57:40.197417 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:57:40.197417 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:57:40.197417 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:57:40.197417 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:57:40.197417 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b67418e-7355-4fdd-ada2-7a36dd772d50 could not be found. Oct 04 20:57:40.197417 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:57:40.197417 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:57:40.197417 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:57:40.197417 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:57:40.197417 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:57:40.197417 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:57:40.197417 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:57:40.197417 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:57:40.197417 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:57:40.197417 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:57:40.197417 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 20:57:40.197417 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 20:57:40.197417 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 20:57:40.197417 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 20:57:40.197417 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:57:40.197417 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:57:40.197417 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:57:40.197417 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:57:40.201570 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b67418e-7355-4fdd-ada2-7a36dd772d50 could not be found. Oct 04 20:57:40.201570 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:57:40.201570 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:57:40.201570 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:57:40.201570 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:57:40.201570 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:57:40.201570 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:57:40.201570 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:57:40.201570 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:57:40.201570 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b67418e-7355-4fdd-ada2-7a36dd772d50 could not be found. Oct 04 20:57:40.201570 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:57:40.203415 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-95601b0b-936f-46af-9fa0-545f1d1b12f7 tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] 10.222.0.33 "GET /compute/v2.1/os-server-groups/d31d1b38-de64-4f20-9704-57b38bc39f54" status: 200 len: 222 microversion: 2.1 time: 0.063755 Oct 04 20:57:40.203597 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0b10bbd8-b11e-4a49-9e8c-1c648d95780d tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Returning 404 to user: Instance 5b67418e-7355-4fdd-ada2-7a36dd772d50 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:57:40.203752 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2343/4646] 10.222.0.33 () {58 vars in 1263 bytes} [Tue Oct 4 20:57:40 2022] GET /compute/v2.1/os-server-groups/d31d1b38-de64-4f20-9704-57b38bc39f54 => generated 222 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 20:57:40.203914 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-0b10bbd8-b11e-4a49-9e8c-1c648d95780d tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] 10.222.0.33 "DELETE /compute/v2.1/servers/5b67418e-7355-4fdd-ada2-7a36dd772d50" status: 404 len: 111 microversion: 2.1 time: 0.085288 Oct 04 20:57:40.203914 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2304/4647] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 20:57:40 2022] DELETE /compute/v2.1/servers/5b67418e-7355-4fdd-ada2-7a36dd772d50 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:57:40.213686 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-20395fbd-1335-42cb-917a-694e4e222d32 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:40.214186 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-20395fbd-1335-42cb-917a-694e4e222d32 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] [instance: e078edba-e82a-4a6e-8661-638c352139c4] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:57:40.219930 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-17d8fcd5-855e-4e58-801c-5391558e48fb tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:40.223433 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-17d8fcd5-855e-4e58-801c-5391558e48fb tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] [instance: f5d7d242-102d-4791-92ba-96dc7b84172a] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:57:40.236257 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-20395fbd-1335-42cb-917a-694e4e222d32 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:40.236753 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-20395fbd-1335-42cb-917a-694e4e222d32 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:40.237195 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-20395fbd-1335-42cb-917a-694e4e222d32 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:40.238579 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-20395fbd-1335-42cb-917a-694e4e222d32 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:40.239605 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-20395fbd-1335-42cb-917a-694e4e222d32 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:40.240042 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-20395fbd-1335-42cb-917a-694e4e222d32 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:40.240220 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-17d8fcd5-855e-4e58-801c-5391558e48fb tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:40.241026 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-17d8fcd5-855e-4e58-801c-5391558e48fb tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:40.241476 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-17d8fcd5-855e-4e58-801c-5391558e48fb tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:40.242205 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-17d8fcd5-855e-4e58-801c-5391558e48fb tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:40.242695 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-17d8fcd5-855e-4e58-801c-5391558e48fb tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:40.243686 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-17d8fcd5-855e-4e58-801c-5391558e48fb tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:40.295436 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-20395fbd-1335-42cb-917a-694e4e222d32 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] [instance: e078edba-e82a-4a6e-8661-638c352139c4] Going to try to terminate instance {{(pid=128801) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:57:40.306323 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-17d8fcd5-855e-4e58-801c-5391558e48fb tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] [instance: f5d7d242-102d-4791-92ba-96dc7b84172a] Going to try to terminate instance {{(pid=128802) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:57:40.448930 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-17d8fcd5-855e-4e58-801c-5391558e48fb tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] 10.222.0.33 "DELETE /compute/v2.1/servers/f5d7d242-102d-4791-92ba-96dc7b84172a" status: 204 len: 0 microversion: 2.1 time: 0.239023 Oct 04 20:57:40.458989 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2344/4648] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 20:57:40 2022] DELETE /compute/v2.1/servers/f5d7d242-102d-4791-92ba-96dc7b84172a => generated 0 bytes in 244 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:57:40.465489 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-a06af908-9700-47e2-8351-125c9f8b5497 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:40.466591 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-a06af908-9700-47e2-8351-125c9f8b5497 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] [instance: 368d4aa4-81a1-43af-a69b-e5f7004da740] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:57:40.474425 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a06af908-9700-47e2-8351-125c9f8b5497 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:40.475321 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a06af908-9700-47e2-8351-125c9f8b5497 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:40.476613 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a06af908-9700-47e2-8351-125c9f8b5497 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:40.477479 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a06af908-9700-47e2-8351-125c9f8b5497 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:40.477924 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a06af908-9700-47e2-8351-125c9f8b5497 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:40.478461 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a06af908-9700-47e2-8351-125c9f8b5497 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:40.483686 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-20395fbd-1335-42cb-917a-694e4e222d32 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] 10.222.0.33 "DELETE /compute/v2.1/servers/e078edba-e82a-4a6e-8661-638c352139c4" status: 204 len: 0 microversion: 2.1 time: 0.273369 Oct 04 20:57:40.484693 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2305/4649] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 20:57:40 2022] DELETE /compute/v2.1/servers/e078edba-e82a-4a6e-8661-638c352139c4 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:57:40.500010 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-53644a4b-9a96-416a-a214-38d02d5c3c2d tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:40.501473 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-53644a4b-9a96-416a-a214-38d02d5c3c2d tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] [instance: f5d7d242-102d-4791-92ba-96dc7b84172a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:57:40.511491 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-53644a4b-9a96-416a-a214-38d02d5c3c2d tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:40.512326 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-53644a4b-9a96-416a-a214-38d02d5c3c2d tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:40.513012 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-53644a4b-9a96-416a-a214-38d02d5c3c2d tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:40.513946 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-53644a4b-9a96-416a-a214-38d02d5c3c2d tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:40.514817 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-53644a4b-9a96-416a-a214-38d02d5c3c2d tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:40.515488 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-53644a4b-9a96-416a-a214-38d02d5c3c2d tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:40.650571 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-a06af908-9700-47e2-8351-125c9f8b5497 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6513f5e908ac4d028cad6eeeebeab285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65946afc398d4a9fb1c9095a4f946e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:57:40.660708 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-a06af908-9700-47e2-8351-125c9f8b5497 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "GET /compute/v2.1/servers/368d4aa4-81a1-43af-a69b-e5f7004da740" status: 200 len: 1274 microversion: 2.1 time: 0.199993 Oct 04 20:57:40.673268 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2345/4650] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:57:40 2022] GET /compute/v2.1/servers/368d4aa4-81a1-43af-a69b-e5f7004da740 => generated 1274 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:57:40.673268 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-46444c80-6f87-4ea0-9e0d-5a3ab981239d tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:40.673268 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-46444c80-6f87-4ea0-9e0d-5a3ab981239d tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] [instance: 9e261662-c010-41bd-a875-8e47b106485b] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:57:40.673874 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-46444c80-6f87-4ea0-9e0d-5a3ab981239d tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:40.674514 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-46444c80-6f87-4ea0-9e0d-5a3ab981239d tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:40.675060 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-46444c80-6f87-4ea0-9e0d-5a3ab981239d tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:40.676058 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-46444c80-6f87-4ea0-9e0d-5a3ab981239d tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:40.676890 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-46444c80-6f87-4ea0-9e0d-5a3ab981239d tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:40.677828 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-46444c80-6f87-4ea0-9e0d-5a3ab981239d tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:40.716429 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-46444c80-6f87-4ea0-9e0d-5a3ab981239d tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] [instance: 9e261662-c010-41bd-a875-8e47b106485b] Going to try to terminate instance {{(pid=128802) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:57:40.811929 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-46444c80-6f87-4ea0-9e0d-5a3ab981239d tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] 10.222.0.33 "DELETE /compute/v2.1/servers/9e261662-c010-41bd-a875-8e47b106485b" status: 204 len: 0 microversion: 2.1 time: 0.148947 Oct 04 20:57:40.812898 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2346/4651] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 20:57:40 2022] DELETE /compute/v2.1/servers/9e261662-c010-41bd-a875-8e47b106485b => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:57:40.830364 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-5e117263-8a6f-4b27-bbcf-9aa8da2b05b1 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:40.833439 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-5e117263-8a6f-4b27-bbcf-9aa8da2b05b1 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] [instance: 5b67418e-7355-4fdd-ada2-7a36dd772d50] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:57:40.842480 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5e117263-8a6f-4b27-bbcf-9aa8da2b05b1 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:40.843282 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5e117263-8a6f-4b27-bbcf-9aa8da2b05b1 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:40.843797 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5e117263-8a6f-4b27-bbcf-9aa8da2b05b1 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:40.844938 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5e117263-8a6f-4b27-bbcf-9aa8da2b05b1 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:40.845647 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5e117263-8a6f-4b27-bbcf-9aa8da2b05b1 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:40.846860 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5e117263-8a6f-4b27-bbcf-9aa8da2b05b1 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:40.854807 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-53644a4b-9a96-416a-a214-38d02d5c3c2d tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ce92a1863c43e387f3410c3f7081b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3351642441347c4badf854104a0f38a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:57:40.863705 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-53644a4b-9a96-416a-a214-38d02d5c3c2d tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] 10.222.0.33 "GET /compute/v2.1/servers/f5d7d242-102d-4791-92ba-96dc7b84172a" status: 200 len: 1501 microversion: 2.1 time: 0.376728 Oct 04 20:57:40.880277 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.wsgi [None req-5e117263-8a6f-4b27-bbcf-9aa8da2b05b1 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] HTTP exception thrown: Instance 5b67418e-7355-4fdd-ada2-7a36dd772d50 could not be found. Oct 04 20:57:40.880277 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-5e117263-8a6f-4b27-bbcf-9aa8da2b05b1 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Request method failure captured: Oct 04 20:57:40.880277 n-d-854823-8 devstack@n-api.service[128802]: request: GET /compute/v2.1/servers/5b67418e-7355-4fdd-ada2-7a36dd772d50 HTTP/1.1 Oct 04 20:57:40.880277 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 20:57:40.880277 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 20:57:40.880277 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 20:57:40.880277 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 0 Oct 04 20:57:40.880277 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 20:57:40.880277 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 20:57:40.880277 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 20:57:40.880277 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 20:57:40.880277 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPJ4VuT2cCVvV5gxG1iPB83Bxn6TBK7uhx9NXV5-9_fAcNWw9t-nXpd4t_HFZR-Q4b2SngVWjg1zGpKRiP1240ZfpcC1Uk8a3h8XpA4eQigNugjB_CpEPCs6qb_9FfT6Wcw0tdPLd1MeN4oZpsYagYrovtibHIgvswEBNsdy3mkIJgmY Oct 04 20:57:40.880277 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 20:57:40.880277 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 20:57:40.880277 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 20:57:40.880277 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 20:57:40.880277 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 20:57:40.880277 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 20:57:40.880277 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: 76cb3acdf52a4016b1af1e1a70614243 Oct 04 20:57:40.880277 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-ListServersNegativeTestJSON-1056031141 Oct 04 20:57:40.880277 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 20:57:40.880277 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 20:57:40.880277 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_76cb3acdf52a4016b1af1e1a70614243", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/76cb3acdf52a4016b1af1e1a70614243"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/76cb3acdf52a4016b1af1e1a70614243"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/76cb3acdf52a4016b1af1e1a70614243"}]}] Oct 04 20:57:40.880277 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-ListServersNegativeTestJSON-1056031141 Oct 04 20:57:40.880277 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: 76cb3acdf52a4016b1af1e1a70614243 Oct 04 20:57:40.880277 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1056031141 Oct 04 20:57:40.880277 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-ListServersNegativeTestJSON-1056031141-project Oct 04 20:57:40.880277 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 20:57:40.880277 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 20:57:40.880277 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: cc0d54ecb4da4d1795ff4a6bfe4ebc77 Oct 04 20:57:40.880277 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-ListServersNegativeTestJSON-1056031141-project Oct 04 20:57:40.880277 n-d-854823-8 devstack@n-api.service[128802]: method: > Oct 04 20:57:40.880277 n-d-854823-8 devstack@n-api.service[128802]: exception: Instance 5b67418e-7355-4fdd-ada2-7a36dd772d50 could not be found. Oct 04 20:57:40.880277 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'id': '5b67418e-7355-4fdd-ada2-7a36dd772d50'} Oct 04 20:57:40.880277 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:57:40.880277 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:57:40.880277 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:57:40.880277 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:57:40.880277 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:57:40.880277 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:57:40.880277 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:57:40.880277 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:57:40.880277 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:57:40.880277 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:57:40.880277 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b67418e-7355-4fdd-ada2-7a36dd772d50 could not be found. Oct 04 20:57:40.880277 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:57:40.880277 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:57:40.880277 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:57:40.880277 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:57:40.880277 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:57:40.880277 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:57:40.880277 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:57:40.880277 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:57:40.880277 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:57:40.880277 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:57:40.880277 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:57:40.880277 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:57:40.880277 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:57:40.880277 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:57:40.880277 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:57:40.887011 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:57:40.887011 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b67418e-7355-4fdd-ada2-7a36dd772d50 could not be found. Oct 04 20:57:40.887011 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:57:40.887011 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:57:40.887011 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:57:40.887011 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:57:40.887011 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:57:40.887011 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:57:40.887011 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:57:40.887011 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:57:40.887011 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b67418e-7355-4fdd-ada2-7a36dd772d50 could not be found. Oct 04 20:57:40.887011 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:57:40.887011 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-5e117263-8a6f-4b27-bbcf-9aa8da2b05b1 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Returning 404 to user: Instance 5b67418e-7355-4fdd-ada2-7a36dd772d50 could not be found. {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:57:40.887011 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-5e117263-8a6f-4b27-bbcf-9aa8da2b05b1 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] 10.222.0.33 "GET /compute/v2.1/servers/5b67418e-7355-4fdd-ada2-7a36dd772d50" status: 404 len: 111 microversion: 2.1 time: 0.058007 Oct 04 20:57:40.887011 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2347/4652] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:57:40 2022] GET /compute/v2.1/servers/5b67418e-7355-4fdd-ada2-7a36dd772d50 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 20:57:40.888222 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2306/4653] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:57:40 2022] GET /compute/v2.1/servers/f5d7d242-102d-4791-92ba-96dc7b84172a => generated 1501 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:57:40.898650 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-75db43c4-3b7d-43c9-bc0f-86c68cffa794 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:40.899471 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-75db43c4-3b7d-43c9-bc0f-86c68cffa794 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] [instance: e078edba-e82a-4a6e-8661-638c352139c4] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:57:40.905848 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-75db43c4-3b7d-43c9-bc0f-86c68cffa794 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:40.906485 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-75db43c4-3b7d-43c9-bc0f-86c68cffa794 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:40.906997 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-75db43c4-3b7d-43c9-bc0f-86c68cffa794 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:40.907776 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-75db43c4-3b7d-43c9-bc0f-86c68cffa794 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:40.908304 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-75db43c4-3b7d-43c9-bc0f-86c68cffa794 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:40.908848 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-75db43c4-3b7d-43c9-bc0f-86c68cffa794 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:41.230462 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-75db43c4-3b7d-43c9-bc0f-86c68cffa794 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0d54ecb4da4d1795ff4a6bfe4ebc77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76cb3acdf52a4016b1af1e1a70614243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:57:41.252430 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-75db43c4-3b7d-43c9-bc0f-86c68cffa794 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] 10.222.0.33 "GET /compute/v2.1/servers/e078edba-e82a-4a6e-8661-638c352139c4" status: 200 len: 1522 microversion: 2.1 time: 0.363249 Oct 04 20:57:41.257111 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2348/4654] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:57:40 2022] GET /compute/v2.1/servers/e078edba-e82a-4a6e-8661-638c352139c4 => generated 1522 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:57:41.691830 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-4fc96343-044f-4480-8209-a07aff6f482a tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:41.695850 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-4fc96343-044f-4480-8209-a07aff6f482a tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] [instance: 368d4aa4-81a1-43af-a69b-e5f7004da740] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:57:41.723470 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4fc96343-044f-4480-8209-a07aff6f482a tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:41.728311 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4fc96343-044f-4480-8209-a07aff6f482a tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:41.728991 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4fc96343-044f-4480-8209-a07aff6f482a tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:41.729958 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4fc96343-044f-4480-8209-a07aff6f482a tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:41.731685 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4fc96343-044f-4480-8209-a07aff6f482a tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:41.733069 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4fc96343-044f-4480-8209-a07aff6f482a tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:41.900949 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-0bab836f-0336-4d7a-a0e4-ab317512e9c3 tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:41.903156 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-0bab836f-0336-4d7a-a0e4-ab317512e9c3 tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] [instance: f5d7d242-102d-4791-92ba-96dc7b84172a] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:57:41.917136 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0bab836f-0336-4d7a-a0e4-ab317512e9c3 tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:41.929535 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0bab836f-0336-4d7a-a0e4-ab317512e9c3 tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:41.931898 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0bab836f-0336-4d7a-a0e4-ab317512e9c3 tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:41.932303 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0bab836f-0336-4d7a-a0e4-ab317512e9c3 tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:41.932794 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0bab836f-0336-4d7a-a0e4-ab317512e9c3 tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:41.933338 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0bab836f-0336-4d7a-a0e4-ab317512e9c3 tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:42.200155 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-4fc96343-044f-4480-8209-a07aff6f482a tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6513f5e908ac4d028cad6eeeebeab285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65946afc398d4a9fb1c9095a4f946e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:57:42.211210 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-4fc96343-044f-4480-8209-a07aff6f482a tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "GET /compute/v2.1/servers/368d4aa4-81a1-43af-a69b-e5f7004da740" status: 200 len: 1316 microversion: 2.1 time: 0.529837 Oct 04 20:57:42.211826 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2307/4655] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:57:41 2022] GET /compute/v2.1/servers/368d4aa4-81a1-43af-a69b-e5f7004da740 => generated 1316 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:57:42.284801 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8e1e85a7-7faa-4e97-ac51-866a2b49c1d4 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:42.285412 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-8e1e85a7-7faa-4e97-ac51-866a2b49c1d4 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] [instance: e078edba-e82a-4a6e-8661-638c352139c4] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:57:42.293124 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8e1e85a7-7faa-4e97-ac51-866a2b49c1d4 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:42.305419 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8e1e85a7-7faa-4e97-ac51-866a2b49c1d4 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:42.307413 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8e1e85a7-7faa-4e97-ac51-866a2b49c1d4 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:42.308695 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8e1e85a7-7faa-4e97-ac51-866a2b49c1d4 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:42.310173 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8e1e85a7-7faa-4e97-ac51-866a2b49c1d4 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:42.312393 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8e1e85a7-7faa-4e97-ac51-866a2b49c1d4 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:42.528935 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-0bab836f-0336-4d7a-a0e4-ab317512e9c3 tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ce92a1863c43e387f3410c3f7081b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3351642441347c4badf854104a0f38a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:57:42.539964 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-0bab836f-0336-4d7a-a0e4-ab317512e9c3 tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] 10.222.0.33 "GET /compute/v2.1/servers/f5d7d242-102d-4791-92ba-96dc7b84172a" status: 200 len: 1501 microversion: 2.1 time: 0.647723 Oct 04 20:57:42.540896 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2349/4656] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:57:41 2022] GET /compute/v2.1/servers/f5d7d242-102d-4791-92ba-96dc7b84172a => generated 1501 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:57:42.960241 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-8e1e85a7-7faa-4e97-ac51-866a2b49c1d4 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0d54ecb4da4d1795ff4a6bfe4ebc77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76cb3acdf52a4016b1af1e1a70614243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:57:42.971868 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-8e1e85a7-7faa-4e97-ac51-866a2b49c1d4 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] 10.222.0.33 "GET /compute/v2.1/servers/e078edba-e82a-4a6e-8661-638c352139c4" status: 200 len: 1522 microversion: 2.1 time: 0.691109 Oct 04 20:57:42.979295 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2308/4657] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:57:42 2022] GET /compute/v2.1/servers/e078edba-e82a-4a6e-8661-638c352139c4 => generated 1522 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:57:43.242678 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-10a82834-4463-4494-a776-a58b48f4d116 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:43.244239 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-10a82834-4463-4494-a776-a58b48f4d116 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] [instance: 368d4aa4-81a1-43af-a69b-e5f7004da740] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:57:43.263206 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-10a82834-4463-4494-a776-a58b48f4d116 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:43.264773 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-10a82834-4463-4494-a776-a58b48f4d116 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:43.266437 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-10a82834-4463-4494-a776-a58b48f4d116 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:43.267815 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-10a82834-4463-4494-a776-a58b48f4d116 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:43.269775 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-10a82834-4463-4494-a776-a58b48f4d116 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:43.270810 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-10a82834-4463-4494-a776-a58b48f4d116 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:43.566965 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-53df06db-8ea8-4b5c-8a5b-8090cddcbbab tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:43.568430 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-53df06db-8ea8-4b5c-8a5b-8090cddcbbab tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] [instance: f5d7d242-102d-4791-92ba-96dc7b84172a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:57:43.580685 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-53df06db-8ea8-4b5c-8a5b-8090cddcbbab tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:43.581195 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-53df06db-8ea8-4b5c-8a5b-8090cddcbbab tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:43.581642 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-53df06db-8ea8-4b5c-8a5b-8090cddcbbab tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:43.582543 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-53df06db-8ea8-4b5c-8a5b-8090cddcbbab tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:43.583432 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-53df06db-8ea8-4b5c-8a5b-8090cddcbbab tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:43.583871 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-53df06db-8ea8-4b5c-8a5b-8090cddcbbab tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:44.804327 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-53df06db-8ea8-4b5c-8a5b-8090cddcbbab tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ce92a1863c43e387f3410c3f7081b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3351642441347c4badf854104a0f38a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:57:44.829022 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-53df06db-8ea8-4b5c-8a5b-8090cddcbbab tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] 10.222.0.33 "GET /compute/v2.1/servers/f5d7d242-102d-4791-92ba-96dc7b84172a" status: 200 len: 1501 microversion: 2.1 time: 1.265924 Oct 04 20:57:44.831448 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2309/4658] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:57:43 2022] GET /compute/v2.1/servers/f5d7d242-102d-4791-92ba-96dc7b84172a => generated 1501 bytes in 1269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:57:44.839834 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-465a33dd-2a3d-4f43-823d-1d5f73ad9de9 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:44.840821 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-465a33dd-2a3d-4f43-823d-1d5f73ad9de9 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] [instance: e078edba-e82a-4a6e-8661-638c352139c4] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:57:44.850411 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-465a33dd-2a3d-4f43-823d-1d5f73ad9de9 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:44.860588 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-10a82834-4463-4494-a776-a58b48f4d116 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6513f5e908ac4d028cad6eeeebeab285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65946afc398d4a9fb1c9095a4f946e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:57:44.871203 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-465a33dd-2a3d-4f43-823d-1d5f73ad9de9 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:44.871677 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-465a33dd-2a3d-4f43-823d-1d5f73ad9de9 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:44.872428 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-465a33dd-2a3d-4f43-823d-1d5f73ad9de9 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:44.873063 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-465a33dd-2a3d-4f43-823d-1d5f73ad9de9 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:44.873642 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-465a33dd-2a3d-4f43-823d-1d5f73ad9de9 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:44.883233 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-10a82834-4463-4494-a776-a58b48f4d116 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "GET /compute/v2.1/servers/368d4aa4-81a1-43af-a69b-e5f7004da740" status: 200 len: 1316 microversion: 2.1 time: 1.646062 Oct 04 20:57:44.883903 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2350/4659] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:57:43 2022] GET /compute/v2.1/servers/368d4aa4-81a1-43af-a69b-e5f7004da740 => generated 1316 bytes in 1648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:57:44.888549 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-19a7455a-2ad8-4a72-bd3a-43b134b946d9 req-582c3f8c-1ce5-400e-b70d-0a7089a2a433 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "368d4aa4-81a1-43af-a69b-e5f7004da740", "tag": "6e0c1b74-365c-4334-a0cd-a002a31e38fa"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:57:44.893759 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:57:44.912579 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-19a7455a-2ad8-4a72-bd3a-43b134b946d9 req-582c3f8c-1ce5-400e-b70d-0a7089a2a433 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:44.913280 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-19a7455a-2ad8-4a72-bd3a-43b134b946d9 req-582c3f8c-1ce5-400e-b70d-0a7089a2a433 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:44.913881 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-19a7455a-2ad8-4a72-bd3a-43b134b946d9 req-582c3f8c-1ce5-400e-b70d-0a7089a2a433 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:44.938570 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-19a7455a-2ad8-4a72-bd3a-43b134b946d9 req-582c3f8c-1ce5-400e-b70d-0a7089a2a433 service nova] Creating event network-changed:6e0c1b74-365c-4334-a0cd-a002a31e38fa for instance 368d4aa4-81a1-43af-a69b-e5f7004da740 on n-h1-854823-8 Oct 04 20:57:44.961664 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-19a7455a-2ad8-4a72-bd3a-43b134b946d9 req-582c3f8c-1ce5-400e-b70d-0a7089a2a433 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076549 Oct 04 20:57:44.962589 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2351/4660] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:57:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:57:45.601415 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-465a33dd-2a3d-4f43-823d-1d5f73ad9de9 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0d54ecb4da4d1795ff4a6bfe4ebc77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76cb3acdf52a4016b1af1e1a70614243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:57:45.635388 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-465a33dd-2a3d-4f43-823d-1d5f73ad9de9 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] 10.222.0.33 "GET /compute/v2.1/servers/e078edba-e82a-4a6e-8661-638c352139c4" status: 200 len: 1522 microversion: 2.1 time: 0.801494 Oct 04 20:57:45.636433 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2310/4661] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:57:44 2022] GET /compute/v2.1/servers/e078edba-e82a-4a6e-8661-638c352139c4 => generated 1522 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:57:45.863112 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-cb07b12a-d5d7-4da8-aae6-78237ed9d1fc tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:45.875558 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-cb07b12a-d5d7-4da8-aae6-78237ed9d1fc tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] [instance: f5d7d242-102d-4791-92ba-96dc7b84172a] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:57:45.892964 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell0:SELECT=2 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:57:45.909497 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cb07b12a-d5d7-4da8-aae6-78237ed9d1fc tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:45.910382 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cb07b12a-d5d7-4da8-aae6-78237ed9d1fc tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:45.911595 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cb07b12a-d5d7-4da8-aae6-78237ed9d1fc tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:45.912297 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d2d0af8c-d1e9-439e-9109-ce9afcb95aa3 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:45.913062 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d2d0af8c-d1e9-439e-9109-ce9afcb95aa3 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] [instance: 368d4aa4-81a1-43af-a69b-e5f7004da740] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:57:45.913620 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cb07b12a-d5d7-4da8-aae6-78237ed9d1fc tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:45.914541 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cb07b12a-d5d7-4da8-aae6-78237ed9d1fc tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:45.916390 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cb07b12a-d5d7-4da8-aae6-78237ed9d1fc tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:45.925810 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=3,nova_api:UPDATE=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:57:45.935161 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d2d0af8c-d1e9-439e-9109-ce9afcb95aa3 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:45.944050 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d2d0af8c-d1e9-439e-9109-ce9afcb95aa3 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:45.944620 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d2d0af8c-d1e9-439e-9109-ce9afcb95aa3 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:45.945319 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d2d0af8c-d1e9-439e-9109-ce9afcb95aa3 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:45.945917 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d2d0af8c-d1e9-439e-9109-ce9afcb95aa3 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:45.946381 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d2d0af8c-d1e9-439e-9109-ce9afcb95aa3 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:45.971679 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cb07b12a-d5d7-4da8-aae6-78237ed9d1fc tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:45.972551 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cb07b12a-d5d7-4da8-aae6-78237ed9d1fc tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:45.974186 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cb07b12a-d5d7-4da8-aae6-78237ed9d1fc tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:45.975050 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.objects.instance [None req-cb07b12a-d5d7-4da8-aae6-78237ed9d1fc tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Lazy-loading 'fault' on Instance uuid f5d7d242-102d-4791-92ba-96dc7b84172a {{(pid=128802) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:57:46.214811 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell0:SELECT=8 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:57:46.311395 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-cb07b12a-d5d7-4da8-aae6-78237ed9d1fc tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ce92a1863c43e387f3410c3f7081b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3351642441347c4badf854104a0f38a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:57:46.322680 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-cb07b12a-d5d7-4da8-aae6-78237ed9d1fc tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] 10.222.0.33 "GET /compute/v2.1/servers/f5d7d242-102d-4791-92ba-96dc7b84172a" status: 200 len: 1301 microversion: 2.1 time: 0.466187 Oct 04 20:57:46.323572 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2352/4662] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:57:45 2022] GET /compute/v2.1/servers/f5d7d242-102d-4791-92ba-96dc7b84172a => generated 1301 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:57:46.665775 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-1376809a-55ad-4906-ba95-2915fff8e075 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:46.666604 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-1376809a-55ad-4906-ba95-2915fff8e075 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] [instance: e078edba-e82a-4a6e-8661-638c352139c4] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:57:46.682906 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1376809a-55ad-4906-ba95-2915fff8e075 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:46.683502 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1376809a-55ad-4906-ba95-2915fff8e075 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:46.683962 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1376809a-55ad-4906-ba95-2915fff8e075 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:46.684792 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1376809a-55ad-4906-ba95-2915fff8e075 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:46.685262 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1376809a-55ad-4906-ba95-2915fff8e075 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:46.685706 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1376809a-55ad-4906-ba95-2915fff8e075 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:47.332264 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-1376809a-55ad-4906-ba95-2915fff8e075 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0d54ecb4da4d1795ff4a6bfe4ebc77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76cb3acdf52a4016b1af1e1a70614243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:57:47.351282 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-1376809a-55ad-4906-ba95-2915fff8e075 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] 10.222.0.33 "GET /compute/v2.1/servers/e078edba-e82a-4a6e-8661-638c352139c4" status: 200 len: 1480 microversion: 2.1 time: 0.690035 Oct 04 20:57:47.352576 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2353/4663] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:57:46 2022] GET /compute/v2.1/servers/e078edba-e82a-4a6e-8661-638c352139c4 => generated 1480 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:57:47.369166 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-2aee6422-747e-4ab7-9db7-3a7fa7b5fdc7 req-c4bfea3a-03e7-4ebe-8cf3-860283305c2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5d7d242-102d-4791-92ba-96dc7b84172a", "name": "network-vif-deleted", "tag": "df23aac4-8d0f-4b97-9cf1-527775e6fa37"}, {"server_uuid": "9e261662-c010-41bd-a875-8e47b106485b", "name": "network-vif-deleted", "tag": "bdf38a71-dc68-47d2-8e91-13ca82211cf4"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:57:47.391893 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-2aee6422-747e-4ab7-9db7-3a7fa7b5fdc7 req-c4bfea3a-03e7-4ebe-8cf3-860283305c2f service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:47.392677 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-2aee6422-747e-4ab7-9db7-3a7fa7b5fdc7 req-c4bfea3a-03e7-4ebe-8cf3-860283305c2f service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:47.393394 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-2aee6422-747e-4ab7-9db7-3a7fa7b5fdc7 req-c4bfea3a-03e7-4ebe-8cf3-860283305c2f service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:47.428853 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-2aee6422-747e-4ab7-9db7-3a7fa7b5fdc7 req-c4bfea3a-03e7-4ebe-8cf3-860283305c2f service nova] Creating event network-vif-deleted:df23aac4-8d0f-4b97-9cf1-527775e6fa37 for instance f5d7d242-102d-4791-92ba-96dc7b84172a on n-h1-854823-8 Oct 04 20:57:47.429487 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-2aee6422-747e-4ab7-9db7-3a7fa7b5fdc7 req-c4bfea3a-03e7-4ebe-8cf3-860283305c2f service nova] Creating event network-vif-deleted:bdf38a71-dc68-47d2-8e91-13ca82211cf4 for instance 9e261662-c010-41bd-a875-8e47b106485b on n-h2-854823-8 Oct 04 20:57:47.437905 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d2d0af8c-d1e9-439e-9109-ce9afcb95aa3 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6513f5e908ac4d028cad6eeeebeab285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65946afc398d4a9fb1c9095a4f946e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:57:47.450258 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d2d0af8c-d1e9-439e-9109-ce9afcb95aa3 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "GET /compute/v2.1/servers/368d4aa4-81a1-43af-a69b-e5f7004da740" status: 200 len: 1316 microversion: 2.1 time: 1.542678 Oct 04 20:57:47.454936 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-2aee6422-747e-4ab7-9db7-3a7fa7b5fdc7 req-c4bfea3a-03e7-4ebe-8cf3-860283305c2f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.100794 Oct 04 20:57:47.463102 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2354/4664] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:57:47 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:57:47.472792 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2311/4665] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:57:45 2022] GET /compute/v2.1/servers/368d4aa4-81a1-43af-a69b-e5f7004da740 => generated 1316 bytes in 1566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:57:47.477258 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-f3d9e4ef-7924-416e-b48d-b2578b4830c2 tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:47.480187 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-f3d9e4ef-7924-416e-b48d-b2578b4830c2 tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] [instance: f5d7d242-102d-4791-92ba-96dc7b84172a] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:57:47.481184 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-02db04e2-8c22-45f5-8625-81f31a39be91 req-29474241-814e-4922-b4dc-b330b72ae401 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e078edba-e82a-4a6e-8661-638c352139c4", "name": "network-vif-deleted", "tag": "4423cf51-b7b4-4c1a-b717-d56a01d2cc5c"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:57:47.494538 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-02db04e2-8c22-45f5-8625-81f31a39be91 req-29474241-814e-4922-b4dc-b330b72ae401 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:47.495868 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-02db04e2-8c22-45f5-8625-81f31a39be91 req-29474241-814e-4922-b4dc-b330b72ae401 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:47.496571 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-02db04e2-8c22-45f5-8625-81f31a39be91 req-29474241-814e-4922-b4dc-b330b72ae401 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:47.501252 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f3d9e4ef-7924-416e-b48d-b2578b4830c2 tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:47.502911 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f3d9e4ef-7924-416e-b48d-b2578b4830c2 tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:47.506058 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f3d9e4ef-7924-416e-b48d-b2578b4830c2 tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:47.508511 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f3d9e4ef-7924-416e-b48d-b2578b4830c2 tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:47.511775 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f3d9e4ef-7924-416e-b48d-b2578b4830c2 tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:47.514477 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f3d9e4ef-7924-416e-b48d-b2578b4830c2 tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:47.516566 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-02db04e2-8c22-45f5-8625-81f31a39be91 req-29474241-814e-4922-b4dc-b330b72ae401 service nova] Creating event network-vif-deleted:4423cf51-b7b4-4c1a-b717-d56a01d2cc5c for instance e078edba-e82a-4a6e-8661-638c352139c4 on n-h2-854823-8 Oct 04 20:57:47.524531 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-02db04e2-8c22-45f5-8625-81f31a39be91 req-29474241-814e-4922-b4dc-b330b72ae401 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047382 Oct 04 20:57:47.525483 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2312/4666] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:57:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:57:47.560147 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.wsgi [None req-f3d9e4ef-7924-416e-b48d-b2578b4830c2 tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] HTTP exception thrown: Instance f5d7d242-102d-4791-92ba-96dc7b84172a could not be found. Oct 04 20:57:47.571399 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-f3d9e4ef-7924-416e-b48d-b2578b4830c2 tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Request method failure captured: Oct 04 20:57:47.571399 n-d-854823-8 devstack@n-api.service[128802]: request: GET /compute/v2.1/servers/f5d7d242-102d-4791-92ba-96dc7b84172a HTTP/1.1 Oct 04 20:57:47.571399 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 20:57:47.571399 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 20:57:47.571399 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 20:57:47.571399 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 0 Oct 04 20:57:47.571399 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 20:57:47.571399 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 20:57:47.571399 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 20:57:47.571399 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 20:57:47.571399 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPJ4oueePgXAAi_qldZxiRtD0vHG_BiAqB_tEk55QeySXpWjRDcQXkSyk4YhBOmr5jvM3O6255yc9KrDlbN59_4QXRMvdaBpUE17H6aC_XUZ7-nk3-o9i8ftrjsDUfKHRRkCjJrLOWi5u9B_kR4iunZvDtENCwVFqapyo54naWi3JVCQ Oct 04 20:57:47.571399 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 20:57:47.571399 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 20:57:47.571399 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 20:57:47.571399 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 20:57:47.571399 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 20:57:47.571399 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 20:57:47.571399 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: b3351642441347c4badf854104a0f38a Oct 04 20:57:47.571399 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-ServerGroupTestJSON-1232846914 Oct 04 20:57:47.571399 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 20:57:47.571399 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 20:57:47.571399 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b3351642441347c4badf854104a0f38a", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b3351642441347c4badf854104a0f38a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b3351642441347c4badf854104a0f38a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b3351642441347c4badf854104a0f38a"}]}] Oct 04 20:57:47.571399 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-ServerGroupTestJSON-1232846914 Oct 04 20:57:47.571399 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: b3351642441347c4badf854104a0f38a Oct 04 20:57:47.571399 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-ServerGroupTestJSON-1232846914 Oct 04 20:57:47.571399 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-ServerGroupTestJSON-1232846914-project Oct 04 20:57:47.571399 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 20:57:47.571399 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 20:57:47.571399 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: f9ce92a1863c43e387f3410c3f7081b5 Oct 04 20:57:47.571399 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-ServerGroupTestJSON-1232846914-project Oct 04 20:57:47.571399 n-d-854823-8 devstack@n-api.service[128802]: method: > Oct 04 20:57:47.571399 n-d-854823-8 devstack@n-api.service[128802]: exception: Instance f5d7d242-102d-4791-92ba-96dc7b84172a could not be found. Oct 04 20:57:47.571399 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'id': 'f5d7d242-102d-4791-92ba-96dc7b84172a'} Oct 04 20:57:47.571399 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:57:47.571399 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:57:47.571399 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:57:47.571399 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:57:47.571399 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:57:47.571399 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:57:47.571399 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:57:47.571399 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:57:47.571399 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:57:47.571399 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:57:47.571399 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5d7d242-102d-4791-92ba-96dc7b84172a could not be found. Oct 04 20:57:47.571399 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:57:47.571399 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:57:47.571399 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:57:47.571399 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:57:47.571399 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:57:47.571399 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:57:47.571399 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:57:47.571399 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:57:47.571399 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:57:47.571399 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:57:47.571399 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:57:47.571399 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:57:47.571399 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:57:47.571399 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:57:47.571399 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:57:47.571399 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:57:47.571399 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5d7d242-102d-4791-92ba-96dc7b84172a could not be found. Oct 04 20:57:47.571399 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:57:47.571399 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:57:47.571399 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:57:47.576003 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:57:47.576003 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:57:47.576003 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:57:47.576003 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:57:47.576003 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:57:47.576003 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5d7d242-102d-4791-92ba-96dc7b84172a could not be found. Oct 04 20:57:47.576003 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:57:47.579156 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-f3d9e4ef-7924-416e-b48d-b2578b4830c2 tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Returning 404 to user: Instance f5d7d242-102d-4791-92ba-96dc7b84172a could not be found. {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:57:47.582139 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-f3d9e4ef-7924-416e-b48d-b2578b4830c2 tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] 10.222.0.33 "GET /compute/v2.1/servers/f5d7d242-102d-4791-92ba-96dc7b84172a" status: 404 len: 111 microversion: 2.1 time: 0.110962 Oct 04 20:57:47.584924 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2355/4667] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:57:47 2022] GET /compute/v2.1/servers/f5d7d242-102d-4791-92ba-96dc7b84172a => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:57:47.602901 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-76dfd211-6f5d-4337-b741-5604355f2564 tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:47.636745 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.compute.server_groups [None req-76dfd211-6f5d-4337-b741-5604355f2564 tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Querying cell 189ff13b-7538-4a71-a71c-1e7f1d3e1b46(cell1) for 1 instances {{(pid=128801) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 04 20:57:47.637566 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-76dfd211-6f5d-4337-b741-5604355f2564 tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:47.638145 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-76dfd211-6f5d-4337-b741-5604355f2564 tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:47.644297 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-76dfd211-6f5d-4337-b741-5604355f2564 tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:47.694595 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-76dfd211-6f5d-4337-b741-5604355f2564 tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] 10.222.0.33 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.102483 Oct 04 20:57:47.713681 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2313/4668] 10.222.0.33 () {58 vars in 1152 bytes} [Tue Oct 4 20:57:47 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:57:47.716864 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-279879a5-9206-4460-af1c-4f981c9d646d tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:47.752422 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.compute.server_groups [None req-279879a5-9206-4460-af1c-4f981c9d646d tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Querying cell 189ff13b-7538-4a71-a71c-1e7f1d3e1b46(cell1) for 1 instances {{(pid=128802) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 04 20:57:47.753559 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-279879a5-9206-4460-af1c-4f981c9d646d tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:47.755809 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-279879a5-9206-4460-af1c-4f981c9d646d tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:47.756793 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-279879a5-9206-4460-af1c-4f981c9d646d tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:47.771906 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-279879a5-9206-4460-af1c-4f981c9d646d tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] 10.222.0.33 "GET /compute/v2.1/os-server-groups/d31d1b38-de64-4f20-9704-57b38bc39f54" status: 200 len: 184 microversion: 2.1 time: 0.059505 Oct 04 20:57:47.773364 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2356/4669] 10.222.0.33 () {58 vars in 1263 bytes} [Tue Oct 4 20:57:47 2022] GET /compute/v2.1/os-server-groups/d31d1b38-de64-4f20-9704-57b38bc39f54 => generated 184 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 20:57:47.786974 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-29e0b4d0-fcc4-432b-8f4e-4531566a9d12 tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:47.788496 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-29e0b4d0-fcc4-432b-8f4e-4531566a9d12 tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] [instance: f5d7d242-102d-4791-92ba-96dc7b84172a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:57:47.796096 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-29e0b4d0-fcc4-432b-8f4e-4531566a9d12 tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:47.796916 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-29e0b4d0-fcc4-432b-8f4e-4531566a9d12 tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:47.797747 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-29e0b4d0-fcc4-432b-8f4e-4531566a9d12 tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:47.799093 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-29e0b4d0-fcc4-432b-8f4e-4531566a9d12 tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:47.799781 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-29e0b4d0-fcc4-432b-8f4e-4531566a9d12 tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:47.800443 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-29e0b4d0-fcc4-432b-8f4e-4531566a9d12 tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:47.819769 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-29e0b4d0-fcc4-432b-8f4e-4531566a9d12 tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] HTTP exception thrown: Instance f5d7d242-102d-4791-92ba-96dc7b84172a could not be found. Oct 04 20:57:47.821871 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-29e0b4d0-fcc4-432b-8f4e-4531566a9d12 tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Request method failure captured: Oct 04 20:57:47.821871 n-d-854823-8 devstack@n-api.service[128801]: request: DELETE /compute/v2.1/servers/f5d7d242-102d-4791-92ba-96dc7b84172a HTTP/1.1 Oct 04 20:57:47.821871 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:57:47.821871 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:57:47.821871 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:57:47.821871 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 0 Oct 04 20:57:47.821871 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:57:47.821871 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:57:47.821871 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:57:47.821871 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:57:47.821871 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJ4oueePgXAAi_qldZxiRtD0vHG_BiAqB_tEk55QeySXpWjRDcQXkSyk4YhBOmr5jvM3O6255yc9KrDlbN59_4QXRMvdaBpUE17H6aC_XUZ7-nk3-o9i8ftrjsDUfKHRRkCjJrLOWi5u9B_kR4iunZvDtENCwVFqapyo54naWi3JVCQ Oct 04 20:57:47.821871 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:57:47.821871 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:57:47.821871 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:57:47.821871 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:57:47.821871 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:57:47.821871 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:57:47.821871 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: b3351642441347c4badf854104a0f38a Oct 04 20:57:47.821871 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-ServerGroupTestJSON-1232846914 Oct 04 20:57:47.821871 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 20:57:47.821871 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 20:57:47.821871 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b3351642441347c4badf854104a0f38a", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b3351642441347c4badf854104a0f38a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b3351642441347c4badf854104a0f38a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b3351642441347c4badf854104a0f38a"}]}] Oct 04 20:57:47.821871 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-ServerGroupTestJSON-1232846914 Oct 04 20:57:47.821871 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: b3351642441347c4badf854104a0f38a Oct 04 20:57:47.821871 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ServerGroupTestJSON-1232846914 Oct 04 20:57:47.821871 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-ServerGroupTestJSON-1232846914-project Oct 04 20:57:47.821871 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:57:47.821871 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:57:47.821871 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: f9ce92a1863c43e387f3410c3f7081b5 Oct 04 20:57:47.821871 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-ServerGroupTestJSON-1232846914-project Oct 04 20:57:47.821871 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 20:57:47.821871 n-d-854823-8 devstack@n-api.service[128801]: exception: Instance f5d7d242-102d-4791-92ba-96dc7b84172a could not be found. Oct 04 20:57:47.821871 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': 'f5d7d242-102d-4791-92ba-96dc7b84172a'} Oct 04 20:57:47.821871 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:57:47.821871 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:57:47.821871 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:57:47.821871 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:57:47.821871 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:57:47.821871 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:57:47.821871 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:57:47.821871 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:57:47.821871 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:57:47.821871 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:57:47.821871 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5d7d242-102d-4791-92ba-96dc7b84172a could not be found. Oct 04 20:57:47.821871 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:57:47.821871 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:57:47.821871 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:57:47.821871 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:57:47.821871 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:57:47.821871 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:57:47.821871 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:57:47.821871 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:57:47.821871 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:57:47.821871 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:57:47.821871 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 20:57:47.821871 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 20:57:47.821871 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 20:57:47.821871 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 20:57:47.821871 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:57:47.821871 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:57:47.821871 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:57:47.821871 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:57:47.826229 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5d7d242-102d-4791-92ba-96dc7b84172a could not be found. Oct 04 20:57:47.826229 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:57:47.826229 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:57:47.826229 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:57:47.826229 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:57:47.826229 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:57:47.826229 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:57:47.826229 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:57:47.826229 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:57:47.826229 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5d7d242-102d-4791-92ba-96dc7b84172a could not be found. Oct 04 20:57:47.826229 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:57:47.831280 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-29e0b4d0-fcc4-432b-8f4e-4531566a9d12 tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Returning 404 to user: Instance f5d7d242-102d-4791-92ba-96dc7b84172a could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:57:47.832439 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-29e0b4d0-fcc4-432b-8f4e-4531566a9d12 tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] 10.222.0.33 "DELETE /compute/v2.1/servers/f5d7d242-102d-4791-92ba-96dc7b84172a" status: 404 len: 111 microversion: 2.1 time: 0.050272 Oct 04 20:57:47.833572 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2314/4670] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 20:57:47 2022] DELETE /compute/v2.1/servers/f5d7d242-102d-4791-92ba-96dc7b84172a => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:57:47.842103 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-eb3e5978-59f1-4597-835a-6e25e22c6bf5 tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:47.842821 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-eb3e5978-59f1-4597-835a-6e25e22c6bf5 tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] [instance: f5d7d242-102d-4791-92ba-96dc7b84172a] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:57:47.860500 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-eb3e5978-59f1-4597-835a-6e25e22c6bf5 tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:47.861020 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-eb3e5978-59f1-4597-835a-6e25e22c6bf5 tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:47.861455 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-eb3e5978-59f1-4597-835a-6e25e22c6bf5 tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:47.869468 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-eb3e5978-59f1-4597-835a-6e25e22c6bf5 tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:47.875338 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-eb3e5978-59f1-4597-835a-6e25e22c6bf5 tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:47.875851 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-eb3e5978-59f1-4597-835a-6e25e22c6bf5 tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:47.957974 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.wsgi [None req-eb3e5978-59f1-4597-835a-6e25e22c6bf5 tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] HTTP exception thrown: Instance f5d7d242-102d-4791-92ba-96dc7b84172a could not be found. Oct 04 20:57:47.959665 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-eb3e5978-59f1-4597-835a-6e25e22c6bf5 tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Request method failure captured: Oct 04 20:57:47.959665 n-d-854823-8 devstack@n-api.service[128802]: request: GET /compute/v2.1/servers/f5d7d242-102d-4791-92ba-96dc7b84172a HTTP/1.1 Oct 04 20:57:47.959665 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 20:57:47.959665 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 20:57:47.959665 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 20:57:47.959665 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 0 Oct 04 20:57:47.959665 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 20:57:47.959665 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 20:57:47.959665 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 20:57:47.959665 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 20:57:47.959665 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPJ4oueePgXAAi_qldZxiRtD0vHG_BiAqB_tEk55QeySXpWjRDcQXkSyk4YhBOmr5jvM3O6255yc9KrDlbN59_4QXRMvdaBpUE17H6aC_XUZ7-nk3-o9i8ftrjsDUfKHRRkCjJrLOWi5u9B_kR4iunZvDtENCwVFqapyo54naWi3JVCQ Oct 04 20:57:47.959665 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 20:57:47.959665 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 20:57:47.959665 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 20:57:47.959665 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 20:57:47.959665 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 20:57:47.959665 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 20:57:47.959665 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: b3351642441347c4badf854104a0f38a Oct 04 20:57:47.959665 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-ServerGroupTestJSON-1232846914 Oct 04 20:57:47.959665 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 20:57:47.959665 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 20:57:47.959665 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b3351642441347c4badf854104a0f38a", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b3351642441347c4badf854104a0f38a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b3351642441347c4badf854104a0f38a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b3351642441347c4badf854104a0f38a"}]}] Oct 04 20:57:47.959665 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-ServerGroupTestJSON-1232846914 Oct 04 20:57:47.959665 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: b3351642441347c4badf854104a0f38a Oct 04 20:57:47.959665 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-ServerGroupTestJSON-1232846914 Oct 04 20:57:47.959665 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-ServerGroupTestJSON-1232846914-project Oct 04 20:57:47.959665 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 20:57:47.959665 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 20:57:47.959665 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: f9ce92a1863c43e387f3410c3f7081b5 Oct 04 20:57:47.959665 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-ServerGroupTestJSON-1232846914-project Oct 04 20:57:47.959665 n-d-854823-8 devstack@n-api.service[128802]: method: > Oct 04 20:57:47.959665 n-d-854823-8 devstack@n-api.service[128802]: exception: Instance f5d7d242-102d-4791-92ba-96dc7b84172a could not be found. Oct 04 20:57:47.959665 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'id': 'f5d7d242-102d-4791-92ba-96dc7b84172a'} Oct 04 20:57:47.959665 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:57:47.959665 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:57:47.959665 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:57:47.959665 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:57:47.959665 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:57:47.959665 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:57:47.959665 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:57:47.959665 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:57:47.959665 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:57:47.959665 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:57:47.959665 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5d7d242-102d-4791-92ba-96dc7b84172a could not be found. Oct 04 20:57:47.959665 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:57:47.959665 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:57:47.959665 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:57:47.959665 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:57:47.959665 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:57:47.959665 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:57:47.959665 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:57:47.959665 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:57:47.959665 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:57:47.959665 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:57:47.959665 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:57:47.959665 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:57:47.959665 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:57:47.959665 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:57:47.959665 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:57:47.959665 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:57:47.959665 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5d7d242-102d-4791-92ba-96dc7b84172a could not be found. Oct 04 20:57:47.959665 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:57:47.959665 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:57:47.959665 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:57:47.964454 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:57:47.964454 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:57:47.964454 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:57:47.964454 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:57:47.964454 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:57:47.964454 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5d7d242-102d-4791-92ba-96dc7b84172a could not be found. Oct 04 20:57:47.964454 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:57:47.964454 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-eb3e5978-59f1-4597-835a-6e25e22c6bf5 tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Returning 404 to user: Instance f5d7d242-102d-4791-92ba-96dc7b84172a could not be found. {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:57:47.974789 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-eb3e5978-59f1-4597-835a-6e25e22c6bf5 tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] 10.222.0.33 "GET /compute/v2.1/servers/f5d7d242-102d-4791-92ba-96dc7b84172a" status: 404 len: 111 microversion: 2.1 time: 0.136201 Oct 04 20:57:47.981389 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2357/4671] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:57:47 2022] GET /compute/v2.1/servers/f5d7d242-102d-4791-92ba-96dc7b84172a => generated 111 bytes in 144 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 20:57:47.984822 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-672ee2f3-a711-495f-82b9-cc52e577efee tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:48.014966 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-672ee2f3-a711-495f-82b9-cc52e577efee tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] HTTP exception thrown: Instance group 7e133bdc-8011-422b-93f2-a102449a9a39 could not be found. Oct 04 20:57:48.017935 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-672ee2f3-a711-495f-82b9-cc52e577efee tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Request method failure captured: Oct 04 20:57:48.017935 n-d-854823-8 devstack@n-api.service[128801]: request: DELETE /compute/v2.1/os-server-groups/7e133bdc-8011-422b-93f2-a102449a9a39 HTTP/1.1 Oct 04 20:57:48.017935 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:57:48.017935 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:57:48.017935 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:57:48.017935 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 0 Oct 04 20:57:48.017935 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:57:48.017935 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:57:48.017935 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:57:48.017935 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:57:48.017935 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJ4oueePgXAAi_qldZxiRtD0vHG_BiAqB_tEk55QeySXpWjRDcQXkSyk4YhBOmr5jvM3O6255yc9KrDlbN59_4QXRMvdaBpUE17H6aC_XUZ7-nk3-o9i8ftrjsDUfKHRRkCjJrLOWi5u9B_kR4iunZvDtENCwVFqapyo54naWi3JVCQ Oct 04 20:57:48.017935 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:57:48.017935 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:57:48.017935 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:57:48.017935 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:57:48.017935 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:57:48.017935 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:57:48.017935 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: b3351642441347c4badf854104a0f38a Oct 04 20:57:48.017935 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-ServerGroupTestJSON-1232846914 Oct 04 20:57:48.017935 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 20:57:48.017935 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 20:57:48.017935 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b3351642441347c4badf854104a0f38a", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b3351642441347c4badf854104a0f38a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b3351642441347c4badf854104a0f38a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b3351642441347c4badf854104a0f38a"}]}] Oct 04 20:57:48.017935 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-ServerGroupTestJSON-1232846914 Oct 04 20:57:48.017935 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: b3351642441347c4badf854104a0f38a Oct 04 20:57:48.017935 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ServerGroupTestJSON-1232846914 Oct 04 20:57:48.017935 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-ServerGroupTestJSON-1232846914-project Oct 04 20:57:48.017935 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:57:48.017935 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:57:48.017935 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: f9ce92a1863c43e387f3410c3f7081b5 Oct 04 20:57:48.017935 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-ServerGroupTestJSON-1232846914-project Oct 04 20:57:48.017935 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 20:57:48.017935 n-d-854823-8 devstack@n-api.service[128801]: exception: Instance group 7e133bdc-8011-422b-93f2-a102449a9a39 could not be found. Oct 04 20:57:48.017935 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': '7e133bdc-8011-422b-93f2-a102449a9a39'} Oct 04 20:57:48.017935 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:57:48.017935 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:57:48.017935 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 04 20:57:48.017935 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 04 20:57:48.017935 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 20:57:48.017935 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 20:57:48.017935 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 04 20:57:48.017935 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 04 20:57:48.017935 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 20:57:48.017935 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 20:57:48.017935 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 04 20:57:48.017935 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 04 20:57:48.017935 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 7e133bdc-8011-422b-93f2-a102449a9a39 could not be found. Oct 04 20:57:48.017935 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:57:48.017935 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:57:48.017935 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:57:48.017935 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:57:48.017935 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:57:48.017935 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:57:48.017935 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:57:48.017935 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:57:48.017935 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:57:48.017935 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:57:48.017935 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 04 20:57:48.017935 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:57:48.017935 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 7e133bdc-8011-422b-93f2-a102449a9a39 could not be found. Oct 04 20:57:48.017935 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:57:48.017935 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:57:48.017935 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:57:48.017935 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:57:48.023056 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:57:48.023056 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:57:48.023056 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:57:48.023056 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:57:48.023056 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 7e133bdc-8011-422b-93f2-a102449a9a39 could not be found. Oct 04 20:57:48.023056 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:57:48.024928 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-672ee2f3-a711-495f-82b9-cc52e577efee tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Returning 404 to user: Instance group 7e133bdc-8011-422b-93f2-a102449a9a39 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:57:48.029443 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-672ee2f3-a711-495f-82b9-cc52e577efee tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] 10.222.0.33 "DELETE /compute/v2.1/os-server-groups/7e133bdc-8011-422b-93f2-a102449a9a39" status: 404 len: 117 microversion: 2.1 time: 0.046440 Oct 04 20:57:48.030717 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2315/4672] 10.222.0.33 () {58 vars in 1266 bytes} [Tue Oct 4 20:57:47 2022] DELETE /compute/v2.1/os-server-groups/7e133bdc-8011-422b-93f2-a102449a9a39 => generated 117 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:57:48.040104 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-7916482f-3ca2-4bbe-95b0-c98403a5af3b tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:48.066630 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.wsgi [None req-7916482f-3ca2-4bbe-95b0-c98403a5af3b tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] HTTP exception thrown: Instance group cc3ef969-e0b3-44d1-81da-56bd4fd111f6 could not be found. Oct 04 20:57:48.078138 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-7916482f-3ca2-4bbe-95b0-c98403a5af3b tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Request method failure captured: Oct 04 20:57:48.078138 n-d-854823-8 devstack@n-api.service[128802]: request: DELETE /compute/v2.1/os-server-groups/cc3ef969-e0b3-44d1-81da-56bd4fd111f6 HTTP/1.1 Oct 04 20:57:48.078138 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 20:57:48.078138 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 20:57:48.078138 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 20:57:48.078138 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 0 Oct 04 20:57:48.078138 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 20:57:48.078138 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 20:57:48.078138 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 20:57:48.078138 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 20:57:48.078138 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPJ4oueePgXAAi_qldZxiRtD0vHG_BiAqB_tEk55QeySXpWjRDcQXkSyk4YhBOmr5jvM3O6255yc9KrDlbN59_4QXRMvdaBpUE17H6aC_XUZ7-nk3-o9i8ftrjsDUfKHRRkCjJrLOWi5u9B_kR4iunZvDtENCwVFqapyo54naWi3JVCQ Oct 04 20:57:48.078138 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 20:57:48.078138 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 20:57:48.078138 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 20:57:48.078138 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 20:57:48.078138 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 20:57:48.078138 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 20:57:48.078138 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: b3351642441347c4badf854104a0f38a Oct 04 20:57:48.078138 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-ServerGroupTestJSON-1232846914 Oct 04 20:57:48.078138 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 20:57:48.078138 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 20:57:48.078138 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b3351642441347c4badf854104a0f38a", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b3351642441347c4badf854104a0f38a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b3351642441347c4badf854104a0f38a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b3351642441347c4badf854104a0f38a"}]}] Oct 04 20:57:48.078138 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-ServerGroupTestJSON-1232846914 Oct 04 20:57:48.078138 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: b3351642441347c4badf854104a0f38a Oct 04 20:57:48.078138 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-ServerGroupTestJSON-1232846914 Oct 04 20:57:48.078138 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-ServerGroupTestJSON-1232846914-project Oct 04 20:57:48.078138 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 20:57:48.078138 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 20:57:48.078138 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: f9ce92a1863c43e387f3410c3f7081b5 Oct 04 20:57:48.078138 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-ServerGroupTestJSON-1232846914-project Oct 04 20:57:48.078138 n-d-854823-8 devstack@n-api.service[128802]: method: > Oct 04 20:57:48.078138 n-d-854823-8 devstack@n-api.service[128802]: exception: Instance group cc3ef969-e0b3-44d1-81da-56bd4fd111f6 could not be found. Oct 04 20:57:48.078138 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'id': 'cc3ef969-e0b3-44d1-81da-56bd4fd111f6'} Oct 04 20:57:48.078138 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:57:48.078138 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:57:48.078138 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 04 20:57:48.078138 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 04 20:57:48.078138 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 20:57:48.078138 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 20:57:48.078138 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 04 20:57:48.078138 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 04 20:57:48.078138 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 20:57:48.078138 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 20:57:48.078138 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 04 20:57:48.078138 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 04 20:57:48.078138 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group cc3ef969-e0b3-44d1-81da-56bd4fd111f6 could not be found. Oct 04 20:57:48.078138 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:57:48.078138 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:57:48.078138 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:57:48.078138 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:57:48.078138 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:57:48.078138 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:57:48.078138 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:57:48.078138 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:57:48.078138 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:57:48.078138 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:57:48.078138 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 04 20:57:48.078138 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:57:48.078138 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group cc3ef969-e0b3-44d1-81da-56bd4fd111f6 could not be found. Oct 04 20:57:48.078138 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:57:48.078138 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:57:48.078138 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:57:48.078138 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:57:48.084627 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:57:48.084627 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:57:48.084627 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:57:48.084627 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:57:48.084627 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group cc3ef969-e0b3-44d1-81da-56bd4fd111f6 could not be found. Oct 04 20:57:48.084627 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:57:48.084627 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-7916482f-3ca2-4bbe-95b0-c98403a5af3b tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Returning 404 to user: Instance group cc3ef969-e0b3-44d1-81da-56bd4fd111f6 could not be found. {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:57:48.086526 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-7916482f-3ca2-4bbe-95b0-c98403a5af3b tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] 10.222.0.33 "DELETE /compute/v2.1/os-server-groups/cc3ef969-e0b3-44d1-81da-56bd4fd111f6" status: 404 len: 117 microversion: 2.1 time: 0.048970 Oct 04 20:57:48.086526 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2358/4673] 10.222.0.33 () {58 vars in 1266 bytes} [Tue Oct 4 20:57:48 2022] DELETE /compute/v2.1/os-server-groups/cc3ef969-e0b3-44d1-81da-56bd4fd111f6 => generated 117 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:57:48.096595 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-44bc9e88-a0fb-414c-889b-d79dd555bd46 tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:48.117418 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-44bc9e88-a0fb-414c-889b-d79dd555bd46 tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] HTTP exception thrown: Instance group b2c68336-1bd9-4ff4-811d-3d1495de46f0 could not be found. Oct 04 20:57:48.122877 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-44bc9e88-a0fb-414c-889b-d79dd555bd46 tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Request method failure captured: Oct 04 20:57:48.122877 n-d-854823-8 devstack@n-api.service[128801]: request: DELETE /compute/v2.1/os-server-groups/b2c68336-1bd9-4ff4-811d-3d1495de46f0 HTTP/1.1 Oct 04 20:57:48.122877 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:57:48.122877 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:57:48.122877 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:57:48.122877 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 0 Oct 04 20:57:48.122877 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:57:48.122877 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:57:48.122877 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:57:48.122877 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:57:48.122877 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJ4oueePgXAAi_qldZxiRtD0vHG_BiAqB_tEk55QeySXpWjRDcQXkSyk4YhBOmr5jvM3O6255yc9KrDlbN59_4QXRMvdaBpUE17H6aC_XUZ7-nk3-o9i8ftrjsDUfKHRRkCjJrLOWi5u9B_kR4iunZvDtENCwVFqapyo54naWi3JVCQ Oct 04 20:57:48.122877 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:57:48.122877 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:57:48.122877 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:57:48.122877 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:57:48.122877 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:57:48.122877 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:57:48.122877 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: b3351642441347c4badf854104a0f38a Oct 04 20:57:48.122877 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-ServerGroupTestJSON-1232846914 Oct 04 20:57:48.122877 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 20:57:48.122877 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 20:57:48.122877 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b3351642441347c4badf854104a0f38a", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b3351642441347c4badf854104a0f38a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b3351642441347c4badf854104a0f38a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b3351642441347c4badf854104a0f38a"}]}] Oct 04 20:57:48.122877 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-ServerGroupTestJSON-1232846914 Oct 04 20:57:48.122877 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: b3351642441347c4badf854104a0f38a Oct 04 20:57:48.122877 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ServerGroupTestJSON-1232846914 Oct 04 20:57:48.122877 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-ServerGroupTestJSON-1232846914-project Oct 04 20:57:48.122877 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:57:48.122877 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:57:48.122877 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: f9ce92a1863c43e387f3410c3f7081b5 Oct 04 20:57:48.122877 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-ServerGroupTestJSON-1232846914-project Oct 04 20:57:48.122877 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 20:57:48.122877 n-d-854823-8 devstack@n-api.service[128801]: exception: Instance group b2c68336-1bd9-4ff4-811d-3d1495de46f0 could not be found. Oct 04 20:57:48.122877 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': 'b2c68336-1bd9-4ff4-811d-3d1495de46f0'} Oct 04 20:57:48.122877 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:57:48.122877 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:57:48.122877 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 04 20:57:48.122877 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 04 20:57:48.122877 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 20:57:48.122877 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 20:57:48.122877 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 04 20:57:48.122877 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 04 20:57:48.122877 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 20:57:48.122877 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 20:57:48.122877 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 04 20:57:48.122877 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 04 20:57:48.122877 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group b2c68336-1bd9-4ff4-811d-3d1495de46f0 could not be found. Oct 04 20:57:48.122877 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:57:48.122877 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:57:48.122877 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:57:48.122877 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:57:48.122877 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:57:48.122877 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:57:48.122877 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:57:48.122877 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:57:48.122877 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:57:48.122877 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:57:48.122877 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 04 20:57:48.122877 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:57:48.122877 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group b2c68336-1bd9-4ff4-811d-3d1495de46f0 could not be found. Oct 04 20:57:48.122877 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:57:48.122877 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:57:48.122877 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:57:48.122877 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:57:48.127011 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:57:48.127011 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:57:48.127011 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:57:48.127011 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:57:48.127011 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group b2c68336-1bd9-4ff4-811d-3d1495de46f0 could not be found. Oct 04 20:57:48.127011 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:57:48.127011 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-44bc9e88-a0fb-414c-889b-d79dd555bd46 tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Returning 404 to user: Instance group b2c68336-1bd9-4ff4-811d-3d1495de46f0 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:57:48.130675 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-44bc9e88-a0fb-414c-889b-d79dd555bd46 tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] 10.222.0.33 "DELETE /compute/v2.1/os-server-groups/b2c68336-1bd9-4ff4-811d-3d1495de46f0" status: 404 len: 117 microversion: 2.1 time: 0.033349 Oct 04 20:57:48.134863 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2316/4674] 10.222.0.33 () {58 vars in 1266 bytes} [Tue Oct 4 20:57:48 2022] DELETE /compute/v2.1/os-server-groups/b2c68336-1bd9-4ff4-811d-3d1495de46f0 => generated 117 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:57:48.141314 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-b3cfa832-92ee-40f2-bc21-2b9a5929e971 tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:48.157077 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.wsgi [None req-b3cfa832-92ee-40f2-bc21-2b9a5929e971 tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] HTTP exception thrown: Instance group 56e0b05e-3abf-4906-9ee2-629c3eb80dd5 could not be found. Oct 04 20:57:48.162966 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-b3cfa832-92ee-40f2-bc21-2b9a5929e971 tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Request method failure captured: Oct 04 20:57:48.162966 n-d-854823-8 devstack@n-api.service[128802]: request: DELETE /compute/v2.1/os-server-groups/56e0b05e-3abf-4906-9ee2-629c3eb80dd5 HTTP/1.1 Oct 04 20:57:48.162966 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 20:57:48.162966 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 20:57:48.162966 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 20:57:48.162966 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 0 Oct 04 20:57:48.162966 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 20:57:48.162966 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 20:57:48.162966 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 20:57:48.162966 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 20:57:48.162966 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPJ4oueePgXAAi_qldZxiRtD0vHG_BiAqB_tEk55QeySXpWjRDcQXkSyk4YhBOmr5jvM3O6255yc9KrDlbN59_4QXRMvdaBpUE17H6aC_XUZ7-nk3-o9i8ftrjsDUfKHRRkCjJrLOWi5u9B_kR4iunZvDtENCwVFqapyo54naWi3JVCQ Oct 04 20:57:48.162966 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 20:57:48.162966 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 20:57:48.162966 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 20:57:48.162966 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 20:57:48.162966 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 20:57:48.162966 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 20:57:48.162966 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: b3351642441347c4badf854104a0f38a Oct 04 20:57:48.162966 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-ServerGroupTestJSON-1232846914 Oct 04 20:57:48.162966 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 20:57:48.162966 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 20:57:48.162966 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b3351642441347c4badf854104a0f38a", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b3351642441347c4badf854104a0f38a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b3351642441347c4badf854104a0f38a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b3351642441347c4badf854104a0f38a"}]}] Oct 04 20:57:48.162966 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-ServerGroupTestJSON-1232846914 Oct 04 20:57:48.162966 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: b3351642441347c4badf854104a0f38a Oct 04 20:57:48.162966 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-ServerGroupTestJSON-1232846914 Oct 04 20:57:48.162966 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-ServerGroupTestJSON-1232846914-project Oct 04 20:57:48.162966 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 20:57:48.162966 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 20:57:48.162966 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: f9ce92a1863c43e387f3410c3f7081b5 Oct 04 20:57:48.162966 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-ServerGroupTestJSON-1232846914-project Oct 04 20:57:48.162966 n-d-854823-8 devstack@n-api.service[128802]: method: > Oct 04 20:57:48.162966 n-d-854823-8 devstack@n-api.service[128802]: exception: Instance group 56e0b05e-3abf-4906-9ee2-629c3eb80dd5 could not be found. Oct 04 20:57:48.162966 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'id': '56e0b05e-3abf-4906-9ee2-629c3eb80dd5'} Oct 04 20:57:48.162966 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:57:48.162966 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:57:48.162966 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 04 20:57:48.162966 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 04 20:57:48.162966 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 20:57:48.162966 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 20:57:48.162966 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 04 20:57:48.162966 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 04 20:57:48.162966 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 20:57:48.162966 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 20:57:48.162966 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 04 20:57:48.162966 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 04 20:57:48.162966 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 56e0b05e-3abf-4906-9ee2-629c3eb80dd5 could not be found. Oct 04 20:57:48.162966 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:57:48.162966 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:57:48.162966 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:57:48.162966 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:57:48.162966 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:57:48.162966 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:57:48.162966 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:57:48.162966 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:57:48.162966 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:57:48.162966 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:57:48.162966 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 04 20:57:48.162966 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:57:48.162966 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 56e0b05e-3abf-4906-9ee2-629c3eb80dd5 could not be found. Oct 04 20:57:48.162966 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:57:48.162966 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:57:48.162966 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:57:48.162966 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:57:48.168352 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:57:48.168352 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:57:48.168352 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:57:48.168352 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:57:48.168352 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 56e0b05e-3abf-4906-9ee2-629c3eb80dd5 could not be found. Oct 04 20:57:48.168352 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:57:48.168352 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-b3cfa832-92ee-40f2-bc21-2b9a5929e971 tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Returning 404 to user: Instance group 56e0b05e-3abf-4906-9ee2-629c3eb80dd5 could not be found. {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:57:48.178432 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-b3cfa832-92ee-40f2-bc21-2b9a5929e971 tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] 10.222.0.33 "DELETE /compute/v2.1/os-server-groups/56e0b05e-3abf-4906-9ee2-629c3eb80dd5" status: 404 len: 117 microversion: 2.1 time: 0.028178 Oct 04 20:57:48.179114 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2359/4675] 10.222.0.33 () {58 vars in 1266 bytes} [Tue Oct 4 20:57:48 2022] DELETE /compute/v2.1/os-server-groups/56e0b05e-3abf-4906-9ee2-629c3eb80dd5 => generated 117 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:57:48.187580 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-15fac17c-52ce-4dba-bee7-297d8ce63b1d tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:48.252756 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-15fac17c-52ce-4dba-bee7-297d8ce63b1d tempest-ServerGroupTestJSON-1232846914 tempest-ServerGroupTestJSON-1232846914-project] 10.222.0.33 "DELETE /compute/v2.1/os-server-groups/d31d1b38-de64-4f20-9704-57b38bc39f54" status: 204 len: 0 microversion: 2.1 time: 0.068990 Oct 04 20:57:48.257985 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2317/4676] 10.222.0.33 () {58 vars in 1266 bytes} [Tue Oct 4 20:57:48 2022] DELETE /compute/v2.1/os-server-groups/d31d1b38-de64-4f20-9704-57b38bc39f54 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:57:48.379081 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-02b69741-1079-4ad2-b8d0-3458d1379a83 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:48.381028 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-02b69741-1079-4ad2-b8d0-3458d1379a83 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] [instance: e078edba-e82a-4a6e-8661-638c352139c4] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:57:48.391595 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-02b69741-1079-4ad2-b8d0-3458d1379a83 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:48.392456 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-02b69741-1079-4ad2-b8d0-3458d1379a83 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:48.394091 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-02b69741-1079-4ad2-b8d0-3458d1379a83 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:48.397141 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-02b69741-1079-4ad2-b8d0-3458d1379a83 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:48.397880 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-02b69741-1079-4ad2-b8d0-3458d1379a83 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:48.398570 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-02b69741-1079-4ad2-b8d0-3458d1379a83 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:48.460629 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-02b69741-1079-4ad2-b8d0-3458d1379a83 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:48.461501 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-02b69741-1079-4ad2-b8d0-3458d1379a83 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:48.462172 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-02b69741-1079-4ad2-b8d0-3458d1379a83 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:48.464166 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.objects.instance [None req-02b69741-1079-4ad2-b8d0-3458d1379a83 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Lazy-loading 'fault' on Instance uuid e078edba-e82a-4a6e-8661-638c352139c4 {{(pid=128802) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:57:48.489693 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-4d3a555f-36cd-48e5-afbd-ccc39c3e5456 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:48.491590 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-4d3a555f-36cd-48e5-afbd-ccc39c3e5456 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] [instance: 368d4aa4-81a1-43af-a69b-e5f7004da740] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:57:48.507897 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4d3a555f-36cd-48e5-afbd-ccc39c3e5456 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:48.509204 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4d3a555f-36cd-48e5-afbd-ccc39c3e5456 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:48.510545 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4d3a555f-36cd-48e5-afbd-ccc39c3e5456 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:48.511690 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4d3a555f-36cd-48e5-afbd-ccc39c3e5456 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:48.512806 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4d3a555f-36cd-48e5-afbd-ccc39c3e5456 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:48.514161 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4d3a555f-36cd-48e5-afbd-ccc39c3e5456 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:48.651682 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-02b69741-1079-4ad2-b8d0-3458d1379a83 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0d54ecb4da4d1795ff4a6bfe4ebc77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76cb3acdf52a4016b1af1e1a70614243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:57:48.671964 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-02b69741-1079-4ad2-b8d0-3458d1379a83 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] 10.222.0.33 "GET /compute/v2.1/servers/e078edba-e82a-4a6e-8661-638c352139c4" status: 200 len: 1312 microversion: 2.1 time: 0.291328 Oct 04 20:57:48.673292 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2360/4677] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:57:48 2022] GET /compute/v2.1/servers/e078edba-e82a-4a6e-8661-638c352139c4 => generated 1312 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:57:48.896403 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-4d3a555f-36cd-48e5-afbd-ccc39c3e5456 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6513f5e908ac4d028cad6eeeebeab285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65946afc398d4a9fb1c9095a4f946e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:57:48.911231 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-4d3a555f-36cd-48e5-afbd-ccc39c3e5456 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "GET /compute/v2.1/servers/368d4aa4-81a1-43af-a69b-e5f7004da740" status: 200 len: 1316 microversion: 2.1 time: 0.433322 Oct 04 20:57:48.917610 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2318/4678] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:57:48 2022] GET /compute/v2.1/servers/368d4aa4-81a1-43af-a69b-e5f7004da740 => generated 1316 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:57:49.701083 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-4892ae35-240b-47c2-ba9e-ce2803d99d90 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:49.704134 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-4892ae35-240b-47c2-ba9e-ce2803d99d90 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] [instance: e078edba-e82a-4a6e-8661-638c352139c4] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:57:49.717144 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4892ae35-240b-47c2-ba9e-ce2803d99d90 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:49.718028 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4892ae35-240b-47c2-ba9e-ce2803d99d90 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:49.722857 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4892ae35-240b-47c2-ba9e-ce2803d99d90 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:49.723886 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4892ae35-240b-47c2-ba9e-ce2803d99d90 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:49.724765 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4892ae35-240b-47c2-ba9e-ce2803d99d90 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:49.725982 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4892ae35-240b-47c2-ba9e-ce2803d99d90 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:49.735775 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:57:49.764294 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.wsgi [None req-4892ae35-240b-47c2-ba9e-ce2803d99d90 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] HTTP exception thrown: Instance e078edba-e82a-4a6e-8661-638c352139c4 could not be found. Oct 04 20:57:49.768939 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-4892ae35-240b-47c2-ba9e-ce2803d99d90 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Request method failure captured: Oct 04 20:57:49.768939 n-d-854823-8 devstack@n-api.service[128802]: request: GET /compute/v2.1/servers/e078edba-e82a-4a6e-8661-638c352139c4 HTTP/1.1 Oct 04 20:57:49.768939 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 20:57:49.768939 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 20:57:49.768939 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 20:57:49.768939 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 0 Oct 04 20:57:49.768939 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 20:57:49.768939 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 20:57:49.768939 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 20:57:49.768939 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 20:57:49.768939 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPJ4VuT2cCVvV5gxG1iPB83Bxn6TBK7uhx9NXV5-9_fAcNWw9t-nXpd4t_HFZR-Q4b2SngVWjg1zGpKRiP1240ZfpcC1Uk8a3h8XpA4eQigNugjB_CpEPCs6qb_9FfT6Wcw0tdPLd1MeN4oZpsYagYrovtibHIgvswEBNsdy3mkIJgmY Oct 04 20:57:49.768939 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 20:57:49.768939 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 20:57:49.768939 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 20:57:49.768939 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 20:57:49.768939 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 20:57:49.768939 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 20:57:49.768939 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: 76cb3acdf52a4016b1af1e1a70614243 Oct 04 20:57:49.768939 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-ListServersNegativeTestJSON-1056031141 Oct 04 20:57:49.768939 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 20:57:49.768939 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 20:57:49.768939 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_76cb3acdf52a4016b1af1e1a70614243", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/76cb3acdf52a4016b1af1e1a70614243"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/76cb3acdf52a4016b1af1e1a70614243"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/76cb3acdf52a4016b1af1e1a70614243"}]}] Oct 04 20:57:49.768939 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-ListServersNegativeTestJSON-1056031141 Oct 04 20:57:49.768939 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: 76cb3acdf52a4016b1af1e1a70614243 Oct 04 20:57:49.768939 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1056031141 Oct 04 20:57:49.768939 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-ListServersNegativeTestJSON-1056031141-project Oct 04 20:57:49.768939 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 20:57:49.768939 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 20:57:49.768939 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: cc0d54ecb4da4d1795ff4a6bfe4ebc77 Oct 04 20:57:49.768939 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-ListServersNegativeTestJSON-1056031141-project Oct 04 20:57:49.768939 n-d-854823-8 devstack@n-api.service[128802]: method: > Oct 04 20:57:49.768939 n-d-854823-8 devstack@n-api.service[128802]: exception: Instance e078edba-e82a-4a6e-8661-638c352139c4 could not be found. Oct 04 20:57:49.768939 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'id': 'e078edba-e82a-4a6e-8661-638c352139c4'} Oct 04 20:57:49.768939 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:57:49.768939 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:57:49.768939 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:57:49.768939 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:57:49.768939 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:57:49.768939 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:57:49.768939 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:57:49.768939 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:57:49.768939 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:57:49.768939 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:57:49.768939 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e078edba-e82a-4a6e-8661-638c352139c4 could not be found. Oct 04 20:57:49.768939 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:57:49.768939 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:57:49.768939 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:57:49.768939 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:57:49.768939 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:57:49.768939 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:57:49.768939 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:57:49.768939 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:57:49.768939 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:57:49.768939 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:57:49.768939 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:57:49.768939 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:57:49.768939 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:57:49.768939 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:57:49.768939 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:57:49.768939 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:57:49.768939 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e078edba-e82a-4a6e-8661-638c352139c4 could not be found. Oct 04 20:57:49.768939 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:57:49.768939 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:57:49.774161 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:57:49.774161 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:57:49.774161 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:57:49.774161 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:57:49.774161 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:57:49.774161 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:57:49.774161 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e078edba-e82a-4a6e-8661-638c352139c4 could not be found. Oct 04 20:57:49.774161 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:57:49.776167 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-4892ae35-240b-47c2-ba9e-ce2803d99d90 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Returning 404 to user: Instance e078edba-e82a-4a6e-8661-638c352139c4 could not be found. {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:57:49.779632 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-4892ae35-240b-47c2-ba9e-ce2803d99d90 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] 10.222.0.33 "GET /compute/v2.1/servers/e078edba-e82a-4a6e-8661-638c352139c4" status: 404 len: 111 microversion: 2.1 time: 0.082420 Oct 04 20:57:49.780723 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2361/4679] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:57:49 2022] GET /compute/v2.1/servers/e078edba-e82a-4a6e-8661-638c352139c4 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:57:49.789238 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-536a727a-294f-4687-8b79-84c149d3b2d8 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:49.790544 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-536a727a-294f-4687-8b79-84c149d3b2d8 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] [instance: 9e261662-c010-41bd-a875-8e47b106485b] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:57:49.801465 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:57:49.805445 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-536a727a-294f-4687-8b79-84c149d3b2d8 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:49.810943 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-536a727a-294f-4687-8b79-84c149d3b2d8 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:49.811707 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-536a727a-294f-4687-8b79-84c149d3b2d8 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:49.816087 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-536a727a-294f-4687-8b79-84c149d3b2d8 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:49.818478 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-536a727a-294f-4687-8b79-84c149d3b2d8 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:49.820065 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-536a727a-294f-4687-8b79-84c149d3b2d8 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:49.864793 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-536a727a-294f-4687-8b79-84c149d3b2d8 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] HTTP exception thrown: Instance 9e261662-c010-41bd-a875-8e47b106485b could not be found. Oct 04 20:57:49.868369 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-536a727a-294f-4687-8b79-84c149d3b2d8 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Request method failure captured: Oct 04 20:57:49.868369 n-d-854823-8 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/9e261662-c010-41bd-a875-8e47b106485b HTTP/1.1 Oct 04 20:57:49.868369 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:57:49.868369 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:57:49.868369 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:57:49.868369 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 0 Oct 04 20:57:49.868369 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:57:49.868369 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:57:49.868369 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:57:49.868369 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:57:49.868369 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJ4VuT2cCVvV5gxG1iPB83Bxn6TBK7uhx9NXV5-9_fAcNWw9t-nXpd4t_HFZR-Q4b2SngVWjg1zGpKRiP1240ZfpcC1Uk8a3h8XpA4eQigNugjB_CpEPCs6qb_9FfT6Wcw0tdPLd1MeN4oZpsYagYrovtibHIgvswEBNsdy3mkIJgmY Oct 04 20:57:49.868369 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:57:49.868369 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:57:49.868369 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:57:49.868369 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:57:49.868369 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:57:49.868369 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:57:49.868369 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: 76cb3acdf52a4016b1af1e1a70614243 Oct 04 20:57:49.868369 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-ListServersNegativeTestJSON-1056031141 Oct 04 20:57:49.868369 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 20:57:49.868369 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 20:57:49.868369 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_76cb3acdf52a4016b1af1e1a70614243", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/76cb3acdf52a4016b1af1e1a70614243"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/76cb3acdf52a4016b1af1e1a70614243"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/76cb3acdf52a4016b1af1e1a70614243"}]}] Oct 04 20:57:49.868369 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-ListServersNegativeTestJSON-1056031141 Oct 04 20:57:49.868369 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: 76cb3acdf52a4016b1af1e1a70614243 Oct 04 20:57:49.868369 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1056031141 Oct 04 20:57:49.868369 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-ListServersNegativeTestJSON-1056031141-project Oct 04 20:57:49.868369 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:57:49.868369 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:57:49.868369 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: cc0d54ecb4da4d1795ff4a6bfe4ebc77 Oct 04 20:57:49.868369 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-ListServersNegativeTestJSON-1056031141-project Oct 04 20:57:49.868369 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 20:57:49.868369 n-d-854823-8 devstack@n-api.service[128801]: exception: Instance 9e261662-c010-41bd-a875-8e47b106485b could not be found. Oct 04 20:57:49.868369 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': '9e261662-c010-41bd-a875-8e47b106485b'} Oct 04 20:57:49.868369 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:57:49.868369 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:57:49.868369 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:57:49.868369 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:57:49.868369 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:57:49.868369 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:57:49.868369 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:57:49.868369 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:57:49.868369 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:57:49.868369 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:57:49.868369 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e261662-c010-41bd-a875-8e47b106485b could not be found. Oct 04 20:57:49.868369 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:57:49.868369 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:57:49.868369 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:57:49.868369 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:57:49.868369 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:57:49.868369 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:57:49.868369 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:57:49.868369 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:57:49.868369 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:57:49.868369 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:57:49.868369 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:57:49.868369 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:57:49.868369 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:57:49.868369 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:57:49.868369 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:57:49.868369 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:57:49.868369 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e261662-c010-41bd-a875-8e47b106485b could not be found. Oct 04 20:57:49.868369 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:57:49.868369 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:57:49.873210 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:57:49.873210 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:57:49.873210 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:57:49.873210 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:57:49.873210 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:57:49.873210 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:57:49.873210 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e261662-c010-41bd-a875-8e47b106485b could not be found. Oct 04 20:57:49.873210 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:57:49.873210 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-536a727a-294f-4687-8b79-84c149d3b2d8 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] Returning 404 to user: Instance 9e261662-c010-41bd-a875-8e47b106485b could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:57:49.873915 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-536a727a-294f-4687-8b79-84c149d3b2d8 tempest-ListServersNegativeTestJSON-1056031141 tempest-ListServersNegativeTestJSON-1056031141-project] 10.222.0.33 "GET /compute/v2.1/servers/9e261662-c010-41bd-a875-8e47b106485b" status: 404 len: 111 microversion: 2.1 time: 0.088457 Oct 04 20:57:49.876685 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2319/4680] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:57:49 2022] GET /compute/v2.1/servers/9e261662-c010-41bd-a875-8e47b106485b => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:57:49.940197 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-fc3bd053-6b2f-4a78-bd65-c7129be5fa55 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:49.940954 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-fc3bd053-6b2f-4a78-bd65-c7129be5fa55 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] [instance: 368d4aa4-81a1-43af-a69b-e5f7004da740] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:57:49.954201 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fc3bd053-6b2f-4a78-bd65-c7129be5fa55 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:49.954867 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fc3bd053-6b2f-4a78-bd65-c7129be5fa55 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:49.955423 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fc3bd053-6b2f-4a78-bd65-c7129be5fa55 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:49.956230 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fc3bd053-6b2f-4a78-bd65-c7129be5fa55 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:49.956928 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fc3bd053-6b2f-4a78-bd65-c7129be5fa55 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:49.962977 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fc3bd053-6b2f-4a78-bd65-c7129be5fa55 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:50.652649 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-fc3bd053-6b2f-4a78-bd65-c7129be5fa55 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6513f5e908ac4d028cad6eeeebeab285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65946afc398d4a9fb1c9095a4f946e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:57:50.666251 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-fc3bd053-6b2f-4a78-bd65-c7129be5fa55 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "GET /compute/v2.1/servers/368d4aa4-81a1-43af-a69b-e5f7004da740" status: 200 len: 1316 microversion: 2.1 time: 0.727057 Oct 04 20:57:50.684449 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2362/4681] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:57:49 2022] GET /compute/v2.1/servers/368d4aa4-81a1-43af-a69b-e5f7004da740 => generated 1316 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:57:51.691462 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-755a47de-8244-478a-ab49-3adab9011676 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:51.695826 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-755a47de-8244-478a-ab49-3adab9011676 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] [instance: 368d4aa4-81a1-43af-a69b-e5f7004da740] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:57:51.699664 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=14 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:57:51.717877 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-755a47de-8244-478a-ab49-3adab9011676 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:51.723916 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-755a47de-8244-478a-ab49-3adab9011676 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:51.725921 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-755a47de-8244-478a-ab49-3adab9011676 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:51.727288 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-755a47de-8244-478a-ab49-3adab9011676 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:51.727970 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-755a47de-8244-478a-ab49-3adab9011676 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:51.729310 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-755a47de-8244-478a-ab49-3adab9011676 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:52.503305 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-755a47de-8244-478a-ab49-3adab9011676 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6513f5e908ac4d028cad6eeeebeab285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65946afc398d4a9fb1c9095a4f946e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:57:52.505809 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:57:52.515497 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-755a47de-8244-478a-ab49-3adab9011676 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "GET /compute/v2.1/servers/368d4aa4-81a1-43af-a69b-e5f7004da740" status: 200 len: 1316 microversion: 2.1 time: 0.828831 Oct 04 20:57:52.527914 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2320/4682] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:57:51 2022] GET /compute/v2.1/servers/368d4aa4-81a1-43af-a69b-e5f7004da740 => generated 1316 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:57:53.544494 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-7f4ba5d7-7be5-4c57-bbcc-33c286796a7f tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:53.545686 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-7f4ba5d7-7be5-4c57-bbcc-33c286796a7f tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] [instance: 368d4aa4-81a1-43af-a69b-e5f7004da740] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:57:53.562711 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7f4ba5d7-7be5-4c57-bbcc-33c286796a7f tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:53.564508 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7f4ba5d7-7be5-4c57-bbcc-33c286796a7f tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:53.565822 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7f4ba5d7-7be5-4c57-bbcc-33c286796a7f tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:53.572139 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7f4ba5d7-7be5-4c57-bbcc-33c286796a7f tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:53.573876 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7f4ba5d7-7be5-4c57-bbcc-33c286796a7f tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:53.576299 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7f4ba5d7-7be5-4c57-bbcc-33c286796a7f tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:54.877818 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-7f4ba5d7-7be5-4c57-bbcc-33c286796a7f tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6513f5e908ac4d028cad6eeeebeab285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65946afc398d4a9fb1c9095a4f946e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:57:54.890267 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-7f4ba5d7-7be5-4c57-bbcc-33c286796a7f tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "GET /compute/v2.1/servers/368d4aa4-81a1-43af-a69b-e5f7004da740" status: 200 len: 1316 microversion: 2.1 time: 1.350598 Oct 04 20:57:54.891967 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2363/4683] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:57:53 2022] GET /compute/v2.1/servers/368d4aa4-81a1-43af-a69b-e5f7004da740 => generated 1316 bytes in 1353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:57:55.332394 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-4dea6e2e-49df-4304-9547-52ca329c4c46 req-96c1657f-1a3d-42d0-8f33-07832d8d2eae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "368d4aa4-81a1-43af-a69b-e5f7004da740", "name": "network-vif-plugged", "status": "completed", "tag": "6e0c1b74-365c-4334-a0cd-a002a31e38fa"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:57:55.354270 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-4dea6e2e-49df-4304-9547-52ca329c4c46 req-96c1657f-1a3d-42d0-8f33-07832d8d2eae service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:55.355288 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-4dea6e2e-49df-4304-9547-52ca329c4c46 req-96c1657f-1a3d-42d0-8f33-07832d8d2eae service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:55.355876 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-4dea6e2e-49df-4304-9547-52ca329c4c46 req-96c1657f-1a3d-42d0-8f33-07832d8d2eae service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:55.389926 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-4dea6e2e-49df-4304-9547-52ca329c4c46 req-96c1657f-1a3d-42d0-8f33-07832d8d2eae service nova] Creating event network-vif-plugged:6e0c1b74-365c-4334-a0cd-a002a31e38fa for instance 368d4aa4-81a1-43af-a69b-e5f7004da740 on n-h1-854823-8 Oct 04 20:57:55.408740 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-4dea6e2e-49df-4304-9547-52ca329c4c46 req-96c1657f-1a3d-42d0-8f33-07832d8d2eae service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080011 Oct 04 20:57:55.413069 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2321/4684] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:57:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:57:55.919158 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-1640c351-3bc7-41f2-b17e-ec49926b28d3 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:55.919790 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-1640c351-3bc7-41f2-b17e-ec49926b28d3 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] [instance: 368d4aa4-81a1-43af-a69b-e5f7004da740] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:57:55.930128 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1640c351-3bc7-41f2-b17e-ec49926b28d3 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:55.938316 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1640c351-3bc7-41f2-b17e-ec49926b28d3 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:55.940656 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1640c351-3bc7-41f2-b17e-ec49926b28d3 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:55.947525 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1640c351-3bc7-41f2-b17e-ec49926b28d3 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:55.953818 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1640c351-3bc7-41f2-b17e-ec49926b28d3 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:55.956816 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1640c351-3bc7-41f2-b17e-ec49926b28d3 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:57.557234 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-1640c351-3bc7-41f2-b17e-ec49926b28d3 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6513f5e908ac4d028cad6eeeebeab285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65946afc398d4a9fb1c9095a4f946e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:57:57.595791 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-1640c351-3bc7-41f2-b17e-ec49926b28d3 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "GET /compute/v2.1/servers/368d4aa4-81a1-43af-a69b-e5f7004da740" status: 200 len: 1316 microversion: 2.1 time: 1.681654 Oct 04 20:57:57.610468 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2364/4685] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:57:55 2022] GET /compute/v2.1/servers/368d4aa4-81a1-43af-a69b-e5f7004da740 => generated 1316 bytes in 1690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:57:58.288473 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-667e8b16-655c-4d15-9347-81137deb684a tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsNegativeTestJSON-server-1702685111", "imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63", "flavorRef": "452", "networks": [{"uuid": "aab40d31-cdc4-4f9a-92b4-64ee71b61fc5"}]}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:57:58.357431 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.network.neutron [None req-667e8b16-655c-4d15-9347-81137deb684a tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] validate_networks() for [('aab40d31-cdc4-4f9a-92b4-64ee71b61fc5', None, None, None, None, None)] {{(pid=128801) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:57:58.621392 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-319e831e-3d75-4baa-aa11-6040c84f5e77 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:58.622007 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-319e831e-3d75-4baa-aa11-6040c84f5e77 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] [instance: 368d4aa4-81a1-43af-a69b-e5f7004da740] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:57:58.636986 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-319e831e-3d75-4baa-aa11-6040c84f5e77 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:58.637391 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-319e831e-3d75-4baa-aa11-6040c84f5e77 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:58.638020 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-319e831e-3d75-4baa-aa11-6040c84f5e77 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:58.639108 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-319e831e-3d75-4baa-aa11-6040c84f5e77 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:58.639709 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-319e831e-3d75-4baa-aa11-6040c84f5e77 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:58.640292 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-319e831e-3d75-4baa-aa11-6040c84f5e77 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:59.728571 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-319e831e-3d75-4baa-aa11-6040c84f5e77 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6513f5e908ac4d028cad6eeeebeab285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65946afc398d4a9fb1c9095a4f946e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:57:59.745155 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-319e831e-3d75-4baa-aa11-6040c84f5e77 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "GET /compute/v2.1/servers/368d4aa4-81a1-43af-a69b-e5f7004da740" status: 200 len: 1505 microversion: 2.1 time: 1.125416 Oct 04 20:57:59.745883 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2365/4686] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:57:58 2022] GET /compute/v2.1/servers/368d4aa4-81a1-43af-a69b-e5f7004da740 => generated 1505 bytes in 1129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:57:59.772696 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-35b54ff4-f2d9-46a9-a146-cb86db43ee67 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:57:59.773541 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-35b54ff4-f2d9-46a9-a146-cb86db43ee67 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] [instance: 368d4aa4-81a1-43af-a69b-e5f7004da740] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:57:59.786192 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-35b54ff4-f2d9-46a9-a146-cb86db43ee67 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:59.787130 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-35b54ff4-f2d9-46a9-a146-cb86db43ee67 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:59.788142 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-35b54ff4-f2d9-46a9-a146-cb86db43ee67 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:59.790407 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-35b54ff4-f2d9-46a9-a146-cb86db43ee67 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:57:59.790407 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-35b54ff4-f2d9-46a9-a146-cb86db43ee67 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:57:59.790407 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-35b54ff4-f2d9-46a9-a146-cb86db43ee67 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:57:59.858514 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-35b54ff4-f2d9-46a9-a146-cb86db43ee67 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] [instance: 368d4aa4-81a1-43af-a69b-e5f7004da740] Going to try to terminate instance {{(pid=128802) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:58:00.078920 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-35b54ff4-f2d9-46a9-a146-cb86db43ee67 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "DELETE /compute/v2.1/servers/368d4aa4-81a1-43af-a69b-e5f7004da740" status: 204 len: 0 microversion: 2.1 time: 0.309671 Oct 04 20:58:00.082710 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2366/4687] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 20:57:59 2022] DELETE /compute/v2.1/servers/368d4aa4-81a1-43af-a69b-e5f7004da740 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 20:58:00.101860 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-dbe3c30a-31e3-45c1-bf35-f2e68cfed614 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:58:00.105520 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-dbe3c30a-31e3-45c1-bf35-f2e68cfed614 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] [instance: 368d4aa4-81a1-43af-a69b-e5f7004da740] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:58:00.118882 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dbe3c30a-31e3-45c1-bf35-f2e68cfed614 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:00.121052 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dbe3c30a-31e3-45c1-bf35-f2e68cfed614 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:00.125489 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dbe3c30a-31e3-45c1-bf35-f2e68cfed614 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:00.126855 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dbe3c30a-31e3-45c1-bf35-f2e68cfed614 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:00.127644 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dbe3c30a-31e3-45c1-bf35-f2e68cfed614 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:00.128331 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dbe3c30a-31e3-45c1-bf35-f2e68cfed614 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:00.165310 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-667e8b16-655c-4d15-9347-81137deb684a tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] Flavor limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:58:00.165775 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-667e8b16-655c-4d15-9347-81137deb684a tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] Image limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:58:00.166211 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-667e8b16-655c-4d15-9347-81137deb684a tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] Flavor pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:58:00.166927 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-667e8b16-655c-4d15-9347-81137deb684a tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] Image pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:58:00.167655 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-667e8b16-655c-4d15-9347-81137deb684a tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:58:00.203398 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-667e8b16-655c-4d15-9347-81137deb684a tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:00.203777 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-667e8b16-655c-4d15-9347-81137deb684a tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:00.204532 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-667e8b16-655c-4d15-9347-81137deb684a tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:00.205472 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-667e8b16-655c-4d15-9347-81137deb684a tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:00.206111 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-667e8b16-655c-4d15-9347-81137deb684a tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:00.206746 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-667e8b16-655c-4d15-9347-81137deb684a tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:00.248201 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-667e8b16-655c-4d15-9347-81137deb684a tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] Getting quotas for project cc1e31ed067d4e85aab983e532ab399c. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:58:00.259936 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-667e8b16-655c-4d15-9347-81137deb684a tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] Getting quotas for user 034056e41cbe4111ba8fcd5e48273007 and project cc1e31ed067d4e85aab983e532ab399c. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:58:00.294131 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-667e8b16-655c-4d15-9347-81137deb684a tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] Going to run 1 instances... {{(pid=128801) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:58:00.296619 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-667e8b16-655c-4d15-9347-81137deb684a tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] [instance: e32774eb-128e-499d-b15e-f93f4c57d9e0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='15b24725-0c99-4bcf-b1fb-907cdf8e2d63',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128801) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:58:00.403871 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-667e8b16-655c-4d15-9347-81137deb684a tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.668308 Oct 04 20:58:00.434086 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2322/4688] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 20:57:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 2699 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 20:58:00.455284 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-11cf695a-0050-473c-8a64-66fcd93a8125 tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:58:00.455927 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-11cf695a-0050-473c-8a64-66fcd93a8125 tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] [instance: e32774eb-128e-499d-b15e-f93f4c57d9e0] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:58:00.608881 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-11cf695a-0050-473c-8a64-66fcd93a8125 tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034056e41cbe4111ba8fcd5e48273007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1e31ed067d4e85aab983e532ab399c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:58:00.637193 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-11cf695a-0050-473c-8a64-66fcd93a8125 tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] 10.222.0.33 "GET /compute/v2.1/servers/e32774eb-128e-499d-b15e-f93f4c57d9e0" status: 200 len: 1225 microversion: 2.1 time: 0.196540 Oct 04 20:58:00.646382 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2323/4689] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:58:00 2022] GET /compute/v2.1/servers/e32774eb-128e-499d-b15e-f93f4c57d9e0 => generated 1225 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:58:00.713322 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-dbe3c30a-31e3-45c1-bf35-f2e68cfed614 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6513f5e908ac4d028cad6eeeebeab285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65946afc398d4a9fb1c9095a4f946e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:58:00.729372 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-dbe3c30a-31e3-45c1-bf35-f2e68cfed614 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "GET /compute/v2.1/servers/368d4aa4-81a1-43af-a69b-e5f7004da740" status: 200 len: 1511 microversion: 2.1 time: 0.638291 Oct 04 20:58:00.732810 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2367/4690] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:58:00 2022] GET /compute/v2.1/servers/368d4aa4-81a1-43af-a69b-e5f7004da740 => generated 1511 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:58:01.683714 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f237da52-2253-4141-aefc-510aaf2e05ca tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:58:01.687038 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f237da52-2253-4141-aefc-510aaf2e05ca tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] [instance: e32774eb-128e-499d-b15e-f93f4c57d9e0] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:58:01.742212 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f237da52-2253-4141-aefc-510aaf2e05ca tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:01.744147 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f237da52-2253-4141-aefc-510aaf2e05ca tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:01.745557 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f237da52-2253-4141-aefc-510aaf2e05ca tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:01.751107 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f237da52-2253-4141-aefc-510aaf2e05ca tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:01.752218 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f237da52-2253-4141-aefc-510aaf2e05ca tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:01.755399 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f237da52-2253-4141-aefc-510aaf2e05ca tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:01.761797 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-bbfd6f55-3169-49c5-bb3c-154fd49d7e2b tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:58:01.763055 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-bbfd6f55-3169-49c5-bb3c-154fd49d7e2b tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] [instance: 368d4aa4-81a1-43af-a69b-e5f7004da740] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:58:01.788885 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bbfd6f55-3169-49c5-bb3c-154fd49d7e2b tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:01.791599 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bbfd6f55-3169-49c5-bb3c-154fd49d7e2b tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:01.795685 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bbfd6f55-3169-49c5-bb3c-154fd49d7e2b tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:01.801701 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bbfd6f55-3169-49c5-bb3c-154fd49d7e2b tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:01.803605 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bbfd6f55-3169-49c5-bb3c-154fd49d7e2b tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:01.804074 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bbfd6f55-3169-49c5-bb3c-154fd49d7e2b tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:02.481702 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f237da52-2253-4141-aefc-510aaf2e05ca tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034056e41cbe4111ba8fcd5e48273007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1e31ed067d4e85aab983e532ab399c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:58:02.501601 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f237da52-2253-4141-aefc-510aaf2e05ca tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] 10.222.0.33 "GET /compute/v2.1/servers/e32774eb-128e-499d-b15e-f93f4c57d9e0" status: 200 len: 1229 microversion: 2.1 time: 0.840806 Oct 04 20:58:02.504862 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2324/4691] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:58:01 2022] GET /compute/v2.1/servers/e32774eb-128e-499d-b15e-f93f4c57d9e0 => generated 1229 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:58:02.756874 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-bbfd6f55-3169-49c5-bb3c-154fd49d7e2b tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6513f5e908ac4d028cad6eeeebeab285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65946afc398d4a9fb1c9095a4f946e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:58:02.769018 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-bbfd6f55-3169-49c5-bb3c-154fd49d7e2b tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "GET /compute/v2.1/servers/368d4aa4-81a1-43af-a69b-e5f7004da740" status: 200 len: 1511 microversion: 2.1 time: 1.010764 Oct 04 20:58:02.769741 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2368/4692] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:58:01 2022] GET /compute/v2.1/servers/368d4aa4-81a1-43af-a69b-e5f7004da740 => generated 1511 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:58:03.531361 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5f621bc0-1cc0-446f-b6bb-4a558ed96c21 tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:58:03.532368 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-5f621bc0-1cc0-446f-b6bb-4a558ed96c21 tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] [instance: e32774eb-128e-499d-b15e-f93f4c57d9e0] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:58:03.546308 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5f621bc0-1cc0-446f-b6bb-4a558ed96c21 tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:03.549354 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5f621bc0-1cc0-446f-b6bb-4a558ed96c21 tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:03.550884 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5f621bc0-1cc0-446f-b6bb-4a558ed96c21 tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:03.553046 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5f621bc0-1cc0-446f-b6bb-4a558ed96c21 tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:03.554097 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5f621bc0-1cc0-446f-b6bb-4a558ed96c21 tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:03.555701 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5f621bc0-1cc0-446f-b6bb-4a558ed96c21 tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:03.801808 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-2d31cac3-3be5-47f0-9667-7734befcf229 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:58:03.805948 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-2d31cac3-3be5-47f0-9667-7734befcf229 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] [instance: 368d4aa4-81a1-43af-a69b-e5f7004da740] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:58:03.824707 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2d31cac3-3be5-47f0-9667-7734befcf229 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:03.842864 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2d31cac3-3be5-47f0-9667-7734befcf229 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:03.843726 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2d31cac3-3be5-47f0-9667-7734befcf229 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:03.848640 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2d31cac3-3be5-47f0-9667-7734befcf229 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:03.849298 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2d31cac3-3be5-47f0-9667-7734befcf229 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:03.850946 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2d31cac3-3be5-47f0-9667-7734befcf229 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:03.853410 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-5f621bc0-1cc0-446f-b6bb-4a558ed96c21 tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034056e41cbe4111ba8fcd5e48273007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1e31ed067d4e85aab983e532ab399c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:58:03.869692 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5f621bc0-1cc0-446f-b6bb-4a558ed96c21 tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] 10.222.0.33 "GET /compute/v2.1/servers/e32774eb-128e-499d-b15e-f93f4c57d9e0" status: 200 len: 1283 microversion: 2.1 time: 0.345448 Oct 04 20:58:03.886224 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2325/4693] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:58:03 2022] GET /compute/v2.1/servers/e32774eb-128e-499d-b15e-f93f4c57d9e0 => generated 1283 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:58:04.467534 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-2d31cac3-3be5-47f0-9667-7734befcf229 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6513f5e908ac4d028cad6eeeebeab285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65946afc398d4a9fb1c9095a4f946e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:58:04.494928 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-2d31cac3-3be5-47f0-9667-7734befcf229 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "GET /compute/v2.1/servers/368d4aa4-81a1-43af-a69b-e5f7004da740" status: 200 len: 1511 microversion: 2.1 time: 0.702865 Oct 04 20:58:04.498666 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2369/4694] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:58:03 2022] GET /compute/v2.1/servers/368d4aa4-81a1-43af-a69b-e5f7004da740 => generated 1511 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:58:04.900524 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-df7f1498-f680-44fa-a67a-a3a53d7ccc06 tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:58:04.901842 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-df7f1498-f680-44fa-a67a-a3a53d7ccc06 tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] [instance: e32774eb-128e-499d-b15e-f93f4c57d9e0] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:58:04.937399 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-df7f1498-f680-44fa-a67a-a3a53d7ccc06 tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:04.940325 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-df7f1498-f680-44fa-a67a-a3a53d7ccc06 tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:04.940886 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-df7f1498-f680-44fa-a67a-a3a53d7ccc06 tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:04.941659 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-df7f1498-f680-44fa-a67a-a3a53d7ccc06 tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:04.942452 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-df7f1498-f680-44fa-a67a-a3a53d7ccc06 tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:04.944289 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-df7f1498-f680-44fa-a67a-a3a53d7ccc06 tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:05.268875 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-df7f1498-f680-44fa-a67a-a3a53d7ccc06 tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034056e41cbe4111ba8fcd5e48273007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1e31ed067d4e85aab983e532ab399c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:58:05.298573 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-df7f1498-f680-44fa-a67a-a3a53d7ccc06 tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] 10.222.0.33 "GET /compute/v2.1/servers/e32774eb-128e-499d-b15e-f93f4c57d9e0" status: 200 len: 1283 microversion: 2.1 time: 0.403430 Oct 04 20:58:05.313166 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2326/4695] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:58:04 2022] GET /compute/v2.1/servers/e32774eb-128e-499d-b15e-f93f4c57d9e0 => generated 1283 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:58:05.523874 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-8662965f-2e1d-43a0-b314-bb86e4c0e081 req-11a6dcab-4785-4167-a55b-f9ce26f4bdf7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "368d4aa4-81a1-43af-a69b-e5f7004da740", "name": "network-vif-deleted", "tag": "6e0c1b74-365c-4334-a0cd-a002a31e38fa"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:58:05.525607 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d6334992-4347-4088-99a2-a4d187cd1204 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:58:05.527866 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d6334992-4347-4088-99a2-a4d187cd1204 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] [instance: 368d4aa4-81a1-43af-a69b-e5f7004da740] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:58:05.548712 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d6334992-4347-4088-99a2-a4d187cd1204 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:05.549219 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d6334992-4347-4088-99a2-a4d187cd1204 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:05.554457 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d6334992-4347-4088-99a2-a4d187cd1204 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:05.560204 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d6334992-4347-4088-99a2-a4d187cd1204 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:05.563297 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d6334992-4347-4088-99a2-a4d187cd1204 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:05.565116 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d6334992-4347-4088-99a2-a4d187cd1204 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:05.569908 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-8662965f-2e1d-43a0-b314-bb86e4c0e081 req-11a6dcab-4785-4167-a55b-f9ce26f4bdf7 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:05.570447 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-8662965f-2e1d-43a0-b314-bb86e4c0e081 req-11a6dcab-4785-4167-a55b-f9ce26f4bdf7 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:05.576189 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-8662965f-2e1d-43a0-b314-bb86e4c0e081 req-11a6dcab-4785-4167-a55b-f9ce26f4bdf7 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:05.626165 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-8662965f-2e1d-43a0-b314-bb86e4c0e081 req-11a6dcab-4785-4167-a55b-f9ce26f4bdf7 service nova] Creating event network-vif-deleted:6e0c1b74-365c-4334-a0cd-a002a31e38fa for instance 368d4aa4-81a1-43af-a69b-e5f7004da740 on n-h1-854823-8 Oct 04 20:58:05.640759 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-8662965f-2e1d-43a0-b314-bb86e4c0e081 req-11a6dcab-4785-4167-a55b-f9ce26f4bdf7 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127400 Oct 04 20:58:05.654472 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2370/4696] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:58:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 20:58:06.329107 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-26a02158-c632-4390-b335-4c62c2ee03ff tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:58:06.329824 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-26a02158-c632-4390-b335-4c62c2ee03ff tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] [instance: e32774eb-128e-499d-b15e-f93f4c57d9e0] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:58:06.362874 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-26a02158-c632-4390-b335-4c62c2ee03ff tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:06.366353 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-26a02158-c632-4390-b335-4c62c2ee03ff tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:06.368797 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-26a02158-c632-4390-b335-4c62c2ee03ff tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:06.372650 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-26a02158-c632-4390-b335-4c62c2ee03ff tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:06.375014 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-26a02158-c632-4390-b335-4c62c2ee03ff tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:06.382252 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-26a02158-c632-4390-b335-4c62c2ee03ff tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:06.617392 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d6334992-4347-4088-99a2-a4d187cd1204 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6513f5e908ac4d028cad6eeeebeab285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65946afc398d4a9fb1c9095a4f946e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:58:06.632729 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d6334992-4347-4088-99a2-a4d187cd1204 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "GET /compute/v2.1/servers/368d4aa4-81a1-43af-a69b-e5f7004da740" status: 200 len: 1301 microversion: 2.1 time: 1.115413 Oct 04 20:58:06.639345 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2327/4697] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:58:05 2022] GET /compute/v2.1/servers/368d4aa4-81a1-43af-a69b-e5f7004da740 => generated 1301 bytes in 1123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:58:06.689676 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-26a02158-c632-4390-b335-4c62c2ee03ff tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034056e41cbe4111ba8fcd5e48273007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1e31ed067d4e85aab983e532ab399c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:58:06.708396 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-26a02158-c632-4390-b335-4c62c2ee03ff tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] 10.222.0.33 "GET /compute/v2.1/servers/e32774eb-128e-499d-b15e-f93f4c57d9e0" status: 200 len: 1283 microversion: 2.1 time: 0.383130 Oct 04 20:58:06.715113 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2371/4698] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:58:06 2022] GET /compute/v2.1/servers/e32774eb-128e-499d-b15e-f93f4c57d9e0 => generated 1283 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:58:07.666886 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-57d1c6fe-e06a-42c3-ae01-e5cd842f3152 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:58:07.668529 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-57d1c6fe-e06a-42c3-ae01-e5cd842f3152 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] [instance: 368d4aa4-81a1-43af-a69b-e5f7004da740] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:58:07.681721 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-57d1c6fe-e06a-42c3-ae01-e5cd842f3152 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:07.686879 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-57d1c6fe-e06a-42c3-ae01-e5cd842f3152 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:07.688716 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-57d1c6fe-e06a-42c3-ae01-e5cd842f3152 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:07.690184 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-57d1c6fe-e06a-42c3-ae01-e5cd842f3152 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:07.693174 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-57d1c6fe-e06a-42c3-ae01-e5cd842f3152 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:07.693988 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-57d1c6fe-e06a-42c3-ae01-e5cd842f3152 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:07.727725 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-57d1c6fe-e06a-42c3-ae01-e5cd842f3152 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] HTTP exception thrown: Instance 368d4aa4-81a1-43af-a69b-e5f7004da740 could not be found. Oct 04 20:58:07.743048 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-376a50bc-284c-4dd8-b3b4-a79b54b38f1e tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:58:07.744548 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-376a50bc-284c-4dd8-b3b4-a79b54b38f1e tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] [instance: e32774eb-128e-499d-b15e-f93f4c57d9e0] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:58:07.749095 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-57d1c6fe-e06a-42c3-ae01-e5cd842f3152 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Request method failure captured: Oct 04 20:58:07.749095 n-d-854823-8 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/368d4aa4-81a1-43af-a69b-e5f7004da740 HTTP/1.1 Oct 04 20:58:07.749095 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:58:07.749095 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:58:07.749095 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:58:07.749095 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 0 Oct 04 20:58:07.749095 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:58:07.749095 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:58:07.749095 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:58:07.749095 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:58:07.749095 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJ4eaBM_FLl2jaN3nQraRbM94DgE-qlLjkCPNJ1Ol7VvkbIGIp-m_lAuwAay2VJ7lXD5niLtaDpJGDoHOJTljuI2aLuReHvX6jQr-uTgC01ZM2s7p6j6gq6a-1PaGQN0mcmcJntCqSnEEt5MEM6DdrOOdi5eEtsfyNU4EpDYmca-Ylo Oct 04 20:58:07.749095 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:58:07.749095 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:58:07.749095 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:58:07.749095 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:58:07.749095 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:58:07.749095 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:58:07.749095 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: 65946afc398d4a9fb1c9095a4f946e07 Oct 04 20:58:07.749095 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-ServersNegativeTestJSON-1097186397 Oct 04 20:58:07.749095 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 20:58:07.749095 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 20:58:07.749095 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_65946afc398d4a9fb1c9095a4f946e07", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/65946afc398d4a9fb1c9095a4f946e07"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/65946afc398d4a9fb1c9095a4f946e07"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/65946afc398d4a9fb1c9095a4f946e07"}]}] Oct 04 20:58:07.749095 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-ServersNegativeTestJSON-1097186397 Oct 04 20:58:07.749095 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: 65946afc398d4a9fb1c9095a4f946e07 Oct 04 20:58:07.749095 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1097186397 Oct 04 20:58:07.749095 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-ServersNegativeTestJSON-1097186397-project Oct 04 20:58:07.749095 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:58:07.749095 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:58:07.749095 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: 6513f5e908ac4d028cad6eeeebeab285 Oct 04 20:58:07.749095 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-ServersNegativeTestJSON-1097186397-project Oct 04 20:58:07.749095 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 20:58:07.749095 n-d-854823-8 devstack@n-api.service[128801]: exception: Instance 368d4aa4-81a1-43af-a69b-e5f7004da740 could not be found. Oct 04 20:58:07.749095 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': '368d4aa4-81a1-43af-a69b-e5f7004da740'} Oct 04 20:58:07.749095 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:58:07.749095 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:58:07.749095 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:58:07.749095 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:58:07.749095 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:58:07.749095 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:58:07.749095 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:58:07.749095 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:58:07.749095 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:58:07.749095 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:58:07.749095 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 368d4aa4-81a1-43af-a69b-e5f7004da740 could not be found. Oct 04 20:58:07.749095 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:58:07.749095 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:58:07.749095 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:58:07.749095 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:58:07.749095 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:58:07.749095 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:58:07.749095 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:58:07.749095 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:58:07.749095 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:58:07.749095 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:58:07.749095 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:58:07.749095 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:58:07.749095 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:58:07.749095 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:58:07.749095 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:58:07.749095 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:58:07.749095 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 368d4aa4-81a1-43af-a69b-e5f7004da740 could not be found. Oct 04 20:58:07.749095 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:58:07.749095 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:58:07.749095 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:58:07.753946 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:58:07.753946 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:58:07.753946 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:58:07.753946 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:58:07.753946 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:58:07.753946 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 368d4aa4-81a1-43af-a69b-e5f7004da740 could not be found. Oct 04 20:58:07.753946 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:58:07.761501 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-57d1c6fe-e06a-42c3-ae01-e5cd842f3152 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Returning 404 to user: Instance 368d4aa4-81a1-43af-a69b-e5f7004da740 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:58:07.764659 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-376a50bc-284c-4dd8-b3b4-a79b54b38f1e tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:07.767688 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-57d1c6fe-e06a-42c3-ae01-e5cd842f3152 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "GET /compute/v2.1/servers/368d4aa4-81a1-43af-a69b-e5f7004da740" status: 404 len: 111 microversion: 2.1 time: 0.103441 Oct 04 20:58:07.770650 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2328/4699] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:58:07 2022] GET /compute/v2.1/servers/368d4aa4-81a1-43af-a69b-e5f7004da740 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 20:58:07.771710 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-376a50bc-284c-4dd8-b3b4-a79b54b38f1e tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:07.772385 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-376a50bc-284c-4dd8-b3b4-a79b54b38f1e tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:07.775180 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-376a50bc-284c-4dd8-b3b4-a79b54b38f1e tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:07.778973 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-376a50bc-284c-4dd8-b3b4-a79b54b38f1e tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:07.780604 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-376a50bc-284c-4dd8-b3b4-a79b54b38f1e tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:07.782538 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0ddde009-301d-4585-85aa-294efe8f8076 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:58:07.791788 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-0ddde009-301d-4585-85aa-294efe8f8076 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] [instance: 320f9a98-969f-473e-bc56-842bbd28dedc] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:58:07.814075 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0ddde009-301d-4585-85aa-294efe8f8076 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:07.815091 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0ddde009-301d-4585-85aa-294efe8f8076 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:07.815730 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0ddde009-301d-4585-85aa-294efe8f8076 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:07.816668 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0ddde009-301d-4585-85aa-294efe8f8076 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:07.817926 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0ddde009-301d-4585-85aa-294efe8f8076 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:07.818563 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0ddde009-301d-4585-85aa-294efe8f8076 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:08.300283 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-376a50bc-284c-4dd8-b3b4-a79b54b38f1e tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034056e41cbe4111ba8fcd5e48273007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1e31ed067d4e85aab983e532ab399c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:58:08.311697 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-376a50bc-284c-4dd8-b3b4-a79b54b38f1e tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] 10.222.0.33 "GET /compute/v2.1/servers/e32774eb-128e-499d-b15e-f93f4c57d9e0" status: 200 len: 1325 microversion: 2.1 time: 0.573829 Oct 04 20:58:08.313481 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2372/4700] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:58:07 2022] GET /compute/v2.1/servers/e32774eb-128e-499d-b15e-f93f4c57d9e0 => generated 1325 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:58:08.494935 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-0ddde009-301d-4585-85aa-294efe8f8076 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6513f5e908ac4d028cad6eeeebeab285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65946afc398d4a9fb1c9095a4f946e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:58:08.509626 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-0ddde009-301d-4585-85aa-294efe8f8076 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc" status: 200 len: 1505 microversion: 2.1 time: 0.733062 Oct 04 20:58:08.510586 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2329/4701] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:58:07 2022] GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc => generated 1505 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:58:08.923766 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-c6e4a4c8-ad6c-41cb-8fed-6a191eb63ed5 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Action: 'create', calling method: >, body: {"server": {"name": 12345, "imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63", "flavorRef": "452", "networks": [{"uuid": "780a66b6-435f-46df-9c7b-6f763e190356"}]}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:58:08.939683 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-c6e4a4c8-ad6c-41cb-8fed-6a191eb63ed5 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Request method failure captured: Oct 04 20:58:08.939683 n-d-854823-8 devstack@n-api.service[128802]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 20:58:08.939683 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 20:58:08.939683 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 20:58:08.939683 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 20:58:08.939683 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 163 Oct 04 20:58:08.939683 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 20:58:08.939683 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 20:58:08.939683 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 20:58:08.939683 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 20:58:08.939683 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPJ4eaBM_FLl2jaN3nQraRbM94DgE-qlLjkCPNJ1Ol7VvkbIGIp-m_lAuwAay2VJ7lXD5niLtaDpJGDoHOJTljuI2aLuReHvX6jQr-uTgC01ZM2s7p6j6gq6a-1PaGQN0mcmcJntCqSnEEt5MEM6DdrOOdi5eEtsfyNU4EpDYmca-Ylo Oct 04 20:58:08.939683 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 20:58:08.939683 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 20:58:08.939683 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 20:58:08.939683 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 20:58:08.939683 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 20:58:08.939683 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 20:58:08.939683 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: 65946afc398d4a9fb1c9095a4f946e07 Oct 04 20:58:08.939683 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-ServersNegativeTestJSON-1097186397 Oct 04 20:58:08.939683 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 20:58:08.939683 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 20:58:08.939683 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_65946afc398d4a9fb1c9095a4f946e07", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/65946afc398d4a9fb1c9095a4f946e07"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/65946afc398d4a9fb1c9095a4f946e07"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/65946afc398d4a9fb1c9095a4f946e07"}]}] Oct 04 20:58:08.939683 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-ServersNegativeTestJSON-1097186397 Oct 04 20:58:08.939683 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: 65946afc398d4a9fb1c9095a4f946e07 Oct 04 20:58:08.939683 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1097186397 Oct 04 20:58:08.939683 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-ServersNegativeTestJSON-1097186397-project Oct 04 20:58:08.939683 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 20:58:08.939683 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 20:58:08.939683 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: 6513f5e908ac4d028cad6eeeebeab285 Oct 04 20:58:08.939683 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-ServersNegativeTestJSON-1097186397-project Oct 04 20:58:08.939683 n-d-854823-8 devstack@n-api.service[128802]: Oct 04 20:58:08.939683 n-d-854823-8 devstack@n-api.service[128802]: {"server": {"name": 12345, "imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63", "flavorRef": "452", "networks": [{"uuid": "780a66b6-435f-46df-9c7b-6f763e190356"}]}} Oct 04 20:58:08.939683 n-d-854823-8 devstack@n-api.service[128802]: method: > Oct 04 20:58:08.939683 n-d-854823-8 devstack@n-api.service[128802]: exception: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Oct 04 20:58:08.939683 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'body': {'server': {'name': 12345, 'imageRef': '15b24725-0c99-4bcf-b1fb-907cdf8e2d63', 'flavorRef': '452', 'networks': [{'uuid': '780a66b6-435f-46df-9c7b-6f763e190356'}]}}} Oct 04 20:58:08.939683 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:58:08.939683 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:58:08.939683 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 20:58:08.939683 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 20:58:08.939683 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 20:58:08.939683 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise error Oct 04 20:58:08.939683 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 12345 is not of type 'string' Oct 04 20:58:08.939683 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:58:08.939683 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['name']: Oct 04 20:58:08.939683 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 04 20:58:08.939683 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:58:08.939683 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 04 20:58:08.939683 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi 12345 Oct 04 20:58:08.939683 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:58:08.939683 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:58:08.939683 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:58:08.939683 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:58:08.939683 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:58:08.939683 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:58:08.939683 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:58:08.939683 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:58:08.939683 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:58:08.939683 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:58:08.939683 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:58:08.939683 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:58:08.939683 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 20:58:08.939683 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 20:58:08.939683 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 20:58:08.939683 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 20:58:08.939683 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 20:58:08.946062 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 20:58:08.946062 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Oct 04 20:58:08.946062 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:58:08.946062 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:58:08.946062 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:58:08.946062 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:58:08.946062 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:58:08.946062 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:58:08.946062 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 20:58:08.946062 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 20:58:08.946062 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Oct 04 20:58:08.946062 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:58:08.946062 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-c6e4a4c8-ad6c-41cb-8fed-6a191eb63ed5 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Returning 400 to user: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:58:08.946062 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-c6e4a4c8-ad6c-41cb-8fed-6a191eb63ed5 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 400 len: 127 microversion: 2.1 time: 0.028361 Oct 04 20:58:08.952806 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2373/4702] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 20:58:08 2022] POST /compute/v2.1/servers => generated 127 bytes in 35 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 20:58:08.962089 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-03f53d36-07ea-4317-83d0-4feb2e915059 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:58:08.963338 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-03f53d36-07ea-4317-83d0-4feb2e915059 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] [instance: 320f9a98-969f-473e-bc56-842bbd28dedc] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:58:08.992228 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-03f53d36-07ea-4317-83d0-4feb2e915059 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:08.996501 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-03f53d36-07ea-4317-83d0-4feb2e915059 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:08.997345 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-03f53d36-07ea-4317-83d0-4feb2e915059 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:08.998749 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-03f53d36-07ea-4317-83d0-4feb2e915059 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:08.999639 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-03f53d36-07ea-4317-83d0-4feb2e915059 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:09.000464 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-03f53d36-07ea-4317-83d0-4feb2e915059 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:09.349404 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-116d74e4-b3a4-4580-8aa1-112abb722df6 tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:58:09.350377 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-116d74e4-b3a4-4580-8aa1-112abb722df6 tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] [instance: e32774eb-128e-499d-b15e-f93f4c57d9e0] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:58:09.380240 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-116d74e4-b3a4-4580-8aa1-112abb722df6 tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:09.381677 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-116d74e4-b3a4-4580-8aa1-112abb722df6 tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:09.385021 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-116d74e4-b3a4-4580-8aa1-112abb722df6 tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:09.388415 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-116d74e4-b3a4-4580-8aa1-112abb722df6 tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:09.391756 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-116d74e4-b3a4-4580-8aa1-112abb722df6 tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:09.392596 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-116d74e4-b3a4-4580-8aa1-112abb722df6 tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:10.222518 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:58:10.444960 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-03f53d36-07ea-4317-83d0-4feb2e915059 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6513f5e908ac4d028cad6eeeebeab285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65946afc398d4a9fb1c9095a4f946e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:58:10.485930 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-03f53d36-07ea-4317-83d0-4feb2e915059 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc" status: 200 len: 1505 microversion: 2.1 time: 1.530498 Oct 04 20:58:10.534773 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2330/4703] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:58:08 2022] GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc => generated 1505 bytes in 1581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:58:10.618968 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=8 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:58:10.668188 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-116d74e4-b3a4-4580-8aa1-112abb722df6 tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034056e41cbe4111ba8fcd5e48273007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1e31ed067d4e85aab983e532ab399c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:58:10.694098 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-116d74e4-b3a4-4580-8aa1-112abb722df6 tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] 10.222.0.33 "GET /compute/v2.1/servers/e32774eb-128e-499d-b15e-f93f4c57d9e0" status: 200 len: 1325 microversion: 2.1 time: 1.359495 Oct 04 20:58:10.716175 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2374/4704] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:58:09 2022] GET /compute/v2.1/servers/e32774eb-128e-499d-b15e-f93f4c57d9e0 => generated 1325 bytes in 1384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:58:10.721835 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-52032c40-26c0-4700-a0d7-bb41b1f3d481 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:58:10.722720 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-52032c40-26c0-4700-a0d7-bb41b1f3d481 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] [instance: 320f9a98-969f-473e-bc56-842bbd28dedc] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:58:10.742716 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-52032c40-26c0-4700-a0d7-bb41b1f3d481 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:10.743272 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-52032c40-26c0-4700-a0d7-bb41b1f3d481 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:10.743819 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-52032c40-26c0-4700-a0d7-bb41b1f3d481 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:10.744740 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-52032c40-26c0-4700-a0d7-bb41b1f3d481 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:10.745215 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-52032c40-26c0-4700-a0d7-bb41b1f3d481 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:10.745725 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-52032c40-26c0-4700-a0d7-bb41b1f3d481 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:11.183160 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c530ab00-cb30-49d5-929c-4a6a23637142 tempest-MultipleCreateNegativeTestJSON-1641667700 tempest-MultipleCreateNegativeTestJSON-1641667700-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1315047466", "imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63", "flavorRef": "452", "min_count": 3, "max_count": 2}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:58:11.192016 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-c530ab00-cb30-49d5-929c-4a6a23637142 tempest-MultipleCreateNegativeTestJSON-1641667700 tempest-MultipleCreateNegativeTestJSON-1641667700-project] HTTP exception thrown: min_count must be <= max_count Oct 04 20:58:11.203443 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c530ab00-cb30-49d5-929c-4a6a23637142 tempest-MultipleCreateNegativeTestJSON-1641667700 tempest-MultipleCreateNegativeTestJSON-1641667700-project] Request method failure captured: Oct 04 20:58:11.203443 n-d-854823-8 devstack@n-api.service[128801]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 20:58:11.203443 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:58:11.203443 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:58:11.203443 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:58:11.203443 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 184 Oct 04 20:58:11.203443 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:58:11.203443 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:58:11.203443 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:58:11.203443 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:58:11.203443 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJ5hlJ5JfCqLx5K2rHlTRjYMocRWJVtAVDtWiE-q3MBz9JFwjpXsILgG8s-jaiMJ743S9Zj9N-VzfOn3lJ1q5h196CLOmuHubUcPiKwnt8Cfsi1V8ZQ0p2kBkDFZ9ccHJBZ5SW3IsINJbGrBCiaa4MxbO5YEKsl4p-3Zaurv9TMRTMU Oct 04 20:58:11.203443 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:58:11.203443 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:58:11.203443 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:58:11.203443 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:58:11.203443 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:58:11.203443 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:58:11.203443 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: b2ef058053274b9498007a3f4f0fecb4 Oct 04 20:58:11.203443 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1641667700 Oct 04 20:58:11.203443 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 20:58:11.203443 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 20:58:11.203443 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b2ef058053274b9498007a3f4f0fecb4", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b2ef058053274b9498007a3f4f0fecb4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b2ef058053274b9498007a3f4f0fecb4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b2ef058053274b9498007a3f4f0fecb4"}]}] Oct 04 20:58:11.203443 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1641667700 Oct 04 20:58:11.203443 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: b2ef058053274b9498007a3f4f0fecb4 Oct 04 20:58:11.203443 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1641667700 Oct 04 20:58:11.203443 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-MultipleCreateNegativeTestJSON-1641667700-project Oct 04 20:58:11.203443 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:58:11.203443 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:58:11.203443 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: 1d73356630b74e7cab4ccf407efcd67d Oct 04 20:58:11.203443 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1641667700-project Oct 04 20:58:11.203443 n-d-854823-8 devstack@n-api.service[128801]: Oct 04 20:58:11.203443 n-d-854823-8 devstack@n-api.service[128801]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1315047466", "imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63", "flavorRef": "452", "min_count": 3, "max_count": 2}} Oct 04 20:58:11.203443 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 20:58:11.203443 n-d-854823-8 devstack@n-api.service[128801]: exception: min_count must be <= max_count Oct 04 20:58:11.203443 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1315047466', 'imageRef': '15b24725-0c99-4bcf-b1fb-907cdf8e2d63', 'flavorRef': '452', 'min_count': 3, 'max_count': 2}}} Oct 04 20:58:11.203443 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:58:11.203443 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:58:11.203443 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:58:11.203443 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:58:11.203443 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:58:11.203443 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:58:11.203443 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:58:11.203443 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:58:11.203443 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:58:11.203443 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:58:11.203443 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:58:11.203443 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:58:11.203443 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:58:11.203443 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:58:11.203443 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 20:58:11.203443 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 726, in create Oct 04 20:58:11.203443 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 04 20:58:11.203443 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: min_count must be <= max_count Oct 04 20:58:11.203443 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:58:11.203443 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:58:11.203443 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:58:11.203443 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:58:11.203443 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:58:11.203443 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:58:11.203443 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:58:11.203443 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:58:11.203443 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: min_count must be <= max_count Oct 04 20:58:11.203443 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:58:11.209453 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c530ab00-cb30-49d5-929c-4a6a23637142 tempest-MultipleCreateNegativeTestJSON-1641667700 tempest-MultipleCreateNegativeTestJSON-1641667700-project] Returning 400 to user: min_count must be <= max_count {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:58:11.210718 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c530ab00-cb30-49d5-929c-4a6a23637142 tempest-MultipleCreateNegativeTestJSON-1641667700 tempest-MultipleCreateNegativeTestJSON-1641667700-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 400 len: 74 microversion: 2.1 time: 0.671971 Oct 04 20:58:11.227790 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2331/4705] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 20:58:10 2022] POST /compute/v2.1/servers => generated 74 bytes in 692 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 04 20:58:11.237821 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-2e3326e3-4b47-45fe-8406-ed1c21ff09ab req-db91a70c-5c9e-4ba6-884e-bc63a18aca0f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e32774eb-128e-499d-b15e-f93f4c57d9e0", "tag": "dc501e3b-439f-430e-a019-e7dca5fff08f"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:58:11.345285 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-2e3326e3-4b47-45fe-8406-ed1c21ff09ab req-db91a70c-5c9e-4ba6-884e-bc63a18aca0f service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:11.345759 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-2e3326e3-4b47-45fe-8406-ed1c21ff09ab req-db91a70c-5c9e-4ba6-884e-bc63a18aca0f service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:11.346215 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-2e3326e3-4b47-45fe-8406-ed1c21ff09ab req-db91a70c-5c9e-4ba6-884e-bc63a18aca0f service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:11.378031 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-2e3326e3-4b47-45fe-8406-ed1c21ff09ab req-db91a70c-5c9e-4ba6-884e-bc63a18aca0f service nova] Creating event network-changed:dc501e3b-439f-430e-a019-e7dca5fff08f for instance e32774eb-128e-499d-b15e-f93f4c57d9e0 on n-h2-854823-8 Oct 04 20:58:11.400444 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-2e3326e3-4b47-45fe-8406-ed1c21ff09ab req-db91a70c-5c9e-4ba6-884e-bc63a18aca0f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.169595 Oct 04 20:58:11.401128 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2332/4706] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:58:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:58:11.423282 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a733c458-d21c-436b-a8b7-aacf613114b9 tempest-MultipleCreateNegativeTestJSON-1641667700 tempest-MultipleCreateNegativeTestJSON-1641667700-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1203366573", "imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63", "flavorRef": "452", "max_count": 0}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:58:11.439887 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a733c458-d21c-436b-a8b7-aacf613114b9 tempest-MultipleCreateNegativeTestJSON-1641667700 tempest-MultipleCreateNegativeTestJSON-1641667700-project] Request method failure captured: Oct 04 20:58:11.439887 n-d-854823-8 devstack@n-api.service[128801]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 20:58:11.439887 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:58:11.439887 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:58:11.439887 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:58:11.439887 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 168 Oct 04 20:58:11.439887 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:58:11.439887 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:58:11.439887 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:58:11.439887 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:58:11.439887 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJ5hlJ5JfCqLx5K2rHlTRjYMocRWJVtAVDtWiE-q3MBz9JFwjpXsILgG8s-jaiMJ743S9Zj9N-VzfOn3lJ1q5h196CLOmuHubUcPiKwnt8Cfsi1V8ZQ0p2kBkDFZ9ccHJBZ5SW3IsINJbGrBCiaa4MxbO5YEKsl4p-3Zaurv9TMRTMU Oct 04 20:58:11.439887 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:58:11.439887 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:58:11.439887 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:58:11.439887 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:58:11.439887 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:58:11.439887 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:58:11.439887 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: b2ef058053274b9498007a3f4f0fecb4 Oct 04 20:58:11.439887 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1641667700 Oct 04 20:58:11.439887 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 20:58:11.439887 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 20:58:11.439887 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b2ef058053274b9498007a3f4f0fecb4", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b2ef058053274b9498007a3f4f0fecb4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b2ef058053274b9498007a3f4f0fecb4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b2ef058053274b9498007a3f4f0fecb4"}]}] Oct 04 20:58:11.439887 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1641667700 Oct 04 20:58:11.439887 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: b2ef058053274b9498007a3f4f0fecb4 Oct 04 20:58:11.439887 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1641667700 Oct 04 20:58:11.439887 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-MultipleCreateNegativeTestJSON-1641667700-project Oct 04 20:58:11.439887 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:58:11.439887 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:58:11.439887 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: 1d73356630b74e7cab4ccf407efcd67d Oct 04 20:58:11.439887 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1641667700-project Oct 04 20:58:11.439887 n-d-854823-8 devstack@n-api.service[128801]: Oct 04 20:58:11.439887 n-d-854823-8 devstack@n-api.service[128801]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1203366573", "imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63", "flavorRef": "452", "max_count": 0}} Oct 04 20:58:11.439887 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 20:58:11.439887 n-d-854823-8 devstack@n-api.service[128801]: exception: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Oct 04 20:58:11.439887 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1203366573', 'imageRef': '15b24725-0c99-4bcf-b1fb-907cdf8e2d63', 'flavorRef': '452', 'max_count': 0}}} Oct 04 20:58:11.439887 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:58:11.439887 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:58:11.439887 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 20:58:11.439887 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 20:58:11.439887 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 20:58:11.439887 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise error Oct 04 20:58:11.439887 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 04 20:58:11.439887 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:58:11.439887 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['max_count']: Oct 04 20:58:11.439887 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 04 20:58:11.439887 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 04 20:58:11.439887 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 04 20:58:11.439887 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 04 20:58:11.439887 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:58:11.439887 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 04 20:58:11.439887 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi 0 Oct 04 20:58:11.439887 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:58:11.439887 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:58:11.439887 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:58:11.439887 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:58:11.439887 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:58:11.439887 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:58:11.439887 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:58:11.439887 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:58:11.439887 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:58:11.439887 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:58:11.439887 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:58:11.439887 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:58:11.439887 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 20:58:11.439887 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 20:58:11.447943 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 20:58:11.447943 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 20:58:11.447943 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 20:58:11.447943 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 20:58:11.447943 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Oct 04 20:58:11.447943 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:58:11.447943 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:58:11.447943 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:58:11.447943 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:58:11.447943 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:58:11.447943 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:58:11.447943 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 20:58:11.447943 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 20:58:11.447943 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Oct 04 20:58:11.447943 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:58:11.463894 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a733c458-d21c-436b-a8b7-aacf613114b9 tempest-MultipleCreateNegativeTestJSON-1641667700 tempest-MultipleCreateNegativeTestJSON-1641667700-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:58:11.465549 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a733c458-d21c-436b-a8b7-aacf613114b9 tempest-MultipleCreateNegativeTestJSON-1641667700 tempest-MultipleCreateNegativeTestJSON-1641667700-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.061947 Oct 04 20:58:11.466935 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2333/4707] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 20:58:11 2022] POST /compute/v2.1/servers => generated 130 bytes in 65 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 20:58:11.549551 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2fdf07ee-97ab-4629-b1f1-95297b74bbd1 tempest-MultipleCreateNegativeTestJSON-1641667700 tempest-MultipleCreateNegativeTestJSON-1641667700-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1591167267", "imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63", "flavorRef": "452", "max_count": 2.5}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:58:11.558498 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2fdf07ee-97ab-4629-b1f1-95297b74bbd1 tempest-MultipleCreateNegativeTestJSON-1641667700 tempest-MultipleCreateNegativeTestJSON-1641667700-project] Request method failure captured: Oct 04 20:58:11.558498 n-d-854823-8 devstack@n-api.service[128801]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 20:58:11.558498 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:58:11.558498 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:58:11.558498 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:58:11.558498 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 170 Oct 04 20:58:11.558498 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:58:11.558498 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:58:11.558498 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:58:11.558498 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:58:11.558498 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJ5hlJ5JfCqLx5K2rHlTRjYMocRWJVtAVDtWiE-q3MBz9JFwjpXsILgG8s-jaiMJ743S9Zj9N-VzfOn3lJ1q5h196CLOmuHubUcPiKwnt8Cfsi1V8ZQ0p2kBkDFZ9ccHJBZ5SW3IsINJbGrBCiaa4MxbO5YEKsl4p-3Zaurv9TMRTMU Oct 04 20:58:11.558498 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:58:11.558498 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:58:11.558498 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:58:11.558498 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:58:11.558498 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:58:11.558498 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:58:11.558498 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: b2ef058053274b9498007a3f4f0fecb4 Oct 04 20:58:11.558498 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1641667700 Oct 04 20:58:11.558498 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 20:58:11.558498 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 20:58:11.558498 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b2ef058053274b9498007a3f4f0fecb4", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b2ef058053274b9498007a3f4f0fecb4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b2ef058053274b9498007a3f4f0fecb4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b2ef058053274b9498007a3f4f0fecb4"}]}] Oct 04 20:58:11.558498 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1641667700 Oct 04 20:58:11.558498 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: b2ef058053274b9498007a3f4f0fecb4 Oct 04 20:58:11.558498 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1641667700 Oct 04 20:58:11.558498 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-MultipleCreateNegativeTestJSON-1641667700-project Oct 04 20:58:11.558498 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:58:11.558498 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:58:11.558498 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: 1d73356630b74e7cab4ccf407efcd67d Oct 04 20:58:11.558498 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1641667700-project Oct 04 20:58:11.558498 n-d-854823-8 devstack@n-api.service[128801]: Oct 04 20:58:11.558498 n-d-854823-8 devstack@n-api.service[128801]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1591167267", "imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63", "flavorRef": "452", "max_count": 2.5}} Oct 04 20:58:11.558498 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 20:58:11.558498 n-d-854823-8 devstack@n-api.service[128801]: exception: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 04 20:58:11.558498 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1591167267', 'imageRef': '15b24725-0c99-4bcf-b1fb-907cdf8e2d63', 'flavorRef': '452', 'max_count': 2.5}}} Oct 04 20:58:11.558498 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:58:11.558498 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:58:11.558498 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 20:58:11.558498 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 20:58:11.558498 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 20:58:11.558498 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise error Oct 04 20:58:11.558498 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Oct 04 20:58:11.558498 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:58:11.558498 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['max_count']: Oct 04 20:58:11.558498 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 04 20:58:11.558498 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 04 20:58:11.558498 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 04 20:58:11.558498 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 04 20:58:11.558498 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:58:11.558498 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 04 20:58:11.558498 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi 2.5 Oct 04 20:58:11.558498 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:58:11.558498 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:58:11.558498 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:58:11.558498 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:58:11.558498 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:58:11.558498 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:58:11.558498 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:58:11.558498 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:58:11.558498 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:58:11.558498 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:58:11.558498 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:58:11.558498 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:58:11.558498 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 20:58:11.558498 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 20:58:11.567699 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 20:58:11.567699 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 20:58:11.567699 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 20:58:11.567699 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 20:58:11.567699 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 04 20:58:11.567699 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:58:11.567699 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:58:11.567699 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:58:11.567699 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:58:11.567699 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:58:11.567699 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:58:11.567699 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 20:58:11.567699 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 20:58:11.567699 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 04 20:58:11.567699 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:58:11.578331 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2fdf07ee-97ab-4629-b1f1-95297b74bbd1 tempest-MultipleCreateNegativeTestJSON-1641667700 tempest-MultipleCreateNegativeTestJSON-1641667700-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:58:11.578331 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-2fdf07ee-97ab-4629-b1f1-95297b74bbd1 tempest-MultipleCreateNegativeTestJSON-1641667700 tempest-MultipleCreateNegativeTestJSON-1641667700-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.032450 Oct 04 20:58:11.579715 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2334/4708] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 20:58:11 2022] POST /compute/v2.1/servers => generated 139 bytes in 37 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 20:58:11.686177 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-fae07687-f7b0-4456-844f-8eed6bc28f3c tempest-MultipleCreateNegativeTestJSON-1641667700 tempest-MultipleCreateNegativeTestJSON-1641667700-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-541900656", "imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63", "flavorRef": "452", "min_count": 0}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:58:11.693103 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-fae07687-f7b0-4456-844f-8eed6bc28f3c tempest-MultipleCreateNegativeTestJSON-1641667700 tempest-MultipleCreateNegativeTestJSON-1641667700-project] Request method failure captured: Oct 04 20:58:11.693103 n-d-854823-8 devstack@n-api.service[128801]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 20:58:11.693103 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:58:11.693103 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:58:11.693103 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:58:11.693103 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 167 Oct 04 20:58:11.693103 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:58:11.693103 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:58:11.693103 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:58:11.693103 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:58:11.693103 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJ5hlJ5JfCqLx5K2rHlTRjYMocRWJVtAVDtWiE-q3MBz9JFwjpXsILgG8s-jaiMJ743S9Zj9N-VzfOn3lJ1q5h196CLOmuHubUcPiKwnt8Cfsi1V8ZQ0p2kBkDFZ9ccHJBZ5SW3IsINJbGrBCiaa4MxbO5YEKsl4p-3Zaurv9TMRTMU Oct 04 20:58:11.693103 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:58:11.693103 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:58:11.693103 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:58:11.693103 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:58:11.693103 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:58:11.693103 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:58:11.693103 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: b2ef058053274b9498007a3f4f0fecb4 Oct 04 20:58:11.693103 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1641667700 Oct 04 20:58:11.693103 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 20:58:11.693103 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 20:58:11.693103 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b2ef058053274b9498007a3f4f0fecb4", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b2ef058053274b9498007a3f4f0fecb4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b2ef058053274b9498007a3f4f0fecb4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b2ef058053274b9498007a3f4f0fecb4"}]}] Oct 04 20:58:11.693103 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1641667700 Oct 04 20:58:11.693103 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: b2ef058053274b9498007a3f4f0fecb4 Oct 04 20:58:11.693103 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1641667700 Oct 04 20:58:11.693103 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-MultipleCreateNegativeTestJSON-1641667700-project Oct 04 20:58:11.693103 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:58:11.693103 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:58:11.693103 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: 1d73356630b74e7cab4ccf407efcd67d Oct 04 20:58:11.693103 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1641667700-project Oct 04 20:58:11.693103 n-d-854823-8 devstack@n-api.service[128801]: Oct 04 20:58:11.693103 n-d-854823-8 devstack@n-api.service[128801]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-541900656", "imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63", "flavorRef": "452", "min_count": 0}} Oct 04 20:58:11.693103 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 20:58:11.693103 n-d-854823-8 devstack@n-api.service[128801]: exception: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Oct 04 20:58:11.693103 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-541900656', 'imageRef': '15b24725-0c99-4bcf-b1fb-907cdf8e2d63', 'flavorRef': '452', 'min_count': 0}}} Oct 04 20:58:11.693103 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:58:11.693103 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:58:11.693103 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 20:58:11.693103 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 20:58:11.693103 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 20:58:11.693103 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise error Oct 04 20:58:11.693103 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 04 20:58:11.693103 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:58:11.693103 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['min_count']: Oct 04 20:58:11.693103 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 04 20:58:11.693103 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 04 20:58:11.693103 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 04 20:58:11.693103 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 04 20:58:11.693103 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:58:11.693103 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 04 20:58:11.693103 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi 0 Oct 04 20:58:11.693103 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:58:11.693103 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:58:11.693103 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:58:11.693103 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:58:11.693103 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:58:11.693103 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:58:11.693103 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:58:11.693103 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:58:11.693103 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:58:11.693103 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:58:11.693103 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:58:11.693103 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:58:11.693103 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 20:58:11.693103 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 20:58:11.701479 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 20:58:11.701479 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 20:58:11.701479 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 20:58:11.701479 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 20:58:11.701479 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Oct 04 20:58:11.701479 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:58:11.701479 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:58:11.701479 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:58:11.701479 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:58:11.701479 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:58:11.701479 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:58:11.701479 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 20:58:11.701479 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 20:58:11.701479 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Oct 04 20:58:11.701479 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:58:11.715634 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-fae07687-f7b0-4456-844f-8eed6bc28f3c tempest-MultipleCreateNegativeTestJSON-1641667700 tempest-MultipleCreateNegativeTestJSON-1641667700-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:58:11.717695 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-fae07687-f7b0-4456-844f-8eed6bc28f3c tempest-MultipleCreateNegativeTestJSON-1641667700 tempest-MultipleCreateNegativeTestJSON-1641667700-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.045287 Oct 04 20:58:11.718820 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2335/4709] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 20:58:11 2022] POST /compute/v2.1/servers => generated 130 bytes in 53 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 04 20:58:11.742215 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e7888a45-9e6d-43aa-a0cc-338c18bddcf7 tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:58:11.743410 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e7888a45-9e6d-43aa-a0cc-338c18bddcf7 tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] [instance: e32774eb-128e-499d-b15e-f93f4c57d9e0] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:58:11.760024 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e7888a45-9e6d-43aa-a0cc-338c18bddcf7 tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:11.763589 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e7888a45-9e6d-43aa-a0cc-338c18bddcf7 tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:11.764590 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e7888a45-9e6d-43aa-a0cc-338c18bddcf7 tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:11.766429 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e7888a45-9e6d-43aa-a0cc-338c18bddcf7 tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:11.769681 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e7888a45-9e6d-43aa-a0cc-338c18bddcf7 tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:11.770573 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e7888a45-9e6d-43aa-a0cc-338c18bddcf7 tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:11.772478 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-52032c40-26c0-4700-a0d7-bb41b1f3d481 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6513f5e908ac4d028cad6eeeebeab285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65946afc398d4a9fb1c9095a4f946e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:58:11.791014 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-52032c40-26c0-4700-a0d7-bb41b1f3d481 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc" status: 200 len: 1505 microversion: 2.1 time: 1.067708 Oct 04 20:58:11.791907 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2375/4710] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:58:10 2022] GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc => generated 1505 bytes in 1075 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:58:11.805038 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-81e8a3ac-04eb-423d-80db-773e4f655347 tempest-MultipleCreateNegativeTestJSON-1641667700 tempest-MultipleCreateNegativeTestJSON-1641667700-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-46178111", "imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63", "flavorRef": "452", "min_count": 2.5}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:58:11.820519 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-81e8a3ac-04eb-423d-80db-773e4f655347 tempest-MultipleCreateNegativeTestJSON-1641667700 tempest-MultipleCreateNegativeTestJSON-1641667700-project] Request method failure captured: Oct 04 20:58:11.820519 n-d-854823-8 devstack@n-api.service[128802]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 20:58:11.820519 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 20:58:11.820519 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 20:58:11.820519 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 20:58:11.820519 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 168 Oct 04 20:58:11.820519 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 20:58:11.820519 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 20:58:11.820519 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 20:58:11.820519 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 20:58:11.820519 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPJ5hlJ5JfCqLx5K2rHlTRjYMocRWJVtAVDtWiE-q3MBz9JFwjpXsILgG8s-jaiMJ743S9Zj9N-VzfOn3lJ1q5h196CLOmuHubUcPiKwnt8Cfsi1V8ZQ0p2kBkDFZ9ccHJBZ5SW3IsINJbGrBCiaa4MxbO5YEKsl4p-3Zaurv9TMRTMU Oct 04 20:58:11.820519 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 20:58:11.820519 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 20:58:11.820519 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 20:58:11.820519 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 20:58:11.820519 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 20:58:11.820519 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 20:58:11.820519 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: b2ef058053274b9498007a3f4f0fecb4 Oct 04 20:58:11.820519 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1641667700 Oct 04 20:58:11.820519 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 20:58:11.820519 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 20:58:11.820519 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b2ef058053274b9498007a3f4f0fecb4", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b2ef058053274b9498007a3f4f0fecb4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b2ef058053274b9498007a3f4f0fecb4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b2ef058053274b9498007a3f4f0fecb4"}]}] Oct 04 20:58:11.820519 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1641667700 Oct 04 20:58:11.820519 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: b2ef058053274b9498007a3f4f0fecb4 Oct 04 20:58:11.820519 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1641667700 Oct 04 20:58:11.820519 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-MultipleCreateNegativeTestJSON-1641667700-project Oct 04 20:58:11.820519 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 20:58:11.820519 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 20:58:11.820519 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: 1d73356630b74e7cab4ccf407efcd67d Oct 04 20:58:11.820519 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1641667700-project Oct 04 20:58:11.820519 n-d-854823-8 devstack@n-api.service[128802]: Oct 04 20:58:11.820519 n-d-854823-8 devstack@n-api.service[128802]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-46178111", "imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63", "flavorRef": "452", "min_count": 2.5}} Oct 04 20:58:11.820519 n-d-854823-8 devstack@n-api.service[128802]: method: > Oct 04 20:58:11.820519 n-d-854823-8 devstack@n-api.service[128802]: exception: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 04 20:58:11.820519 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-46178111', 'imageRef': '15b24725-0c99-4bcf-b1fb-907cdf8e2d63', 'flavorRef': '452', 'min_count': 2.5}}} Oct 04 20:58:11.820519 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:58:11.820519 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:58:11.820519 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 20:58:11.820519 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 20:58:11.820519 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 20:58:11.820519 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise error Oct 04 20:58:11.820519 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Oct 04 20:58:11.820519 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:58:11.820519 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['min_count']: Oct 04 20:58:11.820519 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 04 20:58:11.820519 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 04 20:58:11.820519 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 04 20:58:11.820519 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 04 20:58:11.820519 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:58:11.820519 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 04 20:58:11.820519 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi 2.5 Oct 04 20:58:11.820519 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:58:11.820519 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:58:11.820519 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:58:11.820519 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:58:11.820519 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:58:11.820519 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:58:11.820519 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:58:11.820519 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:58:11.820519 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:58:11.820519 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:58:11.820519 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:58:11.820519 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:58:11.820519 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 20:58:11.820519 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 20:58:11.827384 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 20:58:11.827384 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 20:58:11.827384 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 20:58:11.827384 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 20:58:11.827384 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 04 20:58:11.827384 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:58:11.827384 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:58:11.827384 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:58:11.827384 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:58:11.827384 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:58:11.827384 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:58:11.827384 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 20:58:11.827384 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 20:58:11.827384 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 04 20:58:11.827384 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:58:11.831655 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-81e8a3ac-04eb-423d-80db-773e4f655347 tempest-MultipleCreateNegativeTestJSON-1641667700 tempest-MultipleCreateNegativeTestJSON-1641667700-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:58:11.835057 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-81e8a3ac-04eb-423d-80db-773e4f655347 tempest-MultipleCreateNegativeTestJSON-1641667700 tempest-MultipleCreateNegativeTestJSON-1641667700-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.040963 Oct 04 20:58:11.836074 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2376/4711] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 20:58:11 2022] POST /compute/v2.1/servers => generated 139 bytes in 43 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 20:58:12.246443 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e7888a45-9e6d-43aa-a0cc-338c18bddcf7 tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034056e41cbe4111ba8fcd5e48273007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1e31ed067d4e85aab983e532ab399c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:58:12.266892 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e7888a45-9e6d-43aa-a0cc-338c18bddcf7 tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] 10.222.0.33 "GET /compute/v2.1/servers/e32774eb-128e-499d-b15e-f93f4c57d9e0" status: 200 len: 1325 microversion: 2.1 time: 0.529237 Oct 04 20:58:12.286526 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2336/4712] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:58:11 2022] GET /compute/v2.1/servers/e32774eb-128e-499d-b15e-f93f4c57d9e0 => generated 1325 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:58:13.296208 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-c16b402d-31c9-4c8d-9c4c-09e5b5c3713c tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:58:13.296957 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-c16b402d-31c9-4c8d-9c4c-09e5b5c3713c tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] [instance: e32774eb-128e-499d-b15e-f93f4c57d9e0] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:58:13.309939 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c16b402d-31c9-4c8d-9c4c-09e5b5c3713c tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:13.310471 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c16b402d-31c9-4c8d-9c4c-09e5b5c3713c tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:13.310910 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c16b402d-31c9-4c8d-9c4c-09e5b5c3713c tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:13.324058 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c16b402d-31c9-4c8d-9c4c-09e5b5c3713c tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:13.325526 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c16b402d-31c9-4c8d-9c4c-09e5b5c3713c tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:13.326629 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c16b402d-31c9-4c8d-9c4c-09e5b5c3713c tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:14.231639 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-c16b402d-31c9-4c8d-9c4c-09e5b5c3713c tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034056e41cbe4111ba8fcd5e48273007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1e31ed067d4e85aab983e532ab399c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:58:14.266981 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-c16b402d-31c9-4c8d-9c4c-09e5b5c3713c tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] 10.222.0.33 "GET /compute/v2.1/servers/e32774eb-128e-499d-b15e-f93f4c57d9e0" status: 200 len: 1325 microversion: 2.1 time: 0.957369 Oct 04 20:58:14.276774 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2377/4713] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:58:13 2022] GET /compute/v2.1/servers/e32774eb-128e-499d-b15e-f93f4c57d9e0 => generated 1325 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:58:15.308236 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0e52bc3a-4574-4c50-8c62-688b0f4b4663 tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:58:15.309536 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-0e52bc3a-4574-4c50-8c62-688b0f4b4663 tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] [instance: e32774eb-128e-499d-b15e-f93f4c57d9e0] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:58:15.322441 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0e52bc3a-4574-4c50-8c62-688b0f4b4663 tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:15.324283 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0e52bc3a-4574-4c50-8c62-688b0f4b4663 tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:15.324919 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0e52bc3a-4574-4c50-8c62-688b0f4b4663 tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:15.326077 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0e52bc3a-4574-4c50-8c62-688b0f4b4663 tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:15.331011 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0e52bc3a-4574-4c50-8c62-688b0f4b4663 tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:15.331685 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0e52bc3a-4574-4c50-8c62-688b0f4b4663 tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:15.654080 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-3ec18be0-d0df-42d4-b9c9-eda665fc0a8a tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-511858160", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "de127df8-1bca-4c7c-b93e-e00607a98fee", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "780a66b6-435f-46df-9c7b-6f763e190356"}]}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:58:15.813263 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.wsgi [None req-3ec18be0-d0df-42d4-b9c9-eda665fc0a8a tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] HTTP exception thrown: Block Device de127df8-1bca-4c7c-b93e-e00607a98fee is not bootable. Oct 04 20:58:15.819246 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-3ec18be0-d0df-42d4-b9c9-eda665fc0a8a tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Request method failure captured: Oct 04 20:58:15.819246 n-d-854823-8 devstack@n-api.service[128802]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 20:58:15.819246 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 20:58:15.819246 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 20:58:15.819246 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 20:58:15.819246 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 357 Oct 04 20:58:15.819246 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 20:58:15.819246 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 20:58:15.819246 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 20:58:15.819246 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 20:58:15.819246 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPJ4eaBM_FLl2jaN3nQraRbM94DgE-qlLjkCPNJ1Ol7VvkbIGIp-m_lAuwAay2VJ7lXD5niLtaDpJGDoHOJTljuI2aLuReHvX6jQr-uTgC01ZM2s7p6j6gq6a-1PaGQN0mcmcJntCqSnEEt5MEM6DdrOOdi5eEtsfyNU4EpDYmca-Ylo Oct 04 20:58:15.819246 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 20:58:15.819246 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 20:58:15.819246 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 20:58:15.819246 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 20:58:15.819246 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 20:58:15.819246 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 20:58:15.819246 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: 65946afc398d4a9fb1c9095a4f946e07 Oct 04 20:58:15.819246 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-ServersNegativeTestJSON-1097186397 Oct 04 20:58:15.819246 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 20:58:15.819246 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 20:58:15.819246 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_65946afc398d4a9fb1c9095a4f946e07", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/65946afc398d4a9fb1c9095a4f946e07"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/65946afc398d4a9fb1c9095a4f946e07"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/65946afc398d4a9fb1c9095a4f946e07"}]}] Oct 04 20:58:15.819246 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-ServersNegativeTestJSON-1097186397 Oct 04 20:58:15.819246 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: 65946afc398d4a9fb1c9095a4f946e07 Oct 04 20:58:15.819246 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1097186397 Oct 04 20:58:15.819246 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-ServersNegativeTestJSON-1097186397-project Oct 04 20:58:15.819246 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 20:58:15.819246 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 20:58:15.819246 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: 6513f5e908ac4d028cad6eeeebeab285 Oct 04 20:58:15.819246 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-ServersNegativeTestJSON-1097186397-project Oct 04 20:58:15.819246 n-d-854823-8 devstack@n-api.service[128802]: Oct 04 20:58:15.819246 n-d-854823-8 devstack@n-api.service[128802]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-511858160", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "de127df8-1bca-4c7c-b93e-e00607a98fee", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "780a66b6-435f-46df-9c7b-6f763e190356"}]}} Oct 04 20:58:15.819246 n-d-854823-8 devstack@n-api.service[128802]: method: > Oct 04 20:58:15.819246 n-d-854823-8 devstack@n-api.service[128802]: exception: Block Device de127df8-1bca-4c7c-b93e-e00607a98fee is not bootable. Oct 04 20:58:15.819246 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-511858160', 'imageRef': '', 'flavorRef': '452', 'block_device_mapping_v2': [{'boot_index': 0, 'source_type': 'volume', 'destination_type': 'volume', 'delete_on_termination': False, 'volume_id': 'de127df8-1bca-4c7c-b93e-e00607a98fee'}], 'networks': [{'uuid': '780a66b6-435f-46df-9c7b-6f763e190356'}]}}} Oct 04 20:58:15.819246 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:58:15.819246 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:58:15.819246 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 20:58:15.819246 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 20:58:15.819246 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 20:58:15.819246 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 20:58:15.819246 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1672, in _create_instance Oct 04 20:58:15.819246 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi boot_meta = block_device.get_bdm_image_metadata( Oct 04 20:58:15.819246 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/block_device.py", line 664, in get_bdm_image_metadata Oct 04 20:58:15.819246 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.InvalidBDMVolumeNotBootable(id=volume_id) Oct 04 20:58:15.819246 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.InvalidBDMVolumeNotBootable: Block Device de127df8-1bca-4c7c-b93e-e00607a98fee is not bootable. Oct 04 20:58:15.819246 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:58:15.819246 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:58:15.819246 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:58:15.819246 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:58:15.819246 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:58:15.819246 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:58:15.819246 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:58:15.819246 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:58:15.819246 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:58:15.819246 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:58:15.819246 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:58:15.819246 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:58:15.819246 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:58:15.825497 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:58:15.825497 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:58:15.825497 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:58:15.825497 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 20:58:15.825497 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 04 20:58:15.825497 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 04 20:58:15.825497 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Block Device de127df8-1bca-4c7c-b93e-e00607a98fee is not bootable. Oct 04 20:58:15.825497 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:58:15.825497 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:58:15.825497 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:58:15.825497 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:58:15.825497 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:58:15.825497 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:58:15.825497 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:58:15.825497 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:58:15.825497 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Block Device de127df8-1bca-4c7c-b93e-e00607a98fee is not bootable. Oct 04 20:58:15.825497 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:58:15.830305 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-3ec18be0-d0df-42d4-b9c9-eda665fc0a8a tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Returning 400 to user: Block Device de127df8-1bca-4c7c-b93e-e00607a98fee is not bootable. {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:58:15.832569 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-3ec18be0-d0df-42d4-b9c9-eda665fc0a8a tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.182896 Oct 04 20:58:15.839728 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2378/4714] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 20:58:15 2022] POST /compute/v2.1/servers => generated 110 bytes in 190 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 04 20:58:15.846423 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-4a00e808-286c-4fcb-8358-36bb67d8e68f tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:58:15.850178 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-4a00e808-286c-4fcb-8358-36bb67d8e68f tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] [instance: 320f9a98-969f-473e-bc56-842bbd28dedc] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:58:15.858433 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4a00e808-286c-4fcb-8358-36bb67d8e68f tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:15.859473 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4a00e808-286c-4fcb-8358-36bb67d8e68f tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:15.860687 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4a00e808-286c-4fcb-8358-36bb67d8e68f tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:15.862732 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4a00e808-286c-4fcb-8358-36bb67d8e68f tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:15.864065 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4a00e808-286c-4fcb-8358-36bb67d8e68f tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:15.865429 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4a00e808-286c-4fcb-8358-36bb67d8e68f tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:16.567402 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-0e52bc3a-4574-4c50-8c62-688b0f4b4663 tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034056e41cbe4111ba8fcd5e48273007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1e31ed067d4e85aab983e532ab399c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:58:16.576790 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-0e52bc3a-4574-4c50-8c62-688b0f4b4663 tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] 10.222.0.33 "GET /compute/v2.1/servers/e32774eb-128e-499d-b15e-f93f4c57d9e0" status: 200 len: 1325 microversion: 2.1 time: 1.272364 Oct 04 20:58:16.587375 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2337/4715] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:58:15 2022] GET /compute/v2.1/servers/e32774eb-128e-499d-b15e-f93f4c57d9e0 => generated 1325 bytes in 1284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:58:17.157015 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-4a00e808-286c-4fcb-8358-36bb67d8e68f tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6513f5e908ac4d028cad6eeeebeab285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65946afc398d4a9fb1c9095a4f946e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:58:17.171588 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-4a00e808-286c-4fcb-8358-36bb67d8e68f tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc" status: 200 len: 1505 microversion: 2.1 time: 1.329824 Oct 04 20:58:17.183483 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2379/4716] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:58:15 2022] GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc => generated 1505 bytes in 1343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:58:17.206671 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7d23b218-12d4-42b7-8bbe-05380b92a83a tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:58:17.208423 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-7d23b218-12d4-42b7-8bbe-05380b92a83a tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] [instance: 320f9a98-969f-473e-bc56-842bbd28dedc] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:58:17.210963 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=64,nova_api:DELETE=3,nova_api:INSERT=3 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:58:17.219152 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7d23b218-12d4-42b7-8bbe-05380b92a83a tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:17.229263 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7d23b218-12d4-42b7-8bbe-05380b92a83a tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:17.238827 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7d23b218-12d4-42b7-8bbe-05380b92a83a tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:17.243784 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7d23b218-12d4-42b7-8bbe-05380b92a83a tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:17.244517 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7d23b218-12d4-42b7-8bbe-05380b92a83a tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:17.248351 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7d23b218-12d4-42b7-8bbe-05380b92a83a tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:17.628244 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-c07f9269-11a7-4d0e-a07e-7c939c72038e tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:58:17.629736 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-c07f9269-11a7-4d0e-a07e-7c939c72038e tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] [instance: e32774eb-128e-499d-b15e-f93f4c57d9e0] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:58:17.643151 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=1 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:58:17.646859 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c07f9269-11a7-4d0e-a07e-7c939c72038e tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:17.647621 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c07f9269-11a7-4d0e-a07e-7c939c72038e tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:17.651309 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c07f9269-11a7-4d0e-a07e-7c939c72038e tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:17.652352 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c07f9269-11a7-4d0e-a07e-7c939c72038e tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:17.653066 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c07f9269-11a7-4d0e-a07e-7c939c72038e tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:17.653741 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c07f9269-11a7-4d0e-a07e-7c939c72038e tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:17.692775 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:58:18.180985 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-7d23b218-12d4-42b7-8bbe-05380b92a83a tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6513f5e908ac4d028cad6eeeebeab285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65946afc398d4a9fb1c9095a4f946e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:58:18.189371 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-7d23b218-12d4-42b7-8bbe-05380b92a83a tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc" status: 200 len: 1505 microversion: 2.1 time: 0.986551 Oct 04 20:58:18.192747 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2338/4717] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:58:17 2022] GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc => generated 1505 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:58:18.532262 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-c07f9269-11a7-4d0e-a07e-7c939c72038e tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034056e41cbe4111ba8fcd5e48273007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1e31ed067d4e85aab983e532ab399c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:58:18.555283 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-c07f9269-11a7-4d0e-a07e-7c939c72038e tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] 10.222.0.33 "GET /compute/v2.1/servers/e32774eb-128e-499d-b15e-f93f4c57d9e0" status: 200 len: 1325 microversion: 2.1 time: 0.928534 Oct 04 20:58:18.559846 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2380/4718] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:58:17 2022] GET /compute/v2.1/servers/e32774eb-128e-499d-b15e-f93f4c57d9e0 => generated 1325 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:58:18.783049 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-abd7053e-4f40-4a36-a66a-80fd278c046c tempest-ServersAaction247Test-724016890 tempest-ServersAaction247Test-724016890-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAaction247Test-server-302848368", "imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63", "flavorRef": "452", "networks": "none"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:58:18.882188 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-abd7053e-4f40-4a36-a66a-80fd278c046c tempest-ServersAaction247Test-724016890 tempest-ServersAaction247Test-724016890-project] Flavor limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:58:18.882675 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-abd7053e-4f40-4a36-a66a-80fd278c046c tempest-ServersAaction247Test-724016890 tempest-ServersAaction247Test-724016890-project] Image limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:58:18.883161 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-abd7053e-4f40-4a36-a66a-80fd278c046c tempest-ServersAaction247Test-724016890 tempest-ServersAaction247Test-724016890-project] Flavor pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:58:18.890820 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-abd7053e-4f40-4a36-a66a-80fd278c046c tempest-ServersAaction247Test-724016890 tempest-ServersAaction247Test-724016890-project] Image pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:58:18.892590 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-abd7053e-4f40-4a36-a66a-80fd278c046c tempest-ServersAaction247Test-724016890 tempest-ServersAaction247Test-724016890-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:58:18.955237 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-abd7053e-4f40-4a36-a66a-80fd278c046c tempest-ServersAaction247Test-724016890 tempest-ServersAaction247Test-724016890-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:18.969639 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-abd7053e-4f40-4a36-a66a-80fd278c046c tempest-ServersAaction247Test-724016890 tempest-ServersAaction247Test-724016890-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:18.970960 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-abd7053e-4f40-4a36-a66a-80fd278c046c tempest-ServersAaction247Test-724016890 tempest-ServersAaction247Test-724016890-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:18.979509 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-abd7053e-4f40-4a36-a66a-80fd278c046c tempest-ServersAaction247Test-724016890 tempest-ServersAaction247Test-724016890-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:18.980401 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-abd7053e-4f40-4a36-a66a-80fd278c046c tempest-ServersAaction247Test-724016890 tempest-ServersAaction247Test-724016890-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:18.982595 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-abd7053e-4f40-4a36-a66a-80fd278c046c tempest-ServersAaction247Test-724016890 tempest-ServersAaction247Test-724016890-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:19.048805 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-abd7053e-4f40-4a36-a66a-80fd278c046c tempest-ServersAaction247Test-724016890 tempest-ServersAaction247Test-724016890-project] Getting quotas for project fcea08e8eb0a4d17b4a0f952915bca7e. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:58:19.056698 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-abd7053e-4f40-4a36-a66a-80fd278c046c tempest-ServersAaction247Test-724016890 tempest-ServersAaction247Test-724016890-project] Getting quotas for user f8636fdad74c483eb84aeb7524858a65 and project fcea08e8eb0a4d17b4a0f952915bca7e. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:58:19.096596 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-abd7053e-4f40-4a36-a66a-80fd278c046c tempest-ServersAaction247Test-724016890 tempest-ServersAaction247Test-724016890-project] Going to run 1 instances... {{(pid=128801) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:58:19.110485 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-abd7053e-4f40-4a36-a66a-80fd278c046c tempest-ServersAaction247Test-724016890 tempest-ServersAaction247Test-724016890-project] [instance: efdf16f0-7d78-4f70-a4be-081e38d09e8b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='15b24725-0c99-4bcf-b1fb-907cdf8e2d63',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128801) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:58:19.243541 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-abd7053e-4f40-4a36-a66a-80fd278c046c tempest-ServersAaction247Test-724016890 tempest-ServersAaction247Test-724016890-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 1.049513 Oct 04 20:58:19.248481 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2339/4719] 10.222.0.33 () {62 vars in 1188 bytes} [Tue Oct 4 20:58:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 1054 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 04 20:58:19.287897 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-3b627540-8205-4662-b68b-a67c78ca231e tempest-ServersAaction247Test-724016890 tempest-ServersAaction247Test-724016890-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:58:19.291879 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-3b627540-8205-4662-b68b-a67c78ca231e tempest-ServersAaction247Test-724016890 tempest-ServersAaction247Test-724016890-project] [instance: efdf16f0-7d78-4f70-a4be-081e38d09e8b] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:58:19.530703 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-3b627540-8205-4662-b68b-a67c78ca231e tempest-ServersAaction247Test-724016890 tempest-ServersAaction247Test-724016890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8636fdad74c483eb84aeb7524858a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcea08e8eb0a4d17b4a0f952915bca7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:58:19.541112 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-3b627540-8205-4662-b68b-a67c78ca231e tempest-ServersAaction247Test-724016890 tempest-ServersAaction247Test-724016890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8636fdad74c483eb84aeb7524858a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcea08e8eb0a4d17b4a0f952915bca7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:58:19.542583 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-3b627540-8205-4662-b68b-a67c78ca231e tempest-ServersAaction247Test-724016890 tempest-ServersAaction247Test-724016890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8636fdad74c483eb84aeb7524858a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcea08e8eb0a4d17b4a0f952915bca7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:58:19.543743 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-3b627540-8205-4662-b68b-a67c78ca231e tempest-ServersAaction247Test-724016890 tempest-ServersAaction247Test-724016890-project] 10.222.0.33 "GET /compute/v2.1/servers/efdf16f0-7d78-4f70-a4be-081e38d09e8b" status: 200 len: 1280 microversion: 2.47 time: 0.286643 Oct 04 20:58:19.558408 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2381/4720] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:58:19 2022] GET /compute/v2.1/servers/efdf16f0-7d78-4f70-a4be-081e38d09e8b => generated 1280 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:58:19.591166 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-defc3fe8-3eb9-4425-aacc-e75208be57fb tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:58:19.591796 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-defc3fe8-3eb9-4425-aacc-e75208be57fb tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] [instance: e32774eb-128e-499d-b15e-f93f4c57d9e0] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:58:19.611283 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-defc3fe8-3eb9-4425-aacc-e75208be57fb tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:19.611803 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-defc3fe8-3eb9-4425-aacc-e75208be57fb tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:19.612210 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-defc3fe8-3eb9-4425-aacc-e75208be57fb tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:19.612922 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-defc3fe8-3eb9-4425-aacc-e75208be57fb tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:19.613413 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-defc3fe8-3eb9-4425-aacc-e75208be57fb tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:19.613836 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-defc3fe8-3eb9-4425-aacc-e75208be57fb tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:20.523383 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-defc3fe8-3eb9-4425-aacc-e75208be57fb tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034056e41cbe4111ba8fcd5e48273007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1e31ed067d4e85aab983e532ab399c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:58:20.532617 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-defc3fe8-3eb9-4425-aacc-e75208be57fb tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] 10.222.0.33 "GET /compute/v2.1/servers/e32774eb-128e-499d-b15e-f93f4c57d9e0" status: 200 len: 1325 microversion: 2.1 time: 0.946197 Oct 04 20:58:20.533125 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2340/4721] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:58:19 2022] GET /compute/v2.1/servers/e32774eb-128e-499d-b15e-f93f4c57d9e0 => generated 1325 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:58:20.588423 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-367cbdc8-1cff-46ab-b84c-7b5006543206 tempest-ServersAaction247Test-724016890 tempest-ServersAaction247Test-724016890-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:58:20.589267 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-367cbdc8-1cff-46ab-b84c-7b5006543206 tempest-ServersAaction247Test-724016890 tempest-ServersAaction247Test-724016890-project] [instance: efdf16f0-7d78-4f70-a4be-081e38d09e8b] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:58:20.667167 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-367cbdc8-1cff-46ab-b84c-7b5006543206 tempest-ServersAaction247Test-724016890 tempest-ServersAaction247Test-724016890-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:20.667730 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-367cbdc8-1cff-46ab-b84c-7b5006543206 tempest-ServersAaction247Test-724016890 tempest-ServersAaction247Test-724016890-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:20.668803 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-367cbdc8-1cff-46ab-b84c-7b5006543206 tempest-ServersAaction247Test-724016890 tempest-ServersAaction247Test-724016890-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:20.677173 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-367cbdc8-1cff-46ab-b84c-7b5006543206 tempest-ServersAaction247Test-724016890 tempest-ServersAaction247Test-724016890-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:20.677885 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-367cbdc8-1cff-46ab-b84c-7b5006543206 tempest-ServersAaction247Test-724016890 tempest-ServersAaction247Test-724016890-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:20.678367 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-367cbdc8-1cff-46ab-b84c-7b5006543206 tempest-ServersAaction247Test-724016890 tempest-ServersAaction247Test-724016890-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:21.002402 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-367cbdc8-1cff-46ab-b84c-7b5006543206 tempest-ServersAaction247Test-724016890 tempest-ServersAaction247Test-724016890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8636fdad74c483eb84aeb7524858a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcea08e8eb0a4d17b4a0f952915bca7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:58:21.055728 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-367cbdc8-1cff-46ab-b84c-7b5006543206 tempest-ServersAaction247Test-724016890 tempest-ServersAaction247Test-724016890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8636fdad74c483eb84aeb7524858a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcea08e8eb0a4d17b4a0f952915bca7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:58:21.064889 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-367cbdc8-1cff-46ab-b84c-7b5006543206 tempest-ServersAaction247Test-724016890 tempest-ServersAaction247Test-724016890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8636fdad74c483eb84aeb7524858a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcea08e8eb0a4d17b4a0f952915bca7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:58:21.074218 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-367cbdc8-1cff-46ab-b84c-7b5006543206 tempest-ServersAaction247Test-724016890 tempest-ServersAaction247Test-724016890-project] 10.222.0.33 "GET /compute/v2.1/servers/efdf16f0-7d78-4f70-a4be-081e38d09e8b" status: 200 len: 1284 microversion: 2.47 time: 0.492085 Oct 04 20:58:21.075996 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2382/4722] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:58:20 2022] GET /compute/v2.1/servers/efdf16f0-7d78-4f70-a4be-081e38d09e8b => generated 1284 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:58:21.559130 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b9467a81-db64-45dc-90b0-69510d87b160 tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:58:21.559903 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b9467a81-db64-45dc-90b0-69510d87b160 tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] [instance: e32774eb-128e-499d-b15e-f93f4c57d9e0] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:58:21.573177 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b9467a81-db64-45dc-90b0-69510d87b160 tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:21.578869 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b9467a81-db64-45dc-90b0-69510d87b160 tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:21.579630 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b9467a81-db64-45dc-90b0-69510d87b160 tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:21.580390 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b9467a81-db64-45dc-90b0-69510d87b160 tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:21.580845 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b9467a81-db64-45dc-90b0-69510d87b160 tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:21.581277 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b9467a81-db64-45dc-90b0-69510d87b160 tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:21.987982 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-b9467a81-db64-45dc-90b0-69510d87b160 tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034056e41cbe4111ba8fcd5e48273007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1e31ed067d4e85aab983e532ab399c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:58:22.038598 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b9467a81-db64-45dc-90b0-69510d87b160 tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] 10.222.0.33 "GET /compute/v2.1/servers/e32774eb-128e-499d-b15e-f93f4c57d9e0" status: 200 len: 1325 microversion: 2.1 time: 0.483412 Oct 04 20:58:22.041686 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2341/4723] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:58:21 2022] GET /compute/v2.1/servers/e32774eb-128e-499d-b15e-f93f4c57d9e0 => generated 1325 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:58:22.120931 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-83e80bd3-204a-46cf-88cc-4b012b570bb9 tempest-ServersAaction247Test-724016890 tempest-ServersAaction247Test-724016890-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:58:22.121776 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-83e80bd3-204a-46cf-88cc-4b012b570bb9 tempest-ServersAaction247Test-724016890 tempest-ServersAaction247Test-724016890-project] [instance: efdf16f0-7d78-4f70-a4be-081e38d09e8b] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:58:22.135970 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-83e80bd3-204a-46cf-88cc-4b012b570bb9 tempest-ServersAaction247Test-724016890 tempest-ServersAaction247Test-724016890-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:22.136464 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-83e80bd3-204a-46cf-88cc-4b012b570bb9 tempest-ServersAaction247Test-724016890 tempest-ServersAaction247Test-724016890-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:22.137133 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-83e80bd3-204a-46cf-88cc-4b012b570bb9 tempest-ServersAaction247Test-724016890 tempest-ServersAaction247Test-724016890-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:22.138038 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-83e80bd3-204a-46cf-88cc-4b012b570bb9 tempest-ServersAaction247Test-724016890 tempest-ServersAaction247Test-724016890-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:22.138747 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-83e80bd3-204a-46cf-88cc-4b012b570bb9 tempest-ServersAaction247Test-724016890 tempest-ServersAaction247Test-724016890-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:22.139356 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-83e80bd3-204a-46cf-88cc-4b012b570bb9 tempest-ServersAaction247Test-724016890 tempest-ServersAaction247Test-724016890-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:22.299146 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-83e80bd3-204a-46cf-88cc-4b012b570bb9 tempest-ServersAaction247Test-724016890 tempest-ServersAaction247Test-724016890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8636fdad74c483eb84aeb7524858a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcea08e8eb0a4d17b4a0f952915bca7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:58:22.318396 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-83e80bd3-204a-46cf-88cc-4b012b570bb9 tempest-ServersAaction247Test-724016890 tempest-ServersAaction247Test-724016890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8636fdad74c483eb84aeb7524858a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcea08e8eb0a4d17b4a0f952915bca7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:58:22.320303 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-83e80bd3-204a-46cf-88cc-4b012b570bb9 tempest-ServersAaction247Test-724016890 tempest-ServersAaction247Test-724016890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8636fdad74c483eb84aeb7524858a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcea08e8eb0a4d17b4a0f952915bca7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:58:22.321500 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-83e80bd3-204a-46cf-88cc-4b012b570bb9 tempest-ServersAaction247Test-724016890 tempest-ServersAaction247Test-724016890-project] 10.222.0.33 "GET /compute/v2.1/servers/efdf16f0-7d78-4f70-a4be-081e38d09e8b" status: 200 len: 1350 microversion: 2.47 time: 0.204811 Oct 04 20:58:22.322485 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2383/4724] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:58:22 2022] GET /compute/v2.1/servers/efdf16f0-7d78-4f70-a4be-081e38d09e8b => generated 1350 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:58:22.802871 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6165a723-1688-477b-bc17-42a9f21d4c65 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-787903527", "imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63", "destination_type": "local"}, {"source_type": "volume", "uuid": "d1fefa7c-bdf7-4790-a0ab-4867d052f0d3", "destination_type": "invalid"}], "networks": [{"uuid": "780a66b6-435f-46df-9c7b-6f763e190356"}]}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:58:22.812609 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6165a723-1688-477b-bc17-42a9f21d4c65 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Request method failure captured: Oct 04 20:58:22.812609 n-d-854823-8 devstack@n-api.service[128801]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 20:58:22.812609 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:58:22.812609 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:58:22.812609 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:58:22.812609 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 494 Oct 04 20:58:22.812609 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:58:22.812609 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:58:22.812609 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:58:22.812609 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:58:22.812609 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJ4eaBM_FLl2jaN3nQraRbM94DgE-qlLjkCPNJ1Ol7VvkbIGIp-m_lAuwAay2VJ7lXD5niLtaDpJGDoHOJTljuI2aLuReHvX6jQr-uTgC01ZM2s7p6j6gq6a-1PaGQN0mcmcJntCqSnEEt5MEM6DdrOOdi5eEtsfyNU4EpDYmca-Ylo Oct 04 20:58:22.812609 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:58:22.812609 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:58:22.812609 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:58:22.812609 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:58:22.812609 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:58:22.812609 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:58:22.812609 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: 65946afc398d4a9fb1c9095a4f946e07 Oct 04 20:58:22.812609 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-ServersNegativeTestJSON-1097186397 Oct 04 20:58:22.812609 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 20:58:22.812609 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 20:58:22.812609 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_65946afc398d4a9fb1c9095a4f946e07", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/65946afc398d4a9fb1c9095a4f946e07"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/65946afc398d4a9fb1c9095a4f946e07"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/65946afc398d4a9fb1c9095a4f946e07"}]}] Oct 04 20:58:22.812609 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-ServersNegativeTestJSON-1097186397 Oct 04 20:58:22.812609 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: 65946afc398d4a9fb1c9095a4f946e07 Oct 04 20:58:22.812609 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1097186397 Oct 04 20:58:22.812609 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-ServersNegativeTestJSON-1097186397-project Oct 04 20:58:22.812609 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:58:22.812609 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:58:22.812609 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: 6513f5e908ac4d028cad6eeeebeab285 Oct 04 20:58:22.812609 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-ServersNegativeTestJSON-1097186397-project Oct 04 20:58:22.812609 n-d-854823-8 devstack@n-api.service[128801]: Oct 04 20:58:22.812609 n-d-854823-8 devstack@n-api.service[128801]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-787903527", "imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63", "destination_type": "local"}, {"source_type": "volume", "uuid": "d1fefa7c-bdf7-4790-a0ab-4867d052f0d3", "destination_type": "invalid"}], "networks": [{"uuid": "780a66b6-435f-46df-9c7b-6f763e190356"}]}} Oct 04 20:58:22.812609 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 20:58:22.812609 n-d-854823-8 devstack@n-api.service[128801]: exception: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Oct 04 20:58:22.812609 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-787903527', 'imageRef': '15b24725-0c99-4bcf-b1fb-907cdf8e2d63', 'flavorRef': '452', 'block_device_mapping_v2': [{'source_type': 'image', 'delete_on_termination': True, 'boot_index': 0, 'uuid': '15b24725-0c99-4bcf-b1fb-907cdf8e2d63', 'destination_type': 'local'}, {'source_type': 'volume', 'uuid': 'd1fefa7c-bdf7-4790-a0ab-4867d052f0d3', 'destination_type': 'invalid'}], 'networks': [{'uuid': '780a66b6-435f-46df-9c7b-6f763e190356'}]}}} Oct 04 20:58:22.812609 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:58:22.812609 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:58:22.812609 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 20:58:22.812609 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 20:58:22.812609 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 20:58:22.812609 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise error Oct 04 20:58:22.812609 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['local', 'volume'] Oct 04 20:58:22.812609 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:58:22.812609 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['server']['properties']['block_device_mapping_v2']['items']['properties']['destination_type']: Oct 04 20:58:22.812609 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi {'enum': ['local', 'volume'], 'type': 'string'} Oct 04 20:58:22.812609 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:58:22.812609 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi On instance['server']['block_device_mapping_v2'][1]: Oct 04 20:58:22.812609 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi 'invalid' Oct 04 20:58:22.812609 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:58:22.812609 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:58:22.812609 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:58:22.812609 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:58:22.812609 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:58:22.812609 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:58:22.812609 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:58:22.812609 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:58:22.812609 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:58:22.818429 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:58:22.818429 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:58:22.818429 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:58:22.818429 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 20:58:22.818429 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 20:58:22.818429 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 20:58:22.818429 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 20:58:22.818429 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 20:58:22.818429 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 20:58:22.818429 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Oct 04 20:58:22.818429 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:58:22.818429 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:58:22.818429 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:58:22.818429 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:58:22.818429 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:58:22.818429 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:58:22.818429 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 20:58:22.818429 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 20:58:22.818429 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Oct 04 20:58:22.818429 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:58:22.822268 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6165a723-1688-477b-bc17-42a9f21d4c65 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:58:22.827565 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-6165a723-1688-477b-bc17-42a9f21d4c65 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.030514 Oct 04 20:58:22.830608 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2342/4725] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 20:58:22 2022] POST /compute/v2.1/servers => generated 155 bytes in 34 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 20:58:22.839740 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-1317dd7f-591a-4a7d-82b4-59470c76abf7 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:58:22.840476 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-1317dd7f-591a-4a7d-82b4-59470c76abf7 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] [instance: 320f9a98-969f-473e-bc56-842bbd28dedc] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:58:22.852175 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1317dd7f-591a-4a7d-82b4-59470c76abf7 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:22.855103 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1317dd7f-591a-4a7d-82b4-59470c76abf7 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:22.856738 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1317dd7f-591a-4a7d-82b4-59470c76abf7 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:22.857621 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1317dd7f-591a-4a7d-82b4-59470c76abf7 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:22.859353 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1317dd7f-591a-4a7d-82b4-59470c76abf7 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:22.863935 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1317dd7f-591a-4a7d-82b4-59470c76abf7 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:23.066990 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6d200925-a10b-492a-b603-61089cb12fc3 tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:58:23.067908 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-6d200925-a10b-492a-b603-61089cb12fc3 tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] [instance: e32774eb-128e-499d-b15e-f93f4c57d9e0] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:58:23.107984 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6d200925-a10b-492a-b603-61089cb12fc3 tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:23.110491 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6d200925-a10b-492a-b603-61089cb12fc3 tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:23.111544 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6d200925-a10b-492a-b603-61089cb12fc3 tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:23.115008 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6d200925-a10b-492a-b603-61089cb12fc3 tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:23.117437 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6d200925-a10b-492a-b603-61089cb12fc3 tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:23.118323 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6d200925-a10b-492a-b603-61089cb12fc3 tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:23.404604 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-1317dd7f-591a-4a7d-82b4-59470c76abf7 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6513f5e908ac4d028cad6eeeebeab285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65946afc398d4a9fb1c9095a4f946e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:58:23.417039 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-1317dd7f-591a-4a7d-82b4-59470c76abf7 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc" status: 200 len: 1505 microversion: 2.1 time: 0.581532 Oct 04 20:58:23.418272 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2384/4726] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:58:22 2022] GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc => generated 1505 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:58:23.431878 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-8f0eeefb-93ad-4901-8544-0f0091ff9473 tempest-ServersAaction247Test-724016890 tempest-ServersAaction247Test-724016890-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:58:23.432516 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-8f0eeefb-93ad-4901-8544-0f0091ff9473 tempest-ServersAaction247Test-724016890 tempest-ServersAaction247Test-724016890-project] [instance: efdf16f0-7d78-4f70-a4be-081e38d09e8b] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:58:23.449968 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8f0eeefb-93ad-4901-8544-0f0091ff9473 tempest-ServersAaction247Test-724016890 tempest-ServersAaction247Test-724016890-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:23.452808 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8f0eeefb-93ad-4901-8544-0f0091ff9473 tempest-ServersAaction247Test-724016890 tempest-ServersAaction247Test-724016890-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:23.457813 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8f0eeefb-93ad-4901-8544-0f0091ff9473 tempest-ServersAaction247Test-724016890 tempest-ServersAaction247Test-724016890-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:23.461465 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8f0eeefb-93ad-4901-8544-0f0091ff9473 tempest-ServersAaction247Test-724016890 tempest-ServersAaction247Test-724016890-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:23.462164 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8f0eeefb-93ad-4901-8544-0f0091ff9473 tempest-ServersAaction247Test-724016890 tempest-ServersAaction247Test-724016890-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:23.463049 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8f0eeefb-93ad-4901-8544-0f0091ff9473 tempest-ServersAaction247Test-724016890 tempest-ServersAaction247Test-724016890-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:23.799186 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-8f0eeefb-93ad-4901-8544-0f0091ff9473 tempest-ServersAaction247Test-724016890 tempest-ServersAaction247Test-724016890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8636fdad74c483eb84aeb7524858a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcea08e8eb0a4d17b4a0f952915bca7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:58:23.815893 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-8f0eeefb-93ad-4901-8544-0f0091ff9473 tempest-ServersAaction247Test-724016890 tempest-ServersAaction247Test-724016890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8636fdad74c483eb84aeb7524858a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcea08e8eb0a4d17b4a0f952915bca7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:58:23.826503 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-8f0eeefb-93ad-4901-8544-0f0091ff9473 tempest-ServersAaction247Test-724016890 tempest-ServersAaction247Test-724016890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8636fdad74c483eb84aeb7524858a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcea08e8eb0a4d17b4a0f952915bca7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:58:23.827954 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-8f0eeefb-93ad-4901-8544-0f0091ff9473 tempest-ServersAaction247Test-724016890 tempest-ServersAaction247Test-724016890-project] 10.222.0.33 "GET /compute/v2.1/servers/efdf16f0-7d78-4f70-a4be-081e38d09e8b" status: 200 len: 1338 microversion: 2.47 time: 0.408371 Oct 04 20:58:23.838747 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2385/4727] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:58:23 2022] GET /compute/v2.1/servers/efdf16f0-7d78-4f70-a4be-081e38d09e8b => generated 1338 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:58:23.845550 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-df0ec83b-c7cd-4634-a313-6a676b0c61df tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:58:23.851587 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-df0ec83b-c7cd-4634-a313-6a676b0c61df tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] [instance: 320f9a98-969f-473e-bc56-842bbd28dedc] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:58:23.869095 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-df0ec83b-c7cd-4634-a313-6a676b0c61df tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:23.869786 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-df0ec83b-c7cd-4634-a313-6a676b0c61df tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:23.870634 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-df0ec83b-c7cd-4634-a313-6a676b0c61df tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:23.871630 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-df0ec83b-c7cd-4634-a313-6a676b0c61df tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:23.872250 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-df0ec83b-c7cd-4634-a313-6a676b0c61df tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:23.873168 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-df0ec83b-c7cd-4634-a313-6a676b0c61df tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:23.876884 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-6d200925-a10b-492a-b603-61089cb12fc3 tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034056e41cbe4111ba8fcd5e48273007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1e31ed067d4e85aab983e532ab399c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:58:23.904060 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-6d200925-a10b-492a-b603-61089cb12fc3 tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] 10.222.0.33 "GET /compute/v2.1/servers/e32774eb-128e-499d-b15e-f93f4c57d9e0" status: 200 len: 1325 microversion: 2.1 time: 0.832901 Oct 04 20:58:23.920022 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2343/4728] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:58:23 2022] GET /compute/v2.1/servers/e32774eb-128e-499d-b15e-f93f4c57d9e0 => generated 1325 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:58:24.398478 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-df0ec83b-c7cd-4634-a313-6a676b0c61df tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6513f5e908ac4d028cad6eeeebeab285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65946afc398d4a9fb1c9095a4f946e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:58:24.412944 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-df0ec83b-c7cd-4634-a313-6a676b0c61df tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc" status: 200 len: 1505 microversion: 2.1 time: 0.572643 Oct 04 20:58:24.420594 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2386/4729] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:58:23 2022] GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc => generated 1505 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:58:24.855235 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-f92e5007-7909-47e4-9957-c069a436934e tempest-ServersAaction247Test-724016890 tempest-ServersAaction247Test-724016890-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:58:24.856910 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-249cbb8f-df6d-47aa-8d20-4711cc5d1102 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1268563249", "imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "780a66b6-435f-46df-9c7b-6f763e190356"}]}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:58:24.857161 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-f92e5007-7909-47e4-9957-c069a436934e tempest-ServersAaction247Test-724016890 tempest-ServersAaction247Test-724016890-project] [instance: efdf16f0-7d78-4f70-a4be-081e38d09e8b] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:58:24.867578 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-249cbb8f-df6d-47aa-8d20-4711cc5d1102 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Request method failure captured: Oct 04 20:58:24.867578 n-d-854823-8 devstack@n-api.service[128801]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 20:58:24.867578 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:58:24.867578 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:58:24.867578 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:58:24.867578 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 492 Oct 04 20:58:24.867578 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:58:24.867578 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:58:24.867578 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:58:24.867578 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:58:24.867578 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJ4eaBM_FLl2jaN3nQraRbM94DgE-qlLjkCPNJ1Ol7VvkbIGIp-m_lAuwAay2VJ7lXD5niLtaDpJGDoHOJTljuI2aLuReHvX6jQr-uTgC01ZM2s7p6j6gq6a-1PaGQN0mcmcJntCqSnEEt5MEM6DdrOOdi5eEtsfyNU4EpDYmca-Ylo Oct 04 20:58:24.867578 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:58:24.867578 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:58:24.867578 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:58:24.867578 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:58:24.867578 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:58:24.867578 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:58:24.867578 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: 65946afc398d4a9fb1c9095a4f946e07 Oct 04 20:58:24.867578 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-ServersNegativeTestJSON-1097186397 Oct 04 20:58:24.867578 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 20:58:24.867578 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 20:58:24.867578 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_65946afc398d4a9fb1c9095a4f946e07", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/65946afc398d4a9fb1c9095a4f946e07"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/65946afc398d4a9fb1c9095a4f946e07"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/65946afc398d4a9fb1c9095a4f946e07"}]}] Oct 04 20:58:24.867578 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-ServersNegativeTestJSON-1097186397 Oct 04 20:58:24.867578 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: 65946afc398d4a9fb1c9095a4f946e07 Oct 04 20:58:24.867578 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1097186397 Oct 04 20:58:24.867578 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-ServersNegativeTestJSON-1097186397-project Oct 04 20:58:24.867578 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:58:24.867578 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:58:24.867578 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: 6513f5e908ac4d028cad6eeeebeab285 Oct 04 20:58:24.867578 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-ServersNegativeTestJSON-1097186397-project Oct 04 20:58:24.867578 n-d-854823-8 devstack@n-api.service[128801]: Oct 04 20:58:24.867578 n-d-854823-8 devstack@n-api.service[128801]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1268563249", "imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "780a66b6-435f-46df-9c7b-6f763e190356"}]}} Oct 04 20:58:24.867578 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 20:58:24.867578 n-d-854823-8 devstack@n-api.service[128801]: exception: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 04 20:58:24.867578 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1268563249', 'imageRef': '15b24725-0c99-4bcf-b1fb-907cdf8e2d63', 'flavorRef': '452', 'metadata': {'a': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}, 'networks': [{'uuid': '780a66b6-435f-46df-9c7b-6f763e190356'}]}}} Oct 04 20:58:24.867578 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:58:24.867578 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:58:24.867578 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 20:58:24.867578 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 20:58:24.867578 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 20:58:24.867578 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise error Oct 04 20:58:24.867578 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 04 20:58:24.867578 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:58:24.867578 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['metadata']['patternProperties']['^[a-zA-Z0-9-_:. ]{1,255}$']: Oct 04 20:58:24.867578 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi {'maxLength': 255, 'type': 'string'} Oct 04 20:58:24.867578 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:58:24.867578 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi On instance['server']['metadata']: Oct 04 20:58:24.871506 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' Oct 04 20:58:24.871506 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:58:24.871506 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:58:24.871506 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:58:24.871506 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:58:24.871506 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:58:24.871506 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:58:24.871506 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:58:24.871506 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:58:24.871506 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:58:24.871506 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:58:24.871506 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:58:24.871506 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:58:24.871506 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 20:58:24.871506 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 20:58:24.871506 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 20:58:24.871506 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 20:58:24.871506 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 20:58:24.871506 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 20:58:24.871506 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 04 20:58:24.871506 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:58:24.871506 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:58:24.871506 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:58:24.871506 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:58:24.871506 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:58:24.871506 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:58:24.871506 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 20:58:24.871506 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 20:58:24.871506 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 04 20:58:24.871506 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:58:24.875461 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-249cbb8f-df6d-47aa-8d20-4711cc5d1102 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Returning 400 to user: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:58:24.876522 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-249cbb8f-df6d-47aa-8d20-4711cc5d1102 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 400 len: 624 microversion: 2.1 time: 0.031352 Oct 04 20:58:24.881394 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2344/4730] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 20:58:24 2022] POST /compute/v2.1/servers => generated 624 bytes in 37 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 20:58:24.885299 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f92e5007-7909-47e4-9957-c069a436934e tempest-ServersAaction247Test-724016890 tempest-ServersAaction247Test-724016890-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:24.888603 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f92e5007-7909-47e4-9957-c069a436934e tempest-ServersAaction247Test-724016890 tempest-ServersAaction247Test-724016890-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:24.888956 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f92e5007-7909-47e4-9957-c069a436934e tempest-ServersAaction247Test-724016890 tempest-ServersAaction247Test-724016890-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:24.893568 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f92e5007-7909-47e4-9957-c069a436934e tempest-ServersAaction247Test-724016890 tempest-ServersAaction247Test-724016890-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:24.895826 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f92e5007-7909-47e4-9957-c069a436934e tempest-ServersAaction247Test-724016890 tempest-ServersAaction247Test-724016890-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:24.896249 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f92e5007-7909-47e4-9957-c069a436934e tempest-ServersAaction247Test-724016890 tempest-ServersAaction247Test-724016890-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:24.897096 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-44ad5e93-b93b-4800-9e1e-1304fab2eb80 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:58:24.898398 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-44ad5e93-b93b-4800-9e1e-1304fab2eb80 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] [instance: 320f9a98-969f-473e-bc56-842bbd28dedc] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:58:24.927489 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-44ad5e93-b93b-4800-9e1e-1304fab2eb80 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:24.928328 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-44ad5e93-b93b-4800-9e1e-1304fab2eb80 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:24.931376 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-44ad5e93-b93b-4800-9e1e-1304fab2eb80 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:24.932374 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-44ad5e93-b93b-4800-9e1e-1304fab2eb80 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:24.938660 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-44ad5e93-b93b-4800-9e1e-1304fab2eb80 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:24.939679 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-44ad5e93-b93b-4800-9e1e-1304fab2eb80 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:25.288117 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-f92e5007-7909-47e4-9957-c069a436934e tempest-ServersAaction247Test-724016890 tempest-ServersAaction247Test-724016890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8636fdad74c483eb84aeb7524858a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcea08e8eb0a4d17b4a0f952915bca7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:58:25.305310 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-f92e5007-7909-47e4-9957-c069a436934e tempest-ServersAaction247Test-724016890 tempest-ServersAaction247Test-724016890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8636fdad74c483eb84aeb7524858a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcea08e8eb0a4d17b4a0f952915bca7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:58:25.307588 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-f92e5007-7909-47e4-9957-c069a436934e tempest-ServersAaction247Test-724016890 tempest-ServersAaction247Test-724016890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8636fdad74c483eb84aeb7524858a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcea08e8eb0a4d17b4a0f952915bca7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:58:25.311327 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-f92e5007-7909-47e4-9957-c069a436934e tempest-ServersAaction247Test-724016890 tempest-ServersAaction247Test-724016890-project] 10.222.0.33 "GET /compute/v2.1/servers/efdf16f0-7d78-4f70-a4be-081e38d09e8b" status: 200 len: 1359 microversion: 2.47 time: 0.460258 Oct 04 20:58:25.326373 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2387/4731] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:58:24 2022] GET /compute/v2.1/servers/efdf16f0-7d78-4f70-a4be-081e38d09e8b => generated 1359 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 20:58:25.328972 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-4b469407-63d1-4a2b-8766-f7a0fd8c5560 tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:58:25.334660 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-4b469407-63d1-4a2b-8766-f7a0fd8c5560 tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] [instance: e32774eb-128e-499d-b15e-f93f4c57d9e0] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:58:25.349385 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4b469407-63d1-4a2b-8766-f7a0fd8c5560 tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:25.353187 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4b469407-63d1-4a2b-8766-f7a0fd8c5560 tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:25.353774 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4b469407-63d1-4a2b-8766-f7a0fd8c5560 tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:25.355128 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4b469407-63d1-4a2b-8766-f7a0fd8c5560 tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:25.356731 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4b469407-63d1-4a2b-8766-f7a0fd8c5560 tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:25.358039 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4b469407-63d1-4a2b-8766-f7a0fd8c5560 tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:25.808488 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-44ad5e93-b93b-4800-9e1e-1304fab2eb80 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6513f5e908ac4d028cad6eeeebeab285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65946afc398d4a9fb1c9095a4f946e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:58:25.823353 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-44ad5e93-b93b-4800-9e1e-1304fab2eb80 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc" status: 200 len: 1505 microversion: 2.1 time: 0.939152 Oct 04 20:58:25.845796 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2345/4732] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:58:24 2022] GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc => generated 1505 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:58:25.873690 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-5c87c7f5-fa34-4ad3-91a0-d9f64a9ed6e7 req-2ec3c09d-20f6-46d2-b63d-ac05b8d07013 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e32774eb-128e-499d-b15e-f93f4c57d9e0", "name": "network-vif-plugged", "status": "completed", "tag": "dc501e3b-439f-430e-a019-e7dca5fff08f"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:58:25.921757 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-5c87c7f5-fa34-4ad3-91a0-d9f64a9ed6e7 req-2ec3c09d-20f6-46d2-b63d-ac05b8d07013 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:25.922482 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-5c87c7f5-fa34-4ad3-91a0-d9f64a9ed6e7 req-2ec3c09d-20f6-46d2-b63d-ac05b8d07013 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:25.924592 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-5c87c7f5-fa34-4ad3-91a0-d9f64a9ed6e7 req-2ec3c09d-20f6-46d2-b63d-ac05b8d07013 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:25.959100 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-5c87c7f5-fa34-4ad3-91a0-d9f64a9ed6e7 req-2ec3c09d-20f6-46d2-b63d-ac05b8d07013 service nova] Creating event network-vif-plugged:dc501e3b-439f-430e-a019-e7dca5fff08f for instance e32774eb-128e-499d-b15e-f93f4c57d9e0 on n-h2-854823-8 Oct 04 20:58:25.972640 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-5c87c7f5-fa34-4ad3-91a0-d9f64a9ed6e7 req-2ec3c09d-20f6-46d2-b63d-ac05b8d07013 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125391 Oct 04 20:58:25.975615 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2346/4733] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:58:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:58:25.994003 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-014e9889-ad30-4861-b0af-9acb76600515 tempest-ServersAaction247Test-724016890 tempest-ServersAaction247Test-724016890-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-432442312"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:58:26.000059 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-014e9889-ad30-4861-b0af-9acb76600515 tempest-ServersAaction247Test-724016890 tempest-ServersAaction247Test-724016890-project] [instance: efdf16f0-7d78-4f70-a4be-081e38d09e8b] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:58:26.021660 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-014e9889-ad30-4861-b0af-9acb76600515 tempest-ServersAaction247Test-724016890 tempest-ServersAaction247Test-724016890-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:26.024348 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-014e9889-ad30-4861-b0af-9acb76600515 tempest-ServersAaction247Test-724016890 tempest-ServersAaction247Test-724016890-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:26.024915 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-014e9889-ad30-4861-b0af-9acb76600515 tempest-ServersAaction247Test-724016890 tempest-ServersAaction247Test-724016890-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:26.027587 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-014e9889-ad30-4861-b0af-9acb76600515 tempest-ServersAaction247Test-724016890 tempest-ServersAaction247Test-724016890-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:26.029432 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-014e9889-ad30-4861-b0af-9acb76600515 tempest-ServersAaction247Test-724016890 tempest-ServersAaction247Test-724016890-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:26.031102 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-014e9889-ad30-4861-b0af-9acb76600515 tempest-ServersAaction247Test-724016890 tempest-ServersAaction247Test-724016890-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:26.185446 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-4b469407-63d1-4a2b-8766-f7a0fd8c5560 tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034056e41cbe4111ba8fcd5e48273007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1e31ed067d4e85aab983e532ab399c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:58:26.196588 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-4b469407-63d1-4a2b-8766-f7a0fd8c5560 tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] 10.222.0.33 "GET /compute/v2.1/servers/e32774eb-128e-499d-b15e-f93f4c57d9e0" status: 200 len: 1325 microversion: 2.1 time: 0.879762 Oct 04 20:58:26.197208 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2388/4734] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:58:25 2022] GET /compute/v2.1/servers/e32774eb-128e-499d-b15e-f93f4c57d9e0 => generated 1325 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:58:26.228701 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-cd6d7c28-b948-4fc2-b643-d7b3a430ba29 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:58:26.229648 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-cd6d7c28-b948-4fc2-b643-d7b3a430ba29 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] [instance: 320f9a98-969f-473e-bc56-842bbd28dedc] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:58:26.278388 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cd6d7c28-b948-4fc2-b643-d7b3a430ba29 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:26.278388 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cd6d7c28-b948-4fc2-b643-d7b3a430ba29 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:26.278388 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cd6d7c28-b948-4fc2-b643-d7b3a430ba29 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:26.279094 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cd6d7c28-b948-4fc2-b643-d7b3a430ba29 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:26.286668 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cd6d7c28-b948-4fc2-b643-d7b3a430ba29 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:26.287704 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cd6d7c28-b948-4fc2-b643-d7b3a430ba29 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:26.579206 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=100 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:58:26.686641 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-014e9889-ad30-4861-b0af-9acb76600515 tempest-ServersAaction247Test-724016890 tempest-ServersAaction247Test-724016890-project] 10.222.0.33 "POST /compute/v2.1/servers/efdf16f0-7d78-4f70-a4be-081e38d09e8b/action" status: 202 len: 52 microversion: 2.47 time: 0.708891 Oct 04 20:58:26.695473 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2347/4735] 10.222.0.33 () {62 vars in 1319 bytes} [Tue Oct 4 20:58:25 2022] POST /compute/v2.1/servers/efdf16f0-7d78-4f70-a4be-081e38d09e8b/action => generated 52 bytes in 719 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Oct 04 20:58:26.713458 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a69bfc56-890c-4132-b686-765b1d579711 tempest-ServersAaction247Test-724016890 tempest-ServersAaction247Test-724016890-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:58:26.715452 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a69bfc56-890c-4132-b686-765b1d579711 tempest-ServersAaction247Test-724016890 tempest-ServersAaction247Test-724016890-project] [instance: efdf16f0-7d78-4f70-a4be-081e38d09e8b] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:58:26.730305 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a69bfc56-890c-4132-b686-765b1d579711 tempest-ServersAaction247Test-724016890 tempest-ServersAaction247Test-724016890-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:26.733104 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a69bfc56-890c-4132-b686-765b1d579711 tempest-ServersAaction247Test-724016890 tempest-ServersAaction247Test-724016890-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:26.733781 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a69bfc56-890c-4132-b686-765b1d579711 tempest-ServersAaction247Test-724016890 tempest-ServersAaction247Test-724016890-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:26.736330 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a69bfc56-890c-4132-b686-765b1d579711 tempest-ServersAaction247Test-724016890 tempest-ServersAaction247Test-724016890-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:26.737250 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a69bfc56-890c-4132-b686-765b1d579711 tempest-ServersAaction247Test-724016890 tempest-ServersAaction247Test-724016890-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:26.737690 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a69bfc56-890c-4132-b686-765b1d579711 tempest-ServersAaction247Test-724016890 tempest-ServersAaction247Test-724016890-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:26.811802 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a69bfc56-890c-4132-b686-765b1d579711 tempest-ServersAaction247Test-724016890 tempest-ServersAaction247Test-724016890-project] [instance: efdf16f0-7d78-4f70-a4be-081e38d09e8b] Going to try to terminate instance {{(pid=128801) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:58:27.101979 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a69bfc56-890c-4132-b686-765b1d579711 tempest-ServersAaction247Test-724016890 tempest-ServersAaction247Test-724016890-project] 10.222.0.33 "DELETE /compute/v2.1/servers/efdf16f0-7d78-4f70-a4be-081e38d09e8b" status: 204 len: 0 microversion: 2.47 time: 0.402037 Oct 04 20:58:27.103693 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2348/4736] 10.222.0.33 () {60 vars in 1280 bytes} [Tue Oct 4 20:58:26 2022] DELETE /compute/v2.1/servers/efdf16f0-7d78-4f70-a4be-081e38d09e8b => generated 0 bytes in 405 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 20:58:27.112039 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-cd6d7c28-b948-4fc2-b643-d7b3a430ba29 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6513f5e908ac4d028cad6eeeebeab285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65946afc398d4a9fb1c9095a4f946e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:58:27.113923 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a4381603-0d03-4f6a-91ea-0254a717e9ea tempest-ServersAaction247Test-724016890 tempest-ServersAaction247Test-724016890-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:58:27.115006 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a4381603-0d03-4f6a-91ea-0254a717e9ea tempest-ServersAaction247Test-724016890 tempest-ServersAaction247Test-724016890-project] [instance: efdf16f0-7d78-4f70-a4be-081e38d09e8b] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:58:27.122058 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-cd6d7c28-b948-4fc2-b643-d7b3a430ba29 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc" status: 200 len: 1505 microversion: 2.1 time: 0.910580 Oct 04 20:58:27.132575 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a4381603-0d03-4f6a-91ea-0254a717e9ea tempest-ServersAaction247Test-724016890 tempest-ServersAaction247Test-724016890-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:27.133083 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2389/4737] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:58:26 2022] GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc => generated 1505 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:58:27.135502 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a4381603-0d03-4f6a-91ea-0254a717e9ea tempest-ServersAaction247Test-724016890 tempest-ServersAaction247Test-724016890-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:27.137952 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a4381603-0d03-4f6a-91ea-0254a717e9ea tempest-ServersAaction247Test-724016890 tempest-ServersAaction247Test-724016890-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:27.140923 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a4381603-0d03-4f6a-91ea-0254a717e9ea tempest-ServersAaction247Test-724016890 tempest-ServersAaction247Test-724016890-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:27.148396 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a4381603-0d03-4f6a-91ea-0254a717e9ea tempest-ServersAaction247Test-724016890 tempest-ServersAaction247Test-724016890-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:27.152409 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a4381603-0d03-4f6a-91ea-0254a717e9ea tempest-ServersAaction247Test-724016890 tempest-ServersAaction247Test-724016890-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:27.221134 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-fac45f2d-2a47-4468-aad5-11825a9b6f9d tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:58:27.223493 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-fac45f2d-2a47-4468-aad5-11825a9b6f9d tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] [instance: e32774eb-128e-499d-b15e-f93f4c57d9e0] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:58:27.237697 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fac45f2d-2a47-4468-aad5-11825a9b6f9d tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:27.239142 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fac45f2d-2a47-4468-aad5-11825a9b6f9d tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:27.248100 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fac45f2d-2a47-4468-aad5-11825a9b6f9d tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:27.250308 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fac45f2d-2a47-4468-aad5-11825a9b6f9d tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:27.252177 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fac45f2d-2a47-4468-aad5-11825a9b6f9d tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:27.255639 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fac45f2d-2a47-4468-aad5-11825a9b6f9d tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:27.529199 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-a4381603-0d03-4f6a-91ea-0254a717e9ea tempest-ServersAaction247Test-724016890 tempest-ServersAaction247Test-724016890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8636fdad74c483eb84aeb7524858a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcea08e8eb0a4d17b4a0f952915bca7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:58:27.539326 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-a4381603-0d03-4f6a-91ea-0254a717e9ea tempest-ServersAaction247Test-724016890 tempest-ServersAaction247Test-724016890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8636fdad74c483eb84aeb7524858a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcea08e8eb0a4d17b4a0f952915bca7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:58:27.544439 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-a4381603-0d03-4f6a-91ea-0254a717e9ea tempest-ServersAaction247Test-724016890 tempest-ServersAaction247Test-724016890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8636fdad74c483eb84aeb7524858a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcea08e8eb0a4d17b4a0f952915bca7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:58:27.548108 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a4381603-0d03-4f6a-91ea-0254a717e9ea tempest-ServersAaction247Test-724016890 tempest-ServersAaction247Test-724016890-project] 10.222.0.33 "GET /compute/v2.1/servers/efdf16f0-7d78-4f70-a4be-081e38d09e8b" status: 200 len: 1365 microversion: 2.47 time: 0.440032 Oct 04 20:58:27.552187 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2349/4738] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:58:27 2022] GET /compute/v2.1/servers/efdf16f0-7d78-4f70-a4be-081e38d09e8b => generated 1365 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 20:58:27.583472 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d2743bd5-66aa-4070-b848-cf37bfd73054 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Action: 'create', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63", "flavorRef": "452", "networks": [{"uuid": "780a66b6-435f-46df-9c7b-6f763e190356"}]}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:58:27.587999 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d2743bd5-66aa-4070-b848-cf37bfd73054 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Request method failure captured: Oct 04 20:58:27.587999 n-d-854823-8 devstack@n-api.service[128801]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 20:58:27.587999 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:58:27.587999 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:58:27.587999 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:58:27.587999 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 416 Oct 04 20:58:27.587999 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:58:27.587999 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:58:27.587999 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:58:27.587999 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:58:27.587999 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJ4eaBM_FLl2jaN3nQraRbM94DgE-qlLjkCPNJ1Ol7VvkbIGIp-m_lAuwAay2VJ7lXD5niLtaDpJGDoHOJTljuI2aLuReHvX6jQr-uTgC01ZM2s7p6j6gq6a-1PaGQN0mcmcJntCqSnEEt5MEM6DdrOOdi5eEtsfyNU4EpDYmca-Ylo Oct 04 20:58:27.587999 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:58:27.587999 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:58:27.587999 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:58:27.587999 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:58:27.587999 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:58:27.587999 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:58:27.587999 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: 65946afc398d4a9fb1c9095a4f946e07 Oct 04 20:58:27.587999 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-ServersNegativeTestJSON-1097186397 Oct 04 20:58:27.587999 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 20:58:27.587999 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 20:58:27.587999 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_65946afc398d4a9fb1c9095a4f946e07", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/65946afc398d4a9fb1c9095a4f946e07"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/65946afc398d4a9fb1c9095a4f946e07"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/65946afc398d4a9fb1c9095a4f946e07"}]}] Oct 04 20:58:27.587999 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-ServersNegativeTestJSON-1097186397 Oct 04 20:58:27.587999 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: 65946afc398d4a9fb1c9095a4f946e07 Oct 04 20:58:27.587999 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1097186397 Oct 04 20:58:27.587999 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-ServersNegativeTestJSON-1097186397-project Oct 04 20:58:27.587999 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:58:27.587999 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:58:27.587999 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: 6513f5e908ac4d028cad6eeeebeab285 Oct 04 20:58:27.587999 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-ServersNegativeTestJSON-1097186397-project Oct 04 20:58:27.587999 n-d-854823-8 devstack@n-api.service[128801]: Oct 04 20:58:27.587999 n-d-854823-8 devstack@n-api.service[128801]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63", "flavorRef": "452", "networks": [{"uuid": "780a66b6-435f-46df-9c7b-6f763e190356"}]}} Oct 04 20:58:27.587999 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 20:58:27.587999 n-d-854823-8 devstack@n-api.service[128801]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 04 20:58:27.587999 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'imageRef': '15b24725-0c99-4bcf-b1fb-907cdf8e2d63', 'flavorRef': '452', 'networks': [{'uuid': '780a66b6-435f-46df-9c7b-6f763e190356'}]}}} Oct 04 20:58:27.587999 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:58:27.587999 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:58:27.587999 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 20:58:27.587999 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 20:58:27.587999 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 20:58:27.587999 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise error Oct 04 20:58:27.587999 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 04 20:58:27.587999 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:58:27.587999 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Oct 04 20:58:27.587999 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 04 20:58:27.587999 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:58:27.587999 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 04 20:58:27.587999 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 04 20:58:27.587999 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:58:27.587999 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:58:27.591706 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:58:27.591706 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:58:27.591706 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:58:27.591706 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:58:27.591706 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:58:27.591706 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:58:27.591706 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:58:27.591706 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:58:27.591706 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:58:27.591706 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:58:27.591706 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 20:58:27.591706 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 20:58:27.591706 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 20:58:27.591706 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 20:58:27.591706 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 20:58:27.591706 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 20:58:27.591706 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 04 20:58:27.591706 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:58:27.591706 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:58:27.591706 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:58:27.591706 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:58:27.591706 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:58:27.591706 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:58:27.591706 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 20:58:27.591706 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 20:58:27.591706 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 04 20:58:27.591706 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:58:27.599459 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d2743bd5-66aa-4070-b848-cf37bfd73054 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:58:27.606433 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d2743bd5-66aa-4070-b848-cf37bfd73054 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 400 len: 619 microversion: 2.1 time: 0.027422 Oct 04 20:58:27.607668 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2350/4739] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 20:58:27 2022] POST /compute/v2.1/servers => generated 619 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 20:58:27.619544 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-cd45a141-c782-4135-b7f4-2b26aefb947f tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:58:27.627273 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-cd45a141-c782-4135-b7f4-2b26aefb947f tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] [instance: 320f9a98-969f-473e-bc56-842bbd28dedc] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:58:27.639871 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cd45a141-c782-4135-b7f4-2b26aefb947f tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:27.640784 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cd45a141-c782-4135-b7f4-2b26aefb947f tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:27.641459 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cd45a141-c782-4135-b7f4-2b26aefb947f tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:27.647501 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cd45a141-c782-4135-b7f4-2b26aefb947f tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:27.648171 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cd45a141-c782-4135-b7f4-2b26aefb947f tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:27.648723 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cd45a141-c782-4135-b7f4-2b26aefb947f tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:27.994680 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-fac45f2d-2a47-4468-aad5-11825a9b6f9d tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034056e41cbe4111ba8fcd5e48273007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1e31ed067d4e85aab983e532ab399c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:58:28.002772 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-fac45f2d-2a47-4468-aad5-11825a9b6f9d tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] 10.222.0.33 "GET /compute/v2.1/servers/e32774eb-128e-499d-b15e-f93f4c57d9e0" status: 200 len: 1325 microversion: 2.1 time: 0.785433 Oct 04 20:58:28.006856 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2390/4740] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:58:27 2022] GET /compute/v2.1/servers/e32774eb-128e-499d-b15e-f93f4c57d9e0 => generated 1325 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:58:28.298110 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-cd45a141-c782-4135-b7f4-2b26aefb947f tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6513f5e908ac4d028cad6eeeebeab285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65946afc398d4a9fb1c9095a4f946e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:58:28.313679 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-cd45a141-c782-4135-b7f4-2b26aefb947f tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc" status: 200 len: 1505 microversion: 2.1 time: 0.698612 Oct 04 20:58:28.322413 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2351/4741] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:58:27 2022] GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc => generated 1505 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:58:28.340828 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-72713e2e-0625-48c3-9f3b-458164987bc5 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:58:28.341445 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-72713e2e-0625-48c3-9f3b-458164987bc5 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] [instance: 320f9a98-969f-473e-bc56-842bbd28dedc] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:58:28.358538 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-72713e2e-0625-48c3-9f3b-458164987bc5 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:28.366589 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-72713e2e-0625-48c3-9f3b-458164987bc5 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:28.367189 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-72713e2e-0625-48c3-9f3b-458164987bc5 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:28.367961 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-72713e2e-0625-48c3-9f3b-458164987bc5 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:28.369776 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-72713e2e-0625-48c3-9f3b-458164987bc5 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:28.370211 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-72713e2e-0625-48c3-9f3b-458164987bc5 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:28.581139 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-4a89454b-b761-430f-a863-6f0efde2f95c tempest-ServersAaction247Test-724016890 tempest-ServersAaction247Test-724016890-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:58:28.583587 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-4a89454b-b761-430f-a863-6f0efde2f95c tempest-ServersAaction247Test-724016890 tempest-ServersAaction247Test-724016890-project] [instance: efdf16f0-7d78-4f70-a4be-081e38d09e8b] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:58:28.595105 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4a89454b-b761-430f-a863-6f0efde2f95c tempest-ServersAaction247Test-724016890 tempest-ServersAaction247Test-724016890-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:28.600396 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4a89454b-b761-430f-a863-6f0efde2f95c tempest-ServersAaction247Test-724016890 tempest-ServersAaction247Test-724016890-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:28.601480 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4a89454b-b761-430f-a863-6f0efde2f95c tempest-ServersAaction247Test-724016890 tempest-ServersAaction247Test-724016890-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:28.614046 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4a89454b-b761-430f-a863-6f0efde2f95c tempest-ServersAaction247Test-724016890 tempest-ServersAaction247Test-724016890-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:28.616595 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4a89454b-b761-430f-a863-6f0efde2f95c tempest-ServersAaction247Test-724016890 tempest-ServersAaction247Test-724016890-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:28.617670 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4a89454b-b761-430f-a863-6f0efde2f95c tempest-ServersAaction247Test-724016890 tempest-ServersAaction247Test-724016890-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:29.010824 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:58:29.074726 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=6 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:58:29.481182 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-4a89454b-b761-430f-a863-6f0efde2f95c tempest-ServersAaction247Test-724016890 tempest-ServersAaction247Test-724016890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8636fdad74c483eb84aeb7524858a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcea08e8eb0a4d17b4a0f952915bca7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:58:29.510403 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-4a89454b-b761-430f-a863-6f0efde2f95c tempest-ServersAaction247Test-724016890 tempest-ServersAaction247Test-724016890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8636fdad74c483eb84aeb7524858a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcea08e8eb0a4d17b4a0f952915bca7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:58:29.518002 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-4a89454b-b761-430f-a863-6f0efde2f95c tempest-ServersAaction247Test-724016890 tempest-ServersAaction247Test-724016890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8636fdad74c483eb84aeb7524858a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcea08e8eb0a4d17b4a0f952915bca7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:58:29.524139 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-4a89454b-b761-430f-a863-6f0efde2f95c tempest-ServersAaction247Test-724016890 tempest-ServersAaction247Test-724016890-project] 10.222.0.33 "GET /compute/v2.1/servers/efdf16f0-7d78-4f70-a4be-081e38d09e8b" status: 200 len: 1365 microversion: 2.47 time: 0.946835 Oct 04 20:58:29.535009 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell0:SELECT=2 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:58:29.544058 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2352/4742] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:58:28 2022] GET /compute/v2.1/servers/efdf16f0-7d78-4f70-a4be-081e38d09e8b => generated 1365 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 20:58:29.549339 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d17cd658-793e-4281-9b48-95d0c85b08f7 tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:58:29.568091 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d17cd658-793e-4281-9b48-95d0c85b08f7 tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] [instance: e32774eb-128e-499d-b15e-f93f4c57d9e0] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:58:29.583303 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d17cd658-793e-4281-9b48-95d0c85b08f7 tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:29.585104 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d17cd658-793e-4281-9b48-95d0c85b08f7 tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:29.586106 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d17cd658-793e-4281-9b48-95d0c85b08f7 tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:29.587838 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d17cd658-793e-4281-9b48-95d0c85b08f7 tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:29.589153 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d17cd658-793e-4281-9b48-95d0c85b08f7 tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:29.589907 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d17cd658-793e-4281-9b48-95d0c85b08f7 tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:29.786700 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-72713e2e-0625-48c3-9f3b-458164987bc5 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6513f5e908ac4d028cad6eeeebeab285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65946afc398d4a9fb1c9095a4f946e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:58:29.805002 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-72713e2e-0625-48c3-9f3b-458164987bc5 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc" status: 200 len: 1505 microversion: 2.1 time: 1.470868 Oct 04 20:58:29.805617 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2391/4743] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:58:28 2022] GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc => generated 1505 bytes in 1472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:58:30.126756 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-0fe380ef-0bee-45d7-8c5f-8f031336136b tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1353466360", "imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63", "flavorRef": -1, "networks": [{"uuid": "780a66b6-435f-46df-9c7b-6f763e190356"}]}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:58:30.178313 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.wsgi [None req-0fe380ef-0bee-45d7-8c5f-8f031336136b tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] HTTP exception thrown: Flavor -1 could not be found. Oct 04 20:58:30.183282 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-0fe380ef-0bee-45d7-8c5f-8f031336136b tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Request method failure captured: Oct 04 20:58:30.183282 n-d-854823-8 devstack@n-api.service[128802]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 20:58:30.183282 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 20:58:30.183282 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 20:58:30.183282 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 20:58:30.183282 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 206 Oct 04 20:58:30.183282 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 20:58:30.183282 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 20:58:30.183282 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 20:58:30.183282 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 20:58:30.183282 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPJ4eaBM_FLl2jaN3nQraRbM94DgE-qlLjkCPNJ1Ol7VvkbIGIp-m_lAuwAay2VJ7lXD5niLtaDpJGDoHOJTljuI2aLuReHvX6jQr-uTgC01ZM2s7p6j6gq6a-1PaGQN0mcmcJntCqSnEEt5MEM6DdrOOdi5eEtsfyNU4EpDYmca-Ylo Oct 04 20:58:30.183282 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 20:58:30.183282 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 20:58:30.183282 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 20:58:30.183282 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 20:58:30.183282 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 20:58:30.183282 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 20:58:30.183282 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: 65946afc398d4a9fb1c9095a4f946e07 Oct 04 20:58:30.183282 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-ServersNegativeTestJSON-1097186397 Oct 04 20:58:30.183282 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 20:58:30.183282 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 20:58:30.183282 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_65946afc398d4a9fb1c9095a4f946e07", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/65946afc398d4a9fb1c9095a4f946e07"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/65946afc398d4a9fb1c9095a4f946e07"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/65946afc398d4a9fb1c9095a4f946e07"}]}] Oct 04 20:58:30.183282 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-ServersNegativeTestJSON-1097186397 Oct 04 20:58:30.183282 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: 65946afc398d4a9fb1c9095a4f946e07 Oct 04 20:58:30.183282 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1097186397 Oct 04 20:58:30.183282 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-ServersNegativeTestJSON-1097186397-project Oct 04 20:58:30.183282 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 20:58:30.183282 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 20:58:30.183282 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: 6513f5e908ac4d028cad6eeeebeab285 Oct 04 20:58:30.183282 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-ServersNegativeTestJSON-1097186397-project Oct 04 20:58:30.183282 n-d-854823-8 devstack@n-api.service[128802]: Oct 04 20:58:30.183282 n-d-854823-8 devstack@n-api.service[128802]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1353466360", "imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63", "flavorRef": -1, "networks": [{"uuid": "780a66b6-435f-46df-9c7b-6f763e190356"}]}} Oct 04 20:58:30.183282 n-d-854823-8 devstack@n-api.service[128802]: method: > Oct 04 20:58:30.183282 n-d-854823-8 devstack@n-api.service[128802]: exception: Flavor -1 could not be found. Oct 04 20:58:30.183282 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1353466360', 'imageRef': '15b24725-0c99-4bcf-b1fb-907cdf8e2d63', 'flavorRef': -1, 'networks': [{'uuid': '780a66b6-435f-46df-9c7b-6f763e190356'}]}}} Oct 04 20:58:30.183282 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:58:30.183282 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:58:30.183282 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Oct 04 20:58:30.183282 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Oct 04 20:58:30.183282 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 04 20:58:30.183282 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 04 20:58:30.183282 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 20:58:30.183282 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 20:58:30.183282 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 04 20:58:30.183282 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 04 20:58:30.183282 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 04 20:58:30.183282 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:58:30.183282 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 04 20:58:30.183282 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 04 20:58:30.183282 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor -1 could not be found. Oct 04 20:58:30.183282 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:58:30.183282 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:58:30.183282 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:58:30.183282 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:58:30.183282 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:58:30.183282 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:58:30.183282 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:58:30.183282 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:58:30.183282 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:58:30.183282 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:58:30.183282 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:58:30.183282 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:58:30.188546 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:58:30.188546 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:58:30.188546 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:58:30.188546 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:58:30.188546 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 20:58:30.188546 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 04 20:58:30.188546 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 04 20:58:30.188546 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor -1 could not be found. Oct 04 20:58:30.188546 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:58:30.188546 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:58:30.188546 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:58:30.188546 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:58:30.188546 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:58:30.188546 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:58:30.188546 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:58:30.188546 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:58:30.188546 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor -1 could not be found. Oct 04 20:58:30.188546 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:58:30.198255 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-0fe380ef-0bee-45d7-8c5f-8f031336136b tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Returning 400 to user: Flavor -1 could not be found. {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:58:30.199880 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-0fe380ef-0bee-45d7-8c5f-8f031336136b tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 400 len: 73 microversion: 2.1 time: 0.077128 Oct 04 20:58:30.205296 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2392/4744] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 20:58:30 2022] POST /compute/v2.1/servers => generated 73 bytes in 84 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Oct 04 20:58:30.230411 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-6a17fb60-5376-4297-b745-d9205e5b029c tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:58:30.231601 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-6a17fb60-5376-4297-b745-d9205e5b029c tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] [instance: 320f9a98-969f-473e-bc56-842bbd28dedc] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:58:30.257733 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6a17fb60-5376-4297-b745-d9205e5b029c tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:30.260863 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6a17fb60-5376-4297-b745-d9205e5b029c tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:30.261975 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6a17fb60-5376-4297-b745-d9205e5b029c tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:30.263048 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6a17fb60-5376-4297-b745-d9205e5b029c tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:30.264837 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6a17fb60-5376-4297-b745-d9205e5b029c tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:30.265468 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6a17fb60-5376-4297-b745-d9205e5b029c tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:30.564957 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d17cd658-793e-4281-9b48-95d0c85b08f7 tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034056e41cbe4111ba8fcd5e48273007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1e31ed067d4e85aab983e532ab399c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:58:30.576993 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d17cd658-793e-4281-9b48-95d0c85b08f7 tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] 10.222.0.33 "GET /compute/v2.1/servers/e32774eb-128e-499d-b15e-f93f4c57d9e0" status: 200 len: 1522 microversion: 2.1 time: 1.031374 Oct 04 20:58:30.578206 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2353/4745] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:58:29 2022] GET /compute/v2.1/servers/e32774eb-128e-499d-b15e-f93f4c57d9e0 => generated 1522 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:58:30.584071 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ef9bc52e-0763-4ccf-9d19-8f4b098a18b2 tempest-ServersAaction247Test-724016890 tempest-ServersAaction247Test-724016890-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:58:30.584964 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ef9bc52e-0763-4ccf-9d19-8f4b098a18b2 tempest-ServersAaction247Test-724016890 tempest-ServersAaction247Test-724016890-project] [instance: efdf16f0-7d78-4f70-a4be-081e38d09e8b] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:58:30.591329 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ef9bc52e-0763-4ccf-9d19-8f4b098a18b2 tempest-ServersAaction247Test-724016890 tempest-ServersAaction247Test-724016890-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:30.592135 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ef9bc52e-0763-4ccf-9d19-8f4b098a18b2 tempest-ServersAaction247Test-724016890 tempest-ServersAaction247Test-724016890-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:30.593363 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ef9bc52e-0763-4ccf-9d19-8f4b098a18b2 tempest-ServersAaction247Test-724016890 tempest-ServersAaction247Test-724016890-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:30.594313 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ef9bc52e-0763-4ccf-9d19-8f4b098a18b2 tempest-ServersAaction247Test-724016890 tempest-ServersAaction247Test-724016890-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:30.595035 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ef9bc52e-0763-4ccf-9d19-8f4b098a18b2 tempest-ServersAaction247Test-724016890 tempest-ServersAaction247Test-724016890-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:30.595707 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ef9bc52e-0763-4ccf-9d19-8f4b098a18b2 tempest-ServersAaction247Test-724016890 tempest-ServersAaction247Test-724016890-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:30.649877 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ef9bc52e-0763-4ccf-9d19-8f4b098a18b2 tempest-ServersAaction247Test-724016890 tempest-ServersAaction247Test-724016890-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:30.650802 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ef9bc52e-0763-4ccf-9d19-8f4b098a18b2 tempest-ServersAaction247Test-724016890 tempest-ServersAaction247Test-724016890-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:30.651567 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ef9bc52e-0763-4ccf-9d19-8f4b098a18b2 tempest-ServersAaction247Test-724016890 tempest-ServersAaction247Test-724016890-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:30.652314 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-ef9bc52e-0763-4ccf-9d19-8f4b098a18b2 tempest-ServersAaction247Test-724016890 tempest-ServersAaction247Test-724016890-project] Lazy-loading 'fault' on Instance uuid efdf16f0-7d78-4f70-a4be-081e38d09e8b {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:58:30.755774 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-ef9bc52e-0763-4ccf-9d19-8f4b098a18b2 tempest-ServersAaction247Test-724016890 tempest-ServersAaction247Test-724016890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8636fdad74c483eb84aeb7524858a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcea08e8eb0a4d17b4a0f952915bca7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:58:30.766561 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-6a17fb60-5376-4297-b745-d9205e5b029c tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6513f5e908ac4d028cad6eeeebeab285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65946afc398d4a9fb1c9095a4f946e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:58:30.776682 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-ef9bc52e-0763-4ccf-9d19-8f4b098a18b2 tempest-ServersAaction247Test-724016890 tempest-ServersAaction247Test-724016890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8636fdad74c483eb84aeb7524858a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcea08e8eb0a4d17b4a0f952915bca7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:58:30.778792 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-ef9bc52e-0763-4ccf-9d19-8f4b098a18b2 tempest-ServersAaction247Test-724016890 tempest-ServersAaction247Test-724016890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8636fdad74c483eb84aeb7524858a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcea08e8eb0a4d17b4a0f952915bca7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:58:30.780224 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ef9bc52e-0763-4ccf-9d19-8f4b098a18b2 tempest-ServersAaction247Test-724016890 tempest-ServersAaction247Test-724016890-project] 10.222.0.33 "GET /compute/v2.1/servers/efdf16f0-7d78-4f70-a4be-081e38d09e8b" status: 200 len: 1370 microversion: 2.47 time: 0.200760 Oct 04 20:58:30.781293 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2354/4746] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:58:30 2022] GET /compute/v2.1/servers/efdf16f0-7d78-4f70-a4be-081e38d09e8b => generated 1370 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:58:30.794892 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-6a17fb60-5376-4297-b745-d9205e5b029c tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc" status: 200 len: 1505 microversion: 2.1 time: 0.564380 Oct 04 20:58:30.795569 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2393/4747] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:58:30 2022] GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc => generated 1505 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:58:30.806740 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-68006900-42b2-426c-9d3e-cd08811f2857 tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:58:30.806740 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-68006900-42b2-426c-9d3e-cd08811f2857 tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] [instance: e32774eb-128e-499d-b15e-f93f4c57d9e0] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:58:30.830412 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-fca2c45e-0ae8-4205-a1ab-f4dd7d6cbf3d tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:58:30.831282 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-68006900-42b2-426c-9d3e-cd08811f2857 tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:30.831839 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-68006900-42b2-426c-9d3e-cd08811f2857 tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:30.835075 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-fca2c45e-0ae8-4205-a1ab-f4dd7d6cbf3d tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] [instance: 320f9a98-969f-473e-bc56-842bbd28dedc] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:58:30.837025 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-68006900-42b2-426c-9d3e-cd08811f2857 tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:30.837832 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-68006900-42b2-426c-9d3e-cd08811f2857 tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:30.838281 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-68006900-42b2-426c-9d3e-cd08811f2857 tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:30.838912 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-68006900-42b2-426c-9d3e-cd08811f2857 tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:30.855059 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fca2c45e-0ae8-4205-a1ab-f4dd7d6cbf3d tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:30.859682 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fca2c45e-0ae8-4205-a1ab-f4dd7d6cbf3d tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:30.860133 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fca2c45e-0ae8-4205-a1ab-f4dd7d6cbf3d tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:30.860881 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fca2c45e-0ae8-4205-a1ab-f4dd7d6cbf3d tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:30.861365 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fca2c45e-0ae8-4205-a1ab-f4dd7d6cbf3d tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:30.861798 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fca2c45e-0ae8-4205-a1ab-f4dd7d6cbf3d tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:30.906252 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-68006900-42b2-426c-9d3e-cd08811f2857 tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] HTTP exception thrown: Action 999 not found Oct 04 20:58:30.913401 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-68006900-42b2-426c-9d3e-cd08811f2857 tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] Request method failure captured: Oct 04 20:58:30.913401 n-d-854823-8 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/e32774eb-128e-499d-b15e-f93f4c57d9e0/os-instance-actions/999 HTTP/1.1 Oct 04 20:58:30.913401 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:58:30.913401 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:58:30.913401 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:58:30.913401 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 0 Oct 04 20:58:30.913401 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:58:30.913401 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:58:30.913401 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:58:30.913401 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:58:30.913401 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJ5VTODPmzUwYAv2V4imIY8w13nEys83lpLsR8I6qtxq_ufxhPeteQ-j3kSPVrINVh49M2EgPl2xauwpYfOh8PUDv0HE6cdFqbklydbccjryRdqyKtGsGWfgZDydKYSBEbbY-uqamHJAAPokENWJAlpcn7gQDxkVC98Ykvzdh54SYBw Oct 04 20:58:30.913401 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:58:30.913401 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:58:30.913401 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:58:30.913401 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:58:30.913401 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:58:30.913401 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:58:30.913401 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: cc1e31ed067d4e85aab983e532ab399c Oct 04 20:58:30.913401 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-752810805 Oct 04 20:58:30.913401 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 20:58:30.913401 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 20:58:30.913401 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_cc1e31ed067d4e85aab983e532ab399c", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cc1e31ed067d4e85aab983e532ab399c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cc1e31ed067d4e85aab983e532ab399c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/cc1e31ed067d4e85aab983e532ab399c"}]}] Oct 04 20:58:30.913401 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-752810805 Oct 04 20:58:30.913401 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: cc1e31ed067d4e85aab983e532ab399c Oct 04 20:58:30.913401 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-752810805 Oct 04 20:58:30.913401 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-InstanceActionsNegativeTestJSON-752810805-project Oct 04 20:58:30.913401 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:58:30.913401 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:58:30.913401 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: 034056e41cbe4111ba8fcd5e48273007 Oct 04 20:58:30.913401 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-752810805-project Oct 04 20:58:30.913401 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 20:58:30.913401 n-d-854823-8 devstack@n-api.service[128801]: exception: Action 999 not found Oct 04 20:58:30.913401 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'server_id': 'e32774eb-128e-499d-b15e-f93f4c57d9e0', 'id': '999'} Oct 04 20:58:30.913401 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:58:30.913401 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:58:30.913401 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:58:30.913401 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:58:30.913401 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:58:30.913401 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:58:30.913401 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:58:30.913401 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:58:30.913401 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 152, in show Oct 04 20:58:30.913401 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 04 20:58:30.913401 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Action 999 not found Oct 04 20:58:30.913401 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:58:30.913401 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:58:30.913401 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:58:30.913401 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:58:30.913401 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:58:30.913401 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:58:30.913401 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:58:30.913401 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:58:30.913401 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Action 999 not found Oct 04 20:58:30.913401 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:58:30.921333 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-68006900-42b2-426c-9d3e-cd08811f2857 tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] Returning 404 to user: Action 999 not found {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:58:30.922610 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-68006900-42b2-426c-9d3e-cd08811f2857 tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] 10.222.0.33 "GET /compute/v2.1/servers/e32774eb-128e-499d-b15e-f93f4c57d9e0/os-instance-actions/999" status: 404 len: 66 microversion: 2.1 time: 0.139319 Oct 04 20:58:30.932887 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2355/4748] 10.222.0.33 () {58 vars in 1308 bytes} [Tue Oct 4 20:58:30 2022] GET /compute/v2.1/servers/e32774eb-128e-499d-b15e-f93f4c57d9e0/os-instance-actions/999 => generated 66 bytes in 148 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 20:58:30.939128 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6976d651-8626-4d35-a4f4-e2ce539165b8 tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] Calling method '.version_select at 0x7f3c75061940>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:58:30.939726 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-6976d651-8626-4d35-a4f4-e2ce539165b8 tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] [instance: 5eca3d8f-7c56-4d11-a214-e7e659406b67] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:58:30.951292 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-6976d651-8626-4d35-a4f4-e2ce539165b8 tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] HTTP exception thrown: Instance 5eca3d8f-7c56-4d11-a214-e7e659406b67 could not be found. Oct 04 20:58:30.953104 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6976d651-8626-4d35-a4f4-e2ce539165b8 tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] Request method failure captured: Oct 04 20:58:30.953104 n-d-854823-8 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/5eca3d8f-7c56-4d11-a214-e7e659406b67/os-instance-actions HTTP/1.1 Oct 04 20:58:30.953104 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:58:30.953104 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:58:30.953104 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:58:30.953104 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 0 Oct 04 20:58:30.953104 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:58:30.953104 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:58:30.953104 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:58:30.953104 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:58:30.953104 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJ5VTODPmzUwYAv2V4imIY8w13nEys83lpLsR8I6qtxq_ufxhPeteQ-j3kSPVrINVh49M2EgPl2xauwpYfOh8PUDv0HE6cdFqbklydbccjryRdqyKtGsGWfgZDydKYSBEbbY-uqamHJAAPokENWJAlpcn7gQDxkVC98Ykvzdh54SYBw Oct 04 20:58:30.953104 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:58:30.953104 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:58:30.953104 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:58:30.953104 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:58:30.953104 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:58:30.953104 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:58:30.953104 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: cc1e31ed067d4e85aab983e532ab399c Oct 04 20:58:30.953104 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-752810805 Oct 04 20:58:30.953104 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 20:58:30.953104 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 20:58:30.953104 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_cc1e31ed067d4e85aab983e532ab399c", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cc1e31ed067d4e85aab983e532ab399c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cc1e31ed067d4e85aab983e532ab399c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/cc1e31ed067d4e85aab983e532ab399c"}]}] Oct 04 20:58:30.953104 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-752810805 Oct 04 20:58:30.953104 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: cc1e31ed067d4e85aab983e532ab399c Oct 04 20:58:30.953104 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-752810805 Oct 04 20:58:30.953104 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-InstanceActionsNegativeTestJSON-752810805-project Oct 04 20:58:30.953104 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:58:30.953104 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:58:30.953104 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: 034056e41cbe4111ba8fcd5e48273007 Oct 04 20:58:30.953104 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-752810805-project Oct 04 20:58:30.953104 n-d-854823-8 devstack@n-api.service[128801]: method: Oct 04 20:58:30.953104 n-d-854823-8 devstack@n-api.service[128801]: exception: Instance 5eca3d8f-7c56-4d11-a214-e7e659406b67 could not be found. Oct 04 20:58:30.953104 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'server_id': '5eca3d8f-7c56-4d11-a214-e7e659406b67'} Oct 04 20:58:30.953104 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:58:30.953104 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:58:30.953104 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:58:30.953104 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:58:30.953104 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:58:30.953104 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:58:30.953104 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 20:58:30.953104 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 20:58:30.953104 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5eca3d8f-7c56-4d11-a214-e7e659406b67 could not be found. Oct 04 20:58:30.953104 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:58:30.953104 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:58:30.953104 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:58:30.953104 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:58:30.953104 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:58:30.953104 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:58:30.953104 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:58:30.953104 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:58:30.953104 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:58:30.953104 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:58:30.953104 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:58:30.953104 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:58:30.953104 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 89, in index Oct 04 20:58:30.953104 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(req, context, server_id) Oct 04 20:58:30.953104 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 20:58:30.953104 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 20:58:30.953104 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 77, in _get_instance Oct 04 20:58:30.953104 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return common.get_instance(self.compute_api, context, server_id) Oct 04 20:58:30.953104 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:58:30.953104 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:58:30.957968 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5eca3d8f-7c56-4d11-a214-e7e659406b67 could not be found. Oct 04 20:58:30.957968 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:58:30.957968 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:58:30.957968 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:58:30.957968 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:58:30.957968 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:58:30.957968 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:58:30.957968 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:58:30.957968 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:58:30.957968 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5eca3d8f-7c56-4d11-a214-e7e659406b67 could not be found. Oct 04 20:58:30.957968 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:58:30.957968 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6976d651-8626-4d35-a4f4-e2ce539165b8 tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] Returning 404 to user: Instance 5eca3d8f-7c56-4d11-a214-e7e659406b67 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:58:30.957968 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-6976d651-8626-4d35-a4f4-e2ce539165b8 tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] 10.222.0.33 "GET /compute/v2.1/servers/5eca3d8f-7c56-4d11-a214-e7e659406b67/os-instance-actions" status: 404 len: 111 microversion: 2.1 time: 0.022860 Oct 04 20:58:30.967561 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2356/4749] 10.222.0.33 () {58 vars in 1296 bytes} [Tue Oct 4 20:58:30 2022] GET /compute/v2.1/servers/5eca3d8f-7c56-4d11-a214-e7e659406b67/os-instance-actions => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:58:30.980405 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7c645627-1400-4689-8007-b6b40ed296c4 tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:58:30.983766 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-7c645627-1400-4689-8007-b6b40ed296c4 tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] [instance: e32774eb-128e-499d-b15e-f93f4c57d9e0] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:58:30.994072 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7c645627-1400-4689-8007-b6b40ed296c4 tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:30.994868 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7c645627-1400-4689-8007-b6b40ed296c4 tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:31.001987 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7c645627-1400-4689-8007-b6b40ed296c4 tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:31.009779 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7c645627-1400-4689-8007-b6b40ed296c4 tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:31.011280 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7c645627-1400-4689-8007-b6b40ed296c4 tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:31.012972 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7c645627-1400-4689-8007-b6b40ed296c4 tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:31.065650 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-7c645627-1400-4689-8007-b6b40ed296c4 tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] [instance: e32774eb-128e-499d-b15e-f93f4c57d9e0] Going to try to terminate instance {{(pid=128801) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:58:31.207798 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-7c645627-1400-4689-8007-b6b40ed296c4 tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] 10.222.0.33 "DELETE /compute/v2.1/servers/e32774eb-128e-499d-b15e-f93f4c57d9e0" status: 204 len: 0 microversion: 2.1 time: 0.217289 Oct 04 20:58:31.209851 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2357/4750] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 20:58:30 2022] DELETE /compute/v2.1/servers/e32774eb-128e-499d-b15e-f93f4c57d9e0 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:58:31.220589 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-fca2c45e-0ae8-4205-a1ab-f4dd7d6cbf3d tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6513f5e908ac4d028cad6eeeebeab285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65946afc398d4a9fb1c9095a4f946e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:58:31.275218 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-fca2c45e-0ae8-4205-a1ab-f4dd7d6cbf3d tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc" status: 200 len: 1505 microversion: 2.1 time: 0.448492 Oct 04 20:58:31.282221 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2394/4751] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:58:30 2022] GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc => generated 1505 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:58:31.292177 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-8490713c-6548-4636-b9c1-f333ddc6fd6b tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:58:31.293654 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-8490713c-6548-4636-b9c1-f333ddc6fd6b tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] [instance: e32774eb-128e-499d-b15e-f93f4c57d9e0] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:58:31.309720 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8490713c-6548-4636-b9c1-f333ddc6fd6b tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:31.310727 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8490713c-6548-4636-b9c1-f333ddc6fd6b tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:31.311729 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8490713c-6548-4636-b9c1-f333ddc6fd6b tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:31.313491 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8490713c-6548-4636-b9c1-f333ddc6fd6b tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:31.329979 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8490713c-6548-4636-b9c1-f333ddc6fd6b tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:31.330941 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8490713c-6548-4636-b9c1-f333ddc6fd6b tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:31.775104 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-bcc7fe4f-43a4-4781-9a2d-9e70af031eec tempest-ServerPasswordTestJSON-1023625137 tempest-ServerPasswordTestJSON-1023625137-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerPasswordTestJSON-server-1245549244", "imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63", "flavorRef": "452", "networks": [{"uuid": "5e3d22a4-77e5-4a5e-8420-5038b880f705"}]}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:58:31.828993 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-8490713c-6548-4636-b9c1-f333ddc6fd6b tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034056e41cbe4111ba8fcd5e48273007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1e31ed067d4e85aab983e532ab399c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:58:31.840474 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-8490713c-6548-4636-b9c1-f333ddc6fd6b tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] 10.222.0.33 "GET /compute/v2.1/servers/e32774eb-128e-499d-b15e-f93f4c57d9e0" status: 200 len: 1528 microversion: 2.1 time: 0.556302 Oct 04 20:58:31.846242 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2395/4752] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:58:31 2022] GET /compute/v2.1/servers/e32774eb-128e-499d-b15e-f93f4c57d9e0 => generated 1528 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:58:31.853597 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-182a2293-59c9-4e35-bbb9-3722d02a8e50 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-639816208", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "780a66b6-435f-46df-9c7b-6f763e190356"}]}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:58:31.861707 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-182a2293-59c9-4e35-bbb9-3722d02a8e50 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Request method failure captured: Oct 04 20:58:31.861707 n-d-854823-8 devstack@n-api.service[128802]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 20:58:31.861707 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 20:58:31.861707 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 20:58:31.861707 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 20:58:31.861707 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 172 Oct 04 20:58:31.861707 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 20:58:31.861707 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 20:58:31.861707 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 20:58:31.861707 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 20:58:31.861707 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPJ4eaBM_FLl2jaN3nQraRbM94DgE-qlLjkCPNJ1Ol7VvkbIGIp-m_lAuwAay2VJ7lXD5niLtaDpJGDoHOJTljuI2aLuReHvX6jQr-uTgC01ZM2s7p6j6gq6a-1PaGQN0mcmcJntCqSnEEt5MEM6DdrOOdi5eEtsfyNU4EpDYmca-Ylo Oct 04 20:58:31.861707 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 20:58:31.861707 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 20:58:31.861707 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 20:58:31.861707 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 20:58:31.861707 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 20:58:31.861707 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 20:58:31.861707 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: 65946afc398d4a9fb1c9095a4f946e07 Oct 04 20:58:31.861707 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-ServersNegativeTestJSON-1097186397 Oct 04 20:58:31.861707 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 20:58:31.861707 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 20:58:31.861707 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_65946afc398d4a9fb1c9095a4f946e07", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/65946afc398d4a9fb1c9095a4f946e07"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/65946afc398d4a9fb1c9095a4f946e07"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/65946afc398d4a9fb1c9095a4f946e07"}]}] Oct 04 20:58:31.861707 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-ServersNegativeTestJSON-1097186397 Oct 04 20:58:31.861707 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: 65946afc398d4a9fb1c9095a4f946e07 Oct 04 20:58:31.861707 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1097186397 Oct 04 20:58:31.861707 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-ServersNegativeTestJSON-1097186397-project Oct 04 20:58:31.861707 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 20:58:31.861707 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 20:58:31.861707 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: 6513f5e908ac4d028cad6eeeebeab285 Oct 04 20:58:31.861707 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-ServersNegativeTestJSON-1097186397-project Oct 04 20:58:31.861707 n-d-854823-8 devstack@n-api.service[128802]: Oct 04 20:58:31.861707 n-d-854823-8 devstack@n-api.service[128802]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-639816208", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "780a66b6-435f-46df-9c7b-6f763e190356"}]}} Oct 04 20:58:31.861707 n-d-854823-8 devstack@n-api.service[128802]: method: > Oct 04 20:58:31.861707 n-d-854823-8 devstack@n-api.service[128802]: exception: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Oct 04 20:58:31.861707 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-639816208', 'imageRef': -1, 'flavorRef': '452', 'networks': [{'uuid': '780a66b6-435f-46df-9c7b-6f763e190356'}]}}} Oct 04 20:58:31.861707 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:58:31.861707 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:58:31.861707 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 20:58:31.861707 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 20:58:31.861707 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 20:58:31.861707 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise error Oct 04 20:58:31.861707 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: -1 is not valid under any of the given schemas Oct 04 20:58:31.861707 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:58:31.861707 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['server']['properties']['imageRef']: Oct 04 20:58:31.861707 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'uuid', 'type': 'string'}, Oct 04 20:58:31.861707 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi {'maxLength': 0, 'type': 'string'}]} Oct 04 20:58:31.861707 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:58:31.861707 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 04 20:58:31.861707 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi -1 Oct 04 20:58:31.861707 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:58:31.861707 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:58:31.861707 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:58:31.861707 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:58:31.861707 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:58:31.861707 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:58:31.861707 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:58:31.861707 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:58:31.861707 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:58:31.861707 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:58:31.861707 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:58:31.861707 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:58:31.861707 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 20:58:31.861707 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 20:58:31.861707 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 20:58:31.869812 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 20:58:31.869812 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 20:58:31.869812 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 20:58:31.869812 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Oct 04 20:58:31.869812 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:58:31.869812 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:58:31.869812 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:58:31.869812 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:58:31.869812 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:58:31.869812 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:58:31.869812 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 20:58:31.869812 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 20:58:31.869812 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Oct 04 20:58:31.869812 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:58:31.882810 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-182a2293-59c9-4e35-bbb9-3722d02a8e50 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Returning 400 to user: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:58:31.891749 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-182a2293-59c9-4e35-bbb9-3722d02a8e50 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 400 len: 145 microversion: 2.1 time: 0.043551 Oct 04 20:58:31.896620 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2396/4753] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 20:58:31 2022] POST /compute/v2.1/servers => generated 145 bytes in 47 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 20:58:31.910479 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-8c521e5b-d339-476a-b5f0-092cbc8b0211 tempest-ServersAaction247Test-724016890 tempest-ServersAaction247Test-724016890-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:58:31.912928 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-8c521e5b-d339-476a-b5f0-092cbc8b0211 tempest-ServersAaction247Test-724016890 tempest-ServersAaction247Test-724016890-project] [instance: efdf16f0-7d78-4f70-a4be-081e38d09e8b] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:58:31.940773 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8c521e5b-d339-476a-b5f0-092cbc8b0211 tempest-ServersAaction247Test-724016890 tempest-ServersAaction247Test-724016890-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:31.947011 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8c521e5b-d339-476a-b5f0-092cbc8b0211 tempest-ServersAaction247Test-724016890 tempest-ServersAaction247Test-724016890-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:31.948102 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8c521e5b-d339-476a-b5f0-092cbc8b0211 tempest-ServersAaction247Test-724016890 tempest-ServersAaction247Test-724016890-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:31.951203 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8c521e5b-d339-476a-b5f0-092cbc8b0211 tempest-ServersAaction247Test-724016890 tempest-ServersAaction247Test-724016890-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:31.954161 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8c521e5b-d339-476a-b5f0-092cbc8b0211 tempest-ServersAaction247Test-724016890 tempest-ServersAaction247Test-724016890-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:31.954963 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8c521e5b-d339-476a-b5f0-092cbc8b0211 tempest-ServersAaction247Test-724016890 tempest-ServersAaction247Test-724016890-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:31.974410 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.network.neutron [None req-bcc7fe4f-43a4-4781-9a2d-9e70af031eec tempest-ServerPasswordTestJSON-1023625137 tempest-ServerPasswordTestJSON-1023625137-project] validate_networks() for [('5e3d22a4-77e5-4a5e-8420-5038b880f705', None, None, None, None, None)] {{(pid=128801) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:58:31.992128 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.wsgi [None req-8c521e5b-d339-476a-b5f0-092cbc8b0211 tempest-ServersAaction247Test-724016890 tempest-ServersAaction247Test-724016890-project] HTTP exception thrown: Instance efdf16f0-7d78-4f70-a4be-081e38d09e8b could not be found. Oct 04 20:58:31.995479 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-8c521e5b-d339-476a-b5f0-092cbc8b0211 tempest-ServersAaction247Test-724016890 tempest-ServersAaction247Test-724016890-project] Request method failure captured: Oct 04 20:58:31.995479 n-d-854823-8 devstack@n-api.service[128802]: request: GET /compute/v2.1/servers/efdf16f0-7d78-4f70-a4be-081e38d09e8b HTTP/1.1 Oct 04 20:58:31.995479 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 20:58:31.995479 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 20:58:31.995479 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 20:58:31.995479 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 0 Oct 04 20:58:31.995479 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 20:58:31.995479 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 20:58:31.995479 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 20:58:31.995479 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 20:58:31.995479 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPJ5pSgVICoLOVF8LkWJkLFTk98ZX4YtFu1Xtr3mtsUaE48GuBg7Ft7BfFt5QA4Fe3EpXaBE42oQ1WxXpFw6_GMcZabkkcsBXUf-xlhB6R9nbKHJhNdgYUgsS9mjy4IHsObcIgL6RLGMX6OriWZDrkO7HvEYdB8oLmKZYA8mhNBS2KWw Oct 04 20:58:31.995479 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 20:58:31.995479 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 20:58:31.995479 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 20:58:31.995479 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 20:58:31.995479 n-d-854823-8 devstack@n-api.service[128802]: X-Openstack-Nova-Api-Version: 2.47 Oct 04 20:58:31.995479 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 20:58:31.995479 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 20:58:31.995479 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: fcea08e8eb0a4d17b4a0f952915bca7e Oct 04 20:58:31.995479 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-ServersAaction247Test-724016890 Oct 04 20:58:31.995479 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 20:58:31.995479 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 20:58:31.995479 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_fcea08e8eb0a4d17b4a0f952915bca7e", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fcea08e8eb0a4d17b4a0f952915bca7e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fcea08e8eb0a4d17b4a0f952915bca7e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/fcea08e8eb0a4d17b4a0f952915bca7e"}]}] Oct 04 20:58:31.995479 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-ServersAaction247Test-724016890 Oct 04 20:58:31.995479 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: fcea08e8eb0a4d17b4a0f952915bca7e Oct 04 20:58:31.995479 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-ServersAaction247Test-724016890 Oct 04 20:58:31.995479 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-ServersAaction247Test-724016890-project Oct 04 20:58:31.995479 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 20:58:31.995479 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 20:58:31.995479 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: f8636fdad74c483eb84aeb7524858a65 Oct 04 20:58:31.995479 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-ServersAaction247Test-724016890-project Oct 04 20:58:31.995479 n-d-854823-8 devstack@n-api.service[128802]: method: > Oct 04 20:58:31.995479 n-d-854823-8 devstack@n-api.service[128802]: exception: Instance efdf16f0-7d78-4f70-a4be-081e38d09e8b could not be found. Oct 04 20:58:31.995479 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'id': 'efdf16f0-7d78-4f70-a4be-081e38d09e8b'} Oct 04 20:58:31.995479 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:58:31.995479 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:58:31.995479 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:58:31.995479 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:58:31.995479 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:58:31.995479 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:58:31.995479 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:58:31.995479 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:58:31.995479 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:58:31.995479 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:58:31.995479 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance efdf16f0-7d78-4f70-a4be-081e38d09e8b could not be found. Oct 04 20:58:31.995479 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:58:31.995479 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:58:31.995479 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:58:31.995479 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:58:31.995479 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:58:31.995479 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:58:31.995479 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:58:31.995479 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:58:31.995479 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:58:31.995479 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:58:31.995479 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:58:31.995479 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:58:31.995479 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:58:31.995479 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:58:31.995479 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:58:31.995479 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:58:31.995479 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance efdf16f0-7d78-4f70-a4be-081e38d09e8b could not be found. Oct 04 20:58:31.995479 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:58:31.995479 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:58:31.995479 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:58:32.012654 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:58:32.012654 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:58:32.012654 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:58:32.012654 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:58:32.012654 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:58:32.012654 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance efdf16f0-7d78-4f70-a4be-081e38d09e8b could not be found. Oct 04 20:58:32.012654 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:58:32.012654 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-8c521e5b-d339-476a-b5f0-092cbc8b0211 tempest-ServersAaction247Test-724016890 tempest-ServersAaction247Test-724016890-project] Returning 404 to user: Instance efdf16f0-7d78-4f70-a4be-081e38d09e8b could not be found. {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:58:32.012654 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-8c521e5b-d339-476a-b5f0-092cbc8b0211 tempest-ServersAaction247Test-724016890 tempest-ServersAaction247Test-724016890-project] 10.222.0.33 "GET /compute/v2.1/servers/efdf16f0-7d78-4f70-a4be-081e38d09e8b" status: 404 len: 111 microversion: 2.47 time: 0.101918 Oct 04 20:58:32.012654 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2397/4754] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:58:31 2022] GET /compute/v2.1/servers/efdf16f0-7d78-4f70-a4be-081e38d09e8b => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 20:58:32.012654 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-b5418791-1e08-4386-8fbb-c2ca3868a07f tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:58:32.016764 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-b5418791-1e08-4386-8fbb-c2ca3868a07f tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] [instance: 320f9a98-969f-473e-bc56-842bbd28dedc] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:58:32.026880 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b5418791-1e08-4386-8fbb-c2ca3868a07f tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:32.026880 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b5418791-1e08-4386-8fbb-c2ca3868a07f tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:32.027414 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b5418791-1e08-4386-8fbb-c2ca3868a07f tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:32.027787 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b5418791-1e08-4386-8fbb-c2ca3868a07f tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:32.028544 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b5418791-1e08-4386-8fbb-c2ca3868a07f tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:32.029189 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b5418791-1e08-4386-8fbb-c2ca3868a07f tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:33.262131 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-b5418791-1e08-4386-8fbb-c2ca3868a07f tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6513f5e908ac4d028cad6eeeebeab285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65946afc398d4a9fb1c9095a4f946e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:58:33.282729 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-b5418791-1e08-4386-8fbb-c2ca3868a07f tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc" status: 200 len: 1505 microversion: 2.1 time: 1.280316 Oct 04 20:58:33.302692 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2398/4755] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:58:32 2022] GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc => generated 1505 bytes in 1301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:58:33.327304 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-ff67c951-1575-486b-8f2c-2b588664e17b tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:58:33.327923 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-ff67c951-1575-486b-8f2c-2b588664e17b tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] [instance: e32774eb-128e-499d-b15e-f93f4c57d9e0] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:58:33.346619 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ff67c951-1575-486b-8f2c-2b588664e17b tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:33.347924 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ff67c951-1575-486b-8f2c-2b588664e17b tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:33.348590 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ff67c951-1575-486b-8f2c-2b588664e17b tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:33.349566 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ff67c951-1575-486b-8f2c-2b588664e17b tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:33.351020 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ff67c951-1575-486b-8f2c-2b588664e17b tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:33.352028 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ff67c951-1575-486b-8f2c-2b588664e17b tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:33.487530 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-bcc7fe4f-43a4-4781-9a2d-9e70af031eec tempest-ServerPasswordTestJSON-1023625137 tempest-ServerPasswordTestJSON-1023625137-project] Flavor limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:58:33.491093 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-bcc7fe4f-43a4-4781-9a2d-9e70af031eec tempest-ServerPasswordTestJSON-1023625137 tempest-ServerPasswordTestJSON-1023625137-project] Image limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:58:33.491910 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-bcc7fe4f-43a4-4781-9a2d-9e70af031eec tempest-ServerPasswordTestJSON-1023625137 tempest-ServerPasswordTestJSON-1023625137-project] Flavor pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:58:33.492574 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-bcc7fe4f-43a4-4781-9a2d-9e70af031eec tempest-ServerPasswordTestJSON-1023625137 tempest-ServerPasswordTestJSON-1023625137-project] Image pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:58:33.493516 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-bcc7fe4f-43a4-4781-9a2d-9e70af031eec tempest-ServerPasswordTestJSON-1023625137 tempest-ServerPasswordTestJSON-1023625137-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:58:33.514144 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bcc7fe4f-43a4-4781-9a2d-9e70af031eec tempest-ServerPasswordTestJSON-1023625137 tempest-ServerPasswordTestJSON-1023625137-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:33.521753 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bcc7fe4f-43a4-4781-9a2d-9e70af031eec tempest-ServerPasswordTestJSON-1023625137 tempest-ServerPasswordTestJSON-1023625137-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:33.522595 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bcc7fe4f-43a4-4781-9a2d-9e70af031eec tempest-ServerPasswordTestJSON-1023625137 tempest-ServerPasswordTestJSON-1023625137-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:33.523636 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bcc7fe4f-43a4-4781-9a2d-9e70af031eec tempest-ServerPasswordTestJSON-1023625137 tempest-ServerPasswordTestJSON-1023625137-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:33.524336 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bcc7fe4f-43a4-4781-9a2d-9e70af031eec tempest-ServerPasswordTestJSON-1023625137 tempest-ServerPasswordTestJSON-1023625137-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:33.525084 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bcc7fe4f-43a4-4781-9a2d-9e70af031eec tempest-ServerPasswordTestJSON-1023625137 tempest-ServerPasswordTestJSON-1023625137-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:33.579715 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-bcc7fe4f-43a4-4781-9a2d-9e70af031eec tempest-ServerPasswordTestJSON-1023625137 tempest-ServerPasswordTestJSON-1023625137-project] Getting quotas for project 7007db5728544fc480825a10fac1e81d. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:58:33.591030 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-bcc7fe4f-43a4-4781-9a2d-9e70af031eec tempest-ServerPasswordTestJSON-1023625137 tempest-ServerPasswordTestJSON-1023625137-project] Getting quotas for user 94afe152da6f45a181ed6fd7dd77c033 and project 7007db5728544fc480825a10fac1e81d. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:58:33.616326 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-bcc7fe4f-43a4-4781-9a2d-9e70af031eec tempest-ServerPasswordTestJSON-1023625137 tempest-ServerPasswordTestJSON-1023625137-project] Going to run 1 instances... {{(pid=128801) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:58:33.618919 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-bcc7fe4f-43a4-4781-9a2d-9e70af031eec tempest-ServerPasswordTestJSON-1023625137 tempest-ServerPasswordTestJSON-1023625137-project] [instance: 2f6b6d05-2fff-4d82-ac0f-02c84f49ebe3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='15b24725-0c99-4bcf-b1fb-907cdf8e2d63',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128801) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:58:33.721007 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-bcc7fe4f-43a4-4781-9a2d-9e70af031eec tempest-ServerPasswordTestJSON-1023625137 tempest-ServerPasswordTestJSON-1023625137-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.504407 Oct 04 20:58:33.731123 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2358/4756] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 20:58:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 2517 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 20:58:33.736071 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9163375d-3fa9-45f6-abd6-57f7e913fdcf tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:58:33.736691 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-9163375d-3fa9-45f6-abd6-57f7e913fdcf tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] [instance: 320f9a98-969f-473e-bc56-842bbd28dedc] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:58:33.786238 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9163375d-3fa9-45f6-abd6-57f7e913fdcf tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:33.786775 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9163375d-3fa9-45f6-abd6-57f7e913fdcf tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:33.789352 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9163375d-3fa9-45f6-abd6-57f7e913fdcf tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:33.790114 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9163375d-3fa9-45f6-abd6-57f7e913fdcf tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:33.790628 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9163375d-3fa9-45f6-abd6-57f7e913fdcf tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:33.794736 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9163375d-3fa9-45f6-abd6-57f7e913fdcf tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:34.137207 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-ff67c951-1575-486b-8f2c-2b588664e17b tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034056e41cbe4111ba8fcd5e48273007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1e31ed067d4e85aab983e532ab399c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:58:34.155320 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-ff67c951-1575-486b-8f2c-2b588664e17b tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] 10.222.0.33 "GET /compute/v2.1/servers/e32774eb-128e-499d-b15e-f93f4c57d9e0" status: 200 len: 1528 microversion: 2.1 time: 0.850502 Oct 04 20:58:34.159226 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2399/4757] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:58:33 2022] GET /compute/v2.1/servers/e32774eb-128e-499d-b15e-f93f4c57d9e0 => generated 1528 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:58:34.185338 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-7ed36518-cd5c-472a-b75b-e8bc61606878 tempest-ServerPasswordTestJSON-1023625137 tempest-ServerPasswordTestJSON-1023625137-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:58:34.190437 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-7ed36518-cd5c-472a-b75b-e8bc61606878 tempest-ServerPasswordTestJSON-1023625137 tempest-ServerPasswordTestJSON-1023625137-project] [instance: 2f6b6d05-2fff-4d82-ac0f-02c84f49ebe3] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:58:34.677422 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-7ed36518-cd5c-472a-b75b-e8bc61606878 tempest-ServerPasswordTestJSON-1023625137 tempest-ServerPasswordTestJSON-1023625137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94afe152da6f45a181ed6fd7dd77c033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7007db5728544fc480825a10fac1e81d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:58:34.698063 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-7ed36518-cd5c-472a-b75b-e8bc61606878 tempest-ServerPasswordTestJSON-1023625137 tempest-ServerPasswordTestJSON-1023625137-project] 10.222.0.33 "GET /compute/v2.1/servers/2f6b6d05-2fff-4d82-ac0f-02c84f49ebe3" status: 200 len: 1216 microversion: 2.1 time: 0.531021 Oct 04 20:58:34.699884 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2400/4758] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:58:34 2022] GET /compute/v2.1/servers/2f6b6d05-2fff-4d82-ac0f-02c84f49ebe3 => generated 1216 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:58:35.185337 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-a47bd80b-7cad-4c53-a1cb-837b2dabd44f tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:58:35.186315 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-a47bd80b-7cad-4c53-a1cb-837b2dabd44f tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] [instance: e32774eb-128e-499d-b15e-f93f4c57d9e0] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:58:35.213804 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a47bd80b-7cad-4c53-a1cb-837b2dabd44f tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:35.214404 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a47bd80b-7cad-4c53-a1cb-837b2dabd44f tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:35.214660 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a47bd80b-7cad-4c53-a1cb-837b2dabd44f tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:35.229055 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a47bd80b-7cad-4c53-a1cb-837b2dabd44f tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:35.229564 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a47bd80b-7cad-4c53-a1cb-837b2dabd44f tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:35.230003 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a47bd80b-7cad-4c53-a1cb-837b2dabd44f tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:35.876829 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-a47bd80b-7cad-4c53-a1cb-837b2dabd44f tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034056e41cbe4111ba8fcd5e48273007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1e31ed067d4e85aab983e532ab399c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:58:35.879653 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=100 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:58:35.896398 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-a47bd80b-7cad-4c53-a1cb-837b2dabd44f tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] 10.222.0.33 "GET /compute/v2.1/servers/e32774eb-128e-499d-b15e-f93f4c57d9e0" status: 200 len: 1486 microversion: 2.1 time: 0.714600 Oct 04 20:58:35.899079 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2401/4759] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:58:35 2022] GET /compute/v2.1/servers/e32774eb-128e-499d-b15e-f93f4c57d9e0 => generated 1486 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:58:35.928760 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-e3df185e-b1f9-46f6-83d6-51848fd24b7a tempest-ServerPasswordTestJSON-1023625137 tempest-ServerPasswordTestJSON-1023625137-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:58:35.932153 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-e3df185e-b1f9-46f6-83d6-51848fd24b7a tempest-ServerPasswordTestJSON-1023625137 tempest-ServerPasswordTestJSON-1023625137-project] [instance: 2f6b6d05-2fff-4d82-ac0f-02c84f49ebe3] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:58:35.942789 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e3df185e-b1f9-46f6-83d6-51848fd24b7a tempest-ServerPasswordTestJSON-1023625137 tempest-ServerPasswordTestJSON-1023625137-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:35.943965 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e3df185e-b1f9-46f6-83d6-51848fd24b7a tempest-ServerPasswordTestJSON-1023625137 tempest-ServerPasswordTestJSON-1023625137-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:35.944670 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e3df185e-b1f9-46f6-83d6-51848fd24b7a tempest-ServerPasswordTestJSON-1023625137 tempest-ServerPasswordTestJSON-1023625137-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:35.945667 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e3df185e-b1f9-46f6-83d6-51848fd24b7a tempest-ServerPasswordTestJSON-1023625137 tempest-ServerPasswordTestJSON-1023625137-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:35.946545 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e3df185e-b1f9-46f6-83d6-51848fd24b7a tempest-ServerPasswordTestJSON-1023625137 tempest-ServerPasswordTestJSON-1023625137-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:35.965229 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e3df185e-b1f9-46f6-83d6-51848fd24b7a tempest-ServerPasswordTestJSON-1023625137 tempest-ServerPasswordTestJSON-1023625137-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:36.037516 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-9163375d-3fa9-45f6-abd6-57f7e913fdcf tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6513f5e908ac4d028cad6eeeebeab285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65946afc398d4a9fb1c9095a4f946e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:58:36.084061 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-9163375d-3fa9-45f6-abd6-57f7e913fdcf tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc" status: 200 len: 1505 microversion: 2.1 time: 2.347103 Oct 04 20:58:36.088019 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2359/4760] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:58:33 2022] GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc => generated 1505 bytes in 2356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:58:36.124712 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-6ef64392-8014-4a9b-923f-2f103b0705da req-a3a2165d-1b86-4276-9c38-78850f15cc70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e32774eb-128e-499d-b15e-f93f4c57d9e0", "name": "network-vif-deleted", "tag": "dc501e3b-439f-430e-a019-e7dca5fff08f"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:58:36.170992 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-6ef64392-8014-4a9b-923f-2f103b0705da req-a3a2165d-1b86-4276-9c38-78850f15cc70 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:36.171858 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-6ef64392-8014-4a9b-923f-2f103b0705da req-a3a2165d-1b86-4276-9c38-78850f15cc70 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:36.174112 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-6ef64392-8014-4a9b-923f-2f103b0705da req-a3a2165d-1b86-4276-9c38-78850f15cc70 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:36.218605 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-6ef64392-8014-4a9b-923f-2f103b0705da req-a3a2165d-1b86-4276-9c38-78850f15cc70 service nova] Creating event network-vif-deleted:dc501e3b-439f-430e-a019-e7dca5fff08f for instance e32774eb-128e-499d-b15e-f93f4c57d9e0 on n-h2-854823-8 Oct 04 20:58:36.221884 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-e3df185e-b1f9-46f6-83d6-51848fd24b7a tempest-ServerPasswordTestJSON-1023625137 tempest-ServerPasswordTestJSON-1023625137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94afe152da6f45a181ed6fd7dd77c033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7007db5728544fc480825a10fac1e81d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:58:36.230713 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-6ef64392-8014-4a9b-923f-2f103b0705da req-a3a2165d-1b86-4276-9c38-78850f15cc70 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.137808 Oct 04 20:58:36.232499 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2360/4761] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:58:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:58:36.236145 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-e3df185e-b1f9-46f6-83d6-51848fd24b7a tempest-ServerPasswordTestJSON-1023625137 tempest-ServerPasswordTestJSON-1023625137-project] 10.222.0.33 "GET /compute/v2.1/servers/2f6b6d05-2fff-4d82-ac0f-02c84f49ebe3" status: 200 len: 1268 microversion: 2.1 time: 0.317175 Oct 04 20:58:36.249324 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2402/4762] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:58:35 2022] GET /compute/v2.1/servers/2f6b6d05-2fff-4d82-ac0f-02c84f49ebe3 => generated 1268 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:58:36.589378 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-763e89c8-46f1-4a44-84b7-5c20b3c45f06 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-748314268", "imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:58:36.616075 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-763e89c8-46f1-4a44-84b7-5c20b3c45f06 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] HTTP exception thrown: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 04 20:58:36.622129 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-763e89c8-46f1-4a44-84b7-5c20b3c45f06 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Request method failure captured: Oct 04 20:58:36.622129 n-d-854823-8 devstack@n-api.service[128801]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 20:58:36.622129 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:58:36.622129 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:58:36.622129 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:58:36.622129 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 215 Oct 04 20:58:36.622129 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:58:36.622129 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:58:36.622129 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:58:36.622129 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:58:36.622129 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJ4eaBM_FLl2jaN3nQraRbM94DgE-qlLjkCPNJ1Ol7VvkbIGIp-m_lAuwAay2VJ7lXD5niLtaDpJGDoHOJTljuI2aLuReHvX6jQr-uTgC01ZM2s7p6j6gq6a-1PaGQN0mcmcJntCqSnEEt5MEM6DdrOOdi5eEtsfyNU4EpDYmca-Ylo Oct 04 20:58:36.622129 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:58:36.622129 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:58:36.622129 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:58:36.622129 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:58:36.622129 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:58:36.622129 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:58:36.622129 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: 65946afc398d4a9fb1c9095a4f946e07 Oct 04 20:58:36.622129 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-ServersNegativeTestJSON-1097186397 Oct 04 20:58:36.622129 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 20:58:36.622129 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 20:58:36.622129 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_65946afc398d4a9fb1c9095a4f946e07", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/65946afc398d4a9fb1c9095a4f946e07"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/65946afc398d4a9fb1c9095a4f946e07"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/65946afc398d4a9fb1c9095a4f946e07"}]}] Oct 04 20:58:36.622129 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-ServersNegativeTestJSON-1097186397 Oct 04 20:58:36.622129 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: 65946afc398d4a9fb1c9095a4f946e07 Oct 04 20:58:36.622129 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1097186397 Oct 04 20:58:36.622129 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-ServersNegativeTestJSON-1097186397-project Oct 04 20:58:36.622129 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:58:36.622129 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:58:36.622129 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: 6513f5e908ac4d028cad6eeeebeab285 Oct 04 20:58:36.622129 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-ServersNegativeTestJSON-1097186397-project Oct 04 20:58:36.622129 n-d-854823-8 devstack@n-api.service[128801]: Oct 04 20:58:36.622129 n-d-854823-8 devstack@n-api.service[128801]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-748314268", "imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} Oct 04 20:58:36.622129 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 20:58:36.622129 n-d-854823-8 devstack@n-api.service[128801]: exception: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 04 20:58:36.622129 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-748314268', 'imageRef': '15b24725-0c99-4bcf-b1fb-907cdf8e2d63', 'flavorRef': '452', 'networks': [{'fixed_ip': '10.0.1.1', 'uuid': 'a-b-c-d-e-f-g-h-i-j'}]}}} Oct 04 20:58:36.622129 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:58:36.622129 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:58:36.622129 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:58:36.622129 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:58:36.622129 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:58:36.622129 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:58:36.622129 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:58:36.622129 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:58:36.622129 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:58:36.622129 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:58:36.622129 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:58:36.622129 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:58:36.622129 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:58:36.622129 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:58:36.622129 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 20:58:36.622129 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 773, in create Oct 04 20:58:36.622129 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self._process_networks_for_create( Oct 04 20:58:36.622129 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 547, in _process_networks_for_create Oct 04 20:58:36.622129 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi requested_networks = self._get_requested_networks( Oct 04 20:58:36.622129 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 447, in _get_requested_networks Oct 04 20:58:36.622129 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self._validate_network_id( Oct 04 20:58:36.622129 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 396, in _validate_network_id Oct 04 20:58:36.622129 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 04 20:58:36.622129 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 04 20:58:36.622129 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:58:36.622129 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:58:36.627249 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:58:36.627249 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:58:36.627249 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:58:36.627249 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:58:36.627249 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:58:36.627249 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:58:36.627249 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 04 20:58:36.627249 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:58:36.639421 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-763e89c8-46f1-4a44-84b7-5c20b3c45f06 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Returning 400 to user: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:58:36.641900 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-763e89c8-46f1-4a44-84b7-5c20b3c45f06 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 400 len: 123 microversion: 2.1 time: 0.058378 Oct 04 20:58:36.642769 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2361/4763] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 20:58:36 2022] POST /compute/v2.1/servers => generated 123 bytes in 63 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 20:58:36.652278 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-46a14c1f-94cb-4836-a960-4670d71f6176 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:58:36.652900 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-46a14c1f-94cb-4836-a960-4670d71f6176 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] [instance: 320f9a98-969f-473e-bc56-842bbd28dedc] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:58:36.659976 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-46a14c1f-94cb-4836-a960-4670d71f6176 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:36.660465 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-46a14c1f-94cb-4836-a960-4670d71f6176 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:36.676182 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-46a14c1f-94cb-4836-a960-4670d71f6176 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:36.678308 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-46a14c1f-94cb-4836-a960-4670d71f6176 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:36.683143 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-46a14c1f-94cb-4836-a960-4670d71f6176 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:36.690591 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-46a14c1f-94cb-4836-a960-4670d71f6176 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:36.923932 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-68de1541-08a5-47f9-b985-437163fd627c tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:58:36.924735 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-68de1541-08a5-47f9-b985-437163fd627c tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] [instance: e32774eb-128e-499d-b15e-f93f4c57d9e0] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:58:36.946108 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-68de1541-08a5-47f9-b985-437163fd627c tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:36.956610 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-68de1541-08a5-47f9-b985-437163fd627c tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:36.962592 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-68de1541-08a5-47f9-b985-437163fd627c tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:36.963460 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-68de1541-08a5-47f9-b985-437163fd627c tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:36.963954 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-68de1541-08a5-47f9-b985-437163fd627c tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:36.968105 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-68de1541-08a5-47f9-b985-437163fd627c tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:37.083461 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-46a14c1f-94cb-4836-a960-4670d71f6176 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6513f5e908ac4d028cad6eeeebeab285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65946afc398d4a9fb1c9095a4f946e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:58:37.114279 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-46a14c1f-94cb-4836-a960-4670d71f6176 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc" status: 200 len: 1505 microversion: 2.1 time: 0.465763 Oct 04 20:58:37.116615 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2403/4764] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:58:36 2022] GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc => generated 1505 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:58:37.125332 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-68de1541-08a5-47f9-b985-437163fd627c tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:37.128215 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-68de1541-08a5-47f9-b985-437163fd627c tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:37.130940 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-68de1541-08a5-47f9-b985-437163fd627c tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:37.133144 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-68de1541-08a5-47f9-b985-437163fd627c tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] Lazy-loading 'fault' on Instance uuid e32774eb-128e-499d-b15e-f93f4c57d9e0 {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:58:37.146876 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-18a224e0-f73f-4dd7-afac-40f4f40b2639 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:58:37.147641 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-18a224e0-f73f-4dd7-afac-40f4f40b2639 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] [instance: 320f9a98-969f-473e-bc56-842bbd28dedc] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:58:37.173353 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-18a224e0-f73f-4dd7-afac-40f4f40b2639 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:37.173895 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-18a224e0-f73f-4dd7-afac-40f4f40b2639 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:37.174393 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-18a224e0-f73f-4dd7-afac-40f4f40b2639 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:37.175721 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-18a224e0-f73f-4dd7-afac-40f4f40b2639 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:37.176219 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-18a224e0-f73f-4dd7-afac-40f4f40b2639 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:37.176647 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-18a224e0-f73f-4dd7-afac-40f4f40b2639 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:37.600112 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-68de1541-08a5-47f9-b985-437163fd627c tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '034056e41cbe4111ba8fcd5e48273007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1e31ed067d4e85aab983e532ab399c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:58:37.612864 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-68de1541-08a5-47f9-b985-437163fd627c tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] 10.222.0.33 "GET /compute/v2.1/servers/e32774eb-128e-499d-b15e-f93f4c57d9e0" status: 200 len: 1315 microversion: 2.1 time: 0.694194 Oct 04 20:58:37.613468 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2362/4765] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:58:36 2022] GET /compute/v2.1/servers/e32774eb-128e-499d-b15e-f93f4c57d9e0 => generated 1315 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:58:37.625572 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2ddc0e7c-89a6-45c4-b228-5bd75149ca39 tempest-ServerPasswordTestJSON-1023625137 tempest-ServerPasswordTestJSON-1023625137-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:58:37.626858 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-2ddc0e7c-89a6-45c4-b228-5bd75149ca39 tempest-ServerPasswordTestJSON-1023625137 tempest-ServerPasswordTestJSON-1023625137-project] [instance: 2f6b6d05-2fff-4d82-ac0f-02c84f49ebe3] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:58:37.661351 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2ddc0e7c-89a6-45c4-b228-5bd75149ca39 tempest-ServerPasswordTestJSON-1023625137 tempest-ServerPasswordTestJSON-1023625137-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:37.666515 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2ddc0e7c-89a6-45c4-b228-5bd75149ca39 tempest-ServerPasswordTestJSON-1023625137 tempest-ServerPasswordTestJSON-1023625137-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:37.667465 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2ddc0e7c-89a6-45c4-b228-5bd75149ca39 tempest-ServerPasswordTestJSON-1023625137 tempest-ServerPasswordTestJSON-1023625137-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:37.672976 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2ddc0e7c-89a6-45c4-b228-5bd75149ca39 tempest-ServerPasswordTestJSON-1023625137 tempest-ServerPasswordTestJSON-1023625137-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:37.676889 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2ddc0e7c-89a6-45c4-b228-5bd75149ca39 tempest-ServerPasswordTestJSON-1023625137 tempest-ServerPasswordTestJSON-1023625137-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:37.677576 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2ddc0e7c-89a6-45c4-b228-5bd75149ca39 tempest-ServerPasswordTestJSON-1023625137 tempest-ServerPasswordTestJSON-1023625137-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:37.835651 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-2ddc0e7c-89a6-45c4-b228-5bd75149ca39 tempest-ServerPasswordTestJSON-1023625137 tempest-ServerPasswordTestJSON-1023625137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94afe152da6f45a181ed6fd7dd77c033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7007db5728544fc480825a10fac1e81d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:58:37.849444 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-18a224e0-f73f-4dd7-afac-40f4f40b2639 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6513f5e908ac4d028cad6eeeebeab285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65946afc398d4a9fb1c9095a4f946e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:58:37.857306 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-2ddc0e7c-89a6-45c4-b228-5bd75149ca39 tempest-ServerPasswordTestJSON-1023625137 tempest-ServerPasswordTestJSON-1023625137-project] 10.222.0.33 "GET /compute/v2.1/servers/2f6b6d05-2fff-4d82-ac0f-02c84f49ebe3" status: 200 len: 1274 microversion: 2.1 time: 0.241168 Oct 04 20:58:37.857940 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2363/4766] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:58:37 2022] GET /compute/v2.1/servers/2f6b6d05-2fff-4d82-ac0f-02c84f49ebe3 => generated 1274 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:58:37.862850 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-18a224e0-f73f-4dd7-afac-40f4f40b2639 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc" status: 200 len: 1505 microversion: 2.1 time: 0.719305 Oct 04 20:58:37.864155 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2404/4767] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:58:37 2022] GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc => generated 1505 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:58:38.178726 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-34cc9236-d0c2-448c-887b-698888388c30 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1531266845", "imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63", "flavorRef": "452", "key_name": "tempest-key-955274770", "networks": [{"uuid": "780a66b6-435f-46df-9c7b-6f763e190356"}]}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:58:38.312946 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.network.neutron [None req-34cc9236-d0c2-448c-887b-698888388c30 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] validate_networks() for [('780a66b6-435f-46df-9c7b-6f763e190356', None, None, None, None, None)] {{(pid=128801) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:58:38.640588 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-2723ab02-378b-469c-aad7-97e5c5c1f635 tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:58:38.641836 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-2723ab02-378b-469c-aad7-97e5c5c1f635 tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] [instance: e32774eb-128e-499d-b15e-f93f4c57d9e0] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:58:38.661755 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2723ab02-378b-469c-aad7-97e5c5c1f635 tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:38.662261 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2723ab02-378b-469c-aad7-97e5c5c1f635 tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:38.664210 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2723ab02-378b-469c-aad7-97e5c5c1f635 tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:38.667082 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2723ab02-378b-469c-aad7-97e5c5c1f635 tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:38.670826 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2723ab02-378b-469c-aad7-97e5c5c1f635 tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:38.671282 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2723ab02-378b-469c-aad7-97e5c5c1f635 tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:38.739747 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.wsgi [None req-2723ab02-378b-469c-aad7-97e5c5c1f635 tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] HTTP exception thrown: Instance e32774eb-128e-499d-b15e-f93f4c57d9e0 could not be found. Oct 04 20:58:38.742085 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-2723ab02-378b-469c-aad7-97e5c5c1f635 tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] Request method failure captured: Oct 04 20:58:38.742085 n-d-854823-8 devstack@n-api.service[128802]: request: GET /compute/v2.1/servers/e32774eb-128e-499d-b15e-f93f4c57d9e0 HTTP/1.1 Oct 04 20:58:38.742085 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 20:58:38.742085 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 20:58:38.742085 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 20:58:38.742085 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 0 Oct 04 20:58:38.742085 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 20:58:38.742085 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 20:58:38.742085 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 20:58:38.742085 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 20:58:38.742085 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPJ5VTODPmzUwYAv2V4imIY8w13nEys83lpLsR8I6qtxq_ufxhPeteQ-j3kSPVrINVh49M2EgPl2xauwpYfOh8PUDv0HE6cdFqbklydbccjryRdqyKtGsGWfgZDydKYSBEbbY-uqamHJAAPokENWJAlpcn7gQDxkVC98Ykvzdh54SYBw Oct 04 20:58:38.742085 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 20:58:38.742085 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 20:58:38.742085 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 20:58:38.742085 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 20:58:38.742085 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 20:58:38.742085 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 20:58:38.742085 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: cc1e31ed067d4e85aab983e532ab399c Oct 04 20:58:38.742085 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-752810805 Oct 04 20:58:38.742085 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 20:58:38.742085 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 20:58:38.742085 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_cc1e31ed067d4e85aab983e532ab399c", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cc1e31ed067d4e85aab983e532ab399c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cc1e31ed067d4e85aab983e532ab399c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/cc1e31ed067d4e85aab983e532ab399c"}]}] Oct 04 20:58:38.742085 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-752810805 Oct 04 20:58:38.742085 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: cc1e31ed067d4e85aab983e532ab399c Oct 04 20:58:38.742085 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-752810805 Oct 04 20:58:38.742085 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-InstanceActionsNegativeTestJSON-752810805-project Oct 04 20:58:38.742085 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 20:58:38.742085 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 20:58:38.742085 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: 034056e41cbe4111ba8fcd5e48273007 Oct 04 20:58:38.742085 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-752810805-project Oct 04 20:58:38.742085 n-d-854823-8 devstack@n-api.service[128802]: method: > Oct 04 20:58:38.742085 n-d-854823-8 devstack@n-api.service[128802]: exception: Instance e32774eb-128e-499d-b15e-f93f4c57d9e0 could not be found. Oct 04 20:58:38.742085 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'id': 'e32774eb-128e-499d-b15e-f93f4c57d9e0'} Oct 04 20:58:38.742085 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:58:38.742085 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:58:38.742085 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:58:38.742085 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:58:38.742085 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:58:38.742085 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:58:38.742085 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:58:38.742085 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:58:38.742085 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:58:38.742085 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:58:38.742085 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e32774eb-128e-499d-b15e-f93f4c57d9e0 could not be found. Oct 04 20:58:38.742085 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:58:38.742085 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:58:38.742085 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:58:38.742085 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:58:38.742085 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:58:38.742085 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:58:38.742085 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:58:38.742085 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:58:38.742085 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:58:38.742085 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:58:38.742085 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:58:38.742085 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:58:38.742085 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:58:38.742085 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:58:38.742085 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:58:38.742085 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:58:38.742085 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e32774eb-128e-499d-b15e-f93f4c57d9e0 could not be found. Oct 04 20:58:38.742085 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:58:38.742085 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:58:38.748612 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:58:38.748612 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:58:38.748612 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:58:38.748612 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:58:38.748612 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:58:38.748612 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:58:38.748612 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e32774eb-128e-499d-b15e-f93f4c57d9e0 could not be found. Oct 04 20:58:38.748612 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:58:38.748612 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-2723ab02-378b-469c-aad7-97e5c5c1f635 tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] Returning 404 to user: Instance e32774eb-128e-499d-b15e-f93f4c57d9e0 could not be found. {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:58:38.748612 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-2723ab02-378b-469c-aad7-97e5c5c1f635 tempest-InstanceActionsNegativeTestJSON-752810805 tempest-InstanceActionsNegativeTestJSON-752810805-project] 10.222.0.33 "GET /compute/v2.1/servers/e32774eb-128e-499d-b15e-f93f4c57d9e0" status: 404 len: 111 microversion: 2.1 time: 0.106798 Oct 04 20:58:38.748612 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2405/4768] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:58:38 2022] GET /compute/v2.1/servers/e32774eb-128e-499d-b15e-f93f4c57d9e0 => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:58:38.890024 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-5c22282f-abe1-4795-8d6d-aae1e601f50c tempest-ServerPasswordTestJSON-1023625137 tempest-ServerPasswordTestJSON-1023625137-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:58:38.890942 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-5c22282f-abe1-4795-8d6d-aae1e601f50c tempest-ServerPasswordTestJSON-1023625137 tempest-ServerPasswordTestJSON-1023625137-project] [instance: 2f6b6d05-2fff-4d82-ac0f-02c84f49ebe3] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:58:38.903590 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5c22282f-abe1-4795-8d6d-aae1e601f50c tempest-ServerPasswordTestJSON-1023625137 tempest-ServerPasswordTestJSON-1023625137-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:38.904420 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5c22282f-abe1-4795-8d6d-aae1e601f50c tempest-ServerPasswordTestJSON-1023625137 tempest-ServerPasswordTestJSON-1023625137-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:38.905037 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5c22282f-abe1-4795-8d6d-aae1e601f50c tempest-ServerPasswordTestJSON-1023625137 tempest-ServerPasswordTestJSON-1023625137-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:38.905948 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5c22282f-abe1-4795-8d6d-aae1e601f50c tempest-ServerPasswordTestJSON-1023625137 tempest-ServerPasswordTestJSON-1023625137-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:38.913537 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5c22282f-abe1-4795-8d6d-aae1e601f50c tempest-ServerPasswordTestJSON-1023625137 tempest-ServerPasswordTestJSON-1023625137-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:38.914005 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5c22282f-abe1-4795-8d6d-aae1e601f50c tempest-ServerPasswordTestJSON-1023625137 tempest-ServerPasswordTestJSON-1023625137-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:39.010086 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-34cc9236-d0c2-448c-887b-698888388c30 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] HTTP exception thrown: Invalid key_name provided. Oct 04 20:58:39.011966 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-34cc9236-d0c2-448c-887b-698888388c30 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Request method failure captured: Oct 04 20:58:39.011966 n-d-854823-8 devstack@n-api.service[128801]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 20:58:39.011966 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:58:39.011966 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:58:39.011966 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:58:39.011966 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 246 Oct 04 20:58:39.011966 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:58:39.011966 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:58:39.011966 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:58:39.011966 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:58:39.011966 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJ4eaBM_FLl2jaN3nQraRbM94DgE-qlLjkCPNJ1Ol7VvkbIGIp-m_lAuwAay2VJ7lXD5niLtaDpJGDoHOJTljuI2aLuReHvX6jQr-uTgC01ZM2s7p6j6gq6a-1PaGQN0mcmcJntCqSnEEt5MEM6DdrOOdi5eEtsfyNU4EpDYmca-Ylo Oct 04 20:58:39.011966 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:58:39.011966 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:58:39.011966 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:58:39.011966 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:58:39.011966 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:58:39.011966 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:58:39.011966 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: 65946afc398d4a9fb1c9095a4f946e07 Oct 04 20:58:39.011966 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-ServersNegativeTestJSON-1097186397 Oct 04 20:58:39.011966 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 20:58:39.011966 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 20:58:39.011966 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_65946afc398d4a9fb1c9095a4f946e07", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/65946afc398d4a9fb1c9095a4f946e07"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/65946afc398d4a9fb1c9095a4f946e07"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/65946afc398d4a9fb1c9095a4f946e07"}]}] Oct 04 20:58:39.011966 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-ServersNegativeTestJSON-1097186397 Oct 04 20:58:39.011966 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: 65946afc398d4a9fb1c9095a4f946e07 Oct 04 20:58:39.011966 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1097186397 Oct 04 20:58:39.011966 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-ServersNegativeTestJSON-1097186397-project Oct 04 20:58:39.011966 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:58:39.011966 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:58:39.011966 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: 6513f5e908ac4d028cad6eeeebeab285 Oct 04 20:58:39.011966 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-ServersNegativeTestJSON-1097186397-project Oct 04 20:58:39.011966 n-d-854823-8 devstack@n-api.service[128801]: Oct 04 20:58:39.011966 n-d-854823-8 devstack@n-api.service[128801]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1531266845", "imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63", "flavorRef": "452", "key_name": "tempest-key-955274770", "networks": [{"uuid": "780a66b6-435f-46df-9c7b-6f763e190356"}]}} Oct 04 20:58:39.011966 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 20:58:39.011966 n-d-854823-8 devstack@n-api.service[128801]: exception: Invalid key_name provided. Oct 04 20:58:39.011966 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1531266845', 'imageRef': '15b24725-0c99-4bcf-b1fb-907cdf8e2d63', 'flavorRef': '452', 'key_name': 'tempest-key-955274770', 'networks': [{'uuid': '780a66b6-435f-46df-9c7b-6f763e190356'}]}}} Oct 04 20:58:39.011966 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:58:39.011966 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:58:39.011966 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 20:58:39.011966 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 20:58:39.011966 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 20:58:39.011966 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 20:58:39.011966 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 20:58:39.011966 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 20:58:39.011966 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1089, in _validate_and_build_base_options Oct 04 20:58:39.011966 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi key_pair = objects.KeyPair.get_by_name(context, Oct 04 20:58:39.011966 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 20:58:39.011966 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 20:58:39.011966 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Oct 04 20:58:39.011966 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Oct 04 20:58:39.011966 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Oct 04 20:58:39.011966 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Oct 04 20:58:39.011966 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 20:58:39.011966 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 20:58:39.011966 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Oct 04 20:58:39.011966 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Oct 04 20:58:39.011966 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-key-955274770 not found for user 6513f5e908ac4d028cad6eeeebeab285 Oct 04 20:58:39.011966 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:58:39.011966 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:58:39.011966 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:58:39.011966 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:58:39.011966 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:58:39.016863 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:58:39.016863 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:58:39.016863 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:58:39.016863 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:58:39.016863 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:58:39.016863 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:58:39.016863 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:58:39.016863 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:58:39.016863 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:58:39.016863 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:58:39.016863 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:58:39.016863 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 20:58:39.016863 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 807, in create Oct 04 20:58:39.016863 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 04 20:58:39.016863 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid key_name provided. Oct 04 20:58:39.016863 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:58:39.016863 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:58:39.016863 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:58:39.016863 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:58:39.016863 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:58:39.016863 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:58:39.016863 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:58:39.016863 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:58:39.016863 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid key_name provided. Oct 04 20:58:39.016863 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:58:39.016863 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-34cc9236-d0c2-448c-887b-698888388c30 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Returning 400 to user: Invalid key_name provided. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:58:39.016863 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-34cc9236-d0c2-448c-887b-698888388c30 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 400 len: 70 microversion: 2.1 time: 0.841459 Oct 04 20:58:39.027255 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2364/4769] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 20:58:38 2022] POST /compute/v2.1/servers => generated 70 bytes in 856 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 04 20:58:39.032652 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-fdd008e4-0548-413b-bf2a-828ed42d007b tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:58:39.033264 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-fdd008e4-0548-413b-bf2a-828ed42d007b tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] [instance: 320f9a98-969f-473e-bc56-842bbd28dedc] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:58:39.043769 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fdd008e4-0548-413b-bf2a-828ed42d007b tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:39.044268 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fdd008e4-0548-413b-bf2a-828ed42d007b tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:39.044711 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fdd008e4-0548-413b-bf2a-828ed42d007b tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:39.048722 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fdd008e4-0548-413b-bf2a-828ed42d007b tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:39.049521 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fdd008e4-0548-413b-bf2a-828ed42d007b tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:39.049521 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fdd008e4-0548-413b-bf2a-828ed42d007b tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:39.059378 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:58:39.072226 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-5c22282f-abe1-4795-8d6d-aae1e601f50c tempest-ServerPasswordTestJSON-1023625137 tempest-ServerPasswordTestJSON-1023625137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94afe152da6f45a181ed6fd7dd77c033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7007db5728544fc480825a10fac1e81d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:58:39.083275 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-5c22282f-abe1-4795-8d6d-aae1e601f50c tempest-ServerPasswordTestJSON-1023625137 tempest-ServerPasswordTestJSON-1023625137-project] 10.222.0.33 "GET /compute/v2.1/servers/2f6b6d05-2fff-4d82-ac0f-02c84f49ebe3" status: 200 len: 1274 microversion: 2.1 time: 0.196721 Oct 04 20:58:39.103114 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2406/4770] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:58:38 2022] GET /compute/v2.1/servers/2f6b6d05-2fff-4d82-ac0f-02c84f49ebe3 => generated 1274 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:58:39.699328 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-fdd008e4-0548-413b-bf2a-828ed42d007b tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6513f5e908ac4d028cad6eeeebeab285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65946afc398d4a9fb1c9095a4f946e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:58:39.711586 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-fdd008e4-0548-413b-bf2a-828ed42d007b tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc" status: 200 len: 1505 microversion: 2.1 time: 0.682795 Oct 04 20:58:39.716154 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2365/4771] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:58:39 2022] GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc => generated 1505 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:58:39.744085 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-09a2d60a-4367-42bd-8045-a39523c08b0d tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:58:39.747280 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-09a2d60a-4367-42bd-8045-a39523c08b0d tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] [instance: 320f9a98-969f-473e-bc56-842bbd28dedc] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:58:39.768887 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-09a2d60a-4367-42bd-8045-a39523c08b0d tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:39.774392 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-09a2d60a-4367-42bd-8045-a39523c08b0d tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:39.775268 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-09a2d60a-4367-42bd-8045-a39523c08b0d tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:39.778756 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-09a2d60a-4367-42bd-8045-a39523c08b0d tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:39.779504 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-09a2d60a-4367-42bd-8045-a39523c08b0d tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:39.784805 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-09a2d60a-4367-42bd-8045-a39523c08b0d tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:40.118264 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ac6d45cd-1929-4e4f-b997-b13badd49376 tempest-ServerPasswordTestJSON-1023625137 tempest-ServerPasswordTestJSON-1023625137-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:58:40.119316 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ac6d45cd-1929-4e4f-b997-b13badd49376 tempest-ServerPasswordTestJSON-1023625137 tempest-ServerPasswordTestJSON-1023625137-project] [instance: 2f6b6d05-2fff-4d82-ac0f-02c84f49ebe3] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:58:40.135504 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ac6d45cd-1929-4e4f-b997-b13badd49376 tempest-ServerPasswordTestJSON-1023625137 tempest-ServerPasswordTestJSON-1023625137-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:40.137695 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ac6d45cd-1929-4e4f-b997-b13badd49376 tempest-ServerPasswordTestJSON-1023625137 tempest-ServerPasswordTestJSON-1023625137-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:40.140458 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ac6d45cd-1929-4e4f-b997-b13badd49376 tempest-ServerPasswordTestJSON-1023625137 tempest-ServerPasswordTestJSON-1023625137-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:40.142309 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ac6d45cd-1929-4e4f-b997-b13badd49376 tempest-ServerPasswordTestJSON-1023625137 tempest-ServerPasswordTestJSON-1023625137-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:40.145007 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ac6d45cd-1929-4e4f-b997-b13badd49376 tempest-ServerPasswordTestJSON-1023625137 tempest-ServerPasswordTestJSON-1023625137-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:40.151618 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ac6d45cd-1929-4e4f-b997-b13badd49376 tempest-ServerPasswordTestJSON-1023625137 tempest-ServerPasswordTestJSON-1023625137-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:40.442259 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-ac6d45cd-1929-4e4f-b997-b13badd49376 tempest-ServerPasswordTestJSON-1023625137 tempest-ServerPasswordTestJSON-1023625137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94afe152da6f45a181ed6fd7dd77c033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7007db5728544fc480825a10fac1e81d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:58:40.455253 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ac6d45cd-1929-4e4f-b997-b13badd49376 tempest-ServerPasswordTestJSON-1023625137 tempest-ServerPasswordTestJSON-1023625137-project] 10.222.0.33 "GET /compute/v2.1/servers/2f6b6d05-2fff-4d82-ac0f-02c84f49ebe3" status: 200 len: 1274 microversion: 2.1 time: 0.345950 Oct 04 20:58:40.455893 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2366/4772] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:58:40 2022] GET /compute/v2.1/servers/2f6b6d05-2fff-4d82-ac0f-02c84f49ebe3 => generated 1274 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:58:40.557296 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-09a2d60a-4367-42bd-8045-a39523c08b0d tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6513f5e908ac4d028cad6eeeebeab285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65946afc398d4a9fb1c9095a4f946e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:58:40.572561 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-09a2d60a-4367-42bd-8045-a39523c08b0d tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc" status: 200 len: 1505 microversion: 2.1 time: 0.836231 Oct 04 20:58:40.591349 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2407/4773] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:58:39 2022] GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc => generated 1505 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:58:40.914435 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6444e5cc-500c-4c4a-b746-e2d5b49bc65a tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-897679686", "imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "780a66b6-435f-46df-9c7b-6f763e190356"}]}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:58:41.278305 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.network.security_group_api [None req-6444e5cc-500c-4c4a-b746-e2d5b49bc65a tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Neutron security group does_not_exist not found {{(pid=128801) validate_name /opt/stack/nova/nova/network/security_group_api.py:74}} Oct 04 20:58:41.279143 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-6444e5cc-500c-4c4a-b746-e2d5b49bc65a tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] HTTP exception thrown: Unable to find security_group with name or id 'does_not_exist' Oct 04 20:58:41.292203 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6444e5cc-500c-4c4a-b746-e2d5b49bc65a tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Request method failure captured: Oct 04 20:58:41.292203 n-d-854823-8 devstack@n-api.service[128801]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 20:58:41.292203 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:58:41.292203 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:58:41.292203 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:58:41.292203 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 257 Oct 04 20:58:41.292203 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:58:41.292203 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:58:41.292203 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:58:41.292203 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:58:41.292203 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJ4eaBM_FLl2jaN3nQraRbM94DgE-qlLjkCPNJ1Ol7VvkbIGIp-m_lAuwAay2VJ7lXD5niLtaDpJGDoHOJTljuI2aLuReHvX6jQr-uTgC01ZM2s7p6j6gq6a-1PaGQN0mcmcJntCqSnEEt5MEM6DdrOOdi5eEtsfyNU4EpDYmca-Ylo Oct 04 20:58:41.292203 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:58:41.292203 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:58:41.292203 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:58:41.292203 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:58:41.292203 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:58:41.292203 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:58:41.292203 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: 65946afc398d4a9fb1c9095a4f946e07 Oct 04 20:58:41.292203 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-ServersNegativeTestJSON-1097186397 Oct 04 20:58:41.292203 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 20:58:41.292203 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 20:58:41.292203 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_65946afc398d4a9fb1c9095a4f946e07", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/65946afc398d4a9fb1c9095a4f946e07"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/65946afc398d4a9fb1c9095a4f946e07"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/65946afc398d4a9fb1c9095a4f946e07"}]}] Oct 04 20:58:41.292203 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-ServersNegativeTestJSON-1097186397 Oct 04 20:58:41.292203 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: 65946afc398d4a9fb1c9095a4f946e07 Oct 04 20:58:41.292203 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1097186397 Oct 04 20:58:41.292203 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-ServersNegativeTestJSON-1097186397-project Oct 04 20:58:41.292203 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:58:41.292203 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:58:41.292203 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: 6513f5e908ac4d028cad6eeeebeab285 Oct 04 20:58:41.292203 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-ServersNegativeTestJSON-1097186397-project Oct 04 20:58:41.292203 n-d-854823-8 devstack@n-api.service[128801]: Oct 04 20:58:41.292203 n-d-854823-8 devstack@n-api.service[128801]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-897679686", "imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "780a66b6-435f-46df-9c7b-6f763e190356"}]}} Oct 04 20:58:41.292203 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 20:58:41.292203 n-d-854823-8 devstack@n-api.service[128801]: exception: Unable to find security_group with name or id 'does_not_exist' Oct 04 20:58:41.292203 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-897679686', 'imageRef': '15b24725-0c99-4bcf-b1fb-907cdf8e2d63', 'flavorRef': '452', 'security_groups': [{'name': 'does_not_exist'}], 'networks': [{'uuid': '780a66b6-435f-46df-9c7b-6f763e190356'}]}}} Oct 04 20:58:41.292203 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:58:41.292203 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:58:41.292203 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 476, in find_resource Oct 04 20:58:41.292203 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self.find_resource_by_id(resource, name_or_id, Oct 04 20:58:41.292203 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:58:41.292203 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:58:41.292203 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 440, in find_resource_by_id Oct 04 20:58:41.292203 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Oct 04 20:58:41.292203 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with id 'does_not_exist' Oct 04 20:58:41.292203 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:58:41.292203 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:58:41.292203 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:58:41.292203 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:58:41.292203 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 480, in find_resource Oct 04 20:58:41.292203 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self._find_resource_by_name( Oct 04 20:58:41.292203 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:58:41.292203 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:58:41.292203 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 469, in _find_resource_by_name Oct 04 20:58:41.292203 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Oct 04 20:58:41.292203 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name 'does_not_exist' Oct 04 20:58:41.292203 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:58:41.292203 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:58:41.292203 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:58:41.292203 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:58:41.292203 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 68, in validate_name Oct 04 20:58:41.292203 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return neutronv20.find_resourceid_by_name_or_id( Oct 04 20:58:41.299557 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 56, in find_resourceid_by_name_or_id Oct 04 20:58:41.299557 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return find_resource_by_name_or_id(client, resource, name_or_id, Oct 04 20:58:41.299557 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 49, in find_resource_by_name_or_id Oct 04 20:58:41.299557 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return client.find_resource(resource, name_or_id, project_id, Oct 04 20:58:41.299557 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 20:58:41.299557 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 20:58:41.299557 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 488, in find_resource Oct 04 20:58:41.299557 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound( Oct 04 20:58:41.299557 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name or id 'does_not_exist' Oct 04 20:58:41.299557 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:58:41.299557 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:58:41.299557 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:58:41.299557 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:58:41.299557 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 20:58:41.299557 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 20:58:41.299557 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 20:58:41.299557 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 20:58:41.299557 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 20:58:41.299557 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 20:58:41.299557 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1074, in _validate_and_build_base_options Oct 04 20:58:41.299557 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi security_groups = self._check_requested_secgroups( Oct 04 20:58:41.299557 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 521, in _check_requested_secgroups Oct 04 20:58:41.299557 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi secgroup_uuid = security_group_api.validate_name(context, secgroup) Oct 04 20:58:41.299557 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 75, in validate_name Oct 04 20:58:41.299557 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 04 20:58:41.299557 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Unable to find security_group with name or id 'does_not_exist' Oct 04 20:58:41.299557 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:58:41.299557 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:58:41.299557 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:58:41.299557 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:58:41.299557 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:58:41.299557 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:58:41.299557 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:58:41.299557 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:58:41.299557 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:58:41.299557 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:58:41.299557 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:58:41.299557 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:58:41.299557 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:58:41.299557 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:58:41.299557 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:58:41.299557 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:58:41.299557 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 20:58:41.299557 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 04 20:58:41.299557 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 04 20:58:41.299557 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Unable to find security_group with name or id 'does_not_exist' Oct 04 20:58:41.299557 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:58:41.299557 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:58:41.299557 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:58:41.299557 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:58:41.299557 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:58:41.299557 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:58:41.299557 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:58:41.299557 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:58:41.299557 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unable to find security_group with name or id 'does_not_exist' Oct 04 20:58:41.299557 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:58:41.299557 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6444e5cc-500c-4c4a-b746-e2d5b49bc65a tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Returning 400 to user: Unable to find security_group with name or id 'does_not_exist' {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:58:41.311136 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-6444e5cc-500c-4c4a-b746-e2d5b49bc65a tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 400 len: 106 microversion: 2.1 time: 0.384591 Oct 04 20:58:41.311136 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2367/4774] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 20:58:40 2022] POST /compute/v2.1/servers => generated 106 bytes in 386 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 20:58:41.311378 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-370c6b7c-8d56-4a6f-9641-21f6e8d04ddf tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:58:41.311378 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-370c6b7c-8d56-4a6f-9641-21f6e8d04ddf tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] [instance: 320f9a98-969f-473e-bc56-842bbd28dedc] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:58:41.319594 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-370c6b7c-8d56-4a6f-9641-21f6e8d04ddf tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:41.320124 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-370c6b7c-8d56-4a6f-9641-21f6e8d04ddf tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:41.323784 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-370c6b7c-8d56-4a6f-9641-21f6e8d04ddf tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:41.325921 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-370c6b7c-8d56-4a6f-9641-21f6e8d04ddf tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:41.325921 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-370c6b7c-8d56-4a6f-9641-21f6e8d04ddf tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:41.329134 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-370c6b7c-8d56-4a6f-9641-21f6e8d04ddf tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:41.496272 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f0bce0e0-7f6c-40e8-b610-4ca66ce77a3c tempest-ServerPasswordTestJSON-1023625137 tempest-ServerPasswordTestJSON-1023625137-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:58:41.496849 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f0bce0e0-7f6c-40e8-b610-4ca66ce77a3c tempest-ServerPasswordTestJSON-1023625137 tempest-ServerPasswordTestJSON-1023625137-project] [instance: 2f6b6d05-2fff-4d82-ac0f-02c84f49ebe3] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:58:41.518711 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f0bce0e0-7f6c-40e8-b610-4ca66ce77a3c tempest-ServerPasswordTestJSON-1023625137 tempest-ServerPasswordTestJSON-1023625137-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:41.520084 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f0bce0e0-7f6c-40e8-b610-4ca66ce77a3c tempest-ServerPasswordTestJSON-1023625137 tempest-ServerPasswordTestJSON-1023625137-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:41.520712 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f0bce0e0-7f6c-40e8-b610-4ca66ce77a3c tempest-ServerPasswordTestJSON-1023625137 tempest-ServerPasswordTestJSON-1023625137-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:41.521942 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f0bce0e0-7f6c-40e8-b610-4ca66ce77a3c tempest-ServerPasswordTestJSON-1023625137 tempest-ServerPasswordTestJSON-1023625137-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:41.524394 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f0bce0e0-7f6c-40e8-b610-4ca66ce77a3c tempest-ServerPasswordTestJSON-1023625137 tempest-ServerPasswordTestJSON-1023625137-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:41.525944 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f0bce0e0-7f6c-40e8-b610-4ca66ce77a3c tempest-ServerPasswordTestJSON-1023625137 tempest-ServerPasswordTestJSON-1023625137-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:42.574754 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f0bce0e0-7f6c-40e8-b610-4ca66ce77a3c tempest-ServerPasswordTestJSON-1023625137 tempest-ServerPasswordTestJSON-1023625137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94afe152da6f45a181ed6fd7dd77c033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7007db5728544fc480825a10fac1e81d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:58:42.590004 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f0bce0e0-7f6c-40e8-b610-4ca66ce77a3c tempest-ServerPasswordTestJSON-1023625137 tempest-ServerPasswordTestJSON-1023625137-project] 10.222.0.33 "GET /compute/v2.1/servers/2f6b6d05-2fff-4d82-ac0f-02c84f49ebe3" status: 200 len: 1316 microversion: 2.1 time: 1.108176 Oct 04 20:58:42.592301 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2368/4775] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:58:41 2022] GET /compute/v2.1/servers/2f6b6d05-2fff-4d82-ac0f-02c84f49ebe3 => generated 1316 bytes in 1113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:58:42.624975 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-370c6b7c-8d56-4a6f-9641-21f6e8d04ddf tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6513f5e908ac4d028cad6eeeebeab285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65946afc398d4a9fb1c9095a4f946e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:58:42.641748 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-370c6b7c-8d56-4a6f-9641-21f6e8d04ddf tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc" status: 200 len: 1505 microversion: 2.1 time: 1.341489 Oct 04 20:58:42.643753 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2408/4776] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:58:41 2022] GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc => generated 1505 bytes in 1345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:58:42.666540 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ad08f228-c016-42f2-b85f-207f6b0fbbe1 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:58:42.667728 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ad08f228-c016-42f2-b85f-207f6b0fbbe1 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] [instance: 320f9a98-969f-473e-bc56-842bbd28dedc] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:58:42.672696 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:UPDATE=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:58:42.677942 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ad08f228-c016-42f2-b85f-207f6b0fbbe1 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:42.678837 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ad08f228-c016-42f2-b85f-207f6b0fbbe1 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:42.679444 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ad08f228-c016-42f2-b85f-207f6b0fbbe1 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:42.680679 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ad08f228-c016-42f2-b85f-207f6b0fbbe1 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:42.681309 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ad08f228-c016-42f2-b85f-207f6b0fbbe1 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:42.681899 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ad08f228-c016-42f2-b85f-207f6b0fbbe1 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:43.042251 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-ad08f228-c016-42f2-b85f-207f6b0fbbe1 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6513f5e908ac4d028cad6eeeebeab285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65946afc398d4a9fb1c9095a4f946e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:58:43.057486 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ad08f228-c016-42f2-b85f-207f6b0fbbe1 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc" status: 200 len: 1505 microversion: 2.1 time: 0.394317 Oct 04 20:58:43.077144 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2369/4777] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:58:42 2022] GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc => generated 1505 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:58:43.083898 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-8fb4c044-440d-46a1-878a-9ee88bcf40b3 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:58:43.084397 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-8fb4c044-440d-46a1-878a-9ee88bcf40b3 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] [instance: 6a121dd5-f069-4e77-9b44-a6d7cede832b] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:58:43.090171 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.wsgi [None req-8fb4c044-440d-46a1-878a-9ee88bcf40b3 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] HTTP exception thrown: Instance 6a121dd5-f069-4e77-9b44-a6d7cede832b could not be found. Oct 04 20:58:43.091748 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-8fb4c044-440d-46a1-878a-9ee88bcf40b3 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Request method failure captured: Oct 04 20:58:43.091748 n-d-854823-8 devstack@n-api.service[128802]: request: DELETE /compute/v2.1/servers/6a121dd5-f069-4e77-9b44-a6d7cede832b HTTP/1.1 Oct 04 20:58:43.091748 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 20:58:43.091748 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 20:58:43.091748 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 20:58:43.091748 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 0 Oct 04 20:58:43.091748 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 20:58:43.091748 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 20:58:43.091748 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 20:58:43.091748 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 20:58:43.091748 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPJ4eaBM_FLl2jaN3nQraRbM94DgE-qlLjkCPNJ1Ol7VvkbIGIp-m_lAuwAay2VJ7lXD5niLtaDpJGDoHOJTljuI2aLuReHvX6jQr-uTgC01ZM2s7p6j6gq6a-1PaGQN0mcmcJntCqSnEEt5MEM6DdrOOdi5eEtsfyNU4EpDYmca-Ylo Oct 04 20:58:43.091748 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 20:58:43.091748 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 20:58:43.091748 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 20:58:43.091748 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 20:58:43.091748 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 20:58:43.091748 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 20:58:43.091748 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: 65946afc398d4a9fb1c9095a4f946e07 Oct 04 20:58:43.091748 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-ServersNegativeTestJSON-1097186397 Oct 04 20:58:43.091748 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 20:58:43.091748 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 20:58:43.091748 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_65946afc398d4a9fb1c9095a4f946e07", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/65946afc398d4a9fb1c9095a4f946e07"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/65946afc398d4a9fb1c9095a4f946e07"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/65946afc398d4a9fb1c9095a4f946e07"}]}] Oct 04 20:58:43.091748 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-ServersNegativeTestJSON-1097186397 Oct 04 20:58:43.091748 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: 65946afc398d4a9fb1c9095a4f946e07 Oct 04 20:58:43.091748 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1097186397 Oct 04 20:58:43.091748 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-ServersNegativeTestJSON-1097186397-project Oct 04 20:58:43.091748 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 20:58:43.091748 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 20:58:43.091748 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: 6513f5e908ac4d028cad6eeeebeab285 Oct 04 20:58:43.091748 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-ServersNegativeTestJSON-1097186397-project Oct 04 20:58:43.091748 n-d-854823-8 devstack@n-api.service[128802]: method: > Oct 04 20:58:43.091748 n-d-854823-8 devstack@n-api.service[128802]: exception: Instance 6a121dd5-f069-4e77-9b44-a6d7cede832b could not be found. Oct 04 20:58:43.091748 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'id': '6a121dd5-f069-4e77-9b44-a6d7cede832b'} Oct 04 20:58:43.091748 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:58:43.091748 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:58:43.091748 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:58:43.091748 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:58:43.091748 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:58:43.091748 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:58:43.091748 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 20:58:43.091748 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 20:58:43.091748 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a121dd5-f069-4e77-9b44-a6d7cede832b could not be found. Oct 04 20:58:43.091748 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:58:43.091748 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:58:43.091748 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:58:43.091748 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:58:43.091748 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:58:43.091748 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:58:43.091748 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:58:43.091748 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:58:43.091748 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:58:43.091748 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:58:43.091748 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 20:58:43.091748 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 20:58:43.091748 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 20:58:43.091748 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 20:58:43.091748 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:58:43.091748 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:58:43.091748 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:58:43.091748 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:58:43.091748 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a121dd5-f069-4e77-9b44-a6d7cede832b could not be found. Oct 04 20:58:43.091748 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:58:43.091748 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:58:43.097000 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:58:43.097000 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:58:43.097000 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:58:43.097000 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:58:43.097000 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:58:43.097000 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:58:43.097000 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a121dd5-f069-4e77-9b44-a6d7cede832b could not be found. Oct 04 20:58:43.097000 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:58:43.097000 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-8fb4c044-440d-46a1-878a-9ee88bcf40b3 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Returning 404 to user: Instance 6a121dd5-f069-4e77-9b44-a6d7cede832b could not be found. {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:58:43.097000 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-8fb4c044-440d-46a1-878a-9ee88bcf40b3 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "DELETE /compute/v2.1/servers/6a121dd5-f069-4e77-9b44-a6d7cede832b" status: 404 len: 111 microversion: 2.1 time: 0.013919 Oct 04 20:58:43.102071 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-dbf5966c-b46d-4821-8cd6-089f978062c5 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:58:43.102801 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-dbf5966c-b46d-4821-8cd6-089f978062c5 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] [instance: 320f9a98-969f-473e-bc56-842bbd28dedc] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:58:43.104718 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2409/4778] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 20:58:43 2022] DELETE /compute/v2.1/servers/6a121dd5-f069-4e77-9b44-a6d7cede832b => generated 111 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:58:43.109554 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dbf5966c-b46d-4821-8cd6-089f978062c5 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:43.110049 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dbf5966c-b46d-4821-8cd6-089f978062c5 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:43.110518 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dbf5966c-b46d-4821-8cd6-089f978062c5 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:43.111221 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dbf5966c-b46d-4821-8cd6-089f978062c5 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:43.111867 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dbf5966c-b46d-4821-8cd6-089f978062c5 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:43.112461 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dbf5966c-b46d-4821-8cd6-089f978062c5 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:43.535647 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:58:43.608408 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=6 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:58:43.621580 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-4eb64844-a9b3-40bb-b8ea-85b535697146 tempest-ServerPasswordTestJSON-1023625137 tempest-ServerPasswordTestJSON-1023625137-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:58:43.625888 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-4eb64844-a9b3-40bb-b8ea-85b535697146 tempest-ServerPasswordTestJSON-1023625137 tempest-ServerPasswordTestJSON-1023625137-project] [instance: 2f6b6d05-2fff-4d82-ac0f-02c84f49ebe3] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:58:43.661645 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4eb64844-a9b3-40bb-b8ea-85b535697146 tempest-ServerPasswordTestJSON-1023625137 tempest-ServerPasswordTestJSON-1023625137-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:43.671749 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4eb64844-a9b3-40bb-b8ea-85b535697146 tempest-ServerPasswordTestJSON-1023625137 tempest-ServerPasswordTestJSON-1023625137-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:43.672209 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4eb64844-a9b3-40bb-b8ea-85b535697146 tempest-ServerPasswordTestJSON-1023625137 tempest-ServerPasswordTestJSON-1023625137-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:43.672972 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4eb64844-a9b3-40bb-b8ea-85b535697146 tempest-ServerPasswordTestJSON-1023625137 tempest-ServerPasswordTestJSON-1023625137-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:43.679266 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4eb64844-a9b3-40bb-b8ea-85b535697146 tempest-ServerPasswordTestJSON-1023625137 tempest-ServerPasswordTestJSON-1023625137-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:43.679897 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4eb64844-a9b3-40bb-b8ea-85b535697146 tempest-ServerPasswordTestJSON-1023625137 tempest-ServerPasswordTestJSON-1023625137-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:44.322526 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-4eb64844-a9b3-40bb-b8ea-85b535697146 tempest-ServerPasswordTestJSON-1023625137 tempest-ServerPasswordTestJSON-1023625137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94afe152da6f45a181ed6fd7dd77c033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7007db5728544fc480825a10fac1e81d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:58:44.353544 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-dbf5966c-b46d-4821-8cd6-089f978062c5 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6513f5e908ac4d028cad6eeeebeab285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65946afc398d4a9fb1c9095a4f946e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:58:44.367666 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-4eb64844-a9b3-40bb-b8ea-85b535697146 tempest-ServerPasswordTestJSON-1023625137 tempest-ServerPasswordTestJSON-1023625137-project] 10.222.0.33 "GET /compute/v2.1/servers/2f6b6d05-2fff-4d82-ac0f-02c84f49ebe3" status: 200 len: 1316 microversion: 2.1 time: 0.754125 Oct 04 20:58:44.372128 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2410/4779] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:58:43 2022] GET /compute/v2.1/servers/2f6b6d05-2fff-4d82-ac0f-02c84f49ebe3 => generated 1316 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:58:44.380822 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-dbf5966c-b46d-4821-8cd6-089f978062c5 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc" status: 200 len: 1505 microversion: 2.1 time: 1.280675 Oct 04 20:58:44.386147 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2370/4780] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:58:43 2022] GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc => generated 1505 bytes in 1289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:58:44.396757 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-da99f007-fec7-490f-9ba3-0fdff9a479a9 req-82760597-4dba-4adb-aaf2-e3075072087c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f6b6d05-2fff-4d82-ac0f-02c84f49ebe3", "tag": "c8b9f449-1dbd-4568-ab4c-f71d869a3c1e"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:58:44.418033 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5bd8b6da-6824-4df3-a56c-eed082624020 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:58:44.418679 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-5bd8b6da-6824-4df3-a56c-eed082624020 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] [instance: 320f9a98-969f-473e-bc56-842bbd28dedc] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:58:44.440320 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-da99f007-fec7-490f-9ba3-0fdff9a479a9 req-82760597-4dba-4adb-aaf2-e3075072087c service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:44.452792 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-da99f007-fec7-490f-9ba3-0fdff9a479a9 req-82760597-4dba-4adb-aaf2-e3075072087c service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:44.453736 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5bd8b6da-6824-4df3-a56c-eed082624020 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:44.453736 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5bd8b6da-6824-4df3-a56c-eed082624020 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:44.454539 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-da99f007-fec7-490f-9ba3-0fdff9a479a9 req-82760597-4dba-4adb-aaf2-e3075072087c service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:44.454662 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5bd8b6da-6824-4df3-a56c-eed082624020 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:44.454662 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5bd8b6da-6824-4df3-a56c-eed082624020 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:44.454662 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5bd8b6da-6824-4df3-a56c-eed082624020 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:44.454662 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5bd8b6da-6824-4df3-a56c-eed082624020 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:44.477434 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-da99f007-fec7-490f-9ba3-0fdff9a479a9 req-82760597-4dba-4adb-aaf2-e3075072087c service nova] Creating event network-changed:c8b9f449-1dbd-4568-ab4c-f71d869a3c1e for instance 2f6b6d05-2fff-4d82-ac0f-02c84f49ebe3 on n-h1-854823-8 Oct 04 20:58:44.490457 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-da99f007-fec7-490f-9ba3-0fdff9a479a9 req-82760597-4dba-4adb-aaf2-e3075072087c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110573 Oct 04 20:58:44.491114 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2411/4781] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:58:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:58:45.415653 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-8eb97531-1a79-4370-8a40-97f91b3db57f tempest-ServerPasswordTestJSON-1023625137 tempest-ServerPasswordTestJSON-1023625137-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:58:45.416958 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-8eb97531-1a79-4370-8a40-97f91b3db57f tempest-ServerPasswordTestJSON-1023625137 tempest-ServerPasswordTestJSON-1023625137-project] [instance: 2f6b6d05-2fff-4d82-ac0f-02c84f49ebe3] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:58:45.435905 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell0:SELECT=2 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:58:45.444974 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8eb97531-1a79-4370-8a40-97f91b3db57f tempest-ServerPasswordTestJSON-1023625137 tempest-ServerPasswordTestJSON-1023625137-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:45.447591 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8eb97531-1a79-4370-8a40-97f91b3db57f tempest-ServerPasswordTestJSON-1023625137 tempest-ServerPasswordTestJSON-1023625137-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:45.448666 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8eb97531-1a79-4370-8a40-97f91b3db57f tempest-ServerPasswordTestJSON-1023625137 tempest-ServerPasswordTestJSON-1023625137-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:45.450754 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8eb97531-1a79-4370-8a40-97f91b3db57f tempest-ServerPasswordTestJSON-1023625137 tempest-ServerPasswordTestJSON-1023625137-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:45.451242 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8eb97531-1a79-4370-8a40-97f91b3db57f tempest-ServerPasswordTestJSON-1023625137 tempest-ServerPasswordTestJSON-1023625137-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:45.453893 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8eb97531-1a79-4370-8a40-97f91b3db57f tempest-ServerPasswordTestJSON-1023625137 tempest-ServerPasswordTestJSON-1023625137-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:46.449715 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-5bd8b6da-6824-4df3-a56c-eed082624020 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6513f5e908ac4d028cad6eeeebeab285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65946afc398d4a9fb1c9095a4f946e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:58:46.476121 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5bd8b6da-6824-4df3-a56c-eed082624020 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc" status: 200 len: 1505 microversion: 2.1 time: 2.064393 Oct 04 20:58:46.478464 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-8eb97531-1a79-4370-8a40-97f91b3db57f tempest-ServerPasswordTestJSON-1023625137 tempest-ServerPasswordTestJSON-1023625137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94afe152da6f45a181ed6fd7dd77c033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7007db5728544fc480825a10fac1e81d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:58:46.479468 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2371/4782] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:58:44 2022] GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc => generated 1505 bytes in 2067 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:58:46.495933 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-8eb97531-1a79-4370-8a40-97f91b3db57f tempest-ServerPasswordTestJSON-1023625137 tempest-ServerPasswordTestJSON-1023625137-project] 10.222.0.33 "GET /compute/v2.1/servers/2f6b6d05-2fff-4d82-ac0f-02c84f49ebe3" status: 200 len: 1316 microversion: 2.1 time: 1.088047 Oct 04 20:58:46.496538 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2412/4783] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:58:45 2022] GET /compute/v2.1/servers/2f6b6d05-2fff-4d82-ac0f-02c84f49ebe3 => generated 1316 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:58:46.511558 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8bfe8ee9-e644-4535-8dc5-c42cf48a050d tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:58:46.512115 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-8bfe8ee9-e644-4535-8dc5-c42cf48a050d tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Failed to fetch instance by id 9223372036854775808 {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 04 20:58:46.512726 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-8bfe8ee9-e644-4535-8dc5-c42cf48a050d tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] HTTP exception thrown: Instance 9223372036854775808 could not be found. Oct 04 20:58:46.517508 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8bfe8ee9-e644-4535-8dc5-c42cf48a050d tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Request method failure captured: Oct 04 20:58:46.517508 n-d-854823-8 devstack@n-api.service[128801]: request: DELETE /compute/v2.1/servers/9223372036854775808 HTTP/1.1 Oct 04 20:58:46.517508 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:58:46.517508 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:58:46.517508 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:58:46.517508 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 0 Oct 04 20:58:46.517508 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:58:46.517508 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:58:46.517508 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:58:46.517508 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:58:46.517508 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJ4eaBM_FLl2jaN3nQraRbM94DgE-qlLjkCPNJ1Ol7VvkbIGIp-m_lAuwAay2VJ7lXD5niLtaDpJGDoHOJTljuI2aLuReHvX6jQr-uTgC01ZM2s7p6j6gq6a-1PaGQN0mcmcJntCqSnEEt5MEM6DdrOOdi5eEtsfyNU4EpDYmca-Ylo Oct 04 20:58:46.517508 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:58:46.517508 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:58:46.517508 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:58:46.517508 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:58:46.517508 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:58:46.517508 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:58:46.517508 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: 65946afc398d4a9fb1c9095a4f946e07 Oct 04 20:58:46.517508 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-ServersNegativeTestJSON-1097186397 Oct 04 20:58:46.517508 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 20:58:46.517508 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 20:58:46.517508 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_65946afc398d4a9fb1c9095a4f946e07", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/65946afc398d4a9fb1c9095a4f946e07"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/65946afc398d4a9fb1c9095a4f946e07"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/65946afc398d4a9fb1c9095a4f946e07"}]}] Oct 04 20:58:46.517508 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-ServersNegativeTestJSON-1097186397 Oct 04 20:58:46.517508 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: 65946afc398d4a9fb1c9095a4f946e07 Oct 04 20:58:46.517508 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1097186397 Oct 04 20:58:46.517508 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-ServersNegativeTestJSON-1097186397-project Oct 04 20:58:46.517508 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:58:46.517508 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:58:46.517508 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: 6513f5e908ac4d028cad6eeeebeab285 Oct 04 20:58:46.517508 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-ServersNegativeTestJSON-1097186397-project Oct 04 20:58:46.517508 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 20:58:46.517508 n-d-854823-8 devstack@n-api.service[128801]: exception: Instance 9223372036854775808 could not be found. Oct 04 20:58:46.517508 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': '9223372036854775808'} Oct 04 20:58:46.517508 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:58:46.517508 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:58:46.517508 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:58:46.517508 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:58:46.517508 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 04 20:58:46.517508 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 04 20:58:46.517508 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9223372036854775808 could not be found. Oct 04 20:58:46.517508 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:58:46.517508 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:58:46.517508 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:58:46.517508 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:58:46.517508 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:58:46.517508 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:58:46.517508 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:58:46.517508 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:58:46.517508 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:58:46.517508 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:58:46.517508 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 20:58:46.517508 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 20:58:46.517508 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 20:58:46.517508 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 20:58:46.517508 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:58:46.517508 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:58:46.517508 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:58:46.517508 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:58:46.517508 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9223372036854775808 could not be found. Oct 04 20:58:46.517508 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:58:46.517508 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:58:46.517508 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:58:46.517508 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:58:46.517508 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:58:46.523442 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:58:46.523442 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:58:46.523442 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:58:46.523442 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9223372036854775808 could not be found. Oct 04 20:58:46.523442 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:58:46.523442 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8bfe8ee9-e644-4535-8dc5-c42cf48a050d tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Returning 404 to user: Instance 9223372036854775808 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:58:46.523442 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-8bfe8ee9-e644-4535-8dc5-c42cf48a050d tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "DELETE /compute/v2.1/servers/9223372036854775808" status: 404 len: 94 microversion: 2.1 time: 0.014413 Oct 04 20:58:46.523442 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2372/4784] 10.222.0.33 () {58 vars in 1188 bytes} [Tue Oct 4 20:58:46 2022] DELETE /compute/v2.1/servers/9223372036854775808 => generated 94 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 20:58:46.541530 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-e93cb6dd-5f60-4ce1-90d1-cb903b6c2408 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:58:46.544956 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-e93cb6dd-5f60-4ce1-90d1-cb903b6c2408 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] [instance: 320f9a98-969f-473e-bc56-842bbd28dedc] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:58:46.568131 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e93cb6dd-5f60-4ce1-90d1-cb903b6c2408 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:46.568489 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e93cb6dd-5f60-4ce1-90d1-cb903b6c2408 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:46.569005 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e93cb6dd-5f60-4ce1-90d1-cb903b6c2408 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:46.569778 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e93cb6dd-5f60-4ce1-90d1-cb903b6c2408 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:46.570183 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e93cb6dd-5f60-4ce1-90d1-cb903b6c2408 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:46.570650 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e93cb6dd-5f60-4ce1-90d1-cb903b6c2408 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:47.248855 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-e93cb6dd-5f60-4ce1-90d1-cb903b6c2408 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6513f5e908ac4d028cad6eeeebeab285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65946afc398d4a9fb1c9095a4f946e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:58:47.263675 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-e93cb6dd-5f60-4ce1-90d1-cb903b6c2408 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc" status: 200 len: 1505 microversion: 2.1 time: 0.731676 Oct 04 20:58:47.298327 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2413/4785] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:58:46 2022] GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc => generated 1505 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:58:47.305189 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ca5e5873-6f9a-44fe-8ae4-f1b01d96f40b tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:58:47.306296 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ca5e5873-6f9a-44fe-8ae4-f1b01d96f40b tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] [instance: 320f9a98-969f-473e-bc56-842bbd28dedc] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:58:47.351019 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ca5e5873-6f9a-44fe-8ae4-f1b01d96f40b tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:47.351942 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ca5e5873-6f9a-44fe-8ae4-f1b01d96f40b tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:47.355344 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ca5e5873-6f9a-44fe-8ae4-f1b01d96f40b tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:47.357258 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ca5e5873-6f9a-44fe-8ae4-f1b01d96f40b tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:47.357738 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ca5e5873-6f9a-44fe-8ae4-f1b01d96f40b tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:47.358178 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ca5e5873-6f9a-44fe-8ae4-f1b01d96f40b tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:47.527771 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-d41b0e8e-6e14-4f3b-818b-60cfcd67e960 tempest-ServerPasswordTestJSON-1023625137 tempest-ServerPasswordTestJSON-1023625137-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:58:47.529134 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-d41b0e8e-6e14-4f3b-818b-60cfcd67e960 tempest-ServerPasswordTestJSON-1023625137 tempest-ServerPasswordTestJSON-1023625137-project] [instance: 2f6b6d05-2fff-4d82-ac0f-02c84f49ebe3] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:58:47.546771 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d41b0e8e-6e14-4f3b-818b-60cfcd67e960 tempest-ServerPasswordTestJSON-1023625137 tempest-ServerPasswordTestJSON-1023625137-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:47.548404 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d41b0e8e-6e14-4f3b-818b-60cfcd67e960 tempest-ServerPasswordTestJSON-1023625137 tempest-ServerPasswordTestJSON-1023625137-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:47.555916 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d41b0e8e-6e14-4f3b-818b-60cfcd67e960 tempest-ServerPasswordTestJSON-1023625137 tempest-ServerPasswordTestJSON-1023625137-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:47.557438 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d41b0e8e-6e14-4f3b-818b-60cfcd67e960 tempest-ServerPasswordTestJSON-1023625137 tempest-ServerPasswordTestJSON-1023625137-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:47.560169 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d41b0e8e-6e14-4f3b-818b-60cfcd67e960 tempest-ServerPasswordTestJSON-1023625137 tempest-ServerPasswordTestJSON-1023625137-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:47.560901 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d41b0e8e-6e14-4f3b-818b-60cfcd67e960 tempest-ServerPasswordTestJSON-1023625137 tempest-ServerPasswordTestJSON-1023625137-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:48.545015 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-ca5e5873-6f9a-44fe-8ae4-f1b01d96f40b tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6513f5e908ac4d028cad6eeeebeab285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65946afc398d4a9fb1c9095a4f946e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:58:48.564549 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-d41b0e8e-6e14-4f3b-818b-60cfcd67e960 tempest-ServerPasswordTestJSON-1023625137 tempest-ServerPasswordTestJSON-1023625137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94afe152da6f45a181ed6fd7dd77c033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7007db5728544fc480825a10fac1e81d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:58:48.566221 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ca5e5873-6f9a-44fe-8ae4-f1b01d96f40b tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc" status: 200 len: 1505 microversion: 2.1 time: 1.263126 Oct 04 20:58:48.579397 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2373/4786] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:58:47 2022] GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc => generated 1505 bytes in 1271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:58:48.579771 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-d41b0e8e-6e14-4f3b-818b-60cfcd67e960 tempest-ServerPasswordTestJSON-1023625137 tempest-ServerPasswordTestJSON-1023625137-project] 10.222.0.33 "GET /compute/v2.1/servers/2f6b6d05-2fff-4d82-ac0f-02c84f49ebe3" status: 200 len: 1316 microversion: 2.1 time: 1.052195 Oct 04 20:58:48.579771 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2414/4787] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:58:47 2022] GET /compute/v2.1/servers/2f6b6d05-2fff-4d82-ac0f-02c84f49ebe3 => generated 1316 bytes in 1054 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:58:48.591069 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e5df1dfc-3145-42f6-9b75-a06ed5086bc1 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:58:48.591560 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e5df1dfc-3145-42f6-9b75-a06ed5086bc1 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Failed to fetch instance by id -1 {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 04 20:58:48.592076 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-e5df1dfc-3145-42f6-9b75-a06ed5086bc1 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] HTTP exception thrown: Instance -1 could not be found. Oct 04 20:58:48.593555 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e5df1dfc-3145-42f6-9b75-a06ed5086bc1 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Request method failure captured: Oct 04 20:58:48.593555 n-d-854823-8 devstack@n-api.service[128801]: request: DELETE /compute/v2.1/servers/-1 HTTP/1.1 Oct 04 20:58:48.593555 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:58:48.593555 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:58:48.593555 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:58:48.593555 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 0 Oct 04 20:58:48.593555 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:58:48.593555 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:58:48.593555 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:58:48.593555 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:58:48.593555 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJ4eaBM_FLl2jaN3nQraRbM94DgE-qlLjkCPNJ1Ol7VvkbIGIp-m_lAuwAay2VJ7lXD5niLtaDpJGDoHOJTljuI2aLuReHvX6jQr-uTgC01ZM2s7p6j6gq6a-1PaGQN0mcmcJntCqSnEEt5MEM6DdrOOdi5eEtsfyNU4EpDYmca-Ylo Oct 04 20:58:48.593555 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:58:48.593555 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:58:48.593555 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:58:48.593555 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:58:48.593555 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:58:48.593555 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:58:48.593555 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: 65946afc398d4a9fb1c9095a4f946e07 Oct 04 20:58:48.593555 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-ServersNegativeTestJSON-1097186397 Oct 04 20:58:48.593555 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 20:58:48.593555 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 20:58:48.593555 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_65946afc398d4a9fb1c9095a4f946e07", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/65946afc398d4a9fb1c9095a4f946e07"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/65946afc398d4a9fb1c9095a4f946e07"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/65946afc398d4a9fb1c9095a4f946e07"}]}] Oct 04 20:58:48.593555 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-ServersNegativeTestJSON-1097186397 Oct 04 20:58:48.593555 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: 65946afc398d4a9fb1c9095a4f946e07 Oct 04 20:58:48.593555 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1097186397 Oct 04 20:58:48.593555 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-ServersNegativeTestJSON-1097186397-project Oct 04 20:58:48.593555 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:58:48.593555 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:58:48.593555 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: 6513f5e908ac4d028cad6eeeebeab285 Oct 04 20:58:48.593555 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-ServersNegativeTestJSON-1097186397-project Oct 04 20:58:48.593555 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 20:58:48.593555 n-d-854823-8 devstack@n-api.service[128801]: exception: Instance -1 could not be found. Oct 04 20:58:48.593555 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': '-1'} Oct 04 20:58:48.593555 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:58:48.593555 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:58:48.593555 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:58:48.593555 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:58:48.593555 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 04 20:58:48.593555 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 04 20:58:48.593555 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance -1 could not be found. Oct 04 20:58:48.593555 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:58:48.593555 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:58:48.593555 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:58:48.593555 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:58:48.593555 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:58:48.593555 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:58:48.593555 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:58:48.593555 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:58:48.593555 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:58:48.593555 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:58:48.593555 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 20:58:48.593555 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 20:58:48.593555 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 20:58:48.593555 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 20:58:48.593555 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:58:48.593555 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:58:48.593555 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:58:48.593555 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:58:48.593555 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance -1 could not be found. Oct 04 20:58:48.593555 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:58:48.593555 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:58:48.593555 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:58:48.593555 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:58:48.593555 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:58:48.593555 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:58:48.601421 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:58:48.601421 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:58:48.601421 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance -1 could not be found. Oct 04 20:58:48.601421 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:58:48.601421 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e5df1dfc-3145-42f6-9b75-a06ed5086bc1 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Returning 404 to user: Instance -1 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:58:48.602250 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e5df1dfc-3145-42f6-9b75-a06ed5086bc1 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "DELETE /compute/v2.1/servers/-1" status: 404 len: 77 microversion: 2.1 time: 0.013850 Oct 04 20:58:48.609896 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2374/4788] 10.222.0.33 () {58 vars in 1137 bytes} [Tue Oct 4 20:58:48 2022] DELETE /compute/v2.1/servers/-1 => generated 77 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 20:58:48.615736 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-f2caee1b-40be-407c-a8e4-382855bee8a1 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:58:48.616563 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-f2caee1b-40be-407c-a8e4-382855bee8a1 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] [instance: 320f9a98-969f-473e-bc56-842bbd28dedc] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:58:48.618554 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_api:SELECT=76 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:58:48.627691 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f2caee1b-40be-407c-a8e4-382855bee8a1 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:48.630327 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f2caee1b-40be-407c-a8e4-382855bee8a1 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:48.630930 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f2caee1b-40be-407c-a8e4-382855bee8a1 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:48.632985 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f2caee1b-40be-407c-a8e4-382855bee8a1 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:48.636015 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f2caee1b-40be-407c-a8e4-382855bee8a1 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:48.636579 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f2caee1b-40be-407c-a8e4-382855bee8a1 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:49.607465 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1026e656-293c-4aa5-82c7-219b779ee1c1 tempest-ServerPasswordTestJSON-1023625137 tempest-ServerPasswordTestJSON-1023625137-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:58:49.608226 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-1026e656-293c-4aa5-82c7-219b779ee1c1 tempest-ServerPasswordTestJSON-1023625137 tempest-ServerPasswordTestJSON-1023625137-project] [instance: 2f6b6d05-2fff-4d82-ac0f-02c84f49ebe3] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:58:49.626560 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1026e656-293c-4aa5-82c7-219b779ee1c1 tempest-ServerPasswordTestJSON-1023625137 tempest-ServerPasswordTestJSON-1023625137-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:49.630813 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1026e656-293c-4aa5-82c7-219b779ee1c1 tempest-ServerPasswordTestJSON-1023625137 tempest-ServerPasswordTestJSON-1023625137-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:49.632853 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1026e656-293c-4aa5-82c7-219b779ee1c1 tempest-ServerPasswordTestJSON-1023625137 tempest-ServerPasswordTestJSON-1023625137-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:49.633987 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1026e656-293c-4aa5-82c7-219b779ee1c1 tempest-ServerPasswordTestJSON-1023625137 tempest-ServerPasswordTestJSON-1023625137-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:49.634660 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1026e656-293c-4aa5-82c7-219b779ee1c1 tempest-ServerPasswordTestJSON-1023625137 tempest-ServerPasswordTestJSON-1023625137-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:49.643302 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1026e656-293c-4aa5-82c7-219b779ee1c1 tempest-ServerPasswordTestJSON-1023625137 tempest-ServerPasswordTestJSON-1023625137-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:49.795878 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-f2caee1b-40be-407c-a8e4-382855bee8a1 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6513f5e908ac4d028cad6eeeebeab285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65946afc398d4a9fb1c9095a4f946e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:58:49.806110 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-f2caee1b-40be-407c-a8e4-382855bee8a1 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc" status: 200 len: 1505 microversion: 2.1 time: 1.194781 Oct 04 20:58:49.811088 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2415/4789] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:58:48 2022] GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc => generated 1505 bytes in 1200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:58:49.845244 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-7185c04c-5bbb-473b-b91c-7b649f8cf0d2 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:58:49.848862 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-7185c04c-5bbb-473b-b91c-7b649f8cf0d2 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] [instance: 320f9a98-969f-473e-bc56-842bbd28dedc] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:58:49.870020 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7185c04c-5bbb-473b-b91c-7b649f8cf0d2 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:49.874623 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7185c04c-5bbb-473b-b91c-7b649f8cf0d2 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:49.875128 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7185c04c-5bbb-473b-b91c-7b649f8cf0d2 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:49.875904 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7185c04c-5bbb-473b-b91c-7b649f8cf0d2 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:49.876376 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7185c04c-5bbb-473b-b91c-7b649f8cf0d2 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:49.876807 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7185c04c-5bbb-473b-b91c-7b649f8cf0d2 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:50.776495 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-1026e656-293c-4aa5-82c7-219b779ee1c1 tempest-ServerPasswordTestJSON-1023625137 tempest-ServerPasswordTestJSON-1023625137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94afe152da6f45a181ed6fd7dd77c033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7007db5728544fc480825a10fac1e81d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:58:50.790223 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-1026e656-293c-4aa5-82c7-219b779ee1c1 tempest-ServerPasswordTestJSON-1023625137 tempest-ServerPasswordTestJSON-1023625137-project] 10.222.0.33 "GET /compute/v2.1/servers/2f6b6d05-2fff-4d82-ac0f-02c84f49ebe3" status: 200 len: 1316 microversion: 2.1 time: 1.186929 Oct 04 20:58:50.794883 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2375/4790] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:58:49 2022] GET /compute/v2.1/servers/2f6b6d05-2fff-4d82-ac0f-02c84f49ebe3 => generated 1316 bytes in 1192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:58:51.106553 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-7185c04c-5bbb-473b-b91c-7b649f8cf0d2 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6513f5e908ac4d028cad6eeeebeab285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65946afc398d4a9fb1c9095a4f946e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:58:51.122575 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-7185c04c-5bbb-473b-b91c-7b649f8cf0d2 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc" status: 200 len: 1505 microversion: 2.1 time: 1.278093 Oct 04 20:58:51.123584 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2416/4791] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:58:49 2022] GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc => generated 1505 bytes in 1283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:58:51.158056 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-38c50b9a-521d-45c5-af02-a4be251136ad tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Action: 'action', calling method: >, body: {"forceDelete": {}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:58:51.159112 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-38c50b9a-521d-45c5-af02-a4be251136ad tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] [instance: 668f04f9-8661-40d4-848f-daebc639efc1] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:58:51.172180 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-38c50b9a-521d-45c5-af02-a4be251136ad tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] HTTP exception thrown: Instance 668f04f9-8661-40d4-848f-daebc639efc1 could not be found. Oct 04 20:58:51.181552 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-38c50b9a-521d-45c5-af02-a4be251136ad tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Request method failure captured: Oct 04 20:58:51.181552 n-d-854823-8 devstack@n-api.service[128801]: request: POST /compute/v2.1/servers/668f04f9-8661-40d4-848f-daebc639efc1/action HTTP/1.1 Oct 04 20:58:51.181552 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:58:51.181552 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:58:51.181552 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:58:51.181552 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 19 Oct 04 20:58:51.181552 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:58:51.181552 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:58:51.181552 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:58:51.181552 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:58:51.181552 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJ4eaBM_FLl2jaN3nQraRbM94DgE-qlLjkCPNJ1Ol7VvkbIGIp-m_lAuwAay2VJ7lXD5niLtaDpJGDoHOJTljuI2aLuReHvX6jQr-uTgC01ZM2s7p6j6gq6a-1PaGQN0mcmcJntCqSnEEt5MEM6DdrOOdi5eEtsfyNU4EpDYmca-Ylo Oct 04 20:58:51.181552 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:58:51.181552 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:58:51.181552 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:58:51.181552 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:58:51.181552 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:58:51.181552 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:58:51.181552 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: 65946afc398d4a9fb1c9095a4f946e07 Oct 04 20:58:51.181552 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-ServersNegativeTestJSON-1097186397 Oct 04 20:58:51.181552 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 20:58:51.181552 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 20:58:51.181552 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_65946afc398d4a9fb1c9095a4f946e07", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/65946afc398d4a9fb1c9095a4f946e07"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/65946afc398d4a9fb1c9095a4f946e07"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/65946afc398d4a9fb1c9095a4f946e07"}]}] Oct 04 20:58:51.181552 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-ServersNegativeTestJSON-1097186397 Oct 04 20:58:51.181552 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: 65946afc398d4a9fb1c9095a4f946e07 Oct 04 20:58:51.181552 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1097186397 Oct 04 20:58:51.181552 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-ServersNegativeTestJSON-1097186397-project Oct 04 20:58:51.181552 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:58:51.181552 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:58:51.181552 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: 6513f5e908ac4d028cad6eeeebeab285 Oct 04 20:58:51.181552 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-ServersNegativeTestJSON-1097186397-project Oct 04 20:58:51.181552 n-d-854823-8 devstack@n-api.service[128801]: Oct 04 20:58:51.181552 n-d-854823-8 devstack@n-api.service[128801]: {"forceDelete": {}} Oct 04 20:58:51.181552 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 20:58:51.181552 n-d-854823-8 devstack@n-api.service[128801]: exception: Instance 668f04f9-8661-40d4-848f-daebc639efc1 could not be found. Oct 04 20:58:51.181552 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': '668f04f9-8661-40d4-848f-daebc639efc1', 'body': {'forceDelete': {}}} Oct 04 20:58:51.181552 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:58:51.181552 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:58:51.181552 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:58:51.181552 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:58:51.181552 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:58:51.181552 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:58:51.181552 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 20:58:51.181552 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 20:58:51.181552 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 668f04f9-8661-40d4-848f-daebc639efc1 could not be found. Oct 04 20:58:51.181552 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:58:51.181552 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:58:51.181552 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:58:51.181552 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:58:51.181552 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:58:51.181552 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:58:51.181552 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:58:51.181552 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:58:51.181552 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:58:51.181552 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:58:51.181552 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 55, in _force_delete Oct 04 20:58:51.181552 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 04 20:58:51.181552 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:58:51.181552 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:58:51.181552 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 668f04f9-8661-40d4-848f-daebc639efc1 could not be found. Oct 04 20:58:51.181552 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:58:51.181552 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:58:51.181552 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:58:51.181552 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:58:51.181552 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:58:51.181552 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:58:51.192762 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:58:51.192762 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:58:51.192762 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 668f04f9-8661-40d4-848f-daebc639efc1 could not be found. Oct 04 20:58:51.192762 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:58:51.192762 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-38c50b9a-521d-45c5-af02-a4be251136ad tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Returning 404 to user: Instance 668f04f9-8661-40d4-848f-daebc639efc1 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:58:51.192762 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-38c50b9a-521d-45c5-af02-a4be251136ad tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "POST /compute/v2.1/servers/668f04f9-8661-40d4-848f-daebc639efc1/action" status: 404 len: 111 microversion: 2.1 time: 0.034831 Oct 04 20:58:51.192762 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2376/4792] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 20:58:51 2022] POST /compute/v2.1/servers/668f04f9-8661-40d4-848f-daebc639efc1/action => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:58:51.197533 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-00d2f78b-374c-40ed-beed-d3d695fc1a03 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:58:51.198585 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-00d2f78b-374c-40ed-beed-d3d695fc1a03 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] [instance: 320f9a98-969f-473e-bc56-842bbd28dedc] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:58:51.220099 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-00d2f78b-374c-40ed-beed-d3d695fc1a03 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:51.223445 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-00d2f78b-374c-40ed-beed-d3d695fc1a03 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:51.224166 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-00d2f78b-374c-40ed-beed-d3d695fc1a03 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:51.225078 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-00d2f78b-374c-40ed-beed-d3d695fc1a03 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:51.226965 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-00d2f78b-374c-40ed-beed-d3d695fc1a03 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:51.228968 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-00d2f78b-374c-40ed-beed-d3d695fc1a03 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:51.820999 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6f709109-773f-4130-940b-1b1bafaa8341 tempest-ServerPasswordTestJSON-1023625137 tempest-ServerPasswordTestJSON-1023625137-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:58:51.822014 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-6f709109-773f-4130-940b-1b1bafaa8341 tempest-ServerPasswordTestJSON-1023625137 tempest-ServerPasswordTestJSON-1023625137-project] [instance: 2f6b6d05-2fff-4d82-ac0f-02c84f49ebe3] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:58:51.851970 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6f709109-773f-4130-940b-1b1bafaa8341 tempest-ServerPasswordTestJSON-1023625137 tempest-ServerPasswordTestJSON-1023625137-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:51.852453 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6f709109-773f-4130-940b-1b1bafaa8341 tempest-ServerPasswordTestJSON-1023625137 tempest-ServerPasswordTestJSON-1023625137-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:51.852896 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6f709109-773f-4130-940b-1b1bafaa8341 tempest-ServerPasswordTestJSON-1023625137 tempest-ServerPasswordTestJSON-1023625137-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:51.853630 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6f709109-773f-4130-940b-1b1bafaa8341 tempest-ServerPasswordTestJSON-1023625137 tempest-ServerPasswordTestJSON-1023625137-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:51.854115 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6f709109-773f-4130-940b-1b1bafaa8341 tempest-ServerPasswordTestJSON-1023625137 tempest-ServerPasswordTestJSON-1023625137-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:51.854606 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6f709109-773f-4130-940b-1b1bafaa8341 tempest-ServerPasswordTestJSON-1023625137 tempest-ServerPasswordTestJSON-1023625137-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:52.009706 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-00d2f78b-374c-40ed-beed-d3d695fc1a03 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6513f5e908ac4d028cad6eeeebeab285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65946afc398d4a9fb1c9095a4f946e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:58:52.044684 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-00d2f78b-374c-40ed-beed-d3d695fc1a03 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc" status: 200 len: 1505 microversion: 2.1 time: 0.848145 Oct 04 20:58:52.046037 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2417/4793] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:58:51 2022] GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc => generated 1505 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:58:52.072755 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-ce6f0fe7-6124-4c4c-a2e5-a40b4ae0fb4d tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:58:52.073758 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-ce6f0fe7-6124-4c4c-a2e5-a40b4ae0fb4d tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] [instance: 320f9a98-969f-473e-bc56-842bbd28dedc] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:58:52.081818 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ce6f0fe7-6124-4c4c-a2e5-a40b4ae0fb4d tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:52.082731 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ce6f0fe7-6124-4c4c-a2e5-a40b4ae0fb4d tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:52.083405 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ce6f0fe7-6124-4c4c-a2e5-a40b4ae0fb4d tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:52.084842 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ce6f0fe7-6124-4c4c-a2e5-a40b4ae0fb4d tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:52.085757 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ce6f0fe7-6124-4c4c-a2e5-a40b4ae0fb4d tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:52.086451 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ce6f0fe7-6124-4c4c-a2e5-a40b4ae0fb4d tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:53.298210 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-6f709109-773f-4130-940b-1b1bafaa8341 tempest-ServerPasswordTestJSON-1023625137 tempest-ServerPasswordTestJSON-1023625137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94afe152da6f45a181ed6fd7dd77c033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7007db5728544fc480825a10fac1e81d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:58:53.316360 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-ce6f0fe7-6124-4c4c-a2e5-a40b4ae0fb4d tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6513f5e908ac4d028cad6eeeebeab285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65946afc398d4a9fb1c9095a4f946e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:58:53.325637 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-ce6f0fe7-6124-4c4c-a2e5-a40b4ae0fb4d tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc" status: 200 len: 1505 microversion: 2.1 time: 1.257224 Oct 04 20:58:53.326671 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2418/4794] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:58:52 2022] GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc => generated 1505 bytes in 1259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:58:53.331930 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-02173777-c7cf-41f5-89a0-d2fc93995c1e req-9877955e-b8f5-43ee-ab6f-e3fe03e33908 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f6b6d05-2fff-4d82-ac0f-02c84f49ebe3", "name": "network-vif-plugged", "status": "completed", "tag": "c8b9f449-1dbd-4568-ab4c-f71d869a3c1e"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:58:53.341532 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-6f709109-773f-4130-940b-1b1bafaa8341 tempest-ServerPasswordTestJSON-1023625137 tempest-ServerPasswordTestJSON-1023625137-project] 10.222.0.33 "GET /compute/v2.1/servers/2f6b6d05-2fff-4d82-ac0f-02c84f49ebe3" status: 200 len: 1316 microversion: 2.1 time: 1.524469 Oct 04 20:58:53.373903 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2377/4795] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:58:51 2022] GET /compute/v2.1/servers/2f6b6d05-2fff-4d82-ac0f-02c84f49ebe3 => generated 1316 bytes in 1553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:58:53.374221 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-02173777-c7cf-41f5-89a0-d2fc93995c1e req-9877955e-b8f5-43ee-ab6f-e3fe03e33908 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:53.375326 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-02173777-c7cf-41f5-89a0-d2fc93995c1e req-9877955e-b8f5-43ee-ab6f-e3fe03e33908 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:53.375853 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-02173777-c7cf-41f5-89a0-d2fc93995c1e req-9877955e-b8f5-43ee-ab6f-e3fe03e33908 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:53.381229 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ca30b2e4-9d1f-4096-9c7b-7aa527baa3a9 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 10}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:58:53.391208 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ca30b2e4-9d1f-4096-9c7b-7aa527baa3a9 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] [instance: e2f4295a-8203-4fa5-84a7-26d47ed54a66] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:58:53.403432 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-02173777-c7cf-41f5-89a0-d2fc93995c1e req-9877955e-b8f5-43ee-ab6f-e3fe03e33908 service nova] Creating event network-vif-plugged:c8b9f449-1dbd-4568-ab4c-f71d869a3c1e for instance 2f6b6d05-2fff-4d82-ac0f-02c84f49ebe3 on n-h1-854823-8 Oct 04 20:58:53.404586 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-ca30b2e4-9d1f-4096-9c7b-7aa527baa3a9 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] HTTP exception thrown: Instance e2f4295a-8203-4fa5-84a7-26d47ed54a66 could not be found. Oct 04 20:58:53.414007 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ca30b2e4-9d1f-4096-9c7b-7aa527baa3a9 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Request method failure captured: Oct 04 20:58:53.414007 n-d-854823-8 devstack@n-api.service[128801]: request: POST /compute/v2.1/servers/e2f4295a-8203-4fa5-84a7-26d47ed54a66/action HTTP/1.1 Oct 04 20:58:53.414007 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:58:53.414007 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:58:53.414007 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:58:53.414007 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 39 Oct 04 20:58:53.414007 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:58:53.414007 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:58:53.414007 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:58:53.414007 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:58:53.414007 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJ4eaBM_FLl2jaN3nQraRbM94DgE-qlLjkCPNJ1Ol7VvkbIGIp-m_lAuwAay2VJ7lXD5niLtaDpJGDoHOJTljuI2aLuReHvX6jQr-uTgC01ZM2s7p6j6gq6a-1PaGQN0mcmcJntCqSnEEt5MEM6DdrOOdi5eEtsfyNU4EpDYmca-Ylo Oct 04 20:58:53.414007 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:58:53.414007 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:58:53.414007 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:58:53.414007 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:58:53.414007 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:58:53.414007 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:58:53.414007 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: 65946afc398d4a9fb1c9095a4f946e07 Oct 04 20:58:53.414007 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-ServersNegativeTestJSON-1097186397 Oct 04 20:58:53.414007 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 20:58:53.414007 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 20:58:53.414007 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_65946afc398d4a9fb1c9095a4f946e07", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/65946afc398d4a9fb1c9095a4f946e07"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/65946afc398d4a9fb1c9095a4f946e07"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/65946afc398d4a9fb1c9095a4f946e07"}]}] Oct 04 20:58:53.414007 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-ServersNegativeTestJSON-1097186397 Oct 04 20:58:53.414007 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: 65946afc398d4a9fb1c9095a4f946e07 Oct 04 20:58:53.414007 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1097186397 Oct 04 20:58:53.414007 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-ServersNegativeTestJSON-1097186397-project Oct 04 20:58:53.414007 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:58:53.414007 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:58:53.414007 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: 6513f5e908ac4d028cad6eeeebeab285 Oct 04 20:58:53.414007 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-ServersNegativeTestJSON-1097186397-project Oct 04 20:58:53.414007 n-d-854823-8 devstack@n-api.service[128801]: Oct 04 20:58:53.414007 n-d-854823-8 devstack@n-api.service[128801]: {"os-getConsoleOutput": {"length": 10}} Oct 04 20:58:53.414007 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 20:58:53.414007 n-d-854823-8 devstack@n-api.service[128801]: exception: Instance e2f4295a-8203-4fa5-84a7-26d47ed54a66 could not be found. Oct 04 20:58:53.414007 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': 'e2f4295a-8203-4fa5-84a7-26d47ed54a66', 'body': {'os-getConsoleOutput': {'length': 10}}} Oct 04 20:58:53.414007 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:58:53.414007 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:58:53.414007 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:58:53.414007 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:58:53.414007 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:58:53.414007 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:58:53.414007 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 20:58:53.414007 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 20:58:53.414007 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e2f4295a-8203-4fa5-84a7-26d47ed54a66 could not be found. Oct 04 20:58:53.414007 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:58:53.414007 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:58:53.414007 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:58:53.414007 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:58:53.414007 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:58:53.414007 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:58:53.414007 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:58:53.414007 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:58:53.414007 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:58:53.414007 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:58:53.414007 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:58:53.414007 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:58:53.414007 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/console_output.py", line 41, in get_console_output Oct 04 20:58:53.414007 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 04 20:58:53.414007 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:58:53.414007 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:58:53.414007 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e2f4295a-8203-4fa5-84a7-26d47ed54a66 could not be found. Oct 04 20:58:53.414007 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:58:53.414007 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:58:53.414007 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:58:53.414007 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:58:53.420144 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:58:53.420144 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:58:53.420144 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:58:53.420144 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:58:53.420144 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e2f4295a-8203-4fa5-84a7-26d47ed54a66 could not be found. Oct 04 20:58:53.420144 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:58:53.420678 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-02173777-c7cf-41f5-89a0-d2fc93995c1e req-9877955e-b8f5-43ee-ab6f-e3fe03e33908 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086403 Oct 04 20:58:53.420678 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2419/4796] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:58:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:58:53.426961 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ca30b2e4-9d1f-4096-9c7b-7aa527baa3a9 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Returning 404 to user: Instance e2f4295a-8203-4fa5-84a7-26d47ed54a66 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:58:53.428106 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ca30b2e4-9d1f-4096-9c7b-7aa527baa3a9 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "POST /compute/v2.1/servers/e2f4295a-8203-4fa5-84a7-26d47ed54a66/action" status: 404 len: 111 microversion: 2.1 time: 0.052798 Oct 04 20:58:53.428922 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2378/4797] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 20:58:53 2022] POST /compute/v2.1/servers/e2f4295a-8203-4fa5-84a7-26d47ed54a66/action => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:58:53.439679 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-10fb1cd3-5573-4ee2-a5d1-f6976db5917d tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:58:53.440657 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-10fb1cd3-5573-4ee2-a5d1-f6976db5917d tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] [instance: 320f9a98-969f-473e-bc56-842bbd28dedc] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:58:53.447733 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-10fb1cd3-5573-4ee2-a5d1-f6976db5917d tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:53.448319 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-10fb1cd3-5573-4ee2-a5d1-f6976db5917d tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:53.448765 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-10fb1cd3-5573-4ee2-a5d1-f6976db5917d tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:53.449506 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-10fb1cd3-5573-4ee2-a5d1-f6976db5917d tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:53.449967 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-10fb1cd3-5573-4ee2-a5d1-f6976db5917d tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:53.450803 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-10fb1cd3-5573-4ee2-a5d1-f6976db5917d tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:54.067891 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-10fb1cd3-5573-4ee2-a5d1-f6976db5917d tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6513f5e908ac4d028cad6eeeebeab285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65946afc398d4a9fb1c9095a4f946e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:58:54.079734 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-10fb1cd3-5573-4ee2-a5d1-f6976db5917d tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc" status: 200 len: 1505 microversion: 2.1 time: 0.645414 Oct 04 20:58:54.090512 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2420/4798] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:58:53 2022] GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc => generated 1505 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:58:54.127073 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8377f4d4-dfe4-48dc-ade4-627d00f39f8d tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:58:54.127702 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-8377f4d4-dfe4-48dc-ade4-627d00f39f8d tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] [instance: 320f9a98-969f-473e-bc56-842bbd28dedc] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:58:54.165963 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8377f4d4-dfe4-48dc-ade4-627d00f39f8d tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:54.168258 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8377f4d4-dfe4-48dc-ade4-627d00f39f8d tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:54.171551 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8377f4d4-dfe4-48dc-ade4-627d00f39f8d tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:54.172352 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8377f4d4-dfe4-48dc-ade4-627d00f39f8d tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:54.175361 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8377f4d4-dfe4-48dc-ade4-627d00f39f8d tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:54.175703 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8377f4d4-dfe4-48dc-ade4-627d00f39f8d tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:54.381287 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-b20a16ec-1dc2-4c42-ad8e-49902c4e120d tempest-ServerPasswordTestJSON-1023625137 tempest-ServerPasswordTestJSON-1023625137-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:58:54.383511 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-b20a16ec-1dc2-4c42-ad8e-49902c4e120d tempest-ServerPasswordTestJSON-1023625137 tempest-ServerPasswordTestJSON-1023625137-project] [instance: 2f6b6d05-2fff-4d82-ac0f-02c84f49ebe3] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:58:54.404592 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b20a16ec-1dc2-4c42-ad8e-49902c4e120d tempest-ServerPasswordTestJSON-1023625137 tempest-ServerPasswordTestJSON-1023625137-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:54.407136 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b20a16ec-1dc2-4c42-ad8e-49902c4e120d tempest-ServerPasswordTestJSON-1023625137 tempest-ServerPasswordTestJSON-1023625137-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:54.411328 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b20a16ec-1dc2-4c42-ad8e-49902c4e120d tempest-ServerPasswordTestJSON-1023625137 tempest-ServerPasswordTestJSON-1023625137-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:54.414468 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b20a16ec-1dc2-4c42-ad8e-49902c4e120d tempest-ServerPasswordTestJSON-1023625137 tempest-ServerPasswordTestJSON-1023625137-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:54.416322 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b20a16ec-1dc2-4c42-ad8e-49902c4e120d tempest-ServerPasswordTestJSON-1023625137 tempest-ServerPasswordTestJSON-1023625137-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:54.419042 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b20a16ec-1dc2-4c42-ad8e-49902c4e120d tempest-ServerPasswordTestJSON-1023625137 tempest-ServerPasswordTestJSON-1023625137-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:54.467084 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=100 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:58:55.809522 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-8377f4d4-dfe4-48dc-ade4-627d00f39f8d tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6513f5e908ac4d028cad6eeeebeab285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65946afc398d4a9fb1c9095a4f946e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:58:55.826157 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-8377f4d4-dfe4-48dc-ade4-627d00f39f8d tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc" status: 200 len: 1505 microversion: 2.1 time: 1.712705 Oct 04 20:58:55.848409 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2379/4799] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:58:54 2022] GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc => generated 1505 bytes in 1728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:58:55.867736 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5ee7e9e6-60bd-4ff2-ae4b-7c737c8a0fda tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:58:55.868597 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-5ee7e9e6-60bd-4ff2-ae4b-7c737c8a0fda tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] [instance: 6d73007c-32bb-4470-bf30-5fee122eeca8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:58:55.874903 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-5ee7e9e6-60bd-4ff2-ae4b-7c737c8a0fda tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] HTTP exception thrown: Instance 6d73007c-32bb-4470-bf30-5fee122eeca8 could not be found. Oct 04 20:58:55.876674 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5ee7e9e6-60bd-4ff2-ae4b-7c737c8a0fda tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Request method failure captured: Oct 04 20:58:55.876674 n-d-854823-8 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/6d73007c-32bb-4470-bf30-5fee122eeca8 HTTP/1.1 Oct 04 20:58:55.876674 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:58:55.876674 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:58:55.876674 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:58:55.876674 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 0 Oct 04 20:58:55.876674 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:58:55.876674 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:58:55.876674 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:58:55.876674 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:58:55.876674 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJ4eaBM_FLl2jaN3nQraRbM94DgE-qlLjkCPNJ1Ol7VvkbIGIp-m_lAuwAay2VJ7lXD5niLtaDpJGDoHOJTljuI2aLuReHvX6jQr-uTgC01ZM2s7p6j6gq6a-1PaGQN0mcmcJntCqSnEEt5MEM6DdrOOdi5eEtsfyNU4EpDYmca-Ylo Oct 04 20:58:55.876674 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:58:55.876674 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:58:55.876674 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:58:55.876674 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:58:55.876674 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:58:55.876674 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:58:55.876674 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: 65946afc398d4a9fb1c9095a4f946e07 Oct 04 20:58:55.876674 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-ServersNegativeTestJSON-1097186397 Oct 04 20:58:55.876674 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 20:58:55.876674 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 20:58:55.876674 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_65946afc398d4a9fb1c9095a4f946e07", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/65946afc398d4a9fb1c9095a4f946e07"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/65946afc398d4a9fb1c9095a4f946e07"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/65946afc398d4a9fb1c9095a4f946e07"}]}] Oct 04 20:58:55.876674 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-ServersNegativeTestJSON-1097186397 Oct 04 20:58:55.876674 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: 65946afc398d4a9fb1c9095a4f946e07 Oct 04 20:58:55.876674 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1097186397 Oct 04 20:58:55.876674 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-ServersNegativeTestJSON-1097186397-project Oct 04 20:58:55.876674 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:58:55.876674 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:58:55.876674 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: 6513f5e908ac4d028cad6eeeebeab285 Oct 04 20:58:55.876674 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-ServersNegativeTestJSON-1097186397-project Oct 04 20:58:55.876674 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 20:58:55.876674 n-d-854823-8 devstack@n-api.service[128801]: exception: Instance 6d73007c-32bb-4470-bf30-5fee122eeca8 could not be found. Oct 04 20:58:55.876674 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': '6d73007c-32bb-4470-bf30-5fee122eeca8'} Oct 04 20:58:55.876674 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:58:55.876674 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:58:55.876674 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:58:55.876674 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:58:55.876674 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:58:55.876674 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:58:55.876674 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 20:58:55.876674 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 20:58:55.876674 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d73007c-32bb-4470-bf30-5fee122eeca8 could not be found. Oct 04 20:58:55.876674 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:58:55.876674 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:58:55.876674 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:58:55.876674 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:58:55.876674 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:58:55.876674 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:58:55.876674 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:58:55.876674 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:58:55.876674 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:58:55.876674 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:58:55.876674 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:58:55.876674 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:58:55.876674 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:58:55.876674 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:58:55.876674 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:58:55.876674 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:58:55.876674 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d73007c-32bb-4470-bf30-5fee122eeca8 could not be found. Oct 04 20:58:55.876674 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:58:55.876674 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:58:55.876674 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:58:55.876674 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:58:55.876674 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:58:55.882729 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:58:55.882729 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:58:55.882729 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:58:55.882729 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d73007c-32bb-4470-bf30-5fee122eeca8 could not be found. Oct 04 20:58:55.882729 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:58:55.883563 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5ee7e9e6-60bd-4ff2-ae4b-7c737c8a0fda tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Returning 404 to user: Instance 6d73007c-32bb-4470-bf30-5fee122eeca8 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:58:55.887176 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5ee7e9e6-60bd-4ff2-ae4b-7c737c8a0fda tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "GET /compute/v2.1/servers/6d73007c-32bb-4470-bf30-5fee122eeca8" status: 404 len: 111 microversion: 2.1 time: 0.033508 Oct 04 20:58:55.892254 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2380/4800] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:58:55 2022] GET /compute/v2.1/servers/6d73007c-32bb-4470-bf30-5fee122eeca8 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:58:55.902452 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b72fcbff-524f-46b8-b35a-d6e8caa7e785 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:58:55.905437 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b72fcbff-524f-46b8-b35a-d6e8caa7e785 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] [instance: 320f9a98-969f-473e-bc56-842bbd28dedc] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:58:55.926087 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b72fcbff-524f-46b8-b35a-d6e8caa7e785 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:55.932385 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b72fcbff-524f-46b8-b35a-d6e8caa7e785 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:55.933138 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b72fcbff-524f-46b8-b35a-d6e8caa7e785 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:55.933999 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b72fcbff-524f-46b8-b35a-d6e8caa7e785 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:55.936481 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b72fcbff-524f-46b8-b35a-d6e8caa7e785 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:55.937037 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b72fcbff-524f-46b8-b35a-d6e8caa7e785 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:56.133529 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-b20a16ec-1dc2-4c42-ad8e-49902c4e120d tempest-ServerPasswordTestJSON-1023625137 tempest-ServerPasswordTestJSON-1023625137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94afe152da6f45a181ed6fd7dd77c033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7007db5728544fc480825a10fac1e81d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:58:56.154031 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-b20a16ec-1dc2-4c42-ad8e-49902c4e120d tempest-ServerPasswordTestJSON-1023625137 tempest-ServerPasswordTestJSON-1023625137-project] 10.222.0.33 "GET /compute/v2.1/servers/2f6b6d05-2fff-4d82-ac0f-02c84f49ebe3" status: 200 len: 1316 microversion: 2.1 time: 1.770326 Oct 04 20:58:56.154031 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2421/4801] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:58:54 2022] GET /compute/v2.1/servers/2f6b6d05-2fff-4d82-ac0f-02c84f49ebe3 => generated 1316 bytes in 1772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:58:56.797446 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-b72fcbff-524f-46b8-b35a-d6e8caa7e785 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6513f5e908ac4d028cad6eeeebeab285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65946afc398d4a9fb1c9095a4f946e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:58:56.820144 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b72fcbff-524f-46b8-b35a-d6e8caa7e785 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc" status: 200 len: 1505 microversion: 2.1 time: 0.920866 Oct 04 20:58:56.835647 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2381/4802] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:58:55 2022] GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc => generated 1505 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:58:56.852014 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-06e56448-887d-4bbd-a9e2-f2db4013ed33 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:58:56.852644 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-06e56448-887d-4bbd-a9e2-f2db4013ed33 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] [instance: 320f9a98-969f-473e-bc56-842bbd28dedc] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:58:56.876555 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-06e56448-887d-4bbd-a9e2-f2db4013ed33 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:56.877002 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-06e56448-887d-4bbd-a9e2-f2db4013ed33 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:56.877522 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-06e56448-887d-4bbd-a9e2-f2db4013ed33 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:56.881066 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-06e56448-887d-4bbd-a9e2-f2db4013ed33 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:56.883095 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-06e56448-887d-4bbd-a9e2-f2db4013ed33 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:56.884774 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-06e56448-887d-4bbd-a9e2-f2db4013ed33 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:57.094560 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-8900a64f-ea63-4474-b80d-da4e757cc8fe tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Action: 'create', calling method: .version_select at 0x7f3c6f5994c0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1637210633", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP69HAYFW90zndFU3MatbSez+1nAwU8VVZ/xExoTROY11dGvsBPGVpA4Wvi3DPqvsTlrxqFMelEaSeMXe1hziS1EFYZzULMewWDGlMMre5LTkY4n2kpSkSSbKxp/NRGr4A=="}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:58:57.127887 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-8900a64f-ea63-4474-b80d-da4e757cc8fe tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Getting quotas for project b3aa23aee3c8435c8f1f409019c5fed2. Resources: {'key_pairs'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:58:57.162265 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-8900a64f-ea63-4474-b80d-da4e757cc8fe tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Getting quotas for user 0be5dbe3da6a4af181ef7302fe605fb4 and project b3aa23aee3c8435c8f1f409019c5fed2. Resources: {'key_pairs'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:58:57.223655 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-8900a64f-ea63-4474-b80d-da4e757cc8fe tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.743119 Oct 04 20:58:57.224438 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2422/4803] 10.222.0.33 () {60 vars in 1159 bytes} [Tue Oct 4 20:58:56 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 20:58:57.232900 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-3d9b996a-3343-41c8-ac0f-2b389deeae03 tempest-ServerPasswordTestJSON-1023625137 tempest-ServerPasswordTestJSON-1023625137-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:58:57.251786 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-3d9b996a-3343-41c8-ac0f-2b389deeae03 tempest-ServerPasswordTestJSON-1023625137 tempest-ServerPasswordTestJSON-1023625137-project] [instance: 2f6b6d05-2fff-4d82-ac0f-02c84f49ebe3] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:58:57.264264 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3d9b996a-3343-41c8-ac0f-2b389deeae03 tempest-ServerPasswordTestJSON-1023625137 tempest-ServerPasswordTestJSON-1023625137-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:57.265346 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3d9b996a-3343-41c8-ac0f-2b389deeae03 tempest-ServerPasswordTestJSON-1023625137 tempest-ServerPasswordTestJSON-1023625137-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:57.265898 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3d9b996a-3343-41c8-ac0f-2b389deeae03 tempest-ServerPasswordTestJSON-1023625137 tempest-ServerPasswordTestJSON-1023625137-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:57.266796 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3d9b996a-3343-41c8-ac0f-2b389deeae03 tempest-ServerPasswordTestJSON-1023625137 tempest-ServerPasswordTestJSON-1023625137-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:57.267385 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3d9b996a-3343-41c8-ac0f-2b389deeae03 tempest-ServerPasswordTestJSON-1023625137 tempest-ServerPasswordTestJSON-1023625137-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:57.267945 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3d9b996a-3343-41c8-ac0f-2b389deeae03 tempest-ServerPasswordTestJSON-1023625137 tempest-ServerPasswordTestJSON-1023625137-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:57.432710 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-06e56448-887d-4bbd-a9e2-f2db4013ed33 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6513f5e908ac4d028cad6eeeebeab285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65946afc398d4a9fb1c9095a4f946e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:58:57.447287 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-06e56448-887d-4bbd-a9e2-f2db4013ed33 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc" status: 200 len: 1505 microversion: 2.1 time: 0.596666 Oct 04 20:58:57.449607 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2382/4804] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:58:56 2022] GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc => generated 1505 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:58:57.695843 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-543abf5b-6e2b-440b-89b8-1bf0b734c40d tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-356557477", "imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "780a66b6-435f-46df-9c7b-6f763e190356"}]}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:58:57.732638 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-543abf5b-6e2b-440b-89b8-1bf0b734c40d tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Request method failure captured: Oct 04 20:58:57.732638 n-d-854823-8 devstack@n-api.service[128801]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 20:58:57.732638 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:58:57.732638 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:58:57.732638 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:58:57.732638 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 237 Oct 04 20:58:57.732638 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:58:57.732638 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:58:57.732638 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:58:57.732638 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:58:57.732638 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJ4eaBM_FLl2jaN3nQraRbM94DgE-qlLjkCPNJ1Ol7VvkbIGIp-m_lAuwAay2VJ7lXD5niLtaDpJGDoHOJTljuI2aLuReHvX6jQr-uTgC01ZM2s7p6j6gq6a-1PaGQN0mcmcJntCqSnEEt5MEM6DdrOOdi5eEtsfyNU4EpDYmca-Ylo Oct 04 20:58:57.732638 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:58:57.732638 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:58:57.732638 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:58:57.732638 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:58:57.732638 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:58:57.732638 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:58:57.732638 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: 65946afc398d4a9fb1c9095a4f946e07 Oct 04 20:58:57.732638 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-ServersNegativeTestJSON-1097186397 Oct 04 20:58:57.732638 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 20:58:57.732638 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 20:58:57.732638 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_65946afc398d4a9fb1c9095a4f946e07", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/65946afc398d4a9fb1c9095a4f946e07"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/65946afc398d4a9fb1c9095a4f946e07"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/65946afc398d4a9fb1c9095a4f946e07"}]}] Oct 04 20:58:57.732638 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-ServersNegativeTestJSON-1097186397 Oct 04 20:58:57.732638 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: 65946afc398d4a9fb1c9095a4f946e07 Oct 04 20:58:57.732638 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1097186397 Oct 04 20:58:57.732638 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-ServersNegativeTestJSON-1097186397-project Oct 04 20:58:57.732638 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:58:57.732638 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:58:57.732638 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: 6513f5e908ac4d028cad6eeeebeab285 Oct 04 20:58:57.732638 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-ServersNegativeTestJSON-1097186397-project Oct 04 20:58:57.732638 n-d-854823-8 devstack@n-api.service[128801]: Oct 04 20:58:57.732638 n-d-854823-8 devstack@n-api.service[128801]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-356557477", "imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "780a66b6-435f-46df-9c7b-6f763e190356"}]}} Oct 04 20:58:57.732638 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 20:58:57.732638 n-d-854823-8 devstack@n-api.service[128801]: exception: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Oct 04 20:58:57.732638 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-356557477', 'imageRef': '15b24725-0c99-4bcf-b1fb-907cdf8e2d63', 'flavorRef': '452', 'accessIPv4': '1.1.1.1.1.1', 'networks': [{'uuid': '780a66b6-435f-46df-9c7b-6f763e190356'}]}}} Oct 04 20:58:57.732638 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:58:57.732638 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:58:57.732638 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Oct 04 20:58:57.732638 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi result = func(instance) Oct 04 20:58:57.732638 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 253, in is_ipv4 Oct 04 20:58:57.732638 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return bool(ipaddress.IPv4Address(instance)) Oct 04 20:58:57.732638 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1257, in __init__ Oct 04 20:58:57.732638 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Oct 04 20:58:57.732638 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1144, in _ip_int_from_string Oct 04 20:58:57.732638 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise AddressValueError("Expected 4 octets in %r" % ip_str) Oct 04 20:58:57.732638 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: Expected 4 octets in '1.1.1.1.1.1' Oct 04 20:58:57.732638 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:58:57.732638 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 04 20:58:57.732638 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:58:57.732638 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:58:57.732638 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 20:58:57.732638 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 20:58:57.732638 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 20:58:57.732638 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise error Oct 04 20:58:57.732638 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '1.1.1.1.1.1' is not a 'ipv4' Oct 04 20:58:57.732638 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:58:57.732638 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv4']: Oct 04 20:58:57.732638 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi {'format': 'ipv4', 'type': 'string'} Oct 04 20:58:57.732638 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:58:57.732638 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 04 20:58:57.732638 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi '1.1.1.1.1.1' Oct 04 20:58:57.732638 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:58:57.732638 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:58:57.732638 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:58:57.732638 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:58:57.737928 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:58:57.737928 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:58:57.737928 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:58:57.737928 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:58:57.737928 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:58:57.737928 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:58:57.737928 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:58:57.737928 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:58:57.737928 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 20:58:57.737928 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 20:58:57.737928 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 20:58:57.737928 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 20:58:57.737928 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 20:58:57.737928 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 20:58:57.737928 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Oct 04 20:58:57.737928 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:58:57.737928 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:58:57.737928 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:58:57.737928 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:58:57.737928 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:58:57.737928 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:58:57.737928 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 20:58:57.737928 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 20:58:57.737928 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Oct 04 20:58:57.737928 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:58:57.743411 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-543abf5b-6e2b-440b-89b8-1bf0b734c40d tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Returning 400 to user: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:58:57.744739 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-543abf5b-6e2b-440b-89b8-1bf0b734c40d tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.053060 Oct 04 20:58:57.745968 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2383/4805] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 20:58:57 2022] POST /compute/v2.1/servers => generated 139 bytes in 55 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 04 20:58:57.757020 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-3884edef-c850-4428-b599-46eacc495fb8 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:58:57.758019 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-3884edef-c850-4428-b599-46eacc495fb8 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] [instance: 320f9a98-969f-473e-bc56-842bbd28dedc] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:58:57.775111 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3884edef-c850-4428-b599-46eacc495fb8 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:57.780207 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3884edef-c850-4428-b599-46eacc495fb8 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:57.781042 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3884edef-c850-4428-b599-46eacc495fb8 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:57.782092 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3884edef-c850-4428-b599-46eacc495fb8 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:57.782847 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3884edef-c850-4428-b599-46eacc495fb8 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:57.783548 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3884edef-c850-4428-b599-46eacc495fb8 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:58.276653 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-3d9b996a-3343-41c8-ac0f-2b389deeae03 tempest-ServerPasswordTestJSON-1023625137 tempest-ServerPasswordTestJSON-1023625137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94afe152da6f45a181ed6fd7dd77c033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7007db5728544fc480825a10fac1e81d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:58:58.294824 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-3d9b996a-3343-41c8-ac0f-2b389deeae03 tempest-ServerPasswordTestJSON-1023625137 tempest-ServerPasswordTestJSON-1023625137-project] 10.222.0.33 "GET /compute/v2.1/servers/2f6b6d05-2fff-4d82-ac0f-02c84f49ebe3" status: 200 len: 1505 microversion: 2.1 time: 1.065300 Oct 04 20:58:58.295801 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2423/4806] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:58:57 2022] GET /compute/v2.1/servers/2f6b6d05-2fff-4d82-ac0f-02c84f49ebe3 => generated 1505 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:58:58.323935 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-11c8eaa6-86f3-4f30-9b00-069f76d45153 tempest-ServerPasswordTestJSON-1023625137 tempest-ServerPasswordTestJSON-1023625137-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:58:58.324712 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-11c8eaa6-86f3-4f30-9b00-069f76d45153 tempest-ServerPasswordTestJSON-1023625137 tempest-ServerPasswordTestJSON-1023625137-project] [instance: 2f6b6d05-2fff-4d82-ac0f-02c84f49ebe3] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:58:58.340246 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-11c8eaa6-86f3-4f30-9b00-069f76d45153 tempest-ServerPasswordTestJSON-1023625137 tempest-ServerPasswordTestJSON-1023625137-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:58.349570 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-11c8eaa6-86f3-4f30-9b00-069f76d45153 tempest-ServerPasswordTestJSON-1023625137 tempest-ServerPasswordTestJSON-1023625137-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:58.350574 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-11c8eaa6-86f3-4f30-9b00-069f76d45153 tempest-ServerPasswordTestJSON-1023625137 tempest-ServerPasswordTestJSON-1023625137-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:58.352758 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-11c8eaa6-86f3-4f30-9b00-069f76d45153 tempest-ServerPasswordTestJSON-1023625137 tempest-ServerPasswordTestJSON-1023625137-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:58.354703 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-11c8eaa6-86f3-4f30-9b00-069f76d45153 tempest-ServerPasswordTestJSON-1023625137 tempest-ServerPasswordTestJSON-1023625137-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:58.355783 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-11c8eaa6-86f3-4f30-9b00-069f76d45153 tempest-ServerPasswordTestJSON-1023625137 tempest-ServerPasswordTestJSON-1023625137-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:58.512109 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-11c8eaa6-86f3-4f30-9b00-069f76d45153 tempest-ServerPasswordTestJSON-1023625137 tempest-ServerPasswordTestJSON-1023625137-project] 10.222.0.33 "DELETE /compute/v2.1/servers/2f6b6d05-2fff-4d82-ac0f-02c84f49ebe3/os-server-password" status: 204 len: 0 microversion: 2.1 time: 0.193106 Oct 04 20:58:58.513344 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2424/4807] 10.222.0.33 () {58 vars in 1296 bytes} [Tue Oct 4 20:58:58 2022] DELETE /compute/v2.1/servers/2f6b6d05-2fff-4d82-ac0f-02c84f49ebe3/os-server-password => generated 0 bytes in 195 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:58:58.551813 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-2e7a919b-c183-494e-b232-a427df8d6547 tempest-ServerPasswordTestJSON-1023625137 tempest-ServerPasswordTestJSON-1023625137-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:58:58.553516 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-2e7a919b-c183-494e-b232-a427df8d6547 tempest-ServerPasswordTestJSON-1023625137 tempest-ServerPasswordTestJSON-1023625137-project] [instance: 2f6b6d05-2fff-4d82-ac0f-02c84f49ebe3] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:58:58.564019 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2e7a919b-c183-494e-b232-a427df8d6547 tempest-ServerPasswordTestJSON-1023625137 tempest-ServerPasswordTestJSON-1023625137-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:58.572845 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2e7a919b-c183-494e-b232-a427df8d6547 tempest-ServerPasswordTestJSON-1023625137 tempest-ServerPasswordTestJSON-1023625137-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:58.574875 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2e7a919b-c183-494e-b232-a427df8d6547 tempest-ServerPasswordTestJSON-1023625137 tempest-ServerPasswordTestJSON-1023625137-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:58.579498 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2e7a919b-c183-494e-b232-a427df8d6547 tempest-ServerPasswordTestJSON-1023625137 tempest-ServerPasswordTestJSON-1023625137-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:58.580300 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2e7a919b-c183-494e-b232-a427df8d6547 tempest-ServerPasswordTestJSON-1023625137 tempest-ServerPasswordTestJSON-1023625137-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:58.580972 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2e7a919b-c183-494e-b232-a427df8d6547 tempest-ServerPasswordTestJSON-1023625137 tempest-ServerPasswordTestJSON-1023625137-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:58.632838 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-2e7a919b-c183-494e-b232-a427df8d6547 tempest-ServerPasswordTestJSON-1023625137 tempest-ServerPasswordTestJSON-1023625137-project] 10.222.0.33 "GET /compute/v2.1/servers/2f6b6d05-2fff-4d82-ac0f-02c84f49ebe3/os-server-password" status: 200 len: 16 microversion: 2.1 time: 0.094702 Oct 04 20:58:58.634975 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2425/4808] 10.222.0.33 () {58 vars in 1293 bytes} [Tue Oct 4 20:58:58 2022] GET /compute/v2.1/servers/2f6b6d05-2fff-4d82-ac0f-02c84f49ebe3/os-server-password => generated 16 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 20:58:58.649385 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-ed19c0cb-74b3-490b-bdd1-883b8cc3312d tempest-ServerPasswordTestJSON-1023625137 tempest-ServerPasswordTestJSON-1023625137-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:58:58.654772 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-ed19c0cb-74b3-490b-bdd1-883b8cc3312d tempest-ServerPasswordTestJSON-1023625137 tempest-ServerPasswordTestJSON-1023625137-project] [instance: 2f6b6d05-2fff-4d82-ac0f-02c84f49ebe3] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:58:58.674917 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ed19c0cb-74b3-490b-bdd1-883b8cc3312d tempest-ServerPasswordTestJSON-1023625137 tempest-ServerPasswordTestJSON-1023625137-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:58.675859 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ed19c0cb-74b3-490b-bdd1-883b8cc3312d tempest-ServerPasswordTestJSON-1023625137 tempest-ServerPasswordTestJSON-1023625137-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:58.676544 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ed19c0cb-74b3-490b-bdd1-883b8cc3312d tempest-ServerPasswordTestJSON-1023625137 tempest-ServerPasswordTestJSON-1023625137-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:58.677333 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ed19c0cb-74b3-490b-bdd1-883b8cc3312d tempest-ServerPasswordTestJSON-1023625137 tempest-ServerPasswordTestJSON-1023625137-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:58.677795 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ed19c0cb-74b3-490b-bdd1-883b8cc3312d tempest-ServerPasswordTestJSON-1023625137 tempest-ServerPasswordTestJSON-1023625137-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:58.678559 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ed19c0cb-74b3-490b-bdd1-883b8cc3312d tempest-ServerPasswordTestJSON-1023625137 tempest-ServerPasswordTestJSON-1023625137-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:58.768414 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-ed19c0cb-74b3-490b-bdd1-883b8cc3312d tempest-ServerPasswordTestJSON-1023625137 tempest-ServerPasswordTestJSON-1023625137-project] [instance: 2f6b6d05-2fff-4d82-ac0f-02c84f49ebe3] Going to try to terminate instance {{(pid=128802) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:58:58.913245 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-3884edef-c850-4428-b599-46eacc495fb8 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6513f5e908ac4d028cad6eeeebeab285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65946afc398d4a9fb1c9095a4f946e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:58:58.964011 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-3884edef-c850-4428-b599-46eacc495fb8 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc" status: 200 len: 1505 microversion: 2.1 time: 1.198708 Oct 04 20:58:58.965227 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2384/4809] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:58:57 2022] GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc => generated 1505 bytes in 1215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:58:58.994842 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-40370785-ae0d-4c8f-9b30-776766906618 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:58:58.995709 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-40370785-ae0d-4c8f-9b30-776766906618 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] [instance: 320f9a98-969f-473e-bc56-842bbd28dedc] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:58:59.007662 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-40370785-ae0d-4c8f-9b30-776766906618 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:59.008695 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-40370785-ae0d-4c8f-9b30-776766906618 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:59.009374 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-40370785-ae0d-4c8f-9b30-776766906618 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:59.010353 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-ed19c0cb-74b3-490b-bdd1-883b8cc3312d tempest-ServerPasswordTestJSON-1023625137 tempest-ServerPasswordTestJSON-1023625137-project] 10.222.0.33 "DELETE /compute/v2.1/servers/2f6b6d05-2fff-4d82-ac0f-02c84f49ebe3" status: 204 len: 0 microversion: 2.1 time: 0.366924 Oct 04 20:58:59.010493 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-40370785-ae0d-4c8f-9b30-776766906618 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:59.014978 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2426/4810] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 20:58:58 2022] DELETE /compute/v2.1/servers/2f6b6d05-2fff-4d82-ac0f-02c84f49ebe3 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:58:59.015910 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-40370785-ae0d-4c8f-9b30-776766906618 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:59.017578 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-40370785-ae0d-4c8f-9b30-776766906618 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:59.027445 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-e7b3ce7e-b2b5-4e1a-9d0a-ae5712f9d466 tempest-ServerPasswordTestJSON-1023625137 tempest-ServerPasswordTestJSON-1023625137-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:58:59.029066 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-e7b3ce7e-b2b5-4e1a-9d0a-ae5712f9d466 tempest-ServerPasswordTestJSON-1023625137 tempest-ServerPasswordTestJSON-1023625137-project] [instance: 2f6b6d05-2fff-4d82-ac0f-02c84f49ebe3] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:58:59.039292 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e7b3ce7e-b2b5-4e1a-9d0a-ae5712f9d466 tempest-ServerPasswordTestJSON-1023625137 tempest-ServerPasswordTestJSON-1023625137-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:59.040510 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e7b3ce7e-b2b5-4e1a-9d0a-ae5712f9d466 tempest-ServerPasswordTestJSON-1023625137 tempest-ServerPasswordTestJSON-1023625137-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:59.041229 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e7b3ce7e-b2b5-4e1a-9d0a-ae5712f9d466 tempest-ServerPasswordTestJSON-1023625137 tempest-ServerPasswordTestJSON-1023625137-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:59.042147 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e7b3ce7e-b2b5-4e1a-9d0a-ae5712f9d466 tempest-ServerPasswordTestJSON-1023625137 tempest-ServerPasswordTestJSON-1023625137-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:58:59.042868 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e7b3ce7e-b2b5-4e1a-9d0a-ae5712f9d466 tempest-ServerPasswordTestJSON-1023625137 tempest-ServerPasswordTestJSON-1023625137-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:58:59.043695 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e7b3ce7e-b2b5-4e1a-9d0a-ae5712f9d466 tempest-ServerPasswordTestJSON-1023625137 tempest-ServerPasswordTestJSON-1023625137-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:58:59.639223 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-40370785-ae0d-4c8f-9b30-776766906618 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6513f5e908ac4d028cad6eeeebeab285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65946afc398d4a9fb1c9095a4f946e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:58:59.658435 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-40370785-ae0d-4c8f-9b30-776766906618 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc" status: 200 len: 1505 microversion: 2.1 time: 0.659306 Oct 04 20:58:59.660023 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2385/4811] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:58:58 2022] GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc => generated 1505 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:58:59.930109 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ccfd69be-d912-4601-b0fd-600853cedaeb tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1826878951", "imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "780a66b6-435f-46df-9c7b-6f763e190356"}]}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:58:59.935791 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ccfd69be-d912-4601-b0fd-600853cedaeb tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Request method failure captured: Oct 04 20:58:59.935791 n-d-854823-8 devstack@n-api.service[128801]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 20:58:59.935791 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:58:59.935791 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:58:59.935791 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:58:59.935791 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 235 Oct 04 20:58:59.935791 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:58:59.935791 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:58:59.935791 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:58:59.935791 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:58:59.935791 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJ4eaBM_FLl2jaN3nQraRbM94DgE-qlLjkCPNJ1Ol7VvkbIGIp-m_lAuwAay2VJ7lXD5niLtaDpJGDoHOJTljuI2aLuReHvX6jQr-uTgC01ZM2s7p6j6gq6a-1PaGQN0mcmcJntCqSnEEt5MEM6DdrOOdi5eEtsfyNU4EpDYmca-Ylo Oct 04 20:58:59.935791 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:58:59.935791 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:58:59.935791 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:58:59.935791 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:58:59.935791 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:58:59.935791 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:58:59.935791 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: 65946afc398d4a9fb1c9095a4f946e07 Oct 04 20:58:59.935791 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-ServersNegativeTestJSON-1097186397 Oct 04 20:58:59.935791 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 20:58:59.935791 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 20:58:59.935791 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_65946afc398d4a9fb1c9095a4f946e07", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/65946afc398d4a9fb1c9095a4f946e07"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/65946afc398d4a9fb1c9095a4f946e07"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/65946afc398d4a9fb1c9095a4f946e07"}]}] Oct 04 20:58:59.935791 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-ServersNegativeTestJSON-1097186397 Oct 04 20:58:59.935791 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: 65946afc398d4a9fb1c9095a4f946e07 Oct 04 20:58:59.935791 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1097186397 Oct 04 20:58:59.935791 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-ServersNegativeTestJSON-1097186397-project Oct 04 20:58:59.935791 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:58:59.935791 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:58:59.935791 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: 6513f5e908ac4d028cad6eeeebeab285 Oct 04 20:58:59.935791 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-ServersNegativeTestJSON-1097186397-project Oct 04 20:58:59.935791 n-d-854823-8 devstack@n-api.service[128801]: Oct 04 20:58:59.935791 n-d-854823-8 devstack@n-api.service[128801]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1826878951", "imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "780a66b6-435f-46df-9c7b-6f763e190356"}]}} Oct 04 20:58:59.935791 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 20:58:59.935791 n-d-854823-8 devstack@n-api.service[128801]: exception: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Oct 04 20:58:59.935791 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1826878951', 'imageRef': '15b24725-0c99-4bcf-b1fb-907cdf8e2d63', 'flavorRef': '452', 'accessIPv6': 'notvalid', 'networks': [{'uuid': '780a66b6-435f-46df-9c7b-6f763e190356'}]}}} Oct 04 20:58:59.935791 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:58:59.935791 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:58:59.935791 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Oct 04 20:58:59.935791 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi result = func(instance) Oct 04 20:58:59.935791 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 260, in is_ipv6 Oct 04 20:58:59.935791 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi address = ipaddress.IPv6Address(instance) Oct 04 20:58:59.935791 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1844, in __init__ Oct 04 20:58:59.935791 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Oct 04 20:58:59.935791 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1581, in _ip_int_from_string Oct 04 20:58:59.935791 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise AddressValueError(msg) Oct 04 20:58:59.935791 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: At least 3 parts expected in 'notvalid' Oct 04 20:58:59.935791 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:58:59.935791 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 04 20:58:59.935791 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:58:59.935791 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:58:59.935791 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 20:58:59.935791 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 20:58:59.935791 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 20:58:59.935791 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise error Oct 04 20:58:59.935791 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'notvalid' is not a 'ipv6' Oct 04 20:58:59.935791 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:58:59.935791 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv6']: Oct 04 20:58:59.935791 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi {'format': 'ipv6', 'type': 'string'} Oct 04 20:58:59.935791 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:58:59.935791 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 04 20:58:59.935791 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi 'notvalid' Oct 04 20:58:59.935791 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:58:59.935791 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:58:59.935791 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:58:59.935791 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:58:59.941800 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:58:59.941800 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:58:59.941800 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:58:59.941800 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:58:59.941800 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:58:59.941800 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:58:59.941800 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:58:59.941800 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:58:59.941800 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 20:58:59.941800 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 20:58:59.941800 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 20:58:59.941800 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 20:58:59.941800 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 20:58:59.941800 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 20:58:59.941800 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Oct 04 20:58:59.941800 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:58:59.941800 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:58:59.941800 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:58:59.941800 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:58:59.941800 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:58:59.941800 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:58:59.941800 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 20:58:59.941800 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 20:58:59.941800 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Oct 04 20:58:59.941800 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:58:59.948533 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ccfd69be-d912-4601-b0fd-600853cedaeb tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Returning 400 to user: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:58:59.952217 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ccfd69be-d912-4601-b0fd-600853cedaeb tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 400 len: 133 microversion: 2.1 time: 0.026060 Oct 04 20:58:59.957791 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2386/4812] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 20:58:59 2022] POST /compute/v2.1/servers => generated 133 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 20:58:59.972938 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-e7b3ce7e-b2b5-4e1a-9d0a-ae5712f9d466 tempest-ServerPasswordTestJSON-1023625137 tempest-ServerPasswordTestJSON-1023625137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94afe152da6f45a181ed6fd7dd77c033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7007db5728544fc480825a10fac1e81d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:58:59.978008 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d63897b2-ad63-4a63-8df2-3f97f647e79b tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:58:59.980387 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d63897b2-ad63-4a63-8df2-3f97f647e79b tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] [instance: 320f9a98-969f-473e-bc56-842bbd28dedc] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:58:59.988451 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-e7b3ce7e-b2b5-4e1a-9d0a-ae5712f9d466 tempest-ServerPasswordTestJSON-1023625137 tempest-ServerPasswordTestJSON-1023625137-project] 10.222.0.33 "GET /compute/v2.1/servers/2f6b6d05-2fff-4d82-ac0f-02c84f49ebe3" status: 200 len: 1511 microversion: 2.1 time: 0.963874 Oct 04 20:58:59.989097 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2427/4813] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:58:59 2022] GET /compute/v2.1/servers/2f6b6d05-2fff-4d82-ac0f-02c84f49ebe3 => generated 1511 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:59:00.003866 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d63897b2-ad63-4a63-8df2-3f97f647e79b tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:00.004647 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d63897b2-ad63-4a63-8df2-3f97f647e79b tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:00.017150 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d63897b2-ad63-4a63-8df2-3f97f647e79b tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:00.018189 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d63897b2-ad63-4a63-8df2-3f97f647e79b tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:00.019031 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d63897b2-ad63-4a63-8df2-3f97f647e79b tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:00.022442 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d63897b2-ad63-4a63-8df2-3f97f647e79b tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:00.275736 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d63897b2-ad63-4a63-8df2-3f97f647e79b tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6513f5e908ac4d028cad6eeeebeab285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65946afc398d4a9fb1c9095a4f946e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:59:00.288795 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d63897b2-ad63-4a63-8df2-3f97f647e79b tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc" status: 200 len: 1505 microversion: 2.1 time: 0.325246 Oct 04 20:59:00.290696 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2387/4814] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:58:59 2022] GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc => generated 1505 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:59:00.313982 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-f65bbe40-956e-455f-a0c8-6e2c89f70665 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:59:00.314649 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-f65bbe40-956e-455f-a0c8-6e2c89f70665 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] [instance: 320f9a98-969f-473e-bc56-842bbd28dedc] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:59:00.324648 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f65bbe40-956e-455f-a0c8-6e2c89f70665 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:00.325656 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f65bbe40-956e-455f-a0c8-6e2c89f70665 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:00.326313 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f65bbe40-956e-455f-a0c8-6e2c89f70665 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:00.327323 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f65bbe40-956e-455f-a0c8-6e2c89f70665 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:00.329051 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f65bbe40-956e-455f-a0c8-6e2c89f70665 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:00.329736 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f65bbe40-956e-455f-a0c8-6e2c89f70665 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:00.835826 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-f65bbe40-956e-455f-a0c8-6e2c89f70665 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6513f5e908ac4d028cad6eeeebeab285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65946afc398d4a9fb1c9095a4f946e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:59:00.869510 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-f65bbe40-956e-455f-a0c8-6e2c89f70665 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc" status: 200 len: 1505 microversion: 2.1 time: 0.559310 Oct 04 20:59:00.872511 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2428/4815] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:59:00 2022] GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc => generated 1505 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:59:00.894266 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-dc4be54d-a20e-4d92-b380-93bba21c3583 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:59:00.895172 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-dc4be54d-a20e-4d92-b380-93bba21c3583 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] [instance: 1d5f896d-1c47-430a-a436-1a852bfd026e] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:59:00.904062 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-dc4be54d-a20e-4d92-b380-93bba21c3583 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] HTTP exception thrown: Instance 1d5f896d-1c47-430a-a436-1a852bfd026e could not be found. Oct 04 20:59:00.908813 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-dc4be54d-a20e-4d92-b380-93bba21c3583 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Request method failure captured: Oct 04 20:59:00.908813 n-d-854823-8 devstack@n-api.service[128801]: request: POST /compute/v2.1/servers/1d5f896d-1c47-430a-a436-1a852bfd026e/action HTTP/1.1 Oct 04 20:59:00.908813 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:59:00.908813 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:59:00.908813 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:59:00.908813 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 13 Oct 04 20:59:00.908813 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:59:00.908813 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:59:00.908813 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:59:00.908813 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:59:00.908813 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJ4eaBM_FLl2jaN3nQraRbM94DgE-qlLjkCPNJ1Ol7VvkbIGIp-m_lAuwAay2VJ7lXD5niLtaDpJGDoHOJTljuI2aLuReHvX6jQr-uTgC01ZM2s7p6j6gq6a-1PaGQN0mcmcJntCqSnEEt5MEM6DdrOOdi5eEtsfyNU4EpDYmca-Ylo Oct 04 20:59:00.908813 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:59:00.908813 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:59:00.908813 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:59:00.908813 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:59:00.908813 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:59:00.908813 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:59:00.908813 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: 65946afc398d4a9fb1c9095a4f946e07 Oct 04 20:59:00.908813 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-ServersNegativeTestJSON-1097186397 Oct 04 20:59:00.908813 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 20:59:00.908813 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 20:59:00.908813 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_65946afc398d4a9fb1c9095a4f946e07", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/65946afc398d4a9fb1c9095a4f946e07"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/65946afc398d4a9fb1c9095a4f946e07"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/65946afc398d4a9fb1c9095a4f946e07"}]}] Oct 04 20:59:00.908813 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-ServersNegativeTestJSON-1097186397 Oct 04 20:59:00.908813 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: 65946afc398d4a9fb1c9095a4f946e07 Oct 04 20:59:00.908813 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1097186397 Oct 04 20:59:00.908813 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-ServersNegativeTestJSON-1097186397-project Oct 04 20:59:00.908813 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:59:00.908813 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:59:00.908813 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: 6513f5e908ac4d028cad6eeeebeab285 Oct 04 20:59:00.908813 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-ServersNegativeTestJSON-1097186397-project Oct 04 20:59:00.908813 n-d-854823-8 devstack@n-api.service[128801]: Oct 04 20:59:00.908813 n-d-854823-8 devstack@n-api.service[128801]: {"pause": {}} Oct 04 20:59:00.908813 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 20:59:00.908813 n-d-854823-8 devstack@n-api.service[128801]: exception: Instance 1d5f896d-1c47-430a-a436-1a852bfd026e could not be found. Oct 04 20:59:00.908813 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': '1d5f896d-1c47-430a-a436-1a852bfd026e', 'body': {'pause': {}}} Oct 04 20:59:00.908813 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:59:00.908813 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:59:00.908813 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:59:00.908813 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:59:00.908813 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:59:00.908813 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:59:00.908813 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 20:59:00.908813 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 20:59:00.908813 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1d5f896d-1c47-430a-a436-1a852bfd026e could not be found. Oct 04 20:59:00.908813 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:59:00.908813 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:59:00.908813 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:59:00.908813 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:59:00.908813 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:59:00.908813 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:59:00.908813 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:59:00.908813 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:59:00.908813 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:59:00.908813 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:59:00.908813 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 36, in _pause Oct 04 20:59:00.908813 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Oct 04 20:59:00.908813 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:59:00.908813 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:59:00.908813 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1d5f896d-1c47-430a-a436-1a852bfd026e could not be found. Oct 04 20:59:00.908813 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:59:00.908813 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:59:00.908813 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:59:00.908813 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:59:00.908813 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:59:00.908813 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:59:00.913841 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:59:00.913841 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:59:00.913841 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1d5f896d-1c47-430a-a436-1a852bfd026e could not be found. Oct 04 20:59:00.913841 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:59:00.915605 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-dc4be54d-a20e-4d92-b380-93bba21c3583 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Returning 404 to user: Instance 1d5f896d-1c47-430a-a436-1a852bfd026e could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:59:00.916902 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-dc4be54d-a20e-4d92-b380-93bba21c3583 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "POST /compute/v2.1/servers/1d5f896d-1c47-430a-a436-1a852bfd026e/action" status: 404 len: 111 microversion: 2.1 time: 0.026849 Oct 04 20:59:00.926935 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-b623f60c-89d1-4503-9287-fdaf8ddbad69 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:59:00.927931 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-b623f60c-89d1-4503-9287-fdaf8ddbad69 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] [instance: 320f9a98-969f-473e-bc56-842bbd28dedc] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:59:00.930423 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2388/4816] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 20:59:00 2022] POST /compute/v2.1/servers/1d5f896d-1c47-430a-a436-1a852bfd026e/action => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:59:00.934977 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b623f60c-89d1-4503-9287-fdaf8ddbad69 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:00.935745 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b623f60c-89d1-4503-9287-fdaf8ddbad69 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:00.936410 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b623f60c-89d1-4503-9287-fdaf8ddbad69 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:00.937574 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b623f60c-89d1-4503-9287-fdaf8ddbad69 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:00.938303 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b623f60c-89d1-4503-9287-fdaf8ddbad69 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:00.938979 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b623f60c-89d1-4503-9287-fdaf8ddbad69 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:01.014080 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-cfc5d720-3e99-442e-a43b-c6bb2dd8cb71 tempest-ServerPasswordTestJSON-1023625137 tempest-ServerPasswordTestJSON-1023625137-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:59:01.014827 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-cfc5d720-3e99-442e-a43b-c6bb2dd8cb71 tempest-ServerPasswordTestJSON-1023625137 tempest-ServerPasswordTestJSON-1023625137-project] [instance: 2f6b6d05-2fff-4d82-ac0f-02c84f49ebe3] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:59:01.023442 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cfc5d720-3e99-442e-a43b-c6bb2dd8cb71 tempest-ServerPasswordTestJSON-1023625137 tempest-ServerPasswordTestJSON-1023625137-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:01.024297 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cfc5d720-3e99-442e-a43b-c6bb2dd8cb71 tempest-ServerPasswordTestJSON-1023625137 tempest-ServerPasswordTestJSON-1023625137-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:01.025345 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cfc5d720-3e99-442e-a43b-c6bb2dd8cb71 tempest-ServerPasswordTestJSON-1023625137 tempest-ServerPasswordTestJSON-1023625137-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:01.026370 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cfc5d720-3e99-442e-a43b-c6bb2dd8cb71 tempest-ServerPasswordTestJSON-1023625137 tempest-ServerPasswordTestJSON-1023625137-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:01.027075 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cfc5d720-3e99-442e-a43b-c6bb2dd8cb71 tempest-ServerPasswordTestJSON-1023625137 tempest-ServerPasswordTestJSON-1023625137-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:01.027748 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cfc5d720-3e99-442e-a43b-c6bb2dd8cb71 tempest-ServerPasswordTestJSON-1023625137 tempest-ServerPasswordTestJSON-1023625137-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:01.703597 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-cfc5d720-3e99-442e-a43b-c6bb2dd8cb71 tempest-ServerPasswordTestJSON-1023625137 tempest-ServerPasswordTestJSON-1023625137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94afe152da6f45a181ed6fd7dd77c033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7007db5728544fc480825a10fac1e81d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:59:01.736089 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-cfc5d720-3e99-442e-a43b-c6bb2dd8cb71 tempest-ServerPasswordTestJSON-1023625137 tempest-ServerPasswordTestJSON-1023625137-project] 10.222.0.33 "GET /compute/v2.1/servers/2f6b6d05-2fff-4d82-ac0f-02c84f49ebe3" status: 200 len: 1469 microversion: 2.1 time: 0.727626 Oct 04 20:59:01.736740 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2389/4817] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:59:01 2022] GET /compute/v2.1/servers/2f6b6d05-2fff-4d82-ac0f-02c84f49ebe3 => generated 1469 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:59:01.758069 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-897480c1-a5f5-4f29-8f11-92b67c93fd27 req-b77bf11c-7b5e-45ca-9dd1-9e92951d166d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f6b6d05-2fff-4d82-ac0f-02c84f49ebe3", "name": "network-vif-deleted", "tag": "c8b9f449-1dbd-4568-ab4c-f71d869a3c1e"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:59:01.789665 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-897480c1-a5f5-4f29-8f11-92b67c93fd27 req-b77bf11c-7b5e-45ca-9dd1-9e92951d166d service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:01.793607 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-897480c1-a5f5-4f29-8f11-92b67c93fd27 req-b77bf11c-7b5e-45ca-9dd1-9e92951d166d service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:01.794275 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-897480c1-a5f5-4f29-8f11-92b67c93fd27 req-b77bf11c-7b5e-45ca-9dd1-9e92951d166d service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:01.820013 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-897480c1-a5f5-4f29-8f11-92b67c93fd27 req-b77bf11c-7b5e-45ca-9dd1-9e92951d166d service nova] Creating event network-vif-deleted:c8b9f449-1dbd-4568-ab4c-f71d869a3c1e for instance 2f6b6d05-2fff-4d82-ac0f-02c84f49ebe3 on n-h1-854823-8 Oct 04 20:59:01.845764 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-897480c1-a5f5-4f29-8f11-92b67c93fd27 req-b77bf11c-7b5e-45ca-9dd1-9e92951d166d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091268 Oct 04 20:59:01.847079 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2390/4818] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:59:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:59:02.175878 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-b623f60c-89d1-4503-9287-fdaf8ddbad69 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6513f5e908ac4d028cad6eeeebeab285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65946afc398d4a9fb1c9095a4f946e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:59:02.185119 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-b623f60c-89d1-4503-9287-fdaf8ddbad69 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc" status: 200 len: 1505 microversion: 2.1 time: 1.262842 Oct 04 20:59:02.185701 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2429/4819] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:59:00 2022] GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc => generated 1505 bytes in 1264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:59:02.218691 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a7705eb4-0a80-4385-969e-5182f8b0adec tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:59:02.219999 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a7705eb4-0a80-4385-969e-5182f8b0adec tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] [instance: 320f9a98-969f-473e-bc56-842bbd28dedc] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:59:02.238152 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a7705eb4-0a80-4385-969e-5182f8b0adec tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:02.239207 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a7705eb4-0a80-4385-969e-5182f8b0adec tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:02.239950 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a7705eb4-0a80-4385-969e-5182f8b0adec tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:02.240852 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a7705eb4-0a80-4385-969e-5182f8b0adec tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:02.244678 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a7705eb4-0a80-4385-969e-5182f8b0adec tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:02.248618 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a7705eb4-0a80-4385-969e-5182f8b0adec tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:02.280337 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=100 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:59:02.761915 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-071e634e-e902-460f-a42c-67d7d3350c98 tempest-ServerPasswordTestJSON-1023625137 tempest-ServerPasswordTestJSON-1023625137-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:59:02.762654 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-071e634e-e902-460f-a42c-67d7d3350c98 tempest-ServerPasswordTestJSON-1023625137 tempest-ServerPasswordTestJSON-1023625137-project] [instance: 2f6b6d05-2fff-4d82-ac0f-02c84f49ebe3] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:59:02.782907 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-071e634e-e902-460f-a42c-67d7d3350c98 tempest-ServerPasswordTestJSON-1023625137 tempest-ServerPasswordTestJSON-1023625137-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:02.783402 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-071e634e-e902-460f-a42c-67d7d3350c98 tempest-ServerPasswordTestJSON-1023625137 tempest-ServerPasswordTestJSON-1023625137-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:02.786990 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-071e634e-e902-460f-a42c-67d7d3350c98 tempest-ServerPasswordTestJSON-1023625137 tempest-ServerPasswordTestJSON-1023625137-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:02.788090 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-071e634e-e902-460f-a42c-67d7d3350c98 tempest-ServerPasswordTestJSON-1023625137 tempest-ServerPasswordTestJSON-1023625137-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:02.788914 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-071e634e-e902-460f-a42c-67d7d3350c98 tempest-ServerPasswordTestJSON-1023625137 tempest-ServerPasswordTestJSON-1023625137-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:02.789499 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-071e634e-e902-460f-a42c-67d7d3350c98 tempest-ServerPasswordTestJSON-1023625137 tempest-ServerPasswordTestJSON-1023625137-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:02.819624 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-a7705eb4-0a80-4385-969e-5182f8b0adec tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6513f5e908ac4d028cad6eeeebeab285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65946afc398d4a9fb1c9095a4f946e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:59:02.833839 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a7705eb4-0a80-4385-969e-5182f8b0adec tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc" status: 200 len: 1505 microversion: 2.1 time: 0.622343 Oct 04 20:59:02.842738 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2391/4820] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:59:02 2022] GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc => generated 1505 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:59:02.868842 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.wsgi [None req-071e634e-e902-460f-a42c-67d7d3350c98 tempest-ServerPasswordTestJSON-1023625137 tempest-ServerPasswordTestJSON-1023625137-project] HTTP exception thrown: Instance 2f6b6d05-2fff-4d82-ac0f-02c84f49ebe3 could not be found. Oct 04 20:59:02.873163 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-071e634e-e902-460f-a42c-67d7d3350c98 tempest-ServerPasswordTestJSON-1023625137 tempest-ServerPasswordTestJSON-1023625137-project] Request method failure captured: Oct 04 20:59:02.873163 n-d-854823-8 devstack@n-api.service[128802]: request: GET /compute/v2.1/servers/2f6b6d05-2fff-4d82-ac0f-02c84f49ebe3 HTTP/1.1 Oct 04 20:59:02.873163 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 20:59:02.873163 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 20:59:02.873163 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 20:59:02.873163 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 0 Oct 04 20:59:02.873163 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 20:59:02.873163 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 20:59:02.873163 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 20:59:02.873163 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 20:59:02.873163 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPJ52zPAMCZAQfdEymmH-IEPRJRrftjBBmMuM6vNbRzaOInaFrJYwHCRn_mz7pn85oMcnwDUq-BQ5IMjTU_yrfB7hJjkHnsVjU77R4gaSRrPVG_MJWBu3zySJLSGSPvKDJ71A8Gq7xyz8n7JNLUPeeCRYVo8J54ubIwQSDuYVejs2mWc Oct 04 20:59:02.873163 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 20:59:02.873163 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 20:59:02.873163 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 20:59:02.873163 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 20:59:02.873163 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 20:59:02.873163 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 20:59:02.873163 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: 7007db5728544fc480825a10fac1e81d Oct 04 20:59:02.873163 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-ServerPasswordTestJSON-1023625137 Oct 04 20:59:02.873163 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 20:59:02.873163 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 20:59:02.873163 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_7007db5728544fc480825a10fac1e81d", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7007db5728544fc480825a10fac1e81d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7007db5728544fc480825a10fac1e81d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/7007db5728544fc480825a10fac1e81d"}]}] Oct 04 20:59:02.873163 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-ServerPasswordTestJSON-1023625137 Oct 04 20:59:02.873163 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: 7007db5728544fc480825a10fac1e81d Oct 04 20:59:02.873163 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-ServerPasswordTestJSON-1023625137 Oct 04 20:59:02.873163 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-ServerPasswordTestJSON-1023625137-project Oct 04 20:59:02.873163 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 20:59:02.873163 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 20:59:02.873163 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: 94afe152da6f45a181ed6fd7dd77c033 Oct 04 20:59:02.873163 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-ServerPasswordTestJSON-1023625137-project Oct 04 20:59:02.873163 n-d-854823-8 devstack@n-api.service[128802]: method: > Oct 04 20:59:02.873163 n-d-854823-8 devstack@n-api.service[128802]: exception: Instance 2f6b6d05-2fff-4d82-ac0f-02c84f49ebe3 could not be found. Oct 04 20:59:02.873163 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'id': '2f6b6d05-2fff-4d82-ac0f-02c84f49ebe3'} Oct 04 20:59:02.873163 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:59:02.873163 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:59:02.873163 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:59:02.873163 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:59:02.873163 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:59:02.873163 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:59:02.873163 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:59:02.873163 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:59:02.873163 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:59:02.873163 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:59:02.873163 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2f6b6d05-2fff-4d82-ac0f-02c84f49ebe3 could not be found. Oct 04 20:59:02.873163 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:59:02.873163 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:59:02.873163 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:59:02.873163 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:59:02.873163 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:59:02.873163 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:59:02.873163 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:59:02.873163 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:59:02.873163 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:59:02.873163 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:59:02.873163 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:59:02.873163 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:59:02.873163 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:59:02.873163 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:59:02.873163 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:59:02.873163 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:59:02.873163 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2f6b6d05-2fff-4d82-ac0f-02c84f49ebe3 could not be found. Oct 04 20:59:02.873163 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:59:02.873163 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:59:02.873163 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:59:02.878656 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:59:02.878656 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:59:02.878656 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:59:02.878656 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:59:02.878656 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:59:02.878656 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2f6b6d05-2fff-4d82-ac0f-02c84f49ebe3 could not be found. Oct 04 20:59:02.878656 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:59:02.880341 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-071e634e-e902-460f-a42c-67d7d3350c98 tempest-ServerPasswordTestJSON-1023625137 tempest-ServerPasswordTestJSON-1023625137-project] Returning 404 to user: Instance 2f6b6d05-2fff-4d82-ac0f-02c84f49ebe3 could not be found. {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:59:02.881625 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-071e634e-e902-460f-a42c-67d7d3350c98 tempest-ServerPasswordTestJSON-1023625137 tempest-ServerPasswordTestJSON-1023625137-project] 10.222.0.33 "GET /compute/v2.1/servers/2f6b6d05-2fff-4d82-ac0f-02c84f49ebe3" status: 404 len: 111 microversion: 2.1 time: 0.125075 Oct 04 20:59:02.886244 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2430/4821] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:59:02 2022] GET /compute/v2.1/servers/2f6b6d05-2fff-4d82-ac0f-02c84f49ebe3 => generated 111 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 20:59:02.906335 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-0e1c79f2-967c-4a83-bdf5-ba3718abee17 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:59:02.917086 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-0e1c79f2-967c-4a83-bdf5-ba3718abee17 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] [instance: 320f9a98-969f-473e-bc56-842bbd28dedc] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:59:02.942654 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0e1c79f2-967c-4a83-bdf5-ba3718abee17 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:02.950904 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0e1c79f2-967c-4a83-bdf5-ba3718abee17 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:02.951768 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0e1c79f2-967c-4a83-bdf5-ba3718abee17 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:02.952805 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0e1c79f2-967c-4a83-bdf5-ba3718abee17 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:02.957103 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0e1c79f2-967c-4a83-bdf5-ba3718abee17 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:02.957760 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0e1c79f2-967c-4a83-bdf5-ba3718abee17 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:03.114610 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0ab78e78-76e0-4105-ad66-685a45cc1732 tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-2040054718", "imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63", "flavorRef": "452", "metadata": {}, "networks": [{"uuid": "f9d0fd82-0389-4f6f-abc2-e85dbabc0cc6"}]}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:59:03.155017 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-0e1c79f2-967c-4a83-bdf5-ba3718abee17 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "POST /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc/action" status: 202 len: 0 microversion: 2.1 time: 0.264347 Oct 04 20:59:03.155690 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2431/4822] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 20:59:02 2022] POST /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc/action => generated 0 bytes in 266 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:59:03.176587 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-b337375e-4187-485f-9e49-9f230f60cfc3 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:59:03.191437 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-b337375e-4187-485f-9e49-9f230f60cfc3 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] [instance: 320f9a98-969f-473e-bc56-842bbd28dedc] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:59:03.219600 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b337375e-4187-485f-9e49-9f230f60cfc3 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:03.225860 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b337375e-4187-485f-9e49-9f230f60cfc3 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:03.226588 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b337375e-4187-485f-9e49-9f230f60cfc3 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:03.233620 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b337375e-4187-485f-9e49-9f230f60cfc3 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:03.235556 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b337375e-4187-485f-9e49-9f230f60cfc3 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:03.236203 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b337375e-4187-485f-9e49-9f230f60cfc3 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:03.276543 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.network.neutron [None req-0ab78e78-76e0-4105-ad66-685a45cc1732 tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] validate_networks() for [('f9d0fd82-0389-4f6f-abc2-e85dbabc0cc6', None, None, None, None, None)] {{(pid=128801) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:59:04.306783 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-b337375e-4187-485f-9e49-9f230f60cfc3 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6513f5e908ac4d028cad6eeeebeab285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65946afc398d4a9fb1c9095a4f946e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:59:04.324485 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-b337375e-4187-485f-9e49-9f230f60cfc3 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc" status: 200 len: 1510 microversion: 2.1 time: 1.155524 Oct 04 20:59:04.343400 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2432/4823] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:59:03 2022] GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc => generated 1510 bytes in 1175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:59:05.357427 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-5a1a9e2d-bed0-4f47-a3ff-9a3234a37437 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:59:05.359167 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-5a1a9e2d-bed0-4f47-a3ff-9a3234a37437 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] [instance: 320f9a98-969f-473e-bc56-842bbd28dedc] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:59:05.379980 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5a1a9e2d-bed0-4f47-a3ff-9a3234a37437 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:05.383433 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5a1a9e2d-bed0-4f47-a3ff-9a3234a37437 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:05.385516 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5a1a9e2d-bed0-4f47-a3ff-9a3234a37437 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:05.389442 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5a1a9e2d-bed0-4f47-a3ff-9a3234a37437 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:05.391504 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5a1a9e2d-bed0-4f47-a3ff-9a3234a37437 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:05.392207 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5a1a9e2d-bed0-4f47-a3ff-9a3234a37437 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:06.222412 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-5a1a9e2d-bed0-4f47-a3ff-9a3234a37437 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6513f5e908ac4d028cad6eeeebeab285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65946afc398d4a9fb1c9095a4f946e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:59:06.235038 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-5a1a9e2d-bed0-4f47-a3ff-9a3234a37437 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc" status: 200 len: 1490 microversion: 2.1 time: 0.882923 Oct 04 20:59:06.239304 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2433/4824] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:59:05 2022] GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc => generated 1490 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:59:06.263451 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-a03fe5e8-5621-4e9e-8ef9-23fd94de25f8 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:59:06.263991 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-a03fe5e8-5621-4e9e-8ef9-23fd94de25f8 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] [instance: 320f9a98-969f-473e-bc56-842bbd28dedc] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:59:06.273659 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a03fe5e8-5621-4e9e-8ef9-23fd94de25f8 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:06.274155 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a03fe5e8-5621-4e9e-8ef9-23fd94de25f8 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:06.274623 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a03fe5e8-5621-4e9e-8ef9-23fd94de25f8 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:06.275339 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a03fe5e8-5621-4e9e-8ef9-23fd94de25f8 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:06.275875 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a03fe5e8-5621-4e9e-8ef9-23fd94de25f8 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:06.276229 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a03fe5e8-5621-4e9e-8ef9-23fd94de25f8 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:06.321249 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.wsgi [None req-a03fe5e8-5621-4e9e-8ef9-23fd94de25f8 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] HTTP exception thrown: Cannot 'pause' instance 320f9a98-969f-473e-bc56-842bbd28dedc while it is in vm_state paused Oct 04 20:59:06.332723 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-a03fe5e8-5621-4e9e-8ef9-23fd94de25f8 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Request method failure captured: Oct 04 20:59:06.332723 n-d-854823-8 devstack@n-api.service[128802]: request: POST /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc/action HTTP/1.1 Oct 04 20:59:06.332723 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 20:59:06.332723 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 20:59:06.332723 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 20:59:06.332723 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 13 Oct 04 20:59:06.332723 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 20:59:06.332723 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 20:59:06.332723 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 20:59:06.332723 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 20:59:06.332723 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPJ4eaBM_FLl2jaN3nQraRbM94DgE-qlLjkCPNJ1Ol7VvkbIGIp-m_lAuwAay2VJ7lXD5niLtaDpJGDoHOJTljuI2aLuReHvX6jQr-uTgC01ZM2s7p6j6gq6a-1PaGQN0mcmcJntCqSnEEt5MEM6DdrOOdi5eEtsfyNU4EpDYmca-Ylo Oct 04 20:59:06.332723 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 20:59:06.332723 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 20:59:06.332723 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 20:59:06.332723 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 20:59:06.332723 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 20:59:06.332723 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 20:59:06.332723 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: 65946afc398d4a9fb1c9095a4f946e07 Oct 04 20:59:06.332723 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-ServersNegativeTestJSON-1097186397 Oct 04 20:59:06.332723 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 20:59:06.332723 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 20:59:06.332723 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_65946afc398d4a9fb1c9095a4f946e07", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/65946afc398d4a9fb1c9095a4f946e07"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/65946afc398d4a9fb1c9095a4f946e07"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/65946afc398d4a9fb1c9095a4f946e07"}]}] Oct 04 20:59:06.332723 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-ServersNegativeTestJSON-1097186397 Oct 04 20:59:06.332723 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: 65946afc398d4a9fb1c9095a4f946e07 Oct 04 20:59:06.332723 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1097186397 Oct 04 20:59:06.332723 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-ServersNegativeTestJSON-1097186397-project Oct 04 20:59:06.332723 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 20:59:06.332723 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 20:59:06.332723 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: 6513f5e908ac4d028cad6eeeebeab285 Oct 04 20:59:06.332723 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-ServersNegativeTestJSON-1097186397-project Oct 04 20:59:06.332723 n-d-854823-8 devstack@n-api.service[128802]: Oct 04 20:59:06.332723 n-d-854823-8 devstack@n-api.service[128802]: {"pause": {}} Oct 04 20:59:06.332723 n-d-854823-8 devstack@n-api.service[128802]: method: > Oct 04 20:59:06.332723 n-d-854823-8 devstack@n-api.service[128802]: exception: Cannot 'pause' instance 320f9a98-969f-473e-bc56-842bbd28dedc while it is in vm_state paused Oct 04 20:59:06.332723 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'id': '320f9a98-969f-473e-bc56-842bbd28dedc', 'body': {'pause': {}}} Oct 04 20:59:06.332723 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:59:06.332723 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:59:06.332723 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 41, in _pause Oct 04 20:59:06.332723 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi self.compute_api.pause(ctxt, server) Oct 04 20:59:06.332723 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 20:59:06.332723 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 20:59:06.332723 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 04 20:59:06.332723 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 04 20:59:06.332723 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 320f9a98-969f-473e-bc56-842bbd28dedc in vm_state paused. Cannot pause while the instance is in this state. Oct 04 20:59:06.332723 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:59:06.332723 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:59:06.332723 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:59:06.332723 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:59:06.332723 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:59:06.332723 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:59:06.332723 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:59:06.332723 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:59:06.332723 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:59:06.332723 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:59:06.332723 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 45, in _pause Oct 04 20:59:06.332723 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 04 20:59:06.332723 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 04 20:59:06.332723 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 04 20:59:06.332723 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'pause' instance 320f9a98-969f-473e-bc56-842bbd28dedc while it is in vm_state paused Oct 04 20:59:06.332723 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:59:06.332723 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:59:06.332723 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:59:06.332723 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:59:06.332723 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:59:06.337826 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:59:06.337826 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:59:06.337826 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:59:06.337826 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'pause' instance 320f9a98-969f-473e-bc56-842bbd28dedc while it is in vm_state paused Oct 04 20:59:06.337826 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:59:06.339655 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-a03fe5e8-5621-4e9e-8ef9-23fd94de25f8 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Returning 409 to user: Cannot 'pause' instance 320f9a98-969f-473e-bc56-842bbd28dedc while it is in vm_state paused {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:59:06.341711 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-a03fe5e8-5621-4e9e-8ef9-23fd94de25f8 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "POST /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc/action" status: 409 len: 143 microversion: 2.1 time: 0.082371 Oct 04 20:59:06.343986 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2434/4825] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 20:59:06 2022] POST /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc/action => generated 143 bytes in 85 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Oct 04 20:59:06.359750 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-8a3b369c-332f-4b7e-afb1-2f00a71dd1dd tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:59:06.361678 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-8a3b369c-332f-4b7e-afb1-2f00a71dd1dd tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] [instance: 320f9a98-969f-473e-bc56-842bbd28dedc] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:59:06.375680 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8a3b369c-332f-4b7e-afb1-2f00a71dd1dd tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:06.379329 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8a3b369c-332f-4b7e-afb1-2f00a71dd1dd tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:06.380105 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8a3b369c-332f-4b7e-afb1-2f00a71dd1dd tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:06.381080 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8a3b369c-332f-4b7e-afb1-2f00a71dd1dd tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:06.383867 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8a3b369c-332f-4b7e-afb1-2f00a71dd1dd tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:06.384624 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8a3b369c-332f-4b7e-afb1-2f00a71dd1dd tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:06.469058 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=4,nova_cell1:INSERT=6 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:59:06.501863 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-8a3b369c-332f-4b7e-afb1-2f00a71dd1dd tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "POST /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc/action" status: 202 len: 0 microversion: 2.1 time: 0.151424 Oct 04 20:59:06.504346 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2435/4826] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 20:59:06 2022] POST /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc/action => generated 0 bytes in 155 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:59:06.522554 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-cd559560-2942-4f36-8a4a-d677774960c3 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:59:06.525469 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-cd559560-2942-4f36-8a4a-d677774960c3 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] [instance: 320f9a98-969f-473e-bc56-842bbd28dedc] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:59:06.546793 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cd559560-2942-4f36-8a4a-d677774960c3 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:06.546793 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cd559560-2942-4f36-8a4a-d677774960c3 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:06.550978 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cd559560-2942-4f36-8a4a-d677774960c3 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:06.551783 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cd559560-2942-4f36-8a4a-d677774960c3 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:06.552440 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cd559560-2942-4f36-8a4a-d677774960c3 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:06.553081 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cd559560-2942-4f36-8a4a-d677774960c3 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:07.184690 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell0:SELECT=4 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:59:07.380289 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-0ab78e78-76e0-4105-ad66-685a45cc1732 tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] Flavor limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:59:07.381284 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-0ab78e78-76e0-4105-ad66-685a45cc1732 tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] Image limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:59:07.381965 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-0ab78e78-76e0-4105-ad66-685a45cc1732 tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] Flavor pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:59:07.382741 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-0ab78e78-76e0-4105-ad66-685a45cc1732 tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] Image pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:59:07.383325 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-0ab78e78-76e0-4105-ad66-685a45cc1732 tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:59:07.401336 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0ab78e78-76e0-4105-ad66-685a45cc1732 tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:07.403856 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0ab78e78-76e0-4105-ad66-685a45cc1732 tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:07.405167 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0ab78e78-76e0-4105-ad66-685a45cc1732 tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:07.407219 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0ab78e78-76e0-4105-ad66-685a45cc1732 tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:07.410388 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0ab78e78-76e0-4105-ad66-685a45cc1732 tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:07.411090 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0ab78e78-76e0-4105-ad66-685a45cc1732 tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:07.446176 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-0ab78e78-76e0-4105-ad66-685a45cc1732 tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] Getting quotas for project c3c2d7a7a44e4ea78f2974539bf9a173. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:59:07.460096 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-0ab78e78-76e0-4105-ad66-685a45cc1732 tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] Getting quotas for user d25849c543c84fb7a87a74c11f8d7990 and project c3c2d7a7a44e4ea78f2974539bf9a173. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:59:07.480868 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-0ab78e78-76e0-4105-ad66-685a45cc1732 tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] Going to run 1 instances... {{(pid=128801) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:59:07.484883 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-0ab78e78-76e0-4105-ad66-685a45cc1732 tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] [instance: beedbabd-70f0-435a-80ec-497c232a9ee3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='15b24725-0c99-4bcf-b1fb-907cdf8e2d63',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128801) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:59:07.568570 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-0ab78e78-76e0-4105-ad66-685a45cc1732 tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.723477 Oct 04 20:59:07.569274 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2392/4827] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 20:59:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 4726 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 20:59:07.581531 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-dc76ee3b-5727-498e-9411-28e6f743e7a2 tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:59:07.586251 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-dc76ee3b-5727-498e-9411-28e6f743e7a2 tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] [instance: beedbabd-70f0-435a-80ec-497c232a9ee3] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:59:07.755594 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-dc76ee3b-5727-498e-9411-28e6f743e7a2 tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25849c543c84fb7a87a74c11f8d7990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c2d7a7a44e4ea78f2974539bf9a173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:59:07.767072 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-dc76ee3b-5727-498e-9411-28e6f743e7a2 tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] 10.222.0.33 "GET /compute/v2.1/servers/beedbabd-70f0-435a-80ec-497c232a9ee3" status: 200 len: 1224 microversion: 2.1 time: 0.187808 Oct 04 20:59:07.777209 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2393/4828] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:59:07 2022] GET /compute/v2.1/servers/beedbabd-70f0-435a-80ec-497c232a9ee3 => generated 1224 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:59:07.805429 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-cd559560-2942-4f36-8a4a-d677774960c3 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6513f5e908ac4d028cad6eeeebeab285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65946afc398d4a9fb1c9095a4f946e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:59:07.819701 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-cd559560-2942-4f36-8a4a-d677774960c3 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc" status: 200 len: 1497 microversion: 2.1 time: 1.310532 Oct 04 20:59:07.820576 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2436/4829] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:59:06 2022] GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc => generated 1497 bytes in 1312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:59:08.805603 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-37ac0f8f-3d4e-4317-8b5e-a82d026534f5 tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:59:08.806147 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-37ac0f8f-3d4e-4317-8b5e-a82d026534f5 tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] [instance: beedbabd-70f0-435a-80ec-497c232a9ee3] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:59:08.830003 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-37ac0f8f-3d4e-4317-8b5e-a82d026534f5 tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:08.831001 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-37ac0f8f-3d4e-4317-8b5e-a82d026534f5 tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:08.834712 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-37ac0f8f-3d4e-4317-8b5e-a82d026534f5 tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:08.835837 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-37ac0f8f-3d4e-4317-8b5e-a82d026534f5 tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:08.836515 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-37ac0f8f-3d4e-4317-8b5e-a82d026534f5 tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:08.839043 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-37ac0f8f-3d4e-4317-8b5e-a82d026534f5 tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:08.849936 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-ea08743a-0fb2-4cb1-8282-0b4b81846c31 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:59:08.851372 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-ea08743a-0fb2-4cb1-8282-0b4b81846c31 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] [instance: 320f9a98-969f-473e-bc56-842bbd28dedc] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:59:08.872896 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ea08743a-0fb2-4cb1-8282-0b4b81846c31 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:08.875870 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ea08743a-0fb2-4cb1-8282-0b4b81846c31 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:08.876621 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ea08743a-0fb2-4cb1-8282-0b4b81846c31 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:08.877534 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ea08743a-0fb2-4cb1-8282-0b4b81846c31 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:08.882451 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ea08743a-0fb2-4cb1-8282-0b4b81846c31 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:08.883930 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ea08743a-0fb2-4cb1-8282-0b4b81846c31 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:09.060020 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-37ac0f8f-3d4e-4317-8b5e-a82d026534f5 tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25849c543c84fb7a87a74c11f8d7990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c2d7a7a44e4ea78f2974539bf9a173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:59:09.074321 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-37ac0f8f-3d4e-4317-8b5e-a82d026534f5 tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] 10.222.0.33 "GET /compute/v2.1/servers/beedbabd-70f0-435a-80ec-497c232a9ee3" status: 200 len: 1220 microversion: 2.1 time: 0.273470 Oct 04 20:59:09.075576 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2394/4830] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:59:08 2022] GET /compute/v2.1/servers/beedbabd-70f0-435a-80ec-497c232a9ee3 => generated 1220 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:59:10.101970 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b4d526a4-8553-441b-83d5-b303611fdc70 tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:59:10.104440 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b4d526a4-8553-441b-83d5-b303611fdc70 tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] [instance: beedbabd-70f0-435a-80ec-497c232a9ee3] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:59:10.118923 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b4d526a4-8553-441b-83d5-b303611fdc70 tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:10.121631 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b4d526a4-8553-441b-83d5-b303611fdc70 tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:10.125672 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b4d526a4-8553-441b-83d5-b303611fdc70 tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:10.126666 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b4d526a4-8553-441b-83d5-b303611fdc70 tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:10.127471 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b4d526a4-8553-441b-83d5-b303611fdc70 tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:10.128615 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b4d526a4-8553-441b-83d5-b303611fdc70 tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:10.252241 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-ea08743a-0fb2-4cb1-8282-0b4b81846c31 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6513f5e908ac4d028cad6eeeebeab285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65946afc398d4a9fb1c9095a4f946e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:59:10.262968 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-ea08743a-0fb2-4cb1-8282-0b4b81846c31 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc" status: 200 len: 1505 microversion: 2.1 time: 1.416708 Oct 04 20:59:10.267259 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2437/4831] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:59:08 2022] GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc => generated 1505 bytes in 1423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:59:10.303195 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-2b962b24-0fb5-45a3-a779-8c0e085abf7f tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:59:10.303815 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-2b962b24-0fb5-45a3-a779-8c0e085abf7f tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] [instance: 320f9a98-969f-473e-bc56-842bbd28dedc] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:59:10.312428 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2b962b24-0fb5-45a3-a779-8c0e085abf7f tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:10.312918 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2b962b24-0fb5-45a3-a779-8c0e085abf7f tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:10.313355 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2b962b24-0fb5-45a3-a779-8c0e085abf7f tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:10.314066 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2b962b24-0fb5-45a3-a779-8c0e085abf7f tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:10.314555 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2b962b24-0fb5-45a3-a779-8c0e085abf7f tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:10.314993 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2b962b24-0fb5-45a3-a779-8c0e085abf7f tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:10.484732 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-b4d526a4-8553-441b-83d5-b303611fdc70 tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25849c543c84fb7a87a74c11f8d7990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c2d7a7a44e4ea78f2974539bf9a173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:59:10.498186 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b4d526a4-8553-441b-83d5-b303611fdc70 tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] 10.222.0.33 "GET /compute/v2.1/servers/beedbabd-70f0-435a-80ec-497c232a9ee3" status: 200 len: 1282 microversion: 2.1 time: 0.400072 Oct 04 20:59:10.499720 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2395/4832] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:59:10 2022] GET /compute/v2.1/servers/beedbabd-70f0-435a-80ec-497c232a9ee3 => generated 1282 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:59:11.521844 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2d98ce12-47b6-49f1-b863-d44c9a363fff tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:59:11.525024 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-2d98ce12-47b6-49f1-b863-d44c9a363fff tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] [instance: beedbabd-70f0-435a-80ec-497c232a9ee3] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:59:11.539092 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2d98ce12-47b6-49f1-b863-d44c9a363fff tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:11.540544 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2d98ce12-47b6-49f1-b863-d44c9a363fff tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:11.541200 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2d98ce12-47b6-49f1-b863-d44c9a363fff tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:11.549060 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2d98ce12-47b6-49f1-b863-d44c9a363fff tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:11.550328 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2d98ce12-47b6-49f1-b863-d44c9a363fff tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:11.555230 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2d98ce12-47b6-49f1-b863-d44c9a363fff tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:11.750362 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-2b962b24-0fb5-45a3-a779-8c0e085abf7f tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6513f5e908ac4d028cad6eeeebeab285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65946afc398d4a9fb1c9095a4f946e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:59:11.762982 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-2b962b24-0fb5-45a3-a779-8c0e085abf7f tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc" status: 200 len: 1505 microversion: 2.1 time: 1.464588 Oct 04 20:59:11.782798 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2438/4833] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:59:10 2022] GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc => generated 1505 bytes in 1485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:59:11.791471 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-2d98ce12-47b6-49f1-b863-d44c9a363fff tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25849c543c84fb7a87a74c11f8d7990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c2d7a7a44e4ea78f2974539bf9a173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:59:11.808391 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-24d8992b-3de9-4c5c-8a17-6ccad68372de tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:59:11.811662 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-2d98ce12-47b6-49f1-b863-d44c9a363fff tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] 10.222.0.33 "GET /compute/v2.1/servers/beedbabd-70f0-435a-80ec-497c232a9ee3" status: 200 len: 1282 microversion: 2.1 time: 0.289006 Oct 04 20:59:11.813983 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2396/4834] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:59:11 2022] GET /compute/v2.1/servers/beedbabd-70f0-435a-80ec-497c232a9ee3 => generated 1282 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:59:11.817303 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-24d8992b-3de9-4c5c-8a17-6ccad68372de tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] [instance: 368d4aa4-81a1-43af-a69b-e5f7004da740] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:59:11.832894 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-24d8992b-3de9-4c5c-8a17-6ccad68372de tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:11.833731 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-24d8992b-3de9-4c5c-8a17-6ccad68372de tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:11.834735 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-24d8992b-3de9-4c5c-8a17-6ccad68372de tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:11.835855 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-24d8992b-3de9-4c5c-8a17-6ccad68372de tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:11.848188 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-24d8992b-3de9-4c5c-8a17-6ccad68372de tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:11.849100 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-24d8992b-3de9-4c5c-8a17-6ccad68372de tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:11.870407 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.wsgi [None req-24d8992b-3de9-4c5c-8a17-6ccad68372de tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] HTTP exception thrown: Instance 368d4aa4-81a1-43af-a69b-e5f7004da740 could not be found. Oct 04 20:59:11.872779 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-24d8992b-3de9-4c5c-8a17-6ccad68372de tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Request method failure captured: Oct 04 20:59:11.872779 n-d-854823-8 devstack@n-api.service[128802]: request: POST /compute/v2.1/servers/368d4aa4-81a1-43af-a69b-e5f7004da740/action HTTP/1.1 Oct 04 20:59:11.872779 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 20:59:11.872779 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 20:59:11.872779 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 20:59:11.872779 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 28 Oct 04 20:59:11.872779 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 20:59:11.872779 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 20:59:11.872779 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 20:59:11.872779 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 20:59:11.872779 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPJ4eaBM_FLl2jaN3nQraRbM94DgE-qlLjkCPNJ1Ol7VvkbIGIp-m_lAuwAay2VJ7lXD5niLtaDpJGDoHOJTljuI2aLuReHvX6jQr-uTgC01ZM2s7p6j6gq6a-1PaGQN0mcmcJntCqSnEEt5MEM6DdrOOdi5eEtsfyNU4EpDYmca-Ylo Oct 04 20:59:11.872779 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 20:59:11.872779 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 20:59:11.872779 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 20:59:11.872779 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 20:59:11.872779 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 20:59:11.872779 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 20:59:11.872779 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: 65946afc398d4a9fb1c9095a4f946e07 Oct 04 20:59:11.872779 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-ServersNegativeTestJSON-1097186397 Oct 04 20:59:11.872779 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 20:59:11.872779 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 20:59:11.872779 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_65946afc398d4a9fb1c9095a4f946e07", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/65946afc398d4a9fb1c9095a4f946e07"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/65946afc398d4a9fb1c9095a4f946e07"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/65946afc398d4a9fb1c9095a4f946e07"}]}] Oct 04 20:59:11.872779 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-ServersNegativeTestJSON-1097186397 Oct 04 20:59:11.872779 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: 65946afc398d4a9fb1c9095a4f946e07 Oct 04 20:59:11.872779 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1097186397 Oct 04 20:59:11.872779 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-ServersNegativeTestJSON-1097186397-project Oct 04 20:59:11.872779 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 20:59:11.872779 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 20:59:11.872779 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: 6513f5e908ac4d028cad6eeeebeab285 Oct 04 20:59:11.872779 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-ServersNegativeTestJSON-1097186397-project Oct 04 20:59:11.872779 n-d-854823-8 devstack@n-api.service[128802]: Oct 04 20:59:11.872779 n-d-854823-8 devstack@n-api.service[128802]: {"reboot": {"type": "SOFT"}} Oct 04 20:59:11.872779 n-d-854823-8 devstack@n-api.service[128802]: method: > Oct 04 20:59:11.872779 n-d-854823-8 devstack@n-api.service[128802]: exception: Instance 368d4aa4-81a1-43af-a69b-e5f7004da740 could not be found. Oct 04 20:59:11.872779 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'id': '368d4aa4-81a1-43af-a69b-e5f7004da740', 'body': {'reboot': {'type': 'SOFT'}}} Oct 04 20:59:11.872779 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:59:11.872779 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:59:11.872779 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:59:11.872779 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:59:11.872779 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:59:11.872779 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:59:11.872779 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:59:11.872779 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:59:11.872779 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:59:11.872779 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:59:11.872779 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 368d4aa4-81a1-43af-a69b-e5f7004da740 could not be found. Oct 04 20:59:11.872779 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:59:11.872779 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:59:11.872779 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:59:11.872779 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:59:11.872779 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:59:11.872779 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:59:11.872779 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:59:11.872779 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:59:11.872779 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:59:11.872779 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:59:11.872779 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:59:11.872779 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:59:11.872779 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Oct 04 20:59:11.872779 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 04 20:59:11.872779 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:59:11.872779 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:59:11.872779 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:59:11.872779 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:59:11.878125 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 368d4aa4-81a1-43af-a69b-e5f7004da740 could not be found. Oct 04 20:59:11.878125 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:59:11.878125 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:59:11.878125 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:59:11.878125 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:59:11.878125 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:59:11.878125 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:59:11.878125 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:59:11.878125 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:59:11.878125 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 368d4aa4-81a1-43af-a69b-e5f7004da740 could not be found. Oct 04 20:59:11.878125 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:59:11.881339 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-24d8992b-3de9-4c5c-8a17-6ccad68372de tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Returning 404 to user: Instance 368d4aa4-81a1-43af-a69b-e5f7004da740 could not be found. {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:59:11.882708 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-24d8992b-3de9-4c5c-8a17-6ccad68372de tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "POST /compute/v2.1/servers/368d4aa4-81a1-43af-a69b-e5f7004da740/action" status: 404 len: 111 microversion: 2.1 time: 0.097036 Oct 04 20:59:11.884192 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2439/4835] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 20:59:11 2022] POST /compute/v2.1/servers/368d4aa4-81a1-43af-a69b-e5f7004da740/action => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:59:11.892303 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-120561d2-5308-4f7f-b65b-41cdd275d573 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:59:11.892914 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-120561d2-5308-4f7f-b65b-41cdd275d573 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] [instance: 320f9a98-969f-473e-bc56-842bbd28dedc] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:59:11.906506 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-120561d2-5308-4f7f-b65b-41cdd275d573 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:11.907010 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-120561d2-5308-4f7f-b65b-41cdd275d573 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:11.907584 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-120561d2-5308-4f7f-b65b-41cdd275d573 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:11.908309 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-120561d2-5308-4f7f-b65b-41cdd275d573 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:11.909549 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-120561d2-5308-4f7f-b65b-41cdd275d573 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:11.912786 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-120561d2-5308-4f7f-b65b-41cdd275d573 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:12.837145 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-68858d35-af8d-4ac4-aadd-7fe77a9bbbd3 tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:59:12.837746 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-68858d35-af8d-4ac4-aadd-7fe77a9bbbd3 tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] [instance: beedbabd-70f0-435a-80ec-497c232a9ee3] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:59:12.854515 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-68858d35-af8d-4ac4-aadd-7fe77a9bbbd3 tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:12.855030 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-68858d35-af8d-4ac4-aadd-7fe77a9bbbd3 tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:12.855473 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-68858d35-af8d-4ac4-aadd-7fe77a9bbbd3 tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:12.856884 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-68858d35-af8d-4ac4-aadd-7fe77a9bbbd3 tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:12.857350 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-68858d35-af8d-4ac4-aadd-7fe77a9bbbd3 tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:12.857869 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-68858d35-af8d-4ac4-aadd-7fe77a9bbbd3 tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:13.394071 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-68858d35-af8d-4ac4-aadd-7fe77a9bbbd3 tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25849c543c84fb7a87a74c11f8d7990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c2d7a7a44e4ea78f2974539bf9a173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:59:13.409599 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-68858d35-af8d-4ac4-aadd-7fe77a9bbbd3 tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] 10.222.0.33 "GET /compute/v2.1/servers/beedbabd-70f0-435a-80ec-497c232a9ee3" status: 200 len: 1282 microversion: 2.1 time: 0.575792 Oct 04 20:59:13.410212 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2440/4836] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:59:12 2022] GET /compute/v2.1/servers/beedbabd-70f0-435a-80ec-497c232a9ee3 => generated 1282 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:59:13.737651 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-120561d2-5308-4f7f-b65b-41cdd275d573 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6513f5e908ac4d028cad6eeeebeab285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65946afc398d4a9fb1c9095a4f946e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:59:13.747226 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-120561d2-5308-4f7f-b65b-41cdd275d573 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc" status: 200 len: 1505 microversion: 2.1 time: 1.858660 Oct 04 20:59:13.751095 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2397/4837] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:59:11 2022] GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc => generated 1505 bytes in 1863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:59:13.779771 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-bad00c4e-60ba-4ec7-95d3-2468678bc096 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:59:13.780649 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-bad00c4e-60ba-4ec7-95d3-2468678bc096 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] [instance: 320f9a98-969f-473e-bc56-842bbd28dedc] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:59:13.787148 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bad00c4e-60ba-4ec7-95d3-2468678bc096 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:13.787913 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bad00c4e-60ba-4ec7-95d3-2468678bc096 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:13.788512 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bad00c4e-60ba-4ec7-95d3-2468678bc096 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:13.790066 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bad00c4e-60ba-4ec7-95d3-2468678bc096 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:13.790726 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bad00c4e-60ba-4ec7-95d3-2468678bc096 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:13.791317 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bad00c4e-60ba-4ec7-95d3-2468678bc096 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:14.247537 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-02df500e-25ab-4d7c-b603-6e5aeeabe801 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerTagsTestJSON-server-1167642233", "imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63", "flavorRef": "452", "networks": [{"uuid": "cc3481fb-4d10-4e11-a90a-a944f6f172e5"}]}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:59:14.289633 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=3 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:59:14.341539 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.network.neutron [None req-02df500e-25ab-4d7c-b603-6e5aeeabe801 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] validate_networks() for [('cc3481fb-4d10-4e11-a90a-a944f6f172e5', None, None, None, None, None)] {{(pid=128801) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:59:14.542225 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-bad00c4e-60ba-4ec7-95d3-2468678bc096 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6513f5e908ac4d028cad6eeeebeab285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65946afc398d4a9fb1c9095a4f946e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:59:14.556155 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-bad00c4e-60ba-4ec7-95d3-2468678bc096 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc" status: 200 len: 1505 microversion: 2.1 time: 0.778594 Oct 04 20:59:14.556964 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2441/4838] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:59:13 2022] GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc => generated 1505 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:59:14.576125 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-8b75ee2d-79c1-4d0e-8641-a98b2547b2cc tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:59:14.577111 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-8b75ee2d-79c1-4d0e-8641-a98b2547b2cc tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] [instance: beedbabd-70f0-435a-80ec-497c232a9ee3] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:59:14.590236 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8b75ee2d-79c1-4d0e-8641-a98b2547b2cc tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:14.595407 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8b75ee2d-79c1-4d0e-8641-a98b2547b2cc tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:14.595988 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8b75ee2d-79c1-4d0e-8641-a98b2547b2cc tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:14.599572 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8b75ee2d-79c1-4d0e-8641-a98b2547b2cc tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:14.602697 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8b75ee2d-79c1-4d0e-8641-a98b2547b2cc tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:14.603391 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8b75ee2d-79c1-4d0e-8641-a98b2547b2cc tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:15.052822 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-8b75ee2d-79c1-4d0e-8641-a98b2547b2cc tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25849c543c84fb7a87a74c11f8d7990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c2d7a7a44e4ea78f2974539bf9a173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:59:15.073438 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-8b75ee2d-79c1-4d0e-8641-a98b2547b2cc tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] 10.222.0.33 "GET /compute/v2.1/servers/beedbabd-70f0-435a-80ec-497c232a9ee3" status: 200 len: 1282 microversion: 2.1 time: 0.508605 Oct 04 20:59:15.074828 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2442/4839] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:59:14 2022] GET /compute/v2.1/servers/beedbabd-70f0-435a-80ec-497c232a9ee3 => generated 1282 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:59:15.090789 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-ca43e91c-4fc8-496f-aec2-5b2ef061b4a1 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:59:15.102047 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-ca43e91c-4fc8-496f-aec2-5b2ef061b4a1 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] [instance: a9b8d3f2-c8d5-4cdb-93cd-e5c6a222659e] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:59:15.120562 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.wsgi [None req-ca43e91c-4fc8-496f-aec2-5b2ef061b4a1 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] HTTP exception thrown: Instance a9b8d3f2-c8d5-4cdb-93cd-e5c6a222659e could not be found. Oct 04 20:59:15.123027 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-ca43e91c-4fc8-496f-aec2-5b2ef061b4a1 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Request method failure captured: Oct 04 20:59:15.123027 n-d-854823-8 devstack@n-api.service[128802]: request: POST /compute/v2.1/servers/a9b8d3f2-c8d5-4cdb-93cd-e5c6a222659e/action HTTP/1.1 Oct 04 20:59:15.123027 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 20:59:15.123027 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 20:59:15.123027 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 20:59:15.123027 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 28 Oct 04 20:59:15.123027 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 20:59:15.123027 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 20:59:15.123027 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 20:59:15.123027 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 20:59:15.123027 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPJ4eaBM_FLl2jaN3nQraRbM94DgE-qlLjkCPNJ1Ol7VvkbIGIp-m_lAuwAay2VJ7lXD5niLtaDpJGDoHOJTljuI2aLuReHvX6jQr-uTgC01ZM2s7p6j6gq6a-1PaGQN0mcmcJntCqSnEEt5MEM6DdrOOdi5eEtsfyNU4EpDYmca-Ylo Oct 04 20:59:15.123027 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 20:59:15.123027 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 20:59:15.123027 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 20:59:15.123027 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 20:59:15.123027 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 20:59:15.123027 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 20:59:15.123027 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: 65946afc398d4a9fb1c9095a4f946e07 Oct 04 20:59:15.123027 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-ServersNegativeTestJSON-1097186397 Oct 04 20:59:15.123027 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 20:59:15.123027 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 20:59:15.123027 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_65946afc398d4a9fb1c9095a4f946e07", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/65946afc398d4a9fb1c9095a4f946e07"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/65946afc398d4a9fb1c9095a4f946e07"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/65946afc398d4a9fb1c9095a4f946e07"}]}] Oct 04 20:59:15.123027 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-ServersNegativeTestJSON-1097186397 Oct 04 20:59:15.123027 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: 65946afc398d4a9fb1c9095a4f946e07 Oct 04 20:59:15.123027 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1097186397 Oct 04 20:59:15.123027 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-ServersNegativeTestJSON-1097186397-project Oct 04 20:59:15.123027 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 20:59:15.123027 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 20:59:15.123027 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: 6513f5e908ac4d028cad6eeeebeab285 Oct 04 20:59:15.123027 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-ServersNegativeTestJSON-1097186397-project Oct 04 20:59:15.123027 n-d-854823-8 devstack@n-api.service[128802]: Oct 04 20:59:15.123027 n-d-854823-8 devstack@n-api.service[128802]: {"reboot": {"type": "SOFT"}} Oct 04 20:59:15.123027 n-d-854823-8 devstack@n-api.service[128802]: method: > Oct 04 20:59:15.123027 n-d-854823-8 devstack@n-api.service[128802]: exception: Instance a9b8d3f2-c8d5-4cdb-93cd-e5c6a222659e could not be found. Oct 04 20:59:15.123027 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'id': 'a9b8d3f2-c8d5-4cdb-93cd-e5c6a222659e', 'body': {'reboot': {'type': 'SOFT'}}} Oct 04 20:59:15.123027 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:59:15.123027 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:59:15.123027 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:59:15.123027 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:59:15.123027 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:59:15.123027 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:59:15.123027 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 20:59:15.123027 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 20:59:15.123027 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a9b8d3f2-c8d5-4cdb-93cd-e5c6a222659e could not be found. Oct 04 20:59:15.123027 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:59:15.123027 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:59:15.123027 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:59:15.123027 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:59:15.123027 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:59:15.123027 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:59:15.123027 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:59:15.123027 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:59:15.123027 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:59:15.123027 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:59:15.123027 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:59:15.123027 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:59:15.123027 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Oct 04 20:59:15.123027 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 04 20:59:15.123027 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:59:15.123027 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:59:15.123027 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:59:15.123027 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:59:15.123027 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a9b8d3f2-c8d5-4cdb-93cd-e5c6a222659e could not be found. Oct 04 20:59:15.123027 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:59:15.128410 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:59:15.128410 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:59:15.128410 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:59:15.128410 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:59:15.128410 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:59:15.128410 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:59:15.128410 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:59:15.128410 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a9b8d3f2-c8d5-4cdb-93cd-e5c6a222659e could not be found. Oct 04 20:59:15.128410 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:59:15.128410 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-ca43e91c-4fc8-496f-aec2-5b2ef061b4a1 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Returning 404 to user: Instance a9b8d3f2-c8d5-4cdb-93cd-e5c6a222659e could not be found. {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:59:15.129474 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-ca43e91c-4fc8-496f-aec2-5b2ef061b4a1 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "POST /compute/v2.1/servers/a9b8d3f2-c8d5-4cdb-93cd-e5c6a222659e/action" status: 404 len: 111 microversion: 2.1 time: 0.050153 Oct 04 20:59:15.135667 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2443/4840] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 20:59:15 2022] POST /compute/v2.1/servers/a9b8d3f2-c8d5-4cdb-93cd-e5c6a222659e/action => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:59:15.148567 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-d89eaad2-80a4-4de1-913d-13ab2298a81f tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:59:15.149188 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-d89eaad2-80a4-4de1-913d-13ab2298a81f tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] [instance: 320f9a98-969f-473e-bc56-842bbd28dedc] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:59:15.185649 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d89eaad2-80a4-4de1-913d-13ab2298a81f tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:15.186159 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d89eaad2-80a4-4de1-913d-13ab2298a81f tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:15.186627 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d89eaad2-80a4-4de1-913d-13ab2298a81f tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:15.187639 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d89eaad2-80a4-4de1-913d-13ab2298a81f tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:15.188952 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d89eaad2-80a4-4de1-913d-13ab2298a81f tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:15.189387 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d89eaad2-80a4-4de1-913d-13ab2298a81f tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:16.077597 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-02df500e-25ab-4d7c-b603-6e5aeeabe801 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Flavor limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:59:16.078884 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-02df500e-25ab-4d7c-b603-6e5aeeabe801 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Image limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:59:16.080666 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-02df500e-25ab-4d7c-b603-6e5aeeabe801 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Flavor pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:59:16.082384 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-02df500e-25ab-4d7c-b603-6e5aeeabe801 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Image pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:59:16.083514 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-02df500e-25ab-4d7c-b603-6e5aeeabe801 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:59:16.105256 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-02df500e-25ab-4d7c-b603-6e5aeeabe801 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:16.106076 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-02df500e-25ab-4d7c-b603-6e5aeeabe801 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:16.106726 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-02df500e-25ab-4d7c-b603-6e5aeeabe801 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:16.107901 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-02df500e-25ab-4d7c-b603-6e5aeeabe801 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:16.109164 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-02df500e-25ab-4d7c-b603-6e5aeeabe801 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:16.110641 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-02df500e-25ab-4d7c-b603-6e5aeeabe801 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:16.140918 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-02df500e-25ab-4d7c-b603-6e5aeeabe801 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Getting quotas for project 2e56c6049d5741418d193fd496cbb5d9. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:59:16.149306 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-02df500e-25ab-4d7c-b603-6e5aeeabe801 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Getting quotas for user 4cb9d89574d941ea9c8ca7b2b8d11f35 and project 2e56c6049d5741418d193fd496cbb5d9. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:59:16.167274 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-02df500e-25ab-4d7c-b603-6e5aeeabe801 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Going to run 1 instances... {{(pid=128801) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:59:16.170267 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-02df500e-25ab-4d7c-b603-6e5aeeabe801 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] [instance: 6c1e8070-fc54-4d28-90a9-1241c03b9b95] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='15b24725-0c99-4bcf-b1fb-907cdf8e2d63',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128801) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:59:16.294001 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-02df500e-25ab-4d7c-b603-6e5aeeabe801 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.26 time: 2.292082 Oct 04 20:59:16.296595 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2398/4841] 10.222.0.33 () {62 vars in 1188 bytes} [Tue Oct 4 20:59:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 2295 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 04 20:59:16.308921 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-de2bdc99-7385-4552-9778-b0ff5725e918 tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:59:16.313417 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-de2bdc99-7385-4552-9778-b0ff5725e918 tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] [instance: beedbabd-70f0-435a-80ec-497c232a9ee3] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:59:16.329303 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-de2bdc99-7385-4552-9778-b0ff5725e918 tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:16.329467 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-de2bdc99-7385-4552-9778-b0ff5725e918 tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:16.329883 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-de2bdc99-7385-4552-9778-b0ff5725e918 tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:16.332213 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-de2bdc99-7385-4552-9778-b0ff5725e918 tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:16.333329 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-de2bdc99-7385-4552-9778-b0ff5725e918 tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:16.335229 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-de2bdc99-7385-4552-9778-b0ff5725e918 tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:16.497725 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-d89eaad2-80a4-4de1-913d-13ab2298a81f tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6513f5e908ac4d028cad6eeeebeab285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65946afc398d4a9fb1c9095a4f946e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:59:16.514272 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-d89eaad2-80a4-4de1-913d-13ab2298a81f tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc" status: 200 len: 1505 microversion: 2.1 time: 1.373997 Oct 04 20:59:16.515075 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2444/4842] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:59:15 2022] GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc => generated 1505 bytes in 1379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:59:16.559958 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-5b8102a0-9759-49b5-a4ea-763a08ab51f8 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:59:16.563522 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-5b8102a0-9759-49b5-a4ea-763a08ab51f8 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] [instance: 6c1e8070-fc54-4d28-90a9-1241c03b9b95] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:59:17.485300 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-5b8102a0-9759-49b5-a4ea-763a08ab51f8 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb9d89574d941ea9c8ca7b2b8d11f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e56c6049d5741418d193fd496cbb5d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:59:17.506268 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-5b8102a0-9759-49b5-a4ea-763a08ab51f8 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb9d89574d941ea9c8ca7b2b8d11f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e56c6049d5741418d193fd496cbb5d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:59:17.507757 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-5b8102a0-9759-49b5-a4ea-763a08ab51f8 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb9d89574d941ea9c8ca7b2b8d11f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e56c6049d5741418d193fd496cbb5d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:59:17.513923 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-5b8102a0-9759-49b5-a4ea-763a08ab51f8 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] 10.222.0.33 "GET /compute/v2.1/servers/6c1e8070-fc54-4d28-90a9-1241c03b9b95" status: 200 len: 1262 microversion: 2.26 time: 0.997193 Oct 04 20:59:17.514576 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2445/4843] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:59:16 2022] GET /compute/v2.1/servers/6c1e8070-fc54-4d28-90a9-1241c03b9b95 => generated 1262 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:59:17.530900 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-2894569d-c797-4373-b3ad-d5912f081a71 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:59:17.531786 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-2894569d-c797-4373-b3ad-d5912f081a71 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] [instance: 320f9a98-969f-473e-bc56-842bbd28dedc] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:59:17.551247 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2894569d-c797-4373-b3ad-d5912f081a71 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:17.552031 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2894569d-c797-4373-b3ad-d5912f081a71 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:17.553777 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2894569d-c797-4373-b3ad-d5912f081a71 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:17.556519 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2894569d-c797-4373-b3ad-d5912f081a71 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:17.559834 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2894569d-c797-4373-b3ad-d5912f081a71 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:17.561706 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2894569d-c797-4373-b3ad-d5912f081a71 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:18.064027 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-de2bdc99-7385-4552-9778-b0ff5725e918 tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25849c543c84fb7a87a74c11f8d7990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c2d7a7a44e4ea78f2974539bf9a173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:59:18.078053 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-de2bdc99-7385-4552-9778-b0ff5725e918 tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] 10.222.0.33 "GET /compute/v2.1/servers/beedbabd-70f0-435a-80ec-497c232a9ee3" status: 200 len: 1324 microversion: 2.1 time: 1.779516 Oct 04 20:59:18.078681 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2399/4844] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:59:16 2022] GET /compute/v2.1/servers/beedbabd-70f0-435a-80ec-497c232a9ee3 => generated 1324 bytes in 1781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:59:18.544862 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7722ccb9-d32f-49f8-ba6d-104db0b7a7c7 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:59:18.545744 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-7722ccb9-d32f-49f8-ba6d-104db0b7a7c7 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] [instance: 6c1e8070-fc54-4d28-90a9-1241c03b9b95] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:59:18.559846 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7722ccb9-d32f-49f8-ba6d-104db0b7a7c7 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:18.560820 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7722ccb9-d32f-49f8-ba6d-104db0b7a7c7 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:18.561445 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7722ccb9-d32f-49f8-ba6d-104db0b7a7c7 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:18.567434 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7722ccb9-d32f-49f8-ba6d-104db0b7a7c7 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:18.568227 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7722ccb9-d32f-49f8-ba6d-104db0b7a7c7 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:18.568820 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7722ccb9-d32f-49f8-ba6d-104db0b7a7c7 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:19.073038 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-7722ccb9-d32f-49f8-ba6d-104db0b7a7c7 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb9d89574d941ea9c8ca7b2b8d11f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e56c6049d5741418d193fd496cbb5d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:59:19.091445 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-7722ccb9-d32f-49f8-ba6d-104db0b7a7c7 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb9d89574d941ea9c8ca7b2b8d11f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e56c6049d5741418d193fd496cbb5d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:59:19.099948 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-7722ccb9-d32f-49f8-ba6d-104db0b7a7c7 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb9d89574d941ea9c8ca7b2b8d11f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e56c6049d5741418d193fd496cbb5d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:59:19.104956 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-7722ccb9-d32f-49f8-ba6d-104db0b7a7c7 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] 10.222.0.33 "GET /compute/v2.1/servers/6c1e8070-fc54-4d28-90a9-1241c03b9b95" status: 200 len: 1314 microversion: 2.26 time: 0.563822 Oct 04 20:59:19.105678 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2400/4845] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:59:18 2022] GET /compute/v2.1/servers/6c1e8070-fc54-4d28-90a9-1241c03b9b95 => generated 1314 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 20:59:19.123442 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-812d0737-de20-462e-b26d-d7dc5270f96c tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:59:19.129167 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-812d0737-de20-462e-b26d-d7dc5270f96c tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] [instance: beedbabd-70f0-435a-80ec-497c232a9ee3] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:59:19.158485 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-812d0737-de20-462e-b26d-d7dc5270f96c tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:19.159896 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-812d0737-de20-462e-b26d-d7dc5270f96c tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:19.160365 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-812d0737-de20-462e-b26d-d7dc5270f96c tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:19.161099 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-812d0737-de20-462e-b26d-d7dc5270f96c tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:19.161560 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-812d0737-de20-462e-b26d-d7dc5270f96c tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:19.162052 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-812d0737-de20-462e-b26d-d7dc5270f96c tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:19.520393 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-2894569d-c797-4373-b3ad-d5912f081a71 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6513f5e908ac4d028cad6eeeebeab285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65946afc398d4a9fb1c9095a4f946e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:59:19.553831 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-2894569d-c797-4373-b3ad-d5912f081a71 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc" status: 200 len: 1505 microversion: 2.1 time: 2.028855 Oct 04 20:59:19.557541 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2446/4846] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:59:17 2022] GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc => generated 1505 bytes in 2039 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:59:19.586192 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-a14c0ed8-9df0-48b3-b314-52bdc21ce603 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63"}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:59:19.589887 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-a14c0ed8-9df0-48b3-b314-52bdc21ce603 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] [instance: 368d4aa4-81a1-43af-a69b-e5f7004da740] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:59:19.604609 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:59:19.610324 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a14c0ed8-9df0-48b3-b314-52bdc21ce603 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:19.611416 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a14c0ed8-9df0-48b3-b314-52bdc21ce603 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:19.614702 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a14c0ed8-9df0-48b3-b314-52bdc21ce603 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:19.615766 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a14c0ed8-9df0-48b3-b314-52bdc21ce603 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:19.617976 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a14c0ed8-9df0-48b3-b314-52bdc21ce603 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:19.621814 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a14c0ed8-9df0-48b3-b314-52bdc21ce603 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:19.668795 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.wsgi [None req-a14c0ed8-9df0-48b3-b314-52bdc21ce603 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] HTTP exception thrown: Instance 368d4aa4-81a1-43af-a69b-e5f7004da740 could not be found. Oct 04 20:59:19.676996 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-a14c0ed8-9df0-48b3-b314-52bdc21ce603 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Request method failure captured: Oct 04 20:59:19.676996 n-d-854823-8 devstack@n-api.service[128802]: request: POST /compute/v2.1/servers/368d4aa4-81a1-43af-a69b-e5f7004da740/action HTTP/1.1 Oct 04 20:59:19.676996 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 20:59:19.676996 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 20:59:19.676996 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 20:59:19.676996 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 65 Oct 04 20:59:19.676996 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 20:59:19.676996 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 20:59:19.676996 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 20:59:19.676996 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 20:59:19.676996 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPJ4eaBM_FLl2jaN3nQraRbM94DgE-qlLjkCPNJ1Ol7VvkbIGIp-m_lAuwAay2VJ7lXD5niLtaDpJGDoHOJTljuI2aLuReHvX6jQr-uTgC01ZM2s7p6j6gq6a-1PaGQN0mcmcJntCqSnEEt5MEM6DdrOOdi5eEtsfyNU4EpDYmca-Ylo Oct 04 20:59:19.676996 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 20:59:19.676996 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 20:59:19.676996 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 20:59:19.676996 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 20:59:19.676996 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 20:59:19.676996 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 20:59:19.676996 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: 65946afc398d4a9fb1c9095a4f946e07 Oct 04 20:59:19.676996 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-ServersNegativeTestJSON-1097186397 Oct 04 20:59:19.676996 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 20:59:19.676996 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 20:59:19.676996 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_65946afc398d4a9fb1c9095a4f946e07", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/65946afc398d4a9fb1c9095a4f946e07"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/65946afc398d4a9fb1c9095a4f946e07"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/65946afc398d4a9fb1c9095a4f946e07"}]}] Oct 04 20:59:19.676996 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-ServersNegativeTestJSON-1097186397 Oct 04 20:59:19.676996 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: 65946afc398d4a9fb1c9095a4f946e07 Oct 04 20:59:19.676996 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1097186397 Oct 04 20:59:19.676996 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-ServersNegativeTestJSON-1097186397-project Oct 04 20:59:19.676996 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 20:59:19.676996 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 20:59:19.676996 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: 6513f5e908ac4d028cad6eeeebeab285 Oct 04 20:59:19.676996 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-ServersNegativeTestJSON-1097186397-project Oct 04 20:59:19.676996 n-d-854823-8 devstack@n-api.service[128802]: Oct 04 20:59:19.676996 n-d-854823-8 devstack@n-api.service[128802]: {"rebuild": {"imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63"}} Oct 04 20:59:19.676996 n-d-854823-8 devstack@n-api.service[128802]: method: > Oct 04 20:59:19.676996 n-d-854823-8 devstack@n-api.service[128802]: exception: Instance 368d4aa4-81a1-43af-a69b-e5f7004da740 could not be found. Oct 04 20:59:19.676996 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'id': '368d4aa4-81a1-43af-a69b-e5f7004da740', 'body': {'rebuild': {'imageRef': '15b24725-0c99-4bcf-b1fb-907cdf8e2d63'}}} Oct 04 20:59:19.676996 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:59:19.676996 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:59:19.676996 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:59:19.676996 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:59:19.676996 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:59:19.676996 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:59:19.676996 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:59:19.676996 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:59:19.676996 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:59:19.676996 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:59:19.676996 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 368d4aa4-81a1-43af-a69b-e5f7004da740 could not be found. Oct 04 20:59:19.676996 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:59:19.676996 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:59:19.676996 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:59:19.676996 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:59:19.676996 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:59:19.676996 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:59:19.676996 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:59:19.676996 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:59:19.676996 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:59:19.676996 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:59:19.676996 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:59:19.676996 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:59:19.676996 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:59:19.676996 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:59:19.676996 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:59:19.676996 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:59:19.676996 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Oct 04 20:59:19.676996 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Oct 04 20:59:19.681733 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 04 20:59:19.681733 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:59:19.681733 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:59:19.681733 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:59:19.681733 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:59:19.681733 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 368d4aa4-81a1-43af-a69b-e5f7004da740 could not be found. Oct 04 20:59:19.681733 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:59:19.681733 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:59:19.681733 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:59:19.681733 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:59:19.681733 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:59:19.681733 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:59:19.681733 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:59:19.681733 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:59:19.681733 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 368d4aa4-81a1-43af-a69b-e5f7004da740 could not be found. Oct 04 20:59:19.681733 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:59:19.686012 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-a14c0ed8-9df0-48b3-b314-52bdc21ce603 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Returning 404 to user: Instance 368d4aa4-81a1-43af-a69b-e5f7004da740 could not be found. {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:59:19.690764 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-a14c0ed8-9df0-48b3-b314-52bdc21ce603 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "POST /compute/v2.1/servers/368d4aa4-81a1-43af-a69b-e5f7004da740/action" status: 404 len: 111 microversion: 2.1 time: 0.107476 Oct 04 20:59:19.692681 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2447/4847] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 20:59:19 2022] POST /compute/v2.1/servers/368d4aa4-81a1-43af-a69b-e5f7004da740/action => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 20:59:19.704150 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-26cbd6d3-1f1f-48a9-a85c-e0b45a966add tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:59:19.707921 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-26cbd6d3-1f1f-48a9-a85c-e0b45a966add tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] [instance: 320f9a98-969f-473e-bc56-842bbd28dedc] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:59:19.723791 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-26cbd6d3-1f1f-48a9-a85c-e0b45a966add tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:19.724526 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-26cbd6d3-1f1f-48a9-a85c-e0b45a966add tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:19.725143 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-26cbd6d3-1f1f-48a9-a85c-e0b45a966add tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:19.726221 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-26cbd6d3-1f1f-48a9-a85c-e0b45a966add tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:19.727359 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-26cbd6d3-1f1f-48a9-a85c-e0b45a966add tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:19.742273 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-26cbd6d3-1f1f-48a9-a85c-e0b45a966add tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:20.454869 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-812d0737-de20-462e-b26d-d7dc5270f96c tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25849c543c84fb7a87a74c11f8d7990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c2d7a7a44e4ea78f2974539bf9a173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:59:20.468762 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-812d0737-de20-462e-b26d-d7dc5270f96c tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] 10.222.0.33 "GET /compute/v2.1/servers/beedbabd-70f0-435a-80ec-497c232a9ee3" status: 200 len: 1324 microversion: 2.1 time: 1.359660 Oct 04 20:59:20.469761 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2401/4848] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:59:19 2022] GET /compute/v2.1/servers/beedbabd-70f0-435a-80ec-497c232a9ee3 => generated 1324 bytes in 1361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:59:20.475512 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-17a17c0c-9b8d-45b0-92e7-86eb52c2db8b tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:59:20.476129 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-17a17c0c-9b8d-45b0-92e7-86eb52c2db8b tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] [instance: 6c1e8070-fc54-4d28-90a9-1241c03b9b95] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:59:20.497619 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-17a17c0c-9b8d-45b0-92e7-86eb52c2db8b tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:20.498452 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-17a17c0c-9b8d-45b0-92e7-86eb52c2db8b tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:20.498902 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-17a17c0c-9b8d-45b0-92e7-86eb52c2db8b tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:20.499797 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-17a17c0c-9b8d-45b0-92e7-86eb52c2db8b tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:20.500262 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-17a17c0c-9b8d-45b0-92e7-86eb52c2db8b tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:20.500690 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-17a17c0c-9b8d-45b0-92e7-86eb52c2db8b tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:20.583311 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-26cbd6d3-1f1f-48a9-a85c-e0b45a966add tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6513f5e908ac4d028cad6eeeebeab285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65946afc398d4a9fb1c9095a4f946e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:59:20.592694 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-26cbd6d3-1f1f-48a9-a85c-e0b45a966add tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc" status: 200 len: 1505 microversion: 2.1 time: 0.895527 Oct 04 20:59:20.599885 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2448/4849] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:59:19 2022] GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc => generated 1505 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:59:20.631648 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-40427279-6565-47d8-9f3a-274d0e825305 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:59:20.632824 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-40427279-6565-47d8-9f3a-274d0e825305 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] [instance: 320f9a98-969f-473e-bc56-842bbd28dedc] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:59:20.653302 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-40427279-6565-47d8-9f3a-274d0e825305 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:20.653812 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-40427279-6565-47d8-9f3a-274d0e825305 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:20.654256 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-40427279-6565-47d8-9f3a-274d0e825305 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:20.655019 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-40427279-6565-47d8-9f3a-274d0e825305 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:20.655482 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-40427279-6565-47d8-9f3a-274d0e825305 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:20.655916 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-40427279-6565-47d8-9f3a-274d0e825305 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:20.783462 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-17a17c0c-9b8d-45b0-92e7-86eb52c2db8b tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb9d89574d941ea9c8ca7b2b8d11f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e56c6049d5741418d193fd496cbb5d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:59:20.807604 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-17a17c0c-9b8d-45b0-92e7-86eb52c2db8b tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb9d89574d941ea9c8ca7b2b8d11f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e56c6049d5741418d193fd496cbb5d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:59:20.812157 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-17a17c0c-9b8d-45b0-92e7-86eb52c2db8b tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb9d89574d941ea9c8ca7b2b8d11f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e56c6049d5741418d193fd496cbb5d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:59:20.813435 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-17a17c0c-9b8d-45b0-92e7-86eb52c2db8b tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] 10.222.0.33 "GET /compute/v2.1/servers/6c1e8070-fc54-4d28-90a9-1241c03b9b95" status: 200 len: 1320 microversion: 2.26 time: 0.342597 Oct 04 20:59:20.817324 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2402/4850] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:59:20 2022] GET /compute/v2.1/servers/6c1e8070-fc54-4d28-90a9-1241c03b9b95 => generated 1320 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:59:21.107078 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-40427279-6565-47d8-9f3a-274d0e825305 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6513f5e908ac4d028cad6eeeebeab285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65946afc398d4a9fb1c9095a4f946e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:59:21.134280 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-40427279-6565-47d8-9f3a-274d0e825305 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc" status: 200 len: 1505 microversion: 2.1 time: 0.508672 Oct 04 20:59:21.141523 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2449/4851] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:59:20 2022] GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc => generated 1505 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:59:21.165728 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c3b2f9c5-5490-460b-9ff2-69aa05aa685b tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:59:21.169158 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c3b2f9c5-5490-460b-9ff2-69aa05aa685b tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] [instance: c1956c29-3878-4dd3-8354-633cd370bcdf] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:59:21.185093 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-c3b2f9c5-5490-460b-9ff2-69aa05aa685b tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] HTTP exception thrown: Instance c1956c29-3878-4dd3-8354-633cd370bcdf could not be found. Oct 04 20:59:21.191687 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c3b2f9c5-5490-460b-9ff2-69aa05aa685b tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Request method failure captured: Oct 04 20:59:21.191687 n-d-854823-8 devstack@n-api.service[128801]: request: POST /compute/v2.1/servers/c1956c29-3878-4dd3-8354-633cd370bcdf/action HTTP/1.1 Oct 04 20:59:21.191687 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:59:21.191687 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:59:21.191687 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:59:21.191687 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 65 Oct 04 20:59:21.191687 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:59:21.191687 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:59:21.191687 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:59:21.191687 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:59:21.191687 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJ4eaBM_FLl2jaN3nQraRbM94DgE-qlLjkCPNJ1Ol7VvkbIGIp-m_lAuwAay2VJ7lXD5niLtaDpJGDoHOJTljuI2aLuReHvX6jQr-uTgC01ZM2s7p6j6gq6a-1PaGQN0mcmcJntCqSnEEt5MEM6DdrOOdi5eEtsfyNU4EpDYmca-Ylo Oct 04 20:59:21.191687 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:59:21.191687 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:59:21.191687 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:59:21.191687 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:59:21.191687 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:59:21.191687 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:59:21.191687 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: 65946afc398d4a9fb1c9095a4f946e07 Oct 04 20:59:21.191687 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-ServersNegativeTestJSON-1097186397 Oct 04 20:59:21.191687 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 20:59:21.191687 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 20:59:21.191687 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_65946afc398d4a9fb1c9095a4f946e07", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/65946afc398d4a9fb1c9095a4f946e07"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/65946afc398d4a9fb1c9095a4f946e07"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/65946afc398d4a9fb1c9095a4f946e07"}]}] Oct 04 20:59:21.191687 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-ServersNegativeTestJSON-1097186397 Oct 04 20:59:21.191687 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: 65946afc398d4a9fb1c9095a4f946e07 Oct 04 20:59:21.191687 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1097186397 Oct 04 20:59:21.191687 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-ServersNegativeTestJSON-1097186397-project Oct 04 20:59:21.191687 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:59:21.191687 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:59:21.191687 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: 6513f5e908ac4d028cad6eeeebeab285 Oct 04 20:59:21.191687 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-ServersNegativeTestJSON-1097186397-project Oct 04 20:59:21.191687 n-d-854823-8 devstack@n-api.service[128801]: Oct 04 20:59:21.191687 n-d-854823-8 devstack@n-api.service[128801]: {"rebuild": {"imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63"}} Oct 04 20:59:21.191687 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 20:59:21.191687 n-d-854823-8 devstack@n-api.service[128801]: exception: Instance c1956c29-3878-4dd3-8354-633cd370bcdf could not be found. Oct 04 20:59:21.191687 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': 'c1956c29-3878-4dd3-8354-633cd370bcdf', 'body': {'rebuild': {'imageRef': '15b24725-0c99-4bcf-b1fb-907cdf8e2d63'}}} Oct 04 20:59:21.191687 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:59:21.191687 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:59:21.191687 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:59:21.191687 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:59:21.191687 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:59:21.191687 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:59:21.191687 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 20:59:21.191687 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 20:59:21.191687 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c1956c29-3878-4dd3-8354-633cd370bcdf could not be found. Oct 04 20:59:21.191687 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:59:21.191687 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:59:21.191687 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:59:21.191687 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:59:21.191687 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:59:21.191687 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:59:21.191687 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:59:21.191687 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:59:21.191687 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:59:21.191687 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:59:21.191687 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:59:21.191687 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:59:21.191687 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:59:21.191687 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:59:21.191687 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:59:21.191687 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:59:21.191687 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Oct 04 20:59:21.191687 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Oct 04 20:59:21.191687 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 04 20:59:21.191687 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:59:21.199717 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:59:21.199717 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:59:21.199717 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:59:21.199717 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c1956c29-3878-4dd3-8354-633cd370bcdf could not be found. Oct 04 20:59:21.199717 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:59:21.199717 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:59:21.199717 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:59:21.199717 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:59:21.199717 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:59:21.199717 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:59:21.199717 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:59:21.199717 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:59:21.199717 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c1956c29-3878-4dd3-8354-633cd370bcdf could not be found. Oct 04 20:59:21.199717 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:59:21.199717 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c3b2f9c5-5490-460b-9ff2-69aa05aa685b tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Returning 404 to user: Instance c1956c29-3878-4dd3-8354-633cd370bcdf could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:59:21.199717 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c3b2f9c5-5490-460b-9ff2-69aa05aa685b tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "POST /compute/v2.1/servers/c1956c29-3878-4dd3-8354-633cd370bcdf/action" status: 404 len: 111 microversion: 2.1 time: 0.032495 Oct 04 20:59:21.199717 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2403/4852] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 20:59:21 2022] POST /compute/v2.1/servers/c1956c29-3878-4dd3-8354-633cd370bcdf/action => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:59:21.203423 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-7d4bdbb4-4270-4f54-bd39-58ec3f32ea54 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:59:21.204121 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-7d4bdbb4-4270-4f54-bd39-58ec3f32ea54 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] [instance: 320f9a98-969f-473e-bc56-842bbd28dedc] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:59:21.216114 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7d4bdbb4-4270-4f54-bd39-58ec3f32ea54 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:21.219113 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7d4bdbb4-4270-4f54-bd39-58ec3f32ea54 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:21.220764 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7d4bdbb4-4270-4f54-bd39-58ec3f32ea54 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:21.223585 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7d4bdbb4-4270-4f54-bd39-58ec3f32ea54 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:21.225426 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7d4bdbb4-4270-4f54-bd39-58ec3f32ea54 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:21.226054 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7d4bdbb4-4270-4f54-bd39-58ec3f32ea54 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:21.498862 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8ebc2b05-8d65-4cbb-9a00-197b6180737c tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:59:21.499705 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-8ebc2b05-8d65-4cbb-9a00-197b6180737c tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] [instance: beedbabd-70f0-435a-80ec-497c232a9ee3] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:59:21.513795 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8ebc2b05-8d65-4cbb-9a00-197b6180737c tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:21.516449 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8ebc2b05-8d65-4cbb-9a00-197b6180737c tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:21.519404 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8ebc2b05-8d65-4cbb-9a00-197b6180737c tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:21.520547 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8ebc2b05-8d65-4cbb-9a00-197b6180737c tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:21.521295 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8ebc2b05-8d65-4cbb-9a00-197b6180737c tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:21.523643 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8ebc2b05-8d65-4cbb-9a00-197b6180737c tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:22.105830 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-7d4bdbb4-4270-4f54-bd39-58ec3f32ea54 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6513f5e908ac4d028cad6eeeebeab285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65946afc398d4a9fb1c9095a4f946e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:59:22.117170 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-7d4bdbb4-4270-4f54-bd39-58ec3f32ea54 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc" status: 200 len: 1505 microversion: 2.1 time: 0.918563 Oct 04 20:59:22.145956 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2450/4853] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:59:21 2022] GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc => generated 1505 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:59:22.156376 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-879049d4-df44-4ede-abca-970cf9b24500 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:59:22.157064 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-879049d4-df44-4ede-abca-970cf9b24500 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] [instance: 6c1e8070-fc54-4d28-90a9-1241c03b9b95] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:59:22.193319 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-879049d4-df44-4ede-abca-970cf9b24500 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:22.193997 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-879049d4-df44-4ede-abca-970cf9b24500 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:22.194508 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-879049d4-df44-4ede-abca-970cf9b24500 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:22.199563 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-879049d4-df44-4ede-abca-970cf9b24500 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:22.200394 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-879049d4-df44-4ede-abca-970cf9b24500 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:22.203846 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-879049d4-df44-4ede-abca-970cf9b24500 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:22.891153 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-8ebc2b05-8d65-4cbb-9a00-197b6180737c tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25849c543c84fb7a87a74c11f8d7990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c2d7a7a44e4ea78f2974539bf9a173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:59:22.905382 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-8ebc2b05-8d65-4cbb-9a00-197b6180737c tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] 10.222.0.33 "GET /compute/v2.1/servers/beedbabd-70f0-435a-80ec-497c232a9ee3" status: 200 len: 1324 microversion: 2.1 time: 1.413132 Oct 04 20:59:22.918386 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2404/4854] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:59:21 2022] GET /compute/v2.1/servers/beedbabd-70f0-435a-80ec-497c232a9ee3 => generated 1324 bytes in 1418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:59:22.930495 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-d017d2f7-062d-48d3-9c6d-e2d03b019203 req-04c484e8-4777-4557-8691-551492343da9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "beedbabd-70f0-435a-80ec-497c232a9ee3", "tag": "471eb78e-97c1-4391-bb60-0c27d96466eb"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:59:22.968562 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-d017d2f7-062d-48d3-9c6d-e2d03b019203 req-04c484e8-4777-4557-8691-551492343da9 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:22.970862 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-d017d2f7-062d-48d3-9c6d-e2d03b019203 req-04c484e8-4777-4557-8691-551492343da9 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:22.971348 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-d017d2f7-062d-48d3-9c6d-e2d03b019203 req-04c484e8-4777-4557-8691-551492343da9 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:22.995777 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-d017d2f7-062d-48d3-9c6d-e2d03b019203 req-04c484e8-4777-4557-8691-551492343da9 service nova] Creating event network-changed:471eb78e-97c1-4391-bb60-0c27d96466eb for instance beedbabd-70f0-435a-80ec-497c232a9ee3 on n-h2-854823-8 Oct 04 20:59:23.005587 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-d017d2f7-062d-48d3-9c6d-e2d03b019203 req-04c484e8-4777-4557-8691-551492343da9 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092199 Oct 04 20:59:23.007762 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2405/4855] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:59:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:59:23.028326 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-efb4cba2-6f4e-4b7d-9e89-e08d1754af58 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:59:23.029234 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-efb4cba2-6f4e-4b7d-9e89-e08d1754af58 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] [instance: 320f9a98-969f-473e-bc56-842bbd28dedc] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:59:23.042105 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-efb4cba2-6f4e-4b7d-9e89-e08d1754af58 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:23.043910 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-efb4cba2-6f4e-4b7d-9e89-e08d1754af58 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:23.045093 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-efb4cba2-6f4e-4b7d-9e89-e08d1754af58 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:23.062191 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-efb4cba2-6f4e-4b7d-9e89-e08d1754af58 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:23.062994 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-efb4cba2-6f4e-4b7d-9e89-e08d1754af58 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:23.063462 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-efb4cba2-6f4e-4b7d-9e89-e08d1754af58 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:23.295984 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-879049d4-df44-4ede-abca-970cf9b24500 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb9d89574d941ea9c8ca7b2b8d11f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e56c6049d5741418d193fd496cbb5d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:59:23.304815 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-879049d4-df44-4ede-abca-970cf9b24500 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb9d89574d941ea9c8ca7b2b8d11f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e56c6049d5741418d193fd496cbb5d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:59:23.310995 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-879049d4-df44-4ede-abca-970cf9b24500 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb9d89574d941ea9c8ca7b2b8d11f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e56c6049d5741418d193fd496cbb5d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:59:23.320899 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-879049d4-df44-4ede-abca-970cf9b24500 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] 10.222.0.33 "GET /compute/v2.1/servers/6c1e8070-fc54-4d28-90a9-1241c03b9b95" status: 200 len: 1362 microversion: 2.26 time: 1.165107 Oct 04 20:59:23.322139 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2451/4856] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:59:22 2022] GET /compute/v2.1/servers/6c1e8070-fc54-4d28-90a9-1241c03b9b95 => generated 1362 bytes in 1175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:59:23.899630 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-efb4cba2-6f4e-4b7d-9e89-e08d1754af58 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6513f5e908ac4d028cad6eeeebeab285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65946afc398d4a9fb1c9095a4f946e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:59:23.920036 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-efb4cba2-6f4e-4b7d-9e89-e08d1754af58 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc" status: 200 len: 1505 microversion: 2.1 time: 0.910831 Oct 04 20:59:23.921247 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2406/4857] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:59:23 2022] GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc => generated 1505 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:59:23.931624 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-8f8de2c6-1979-43ef-8b22-5986a2c324d7 tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:59:23.933736 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-8f8de2c6-1979-43ef-8b22-5986a2c324d7 tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] [instance: beedbabd-70f0-435a-80ec-497c232a9ee3] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:59:23.945002 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8f8de2c6-1979-43ef-8b22-5986a2c324d7 tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:23.945784 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8f8de2c6-1979-43ef-8b22-5986a2c324d7 tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:23.950866 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ebd17282-22d2-42eb-9e6c-9064bb074fef tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:59:23.951765 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8f8de2c6-1979-43ef-8b22-5986a2c324d7 tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:23.951922 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ebd17282-22d2-42eb-9e6c-9064bb074fef tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] [instance: 598cf7e2-88a6-4096-bdb5-9426edf84ddb] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:59:23.952837 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8f8de2c6-1979-43ef-8b22-5986a2c324d7 tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:23.953476 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8f8de2c6-1979-43ef-8b22-5986a2c324d7 tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:23.954228 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8f8de2c6-1979-43ef-8b22-5986a2c324d7 tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:23.968551 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-ebd17282-22d2-42eb-9e6c-9064bb074fef tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] HTTP exception thrown: Instance 598cf7e2-88a6-4096-bdb5-9426edf84ddb could not be found. Oct 04 20:59:23.970219 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ebd17282-22d2-42eb-9e6c-9064bb074fef tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Request method failure captured: Oct 04 20:59:23.970219 n-d-854823-8 devstack@n-api.service[128801]: request: POST /compute/v2.1/servers/598cf7e2-88a6-4096-bdb5-9426edf84ddb/action HTTP/1.1 Oct 04 20:59:23.970219 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:59:23.970219 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:59:23.970219 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:59:23.970219 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 15 Oct 04 20:59:23.970219 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:59:23.970219 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:59:23.970219 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:59:23.970219 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:59:23.970219 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJ4eaBM_FLl2jaN3nQraRbM94DgE-qlLjkCPNJ1Ol7VvkbIGIp-m_lAuwAay2VJ7lXD5niLtaDpJGDoHOJTljuI2aLuReHvX6jQr-uTgC01ZM2s7p6j6gq6a-1PaGQN0mcmcJntCqSnEEt5MEM6DdrOOdi5eEtsfyNU4EpDYmca-Ylo Oct 04 20:59:23.970219 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:59:23.970219 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:59:23.970219 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:59:23.970219 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:59:23.970219 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:59:23.970219 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:59:23.970219 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: 65946afc398d4a9fb1c9095a4f946e07 Oct 04 20:59:23.970219 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-ServersNegativeTestJSON-1097186397 Oct 04 20:59:23.970219 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 20:59:23.970219 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 20:59:23.970219 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_65946afc398d4a9fb1c9095a4f946e07", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/65946afc398d4a9fb1c9095a4f946e07"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/65946afc398d4a9fb1c9095a4f946e07"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/65946afc398d4a9fb1c9095a4f946e07"}]}] Oct 04 20:59:23.970219 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-ServersNegativeTestJSON-1097186397 Oct 04 20:59:23.970219 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: 65946afc398d4a9fb1c9095a4f946e07 Oct 04 20:59:23.970219 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1097186397 Oct 04 20:59:23.970219 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-ServersNegativeTestJSON-1097186397-project Oct 04 20:59:23.970219 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:59:23.970219 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:59:23.970219 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: 6513f5e908ac4d028cad6eeeebeab285 Oct 04 20:59:23.970219 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-ServersNegativeTestJSON-1097186397-project Oct 04 20:59:23.970219 n-d-854823-8 devstack@n-api.service[128801]: Oct 04 20:59:23.970219 n-d-854823-8 devstack@n-api.service[128801]: {"restore": {}} Oct 04 20:59:23.970219 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 20:59:23.970219 n-d-854823-8 devstack@n-api.service[128801]: exception: Instance 598cf7e2-88a6-4096-bdb5-9426edf84ddb could not be found. Oct 04 20:59:23.970219 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': '598cf7e2-88a6-4096-bdb5-9426edf84ddb', 'body': {'restore': {}}} Oct 04 20:59:23.970219 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:59:23.970219 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:59:23.970219 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:59:23.970219 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:59:23.970219 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:59:23.970219 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:59:23.970219 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 20:59:23.970219 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 20:59:23.970219 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 598cf7e2-88a6-4096-bdb5-9426edf84ddb could not be found. Oct 04 20:59:23.970219 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:59:23.970219 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:59:23.970219 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:59:23.970219 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:59:23.970219 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:59:23.970219 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:59:23.970219 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:59:23.970219 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:59:23.970219 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:59:23.970219 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:59:23.970219 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 38, in _restore Oct 04 20:59:23.970219 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 04 20:59:23.970219 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:59:23.970219 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:59:23.970219 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 598cf7e2-88a6-4096-bdb5-9426edf84ddb could not be found. Oct 04 20:59:23.970219 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:59:23.970219 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:59:23.970219 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:59:23.970219 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:59:23.970219 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:59:23.970219 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:59:23.981511 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:59:23.981511 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:59:23.981511 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 598cf7e2-88a6-4096-bdb5-9426edf84ddb could not be found. Oct 04 20:59:23.981511 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:59:23.981511 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ebd17282-22d2-42eb-9e6c-9064bb074fef tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Returning 404 to user: Instance 598cf7e2-88a6-4096-bdb5-9426edf84ddb could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:59:23.981511 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ebd17282-22d2-42eb-9e6c-9064bb074fef tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "POST /compute/v2.1/servers/598cf7e2-88a6-4096-bdb5-9426edf84ddb/action" status: 404 len: 111 microversion: 2.1 time: 0.028578 Oct 04 20:59:23.981511 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2407/4858] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 20:59:23 2022] POST /compute/v2.1/servers/598cf7e2-88a6-4096-bdb5-9426edf84ddb/action => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 20:59:24.002131 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f8714652-8b74-4964-b8af-8631d3b8c568 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:59:24.017444 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f8714652-8b74-4964-b8af-8631d3b8c568 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] [instance: 320f9a98-969f-473e-bc56-842bbd28dedc] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:59:24.058015 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f8714652-8b74-4964-b8af-8631d3b8c568 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:24.059262 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f8714652-8b74-4964-b8af-8631d3b8c568 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:24.077694 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f8714652-8b74-4964-b8af-8631d3b8c568 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:24.079377 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f8714652-8b74-4964-b8af-8631d3b8c568 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:24.082456 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f8714652-8b74-4964-b8af-8631d3b8c568 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:24.083775 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f8714652-8b74-4964-b8af-8631d3b8c568 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:25.181540 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-8f8de2c6-1979-43ef-8b22-5986a2c324d7 tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25849c543c84fb7a87a74c11f8d7990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c2d7a7a44e4ea78f2974539bf9a173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:59:25.224512 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-8f8de2c6-1979-43ef-8b22-5986a2c324d7 tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] 10.222.0.33 "GET /compute/v2.1/servers/beedbabd-70f0-435a-80ec-497c232a9ee3" status: 200 len: 1324 microversion: 2.1 time: 1.293286 Oct 04 20:59:25.226522 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2452/4859] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:59:23 2022] GET /compute/v2.1/servers/beedbabd-70f0-435a-80ec-497c232a9ee3 => generated 1324 bytes in 1299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:59:25.226843 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f8714652-8b74-4964-b8af-8631d3b8c568 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6513f5e908ac4d028cad6eeeebeab285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65946afc398d4a9fb1c9095a4f946e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:59:25.235988 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f8714652-8b74-4964-b8af-8631d3b8c568 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc" status: 200 len: 1505 microversion: 2.1 time: 1.245319 Oct 04 20:59:25.240911 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-cbfefcbf-6b5f-4717-92c2-5e0e67ef25e3 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:59:25.241785 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2408/4860] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:59:23 2022] GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc => generated 1505 bytes in 1252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:59:25.262173 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-cbfefcbf-6b5f-4717-92c2-5e0e67ef25e3 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] [instance: 6c1e8070-fc54-4d28-90a9-1241c03b9b95] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:59:25.271126 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6700434a-b175-4e60-9272-3e564a388299 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:59:25.272088 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-6700434a-b175-4e60-9272-3e564a388299 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] [instance: 320f9a98-969f-473e-bc56-842bbd28dedc] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:59:25.283570 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cbfefcbf-6b5f-4717-92c2-5e0e67ef25e3 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:25.284225 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cbfefcbf-6b5f-4717-92c2-5e0e67ef25e3 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:25.284895 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cbfefcbf-6b5f-4717-92c2-5e0e67ef25e3 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:25.285711 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cbfefcbf-6b5f-4717-92c2-5e0e67ef25e3 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:25.286285 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6700434a-b175-4e60-9272-3e564a388299 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:25.286457 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cbfefcbf-6b5f-4717-92c2-5e0e67ef25e3 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:25.286923 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cbfefcbf-6b5f-4717-92c2-5e0e67ef25e3 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:25.290978 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6700434a-b175-4e60-9272-3e564a388299 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:25.291661 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6700434a-b175-4e60-9272-3e564a388299 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:25.292593 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6700434a-b175-4e60-9272-3e564a388299 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:25.293220 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6700434a-b175-4e60-9272-3e564a388299 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:25.293822 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6700434a-b175-4e60-9272-3e564a388299 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:25.855189 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-6700434a-b175-4e60-9272-3e564a388299 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6513f5e908ac4d028cad6eeeebeab285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65946afc398d4a9fb1c9095a4f946e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:59:25.869849 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-6700434a-b175-4e60-9272-3e564a388299 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc" status: 200 len: 1505 microversion: 2.1 time: 0.607203 Oct 04 20:59:25.904207 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2409/4861] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:59:25 2022] GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc => generated 1505 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:59:25.917000 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2a6e377c-4fd6-4d40-844e-1cf14c3f248a tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:59:25.917556 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-2a6e377c-4fd6-4d40-844e-1cf14c3f248a tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] [instance: 320f9a98-969f-473e-bc56-842bbd28dedc] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:59:25.926092 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2a6e377c-4fd6-4d40-844e-1cf14c3f248a tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:25.926624 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2a6e377c-4fd6-4d40-844e-1cf14c3f248a tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:25.927072 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2a6e377c-4fd6-4d40-844e-1cf14c3f248a tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:25.927853 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2a6e377c-4fd6-4d40-844e-1cf14c3f248a tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:25.928505 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2a6e377c-4fd6-4d40-844e-1cf14c3f248a tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:25.928945 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2a6e377c-4fd6-4d40-844e-1cf14c3f248a tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:26.005205 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-2a6e377c-4fd6-4d40-844e-1cf14c3f248a tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] HTTP exception thrown: Cannot 'restore' instance 320f9a98-969f-473e-bc56-842bbd28dedc while it is in vm_state active Oct 04 20:59:26.010980 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2a6e377c-4fd6-4d40-844e-1cf14c3f248a tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Request method failure captured: Oct 04 20:59:26.010980 n-d-854823-8 devstack@n-api.service[128801]: request: POST /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc/action HTTP/1.1 Oct 04 20:59:26.010980 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:59:26.010980 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:59:26.010980 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:59:26.010980 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 15 Oct 04 20:59:26.010980 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:59:26.010980 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:59:26.010980 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:59:26.010980 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:59:26.010980 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJ4eaBM_FLl2jaN3nQraRbM94DgE-qlLjkCPNJ1Ol7VvkbIGIp-m_lAuwAay2VJ7lXD5niLtaDpJGDoHOJTljuI2aLuReHvX6jQr-uTgC01ZM2s7p6j6gq6a-1PaGQN0mcmcJntCqSnEEt5MEM6DdrOOdi5eEtsfyNU4EpDYmca-Ylo Oct 04 20:59:26.010980 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:59:26.010980 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:59:26.010980 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:59:26.010980 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:59:26.010980 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:59:26.010980 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:59:26.010980 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: 65946afc398d4a9fb1c9095a4f946e07 Oct 04 20:59:26.010980 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-ServersNegativeTestJSON-1097186397 Oct 04 20:59:26.010980 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 20:59:26.010980 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 20:59:26.010980 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_65946afc398d4a9fb1c9095a4f946e07", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/65946afc398d4a9fb1c9095a4f946e07"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/65946afc398d4a9fb1c9095a4f946e07"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/65946afc398d4a9fb1c9095a4f946e07"}]}] Oct 04 20:59:26.010980 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-ServersNegativeTestJSON-1097186397 Oct 04 20:59:26.010980 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: 65946afc398d4a9fb1c9095a4f946e07 Oct 04 20:59:26.010980 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1097186397 Oct 04 20:59:26.010980 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-ServersNegativeTestJSON-1097186397-project Oct 04 20:59:26.010980 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:59:26.010980 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:59:26.010980 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: 6513f5e908ac4d028cad6eeeebeab285 Oct 04 20:59:26.010980 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-ServersNegativeTestJSON-1097186397-project Oct 04 20:59:26.010980 n-d-854823-8 devstack@n-api.service[128801]: Oct 04 20:59:26.010980 n-d-854823-8 devstack@n-api.service[128801]: {"restore": {}} Oct 04 20:59:26.010980 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 20:59:26.010980 n-d-854823-8 devstack@n-api.service[128801]: exception: Cannot 'restore' instance 320f9a98-969f-473e-bc56-842bbd28dedc while it is in vm_state active Oct 04 20:59:26.010980 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': '320f9a98-969f-473e-bc56-842bbd28dedc', 'body': {'restore': {}}} Oct 04 20:59:26.010980 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:59:26.010980 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:59:26.010980 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 42, in _restore Oct 04 20:59:26.010980 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self.compute_api.restore(context, instance) Oct 04 20:59:26.010980 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 20:59:26.010980 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 20:59:26.010980 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 04 20:59:26.010980 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 04 20:59:26.010980 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 320f9a98-969f-473e-bc56-842bbd28dedc in vm_state active. Cannot restore while the instance is in this state. Oct 04 20:59:26.010980 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:59:26.010980 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:59:26.010980 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:59:26.010980 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:59:26.010980 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:59:26.010980 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:59:26.010980 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:59:26.010980 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:59:26.010980 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:59:26.010980 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:59:26.010980 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 46, in _restore Oct 04 20:59:26.010980 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 04 20:59:26.010980 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 04 20:59:26.010980 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 04 20:59:26.010980 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'restore' instance 320f9a98-969f-473e-bc56-842bbd28dedc while it is in vm_state active Oct 04 20:59:26.010980 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:59:26.010980 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:59:26.010980 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:59:26.010980 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:59:26.010980 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:59:26.016150 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:59:26.016150 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:59:26.016150 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:59:26.016150 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'restore' instance 320f9a98-969f-473e-bc56-842bbd28dedc while it is in vm_state active Oct 04 20:59:26.016150 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:59:26.016150 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2a6e377c-4fd6-4d40-844e-1cf14c3f248a tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Returning 409 to user: Cannot 'restore' instance 320f9a98-969f-473e-bc56-842bbd28dedc while it is in vm_state active {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:59:26.018980 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-2a6e377c-4fd6-4d40-844e-1cf14c3f248a tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "POST /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc/action" status: 409 len: 145 microversion: 2.1 time: 0.112582 Oct 04 20:59:26.021446 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2410/4862] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 20:59:25 2022] POST /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc/action => generated 145 bytes in 117 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 04 20:59:26.047734 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-efd5981a-eb1d-46c0-bfe3-bbb072e110c9 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:59:26.051108 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-efd5981a-eb1d-46c0-bfe3-bbb072e110c9 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] [instance: 320f9a98-969f-473e-bc56-842bbd28dedc] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:59:26.079202 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-efd5981a-eb1d-46c0-bfe3-bbb072e110c9 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:26.081837 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-efd5981a-eb1d-46c0-bfe3-bbb072e110c9 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:26.084733 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-efd5981a-eb1d-46c0-bfe3-bbb072e110c9 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:26.085616 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-efd5981a-eb1d-46c0-bfe3-bbb072e110c9 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:26.087288 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-efd5981a-eb1d-46c0-bfe3-bbb072e110c9 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:26.089922 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-efd5981a-eb1d-46c0-bfe3-bbb072e110c9 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:26.141737 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=4 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:59:26.161048 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=14 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:59:26.169585 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-cbfefcbf-6b5f-4717-92c2-5e0e67ef25e3 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb9d89574d941ea9c8ca7b2b8d11f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e56c6049d5741418d193fd496cbb5d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:59:26.178997 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-cbfefcbf-6b5f-4717-92c2-5e0e67ef25e3 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb9d89574d941ea9c8ca7b2b8d11f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e56c6049d5741418d193fd496cbb5d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:59:26.197359 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-cbfefcbf-6b5f-4717-92c2-5e0e67ef25e3 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb9d89574d941ea9c8ca7b2b8d11f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e56c6049d5741418d193fd496cbb5d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:59:26.198607 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-cbfefcbf-6b5f-4717-92c2-5e0e67ef25e3 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] 10.222.0.33 "GET /compute/v2.1/servers/6c1e8070-fc54-4d28-90a9-1241c03b9b95" status: 200 len: 1362 microversion: 2.26 time: 0.968928 Oct 04 20:59:26.199179 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2453/4863] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:59:25 2022] GET /compute/v2.1/servers/6c1e8070-fc54-4d28-90a9-1241c03b9b95 => generated 1362 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:59:26.248635 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-bb089034-f66e-4bb2-8673-1e5dd412023b tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:59:26.249867 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-bb089034-f66e-4bb2-8673-1e5dd412023b tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] [instance: beedbabd-70f0-435a-80ec-497c232a9ee3] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:59:26.258362 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bb089034-f66e-4bb2-8673-1e5dd412023b tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:26.269207 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bb089034-f66e-4bb2-8673-1e5dd412023b tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:26.272951 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bb089034-f66e-4bb2-8673-1e5dd412023b tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:26.276288 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bb089034-f66e-4bb2-8673-1e5dd412023b tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:26.276780 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bb089034-f66e-4bb2-8673-1e5dd412023b tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:26.277226 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bb089034-f66e-4bb2-8673-1e5dd412023b tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:27.173437 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-efd5981a-eb1d-46c0-bfe3-bbb072e110c9 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6513f5e908ac4d028cad6eeeebeab285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65946afc398d4a9fb1c9095a4f946e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:59:27.183320 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-efd5981a-eb1d-46c0-bfe3-bbb072e110c9 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc" status: 200 len: 1505 microversion: 2.1 time: 1.156675 Oct 04 20:59:27.183914 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2411/4864] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:59:26 2022] GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc => generated 1505 bytes in 1158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:59:27.208328 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ac4bc6d9-a12c-4f5f-ba56-cadb5dd3ecc7 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:59:27.208955 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ac4bc6d9-a12c-4f5f-ba56-cadb5dd3ecc7 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] [instance: 320f9a98-969f-473e-bc56-842bbd28dedc] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:59:27.224294 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ac4bc6d9-a12c-4f5f-ba56-cadb5dd3ecc7 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:27.224799 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ac4bc6d9-a12c-4f5f-ba56-cadb5dd3ecc7 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:27.225359 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ac4bc6d9-a12c-4f5f-ba56-cadb5dd3ecc7 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:27.225963 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ac4bc6d9-a12c-4f5f-ba56-cadb5dd3ecc7 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:27.226470 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ac4bc6d9-a12c-4f5f-ba56-cadb5dd3ecc7 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:27.226889 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ac4bc6d9-a12c-4f5f-ba56-cadb5dd3ecc7 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:27.312621 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-bb089034-f66e-4bb2-8673-1e5dd412023b tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25849c543c84fb7a87a74c11f8d7990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c2d7a7a44e4ea78f2974539bf9a173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:59:27.326656 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-bb089034-f66e-4bb2-8673-1e5dd412023b tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] 10.222.0.33 "GET /compute/v2.1/servers/beedbabd-70f0-435a-80ec-497c232a9ee3" status: 200 len: 1324 microversion: 2.1 time: 1.082663 Oct 04 20:59:27.327566 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2454/4865] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:59:26 2022] GET /compute/v2.1/servers/beedbabd-70f0-435a-80ec-497c232a9ee3 => generated 1324 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:59:27.339102 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-844e3e53-f3b0-4d91-8d99-e84a14d61224 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:59:27.340003 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-844e3e53-f3b0-4d91-8d99-e84a14d61224 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] [instance: 6c1e8070-fc54-4d28-90a9-1241c03b9b95] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:59:27.356021 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-844e3e53-f3b0-4d91-8d99-e84a14d61224 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:27.356430 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-844e3e53-f3b0-4d91-8d99-e84a14d61224 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:27.367508 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-844e3e53-f3b0-4d91-8d99-e84a14d61224 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:27.368687 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-844e3e53-f3b0-4d91-8d99-e84a14d61224 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:27.374633 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-844e3e53-f3b0-4d91-8d99-e84a14d61224 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:27.375495 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-844e3e53-f3b0-4d91-8d99-e84a14d61224 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:27.420864 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:59:27.500185 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell0:SELECT=2 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:59:27.755526 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-ac4bc6d9-a12c-4f5f-ba56-cadb5dd3ecc7 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6513f5e908ac4d028cad6eeeebeab285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65946afc398d4a9fb1c9095a4f946e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:59:27.777425 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ac4bc6d9-a12c-4f5f-ba56-cadb5dd3ecc7 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc" status: 200 len: 1505 microversion: 2.1 time: 0.571373 Oct 04 20:59:27.780197 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2412/4866] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:59:27 2022] GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc => generated 1505 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:59:27.794146 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-844e3e53-f3b0-4d91-8d99-e84a14d61224 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb9d89574d941ea9c8ca7b2b8d11f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e56c6049d5741418d193fd496cbb5d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:59:27.804991 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-65dbeace-06a0-42f6-b3a2-780995471fc7 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:59:27.807035 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-65dbeace-06a0-42f6-b3a2-780995471fc7 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] [instance: 07f1576f-afca-4662-97cc-a3cfa660c3e4] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:59:27.811428 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-844e3e53-f3b0-4d91-8d99-e84a14d61224 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb9d89574d941ea9c8ca7b2b8d11f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e56c6049d5741418d193fd496cbb5d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:59:27.812923 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-844e3e53-f3b0-4d91-8d99-e84a14d61224 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb9d89574d941ea9c8ca7b2b8d11f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e56c6049d5741418d193fd496cbb5d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:59:27.814325 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-844e3e53-f3b0-4d91-8d99-e84a14d61224 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] 10.222.0.33 "GET /compute/v2.1/servers/6c1e8070-fc54-4d28-90a9-1241c03b9b95" status: 200 len: 1362 microversion: 2.26 time: 0.485254 Oct 04 20:59:27.821890 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-65dbeace-06a0-42f6-b3a2-780995471fc7 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] HTTP exception thrown: Instance 07f1576f-afca-4662-97cc-a3cfa660c3e4 could not be found. Oct 04 20:59:27.824077 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2455/4867] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:59:27 2022] GET /compute/v2.1/servers/6c1e8070-fc54-4d28-90a9-1241c03b9b95 => generated 1362 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:59:27.838242 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-65dbeace-06a0-42f6-b3a2-780995471fc7 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Request method failure captured: Oct 04 20:59:27.838242 n-d-854823-8 devstack@n-api.service[128801]: request: POST /compute/v2.1/servers/07f1576f-afca-4662-97cc-a3cfa660c3e4/action HTTP/1.1 Oct 04 20:59:27.838242 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:59:27.838242 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:59:27.838242 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:59:27.838242 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 14 Oct 04 20:59:27.838242 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:59:27.838242 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:59:27.838242 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:59:27.838242 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:59:27.838242 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJ4eaBM_FLl2jaN3nQraRbM94DgE-qlLjkCPNJ1Ol7VvkbIGIp-m_lAuwAay2VJ7lXD5niLtaDpJGDoHOJTljuI2aLuReHvX6jQr-uTgC01ZM2s7p6j6gq6a-1PaGQN0mcmcJntCqSnEEt5MEM6DdrOOdi5eEtsfyNU4EpDYmca-Ylo Oct 04 20:59:27.838242 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:59:27.838242 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:59:27.838242 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:59:27.838242 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:59:27.838242 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:59:27.838242 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:59:27.838242 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: 65946afc398d4a9fb1c9095a4f946e07 Oct 04 20:59:27.838242 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-ServersNegativeTestJSON-1097186397 Oct 04 20:59:27.838242 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 20:59:27.838242 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 20:59:27.838242 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_65946afc398d4a9fb1c9095a4f946e07", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/65946afc398d4a9fb1c9095a4f946e07"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/65946afc398d4a9fb1c9095a4f946e07"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/65946afc398d4a9fb1c9095a4f946e07"}]}] Oct 04 20:59:27.838242 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-ServersNegativeTestJSON-1097186397 Oct 04 20:59:27.838242 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: 65946afc398d4a9fb1c9095a4f946e07 Oct 04 20:59:27.838242 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1097186397 Oct 04 20:59:27.838242 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-ServersNegativeTestJSON-1097186397-project Oct 04 20:59:27.838242 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:59:27.838242 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:59:27.838242 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: 6513f5e908ac4d028cad6eeeebeab285 Oct 04 20:59:27.838242 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-ServersNegativeTestJSON-1097186397-project Oct 04 20:59:27.838242 n-d-854823-8 devstack@n-api.service[128801]: Oct 04 20:59:27.838242 n-d-854823-8 devstack@n-api.service[128801]: {"resume": {}} Oct 04 20:59:27.838242 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 20:59:27.838242 n-d-854823-8 devstack@n-api.service[128801]: exception: Instance 07f1576f-afca-4662-97cc-a3cfa660c3e4 could not be found. Oct 04 20:59:27.838242 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': '07f1576f-afca-4662-97cc-a3cfa660c3e4', 'body': {'resume': {}}} Oct 04 20:59:27.838242 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:59:27.838242 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:59:27.838242 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:59:27.838242 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:59:27.838242 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:59:27.838242 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:59:27.838242 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 20:59:27.838242 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 20:59:27.838242 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 07f1576f-afca-4662-97cc-a3cfa660c3e4 could not be found. Oct 04 20:59:27.838242 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:59:27.838242 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:59:27.838242 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:59:27.838242 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:59:27.838242 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:59:27.838242 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:59:27.838242 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:59:27.838242 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:59:27.838242 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:59:27.838242 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:59:27.838242 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 55, in _resume Oct 04 20:59:27.838242 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Oct 04 20:59:27.838242 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:59:27.838242 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:59:27.838242 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 07f1576f-afca-4662-97cc-a3cfa660c3e4 could not be found. Oct 04 20:59:27.838242 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:59:27.838242 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:59:27.838242 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:59:27.838242 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:59:27.838242 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:59:27.838242 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:59:27.847119 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:59:27.847119 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:59:27.847119 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 07f1576f-afca-4662-97cc-a3cfa660c3e4 could not be found. Oct 04 20:59:27.847119 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:59:27.847119 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-65dbeace-06a0-42f6-b3a2-780995471fc7 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Returning 404 to user: Instance 07f1576f-afca-4662-97cc-a3cfa660c3e4 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:59:27.847119 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-65dbeace-06a0-42f6-b3a2-780995471fc7 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "POST /compute/v2.1/servers/07f1576f-afca-4662-97cc-a3cfa660c3e4/action" status: 404 len: 111 microversion: 2.1 time: 0.041081 Oct 04 20:59:27.847119 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2413/4868] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 20:59:27 2022] POST /compute/v2.1/servers/07f1576f-afca-4662-97cc-a3cfa660c3e4/action => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 20:59:27.861405 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-88ea744b-f0b8-40ad-9eeb-3b68ebf3102d tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:59:27.863734 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-88ea744b-f0b8-40ad-9eeb-3b68ebf3102d tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] [instance: 320f9a98-969f-473e-bc56-842bbd28dedc] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:59:27.883070 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-88ea744b-f0b8-40ad-9eeb-3b68ebf3102d tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:27.884016 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-88ea744b-f0b8-40ad-9eeb-3b68ebf3102d tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:27.885956 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-88ea744b-f0b8-40ad-9eeb-3b68ebf3102d tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:27.887679 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-88ea744b-f0b8-40ad-9eeb-3b68ebf3102d tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:27.889708 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-88ea744b-f0b8-40ad-9eeb-3b68ebf3102d tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:27.890783 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-88ea744b-f0b8-40ad-9eeb-3b68ebf3102d tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:28.295737 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-88ea744b-f0b8-40ad-9eeb-3b68ebf3102d tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6513f5e908ac4d028cad6eeeebeab285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65946afc398d4a9fb1c9095a4f946e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:59:28.309522 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-88ea744b-f0b8-40ad-9eeb-3b68ebf3102d tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc" status: 200 len: 1505 microversion: 2.1 time: 0.461541 Oct 04 20:59:28.323598 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2456/4869] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:59:27 2022] GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc => generated 1505 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:59:28.341494 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7f9c27a7-aa19-420b-9528-734330d8b0ce tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:59:28.342292 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-7f9c27a7-aa19-420b-9528-734330d8b0ce tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] [instance: 320f9a98-969f-473e-bc56-842bbd28dedc] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:59:28.360247 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7f9c27a7-aa19-420b-9528-734330d8b0ce tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:28.366911 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-d506f2ae-5287-47aa-8528-7ce4ce08aa3b tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:59:28.368226 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7f9c27a7-aa19-420b-9528-734330d8b0ce tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:28.368909 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7f9c27a7-aa19-420b-9528-734330d8b0ce tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:28.371264 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7f9c27a7-aa19-420b-9528-734330d8b0ce tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:28.371993 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-d506f2ae-5287-47aa-8528-7ce4ce08aa3b tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] [instance: beedbabd-70f0-435a-80ec-497c232a9ee3] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:59:28.374499 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7f9c27a7-aa19-420b-9528-734330d8b0ce tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:28.376746 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7f9c27a7-aa19-420b-9528-734330d8b0ce tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:28.397617 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d506f2ae-5287-47aa-8528-7ce4ce08aa3b tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:28.402601 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d506f2ae-5287-47aa-8528-7ce4ce08aa3b tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:28.402974 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d506f2ae-5287-47aa-8528-7ce4ce08aa3b tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:28.403731 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d506f2ae-5287-47aa-8528-7ce4ce08aa3b tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:28.404206 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d506f2ae-5287-47aa-8528-7ce4ce08aa3b tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:28.404636 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d506f2ae-5287-47aa-8528-7ce4ce08aa3b tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:28.443895 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=100 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:59:28.866612 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-d506f2ae-5287-47aa-8528-7ce4ce08aa3b tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25849c543c84fb7a87a74c11f8d7990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c2d7a7a44e4ea78f2974539bf9a173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:59:28.876823 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-d506f2ae-5287-47aa-8528-7ce4ce08aa3b tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] 10.222.0.33 "GET /compute/v2.1/servers/beedbabd-70f0-435a-80ec-497c232a9ee3" status: 200 len: 1324 microversion: 2.1 time: 0.529101 Oct 04 20:59:28.877439 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2457/4870] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:59:28 2022] GET /compute/v2.1/servers/beedbabd-70f0-435a-80ec-497c232a9ee3 => generated 1324 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:59:28.887799 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-d7b658ce-b3a1-49c1-8c14-47f647a52792 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:59:28.888408 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-d7b658ce-b3a1-49c1-8c14-47f647a52792 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] [instance: 6c1e8070-fc54-4d28-90a9-1241c03b9b95] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:59:28.906497 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d7b658ce-b3a1-49c1-8c14-47f647a52792 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:28.907086 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d7b658ce-b3a1-49c1-8c14-47f647a52792 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:28.907529 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d7b658ce-b3a1-49c1-8c14-47f647a52792 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:28.913828 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d7b658ce-b3a1-49c1-8c14-47f647a52792 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:28.914548 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d7b658ce-b3a1-49c1-8c14-47f647a52792 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:28.915183 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d7b658ce-b3a1-49c1-8c14-47f647a52792 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:28.983545 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-7f9c27a7-aa19-420b-9528-734330d8b0ce tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6513f5e908ac4d028cad6eeeebeab285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65946afc398d4a9fb1c9095a4f946e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:59:28.999434 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-7f9c27a7-aa19-420b-9528-734330d8b0ce tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc" status: 200 len: 1505 microversion: 2.1 time: 0.662537 Oct 04 20:59:29.000372 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2414/4871] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:59:28 2022] GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc => generated 1505 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:59:29.027470 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-15bd09f0-9535-4f5b-be05-47e1355458f4 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:59:29.028003 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-15bd09f0-9535-4f5b-be05-47e1355458f4 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] [instance: 320f9a98-969f-473e-bc56-842bbd28dedc] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:59:29.038567 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-15bd09f0-9535-4f5b-be05-47e1355458f4 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:29.040773 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-15bd09f0-9535-4f5b-be05-47e1355458f4 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:29.042098 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-15bd09f0-9535-4f5b-be05-47e1355458f4 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:29.044220 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-15bd09f0-9535-4f5b-be05-47e1355458f4 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:29.046079 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-15bd09f0-9535-4f5b-be05-47e1355458f4 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:29.047087 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-15bd09f0-9535-4f5b-be05-47e1355458f4 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:29.118229 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-15bd09f0-9535-4f5b-be05-47e1355458f4 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] HTTP exception thrown: Cannot 'resume' instance 320f9a98-969f-473e-bc56-842bbd28dedc while it is in vm_state active Oct 04 20:59:29.122671 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-15bd09f0-9535-4f5b-be05-47e1355458f4 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Request method failure captured: Oct 04 20:59:29.122671 n-d-854823-8 devstack@n-api.service[128801]: request: POST /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc/action HTTP/1.1 Oct 04 20:59:29.122671 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:59:29.122671 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:59:29.122671 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:59:29.122671 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 14 Oct 04 20:59:29.122671 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:59:29.122671 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:59:29.122671 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:59:29.122671 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:59:29.122671 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJ4eaBM_FLl2jaN3nQraRbM94DgE-qlLjkCPNJ1Ol7VvkbIGIp-m_lAuwAay2VJ7lXD5niLtaDpJGDoHOJTljuI2aLuReHvX6jQr-uTgC01ZM2s7p6j6gq6a-1PaGQN0mcmcJntCqSnEEt5MEM6DdrOOdi5eEtsfyNU4EpDYmca-Ylo Oct 04 20:59:29.122671 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:59:29.122671 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:59:29.122671 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:59:29.122671 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:59:29.122671 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:59:29.122671 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:59:29.122671 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: 65946afc398d4a9fb1c9095a4f946e07 Oct 04 20:59:29.122671 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-ServersNegativeTestJSON-1097186397 Oct 04 20:59:29.122671 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 20:59:29.122671 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 20:59:29.122671 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_65946afc398d4a9fb1c9095a4f946e07", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/65946afc398d4a9fb1c9095a4f946e07"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/65946afc398d4a9fb1c9095a4f946e07"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/65946afc398d4a9fb1c9095a4f946e07"}]}] Oct 04 20:59:29.122671 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-ServersNegativeTestJSON-1097186397 Oct 04 20:59:29.122671 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: 65946afc398d4a9fb1c9095a4f946e07 Oct 04 20:59:29.122671 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1097186397 Oct 04 20:59:29.122671 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-ServersNegativeTestJSON-1097186397-project Oct 04 20:59:29.122671 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:59:29.122671 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:59:29.122671 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: 6513f5e908ac4d028cad6eeeebeab285 Oct 04 20:59:29.122671 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-ServersNegativeTestJSON-1097186397-project Oct 04 20:59:29.122671 n-d-854823-8 devstack@n-api.service[128801]: Oct 04 20:59:29.122671 n-d-854823-8 devstack@n-api.service[128801]: {"resume": {}} Oct 04 20:59:29.122671 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 20:59:29.122671 n-d-854823-8 devstack@n-api.service[128801]: exception: Cannot 'resume' instance 320f9a98-969f-473e-bc56-842bbd28dedc while it is in vm_state active Oct 04 20:59:29.122671 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': '320f9a98-969f-473e-bc56-842bbd28dedc', 'body': {'resume': {}}} Oct 04 20:59:29.122671 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:59:29.122671 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:59:29.122671 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 59, in _resume Oct 04 20:59:29.122671 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self.compute_api.resume(context, server) Oct 04 20:59:29.122671 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 20:59:29.122671 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 20:59:29.122671 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 04 20:59:29.122671 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 04 20:59:29.122671 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 04 20:59:29.122671 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 04 20:59:29.122671 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 320f9a98-969f-473e-bc56-842bbd28dedc in vm_state active. Cannot resume while the instance is in this state. Oct 04 20:59:29.122671 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:59:29.122671 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:59:29.122671 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:59:29.122671 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:59:29.122671 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:59:29.122671 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:59:29.122671 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:59:29.122671 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:59:29.122671 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:59:29.122671 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:59:29.122671 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 63, in _resume Oct 04 20:59:29.122671 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 04 20:59:29.122671 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 04 20:59:29.122671 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 04 20:59:29.122671 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'resume' instance 320f9a98-969f-473e-bc56-842bbd28dedc while it is in vm_state active Oct 04 20:59:29.122671 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:59:29.122671 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:59:29.122671 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:59:29.129004 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:59:29.129004 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:59:29.129004 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:59:29.129004 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:59:29.129004 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:59:29.129004 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'resume' instance 320f9a98-969f-473e-bc56-842bbd28dedc while it is in vm_state active Oct 04 20:59:29.129004 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:59:29.129004 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-15bd09f0-9535-4f5b-be05-47e1355458f4 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Returning 409 to user: Cannot 'resume' instance 320f9a98-969f-473e-bc56-842bbd28dedc while it is in vm_state active {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:59:29.130650 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-15bd09f0-9535-4f5b-be05-47e1355458f4 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "POST /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc/action" status: 409 len: 144 microversion: 2.1 time: 0.108112 Oct 04 20:59:29.136319 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2415/4872] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 20:59:29 2022] POST /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc/action => generated 144 bytes in 112 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 04 20:59:29.143608 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8442b796-e207-47a7-b2f3-ddf423959eaf tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:59:29.147734 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-8442b796-e207-47a7-b2f3-ddf423959eaf tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] [instance: 320f9a98-969f-473e-bc56-842bbd28dedc] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:59:29.154683 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8442b796-e207-47a7-b2f3-ddf423959eaf tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:29.155260 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8442b796-e207-47a7-b2f3-ddf423959eaf tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:29.155834 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8442b796-e207-47a7-b2f3-ddf423959eaf tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:29.156642 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8442b796-e207-47a7-b2f3-ddf423959eaf tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:29.157176 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8442b796-e207-47a7-b2f3-ddf423959eaf tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:29.157675 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8442b796-e207-47a7-b2f3-ddf423959eaf tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:29.624034 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-d7b658ce-b3a1-49c1-8c14-47f647a52792 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb9d89574d941ea9c8ca7b2b8d11f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e56c6049d5741418d193fd496cbb5d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:59:29.645685 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-d7b658ce-b3a1-49c1-8c14-47f647a52792 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb9d89574d941ea9c8ca7b2b8d11f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e56c6049d5741418d193fd496cbb5d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:59:29.650372 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-d7b658ce-b3a1-49c1-8c14-47f647a52792 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb9d89574d941ea9c8ca7b2b8d11f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e56c6049d5741418d193fd496cbb5d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:59:29.660122 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-d7b658ce-b3a1-49c1-8c14-47f647a52792 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] 10.222.0.33 "GET /compute/v2.1/servers/6c1e8070-fc54-4d28-90a9-1241c03b9b95" status: 200 len: 1362 microversion: 2.26 time: 0.779990 Oct 04 20:59:29.663794 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2458/4873] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:59:28 2022] GET /compute/v2.1/servers/6c1e8070-fc54-4d28-90a9-1241c03b9b95 => generated 1362 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:59:29.675607 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-8442b796-e207-47a7-b2f3-ddf423959eaf tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6513f5e908ac4d028cad6eeeebeab285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65946afc398d4a9fb1c9095a4f946e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:59:29.694470 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-8442b796-e207-47a7-b2f3-ddf423959eaf tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc" status: 200 len: 1505 microversion: 2.1 time: 0.553648 Oct 04 20:59:29.694813 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-77789e4c-4527-4586-8554-d7bb2d0e6966 req-62fdc358-e99e-4067-b7ae-98d7ff72b5d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c1e8070-fc54-4d28-90a9-1241c03b9b95", "tag": "d1ea27b2-49f2-43a7-96dc-84ebebf2b2e0"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:59:29.695915 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2416/4874] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:59:29 2022] GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc => generated 1505 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:59:29.719304 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-77789e4c-4527-4586-8554-d7bb2d0e6966 req-62fdc358-e99e-4067-b7ae-98d7ff72b5d4 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:29.720505 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-77789e4c-4527-4586-8554-d7bb2d0e6966 req-62fdc358-e99e-4067-b7ae-98d7ff72b5d4 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:29.721089 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-77789e4c-4527-4586-8554-d7bb2d0e6966 req-62fdc358-e99e-4067-b7ae-98d7ff72b5d4 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:29.725431 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-78bd4ba2-92a7-486c-b5e1-ab78632f1ecc tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:59:29.727253 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-78bd4ba2-92a7-486c-b5e1-ab78632f1ecc tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] [instance: 320f9a98-969f-473e-bc56-842bbd28dedc] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:59:29.733575 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-78bd4ba2-92a7-486c-b5e1-ab78632f1ecc tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:29.734679 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-78bd4ba2-92a7-486c-b5e1-ab78632f1ecc tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:29.735437 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-78bd4ba2-92a7-486c-b5e1-ab78632f1ecc tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:29.736376 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-78bd4ba2-92a7-486c-b5e1-ab78632f1ecc tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:29.738202 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-78bd4ba2-92a7-486c-b5e1-ab78632f1ecc tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:29.738962 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-78bd4ba2-92a7-486c-b5e1-ab78632f1ecc tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:29.750504 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-77789e4c-4527-4586-8554-d7bb2d0e6966 req-62fdc358-e99e-4067-b7ae-98d7ff72b5d4 service nova] Creating event network-changed:d1ea27b2-49f2-43a7-96dc-84ebebf2b2e0 for instance 6c1e8070-fc54-4d28-90a9-1241c03b9b95 on n-h1-854823-8 Oct 04 20:59:29.760678 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-77789e4c-4527-4586-8554-d7bb2d0e6966 req-62fdc358-e99e-4067-b7ae-98d7ff72b5d4 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092690 Oct 04 20:59:29.768262 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2459/4875] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:59:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:59:29.901479 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-76d9305a-f4e4-47f0-9ffc-e3acfadf29be tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:59:29.903099 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-76d9305a-f4e4-47f0-9ffc-e3acfadf29be tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] [instance: beedbabd-70f0-435a-80ec-497c232a9ee3] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:59:29.923950 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-76d9305a-f4e4-47f0-9ffc-e3acfadf29be tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:29.925663 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-76d9305a-f4e4-47f0-9ffc-e3acfadf29be tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:29.927911 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-76d9305a-f4e4-47f0-9ffc-e3acfadf29be tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:29.929121 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-76d9305a-f4e4-47f0-9ffc-e3acfadf29be tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:29.931359 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-76d9305a-f4e4-47f0-9ffc-e3acfadf29be tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:29.931876 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-76d9305a-f4e4-47f0-9ffc-e3acfadf29be tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:30.490526 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-76d9305a-f4e4-47f0-9ffc-e3acfadf29be tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25849c543c84fb7a87a74c11f8d7990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c2d7a7a44e4ea78f2974539bf9a173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:59:30.509513 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-76d9305a-f4e4-47f0-9ffc-e3acfadf29be tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] 10.222.0.33 "GET /compute/v2.1/servers/beedbabd-70f0-435a-80ec-497c232a9ee3" status: 200 len: 1324 microversion: 2.1 time: 0.612684 Oct 04 20:59:30.512480 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2460/4876] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:59:29 2022] GET /compute/v2.1/servers/beedbabd-70f0-435a-80ec-497c232a9ee3 => generated 1324 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:59:30.519255 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-78bd4ba2-92a7-486c-b5e1-ab78632f1ecc tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6513f5e908ac4d028cad6eeeebeab285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65946afc398d4a9fb1c9095a4f946e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:59:30.527848 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-78bd4ba2-92a7-486c-b5e1-ab78632f1ecc tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc" status: 200 len: 1505 microversion: 2.1 time: 0.807072 Oct 04 20:59:30.528881 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2417/4877] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:59:29 2022] GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc => generated 1505 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:59:30.694835 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-5028412f-7838-45f6-8d13-bb72485dfe88 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:59:30.695462 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-5028412f-7838-45f6-8d13-bb72485dfe88 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] [instance: 6c1e8070-fc54-4d28-90a9-1241c03b9b95] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:59:30.699338 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-062aed0f-5ce5-46c5-98f9-d96188207bf2 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Action: 'create', calling method: >, body: {"server": {"name": "", "imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63", "flavorRef": "452", "networks": [{"uuid": "780a66b6-435f-46df-9c7b-6f763e190356"}]}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:59:30.704186 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-062aed0f-5ce5-46c5-98f9-d96188207bf2 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Request method failure captured: Oct 04 20:59:30.704186 n-d-854823-8 devstack@n-api.service[128801]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 20:59:30.704186 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:59:30.704186 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:59:30.704186 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:59:30.704186 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 160 Oct 04 20:59:30.704186 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:59:30.704186 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:59:30.704186 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:59:30.704186 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:59:30.704186 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJ4eaBM_FLl2jaN3nQraRbM94DgE-qlLjkCPNJ1Ol7VvkbIGIp-m_lAuwAay2VJ7lXD5niLtaDpJGDoHOJTljuI2aLuReHvX6jQr-uTgC01ZM2s7p6j6gq6a-1PaGQN0mcmcJntCqSnEEt5MEM6DdrOOdi5eEtsfyNU4EpDYmca-Ylo Oct 04 20:59:30.704186 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:59:30.704186 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:59:30.704186 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:59:30.704186 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:59:30.704186 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:59:30.704186 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:59:30.704186 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: 65946afc398d4a9fb1c9095a4f946e07 Oct 04 20:59:30.704186 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-ServersNegativeTestJSON-1097186397 Oct 04 20:59:30.704186 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 20:59:30.704186 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 20:59:30.704186 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_65946afc398d4a9fb1c9095a4f946e07", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/65946afc398d4a9fb1c9095a4f946e07"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/65946afc398d4a9fb1c9095a4f946e07"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/65946afc398d4a9fb1c9095a4f946e07"}]}] Oct 04 20:59:30.704186 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-ServersNegativeTestJSON-1097186397 Oct 04 20:59:30.704186 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: 65946afc398d4a9fb1c9095a4f946e07 Oct 04 20:59:30.704186 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1097186397 Oct 04 20:59:30.704186 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-ServersNegativeTestJSON-1097186397-project Oct 04 20:59:30.704186 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:59:30.704186 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:59:30.704186 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: 6513f5e908ac4d028cad6eeeebeab285 Oct 04 20:59:30.704186 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-ServersNegativeTestJSON-1097186397-project Oct 04 20:59:30.704186 n-d-854823-8 devstack@n-api.service[128801]: Oct 04 20:59:30.704186 n-d-854823-8 devstack@n-api.service[128801]: {"server": {"name": "", "imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63", "flavorRef": "452", "networks": [{"uuid": "780a66b6-435f-46df-9c7b-6f763e190356"}]}} Oct 04 20:59:30.704186 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 20:59:30.704186 n-d-854823-8 devstack@n-api.service[128801]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 04 20:59:30.704186 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'body': {'server': {'name': '', 'imageRef': '15b24725-0c99-4bcf-b1fb-907cdf8e2d63', 'flavorRef': '452', 'networks': [{'uuid': '780a66b6-435f-46df-9c7b-6f763e190356'}]}}} Oct 04 20:59:30.704186 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:59:30.704186 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:59:30.704186 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 20:59:30.704186 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 20:59:30.704186 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 20:59:30.704186 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise error Oct 04 20:59:30.704186 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 04 20:59:30.704186 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:59:30.704186 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Oct 04 20:59:30.704186 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 04 20:59:30.704186 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:59:30.704186 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 04 20:59:30.704186 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi '' Oct 04 20:59:30.704186 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:59:30.704186 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:59:30.704186 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:59:30.704186 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:59:30.704186 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:59:30.704186 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:59:30.704186 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:59:30.704186 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:59:30.704186 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:59:30.704186 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:59:30.704186 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:59:30.704186 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:59:30.704186 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 20:59:30.704186 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 20:59:30.704186 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 20:59:30.704186 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 20:59:30.704186 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 20:59:30.709711 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 20:59:30.709711 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 04 20:59:30.709711 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:59:30.709711 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:59:30.709711 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:59:30.709711 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:59:30.709711 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:59:30.709711 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:59:30.709711 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 20:59:30.709711 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 20:59:30.709711 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 04 20:59:30.709711 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:59:30.713657 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-062aed0f-5ce5-46c5-98f9-d96188207bf2 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:59:30.716357 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-062aed0f-5ce5-46c5-98f9-d96188207bf2 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 400 len: 108 microversion: 2.1 time: 0.027191 Oct 04 20:59:30.718605 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5028412f-7838-45f6-8d13-bb72485dfe88 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:30.718997 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2418/4878] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 20:59:30 2022] POST /compute/v2.1/servers => generated 108 bytes in 32 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 20:59:30.719685 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5028412f-7838-45f6-8d13-bb72485dfe88 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:30.720316 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5028412f-7838-45f6-8d13-bb72485dfe88 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:30.721296 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5028412f-7838-45f6-8d13-bb72485dfe88 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:30.728032 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-181d5c75-df86-4f7b-bb44-305a90eeaa94 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:59:30.729795 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5028412f-7838-45f6-8d13-bb72485dfe88 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:30.730822 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5028412f-7838-45f6-8d13-bb72485dfe88 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:30.735321 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-181d5c75-df86-4f7b-bb44-305a90eeaa94 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] [instance: 320f9a98-969f-473e-bc56-842bbd28dedc] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:59:30.756747 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-181d5c75-df86-4f7b-bb44-305a90eeaa94 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:30.757248 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-181d5c75-df86-4f7b-bb44-305a90eeaa94 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:30.757691 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-181d5c75-df86-4f7b-bb44-305a90eeaa94 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:30.758445 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-181d5c75-df86-4f7b-bb44-305a90eeaa94 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:30.765186 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-181d5c75-df86-4f7b-bb44-305a90eeaa94 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:30.766543 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-181d5c75-df86-4f7b-bb44-305a90eeaa94 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:31.152160 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-5028412f-7838-45f6-8d13-bb72485dfe88 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb9d89574d941ea9c8ca7b2b8d11f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e56c6049d5741418d193fd496cbb5d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:59:31.160179 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-181d5c75-df86-4f7b-bb44-305a90eeaa94 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6513f5e908ac4d028cad6eeeebeab285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65946afc398d4a9fb1c9095a4f946e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:59:31.163196 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-5028412f-7838-45f6-8d13-bb72485dfe88 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb9d89574d941ea9c8ca7b2b8d11f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e56c6049d5741418d193fd496cbb5d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:59:31.165577 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-5028412f-7838-45f6-8d13-bb72485dfe88 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb9d89574d941ea9c8ca7b2b8d11f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e56c6049d5741418d193fd496cbb5d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:59:31.167315 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-5028412f-7838-45f6-8d13-bb72485dfe88 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] 10.222.0.33 "GET /compute/v2.1/servers/6c1e8070-fc54-4d28-90a9-1241c03b9b95" status: 200 len: 1362 microversion: 2.26 time: 0.482862 Oct 04 20:59:31.187720 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2461/4879] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:59:30 2022] GET /compute/v2.1/servers/6c1e8070-fc54-4d28-90a9-1241c03b9b95 => generated 1362 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:59:31.188468 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-181d5c75-df86-4f7b-bb44-305a90eeaa94 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc" status: 200 len: 1505 microversion: 2.1 time: 0.464265 Oct 04 20:59:31.189211 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2419/4880] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:59:30 2022] GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc => generated 1505 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:59:31.223754 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-aa7acccb-acf9-4673-ae0c-4cac19faa919 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:59:31.224631 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-aa7acccb-acf9-4673-ae0c-4cac19faa919 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] [instance: 320f9a98-969f-473e-bc56-842bbd28dedc] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:59:31.232368 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-aa7acccb-acf9-4673-ae0c-4cac19faa919 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:31.233107 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-aa7acccb-acf9-4673-ae0c-4cac19faa919 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:31.233702 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-aa7acccb-acf9-4673-ae0c-4cac19faa919 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:31.234770 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-aa7acccb-acf9-4673-ae0c-4cac19faa919 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:31.235618 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-aa7acccb-acf9-4673-ae0c-4cac19faa919 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:31.236381 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-aa7acccb-acf9-4673-ae0c-4cac19faa919 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:31.467349 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-f6417561-5d6a-4bdf-b51a-8e76d644af9c req-d280aef5-3ccb-4a67-8c91-e2c9e22f3c5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "beedbabd-70f0-435a-80ec-497c232a9ee3", "name": "network-vif-plugged", "status": "completed", "tag": "471eb78e-97c1-4391-bb60-0c27d96466eb"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:59:31.488490 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-f6417561-5d6a-4bdf-b51a-8e76d644af9c req-d280aef5-3ccb-4a67-8c91-e2c9e22f3c5d service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:31.489486 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-f6417561-5d6a-4bdf-b51a-8e76d644af9c req-d280aef5-3ccb-4a67-8c91-e2c9e22f3c5d service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:31.490490 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-f6417561-5d6a-4bdf-b51a-8e76d644af9c req-d280aef5-3ccb-4a67-8c91-e2c9e22f3c5d service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:31.504307 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-aa7acccb-acf9-4673-ae0c-4cac19faa919 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6513f5e908ac4d028cad6eeeebeab285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65946afc398d4a9fb1c9095a4f946e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:59:31.520030 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-aa7acccb-acf9-4673-ae0c-4cac19faa919 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc" status: 200 len: 1505 microversion: 2.1 time: 0.300534 Oct 04 20:59:31.521684 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2462/4881] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:59:31 2022] GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc => generated 1505 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:59:31.531481 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-f6417561-5d6a-4bdf-b51a-8e76d644af9c req-d280aef5-3ccb-4a67-8c91-e2c9e22f3c5d service nova] Creating event network-vif-plugged:471eb78e-97c1-4391-bb60-0c27d96466eb for instance beedbabd-70f0-435a-80ec-497c232a9ee3 on n-h2-854823-8 Oct 04 20:59:31.544043 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-5d09986c-142a-43f0-9596-5b41c22ce947 tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:59:31.545627 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-5d09986c-142a-43f0-9596-5b41c22ce947 tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] [instance: beedbabd-70f0-435a-80ec-497c232a9ee3] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:59:31.564642 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-f6417561-5d6a-4bdf-b51a-8e76d644af9c req-d280aef5-3ccb-4a67-8c91-e2c9e22f3c5d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100089 Oct 04 20:59:31.570314 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2420/4882] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:59:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:59:31.573978 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5d09986c-142a-43f0-9596-5b41c22ce947 tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:31.575823 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5d09986c-142a-43f0-9596-5b41c22ce947 tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:31.577280 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5d09986c-142a-43f0-9596-5b41c22ce947 tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:31.579793 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5d09986c-142a-43f0-9596-5b41c22ce947 tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:31.581330 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5d09986c-142a-43f0-9596-5b41c22ce947 tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:31.582385 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5d09986c-142a-43f0-9596-5b41c22ce947 tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:31.590054 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-24807e7f-6ac8-4c12-bcf4-006781e034fc tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:59:31.606810 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-24807e7f-6ac8-4c12-bcf4-006781e034fc tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] [instance: b2224f78-67a4-4aad-abad-2ae77c017e59] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:59:31.622266 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-24807e7f-6ac8-4c12-bcf4-006781e034fc tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] HTTP exception thrown: Instance b2224f78-67a4-4aad-abad-2ae77c017e59 could not be found. Oct 04 20:59:31.629582 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-24807e7f-6ac8-4c12-bcf4-006781e034fc tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Request method failure captured: Oct 04 20:59:31.629582 n-d-854823-8 devstack@n-api.service[128801]: request: POST /compute/v2.1/servers/b2224f78-67a4-4aad-abad-2ae77c017e59/action HTTP/1.1 Oct 04 20:59:31.629582 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:59:31.629582 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:59:31.629582 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:59:31.629582 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 14 Oct 04 20:59:31.629582 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:59:31.629582 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:59:31.629582 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:59:31.629582 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:59:31.629582 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJ4eaBM_FLl2jaN3nQraRbM94DgE-qlLjkCPNJ1Ol7VvkbIGIp-m_lAuwAay2VJ7lXD5niLtaDpJGDoHOJTljuI2aLuReHvX6jQr-uTgC01ZM2s7p6j6gq6a-1PaGQN0mcmcJntCqSnEEt5MEM6DdrOOdi5eEtsfyNU4EpDYmca-Ylo Oct 04 20:59:31.629582 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:59:31.629582 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:59:31.629582 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:59:31.629582 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:59:31.629582 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:59:31.629582 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:59:31.629582 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: 65946afc398d4a9fb1c9095a4f946e07 Oct 04 20:59:31.629582 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-ServersNegativeTestJSON-1097186397 Oct 04 20:59:31.629582 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 20:59:31.629582 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 20:59:31.629582 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_65946afc398d4a9fb1c9095a4f946e07", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/65946afc398d4a9fb1c9095a4f946e07"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/65946afc398d4a9fb1c9095a4f946e07"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/65946afc398d4a9fb1c9095a4f946e07"}]}] Oct 04 20:59:31.629582 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-ServersNegativeTestJSON-1097186397 Oct 04 20:59:31.629582 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: 65946afc398d4a9fb1c9095a4f946e07 Oct 04 20:59:31.629582 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1097186397 Oct 04 20:59:31.629582 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-ServersNegativeTestJSON-1097186397-project Oct 04 20:59:31.629582 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:59:31.629582 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:59:31.629582 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: 6513f5e908ac4d028cad6eeeebeab285 Oct 04 20:59:31.629582 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-ServersNegativeTestJSON-1097186397-project Oct 04 20:59:31.629582 n-d-854823-8 devstack@n-api.service[128801]: Oct 04 20:59:31.629582 n-d-854823-8 devstack@n-api.service[128801]: {"shelve": {}} Oct 04 20:59:31.629582 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 20:59:31.629582 n-d-854823-8 devstack@n-api.service[128801]: exception: Instance b2224f78-67a4-4aad-abad-2ae77c017e59 could not be found. Oct 04 20:59:31.629582 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': 'b2224f78-67a4-4aad-abad-2ae77c017e59', 'body': {'shelve': {}}} Oct 04 20:59:31.629582 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:59:31.629582 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:59:31.629582 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:59:31.629582 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:59:31.629582 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:59:31.629582 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:59:31.629582 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 20:59:31.629582 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 20:59:31.629582 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b2224f78-67a4-4aad-abad-2ae77c017e59 could not be found. Oct 04 20:59:31.629582 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:59:31.629582 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:59:31.629582 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:59:31.629582 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:59:31.629582 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:59:31.629582 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:59:31.629582 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:59:31.629582 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:59:31.629582 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:59:31.629582 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:59:31.629582 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 44, in _shelve Oct 04 20:59:31.629582 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 04 20:59:31.629582 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:59:31.629582 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:59:31.629582 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b2224f78-67a4-4aad-abad-2ae77c017e59 could not be found. Oct 04 20:59:31.629582 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:59:31.629582 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:59:31.629582 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:59:31.629582 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:59:31.629582 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:59:31.629582 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:59:31.637072 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:59:31.637072 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:59:31.637072 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b2224f78-67a4-4aad-abad-2ae77c017e59 could not be found. Oct 04 20:59:31.637072 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:59:31.637072 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-24807e7f-6ac8-4c12-bcf4-006781e034fc tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Returning 404 to user: Instance b2224f78-67a4-4aad-abad-2ae77c017e59 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:59:31.637072 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-24807e7f-6ac8-4c12-bcf4-006781e034fc tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "POST /compute/v2.1/servers/b2224f78-67a4-4aad-abad-2ae77c017e59/action" status: 404 len: 111 microversion: 2.1 time: 0.058867 Oct 04 20:59:31.637072 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2421/4883] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 20:59:31 2022] POST /compute/v2.1/servers/b2224f78-67a4-4aad-abad-2ae77c017e59/action => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:59:31.645240 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6786dec3-1cd7-4f57-ae86-3de49ef65bbe tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:59:31.645855 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-6786dec3-1cd7-4f57-ae86-3de49ef65bbe tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] [instance: 320f9a98-969f-473e-bc56-842bbd28dedc] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:59:31.667723 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6786dec3-1cd7-4f57-ae86-3de49ef65bbe tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:31.667982 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6786dec3-1cd7-4f57-ae86-3de49ef65bbe tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:31.668323 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6786dec3-1cd7-4f57-ae86-3de49ef65bbe tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:31.669035 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6786dec3-1cd7-4f57-ae86-3de49ef65bbe tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:31.669486 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6786dec3-1cd7-4f57-ae86-3de49ef65bbe tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:31.669907 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6786dec3-1cd7-4f57-ae86-3de49ef65bbe tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:32.653342 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-5d09986c-142a-43f0-9596-5b41c22ce947 tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25849c543c84fb7a87a74c11f8d7990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c2d7a7a44e4ea78f2974539bf9a173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:59:32.663253 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-5d09986c-142a-43f0-9596-5b41c22ce947 tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] 10.222.0.33 "GET /compute/v2.1/servers/beedbabd-70f0-435a-80ec-497c232a9ee3" status: 200 len: 1324 microversion: 2.1 time: 1.125755 Oct 04 20:59:32.682761 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2463/4884] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:59:31 2022] GET /compute/v2.1/servers/beedbabd-70f0-435a-80ec-497c232a9ee3 => generated 1324 bytes in 1146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:59:32.697855 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-cf08924d-2999-4485-9251-a5e3255d01d7 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-174494924", "imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63", "flavorRef": "452", "networks": [{"uuid": "6d86fb77-9845-4176-9d29-ded86267866d"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1637210633", "security_groups": [{"name": "tempest-secgroup-smoke-612451186"}]}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:59:32.761298 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-6786dec3-1cd7-4f57-ae86-3de49ef65bbe tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6513f5e908ac4d028cad6eeeebeab285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65946afc398d4a9fb1c9095a4f946e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:59:32.779829 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-6786dec3-1cd7-4f57-ae86-3de49ef65bbe tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc" status: 200 len: 1505 microversion: 2.1 time: 1.140240 Oct 04 20:59:32.794405 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2422/4885] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:59:31 2022] GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc => generated 1505 bytes in 1142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:59:32.794405 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-bd57cf44-150b-469e-a211-4766167ae9d1 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:59:32.794405 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-bd57cf44-150b-469e-a211-4766167ae9d1 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] [instance: 6c1e8070-fc54-4d28-90a9-1241c03b9b95] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:59:32.806382 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bd57cf44-150b-469e-a211-4766167ae9d1 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:32.817669 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bd57cf44-150b-469e-a211-4766167ae9d1 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:32.818134 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bd57cf44-150b-469e-a211-4766167ae9d1 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:32.818960 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bd57cf44-150b-469e-a211-4766167ae9d1 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:32.819455 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bd57cf44-150b-469e-a211-4766167ae9d1 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:32.819932 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bd57cf44-150b-469e-a211-4766167ae9d1 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:33.040684 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.network.neutron [None req-cf08924d-2999-4485-9251-a5e3255d01d7 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] validate_networks() for [('6d86fb77-9845-4176-9d29-ded86267866d', None, None, None, None, None)] {{(pid=128802) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 20:59:33.219920 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-bd57cf44-150b-469e-a211-4766167ae9d1 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb9d89574d941ea9c8ca7b2b8d11f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e56c6049d5741418d193fd496cbb5d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:59:33.231148 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-bd57cf44-150b-469e-a211-4766167ae9d1 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb9d89574d941ea9c8ca7b2b8d11f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e56c6049d5741418d193fd496cbb5d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:59:33.242068 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-bd57cf44-150b-469e-a211-4766167ae9d1 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb9d89574d941ea9c8ca7b2b8d11f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e56c6049d5741418d193fd496cbb5d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:59:33.243463 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-bd57cf44-150b-469e-a211-4766167ae9d1 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] 10.222.0.33 "GET /compute/v2.1/servers/6c1e8070-fc54-4d28-90a9-1241c03b9b95" status: 200 len: 1362 microversion: 2.26 time: 0.455159 Oct 04 20:59:33.248475 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2423/4886] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:59:32 2022] GET /compute/v2.1/servers/6c1e8070-fc54-4d28-90a9-1241c03b9b95 => generated 1362 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:59:33.271729 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9301a134-a13d-45a5-877e-35933f97eb81 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:59:33.275386 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-9301a134-a13d-45a5-877e-35933f97eb81 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] [instance: 320f9a98-969f-473e-bc56-842bbd28dedc] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:59:33.289835 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9301a134-a13d-45a5-877e-35933f97eb81 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:33.292582 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9301a134-a13d-45a5-877e-35933f97eb81 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:33.293111 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9301a134-a13d-45a5-877e-35933f97eb81 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:33.293914 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9301a134-a13d-45a5-877e-35933f97eb81 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:33.299695 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9301a134-a13d-45a5-877e-35933f97eb81 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:33.300289 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9301a134-a13d-45a5-877e-35933f97eb81 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:33.903998 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-9301a134-a13d-45a5-877e-35933f97eb81 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6513f5e908ac4d028cad6eeeebeab285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65946afc398d4a9fb1c9095a4f946e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:59:33.925864 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-9301a134-a13d-45a5-877e-35933f97eb81 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc" status: 200 len: 1505 microversion: 2.1 time: 0.674676 Oct 04 20:59:33.927717 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2424/4887] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:59:33 2022] GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc => generated 1505 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:59:33.942441 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-60958aa8-40e4-4efd-b221-e0ed689753b3 tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:59:33.943310 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-60958aa8-40e4-4efd-b221-e0ed689753b3 tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] [instance: beedbabd-70f0-435a-80ec-497c232a9ee3] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:59:33.985836 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-60958aa8-40e4-4efd-b221-e0ed689753b3 tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:33.987237 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-60958aa8-40e4-4efd-b221-e0ed689753b3 tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:33.989848 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-60958aa8-40e4-4efd-b221-e0ed689753b3 tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:33.990918 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-60958aa8-40e4-4efd-b221-e0ed689753b3 tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:33.991562 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-60958aa8-40e4-4efd-b221-e0ed689753b3 tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:33.992252 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-60958aa8-40e4-4efd-b221-e0ed689753b3 tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:34.539847 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-cf08924d-2999-4485-9251-a5e3255d01d7 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Flavor limits 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 20:59:34.541690 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-cf08924d-2999-4485-9251-a5e3255d01d7 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Image limits 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 20:59:34.545893 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-cf08924d-2999-4485-9251-a5e3255d01d7 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Flavor pref 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 20:59:34.547105 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-cf08924d-2999-4485-9251-a5e3255d01d7 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Image pref 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 20:59:34.550588 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-cf08924d-2999-4485-9251-a5e3255d01d7 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 20:59:34.583822 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cf08924d-2999-4485-9251-a5e3255d01d7 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:34.588141 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cf08924d-2999-4485-9251-a5e3255d01d7 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:34.588833 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cf08924d-2999-4485-9251-a5e3255d01d7 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:34.591649 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cf08924d-2999-4485-9251-a5e3255d01d7 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:34.592495 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cf08924d-2999-4485-9251-a5e3255d01d7 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:34.593153 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cf08924d-2999-4485-9251-a5e3255d01d7 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:34.635532 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-cf08924d-2999-4485-9251-a5e3255d01d7 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Getting quotas for project b3aa23aee3c8435c8f1f409019c5fed2. Resources: {'ram', 'instances', 'cores'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 20:59:34.644488 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-cf08924d-2999-4485-9251-a5e3255d01d7 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Getting quotas for user 0be5dbe3da6a4af181ef7302fe605fb4 and project b3aa23aee3c8435c8f1f409019c5fed2. Resources: {'ram', 'instances', 'cores'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 20:59:34.681462 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-60958aa8-40e4-4efd-b221-e0ed689753b3 tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25849c543c84fb7a87a74c11f8d7990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c2d7a7a44e4ea78f2974539bf9a173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:59:34.708436 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-60958aa8-40e4-4efd-b221-e0ed689753b3 tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] 10.222.0.33 "GET /compute/v2.1/servers/beedbabd-70f0-435a-80ec-497c232a9ee3" status: 200 len: 1521 microversion: 2.1 time: 0.770603 Oct 04 20:59:34.709034 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2425/4888] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:59:33 2022] GET /compute/v2.1/servers/beedbabd-70f0-435a-80ec-497c232a9ee3 => generated 1521 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:59:34.711022 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-cf08924d-2999-4485-9251-a5e3255d01d7 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Going to run 1 instances... {{(pid=128802) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 20:59:34.714983 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-cf08924d-2999-4485-9251-a5e3255d01d7 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] [instance: 243cbbbd-0734-4711-b605-c0657b81e359] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='15b24725-0c99-4bcf-b1fb-907cdf8e2d63',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128802) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 20:59:34.728304 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b20bbb16-8b49-44ee-8b18-74196db04ae2 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:59:34.729211 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b20bbb16-8b49-44ee-8b18-74196db04ae2 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] [instance: 320f9a98-969f-473e-bc56-842bbd28dedc] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:59:34.745677 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b20bbb16-8b49-44ee-8b18-74196db04ae2 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:34.751055 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b20bbb16-8b49-44ee-8b18-74196db04ae2 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:34.751507 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b20bbb16-8b49-44ee-8b18-74196db04ae2 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:34.752792 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b20bbb16-8b49-44ee-8b18-74196db04ae2 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:34.753250 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b20bbb16-8b49-44ee-8b18-74196db04ae2 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:34.753675 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b20bbb16-8b49-44ee-8b18-74196db04ae2 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:34.840208 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-b20bbb16-8b49-44ee-8b18-74196db04ae2 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lazy-loading 'flavor' on Instance uuid 320f9a98-969f-473e-bc56-842bbd28dedc {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:59:34.885491 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-cf08924d-2999-4485-9251-a5e3255d01d7 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.201456 Oct 04 20:59:34.890019 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2464/4889] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 20:59:32 2022] POST /compute/v2.1/servers => generated 405 bytes in 2206 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 20:59:34.899222 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-2fc23b65-921f-4cf7-8aec-5f4ea3b34b8b tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:59:34.899222 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-2fc23b65-921f-4cf7-8aec-5f4ea3b34b8b tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] [instance: 6c1e8070-fc54-4d28-90a9-1241c03b9b95] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:59:34.945571 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2fc23b65-921f-4cf7-8aec-5f4ea3b34b8b tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:34.947902 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2fc23b65-921f-4cf7-8aec-5f4ea3b34b8b tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:34.949116 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2fc23b65-921f-4cf7-8aec-5f4ea3b34b8b tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:34.950311 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2fc23b65-921f-4cf7-8aec-5f4ea3b34b8b tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:34.954288 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2fc23b65-921f-4cf7-8aec-5f4ea3b34b8b tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:34.956590 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2fc23b65-921f-4cf7-8aec-5f4ea3b34b8b tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:35.438579 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b20bbb16-8b49-44ee-8b18-74196db04ae2 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "POST /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc/action" status: 202 len: 0 microversion: 2.1 time: 0.727318 Oct 04 20:59:35.445312 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2426/4890] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 20:59:34 2022] POST /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc/action => generated 0 bytes in 736 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 20:59:35.484880 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-484eb978-53c7-4133-9961-d44a306db8ad tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1364060240", "imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "f9d0fd82-0389-4f6f-abc2-e85dbabc0cc6"}]}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:59:35.516397 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-484eb978-53c7-4133-9961-d44a306db8ad tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] Request method failure captured: Oct 04 20:59:35.516397 n-d-854823-8 devstack@n-api.service[128801]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 20:59:35.516397 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:59:35.516397 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:59:35.516397 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:59:35.516397 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 243 Oct 04 20:59:35.516397 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:59:35.516397 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:59:35.516397 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:59:35.516397 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:59:35.516397 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJ6WwKMAlY2ZpOMNDQ9y8sLpb5t0Vu0B-YpqzzPope3GaLlFLpVUwVCCZLJ1W8fI41mBPAEm-PMBybTImReqTXoDJylNCJidwYXwBhhh_MF1OcO5y8txG4p_JKebzrXZLpAk4zIoX6sjI4GfDKd94m8mH0DVpOMUnQ2xS7FiJhU5kUM Oct 04 20:59:35.516397 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:59:35.516397 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:59:35.516397 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:59:35.516397 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:59:35.516397 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:59:35.516397 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:59:35.516397 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: c3c2d7a7a44e4ea78f2974539bf9a173 Oct 04 20:59:35.516397 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-554011785 Oct 04 20:59:35.516397 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 20:59:35.516397 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 20:59:35.516397 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_c3c2d7a7a44e4ea78f2974539bf9a173", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c3c2d7a7a44e4ea78f2974539bf9a173"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c3c2d7a7a44e4ea78f2974539bf9a173"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/c3c2d7a7a44e4ea78f2974539bf9a173"}]}] Oct 04 20:59:35.516397 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-554011785 Oct 04 20:59:35.516397 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: c3c2d7a7a44e4ea78f2974539bf9a173 Oct 04 20:59:35.516397 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-554011785 Oct 04 20:59:35.516397 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-ServerMetadataNegativeTestJSON-554011785-project Oct 04 20:59:35.516397 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:59:35.516397 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:59:35.516397 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: d25849c543c84fb7a87a74c11f8d7990 Oct 04 20:59:35.516397 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-554011785-project Oct 04 20:59:35.516397 n-d-854823-8 devstack@n-api.service[128801]: Oct 04 20:59:35.516397 n-d-854823-8 devstack@n-api.service[128801]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1364060240", "imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "f9d0fd82-0389-4f6f-abc2-e85dbabc0cc6"}]}} Oct 04 20:59:35.516397 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 20:59:35.516397 n-d-854823-8 devstack@n-api.service[128801]: exception: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 20:59:35.516397 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1364060240', 'imageRef': '15b24725-0c99-4bcf-b1fb-907cdf8e2d63', 'flavorRef': '452', 'metadata': {'': 'data1'}, 'networks': [{'uuid': 'f9d0fd82-0389-4f6f-abc2-e85dbabc0cc6'}]}}} Oct 04 20:59:35.516397 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:59:35.516397 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:59:35.516397 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 20:59:35.516397 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 20:59:35.516397 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 20:59:35.516397 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise error Oct 04 20:59:35.516397 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 20:59:35.516397 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:59:35.516397 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 04 20:59:35.516397 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 04 20:59:35.516397 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 04 20:59:35.516397 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 04 20:59:35.516397 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 04 20:59:35.516397 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:59:35.516397 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 04 20:59:35.516397 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi {'': 'data1'} Oct 04 20:59:35.516397 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:59:35.516397 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:59:35.516397 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:59:35.516397 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:59:35.516397 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:59:35.516397 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:59:35.516397 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:59:35.516397 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:59:35.516397 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:59:35.516397 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:59:35.516397 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:59:35.524598 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:59:35.524598 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 20:59:35.524598 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 20:59:35.524598 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 20:59:35.524598 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 20:59:35.524598 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 20:59:35.524598 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 20:59:35.524598 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 20:59:35.524598 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:59:35.524598 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:59:35.524598 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:59:35.524598 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:59:35.524598 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:59:35.524598 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:59:35.524598 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 20:59:35.524598 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 20:59:35.524598 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 20:59:35.524598 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:59:35.530453 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-484eb978-53c7-4133-9961-d44a306db8ad tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:59:35.533176 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-484eb978-53c7-4133-9961-d44a306db8ad tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 400 len: 175 microversion: 2.1 time: 0.085161 Oct 04 20:59:35.544962 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2427/4891] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 20:59:35 2022] POST /compute/v2.1/servers => generated 175 bytes in 99 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 20:59:35.561422 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b704067c-ff64-4a84-9b9a-13751e2b6e3d tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:59:35.575312 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b704067c-ff64-4a84-9b9a-13751e2b6e3d tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] [instance: 243cbbbd-0734-4711-b605-c0657b81e359] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:59:35.600444 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-2fc23b65-921f-4cf7-8aec-5f4ea3b34b8b tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb9d89574d941ea9c8ca7b2b8d11f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e56c6049d5741418d193fd496cbb5d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:59:35.615168 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-2fc23b65-921f-4cf7-8aec-5f4ea3b34b8b tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb9d89574d941ea9c8ca7b2b8d11f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e56c6049d5741418d193fd496cbb5d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:59:35.620956 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-2fc23b65-921f-4cf7-8aec-5f4ea3b34b8b tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb9d89574d941ea9c8ca7b2b8d11f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e56c6049d5741418d193fd496cbb5d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:59:35.623981 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-2fc23b65-921f-4cf7-8aec-5f4ea3b34b8b tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] 10.222.0.33 "GET /compute/v2.1/servers/6c1e8070-fc54-4d28-90a9-1241c03b9b95" status: 200 len: 1362 microversion: 2.26 time: 0.728259 Oct 04 20:59:35.624799 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2465/4892] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:59:34 2022] GET /compute/v2.1/servers/6c1e8070-fc54-4d28-90a9-1241c03b9b95 => generated 1362 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:59:35.634433 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-cdf87e2a-ee44-4116-a8ce-16fbeade00d6 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:59:35.635388 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-cdf87e2a-ee44-4116-a8ce-16fbeade00d6 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] [instance: 320f9a98-969f-473e-bc56-842bbd28dedc] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:59:35.671955 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cdf87e2a-ee44-4116-a8ce-16fbeade00d6 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:35.676091 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cdf87e2a-ee44-4116-a8ce-16fbeade00d6 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:35.680186 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cdf87e2a-ee44-4116-a8ce-16fbeade00d6 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:35.683654 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cdf87e2a-ee44-4116-a8ce-16fbeade00d6 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:35.686038 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cdf87e2a-ee44-4116-a8ce-16fbeade00d6 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:35.687816 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cdf87e2a-ee44-4116-a8ce-16fbeade00d6 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:35.815837 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-b704067c-ff64-4a84-9b9a-13751e2b6e3d tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5dbe3da6a4af181ef7302fe605fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3aa23aee3c8435c8f1f409019c5fed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:59:35.832045 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b704067c-ff64-4a84-9b9a-13751e2b6e3d tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] 10.222.0.33 "GET /compute/v2.1/servers/243cbbbd-0734-4711-b605-c0657b81e359" status: 200 len: 1266 microversion: 2.1 time: 0.282556 Oct 04 20:59:35.833880 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2428/4893] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:59:35 2022] GET /compute/v2.1/servers/243cbbbd-0734-4711-b605-c0657b81e359 => generated 1266 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:59:35.839889 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-60b72b44-6e4f-44d0-89fa-996af54c3381 tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:59:35.840674 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-60b72b44-6e4f-44d0-89fa-996af54c3381 tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] [instance: a560c2bd-6805-423f-ad79-69b9dc841e82] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:59:35.847966 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-60b72b44-6e4f-44d0-89fa-996af54c3381 tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] HTTP exception thrown: Instance a560c2bd-6805-423f-ad79-69b9dc841e82 could not be found. Oct 04 20:59:35.865294 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-60b72b44-6e4f-44d0-89fa-996af54c3381 tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] Request method failure captured: Oct 04 20:59:35.865294 n-d-854823-8 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/a560c2bd-6805-423f-ad79-69b9dc841e82/metadata HTTP/1.1 Oct 04 20:59:35.865294 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:59:35.865294 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:59:35.865294 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:59:35.865294 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 0 Oct 04 20:59:35.865294 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:59:35.865294 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:59:35.865294 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:59:35.865294 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:59:35.865294 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJ6WwKMAlY2ZpOMNDQ9y8sLpb5t0Vu0B-YpqzzPope3GaLlFLpVUwVCCZLJ1W8fI41mBPAEm-PMBybTImReqTXoDJylNCJidwYXwBhhh_MF1OcO5y8txG4p_JKebzrXZLpAk4zIoX6sjI4GfDKd94m8mH0DVpOMUnQ2xS7FiJhU5kUM Oct 04 20:59:35.865294 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:59:35.865294 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:59:35.865294 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:59:35.865294 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:59:35.865294 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:59:35.865294 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:59:35.865294 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: c3c2d7a7a44e4ea78f2974539bf9a173 Oct 04 20:59:35.865294 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-554011785 Oct 04 20:59:35.865294 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 20:59:35.865294 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 20:59:35.865294 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_c3c2d7a7a44e4ea78f2974539bf9a173", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c3c2d7a7a44e4ea78f2974539bf9a173"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c3c2d7a7a44e4ea78f2974539bf9a173"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/c3c2d7a7a44e4ea78f2974539bf9a173"}]}] Oct 04 20:59:35.865294 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-554011785 Oct 04 20:59:35.865294 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: c3c2d7a7a44e4ea78f2974539bf9a173 Oct 04 20:59:35.865294 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-554011785 Oct 04 20:59:35.865294 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-ServerMetadataNegativeTestJSON-554011785-project Oct 04 20:59:35.865294 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:59:35.865294 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:59:35.865294 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: d25849c543c84fb7a87a74c11f8d7990 Oct 04 20:59:35.865294 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-554011785-project Oct 04 20:59:35.865294 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 20:59:35.865294 n-d-854823-8 devstack@n-api.service[128801]: exception: Instance a560c2bd-6805-423f-ad79-69b9dc841e82 could not be found. Oct 04 20:59:35.865294 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'server_id': 'a560c2bd-6805-423f-ad79-69b9dc841e82'} Oct 04 20:59:35.865294 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:59:35.865294 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:59:35.865294 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:59:35.865294 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:59:35.865294 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:59:35.865294 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:59:35.865294 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 20:59:35.865294 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 20:59:35.865294 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a560c2bd-6805-423f-ad79-69b9dc841e82 could not be found. Oct 04 20:59:35.865294 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:59:35.865294 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:59:35.865294 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:59:35.865294 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:59:35.865294 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:59:35.865294 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:59:35.865294 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:59:35.865294 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:59:35.865294 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:59:35.865294 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:59:35.865294 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 54, in index Oct 04 20:59:35.865294 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Oct 04 20:59:35.865294 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:59:35.865294 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:59:35.865294 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a560c2bd-6805-423f-ad79-69b9dc841e82 could not be found. Oct 04 20:59:35.865294 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:59:35.865294 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:59:35.865294 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:59:35.865294 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:59:35.865294 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:59:35.865294 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:59:35.871639 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:59:35.871639 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:59:35.871639 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a560c2bd-6805-423f-ad79-69b9dc841e82 could not be found. Oct 04 20:59:35.871639 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:59:35.873789 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-60b72b44-6e4f-44d0-89fa-996af54c3381 tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] Returning 404 to user: Instance a560c2bd-6805-423f-ad79-69b9dc841e82 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:59:35.875239 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-60b72b44-6e4f-44d0-89fa-996af54c3381 tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] 10.222.0.33 "GET /compute/v2.1/servers/a560c2bd-6805-423f-ad79-69b9dc841e82/metadata" status: 404 len: 111 microversion: 2.1 time: 0.040048 Oct 04 20:59:35.876374 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2429/4894] 10.222.0.33 () {58 vars in 1263 bytes} [Tue Oct 4 20:59:35 2022] GET /compute/v2.1/servers/a560c2bd-6805-423f-ad79-69b9dc841e82/metadata => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:59:35.982559 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0368a3fe-76fa-4ee7-8c4e-4695825172b8 tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-61252872", "imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "f9d0fd82-0389-4f6f-abc2-e85dbabc0cc6"}]}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:59:36.001701 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0368a3fe-76fa-4ee7-8c4e-4695825172b8 tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] Request method failure captured: Oct 04 20:59:36.001701 n-d-854823-8 devstack@n-api.service[128801]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 20:59:36.001701 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:59:36.001701 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:59:36.001701 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:59:36.001701 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 497 Oct 04 20:59:36.001701 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:59:36.001701 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:59:36.001701 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:59:36.001701 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:59:36.001701 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJ6WwKMAlY2ZpOMNDQ9y8sLpb5t0Vu0B-YpqzzPope3GaLlFLpVUwVCCZLJ1W8fI41mBPAEm-PMBybTImReqTXoDJylNCJidwYXwBhhh_MF1OcO5y8txG4p_JKebzrXZLpAk4zIoX6sjI4GfDKd94m8mH0DVpOMUnQ2xS7FiJhU5kUM Oct 04 20:59:36.001701 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:59:36.001701 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:59:36.001701 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:59:36.001701 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:59:36.001701 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:59:36.001701 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:59:36.001701 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: c3c2d7a7a44e4ea78f2974539bf9a173 Oct 04 20:59:36.001701 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-554011785 Oct 04 20:59:36.001701 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 20:59:36.001701 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 20:59:36.001701 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_c3c2d7a7a44e4ea78f2974539bf9a173", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c3c2d7a7a44e4ea78f2974539bf9a173"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c3c2d7a7a44e4ea78f2974539bf9a173"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/c3c2d7a7a44e4ea78f2974539bf9a173"}]}] Oct 04 20:59:36.001701 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-554011785 Oct 04 20:59:36.001701 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: c3c2d7a7a44e4ea78f2974539bf9a173 Oct 04 20:59:36.001701 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-554011785 Oct 04 20:59:36.001701 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-ServerMetadataNegativeTestJSON-554011785-project Oct 04 20:59:36.001701 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:59:36.001701 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:59:36.001701 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: d25849c543c84fb7a87a74c11f8d7990 Oct 04 20:59:36.001701 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-554011785-project Oct 04 20:59:36.001701 n-d-854823-8 devstack@n-api.service[128801]: Oct 04 20:59:36.001701 n-d-854823-8 devstack@n-api.service[128801]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-61252872", "imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "f9d0fd82-0389-4f6f-abc2-e85dbabc0cc6"}]}} Oct 04 20:59:36.001701 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 20:59:36.001701 n-d-854823-8 devstack@n-api.service[128801]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 20:59:36.001701 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-61252872', 'imageRef': '15b24725-0c99-4bcf-b1fb-907cdf8e2d63', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': 'f9d0fd82-0389-4f6f-abc2-e85dbabc0cc6'}]}}} Oct 04 20:59:36.001701 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:59:36.001701 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:59:36.001701 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 20:59:36.001701 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 20:59:36.001701 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 20:59:36.001701 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise error Oct 04 20:59:36.001701 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 20:59:36.001701 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:59:36.001701 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 04 20:59:36.001701 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 04 20:59:36.001701 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 04 20:59:36.001701 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 04 20:59:36.006105 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 04 20:59:36.006105 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:59:36.006105 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 04 20:59:36.006105 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 04 20:59:36.006105 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:59:36.006105 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:59:36.006105 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:59:36.006105 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:59:36.006105 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:59:36.006105 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:59:36.006105 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:59:36.006105 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:59:36.006105 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:59:36.006105 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:59:36.006105 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:59:36.006105 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:59:36.006105 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 20:59:36.006105 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 20:59:36.006105 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 20:59:36.006105 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 20:59:36.006105 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 20:59:36.006105 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 20:59:36.006105 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 20:59:36.006105 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:59:36.006105 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:59:36.006105 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:59:36.006105 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:59:36.006105 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:59:36.006105 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:59:36.006105 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 20:59:36.006105 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 20:59:36.006105 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 20:59:36.006105 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:59:36.011464 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0368a3fe-76fa-4ee7-8c4e-4695825172b8 tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:59:36.012865 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-0368a3fe-76fa-4ee7-8c4e-4695825172b8 tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 400 len: 687 microversion: 2.1 time: 0.036232 Oct 04 20:59:36.014001 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2430/4895] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 20:59:35 2022] POST /compute/v2.1/servers => generated 687 bytes in 38 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 04 20:59:36.124189 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7a450c88-fa76-4afc-976c-5a05310cb70e tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-539327786", "imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "f9d0fd82-0389-4f6f-abc2-e85dbabc0cc6"}]}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:59:36.133835 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7a450c88-fa76-4afc-976c-5a05310cb70e tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] Request method failure captured: Oct 04 20:59:36.133835 n-d-854823-8 devstack@n-api.service[128801]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 20:59:36.133835 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:59:36.133835 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:59:36.133835 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:59:36.133835 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 499 Oct 04 20:59:36.133835 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:59:36.133835 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:59:36.133835 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:59:36.133835 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:59:36.133835 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJ6WwKMAlY2ZpOMNDQ9y8sLpb5t0Vu0B-YpqzzPope3GaLlFLpVUwVCCZLJ1W8fI41mBPAEm-PMBybTImReqTXoDJylNCJidwYXwBhhh_MF1OcO5y8txG4p_JKebzrXZLpAk4zIoX6sjI4GfDKd94m8mH0DVpOMUnQ2xS7FiJhU5kUM Oct 04 20:59:36.133835 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:59:36.133835 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:59:36.133835 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:59:36.133835 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:59:36.133835 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:59:36.133835 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:59:36.133835 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: c3c2d7a7a44e4ea78f2974539bf9a173 Oct 04 20:59:36.133835 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-554011785 Oct 04 20:59:36.133835 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 20:59:36.133835 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 20:59:36.133835 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_c3c2d7a7a44e4ea78f2974539bf9a173", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c3c2d7a7a44e4ea78f2974539bf9a173"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c3c2d7a7a44e4ea78f2974539bf9a173"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/c3c2d7a7a44e4ea78f2974539bf9a173"}]}] Oct 04 20:59:36.133835 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-554011785 Oct 04 20:59:36.133835 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: c3c2d7a7a44e4ea78f2974539bf9a173 Oct 04 20:59:36.133835 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-554011785 Oct 04 20:59:36.133835 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-ServerMetadataNegativeTestJSON-554011785-project Oct 04 20:59:36.133835 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:59:36.133835 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:59:36.133835 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: d25849c543c84fb7a87a74c11f8d7990 Oct 04 20:59:36.133835 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-554011785-project Oct 04 20:59:36.133835 n-d-854823-8 devstack@n-api.service[128801]: Oct 04 20:59:36.133835 n-d-854823-8 devstack@n-api.service[128801]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-539327786", "imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "f9d0fd82-0389-4f6f-abc2-e85dbabc0cc6"}]}} Oct 04 20:59:36.133835 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 20:59:36.133835 n-d-854823-8 devstack@n-api.service[128801]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 20:59:36.133835 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-539327786', 'imageRef': '15b24725-0c99-4bcf-b1fb-907cdf8e2d63', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': 'f9d0fd82-0389-4f6f-abc2-e85dbabc0cc6'}]}}} Oct 04 20:59:36.133835 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:59:36.133835 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:59:36.133835 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 20:59:36.133835 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 20:59:36.133835 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 20:59:36.133835 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise error Oct 04 20:59:36.133835 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 20:59:36.133835 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:59:36.133835 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 04 20:59:36.133835 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 04 20:59:36.133835 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 04 20:59:36.133835 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 04 20:59:36.138266 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 04 20:59:36.138266 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:59:36.138266 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 04 20:59:36.138266 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 04 20:59:36.138266 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:59:36.138266 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:59:36.138266 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:59:36.138266 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:59:36.138266 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:59:36.138266 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:59:36.138266 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:59:36.138266 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:59:36.138266 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:59:36.138266 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:59:36.138266 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:59:36.138266 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:59:36.138266 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 20:59:36.138266 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 20:59:36.138266 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 20:59:36.138266 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 20:59:36.138266 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 20:59:36.138266 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 20:59:36.138266 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 20:59:36.138266 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:59:36.138266 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:59:36.138266 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:59:36.138266 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:59:36.138266 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:59:36.138266 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:59:36.138266 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 20:59:36.138266 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 20:59:36.138266 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 20:59:36.138266 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:59:36.145334 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7a450c88-fa76-4afc-976c-5a05310cb70e tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:59:36.150878 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-7a450c88-fa76-4afc-976c-5a05310cb70e tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 400 len: 689 microversion: 2.1 time: 0.030110 Oct 04 20:59:36.155801 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2431/4896] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 20:59:36 2022] POST /compute/v2.1/servers => generated 689 bytes in 38 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 20:59:36.267486 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b345841a-3d12-4790-860a-7ae51299c6cf tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-157401212", "imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "f9d0fd82-0389-4f6f-abc2-e85dbabc0cc6"}]}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:59:36.299206 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b345841a-3d12-4790-860a-7ae51299c6cf tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] Request method failure captured: Oct 04 20:59:36.299206 n-d-854823-8 devstack@n-api.service[128801]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 20:59:36.299206 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:59:36.299206 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:59:36.299206 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:59:36.299206 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 753 Oct 04 20:59:36.299206 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:59:36.299206 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:59:36.299206 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:59:36.299206 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:59:36.299206 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJ6WwKMAlY2ZpOMNDQ9y8sLpb5t0Vu0B-YpqzzPope3GaLlFLpVUwVCCZLJ1W8fI41mBPAEm-PMBybTImReqTXoDJylNCJidwYXwBhhh_MF1OcO5y8txG4p_JKebzrXZLpAk4zIoX6sjI4GfDKd94m8mH0DVpOMUnQ2xS7FiJhU5kUM Oct 04 20:59:36.299206 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:59:36.299206 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:59:36.299206 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:59:36.299206 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:59:36.299206 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:59:36.299206 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:59:36.299206 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: c3c2d7a7a44e4ea78f2974539bf9a173 Oct 04 20:59:36.299206 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-554011785 Oct 04 20:59:36.299206 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 20:59:36.299206 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 20:59:36.299206 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_c3c2d7a7a44e4ea78f2974539bf9a173", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c3c2d7a7a44e4ea78f2974539bf9a173"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c3c2d7a7a44e4ea78f2974539bf9a173"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/c3c2d7a7a44e4ea78f2974539bf9a173"}]}] Oct 04 20:59:36.299206 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-554011785 Oct 04 20:59:36.299206 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: c3c2d7a7a44e4ea78f2974539bf9a173 Oct 04 20:59:36.299206 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-554011785 Oct 04 20:59:36.299206 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-ServerMetadataNegativeTestJSON-554011785-project Oct 04 20:59:36.299206 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:59:36.299206 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:59:36.299206 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: d25849c543c84fb7a87a74c11f8d7990 Oct 04 20:59:36.299206 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-554011785-project Oct 04 20:59:36.299206 n-d-854823-8 devstack@n-api.service[128801]: Oct 04 20:59:36.299206 n-d-854823-8 devstack@n-api.service[128801]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-157401212", "imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "f9d0fd82-0389-4f6f-abc2-e85dbabc0cc6"}]}} Oct 04 20:59:36.299206 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 20:59:36.299206 n-d-854823-8 devstack@n-api.service[128801]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 20:59:36.299206 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-157401212', 'imageRef': '15b24725-0c99-4bcf-b1fb-907cdf8e2d63', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': 'f9d0fd82-0389-4f6f-abc2-e85dbabc0cc6'}]}}} Oct 04 20:59:36.299206 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:59:36.299206 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:59:36.299206 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 20:59:36.299206 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 20:59:36.299206 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 20:59:36.304202 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise error Oct 04 20:59:36.304202 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 20:59:36.304202 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:59:36.304202 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 04 20:59:36.304202 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 04 20:59:36.304202 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 04 20:59:36.304202 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 04 20:59:36.304202 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 04 20:59:36.304202 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:59:36.304202 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 04 20:59:36.304202 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 04 20:59:36.304202 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:59:36.304202 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:59:36.304202 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:59:36.304202 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:59:36.304202 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:59:36.304202 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:59:36.304202 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:59:36.304202 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:59:36.304202 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:59:36.304202 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:59:36.304202 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:59:36.304202 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:59:36.304202 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 20:59:36.304202 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 20:59:36.304202 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 20:59:36.304202 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 20:59:36.304202 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 20:59:36.304202 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 20:59:36.304202 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 20:59:36.304202 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:59:36.304202 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:59:36.304202 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:59:36.304202 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:59:36.304202 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:59:36.304202 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:59:36.304202 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 20:59:36.304202 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 20:59:36.307779 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 20:59:36.307779 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:59:36.307779 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b345841a-3d12-4790-860a-7ae51299c6cf tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:59:36.307779 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b345841a-3d12-4790-860a-7ae51299c6cf tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 400 len: 1197 microversion: 2.1 time: 0.054364 Oct 04 20:59:36.310983 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2432/4897] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 20:59:36 2022] POST /compute/v2.1/servers => generated 1197 bytes in 60 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Oct 04 20:59:36.462226 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f23fc310-634b-4286-850a-5a2227046d0d tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-969816479", "imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "f9d0fd82-0389-4f6f-abc2-e85dbabc0cc6"}]}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:59:36.488858 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f23fc310-634b-4286-850a-5a2227046d0d tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] Request method failure captured: Oct 04 20:59:36.488858 n-d-854823-8 devstack@n-api.service[128801]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 20:59:36.488858 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:59:36.488858 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:59:36.488858 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:59:36.488858 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 1265 Oct 04 20:59:36.488858 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:59:36.488858 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:59:36.488858 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:59:36.488858 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:59:36.488858 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJ6WwKMAlY2ZpOMNDQ9y8sLpb5t0Vu0B-YpqzzPope3GaLlFLpVUwVCCZLJ1W8fI41mBPAEm-PMBybTImReqTXoDJylNCJidwYXwBhhh_MF1OcO5y8txG4p_JKebzrXZLpAk4zIoX6sjI4GfDKd94m8mH0DVpOMUnQ2xS7FiJhU5kUM Oct 04 20:59:36.488858 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:59:36.488858 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:59:36.488858 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:59:36.488858 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:59:36.488858 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:59:36.488858 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:59:36.488858 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: c3c2d7a7a44e4ea78f2974539bf9a173 Oct 04 20:59:36.488858 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-554011785 Oct 04 20:59:36.488858 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 20:59:36.488858 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 20:59:36.488858 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_c3c2d7a7a44e4ea78f2974539bf9a173", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c3c2d7a7a44e4ea78f2974539bf9a173"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c3c2d7a7a44e4ea78f2974539bf9a173"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/c3c2d7a7a44e4ea78f2974539bf9a173"}]}] Oct 04 20:59:36.488858 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-554011785 Oct 04 20:59:36.488858 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: c3c2d7a7a44e4ea78f2974539bf9a173 Oct 04 20:59:36.488858 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-554011785 Oct 04 20:59:36.488858 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-ServerMetadataNegativeTestJSON-554011785-project Oct 04 20:59:36.488858 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:59:36.488858 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:59:36.488858 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: d25849c543c84fb7a87a74c11f8d7990 Oct 04 20:59:36.488858 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-554011785-project Oct 04 20:59:36.488858 n-d-854823-8 devstack@n-api.service[128801]: Oct 04 20:59:36.488858 n-d-854823-8 devstack@n-api.service[128801]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-969816479", "imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "f9d0fd82-0389-4f6f-abc2-e85dbabc0cc6"}]}} Oct 04 20:59:36.488858 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 20:59:36.491653 n-d-854823-8 devstack@n-api.service[128801]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 20:59:36.491653 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-969816479', 'imageRef': '15b24725-0c99-4bcf-b1fb-907cdf8e2d63', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': 'f9d0fd82-0389-4f6f-abc2-e85dbabc0cc6'}]}}} Oct 04 20:59:36.491653 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:59:36.491653 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:59:36.491653 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 20:59:36.491653 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 20:59:36.491653 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 20:59:36.491653 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise error Oct 04 20:59:36.491653 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 20:59:36.491653 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:59:36.491653 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 04 20:59:36.491653 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 04 20:59:36.491653 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 04 20:59:36.491653 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 04 20:59:36.491653 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 04 20:59:36.491653 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:59:36.491653 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 04 20:59:36.494180 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 04 20:59:36.494180 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:59:36.494180 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:59:36.494180 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:59:36.494180 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:59:36.494180 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:59:36.494180 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:59:36.494180 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:59:36.494180 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:59:36.494180 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:59:36.494180 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:59:36.494180 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 20:59:36.494180 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 20:59:36.494180 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 20:59:36.494180 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 20:59:36.494180 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 20:59:36.494180 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 20:59:36.494180 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 20:59:36.494180 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 20:59:36.494180 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 20:59:36.494180 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:59:36.494180 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:59:36.494180 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:59:36.494180 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:59:36.494180 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:59:36.494180 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:59:36.494180 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 20:59:36.494180 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 20:59:36.496570 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 20:59:36.496570 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:59:36.514597 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f23fc310-634b-4286-850a-5a2227046d0d tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:59:36.516046 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f23fc310-634b-4286-850a-5a2227046d0d tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 400 len: 2221 microversion: 2.1 time: 0.060283 Oct 04 20:59:36.517844 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2433/4898] 10.222.0.33 () {60 vars in 1148 bytes} [Tue Oct 4 20:59:36 2022] POST /compute/v2.1/servers => generated 2221 bytes in 62 msecs (HTTP/1.1 400) 9 headers in 382 bytes (2 switches on core 0) Oct 04 20:59:36.550103 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-72959ce3-125c-4682-b593-b08cdb3ea654 tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:59:36.551231 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-72959ce3-125c-4682-b593-b08cdb3ea654 tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] [instance: 54473760-7c2c-4dcf-bd0b-21534b7ab0b4] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:59:36.562387 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-72959ce3-125c-4682-b593-b08cdb3ea654 tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] HTTP exception thrown: Instance 54473760-7c2c-4dcf-bd0b-21534b7ab0b4 could not be found. Oct 04 20:59:36.564393 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-72959ce3-125c-4682-b593-b08cdb3ea654 tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] Request method failure captured: Oct 04 20:59:36.564393 n-d-854823-8 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/54473760-7c2c-4dcf-bd0b-21534b7ab0b4/metadata/test2 HTTP/1.1 Oct 04 20:59:36.564393 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 20:59:36.564393 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 20:59:36.564393 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 20:59:36.564393 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 0 Oct 04 20:59:36.564393 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 20:59:36.564393 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 20:59:36.564393 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 20:59:36.564393 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 20:59:36.564393 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJ6WwKMAlY2ZpOMNDQ9y8sLpb5t0Vu0B-YpqzzPope3GaLlFLpVUwVCCZLJ1W8fI41mBPAEm-PMBybTImReqTXoDJylNCJidwYXwBhhh_MF1OcO5y8txG4p_JKebzrXZLpAk4zIoX6sjI4GfDKd94m8mH0DVpOMUnQ2xS7FiJhU5kUM Oct 04 20:59:36.564393 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 20:59:36.564393 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 20:59:36.564393 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 20:59:36.564393 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 20:59:36.564393 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 20:59:36.564393 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 20:59:36.564393 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: c3c2d7a7a44e4ea78f2974539bf9a173 Oct 04 20:59:36.564393 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-554011785 Oct 04 20:59:36.564393 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 20:59:36.564393 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 20:59:36.564393 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_c3c2d7a7a44e4ea78f2974539bf9a173", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c3c2d7a7a44e4ea78f2974539bf9a173"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c3c2d7a7a44e4ea78f2974539bf9a173"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/c3c2d7a7a44e4ea78f2974539bf9a173"}]}] Oct 04 20:59:36.564393 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-554011785 Oct 04 20:59:36.564393 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: c3c2d7a7a44e4ea78f2974539bf9a173 Oct 04 20:59:36.564393 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-554011785 Oct 04 20:59:36.564393 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-ServerMetadataNegativeTestJSON-554011785-project Oct 04 20:59:36.564393 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 20:59:36.564393 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 20:59:36.564393 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: d25849c543c84fb7a87a74c11f8d7990 Oct 04 20:59:36.564393 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-554011785-project Oct 04 20:59:36.564393 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 20:59:36.564393 n-d-854823-8 devstack@n-api.service[128801]: exception: Instance 54473760-7c2c-4dcf-bd0b-21534b7ab0b4 could not be found. Oct 04 20:59:36.564393 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'server_id': '54473760-7c2c-4dcf-bd0b-21534b7ab0b4', 'id': 'test2'} Oct 04 20:59:36.564393 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:59:36.564393 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:59:36.564393 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:59:36.564393 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:59:36.564393 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:59:36.564393 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:59:36.564393 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 20:59:36.564393 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 20:59:36.564393 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 54473760-7c2c-4dcf-bd0b-21534b7ab0b4 could not be found. Oct 04 20:59:36.564393 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:59:36.564393 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:59:36.564393 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:59:36.564393 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:59:36.564393 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:59:36.564393 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:59:36.564393 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:59:36.564393 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:59:36.564393 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:59:36.564393 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:59:36.564393 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 129, in show Oct 04 20:59:36.564393 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Oct 04 20:59:36.564393 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:59:36.564393 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:59:36.564393 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 54473760-7c2c-4dcf-bd0b-21534b7ab0b4 could not be found. Oct 04 20:59:36.564393 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:59:36.564393 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:59:36.564393 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:59:36.564393 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:59:36.564393 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:59:36.564393 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:59:36.570091 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:59:36.570091 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:59:36.570091 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 54473760-7c2c-4dcf-bd0b-21534b7ab0b4 could not be found. Oct 04 20:59:36.570091 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 20:59:36.570091 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-72959ce3-125c-4682-b593-b08cdb3ea654 tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] Returning 404 to user: Instance 54473760-7c2c-4dcf-bd0b-21534b7ab0b4 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:59:36.571233 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-72959ce3-125c-4682-b593-b08cdb3ea654 tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] 10.222.0.33 "GET /compute/v2.1/servers/54473760-7c2c-4dcf-bd0b-21534b7ab0b4/metadata/test2" status: 404 len: 111 microversion: 2.1 time: 0.043214 Oct 04 20:59:36.573639 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2434/4899] 10.222.0.33 () {58 vars in 1281 bytes} [Tue Oct 4 20:59:36 2022] GET /compute/v2.1/servers/54473760-7c2c-4dcf-bd0b-21534b7ab0b4/metadata/test2 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:59:36.593085 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7a9dcfae-1205-4965-9377-e77196197896 tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:59:36.594314 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-7a9dcfae-1205-4965-9377-e77196197896 tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] [instance: beedbabd-70f0-435a-80ec-497c232a9ee3] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:59:36.609072 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7a9dcfae-1205-4965-9377-e77196197896 tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:36.609896 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7a9dcfae-1205-4965-9377-e77196197896 tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:36.610623 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7a9dcfae-1205-4965-9377-e77196197896 tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:36.612300 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7a9dcfae-1205-4965-9377-e77196197896 tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:36.613012 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7a9dcfae-1205-4965-9377-e77196197896 tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:36.613999 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7a9dcfae-1205-4965-9377-e77196197896 tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:36.774086 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-7a9dcfae-1205-4965-9377-e77196197896 tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] [instance: beedbabd-70f0-435a-80ec-497c232a9ee3] Going to try to terminate instance {{(pid=128801) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:59:36.903227 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-cdf87e2a-ee44-4116-a8ce-16fbeade00d6 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6513f5e908ac4d028cad6eeeebeab285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65946afc398d4a9fb1c9095a4f946e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:59:36.944182 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-cdf87e2a-ee44-4116-a8ce-16fbeade00d6 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc" status: 200 len: 1511 microversion: 2.1 time: 1.314264 Oct 04 20:59:36.947103 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2466/4900] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:59:35 2022] GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc => generated 1511 bytes in 1321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:59:36.960075 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-66e65adf-f77d-4b5a-b9ef-10f7676c902d tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:59:36.961960 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-66e65adf-f77d-4b5a-b9ef-10f7676c902d tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] [instance: 6c1e8070-fc54-4d28-90a9-1241c03b9b95] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:59:36.973738 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-66e65adf-f77d-4b5a-b9ef-10f7676c902d tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:36.974681 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-66e65adf-f77d-4b5a-b9ef-10f7676c902d tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:36.975466 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-66e65adf-f77d-4b5a-b9ef-10f7676c902d tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:36.976703 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-66e65adf-f77d-4b5a-b9ef-10f7676c902d tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:36.977410 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-66e65adf-f77d-4b5a-b9ef-10f7676c902d tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:36.978599 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-66e65adf-f77d-4b5a-b9ef-10f7676c902d tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:37.053813 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-7a9dcfae-1205-4965-9377-e77196197896 tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] 10.222.0.33 "DELETE /compute/v2.1/servers/beedbabd-70f0-435a-80ec-497c232a9ee3" status: 204 len: 0 microversion: 2.1 time: 0.464442 Oct 04 20:59:37.058114 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2435/4901] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 20:59:36 2022] DELETE /compute/v2.1/servers/beedbabd-70f0-435a-80ec-497c232a9ee3 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 20:59:37.070607 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ee329365-a0e0-413b-8928-66bf49ab0f26 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:59:37.071330 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ee329365-a0e0-413b-8928-66bf49ab0f26 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] [instance: 243cbbbd-0734-4711-b605-c0657b81e359] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:59:37.092165 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ee329365-a0e0-413b-8928-66bf49ab0f26 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:37.092671 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ee329365-a0e0-413b-8928-66bf49ab0f26 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:37.093120 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ee329365-a0e0-413b-8928-66bf49ab0f26 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:37.093849 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ee329365-a0e0-413b-8928-66bf49ab0f26 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:37.094310 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ee329365-a0e0-413b-8928-66bf49ab0f26 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:37.094764 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ee329365-a0e0-413b-8928-66bf49ab0f26 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:37.344322 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-ee329365-a0e0-413b-8928-66bf49ab0f26 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5dbe3da6a4af181ef7302fe605fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3aa23aee3c8435c8f1f409019c5fed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:59:37.370616 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ee329365-a0e0-413b-8928-66bf49ab0f26 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] 10.222.0.33 "GET /compute/v2.1/servers/243cbbbd-0734-4711-b605-c0657b81e359" status: 200 len: 1318 microversion: 2.1 time: 0.301701 Oct 04 20:59:37.373521 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2436/4902] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:59:37 2022] GET /compute/v2.1/servers/243cbbbd-0734-4711-b605-c0657b81e359 => generated 1318 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:59:37.379359 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8beed2a6-40d0-45bc-9e3c-e3ea3dd7866f tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:59:37.380240 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-8beed2a6-40d0-45bc-9e3c-e3ea3dd7866f tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] [instance: beedbabd-70f0-435a-80ec-497c232a9ee3] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:59:37.395121 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8beed2a6-40d0-45bc-9e3c-e3ea3dd7866f tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:37.399530 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8beed2a6-40d0-45bc-9e3c-e3ea3dd7866f tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:37.403921 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8beed2a6-40d0-45bc-9e3c-e3ea3dd7866f tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:37.405453 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8beed2a6-40d0-45bc-9e3c-e3ea3dd7866f tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:37.405952 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8beed2a6-40d0-45bc-9e3c-e3ea3dd7866f tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:37.406431 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8beed2a6-40d0-45bc-9e3c-e3ea3dd7866f tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:37.677073 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-66e65adf-f77d-4b5a-b9ef-10f7676c902d tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb9d89574d941ea9c8ca7b2b8d11f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e56c6049d5741418d193fd496cbb5d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:59:37.688807 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-66e65adf-f77d-4b5a-b9ef-10f7676c902d tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb9d89574d941ea9c8ca7b2b8d11f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e56c6049d5741418d193fd496cbb5d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:59:37.690580 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-66e65adf-f77d-4b5a-b9ef-10f7676c902d tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb9d89574d941ea9c8ca7b2b8d11f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e56c6049d5741418d193fd496cbb5d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:59:37.691762 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-66e65adf-f77d-4b5a-b9ef-10f7676c902d tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] 10.222.0.33 "GET /compute/v2.1/servers/6c1e8070-fc54-4d28-90a9-1241c03b9b95" status: 200 len: 1362 microversion: 2.26 time: 0.743093 Oct 04 20:59:37.714619 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2467/4903] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:59:36 2022] GET /compute/v2.1/servers/6c1e8070-fc54-4d28-90a9-1241c03b9b95 => generated 1362 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:59:37.816585 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-8beed2a6-40d0-45bc-9e3c-e3ea3dd7866f tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25849c543c84fb7a87a74c11f8d7990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c2d7a7a44e4ea78f2974539bf9a173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:59:37.828296 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-8beed2a6-40d0-45bc-9e3c-e3ea3dd7866f tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] 10.222.0.33 "GET /compute/v2.1/servers/beedbabd-70f0-435a-80ec-497c232a9ee3" status: 200 len: 1527 microversion: 2.1 time: 0.453466 Oct 04 20:59:37.828884 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2437/4904] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:59:37 2022] GET /compute/v2.1/servers/beedbabd-70f0-435a-80ec-497c232a9ee3 => generated 1527 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:59:37.969146 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-8751ddc2-50b7-4929-aee9-716aa2e612f5 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:59:37.969763 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-8751ddc2-50b7-4929-aee9-716aa2e612f5 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] [instance: 320f9a98-969f-473e-bc56-842bbd28dedc] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:59:37.977583 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8751ddc2-50b7-4929-aee9-716aa2e612f5 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:37.979248 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8751ddc2-50b7-4929-aee9-716aa2e612f5 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:37.999204 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8751ddc2-50b7-4929-aee9-716aa2e612f5 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:38.000134 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8751ddc2-50b7-4929-aee9-716aa2e612f5 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:38.000627 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8751ddc2-50b7-4929-aee9-716aa2e612f5 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:38.008323 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8751ddc2-50b7-4929-aee9-716aa2e612f5 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:38.396799 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-56ad2728-0129-475d-9879-ea0fdfb595b7 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:59:38.397584 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-56ad2728-0129-475d-9879-ea0fdfb595b7 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] [instance: 243cbbbd-0734-4711-b605-c0657b81e359] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:59:38.408971 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-56ad2728-0129-475d-9879-ea0fdfb595b7 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:38.409728 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-56ad2728-0129-475d-9879-ea0fdfb595b7 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:38.410275 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-56ad2728-0129-475d-9879-ea0fdfb595b7 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:38.413552 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-56ad2728-0129-475d-9879-ea0fdfb595b7 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:38.414189 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-56ad2728-0129-475d-9879-ea0fdfb595b7 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:38.414777 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-56ad2728-0129-475d-9879-ea0fdfb595b7 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:38.462890 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:59:39.275867 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-56ad2728-0129-475d-9879-ea0fdfb595b7 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5dbe3da6a4af181ef7302fe605fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3aa23aee3c8435c8f1f409019c5fed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:59:39.285930 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-56ad2728-0129-475d-9879-ea0fdfb595b7 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] 10.222.0.33 "GET /compute/v2.1/servers/243cbbbd-0734-4711-b605-c0657b81e359" status: 200 len: 1318 microversion: 2.1 time: 0.895096 Oct 04 20:59:39.288393 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2438/4905] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:59:38 2022] GET /compute/v2.1/servers/243cbbbd-0734-4711-b605-c0657b81e359 => generated 1318 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:59:39.293273 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8f5381d5-96c2-40ad-93c0-ce30a9491e44 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:59:39.294706 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-8f5381d5-96c2-40ad-93c0-ce30a9491e44 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] [instance: 6c1e8070-fc54-4d28-90a9-1241c03b9b95] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:59:39.306394 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8f5381d5-96c2-40ad-93c0-ce30a9491e44 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:39.307363 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8f5381d5-96c2-40ad-93c0-ce30a9491e44 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:39.310458 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8f5381d5-96c2-40ad-93c0-ce30a9491e44 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:39.313033 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8f5381d5-96c2-40ad-93c0-ce30a9491e44 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:39.316114 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8f5381d5-96c2-40ad-93c0-ce30a9491e44 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:39.317784 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8f5381d5-96c2-40ad-93c0-ce30a9491e44 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:39.651048 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-8751ddc2-50b7-4929-aee9-716aa2e612f5 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6513f5e908ac4d028cad6eeeebeab285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65946afc398d4a9fb1c9095a4f946e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:59:39.675130 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-8751ddc2-50b7-4929-aee9-716aa2e612f5 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc" status: 200 len: 1511 microversion: 2.1 time: 1.708404 Oct 04 20:59:39.677792 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2468/4906] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:59:37 2022] GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc => generated 1511 bytes in 1712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:59:39.693645 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-29f72953-8182-46cc-b942-be7dd9ac9dc4 tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:59:39.694701 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-29f72953-8182-46cc-b942-be7dd9ac9dc4 tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] [instance: beedbabd-70f0-435a-80ec-497c232a9ee3] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:59:39.708756 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-29f72953-8182-46cc-b942-be7dd9ac9dc4 tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:39.709664 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-29f72953-8182-46cc-b942-be7dd9ac9dc4 tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:39.710630 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-29f72953-8182-46cc-b942-be7dd9ac9dc4 tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:39.712130 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-29f72953-8182-46cc-b942-be7dd9ac9dc4 tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:39.713313 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-29f72953-8182-46cc-b942-be7dd9ac9dc4 tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:39.713983 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-29f72953-8182-46cc-b942-be7dd9ac9dc4 tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:40.296609 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-29f72953-8182-46cc-b942-be7dd9ac9dc4 tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25849c543c84fb7a87a74c11f8d7990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c2d7a7a44e4ea78f2974539bf9a173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:59:40.313554 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-29f72953-8182-46cc-b942-be7dd9ac9dc4 tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] 10.222.0.33 "GET /compute/v2.1/servers/beedbabd-70f0-435a-80ec-497c232a9ee3" status: 200 len: 1527 microversion: 2.1 time: 0.634336 Oct 04 20:59:40.319781 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2469/4907] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:59:39 2022] GET /compute/v2.1/servers/beedbabd-70f0-435a-80ec-497c232a9ee3 => generated 1527 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:59:40.325607 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-b94c1e9d-b80d-4305-ac1e-6bf732182edb tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:59:40.326739 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-b94c1e9d-b80d-4305-ac1e-6bf732182edb tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] [instance: 243cbbbd-0734-4711-b605-c0657b81e359] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:59:40.334440 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b94c1e9d-b80d-4305-ac1e-6bf732182edb tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:40.335171 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b94c1e9d-b80d-4305-ac1e-6bf732182edb tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:40.335800 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b94c1e9d-b80d-4305-ac1e-6bf732182edb tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:40.336705 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b94c1e9d-b80d-4305-ac1e-6bf732182edb tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:40.337322 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b94c1e9d-b80d-4305-ac1e-6bf732182edb tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:40.338514 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b94c1e9d-b80d-4305-ac1e-6bf732182edb tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:40.363140 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-8f5381d5-96c2-40ad-93c0-ce30a9491e44 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb9d89574d941ea9c8ca7b2b8d11f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e56c6049d5741418d193fd496cbb5d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:59:40.370073 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-8f5381d5-96c2-40ad-93c0-ce30a9491e44 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb9d89574d941ea9c8ca7b2b8d11f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e56c6049d5741418d193fd496cbb5d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:59:40.377294 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-8f5381d5-96c2-40ad-93c0-ce30a9491e44 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb9d89574d941ea9c8ca7b2b8d11f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e56c6049d5741418d193fd496cbb5d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:59:40.378766 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-8f5381d5-96c2-40ad-93c0-ce30a9491e44 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] 10.222.0.33 "GET /compute/v2.1/servers/6c1e8070-fc54-4d28-90a9-1241c03b9b95" status: 200 len: 1362 microversion: 2.26 time: 1.089368 Oct 04 20:59:40.379849 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2439/4908] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:59:39 2022] GET /compute/v2.1/servers/6c1e8070-fc54-4d28-90a9-1241c03b9b95 => generated 1362 bytes in 1091 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:59:40.411134 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-9591a2af-8521-4319-a47e-4b0b52ecfa27 req-62dc1df0-08d7-4cf5-9848-7cce0076749c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c1e8070-fc54-4d28-90a9-1241c03b9b95", "name": "network-vif-plugged", "status": "completed", "tag": "d1ea27b2-49f2-43a7-96dc-84ebebf2b2e0"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:59:40.425455 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-9591a2af-8521-4319-a47e-4b0b52ecfa27 req-62dc1df0-08d7-4cf5-9848-7cce0076749c service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:40.426196 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-9591a2af-8521-4319-a47e-4b0b52ecfa27 req-62dc1df0-08d7-4cf5-9848-7cce0076749c service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:40.426866 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-9591a2af-8521-4319-a47e-4b0b52ecfa27 req-62dc1df0-08d7-4cf5-9848-7cce0076749c service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:40.452938 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-9591a2af-8521-4319-a47e-4b0b52ecfa27 req-62dc1df0-08d7-4cf5-9848-7cce0076749c service nova] Creating event network-vif-plugged:d1ea27b2-49f2-43a7-96dc-84ebebf2b2e0 for instance 6c1e8070-fc54-4d28-90a9-1241c03b9b95 on n-h1-854823-8 Oct 04 20:59:40.463306 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-b94c1e9d-b80d-4305-ac1e-6bf732182edb tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5dbe3da6a4af181ef7302fe605fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3aa23aee3c8435c8f1f409019c5fed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:59:40.472009 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-b94c1e9d-b80d-4305-ac1e-6bf732182edb tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] 10.222.0.33 "GET /compute/v2.1/servers/243cbbbd-0734-4711-b605-c0657b81e359" status: 200 len: 1324 microversion: 2.1 time: 0.150038 Oct 04 20:59:40.472924 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2470/4909] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:59:40 2022] GET /compute/v2.1/servers/243cbbbd-0734-4711-b605-c0657b81e359 => generated 1324 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:59:40.508188 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-9591a2af-8521-4319-a47e-4b0b52ecfa27 req-62dc1df0-08d7-4cf5-9848-7cce0076749c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110968 Oct 04 20:59:40.514045 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2440/4910] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:59:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:59:40.706609 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-46adbc9c-d0ed-436e-bb0f-b56252559efa tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:59:40.708365 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-46adbc9c-d0ed-436e-bb0f-b56252559efa tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] [instance: 320f9a98-969f-473e-bc56-842bbd28dedc] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:59:40.726646 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-46adbc9c-d0ed-436e-bb0f-b56252559efa tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:40.727453 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-46adbc9c-d0ed-436e-bb0f-b56252559efa tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:40.728086 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-46adbc9c-d0ed-436e-bb0f-b56252559efa tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:40.729011 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-46adbc9c-d0ed-436e-bb0f-b56252559efa tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:40.729664 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-46adbc9c-d0ed-436e-bb0f-b56252559efa tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:40.730269 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-46adbc9c-d0ed-436e-bb0f-b56252559efa tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:41.285332 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-46adbc9c-d0ed-436e-bb0f-b56252559efa tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6513f5e908ac4d028cad6eeeebeab285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65946afc398d4a9fb1c9095a4f946e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:59:41.295545 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-46adbc9c-d0ed-436e-bb0f-b56252559efa tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc" status: 200 len: 1511 microversion: 2.1 time: 0.595023 Oct 04 20:59:41.301486 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2471/4911] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:59:40 2022] GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc => generated 1511 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:59:41.349745 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c867d353-13c9-4dc3-af62-f6d393c6192d tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:59:41.350531 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c867d353-13c9-4dc3-af62-f6d393c6192d tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] [instance: beedbabd-70f0-435a-80ec-497c232a9ee3] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:59:41.368682 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c867d353-13c9-4dc3-af62-f6d393c6192d tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:41.369312 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c867d353-13c9-4dc3-af62-f6d393c6192d tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:41.369592 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c867d353-13c9-4dc3-af62-f6d393c6192d tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:41.370295 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c867d353-13c9-4dc3-af62-f6d393c6192d tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:41.379291 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c867d353-13c9-4dc3-af62-f6d393c6192d tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:41.379832 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c867d353-13c9-4dc3-af62-f6d393c6192d tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:41.406371 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-9366ae77-f425-48e8-82a4-7e03621de72e tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:59:41.407060 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-9366ae77-f425-48e8-82a4-7e03621de72e tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] [instance: 6c1e8070-fc54-4d28-90a9-1241c03b9b95] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:59:41.415682 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9366ae77-f425-48e8-82a4-7e03621de72e tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:41.416542 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9366ae77-f425-48e8-82a4-7e03621de72e tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:41.417661 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9366ae77-f425-48e8-82a4-7e03621de72e tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:41.418755 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9366ae77-f425-48e8-82a4-7e03621de72e tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:41.419724 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9366ae77-f425-48e8-82a4-7e03621de72e tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:41.421188 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9366ae77-f425-48e8-82a4-7e03621de72e tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:41.617069 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c867d353-13c9-4dc3-af62-f6d393c6192d tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25849c543c84fb7a87a74c11f8d7990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c2d7a7a44e4ea78f2974539bf9a173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:59:41.641525 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c867d353-13c9-4dc3-af62-f6d393c6192d tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] 10.222.0.33 "GET /compute/v2.1/servers/beedbabd-70f0-435a-80ec-497c232a9ee3" status: 200 len: 1485 microversion: 2.1 time: 0.294538 Oct 04 20:59:41.649673 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2441/4912] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:59:41 2022] GET /compute/v2.1/servers/beedbabd-70f0-435a-80ec-497c232a9ee3 => generated 1485 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:59:41.661869 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c50c86b9-c8c5-4e97-802d-5f3e927ded86 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:59:41.672214 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c50c86b9-c8c5-4e97-802d-5f3e927ded86 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] [instance: 243cbbbd-0734-4711-b605-c0657b81e359] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:59:41.695348 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c50c86b9-c8c5-4e97-802d-5f3e927ded86 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:41.697834 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c50c86b9-c8c5-4e97-802d-5f3e927ded86 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:41.700844 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c50c86b9-c8c5-4e97-802d-5f3e927ded86 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:41.702845 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c50c86b9-c8c5-4e97-802d-5f3e927ded86 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:41.704655 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c50c86b9-c8c5-4e97-802d-5f3e927ded86 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:41.707302 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c50c86b9-c8c5-4e97-802d-5f3e927ded86 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:42.015724 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c50c86b9-c8c5-4e97-802d-5f3e927ded86 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5dbe3da6a4af181ef7302fe605fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3aa23aee3c8435c8f1f409019c5fed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:59:42.031619 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c50c86b9-c8c5-4e97-802d-5f3e927ded86 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] 10.222.0.33 "GET /compute/v2.1/servers/243cbbbd-0734-4711-b605-c0657b81e359" status: 200 len: 1324 microversion: 2.1 time: 0.378391 Oct 04 20:59:42.036026 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2442/4913] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:59:41 2022] GET /compute/v2.1/servers/243cbbbd-0734-4711-b605-c0657b81e359 => generated 1324 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:59:42.359409 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-9183f123-7b4a-4c0a-97e8-ab613bc64441 req-1fa7fdb0-3e46-4c13-8de2-0d405da9e674 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "beedbabd-70f0-435a-80ec-497c232a9ee3", "name": "network-vif-deleted", "tag": "471eb78e-97c1-4391-bb60-0c27d96466eb"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:59:42.391473 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:59:42.428390 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-9183f123-7b4a-4c0a-97e8-ab613bc64441 req-1fa7fdb0-3e46-4c13-8de2-0d405da9e674 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:42.428868 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-9183f123-7b4a-4c0a-97e8-ab613bc64441 req-1fa7fdb0-3e46-4c13-8de2-0d405da9e674 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:42.436351 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-9183f123-7b4a-4c0a-97e8-ab613bc64441 req-1fa7fdb0-3e46-4c13-8de2-0d405da9e674 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:42.503668 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-9183f123-7b4a-4c0a-97e8-ab613bc64441 req-1fa7fdb0-3e46-4c13-8de2-0d405da9e674 service nova] Creating event network-vif-deleted:471eb78e-97c1-4391-bb60-0c27d96466eb for instance beedbabd-70f0-435a-80ec-497c232a9ee3 on n-h2-854823-8 Oct 04 20:59:42.524189 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-9183f123-7b4a-4c0a-97e8-ab613bc64441 req-1fa7fdb0-3e46-4c13-8de2-0d405da9e674 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.485569 Oct 04 20:59:42.526873 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2443/4914] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:59:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:59:42.541712 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6c86ad10-bd54-4d5a-b59e-64668845e203 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:59:42.544024 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-6c86ad10-bd54-4d5a-b59e-64668845e203 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] [instance: 320f9a98-969f-473e-bc56-842bbd28dedc] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:59:42.566039 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6c86ad10-bd54-4d5a-b59e-64668845e203 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:42.570448 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6c86ad10-bd54-4d5a-b59e-64668845e203 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:42.572148 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6c86ad10-bd54-4d5a-b59e-64668845e203 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:42.572897 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6c86ad10-bd54-4d5a-b59e-64668845e203 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:42.576275 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6c86ad10-bd54-4d5a-b59e-64668845e203 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:42.578529 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6c86ad10-bd54-4d5a-b59e-64668845e203 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:42.625426 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-9366ae77-f425-48e8-82a4-7e03621de72e tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb9d89574d941ea9c8ca7b2b8d11f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e56c6049d5741418d193fd496cbb5d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:59:42.654198 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-9366ae77-f425-48e8-82a4-7e03621de72e tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb9d89574d941ea9c8ca7b2b8d11f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e56c6049d5741418d193fd496cbb5d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:59:42.662225 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-9366ae77-f425-48e8-82a4-7e03621de72e tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb9d89574d941ea9c8ca7b2b8d11f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e56c6049d5741418d193fd496cbb5d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:59:42.668739 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-9366ae77-f425-48e8-82a4-7e03621de72e tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] 10.222.0.33 "GET /compute/v2.1/servers/6c1e8070-fc54-4d28-90a9-1241c03b9b95" status: 200 len: 1362 microversion: 2.26 time: 1.265670 Oct 04 20:59:42.672392 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2472/4915] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:59:41 2022] GET /compute/v2.1/servers/6c1e8070-fc54-4d28-90a9-1241c03b9b95 => generated 1362 bytes in 1272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 20:59:42.714792 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-b8adb90d-13e9-4b2e-a03a-69c41d3cb6bf tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:59:42.714792 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-b8adb90d-13e9-4b2e-a03a-69c41d3cb6bf tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] [instance: beedbabd-70f0-435a-80ec-497c232a9ee3] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:59:42.724300 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b8adb90d-13e9-4b2e-a03a-69c41d3cb6bf tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:42.724800 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b8adb90d-13e9-4b2e-a03a-69c41d3cb6bf tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:42.725244 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b8adb90d-13e9-4b2e-a03a-69c41d3cb6bf tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:42.726905 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b8adb90d-13e9-4b2e-a03a-69c41d3cb6bf tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:42.734067 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b8adb90d-13e9-4b2e-a03a-69c41d3cb6bf tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:42.734554 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b8adb90d-13e9-4b2e-a03a-69c41d3cb6bf tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:42.754312 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.wsgi [None req-b8adb90d-13e9-4b2e-a03a-69c41d3cb6bf tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] HTTP exception thrown: Instance beedbabd-70f0-435a-80ec-497c232a9ee3 could not be found. Oct 04 20:59:42.758700 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-b8adb90d-13e9-4b2e-a03a-69c41d3cb6bf tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] Request method failure captured: Oct 04 20:59:42.758700 n-d-854823-8 devstack@n-api.service[128802]: request: GET /compute/v2.1/servers/beedbabd-70f0-435a-80ec-497c232a9ee3 HTTP/1.1 Oct 04 20:59:42.758700 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 20:59:42.758700 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 20:59:42.758700 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 20:59:42.758700 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 0 Oct 04 20:59:42.758700 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 20:59:42.758700 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 20:59:42.758700 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 20:59:42.758700 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 20:59:42.758700 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPJ6WwKMAlY2ZpOMNDQ9y8sLpb5t0Vu0B-YpqzzPope3GaLlFLpVUwVCCZLJ1W8fI41mBPAEm-PMBybTImReqTXoDJylNCJidwYXwBhhh_MF1OcO5y8txG4p_JKebzrXZLpAk4zIoX6sjI4GfDKd94m8mH0DVpOMUnQ2xS7FiJhU5kUM Oct 04 20:59:42.758700 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 20:59:42.758700 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 20:59:42.758700 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 20:59:42.758700 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 20:59:42.758700 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 20:59:42.758700 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 20:59:42.758700 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: c3c2d7a7a44e4ea78f2974539bf9a173 Oct 04 20:59:42.758700 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-554011785 Oct 04 20:59:42.758700 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 20:59:42.758700 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 20:59:42.758700 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_c3c2d7a7a44e4ea78f2974539bf9a173", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c3c2d7a7a44e4ea78f2974539bf9a173"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c3c2d7a7a44e4ea78f2974539bf9a173"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/c3c2d7a7a44e4ea78f2974539bf9a173"}]}] Oct 04 20:59:42.758700 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-554011785 Oct 04 20:59:42.758700 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: c3c2d7a7a44e4ea78f2974539bf9a173 Oct 04 20:59:42.758700 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-554011785 Oct 04 20:59:42.758700 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-ServerMetadataNegativeTestJSON-554011785-project Oct 04 20:59:42.758700 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 20:59:42.758700 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 20:59:42.758700 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: d25849c543c84fb7a87a74c11f8d7990 Oct 04 20:59:42.758700 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-554011785-project Oct 04 20:59:42.758700 n-d-854823-8 devstack@n-api.service[128802]: method: > Oct 04 20:59:42.758700 n-d-854823-8 devstack@n-api.service[128802]: exception: Instance beedbabd-70f0-435a-80ec-497c232a9ee3 could not be found. Oct 04 20:59:42.758700 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'id': 'beedbabd-70f0-435a-80ec-497c232a9ee3'} Oct 04 20:59:42.758700 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:59:42.758700 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:59:42.758700 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:59:42.758700 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:59:42.758700 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:59:42.758700 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:59:42.758700 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:59:42.758700 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:59:42.758700 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:59:42.758700 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:59:42.758700 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance beedbabd-70f0-435a-80ec-497c232a9ee3 could not be found. Oct 04 20:59:42.758700 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:59:42.758700 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:59:42.758700 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:59:42.758700 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:59:42.758700 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:59:42.758700 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:59:42.758700 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:59:42.758700 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:59:42.758700 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:59:42.758700 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:59:42.758700 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:59:42.758700 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:59:42.758700 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:59:42.758700 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:59:42.758700 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:59:42.758700 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:59:42.758700 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance beedbabd-70f0-435a-80ec-497c232a9ee3 could not be found. Oct 04 20:59:42.758700 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:59:42.758700 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:59:42.764043 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:59:42.764043 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:59:42.764043 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:59:42.764043 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:59:42.764043 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:59:42.764043 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:59:42.764043 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance beedbabd-70f0-435a-80ec-497c232a9ee3 could not be found. Oct 04 20:59:42.764043 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:59:42.766679 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-b8adb90d-13e9-4b2e-a03a-69c41d3cb6bf tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] Returning 404 to user: Instance beedbabd-70f0-435a-80ec-497c232a9ee3 could not be found. {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:59:42.768211 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-b8adb90d-13e9-4b2e-a03a-69c41d3cb6bf tempest-ServerMetadataNegativeTestJSON-554011785 tempest-ServerMetadataNegativeTestJSON-554011785-project] 10.222.0.33 "GET /compute/v2.1/servers/beedbabd-70f0-435a-80ec-497c232a9ee3" status: 404 len: 111 microversion: 2.1 time: 0.090036 Oct 04 20:59:42.769563 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2473/4916] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:59:42 2022] GET /compute/v2.1/servers/beedbabd-70f0-435a-80ec-497c232a9ee3 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 20:59:43.058609 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-6f331275-4937-4da6-ac47-082db6c415d0 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:59:43.059734 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-6f331275-4937-4da6-ac47-082db6c415d0 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] [instance: 243cbbbd-0734-4711-b605-c0657b81e359] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:59:43.078940 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6f331275-4937-4da6-ac47-082db6c415d0 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:43.079949 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6f331275-4937-4da6-ac47-082db6c415d0 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:43.081681 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6f331275-4937-4da6-ac47-082db6c415d0 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:43.084170 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6f331275-4937-4da6-ac47-082db6c415d0 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:43.086605 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6f331275-4937-4da6-ac47-082db6c415d0 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:43.088658 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6f331275-4937-4da6-ac47-082db6c415d0 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:43.104582 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=100 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:59:43.366247 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-6c86ad10-bd54-4d5a-b59e-64668845e203 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6513f5e908ac4d028cad6eeeebeab285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65946afc398d4a9fb1c9095a4f946e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:59:43.375840 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-6c86ad10-bd54-4d5a-b59e-64668845e203 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc" status: 200 len: 1511 microversion: 2.1 time: 0.846395 Oct 04 20:59:43.391796 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2444/4917] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:59:42 2022] GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc => generated 1511 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:59:43.703842 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c82648ff-53fd-4489-b45a-2352e1468288 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:59:43.706239 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c82648ff-53fd-4489-b45a-2352e1468288 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] [instance: 6c1e8070-fc54-4d28-90a9-1241c03b9b95] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:59:43.719321 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c82648ff-53fd-4489-b45a-2352e1468288 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:43.720120 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c82648ff-53fd-4489-b45a-2352e1468288 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:43.721853 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c82648ff-53fd-4489-b45a-2352e1468288 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:43.737836 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c82648ff-53fd-4489-b45a-2352e1468288 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:43.740557 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c82648ff-53fd-4489-b45a-2352e1468288 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:43.742311 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c82648ff-53fd-4489-b45a-2352e1468288 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:44.522503 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-6f331275-4937-4da6-ac47-082db6c415d0 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5dbe3da6a4af181ef7302fe605fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3aa23aee3c8435c8f1f409019c5fed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:59:44.540749 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-6f331275-4937-4da6-ac47-082db6c415d0 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] 10.222.0.33 "GET /compute/v2.1/servers/243cbbbd-0734-4711-b605-c0657b81e359" status: 200 len: 1391 microversion: 2.1 time: 1.487808 Oct 04 20:59:44.542573 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2474/4918] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:59:43 2022] GET /compute/v2.1/servers/243cbbbd-0734-4711-b605-c0657b81e359 => generated 1391 bytes in 1490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:59:44.562221 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-1130ccc4-010a-4bfc-b411-5d684d18b52f tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:59:44.563407 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-1130ccc4-010a-4bfc-b411-5d684d18b52f tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] [instance: 320f9a98-969f-473e-bc56-842bbd28dedc] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:59:44.570832 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1130ccc4-010a-4bfc-b411-5d684d18b52f tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:44.571705 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1130ccc4-010a-4bfc-b411-5d684d18b52f tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:44.572410 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1130ccc4-010a-4bfc-b411-5d684d18b52f tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:44.573377 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1130ccc4-010a-4bfc-b411-5d684d18b52f tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:44.574066 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1130ccc4-010a-4bfc-b411-5d684d18b52f tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:44.575033 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1130ccc4-010a-4bfc-b411-5d684d18b52f tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:44.620960 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell0:SELECT=2 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:59:44.659347 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell0:SELECT=6 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:59:44.718732 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c82648ff-53fd-4489-b45a-2352e1468288 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb9d89574d941ea9c8ca7b2b8d11f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e56c6049d5741418d193fd496cbb5d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:59:44.736063 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c82648ff-53fd-4489-b45a-2352e1468288 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb9d89574d941ea9c8ca7b2b8d11f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e56c6049d5741418d193fd496cbb5d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:59:44.738248 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c82648ff-53fd-4489-b45a-2352e1468288 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb9d89574d941ea9c8ca7b2b8d11f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e56c6049d5741418d193fd496cbb5d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:59:44.739447 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c82648ff-53fd-4489-b45a-2352e1468288 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] 10.222.0.33 "GET /compute/v2.1/servers/6c1e8070-fc54-4d28-90a9-1241c03b9b95" status: 200 len: 1547 microversion: 2.26 time: 1.041185 Oct 04 20:59:44.740353 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2445/4919] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:59:43 2022] GET /compute/v2.1/servers/6c1e8070-fc54-4d28-90a9-1241c03b9b95 => generated 1547 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:59:44.769947 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ab9e40c9-510f-4f1f-a2c4-b249467ef9c8 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Calling method '.version_select at 0x7f3c6fa08940>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:59:44.790513 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ab9e40c9-510f-4f1f-a2c4-b249467ef9c8 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:44.791011 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ab9e40c9-510f-4f1f-a2c4-b249467ef9c8 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:44.791444 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ab9e40c9-510f-4f1f-a2c4-b249467ef9c8 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:44.792135 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ab9e40c9-510f-4f1f-a2c4-b249467ef9c8 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] [instance: 6c1e8070-fc54-4d28-90a9-1241c03b9b95] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:59:44.808089 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ab9e40c9-510f-4f1f-a2c4-b249467ef9c8 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:44.810220 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ab9e40c9-510f-4f1f-a2c4-b249467ef9c8 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:44.810989 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ab9e40c9-510f-4f1f-a2c4-b249467ef9c8 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:44.816202 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ab9e40c9-510f-4f1f-a2c4-b249467ef9c8 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:44.816703 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ab9e40c9-510f-4f1f-a2c4-b249467ef9c8 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:44.817153 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ab9e40c9-510f-4f1f-a2c4-b249467ef9c8 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:44.885038 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ab9e40c9-510f-4f1f-a2c4-b249467ef9c8 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:44.886558 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ab9e40c9-510f-4f1f-a2c4-b249467ef9c8 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:44.887890 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ab9e40c9-510f-4f1f-a2c4-b249467ef9c8 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:44.932873 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ab9e40c9-510f-4f1f-a2c4-b249467ef9c8 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:44.933385 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ab9e40c9-510f-4f1f-a2c4-b249467ef9c8 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:44.933831 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ab9e40c9-510f-4f1f-a2c4-b249467ef9c8 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:45.024798 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-ab9e40c9-510f-4f1f-a2c4-b249467ef9c8 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Lazy-loading 'flavor' on Instance uuid 6c1e8070-fc54-4d28-90a9-1241c03b9b95 {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:59:45.079209 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ab9e40c9-510f-4f1f-a2c4-b249467ef9c8 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] 10.222.0.33 "PUT /compute/v2.1/servers/6c1e8070-fc54-4d28-90a9-1241c03b9b95/tags/tempest-tag-1786780681" status: 201 len: 0 microversion: 2.26 time: 0.313509 Oct 04 20:59:45.080673 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2446/4920] 10.222.0.33 () {62 vars in 1380 bytes} [Tue Oct 4 20:59:44 2022] PUT /compute/v2.1/servers/6c1e8070-fc54-4d28-90a9-1241c03b9b95/tags/tempest-tag-1786780681 => generated 0 bytes in 315 msecs (HTTP/1.1 201) 10 headers in 486 bytes (2 switches on core 0) Oct 04 20:59:45.090779 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-669d28bd-2aa9-44d7-91e8-48b584696519 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Calling method '.version_select at 0x7f3c742491f0>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:59:45.105212 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-669d28bd-2aa9-44d7-91e8-48b584696519 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:45.109504 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-669d28bd-2aa9-44d7-91e8-48b584696519 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:45.112628 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-669d28bd-2aa9-44d7-91e8-48b584696519 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:45.143357 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-669d28bd-2aa9-44d7-91e8-48b584696519 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] 10.222.0.33 "GET /compute/v2.1/servers/6c1e8070-fc54-4d28-90a9-1241c03b9b95/tags/tempest-tag-1786780681" status: 204 len: 0 microversion: 2.26 time: 0.056299 Oct 04 20:59:45.146653 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2447/4921] 10.222.0.33 () {60 vars in 1361 bytes} [Tue Oct 4 20:59:45 2022] GET /compute/v2.1/servers/6c1e8070-fc54-4d28-90a9-1241c03b9b95/tags/tempest-tag-1786780681 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 20:59:45.155702 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-dcd80c7b-8723-40ec-9250-10d4b9087bf9 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Calling method '.version_select at 0x7f3c740cef70>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:59:45.178835 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dcd80c7b-8723-40ec-9250-10d4b9087bf9 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:45.179373 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dcd80c7b-8723-40ec-9250-10d4b9087bf9 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:45.179819 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dcd80c7b-8723-40ec-9250-10d4b9087bf9 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:45.180316 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-dcd80c7b-8723-40ec-9250-10d4b9087bf9 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] [instance: 6c1e8070-fc54-4d28-90a9-1241c03b9b95] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:59:45.191844 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dcd80c7b-8723-40ec-9250-10d4b9087bf9 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:45.192342 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dcd80c7b-8723-40ec-9250-10d4b9087bf9 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:45.192782 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dcd80c7b-8723-40ec-9250-10d4b9087bf9 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:45.193493 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dcd80c7b-8723-40ec-9250-10d4b9087bf9 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:45.193949 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dcd80c7b-8723-40ec-9250-10d4b9087bf9 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:45.194398 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dcd80c7b-8723-40ec-9250-10d4b9087bf9 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:45.238715 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dcd80c7b-8723-40ec-9250-10d4b9087bf9 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:45.239561 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dcd80c7b-8723-40ec-9250-10d4b9087bf9 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:45.240539 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dcd80c7b-8723-40ec-9250-10d4b9087bf9 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:45.269717 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-dcd80c7b-8723-40ec-9250-10d4b9087bf9 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Lazy-loading 'flavor' on Instance uuid 6c1e8070-fc54-4d28-90a9-1241c03b9b95 {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:59:45.309414 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-dcd80c7b-8723-40ec-9250-10d4b9087bf9 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] 10.222.0.33 "DELETE /compute/v2.1/servers/6c1e8070-fc54-4d28-90a9-1241c03b9b95/tags" status: 204 len: 0 microversion: 2.26 time: 0.154775 Oct 04 20:59:45.310118 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2448/4922] 10.222.0.33 () {60 vars in 1295 bytes} [Tue Oct 4 20:59:45 2022] DELETE /compute/v2.1/servers/6c1e8070-fc54-4d28-90a9-1241c03b9b95/tags => generated 0 bytes in 159 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 20:59:45.328974 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f7574615-59e7-4735-9004-538eeb46c828 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Calling method '.version_select at 0x7f3c788abd30>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:59:45.338909 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f7574615-59e7-4735-9004-538eeb46c828 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:45.339727 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f7574615-59e7-4735-9004-538eeb46c828 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:45.340389 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f7574615-59e7-4735-9004-538eeb46c828 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:45.367823 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f7574615-59e7-4735-9004-538eeb46c828 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] 10.222.0.33 "GET /compute/v2.1/servers/6c1e8070-fc54-4d28-90a9-1241c03b9b95/tags" status: 200 len: 12 microversion: 2.26 time: 0.045462 Oct 04 20:59:45.372485 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2449/4923] 10.222.0.33 () {60 vars in 1292 bytes} [Tue Oct 4 20:59:45 2022] GET /compute/v2.1/servers/6c1e8070-fc54-4d28-90a9-1241c03b9b95/tags => generated 12 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:59:45.382925 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-bc539710-30bc-4413-87dc-24626d11a738 req-cd783b42-0538-49d5-872c-a056a2513d2c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "243cbbbd-0734-4711-b605-c0657b81e359", "tag": "65760264-f1de-43cd-baca-c370b4c65ec6"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:59:45.397803 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-bc539710-30bc-4413-87dc-24626d11a738 req-cd783b42-0538-49d5-872c-a056a2513d2c service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:45.398730 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-bc539710-30bc-4413-87dc-24626d11a738 req-cd783b42-0538-49d5-872c-a056a2513d2c service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:45.399574 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-bc539710-30bc-4413-87dc-24626d11a738 req-cd783b42-0538-49d5-872c-a056a2513d2c service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:45.426944 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-bc539710-30bc-4413-87dc-24626d11a738 req-cd783b42-0538-49d5-872c-a056a2513d2c service nova] Creating event network-changed:65760264-f1de-43cd-baca-c370b4c65ec6 for instance 243cbbbd-0734-4711-b605-c0657b81e359 on n-h2-854823-8 Oct 04 20:59:45.432434 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-bc539710-30bc-4413-87dc-24626d11a738 req-cd783b42-0538-49d5-872c-a056a2513d2c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058346 Oct 04 20:59:45.435114 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2450/4924] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:59:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:59:45.442874 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-42cd600b-53cb-4481-9a36-8eaa7ab03628 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Calling method '.version_select at 0x7f3c74208940>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:59:45.454298 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-42cd600b-53cb-4481-9a36-8eaa7ab03628 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:45.455769 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-42cd600b-53cb-4481-9a36-8eaa7ab03628 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:45.457066 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-42cd600b-53cb-4481-9a36-8eaa7ab03628 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:45.458728 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-42cd600b-53cb-4481-9a36-8eaa7ab03628 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] [instance: 6c1e8070-fc54-4d28-90a9-1241c03b9b95] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:59:45.467482 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-42cd600b-53cb-4481-9a36-8eaa7ab03628 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:45.468289 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-42cd600b-53cb-4481-9a36-8eaa7ab03628 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:45.469248 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-42cd600b-53cb-4481-9a36-8eaa7ab03628 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:45.470205 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-42cd600b-53cb-4481-9a36-8eaa7ab03628 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:45.471101 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-42cd600b-53cb-4481-9a36-8eaa7ab03628 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:45.472112 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-42cd600b-53cb-4481-9a36-8eaa7ab03628 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:45.511508 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-1130ccc4-010a-4bfc-b411-5d684d18b52f tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6513f5e908ac4d028cad6eeeebeab285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65946afc398d4a9fb1c9095a4f946e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:59:45.516842 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-42cd600b-53cb-4481-9a36-8eaa7ab03628 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:45.517352 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-42cd600b-53cb-4481-9a36-8eaa7ab03628 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:45.517964 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-42cd600b-53cb-4481-9a36-8eaa7ab03628 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:45.528360 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-42cd600b-53cb-4481-9a36-8eaa7ab03628 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:45.529058 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-42cd600b-53cb-4481-9a36-8eaa7ab03628 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:45.529668 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-42cd600b-53cb-4481-9a36-8eaa7ab03628 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:45.546114 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-1130ccc4-010a-4bfc-b411-5d684d18b52f tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc" status: 200 len: 1511 microversion: 2.1 time: 0.985610 Oct 04 20:59:45.546848 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2475/4925] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:59:44 2022] GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc => generated 1511 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:59:45.569598 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-42cd600b-53cb-4481-9a36-8eaa7ab03628 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Lazy-loading 'flavor' on Instance uuid 6c1e8070-fc54-4d28-90a9-1241c03b9b95 {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:59:45.575067 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-0eb731a0-e362-4bd0-81ae-137ecf2d707d tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:59:45.576057 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-0eb731a0-e362-4bd0-81ae-137ecf2d707d tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] [instance: 243cbbbd-0734-4711-b605-c0657b81e359] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:59:45.591852 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-42cd600b-53cb-4481-9a36-8eaa7ab03628 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] 10.222.0.33 "PUT /compute/v2.1/servers/6c1e8070-fc54-4d28-90a9-1241c03b9b95/tags/tempest-tag-1435759696" status: 201 len: 0 microversion: 2.26 time: 0.154159 Oct 04 20:59:45.593158 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2451/4926] 10.222.0.33 () {62 vars in 1380 bytes} [Tue Oct 4 20:59:45 2022] PUT /compute/v2.1/servers/6c1e8070-fc54-4d28-90a9-1241c03b9b95/tags/tempest-tag-1435759696 => generated 0 bytes in 157 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Oct 04 20:59:45.603210 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0eb731a0-e362-4bd0-81ae-137ecf2d707d tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:45.604877 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0eb731a0-e362-4bd0-81ae-137ecf2d707d tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:45.606298 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0eb731a0-e362-4bd0-81ae-137ecf2d707d tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:45.608010 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0eb731a0-e362-4bd0-81ae-137ecf2d707d tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:45.612052 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0eb731a0-e362-4bd0-81ae-137ecf2d707d tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:45.615424 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0eb731a0-e362-4bd0-81ae-137ecf2d707d tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:45.619002 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-3dcbed38-cc61-4bd0-becd-6f24d8ffecf2 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Calling method '.version_select at 0x7f3c787c4af0>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:59:45.630852 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3dcbed38-cc61-4bd0-becd-6f24d8ffecf2 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:45.631670 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3dcbed38-cc61-4bd0-becd-6f24d8ffecf2 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:45.632402 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3dcbed38-cc61-4bd0-becd-6f24d8ffecf2 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:45.654964 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-3dcbed38-cc61-4bd0-becd-6f24d8ffecf2 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] 10.222.0.33 "GET /compute/v2.1/servers/6c1e8070-fc54-4d28-90a9-1241c03b9b95/tags" status: 200 len: 36 microversion: 2.26 time: 0.055490 Oct 04 20:59:45.662082 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2452/4927] 10.222.0.33 () {60 vars in 1292 bytes} [Tue Oct 4 20:59:45 2022] GET /compute/v2.1/servers/6c1e8070-fc54-4d28-90a9-1241c03b9b95/tags => generated 36 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:59:45.670966 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ed7dfe00-2b4f-4827-9d8d-f02373cc814d tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Calling method '.version_select at 0x7f3c740ce790>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:59:45.680317 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ed7dfe00-2b4f-4827-9d8d-f02373cc814d tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:45.680804 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ed7dfe00-2b4f-4827-9d8d-f02373cc814d tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:45.681241 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ed7dfe00-2b4f-4827-9d8d-f02373cc814d tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:45.681741 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ed7dfe00-2b4f-4827-9d8d-f02373cc814d tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] [instance: 6c1e8070-fc54-4d28-90a9-1241c03b9b95] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:59:45.688163 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ed7dfe00-2b4f-4827-9d8d-f02373cc814d tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:45.688657 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ed7dfe00-2b4f-4827-9d8d-f02373cc814d tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:45.689091 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ed7dfe00-2b4f-4827-9d8d-f02373cc814d tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:45.690714 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ed7dfe00-2b4f-4827-9d8d-f02373cc814d tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:45.691180 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ed7dfe00-2b4f-4827-9d8d-f02373cc814d tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:45.691608 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ed7dfe00-2b4f-4827-9d8d-f02373cc814d tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:45.730498 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ed7dfe00-2b4f-4827-9d8d-f02373cc814d tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:45.731215 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ed7dfe00-2b4f-4827-9d8d-f02373cc814d tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:45.731588 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ed7dfe00-2b4f-4827-9d8d-f02373cc814d tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:45.753731 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=92,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=2,nova_cell1:RELEASE=2,nova_cell1:DELETE=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:59:45.781565 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-ed7dfe00-2b4f-4827-9d8d-f02373cc814d tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Lazy-loading 'flavor' on Instance uuid 6c1e8070-fc54-4d28-90a9-1241c03b9b95 {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:59:45.803731 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ed7dfe00-2b4f-4827-9d8d-f02373cc814d tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] 10.222.0.33 "DELETE /compute/v2.1/servers/6c1e8070-fc54-4d28-90a9-1241c03b9b95/tags/tempest-tag-1435759696" status: 204 len: 0 microversion: 2.26 time: 0.136863 Oct 04 20:59:45.804875 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2453/4928] 10.222.0.33 () {60 vars in 1364 bytes} [Tue Oct 4 20:59:45 2022] DELETE /compute/v2.1/servers/6c1e8070-fc54-4d28-90a9-1241c03b9b95/tags/tempest-tag-1435759696 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 20:59:45.819916 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9def4732-8fb9-44e3-85dc-c3edfc4f79d2 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Calling method '.version_select at 0x7f3c74208b80>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:59:45.833324 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:59:45.851402 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9def4732-8fb9-44e3-85dc-c3edfc4f79d2 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:45.851902 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9def4732-8fb9-44e3-85dc-c3edfc4f79d2 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:45.852742 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9def4732-8fb9-44e3-85dc-c3edfc4f79d2 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:45.871612 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-9def4732-8fb9-44e3-85dc-c3edfc4f79d2 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] 10.222.0.33 "GET /compute/v2.1/servers/6c1e8070-fc54-4d28-90a9-1241c03b9b95/tags" status: 200 len: 12 microversion: 2.26 time: 0.061740 Oct 04 20:59:45.878053 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2454/4929] 10.222.0.33 () {60 vars in 1292 bytes} [Tue Oct 4 20:59:45 2022] GET /compute/v2.1/servers/6c1e8070-fc54-4d28-90a9-1241c03b9b95/tags => generated 12 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:59:45.888637 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-45ef9546-e9dd-45d2-b017-3376ccb95fd3 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Calling method '.version_select at 0x7f3c74bb05e0>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:59:45.908154 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-45ef9546-e9dd-45d2-b017-3376ccb95fd3 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:45.909329 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-45ef9546-e9dd-45d2-b017-3376ccb95fd3 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:45.909777 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-45ef9546-e9dd-45d2-b017-3376ccb95fd3 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:45.910277 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-45ef9546-e9dd-45d2-b017-3376ccb95fd3 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] [instance: 6c1e8070-fc54-4d28-90a9-1241c03b9b95] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:59:45.935502 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-45ef9546-e9dd-45d2-b017-3376ccb95fd3 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:45.936664 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-45ef9546-e9dd-45d2-b017-3376ccb95fd3 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:45.937132 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-45ef9546-e9dd-45d2-b017-3376ccb95fd3 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:45.941760 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-45ef9546-e9dd-45d2-b017-3376ccb95fd3 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:45.942256 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-45ef9546-e9dd-45d2-b017-3376ccb95fd3 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:45.942724 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-45ef9546-e9dd-45d2-b017-3376ccb95fd3 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:45.998917 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-45ef9546-e9dd-45d2-b017-3376ccb95fd3 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:46.000918 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-45ef9546-e9dd-45d2-b017-3376ccb95fd3 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:46.000918 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-45ef9546-e9dd-45d2-b017-3376ccb95fd3 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:46.027242 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-45ef9546-e9dd-45d2-b017-3376ccb95fd3 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Lazy-loading 'flavor' on Instance uuid 6c1e8070-fc54-4d28-90a9-1241c03b9b95 {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:59:46.066182 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-45ef9546-e9dd-45d2-b017-3376ccb95fd3 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] 10.222.0.33 "DELETE /compute/v2.1/servers/6c1e8070-fc54-4d28-90a9-1241c03b9b95/tags" status: 204 len: 0 microversion: 2.26 time: 0.179121 Oct 04 20:59:46.068879 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2455/4930] 10.222.0.33 () {60 vars in 1295 bytes} [Tue Oct 4 20:59:45 2022] DELETE /compute/v2.1/servers/6c1e8070-fc54-4d28-90a9-1241c03b9b95/tags => generated 0 bytes in 190 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 20:59:46.078577 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5e2fd778-a655-41b8-8a2d-1a1339a8814d tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Calling method '.version_select at 0x7f3c742238b0>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:59:46.113319 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5e2fd778-a655-41b8-8a2d-1a1339a8814d tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:46.113818 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5e2fd778-a655-41b8-8a2d-1a1339a8814d tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:46.114257 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5e2fd778-a655-41b8-8a2d-1a1339a8814d tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:46.114771 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-5e2fd778-a655-41b8-8a2d-1a1339a8814d tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] [instance: 6c1e8070-fc54-4d28-90a9-1241c03b9b95] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:59:46.135647 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5e2fd778-a655-41b8-8a2d-1a1339a8814d tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:46.136229 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5e2fd778-a655-41b8-8a2d-1a1339a8814d tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:46.136593 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5e2fd778-a655-41b8-8a2d-1a1339a8814d tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:46.137314 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5e2fd778-a655-41b8-8a2d-1a1339a8814d tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:46.137780 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5e2fd778-a655-41b8-8a2d-1a1339a8814d tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:46.138204 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5e2fd778-a655-41b8-8a2d-1a1339a8814d tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:46.216989 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5e2fd778-a655-41b8-8a2d-1a1339a8814d tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:46.217498 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5e2fd778-a655-41b8-8a2d-1a1339a8814d tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:46.217944 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5e2fd778-a655-41b8-8a2d-1a1339a8814d tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:46.263637 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5e2fd778-a655-41b8-8a2d-1a1339a8814d tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:46.264139 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5e2fd778-a655-41b8-8a2d-1a1339a8814d tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:46.264578 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5e2fd778-a655-41b8-8a2d-1a1339a8814d tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:46.365450 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-5e2fd778-a655-41b8-8a2d-1a1339a8814d tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Lazy-loading 'flavor' on Instance uuid 6c1e8070-fc54-4d28-90a9-1241c03b9b95 {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:59:46.428932 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5e2fd778-a655-41b8-8a2d-1a1339a8814d tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] 10.222.0.33 "PUT /compute/v2.1/servers/6c1e8070-fc54-4d28-90a9-1241c03b9b95/tags/tempest-tag-456912227" status: 201 len: 0 microversion: 2.26 time: 0.354804 Oct 04 20:59:46.429789 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2456/4931] 10.222.0.33 () {62 vars in 1377 bytes} [Tue Oct 4 20:59:46 2022] PUT /compute/v2.1/servers/6c1e8070-fc54-4d28-90a9-1241c03b9b95/tags/tempest-tag-456912227 => generated 0 bytes in 356 msecs (HTTP/1.1 201) 10 headers in 485 bytes (2 switches on core 0) Oct 04 20:59:46.451218 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-84ce56c7-9343-46ef-a8ea-fb73d1b5e7e0 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Calling method '.version_select at 0x7f3c740ce310>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:59:46.478778 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-84ce56c7-9343-46ef-a8ea-fb73d1b5e7e0 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:46.479284 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-84ce56c7-9343-46ef-a8ea-fb73d1b5e7e0 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:46.479721 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-84ce56c7-9343-46ef-a8ea-fb73d1b5e7e0 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:46.480488 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-84ce56c7-9343-46ef-a8ea-fb73d1b5e7e0 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] [instance: 6c1e8070-fc54-4d28-90a9-1241c03b9b95] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:59:46.491820 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-84ce56c7-9343-46ef-a8ea-fb73d1b5e7e0 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:46.491820 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-84ce56c7-9343-46ef-a8ea-fb73d1b5e7e0 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:46.492282 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-84ce56c7-9343-46ef-a8ea-fb73d1b5e7e0 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:46.492979 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-84ce56c7-9343-46ef-a8ea-fb73d1b5e7e0 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:46.494400 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-84ce56c7-9343-46ef-a8ea-fb73d1b5e7e0 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:46.494400 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-84ce56c7-9343-46ef-a8ea-fb73d1b5e7e0 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:46.588139 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-84ce56c7-9343-46ef-a8ea-fb73d1b5e7e0 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:46.592446 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-84ce56c7-9343-46ef-a8ea-fb73d1b5e7e0 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:46.592949 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-84ce56c7-9343-46ef-a8ea-fb73d1b5e7e0 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:46.618719 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-84ce56c7-9343-46ef-a8ea-fb73d1b5e7e0 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:46.621053 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-84ce56c7-9343-46ef-a8ea-fb73d1b5e7e0 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:46.621053 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-84ce56c7-9343-46ef-a8ea-fb73d1b5e7e0 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:46.675396 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-84ce56c7-9343-46ef-a8ea-fb73d1b5e7e0 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Lazy-loading 'flavor' on Instance uuid 6c1e8070-fc54-4d28-90a9-1241c03b9b95 {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:59:46.709648 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-84ce56c7-9343-46ef-a8ea-fb73d1b5e7e0 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] 10.222.0.33 "PUT /compute/v2.1/servers/6c1e8070-fc54-4d28-90a9-1241c03b9b95/tags/tempest-tag-1659128089" status: 201 len: 0 microversion: 2.26 time: 0.274004 Oct 04 20:59:46.711021 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2457/4932] 10.222.0.33 () {62 vars in 1380 bytes} [Tue Oct 4 20:59:46 2022] PUT /compute/v2.1/servers/6c1e8070-fc54-4d28-90a9-1241c03b9b95/tags/tempest-tag-1659128089 => generated 0 bytes in 276 msecs (HTTP/1.1 201) 10 headers in 486 bytes (2 switches on core 0) Oct 04 20:59:46.717676 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-63f9caef-0f1e-43ed-815a-78844ca40e2b tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:59:46.718545 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-63f9caef-0f1e-43ed-815a-78844ca40e2b tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] [instance: 320f9a98-969f-473e-bc56-842bbd28dedc] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:59:46.719094 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-0eb731a0-e362-4bd0-81ae-137ecf2d707d tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5dbe3da6a4af181ef7302fe605fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3aa23aee3c8435c8f1f409019c5fed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:59:46.729890 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-0eb731a0-e362-4bd0-81ae-137ecf2d707d tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] 10.222.0.33 "GET /compute/v2.1/servers/243cbbbd-0734-4711-b605-c0657b81e359" status: 200 len: 1391 microversion: 2.1 time: 1.166306 Oct 04 20:59:46.732253 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-63f9caef-0f1e-43ed-815a-78844ca40e2b tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:46.734661 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2476/4933] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:59:45 2022] GET /compute/v2.1/servers/243cbbbd-0734-4711-b605-c0657b81e359 => generated 1391 bytes in 1172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:59:46.735522 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-63f9caef-0f1e-43ed-815a-78844ca40e2b tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:46.736001 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-63f9caef-0f1e-43ed-815a-78844ca40e2b tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:46.738950 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-63f9caef-0f1e-43ed-815a-78844ca40e2b tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:46.739458 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-63f9caef-0f1e-43ed-815a-78844ca40e2b tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:46.739894 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-63f9caef-0f1e-43ed-815a-78844ca40e2b tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:46.765658 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-74f621dd-db28-4d64-bd23-24128b1f84e9 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Calling method '.version_select at 0x7f3c6f588e50>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:59:46.799411 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-74f621dd-db28-4d64-bd23-24128b1f84e9 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:46.809861 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-74f621dd-db28-4d64-bd23-24128b1f84e9 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:46.810722 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-74f621dd-db28-4d64-bd23-24128b1f84e9 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:46.813926 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-74f621dd-db28-4d64-bd23-24128b1f84e9 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] [instance: 6c1e8070-fc54-4d28-90a9-1241c03b9b95] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:59:46.825203 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-74f621dd-db28-4d64-bd23-24128b1f84e9 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:46.826701 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-74f621dd-db28-4d64-bd23-24128b1f84e9 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:46.828187 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-74f621dd-db28-4d64-bd23-24128b1f84e9 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:46.832069 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-74f621dd-db28-4d64-bd23-24128b1f84e9 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:46.833615 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-74f621dd-db28-4d64-bd23-24128b1f84e9 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:46.836154 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-74f621dd-db28-4d64-bd23-24128b1f84e9 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:46.902330 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-74f621dd-db28-4d64-bd23-24128b1f84e9 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:46.904115 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-74f621dd-db28-4d64-bd23-24128b1f84e9 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:46.905563 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-74f621dd-db28-4d64-bd23-24128b1f84e9 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:46.985242 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.objects.instance [None req-74f621dd-db28-4d64-bd23-24128b1f84e9 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Lazy-loading 'flavor' on Instance uuid 6c1e8070-fc54-4d28-90a9-1241c03b9b95 {{(pid=128802) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:59:47.011938 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-74f621dd-db28-4d64-bd23-24128b1f84e9 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] 10.222.0.33 "DELETE /compute/v2.1/servers/6c1e8070-fc54-4d28-90a9-1241c03b9b95/tags" status: 204 len: 0 microversion: 2.26 time: 0.271100 Oct 04 20:59:47.012802 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2477/4934] 10.222.0.33 () {60 vars in 1295 bytes} [Tue Oct 4 20:59:46 2022] DELETE /compute/v2.1/servers/6c1e8070-fc54-4d28-90a9-1241c03b9b95/tags => generated 0 bytes in 273 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 20:59:47.021965 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-020faa24-51a0-47bc-9210-c86da0173604 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Calling method '.version_select at 0x7f3c6f6038b0>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:59:47.035915 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-020faa24-51a0-47bc-9210-c86da0173604 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:47.037547 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-020faa24-51a0-47bc-9210-c86da0173604 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:47.039812 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-020faa24-51a0-47bc-9210-c86da0173604 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:47.059466 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-020faa24-51a0-47bc-9210-c86da0173604 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] 10.222.0.33 "GET /compute/v2.1/servers/6c1e8070-fc54-4d28-90a9-1241c03b9b95/tags" status: 200 len: 12 microversion: 2.26 time: 0.041601 Oct 04 20:59:47.060002 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2478/4935] 10.222.0.33 () {60 vars in 1292 bytes} [Tue Oct 4 20:59:47 2022] GET /compute/v2.1/servers/6c1e8070-fc54-4d28-90a9-1241c03b9b95/tags => generated 12 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:59:47.072718 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-a0bc26c3-1ff8-48fc-81bc-344b00f8d5c6 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Calling method '.version_select at 0x7f3c6f588ee0>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:59:47.092658 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a0bc26c3-1ff8-48fc-81bc-344b00f8d5c6 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:47.099725 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a0bc26c3-1ff8-48fc-81bc-344b00f8d5c6 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:47.100639 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a0bc26c3-1ff8-48fc-81bc-344b00f8d5c6 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:47.101341 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-a0bc26c3-1ff8-48fc-81bc-344b00f8d5c6 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] [instance: 6c1e8070-fc54-4d28-90a9-1241c03b9b95] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:59:47.116271 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a0bc26c3-1ff8-48fc-81bc-344b00f8d5c6 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:47.117004 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a0bc26c3-1ff8-48fc-81bc-344b00f8d5c6 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:47.118360 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a0bc26c3-1ff8-48fc-81bc-344b00f8d5c6 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:47.121821 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a0bc26c3-1ff8-48fc-81bc-344b00f8d5c6 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:47.123441 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a0bc26c3-1ff8-48fc-81bc-344b00f8d5c6 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:47.124644 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a0bc26c3-1ff8-48fc-81bc-344b00f8d5c6 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:47.202258 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a0bc26c3-1ff8-48fc-81bc-344b00f8d5c6 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:47.207082 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a0bc26c3-1ff8-48fc-81bc-344b00f8d5c6 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:47.207784 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a0bc26c3-1ff8-48fc-81bc-344b00f8d5c6 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:47.253182 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.objects.instance [None req-a0bc26c3-1ff8-48fc-81bc-344b00f8d5c6 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Lazy-loading 'flavor' on Instance uuid 6c1e8070-fc54-4d28-90a9-1241c03b9b95 {{(pid=128802) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:59:47.296979 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-a0bc26c3-1ff8-48fc-81bc-344b00f8d5c6 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] 10.222.0.33 "DELETE /compute/v2.1/servers/6c1e8070-fc54-4d28-90a9-1241c03b9b95/tags" status: 204 len: 0 microversion: 2.26 time: 0.229080 Oct 04 20:59:47.298424 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2479/4936] 10.222.0.33 () {60 vars in 1295 bytes} [Tue Oct 4 20:59:47 2022] DELETE /compute/v2.1/servers/6c1e8070-fc54-4d28-90a9-1241c03b9b95/tags => generated 0 bytes in 231 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 04 20:59:47.308535 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-965eb4a8-aebf-4516-ac3e-b75c7ae1293f tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Calling method '.version_select at 0x7f3c6f584f70>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:59:47.337564 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-965eb4a8-aebf-4516-ac3e-b75c7ae1293f tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:47.338163 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-965eb4a8-aebf-4516-ac3e-b75c7ae1293f tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:47.338728 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-965eb4a8-aebf-4516-ac3e-b75c7ae1293f tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:47.342380 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-965eb4a8-aebf-4516-ac3e-b75c7ae1293f tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] [instance: 6c1e8070-fc54-4d28-90a9-1241c03b9b95] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:59:47.351114 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-965eb4a8-aebf-4516-ac3e-b75c7ae1293f tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:47.351984 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-965eb4a8-aebf-4516-ac3e-b75c7ae1293f tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:47.352649 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-965eb4a8-aebf-4516-ac3e-b75c7ae1293f tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:47.353588 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-965eb4a8-aebf-4516-ac3e-b75c7ae1293f tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:47.354266 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-965eb4a8-aebf-4516-ac3e-b75c7ae1293f tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:47.354940 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-965eb4a8-aebf-4516-ac3e-b75c7ae1293f tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:47.421171 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-965eb4a8-aebf-4516-ac3e-b75c7ae1293f tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:47.422088 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-965eb4a8-aebf-4516-ac3e-b75c7ae1293f tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:47.423164 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-965eb4a8-aebf-4516-ac3e-b75c7ae1293f tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:47.433902 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-965eb4a8-aebf-4516-ac3e-b75c7ae1293f tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:47.434817 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-965eb4a8-aebf-4516-ac3e-b75c7ae1293f tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:47.437104 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-965eb4a8-aebf-4516-ac3e-b75c7ae1293f tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:47.472668 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.objects.instance [None req-965eb4a8-aebf-4516-ac3e-b75c7ae1293f tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Lazy-loading 'flavor' on Instance uuid 6c1e8070-fc54-4d28-90a9-1241c03b9b95 {{(pid=128802) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:59:47.493595 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-965eb4a8-aebf-4516-ac3e-b75c7ae1293f tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] 10.222.0.33 "PUT /compute/v2.1/servers/6c1e8070-fc54-4d28-90a9-1241c03b9b95/tags/tempest-tag-35306338" status: 201 len: 0 microversion: 2.26 time: 0.189117 Oct 04 20:59:47.499105 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2480/4937] 10.222.0.33 () {62 vars in 1374 bytes} [Tue Oct 4 20:59:47 2022] PUT /compute/v2.1/servers/6c1e8070-fc54-4d28-90a9-1241c03b9b95/tags/tempest-tag-35306338 => generated 0 bytes in 191 msecs (HTTP/1.1 201) 10 headers in 484 bytes (2 switches on core 0) Oct 04 20:59:47.514826 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-001148c5-7784-48bc-97b1-de4ce476e4bb tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Calling method '.version_select at 0x7f3c6f6038b0>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:59:47.545565 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-001148c5-7784-48bc-97b1-de4ce476e4bb tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:47.546368 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-001148c5-7784-48bc-97b1-de4ce476e4bb tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:47.548289 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-001148c5-7784-48bc-97b1-de4ce476e4bb tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:47.550695 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-001148c5-7784-48bc-97b1-de4ce476e4bb tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] [instance: 6c1e8070-fc54-4d28-90a9-1241c03b9b95] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:59:47.566750 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-001148c5-7784-48bc-97b1-de4ce476e4bb tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:47.568101 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-001148c5-7784-48bc-97b1-de4ce476e4bb tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:47.569928 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-001148c5-7784-48bc-97b1-de4ce476e4bb tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:47.573822 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-001148c5-7784-48bc-97b1-de4ce476e4bb tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:47.575917 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-001148c5-7784-48bc-97b1-de4ce476e4bb tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:47.577077 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-001148c5-7784-48bc-97b1-de4ce476e4bb tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:47.660738 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-001148c5-7784-48bc-97b1-de4ce476e4bb tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:47.667562 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-001148c5-7784-48bc-97b1-de4ce476e4bb tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:47.668527 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-001148c5-7784-48bc-97b1-de4ce476e4bb tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:47.687423 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-63f9caef-0f1e-43ed-815a-78844ca40e2b tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6513f5e908ac4d028cad6eeeebeab285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65946afc398d4a9fb1c9095a4f946e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:59:47.708659 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-63f9caef-0f1e-43ed-815a-78844ca40e2b tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc" status: 200 len: 1532 microversion: 2.1 time: 0.992535 Oct 04 20:59:47.710385 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2458/4938] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:59:46 2022] GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc => generated 1532 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:59:47.715157 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-001148c5-7784-48bc-97b1-de4ce476e4bb tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:47.719855 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-001148c5-7784-48bc-97b1-de4ce476e4bb tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:47.722698 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-001148c5-7784-48bc-97b1-de4ce476e4bb tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:47.760491 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-cd871cb2-b3cc-4ad8-9dfb-ba900424e717 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:59:47.761273 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-cd871cb2-b3cc-4ad8-9dfb-ba900424e717 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] [instance: 243cbbbd-0734-4711-b605-c0657b81e359] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:59:47.781563 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cd871cb2-b3cc-4ad8-9dfb-ba900424e717 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:47.782778 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cd871cb2-b3cc-4ad8-9dfb-ba900424e717 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:47.784900 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cd871cb2-b3cc-4ad8-9dfb-ba900424e717 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:47.788244 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cd871cb2-b3cc-4ad8-9dfb-ba900424e717 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:47.795229 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cd871cb2-b3cc-4ad8-9dfb-ba900424e717 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:47.796681 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cd871cb2-b3cc-4ad8-9dfb-ba900424e717 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:47.805056 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.objects.instance [None req-001148c5-7784-48bc-97b1-de4ce476e4bb tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Lazy-loading 'flavor' on Instance uuid 6c1e8070-fc54-4d28-90a9-1241c03b9b95 {{(pid=128802) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:59:47.842067 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-001148c5-7784-48bc-97b1-de4ce476e4bb tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] 10.222.0.33 "PUT /compute/v2.1/servers/6c1e8070-fc54-4d28-90a9-1241c03b9b95/tags/tempest-tag-1434548427" status: 201 len: 0 microversion: 2.26 time: 0.340277 Oct 04 20:59:47.843764 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2481/4939] 10.222.0.33 () {62 vars in 1380 bytes} [Tue Oct 4 20:59:47 2022] PUT /compute/v2.1/servers/6c1e8070-fc54-4d28-90a9-1241c03b9b95/tags/tempest-tag-1434548427 => generated 0 bytes in 342 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Oct 04 20:59:47.855550 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-ea202eac-87a2-475a-b84b-f530495befbd tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Action: 'update_all', calling method: .version_select at 0x7f3c6f599b80>, body: {"tags": ["tempest-tag-1521800230", "tempest-tag-96157259"]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:59:47.889376 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ea202eac-87a2-475a-b84b-f530495befbd tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:47.889993 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ea202eac-87a2-475a-b84b-f530495befbd tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:47.890649 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ea202eac-87a2-475a-b84b-f530495befbd tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:47.891325 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-ea202eac-87a2-475a-b84b-f530495befbd tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] [instance: 6c1e8070-fc54-4d28-90a9-1241c03b9b95] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:59:47.903174 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ea202eac-87a2-475a-b84b-f530495befbd tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:47.904073 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ea202eac-87a2-475a-b84b-f530495befbd tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:47.904741 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ea202eac-87a2-475a-b84b-f530495befbd tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:47.906356 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ea202eac-87a2-475a-b84b-f530495befbd tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:47.907118 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ea202eac-87a2-475a-b84b-f530495befbd tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:47.907687 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ea202eac-87a2-475a-b84b-f530495befbd tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:47.943584 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ea202eac-87a2-475a-b84b-f530495befbd tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:47.944149 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ea202eac-87a2-475a-b84b-f530495befbd tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:47.944659 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ea202eac-87a2-475a-b84b-f530495befbd tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:47.977993 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.objects.instance [None req-ea202eac-87a2-475a-b84b-f530495befbd tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Lazy-loading 'flavor' on Instance uuid 6c1e8070-fc54-4d28-90a9-1241c03b9b95 {{(pid=128802) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:59:48.015358 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-ea202eac-87a2-475a-b84b-f530495befbd tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] 10.222.0.33 "PUT /compute/v2.1/servers/6c1e8070-fc54-4d28-90a9-1241c03b9b95/tags" status: 200 len: 60 microversion: 2.26 time: 0.165006 Oct 04 20:59:48.016914 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2482/4940] 10.222.0.33 () {62 vars in 1312 bytes} [Tue Oct 4 20:59:47 2022] PUT /compute/v2.1/servers/6c1e8070-fc54-4d28-90a9-1241c03b9b95/tags => generated 60 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:59:48.035252 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-3ef6e98d-8aed-4d0a-9595-fc4c9906c4dc tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Calling method '.version_select at 0x7f3c6f588d30>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:59:48.054459 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3ef6e98d-8aed-4d0a-9595-fc4c9906c4dc tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:48.054969 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3ef6e98d-8aed-4d0a-9595-fc4c9906c4dc tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:48.055615 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3ef6e98d-8aed-4d0a-9595-fc4c9906c4dc tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:48.073983 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-3ef6e98d-8aed-4d0a-9595-fc4c9906c4dc tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] 10.222.0.33 "GET /compute/v2.1/servers/6c1e8070-fc54-4d28-90a9-1241c03b9b95/tags" status: 200 len: 60 microversion: 2.26 time: 0.049712 Oct 04 20:59:48.078805 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2483/4941] 10.222.0.33 () {60 vars in 1292 bytes} [Tue Oct 4 20:59:48 2022] GET /compute/v2.1/servers/6c1e8070-fc54-4d28-90a9-1241c03b9b95/tags => generated 60 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:59:48.091664 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-ee35ddb3-4958-42b3-8a4f-9c08565f1cec tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Calling method '.version_select at 0x7f3c6f6039d0>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:59:48.095127 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:59:48.134310 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ee35ddb3-4958-42b3-8a4f-9c08565f1cec tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:48.135172 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ee35ddb3-4958-42b3-8a4f-9c08565f1cec tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:48.135619 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ee35ddb3-4958-42b3-8a4f-9c08565f1cec tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:48.136109 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-ee35ddb3-4958-42b3-8a4f-9c08565f1cec tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] [instance: 6c1e8070-fc54-4d28-90a9-1241c03b9b95] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:59:48.157104 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ee35ddb3-4958-42b3-8a4f-9c08565f1cec tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:48.157634 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ee35ddb3-4958-42b3-8a4f-9c08565f1cec tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:48.160677 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ee35ddb3-4958-42b3-8a4f-9c08565f1cec tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:48.163672 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ee35ddb3-4958-42b3-8a4f-9c08565f1cec tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:48.164181 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ee35ddb3-4958-42b3-8a4f-9c08565f1cec tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:48.165349 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ee35ddb3-4958-42b3-8a4f-9c08565f1cec tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:48.221185 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ee35ddb3-4958-42b3-8a4f-9c08565f1cec tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:48.221689 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ee35ddb3-4958-42b3-8a4f-9c08565f1cec tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:48.222133 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ee35ddb3-4958-42b3-8a4f-9c08565f1cec tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:48.302549 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.objects.instance [None req-ee35ddb3-4958-42b3-8a4f-9c08565f1cec tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Lazy-loading 'flavor' on Instance uuid 6c1e8070-fc54-4d28-90a9-1241c03b9b95 {{(pid=128802) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 20:59:48.340200 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-ee35ddb3-4958-42b3-8a4f-9c08565f1cec tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] 10.222.0.33 "DELETE /compute/v2.1/servers/6c1e8070-fc54-4d28-90a9-1241c03b9b95/tags" status: 204 len: 0 microversion: 2.26 time: 0.256506 Oct 04 20:59:48.347126 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2484/4942] 10.222.0.33 () {60 vars in 1295 bytes} [Tue Oct 4 20:59:48 2022] DELETE /compute/v2.1/servers/6c1e8070-fc54-4d28-90a9-1241c03b9b95/tags => generated 0 bytes in 260 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 20:59:48.378408 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-917b7b3d-0f52-46cb-8b4e-3870256f03f0 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:59:48.378408 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-917b7b3d-0f52-46cb-8b4e-3870256f03f0 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] [instance: 6c1e8070-fc54-4d28-90a9-1241c03b9b95] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:59:48.384412 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-917b7b3d-0f52-46cb-8b4e-3870256f03f0 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:48.384904 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-917b7b3d-0f52-46cb-8b4e-3870256f03f0 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:48.385614 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-917b7b3d-0f52-46cb-8b4e-3870256f03f0 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:48.386820 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-917b7b3d-0f52-46cb-8b4e-3870256f03f0 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:48.388161 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-917b7b3d-0f52-46cb-8b4e-3870256f03f0 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:48.390849 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-917b7b3d-0f52-46cb-8b4e-3870256f03f0 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:48.445449 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=89,nova_cell1:DELETE=4,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=3,nova_cell1:RELEASE=2 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:59:48.457338 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-917b7b3d-0f52-46cb-8b4e-3870256f03f0 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] [instance: 6c1e8070-fc54-4d28-90a9-1241c03b9b95] Going to try to terminate instance {{(pid=128802) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 20:59:48.627633 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-cd871cb2-b3cc-4ad8-9dfb-ba900424e717 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5dbe3da6a4af181ef7302fe605fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3aa23aee3c8435c8f1f409019c5fed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:59:48.642937 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-cd871cb2-b3cc-4ad8-9dfb-ba900424e717 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] 10.222.0.33 "GET /compute/v2.1/servers/243cbbbd-0734-4711-b605-c0657b81e359" status: 200 len: 1391 microversion: 2.1 time: 0.887282 Oct 04 20:59:48.662000 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2459/4943] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:59:47 2022] GET /compute/v2.1/servers/243cbbbd-0734-4711-b605-c0657b81e359 => generated 1391 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:59:48.670936 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-917b7b3d-0f52-46cb-8b4e-3870256f03f0 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] 10.222.0.33 "DELETE /compute/v2.1/servers/6c1e8070-fc54-4d28-90a9-1241c03b9b95" status: 204 len: 0 microversion: 2.26 time: 0.319878 Oct 04 20:59:48.672156 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2485/4944] 10.222.0.33 () {60 vars in 1280 bytes} [Tue Oct 4 20:59:48 2022] DELETE /compute/v2.1/servers/6c1e8070-fc54-4d28-90a9-1241c03b9b95 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 20:59:48.683234 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9941a1a8-5f70-458a-b779-61de607b5294 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:59:48.696684 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-9941a1a8-5f70-458a-b779-61de607b5294 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] [instance: 6c1e8070-fc54-4d28-90a9-1241c03b9b95] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:59:48.724327 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9941a1a8-5f70-458a-b779-61de607b5294 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:48.725081 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9941a1a8-5f70-458a-b779-61de607b5294 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:48.727649 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9941a1a8-5f70-458a-b779-61de607b5294 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:48.740096 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9941a1a8-5f70-458a-b779-61de607b5294 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:48.740440 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-f31e3d6b-2273-4c40-8314-b22da8328bd4 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:59:48.742668 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-f31e3d6b-2273-4c40-8314-b22da8328bd4 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] [instance: 320f9a98-969f-473e-bc56-842bbd28dedc] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:59:48.743284 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9941a1a8-5f70-458a-b779-61de607b5294 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:48.743749 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9941a1a8-5f70-458a-b779-61de607b5294 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:48.760886 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f31e3d6b-2273-4c40-8314-b22da8328bd4 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:48.762986 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f31e3d6b-2273-4c40-8314-b22da8328bd4 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:48.764778 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f31e3d6b-2273-4c40-8314-b22da8328bd4 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:48.768397 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f31e3d6b-2273-4c40-8314-b22da8328bd4 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:48.771282 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f31e3d6b-2273-4c40-8314-b22da8328bd4 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:48.772018 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f31e3d6b-2273-4c40-8314-b22da8328bd4 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:49.594626 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-9941a1a8-5f70-458a-b779-61de607b5294 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb9d89574d941ea9c8ca7b2b8d11f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e56c6049d5741418d193fd496cbb5d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:59:49.614115 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-9941a1a8-5f70-458a-b779-61de607b5294 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb9d89574d941ea9c8ca7b2b8d11f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e56c6049d5741418d193fd496cbb5d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:59:49.615652 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-9941a1a8-5f70-458a-b779-61de607b5294 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb9d89574d941ea9c8ca7b2b8d11f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e56c6049d5741418d193fd496cbb5d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:59:49.616892 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-9941a1a8-5f70-458a-b779-61de607b5294 tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] 10.222.0.33 "GET /compute/v2.1/servers/6c1e8070-fc54-4d28-90a9-1241c03b9b95" status: 200 len: 1553 microversion: 2.26 time: 0.938863 Oct 04 20:59:49.617451 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2460/4945] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:59:48 2022] GET /compute/v2.1/servers/6c1e8070-fc54-4d28-90a9-1241c03b9b95 => generated 1553 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:59:49.668259 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-986b2fe0-ddcf-48ca-ad93-e96aeb7801fa tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:59:49.669759 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-986b2fe0-ddcf-48ca-ad93-e96aeb7801fa tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] [instance: 243cbbbd-0734-4711-b605-c0657b81e359] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:59:49.685941 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-986b2fe0-ddcf-48ca-ad93-e96aeb7801fa tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:49.688667 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-986b2fe0-ddcf-48ca-ad93-e96aeb7801fa tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:49.689527 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-986b2fe0-ddcf-48ca-ad93-e96aeb7801fa tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:49.690664 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-986b2fe0-ddcf-48ca-ad93-e96aeb7801fa tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:49.691375 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-986b2fe0-ddcf-48ca-ad93-e96aeb7801fa tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:49.692079 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-986b2fe0-ddcf-48ca-ad93-e96aeb7801fa tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:50.197969 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-f31e3d6b-2273-4c40-8314-b22da8328bd4 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6513f5e908ac4d028cad6eeeebeab285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65946afc398d4a9fb1c9095a4f946e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:59:50.214335 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-f31e3d6b-2273-4c40-8314-b22da8328bd4 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc" status: 200 len: 1527 microversion: 2.1 time: 1.482469 Oct 04 20:59:50.215503 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2486/4946] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:59:48 2022] GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc => generated 1527 bytes in 1485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:59:50.646245 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-ae46a9c8-8d33-4e19-8644-d3f42810e5fc tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:59:50.646917 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-ae46a9c8-8d33-4e19-8644-d3f42810e5fc tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] [instance: 6c1e8070-fc54-4d28-90a9-1241c03b9b95] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:59:50.659764 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ae46a9c8-8d33-4e19-8644-d3f42810e5fc tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:50.660277 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ae46a9c8-8d33-4e19-8644-d3f42810e5fc tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:50.660719 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ae46a9c8-8d33-4e19-8644-d3f42810e5fc tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:50.661436 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ae46a9c8-8d33-4e19-8644-d3f42810e5fc tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:50.661895 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ae46a9c8-8d33-4e19-8644-d3f42810e5fc tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:50.675768 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ae46a9c8-8d33-4e19-8644-d3f42810e5fc tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:51.286876 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-986b2fe0-ddcf-48ca-ad93-e96aeb7801fa tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5dbe3da6a4af181ef7302fe605fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3aa23aee3c8435c8f1f409019c5fed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:59:51.304986 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-986b2fe0-ddcf-48ca-ad93-e96aeb7801fa tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] 10.222.0.33 "GET /compute/v2.1/servers/243cbbbd-0734-4711-b605-c0657b81e359" status: 200 len: 1391 microversion: 2.1 time: 1.640905 Oct 04 20:59:51.307867 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2461/4947] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:59:49 2022] GET /compute/v2.1/servers/243cbbbd-0734-4711-b605-c0657b81e359 => generated 1391 bytes in 1645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:59:51.315878 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1c99e5ac-5b99-487e-b02e-96b8bc0a8ebc tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:59:51.317448 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-1c99e5ac-5b99-487e-b02e-96b8bc0a8ebc tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] [instance: 320f9a98-969f-473e-bc56-842bbd28dedc] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:59:51.339819 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1c99e5ac-5b99-487e-b02e-96b8bc0a8ebc tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:51.342101 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1c99e5ac-5b99-487e-b02e-96b8bc0a8ebc tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:51.343355 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1c99e5ac-5b99-487e-b02e-96b8bc0a8ebc tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:51.348617 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1c99e5ac-5b99-487e-b02e-96b8bc0a8ebc tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:51.349102 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1c99e5ac-5b99-487e-b02e-96b8bc0a8ebc tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:51.351302 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1c99e5ac-5b99-487e-b02e-96b8bc0a8ebc tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:51.832383 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-ae46a9c8-8d33-4e19-8644-d3f42810e5fc tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb9d89574d941ea9c8ca7b2b8d11f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e56c6049d5741418d193fd496cbb5d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:59:51.841678 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-ae46a9c8-8d33-4e19-8644-d3f42810e5fc tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb9d89574d941ea9c8ca7b2b8d11f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e56c6049d5741418d193fd496cbb5d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:59:51.850680 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-ae46a9c8-8d33-4e19-8644-d3f42810e5fc tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb9d89574d941ea9c8ca7b2b8d11f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e56c6049d5741418d193fd496cbb5d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:59:51.852453 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-ae46a9c8-8d33-4e19-8644-d3f42810e5fc tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] 10.222.0.33 "GET /compute/v2.1/servers/6c1e8070-fc54-4d28-90a9-1241c03b9b95" status: 200 len: 1553 microversion: 2.26 time: 1.211336 Oct 04 20:59:51.856059 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2487/4948] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:59:50 2022] GET /compute/v2.1/servers/6c1e8070-fc54-4d28-90a9-1241c03b9b95 => generated 1553 bytes in 1216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:59:52.335161 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-e6889d83-7f8b-4da0-95f7-81bc251fc49b tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:59:52.340619 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-e6889d83-7f8b-4da0-95f7-81bc251fc49b tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] [instance: 243cbbbd-0734-4711-b605-c0657b81e359] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:59:52.364383 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e6889d83-7f8b-4da0-95f7-81bc251fc49b tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:52.364885 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e6889d83-7f8b-4da0-95f7-81bc251fc49b tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:52.365340 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e6889d83-7f8b-4da0-95f7-81bc251fc49b tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:52.366043 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e6889d83-7f8b-4da0-95f7-81bc251fc49b tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:52.377244 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e6889d83-7f8b-4da0-95f7-81bc251fc49b tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:52.387441 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e6889d83-7f8b-4da0-95f7-81bc251fc49b tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:52.626128 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-1c99e5ac-5b99-487e-b02e-96b8bc0a8ebc tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6513f5e908ac4d028cad6eeeebeab285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65946afc398d4a9fb1c9095a4f946e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:59:52.644653 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-1c99e5ac-5b99-487e-b02e-96b8bc0a8ebc tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc" status: 200 len: 1527 microversion: 2.1 time: 1.332654 Oct 04 20:59:52.655693 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2462/4949] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:59:51 2022] GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc => generated 1527 bytes in 1344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:59:52.887748 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-55d2efe6-3a59-410d-b8cd-77d796cdf50a tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:59:52.888449 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-55d2efe6-3a59-410d-b8cd-77d796cdf50a tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] [instance: 6c1e8070-fc54-4d28-90a9-1241c03b9b95] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:59:52.910700 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-55d2efe6-3a59-410d-b8cd-77d796cdf50a tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:52.920195 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-55d2efe6-3a59-410d-b8cd-77d796cdf50a tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:52.921152 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-55d2efe6-3a59-410d-b8cd-77d796cdf50a tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:52.922101 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-55d2efe6-3a59-410d-b8cd-77d796cdf50a tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:52.931130 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-55d2efe6-3a59-410d-b8cd-77d796cdf50a tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:52.933534 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-55d2efe6-3a59-410d-b8cd-77d796cdf50a tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:53.400611 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-e6889d83-7f8b-4da0-95f7-81bc251fc49b tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5dbe3da6a4af181ef7302fe605fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3aa23aee3c8435c8f1f409019c5fed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:59:53.410126 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-e6889d83-7f8b-4da0-95f7-81bc251fc49b tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] 10.222.0.33 "GET /compute/v2.1/servers/243cbbbd-0734-4711-b605-c0657b81e359" status: 200 len: 1391 microversion: 2.1 time: 1.080886 Oct 04 20:59:53.415659 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2488/4950] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:59:52 2022] GET /compute/v2.1/servers/243cbbbd-0734-4711-b605-c0657b81e359 => generated 1391 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:59:53.442044 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-55d2efe6-3a59-410d-b8cd-77d796cdf50a tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb9d89574d941ea9c8ca7b2b8d11f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e56c6049d5741418d193fd496cbb5d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:59:53.464800 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-55d2efe6-3a59-410d-b8cd-77d796cdf50a tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb9d89574d941ea9c8ca7b2b8d11f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e56c6049d5741418d193fd496cbb5d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:59:53.478063 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-55d2efe6-3a59-410d-b8cd-77d796cdf50a tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb9d89574d941ea9c8ca7b2b8d11f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e56c6049d5741418d193fd496cbb5d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:59:53.482329 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-55d2efe6-3a59-410d-b8cd-77d796cdf50a tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] 10.222.0.33 "GET /compute/v2.1/servers/6c1e8070-fc54-4d28-90a9-1241c03b9b95" status: 200 len: 1511 microversion: 2.26 time: 0.598821 Oct 04 20:59:53.487613 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2463/4951] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:59:52 2022] GET /compute/v2.1/servers/6c1e8070-fc54-4d28-90a9-1241c03b9b95 => generated 1511 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 20:59:53.679315 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-2503152f-f618-4244-a806-6e6d2b932b84 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:59:53.680505 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-2503152f-f618-4244-a806-6e6d2b932b84 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] [instance: 320f9a98-969f-473e-bc56-842bbd28dedc] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:59:53.690568 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2503152f-f618-4244-a806-6e6d2b932b84 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:53.691975 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2503152f-f618-4244-a806-6e6d2b932b84 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:53.692737 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2503152f-f618-4244-a806-6e6d2b932b84 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:53.694133 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2503152f-f618-4244-a806-6e6d2b932b84 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:53.697436 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2503152f-f618-4244-a806-6e6d2b932b84 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:53.699469 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2503152f-f618-4244-a806-6e6d2b932b84 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:54.382924 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-53451161-72fa-49dd-a26e-b29e89460a01 req-784edf79-4d66-49e9-b49a-4068ab28c89d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c1e8070-fc54-4d28-90a9-1241c03b9b95", "name": "network-vif-deleted", "tag": "d1ea27b2-49f2-43a7-96dc-84ebebf2b2e0"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:59:54.433674 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-53451161-72fa-49dd-a26e-b29e89460a01 req-784edf79-4d66-49e9-b49a-4068ab28c89d service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:54.435349 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-53451161-72fa-49dd-a26e-b29e89460a01 req-784edf79-4d66-49e9-b49a-4068ab28c89d service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:54.440560 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-53451161-72fa-49dd-a26e-b29e89460a01 req-784edf79-4d66-49e9-b49a-4068ab28c89d service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:54.495756 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-53451161-72fa-49dd-a26e-b29e89460a01 req-784edf79-4d66-49e9-b49a-4068ab28c89d service nova] Creating event network-vif-deleted:d1ea27b2-49f2-43a7-96dc-84ebebf2b2e0 for instance 6c1e8070-fc54-4d28-90a9-1241c03b9b95 on n-h1-854823-8 Oct 04 20:59:54.510813 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-53451161-72fa-49dd-a26e-b29e89460a01 req-784edf79-4d66-49e9-b49a-4068ab28c89d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133175 Oct 04 20:59:54.515489 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2464/4952] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:59:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 20:59:54.533351 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e44890ed-1933-4984-8430-202787bce7a8 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:59:54.541609 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e44890ed-1933-4984-8430-202787bce7a8 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] [instance: 243cbbbd-0734-4711-b605-c0657b81e359] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:59:54.558935 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e44890ed-1933-4984-8430-202787bce7a8 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:54.561874 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e44890ed-1933-4984-8430-202787bce7a8 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:54.562379 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e44890ed-1933-4984-8430-202787bce7a8 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:54.563159 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e44890ed-1933-4984-8430-202787bce7a8 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:54.567995 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e44890ed-1933-4984-8430-202787bce7a8 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:54.568656 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e44890ed-1933-4984-8430-202787bce7a8 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:55.177484 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-2503152f-f618-4244-a806-6e6d2b932b84 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6513f5e908ac4d028cad6eeeebeab285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65946afc398d4a9fb1c9095a4f946e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:59:55.207185 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-2503152f-f618-4244-a806-6e6d2b932b84 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc" status: 200 len: 1527 microversion: 2.1 time: 1.534165 Oct 04 20:59:55.210540 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2489/4953] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:59:53 2022] GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc => generated 1527 bytes in 1540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:59:55.215590 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e44890ed-1933-4984-8430-202787bce7a8 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5dbe3da6a4af181ef7302fe605fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3aa23aee3c8435c8f1f409019c5fed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:59:55.230775 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e44890ed-1933-4984-8430-202787bce7a8 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] 10.222.0.33 "GET /compute/v2.1/servers/243cbbbd-0734-4711-b605-c0657b81e359" status: 200 len: 1391 microversion: 2.1 time: 0.712892 Oct 04 20:59:55.259825 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2465/4954] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:59:54 2022] GET /compute/v2.1/servers/243cbbbd-0734-4711-b605-c0657b81e359 => generated 1391 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:59:55.263252 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-6b2b42e0-4665-47e6-a44f-09cf20f9bb8c tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:59:55.265520 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-6b2b42e0-4665-47e6-a44f-09cf20f9bb8c tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] [instance: 6c1e8070-fc54-4d28-90a9-1241c03b9b95] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:59:55.291677 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6b2b42e0-4665-47e6-a44f-09cf20f9bb8c tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:55.293958 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6b2b42e0-4665-47e6-a44f-09cf20f9bb8c tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:55.298387 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6b2b42e0-4665-47e6-a44f-09cf20f9bb8c tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:55.302555 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6b2b42e0-4665-47e6-a44f-09cf20f9bb8c tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:55.303843 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6b2b42e0-4665-47e6-a44f-09cf20f9bb8c tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:55.306846 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6b2b42e0-4665-47e6-a44f-09cf20f9bb8c tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:55.373771 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.wsgi [None req-6b2b42e0-4665-47e6-a44f-09cf20f9bb8c tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] HTTP exception thrown: Instance 6c1e8070-fc54-4d28-90a9-1241c03b9b95 could not be found. Oct 04 20:59:55.378140 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-6b2b42e0-4665-47e6-a44f-09cf20f9bb8c tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Request method failure captured: Oct 04 20:59:55.378140 n-d-854823-8 devstack@n-api.service[128802]: request: GET /compute/v2.1/servers/6c1e8070-fc54-4d28-90a9-1241c03b9b95 HTTP/1.1 Oct 04 20:59:55.378140 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 20:59:55.378140 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 20:59:55.378140 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 20:59:55.378140 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 0 Oct 04 20:59:55.378140 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 20:59:55.378140 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 20:59:55.378140 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 20:59:55.378140 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 20:59:55.378140 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPJ6h7VK7tnuHRqy6CSjpB_OCNnYKI-KUQGVs6Zcv48UMCpb8aIz2tbDtuSNB6nK4ekCAggyS_KCvEg3919OKKjSehf-XarPDpLmviGusz8tDrQWVy-MKlcwg79jTVLUkIs3tYqRy5skrgxpP8HuvmK4gZKEPFKzBQ6HN3v_rvr2g3rs Oct 04 20:59:55.378140 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 20:59:55.378140 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 20:59:55.378140 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 20:59:55.378140 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 20:59:55.378140 n-d-854823-8 devstack@n-api.service[128802]: X-Openstack-Nova-Api-Version: 2.26 Oct 04 20:59:55.378140 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 20:59:55.378140 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 20:59:55.378140 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: 2e56c6049d5741418d193fd496cbb5d9 Oct 04 20:59:55.378140 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-ServerTagsTestJSON-337103316 Oct 04 20:59:55.378140 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 20:59:55.378140 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 20:59:55.378140 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_2e56c6049d5741418d193fd496cbb5d9", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2e56c6049d5741418d193fd496cbb5d9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2e56c6049d5741418d193fd496cbb5d9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/2e56c6049d5741418d193fd496cbb5d9"}]}] Oct 04 20:59:55.378140 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-ServerTagsTestJSON-337103316 Oct 04 20:59:55.378140 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: 2e56c6049d5741418d193fd496cbb5d9 Oct 04 20:59:55.378140 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-ServerTagsTestJSON-337103316 Oct 04 20:59:55.378140 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-ServerTagsTestJSON-337103316-project Oct 04 20:59:55.378140 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 20:59:55.378140 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 20:59:55.378140 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: 4cb9d89574d941ea9c8ca7b2b8d11f35 Oct 04 20:59:55.378140 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-ServerTagsTestJSON-337103316-project Oct 04 20:59:55.378140 n-d-854823-8 devstack@n-api.service[128802]: method: > Oct 04 20:59:55.378140 n-d-854823-8 devstack@n-api.service[128802]: exception: Instance 6c1e8070-fc54-4d28-90a9-1241c03b9b95 could not be found. Oct 04 20:59:55.378140 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'id': '6c1e8070-fc54-4d28-90a9-1241c03b9b95'} Oct 04 20:59:55.378140 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 20:59:55.378140 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:59:55.378140 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 20:59:55.378140 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 20:59:55.378140 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 20:59:55.378140 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 20:59:55.378140 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 20:59:55.378140 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 20:59:55.378140 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 20:59:55.378140 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 20:59:55.378140 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c1e8070-fc54-4d28-90a9-1241c03b9b95 could not be found. Oct 04 20:59:55.378140 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:59:55.378140 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:59:55.378140 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:59:55.378140 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:59:55.378140 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:59:55.378140 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:59:55.378140 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 20:59:55.378140 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 20:59:55.378140 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 20:59:55.378140 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 20:59:55.378140 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 20:59:55.378140 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 20:59:55.378140 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 20:59:55.378140 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 20:59:55.378140 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 20:59:55.378140 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 20:59:55.378140 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c1e8070-fc54-4d28-90a9-1241c03b9b95 could not be found. Oct 04 20:59:55.378140 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:59:55.378140 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 20:59:55.378140 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:59:55.384164 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 20:59:55.384164 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 20:59:55.384164 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 20:59:55.384164 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 20:59:55.384164 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 20:59:55.384164 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c1e8070-fc54-4d28-90a9-1241c03b9b95 could not be found. Oct 04 20:59:55.384164 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 20:59:55.386918 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-6b2b42e0-4665-47e6-a44f-09cf20f9bb8c tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] Returning 404 to user: Instance 6c1e8070-fc54-4d28-90a9-1241c03b9b95 could not be found. {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 20:59:55.388864 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-6b2b42e0-4665-47e6-a44f-09cf20f9bb8c tempest-ServerTagsTestJSON-337103316 tempest-ServerTagsTestJSON-337103316-project] 10.222.0.33 "GET /compute/v2.1/servers/6c1e8070-fc54-4d28-90a9-1241c03b9b95" status: 404 len: 111 microversion: 2.26 time: 0.176985 Oct 04 20:59:55.390915 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2490/4955] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 20:59:55 2022] GET /compute/v2.1/servers/6c1e8070-fc54-4d28-90a9-1241c03b9b95 => generated 111 bytes in 179 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 20:59:56.236566 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-4a576a20-1b90-49b9-be76-c77935fb7197 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:59:56.237288 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-4a576a20-1b90-49b9-be76-c77935fb7197 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] [instance: 320f9a98-969f-473e-bc56-842bbd28dedc] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:59:56.253633 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-1cc89f2c-52ac-449d-99fb-5f604924ee02 req-5c95201e-0e10-4035-92f3-8b786c9b10bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "243cbbbd-0734-4711-b605-c0657b81e359", "name": "network-vif-plugged", "status": "completed", "tag": "65760264-f1de-43cd-baca-c370b4c65ec6"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:59:56.255732 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4a576a20-1b90-49b9-be76-c77935fb7197 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:56.256226 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4a576a20-1b90-49b9-be76-c77935fb7197 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:56.256703 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4a576a20-1b90-49b9-be76-c77935fb7197 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:56.257341 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4a576a20-1b90-49b9-be76-c77935fb7197 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:56.257789 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4a576a20-1b90-49b9-be76-c77935fb7197 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:56.258209 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4a576a20-1b90-49b9-be76-c77935fb7197 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:56.288030 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-1cc89f2c-52ac-449d-99fb-5f604924ee02 req-5c95201e-0e10-4035-92f3-8b786c9b10bf service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:56.290924 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-1cc89f2c-52ac-449d-99fb-5f604924ee02 req-5c95201e-0e10-4035-92f3-8b786c9b10bf service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:56.296988 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-1cc89f2c-52ac-449d-99fb-5f604924ee02 req-5c95201e-0e10-4035-92f3-8b786c9b10bf service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:56.341659 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-1cc89f2c-52ac-449d-99fb-5f604924ee02 req-5c95201e-0e10-4035-92f3-8b786c9b10bf service nova] Creating event network-vif-plugged:65760264-f1de-43cd-baca-c370b4c65ec6 for instance 243cbbbd-0734-4711-b605-c0657b81e359 on n-h2-854823-8 Oct 04 20:59:56.368440 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-1cc89f2c-52ac-449d-99fb-5f604924ee02 req-5c95201e-0e10-4035-92f3-8b786c9b10bf service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.586451 Oct 04 20:59:56.370861 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2466/4956] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:59:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:59:56.398512 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-18af2dfa-ca22-4db0-8a7c-57f89e4a3349 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:59:56.399848 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-18af2dfa-ca22-4db0-8a7c-57f89e4a3349 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] [instance: 243cbbbd-0734-4711-b605-c0657b81e359] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:59:56.417757 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-18af2dfa-ca22-4db0-8a7c-57f89e4a3349 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:56.418907 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-18af2dfa-ca22-4db0-8a7c-57f89e4a3349 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:56.420388 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-18af2dfa-ca22-4db0-8a7c-57f89e4a3349 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:56.421557 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-18af2dfa-ca22-4db0-8a7c-57f89e4a3349 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:56.422474 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-18af2dfa-ca22-4db0-8a7c-57f89e4a3349 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:56.423099 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-18af2dfa-ca22-4db0-8a7c-57f89e4a3349 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:56.771708 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-4a576a20-1b90-49b9-be76-c77935fb7197 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6513f5e908ac4d028cad6eeeebeab285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65946afc398d4a9fb1c9095a4f946e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:59:56.785414 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-4a576a20-1b90-49b9-be76-c77935fb7197 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc" status: 200 len: 1527 microversion: 2.1 time: 0.553289 Oct 04 20:59:56.786597 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2491/4957] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:59:56 2022] GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc => generated 1527 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:59:56.834381 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-18af2dfa-ca22-4db0-8a7c-57f89e4a3349 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5dbe3da6a4af181ef7302fe605fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3aa23aee3c8435c8f1f409019c5fed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:59:56.836865 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=93,nova_cell1:DELETE=1,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=2,nova_cell1:RELEASE=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 20:59:56.850459 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-18af2dfa-ca22-4db0-8a7c-57f89e4a3349 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] 10.222.0.33 "GET /compute/v2.1/servers/243cbbbd-0734-4711-b605-c0657b81e359" status: 200 len: 1391 microversion: 2.1 time: 0.477843 Oct 04 20:59:56.851521 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2467/4958] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:59:56 2022] GET /compute/v2.1/servers/243cbbbd-0734-4711-b605-c0657b81e359 => generated 1391 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:59:57.812358 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-4ba6d7ea-a32b-473d-8290-19256d94c772 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:59:57.817157 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-4ba6d7ea-a32b-473d-8290-19256d94c772 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] [instance: 320f9a98-969f-473e-bc56-842bbd28dedc] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:59:57.878022 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4ba6d7ea-a32b-473d-8290-19256d94c772 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:57.878384 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-4006e293-4f37-40df-8152-1f798097baf3 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:59:57.879078 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-4006e293-4f37-40df-8152-1f798097baf3 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] [instance: 243cbbbd-0734-4711-b605-c0657b81e359] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:59:57.880812 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4ba6d7ea-a32b-473d-8290-19256d94c772 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:57.881914 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4ba6d7ea-a32b-473d-8290-19256d94c772 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:57.882916 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4ba6d7ea-a32b-473d-8290-19256d94c772 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:57.883629 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4ba6d7ea-a32b-473d-8290-19256d94c772 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:57.884449 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4ba6d7ea-a32b-473d-8290-19256d94c772 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:57.895660 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4006e293-4f37-40df-8152-1f798097baf3 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:57.896245 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4006e293-4f37-40df-8152-1f798097baf3 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:57.896694 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4006e293-4f37-40df-8152-1f798097baf3 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:57.897443 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4006e293-4f37-40df-8152-1f798097baf3 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:57.897891 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4006e293-4f37-40df-8152-1f798097baf3 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:57.898324 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4006e293-4f37-40df-8152-1f798097baf3 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:58.599270 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-4006e293-4f37-40df-8152-1f798097baf3 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5dbe3da6a4af181ef7302fe605fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3aa23aee3c8435c8f1f409019c5fed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:59:58.618796 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-4006e293-4f37-40df-8152-1f798097baf3 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] 10.222.0.33 "GET /compute/v2.1/servers/243cbbbd-0734-4711-b605-c0657b81e359" status: 200 len: 1391 microversion: 2.1 time: 0.744951 Oct 04 20:59:58.622208 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2468/4959] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:59:57 2022] GET /compute/v2.1/servers/243cbbbd-0734-4711-b605-c0657b81e359 => generated 1391 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 20:59:58.660063 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-4ba6d7ea-a32b-473d-8290-19256d94c772 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6513f5e908ac4d028cad6eeeebeab285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65946afc398d4a9fb1c9095a4f946e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 20:59:58.676254 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-4ba6d7ea-a32b-473d-8290-19256d94c772 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc" status: 200 len: 1527 microversion: 2.1 time: 0.869349 Oct 04 20:59:58.679371 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2492/4960] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:59:57 2022] GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc => generated 1527 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 20:59:58.762325 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-ddaecf02-04b7-437e-ba33-64c46e70b517 req-07f907a0-e18e-4970-b6ec-621ce0c7f043 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "320f9a98-969f-473e-bc56-842bbd28dedc", "name": "network-vif-plugged", "status": "completed", "tag": "d2b3af35-3f6f-4a4b-91ec-14c17375542b"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 20:59:58.789039 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-ddaecf02-04b7-437e-ba33-64c46e70b517 req-07f907a0-e18e-4970-b6ec-621ce0c7f043 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:58.797427 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-ddaecf02-04b7-437e-ba33-64c46e70b517 req-07f907a0-e18e-4970-b6ec-621ce0c7f043 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:58.797993 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-ddaecf02-04b7-437e-ba33-64c46e70b517 req-07f907a0-e18e-4970-b6ec-621ce0c7f043 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:58.846002 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-ddaecf02-04b7-437e-ba33-64c46e70b517 req-07f907a0-e18e-4970-b6ec-621ce0c7f043 service nova] Creating event network-vif-plugged:d2b3af35-3f6f-4a4b-91ec-14c17375542b for instance 320f9a98-969f-473e-bc56-842bbd28dedc on n-h1-854823-8 Oct 04 20:59:58.867102 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-ddaecf02-04b7-437e-ba33-64c46e70b517 req-07f907a0-e18e-4970-b6ec-621ce0c7f043 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108668 Oct 04 20:59:58.875024 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2469/4961] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 20:59:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 20:59:59.659091 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-08da3ce1-ce08-42e3-8ad9-4d755215a5b2 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:59:59.660291 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-08da3ce1-ce08-42e3-8ad9-4d755215a5b2 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] [instance: 243cbbbd-0734-4711-b605-c0657b81e359] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:59:59.672868 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-08da3ce1-ce08-42e3-8ad9-4d755215a5b2 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:59.673485 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-08da3ce1-ce08-42e3-8ad9-4d755215a5b2 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:59.674117 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-08da3ce1-ce08-42e3-8ad9-4d755215a5b2 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:59.675228 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-08da3ce1-ce08-42e3-8ad9-4d755215a5b2 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:59.679089 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-08da3ce1-ce08-42e3-8ad9-4d755215a5b2 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:59.680351 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-08da3ce1-ce08-42e3-8ad9-4d755215a5b2 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:59.703430 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a1b89a58-9b85-45df-acaa-231f298c11be tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 20:59:59.704135 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a1b89a58-9b85-45df-acaa-231f298c11be tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] [instance: 320f9a98-969f-473e-bc56-842bbd28dedc] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 20:59:59.718566 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a1b89a58-9b85-45df-acaa-231f298c11be tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:59.719072 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a1b89a58-9b85-45df-acaa-231f298c11be tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:59.719514 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a1b89a58-9b85-45df-acaa-231f298c11be tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 20:59:59.733386 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a1b89a58-9b85-45df-acaa-231f298c11be tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 20:59:59.740316 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a1b89a58-9b85-45df-acaa-231f298c11be tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 20:59:59.744596 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a1b89a58-9b85-45df-acaa-231f298c11be tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:00.361841 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-a1b89a58-9b85-45df-acaa-231f298c11be tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6513f5e908ac4d028cad6eeeebeab285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65946afc398d4a9fb1c9095a4f946e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:00:00.367030 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-08da3ce1-ce08-42e3-8ad9-4d755215a5b2 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5dbe3da6a4af181ef7302fe605fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3aa23aee3c8435c8f1f409019c5fed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:00:00.372488 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a1b89a58-9b85-45df-acaa-231f298c11be tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc" status: 200 len: 1527 microversion: 2.1 time: 0.673564 Oct 04 21:00:00.377515 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2470/4962] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:59:59 2022] GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc => generated 1527 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:00:00.378472 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-08da3ce1-ce08-42e3-8ad9-4d755215a5b2 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] 10.222.0.33 "GET /compute/v2.1/servers/243cbbbd-0734-4711-b605-c0657b81e359" status: 200 len: 1563 microversion: 2.1 time: 0.725110 Oct 04 21:00:00.379580 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2493/4963] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 20:59:59 2022] GET /compute/v2.1/servers/243cbbbd-0734-4711-b605-c0657b81e359 => generated 1563 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:00:00.421821 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5bca2cb5-f42d-42c7-addc-7035efcbf67e tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:00:00.422715 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-5bca2cb5-f42d-42c7-addc-7035efcbf67e tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] [instance: 243cbbbd-0734-4711-b605-c0657b81e359] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:00:00.441924 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5bca2cb5-f42d-42c7-addc-7035efcbf67e tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:00.442723 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5bca2cb5-f42d-42c7-addc-7035efcbf67e tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:00.443375 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5bca2cb5-f42d-42c7-addc-7035efcbf67e tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:00.444356 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5bca2cb5-f42d-42c7-addc-7035efcbf67e tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:00.444731 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5bca2cb5-f42d-42c7-addc-7035efcbf67e tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:00.445163 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5bca2cb5-f42d-42c7-addc-7035efcbf67e tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:00.788520 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-5bca2cb5-f42d-42c7-addc-7035efcbf67e tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5dbe3da6a4af181ef7302fe605fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3aa23aee3c8435c8f1f409019c5fed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:00:00.799315 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5bca2cb5-f42d-42c7-addc-7035efcbf67e tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] 10.222.0.33 "GET /compute/v2.1/servers/243cbbbd-0734-4711-b605-c0657b81e359" status: 200 len: 1563 microversion: 2.1 time: 0.381405 Oct 04 21:00:00.820401 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2471/4964] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:00:00 2022] GET /compute/v2.1/servers/243cbbbd-0734-4711-b605-c0657b81e359 => generated 1563 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:00:00.915818 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-08da3ce1-ce08-42e3-8ad9-4d755215a5b2 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:00:00.917892 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-08da3ce1-ce08-42e3-8ad9-4d755215a5b2 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] 10.222.0.33 "GET /compute//" status: 200 len: 377 microversion: - time: 0.002436 Oct 04 21:00:00.918642 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2494/4965] 10.222.0.33 () {56 vars in 886 bytes} [Tue Oct 4 21:00:00 2022] GET /compute/ => generated 377 bytes in 4 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 04 21:00:01.430895 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6b1f7dbf-8368-40eb-afe3-18877df1f33e tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:00:01.434432 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-6b1f7dbf-8368-40eb-afe3-18877df1f33e tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] [instance: 320f9a98-969f-473e-bc56-842bbd28dedc] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:00:01.455635 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6b1f7dbf-8368-40eb-afe3-18877df1f33e tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:01.456443 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6b1f7dbf-8368-40eb-afe3-18877df1f33e tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:01.457077 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6b1f7dbf-8368-40eb-afe3-18877df1f33e tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:01.458589 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6b1f7dbf-8368-40eb-afe3-18877df1f33e tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:01.459233 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6b1f7dbf-8368-40eb-afe3-18877df1f33e tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:01.459834 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6b1f7dbf-8368-40eb-afe3-18877df1f33e tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:02.114414 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-6b1f7dbf-8368-40eb-afe3-18877df1f33e tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6513f5e908ac4d028cad6eeeebeab285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65946afc398d4a9fb1c9095a4f946e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:00:02.145310 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-6b1f7dbf-8368-40eb-afe3-18877df1f33e tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc" status: 200 len: 1527 microversion: 2.1 time: 0.722111 Oct 04 21:00:02.145928 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2472/4966] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:00:01 2022] GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc => generated 1527 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:00:03.177523 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-1034000f-10b5-4448-9a69-6049cd634cc6 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:00:03.179004 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-1034000f-10b5-4448-9a69-6049cd634cc6 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] [instance: 320f9a98-969f-473e-bc56-842bbd28dedc] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:00:03.217673 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1034000f-10b5-4448-9a69-6049cd634cc6 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:03.225104 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1034000f-10b5-4448-9a69-6049cd634cc6 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:03.225853 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1034000f-10b5-4448-9a69-6049cd634cc6 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:03.228246 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1034000f-10b5-4448-9a69-6049cd634cc6 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:03.231809 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1034000f-10b5-4448-9a69-6049cd634cc6 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:03.235391 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1034000f-10b5-4448-9a69-6049cd634cc6 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:04.846707 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-1034000f-10b5-4448-9a69-6049cd634cc6 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6513f5e908ac4d028cad6eeeebeab285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65946afc398d4a9fb1c9095a4f946e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:00:04.863864 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-1034000f-10b5-4448-9a69-6049cd634cc6 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc" status: 200 len: 1527 microversion: 2.1 time: 1.692636 Oct 04 21:00:04.866164 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2495/4967] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:00:03 2022] GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc => generated 1527 bytes in 1696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:00:05.891395 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0e036e9b-d0b2-4eda-b9fa-ae45c1da1fef tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:00:05.892585 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-0e036e9b-d0b2-4eda-b9fa-ae45c1da1fef tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] [instance: 320f9a98-969f-473e-bc56-842bbd28dedc] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:00:05.915977 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0e036e9b-d0b2-4eda-b9fa-ae45c1da1fef tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:05.916730 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0e036e9b-d0b2-4eda-b9fa-ae45c1da1fef tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:05.917360 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0e036e9b-d0b2-4eda-b9fa-ae45c1da1fef tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:05.919036 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0e036e9b-d0b2-4eda-b9fa-ae45c1da1fef tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:05.921153 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0e036e9b-d0b2-4eda-b9fa-ae45c1da1fef tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:05.921751 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0e036e9b-d0b2-4eda-b9fa-ae45c1da1fef tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:06.817226 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-0e036e9b-d0b2-4eda-b9fa-ae45c1da1fef tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6513f5e908ac4d028cad6eeeebeab285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65946afc398d4a9fb1c9095a4f946e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:00:06.853240 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-0e036e9b-d0b2-4eda-b9fa-ae45c1da1fef tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc" status: 200 len: 1527 microversion: 2.1 time: 0.965659 Oct 04 21:00:06.872509 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2473/4968] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:00:05 2022] GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc => generated 1527 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:00:07.884772 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-9e709ffc-011e-4f30-9e7f-c722525e312f tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:00:07.886181 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-9e709ffc-011e-4f30-9e7f-c722525e312f tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] [instance: 320f9a98-969f-473e-bc56-842bbd28dedc] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:00:07.904949 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9e709ffc-011e-4f30-9e7f-c722525e312f tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:07.912994 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9e709ffc-011e-4f30-9e7f-c722525e312f tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:07.916129 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9e709ffc-011e-4f30-9e7f-c722525e312f tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:07.919525 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9e709ffc-011e-4f30-9e7f-c722525e312f tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:07.923220 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9e709ffc-011e-4f30-9e7f-c722525e312f tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:07.924635 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9e709ffc-011e-4f30-9e7f-c722525e312f tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:08.951842 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-bb608aba-87bb-48ea-a072-489d33f30406 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:00:08.952451 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-bb608aba-87bb-48ea-a072-489d33f30406 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] [instance: 243cbbbd-0734-4711-b605-c0657b81e359] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:00:08.972935 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bb608aba-87bb-48ea-a072-489d33f30406 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:08.973438 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bb608aba-87bb-48ea-a072-489d33f30406 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:08.973878 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bb608aba-87bb-48ea-a072-489d33f30406 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:08.974615 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bb608aba-87bb-48ea-a072-489d33f30406 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:08.988537 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bb608aba-87bb-48ea-a072-489d33f30406 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:08.993871 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bb608aba-87bb-48ea-a072-489d33f30406 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:09.802590 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-9e709ffc-011e-4f30-9e7f-c722525e312f tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6513f5e908ac4d028cad6eeeebeab285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65946afc398d4a9fb1c9095a4f946e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:00:09.811923 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-9e709ffc-011e-4f30-9e7f-c722525e312f tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc" status: 200 len: 1527 microversion: 2.1 time: 1.931092 Oct 04 21:00:09.843379 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-bb608aba-87bb-48ea-a072-489d33f30406 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5dbe3da6a4af181ef7302fe605fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3aa23aee3c8435c8f1f409019c5fed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:00:09.854617 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2496/4969] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:00:07 2022] GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc => generated 1527 bytes in 1974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:00:09.860923 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-bb608aba-87bb-48ea-a072-489d33f30406 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] 10.222.0.33 "GET /compute/v2.1/servers/243cbbbd-0734-4711-b605-c0657b81e359" status: 200 len: 1563 microversion: 2.1 time: 0.914016 Oct 04 21:00:09.861713 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2474/4970] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:00:08 2022] GET /compute/v2.1/servers/243cbbbd-0734-4711-b605-c0657b81e359 => generated 1563 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:00:09.871068 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-8ae86966-9cfb-4ded-8b8e-6ffd6f5b8412 req-bf97ac59-50d0-458c-81aa-f897a5140674 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "243cbbbd-0734-4711-b605-c0657b81e359", "tag": "65760264-f1de-43cd-baca-c370b4c65ec6"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:00:09.915779 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-8ae86966-9cfb-4ded-8b8e-6ffd6f5b8412 req-bf97ac59-50d0-458c-81aa-f897a5140674 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:09.920858 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-8ae86966-9cfb-4ded-8b8e-6ffd6f5b8412 req-bf97ac59-50d0-458c-81aa-f897a5140674 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:09.923249 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-8ae86966-9cfb-4ded-8b8e-6ffd6f5b8412 req-bf97ac59-50d0-458c-81aa-f897a5140674 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:09.976192 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-8ae86966-9cfb-4ded-8b8e-6ffd6f5b8412 req-bf97ac59-50d0-458c-81aa-f897a5140674 service nova] Creating event network-changed:65760264-f1de-43cd-baca-c370b4c65ec6 for instance 243cbbbd-0734-4711-b605-c0657b81e359 on n-h2-854823-8 Oct 04 21:00:10.002610 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-8ae86966-9cfb-4ded-8b8e-6ffd6f5b8412 req-bf97ac59-50d0-458c-81aa-f897a5140674 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.142213 Oct 04 21:00:10.005929 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2497/4971] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:00:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:00:10.842666 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f8e3c6f7-2952-4102-84f1-65c84ba43a6d tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:00:10.843288 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f8e3c6f7-2952-4102-84f1-65c84ba43a6d tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] [instance: 320f9a98-969f-473e-bc56-842bbd28dedc] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:00:10.858053 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f8e3c6f7-2952-4102-84f1-65c84ba43a6d tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:10.858583 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f8e3c6f7-2952-4102-84f1-65c84ba43a6d tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:10.861979 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f8e3c6f7-2952-4102-84f1-65c84ba43a6d tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:10.862776 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f8e3c6f7-2952-4102-84f1-65c84ba43a6d tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:10.863252 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f8e3c6f7-2952-4102-84f1-65c84ba43a6d tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:10.863685 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f8e3c6f7-2952-4102-84f1-65c84ba43a6d tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:11.779387 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f8e3c6f7-2952-4102-84f1-65c84ba43a6d tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6513f5e908ac4d028cad6eeeebeab285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65946afc398d4a9fb1c9095a4f946e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:00:11.794114 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f8e3c6f7-2952-4102-84f1-65c84ba43a6d tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc" status: 200 len: 1527 microversion: 2.1 time: 0.956152 Oct 04 21:00:11.794778 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2475/4972] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:00:10 2022] GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc => generated 1527 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:00:12.539890 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-aa97903d-5e4e-4372-b553-e7398d5411e0 tempest-VolumesTestJSON-1582166703 tempest-VolumesTestJSON-1582166703-project] Calling method '.version_select at 0x7f3c6f588b80>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:00:12.640217 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-aa97903d-5e4e-4372-b553-e7398d5411e0 tempest-VolumesTestJSON-1582166703 tempest-VolumesTestJSON-1582166703-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/27aadb4c-b3f1-46be-9138-f5ffd0d1b164" status: 200 len: 351 microversion: 2.1 time: 0.105041 Oct 04 21:00:12.648776 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2498/4973] 10.222.0.33 () {58 vars in 1245 bytes} [Tue Oct 4 21:00:12 2022] GET /compute/v2.1/os-volumes/27aadb4c-b3f1-46be-9138-f5ffd0d1b164 => generated 351 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:00:12.821145 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1bb2c629-9eaa-4d70-991a-2f2543166e3d tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:00:12.821776 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-1bb2c629-9eaa-4d70-991a-2f2543166e3d tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] [instance: 320f9a98-969f-473e-bc56-842bbd28dedc] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:00:12.831440 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=80 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:00:12.872664 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1bb2c629-9eaa-4d70-991a-2f2543166e3d tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:12.873180 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1bb2c629-9eaa-4d70-991a-2f2543166e3d tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:12.873620 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1bb2c629-9eaa-4d70-991a-2f2543166e3d tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:12.889359 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1bb2c629-9eaa-4d70-991a-2f2543166e3d tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:12.894269 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1bb2c629-9eaa-4d70-991a-2f2543166e3d tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:12.900550 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1bb2c629-9eaa-4d70-991a-2f2543166e3d tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:14.932300 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-1bb2c629-9eaa-4d70-991a-2f2543166e3d tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6513f5e908ac4d028cad6eeeebeab285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65946afc398d4a9fb1c9095a4f946e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:00:14.948559 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-1bb2c629-9eaa-4d70-991a-2f2543166e3d tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc" status: 200 len: 1527 microversion: 2.1 time: 2.131566 Oct 04 21:00:14.969925 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2476/4974] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:00:12 2022] GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc => generated 1527 bytes in 2154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:00:15.866224 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-f5aac72a-105b-4c3f-843b-e917692ad32b tempest-VolumesTestJSON-1582166703 tempest-VolumesTestJSON-1582166703-project] Calling method '.version_select at 0x7f3c6f5ac280>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:00:15.977168 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-62ff1986-c122-449b-8557-be226e4376dd tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:00:15.978492 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-62ff1986-c122-449b-8557-be226e4376dd tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] [instance: 320f9a98-969f-473e-bc56-842bbd28dedc] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:00:16.006782 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-62ff1986-c122-449b-8557-be226e4376dd tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:16.010462 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-f5aac72a-105b-4c3f-843b-e917692ad32b tempest-VolumesTestJSON-1582166703 tempest-VolumesTestJSON-1582166703-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/3d6e563f-2265-4570-bd22-2888d1e40ded" status: 200 len: 350 microversion: 2.1 time: 0.153077 Oct 04 21:00:16.019965 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2499/4975] 10.222.0.33 () {58 vars in 1245 bytes} [Tue Oct 4 21:00:15 2022] GET /compute/v2.1/os-volumes/3d6e563f-2265-4570-bd22-2888d1e40ded => generated 350 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:00:16.022217 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-62ff1986-c122-449b-8557-be226e4376dd tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:16.024713 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-62ff1986-c122-449b-8557-be226e4376dd tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:16.028098 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-62ff1986-c122-449b-8557-be226e4376dd tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:16.028586 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-62ff1986-c122-449b-8557-be226e4376dd tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:16.029031 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-62ff1986-c122-449b-8557-be226e4376dd tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:17.042482 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-62ff1986-c122-449b-8557-be226e4376dd tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6513f5e908ac4d028cad6eeeebeab285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65946afc398d4a9fb1c9095a4f946e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:00:17.051025 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-62ff1986-c122-449b-8557-be226e4376dd tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc" status: 200 len: 1527 microversion: 2.1 time: 1.077566 Oct 04 21:00:17.074216 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2477/4976] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:00:15 2022] GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc => generated 1527 bytes in 1101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:00:18.077521 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-6f0ab6d9-3c91-4583-8220-086189c60bfb tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:00:18.078884 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-6f0ab6d9-3c91-4583-8220-086189c60bfb tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] [instance: 320f9a98-969f-473e-bc56-842bbd28dedc] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:00:18.092932 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6f0ab6d9-3c91-4583-8220-086189c60bfb tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:18.110159 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6f0ab6d9-3c91-4583-8220-086189c60bfb tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:18.111880 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6f0ab6d9-3c91-4583-8220-086189c60bfb tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:18.131220 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6f0ab6d9-3c91-4583-8220-086189c60bfb tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:18.131828 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6f0ab6d9-3c91-4583-8220-086189c60bfb tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:18.132650 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6f0ab6d9-3c91-4583-8220-086189c60bfb tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:19.062103 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-6f0ab6d9-3c91-4583-8220-086189c60bfb tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6513f5e908ac4d028cad6eeeebeab285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65946afc398d4a9fb1c9095a4f946e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:00:19.071387 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:00:19.081931 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-6f0ab6d9-3c91-4583-8220-086189c60bfb tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc" status: 200 len: 1527 microversion: 2.1 time: 1.002047 Oct 04 21:00:19.104036 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2500/4977] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:00:18 2022] GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc => generated 1527 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:00:20.112432 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-268cbdd9-b2a0-4343-8fce-363c9ebd9d3b tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:00:20.113099 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-268cbdd9-b2a0-4343-8fce-363c9ebd9d3b tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] [instance: 320f9a98-969f-473e-bc56-842bbd28dedc] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:00:20.135075 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:00:20.136582 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-268cbdd9-b2a0-4343-8fce-363c9ebd9d3b tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:20.145573 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-268cbdd9-b2a0-4343-8fce-363c9ebd9d3b tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:20.151030 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-268cbdd9-b2a0-4343-8fce-363c9ebd9d3b tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:20.152026 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-268cbdd9-b2a0-4343-8fce-363c9ebd9d3b tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:20.155996 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-268cbdd9-b2a0-4343-8fce-363c9ebd9d3b tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:20.159803 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-268cbdd9-b2a0-4343-8fce-363c9ebd9d3b tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:20.571650 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ff4a53f3-3345-4d19-8e09-c9f34638c88a tempest-ServersNegativeTestMultiTenantJSON-1428014836 tempest-ServersNegativeTestMultiTenantJSON-1428014836-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestMultiTenantJSON-server-956773233", "imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63", "flavorRef": "452", "networks": [{"uuid": "35be0a35-61ce-4a02-a0cf-a2a7c8dcbaf2"}]}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:00:20.830978 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.network.neutron [None req-ff4a53f3-3345-4d19-8e09-c9f34638c88a tempest-ServersNegativeTestMultiTenantJSON-1428014836 tempest-ServersNegativeTestMultiTenantJSON-1428014836-project] validate_networks() for [('35be0a35-61ce-4a02-a0cf-a2a7c8dcbaf2', None, None, None, None, None)] {{(pid=128801) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:00:21.549999 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-268cbdd9-b2a0-4343-8fce-363c9ebd9d3b tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6513f5e908ac4d028cad6eeeebeab285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65946afc398d4a9fb1c9095a4f946e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:00:21.566434 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-268cbdd9-b2a0-4343-8fce-363c9ebd9d3b tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc" status: 200 len: 1527 microversion: 2.1 time: 1.457607 Oct 04 21:00:21.573020 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2501/4978] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:00:20 2022] GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc => generated 1527 bytes in 1465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:00:21.593272 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-65f77f24-07de-4f72-b6df-43baa237541f tempest-VolumesTestJSON-1582166703 tempest-VolumesTestJSON-1582166703-project] Calling method '.version_select at 0x7f3c6f584dc0>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:00:21.724767 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-65f77f24-07de-4f72-b6df-43baa237541f tempest-VolumesTestJSON-1582166703 tempest-VolumesTestJSON-1582166703-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/f00f18d3-7ed5-4436-8463-47934f9f2415" status: 200 len: 350 microversion: 2.1 time: 0.150317 Oct 04 21:00:21.725660 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2502/4979] 10.222.0.33 () {58 vars in 1245 bytes} [Tue Oct 4 21:00:21 2022] GET /compute/v2.1/os-volumes/f00f18d3-7ed5-4436-8463-47934f9f2415 => generated 350 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:00:22.188461 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-36058241-a6ea-4534-ace5-bec6590bf3e2 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV254Test-server-835124504", "imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63", "flavorRef": "452", "networks": "none"}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:00:22.320632 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-36058241-a6ea-4534-ace5-bec6590bf3e2 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Flavor limits 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:00:22.322637 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-36058241-a6ea-4534-ace5-bec6590bf3e2 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Image limits 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:00:22.324965 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-36058241-a6ea-4534-ace5-bec6590bf3e2 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Flavor pref 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:00:22.325392 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-36058241-a6ea-4534-ace5-bec6590bf3e2 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Image pref 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:00:22.325820 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-36058241-a6ea-4534-ace5-bec6590bf3e2 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:00:22.371834 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-36058241-a6ea-4534-ace5-bec6590bf3e2 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:22.381659 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-36058241-a6ea-4534-ace5-bec6590bf3e2 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:22.384487 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-36058241-a6ea-4534-ace5-bec6590bf3e2 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:22.393185 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-36058241-a6ea-4534-ace5-bec6590bf3e2 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:22.393879 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-36058241-a6ea-4534-ace5-bec6590bf3e2 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:22.394329 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-36058241-a6ea-4534-ace5-bec6590bf3e2 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:22.504174 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-36058241-a6ea-4534-ace5-bec6590bf3e2 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Getting quotas for project fec4233f765546f997810e0e843ae184. Resources: {'ram', 'instances', 'cores'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:00:22.521361 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-36058241-a6ea-4534-ace5-bec6590bf3e2 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Getting quotas for user 0ea297d567a044fc9132f5d7d076f469 and project fec4233f765546f997810e0e843ae184. Resources: {'ram', 'instances', 'cores'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:00:22.559273 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-36058241-a6ea-4534-ace5-bec6590bf3e2 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Going to run 1 instances... {{(pid=128802) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:00:22.566450 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-36058241-a6ea-4534-ace5-bec6590bf3e2 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] [instance: b43cf252-2634-4a7d-9b8b-808e03acf885] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='15b24725-0c99-4bcf-b1fb-907cdf8e2d63',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128802) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:00:22.674658 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-36058241-a6ea-4534-ace5-bec6590bf3e2 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.54 time: 0.945507 Oct 04 21:00:22.675920 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2503/4980] 10.222.0.33 () {62 vars in 1188 bytes} [Tue Oct 4 21:00:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 950 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 04 21:00:22.686864 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-732fc39b-2595-4dee-9c44-91be3102e895 tempest-VolumesTestJSON-1582166703 tempest-VolumesTestJSON-1582166703-project] Calling method '.version_select at 0x7f3c6f6aa5e0>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:00:22.891490 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-732fc39b-2595-4dee-9c44-91be3102e895 tempest-VolumesTestJSON-1582166703 tempest-VolumesTestJSON-1582166703-project] 10.222.0.33 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.214252 Oct 04 21:00:22.893202 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2504/4981] 10.222.0.33 () {58 vars in 1134 bytes} [Tue Oct 4 21:00:22 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:00:22.898779 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-afed4b9f-8ed3-46dc-bebb-81feafb063c8 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:00:22.899608 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-afed4b9f-8ed3-46dc-bebb-81feafb063c8 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] [instance: 320f9a98-969f-473e-bc56-842bbd28dedc] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:00:22.921381 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-afed4b9f-8ed3-46dc-bebb-81feafb063c8 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:22.922082 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-afed4b9f-8ed3-46dc-bebb-81feafb063c8 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:22.922728 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-afed4b9f-8ed3-46dc-bebb-81feafb063c8 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:22.924234 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-afed4b9f-8ed3-46dc-bebb-81feafb063c8 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:22.924861 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-afed4b9f-8ed3-46dc-bebb-81feafb063c8 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:22.931899 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-afed4b9f-8ed3-46dc-bebb-81feafb063c8 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:23.431111 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-afed4b9f-8ed3-46dc-bebb-81feafb063c8 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6513f5e908ac4d028cad6eeeebeab285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65946afc398d4a9fb1c9095a4f946e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:00:23.464446 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-afed4b9f-8ed3-46dc-bebb-81feafb063c8 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc" status: 200 len: 1527 microversion: 2.1 time: 0.561046 Oct 04 21:00:23.465191 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2505/4982] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:00:22 2022] GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc => generated 1527 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:00:23.496768 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-d51122e4-f210-4d48-9aac-3f136b3a9250 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:00:23.497399 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-d51122e4-f210-4d48-9aac-3f136b3a9250 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] [instance: b43cf252-2634-4a7d-9b8b-808e03acf885] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:00:23.674056 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-d51122e4-f210-4d48-9aac-3f136b3a9250 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea297d567a044fc9132f5d7d076f469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec4233f765546f997810e0e843ae184', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:00:23.694157 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-d51122e4-f210-4d48-9aac-3f136b3a9250 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0ea297d567a044fc9132f5d7d076f469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec4233f765546f997810e0e843ae184', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:00:23.695695 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-d51122e4-f210-4d48-9aac-3f136b3a9250 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0ea297d567a044fc9132f5d7d076f469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec4233f765546f997810e0e843ae184', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:00:23.696786 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-d51122e4-f210-4d48-9aac-3f136b3a9250 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] 10.222.0.33 "GET /compute/v2.1/servers/b43cf252-2634-4a7d-9b8b-808e03acf885" status: 200 len: 1277 microversion: 2.54 time: 0.228539 Oct 04 21:00:23.697855 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2506/4983] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 21:00:23 2022] GET /compute/v2.1/servers/b43cf252-2634-4a7d-9b8b-808e03acf885 => generated 1277 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:00:23.703134 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-7ee3e2a0-2b77-41b4-9d00-b27d2550c7ff tempest-VolumesTestJSON-1582166703 tempest-VolumesTestJSON-1582166703-project] Calling method '.version_select at 0x7f3c6f5ac040>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:00:23.898215 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-7ee3e2a0-2b77-41b4-9d00-b27d2550c7ff tempest-VolumesTestJSON-1582166703 tempest-VolumesTestJSON-1582166703-project] 10.222.0.33 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.198683 Oct 04 21:00:23.899677 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2507/4984] 10.222.0.33 () {58 vars in 1149 bytes} [Tue Oct 4 21:00:23 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:00:23.914907 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-43ae630d-51fd-47b4-9ffb-9da5dd0ef5be tempest-VolumesTestJSON-1582166703 tempest-VolumesTestJSON-1582166703-project] Calling method '.version_select at 0x7f3c6f5ac670>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:00:24.184935 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-43ae630d-51fd-47b4-9ffb-9da5dd0ef5be tempest-VolumesTestJSON-1582166703 tempest-VolumesTestJSON-1582166703-project] 10.222.0.33 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.274242 Oct 04 21:00:24.196357 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2508/4985] 10.222.0.33 () {58 vars in 1134 bytes} [Tue Oct 4 21:00:23 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:00:24.204922 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-4bc92078-a7e4-4724-b4a4-f1e8f1cc5bc7 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:00:24.208819 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-4bc92078-a7e4-4724-b4a4-f1e8f1cc5bc7 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] [instance: 243cbbbd-0734-4711-b605-c0657b81e359] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:00:24.222175 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4bc92078-a7e4-4724-b4a4-f1e8f1cc5bc7 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:24.222933 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4bc92078-a7e4-4724-b4a4-f1e8f1cc5bc7 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:24.223553 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4bc92078-a7e4-4724-b4a4-f1e8f1cc5bc7 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:24.224421 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4bc92078-a7e4-4724-b4a4-f1e8f1cc5bc7 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:24.225986 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4bc92078-a7e4-4724-b4a4-f1e8f1cc5bc7 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:24.226611 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4bc92078-a7e4-4724-b4a4-f1e8f1cc5bc7 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:24.321969 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-4bc92078-a7e4-4724-b4a4-f1e8f1cc5bc7 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] 10.222.0.33 "POST /compute/v2.1/servers/243cbbbd-0734-4711-b605-c0657b81e359/action" status: 200 len: 24565 microversion: 2.1 time: 0.123433 Oct 04 21:00:24.323018 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2509/4986] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 21:00:24 2022] POST /compute/v2.1/servers/243cbbbd-0734-4711-b605-c0657b81e359/action => generated 24565 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 21:00:24.334042 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-e7ce0e2d-be61-4863-ad68-7193de25661b tempest-VolumesTestJSON-1582166703 tempest-VolumesTestJSON-1582166703-project] Calling method '.version_select at 0x7f3c6f554a60>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:00:24.605903 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-e7ce0e2d-be61-4863-ad68-7193de25661b tempest-VolumesTestJSON-1582166703 tempest-VolumesTestJSON-1582166703-project] 10.222.0.33 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.281516 Oct 04 21:00:24.606331 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2510/4987] 10.222.0.33 () {58 vars in 1167 bytes} [Tue Oct 4 21:00:24 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:00:24.620517 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-bd85ab0b-a598-4cd3-a7a4-1172d81c9377 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:00:24.621253 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-bd85ab0b-a598-4cd3-a7a4-1172d81c9377 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] [instance: 320f9a98-969f-473e-bc56-842bbd28dedc] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:00:24.634403 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bd85ab0b-a598-4cd3-a7a4-1172d81c9377 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:24.637034 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bd85ab0b-a598-4cd3-a7a4-1172d81c9377 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:24.640248 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bd85ab0b-a598-4cd3-a7a4-1172d81c9377 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:24.641015 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bd85ab0b-a598-4cd3-a7a4-1172d81c9377 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:24.641494 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bd85ab0b-a598-4cd3-a7a4-1172d81c9377 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:24.649898 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bd85ab0b-a598-4cd3-a7a4-1172d81c9377 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:25.346263 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-ff4a53f3-3345-4d19-8e09-c9f34638c88a tempest-ServersNegativeTestMultiTenantJSON-1428014836 tempest-ServersNegativeTestMultiTenantJSON-1428014836-project] Flavor limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:00:25.346845 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-ff4a53f3-3345-4d19-8e09-c9f34638c88a tempest-ServersNegativeTestMultiTenantJSON-1428014836 tempest-ServersNegativeTestMultiTenantJSON-1428014836-project] Image limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:00:25.347373 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-ff4a53f3-3345-4d19-8e09-c9f34638c88a tempest-ServersNegativeTestMultiTenantJSON-1428014836 tempest-ServersNegativeTestMultiTenantJSON-1428014836-project] Flavor pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:00:25.347875 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-ff4a53f3-3345-4d19-8e09-c9f34638c88a tempest-ServersNegativeTestMultiTenantJSON-1428014836 tempest-ServersNegativeTestMultiTenantJSON-1428014836-project] Image pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:00:25.348367 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-ff4a53f3-3345-4d19-8e09-c9f34638c88a tempest-ServersNegativeTestMultiTenantJSON-1428014836 tempest-ServersNegativeTestMultiTenantJSON-1428014836-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:00:25.391005 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ff4a53f3-3345-4d19-8e09-c9f34638c88a tempest-ServersNegativeTestMultiTenantJSON-1428014836 tempest-ServersNegativeTestMultiTenantJSON-1428014836-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:25.391586 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ff4a53f3-3345-4d19-8e09-c9f34638c88a tempest-ServersNegativeTestMultiTenantJSON-1428014836 tempest-ServersNegativeTestMultiTenantJSON-1428014836-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:25.393394 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ff4a53f3-3345-4d19-8e09-c9f34638c88a tempest-ServersNegativeTestMultiTenantJSON-1428014836 tempest-ServersNegativeTestMultiTenantJSON-1428014836-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:25.397011 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ff4a53f3-3345-4d19-8e09-c9f34638c88a tempest-ServersNegativeTestMultiTenantJSON-1428014836 tempest-ServersNegativeTestMultiTenantJSON-1428014836-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:25.397516 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ff4a53f3-3345-4d19-8e09-c9f34638c88a tempest-ServersNegativeTestMultiTenantJSON-1428014836 tempest-ServersNegativeTestMultiTenantJSON-1428014836-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:25.400558 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ff4a53f3-3345-4d19-8e09-c9f34638c88a tempest-ServersNegativeTestMultiTenantJSON-1428014836 tempest-ServersNegativeTestMultiTenantJSON-1428014836-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:25.401400 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-bd85ab0b-a598-4cd3-a7a4-1172d81c9377 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6513f5e908ac4d028cad6eeeebeab285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65946afc398d4a9fb1c9095a4f946e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:00:25.414662 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-bd85ab0b-a598-4cd3-a7a4-1172d81c9377 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc" status: 200 len: 1509 microversion: 2.1 time: 0.805594 Oct 04 21:00:25.416887 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2511/4988] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:00:24 2022] GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc => generated 1509 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:00:25.438584 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-5fcc0595-b2be-45b5-a769-76ac1b2f775b tempest-VolumesTestJSON-1582166703 tempest-VolumesTestJSON-1582166703-project] Calling method '.version_select at 0x7f3c6f575700>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:00:25.457286 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-ff4a53f3-3345-4d19-8e09-c9f34638c88a tempest-ServersNegativeTestMultiTenantJSON-1428014836 tempest-ServersNegativeTestMultiTenantJSON-1428014836-project] Getting quotas for project dcf2a507fa3842e59a81c0967e25ae54. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:00:25.501060 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-ff4a53f3-3345-4d19-8e09-c9f34638c88a tempest-ServersNegativeTestMultiTenantJSON-1428014836 tempest-ServersNegativeTestMultiTenantJSON-1428014836-project] Getting quotas for user 1dfed24a3a0144b0ac357f7e200b2155 and project dcf2a507fa3842e59a81c0967e25ae54. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:00:25.542935 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ff4a53f3-3345-4d19-8e09-c9f34638c88a tempest-ServersNegativeTestMultiTenantJSON-1428014836 tempest-ServersNegativeTestMultiTenantJSON-1428014836-project] Going to run 1 instances... {{(pid=128801) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:00:25.545556 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ff4a53f3-3345-4d19-8e09-c9f34638c88a tempest-ServersNegativeTestMultiTenantJSON-1428014836 tempest-ServersNegativeTestMultiTenantJSON-1428014836-project] [instance: 0e2212f3-ad4e-4cb0-8dca-ca49144a1e94] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='15b24725-0c99-4bcf-b1fb-907cdf8e2d63',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128801) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:00:25.660833 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ff4a53f3-3345-4d19-8e09-c9f34638c88a tempest-ServersNegativeTestMultiTenantJSON-1428014836 tempest-ServersNegativeTestMultiTenantJSON-1428014836-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 6.027195 Oct 04 21:00:25.678187 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-5fcc0595-b2be-45b5-a769-76ac1b2f775b tempest-VolumesTestJSON-1582166703 tempest-VolumesTestJSON-1582166703-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.258779 Oct 04 21:00:25.679280 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2512/4989] 10.222.0.33 () {58 vars in 1170 bytes} [Tue Oct 4 21:00:25 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:00:25.684052 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-69e534d7-bfae-4c62-ac74-f2e0a085f92f tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:00:25.684864 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-69e534d7-bfae-4c62-ac74-f2e0a085f92f tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] [instance: b43cf252-2634-4a7d-9b8b-808e03acf885] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:00:25.693056 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2478/4990] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 21:00:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 6060 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:00:25.712810 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-69e534d7-bfae-4c62-ac74-f2e0a085f92f tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:25.719300 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-67947cbc-ee63-419d-a53f-b169d4afe529 tempest-ServersNegativeTestMultiTenantJSON-1428014836 tempest-ServersNegativeTestMultiTenantJSON-1428014836-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:00:25.720136 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-67947cbc-ee63-419d-a53f-b169d4afe529 tempest-ServersNegativeTestMultiTenantJSON-1428014836 tempest-ServersNegativeTestMultiTenantJSON-1428014836-project] [instance: 0e2212f3-ad4e-4cb0-8dca-ca49144a1e94] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:00:25.721541 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-69e534d7-bfae-4c62-ac74-f2e0a085f92f tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:25.723980 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-69e534d7-bfae-4c62-ac74-f2e0a085f92f tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:25.724853 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-69e534d7-bfae-4c62-ac74-f2e0a085f92f tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:25.725989 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-69e534d7-bfae-4c62-ac74-f2e0a085f92f tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:25.732896 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-69e534d7-bfae-4c62-ac74-f2e0a085f92f tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:26.138508 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-67947cbc-ee63-419d-a53f-b169d4afe529 tempest-ServersNegativeTestMultiTenantJSON-1428014836 tempest-ServersNegativeTestMultiTenantJSON-1428014836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dfed24a3a0144b0ac357f7e200b2155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf2a507fa3842e59a81c0967e25ae54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:00:26.141403 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-69e534d7-bfae-4c62-ac74-f2e0a085f92f tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea297d567a044fc9132f5d7d076f469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec4233f765546f997810e0e843ae184', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:00:26.152376 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-67947cbc-ee63-419d-a53f-b169d4afe529 tempest-ServersNegativeTestMultiTenantJSON-1428014836 tempest-ServersNegativeTestMultiTenantJSON-1428014836-project] 10.222.0.33 "GET /compute/v2.1/servers/0e2212f3-ad4e-4cb0-8dca-ca49144a1e94" status: 200 len: 1227 microversion: 2.1 time: 0.455975 Oct 04 21:00:26.169593 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2479/4991] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:00:25 2022] GET /compute/v2.1/servers/0e2212f3-ad4e-4cb0-8dca-ca49144a1e94 => generated 1227 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:00:26.169686 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-69e534d7-bfae-4c62-ac74-f2e0a085f92f tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0ea297d567a044fc9132f5d7d076f469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec4233f765546f997810e0e843ae184', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:00:26.169686 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-69e534d7-bfae-4c62-ac74-f2e0a085f92f tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0ea297d567a044fc9132f5d7d076f469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec4233f765546f997810e0e843ae184', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:00:26.170022 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-69e534d7-bfae-4c62-ac74-f2e0a085f92f tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] 10.222.0.33 "GET /compute/v2.1/servers/b43cf252-2634-4a7d-9b8b-808e03acf885" status: 200 len: 1329 microversion: 2.54 time: 0.489708 Oct 04 21:00:26.180190 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2513/4992] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 21:00:25 2022] GET /compute/v2.1/servers/b43cf252-2634-4a7d-9b8b-808e03acf885 => generated 1329 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:00:26.206301 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-20a667f8-fa9e-43d3-9ac0-7a20fbc56ec1 tempest-VolumesTestJSON-1582166703 tempest-VolumesTestJSON-1582166703-project] Calling method '.version_select at 0x7f3c6f2fca60>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:00:26.442909 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-b0c81872-f975-465f-8a41-932b40d9606a tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:00:26.444860 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-b0c81872-f975-465f-8a41-932b40d9606a tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] [instance: 320f9a98-969f-473e-bc56-842bbd28dedc] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:00:26.459073 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b0c81872-f975-465f-8a41-932b40d9606a tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:26.459851 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b0c81872-f975-465f-8a41-932b40d9606a tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:26.461153 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b0c81872-f975-465f-8a41-932b40d9606a tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:26.462742 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b0c81872-f975-465f-8a41-932b40d9606a tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:26.464355 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b0c81872-f975-465f-8a41-932b40d9606a tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:26.467611 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b0c81872-f975-465f-8a41-932b40d9606a tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:26.539293 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-20a667f8-fa9e-43d3-9ac0-7a20fbc56ec1 tempest-VolumesTestJSON-1582166703 tempest-VolumesTestJSON-1582166703-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.377462 Oct 04 21:00:26.540729 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2480/4993] 10.222.0.33 () {58 vars in 1155 bytes} [Tue Oct 4 21:00:26 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:00:26.556665 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-407602d7-19ac-4905-a1d6-82fb026b8549 tempest-VolumesTestJSON-1582166703 tempest-VolumesTestJSON-1582166703-project] Calling method '.version_select at 0x7f3c6f2a5e50>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:00:26.732674 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-407602d7-19ac-4905-a1d6-82fb026b8549 tempest-VolumesTestJSON-1582166703 tempest-VolumesTestJSON-1582166703-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.180080 Oct 04 21:00:26.733583 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2481/4994] 10.222.0.33 () {58 vars in 1188 bytes} [Tue Oct 4 21:00:26 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:00:26.749153 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6d8e26f5-e6b0-451a-b08b-efdda33b006c tempest-VolumesTestJSON-1582166703 tempest-VolumesTestJSON-1582166703-project] Calling method '.version_select at 0x7f3c78839160>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:00:26.913310 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-6d8e26f5-e6b0-451a-b08b-efdda33b006c tempest-VolumesTestJSON-1582166703 tempest-VolumesTestJSON-1582166703-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.168281 Oct 04 21:00:26.916374 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2482/4995] 10.222.0.33 () {58 vars in 1155 bytes} [Tue Oct 4 21:00:26 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:00:26.929258 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-b0c81872-f975-465f-8a41-932b40d9606a tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6513f5e908ac4d028cad6eeeebeab285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65946afc398d4a9fb1c9095a4f946e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:00:26.938445 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-b0c81872-f975-465f-8a41-932b40d9606a tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc" status: 200 len: 1509 microversion: 2.1 time: 0.500532 Oct 04 21:00:26.944808 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2514/4996] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:00:26 2022] GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc => generated 1509 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:00:27.177433 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0bbbed7d-1111-44c2-93a7-35298ed612bd tempest-ServersNegativeTestMultiTenantJSON-1428014836 tempest-ServersNegativeTestMultiTenantJSON-1428014836-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:00:27.178355 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-0bbbed7d-1111-44c2-93a7-35298ed612bd tempest-ServersNegativeTestMultiTenantJSON-1428014836 tempest-ServersNegativeTestMultiTenantJSON-1428014836-project] [instance: 0e2212f3-ad4e-4cb0-8dca-ca49144a1e94] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:00:27.189736 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0bbbed7d-1111-44c2-93a7-35298ed612bd tempest-ServersNegativeTestMultiTenantJSON-1428014836 tempest-ServersNegativeTestMultiTenantJSON-1428014836-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:27.190470 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0bbbed7d-1111-44c2-93a7-35298ed612bd tempest-ServersNegativeTestMultiTenantJSON-1428014836 tempest-ServersNegativeTestMultiTenantJSON-1428014836-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:27.191961 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0bbbed7d-1111-44c2-93a7-35298ed612bd tempest-ServersNegativeTestMultiTenantJSON-1428014836 tempest-ServersNegativeTestMultiTenantJSON-1428014836-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:27.215463 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-6bdb7fe1-1708-4413-8faf-7cfe1017f2f6 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:00:27.217582 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-6bdb7fe1-1708-4413-8faf-7cfe1017f2f6 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] [instance: b43cf252-2634-4a7d-9b8b-808e03acf885] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:00:27.219098 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0bbbed7d-1111-44c2-93a7-35298ed612bd tempest-ServersNegativeTestMultiTenantJSON-1428014836 tempest-ServersNegativeTestMultiTenantJSON-1428014836-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:27.224790 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0bbbed7d-1111-44c2-93a7-35298ed612bd tempest-ServersNegativeTestMultiTenantJSON-1428014836 tempest-ServersNegativeTestMultiTenantJSON-1428014836-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:27.225462 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0bbbed7d-1111-44c2-93a7-35298ed612bd tempest-ServersNegativeTestMultiTenantJSON-1428014836 tempest-ServersNegativeTestMultiTenantJSON-1428014836-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:27.243264 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6bdb7fe1-1708-4413-8faf-7cfe1017f2f6 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:27.244911 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6bdb7fe1-1708-4413-8faf-7cfe1017f2f6 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:27.245829 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6bdb7fe1-1708-4413-8faf-7cfe1017f2f6 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:27.247612 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6bdb7fe1-1708-4413-8faf-7cfe1017f2f6 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:27.248486 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6bdb7fe1-1708-4413-8faf-7cfe1017f2f6 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:27.256193 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6bdb7fe1-1708-4413-8faf-7cfe1017f2f6 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:27.370772 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-0bbbed7d-1111-44c2-93a7-35298ed612bd tempest-ServersNegativeTestMultiTenantJSON-1428014836 tempest-ServersNegativeTestMultiTenantJSON-1428014836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dfed24a3a0144b0ac357f7e200b2155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf2a507fa3842e59a81c0967e25ae54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:00:27.382021 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-0bbbed7d-1111-44c2-93a7-35298ed612bd tempest-ServersNegativeTestMultiTenantJSON-1428014836 tempest-ServersNegativeTestMultiTenantJSON-1428014836-project] 10.222.0.33 "GET /compute/v2.1/servers/0e2212f3-ad4e-4cb0-8dca-ca49144a1e94" status: 200 len: 1279 microversion: 2.1 time: 0.210082 Oct 04 21:00:27.408454 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2483/4997] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:00:27 2022] GET /compute/v2.1/servers/0e2212f3-ad4e-4cb0-8dca-ca49144a1e94 => generated 1279 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:00:27.422559 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-6bdb7fe1-1708-4413-8faf-7cfe1017f2f6 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea297d567a044fc9132f5d7d076f469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec4233f765546f997810e0e843ae184', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:00:27.433309 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-6bdb7fe1-1708-4413-8faf-7cfe1017f2f6 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0ea297d567a044fc9132f5d7d076f469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec4233f765546f997810e0e843ae184', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:00:27.435090 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-6bdb7fe1-1708-4413-8faf-7cfe1017f2f6 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0ea297d567a044fc9132f5d7d076f469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec4233f765546f997810e0e843ae184', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:00:27.436459 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-6bdb7fe1-1708-4413-8faf-7cfe1017f2f6 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] 10.222.0.33 "GET /compute/v2.1/servers/b43cf252-2634-4a7d-9b8b-808e03acf885" status: 200 len: 1335 microversion: 2.54 time: 0.239360 Oct 04 21:00:27.437513 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2515/4998] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 21:00:27 2022] GET /compute/v2.1/servers/b43cf252-2634-4a7d-9b8b-808e03acf885 => generated 1335 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:00:27.970042 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9ee2574b-6fc9-48c0-aa30-416fb8356b28 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:00:27.975898 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-9ee2574b-6fc9-48c0-aa30-416fb8356b28 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] [instance: 320f9a98-969f-473e-bc56-842bbd28dedc] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:00:27.991196 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9ee2574b-6fc9-48c0-aa30-416fb8356b28 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:28.006754 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9ee2574b-6fc9-48c0-aa30-416fb8356b28 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:28.008067 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9ee2574b-6fc9-48c0-aa30-416fb8356b28 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:28.008843 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9ee2574b-6fc9-48c0-aa30-416fb8356b28 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:28.015810 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9ee2574b-6fc9-48c0-aa30-416fb8356b28 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:28.015810 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9ee2574b-6fc9-48c0-aa30-416fb8356b28 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:28.086875 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=68 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:00:28.413465 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-9ee2574b-6fc9-48c0-aa30-416fb8356b28 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6513f5e908ac4d028cad6eeeebeab285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65946afc398d4a9fb1c9095a4f946e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:00:28.418912 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-3b7fb585-77e5-4648-b69e-0ee1faf1aede tempest-ServersNegativeTestMultiTenantJSON-1428014836 tempest-ServersNegativeTestMultiTenantJSON-1428014836-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:00:28.424413 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-3b7fb585-77e5-4648-b69e-0ee1faf1aede tempest-ServersNegativeTestMultiTenantJSON-1428014836 tempest-ServersNegativeTestMultiTenantJSON-1428014836-project] [instance: 0e2212f3-ad4e-4cb0-8dca-ca49144a1e94] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:00:28.443320 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-9ee2574b-6fc9-48c0-aa30-416fb8356b28 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc" status: 200 len: 1509 microversion: 2.1 time: 0.477926 Oct 04 21:00:28.443958 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2484/4999] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:00:27 2022] GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc => generated 1509 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:00:28.450898 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3b7fb585-77e5-4648-b69e-0ee1faf1aede tempest-ServersNegativeTestMultiTenantJSON-1428014836 tempest-ServersNegativeTestMultiTenantJSON-1428014836-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:28.451401 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3b7fb585-77e5-4648-b69e-0ee1faf1aede tempest-ServersNegativeTestMultiTenantJSON-1428014836 tempest-ServersNegativeTestMultiTenantJSON-1428014836-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:28.451842 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3b7fb585-77e5-4648-b69e-0ee1faf1aede tempest-ServersNegativeTestMultiTenantJSON-1428014836 tempest-ServersNegativeTestMultiTenantJSON-1428014836-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:28.454816 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3b7fb585-77e5-4648-b69e-0ee1faf1aede tempest-ServersNegativeTestMultiTenantJSON-1428014836 tempest-ServersNegativeTestMultiTenantJSON-1428014836-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:28.459266 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3b7fb585-77e5-4648-b69e-0ee1faf1aede tempest-ServersNegativeTestMultiTenantJSON-1428014836 tempest-ServersNegativeTestMultiTenantJSON-1428014836-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:28.464925 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-fff30d3e-1647-4df1-b94c-ffaff2a1601e tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:00:28.465688 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-fff30d3e-1647-4df1-b94c-ffaff2a1601e tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] [instance: b43cf252-2634-4a7d-9b8b-808e03acf885] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:00:28.466994 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3b7fb585-77e5-4648-b69e-0ee1faf1aede tempest-ServersNegativeTestMultiTenantJSON-1428014836 tempest-ServersNegativeTestMultiTenantJSON-1428014836-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:28.492170 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fff30d3e-1647-4df1-b94c-ffaff2a1601e tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:28.492829 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fff30d3e-1647-4df1-b94c-ffaff2a1601e tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:28.493947 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fff30d3e-1647-4df1-b94c-ffaff2a1601e tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:28.498887 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fff30d3e-1647-4df1-b94c-ffaff2a1601e tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:28.499461 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fff30d3e-1647-4df1-b94c-ffaff2a1601e tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:28.504938 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fff30d3e-1647-4df1-b94c-ffaff2a1601e tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:28.741094 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-3b7fb585-77e5-4648-b69e-0ee1faf1aede tempest-ServersNegativeTestMultiTenantJSON-1428014836 tempest-ServersNegativeTestMultiTenantJSON-1428014836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dfed24a3a0144b0ac357f7e200b2155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf2a507fa3842e59a81c0967e25ae54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:00:28.749862 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-3b7fb585-77e5-4648-b69e-0ee1faf1aede tempest-ServersNegativeTestMultiTenantJSON-1428014836 tempest-ServersNegativeTestMultiTenantJSON-1428014836-project] 10.222.0.33 "GET /compute/v2.1/servers/0e2212f3-ad4e-4cb0-8dca-ca49144a1e94" status: 200 len: 1285 microversion: 2.1 time: 0.346766 Oct 04 21:00:28.755217 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2516/5000] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:00:28 2022] GET /compute/v2.1/servers/0e2212f3-ad4e-4cb0-8dca-ca49144a1e94 => generated 1285 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:00:28.783879 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-fff30d3e-1647-4df1-b94c-ffaff2a1601e tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea297d567a044fc9132f5d7d076f469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec4233f765546f997810e0e843ae184', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:00:28.809606 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-fff30d3e-1647-4df1-b94c-ffaff2a1601e tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0ea297d567a044fc9132f5d7d076f469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec4233f765546f997810e0e843ae184', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:00:28.811951 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-fff30d3e-1647-4df1-b94c-ffaff2a1601e tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0ea297d567a044fc9132f5d7d076f469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec4233f765546f997810e0e843ae184', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:00:28.815935 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-fff30d3e-1647-4df1-b94c-ffaff2a1601e tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] 10.222.0.33 "GET /compute/v2.1/servers/b43cf252-2634-4a7d-9b8b-808e03acf885" status: 200 len: 1335 microversion: 2.54 time: 0.355237 Oct 04 21:00:28.817827 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2485/5001] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 21:00:28 2022] GET /compute/v2.1/servers/b43cf252-2634-4a7d-9b8b-808e03acf885 => generated 1335 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:00:29.481307 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-63c1c6a2-f965-4636-b3f5-219ee7de4fe1 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:00:29.483294 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-63c1c6a2-f965-4636-b3f5-219ee7de4fe1 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] [instance: 320f9a98-969f-473e-bc56-842bbd28dedc] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:00:29.500623 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-63c1c6a2-f965-4636-b3f5-219ee7de4fe1 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:29.502174 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-63c1c6a2-f965-4636-b3f5-219ee7de4fe1 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:29.508194 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-63c1c6a2-f965-4636-b3f5-219ee7de4fe1 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:29.512354 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-63c1c6a2-f965-4636-b3f5-219ee7de4fe1 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:29.513145 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-63c1c6a2-f965-4636-b3f5-219ee7de4fe1 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:29.514923 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-63c1c6a2-f965-4636-b3f5-219ee7de4fe1 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:29.786219 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-05aea12e-41c9-48e9-b190-b60fdeba8d72 tempest-ServersNegativeTestMultiTenantJSON-1428014836 tempest-ServersNegativeTestMultiTenantJSON-1428014836-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:00:29.798981 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-05aea12e-41c9-48e9-b190-b60fdeba8d72 tempest-ServersNegativeTestMultiTenantJSON-1428014836 tempest-ServersNegativeTestMultiTenantJSON-1428014836-project] [instance: 0e2212f3-ad4e-4cb0-8dca-ca49144a1e94] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:00:29.816751 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-05aea12e-41c9-48e9-b190-b60fdeba8d72 tempest-ServersNegativeTestMultiTenantJSON-1428014836 tempest-ServersNegativeTestMultiTenantJSON-1428014836-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:29.817488 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-05aea12e-41c9-48e9-b190-b60fdeba8d72 tempest-ServersNegativeTestMultiTenantJSON-1428014836 tempest-ServersNegativeTestMultiTenantJSON-1428014836-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:29.818766 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-05aea12e-41c9-48e9-b190-b60fdeba8d72 tempest-ServersNegativeTestMultiTenantJSON-1428014836 tempest-ServersNegativeTestMultiTenantJSON-1428014836-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:29.819932 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-05aea12e-41c9-48e9-b190-b60fdeba8d72 tempest-ServersNegativeTestMultiTenantJSON-1428014836 tempest-ServersNegativeTestMultiTenantJSON-1428014836-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:29.820722 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-05aea12e-41c9-48e9-b190-b60fdeba8d72 tempest-ServersNegativeTestMultiTenantJSON-1428014836 tempest-ServersNegativeTestMultiTenantJSON-1428014836-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:29.822621 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-05aea12e-41c9-48e9-b190-b60fdeba8d72 tempest-ServersNegativeTestMultiTenantJSON-1428014836 tempest-ServersNegativeTestMultiTenantJSON-1428014836-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:30.085066 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-63c1c6a2-f965-4636-b3f5-219ee7de4fe1 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6513f5e908ac4d028cad6eeeebeab285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65946afc398d4a9fb1c9095a4f946e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:00:30.093074 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-05aea12e-41c9-48e9-b190-b60fdeba8d72 tempest-ServersNegativeTestMultiTenantJSON-1428014836 tempest-ServersNegativeTestMultiTenantJSON-1428014836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dfed24a3a0144b0ac357f7e200b2155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf2a507fa3842e59a81c0967e25ae54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:00:30.098720 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-63c1c6a2-f965-4636-b3f5-219ee7de4fe1 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc" status: 200 len: 1512 microversion: 2.1 time: 0.627400 Oct 04 21:00:30.105091 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-05aea12e-41c9-48e9-b190-b60fdeba8d72 tempest-ServersNegativeTestMultiTenantJSON-1428014836 tempest-ServersNegativeTestMultiTenantJSON-1428014836-project] 10.222.0.33 "GET /compute/v2.1/servers/0e2212f3-ad4e-4cb0-8dca-ca49144a1e94" status: 200 len: 1285 microversion: 2.1 time: 0.326062 Oct 04 21:00:30.120007 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2517/5002] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:00:29 2022] GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc => generated 1512 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:00:30.122714 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2486/5003] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:00:29 2022] GET /compute/v2.1/servers/0e2212f3-ad4e-4cb0-8dca-ca49144a1e94 => generated 1285 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:00:30.127528 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-0ba8e2c5-16a9-4f34-b011-b9fa4422e3cf tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:00:30.128407 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-0ba8e2c5-16a9-4f34-b011-b9fa4422e3cf tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] [instance: b43cf252-2634-4a7d-9b8b-808e03acf885] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:00:30.134802 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0ba8e2c5-16a9-4f34-b011-b9fa4422e3cf tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:30.135549 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0ba8e2c5-16a9-4f34-b011-b9fa4422e3cf tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:30.135653 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-b911a81c-24b0-42bb-bd1a-3e549d8668b7 req-e0e7739e-aa3d-4961-8236-80541874923d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "320f9a98-969f-473e-bc56-842bbd28dedc", "name": "network-vif-unplugged", "status": "completed", "tag": "d2b3af35-3f6f-4a4b-91ec-14c17375542b"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:00:30.136317 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0ba8e2c5-16a9-4f34-b011-b9fa4422e3cf tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:30.137477 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0ba8e2c5-16a9-4f34-b011-b9fa4422e3cf tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:30.138111 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0ba8e2c5-16a9-4f34-b011-b9fa4422e3cf tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:30.138736 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0ba8e2c5-16a9-4f34-b011-b9fa4422e3cf tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:30.176557 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-b911a81c-24b0-42bb-bd1a-3e549d8668b7 req-e0e7739e-aa3d-4961-8236-80541874923d service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:30.177036 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-b911a81c-24b0-42bb-bd1a-3e549d8668b7 req-e0e7739e-aa3d-4961-8236-80541874923d service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:30.177467 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-b911a81c-24b0-42bb-bd1a-3e549d8668b7 req-e0e7739e-aa3d-4961-8236-80541874923d service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:30.216338 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.compute.server_external_events [req-b911a81c-24b0-42bb-bd1a-3e549d8668b7 req-e0e7739e-aa3d-4961-8236-80541874923d service nova] Unable to find a host for instance 320f9a98-969f-473e-bc56-842bbd28dedc. Dropping event network-vif-unplugged {{(pid=128801) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 04 21:00:30.217252 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-b911a81c-24b0-42bb-bd1a-3e549d8668b7 req-e0e7739e-aa3d-4961-8236-80541874923d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.093504 Oct 04 21:00:30.217871 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2487/5004] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:00:30 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 95 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 04 21:00:30.228739 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-168588f5-fb05-4b4b-9668-9bbbb710c9d0 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:00:30.229375 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-168588f5-fb05-4b4b-9668-9bbbb710c9d0 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] [instance: 320f9a98-969f-473e-bc56-842bbd28dedc] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:00:30.247885 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-168588f5-fb05-4b4b-9668-9bbbb710c9d0 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:30.248478 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-168588f5-fb05-4b4b-9668-9bbbb710c9d0 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:30.248858 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-168588f5-fb05-4b4b-9668-9bbbb710c9d0 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:30.249563 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-168588f5-fb05-4b4b-9668-9bbbb710c9d0 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:30.250016 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-168588f5-fb05-4b4b-9668-9bbbb710c9d0 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:30.250463 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-168588f5-fb05-4b4b-9668-9bbbb710c9d0 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:30.567590 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-0ba8e2c5-16a9-4f34-b011-b9fa4422e3cf tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea297d567a044fc9132f5d7d076f469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec4233f765546f997810e0e843ae184', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:00:30.605645 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-0ba8e2c5-16a9-4f34-b011-b9fa4422e3cf tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0ea297d567a044fc9132f5d7d076f469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec4233f765546f997810e0e843ae184', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:00:30.616106 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-0ba8e2c5-16a9-4f34-b011-b9fa4422e3cf tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0ea297d567a044fc9132f5d7d076f469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec4233f765546f997810e0e843ae184', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:00:30.623235 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-0ba8e2c5-16a9-4f34-b011-b9fa4422e3cf tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] 10.222.0.33 "GET /compute/v2.1/servers/b43cf252-2634-4a7d-9b8b-808e03acf885" status: 200 len: 1335 microversion: 2.54 time: 0.501770 Oct 04 21:00:30.635442 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2518/5005] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 21:00:30 2022] GET /compute/v2.1/servers/b43cf252-2634-4a7d-9b8b-808e03acf885 => generated 1335 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:00:31.151595 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-dc9c6a06-21a5-4903-a1f3-752da9619626 tempest-ServersNegativeTestMultiTenantJSON-1428014836 tempest-ServersNegativeTestMultiTenantJSON-1428014836-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:00:31.152465 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-dc9c6a06-21a5-4903-a1f3-752da9619626 tempest-ServersNegativeTestMultiTenantJSON-1428014836 tempest-ServersNegativeTestMultiTenantJSON-1428014836-project] [instance: 0e2212f3-ad4e-4cb0-8dca-ca49144a1e94] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:00:31.165166 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dc9c6a06-21a5-4903-a1f3-752da9619626 tempest-ServersNegativeTestMultiTenantJSON-1428014836 tempest-ServersNegativeTestMultiTenantJSON-1428014836-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:31.166880 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dc9c6a06-21a5-4903-a1f3-752da9619626 tempest-ServersNegativeTestMultiTenantJSON-1428014836 tempest-ServersNegativeTestMultiTenantJSON-1428014836-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:31.168881 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dc9c6a06-21a5-4903-a1f3-752da9619626 tempest-ServersNegativeTestMultiTenantJSON-1428014836 tempest-ServersNegativeTestMultiTenantJSON-1428014836-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:31.171760 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dc9c6a06-21a5-4903-a1f3-752da9619626 tempest-ServersNegativeTestMultiTenantJSON-1428014836 tempest-ServersNegativeTestMultiTenantJSON-1428014836-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:31.172457 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dc9c6a06-21a5-4903-a1f3-752da9619626 tempest-ServersNegativeTestMultiTenantJSON-1428014836 tempest-ServersNegativeTestMultiTenantJSON-1428014836-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:31.173485 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dc9c6a06-21a5-4903-a1f3-752da9619626 tempest-ServersNegativeTestMultiTenantJSON-1428014836 tempest-ServersNegativeTestMultiTenantJSON-1428014836-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:31.220230 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-168588f5-fb05-4b4b-9668-9bbbb710c9d0 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6513f5e908ac4d028cad6eeeebeab285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65946afc398d4a9fb1c9095a4f946e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:00:31.246108 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-168588f5-fb05-4b4b-9668-9bbbb710c9d0 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc" status: 200 len: 1452 microversion: 2.1 time: 1.027091 Oct 04 21:00:31.253223 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2488/5006] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:00:30 2022] GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc => generated 1452 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:00:31.337474 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-44c4ac27-4d39-44f1-85a0-859c0080fe44 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:00:31.338703 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-44c4ac27-4d39-44f1-85a0-859c0080fe44 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] [instance: 320f9a98-969f-473e-bc56-842bbd28dedc] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:00:31.346920 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-44c4ac27-4d39-44f1-85a0-859c0080fe44 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:31.347717 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-44c4ac27-4d39-44f1-85a0-859c0080fe44 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:31.348628 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-44c4ac27-4d39-44f1-85a0-859c0080fe44 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:31.351737 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-44c4ac27-4d39-44f1-85a0-859c0080fe44 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:31.352507 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-44c4ac27-4d39-44f1-85a0-859c0080fe44 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:31.354654 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-44c4ac27-4d39-44f1-85a0-859c0080fe44 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:31.431065 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-44c4ac27-4d39-44f1-85a0-859c0080fe44 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lazy-loading 'flavor' on Instance uuid 320f9a98-969f-473e-bc56-842bbd28dedc {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:00:31.472138 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-44c4ac27-4d39-44f1-85a0-859c0080fe44 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] HTTP exception thrown: Cannot 'shelve' instance 320f9a98-969f-473e-bc56-842bbd28dedc while it is in vm_state shelved_offloaded Oct 04 21:00:31.482226 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-44c4ac27-4d39-44f1-85a0-859c0080fe44 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Request method failure captured: Oct 04 21:00:31.482226 n-d-854823-8 devstack@n-api.service[128801]: request: POST /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc/action HTTP/1.1 Oct 04 21:00:31.482226 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 21:00:31.482226 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 21:00:31.482226 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 21:00:31.482226 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 14 Oct 04 21:00:31.482226 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 21:00:31.482226 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 21:00:31.482226 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 21:00:31.482226 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 21:00:31.482226 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJ4eaBM_FLl2jaN3nQraRbM94DgE-qlLjkCPNJ1Ol7VvkbIGIp-m_lAuwAay2VJ7lXD5niLtaDpJGDoHOJTljuI2aLuReHvX6jQr-uTgC01ZM2s7p6j6gq6a-1PaGQN0mcmcJntCqSnEEt5MEM6DdrOOdi5eEtsfyNU4EpDYmca-Ylo Oct 04 21:00:31.482226 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 21:00:31.482226 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 21:00:31.482226 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 21:00:31.482226 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 21:00:31.482226 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 21:00:31.482226 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 21:00:31.482226 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: 65946afc398d4a9fb1c9095a4f946e07 Oct 04 21:00:31.482226 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-ServersNegativeTestJSON-1097186397 Oct 04 21:00:31.482226 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 21:00:31.482226 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 21:00:31.482226 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_65946afc398d4a9fb1c9095a4f946e07", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/65946afc398d4a9fb1c9095a4f946e07"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/65946afc398d4a9fb1c9095a4f946e07"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/65946afc398d4a9fb1c9095a4f946e07"}]}] Oct 04 21:00:31.482226 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-ServersNegativeTestJSON-1097186397 Oct 04 21:00:31.482226 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: 65946afc398d4a9fb1c9095a4f946e07 Oct 04 21:00:31.482226 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1097186397 Oct 04 21:00:31.482226 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-ServersNegativeTestJSON-1097186397-project Oct 04 21:00:31.482226 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 21:00:31.482226 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 21:00:31.482226 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: 6513f5e908ac4d028cad6eeeebeab285 Oct 04 21:00:31.482226 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-ServersNegativeTestJSON-1097186397-project Oct 04 21:00:31.482226 n-d-854823-8 devstack@n-api.service[128801]: Oct 04 21:00:31.482226 n-d-854823-8 devstack@n-api.service[128801]: {"shelve": {}} Oct 04 21:00:31.482226 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 21:00:31.482226 n-d-854823-8 devstack@n-api.service[128801]: exception: Cannot 'shelve' instance 320f9a98-969f-473e-bc56-842bbd28dedc while it is in vm_state shelved_offloaded Oct 04 21:00:31.482226 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': '320f9a98-969f-473e-bc56-842bbd28dedc', 'body': {'shelve': {}}} Oct 04 21:00:31.482226 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:00:31.482226 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:00:31.482226 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 49, in _shelve Oct 04 21:00:31.482226 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self.compute_api.shelve(context, instance) Oct 04 21:00:31.482226 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 04 21:00:31.482226 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 04 21:00:31.482226 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 04 21:00:31.482226 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 04 21:00:31.482226 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 04 21:00:31.482226 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 04 21:00:31.482226 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 21:00:31.482226 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 21:00:31.482226 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 04 21:00:31.482226 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 04 21:00:31.482226 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 320f9a98-969f-473e-bc56-842bbd28dedc in vm_state shelved_offloaded. Cannot shelve while the instance is in this state. Oct 04 21:00:31.482226 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:00:31.482226 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:00:31.482226 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:00:31.482226 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:00:31.482226 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:00:31.482226 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:00:31.482226 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:00:31.482226 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:00:31.482226 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:00:31.482226 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:00:31.482226 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 56, in _shelve Oct 04 21:00:31.482226 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 04 21:00:31.482226 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 04 21:00:31.485355 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 04 21:00:31.485355 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'shelve' instance 320f9a98-969f-473e-bc56-842bbd28dedc while it is in vm_state shelved_offloaded Oct 04 21:00:31.485355 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:00:31.485355 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:00:31.485355 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:00:31.485355 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:00:31.485355 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:00:31.485355 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:00:31.485355 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:00:31.485355 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:00:31.485355 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'shelve' instance 320f9a98-969f-473e-bc56-842bbd28dedc while it is in vm_state shelved_offloaded Oct 04 21:00:31.485355 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:00:31.486424 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-44c4ac27-4d39-44f1-85a0-859c0080fe44 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Returning 409 to user: Cannot 'shelve' instance 320f9a98-969f-473e-bc56-842bbd28dedc while it is in vm_state shelved_offloaded {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:00:31.489524 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-44c4ac27-4d39-44f1-85a0-859c0080fe44 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "POST /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc/action" status: 409 len: 155 microversion: 2.1 time: 0.161712 Oct 04 21:00:31.505721 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2489/5007] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 21:00:31 2022] POST /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc/action => generated 155 bytes in 178 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 04 21:00:31.534064 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-92e78176-8e26-43ff-a25d-e98cce01db46 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:00:31.534736 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-92e78176-8e26-43ff-a25d-e98cce01db46 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] [instance: 320f9a98-969f-473e-bc56-842bbd28dedc] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:00:31.565206 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-92e78176-8e26-43ff-a25d-e98cce01db46 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:31.565723 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-92e78176-8e26-43ff-a25d-e98cce01db46 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:31.569865 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-92e78176-8e26-43ff-a25d-e98cce01db46 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:31.570792 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-92e78176-8e26-43ff-a25d-e98cce01db46 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:31.571288 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-92e78176-8e26-43ff-a25d-e98cce01db46 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:31.571730 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-92e78176-8e26-43ff-a25d-e98cce01db46 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:31.760425 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-92e78176-8e26-43ff-a25d-e98cce01db46 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] [instance: 320f9a98-969f-473e-bc56-842bbd28dedc] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=128801) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 04 21:00:31.959855 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-92e78176-8e26-43ff-a25d-e98cce01db46 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "POST /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc/action" status: 202 len: 0 microversion: 2.1 time: 0.450984 Oct 04 21:00:31.960475 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2490/5008] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 21:00:31 2022] POST /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc/action => generated 0 bytes in 454 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:00:31.965593 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f1af88d3-f21f-430e-a863-afd02c168056 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:00:31.966214 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f1af88d3-f21f-430e-a863-afd02c168056 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] [instance: b43cf252-2634-4a7d-9b8b-808e03acf885] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:00:31.982127 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f1af88d3-f21f-430e-a863-afd02c168056 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:31.982654 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f1af88d3-f21f-430e-a863-afd02c168056 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:31.983103 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f1af88d3-f21f-430e-a863-afd02c168056 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:31.983813 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f1af88d3-f21f-430e-a863-afd02c168056 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:31.984275 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f1af88d3-f21f-430e-a863-afd02c168056 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:31.984705 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f1af88d3-f21f-430e-a863-afd02c168056 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:32.131918 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f1af88d3-f21f-430e-a863-afd02c168056 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea297d567a044fc9132f5d7d076f469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec4233f765546f997810e0e843ae184', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:00:32.147473 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f1af88d3-f21f-430e-a863-afd02c168056 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0ea297d567a044fc9132f5d7d076f469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec4233f765546f997810e0e843ae184', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:00:32.157585 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f1af88d3-f21f-430e-a863-afd02c168056 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0ea297d567a044fc9132f5d7d076f469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec4233f765546f997810e0e843ae184', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:00:32.165318 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f1af88d3-f21f-430e-a863-afd02c168056 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] 10.222.0.33 "GET /compute/v2.1/servers/b43cf252-2634-4a7d-9b8b-808e03acf885" status: 200 len: 1356 microversion: 2.54 time: 0.201972 Oct 04 21:00:32.178712 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2491/5009] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 21:00:31 2022] GET /compute/v2.1/servers/b43cf252-2634-4a7d-9b8b-808e03acf885 => generated 1356 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:00:32.195011 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-dc9c6a06-21a5-4903-a1f3-752da9619626 tempest-ServersNegativeTestMultiTenantJSON-1428014836 tempest-ServersNegativeTestMultiTenantJSON-1428014836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dfed24a3a0144b0ac357f7e200b2155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf2a507fa3842e59a81c0967e25ae54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:00:32.197181 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-dbac753f-5ae8-4037-83b2-0ac36a096674 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:00:32.198000 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-dbac753f-5ae8-4037-83b2-0ac36a096674 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] [instance: 320f9a98-969f-473e-bc56-842bbd28dedc] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:00:32.204741 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-dc9c6a06-21a5-4903-a1f3-752da9619626 tempest-ServersNegativeTestMultiTenantJSON-1428014836 tempest-ServersNegativeTestMultiTenantJSON-1428014836-project] 10.222.0.33 "GET /compute/v2.1/servers/0e2212f3-ad4e-4cb0-8dca-ca49144a1e94" status: 200 len: 1327 microversion: 2.1 time: 1.072450 Oct 04 21:00:32.205762 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2519/5010] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:00:31 2022] GET /compute/v2.1/servers/0e2212f3-ad4e-4cb0-8dca-ca49144a1e94 => generated 1327 bytes in 1074 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:00:32.207167 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dbac753f-5ae8-4037-83b2-0ac36a096674 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:32.207895 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dbac753f-5ae8-4037-83b2-0ac36a096674 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:32.208581 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dbac753f-5ae8-4037-83b2-0ac36a096674 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:32.209469 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dbac753f-5ae8-4037-83b2-0ac36a096674 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:32.210093 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dbac753f-5ae8-4037-83b2-0ac36a096674 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:32.210729 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dbac753f-5ae8-4037-83b2-0ac36a096674 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:32.247287 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-08d6ae33-cd58-4eb2-82e6-803f1bc3ca96 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Action: 'create', calling method: .version_select at 0x7f3c6f5ac160>, body: {"keypair": {"name": "tempest-ServerShowV254Test-keypair-1836586810", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIldLLBFG1ibM4Ayks4K/AZBZTciU/0yv+YYYxgfry3rCQ4DPfdwz13ki0S0rS/6TP1qfGuwlZ2mgoaZng1VD6kpWbRfRqRZUsRLvT3tD/YolkoAftVWKiYgfg0zJXXK3Q=="}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:00:32.289359 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-08d6ae33-cd58-4eb2-82e6-803f1bc3ca96 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Getting quotas for project fec4233f765546f997810e0e843ae184. Resources: {'key_pairs'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:00:32.304222 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-08d6ae33-cd58-4eb2-82e6-803f1bc3ca96 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Getting quotas for user 0ea297d567a044fc9132f5d7d076f469 and project fec4233f765546f997810e0e843ae184. Resources: {'key_pairs'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:00:32.393314 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-08d6ae33-cd58-4eb2-82e6-803f1bc3ca96 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.54 time: 0.174967 Oct 04 21:00:32.400380 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2520/5011] 10.222.0.33 () {62 vars in 1200 bytes} [Tue Oct 4 21:00:32 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 194 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 04 21:00:32.413751 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-6b2184cd-526f-4951-928b-80d978b1499f tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Action: 'action', calling method: >, body: {"rebuild": {"key_name": "tempest-ServerShowV254Test-keypair-1836586810", "imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63"}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:00:32.419651 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-6b2184cd-526f-4951-928b-80d978b1499f tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] [instance: b43cf252-2634-4a7d-9b8b-808e03acf885] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:00:32.440397 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell0:SELECT=2 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:00:32.443074 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6b2184cd-526f-4951-928b-80d978b1499f tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:32.443584 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6b2184cd-526f-4951-928b-80d978b1499f tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:32.444031 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6b2184cd-526f-4951-928b-80d978b1499f tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:32.444974 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6b2184cd-526f-4951-928b-80d978b1499f tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:32.449970 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6b2184cd-526f-4951-928b-80d978b1499f tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:32.450642 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6b2184cd-526f-4951-928b-80d978b1499f tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:32.721233 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-6b2184cd-526f-4951-928b-80d978b1499f tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Flavor limits 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:00:32.722014 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-6b2184cd-526f-4951-928b-80d978b1499f tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Image limits 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:00:32.723200 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-6b2184cd-526f-4951-928b-80d978b1499f tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Flavor pref 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:00:32.725400 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-6b2184cd-526f-4951-928b-80d978b1499f tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Image pref 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:00:32.726824 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-6b2184cd-526f-4951-928b-80d978b1499f tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:00:32.853179 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-dbac753f-5ae8-4037-83b2-0ac36a096674 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6513f5e908ac4d028cad6eeeebeab285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65946afc398d4a9fb1c9095a4f946e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:00:32.862296 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-dbac753f-5ae8-4037-83b2-0ac36a096674 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc" status: 200 len: 1460 microversion: 2.1 time: 0.681994 Oct 04 21:00:32.867767 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2492/5012] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:00:32 2022] GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc => generated 1460 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:00:33.039768 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-6b2184cd-526f-4951-928b-80d978b1499f tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] [instance: b43cf252-2634-4a7d-9b8b-808e03acf885] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:00:33.062773 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6b2184cd-526f-4951-928b-80d978b1499f tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:33.063014 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6b2184cd-526f-4951-928b-80d978b1499f tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:33.067510 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6b2184cd-526f-4951-928b-80d978b1499f tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:33.068246 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6b2184cd-526f-4951-928b-80d978b1499f tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:33.068895 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6b2184cd-526f-4951-928b-80d978b1499f tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:33.069339 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6b2184cd-526f-4951-928b-80d978b1499f tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:33.173227 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-6b2184cd-526f-4951-928b-80d978b1499f tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] 10.222.0.33 "POST /compute/v2.1/servers/b43cf252-2634-4a7d-9b8b-808e03acf885/action" status: 202 len: 1139 microversion: 2.54 time: 0.771003 Oct 04 21:00:33.174621 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2521/5013] 10.222.0.33 () {62 vars in 1320 bytes} [Tue Oct 4 21:00:32 2022] POST /compute/v2.1/servers/b43cf252-2634-4a7d-9b8b-808e03acf885/action => generated 1139 bytes in 773 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 04 21:00:33.200285 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e40e7fe5-b85c-4819-8827-9925114aff3f tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:00:33.200850 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e40e7fe5-b85c-4819-8827-9925114aff3f tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] [instance: b43cf252-2634-4a7d-9b8b-808e03acf885] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:00:33.222789 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e40e7fe5-b85c-4819-8827-9925114aff3f tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:33.223300 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e40e7fe5-b85c-4819-8827-9925114aff3f tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:33.223748 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e40e7fe5-b85c-4819-8827-9925114aff3f tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:33.224469 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e40e7fe5-b85c-4819-8827-9925114aff3f tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:33.224933 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e40e7fe5-b85c-4819-8827-9925114aff3f tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:33.225361 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e40e7fe5-b85c-4819-8827-9925114aff3f tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:33.233089 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-ca15afdc-edcd-4211-b755-006f55dd4529 tempest-ServersNegativeTestMultiTenantJSON-1428014836 tempest-ServersNegativeTestMultiTenantJSON-1428014836-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:00:33.233724 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-ca15afdc-edcd-4211-b755-006f55dd4529 tempest-ServersNegativeTestMultiTenantJSON-1428014836 tempest-ServersNegativeTestMultiTenantJSON-1428014836-project] [instance: 0e2212f3-ad4e-4cb0-8dca-ca49144a1e94] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:00:33.245804 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ca15afdc-edcd-4211-b755-006f55dd4529 tempest-ServersNegativeTestMultiTenantJSON-1428014836 tempest-ServersNegativeTestMultiTenantJSON-1428014836-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:33.254483 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ca15afdc-edcd-4211-b755-006f55dd4529 tempest-ServersNegativeTestMultiTenantJSON-1428014836 tempest-ServersNegativeTestMultiTenantJSON-1428014836-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:33.255036 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ca15afdc-edcd-4211-b755-006f55dd4529 tempest-ServersNegativeTestMultiTenantJSON-1428014836 tempest-ServersNegativeTestMultiTenantJSON-1428014836-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:33.257320 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ca15afdc-edcd-4211-b755-006f55dd4529 tempest-ServersNegativeTestMultiTenantJSON-1428014836 tempest-ServersNegativeTestMultiTenantJSON-1428014836-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:33.257825 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ca15afdc-edcd-4211-b755-006f55dd4529 tempest-ServersNegativeTestMultiTenantJSON-1428014836 tempest-ServersNegativeTestMultiTenantJSON-1428014836-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:33.258273 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ca15afdc-edcd-4211-b755-006f55dd4529 tempest-ServersNegativeTestMultiTenantJSON-1428014836 tempest-ServersNegativeTestMultiTenantJSON-1428014836-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:33.578735 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e40e7fe5-b85c-4819-8827-9925114aff3f tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea297d567a044fc9132f5d7d076f469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec4233f765546f997810e0e843ae184', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:00:33.589535 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e40e7fe5-b85c-4819-8827-9925114aff3f tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0ea297d567a044fc9132f5d7d076f469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec4233f765546f997810e0e843ae184', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:00:33.597485 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e40e7fe5-b85c-4819-8827-9925114aff3f tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0ea297d567a044fc9132f5d7d076f469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec4233f765546f997810e0e843ae184', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:00:33.606143 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e40e7fe5-b85c-4819-8827-9925114aff3f tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] 10.222.0.33 "GET /compute/v2.1/servers/b43cf252-2634-4a7d-9b8b-808e03acf885" status: 200 len: 1408 microversion: 2.54 time: 0.410112 Oct 04 21:00:33.622811 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2493/5014] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 21:00:33 2022] GET /compute/v2.1/servers/b43cf252-2634-4a7d-9b8b-808e03acf885 => generated 1408 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:00:33.894200 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c600f72d-4444-4746-961a-861fedd3aeae tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:00:33.895516 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c600f72d-4444-4746-961a-861fedd3aeae tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] [instance: 320f9a98-969f-473e-bc56-842bbd28dedc] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:00:33.905381 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c600f72d-4444-4746-961a-861fedd3aeae tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:33.911541 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c600f72d-4444-4746-961a-861fedd3aeae tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:33.912328 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c600f72d-4444-4746-961a-861fedd3aeae tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:33.913224 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c600f72d-4444-4746-961a-861fedd3aeae tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:33.913834 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c600f72d-4444-4746-961a-861fedd3aeae tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:33.914537 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c600f72d-4444-4746-961a-861fedd3aeae tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:34.121489 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-ca15afdc-edcd-4211-b755-006f55dd4529 tempest-ServersNegativeTestMultiTenantJSON-1428014836 tempest-ServersNegativeTestMultiTenantJSON-1428014836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dfed24a3a0144b0ac357f7e200b2155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf2a507fa3842e59a81c0967e25ae54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:00:34.130077 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-ca15afdc-edcd-4211-b755-006f55dd4529 tempest-ServersNegativeTestMultiTenantJSON-1428014836 tempest-ServersNegativeTestMultiTenantJSON-1428014836-project] 10.222.0.33 "GET /compute/v2.1/servers/0e2212f3-ad4e-4cb0-8dca-ca49144a1e94" status: 200 len: 1327 microversion: 2.1 time: 0.900743 Oct 04 21:00:34.140680 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2522/5015] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:00:33 2022] GET /compute/v2.1/servers/0e2212f3-ad4e-4cb0-8dca-ca49144a1e94 => generated 1327 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:00:34.465517 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c600f72d-4444-4746-961a-861fedd3aeae tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6513f5e908ac4d028cad6eeeebeab285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65946afc398d4a9fb1c9095a4f946e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:00:34.477105 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c600f72d-4444-4746-961a-861fedd3aeae tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc" status: 200 len: 1460 microversion: 2.1 time: 0.584892 Oct 04 21:00:34.490368 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2494/5016] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:00:33 2022] GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc => generated 1460 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:00:34.636875 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-7c72236c-7ca0-4497-837a-bb6ffe373d26 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:00:34.637489 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-7c72236c-7ca0-4497-837a-bb6ffe373d26 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] [instance: b43cf252-2634-4a7d-9b8b-808e03acf885] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:00:34.645011 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7c72236c-7ca0-4497-837a-bb6ffe373d26 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:34.645505 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7c72236c-7ca0-4497-837a-bb6ffe373d26 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:34.645942 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7c72236c-7ca0-4497-837a-bb6ffe373d26 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:34.662719 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7c72236c-7ca0-4497-837a-bb6ffe373d26 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:34.663270 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7c72236c-7ca0-4497-837a-bb6ffe373d26 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:34.663735 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7c72236c-7ca0-4497-837a-bb6ffe373d26 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:34.982923 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-7c72236c-7ca0-4497-837a-bb6ffe373d26 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea297d567a044fc9132f5d7d076f469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec4233f765546f997810e0e843ae184', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:00:34.992293 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-7c72236c-7ca0-4497-837a-bb6ffe373d26 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0ea297d567a044fc9132f5d7d076f469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec4233f765546f997810e0e843ae184', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:00:34.996722 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-7c72236c-7ca0-4497-837a-bb6ffe373d26 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0ea297d567a044fc9132f5d7d076f469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec4233f765546f997810e0e843ae184', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:00:35.004398 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-7c72236c-7ca0-4497-837a-bb6ffe373d26 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] 10.222.0.33 "GET /compute/v2.1/servers/b43cf252-2634-4a7d-9b8b-808e03acf885" status: 200 len: 1408 microversion: 2.54 time: 0.370788 Oct 04 21:00:35.018649 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2523/5017] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 21:00:34 2022] GET /compute/v2.1/servers/b43cf252-2634-4a7d-9b8b-808e03acf885 => generated 1408 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:00:35.166969 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-48f134a1-50e6-4a24-97a1-8eb6b0eba5c9 tempest-ServersNegativeTestMultiTenantJSON-1428014836 tempest-ServersNegativeTestMultiTenantJSON-1428014836-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:00:35.168466 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-48f134a1-50e6-4a24-97a1-8eb6b0eba5c9 tempest-ServersNegativeTestMultiTenantJSON-1428014836 tempest-ServersNegativeTestMultiTenantJSON-1428014836-project] [instance: 0e2212f3-ad4e-4cb0-8dca-ca49144a1e94] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:00:35.181447 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-48f134a1-50e6-4a24-97a1-8eb6b0eba5c9 tempest-ServersNegativeTestMultiTenantJSON-1428014836 tempest-ServersNegativeTestMultiTenantJSON-1428014836-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:35.182191 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-48f134a1-50e6-4a24-97a1-8eb6b0eba5c9 tempest-ServersNegativeTestMultiTenantJSON-1428014836 tempest-ServersNegativeTestMultiTenantJSON-1428014836-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:35.187311 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-48f134a1-50e6-4a24-97a1-8eb6b0eba5c9 tempest-ServersNegativeTestMultiTenantJSON-1428014836 tempest-ServersNegativeTestMultiTenantJSON-1428014836-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:35.188313 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-48f134a1-50e6-4a24-97a1-8eb6b0eba5c9 tempest-ServersNegativeTestMultiTenantJSON-1428014836 tempest-ServersNegativeTestMultiTenantJSON-1428014836-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:35.189719 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-48f134a1-50e6-4a24-97a1-8eb6b0eba5c9 tempest-ServersNegativeTestMultiTenantJSON-1428014836 tempest-ServersNegativeTestMultiTenantJSON-1428014836-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:35.190354 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-48f134a1-50e6-4a24-97a1-8eb6b0eba5c9 tempest-ServersNegativeTestMultiTenantJSON-1428014836 tempest-ServersNegativeTestMultiTenantJSON-1428014836-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:35.425169 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:00:35.427900 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-30e597c9-6f4c-41ac-a9be-644847945b31 tempest-TestNetworkAdvancedServerOps-2095277972 tempest-TestNetworkAdvancedServerOps-2095277972-project-admin] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:00:35.428788 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-30e597c9-6f4c-41ac-a9be-644847945b31 tempest-TestNetworkAdvancedServerOps-2095277972 tempest-TestNetworkAdvancedServerOps-2095277972-project-admin] [instance: 243cbbbd-0734-4711-b605-c0657b81e359] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:00:35.452582 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-30e597c9-6f4c-41ac-a9be-644847945b31 tempest-TestNetworkAdvancedServerOps-2095277972 tempest-TestNetworkAdvancedServerOps-2095277972-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:35.454832 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-30e597c9-6f4c-41ac-a9be-644847945b31 tempest-TestNetworkAdvancedServerOps-2095277972 tempest-TestNetworkAdvancedServerOps-2095277972-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:35.457142 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-30e597c9-6f4c-41ac-a9be-644847945b31 tempest-TestNetworkAdvancedServerOps-2095277972 tempest-TestNetworkAdvancedServerOps-2095277972-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:35.458128 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-30e597c9-6f4c-41ac-a9be-644847945b31 tempest-TestNetworkAdvancedServerOps-2095277972 tempest-TestNetworkAdvancedServerOps-2095277972-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:35.460428 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-30e597c9-6f4c-41ac-a9be-644847945b31 tempest-TestNetworkAdvancedServerOps-2095277972 tempest-TestNetworkAdvancedServerOps-2095277972-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:35.461077 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-30e597c9-6f4c-41ac-a9be-644847945b31 tempest-TestNetworkAdvancedServerOps-2095277972 tempest-TestNetworkAdvancedServerOps-2095277972-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:35.563198 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:00:35.565605 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-48f134a1-50e6-4a24-97a1-8eb6b0eba5c9 tempest-ServersNegativeTestMultiTenantJSON-1428014836 tempest-ServersNegativeTestMultiTenantJSON-1428014836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dfed24a3a0144b0ac357f7e200b2155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf2a507fa3842e59a81c0967e25ae54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:00:35.591823 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-48f134a1-50e6-4a24-97a1-8eb6b0eba5c9 tempest-ServersNegativeTestMultiTenantJSON-1428014836 tempest-ServersNegativeTestMultiTenantJSON-1428014836-project] 10.222.0.33 "GET /compute/v2.1/servers/0e2212f3-ad4e-4cb0-8dca-ca49144a1e94" status: 200 len: 1327 microversion: 2.1 time: 0.428801 Oct 04 21:00:35.593236 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2495/5018] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:00:35 2022] GET /compute/v2.1/servers/0e2212f3-ad4e-4cb0-8dca-ca49144a1e94 => generated 1327 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:00:35.602587 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f7c37e1f-9069-48ca-91cd-301082dab37b tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:00:35.607302 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f7c37e1f-9069-48ca-91cd-301082dab37b tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] [instance: 320f9a98-969f-473e-bc56-842bbd28dedc] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:00:35.627884 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f7c37e1f-9069-48ca-91cd-301082dab37b tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:35.628552 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f7c37e1f-9069-48ca-91cd-301082dab37b tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:35.629090 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f7c37e1f-9069-48ca-91cd-301082dab37b tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:35.630091 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f7c37e1f-9069-48ca-91cd-301082dab37b tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:35.632114 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f7c37e1f-9069-48ca-91cd-301082dab37b tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:35.634499 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f7c37e1f-9069-48ca-91cd-301082dab37b tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:36.148324 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=8 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:00:36.177503 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f7c37e1f-9069-48ca-91cd-301082dab37b tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6513f5e908ac4d028cad6eeeebeab285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65946afc398d4a9fb1c9095a4f946e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:00:36.197464 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f7c37e1f-9069-48ca-91cd-301082dab37b tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc" status: 200 len: 1518 microversion: 2.1 time: 0.602365 Oct 04 21:00:36.202395 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2496/5019] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:00:35 2022] GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc => generated 1518 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:00:36.296280 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-bc8e4085-6091-48a8-980a-bc7779b7176d req-9f910d18-6edf-4768-bec8-67fef6498b6d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e2212f3-ad4e-4cb0-8dca-ca49144a1e94", "tag": "d2362a29-ecfd-42ad-8fbe-b5e9ccabbeaf"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:00:36.310498 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-bc8e4085-6091-48a8-980a-bc7779b7176d req-9f910d18-6edf-4768-bec8-67fef6498b6d service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:36.311354 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-bc8e4085-6091-48a8-980a-bc7779b7176d req-9f910d18-6edf-4768-bec8-67fef6498b6d service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:36.312009 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-bc8e4085-6091-48a8-980a-bc7779b7176d req-9f910d18-6edf-4768-bec8-67fef6498b6d service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:36.327380 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-bc8e4085-6091-48a8-980a-bc7779b7176d req-9f910d18-6edf-4768-bec8-67fef6498b6d service nova] Creating event network-changed:d2362a29-ecfd-42ad-8fbe-b5e9ccabbeaf for instance 0e2212f3-ad4e-4cb0-8dca-ca49144a1e94 on n-h2-854823-8 Oct 04 21:00:36.334448 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-bc8e4085-6091-48a8-980a-bc7779b7176d req-9f910d18-6edf-4768-bec8-67fef6498b6d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.133830 Oct 04 21:00:36.336210 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2497/5020] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:00:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:00:36.341848 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9a2f8804-5a86-4d37-8e00-f49ac0581dea tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:00:36.342947 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-9a2f8804-5a86-4d37-8e00-f49ac0581dea tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] [instance: b43cf252-2634-4a7d-9b8b-808e03acf885] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:00:36.353163 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9a2f8804-5a86-4d37-8e00-f49ac0581dea tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:36.354162 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9a2f8804-5a86-4d37-8e00-f49ac0581dea tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:36.355056 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9a2f8804-5a86-4d37-8e00-f49ac0581dea tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:36.356612 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9a2f8804-5a86-4d37-8e00-f49ac0581dea tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:36.357637 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9a2f8804-5a86-4d37-8e00-f49ac0581dea tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:36.358303 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9a2f8804-5a86-4d37-8e00-f49ac0581dea tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:36.671513 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-9a2f8804-5a86-4d37-8e00-f49ac0581dea tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea297d567a044fc9132f5d7d076f469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec4233f765546f997810e0e843ae184', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:00:36.676377 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-30e597c9-6f4c-41ac-a9be-644847945b31 tempest-TestNetworkAdvancedServerOps-2095277972 tempest-TestNetworkAdvancedServerOps-2095277972-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/243cbbbd-0734-4711-b605-c0657b81e359" status: 200 len: 1832 microversion: 2.1 time: 1.267641 Oct 04 21:00:36.683421 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-9a2f8804-5a86-4d37-8e00-f49ac0581dea tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0ea297d567a044fc9132f5d7d076f469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec4233f765546f997810e0e843ae184', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:00:36.685103 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-9a2f8804-5a86-4d37-8e00-f49ac0581dea tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0ea297d567a044fc9132f5d7d076f469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec4233f765546f997810e0e843ae184', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:00:36.686282 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-9a2f8804-5a86-4d37-8e00-f49ac0581dea tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] 10.222.0.33 "GET /compute/v2.1/servers/b43cf252-2634-4a7d-9b8b-808e03acf885" status: 200 len: 1408 microversion: 2.54 time: 0.348617 Oct 04 21:00:36.687023 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2498/5021] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 21:00:36 2022] GET /compute/v2.1/servers/b43cf252-2634-4a7d-9b8b-808e03acf885 => generated 1408 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:00:36.692258 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a610d0dc-3445-483f-9499-ffbb36c86761 tempest-ServersNegativeTestMultiTenantJSON-1428014836 tempest-ServersNegativeTestMultiTenantJSON-1428014836-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:00:36.693070 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a610d0dc-3445-483f-9499-ffbb36c86761 tempest-ServersNegativeTestMultiTenantJSON-1428014836 tempest-ServersNegativeTestMultiTenantJSON-1428014836-project] [instance: 0e2212f3-ad4e-4cb0-8dca-ca49144a1e94] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:00:36.700579 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2524/5022] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:00:35 2022] GET /compute/v2.1/servers/243cbbbd-0734-4711-b605-c0657b81e359 => generated 1832 bytes in 1293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:00:36.704121 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a610d0dc-3445-483f-9499-ffbb36c86761 tempest-ServersNegativeTestMultiTenantJSON-1428014836 tempest-ServersNegativeTestMultiTenantJSON-1428014836-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:36.704863 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a610d0dc-3445-483f-9499-ffbb36c86761 tempest-ServersNegativeTestMultiTenantJSON-1428014836 tempest-ServersNegativeTestMultiTenantJSON-1428014836-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:36.708244 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a610d0dc-3445-483f-9499-ffbb36c86761 tempest-ServersNegativeTestMultiTenantJSON-1428014836 tempest-ServersNegativeTestMultiTenantJSON-1428014836-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:36.709554 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a610d0dc-3445-483f-9499-ffbb36c86761 tempest-ServersNegativeTestMultiTenantJSON-1428014836 tempest-ServersNegativeTestMultiTenantJSON-1428014836-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:36.710910 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a610d0dc-3445-483f-9499-ffbb36c86761 tempest-ServersNegativeTestMultiTenantJSON-1428014836 tempest-ServersNegativeTestMultiTenantJSON-1428014836-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:36.711584 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a610d0dc-3445-483f-9499-ffbb36c86761 tempest-ServersNegativeTestMultiTenantJSON-1428014836 tempest-ServersNegativeTestMultiTenantJSON-1428014836-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:36.727175 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-0598b9bc-0ea4-43a8-863f-6994ea99df19 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:00:36.730291 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-0598b9bc-0ea4-43a8-863f-6994ea99df19 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] [instance: 243cbbbd-0734-4711-b605-c0657b81e359] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:00:36.744246 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0598b9bc-0ea4-43a8-863f-6994ea99df19 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:36.744894 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0598b9bc-0ea4-43a8-863f-6994ea99df19 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:36.745433 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0598b9bc-0ea4-43a8-863f-6994ea99df19 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:36.746261 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0598b9bc-0ea4-43a8-863f-6994ea99df19 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:36.746854 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0598b9bc-0ea4-43a8-863f-6994ea99df19 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:36.751641 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0598b9bc-0ea4-43a8-863f-6994ea99df19 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:37.202291 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-a610d0dc-3445-483f-9499-ffbb36c86761 tempest-ServersNegativeTestMultiTenantJSON-1428014836 tempest-ServersNegativeTestMultiTenantJSON-1428014836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dfed24a3a0144b0ac357f7e200b2155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf2a507fa3842e59a81c0967e25ae54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:00:37.215875 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a610d0dc-3445-483f-9499-ffbb36c86761 tempest-ServersNegativeTestMultiTenantJSON-1428014836 tempest-ServersNegativeTestMultiTenantJSON-1428014836-project] 10.222.0.33 "GET /compute/v2.1/servers/0e2212f3-ad4e-4cb0-8dca-ca49144a1e94" status: 200 len: 1327 microversion: 2.1 time: 0.526413 Oct 04 21:00:37.217581 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2499/5023] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:00:36 2022] GET /compute/v2.1/servers/0e2212f3-ad4e-4cb0-8dca-ca49144a1e94 => generated 1327 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:00:37.238110 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d00dc2b9-2eef-45e4-b2d5-e44f7fa16f7c tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:00:37.239136 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d00dc2b9-2eef-45e4-b2d5-e44f7fa16f7c tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] [instance: 320f9a98-969f-473e-bc56-842bbd28dedc] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:00:37.260234 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d00dc2b9-2eef-45e4-b2d5-e44f7fa16f7c tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:37.261132 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d00dc2b9-2eef-45e4-b2d5-e44f7fa16f7c tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:37.261806 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d00dc2b9-2eef-45e4-b2d5-e44f7fa16f7c tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:37.263987 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d00dc2b9-2eef-45e4-b2d5-e44f7fa16f7c tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:37.266037 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d00dc2b9-2eef-45e4-b2d5-e44f7fa16f7c tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:37.267254 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d00dc2b9-2eef-45e4-b2d5-e44f7fa16f7c tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:37.355641 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-0598b9bc-0ea4-43a8-863f-6994ea99df19 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5dbe3da6a4af181ef7302fe605fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3aa23aee3c8435c8f1f409019c5fed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:00:37.374367 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-0598b9bc-0ea4-43a8-863f-6994ea99df19 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] 10.222.0.33 "GET /compute/v2.1/servers/243cbbbd-0734-4711-b605-c0657b81e359" status: 200 len: 1681 microversion: 2.1 time: 0.652406 Oct 04 21:00:37.377583 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2525/5024] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:00:36 2022] GET /compute/v2.1/servers/243cbbbd-0734-4711-b605-c0657b81e359 => generated 1681 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:00:37.663300 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d00dc2b9-2eef-45e4-b2d5-e44f7fa16f7c tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6513f5e908ac4d028cad6eeeebeab285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65946afc398d4a9fb1c9095a4f946e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:00:37.671424 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-fdb4897f-b755-4549-8b3b-a79b50e819f0 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:00:37.676156 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-fdb4897f-b755-4549-8b3b-a79b50e819f0 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] [instance: 243cbbbd-0734-4711-b605-c0657b81e359] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:00:37.691366 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d00dc2b9-2eef-45e4-b2d5-e44f7fa16f7c tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc" status: 200 len: 1518 microversion: 2.1 time: 0.457442 Oct 04 21:00:37.697223 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2500/5025] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:00:37 2022] GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc => generated 1518 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:00:37.713604 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fdb4897f-b755-4549-8b3b-a79b50e819f0 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:37.715125 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fdb4897f-b755-4549-8b3b-a79b50e819f0 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:37.715903 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fdb4897f-b755-4549-8b3b-a79b50e819f0 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:37.716950 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fdb4897f-b755-4549-8b3b-a79b50e819f0 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:37.717860 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fdb4897f-b755-4549-8b3b-a79b50e819f0 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:37.718630 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fdb4897f-b755-4549-8b3b-a79b50e819f0 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:37.728506 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-89a1f9fd-33cf-4f7e-a822-56c02f64a49a tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:00:37.729479 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-89a1f9fd-33cf-4f7e-a822-56c02f64a49a tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] [instance: b43cf252-2634-4a7d-9b8b-808e03acf885] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:00:37.760164 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-89a1f9fd-33cf-4f7e-a822-56c02f64a49a tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:37.763036 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-89a1f9fd-33cf-4f7e-a822-56c02f64a49a tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:37.769134 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-89a1f9fd-33cf-4f7e-a822-56c02f64a49a tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:37.770143 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-89a1f9fd-33cf-4f7e-a822-56c02f64a49a tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:37.775077 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-89a1f9fd-33cf-4f7e-a822-56c02f64a49a tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:37.775803 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-89a1f9fd-33cf-4f7e-a822-56c02f64a49a tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:37.841579 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:00:38.067282 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-89a1f9fd-33cf-4f7e-a822-56c02f64a49a tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea297d567a044fc9132f5d7d076f469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec4233f765546f997810e0e843ae184', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:00:38.084488 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-89a1f9fd-33cf-4f7e-a822-56c02f64a49a tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0ea297d567a044fc9132f5d7d076f469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec4233f765546f997810e0e843ae184', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:00:38.092597 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-89a1f9fd-33cf-4f7e-a822-56c02f64a49a tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0ea297d567a044fc9132f5d7d076f469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec4233f765546f997810e0e843ae184', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:00:38.097476 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-89a1f9fd-33cf-4f7e-a822-56c02f64a49a tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] 10.222.0.33 "GET /compute/v2.1/servers/b43cf252-2634-4a7d-9b8b-808e03acf885" status: 200 len: 1408 microversion: 2.54 time: 0.371618 Oct 04 21:00:38.098326 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2501/5026] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 21:00:37 2022] GET /compute/v2.1/servers/b43cf252-2634-4a7d-9b8b-808e03acf885 => generated 1408 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:00:38.248088 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5db9ab40-1f9b-410c-9ac7-434c1f768b71 tempest-ServersNegativeTestMultiTenantJSON-1428014836 tempest-ServersNegativeTestMultiTenantJSON-1428014836-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:00:38.248743 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-5db9ab40-1f9b-410c-9ac7-434c1f768b71 tempest-ServersNegativeTestMultiTenantJSON-1428014836 tempest-ServersNegativeTestMultiTenantJSON-1428014836-project] [instance: 0e2212f3-ad4e-4cb0-8dca-ca49144a1e94] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:00:38.262645 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5db9ab40-1f9b-410c-9ac7-434c1f768b71 tempest-ServersNegativeTestMultiTenantJSON-1428014836 tempest-ServersNegativeTestMultiTenantJSON-1428014836-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:38.264484 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5db9ab40-1f9b-410c-9ac7-434c1f768b71 tempest-ServersNegativeTestMultiTenantJSON-1428014836 tempest-ServersNegativeTestMultiTenantJSON-1428014836-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:38.264950 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5db9ab40-1f9b-410c-9ac7-434c1f768b71 tempest-ServersNegativeTestMultiTenantJSON-1428014836 tempest-ServersNegativeTestMultiTenantJSON-1428014836-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:38.265685 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5db9ab40-1f9b-410c-9ac7-434c1f768b71 tempest-ServersNegativeTestMultiTenantJSON-1428014836 tempest-ServersNegativeTestMultiTenantJSON-1428014836-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:38.266153 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5db9ab40-1f9b-410c-9ac7-434c1f768b71 tempest-ServersNegativeTestMultiTenantJSON-1428014836 tempest-ServersNegativeTestMultiTenantJSON-1428014836-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:38.269853 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5db9ab40-1f9b-410c-9ac7-434c1f768b71 tempest-ServersNegativeTestMultiTenantJSON-1428014836 tempest-ServersNegativeTestMultiTenantJSON-1428014836-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:38.339087 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-fdb4897f-b755-4549-8b3b-a79b50e819f0 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] 10.222.0.33 "POST /compute/v2.1/servers/243cbbbd-0734-4711-b605-c0657b81e359/action" status: 200 len: 32638 microversion: 2.1 time: 0.685013 Oct 04 21:00:38.340409 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2526/5027] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 21:00:37 2022] POST /compute/v2.1/servers/243cbbbd-0734-4711-b605-c0657b81e359/action => generated 32638 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 04 21:00:38.519881 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-219b6932-a497-4d72-b1af-2bab255942ca tempest-TestNetworkAdvancedServerOps-2095277972 tempest-TestNetworkAdvancedServerOps-2095277972-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:00:38.521421 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-219b6932-a497-4d72-b1af-2bab255942ca tempest-TestNetworkAdvancedServerOps-2095277972 tempest-TestNetworkAdvancedServerOps-2095277972-project-admin] [instance: 243cbbbd-0734-4711-b605-c0657b81e359] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:00:38.581135 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-219b6932-a497-4d72-b1af-2bab255942ca tempest-TestNetworkAdvancedServerOps-2095277972 tempest-TestNetworkAdvancedServerOps-2095277972-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:38.581625 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-219b6932-a497-4d72-b1af-2bab255942ca tempest-TestNetworkAdvancedServerOps-2095277972 tempest-TestNetworkAdvancedServerOps-2095277972-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:38.588468 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-219b6932-a497-4d72-b1af-2bab255942ca tempest-TestNetworkAdvancedServerOps-2095277972 tempest-TestNetworkAdvancedServerOps-2095277972-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:38.589345 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-219b6932-a497-4d72-b1af-2bab255942ca tempest-TestNetworkAdvancedServerOps-2095277972 tempest-TestNetworkAdvancedServerOps-2095277972-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:38.599022 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-219b6932-a497-4d72-b1af-2bab255942ca tempest-TestNetworkAdvancedServerOps-2095277972 tempest-TestNetworkAdvancedServerOps-2095277972-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:38.600180 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-219b6932-a497-4d72-b1af-2bab255942ca tempest-TestNetworkAdvancedServerOps-2095277972 tempest-TestNetworkAdvancedServerOps-2095277972-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:38.834218 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-219b6932-a497-4d72-b1af-2bab255942ca tempest-TestNetworkAdvancedServerOps-2095277972 tempest-TestNetworkAdvancedServerOps-2095277972-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '7d1811d0cd2a4e81bd89409b4a866b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0de0fd6794f74ca48fde53682ce8dde8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:00:38.834928 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-219b6932-a497-4d72-b1af-2bab255942ca tempest-TestNetworkAdvancedServerOps-2095277972 tempest-TestNetworkAdvancedServerOps-2095277972-project-admin] [instance: 243cbbbd-0734-4711-b605-c0657b81e359] flavor_id is None. Assuming migration. {{(pid=128802) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 04 21:00:38.836077 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-219b6932-a497-4d72-b1af-2bab255942ca tempest-TestNetworkAdvancedServerOps-2095277972 tempest-TestNetworkAdvancedServerOps-2095277972-project-admin] [instance: 243cbbbd-0734-4711-b605-c0657b81e359] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=128802) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 04 21:00:39.050484 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-5db9ab40-1f9b-410c-9ac7-434c1f768b71 tempest-ServersNegativeTestMultiTenantJSON-1428014836 tempest-ServersNegativeTestMultiTenantJSON-1428014836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dfed24a3a0144b0ac357f7e200b2155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf2a507fa3842e59a81c0967e25ae54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:00:39.068965 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5db9ab40-1f9b-410c-9ac7-434c1f768b71 tempest-ServersNegativeTestMultiTenantJSON-1428014836 tempest-ServersNegativeTestMultiTenantJSON-1428014836-project] 10.222.0.33 "GET /compute/v2.1/servers/0e2212f3-ad4e-4cb0-8dca-ca49144a1e94" status: 200 len: 1327 microversion: 2.1 time: 0.817080 Oct 04 21:00:39.083325 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2502/5028] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:00:38 2022] GET /compute/v2.1/servers/0e2212f3-ad4e-4cb0-8dca-ca49144a1e94 => generated 1327 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:00:39.097903 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0f9df1c6-f507-473e-9bc8-e9a3adc1690d tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:00:39.099381 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-0f9df1c6-f507-473e-9bc8-e9a3adc1690d tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] [instance: 320f9a98-969f-473e-bc56-842bbd28dedc] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:00:39.111948 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0f9df1c6-f507-473e-9bc8-e9a3adc1690d tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:39.112709 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0f9df1c6-f507-473e-9bc8-e9a3adc1690d tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:39.113343 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0f9df1c6-f507-473e-9bc8-e9a3adc1690d tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:39.114500 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0f9df1c6-f507-473e-9bc8-e9a3adc1690d tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:39.115156 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0f9df1c6-f507-473e-9bc8-e9a3adc1690d tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:39.115798 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0f9df1c6-f507-473e-9bc8-e9a3adc1690d tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:39.768614 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-219b6932-a497-4d72-b1af-2bab255942ca tempest-TestNetworkAdvancedServerOps-2095277972 tempest-TestNetworkAdvancedServerOps-2095277972-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/243cbbbd-0734-4711-b605-c0657b81e359/action" status: 202 len: 0 microversion: 2.1 time: 1.283771 Oct 04 21:00:39.771240 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2527/5029] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 21:00:38 2022] POST /compute/v2.1/servers/243cbbbd-0734-4711-b605-c0657b81e359/action => generated 0 bytes in 1287 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:00:39.779294 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-295690c0-347e-4265-8556-73bf4d5841ef tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:00:39.779927 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-295690c0-347e-4265-8556-73bf4d5841ef tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] [instance: b43cf252-2634-4a7d-9b8b-808e03acf885] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:00:39.839247 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-295690c0-347e-4265-8556-73bf4d5841ef tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:39.839866 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-295690c0-347e-4265-8556-73bf4d5841ef tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:39.840280 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-295690c0-347e-4265-8556-73bf4d5841ef tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:39.849421 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-295690c0-347e-4265-8556-73bf4d5841ef tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:39.849918 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-295690c0-347e-4265-8556-73bf4d5841ef tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:39.864112 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-0f9df1c6-f507-473e-9bc8-e9a3adc1690d tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6513f5e908ac4d028cad6eeeebeab285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65946afc398d4a9fb1c9095a4f946e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:00:39.868523 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-295690c0-347e-4265-8556-73bf4d5841ef tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:39.879014 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-0f9df1c6-f507-473e-9bc8-e9a3adc1690d tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc" status: 200 len: 1518 microversion: 2.1 time: 0.794179 Oct 04 21:00:39.894095 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2503/5030] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:00:39 2022] GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc => generated 1518 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:00:39.916064 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d8b2b8d5-7fd9-438c-9da6-a50709893f01 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:00:39.928166 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d8b2b8d5-7fd9-438c-9da6-a50709893f01 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] [instance: 243cbbbd-0734-4711-b605-c0657b81e359] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:00:39.978146 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d8b2b8d5-7fd9-438c-9da6-a50709893f01 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:39.978876 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d8b2b8d5-7fd9-438c-9da6-a50709893f01 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:39.979429 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d8b2b8d5-7fd9-438c-9da6-a50709893f01 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:39.980293 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d8b2b8d5-7fd9-438c-9da6-a50709893f01 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:39.980837 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d8b2b8d5-7fd9-438c-9da6-a50709893f01 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:39.981317 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d8b2b8d5-7fd9-438c-9da6-a50709893f01 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:40.465022 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-295690c0-347e-4265-8556-73bf4d5841ef tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea297d567a044fc9132f5d7d076f469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec4233f765546f997810e0e843ae184', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:00:40.474415 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-295690c0-347e-4265-8556-73bf4d5841ef tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0ea297d567a044fc9132f5d7d076f469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec4233f765546f997810e0e843ae184', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:00:40.475888 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-295690c0-347e-4265-8556-73bf4d5841ef tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0ea297d567a044fc9132f5d7d076f469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec4233f765546f997810e0e843ae184', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:00:40.519707 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-295690c0-347e-4265-8556-73bf4d5841ef tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] 10.222.0.33 "GET /compute/v2.1/servers/b43cf252-2634-4a7d-9b8b-808e03acf885" status: 200 len: 1408 microversion: 2.54 time: 0.704696 Oct 04 21:00:40.525091 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2528/5031] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 21:00:39 2022] GET /compute/v2.1/servers/b43cf252-2634-4a7d-9b8b-808e03acf885 => generated 1408 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:00:40.546498 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-a6c09d0d-fdf7-4da8-86b5-e2c9f0e76b0d tempest-ServersNegativeTestMultiTenantJSON-1428014836 tempest-ServersNegativeTestMultiTenantJSON-1428014836-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:00:40.553911 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-a6c09d0d-fdf7-4da8-86b5-e2c9f0e76b0d tempest-ServersNegativeTestMultiTenantJSON-1428014836 tempest-ServersNegativeTestMultiTenantJSON-1428014836-project] [instance: 0e2212f3-ad4e-4cb0-8dca-ca49144a1e94] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:00:40.597421 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a6c09d0d-fdf7-4da8-86b5-e2c9f0e76b0d tempest-ServersNegativeTestMultiTenantJSON-1428014836 tempest-ServersNegativeTestMultiTenantJSON-1428014836-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:40.611221 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a6c09d0d-fdf7-4da8-86b5-e2c9f0e76b0d tempest-ServersNegativeTestMultiTenantJSON-1428014836 tempest-ServersNegativeTestMultiTenantJSON-1428014836-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:40.611910 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a6c09d0d-fdf7-4da8-86b5-e2c9f0e76b0d tempest-ServersNegativeTestMultiTenantJSON-1428014836 tempest-ServersNegativeTestMultiTenantJSON-1428014836-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:40.612690 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a6c09d0d-fdf7-4da8-86b5-e2c9f0e76b0d tempest-ServersNegativeTestMultiTenantJSON-1428014836 tempest-ServersNegativeTestMultiTenantJSON-1428014836-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:40.613264 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a6c09d0d-fdf7-4da8-86b5-e2c9f0e76b0d tempest-ServersNegativeTestMultiTenantJSON-1428014836 tempest-ServersNegativeTestMultiTenantJSON-1428014836-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:40.614777 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a6c09d0d-fdf7-4da8-86b5-e2c9f0e76b0d tempest-ServersNegativeTestMultiTenantJSON-1428014836 tempest-ServersNegativeTestMultiTenantJSON-1428014836-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:40.848314 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d8b2b8d5-7fd9-438c-9da6-a50709893f01 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5dbe3da6a4af181ef7302fe605fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3aa23aee3c8435c8f1f409019c5fed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:00:40.861569 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d8b2b8d5-7fd9-438c-9da6-a50709893f01 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] 10.222.0.33 "GET /compute/v2.1/servers/243cbbbd-0734-4711-b605-c0657b81e359" status: 200 len: 1690 microversion: 2.1 time: 0.963441 Oct 04 21:00:40.865023 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2504/5032] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:00:39 2022] GET /compute/v2.1/servers/243cbbbd-0734-4711-b605-c0657b81e359 => generated 1690 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:00:40.921733 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1c781f3c-8b52-45eb-ad61-ef2ddea44cf4 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:00:40.925981 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-1c781f3c-8b52-45eb-ad61-ef2ddea44cf4 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] [instance: 320f9a98-969f-473e-bc56-842bbd28dedc] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:00:40.973783 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1c781f3c-8b52-45eb-ad61-ef2ddea44cf4 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:40.978172 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1c781f3c-8b52-45eb-ad61-ef2ddea44cf4 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:40.979802 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1c781f3c-8b52-45eb-ad61-ef2ddea44cf4 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:40.984207 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1c781f3c-8b52-45eb-ad61-ef2ddea44cf4 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:40.986960 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1c781f3c-8b52-45eb-ad61-ef2ddea44cf4 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:40.988072 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1c781f3c-8b52-45eb-ad61-ef2ddea44cf4 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:41.490996 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-a6c09d0d-fdf7-4da8-86b5-e2c9f0e76b0d tempest-ServersNegativeTestMultiTenantJSON-1428014836 tempest-ServersNegativeTestMultiTenantJSON-1428014836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dfed24a3a0144b0ac357f7e200b2155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf2a507fa3842e59a81c0967e25ae54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:00:41.527810 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-a6c09d0d-fdf7-4da8-86b5-e2c9f0e76b0d tempest-ServersNegativeTestMultiTenantJSON-1428014836 tempest-ServersNegativeTestMultiTenantJSON-1428014836-project] 10.222.0.33 "GET /compute/v2.1/servers/0e2212f3-ad4e-4cb0-8dca-ca49144a1e94" status: 200 len: 1327 microversion: 2.1 time: 0.973002 Oct 04 21:00:41.534570 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2529/5033] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:00:40 2022] GET /compute/v2.1/servers/0e2212f3-ad4e-4cb0-8dca-ca49144a1e94 => generated 1327 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:00:41.571572 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-e4b9c050-9be0-439c-99f3-c038d6ae7d75 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:00:41.576072 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-e4b9c050-9be0-439c-99f3-c038d6ae7d75 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] [instance: b43cf252-2634-4a7d-9b8b-808e03acf885] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:00:41.596914 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e4b9c050-9be0-439c-99f3-c038d6ae7d75 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:41.606642 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e4b9c050-9be0-439c-99f3-c038d6ae7d75 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:41.607107 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e4b9c050-9be0-439c-99f3-c038d6ae7d75 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:41.607877 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e4b9c050-9be0-439c-99f3-c038d6ae7d75 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:41.608339 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e4b9c050-9be0-439c-99f3-c038d6ae7d75 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:41.620610 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e4b9c050-9be0-439c-99f3-c038d6ae7d75 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:42.161132 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-e4b9c050-9be0-439c-99f3-c038d6ae7d75 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea297d567a044fc9132f5d7d076f469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec4233f765546f997810e0e843ae184', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:00:42.179365 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-e4b9c050-9be0-439c-99f3-c038d6ae7d75 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0ea297d567a044fc9132f5d7d076f469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec4233f765546f997810e0e843ae184', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:00:42.187336 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-e4b9c050-9be0-439c-99f3-c038d6ae7d75 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0ea297d567a044fc9132f5d7d076f469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec4233f765546f997810e0e843ae184', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:00:42.189602 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-e4b9c050-9be0-439c-99f3-c038d6ae7d75 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] 10.222.0.33 "GET /compute/v2.1/servers/b43cf252-2634-4a7d-9b8b-808e03acf885" status: 200 len: 1408 microversion: 2.54 time: 0.629970 Oct 04 21:00:42.207444 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2530/5034] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 21:00:41 2022] GET /compute/v2.1/servers/b43cf252-2634-4a7d-9b8b-808e03acf885 => generated 1408 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:00:42.225882 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-9df9ec3a-72bd-47da-960e-f728d512a24a req-e5dae497-fd0e-40f9-9886-575f5b906a84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e2212f3-ad4e-4cb0-8dca-ca49144a1e94", "name": "network-vif-plugged", "status": "completed", "tag": "d2362a29-ecfd-42ad-8fbe-b5e9ccabbeaf"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:00:42.249881 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-9df9ec3a-72bd-47da-960e-f728d512a24a req-e5dae497-fd0e-40f9-9886-575f5b906a84 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:42.254622 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-9df9ec3a-72bd-47da-960e-f728d512a24a req-e5dae497-fd0e-40f9-9886-575f5b906a84 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:42.255220 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-9df9ec3a-72bd-47da-960e-f728d512a24a req-e5dae497-fd0e-40f9-9886-575f5b906a84 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:42.287844 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-9df9ec3a-72bd-47da-960e-f728d512a24a req-e5dae497-fd0e-40f9-9886-575f5b906a84 service nova] Creating event network-vif-plugged:d2362a29-ecfd-42ad-8fbe-b5e9ccabbeaf for instance 0e2212f3-ad4e-4cb0-8dca-ca49144a1e94 on n-h2-854823-8 Oct 04 21:00:42.304043 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-9df9ec3a-72bd-47da-960e-f728d512a24a req-e5dae497-fd0e-40f9-9886-575f5b906a84 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086513 Oct 04 21:00:42.307955 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2531/5035] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:00:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:00:42.321686 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-678bdd03-af36-4c9f-9942-d24081c02bb3 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:00:42.322689 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-678bdd03-af36-4c9f-9942-d24081c02bb3 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] [instance: 243cbbbd-0734-4711-b605-c0657b81e359] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:00:42.338520 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-678bdd03-af36-4c9f-9942-d24081c02bb3 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:42.339287 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-678bdd03-af36-4c9f-9942-d24081c02bb3 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:42.339958 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-678bdd03-af36-4c9f-9942-d24081c02bb3 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:42.343049 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-678bdd03-af36-4c9f-9942-d24081c02bb3 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:42.346103 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-678bdd03-af36-4c9f-9942-d24081c02bb3 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:42.347275 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-678bdd03-af36-4c9f-9942-d24081c02bb3 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:42.348074 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell0:SELECT=12 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:00:42.554038 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-1c781f3c-8b52-45eb-ad61-ef2ddea44cf4 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6513f5e908ac4d028cad6eeeebeab285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65946afc398d4a9fb1c9095a4f946e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:00:42.565339 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-1c781f3c-8b52-45eb-ad61-ef2ddea44cf4 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc" status: 200 len: 1518 microversion: 2.1 time: 1.655366 Oct 04 21:00:42.580040 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2505/5036] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:00:40 2022] GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc => generated 1518 bytes in 1671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:00:42.602777 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a4d9a52d-5f58-4129-bee5-2e592de3d480 tempest-ServersNegativeTestMultiTenantJSON-1428014836 tempest-ServersNegativeTestMultiTenantJSON-1428014836-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:00:42.603569 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a4d9a52d-5f58-4129-bee5-2e592de3d480 tempest-ServersNegativeTestMultiTenantJSON-1428014836 tempest-ServersNegativeTestMultiTenantJSON-1428014836-project] [instance: 0e2212f3-ad4e-4cb0-8dca-ca49144a1e94] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:00:42.610548 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a4d9a52d-5f58-4129-bee5-2e592de3d480 tempest-ServersNegativeTestMultiTenantJSON-1428014836 tempest-ServersNegativeTestMultiTenantJSON-1428014836-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:42.611767 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a4d9a52d-5f58-4129-bee5-2e592de3d480 tempest-ServersNegativeTestMultiTenantJSON-1428014836 tempest-ServersNegativeTestMultiTenantJSON-1428014836-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:42.612514 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a4d9a52d-5f58-4129-bee5-2e592de3d480 tempest-ServersNegativeTestMultiTenantJSON-1428014836 tempest-ServersNegativeTestMultiTenantJSON-1428014836-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:42.613541 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a4d9a52d-5f58-4129-bee5-2e592de3d480 tempest-ServersNegativeTestMultiTenantJSON-1428014836 tempest-ServersNegativeTestMultiTenantJSON-1428014836-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:42.614290 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a4d9a52d-5f58-4129-bee5-2e592de3d480 tempest-ServersNegativeTestMultiTenantJSON-1428014836 tempest-ServersNegativeTestMultiTenantJSON-1428014836-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:42.615059 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a4d9a52d-5f58-4129-bee5-2e592de3d480 tempest-ServersNegativeTestMultiTenantJSON-1428014836 tempest-ServersNegativeTestMultiTenantJSON-1428014836-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:43.037716 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-678bdd03-af36-4c9f-9942-d24081c02bb3 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5dbe3da6a4af181ef7302fe605fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3aa23aee3c8435c8f1f409019c5fed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:00:43.048613 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-678bdd03-af36-4c9f-9942-d24081c02bb3 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] 10.222.0.33 "GET /compute/v2.1/servers/243cbbbd-0734-4711-b605-c0657b81e359" status: 200 len: 1690 microversion: 2.1 time: 0.739189 Oct 04 21:00:43.054592 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2532/5037] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:00:42 2022] GET /compute/v2.1/servers/243cbbbd-0734-4711-b605-c0657b81e359 => generated 1690 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:00:43.225548 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-1b6bf2c6-406c-413c-a08e-41eba8e59826 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:00:43.226536 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-1b6bf2c6-406c-413c-a08e-41eba8e59826 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] [instance: b43cf252-2634-4a7d-9b8b-808e03acf885] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:00:43.253560 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1b6bf2c6-406c-413c-a08e-41eba8e59826 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:43.260228 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1b6bf2c6-406c-413c-a08e-41eba8e59826 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:43.260869 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1b6bf2c6-406c-413c-a08e-41eba8e59826 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:43.261745 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1b6bf2c6-406c-413c-a08e-41eba8e59826 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:43.264549 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1b6bf2c6-406c-413c-a08e-41eba8e59826 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:43.265151 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1b6bf2c6-406c-413c-a08e-41eba8e59826 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:43.419556 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-a4d9a52d-5f58-4129-bee5-2e592de3d480 tempest-ServersNegativeTestMultiTenantJSON-1428014836 tempest-ServersNegativeTestMultiTenantJSON-1428014836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dfed24a3a0144b0ac357f7e200b2155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf2a507fa3842e59a81c0967e25ae54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:00:43.430238 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a4d9a52d-5f58-4129-bee5-2e592de3d480 tempest-ServersNegativeTestMultiTenantJSON-1428014836 tempest-ServersNegativeTestMultiTenantJSON-1428014836-project] 10.222.0.33 "GET /compute/v2.1/servers/0e2212f3-ad4e-4cb0-8dca-ca49144a1e94" status: 200 len: 1327 microversion: 2.1 time: 0.837832 Oct 04 21:00:43.449904 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2506/5038] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:00:42 2022] GET /compute/v2.1/servers/0e2212f3-ad4e-4cb0-8dca-ca49144a1e94 => generated 1327 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:00:43.605378 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8428e06f-3988-4bf9-bc61-7afb6a56cc1d tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:00:43.606905 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-8428e06f-3988-4bf9-bc61-7afb6a56cc1d tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] [instance: 320f9a98-969f-473e-bc56-842bbd28dedc] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:00:43.622773 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:00:43.624283 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8428e06f-3988-4bf9-bc61-7afb6a56cc1d tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:43.624786 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8428e06f-3988-4bf9-bc61-7afb6a56cc1d tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:43.625404 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8428e06f-3988-4bf9-bc61-7afb6a56cc1d tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:43.641182 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8428e06f-3988-4bf9-bc61-7afb6a56cc1d tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:43.652969 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8428e06f-3988-4bf9-bc61-7afb6a56cc1d tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:43.653904 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8428e06f-3988-4bf9-bc61-7afb6a56cc1d tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:44.693986 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-1b6bf2c6-406c-413c-a08e-41eba8e59826 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea297d567a044fc9132f5d7d076f469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec4233f765546f997810e0e843ae184', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:00:44.731753 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-1b6bf2c6-406c-413c-a08e-41eba8e59826 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0ea297d567a044fc9132f5d7d076f469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec4233f765546f997810e0e843ae184', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:00:44.740132 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-1b6bf2c6-406c-413c-a08e-41eba8e59826 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0ea297d567a044fc9132f5d7d076f469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec4233f765546f997810e0e843ae184', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:00:44.741370 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-1b6bf2c6-406c-413c-a08e-41eba8e59826 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] 10.222.0.33 "GET /compute/v2.1/servers/b43cf252-2634-4a7d-9b8b-808e03acf885" status: 200 len: 1408 microversion: 2.54 time: 1.520471 Oct 04 21:00:44.741939 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2533/5039] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 21:00:43 2022] GET /compute/v2.1/servers/b43cf252-2634-4a7d-9b8b-808e03acf885 => generated 1408 bytes in 1522 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:00:44.759578 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-a319082a-164d-4a0c-946d-94bc109e2f95 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:00:44.760436 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-a319082a-164d-4a0c-946d-94bc109e2f95 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] [instance: 243cbbbd-0734-4711-b605-c0657b81e359] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:00:44.776462 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a319082a-164d-4a0c-946d-94bc109e2f95 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:44.777026 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a319082a-164d-4a0c-946d-94bc109e2f95 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:44.777525 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a319082a-164d-4a0c-946d-94bc109e2f95 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:44.778303 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a319082a-164d-4a0c-946d-94bc109e2f95 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:44.788609 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a319082a-164d-4a0c-946d-94bc109e2f95 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:44.790212 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a319082a-164d-4a0c-946d-94bc109e2f95 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:46.032601 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-a319082a-164d-4a0c-946d-94bc109e2f95 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5dbe3da6a4af181ef7302fe605fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3aa23aee3c8435c8f1f409019c5fed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:00:46.047288 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-a319082a-164d-4a0c-946d-94bc109e2f95 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] 10.222.0.33 "GET /compute/v2.1/servers/243cbbbd-0734-4711-b605-c0657b81e359" status: 200 len: 1690 microversion: 2.1 time: 1.304155 Oct 04 21:00:46.049727 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2534/5040] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:00:44 2022] GET /compute/v2.1/servers/243cbbbd-0734-4711-b605-c0657b81e359 => generated 1690 bytes in 1307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:00:46.058163 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-12401865-0ed5-4a79-ab91-d9e250247821 tempest-ServersNegativeTestMultiTenantJSON-1428014836 tempest-ServersNegativeTestMultiTenantJSON-1428014836-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:00:46.059258 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-12401865-0ed5-4a79-ab91-d9e250247821 tempest-ServersNegativeTestMultiTenantJSON-1428014836 tempest-ServersNegativeTestMultiTenantJSON-1428014836-project] [instance: 0e2212f3-ad4e-4cb0-8dca-ca49144a1e94] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:00:46.079834 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-12401865-0ed5-4a79-ab91-d9e250247821 tempest-ServersNegativeTestMultiTenantJSON-1428014836 tempest-ServersNegativeTestMultiTenantJSON-1428014836-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:46.080692 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-12401865-0ed5-4a79-ab91-d9e250247821 tempest-ServersNegativeTestMultiTenantJSON-1428014836 tempest-ServersNegativeTestMultiTenantJSON-1428014836-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:46.081358 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-12401865-0ed5-4a79-ab91-d9e250247821 tempest-ServersNegativeTestMultiTenantJSON-1428014836 tempest-ServersNegativeTestMultiTenantJSON-1428014836-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:46.082326 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-12401865-0ed5-4a79-ab91-d9e250247821 tempest-ServersNegativeTestMultiTenantJSON-1428014836 tempest-ServersNegativeTestMultiTenantJSON-1428014836-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:46.083104 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-12401865-0ed5-4a79-ab91-d9e250247821 tempest-ServersNegativeTestMultiTenantJSON-1428014836 tempest-ServersNegativeTestMultiTenantJSON-1428014836-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:46.083801 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-12401865-0ed5-4a79-ab91-d9e250247821 tempest-ServersNegativeTestMultiTenantJSON-1428014836 tempest-ServersNegativeTestMultiTenantJSON-1428014836-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:46.548787 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-8428e06f-3988-4bf9-bc61-7afb6a56cc1d tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6513f5e908ac4d028cad6eeeebeab285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65946afc398d4a9fb1c9095a4f946e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:00:46.562229 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-8428e06f-3988-4bf9-bc61-7afb6a56cc1d tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc" status: 200 len: 1518 microversion: 2.1 time: 2.959484 Oct 04 21:00:46.565132 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2507/5041] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:00:43 2022] GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc => generated 1518 bytes in 2964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:00:46.583486 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f653654e-6a0f-460d-8747-4297f0e64115 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:00:46.584544 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f653654e-6a0f-460d-8747-4297f0e64115 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] [instance: b43cf252-2634-4a7d-9b8b-808e03acf885] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:00:46.595410 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f653654e-6a0f-460d-8747-4297f0e64115 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:46.597697 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f653654e-6a0f-460d-8747-4297f0e64115 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:46.599971 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f653654e-6a0f-460d-8747-4297f0e64115 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:46.601675 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f653654e-6a0f-460d-8747-4297f0e64115 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:46.602494 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f653654e-6a0f-460d-8747-4297f0e64115 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:46.605323 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f653654e-6a0f-460d-8747-4297f0e64115 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:46.721409 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-12401865-0ed5-4a79-ab91-d9e250247821 tempest-ServersNegativeTestMultiTenantJSON-1428014836 tempest-ServersNegativeTestMultiTenantJSON-1428014836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dfed24a3a0144b0ac357f7e200b2155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf2a507fa3842e59a81c0967e25ae54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:00:46.735905 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-12401865-0ed5-4a79-ab91-d9e250247821 tempest-ServersNegativeTestMultiTenantJSON-1428014836 tempest-ServersNegativeTestMultiTenantJSON-1428014836-project] 10.222.0.33 "GET /compute/v2.1/servers/0e2212f3-ad4e-4cb0-8dca-ca49144a1e94" status: 200 len: 1525 microversion: 2.1 time: 0.681984 Oct 04 21:00:46.741781 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2535/5042] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:00:46 2022] GET /compute/v2.1/servers/0e2212f3-ad4e-4cb0-8dca-ca49144a1e94 => generated 1525 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:00:46.765597 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-ba548502-2d15-4603-9049-fb0e40c0611b tempest-ServersNegativeTestMultiTenantJSON-1428014836 tempest-ServersNegativeTestMultiTenantJSON-1428014836-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:00:46.766304 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-ba548502-2d15-4603-9049-fb0e40c0611b tempest-ServersNegativeTestMultiTenantJSON-1428014836 tempest-ServersNegativeTestMultiTenantJSON-1428014836-project] [instance: 0e2212f3-ad4e-4cb0-8dca-ca49144a1e94] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:00:46.766781 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f653654e-6a0f-460d-8747-4297f0e64115 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea297d567a044fc9132f5d7d076f469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec4233f765546f997810e0e843ae184', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:00:46.774196 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ba548502-2d15-4603-9049-fb0e40c0611b tempest-ServersNegativeTestMultiTenantJSON-1428014836 tempest-ServersNegativeTestMultiTenantJSON-1428014836-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:46.774721 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ba548502-2d15-4603-9049-fb0e40c0611b tempest-ServersNegativeTestMultiTenantJSON-1428014836 tempest-ServersNegativeTestMultiTenantJSON-1428014836-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:46.775162 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ba548502-2d15-4603-9049-fb0e40c0611b tempest-ServersNegativeTestMultiTenantJSON-1428014836 tempest-ServersNegativeTestMultiTenantJSON-1428014836-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:46.775899 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ba548502-2d15-4603-9049-fb0e40c0611b tempest-ServersNegativeTestMultiTenantJSON-1428014836 tempest-ServersNegativeTestMultiTenantJSON-1428014836-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:46.776351 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ba548502-2d15-4603-9049-fb0e40c0611b tempest-ServersNegativeTestMultiTenantJSON-1428014836 tempest-ServersNegativeTestMultiTenantJSON-1428014836-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:46.776778 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ba548502-2d15-4603-9049-fb0e40c0611b tempest-ServersNegativeTestMultiTenantJSON-1428014836 tempest-ServersNegativeTestMultiTenantJSON-1428014836-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:46.778542 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f653654e-6a0f-460d-8747-4297f0e64115 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0ea297d567a044fc9132f5d7d076f469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec4233f765546f997810e0e843ae184', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:00:46.791296 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f653654e-6a0f-460d-8747-4297f0e64115 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0ea297d567a044fc9132f5d7d076f469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec4233f765546f997810e0e843ae184', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:00:46.794577 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f653654e-6a0f-460d-8747-4297f0e64115 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] 10.222.0.33 "GET /compute/v2.1/servers/b43cf252-2634-4a7d-9b8b-808e03acf885" status: 200 len: 1408 microversion: 2.54 time: 0.228105 Oct 04 21:00:46.805387 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2508/5043] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 21:00:46 2022] GET /compute/v2.1/servers/b43cf252-2634-4a7d-9b8b-808e03acf885 => generated 1408 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:00:47.089606 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-bd4e1226-3c89-4f20-89d4-c1452b525711 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:00:47.089606 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-bd4e1226-3c89-4f20-89d4-c1452b525711 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] [instance: 243cbbbd-0734-4711-b605-c0657b81e359] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:00:47.109716 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bd4e1226-3c89-4f20-89d4-c1452b525711 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:47.114836 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bd4e1226-3c89-4f20-89d4-c1452b525711 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:47.115327 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bd4e1226-3c89-4f20-89d4-c1452b525711 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:47.116212 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bd4e1226-3c89-4f20-89d4-c1452b525711 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:47.116773 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bd4e1226-3c89-4f20-89d4-c1452b525711 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:47.117285 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bd4e1226-3c89-4f20-89d4-c1452b525711 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:47.504585 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-ba548502-2d15-4603-9049-fb0e40c0611b tempest-ServersNegativeTestMultiTenantJSON-1428014836 tempest-ServersNegativeTestMultiTenantJSON-1428014836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dfed24a3a0144b0ac357f7e200b2155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf2a507fa3842e59a81c0967e25ae54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:00:47.535448 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-ba548502-2d15-4603-9049-fb0e40c0611b tempest-ServersNegativeTestMultiTenantJSON-1428014836 tempest-ServersNegativeTestMultiTenantJSON-1428014836-project] 10.222.0.33 "GET /compute/v2.1/servers/0e2212f3-ad4e-4cb0-8dca-ca49144a1e94" status: 200 len: 1525 microversion: 2.1 time: 0.773764 Oct 04 21:00:47.556621 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2536/5044] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:00:46 2022] GET /compute/v2.1/servers/0e2212f3-ad4e-4cb0-8dca-ca49144a1e94 => generated 1525 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:00:47.612692 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-bd4e1226-3c89-4f20-89d4-c1452b525711 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5dbe3da6a4af181ef7302fe605fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3aa23aee3c8435c8f1f409019c5fed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:00:47.625045 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-bd4e1226-3c89-4f20-89d4-c1452b525711 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] 10.222.0.33 "GET /compute/v2.1/servers/243cbbbd-0734-4711-b605-c0657b81e359" status: 200 len: 1695 microversion: 2.1 time: 0.550184 Oct 04 21:00:47.629351 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2509/5045] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:00:47 2022] GET /compute/v2.1/servers/243cbbbd-0734-4711-b605-c0657b81e359 => generated 1695 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:00:47.636486 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6be01c3c-b7e9-44f6-bd26-4d66aa482408 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:00:47.637509 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-6be01c3c-b7e9-44f6-bd26-4d66aa482408 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] [instance: 320f9a98-969f-473e-bc56-842bbd28dedc] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:00:47.648153 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6be01c3c-b7e9-44f6-bd26-4d66aa482408 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:47.660507 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6be01c3c-b7e9-44f6-bd26-4d66aa482408 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:47.664687 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6be01c3c-b7e9-44f6-bd26-4d66aa482408 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:47.668869 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6be01c3c-b7e9-44f6-bd26-4d66aa482408 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:47.672203 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6be01c3c-b7e9-44f6-bd26-4d66aa482408 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:47.676413 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6be01c3c-b7e9-44f6-bd26-4d66aa482408 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:48.490669 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-6be01c3c-b7e9-44f6-bd26-4d66aa482408 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6513f5e908ac4d028cad6eeeebeab285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65946afc398d4a9fb1c9095a4f946e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:00:48.504799 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-6be01c3c-b7e9-44f6-bd26-4d66aa482408 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc" status: 200 len: 1518 microversion: 2.1 time: 0.874020 Oct 04 21:00:48.524760 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2510/5046] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:00:47 2022] GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc => generated 1518 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:00:48.536171 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c7744c6a-4430-4ff8-8c41-8698546d14b9 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:00:48.537735 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c7744c6a-4430-4ff8-8c41-8698546d14b9 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] [instance: b43cf252-2634-4a7d-9b8b-808e03acf885] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:00:48.556052 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c7744c6a-4430-4ff8-8c41-8698546d14b9 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:48.556259 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c7744c6a-4430-4ff8-8c41-8698546d14b9 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:48.556674 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c7744c6a-4430-4ff8-8c41-8698546d14b9 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:48.557489 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c7744c6a-4430-4ff8-8c41-8698546d14b9 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:48.557960 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c7744c6a-4430-4ff8-8c41-8698546d14b9 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:48.558414 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c7744c6a-4430-4ff8-8c41-8698546d14b9 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:48.714993 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c7744c6a-4430-4ff8-8c41-8698546d14b9 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea297d567a044fc9132f5d7d076f469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec4233f765546f997810e0e843ae184', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:00:48.744902 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c7744c6a-4430-4ff8-8c41-8698546d14b9 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0ea297d567a044fc9132f5d7d076f469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec4233f765546f997810e0e843ae184', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:00:48.751476 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c7744c6a-4430-4ff8-8c41-8698546d14b9 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0ea297d567a044fc9132f5d7d076f469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec4233f765546f997810e0e843ae184', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:00:48.761218 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c7744c6a-4430-4ff8-8c41-8698546d14b9 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] 10.222.0.33 "GET /compute/v2.1/servers/b43cf252-2634-4a7d-9b8b-808e03acf885" status: 200 len: 1408 microversion: 2.54 time: 0.234134 Oct 04 21:00:48.765204 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2511/5047] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 21:00:48 2022] GET /compute/v2.1/servers/b43cf252-2634-4a7d-9b8b-808e03acf885 => generated 1408 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:00:48.780373 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-ffd985fe-a884-4adc-a4b5-ffdcd09aa32b tempest-ServersNegativeTestMultiTenantJSON-1412698807 tempest-ServersNegativeTestMultiTenantJSON-1412698807-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:00:48.781473 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-ffd985fe-a884-4adc-a4b5-ffdcd09aa32b tempest-ServersNegativeTestMultiTenantJSON-1412698807 tempest-ServersNegativeTestMultiTenantJSON-1412698807-project] [instance: 0e2212f3-ad4e-4cb0-8dca-ca49144a1e94] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:00:48.796890 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-34dfc754-b561-4d95-985e-f2e5d49798a8 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:00:48.809852 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-34dfc754-b561-4d95-985e-f2e5d49798a8 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] [instance: 243cbbbd-0734-4711-b605-c0657b81e359] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:00:48.809936 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ffd985fe-a884-4adc-a4b5-ffdcd09aa32b tempest-ServersNegativeTestMultiTenantJSON-1412698807 tempest-ServersNegativeTestMultiTenantJSON-1412698807-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:48.815168 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ffd985fe-a884-4adc-a4b5-ffdcd09aa32b tempest-ServersNegativeTestMultiTenantJSON-1412698807 tempest-ServersNegativeTestMultiTenantJSON-1412698807-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:48.819185 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ffd985fe-a884-4adc-a4b5-ffdcd09aa32b tempest-ServersNegativeTestMultiTenantJSON-1412698807 tempest-ServersNegativeTestMultiTenantJSON-1412698807-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:48.823772 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ffd985fe-a884-4adc-a4b5-ffdcd09aa32b tempest-ServersNegativeTestMultiTenantJSON-1412698807 tempest-ServersNegativeTestMultiTenantJSON-1412698807-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:48.824745 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ffd985fe-a884-4adc-a4b5-ffdcd09aa32b tempest-ServersNegativeTestMultiTenantJSON-1412698807 tempest-ServersNegativeTestMultiTenantJSON-1412698807-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:48.826104 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ffd985fe-a884-4adc-a4b5-ffdcd09aa32b tempest-ServersNegativeTestMultiTenantJSON-1412698807 tempest-ServersNegativeTestMultiTenantJSON-1412698807-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:48.834001 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-34dfc754-b561-4d95-985e-f2e5d49798a8 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:48.836145 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-34dfc754-b561-4d95-985e-f2e5d49798a8 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:48.839162 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-34dfc754-b561-4d95-985e-f2e5d49798a8 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:48.845298 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-34dfc754-b561-4d95-985e-f2e5d49798a8 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:48.847706 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-34dfc754-b561-4d95-985e-f2e5d49798a8 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:48.850209 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-34dfc754-b561-4d95-985e-f2e5d49798a8 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:48.885101 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.wsgi [None req-ffd985fe-a884-4adc-a4b5-ffdcd09aa32b tempest-ServersNegativeTestMultiTenantJSON-1412698807 tempest-ServersNegativeTestMultiTenantJSON-1412698807-project] HTTP exception thrown: Instance 0e2212f3-ad4e-4cb0-8dca-ca49144a1e94 could not be found. Oct 04 21:00:48.893449 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-ffd985fe-a884-4adc-a4b5-ffdcd09aa32b tempest-ServersNegativeTestMultiTenantJSON-1412698807 tempest-ServersNegativeTestMultiTenantJSON-1412698807-project] Request method failure captured: Oct 04 21:00:48.893449 n-d-854823-8 devstack@n-api.service[128802]: request: DELETE /compute/v2.1/servers/0e2212f3-ad4e-4cb0-8dca-ca49144a1e94 HTTP/1.1 Oct 04 21:00:48.893449 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 21:00:48.893449 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 21:00:48.893449 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 21:00:48.893449 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 0 Oct 04 21:00:48.893449 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 21:00:48.893449 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 21:00:48.893449 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 21:00:48.893449 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 21:00:48.893449 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPJ7jwZ0fD4ZrwdRVFkzBKtY88QdLyZlszRZlzBEMZHSAA_n7_KhGhgVusw3GXRHQnzNcNmcWTMXM-6srrc3mrpESpiwlSX_rqKjcUdStY18y7m0Oq0Hl1wdX2TiAmfccH93WYl0z61zkBmASNU3A2lFx8SmadGzAWXPMeuQPwA7r7tw Oct 04 21:00:48.893449 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 21:00:48.893449 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 21:00:48.893449 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 21:00:48.893449 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 21:00:48.893449 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 21:00:48.893449 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 21:00:48.893449 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: c50526506475441bb7dbe36f456751e0 Oct 04 21:00:48.893449 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1412698807 Oct 04 21:00:48.893449 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 21:00:48.893449 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 21:00:48.893449 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_c50526506475441bb7dbe36f456751e0", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c50526506475441bb7dbe36f456751e0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c50526506475441bb7dbe36f456751e0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/c50526506475441bb7dbe36f456751e0"}]}] Oct 04 21:00:48.893449 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1412698807 Oct 04 21:00:48.893449 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: c50526506475441bb7dbe36f456751e0 Oct 04 21:00:48.893449 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1412698807 Oct 04 21:00:48.893449 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1412698807-project Oct 04 21:00:48.893449 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 21:00:48.893449 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 21:00:48.893449 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: c626ab487e594219b134434680af4570 Oct 04 21:00:48.893449 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1412698807-project Oct 04 21:00:48.893449 n-d-854823-8 devstack@n-api.service[128802]: method: > Oct 04 21:00:48.893449 n-d-854823-8 devstack@n-api.service[128802]: exception: Instance 0e2212f3-ad4e-4cb0-8dca-ca49144a1e94 could not be found. Oct 04 21:00:48.893449 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'id': '0e2212f3-ad4e-4cb0-8dca-ca49144a1e94'} Oct 04 21:00:48.893449 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:00:48.893449 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:00:48.893449 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:00:48.893449 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:00:48.893449 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:00:48.893449 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:00:48.893449 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:00:48.893449 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:00:48.893449 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:00:48.893449 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:00:48.893449 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e2212f3-ad4e-4cb0-8dca-ca49144a1e94 could not be found. Oct 04 21:00:48.893449 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:00:48.893449 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:00:48.893449 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:00:48.893449 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:00:48.893449 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:00:48.893449 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:00:48.893449 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:00:48.893449 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:00:48.893449 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:00:48.893449 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:00:48.893449 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 21:00:48.893449 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 21:00:48.893449 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 21:00:48.893449 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 21:00:48.893449 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:00:48.893449 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:00:48.893449 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:00:48.893449 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:00:48.897146 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e2212f3-ad4e-4cb0-8dca-ca49144a1e94 could not be found. Oct 04 21:00:48.897146 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:00:48.897146 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:00:48.897146 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:00:48.897146 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:00:48.897146 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:00:48.897146 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:00:48.897146 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:00:48.897146 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:00:48.897146 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e2212f3-ad4e-4cb0-8dca-ca49144a1e94 could not be found. Oct 04 21:00:48.897146 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:00:48.899851 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-ffd985fe-a884-4adc-a4b5-ffdcd09aa32b tempest-ServersNegativeTestMultiTenantJSON-1412698807 tempest-ServersNegativeTestMultiTenantJSON-1412698807-project] Returning 404 to user: Instance 0e2212f3-ad4e-4cb0-8dca-ca49144a1e94 could not be found. {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:00:48.903717 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-ffd985fe-a884-4adc-a4b5-ffdcd09aa32b tempest-ServersNegativeTestMultiTenantJSON-1412698807 tempest-ServersNegativeTestMultiTenantJSON-1412698807-project] 10.222.0.33 "DELETE /compute/v2.1/servers/0e2212f3-ad4e-4cb0-8dca-ca49144a1e94" status: 404 len: 111 microversion: 2.1 time: 1.336213 Oct 04 21:00:48.916287 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2537/5048] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 21:00:47 2022] DELETE /compute/v2.1/servers/0e2212f3-ad4e-4cb0-8dca-ca49144a1e94 => generated 111 bytes in 1349 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:00:48.932696 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-f537e89e-1f1e-4676-83ff-37e1753834cb tempest-ServersNegativeTestMultiTenantJSON-1428014836 tempest-ServersNegativeTestMultiTenantJSON-1428014836-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:00:48.933493 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-f537e89e-1f1e-4676-83ff-37e1753834cb tempest-ServersNegativeTestMultiTenantJSON-1428014836 tempest-ServersNegativeTestMultiTenantJSON-1428014836-project] [instance: 0e2212f3-ad4e-4cb0-8dca-ca49144a1e94] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:00:48.940940 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f537e89e-1f1e-4676-83ff-37e1753834cb tempest-ServersNegativeTestMultiTenantJSON-1428014836 tempest-ServersNegativeTestMultiTenantJSON-1428014836-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:48.941832 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f537e89e-1f1e-4676-83ff-37e1753834cb tempest-ServersNegativeTestMultiTenantJSON-1428014836 tempest-ServersNegativeTestMultiTenantJSON-1428014836-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:48.943149 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f537e89e-1f1e-4676-83ff-37e1753834cb tempest-ServersNegativeTestMultiTenantJSON-1428014836 tempest-ServersNegativeTestMultiTenantJSON-1428014836-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:48.944053 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f537e89e-1f1e-4676-83ff-37e1753834cb tempest-ServersNegativeTestMultiTenantJSON-1428014836 tempest-ServersNegativeTestMultiTenantJSON-1428014836-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:48.944735 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f537e89e-1f1e-4676-83ff-37e1753834cb tempest-ServersNegativeTestMultiTenantJSON-1428014836 tempest-ServersNegativeTestMultiTenantJSON-1428014836-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:48.945334 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f537e89e-1f1e-4676-83ff-37e1753834cb tempest-ServersNegativeTestMultiTenantJSON-1428014836 tempest-ServersNegativeTestMultiTenantJSON-1428014836-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:49.871619 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-f537e89e-1f1e-4676-83ff-37e1753834cb tempest-ServersNegativeTestMultiTenantJSON-1428014836 tempest-ServersNegativeTestMultiTenantJSON-1428014836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dfed24a3a0144b0ac357f7e200b2155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf2a507fa3842e59a81c0967e25ae54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:00:49.884842 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-f537e89e-1f1e-4676-83ff-37e1753834cb tempest-ServersNegativeTestMultiTenantJSON-1428014836 tempest-ServersNegativeTestMultiTenantJSON-1428014836-project] 10.222.0.33 "GET /compute/v2.1/servers/0e2212f3-ad4e-4cb0-8dca-ca49144a1e94" status: 200 len: 1525 microversion: 2.1 time: 0.967053 Oct 04 21:00:49.908089 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2538/5049] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:00:48 2022] GET /compute/v2.1/servers/0e2212f3-ad4e-4cb0-8dca-ca49144a1e94 => generated 1525 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:00:49.919285 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-a7db29e0-dcdd-4f54-8789-8727716f5396 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:00:49.919909 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-a7db29e0-dcdd-4f54-8789-8727716f5396 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] [instance: 320f9a98-969f-473e-bc56-842bbd28dedc] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:00:49.936762 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a7db29e0-dcdd-4f54-8789-8727716f5396 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:49.937272 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a7db29e0-dcdd-4f54-8789-8727716f5396 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:49.937720 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a7db29e0-dcdd-4f54-8789-8727716f5396 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:49.939603 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a7db29e0-dcdd-4f54-8789-8727716f5396 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:49.939778 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a7db29e0-dcdd-4f54-8789-8727716f5396 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:49.940270 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a7db29e0-dcdd-4f54-8789-8727716f5396 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:49.979717 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-34dfc754-b561-4d95-985e-f2e5d49798a8 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5dbe3da6a4af181ef7302fe605fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3aa23aee3c8435c8f1f409019c5fed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:00:49.988226 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-34dfc754-b561-4d95-985e-f2e5d49798a8 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] 10.222.0.33 "GET /compute/v2.1/servers/243cbbbd-0734-4711-b605-c0657b81e359" status: 200 len: 1695 microversion: 2.1 time: 1.221768 Oct 04 21:00:49.998289 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2512/5050] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:00:48 2022] GET /compute/v2.1/servers/243cbbbd-0734-4711-b605-c0657b81e359 => generated 1695 bytes in 1232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:00:50.022508 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-78243076-bfb6-4807-a525-3e18fe2e8159 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:00:50.024367 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-78243076-bfb6-4807-a525-3e18fe2e8159 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] [instance: b43cf252-2634-4a7d-9b8b-808e03acf885] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:00:50.059508 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-78243076-bfb6-4807-a525-3e18fe2e8159 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:50.060314 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-78243076-bfb6-4807-a525-3e18fe2e8159 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:50.065265 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-78243076-bfb6-4807-a525-3e18fe2e8159 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:50.066475 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-78243076-bfb6-4807-a525-3e18fe2e8159 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:50.072090 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-78243076-bfb6-4807-a525-3e18fe2e8159 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:50.073942 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-78243076-bfb6-4807-a525-3e18fe2e8159 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:50.352633 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-78243076-bfb6-4807-a525-3e18fe2e8159 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea297d567a044fc9132f5d7d076f469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec4233f765546f997810e0e843ae184', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:00:50.374727 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-78243076-bfb6-4807-a525-3e18fe2e8159 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0ea297d567a044fc9132f5d7d076f469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec4233f765546f997810e0e843ae184', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:00:50.379739 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-78243076-bfb6-4807-a525-3e18fe2e8159 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0ea297d567a044fc9132f5d7d076f469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec4233f765546f997810e0e843ae184', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:00:50.383755 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-78243076-bfb6-4807-a525-3e18fe2e8159 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] 10.222.0.33 "GET /compute/v2.1/servers/b43cf252-2634-4a7d-9b8b-808e03acf885" status: 200 len: 1408 microversion: 2.54 time: 0.383453 Oct 04 21:00:50.385404 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2513/5051] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 21:00:49 2022] GET /compute/v2.1/servers/b43cf252-2634-4a7d-9b8b-808e03acf885 => generated 1408 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:00:50.398310 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-81bf52dc-9e0f-40c5-b00e-a8326d330de7 tempest-ServersNegativeTestMultiTenantJSON-1412698807 tempest-ServersNegativeTestMultiTenantJSON-1412698807-project] Action: 'update', calling method: >, body: {"server": {"name": "0e2212f3-ad4e-4cb0-8dca-ca49144a1e94_new"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:00:50.404300 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-81bf52dc-9e0f-40c5-b00e-a8326d330de7 tempest-ServersNegativeTestMultiTenantJSON-1412698807 tempest-ServersNegativeTestMultiTenantJSON-1412698807-project] [instance: 0e2212f3-ad4e-4cb0-8dca-ca49144a1e94] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:00:50.422779 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-81bf52dc-9e0f-40c5-b00e-a8326d330de7 tempest-ServersNegativeTestMultiTenantJSON-1412698807 tempest-ServersNegativeTestMultiTenantJSON-1412698807-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:50.429771 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-81bf52dc-9e0f-40c5-b00e-a8326d330de7 tempest-ServersNegativeTestMultiTenantJSON-1412698807 tempest-ServersNegativeTestMultiTenantJSON-1412698807-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:50.430547 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-81bf52dc-9e0f-40c5-b00e-a8326d330de7 tempest-ServersNegativeTestMultiTenantJSON-1412698807 tempest-ServersNegativeTestMultiTenantJSON-1412698807-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:50.433730 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-81bf52dc-9e0f-40c5-b00e-a8326d330de7 tempest-ServersNegativeTestMultiTenantJSON-1412698807 tempest-ServersNegativeTestMultiTenantJSON-1412698807-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:50.435321 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-81bf52dc-9e0f-40c5-b00e-a8326d330de7 tempest-ServersNegativeTestMultiTenantJSON-1412698807 tempest-ServersNegativeTestMultiTenantJSON-1412698807-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:50.435971 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-81bf52dc-9e0f-40c5-b00e-a8326d330de7 tempest-ServersNegativeTestMultiTenantJSON-1412698807 tempest-ServersNegativeTestMultiTenantJSON-1412698807-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:50.470543 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-81bf52dc-9e0f-40c5-b00e-a8326d330de7 tempest-ServersNegativeTestMultiTenantJSON-1412698807 tempest-ServersNegativeTestMultiTenantJSON-1412698807-project] HTTP exception thrown: Instance 0e2212f3-ad4e-4cb0-8dca-ca49144a1e94 could not be found. Oct 04 21:00:50.473038 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-81bf52dc-9e0f-40c5-b00e-a8326d330de7 tempest-ServersNegativeTestMultiTenantJSON-1412698807 tempest-ServersNegativeTestMultiTenantJSON-1412698807-project] Request method failure captured: Oct 04 21:00:50.473038 n-d-854823-8 devstack@n-api.service[128801]: request: PUT /compute/v2.1/servers/0e2212f3-ad4e-4cb0-8dca-ca49144a1e94 HTTP/1.1 Oct 04 21:00:50.473038 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 21:00:50.473038 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 21:00:50.473038 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 21:00:50.473038 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 64 Oct 04 21:00:50.473038 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 21:00:50.473038 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 21:00:50.473038 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 21:00:50.473038 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 21:00:50.473038 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJ7jwZ0fD4ZrwdRVFkzBKtY88QdLyZlszRZlzBEMZHSAA_n7_KhGhgVusw3GXRHQnzNcNmcWTMXM-6srrc3mrpESpiwlSX_rqKjcUdStY18y7m0Oq0Hl1wdX2TiAmfccH93WYl0z61zkBmASNU3A2lFx8SmadGzAWXPMeuQPwA7r7tw Oct 04 21:00:50.473038 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 21:00:50.473038 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 21:00:50.473038 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 21:00:50.473038 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 21:00:50.473038 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 21:00:50.473038 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 21:00:50.473038 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: c50526506475441bb7dbe36f456751e0 Oct 04 21:00:50.473038 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1412698807 Oct 04 21:00:50.473038 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 21:00:50.473038 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 21:00:50.473038 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_c50526506475441bb7dbe36f456751e0", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c50526506475441bb7dbe36f456751e0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c50526506475441bb7dbe36f456751e0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/c50526506475441bb7dbe36f456751e0"}]}] Oct 04 21:00:50.473038 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1412698807 Oct 04 21:00:50.473038 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: c50526506475441bb7dbe36f456751e0 Oct 04 21:00:50.473038 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1412698807 Oct 04 21:00:50.473038 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1412698807-project Oct 04 21:00:50.473038 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 21:00:50.473038 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 21:00:50.473038 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: c626ab487e594219b134434680af4570 Oct 04 21:00:50.473038 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1412698807-project Oct 04 21:00:50.473038 n-d-854823-8 devstack@n-api.service[128801]: Oct 04 21:00:50.473038 n-d-854823-8 devstack@n-api.service[128801]: {"server": {"name": "0e2212f3-ad4e-4cb0-8dca-ca49144a1e94_new"}} Oct 04 21:00:50.473038 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 21:00:50.473038 n-d-854823-8 devstack@n-api.service[128801]: exception: Instance 0e2212f3-ad4e-4cb0-8dca-ca49144a1e94 could not be found. Oct 04 21:00:50.473038 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': '0e2212f3-ad4e-4cb0-8dca-ca49144a1e94', 'body': {'server': {'name': '0e2212f3-ad4e-4cb0-8dca-ca49144a1e94_new'}}} Oct 04 21:00:50.473038 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:00:50.473038 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:00:50.473038 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:00:50.473038 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:00:50.473038 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:00:50.473038 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:00:50.473038 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:00:50.473038 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:00:50.473038 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:00:50.473038 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:00:50.473038 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e2212f3-ad4e-4cb0-8dca-ca49144a1e94 could not be found. Oct 04 21:00:50.473038 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:00:50.473038 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:00:50.473038 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:00:50.473038 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:00:50.473038 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:00:50.473038 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:00:50.473038 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:00:50.473038 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:00:50.473038 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:00:50.473038 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:00:50.473038 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:00:50.473038 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:00:50.473038 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:00:50.473038 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:00:50.473038 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:00:50.473038 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:00:50.473038 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 04 21:00:50.477124 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Oct 04 21:00:50.477124 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Oct 04 21:00:50.477124 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:00:50.477124 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:00:50.477124 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:00:50.477124 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:00:50.477124 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e2212f3-ad4e-4cb0-8dca-ca49144a1e94 could not be found. Oct 04 21:00:50.477124 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:00:50.477124 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:00:50.477124 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:00:50.477124 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:00:50.477124 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:00:50.477124 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:00:50.477124 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:00:50.477124 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:00:50.477124 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e2212f3-ad4e-4cb0-8dca-ca49144a1e94 could not be found. Oct 04 21:00:50.477124 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:00:50.477124 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-81bf52dc-9e0f-40c5-b00e-a8326d330de7 tempest-ServersNegativeTestMultiTenantJSON-1412698807 tempest-ServersNegativeTestMultiTenantJSON-1412698807-project] Returning 404 to user: Instance 0e2212f3-ad4e-4cb0-8dca-ca49144a1e94 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:00:50.477124 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-81bf52dc-9e0f-40c5-b00e-a8326d330de7 tempest-ServersNegativeTestMultiTenantJSON-1412698807 tempest-ServersNegativeTestMultiTenantJSON-1412698807-project] 10.222.0.33 "PUT /compute/v2.1/servers/0e2212f3-ad4e-4cb0-8dca-ca49144a1e94" status: 404 len: 111 microversion: 2.1 time: 0.086540 Oct 04 21:00:50.477124 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2514/5052] 10.222.0.33 () {60 vars in 1256 bytes} [Tue Oct 4 21:00:50 2022] PUT /compute/v2.1/servers/0e2212f3-ad4e-4cb0-8dca-ca49144a1e94 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:00:50.493798 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2b548230-1a59-4e8b-bfa8-4165a46e4321 tempest-ServersNegativeTestMultiTenantJSON-1428014836 tempest-ServersNegativeTestMultiTenantJSON-1428014836-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:00:50.494597 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-2b548230-1a59-4e8b-bfa8-4165a46e4321 tempest-ServersNegativeTestMultiTenantJSON-1428014836 tempest-ServersNegativeTestMultiTenantJSON-1428014836-project] [instance: 0e2212f3-ad4e-4cb0-8dca-ca49144a1e94] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:00:50.506330 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2b548230-1a59-4e8b-bfa8-4165a46e4321 tempest-ServersNegativeTestMultiTenantJSON-1428014836 tempest-ServersNegativeTestMultiTenantJSON-1428014836-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:50.507346 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2b548230-1a59-4e8b-bfa8-4165a46e4321 tempest-ServersNegativeTestMultiTenantJSON-1428014836 tempest-ServersNegativeTestMultiTenantJSON-1428014836-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:50.508321 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2b548230-1a59-4e8b-bfa8-4165a46e4321 tempest-ServersNegativeTestMultiTenantJSON-1428014836 tempest-ServersNegativeTestMultiTenantJSON-1428014836-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:50.510944 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2b548230-1a59-4e8b-bfa8-4165a46e4321 tempest-ServersNegativeTestMultiTenantJSON-1428014836 tempest-ServersNegativeTestMultiTenantJSON-1428014836-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:50.511741 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2b548230-1a59-4e8b-bfa8-4165a46e4321 tempest-ServersNegativeTestMultiTenantJSON-1428014836 tempest-ServersNegativeTestMultiTenantJSON-1428014836-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:50.512618 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2b548230-1a59-4e8b-bfa8-4165a46e4321 tempest-ServersNegativeTestMultiTenantJSON-1428014836 tempest-ServersNegativeTestMultiTenantJSON-1428014836-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:50.564079 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-2b548230-1a59-4e8b-bfa8-4165a46e4321 tempest-ServersNegativeTestMultiTenantJSON-1428014836 tempest-ServersNegativeTestMultiTenantJSON-1428014836-project] [instance: 0e2212f3-ad4e-4cb0-8dca-ca49144a1e94] Going to try to terminate instance {{(pid=128801) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:00:50.822589 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-2b548230-1a59-4e8b-bfa8-4165a46e4321 tempest-ServersNegativeTestMultiTenantJSON-1428014836 tempest-ServersNegativeTestMultiTenantJSON-1428014836-project] 10.222.0.33 "DELETE /compute/v2.1/servers/0e2212f3-ad4e-4cb0-8dca-ca49144a1e94" status: 204 len: 0 microversion: 2.1 time: 0.340557 Oct 04 21:00:50.827981 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2515/5053] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 21:00:50 2022] DELETE /compute/v2.1/servers/0e2212f3-ad4e-4cb0-8dca-ca49144a1e94 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:00:50.842173 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9a144d5c-230b-4d7c-a1a0-ddfe94c21e53 tempest-ServersNegativeTestMultiTenantJSON-1428014836 tempest-ServersNegativeTestMultiTenantJSON-1428014836-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:00:50.845539 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-9a144d5c-230b-4d7c-a1a0-ddfe94c21e53 tempest-ServersNegativeTestMultiTenantJSON-1428014836 tempest-ServersNegativeTestMultiTenantJSON-1428014836-project] [instance: 0e2212f3-ad4e-4cb0-8dca-ca49144a1e94] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:00:50.859655 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9a144d5c-230b-4d7c-a1a0-ddfe94c21e53 tempest-ServersNegativeTestMultiTenantJSON-1428014836 tempest-ServersNegativeTestMultiTenantJSON-1428014836-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:50.860926 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9a144d5c-230b-4d7c-a1a0-ddfe94c21e53 tempest-ServersNegativeTestMultiTenantJSON-1428014836 tempest-ServersNegativeTestMultiTenantJSON-1428014836-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:50.861520 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9a144d5c-230b-4d7c-a1a0-ddfe94c21e53 tempest-ServersNegativeTestMultiTenantJSON-1428014836 tempest-ServersNegativeTestMultiTenantJSON-1428014836-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:50.865592 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9a144d5c-230b-4d7c-a1a0-ddfe94c21e53 tempest-ServersNegativeTestMultiTenantJSON-1428014836 tempest-ServersNegativeTestMultiTenantJSON-1428014836-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:50.866100 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9a144d5c-230b-4d7c-a1a0-ddfe94c21e53 tempest-ServersNegativeTestMultiTenantJSON-1428014836 tempest-ServersNegativeTestMultiTenantJSON-1428014836-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:50.870645 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9a144d5c-230b-4d7c-a1a0-ddfe94c21e53 tempest-ServersNegativeTestMultiTenantJSON-1428014836 tempest-ServersNegativeTestMultiTenantJSON-1428014836-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:51.473484 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-a7db29e0-dcdd-4f54-8789-8727716f5396 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6513f5e908ac4d028cad6eeeebeab285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65946afc398d4a9fb1c9095a4f946e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:00:51.483440 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-a7db29e0-dcdd-4f54-8789-8727716f5396 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc" status: 200 len: 1518 microversion: 2.1 time: 1.573789 Oct 04 21:00:51.485634 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2539/5054] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:00:49 2022] GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc => generated 1518 bytes in 1577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:00:51.506572 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-c46bfe01-9ac5-4042-89ba-98b232dcd070 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:00:51.508828 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-c46bfe01-9ac5-4042-89ba-98b232dcd070 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] [instance: 243cbbbd-0734-4711-b605-c0657b81e359] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:00:51.526628 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:00:51.528283 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c46bfe01-9ac5-4042-89ba-98b232dcd070 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:51.529017 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c46bfe01-9ac5-4042-89ba-98b232dcd070 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:51.530108 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c46bfe01-9ac5-4042-89ba-98b232dcd070 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:51.531192 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c46bfe01-9ac5-4042-89ba-98b232dcd070 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:51.532855 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c46bfe01-9ac5-4042-89ba-98b232dcd070 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:51.533526 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c46bfe01-9ac5-4042-89ba-98b232dcd070 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:52.012287 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-9a144d5c-230b-4d7c-a1a0-ddfe94c21e53 tempest-ServersNegativeTestMultiTenantJSON-1428014836 tempest-ServersNegativeTestMultiTenantJSON-1428014836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dfed24a3a0144b0ac357f7e200b2155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf2a507fa3842e59a81c0967e25ae54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:00:52.030634 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-9a144d5c-230b-4d7c-a1a0-ddfe94c21e53 tempest-ServersNegativeTestMultiTenantJSON-1428014836 tempest-ServersNegativeTestMultiTenantJSON-1428014836-project] 10.222.0.33 "GET /compute/v2.1/servers/0e2212f3-ad4e-4cb0-8dca-ca49144a1e94" status: 200 len: 1531 microversion: 2.1 time: 1.193432 Oct 04 21:00:52.031547 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2516/5055] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:00:50 2022] GET /compute/v2.1/servers/0e2212f3-ad4e-4cb0-8dca-ca49144a1e94 => generated 1531 bytes in 1203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:00:52.049450 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7444acf0-4aad-4a86-8327-0e89f966bd1b tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:00:52.050440 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-7444acf0-4aad-4a86-8327-0e89f966bd1b tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] [instance: b43cf252-2634-4a7d-9b8b-808e03acf885] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:00:52.062021 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7444acf0-4aad-4a86-8327-0e89f966bd1b tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:52.062565 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7444acf0-4aad-4a86-8327-0e89f966bd1b tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:52.063639 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7444acf0-4aad-4a86-8327-0e89f966bd1b tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:52.068511 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7444acf0-4aad-4a86-8327-0e89f966bd1b tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:52.069010 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7444acf0-4aad-4a86-8327-0e89f966bd1b tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:52.069456 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7444acf0-4aad-4a86-8327-0e89f966bd1b tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:52.096156 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:00:52.775638 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-c46bfe01-9ac5-4042-89ba-98b232dcd070 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5dbe3da6a4af181ef7302fe605fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3aa23aee3c8435c8f1f409019c5fed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:00:52.780867 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:00:52.798737 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-c46bfe01-9ac5-4042-89ba-98b232dcd070 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] 10.222.0.33 "GET /compute/v2.1/servers/243cbbbd-0734-4711-b605-c0657b81e359" status: 200 len: 1695 microversion: 2.1 time: 1.306160 Oct 04 21:00:52.801123 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2540/5056] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:00:51 2022] GET /compute/v2.1/servers/243cbbbd-0734-4711-b605-c0657b81e359 => generated 1695 bytes in 1312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:00:52.818868 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-7444acf0-4aad-4a86-8327-0e89f966bd1b tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea297d567a044fc9132f5d7d076f469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec4233f765546f997810e0e843ae184', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:00:52.827572 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-6ca1bb95-e9b0-43a9-bf4a-5c51015efe17 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:00:52.845310 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-7444acf0-4aad-4a86-8327-0e89f966bd1b tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0ea297d567a044fc9132f5d7d076f469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec4233f765546f997810e0e843ae184', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:00:52.846647 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-6ca1bb95-e9b0-43a9-bf4a-5c51015efe17 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] [instance: 320f9a98-969f-473e-bc56-842bbd28dedc] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:00:52.851784 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-7444acf0-4aad-4a86-8327-0e89f966bd1b tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0ea297d567a044fc9132f5d7d076f469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec4233f765546f997810e0e843ae184', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:00:52.862569 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-7444acf0-4aad-4a86-8327-0e89f966bd1b tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] 10.222.0.33 "GET /compute/v2.1/servers/b43cf252-2634-4a7d-9b8b-808e03acf885" status: 200 len: 1408 microversion: 2.54 time: 0.829389 Oct 04 21:00:52.872345 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2517/5057] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 21:00:52 2022] GET /compute/v2.1/servers/b43cf252-2634-4a7d-9b8b-808e03acf885 => generated 1408 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:00:52.875720 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6ca1bb95-e9b0-43a9-bf4a-5c51015efe17 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:52.878825 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6ca1bb95-e9b0-43a9-bf4a-5c51015efe17 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:52.879431 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6ca1bb95-e9b0-43a9-bf4a-5c51015efe17 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:52.880305 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6ca1bb95-e9b0-43a9-bf4a-5c51015efe17 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:52.882737 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6ca1bb95-e9b0-43a9-bf4a-5c51015efe17 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:52.883340 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6ca1bb95-e9b0-43a9-bf4a-5c51015efe17 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:53.060556 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a53a3430-f0e9-43fb-991e-8052d14f5d34 tempest-ServersNegativeTestMultiTenantJSON-1428014836 tempest-ServersNegativeTestMultiTenantJSON-1428014836-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:00:53.061865 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a53a3430-f0e9-43fb-991e-8052d14f5d34 tempest-ServersNegativeTestMultiTenantJSON-1428014836 tempest-ServersNegativeTestMultiTenantJSON-1428014836-project] [instance: 0e2212f3-ad4e-4cb0-8dca-ca49144a1e94] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:00:53.070234 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a53a3430-f0e9-43fb-991e-8052d14f5d34 tempest-ServersNegativeTestMultiTenantJSON-1428014836 tempest-ServersNegativeTestMultiTenantJSON-1428014836-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:53.076598 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a53a3430-f0e9-43fb-991e-8052d14f5d34 tempest-ServersNegativeTestMultiTenantJSON-1428014836 tempest-ServersNegativeTestMultiTenantJSON-1428014836-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:53.080740 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a53a3430-f0e9-43fb-991e-8052d14f5d34 tempest-ServersNegativeTestMultiTenantJSON-1428014836 tempest-ServersNegativeTestMultiTenantJSON-1428014836-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:53.083692 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a53a3430-f0e9-43fb-991e-8052d14f5d34 tempest-ServersNegativeTestMultiTenantJSON-1428014836 tempest-ServersNegativeTestMultiTenantJSON-1428014836-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:53.085995 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a53a3430-f0e9-43fb-991e-8052d14f5d34 tempest-ServersNegativeTestMultiTenantJSON-1428014836 tempest-ServersNegativeTestMultiTenantJSON-1428014836-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:53.087434 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a53a3430-f0e9-43fb-991e-8052d14f5d34 tempest-ServersNegativeTestMultiTenantJSON-1428014836 tempest-ServersNegativeTestMultiTenantJSON-1428014836-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:54.171859 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-a53a3430-f0e9-43fb-991e-8052d14f5d34 tempest-ServersNegativeTestMultiTenantJSON-1428014836 tempest-ServersNegativeTestMultiTenantJSON-1428014836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dfed24a3a0144b0ac357f7e200b2155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcf2a507fa3842e59a81c0967e25ae54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:00:54.183751 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a53a3430-f0e9-43fb-991e-8052d14f5d34 tempest-ServersNegativeTestMultiTenantJSON-1428014836 tempest-ServersNegativeTestMultiTenantJSON-1428014836-project] 10.222.0.33 "GET /compute/v2.1/servers/0e2212f3-ad4e-4cb0-8dca-ca49144a1e94" status: 200 len: 1531 microversion: 2.1 time: 1.127985 Oct 04 21:00:54.205101 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2518/5058] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:00:53 2022] GET /compute/v2.1/servers/0e2212f3-ad4e-4cb0-8dca-ca49144a1e94 => generated 1531 bytes in 1150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:00:54.303231 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-6ca1bb95-e9b0-43a9-bf4a-5c51015efe17 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6513f5e908ac4d028cad6eeeebeab285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65946afc398d4a9fb1c9095a4f946e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:00:54.316716 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-6ca1bb95-e9b0-43a9-bf4a-5c51015efe17 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc" status: 200 len: 1518 microversion: 2.1 time: 1.508533 Oct 04 21:00:54.318071 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2541/5059] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:00:52 2022] GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc => generated 1518 bytes in 1516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:00:54.328654 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-2fee82ae-9831-43cf-944f-0c34906c4843 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:00:54.338334 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-2fee82ae-9831-43cf-944f-0c34906c4843 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] [instance: 243cbbbd-0734-4711-b605-c0657b81e359] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:00:54.347411 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2fee82ae-9831-43cf-944f-0c34906c4843 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:54.348226 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2fee82ae-9831-43cf-944f-0c34906c4843 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:54.348827 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2fee82ae-9831-43cf-944f-0c34906c4843 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:54.349866 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2fee82ae-9831-43cf-944f-0c34906c4843 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:54.350568 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2fee82ae-9831-43cf-944f-0c34906c4843 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:54.351337 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2fee82ae-9831-43cf-944f-0c34906c4843 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:54.642580 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-21ce26d7-72a2-4e83-8e81-80fd2035887d tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Action: 'create', calling method: .version_select at 0x7f3c6f077040>, body: {"keypair": {"name": "tempest-TestSecurityGroupsBasicOps-1879853288", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHgwd2ZWdo/1hyqxkhE9MrpYHUXBYRx37DLkSdomcqOLQw24MZPCKgZN87HVIKX9ci+3tEV2QesoODOroH4kW4ugNxRS6lfIwbvMCMbMT5+QodMgk5BSR4PD0agN8lyKeA=="}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:00:54.668927 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-21ce26d7-72a2-4e83-8e81-80fd2035887d tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Getting quotas for project 8be936dd2db2466990cafbfbfb3a15cf. Resources: {'key_pairs'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:00:54.687751 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-21ce26d7-72a2-4e83-8e81-80fd2035887d tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Getting quotas for user 0f3403486e6f4afd8d97f97612110eb5 and project 8be936dd2db2466990cafbfbfb3a15cf. Resources: {'key_pairs'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:00:54.733193 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-21ce26d7-72a2-4e83-8e81-80fd2035887d tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.526107 Oct 04 21:00:54.734485 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2519/5060] 10.222.0.33 () {60 vars in 1159 bytes} [Tue Oct 4 21:00:54 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:00:54.740085 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-38641a73-eaae-4752-b138-9b49cc48ca84 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:00:54.745470 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-38641a73-eaae-4752-b138-9b49cc48ca84 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] [instance: b43cf252-2634-4a7d-9b8b-808e03acf885] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:00:54.765190 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-2fee82ae-9831-43cf-944f-0c34906c4843 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5dbe3da6a4af181ef7302fe605fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3aa23aee3c8435c8f1f409019c5fed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:00:54.774849 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-2fee82ae-9831-43cf-944f-0c34906c4843 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] 10.222.0.33 "GET /compute/v2.1/servers/243cbbbd-0734-4711-b605-c0657b81e359" status: 200 len: 1695 microversion: 2.1 time: 0.453981 Oct 04 21:00:54.775043 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-38641a73-eaae-4752-b138-9b49cc48ca84 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:54.776744 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-38641a73-eaae-4752-b138-9b49cc48ca84 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:54.779489 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-38641a73-eaae-4752-b138-9b49cc48ca84 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:54.785222 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2542/5061] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:00:54 2022] GET /compute/v2.1/servers/243cbbbd-0734-4711-b605-c0657b81e359 => generated 1695 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:00:54.786853 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-38641a73-eaae-4752-b138-9b49cc48ca84 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:54.789425 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-38641a73-eaae-4752-b138-9b49cc48ca84 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:54.793020 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-38641a73-eaae-4752-b138-9b49cc48ca84 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:54.797620 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-743f52e4-def9-4720-8030-5391250e55fc req-46a12d86-df0d-4877-8301-2f4c176a16f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e2212f3-ad4e-4cb0-8dca-ca49144a1e94", "name": "network-vif-deleted", "tag": "d2362a29-ecfd-42ad-8fbe-b5e9ccabbeaf"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:00:54.830926 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-743f52e4-def9-4720-8030-5391250e55fc req-46a12d86-df0d-4877-8301-2f4c176a16f1 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:54.831482 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-743f52e4-def9-4720-8030-5391250e55fc req-46a12d86-df0d-4877-8301-2f4c176a16f1 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:54.831933 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-743f52e4-def9-4720-8030-5391250e55fc req-46a12d86-df0d-4877-8301-2f4c176a16f1 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:54.861443 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-743f52e4-def9-4720-8030-5391250e55fc req-46a12d86-df0d-4877-8301-2f4c176a16f1 service nova] Creating event network-vif-deleted:d2362a29-ecfd-42ad-8fbe-b5e9ccabbeaf for instance 0e2212f3-ad4e-4cb0-8dca-ca49144a1e94 on n-h2-854823-8 Oct 04 21:00:54.888767 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-743f52e4-def9-4720-8030-5391250e55fc req-46a12d86-df0d-4877-8301-2f4c176a16f1 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097374 Oct 04 21:00:54.889928 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2543/5062] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:00:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:00:55.027997 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-38641a73-eaae-4752-b138-9b49cc48ca84 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea297d567a044fc9132f5d7d076f469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec4233f765546f997810e0e843ae184', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:00:55.047030 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-38641a73-eaae-4752-b138-9b49cc48ca84 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0ea297d567a044fc9132f5d7d076f469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec4233f765546f997810e0e843ae184', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:00:55.052377 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-38641a73-eaae-4752-b138-9b49cc48ca84 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0ea297d567a044fc9132f5d7d076f469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec4233f765546f997810e0e843ae184', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:00:55.057293 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-38641a73-eaae-4752-b138-9b49cc48ca84 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] 10.222.0.33 "GET /compute/v2.1/servers/b43cf252-2634-4a7d-9b8b-808e03acf885" status: 200 len: 1408 microversion: 2.54 time: 0.318363 Oct 04 21:00:55.058518 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2520/5063] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 21:00:54 2022] GET /compute/v2.1/servers/b43cf252-2634-4a7d-9b8b-808e03acf885 => generated 1408 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:00:55.211047 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-46252be1-053d-492e-bffc-f211c8f7ff16 tempest-ServersNegativeTestMultiTenantJSON-1428014836 tempest-ServersNegativeTestMultiTenantJSON-1428014836-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:00:55.211768 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-46252be1-053d-492e-bffc-f211c8f7ff16 tempest-ServersNegativeTestMultiTenantJSON-1428014836 tempest-ServersNegativeTestMultiTenantJSON-1428014836-project] [instance: 0e2212f3-ad4e-4cb0-8dca-ca49144a1e94] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:00:55.230149 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-46252be1-053d-492e-bffc-f211c8f7ff16 tempest-ServersNegativeTestMultiTenantJSON-1428014836 tempest-ServersNegativeTestMultiTenantJSON-1428014836-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:55.230680 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-46252be1-053d-492e-bffc-f211c8f7ff16 tempest-ServersNegativeTestMultiTenantJSON-1428014836 tempest-ServersNegativeTestMultiTenantJSON-1428014836-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:55.231126 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-46252be1-053d-492e-bffc-f211c8f7ff16 tempest-ServersNegativeTestMultiTenantJSON-1428014836 tempest-ServersNegativeTestMultiTenantJSON-1428014836-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:55.231842 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-46252be1-053d-492e-bffc-f211c8f7ff16 tempest-ServersNegativeTestMultiTenantJSON-1428014836 tempest-ServersNegativeTestMultiTenantJSON-1428014836-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:55.232301 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-46252be1-053d-492e-bffc-f211c8f7ff16 tempest-ServersNegativeTestMultiTenantJSON-1428014836 tempest-ServersNegativeTestMultiTenantJSON-1428014836-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:55.232730 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-46252be1-053d-492e-bffc-f211c8f7ff16 tempest-ServersNegativeTestMultiTenantJSON-1428014836 tempest-ServersNegativeTestMultiTenantJSON-1428014836-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:55.256316 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.wsgi [None req-46252be1-053d-492e-bffc-f211c8f7ff16 tempest-ServersNegativeTestMultiTenantJSON-1428014836 tempest-ServersNegativeTestMultiTenantJSON-1428014836-project] HTTP exception thrown: Instance 0e2212f3-ad4e-4cb0-8dca-ca49144a1e94 could not be found. Oct 04 21:00:55.258000 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-46252be1-053d-492e-bffc-f211c8f7ff16 tempest-ServersNegativeTestMultiTenantJSON-1428014836 tempest-ServersNegativeTestMultiTenantJSON-1428014836-project] Request method failure captured: Oct 04 21:00:55.258000 n-d-854823-8 devstack@n-api.service[128802]: request: GET /compute/v2.1/servers/0e2212f3-ad4e-4cb0-8dca-ca49144a1e94 HTTP/1.1 Oct 04 21:00:55.258000 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 21:00:55.258000 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 21:00:55.258000 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 21:00:55.258000 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 0 Oct 04 21:00:55.258000 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 21:00:55.258000 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 21:00:55.258000 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 21:00:55.258000 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 21:00:55.258000 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPJ7EkmsLUag-Qnk_ErUnlaWKRpRkbTgue0CscE-4ItTIKaxiExiqz_Sp3qr8v4iUOY1yb9J_c0iggBB86L0Uilb6Aaz4tUEJY3fqvVY6xqGcXvEsX-rqCN-71geNnbxklxxeg0_MkDRa-mOQI0putGR-P_sIKLccndehcdAFj10PBd8 Oct 04 21:00:55.258000 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 21:00:55.258000 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 21:00:55.258000 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 21:00:55.258000 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 21:00:55.258000 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 21:00:55.258000 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 21:00:55.258000 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: dcf2a507fa3842e59a81c0967e25ae54 Oct 04 21:00:55.258000 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1428014836 Oct 04 21:00:55.258000 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 21:00:55.258000 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 21:00:55.258000 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_dcf2a507fa3842e59a81c0967e25ae54", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/dcf2a507fa3842e59a81c0967e25ae54"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/dcf2a507fa3842e59a81c0967e25ae54"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/dcf2a507fa3842e59a81c0967e25ae54"}]}] Oct 04 21:00:55.258000 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1428014836 Oct 04 21:00:55.258000 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: dcf2a507fa3842e59a81c0967e25ae54 Oct 04 21:00:55.258000 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1428014836 Oct 04 21:00:55.258000 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1428014836-project Oct 04 21:00:55.258000 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 21:00:55.258000 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 21:00:55.258000 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: 1dfed24a3a0144b0ac357f7e200b2155 Oct 04 21:00:55.258000 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1428014836-project Oct 04 21:00:55.258000 n-d-854823-8 devstack@n-api.service[128802]: method: > Oct 04 21:00:55.258000 n-d-854823-8 devstack@n-api.service[128802]: exception: Instance 0e2212f3-ad4e-4cb0-8dca-ca49144a1e94 could not be found. Oct 04 21:00:55.258000 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'id': '0e2212f3-ad4e-4cb0-8dca-ca49144a1e94'} Oct 04 21:00:55.258000 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:00:55.258000 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:00:55.258000 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:00:55.258000 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:00:55.258000 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:00:55.258000 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:00:55.258000 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:00:55.258000 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:00:55.258000 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:00:55.258000 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:00:55.258000 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e2212f3-ad4e-4cb0-8dca-ca49144a1e94 could not be found. Oct 04 21:00:55.258000 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:00:55.258000 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:00:55.258000 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:00:55.258000 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:00:55.258000 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:00:55.258000 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:00:55.258000 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:00:55.258000 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:00:55.258000 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:00:55.258000 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:00:55.258000 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:00:55.258000 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:00:55.258000 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:00:55.258000 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:00:55.258000 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:00:55.258000 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:00:55.258000 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e2212f3-ad4e-4cb0-8dca-ca49144a1e94 could not be found. Oct 04 21:00:55.258000 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:00:55.261345 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:00:55.261345 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:00:55.261345 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:00:55.261345 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:00:55.261345 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:00:55.261345 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:00:55.261345 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:00:55.261345 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e2212f3-ad4e-4cb0-8dca-ca49144a1e94 could not be found. Oct 04 21:00:55.261345 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:00:55.261345 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-46252be1-053d-492e-bffc-f211c8f7ff16 tempest-ServersNegativeTestMultiTenantJSON-1428014836 tempest-ServersNegativeTestMultiTenantJSON-1428014836-project] Returning 404 to user: Instance 0e2212f3-ad4e-4cb0-8dca-ca49144a1e94 could not be found. {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:00:55.261345 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-46252be1-053d-492e-bffc-f211c8f7ff16 tempest-ServersNegativeTestMultiTenantJSON-1428014836 tempest-ServersNegativeTestMultiTenantJSON-1428014836-project] 10.222.0.33 "GET /compute/v2.1/servers/0e2212f3-ad4e-4cb0-8dca-ca49144a1e94" status: 404 len: 111 microversion: 2.1 time: 0.053512 Oct 04 21:00:55.274766 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2544/5064] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:00:55 2022] GET /compute/v2.1/servers/0e2212f3-ad4e-4cb0-8dca-ca49144a1e94 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:00:55.348389 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1364041d-97df-4d24-bf80-ffd226dad358 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:00:55.350275 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-1364041d-97df-4d24-bf80-ffd226dad358 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] [instance: 320f9a98-969f-473e-bc56-842bbd28dedc] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:00:55.359440 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1364041d-97df-4d24-bf80-ffd226dad358 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:55.360374 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1364041d-97df-4d24-bf80-ffd226dad358 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:55.361239 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1364041d-97df-4d24-bf80-ffd226dad358 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:55.362044 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1364041d-97df-4d24-bf80-ffd226dad358 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:55.363352 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1364041d-97df-4d24-bf80-ffd226dad358 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:55.363891 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1364041d-97df-4d24-bf80-ffd226dad358 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:55.787278 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-1364041d-97df-4d24-bf80-ffd226dad358 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6513f5e908ac4d028cad6eeeebeab285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65946afc398d4a9fb1c9095a4f946e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:00:55.799990 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-1364041d-97df-4d24-bf80-ffd226dad358 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc" status: 200 len: 1518 microversion: 2.1 time: 0.457034 Oct 04 21:00:55.803056 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2521/5065] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:00:55 2022] GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc => generated 1518 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:00:55.823715 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-8d2c5654-f13d-4d07-8a19-ff6c4ef1c002 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:00:55.825144 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-8d2c5654-f13d-4d07-8a19-ff6c4ef1c002 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] [instance: 243cbbbd-0734-4711-b605-c0657b81e359] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:00:55.833553 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8d2c5654-f13d-4d07-8a19-ff6c4ef1c002 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:55.834299 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8d2c5654-f13d-4d07-8a19-ff6c4ef1c002 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:55.835243 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8d2c5654-f13d-4d07-8a19-ff6c4ef1c002 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:55.836436 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8d2c5654-f13d-4d07-8a19-ff6c4ef1c002 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:55.837042 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8d2c5654-f13d-4d07-8a19-ff6c4ef1c002 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:55.837616 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8d2c5654-f13d-4d07-8a19-ff6c4ef1c002 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:56.090883 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ec488e9d-cf10-4446-9ac4-17076e63b9c0 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:00:56.091402 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ec488e9d-cf10-4446-9ac4-17076e63b9c0 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] [instance: b43cf252-2634-4a7d-9b8b-808e03acf885] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:00:56.117245 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ec488e9d-cf10-4446-9ac4-17076e63b9c0 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:56.120071 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ec488e9d-cf10-4446-9ac4-17076e63b9c0 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:56.122490 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ec488e9d-cf10-4446-9ac4-17076e63b9c0 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:56.123811 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ec488e9d-cf10-4446-9ac4-17076e63b9c0 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:56.124581 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ec488e9d-cf10-4446-9ac4-17076e63b9c0 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:56.126622 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ec488e9d-cf10-4446-9ac4-17076e63b9c0 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:56.278512 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-ec488e9d-cf10-4446-9ac4-17076e63b9c0 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea297d567a044fc9132f5d7d076f469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec4233f765546f997810e0e843ae184', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:00:56.305791 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-ec488e9d-cf10-4446-9ac4-17076e63b9c0 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0ea297d567a044fc9132f5d7d076f469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec4233f765546f997810e0e843ae184', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:00:56.312359 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-ec488e9d-cf10-4446-9ac4-17076e63b9c0 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0ea297d567a044fc9132f5d7d076f469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec4233f765546f997810e0e843ae184', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:00:56.317298 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ec488e9d-cf10-4446-9ac4-17076e63b9c0 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] 10.222.0.33 "GET /compute/v2.1/servers/b43cf252-2634-4a7d-9b8b-808e03acf885" status: 200 len: 1408 microversion: 2.54 time: 0.229716 Oct 04 21:00:56.317298 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2522/5066] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 21:00:56 2022] GET /compute/v2.1/servers/b43cf252-2634-4a7d-9b8b-808e03acf885 => generated 1408 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:00:56.397502 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-8d2c5654-f13d-4d07-8a19-ff6c4ef1c002 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5dbe3da6a4af181ef7302fe605fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3aa23aee3c8435c8f1f409019c5fed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:00:56.412439 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-8d2c5654-f13d-4d07-8a19-ff6c4ef1c002 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] 10.222.0.33 "GET /compute/v2.1/servers/243cbbbd-0734-4711-b605-c0657b81e359" status: 200 len: 1695 microversion: 2.1 time: 0.598298 Oct 04 21:00:56.413648 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2545/5067] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:00:55 2022] GET /compute/v2.1/servers/243cbbbd-0734-4711-b605-c0657b81e359 => generated 1695 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:00:56.840803 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-23ca9361-6d62-49b8-b2f7-8a3da65fa9cd tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:00:56.846164 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-23ca9361-6d62-49b8-b2f7-8a3da65fa9cd tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] [instance: 320f9a98-969f-473e-bc56-842bbd28dedc] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:00:56.870914 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-23ca9361-6d62-49b8-b2f7-8a3da65fa9cd tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:56.872099 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-23ca9361-6d62-49b8-b2f7-8a3da65fa9cd tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:56.872923 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-23ca9361-6d62-49b8-b2f7-8a3da65fa9cd tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:56.875222 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-23ca9361-6d62-49b8-b2f7-8a3da65fa9cd tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:56.876660 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-23ca9361-6d62-49b8-b2f7-8a3da65fa9cd tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:56.877318 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-23ca9361-6d62-49b8-b2f7-8a3da65fa9cd tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:57.341976 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-1df4e72d-e5ea-404e-b8a6-dfeb5ee57434 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:00:57.343081 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-1df4e72d-e5ea-404e-b8a6-dfeb5ee57434 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] [instance: b43cf252-2634-4a7d-9b8b-808e03acf885] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:00:57.367708 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1df4e72d-e5ea-404e-b8a6-dfeb5ee57434 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:57.369389 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1df4e72d-e5ea-404e-b8a6-dfeb5ee57434 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:57.370013 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1df4e72d-e5ea-404e-b8a6-dfeb5ee57434 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:57.372779 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1df4e72d-e5ea-404e-b8a6-dfeb5ee57434 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:57.373757 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1df4e72d-e5ea-404e-b8a6-dfeb5ee57434 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:57.374366 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1df4e72d-e5ea-404e-b8a6-dfeb5ee57434 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:57.511306 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-1df4e72d-e5ea-404e-b8a6-dfeb5ee57434 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea297d567a044fc9132f5d7d076f469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec4233f765546f997810e0e843ae184', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:00:57.544175 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-1df4e72d-e5ea-404e-b8a6-dfeb5ee57434 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0ea297d567a044fc9132f5d7d076f469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec4233f765546f997810e0e843ae184', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:00:57.545982 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-1df4e72d-e5ea-404e-b8a6-dfeb5ee57434 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0ea297d567a044fc9132f5d7d076f469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec4233f765546f997810e0e843ae184', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:00:57.547996 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-1df4e72d-e5ea-404e-b8a6-dfeb5ee57434 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] 10.222.0.33 "GET /compute/v2.1/servers/b43cf252-2634-4a7d-9b8b-808e03acf885" status: 200 len: 1408 microversion: 2.54 time: 0.210364 Oct 04 21:00:57.557335 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2546/5068] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 21:00:57 2022] GET /compute/v2.1/servers/b43cf252-2634-4a7d-9b8b-808e03acf885 => generated 1408 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:00:57.570551 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-2b1d4030-da50-4ea5-b5ee-581d73188260 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:00:57.571271 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-2b1d4030-da50-4ea5-b5ee-581d73188260 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] [instance: 243cbbbd-0734-4711-b605-c0657b81e359] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:00:57.571542 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-23ca9361-6d62-49b8-b2f7-8a3da65fa9cd tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6513f5e908ac4d028cad6eeeebeab285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65946afc398d4a9fb1c9095a4f946e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:00:57.586659 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2b1d4030-da50-4ea5-b5ee-581d73188260 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:57.587185 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2b1d4030-da50-4ea5-b5ee-581d73188260 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:57.587630 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2b1d4030-da50-4ea5-b5ee-581d73188260 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:57.587841 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-23ca9361-6d62-49b8-b2f7-8a3da65fa9cd tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc" status: 200 len: 1518 microversion: 2.1 time: 0.763907 Oct 04 21:00:57.588347 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2b1d4030-da50-4ea5-b5ee-581d73188260 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:57.589230 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2523/5069] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:00:56 2022] GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc => generated 1518 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:00:57.595868 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2b1d4030-da50-4ea5-b5ee-581d73188260 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:57.596559 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2b1d4030-da50-4ea5-b5ee-581d73188260 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:58.051717 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-2b1d4030-da50-4ea5-b5ee-581d73188260 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5dbe3da6a4af181ef7302fe605fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3aa23aee3c8435c8f1f409019c5fed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:00:58.061761 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-2b1d4030-da50-4ea5-b5ee-581d73188260 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] 10.222.0.33 "GET /compute/v2.1/servers/243cbbbd-0734-4711-b605-c0657b81e359" status: 200 len: 1695 microversion: 2.1 time: 0.500359 Oct 04 21:00:58.074956 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2547/5070] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:00:57 2022] GET /compute/v2.1/servers/243cbbbd-0734-4711-b605-c0657b81e359 => generated 1695 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:00:58.576219 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b2b8ef6b-7154-4f5b-9e22-e19b940cb5e3 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:00:58.578234 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b2b8ef6b-7154-4f5b-9e22-e19b940cb5e3 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] [instance: b43cf252-2634-4a7d-9b8b-808e03acf885] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:00:58.613829 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-d910b5b0-f89c-4908-8860-152bbcf81fbf tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:00:58.614801 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-d910b5b0-f89c-4908-8860-152bbcf81fbf tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] [instance: 320f9a98-969f-473e-bc56-842bbd28dedc] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:00:58.616377 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b2b8ef6b-7154-4f5b-9e22-e19b940cb5e3 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:58.618175 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b2b8ef6b-7154-4f5b-9e22-e19b940cb5e3 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:58.619890 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b2b8ef6b-7154-4f5b-9e22-e19b940cb5e3 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:58.621256 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b2b8ef6b-7154-4f5b-9e22-e19b940cb5e3 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:58.621919 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b2b8ef6b-7154-4f5b-9e22-e19b940cb5e3 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:58.622667 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b2b8ef6b-7154-4f5b-9e22-e19b940cb5e3 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:58.624839 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d910b5b0-f89c-4908-8860-152bbcf81fbf tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:58.627617 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d910b5b0-f89c-4908-8860-152bbcf81fbf tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:58.628950 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d910b5b0-f89c-4908-8860-152bbcf81fbf tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:58.630223 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d910b5b0-f89c-4908-8860-152bbcf81fbf tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:58.633185 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d910b5b0-f89c-4908-8860-152bbcf81fbf tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:58.633713 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d910b5b0-f89c-4908-8860-152bbcf81fbf tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:58.854000 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-b2b8ef6b-7154-4f5b-9e22-e19b940cb5e3 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea297d567a044fc9132f5d7d076f469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec4233f765546f997810e0e843ae184', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:00:58.869690 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-b2b8ef6b-7154-4f5b-9e22-e19b940cb5e3 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0ea297d567a044fc9132f5d7d076f469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec4233f765546f997810e0e843ae184', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:00:58.875398 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-b2b8ef6b-7154-4f5b-9e22-e19b940cb5e3 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0ea297d567a044fc9132f5d7d076f469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec4233f765546f997810e0e843ae184', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:00:58.880767 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b2b8ef6b-7154-4f5b-9e22-e19b940cb5e3 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] 10.222.0.33 "GET /compute/v2.1/servers/b43cf252-2634-4a7d-9b8b-808e03acf885" status: 200 len: 1408 microversion: 2.54 time: 0.309456 Oct 04 21:00:58.884651 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2524/5071] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 21:00:58 2022] GET /compute/v2.1/servers/b43cf252-2634-4a7d-9b8b-808e03acf885 => generated 1408 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:00:59.090608 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-058de7a6-8933-4fde-9a8e-999d279aa604 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:00:59.091348 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-058de7a6-8933-4fde-9a8e-999d279aa604 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] [instance: 243cbbbd-0734-4711-b605-c0657b81e359] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:00:59.091492 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-d910b5b0-f89c-4908-8860-152bbcf81fbf tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6513f5e908ac4d028cad6eeeebeab285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65946afc398d4a9fb1c9095a4f946e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:00:59.101694 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-d910b5b0-f89c-4908-8860-152bbcf81fbf tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc" status: 200 len: 1518 microversion: 2.1 time: 0.492332 Oct 04 21:00:59.103265 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-058de7a6-8933-4fde-9a8e-999d279aa604 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:59.107038 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2548/5072] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:00:58 2022] GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc => generated 1518 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:00:59.107831 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-058de7a6-8933-4fde-9a8e-999d279aa604 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:59.108522 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-058de7a6-8933-4fde-9a8e-999d279aa604 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:59.111348 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-058de7a6-8933-4fde-9a8e-999d279aa604 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:59.112699 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-058de7a6-8933-4fde-9a8e-999d279aa604 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:59.114743 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-058de7a6-8933-4fde-9a8e-999d279aa604 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:59.587283 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-058de7a6-8933-4fde-9a8e-999d279aa604 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5dbe3da6a4af181ef7302fe605fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3aa23aee3c8435c8f1f409019c5fed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:00:59.603305 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-058de7a6-8933-4fde-9a8e-999d279aa604 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] 10.222.0.33 "GET /compute/v2.1/servers/243cbbbd-0734-4711-b605-c0657b81e359" status: 200 len: 1695 microversion: 2.1 time: 0.519036 Oct 04 21:00:59.603934 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2525/5073] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:00:59 2022] GET /compute/v2.1/servers/243cbbbd-0734-4711-b605-c0657b81e359 => generated 1695 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:00:59.913564 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-74fc045f-1d4c-4d2c-a116-49b73db80204 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:00:59.914192 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-74fc045f-1d4c-4d2c-a116-49b73db80204 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] [instance: b43cf252-2634-4a7d-9b8b-808e03acf885] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:00:59.926458 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-74fc045f-1d4c-4d2c-a116-49b73db80204 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:59.932572 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-74fc045f-1d4c-4d2c-a116-49b73db80204 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:59.933039 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-74fc045f-1d4c-4d2c-a116-49b73db80204 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:00:59.933790 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-74fc045f-1d4c-4d2c-a116-49b73db80204 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:00:59.934254 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-74fc045f-1d4c-4d2c-a116-49b73db80204 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:00:59.934755 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-74fc045f-1d4c-4d2c-a116-49b73db80204 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:00.132542 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-38b54048-4ffb-4934-8133-8480a61d5cd6 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:01:00.133164 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-38b54048-4ffb-4934-8133-8480a61d5cd6 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] [instance: 320f9a98-969f-473e-bc56-842bbd28dedc] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:01:00.156351 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-38b54048-4ffb-4934-8133-8480a61d5cd6 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:00.157745 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-38b54048-4ffb-4934-8133-8480a61d5cd6 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:00.159478 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-38b54048-4ffb-4934-8133-8480a61d5cd6 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:00.161162 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-38b54048-4ffb-4934-8133-8480a61d5cd6 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:00.163838 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-38b54048-4ffb-4934-8133-8480a61d5cd6 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:00.165304 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-38b54048-4ffb-4934-8133-8480a61d5cd6 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:00.222183 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-74fc045f-1d4c-4d2c-a116-49b73db80204 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea297d567a044fc9132f5d7d076f469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec4233f765546f997810e0e843ae184', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:01:00.234016 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-74fc045f-1d4c-4d2c-a116-49b73db80204 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0ea297d567a044fc9132f5d7d076f469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec4233f765546f997810e0e843ae184', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:01:00.236713 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-74fc045f-1d4c-4d2c-a116-49b73db80204 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0ea297d567a044fc9132f5d7d076f469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec4233f765546f997810e0e843ae184', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:01:00.238032 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-74fc045f-1d4c-4d2c-a116-49b73db80204 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] 10.222.0.33 "GET /compute/v2.1/servers/b43cf252-2634-4a7d-9b8b-808e03acf885" status: 200 len: 1408 microversion: 2.54 time: 0.329354 Oct 04 21:01:00.247141 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2549/5074] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 21:00:59 2022] GET /compute/v2.1/servers/b43cf252-2634-4a7d-9b8b-808e03acf885 => generated 1408 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:01:00.630395 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-5684b427-353b-415b-8ae3-680ddf736efa tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:01:00.631126 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-5684b427-353b-415b-8ae3-680ddf736efa tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] [instance: 243cbbbd-0734-4711-b605-c0657b81e359] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:01:00.637718 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5684b427-353b-415b-8ae3-680ddf736efa tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:00.642489 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5684b427-353b-415b-8ae3-680ddf736efa tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:00.643145 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5684b427-353b-415b-8ae3-680ddf736efa tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:00.643996 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5684b427-353b-415b-8ae3-680ddf736efa tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:00.644571 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5684b427-353b-415b-8ae3-680ddf736efa tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:00.645139 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5684b427-353b-415b-8ae3-680ddf736efa tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:01.092387 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-38b54048-4ffb-4934-8133-8480a61d5cd6 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6513f5e908ac4d028cad6eeeebeab285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65946afc398d4a9fb1c9095a4f946e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:01:01.101408 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-38b54048-4ffb-4934-8133-8480a61d5cd6 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc" status: 200 len: 1518 microversion: 2.1 time: 0.972699 Oct 04 21:01:01.107011 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2526/5075] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:01:00 2022] GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc => generated 1518 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:01:01.277369 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d634f1ab-6798-4f7c-a2c3-479a20d4a318 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:01:01.278109 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d634f1ab-6798-4f7c-a2c3-479a20d4a318 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] [instance: b43cf252-2634-4a7d-9b8b-808e03acf885] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:01:01.285557 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d634f1ab-6798-4f7c-a2c3-479a20d4a318 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:01.286278 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d634f1ab-6798-4f7c-a2c3-479a20d4a318 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:01.286884 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d634f1ab-6798-4f7c-a2c3-479a20d4a318 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:01.287761 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d634f1ab-6798-4f7c-a2c3-479a20d4a318 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:01.288441 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d634f1ab-6798-4f7c-a2c3-479a20d4a318 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:01.289038 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d634f1ab-6798-4f7c-a2c3-479a20d4a318 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:01.564816 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-5684b427-353b-415b-8ae3-680ddf736efa tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5dbe3da6a4af181ef7302fe605fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3aa23aee3c8435c8f1f409019c5fed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:01:01.587981 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d634f1ab-6798-4f7c-a2c3-479a20d4a318 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea297d567a044fc9132f5d7d076f469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec4233f765546f997810e0e843ae184', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:01:01.598140 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-5684b427-353b-415b-8ae3-680ddf736efa tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] 10.222.0.33 "GET /compute/v2.1/servers/243cbbbd-0734-4711-b605-c0657b81e359" status: 200 len: 1695 microversion: 2.1 time: 0.974346 Oct 04 21:01:01.609063 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2550/5076] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:01:00 2022] GET /compute/v2.1/servers/243cbbbd-0734-4711-b605-c0657b81e359 => generated 1695 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:01:01.611548 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d634f1ab-6798-4f7c-a2c3-479a20d4a318 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0ea297d567a044fc9132f5d7d076f469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec4233f765546f997810e0e843ae184', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:01:01.616106 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d634f1ab-6798-4f7c-a2c3-479a20d4a318 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0ea297d567a044fc9132f5d7d076f469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec4233f765546f997810e0e843ae184', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:01:01.617501 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d634f1ab-6798-4f7c-a2c3-479a20d4a318 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] 10.222.0.33 "GET /compute/v2.1/servers/b43cf252-2634-4a7d-9b8b-808e03acf885" status: 200 len: 1414 microversion: 2.54 time: 0.344250 Oct 04 21:01:01.619864 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2527/5077] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 21:01:01 2022] GET /compute/v2.1/servers/b43cf252-2634-4a7d-9b8b-808e03acf885 => generated 1414 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:01:02.129694 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-b9dafc7c-300f-42fa-9fcb-2d4c2e979dec tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:01:02.130598 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-b9dafc7c-300f-42fa-9fcb-2d4c2e979dec tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] [instance: 320f9a98-969f-473e-bc56-842bbd28dedc] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:01:02.143378 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b9dafc7c-300f-42fa-9fcb-2d4c2e979dec tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:02.144258 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b9dafc7c-300f-42fa-9fcb-2d4c2e979dec tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:02.144923 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b9dafc7c-300f-42fa-9fcb-2d4c2e979dec tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:02.145918 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b9dafc7c-300f-42fa-9fcb-2d4c2e979dec tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:02.146695 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b9dafc7c-300f-42fa-9fcb-2d4c2e979dec tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:02.147392 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b9dafc7c-300f-42fa-9fcb-2d4c2e979dec tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:02.617181 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-b9dafc7c-300f-42fa-9fcb-2d4c2e979dec tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6513f5e908ac4d028cad6eeeebeab285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65946afc398d4a9fb1c9095a4f946e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:01:02.632670 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-b9dafc7c-300f-42fa-9fcb-2d4c2e979dec tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc" status: 200 len: 1518 microversion: 2.1 time: 0.506274 Oct 04 21:01:02.633860 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-21537d2b-dafd-4149-8e4e-b091962a58c7 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:01:02.634515 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-21537d2b-dafd-4149-8e4e-b091962a58c7 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] [instance: 243cbbbd-0734-4711-b605-c0657b81e359] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:01:02.635268 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2551/5078] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:01:02 2022] GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc => generated 1518 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:01:02.642580 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-21537d2b-dafd-4149-8e4e-b091962a58c7 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:02.643006 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-21537d2b-dafd-4149-8e4e-b091962a58c7 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:02.643444 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-21537d2b-dafd-4149-8e4e-b091962a58c7 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:02.644154 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-21537d2b-dafd-4149-8e4e-b091962a58c7 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:02.644616 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-21537d2b-dafd-4149-8e4e-b091962a58c7 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:02.645041 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-21537d2b-dafd-4149-8e4e-b091962a58c7 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:02.661404 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-e67684db-f804-4585-8be9-1d22e6d46abc tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:01:02.662085 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-e67684db-f804-4585-8be9-1d22e6d46abc tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] [instance: b43cf252-2634-4a7d-9b8b-808e03acf885] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:01:02.674013 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e67684db-f804-4585-8be9-1d22e6d46abc tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:02.674536 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e67684db-f804-4585-8be9-1d22e6d46abc tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:02.675135 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e67684db-f804-4585-8be9-1d22e6d46abc tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:02.676748 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e67684db-f804-4585-8be9-1d22e6d46abc tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:02.677358 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e67684db-f804-4585-8be9-1d22e6d46abc tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:02.677972 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e67684db-f804-4585-8be9-1d22e6d46abc tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:02.840146 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-e67684db-f804-4585-8be9-1d22e6d46abc tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea297d567a044fc9132f5d7d076f469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec4233f765546f997810e0e843ae184', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:01:02.858532 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-e67684db-f804-4585-8be9-1d22e6d46abc tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0ea297d567a044fc9132f5d7d076f469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec4233f765546f997810e0e843ae184', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:01:02.860325 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-e67684db-f804-4585-8be9-1d22e6d46abc tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0ea297d567a044fc9132f5d7d076f469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec4233f765546f997810e0e843ae184', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:01:02.861941 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-e67684db-f804-4585-8be9-1d22e6d46abc tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] 10.222.0.33 "GET /compute/v2.1/servers/b43cf252-2634-4a7d-9b8b-808e03acf885" status: 200 len: 1414 microversion: 2.54 time: 0.208765 Oct 04 21:01:02.875337 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2552/5079] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 21:01:02 2022] GET /compute/v2.1/servers/b43cf252-2634-4a7d-9b8b-808e03acf885 => generated 1414 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:01:03.540235 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-21537d2b-dafd-4149-8e4e-b091962a58c7 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5dbe3da6a4af181ef7302fe605fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3aa23aee3c8435c8f1f409019c5fed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:01:03.559955 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-21537d2b-dafd-4149-8e4e-b091962a58c7 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] 10.222.0.33 "GET /compute/v2.1/servers/243cbbbd-0734-4711-b605-c0657b81e359" status: 200 len: 1695 microversion: 2.1 time: 0.930011 Oct 04 21:01:03.565124 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2528/5080] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:01:02 2022] GET /compute/v2.1/servers/243cbbbd-0734-4711-b605-c0657b81e359 => generated 1695 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:01:03.663144 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-da33084b-6a42-43da-a723-a8ef1a320b38 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:01:03.664346 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-da33084b-6a42-43da-a723-a8ef1a320b38 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] [instance: 320f9a98-969f-473e-bc56-842bbd28dedc] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:01:03.678774 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-da33084b-6a42-43da-a723-a8ef1a320b38 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:03.679503 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-da33084b-6a42-43da-a723-a8ef1a320b38 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:03.680090 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-da33084b-6a42-43da-a723-a8ef1a320b38 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:03.680952 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-da33084b-6a42-43da-a723-a8ef1a320b38 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:03.682490 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-da33084b-6a42-43da-a723-a8ef1a320b38 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:03.683071 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-da33084b-6a42-43da-a723-a8ef1a320b38 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:03.904929 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7e57ec53-9e09-4c49-bdfb-b2c6b1d9d5d2 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:01:03.906115 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-7e57ec53-9e09-4c49-bdfb-b2c6b1d9d5d2 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] [instance: b43cf252-2634-4a7d-9b8b-808e03acf885] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:01:03.918323 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7e57ec53-9e09-4c49-bdfb-b2c6b1d9d5d2 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:03.926885 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7e57ec53-9e09-4c49-bdfb-b2c6b1d9d5d2 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:03.927754 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7e57ec53-9e09-4c49-bdfb-b2c6b1d9d5d2 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:03.929243 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7e57ec53-9e09-4c49-bdfb-b2c6b1d9d5d2 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:03.929852 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7e57ec53-9e09-4c49-bdfb-b2c6b1d9d5d2 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:03.930676 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7e57ec53-9e09-4c49-bdfb-b2c6b1d9d5d2 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:04.216869 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-7e57ec53-9e09-4c49-bdfb-b2c6b1d9d5d2 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea297d567a044fc9132f5d7d076f469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec4233f765546f997810e0e843ae184', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:01:04.229250 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-7e57ec53-9e09-4c49-bdfb-b2c6b1d9d5d2 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0ea297d567a044fc9132f5d7d076f469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec4233f765546f997810e0e843ae184', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:01:04.233734 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-7e57ec53-9e09-4c49-bdfb-b2c6b1d9d5d2 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0ea297d567a044fc9132f5d7d076f469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec4233f765546f997810e0e843ae184', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:01:04.238853 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-7e57ec53-9e09-4c49-bdfb-b2c6b1d9d5d2 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] 10.222.0.33 "GET /compute/v2.1/servers/b43cf252-2634-4a7d-9b8b-808e03acf885" status: 200 len: 1399 microversion: 2.54 time: 0.337531 Oct 04 21:01:04.257902 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2529/5081] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 21:01:03 2022] GET /compute/v2.1/servers/b43cf252-2634-4a7d-9b8b-808e03acf885 => generated 1399 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:01:04.268709 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ef1d652c-12cb-405c-8142-0bfd0b975661 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Calling method '.version_select at 0x7f3c6f06bf70>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:01:04.299896 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ef1d652c-12cb-405c-8142-0bfd0b975661 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-1836586810" status: 204 len: 0 microversion: 2.54 time: 0.036003 Oct 04 21:01:04.307049 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2530/5082] 10.222.0.33 () {60 vars in 1319 bytes} [Tue Oct 4 21:01:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-1836586810 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 21:01:04.314787 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c91795a4-e6e9-46c9-b6c9-ecf9de0d96f3 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:01:04.316052 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c91795a4-e6e9-46c9-b6c9-ecf9de0d96f3 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] [instance: b43cf252-2634-4a7d-9b8b-808e03acf885] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:01:04.327041 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c91795a4-e6e9-46c9-b6c9-ecf9de0d96f3 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:04.328881 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c91795a4-e6e9-46c9-b6c9-ecf9de0d96f3 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:04.330082 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c91795a4-e6e9-46c9-b6c9-ecf9de0d96f3 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:04.331052 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c91795a4-e6e9-46c9-b6c9-ecf9de0d96f3 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:04.331778 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c91795a4-e6e9-46c9-b6c9-ecf9de0d96f3 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:04.332431 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c91795a4-e6e9-46c9-b6c9-ecf9de0d96f3 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:04.371288 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c91795a4-e6e9-46c9-b6c9-ecf9de0d96f3 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] [instance: b43cf252-2634-4a7d-9b8b-808e03acf885] Going to try to terminate instance {{(pid=128801) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:01:04.459346 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-da33084b-6a42-43da-a723-a8ef1a320b38 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6513f5e908ac4d028cad6eeeebeab285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65946afc398d4a9fb1c9095a4f946e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:01:04.468531 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-da33084b-6a42-43da-a723-a8ef1a320b38 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc" status: 200 len: 1518 microversion: 2.1 time: 0.809169 Oct 04 21:01:04.469350 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2553/5083] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:01:03 2022] GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc => generated 1518 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:01:04.514850 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c91795a4-e6e9-46c9-b6c9-ecf9de0d96f3 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] 10.222.0.33 "DELETE /compute/v2.1/servers/b43cf252-2634-4a7d-9b8b-808e03acf885" status: 204 len: 0 microversion: 2.54 time: 0.203837 Oct 04 21:01:04.521083 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2531/5084] 10.222.0.33 () {60 vars in 1280 bytes} [Tue Oct 4 21:01:04 2022] DELETE /compute/v2.1/servers/b43cf252-2634-4a7d-9b8b-808e03acf885 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 21:01:04.526439 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-7291ebdd-1acc-43d4-a278-cd8dab91ba4d tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:01:04.526974 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-7291ebdd-1acc-43d4-a278-cd8dab91ba4d tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] [instance: b43cf252-2634-4a7d-9b8b-808e03acf885] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:01:04.533318 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7291ebdd-1acc-43d4-a278-cd8dab91ba4d tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:04.534008 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7291ebdd-1acc-43d4-a278-cd8dab91ba4d tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:04.534617 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7291ebdd-1acc-43d4-a278-cd8dab91ba4d tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:04.535618 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7291ebdd-1acc-43d4-a278-cd8dab91ba4d tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:04.536214 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7291ebdd-1acc-43d4-a278-cd8dab91ba4d tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:04.536789 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7291ebdd-1acc-43d4-a278-cd8dab91ba4d tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:04.590119 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-975f655f-d66c-4cbd-81a5-17756adec8e9 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:01:04.591042 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-975f655f-d66c-4cbd-81a5-17756adec8e9 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] [instance: 243cbbbd-0734-4711-b605-c0657b81e359] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:01:04.622562 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-975f655f-d66c-4cbd-81a5-17756adec8e9 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:04.623277 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-975f655f-d66c-4cbd-81a5-17756adec8e9 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:04.623743 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-975f655f-d66c-4cbd-81a5-17756adec8e9 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:04.624509 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-975f655f-d66c-4cbd-81a5-17756adec8e9 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:04.624981 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-975f655f-d66c-4cbd-81a5-17756adec8e9 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:04.625969 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-975f655f-d66c-4cbd-81a5-17756adec8e9 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:04.711269 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=4 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:01:05.305501 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-7291ebdd-1acc-43d4-a278-cd8dab91ba4d tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea297d567a044fc9132f5d7d076f469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec4233f765546f997810e0e843ae184', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:01:05.340121 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-7291ebdd-1acc-43d4-a278-cd8dab91ba4d tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0ea297d567a044fc9132f5d7d076f469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec4233f765546f997810e0e843ae184', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:01:05.352877 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-7291ebdd-1acc-43d4-a278-cd8dab91ba4d tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0ea297d567a044fc9132f5d7d076f469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec4233f765546f997810e0e843ae184', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:01:05.354380 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-7291ebdd-1acc-43d4-a278-cd8dab91ba4d tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] 10.222.0.33 "GET /compute/v2.1/servers/b43cf252-2634-4a7d-9b8b-808e03acf885" status: 200 len: 1405 microversion: 2.54 time: 0.832916 Oct 04 21:01:05.355460 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2554/5085] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 21:01:04 2022] GET /compute/v2.1/servers/b43cf252-2634-4a7d-9b8b-808e03acf885 => generated 1405 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:01:05.365933 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-464a0f58-6d9c-4d0e-b54b-635a8dbdcd5f req-86ed5a22-93d9-4f22-bc97-5db34651c31c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "320f9a98-969f-473e-bc56-842bbd28dedc", "name": "network-vif-plugged", "status": "completed", "tag": "d2b3af35-3f6f-4a4b-91ec-14c17375542b"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:01:05.418404 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-464a0f58-6d9c-4d0e-b54b-635a8dbdcd5f req-86ed5a22-93d9-4f22-bc97-5db34651c31c service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:05.419281 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-464a0f58-6d9c-4d0e-b54b-635a8dbdcd5f req-86ed5a22-93d9-4f22-bc97-5db34651c31c service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:05.419891 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-464a0f58-6d9c-4d0e-b54b-635a8dbdcd5f req-86ed5a22-93d9-4f22-bc97-5db34651c31c service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:05.436514 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-464a0f58-6d9c-4d0e-b54b-635a8dbdcd5f req-86ed5a22-93d9-4f22-bc97-5db34651c31c service nova] Creating event network-vif-plugged:d2b3af35-3f6f-4a4b-91ec-14c17375542b for instance 320f9a98-969f-473e-bc56-842bbd28dedc on n-h1-854823-8 Oct 04 21:01:05.448071 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-464a0f58-6d9c-4d0e-b54b-635a8dbdcd5f req-86ed5a22-93d9-4f22-bc97-5db34651c31c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091044 Oct 04 21:01:05.449996 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2555/5086] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:01:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:01:05.494401 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-bc3b0978-d3e3-4864-b5c7-9c0aa843a13e tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:01:05.495337 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-bc3b0978-d3e3-4864-b5c7-9c0aa843a13e tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] [instance: 320f9a98-969f-473e-bc56-842bbd28dedc] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:01:05.508374 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bc3b0978-d3e3-4864-b5c7-9c0aa843a13e tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:05.509041 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bc3b0978-d3e3-4864-b5c7-9c0aa843a13e tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:05.509553 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bc3b0978-d3e3-4864-b5c7-9c0aa843a13e tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:05.510533 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bc3b0978-d3e3-4864-b5c7-9c0aa843a13e tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:05.511098 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bc3b0978-d3e3-4864-b5c7-9c0aa843a13e tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:05.511595 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bc3b0978-d3e3-4864-b5c7-9c0aa843a13e tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:05.739807 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-975f655f-d66c-4cbd-81a5-17756adec8e9 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5dbe3da6a4af181ef7302fe605fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3aa23aee3c8435c8f1f409019c5fed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:01:05.755710 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-975f655f-d66c-4cbd-81a5-17756adec8e9 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] 10.222.0.33 "GET /compute/v2.1/servers/243cbbbd-0734-4711-b605-c0657b81e359" status: 200 len: 1694 microversion: 2.1 time: 1.169322 Oct 04 21:01:05.757855 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2532/5087] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:01:04 2022] GET /compute/v2.1/servers/243cbbbd-0734-4711-b605-c0657b81e359 => generated 1694 bytes in 1174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:01:05.763477 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-034ff681-917d-4fbc-89e5-c4d11eb06aa8 req-28f400d4-2d56-40a3-92be-fdb0b970dab5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "243cbbbd-0734-4711-b605-c0657b81e359", "name": "network-vif-unplugged", "status": "completed", "tag": "65760264-f1de-43cd-baca-c370b4c65ec6"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:01:05.794431 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-034ff681-917d-4fbc-89e5-c4d11eb06aa8 req-28f400d4-2d56-40a3-92be-fdb0b970dab5 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:05.796367 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-034ff681-917d-4fbc-89e5-c4d11eb06aa8 req-28f400d4-2d56-40a3-92be-fdb0b970dab5 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:05.798190 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-034ff681-917d-4fbc-89e5-c4d11eb06aa8 req-28f400d4-2d56-40a3-92be-fdb0b970dab5 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:05.818816 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-034ff681-917d-4fbc-89e5-c4d11eb06aa8 req-28f400d4-2d56-40a3-92be-fdb0b970dab5 service nova] Creating event network-vif-unplugged:65760264-f1de-43cd-baca-c370b4c65ec6 for instance 243cbbbd-0734-4711-b605-c0657b81e359 on n-h1-854823-8 Oct 04 21:01:05.832606 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [req-034ff681-917d-4fbc-89e5-c4d11eb06aa8 req-28f400d4-2d56-40a3-92be-fdb0b970dab5 service nova] Instance 243cbbbd-0734-4711-b605-c0657b81e359 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854823-8', 'n-h2-854823-8'} {{(pid=128801) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 21:01:05.880377 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-034ff681-917d-4fbc-89e5-c4d11eb06aa8 req-28f400d4-2d56-40a3-92be-fdb0b970dab5 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.119648 Oct 04 21:01:05.882503 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2533/5088] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:01:05 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:01:05.917177 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-bc3b0978-d3e3-4864-b5c7-9c0aa843a13e tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6513f5e908ac4d028cad6eeeebeab285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65946afc398d4a9fb1c9095a4f946e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:01:05.944612 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-bc3b0978-d3e3-4864-b5c7-9c0aa843a13e tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc" status: 200 len: 1518 microversion: 2.1 time: 0.455498 Oct 04 21:01:05.951045 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2556/5089] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:01:05 2022] GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc => generated 1518 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:01:06.387756 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ab02c24e-b97d-4eee-8c72-740944058381 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:01:06.388924 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ab02c24e-b97d-4eee-8c72-740944058381 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] [instance: b43cf252-2634-4a7d-9b8b-808e03acf885] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:01:06.413470 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ab02c24e-b97d-4eee-8c72-740944058381 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:06.413967 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ab02c24e-b97d-4eee-8c72-740944058381 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:06.414434 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ab02c24e-b97d-4eee-8c72-740944058381 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:06.415141 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ab02c24e-b97d-4eee-8c72-740944058381 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:06.415597 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ab02c24e-b97d-4eee-8c72-740944058381 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:06.416020 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ab02c24e-b97d-4eee-8c72-740944058381 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:06.504061 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:01:06.785961 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-02396262-3a94-428d-9fa9-5840c24c7fb2 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:01:06.786636 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-02396262-3a94-428d-9fa9-5840c24c7fb2 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] [instance: 243cbbbd-0734-4711-b605-c0657b81e359] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:01:06.796923 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-02396262-3a94-428d-9fa9-5840c24c7fb2 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:06.801459 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-02396262-3a94-428d-9fa9-5840c24c7fb2 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:06.803895 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-02396262-3a94-428d-9fa9-5840c24c7fb2 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:06.814089 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-02396262-3a94-428d-9fa9-5840c24c7fb2 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:06.814779 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-02396262-3a94-428d-9fa9-5840c24c7fb2 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:06.815291 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-02396262-3a94-428d-9fa9-5840c24c7fb2 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:07.012961 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-ab02c24e-b97d-4eee-8c72-740944058381 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea297d567a044fc9132f5d7d076f469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec4233f765546f997810e0e843ae184', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:01:07.022630 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-ab02c24e-b97d-4eee-8c72-740944058381 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0ea297d567a044fc9132f5d7d076f469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec4233f765546f997810e0e843ae184', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:01:07.033563 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-ab02c24e-b97d-4eee-8c72-740944058381 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0ea297d567a044fc9132f5d7d076f469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec4233f765546f997810e0e843ae184', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:01:07.041636 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ab02c24e-b97d-4eee-8c72-740944058381 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] 10.222.0.33 "GET /compute/v2.1/servers/b43cf252-2634-4a7d-9b8b-808e03acf885" status: 200 len: 1405 microversion: 2.54 time: 0.656099 Oct 04 21:01:07.042609 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2534/5090] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 21:01:06 2022] GET /compute/v2.1/servers/b43cf252-2634-4a7d-9b8b-808e03acf885 => generated 1405 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:01:07.053539 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-baf73797-2e99-4b32-a5aa-25b86917ec79 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:01:07.057412 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-baf73797-2e99-4b32-a5aa-25b86917ec79 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] [instance: 320f9a98-969f-473e-bc56-842bbd28dedc] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:01:07.081053 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-baf73797-2e99-4b32-a5aa-25b86917ec79 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:07.084743 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-baf73797-2e99-4b32-a5aa-25b86917ec79 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:07.086387 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-baf73797-2e99-4b32-a5aa-25b86917ec79 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:07.096647 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-baf73797-2e99-4b32-a5aa-25b86917ec79 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:07.098516 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-baf73797-2e99-4b32-a5aa-25b86917ec79 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:07.099543 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-baf73797-2e99-4b32-a5aa-25b86917ec79 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:07.621077 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-02396262-3a94-428d-9fa9-5840c24c7fb2 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5dbe3da6a4af181ef7302fe605fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3aa23aee3c8435c8f1f409019c5fed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:01:07.635129 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-02396262-3a94-428d-9fa9-5840c24c7fb2 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] 10.222.0.33 "GET /compute/v2.1/servers/243cbbbd-0734-4711-b605-c0657b81e359" status: 200 len: 1694 microversion: 2.1 time: 0.854164 Oct 04 21:01:07.639125 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2557/5091] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:01:06 2022] GET /compute/v2.1/servers/243cbbbd-0734-4711-b605-c0657b81e359 => generated 1694 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:01:07.682217 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-baf73797-2e99-4b32-a5aa-25b86917ec79 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6513f5e908ac4d028cad6eeeebeab285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65946afc398d4a9fb1c9095a4f946e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:01:07.697105 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-baf73797-2e99-4b32-a5aa-25b86917ec79 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc" status: 200 len: 1518 microversion: 2.1 time: 0.653193 Oct 04 21:01:07.697708 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2535/5092] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:01:07 2022] GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc => generated 1518 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:01:08.075951 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-22198e4e-3229-45d2-bf78-5328afb76c80 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:01:08.076558 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-22198e4e-3229-45d2-bf78-5328afb76c80 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] [instance: b43cf252-2634-4a7d-9b8b-808e03acf885] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:01:08.105676 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-22198e4e-3229-45d2-bf78-5328afb76c80 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:08.115997 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-22198e4e-3229-45d2-bf78-5328afb76c80 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:08.116798 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-22198e4e-3229-45d2-bf78-5328afb76c80 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:08.119916 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-22198e4e-3229-45d2-bf78-5328afb76c80 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:08.123046 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-22198e4e-3229-45d2-bf78-5328afb76c80 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:08.123730 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-22198e4e-3229-45d2-bf78-5328afb76c80 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:08.255897 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-22198e4e-3229-45d2-bf78-5328afb76c80 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:08.256495 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-22198e4e-3229-45d2-bf78-5328afb76c80 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:08.257759 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-22198e4e-3229-45d2-bf78-5328afb76c80 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:08.261979 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.objects.instance [None req-22198e4e-3229-45d2-bf78-5328afb76c80 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Lazy-loading 'fault' on Instance uuid b43cf252-2634-4a7d-9b8b-808e03acf885 {{(pid=128802) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:01:08.492085 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-22198e4e-3229-45d2-bf78-5328afb76c80 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ea297d567a044fc9132f5d7d076f469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec4233f765546f997810e0e843ae184', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:01:08.498914 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-22198e4e-3229-45d2-bf78-5328afb76c80 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0ea297d567a044fc9132f5d7d076f469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec4233f765546f997810e0e843ae184', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:01:08.502017 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-22198e4e-3229-45d2-bf78-5328afb76c80 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0ea297d567a044fc9132f5d7d076f469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec4233f765546f997810e0e843ae184', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:01:08.504712 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-22198e4e-3229-45d2-bf78-5328afb76c80 tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] 10.222.0.33 "GET /compute/v2.1/servers/b43cf252-2634-4a7d-9b8b-808e03acf885" status: 200 len: 1410 microversion: 2.54 time: 0.435787 Oct 04 21:01:08.505296 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2558/5093] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 21:01:08 2022] GET /compute/v2.1/servers/b43cf252-2634-4a7d-9b8b-808e03acf885 => generated 1410 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:01:08.676512 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9c7cd54c-abcc-4610-a956-d2f0259d9434 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:01:08.678660 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-9c7cd54c-abcc-4610-a956-d2f0259d9434 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] [instance: 243cbbbd-0734-4711-b605-c0657b81e359] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:01:08.723513 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-08e2092d-059e-4e54-87d3-c5cb316221b0 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:01:08.724385 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-08e2092d-059e-4e54-87d3-c5cb316221b0 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] [instance: 320f9a98-969f-473e-bc56-842bbd28dedc] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:01:08.728967 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9c7cd54c-abcc-4610-a956-d2f0259d9434 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:08.729669 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9c7cd54c-abcc-4610-a956-d2f0259d9434 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:08.730137 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9c7cd54c-abcc-4610-a956-d2f0259d9434 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:08.732029 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9c7cd54c-abcc-4610-a956-d2f0259d9434 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:08.736915 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9c7cd54c-abcc-4610-a956-d2f0259d9434 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:08.737608 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9c7cd54c-abcc-4610-a956-d2f0259d9434 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:08.738198 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-08e2092d-059e-4e54-87d3-c5cb316221b0 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:08.746909 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-08e2092d-059e-4e54-87d3-c5cb316221b0 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:08.747641 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-08e2092d-059e-4e54-87d3-c5cb316221b0 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:08.748722 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-08e2092d-059e-4e54-87d3-c5cb316221b0 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:08.749264 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-08e2092d-059e-4e54-87d3-c5cb316221b0 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:08.752125 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-08e2092d-059e-4e54-87d3-c5cb316221b0 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:08.856982 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=100 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:01:09.704202 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-08e2092d-059e-4e54-87d3-c5cb316221b0 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6513f5e908ac4d028cad6eeeebeab285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65946afc398d4a9fb1c9095a4f946e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:01:09.717753 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-08e2092d-059e-4e54-87d3-c5cb316221b0 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc" status: 200 len: 1518 microversion: 2.1 time: 0.997778 Oct 04 21:01:09.736795 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2559/5094] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:01:08 2022] GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc => generated 1518 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:01:09.743766 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-1ef6903b-3c08-4e4f-9b9d-b6c3eef211bd tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:01:09.744588 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-1ef6903b-3c08-4e4f-9b9d-b6c3eef211bd tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] [instance: b43cf252-2634-4a7d-9b8b-808e03acf885] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:01:09.751352 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1ef6903b-3c08-4e4f-9b9d-b6c3eef211bd tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:09.752018 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1ef6903b-3c08-4e4f-9b9d-b6c3eef211bd tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:09.752634 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1ef6903b-3c08-4e4f-9b9d-b6c3eef211bd tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:09.754118 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1ef6903b-3c08-4e4f-9b9d-b6c3eef211bd tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:09.754804 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1ef6903b-3c08-4e4f-9b9d-b6c3eef211bd tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:09.755425 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1ef6903b-3c08-4e4f-9b9d-b6c3eef211bd tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:09.775492 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.wsgi [None req-1ef6903b-3c08-4e4f-9b9d-b6c3eef211bd tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] HTTP exception thrown: Instance b43cf252-2634-4a7d-9b8b-808e03acf885 could not be found. Oct 04 21:01:09.777872 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-1ef6903b-3c08-4e4f-9b9d-b6c3eef211bd tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Request method failure captured: Oct 04 21:01:09.777872 n-d-854823-8 devstack@n-api.service[128802]: request: GET /compute/v2.1/servers/b43cf252-2634-4a7d-9b8b-808e03acf885 HTTP/1.1 Oct 04 21:01:09.777872 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 21:01:09.777872 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 21:01:09.777872 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 21:01:09.777872 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 0 Oct 04 21:01:09.777872 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 21:01:09.777872 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 21:01:09.777872 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 21:01:09.777872 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 21:01:09.777872 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPJ7khmo1Z8Yxe04-vf5tw4EE-CDbaWo6RK0_aOq3HZCp5QiuhYiL0bNTSHZISJoJp_J65nzvemW_IWMDvK5SvyDLwUs2TVi26EwdnLZ5CdPNeKYdgHNRe677UroIsA0K6HmTLs0rr5-XJCQ15rgyQ-daC35NgwbgC9tJhRjNVb_dR1c Oct 04 21:01:09.777872 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 21:01:09.777872 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 21:01:09.777872 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 21:01:09.777872 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 21:01:09.777872 n-d-854823-8 devstack@n-api.service[128802]: X-Openstack-Nova-Api-Version: 2.54 Oct 04 21:01:09.777872 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 21:01:09.777872 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 21:01:09.777872 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: fec4233f765546f997810e0e843ae184 Oct 04 21:01:09.777872 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-ServerShowV254Test-1754105527 Oct 04 21:01:09.777872 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 21:01:09.777872 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 21:01:09.777872 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_fec4233f765546f997810e0e843ae184", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fec4233f765546f997810e0e843ae184"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fec4233f765546f997810e0e843ae184"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/fec4233f765546f997810e0e843ae184"}]}] Oct 04 21:01:09.777872 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-ServerShowV254Test-1754105527 Oct 04 21:01:09.777872 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: fec4233f765546f997810e0e843ae184 Oct 04 21:01:09.777872 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-ServerShowV254Test-1754105527 Oct 04 21:01:09.777872 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-ServerShowV254Test-1754105527-project Oct 04 21:01:09.777872 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 21:01:09.777872 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 21:01:09.777872 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: 0ea297d567a044fc9132f5d7d076f469 Oct 04 21:01:09.777872 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-ServerShowV254Test-1754105527-project Oct 04 21:01:09.777872 n-d-854823-8 devstack@n-api.service[128802]: method: > Oct 04 21:01:09.777872 n-d-854823-8 devstack@n-api.service[128802]: exception: Instance b43cf252-2634-4a7d-9b8b-808e03acf885 could not be found. Oct 04 21:01:09.777872 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'id': 'b43cf252-2634-4a7d-9b8b-808e03acf885'} Oct 04 21:01:09.777872 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:01:09.777872 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:01:09.777872 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:01:09.777872 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:01:09.777872 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:01:09.777872 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:01:09.777872 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:01:09.777872 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:01:09.777872 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:01:09.777872 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:01:09.777872 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b43cf252-2634-4a7d-9b8b-808e03acf885 could not be found. Oct 04 21:01:09.777872 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:01:09.777872 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:01:09.777872 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:01:09.777872 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:01:09.777872 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:01:09.777872 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:01:09.777872 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:01:09.777872 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:01:09.777872 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:01:09.777872 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:01:09.777872 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:01:09.777872 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:01:09.777872 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:01:09.777872 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:01:09.777872 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:01:09.777872 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:01:09.777872 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b43cf252-2634-4a7d-9b8b-808e03acf885 could not be found. Oct 04 21:01:09.777872 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:01:09.777872 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:01:09.777872 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:01:09.782813 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:01:09.782813 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:01:09.782813 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:01:09.782813 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:01:09.782813 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:01:09.782813 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b43cf252-2634-4a7d-9b8b-808e03acf885 could not be found. Oct 04 21:01:09.782813 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:01:09.785013 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-1ef6903b-3c08-4e4f-9b9d-b6c3eef211bd tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] Returning 404 to user: Instance b43cf252-2634-4a7d-9b8b-808e03acf885 could not be found. {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:01:09.785809 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-1ef6903b-3c08-4e4f-9b9d-b6c3eef211bd tempest-ServerShowV254Test-1754105527 tempest-ServerShowV254Test-1754105527-project] 10.222.0.33 "GET /compute/v2.1/servers/b43cf252-2634-4a7d-9b8b-808e03acf885" status: 404 len: 111 microversion: 2.54 time: 0.047479 Oct 04 21:01:09.787753 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2560/5095] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 21:01:09 2022] GET /compute/v2.1/servers/b43cf252-2634-4a7d-9b8b-808e03acf885 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 21:01:09.849266 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-7acb0456-b99f-4c96-9a83-8ca0cf119f82 req-7ec910fd-735a-418e-b779-308589b77a0f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "243cbbbd-0734-4711-b605-c0657b81e359", "tag": "65760264-f1de-43cd-baca-c370b4c65ec6"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:01:09.883208 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-7acb0456-b99f-4c96-9a83-8ca0cf119f82 req-7ec910fd-735a-418e-b779-308589b77a0f service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:09.886317 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-7acb0456-b99f-4c96-9a83-8ca0cf119f82 req-7ec910fd-735a-418e-b779-308589b77a0f service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:09.894968 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-7acb0456-b99f-4c96-9a83-8ca0cf119f82 req-7ec910fd-735a-418e-b779-308589b77a0f service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:09.921871 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-7acb0456-b99f-4c96-9a83-8ca0cf119f82 req-7ec910fd-735a-418e-b779-308589b77a0f service nova] Creating event network-changed:65760264-f1de-43cd-baca-c370b4c65ec6 for instance 243cbbbd-0734-4711-b605-c0657b81e359 on n-h1-854823-8 Oct 04 21:01:09.934133 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [req-7acb0456-b99f-4c96-9a83-8ca0cf119f82 req-7ec910fd-735a-418e-b779-308589b77a0f service nova] Instance 243cbbbd-0734-4711-b605-c0657b81e359 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854823-8', 'n-h2-854823-8'} {{(pid=128802) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 21:01:09.970825 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-7acb0456-b99f-4c96-9a83-8ca0cf119f82 req-7ec910fd-735a-418e-b779-308589b77a0f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.132827 Oct 04 21:01:09.973063 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2561/5096] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:01:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:01:09.975588 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-9c7cd54c-abcc-4610-a956-d2f0259d9434 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5dbe3da6a4af181ef7302fe605fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3aa23aee3c8435c8f1f409019c5fed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:01:09.988320 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-9c7cd54c-abcc-4610-a956-d2f0259d9434 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] 10.222.0.33 "GET /compute/v2.1/servers/243cbbbd-0734-4711-b605-c0657b81e359" status: 200 len: 1694 microversion: 2.1 time: 1.324208 Oct 04 21:01:10.007088 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2536/5097] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:01:08 2022] GET /compute/v2.1/servers/243cbbbd-0734-4711-b605-c0657b81e359 => generated 1694 bytes in 1344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:01:10.753393 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-276b4f13-be00-455b-8bf1-4bca20f7924c tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:01:10.755688 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-276b4f13-be00-455b-8bf1-4bca20f7924c tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] [instance: 320f9a98-969f-473e-bc56-842bbd28dedc] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:01:10.787472 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-276b4f13-be00-455b-8bf1-4bca20f7924c tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:10.790288 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-276b4f13-be00-455b-8bf1-4bca20f7924c tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:10.792029 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-276b4f13-be00-455b-8bf1-4bca20f7924c tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:10.793848 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-276b4f13-be00-455b-8bf1-4bca20f7924c tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:10.798078 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-276b4f13-be00-455b-8bf1-4bca20f7924c tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:10.802172 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-276b4f13-be00-455b-8bf1-4bca20f7924c tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:11.025487 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8bd9c701-c4f5-447f-b8c2-7184265e3d5e tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:01:11.027547 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-8bd9c701-c4f5-447f-b8c2-7184265e3d5e tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] [instance: 243cbbbd-0734-4711-b605-c0657b81e359] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:01:11.042878 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8bd9c701-c4f5-447f-b8c2-7184265e3d5e tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:11.043379 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8bd9c701-c4f5-447f-b8c2-7184265e3d5e tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:11.043828 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8bd9c701-c4f5-447f-b8c2-7184265e3d5e tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:11.046061 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8bd9c701-c4f5-447f-b8c2-7184265e3d5e tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:11.050426 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8bd9c701-c4f5-447f-b8c2-7184265e3d5e tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:11.051870 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8bd9c701-c4f5-447f-b8c2-7184265e3d5e tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:11.676695 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-276b4f13-be00-455b-8bf1-4bca20f7924c tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6513f5e908ac4d028cad6eeeebeab285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65946afc398d4a9fb1c9095a4f946e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:01:11.684680 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-276b4f13-be00-455b-8bf1-4bca20f7924c tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc" status: 200 len: 1505 microversion: 2.1 time: 0.944491 Oct 04 21:01:11.685185 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2562/5098] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:01:10 2022] GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc => generated 1505 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:01:11.724669 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-3b99bf5a-436d-4a93-8807-c36047b07d26 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:01:11.725503 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-3b99bf5a-436d-4a93-8807-c36047b07d26 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] [instance: 320f9a98-969f-473e-bc56-842bbd28dedc] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:01:11.731978 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3b99bf5a-436d-4a93-8807-c36047b07d26 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:11.732470 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3b99bf5a-436d-4a93-8807-c36047b07d26 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:11.732900 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3b99bf5a-436d-4a93-8807-c36047b07d26 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:11.733611 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3b99bf5a-436d-4a93-8807-c36047b07d26 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:11.734058 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3b99bf5a-436d-4a93-8807-c36047b07d26 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:11.737187 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3b99bf5a-436d-4a93-8807-c36047b07d26 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:11.779864 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-8bd9c701-c4f5-447f-b8c2-7184265e3d5e tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5dbe3da6a4af181ef7302fe605fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3aa23aee3c8435c8f1f409019c5fed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:01:11.791867 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-8bd9c701-c4f5-447f-b8c2-7184265e3d5e tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] 10.222.0.33 "GET /compute/v2.1/servers/243cbbbd-0734-4711-b605-c0657b81e359" status: 200 len: 1694 microversion: 2.1 time: 0.771707 Oct 04 21:01:11.792461 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2537/5099] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:01:11 2022] GET /compute/v2.1/servers/243cbbbd-0734-4711-b605-c0657b81e359 => generated 1694 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:01:12.619341 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-3b99bf5a-436d-4a93-8807-c36047b07d26 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6513f5e908ac4d028cad6eeeebeab285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65946afc398d4a9fb1c9095a4f946e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:01:12.636933 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-3b99bf5a-436d-4a93-8807-c36047b07d26 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc" status: 200 len: 1505 microversion: 2.1 time: 0.924994 Oct 04 21:01:12.650155 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2563/5100] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:01:11 2022] GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc => generated 1505 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:01:12.669160 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-68518726-2d24-4e12-ad3f-b827292f02ac tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:01:12.670145 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-68518726-2d24-4e12-ad3f-b827292f02ac tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] [instance: 320f9a98-969f-473e-bc56-842bbd28dedc] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:01:12.677904 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-68518726-2d24-4e12-ad3f-b827292f02ac tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:12.678436 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-68518726-2d24-4e12-ad3f-b827292f02ac tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:12.678881 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-68518726-2d24-4e12-ad3f-b827292f02ac tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:12.679671 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-68518726-2d24-4e12-ad3f-b827292f02ac tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:12.680285 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-68518726-2d24-4e12-ad3f-b827292f02ac tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:12.680889 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-68518726-2d24-4e12-ad3f-b827292f02ac tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:12.822019 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-b12457ea-574e-4cce-8aac-3da97bb7a983 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:01:12.823496 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-b12457ea-574e-4cce-8aac-3da97bb7a983 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] [instance: 243cbbbd-0734-4711-b605-c0657b81e359] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:01:12.839228 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b12457ea-574e-4cce-8aac-3da97bb7a983 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:12.839760 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b12457ea-574e-4cce-8aac-3da97bb7a983 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:12.840399 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b12457ea-574e-4cce-8aac-3da97bb7a983 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:12.841139 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b12457ea-574e-4cce-8aac-3da97bb7a983 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:12.841661 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b12457ea-574e-4cce-8aac-3da97bb7a983 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:12.842102 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b12457ea-574e-4cce-8aac-3da97bb7a983 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:13.283310 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-68518726-2d24-4e12-ad3f-b827292f02ac tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6513f5e908ac4d028cad6eeeebeab285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65946afc398d4a9fb1c9095a4f946e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:01:13.302154 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-68518726-2d24-4e12-ad3f-b827292f02ac tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc" status: 200 len: 1505 microversion: 2.1 time: 0.638071 Oct 04 21:01:13.318377 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2538/5101] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:01:12 2022] GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc => generated 1505 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:01:13.332982 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f74477b9-7ba1-491b-bdc7-b7400f8555c2 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:01:13.340489 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-f74477b9-7ba1-491b-bdc7-b7400f8555c2 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] HTTP exception thrown: Instance 7ead09c8-0305-48bf-9ced-9631f4aee06d has no mapping to a cell. Oct 04 21:01:13.351508 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f74477b9-7ba1-491b-bdc7-b7400f8555c2 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Request method failure captured: Oct 04 21:01:13.351508 n-d-854823-8 devstack@n-api.service[128801]: request: POST /compute/v2.1/servers/7ead09c8-0305-48bf-9ced-9631f4aee06d/action HTTP/1.1 Oct 04 21:01:13.351508 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 21:01:13.351508 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 21:01:13.351508 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 21:01:13.351508 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 15 Oct 04 21:01:13.351508 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 21:01:13.351508 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 21:01:13.351508 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 21:01:13.351508 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 21:01:13.351508 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJ4eaBM_FLl2jaN3nQraRbM94DgE-qlLjkCPNJ1Ol7VvkbIGIp-m_lAuwAay2VJ7lXD5niLtaDpJGDoHOJTljuI2aLuReHvX6jQr-uTgC01ZM2s7p6j6gq6a-1PaGQN0mcmcJntCqSnEEt5MEM6DdrOOdi5eEtsfyNU4EpDYmca-Ylo Oct 04 21:01:13.351508 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 21:01:13.351508 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 21:01:13.351508 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 21:01:13.351508 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 21:01:13.351508 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 21:01:13.351508 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 21:01:13.351508 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: 65946afc398d4a9fb1c9095a4f946e07 Oct 04 21:01:13.351508 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-ServersNegativeTestJSON-1097186397 Oct 04 21:01:13.351508 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 21:01:13.351508 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 21:01:13.351508 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_65946afc398d4a9fb1c9095a4f946e07", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/65946afc398d4a9fb1c9095a4f946e07"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/65946afc398d4a9fb1c9095a4f946e07"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/65946afc398d4a9fb1c9095a4f946e07"}]}] Oct 04 21:01:13.351508 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-ServersNegativeTestJSON-1097186397 Oct 04 21:01:13.351508 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: 65946afc398d4a9fb1c9095a4f946e07 Oct 04 21:01:13.351508 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1097186397 Oct 04 21:01:13.351508 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-ServersNegativeTestJSON-1097186397-project Oct 04 21:01:13.351508 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 21:01:13.351508 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 21:01:13.351508 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: 6513f5e908ac4d028cad6eeeebeab285 Oct 04 21:01:13.351508 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-ServersNegativeTestJSON-1097186397-project Oct 04 21:01:13.351508 n-d-854823-8 devstack@n-api.service[128801]: Oct 04 21:01:13.351508 n-d-854823-8 devstack@n-api.service[128801]: {"os-stop": {}} Oct 04 21:01:13.351508 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 21:01:13.351508 n-d-854823-8 devstack@n-api.service[128801]: exception: Instance 7ead09c8-0305-48bf-9ced-9631f4aee06d has no mapping to a cell. Oct 04 21:01:13.351508 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': '7ead09c8-0305-48bf-9ced-9631f4aee06d', 'body': {'os-stop': {}}} Oct 04 21:01:13.351508 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:01:13.351508 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:01:13.351508 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1411, in _get_instance Oct 04 21:01:13.351508 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi mapping = objects.InstanceMapping.get_by_instance_uuid( Oct 04 21:01:13.351508 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 21:01:13.351508 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 21:01:13.351508 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 112, in get_by_instance_uuid Oct 04 21:01:13.351508 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_instance_uuid_from_db(context, instance_uuid) Oct 04 21:01:13.351508 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 21:01:13.351508 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 21:01:13.351508 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 106, in _get_by_instance_uuid_from_db Oct 04 21:01:13.351508 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceMappingNotFound(uuid=instance_uuid) Oct 04 21:01:13.351508 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceMappingNotFound: Instance 7ead09c8-0305-48bf-9ced-9631f4aee06d has no mapping to a cell. Oct 04 21:01:13.351508 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:01:13.351508 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:01:13.351508 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:01:13.351508 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:01:13.351508 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:01:13.351508 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:01:13.351508 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:01:13.351508 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:01:13.351508 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:01:13.351508 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:01:13.351508 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1444, in _stop_server Oct 04 21:01:13.351508 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, id) Oct 04 21:01:13.351508 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1418, in _get_instance Oct 04 21:01:13.351508 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:01:13.351508 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ead09c8-0305-48bf-9ced-9631f4aee06d has no mapping to a cell. Oct 04 21:01:13.355314 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:01:13.355314 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:01:13.355314 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:01:13.355314 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:01:13.355314 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:01:13.355314 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:01:13.355314 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:01:13.355314 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:01:13.355314 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ead09c8-0305-48bf-9ced-9631f4aee06d has no mapping to a cell. Oct 04 21:01:13.355314 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:01:13.358557 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f74477b9-7ba1-491b-bdc7-b7400f8555c2 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Returning 404 to user: Instance 7ead09c8-0305-48bf-9ced-9631f4aee06d has no mapping to a cell. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:01:13.360283 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f74477b9-7ba1-491b-bdc7-b7400f8555c2 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "POST /compute/v2.1/servers/7ead09c8-0305-48bf-9ced-9631f4aee06d/action" status: 404 len: 117 microversion: 2.1 time: 0.032506 Oct 04 21:01:13.361621 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2539/5102] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 21:01:13 2022] POST /compute/v2.1/servers/7ead09c8-0305-48bf-9ced-9631f4aee06d/action => generated 117 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:01:13.376468 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a66f78b5-4126-49a9-8904-9747ae4bebf6 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:01:13.377758 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a66f78b5-4126-49a9-8904-9747ae4bebf6 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] [instance: 320f9a98-969f-473e-bc56-842bbd28dedc] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:01:13.391489 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a66f78b5-4126-49a9-8904-9747ae4bebf6 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:13.394054 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a66f78b5-4126-49a9-8904-9747ae4bebf6 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:13.398056 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a66f78b5-4126-49a9-8904-9747ae4bebf6 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:13.399663 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a66f78b5-4126-49a9-8904-9747ae4bebf6 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:13.400368 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a66f78b5-4126-49a9-8904-9747ae4bebf6 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:13.401743 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a66f78b5-4126-49a9-8904-9747ae4bebf6 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:13.425104 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-b12457ea-574e-4cce-8aac-3da97bb7a983 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5dbe3da6a4af181ef7302fe605fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3aa23aee3c8435c8f1f409019c5fed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:01:13.435915 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-b12457ea-574e-4cce-8aac-3da97bb7a983 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] 10.222.0.33 "GET /compute/v2.1/servers/243cbbbd-0734-4711-b605-c0657b81e359" status: 200 len: 1692 microversion: 2.1 time: 0.618179 Oct 04 21:01:13.452479 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2564/5103] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:01:12 2022] GET /compute/v2.1/servers/243cbbbd-0734-4711-b605-c0657b81e359 => generated 1692 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:01:13.734380 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-a66f78b5-4126-49a9-8904-9747ae4bebf6 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6513f5e908ac4d028cad6eeeebeab285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65946afc398d4a9fb1c9095a4f946e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:01:13.764309 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a66f78b5-4126-49a9-8904-9747ae4bebf6 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc" status: 200 len: 1505 microversion: 2.1 time: 0.396198 Oct 04 21:01:13.782371 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2540/5104] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:01:13 2022] GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc => generated 1505 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:01:13.798657 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-c8cb96dc-f48e-4933-a429-a46b68192a76 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:01:13.799789 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-c8cb96dc-f48e-4933-a429-a46b68192a76 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] [instance: 320f9a98-969f-473e-bc56-842bbd28dedc] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:01:13.807935 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c8cb96dc-f48e-4933-a429-a46b68192a76 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:13.808670 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c8cb96dc-f48e-4933-a429-a46b68192a76 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:13.809416 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c8cb96dc-f48e-4933-a429-a46b68192a76 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:13.810445 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c8cb96dc-f48e-4933-a429-a46b68192a76 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:13.811095 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c8cb96dc-f48e-4933-a429-a46b68192a76 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:13.812045 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c8cb96dc-f48e-4933-a429-a46b68192a76 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:14.123179 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-c8cb96dc-f48e-4933-a429-a46b68192a76 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6513f5e908ac4d028cad6eeeebeab285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65946afc398d4a9fb1c9095a4f946e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:01:14.133531 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-c8cb96dc-f48e-4933-a429-a46b68192a76 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc" status: 200 len: 1505 microversion: 2.1 time: 0.339866 Oct 04 21:01:14.146743 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2565/5105] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:01:13 2022] GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc => generated 1505 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:01:14.162952 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-41535c0d-b70a-4662-905c-b5d8f586b78e tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:01:14.163499 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-41535c0d-b70a-4662-905c-b5d8f586b78e tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] [instance: aa57809e-465f-42ac-bca9-7d5ddda82a56] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:01:14.169532 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=88,nova_api:UPDATE=2,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:01:14.171277 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-41535c0d-b70a-4662-905c-b5d8f586b78e tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] HTTP exception thrown: Instance aa57809e-465f-42ac-bca9-7d5ddda82a56 could not be found. Oct 04 21:01:14.173723 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-41535c0d-b70a-4662-905c-b5d8f586b78e tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Request method failure captured: Oct 04 21:01:14.173723 n-d-854823-8 devstack@n-api.service[128801]: request: POST /compute/v2.1/servers/aa57809e-465f-42ac-bca9-7d5ddda82a56/action HTTP/1.1 Oct 04 21:01:14.173723 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 21:01:14.173723 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 21:01:14.173723 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 21:01:14.173723 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 15 Oct 04 21:01:14.173723 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 21:01:14.173723 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 21:01:14.173723 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 21:01:14.173723 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 21:01:14.173723 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJ4eaBM_FLl2jaN3nQraRbM94DgE-qlLjkCPNJ1Ol7VvkbIGIp-m_lAuwAay2VJ7lXD5niLtaDpJGDoHOJTljuI2aLuReHvX6jQr-uTgC01ZM2s7p6j6gq6a-1PaGQN0mcmcJntCqSnEEt5MEM6DdrOOdi5eEtsfyNU4EpDYmca-Ylo Oct 04 21:01:14.173723 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 21:01:14.173723 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 21:01:14.173723 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 21:01:14.173723 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 21:01:14.173723 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 21:01:14.173723 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 21:01:14.173723 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: 65946afc398d4a9fb1c9095a4f946e07 Oct 04 21:01:14.173723 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-ServersNegativeTestJSON-1097186397 Oct 04 21:01:14.173723 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 21:01:14.173723 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 21:01:14.173723 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_65946afc398d4a9fb1c9095a4f946e07", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/65946afc398d4a9fb1c9095a4f946e07"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/65946afc398d4a9fb1c9095a4f946e07"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/65946afc398d4a9fb1c9095a4f946e07"}]}] Oct 04 21:01:14.173723 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-ServersNegativeTestJSON-1097186397 Oct 04 21:01:14.173723 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: 65946afc398d4a9fb1c9095a4f946e07 Oct 04 21:01:14.173723 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1097186397 Oct 04 21:01:14.173723 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-ServersNegativeTestJSON-1097186397-project Oct 04 21:01:14.173723 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 21:01:14.173723 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 21:01:14.173723 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: 6513f5e908ac4d028cad6eeeebeab285 Oct 04 21:01:14.173723 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-ServersNegativeTestJSON-1097186397-project Oct 04 21:01:14.173723 n-d-854823-8 devstack@n-api.service[128801]: Oct 04 21:01:14.173723 n-d-854823-8 devstack@n-api.service[128801]: {"suspend": {}} Oct 04 21:01:14.173723 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 21:01:14.173723 n-d-854823-8 devstack@n-api.service[128801]: exception: Instance aa57809e-465f-42ac-bca9-7d5ddda82a56 could not be found. Oct 04 21:01:14.173723 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': 'aa57809e-465f-42ac-bca9-7d5ddda82a56', 'body': {'suspend': {}}} Oct 04 21:01:14.173723 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:01:14.173723 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:01:14.173723 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:01:14.173723 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:01:14.173723 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:01:14.173723 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:01:14.173723 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 21:01:14.173723 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 21:01:14.173723 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa57809e-465f-42ac-bca9-7d5ddda82a56 could not be found. Oct 04 21:01:14.173723 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:01:14.173723 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:01:14.173723 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:01:14.173723 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:01:14.173723 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:01:14.173723 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:01:14.173723 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:01:14.173723 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:01:14.173723 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:01:14.173723 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:01:14.173723 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 35, in _suspend Oct 04 21:01:14.173723 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Oct 04 21:01:14.173723 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:01:14.173723 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:01:14.173723 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa57809e-465f-42ac-bca9-7d5ddda82a56 could not be found. Oct 04 21:01:14.173723 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:01:14.173723 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:01:14.173723 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:01:14.173723 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:01:14.173723 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:01:14.173723 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:01:14.177781 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:01:14.177781 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:01:14.177781 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa57809e-465f-42ac-bca9-7d5ddda82a56 could not be found. Oct 04 21:01:14.177781 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:01:14.179830 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-41535c0d-b70a-4662-905c-b5d8f586b78e tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Returning 404 to user: Instance aa57809e-465f-42ac-bca9-7d5ddda82a56 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:01:14.182153 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-41535c0d-b70a-4662-905c-b5d8f586b78e tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "POST /compute/v2.1/servers/aa57809e-465f-42ac-bca9-7d5ddda82a56/action" status: 404 len: 111 microversion: 2.1 time: 0.024193 Oct 04 21:01:14.183297 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2541/5106] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 21:01:14 2022] POST /compute/v2.1/servers/aa57809e-465f-42ac-bca9-7d5ddda82a56/action => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:01:14.210022 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-a769e878-d85a-405d-bb75-de4ba234af88 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:01:14.211922 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-a769e878-d85a-405d-bb75-de4ba234af88 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] [instance: 320f9a98-969f-473e-bc56-842bbd28dedc] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:01:14.232193 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a769e878-d85a-405d-bb75-de4ba234af88 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:14.232655 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a769e878-d85a-405d-bb75-de4ba234af88 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:14.233163 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a769e878-d85a-405d-bb75-de4ba234af88 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:14.236058 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a769e878-d85a-405d-bb75-de4ba234af88 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:14.236539 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a769e878-d85a-405d-bb75-de4ba234af88 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:14.236979 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a769e878-d85a-405d-bb75-de4ba234af88 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:14.411007 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-47fe03a9-a364-4f1c-ae1b-e2dd427c355e tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-tempest-TestSecurityGroupsBasicOps-1824446933-access_point-354434666", "imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63", "flavorRef": "452", "networks": [{"uuid": "05065cbd-34af-4552-95ca-d6558c649a27"}], "key_name": "tempest-TestSecurityGroupsBasicOps-1879853288", "security_groups": [{"name": "tempest-secgroup_access--1838449591"}, {"name": "tempest-secgroup_general--558723469"}]}, "os:scheduler_hints": {"different_host": []}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:01:14.654755 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-a769e878-d85a-405d-bb75-de4ba234af88 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6513f5e908ac4d028cad6eeeebeab285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65946afc398d4a9fb1c9095a4f946e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:01:14.678470 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-a769e878-d85a-405d-bb75-de4ba234af88 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc" status: 200 len: 1505 microversion: 2.1 time: 0.486483 Oct 04 21:01:14.690485 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2566/5107] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:01:14 2022] GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc => generated 1505 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:01:14.719806 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-7babdc6d-a004-4e54-933a-2ea78da4eda9 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:01:14.725328 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-7babdc6d-a004-4e54-933a-2ea78da4eda9 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] [instance: 243cbbbd-0734-4711-b605-c0657b81e359] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:01:14.748831 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7babdc6d-a004-4e54-933a-2ea78da4eda9 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:14.751335 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7babdc6d-a004-4e54-933a-2ea78da4eda9 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:14.754644 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7babdc6d-a004-4e54-933a-2ea78da4eda9 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:14.756940 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7babdc6d-a004-4e54-933a-2ea78da4eda9 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:14.757610 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7babdc6d-a004-4e54-933a-2ea78da4eda9 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:14.758053 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7babdc6d-a004-4e54-933a-2ea78da4eda9 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:15.001713 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.network.neutron [None req-47fe03a9-a364-4f1c-ae1b-e2dd427c355e tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] validate_networks() for [('05065cbd-34af-4552-95ca-d6558c649a27', None, None, None, None, None)] {{(pid=128801) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:01:15.377268 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-7babdc6d-a004-4e54-933a-2ea78da4eda9 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5dbe3da6a4af181ef7302fe605fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3aa23aee3c8435c8f1f409019c5fed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:01:15.395619 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-7babdc6d-a004-4e54-933a-2ea78da4eda9 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] 10.222.0.33 "GET /compute/v2.1/servers/243cbbbd-0734-4711-b605-c0657b81e359" status: 200 len: 1689 microversion: 2.1 time: 0.713285 Oct 04 21:01:15.403724 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2567/5108] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:01:14 2022] GET /compute/v2.1/servers/243cbbbd-0734-4711-b605-c0657b81e359 => generated 1689 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:01:15.413520 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-3d0ab54e-9312-4cfe-8e28-0c80eed3cdfd tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:01:15.414152 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-3d0ab54e-9312-4cfe-8e28-0c80eed3cdfd tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] [instance: 320f9a98-969f-473e-bc56-842bbd28dedc] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:01:15.434757 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3d0ab54e-9312-4cfe-8e28-0c80eed3cdfd tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:15.435615 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3d0ab54e-9312-4cfe-8e28-0c80eed3cdfd tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:15.436416 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3d0ab54e-9312-4cfe-8e28-0c80eed3cdfd tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:15.437501 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3d0ab54e-9312-4cfe-8e28-0c80eed3cdfd tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:15.438786 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3d0ab54e-9312-4cfe-8e28-0c80eed3cdfd tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:15.439449 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3d0ab54e-9312-4cfe-8e28-0c80eed3cdfd tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:15.890692 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-3d0ab54e-9312-4cfe-8e28-0c80eed3cdfd tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6513f5e908ac4d028cad6eeeebeab285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65946afc398d4a9fb1c9095a4f946e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:01:15.901431 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-3d0ab54e-9312-4cfe-8e28-0c80eed3cdfd tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc" status: 200 len: 1505 microversion: 2.1 time: 0.496417 Oct 04 21:01:15.904289 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2568/5109] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:01:15 2022] GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc => generated 1505 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:01:16.093043 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-681aae7e-b07d-4a10-aac3-3f2c03f9ec86 tempest-QuotasTestJSON-1776707297 tempest-QuotasTestJSON-1776707297-project] Calling method '.version_select at 0x7f3c6f599a60>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:01:16.137502 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-47fe03a9-a364-4f1c-ae1b-e2dd427c355e tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Flavor limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:01:16.138014 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-47fe03a9-a364-4f1c-ae1b-e2dd427c355e tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Image limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:01:16.139820 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-47fe03a9-a364-4f1c-ae1b-e2dd427c355e tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Flavor pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:01:16.140298 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-47fe03a9-a364-4f1c-ae1b-e2dd427c355e tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Image pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:01:16.141411 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-47fe03a9-a364-4f1c-ae1b-e2dd427c355e tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:01:16.156514 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-47fe03a9-a364-4f1c-ae1b-e2dd427c355e tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:16.156992 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-47fe03a9-a364-4f1c-ae1b-e2dd427c355e tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:16.157427 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-47fe03a9-a364-4f1c-ae1b-e2dd427c355e tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:16.158151 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-47fe03a9-a364-4f1c-ae1b-e2dd427c355e tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:16.161455 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-681aae7e-b07d-4a10-aac3-3f2c03f9ec86 tempest-QuotasTestJSON-1776707297 tempest-QuotasTestJSON-1776707297-project] 10.222.0.33 "GET /compute/v2.1/os-quota-sets/a8ee2a5cc9554f24b2da1d32ea2b631e/defaults" status: 200 len: 371 microversion: 2.1 time: 0.249367 Oct 04 21:01:16.162198 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2569/5110] 10.222.0.33 () {58 vars in 1269 bytes} [Tue Oct 4 21:01:15 2022] GET /compute/v2.1/os-quota-sets/a8ee2a5cc9554f24b2da1d32ea2b631e/defaults => generated 371 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:01:16.168939 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-610a1532-92c6-408f-86a8-d39c5b71909b tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:01:16.169625 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-47fe03a9-a364-4f1c-ae1b-e2dd427c355e tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:16.170026 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-610a1532-92c6-408f-86a8-d39c5b71909b tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] [instance: 243cbbbd-0734-4711-b605-c0657b81e359] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:01:16.170134 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-47fe03a9-a364-4f1c-ae1b-e2dd427c355e tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:16.177649 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-610a1532-92c6-408f-86a8-d39c5b71909b tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:16.178496 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-610a1532-92c6-408f-86a8-d39c5b71909b tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:16.179181 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-610a1532-92c6-408f-86a8-d39c5b71909b tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:16.180107 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-610a1532-92c6-408f-86a8-d39c5b71909b tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:16.181408 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-610a1532-92c6-408f-86a8-d39c5b71909b tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:16.182086 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-610a1532-92c6-408f-86a8-d39c5b71909b tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:16.222886 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-47fe03a9-a364-4f1c-ae1b-e2dd427c355e tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Getting quotas for project 8be936dd2db2466990cafbfbfb3a15cf. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:01:16.230041 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-47fe03a9-a364-4f1c-ae1b-e2dd427c355e tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Getting quotas for user 0f3403486e6f4afd8d97f97612110eb5 and project 8be936dd2db2466990cafbfbfb3a15cf. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:01:16.246271 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-47fe03a9-a364-4f1c-ae1b-e2dd427c355e tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Going to run 1 instances... {{(pid=128801) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:01:16.249270 n-d-854823-8 devstack@n-api.service[128801]: WARNING nova.utils [None req-47fe03a9-a364-4f1c-ae1b-e2dd427c355e tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Hostname tempest-server-tempest-TestSecurityGroupsBasicOps-1824446933-access_point-354434666 is longer than 63, truncate it to tempest-server-tempest-TestSecurityGroupsBasicOps-1824446933-ac Oct 04 21:01:16.250978 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-47fe03a9-a364-4f1c-ae1b-e2dd427c355e tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] [instance: 61bb9cf5-6da5-4074-9bb8-ffd1269ea50f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='15b24725-0c99-4bcf-b1fb-907cdf8e2d63',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128801) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:01:16.258208 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-610a1532-92c6-408f-86a8-d39c5b71909b tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] 10.222.0.33 "POST /compute/v2.1/servers/243cbbbd-0734-4711-b605-c0657b81e359/action" status: 204 len: 0 microversion: 2.1 time: 0.094545 Oct 04 21:01:16.259243 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2570/5111] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 21:01:16 2022] POST /compute/v2.1/servers/243cbbbd-0734-4711-b605-c0657b81e359/action => generated 0 bytes in 96 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:01:16.267290 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-e63301d9-f172-4fd7-84fa-193f33273174 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:01:16.268296 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-e63301d9-f172-4fd7-84fa-193f33273174 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] [instance: 320f9a98-969f-473e-bc56-842bbd28dedc] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:01:16.277383 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e63301d9-f172-4fd7-84fa-193f33273174 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:16.278300 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e63301d9-f172-4fd7-84fa-193f33273174 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:16.278994 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e63301d9-f172-4fd7-84fa-193f33273174 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:16.280260 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e63301d9-f172-4fd7-84fa-193f33273174 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:16.280988 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e63301d9-f172-4fd7-84fa-193f33273174 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:16.282211 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e63301d9-f172-4fd7-84fa-193f33273174 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:16.311673 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.objects.instance [None req-e63301d9-f172-4fd7-84fa-193f33273174 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lazy-loading 'flavor' on Instance uuid 320f9a98-969f-473e-bc56-842bbd28dedc {{(pid=128802) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:01:16.317024 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-47fe03a9-a364-4f1c-ae1b-e2dd427c355e tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 457 microversion: 2.1 time: 1.912010 Oct 04 21:01:16.318261 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2542/5112] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 21:01:14 2022] POST /compute/v2.1/servers => generated 457 bytes in 1915 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 21:01:16.323176 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8dcec7e8-1e11-403a-923a-2c10305c8bbf tempest-QuotasTestJSON-1776707297 tempest-QuotasTestJSON-1776707297-project] Calling method '.version_select at 0x7f3c74f5e8b0>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:01:16.481430 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-e63301d9-f172-4fd7-84fa-193f33273174 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "POST /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc/action" status: 202 len: 0 microversion: 2.1 time: 0.218945 Oct 04 21:01:16.484601 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2571/5113] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 21:01:16 2022] POST /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc/action => generated 0 bytes in 225 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:01:16.499482 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-8dcec7e8-1e11-403a-923a-2c10305c8bbf tempest-QuotasTestJSON-1776707297 tempest-QuotasTestJSON-1776707297-project] 10.222.0.33 "GET /compute/v2.1/os-quota-sets/a8ee2a5cc9554f24b2da1d32ea2b631e" status: 200 len: 371 microversion: 2.1 time: 0.179894 Oct 04 21:01:16.501132 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2543/5114] 10.222.0.33 () {58 vars in 1242 bytes} [Tue Oct 4 21:01:16 2022] GET /compute/v2.1/os-quota-sets/a8ee2a5cc9554f24b2da1d32ea2b631e => generated 371 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:01:16.511835 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-d2ca9e40-ec1f-421d-a907-2b7206b4e072 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:01:16.513543 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-d2ca9e40-ec1f-421d-a907-2b7206b4e072 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] [instance: 243cbbbd-0734-4711-b605-c0657b81e359] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:01:16.522989 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7b507b99-fefa-4a41-b7b4-fc7b61e5b46c tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:01:16.523696 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d2ca9e40-ec1f-421d-a907-2b7206b4e072 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:16.524352 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d2ca9e40-ec1f-421d-a907-2b7206b4e072 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:16.524969 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d2ca9e40-ec1f-421d-a907-2b7206b4e072 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:16.525625 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-7b507b99-fefa-4a41-b7b4-fc7b61e5b46c tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] [instance: 61bb9cf5-6da5-4074-9bb8-ffd1269ea50f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:01:16.526221 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d2ca9e40-ec1f-421d-a907-2b7206b4e072 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:16.526846 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d2ca9e40-ec1f-421d-a907-2b7206b4e072 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:16.530946 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d2ca9e40-ec1f-421d-a907-2b7206b4e072 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:17.057713 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-7b507b99-fefa-4a41-b7b4-fc7b61e5b46c tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3403486e6f4afd8d97f97612110eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be936dd2db2466990cafbfbfb3a15cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:01:17.088708 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-7b507b99-fefa-4a41-b7b4-fc7b61e5b46c tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] 10.222.0.33 "GET /compute/v2.1/servers/61bb9cf5-6da5-4074-9bb8-ffd1269ea50f" status: 200 len: 1294 microversion: 2.1 time: 0.585639 Oct 04 21:01:17.090948 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2544/5115] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:01:16 2022] GET /compute/v2.1/servers/61bb9cf5-6da5-4074-9bb8-ffd1269ea50f => generated 1294 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:01:17.127137 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d297fa2b-2b79-492a-8cdd-33a691c076ff tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:01:17.128191 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d297fa2b-2b79-492a-8cdd-33a691c076ff tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] [instance: 320f9a98-969f-473e-bc56-842bbd28dedc] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:01:17.144783 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d297fa2b-2b79-492a-8cdd-33a691c076ff tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:17.146244 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d297fa2b-2b79-492a-8cdd-33a691c076ff tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:17.146860 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d297fa2b-2b79-492a-8cdd-33a691c076ff tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:17.148152 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d297fa2b-2b79-492a-8cdd-33a691c076ff tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:17.150630 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d297fa2b-2b79-492a-8cdd-33a691c076ff tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:17.152629 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d297fa2b-2b79-492a-8cdd-33a691c076ff tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:17.621894 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-d2ca9e40-ec1f-421d-a907-2b7206b4e072 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5dbe3da6a4af181ef7302fe605fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3aa23aee3c8435c8f1f409019c5fed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:01:17.633321 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-d2ca9e40-ec1f-421d-a907-2b7206b4e072 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] 10.222.0.33 "GET /compute/v2.1/servers/243cbbbd-0734-4711-b605-c0657b81e359" status: 200 len: 1689 microversion: 2.1 time: 1.147308 Oct 04 21:01:17.651348 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2572/5116] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:01:16 2022] GET /compute/v2.1/servers/243cbbbd-0734-4711-b605-c0657b81e359 => generated 1689 bytes in 1149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:01:17.678478 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-a86d4ffc-c35a-43c2-89a3-3d09c351a231 tempest-QuotasTestJSON-1776707297 tempest-QuotasTestJSON-1776707297-project] Calling method '.version_select at 0x7f3c6f670dc0>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:01:17.792394 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d297fa2b-2b79-492a-8cdd-33a691c076ff tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6513f5e908ac4d028cad6eeeebeab285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65946afc398d4a9fb1c9095a4f946e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:01:17.807595 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d297fa2b-2b79-492a-8cdd-33a691c076ff tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc" status: 200 len: 1496 microversion: 2.1 time: 0.714357 Oct 04 21:01:17.808215 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2545/5117] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:01:17 2022] GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc => generated 1496 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:01:17.860329 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-fc125f55-6e41-49c0-babe-d8aa5a3f8b86 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:01:17.861882 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-fc125f55-6e41-49c0-babe-d8aa5a3f8b86 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] [instance: 320f9a98-969f-473e-bc56-842bbd28dedc] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:01:17.884183 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fc125f55-6e41-49c0-babe-d8aa5a3f8b86 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:17.884692 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fc125f55-6e41-49c0-babe-d8aa5a3f8b86 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:17.885131 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fc125f55-6e41-49c0-babe-d8aa5a3f8b86 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:17.896448 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fc125f55-6e41-49c0-babe-d8aa5a3f8b86 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:17.896955 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fc125f55-6e41-49c0-babe-d8aa5a3f8b86 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:17.902786 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fc125f55-6e41-49c0-babe-d8aa5a3f8b86 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:18.025903 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-fc125f55-6e41-49c0-babe-d8aa5a3f8b86 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lazy-loading 'flavor' on Instance uuid 320f9a98-969f-473e-bc56-842bbd28dedc {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:01:18.094277 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-fc125f55-6e41-49c0-babe-d8aa5a3f8b86 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] HTTP exception thrown: Cannot 'suspend' instance 320f9a98-969f-473e-bc56-842bbd28dedc while it is in vm_state suspended Oct 04 21:01:18.116301 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-fc125f55-6e41-49c0-babe-d8aa5a3f8b86 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Request method failure captured: Oct 04 21:01:18.116301 n-d-854823-8 devstack@n-api.service[128801]: request: POST /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc/action HTTP/1.1 Oct 04 21:01:18.116301 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 21:01:18.116301 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 21:01:18.116301 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 21:01:18.116301 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 15 Oct 04 21:01:18.116301 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 21:01:18.116301 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 21:01:18.116301 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 21:01:18.116301 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 21:01:18.116301 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJ4eaBM_FLl2jaN3nQraRbM94DgE-qlLjkCPNJ1Ol7VvkbIGIp-m_lAuwAay2VJ7lXD5niLtaDpJGDoHOJTljuI2aLuReHvX6jQr-uTgC01ZM2s7p6j6gq6a-1PaGQN0mcmcJntCqSnEEt5MEM6DdrOOdi5eEtsfyNU4EpDYmca-Ylo Oct 04 21:01:18.116301 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 21:01:18.116301 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 21:01:18.116301 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 21:01:18.116301 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 21:01:18.116301 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 21:01:18.116301 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 21:01:18.116301 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: 65946afc398d4a9fb1c9095a4f946e07 Oct 04 21:01:18.116301 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-ServersNegativeTestJSON-1097186397 Oct 04 21:01:18.116301 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 21:01:18.116301 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 21:01:18.116301 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_65946afc398d4a9fb1c9095a4f946e07", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/65946afc398d4a9fb1c9095a4f946e07"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/65946afc398d4a9fb1c9095a4f946e07"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/65946afc398d4a9fb1c9095a4f946e07"}]}] Oct 04 21:01:18.116301 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-ServersNegativeTestJSON-1097186397 Oct 04 21:01:18.116301 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: 65946afc398d4a9fb1c9095a4f946e07 Oct 04 21:01:18.116301 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1097186397 Oct 04 21:01:18.116301 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-ServersNegativeTestJSON-1097186397-project Oct 04 21:01:18.116301 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 21:01:18.116301 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 21:01:18.116301 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: 6513f5e908ac4d028cad6eeeebeab285 Oct 04 21:01:18.116301 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-ServersNegativeTestJSON-1097186397-project Oct 04 21:01:18.116301 n-d-854823-8 devstack@n-api.service[128801]: Oct 04 21:01:18.116301 n-d-854823-8 devstack@n-api.service[128801]: {"suspend": {}} Oct 04 21:01:18.116301 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 21:01:18.116301 n-d-854823-8 devstack@n-api.service[128801]: exception: Cannot 'suspend' instance 320f9a98-969f-473e-bc56-842bbd28dedc while it is in vm_state suspended Oct 04 21:01:18.116301 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': '320f9a98-969f-473e-bc56-842bbd28dedc', 'body': {'suspend': {}}} Oct 04 21:01:18.116301 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:01:18.116301 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:01:18.116301 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 40, in _suspend Oct 04 21:01:18.116301 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self.compute_api.suspend(context, server) Oct 04 21:01:18.116301 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 04 21:01:18.116301 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 04 21:01:18.116301 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 04 21:01:18.116301 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 04 21:01:18.116301 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 04 21:01:18.116301 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 04 21:01:18.116301 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Oct 04 21:01:18.116301 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 04 21:01:18.116301 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 21:01:18.116301 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 21:01:18.116301 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 04 21:01:18.116301 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 04 21:01:18.116301 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 320f9a98-969f-473e-bc56-842bbd28dedc in vm_state suspended. Cannot suspend while the instance is in this state. Oct 04 21:01:18.116301 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:01:18.116301 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:01:18.116301 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:01:18.116301 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:01:18.116301 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:01:18.116301 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:01:18.116301 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:01:18.116301 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:01:18.116301 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:01:18.116301 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:01:18.116301 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 44, in _suspend Oct 04 21:01:18.116301 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 04 21:01:18.119871 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 04 21:01:18.119871 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 04 21:01:18.119871 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'suspend' instance 320f9a98-969f-473e-bc56-842bbd28dedc while it is in vm_state suspended Oct 04 21:01:18.119871 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:01:18.119871 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:01:18.119871 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:01:18.119871 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:01:18.119871 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:01:18.119871 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:01:18.119871 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:01:18.119871 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:01:18.119871 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'suspend' instance 320f9a98-969f-473e-bc56-842bbd28dedc while it is in vm_state suspended Oct 04 21:01:18.119871 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:01:18.124729 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-fc125f55-6e41-49c0-babe-d8aa5a3f8b86 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Returning 409 to user: Cannot 'suspend' instance 320f9a98-969f-473e-bc56-842bbd28dedc while it is in vm_state suspended {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:01:18.128755 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-fc125f55-6e41-49c0-babe-d8aa5a3f8b86 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "POST /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc/action" status: 409 len: 148 microversion: 2.1 time: 0.293749 Oct 04 21:01:18.130029 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2546/5118] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 21:01:17 2022] POST /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc/action => generated 148 bytes in 296 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 04 21:01:18.145374 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8db7946f-4ccc-453d-823a-60f948376780 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:01:18.146922 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-8db7946f-4ccc-453d-823a-60f948376780 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] [instance: 61bb9cf5-6da5-4074-9bb8-ffd1269ea50f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:01:18.166680 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8db7946f-4ccc-453d-823a-60f948376780 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:18.167542 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8db7946f-4ccc-453d-823a-60f948376780 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:18.168198 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8db7946f-4ccc-453d-823a-60f948376780 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:18.169446 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8db7946f-4ccc-453d-823a-60f948376780 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:18.170125 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8db7946f-4ccc-453d-823a-60f948376780 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:18.172517 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8db7946f-4ccc-453d-823a-60f948376780 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:18.283786 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-a86d4ffc-c35a-43c2-89a3-3d09c351a231 tempest-QuotasTestJSON-1776707297 tempest-QuotasTestJSON-1776707297-project] 10.222.0.33 "GET /compute/v2.1/os-quota-sets/a8ee2a5cc9554f24b2da1d32ea2b631e/defaults" status: 200 len: 371 microversion: 2.1 time: 0.629603 Oct 04 21:01:18.284411 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2573/5119] 10.222.0.33 () {58 vars in 1269 bytes} [Tue Oct 4 21:01:17 2022] GET /compute/v2.1/os-quota-sets/a8ee2a5cc9554f24b2da1d32ea2b631e/defaults => generated 371 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:01:18.301638 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-e6ca79ed-417d-437f-a8c4-e5363eb317f7 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:01:18.303393 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-e6ca79ed-417d-437f-a8c4-e5363eb317f7 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] [instance: 320f9a98-969f-473e-bc56-842bbd28dedc] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:01:18.336100 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-8db7946f-4ccc-453d-823a-60f948376780 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3403486e6f4afd8d97f97612110eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be936dd2db2466990cafbfbfb3a15cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:01:18.347807 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-8db7946f-4ccc-453d-823a-60f948376780 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] 10.222.0.33 "GET /compute/v2.1/servers/61bb9cf5-6da5-4074-9bb8-ffd1269ea50f" status: 200 len: 1346 microversion: 2.1 time: 0.216192 Oct 04 21:01:18.351467 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2547/5120] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:01:18 2022] GET /compute/v2.1/servers/61bb9cf5-6da5-4074-9bb8-ffd1269ea50f => generated 1346 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:01:18.355016 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e6ca79ed-417d-437f-a8c4-e5363eb317f7 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:18.357406 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e6ca79ed-417d-437f-a8c4-e5363eb317f7 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:18.357883 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e6ca79ed-417d-437f-a8c4-e5363eb317f7 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:18.360971 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-461ee1cf-c35c-49f7-a551-0bac49fd9d4d tempest-QuotasTestJSON-1776707297 tempest-QuotasTestJSON-1776707297-project] Calling method '.version_select at 0x7f3c78839160>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:01:18.363662 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e6ca79ed-417d-437f-a8c4-e5363eb317f7 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:18.364174 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e6ca79ed-417d-437f-a8c4-e5363eb317f7 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:18.367609 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e6ca79ed-417d-437f-a8c4-e5363eb317f7 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:18.566746 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-461ee1cf-c35c-49f7-a551-0bac49fd9d4d tempest-QuotasTestJSON-1776707297 tempest-QuotasTestJSON-1776707297-project] 10.222.0.33 "GET /compute/v2.1/os-quota-sets/a8ee2a5cc9554f24b2da1d32ea2b631e" status: 200 len: 371 microversion: 2.1 time: 0.213948 Oct 04 21:01:18.567349 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2548/5121] 10.222.0.33 () {58 vars in 1242 bytes} [Tue Oct 4 21:01:18 2022] GET /compute/v2.1/os-quota-sets/a8ee2a5cc9554f24b2da1d32ea2b631e => generated 371 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:01:18.591489 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2234a256-b32d-4af1-a7c6-8011926cd2e3 tempest-QuotasTestJSON-1776707297 tempest-QuotasTestJSON-1776707297-project] Calling method '.version_select at 0x7f3c740ced30>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:01:18.669178 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:01:18.763239 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-e6ca79ed-417d-437f-a8c4-e5363eb317f7 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "POST /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc/action" status: 202 len: 0 microversion: 2.1 time: 0.431229 Oct 04 21:01:18.764262 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2574/5122] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 21:01:18 2022] POST /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc/action => generated 0 bytes in 479 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:01:18.776448 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-d2c586a3-87e2-43dd-8599-8c6b8418cc73 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:01:18.798585 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-d2c586a3-87e2-43dd-8599-8c6b8418cc73 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] [instance: 243cbbbd-0734-4711-b605-c0657b81e359] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:01:18.861348 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d2c586a3-87e2-43dd-8599-8c6b8418cc73 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:18.862407 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d2c586a3-87e2-43dd-8599-8c6b8418cc73 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:18.867412 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d2c586a3-87e2-43dd-8599-8c6b8418cc73 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:18.868801 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d2c586a3-87e2-43dd-8599-8c6b8418cc73 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:18.873141 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d2c586a3-87e2-43dd-8599-8c6b8418cc73 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:18.873927 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d2c586a3-87e2-43dd-8599-8c6b8418cc73 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:19.358687 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-2234a256-b32d-4af1-a7c6-8011926cd2e3 tempest-QuotasTestJSON-1776707297 tempest-QuotasTestJSON-1776707297-project] 10.222.0.33 "GET /compute/v2.1/os-quota-sets/a8ee2a5cc9554f24b2da1d32ea2b631e?user_id=1e78618eb34d45939e991454df4f09b9" status: 200 len: 371 microversion: 2.1 time: 0.770963 Oct 04 21:01:19.361989 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2549/5123] 10.222.0.33 () {58 vars in 1323 bytes} [Tue Oct 4 21:01:18 2022] GET /compute/v2.1/os-quota-sets/a8ee2a5cc9554f24b2da1d32ea2b631e?user_id=1e78618eb34d45939e991454df4f09b9 => generated 371 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:01:19.376875 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-4978743d-6f10-42f6-ae1d-f75845d6f8c4 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:01:19.377519 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-4978743d-6f10-42f6-ae1d-f75845d6f8c4 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] [instance: 320f9a98-969f-473e-bc56-842bbd28dedc] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:01:19.395486 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4978743d-6f10-42f6-ae1d-f75845d6f8c4 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:19.395907 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4978743d-6f10-42f6-ae1d-f75845d6f8c4 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:19.398628 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4978743d-6f10-42f6-ae1d-f75845d6f8c4 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:19.399613 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4978743d-6f10-42f6-ae1d-f75845d6f8c4 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:19.400242 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4978743d-6f10-42f6-ae1d-f75845d6f8c4 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:19.403004 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4978743d-6f10-42f6-ae1d-f75845d6f8c4 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:19.621287 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-d2c586a3-87e2-43dd-8599-8c6b8418cc73 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5dbe3da6a4af181ef7302fe605fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3aa23aee3c8435c8f1f409019c5fed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:01:19.635911 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-d2c586a3-87e2-43dd-8599-8c6b8418cc73 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] 10.222.0.33 "GET /compute/v2.1/servers/243cbbbd-0734-4711-b605-c0657b81e359" status: 200 len: 1689 microversion: 2.1 time: 0.868609 Oct 04 21:01:19.644975 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2575/5124] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:01:18 2022] GET /compute/v2.1/servers/243cbbbd-0734-4711-b605-c0657b81e359 => generated 1689 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:01:19.668180 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-dcfd92ca-d0d3-46ec-9bfd-57620c388ba2 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:01:19.669122 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-dcfd92ca-d0d3-46ec-9bfd-57620c388ba2 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] [instance: 61bb9cf5-6da5-4074-9bb8-ffd1269ea50f] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:01:19.684652 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dcfd92ca-d0d3-46ec-9bfd-57620c388ba2 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:19.696020 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dcfd92ca-d0d3-46ec-9bfd-57620c388ba2 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:19.696696 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dcfd92ca-d0d3-46ec-9bfd-57620c388ba2 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:19.707741 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dcfd92ca-d0d3-46ec-9bfd-57620c388ba2 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:19.709026 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dcfd92ca-d0d3-46ec-9bfd-57620c388ba2 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:19.713589 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dcfd92ca-d0d3-46ec-9bfd-57620c388ba2 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:19.984755 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-dcfd92ca-d0d3-46ec-9bfd-57620c388ba2 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3403486e6f4afd8d97f97612110eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be936dd2db2466990cafbfbfb3a15cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:01:19.998862 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-dcfd92ca-d0d3-46ec-9bfd-57620c388ba2 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] 10.222.0.33 "GET /compute/v2.1/servers/61bb9cf5-6da5-4074-9bb8-ffd1269ea50f" status: 200 len: 1352 microversion: 2.1 time: 0.352369 Oct 04 21:01:20.004508 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2576/5125] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:01:19 2022] GET /compute/v2.1/servers/61bb9cf5-6da5-4074-9bb8-ffd1269ea50f => generated 1352 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:01:20.509679 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-4978743d-6f10-42f6-ae1d-f75845d6f8c4 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6513f5e908ac4d028cad6eeeebeab285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65946afc398d4a9fb1c9095a4f946e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:01:20.522072 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-4978743d-6f10-42f6-ae1d-f75845d6f8c4 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc" status: 200 len: 1502 microversion: 2.1 time: 1.157243 Oct 04 21:01:20.523215 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2550/5126] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:01:19 2022] GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc => generated 1502 bytes in 1161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:01:20.667451 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-4b2e358d-68f5-44aa-9683-ed85b67bb667 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:01:20.674726 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-4b2e358d-68f5-44aa-9683-ed85b67bb667 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] [instance: 243cbbbd-0734-4711-b605-c0657b81e359] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:01:20.682594 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4b2e358d-68f5-44aa-9683-ed85b67bb667 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:20.683559 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4b2e358d-68f5-44aa-9683-ed85b67bb667 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:20.684224 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4b2e358d-68f5-44aa-9683-ed85b67bb667 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:20.685340 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4b2e358d-68f5-44aa-9683-ed85b67bb667 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:20.693479 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4b2e358d-68f5-44aa-9683-ed85b67bb667 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:20.694318 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4b2e358d-68f5-44aa-9683-ed85b67bb667 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:21.035185 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-cf5f33af-f0b2-4aa7-92e9-11de7f83984d tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:01:21.048195 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-cf5f33af-f0b2-4aa7-92e9-11de7f83984d tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] [instance: 61bb9cf5-6da5-4074-9bb8-ffd1269ea50f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:01:21.065845 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cf5f33af-f0b2-4aa7-92e9-11de7f83984d tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:21.066356 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cf5f33af-f0b2-4aa7-92e9-11de7f83984d tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:21.068833 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cf5f33af-f0b2-4aa7-92e9-11de7f83984d tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:21.069614 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cf5f33af-f0b2-4aa7-92e9-11de7f83984d tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:21.070086 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cf5f33af-f0b2-4aa7-92e9-11de7f83984d tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:21.070554 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cf5f33af-f0b2-4aa7-92e9-11de7f83984d tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:21.631999 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-4b2e358d-68f5-44aa-9683-ed85b67bb667 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5dbe3da6a4af181ef7302fe605fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3aa23aee3c8435c8f1f409019c5fed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:01:21.683637 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-4b2e358d-68f5-44aa-9683-ed85b67bb667 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] 10.222.0.33 "GET /compute/v2.1/servers/243cbbbd-0734-4711-b605-c0657b81e359" status: 200 len: 1689 microversion: 2.1 time: 1.019904 Oct 04 21:01:21.685892 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-cf5f33af-f0b2-4aa7-92e9-11de7f83984d tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3403486e6f4afd8d97f97612110eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be936dd2db2466990cafbfbfb3a15cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:01:21.690705 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2577/5127] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:01:20 2022] GET /compute/v2.1/servers/243cbbbd-0734-4711-b605-c0657b81e359 => generated 1689 bytes in 1028 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:01:21.715038 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-8f1d12c8-26fe-43c9-955e-a29d571b9ffc tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:01:21.720684 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-8f1d12c8-26fe-43c9-955e-a29d571b9ffc tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] [instance: 320f9a98-969f-473e-bc56-842bbd28dedc] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:01:21.730140 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_api:SELECT=78 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:01:21.735534 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-cf5f33af-f0b2-4aa7-92e9-11de7f83984d tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] 10.222.0.33 "GET /compute/v2.1/servers/61bb9cf5-6da5-4074-9bb8-ffd1269ea50f" status: 200 len: 1352 microversion: 2.1 time: 0.704204 Oct 04 21:01:21.739500 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2551/5128] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:01:21 2022] GET /compute/v2.1/servers/61bb9cf5-6da5-4074-9bb8-ffd1269ea50f => generated 1352 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:01:21.759952 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8f1d12c8-26fe-43c9-955e-a29d571b9ffc tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:21.761324 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8f1d12c8-26fe-43c9-955e-a29d571b9ffc tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:21.762018 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8f1d12c8-26fe-43c9-955e-a29d571b9ffc tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:21.764905 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8f1d12c8-26fe-43c9-955e-a29d571b9ffc tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:21.767067 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8f1d12c8-26fe-43c9-955e-a29d571b9ffc tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:21.767734 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8f1d12c8-26fe-43c9-955e-a29d571b9ffc tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:22.718255 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9df1e208-ab31-49eb-9fbe-808e07f96082 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:01:22.718848 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-9df1e208-ab31-49eb-9fbe-808e07f96082 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] [instance: 243cbbbd-0734-4711-b605-c0657b81e359] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:01:22.758978 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9df1e208-ab31-49eb-9fbe-808e07f96082 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:22.759554 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9df1e208-ab31-49eb-9fbe-808e07f96082 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:22.761195 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9df1e208-ab31-49eb-9fbe-808e07f96082 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:22.761960 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9df1e208-ab31-49eb-9fbe-808e07f96082 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:22.763302 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9df1e208-ab31-49eb-9fbe-808e07f96082 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:22.763751 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9df1e208-ab31-49eb-9fbe-808e07f96082 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:22.947348 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-8f1d12c8-26fe-43c9-955e-a29d571b9ffc tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6513f5e908ac4d028cad6eeeebeab285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65946afc398d4a9fb1c9095a4f946e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:01:22.959327 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-8f1d12c8-26fe-43c9-955e-a29d571b9ffc tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc" status: 200 len: 1502 microversion: 2.1 time: 1.266902 Oct 04 21:01:22.995103 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2578/5129] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:01:21 2022] GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc => generated 1502 bytes in 1303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:01:23.005931 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-216bcdd4-103b-4d25-bb79-24973a0e8f32 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:01:23.006989 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-216bcdd4-103b-4d25-bb79-24973a0e8f32 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] [instance: 61bb9cf5-6da5-4074-9bb8-ffd1269ea50f] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:01:23.014201 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-216bcdd4-103b-4d25-bb79-24973a0e8f32 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:23.015069 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-216bcdd4-103b-4d25-bb79-24973a0e8f32 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:23.015804 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-216bcdd4-103b-4d25-bb79-24973a0e8f32 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:23.016745 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-216bcdd4-103b-4d25-bb79-24973a0e8f32 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:23.017414 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-216bcdd4-103b-4d25-bb79-24973a0e8f32 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:23.018062 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-216bcdd4-103b-4d25-bb79-24973a0e8f32 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:23.875511 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-216bcdd4-103b-4d25-bb79-24973a0e8f32 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3403486e6f4afd8d97f97612110eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be936dd2db2466990cafbfbfb3a15cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:01:23.898163 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-216bcdd4-103b-4d25-bb79-24973a0e8f32 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] 10.222.0.33 "GET /compute/v2.1/servers/61bb9cf5-6da5-4074-9bb8-ffd1269ea50f" status: 200 len: 1471 microversion: 2.1 time: 0.898638 Oct 04 21:01:23.920374 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2579/5130] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:01:22 2022] GET /compute/v2.1/servers/61bb9cf5-6da5-4074-9bb8-ffd1269ea50f => generated 1471 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:01:23.944151 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-f2b1f124-a6ce-4ee5-85eb-36ffbcdf616a req-5e589fbb-18ae-40c9-b09c-530edf5079b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "243cbbbd-0734-4711-b605-c0657b81e359", "name": "network-vif-plugged", "status": "completed", "tag": "65760264-f1de-43cd-baca-c370b4c65ec6"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:01:23.998028 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-f2b1f124-a6ce-4ee5-85eb-36ffbcdf616a req-5e589fbb-18ae-40c9-b09c-530edf5079b6 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:23.998703 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-f2b1f124-a6ce-4ee5-85eb-36ffbcdf616a req-5e589fbb-18ae-40c9-b09c-530edf5079b6 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:24.013029 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-f2b1f124-a6ce-4ee5-85eb-36ffbcdf616a req-5e589fbb-18ae-40c9-b09c-530edf5079b6 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:24.033867 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-f2b1f124-a6ce-4ee5-85eb-36ffbcdf616a req-5e589fbb-18ae-40c9-b09c-530edf5079b6 service nova] Creating event network-vif-plugged:65760264-f1de-43cd-baca-c370b4c65ec6 for instance 243cbbbd-0734-4711-b605-c0657b81e359 on n-h1-854823-8 Oct 04 21:01:24.038013 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-9df1e208-ab31-49eb-9fbe-808e07f96082 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5dbe3da6a4af181ef7302fe605fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3aa23aee3c8435c8f1f409019c5fed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:01:24.049323 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-9df1e208-ab31-49eb-9fbe-808e07f96082 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] 10.222.0.33 "GET /compute/v2.1/servers/243cbbbd-0734-4711-b605-c0657b81e359" status: 200 len: 1681 microversion: 2.1 time: 1.332324 Oct 04 21:01:24.051450 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2552/5131] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:01:22 2022] GET /compute/v2.1/servers/243cbbbd-0734-4711-b605-c0657b81e359 => generated 1681 bytes in 1338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:01:24.056557 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-f2b1f124-a6ce-4ee5-85eb-36ffbcdf616a req-5e589fbb-18ae-40c9-b09c-530edf5079b6 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116960 Oct 04 21:01:24.059735 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d598fd6d-cf98-428e-a3e4-abd86a427e9b tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:01:24.060356 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d598fd6d-cf98-428e-a3e4-abd86a427e9b tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] [instance: 320f9a98-969f-473e-bc56-842bbd28dedc] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:01:24.063256 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2580/5132] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:01:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:01:24.068778 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d598fd6d-cf98-428e-a3e4-abd86a427e9b tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:24.069442 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d598fd6d-cf98-428e-a3e4-abd86a427e9b tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:24.070048 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d598fd6d-cf98-428e-a3e4-abd86a427e9b tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:24.071557 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d598fd6d-cf98-428e-a3e4-abd86a427e9b tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:24.072159 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d598fd6d-cf98-428e-a3e4-abd86a427e9b tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:24.072726 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d598fd6d-cf98-428e-a3e4-abd86a427e9b tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:24.516361 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-76d8fca0-3775-4313-ae62-09c54ae132dc req-458da405-6739-4ee3-b37b-640a8b9b67d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "61bb9cf5-6da5-4074-9bb8-ffd1269ea50f", "tag": "bcd2dd15-0ca7-47ca-9e2d-d0c557d550b4"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:01:24.540772 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-76d8fca0-3775-4313-ae62-09c54ae132dc req-458da405-6739-4ee3-b37b-640a8b9b67d3 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:24.541477 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-76d8fca0-3775-4313-ae62-09c54ae132dc req-458da405-6739-4ee3-b37b-640a8b9b67d3 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:24.542009 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-76d8fca0-3775-4313-ae62-09c54ae132dc req-458da405-6739-4ee3-b37b-640a8b9b67d3 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:24.584971 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-76d8fca0-3775-4313-ae62-09c54ae132dc req-458da405-6739-4ee3-b37b-640a8b9b67d3 service nova] Creating event network-changed:bcd2dd15-0ca7-47ca-9e2d-d0c557d550b4 for instance 61bb9cf5-6da5-4074-9bb8-ffd1269ea50f on n-h1-854823-8 Oct 04 21:01:24.594908 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-76d8fca0-3775-4313-ae62-09c54ae132dc req-458da405-6739-4ee3-b37b-640a8b9b67d3 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090082 Oct 04 21:01:24.596770 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2581/5133] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:01:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:01:24.951504 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-d387a2f5-1f53-4a4a-9e1d-3f98f53e3906 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:01:24.960702 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-d387a2f5-1f53-4a4a-9e1d-3f98f53e3906 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] [instance: 61bb9cf5-6da5-4074-9bb8-ffd1269ea50f] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:01:25.012344 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d387a2f5-1f53-4a4a-9e1d-3f98f53e3906 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:25.020376 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d387a2f5-1f53-4a4a-9e1d-3f98f53e3906 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:25.021135 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d387a2f5-1f53-4a4a-9e1d-3f98f53e3906 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:25.031774 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d387a2f5-1f53-4a4a-9e1d-3f98f53e3906 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:25.032467 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d387a2f5-1f53-4a4a-9e1d-3f98f53e3906 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:25.036399 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d387a2f5-1f53-4a4a-9e1d-3f98f53e3906 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:25.109197 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d598fd6d-cf98-428e-a3e4-abd86a427e9b tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6513f5e908ac4d028cad6eeeebeab285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65946afc398d4a9fb1c9095a4f946e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:01:25.118925 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d598fd6d-cf98-428e-a3e4-abd86a427e9b tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc" status: 200 len: 1505 microversion: 2.1 time: 1.066312 Oct 04 21:01:25.122469 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2553/5134] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:01:24 2022] GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc => generated 1505 bytes in 1070 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:01:25.152510 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-41650e88-07bb-4ff2-84a1-30c5def9f3c4 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:01:25.153350 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-41650e88-07bb-4ff2-84a1-30c5def9f3c4 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] [instance: 320f9a98-969f-473e-bc56-842bbd28dedc] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:01:25.164516 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-41650e88-07bb-4ff2-84a1-30c5def9f3c4 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:25.166288 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-41650e88-07bb-4ff2-84a1-30c5def9f3c4 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:25.169572 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-41650e88-07bb-4ff2-84a1-30c5def9f3c4 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:25.173384 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-41650e88-07bb-4ff2-84a1-30c5def9f3c4 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:25.174189 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-41650e88-07bb-4ff2-84a1-30c5def9f3c4 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:25.174862 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-41650e88-07bb-4ff2-84a1-30c5def9f3c4 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:25.478244 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-41650e88-07bb-4ff2-84a1-30c5def9f3c4 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6513f5e908ac4d028cad6eeeebeab285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65946afc398d4a9fb1c9095a4f946e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:01:25.489063 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-41650e88-07bb-4ff2-84a1-30c5def9f3c4 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc" status: 200 len: 1505 microversion: 2.1 time: 0.341692 Oct 04 21:01:25.489856 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2554/5135] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:01:25 2022] GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc => generated 1505 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:01:25.516957 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b8c18c34-1e33-4131-bab3-ce060d2a36a4 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:01:25.517897 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b8c18c34-1e33-4131-bab3-ce060d2a36a4 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] [instance: 174118bc-f55c-471a-bd03-930c6ffc042e] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:01:25.527067 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-b8c18c34-1e33-4131-bab3-ce060d2a36a4 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] HTTP exception thrown: Instance 174118bc-f55c-471a-bd03-930c6ffc042e could not be found. Oct 04 21:01:25.532593 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b8c18c34-1e33-4131-bab3-ce060d2a36a4 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Request method failure captured: Oct 04 21:01:25.532593 n-d-854823-8 devstack@n-api.service[128801]: request: POST /compute/v2.1/servers/174118bc-f55c-471a-bd03-930c6ffc042e/action HTTP/1.1 Oct 04 21:01:25.532593 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 21:01:25.532593 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 21:01:25.532593 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 21:01:25.532593 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 15 Oct 04 21:01:25.532593 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 21:01:25.532593 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 21:01:25.532593 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 21:01:25.532593 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 21:01:25.532593 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJ4eaBM_FLl2jaN3nQraRbM94DgE-qlLjkCPNJ1Ol7VvkbIGIp-m_lAuwAay2VJ7lXD5niLtaDpJGDoHOJTljuI2aLuReHvX6jQr-uTgC01ZM2s7p6j6gq6a-1PaGQN0mcmcJntCqSnEEt5MEM6DdrOOdi5eEtsfyNU4EpDYmca-Ylo Oct 04 21:01:25.532593 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 21:01:25.532593 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 21:01:25.532593 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 21:01:25.532593 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 21:01:25.532593 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 21:01:25.532593 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 21:01:25.532593 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: 65946afc398d4a9fb1c9095a4f946e07 Oct 04 21:01:25.532593 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-ServersNegativeTestJSON-1097186397 Oct 04 21:01:25.532593 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 21:01:25.532593 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 21:01:25.532593 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_65946afc398d4a9fb1c9095a4f946e07", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/65946afc398d4a9fb1c9095a4f946e07"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/65946afc398d4a9fb1c9095a4f946e07"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/65946afc398d4a9fb1c9095a4f946e07"}]}] Oct 04 21:01:25.532593 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-ServersNegativeTestJSON-1097186397 Oct 04 21:01:25.532593 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: 65946afc398d4a9fb1c9095a4f946e07 Oct 04 21:01:25.532593 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1097186397 Oct 04 21:01:25.532593 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-ServersNegativeTestJSON-1097186397-project Oct 04 21:01:25.532593 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 21:01:25.532593 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 21:01:25.532593 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: 6513f5e908ac4d028cad6eeeebeab285 Oct 04 21:01:25.532593 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-ServersNegativeTestJSON-1097186397-project Oct 04 21:01:25.532593 n-d-854823-8 devstack@n-api.service[128801]: Oct 04 21:01:25.532593 n-d-854823-8 devstack@n-api.service[128801]: {"unpause": {}} Oct 04 21:01:25.532593 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 21:01:25.532593 n-d-854823-8 devstack@n-api.service[128801]: exception: Instance 174118bc-f55c-471a-bd03-930c6ffc042e could not be found. Oct 04 21:01:25.532593 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': '174118bc-f55c-471a-bd03-930c6ffc042e', 'body': {'unpause': {}}} Oct 04 21:01:25.532593 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:01:25.532593 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:01:25.532593 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:01:25.532593 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:01:25.532593 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:01:25.532593 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:01:25.532593 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 21:01:25.532593 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 21:01:25.532593 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 174118bc-f55c-471a-bd03-930c6ffc042e could not be found. Oct 04 21:01:25.532593 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:01:25.532593 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:01:25.532593 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:01:25.532593 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:01:25.532593 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:01:25.532593 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:01:25.532593 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:01:25.532593 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:01:25.532593 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:01:25.532593 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:01:25.532593 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 58, in _unpause Oct 04 21:01:25.532593 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Oct 04 21:01:25.532593 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:01:25.532593 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:01:25.532593 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 174118bc-f55c-471a-bd03-930c6ffc042e could not be found. Oct 04 21:01:25.532593 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:01:25.532593 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:01:25.532593 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:01:25.532593 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:01:25.532593 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:01:25.532593 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:01:25.538744 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:01:25.538744 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:01:25.538744 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 174118bc-f55c-471a-bd03-930c6ffc042e could not be found. Oct 04 21:01:25.538744 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:01:25.538744 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b8c18c34-1e33-4131-bab3-ce060d2a36a4 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Returning 404 to user: Instance 174118bc-f55c-471a-bd03-930c6ffc042e could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:01:25.538744 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b8c18c34-1e33-4131-bab3-ce060d2a36a4 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "POST /compute/v2.1/servers/174118bc-f55c-471a-bd03-930c6ffc042e/action" status: 404 len: 111 microversion: 2.1 time: 0.023616 Oct 04 21:01:25.538744 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2555/5136] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 21:01:25 2022] POST /compute/v2.1/servers/174118bc-f55c-471a-bd03-930c6ffc042e/action => generated 111 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 21:01:25.545943 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-3f2474b3-f65d-4d94-aa54-4625c7c06a50 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:01:25.552076 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-3f2474b3-f65d-4d94-aa54-4625c7c06a50 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] [instance: 320f9a98-969f-473e-bc56-842bbd28dedc] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:01:25.569081 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3f2474b3-f65d-4d94-aa54-4625c7c06a50 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:25.569859 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3f2474b3-f65d-4d94-aa54-4625c7c06a50 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:25.570468 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3f2474b3-f65d-4d94-aa54-4625c7c06a50 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:25.571345 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3f2474b3-f65d-4d94-aa54-4625c7c06a50 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:25.571955 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3f2474b3-f65d-4d94-aa54-4625c7c06a50 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:25.572546 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3f2474b3-f65d-4d94-aa54-4625c7c06a50 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:25.864725 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-d387a2f5-1f53-4a4a-9e1d-3f98f53e3906 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3403486e6f4afd8d97f97612110eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be936dd2db2466990cafbfbfb3a15cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:01:25.876449 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-d387a2f5-1f53-4a4a-9e1d-3f98f53e3906 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] 10.222.0.33 "GET /compute/v2.1/servers/61bb9cf5-6da5-4074-9bb8-ffd1269ea50f" status: 200 len: 1471 microversion: 2.1 time: 0.932965 Oct 04 21:01:25.877926 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2582/5137] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:01:24 2022] GET /compute/v2.1/servers/61bb9cf5-6da5-4074-9bb8-ffd1269ea50f => generated 1471 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:01:25.969876 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-3f2474b3-f65d-4d94-aa54-4625c7c06a50 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6513f5e908ac4d028cad6eeeebeab285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65946afc398d4a9fb1c9095a4f946e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:01:25.977752 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-3f2474b3-f65d-4d94-aa54-4625c7c06a50 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc" status: 200 len: 1505 microversion: 2.1 time: 0.435713 Oct 04 21:01:25.987782 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2556/5138] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:01:25 2022] GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc => generated 1505 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:01:26.005960 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-99b92e2a-4577-43ac-983e-b7d3696a151a tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:01:26.006614 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-99b92e2a-4577-43ac-983e-b7d3696a151a tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] [instance: 320f9a98-969f-473e-bc56-842bbd28dedc] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:01:26.019904 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-99b92e2a-4577-43ac-983e-b7d3696a151a tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:26.021601 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-99b92e2a-4577-43ac-983e-b7d3696a151a tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:26.024003 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-99b92e2a-4577-43ac-983e-b7d3696a151a tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:26.026372 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-99b92e2a-4577-43ac-983e-b7d3696a151a tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:26.027056 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-99b92e2a-4577-43ac-983e-b7d3696a151a tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:26.028074 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-99b92e2a-4577-43ac-983e-b7d3696a151a tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:26.528156 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-99b92e2a-4577-43ac-983e-b7d3696a151a tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6513f5e908ac4d028cad6eeeebeab285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65946afc398d4a9fb1c9095a4f946e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:01:26.539680 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-99b92e2a-4577-43ac-983e-b7d3696a151a tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc" status: 200 len: 1505 microversion: 2.1 time: 0.537483 Oct 04 21:01:26.541097 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2583/5139] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:01:26 2022] GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc => generated 1505 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:01:26.569359 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-60415e49-686b-4b21-a8ea-31b274259e28 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:01:26.569916 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-60415e49-686b-4b21-a8ea-31b274259e28 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] [instance: 320f9a98-969f-473e-bc56-842bbd28dedc] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:01:26.571895 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:01:26.580471 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-60415e49-686b-4b21-a8ea-31b274259e28 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:26.591155 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-60415e49-686b-4b21-a8ea-31b274259e28 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:26.591892 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-60415e49-686b-4b21-a8ea-31b274259e28 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:26.592809 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-60415e49-686b-4b21-a8ea-31b274259e28 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:26.593418 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-60415e49-686b-4b21-a8ea-31b274259e28 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:26.594052 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-60415e49-686b-4b21-a8ea-31b274259e28 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:26.646026 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-60415e49-686b-4b21-a8ea-31b274259e28 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] HTTP exception thrown: Cannot 'unpause' instance 320f9a98-969f-473e-bc56-842bbd28dedc while it is in vm_state active Oct 04 21:01:26.649847 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-60415e49-686b-4b21-a8ea-31b274259e28 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Request method failure captured: Oct 04 21:01:26.649847 n-d-854823-8 devstack@n-api.service[128801]: request: POST /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc/action HTTP/1.1 Oct 04 21:01:26.649847 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 21:01:26.649847 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 21:01:26.649847 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 21:01:26.649847 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 15 Oct 04 21:01:26.649847 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 21:01:26.649847 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 21:01:26.649847 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 21:01:26.649847 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 21:01:26.649847 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJ4eaBM_FLl2jaN3nQraRbM94DgE-qlLjkCPNJ1Ol7VvkbIGIp-m_lAuwAay2VJ7lXD5niLtaDpJGDoHOJTljuI2aLuReHvX6jQr-uTgC01ZM2s7p6j6gq6a-1PaGQN0mcmcJntCqSnEEt5MEM6DdrOOdi5eEtsfyNU4EpDYmca-Ylo Oct 04 21:01:26.649847 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 21:01:26.649847 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 21:01:26.649847 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 21:01:26.649847 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 21:01:26.649847 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 21:01:26.649847 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 21:01:26.649847 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: 65946afc398d4a9fb1c9095a4f946e07 Oct 04 21:01:26.649847 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-ServersNegativeTestJSON-1097186397 Oct 04 21:01:26.649847 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 21:01:26.649847 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 21:01:26.649847 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_65946afc398d4a9fb1c9095a4f946e07", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/65946afc398d4a9fb1c9095a4f946e07"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/65946afc398d4a9fb1c9095a4f946e07"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/65946afc398d4a9fb1c9095a4f946e07"}]}] Oct 04 21:01:26.649847 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-ServersNegativeTestJSON-1097186397 Oct 04 21:01:26.649847 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: 65946afc398d4a9fb1c9095a4f946e07 Oct 04 21:01:26.649847 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1097186397 Oct 04 21:01:26.649847 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-ServersNegativeTestJSON-1097186397-project Oct 04 21:01:26.649847 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 21:01:26.649847 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 21:01:26.649847 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: 6513f5e908ac4d028cad6eeeebeab285 Oct 04 21:01:26.649847 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-ServersNegativeTestJSON-1097186397-project Oct 04 21:01:26.649847 n-d-854823-8 devstack@n-api.service[128801]: Oct 04 21:01:26.649847 n-d-854823-8 devstack@n-api.service[128801]: {"unpause": {}} Oct 04 21:01:26.649847 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 21:01:26.649847 n-d-854823-8 devstack@n-api.service[128801]: exception: Cannot 'unpause' instance 320f9a98-969f-473e-bc56-842bbd28dedc while it is in vm_state active Oct 04 21:01:26.649847 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': '320f9a98-969f-473e-bc56-842bbd28dedc', 'body': {'unpause': {}}} Oct 04 21:01:26.649847 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:01:26.649847 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:01:26.649847 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 62, in _unpause Oct 04 21:01:26.649847 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self.compute_api.unpause(ctxt, server) Oct 04 21:01:26.649847 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 21:01:26.649847 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 21:01:26.649847 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 04 21:01:26.649847 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 04 21:01:26.649847 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 320f9a98-969f-473e-bc56-842bbd28dedc in vm_state active. Cannot unpause while the instance is in this state. Oct 04 21:01:26.649847 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:01:26.649847 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:01:26.649847 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:01:26.649847 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:01:26.649847 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:01:26.649847 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:01:26.649847 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:01:26.649847 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:01:26.649847 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:01:26.649847 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:01:26.649847 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 66, in _unpause Oct 04 21:01:26.649847 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 04 21:01:26.649847 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 04 21:01:26.649847 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 04 21:01:26.649847 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unpause' instance 320f9a98-969f-473e-bc56-842bbd28dedc while it is in vm_state active Oct 04 21:01:26.649847 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:01:26.649847 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:01:26.649847 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:01:26.649847 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:01:26.649847 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:01:26.654262 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:01:26.654262 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:01:26.654262 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:01:26.654262 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unpause' instance 320f9a98-969f-473e-bc56-842bbd28dedc while it is in vm_state active Oct 04 21:01:26.654262 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:01:26.654919 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-60415e49-686b-4b21-a8ea-31b274259e28 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Returning 409 to user: Cannot 'unpause' instance 320f9a98-969f-473e-bc56-842bbd28dedc while it is in vm_state active {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:01:26.657573 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-60415e49-686b-4b21-a8ea-31b274259e28 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "POST /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc/action" status: 409 len: 145 microversion: 2.1 time: 0.092356 Oct 04 21:01:26.659714 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2557/5140] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 21:01:26 2022] POST /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc/action => generated 145 bytes in 95 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 04 21:01:26.669902 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-49ec6188-59b4-4537-8ec0-f050e4b31211 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:01:26.670560 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-49ec6188-59b4-4537-8ec0-f050e4b31211 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] [instance: 320f9a98-969f-473e-bc56-842bbd28dedc] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:01:26.708223 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-49ec6188-59b4-4537-8ec0-f050e4b31211 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:26.708954 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-49ec6188-59b4-4537-8ec0-f050e4b31211 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:26.709409 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-49ec6188-59b4-4537-8ec0-f050e4b31211 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:26.710160 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-49ec6188-59b4-4537-8ec0-f050e4b31211 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:26.710644 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-49ec6188-59b4-4537-8ec0-f050e4b31211 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:26.711070 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-49ec6188-59b4-4537-8ec0-f050e4b31211 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:26.902052 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8d3dc74d-d6bf-41b9-a63a-75ecf1930238 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:01:26.902841 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-8d3dc74d-d6bf-41b9-a63a-75ecf1930238 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] [instance: 61bb9cf5-6da5-4074-9bb8-ffd1269ea50f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:01:26.914391 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8d3dc74d-d6bf-41b9-a63a-75ecf1930238 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:26.926690 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8d3dc74d-d6bf-41b9-a63a-75ecf1930238 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:26.927377 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8d3dc74d-d6bf-41b9-a63a-75ecf1930238 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:26.933197 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8d3dc74d-d6bf-41b9-a63a-75ecf1930238 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:26.943159 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8d3dc74d-d6bf-41b9-a63a-75ecf1930238 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:26.944941 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8d3dc74d-d6bf-41b9-a63a-75ecf1930238 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:27.101062 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-49ec6188-59b4-4537-8ec0-f050e4b31211 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6513f5e908ac4d028cad6eeeebeab285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65946afc398d4a9fb1c9095a4f946e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:01:27.109180 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-49ec6188-59b4-4537-8ec0-f050e4b31211 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc" status: 200 len: 1505 microversion: 2.1 time: 0.444765 Oct 04 21:01:27.133582 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2584/5141] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:01:26 2022] GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc => generated 1505 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:01:27.138728 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-734ba63e-3d2d-48c5-b718-22e347492c1f tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:01:27.139333 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-734ba63e-3d2d-48c5-b718-22e347492c1f tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] [instance: 320f9a98-969f-473e-bc56-842bbd28dedc] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:01:27.156571 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-734ba63e-3d2d-48c5-b718-22e347492c1f tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:27.159727 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-734ba63e-3d2d-48c5-b718-22e347492c1f tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:27.160507 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-734ba63e-3d2d-48c5-b718-22e347492c1f tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:27.161861 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-734ba63e-3d2d-48c5-b718-22e347492c1f tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:27.164736 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-734ba63e-3d2d-48c5-b718-22e347492c1f tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:27.165382 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-734ba63e-3d2d-48c5-b718-22e347492c1f tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:27.881472 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-8d3dc74d-d6bf-41b9-a63a-75ecf1930238 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3403486e6f4afd8d97f97612110eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be936dd2db2466990cafbfbfb3a15cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:01:27.898335 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-8d3dc74d-d6bf-41b9-a63a-75ecf1930238 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] 10.222.0.33 "GET /compute/v2.1/servers/61bb9cf5-6da5-4074-9bb8-ffd1269ea50f" status: 200 len: 1471 microversion: 2.1 time: 1.001387 Oct 04 21:01:27.900211 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2558/5142] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:01:26 2022] GET /compute/v2.1/servers/61bb9cf5-6da5-4074-9bb8-ffd1269ea50f => generated 1471 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:01:27.925795 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-734ba63e-3d2d-48c5-b718-22e347492c1f tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6513f5e908ac4d028cad6eeeebeab285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65946afc398d4a9fb1c9095a4f946e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:01:27.944227 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-734ba63e-3d2d-48c5-b718-22e347492c1f tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc" status: 200 len: 1505 microversion: 2.1 time: 0.809392 Oct 04 21:01:27.944821 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2585/5143] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:01:27 2022] GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc => generated 1505 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:01:27.967151 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-613fa2b4-53c1-4fc4-abd2-79a12f75cd56 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:01:27.968005 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-613fa2b4-53c1-4fc4-abd2-79a12f75cd56 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] [instance: e9c7cb7a-83d3-4f49-8169-4df15b2038c9] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:01:27.974868 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-613fa2b4-53c1-4fc4-abd2-79a12f75cd56 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] HTTP exception thrown: Instance e9c7cb7a-83d3-4f49-8169-4df15b2038c9 could not be found. Oct 04 21:01:27.976610 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-613fa2b4-53c1-4fc4-abd2-79a12f75cd56 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Request method failure captured: Oct 04 21:01:27.976610 n-d-854823-8 devstack@n-api.service[128801]: request: POST /compute/v2.1/servers/e9c7cb7a-83d3-4f49-8169-4df15b2038c9/action HTTP/1.1 Oct 04 21:01:27.976610 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 21:01:27.976610 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 21:01:27.976610 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 21:01:27.976610 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 18 Oct 04 21:01:27.976610 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 21:01:27.976610 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 21:01:27.976610 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 21:01:27.976610 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 21:01:27.976610 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJ4eaBM_FLl2jaN3nQraRbM94DgE-qlLjkCPNJ1Ol7VvkbIGIp-m_lAuwAay2VJ7lXD5niLtaDpJGDoHOJTljuI2aLuReHvX6jQr-uTgC01ZM2s7p6j6gq6a-1PaGQN0mcmcJntCqSnEEt5MEM6DdrOOdi5eEtsfyNU4EpDYmca-Ylo Oct 04 21:01:27.976610 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 21:01:27.976610 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 21:01:27.976610 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 21:01:27.976610 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 21:01:27.976610 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 21:01:27.976610 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 21:01:27.976610 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: 65946afc398d4a9fb1c9095a4f946e07 Oct 04 21:01:27.976610 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-ServersNegativeTestJSON-1097186397 Oct 04 21:01:27.976610 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 21:01:27.976610 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 21:01:27.976610 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_65946afc398d4a9fb1c9095a4f946e07", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/65946afc398d4a9fb1c9095a4f946e07"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/65946afc398d4a9fb1c9095a4f946e07"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/65946afc398d4a9fb1c9095a4f946e07"}]}] Oct 04 21:01:27.976610 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-ServersNegativeTestJSON-1097186397 Oct 04 21:01:27.976610 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: 65946afc398d4a9fb1c9095a4f946e07 Oct 04 21:01:27.976610 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1097186397 Oct 04 21:01:27.976610 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-ServersNegativeTestJSON-1097186397-project Oct 04 21:01:27.976610 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 21:01:27.976610 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 21:01:27.976610 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: 6513f5e908ac4d028cad6eeeebeab285 Oct 04 21:01:27.976610 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-ServersNegativeTestJSON-1097186397-project Oct 04 21:01:27.976610 n-d-854823-8 devstack@n-api.service[128801]: Oct 04 21:01:27.976610 n-d-854823-8 devstack@n-api.service[128801]: {"unshelve": null} Oct 04 21:01:27.976610 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 21:01:27.976610 n-d-854823-8 devstack@n-api.service[128801]: exception: Instance e9c7cb7a-83d3-4f49-8169-4df15b2038c9 could not be found. Oct 04 21:01:27.976610 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': 'e9c7cb7a-83d3-4f49-8169-4df15b2038c9', 'body': {'unshelve': None}} Oct 04 21:01:27.976610 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:01:27.976610 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:01:27.976610 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:01:27.976610 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:01:27.976610 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:01:27.976610 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:01:27.976610 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 21:01:27.976610 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 21:01:27.976610 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e9c7cb7a-83d3-4f49-8169-4df15b2038c9 could not be found. Oct 04 21:01:27.976610 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:01:27.976610 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:01:27.976610 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:01:27.976610 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:01:27.976610 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:01:27.976610 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:01:27.976610 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:01:27.976610 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:01:27.976610 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:01:27.976610 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:01:27.976610 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:01:27.976610 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:01:27.976610 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:01:27.976610 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:01:27.976610 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 102, in _unshelve Oct 04 21:01:27.976610 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 04 21:01:27.976610 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:01:27.976610 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:01:27.976610 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9c7cb7a-83d3-4f49-8169-4df15b2038c9 could not be found. Oct 04 21:01:27.976610 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:01:27.976610 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:01:27.980833 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:01:27.980833 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:01:27.980833 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:01:27.980833 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:01:27.980833 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:01:27.980833 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:01:27.980833 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9c7cb7a-83d3-4f49-8169-4df15b2038c9 could not be found. Oct 04 21:01:27.980833 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:01:27.981998 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-613fa2b4-53c1-4fc4-abd2-79a12f75cd56 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Returning 404 to user: Instance e9c7cb7a-83d3-4f49-8169-4df15b2038c9 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:01:27.983034 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-613fa2b4-53c1-4fc4-abd2-79a12f75cd56 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "POST /compute/v2.1/servers/e9c7cb7a-83d3-4f49-8169-4df15b2038c9/action" status: 404 len: 111 microversion: 2.1 time: 0.019892 Oct 04 21:01:27.992221 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-dfd10b1a-be35-4567-98bb-9cc840b0c48a tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:01:27.993067 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-dfd10b1a-be35-4567-98bb-9cc840b0c48a tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] [instance: 320f9a98-969f-473e-bc56-842bbd28dedc] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:01:27.998067 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2559/5144] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 21:01:27 2022] POST /compute/v2.1/servers/e9c7cb7a-83d3-4f49-8169-4df15b2038c9/action => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:01:28.000704 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dfd10b1a-be35-4567-98bb-9cc840b0c48a tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:28.001383 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dfd10b1a-be35-4567-98bb-9cc840b0c48a tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:28.002002 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dfd10b1a-be35-4567-98bb-9cc840b0c48a tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:28.002949 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dfd10b1a-be35-4567-98bb-9cc840b0c48a tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:28.003597 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dfd10b1a-be35-4567-98bb-9cc840b0c48a tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:28.004202 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dfd10b1a-be35-4567-98bb-9cc840b0c48a tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:28.432414 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-dfd10b1a-be35-4567-98bb-9cc840b0c48a tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6513f5e908ac4d028cad6eeeebeab285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65946afc398d4a9fb1c9095a4f946e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:01:28.456032 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-dfd10b1a-be35-4567-98bb-9cc840b0c48a tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc" status: 200 len: 1505 microversion: 2.1 time: 0.467579 Oct 04 21:01:28.456639 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2586/5145] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:01:27 2022] GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc => generated 1505 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:01:28.485844 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-86fd98cc-1a5e-400c-abc3-7325700a1a9a tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:01:28.486487 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-86fd98cc-1a5e-400c-abc3-7325700a1a9a tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] [instance: 320f9a98-969f-473e-bc56-842bbd28dedc] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:01:28.503746 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-86fd98cc-1a5e-400c-abc3-7325700a1a9a tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:28.504308 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-86fd98cc-1a5e-400c-abc3-7325700a1a9a tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:28.504611 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-86fd98cc-1a5e-400c-abc3-7325700a1a9a tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:28.505325 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-86fd98cc-1a5e-400c-abc3-7325700a1a9a tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:28.505776 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-86fd98cc-1a5e-400c-abc3-7325700a1a9a tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:28.506384 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-86fd98cc-1a5e-400c-abc3-7325700a1a9a tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:28.510926 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=100 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:01:28.891126 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-86fd98cc-1a5e-400c-abc3-7325700a1a9a tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6513f5e908ac4d028cad6eeeebeab285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65946afc398d4a9fb1c9095a4f946e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:01:28.901222 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-86fd98cc-1a5e-400c-abc3-7325700a1a9a tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc" status: 200 len: 1505 microversion: 2.1 time: 0.419473 Oct 04 21:01:28.902962 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2560/5146] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:01:28 2022] GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc => generated 1505 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:01:28.933502 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-17843672-fbe4-4aaf-b0e7-8253b5fa5366 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:01:28.934535 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-17843672-fbe4-4aaf-b0e7-8253b5fa5366 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] [instance: 61bb9cf5-6da5-4074-9bb8-ffd1269ea50f] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:01:28.935723 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-74f18f7c-1f8a-4e4a-a074-b4e79bb240c1 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:01:28.936570 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-74f18f7c-1f8a-4e4a-a074-b4e79bb240c1 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] [instance: 320f9a98-969f-473e-bc56-842bbd28dedc] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:01:28.944308 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-17843672-fbe4-4aaf-b0e7-8253b5fa5366 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:28.945961 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-17843672-fbe4-4aaf-b0e7-8253b5fa5366 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:28.946513 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-17843672-fbe4-4aaf-b0e7-8253b5fa5366 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:28.947978 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-74f18f7c-1f8a-4e4a-a074-b4e79bb240c1 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:28.948909 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-17843672-fbe4-4aaf-b0e7-8253b5fa5366 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:28.949774 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-17843672-fbe4-4aaf-b0e7-8253b5fa5366 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:28.950091 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-74f18f7c-1f8a-4e4a-a074-b4e79bb240c1 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:28.951508 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-74f18f7c-1f8a-4e4a-a074-b4e79bb240c1 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:28.952100 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-17843672-fbe4-4aaf-b0e7-8253b5fa5366 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:28.953739 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-74f18f7c-1f8a-4e4a-a074-b4e79bb240c1 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:28.956292 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-74f18f7c-1f8a-4e4a-a074-b4e79bb240c1 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:28.957492 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-74f18f7c-1f8a-4e4a-a074-b4e79bb240c1 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:29.020284 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-74f18f7c-1f8a-4e4a-a074-b4e79bb240c1 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] HTTP exception thrown: Cannot 'unshelve' instance 320f9a98-969f-473e-bc56-842bbd28dedc while it is in vm_state active Oct 04 21:01:29.023926 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-74f18f7c-1f8a-4e4a-a074-b4e79bb240c1 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Request method failure captured: Oct 04 21:01:29.023926 n-d-854823-8 devstack@n-api.service[128801]: request: POST /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc/action HTTP/1.1 Oct 04 21:01:29.023926 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 21:01:29.023926 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 21:01:29.023926 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 21:01:29.023926 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 18 Oct 04 21:01:29.023926 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 21:01:29.023926 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 21:01:29.023926 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 21:01:29.023926 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 21:01:29.023926 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJ4eaBM_FLl2jaN3nQraRbM94DgE-qlLjkCPNJ1Ol7VvkbIGIp-m_lAuwAay2VJ7lXD5niLtaDpJGDoHOJTljuI2aLuReHvX6jQr-uTgC01ZM2s7p6j6gq6a-1PaGQN0mcmcJntCqSnEEt5MEM6DdrOOdi5eEtsfyNU4EpDYmca-Ylo Oct 04 21:01:29.023926 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 21:01:29.023926 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 21:01:29.023926 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 21:01:29.023926 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 21:01:29.023926 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 21:01:29.023926 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 21:01:29.023926 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: 65946afc398d4a9fb1c9095a4f946e07 Oct 04 21:01:29.023926 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-ServersNegativeTestJSON-1097186397 Oct 04 21:01:29.023926 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 21:01:29.023926 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 21:01:29.023926 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_65946afc398d4a9fb1c9095a4f946e07", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/65946afc398d4a9fb1c9095a4f946e07"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/65946afc398d4a9fb1c9095a4f946e07"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/65946afc398d4a9fb1c9095a4f946e07"}]}] Oct 04 21:01:29.023926 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-ServersNegativeTestJSON-1097186397 Oct 04 21:01:29.023926 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: 65946afc398d4a9fb1c9095a4f946e07 Oct 04 21:01:29.023926 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1097186397 Oct 04 21:01:29.023926 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-ServersNegativeTestJSON-1097186397-project Oct 04 21:01:29.023926 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 21:01:29.023926 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 21:01:29.023926 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: 6513f5e908ac4d028cad6eeeebeab285 Oct 04 21:01:29.023926 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-ServersNegativeTestJSON-1097186397-project Oct 04 21:01:29.023926 n-d-854823-8 devstack@n-api.service[128801]: Oct 04 21:01:29.023926 n-d-854823-8 devstack@n-api.service[128801]: {"unshelve": null} Oct 04 21:01:29.023926 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 21:01:29.023926 n-d-854823-8 devstack@n-api.service[128801]: exception: Cannot 'unshelve' instance 320f9a98-969f-473e-bc56-842bbd28dedc while it is in vm_state active Oct 04 21:01:29.023926 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': '320f9a98-969f-473e-bc56-842bbd28dedc', 'body': {'unshelve': None}} Oct 04 21:01:29.023926 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:01:29.023926 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:01:29.023926 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 124, in _unshelve Oct 04 21:01:29.023926 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self.compute_api.unshelve( Oct 04 21:01:29.023926 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 04 21:01:29.023926 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 21:01:29.023926 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 21:01:29.023926 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 21:01:29.023926 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 04 21:01:29.023926 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 04 21:01:29.023926 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 320f9a98-969f-473e-bc56-842bbd28dedc in vm_state active. Cannot unshelve while the instance is in this state. Oct 04 21:01:29.023926 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:01:29.023926 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:01:29.023926 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:01:29.023926 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:01:29.023926 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:01:29.023926 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:01:29.023926 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:01:29.023926 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:01:29.023926 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:01:29.023926 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:01:29.023926 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:01:29.023926 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:01:29.023926 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:01:29.023926 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:01:29.023926 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 137, in _unshelve Oct 04 21:01:29.023926 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Oct 04 21:01:29.023926 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 04 21:01:29.023926 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 04 21:01:29.037859 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unshelve' instance 320f9a98-969f-473e-bc56-842bbd28dedc while it is in vm_state active Oct 04 21:01:29.037859 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:01:29.037859 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:01:29.037859 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:01:29.037859 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:01:29.037859 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:01:29.037859 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:01:29.037859 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:01:29.037859 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:01:29.037859 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unshelve' instance 320f9a98-969f-473e-bc56-842bbd28dedc while it is in vm_state active Oct 04 21:01:29.037859 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:01:29.037859 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-74f18f7c-1f8a-4e4a-a074-b4e79bb240c1 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Returning 409 to user: Cannot 'unshelve' instance 320f9a98-969f-473e-bc56-842bbd28dedc while it is in vm_state active {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:01:29.037859 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-74f18f7c-1f8a-4e4a-a074-b4e79bb240c1 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "POST /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc/action" status: 409 len: 146 microversion: 2.1 time: 0.095859 Oct 04 21:01:29.037859 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2561/5147] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 21:01:28 2022] POST /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc/action => generated 146 bytes in 99 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 04 21:01:29.046287 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c9d25bd5-295c-4ed7-b62b-625d2ec658f5 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:01:29.048743 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c9d25bd5-295c-4ed7-b62b-625d2ec658f5 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] [instance: 320f9a98-969f-473e-bc56-842bbd28dedc] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:01:29.073835 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c9d25bd5-295c-4ed7-b62b-625d2ec658f5 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:29.074633 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c9d25bd5-295c-4ed7-b62b-625d2ec658f5 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:29.101061 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c9d25bd5-295c-4ed7-b62b-625d2ec658f5 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:29.105993 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c9d25bd5-295c-4ed7-b62b-625d2ec658f5 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:29.106646 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c9d25bd5-295c-4ed7-b62b-625d2ec658f5 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:29.110976 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c9d25bd5-295c-4ed7-b62b-625d2ec658f5 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:29.332709 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=16 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:01:29.675808 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-17843672-fbe4-4aaf-b0e7-8253b5fa5366 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3403486e6f4afd8d97f97612110eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be936dd2db2466990cafbfbfb3a15cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:01:29.691664 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-17843672-fbe4-4aaf-b0e7-8253b5fa5366 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] 10.222.0.33 "GET /compute/v2.1/servers/61bb9cf5-6da5-4074-9bb8-ffd1269ea50f" status: 200 len: 1471 microversion: 2.1 time: 0.766142 Oct 04 21:01:29.692834 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2587/5148] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:01:28 2022] GET /compute/v2.1/servers/61bb9cf5-6da5-4074-9bb8-ffd1269ea50f => generated 1471 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:01:29.738611 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c9d25bd5-295c-4ed7-b62b-625d2ec658f5 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6513f5e908ac4d028cad6eeeebeab285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65946afc398d4a9fb1c9095a4f946e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:01:29.759080 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c9d25bd5-295c-4ed7-b62b-625d2ec658f5 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc" status: 200 len: 1505 microversion: 2.1 time: 0.716309 Oct 04 21:01:29.760508 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2562/5149] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:01:29 2022] GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc => generated 1505 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:01:29.788026 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-e01351c7-2e85-4cdd-8676-3e8c07e51cd0 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:01:29.788778 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-e01351c7-2e85-4cdd-8676-3e8c07e51cd0 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] [instance: 320f9a98-969f-473e-bc56-842bbd28dedc] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:01:29.799370 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e01351c7-2e85-4cdd-8676-3e8c07e51cd0 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:29.815518 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e01351c7-2e85-4cdd-8676-3e8c07e51cd0 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:29.815518 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e01351c7-2e85-4cdd-8676-3e8c07e51cd0 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:29.824525 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e01351c7-2e85-4cdd-8676-3e8c07e51cd0 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:29.832313 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e01351c7-2e85-4cdd-8676-3e8c07e51cd0 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:29.834783 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e01351c7-2e85-4cdd-8676-3e8c07e51cd0 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:30.249018 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-e01351c7-2e85-4cdd-8676-3e8c07e51cd0 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6513f5e908ac4d028cad6eeeebeab285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65946afc398d4a9fb1c9095a4f946e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:01:30.261590 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-e01351c7-2e85-4cdd-8676-3e8c07e51cd0 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc" status: 200 len: 1505 microversion: 2.1 time: 0.482016 Oct 04 21:01:30.267533 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2588/5150] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:01:29 2022] GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc => generated 1505 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:01:30.292558 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-63b3843f-7c8d-4f2f-8ab5-ce46d8180c8f tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1472381053_updated"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:01:30.295750 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-63b3843f-7c8d-4f2f-8ab5-ce46d8180c8f tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] [instance: 2d34b6e8-c193-4a42-acad-ee08d917f009] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:01:30.311417 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-63b3843f-7c8d-4f2f-8ab5-ce46d8180c8f tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] HTTP exception thrown: Instance 2d34b6e8-c193-4a42-acad-ee08d917f009 could not be found. Oct 04 21:01:30.320025 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-63b3843f-7c8d-4f2f-8ab5-ce46d8180c8f tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Request method failure captured: Oct 04 21:01:30.320025 n-d-854823-8 devstack@n-api.service[128801]: request: PUT /compute/v2.1/servers/2d34b6e8-c193-4a42-acad-ee08d917f009 HTTP/1.1 Oct 04 21:01:30.320025 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 21:01:30.320025 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 21:01:30.320025 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 21:01:30.320025 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 81 Oct 04 21:01:30.320025 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 21:01:30.320025 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 21:01:30.320025 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 21:01:30.320025 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 21:01:30.320025 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJ4eaBM_FLl2jaN3nQraRbM94DgE-qlLjkCPNJ1Ol7VvkbIGIp-m_lAuwAay2VJ7lXD5niLtaDpJGDoHOJTljuI2aLuReHvX6jQr-uTgC01ZM2s7p6j6gq6a-1PaGQN0mcmcJntCqSnEEt5MEM6DdrOOdi5eEtsfyNU4EpDYmca-Ylo Oct 04 21:01:30.320025 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 21:01:30.320025 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 21:01:30.320025 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 21:01:30.320025 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 21:01:30.320025 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 21:01:30.320025 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 21:01:30.320025 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: 65946afc398d4a9fb1c9095a4f946e07 Oct 04 21:01:30.320025 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-ServersNegativeTestJSON-1097186397 Oct 04 21:01:30.320025 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 21:01:30.320025 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 21:01:30.320025 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_65946afc398d4a9fb1c9095a4f946e07", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/65946afc398d4a9fb1c9095a4f946e07"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/65946afc398d4a9fb1c9095a4f946e07"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/65946afc398d4a9fb1c9095a4f946e07"}]}] Oct 04 21:01:30.320025 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-ServersNegativeTestJSON-1097186397 Oct 04 21:01:30.320025 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: 65946afc398d4a9fb1c9095a4f946e07 Oct 04 21:01:30.320025 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1097186397 Oct 04 21:01:30.320025 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-ServersNegativeTestJSON-1097186397-project Oct 04 21:01:30.320025 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 21:01:30.320025 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 21:01:30.320025 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: 6513f5e908ac4d028cad6eeeebeab285 Oct 04 21:01:30.320025 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-ServersNegativeTestJSON-1097186397-project Oct 04 21:01:30.320025 n-d-854823-8 devstack@n-api.service[128801]: Oct 04 21:01:30.320025 n-d-854823-8 devstack@n-api.service[128801]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1472381053_updated"}} Oct 04 21:01:30.320025 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 21:01:30.320025 n-d-854823-8 devstack@n-api.service[128801]: exception: Instance 2d34b6e8-c193-4a42-acad-ee08d917f009 could not be found. Oct 04 21:01:30.320025 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': '2d34b6e8-c193-4a42-acad-ee08d917f009', 'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1472381053_updated'}}} Oct 04 21:01:30.320025 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:01:30.320025 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:01:30.320025 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:01:30.320025 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:01:30.320025 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:01:30.320025 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:01:30.320025 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 21:01:30.320025 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 21:01:30.320025 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d34b6e8-c193-4a42-acad-ee08d917f009 could not be found. Oct 04 21:01:30.320025 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:01:30.320025 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:01:30.320025 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:01:30.320025 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:01:30.320025 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:01:30.320025 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:01:30.320025 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:01:30.320025 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:01:30.320025 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:01:30.320025 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:01:30.320025 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:01:30.320025 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:01:30.320025 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:01:30.320025 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:01:30.320025 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:01:30.320025 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:01:30.320025 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 04 21:01:30.320025 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Oct 04 21:01:30.320025 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Oct 04 21:01:30.320025 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:01:30.324479 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:01:30.324479 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:01:30.324479 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:01:30.324479 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d34b6e8-c193-4a42-acad-ee08d917f009 could not be found. Oct 04 21:01:30.324479 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:01:30.324479 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:01:30.324479 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:01:30.324479 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:01:30.324479 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:01:30.324479 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:01:30.324479 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:01:30.324479 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:01:30.324479 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d34b6e8-c193-4a42-acad-ee08d917f009 could not be found. Oct 04 21:01:30.324479 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:01:30.330362 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-63b3843f-7c8d-4f2f-8ab5-ce46d8180c8f tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Returning 404 to user: Instance 2d34b6e8-c193-4a42-acad-ee08d917f009 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:01:30.336331 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-63b3843f-7c8d-4f2f-8ab5-ce46d8180c8f tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "PUT /compute/v2.1/servers/2d34b6e8-c193-4a42-acad-ee08d917f009" status: 404 len: 111 microversion: 2.1 time: 0.048009 Oct 04 21:01:30.337122 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2563/5151] 10.222.0.33 () {60 vars in 1256 bytes} [Tue Oct 4 21:01:30 2022] PUT /compute/v2.1/servers/2d34b6e8-c193-4a42-acad-ee08d917f009 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:01:30.346991 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-21ca7d96-398e-494c-a347-f9823e2648bc tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:01:30.348137 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-21ca7d96-398e-494c-a347-f9823e2648bc tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] [instance: 320f9a98-969f-473e-bc56-842bbd28dedc] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:01:30.360565 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-21ca7d96-398e-494c-a347-f9823e2648bc tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:30.364138 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-21ca7d96-398e-494c-a347-f9823e2648bc tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:30.369377 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-21ca7d96-398e-494c-a347-f9823e2648bc tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:30.371073 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-21ca7d96-398e-494c-a347-f9823e2648bc tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:30.373961 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-21ca7d96-398e-494c-a347-f9823e2648bc tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:30.375227 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-21ca7d96-398e-494c-a347-f9823e2648bc tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:30.716970 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-3a9521dd-75ab-407d-a408-4cc1d9ea5b25 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:01:30.717590 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-3a9521dd-75ab-407d-a408-4cc1d9ea5b25 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] [instance: 61bb9cf5-6da5-4074-9bb8-ffd1269ea50f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:01:30.732184 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3a9521dd-75ab-407d-a408-4cc1d9ea5b25 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:30.733501 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3a9521dd-75ab-407d-a408-4cc1d9ea5b25 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:30.735010 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3a9521dd-75ab-407d-a408-4cc1d9ea5b25 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:30.736069 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3a9521dd-75ab-407d-a408-4cc1d9ea5b25 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:30.738010 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3a9521dd-75ab-407d-a408-4cc1d9ea5b25 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:30.740312 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3a9521dd-75ab-407d-a408-4cc1d9ea5b25 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:31.071494 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-21ca7d96-398e-494c-a347-f9823e2648bc tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6513f5e908ac4d028cad6eeeebeab285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65946afc398d4a9fb1c9095a4f946e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:01:31.095727 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-21ca7d96-398e-494c-a347-f9823e2648bc tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc" status: 200 len: 1505 microversion: 2.1 time: 0.753504 Oct 04 21:01:31.110019 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2589/5152] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:01:30 2022] GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc => generated 1505 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:01:31.128082 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-6ca02f34-a734-4481-b233-8afb836c92d8 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:01:31.129860 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-6ca02f34-a734-4481-b233-8afb836c92d8 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] [instance: 320f9a98-969f-473e-bc56-842bbd28dedc] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:01:31.138327 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6ca02f34-a734-4481-b233-8afb836c92d8 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:31.138856 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6ca02f34-a734-4481-b233-8afb836c92d8 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:31.139305 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6ca02f34-a734-4481-b233-8afb836c92d8 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:31.140032 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6ca02f34-a734-4481-b233-8afb836c92d8 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:31.141125 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6ca02f34-a734-4481-b233-8afb836c92d8 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:31.148603 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6ca02f34-a734-4481-b233-8afb836c92d8 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:31.460297 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-3a9521dd-75ab-407d-a408-4cc1d9ea5b25 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3403486e6f4afd8d97f97612110eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be936dd2db2466990cafbfbfb3a15cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:01:31.468497 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-3a9521dd-75ab-407d-a408-4cc1d9ea5b25 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] 10.222.0.33 "GET /compute/v2.1/servers/61bb9cf5-6da5-4074-9bb8-ffd1269ea50f" status: 200 len: 1471 microversion: 2.1 time: 0.755218 Oct 04 21:01:31.469927 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2564/5153] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:01:30 2022] GET /compute/v2.1/servers/61bb9cf5-6da5-4074-9bb8-ffd1269ea50f => generated 1471 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:01:31.652742 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-6ca02f34-a734-4481-b233-8afb836c92d8 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6513f5e908ac4d028cad6eeeebeab285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65946afc398d4a9fb1c9095a4f946e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:01:31.665211 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-6ca02f34-a734-4481-b233-8afb836c92d8 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc" status: 200 len: 1505 microversion: 2.1 time: 0.544494 Oct 04 21:01:31.670259 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2590/5154] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:01:31 2022] GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc => generated 1505 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:01:31.699829 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d4069b70-a633-49ba-aab2-1b3cfd41fb2b tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Action: 'update', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:01:31.705889 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d4069b70-a633-49ba-aab2-1b3cfd41fb2b tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Request method failure captured: Oct 04 21:01:31.705889 n-d-854823-8 devstack@n-api.service[128801]: request: PUT /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc HTTP/1.1 Oct 04 21:01:31.705889 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 21:01:31.705889 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 21:01:31.705889 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 21:01:31.705889 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 280 Oct 04 21:01:31.705889 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 21:01:31.705889 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 21:01:31.705889 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 21:01:31.705889 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 21:01:31.705889 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJ4eaBM_FLl2jaN3nQraRbM94DgE-qlLjkCPNJ1Ol7VvkbIGIp-m_lAuwAay2VJ7lXD5niLtaDpJGDoHOJTljuI2aLuReHvX6jQr-uTgC01ZM2s7p6j6gq6a-1PaGQN0mcmcJntCqSnEEt5MEM6DdrOOdi5eEtsfyNU4EpDYmca-Ylo Oct 04 21:01:31.705889 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 21:01:31.705889 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 21:01:31.705889 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 21:01:31.705889 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 21:01:31.705889 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 21:01:31.705889 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 21:01:31.705889 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: 65946afc398d4a9fb1c9095a4f946e07 Oct 04 21:01:31.705889 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-ServersNegativeTestJSON-1097186397 Oct 04 21:01:31.705889 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 21:01:31.705889 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 21:01:31.705889 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_65946afc398d4a9fb1c9095a4f946e07", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/65946afc398d4a9fb1c9095a4f946e07"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/65946afc398d4a9fb1c9095a4f946e07"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/65946afc398d4a9fb1c9095a4f946e07"}]}] Oct 04 21:01:31.705889 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-ServersNegativeTestJSON-1097186397 Oct 04 21:01:31.705889 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: 65946afc398d4a9fb1c9095a4f946e07 Oct 04 21:01:31.705889 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1097186397 Oct 04 21:01:31.705889 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-ServersNegativeTestJSON-1097186397-project Oct 04 21:01:31.705889 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 21:01:31.705889 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 21:01:31.705889 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: 6513f5e908ac4d028cad6eeeebeab285 Oct 04 21:01:31.705889 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-ServersNegativeTestJSON-1097186397-project Oct 04 21:01:31.705889 n-d-854823-8 devstack@n-api.service[128801]: Oct 04 21:01:31.705889 n-d-854823-8 devstack@n-api.service[128801]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Oct 04 21:01:31.705889 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 21:01:31.705889 n-d-854823-8 devstack@n-api.service[128801]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 04 21:01:31.705889 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': '320f9a98-969f-473e-bc56-842bbd28dedc', 'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Oct 04 21:01:31.705889 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:01:31.705889 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:01:31.705889 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 21:01:31.705889 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 21:01:31.705889 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 21:01:31.705889 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise error Oct 04 21:01:31.705889 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 04 21:01:31.705889 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:01:31.705889 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Oct 04 21:01:31.705889 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 04 21:01:31.705889 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:01:31.705889 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 04 21:01:31.705889 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 04 21:01:31.705889 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:01:31.705889 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:01:31.705889 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:01:31.705889 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:01:31.709147 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:01:31.709147 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:01:31.709147 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:01:31.709147 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:01:31.709147 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:01:31.709147 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:01:31.709147 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:01:31.709147 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:01:31.709147 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 21:01:31.709147 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 21:01:31.709147 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 21:01:31.709147 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 21:01:31.709147 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 21:01:31.709147 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 21:01:31.709147 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 04 21:01:31.709147 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:01:31.709147 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:01:31.709147 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:01:31.709147 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:01:31.709147 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:01:31.709147 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:01:31.709147 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 21:01:31.709147 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 21:01:31.709147 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 04 21:01:31.709147 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:01:31.709147 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d4069b70-a633-49ba-aab2-1b3cfd41fb2b tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:01:31.709147 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d4069b70-a633-49ba-aab2-1b3cfd41fb2b tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "PUT /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc" status: 400 len: 619 microversion: 2.1 time: 0.013489 Oct 04 21:01:31.716682 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2565/5155] 10.222.0.33 () {60 vars in 1257 bytes} [Tue Oct 4 21:01:31 2022] PUT /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc => generated 619 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 21:01:31.719615 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-7a841931-ad4d-4a7f-89e2-df1b8112e5b8 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:01:31.721033 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-7a841931-ad4d-4a7f-89e2-df1b8112e5b8 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] [instance: 320f9a98-969f-473e-bc56-842bbd28dedc] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:01:31.728370 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7a841931-ad4d-4a7f-89e2-df1b8112e5b8 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:31.728872 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7a841931-ad4d-4a7f-89e2-df1b8112e5b8 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:31.729579 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7a841931-ad4d-4a7f-89e2-df1b8112e5b8 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:31.731056 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7a841931-ad4d-4a7f-89e2-df1b8112e5b8 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:31.731530 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7a841931-ad4d-4a7f-89e2-df1b8112e5b8 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:31.731971 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7a841931-ad4d-4a7f-89e2-df1b8112e5b8 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:32.034758 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-7a841931-ad4d-4a7f-89e2-df1b8112e5b8 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6513f5e908ac4d028cad6eeeebeab285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65946afc398d4a9fb1c9095a4f946e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:01:32.057016 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-7a841931-ad4d-4a7f-89e2-df1b8112e5b8 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc" status: 200 len: 1505 microversion: 2.1 time: 0.339738 Oct 04 21:01:32.081314 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2591/5156] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:01:31 2022] GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc => generated 1505 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:01:32.089253 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-79df404b-73c0-4f43-b32d-e93e94434a40 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:01:32.090485 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-79df404b-73c0-4f43-b32d-e93e94434a40 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] [instance: 320f9a98-969f-473e-bc56-842bbd28dedc] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:01:32.113297 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-79df404b-73c0-4f43-b32d-e93e94434a40 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:32.114125 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-79df404b-73c0-4f43-b32d-e93e94434a40 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:32.114604 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-79df404b-73c0-4f43-b32d-e93e94434a40 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:32.123697 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-79df404b-73c0-4f43-b32d-e93e94434a40 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:32.127633 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-79df404b-73c0-4f43-b32d-e93e94434a40 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:32.128446 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-79df404b-73c0-4f43-b32d-e93e94434a40 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:32.483694 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-79df404b-73c0-4f43-b32d-e93e94434a40 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6513f5e908ac4d028cad6eeeebeab285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65946afc398d4a9fb1c9095a4f946e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:01:32.495393 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-3daa429b-f1cc-44ce-9905-491aab59d40d tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:01:32.496019 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-3daa429b-f1cc-44ce-9905-491aab59d40d tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] [instance: 61bb9cf5-6da5-4074-9bb8-ffd1269ea50f] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:01:32.508087 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-79df404b-73c0-4f43-b32d-e93e94434a40 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc" status: 200 len: 1505 microversion: 2.1 time: 0.425858 Oct 04 21:01:32.511052 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3daa429b-f1cc-44ce-9905-491aab59d40d tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:32.526368 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3daa429b-f1cc-44ce-9905-491aab59d40d tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:32.526368 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3daa429b-f1cc-44ce-9905-491aab59d40d tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:32.526368 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3daa429b-f1cc-44ce-9905-491aab59d40d tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:32.526975 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2566/5157] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:01:32 2022] GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc => generated 1505 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:01:32.527058 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3daa429b-f1cc-44ce-9905-491aab59d40d tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:32.527058 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3daa429b-f1cc-44ce-9905-491aab59d40d tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:32.537885 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-702a25a2-ba4e-4edb-a2f0-8f001587bc1b tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Action: 'update', calling method: >, body: {"server": {"name": ""}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:01:32.551525 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-702a25a2-ba4e-4edb-a2f0-8f001587bc1b tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Request method failure captured: Oct 04 21:01:32.551525 n-d-854823-8 devstack@n-api.service[128801]: request: PUT /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc HTTP/1.1 Oct 04 21:01:32.551525 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 21:01:32.551525 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 21:01:32.551525 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 21:01:32.551525 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 24 Oct 04 21:01:32.551525 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 21:01:32.551525 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 21:01:32.551525 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 21:01:32.551525 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 21:01:32.551525 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJ4eaBM_FLl2jaN3nQraRbM94DgE-qlLjkCPNJ1Ol7VvkbIGIp-m_lAuwAay2VJ7lXD5niLtaDpJGDoHOJTljuI2aLuReHvX6jQr-uTgC01ZM2s7p6j6gq6a-1PaGQN0mcmcJntCqSnEEt5MEM6DdrOOdi5eEtsfyNU4EpDYmca-Ylo Oct 04 21:01:32.551525 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 21:01:32.551525 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 21:01:32.551525 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 21:01:32.551525 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 21:01:32.551525 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 21:01:32.551525 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 21:01:32.551525 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: 65946afc398d4a9fb1c9095a4f946e07 Oct 04 21:01:32.551525 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-ServersNegativeTestJSON-1097186397 Oct 04 21:01:32.551525 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 21:01:32.551525 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 21:01:32.551525 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_65946afc398d4a9fb1c9095a4f946e07", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/65946afc398d4a9fb1c9095a4f946e07"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/65946afc398d4a9fb1c9095a4f946e07"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/65946afc398d4a9fb1c9095a4f946e07"}]}] Oct 04 21:01:32.551525 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-ServersNegativeTestJSON-1097186397 Oct 04 21:01:32.551525 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: 65946afc398d4a9fb1c9095a4f946e07 Oct 04 21:01:32.551525 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1097186397 Oct 04 21:01:32.551525 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-ServersNegativeTestJSON-1097186397-project Oct 04 21:01:32.551525 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 21:01:32.551525 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 21:01:32.551525 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: 6513f5e908ac4d028cad6eeeebeab285 Oct 04 21:01:32.551525 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-ServersNegativeTestJSON-1097186397-project Oct 04 21:01:32.551525 n-d-854823-8 devstack@n-api.service[128801]: Oct 04 21:01:32.551525 n-d-854823-8 devstack@n-api.service[128801]: {"server": {"name": ""}} Oct 04 21:01:32.551525 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 21:01:32.551525 n-d-854823-8 devstack@n-api.service[128801]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 04 21:01:32.551525 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': '320f9a98-969f-473e-bc56-842bbd28dedc', 'body': {'server': {'name': ''}}} Oct 04 21:01:32.551525 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:01:32.551525 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:01:32.551525 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 21:01:32.551525 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 21:01:32.551525 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 21:01:32.551525 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise error Oct 04 21:01:32.551525 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 04 21:01:32.551525 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:01:32.551525 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Oct 04 21:01:32.551525 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 04 21:01:32.551525 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:01:32.551525 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 04 21:01:32.551525 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi '' Oct 04 21:01:32.551525 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:01:32.551525 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:01:32.551525 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:01:32.551525 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:01:32.551525 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:01:32.551525 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:01:32.551525 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:01:32.551525 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:01:32.551525 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:01:32.551525 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:01:32.551525 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:01:32.551525 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:01:32.551525 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 21:01:32.551525 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 21:01:32.551525 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 21:01:32.551525 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 21:01:32.551525 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 21:01:32.551525 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 21:01:32.555365 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 04 21:01:32.555365 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:01:32.555365 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:01:32.555365 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:01:32.555365 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:01:32.555365 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:01:32.555365 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:01:32.555365 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 21:01:32.555365 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 21:01:32.555365 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 04 21:01:32.555365 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:01:32.557816 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-702a25a2-ba4e-4edb-a2f0-8f001587bc1b tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:01:32.559178 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-702a25a2-ba4e-4edb-a2f0-8f001587bc1b tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "PUT /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc" status: 400 len: 108 microversion: 2.1 time: 0.025411 Oct 04 21:01:32.564410 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2567/5158] 10.222.0.33 () {60 vars in 1256 bytes} [Tue Oct 4 21:01:32 2022] PUT /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc => generated 108 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 21:01:32.579098 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a87e2383-81fe-4b56-bca8-98b6daef2325 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:01:32.586087 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a87e2383-81fe-4b56-bca8-98b6daef2325 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] [instance: 320f9a98-969f-473e-bc56-842bbd28dedc] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:01:32.615129 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a87e2383-81fe-4b56-bca8-98b6daef2325 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:32.615782 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a87e2383-81fe-4b56-bca8-98b6daef2325 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:32.616459 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a87e2383-81fe-4b56-bca8-98b6daef2325 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:32.617321 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a87e2383-81fe-4b56-bca8-98b6daef2325 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:32.622849 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a87e2383-81fe-4b56-bca8-98b6daef2325 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:32.623521 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a87e2383-81fe-4b56-bca8-98b6daef2325 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:33.065307 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-a87e2383-81fe-4b56-bca8-98b6daef2325 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6513f5e908ac4d028cad6eeeebeab285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65946afc398d4a9fb1c9095a4f946e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:01:33.078415 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a87e2383-81fe-4b56-bca8-98b6daef2325 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc" status: 200 len: 1505 microversion: 2.1 time: 0.509866 Oct 04 21:01:33.080697 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2568/5159] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:01:32 2022] GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc => generated 1505 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:01:33.127362 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-3daa429b-f1cc-44ce-9905-491aab59d40d tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3403486e6f4afd8d97f97612110eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be936dd2db2466990cafbfbfb3a15cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:01:33.132637 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=100 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:01:33.152288 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-3daa429b-f1cc-44ce-9905-491aab59d40d tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] 10.222.0.33 "GET /compute/v2.1/servers/61bb9cf5-6da5-4074-9bb8-ffd1269ea50f" status: 200 len: 1471 microversion: 2.1 time: 0.663761 Oct 04 21:01:33.154403 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2592/5160] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:01:32 2022] GET /compute/v2.1/servers/61bb9cf5-6da5-4074-9bb8-ffd1269ea50f => generated 1471 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:01:34.177069 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-39396c3f-a33a-4eb8-a00e-ff9307cfb203 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:01:34.178385 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-39396c3f-a33a-4eb8-a00e-ff9307cfb203 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] [instance: 61bb9cf5-6da5-4074-9bb8-ffd1269ea50f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:01:34.193439 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-39396c3f-a33a-4eb8-a00e-ff9307cfb203 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:34.201996 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-39396c3f-a33a-4eb8-a00e-ff9307cfb203 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:34.203918 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-39396c3f-a33a-4eb8-a00e-ff9307cfb203 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:34.207514 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-39396c3f-a33a-4eb8-a00e-ff9307cfb203 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:34.208269 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-39396c3f-a33a-4eb8-a00e-ff9307cfb203 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:34.209907 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-39396c3f-a33a-4eb8-a00e-ff9307cfb203 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:34.929263 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-39396c3f-a33a-4eb8-a00e-ff9307cfb203 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3403486e6f4afd8d97f97612110eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be936dd2db2466990cafbfbfb3a15cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:01:34.949784 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-39396c3f-a33a-4eb8-a00e-ff9307cfb203 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] 10.222.0.33 "GET /compute/v2.1/servers/61bb9cf5-6da5-4074-9bb8-ffd1269ea50f" status: 200 len: 1471 microversion: 2.1 time: 0.774038 Oct 04 21:01:34.951459 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2569/5161] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:01:34 2022] GET /compute/v2.1/servers/61bb9cf5-6da5-4074-9bb8-ffd1269ea50f => generated 1471 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:01:35.981498 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-7c7e4b58-0e19-4b29-ae43-c90377ae96df tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:01:35.982687 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-7c7e4b58-0e19-4b29-ae43-c90377ae96df tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] [instance: 61bb9cf5-6da5-4074-9bb8-ffd1269ea50f] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:01:35.999713 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-6426996d-3d4f-47c8-9b6d-bf950723ce7b req-ec84ac02-cb0a-4e29-aac2-009fddf1a9d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61bb9cf5-6da5-4074-9bb8-ffd1269ea50f", "name": "network-vif-plugged", "status": "completed", "tag": "bcd2dd15-0ca7-47ca-9e2d-d0c557d550b4"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:01:36.005080 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7c7e4b58-0e19-4b29-ae43-c90377ae96df tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:36.006139 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7c7e4b58-0e19-4b29-ae43-c90377ae96df tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:36.010751 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7c7e4b58-0e19-4b29-ae43-c90377ae96df tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:36.011593 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7c7e4b58-0e19-4b29-ae43-c90377ae96df tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:36.012082 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7c7e4b58-0e19-4b29-ae43-c90377ae96df tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:36.013590 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7c7e4b58-0e19-4b29-ae43-c90377ae96df tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:36.019332 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-6426996d-3d4f-47c8-9b6d-bf950723ce7b req-ec84ac02-cb0a-4e29-aac2-009fddf1a9d9 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:36.024097 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-6426996d-3d4f-47c8-9b6d-bf950723ce7b req-ec84ac02-cb0a-4e29-aac2-009fddf1a9d9 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:36.024742 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-6426996d-3d4f-47c8-9b6d-bf950723ce7b req-ec84ac02-cb0a-4e29-aac2-009fddf1a9d9 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:36.085878 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-6426996d-3d4f-47c8-9b6d-bf950723ce7b req-ec84ac02-cb0a-4e29-aac2-009fddf1a9d9 service nova] Creating event network-vif-plugged:bcd2dd15-0ca7-47ca-9e2d-d0c557d550b4 for instance 61bb9cf5-6da5-4074-9bb8-ffd1269ea50f on n-h1-854823-8 Oct 04 21:01:36.096002 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-6426996d-3d4f-47c8-9b6d-bf950723ce7b req-ec84ac02-cb0a-4e29-aac2-009fddf1a9d9 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101415 Oct 04 21:01:36.097197 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2570/5162] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:01:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:01:37.124153 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-7c7e4b58-0e19-4b29-ae43-c90377ae96df tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3403486e6f4afd8d97f97612110eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be936dd2db2466990cafbfbfb3a15cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:01:37.139245 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-7c7e4b58-0e19-4b29-ae43-c90377ae96df tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] 10.222.0.33 "GET /compute/v2.1/servers/61bb9cf5-6da5-4074-9bb8-ffd1269ea50f" status: 200 len: 1471 microversion: 2.1 time: 1.169483 Oct 04 21:01:37.140657 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2593/5163] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:01:35 2022] GET /compute/v2.1/servers/61bb9cf5-6da5-4074-9bb8-ffd1269ea50f => generated 1471 bytes in 1172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:01:38.165735 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-fadfda63-25d5-4a5f-9bc6-1717f6e8cf3f tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:01:38.166977 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-fadfda63-25d5-4a5f-9bc6-1717f6e8cf3f tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] [instance: 61bb9cf5-6da5-4074-9bb8-ffd1269ea50f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:01:38.185687 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fadfda63-25d5-4a5f-9bc6-1717f6e8cf3f tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:38.186189 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fadfda63-25d5-4a5f-9bc6-1717f6e8cf3f tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:38.193254 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fadfda63-25d5-4a5f-9bc6-1717f6e8cf3f tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:38.194134 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fadfda63-25d5-4a5f-9bc6-1717f6e8cf3f tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:38.194653 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fadfda63-25d5-4a5f-9bc6-1717f6e8cf3f tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:38.195103 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fadfda63-25d5-4a5f-9bc6-1717f6e8cf3f tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:38.649828 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-fadfda63-25d5-4a5f-9bc6-1717f6e8cf3f tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3403486e6f4afd8d97f97612110eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be936dd2db2466990cafbfbfb3a15cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:01:38.662801 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-fadfda63-25d5-4a5f-9bc6-1717f6e8cf3f tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] 10.222.0.33 "GET /compute/v2.1/servers/61bb9cf5-6da5-4074-9bb8-ffd1269ea50f" status: 200 len: 1644 microversion: 2.1 time: 0.501042 Oct 04 21:01:38.667339 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2571/5164] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:01:38 2022] GET /compute/v2.1/servers/61bb9cf5-6da5-4074-9bb8-ffd1269ea50f => generated 1644 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:01:38.692651 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-ef783651-711a-4bef-bad3-48252306309e tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:01:38.693266 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-ef783651-711a-4bef-bad3-48252306309e tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] [instance: 61bb9cf5-6da5-4074-9bb8-ffd1269ea50f] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:01:38.710661 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ef783651-711a-4bef-bad3-48252306309e tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:38.714780 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ef783651-711a-4bef-bad3-48252306309e tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:38.716407 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ef783651-711a-4bef-bad3-48252306309e tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:38.720408 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ef783651-711a-4bef-bad3-48252306309e tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:38.722012 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ef783651-711a-4bef-bad3-48252306309e tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:38.724337 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ef783651-711a-4bef-bad3-48252306309e tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:39.790506 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-ef783651-711a-4bef-bad3-48252306309e tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3403486e6f4afd8d97f97612110eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be936dd2db2466990cafbfbfb3a15cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:01:39.804164 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-ef783651-711a-4bef-bad3-48252306309e tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] 10.222.0.33 "GET /compute/v2.1/servers/61bb9cf5-6da5-4074-9bb8-ffd1269ea50f" status: 200 len: 1644 microversion: 2.1 time: 1.115512 Oct 04 21:01:39.806308 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2594/5165] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:01:38 2022] GET /compute/v2.1/servers/61bb9cf5-6da5-4074-9bb8-ffd1269ea50f => generated 1644 bytes in 1118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:01:39.830262 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-f5db27d0-94e8-4014-8dd6-3be27e1e0928 tempest-TestSecurityGroupsBasicOps-953752114 tempest-TestSecurityGroupsBasicOps-953752114-project-admin] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:01:39.831146 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-f5db27d0-94e8-4014-8dd6-3be27e1e0928 tempest-TestSecurityGroupsBasicOps-953752114 tempest-TestSecurityGroupsBasicOps-953752114-project-admin] [instance: 61bb9cf5-6da5-4074-9bb8-ffd1269ea50f] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:01:39.847642 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f5db27d0-94e8-4014-8dd6-3be27e1e0928 tempest-TestSecurityGroupsBasicOps-953752114 tempest-TestSecurityGroupsBasicOps-953752114-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:39.848404 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f5db27d0-94e8-4014-8dd6-3be27e1e0928 tempest-TestSecurityGroupsBasicOps-953752114 tempest-TestSecurityGroupsBasicOps-953752114-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:39.848997 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f5db27d0-94e8-4014-8dd6-3be27e1e0928 tempest-TestSecurityGroupsBasicOps-953752114 tempest-TestSecurityGroupsBasicOps-953752114-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:39.849925 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f5db27d0-94e8-4014-8dd6-3be27e1e0928 tempest-TestSecurityGroupsBasicOps-953752114 tempest-TestSecurityGroupsBasicOps-953752114-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:39.851923 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f5db27d0-94e8-4014-8dd6-3be27e1e0928 tempest-TestSecurityGroupsBasicOps-953752114 tempest-TestSecurityGroupsBasicOps-953752114-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:39.852541 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f5db27d0-94e8-4014-8dd6-3be27e1e0928 tempest-TestSecurityGroupsBasicOps-953752114 tempest-TestSecurityGroupsBasicOps-953752114-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:40.441874 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d85b34ca-3dd4-4c37-afb1-ee9170eebeeb tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Action: 'create', calling method: .version_select at 0x7f3c6efc09d0>, body: {"keypair": {"name": "tempest-keypair-1817073311", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN5sFQOwXvSOuc+SVtlOVHfViAFALoThyEC2S6I9xpblsorROAFRbcLfBlkIaGOwj72o3372KV8alH41nDZEbekOa8RUXdMeJDTME7lvHeJvfeCHxzACfAteMb1xR7Suqg=="}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:01:40.468802 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-d85b34ca-3dd4-4c37-afb1-ee9170eebeeb tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Getting quotas for project 8625c9db98c2475db23d56a965eedb66. Resources: {'key_pairs'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:01:40.487879 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-d85b34ca-3dd4-4c37-afb1-ee9170eebeeb tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Getting quotas for user 9169ee22a4c94b2ab8d092c890bbf3ed and project 8625c9db98c2475db23d56a965eedb66. Resources: {'key_pairs'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:01:40.548909 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d85b34ca-3dd4-4c37-afb1-ee9170eebeeb tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.983983 Oct 04 21:01:40.551053 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2572/5166] 10.222.0.33 () {62 vars in 1200 bytes} [Tue Oct 4 21:01:39 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 993 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 04 21:01:41.304520 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-f5db27d0-94e8-4014-8dd6-3be27e1e0928 tempest-TestSecurityGroupsBasicOps-953752114 tempest-TestSecurityGroupsBasicOps-953752114-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/61bb9cf5-6da5-4074-9bb8-ffd1269ea50f" status: 200 len: 1795 microversion: 2.1 time: 1.478987 Oct 04 21:01:41.319227 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2595/5167] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:01:39 2022] GET /compute/v2.1/servers/61bb9cf5-6da5-4074-9bb8-ffd1269ea50f => generated 1795 bytes in 1482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:01:42.351616 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-148bb736-452b-4180-afb9-2f7eab68fe47 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:01:42.354461 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-148bb736-452b-4180-afb9-2f7eab68fe47 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] [instance: 243cbbbd-0734-4711-b605-c0657b81e359] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:01:42.376501 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-148bb736-452b-4180-afb9-2f7eab68fe47 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:42.380772 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-148bb736-452b-4180-afb9-2f7eab68fe47 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:42.381425 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-148bb736-452b-4180-afb9-2f7eab68fe47 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:42.382194 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-148bb736-452b-4180-afb9-2f7eab68fe47 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:42.384570 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-148bb736-452b-4180-afb9-2f7eab68fe47 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:42.385541 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-148bb736-452b-4180-afb9-2f7eab68fe47 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:42.496859 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-148bb736-452b-4180-afb9-2f7eab68fe47 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] 10.222.0.33 "POST /compute/v2.1/servers/243cbbbd-0734-4711-b605-c0657b81e359/action" status: 200 len: 24575 microversion: 2.1 time: 0.156233 Oct 04 21:01:42.497865 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2573/5168] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 21:01:42 2022] POST /compute/v2.1/servers/243cbbbd-0734-4711-b605-c0657b81e359/action => generated 24575 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 21:01:43.610055 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-28e39bee-a004-4434-9f71-ada8e66ea526 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:01:43.610733 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-28e39bee-a004-4434-9f71-ada8e66ea526 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] [instance: 368d4aa4-81a1-43af-a69b-e5f7004da740] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:01:43.628182 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-28e39bee-a004-4434-9f71-ada8e66ea526 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:43.634062 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-28e39bee-a004-4434-9f71-ada8e66ea526 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:43.634811 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-28e39bee-a004-4434-9f71-ada8e66ea526 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:43.635722 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-28e39bee-a004-4434-9f71-ada8e66ea526 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:43.636336 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-28e39bee-a004-4434-9f71-ada8e66ea526 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:43.643647 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-28e39bee-a004-4434-9f71-ada8e66ea526 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:43.681232 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.wsgi [None req-28e39bee-a004-4434-9f71-ada8e66ea526 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] HTTP exception thrown: Instance 368d4aa4-81a1-43af-a69b-e5f7004da740 could not be found. Oct 04 21:01:43.690204 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-28e39bee-a004-4434-9f71-ada8e66ea526 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Request method failure captured: Oct 04 21:01:43.690204 n-d-854823-8 devstack@n-api.service[128802]: request: DELETE /compute/v2.1/servers/368d4aa4-81a1-43af-a69b-e5f7004da740 HTTP/1.1 Oct 04 21:01:43.690204 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 21:01:43.690204 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 21:01:43.690204 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 21:01:43.690204 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 0 Oct 04 21:01:43.690204 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 21:01:43.690204 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 21:01:43.690204 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 21:01:43.690204 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 21:01:43.690204 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPJ4eaBM_FLl2jaN3nQraRbM94DgE-qlLjkCPNJ1Ol7VvkbIGIp-m_lAuwAay2VJ7lXD5niLtaDpJGDoHOJTljuI2aLuReHvX6jQr-uTgC01ZM2s7p6j6gq6a-1PaGQN0mcmcJntCqSnEEt5MEM6DdrOOdi5eEtsfyNU4EpDYmca-Ylo Oct 04 21:01:43.690204 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 21:01:43.690204 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 21:01:43.690204 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 21:01:43.690204 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 21:01:43.690204 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 21:01:43.690204 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 21:01:43.690204 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: 65946afc398d4a9fb1c9095a4f946e07 Oct 04 21:01:43.690204 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-ServersNegativeTestJSON-1097186397 Oct 04 21:01:43.690204 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 21:01:43.690204 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 21:01:43.690204 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_65946afc398d4a9fb1c9095a4f946e07", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/65946afc398d4a9fb1c9095a4f946e07"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/65946afc398d4a9fb1c9095a4f946e07"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/65946afc398d4a9fb1c9095a4f946e07"}]}] Oct 04 21:01:43.690204 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-ServersNegativeTestJSON-1097186397 Oct 04 21:01:43.690204 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: 65946afc398d4a9fb1c9095a4f946e07 Oct 04 21:01:43.690204 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1097186397 Oct 04 21:01:43.690204 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-ServersNegativeTestJSON-1097186397-project Oct 04 21:01:43.690204 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 21:01:43.690204 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 21:01:43.690204 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: 6513f5e908ac4d028cad6eeeebeab285 Oct 04 21:01:43.690204 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-ServersNegativeTestJSON-1097186397-project Oct 04 21:01:43.690204 n-d-854823-8 devstack@n-api.service[128802]: method: > Oct 04 21:01:43.690204 n-d-854823-8 devstack@n-api.service[128802]: exception: Instance 368d4aa4-81a1-43af-a69b-e5f7004da740 could not be found. Oct 04 21:01:43.690204 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'id': '368d4aa4-81a1-43af-a69b-e5f7004da740'} Oct 04 21:01:43.690204 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:01:43.690204 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:01:43.690204 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:01:43.690204 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:01:43.690204 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:01:43.690204 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:01:43.690204 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:01:43.690204 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:01:43.690204 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:01:43.690204 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:01:43.690204 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 368d4aa4-81a1-43af-a69b-e5f7004da740 could not be found. Oct 04 21:01:43.690204 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:01:43.690204 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:01:43.690204 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:01:43.690204 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:01:43.690204 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:01:43.690204 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:01:43.690204 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:01:43.690204 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:01:43.690204 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:01:43.690204 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:01:43.690204 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 21:01:43.690204 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 21:01:43.690204 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 21:01:43.690204 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 21:01:43.690204 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:01:43.690204 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:01:43.690204 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:01:43.690204 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:01:43.693911 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 368d4aa4-81a1-43af-a69b-e5f7004da740 could not be found. Oct 04 21:01:43.693911 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:01:43.693911 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:01:43.693911 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:01:43.693911 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:01:43.693911 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:01:43.693911 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:01:43.693911 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:01:43.693911 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:01:43.693911 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 368d4aa4-81a1-43af-a69b-e5f7004da740 could not be found. Oct 04 21:01:43.693911 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:01:43.698678 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-28e39bee-a004-4434-9f71-ada8e66ea526 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Returning 404 to user: Instance 368d4aa4-81a1-43af-a69b-e5f7004da740 could not be found. {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:01:43.701541 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-28e39bee-a004-4434-9f71-ada8e66ea526 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "DELETE /compute/v2.1/servers/368d4aa4-81a1-43af-a69b-e5f7004da740" status: 404 len: 111 microversion: 2.1 time: 0.095540 Oct 04 21:01:43.706467 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2596/5169] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 21:01:43 2022] DELETE /compute/v2.1/servers/368d4aa4-81a1-43af-a69b-e5f7004da740 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:01:43.716404 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-40f32f70-8890-4b14-bc32-3d7b655695ca tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:01:43.717798 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-40f32f70-8890-4b14-bc32-3d7b655695ca tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] [instance: 368d4aa4-81a1-43af-a69b-e5f7004da740] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:01:43.749144 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-40f32f70-8890-4b14-bc32-3d7b655695ca tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:43.749647 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-40f32f70-8890-4b14-bc32-3d7b655695ca tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:43.750092 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-40f32f70-8890-4b14-bc32-3d7b655695ca tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:43.760370 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-40f32f70-8890-4b14-bc32-3d7b655695ca tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:43.760860 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-40f32f70-8890-4b14-bc32-3d7b655695ca tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:43.761300 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-40f32f70-8890-4b14-bc32-3d7b655695ca tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:43.804587 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-40f32f70-8890-4b14-bc32-3d7b655695ca tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] HTTP exception thrown: Instance 368d4aa4-81a1-43af-a69b-e5f7004da740 could not be found. Oct 04 21:01:43.806214 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-40f32f70-8890-4b14-bc32-3d7b655695ca tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Request method failure captured: Oct 04 21:01:43.806214 n-d-854823-8 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/368d4aa4-81a1-43af-a69b-e5f7004da740 HTTP/1.1 Oct 04 21:01:43.806214 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 21:01:43.806214 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 21:01:43.806214 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 21:01:43.806214 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 0 Oct 04 21:01:43.806214 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 21:01:43.806214 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 21:01:43.806214 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 21:01:43.806214 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 21:01:43.806214 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJ4eaBM_FLl2jaN3nQraRbM94DgE-qlLjkCPNJ1Ol7VvkbIGIp-m_lAuwAay2VJ7lXD5niLtaDpJGDoHOJTljuI2aLuReHvX6jQr-uTgC01ZM2s7p6j6gq6a-1PaGQN0mcmcJntCqSnEEt5MEM6DdrOOdi5eEtsfyNU4EpDYmca-Ylo Oct 04 21:01:43.806214 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 21:01:43.806214 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 21:01:43.806214 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 21:01:43.806214 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 21:01:43.806214 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 21:01:43.806214 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 21:01:43.806214 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: 65946afc398d4a9fb1c9095a4f946e07 Oct 04 21:01:43.806214 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-ServersNegativeTestJSON-1097186397 Oct 04 21:01:43.806214 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 21:01:43.806214 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 21:01:43.806214 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_65946afc398d4a9fb1c9095a4f946e07", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/65946afc398d4a9fb1c9095a4f946e07"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/65946afc398d4a9fb1c9095a4f946e07"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/65946afc398d4a9fb1c9095a4f946e07"}]}] Oct 04 21:01:43.806214 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-ServersNegativeTestJSON-1097186397 Oct 04 21:01:43.806214 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: 65946afc398d4a9fb1c9095a4f946e07 Oct 04 21:01:43.806214 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1097186397 Oct 04 21:01:43.806214 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-ServersNegativeTestJSON-1097186397-project Oct 04 21:01:43.806214 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 21:01:43.806214 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 21:01:43.806214 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: 6513f5e908ac4d028cad6eeeebeab285 Oct 04 21:01:43.806214 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-ServersNegativeTestJSON-1097186397-project Oct 04 21:01:43.806214 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 21:01:43.806214 n-d-854823-8 devstack@n-api.service[128801]: exception: Instance 368d4aa4-81a1-43af-a69b-e5f7004da740 could not be found. Oct 04 21:01:43.806214 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': '368d4aa4-81a1-43af-a69b-e5f7004da740'} Oct 04 21:01:43.806214 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:01:43.806214 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:01:43.806214 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:01:43.806214 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:01:43.806214 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:01:43.806214 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:01:43.806214 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:01:43.806214 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:01:43.806214 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:01:43.806214 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:01:43.806214 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 368d4aa4-81a1-43af-a69b-e5f7004da740 could not be found. Oct 04 21:01:43.806214 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:01:43.806214 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:01:43.806214 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:01:43.806214 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:01:43.806214 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:01:43.806214 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:01:43.806214 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:01:43.806214 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:01:43.806214 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:01:43.806214 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:01:43.806214 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:01:43.806214 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:01:43.806214 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:01:43.806214 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:01:43.806214 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:01:43.806214 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:01:43.806214 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 368d4aa4-81a1-43af-a69b-e5f7004da740 could not be found. Oct 04 21:01:43.806214 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:01:43.806214 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:01:43.806214 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:01:43.810524 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:01:43.810524 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:01:43.810524 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:01:43.810524 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:01:43.810524 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:01:43.810524 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 368d4aa4-81a1-43af-a69b-e5f7004da740 could not be found. Oct 04 21:01:43.810524 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:01:43.810524 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-40f32f70-8890-4b14-bc32-3d7b655695ca tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Returning 404 to user: Instance 368d4aa4-81a1-43af-a69b-e5f7004da740 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:01:43.810524 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-40f32f70-8890-4b14-bc32-3d7b655695ca tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "GET /compute/v2.1/servers/368d4aa4-81a1-43af-a69b-e5f7004da740" status: 404 len: 111 microversion: 2.1 time: 0.098944 Oct 04 21:01:43.812794 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2574/5170] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:01:43 2022] GET /compute/v2.1/servers/368d4aa4-81a1-43af-a69b-e5f7004da740 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:01:43.834930 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-bb73214c-0cd3-4b7b-9e68-d1d54c498806 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:01:43.836577 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-bb73214c-0cd3-4b7b-9e68-d1d54c498806 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] [instance: 320f9a98-969f-473e-bc56-842bbd28dedc] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:01:43.851528 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bb73214c-0cd3-4b7b-9e68-d1d54c498806 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:43.862887 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bb73214c-0cd3-4b7b-9e68-d1d54c498806 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:43.863534 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bb73214c-0cd3-4b7b-9e68-d1d54c498806 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:43.864387 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bb73214c-0cd3-4b7b-9e68-d1d54c498806 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:43.865659 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bb73214c-0cd3-4b7b-9e68-d1d54c498806 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:43.875117 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bb73214c-0cd3-4b7b-9e68-d1d54c498806 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:43.925462 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-bb73214c-0cd3-4b7b-9e68-d1d54c498806 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] [instance: 320f9a98-969f-473e-bc56-842bbd28dedc] Going to try to terminate instance {{(pid=128802) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:01:44.129991 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-bb73214c-0cd3-4b7b-9e68-d1d54c498806 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "DELETE /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc" status: 204 len: 0 microversion: 2.1 time: 0.307143 Oct 04 21:01:44.130797 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2597/5171] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 21:01:43 2022] DELETE /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc => generated 0 bytes in 309 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:01:44.149465 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-bbdd1ae3-21c7-4980-b2ef-3e081eda9d7f tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:01:44.150123 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-bbdd1ae3-21c7-4980-b2ef-3e081eda9d7f tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] [instance: 320f9a98-969f-473e-bc56-842bbd28dedc] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:01:44.153819 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:01:44.185980 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bbdd1ae3-21c7-4980-b2ef-3e081eda9d7f tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:44.186715 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bbdd1ae3-21c7-4980-b2ef-3e081eda9d7f tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:44.188149 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bbdd1ae3-21c7-4980-b2ef-3e081eda9d7f tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:44.189045 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bbdd1ae3-21c7-4980-b2ef-3e081eda9d7f tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:44.189657 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bbdd1ae3-21c7-4980-b2ef-3e081eda9d7f tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:44.190235 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bbdd1ae3-21c7-4980-b2ef-3e081eda9d7f tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:44.995295 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-bbdd1ae3-21c7-4980-b2ef-3e081eda9d7f tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6513f5e908ac4d028cad6eeeebeab285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65946afc398d4a9fb1c9095a4f946e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:01:45.015544 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-bbdd1ae3-21c7-4980-b2ef-3e081eda9d7f tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc" status: 200 len: 1511 microversion: 2.1 time: 0.878355 Oct 04 21:01:45.016432 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2575/5172] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:01:44 2022] GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc => generated 1511 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:01:46.043184 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-5837fd92-5467-40f9-b0d4-23ccbeb6bb53 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:01:46.043900 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-5837fd92-5467-40f9-b0d4-23ccbeb6bb53 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] [instance: 320f9a98-969f-473e-bc56-842bbd28dedc] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:01:46.060740 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5837fd92-5467-40f9-b0d4-23ccbeb6bb53 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:46.061242 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5837fd92-5467-40f9-b0d4-23ccbeb6bb53 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:46.061681 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5837fd92-5467-40f9-b0d4-23ccbeb6bb53 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:46.062983 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5837fd92-5467-40f9-b0d4-23ccbeb6bb53 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:46.063435 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5837fd92-5467-40f9-b0d4-23ccbeb6bb53 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:46.063868 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5837fd92-5467-40f9-b0d4-23ccbeb6bb53 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:46.795446 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-5837fd92-5467-40f9-b0d4-23ccbeb6bb53 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6513f5e908ac4d028cad6eeeebeab285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65946afc398d4a9fb1c9095a4f946e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:01:46.803923 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-5837fd92-5467-40f9-b0d4-23ccbeb6bb53 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc" status: 200 len: 1511 microversion: 2.1 time: 0.765232 Oct 04 21:01:46.830690 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2598/5173] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:01:46 2022] GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc => generated 1511 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:01:47.183972 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-60ae07b4-ecd1-4d38-9a8b-823637d670d3 req-0f663da8-2ba4-4205-bcd3-845fd0368031 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "320f9a98-969f-473e-bc56-842bbd28dedc", "name": "network-vif-deleted", "tag": "d2b3af35-3f6f-4a4b-91ec-14c17375542b"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:01:47.210614 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-60ae07b4-ecd1-4d38-9a8b-823637d670d3 req-0f663da8-2ba4-4205-bcd3-845fd0368031 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:47.211399 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-60ae07b4-ecd1-4d38-9a8b-823637d670d3 req-0f663da8-2ba4-4205-bcd3-845fd0368031 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:47.212175 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-60ae07b4-ecd1-4d38-9a8b-823637d670d3 req-0f663da8-2ba4-4205-bcd3-845fd0368031 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:47.237330 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-60ae07b4-ecd1-4d38-9a8b-823637d670d3 req-0f663da8-2ba4-4205-bcd3-845fd0368031 service nova] Creating event network-vif-deleted:d2b3af35-3f6f-4a4b-91ec-14c17375542b for instance 320f9a98-969f-473e-bc56-842bbd28dedc on n-h1-854823-8 Oct 04 21:01:47.247129 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-60ae07b4-ecd1-4d38-9a8b-823637d670d3 req-0f663da8-2ba4-4205-bcd3-845fd0368031 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066964 Oct 04 21:01:47.255966 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2576/5174] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:01:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:01:47.514937 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-cbb164c4-0ed7-4a5f-9ece-705ad5148b01 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1629461471", "imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "883d858a-7cae-4639-8390-ea0087441e3f"}], "security_groups": [{"name": "tempest-securitygroup--612017669"}], "key_name": "tempest-keypair-1817073311", "user_data": "}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:01:47.844505 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5c91b5ae-ecc1-4f72-9824-8b49e109e787 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:01:47.845343 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-5c91b5ae-ecc1-4f72-9824-8b49e109e787 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] [instance: 320f9a98-969f-473e-bc56-842bbd28dedc] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:01:47.855713 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5c91b5ae-ecc1-4f72-9824-8b49e109e787 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:47.856505 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5c91b5ae-ecc1-4f72-9824-8b49e109e787 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:47.857770 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5c91b5ae-ecc1-4f72-9824-8b49e109e787 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:47.862208 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5c91b5ae-ecc1-4f72-9824-8b49e109e787 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:47.867046 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5c91b5ae-ecc1-4f72-9824-8b49e109e787 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:47.868088 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5c91b5ae-ecc1-4f72-9824-8b49e109e787 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:47.959319 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5c91b5ae-ecc1-4f72-9824-8b49e109e787 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:47.960674 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5c91b5ae-ecc1-4f72-9824-8b49e109e787 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:47.961519 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5c91b5ae-ecc1-4f72-9824-8b49e109e787 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:47.964682 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-5c91b5ae-ecc1-4f72-9824-8b49e109e787 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lazy-loading 'fault' on Instance uuid 320f9a98-969f-473e-bc56-842bbd28dedc {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:01:48.244646 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-5c91b5ae-ecc1-4f72-9824-8b49e109e787 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6513f5e908ac4d028cad6eeeebeab285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65946afc398d4a9fb1c9095a4f946e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:01:48.248390 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.network.neutron [None req-cbb164c4-0ed7-4a5f-9ece-705ad5148b01 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] validate_networks() for [('883d858a-7cae-4639-8390-ea0087441e3f', None, None, None, None, None)] {{(pid=128802) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:01:48.256125 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5c91b5ae-ecc1-4f72-9824-8b49e109e787 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc" status: 200 len: 1307 microversion: 2.1 time: 0.416861 Oct 04 21:01:48.272900 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2577/5175] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:01:47 2022] GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc => generated 1307 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:01:48.754091 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8887b0f6-8027-4a9f-ae27-f80b6dbe46cb tempest-TestNetworkAdvancedServerOps-2095277972 tempest-TestNetworkAdvancedServerOps-2095277972-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:01:48.754732 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-8887b0f6-8027-4a9f-ae27-f80b6dbe46cb tempest-TestNetworkAdvancedServerOps-2095277972 tempest-TestNetworkAdvancedServerOps-2095277972-project-admin] [instance: 243cbbbd-0734-4711-b605-c0657b81e359] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:01:48.764441 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8887b0f6-8027-4a9f-ae27-f80b6dbe46cb tempest-TestNetworkAdvancedServerOps-2095277972 tempest-TestNetworkAdvancedServerOps-2095277972-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:48.765485 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8887b0f6-8027-4a9f-ae27-f80b6dbe46cb tempest-TestNetworkAdvancedServerOps-2095277972 tempest-TestNetworkAdvancedServerOps-2095277972-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:48.767246 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8887b0f6-8027-4a9f-ae27-f80b6dbe46cb tempest-TestNetworkAdvancedServerOps-2095277972 tempest-TestNetworkAdvancedServerOps-2095277972-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:48.769047 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8887b0f6-8027-4a9f-ae27-f80b6dbe46cb tempest-TestNetworkAdvancedServerOps-2095277972 tempest-TestNetworkAdvancedServerOps-2095277972-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:48.770899 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8887b0f6-8027-4a9f-ae27-f80b6dbe46cb tempest-TestNetworkAdvancedServerOps-2095277972 tempest-TestNetworkAdvancedServerOps-2095277972-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:48.779048 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8887b0f6-8027-4a9f-ae27-f80b6dbe46cb tempest-TestNetworkAdvancedServerOps-2095277972 tempest-TestNetworkAdvancedServerOps-2095277972-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:49.239764 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-8887b0f6-8027-4a9f-ae27-f80b6dbe46cb tempest-TestNetworkAdvancedServerOps-2095277972 tempest-TestNetworkAdvancedServerOps-2095277972-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/243cbbbd-0734-4711-b605-c0657b81e359" status: 200 len: 1832 microversion: 2.1 time: 0.486035 Oct 04 21:01:49.243045 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2578/5176] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:01:48 2022] GET /compute/v2.1/servers/243cbbbd-0734-4711-b605-c0657b81e359 => generated 1832 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:01:49.255057 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-d9424424-dcf2-4684-b323-412576ca872f req-95f4d134-726f-4abd-8df4-c31fdc9d39e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "61bb9cf5-6da5-4074-9bb8-ffd1269ea50f", "tag": "bcd2dd15-0ca7-47ca-9e2d-d0c557d550b4"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:01:49.281123 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-d9424424-dcf2-4684-b323-412576ca872f req-95f4d134-726f-4abd-8df4-c31fdc9d39e2 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:49.286081 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-d9424424-dcf2-4684-b323-412576ca872f req-95f4d134-726f-4abd-8df4-c31fdc9d39e2 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:49.286620 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-d9424424-dcf2-4684-b323-412576ca872f req-95f4d134-726f-4abd-8df4-c31fdc9d39e2 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:49.317250 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-d9424424-dcf2-4684-b323-412576ca872f req-95f4d134-726f-4abd-8df4-c31fdc9d39e2 service nova] Creating event network-changed:bcd2dd15-0ca7-47ca-9e2d-d0c557d550b4 for instance 61bb9cf5-6da5-4074-9bb8-ffd1269ea50f on n-h1-854823-8 Oct 04 21:01:49.335827 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-d9424424-dcf2-4684-b323-412576ca872f req-95f4d134-726f-4abd-8df4-c31fdc9d39e2 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091229 Oct 04 21:01:49.337419 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2579/5177] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:01:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:01:49.348112 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d89f6b79-f59b-4e3d-af97-330ca734bd61 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:01:49.348817 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d89f6b79-f59b-4e3d-af97-330ca734bd61 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] [instance: 320f9a98-969f-473e-bc56-842bbd28dedc] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:01:49.355651 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d89f6b79-f59b-4e3d-af97-330ca734bd61 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:49.356378 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d89f6b79-f59b-4e3d-af97-330ca734bd61 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:49.356996 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d89f6b79-f59b-4e3d-af97-330ca734bd61 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:49.358132 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d89f6b79-f59b-4e3d-af97-330ca734bd61 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:49.359166 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d89f6b79-f59b-4e3d-af97-330ca734bd61 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:49.359893 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d89f6b79-f59b-4e3d-af97-330ca734bd61 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:49.381804 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-d89f6b79-f59b-4e3d-af97-330ca734bd61 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] HTTP exception thrown: Instance 320f9a98-969f-473e-bc56-842bbd28dedc could not be found. Oct 04 21:01:49.383863 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d89f6b79-f59b-4e3d-af97-330ca734bd61 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Request method failure captured: Oct 04 21:01:49.383863 n-d-854823-8 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc HTTP/1.1 Oct 04 21:01:49.383863 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 21:01:49.383863 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 21:01:49.383863 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 21:01:49.383863 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 0 Oct 04 21:01:49.383863 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 21:01:49.383863 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 21:01:49.383863 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 21:01:49.383863 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 21:01:49.383863 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJ4eaBM_FLl2jaN3nQraRbM94DgE-qlLjkCPNJ1Ol7VvkbIGIp-m_lAuwAay2VJ7lXD5niLtaDpJGDoHOJTljuI2aLuReHvX6jQr-uTgC01ZM2s7p6j6gq6a-1PaGQN0mcmcJntCqSnEEt5MEM6DdrOOdi5eEtsfyNU4EpDYmca-Ylo Oct 04 21:01:49.383863 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 21:01:49.383863 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 21:01:49.383863 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 21:01:49.383863 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 21:01:49.383863 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 21:01:49.383863 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 21:01:49.383863 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: 65946afc398d4a9fb1c9095a4f946e07 Oct 04 21:01:49.383863 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-ServersNegativeTestJSON-1097186397 Oct 04 21:01:49.383863 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 21:01:49.383863 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 21:01:49.383863 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_65946afc398d4a9fb1c9095a4f946e07", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/65946afc398d4a9fb1c9095a4f946e07"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/65946afc398d4a9fb1c9095a4f946e07"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/65946afc398d4a9fb1c9095a4f946e07"}]}] Oct 04 21:01:49.383863 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-ServersNegativeTestJSON-1097186397 Oct 04 21:01:49.383863 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: 65946afc398d4a9fb1c9095a4f946e07 Oct 04 21:01:49.383863 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1097186397 Oct 04 21:01:49.383863 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-ServersNegativeTestJSON-1097186397-project Oct 04 21:01:49.383863 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 21:01:49.383863 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 21:01:49.383863 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: 6513f5e908ac4d028cad6eeeebeab285 Oct 04 21:01:49.383863 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-ServersNegativeTestJSON-1097186397-project Oct 04 21:01:49.383863 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 21:01:49.383863 n-d-854823-8 devstack@n-api.service[128801]: exception: Instance 320f9a98-969f-473e-bc56-842bbd28dedc could not be found. Oct 04 21:01:49.383863 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': '320f9a98-969f-473e-bc56-842bbd28dedc'} Oct 04 21:01:49.383863 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:01:49.383863 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:01:49.383863 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:01:49.383863 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:01:49.383863 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:01:49.383863 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:01:49.383863 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:01:49.383863 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:01:49.383863 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:01:49.383863 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:01:49.383863 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 320f9a98-969f-473e-bc56-842bbd28dedc could not be found. Oct 04 21:01:49.383863 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:01:49.383863 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:01:49.383863 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:01:49.383863 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:01:49.383863 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:01:49.383863 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:01:49.383863 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:01:49.383863 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:01:49.383863 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:01:49.383863 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:01:49.383863 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:01:49.383863 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:01:49.383863 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:01:49.383863 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:01:49.383863 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:01:49.383863 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:01:49.383863 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 320f9a98-969f-473e-bc56-842bbd28dedc could not be found. Oct 04 21:01:49.383863 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:01:49.383863 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:01:49.383863 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:01:49.387387 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:01:49.387387 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:01:49.387387 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:01:49.387387 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:01:49.387387 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:01:49.387387 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 320f9a98-969f-473e-bc56-842bbd28dedc could not be found. Oct 04 21:01:49.387387 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:01:49.387930 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d89f6b79-f59b-4e3d-af97-330ca734bd61 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] Returning 404 to user: Instance 320f9a98-969f-473e-bc56-842bbd28dedc could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:01:49.389695 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d89f6b79-f59b-4e3d-af97-330ca734bd61 tempest-ServersNegativeTestJSON-1097186397 tempest-ServersNegativeTestJSON-1097186397-project] 10.222.0.33 "GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc" status: 404 len: 111 microversion: 2.1 time: 0.051123 Oct 04 21:01:49.392361 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2580/5178] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:01:49 2022] GET /compute/v2.1/servers/320f9a98-969f-473e-bc56-842bbd28dedc => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:01:50.648323 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-cbb164c4-0ed7-4a5f-9ece-705ad5148b01 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Flavor limits 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:01:50.649590 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-cbb164c4-0ed7-4a5f-9ece-705ad5148b01 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Image limits 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:01:50.652014 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-cbb164c4-0ed7-4a5f-9ece-705ad5148b01 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Flavor pref 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:01:50.652727 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-cbb164c4-0ed7-4a5f-9ece-705ad5148b01 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Image pref 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:01:50.654044 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-cbb164c4-0ed7-4a5f-9ece-705ad5148b01 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:01:50.692378 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cbb164c4-0ed7-4a5f-9ece-705ad5148b01 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:50.693685 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cbb164c4-0ed7-4a5f-9ece-705ad5148b01 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:50.695732 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cbb164c4-0ed7-4a5f-9ece-705ad5148b01 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:50.698073 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cbb164c4-0ed7-4a5f-9ece-705ad5148b01 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:50.700030 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cbb164c4-0ed7-4a5f-9ece-705ad5148b01 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:50.703549 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cbb164c4-0ed7-4a5f-9ece-705ad5148b01 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:50.787859 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-cbb164c4-0ed7-4a5f-9ece-705ad5148b01 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Getting quotas for project 8625c9db98c2475db23d56a965eedb66. Resources: {'ram', 'instances', 'cores'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:01:50.795700 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-cbb164c4-0ed7-4a5f-9ece-705ad5148b01 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Getting quotas for user 9169ee22a4c94b2ab8d092c890bbf3ed and project 8625c9db98c2475db23d56a965eedb66. Resources: {'ram', 'instances', 'cores'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:01:50.818868 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-cbb164c4-0ed7-4a5f-9ece-705ad5148b01 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Going to run 1 instances... {{(pid=128802) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:01:50.828093 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-cbb164c4-0ed7-4a5f-9ece-705ad5148b01 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] [instance: cc9ad5af-1587-4aa1-8323-a50c91bb1b84] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='15b24725-0c99-4bcf-b1fb-907cdf8e2d63',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128802) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:01:50.971740 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-cbb164c4-0ed7-4a5f-9ece-705ad5148b01 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 3.460765 Oct 04 21:01:50.972726 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2599/5179] 10.222.0.33 () {62 vars in 1188 bytes} [Tue Oct 4 21:01:47 2022] POST /compute/v2.1/servers => generated 401 bytes in 3463 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 04 21:01:50.985560 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2d12d3ad-ef7c-462a-959d-ff9372903920 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:01:50.986431 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-2d12d3ad-ef7c-462a-959d-ff9372903920 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] [instance: cc9ad5af-1587-4aa1-8323-a50c91bb1b84] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:01:51.000529 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=4 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:01:51.219980 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-2d12d3ad-ef7c-462a-959d-ff9372903920 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:01:51.234430 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-2d12d3ad-ef7c-462a-959d-ff9372903920 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:01:51.240144 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-2d12d3ad-ef7c-462a-959d-ff9372903920 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:01:51.243530 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-2d12d3ad-ef7c-462a-959d-ff9372903920 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] 10.222.0.33 "GET /compute/v2.1/servers/cc9ad5af-1587-4aa1-8323-a50c91bb1b84" status: 200 len: 1282 microversion: 2.20 time: 0.262896 Oct 04 21:01:51.245618 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2581/5180] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 21:01:50 2022] GET /compute/v2.1/servers/cc9ad5af-1587-4aa1-8323-a50c91bb1b84 => generated 1282 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:01:52.278955 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-6273911c-8acf-4ca3-8206-e85cf961bb6e tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:01:52.281133 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-6273911c-8acf-4ca3-8206-e85cf961bb6e tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] [instance: cc9ad5af-1587-4aa1-8323-a50c91bb1b84] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:01:52.295563 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:01:52.298095 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6273911c-8acf-4ca3-8206-e85cf961bb6e tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:52.302126 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6273911c-8acf-4ca3-8206-e85cf961bb6e tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:52.302656 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6273911c-8acf-4ca3-8206-e85cf961bb6e tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:52.303489 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6273911c-8acf-4ca3-8206-e85cf961bb6e tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:52.304112 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6273911c-8acf-4ca3-8206-e85cf961bb6e tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:52.312382 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6273911c-8acf-4ca3-8206-e85cf961bb6e tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:52.608334 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-6273911c-8acf-4ca3-8206-e85cf961bb6e tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:01:52.628025 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-6273911c-8acf-4ca3-8206-e85cf961bb6e tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:01:52.630555 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-6273911c-8acf-4ca3-8206-e85cf961bb6e tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:01:52.632105 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-6273911c-8acf-4ca3-8206-e85cf961bb6e tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] 10.222.0.33 "GET /compute/v2.1/servers/cc9ad5af-1587-4aa1-8323-a50c91bb1b84" status: 200 len: 1334 microversion: 2.20 time: 0.362223 Oct 04 21:01:52.633668 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2600/5181] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 21:01:52 2022] GET /compute/v2.1/servers/cc9ad5af-1587-4aa1-8323-a50c91bb1b84 => generated 1334 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:01:53.661810 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-dce95306-e058-4a71-b187-9a05e6df1beb tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:01:53.662571 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-dce95306-e058-4a71-b187-9a05e6df1beb tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] [instance: cc9ad5af-1587-4aa1-8323-a50c91bb1b84] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:01:53.688046 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dce95306-e058-4a71-b187-9a05e6df1beb tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:53.688549 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dce95306-e058-4a71-b187-9a05e6df1beb tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:53.688992 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dce95306-e058-4a71-b187-9a05e6df1beb tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:53.689716 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dce95306-e058-4a71-b187-9a05e6df1beb tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:53.690186 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dce95306-e058-4a71-b187-9a05e6df1beb tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:53.690737 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dce95306-e058-4a71-b187-9a05e6df1beb tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:54.111893 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-c1a0da1e-6606-4353-b32f-83b483b8e8b8 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:01:54.113185 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-c1a0da1e-6606-4353-b32f-83b483b8e8b8 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] [instance: 243cbbbd-0734-4711-b605-c0657b81e359] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:01:54.139436 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c1a0da1e-6606-4353-b32f-83b483b8e8b8 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:54.141544 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c1a0da1e-6606-4353-b32f-83b483b8e8b8 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:54.142043 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c1a0da1e-6606-4353-b32f-83b483b8e8b8 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:54.147965 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c1a0da1e-6606-4353-b32f-83b483b8e8b8 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:54.148468 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c1a0da1e-6606-4353-b32f-83b483b8e8b8 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:54.152766 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c1a0da1e-6606-4353-b32f-83b483b8e8b8 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:54.226729 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-dce95306-e058-4a71-b187-9a05e6df1beb tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:01:54.227147 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-c1a0da1e-6606-4353-b32f-83b483b8e8b8 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] [instance: 243cbbbd-0734-4711-b605-c0657b81e359] Going to try to terminate instance {{(pid=128802) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:01:54.259673 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-dce95306-e058-4a71-b187-9a05e6df1beb tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:01:54.261335 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-dce95306-e058-4a71-b187-9a05e6df1beb tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:01:54.267179 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-dce95306-e058-4a71-b187-9a05e6df1beb tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] 10.222.0.33 "GET /compute/v2.1/servers/cc9ad5af-1587-4aa1-8323-a50c91bb1b84" status: 200 len: 1340 microversion: 2.20 time: 0.609213 Oct 04 21:01:54.271911 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2582/5182] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 21:01:53 2022] GET /compute/v2.1/servers/cc9ad5af-1587-4aa1-8323-a50c91bb1b84 => generated 1340 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:01:54.288602 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-12a4ffcb-c749-40a9-825d-2fcaae586dbb req-169062ea-9174-4964-9b7b-84239e8fffc3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "243cbbbd-0734-4711-b605-c0657b81e359", "tag": "65760264-f1de-43cd-baca-c370b4c65ec6"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:01:54.328695 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-12a4ffcb-c749-40a9-825d-2fcaae586dbb req-169062ea-9174-4964-9b7b-84239e8fffc3 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:54.333034 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-12a4ffcb-c749-40a9-825d-2fcaae586dbb req-169062ea-9174-4964-9b7b-84239e8fffc3 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:54.334474 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-12a4ffcb-c749-40a9-825d-2fcaae586dbb req-169062ea-9174-4964-9b7b-84239e8fffc3 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:54.376768 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-12a4ffcb-c749-40a9-825d-2fcaae586dbb req-169062ea-9174-4964-9b7b-84239e8fffc3 service nova] Creating event network-changed:65760264-f1de-43cd-baca-c370b4c65ec6 for instance 243cbbbd-0734-4711-b605-c0657b81e359 on n-h1-854823-8 Oct 04 21:01:54.395000 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-12a4ffcb-c749-40a9-825d-2fcaae586dbb req-169062ea-9174-4964-9b7b-84239e8fffc3 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.121698 Oct 04 21:01:54.396886 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2583/5183] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:01:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:01:54.400152 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-c1a0da1e-6606-4353-b32f-83b483b8e8b8 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] 10.222.0.33 "DELETE /compute/v2.1/servers/243cbbbd-0734-4711-b605-c0657b81e359" status: 204 len: 0 microversion: 2.1 time: 0.299924 Oct 04 21:01:54.401407 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2601/5184] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 21:01:54 2022] DELETE /compute/v2.1/servers/243cbbbd-0734-4711-b605-c0657b81e359 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:01:54.415230 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-74b5e71a-d133-4115-813f-aed21c62fbca tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:01:54.418150 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-74b5e71a-d133-4115-813f-aed21c62fbca tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] [instance: 243cbbbd-0734-4711-b605-c0657b81e359] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:01:54.436131 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-74b5e71a-d133-4115-813f-aed21c62fbca tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:54.436882 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-74b5e71a-d133-4115-813f-aed21c62fbca tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:54.439314 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-74b5e71a-d133-4115-813f-aed21c62fbca tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:54.441441 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-74b5e71a-d133-4115-813f-aed21c62fbca tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:54.442964 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-74b5e71a-d133-4115-813f-aed21c62fbca tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:54.446968 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-74b5e71a-d133-4115-813f-aed21c62fbca tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:55.058227 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-74b5e71a-d133-4115-813f-aed21c62fbca tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5dbe3da6a4af181ef7302fe605fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3aa23aee3c8435c8f1f409019c5fed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:01:55.071000 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-74b5e71a-d133-4115-813f-aed21c62fbca tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] 10.222.0.33 "GET /compute/v2.1/servers/243cbbbd-0734-4711-b605-c0657b81e359" status: 200 len: 1687 microversion: 2.1 time: 0.660483 Oct 04 21:01:55.071970 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2584/5185] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:01:54 2022] GET /compute/v2.1/servers/243cbbbd-0734-4711-b605-c0657b81e359 => generated 1687 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:01:55.299753 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-524dc1ae-38cd-4774-ab1f-007cbbcfdcb7 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:01:55.300344 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-524dc1ae-38cd-4774-ab1f-007cbbcfdcb7 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] [instance: cc9ad5af-1587-4aa1-8323-a50c91bb1b84] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:01:55.313930 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-524dc1ae-38cd-4774-ab1f-007cbbcfdcb7 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:55.317463 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-524dc1ae-38cd-4774-ab1f-007cbbcfdcb7 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:55.317974 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-524dc1ae-38cd-4774-ab1f-007cbbcfdcb7 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:55.318765 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-524dc1ae-38cd-4774-ab1f-007cbbcfdcb7 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:55.319238 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-524dc1ae-38cd-4774-ab1f-007cbbcfdcb7 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:55.322244 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-524dc1ae-38cd-4774-ab1f-007cbbcfdcb7 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:55.501649 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-524dc1ae-38cd-4774-ab1f-007cbbcfdcb7 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:01:55.517776 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-524dc1ae-38cd-4774-ab1f-007cbbcfdcb7 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:01:55.524595 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-524dc1ae-38cd-4774-ab1f-007cbbcfdcb7 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:01:55.526045 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-524dc1ae-38cd-4774-ab1f-007cbbcfdcb7 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] 10.222.0.33 "GET /compute/v2.1/servers/cc9ad5af-1587-4aa1-8323-a50c91bb1b84" status: 200 len: 1340 microversion: 2.20 time: 0.232247 Oct 04 21:01:55.527663 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2602/5186] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 21:01:55 2022] GET /compute/v2.1/servers/cc9ad5af-1587-4aa1-8323-a50c91bb1b84 => generated 1340 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:01:56.104195 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7aecfd9f-03d8-4f84-a018-92dca085fd26 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:01:56.104821 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-7aecfd9f-03d8-4f84-a018-92dca085fd26 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] [instance: 243cbbbd-0734-4711-b605-c0657b81e359] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:01:56.128642 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7aecfd9f-03d8-4f84-a018-92dca085fd26 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:56.129058 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7aecfd9f-03d8-4f84-a018-92dca085fd26 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:56.129506 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7aecfd9f-03d8-4f84-a018-92dca085fd26 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:56.130229 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7aecfd9f-03d8-4f84-a018-92dca085fd26 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:56.138055 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7aecfd9f-03d8-4f84-a018-92dca085fd26 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:56.144898 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7aecfd9f-03d8-4f84-a018-92dca085fd26 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:56.554780 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-0f1d8347-ab35-4f03-92a1-030da3c24be5 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:01:56.556099 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-0f1d8347-ab35-4f03-92a1-030da3c24be5 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] [instance: cc9ad5af-1587-4aa1-8323-a50c91bb1b84] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:01:56.576414 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0f1d8347-ab35-4f03-92a1-030da3c24be5 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:56.578171 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0f1d8347-ab35-4f03-92a1-030da3c24be5 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:56.584643 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0f1d8347-ab35-4f03-92a1-030da3c24be5 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:56.587081 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0f1d8347-ab35-4f03-92a1-030da3c24be5 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:56.589533 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0f1d8347-ab35-4f03-92a1-030da3c24be5 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:56.590437 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0f1d8347-ab35-4f03-92a1-030da3c24be5 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:56.876850 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-0f1d8347-ab35-4f03-92a1-030da3c24be5 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:01:56.891474 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-0f1d8347-ab35-4f03-92a1-030da3c24be5 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:01:56.896736 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-0f1d8347-ab35-4f03-92a1-030da3c24be5 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:01:56.899383 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-0f1d8347-ab35-4f03-92a1-030da3c24be5 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] 10.222.0.33 "GET /compute/v2.1/servers/cc9ad5af-1587-4aa1-8323-a50c91bb1b84" status: 200 len: 1340 microversion: 2.20 time: 0.348513 Oct 04 21:01:56.904763 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2603/5187] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 21:01:56 2022] GET /compute/v2.1/servers/cc9ad5af-1587-4aa1-8323-a50c91bb1b84 => generated 1340 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:01:57.015332 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-7aecfd9f-03d8-4f84-a018-92dca085fd26 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5dbe3da6a4af181ef7302fe605fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3aa23aee3c8435c8f1f409019c5fed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:01:57.030934 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-7aecfd9f-03d8-4f84-a018-92dca085fd26 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] 10.222.0.33 "GET /compute/v2.1/servers/243cbbbd-0734-4711-b605-c0657b81e359" status: 200 len: 1687 microversion: 2.1 time: 0.931365 Oct 04 21:01:57.047203 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2585/5188] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:01:56 2022] GET /compute/v2.1/servers/243cbbbd-0734-4711-b605-c0657b81e359 => generated 1687 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:01:57.930966 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-bebc08fa-1b3c-40a1-9be1-cdcee24344a7 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:01:57.931703 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-bebc08fa-1b3c-40a1-9be1-cdcee24344a7 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] [instance: cc9ad5af-1587-4aa1-8323-a50c91bb1b84] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:01:57.938776 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bebc08fa-1b3c-40a1-9be1-cdcee24344a7 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:57.939511 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bebc08fa-1b3c-40a1-9be1-cdcee24344a7 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:57.940283 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bebc08fa-1b3c-40a1-9be1-cdcee24344a7 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:57.941574 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bebc08fa-1b3c-40a1-9be1-cdcee24344a7 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:57.942383 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bebc08fa-1b3c-40a1-9be1-cdcee24344a7 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:57.942958 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bebc08fa-1b3c-40a1-9be1-cdcee24344a7 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:58.002221 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-830029bf-b780-47da-8c65-2a78b17bdeb3 req-b304ffe1-3ff4-49cf-97ce-2bced3ab7e18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "243cbbbd-0734-4711-b605-c0657b81e359", "name": "network-vif-deleted", "tag": "65760264-f1de-43cd-baca-c370b4c65ec6"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:01:58.025387 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-830029bf-b780-47da-8c65-2a78b17bdeb3 req-b304ffe1-3ff4-49cf-97ce-2bced3ab7e18 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:58.026215 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-830029bf-b780-47da-8c65-2a78b17bdeb3 req-b304ffe1-3ff4-49cf-97ce-2bced3ab7e18 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:58.026811 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-830029bf-b780-47da-8c65-2a78b17bdeb3 req-b304ffe1-3ff4-49cf-97ce-2bced3ab7e18 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:58.049696 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=100 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:01:58.056745 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-830029bf-b780-47da-8c65-2a78b17bdeb3 req-b304ffe1-3ff4-49cf-97ce-2bced3ab7e18 service nova] Creating event network-vif-deleted:65760264-f1de-43cd-baca-c370b4c65ec6 for instance 243cbbbd-0734-4711-b605-c0657b81e359 on n-h1-854823-8 Oct 04 21:01:58.071124 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-830029bf-b780-47da-8c65-2a78b17bdeb3 req-b304ffe1-3ff4-49cf-97ce-2bced3ab7e18 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073585 Oct 04 21:01:58.071740 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2586/5189] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:01:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:01:58.080870 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d052c3ef-3776-436b-b1ef-492c6aafe3a4 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:01:58.088220 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d052c3ef-3776-436b-b1ef-492c6aafe3a4 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] [instance: 243cbbbd-0734-4711-b605-c0657b81e359] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:01:58.097584 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d052c3ef-3776-436b-b1ef-492c6aafe3a4 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:58.098525 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d052c3ef-3776-436b-b1ef-492c6aafe3a4 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:58.099188 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d052c3ef-3776-436b-b1ef-492c6aafe3a4 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:58.100167 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d052c3ef-3776-436b-b1ef-492c6aafe3a4 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:58.100834 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d052c3ef-3776-436b-b1ef-492c6aafe3a4 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:58.101474 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d052c3ef-3776-436b-b1ef-492c6aafe3a4 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:58.147179 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d052c3ef-3776-436b-b1ef-492c6aafe3a4 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:58.148061 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d052c3ef-3776-436b-b1ef-492c6aafe3a4 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:58.148874 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d052c3ef-3776-436b-b1ef-492c6aafe3a4 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:58.149592 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-d052c3ef-3776-436b-b1ef-492c6aafe3a4 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lazy-loading 'fault' on Instance uuid 243cbbbd-0734-4711-b605-c0657b81e359 {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:01:58.477328 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d052c3ef-3776-436b-b1ef-492c6aafe3a4 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5dbe3da6a4af181ef7302fe605fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3aa23aee3c8435c8f1f409019c5fed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:01:58.489647 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d052c3ef-3776-436b-b1ef-492c6aafe3a4 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] 10.222.0.33 "GET /compute/v2.1/servers/243cbbbd-0734-4711-b605-c0657b81e359" status: 200 len: 1356 microversion: 2.1 time: 0.416591 Oct 04 21:01:58.491404 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2587/5190] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:01:58 2022] GET /compute/v2.1/servers/243cbbbd-0734-4711-b605-c0657b81e359 => generated 1356 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:01:58.735106 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-bebc08fa-1b3c-40a1-9be1-cdcee24344a7 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:01:58.752979 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-bebc08fa-1b3c-40a1-9be1-cdcee24344a7 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:01:58.756604 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-bebc08fa-1b3c-40a1-9be1-cdcee24344a7 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:01:58.762445 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-bebc08fa-1b3c-40a1-9be1-cdcee24344a7 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] 10.222.0.33 "GET /compute/v2.1/servers/cc9ad5af-1587-4aa1-8323-a50c91bb1b84" status: 200 len: 1407 microversion: 2.20 time: 0.835243 Oct 04 21:01:58.763760 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2604/5191] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 21:01:57 2022] GET /compute/v2.1/servers/cc9ad5af-1587-4aa1-8323-a50c91bb1b84 => generated 1407 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:01:59.523505 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-953910ee-e316-405c-9c2a-e96512df4be5 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:01:59.525013 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-953910ee-e316-405c-9c2a-e96512df4be5 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] [instance: 243cbbbd-0734-4711-b605-c0657b81e359] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:01:59.544853 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-953910ee-e316-405c-9c2a-e96512df4be5 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:59.544853 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-953910ee-e316-405c-9c2a-e96512df4be5 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:59.545293 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-953910ee-e316-405c-9c2a-e96512df4be5 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:59.546625 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-953910ee-e316-405c-9c2a-e96512df4be5 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:59.549488 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-953910ee-e316-405c-9c2a-e96512df4be5 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:59.550120 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-953910ee-e316-405c-9c2a-e96512df4be5 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:59.593034 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-953910ee-e316-405c-9c2a-e96512df4be5 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] HTTP exception thrown: Instance 243cbbbd-0734-4711-b605-c0657b81e359 could not be found. Oct 04 21:01:59.596700 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-953910ee-e316-405c-9c2a-e96512df4be5 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Request method failure captured: Oct 04 21:01:59.596700 n-d-854823-8 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/243cbbbd-0734-4711-b605-c0657b81e359 HTTP/1.1 Oct 04 21:01:59.596700 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 21:01:59.596700 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 21:01:59.596700 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 21:01:59.596700 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 0 Oct 04 21:01:59.596700 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 21:01:59.596700 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 21:01:59.596700 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 21:01:59.596700 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 21:01:59.596700 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJ6ORv5f7ucUc1GgNtAvhRFv0MfXY90YwD2xgHLgYfsVRwUV5gV1Hx78rlUpKA1NRvwYKNJhb7yIJiTiGqKIsoz35JtnB2AAmUjVwzFJr8QnfB8bfTqI5gxOvM7f9zAR1w4iePiaw2CxUuNcF2SaDuAI205FbH1jwb6Vgw17rzPCl_Q Oct 04 21:01:59.596700 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 21:01:59.596700 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 21:01:59.596700 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 21:01:59.596700 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 21:01:59.596700 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 21:01:59.596700 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 21:01:59.596700 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: b3aa23aee3c8435c8f1f409019c5fed2 Oct 04 21:01:59.596700 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1628573817 Oct 04 21:01:59.596700 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 21:01:59.596700 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 21:01:59.596700 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b3aa23aee3c8435c8f1f409019c5fed2", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b3aa23aee3c8435c8f1f409019c5fed2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b3aa23aee3c8435c8f1f409019c5fed2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b3aa23aee3c8435c8f1f409019c5fed2"}]}] Oct 04 21:01:59.596700 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1628573817 Oct 04 21:01:59.596700 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: b3aa23aee3c8435c8f1f409019c5fed2 Oct 04 21:01:59.596700 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1628573817 Oct 04 21:01:59.596700 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-TestNetworkAdvancedServerOps-1628573817-project Oct 04 21:01:59.596700 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 21:01:59.596700 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 21:01:59.596700 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: 0be5dbe3da6a4af181ef7302fe605fb4 Oct 04 21:01:59.596700 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1628573817-project Oct 04 21:01:59.596700 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 21:01:59.596700 n-d-854823-8 devstack@n-api.service[128801]: exception: Instance 243cbbbd-0734-4711-b605-c0657b81e359 could not be found. Oct 04 21:01:59.596700 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': '243cbbbd-0734-4711-b605-c0657b81e359'} Oct 04 21:01:59.596700 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:01:59.596700 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:01:59.596700 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:01:59.596700 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:01:59.596700 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:01:59.596700 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:01:59.596700 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:01:59.596700 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:01:59.596700 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:01:59.596700 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:01:59.596700 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 243cbbbd-0734-4711-b605-c0657b81e359 could not be found. Oct 04 21:01:59.596700 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:01:59.596700 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:01:59.596700 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:01:59.596700 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:01:59.596700 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:01:59.596700 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:01:59.596700 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:01:59.596700 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:01:59.596700 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:01:59.596700 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:01:59.596700 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:01:59.596700 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:01:59.596700 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:01:59.596700 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:01:59.596700 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:01:59.596700 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:01:59.596700 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 243cbbbd-0734-4711-b605-c0657b81e359 could not be found. Oct 04 21:01:59.596700 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:01:59.596700 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:01:59.602877 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:01:59.602877 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:01:59.602877 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:01:59.602877 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:01:59.602877 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:01:59.602877 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:01:59.602877 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 243cbbbd-0734-4711-b605-c0657b81e359 could not be found. Oct 04 21:01:59.602877 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:01:59.606100 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-953910ee-e316-405c-9c2a-e96512df4be5 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Returning 404 to user: Instance 243cbbbd-0734-4711-b605-c0657b81e359 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:01:59.608277 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-953910ee-e316-405c-9c2a-e96512df4be5 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] 10.222.0.33 "GET /compute/v2.1/servers/243cbbbd-0734-4711-b605-c0657b81e359" status: 404 len: 111 microversion: 2.1 time: 0.094836 Oct 04 21:01:59.609586 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2588/5192] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:01:59 2022] GET /compute/v2.1/servers/243cbbbd-0734-4711-b605-c0657b81e359 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:01:59.791639 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-d0873f28-862a-42c4-90f4-8e2be078f6bd tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:01:59.792255 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-d0873f28-862a-42c4-90f4-8e2be078f6bd tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] [instance: cc9ad5af-1587-4aa1-8323-a50c91bb1b84] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:01:59.806955 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d0873f28-862a-42c4-90f4-8e2be078f6bd tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:59.807662 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d0873f28-862a-42c4-90f4-8e2be078f6bd tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:59.808289 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d0873f28-862a-42c4-90f4-8e2be078f6bd tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:01:59.809195 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d0873f28-862a-42c4-90f4-8e2be078f6bd tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:01:59.809802 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d0873f28-862a-42c4-90f4-8e2be078f6bd tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:01:59.810426 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d0873f28-862a-42c4-90f4-8e2be078f6bd tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:02:00.134928 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-37f24a9f-3cfb-4127-83b1-04429ee58665 req-493402ef-d121-418e-b0df-bb94183ddf3c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc9ad5af-1587-4aa1-8323-a50c91bb1b84", "tag": "1669c917-58c0-440d-8b0d-29a608119c96"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:02:00.160499 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-37f24a9f-3cfb-4127-83b1-04429ee58665 req-493402ef-d121-418e-b0df-bb94183ddf3c service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:02:00.161975 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-37f24a9f-3cfb-4127-83b1-04429ee58665 req-493402ef-d121-418e-b0df-bb94183ddf3c service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:02:00.162933 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-37f24a9f-3cfb-4127-83b1-04429ee58665 req-493402ef-d121-418e-b0df-bb94183ddf3c service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:02:00.182145 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-37f24a9f-3cfb-4127-83b1-04429ee58665 req-493402ef-d121-418e-b0df-bb94183ddf3c service nova] Creating event network-changed:1669c917-58c0-440d-8b0d-29a608119c96 for instance cc9ad5af-1587-4aa1-8323-a50c91bb1b84 on n-h1-854823-8 Oct 04 21:02:00.189631 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-37f24a9f-3cfb-4127-83b1-04429ee58665 req-493402ef-d121-418e-b0df-bb94183ddf3c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061761 Oct 04 21:02:00.190847 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2589/5193] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:02:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:02:00.273487 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-d0873f28-862a-42c4-90f4-8e2be078f6bd tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:02:00.282791 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-d0873f28-862a-42c4-90f4-8e2be078f6bd tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:02:00.284553 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-d0873f28-862a-42c4-90f4-8e2be078f6bd tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:02:00.286032 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-d0873f28-862a-42c4-90f4-8e2be078f6bd tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] 10.222.0.33 "GET /compute/v2.1/servers/cc9ad5af-1587-4aa1-8323-a50c91bb1b84" status: 200 len: 1407 microversion: 2.20 time: 0.498895 Oct 04 21:02:00.308508 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2605/5194] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 21:01:59 2022] GET /compute/v2.1/servers/cc9ad5af-1587-4aa1-8323-a50c91bb1b84 => generated 1407 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:02:01.313714 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e1c16c0f-56da-4944-abcc-6350d0cbddf7 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:02:01.315134 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e1c16c0f-56da-4944-abcc-6350d0cbddf7 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] [instance: cc9ad5af-1587-4aa1-8323-a50c91bb1b84] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:02:01.323684 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:02:01.330118 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e1c16c0f-56da-4944-abcc-6350d0cbddf7 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:02:01.330886 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e1c16c0f-56da-4944-abcc-6350d0cbddf7 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:02:01.331560 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e1c16c0f-56da-4944-abcc-6350d0cbddf7 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:02:01.332933 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e1c16c0f-56da-4944-abcc-6350d0cbddf7 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:02:01.333595 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e1c16c0f-56da-4944-abcc-6350d0cbddf7 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:02:01.334242 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e1c16c0f-56da-4944-abcc-6350d0cbddf7 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:02:02.002269 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e1c16c0f-56da-4944-abcc-6350d0cbddf7 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:02:02.013017 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e1c16c0f-56da-4944-abcc-6350d0cbddf7 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:02:02.014517 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e1c16c0f-56da-4944-abcc-6350d0cbddf7 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:02:02.015699 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e1c16c0f-56da-4944-abcc-6350d0cbddf7 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] 10.222.0.33 "GET /compute/v2.1/servers/cc9ad5af-1587-4aa1-8323-a50c91bb1b84" status: 200 len: 1407 microversion: 2.20 time: 0.706759 Oct 04 21:02:02.022756 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2590/5195] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 21:02:01 2022] GET /compute/v2.1/servers/cc9ad5af-1587-4aa1-8323-a50c91bb1b84 => generated 1407 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:02:03.053483 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-d32dd367-0fb9-49c3-9eb4-1638444d1602 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:02:03.054116 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-d32dd367-0fb9-49c3-9eb4-1638444d1602 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] [instance: cc9ad5af-1587-4aa1-8323-a50c91bb1b84] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:02:03.064249 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell0:SELECT=2 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:02:03.072126 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell0:SELECT=6 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:02:03.078601 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d32dd367-0fb9-49c3-9eb4-1638444d1602 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:02:03.079814 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d32dd367-0fb9-49c3-9eb4-1638444d1602 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:02:03.081433 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d32dd367-0fb9-49c3-9eb4-1638444d1602 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:02:03.084492 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d32dd367-0fb9-49c3-9eb4-1638444d1602 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:02:03.085100 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d32dd367-0fb9-49c3-9eb4-1638444d1602 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:02:03.086480 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d32dd367-0fb9-49c3-9eb4-1638444d1602 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:02:03.576626 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-d32dd367-0fb9-49c3-9eb4-1638444d1602 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:02:03.596031 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-d32dd367-0fb9-49c3-9eb4-1638444d1602 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:02:03.609590 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-d32dd367-0fb9-49c3-9eb4-1638444d1602 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:02:03.611848 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-d32dd367-0fb9-49c3-9eb4-1638444d1602 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] 10.222.0.33 "GET /compute/v2.1/servers/cc9ad5af-1587-4aa1-8323-a50c91bb1b84" status: 200 len: 1407 microversion: 2.20 time: 0.565855 Oct 04 21:02:03.617114 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2606/5196] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 21:02:03 2022] GET /compute/v2.1/servers/cc9ad5af-1587-4aa1-8323-a50c91bb1b84 => generated 1407 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:02:04.654117 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-54b6085f-3ebc-429f-a1c3-b7f0566fad38 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:02:04.654765 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-54b6085f-3ebc-429f-a1c3-b7f0566fad38 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] [instance: cc9ad5af-1587-4aa1-8323-a50c91bb1b84] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:02:04.674775 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-54b6085f-3ebc-429f-a1c3-b7f0566fad38 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:02:04.682772 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-54b6085f-3ebc-429f-a1c3-b7f0566fad38 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:02:04.684823 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-54b6085f-3ebc-429f-a1c3-b7f0566fad38 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:02:04.689361 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-54b6085f-3ebc-429f-a1c3-b7f0566fad38 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:02:04.691719 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-54b6085f-3ebc-429f-a1c3-b7f0566fad38 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:02:04.692479 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-54b6085f-3ebc-429f-a1c3-b7f0566fad38 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:02:05.487372 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-54b6085f-3ebc-429f-a1c3-b7f0566fad38 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:02:05.500529 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-54b6085f-3ebc-429f-a1c3-b7f0566fad38 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:02:05.508410 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-54b6085f-3ebc-429f-a1c3-b7f0566fad38 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:02:05.513373 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-54b6085f-3ebc-429f-a1c3-b7f0566fad38 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] 10.222.0.33 "GET /compute/v2.1/servers/cc9ad5af-1587-4aa1-8323-a50c91bb1b84" status: 200 len: 1407 microversion: 2.20 time: 0.861384 Oct 04 21:02:05.517902 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2591/5197] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 21:02:04 2022] GET /compute/v2.1/servers/cc9ad5af-1587-4aa1-8323-a50c91bb1b84 => generated 1407 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:02:06.544526 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-85416585-3efc-439a-a580-2feef91275a4 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:02:06.548877 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-85416585-3efc-439a-a580-2feef91275a4 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] [instance: cc9ad5af-1587-4aa1-8323-a50c91bb1b84] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:02:06.565184 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-85416585-3efc-439a-a580-2feef91275a4 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:02:06.565687 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-85416585-3efc-439a-a580-2feef91275a4 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:02:06.570757 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-85416585-3efc-439a-a580-2feef91275a4 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:02:06.579720 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-85416585-3efc-439a-a580-2feef91275a4 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:02:06.580303 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-85416585-3efc-439a-a580-2feef91275a4 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:02:06.582885 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-85416585-3efc-439a-a580-2feef91275a4 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:02:06.591704 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:02:07.102772 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-85416585-3efc-439a-a580-2feef91275a4 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:02:07.112291 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-85416585-3efc-439a-a580-2feef91275a4 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:02:07.113761 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-85416585-3efc-439a-a580-2feef91275a4 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:02:07.114949 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-85416585-3efc-439a-a580-2feef91275a4 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] 10.222.0.33 "GET /compute/v2.1/servers/cc9ad5af-1587-4aa1-8323-a50c91bb1b84" status: 200 len: 1407 microversion: 2.20 time: 0.575067 Oct 04 21:02:07.115525 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2607/5198] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 21:02:06 2022] GET /compute/v2.1/servers/cc9ad5af-1587-4aa1-8323-a50c91bb1b84 => generated 1407 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:02:07.290597 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-782783ec-490c-48de-88c3-d18d7e026052 req-9c24f7f1-3f29-431e-9b22-d38bff141247 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc9ad5af-1587-4aa1-8323-a50c91bb1b84", "name": "network-vif-plugged", "status": "completed", "tag": "1669c917-58c0-440d-8b0d-29a608119c96"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:02:07.316144 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-782783ec-490c-48de-88c3-d18d7e026052 req-9c24f7f1-3f29-431e-9b22-d38bff141247 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:02:07.316636 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-782783ec-490c-48de-88c3-d18d7e026052 req-9c24f7f1-3f29-431e-9b22-d38bff141247 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:02:07.317070 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-782783ec-490c-48de-88c3-d18d7e026052 req-9c24f7f1-3f29-431e-9b22-d38bff141247 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:02:07.335031 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-782783ec-490c-48de-88c3-d18d7e026052 req-9c24f7f1-3f29-431e-9b22-d38bff141247 service nova] Creating event network-vif-plugged:1669c917-58c0-440d-8b0d-29a608119c96 for instance cc9ad5af-1587-4aa1-8323-a50c91bb1b84 on n-h1-854823-8 Oct 04 21:02:07.342412 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-782783ec-490c-48de-88c3-d18d7e026052 req-9c24f7f1-3f29-431e-9b22-d38bff141247 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055377 Oct 04 21:02:07.344801 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2608/5199] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:02:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:02:07.532603 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-4d29878f-93f7-4552-b7f8-8c4e7990479c tempest-ExtensionsTest-2008669139 tempest-ExtensionsTest-2008669139-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:02:07.534486 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-4d29878f-93f7-4552-b7f8-8c4e7990479c tempest-ExtensionsTest-2008669139 tempest-ExtensionsTest-2008669139-project] 10.222.0.33 "GET /compute/v2.1/extensions/os-consoles" status: 200 len: 217 microversion: 2.1 time: 0.756988 Oct 04 21:02:07.535155 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2592/5200] 10.222.0.33 () {58 vars in 1170 bytes} [Tue Oct 4 21:02:06 2022] GET /compute/v2.1/extensions/os-consoles => generated 217 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:02:07.545611 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-1888e928-46f9-4adf-a600-fac5421ba7f8 tempest-ExtensionsTest-2008669139 tempest-ExtensionsTest-2008669139-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:02:07.549739 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-1888e928-46f9-4adf-a600-fac5421ba7f8 tempest-ExtensionsTest-2008669139 tempest-ExtensionsTest-2008669139-project] 10.222.0.33 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.008788 Oct 04 21:02:07.552297 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2609/5201] 10.222.0.33 () {58 vars in 1134 bytes} [Tue Oct 4 21:02:07 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 11 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 21:02:08.144304 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-eba97a05-6d4a-46fb-9ed5-9a5c2cf40d10 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:02:08.145381 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-eba97a05-6d4a-46fb-9ed5-9a5c2cf40d10 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] [instance: cc9ad5af-1587-4aa1-8323-a50c91bb1b84] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:02:08.165828 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-eba97a05-6d4a-46fb-9ed5-9a5c2cf40d10 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:02:08.166288 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-eba97a05-6d4a-46fb-9ed5-9a5c2cf40d10 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:02:08.166764 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-eba97a05-6d4a-46fb-9ed5-9a5c2cf40d10 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:02:08.167486 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-eba97a05-6d4a-46fb-9ed5-9a5c2cf40d10 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:02:08.168028 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-eba97a05-6d4a-46fb-9ed5-9a5c2cf40d10 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:02:08.168615 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-eba97a05-6d4a-46fb-9ed5-9a5c2cf40d10 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:02:08.616898 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-eba97a05-6d4a-46fb-9ed5-9a5c2cf40d10 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:02:08.636603 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-eba97a05-6d4a-46fb-9ed5-9a5c2cf40d10 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:02:08.639324 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-eba97a05-6d4a-46fb-9ed5-9a5c2cf40d10 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:02:08.644405 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-eba97a05-6d4a-46fb-9ed5-9a5c2cf40d10 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] 10.222.0.33 "GET /compute/v2.1/servers/cc9ad5af-1587-4aa1-8323-a50c91bb1b84" status: 200 len: 1407 microversion: 2.20 time: 0.503996 Oct 04 21:02:08.648358 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2593/5202] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 21:02:08 2022] GET /compute/v2.1/servers/cc9ad5af-1587-4aa1-8323-a50c91bb1b84 => generated 1407 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:02:08.768818 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-29571c40-65d6-4f7c-b5ed-517316637858 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Calling method '.version_select at 0x7f3c740fa8b0>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:02:08.817102 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-29571c40-65d6-4f7c-b5ed-517316637858 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1637210633" status: 202 len: 0 microversion: 2.1 time: 0.052959 Oct 04 21:02:08.817887 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2610/5203] 10.222.0.33 () {58 vars in 1284 bytes} [Tue Oct 4 21:02:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1637210633 => generated 0 bytes in 54 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:02:08.857814 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9a22a97a-6efa-41c5-a690-5fc34163452e tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Action: 'create', calling method: .version_select at 0x7f3c6f06be50>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-2027624640", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNxY9LrjPqmjWilsB463GOPc7ilbceMYNQ0e7y3wMEQ8Vhdi/Av53bzEAdkFU7qOi9Y4IxB6Xa0XkWKsPZbc5rwRoW88hbkiHbYTlv5nhvFrkTJLUETl3YIdZC7hOPVuMA=="}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:02:08.911750 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-9a22a97a-6efa-41c5-a690-5fc34163452e tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Getting quotas for project b3aa23aee3c8435c8f1f409019c5fed2. Resources: {'key_pairs'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:02:08.939864 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-9a22a97a-6efa-41c5-a690-5fc34163452e tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Getting quotas for user 0be5dbe3da6a4af181ef7302fe605fb4 and project b3aa23aee3c8435c8f1f409019c5fed2. Resources: {'key_pairs'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:02:09.011246 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-9a22a97a-6efa-41c5-a690-5fc34163452e tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.158900 Oct 04 21:02:09.012403 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2594/5204] 10.222.0.33 () {60 vars in 1159 bytes} [Tue Oct 4 21:02:08 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:02:09.680612 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-3fd70460-350e-42ca-80c6-249b184aeab0 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:02:09.681562 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-3fd70460-350e-42ca-80c6-249b184aeab0 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] [instance: cc9ad5af-1587-4aa1-8323-a50c91bb1b84] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:02:09.704946 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3fd70460-350e-42ca-80c6-249b184aeab0 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:02:09.705884 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3fd70460-350e-42ca-80c6-249b184aeab0 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:02:09.706528 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3fd70460-350e-42ca-80c6-249b184aeab0 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:02:09.707459 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3fd70460-350e-42ca-80c6-249b184aeab0 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:02:09.708126 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3fd70460-350e-42ca-80c6-249b184aeab0 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:02:09.708707 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3fd70460-350e-42ca-80c6-249b184aeab0 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:02:10.329292 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-3fd70460-350e-42ca-80c6-249b184aeab0 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:02:10.338053 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-3fd70460-350e-42ca-80c6-249b184aeab0 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:02:10.348711 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-3fd70460-350e-42ca-80c6-249b184aeab0 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:02:10.349964 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-3fd70460-350e-42ca-80c6-249b184aeab0 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] 10.222.0.33 "GET /compute/v2.1/servers/cc9ad5af-1587-4aa1-8323-a50c91bb1b84" status: 200 len: 1599 microversion: 2.20 time: 0.680807 Oct 04 21:02:10.350568 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2611/5205] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 21:02:09 2022] GET /compute/v2.1/servers/cc9ad5af-1587-4aa1-8323-a50c91bb1b84 => generated 1599 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:02:10.385009 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-08414dd5-1836-439f-ab44-fa9b65b05295 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:02:10.385776 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-08414dd5-1836-439f-ab44-fa9b65b05295 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] [instance: cc9ad5af-1587-4aa1-8323-a50c91bb1b84] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:02:10.402477 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-08414dd5-1836-439f-ab44-fa9b65b05295 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:02:10.403082 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-08414dd5-1836-439f-ab44-fa9b65b05295 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:02:10.403550 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-08414dd5-1836-439f-ab44-fa9b65b05295 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:02:10.404297 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-08414dd5-1836-439f-ab44-fa9b65b05295 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:02:10.404796 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-08414dd5-1836-439f-ab44-fa9b65b05295 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:02:10.405342 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-08414dd5-1836-439f-ab44-fa9b65b05295 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:02:10.712376 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-08414dd5-1836-439f-ab44-fa9b65b05295 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] 10.222.0.33 "GET /compute/v2.1/servers/cc9ad5af-1587-4aa1-8323-a50c91bb1b84/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.334195 Oct 04 21:02:10.713115 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2595/5206] 10.222.0.33 () {60 vars in 1316 bytes} [Tue Oct 4 21:02:10 2022] GET /compute/v2.1/servers/cc9ad5af-1587-4aa1-8323-a50c91bb1b84/os-interface => generated 285 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 21:02:14.665182 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-30a2debe-50da-4bb2-b878-0c302422b086 req-ab5ffa69-24a1-417a-ba53-732c1c675a9b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc9ad5af-1587-4aa1-8323-a50c91bb1b84", "tag": "1669c917-58c0-440d-8b0d-29a608119c96"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:02:14.696248 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-30a2debe-50da-4bb2-b878-0c302422b086 req-ab5ffa69-24a1-417a-ba53-732c1c675a9b service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:02:14.697158 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-30a2debe-50da-4bb2-b878-0c302422b086 req-ab5ffa69-24a1-417a-ba53-732c1c675a9b service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:02:14.710336 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-30a2debe-50da-4bb2-b878-0c302422b086 req-ab5ffa69-24a1-417a-ba53-732c1c675a9b service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:02:14.726559 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-30a2debe-50da-4bb2-b878-0c302422b086 req-ab5ffa69-24a1-417a-ba53-732c1c675a9b service nova] Creating event network-changed:1669c917-58c0-440d-8b0d-29a608119c96 for instance cc9ad5af-1587-4aa1-8323-a50c91bb1b84 on n-h1-854823-8 Oct 04 21:02:14.735984 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-30a2debe-50da-4bb2-b878-0c302422b086 req-ab5ffa69-24a1-417a-ba53-732c1c675a9b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090353 Oct 04 21:02:14.737035 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2612/5207] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:02:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:02:15.648441 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9623b8f2-6d7a-40ad-82aa-aa281e42c88c tempest-ComputeTenantNetworksTest-1607015773 tempest-ComputeTenantNetworksTest-1607015773-project] Calling method '.version_select at 0x7f3c6efcbee0>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:02:16.007754 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-9623b8f2-6d7a-40ad-82aa-aa281e42c88c tempest-ComputeTenantNetworksTest-1607015773 tempest-ComputeTenantNetworksTest-1607015773-project] 10.222.0.33 "GET /compute/v2.1/os-tenant-networks" status: 200 len: 309 microversion: 2.1 time: 1.176529 Oct 04 21:02:16.008355 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2596/5208] 10.222.0.33 () {58 vars in 1158 bytes} [Tue Oct 4 21:02:14 2022] GET /compute/v2.1/os-tenant-networks => generated 309 bytes in 1182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:02:16.020619 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-22d64d74-841d-4629-a25f-cf7aad42c7e5 tempest-ComputeTenantNetworksTest-1607015773 tempest-ComputeTenantNetworksTest-1607015773-project] Calling method '.version_select at 0x7f3c740ad430>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:02:16.267403 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-22d64d74-841d-4629-a25f-cf7aad42c7e5 tempest-ComputeTenantNetworksTest-1607015773 tempest-ComputeTenantNetworksTest-1607015773-project] 10.222.0.33 "GET /compute/v2.1/os-tenant-networks/9db3fbf5-f6a3-4afd-aebb-1df11256bf8b" status: 200 len: 140 microversion: 2.1 time: 0.251185 Oct 04 21:02:16.268581 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2613/5209] 10.222.0.33 () {58 vars in 1269 bytes} [Tue Oct 4 21:02:16 2022] GET /compute/v2.1/os-tenant-networks/9db3fbf5-f6a3-4afd-aebb-1df11256bf8b => generated 140 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:02:32.573642 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=4 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:02:32.575584 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:02:32.579027 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=35 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:02:32.589230 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5e716cd9-531d-4406-90f4-3f26eaef82f5 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-611015063", "imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63", "flavorRef": "452", "networks": [{"uuid": "e332aaa2-9ac0-43db-909e-1bc00c7ba166"}], "key_name": "tempest-TestNetworkAdvancedServerOps-2027624640", "security_groups": [{"name": "tempest-secgroup-smoke-713517521"}]}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:02:32.886694 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_api:SELECT=29,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:02:32.887458 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=15 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:02:33.135191 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.network.neutron [None req-5e716cd9-531d-4406-90f4-3f26eaef82f5 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] validate_networks() for [('e332aaa2-9ac0-43db-909e-1bc00c7ba166', None, None, None, None, None)] {{(pid=128801) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:02:33.541287 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-e3271278-ea9a-4fee-b147-ccb1594d5ff6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1201573462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1201573462-project-admin] Calling method '.version_select at 0x7f3c7419fca0>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:02:33.544760 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e3271278-ea9a-4fee-b147-ccb1594d5ff6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1201573462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1201573462-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:02:33.546625 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e3271278-ea9a-4fee-b147-ccb1594d5ff6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1201573462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1201573462-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:02:33.549893 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e3271278-ea9a-4fee-b147-ccb1594d5ff6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1201573462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1201573462-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:02:33.602873 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e3271278-ea9a-4fee-b147-ccb1594d5ff6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1201573462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1201573462-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:02:33.605766 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e3271278-ea9a-4fee-b147-ccb1594d5ff6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1201573462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1201573462-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:02:33.608763 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e3271278-ea9a-4fee-b147-ccb1594d5ff6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1201573462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1201573462-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:02:33.645838 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e3271278-ea9a-4fee-b147-ccb1594d5ff6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1201573462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1201573462-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:02:33.646701 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e3271278-ea9a-4fee-b147-ccb1594d5ff6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1201573462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1201573462-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:02:33.650461 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e3271278-ea9a-4fee-b147-ccb1594d5ff6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1201573462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1201573462-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:02:33.667985 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-e3271278-ea9a-4fee-b147-ccb1594d5ff6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1201573462 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1201573462-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.783877 Oct 04 21:02:33.670942 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2614/5210] 10.222.0.33 () {58 vars in 1146 bytes} [Tue Oct 4 21:02:32 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:02:34.741036 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-5e716cd9-531d-4406-90f4-3f26eaef82f5 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Flavor limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:02:34.741977 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-5e716cd9-531d-4406-90f4-3f26eaef82f5 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Image limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:02:34.742759 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-5e716cd9-531d-4406-90f4-3f26eaef82f5 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Flavor pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:02:34.743378 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-5e716cd9-531d-4406-90f4-3f26eaef82f5 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Image pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:02:34.743969 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-5e716cd9-531d-4406-90f4-3f26eaef82f5 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:02:34.757692 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5e716cd9-531d-4406-90f4-3f26eaef82f5 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:02:34.766307 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5e716cd9-531d-4406-90f4-3f26eaef82f5 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:02:34.767022 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5e716cd9-531d-4406-90f4-3f26eaef82f5 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:02:34.768113 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5e716cd9-531d-4406-90f4-3f26eaef82f5 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:02:34.769178 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5e716cd9-531d-4406-90f4-3f26eaef82f5 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:02:34.771246 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5e716cd9-531d-4406-90f4-3f26eaef82f5 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:02:34.797632 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-5e716cd9-531d-4406-90f4-3f26eaef82f5 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Getting quotas for project b3aa23aee3c8435c8f1f409019c5fed2. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:02:34.805586 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-5e716cd9-531d-4406-90f4-3f26eaef82f5 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Getting quotas for user 0be5dbe3da6a4af181ef7302fe605fb4 and project b3aa23aee3c8435c8f1f409019c5fed2. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:02:34.825485 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-5e716cd9-531d-4406-90f4-3f26eaef82f5 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Going to run 1 instances... {{(pid=128801) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:02:34.828757 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-5e716cd9-531d-4406-90f4-3f26eaef82f5 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] [instance: 5a95bf94-24e7-43a2-9818-d5bf1b0315f1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='15b24725-0c99-4bcf-b1fb-907cdf8e2d63',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128801) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:02:34.937797 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5e716cd9-531d-4406-90f4-3f26eaef82f5 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.362524 Oct 04 21:02:34.947768 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2597/5211] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 21:02:32 2022] POST /compute/v2.1/servers => generated 405 bytes in 2377 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:02:34.954026 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-21d20fd0-cef7-4205-b40c-f60efce99422 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:02:34.954907 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-21d20fd0-cef7-4205-b40c-f60efce99422 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] [instance: 5a95bf94-24e7-43a2-9818-d5bf1b0315f1] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:02:35.819301 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-21d20fd0-cef7-4205-b40c-f60efce99422 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5dbe3da6a4af181ef7302fe605fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3aa23aee3c8435c8f1f409019c5fed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:02:35.831190 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-21d20fd0-cef7-4205-b40c-f60efce99422 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] 10.222.0.33 "GET /compute/v2.1/servers/5a95bf94-24e7-43a2-9818-d5bf1b0315f1" status: 200 len: 1266 microversion: 2.1 time: 0.883083 Oct 04 21:02:35.831774 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2615/5212] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:02:34 2022] GET /compute/v2.1/servers/5a95bf94-24e7-43a2-9818-d5bf1b0315f1 => generated 1266 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:02:36.862839 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ecc30ae0-12a6-42a4-9eca-b1eb8e129c25 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:02:36.863744 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ecc30ae0-12a6-42a4-9eca-b1eb8e129c25 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] [instance: 5a95bf94-24e7-43a2-9818-d5bf1b0315f1] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:02:36.881766 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ecc30ae0-12a6-42a4-9eca-b1eb8e129c25 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:02:36.902131 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ecc30ae0-12a6-42a4-9eca-b1eb8e129c25 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:02:36.903424 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ecc30ae0-12a6-42a4-9eca-b1eb8e129c25 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:02:36.903424 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ecc30ae0-12a6-42a4-9eca-b1eb8e129c25 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:02:36.903911 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ecc30ae0-12a6-42a4-9eca-b1eb8e129c25 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:02:36.904347 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ecc30ae0-12a6-42a4-9eca-b1eb8e129c25 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:02:37.216670 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-ecc30ae0-12a6-42a4-9eca-b1eb8e129c25 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5dbe3da6a4af181ef7302fe605fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3aa23aee3c8435c8f1f409019c5fed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:02:37.246653 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ecc30ae0-12a6-42a4-9eca-b1eb8e129c25 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] 10.222.0.33 "GET /compute/v2.1/servers/5a95bf94-24e7-43a2-9818-d5bf1b0315f1" status: 200 len: 1318 microversion: 2.1 time: 0.384029 Oct 04 21:02:37.250380 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2598/5213] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:02:36 2022] GET /compute/v2.1/servers/5a95bf94-24e7-43a2-9818-d5bf1b0315f1 => generated 1318 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:02:38.278916 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-ed4df891-77fa-4059-8311-55fb659b174c tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:02:38.280354 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-ed4df891-77fa-4059-8311-55fb659b174c tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] [instance: 5a95bf94-24e7-43a2-9818-d5bf1b0315f1] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:02:38.319656 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ed4df891-77fa-4059-8311-55fb659b174c tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:02:38.321338 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ed4df891-77fa-4059-8311-55fb659b174c tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:02:38.322221 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ed4df891-77fa-4059-8311-55fb659b174c tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:02:38.323229 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ed4df891-77fa-4059-8311-55fb659b174c tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:02:38.325235 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ed4df891-77fa-4059-8311-55fb659b174c tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:02:38.326011 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ed4df891-77fa-4059-8311-55fb659b174c tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:02:38.503085 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-ed4df891-77fa-4059-8311-55fb659b174c tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5dbe3da6a4af181ef7302fe605fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3aa23aee3c8435c8f1f409019c5fed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:02:38.531246 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-ed4df891-77fa-4059-8311-55fb659b174c tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] 10.222.0.33 "GET /compute/v2.1/servers/5a95bf94-24e7-43a2-9818-d5bf1b0315f1" status: 200 len: 1324 microversion: 2.1 time: 0.258492 Oct 04 21:02:38.534546 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2616/5214] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:02:38 2022] GET /compute/v2.1/servers/5a95bf94-24e7-43a2-9818-d5bf1b0315f1 => generated 1324 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:02:39.559998 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-138867ad-627a-4fce-a7ba-c4294f86ae47 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:02:39.562164 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-138867ad-627a-4fce-a7ba-c4294f86ae47 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] [instance: 5a95bf94-24e7-43a2-9818-d5bf1b0315f1] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:02:39.588579 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-138867ad-627a-4fce-a7ba-c4294f86ae47 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:02:39.594471 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-138867ad-627a-4fce-a7ba-c4294f86ae47 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:02:39.598473 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-138867ad-627a-4fce-a7ba-c4294f86ae47 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:02:39.599752 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-138867ad-627a-4fce-a7ba-c4294f86ae47 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:02:39.601682 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-138867ad-627a-4fce-a7ba-c4294f86ae47 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:02:39.602321 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-138867ad-627a-4fce-a7ba-c4294f86ae47 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:02:40.052178 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-138867ad-627a-4fce-a7ba-c4294f86ae47 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5dbe3da6a4af181ef7302fe605fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3aa23aee3c8435c8f1f409019c5fed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:02:40.097072 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-138867ad-627a-4fce-a7ba-c4294f86ae47 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] 10.222.0.33 "GET /compute/v2.1/servers/5a95bf94-24e7-43a2-9818-d5bf1b0315f1" status: 200 len: 1324 microversion: 2.1 time: 0.526777 Oct 04 21:02:40.116037 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2599/5215] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:02:39 2022] GET /compute/v2.1/servers/5a95bf94-24e7-43a2-9818-d5bf1b0315f1 => generated 1324 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:02:41.129252 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-10b87766-6639-4ebf-8cdf-2824dad0d6fa tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:02:41.129885 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-10b87766-6639-4ebf-8cdf-2824dad0d6fa tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] [instance: 5a95bf94-24e7-43a2-9818-d5bf1b0315f1] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:02:41.145257 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-10b87766-6639-4ebf-8cdf-2824dad0d6fa tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:02:41.148223 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-10b87766-6639-4ebf-8cdf-2824dad0d6fa tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:02:41.149184 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-10b87766-6639-4ebf-8cdf-2824dad0d6fa tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:02:41.150173 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-10b87766-6639-4ebf-8cdf-2824dad0d6fa tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:02:41.157123 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-10b87766-6639-4ebf-8cdf-2824dad0d6fa tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:02:41.157826 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-10b87766-6639-4ebf-8cdf-2824dad0d6fa tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:02:41.543988 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-10b87766-6639-4ebf-8cdf-2824dad0d6fa tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5dbe3da6a4af181ef7302fe605fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3aa23aee3c8435c8f1f409019c5fed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:02:41.577416 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f8801638-fe0d-47a9-977c-6c18f26f0f84 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-smoke-1637404469", "imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63", "flavorRef": "452", "networks": [{"uuid": "62be98fa-147f-4668-af06-b6a03298adcf"}], "key_name": "tempest-TestSecurityGroupsBasicOps-1879853288", "security_groups": []}, "os:scheduler_hints": {"different_host": ["61bb9cf5-6da5-4074-9bb8-ffd1269ea50f"]}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:02:41.592909 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-10b87766-6639-4ebf-8cdf-2824dad0d6fa tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] 10.222.0.33 "GET /compute/v2.1/servers/5a95bf94-24e7-43a2-9818-d5bf1b0315f1" status: 200 len: 1391 microversion: 2.1 time: 0.466779 Oct 04 21:02:41.593857 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2617/5216] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:02:41 2022] GET /compute/v2.1/servers/5a95bf94-24e7-43a2-9818-d5bf1b0315f1 => generated 1391 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:02:41.739499 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.network.neutron [None req-f8801638-fe0d-47a9-977c-6c18f26f0f84 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] validate_networks() for [('62be98fa-147f-4668-af06-b6a03298adcf', None, None, None, None, None)] {{(pid=128801) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:02:42.619918 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-94626b56-b728-4969-a4e3-921b6b4dbca2 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:02:42.620885 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-94626b56-b728-4969-a4e3-921b6b4dbca2 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] [instance: 5a95bf94-24e7-43a2-9818-d5bf1b0315f1] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:02:42.642658 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-94626b56-b728-4969-a4e3-921b6b4dbca2 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:02:42.648493 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-94626b56-b728-4969-a4e3-921b6b4dbca2 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:02:42.649084 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-94626b56-b728-4969-a4e3-921b6b4dbca2 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:02:42.651841 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-94626b56-b728-4969-a4e3-921b6b4dbca2 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:02:42.652655 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-94626b56-b728-4969-a4e3-921b6b4dbca2 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:02:42.653525 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-94626b56-b728-4969-a4e3-921b6b4dbca2 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:02:43.326319 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-94626b56-b728-4969-a4e3-921b6b4dbca2 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5dbe3da6a4af181ef7302fe605fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3aa23aee3c8435c8f1f409019c5fed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:02:43.338925 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-94626b56-b728-4969-a4e3-921b6b4dbca2 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] 10.222.0.33 "GET /compute/v2.1/servers/5a95bf94-24e7-43a2-9818-d5bf1b0315f1" status: 200 len: 1391 microversion: 2.1 time: 0.723684 Oct 04 21:02:43.339539 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2618/5217] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:02:42 2022] GET /compute/v2.1/servers/5a95bf94-24e7-43a2-9818-d5bf1b0315f1 => generated 1391 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:02:44.239957 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-f8801638-fe0d-47a9-977c-6c18f26f0f84 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Flavor limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:02:44.240909 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-f8801638-fe0d-47a9-977c-6c18f26f0f84 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Image limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:02:44.241737 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-f8801638-fe0d-47a9-977c-6c18f26f0f84 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Flavor pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:02:44.242401 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-f8801638-fe0d-47a9-977c-6c18f26f0f84 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Image pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:02:44.243010 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-f8801638-fe0d-47a9-977c-6c18f26f0f84 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:02:44.286709 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f8801638-fe0d-47a9-977c-6c18f26f0f84 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:02:44.291343 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f8801638-fe0d-47a9-977c-6c18f26f0f84 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:02:44.293233 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f8801638-fe0d-47a9-977c-6c18f26f0f84 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:02:44.301528 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f8801638-fe0d-47a9-977c-6c18f26f0f84 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:02:44.302185 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f8801638-fe0d-47a9-977c-6c18f26f0f84 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:02:44.305956 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f8801638-fe0d-47a9-977c-6c18f26f0f84 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:02:44.365315 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-f51f13fe-33e7-409e-b071-4b5941dcef20 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:02:44.366732 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-f51f13fe-33e7-409e-b071-4b5941dcef20 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] [instance: 5a95bf94-24e7-43a2-9818-d5bf1b0315f1] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:02:44.395376 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f51f13fe-33e7-409e-b071-4b5941dcef20 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:02:44.396128 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f51f13fe-33e7-409e-b071-4b5941dcef20 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:02:44.396737 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f51f13fe-33e7-409e-b071-4b5941dcef20 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:02:44.403506 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f51f13fe-33e7-409e-b071-4b5941dcef20 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:02:44.404246 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f51f13fe-33e7-409e-b071-4b5941dcef20 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:02:44.405551 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f51f13fe-33e7-409e-b071-4b5941dcef20 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:02:44.416521 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-f8801638-fe0d-47a9-977c-6c18f26f0f84 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Getting quotas for project 8be936dd2db2466990cafbfbfb3a15cf. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:02:44.439927 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-f8801638-fe0d-47a9-977c-6c18f26f0f84 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Getting quotas for user 0f3403486e6f4afd8d97f97612110eb5 and project 8be936dd2db2466990cafbfbfb3a15cf. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:02:44.495361 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f8801638-fe0d-47a9-977c-6c18f26f0f84 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Going to run 1 instances... {{(pid=128801) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:02:44.502185 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f8801638-fe0d-47a9-977c-6c18f26f0f84 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] [instance: 0e0c304b-2735-4232-805f-5396927f389e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='15b24725-0c99-4bcf-b1fb-907cdf8e2d63',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128801) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:02:44.643405 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f8801638-fe0d-47a9-977c-6c18f26f0f84 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 361 microversion: 2.1 time: 3.070344 Oct 04 21:02:44.646728 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2600/5218] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 21:02:41 2022] POST /compute/v2.1/servers => generated 361 bytes in 3075 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 21:02:44.660704 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e6904d04-cae0-4929-bab8-1d21c9e0fa53 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:02:44.663946 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e6904d04-cae0-4929-bab8-1d21c9e0fa53 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] [instance: 0e0c304b-2735-4232-805f-5396927f389e] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:02:44.892487 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e6904d04-cae0-4929-bab8-1d21c9e0fa53 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3403486e6f4afd8d97f97612110eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be936dd2db2466990cafbfbfb3a15cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:02:44.915166 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e6904d04-cae0-4929-bab8-1d21c9e0fa53 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] 10.222.0.33 "GET /compute/v2.1/servers/0e0c304b-2735-4232-805f-5396927f389e" status: 200 len: 1242 microversion: 2.1 time: 0.262823 Oct 04 21:02:44.920739 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2601/5219] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:02:44 2022] GET /compute/v2.1/servers/0e0c304b-2735-4232-805f-5396927f389e => generated 1242 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:02:44.959166 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-f51f13fe-33e7-409e-b071-4b5941dcef20 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5dbe3da6a4af181ef7302fe605fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3aa23aee3c8435c8f1f409019c5fed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:02:44.973431 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-f51f13fe-33e7-409e-b071-4b5941dcef20 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] 10.222.0.33 "GET /compute/v2.1/servers/5a95bf94-24e7-43a2-9818-d5bf1b0315f1" status: 200 len: 1391 microversion: 2.1 time: 0.615663 Oct 04 21:02:44.986117 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2619/5220] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:02:44 2022] GET /compute/v2.1/servers/5a95bf94-24e7-43a2-9818-d5bf1b0315f1 => generated 1391 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:02:45.946916 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ee9feaec-c47c-4153-ac53-9d6802cdf969 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:02:45.947713 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ee9feaec-c47c-4153-ac53-9d6802cdf969 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] [instance: 0e0c304b-2735-4232-805f-5396927f389e] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:02:45.959432 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ee9feaec-c47c-4153-ac53-9d6802cdf969 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:02:45.959921 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ee9feaec-c47c-4153-ac53-9d6802cdf969 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:02:45.960355 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ee9feaec-c47c-4153-ac53-9d6802cdf969 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:02:45.961066 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ee9feaec-c47c-4153-ac53-9d6802cdf969 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:02:45.961526 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ee9feaec-c47c-4153-ac53-9d6802cdf969 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:02:45.961951 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ee9feaec-c47c-4153-ac53-9d6802cdf969 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:02:46.016121 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-e85f1bb5-dfba-4889-9657-7d9bcc111e1d tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:02:46.017519 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-e85f1bb5-dfba-4889-9657-7d9bcc111e1d tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] [instance: 5a95bf94-24e7-43a2-9818-d5bf1b0315f1] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:02:46.021356 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell0:SELECT=2 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:02:46.048883 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e85f1bb5-dfba-4889-9657-7d9bcc111e1d tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:02:46.050720 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e85f1bb5-dfba-4889-9657-7d9bcc111e1d tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:02:46.051422 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e85f1bb5-dfba-4889-9657-7d9bcc111e1d tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:02:46.053054 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e85f1bb5-dfba-4889-9657-7d9bcc111e1d tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:02:46.055925 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e85f1bb5-dfba-4889-9657-7d9bcc111e1d tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:02:46.058672 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e85f1bb5-dfba-4889-9657-7d9bcc111e1d tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:02:46.191421 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-ee9feaec-c47c-4153-ac53-9d6802cdf969 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3403486e6f4afd8d97f97612110eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be936dd2db2466990cafbfbfb3a15cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:02:46.203905 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ee9feaec-c47c-4153-ac53-9d6802cdf969 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] 10.222.0.33 "GET /compute/v2.1/servers/0e0c304b-2735-4232-805f-5396927f389e" status: 200 len: 1246 microversion: 2.1 time: 0.260789 Oct 04 21:02:46.220921 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2602/5221] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:02:45 2022] GET /compute/v2.1/servers/0e0c304b-2735-4232-805f-5396927f389e => generated 1246 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:02:46.548422 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-e85f1bb5-dfba-4889-9657-7d9bcc111e1d tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5dbe3da6a4af181ef7302fe605fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3aa23aee3c8435c8f1f409019c5fed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:02:46.564490 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-e85f1bb5-dfba-4889-9657-7d9bcc111e1d tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] 10.222.0.33 "GET /compute/v2.1/servers/5a95bf94-24e7-43a2-9818-d5bf1b0315f1" status: 200 len: 1391 microversion: 2.1 time: 0.553571 Oct 04 21:02:46.583383 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2620/5222] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:02:46 2022] GET /compute/v2.1/servers/5a95bf94-24e7-43a2-9818-d5bf1b0315f1 => generated 1391 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:02:47.242097 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1d22d509-5b2f-4f33-b821-d9730d153ec8 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:02:47.242756 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-1d22d509-5b2f-4f33-b821-d9730d153ec8 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] [instance: 0e0c304b-2735-4232-805f-5396927f389e] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:02:47.280352 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1d22d509-5b2f-4f33-b821-d9730d153ec8 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:02:47.284390 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1d22d509-5b2f-4f33-b821-d9730d153ec8 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:02:47.284390 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1d22d509-5b2f-4f33-b821-d9730d153ec8 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:02:47.289443 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1d22d509-5b2f-4f33-b821-d9730d153ec8 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:02:47.289957 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1d22d509-5b2f-4f33-b821-d9730d153ec8 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:02:47.293456 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1d22d509-5b2f-4f33-b821-d9730d153ec8 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:02:47.591141 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-154b4e5e-c3c5-4b6e-a1de-a82820ff9c82 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:02:47.592514 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-154b4e5e-c3c5-4b6e-a1de-a82820ff9c82 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] [instance: 5a95bf94-24e7-43a2-9818-d5bf1b0315f1] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:02:47.619251 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-154b4e5e-c3c5-4b6e-a1de-a82820ff9c82 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:02:47.619781 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-154b4e5e-c3c5-4b6e-a1de-a82820ff9c82 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:02:47.620185 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-154b4e5e-c3c5-4b6e-a1de-a82820ff9c82 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:02:47.620909 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-154b4e5e-c3c5-4b6e-a1de-a82820ff9c82 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:02:47.621371 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-154b4e5e-c3c5-4b6e-a1de-a82820ff9c82 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:02:47.621800 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-154b4e5e-c3c5-4b6e-a1de-a82820ff9c82 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:02:48.076074 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-1d22d509-5b2f-4f33-b821-d9730d153ec8 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3403486e6f4afd8d97f97612110eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be936dd2db2466990cafbfbfb3a15cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:02:48.098363 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-1d22d509-5b2f-4f33-b821-d9730d153ec8 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] 10.222.0.33 "GET /compute/v2.1/servers/0e0c304b-2735-4232-805f-5396927f389e" status: 200 len: 1294 microversion: 2.1 time: 0.861137 Oct 04 21:02:48.099665 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2603/5223] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:02:47 2022] GET /compute/v2.1/servers/0e0c304b-2735-4232-805f-5396927f389e => generated 1294 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:02:48.148402 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-607169ab-9e2b-4b0e-9f85-2d774ed5cb8b tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:02:48.150980 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-607169ab-9e2b-4b0e-9f85-2d774ed5cb8b tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] [instance: cc9ad5af-1587-4aa1-8323-a50c91bb1b84] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:02:48.167642 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-607169ab-9e2b-4b0e-9f85-2d774ed5cb8b tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:02:48.168795 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-607169ab-9e2b-4b0e-9f85-2d774ed5cb8b tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:02:48.169539 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-607169ab-9e2b-4b0e-9f85-2d774ed5cb8b tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:02:48.170842 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-607169ab-9e2b-4b0e-9f85-2d774ed5cb8b tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:02:48.171632 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-607169ab-9e2b-4b0e-9f85-2d774ed5cb8b tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:02:48.172552 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-607169ab-9e2b-4b0e-9f85-2d774ed5cb8b tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:02:48.215040 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-607169ab-9e2b-4b0e-9f85-2d774ed5cb8b tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] 10.222.0.33 "GET /compute/v2.1/servers/cc9ad5af-1587-4aa1-8323-a50c91bb1b84/ips" status: 200 len: 151 microversion: 2.20 time: 0.098861 Oct 04 21:02:48.216340 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2604/5224] 10.222.0.33 () {60 vars in 1289 bytes} [Tue Oct 4 21:02:48 2022] GET /compute/v2.1/servers/cc9ad5af-1587-4aa1-8323-a50c91bb1b84/ips => generated 151 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 21:02:48.255109 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-9eddcec5-9ad1-4a59-bb25-f04959a18bd7 req-352acba1-af6d-4921-b473-863a595eef35 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a95bf94-24e7-43a2-9818-d5bf1b0315f1", "tag": "99e654db-1794-4804-bb52-dc567c83649d"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:02:48.268431 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-9eddcec5-9ad1-4a59-bb25-f04959a18bd7 req-352acba1-af6d-4921-b473-863a595eef35 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:02:48.269107 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-9eddcec5-9ad1-4a59-bb25-f04959a18bd7 req-352acba1-af6d-4921-b473-863a595eef35 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:02:48.269724 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-9eddcec5-9ad1-4a59-bb25-f04959a18bd7 req-352acba1-af6d-4921-b473-863a595eef35 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:02:48.302581 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-9eddcec5-9ad1-4a59-bb25-f04959a18bd7 req-352acba1-af6d-4921-b473-863a595eef35 service nova] Creating event network-changed:99e654db-1794-4804-bb52-dc567c83649d for instance 5a95bf94-24e7-43a2-9818-d5bf1b0315f1 on n-h2-854823-8 Oct 04 21:02:48.309192 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-9eddcec5-9ad1-4a59-bb25-f04959a18bd7 req-352acba1-af6d-4921-b473-863a595eef35 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057943 Oct 04 21:02:48.310037 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2605/5225] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:02:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:02:48.327467 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-154b4e5e-c3c5-4b6e-a1de-a82820ff9c82 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5dbe3da6a4af181ef7302fe605fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3aa23aee3c8435c8f1f409019c5fed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:02:48.348018 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-154b4e5e-c3c5-4b6e-a1de-a82820ff9c82 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] 10.222.0.33 "GET /compute/v2.1/servers/5a95bf94-24e7-43a2-9818-d5bf1b0315f1" status: 200 len: 1391 microversion: 2.1 time: 0.762286 Oct 04 21:02:48.350067 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2621/5226] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:02:47 2022] GET /compute/v2.1/servers/5a95bf94-24e7-43a2-9818-d5bf1b0315f1 => generated 1391 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:02:49.123739 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a4eaa05f-5437-47a8-b44d-7a73789126e1 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:02:49.124551 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a4eaa05f-5437-47a8-b44d-7a73789126e1 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] [instance: 0e0c304b-2735-4232-805f-5396927f389e] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:02:49.148248 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a4eaa05f-5437-47a8-b44d-7a73789126e1 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:02:49.148745 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a4eaa05f-5437-47a8-b44d-7a73789126e1 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:02:49.149181 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a4eaa05f-5437-47a8-b44d-7a73789126e1 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:02:49.149878 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a4eaa05f-5437-47a8-b44d-7a73789126e1 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:02:49.155127 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a4eaa05f-5437-47a8-b44d-7a73789126e1 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:02:49.155800 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a4eaa05f-5437-47a8-b44d-7a73789126e1 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:02:49.377653 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-464d5850-31c7-4f57-ad07-700cbf39a3e1 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:02:49.378454 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-464d5850-31c7-4f57-ad07-700cbf39a3e1 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] [instance: 5a95bf94-24e7-43a2-9818-d5bf1b0315f1] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:02:49.398436 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-464d5850-31c7-4f57-ad07-700cbf39a3e1 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:02:49.399064 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-464d5850-31c7-4f57-ad07-700cbf39a3e1 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:02:49.399616 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-464d5850-31c7-4f57-ad07-700cbf39a3e1 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:02:49.400610 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-464d5850-31c7-4f57-ad07-700cbf39a3e1 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:02:49.401291 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-464d5850-31c7-4f57-ad07-700cbf39a3e1 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:02:49.402000 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-464d5850-31c7-4f57-ad07-700cbf39a3e1 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:02:49.583980 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-a4eaa05f-5437-47a8-b44d-7a73789126e1 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3403486e6f4afd8d97f97612110eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be936dd2db2466990cafbfbfb3a15cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:02:49.600410 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a4eaa05f-5437-47a8-b44d-7a73789126e1 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] 10.222.0.33 "GET /compute/v2.1/servers/0e0c304b-2735-4232-805f-5396927f389e" status: 200 len: 1300 microversion: 2.1 time: 0.481047 Oct 04 21:02:49.601046 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2606/5227] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:02:49 2022] GET /compute/v2.1/servers/0e0c304b-2735-4232-805f-5396927f389e => generated 1300 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:02:50.192271 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-464d5850-31c7-4f57-ad07-700cbf39a3e1 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5dbe3da6a4af181ef7302fe605fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3aa23aee3c8435c8f1f409019c5fed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:02:50.203762 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-464d5850-31c7-4f57-ad07-700cbf39a3e1 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] 10.222.0.33 "GET /compute/v2.1/servers/5a95bf94-24e7-43a2-9818-d5bf1b0315f1" status: 200 len: 1391 microversion: 2.1 time: 0.832142 Oct 04 21:02:50.204351 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2622/5228] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:02:49 2022] GET /compute/v2.1/servers/5a95bf94-24e7-43a2-9818-d5bf1b0315f1 => generated 1391 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:02:50.626500 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d082fdeb-e693-4bfe-b14e-827041977951 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:02:50.627809 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d082fdeb-e693-4bfe-b14e-827041977951 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] [instance: 0e0c304b-2735-4232-805f-5396927f389e] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:02:50.646866 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d082fdeb-e693-4bfe-b14e-827041977951 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:02:50.649721 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d082fdeb-e693-4bfe-b14e-827041977951 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:02:50.656085 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d082fdeb-e693-4bfe-b14e-827041977951 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:02:50.657105 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d082fdeb-e693-4bfe-b14e-827041977951 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:02:50.657802 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d082fdeb-e693-4bfe-b14e-827041977951 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:02:50.661256 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d082fdeb-e693-4bfe-b14e-827041977951 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:02:50.914549 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d082fdeb-e693-4bfe-b14e-827041977951 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3403486e6f4afd8d97f97612110eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be936dd2db2466990cafbfbfb3a15cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:02:50.931995 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d082fdeb-e693-4bfe-b14e-827041977951 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] 10.222.0.33 "GET /compute/v2.1/servers/0e0c304b-2735-4232-805f-5396927f389e" status: 200 len: 1300 microversion: 2.1 time: 0.310409 Oct 04 21:02:50.932601 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2607/5229] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:02:50 2022] GET /compute/v2.1/servers/0e0c304b-2735-4232-805f-5396927f389e => generated 1300 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:02:51.231649 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-54b70b6b-9ce9-427d-af03-214192d1f399 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:02:51.233139 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-54b70b6b-9ce9-427d-af03-214192d1f399 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] [instance: 5a95bf94-24e7-43a2-9818-d5bf1b0315f1] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:02:51.249075 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-54b70b6b-9ce9-427d-af03-214192d1f399 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:02:51.249591 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-54b70b6b-9ce9-427d-af03-214192d1f399 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:02:51.250038 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-54b70b6b-9ce9-427d-af03-214192d1f399 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:02:51.251014 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-54b70b6b-9ce9-427d-af03-214192d1f399 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:02:51.251575 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-54b70b6b-9ce9-427d-af03-214192d1f399 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:02:51.253456 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-54b70b6b-9ce9-427d-af03-214192d1f399 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:02:51.799401 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-dcd3077b-eba2-4dfd-a4e0-9d8f1aeb9816 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:02:51.800092 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-dcd3077b-eba2-4dfd-a4e0-9d8f1aeb9816 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] [instance: cc9ad5af-1587-4aa1-8323-a50c91bb1b84] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:02:51.813819 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dcd3077b-eba2-4dfd-a4e0-9d8f1aeb9816 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:02:51.817705 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dcd3077b-eba2-4dfd-a4e0-9d8f1aeb9816 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:02:51.819887 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dcd3077b-eba2-4dfd-a4e0-9d8f1aeb9816 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:02:51.822237 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dcd3077b-eba2-4dfd-a4e0-9d8f1aeb9816 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:02:51.824563 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dcd3077b-eba2-4dfd-a4e0-9d8f1aeb9816 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:02:51.825367 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dcd3077b-eba2-4dfd-a4e0-9d8f1aeb9816 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:02:51.884883 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-dcd3077b-eba2-4dfd-a4e0-9d8f1aeb9816 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lazy-loading 'flavor' on Instance uuid cc9ad5af-1587-4aa1-8323-a50c91bb1b84 {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:02:52.349461 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-54b70b6b-9ce9-427d-af03-214192d1f399 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5dbe3da6a4af181ef7302fe605fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3aa23aee3c8435c8f1f409019c5fed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:02:52.366058 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-54b70b6b-9ce9-427d-af03-214192d1f399 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] 10.222.0.33 "GET /compute/v2.1/servers/5a95bf94-24e7-43a2-9818-d5bf1b0315f1" status: 200 len: 1391 microversion: 2.1 time: 1.136699 Oct 04 21:02:52.370217 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2623/5230] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:02:51 2022] GET /compute/v2.1/servers/5a95bf94-24e7-43a2-9818-d5bf1b0315f1 => generated 1391 bytes in 1144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:02:52.380495 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-0b5ac1ec-ae4b-4174-bf84-dee92ccfac1c tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:02:52.382679 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-0b5ac1ec-ae4b-4174-bf84-dee92ccfac1c tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] [instance: 0e0c304b-2735-4232-805f-5396927f389e] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:02:52.398689 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0b5ac1ec-ae4b-4174-bf84-dee92ccfac1c tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:02:52.399680 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0b5ac1ec-ae4b-4174-bf84-dee92ccfac1c tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:02:52.400954 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0b5ac1ec-ae4b-4174-bf84-dee92ccfac1c tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:02:52.404124 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0b5ac1ec-ae4b-4174-bf84-dee92ccfac1c tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:02:52.405984 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0b5ac1ec-ae4b-4174-bf84-dee92ccfac1c tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:02:52.407476 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0b5ac1ec-ae4b-4174-bf84-dee92ccfac1c tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:02:52.408294 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-dcd3077b-eba2-4dfd-a4e0-9d8f1aeb9816 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] 10.222.0.33 "POST /compute/v2.1/servers/cc9ad5af-1587-4aa1-8323-a50c91bb1b84/action" status: 202 len: 0 microversion: 2.20 time: 0.612593 Oct 04 21:02:52.408922 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2608/5231] 10.222.0.33 () {62 vars in 1319 bytes} [Tue Oct 4 21:02:51 2022] POST /compute/v2.1/servers/cc9ad5af-1587-4aa1-8323-a50c91bb1b84/action => generated 0 bytes in 614 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:02:52.435315 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d6774726-2f56-4c18-8667-b6524be5b2dc tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:02:52.440615 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d6774726-2f56-4c18-8667-b6524be5b2dc tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] [instance: cc9ad5af-1587-4aa1-8323-a50c91bb1b84] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:02:52.461620 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d6774726-2f56-4c18-8667-b6524be5b2dc tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:02:52.469245 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d6774726-2f56-4c18-8667-b6524be5b2dc tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:02:52.473171 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d6774726-2f56-4c18-8667-b6524be5b2dc tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:02:52.474967 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d6774726-2f56-4c18-8667-b6524be5b2dc tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:02:52.479531 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d6774726-2f56-4c18-8667-b6524be5b2dc tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:02:52.479996 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d6774726-2f56-4c18-8667-b6524be5b2dc tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:02:52.917215 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-0b5ac1ec-ae4b-4174-bf84-dee92ccfac1c tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3403486e6f4afd8d97f97612110eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be936dd2db2466990cafbfbfb3a15cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:02:52.928764 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-0b5ac1ec-ae4b-4174-bf84-dee92ccfac1c tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] 10.222.0.33 "GET /compute/v2.1/servers/0e0c304b-2735-4232-805f-5396927f389e" status: 200 len: 1300 microversion: 2.1 time: 0.557219 Oct 04 21:02:52.930121 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2624/5232] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:02:52 2022] GET /compute/v2.1/servers/0e0c304b-2735-4232-805f-5396927f389e => generated 1300 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:02:53.368683 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d6774726-2f56-4c18-8667-b6524be5b2dc tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:02:53.379220 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d6774726-2f56-4c18-8667-b6524be5b2dc tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:02:53.384233 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d6774726-2f56-4c18-8667-b6524be5b2dc tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:02:53.393895 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-5087eb15-17df-40b1-94c8-2bf151b4b774 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:02:53.394570 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-5087eb15-17df-40b1-94c8-2bf151b4b774 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] [instance: 5a95bf94-24e7-43a2-9818-d5bf1b0315f1] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:02:53.395251 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d6774726-2f56-4c18-8667-b6524be5b2dc tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] 10.222.0.33 "GET /compute/v2.1/servers/cc9ad5af-1587-4aa1-8323-a50c91bb1b84" status: 200 len: 1723 microversion: 2.20 time: 0.971795 Oct 04 21:02:53.396159 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2609/5233] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 21:02:52 2022] GET /compute/v2.1/servers/cc9ad5af-1587-4aa1-8323-a50c91bb1b84 => generated 1723 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:02:53.401865 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5087eb15-17df-40b1-94c8-2bf151b4b774 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:02:53.402368 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5087eb15-17df-40b1-94c8-2bf151b4b774 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:02:53.402796 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5087eb15-17df-40b1-94c8-2bf151b4b774 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:02:53.411987 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5087eb15-17df-40b1-94c8-2bf151b4b774 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:02:53.412566 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5087eb15-17df-40b1-94c8-2bf151b4b774 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:02:53.413641 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5087eb15-17df-40b1-94c8-2bf151b4b774 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:02:53.958232 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ca6b4b6c-179c-4b37-96ef-42e2b9c2c896 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:02:53.959202 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ca6b4b6c-179c-4b37-96ef-42e2b9c2c896 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] [instance: 0e0c304b-2735-4232-805f-5396927f389e] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:02:53.976442 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ca6b4b6c-179c-4b37-96ef-42e2b9c2c896 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:02:53.977556 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ca6b4b6c-179c-4b37-96ef-42e2b9c2c896 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:02:53.978198 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ca6b4b6c-179c-4b37-96ef-42e2b9c2c896 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:02:53.979753 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ca6b4b6c-179c-4b37-96ef-42e2b9c2c896 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:02:53.980173 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ca6b4b6c-179c-4b37-96ef-42e2b9c2c896 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:02:53.980613 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ca6b4b6c-179c-4b37-96ef-42e2b9c2c896 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:02:54.220083 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-5087eb15-17df-40b1-94c8-2bf151b4b774 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5dbe3da6a4af181ef7302fe605fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3aa23aee3c8435c8f1f409019c5fed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:02:54.228628 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-5087eb15-17df-40b1-94c8-2bf151b4b774 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] 10.222.0.33 "GET /compute/v2.1/servers/5a95bf94-24e7-43a2-9818-d5bf1b0315f1" status: 200 len: 1391 microversion: 2.1 time: 0.839939 Oct 04 21:02:54.233458 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2625/5234] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:02:53 2022] GET /compute/v2.1/servers/5a95bf94-24e7-43a2-9818-d5bf1b0315f1 => generated 1391 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:02:54.367384 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=4 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:02:54.422663 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-9ea97469-9caa-450e-9e76-acddc0cb0bba tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:02:54.423831 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-9ea97469-9caa-450e-9e76-acddc0cb0bba tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] [instance: cc9ad5af-1587-4aa1-8323-a50c91bb1b84] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:02:54.434903 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9ea97469-9caa-450e-9e76-acddc0cb0bba tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:02:54.451843 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9ea97469-9caa-450e-9e76-acddc0cb0bba tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:02:54.451843 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9ea97469-9caa-450e-9e76-acddc0cb0bba tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:02:54.451843 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9ea97469-9caa-450e-9e76-acddc0cb0bba tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:02:54.451843 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9ea97469-9caa-450e-9e76-acddc0cb0bba tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:02:54.454012 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9ea97469-9caa-450e-9e76-acddc0cb0bba tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:02:54.898894 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-ca6b4b6c-179c-4b37-96ef-42e2b9c2c896 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3403486e6f4afd8d97f97612110eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be936dd2db2466990cafbfbfb3a15cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:02:54.914408 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ca6b4b6c-179c-4b37-96ef-42e2b9c2c896 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] 10.222.0.33 "GET /compute/v2.1/servers/0e0c304b-2735-4232-805f-5396927f389e" status: 200 len: 1300 microversion: 2.1 time: 0.957346 Oct 04 21:02:54.915777 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2610/5235] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:02:53 2022] GET /compute/v2.1/servers/0e0c304b-2735-4232-805f-5396927f389e => generated 1300 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:02:55.268863 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-36e8b07c-7145-4a1e-9b50-fde025ea8275 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:02:55.270015 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-36e8b07c-7145-4a1e-9b50-fde025ea8275 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] [instance: 5a95bf94-24e7-43a2-9818-d5bf1b0315f1] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:02:55.272185 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-9ea97469-9caa-450e-9e76-acddc0cb0bba tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:02:55.279326 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=14 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:02:55.283908 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-36e8b07c-7145-4a1e-9b50-fde025ea8275 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:02:55.284475 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-9ea97469-9caa-450e-9e76-acddc0cb0bba tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:02:55.284942 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-36e8b07c-7145-4a1e-9b50-fde025ea8275 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:02:55.285745 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-36e8b07c-7145-4a1e-9b50-fde025ea8275 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:02:55.286000 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-9ea97469-9caa-450e-9e76-acddc0cb0bba tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:02:55.288743 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-36e8b07c-7145-4a1e-9b50-fde025ea8275 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:02:55.289447 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-36e8b07c-7145-4a1e-9b50-fde025ea8275 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:02:55.290213 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-36e8b07c-7145-4a1e-9b50-fde025ea8275 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:02:55.299768 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-9ea97469-9caa-450e-9e76-acddc0cb0bba tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] 10.222.0.33 "GET /compute/v2.1/servers/cc9ad5af-1587-4aa1-8323-a50c91bb1b84" status: 200 len: 1723 microversion: 2.20 time: 0.881773 Oct 04 21:02:55.300385 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2626/5236] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 21:02:54 2022] GET /compute/v2.1/servers/cc9ad5af-1587-4aa1-8323-a50c91bb1b84 => generated 1723 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:02:55.925899 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-36e8b07c-7145-4a1e-9b50-fde025ea8275 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5dbe3da6a4af181ef7302fe605fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3aa23aee3c8435c8f1f409019c5fed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:02:55.938434 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-36e8b07c-7145-4a1e-9b50-fde025ea8275 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] 10.222.0.33 "GET /compute/v2.1/servers/5a95bf94-24e7-43a2-9818-d5bf1b0315f1" status: 200 len: 1391 microversion: 2.1 time: 0.681403 Oct 04 21:02:55.939749 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2611/5237] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:02:55 2022] GET /compute/v2.1/servers/5a95bf94-24e7-43a2-9818-d5bf1b0315f1 => generated 1391 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:02:55.941145 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-768d7307-57d1-4833-ac8f-d642b5934b4c tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:02:55.941808 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-768d7307-57d1-4833-ac8f-d642b5934b4c tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] [instance: 0e0c304b-2735-4232-805f-5396927f389e] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:02:55.961439 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-768d7307-57d1-4833-ac8f-d642b5934b4c tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:02:55.963348 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-768d7307-57d1-4833-ac8f-d642b5934b4c tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:02:55.963796 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-768d7307-57d1-4833-ac8f-d642b5934b4c tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:02:55.969346 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-768d7307-57d1-4833-ac8f-d642b5934b4c tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:02:55.971434 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-768d7307-57d1-4833-ac8f-d642b5934b4c tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:02:55.972121 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-768d7307-57d1-4833-ac8f-d642b5934b4c tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:02:56.205294 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-b6016614-782f-49cd-85bd-2b822cf8ec7e req-2fb84409-157d-4c0b-947a-e14b77a181c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e0c304b-2735-4232-805f-5396927f389e", "tag": "40bcdca2-30e3-49b0-8678-4508c44b8787"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:02:56.228615 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-b6016614-782f-49cd-85bd-2b822cf8ec7e req-2fb84409-157d-4c0b-947a-e14b77a181c1 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:02:56.229636 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-b6016614-782f-49cd-85bd-2b822cf8ec7e req-2fb84409-157d-4c0b-947a-e14b77a181c1 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:02:56.230841 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-b6016614-782f-49cd-85bd-2b822cf8ec7e req-2fb84409-157d-4c0b-947a-e14b77a181c1 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:02:56.281545 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-b6016614-782f-49cd-85bd-2b822cf8ec7e req-2fb84409-157d-4c0b-947a-e14b77a181c1 service nova] Creating event network-changed:40bcdca2-30e3-49b0-8678-4508c44b8787 for instance 0e0c304b-2735-4232-805f-5396927f389e on n-h2-854823-8 Oct 04 21:02:56.292733 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-b6016614-782f-49cd-85bd-2b822cf8ec7e req-2fb84409-157d-4c0b-947a-e14b77a181c1 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100158 Oct 04 21:02:56.294493 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2612/5238] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:02:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:02:56.333961 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-bdc767e2-14bb-417b-9941-70d6fa503c8c tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:02:56.335089 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-bdc767e2-14bb-417b-9941-70d6fa503c8c tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] [instance: cc9ad5af-1587-4aa1-8323-a50c91bb1b84] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:02:56.344360 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bdc767e2-14bb-417b-9941-70d6fa503c8c tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:02:56.345159 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bdc767e2-14bb-417b-9941-70d6fa503c8c tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:02:56.348270 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bdc767e2-14bb-417b-9941-70d6fa503c8c tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:02:56.358606 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bdc767e2-14bb-417b-9941-70d6fa503c8c tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:02:56.359493 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bdc767e2-14bb-417b-9941-70d6fa503c8c tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:02:56.361699 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bdc767e2-14bb-417b-9941-70d6fa503c8c tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:02:56.516243 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-768d7307-57d1-4833-ac8f-d642b5934b4c tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3403486e6f4afd8d97f97612110eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be936dd2db2466990cafbfbfb3a15cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:02:56.534264 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-768d7307-57d1-4833-ac8f-d642b5934b4c tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] 10.222.0.33 "GET /compute/v2.1/servers/0e0c304b-2735-4232-805f-5396927f389e" status: 200 len: 1300 microversion: 2.1 time: 0.597543 Oct 04 21:02:56.535214 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2627/5239] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:02:55 2022] GET /compute/v2.1/servers/0e0c304b-2735-4232-805f-5396927f389e => generated 1300 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:02:56.962977 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-163d1693-3db9-4830-9374-ec4f1bd2d4d1 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:02:56.964578 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-163d1693-3db9-4830-9374-ec4f1bd2d4d1 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] [instance: 5a95bf94-24e7-43a2-9818-d5bf1b0315f1] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:02:56.975453 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-163d1693-3db9-4830-9374-ec4f1bd2d4d1 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:02:56.983874 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-163d1693-3db9-4830-9374-ec4f1bd2d4d1 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:02:56.984630 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-163d1693-3db9-4830-9374-ec4f1bd2d4d1 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:02:56.985570 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-163d1693-3db9-4830-9374-ec4f1bd2d4d1 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:02:56.986198 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-163d1693-3db9-4830-9374-ec4f1bd2d4d1 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:02:56.986927 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-163d1693-3db9-4830-9374-ec4f1bd2d4d1 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:02:57.160004 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-bdc767e2-14bb-417b-9941-70d6fa503c8c tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:02:57.170378 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-bdc767e2-14bb-417b-9941-70d6fa503c8c tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:02:57.172432 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-bdc767e2-14bb-417b-9941-70d6fa503c8c tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:02:57.174027 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-bdc767e2-14bb-417b-9941-70d6fa503c8c tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] 10.222.0.33 "GET /compute/v2.1/servers/cc9ad5af-1587-4aa1-8323-a50c91bb1b84" status: 200 len: 1723 microversion: 2.20 time: 0.849607 Oct 04 21:02:57.194190 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2613/5240] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 21:02:56 2022] GET /compute/v2.1/servers/cc9ad5af-1587-4aa1-8323-a50c91bb1b84 => generated 1723 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:02:57.565336 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ff4129ef-800f-45c7-9217-0b7ecab4f3eb tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:02:57.566480 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ff4129ef-800f-45c7-9217-0b7ecab4f3eb tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] [instance: 0e0c304b-2735-4232-805f-5396927f389e] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:02:57.581203 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ff4129ef-800f-45c7-9217-0b7ecab4f3eb tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:02:57.584318 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ff4129ef-800f-45c7-9217-0b7ecab4f3eb tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:02:57.584997 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ff4129ef-800f-45c7-9217-0b7ecab4f3eb tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:02:57.586099 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ff4129ef-800f-45c7-9217-0b7ecab4f3eb tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:02:57.588819 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ff4129ef-800f-45c7-9217-0b7ecab4f3eb tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:02:57.589502 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ff4129ef-800f-45c7-9217-0b7ecab4f3eb tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:02:57.704584 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-163d1693-3db9-4830-9374-ec4f1bd2d4d1 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5dbe3da6a4af181ef7302fe605fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3aa23aee3c8435c8f1f409019c5fed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:02:57.761727 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-163d1693-3db9-4830-9374-ec4f1bd2d4d1 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] 10.222.0.33 "GET /compute/v2.1/servers/5a95bf94-24e7-43a2-9818-d5bf1b0315f1" status: 200 len: 1391 microversion: 2.1 time: 0.793905 Oct 04 21:02:57.766394 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2628/5241] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:02:56 2022] GET /compute/v2.1/servers/5a95bf94-24e7-43a2-9818-d5bf1b0315f1 => generated 1391 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:02:57.918871 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-ff4129ef-800f-45c7-9217-0b7ecab4f3eb tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3403486e6f4afd8d97f97612110eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be936dd2db2466990cafbfbfb3a15cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:02:57.932491 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ff4129ef-800f-45c7-9217-0b7ecab4f3eb tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] 10.222.0.33 "GET /compute/v2.1/servers/0e0c304b-2735-4232-805f-5396927f389e" status: 200 len: 1300 microversion: 2.1 time: 0.371722 Oct 04 21:02:57.935605 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2614/5242] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:02:57 2022] GET /compute/v2.1/servers/0e0c304b-2735-4232-805f-5396927f389e => generated 1300 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:02:58.204331 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-0ec0db6e-f388-4d2b-b824-74c51b453d3f tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:02:58.204940 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-0ec0db6e-f388-4d2b-b824-74c51b453d3f tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] [instance: cc9ad5af-1587-4aa1-8323-a50c91bb1b84] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:02:58.217378 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0ec0db6e-f388-4d2b-b824-74c51b453d3f tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:02:58.230229 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0ec0db6e-f388-4d2b-b824-74c51b453d3f tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:02:58.230730 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0ec0db6e-f388-4d2b-b824-74c51b453d3f tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:02:58.233769 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0ec0db6e-f388-4d2b-b824-74c51b453d3f tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:02:58.234296 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0ec0db6e-f388-4d2b-b824-74c51b453d3f tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:02:58.234771 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0ec0db6e-f388-4d2b-b824-74c51b453d3f tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:02:58.521413 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-0ec0db6e-f388-4d2b-b824-74c51b453d3f tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:02:58.534225 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-0ec0db6e-f388-4d2b-b824-74c51b453d3f tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:02:58.535717 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-0ec0db6e-f388-4d2b-b824-74c51b453d3f tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:02:58.536900 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-0ec0db6e-f388-4d2b-b824-74c51b453d3f tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] 10.222.0.33 "GET /compute/v2.1/servers/cc9ad5af-1587-4aa1-8323-a50c91bb1b84" status: 200 len: 1723 microversion: 2.20 time: 0.337990 Oct 04 21:02:58.537644 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2629/5243] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 21:02:58 2022] GET /compute/v2.1/servers/cc9ad5af-1587-4aa1-8323-a50c91bb1b84 => generated 1723 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:02:58.793787 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-53382530-11da-41cf-bc08-48dc9656f2d3 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:02:58.794461 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-53382530-11da-41cf-bc08-48dc9656f2d3 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] [instance: 5a95bf94-24e7-43a2-9818-d5bf1b0315f1] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:02:58.820492 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-53382530-11da-41cf-bc08-48dc9656f2d3 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:02:58.821021 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-53382530-11da-41cf-bc08-48dc9656f2d3 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:02:58.826748 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-53382530-11da-41cf-bc08-48dc9656f2d3 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:02:58.827770 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-53382530-11da-41cf-bc08-48dc9656f2d3 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:02:58.829729 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-53382530-11da-41cf-bc08-48dc9656f2d3 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:02:58.833904 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-53382530-11da-41cf-bc08-48dc9656f2d3 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:02:58.917313 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:02:58.962148 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-e0f26360-c87e-4d8d-afca-e374fccd9d3f tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:02:58.962914 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-e0f26360-c87e-4d8d-afca-e374fccd9d3f tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] [instance: 0e0c304b-2735-4232-805f-5396927f389e] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:02:58.974684 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e0f26360-c87e-4d8d-afca-e374fccd9d3f tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:02:58.987785 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e0f26360-c87e-4d8d-afca-e374fccd9d3f tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:02:58.992867 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e0f26360-c87e-4d8d-afca-e374fccd9d3f tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:02:58.993815 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e0f26360-c87e-4d8d-afca-e374fccd9d3f tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:02:58.996171 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e0f26360-c87e-4d8d-afca-e374fccd9d3f tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:02:58.998553 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e0f26360-c87e-4d8d-afca-e374fccd9d3f tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:02:59.217874 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-e0f26360-c87e-4d8d-afca-e374fccd9d3f tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3403486e6f4afd8d97f97612110eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be936dd2db2466990cafbfbfb3a15cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:02:59.234060 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-e0f26360-c87e-4d8d-afca-e374fccd9d3f tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] 10.222.0.33 "GET /compute/v2.1/servers/0e0c304b-2735-4232-805f-5396927f389e" status: 200 len: 1300 microversion: 2.1 time: 0.276740 Oct 04 21:02:59.238010 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2630/5244] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:02:58 2022] GET /compute/v2.1/servers/0e0c304b-2735-4232-805f-5396927f389e => generated 1300 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:02:59.564224 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-09f758a4-a154-45e4-aab6-328245b4795e tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:02:59.565297 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-09f758a4-a154-45e4-aab6-328245b4795e tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] [instance: cc9ad5af-1587-4aa1-8323-a50c91bb1b84] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:02:59.575803 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-09f758a4-a154-45e4-aab6-328245b4795e tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:02:59.577151 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-09f758a4-a154-45e4-aab6-328245b4795e tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:02:59.577591 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-09f758a4-a154-45e4-aab6-328245b4795e tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:02:59.581987 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-09f758a4-a154-45e4-aab6-328245b4795e tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:02:59.582935 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-09f758a4-a154-45e4-aab6-328245b4795e tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:02:59.583380 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-09f758a4-a154-45e4-aab6-328245b4795e tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:02:59.641616 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=100 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:02:59.936468 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-53382530-11da-41cf-bc08-48dc9656f2d3 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5dbe3da6a4af181ef7302fe605fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3aa23aee3c8435c8f1f409019c5fed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:02:59.962870 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-53382530-11da-41cf-bc08-48dc9656f2d3 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] 10.222.0.33 "GET /compute/v2.1/servers/5a95bf94-24e7-43a2-9818-d5bf1b0315f1" status: 200 len: 1391 microversion: 2.1 time: 1.173175 Oct 04 21:02:59.963839 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2615/5245] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:02:58 2022] GET /compute/v2.1/servers/5a95bf94-24e7-43a2-9818-d5bf1b0315f1 => generated 1391 bytes in 1176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:03:00.151629 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-09f758a4-a154-45e4-aab6-328245b4795e tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:03:00.160227 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-09f758a4-a154-45e4-aab6-328245b4795e tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:03:00.172834 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-09f758a4-a154-45e4-aab6-328245b4795e tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:03:00.179463 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-09f758a4-a154-45e4-aab6-328245b4795e tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] 10.222.0.33 "GET /compute/v2.1/servers/cc9ad5af-1587-4aa1-8323-a50c91bb1b84" status: 200 len: 1723 microversion: 2.20 time: 0.620354 Oct 04 21:03:00.180286 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2631/5246] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 21:02:59 2022] GET /compute/v2.1/servers/cc9ad5af-1587-4aa1-8323-a50c91bb1b84 => generated 1723 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:03:00.268278 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1adae89d-4c9a-4dd0-9fc0-f440842ea066 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:03:00.269243 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-1adae89d-4c9a-4dd0-9fc0-f440842ea066 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] [instance: 0e0c304b-2735-4232-805f-5396927f389e] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:03:00.300997 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1adae89d-4c9a-4dd0-9fc0-f440842ea066 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:00.306117 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1adae89d-4c9a-4dd0-9fc0-f440842ea066 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:00.308143 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1adae89d-4c9a-4dd0-9fc0-f440842ea066 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:00.309336 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1adae89d-4c9a-4dd0-9fc0-f440842ea066 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:00.311743 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1adae89d-4c9a-4dd0-9fc0-f440842ea066 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:00.313550 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1adae89d-4c9a-4dd0-9fc0-f440842ea066 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:00.549482 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-1adae89d-4c9a-4dd0-9fc0-f440842ea066 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3403486e6f4afd8d97f97612110eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be936dd2db2466990cafbfbfb3a15cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:03:00.566440 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-1adae89d-4c9a-4dd0-9fc0-f440842ea066 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] 10.222.0.33 "GET /compute/v2.1/servers/0e0c304b-2735-4232-805f-5396927f389e" status: 200 len: 1300 microversion: 2.1 time: 0.302206 Oct 04 21:03:00.567172 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2616/5247] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:03:00 2022] GET /compute/v2.1/servers/0e0c304b-2735-4232-805f-5396927f389e => generated 1300 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:03:00.610917 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-2be67a62-680d-41ee-a858-8aefcade9246 req-97edf289-05ee-49fa-b3a8-f176f2724538 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a95bf94-24e7-43a2-9818-d5bf1b0315f1", "name": "network-vif-plugged", "status": "completed", "tag": "99e654db-1794-4804-bb52-dc567c83649d"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:03:00.629156 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-2be67a62-680d-41ee-a858-8aefcade9246 req-97edf289-05ee-49fa-b3a8-f176f2724538 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:00.630601 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-2be67a62-680d-41ee-a858-8aefcade9246 req-97edf289-05ee-49fa-b3a8-f176f2724538 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:00.632047 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-2be67a62-680d-41ee-a858-8aefcade9246 req-97edf289-05ee-49fa-b3a8-f176f2724538 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:00.664607 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-2be67a62-680d-41ee-a858-8aefcade9246 req-97edf289-05ee-49fa-b3a8-f176f2724538 service nova] Creating event network-vif-plugged:99e654db-1794-4804-bb52-dc567c83649d for instance 5a95bf94-24e7-43a2-9818-d5bf1b0315f1 on n-h2-854823-8 Oct 04 21:03:00.681079 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-2be67a62-680d-41ee-a858-8aefcade9246 req-97edf289-05ee-49fa-b3a8-f176f2724538 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073838 Oct 04 21:03:00.685821 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2632/5248] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:03:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:03:00.989702 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0e5bc662-bbde-42da-a407-2aaee9216abc tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:03:00.990517 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-0e5bc662-bbde-42da-a407-2aaee9216abc tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] [instance: 5a95bf94-24e7-43a2-9818-d5bf1b0315f1] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:03:01.001423 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0e5bc662-bbde-42da-a407-2aaee9216abc tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:01.005018 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0e5bc662-bbde-42da-a407-2aaee9216abc tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:01.005574 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0e5bc662-bbde-42da-a407-2aaee9216abc tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:01.007776 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0e5bc662-bbde-42da-a407-2aaee9216abc tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:01.008266 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0e5bc662-bbde-42da-a407-2aaee9216abc tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:01.008703 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0e5bc662-bbde-42da-a407-2aaee9216abc tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:01.214790 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-0e5bc662-bbde-42da-a407-2aaee9216abc tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5dbe3da6a4af181ef7302fe605fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3aa23aee3c8435c8f1f409019c5fed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:03:01.217160 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-a74e60e1-a49c-4c7a-9009-e3fd232eedd7 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:03:01.218217 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-a74e60e1-a49c-4c7a-9009-e3fd232eedd7 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] [instance: cc9ad5af-1587-4aa1-8323-a50c91bb1b84] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:03:01.230674 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-0e5bc662-bbde-42da-a407-2aaee9216abc tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] 10.222.0.33 "GET /compute/v2.1/servers/5a95bf94-24e7-43a2-9818-d5bf1b0315f1" status: 200 len: 1391 microversion: 2.1 time: 0.244938 Oct 04 21:03:01.231661 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2617/5249] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:03:00 2022] GET /compute/v2.1/servers/5a95bf94-24e7-43a2-9818-d5bf1b0315f1 => generated 1391 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:03:01.234776 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a74e60e1-a49c-4c7a-9009-e3fd232eedd7 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:01.235876 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a74e60e1-a49c-4c7a-9009-e3fd232eedd7 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:01.236394 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a74e60e1-a49c-4c7a-9009-e3fd232eedd7 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:01.237223 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a74e60e1-a49c-4c7a-9009-e3fd232eedd7 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:01.238860 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a74e60e1-a49c-4c7a-9009-e3fd232eedd7 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:01.239400 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a74e60e1-a49c-4c7a-9009-e3fd232eedd7 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:01.481769 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-a74e60e1-a49c-4c7a-9009-e3fd232eedd7 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:03:01.495515 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-a74e60e1-a49c-4c7a-9009-e3fd232eedd7 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:03:01.497597 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-a74e60e1-a49c-4c7a-9009-e3fd232eedd7 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:03:01.507209 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-a74e60e1-a49c-4c7a-9009-e3fd232eedd7 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] 10.222.0.33 "GET /compute/v2.1/servers/cc9ad5af-1587-4aa1-8323-a50c91bb1b84" status: 200 len: 1723 microversion: 2.20 time: 0.295067 Oct 04 21:03:01.508420 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2633/5250] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 21:03:01 2022] GET /compute/v2.1/servers/cc9ad5af-1587-4aa1-8323-a50c91bb1b84 => generated 1723 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:03:01.593813 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-541e03cd-ec6c-4457-842c-cb3c90e6f40f tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:03:01.594588 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-541e03cd-ec6c-4457-842c-cb3c90e6f40f tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] [instance: 0e0c304b-2735-4232-805f-5396927f389e] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:03:01.605058 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-541e03cd-ec6c-4457-842c-cb3c90e6f40f tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:01.605805 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-541e03cd-ec6c-4457-842c-cb3c90e6f40f tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:01.608842 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-541e03cd-ec6c-4457-842c-cb3c90e6f40f tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:01.610868 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-541e03cd-ec6c-4457-842c-cb3c90e6f40f tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:01.611514 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-541e03cd-ec6c-4457-842c-cb3c90e6f40f tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:01.612582 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-541e03cd-ec6c-4457-842c-cb3c90e6f40f tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:01.894975 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-541e03cd-ec6c-4457-842c-cb3c90e6f40f tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3403486e6f4afd8d97f97612110eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be936dd2db2466990cafbfbfb3a15cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:03:01.903625 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-541e03cd-ec6c-4457-842c-cb3c90e6f40f tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] 10.222.0.33 "GET /compute/v2.1/servers/0e0c304b-2735-4232-805f-5396927f389e" status: 200 len: 1300 microversion: 2.1 time: 0.314586 Oct 04 21:03:01.918562 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2618/5251] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:03:01 2022] GET /compute/v2.1/servers/0e0c304b-2735-4232-805f-5396927f389e => generated 1300 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:03:02.259563 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-e4fbc456-b2e0-4909-b4c7-1b5bda79948a tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:03:02.260198 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-e4fbc456-b2e0-4909-b4c7-1b5bda79948a tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] [instance: 5a95bf94-24e7-43a2-9818-d5bf1b0315f1] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:03:02.285268 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e4fbc456-b2e0-4909-b4c7-1b5bda79948a tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:02.285787 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e4fbc456-b2e0-4909-b4c7-1b5bda79948a tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:02.286581 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e4fbc456-b2e0-4909-b4c7-1b5bda79948a tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:02.287323 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e4fbc456-b2e0-4909-b4c7-1b5bda79948a tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:02.287781 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e4fbc456-b2e0-4909-b4c7-1b5bda79948a tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:02.290201 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e4fbc456-b2e0-4909-b4c7-1b5bda79948a tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:02.536822 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2d99a95b-ae7c-45a2-8d28-40429627e978 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:03:02.538077 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-2d99a95b-ae7c-45a2-8d28-40429627e978 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] [instance: cc9ad5af-1587-4aa1-8323-a50c91bb1b84] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:03:02.552118 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2d99a95b-ae7c-45a2-8d28-40429627e978 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:02.552948 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2d99a95b-ae7c-45a2-8d28-40429627e978 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:02.553596 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2d99a95b-ae7c-45a2-8d28-40429627e978 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:02.556269 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2d99a95b-ae7c-45a2-8d28-40429627e978 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:02.556933 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2d99a95b-ae7c-45a2-8d28-40429627e978 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:02.558747 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2d99a95b-ae7c-45a2-8d28-40429627e978 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:03.554249 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-e4fbc456-b2e0-4909-b4c7-1b5bda79948a tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5dbe3da6a4af181ef7302fe605fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3aa23aee3c8435c8f1f409019c5fed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:03:03.578734 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-e4fbc456-b2e0-4909-b4c7-1b5bda79948a tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] 10.222.0.33 "GET /compute/v2.1/servers/5a95bf94-24e7-43a2-9818-d5bf1b0315f1" status: 200 len: 1563 microversion: 2.1 time: 1.324962 Oct 04 21:03:03.579528 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2634/5252] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:03:02 2022] GET /compute/v2.1/servers/5a95bf94-24e7-43a2-9818-d5bf1b0315f1 => generated 1563 bytes in 1327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:03:03.600798 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-82561336-4ac2-4c25-82e7-5f93c16e044d tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:03:03.604261 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-82561336-4ac2-4c25-82e7-5f93c16e044d tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] [instance: 0e0c304b-2735-4232-805f-5396927f389e] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:03:03.614674 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_api:SELECT=47 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:03:03.644867 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-82561336-4ac2-4c25-82e7-5f93c16e044d tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:03.648271 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-82561336-4ac2-4c25-82e7-5f93c16e044d tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:03.650638 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-82561336-4ac2-4c25-82e7-5f93c16e044d tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:03.659014 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-82561336-4ac2-4c25-82e7-5f93c16e044d tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:03.659717 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-82561336-4ac2-4c25-82e7-5f93c16e044d tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:03.661234 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-82561336-4ac2-4c25-82e7-5f93c16e044d tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:03.888909 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-82561336-4ac2-4c25-82e7-5f93c16e044d tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3403486e6f4afd8d97f97612110eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be936dd2db2466990cafbfbfb3a15cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:03:03.896553 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-2d99a95b-ae7c-45a2-8d28-40429627e978 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:03:03.917871 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-82561336-4ac2-4c25-82e7-5f93c16e044d tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] 10.222.0.33 "GET /compute/v2.1/servers/0e0c304b-2735-4232-805f-5396927f389e" status: 200 len: 1300 microversion: 2.1 time: 0.337082 Oct 04 21:03:03.931082 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2635/5253] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:03:03 2022] GET /compute/v2.1/servers/0e0c304b-2735-4232-805f-5396927f389e => generated 1300 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:03:03.932946 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-2d99a95b-ae7c-45a2-8d28-40429627e978 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:03:03.940925 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-2d99a95b-ae7c-45a2-8d28-40429627e978 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:03:03.949961 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-2d99a95b-ae7c-45a2-8d28-40429627e978 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] 10.222.0.33 "GET /compute/v2.1/servers/cc9ad5af-1587-4aa1-8323-a50c91bb1b84" status: 200 len: 1723 microversion: 2.20 time: 1.418668 Oct 04 21:03:03.950637 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2619/5254] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 21:03:02 2022] GET /compute/v2.1/servers/cc9ad5af-1587-4aa1-8323-a50c91bb1b84 => generated 1723 bytes in 1420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:03:03.965791 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-6ae56fa0-fef2-4bd8-954a-5f990c963b94 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:03:03.972598 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-6ae56fa0-fef2-4bd8-954a-5f990c963b94 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] [instance: 5a95bf94-24e7-43a2-9818-d5bf1b0315f1] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:03:03.981764 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6ae56fa0-fef2-4bd8-954a-5f990c963b94 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:03.984137 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6ae56fa0-fef2-4bd8-954a-5f990c963b94 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:03.984895 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6ae56fa0-fef2-4bd8-954a-5f990c963b94 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:03.986580 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6ae56fa0-fef2-4bd8-954a-5f990c963b94 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:03.987209 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6ae56fa0-fef2-4bd8-954a-5f990c963b94 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:03.988302 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6ae56fa0-fef2-4bd8-954a-5f990c963b94 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:04.229957 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-0397b918-2a3c-490f-a34f-7663949f9781 req-f3d5fcd0-2a58-46b3-b900-5c7056b76f71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e0c304b-2735-4232-805f-5396927f389e", "name": "network-vif-plugged", "status": "completed", "tag": "40bcdca2-30e3-49b0-8678-4508c44b8787"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:03:04.250779 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=6 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:03:04.259555 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-0397b918-2a3c-490f-a34f-7663949f9781 req-f3d5fcd0-2a58-46b3-b900-5c7056b76f71 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:04.264256 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-0397b918-2a3c-490f-a34f-7663949f9781 req-f3d5fcd0-2a58-46b3-b900-5c7056b76f71 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:04.267512 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-0397b918-2a3c-490f-a34f-7663949f9781 req-f3d5fcd0-2a58-46b3-b900-5c7056b76f71 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:04.291069 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-6ae56fa0-fef2-4bd8-954a-5f990c963b94 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5dbe3da6a4af181ef7302fe605fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3aa23aee3c8435c8f1f409019c5fed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:03:04.303654 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-0397b918-2a3c-490f-a34f-7663949f9781 req-f3d5fcd0-2a58-46b3-b900-5c7056b76f71 service nova] Creating event network-vif-plugged:40bcdca2-30e3-49b0-8678-4508c44b8787 for instance 0e0c304b-2735-4232-805f-5396927f389e on n-h2-854823-8 Oct 04 21:03:04.305985 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-6ae56fa0-fef2-4bd8-954a-5f990c963b94 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] 10.222.0.33 "GET /compute/v2.1/servers/5a95bf94-24e7-43a2-9818-d5bf1b0315f1" status: 200 len: 1563 microversion: 2.1 time: 0.371450 Oct 04 21:03:04.307869 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2636/5255] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:03:03 2022] GET /compute/v2.1/servers/5a95bf94-24e7-43a2-9818-d5bf1b0315f1 => generated 1563 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:03:04.334803 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-0397b918-2a3c-490f-a34f-7663949f9781 req-f3d5fcd0-2a58-46b3-b900-5c7056b76f71 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106666 Oct 04 21:03:04.336152 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2620/5256] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:03:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:03:05.015141 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c34e080c-7b59-44d0-9b05-31df66a2f982 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:03:05.018737 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-def012a8-797e-489a-b910-1a6076e30901 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:03:05.020093 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-def012a8-797e-489a-b910-1a6076e30901 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] [instance: 0e0c304b-2735-4232-805f-5396927f389e] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:03:05.020335 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c34e080c-7b59-44d0-9b05-31df66a2f982 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] [instance: cc9ad5af-1587-4aa1-8323-a50c91bb1b84] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:03:05.053402 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c34e080c-7b59-44d0-9b05-31df66a2f982 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:05.059617 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-def012a8-797e-489a-b910-1a6076e30901 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:05.063989 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-def012a8-797e-489a-b910-1a6076e30901 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:05.064307 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c34e080c-7b59-44d0-9b05-31df66a2f982 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:05.065026 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c34e080c-7b59-44d0-9b05-31df66a2f982 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:05.065712 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-def012a8-797e-489a-b910-1a6076e30901 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:05.067280 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c34e080c-7b59-44d0-9b05-31df66a2f982 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:05.068537 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-def012a8-797e-489a-b910-1a6076e30901 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:05.069562 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c34e080c-7b59-44d0-9b05-31df66a2f982 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:05.070919 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-def012a8-797e-489a-b910-1a6076e30901 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:05.071931 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c34e080c-7b59-44d0-9b05-31df66a2f982 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:05.074006 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-def012a8-797e-489a-b910-1a6076e30901 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:05.634444 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-def012a8-797e-489a-b910-1a6076e30901 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3403486e6f4afd8d97f97612110eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be936dd2db2466990cafbfbfb3a15cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:03:05.644165 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-def012a8-797e-489a-b910-1a6076e30901 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] 10.222.0.33 "GET /compute/v2.1/servers/0e0c304b-2735-4232-805f-5396927f389e" status: 200 len: 1300 microversion: 2.1 time: 0.690870 Oct 04 21:03:05.647491 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2637/5257] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:03:04 2022] GET /compute/v2.1/servers/0e0c304b-2735-4232-805f-5396927f389e => generated 1300 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:03:05.737610 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c34e080c-7b59-44d0-9b05-31df66a2f982 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:03:05.750639 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c34e080c-7b59-44d0-9b05-31df66a2f982 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:03:05.752423 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c34e080c-7b59-44d0-9b05-31df66a2f982 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:03:05.756060 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c34e080c-7b59-44d0-9b05-31df66a2f982 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] 10.222.0.33 "GET /compute/v2.1/servers/cc9ad5af-1587-4aa1-8323-a50c91bb1b84" status: 200 len: 1723 microversion: 2.20 time: 0.779410 Oct 04 21:03:05.760058 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2621/5258] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 21:03:04 2022] GET /compute/v2.1/servers/cc9ad5af-1587-4aa1-8323-a50c91bb1b84 => generated 1723 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:03:06.674640 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-42abb664-7f11-4704-90fd-5bb1f7d35b26 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:03:06.677190 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-42abb664-7f11-4704-90fd-5bb1f7d35b26 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] [instance: 0e0c304b-2735-4232-805f-5396927f389e] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:03:06.704848 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-42abb664-7f11-4704-90fd-5bb1f7d35b26 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:06.705563 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-42abb664-7f11-4704-90fd-5bb1f7d35b26 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:06.706815 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-42abb664-7f11-4704-90fd-5bb1f7d35b26 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:06.708582 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-42abb664-7f11-4704-90fd-5bb1f7d35b26 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:06.710420 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-42abb664-7f11-4704-90fd-5bb1f7d35b26 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:06.711064 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-42abb664-7f11-4704-90fd-5bb1f7d35b26 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:06.790033 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-cf5094c1-296c-4c08-8141-5e77499df91b tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:03:06.790981 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-cf5094c1-296c-4c08-8141-5e77499df91b tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] [instance: cc9ad5af-1587-4aa1-8323-a50c91bb1b84] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:03:06.804263 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cf5094c1-296c-4c08-8141-5e77499df91b tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:06.804761 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cf5094c1-296c-4c08-8141-5e77499df91b tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:06.805193 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cf5094c1-296c-4c08-8141-5e77499df91b tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:06.809186 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cf5094c1-296c-4c08-8141-5e77499df91b tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:06.809982 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cf5094c1-296c-4c08-8141-5e77499df91b tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:06.811892 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cf5094c1-296c-4c08-8141-5e77499df91b tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:06.997148 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-42abb664-7f11-4704-90fd-5bb1f7d35b26 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3403486e6f4afd8d97f97612110eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be936dd2db2466990cafbfbfb3a15cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:03:07.016027 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-42abb664-7f11-4704-90fd-5bb1f7d35b26 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] 10.222.0.33 "GET /compute/v2.1/servers/0e0c304b-2735-4232-805f-5396927f389e" status: 200 len: 1473 microversion: 2.1 time: 0.346194 Oct 04 21:03:07.020913 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2638/5259] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:03:06 2022] GET /compute/v2.1/servers/0e0c304b-2735-4232-805f-5396927f389e => generated 1473 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:03:07.050470 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-5f786aa8-044e-4cac-9779-b24e09309a96 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:03:07.051335 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-5f786aa8-044e-4cac-9779-b24e09309a96 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] [instance: 0e0c304b-2735-4232-805f-5396927f389e] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:03:07.062971 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5f786aa8-044e-4cac-9779-b24e09309a96 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:07.064252 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5f786aa8-044e-4cac-9779-b24e09309a96 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:07.066846 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5f786aa8-044e-4cac-9779-b24e09309a96 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:07.067679 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5f786aa8-044e-4cac-9779-b24e09309a96 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:07.068335 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5f786aa8-044e-4cac-9779-b24e09309a96 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:07.068846 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5f786aa8-044e-4cac-9779-b24e09309a96 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:07.372929 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-5f786aa8-044e-4cac-9779-b24e09309a96 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3403486e6f4afd8d97f97612110eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be936dd2db2466990cafbfbfb3a15cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:03:07.386913 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-5f786aa8-044e-4cac-9779-b24e09309a96 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] 10.222.0.33 "GET /compute/v2.1/servers/0e0c304b-2735-4232-805f-5396927f389e" status: 200 len: 1473 microversion: 2.1 time: 0.340709 Oct 04 21:03:07.387804 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2639/5260] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:03:07 2022] GET /compute/v2.1/servers/0e0c304b-2735-4232-805f-5396927f389e => generated 1473 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:03:07.411350 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-5af4fbf7-7bad-4fa6-b35e-2c13b92a3816 tempest-TestSecurityGroupsBasicOps-953752114 tempest-TestSecurityGroupsBasicOps-953752114-project-admin] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:03:07.412170 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-5af4fbf7-7bad-4fa6-b35e-2c13b92a3816 tempest-TestSecurityGroupsBasicOps-953752114 tempest-TestSecurityGroupsBasicOps-953752114-project-admin] [instance: 0e0c304b-2735-4232-805f-5396927f389e] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:03:07.418990 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5af4fbf7-7bad-4fa6-b35e-2c13b92a3816 tempest-TestSecurityGroupsBasicOps-953752114 tempest-TestSecurityGroupsBasicOps-953752114-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:07.419781 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5af4fbf7-7bad-4fa6-b35e-2c13b92a3816 tempest-TestSecurityGroupsBasicOps-953752114 tempest-TestSecurityGroupsBasicOps-953752114-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:07.420419 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5af4fbf7-7bad-4fa6-b35e-2c13b92a3816 tempest-TestSecurityGroupsBasicOps-953752114 tempest-TestSecurityGroupsBasicOps-953752114-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:07.421412 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5af4fbf7-7bad-4fa6-b35e-2c13b92a3816 tempest-TestSecurityGroupsBasicOps-953752114 tempest-TestSecurityGroupsBasicOps-953752114-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:07.422086 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5af4fbf7-7bad-4fa6-b35e-2c13b92a3816 tempest-TestSecurityGroupsBasicOps-953752114 tempest-TestSecurityGroupsBasicOps-953752114-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:07.422720 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5af4fbf7-7bad-4fa6-b35e-2c13b92a3816 tempest-TestSecurityGroupsBasicOps-953752114 tempest-TestSecurityGroupsBasicOps-953752114-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:07.436868 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-cf5094c1-296c-4c08-8141-5e77499df91b tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:03:07.448018 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-cf5094c1-296c-4c08-8141-5e77499df91b tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:03:07.450267 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-cf5094c1-296c-4c08-8141-5e77499df91b tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:03:07.456755 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-cf5094c1-296c-4c08-8141-5e77499df91b tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] 10.222.0.33 "GET /compute/v2.1/servers/cc9ad5af-1587-4aa1-8323-a50c91bb1b84" status: 200 len: 1723 microversion: 2.20 time: 0.670516 Oct 04 21:03:07.458974 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2622/5261] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 21:03:06 2022] GET /compute/v2.1/servers/cc9ad5af-1587-4aa1-8323-a50c91bb1b84 => generated 1723 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:03:07.662823 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-5af4fbf7-7bad-4fa6-b35e-2c13b92a3816 tempest-TestSecurityGroupsBasicOps-953752114 tempest-TestSecurityGroupsBasicOps-953752114-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/0e0c304b-2735-4232-805f-5396927f389e" status: 200 len: 1624 microversion: 2.1 time: 0.255264 Oct 04 21:03:07.663739 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2640/5262] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:03:07 2022] GET /compute/v2.1/servers/0e0c304b-2735-4232-805f-5396927f389e => generated 1624 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:03:07.692965 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-4ec9d6b2-1aee-40ae-85ae-414044c8ae65 tempest-TestSecurityGroupsBasicOps-953752114 tempest-TestSecurityGroupsBasicOps-953752114-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:03:07.693916 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-4ec9d6b2-1aee-40ae-85ae-414044c8ae65 tempest-TestSecurityGroupsBasicOps-953752114 tempest-TestSecurityGroupsBasicOps-953752114-project-admin] [instance: 61bb9cf5-6da5-4074-9bb8-ffd1269ea50f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:03:07.702957 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4ec9d6b2-1aee-40ae-85ae-414044c8ae65 tempest-TestSecurityGroupsBasicOps-953752114 tempest-TestSecurityGroupsBasicOps-953752114-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:07.703807 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4ec9d6b2-1aee-40ae-85ae-414044c8ae65 tempest-TestSecurityGroupsBasicOps-953752114 tempest-TestSecurityGroupsBasicOps-953752114-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:07.704641 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4ec9d6b2-1aee-40ae-85ae-414044c8ae65 tempest-TestSecurityGroupsBasicOps-953752114 tempest-TestSecurityGroupsBasicOps-953752114-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:07.705583 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4ec9d6b2-1aee-40ae-85ae-414044c8ae65 tempest-TestSecurityGroupsBasicOps-953752114 tempest-TestSecurityGroupsBasicOps-953752114-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:07.706270 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4ec9d6b2-1aee-40ae-85ae-414044c8ae65 tempest-TestSecurityGroupsBasicOps-953752114 tempest-TestSecurityGroupsBasicOps-953752114-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:07.707408 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4ec9d6b2-1aee-40ae-85ae-414044c8ae65 tempest-TestSecurityGroupsBasicOps-953752114 tempest-TestSecurityGroupsBasicOps-953752114-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:08.167636 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-4ec9d6b2-1aee-40ae-85ae-414044c8ae65 tempest-TestSecurityGroupsBasicOps-953752114 tempest-TestSecurityGroupsBasicOps-953752114-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/61bb9cf5-6da5-4074-9bb8-ffd1269ea50f" status: 200 len: 1913 microversion: 2.1 time: 0.482348 Oct 04 21:03:08.168873 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2623/5263] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:03:07 2022] GET /compute/v2.1/servers/61bb9cf5-6da5-4074-9bb8-ffd1269ea50f => generated 1913 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:03:08.489641 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-0ef489e3-e972-4c71-9832-dbc374db6045 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:03:08.491251 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-0ef489e3-e972-4c71-9832-dbc374db6045 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] [instance: cc9ad5af-1587-4aa1-8323-a50c91bb1b84] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:03:08.505019 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0ef489e3-e972-4c71-9832-dbc374db6045 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:08.506186 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0ef489e3-e972-4c71-9832-dbc374db6045 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:08.507005 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0ef489e3-e972-4c71-9832-dbc374db6045 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:08.508024 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0ef489e3-e972-4c71-9832-dbc374db6045 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:08.509191 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0ef489e3-e972-4c71-9832-dbc374db6045 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:08.510063 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0ef489e3-e972-4c71-9832-dbc374db6045 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:08.839112 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b14390c3-c35d-48e3-bc98-955d5085f89d tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:03:08.842777 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b14390c3-c35d-48e3-bc98-955d5085f89d tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] [instance: 0e0c304b-2735-4232-805f-5396927f389e] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:03:08.856507 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b14390c3-c35d-48e3-bc98-955d5085f89d tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:08.859251 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b14390c3-c35d-48e3-bc98-955d5085f89d tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:08.860386 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b14390c3-c35d-48e3-bc98-955d5085f89d tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:08.861671 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b14390c3-c35d-48e3-bc98-955d5085f89d tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:08.865572 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b14390c3-c35d-48e3-bc98-955d5085f89d tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:08.866820 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b14390c3-c35d-48e3-bc98-955d5085f89d tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:08.925608 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b14390c3-c35d-48e3-bc98-955d5085f89d tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] [instance: 0e0c304b-2735-4232-805f-5396927f389e] Going to try to terminate instance {{(pid=128801) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:03:08.947711 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-0ef489e3-e972-4c71-9832-dbc374db6045 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:03:08.968468 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-0ef489e3-e972-4c71-9832-dbc374db6045 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:03:08.969961 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-0ef489e3-e972-4c71-9832-dbc374db6045 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:03:08.971235 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-0ef489e3-e972-4c71-9832-dbc374db6045 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] 10.222.0.33 "GET /compute/v2.1/servers/cc9ad5af-1587-4aa1-8323-a50c91bb1b84" status: 200 len: 1744 microversion: 2.20 time: 0.486349 Oct 04 21:03:08.972004 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2641/5264] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 21:03:08 2022] GET /compute/v2.1/servers/cc9ad5af-1587-4aa1-8323-a50c91bb1b84 => generated 1744 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:03:09.155146 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b14390c3-c35d-48e3-bc98-955d5085f89d tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] 10.222.0.33 "DELETE /compute/v2.1/servers/0e0c304b-2735-4232-805f-5396927f389e" status: 204 len: 0 microversion: 2.1 time: 0.323200 Oct 04 21:03:09.156216 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2624/5265] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 21:03:08 2022] DELETE /compute/v2.1/servers/0e0c304b-2735-4232-805f-5396927f389e => generated 0 bytes in 327 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:03:09.166361 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-607737e9-b6cb-4350-8186-eea146f068a3 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:03:09.167157 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-607737e9-b6cb-4350-8186-eea146f068a3 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] [instance: 0e0c304b-2735-4232-805f-5396927f389e] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:03:09.182604 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-607737e9-b6cb-4350-8186-eea146f068a3 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:09.184593 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-607737e9-b6cb-4350-8186-eea146f068a3 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:09.191304 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-607737e9-b6cb-4350-8186-eea146f068a3 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:09.192245 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-607737e9-b6cb-4350-8186-eea146f068a3 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:09.192963 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-607737e9-b6cb-4350-8186-eea146f068a3 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:09.194710 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-607737e9-b6cb-4350-8186-eea146f068a3 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:09.790940 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-607737e9-b6cb-4350-8186-eea146f068a3 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3403486e6f4afd8d97f97612110eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be936dd2db2466990cafbfbfb3a15cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:03:09.805949 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-607737e9-b6cb-4350-8186-eea146f068a3 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] 10.222.0.33 "GET /compute/v2.1/servers/0e0c304b-2735-4232-805f-5396927f389e" status: 200 len: 1479 microversion: 2.1 time: 0.641398 Oct 04 21:03:09.806984 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2642/5266] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:03:09 2022] GET /compute/v2.1/servers/0e0c304b-2735-4232-805f-5396927f389e => generated 1479 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:03:10.018943 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-03f2fb8a-5336-4743-a260-825d3ede1af8 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:03:10.019759 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-03f2fb8a-5336-4743-a260-825d3ede1af8 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] [instance: cc9ad5af-1587-4aa1-8323-a50c91bb1b84] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:03:10.033912 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-03f2fb8a-5336-4743-a260-825d3ede1af8 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:10.038332 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-03f2fb8a-5336-4743-a260-825d3ede1af8 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:10.039611 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-03f2fb8a-5336-4743-a260-825d3ede1af8 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:10.040695 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-03f2fb8a-5336-4743-a260-825d3ede1af8 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:10.041325 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-03f2fb8a-5336-4743-a260-825d3ede1af8 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:10.042037 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-03f2fb8a-5336-4743-a260-825d3ede1af8 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:10.829987 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-83d60158-58e6-4a76-905e-f36e1ebe4aed tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:03:10.831324 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-83d60158-58e6-4a76-905e-f36e1ebe4aed tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] [instance: 0e0c304b-2735-4232-805f-5396927f389e] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:03:10.856817 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-83d60158-58e6-4a76-905e-f36e1ebe4aed tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:10.859057 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-83d60158-58e6-4a76-905e-f36e1ebe4aed tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:10.864249 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-83d60158-58e6-4a76-905e-f36e1ebe4aed tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:10.865262 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-83d60158-58e6-4a76-905e-f36e1ebe4aed tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:10.867555 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-83d60158-58e6-4a76-905e-f36e1ebe4aed tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:10.868237 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-83d60158-58e6-4a76-905e-f36e1ebe4aed tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:11.561840 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-83d60158-58e6-4a76-905e-f36e1ebe4aed tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3403486e6f4afd8d97f97612110eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be936dd2db2466990cafbfbfb3a15cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:03:11.574749 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-83d60158-58e6-4a76-905e-f36e1ebe4aed tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] 10.222.0.33 "GET /compute/v2.1/servers/0e0c304b-2735-4232-805f-5396927f389e" status: 200 len: 1479 microversion: 2.1 time: 0.744857 Oct 04 21:03:11.575821 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2643/5267] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:03:10 2022] GET /compute/v2.1/servers/0e0c304b-2735-4232-805f-5396927f389e => generated 1479 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:03:11.706989 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-03f2fb8a-5336-4743-a260-825d3ede1af8 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:03:11.717050 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-03f2fb8a-5336-4743-a260-825d3ede1af8 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:03:11.727858 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-03f2fb8a-5336-4743-a260-825d3ede1af8 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:03:11.738112 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-03f2fb8a-5336-4743-a260-825d3ede1af8 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] 10.222.0.33 "GET /compute/v2.1/servers/cc9ad5af-1587-4aa1-8323-a50c91bb1b84" status: 200 len: 1739 microversion: 2.20 time: 1.726291 Oct 04 21:03:11.766616 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2625/5268] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 21:03:10 2022] GET /compute/v2.1/servers/cc9ad5af-1587-4aa1-8323-a50c91bb1b84 => generated 1739 bytes in 1760 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:03:12.058807 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-df60235d-8e72-42c2-a1c2-277dd05458d3 req-0aa58383-05a1-4cb4-9927-51fb6a14ab7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc9ad5af-1587-4aa1-8323-a50c91bb1b84", "name": "network-vif-plugged", "status": "completed", "tag": "1669c917-58c0-440d-8b0d-29a608119c96"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:03:12.109161 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-df60235d-8e72-42c2-a1c2-277dd05458d3 req-0aa58383-05a1-4cb4-9927-51fb6a14ab7c service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:12.110173 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-df60235d-8e72-42c2-a1c2-277dd05458d3 req-0aa58383-05a1-4cb4-9927-51fb6a14ab7c service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:12.118277 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-df60235d-8e72-42c2-a1c2-277dd05458d3 req-0aa58383-05a1-4cb4-9927-51fb6a14ab7c service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:12.167616 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-df60235d-8e72-42c2-a1c2-277dd05458d3 req-0aa58383-05a1-4cb4-9927-51fb6a14ab7c service nova] Creating event network-vif-plugged:1669c917-58c0-440d-8b0d-29a608119c96 for instance cc9ad5af-1587-4aa1-8323-a50c91bb1b84 on n-h1-854823-8 Oct 04 21:03:12.192685 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-df60235d-8e72-42c2-a1c2-277dd05458d3 req-0aa58383-05a1-4cb4-9927-51fb6a14ab7c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131744 Oct 04 21:03:12.195207 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2644/5269] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:03:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:03:12.605686 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-783cac84-415e-4bdc-89f3-028de034b132 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:03:12.606304 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-783cac84-415e-4bdc-89f3-028de034b132 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] [instance: 0e0c304b-2735-4232-805f-5396927f389e] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:03:12.616266 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-783cac84-415e-4bdc-89f3-028de034b132 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:12.616695 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-783cac84-415e-4bdc-89f3-028de034b132 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:12.617110 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-783cac84-415e-4bdc-89f3-028de034b132 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:12.617819 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-783cac84-415e-4bdc-89f3-028de034b132 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:12.618262 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-783cac84-415e-4bdc-89f3-028de034b132 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:12.627007 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-783cac84-415e-4bdc-89f3-028de034b132 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:12.774451 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-3feed7bb-fd48-41dd-aa12-ee5a07e3fd54 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:03:12.775284 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-3feed7bb-fd48-41dd-aa12-ee5a07e3fd54 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] [instance: cc9ad5af-1587-4aa1-8323-a50c91bb1b84] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:03:12.785246 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3feed7bb-fd48-41dd-aa12-ee5a07e3fd54 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:12.785752 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3feed7bb-fd48-41dd-aa12-ee5a07e3fd54 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:12.786193 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3feed7bb-fd48-41dd-aa12-ee5a07e3fd54 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:12.789100 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3feed7bb-fd48-41dd-aa12-ee5a07e3fd54 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:12.789652 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3feed7bb-fd48-41dd-aa12-ee5a07e3fd54 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:12.790100 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3feed7bb-fd48-41dd-aa12-ee5a07e3fd54 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:13.116870 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-783cac84-415e-4bdc-89f3-028de034b132 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3403486e6f4afd8d97f97612110eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be936dd2db2466990cafbfbfb3a15cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:03:13.153986 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-783cac84-415e-4bdc-89f3-028de034b132 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] 10.222.0.33 "GET /compute/v2.1/servers/0e0c304b-2735-4232-805f-5396927f389e" status: 200 len: 1479 microversion: 2.1 time: 0.549859 Oct 04 21:03:13.154844 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2626/5270] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:03:12 2022] GET /compute/v2.1/servers/0e0c304b-2735-4232-805f-5396927f389e => generated 1479 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:03:14.182443 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-645d43f2-bcb9-4569-ac05-086d2f81a9cd tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:03:14.183967 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-645d43f2-bcb9-4569-ac05-086d2f81a9cd tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] [instance: 0e0c304b-2735-4232-805f-5396927f389e] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:03:14.201990 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-645d43f2-bcb9-4569-ac05-086d2f81a9cd tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:14.202852 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-645d43f2-bcb9-4569-ac05-086d2f81a9cd tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:14.209426 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-645d43f2-bcb9-4569-ac05-086d2f81a9cd tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:14.215457 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-645d43f2-bcb9-4569-ac05-086d2f81a9cd tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:14.216289 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-645d43f2-bcb9-4569-ac05-086d2f81a9cd tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:14.216952 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-645d43f2-bcb9-4569-ac05-086d2f81a9cd tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:14.568349 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-3feed7bb-fd48-41dd-aa12-ee5a07e3fd54 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:03:14.579439 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-3feed7bb-fd48-41dd-aa12-ee5a07e3fd54 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:03:14.580888 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-3feed7bb-fd48-41dd-aa12-ee5a07e3fd54 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:03:14.593323 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-3feed7bb-fd48-41dd-aa12-ee5a07e3fd54 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] 10.222.0.33 "GET /compute/v2.1/servers/cc9ad5af-1587-4aa1-8323-a50c91bb1b84" status: 200 len: 1739 microversion: 2.20 time: 1.823096 Oct 04 21:03:14.595080 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2645/5271] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 21:03:12 2022] GET /compute/v2.1/servers/cc9ad5af-1587-4aa1-8323-a50c91bb1b84 => generated 1739 bytes in 1825 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:03:14.603116 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-d46fcc22-6dca-42d2-91e7-0e71154d0463 req-7bd9cdc5-b304-48f6-88fa-776aa96aa96b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e0c304b-2735-4232-805f-5396927f389e", "name": "network-vif-deleted", "tag": "40bcdca2-30e3-49b0-8678-4508c44b8787"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:03:14.648559 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-d46fcc22-6dca-42d2-91e7-0e71154d0463 req-7bd9cdc5-b304-48f6-88fa-776aa96aa96b service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:14.649734 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-d46fcc22-6dca-42d2-91e7-0e71154d0463 req-7bd9cdc5-b304-48f6-88fa-776aa96aa96b service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:14.650179 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-d46fcc22-6dca-42d2-91e7-0e71154d0463 req-7bd9cdc5-b304-48f6-88fa-776aa96aa96b service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:14.690573 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-d46fcc22-6dca-42d2-91e7-0e71154d0463 req-7bd9cdc5-b304-48f6-88fa-776aa96aa96b service nova] Creating event network-vif-deleted:40bcdca2-30e3-49b0-8678-4508c44b8787 for instance 0e0c304b-2735-4232-805f-5396927f389e on n-h2-854823-8 Oct 04 21:03:14.711884 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-d46fcc22-6dca-42d2-91e7-0e71154d0463 req-7bd9cdc5-b304-48f6-88fa-776aa96aa96b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115498 Oct 04 21:03:14.712500 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2646/5272] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:03:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:03:14.730696 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-534dccf2-988c-4e3f-b04d-f9bcf8da1ca6 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:03:14.731400 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-534dccf2-988c-4e3f-b04d-f9bcf8da1ca6 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] [instance: 5a95bf94-24e7-43a2-9818-d5bf1b0315f1] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:03:14.759334 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-534dccf2-988c-4e3f-b04d-f9bcf8da1ca6 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:14.761804 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-534dccf2-988c-4e3f-b04d-f9bcf8da1ca6 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:14.762932 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-534dccf2-988c-4e3f-b04d-f9bcf8da1ca6 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:14.764860 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-534dccf2-988c-4e3f-b04d-f9bcf8da1ca6 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:14.769482 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-534dccf2-988c-4e3f-b04d-f9bcf8da1ca6 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:14.770162 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-534dccf2-988c-4e3f-b04d-f9bcf8da1ca6 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:15.181175 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-645d43f2-bcb9-4569-ac05-086d2f81a9cd tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3403486e6f4afd8d97f97612110eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be936dd2db2466990cafbfbfb3a15cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:03:15.195185 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-645d43f2-bcb9-4569-ac05-086d2f81a9cd tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] 10.222.0.33 "GET /compute/v2.1/servers/0e0c304b-2735-4232-805f-5396927f389e" status: 200 len: 1479 microversion: 2.1 time: 1.017005 Oct 04 21:03:15.218894 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2627/5273] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:03:14 2022] GET /compute/v2.1/servers/0e0c304b-2735-4232-805f-5396927f389e => generated 1479 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:03:15.628336 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a977199d-dee4-4bdf-a679-ae786ab999fb tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:03:15.629251 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a977199d-dee4-4bdf-a679-ae786ab999fb tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] [instance: cc9ad5af-1587-4aa1-8323-a50c91bb1b84] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:03:15.664878 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a977199d-dee4-4bdf-a679-ae786ab999fb tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:15.665378 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a977199d-dee4-4bdf-a679-ae786ab999fb tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:15.665813 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a977199d-dee4-4bdf-a679-ae786ab999fb tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:15.666565 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a977199d-dee4-4bdf-a679-ae786ab999fb tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:15.672983 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a977199d-dee4-4bdf-a679-ae786ab999fb tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:15.673446 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a977199d-dee4-4bdf-a679-ae786ab999fb tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:16.099530 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-534dccf2-988c-4e3f-b04d-f9bcf8da1ca6 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5dbe3da6a4af181ef7302fe605fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3aa23aee3c8435c8f1f409019c5fed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:03:16.117462 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-534dccf2-988c-4e3f-b04d-f9bcf8da1ca6 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] 10.222.0.33 "GET /compute/v2.1/servers/5a95bf94-24e7-43a2-9818-d5bf1b0315f1" status: 200 len: 1563 microversion: 2.1 time: 1.402483 Oct 04 21:03:16.118335 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2647/5274] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:03:14 2022] GET /compute/v2.1/servers/5a95bf94-24e7-43a2-9818-d5bf1b0315f1 => generated 1563 bytes in 1405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:03:16.221432 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-2713f943-d138-45b4-93f6-7aeb9422dee8 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:03:16.222335 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-2713f943-d138-45b4-93f6-7aeb9422dee8 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] [instance: 0e0c304b-2735-4232-805f-5396927f389e] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:03:16.232669 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2713f943-d138-45b4-93f6-7aeb9422dee8 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:16.243199 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2713f943-d138-45b4-93f6-7aeb9422dee8 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:16.251177 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2713f943-d138-45b4-93f6-7aeb9422dee8 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:16.252342 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2713f943-d138-45b4-93f6-7aeb9422dee8 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:16.253055 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2713f943-d138-45b4-93f6-7aeb9422dee8 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:16.253735 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2713f943-d138-45b4-93f6-7aeb9422dee8 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:16.287304 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.wsgi [None req-2713f943-d138-45b4-93f6-7aeb9422dee8 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] HTTP exception thrown: Instance 0e0c304b-2735-4232-805f-5396927f389e could not be found. Oct 04 21:03:16.289382 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-2713f943-d138-45b4-93f6-7aeb9422dee8 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Request method failure captured: Oct 04 21:03:16.289382 n-d-854823-8 devstack@n-api.service[128802]: request: GET /compute/v2.1/servers/0e0c304b-2735-4232-805f-5396927f389e HTTP/1.1 Oct 04 21:03:16.289382 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 21:03:16.289382 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 21:03:16.289382 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 21:03:16.289382 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 0 Oct 04 21:03:16.289382 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 21:03:16.289382 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 21:03:16.289382 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 21:03:16.289382 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 21:03:16.289382 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPJ8BN-OrapfgqK2P6TzuwZOwR4aY1OQd3GseLPuZ0pobQHquQ9bjmRFBUWmXZigaqWIJjuUAtigWd6NSAKQ5jrwlSaoxmqq2RtBYd48SEh911BmGBYfy8qjC4a6c-wTbsiLfT4J21RiEjLJT-AW9RabwAHTvmd0RLMdOuS16-gVxClA Oct 04 21:03:16.289382 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 21:03:16.289382 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 21:03:16.289382 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 21:03:16.289382 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 21:03:16.289382 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 21:03:16.289382 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 21:03:16.289382 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: 8be936dd2db2466990cafbfbfb3a15cf Oct 04 21:03:16.289382 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-1824446933 Oct 04 21:03:16.289382 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 21:03:16.289382 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 21:03:16.289382 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_8be936dd2db2466990cafbfbfb3a15cf", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8be936dd2db2466990cafbfbfb3a15cf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8be936dd2db2466990cafbfbfb3a15cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/8be936dd2db2466990cafbfbfb3a15cf"}]}] Oct 04 21:03:16.289382 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-TestSecurityGroupsBasicOps-1824446933 Oct 04 21:03:16.289382 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: 8be936dd2db2466990cafbfbfb3a15cf Oct 04 21:03:16.289382 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-1824446933 Oct 04 21:03:16.289382 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-TestSecurityGroupsBasicOps-1824446933-project Oct 04 21:03:16.289382 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 21:03:16.289382 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 21:03:16.289382 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: 0f3403486e6f4afd8d97f97612110eb5 Oct 04 21:03:16.289382 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-TestSecurityGroupsBasicOps-1824446933-project Oct 04 21:03:16.289382 n-d-854823-8 devstack@n-api.service[128802]: method: > Oct 04 21:03:16.289382 n-d-854823-8 devstack@n-api.service[128802]: exception: Instance 0e0c304b-2735-4232-805f-5396927f389e could not be found. Oct 04 21:03:16.289382 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'id': '0e0c304b-2735-4232-805f-5396927f389e'} Oct 04 21:03:16.289382 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:03:16.289382 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:03:16.289382 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:03:16.289382 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:03:16.289382 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:03:16.289382 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:03:16.289382 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:03:16.289382 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:03:16.289382 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:03:16.289382 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:03:16.289382 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e0c304b-2735-4232-805f-5396927f389e could not be found. Oct 04 21:03:16.289382 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:03:16.289382 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:03:16.289382 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:03:16.289382 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:03:16.289382 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:03:16.289382 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:03:16.289382 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:03:16.289382 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:03:16.289382 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:03:16.289382 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:03:16.289382 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:03:16.289382 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:03:16.289382 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:03:16.289382 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:03:16.289382 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:03:16.289382 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:03:16.289382 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e0c304b-2735-4232-805f-5396927f389e could not be found. Oct 04 21:03:16.289382 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:03:16.289382 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:03:16.293256 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:03:16.293256 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:03:16.293256 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:03:16.293256 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:03:16.293256 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:03:16.293256 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:03:16.293256 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e0c304b-2735-4232-805f-5396927f389e could not be found. Oct 04 21:03:16.293256 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:03:16.300310 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-2713f943-d138-45b4-93f6-7aeb9422dee8 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Returning 404 to user: Instance 0e0c304b-2735-4232-805f-5396927f389e could not be found. {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:03:16.302170 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-2713f943-d138-45b4-93f6-7aeb9422dee8 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] 10.222.0.33 "GET /compute/v2.1/servers/0e0c304b-2735-4232-805f-5396927f389e" status: 404 len: 111 microversion: 2.1 time: 0.084899 Oct 04 21:03:16.315439 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2648/5275] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:03:16 2022] GET /compute/v2.1/servers/0e0c304b-2735-4232-805f-5396927f389e => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 21:03:16.511628 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-a977199d-dee4-4bdf-a679-ae786ab999fb tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:03:16.532574 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-a977199d-dee4-4bdf-a679-ae786ab999fb tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:03:16.534702 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-a977199d-dee4-4bdf-a679-ae786ab999fb tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:03:16.536111 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a977199d-dee4-4bdf-a679-ae786ab999fb tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] 10.222.0.33 "GET /compute/v2.1/servers/cc9ad5af-1587-4aa1-8323-a50c91bb1b84" status: 200 len: 1739 microversion: 2.20 time: 0.913426 Oct 04 21:03:16.536858 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2628/5276] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 21:03:15 2022] GET /compute/v2.1/servers/cc9ad5af-1587-4aa1-8323-a50c91bb1b84 => generated 1739 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:03:16.754460 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-efc649dc-16c9-490a-a3e1-bbc95d0e2588 req-f7b39af8-2053-48f3-9323-6228f4a7f7bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a95bf94-24e7-43a2-9818-d5bf1b0315f1", "tag": "99e654db-1794-4804-bb52-dc567c83649d"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:03:16.771540 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-efc649dc-16c9-490a-a3e1-bbc95d0e2588 req-f7b39af8-2053-48f3-9323-6228f4a7f7bb service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:16.783038 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-efc649dc-16c9-490a-a3e1-bbc95d0e2588 req-f7b39af8-2053-48f3-9323-6228f4a7f7bb service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:16.783738 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-efc649dc-16c9-490a-a3e1-bbc95d0e2588 req-f7b39af8-2053-48f3-9323-6228f4a7f7bb service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:16.844292 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-efc649dc-16c9-490a-a3e1-bbc95d0e2588 req-f7b39af8-2053-48f3-9323-6228f4a7f7bb service nova] Creating event network-changed:99e654db-1794-4804-bb52-dc567c83649d for instance 5a95bf94-24e7-43a2-9818-d5bf1b0315f1 on n-h2-854823-8 Oct 04 21:03:16.859082 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-efc649dc-16c9-490a-a3e1-bbc95d0e2588 req-f7b39af8-2053-48f3-9323-6228f4a7f7bb service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104410 Oct 04 21:03:16.861718 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2649/5277] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:03:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:03:17.567356 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d2096c4f-2d42-4560-ae75-92b62fa371c1 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:03:17.567950 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d2096c4f-2d42-4560-ae75-92b62fa371c1 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] [instance: cc9ad5af-1587-4aa1-8323-a50c91bb1b84] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:03:17.578147 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d2096c4f-2d42-4560-ae75-92b62fa371c1 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:17.578655 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d2096c4f-2d42-4560-ae75-92b62fa371c1 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:17.579091 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d2096c4f-2d42-4560-ae75-92b62fa371c1 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:17.579797 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d2096c4f-2d42-4560-ae75-92b62fa371c1 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:17.580247 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d2096c4f-2d42-4560-ae75-92b62fa371c1 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:17.580672 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d2096c4f-2d42-4560-ae75-92b62fa371c1 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:19.112569 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d2096c4f-2d42-4560-ae75-92b62fa371c1 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:03:19.124673 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d2096c4f-2d42-4560-ae75-92b62fa371c1 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:03:19.131989 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d2096c4f-2d42-4560-ae75-92b62fa371c1 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:03:19.135073 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d2096c4f-2d42-4560-ae75-92b62fa371c1 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] 10.222.0.33 "GET /compute/v2.1/servers/cc9ad5af-1587-4aa1-8323-a50c91bb1b84" status: 200 len: 1739 microversion: 2.20 time: 1.571793 Oct 04 21:03:19.228136 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2629/5278] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 21:03:17 2022] GET /compute/v2.1/servers/cc9ad5af-1587-4aa1-8323-a50c91bb1b84 => generated 1739 bytes in 1665 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:03:20.167158 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-15accb36-d035-4d27-bb45-02977b1aeb60 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:03:20.168683 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-15accb36-d035-4d27-bb45-02977b1aeb60 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] [instance: cc9ad5af-1587-4aa1-8323-a50c91bb1b84] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:03:20.187040 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-15accb36-d035-4d27-bb45-02977b1aeb60 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:20.188005 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-15accb36-d035-4d27-bb45-02977b1aeb60 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:20.188676 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-15accb36-d035-4d27-bb45-02977b1aeb60 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:20.189720 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-15accb36-d035-4d27-bb45-02977b1aeb60 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:20.190425 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-15accb36-d035-4d27-bb45-02977b1aeb60 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:20.191067 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-15accb36-d035-4d27-bb45-02977b1aeb60 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:20.682073 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-15accb36-d035-4d27-bb45-02977b1aeb60 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:03:20.691688 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-15accb36-d035-4d27-bb45-02977b1aeb60 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:03:20.693138 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-15accb36-d035-4d27-bb45-02977b1aeb60 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:03:20.710654 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-15accb36-d035-4d27-bb45-02977b1aeb60 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] 10.222.0.33 "GET /compute/v2.1/servers/cc9ad5af-1587-4aa1-8323-a50c91bb1b84" status: 200 len: 1739 microversion: 2.20 time: 0.533055 Oct 04 21:03:20.729367 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2650/5279] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 21:03:20 2022] GET /compute/v2.1/servers/cc9ad5af-1587-4aa1-8323-a50c91bb1b84 => generated 1739 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:03:21.743139 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d47f68ad-1605-40cd-971f-00212e770b70 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:03:21.743762 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d47f68ad-1605-40cd-971f-00212e770b70 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] [instance: cc9ad5af-1587-4aa1-8323-a50c91bb1b84] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:03:21.753981 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d47f68ad-1605-40cd-971f-00212e770b70 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:21.754191 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d47f68ad-1605-40cd-971f-00212e770b70 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:21.754536 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d47f68ad-1605-40cd-971f-00212e770b70 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:21.755244 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d47f68ad-1605-40cd-971f-00212e770b70 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:21.755693 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d47f68ad-1605-40cd-971f-00212e770b70 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:21.756111 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d47f68ad-1605-40cd-971f-00212e770b70 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:22.375218 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d47f68ad-1605-40cd-971f-00212e770b70 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:03:22.388112 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d47f68ad-1605-40cd-971f-00212e770b70 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:03:22.392068 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d47f68ad-1605-40cd-971f-00212e770b70 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:03:22.400671 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d47f68ad-1605-40cd-971f-00212e770b70 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] 10.222.0.33 "GET /compute/v2.1/servers/cc9ad5af-1587-4aa1-8323-a50c91bb1b84" status: 200 len: 1739 microversion: 2.20 time: 0.658114 Oct 04 21:03:22.415313 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2630/5280] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 21:03:21 2022] GET /compute/v2.1/servers/cc9ad5af-1587-4aa1-8323-a50c91bb1b84 => generated 1739 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:03:23.430824 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-b98abe3c-99a4-48dd-8c00-fbede324f078 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:03:23.432114 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-b98abe3c-99a4-48dd-8c00-fbede324f078 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] [instance: cc9ad5af-1587-4aa1-8323-a50c91bb1b84] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:03:23.452155 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b98abe3c-99a4-48dd-8c00-fbede324f078 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:23.454398 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b98abe3c-99a4-48dd-8c00-fbede324f078 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:23.455094 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b98abe3c-99a4-48dd-8c00-fbede324f078 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:23.460462 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b98abe3c-99a4-48dd-8c00-fbede324f078 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:23.462842 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b98abe3c-99a4-48dd-8c00-fbede324f078 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:23.464609 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b98abe3c-99a4-48dd-8c00-fbede324f078 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:23.522806 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=100 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:03:23.993197 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-b98abe3c-99a4-48dd-8c00-fbede324f078 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:03:24.003773 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-b98abe3c-99a4-48dd-8c00-fbede324f078 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:03:24.016811 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-b98abe3c-99a4-48dd-8c00-fbede324f078 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:03:24.018174 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-b98abe3c-99a4-48dd-8c00-fbede324f078 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] 10.222.0.33 "GET /compute/v2.1/servers/cc9ad5af-1587-4aa1-8323-a50c91bb1b84" status: 200 len: 1739 microversion: 2.20 time: 0.593105 Oct 04 21:03:24.028777 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2651/5281] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 21:03:23 2022] GET /compute/v2.1/servers/cc9ad5af-1587-4aa1-8323-a50c91bb1b84 => generated 1739 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:03:25.047930 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-808357eb-7586-47d8-9b19-d83652de777d tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:03:25.049348 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-808357eb-7586-47d8-9b19-d83652de777d tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] [instance: cc9ad5af-1587-4aa1-8323-a50c91bb1b84] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:03:25.094520 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-808357eb-7586-47d8-9b19-d83652de777d tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:25.102327 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-808357eb-7586-47d8-9b19-d83652de777d tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:25.134689 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-808357eb-7586-47d8-9b19-d83652de777d tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.037s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:25.135541 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-808357eb-7586-47d8-9b19-d83652de777d tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:25.136237 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-808357eb-7586-47d8-9b19-d83652de777d tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:25.137098 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-808357eb-7586-47d8-9b19-d83652de777d tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:25.143649 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:03:26.079583 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-808357eb-7586-47d8-9b19-d83652de777d tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:03:26.094429 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-808357eb-7586-47d8-9b19-d83652de777d tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:03:26.106682 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-808357eb-7586-47d8-9b19-d83652de777d tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:03:26.117494 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-808357eb-7586-47d8-9b19-d83652de777d tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] 10.222.0.33 "GET /compute/v2.1/servers/cc9ad5af-1587-4aa1-8323-a50c91bb1b84" status: 200 len: 1739 microversion: 2.20 time: 1.075248 Oct 04 21:03:26.123712 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2631/5282] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 21:03:25 2022] GET /compute/v2.1/servers/cc9ad5af-1587-4aa1-8323-a50c91bb1b84 => generated 1739 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:03:27.146856 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-8513f5ff-1adc-4b7f-9302-55642faf4104 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:03:27.148050 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-8513f5ff-1adc-4b7f-9302-55642faf4104 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] [instance: cc9ad5af-1587-4aa1-8323-a50c91bb1b84] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:03:27.157728 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8513f5ff-1adc-4b7f-9302-55642faf4104 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:27.161524 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8513f5ff-1adc-4b7f-9302-55642faf4104 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:27.163888 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8513f5ff-1adc-4b7f-9302-55642faf4104 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:27.166520 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8513f5ff-1adc-4b7f-9302-55642faf4104 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:27.167139 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8513f5ff-1adc-4b7f-9302-55642faf4104 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:27.168437 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8513f5ff-1adc-4b7f-9302-55642faf4104 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:28.313606 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-8513f5ff-1adc-4b7f-9302-55642faf4104 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:03:28.337938 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-8513f5ff-1adc-4b7f-9302-55642faf4104 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:03:28.365196 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-8513f5ff-1adc-4b7f-9302-55642faf4104 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:03:28.375977 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-8513f5ff-1adc-4b7f-9302-55642faf4104 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] 10.222.0.33 "GET /compute/v2.1/servers/cc9ad5af-1587-4aa1-8323-a50c91bb1b84" status: 200 len: 1739 microversion: 2.20 time: 1.233323 Oct 04 21:03:28.378109 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2652/5283] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 21:03:27 2022] GET /compute/v2.1/servers/cc9ad5af-1587-4aa1-8323-a50c91bb1b84 => generated 1739 bytes in 1236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:03:28.524721 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-48681efd-e105-4881-b80f-179e5809dc76 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:03:28.530727 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-48681efd-e105-4881-b80f-179e5809dc76 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] [instance: 5a95bf94-24e7-43a2-9818-d5bf1b0315f1] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:03:28.553171 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-48681efd-e105-4881-b80f-179e5809dc76 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:28.553666 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-48681efd-e105-4881-b80f-179e5809dc76 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:28.554103 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-48681efd-e105-4881-b80f-179e5809dc76 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:28.554850 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-48681efd-e105-4881-b80f-179e5809dc76 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:28.555302 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-48681efd-e105-4881-b80f-179e5809dc76 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:28.555722 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-48681efd-e105-4881-b80f-179e5809dc76 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:28.675888 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-48681efd-e105-4881-b80f-179e5809dc76 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] 10.222.0.33 "POST /compute/v2.1/servers/5a95bf94-24e7-43a2-9818-d5bf1b0315f1/action" status: 200 len: 24569 microversion: 2.1 time: 0.158180 Oct 04 21:03:28.677567 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2632/5284] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 21:03:28 2022] POST /compute/v2.1/servers/5a95bf94-24e7-43a2-9818-d5bf1b0315f1/action => generated 24569 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 04 21:03:29.409659 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-20cef8a1-963a-4016-aace-349cd4930646 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:03:29.410936 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-20cef8a1-963a-4016-aace-349cd4930646 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] [instance: cc9ad5af-1587-4aa1-8323-a50c91bb1b84] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:03:29.437090 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-20cef8a1-963a-4016-aace-349cd4930646 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:29.437989 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-20cef8a1-963a-4016-aace-349cd4930646 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:29.438618 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-20cef8a1-963a-4016-aace-349cd4930646 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:29.441457 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-20cef8a1-963a-4016-aace-349cd4930646 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:29.445045 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-20cef8a1-963a-4016-aace-349cd4930646 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:29.449900 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-20cef8a1-963a-4016-aace-349cd4930646 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:31.051804 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-20cef8a1-963a-4016-aace-349cd4930646 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:03:31.064750 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-20cef8a1-963a-4016-aace-349cd4930646 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:03:31.071543 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-20cef8a1-963a-4016-aace-349cd4930646 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:03:31.074647 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-20cef8a1-963a-4016-aace-349cd4930646 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] 10.222.0.33 "GET /compute/v2.1/servers/cc9ad5af-1587-4aa1-8323-a50c91bb1b84" status: 200 len: 1739 microversion: 2.20 time: 1.667845 Oct 04 21:03:31.099982 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2653/5285] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 21:03:29 2022] GET /compute/v2.1/servers/cc9ad5af-1587-4aa1-8323-a50c91bb1b84 => generated 1739 bytes in 1696 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:03:32.127134 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ffb8eafe-c859-414a-8c50-21ae17641e12 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:03:32.143430 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ffb8eafe-c859-414a-8c50-21ae17641e12 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] [instance: cc9ad5af-1587-4aa1-8323-a50c91bb1b84] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:03:32.170140 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ffb8eafe-c859-414a-8c50-21ae17641e12 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:32.178812 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ffb8eafe-c859-414a-8c50-21ae17641e12 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:32.187169 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ffb8eafe-c859-414a-8c50-21ae17641e12 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:32.189563 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ffb8eafe-c859-414a-8c50-21ae17641e12 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:32.255288 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ffb8eafe-c859-414a-8c50-21ae17641e12 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.066s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:32.259501 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ffb8eafe-c859-414a-8c50-21ae17641e12 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:33.043060 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-ffb8eafe-c859-414a-8c50-21ae17641e12 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:03:33.058397 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-ffb8eafe-c859-414a-8c50-21ae17641e12 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:03:33.062944 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-ffb8eafe-c859-414a-8c50-21ae17641e12 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:03:33.064426 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ffb8eafe-c859-414a-8c50-21ae17641e12 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] 10.222.0.33 "GET /compute/v2.1/servers/cc9ad5af-1587-4aa1-8323-a50c91bb1b84" status: 200 len: 1739 microversion: 2.20 time: 0.953245 Oct 04 21:03:33.068347 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2633/5286] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 21:03:32 2022] GET /compute/v2.1/servers/cc9ad5af-1587-4aa1-8323-a50c91bb1b84 => generated 1739 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:03:34.100950 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-56a83f29-c40a-4bea-87f5-eeff69893d6e tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:03:34.101574 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-56a83f29-c40a-4bea-87f5-eeff69893d6e tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] [instance: cc9ad5af-1587-4aa1-8323-a50c91bb1b84] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:03:34.120159 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_api:SELECT=38 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:03:34.121719 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-56a83f29-c40a-4bea-87f5-eeff69893d6e tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:34.122897 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-56a83f29-c40a-4bea-87f5-eeff69893d6e tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:34.123357 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-56a83f29-c40a-4bea-87f5-eeff69893d6e tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:34.124086 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-56a83f29-c40a-4bea-87f5-eeff69893d6e tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:34.124544 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-56a83f29-c40a-4bea-87f5-eeff69893d6e tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:34.124974 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-56a83f29-c40a-4bea-87f5-eeff69893d6e tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:35.387618 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-56a83f29-c40a-4bea-87f5-eeff69893d6e tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:03:35.402247 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-56a83f29-c40a-4bea-87f5-eeff69893d6e tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:03:35.406643 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-56a83f29-c40a-4bea-87f5-eeff69893d6e tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:03:35.408831 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-56a83f29-c40a-4bea-87f5-eeff69893d6e tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] 10.222.0.33 "GET /compute/v2.1/servers/cc9ad5af-1587-4aa1-8323-a50c91bb1b84" status: 200 len: 1739 microversion: 2.20 time: 1.313047 Oct 04 21:03:35.430867 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2654/5287] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 21:03:34 2022] GET /compute/v2.1/servers/cc9ad5af-1587-4aa1-8323-a50c91bb1b84 => generated 1739 bytes in 1335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:03:36.249694 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-588ea02e-299f-4709-814a-f651c961886c tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:03:36.250207 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-588ea02e-299f-4709-814a-f651c961886c tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] [instance: 61bb9cf5-6da5-4074-9bb8-ffd1269ea50f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:03:36.255996 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:03:36.270535 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-cc63c360-5d9c-4d3d-aea6-0814824fc8b9 req-956b7f6b-bb4a-4c98-91f1-66bb878b2ffb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "61bb9cf5-6da5-4074-9bb8-ffd1269ea50f", "tag": "bcd2dd15-0ca7-47ca-9e2d-d0c557d550b4"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:03:36.285183 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-588ea02e-299f-4709-814a-f651c961886c tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:36.289386 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-588ea02e-299f-4709-814a-f651c961886c tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:36.289954 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-588ea02e-299f-4709-814a-f651c961886c tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:36.290862 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-588ea02e-299f-4709-814a-f651c961886c tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:36.291580 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-588ea02e-299f-4709-814a-f651c961886c tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:36.292253 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-588ea02e-299f-4709-814a-f651c961886c tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:36.298142 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-cc63c360-5d9c-4d3d-aea6-0814824fc8b9 req-956b7f6b-bb4a-4c98-91f1-66bb878b2ffb service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:36.299045 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-cc63c360-5d9c-4d3d-aea6-0814824fc8b9 req-956b7f6b-bb4a-4c98-91f1-66bb878b2ffb service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:36.302947 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-cc63c360-5d9c-4d3d-aea6-0814824fc8b9 req-956b7f6b-bb4a-4c98-91f1-66bb878b2ffb service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:36.320479 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-cc63c360-5d9c-4d3d-aea6-0814824fc8b9 req-956b7f6b-bb4a-4c98-91f1-66bb878b2ffb service nova] Creating event network-changed:bcd2dd15-0ca7-47ca-9e2d-d0c557d550b4 for instance 61bb9cf5-6da5-4074-9bb8-ffd1269ea50f on n-h1-854823-8 Oct 04 21:03:36.328769 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-cc63c360-5d9c-4d3d-aea6-0814824fc8b9 req-956b7f6b-bb4a-4c98-91f1-66bb878b2ffb service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063077 Oct 04 21:03:36.330000 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2655/5288] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:03:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:03:36.396693 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-588ea02e-299f-4709-814a-f651c961886c tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] [instance: 61bb9cf5-6da5-4074-9bb8-ffd1269ea50f] Going to try to terminate instance {{(pid=128801) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:03:36.448466 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-25d4d0b1-1ce1-4af0-b168-7d57ca5c05e1 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:03:36.450982 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-25d4d0b1-1ce1-4af0-b168-7d57ca5c05e1 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] [instance: cc9ad5af-1587-4aa1-8323-a50c91bb1b84] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:03:36.459273 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-25d4d0b1-1ce1-4af0-b168-7d57ca5c05e1 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:36.460405 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-25d4d0b1-1ce1-4af0-b168-7d57ca5c05e1 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:36.461020 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-25d4d0b1-1ce1-4af0-b168-7d57ca5c05e1 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:36.461962 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-25d4d0b1-1ce1-4af0-b168-7d57ca5c05e1 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:36.462608 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-25d4d0b1-1ce1-4af0-b168-7d57ca5c05e1 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:36.463431 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-25d4d0b1-1ce1-4af0-b168-7d57ca5c05e1 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:36.592371 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-588ea02e-299f-4709-814a-f651c961886c tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] 10.222.0.33 "DELETE /compute/v2.1/servers/61bb9cf5-6da5-4074-9bb8-ffd1269ea50f" status: 204 len: 0 microversion: 2.1 time: 0.346617 Oct 04 21:03:36.593834 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2634/5289] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 21:03:36 2022] DELETE /compute/v2.1/servers/61bb9cf5-6da5-4074-9bb8-ffd1269ea50f => generated 0 bytes in 349 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:03:36.602713 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-44d15206-6662-405e-9dd4-9ec919bdc4c4 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:03:36.603663 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-44d15206-6662-405e-9dd4-9ec919bdc4c4 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] [instance: 61bb9cf5-6da5-4074-9bb8-ffd1269ea50f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:03:36.615552 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-44d15206-6662-405e-9dd4-9ec919bdc4c4 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:36.616867 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-44d15206-6662-405e-9dd4-9ec919bdc4c4 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:36.617579 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-44d15206-6662-405e-9dd4-9ec919bdc4c4 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:36.618667 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-44d15206-6662-405e-9dd4-9ec919bdc4c4 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:36.619731 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-44d15206-6662-405e-9dd4-9ec919bdc4c4 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:36.620458 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-44d15206-6662-405e-9dd4-9ec919bdc4c4 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:37.000560 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-25d4d0b1-1ce1-4af0-b168-7d57ca5c05e1 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:03:37.016175 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-25d4d0b1-1ce1-4af0-b168-7d57ca5c05e1 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:03:37.018217 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-25d4d0b1-1ce1-4af0-b168-7d57ca5c05e1 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:03:37.021809 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-25d4d0b1-1ce1-4af0-b168-7d57ca5c05e1 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] 10.222.0.33 "GET /compute/v2.1/servers/cc9ad5af-1587-4aa1-8323-a50c91bb1b84" status: 200 len: 1739 microversion: 2.20 time: 0.577775 Oct 04 21:03:37.048577 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2656/5290] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 21:03:36 2022] GET /compute/v2.1/servers/cc9ad5af-1587-4aa1-8323-a50c91bb1b84 => generated 1739 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:03:38.064313 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-c11e34c6-acc3-4bb4-b0f1-be561fc0d0b9 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:03:38.064951 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-c11e34c6-acc3-4bb4-b0f1-be561fc0d0b9 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] [instance: cc9ad5af-1587-4aa1-8323-a50c91bb1b84] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:03:38.091543 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c11e34c6-acc3-4bb4-b0f1-be561fc0d0b9 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:38.093756 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c11e34c6-acc3-4bb4-b0f1-be561fc0d0b9 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:38.095363 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c11e34c6-acc3-4bb4-b0f1-be561fc0d0b9 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:38.109498 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c11e34c6-acc3-4bb4-b0f1-be561fc0d0b9 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:38.110270 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c11e34c6-acc3-4bb4-b0f1-be561fc0d0b9 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:38.111198 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c11e34c6-acc3-4bb4-b0f1-be561fc0d0b9 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:38.222521 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-44d15206-6662-405e-9dd4-9ec919bdc4c4 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3403486e6f4afd8d97f97612110eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be936dd2db2466990cafbfbfb3a15cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:03:38.239920 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-44d15206-6662-405e-9dd4-9ec919bdc4c4 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] 10.222.0.33 "GET /compute/v2.1/servers/61bb9cf5-6da5-4074-9bb8-ffd1269ea50f" status: 200 len: 1768 microversion: 2.1 time: 1.641830 Oct 04 21:03:38.241631 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2635/5291] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:03:36 2022] GET /compute/v2.1/servers/61bb9cf5-6da5-4074-9bb8-ffd1269ea50f => generated 1768 bytes in 1644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:03:39.266640 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-564439cf-7641-4852-be7d-e8f5885ddcb3 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:03:39.268000 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-564439cf-7641-4852-be7d-e8f5885ddcb3 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] [instance: 61bb9cf5-6da5-4074-9bb8-ffd1269ea50f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:03:39.294774 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-564439cf-7641-4852-be7d-e8f5885ddcb3 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:39.297543 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-564439cf-7641-4852-be7d-e8f5885ddcb3 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:39.298157 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-564439cf-7641-4852-be7d-e8f5885ddcb3 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:39.299096 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-564439cf-7641-4852-be7d-e8f5885ddcb3 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:39.299863 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-564439cf-7641-4852-be7d-e8f5885ddcb3 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:39.303455 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-564439cf-7641-4852-be7d-e8f5885ddcb3 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:39.918555 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-c11e34c6-acc3-4bb4-b0f1-be561fc0d0b9 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:03:39.928688 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-c11e34c6-acc3-4bb4-b0f1-be561fc0d0b9 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:03:39.940251 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-c11e34c6-acc3-4bb4-b0f1-be561fc0d0b9 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:03:39.948217 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-c11e34c6-acc3-4bb4-b0f1-be561fc0d0b9 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] 10.222.0.33 "GET /compute/v2.1/servers/cc9ad5af-1587-4aa1-8323-a50c91bb1b84" status: 200 len: 1739 microversion: 2.20 time: 1.895064 Oct 04 21:03:39.949202 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2657/5292] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 21:03:38 2022] GET /compute/v2.1/servers/cc9ad5af-1587-4aa1-8323-a50c91bb1b84 => generated 1739 bytes in 1899 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:03:39.954636 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-3aea7ea2-2caf-4237-a4a7-e77c065829f7 tempest-TestNetworkAdvancedServerOps-2095277972 tempest-TestNetworkAdvancedServerOps-2095277972-project-admin] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:03:39.971299 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-3aea7ea2-2caf-4237-a4a7-e77c065829f7 tempest-TestNetworkAdvancedServerOps-2095277972 tempest-TestNetworkAdvancedServerOps-2095277972-project-admin] [instance: 5a95bf94-24e7-43a2-9818-d5bf1b0315f1] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:03:39.988271 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3aea7ea2-2caf-4237-a4a7-e77c065829f7 tempest-TestNetworkAdvancedServerOps-2095277972 tempest-TestNetworkAdvancedServerOps-2095277972-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:39.990567 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3aea7ea2-2caf-4237-a4a7-e77c065829f7 tempest-TestNetworkAdvancedServerOps-2095277972 tempest-TestNetworkAdvancedServerOps-2095277972-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:39.991939 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3aea7ea2-2caf-4237-a4a7-e77c065829f7 tempest-TestNetworkAdvancedServerOps-2095277972 tempest-TestNetworkAdvancedServerOps-2095277972-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:39.992938 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3aea7ea2-2caf-4237-a4a7-e77c065829f7 tempest-TestNetworkAdvancedServerOps-2095277972 tempest-TestNetworkAdvancedServerOps-2095277972-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:39.994976 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3aea7ea2-2caf-4237-a4a7-e77c065829f7 tempest-TestNetworkAdvancedServerOps-2095277972 tempest-TestNetworkAdvancedServerOps-2095277972-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:39.999104 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3aea7ea2-2caf-4237-a4a7-e77c065829f7 tempest-TestNetworkAdvancedServerOps-2095277972 tempest-TestNetworkAdvancedServerOps-2095277972-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:41.033010 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-564439cf-7641-4852-be7d-e8f5885ddcb3 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3403486e6f4afd8d97f97612110eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be936dd2db2466990cafbfbfb3a15cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:03:41.050439 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-564439cf-7641-4852-be7d-e8f5885ddcb3 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] 10.222.0.33 "GET /compute/v2.1/servers/61bb9cf5-6da5-4074-9bb8-ffd1269ea50f" status: 200 len: 1768 microversion: 2.1 time: 1.785824 Oct 04 21:03:41.051316 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2636/5293] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:03:39 2022] GET /compute/v2.1/servers/61bb9cf5-6da5-4074-9bb8-ffd1269ea50f => generated 1768 bytes in 1791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:03:41.079177 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-59cb36da-6166-4bd7-a462-955331e11af7 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:03:41.080046 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-59cb36da-6166-4bd7-a462-955331e11af7 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] [instance: cc9ad5af-1587-4aa1-8323-a50c91bb1b84] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:03:41.098635 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-59cb36da-6166-4bd7-a462-955331e11af7 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:41.099383 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-59cb36da-6166-4bd7-a462-955331e11af7 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:41.100021 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-59cb36da-6166-4bd7-a462-955331e11af7 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:41.100942 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-59cb36da-6166-4bd7-a462-955331e11af7 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:41.101555 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-59cb36da-6166-4bd7-a462-955331e11af7 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:41.102212 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-59cb36da-6166-4bd7-a462-955331e11af7 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:41.319091 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-3aea7ea2-2caf-4237-a4a7-e77c065829f7 tempest-TestNetworkAdvancedServerOps-2095277972 tempest-TestNetworkAdvancedServerOps-2095277972-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/5a95bf94-24e7-43a2-9818-d5bf1b0315f1" status: 200 len: 1833 microversion: 2.1 time: 1.368534 Oct 04 21:03:41.319691 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2658/5294] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:03:39 2022] GET /compute/v2.1/servers/5a95bf94-24e7-43a2-9818-d5bf1b0315f1 => generated 1833 bytes in 1370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:03:41.352265 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-c9b702ac-0bd2-4bdc-94c9-1b1bf800c26c tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:03:41.353190 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-c9b702ac-0bd2-4bdc-94c9-1b1bf800c26c tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] [instance: 5a95bf94-24e7-43a2-9818-d5bf1b0315f1] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:03:41.368072 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c9b702ac-0bd2-4bdc-94c9-1b1bf800c26c tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:41.369870 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c9b702ac-0bd2-4bdc-94c9-1b1bf800c26c tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:41.372024 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c9b702ac-0bd2-4bdc-94c9-1b1bf800c26c tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:41.373153 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c9b702ac-0bd2-4bdc-94c9-1b1bf800c26c tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:41.376216 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c9b702ac-0bd2-4bdc-94c9-1b1bf800c26c tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:41.377735 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c9b702ac-0bd2-4bdc-94c9-1b1bf800c26c tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:41.703499 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-59cb36da-6166-4bd7-a462-955331e11af7 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:03:41.712445 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-59cb36da-6166-4bd7-a462-955331e11af7 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:03:41.719254 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-59cb36da-6166-4bd7-a462-955331e11af7 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:03:41.721017 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-59cb36da-6166-4bd7-a462-955331e11af7 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] 10.222.0.33 "GET /compute/v2.1/servers/cc9ad5af-1587-4aa1-8323-a50c91bb1b84" status: 200 len: 1739 microversion: 2.20 time: 0.652565 Oct 04 21:03:41.724539 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2637/5295] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 21:03:41 2022] GET /compute/v2.1/servers/cc9ad5af-1587-4aa1-8323-a50c91bb1b84 => generated 1739 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:03:41.808382 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-9da7c08f-ffeb-4d0c-8b61-7d85e5b5bc87 req-0a015076-f3b9-417f-b4d4-0afb1dc2a1d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61bb9cf5-6da5-4074-9bb8-ffd1269ea50f", "name": "network-vif-unplugged", "status": "completed", "tag": "bcd2dd15-0ca7-47ca-9e2d-d0c557d550b4"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:03:41.828080 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-9da7c08f-ffeb-4d0c-8b61-7d85e5b5bc87 req-0a015076-f3b9-417f-b4d4-0afb1dc2a1d1 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:41.828775 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-9da7c08f-ffeb-4d0c-8b61-7d85e5b5bc87 req-0a015076-f3b9-417f-b4d4-0afb1dc2a1d1 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:41.829358 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-9da7c08f-ffeb-4d0c-8b61-7d85e5b5bc87 req-0a015076-f3b9-417f-b4d4-0afb1dc2a1d1 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:41.863688 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-9da7c08f-ffeb-4d0c-8b61-7d85e5b5bc87 req-0a015076-f3b9-417f-b4d4-0afb1dc2a1d1 service nova] Creating event network-vif-unplugged:bcd2dd15-0ca7-47ca-9e2d-d0c557d550b4 for instance 61bb9cf5-6da5-4074-9bb8-ffd1269ea50f on n-h1-854823-8 Oct 04 21:03:41.879799 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-9da7c08f-ffeb-4d0c-8b61-7d85e5b5bc87 req-0a015076-f3b9-417f-b4d4-0afb1dc2a1d1 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.074795 Oct 04 21:03:41.880709 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2638/5296] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:03:41 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:03:42.082486 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9233dfff-1e33-4cc4-bd97-bf293f0fdf7c tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:03:42.083932 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-9233dfff-1e33-4cc4-bd97-bf293f0fdf7c tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] [instance: 61bb9cf5-6da5-4074-9bb8-ffd1269ea50f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:03:42.094477 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9233dfff-1e33-4cc4-bd97-bf293f0fdf7c tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:42.095370 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9233dfff-1e33-4cc4-bd97-bf293f0fdf7c tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:42.097455 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9233dfff-1e33-4cc4-bd97-bf293f0fdf7c tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:42.098545 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9233dfff-1e33-4cc4-bd97-bf293f0fdf7c tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:42.101577 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9233dfff-1e33-4cc4-bd97-bf293f0fdf7c tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:42.103039 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9233dfff-1e33-4cc4-bd97-bf293f0fdf7c tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:42.574935 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-c9b702ac-0bd2-4bdc-94c9-1b1bf800c26c tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5dbe3da6a4af181ef7302fe605fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3aa23aee3c8435c8f1f409019c5fed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:03:42.592216 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-c9b702ac-0bd2-4bdc-94c9-1b1bf800c26c tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] 10.222.0.33 "GET /compute/v2.1/servers/5a95bf94-24e7-43a2-9818-d5bf1b0315f1" status: 200 len: 1682 microversion: 2.1 time: 1.243098 Oct 04 21:03:42.606418 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2659/5297] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:03:41 2022] GET /compute/v2.1/servers/5a95bf94-24e7-43a2-9818-d5bf1b0315f1 => generated 1682 bytes in 1251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:03:42.757866 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-ed498f4c-2f05-48b1-a365-d02ddac87aa1 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:03:42.760059 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-ed498f4c-2f05-48b1-a365-d02ddac87aa1 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] [instance: cc9ad5af-1587-4aa1-8323-a50c91bb1b84] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:03:42.768649 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ed498f4c-2f05-48b1-a365-d02ddac87aa1 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:42.769519 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ed498f4c-2f05-48b1-a365-d02ddac87aa1 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:42.770174 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ed498f4c-2f05-48b1-a365-d02ddac87aa1 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:42.780972 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ed498f4c-2f05-48b1-a365-d02ddac87aa1 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:42.781830 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ed498f4c-2f05-48b1-a365-d02ddac87aa1 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:42.782572 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ed498f4c-2f05-48b1-a365-d02ddac87aa1 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:42.855457 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-9233dfff-1e33-4cc4-bd97-bf293f0fdf7c tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3403486e6f4afd8d97f97612110eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be936dd2db2466990cafbfbfb3a15cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:03:42.870374 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-9233dfff-1e33-4cc4-bd97-bf293f0fdf7c tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] 10.222.0.33 "GET /compute/v2.1/servers/61bb9cf5-6da5-4074-9bb8-ffd1269ea50f" status: 200 len: 1650 microversion: 2.1 time: 0.790880 Oct 04 21:03:42.871410 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2639/5298] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:03:42 2022] GET /compute/v2.1/servers/61bb9cf5-6da5-4074-9bb8-ffd1269ea50f => generated 1650 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:03:42.881934 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5b77b05f-9100-4e52-9c3a-650eb07b203a tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:03:42.891392 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-5b77b05f-9100-4e52-9c3a-650eb07b203a tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] [instance: 5a95bf94-24e7-43a2-9818-d5bf1b0315f1] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:03:42.899373 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5b77b05f-9100-4e52-9c3a-650eb07b203a tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:42.900345 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5b77b05f-9100-4e52-9c3a-650eb07b203a tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:42.901008 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5b77b05f-9100-4e52-9c3a-650eb07b203a tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:42.901957 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5b77b05f-9100-4e52-9c3a-650eb07b203a tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:42.902677 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5b77b05f-9100-4e52-9c3a-650eb07b203a tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:42.904150 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5b77b05f-9100-4e52-9c3a-650eb07b203a tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:43.003615 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5b77b05f-9100-4e52-9c3a-650eb07b203a tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] 10.222.0.33 "POST /compute/v2.1/servers/5a95bf94-24e7-43a2-9818-d5bf1b0315f1/action" status: 200 len: 32634 microversion: 2.1 time: 0.129560 Oct 04 21:03:43.010915 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2640/5299] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 21:03:42 2022] POST /compute/v2.1/servers/5a95bf94-24e7-43a2-9818-d5bf1b0315f1/action => generated 32634 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 21:03:43.175144 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0e6c2456-bdaf-4bf7-993d-9cf80f21069a tempest-TestNetworkAdvancedServerOps-2095277972 tempest-TestNetworkAdvancedServerOps-2095277972-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:03:43.176629 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-0e6c2456-bdaf-4bf7-993d-9cf80f21069a tempest-TestNetworkAdvancedServerOps-2095277972 tempest-TestNetworkAdvancedServerOps-2095277972-project-admin] [instance: 5a95bf94-24e7-43a2-9818-d5bf1b0315f1] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:03:43.205799 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0e6c2456-bdaf-4bf7-993d-9cf80f21069a tempest-TestNetworkAdvancedServerOps-2095277972 tempest-TestNetworkAdvancedServerOps-2095277972-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:43.209151 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0e6c2456-bdaf-4bf7-993d-9cf80f21069a tempest-TestNetworkAdvancedServerOps-2095277972 tempest-TestNetworkAdvancedServerOps-2095277972-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:43.210000 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0e6c2456-bdaf-4bf7-993d-9cf80f21069a tempest-TestNetworkAdvancedServerOps-2095277972 tempest-TestNetworkAdvancedServerOps-2095277972-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:43.215229 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0e6c2456-bdaf-4bf7-993d-9cf80f21069a tempest-TestNetworkAdvancedServerOps-2095277972 tempest-TestNetworkAdvancedServerOps-2095277972-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:43.216512 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0e6c2456-bdaf-4bf7-993d-9cf80f21069a tempest-TestNetworkAdvancedServerOps-2095277972 tempest-TestNetworkAdvancedServerOps-2095277972-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:43.218523 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0e6c2456-bdaf-4bf7-993d-9cf80f21069a tempest-TestNetworkAdvancedServerOps-2095277972 tempest-TestNetworkAdvancedServerOps-2095277972-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:43.416200 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-0e6c2456-bdaf-4bf7-993d-9cf80f21069a tempest-TestNetworkAdvancedServerOps-2095277972 tempest-TestNetworkAdvancedServerOps-2095277972-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '7d1811d0cd2a4e81bd89409b4a866b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0de0fd6794f74ca48fde53682ce8dde8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:03:43.416603 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-0e6c2456-bdaf-4bf7-993d-9cf80f21069a tempest-TestNetworkAdvancedServerOps-2095277972 tempest-TestNetworkAdvancedServerOps-2095277972-project-admin] [instance: 5a95bf94-24e7-43a2-9818-d5bf1b0315f1] flavor_id is None. Assuming migration. {{(pid=128801) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 04 21:03:43.417049 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-0e6c2456-bdaf-4bf7-993d-9cf80f21069a tempest-TestNetworkAdvancedServerOps-2095277972 tempest-TestNetworkAdvancedServerOps-2095277972-project-admin] [instance: 5a95bf94-24e7-43a2-9818-d5bf1b0315f1] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=128801) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 04 21:03:43.443993 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-ed498f4c-2f05-48b1-a365-d02ddac87aa1 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:03:43.475282 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-ed498f4c-2f05-48b1-a365-d02ddac87aa1 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:03:43.489856 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-ed498f4c-2f05-48b1-a365-d02ddac87aa1 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:03:43.492389 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-ed498f4c-2f05-48b1-a365-d02ddac87aa1 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] 10.222.0.33 "GET /compute/v2.1/servers/cc9ad5af-1587-4aa1-8323-a50c91bb1b84" status: 200 len: 1721 microversion: 2.20 time: 0.739645 Oct 04 21:03:43.507925 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2660/5300] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 21:03:42 2022] GET /compute/v2.1/servers/cc9ad5af-1587-4aa1-8323-a50c91bb1b84 => generated 1721 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:03:43.538139 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-6c2a2e9d-57ec-4a58-91cd-5bb99c055765 req-3b8db7cf-816a-44f1-966c-c4b2300cdb17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61bb9cf5-6da5-4074-9bb8-ffd1269ea50f", "name": "network-vif-deleted", "tag": "bcd2dd15-0ca7-47ca-9e2d-d0c557d550b4"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:03:43.570797 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-6c2a2e9d-57ec-4a58-91cd-5bb99c055765 req-3b8db7cf-816a-44f1-966c-c4b2300cdb17 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:43.575687 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-6c2a2e9d-57ec-4a58-91cd-5bb99c055765 req-3b8db7cf-816a-44f1-966c-c4b2300cdb17 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:43.577540 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-6c2a2e9d-57ec-4a58-91cd-5bb99c055765 req-3b8db7cf-816a-44f1-966c-c4b2300cdb17 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:43.607640 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-6c2a2e9d-57ec-4a58-91cd-5bb99c055765 req-3b8db7cf-816a-44f1-966c-c4b2300cdb17 service nova] Creating event network-vif-deleted:bcd2dd15-0ca7-47ca-9e2d-d0c557d550b4 for instance 61bb9cf5-6da5-4074-9bb8-ffd1269ea50f on n-h1-854823-8 Oct 04 21:03:43.623004 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-6c2a2e9d-57ec-4a58-91cd-5bb99c055765 req-3b8db7cf-816a-44f1-966c-c4b2300cdb17 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111552 Oct 04 21:03:43.625022 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2661/5301] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:03:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:03:43.896339 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-e9883e9f-b732-4a4f-b023-8717733987b7 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:03:43.897347 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-e9883e9f-b732-4a4f-b023-8717733987b7 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] [instance: 61bb9cf5-6da5-4074-9bb8-ffd1269ea50f] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:03:43.911198 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e9883e9f-b732-4a4f-b023-8717733987b7 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:43.923749 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e9883e9f-b732-4a4f-b023-8717733987b7 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:43.924335 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e9883e9f-b732-4a4f-b023-8717733987b7 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:43.927009 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e9883e9f-b732-4a4f-b023-8717733987b7 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:43.928663 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e9883e9f-b732-4a4f-b023-8717733987b7 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:43.935572 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e9883e9f-b732-4a4f-b023-8717733987b7 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:44.031254 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e9883e9f-b732-4a4f-b023-8717733987b7 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:44.032011 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e9883e9f-b732-4a4f-b023-8717733987b7 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:44.032689 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e9883e9f-b732-4a4f-b023-8717733987b7 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:44.034135 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.objects.instance [None req-e9883e9f-b732-4a4f-b023-8717733987b7 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Lazy-loading 'fault' on Instance uuid 61bb9cf5-6da5-4074-9bb8-ffd1269ea50f {{(pid=128802) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:03:44.127604 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-0e6c2456-bdaf-4bf7-993d-9cf80f21069a tempest-TestNetworkAdvancedServerOps-2095277972 tempest-TestNetworkAdvancedServerOps-2095277972-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/5a95bf94-24e7-43a2-9818-d5bf1b0315f1/action" status: 202 len: 0 microversion: 2.1 time: 0.957601 Oct 04 21:03:44.131124 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2641/5302] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 21:03:43 2022] POST /compute/v2.1/servers/5a95bf94-24e7-43a2-9818-d5bf1b0315f1/action => generated 0 bytes in 965 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:03:44.144166 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1ae27b75-b697-4999-a485-96feff48b24d tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:03:44.148382 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-1ae27b75-b697-4999-a485-96feff48b24d tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] [instance: 5a95bf94-24e7-43a2-9818-d5bf1b0315f1] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:03:44.176810 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1ae27b75-b697-4999-a485-96feff48b24d tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:44.177393 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1ae27b75-b697-4999-a485-96feff48b24d tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:44.177799 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1ae27b75-b697-4999-a485-96feff48b24d tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:44.182100 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1ae27b75-b697-4999-a485-96feff48b24d tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:44.184906 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1ae27b75-b697-4999-a485-96feff48b24d tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:44.188428 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1ae27b75-b697-4999-a485-96feff48b24d tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:44.260760 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-e9883e9f-b732-4a4f-b023-8717733987b7 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3403486e6f4afd8d97f97612110eb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be936dd2db2466990cafbfbfb3a15cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:03:44.274195 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-e9883e9f-b732-4a4f-b023-8717733987b7 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] 10.222.0.33 "GET /compute/v2.1/servers/61bb9cf5-6da5-4074-9bb8-ffd1269ea50f" status: 200 len: 1384 microversion: 2.1 time: 0.382472 Oct 04 21:03:44.277272 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2662/5303] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:03:43 2022] GET /compute/v2.1/servers/61bb9cf5-6da5-4074-9bb8-ffd1269ea50f => generated 1384 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:03:44.511067 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-1ae27b75-b697-4999-a485-96feff48b24d tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5dbe3da6a4af181ef7302fe605fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3aa23aee3c8435c8f1f409019c5fed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:03:44.529195 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-fb7860df-5dbf-4336-ad41-3b1650d7b5a1 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:03:44.530220 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-fb7860df-5dbf-4336-ad41-3b1650d7b5a1 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] [instance: cc9ad5af-1587-4aa1-8323-a50c91bb1b84] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:03:44.538541 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-1ae27b75-b697-4999-a485-96feff48b24d tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] 10.222.0.33 "GET /compute/v2.1/servers/5a95bf94-24e7-43a2-9818-d5bf1b0315f1" status: 200 len: 1691 microversion: 2.1 time: 0.403467 Oct 04 21:03:44.541537 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fb7860df-5dbf-4336-ad41-3b1650d7b5a1 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:44.562118 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2642/5304] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:03:44 2022] GET /compute/v2.1/servers/5a95bf94-24e7-43a2-9818-d5bf1b0315f1 => generated 1691 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:03:44.578256 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fb7860df-5dbf-4336-ad41-3b1650d7b5a1 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.029s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:44.584191 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fb7860df-5dbf-4336-ad41-3b1650d7b5a1 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:44.589615 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fb7860df-5dbf-4336-ad41-3b1650d7b5a1 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:44.594856 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fb7860df-5dbf-4336-ad41-3b1650d7b5a1 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:44.599196 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fb7860df-5dbf-4336-ad41-3b1650d7b5a1 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:45.304173 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-33489d5a-1f75-4af7-91e3-4d2c91b11edd tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:03:45.304996 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-33489d5a-1f75-4af7-91e3-4d2c91b11edd tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] [instance: 61bb9cf5-6da5-4074-9bb8-ffd1269ea50f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:03:45.321232 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-33489d5a-1f75-4af7-91e3-4d2c91b11edd tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:45.324024 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-33489d5a-1f75-4af7-91e3-4d2c91b11edd tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:45.327862 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-33489d5a-1f75-4af7-91e3-4d2c91b11edd tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:45.329023 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-33489d5a-1f75-4af7-91e3-4d2c91b11edd tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:45.331679 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-33489d5a-1f75-4af7-91e3-4d2c91b11edd tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:45.333645 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-33489d5a-1f75-4af7-91e3-4d2c91b11edd tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:45.382584 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-33489d5a-1f75-4af7-91e3-4d2c91b11edd tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] HTTP exception thrown: Instance 61bb9cf5-6da5-4074-9bb8-ffd1269ea50f could not be found. Oct 04 21:03:45.386613 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-33489d5a-1f75-4af7-91e3-4d2c91b11edd tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Request method failure captured: Oct 04 21:03:45.386613 n-d-854823-8 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/61bb9cf5-6da5-4074-9bb8-ffd1269ea50f HTTP/1.1 Oct 04 21:03:45.386613 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 21:03:45.386613 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 21:03:45.386613 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 21:03:45.386613 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 0 Oct 04 21:03:45.386613 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 21:03:45.386613 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 21:03:45.386613 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 21:03:45.386613 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 21:03:45.386613 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJ8BN-OrapfgqK2P6TzuwZOwR4aY1OQd3GseLPuZ0pobQHquQ9bjmRFBUWmXZigaqWIJjuUAtigWd6NSAKQ5jrwlSaoxmqq2RtBYd48SEh911BmGBYfy8qjC4a6c-wTbsiLfT4J21RiEjLJT-AW9RabwAHTvmd0RLMdOuS16-gVxClA Oct 04 21:03:45.386613 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 21:03:45.386613 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 21:03:45.386613 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 21:03:45.386613 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 21:03:45.386613 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 21:03:45.386613 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 21:03:45.386613 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: 8be936dd2db2466990cafbfbfb3a15cf Oct 04 21:03:45.386613 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-1824446933 Oct 04 21:03:45.386613 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 21:03:45.386613 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 21:03:45.386613 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_8be936dd2db2466990cafbfbfb3a15cf", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8be936dd2db2466990cafbfbfb3a15cf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8be936dd2db2466990cafbfbfb3a15cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/8be936dd2db2466990cafbfbfb3a15cf"}]}] Oct 04 21:03:45.386613 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-TestSecurityGroupsBasicOps-1824446933 Oct 04 21:03:45.386613 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: 8be936dd2db2466990cafbfbfb3a15cf Oct 04 21:03:45.386613 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-1824446933 Oct 04 21:03:45.386613 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-TestSecurityGroupsBasicOps-1824446933-project Oct 04 21:03:45.386613 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 21:03:45.386613 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 21:03:45.386613 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: 0f3403486e6f4afd8d97f97612110eb5 Oct 04 21:03:45.386613 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-TestSecurityGroupsBasicOps-1824446933-project Oct 04 21:03:45.386613 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 21:03:45.386613 n-d-854823-8 devstack@n-api.service[128801]: exception: Instance 61bb9cf5-6da5-4074-9bb8-ffd1269ea50f could not be found. Oct 04 21:03:45.386613 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': '61bb9cf5-6da5-4074-9bb8-ffd1269ea50f'} Oct 04 21:03:45.386613 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:03:45.386613 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:03:45.386613 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:03:45.386613 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:03:45.386613 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:03:45.386613 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:03:45.386613 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:03:45.386613 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:03:45.386613 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:03:45.386613 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:03:45.386613 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 61bb9cf5-6da5-4074-9bb8-ffd1269ea50f could not be found. Oct 04 21:03:45.386613 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:03:45.386613 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:03:45.386613 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:03:45.386613 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:03:45.386613 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:03:45.386613 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:03:45.386613 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:03:45.386613 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:03:45.386613 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:03:45.386613 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:03:45.386613 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:03:45.386613 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:03:45.386613 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:03:45.386613 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:03:45.386613 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:03:45.386613 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:03:45.386613 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 61bb9cf5-6da5-4074-9bb8-ffd1269ea50f could not be found. Oct 04 21:03:45.386613 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:03:45.386613 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:03:45.392022 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:03:45.392022 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:03:45.392022 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:03:45.392022 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:03:45.392022 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:03:45.392022 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:03:45.392022 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 61bb9cf5-6da5-4074-9bb8-ffd1269ea50f could not be found. Oct 04 21:03:45.392022 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:03:45.393906 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-33489d5a-1f75-4af7-91e3-4d2c91b11edd tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Returning 404 to user: Instance 61bb9cf5-6da5-4074-9bb8-ffd1269ea50f could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:03:45.395364 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-33489d5a-1f75-4af7-91e3-4d2c91b11edd tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] 10.222.0.33 "GET /compute/v2.1/servers/61bb9cf5-6da5-4074-9bb8-ffd1269ea50f" status: 404 len: 111 microversion: 2.1 time: 0.095328 Oct 04 21:03:45.396122 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2643/5305] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:03:45 2022] GET /compute/v2.1/servers/61bb9cf5-6da5-4074-9bb8-ffd1269ea50f => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:03:45.437098 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-fb7860df-5dbf-4336-ad41-3b1650d7b5a1 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:03:45.446781 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-fb7860df-5dbf-4336-ad41-3b1650d7b5a1 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:03:45.448252 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-fb7860df-5dbf-4336-ad41-3b1650d7b5a1 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:03:45.450829 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-fb7860df-5dbf-4336-ad41-3b1650d7b5a1 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] 10.222.0.33 "GET /compute/v2.1/servers/cc9ad5af-1587-4aa1-8323-a50c91bb1b84" status: 200 len: 1721 microversion: 2.20 time: 0.925848 Oct 04 21:03:45.463631 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2663/5306] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 21:03:44 2022] GET /compute/v2.1/servers/cc9ad5af-1587-4aa1-8323-a50c91bb1b84 => generated 1721 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:03:45.577186 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-26906993-3d50-4280-8d7b-f544133fb747 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:03:45.578098 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-26906993-3d50-4280-8d7b-f544133fb747 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] [instance: 5a95bf94-24e7-43a2-9818-d5bf1b0315f1] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:03:45.597195 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-26906993-3d50-4280-8d7b-f544133fb747 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:45.605077 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-26906993-3d50-4280-8d7b-f544133fb747 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:45.609218 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-26906993-3d50-4280-8d7b-f544133fb747 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:45.612249 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-26906993-3d50-4280-8d7b-f544133fb747 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:45.613401 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-26906993-3d50-4280-8d7b-f544133fb747 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:45.614253 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-26906993-3d50-4280-8d7b-f544133fb747 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:45.680366 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-87e0d89d-5ecc-4883-b798-f4a7666a1db0 req-8b7c9de4-c69e-46bc-88db-4678ff664ea3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc9ad5af-1587-4aa1-8323-a50c91bb1b84", "name": "network-vif-unplugged", "status": "completed", "tag": "1669c917-58c0-440d-8b0d-29a608119c96"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:03:45.703715 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-87e0d89d-5ecc-4883-b798-f4a7666a1db0 req-8b7c9de4-c69e-46bc-88db-4678ff664ea3 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:45.704140 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-87e0d89d-5ecc-4883-b798-f4a7666a1db0 req-8b7c9de4-c69e-46bc-88db-4678ff664ea3 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:45.709099 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-87e0d89d-5ecc-4883-b798-f4a7666a1db0 req-8b7c9de4-c69e-46bc-88db-4678ff664ea3 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:45.745612 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-87e0d89d-5ecc-4883-b798-f4a7666a1db0 req-8b7c9de4-c69e-46bc-88db-4678ff664ea3 service nova] Creating event network-vif-unplugged:1669c917-58c0-440d-8b0d-29a608119c96 for instance cc9ad5af-1587-4aa1-8323-a50c91bb1b84 on n-h1-854823-8 Oct 04 21:03:45.762030 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-87e0d89d-5ecc-4883-b798-f4a7666a1db0 req-8b7c9de4-c69e-46bc-88db-4678ff664ea3 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.080481 Oct 04 21:03:45.763948 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2664/5307] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:03:45 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:03:46.367503 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-26906993-3d50-4280-8d7b-f544133fb747 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5dbe3da6a4af181ef7302fe605fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3aa23aee3c8435c8f1f409019c5fed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:03:46.385032 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-26906993-3d50-4280-8d7b-f544133fb747 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] 10.222.0.33 "GET /compute/v2.1/servers/5a95bf94-24e7-43a2-9818-d5bf1b0315f1" status: 200 len: 1691 microversion: 2.1 time: 0.813823 Oct 04 21:03:46.406478 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2644/5308] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:03:45 2022] GET /compute/v2.1/servers/5a95bf94-24e7-43a2-9818-d5bf1b0315f1 => generated 1691 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:03:46.508184 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-2cf873ca-1484-4bb7-9ca8-a20c7acb54aa tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:03:46.512476 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-2cf873ca-1484-4bb7-9ca8-a20c7acb54aa tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] [instance: cc9ad5af-1587-4aa1-8323-a50c91bb1b84] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:03:46.521027 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2cf873ca-1484-4bb7-9ca8-a20c7acb54aa tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:46.521809 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2cf873ca-1484-4bb7-9ca8-a20c7acb54aa tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:46.522842 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2cf873ca-1484-4bb7-9ca8-a20c7acb54aa tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:46.524429 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2cf873ca-1484-4bb7-9ca8-a20c7acb54aa tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:46.525118 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2cf873ca-1484-4bb7-9ca8-a20c7acb54aa tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:46.533051 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2cf873ca-1484-4bb7-9ca8-a20c7acb54aa tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:47.147972 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-2cf873ca-1484-4bb7-9ca8-a20c7acb54aa tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:03:47.158398 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-2cf873ca-1484-4bb7-9ca8-a20c7acb54aa tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:03:47.168461 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-2cf873ca-1484-4bb7-9ca8-a20c7acb54aa tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:03:47.171325 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-2cf873ca-1484-4bb7-9ca8-a20c7acb54aa tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] 10.222.0.33 "GET /compute/v2.1/servers/cc9ad5af-1587-4aa1-8323-a50c91bb1b84" status: 200 len: 1721 microversion: 2.20 time: 0.674619 Oct 04 21:03:47.174426 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2665/5309] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 21:03:46 2022] GET /compute/v2.1/servers/cc9ad5af-1587-4aa1-8323-a50c91bb1b84 => generated 1721 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:03:47.421814 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-55e98546-40ca-4758-a688-3dc1933ad39f tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:03:47.422572 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-55e98546-40ca-4758-a688-3dc1933ad39f tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] [instance: 5a95bf94-24e7-43a2-9818-d5bf1b0315f1] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:03:47.436511 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-55e98546-40ca-4758-a688-3dc1933ad39f tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:47.437587 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-55e98546-40ca-4758-a688-3dc1933ad39f tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:47.438250 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-55e98546-40ca-4758-a688-3dc1933ad39f tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:47.439547 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-55e98546-40ca-4758-a688-3dc1933ad39f tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:47.440242 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-55e98546-40ca-4758-a688-3dc1933ad39f tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:47.440932 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-55e98546-40ca-4758-a688-3dc1933ad39f tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:47.968839 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-55e98546-40ca-4758-a688-3dc1933ad39f tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5dbe3da6a4af181ef7302fe605fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3aa23aee3c8435c8f1f409019c5fed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:03:47.985454 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-55e98546-40ca-4758-a688-3dc1933ad39f tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] 10.222.0.33 "GET /compute/v2.1/servers/5a95bf94-24e7-43a2-9818-d5bf1b0315f1" status: 200 len: 1691 microversion: 2.1 time: 0.568089 Oct 04 21:03:47.990024 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2645/5310] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:03:47 2022] GET /compute/v2.1/servers/5a95bf94-24e7-43a2-9818-d5bf1b0315f1 => generated 1691 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:03:48.207957 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-7885c6d5-9bce-4789-af26-5f26c5c3af0f tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:03:48.209271 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-7885c6d5-9bce-4789-af26-5f26c5c3af0f tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] [instance: cc9ad5af-1587-4aa1-8323-a50c91bb1b84] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:03:48.226504 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7885c6d5-9bce-4789-af26-5f26c5c3af0f tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:48.230269 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7885c6d5-9bce-4789-af26-5f26c5c3af0f tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:48.230976 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7885c6d5-9bce-4789-af26-5f26c5c3af0f tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:48.232390 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7885c6d5-9bce-4789-af26-5f26c5c3af0f tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:48.232862 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7885c6d5-9bce-4789-af26-5f26c5c3af0f tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:48.233296 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7885c6d5-9bce-4789-af26-5f26c5c3af0f tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:49.010060 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-191f8d4f-b166-405f-b64a-9ea33a5f295c tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:03:49.012021 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-191f8d4f-b166-405f-b64a-9ea33a5f295c tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] [instance: 5a95bf94-24e7-43a2-9818-d5bf1b0315f1] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:03:49.025241 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-191f8d4f-b166-405f-b64a-9ea33a5f295c tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:49.025964 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-191f8d4f-b166-405f-b64a-9ea33a5f295c tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:49.026921 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-191f8d4f-b166-405f-b64a-9ea33a5f295c tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:49.027913 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-191f8d4f-b166-405f-b64a-9ea33a5f295c tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:49.029607 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-191f8d4f-b166-405f-b64a-9ea33a5f295c tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:49.030301 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-191f8d4f-b166-405f-b64a-9ea33a5f295c tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:49.056287 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:03:49.193111 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-7885c6d5-9bce-4789-af26-5f26c5c3af0f tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:03:49.203264 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-7885c6d5-9bce-4789-af26-5f26c5c3af0f tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:03:49.204728 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-7885c6d5-9bce-4789-af26-5f26c5c3af0f tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:03:49.206060 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-7885c6d5-9bce-4789-af26-5f26c5c3af0f tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] 10.222.0.33 "GET /compute/v2.1/servers/cc9ad5af-1587-4aa1-8323-a50c91bb1b84" status: 200 len: 1664 microversion: 2.20 time: 1.006596 Oct 04 21:03:49.207034 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2666/5311] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 21:03:48 2022] GET /compute/v2.1/servers/cc9ad5af-1587-4aa1-8323-a50c91bb1b84 => generated 1664 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:03:49.249092 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-c9ec6ed5-a36a-4989-a206-e4b4a5ecb324 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "160a21a1-3aa8-4e04-85c8-43da098aa084"}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:03:49.259943 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-c9ec6ed5-a36a-4989-a206-e4b4a5ecb324 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] [instance: cc9ad5af-1587-4aa1-8323-a50c91bb1b84] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:03:49.273719 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c9ec6ed5-a36a-4989-a206-e4b4a5ecb324 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:49.274218 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c9ec6ed5-a36a-4989-a206-e4b4a5ecb324 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:49.280534 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c9ec6ed5-a36a-4989-a206-e4b4a5ecb324 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:49.282373 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c9ec6ed5-a36a-4989-a206-e4b4a5ecb324 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:49.282894 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c9ec6ed5-a36a-4989-a206-e4b4a5ecb324 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:49.283343 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c9ec6ed5-a36a-4989-a206-e4b4a5ecb324 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:49.834644 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:03:49.898865 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-c9ec6ed5-a36a-4989-a206-e4b4a5ecb324 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] 10.222.0.33 "POST /compute/v2.1/servers/cc9ad5af-1587-4aa1-8323-a50c91bb1b84/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.666288 Oct 04 21:03:49.899910 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2667/5312] 10.222.0.33 () {62 vars in 1364 bytes} [Tue Oct 4 21:03:49 2022] POST /compute/v2.1/servers/cc9ad5af-1587-4aa1-8323-a50c91bb1b84/os-volume_attachments => generated 188 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 04 21:03:50.070078 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-191f8d4f-b166-405f-b64a-9ea33a5f295c tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5dbe3da6a4af181ef7302fe605fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3aa23aee3c8435c8f1f409019c5fed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:03:50.083521 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-191f8d4f-b166-405f-b64a-9ea33a5f295c tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] 10.222.0.33 "GET /compute/v2.1/servers/5a95bf94-24e7-43a2-9818-d5bf1b0315f1" status: 200 len: 1691 microversion: 2.1 time: 1.077610 Oct 04 21:03:50.084086 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2646/5313] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:03:49 2022] GET /compute/v2.1/servers/5a95bf94-24e7-43a2-9818-d5bf1b0315f1 => generated 1691 bytes in 1079 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:03:50.148929 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-0f39d9db-5fd2-4100-b440-7e6c223806a0 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:03:50.149539 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-0f39d9db-5fd2-4100-b440-7e6c223806a0 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] [instance: cc9ad5af-1587-4aa1-8323-a50c91bb1b84] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:03:50.180384 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0f39d9db-5fd2-4100-b440-7e6c223806a0 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:50.180894 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0f39d9db-5fd2-4100-b440-7e6c223806a0 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:50.181337 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0f39d9db-5fd2-4100-b440-7e6c223806a0 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:50.182065 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0f39d9db-5fd2-4100-b440-7e6c223806a0 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:50.182847 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0f39d9db-5fd2-4100-b440-7e6c223806a0 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:50.183447 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0f39d9db-5fd2-4100-b440-7e6c223806a0 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:50.329274 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-0f39d9db-5fd2-4100-b440-7e6c223806a0 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] [instance: cc9ad5af-1587-4aa1-8323-a50c91bb1b84] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=128802) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 04 21:03:50.487932 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-0f39d9db-5fd2-4100-b440-7e6c223806a0 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] 10.222.0.33 "POST /compute/v2.1/servers/cc9ad5af-1587-4aa1-8323-a50c91bb1b84/action" status: 202 len: 0 microversion: 2.20 time: 0.347292 Oct 04 21:03:50.489445 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2668/5314] 10.222.0.33 () {62 vars in 1319 bytes} [Tue Oct 4 21:03:50 2022] POST /compute/v2.1/servers/cc9ad5af-1587-4aa1-8323-a50c91bb1b84/action => generated 0 bytes in 349 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:03:50.500459 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-91abc007-1f3a-4f9a-b8f7-5ea87b74d364 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:03:50.501324 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-91abc007-1f3a-4f9a-b8f7-5ea87b74d364 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] [instance: cc9ad5af-1587-4aa1-8323-a50c91bb1b84] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:03:50.515521 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-91abc007-1f3a-4f9a-b8f7-5ea87b74d364 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:50.516351 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-91abc007-1f3a-4f9a-b8f7-5ea87b74d364 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:50.516958 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-91abc007-1f3a-4f9a-b8f7-5ea87b74d364 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:50.518295 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-91abc007-1f3a-4f9a-b8f7-5ea87b74d364 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:50.520093 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-91abc007-1f3a-4f9a-b8f7-5ea87b74d364 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:50.521008 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-91abc007-1f3a-4f9a-b8f7-5ea87b74d364 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:51.115929 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-9eb17ae0-fafb-4d68-9155-a01421f3bbfc tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:03:51.117559 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-9eb17ae0-fafb-4d68-9155-a01421f3bbfc tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] [instance: 5a95bf94-24e7-43a2-9818-d5bf1b0315f1] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:03:51.132799 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9eb17ae0-fafb-4d68-9155-a01421f3bbfc tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:51.141977 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9eb17ae0-fafb-4d68-9155-a01421f3bbfc tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:51.144052 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9eb17ae0-fafb-4d68-9155-a01421f3bbfc tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:51.144980 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9eb17ae0-fafb-4d68-9155-a01421f3bbfc tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:51.147988 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9eb17ae0-fafb-4d68-9155-a01421f3bbfc tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:51.148601 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9eb17ae0-fafb-4d68-9155-a01421f3bbfc tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:51.561078 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-91abc007-1f3a-4f9a-b8f7-5ea87b74d364 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:03:51.578779 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-91abc007-1f3a-4f9a-b8f7-5ea87b74d364 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:03:51.580284 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-91abc007-1f3a-4f9a-b8f7-5ea87b74d364 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:03:51.581471 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-91abc007-1f3a-4f9a-b8f7-5ea87b74d364 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] 10.222.0.33 "GET /compute/v2.1/servers/cc9ad5af-1587-4aa1-8323-a50c91bb1b84" status: 200 len: 1750 microversion: 2.20 time: 1.087327 Oct 04 21:03:51.584170 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2647/5315] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 21:03:50 2022] GET /compute/v2.1/servers/cc9ad5af-1587-4aa1-8323-a50c91bb1b84 => generated 1750 bytes in 1091 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:03:51.919276 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-9eb17ae0-fafb-4d68-9155-a01421f3bbfc tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5dbe3da6a4af181ef7302fe605fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3aa23aee3c8435c8f1f409019c5fed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:03:51.936321 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-9eb17ae0-fafb-4d68-9155-a01421f3bbfc tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] 10.222.0.33 "GET /compute/v2.1/servers/5a95bf94-24e7-43a2-9818-d5bf1b0315f1" status: 200 len: 1696 microversion: 2.1 time: 0.819374 Oct 04 21:03:51.939100 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2669/5316] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:03:51 2022] GET /compute/v2.1/servers/5a95bf94-24e7-43a2-9818-d5bf1b0315f1 => generated 1696 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:03:52.620838 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9eb052ff-c7ed-4560-9585-6b05508b5c74 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:03:52.621554 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-9eb052ff-c7ed-4560-9585-6b05508b5c74 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] [instance: cc9ad5af-1587-4aa1-8323-a50c91bb1b84] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:03:52.640690 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9eb052ff-c7ed-4560-9585-6b05508b5c74 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:52.641140 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9eb052ff-c7ed-4560-9585-6b05508b5c74 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:52.641779 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9eb052ff-c7ed-4560-9585-6b05508b5c74 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:52.642907 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9eb052ff-c7ed-4560-9585-6b05508b5c74 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:52.643540 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9eb052ff-c7ed-4560-9585-6b05508b5c74 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:52.644145 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9eb052ff-c7ed-4560-9585-6b05508b5c74 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:52.965300 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-b2a43773-efa0-42e9-8269-27ba6ee72451 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:03:52.966527 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-b2a43773-efa0-42e9-8269-27ba6ee72451 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] [instance: 5a95bf94-24e7-43a2-9818-d5bf1b0315f1] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:03:52.982665 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b2a43773-efa0-42e9-8269-27ba6ee72451 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:52.983159 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b2a43773-efa0-42e9-8269-27ba6ee72451 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:52.983591 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b2a43773-efa0-42e9-8269-27ba6ee72451 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:52.989877 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b2a43773-efa0-42e9-8269-27ba6ee72451 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:52.990796 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b2a43773-efa0-42e9-8269-27ba6ee72451 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:52.991447 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b2a43773-efa0-42e9-8269-27ba6ee72451 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:53.682611 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-9eb052ff-c7ed-4560-9585-6b05508b5c74 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:03:53.707031 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-9eb052ff-c7ed-4560-9585-6b05508b5c74 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:03:53.713707 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-9eb052ff-c7ed-4560-9585-6b05508b5c74 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:03:53.719443 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-9eb052ff-c7ed-4560-9585-6b05508b5c74 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] 10.222.0.33 "GET /compute/v2.1/servers/cc9ad5af-1587-4aa1-8323-a50c91bb1b84" status: 200 len: 1752 microversion: 2.20 time: 1.104187 Oct 04 21:03:53.723876 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2648/5317] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 21:03:52 2022] GET /compute/v2.1/servers/cc9ad5af-1587-4aa1-8323-a50c91bb1b84 => generated 1752 bytes in 1111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:03:53.941450 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-b2a43773-efa0-42e9-8269-27ba6ee72451 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5dbe3da6a4af181ef7302fe605fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3aa23aee3c8435c8f1f409019c5fed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:03:53.961318 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-b2a43773-efa0-42e9-8269-27ba6ee72451 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] 10.222.0.33 "GET /compute/v2.1/servers/5a95bf94-24e7-43a2-9818-d5bf1b0315f1" status: 200 len: 1696 microversion: 2.1 time: 0.999964 Oct 04 21:03:53.966356 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2670/5318] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:03:52 2022] GET /compute/v2.1/servers/5a95bf94-24e7-43a2-9818-d5bf1b0315f1 => generated 1696 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:03:54.751977 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f67132a7-f112-449a-a5af-123488d37c28 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:03:54.752589 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f67132a7-f112-449a-a5af-123488d37c28 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] [instance: cc9ad5af-1587-4aa1-8323-a50c91bb1b84] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:03:54.764743 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f67132a7-f112-449a-a5af-123488d37c28 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:54.767505 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f67132a7-f112-449a-a5af-123488d37c28 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:54.768230 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f67132a7-f112-449a-a5af-123488d37c28 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:54.769114 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f67132a7-f112-449a-a5af-123488d37c28 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:54.769766 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f67132a7-f112-449a-a5af-123488d37c28 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:54.774369 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f67132a7-f112-449a-a5af-123488d37c28 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:54.994981 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-b79561d1-30b4-4ddf-af43-6410a336cf60 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:03:54.995642 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-b79561d1-30b4-4ddf-af43-6410a336cf60 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] [instance: 5a95bf94-24e7-43a2-9818-d5bf1b0315f1] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:03:55.009692 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b79561d1-30b4-4ddf-af43-6410a336cf60 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:55.010186 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b79561d1-30b4-4ddf-af43-6410a336cf60 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:55.015332 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b79561d1-30b4-4ddf-af43-6410a336cf60 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:55.028255 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b79561d1-30b4-4ddf-af43-6410a336cf60 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:55.028255 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b79561d1-30b4-4ddf-af43-6410a336cf60 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:55.028593 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b79561d1-30b4-4ddf-af43-6410a336cf60 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:55.742153 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-b79561d1-30b4-4ddf-af43-6410a336cf60 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5dbe3da6a4af181ef7302fe605fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3aa23aee3c8435c8f1f409019c5fed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:03:55.751840 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-b79561d1-30b4-4ddf-af43-6410a336cf60 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] 10.222.0.33 "GET /compute/v2.1/servers/5a95bf94-24e7-43a2-9818-d5bf1b0315f1" status: 200 len: 1696 microversion: 2.1 time: 0.761221 Oct 04 21:03:55.754636 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2671/5319] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:03:54 2022] GET /compute/v2.1/servers/5a95bf94-24e7-43a2-9818-d5bf1b0315f1 => generated 1696 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:03:55.766737 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f67132a7-f112-449a-a5af-123488d37c28 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:03:55.791746 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f67132a7-f112-449a-a5af-123488d37c28 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:03:55.796296 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f67132a7-f112-449a-a5af-123488d37c28 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:03:55.797741 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f67132a7-f112-449a-a5af-123488d37c28 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] 10.222.0.33 "GET /compute/v2.1/servers/cc9ad5af-1587-4aa1-8323-a50c91bb1b84" status: 200 len: 1752 microversion: 2.20 time: 1.051105 Oct 04 21:03:55.800535 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2649/5320] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 21:03:54 2022] GET /compute/v2.1/servers/cc9ad5af-1587-4aa1-8323-a50c91bb1b84 => generated 1752 bytes in 1055 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:03:56.830998 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2ef244ab-b245-46c5-9486-89a7b77d62a3 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:03:56.831748 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-2ef244ab-b245-46c5-9486-89a7b77d62a3 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] [instance: cc9ad5af-1587-4aa1-8323-a50c91bb1b84] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:03:56.847014 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2ef244ab-b245-46c5-9486-89a7b77d62a3 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:56.854434 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2ef244ab-b245-46c5-9486-89a7b77d62a3 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:56.855360 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2ef244ab-b245-46c5-9486-89a7b77d62a3 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:56.860306 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2ef244ab-b245-46c5-9486-89a7b77d62a3 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:56.860948 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2ef244ab-b245-46c5-9486-89a7b77d62a3 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:56.862213 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2ef244ab-b245-46c5-9486-89a7b77d62a3 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:57.348742 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-0eb6995e-352d-444c-938d-9047a364e6b9 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:03:57.349371 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-0eb6995e-352d-444c-938d-9047a364e6b9 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] [instance: 5a95bf94-24e7-43a2-9818-d5bf1b0315f1] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:03:57.369860 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0eb6995e-352d-444c-938d-9047a364e6b9 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:57.372841 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0eb6995e-352d-444c-938d-9047a364e6b9 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:57.373520 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0eb6995e-352d-444c-938d-9047a364e6b9 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:57.376054 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0eb6995e-352d-444c-938d-9047a364e6b9 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:57.378970 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0eb6995e-352d-444c-938d-9047a364e6b9 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:57.379619 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0eb6995e-352d-444c-938d-9047a364e6b9 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:57.690707 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-2ef244ab-b245-46c5-9486-89a7b77d62a3 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:03:57.701228 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-2ef244ab-b245-46c5-9486-89a7b77d62a3 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:03:57.712313 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-2ef244ab-b245-46c5-9486-89a7b77d62a3 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:03:57.713823 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-2ef244ab-b245-46c5-9486-89a7b77d62a3 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] 10.222.0.33 "GET /compute/v2.1/servers/cc9ad5af-1587-4aa1-8323-a50c91bb1b84" status: 200 len: 1752 microversion: 2.20 time: 0.887001 Oct 04 21:03:57.714771 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2650/5321] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 21:03:56 2022] GET /compute/v2.1/servers/cc9ad5af-1587-4aa1-8323-a50c91bb1b84 => generated 1752 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:03:57.993243 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-0eb6995e-352d-444c-938d-9047a364e6b9 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5dbe3da6a4af181ef7302fe605fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3aa23aee3c8435c8f1f409019c5fed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:03:58.009579 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-0eb6995e-352d-444c-938d-9047a364e6b9 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] 10.222.0.33 "GET /compute/v2.1/servers/5a95bf94-24e7-43a2-9818-d5bf1b0315f1" status: 200 len: 1696 microversion: 2.1 time: 1.236184 Oct 04 21:03:58.022985 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2672/5322] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:03:56 2022] GET /compute/v2.1/servers/5a95bf94-24e7-43a2-9818-d5bf1b0315f1 => generated 1696 bytes in 1238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:03:58.749369 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c3419ccc-21bf-46c0-a58e-31db9056e6d2 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:03:58.751185 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c3419ccc-21bf-46c0-a58e-31db9056e6d2 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] [instance: cc9ad5af-1587-4aa1-8323-a50c91bb1b84] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:03:58.768654 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c3419ccc-21bf-46c0-a58e-31db9056e6d2 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:58.769378 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c3419ccc-21bf-46c0-a58e-31db9056e6d2 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:58.770047 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c3419ccc-21bf-46c0-a58e-31db9056e6d2 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:58.771026 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c3419ccc-21bf-46c0-a58e-31db9056e6d2 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:58.771812 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c3419ccc-21bf-46c0-a58e-31db9056e6d2 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:58.772427 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c3419ccc-21bf-46c0-a58e-31db9056e6d2 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:59.048481 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-c84163be-2d15-4d0c-a816-46f63bf62bd5 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:03:59.051021 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-c84163be-2d15-4d0c-a816-46f63bf62bd5 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] [instance: 5a95bf94-24e7-43a2-9818-d5bf1b0315f1] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:03:59.081874 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c84163be-2d15-4d0c-a816-46f63bf62bd5 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:59.082433 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c84163be-2d15-4d0c-a816-46f63bf62bd5 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:59.086477 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c84163be-2d15-4d0c-a816-46f63bf62bd5 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:59.090294 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c84163be-2d15-4d0c-a816-46f63bf62bd5 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:03:59.090945 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c84163be-2d15-4d0c-a816-46f63bf62bd5 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:03:59.092283 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c84163be-2d15-4d0c-a816-46f63bf62bd5 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:03:59.593992 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c3419ccc-21bf-46c0-a58e-31db9056e6d2 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:03:59.603111 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c3419ccc-21bf-46c0-a58e-31db9056e6d2 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:03:59.610856 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c3419ccc-21bf-46c0-a58e-31db9056e6d2 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:03:59.616423 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c3419ccc-21bf-46c0-a58e-31db9056e6d2 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] 10.222.0.33 "GET /compute/v2.1/servers/cc9ad5af-1587-4aa1-8323-a50c91bb1b84" status: 200 len: 1752 microversion: 2.20 time: 0.871732 Oct 04 21:03:59.634808 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2651/5323] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 21:03:58 2022] GET /compute/v2.1/servers/cc9ad5af-1587-4aa1-8323-a50c91bb1b84 => generated 1752 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:03:59.645577 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6e0377ce-8bdf-4de9-ad4c-7d46ede46f94 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] Calling method '.version_select at 0x7f3c6ef56c10>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:03:59.689376 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-6e0377ce-8bdf-4de9-ad4c-7d46ede46f94 tempest-TestSecurityGroupsBasicOps-1824446933 tempest-TestSecurityGroupsBasicOps-1824446933-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-1879853288" status: 202 len: 0 microversion: 2.1 time: 0.053333 Oct 04 21:03:59.690357 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2652/5324] 10.222.0.33 () {58 vars in 1278 bytes} [Tue Oct 4 21:03:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-1879853288 => generated 0 bytes in 55 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:03:59.734384 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-c84163be-2d15-4d0c-a816-46f63bf62bd5 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5dbe3da6a4af181ef7302fe605fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3aa23aee3c8435c8f1f409019c5fed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:03:59.743846 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-c84163be-2d15-4d0c-a816-46f63bf62bd5 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] 10.222.0.33 "GET /compute/v2.1/servers/5a95bf94-24e7-43a2-9818-d5bf1b0315f1" status: 200 len: 1696 microversion: 2.1 time: 0.710176 Oct 04 21:03:59.751446 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2673/5325] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:03:59 2022] GET /compute/v2.1/servers/5a95bf94-24e7-43a2-9818-d5bf1b0315f1 => generated 1696 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:04:00.649087 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-cc2f72f0-98a4-4452-9b77-b065b2fbd3d7 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:04:00.649701 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-cc2f72f0-98a4-4452-9b77-b065b2fbd3d7 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] [instance: cc9ad5af-1587-4aa1-8323-a50c91bb1b84] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:04:00.662256 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cc2f72f0-98a4-4452-9b77-b065b2fbd3d7 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:00.662791 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cc2f72f0-98a4-4452-9b77-b065b2fbd3d7 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:00.663232 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cc2f72f0-98a4-4452-9b77-b065b2fbd3d7 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:00.664029 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cc2f72f0-98a4-4452-9b77-b065b2fbd3d7 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:00.664390 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cc2f72f0-98a4-4452-9b77-b065b2fbd3d7 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:00.664819 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cc2f72f0-98a4-4452-9b77-b065b2fbd3d7 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:00.795818 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-b419b498-cee2-492e-9fff-dc28fe417550 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:04:00.797936 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-b419b498-cee2-492e-9fff-dc28fe417550 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] [instance: 5a95bf94-24e7-43a2-9818-d5bf1b0315f1] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:04:00.824208 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b419b498-cee2-492e-9fff-dc28fe417550 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:00.825616 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b419b498-cee2-492e-9fff-dc28fe417550 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:00.826257 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b419b498-cee2-492e-9fff-dc28fe417550 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:00.827166 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b419b498-cee2-492e-9fff-dc28fe417550 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:00.832142 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b419b498-cee2-492e-9fff-dc28fe417550 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:00.833408 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b419b498-cee2-492e-9fff-dc28fe417550 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:01.420359 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-cc2f72f0-98a4-4452-9b77-b065b2fbd3d7 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:04:01.432250 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-cc2f72f0-98a4-4452-9b77-b065b2fbd3d7 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:04:01.437191 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-cc2f72f0-98a4-4452-9b77-b065b2fbd3d7 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:04:01.446708 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-cc2f72f0-98a4-4452-9b77-b065b2fbd3d7 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] 10.222.0.33 "GET /compute/v2.1/servers/cc9ad5af-1587-4aa1-8323-a50c91bb1b84" status: 200 len: 1752 microversion: 2.20 time: 0.801153 Oct 04 21:04:01.447536 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2653/5326] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 21:04:00 2022] GET /compute/v2.1/servers/cc9ad5af-1587-4aa1-8323-a50c91bb1b84 => generated 1752 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:04:02.269881 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-b419b498-cee2-492e-9fff-dc28fe417550 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5dbe3da6a4af181ef7302fe605fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3aa23aee3c8435c8f1f409019c5fed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:04:02.294799 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-b419b498-cee2-492e-9fff-dc28fe417550 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] 10.222.0.33 "GET /compute/v2.1/servers/5a95bf94-24e7-43a2-9818-d5bf1b0315f1" status: 200 len: 1696 microversion: 2.1 time: 1.519107 Oct 04 21:04:02.295520 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2674/5327] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:04:00 2022] GET /compute/v2.1/servers/5a95bf94-24e7-43a2-9818-d5bf1b0315f1 => generated 1696 bytes in 1521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:04:02.476400 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5fd5ba20-1704-4a82-8d91-4efd1ee2fc6c tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:04:02.477880 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-5fd5ba20-1704-4a82-8d91-4efd1ee2fc6c tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] [instance: cc9ad5af-1587-4aa1-8323-a50c91bb1b84] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:04:02.491943 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5fd5ba20-1704-4a82-8d91-4efd1ee2fc6c tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:02.492788 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5fd5ba20-1704-4a82-8d91-4efd1ee2fc6c tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:02.493392 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5fd5ba20-1704-4a82-8d91-4efd1ee2fc6c tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:02.494191 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5fd5ba20-1704-4a82-8d91-4efd1ee2fc6c tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:02.494763 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5fd5ba20-1704-4a82-8d91-4efd1ee2fc6c tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:02.495428 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5fd5ba20-1704-4a82-8d91-4efd1ee2fc6c tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:03.319565 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-a4ba8639-63b4-4a65-8243-1e9964c0f14d tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:04:03.320180 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-a4ba8639-63b4-4a65-8243-1e9964c0f14d tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] [instance: 5a95bf94-24e7-43a2-9818-d5bf1b0315f1] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:04:03.334314 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a4ba8639-63b4-4a65-8243-1e9964c0f14d tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:03.334853 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a4ba8639-63b4-4a65-8243-1e9964c0f14d tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:03.335288 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a4ba8639-63b4-4a65-8243-1e9964c0f14d tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:03.336002 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a4ba8639-63b4-4a65-8243-1e9964c0f14d tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:03.336454 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a4ba8639-63b4-4a65-8243-1e9964c0f14d tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:03.336880 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a4ba8639-63b4-4a65-8243-1e9964c0f14d tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:03.998606 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-5fd5ba20-1704-4a82-8d91-4efd1ee2fc6c tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:04:04.018210 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-5fd5ba20-1704-4a82-8d91-4efd1ee2fc6c tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:04:04.020068 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-5fd5ba20-1704-4a82-8d91-4efd1ee2fc6c tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:04:04.021594 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5fd5ba20-1704-4a82-8d91-4efd1ee2fc6c tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] 10.222.0.33 "GET /compute/v2.1/servers/cc9ad5af-1587-4aa1-8323-a50c91bb1b84" status: 200 len: 1808 microversion: 2.20 time: 1.549016 Oct 04 21:04:04.023696 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2654/5328] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 21:04:02 2022] GET /compute/v2.1/servers/cc9ad5af-1587-4aa1-8323-a50c91bb1b84 => generated 1808 bytes in 1552 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:04:04.261473 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-a4ba8639-63b4-4a65-8243-1e9964c0f14d tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5dbe3da6a4af181ef7302fe605fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3aa23aee3c8435c8f1f409019c5fed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:04:04.271067 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-a4ba8639-63b4-4a65-8243-1e9964c0f14d tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] 10.222.0.33 "GET /compute/v2.1/servers/5a95bf94-24e7-43a2-9818-d5bf1b0315f1" status: 200 len: 1696 microversion: 2.1 time: 0.955442 Oct 04 21:04:04.271668 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2675/5329] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:04:03 2022] GET /compute/v2.1/servers/5a95bf94-24e7-43a2-9818-d5bf1b0315f1 => generated 1696 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:04:05.052369 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-3169fc19-f1ba-43e7-bc49-ce3464d60e63 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:04:05.053194 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-3169fc19-f1ba-43e7-bc49-ce3464d60e63 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] [instance: cc9ad5af-1587-4aa1-8323-a50c91bb1b84] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:04:05.087947 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3169fc19-f1ba-43e7-bc49-ce3464d60e63 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:05.095578 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3169fc19-f1ba-43e7-bc49-ce3464d60e63 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:05.097233 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3169fc19-f1ba-43e7-bc49-ce3464d60e63 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:05.103790 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3169fc19-f1ba-43e7-bc49-ce3464d60e63 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:05.104544 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3169fc19-f1ba-43e7-bc49-ce3464d60e63 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:05.105047 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3169fc19-f1ba-43e7-bc49-ce3464d60e63 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:05.302407 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-9af08a9e-b5a0-424e-bcb1-975686da390a tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:04:05.303757 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-9af08a9e-b5a0-424e-bcb1-975686da390a tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] [instance: 5a95bf94-24e7-43a2-9818-d5bf1b0315f1] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:04:05.313007 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:04:05.315451 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9af08a9e-b5a0-424e-bcb1-975686da390a tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:05.316205 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9af08a9e-b5a0-424e-bcb1-975686da390a tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:05.316819 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9af08a9e-b5a0-424e-bcb1-975686da390a tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:05.319566 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9af08a9e-b5a0-424e-bcb1-975686da390a tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:05.320441 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9af08a9e-b5a0-424e-bcb1-975686da390a tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:05.321241 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9af08a9e-b5a0-424e-bcb1-975686da390a tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:05.912848 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-3169fc19-f1ba-43e7-bc49-ce3464d60e63 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:04:05.919092 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-9af08a9e-b5a0-424e-bcb1-975686da390a tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5dbe3da6a4af181ef7302fe605fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3aa23aee3c8435c8f1f409019c5fed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:04:05.930102 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-9af08a9e-b5a0-424e-bcb1-975686da390a tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] 10.222.0.33 "GET /compute/v2.1/servers/5a95bf94-24e7-43a2-9818-d5bf1b0315f1" status: 200 len: 1696 microversion: 2.1 time: 0.633414 Oct 04 21:04:05.933114 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-3169fc19-f1ba-43e7-bc49-ce3464d60e63 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:04:05.943806 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2676/5330] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:04:05 2022] GET /compute/v2.1/servers/5a95bf94-24e7-43a2-9818-d5bf1b0315f1 => generated 1696 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:04:05.945895 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-3169fc19-f1ba-43e7-bc49-ce3464d60e63 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:04:05.947519 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-3169fc19-f1ba-43e7-bc49-ce3464d60e63 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] 10.222.0.33 "GET /compute/v2.1/servers/cc9ad5af-1587-4aa1-8323-a50c91bb1b84" status: 200 len: 1808 microversion: 2.20 time: 0.899762 Oct 04 21:04:05.949155 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2655/5331] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 21:04:05 2022] GET /compute/v2.1/servers/cc9ad5af-1587-4aa1-8323-a50c91bb1b84 => generated 1808 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:04:06.962555 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-62222244-5e49-4871-a3d7-23f06b34abc6 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:04:06.966386 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-62222244-5e49-4871-a3d7-23f06b34abc6 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] [instance: 5a95bf94-24e7-43a2-9818-d5bf1b0315f1] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:04:06.974086 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5d773dbf-48f0-4bf1-901a-13d98b7e9708 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:04:06.975371 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-5d773dbf-48f0-4bf1-901a-13d98b7e9708 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] [instance: cc9ad5af-1587-4aa1-8323-a50c91bb1b84] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:04:06.985526 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-62222244-5e49-4871-a3d7-23f06b34abc6 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:06.986399 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:04:06.989508 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-62222244-5e49-4871-a3d7-23f06b34abc6 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:06.990328 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5d773dbf-48f0-4bf1-901a-13d98b7e9708 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:06.991061 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-62222244-5e49-4871-a3d7-23f06b34abc6 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:06.993308 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5d773dbf-48f0-4bf1-901a-13d98b7e9708 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:06.994440 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5d773dbf-48f0-4bf1-901a-13d98b7e9708 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:06.995438 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5d773dbf-48f0-4bf1-901a-13d98b7e9708 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:06.997395 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-62222244-5e49-4871-a3d7-23f06b34abc6 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:06.998392 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5d773dbf-48f0-4bf1-901a-13d98b7e9708 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:06.999234 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5d773dbf-48f0-4bf1-901a-13d98b7e9708 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:06.999560 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-62222244-5e49-4871-a3d7-23f06b34abc6 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:07.000104 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-62222244-5e49-4871-a3d7-23f06b34abc6 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:08.221173 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-5d773dbf-48f0-4bf1-901a-13d98b7e9708 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:04:08.243750 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-5d773dbf-48f0-4bf1-901a-13d98b7e9708 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:04:08.245577 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-5d773dbf-48f0-4bf1-901a-13d98b7e9708 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:04:08.249099 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5d773dbf-48f0-4bf1-901a-13d98b7e9708 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] 10.222.0.33 "GET /compute/v2.1/servers/cc9ad5af-1587-4aa1-8323-a50c91bb1b84" status: 200 len: 1808 microversion: 2.20 time: 1.279055 Oct 04 21:04:08.252612 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2656/5332] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 21:04:06 2022] GET /compute/v2.1/servers/cc9ad5af-1587-4aa1-8323-a50c91bb1b84 => generated 1808 bytes in 1283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:04:08.303339 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-62222244-5e49-4871-a3d7-23f06b34abc6 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5dbe3da6a4af181ef7302fe605fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3aa23aee3c8435c8f1f409019c5fed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:04:08.317694 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-62222244-5e49-4871-a3d7-23f06b34abc6 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] 10.222.0.33 "GET /compute/v2.1/servers/5a95bf94-24e7-43a2-9818-d5bf1b0315f1" status: 200 len: 1696 microversion: 2.1 time: 1.356905 Oct 04 21:04:08.320197 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2677/5333] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:04:06 2022] GET /compute/v2.1/servers/5a95bf94-24e7-43a2-9818-d5bf1b0315f1 => generated 1696 bytes in 1363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:04:09.291583 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-233861c3-05a0-497d-9e7a-88fbcc763447 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:04:09.293992 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-233861c3-05a0-497d-9e7a-88fbcc763447 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] [instance: cc9ad5af-1587-4aa1-8323-a50c91bb1b84] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:04:09.315185 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-233861c3-05a0-497d-9e7a-88fbcc763447 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:09.316808 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-233861c3-05a0-497d-9e7a-88fbcc763447 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:09.318864 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-233861c3-05a0-497d-9e7a-88fbcc763447 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:09.322332 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-233861c3-05a0-497d-9e7a-88fbcc763447 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:09.346254 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-131cee8c-8063-4aba-a761-f4f33c21fcc1 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:04:09.346904 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-131cee8c-8063-4aba-a761-f4f33c21fcc1 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] [instance: 5a95bf94-24e7-43a2-9818-d5bf1b0315f1] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:04:09.355257 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-233861c3-05a0-497d-9e7a-88fbcc763447 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:09.359481 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-233861c3-05a0-497d-9e7a-88fbcc763447 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:09.371906 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-131cee8c-8063-4aba-a761-f4f33c21fcc1 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:09.376140 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-131cee8c-8063-4aba-a761-f4f33c21fcc1 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:09.378063 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-131cee8c-8063-4aba-a761-f4f33c21fcc1 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:09.384840 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-131cee8c-8063-4aba-a761-f4f33c21fcc1 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:09.388675 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-131cee8c-8063-4aba-a761-f4f33c21fcc1 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:09.390278 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-131cee8c-8063-4aba-a761-f4f33c21fcc1 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:10.495660 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-233861c3-05a0-497d-9e7a-88fbcc763447 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:04:10.513966 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-233861c3-05a0-497d-9e7a-88fbcc763447 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:04:10.529832 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-233861c3-05a0-497d-9e7a-88fbcc763447 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:04:10.532575 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-233861c3-05a0-497d-9e7a-88fbcc763447 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] 10.222.0.33 "GET /compute/v2.1/servers/cc9ad5af-1587-4aa1-8323-a50c91bb1b84" status: 200 len: 1808 microversion: 2.20 time: 1.252491 Oct 04 21:04:10.545467 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2657/5334] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 21:04:09 2022] GET /compute/v2.1/servers/cc9ad5af-1587-4aa1-8323-a50c91bb1b84 => generated 1808 bytes in 1268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:04:10.573857 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-39616a30-dcae-49e8-9533-8580d758ddc1 req-9b4bd5c7-34fd-4bb0-a5bc-de68aac17b84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a95bf94-24e7-43a2-9818-d5bf1b0315f1", "name": "network-vif-unplugged", "status": "completed", "tag": "99e654db-1794-4804-bb52-dc567c83649d"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:04:10.603689 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-39616a30-dcae-49e8-9533-8580d758ddc1 req-9b4bd5c7-34fd-4bb0-a5bc-de68aac17b84 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:10.608222 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-39616a30-dcae-49e8-9533-8580d758ddc1 req-9b4bd5c7-34fd-4bb0-a5bc-de68aac17b84 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:10.613381 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-39616a30-dcae-49e8-9533-8580d758ddc1 req-9b4bd5c7-34fd-4bb0-a5bc-de68aac17b84 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:10.646542 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-39616a30-dcae-49e8-9533-8580d758ddc1 req-9b4bd5c7-34fd-4bb0-a5bc-de68aac17b84 service nova] Creating event network-vif-unplugged:99e654db-1794-4804-bb52-dc567c83649d for instance 5a95bf94-24e7-43a2-9818-d5bf1b0315f1 on n-h1-854823-8 Oct 04 21:04:10.660842 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [req-39616a30-dcae-49e8-9533-8580d758ddc1 req-9b4bd5c7-34fd-4bb0-a5bc-de68aac17b84 service nova] Instance 5a95bf94-24e7-43a2-9818-d5bf1b0315f1 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854823-8', 'n-h2-854823-8'} {{(pid=128801) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 21:04:10.696699 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-39616a30-dcae-49e8-9533-8580d758ddc1 req-9b4bd5c7-34fd-4bb0-a5bc-de68aac17b84 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.148580 Oct 04 21:04:10.697944 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2658/5335] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:04:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:04:10.742839 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-131cee8c-8063-4aba-a761-f4f33c21fcc1 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5dbe3da6a4af181ef7302fe605fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3aa23aee3c8435c8f1f409019c5fed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:04:10.760437 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-131cee8c-8063-4aba-a761-f4f33c21fcc1 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] 10.222.0.33 "GET /compute/v2.1/servers/5a95bf94-24e7-43a2-9818-d5bf1b0315f1" status: 200 len: 1695 microversion: 2.1 time: 1.416856 Oct 04 21:04:10.762673 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2678/5336] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:04:09 2022] GET /compute/v2.1/servers/5a95bf94-24e7-43a2-9818-d5bf1b0315f1 => generated 1695 bytes in 1422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:04:11.574237 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-04d3d600-f379-48fe-be5e-51f58be8379a tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:04:11.575723 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-04d3d600-f379-48fe-be5e-51f58be8379a tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] [instance: cc9ad5af-1587-4aa1-8323-a50c91bb1b84] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:04:11.601892 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-04d3d600-f379-48fe-be5e-51f58be8379a tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:11.602587 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-04d3d600-f379-48fe-be5e-51f58be8379a tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:11.603095 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-04d3d600-f379-48fe-be5e-51f58be8379a tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:11.603844 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-04d3d600-f379-48fe-be5e-51f58be8379a tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:11.604302 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-04d3d600-f379-48fe-be5e-51f58be8379a tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:11.604726 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-04d3d600-f379-48fe-be5e-51f58be8379a tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:11.812111 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-2e937364-fa26-4a58-b151-914e5dfc1b76 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:04:11.816806 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-2e937364-fa26-4a58-b151-914e5dfc1b76 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] [instance: 5a95bf94-24e7-43a2-9818-d5bf1b0315f1] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:04:11.856817 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2e937364-fa26-4a58-b151-914e5dfc1b76 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:11.858030 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2e937364-fa26-4a58-b151-914e5dfc1b76 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:11.859002 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2e937364-fa26-4a58-b151-914e5dfc1b76 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:11.860397 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2e937364-fa26-4a58-b151-914e5dfc1b76 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:11.861357 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2e937364-fa26-4a58-b151-914e5dfc1b76 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:11.862556 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2e937364-fa26-4a58-b151-914e5dfc1b76 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:12.667648 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-2e937364-fa26-4a58-b151-914e5dfc1b76 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5dbe3da6a4af181ef7302fe605fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3aa23aee3c8435c8f1f409019c5fed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:04:12.690696 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-04d3d600-f379-48fe-be5e-51f58be8379a tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:04:12.696007 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-2e937364-fa26-4a58-b151-914e5dfc1b76 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] 10.222.0.33 "GET /compute/v2.1/servers/5a95bf94-24e7-43a2-9818-d5bf1b0315f1" status: 200 len: 1695 microversion: 2.1 time: 0.894123 Oct 04 21:04:12.712244 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2679/5337] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:04:11 2022] GET /compute/v2.1/servers/5a95bf94-24e7-43a2-9818-d5bf1b0315f1 => generated 1695 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:04:12.735638 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-04d3d600-f379-48fe-be5e-51f58be8379a tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:04:12.752695 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-04d3d600-f379-48fe-be5e-51f58be8379a tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:04:12.754671 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-04d3d600-f379-48fe-be5e-51f58be8379a tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] 10.222.0.33 "GET /compute/v2.1/servers/cc9ad5af-1587-4aa1-8323-a50c91bb1b84" status: 200 len: 1808 microversion: 2.20 time: 1.185900 Oct 04 21:04:12.756055 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2659/5338] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 21:04:11 2022] GET /compute/v2.1/servers/cc9ad5af-1587-4aa1-8323-a50c91bb1b84 => generated 1808 bytes in 1188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:04:13.731155 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-13f9138b-0a22-40d8-8325-8b0f7d35eb49 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:04:13.732521 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-13f9138b-0a22-40d8-8325-8b0f7d35eb49 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] [instance: 5a95bf94-24e7-43a2-9818-d5bf1b0315f1] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:04:13.753581 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-13f9138b-0a22-40d8-8325-8b0f7d35eb49 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:13.754239 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-13f9138b-0a22-40d8-8325-8b0f7d35eb49 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:13.754821 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-13f9138b-0a22-40d8-8325-8b0f7d35eb49 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:13.755742 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-13f9138b-0a22-40d8-8325-8b0f7d35eb49 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:13.756459 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-13f9138b-0a22-40d8-8325-8b0f7d35eb49 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:13.756996 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-13f9138b-0a22-40d8-8325-8b0f7d35eb49 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:13.788398 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ff20129e-11de-46c3-99b2-70aec7d55014 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:04:13.789021 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ff20129e-11de-46c3-99b2-70aec7d55014 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] [instance: cc9ad5af-1587-4aa1-8323-a50c91bb1b84] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:04:13.811697 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ff20129e-11de-46c3-99b2-70aec7d55014 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:13.813992 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ff20129e-11de-46c3-99b2-70aec7d55014 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:13.816849 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ff20129e-11de-46c3-99b2-70aec7d55014 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:13.817612 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ff20129e-11de-46c3-99b2-70aec7d55014 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:13.818086 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ff20129e-11de-46c3-99b2-70aec7d55014 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:13.825928 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ff20129e-11de-46c3-99b2-70aec7d55014 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:14.776345 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-13f9138b-0a22-40d8-8325-8b0f7d35eb49 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5dbe3da6a4af181ef7302fe605fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3aa23aee3c8435c8f1f409019c5fed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:04:14.781867 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-ff20129e-11de-46c3-99b2-70aec7d55014 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:04:14.790307 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-13f9138b-0a22-40d8-8325-8b0f7d35eb49 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] 10.222.0.33 "GET /compute/v2.1/servers/5a95bf94-24e7-43a2-9818-d5bf1b0315f1" status: 200 len: 1695 microversion: 2.1 time: 1.063806 Oct 04 21:04:14.791639 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2680/5339] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:04:13 2022] GET /compute/v2.1/servers/5a95bf94-24e7-43a2-9818-d5bf1b0315f1 => generated 1695 bytes in 1067 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:04:14.803944 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-c1e8efa5-e9dd-4696-ab04-a37668eed5ed req-7dae1340-7380-46a2-a526-5f6bfe82e2af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a95bf94-24e7-43a2-9818-d5bf1b0315f1", "tag": "99e654db-1794-4804-bb52-dc567c83649d"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:04:14.826035 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-ff20129e-11de-46c3-99b2-70aec7d55014 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:04:14.828862 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-ff20129e-11de-46c3-99b2-70aec7d55014 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:04:14.830782 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ff20129e-11de-46c3-99b2-70aec7d55014 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] 10.222.0.33 "GET /compute/v2.1/servers/cc9ad5af-1587-4aa1-8323-a50c91bb1b84" status: 200 len: 1808 microversion: 2.20 time: 1.048778 Oct 04 21:04:14.831954 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2660/5340] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 21:04:13 2022] GET /compute/v2.1/servers/cc9ad5af-1587-4aa1-8323-a50c91bb1b84 => generated 1808 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:04:14.862317 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-c1e8efa5-e9dd-4696-ab04-a37668eed5ed req-7dae1340-7380-46a2-a526-5f6bfe82e2af service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:14.862840 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-c1e8efa5-e9dd-4696-ab04-a37668eed5ed req-7dae1340-7380-46a2-a526-5f6bfe82e2af service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:14.863353 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-c1e8efa5-e9dd-4696-ab04-a37668eed5ed req-7dae1340-7380-46a2-a526-5f6bfe82e2af service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:14.915524 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-c1e8efa5-e9dd-4696-ab04-a37668eed5ed req-7dae1340-7380-46a2-a526-5f6bfe82e2af service nova] Creating event network-changed:99e654db-1794-4804-bb52-dc567c83649d for instance 5a95bf94-24e7-43a2-9818-d5bf1b0315f1 on n-h1-854823-8 Oct 04 21:04:14.939643 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [req-c1e8efa5-e9dd-4696-ab04-a37668eed5ed req-7dae1340-7380-46a2-a526-5f6bfe82e2af service nova] Instance 5a95bf94-24e7-43a2-9818-d5bf1b0315f1 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854823-8', 'n-h2-854823-8'} {{(pid=128802) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 21:04:14.987419 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-c1e8efa5-e9dd-4696-ab04-a37668eed5ed req-7dae1340-7380-46a2-a526-5f6bfe82e2af service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.194296 Oct 04 21:04:14.988033 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2681/5341] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:04:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:04:15.823068 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7ad2d7c1-0517-4b5d-b7ce-3b02bc5113df tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:04:15.824500 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-7ad2d7c1-0517-4b5d-b7ce-3b02bc5113df tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] [instance: 5a95bf94-24e7-43a2-9818-d5bf1b0315f1] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:04:15.841519 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7ad2d7c1-0517-4b5d-b7ce-3b02bc5113df tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:15.842401 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7ad2d7c1-0517-4b5d-b7ce-3b02bc5113df tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:15.844932 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7ad2d7c1-0517-4b5d-b7ce-3b02bc5113df tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:15.846590 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7ad2d7c1-0517-4b5d-b7ce-3b02bc5113df tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:15.850671 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7ad2d7c1-0517-4b5d-b7ce-3b02bc5113df tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:15.851626 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7ad2d7c1-0517-4b5d-b7ce-3b02bc5113df tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:15.863470 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-fd3e985f-8cdf-4ab5-a3ab-09a47dfe73bb tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:04:15.865089 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-fd3e985f-8cdf-4ab5-a3ab-09a47dfe73bb tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] [instance: cc9ad5af-1587-4aa1-8323-a50c91bb1b84] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:04:15.896763 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fd3e985f-8cdf-4ab5-a3ab-09a47dfe73bb tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:15.898322 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fd3e985f-8cdf-4ab5-a3ab-09a47dfe73bb tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:15.901713 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fd3e985f-8cdf-4ab5-a3ab-09a47dfe73bb tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:15.907792 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fd3e985f-8cdf-4ab5-a3ab-09a47dfe73bb tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:15.908484 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fd3e985f-8cdf-4ab5-a3ab-09a47dfe73bb tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:15.909065 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fd3e985f-8cdf-4ab5-a3ab-09a47dfe73bb tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:17.543897 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-7ad2d7c1-0517-4b5d-b7ce-3b02bc5113df tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5dbe3da6a4af181ef7302fe605fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3aa23aee3c8435c8f1f409019c5fed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:04:17.559991 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-7ad2d7c1-0517-4b5d-b7ce-3b02bc5113df tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] 10.222.0.33 "GET /compute/v2.1/servers/5a95bf94-24e7-43a2-9818-d5bf1b0315f1" status: 200 len: 1695 microversion: 2.1 time: 1.740151 Oct 04 21:04:17.561820 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2661/5342] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:04:15 2022] GET /compute/v2.1/servers/5a95bf94-24e7-43a2-9818-d5bf1b0315f1 => generated 1695 bytes in 1744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:04:17.602802 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-fd3e985f-8cdf-4ab5-a3ab-09a47dfe73bb tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:04:17.615851 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-fd3e985f-8cdf-4ab5-a3ab-09a47dfe73bb tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:04:17.618311 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-fd3e985f-8cdf-4ab5-a3ab-09a47dfe73bb tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:04:17.621339 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-fd3e985f-8cdf-4ab5-a3ab-09a47dfe73bb tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] 10.222.0.33 "GET /compute/v2.1/servers/cc9ad5af-1587-4aa1-8323-a50c91bb1b84" status: 200 len: 1808 microversion: 2.20 time: 1.765167 Oct 04 21:04:17.623357 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2682/5343] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 21:04:15 2022] GET /compute/v2.1/servers/cc9ad5af-1587-4aa1-8323-a50c91bb1b84 => generated 1808 bytes in 1768 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:04:18.601862 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-790ee28f-e3b0-46c6-8170-dc685a8cc0ef tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:04:18.604071 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-790ee28f-e3b0-46c6-8170-dc685a8cc0ef tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] [instance: 5a95bf94-24e7-43a2-9818-d5bf1b0315f1] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:04:18.656248 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-cd957ac8-cc08-4240-be90-962936c3176f tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:04:18.656935 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-cd957ac8-cc08-4240-be90-962936c3176f tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] [instance: cc9ad5af-1587-4aa1-8323-a50c91bb1b84] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:04:18.673280 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-790ee28f-e3b0-46c6-8170-dc685a8cc0ef tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:18.673789 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-790ee28f-e3b0-46c6-8170-dc685a8cc0ef tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:18.675937 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cd957ac8-cc08-4240-be90-962936c3176f tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:18.679902 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-790ee28f-e3b0-46c6-8170-dc685a8cc0ef tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:18.680163 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cd957ac8-cc08-4240-be90-962936c3176f tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:18.681491 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-790ee28f-e3b0-46c6-8170-dc685a8cc0ef tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:18.681652 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cd957ac8-cc08-4240-be90-962936c3176f tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:18.682907 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-790ee28f-e3b0-46c6-8170-dc685a8cc0ef tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:18.683348 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-790ee28f-e3b0-46c6-8170-dc685a8cc0ef tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:18.694330 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cd957ac8-cc08-4240-be90-962936c3176f tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:18.696651 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cd957ac8-cc08-4240-be90-962936c3176f tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:18.698121 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cd957ac8-cc08-4240-be90-962936c3176f tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:18.768055 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:04:19.458695 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-790ee28f-e3b0-46c6-8170-dc685a8cc0ef tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5dbe3da6a4af181ef7302fe605fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3aa23aee3c8435c8f1f409019c5fed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:04:19.461152 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=89 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:04:19.474761 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-790ee28f-e3b0-46c6-8170-dc685a8cc0ef tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] 10.222.0.33 "GET /compute/v2.1/servers/5a95bf94-24e7-43a2-9818-d5bf1b0315f1" status: 200 len: 1693 microversion: 2.1 time: 0.889811 Oct 04 21:04:19.477517 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2662/5344] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:04:18 2022] GET /compute/v2.1/servers/5a95bf94-24e7-43a2-9818-d5bf1b0315f1 => generated 1693 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:04:19.786241 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2dbae06f-91fb-47f5-8b22-9820075bfd68 tempest-PortsAdminExtendedAttrsTestJSON-253407035 tempest-PortsAdminExtendedAttrsTestJSON-253407035-project-admin] Calling method '.version_select at 0x7f3c740cee50>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:04:19.788411 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2dbae06f-91fb-47f5-8b22-9820075bfd68 tempest-PortsAdminExtendedAttrsTestJSON-253407035 tempest-PortsAdminExtendedAttrsTestJSON-253407035-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:19.788905 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2dbae06f-91fb-47f5-8b22-9820075bfd68 tempest-PortsAdminExtendedAttrsTestJSON-253407035 tempest-PortsAdminExtendedAttrsTestJSON-253407035-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:19.789345 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2dbae06f-91fb-47f5-8b22-9820075bfd68 tempest-PortsAdminExtendedAttrsTestJSON-253407035 tempest-PortsAdminExtendedAttrsTestJSON-253407035-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:19.827746 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2dbae06f-91fb-47f5-8b22-9820075bfd68 tempest-PortsAdminExtendedAttrsTestJSON-253407035 tempest-PortsAdminExtendedAttrsTestJSON-253407035-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:19.829196 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2dbae06f-91fb-47f5-8b22-9820075bfd68 tempest-PortsAdminExtendedAttrsTestJSON-253407035 tempest-PortsAdminExtendedAttrsTestJSON-253407035-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:19.829850 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2dbae06f-91fb-47f5-8b22-9820075bfd68 tempest-PortsAdminExtendedAttrsTestJSON-253407035 tempest-PortsAdminExtendedAttrsTestJSON-253407035-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:19.845016 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2dbae06f-91fb-47f5-8b22-9820075bfd68 tempest-PortsAdminExtendedAttrsTestJSON-253407035 tempest-PortsAdminExtendedAttrsTestJSON-253407035-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:19.846055 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2dbae06f-91fb-47f5-8b22-9820075bfd68 tempest-PortsAdminExtendedAttrsTestJSON-253407035 tempest-PortsAdminExtendedAttrsTestJSON-253407035-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:19.847001 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2dbae06f-91fb-47f5-8b22-9820075bfd68 tempest-PortsAdminExtendedAttrsTestJSON-253407035 tempest-PortsAdminExtendedAttrsTestJSON-253407035-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:19.856865 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-2dbae06f-91fb-47f5-8b22-9820075bfd68 tempest-PortsAdminExtendedAttrsTestJSON-253407035 tempest-PortsAdminExtendedAttrsTestJSON-253407035-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.374912 Oct 04 21:04:19.859020 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2663/5345] 10.222.0.33 () {58 vars in 1146 bytes} [Tue Oct 4 21:04:19 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:04:19.875797 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-cd957ac8-cc08-4240-be90-962936c3176f tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:04:19.890249 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-cd957ac8-cc08-4240-be90-962936c3176f tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:04:19.892359 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-cd957ac8-cc08-4240-be90-962936c3176f tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:04:19.895185 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-cd957ac8-cc08-4240-be90-962936c3176f tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] 10.222.0.33 "GET /compute/v2.1/servers/cc9ad5af-1587-4aa1-8323-a50c91bb1b84" status: 200 len: 1808 microversion: 2.20 time: 1.246070 Oct 04 21:04:19.910952 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2683/5346] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 21:04:18 2022] GET /compute/v2.1/servers/cc9ad5af-1587-4aa1-8323-a50c91bb1b84 => generated 1808 bytes in 1252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:04:20.504650 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-74b58f61-ff55-4ba2-86c1-fc360243d6d3 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:04:20.505978 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-74b58f61-ff55-4ba2-86c1-fc360243d6d3 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] [instance: 5a95bf94-24e7-43a2-9818-d5bf1b0315f1] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:04:20.519770 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-74b58f61-ff55-4ba2-86c1-fc360243d6d3 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:20.522764 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-74b58f61-ff55-4ba2-86c1-fc360243d6d3 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:20.524472 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-74b58f61-ff55-4ba2-86c1-fc360243d6d3 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:20.529179 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-74b58f61-ff55-4ba2-86c1-fc360243d6d3 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:20.530619 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-74b58f61-ff55-4ba2-86c1-fc360243d6d3 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:20.533463 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-74b58f61-ff55-4ba2-86c1-fc360243d6d3 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:20.924857 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-e7c4beae-bd37-479c-9ce8-a7278753956d tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:04:20.926160 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-e7c4beae-bd37-479c-9ce8-a7278753956d tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] [instance: cc9ad5af-1587-4aa1-8323-a50c91bb1b84] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:04:20.940929 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e7c4beae-bd37-479c-9ce8-a7278753956d tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:20.941770 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e7c4beae-bd37-479c-9ce8-a7278753956d tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:20.942612 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e7c4beae-bd37-479c-9ce8-a7278753956d tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:20.943561 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e7c4beae-bd37-479c-9ce8-a7278753956d tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:20.946814 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e7c4beae-bd37-479c-9ce8-a7278753956d tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:20.947958 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e7c4beae-bd37-479c-9ce8-a7278753956d tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:21.459752 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-74b58f61-ff55-4ba2-86c1-fc360243d6d3 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5dbe3da6a4af181ef7302fe605fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3aa23aee3c8435c8f1f409019c5fed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:04:21.471575 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-74b58f61-ff55-4ba2-86c1-fc360243d6d3 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] 10.222.0.33 "GET /compute/v2.1/servers/5a95bf94-24e7-43a2-9818-d5bf1b0315f1" status: 200 len: 1690 microversion: 2.1 time: 0.972756 Oct 04 21:04:21.472976 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2664/5347] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:04:20 2022] GET /compute/v2.1/servers/5a95bf94-24e7-43a2-9818-d5bf1b0315f1 => generated 1690 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:04:21.502104 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5b3b86ab-fb4e-4120-8523-de13a5a88011 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:04:21.502948 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-5b3b86ab-fb4e-4120-8523-de13a5a88011 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] [instance: 5a95bf94-24e7-43a2-9818-d5bf1b0315f1] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:04:21.521273 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5b3b86ab-fb4e-4120-8523-de13a5a88011 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:21.529500 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5b3b86ab-fb4e-4120-8523-de13a5a88011 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:21.530204 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5b3b86ab-fb4e-4120-8523-de13a5a88011 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:21.531223 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5b3b86ab-fb4e-4120-8523-de13a5a88011 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:21.531903 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5b3b86ab-fb4e-4120-8523-de13a5a88011 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:21.532582 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5b3b86ab-fb4e-4120-8523-de13a5a88011 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:21.766090 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5b3b86ab-fb4e-4120-8523-de13a5a88011 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] 10.222.0.33 "POST /compute/v2.1/servers/5a95bf94-24e7-43a2-9818-d5bf1b0315f1/action" status: 202 len: 0 microversion: 2.1 time: 0.269462 Oct 04 21:04:21.766911 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2665/5348] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 21:04:21 2022] POST /compute/v2.1/servers/5a95bf94-24e7-43a2-9818-d5bf1b0315f1/action => generated 0 bytes in 271 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 21:04:21.775940 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a039d05b-396d-4b09-82dc-295c1b30ce63 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:04:21.776936 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a039d05b-396d-4b09-82dc-295c1b30ce63 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] [instance: 5a95bf94-24e7-43a2-9818-d5bf1b0315f1] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:04:21.790744 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a039d05b-396d-4b09-82dc-295c1b30ce63 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:21.791454 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a039d05b-396d-4b09-82dc-295c1b30ce63 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:21.794182 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a039d05b-396d-4b09-82dc-295c1b30ce63 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:21.795183 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a039d05b-396d-4b09-82dc-295c1b30ce63 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:21.796017 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a039d05b-396d-4b09-82dc-295c1b30ce63 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:21.796968 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a039d05b-396d-4b09-82dc-295c1b30ce63 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:22.444737 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-e7c4beae-bd37-479c-9ce8-a7278753956d tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:04:22.463651 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-e7c4beae-bd37-479c-9ce8-a7278753956d tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:04:22.465912 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-e7c4beae-bd37-479c-9ce8-a7278753956d tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:04:22.467429 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-e7c4beae-bd37-479c-9ce8-a7278753956d tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] 10.222.0.33 "GET /compute/v2.1/servers/cc9ad5af-1587-4aa1-8323-a50c91bb1b84" status: 200 len: 1808 microversion: 2.20 time: 1.546556 Oct 04 21:04:22.470779 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2684/5349] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 21:04:20 2022] GET /compute/v2.1/servers/cc9ad5af-1587-4aa1-8323-a50c91bb1b84 => generated 1808 bytes in 1550 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:04:22.833801 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-a039d05b-396d-4b09-82dc-295c1b30ce63 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5dbe3da6a4af181ef7302fe605fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3aa23aee3c8435c8f1f409019c5fed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:04:22.848974 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a039d05b-396d-4b09-82dc-295c1b30ce63 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] 10.222.0.33 "GET /compute/v2.1/servers/5a95bf94-24e7-43a2-9818-d5bf1b0315f1" status: 200 len: 1689 microversion: 2.1 time: 1.077453 Oct 04 21:04:22.859467 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2666/5350] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:04:21 2022] GET /compute/v2.1/servers/5a95bf94-24e7-43a2-9818-d5bf1b0315f1 => generated 1689 bytes in 1089 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:04:23.502918 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-1a048277-c570-4b13-9d1a-52114473031d tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:04:23.504683 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-1a048277-c570-4b13-9d1a-52114473031d tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] [instance: cc9ad5af-1587-4aa1-8323-a50c91bb1b84] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:04:23.525750 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1a048277-c570-4b13-9d1a-52114473031d tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:23.526260 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1a048277-c570-4b13-9d1a-52114473031d tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:23.528324 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1a048277-c570-4b13-9d1a-52114473031d tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:23.531792 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1a048277-c570-4b13-9d1a-52114473031d tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:23.532289 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1a048277-c570-4b13-9d1a-52114473031d tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:23.532841 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1a048277-c570-4b13-9d1a-52114473031d tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:23.876561 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-523e9b10-2b84-4f0d-8f23-105a8d91302e tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:04:23.877513 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-523e9b10-2b84-4f0d-8f23-105a8d91302e tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] [instance: 5a95bf94-24e7-43a2-9818-d5bf1b0315f1] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:04:23.897766 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-523e9b10-2b84-4f0d-8f23-105a8d91302e tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:23.898599 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-523e9b10-2b84-4f0d-8f23-105a8d91302e tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:23.901075 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-523e9b10-2b84-4f0d-8f23-105a8d91302e tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:23.907778 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-523e9b10-2b84-4f0d-8f23-105a8d91302e tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:23.908288 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-523e9b10-2b84-4f0d-8f23-105a8d91302e tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:23.914950 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-523e9b10-2b84-4f0d-8f23-105a8d91302e tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:24.271658 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-1a048277-c570-4b13-9d1a-52114473031d tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:04:24.286035 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-1a048277-c570-4b13-9d1a-52114473031d tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:04:24.288317 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-1a048277-c570-4b13-9d1a-52114473031d tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:04:24.290209 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-1a048277-c570-4b13-9d1a-52114473031d tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] 10.222.0.33 "GET /compute/v2.1/servers/cc9ad5af-1587-4aa1-8323-a50c91bb1b84" status: 200 len: 1808 microversion: 2.20 time: 0.791510 Oct 04 21:04:24.291186 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2685/5351] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 21:04:23 2022] GET /compute/v2.1/servers/cc9ad5af-1587-4aa1-8323-a50c91bb1b84 => generated 1808 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:04:24.563579 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-523e9b10-2b84-4f0d-8f23-105a8d91302e tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5dbe3da6a4af181ef7302fe605fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3aa23aee3c8435c8f1f409019c5fed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:04:24.575853 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-523e9b10-2b84-4f0d-8f23-105a8d91302e tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] 10.222.0.33 "GET /compute/v2.1/servers/5a95bf94-24e7-43a2-9818-d5bf1b0315f1" status: 200 len: 1689 microversion: 2.1 time: 0.704325 Oct 04 21:04:24.591093 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2667/5352] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:04:23 2022] GET /compute/v2.1/servers/5a95bf94-24e7-43a2-9818-d5bf1b0315f1 => generated 1689 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:04:25.320940 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-d3621409-60bb-4e51-b862-eba753258dca tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:04:25.322251 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-d3621409-60bb-4e51-b862-eba753258dca tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] [instance: cc9ad5af-1587-4aa1-8323-a50c91bb1b84] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:04:25.341779 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d3621409-60bb-4e51-b862-eba753258dca tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:25.342047 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d3621409-60bb-4e51-b862-eba753258dca tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:25.343633 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d3621409-60bb-4e51-b862-eba753258dca tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:25.344395 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d3621409-60bb-4e51-b862-eba753258dca tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:25.344865 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d3621409-60bb-4e51-b862-eba753258dca tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:25.345298 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d3621409-60bb-4e51-b862-eba753258dca tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:25.603788 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d38d8e8c-e09e-4993-a7c1-d3f57a19dc7b tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:04:25.605205 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d38d8e8c-e09e-4993-a7c1-d3f57a19dc7b tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] [instance: 5a95bf94-24e7-43a2-9818-d5bf1b0315f1] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:04:25.619031 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d38d8e8c-e09e-4993-a7c1-d3f57a19dc7b tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:25.619564 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d38d8e8c-e09e-4993-a7c1-d3f57a19dc7b tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:25.619988 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d38d8e8c-e09e-4993-a7c1-d3f57a19dc7b tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:25.620693 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d38d8e8c-e09e-4993-a7c1-d3f57a19dc7b tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:25.622208 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d38d8e8c-e09e-4993-a7c1-d3f57a19dc7b tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:25.623320 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d38d8e8c-e09e-4993-a7c1-d3f57a19dc7b tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:25.676406 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-d3621409-60bb-4e51-b862-eba753258dca tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:04:25.724520 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-d3621409-60bb-4e51-b862-eba753258dca tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:04:25.727200 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-d3621409-60bb-4e51-b862-eba753258dca tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:04:25.728654 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-d3621409-60bb-4e51-b862-eba753258dca tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] 10.222.0.33 "GET /compute/v2.1/servers/cc9ad5af-1587-4aa1-8323-a50c91bb1b84" status: 200 len: 1808 microversion: 2.20 time: 0.412462 Oct 04 21:04:25.759934 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2686/5353] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 21:04:25 2022] GET /compute/v2.1/servers/cc9ad5af-1587-4aa1-8323-a50c91bb1b84 => generated 1808 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:04:25.994284 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d38d8e8c-e09e-4993-a7c1-d3f57a19dc7b tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5dbe3da6a4af181ef7302fe605fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3aa23aee3c8435c8f1f409019c5fed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:04:26.008744 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d38d8e8c-e09e-4993-a7c1-d3f57a19dc7b tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] 10.222.0.33 "GET /compute/v2.1/servers/5a95bf94-24e7-43a2-9818-d5bf1b0315f1" status: 200 len: 1689 microversion: 2.1 time: 0.409640 Oct 04 21:04:26.009435 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2668/5354] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:04:25 2022] GET /compute/v2.1/servers/5a95bf94-24e7-43a2-9818-d5bf1b0315f1 => generated 1689 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:04:26.094654 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-ab1896c9-072d-4645-85ea-37e4194ae00b req-c2de1149-d412-4100-b766-d6e42f657fb6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a95bf94-24e7-43a2-9818-d5bf1b0315f1", "name": "network-vif-plugged", "status": "completed", "tag": "99e654db-1794-4804-bb52-dc567c83649d"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:04:26.108392 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-ab1896c9-072d-4645-85ea-37e4194ae00b req-c2de1149-d412-4100-b766-d6e42f657fb6 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:26.108593 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-ab1896c9-072d-4645-85ea-37e4194ae00b req-c2de1149-d412-4100-b766-d6e42f657fb6 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:26.109095 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-ab1896c9-072d-4645-85ea-37e4194ae00b req-c2de1149-d412-4100-b766-d6e42f657fb6 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:26.131688 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-ab1896c9-072d-4645-85ea-37e4194ae00b req-c2de1149-d412-4100-b766-d6e42f657fb6 service nova] Creating event network-vif-plugged:99e654db-1794-4804-bb52-dc567c83649d for instance 5a95bf94-24e7-43a2-9818-d5bf1b0315f1 on n-h1-854823-8 Oct 04 21:04:26.138609 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [req-ab1896c9-072d-4645-85ea-37e4194ae00b req-c2de1149-d412-4100-b766-d6e42f657fb6 service nova] Instance 5a95bf94-24e7-43a2-9818-d5bf1b0315f1 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854823-8', 'n-h2-854823-8'} {{(pid=128802) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 21:04:26.156215 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-ab1896c9-072d-4645-85ea-37e4194ae00b req-c2de1149-d412-4100-b766-d6e42f657fb6 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065235 Oct 04 21:04:26.156943 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2687/5355] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:04:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:04:26.768439 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e137d592-ba13-4077-8393-336580ee81b6 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:04:26.772031 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e137d592-ba13-4077-8393-336580ee81b6 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] [instance: cc9ad5af-1587-4aa1-8323-a50c91bb1b84] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:04:26.791991 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e137d592-ba13-4077-8393-336580ee81b6 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:26.792493 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e137d592-ba13-4077-8393-336580ee81b6 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:26.793328 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e137d592-ba13-4077-8393-336580ee81b6 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:26.794192 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e137d592-ba13-4077-8393-336580ee81b6 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:26.794928 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e137d592-ba13-4077-8393-336580ee81b6 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:26.796127 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e137d592-ba13-4077-8393-336580ee81b6 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:27.037718 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-57ad9fb0-4c69-4d22-8a9b-f1139b86868f tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:04:27.038544 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-57ad9fb0-4c69-4d22-8a9b-f1139b86868f tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] [instance: 5a95bf94-24e7-43a2-9818-d5bf1b0315f1] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:04:27.048881 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-57ad9fb0-4c69-4d22-8a9b-f1139b86868f tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:27.049696 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-57ad9fb0-4c69-4d22-8a9b-f1139b86868f tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:27.050321 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-57ad9fb0-4c69-4d22-8a9b-f1139b86868f tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:27.051366 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-57ad9fb0-4c69-4d22-8a9b-f1139b86868f tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:27.052254 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-57ad9fb0-4c69-4d22-8a9b-f1139b86868f tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:27.052861 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-57ad9fb0-4c69-4d22-8a9b-f1139b86868f tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:27.113973 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e137d592-ba13-4077-8393-336580ee81b6 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:04:27.128703 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e137d592-ba13-4077-8393-336580ee81b6 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:04:27.136458 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e137d592-ba13-4077-8393-336580ee81b6 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:04:27.139776 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e137d592-ba13-4077-8393-336580ee81b6 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] 10.222.0.33 "GET /compute/v2.1/servers/cc9ad5af-1587-4aa1-8323-a50c91bb1b84" status: 200 len: 1808 microversion: 2.20 time: 0.379554 Oct 04 21:04:27.140700 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2669/5356] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 21:04:26 2022] GET /compute/v2.1/servers/cc9ad5af-1587-4aa1-8323-a50c91bb1b84 => generated 1808 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:04:28.009842 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-57ad9fb0-4c69-4d22-8a9b-f1139b86868f tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5dbe3da6a4af181ef7302fe605fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3aa23aee3c8435c8f1f409019c5fed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:04:28.020742 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-57ad9fb0-4c69-4d22-8a9b-f1139b86868f tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] 10.222.0.33 "GET /compute/v2.1/servers/5a95bf94-24e7-43a2-9818-d5bf1b0315f1" status: 200 len: 1689 microversion: 2.1 time: 0.988555 Oct 04 21:04:28.022009 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2688/5357] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:04:27 2022] GET /compute/v2.1/servers/5a95bf94-24e7-43a2-9818-d5bf1b0315f1 => generated 1689 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:04:28.171592 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-12604659-adc0-478e-be7a-b6f10550cf7e tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:04:28.173097 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-12604659-adc0-478e-be7a-b6f10550cf7e tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] [instance: cc9ad5af-1587-4aa1-8323-a50c91bb1b84] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:04:28.183126 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-12604659-adc0-478e-be7a-b6f10550cf7e tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:28.185151 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-12604659-adc0-478e-be7a-b6f10550cf7e tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:28.186123 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-12604659-adc0-478e-be7a-b6f10550cf7e tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:28.187103 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-12604659-adc0-478e-be7a-b6f10550cf7e tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:28.187814 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-12604659-adc0-478e-be7a-b6f10550cf7e tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:28.188484 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-12604659-adc0-478e-be7a-b6f10550cf7e tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:28.539731 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-12604659-adc0-478e-be7a-b6f10550cf7e tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:04:28.554658 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-12604659-adc0-478e-be7a-b6f10550cf7e tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:04:28.557094 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-12604659-adc0-478e-be7a-b6f10550cf7e tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:04:28.559442 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-12604659-adc0-478e-be7a-b6f10550cf7e tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] 10.222.0.33 "GET /compute/v2.1/servers/cc9ad5af-1587-4aa1-8323-a50c91bb1b84" status: 200 len: 1808 microversion: 2.20 time: 0.393731 Oct 04 21:04:28.577184 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2670/5358] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 21:04:28 2022] GET /compute/v2.1/servers/cc9ad5af-1587-4aa1-8323-a50c91bb1b84 => generated 1808 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:04:28.852047 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-aa39a5fb-4030-419d-ae3a-3f8165d64018 req-f2f721b1-5313-46ea-8cff-0b73f07a778c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a95bf94-24e7-43a2-9818-d5bf1b0315f1", "name": "network-vif-unplugged", "status": "completed", "tag": "99e654db-1794-4804-bb52-dc567c83649d"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:04:28.866068 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-aa39a5fb-4030-419d-ae3a-3f8165d64018 req-f2f721b1-5313-46ea-8cff-0b73f07a778c service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:28.866552 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-aa39a5fb-4030-419d-ae3a-3f8165d64018 req-f2f721b1-5313-46ea-8cff-0b73f07a778c service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:28.867320 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-aa39a5fb-4030-419d-ae3a-3f8165d64018 req-f2f721b1-5313-46ea-8cff-0b73f07a778c service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:28.900832 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-aa39a5fb-4030-419d-ae3a-3f8165d64018 req-f2f721b1-5313-46ea-8cff-0b73f07a778c service nova] Creating event network-vif-unplugged:99e654db-1794-4804-bb52-dc567c83649d for instance 5a95bf94-24e7-43a2-9818-d5bf1b0315f1 on n-h2-854823-8 Oct 04 21:04:28.925749 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [req-aa39a5fb-4030-419d-ae3a-3f8165d64018 req-f2f721b1-5313-46ea-8cff-0b73f07a778c service nova] Instance 5a95bf94-24e7-43a2-9818-d5bf1b0315f1 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854823-8', 'n-h2-854823-8'} {{(pid=128802) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 21:04:28.951368 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-aa39a5fb-4030-419d-ae3a-3f8165d64018 req-f2f721b1-5313-46ea-8cff-0b73f07a778c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.104307 Oct 04 21:04:28.952458 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2689/5359] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:04:28 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:04:29.044457 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f026cd61-a410-47d8-b5f4-940675599b34 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:04:29.045089 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f026cd61-a410-47d8-b5f4-940675599b34 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] [instance: 5a95bf94-24e7-43a2-9818-d5bf1b0315f1] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:04:29.054666 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f026cd61-a410-47d8-b5f4-940675599b34 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:29.055171 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f026cd61-a410-47d8-b5f4-940675599b34 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:29.056071 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f026cd61-a410-47d8-b5f4-940675599b34 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:29.056891 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f026cd61-a410-47d8-b5f4-940675599b34 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:29.060697 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f026cd61-a410-47d8-b5f4-940675599b34 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:29.062269 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f026cd61-a410-47d8-b5f4-940675599b34 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:29.517061 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f026cd61-a410-47d8-b5f4-940675599b34 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5dbe3da6a4af181ef7302fe605fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3aa23aee3c8435c8f1f409019c5fed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:04:29.525256 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f026cd61-a410-47d8-b5f4-940675599b34 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] 10.222.0.33 "GET /compute/v2.1/servers/5a95bf94-24e7-43a2-9818-d5bf1b0315f1" status: 200 len: 1689 microversion: 2.1 time: 0.484884 Oct 04 21:04:29.525979 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2671/5360] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:04:29 2022] GET /compute/v2.1/servers/5a95bf94-24e7-43a2-9818-d5bf1b0315f1 => generated 1689 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:04:29.591983 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-ae5b3f15-4b5f-4765-b0e6-0106142c7bf9 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:04:29.592688 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-ae5b3f15-4b5f-4765-b0e6-0106142c7bf9 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] [instance: cc9ad5af-1587-4aa1-8323-a50c91bb1b84] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:04:29.599231 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ae5b3f15-4b5f-4765-b0e6-0106142c7bf9 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:29.599763 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ae5b3f15-4b5f-4765-b0e6-0106142c7bf9 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:29.600200 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ae5b3f15-4b5f-4765-b0e6-0106142c7bf9 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:29.601175 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ae5b3f15-4b5f-4765-b0e6-0106142c7bf9 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:29.601851 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ae5b3f15-4b5f-4765-b0e6-0106142c7bf9 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:29.602461 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ae5b3f15-4b5f-4765-b0e6-0106142c7bf9 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:30.058164 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-ae5b3f15-4b5f-4765-b0e6-0106142c7bf9 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:04:30.087947 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-ae5b3f15-4b5f-4765-b0e6-0106142c7bf9 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:04:30.091725 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-ae5b3f15-4b5f-4765-b0e6-0106142c7bf9 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:04:30.093361 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-ae5b3f15-4b5f-4765-b0e6-0106142c7bf9 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] 10.222.0.33 "GET /compute/v2.1/servers/cc9ad5af-1587-4aa1-8323-a50c91bb1b84" status: 200 len: 1808 microversion: 2.20 time: 0.508484 Oct 04 21:04:30.106771 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2690/5361] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 21:04:29 2022] GET /compute/v2.1/servers/cc9ad5af-1587-4aa1-8323-a50c91bb1b84 => generated 1808 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:04:30.550391 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8632d8cf-25f7-4e7a-9e5a-2ccb2e0d1de0 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:04:30.551268 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-8632d8cf-25f7-4e7a-9e5a-2ccb2e0d1de0 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] [instance: 5a95bf94-24e7-43a2-9818-d5bf1b0315f1] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:04:30.559630 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8632d8cf-25f7-4e7a-9e5a-2ccb2e0d1de0 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:30.560247 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8632d8cf-25f7-4e7a-9e5a-2ccb2e0d1de0 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:30.560783 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8632d8cf-25f7-4e7a-9e5a-2ccb2e0d1de0 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:30.561585 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8632d8cf-25f7-4e7a-9e5a-2ccb2e0d1de0 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:30.562247 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8632d8cf-25f7-4e7a-9e5a-2ccb2e0d1de0 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:30.562698 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8632d8cf-25f7-4e7a-9e5a-2ccb2e0d1de0 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:30.970000 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-8632d8cf-25f7-4e7a-9e5a-2ccb2e0d1de0 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5dbe3da6a4af181ef7302fe605fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3aa23aee3c8435c8f1f409019c5fed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:04:30.983961 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-8632d8cf-25f7-4e7a-9e5a-2ccb2e0d1de0 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] 10.222.0.33 "GET /compute/v2.1/servers/5a95bf94-24e7-43a2-9818-d5bf1b0315f1" status: 200 len: 1689 microversion: 2.1 time: 0.436807 Oct 04 21:04:30.985267 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2672/5362] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:04:30 2022] GET /compute/v2.1/servers/5a95bf94-24e7-43a2-9818-d5bf1b0315f1 => generated 1689 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:04:31.030971 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-1773e02c-a18d-4049-9cbe-c35377e41e3a req-6e46169b-7b28-476d-8515-039d902cc9d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a95bf94-24e7-43a2-9818-d5bf1b0315f1", "tag": "99e654db-1794-4804-bb52-dc567c83649d"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:04:31.042699 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-1773e02c-a18d-4049-9cbe-c35377e41e3a req-6e46169b-7b28-476d-8515-039d902cc9d1 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:31.044209 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-1773e02c-a18d-4049-9cbe-c35377e41e3a req-6e46169b-7b28-476d-8515-039d902cc9d1 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:31.044723 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-1773e02c-a18d-4049-9cbe-c35377e41e3a req-6e46169b-7b28-476d-8515-039d902cc9d1 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:31.057710 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-1773e02c-a18d-4049-9cbe-c35377e41e3a req-6e46169b-7b28-476d-8515-039d902cc9d1 service nova] Creating event network-changed:99e654db-1794-4804-bb52-dc567c83649d for instance 5a95bf94-24e7-43a2-9818-d5bf1b0315f1 on n-h2-854823-8 Oct 04 21:04:31.064483 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [req-1773e02c-a18d-4049-9cbe-c35377e41e3a req-6e46169b-7b28-476d-8515-039d902cc9d1 service nova] Instance 5a95bf94-24e7-43a2-9818-d5bf1b0315f1 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854823-8', 'n-h2-854823-8'} {{(pid=128802) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 21:04:31.077122 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-1773e02c-a18d-4049-9cbe-c35377e41e3a req-6e46169b-7b28-476d-8515-039d902cc9d1 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050835 Oct 04 21:04:31.078391 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2691/5363] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:04:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:04:31.123400 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e80478d5-5a54-4044-9131-1243656a090d tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:04:31.124123 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e80478d5-5a54-4044-9131-1243656a090d tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] [instance: cc9ad5af-1587-4aa1-8323-a50c91bb1b84] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:04:31.131765 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e80478d5-5a54-4044-9131-1243656a090d tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:31.132553 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e80478d5-5a54-4044-9131-1243656a090d tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:31.133156 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e80478d5-5a54-4044-9131-1243656a090d tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:31.134033 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e80478d5-5a54-4044-9131-1243656a090d tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:31.134690 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e80478d5-5a54-4044-9131-1243656a090d tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:31.135278 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e80478d5-5a54-4044-9131-1243656a090d tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:32.012706 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-f055bc97-8d84-43cc-9381-c8942dbe72f3 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:04:32.013878 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-f055bc97-8d84-43cc-9381-c8942dbe72f3 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] [instance: 5a95bf94-24e7-43a2-9818-d5bf1b0315f1] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:04:32.036337 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f055bc97-8d84-43cc-9381-c8942dbe72f3 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:32.038257 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f055bc97-8d84-43cc-9381-c8942dbe72f3 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:32.038988 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f055bc97-8d84-43cc-9381-c8942dbe72f3 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:32.043185 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f055bc97-8d84-43cc-9381-c8942dbe72f3 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:32.044288 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f055bc97-8d84-43cc-9381-c8942dbe72f3 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:32.045433 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f055bc97-8d84-43cc-9381-c8942dbe72f3 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:32.108803 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e80478d5-5a54-4044-9131-1243656a090d tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:04:32.132040 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e80478d5-5a54-4044-9131-1243656a090d tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:04:32.139689 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e80478d5-5a54-4044-9131-1243656a090d tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:04:32.142570 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e80478d5-5a54-4044-9131-1243656a090d tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] 10.222.0.33 "GET /compute/v2.1/servers/cc9ad5af-1587-4aa1-8323-a50c91bb1b84" status: 200 len: 1808 microversion: 2.20 time: 1.023035 Oct 04 21:04:32.143368 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2673/5364] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 21:04:31 2022] GET /compute/v2.1/servers/cc9ad5af-1587-4aa1-8323-a50c91bb1b84 => generated 1808 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:04:32.543693 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-f055bc97-8d84-43cc-9381-c8942dbe72f3 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5dbe3da6a4af181ef7302fe605fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3aa23aee3c8435c8f1f409019c5fed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:04:32.572549 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-f055bc97-8d84-43cc-9381-c8942dbe72f3 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] 10.222.0.33 "GET /compute/v2.1/servers/5a95bf94-24e7-43a2-9818-d5bf1b0315f1" status: 200 len: 1689 microversion: 2.1 time: 0.563070 Oct 04 21:04:32.575919 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2692/5365] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:04:32 2022] GET /compute/v2.1/servers/5a95bf94-24e7-43a2-9818-d5bf1b0315f1 => generated 1689 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:04:33.177576 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-bc4036a9-13f4-4a3a-8ed2-29b6a5019010 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:04:33.178379 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-bc4036a9-13f4-4a3a-8ed2-29b6a5019010 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] [instance: cc9ad5af-1587-4aa1-8323-a50c91bb1b84] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:04:33.192914 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bc4036a9-13f4-4a3a-8ed2-29b6a5019010 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:33.193423 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bc4036a9-13f4-4a3a-8ed2-29b6a5019010 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:33.193873 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bc4036a9-13f4-4a3a-8ed2-29b6a5019010 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:33.194632 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bc4036a9-13f4-4a3a-8ed2-29b6a5019010 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:33.195097 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bc4036a9-13f4-4a3a-8ed2-29b6a5019010 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:33.195535 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bc4036a9-13f4-4a3a-8ed2-29b6a5019010 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:33.305433 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0098681e-63d4-4b6a-be77-beada497bf30 tempest-VolumesActionsTest-1831230653 tempest-VolumesActionsTest-1831230653-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-952435037", "imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63", "flavorRef": "452", "networks": [{"uuid": "c5b86ce4-7f28-4154-b35b-9523247b2cd7"}]}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:04:33.372346 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.network.neutron [None req-0098681e-63d4-4b6a-be77-beada497bf30 tempest-VolumesActionsTest-1831230653 tempest-VolumesActionsTest-1831230653-project] validate_networks() for [('c5b86ce4-7f28-4154-b35b-9523247b2cd7', None, None, None, None, None)] {{(pid=128801) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:04:33.838550 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-bc4036a9-13f4-4a3a-8ed2-29b6a5019010 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:04:33.850276 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-bc4036a9-13f4-4a3a-8ed2-29b6a5019010 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:04:33.851758 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-bc4036a9-13f4-4a3a-8ed2-29b6a5019010 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:04:33.852953 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-bc4036a9-13f4-4a3a-8ed2-29b6a5019010 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] 10.222.0.33 "GET /compute/v2.1/servers/cc9ad5af-1587-4aa1-8323-a50c91bb1b84" status: 200 len: 1808 microversion: 2.20 time: 0.683823 Oct 04 21:04:33.872073 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2693/5366] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 21:04:33 2022] GET /compute/v2.1/servers/cc9ad5af-1587-4aa1-8323-a50c91bb1b84 => generated 1808 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:04:33.877625 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-39d0c810-4e5d-42b6-94df-62840505791a tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:04:33.878670 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-39d0c810-4e5d-42b6-94df-62840505791a tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] [instance: 5a95bf94-24e7-43a2-9818-d5bf1b0315f1] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:04:33.903922 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-39d0c810-4e5d-42b6-94df-62840505791a tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:33.905910 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-39d0c810-4e5d-42b6-94df-62840505791a tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:33.906612 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-39d0c810-4e5d-42b6-94df-62840505791a tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:33.907702 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-39d0c810-4e5d-42b6-94df-62840505791a tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:33.908367 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-39d0c810-4e5d-42b6-94df-62840505791a tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:33.909058 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-39d0c810-4e5d-42b6-94df-62840505791a tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:34.510948 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-39d0c810-4e5d-42b6-94df-62840505791a tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5dbe3da6a4af181ef7302fe605fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3aa23aee3c8435c8f1f409019c5fed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:04:34.579081 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-39d0c810-4e5d-42b6-94df-62840505791a tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] 10.222.0.33 "GET /compute/v2.1/servers/5a95bf94-24e7-43a2-9818-d5bf1b0315f1" status: 200 len: 1682 microversion: 2.1 time: 0.705437 Oct 04 21:04:34.580171 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2694/5367] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:04:33 2022] GET /compute/v2.1/servers/5a95bf94-24e7-43a2-9818-d5bf1b0315f1 => generated 1682 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:04:34.600263 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-66d3eab6-da84-489c-b533-2ebc1a3fdd51 req-b56dcbd4-30cd-42ef-b3d6-9da9c74648f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc9ad5af-1587-4aa1-8323-a50c91bb1b84", "name": "network-vif-plugged", "status": "completed", "tag": "1669c917-58c0-440d-8b0d-29a608119c96"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:04:34.623968 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-66d3eab6-da84-489c-b533-2ebc1a3fdd51 req-b56dcbd4-30cd-42ef-b3d6-9da9c74648f7 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:34.624845 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-66d3eab6-da84-489c-b533-2ebc1a3fdd51 req-b56dcbd4-30cd-42ef-b3d6-9da9c74648f7 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:34.625488 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-66d3eab6-da84-489c-b533-2ebc1a3fdd51 req-b56dcbd4-30cd-42ef-b3d6-9da9c74648f7 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:34.641554 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-66d3eab6-da84-489c-b533-2ebc1a3fdd51 req-b56dcbd4-30cd-42ef-b3d6-9da9c74648f7 service nova] Creating event network-vif-plugged:1669c917-58c0-440d-8b0d-29a608119c96 for instance cc9ad5af-1587-4aa1-8323-a50c91bb1b84 on n-h1-854823-8 Oct 04 21:04:34.648978 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-66d3eab6-da84-489c-b533-2ebc1a3fdd51 req-b56dcbd4-30cd-42ef-b3d6-9da9c74648f7 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065136 Oct 04 21:04:34.649961 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2695/5368] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:04:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:04:34.906980 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-5a61ea7d-b67d-4c4b-8d8e-7147c59200b6 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:04:34.908540 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-5a61ea7d-b67d-4c4b-8d8e-7147c59200b6 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] [instance: cc9ad5af-1587-4aa1-8323-a50c91bb1b84] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:04:34.918582 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5a61ea7d-b67d-4c4b-8d8e-7147c59200b6 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:34.919080 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5a61ea7d-b67d-4c4b-8d8e-7147c59200b6 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:34.919619 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5a61ea7d-b67d-4c4b-8d8e-7147c59200b6 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:34.920498 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5a61ea7d-b67d-4c4b-8d8e-7147c59200b6 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:34.921099 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5a61ea7d-b67d-4c4b-8d8e-7147c59200b6 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:34.921669 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5a61ea7d-b67d-4c4b-8d8e-7147c59200b6 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:35.089971 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-0098681e-63d4-4b6a-be77-beada497bf30 tempest-VolumesActionsTest-1831230653 tempest-VolumesActionsTest-1831230653-project] Flavor limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:04:35.091053 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-0098681e-63d4-4b6a-be77-beada497bf30 tempest-VolumesActionsTest-1831230653 tempest-VolumesActionsTest-1831230653-project] Image limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:04:35.091924 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-0098681e-63d4-4b6a-be77-beada497bf30 tempest-VolumesActionsTest-1831230653 tempest-VolumesActionsTest-1831230653-project] Flavor pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:04:35.092742 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-0098681e-63d4-4b6a-be77-beada497bf30 tempest-VolumesActionsTest-1831230653 tempest-VolumesActionsTest-1831230653-project] Image pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:04:35.093371 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-0098681e-63d4-4b6a-be77-beada497bf30 tempest-VolumesActionsTest-1831230653 tempest-VolumesActionsTest-1831230653-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:04:35.117746 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0098681e-63d4-4b6a-be77-beada497bf30 tempest-VolumesActionsTest-1831230653 tempest-VolumesActionsTest-1831230653-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:35.122769 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0098681e-63d4-4b6a-be77-beada497bf30 tempest-VolumesActionsTest-1831230653 tempest-VolumesActionsTest-1831230653-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:35.123648 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0098681e-63d4-4b6a-be77-beada497bf30 tempest-VolumesActionsTest-1831230653 tempest-VolumesActionsTest-1831230653-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:35.134000 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0098681e-63d4-4b6a-be77-beada497bf30 tempest-VolumesActionsTest-1831230653 tempest-VolumesActionsTest-1831230653-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:35.134945 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0098681e-63d4-4b6a-be77-beada497bf30 tempest-VolumesActionsTest-1831230653 tempest-VolumesActionsTest-1831230653-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:35.135618 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0098681e-63d4-4b6a-be77-beada497bf30 tempest-VolumesActionsTest-1831230653 tempest-VolumesActionsTest-1831230653-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:35.207192 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-0098681e-63d4-4b6a-be77-beada497bf30 tempest-VolumesActionsTest-1831230653 tempest-VolumesActionsTest-1831230653-project] Getting quotas for project 6c79f951035f421abba628c18c51c51e. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:04:35.215641 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-0098681e-63d4-4b6a-be77-beada497bf30 tempest-VolumesActionsTest-1831230653 tempest-VolumesActionsTest-1831230653-project] Getting quotas for user 93de6d52cd674c4d9b81053284ecc39c and project 6c79f951035f421abba628c18c51c51e. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:04:35.234288 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-0098681e-63d4-4b6a-be77-beada497bf30 tempest-VolumesActionsTest-1831230653 tempest-VolumesActionsTest-1831230653-project] Going to run 1 instances... {{(pid=128801) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:04:35.236958 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-0098681e-63d4-4b6a-be77-beada497bf30 tempest-VolumesActionsTest-1831230653 tempest-VolumesActionsTest-1831230653-project] [instance: 72c9aaec-4af2-4eec-9533-f2da591f203b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='15b24725-0c99-4bcf-b1fb-907cdf8e2d63',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128801) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:04:35.310990 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-0098681e-63d4-4b6a-be77-beada497bf30 tempest-VolumesActionsTest-1831230653 tempest-VolumesActionsTest-1831230653-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.262409 Oct 04 21:04:35.327709 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2674/5369] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 21:04:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 2280 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:04:35.349784 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-471c62b7-681e-4fe2-a1c9-314289003e3b tempest-VolumesActionsTest-1831230653 tempest-VolumesActionsTest-1831230653-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:04:35.366743 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-471c62b7-681e-4fe2-a1c9-314289003e3b tempest-VolumesActionsTest-1831230653 tempest-VolumesActionsTest-1831230653-project] [instance: 72c9aaec-4af2-4eec-9533-f2da591f203b] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:04:35.482014 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-5a61ea7d-b67d-4c4b-8d8e-7147c59200b6 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:04:35.498668 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-5a61ea7d-b67d-4c4b-8d8e-7147c59200b6 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:04:35.500356 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-5a61ea7d-b67d-4c4b-8d8e-7147c59200b6 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:04:35.505728 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-5a61ea7d-b67d-4c4b-8d8e-7147c59200b6 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] 10.222.0.33 "GET /compute/v2.1/servers/cc9ad5af-1587-4aa1-8323-a50c91bb1b84" status: 200 len: 1808 microversion: 2.20 time: 0.605681 Oct 04 21:04:35.506609 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2696/5370] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 21:04:34 2022] GET /compute/v2.1/servers/cc9ad5af-1587-4aa1-8323-a50c91bb1b84 => generated 1808 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:04:35.583193 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-471c62b7-681e-4fe2-a1c9-314289003e3b tempest-VolumesActionsTest-1831230653 tempest-VolumesActionsTest-1831230653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93de6d52cd674c4d9b81053284ecc39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c79f951035f421abba628c18c51c51e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:04:35.591192 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-471c62b7-681e-4fe2-a1c9-314289003e3b tempest-VolumesActionsTest-1831230653 tempest-VolumesActionsTest-1831230653-project] 10.222.0.33 "GET /compute/v2.1/servers/72c9aaec-4af2-4eec-9533-f2da591f203b" status: 200 len: 1213 microversion: 2.1 time: 0.261936 Oct 04 21:04:35.602205 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2675/5371] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:04:35 2022] GET /compute/v2.1/servers/72c9aaec-4af2-4eec-9533-f2da591f203b => generated 1213 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:04:36.545321 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-4ba1372d-f0ba-48e3-bfc6-225f978195df tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:04:36.546149 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-4ba1372d-f0ba-48e3-bfc6-225f978195df tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] [instance: cc9ad5af-1587-4aa1-8323-a50c91bb1b84] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:04:36.564883 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_api:SELECT=42 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:04:36.568707 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4ba1372d-f0ba-48e3-bfc6-225f978195df tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:36.569370 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4ba1372d-f0ba-48e3-bfc6-225f978195df tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:36.569822 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4ba1372d-f0ba-48e3-bfc6-225f978195df tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:36.573160 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4ba1372d-f0ba-48e3-bfc6-225f978195df tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:36.575171 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4ba1372d-f0ba-48e3-bfc6-225f978195df tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:36.575676 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4ba1372d-f0ba-48e3-bfc6-225f978195df tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:36.617055 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5dcc6ed0-450a-4ff2-a6eb-2a3216ec70c4 tempest-VolumesActionsTest-1831230653 tempest-VolumesActionsTest-1831230653-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:04:36.619277 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-5dcc6ed0-450a-4ff2-a6eb-2a3216ec70c4 tempest-VolumesActionsTest-1831230653 tempest-VolumesActionsTest-1831230653-project] [instance: 72c9aaec-4af2-4eec-9533-f2da591f203b] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:04:36.637079 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5dcc6ed0-450a-4ff2-a6eb-2a3216ec70c4 tempest-VolumesActionsTest-1831230653 tempest-VolumesActionsTest-1831230653-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:36.646857 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5dcc6ed0-450a-4ff2-a6eb-2a3216ec70c4 tempest-VolumesActionsTest-1831230653 tempest-VolumesActionsTest-1831230653-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:36.647315 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5dcc6ed0-450a-4ff2-a6eb-2a3216ec70c4 tempest-VolumesActionsTest-1831230653 tempest-VolumesActionsTest-1831230653-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:36.648075 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5dcc6ed0-450a-4ff2-a6eb-2a3216ec70c4 tempest-VolumesActionsTest-1831230653 tempest-VolumesActionsTest-1831230653-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:36.651148 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5dcc6ed0-450a-4ff2-a6eb-2a3216ec70c4 tempest-VolumesActionsTest-1831230653 tempest-VolumesActionsTest-1831230653-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:36.651633 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5dcc6ed0-450a-4ff2-a6eb-2a3216ec70c4 tempest-VolumesActionsTest-1831230653 tempest-VolumesActionsTest-1831230653-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:36.974432 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-5dcc6ed0-450a-4ff2-a6eb-2a3216ec70c4 tempest-VolumesActionsTest-1831230653 tempest-VolumesActionsTest-1831230653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93de6d52cd674c4d9b81053284ecc39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c79f951035f421abba628c18c51c51e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:04:36.992971 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5dcc6ed0-450a-4ff2-a6eb-2a3216ec70c4 tempest-VolumesActionsTest-1831230653 tempest-VolumesActionsTest-1831230653-project] 10.222.0.33 "GET /compute/v2.1/servers/72c9aaec-4af2-4eec-9533-f2da591f203b" status: 200 len: 1265 microversion: 2.1 time: 0.370254 Oct 04 21:04:36.993866 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2676/5372] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:04:36 2022] GET /compute/v2.1/servers/72c9aaec-4af2-4eec-9533-f2da591f203b => generated 1265 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:04:37.879604 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-4ba1372d-f0ba-48e3-bfc6-225f978195df tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:04:37.897529 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-4ba1372d-f0ba-48e3-bfc6-225f978195df tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:04:37.901823 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-4ba1372d-f0ba-48e3-bfc6-225f978195df tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:04:37.915429 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-4ba1372d-f0ba-48e3-bfc6-225f978195df tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] 10.222.0.33 "GET /compute/v2.1/servers/cc9ad5af-1587-4aa1-8323-a50c91bb1b84" status: 200 len: 1808 microversion: 2.20 time: 1.376508 Oct 04 21:04:37.920430 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2697/5373] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 21:04:36 2022] GET /compute/v2.1/servers/cc9ad5af-1587-4aa1-8323-a50c91bb1b84 => generated 1808 bytes in 1382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:04:38.026074 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-88bb5755-b6ae-41f0-8abc-ba4795e1865c tempest-VolumesActionsTest-1831230653 tempest-VolumesActionsTest-1831230653-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:04:38.027057 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-88bb5755-b6ae-41f0-8abc-ba4795e1865c tempest-VolumesActionsTest-1831230653 tempest-VolumesActionsTest-1831230653-project] [instance: 72c9aaec-4af2-4eec-9533-f2da591f203b] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:04:38.037776 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=3 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:04:38.040114 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-88bb5755-b6ae-41f0-8abc-ba4795e1865c tempest-VolumesActionsTest-1831230653 tempest-VolumesActionsTest-1831230653-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:38.041411 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-88bb5755-b6ae-41f0-8abc-ba4795e1865c tempest-VolumesActionsTest-1831230653 tempest-VolumesActionsTest-1831230653-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:38.042086 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-88bb5755-b6ae-41f0-8abc-ba4795e1865c tempest-VolumesActionsTest-1831230653 tempest-VolumesActionsTest-1831230653-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:38.044024 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-88bb5755-b6ae-41f0-8abc-ba4795e1865c tempest-VolumesActionsTest-1831230653 tempest-VolumesActionsTest-1831230653-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:38.044855 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-88bb5755-b6ae-41f0-8abc-ba4795e1865c tempest-VolumesActionsTest-1831230653 tempest-VolumesActionsTest-1831230653-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:38.045503 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-88bb5755-b6ae-41f0-8abc-ba4795e1865c tempest-VolumesActionsTest-1831230653 tempest-VolumesActionsTest-1831230653-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:38.167578 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-e90e8dce-ce42-48a0-8fb4-5354026c96db req-c0f1265f-5ec2-4d93-b646-b443419fe016 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a95bf94-24e7-43a2-9818-d5bf1b0315f1", "name": "network-vif-plugged", "status": "completed", "tag": "99e654db-1794-4804-bb52-dc567c83649d"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:04:38.188173 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-e90e8dce-ce42-48a0-8fb4-5354026c96db req-c0f1265f-5ec2-4d93-b646-b443419fe016 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:38.188856 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-e90e8dce-ce42-48a0-8fb4-5354026c96db req-c0f1265f-5ec2-4d93-b646-b443419fe016 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:38.189724 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-e90e8dce-ce42-48a0-8fb4-5354026c96db req-c0f1265f-5ec2-4d93-b646-b443419fe016 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:38.211487 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-e90e8dce-ce42-48a0-8fb4-5354026c96db req-c0f1265f-5ec2-4d93-b646-b443419fe016 service nova] Creating event network-vif-plugged:99e654db-1794-4804-bb52-dc567c83649d for instance 5a95bf94-24e7-43a2-9818-d5bf1b0315f1 on n-h2-854823-8 Oct 04 21:04:38.221440 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-88bb5755-b6ae-41f0-8abc-ba4795e1865c tempest-VolumesActionsTest-1831230653 tempest-VolumesActionsTest-1831230653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93de6d52cd674c4d9b81053284ecc39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c79f951035f421abba628c18c51c51e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:04:38.237002 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-e90e8dce-ce42-48a0-8fb4-5354026c96db req-c0f1265f-5ec2-4d93-b646-b443419fe016 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083367 Oct 04 21:04:38.237795 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-88bb5755-b6ae-41f0-8abc-ba4795e1865c tempest-VolumesActionsTest-1831230653 tempest-VolumesActionsTest-1831230653-project] 10.222.0.33 "GET /compute/v2.1/servers/72c9aaec-4af2-4eec-9533-f2da591f203b" status: 200 len: 1271 microversion: 2.1 time: 0.219181 Oct 04 21:04:38.239636 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2677/5374] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:04:38 2022] GET /compute/v2.1/servers/72c9aaec-4af2-4eec-9533-f2da591f203b => generated 1271 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:04:38.240157 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2698/5375] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:04:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:04:38.953494 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-3f7e373f-d22b-4398-bc41-1ed68161ca94 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:04:38.954587 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-3f7e373f-d22b-4398-bc41-1ed68161ca94 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] [instance: cc9ad5af-1587-4aa1-8323-a50c91bb1b84] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:04:38.963194 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3f7e373f-d22b-4398-bc41-1ed68161ca94 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:38.964455 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3f7e373f-d22b-4398-bc41-1ed68161ca94 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:38.965989 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3f7e373f-d22b-4398-bc41-1ed68161ca94 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:38.967708 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3f7e373f-d22b-4398-bc41-1ed68161ca94 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:38.968429 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3f7e373f-d22b-4398-bc41-1ed68161ca94 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:38.969275 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3f7e373f-d22b-4398-bc41-1ed68161ca94 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:39.267035 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-bceb3e72-029e-406f-b3e6-9a9eeb0f4610 tempest-VolumesActionsTest-1831230653 tempest-VolumesActionsTest-1831230653-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:04:39.268390 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-bceb3e72-029e-406f-b3e6-9a9eeb0f4610 tempest-VolumesActionsTest-1831230653 tempest-VolumesActionsTest-1831230653-project] [instance: 72c9aaec-4af2-4eec-9533-f2da591f203b] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:04:39.274995 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bceb3e72-029e-406f-b3e6-9a9eeb0f4610 tempest-VolumesActionsTest-1831230653 tempest-VolumesActionsTest-1831230653-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:39.275933 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bceb3e72-029e-406f-b3e6-9a9eeb0f4610 tempest-VolumesActionsTest-1831230653 tempest-VolumesActionsTest-1831230653-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:39.276430 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bceb3e72-029e-406f-b3e6-9a9eeb0f4610 tempest-VolumesActionsTest-1831230653 tempest-VolumesActionsTest-1831230653-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:39.278633 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bceb3e72-029e-406f-b3e6-9a9eeb0f4610 tempest-VolumesActionsTest-1831230653 tempest-VolumesActionsTest-1831230653-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:39.279188 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bceb3e72-029e-406f-b3e6-9a9eeb0f4610 tempest-VolumesActionsTest-1831230653 tempest-VolumesActionsTest-1831230653-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:39.279711 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bceb3e72-029e-406f-b3e6-9a9eeb0f4610 tempest-VolumesActionsTest-1831230653 tempest-VolumesActionsTest-1831230653-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:39.325054 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-3f7e373f-d22b-4398-bc41-1ed68161ca94 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:04:39.348730 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-3f7e373f-d22b-4398-bc41-1ed68161ca94 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:04:39.351357 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-3f7e373f-d22b-4398-bc41-1ed68161ca94 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:04:39.353798 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-3f7e373f-d22b-4398-bc41-1ed68161ca94 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] 10.222.0.33 "GET /compute/v2.1/servers/cc9ad5af-1587-4aa1-8323-a50c91bb1b84" status: 200 len: 1795 microversion: 2.20 time: 0.407005 Oct 04 21:04:39.356995 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2678/5376] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 21:04:38 2022] GET /compute/v2.1/servers/cc9ad5af-1587-4aa1-8323-a50c91bb1b84 => generated 1795 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:04:39.896041 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-bceb3e72-029e-406f-b3e6-9a9eeb0f4610 tempest-VolumesActionsTest-1831230653 tempest-VolumesActionsTest-1831230653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93de6d52cd674c4d9b81053284ecc39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c79f951035f421abba628c18c51c51e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:04:39.905129 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-bceb3e72-029e-406f-b3e6-9a9eeb0f4610 tempest-VolumesActionsTest-1831230653 tempest-VolumesActionsTest-1831230653-project] 10.222.0.33 "GET /compute/v2.1/servers/72c9aaec-4af2-4eec-9533-f2da591f203b" status: 200 len: 1313 microversion: 2.1 time: 0.643826 Oct 04 21:04:39.905826 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2699/5377] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:04:39 2022] GET /compute/v2.1/servers/72c9aaec-4af2-4eec-9533-f2da591f203b => generated 1313 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:04:40.931195 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-3e56d02f-cdba-44fe-99ab-a4234bb3831e tempest-VolumesActionsTest-1831230653 tempest-VolumesActionsTest-1831230653-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:04:40.931817 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-3e56d02f-cdba-44fe-99ab-a4234bb3831e tempest-VolumesActionsTest-1831230653 tempest-VolumesActionsTest-1831230653-project] [instance: 72c9aaec-4af2-4eec-9533-f2da591f203b] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:04:40.939298 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3e56d02f-cdba-44fe-99ab-a4234bb3831e tempest-VolumesActionsTest-1831230653 tempest-VolumesActionsTest-1831230653-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:40.940058 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3e56d02f-cdba-44fe-99ab-a4234bb3831e tempest-VolumesActionsTest-1831230653 tempest-VolumesActionsTest-1831230653-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:40.940662 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3e56d02f-cdba-44fe-99ab-a4234bb3831e tempest-VolumesActionsTest-1831230653 tempest-VolumesActionsTest-1831230653-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:40.941542 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3e56d02f-cdba-44fe-99ab-a4234bb3831e tempest-VolumesActionsTest-1831230653 tempest-VolumesActionsTest-1831230653-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:40.942211 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3e56d02f-cdba-44fe-99ab-a4234bb3831e tempest-VolumesActionsTest-1831230653 tempest-VolumesActionsTest-1831230653-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:40.942810 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3e56d02f-cdba-44fe-99ab-a4234bb3831e tempest-VolumesActionsTest-1831230653 tempest-VolumesActionsTest-1831230653-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:40.947350 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:04:41.232498 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-3e56d02f-cdba-44fe-99ab-a4234bb3831e tempest-VolumesActionsTest-1831230653 tempest-VolumesActionsTest-1831230653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93de6d52cd674c4d9b81053284ecc39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c79f951035f421abba628c18c51c51e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:04:41.241462 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-3e56d02f-cdba-44fe-99ab-a4234bb3831e tempest-VolumesActionsTest-1831230653 tempest-VolumesActionsTest-1831230653-project] 10.222.0.33 "GET /compute/v2.1/servers/72c9aaec-4af2-4eec-9533-f2da591f203b" status: 200 len: 1313 microversion: 2.1 time: 0.314189 Oct 04 21:04:41.243770 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2679/5378] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:04:40 2022] GET /compute/v2.1/servers/72c9aaec-4af2-4eec-9533-f2da591f203b => generated 1313 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:04:41.758897 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-a5a88ddf-839f-40b7-beb5-4bf206b49eb0 req-59b641ff-b234-4588-b3c2-15a7537af393 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "72c9aaec-4af2-4eec-9533-f2da591f203b", "tag": "8c7f70a4-03da-462c-8aba-a3e96f2c366d"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:04:41.774642 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-a5a88ddf-839f-40b7-beb5-4bf206b49eb0 req-59b641ff-b234-4588-b3c2-15a7537af393 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:41.776312 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-a5a88ddf-839f-40b7-beb5-4bf206b49eb0 req-59b641ff-b234-4588-b3c2-15a7537af393 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:41.777001 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-a5a88ddf-839f-40b7-beb5-4bf206b49eb0 req-59b641ff-b234-4588-b3c2-15a7537af393 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:41.798526 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-a5a88ddf-839f-40b7-beb5-4bf206b49eb0 req-59b641ff-b234-4588-b3c2-15a7537af393 service nova] Creating event network-changed:8c7f70a4-03da-462c-8aba-a3e96f2c366d for instance 72c9aaec-4af2-4eec-9533-f2da591f203b on n-h1-854823-8 Oct 04 21:04:41.804728 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-a5a88ddf-839f-40b7-beb5-4bf206b49eb0 req-59b641ff-b234-4588-b3c2-15a7537af393 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049303 Oct 04 21:04:41.806446 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2700/5379] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:04:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:04:42.267705 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-98d60617-5347-429d-8f74-16d3215f7c46 tempest-VolumesActionsTest-1831230653 tempest-VolumesActionsTest-1831230653-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:04:42.268380 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-98d60617-5347-429d-8f74-16d3215f7c46 tempest-VolumesActionsTest-1831230653 tempest-VolumesActionsTest-1831230653-project] [instance: 72c9aaec-4af2-4eec-9533-f2da591f203b] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:04:42.280147 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-98d60617-5347-429d-8f74-16d3215f7c46 tempest-VolumesActionsTest-1831230653 tempest-VolumesActionsTest-1831230653-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:42.281164 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-98d60617-5347-429d-8f74-16d3215f7c46 tempest-VolumesActionsTest-1831230653 tempest-VolumesActionsTest-1831230653-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:42.281841 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-98d60617-5347-429d-8f74-16d3215f7c46 tempest-VolumesActionsTest-1831230653 tempest-VolumesActionsTest-1831230653-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:42.283544 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-98d60617-5347-429d-8f74-16d3215f7c46 tempest-VolumesActionsTest-1831230653 tempest-VolumesActionsTest-1831230653-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:42.284017 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-98d60617-5347-429d-8f74-16d3215f7c46 tempest-VolumesActionsTest-1831230653 tempest-VolumesActionsTest-1831230653-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:42.284444 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-98d60617-5347-429d-8f74-16d3215f7c46 tempest-VolumesActionsTest-1831230653 tempest-VolumesActionsTest-1831230653-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:42.566652 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-98d60617-5347-429d-8f74-16d3215f7c46 tempest-VolumesActionsTest-1831230653 tempest-VolumesActionsTest-1831230653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93de6d52cd674c4d9b81053284ecc39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c79f951035f421abba628c18c51c51e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:04:42.581025 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-98d60617-5347-429d-8f74-16d3215f7c46 tempest-VolumesActionsTest-1831230653 tempest-VolumesActionsTest-1831230653-project] 10.222.0.33 "GET /compute/v2.1/servers/72c9aaec-4af2-4eec-9533-f2da591f203b" status: 200 len: 1313 microversion: 2.1 time: 0.316761 Oct 04 21:04:42.582255 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2680/5380] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:04:42 2022] GET /compute/v2.1/servers/72c9aaec-4af2-4eec-9533-f2da591f203b => generated 1313 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:04:43.607921 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-88d611e0-e0b7-4dcc-b72d-3488bdbb6790 tempest-VolumesActionsTest-1831230653 tempest-VolumesActionsTest-1831230653-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:04:43.609291 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-88d611e0-e0b7-4dcc-b72d-3488bdbb6790 tempest-VolumesActionsTest-1831230653 tempest-VolumesActionsTest-1831230653-project] [instance: 72c9aaec-4af2-4eec-9533-f2da591f203b] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:04:43.623481 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-88d611e0-e0b7-4dcc-b72d-3488bdbb6790 tempest-VolumesActionsTest-1831230653 tempest-VolumesActionsTest-1831230653-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:43.624321 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-88d611e0-e0b7-4dcc-b72d-3488bdbb6790 tempest-VolumesActionsTest-1831230653 tempest-VolumesActionsTest-1831230653-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:43.625104 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-88d611e0-e0b7-4dcc-b72d-3488bdbb6790 tempest-VolumesActionsTest-1831230653 tempest-VolumesActionsTest-1831230653-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:43.626260 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-88d611e0-e0b7-4dcc-b72d-3488bdbb6790 tempest-VolumesActionsTest-1831230653 tempest-VolumesActionsTest-1831230653-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:43.626936 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-88d611e0-e0b7-4dcc-b72d-3488bdbb6790 tempest-VolumesActionsTest-1831230653 tempest-VolumesActionsTest-1831230653-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:43.627648 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-88d611e0-e0b7-4dcc-b72d-3488bdbb6790 tempest-VolumesActionsTest-1831230653 tempest-VolumesActionsTest-1831230653-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:44.160412 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-88d611e0-e0b7-4dcc-b72d-3488bdbb6790 tempest-VolumesActionsTest-1831230653 tempest-VolumesActionsTest-1831230653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93de6d52cd674c4d9b81053284ecc39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c79f951035f421abba628c18c51c51e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:04:44.169457 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-88d611e0-e0b7-4dcc-b72d-3488bdbb6790 tempest-VolumesActionsTest-1831230653 tempest-VolumesActionsTest-1831230653-project] 10.222.0.33 "GET /compute/v2.1/servers/72c9aaec-4af2-4eec-9533-f2da591f203b" status: 200 len: 1313 microversion: 2.1 time: 0.568000 Oct 04 21:04:44.170226 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2701/5381] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:04:43 2022] GET /compute/v2.1/servers/72c9aaec-4af2-4eec-9533-f2da591f203b => generated 1313 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:04:45.192990 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-00ae84b3-4750-4173-90b7-854bbe0da888 tempest-VolumesActionsTest-1831230653 tempest-VolumesActionsTest-1831230653-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:04:45.193683 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-00ae84b3-4750-4173-90b7-854bbe0da888 tempest-VolumesActionsTest-1831230653 tempest-VolumesActionsTest-1831230653-project] [instance: 72c9aaec-4af2-4eec-9533-f2da591f203b] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:04:45.197574 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:04:45.202108 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-00ae84b3-4750-4173-90b7-854bbe0da888 tempest-VolumesActionsTest-1831230653 tempest-VolumesActionsTest-1831230653-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:45.202851 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-00ae84b3-4750-4173-90b7-854bbe0da888 tempest-VolumesActionsTest-1831230653 tempest-VolumesActionsTest-1831230653-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:45.203293 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-00ae84b3-4750-4173-90b7-854bbe0da888 tempest-VolumesActionsTest-1831230653 tempest-VolumesActionsTest-1831230653-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:45.204007 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-00ae84b3-4750-4173-90b7-854bbe0da888 tempest-VolumesActionsTest-1831230653 tempest-VolumesActionsTest-1831230653-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:45.204469 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-00ae84b3-4750-4173-90b7-854bbe0da888 tempest-VolumesActionsTest-1831230653 tempest-VolumesActionsTest-1831230653-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:45.204897 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-00ae84b3-4750-4173-90b7-854bbe0da888 tempest-VolumesActionsTest-1831230653 tempest-VolumesActionsTest-1831230653-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:45.587334 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=8 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:04:45.923671 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-00ae84b3-4750-4173-90b7-854bbe0da888 tempest-VolumesActionsTest-1831230653 tempest-VolumesActionsTest-1831230653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93de6d52cd674c4d9b81053284ecc39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c79f951035f421abba628c18c51c51e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:04:45.941028 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-00ae84b3-4750-4173-90b7-854bbe0da888 tempest-VolumesActionsTest-1831230653 tempest-VolumesActionsTest-1831230653-project] 10.222.0.33 "GET /compute/v2.1/servers/72c9aaec-4af2-4eec-9533-f2da591f203b" status: 200 len: 1313 microversion: 2.1 time: 0.751852 Oct 04 21:04:45.946547 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2681/5382] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:04:45 2022] GET /compute/v2.1/servers/72c9aaec-4af2-4eec-9533-f2da591f203b => generated 1313 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:04:46.965282 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-35b1d37e-8d73-4377-8c0a-3cddeadeb020 tempest-VolumesActionsTest-1831230653 tempest-VolumesActionsTest-1831230653-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:04:46.966881 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-35b1d37e-8d73-4377-8c0a-3cddeadeb020 tempest-VolumesActionsTest-1831230653 tempest-VolumesActionsTest-1831230653-project] [instance: 72c9aaec-4af2-4eec-9533-f2da591f203b] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:04:46.974282 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-35b1d37e-8d73-4377-8c0a-3cddeadeb020 tempest-VolumesActionsTest-1831230653 tempest-VolumesActionsTest-1831230653-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:46.974862 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-35b1d37e-8d73-4377-8c0a-3cddeadeb020 tempest-VolumesActionsTest-1831230653 tempest-VolumesActionsTest-1831230653-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:46.975321 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-35b1d37e-8d73-4377-8c0a-3cddeadeb020 tempest-VolumesActionsTest-1831230653 tempest-VolumesActionsTest-1831230653-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:46.976019 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-35b1d37e-8d73-4377-8c0a-3cddeadeb020 tempest-VolumesActionsTest-1831230653 tempest-VolumesActionsTest-1831230653-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:46.976787 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-35b1d37e-8d73-4377-8c0a-3cddeadeb020 tempest-VolumesActionsTest-1831230653 tempest-VolumesActionsTest-1831230653-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:46.977224 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-35b1d37e-8d73-4377-8c0a-3cddeadeb020 tempest-VolumesActionsTest-1831230653 tempest-VolumesActionsTest-1831230653-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:47.356070 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-35b1d37e-8d73-4377-8c0a-3cddeadeb020 tempest-VolumesActionsTest-1831230653 tempest-VolumesActionsTest-1831230653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93de6d52cd674c4d9b81053284ecc39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c79f951035f421abba628c18c51c51e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:04:47.365196 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=100 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:04:47.377922 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-35b1d37e-8d73-4377-8c0a-3cddeadeb020 tempest-VolumesActionsTest-1831230653 tempest-VolumesActionsTest-1831230653-project] 10.222.0.33 "GET /compute/v2.1/servers/72c9aaec-4af2-4eec-9533-f2da591f203b" status: 200 len: 1313 microversion: 2.1 time: 0.416496 Oct 04 21:04:47.389551 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2702/5383] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:04:46 2022] GET /compute/v2.1/servers/72c9aaec-4af2-4eec-9533-f2da591f203b => generated 1313 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:04:48.033358 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-8528f943-73d3-47b2-ab0c-cea820872181 req-d0f8c968-368e-436c-93bc-e86976220d10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72c9aaec-4af2-4eec-9533-f2da591f203b", "name": "network-vif-plugged", "status": "completed", "tag": "8c7f70a4-03da-462c-8aba-a3e96f2c366d"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:04:48.053171 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-8528f943-73d3-47b2-ab0c-cea820872181 req-d0f8c968-368e-436c-93bc-e86976220d10 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:48.053956 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-8528f943-73d3-47b2-ab0c-cea820872181 req-d0f8c968-368e-436c-93bc-e86976220d10 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:48.054584 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-8528f943-73d3-47b2-ab0c-cea820872181 req-d0f8c968-368e-436c-93bc-e86976220d10 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:48.076092 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-8528f943-73d3-47b2-ab0c-cea820872181 req-d0f8c968-368e-436c-93bc-e86976220d10 service nova] Creating event network-vif-plugged:8c7f70a4-03da-462c-8aba-a3e96f2c366d for instance 72c9aaec-4af2-4eec-9533-f2da591f203b on n-h1-854823-8 Oct 04 21:04:48.082119 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-8528f943-73d3-47b2-ab0c-cea820872181 req-d0f8c968-368e-436c-93bc-e86976220d10 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054750 Oct 04 21:04:48.084134 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2682/5384] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:04:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:04:48.415279 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-f3661bd8-660f-449e-9e5a-07d1b4480f82 tempest-VolumesActionsTest-1831230653 tempest-VolumesActionsTest-1831230653-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:04:48.416821 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-f3661bd8-660f-449e-9e5a-07d1b4480f82 tempest-VolumesActionsTest-1831230653 tempest-VolumesActionsTest-1831230653-project] [instance: 72c9aaec-4af2-4eec-9533-f2da591f203b] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:04:48.429042 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f3661bd8-660f-449e-9e5a-07d1b4480f82 tempest-VolumesActionsTest-1831230653 tempest-VolumesActionsTest-1831230653-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:48.429871 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f3661bd8-660f-449e-9e5a-07d1b4480f82 tempest-VolumesActionsTest-1831230653 tempest-VolumesActionsTest-1831230653-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:48.430896 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f3661bd8-660f-449e-9e5a-07d1b4480f82 tempest-VolumesActionsTest-1831230653 tempest-VolumesActionsTest-1831230653-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:48.432361 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f3661bd8-660f-449e-9e5a-07d1b4480f82 tempest-VolumesActionsTest-1831230653 tempest-VolumesActionsTest-1831230653-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:48.434597 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f3661bd8-660f-449e-9e5a-07d1b4480f82 tempest-VolumesActionsTest-1831230653 tempest-VolumesActionsTest-1831230653-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:48.435592 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f3661bd8-660f-449e-9e5a-07d1b4480f82 tempest-VolumesActionsTest-1831230653 tempest-VolumesActionsTest-1831230653-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:48.766476 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-f3661bd8-660f-449e-9e5a-07d1b4480f82 tempest-VolumesActionsTest-1831230653 tempest-VolumesActionsTest-1831230653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93de6d52cd674c4d9b81053284ecc39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c79f951035f421abba628c18c51c51e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:04:48.776435 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-f3661bd8-660f-449e-9e5a-07d1b4480f82 tempest-VolumesActionsTest-1831230653 tempest-VolumesActionsTest-1831230653-project] 10.222.0.33 "GET /compute/v2.1/servers/72c9aaec-4af2-4eec-9533-f2da591f203b" status: 200 len: 1313 microversion: 2.1 time: 0.367727 Oct 04 21:04:48.780319 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2703/5385] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:04:48 2022] GET /compute/v2.1/servers/72c9aaec-4af2-4eec-9533-f2da591f203b => generated 1313 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:04:49.804666 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f7dac99c-cdcf-47ab-8557-01316a919131 tempest-VolumesActionsTest-1831230653 tempest-VolumesActionsTest-1831230653-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:04:49.806196 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f7dac99c-cdcf-47ab-8557-01316a919131 tempest-VolumesActionsTest-1831230653 tempest-VolumesActionsTest-1831230653-project] [instance: 72c9aaec-4af2-4eec-9533-f2da591f203b] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:04:49.821585 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f7dac99c-cdcf-47ab-8557-01316a919131 tempest-VolumesActionsTest-1831230653 tempest-VolumesActionsTest-1831230653-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:49.826178 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f7dac99c-cdcf-47ab-8557-01316a919131 tempest-VolumesActionsTest-1831230653 tempest-VolumesActionsTest-1831230653-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:49.827040 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f7dac99c-cdcf-47ab-8557-01316a919131 tempest-VolumesActionsTest-1831230653 tempest-VolumesActionsTest-1831230653-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:49.829786 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f7dac99c-cdcf-47ab-8557-01316a919131 tempest-VolumesActionsTest-1831230653 tempest-VolumesActionsTest-1831230653-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:49.831650 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f7dac99c-cdcf-47ab-8557-01316a919131 tempest-VolumesActionsTest-1831230653 tempest-VolumesActionsTest-1831230653-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:49.832463 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f7dac99c-cdcf-47ab-8557-01316a919131 tempest-VolumesActionsTest-1831230653 tempest-VolumesActionsTest-1831230653-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:50.057514 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f7dac99c-cdcf-47ab-8557-01316a919131 tempest-VolumesActionsTest-1831230653 tempest-VolumesActionsTest-1831230653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93de6d52cd674c4d9b81053284ecc39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c79f951035f421abba628c18c51c51e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:04:50.067399 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f7dac99c-cdcf-47ab-8557-01316a919131 tempest-VolumesActionsTest-1831230653 tempest-VolumesActionsTest-1831230653-project] 10.222.0.33 "GET /compute/v2.1/servers/72c9aaec-4af2-4eec-9533-f2da591f203b" status: 200 len: 1497 microversion: 2.1 time: 0.267914 Oct 04 21:04:50.068356 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2683/5386] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:04:49 2022] GET /compute/v2.1/servers/72c9aaec-4af2-4eec-9533-f2da591f203b => generated 1497 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:04:54.703806 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-b8733a0a-4cf6-4d11-ba4d-7f137fd6b2bb tempest-VolumesActionsTest-1831230653 tempest-VolumesActionsTest-1831230653-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:04:54.704377 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-b8733a0a-4cf6-4d11-ba4d-7f137fd6b2bb tempest-VolumesActionsTest-1831230653 tempest-VolumesActionsTest-1831230653-project] [instance: 72c9aaec-4af2-4eec-9533-f2da591f203b] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:04:54.716489 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b8733a0a-4cf6-4d11-ba4d-7f137fd6b2bb tempest-VolumesActionsTest-1831230653 tempest-VolumesActionsTest-1831230653-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:54.717103 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b8733a0a-4cf6-4d11-ba4d-7f137fd6b2bb tempest-VolumesActionsTest-1831230653 tempest-VolumesActionsTest-1831230653-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:54.717800 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b8733a0a-4cf6-4d11-ba4d-7f137fd6b2bb tempest-VolumesActionsTest-1831230653 tempest-VolumesActionsTest-1831230653-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:54.718519 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b8733a0a-4cf6-4d11-ba4d-7f137fd6b2bb tempest-VolumesActionsTest-1831230653 tempest-VolumesActionsTest-1831230653-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:54.719301 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b8733a0a-4cf6-4d11-ba4d-7f137fd6b2bb tempest-VolumesActionsTest-1831230653 tempest-VolumesActionsTest-1831230653-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:54.719653 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b8733a0a-4cf6-4d11-ba4d-7f137fd6b2bb tempest-VolumesActionsTest-1831230653 tempest-VolumesActionsTest-1831230653-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:54.761119 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-b8733a0a-4cf6-4d11-ba4d-7f137fd6b2bb tempest-VolumesActionsTest-1831230653 tempest-VolumesActionsTest-1831230653-project] [instance: 72c9aaec-4af2-4eec-9533-f2da591f203b] Going to try to terminate instance {{(pid=128802) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:04:54.895400 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-b8733a0a-4cf6-4d11-ba4d-7f137fd6b2bb tempest-VolumesActionsTest-1831230653 tempest-VolumesActionsTest-1831230653-project] 10.222.0.33 "DELETE /compute/v2.1/servers/72c9aaec-4af2-4eec-9533-f2da591f203b" status: 204 len: 0 microversion: 2.1 time: 0.198320 Oct 04 21:04:54.900128 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2704/5387] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 21:04:54 2022] DELETE /compute/v2.1/servers/72c9aaec-4af2-4eec-9533-f2da591f203b => generated 0 bytes in 201 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:04:54.906320 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-bc742a73-0671-46cb-b77c-3a42c602540f tempest-VolumesActionsTest-1831230653 tempest-VolumesActionsTest-1831230653-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:04:54.907784 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-bc742a73-0671-46cb-b77c-3a42c602540f tempest-VolumesActionsTest-1831230653 tempest-VolumesActionsTest-1831230653-project] [instance: 72c9aaec-4af2-4eec-9533-f2da591f203b] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:04:54.926941 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bc742a73-0671-46cb-b77c-3a42c602540f tempest-VolumesActionsTest-1831230653 tempest-VolumesActionsTest-1831230653-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:54.927435 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bc742a73-0671-46cb-b77c-3a42c602540f tempest-VolumesActionsTest-1831230653 tempest-VolumesActionsTest-1831230653-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:54.927898 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bc742a73-0671-46cb-b77c-3a42c602540f tempest-VolumesActionsTest-1831230653 tempest-VolumesActionsTest-1831230653-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:54.928642 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bc742a73-0671-46cb-b77c-3a42c602540f tempest-VolumesActionsTest-1831230653 tempest-VolumesActionsTest-1831230653-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:54.929095 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bc742a73-0671-46cb-b77c-3a42c602540f tempest-VolumesActionsTest-1831230653 tempest-VolumesActionsTest-1831230653-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:54.929512 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bc742a73-0671-46cb-b77c-3a42c602540f tempest-VolumesActionsTest-1831230653 tempest-VolumesActionsTest-1831230653-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:55.199991 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-bc742a73-0671-46cb-b77c-3a42c602540f tempest-VolumesActionsTest-1831230653 tempest-VolumesActionsTest-1831230653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93de6d52cd674c4d9b81053284ecc39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c79f951035f421abba628c18c51c51e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:04:55.208161 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-bc742a73-0671-46cb-b77c-3a42c602540f tempest-VolumesActionsTest-1831230653 tempest-VolumesActionsTest-1831230653-project] 10.222.0.33 "GET /compute/v2.1/servers/72c9aaec-4af2-4eec-9533-f2da591f203b" status: 200 len: 1503 microversion: 2.1 time: 0.306839 Oct 04 21:04:55.214864 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2684/5388] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:04:54 2022] GET /compute/v2.1/servers/72c9aaec-4af2-4eec-9533-f2da591f203b => generated 1503 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:04:56.242892 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-4ab62477-e9d4-4abe-b195-760c43b99c49 tempest-VolumesActionsTest-1831230653 tempest-VolumesActionsTest-1831230653-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:04:56.244452 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-4ab62477-e9d4-4abe-b195-760c43b99c49 tempest-VolumesActionsTest-1831230653 tempest-VolumesActionsTest-1831230653-project] [instance: 72c9aaec-4af2-4eec-9533-f2da591f203b] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:04:56.260633 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4ab62477-e9d4-4abe-b195-760c43b99c49 tempest-VolumesActionsTest-1831230653 tempest-VolumesActionsTest-1831230653-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:56.263769 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4ab62477-e9d4-4abe-b195-760c43b99c49 tempest-VolumesActionsTest-1831230653 tempest-VolumesActionsTest-1831230653-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:56.264245 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4ab62477-e9d4-4abe-b195-760c43b99c49 tempest-VolumesActionsTest-1831230653 tempest-VolumesActionsTest-1831230653-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:56.264975 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4ab62477-e9d4-4abe-b195-760c43b99c49 tempest-VolumesActionsTest-1831230653 tempest-VolumesActionsTest-1831230653-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:56.265450 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4ab62477-e9d4-4abe-b195-760c43b99c49 tempest-VolumesActionsTest-1831230653 tempest-VolumesActionsTest-1831230653-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:56.265840 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4ab62477-e9d4-4abe-b195-760c43b99c49 tempest-VolumesActionsTest-1831230653 tempest-VolumesActionsTest-1831230653-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:56.603066 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-4ab62477-e9d4-4abe-b195-760c43b99c49 tempest-VolumesActionsTest-1831230653 tempest-VolumesActionsTest-1831230653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93de6d52cd674c4d9b81053284ecc39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c79f951035f421abba628c18c51c51e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:04:56.616639 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-4ab62477-e9d4-4abe-b195-760c43b99c49 tempest-VolumesActionsTest-1831230653 tempest-VolumesActionsTest-1831230653-project] 10.222.0.33 "GET /compute/v2.1/servers/72c9aaec-4af2-4eec-9533-f2da591f203b" status: 200 len: 1503 microversion: 2.1 time: 0.380409 Oct 04 21:04:56.617529 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2705/5389] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:04:56 2022] GET /compute/v2.1/servers/72c9aaec-4af2-4eec-9533-f2da591f203b => generated 1503 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:04:57.418303 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-f8557ef1-c1be-4d9c-ab3c-f264adca2df8 req-f74f1886-3bc7-4847-9dfb-2bbea019c541 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72c9aaec-4af2-4eec-9533-f2da591f203b", "name": "network-vif-deleted", "tag": "8c7f70a4-03da-462c-8aba-a3e96f2c366d"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:04:57.434500 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-f8557ef1-c1be-4d9c-ab3c-f264adca2df8 req-f74f1886-3bc7-4847-9dfb-2bbea019c541 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:57.435562 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-f8557ef1-c1be-4d9c-ab3c-f264adca2df8 req-f74f1886-3bc7-4847-9dfb-2bbea019c541 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:57.438294 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-f8557ef1-c1be-4d9c-ab3c-f264adca2df8 req-f74f1886-3bc7-4847-9dfb-2bbea019c541 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:57.467612 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-f8557ef1-c1be-4d9c-ab3c-f264adca2df8 req-f74f1886-3bc7-4847-9dfb-2bbea019c541 service nova] Creating event network-vif-deleted:8c7f70a4-03da-462c-8aba-a3e96f2c366d for instance 72c9aaec-4af2-4eec-9533-f2da591f203b on n-h1-854823-8 Oct 04 21:04:57.473579 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-f8557ef1-c1be-4d9c-ab3c-f264adca2df8 req-f74f1886-3bc7-4847-9dfb-2bbea019c541 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.359993 Oct 04 21:04:57.475307 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2685/5390] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:04:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:04:57.647691 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-5811e0ce-5eb1-4946-b3cd-0e1974456af3 tempest-VolumesActionsTest-1831230653 tempest-VolumesActionsTest-1831230653-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:04:57.662420 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-5811e0ce-5eb1-4946-b3cd-0e1974456af3 tempest-VolumesActionsTest-1831230653 tempest-VolumesActionsTest-1831230653-project] [instance: 72c9aaec-4af2-4eec-9533-f2da591f203b] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:04:57.691940 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5811e0ce-5eb1-4946-b3cd-0e1974456af3 tempest-VolumesActionsTest-1831230653 tempest-VolumesActionsTest-1831230653-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:57.706016 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5811e0ce-5eb1-4946-b3cd-0e1974456af3 tempest-VolumesActionsTest-1831230653 tempest-VolumesActionsTest-1831230653-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:57.707091 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5811e0ce-5eb1-4946-b3cd-0e1974456af3 tempest-VolumesActionsTest-1831230653 tempest-VolumesActionsTest-1831230653-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:57.708188 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5811e0ce-5eb1-4946-b3cd-0e1974456af3 tempest-VolumesActionsTest-1831230653 tempest-VolumesActionsTest-1831230653-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:57.709686 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5811e0ce-5eb1-4946-b3cd-0e1974456af3 tempest-VolumesActionsTest-1831230653 tempest-VolumesActionsTest-1831230653-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:57.710559 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5811e0ce-5eb1-4946-b3cd-0e1974456af3 tempest-VolumesActionsTest-1831230653 tempest-VolumesActionsTest-1831230653-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:57.789355 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5811e0ce-5eb1-4946-b3cd-0e1974456af3 tempest-VolumesActionsTest-1831230653 tempest-VolumesActionsTest-1831230653-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:57.789990 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5811e0ce-5eb1-4946-b3cd-0e1974456af3 tempest-VolumesActionsTest-1831230653 tempest-VolumesActionsTest-1831230653-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:57.790491 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5811e0ce-5eb1-4946-b3cd-0e1974456af3 tempest-VolumesActionsTest-1831230653 tempest-VolumesActionsTest-1831230653-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:57.796770 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.objects.instance [None req-5811e0ce-5eb1-4946-b3cd-0e1974456af3 tempest-VolumesActionsTest-1831230653 tempest-VolumesActionsTest-1831230653-project] Lazy-loading 'fault' on Instance uuid 72c9aaec-4af2-4eec-9533-f2da591f203b {{(pid=128802) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:04:57.908908 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-5811e0ce-5eb1-4946-b3cd-0e1974456af3 tempest-VolumesActionsTest-1831230653 tempest-VolumesActionsTest-1831230653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93de6d52cd674c4d9b81053284ecc39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c79f951035f421abba628c18c51c51e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:04:57.922612 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-5811e0ce-5eb1-4946-b3cd-0e1974456af3 tempest-VolumesActionsTest-1831230653 tempest-VolumesActionsTest-1831230653-project] 10.222.0.33 "GET /compute/v2.1/servers/72c9aaec-4af2-4eec-9533-f2da591f203b" status: 200 len: 1303 microversion: 2.1 time: 0.284407 Oct 04 21:04:57.926183 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2706/5391] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:04:57 2022] GET /compute/v2.1/servers/72c9aaec-4af2-4eec-9533-f2da591f203b => generated 1303 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:04:58.887132 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-fbecaf41-0e86-44db-9a16-e0d0bc373df4 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:04:58.889412 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-fbecaf41-0e86-44db-9a16-e0d0bc373df4 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] [instance: 5a95bf94-24e7-43a2-9818-d5bf1b0315f1] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:04:58.902620 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fbecaf41-0e86-44db-9a16-e0d0bc373df4 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:58.903122 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fbecaf41-0e86-44db-9a16-e0d0bc373df4 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:58.905481 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fbecaf41-0e86-44db-9a16-e0d0bc373df4 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:58.906240 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fbecaf41-0e86-44db-9a16-e0d0bc373df4 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:58.906744 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fbecaf41-0e86-44db-9a16-e0d0bc373df4 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:58.910962 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fbecaf41-0e86-44db-9a16-e0d0bc373df4 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:58.960839 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-f90d6d13-d608-4f4e-a0d6-de7282da7543 tempest-VolumesActionsTest-1831230653 tempest-VolumesActionsTest-1831230653-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:04:58.962625 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-f90d6d13-d608-4f4e-a0d6-de7282da7543 tempest-VolumesActionsTest-1831230653 tempest-VolumesActionsTest-1831230653-project] [instance: 72c9aaec-4af2-4eec-9533-f2da591f203b] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:04:58.983565 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f90d6d13-d608-4f4e-a0d6-de7282da7543 tempest-VolumesActionsTest-1831230653 tempest-VolumesActionsTest-1831230653-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:58.984075 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f90d6d13-d608-4f4e-a0d6-de7282da7543 tempest-VolumesActionsTest-1831230653 tempest-VolumesActionsTest-1831230653-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:58.987583 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f90d6d13-d608-4f4e-a0d6-de7282da7543 tempest-VolumesActionsTest-1831230653 tempest-VolumesActionsTest-1831230653-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:58.988278 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f90d6d13-d608-4f4e-a0d6-de7282da7543 tempest-VolumesActionsTest-1831230653 tempest-VolumesActionsTest-1831230653-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:04:58.988882 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f90d6d13-d608-4f4e-a0d6-de7282da7543 tempest-VolumesActionsTest-1831230653 tempest-VolumesActionsTest-1831230653-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:04:58.989720 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f90d6d13-d608-4f4e-a0d6-de7282da7543 tempest-VolumesActionsTest-1831230653 tempest-VolumesActionsTest-1831230653-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:04:59.018220 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.wsgi [None req-f90d6d13-d608-4f4e-a0d6-de7282da7543 tempest-VolumesActionsTest-1831230653 tempest-VolumesActionsTest-1831230653-project] HTTP exception thrown: Instance 72c9aaec-4af2-4eec-9533-f2da591f203b could not be found. Oct 04 21:04:59.026123 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-f90d6d13-d608-4f4e-a0d6-de7282da7543 tempest-VolumesActionsTest-1831230653 tempest-VolumesActionsTest-1831230653-project] Request method failure captured: Oct 04 21:04:59.026123 n-d-854823-8 devstack@n-api.service[128802]: request: GET /compute/v2.1/servers/72c9aaec-4af2-4eec-9533-f2da591f203b HTTP/1.1 Oct 04 21:04:59.026123 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 21:04:59.026123 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 21:04:59.026123 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 21:04:59.026123 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 0 Oct 04 21:04:59.026123 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 21:04:59.026123 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 21:04:59.026123 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 21:04:59.026123 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 21:04:59.026123 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPJ_cbhsHsSuLQzOVqgiqvcuz5z20XHpDS23zDChMEfIShI9tYoKRnjyFL7OXIxXZKJnb9lkAPYJEdrp5d1GHBU89b4ZOgsvsX_p9t2K-jGTEj07XuV7t9hMwPsXBYNbULr5WZw7xRoSOLyJMog3OT219woC4RlrjMHnI73z_RsyDqUU Oct 04 21:04:59.026123 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 21:04:59.026123 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 21:04:59.026123 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 21:04:59.026123 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 21:04:59.026123 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 21:04:59.026123 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 21:04:59.026123 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: 6c79f951035f421abba628c18c51c51e Oct 04 21:04:59.026123 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-VolumesActionsTest-1831230653 Oct 04 21:04:59.026123 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 21:04:59.026123 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 21:04:59.026123 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_6c79f951035f421abba628c18c51c51e", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/6c79f951035f421abba628c18c51c51e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/6c79f951035f421abba628c18c51c51e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/6c79f951035f421abba628c18c51c51e"}]}] Oct 04 21:04:59.026123 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-VolumesActionsTest-1831230653 Oct 04 21:04:59.026123 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: 6c79f951035f421abba628c18c51c51e Oct 04 21:04:59.026123 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-VolumesActionsTest-1831230653 Oct 04 21:04:59.026123 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-VolumesActionsTest-1831230653-project Oct 04 21:04:59.026123 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 21:04:59.026123 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 21:04:59.026123 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: 93de6d52cd674c4d9b81053284ecc39c Oct 04 21:04:59.026123 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-VolumesActionsTest-1831230653-project Oct 04 21:04:59.026123 n-d-854823-8 devstack@n-api.service[128802]: method: > Oct 04 21:04:59.026123 n-d-854823-8 devstack@n-api.service[128802]: exception: Instance 72c9aaec-4af2-4eec-9533-f2da591f203b could not be found. Oct 04 21:04:59.026123 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'id': '72c9aaec-4af2-4eec-9533-f2da591f203b'} Oct 04 21:04:59.026123 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:04:59.026123 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:04:59.026123 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:04:59.026123 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:04:59.026123 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:04:59.026123 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:04:59.026123 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:04:59.026123 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:04:59.026123 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:04:59.026123 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:04:59.026123 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 72c9aaec-4af2-4eec-9533-f2da591f203b could not be found. Oct 04 21:04:59.026123 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:04:59.026123 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:04:59.026123 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:04:59.026123 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:04:59.026123 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:04:59.026123 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:04:59.026123 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:04:59.026123 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:04:59.026123 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:04:59.026123 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:04:59.026123 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:04:59.026123 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:04:59.026123 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:04:59.026123 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:04:59.026123 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:04:59.026123 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:04:59.026123 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 72c9aaec-4af2-4eec-9533-f2da591f203b could not be found. Oct 04 21:04:59.026123 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:04:59.026123 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:04:59.026123 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:04:59.032032 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:04:59.032032 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:04:59.032032 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:04:59.032032 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:04:59.032032 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:04:59.032032 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 72c9aaec-4af2-4eec-9533-f2da591f203b could not be found. Oct 04 21:04:59.032032 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:04:59.032032 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-f90d6d13-d608-4f4e-a0d6-de7282da7543 tempest-VolumesActionsTest-1831230653 tempest-VolumesActionsTest-1831230653-project] Returning 404 to user: Instance 72c9aaec-4af2-4eec-9533-f2da591f203b could not be found. {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:04:59.032032 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-f90d6d13-d608-4f4e-a0d6-de7282da7543 tempest-VolumesActionsTest-1831230653 tempest-VolumesActionsTest-1831230653-project] 10.222.0.33 "GET /compute/v2.1/servers/72c9aaec-4af2-4eec-9533-f2da591f203b" status: 404 len: 111 microversion: 2.1 time: 0.072479 Oct 04 21:04:59.032032 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2707/5392] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:04:58 2022] GET /compute/v2.1/servers/72c9aaec-4af2-4eec-9533-f2da591f203b => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 21:04:59.046088 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-fbecaf41-0e86-44db-9a16-e0d0bc373df4 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] 10.222.0.33 "POST /compute/v2.1/servers/5a95bf94-24e7-43a2-9818-d5bf1b0315f1/action" status: 200 len: 63144 microversion: 2.1 time: 0.164175 Oct 04 21:04:59.046823 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2686/5393] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 21:04:58 2022] POST /compute/v2.1/servers/5a95bf94-24e7-43a2-9818-d5bf1b0315f1/action => generated 63144 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 21:05:05.965062 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-165859b4-eccc-44dd-a531-6f02d00d32d1 tempest-TestNetworkAdvancedServerOps-2095277972 tempest-TestNetworkAdvancedServerOps-2095277972-project-admin] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:05:05.965673 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-165859b4-eccc-44dd-a531-6f02d00d32d1 tempest-TestNetworkAdvancedServerOps-2095277972 tempest-TestNetworkAdvancedServerOps-2095277972-project-admin] [instance: 5a95bf94-24e7-43a2-9818-d5bf1b0315f1] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:05:05.973284 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-165859b4-eccc-44dd-a531-6f02d00d32d1 tempest-TestNetworkAdvancedServerOps-2095277972 tempest-TestNetworkAdvancedServerOps-2095277972-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:05.973775 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-165859b4-eccc-44dd-a531-6f02d00d32d1 tempest-TestNetworkAdvancedServerOps-2095277972 tempest-TestNetworkAdvancedServerOps-2095277972-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:05.974209 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-165859b4-eccc-44dd-a531-6f02d00d32d1 tempest-TestNetworkAdvancedServerOps-2095277972 tempest-TestNetworkAdvancedServerOps-2095277972-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:05.978553 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-165859b4-eccc-44dd-a531-6f02d00d32d1 tempest-TestNetworkAdvancedServerOps-2095277972 tempest-TestNetworkAdvancedServerOps-2095277972-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:05.981461 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-165859b4-eccc-44dd-a531-6f02d00d32d1 tempest-TestNetworkAdvancedServerOps-2095277972 tempest-TestNetworkAdvancedServerOps-2095277972-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:05.982209 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-165859b4-eccc-44dd-a531-6f02d00d32d1 tempest-TestNetworkAdvancedServerOps-2095277972 tempest-TestNetworkAdvancedServerOps-2095277972-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:06.326876 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-165859b4-eccc-44dd-a531-6f02d00d32d1 tempest-TestNetworkAdvancedServerOps-2095277972 tempest-TestNetworkAdvancedServerOps-2095277972-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/5a95bf94-24e7-43a2-9818-d5bf1b0315f1" status: 200 len: 1833 microversion: 2.1 time: 0.913352 Oct 04 21:05:06.332950 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2708/5394] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:05:05 2022] GET /compute/v2.1/servers/5a95bf94-24e7-43a2-9818-d5bf1b0315f1 => generated 1833 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:05:10.020368 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-784df3f8-da3b-4d30-95fe-6abdcc1201ad tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:05:10.021809 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-784df3f8-da3b-4d30-95fe-6abdcc1201ad tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] [instance: 5a95bf94-24e7-43a2-9818-d5bf1b0315f1] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:05:10.031983 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-48f79222-e195-46a7-a158-d93708ea2e7b req-e7552135-0673-44f7-a039-36be9eb3237b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a95bf94-24e7-43a2-9818-d5bf1b0315f1", "tag": "99e654db-1794-4804-bb52-dc567c83649d"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:05:10.074710 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=19 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:05:10.081660 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=36 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:05:10.096271 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-784df3f8-da3b-4d30-95fe-6abdcc1201ad tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:10.096881 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_api:SELECT=31,nova_api:UPDATE=1 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:05:10.099006 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-784df3f8-da3b-4d30-95fe-6abdcc1201ad tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:10.099649 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-784df3f8-da3b-4d30-95fe-6abdcc1201ad tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:10.104350 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-48f79222-e195-46a7-a158-d93708ea2e7b req-e7552135-0673-44f7-a039-36be9eb3237b service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:10.111111 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-784df3f8-da3b-4d30-95fe-6abdcc1201ad tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:10.113839 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-784df3f8-da3b-4d30-95fe-6abdcc1201ad tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:10.114419 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-48f79222-e195-46a7-a158-d93708ea2e7b req-e7552135-0673-44f7-a039-36be9eb3237b service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:10.115628 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-48f79222-e195-46a7-a158-d93708ea2e7b req-e7552135-0673-44f7-a039-36be9eb3237b service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:10.116876 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-784df3f8-da3b-4d30-95fe-6abdcc1201ad tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:10.180013 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-48f79222-e195-46a7-a158-d93708ea2e7b req-e7552135-0673-44f7-a039-36be9eb3237b service nova] Creating event network-changed:99e654db-1794-4804-bb52-dc567c83649d for instance 5a95bf94-24e7-43a2-9818-d5bf1b0315f1 on n-h2-854823-8 Oct 04 21:05:10.207616 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-48f79222-e195-46a7-a158-d93708ea2e7b req-e7552135-0673-44f7-a039-36be9eb3237b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.170458 Oct 04 21:05:10.207616 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2709/5395] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:05:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:05:10.251974 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-784df3f8-da3b-4d30-95fe-6abdcc1201ad tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] [instance: 5a95bf94-24e7-43a2-9818-d5bf1b0315f1] Going to try to terminate instance {{(pid=128801) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:05:10.470833 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-784df3f8-da3b-4d30-95fe-6abdcc1201ad tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] 10.222.0.33 "DELETE /compute/v2.1/servers/5a95bf94-24e7-43a2-9818-d5bf1b0315f1" status: 204 len: 0 microversion: 2.1 time: 0.454755 Oct 04 21:05:10.471962 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2687/5396] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 21:05:10 2022] DELETE /compute/v2.1/servers/5a95bf94-24e7-43a2-9818-d5bf1b0315f1 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:05:10.483578 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-3a60f0f1-1458-4632-9e7d-cc70297b0548 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:05:10.484739 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-3a60f0f1-1458-4632-9e7d-cc70297b0548 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] [instance: 5a95bf94-24e7-43a2-9818-d5bf1b0315f1] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:05:10.502926 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3a60f0f1-1458-4632-9e7d-cc70297b0548 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:10.503480 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3a60f0f1-1458-4632-9e7d-cc70297b0548 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:10.506088 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3a60f0f1-1458-4632-9e7d-cc70297b0548 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:10.507902 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3a60f0f1-1458-4632-9e7d-cc70297b0548 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:10.508622 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3a60f0f1-1458-4632-9e7d-cc70297b0548 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:10.519205 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3a60f0f1-1458-4632-9e7d-cc70297b0548 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:11.672584 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-3a60f0f1-1458-4632-9e7d-cc70297b0548 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5dbe3da6a4af181ef7302fe605fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3aa23aee3c8435c8f1f409019c5fed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:05:11.681870 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-3a60f0f1-1458-4632-9e7d-cc70297b0548 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] 10.222.0.33 "GET /compute/v2.1/servers/5a95bf94-24e7-43a2-9818-d5bf1b0315f1" status: 200 len: 1688 microversion: 2.1 time: 1.204792 Oct 04 21:05:11.682535 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2710/5397] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:05:10 2022] GET /compute/v2.1/servers/5a95bf94-24e7-43a2-9818-d5bf1b0315f1 => generated 1688 bytes in 1206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:05:12.398101 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-aa645982-ec42-4369-965d-d8e9ee50113a tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:05:12.399464 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-aa645982-ec42-4369-965d-d8e9ee50113a tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] [instance: cc9ad5af-1587-4aa1-8323-a50c91bb1b84] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:05:12.417520 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-aa645982-ec42-4369-965d-d8e9ee50113a tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:12.420602 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-aa645982-ec42-4369-965d-d8e9ee50113a tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:12.421506 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-aa645982-ec42-4369-965d-d8e9ee50113a tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:12.422549 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-aa645982-ec42-4369-965d-d8e9ee50113a tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:12.425692 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-aa645982-ec42-4369-965d-d8e9ee50113a tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:12.426618 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-aa645982-ec42-4369-965d-d8e9ee50113a tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:12.521905 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-aa645982-ec42-4369-965d-d8e9ee50113a tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] 10.222.0.33 "GET /compute/v2.1/servers/cc9ad5af-1587-4aa1-8323-a50c91bb1b84/os-volume_attachments/160a21a1-3aa8-4e04-85c8-43da098aa084" status: 200 len: 194 microversion: 2.20 time: 0.130486 Oct 04 21:05:12.533237 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2688/5398] 10.222.0.33 () {60 vars in 1454 bytes} [Tue Oct 4 21:05:12 2022] GET /compute/v2.1/servers/cc9ad5af-1587-4aa1-8323-a50c91bb1b84/os-volume_attachments/160a21a1-3aa8-4e04-85c8-43da098aa084 => generated 194 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 21:05:12.663046 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-0c01319f-8968-46ad-97f2-29bc855e27f3 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:05:12.663773 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-0c01319f-8968-46ad-97f2-29bc855e27f3 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] [instance: cc9ad5af-1587-4aa1-8323-a50c91bb1b84] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:05:12.694091 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0c01319f-8968-46ad-97f2-29bc855e27f3 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:12.695688 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0c01319f-8968-46ad-97f2-29bc855e27f3 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:12.697094 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0c01319f-8968-46ad-97f2-29bc855e27f3 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:12.699708 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0c01319f-8968-46ad-97f2-29bc855e27f3 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:12.700594 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0c01319f-8968-46ad-97f2-29bc855e27f3 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:12.701262 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0c01319f-8968-46ad-97f2-29bc855e27f3 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:12.713215 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-46f65196-41c0-4eb2-bb72-ca31f2b31836 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:05:12.717289 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-46f65196-41c0-4eb2-bb72-ca31f2b31836 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] [instance: 5a95bf94-24e7-43a2-9818-d5bf1b0315f1] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:05:12.735527 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-46f65196-41c0-4eb2-bb72-ca31f2b31836 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:12.737579 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-46f65196-41c0-4eb2-bb72-ca31f2b31836 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:12.738294 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-46f65196-41c0-4eb2-bb72-ca31f2b31836 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:12.740417 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-46f65196-41c0-4eb2-bb72-ca31f2b31836 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:12.741090 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-46f65196-41c0-4eb2-bb72-ca31f2b31836 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:12.742583 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-46f65196-41c0-4eb2-bb72-ca31f2b31836 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:12.988766 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.objects.instance [None req-0c01319f-8968-46ad-97f2-29bc855e27f3 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lazy-loading 'services' on Instance uuid cc9ad5af-1587-4aa1-8323-a50c91bb1b84 {{(pid=128802) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:05:13.221269 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-0c01319f-8968-46ad-97f2-29bc855e27f3 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] 10.222.0.33 "DELETE /compute/v2.1/servers/cc9ad5af-1587-4aa1-8323-a50c91bb1b84/os-volume_attachments/160a21a1-3aa8-4e04-85c8-43da098aa084" status: 202 len: 0 microversion: 2.20 time: 0.561688 Oct 04 21:05:13.223945 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2711/5399] 10.222.0.33 () {60 vars in 1457 bytes} [Tue Oct 4 21:05:12 2022] DELETE /compute/v2.1/servers/cc9ad5af-1587-4aa1-8323-a50c91bb1b84/os-volume_attachments/160a21a1-3aa8-4e04-85c8-43da098aa084 => generated 0 bytes in 567 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:05:13.254900 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-57bb57f9-9ce7-443a-8edb-e2f68a41e037 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:05:13.264931 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-57bb57f9-9ce7-443a-8edb-e2f68a41e037 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] [instance: cc9ad5af-1587-4aa1-8323-a50c91bb1b84] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:05:13.300435 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-57bb57f9-9ce7-443a-8edb-e2f68a41e037 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:13.301671 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-57bb57f9-9ce7-443a-8edb-e2f68a41e037 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:13.303575 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-57bb57f9-9ce7-443a-8edb-e2f68a41e037 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:13.308345 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-57bb57f9-9ce7-443a-8edb-e2f68a41e037 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:13.309349 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-57bb57f9-9ce7-443a-8edb-e2f68a41e037 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:13.311492 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-57bb57f9-9ce7-443a-8edb-e2f68a41e037 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:13.434711 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-57bb57f9-9ce7-443a-8edb-e2f68a41e037 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] 10.222.0.33 "GET /compute/v2.1/servers/cc9ad5af-1587-4aa1-8323-a50c91bb1b84/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.198023 Oct 04 21:05:13.436226 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2712/5400] 10.222.0.33 () {60 vars in 1343 bytes} [Tue Oct 4 21:05:13 2022] GET /compute/v2.1/servers/cc9ad5af-1587-4aa1-8323-a50c91bb1b84/os-volume_attachments => generated 197 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 21:05:13.650856 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-46f65196-41c0-4eb2-bb72-ca31f2b31836 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5dbe3da6a4af181ef7302fe605fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3aa23aee3c8435c8f1f409019c5fed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:05:13.665601 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-46f65196-41c0-4eb2-bb72-ca31f2b31836 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] 10.222.0.33 "GET /compute/v2.1/servers/5a95bf94-24e7-43a2-9818-d5bf1b0315f1" status: 200 len: 1688 microversion: 2.1 time: 0.958181 Oct 04 21:05:13.675722 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2689/5401] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:05:12 2022] GET /compute/v2.1/servers/5a95bf94-24e7-43a2-9818-d5bf1b0315f1 => generated 1688 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:05:13.931971 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-0bf324e0-6ca6-42b1-be4f-149869beef63 req-90bd9847-e945-41fe-b684-7bd05b0ce780 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a95bf94-24e7-43a2-9818-d5bf1b0315f1", "name": "network-vif-deleted", "tag": "99e654db-1794-4804-bb52-dc567c83649d"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:05:13.954639 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-0bf324e0-6ca6-42b1-be4f-149869beef63 req-90bd9847-e945-41fe-b684-7bd05b0ce780 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:13.959030 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-0bf324e0-6ca6-42b1-be4f-149869beef63 req-90bd9847-e945-41fe-b684-7bd05b0ce780 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:13.959859 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-0bf324e0-6ca6-42b1-be4f-149869beef63 req-90bd9847-e945-41fe-b684-7bd05b0ce780 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:14.028377 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-0bf324e0-6ca6-42b1-be4f-149869beef63 req-90bd9847-e945-41fe-b684-7bd05b0ce780 service nova] Creating event network-vif-deleted:99e654db-1794-4804-bb52-dc567c83649d for instance 5a95bf94-24e7-43a2-9818-d5bf1b0315f1 on n-h2-854823-8 Oct 04 21:05:14.035399 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-0bf324e0-6ca6-42b1-be4f-149869beef63 req-90bd9847-e945-41fe-b684-7bd05b0ce780 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107139 Oct 04 21:05:14.039017 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2713/5402] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:05:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:05:14.454323 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c1a2cf05-4b17-4a88-8905-b302e47a97fb tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:05:14.460575 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c1a2cf05-4b17-4a88-8905-b302e47a97fb tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] [instance: cc9ad5af-1587-4aa1-8323-a50c91bb1b84] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:05:14.497583 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c1a2cf05-4b17-4a88-8905-b302e47a97fb tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:14.498216 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c1a2cf05-4b17-4a88-8905-b302e47a97fb tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:14.500482 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c1a2cf05-4b17-4a88-8905-b302e47a97fb tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:14.506949 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c1a2cf05-4b17-4a88-8905-b302e47a97fb tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:14.511813 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c1a2cf05-4b17-4a88-8905-b302e47a97fb tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:14.512477 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c1a2cf05-4b17-4a88-8905-b302e47a97fb tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:14.584939 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c1a2cf05-4b17-4a88-8905-b302e47a97fb tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] 10.222.0.33 "GET /compute/v2.1/servers/cc9ad5af-1587-4aa1-8323-a50c91bb1b84/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.139703 Oct 04 21:05:14.592562 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2690/5403] 10.222.0.33 () {60 vars in 1343 bytes} [Tue Oct 4 21:05:14 2022] GET /compute/v2.1/servers/cc9ad5af-1587-4aa1-8323-a50c91bb1b84/os-volume_attachments => generated 197 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 21:05:14.712487 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-2409109a-8460-4346-87ad-9fe3d2a87e77 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:05:14.713287 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-2409109a-8460-4346-87ad-9fe3d2a87e77 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] [instance: 5a95bf94-24e7-43a2-9818-d5bf1b0315f1] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:05:14.728218 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2409109a-8460-4346-87ad-9fe3d2a87e77 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:14.728822 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2409109a-8460-4346-87ad-9fe3d2a87e77 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:14.731113 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2409109a-8460-4346-87ad-9fe3d2a87e77 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:14.732026 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2409109a-8460-4346-87ad-9fe3d2a87e77 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:14.734970 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2409109a-8460-4346-87ad-9fe3d2a87e77 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:14.735575 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2409109a-8460-4346-87ad-9fe3d2a87e77 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:14.841960 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2409109a-8460-4346-87ad-9fe3d2a87e77 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:14.846660 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2409109a-8460-4346-87ad-9fe3d2a87e77 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:14.847250 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2409109a-8460-4346-87ad-9fe3d2a87e77 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:14.847875 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.objects.instance [None req-2409109a-8460-4346-87ad-9fe3d2a87e77 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lazy-loading 'fault' on Instance uuid 5a95bf94-24e7-43a2-9818-d5bf1b0315f1 {{(pid=128802) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:05:15.121631 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-2409109a-8460-4346-87ad-9fe3d2a87e77 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5dbe3da6a4af181ef7302fe605fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3aa23aee3c8435c8f1f409019c5fed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:05:15.138736 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-2409109a-8460-4346-87ad-9fe3d2a87e77 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] 10.222.0.33 "GET /compute/v2.1/servers/5a95bf94-24e7-43a2-9818-d5bf1b0315f1" status: 200 len: 1507 microversion: 2.1 time: 0.431009 Oct 04 21:05:15.151020 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2714/5404] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:05:14 2022] GET /compute/v2.1/servers/5a95bf94-24e7-43a2-9818-d5bf1b0315f1 => generated 1507 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:05:15.599105 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-77ba3e1f-cd12-44f9-bc0f-708935857ce7 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:05:15.602326 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-77ba3e1f-cd12-44f9-bc0f-708935857ce7 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] [instance: cc9ad5af-1587-4aa1-8323-a50c91bb1b84] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:05:15.619609 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-77ba3e1f-cd12-44f9-bc0f-708935857ce7 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:15.620843 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-77ba3e1f-cd12-44f9-bc0f-708935857ce7 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:15.623064 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-77ba3e1f-cd12-44f9-bc0f-708935857ce7 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:15.627203 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-77ba3e1f-cd12-44f9-bc0f-708935857ce7 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:15.628080 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-77ba3e1f-cd12-44f9-bc0f-708935857ce7 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:15.637269 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-77ba3e1f-cd12-44f9-bc0f-708935857ce7 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:15.705815 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-77ba3e1f-cd12-44f9-bc0f-708935857ce7 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] 10.222.0.33 "GET /compute/v2.1/servers/cc9ad5af-1587-4aa1-8323-a50c91bb1b84/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.111069 Oct 04 21:05:15.717689 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2691/5405] 10.222.0.33 () {60 vars in 1343 bytes} [Tue Oct 4 21:05:15 2022] GET /compute/v2.1/servers/cc9ad5af-1587-4aa1-8323-a50c91bb1b84/os-volume_attachments => generated 197 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 21:05:16.169061 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-ae4debae-21d3-4ec9-89df-0e3e7b605819 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:05:16.169679 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-ae4debae-21d3-4ec9-89df-0e3e7b605819 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] [instance: 5a95bf94-24e7-43a2-9818-d5bf1b0315f1] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:05:16.188578 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ae4debae-21d3-4ec9-89df-0e3e7b605819 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:16.189074 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ae4debae-21d3-4ec9-89df-0e3e7b605819 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:16.189515 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ae4debae-21d3-4ec9-89df-0e3e7b605819 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:16.190235 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ae4debae-21d3-4ec9-89df-0e3e7b605819 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:16.190720 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ae4debae-21d3-4ec9-89df-0e3e7b605819 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:16.191148 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ae4debae-21d3-4ec9-89df-0e3e7b605819 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:16.246770 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.wsgi [None req-ae4debae-21d3-4ec9-89df-0e3e7b605819 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] HTTP exception thrown: Instance 5a95bf94-24e7-43a2-9818-d5bf1b0315f1 could not be found. Oct 04 21:05:16.248481 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-ae4debae-21d3-4ec9-89df-0e3e7b605819 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Request method failure captured: Oct 04 21:05:16.248481 n-d-854823-8 devstack@n-api.service[128802]: request: GET /compute/v2.1/servers/5a95bf94-24e7-43a2-9818-d5bf1b0315f1 HTTP/1.1 Oct 04 21:05:16.248481 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 21:05:16.248481 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 21:05:16.248481 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 21:05:16.248481 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 0 Oct 04 21:05:16.248481 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 21:05:16.248481 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 21:05:16.248481 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 21:05:16.248481 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 21:05:16.248481 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPJ6ORv5f7ucUc1GgNtAvhRFv0MfXY90YwD2xgHLgYfsVRwUV5gV1Hx78rlUpKA1NRvwYKNJhb7yIJiTiGqKIsoz35JtnB2AAmUjVwzFJr8QnfB8bfTqI5gxOvM7f9zAR1w4iePiaw2CxUuNcF2SaDuAI205FbH1jwb6Vgw17rzPCl_Q Oct 04 21:05:16.248481 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 21:05:16.248481 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 21:05:16.248481 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 21:05:16.248481 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 21:05:16.248481 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 21:05:16.248481 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 21:05:16.248481 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: b3aa23aee3c8435c8f1f409019c5fed2 Oct 04 21:05:16.248481 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1628573817 Oct 04 21:05:16.248481 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 21:05:16.248481 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 21:05:16.248481 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b3aa23aee3c8435c8f1f409019c5fed2", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b3aa23aee3c8435c8f1f409019c5fed2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b3aa23aee3c8435c8f1f409019c5fed2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b3aa23aee3c8435c8f1f409019c5fed2"}]}] Oct 04 21:05:16.248481 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1628573817 Oct 04 21:05:16.248481 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: b3aa23aee3c8435c8f1f409019c5fed2 Oct 04 21:05:16.248481 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1628573817 Oct 04 21:05:16.248481 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-TestNetworkAdvancedServerOps-1628573817-project Oct 04 21:05:16.248481 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 21:05:16.248481 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 21:05:16.248481 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: 0be5dbe3da6a4af181ef7302fe605fb4 Oct 04 21:05:16.248481 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1628573817-project Oct 04 21:05:16.248481 n-d-854823-8 devstack@n-api.service[128802]: method: > Oct 04 21:05:16.248481 n-d-854823-8 devstack@n-api.service[128802]: exception: Instance 5a95bf94-24e7-43a2-9818-d5bf1b0315f1 could not be found. Oct 04 21:05:16.248481 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'id': '5a95bf94-24e7-43a2-9818-d5bf1b0315f1'} Oct 04 21:05:16.248481 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:05:16.248481 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:05:16.248481 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:05:16.248481 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:05:16.248481 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:05:16.248481 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:05:16.248481 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:05:16.248481 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:05:16.248481 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:05:16.248481 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:05:16.248481 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a95bf94-24e7-43a2-9818-d5bf1b0315f1 could not be found. Oct 04 21:05:16.248481 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:05:16.248481 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:05:16.248481 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:05:16.248481 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:05:16.248481 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:05:16.248481 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:05:16.248481 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:05:16.248481 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:05:16.248481 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:05:16.248481 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:05:16.248481 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:05:16.248481 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:05:16.248481 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:05:16.248481 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:05:16.248481 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:05:16.248481 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:05:16.248481 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a95bf94-24e7-43a2-9818-d5bf1b0315f1 could not be found. Oct 04 21:05:16.248481 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:05:16.248481 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:05:16.253512 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:05:16.253512 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:05:16.253512 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:05:16.253512 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:05:16.253512 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:05:16.253512 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:05:16.253512 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a95bf94-24e7-43a2-9818-d5bf1b0315f1 could not be found. Oct 04 21:05:16.253512 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:05:16.253512 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-ae4debae-21d3-4ec9-89df-0e3e7b605819 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Returning 404 to user: Instance 5a95bf94-24e7-43a2-9818-d5bf1b0315f1 could not be found. {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:05:16.253512 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-ae4debae-21d3-4ec9-89df-0e3e7b605819 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] 10.222.0.33 "GET /compute/v2.1/servers/5a95bf94-24e7-43a2-9818-d5bf1b0315f1" status: 404 len: 111 microversion: 2.1 time: 0.086536 Oct 04 21:05:16.276950 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2715/5406] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:05:16 2022] GET /compute/v2.1/servers/5a95bf94-24e7-43a2-9818-d5bf1b0315f1 => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:05:16.725194 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-289f32d0-45be-4cbb-a5a0-215d82e1d8d1 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:05:16.727499 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-289f32d0-45be-4cbb-a5a0-215d82e1d8d1 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] [instance: cc9ad5af-1587-4aa1-8323-a50c91bb1b84] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:05:16.749271 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-289f32d0-45be-4cbb-a5a0-215d82e1d8d1 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:16.763649 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-289f32d0-45be-4cbb-a5a0-215d82e1d8d1 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:16.767563 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-289f32d0-45be-4cbb-a5a0-215d82e1d8d1 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:16.768739 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-289f32d0-45be-4cbb-a5a0-215d82e1d8d1 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:16.769561 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-289f32d0-45be-4cbb-a5a0-215d82e1d8d1 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:16.775155 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-289f32d0-45be-4cbb-a5a0-215d82e1d8d1 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:16.869102 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-289f32d0-45be-4cbb-a5a0-215d82e1d8d1 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] 10.222.0.33 "GET /compute/v2.1/servers/cc9ad5af-1587-4aa1-8323-a50c91bb1b84/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.147984 Oct 04 21:05:16.880561 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2692/5407] 10.222.0.33 () {60 vars in 1343 bytes} [Tue Oct 4 21:05:16 2022] GET /compute/v2.1/servers/cc9ad5af-1587-4aa1-8323-a50c91bb1b84/os-volume_attachments => generated 197 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 21:05:17.895359 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-1ed9c7f1-d757-4a33-a241-2179e136c07b tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:05:17.898968 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-1ed9c7f1-d757-4a33-a241-2179e136c07b tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] [instance: cc9ad5af-1587-4aa1-8323-a50c91bb1b84] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:05:17.930275 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1ed9c7f1-d757-4a33-a241-2179e136c07b tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:17.930805 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1ed9c7f1-d757-4a33-a241-2179e136c07b tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:17.931241 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1ed9c7f1-d757-4a33-a241-2179e136c07b tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:17.931960 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1ed9c7f1-d757-4a33-a241-2179e136c07b tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:17.932924 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1ed9c7f1-d757-4a33-a241-2179e136c07b tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:17.936303 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1ed9c7f1-d757-4a33-a241-2179e136c07b tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:18.086647 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-1ed9c7f1-d757-4a33-a241-2179e136c07b tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] 10.222.0.33 "GET /compute/v2.1/servers/cc9ad5af-1587-4aa1-8323-a50c91bb1b84/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.196549 Oct 04 21:05:18.089821 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2716/5408] 10.222.0.33 () {60 vars in 1343 bytes} [Tue Oct 4 21:05:17 2022] GET /compute/v2.1/servers/cc9ad5af-1587-4aa1-8323-a50c91bb1b84/os-volume_attachments => generated 197 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 21:05:19.106198 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-61f460fe-eb64-40c8-93c4-84f724a1014e tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:05:19.109455 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-61f460fe-eb64-40c8-93c4-84f724a1014e tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] [instance: cc9ad5af-1587-4aa1-8323-a50c91bb1b84] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:05:19.143119 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-61f460fe-eb64-40c8-93c4-84f724a1014e tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:19.152474 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-61f460fe-eb64-40c8-93c4-84f724a1014e tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:19.156222 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-61f460fe-eb64-40c8-93c4-84f724a1014e tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:19.160610 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-61f460fe-eb64-40c8-93c4-84f724a1014e tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:19.183442 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-61f460fe-eb64-40c8-93c4-84f724a1014e tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:19.184053 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-61f460fe-eb64-40c8-93c4-84f724a1014e tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:19.311973 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-61f460fe-eb64-40c8-93c4-84f724a1014e tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] 10.222.0.33 "GET /compute/v2.1/servers/cc9ad5af-1587-4aa1-8323-a50c91bb1b84/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.211001 Oct 04 21:05:19.312597 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2693/5409] 10.222.0.33 () {60 vars in 1343 bytes} [Tue Oct 4 21:05:19 2022] GET /compute/v2.1/servers/cc9ad5af-1587-4aa1-8323-a50c91bb1b84/os-volume_attachments => generated 197 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 21:05:20.325660 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-a939787c-440f-41b1-974a-1e15c7632322 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:05:20.329081 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-a939787c-440f-41b1-974a-1e15c7632322 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] [instance: cc9ad5af-1587-4aa1-8323-a50c91bb1b84] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:05:20.348289 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a939787c-440f-41b1-974a-1e15c7632322 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:20.349181 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a939787c-440f-41b1-974a-1e15c7632322 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:20.349866 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a939787c-440f-41b1-974a-1e15c7632322 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:20.351577 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a939787c-440f-41b1-974a-1e15c7632322 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:20.357662 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a939787c-440f-41b1-974a-1e15c7632322 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:20.358521 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a939787c-440f-41b1-974a-1e15c7632322 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:20.439644 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:05:20.490619 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-a939787c-440f-41b1-974a-1e15c7632322 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] 10.222.0.33 "GET /compute/v2.1/servers/cc9ad5af-1587-4aa1-8323-a50c91bb1b84/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.162418 Oct 04 21:05:20.491466 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2717/5410] 10.222.0.33 () {60 vars in 1343 bytes} [Tue Oct 4 21:05:20 2022] GET /compute/v2.1/servers/cc9ad5af-1587-4aa1-8323-a50c91bb1b84/os-volume_attachments => generated 197 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 21:05:21.504800 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0ee50a6d-adcf-4a9f-976e-1221c9517b21 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:05:21.512587 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-0ee50a6d-adcf-4a9f-976e-1221c9517b21 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] [instance: cc9ad5af-1587-4aa1-8323-a50c91bb1b84] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:05:21.533218 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0ee50a6d-adcf-4a9f-976e-1221c9517b21 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:21.538952 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0ee50a6d-adcf-4a9f-976e-1221c9517b21 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:21.539532 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0ee50a6d-adcf-4a9f-976e-1221c9517b21 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:21.540309 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0ee50a6d-adcf-4a9f-976e-1221c9517b21 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:21.540788 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0ee50a6d-adcf-4a9f-976e-1221c9517b21 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:21.541223 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0ee50a6d-adcf-4a9f-976e-1221c9517b21 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:21.642189 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-0ee50a6d-adcf-4a9f-976e-1221c9517b21 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] 10.222.0.33 "GET /compute/v2.1/servers/cc9ad5af-1587-4aa1-8323-a50c91bb1b84/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.141656 Oct 04 21:05:21.648367 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2694/5411] 10.222.0.33 () {60 vars in 1343 bytes} [Tue Oct 4 21:05:21 2022] GET /compute/v2.1/servers/cc9ad5af-1587-4aa1-8323-a50c91bb1b84/os-volume_attachments => generated 197 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 04 21:05:22.662051 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-ad99b5b8-5950-48a7-bcb9-63e37103843b tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:05:22.664836 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-ad99b5b8-5950-48a7-bcb9-63e37103843b tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] [instance: cc9ad5af-1587-4aa1-8323-a50c91bb1b84] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:05:22.697518 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ad99b5b8-5950-48a7-bcb9-63e37103843b tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:22.699038 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ad99b5b8-5950-48a7-bcb9-63e37103843b tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:22.699317 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ad99b5b8-5950-48a7-bcb9-63e37103843b tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:22.704483 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ad99b5b8-5950-48a7-bcb9-63e37103843b tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:22.711147 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ad99b5b8-5950-48a7-bcb9-63e37103843b tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:22.711840 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ad99b5b8-5950-48a7-bcb9-63e37103843b tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:22.825998 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-ad99b5b8-5950-48a7-bcb9-63e37103843b tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] 10.222.0.33 "GET /compute/v2.1/servers/cc9ad5af-1587-4aa1-8323-a50c91bb1b84/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.168142 Oct 04 21:05:22.826752 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2718/5412] 10.222.0.33 () {60 vars in 1343 bytes} [Tue Oct 4 21:05:22 2022] GET /compute/v2.1/servers/cc9ad5af-1587-4aa1-8323-a50c91bb1b84/os-volume_attachments => generated 197 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 21:05:23.858117 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7d87cc61-ffb8-4f32-b5d2-7cc8b806dd02 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:05:23.874128 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-7d87cc61-ffb8-4f32-b5d2-7cc8b806dd02 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] [instance: cc9ad5af-1587-4aa1-8323-a50c91bb1b84] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:05:23.905276 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7d87cc61-ffb8-4f32-b5d2-7cc8b806dd02 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:23.905998 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7d87cc61-ffb8-4f32-b5d2-7cc8b806dd02 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:23.906951 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7d87cc61-ffb8-4f32-b5d2-7cc8b806dd02 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:23.908322 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7d87cc61-ffb8-4f32-b5d2-7cc8b806dd02 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:23.908922 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7d87cc61-ffb8-4f32-b5d2-7cc8b806dd02 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:23.909351 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7d87cc61-ffb8-4f32-b5d2-7cc8b806dd02 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:24.023739 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-7d87cc61-ffb8-4f32-b5d2-7cc8b806dd02 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] 10.222.0.33 "GET /compute/v2.1/servers/cc9ad5af-1587-4aa1-8323-a50c91bb1b84/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.184832 Oct 04 21:05:24.031886 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2695/5413] 10.222.0.33 () {60 vars in 1343 bytes} [Tue Oct 4 21:05:23 2022] GET /compute/v2.1/servers/cc9ad5af-1587-4aa1-8323-a50c91bb1b84/os-volume_attachments => generated 197 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 21:05:25.039900 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-2874acee-bcc5-4dd4-9fa5-f9559c2bc291 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:05:25.044706 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-2874acee-bcc5-4dd4-9fa5-f9559c2bc291 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] [instance: cc9ad5af-1587-4aa1-8323-a50c91bb1b84] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:05:25.075967 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2874acee-bcc5-4dd4-9fa5-f9559c2bc291 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:25.077158 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2874acee-bcc5-4dd4-9fa5-f9559c2bc291 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:25.083807 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2874acee-bcc5-4dd4-9fa5-f9559c2bc291 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:25.085117 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2874acee-bcc5-4dd4-9fa5-f9559c2bc291 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:25.085803 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2874acee-bcc5-4dd4-9fa5-f9559c2bc291 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:25.086478 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2874acee-bcc5-4dd4-9fa5-f9559c2bc291 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:25.235171 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-2874acee-bcc5-4dd4-9fa5-f9559c2bc291 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] 10.222.0.33 "GET /compute/v2.1/servers/cc9ad5af-1587-4aa1-8323-a50c91bb1b84/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.199507 Oct 04 21:05:25.239003 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2719/5414] 10.222.0.33 () {60 vars in 1343 bytes} [Tue Oct 4 21:05:25 2022] GET /compute/v2.1/servers/cc9ad5af-1587-4aa1-8323-a50c91bb1b84/os-volume_attachments => generated 197 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 21:05:26.251490 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d7673ee6-8a37-4529-922f-10c762225b81 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:05:26.254605 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d7673ee6-8a37-4529-922f-10c762225b81 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] [instance: cc9ad5af-1587-4aa1-8323-a50c91bb1b84] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:05:26.286664 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d7673ee6-8a37-4529-922f-10c762225b81 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:26.287457 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d7673ee6-8a37-4529-922f-10c762225b81 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:26.290927 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d7673ee6-8a37-4529-922f-10c762225b81 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:26.293876 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d7673ee6-8a37-4529-922f-10c762225b81 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:26.294559 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d7673ee6-8a37-4529-922f-10c762225b81 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:26.297316 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d7673ee6-8a37-4529-922f-10c762225b81 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:26.423709 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d7673ee6-8a37-4529-922f-10c762225b81 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] 10.222.0.33 "GET /compute/v2.1/servers/cc9ad5af-1587-4aa1-8323-a50c91bb1b84/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.176522 Oct 04 21:05:26.427299 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2696/5415] 10.222.0.33 () {60 vars in 1343 bytes} [Tue Oct 4 21:05:26 2022] GET /compute/v2.1/servers/cc9ad5af-1587-4aa1-8323-a50c91bb1b84/os-volume_attachments => generated 25 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:05:26.605945 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-4fdf779e-b779-4efc-8d3a-24a907f6b981 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:05:26.607491 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-4fdf779e-b779-4efc-8d3a-24a907f6b981 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] [instance: cc9ad5af-1587-4aa1-8323-a50c91bb1b84] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:05:26.634587 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4fdf779e-b779-4efc-8d3a-24a907f6b981 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:26.636276 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4fdf779e-b779-4efc-8d3a-24a907f6b981 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:26.639283 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4fdf779e-b779-4efc-8d3a-24a907f6b981 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:26.640426 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4fdf779e-b779-4efc-8d3a-24a907f6b981 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:26.644224 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4fdf779e-b779-4efc-8d3a-24a907f6b981 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:26.644930 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4fdf779e-b779-4efc-8d3a-24a907f6b981 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:26.724711 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-4fdf779e-b779-4efc-8d3a-24a907f6b981 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] [instance: cc9ad5af-1587-4aa1-8323-a50c91bb1b84] Going to try to terminate instance {{(pid=128802) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:05:26.972358 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-4fdf779e-b779-4efc-8d3a-24a907f6b981 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] 10.222.0.33 "DELETE /compute/v2.1/servers/cc9ad5af-1587-4aa1-8323-a50c91bb1b84" status: 204 len: 0 microversion: 2.20 time: 0.370930 Oct 04 21:05:26.973996 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2720/5416] 10.222.0.33 () {60 vars in 1280 bytes} [Tue Oct 4 21:05:26 2022] DELETE /compute/v2.1/servers/cc9ad5af-1587-4aa1-8323-a50c91bb1b84 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 04 21:05:26.983285 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e30328ad-b3a1-4ec1-9dea-e18b82dd88e2 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:05:26.984058 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e30328ad-b3a1-4ec1-9dea-e18b82dd88e2 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] [instance: cc9ad5af-1587-4aa1-8323-a50c91bb1b84] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:05:27.018790 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e30328ad-b3a1-4ec1-9dea-e18b82dd88e2 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:27.019562 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e30328ad-b3a1-4ec1-9dea-e18b82dd88e2 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:27.020121 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e30328ad-b3a1-4ec1-9dea-e18b82dd88e2 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:27.022390 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e30328ad-b3a1-4ec1-9dea-e18b82dd88e2 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:27.024732 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e30328ad-b3a1-4ec1-9dea-e18b82dd88e2 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:27.025323 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e30328ad-b3a1-4ec1-9dea-e18b82dd88e2 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:27.872613 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e30328ad-b3a1-4ec1-9dea-e18b82dd88e2 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:05:27.888399 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e30328ad-b3a1-4ec1-9dea-e18b82dd88e2 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:05:27.895735 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e30328ad-b3a1-4ec1-9dea-e18b82dd88e2 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:05:27.897890 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e30328ad-b3a1-4ec1-9dea-e18b82dd88e2 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] 10.222.0.33 "GET /compute/v2.1/servers/cc9ad5af-1587-4aa1-8323-a50c91bb1b84" status: 200 len: 1723 microversion: 2.20 time: 0.919020 Oct 04 21:05:27.908827 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2697/5417] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 21:05:26 2022] GET /compute/v2.1/servers/cc9ad5af-1587-4aa1-8323-a50c91bb1b84 => generated 1723 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:05:28.937561 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-fee3e757-7b13-4396-bfd8-cafa5722299b tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:05:28.938660 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-fee3e757-7b13-4396-bfd8-cafa5722299b tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] [instance: cc9ad5af-1587-4aa1-8323-a50c91bb1b84] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:05:28.955273 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fee3e757-7b13-4396-bfd8-cafa5722299b tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:28.955863 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fee3e757-7b13-4396-bfd8-cafa5722299b tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:28.956420 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fee3e757-7b13-4396-bfd8-cafa5722299b tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:28.957650 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fee3e757-7b13-4396-bfd8-cafa5722299b tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:28.958236 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fee3e757-7b13-4396-bfd8-cafa5722299b tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:28.962504 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fee3e757-7b13-4396-bfd8-cafa5722299b tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:29.770117 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-fee3e757-7b13-4396-bfd8-cafa5722299b tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:05:29.783935 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-fee3e757-7b13-4396-bfd8-cafa5722299b tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:05:29.785417 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-fee3e757-7b13-4396-bfd8-cafa5722299b tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:05:29.786660 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-fee3e757-7b13-4396-bfd8-cafa5722299b tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] 10.222.0.33 "GET /compute/v2.1/servers/cc9ad5af-1587-4aa1-8323-a50c91bb1b84" status: 200 len: 1723 microversion: 2.20 time: 0.854693 Oct 04 21:05:29.798859 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2721/5418] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 21:05:28 2022] GET /compute/v2.1/servers/cc9ad5af-1587-4aa1-8323-a50c91bb1b84 => generated 1723 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:05:30.345057 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ee900509-3395-4711-8bf7-3c98331a97e3 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Calling method '.version_select at 0x7f3c6ef1c9d0>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:05:30.397576 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ee900509-3395-4711-8bf7-3c98331a97e3 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2027624640" status: 202 len: 0 microversion: 2.1 time: 0.056297 Oct 04 21:05:30.398923 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2698/5419] 10.222.0.33 () {58 vars in 1284 bytes} [Tue Oct 4 21:05:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2027624640 => generated 0 bytes in 59 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:05:30.446733 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-7767a2f2-83a0-42b2-a32b-c969507de850 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Action: 'create', calling method: .version_select at 0x7f3c746e53a0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-761519335", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGC3JtCen0cAuLoTP8zhJ3ATV5ANPrqDDOPUOmaUW9ypwOtKnU+5cfoO6lRo00VzAwVpvLjgCyHuNv5s50Y7Q9GA9Th26X0Vnyv8V0WjXL9lRk+VpJa65K9BL1ls795+yw=="}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:05:30.472988 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-7767a2f2-83a0-42b2-a32b-c969507de850 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Getting quotas for project b3aa23aee3c8435c8f1f409019c5fed2. Resources: {'key_pairs'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:05:30.491651 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-7767a2f2-83a0-42b2-a32b-c969507de850 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Getting quotas for user 0be5dbe3da6a4af181ef7302fe605fb4 and project b3aa23aee3c8435c8f1f409019c5fed2. Resources: {'key_pairs'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:05:30.549574 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-7767a2f2-83a0-42b2-a32b-c969507de850 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.113465 Oct 04 21:05:30.551692 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2722/5420] 10.222.0.33 () {60 vars in 1159 bytes} [Tue Oct 4 21:05:30 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:05:30.816423 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1e998170-bbea-428f-ac0e-e5bf8c73c8c4 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:05:30.817161 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-1e998170-bbea-428f-ac0e-e5bf8c73c8c4 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] [instance: cc9ad5af-1587-4aa1-8323-a50c91bb1b84] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:05:30.830885 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1e998170-bbea-428f-ac0e-e5bf8c73c8c4 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:30.831993 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1e998170-bbea-428f-ac0e-e5bf8c73c8c4 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:30.832966 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1e998170-bbea-428f-ac0e-e5bf8c73c8c4 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:30.835687 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1e998170-bbea-428f-ac0e-e5bf8c73c8c4 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:30.836355 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1e998170-bbea-428f-ac0e-e5bf8c73c8c4 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:30.839202 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1e998170-bbea-428f-ac0e-e5bf8c73c8c4 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:32.222981 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-1e998170-bbea-428f-ac0e-e5bf8c73c8c4 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:05:32.253590 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-1e998170-bbea-428f-ac0e-e5bf8c73c8c4 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:05:32.259505 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-1e998170-bbea-428f-ac0e-e5bf8c73c8c4 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:05:32.267060 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-1e998170-bbea-428f-ac0e-e5bf8c73c8c4 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] 10.222.0.33 "GET /compute/v2.1/servers/cc9ad5af-1587-4aa1-8323-a50c91bb1b84" status: 200 len: 1723 microversion: 2.20 time: 1.452238 Oct 04 21:05:32.270726 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2699/5421] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 21:05:30 2022] GET /compute/v2.1/servers/cc9ad5af-1587-4aa1-8323-a50c91bb1b84 => generated 1723 bytes in 1457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:05:33.303530 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-4482a78e-b631-4972-ba69-c2d9663f44dd tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:05:33.304800 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-4482a78e-b631-4972-ba69-c2d9663f44dd tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] [instance: cc9ad5af-1587-4aa1-8323-a50c91bb1b84] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:05:33.318465 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4482a78e-b631-4972-ba69-c2d9663f44dd tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:33.319496 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4482a78e-b631-4972-ba69-c2d9663f44dd tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:33.324765 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4482a78e-b631-4972-ba69-c2d9663f44dd tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:33.326574 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4482a78e-b631-4972-ba69-c2d9663f44dd tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:33.327578 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4482a78e-b631-4972-ba69-c2d9663f44dd tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:33.328310 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4482a78e-b631-4972-ba69-c2d9663f44dd tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:33.675634 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-4482a78e-b631-4972-ba69-c2d9663f44dd tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:05:33.708894 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-4482a78e-b631-4972-ba69-c2d9663f44dd tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:05:33.711857 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-4482a78e-b631-4972-ba69-c2d9663f44dd tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:05:33.715682 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-4482a78e-b631-4972-ba69-c2d9663f44dd tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] 10.222.0.33 "GET /compute/v2.1/servers/cc9ad5af-1587-4aa1-8323-a50c91bb1b84" status: 200 len: 1656 microversion: 2.20 time: 0.416281 Oct 04 21:05:33.728734 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2723/5422] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 21:05:33 2022] GET /compute/v2.1/servers/cc9ad5af-1587-4aa1-8323-a50c91bb1b84 => generated 1656 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:05:34.477102 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-17c2888b-05c9-4969-bcc9-4b796ab75c22 req-d22fcb0b-da55-48b7-bfbe-d85e6b5cbf55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc9ad5af-1587-4aa1-8323-a50c91bb1b84", "name": "network-vif-deleted", "tag": "1669c917-58c0-440d-8b0d-29a608119c96"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:05:34.584156 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-17c2888b-05c9-4969-bcc9-4b796ab75c22 req-d22fcb0b-da55-48b7-bfbe-d85e6b5cbf55 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:34.586656 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-17c2888b-05c9-4969-bcc9-4b796ab75c22 req-d22fcb0b-da55-48b7-bfbe-d85e6b5cbf55 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:34.595136 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-17c2888b-05c9-4969-bcc9-4b796ab75c22 req-d22fcb0b-da55-48b7-bfbe-d85e6b5cbf55 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:34.628687 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-17c2888b-05c9-4969-bcc9-4b796ab75c22 req-d22fcb0b-da55-48b7-bfbe-d85e6b5cbf55 service nova] Creating event network-vif-deleted:1669c917-58c0-440d-8b0d-29a608119c96 for instance cc9ad5af-1587-4aa1-8323-a50c91bb1b84 on n-h1-854823-8 Oct 04 21:05:34.705553 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-17c2888b-05c9-4969-bcc9-4b796ab75c22 req-d22fcb0b-da55-48b7-bfbe-d85e6b5cbf55 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.220288 Oct 04 21:05:34.707732 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2700/5423] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:05:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:05:34.749567 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-e6368737-2113-40e1-af87-280c20f11120 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:05:34.750332 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-e6368737-2113-40e1-af87-280c20f11120 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] [instance: cc9ad5af-1587-4aa1-8323-a50c91bb1b84] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:05:34.774707 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e6368737-2113-40e1-af87-280c20f11120 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:34.789686 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e6368737-2113-40e1-af87-280c20f11120 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:34.793794 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e6368737-2113-40e1-af87-280c20f11120 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:34.797134 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e6368737-2113-40e1-af87-280c20f11120 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:34.805113 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e6368737-2113-40e1-af87-280c20f11120 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:34.810161 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e6368737-2113-40e1-af87-280c20f11120 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:34.879243 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e6368737-2113-40e1-af87-280c20f11120 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:34.879852 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e6368737-2113-40e1-af87-280c20f11120 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:34.880529 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e6368737-2113-40e1-af87-280c20f11120 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:34.881590 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.objects.instance [None req-e6368737-2113-40e1-af87-280c20f11120 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lazy-loading 'fault' on Instance uuid cc9ad5af-1587-4aa1-8323-a50c91bb1b84 {{(pid=128802) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:05:34.989822 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-e6368737-2113-40e1-af87-280c20f11120 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:05:34.999531 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-e6368737-2113-40e1-af87-280c20f11120 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:05:35.006333 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-e6368737-2113-40e1-af87-280c20f11120 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:05:35.015856 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-e6368737-2113-40e1-af87-280c20f11120 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] 10.222.0.33 "GET /compute/v2.1/servers/cc9ad5af-1587-4aa1-8323-a50c91bb1b84" status: 200 len: 1372 microversion: 2.20 time: 0.272239 Oct 04 21:05:35.032047 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2724/5424] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 21:05:34 2022] GET /compute/v2.1/servers/cc9ad5af-1587-4aa1-8323-a50c91bb1b84 => generated 1372 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:05:36.049914 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d394aa91-03b4-4bfd-9051-4e64d64dd6ed tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:05:36.050870 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d394aa91-03b4-4bfd-9051-4e64d64dd6ed tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] [instance: cc9ad5af-1587-4aa1-8323-a50c91bb1b84] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:05:36.076159 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d394aa91-03b4-4bfd-9051-4e64d64dd6ed tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:36.076679 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d394aa91-03b4-4bfd-9051-4e64d64dd6ed tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:36.077125 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d394aa91-03b4-4bfd-9051-4e64d64dd6ed tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:36.079287 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d394aa91-03b4-4bfd-9051-4e64d64dd6ed tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:36.080821 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d394aa91-03b4-4bfd-9051-4e64d64dd6ed tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:36.081841 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d394aa91-03b4-4bfd-9051-4e64d64dd6ed tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:36.126032 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-d394aa91-03b4-4bfd-9051-4e64d64dd6ed tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] HTTP exception thrown: Instance cc9ad5af-1587-4aa1-8323-a50c91bb1b84 could not be found. Oct 04 21:05:36.132875 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d394aa91-03b4-4bfd-9051-4e64d64dd6ed tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Request method failure captured: Oct 04 21:05:36.132875 n-d-854823-8 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/cc9ad5af-1587-4aa1-8323-a50c91bb1b84 HTTP/1.1 Oct 04 21:05:36.132875 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 21:05:36.132875 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 21:05:36.132875 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 21:05:36.132875 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 0 Oct 04 21:05:36.132875 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 21:05:36.132875 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 21:05:36.132875 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 21:05:36.132875 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 21:05:36.132875 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJ8zlUsVfOsr3ZIKfOLJwOa8Eha_qKsP9ATaYd5T34l3LH31b1lhpj1nxyNL2Q9bu6RpjSnFJX3ysP1c_sr8KFFD7E52JZEP_cYQx-2U-LdHQiJW_im-7tRJevST1wxkasm0x9XKZ_y2eiGeaDi_E1b04PRtNmxzoKRAVhYpncES3cs Oct 04 21:05:36.132875 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 21:05:36.132875 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 21:05:36.132875 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 21:05:36.132875 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 21:05:36.132875 n-d-854823-8 devstack@n-api.service[128801]: X-Openstack-Nova-Api-Version: 2.20 Oct 04 21:05:36.132875 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 21:05:36.132875 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 21:05:36.132875 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: 8625c9db98c2475db23d56a965eedb66 Oct 04 21:05:36.132875 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1082323484 Oct 04 21:05:36.132875 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 21:05:36.132875 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 21:05:36.132875 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_8625c9db98c2475db23d56a965eedb66", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8625c9db98c2475db23d56a965eedb66"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8625c9db98c2475db23d56a965eedb66"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/8625c9db98c2475db23d56a965eedb66"}]}] Oct 04 21:05:36.132875 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1082323484 Oct 04 21:05:36.132875 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: 8625c9db98c2475db23d56a965eedb66 Oct 04 21:05:36.132875 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1082323484 Oct 04 21:05:36.132875 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-AttachVolumeShelveTestJSON-1082323484-project Oct 04 21:05:36.132875 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 21:05:36.132875 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 21:05:36.132875 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: 9169ee22a4c94b2ab8d092c890bbf3ed Oct 04 21:05:36.132875 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1082323484-project Oct 04 21:05:36.132875 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 21:05:36.132875 n-d-854823-8 devstack@n-api.service[128801]: exception: Instance cc9ad5af-1587-4aa1-8323-a50c91bb1b84 could not be found. Oct 04 21:05:36.132875 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': 'cc9ad5af-1587-4aa1-8323-a50c91bb1b84'} Oct 04 21:05:36.132875 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:05:36.132875 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:05:36.132875 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:05:36.132875 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:05:36.132875 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:05:36.132875 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:05:36.132875 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:05:36.132875 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:05:36.132875 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:05:36.132875 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:05:36.132875 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc9ad5af-1587-4aa1-8323-a50c91bb1b84 could not be found. Oct 04 21:05:36.132875 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:05:36.132875 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:05:36.132875 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:05:36.132875 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:05:36.132875 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:05:36.132875 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:05:36.132875 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:05:36.132875 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:05:36.132875 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:05:36.132875 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:05:36.132875 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:05:36.132875 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:05:36.132875 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:05:36.132875 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:05:36.132875 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:05:36.132875 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:05:36.132875 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc9ad5af-1587-4aa1-8323-a50c91bb1b84 could not be found. Oct 04 21:05:36.132875 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:05:36.132875 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:05:36.139854 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:05:36.139854 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:05:36.139854 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:05:36.139854 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:05:36.139854 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:05:36.139854 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:05:36.139854 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc9ad5af-1587-4aa1-8323-a50c91bb1b84 could not be found. Oct 04 21:05:36.139854 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:05:36.139854 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d394aa91-03b4-4bfd-9051-4e64d64dd6ed tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Returning 404 to user: Instance cc9ad5af-1587-4aa1-8323-a50c91bb1b84 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:05:36.139854 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d394aa91-03b4-4bfd-9051-4e64d64dd6ed tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] 10.222.0.33 "GET /compute/v2.1/servers/cc9ad5af-1587-4aa1-8323-a50c91bb1b84" status: 404 len: 111 microversion: 2.20 time: 0.093491 Oct 04 21:05:36.146685 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2701/5425] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 21:05:36 2022] GET /compute/v2.1/servers/cc9ad5af-1587-4aa1-8323-a50c91bb1b84 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 21:05:36.151042 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-600103e1-5ac4-47aa-8247-6460b51ec135 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Calling method '.version_select at 0x7f3c7890f0d0>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:05:36.215272 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-600103e1-5ac4-47aa-8247-6460b51ec135 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1817073311" status: 204 len: 0 microversion: 2.20 time: 0.069668 Oct 04 21:05:36.216180 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2725/5426] 10.222.0.33 () {60 vars in 1262 bytes} [Tue Oct 4 21:05:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1817073311 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 21:05:38.454907 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-bad8f61a-6a99-4090-9225-1e3d115cb14a tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Action: 'create', calling method: .version_select at 0x7f3c6ef299d0>, body: {"keypair": {"name": "tempest-keypair-624317942", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOt8YwJ7v8pPqIbNrWAdjKt+GdxJMrOPepfNwyQiWbx4EbGicmIQyLynq3PTMo1k/zHN01J0V+iiDIRJ/wWpx0ijtH0HvkmD1AZF6Wxn/4bsyPQzWXYe3klAQshKucS/aQ=="}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:05:38.490220 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-bad8f61a-6a99-4090-9225-1e3d115cb14a tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Getting quotas for project 8625c9db98c2475db23d56a965eedb66. Resources: {'key_pairs'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:05:38.523698 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-bad8f61a-6a99-4090-9225-1e3d115cb14a tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Getting quotas for user 9169ee22a4c94b2ab8d092c890bbf3ed and project 8625c9db98c2475db23d56a965eedb66. Resources: {'key_pairs'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:05:38.591963 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-bad8f61a-6a99-4090-9225-1e3d115cb14a tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.143785 Oct 04 21:05:38.594647 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2702/5427] 10.222.0.33 () {62 vars in 1200 bytes} [Tue Oct 4 21:05:38 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 149 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 04 21:05:48.502722 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-794887ae-fca6-40b9-88dd-0fab1a342597 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-810753219", "imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "883d858a-7cae-4639-8390-ea0087441e3f"}], "security_groups": [{"name": "tempest-securitygroup--1488608235"}], "key_name": "tempest-keypair-624317942", "user_data": "}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:05:48.564313 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell0:SELECT=4 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:05:48.567606 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:05:48.568322 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:05:48.950945 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.network.neutron [None req-794887ae-fca6-40b9-88dd-0fab1a342597 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] validate_networks() for [('883d858a-7cae-4639-8390-ea0087441e3f', None, None, None, None, None)] {{(pid=128802) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:05:50.428461 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-64733c2e-ecb7-4720-a933-de8acbf0383c tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1103989699", "imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63", "flavorRef": "452", "networks": [{"uuid": "1818d99e-0055-4ced-b0c8-8519b20e58ac"}], "key_name": "tempest-TestNetworkAdvancedServerOps-761519335", "security_groups": [{"name": "tempest-secgroup-smoke-2094510954"}]}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:05:50.466886 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:05:50.468518 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=4 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:05:50.469882 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:05:50.590809 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-794887ae-fca6-40b9-88dd-0fab1a342597 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Flavor limits 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:05:50.593354 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-794887ae-fca6-40b9-88dd-0fab1a342597 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Image limits 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:05:50.594720 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-794887ae-fca6-40b9-88dd-0fab1a342597 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Flavor pref 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:05:50.596675 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-794887ae-fca6-40b9-88dd-0fab1a342597 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Image pref 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:05:50.598636 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-794887ae-fca6-40b9-88dd-0fab1a342597 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:05:50.623396 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.network.neutron [None req-64733c2e-ecb7-4720-a933-de8acbf0383c tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] validate_networks() for [('1818d99e-0055-4ced-b0c8-8519b20e58ac', None, None, None, None, None)] {{(pid=128801) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:05:50.640074 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-794887ae-fca6-40b9-88dd-0fab1a342597 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:50.642817 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-794887ae-fca6-40b9-88dd-0fab1a342597 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:50.644104 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-794887ae-fca6-40b9-88dd-0fab1a342597 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:50.646504 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-794887ae-fca6-40b9-88dd-0fab1a342597 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:50.647722 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-794887ae-fca6-40b9-88dd-0fab1a342597 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:50.649991 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-794887ae-fca6-40b9-88dd-0fab1a342597 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:50.677746 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-794887ae-fca6-40b9-88dd-0fab1a342597 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Getting quotas for project 8625c9db98c2475db23d56a965eedb66. Resources: {'ram', 'instances', 'cores'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:05:50.685252 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-794887ae-fca6-40b9-88dd-0fab1a342597 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Getting quotas for user 9169ee22a4c94b2ab8d092c890bbf3ed and project 8625c9db98c2475db23d56a965eedb66. Resources: {'ram', 'instances', 'cores'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:05:50.705449 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-794887ae-fca6-40b9-88dd-0fab1a342597 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Going to run 1 instances... {{(pid=128802) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:05:50.709952 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-794887ae-fca6-40b9-88dd-0fab1a342597 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] [instance: 05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='15b24725-0c99-4bcf-b1fb-907cdf8e2d63',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128802) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:05:50.800180 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-794887ae-fca6-40b9-88dd-0fab1a342597 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 2.303591 Oct 04 21:05:50.802223 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2726/5428] 10.222.0.33 () {62 vars in 1188 bytes} [Tue Oct 4 21:05:48 2022] POST /compute/v2.1/servers => generated 402 bytes in 2306 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 04 21:05:50.821111 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-ab21af01-6812-487a-b905-f34618717e8f tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:05:50.823560 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-ab21af01-6812-487a-b905-f34618717e8f tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] [instance: 05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:05:50.950240 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-ab21af01-6812-487a-b905-f34618717e8f tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:05:50.975781 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-ab21af01-6812-487a-b905-f34618717e8f tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:05:50.981839 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-ab21af01-6812-487a-b905-f34618717e8f tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:05:50.987852 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-ab21af01-6812-487a-b905-f34618717e8f tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] 10.222.0.33 "GET /compute/v2.1/servers/05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9" status: 200 len: 1280 microversion: 2.20 time: 0.175659 Oct 04 21:05:50.989059 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2727/5429] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 21:05:50 2022] GET /compute/v2.1/servers/05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9 => generated 1280 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:05:52.019252 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-d8f09722-fdb6-413c-89c1-5debd4cbe046 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:05:52.028422 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-d8f09722-fdb6-413c-89c1-5debd4cbe046 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] [instance: 05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:05:52.040989 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d8f09722-fdb6-413c-89c1-5debd4cbe046 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:52.047915 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d8f09722-fdb6-413c-89c1-5debd4cbe046 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:52.048682 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d8f09722-fdb6-413c-89c1-5debd4cbe046 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:52.050963 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d8f09722-fdb6-413c-89c1-5debd4cbe046 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:52.051646 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d8f09722-fdb6-413c-89c1-5debd4cbe046 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:52.053802 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d8f09722-fdb6-413c-89c1-5debd4cbe046 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:52.262826 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-64733c2e-ecb7-4720-a933-de8acbf0383c tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Flavor limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:05:52.263993 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-64733c2e-ecb7-4720-a933-de8acbf0383c tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Image limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:05:52.264541 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-64733c2e-ecb7-4720-a933-de8acbf0383c tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Flavor pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:05:52.265029 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-64733c2e-ecb7-4720-a933-de8acbf0383c tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Image pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:05:52.265541 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-64733c2e-ecb7-4720-a933-de8acbf0383c tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:05:52.306449 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-d8f09722-fdb6-413c-89c1-5debd4cbe046 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:05:52.307543 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-64733c2e-ecb7-4720-a933-de8acbf0383c tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:52.313664 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-64733c2e-ecb7-4720-a933-de8acbf0383c tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:52.315460 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-64733c2e-ecb7-4720-a933-de8acbf0383c tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:52.327520 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-64733c2e-ecb7-4720-a933-de8acbf0383c tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:52.330396 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-d8f09722-fdb6-413c-89c1-5debd4cbe046 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:05:52.332360 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-d8f09722-fdb6-413c-89c1-5debd4cbe046 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:05:52.333743 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-64733c2e-ecb7-4720-a933-de8acbf0383c tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:52.335213 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-d8f09722-fdb6-413c-89c1-5debd4cbe046 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] 10.222.0.33 "GET /compute/v2.1/servers/05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9" status: 200 len: 1284 microversion: 2.20 time: 0.319942 Oct 04 21:05:52.336797 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-64733c2e-ecb7-4720-a933-de8acbf0383c tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:52.340041 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2728/5430] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 21:05:52 2022] GET /compute/v2.1/servers/05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9 => generated 1284 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:05:52.395190 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-64733c2e-ecb7-4720-a933-de8acbf0383c tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Getting quotas for project b3aa23aee3c8435c8f1f409019c5fed2. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:05:52.402508 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-64733c2e-ecb7-4720-a933-de8acbf0383c tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Getting quotas for user 0be5dbe3da6a4af181ef7302fe605fb4 and project b3aa23aee3c8435c8f1f409019c5fed2. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:05:52.421098 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-64733c2e-ecb7-4720-a933-de8acbf0383c tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Going to run 1 instances... {{(pid=128801) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:05:52.425989 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-64733c2e-ecb7-4720-a933-de8acbf0383c tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] [instance: e1f9b5da-f76c-47e2-bc50-eb6487d57306] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='15b24725-0c99-4bcf-b1fb-907cdf8e2d63',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128801) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:05:52.529638 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-64733c2e-ecb7-4720-a933-de8acbf0383c tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.102189 Oct 04 21:05:52.530430 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2703/5431] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 21:05:50 2022] POST /compute/v2.1/servers => generated 406 bytes in 2112 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:05:52.542891 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-0c5200cf-eea5-45e1-9528-a8a33cf850cd tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:05:52.543768 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-0c5200cf-eea5-45e1-9528-a8a33cf850cd tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] [instance: e1f9b5da-f76c-47e2-bc50-eb6487d57306] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:05:52.895541 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-0c5200cf-eea5-45e1-9528-a8a33cf850cd tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5dbe3da6a4af181ef7302fe605fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3aa23aee3c8435c8f1f409019c5fed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:05:52.910535 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-0c5200cf-eea5-45e1-9528-a8a33cf850cd tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] 10.222.0.33 "GET /compute/v2.1/servers/e1f9b5da-f76c-47e2-bc50-eb6487d57306" status: 200 len: 1266 microversion: 2.1 time: 0.370965 Oct 04 21:05:52.913376 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2729/5432] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:05:52 2022] GET /compute/v2.1/servers/e1f9b5da-f76c-47e2-bc50-eb6487d57306 => generated 1266 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:05:53.367062 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f8f661b0-15f5-4dd3-95e2-974946d0b361 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:05:53.367684 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f8f661b0-15f5-4dd3-95e2-974946d0b361 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] [instance: 05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:05:53.414596 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f8f661b0-15f5-4dd3-95e2-974946d0b361 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:53.414596 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f8f661b0-15f5-4dd3-95e2-974946d0b361 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:53.414836 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f8f661b0-15f5-4dd3-95e2-974946d0b361 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:53.416815 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f8f661b0-15f5-4dd3-95e2-974946d0b361 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:53.417846 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f8f661b0-15f5-4dd3-95e2-974946d0b361 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:53.418493 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f8f661b0-15f5-4dd3-95e2-974946d0b361 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:53.940583 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-25a3e6b4-39e3-4544-b9fe-7f5ba7a68a08 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:05:53.941201 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-25a3e6b4-39e3-4544-b9fe-7f5ba7a68a08 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] [instance: e1f9b5da-f76c-47e2-bc50-eb6487d57306] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:05:53.956238 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-25a3e6b4-39e3-4544-b9fe-7f5ba7a68a08 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:53.956935 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-25a3e6b4-39e3-4544-b9fe-7f5ba7a68a08 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:53.957180 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-25a3e6b4-39e3-4544-b9fe-7f5ba7a68a08 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:53.971496 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-25a3e6b4-39e3-4544-b9fe-7f5ba7a68a08 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:53.972001 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-25a3e6b4-39e3-4544-b9fe-7f5ba7a68a08 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:53.972466 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-25a3e6b4-39e3-4544-b9fe-7f5ba7a68a08 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:54.203436 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-25a3e6b4-39e3-4544-b9fe-7f5ba7a68a08 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5dbe3da6a4af181ef7302fe605fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3aa23aee3c8435c8f1f409019c5fed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:05:54.216718 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-25a3e6b4-39e3-4544-b9fe-7f5ba7a68a08 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] 10.222.0.33 "GET /compute/v2.1/servers/e1f9b5da-f76c-47e2-bc50-eb6487d57306" status: 200 len: 1270 microversion: 2.1 time: 0.280662 Oct 04 21:05:54.227646 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2730/5433] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:05:53 2022] GET /compute/v2.1/servers/e1f9b5da-f76c-47e2-bc50-eb6487d57306 => generated 1270 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:05:54.852037 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f8f661b0-15f5-4dd3-95e2-974946d0b361 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:05:54.867739 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f8f661b0-15f5-4dd3-95e2-974946d0b361 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:05:54.879161 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f8f661b0-15f5-4dd3-95e2-974946d0b361 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:05:54.884861 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f8f661b0-15f5-4dd3-95e2-974946d0b361 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] 10.222.0.33 "GET /compute/v2.1/servers/05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9" status: 200 len: 1340 microversion: 2.20 time: 1.521683 Oct 04 21:05:54.912714 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2704/5434] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 21:05:53 2022] GET /compute/v2.1/servers/05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9 => generated 1340 bytes in 1552 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:05:55.251003 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-08adfc58-ca99-4a40-90cd-dcbc3c344e87 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:05:55.252332 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-08adfc58-ca99-4a40-90cd-dcbc3c344e87 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] [instance: e1f9b5da-f76c-47e2-bc50-eb6487d57306] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:05:55.268093 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-08adfc58-ca99-4a40-90cd-dcbc3c344e87 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:55.270791 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-08adfc58-ca99-4a40-90cd-dcbc3c344e87 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:55.272933 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-08adfc58-ca99-4a40-90cd-dcbc3c344e87 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:55.275213 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-08adfc58-ca99-4a40-90cd-dcbc3c344e87 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:55.276609 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-08adfc58-ca99-4a40-90cd-dcbc3c344e87 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:55.278928 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-08adfc58-ca99-4a40-90cd-dcbc3c344e87 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:55.613046 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-08adfc58-ca99-4a40-90cd-dcbc3c344e87 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5dbe3da6a4af181ef7302fe605fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3aa23aee3c8435c8f1f409019c5fed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:05:55.629505 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-08adfc58-ca99-4a40-90cd-dcbc3c344e87 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] 10.222.0.33 "GET /compute/v2.1/servers/e1f9b5da-f76c-47e2-bc50-eb6487d57306" status: 200 len: 1326 microversion: 2.1 time: 0.382352 Oct 04 21:05:55.630103 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2731/5435] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:05:55 2022] GET /compute/v2.1/servers/e1f9b5da-f76c-47e2-bc50-eb6487d57306 => generated 1326 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:05:55.922580 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a3bc667b-ed07-42d2-8400-4c334f6254e2 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:05:55.923426 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a3bc667b-ed07-42d2-8400-4c334f6254e2 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] [instance: 05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:05:55.941655 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a3bc667b-ed07-42d2-8400-4c334f6254e2 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:55.942453 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a3bc667b-ed07-42d2-8400-4c334f6254e2 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:55.943019 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a3bc667b-ed07-42d2-8400-4c334f6254e2 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:55.944080 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a3bc667b-ed07-42d2-8400-4c334f6254e2 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:55.945846 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a3bc667b-ed07-42d2-8400-4c334f6254e2 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:55.948904 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a3bc667b-ed07-42d2-8400-4c334f6254e2 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:56.373611 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-a3bc667b-ed07-42d2-8400-4c334f6254e2 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:05:56.398382 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-a3bc667b-ed07-42d2-8400-4c334f6254e2 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:05:56.412977 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-a3bc667b-ed07-42d2-8400-4c334f6254e2 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:05:56.416579 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a3bc667b-ed07-42d2-8400-4c334f6254e2 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] 10.222.0.33 "GET /compute/v2.1/servers/05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9" status: 200 len: 1338 microversion: 2.20 time: 0.500517 Oct 04 21:05:56.443847 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2705/5436] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 21:05:55 2022] GET /compute/v2.1/servers/05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9 => generated 1338 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:05:56.658524 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-816451d5-c4ec-499e-9ec1-48ae995ae62a tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:05:56.659142 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-816451d5-c4ec-499e-9ec1-48ae995ae62a tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] [instance: e1f9b5da-f76c-47e2-bc50-eb6487d57306] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:05:56.680135 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-816451d5-c4ec-499e-9ec1-48ae995ae62a tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:56.681515 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-816451d5-c4ec-499e-9ec1-48ae995ae62a tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:56.682210 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-816451d5-c4ec-499e-9ec1-48ae995ae62a tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:56.683356 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-816451d5-c4ec-499e-9ec1-48ae995ae62a tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:56.684145 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-816451d5-c4ec-499e-9ec1-48ae995ae62a tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:56.684751 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-816451d5-c4ec-499e-9ec1-48ae995ae62a tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:56.819608 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-816451d5-c4ec-499e-9ec1-48ae995ae62a tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5dbe3da6a4af181ef7302fe605fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3aa23aee3c8435c8f1f409019c5fed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:05:56.836606 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-816451d5-c4ec-499e-9ec1-48ae995ae62a tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] 10.222.0.33 "GET /compute/v2.1/servers/e1f9b5da-f76c-47e2-bc50-eb6487d57306" status: 200 len: 1324 microversion: 2.1 time: 0.181279 Oct 04 21:05:56.841097 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2732/5437] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:05:56 2022] GET /compute/v2.1/servers/e1f9b5da-f76c-47e2-bc50-eb6487d57306 => generated 1324 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:05:57.455191 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-632b422f-4446-4165-a2c4-8755648c019e tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:05:57.456528 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-632b422f-4446-4165-a2c4-8755648c019e tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] [instance: 05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:05:57.474460 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-632b422f-4446-4165-a2c4-8755648c019e tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:57.476179 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-632b422f-4446-4165-a2c4-8755648c019e tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:57.480323 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-632b422f-4446-4165-a2c4-8755648c019e tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:57.481629 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-632b422f-4446-4165-a2c4-8755648c019e tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:57.483033 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-632b422f-4446-4165-a2c4-8755648c019e tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:57.490962 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-632b422f-4446-4165-a2c4-8755648c019e tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:57.865984 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-a0b90169-6643-4bec-91c8-78323b5ff968 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:05:57.866868 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-a0b90169-6643-4bec-91c8-78323b5ff968 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] [instance: e1f9b5da-f76c-47e2-bc50-eb6487d57306] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:05:57.882530 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a0b90169-6643-4bec-91c8-78323b5ff968 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:57.883413 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a0b90169-6643-4bec-91c8-78323b5ff968 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:57.884000 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a0b90169-6643-4bec-91c8-78323b5ff968 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:57.886976 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a0b90169-6643-4bec-91c8-78323b5ff968 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:57.888504 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a0b90169-6643-4bec-91c8-78323b5ff968 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:57.891088 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a0b90169-6643-4bec-91c8-78323b5ff968 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:58.273421 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-a0b90169-6643-4bec-91c8-78323b5ff968 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5dbe3da6a4af181ef7302fe605fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3aa23aee3c8435c8f1f409019c5fed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:05:58.286031 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-a0b90169-6643-4bec-91c8-78323b5ff968 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] 10.222.0.33 "GET /compute/v2.1/servers/e1f9b5da-f76c-47e2-bc50-eb6487d57306" status: 200 len: 1324 microversion: 2.1 time: 0.424475 Oct 04 21:05:58.286842 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2733/5438] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:05:57 2022] GET /compute/v2.1/servers/e1f9b5da-f76c-47e2-bc50-eb6487d57306 => generated 1324 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:05:58.354091 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-632b422f-4446-4165-a2c4-8755648c019e tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:05:58.370493 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-632b422f-4446-4165-a2c4-8755648c019e tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:05:58.375504 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-632b422f-4446-4165-a2c4-8755648c019e tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:05:58.385384 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-632b422f-4446-4165-a2c4-8755648c019e tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] 10.222.0.33 "GET /compute/v2.1/servers/05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9" status: 200 len: 1406 microversion: 2.20 time: 0.934718 Oct 04 21:05:58.395321 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2706/5439] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 21:05:57 2022] GET /compute/v2.1/servers/05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9 => generated 1406 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:05:59.317139 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-c80ccd90-8980-439c-b3d6-aa4aba306e29 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:05:59.318171 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-c80ccd90-8980-439c-b3d6-aa4aba306e29 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] [instance: e1f9b5da-f76c-47e2-bc50-eb6487d57306] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:05:59.334518 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c80ccd90-8980-439c-b3d6-aa4aba306e29 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:59.340148 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c80ccd90-8980-439c-b3d6-aa4aba306e29 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:59.345736 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c80ccd90-8980-439c-b3d6-aa4aba306e29 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:59.346933 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c80ccd90-8980-439c-b3d6-aa4aba306e29 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:59.348537 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c80ccd90-8980-439c-b3d6-aa4aba306e29 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:59.349645 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c80ccd90-8980-439c-b3d6-aa4aba306e29 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:59.413089 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-4dc24815-9019-4db9-b021-d43f4d1a9036 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:05:59.413711 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-4dc24815-9019-4db9-b021-d43f4d1a9036 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] [instance: 05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:05:59.429884 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4dc24815-9019-4db9-b021-d43f4d1a9036 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:59.433228 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4dc24815-9019-4db9-b021-d43f4d1a9036 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:59.434509 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4dc24815-9019-4db9-b021-d43f4d1a9036 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:59.437501 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4dc24815-9019-4db9-b021-d43f4d1a9036 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:05:59.438165 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4dc24815-9019-4db9-b021-d43f4d1a9036 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:05:59.439466 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4dc24815-9019-4db9-b021-d43f4d1a9036 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:05:59.919442 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-c80ccd90-8980-439c-b3d6-aa4aba306e29 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5dbe3da6a4af181ef7302fe605fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3aa23aee3c8435c8f1f409019c5fed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:05:59.937808 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-c80ccd90-8980-439c-b3d6-aa4aba306e29 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] 10.222.0.33 "GET /compute/v2.1/servers/e1f9b5da-f76c-47e2-bc50-eb6487d57306" status: 200 len: 1392 microversion: 2.1 time: 0.629197 Oct 04 21:05:59.938961 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2734/5440] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:05:59 2022] GET /compute/v2.1/servers/e1f9b5da-f76c-47e2-bc50-eb6487d57306 => generated 1392 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:06:00.131113 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-4dc24815-9019-4db9-b021-d43f4d1a9036 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:00.145826 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-4dc24815-9019-4db9-b021-d43f4d1a9036 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:00.148485 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-4dc24815-9019-4db9-b021-d43f4d1a9036 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:00.149942 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-4dc24815-9019-4db9-b021-d43f4d1a9036 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] 10.222.0.33 "GET /compute/v2.1/servers/05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9" status: 200 len: 1406 microversion: 2.20 time: 0.741370 Oct 04 21:06:00.179300 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2707/5441] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 21:05:59 2022] GET /compute/v2.1/servers/05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9 => generated 1406 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:06:00.561315 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-8e23515d-176d-40f2-b672-a6df8fa832b8 req-7a67ecde-4e68-4c76-9f09-bc82717a9d86 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9", "tag": "2f9889d1-cb04-4ccc-8abc-1f54eb9f493f"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:06:00.585310 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-8e23515d-176d-40f2-b672-a6df8fa832b8 req-7a67ecde-4e68-4c76-9f09-bc82717a9d86 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:00.586424 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-8e23515d-176d-40f2-b672-a6df8fa832b8 req-7a67ecde-4e68-4c76-9f09-bc82717a9d86 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:00.588927 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-8e23515d-176d-40f2-b672-a6df8fa832b8 req-7a67ecde-4e68-4c76-9f09-bc82717a9d86 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:00.614862 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-8e23515d-176d-40f2-b672-a6df8fa832b8 req-7a67ecde-4e68-4c76-9f09-bc82717a9d86 service nova] Creating event network-changed:2f9889d1-cb04-4ccc-8abc-1f54eb9f493f for instance 05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9 on n-h2-854823-8 Oct 04 21:06:00.629080 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-8e23515d-176d-40f2-b672-a6df8fa832b8 req-7a67ecde-4e68-4c76-9f09-bc82717a9d86 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072091 Oct 04 21:06:00.629733 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2735/5442] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:06:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:06:00.965621 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b57296ac-7c05-4648-b190-8060cdf41147 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:00.966477 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b57296ac-7c05-4648-b190-8060cdf41147 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] [instance: e1f9b5da-f76c-47e2-bc50-eb6487d57306] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:06:00.985940 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b57296ac-7c05-4648-b190-8060cdf41147 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:00.986552 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b57296ac-7c05-4648-b190-8060cdf41147 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:00.987012 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b57296ac-7c05-4648-b190-8060cdf41147 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:00.987744 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b57296ac-7c05-4648-b190-8060cdf41147 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:00.988217 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b57296ac-7c05-4648-b190-8060cdf41147 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:00.988658 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b57296ac-7c05-4648-b190-8060cdf41147 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:01.188354 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-17a775a0-671b-49ec-a493-fae2715c6c5c tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:01.189437 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-17a775a0-671b-49ec-a493-fae2715c6c5c tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] [instance: 05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:06:01.193844 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell0:SELECT=2 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:06:01.200373 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-17a775a0-671b-49ec-a493-fae2715c6c5c tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:01.201846 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-17a775a0-671b-49ec-a493-fae2715c6c5c tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:01.202580 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-17a775a0-671b-49ec-a493-fae2715c6c5c tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:01.203667 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-17a775a0-671b-49ec-a493-fae2715c6c5c tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:01.204403 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-17a775a0-671b-49ec-a493-fae2715c6c5c tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:01.205068 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-17a775a0-671b-49ec-a493-fae2715c6c5c tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:01.481322 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-b57296ac-7c05-4648-b190-8060cdf41147 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5dbe3da6a4af181ef7302fe605fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3aa23aee3c8435c8f1f409019c5fed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:01.497202 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b57296ac-7c05-4648-b190-8060cdf41147 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] 10.222.0.33 "GET /compute/v2.1/servers/e1f9b5da-f76c-47e2-bc50-eb6487d57306" status: 200 len: 1392 microversion: 2.1 time: 0.535306 Oct 04 21:06:01.498184 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2708/5443] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:06:00 2022] GET /compute/v2.1/servers/e1f9b5da-f76c-47e2-bc50-eb6487d57306 => generated 1392 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:06:01.682427 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-17a775a0-671b-49ec-a493-fae2715c6c5c tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:01.699718 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-17a775a0-671b-49ec-a493-fae2715c6c5c tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:01.705896 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-17a775a0-671b-49ec-a493-fae2715c6c5c tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:01.708783 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-17a775a0-671b-49ec-a493-fae2715c6c5c tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] 10.222.0.33 "GET /compute/v2.1/servers/05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9" status: 200 len: 1406 microversion: 2.20 time: 0.524921 Oct 04 21:06:01.714245 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2736/5444] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 21:06:01 2022] GET /compute/v2.1/servers/05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9 => generated 1406 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:06:02.530318 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f006621f-86ef-43ea-b4bb-097cf4596533 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:02.531986 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f006621f-86ef-43ea-b4bb-097cf4596533 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] [instance: e1f9b5da-f76c-47e2-bc50-eb6487d57306] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:06:02.538544 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:06:02.539279 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=6 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:06:02.560263 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f006621f-86ef-43ea-b4bb-097cf4596533 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:02.560773 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f006621f-86ef-43ea-b4bb-097cf4596533 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:02.567761 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f006621f-86ef-43ea-b4bb-097cf4596533 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:02.568836 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f006621f-86ef-43ea-b4bb-097cf4596533 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:02.569489 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f006621f-86ef-43ea-b4bb-097cf4596533 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:02.570143 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f006621f-86ef-43ea-b4bb-097cf4596533 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:02.725596 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-36e3dc6a-1df1-4bd6-a271-df52cf54fc5c req-93f6005d-e6cb-42cc-8348-eaabbad3cfd5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1f9b5da-f76c-47e2-bc50-eb6487d57306", "tag": "d58cf329-9762-4338-9c18-cefa8710d34b"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:06:02.748413 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-36e3dc6a-1df1-4bd6-a271-df52cf54fc5c req-93f6005d-e6cb-42cc-8348-eaabbad3cfd5 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:02.748898 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-36e3dc6a-1df1-4bd6-a271-df52cf54fc5c req-93f6005d-e6cb-42cc-8348-eaabbad3cfd5 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:02.749321 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-36e3dc6a-1df1-4bd6-a271-df52cf54fc5c req-93f6005d-e6cb-42cc-8348-eaabbad3cfd5 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:02.782203 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-36e3dc6a-1df1-4bd6-a271-df52cf54fc5c req-93f6005d-e6cb-42cc-8348-eaabbad3cfd5 service nova] Creating event network-changed:d58cf329-9762-4338-9c18-cefa8710d34b for instance e1f9b5da-f76c-47e2-bc50-eb6487d57306 on n-h1-854823-8 Oct 04 21:06:02.788394 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-36e3dc6a-1df1-4bd6-a271-df52cf54fc5c req-93f6005d-e6cb-42cc-8348-eaabbad3cfd5 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066666 Oct 04 21:06:02.791972 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2737/5445] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:06:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:06:02.804831 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-842d2fe1-57ab-40ab-9aab-2ece376cd1bd tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:02.806758 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-842d2fe1-57ab-40ab-9aab-2ece376cd1bd tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] [instance: 05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:06:02.824674 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-842d2fe1-57ab-40ab-9aab-2ece376cd1bd tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:02.826714 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-842d2fe1-57ab-40ab-9aab-2ece376cd1bd tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:02.827419 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-842d2fe1-57ab-40ab-9aab-2ece376cd1bd tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:02.828336 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-842d2fe1-57ab-40ab-9aab-2ece376cd1bd tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:02.828973 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-842d2fe1-57ab-40ab-9aab-2ece376cd1bd tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:02.829561 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-842d2fe1-57ab-40ab-9aab-2ece376cd1bd tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:02.907594 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell0:SELECT=10 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:06:03.123617 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f006621f-86ef-43ea-b4bb-097cf4596533 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5dbe3da6a4af181ef7302fe605fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3aa23aee3c8435c8f1f409019c5fed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:03.138619 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f006621f-86ef-43ea-b4bb-097cf4596533 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] 10.222.0.33 "GET /compute/v2.1/servers/e1f9b5da-f76c-47e2-bc50-eb6487d57306" status: 200 len: 1392 microversion: 2.1 time: 0.614540 Oct 04 21:06:03.142961 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2709/5446] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:06:02 2022] GET /compute/v2.1/servers/e1f9b5da-f76c-47e2-bc50-eb6487d57306 => generated 1392 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:06:03.511439 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-842d2fe1-57ab-40ab-9aab-2ece376cd1bd tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:03.522961 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-842d2fe1-57ab-40ab-9aab-2ece376cd1bd tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:03.538146 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-842d2fe1-57ab-40ab-9aab-2ece376cd1bd tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:03.542057 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-842d2fe1-57ab-40ab-9aab-2ece376cd1bd tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] 10.222.0.33 "GET /compute/v2.1/servers/05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9" status: 200 len: 1406 microversion: 2.20 time: 0.745748 Oct 04 21:06:03.543029 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2738/5447] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 21:06:02 2022] GET /compute/v2.1/servers/05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9 => generated 1406 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:06:04.168486 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f1311757-8a4e-4b14-b924-3ff9e42548e9 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:04.169992 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f1311757-8a4e-4b14-b924-3ff9e42548e9 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] [instance: e1f9b5da-f76c-47e2-bc50-eb6487d57306] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:06:04.185916 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f1311757-8a4e-4b14-b924-3ff9e42548e9 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:04.192462 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f1311757-8a4e-4b14-b924-3ff9e42548e9 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:04.193445 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f1311757-8a4e-4b14-b924-3ff9e42548e9 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:04.200055 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f1311757-8a4e-4b14-b924-3ff9e42548e9 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:04.201113 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f1311757-8a4e-4b14-b924-3ff9e42548e9 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:04.201790 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f1311757-8a4e-4b14-b924-3ff9e42548e9 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:04.573562 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-be0008b8-5b38-443f-a05f-6f51035ca042 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:04.574840 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-be0008b8-5b38-443f-a05f-6f51035ca042 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] [instance: 05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:06:04.610844 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-be0008b8-5b38-443f-a05f-6f51035ca042 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:04.611561 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-be0008b8-5b38-443f-a05f-6f51035ca042 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:04.611901 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-be0008b8-5b38-443f-a05f-6f51035ca042 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:04.612682 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-be0008b8-5b38-443f-a05f-6f51035ca042 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:04.613101 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-be0008b8-5b38-443f-a05f-6f51035ca042 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:04.613535 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-be0008b8-5b38-443f-a05f-6f51035ca042 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:04.842294 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f1311757-8a4e-4b14-b924-3ff9e42548e9 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5dbe3da6a4af181ef7302fe605fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3aa23aee3c8435c8f1f409019c5fed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:04.854796 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f1311757-8a4e-4b14-b924-3ff9e42548e9 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] 10.222.0.33 "GET /compute/v2.1/servers/e1f9b5da-f76c-47e2-bc50-eb6487d57306" status: 200 len: 1392 microversion: 2.1 time: 0.691889 Oct 04 21:06:04.855416 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2710/5448] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:06:04 2022] GET /compute/v2.1/servers/e1f9b5da-f76c-47e2-bc50-eb6487d57306 => generated 1392 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:06:05.132236 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-be0008b8-5b38-443f-a05f-6f51035ca042 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:05.148450 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-be0008b8-5b38-443f-a05f-6f51035ca042 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:05.150994 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-be0008b8-5b38-443f-a05f-6f51035ca042 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:05.152172 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-be0008b8-5b38-443f-a05f-6f51035ca042 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] 10.222.0.33 "GET /compute/v2.1/servers/05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9" status: 200 len: 1406 microversion: 2.20 time: 0.583928 Oct 04 21:06:05.152817 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2739/5449] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 21:06:04 2022] GET /compute/v2.1/servers/05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9 => generated 1406 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:06:05.891642 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9340a24e-7293-40d4-b0a3-32c01a2936dc tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:05.892367 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-9340a24e-7293-40d4-b0a3-32c01a2936dc tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] [instance: e1f9b5da-f76c-47e2-bc50-eb6487d57306] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:06:05.927348 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9340a24e-7293-40d4-b0a3-32c01a2936dc tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:05.928144 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9340a24e-7293-40d4-b0a3-32c01a2936dc tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:05.930675 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9340a24e-7293-40d4-b0a3-32c01a2936dc tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:05.932473 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9340a24e-7293-40d4-b0a3-32c01a2936dc tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:05.934550 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9340a24e-7293-40d4-b0a3-32c01a2936dc tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:05.937365 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9340a24e-7293-40d4-b0a3-32c01a2936dc tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:06.185284 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-26683726-54b0-412a-86c1-c072cc7186bd tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:06.186041 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-26683726-54b0-412a-86c1-c072cc7186bd tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] [instance: 05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:06:06.204437 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-26683726-54b0-412a-86c1-c072cc7186bd tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:06.204864 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-26683726-54b0-412a-86c1-c072cc7186bd tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:06.205329 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-26683726-54b0-412a-86c1-c072cc7186bd tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:06.209657 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-26683726-54b0-412a-86c1-c072cc7186bd tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:06.210221 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-26683726-54b0-412a-86c1-c072cc7186bd tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:06.210706 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-26683726-54b0-412a-86c1-c072cc7186bd tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:06.283794 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-9340a24e-7293-40d4-b0a3-32c01a2936dc tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5dbe3da6a4af181ef7302fe605fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3aa23aee3c8435c8f1f409019c5fed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:06.298295 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-9340a24e-7293-40d4-b0a3-32c01a2936dc tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] 10.222.0.33 "GET /compute/v2.1/servers/e1f9b5da-f76c-47e2-bc50-eb6487d57306" status: 200 len: 1392 microversion: 2.1 time: 0.421915 Oct 04 21:06:06.302374 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2711/5450] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:06:05 2022] GET /compute/v2.1/servers/e1f9b5da-f76c-47e2-bc50-eb6487d57306 => generated 1392 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:06:06.644619 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-26683726-54b0-412a-86c1-c072cc7186bd tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:06.659305 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-26683726-54b0-412a-86c1-c072cc7186bd tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:06.665438 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-26683726-54b0-412a-86c1-c072cc7186bd tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:06.670208 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-26683726-54b0-412a-86c1-c072cc7186bd tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] 10.222.0.33 "GET /compute/v2.1/servers/05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9" status: 200 len: 1406 microversion: 2.20 time: 0.490890 Oct 04 21:06:06.676234 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2740/5451] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 21:06:06 2022] GET /compute/v2.1/servers/05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9 => generated 1406 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:06:07.328878 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a7a65fd1-37e2-478d-bb85-01a050f1174a tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:07.350579 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a7a65fd1-37e2-478d-bb85-01a050f1174a tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] [instance: e1f9b5da-f76c-47e2-bc50-eb6487d57306] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:06:07.411507 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a7a65fd1-37e2-478d-bb85-01a050f1174a tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:07.412600 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a7a65fd1-37e2-478d-bb85-01a050f1174a tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:07.413523 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a7a65fd1-37e2-478d-bb85-01a050f1174a tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:07.415212 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a7a65fd1-37e2-478d-bb85-01a050f1174a tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:07.415996 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a7a65fd1-37e2-478d-bb85-01a050f1174a tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:07.416973 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a7a65fd1-37e2-478d-bb85-01a050f1174a tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:07.717437 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-5e94e512-ae70-4854-980d-d20e7d53667a tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:07.718554 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-5e94e512-ae70-4854-980d-d20e7d53667a tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] [instance: 05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:06:07.727967 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5e94e512-ae70-4854-980d-d20e7d53667a tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:07.731459 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5e94e512-ae70-4854-980d-d20e7d53667a tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:07.732043 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5e94e512-ae70-4854-980d-d20e7d53667a tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:07.732949 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5e94e512-ae70-4854-980d-d20e7d53667a tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:07.733613 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5e94e512-ae70-4854-980d-d20e7d53667a tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:07.734243 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5e94e512-ae70-4854-980d-d20e7d53667a tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:07.843526 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-a7a65fd1-37e2-478d-bb85-01a050f1174a tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5dbe3da6a4af181ef7302fe605fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3aa23aee3c8435c8f1f409019c5fed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:07.858202 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a7a65fd1-37e2-478d-bb85-01a050f1174a tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] 10.222.0.33 "GET /compute/v2.1/servers/e1f9b5da-f76c-47e2-bc50-eb6487d57306" status: 200 len: 1392 microversion: 2.1 time: 0.537114 Oct 04 21:06:07.860308 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2712/5452] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:06:07 2022] GET /compute/v2.1/servers/e1f9b5da-f76c-47e2-bc50-eb6487d57306 => generated 1392 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:06:08.053038 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-5e94e512-ae70-4854-980d-d20e7d53667a tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:08.071775 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-5e94e512-ae70-4854-980d-d20e7d53667a tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:08.075037 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-5e94e512-ae70-4854-980d-d20e7d53667a tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:08.078887 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-5e94e512-ae70-4854-980d-d20e7d53667a tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] 10.222.0.33 "GET /compute/v2.1/servers/05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9" status: 200 len: 1406 microversion: 2.20 time: 0.381560 Oct 04 21:06:08.080425 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2741/5453] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 21:06:07 2022] GET /compute/v2.1/servers/05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9 => generated 1406 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:06:08.892319 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-361a68ac-5c75-4b0c-8106-db271417041b tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:08.892923 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-361a68ac-5c75-4b0c-8106-db271417041b tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] [instance: e1f9b5da-f76c-47e2-bc50-eb6487d57306] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:06:08.905259 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-361a68ac-5c75-4b0c-8106-db271417041b tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:08.911905 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-361a68ac-5c75-4b0c-8106-db271417041b tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:08.912433 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-361a68ac-5c75-4b0c-8106-db271417041b tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:08.913855 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-361a68ac-5c75-4b0c-8106-db271417041b tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:08.916638 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-361a68ac-5c75-4b0c-8106-db271417041b tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:08.918110 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-361a68ac-5c75-4b0c-8106-db271417041b tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:09.116384 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-c6416928-3c53-4ff6-b2f7-e2715fcca3ee tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:09.117688 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-c6416928-3c53-4ff6-b2f7-e2715fcca3ee tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] [instance: 05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:06:09.141693 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c6416928-3c53-4ff6-b2f7-e2715fcca3ee tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:09.147743 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c6416928-3c53-4ff6-b2f7-e2715fcca3ee tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:09.148773 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c6416928-3c53-4ff6-b2f7-e2715fcca3ee tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:09.161091 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c6416928-3c53-4ff6-b2f7-e2715fcca3ee tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:09.168969 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c6416928-3c53-4ff6-b2f7-e2715fcca3ee tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:09.169550 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c6416928-3c53-4ff6-b2f7-e2715fcca3ee tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:09.371424 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-361a68ac-5c75-4b0c-8106-db271417041b tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5dbe3da6a4af181ef7302fe605fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3aa23aee3c8435c8f1f409019c5fed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:09.387275 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-361a68ac-5c75-4b0c-8106-db271417041b tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] 10.222.0.33 "GET /compute/v2.1/servers/e1f9b5da-f76c-47e2-bc50-eb6487d57306" status: 200 len: 1392 microversion: 2.1 time: 0.500766 Oct 04 21:06:09.389254 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2713/5454] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:06:08 2022] GET /compute/v2.1/servers/e1f9b5da-f76c-47e2-bc50-eb6487d57306 => generated 1392 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:06:09.660494 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-c6416928-3c53-4ff6-b2f7-e2715fcca3ee tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:09.675579 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-c6416928-3c53-4ff6-b2f7-e2715fcca3ee tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:09.677554 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-c6416928-3c53-4ff6-b2f7-e2715fcca3ee tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:09.679119 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-c6416928-3c53-4ff6-b2f7-e2715fcca3ee tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] 10.222.0.33 "GET /compute/v2.1/servers/05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9" status: 200 len: 1406 microversion: 2.20 time: 0.575554 Oct 04 21:06:09.683836 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2742/5455] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 21:06:09 2022] GET /compute/v2.1/servers/05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9 => generated 1406 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:06:10.419296 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1a5d86ed-4e58-4849-a817-577bff820d14 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:10.421497 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-1a5d86ed-4e58-4849-a817-577bff820d14 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] [instance: e1f9b5da-f76c-47e2-bc50-eb6487d57306] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:06:10.439463 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1a5d86ed-4e58-4849-a817-577bff820d14 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:10.441298 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1a5d86ed-4e58-4849-a817-577bff820d14 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:10.443965 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1a5d86ed-4e58-4849-a817-577bff820d14 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:10.449978 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1a5d86ed-4e58-4849-a817-577bff820d14 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:10.452063 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1a5d86ed-4e58-4849-a817-577bff820d14 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:10.452815 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1a5d86ed-4e58-4849-a817-577bff820d14 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:10.709770 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-ecc36b38-381a-45a0-ae36-cfc67c72c1bc tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:10.710415 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-ecc36b38-381a-45a0-ae36-cfc67c72c1bc tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] [instance: 05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:06:10.727903 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ecc36b38-381a-45a0-ae36-cfc67c72c1bc tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:10.730954 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ecc36b38-381a-45a0-ae36-cfc67c72c1bc tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:10.732920 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ecc36b38-381a-45a0-ae36-cfc67c72c1bc tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:10.735290 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ecc36b38-381a-45a0-ae36-cfc67c72c1bc tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:10.740249 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ecc36b38-381a-45a0-ae36-cfc67c72c1bc tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:10.741781 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ecc36b38-381a-45a0-ae36-cfc67c72c1bc tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:11.006662 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-1a5d86ed-4e58-4849-a817-577bff820d14 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5dbe3da6a4af181ef7302fe605fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3aa23aee3c8435c8f1f409019c5fed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:11.030679 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-1a5d86ed-4e58-4849-a817-577bff820d14 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] 10.222.0.33 "GET /compute/v2.1/servers/e1f9b5da-f76c-47e2-bc50-eb6487d57306" status: 200 len: 1392 microversion: 2.1 time: 0.617012 Oct 04 21:06:11.046430 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2714/5456] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:06:10 2022] GET /compute/v2.1/servers/e1f9b5da-f76c-47e2-bc50-eb6487d57306 => generated 1392 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:06:11.182862 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-ecc36b38-381a-45a0-ae36-cfc67c72c1bc tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:11.203096 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-ecc36b38-381a-45a0-ae36-cfc67c72c1bc tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:11.222614 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-ecc36b38-381a-45a0-ae36-cfc67c72c1bc tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:11.229246 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-ecc36b38-381a-45a0-ae36-cfc67c72c1bc tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] 10.222.0.33 "GET /compute/v2.1/servers/05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9" status: 200 len: 1406 microversion: 2.20 time: 0.521624 Oct 04 21:06:11.230298 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2743/5457] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 21:06:10 2022] GET /compute/v2.1/servers/05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9 => generated 1406 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:06:11.526996 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-c74d6867-b1eb-45cd-a459-125e73b54a2a req-744ee2ee-d390-479b-b6c2-b9777387e8c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1f9b5da-f76c-47e2-bc50-eb6487d57306", "name": "network-vif-plugged", "status": "completed", "tag": "d58cf329-9762-4338-9c18-cefa8710d34b"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:06:11.558384 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-c74d6867-b1eb-45cd-a459-125e73b54a2a req-744ee2ee-d390-479b-b6c2-b9777387e8c7 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:11.559137 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-c74d6867-b1eb-45cd-a459-125e73b54a2a req-744ee2ee-d390-479b-b6c2-b9777387e8c7 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:11.560703 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-c74d6867-b1eb-45cd-a459-125e73b54a2a req-744ee2ee-d390-479b-b6c2-b9777387e8c7 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:11.582334 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-c74d6867-b1eb-45cd-a459-125e73b54a2a req-744ee2ee-d390-479b-b6c2-b9777387e8c7 service nova] Creating event network-vif-plugged:d58cf329-9762-4338-9c18-cefa8710d34b for instance e1f9b5da-f76c-47e2-bc50-eb6487d57306 on n-h1-854823-8 Oct 04 21:06:11.591311 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-c74d6867-b1eb-45cd-a459-125e73b54a2a req-744ee2ee-d390-479b-b6c2-b9777387e8c7 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.394330 Oct 04 21:06:11.592290 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2715/5458] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:06:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:06:12.062767 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-a5594d76-c168-4586-8500-8ed7f3f5db65 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:12.064739 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-a5594d76-c168-4586-8500-8ed7f3f5db65 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] [instance: e1f9b5da-f76c-47e2-bc50-eb6487d57306] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:06:12.078578 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a5594d76-c168-4586-8500-8ed7f3f5db65 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:12.079645 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a5594d76-c168-4586-8500-8ed7f3f5db65 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:12.080376 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a5594d76-c168-4586-8500-8ed7f3f5db65 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:12.081385 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a5594d76-c168-4586-8500-8ed7f3f5db65 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:12.082209 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a5594d76-c168-4586-8500-8ed7f3f5db65 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:12.082950 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a5594d76-c168-4586-8500-8ed7f3f5db65 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:12.261659 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e62a1c63-59c3-4b9c-be75-4f0014221b29 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:12.262499 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e62a1c63-59c3-4b9c-be75-4f0014221b29 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] [instance: 05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:06:12.279007 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e62a1c63-59c3-4b9c-be75-4f0014221b29 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:12.280884 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e62a1c63-59c3-4b9c-be75-4f0014221b29 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:12.282144 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e62a1c63-59c3-4b9c-be75-4f0014221b29 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:12.285993 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e62a1c63-59c3-4b9c-be75-4f0014221b29 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:12.287050 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e62a1c63-59c3-4b9c-be75-4f0014221b29 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:12.289352 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e62a1c63-59c3-4b9c-be75-4f0014221b29 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:12.369645 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-a5594d76-c168-4586-8500-8ed7f3f5db65 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5dbe3da6a4af181ef7302fe605fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3aa23aee3c8435c8f1f409019c5fed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:12.379391 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-a5594d76-c168-4586-8500-8ed7f3f5db65 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] 10.222.0.33 "GET /compute/v2.1/servers/e1f9b5da-f76c-47e2-bc50-eb6487d57306" status: 200 len: 1392 microversion: 2.1 time: 0.326456 Oct 04 21:06:12.380657 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2744/5459] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:06:12 2022] GET /compute/v2.1/servers/e1f9b5da-f76c-47e2-bc50-eb6487d57306 => generated 1392 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:06:12.751527 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e62a1c63-59c3-4b9c-be75-4f0014221b29 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:12.766535 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e62a1c63-59c3-4b9c-be75-4f0014221b29 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:12.769109 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e62a1c63-59c3-4b9c-be75-4f0014221b29 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:12.770809 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e62a1c63-59c3-4b9c-be75-4f0014221b29 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] 10.222.0.33 "GET /compute/v2.1/servers/05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9" status: 200 len: 1406 microversion: 2.20 time: 0.516985 Oct 04 21:06:12.771686 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2716/5460] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 21:06:12 2022] GET /compute/v2.1/servers/05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9 => generated 1406 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:06:13.407605 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-e20e2d64-cb7b-43f9-9f5c-775afa303011 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:13.408319 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-e20e2d64-cb7b-43f9-9f5c-775afa303011 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] [instance: e1f9b5da-f76c-47e2-bc50-eb6487d57306] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:06:13.424761 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e20e2d64-cb7b-43f9-9f5c-775afa303011 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:13.427989 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e20e2d64-cb7b-43f9-9f5c-775afa303011 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:13.428929 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e20e2d64-cb7b-43f9-9f5c-775afa303011 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:13.434930 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e20e2d64-cb7b-43f9-9f5c-775afa303011 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:13.436222 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e20e2d64-cb7b-43f9-9f5c-775afa303011 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:13.436881 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e20e2d64-cb7b-43f9-9f5c-775afa303011 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:13.616400 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-cdf9548d-5ad3-4bd9-92c5-6e7911156479 req-b1609542-c8a2-462a-93d2-5e9ee819376a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9", "name": "network-vif-plugged", "status": "completed", "tag": "2f9889d1-cb04-4ccc-8abc-1f54eb9f493f"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:06:13.656579 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-cdf9548d-5ad3-4bd9-92c5-6e7911156479 req-b1609542-c8a2-462a-93d2-5e9ee819376a service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:13.657151 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-cdf9548d-5ad3-4bd9-92c5-6e7911156479 req-b1609542-c8a2-462a-93d2-5e9ee819376a service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:13.657722 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-cdf9548d-5ad3-4bd9-92c5-6e7911156479 req-b1609542-c8a2-462a-93d2-5e9ee819376a service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:13.710265 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-cdf9548d-5ad3-4bd9-92c5-6e7911156479 req-b1609542-c8a2-462a-93d2-5e9ee819376a service nova] Creating event network-vif-plugged:2f9889d1-cb04-4ccc-8abc-1f54eb9f493f for instance 05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9 on n-h2-854823-8 Oct 04 21:06:13.729042 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-cdf9548d-5ad3-4bd9-92c5-6e7911156479 req-b1609542-c8a2-462a-93d2-5e9ee819376a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116011 Oct 04 21:06:13.731700 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2717/5461] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:06:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:06:13.813371 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-3ba92899-913c-4386-bed7-8110cfe63318 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:13.817438 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-3ba92899-913c-4386-bed7-8110cfe63318 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] [instance: 05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:06:13.843294 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3ba92899-913c-4386-bed7-8110cfe63318 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:13.843864 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3ba92899-913c-4386-bed7-8110cfe63318 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:13.844319 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3ba92899-913c-4386-bed7-8110cfe63318 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:13.852196 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3ba92899-913c-4386-bed7-8110cfe63318 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:13.852706 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3ba92899-913c-4386-bed7-8110cfe63318 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:13.854514 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3ba92899-913c-4386-bed7-8110cfe63318 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:14.310546 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-e20e2d64-cb7b-43f9-9f5c-775afa303011 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5dbe3da6a4af181ef7302fe605fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3aa23aee3c8435c8f1f409019c5fed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:14.329208 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-e20e2d64-cb7b-43f9-9f5c-775afa303011 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] 10.222.0.33 "GET /compute/v2.1/servers/e1f9b5da-f76c-47e2-bc50-eb6487d57306" status: 200 len: 1565 microversion: 2.1 time: 0.926690 Oct 04 21:06:14.330289 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2745/5462] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:06:13 2022] GET /compute/v2.1/servers/e1f9b5da-f76c-47e2-bc50-eb6487d57306 => generated 1565 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:06:14.354670 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-5d8ee262-7e23-4ec9-aaea-498b201095d6 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:14.355367 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-5d8ee262-7e23-4ec9-aaea-498b201095d6 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] [instance: e1f9b5da-f76c-47e2-bc50-eb6487d57306] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:06:14.370387 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5d8ee262-7e23-4ec9-aaea-498b201095d6 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:14.371263 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5d8ee262-7e23-4ec9-aaea-498b201095d6 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:14.371958 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5d8ee262-7e23-4ec9-aaea-498b201095d6 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:14.372741 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5d8ee262-7e23-4ec9-aaea-498b201095d6 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:14.373371 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5d8ee262-7e23-4ec9-aaea-498b201095d6 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:14.377291 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5d8ee262-7e23-4ec9-aaea-498b201095d6 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:14.420914 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=100 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:06:14.536306 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-3ba92899-913c-4386-bed7-8110cfe63318 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:14.546234 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-3ba92899-913c-4386-bed7-8110cfe63318 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:14.553433 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-3ba92899-913c-4386-bed7-8110cfe63318 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:14.559937 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-3ba92899-913c-4386-bed7-8110cfe63318 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] 10.222.0.33 "GET /compute/v2.1/servers/05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9" status: 200 len: 1406 microversion: 2.20 time: 0.764766 Oct 04 21:06:14.560550 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2718/5463] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 21:06:13 2022] GET /compute/v2.1/servers/05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9 => generated 1406 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:06:14.680908 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-5d8ee262-7e23-4ec9-aaea-498b201095d6 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5dbe3da6a4af181ef7302fe605fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3aa23aee3c8435c8f1f409019c5fed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:14.710717 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-5d8ee262-7e23-4ec9-aaea-498b201095d6 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] 10.222.0.33 "GET /compute/v2.1/servers/e1f9b5da-f76c-47e2-bc50-eb6487d57306" status: 200 len: 1565 microversion: 2.1 time: 0.360605 Oct 04 21:06:14.711749 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2746/5464] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:06:14 2022] GET /compute/v2.1/servers/e1f9b5da-f76c-47e2-bc50-eb6487d57306 => generated 1565 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:06:15.591095 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-31271cc4-5b26-4500-9e0d-b106fc79644c tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:15.592352 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-31271cc4-5b26-4500-9e0d-b106fc79644c tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] [instance: 05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:06:15.606283 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-31271cc4-5b26-4500-9e0d-b106fc79644c tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:15.607064 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-31271cc4-5b26-4500-9e0d-b106fc79644c tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:15.607673 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-31271cc4-5b26-4500-9e0d-b106fc79644c tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:15.609923 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-31271cc4-5b26-4500-9e0d-b106fc79644c tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:15.611873 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-31271cc4-5b26-4500-9e0d-b106fc79644c tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:15.614234 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-31271cc4-5b26-4500-9e0d-b106fc79644c tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:16.092008 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-31271cc4-5b26-4500-9e0d-b106fc79644c tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:16.111056 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-31271cc4-5b26-4500-9e0d-b106fc79644c tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:16.115329 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-31271cc4-5b26-4500-9e0d-b106fc79644c tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:16.123264 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-31271cc4-5b26-4500-9e0d-b106fc79644c tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] 10.222.0.33 "GET /compute/v2.1/servers/05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9" status: 200 len: 1598 microversion: 2.20 time: 0.531108 Oct 04 21:06:16.126749 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2719/5465] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 21:06:15 2022] GET /compute/v2.1/servers/05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9 => generated 1598 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:06:16.153387 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-50a3349a-b13f-49bc-95ae-c0678fbbab1a tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:16.153874 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-50a3349a-b13f-49bc-95ae-c0678fbbab1a tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] [instance: 05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:06:16.161391 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-50a3349a-b13f-49bc-95ae-c0678fbbab1a tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:16.161877 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-50a3349a-b13f-49bc-95ae-c0678fbbab1a tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:16.162312 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-50a3349a-b13f-49bc-95ae-c0678fbbab1a tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:16.177735 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-50a3349a-b13f-49bc-95ae-c0678fbbab1a tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:16.178230 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-50a3349a-b13f-49bc-95ae-c0678fbbab1a tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:16.178703 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-50a3349a-b13f-49bc-95ae-c0678fbbab1a tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:16.578887 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-50a3349a-b13f-49bc-95ae-c0678fbbab1a tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] 10.222.0.33 "GET /compute/v2.1/servers/05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.429302 Oct 04 21:06:16.579921 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2747/5466] 10.222.0.33 () {60 vars in 1316 bytes} [Tue Oct 4 21:06:16 2022] GET /compute/v2.1/servers/05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9/os-interface => generated 285 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 21:06:20.146243 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-c78534eb-5ea7-4f6b-bf30-38d509254b3e req-28dbf425-707a-406f-9612-bc11b11b1928 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9", "tag": "2f9889d1-cb04-4ccc-8abc-1f54eb9f493f"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:06:20.169834 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-c78534eb-5ea7-4f6b-bf30-38d509254b3e req-28dbf425-707a-406f-9612-bc11b11b1928 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:20.170599 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-c78534eb-5ea7-4f6b-bf30-38d509254b3e req-28dbf425-707a-406f-9612-bc11b11b1928 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:20.174390 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-c78534eb-5ea7-4f6b-bf30-38d509254b3e req-28dbf425-707a-406f-9612-bc11b11b1928 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:20.204898 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-c78534eb-5ea7-4f6b-bf30-38d509254b3e req-28dbf425-707a-406f-9612-bc11b11b1928 service nova] Creating event network-changed:2f9889d1-cb04-4ccc-8abc-1f54eb9f493f for instance 05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9 on n-h2-854823-8 Oct 04 21:06:20.216917 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-c78534eb-5ea7-4f6b-bf30-38d509254b3e req-28dbf425-707a-406f-9612-bc11b11b1928 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077746 Oct 04 21:06:20.220695 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2720/5467] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:06:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:06:21.804976 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-7c3745ff-5a24-439f-a728-6e1d1fcf9f50 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:21.805567 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-7c3745ff-5a24-439f-a728-6e1d1fcf9f50 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] [instance: e1f9b5da-f76c-47e2-bc50-eb6487d57306] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:06:21.820311 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=3 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:06:21.837068 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7c3745ff-5a24-439f-a728-6e1d1fcf9f50 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:21.842290 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7c3745ff-5a24-439f-a728-6e1d1fcf9f50 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:21.842779 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7c3745ff-5a24-439f-a728-6e1d1fcf9f50 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:21.845041 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7c3745ff-5a24-439f-a728-6e1d1fcf9f50 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:21.845523 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7c3745ff-5a24-439f-a728-6e1d1fcf9f50 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:21.860451 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7c3745ff-5a24-439f-a728-6e1d1fcf9f50 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:22.466931 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-7c3745ff-5a24-439f-a728-6e1d1fcf9f50 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5dbe3da6a4af181ef7302fe605fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3aa23aee3c8435c8f1f409019c5fed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:22.475864 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-7c3745ff-5a24-439f-a728-6e1d1fcf9f50 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] 10.222.0.33 "GET /compute/v2.1/servers/e1f9b5da-f76c-47e2-bc50-eb6487d57306" status: 200 len: 1565 microversion: 2.1 time: 0.675993 Oct 04 21:06:22.489058 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-f5732a2b-0310-4583-ad13-943de9183507 req-d57d8a40-de68-44d8-ba41-16340b5556d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1f9b5da-f76c-47e2-bc50-eb6487d57306", "tag": "d58cf329-9762-4338-9c18-cefa8710d34b"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:06:22.492965 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2748/5468] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:06:21 2022] GET /compute/v2.1/servers/e1f9b5da-f76c-47e2-bc50-eb6487d57306 => generated 1565 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:06:22.512173 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=3 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:06:22.544416 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-f5732a2b-0310-4583-ad13-943de9183507 req-d57d8a40-de68-44d8-ba41-16340b5556d2 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:22.545818 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-f5732a2b-0310-4583-ad13-943de9183507 req-d57d8a40-de68-44d8-ba41-16340b5556d2 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.028s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:22.549264 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-f5732a2b-0310-4583-ad13-943de9183507 req-d57d8a40-de68-44d8-ba41-16340b5556d2 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:22.562181 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=93 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:06:22.610904 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-f5732a2b-0310-4583-ad13-943de9183507 req-d57d8a40-de68-44d8-ba41-16340b5556d2 service nova] Creating event network-changed:d58cf329-9762-4338-9c18-cefa8710d34b for instance e1f9b5da-f76c-47e2-bc50-eb6487d57306 on n-h1-854823-8 Oct 04 21:06:22.643078 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-f5732a2b-0310-4583-ad13-943de9183507 req-d57d8a40-de68-44d8-ba41-16340b5556d2 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.818294 Oct 04 21:06:22.646415 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2721/5469] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:06:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:06:40.391538 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-4b5d2be7-1964-446c-bbf0-42b9be6c1746 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:06:40.402391 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-4b5d2be7-1964-446c-bbf0-42b9be6c1746 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] [instance: e1f9b5da-f76c-47e2-bc50-eb6487d57306] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:06:40.438104 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_api:SELECT=1 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:06:40.438104 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=12 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:06:40.451161 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4b5d2be7-1964-446c-bbf0-42b9be6c1746 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:40.451661 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4b5d2be7-1964-446c-bbf0-42b9be6c1746 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:40.452100 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4b5d2be7-1964-446c-bbf0-42b9be6c1746 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:40.452812 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4b5d2be7-1964-446c-bbf0-42b9be6c1746 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:40.454742 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4b5d2be7-1964-446c-bbf0-42b9be6c1746 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:40.456244 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4b5d2be7-1964-446c-bbf0-42b9be6c1746 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:40.599132 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-4b5d2be7-1964-446c-bbf0-42b9be6c1746 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] 10.222.0.33 "POST /compute/v2.1/servers/e1f9b5da-f76c-47e2-bc50-eb6487d57306/action" status: 200 len: 24568 microversion: 2.1 time: 0.221687 Oct 04 21:06:40.599811 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2749/5470] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 21:06:40 2022] POST /compute/v2.1/servers/e1f9b5da-f76c-47e2-bc50-eb6487d57306/action => generated 24568 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 21:06:51.630634 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0174380c-8fbb-40e8-bb76-275b2969ac53 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:51.631358 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-0174380c-8fbb-40e8-bb76-275b2969ac53 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] [instance: e1f9b5da-f76c-47e2-bc50-eb6487d57306] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:06:51.652490 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0174380c-8fbb-40e8-bb76-275b2969ac53 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:51.653299 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0174380c-8fbb-40e8-bb76-275b2969ac53 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:51.653913 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0174380c-8fbb-40e8-bb76-275b2969ac53 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:51.659535 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0174380c-8fbb-40e8-bb76-275b2969ac53 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:51.660290 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0174380c-8fbb-40e8-bb76-275b2969ac53 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:51.660917 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0174380c-8fbb-40e8-bb76-275b2969ac53 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:52.028871 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-0174380c-8fbb-40e8-bb76-275b2969ac53 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5dbe3da6a4af181ef7302fe605fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3aa23aee3c8435c8f1f409019c5fed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:52.050543 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-0174380c-8fbb-40e8-bb76-275b2969ac53 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] 10.222.0.33 "GET /compute/v2.1/servers/e1f9b5da-f76c-47e2-bc50-eb6487d57306" status: 200 len: 1684 microversion: 2.1 time: 0.424453 Oct 04 21:06:52.057273 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2722/5471] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:06:51 2022] GET /compute/v2.1/servers/e1f9b5da-f76c-47e2-bc50-eb6487d57306 => generated 1684 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:06:52.207885 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-98f7940a-3117-4732-806a-63522082b8fc tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:06:52.219369 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-98f7940a-3117-4732-806a-63522082b8fc tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] [instance: e1f9b5da-f76c-47e2-bc50-eb6487d57306] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:06:52.239365 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_api:SELECT=2 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:06:52.243636 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=4 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:06:52.246413 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-98f7940a-3117-4732-806a-63522082b8fc tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:52.247370 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-98f7940a-3117-4732-806a-63522082b8fc tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:52.248273 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-98f7940a-3117-4732-806a-63522082b8fc tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:52.250815 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-98f7940a-3117-4732-806a-63522082b8fc tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:52.251798 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-98f7940a-3117-4732-806a-63522082b8fc tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:52.252832 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-98f7940a-3117-4732-806a-63522082b8fc tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:52.372436 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-98f7940a-3117-4732-806a-63522082b8fc tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] 10.222.0.33 "POST /compute/v2.1/servers/e1f9b5da-f76c-47e2-bc50-eb6487d57306/action" status: 200 len: 32639 microversion: 2.1 time: 0.176217 Oct 04 21:06:52.373486 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2750/5472] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 21:06:52 2022] POST /compute/v2.1/servers/e1f9b5da-f76c-47e2-bc50-eb6487d57306/action => generated 32639 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 21:06:52.612233 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-fe055f0a-aebc-4d93-a92b-fa626eb3a829 tempest-TestNetworkAdvancedServerOps-2095277972 tempest-TestNetworkAdvancedServerOps-2095277972-project-admin] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:52.613341 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-fe055f0a-aebc-4d93-a92b-fa626eb3a829 tempest-TestNetworkAdvancedServerOps-2095277972 tempest-TestNetworkAdvancedServerOps-2095277972-project-admin] [instance: e1f9b5da-f76c-47e2-bc50-eb6487d57306] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:06:52.640295 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fe055f0a-aebc-4d93-a92b-fa626eb3a829 tempest-TestNetworkAdvancedServerOps-2095277972 tempest-TestNetworkAdvancedServerOps-2095277972-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:52.641500 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fe055f0a-aebc-4d93-a92b-fa626eb3a829 tempest-TestNetworkAdvancedServerOps-2095277972 tempest-TestNetworkAdvancedServerOps-2095277972-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:52.655895 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fe055f0a-aebc-4d93-a92b-fa626eb3a829 tempest-TestNetworkAdvancedServerOps-2095277972 tempest-TestNetworkAdvancedServerOps-2095277972-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:52.664085 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fe055f0a-aebc-4d93-a92b-fa626eb3a829 tempest-TestNetworkAdvancedServerOps-2095277972 tempest-TestNetworkAdvancedServerOps-2095277972-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:52.667238 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fe055f0a-aebc-4d93-a92b-fa626eb3a829 tempest-TestNetworkAdvancedServerOps-2095277972 tempest-TestNetworkAdvancedServerOps-2095277972-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:52.672939 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fe055f0a-aebc-4d93-a92b-fa626eb3a829 tempest-TestNetworkAdvancedServerOps-2095277972 tempest-TestNetworkAdvancedServerOps-2095277972-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:53.035011 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d23b1fdc-f030-4b9a-8df8-ac0890966b1c tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:53.036352 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d23b1fdc-f030-4b9a-8df8-ac0890966b1c tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] [instance: 05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:06:53.049669 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d23b1fdc-f030-4b9a-8df8-ac0890966b1c tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:53.051246 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d23b1fdc-f030-4b9a-8df8-ac0890966b1c tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:53.052115 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d23b1fdc-f030-4b9a-8df8-ac0890966b1c tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:53.053187 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d23b1fdc-f030-4b9a-8df8-ac0890966b1c tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:53.054224 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d23b1fdc-f030-4b9a-8df8-ac0890966b1c tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:53.056862 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d23b1fdc-f030-4b9a-8df8-ac0890966b1c tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:53.103426 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d23b1fdc-f030-4b9a-8df8-ac0890966b1c tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] 10.222.0.33 "GET /compute/v2.1/servers/05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9/ips" status: 200 len: 151 microversion: 2.20 time: 0.642593 Oct 04 21:06:53.104971 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2723/5473] 10.222.0.33 () {60 vars in 1289 bytes} [Tue Oct 4 21:06:52 2022] GET /compute/v2.1/servers/05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9/ips => generated 151 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 21:06:53.231044 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-fe055f0a-aebc-4d93-a92b-fa626eb3a829 tempest-TestNetworkAdvancedServerOps-2095277972 tempest-TestNetworkAdvancedServerOps-2095277972-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/e1f9b5da-f76c-47e2-bc50-eb6487d57306" status: 200 len: 1835 microversion: 2.1 time: 0.622595 Oct 04 21:06:53.231664 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2751/5474] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:06:52 2022] GET /compute/v2.1/servers/e1f9b5da-f76c-47e2-bc50-eb6487d57306 => generated 1835 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:06:53.270297 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ad7e2fbf-15fa-455a-b370-b51a688980d7 tempest-TestNetworkAdvancedServerOps-2095277972 tempest-TestNetworkAdvancedServerOps-2095277972-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": null, "block_migration": true, "disk_over_commit": false}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:06:53.272972 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ad7e2fbf-15fa-455a-b370-b51a688980d7 tempest-TestNetworkAdvancedServerOps-2095277972 tempest-TestNetworkAdvancedServerOps-2095277972-project-admin] [instance: e1f9b5da-f76c-47e2-bc50-eb6487d57306] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:06:53.284974 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ad7e2fbf-15fa-455a-b370-b51a688980d7 tempest-TestNetworkAdvancedServerOps-2095277972 tempest-TestNetworkAdvancedServerOps-2095277972-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:53.285849 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ad7e2fbf-15fa-455a-b370-b51a688980d7 tempest-TestNetworkAdvancedServerOps-2095277972 tempest-TestNetworkAdvancedServerOps-2095277972-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:53.287697 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ad7e2fbf-15fa-455a-b370-b51a688980d7 tempest-TestNetworkAdvancedServerOps-2095277972 tempest-TestNetworkAdvancedServerOps-2095277972-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:53.293329 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ad7e2fbf-15fa-455a-b370-b51a688980d7 tempest-TestNetworkAdvancedServerOps-2095277972 tempest-TestNetworkAdvancedServerOps-2095277972-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:53.293956 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ad7e2fbf-15fa-455a-b370-b51a688980d7 tempest-TestNetworkAdvancedServerOps-2095277972 tempest-TestNetworkAdvancedServerOps-2095277972-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:53.294546 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ad7e2fbf-15fa-455a-b370-b51a688980d7 tempest-TestNetworkAdvancedServerOps-2095277972 tempest-TestNetworkAdvancedServerOps-2095277972-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:53.347154 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-ad7e2fbf-15fa-455a-b370-b51a688980d7 tempest-TestNetworkAdvancedServerOps-2095277972 tempest-TestNetworkAdvancedServerOps-2095277972-project-admin] Lazy-loading 'flavor' on Instance uuid e1f9b5da-f76c-47e2-bc50-eb6487d57306 {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:06:53.400992 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ad7e2fbf-15fa-455a-b370-b51a688980d7 tempest-TestNetworkAdvancedServerOps-2095277972 tempest-TestNetworkAdvancedServerOps-2095277972-project-admin] [instance: e1f9b5da-f76c-47e2-bc50-eb6487d57306] Going to try to live migrate instance to another host {{(pid=128801) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 04 21:06:56.818811 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-8146f78c-c12e-441e-9efe-9cf62270d2be tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:06:56.819503 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-8146f78c-c12e-441e-9efe-9cf62270d2be tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] [instance: 05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:06:56.830467 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8146f78c-c12e-441e-9efe-9cf62270d2be tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:56.831216 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8146f78c-c12e-441e-9efe-9cf62270d2be tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:56.831845 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8146f78c-c12e-441e-9efe-9cf62270d2be tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:56.832792 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8146f78c-c12e-441e-9efe-9cf62270d2be tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:56.833623 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8146f78c-c12e-441e-9efe-9cf62270d2be tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:56.834213 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8146f78c-c12e-441e-9efe-9cf62270d2be tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:56.927586 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.objects.instance [None req-8146f78c-c12e-441e-9efe-9cf62270d2be tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lazy-loading 'flavor' on Instance uuid 05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9 {{(pid=128802) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:06:57.545405 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-8146f78c-c12e-441e-9efe-9cf62270d2be tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] 10.222.0.33 "POST /compute/v2.1/servers/05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9/action" status: 202 len: 0 microversion: 2.20 time: 0.730859 Oct 04 21:06:57.549394 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2752/5475] 10.222.0.33 () {62 vars in 1319 bytes} [Tue Oct 4 21:06:56 2022] POST /compute/v2.1/servers/05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9/action => generated 0 bytes in 736 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:06:57.585023 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-e2aff572-befe-46af-b963-b7f053dbb511 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:57.586633 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-e2aff572-befe-46af-b963-b7f053dbb511 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] [instance: 05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:06:57.613115 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e2aff572-befe-46af-b963-b7f053dbb511 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:57.621231 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e2aff572-befe-46af-b963-b7f053dbb511 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:57.623273 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e2aff572-befe-46af-b963-b7f053dbb511 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:57.628744 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e2aff572-befe-46af-b963-b7f053dbb511 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:57.629676 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e2aff572-befe-46af-b963-b7f053dbb511 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:57.632536 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e2aff572-befe-46af-b963-b7f053dbb511 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:57.782724 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ad7e2fbf-15fa-455a-b370-b51a688980d7 tempest-TestNetworkAdvancedServerOps-2095277972 tempest-TestNetworkAdvancedServerOps-2095277972-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/e1f9b5da-f76c-47e2-bc50-eb6487d57306/action" status: 202 len: 0 microversion: 2.1 time: 4.518255 Oct 04 21:06:57.784714 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2724/5476] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 21:06:53 2022] POST /compute/v2.1/servers/e1f9b5da-f76c-47e2-bc50-eb6487d57306/action => generated 0 bytes in 4522 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:06:57.807608 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-711778d7-32bc-4a8f-ac05-10fcbf04c9cd tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:57.812004 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-711778d7-32bc-4a8f-ac05-10fcbf04c9cd tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] [instance: e1f9b5da-f76c-47e2-bc50-eb6487d57306] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:06:57.849078 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-711778d7-32bc-4a8f-ac05-10fcbf04c9cd tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:57.851042 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-711778d7-32bc-4a8f-ac05-10fcbf04c9cd tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:57.854801 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-711778d7-32bc-4a8f-ac05-10fcbf04c9cd tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:57.855955 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-711778d7-32bc-4a8f-ac05-10fcbf04c9cd tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:57.858147 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-711778d7-32bc-4a8f-ac05-10fcbf04c9cd tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:57.862160 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-711778d7-32bc-4a8f-ac05-10fcbf04c9cd tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:58.032857 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-e2aff572-befe-46af-b963-b7f053dbb511 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:58.048018 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-e2aff572-befe-46af-b963-b7f053dbb511 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:58.049724 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-e2aff572-befe-46af-b963-b7f053dbb511 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:58.051207 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-e2aff572-befe-46af-b963-b7f053dbb511 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] 10.222.0.33 "GET /compute/v2.1/servers/05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9" status: 200 len: 1722 microversion: 2.20 time: 0.498110 Oct 04 21:06:58.072583 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2753/5477] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 21:06:57 2022] GET /compute/v2.1/servers/05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9 => generated 1722 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:06:58.549823 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-711778d7-32bc-4a8f-ac05-10fcbf04c9cd tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5dbe3da6a4af181ef7302fe605fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3aa23aee3c8435c8f1f409019c5fed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:58.566591 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-711778d7-32bc-4a8f-ac05-10fcbf04c9cd tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] 10.222.0.33 "GET /compute/v2.1/servers/e1f9b5da-f76c-47e2-bc50-eb6487d57306" status: 200 len: 1694 microversion: 2.1 time: 0.775501 Oct 04 21:06:58.567496 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2725/5478] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:06:57 2022] GET /compute/v2.1/servers/e1f9b5da-f76c-47e2-bc50-eb6487d57306 => generated 1694 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:06:59.077830 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-bfa7cf74-a7eb-4da2-a959-52b0de5c61ff tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:59.079075 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-bfa7cf74-a7eb-4da2-a959-52b0de5c61ff tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] [instance: 05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:06:59.094077 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bfa7cf74-a7eb-4da2-a959-52b0de5c61ff tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:59.094865 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bfa7cf74-a7eb-4da2-a959-52b0de5c61ff tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:59.095463 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bfa7cf74-a7eb-4da2-a959-52b0de5c61ff tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:59.096961 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bfa7cf74-a7eb-4da2-a959-52b0de5c61ff tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:59.097675 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bfa7cf74-a7eb-4da2-a959-52b0de5c61ff tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:59.098262 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bfa7cf74-a7eb-4da2-a959-52b0de5c61ff tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:59.412583 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-bfa7cf74-a7eb-4da2-a959-52b0de5c61ff tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:59.423242 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-bfa7cf74-a7eb-4da2-a959-52b0de5c61ff tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:59.424682 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-bfa7cf74-a7eb-4da2-a959-52b0de5c61ff tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:06:59.425867 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-bfa7cf74-a7eb-4da2-a959-52b0de5c61ff tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] 10.222.0.33 "GET /compute/v2.1/servers/05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9" status: 200 len: 1722 microversion: 2.20 time: 0.351957 Oct 04 21:06:59.426464 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2754/5479] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 21:06:59 2022] GET /compute/v2.1/servers/05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9 => generated 1722 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:06:59.596993 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-dfbcf27c-9cf3-4e44-b23d-6960f48ac571 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:06:59.597567 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-dfbcf27c-9cf3-4e44-b23d-6960f48ac571 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] [instance: e1f9b5da-f76c-47e2-bc50-eb6487d57306] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:06:59.605812 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dfbcf27c-9cf3-4e44-b23d-6960f48ac571 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:59.617180 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dfbcf27c-9cf3-4e44-b23d-6960f48ac571 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:59.617922 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dfbcf27c-9cf3-4e44-b23d-6960f48ac571 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:06:59.619155 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dfbcf27c-9cf3-4e44-b23d-6960f48ac571 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:06:59.619801 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dfbcf27c-9cf3-4e44-b23d-6960f48ac571 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:06:59.620433 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dfbcf27c-9cf3-4e44-b23d-6960f48ac571 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:00.102228 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-dfbcf27c-9cf3-4e44-b23d-6960f48ac571 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5dbe3da6a4af181ef7302fe605fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3aa23aee3c8435c8f1f409019c5fed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:00.113007 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-dfbcf27c-9cf3-4e44-b23d-6960f48ac571 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] 10.222.0.33 "GET /compute/v2.1/servers/e1f9b5da-f76c-47e2-bc50-eb6487d57306" status: 200 len: 1694 microversion: 2.1 time: 0.520243 Oct 04 21:07:00.116466 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2726/5480] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:06:59 2022] GET /compute/v2.1/servers/e1f9b5da-f76c-47e2-bc50-eb6487d57306 => generated 1694 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:07:00.421636 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-6ae7c808-e959-4f4c-91cd-be15dfc335c6 req-d9815abb-fe36-44ee-a840-8fdef2067462 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1f9b5da-f76c-47e2-bc50-eb6487d57306", "name": "network-vif-unplugged", "status": "completed", "tag": "d58cf329-9762-4338-9c18-cefa8710d34b"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:07:00.434873 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-6ae7c808-e959-4f4c-91cd-be15dfc335c6 req-d9815abb-fe36-44ee-a840-8fdef2067462 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:00.435693 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-6ae7c808-e959-4f4c-91cd-be15dfc335c6 req-d9815abb-fe36-44ee-a840-8fdef2067462 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:00.436989 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-6ae7c808-e959-4f4c-91cd-be15dfc335c6 req-d9815abb-fe36-44ee-a840-8fdef2067462 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:00.452239 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-6ae7c808-e959-4f4c-91cd-be15dfc335c6 req-d9815abb-fe36-44ee-a840-8fdef2067462 service nova] Creating event network-vif-unplugged:d58cf329-9762-4338-9c18-cefa8710d34b for instance e1f9b5da-f76c-47e2-bc50-eb6487d57306 on n-h1-854823-8 Oct 04 21:07:00.452430 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c1b721b2-5dd3-4306-a31b-344e0065e138 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:00.452851 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c1b721b2-5dd3-4306-a31b-344e0065e138 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] [instance: 05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:00.459486 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-6ae7c808-e959-4f4c-91cd-be15dfc335c6 req-d9815abb-fe36-44ee-a840-8fdef2067462 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.052636 Oct 04 21:07:00.460820 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2755/5481] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:07:00 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:07:00.469179 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c1b721b2-5dd3-4306-a31b-344e0065e138 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:00.469684 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c1b721b2-5dd3-4306-a31b-344e0065e138 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:00.470127 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c1b721b2-5dd3-4306-a31b-344e0065e138 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:00.470869 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c1b721b2-5dd3-4306-a31b-344e0065e138 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:00.471330 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c1b721b2-5dd3-4306-a31b-344e0065e138 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:00.471756 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c1b721b2-5dd3-4306-a31b-344e0065e138 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:01.139699 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-6e7f0000-0445-4e2b-a635-930ffe2d615d tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:01.140571 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-6e7f0000-0445-4e2b-a635-930ffe2d615d tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] [instance: e1f9b5da-f76c-47e2-bc50-eb6487d57306] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:01.153615 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6e7f0000-0445-4e2b-a635-930ffe2d615d tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:01.164327 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6e7f0000-0445-4e2b-a635-930ffe2d615d tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:01.166631 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6e7f0000-0445-4e2b-a635-930ffe2d615d tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:01.167893 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6e7f0000-0445-4e2b-a635-930ffe2d615d tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:01.174096 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6e7f0000-0445-4e2b-a635-930ffe2d615d tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:01.174900 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6e7f0000-0445-4e2b-a635-930ffe2d615d tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:01.736733 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c1b721b2-5dd3-4306-a31b-344e0065e138 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:01.755688 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c1b721b2-5dd3-4306-a31b-344e0065e138 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:01.757138 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c1b721b2-5dd3-4306-a31b-344e0065e138 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:01.758333 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c1b721b2-5dd3-4306-a31b-344e0065e138 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] 10.222.0.33 "GET /compute/v2.1/servers/05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9" status: 200 len: 1722 microversion: 2.20 time: 1.309980 Oct 04 21:07:01.774054 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-6e7f0000-0445-4e2b-a635-930ffe2d615d tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5dbe3da6a4af181ef7302fe605fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3aa23aee3c8435c8f1f409019c5fed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:01.775002 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2727/5482] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 21:07:00 2022] GET /compute/v2.1/servers/05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9 => generated 1722 bytes in 1327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:07:01.790586 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-6e7f0000-0445-4e2b-a635-930ffe2d615d tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] 10.222.0.33 "GET /compute/v2.1/servers/e1f9b5da-f76c-47e2-bc50-eb6487d57306" status: 200 len: 1694 microversion: 2.1 time: 0.655679 Oct 04 21:07:01.792536 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2756/5483] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:07:01 2022] GET /compute/v2.1/servers/e1f9b5da-f76c-47e2-bc50-eb6487d57306 => generated 1694 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:07:02.784250 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d1508e17-6f5c-4175-bc8e-536771e52341 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:02.784859 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d1508e17-6f5c-4175-bc8e-536771e52341 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] [instance: 05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:02.800075 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d1508e17-6f5c-4175-bc8e-536771e52341 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:02.800577 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d1508e17-6f5c-4175-bc8e-536771e52341 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:02.801016 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d1508e17-6f5c-4175-bc8e-536771e52341 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:02.801734 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d1508e17-6f5c-4175-bc8e-536771e52341 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:02.802190 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d1508e17-6f5c-4175-bc8e-536771e52341 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:02.802644 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d1508e17-6f5c-4175-bc8e-536771e52341 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:02.817022 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-5c716edc-f523-4285-9268-9710b4690a40 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:02.817614 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-5c716edc-f523-4285-9268-9710b4690a40 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] [instance: e1f9b5da-f76c-47e2-bc50-eb6487d57306] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:02.833192 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5c716edc-f523-4285-9268-9710b4690a40 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:02.833728 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5c716edc-f523-4285-9268-9710b4690a40 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:02.834166 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5c716edc-f523-4285-9268-9710b4690a40 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:02.836996 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5c716edc-f523-4285-9268-9710b4690a40 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:02.837545 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5c716edc-f523-4285-9268-9710b4690a40 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:02.837981 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5c716edc-f523-4285-9268-9710b4690a40 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:03.203697 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d1508e17-6f5c-4175-bc8e-536771e52341 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:03.213708 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d1508e17-6f5c-4175-bc8e-536771e52341 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:03.230030 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d1508e17-6f5c-4175-bc8e-536771e52341 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:03.232177 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d1508e17-6f5c-4175-bc8e-536771e52341 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] 10.222.0.33 "GET /compute/v2.1/servers/05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9" status: 200 len: 1722 microversion: 2.20 time: 0.451763 Oct 04 21:07:03.234185 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2728/5484] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 21:07:02 2022] GET /compute/v2.1/servers/05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9 => generated 1722 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:07:03.255098 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-da037e00-b750-4a0a-b36e-34985e1ba1a5 req-0482e2e7-a294-429f-ac04-49c4d3d70295 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1f9b5da-f76c-47e2-bc50-eb6487d57306", "tag": "d58cf329-9762-4338-9c18-cefa8710d34b"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:07:03.300442 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-5c716edc-f523-4285-9268-9710b4690a40 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5dbe3da6a4af181ef7302fe605fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3aa23aee3c8435c8f1f409019c5fed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:03.301535 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-da037e00-b750-4a0a-b36e-34985e1ba1a5 req-0482e2e7-a294-429f-ac04-49c4d3d70295 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:03.302114 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-da037e00-b750-4a0a-b36e-34985e1ba1a5 req-0482e2e7-a294-429f-ac04-49c4d3d70295 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:03.302609 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-da037e00-b750-4a0a-b36e-34985e1ba1a5 req-0482e2e7-a294-429f-ac04-49c4d3d70295 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:03.312529 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-5c716edc-f523-4285-9268-9710b4690a40 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] 10.222.0.33 "GET /compute/v2.1/servers/e1f9b5da-f76c-47e2-bc50-eb6487d57306" status: 200 len: 1694 microversion: 2.1 time: 0.499764 Oct 04 21:07:03.318029 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2757/5485] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:07:02 2022] GET /compute/v2.1/servers/e1f9b5da-f76c-47e2-bc50-eb6487d57306 => generated 1694 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:07:03.329789 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-da037e00-b750-4a0a-b36e-34985e1ba1a5 req-0482e2e7-a294-429f-ac04-49c4d3d70295 service nova] Creating event network-changed:d58cf329-9762-4338-9c18-cefa8710d34b for instance e1f9b5da-f76c-47e2-bc50-eb6487d57306 on n-h1-854823-8 Oct 04 21:07:03.335607 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-da037e00-b750-4a0a-b36e-34985e1ba1a5 req-0482e2e7-a294-429f-ac04-49c4d3d70295 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099956 Oct 04 21:07:03.337284 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2729/5486] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:07:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:07:04.263867 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-48a2ed51-a0f5-481c-b0ea-bb76ce5f9b2f tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:04.264537 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-48a2ed51-a0f5-481c-b0ea-bb76ce5f9b2f tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] [instance: 05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:04.281973 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-48a2ed51-a0f5-481c-b0ea-bb76ce5f9b2f tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:04.282529 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-48a2ed51-a0f5-481c-b0ea-bb76ce5f9b2f tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:04.283023 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-48a2ed51-a0f5-481c-b0ea-bb76ce5f9b2f tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:04.283744 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-48a2ed51-a0f5-481c-b0ea-bb76ce5f9b2f tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:04.284384 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-48a2ed51-a0f5-481c-b0ea-bb76ce5f9b2f tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:04.284833 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-48a2ed51-a0f5-481c-b0ea-bb76ce5f9b2f tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:04.350871 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7cbe2ed2-3191-42bd-8055-7892e7b3528f tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:04.354567 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-7cbe2ed2-3191-42bd-8055-7892e7b3528f tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] [instance: e1f9b5da-f76c-47e2-bc50-eb6487d57306] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:04.370316 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7cbe2ed2-3191-42bd-8055-7892e7b3528f tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:04.372366 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7cbe2ed2-3191-42bd-8055-7892e7b3528f tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:04.373082 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7cbe2ed2-3191-42bd-8055-7892e7b3528f tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:04.374895 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7cbe2ed2-3191-42bd-8055-7892e7b3528f tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:04.375909 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7cbe2ed2-3191-42bd-8055-7892e7b3528f tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:04.376856 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7cbe2ed2-3191-42bd-8055-7892e7b3528f tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:04.953096 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-48a2ed51-a0f5-481c-b0ea-bb76ce5f9b2f tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:04.983645 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-48a2ed51-a0f5-481c-b0ea-bb76ce5f9b2f tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:04.985802 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-48a2ed51-a0f5-481c-b0ea-bb76ce5f9b2f tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:04.990649 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-48a2ed51-a0f5-481c-b0ea-bb76ce5f9b2f tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] 10.222.0.33 "GET /compute/v2.1/servers/05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9" status: 200 len: 1722 microversion: 2.20 time: 0.731582 Oct 04 21:07:04.996818 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2758/5487] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 21:07:04 2022] GET /compute/v2.1/servers/05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9 => generated 1722 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:07:05.042206 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-7cbe2ed2-3191-42bd-8055-7892e7b3528f tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5dbe3da6a4af181ef7302fe605fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3aa23aee3c8435c8f1f409019c5fed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:05.051377 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-7cbe2ed2-3191-42bd-8055-7892e7b3528f tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] 10.222.0.33 "GET /compute/v2.1/servers/e1f9b5da-f76c-47e2-bc50-eb6487d57306" status: 200 len: 1694 microversion: 2.1 time: 0.707587 Oct 04 21:07:05.055245 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2730/5488] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:07:04 2022] GET /compute/v2.1/servers/e1f9b5da-f76c-47e2-bc50-eb6487d57306 => generated 1694 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:07:06.029121 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-e7053884-d41a-4e6a-91ff-fc59b23739b1 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:06.032980 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-e7053884-d41a-4e6a-91ff-fc59b23739b1 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] [instance: 05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:06.062883 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e7053884-d41a-4e6a-91ff-fc59b23739b1 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:06.063599 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e7053884-d41a-4e6a-91ff-fc59b23739b1 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:06.064167 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e7053884-d41a-4e6a-91ff-fc59b23739b1 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:06.065052 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e7053884-d41a-4e6a-91ff-fc59b23739b1 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:06.065630 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e7053884-d41a-4e6a-91ff-fc59b23739b1 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:06.066183 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e7053884-d41a-4e6a-91ff-fc59b23739b1 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:06.079098 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-dbabbd79-dd52-4c5a-a38d-1093210f1784 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:06.080332 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-dbabbd79-dd52-4c5a-a38d-1093210f1784 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] [instance: e1f9b5da-f76c-47e2-bc50-eb6487d57306] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:06.091394 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dbabbd79-dd52-4c5a-a38d-1093210f1784 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:06.099559 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dbabbd79-dd52-4c5a-a38d-1093210f1784 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:06.100434 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dbabbd79-dd52-4c5a-a38d-1093210f1784 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:06.101405 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dbabbd79-dd52-4c5a-a38d-1093210f1784 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:06.102092 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dbabbd79-dd52-4c5a-a38d-1093210f1784 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:06.103374 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dbabbd79-dd52-4c5a-a38d-1093210f1784 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:06.421934 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-e7053884-d41a-4e6a-91ff-fc59b23739b1 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:06.439154 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-e7053884-d41a-4e6a-91ff-fc59b23739b1 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:06.450884 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-e7053884-d41a-4e6a-91ff-fc59b23739b1 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:06.452808 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-e7053884-d41a-4e6a-91ff-fc59b23739b1 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] 10.222.0.33 "GET /compute/v2.1/servers/05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9" status: 200 len: 1722 microversion: 2.20 time: 0.434384 Oct 04 21:07:06.454534 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2759/5489] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 21:07:06 2022] GET /compute/v2.1/servers/05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9 => generated 1722 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:07:06.503500 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-dbabbd79-dd52-4c5a-a38d-1093210f1784 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5dbe3da6a4af181ef7302fe605fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3aa23aee3c8435c8f1f409019c5fed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:06.515011 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-dbabbd79-dd52-4c5a-a38d-1093210f1784 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] 10.222.0.33 "GET /compute/v2.1/servers/e1f9b5da-f76c-47e2-bc50-eb6487d57306" status: 200 len: 1694 microversion: 2.1 time: 0.439212 Oct 04 21:07:06.516506 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2731/5490] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:07:06 2022] GET /compute/v2.1/servers/e1f9b5da-f76c-47e2-bc50-eb6487d57306 => generated 1694 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:07:07.484984 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-85ed764e-b2ac-4a08-af81-ff8ddbc468b1 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:07.486214 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-85ed764e-b2ac-4a08-af81-ff8ddbc468b1 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] [instance: 05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:07.504248 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-85ed764e-b2ac-4a08-af81-ff8ddbc468b1 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:07.504756 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-85ed764e-b2ac-4a08-af81-ff8ddbc468b1 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:07.505195 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-85ed764e-b2ac-4a08-af81-ff8ddbc468b1 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:07.505922 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-85ed764e-b2ac-4a08-af81-ff8ddbc468b1 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:07.506492 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-85ed764e-b2ac-4a08-af81-ff8ddbc468b1 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:07.506849 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-85ed764e-b2ac-4a08-af81-ff8ddbc468b1 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:07.540691 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-eab97abb-b85c-4e30-90a2-4c07d14469f5 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:07.541913 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-eab97abb-b85c-4e30-90a2-4c07d14469f5 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] [instance: e1f9b5da-f76c-47e2-bc50-eb6487d57306] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:07.548931 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-eab97abb-b85c-4e30-90a2-4c07d14469f5 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:07.567477 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-eab97abb-b85c-4e30-90a2-4c07d14469f5 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:07.567940 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-eab97abb-b85c-4e30-90a2-4c07d14469f5 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:07.568698 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-eab97abb-b85c-4e30-90a2-4c07d14469f5 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:07.569167 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-eab97abb-b85c-4e30-90a2-4c07d14469f5 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:07.569596 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-eab97abb-b85c-4e30-90a2-4c07d14469f5 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:08.156979 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-85ed764e-b2ac-4a08-af81-ff8ddbc468b1 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:08.171114 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-85ed764e-b2ac-4a08-af81-ff8ddbc468b1 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:08.175112 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-85ed764e-b2ac-4a08-af81-ff8ddbc468b1 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:08.185702 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-85ed764e-b2ac-4a08-af81-ff8ddbc468b1 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] 10.222.0.33 "GET /compute/v2.1/servers/05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9" status: 200 len: 1722 microversion: 2.20 time: 0.704440 Oct 04 21:07:08.186429 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2760/5491] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 21:07:07 2022] GET /compute/v2.1/servers/05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9 => generated 1722 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:07:08.239870 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-eab97abb-b85c-4e30-90a2-4c07d14469f5 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5dbe3da6a4af181ef7302fe605fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3aa23aee3c8435c8f1f409019c5fed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:08.248579 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-eab97abb-b85c-4e30-90a2-4c07d14469f5 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] 10.222.0.33 "GET /compute/v2.1/servers/e1f9b5da-f76c-47e2-bc50-eb6487d57306" status: 200 len: 1694 microversion: 2.1 time: 0.712929 Oct 04 21:07:08.255335 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2732/5492] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:07:07 2022] GET /compute/v2.1/servers/e1f9b5da-f76c-47e2-bc50-eb6487d57306 => generated 1694 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:07:09.213621 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-8823f153-6acd-42c3-97e0-ba9da428aaa5 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:09.215831 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-8823f153-6acd-42c3-97e0-ba9da428aaa5 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] [instance: 05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:09.247050 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8823f153-6acd-42c3-97e0-ba9da428aaa5 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:09.248015 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8823f153-6acd-42c3-97e0-ba9da428aaa5 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:09.250163 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8823f153-6acd-42c3-97e0-ba9da428aaa5 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:09.251337 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8823f153-6acd-42c3-97e0-ba9da428aaa5 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:09.254750 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8823f153-6acd-42c3-97e0-ba9da428aaa5 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:09.256736 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8823f153-6acd-42c3-97e0-ba9da428aaa5 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:09.279831 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a6655744-00c4-44a7-b7ff-54a0144a18a4 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:09.281210 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a6655744-00c4-44a7-b7ff-54a0144a18a4 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] [instance: e1f9b5da-f76c-47e2-bc50-eb6487d57306] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:09.308444 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a6655744-00c4-44a7-b7ff-54a0144a18a4 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:09.310820 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a6655744-00c4-44a7-b7ff-54a0144a18a4 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:09.313673 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a6655744-00c4-44a7-b7ff-54a0144a18a4 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:09.314691 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a6655744-00c4-44a7-b7ff-54a0144a18a4 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:09.316381 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a6655744-00c4-44a7-b7ff-54a0144a18a4 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:09.326375 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a6655744-00c4-44a7-b7ff-54a0144a18a4 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:10.066302 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-a6655744-00c4-44a7-b7ff-54a0144a18a4 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5dbe3da6a4af181ef7302fe605fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3aa23aee3c8435c8f1f409019c5fed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:10.082203 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a6655744-00c4-44a7-b7ff-54a0144a18a4 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] 10.222.0.33 "GET /compute/v2.1/servers/e1f9b5da-f76c-47e2-bc50-eb6487d57306" status: 200 len: 1694 microversion: 2.1 time: 0.802999 Oct 04 21:07:10.090977 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2733/5493] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:07:09 2022] GET /compute/v2.1/servers/e1f9b5da-f76c-47e2-bc50-eb6487d57306 => generated 1694 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:07:10.162995 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-8823f153-6acd-42c3-97e0-ba9da428aaa5 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:10.181159 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-8823f153-6acd-42c3-97e0-ba9da428aaa5 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:10.203141 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-8823f153-6acd-42c3-97e0-ba9da428aaa5 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:10.204814 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-8823f153-6acd-42c3-97e0-ba9da428aaa5 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] 10.222.0.33 "GET /compute/v2.1/servers/05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9" status: 200 len: 1743 microversion: 2.20 time: 0.995491 Oct 04 21:07:10.219706 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2761/5494] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 21:07:09 2022] GET /compute/v2.1/servers/05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9 => generated 1743 bytes in 1011 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:07:11.132233 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1ff8fc68-fb15-4bda-ab6e-d1067db60f0a tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:11.133074 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-1ff8fc68-fb15-4bda-ab6e-d1067db60f0a tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] [instance: e1f9b5da-f76c-47e2-bc50-eb6487d57306] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:11.157571 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1ff8fc68-fb15-4bda-ab6e-d1067db60f0a tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:11.162194 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1ff8fc68-fb15-4bda-ab6e-d1067db60f0a tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:11.162783 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1ff8fc68-fb15-4bda-ab6e-d1067db60f0a tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:11.174071 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1ff8fc68-fb15-4bda-ab6e-d1067db60f0a tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:11.174740 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1ff8fc68-fb15-4bda-ab6e-d1067db60f0a tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:11.175192 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1ff8fc68-fb15-4bda-ab6e-d1067db60f0a tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:11.237146 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-2ade2bc3-4f50-44f3-ad00-e3160e27e5aa tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:11.238008 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-2ade2bc3-4f50-44f3-ad00-e3160e27e5aa tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] [instance: 05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:11.261122 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2ade2bc3-4f50-44f3-ad00-e3160e27e5aa tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:11.267214 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2ade2bc3-4f50-44f3-ad00-e3160e27e5aa tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:11.272548 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2ade2bc3-4f50-44f3-ad00-e3160e27e5aa tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:11.273417 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2ade2bc3-4f50-44f3-ad00-e3160e27e5aa tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:11.282917 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2ade2bc3-4f50-44f3-ad00-e3160e27e5aa tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:11.287147 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2ade2bc3-4f50-44f3-ad00-e3160e27e5aa tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:12.807223 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-2ade2bc3-4f50-44f3-ad00-e3160e27e5aa tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:12.831028 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-2ade2bc3-4f50-44f3-ad00-e3160e27e5aa tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:12.846522 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-2ade2bc3-4f50-44f3-ad00-e3160e27e5aa tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:12.849813 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-2ade2bc3-4f50-44f3-ad00-e3160e27e5aa tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] 10.222.0.33 "GET /compute/v2.1/servers/05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9" status: 200 len: 1738 microversion: 2.20 time: 1.617886 Oct 04 21:07:12.855142 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2762/5495] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 21:07:11 2022] GET /compute/v2.1/servers/05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9 => generated 1738 bytes in 1624 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:07:12.886189 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-1ff8fc68-fb15-4bda-ab6e-d1067db60f0a tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5dbe3da6a4af181ef7302fe605fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3aa23aee3c8435c8f1f409019c5fed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:12.912427 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-1ff8fc68-fb15-4bda-ab6e-d1067db60f0a tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] 10.222.0.33 "GET /compute/v2.1/servers/e1f9b5da-f76c-47e2-bc50-eb6487d57306" status: 200 len: 1694 microversion: 2.1 time: 1.795253 Oct 04 21:07:12.915607 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2734/5496] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:07:11 2022] GET /compute/v2.1/servers/e1f9b5da-f76c-47e2-bc50-eb6487d57306 => generated 1694 bytes in 1798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:07:13.449401 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-98a268ba-0713-4179-85ab-c50832292e06 req-c7e2d78c-c80b-4b96-8f71-d87bdddfd295 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9", "name": "network-vif-plugged", "status": "completed", "tag": "2f9889d1-cb04-4ccc-8abc-1f54eb9f493f"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:07:13.494367 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-98a268ba-0713-4179-85ab-c50832292e06 req-c7e2d78c-c80b-4b96-8f71-d87bdddfd295 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:13.500900 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-98a268ba-0713-4179-85ab-c50832292e06 req-c7e2d78c-c80b-4b96-8f71-d87bdddfd295 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:13.501629 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-98a268ba-0713-4179-85ab-c50832292e06 req-c7e2d78c-c80b-4b96-8f71-d87bdddfd295 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:13.550448 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-98a268ba-0713-4179-85ab-c50832292e06 req-c7e2d78c-c80b-4b96-8f71-d87bdddfd295 service nova] Creating event network-vif-plugged:2f9889d1-cb04-4ccc-8abc-1f54eb9f493f for instance 05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9 on n-h2-854823-8 Oct 04 21:07:13.578260 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-98a268ba-0713-4179-85ab-c50832292e06 req-c7e2d78c-c80b-4b96-8f71-d87bdddfd295 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.139229 Oct 04 21:07:13.592841 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2763/5497] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:07:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:07:13.894542 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-22ee121d-ad59-4c56-8180-c5d184300636 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:13.895178 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-22ee121d-ad59-4c56-8180-c5d184300636 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] [instance: 05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:13.905732 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-22ee121d-ad59-4c56-8180-c5d184300636 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:13.906741 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-22ee121d-ad59-4c56-8180-c5d184300636 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:13.907418 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-22ee121d-ad59-4c56-8180-c5d184300636 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:13.908474 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-22ee121d-ad59-4c56-8180-c5d184300636 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:13.909257 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-22ee121d-ad59-4c56-8180-c5d184300636 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:13.910878 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-22ee121d-ad59-4c56-8180-c5d184300636 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:13.958539 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-b399e79c-6110-4acb-855a-2d3645a7fb96 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:13.964707 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-b399e79c-6110-4acb-855a-2d3645a7fb96 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] [instance: e1f9b5da-f76c-47e2-bc50-eb6487d57306] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:14.028001 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b399e79c-6110-4acb-855a-2d3645a7fb96 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:14.031205 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b399e79c-6110-4acb-855a-2d3645a7fb96 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:14.042434 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b399e79c-6110-4acb-855a-2d3645a7fb96 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:14.045716 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b399e79c-6110-4acb-855a-2d3645a7fb96 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:14.046668 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b399e79c-6110-4acb-855a-2d3645a7fb96 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:14.047379 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b399e79c-6110-4acb-855a-2d3645a7fb96 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:14.640873 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-22ee121d-ad59-4c56-8180-c5d184300636 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:14.650796 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-22ee121d-ad59-4c56-8180-c5d184300636 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:14.663007 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-22ee121d-ad59-4c56-8180-c5d184300636 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:14.665342 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-22ee121d-ad59-4c56-8180-c5d184300636 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] 10.222.0.33 "GET /compute/v2.1/servers/05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9" status: 200 len: 1738 microversion: 2.20 time: 0.778577 Oct 04 21:07:14.672894 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2735/5498] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 21:07:13 2022] GET /compute/v2.1/servers/05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9 => generated 1738 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:07:14.823466 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-b399e79c-6110-4acb-855a-2d3645a7fb96 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5dbe3da6a4af181ef7302fe605fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3aa23aee3c8435c8f1f409019c5fed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:14.836893 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-b399e79c-6110-4acb-855a-2d3645a7fb96 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] 10.222.0.33 "GET /compute/v2.1/servers/e1f9b5da-f76c-47e2-bc50-eb6487d57306" status: 200 len: 1684 microversion: 2.1 time: 0.888151 Oct 04 21:07:14.852433 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2764/5499] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:07:13 2022] GET /compute/v2.1/servers/e1f9b5da-f76c-47e2-bc50-eb6487d57306 => generated 1684 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:07:14.867328 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-61cb5458-3c11-4f6b-b12d-cea9c669f86a tempest-TestNetworkAdvancedServerOps-2095277972 tempest-TestNetworkAdvancedServerOps-2095277972-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:14.868323 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-61cb5458-3c11-4f6b-b12d-cea9c669f86a tempest-TestNetworkAdvancedServerOps-2095277972 tempest-TestNetworkAdvancedServerOps-2095277972-project-admin] [instance: e1f9b5da-f76c-47e2-bc50-eb6487d57306] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:14.880600 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-61cb5458-3c11-4f6b-b12d-cea9c669f86a tempest-TestNetworkAdvancedServerOps-2095277972 tempest-TestNetworkAdvancedServerOps-2095277972-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:14.881398 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-61cb5458-3c11-4f6b-b12d-cea9c669f86a tempest-TestNetworkAdvancedServerOps-2095277972 tempest-TestNetworkAdvancedServerOps-2095277972-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:14.882028 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-61cb5458-3c11-4f6b-b12d-cea9c669f86a tempest-TestNetworkAdvancedServerOps-2095277972 tempest-TestNetworkAdvancedServerOps-2095277972-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:14.883127 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-61cb5458-3c11-4f6b-b12d-cea9c669f86a tempest-TestNetworkAdvancedServerOps-2095277972 tempest-TestNetworkAdvancedServerOps-2095277972-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:14.885081 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-61cb5458-3c11-4f6b-b12d-cea9c669f86a tempest-TestNetworkAdvancedServerOps-2095277972 tempest-TestNetworkAdvancedServerOps-2095277972-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:14.885790 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-61cb5458-3c11-4f6b-b12d-cea9c669f86a tempest-TestNetworkAdvancedServerOps-2095277972 tempest-TestNetworkAdvancedServerOps-2095277972-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:15.381787 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-61cb5458-3c11-4f6b-b12d-cea9c669f86a tempest-TestNetworkAdvancedServerOps-2095277972 tempest-TestNetworkAdvancedServerOps-2095277972-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/e1f9b5da-f76c-47e2-bc50-eb6487d57306" status: 200 len: 1835 microversion: 2.1 time: 0.515749 Oct 04 21:07:15.384214 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2736/5500] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:07:14 2022] GET /compute/v2.1/servers/e1f9b5da-f76c-47e2-bc50-eb6487d57306 => generated 1835 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:07:15.420614 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-ec9f5df1-05c6-487e-b2b2-e1fa673157f3 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:15.423595 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-ec9f5df1-05c6-487e-b2b2-e1fa673157f3 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] [instance: e1f9b5da-f76c-47e2-bc50-eb6487d57306] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:15.441868 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ec9f5df1-05c6-487e-b2b2-e1fa673157f3 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:15.447435 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ec9f5df1-05c6-487e-b2b2-e1fa673157f3 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:15.467496 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ec9f5df1-05c6-487e-b2b2-e1fa673157f3 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:15.468701 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ec9f5df1-05c6-487e-b2b2-e1fa673157f3 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:15.469868 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ec9f5df1-05c6-487e-b2b2-e1fa673157f3 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:15.471186 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ec9f5df1-05c6-487e-b2b2-e1fa673157f3 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:15.706950 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a926b650-4b29-44d0-9cdc-5933770f5409 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:15.708247 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a926b650-4b29-44d0-9cdc-5933770f5409 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] [instance: 05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:15.717836 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a926b650-4b29-44d0-9cdc-5933770f5409 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:15.723473 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a926b650-4b29-44d0-9cdc-5933770f5409 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:15.724393 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a926b650-4b29-44d0-9cdc-5933770f5409 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:15.725390 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a926b650-4b29-44d0-9cdc-5933770f5409 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:15.726080 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a926b650-4b29-44d0-9cdc-5933770f5409 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:15.726779 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a926b650-4b29-44d0-9cdc-5933770f5409 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:16.209398 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-ec9f5df1-05c6-487e-b2b2-e1fa673157f3 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5dbe3da6a4af181ef7302fe605fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3aa23aee3c8435c8f1f409019c5fed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:16.225074 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-ec9f5df1-05c6-487e-b2b2-e1fa673157f3 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] 10.222.0.33 "GET /compute/v2.1/servers/e1f9b5da-f76c-47e2-bc50-eb6487d57306" status: 200 len: 1684 microversion: 2.1 time: 0.812331 Oct 04 21:07:16.260423 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2765/5501] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:07:15 2022] GET /compute/v2.1/servers/e1f9b5da-f76c-47e2-bc50-eb6487d57306 => generated 1684 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:07:16.463051 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-85fd81f1-6191-4510-846e-aa1da7c9fcf9 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:07:16.466411 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-85fd81f1-6191-4510-846e-aa1da7c9fcf9 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] [instance: e1f9b5da-f76c-47e2-bc50-eb6487d57306] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:16.488599 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-85fd81f1-6191-4510-846e-aa1da7c9fcf9 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:16.496760 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-85fd81f1-6191-4510-846e-aa1da7c9fcf9 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:16.506290 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-85fd81f1-6191-4510-846e-aa1da7c9fcf9 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:16.515730 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-85fd81f1-6191-4510-846e-aa1da7c9fcf9 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:16.519072 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-a926b650-4b29-44d0-9cdc-5933770f5409 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:16.522538 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:07:16.525749 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-85fd81f1-6191-4510-846e-aa1da7c9fcf9 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:16.526935 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-85fd81f1-6191-4510-846e-aa1da7c9fcf9 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:16.532225 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-a926b650-4b29-44d0-9cdc-5933770f5409 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:16.533608 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-a926b650-4b29-44d0-9cdc-5933770f5409 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:16.552521 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a926b650-4b29-44d0-9cdc-5933770f5409 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] 10.222.0.33 "GET /compute/v2.1/servers/05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9" status: 200 len: 1738 microversion: 2.20 time: 0.849333 Oct 04 21:07:16.557099 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2737/5502] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 21:07:15 2022] GET /compute/v2.1/servers/05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9 => generated 1738 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:07:16.610235 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:07:16.707158 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-85fd81f1-6191-4510-846e-aa1da7c9fcf9 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] 10.222.0.33 "POST /compute/v2.1/servers/e1f9b5da-f76c-47e2-bc50-eb6487d57306/action" status: 200 len: 38625 microversion: 2.1 time: 0.248486 Oct 04 21:07:16.708260 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2766/5503] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 21:07:16 2022] POST /compute/v2.1/servers/e1f9b5da-f76c-47e2-bc50-eb6487d57306/action => generated 38625 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 04 21:07:17.584514 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-70949562-badd-4d76-920f-b51e32c2c7e9 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:17.585595 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-70949562-badd-4d76-920f-b51e32c2c7e9 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] [instance: 05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:17.634882 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-70949562-badd-4d76-920f-b51e32c2c7e9 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:17.640153 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-70949562-badd-4d76-920f-b51e32c2c7e9 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:17.644936 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-70949562-badd-4d76-920f-b51e32c2c7e9 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:17.652724 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-70949562-badd-4d76-920f-b51e32c2c7e9 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:17.656911 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-70949562-badd-4d76-920f-b51e32c2c7e9 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:17.659631 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-70949562-badd-4d76-920f-b51e32c2c7e9 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:18.524404 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-70949562-badd-4d76-920f-b51e32c2c7e9 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:18.552461 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-70949562-badd-4d76-920f-b51e32c2c7e9 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:18.556935 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-70949562-badd-4d76-920f-b51e32c2c7e9 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:18.577024 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-70949562-badd-4d76-920f-b51e32c2c7e9 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] 10.222.0.33 "GET /compute/v2.1/servers/05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9" status: 200 len: 1738 microversion: 2.20 time: 0.995311 Oct 04 21:07:18.580421 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2738/5504] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 21:07:17 2022] GET /compute/v2.1/servers/05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9 => generated 1738 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:07:19.608346 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-6c0bc0dc-41c3-4f0f-8311-bd73d285e641 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:19.611035 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-6c0bc0dc-41c3-4f0f-8311-bd73d285e641 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] [instance: 05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:19.657456 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6c0bc0dc-41c3-4f0f-8311-bd73d285e641 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:19.663252 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6c0bc0dc-41c3-4f0f-8311-bd73d285e641 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:19.668649 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6c0bc0dc-41c3-4f0f-8311-bd73d285e641 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:19.671303 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6c0bc0dc-41c3-4f0f-8311-bd73d285e641 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:19.685727 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6c0bc0dc-41c3-4f0f-8311-bd73d285e641 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:19.689201 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6c0bc0dc-41c3-4f0f-8311-bd73d285e641 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:20.536323 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-6c0bc0dc-41c3-4f0f-8311-bd73d285e641 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:20.550130 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-6c0bc0dc-41c3-4f0f-8311-bd73d285e641 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:20.554572 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-6c0bc0dc-41c3-4f0f-8311-bd73d285e641 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:20.560592 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-6c0bc0dc-41c3-4f0f-8311-bd73d285e641 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] 10.222.0.33 "GET /compute/v2.1/servers/05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9" status: 200 len: 1738 microversion: 2.20 time: 0.956794 Oct 04 21:07:20.587576 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2767/5505] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 21:07:19 2022] GET /compute/v2.1/servers/05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9 => generated 1738 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:07:21.315764 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-fd1e2891-5715-4092-8fc3-92ea0d6db1bf tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:21.316876 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-fd1e2891-5715-4092-8fc3-92ea0d6db1bf tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] [instance: e1f9b5da-f76c-47e2-bc50-eb6487d57306] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:21.320423 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-79205cb7-872b-439b-96ea-07bfe9a591e9 req-e42e18b4-2403-4f76-a12f-34cf42707d8a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1f9b5da-f76c-47e2-bc50-eb6487d57306", "tag": "d58cf329-9762-4338-9c18-cefa8710d34b"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:07:21.342726 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fd1e2891-5715-4092-8fc3-92ea0d6db1bf tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:21.343070 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fd1e2891-5715-4092-8fc3-92ea0d6db1bf tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:21.343514 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fd1e2891-5715-4092-8fc3-92ea0d6db1bf tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:21.346838 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fd1e2891-5715-4092-8fc3-92ea0d6db1bf tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:21.352529 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fd1e2891-5715-4092-8fc3-92ea0d6db1bf tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:21.353207 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fd1e2891-5715-4092-8fc3-92ea0d6db1bf tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:21.385148 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-79205cb7-872b-439b-96ea-07bfe9a591e9 req-e42e18b4-2403-4f76-a12f-34cf42707d8a service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:21.386489 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-79205cb7-872b-439b-96ea-07bfe9a591e9 req-e42e18b4-2403-4f76-a12f-34cf42707d8a service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:21.387293 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-79205cb7-872b-439b-96ea-07bfe9a591e9 req-e42e18b4-2403-4f76-a12f-34cf42707d8a service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:21.403624 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-79205cb7-872b-439b-96ea-07bfe9a591e9 req-e42e18b4-2403-4f76-a12f-34cf42707d8a service nova] Creating event network-changed:d58cf329-9762-4338-9c18-cefa8710d34b for instance e1f9b5da-f76c-47e2-bc50-eb6487d57306 on n-h2-854823-8 Oct 04 21:07:21.409793 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-79205cb7-872b-439b-96ea-07bfe9a591e9 req-e42e18b4-2403-4f76-a12f-34cf42707d8a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094942 Oct 04 21:07:21.410833 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2768/5506] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:07:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:07:21.470793 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-fd1e2891-5715-4092-8fc3-92ea0d6db1bf tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] [instance: e1f9b5da-f76c-47e2-bc50-eb6487d57306] Going to try to terminate instance {{(pid=128801) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:07:21.615666 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-79242cda-a11e-45f5-bba5-04dd265e7c02 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:21.618197 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-79242cda-a11e-45f5-bba5-04dd265e7c02 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] [instance: 05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:21.650088 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-79242cda-a11e-45f5-bba5-04dd265e7c02 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:21.655956 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-79242cda-a11e-45f5-bba5-04dd265e7c02 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:21.656633 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-79242cda-a11e-45f5-bba5-04dd265e7c02 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:21.657458 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-79242cda-a11e-45f5-bba5-04dd265e7c02 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:21.657976 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-79242cda-a11e-45f5-bba5-04dd265e7c02 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:21.658528 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-79242cda-a11e-45f5-bba5-04dd265e7c02 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:21.717542 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=40 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:07:21.753739 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-fd1e2891-5715-4092-8fc3-92ea0d6db1bf tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] 10.222.0.33 "DELETE /compute/v2.1/servers/e1f9b5da-f76c-47e2-bc50-eb6487d57306" status: 204 len: 0 microversion: 2.1 time: 0.443055 Oct 04 21:07:21.754378 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2739/5507] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 21:07:21 2022] DELETE /compute/v2.1/servers/e1f9b5da-f76c-47e2-bc50-eb6487d57306 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:07:21.781239 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-fe69bbb4-7ea0-47cb-9f3e-ab3069f4c210 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:21.781978 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-fe69bbb4-7ea0-47cb-9f3e-ab3069f4c210 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] [instance: e1f9b5da-f76c-47e2-bc50-eb6487d57306] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:21.802500 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fe69bbb4-7ea0-47cb-9f3e-ab3069f4c210 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:21.803286 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fe69bbb4-7ea0-47cb-9f3e-ab3069f4c210 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:21.816703 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fe69bbb4-7ea0-47cb-9f3e-ab3069f4c210 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:21.817891 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fe69bbb4-7ea0-47cb-9f3e-ab3069f4c210 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:21.819596 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fe69bbb4-7ea0-47cb-9f3e-ab3069f4c210 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:21.820217 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fe69bbb4-7ea0-47cb-9f3e-ab3069f4c210 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:23.912940 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-79242cda-a11e-45f5-bba5-04dd265e7c02 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:23.933785 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-79242cda-a11e-45f5-bba5-04dd265e7c02 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:23.943959 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-79242cda-a11e-45f5-bba5-04dd265e7c02 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:23.954757 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-79242cda-a11e-45f5-bba5-04dd265e7c02 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] 10.222.0.33 "GET /compute/v2.1/servers/05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9" status: 200 len: 1738 microversion: 2.20 time: 2.362279 Oct 04 21:07:23.965518 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2769/5508] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 21:07:21 2022] GET /compute/v2.1/servers/05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9 => generated 1738 bytes in 2374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:07:24.049982 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-fe69bbb4-7ea0-47cb-9f3e-ab3069f4c210 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5dbe3da6a4af181ef7302fe605fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3aa23aee3c8435c8f1f409019c5fed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:24.139418 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-fe69bbb4-7ea0-47cb-9f3e-ab3069f4c210 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] 10.222.0.33 "GET /compute/v2.1/servers/e1f9b5da-f76c-47e2-bc50-eb6487d57306" status: 200 len: 1690 microversion: 2.1 time: 2.364133 Oct 04 21:07:24.143369 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2740/5509] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:07:21 2022] GET /compute/v2.1/servers/e1f9b5da-f76c-47e2-bc50-eb6487d57306 => generated 1690 bytes in 2376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:07:24.416046 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-d8c3664f-fa10-4794-b090-f8b68c86fd15 req-3118cf11-6dcf-4610-93ae-f03ce8d2d10c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1f9b5da-f76c-47e2-bc50-eb6487d57306", "name": "network-vif-deleted", "tag": "d58cf329-9762-4338-9c18-cefa8710d34b"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:07:24.460658 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_api:SELECT=41 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:07:24.472491 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-d8c3664f-fa10-4794-b090-f8b68c86fd15 req-3118cf11-6dcf-4610-93ae-f03ce8d2d10c service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:24.474664 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-d8c3664f-fa10-4794-b090-f8b68c86fd15 req-3118cf11-6dcf-4610-93ae-f03ce8d2d10c service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:24.481039 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-d8c3664f-fa10-4794-b090-f8b68c86fd15 req-3118cf11-6dcf-4610-93ae-f03ce8d2d10c service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:24.529872 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-d8c3664f-fa10-4794-b090-f8b68c86fd15 req-3118cf11-6dcf-4610-93ae-f03ce8d2d10c service nova] Creating event network-vif-deleted:d58cf329-9762-4338-9c18-cefa8710d34b for instance e1f9b5da-f76c-47e2-bc50-eb6487d57306 on n-h2-854823-8 Oct 04 21:07:24.555793 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-d8c3664f-fa10-4794-b090-f8b68c86fd15 req-3118cf11-6dcf-4610-93ae-f03ce8d2d10c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.140987 Oct 04 21:07:24.560116 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2770/5510] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:07:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:07:25.016984 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2be16bc3-073d-411d-87c4-b594bed0409c tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:25.019431 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-2be16bc3-073d-411d-87c4-b594bed0409c tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] [instance: 05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:25.045884 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2be16bc3-073d-411d-87c4-b594bed0409c tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:25.057360 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2be16bc3-073d-411d-87c4-b594bed0409c tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:25.060190 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2be16bc3-073d-411d-87c4-b594bed0409c tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:25.063034 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2be16bc3-073d-411d-87c4-b594bed0409c tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:25.096569 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2be16bc3-073d-411d-87c4-b594bed0409c tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.033s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:25.097481 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2be16bc3-073d-411d-87c4-b594bed0409c tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:25.171018 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-9f89571e-bbaf-43ce-8602-8790cf27daac tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:25.171858 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-9f89571e-bbaf-43ce-8602-8790cf27daac tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] [instance: e1f9b5da-f76c-47e2-bc50-eb6487d57306] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:25.189188 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9f89571e-bbaf-43ce-8602-8790cf27daac tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:25.194989 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9f89571e-bbaf-43ce-8602-8790cf27daac tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:25.198869 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9f89571e-bbaf-43ce-8602-8790cf27daac tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:25.202261 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9f89571e-bbaf-43ce-8602-8790cf27daac tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:25.220326 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9f89571e-bbaf-43ce-8602-8790cf27daac tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:25.221261 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9f89571e-bbaf-43ce-8602-8790cf27daac tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:25.273295 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.wsgi [None req-9f89571e-bbaf-43ce-8602-8790cf27daac tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] HTTP exception thrown: Instance e1f9b5da-f76c-47e2-bc50-eb6487d57306 could not be found. Oct 04 21:07:25.276105 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-9f89571e-bbaf-43ce-8602-8790cf27daac tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Request method failure captured: Oct 04 21:07:25.276105 n-d-854823-8 devstack@n-api.service[128802]: request: GET /compute/v2.1/servers/e1f9b5da-f76c-47e2-bc50-eb6487d57306 HTTP/1.1 Oct 04 21:07:25.276105 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 21:07:25.276105 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 21:07:25.276105 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 21:07:25.276105 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 0 Oct 04 21:07:25.276105 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 21:07:25.276105 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 21:07:25.276105 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 21:07:25.276105 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 21:07:25.276105 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPJ6ORv5f7ucUc1GgNtAvhRFv0MfXY90YwD2xgHLgYfsVRwUV5gV1Hx78rlUpKA1NRvwYKNJhb7yIJiTiGqKIsoz35JtnB2AAmUjVwzFJr8QnfB8bfTqI5gxOvM7f9zAR1w4iePiaw2CxUuNcF2SaDuAI205FbH1jwb6Vgw17rzPCl_Q Oct 04 21:07:25.276105 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 21:07:25.276105 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 21:07:25.276105 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 21:07:25.276105 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 21:07:25.276105 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 21:07:25.276105 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 21:07:25.276105 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: b3aa23aee3c8435c8f1f409019c5fed2 Oct 04 21:07:25.276105 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1628573817 Oct 04 21:07:25.276105 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 21:07:25.276105 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 21:07:25.276105 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b3aa23aee3c8435c8f1f409019c5fed2", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b3aa23aee3c8435c8f1f409019c5fed2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b3aa23aee3c8435c8f1f409019c5fed2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b3aa23aee3c8435c8f1f409019c5fed2"}]}] Oct 04 21:07:25.276105 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1628573817 Oct 04 21:07:25.276105 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: b3aa23aee3c8435c8f1f409019c5fed2 Oct 04 21:07:25.276105 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1628573817 Oct 04 21:07:25.276105 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-TestNetworkAdvancedServerOps-1628573817-project Oct 04 21:07:25.276105 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 21:07:25.276105 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 21:07:25.276105 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: 0be5dbe3da6a4af181ef7302fe605fb4 Oct 04 21:07:25.276105 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1628573817-project Oct 04 21:07:25.276105 n-d-854823-8 devstack@n-api.service[128802]: method: > Oct 04 21:07:25.276105 n-d-854823-8 devstack@n-api.service[128802]: exception: Instance e1f9b5da-f76c-47e2-bc50-eb6487d57306 could not be found. Oct 04 21:07:25.276105 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'id': 'e1f9b5da-f76c-47e2-bc50-eb6487d57306'} Oct 04 21:07:25.276105 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:07:25.276105 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:07:25.276105 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:07:25.276105 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:07:25.276105 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:07:25.276105 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:07:25.276105 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:07:25.276105 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:07:25.276105 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:07:25.276105 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:07:25.276105 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e1f9b5da-f76c-47e2-bc50-eb6487d57306 could not be found. Oct 04 21:07:25.276105 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:07:25.276105 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:07:25.276105 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:07:25.276105 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:07:25.276105 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:07:25.276105 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:07:25.276105 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:07:25.276105 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:07:25.276105 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:07:25.276105 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:07:25.276105 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:07:25.276105 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:07:25.276105 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:07:25.276105 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:07:25.276105 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:07:25.276105 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:07:25.276105 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e1f9b5da-f76c-47e2-bc50-eb6487d57306 could not be found. Oct 04 21:07:25.276105 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:07:25.276105 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:07:25.281562 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:07:25.281562 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:07:25.281562 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:07:25.281562 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:07:25.281562 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:07:25.281562 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:07:25.281562 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e1f9b5da-f76c-47e2-bc50-eb6487d57306 could not be found. Oct 04 21:07:25.281562 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:07:25.287193 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-9f89571e-bbaf-43ce-8602-8790cf27daac tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Returning 404 to user: Instance e1f9b5da-f76c-47e2-bc50-eb6487d57306 could not be found. {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:07:25.288533 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-9f89571e-bbaf-43ce-8602-8790cf27daac tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] 10.222.0.33 "GET /compute/v2.1/servers/e1f9b5da-f76c-47e2-bc50-eb6487d57306" status: 404 len: 111 microversion: 2.1 time: 0.124104 Oct 04 21:07:25.294926 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2771/5511] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:07:25 2022] GET /compute/v2.1/servers/e1f9b5da-f76c-47e2-bc50-eb6487d57306 => generated 111 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:07:25.543369 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-2be16bc3-073d-411d-87c4-b594bed0409c tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:25.566211 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-2be16bc3-073d-411d-87c4-b594bed0409c tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:25.574754 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-2be16bc3-073d-411d-87c4-b594bed0409c tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:25.577331 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-2be16bc3-073d-411d-87c4-b594bed0409c tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] 10.222.0.33 "GET /compute/v2.1/servers/05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9" status: 200 len: 1738 microversion: 2.20 time: 0.577112 Oct 04 21:07:25.594878 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2741/5512] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 21:07:24 2022] GET /compute/v2.1/servers/05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9 => generated 1738 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:07:26.616678 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-9b9532e1-f7e8-4074-a2f6-78ee1467f5a1 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:26.619316 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-9b9532e1-f7e8-4074-a2f6-78ee1467f5a1 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] [instance: 05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:26.629078 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9b9532e1-f7e8-4074-a2f6-78ee1467f5a1 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:26.630678 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9b9532e1-f7e8-4074-a2f6-78ee1467f5a1 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:26.634570 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9b9532e1-f7e8-4074-a2f6-78ee1467f5a1 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:26.635624 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9b9532e1-f7e8-4074-a2f6-78ee1467f5a1 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:26.636272 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9b9532e1-f7e8-4074-a2f6-78ee1467f5a1 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:26.636869 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9b9532e1-f7e8-4074-a2f6-78ee1467f5a1 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:27.037356 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-9b9532e1-f7e8-4074-a2f6-78ee1467f5a1 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:27.062442 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-9b9532e1-f7e8-4074-a2f6-78ee1467f5a1 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:27.076680 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-9b9532e1-f7e8-4074-a2f6-78ee1467f5a1 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:27.078451 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-9b9532e1-f7e8-4074-a2f6-78ee1467f5a1 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] 10.222.0.33 "GET /compute/v2.1/servers/05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9" status: 200 len: 1738 microversion: 2.20 time: 0.466606 Oct 04 21:07:27.085336 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2772/5513] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 21:07:26 2022] GET /compute/v2.1/servers/05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9 => generated 1738 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:07:28.109760 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d2610831-a60f-4159-9ea6-58af20a24bed tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:28.110381 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d2610831-a60f-4159-9ea6-58af20a24bed tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] [instance: 05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:28.123183 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d2610831-a60f-4159-9ea6-58af20a24bed tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:28.123869 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d2610831-a60f-4159-9ea6-58af20a24bed tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:28.124324 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d2610831-a60f-4159-9ea6-58af20a24bed tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:28.125041 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d2610831-a60f-4159-9ea6-58af20a24bed tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:28.125501 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d2610831-a60f-4159-9ea6-58af20a24bed tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:28.125933 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d2610831-a60f-4159-9ea6-58af20a24bed tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:28.642693 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d2610831-a60f-4159-9ea6-58af20a24bed tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:28.654400 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d2610831-a60f-4159-9ea6-58af20a24bed tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:28.677115 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d2610831-a60f-4159-9ea6-58af20a24bed tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:28.683866 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d2610831-a60f-4159-9ea6-58af20a24bed tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] 10.222.0.33 "GET /compute/v2.1/servers/05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9" status: 200 len: 1738 microversion: 2.20 time: 0.577974 Oct 04 21:07:28.687857 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2742/5514] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 21:07:28 2022] GET /compute/v2.1/servers/05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9 => generated 1738 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:07:29.722100 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-7516f473-7589-4c81-aa0c-5dd1b8fe2c41 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:29.723408 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-7516f473-7589-4c81-aa0c-5dd1b8fe2c41 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] [instance: 05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:29.735414 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7516f473-7589-4c81-aa0c-5dd1b8fe2c41 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:29.735920 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7516f473-7589-4c81-aa0c-5dd1b8fe2c41 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:29.736367 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7516f473-7589-4c81-aa0c-5dd1b8fe2c41 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:29.737095 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7516f473-7589-4c81-aa0c-5dd1b8fe2c41 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:29.737547 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7516f473-7589-4c81-aa0c-5dd1b8fe2c41 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:29.755892 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7516f473-7589-4c81-aa0c-5dd1b8fe2c41 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:30.145726 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-7516f473-7589-4c81-aa0c-5dd1b8fe2c41 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:30.162123 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-7516f473-7589-4c81-aa0c-5dd1b8fe2c41 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:30.163810 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-7516f473-7589-4c81-aa0c-5dd1b8fe2c41 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:30.168422 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-7516f473-7589-4c81-aa0c-5dd1b8fe2c41 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] 10.222.0.33 "GET /compute/v2.1/servers/05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9" status: 200 len: 1738 microversion: 2.20 time: 0.448994 Oct 04 21:07:30.186371 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2773/5515] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 21:07:29 2022] GET /compute/v2.1/servers/05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9 => generated 1738 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:07:31.207473 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2f782389-320a-400f-bd55-d4a2a6e88b14 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:31.210329 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-2f782389-320a-400f-bd55-d4a2a6e88b14 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] [instance: 05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:31.225509 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2f782389-320a-400f-bd55-d4a2a6e88b14 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:31.228122 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2f782389-320a-400f-bd55-d4a2a6e88b14 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:31.230022 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2f782389-320a-400f-bd55-d4a2a6e88b14 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:31.231215 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2f782389-320a-400f-bd55-d4a2a6e88b14 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:31.232896 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2f782389-320a-400f-bd55-d4a2a6e88b14 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:31.235565 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2f782389-320a-400f-bd55-d4a2a6e88b14 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:32.192114 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-2f782389-320a-400f-bd55-d4a2a6e88b14 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:32.231555 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-2f782389-320a-400f-bd55-d4a2a6e88b14 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:32.233882 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-2f782389-320a-400f-bd55-d4a2a6e88b14 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:32.244529 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-2f782389-320a-400f-bd55-d4a2a6e88b14 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] 10.222.0.33 "GET /compute/v2.1/servers/05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9" status: 200 len: 1738 microversion: 2.20 time: 1.047106 Oct 04 21:07:32.265098 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2743/5516] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 21:07:31 2022] GET /compute/v2.1/servers/05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9 => generated 1738 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:07:33.272638 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-32d104e8-949e-4e4a-857d-71868540f5f6 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:33.274364 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-32d104e8-949e-4e4a-857d-71868540f5f6 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] [instance: 05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:33.310164 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-32d104e8-949e-4e4a-857d-71868540f5f6 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:33.311945 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-32d104e8-949e-4e4a-857d-71868540f5f6 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:33.312406 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-32d104e8-949e-4e4a-857d-71868540f5f6 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:33.323958 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-32d104e8-949e-4e4a-857d-71868540f5f6 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:33.324602 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-32d104e8-949e-4e4a-857d-71868540f5f6 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:33.332205 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-32d104e8-949e-4e4a-857d-71868540f5f6 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:34.204087 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-32d104e8-949e-4e4a-857d-71868540f5f6 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:34.256409 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-32d104e8-949e-4e4a-857d-71868540f5f6 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:34.267028 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-32d104e8-949e-4e4a-857d-71868540f5f6 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:34.268292 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-32d104e8-949e-4e4a-857d-71868540f5f6 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] 10.222.0.33 "GET /compute/v2.1/servers/05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9" status: 200 len: 1738 microversion: 2.20 time: 1.000837 Oct 04 21:07:34.276666 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2774/5517] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 21:07:33 2022] GET /compute/v2.1/servers/05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9 => generated 1738 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:07:35.309492 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-36521b7a-d7d3-45a9-a705-7ead09529951 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:35.310099 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-36521b7a-d7d3-45a9-a705-7ead09529951 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] [instance: 05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:35.316725 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-36521b7a-d7d3-45a9-a705-7ead09529951 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:35.317230 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-36521b7a-d7d3-45a9-a705-7ead09529951 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:35.317680 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-36521b7a-d7d3-45a9-a705-7ead09529951 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:35.318438 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-36521b7a-d7d3-45a9-a705-7ead09529951 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:35.318909 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-36521b7a-d7d3-45a9-a705-7ead09529951 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:35.319345 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-36521b7a-d7d3-45a9-a705-7ead09529951 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:35.798703 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-36521b7a-d7d3-45a9-a705-7ead09529951 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:35.811845 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-36521b7a-d7d3-45a9-a705-7ead09529951 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:35.813317 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-36521b7a-d7d3-45a9-a705-7ead09529951 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:35.830755 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-36521b7a-d7d3-45a9-a705-7ead09529951 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] 10.222.0.33 "GET /compute/v2.1/servers/05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9" status: 200 len: 1738 microversion: 2.20 time: 0.523135 Oct 04 21:07:35.831808 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2744/5518] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 21:07:35 2022] GET /compute/v2.1/servers/05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9 => generated 1738 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:07:36.235955 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-8c73ef92-d7c9-4295-855a-46c0631ea381 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Calling method '.version_select at 0x7f3c74149c10>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:36.299254 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-8c73ef92-d7c9-4295-855a-46c0631ea381 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-761519335" status: 202 len: 0 microversion: 2.1 time: 0.092015 Oct 04 21:07:36.303877 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2775/5519] 10.222.0.33 () {58 vars in 1281 bytes} [Tue Oct 4 21:07:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-761519335 => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:07:36.332781 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b4ac714c-df14-4b85-b871-7301b0aacb88 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Action: 'create', calling method: .version_select at 0x7f3c6ef0c940>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-2059665705", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNtqdNVoQkI69IJmqINDOiHXP9nv24G0bE0N3bCuCNKM5woFu/gSoS5DDqb1copybT6MNoaJlMkNF/CdiLg1Rrwdw972+o1FdQZCZYuBybC3n58M1D7s2eEyMVEziRTUHg=="}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:07:36.372882 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-b4ac714c-df14-4b85-b871-7301b0aacb88 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Getting quotas for project b3aa23aee3c8435c8f1f409019c5fed2. Resources: {'key_pairs'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:07:36.383313 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-b4ac714c-df14-4b85-b871-7301b0aacb88 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Getting quotas for user 0be5dbe3da6a4af181ef7302fe605fb4 and project b3aa23aee3c8435c8f1f409019c5fed2. Resources: {'key_pairs'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:07:36.442571 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b4ac714c-df14-4b85-b871-7301b0aacb88 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.113816 Oct 04 21:07:36.450474 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2745/5520] 10.222.0.33 () {60 vars in 1159 bytes} [Tue Oct 4 21:07:36 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:07:36.863469 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-fb793177-895e-4f04-a728-5e3526f9459a tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:36.864499 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-fb793177-895e-4f04-a728-5e3526f9459a tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] [instance: 05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:36.876108 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fb793177-895e-4f04-a728-5e3526f9459a tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:36.878893 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fb793177-895e-4f04-a728-5e3526f9459a tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:36.881002 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fb793177-895e-4f04-a728-5e3526f9459a tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:36.883354 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fb793177-895e-4f04-a728-5e3526f9459a tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:36.884772 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fb793177-895e-4f04-a728-5e3526f9459a tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:36.887216 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fb793177-895e-4f04-a728-5e3526f9459a tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:37.300963 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-fb793177-895e-4f04-a728-5e3526f9459a tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:37.317604 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-fb793177-895e-4f04-a728-5e3526f9459a tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:37.319212 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-fb793177-895e-4f04-a728-5e3526f9459a tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:37.321290 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-fb793177-895e-4f04-a728-5e3526f9459a tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] 10.222.0.33 "GET /compute/v2.1/servers/05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9" status: 200 len: 1738 microversion: 2.20 time: 0.463832 Oct 04 21:07:37.322052 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2776/5521] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 21:07:36 2022] GET /compute/v2.1/servers/05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9 => generated 1738 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:07:38.352686 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-fa25bfeb-6866-4355-b656-f539a879a7d1 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:38.353832 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-fa25bfeb-6866-4355-b656-f539a879a7d1 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] [instance: 05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:38.380082 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fa25bfeb-6866-4355-b656-f539a879a7d1 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:38.380590 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fa25bfeb-6866-4355-b656-f539a879a7d1 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:38.381031 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fa25bfeb-6866-4355-b656-f539a879a7d1 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:38.381765 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fa25bfeb-6866-4355-b656-f539a879a7d1 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:38.382221 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fa25bfeb-6866-4355-b656-f539a879a7d1 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:38.392839 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fa25bfeb-6866-4355-b656-f539a879a7d1 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:38.922638 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-fa25bfeb-6866-4355-b656-f539a879a7d1 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:38.933665 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-fa25bfeb-6866-4355-b656-f539a879a7d1 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:38.935916 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-fa25bfeb-6866-4355-b656-f539a879a7d1 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:38.937791 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-fa25bfeb-6866-4355-b656-f539a879a7d1 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] 10.222.0.33 "GET /compute/v2.1/servers/05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9" status: 200 len: 1738 microversion: 2.20 time: 0.588841 Oct 04 21:07:38.939245 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2746/5522] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 21:07:38 2022] GET /compute/v2.1/servers/05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9 => generated 1738 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:07:39.970057 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-a81425d3-ce32-4faf-b1e3-e1a24d5bdb2e tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:39.970730 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-a81425d3-ce32-4faf-b1e3-e1a24d5bdb2e tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] [instance: 05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:39.995007 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a81425d3-ce32-4faf-b1e3-e1a24d5bdb2e tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:39.995598 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a81425d3-ce32-4faf-b1e3-e1a24d5bdb2e tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:40.013111 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a81425d3-ce32-4faf-b1e3-e1a24d5bdb2e tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:40.021007 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a81425d3-ce32-4faf-b1e3-e1a24d5bdb2e tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:40.037669 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a81425d3-ce32-4faf-b1e3-e1a24d5bdb2e tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:40.038155 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a81425d3-ce32-4faf-b1e3-e1a24d5bdb2e tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:40.520284 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-a81425d3-ce32-4faf-b1e3-e1a24d5bdb2e tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:40.532157 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-a81425d3-ce32-4faf-b1e3-e1a24d5bdb2e tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:40.535764 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-a81425d3-ce32-4faf-b1e3-e1a24d5bdb2e tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:40.538058 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-a81425d3-ce32-4faf-b1e3-e1a24d5bdb2e tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] 10.222.0.33 "GET /compute/v2.1/servers/05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9" status: 200 len: 1738 microversion: 2.20 time: 0.572705 Oct 04 21:07:40.552306 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2777/5523] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 21:07:39 2022] GET /compute/v2.1/servers/05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9 => generated 1738 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:07:41.567517 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-86e43964-935d-4293-b233-e21195fd8f3e tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:41.568172 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-86e43964-935d-4293-b233-e21195fd8f3e tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] [instance: 05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:41.580271 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-86e43964-935d-4293-b233-e21195fd8f3e tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:41.582059 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-86e43964-935d-4293-b233-e21195fd8f3e tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:41.584154 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-86e43964-935d-4293-b233-e21195fd8f3e tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:41.584913 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-86e43964-935d-4293-b233-e21195fd8f3e tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:41.586926 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-86e43964-935d-4293-b233-e21195fd8f3e tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:41.587386 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-86e43964-935d-4293-b233-e21195fd8f3e tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:42.066069 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-86e43964-935d-4293-b233-e21195fd8f3e tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:42.075367 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-86e43964-935d-4293-b233-e21195fd8f3e tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:42.093138 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-86e43964-935d-4293-b233-e21195fd8f3e tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:42.096940 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-86e43964-935d-4293-b233-e21195fd8f3e tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] 10.222.0.33 "GET /compute/v2.1/servers/05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9" status: 200 len: 1738 microversion: 2.20 time: 0.534019 Oct 04 21:07:42.100119 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2747/5524] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 21:07:41 2022] GET /compute/v2.1/servers/05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9 => generated 1738 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:07:43.131407 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-a59dc09b-3789-4622-a190-6961d8246871 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:43.132837 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-a59dc09b-3789-4622-a190-6961d8246871 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] [instance: 05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:43.155108 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a59dc09b-3789-4622-a190-6961d8246871 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:43.159568 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a59dc09b-3789-4622-a190-6961d8246871 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:43.162081 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a59dc09b-3789-4622-a190-6961d8246871 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:43.164713 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a59dc09b-3789-4622-a190-6961d8246871 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:43.169073 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a59dc09b-3789-4622-a190-6961d8246871 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:43.171549 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a59dc09b-3789-4622-a190-6961d8246871 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:43.734950 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-a59dc09b-3789-4622-a190-6961d8246871 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:43.753854 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-a59dc09b-3789-4622-a190-6961d8246871 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:43.764210 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-a59dc09b-3789-4622-a190-6961d8246871 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:43.769767 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-a59dc09b-3789-4622-a190-6961d8246871 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] 10.222.0.33 "GET /compute/v2.1/servers/05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9" status: 200 len: 1738 microversion: 2.20 time: 0.641238 Oct 04 21:07:43.785947 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2778/5525] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 21:07:43 2022] GET /compute/v2.1/servers/05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9 => generated 1738 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:07:44.807621 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-448c3741-33d6-4d5f-9858-cc4e69b3977d tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:44.808205 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-448c3741-33d6-4d5f-9858-cc4e69b3977d tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] [instance: 05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:44.829793 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-448c3741-33d6-4d5f-9858-cc4e69b3977d tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:44.830305 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-448c3741-33d6-4d5f-9858-cc4e69b3977d tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:44.830776 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-448c3741-33d6-4d5f-9858-cc4e69b3977d tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:44.831492 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-448c3741-33d6-4d5f-9858-cc4e69b3977d tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:44.831953 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-448c3741-33d6-4d5f-9858-cc4e69b3977d tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:44.832382 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-448c3741-33d6-4d5f-9858-cc4e69b3977d tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:45.488857 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-448c3741-33d6-4d5f-9858-cc4e69b3977d tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:45.488857 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-448c3741-33d6-4d5f-9858-cc4e69b3977d tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:45.489325 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-448c3741-33d6-4d5f-9858-cc4e69b3977d tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:45.506729 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-448c3741-33d6-4d5f-9858-cc4e69b3977d tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] 10.222.0.33 "GET /compute/v2.1/servers/05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9" status: 200 len: 1738 microversion: 2.20 time: 0.688250 Oct 04 21:07:45.507431 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2748/5526] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 21:07:44 2022] GET /compute/v2.1/servers/05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9 => generated 1738 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:07:46.559633 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-1a38af75-f53b-45f4-bdcc-ae695e5dcf1f tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:46.561013 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-1a38af75-f53b-45f4-bdcc-ae695e5dcf1f tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] [instance: 05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:46.644786 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1a38af75-f53b-45f4-bdcc-ae695e5dcf1f tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:46.660778 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1a38af75-f53b-45f4-bdcc-ae695e5dcf1f tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:46.674984 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1a38af75-f53b-45f4-bdcc-ae695e5dcf1f tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:46.680374 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1a38af75-f53b-45f4-bdcc-ae695e5dcf1f tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:46.708088 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1a38af75-f53b-45f4-bdcc-ae695e5dcf1f tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.028s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:46.718607 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1a38af75-f53b-45f4-bdcc-ae695e5dcf1f tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:46.737096 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=57 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:07:47.739584 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-1a38af75-f53b-45f4-bdcc-ae695e5dcf1f tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:47.808878 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-1a38af75-f53b-45f4-bdcc-ae695e5dcf1f tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:47.810886 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-1a38af75-f53b-45f4-bdcc-ae695e5dcf1f tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:47.813268 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-1a38af75-f53b-45f4-bdcc-ae695e5dcf1f tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] 10.222.0.33 "GET /compute/v2.1/servers/05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9" status: 200 len: 1738 microversion: 2.20 time: 1.276973 Oct 04 21:07:47.831055 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2779/5527] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 21:07:46 2022] GET /compute/v2.1/servers/05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9 => generated 1738 bytes in 1294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:07:48.847861 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8d3aa6ef-076c-410e-8053-faf936bb1e3d tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:48.848476 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-8d3aa6ef-076c-410e-8053-faf936bb1e3d tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] [instance: 05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:48.861596 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=4 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:07:48.868730 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8d3aa6ef-076c-410e-8053-faf936bb1e3d tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:48.872950 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8d3aa6ef-076c-410e-8053-faf936bb1e3d tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:48.873284 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8d3aa6ef-076c-410e-8053-faf936bb1e3d tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:48.874044 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8d3aa6ef-076c-410e-8053-faf936bb1e3d tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:48.878237 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8d3aa6ef-076c-410e-8053-faf936bb1e3d tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:48.878721 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8d3aa6ef-076c-410e-8053-faf936bb1e3d tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:48.897432 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:07:49.682478 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-8d3aa6ef-076c-410e-8053-faf936bb1e3d tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:49.713801 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-8d3aa6ef-076c-410e-8053-faf936bb1e3d tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:49.719853 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-8d3aa6ef-076c-410e-8053-faf936bb1e3d tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:49.723961 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-8d3aa6ef-076c-410e-8053-faf936bb1e3d tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] 10.222.0.33 "GET /compute/v2.1/servers/05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9" status: 200 len: 1720 microversion: 2.20 time: 0.880446 Oct 04 21:07:49.725106 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2749/5528] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 21:07:48 2022] GET /compute/v2.1/servers/05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9 => generated 1720 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:07:50.755907 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-2f0a194a-faa5-423c-9812-da7a63ac9615 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:50.757267 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-2f0a194a-faa5-423c-9812-da7a63ac9615 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] [instance: 05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:50.772709 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2f0a194a-faa5-423c-9812-da7a63ac9615 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:50.774625 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2f0a194a-faa5-423c-9812-da7a63ac9615 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:50.777800 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2f0a194a-faa5-423c-9812-da7a63ac9615 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:50.784429 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2f0a194a-faa5-423c-9812-da7a63ac9615 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:50.785844 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2f0a194a-faa5-423c-9812-da7a63ac9615 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:50.789494 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2f0a194a-faa5-423c-9812-da7a63ac9615 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:52.914982 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-2f0a194a-faa5-423c-9812-da7a63ac9615 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:52.941867 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-2f0a194a-faa5-423c-9812-da7a63ac9615 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:52.950637 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-2f0a194a-faa5-423c-9812-da7a63ac9615 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:52.959780 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-2f0a194a-faa5-423c-9812-da7a63ac9615 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] 10.222.0.33 "GET /compute/v2.1/servers/05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9" status: 200 len: 1720 microversion: 2.20 time: 2.206939 Oct 04 21:07:52.961540 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2780/5529] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 21:07:50 2022] GET /compute/v2.1/servers/05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9 => generated 1720 bytes in 2211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:07:53.223365 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-1d0f913c-ccf0-413b-a452-075c40a67913 req-7e1adcf4-9da9-4006-992b-dd891a4da5bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9", "name": "network-vif-unplugged", "status": "completed", "tag": "2f9889d1-cb04-4ccc-8abc-1f54eb9f493f"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:07:53.246722 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:07:53.265614 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-1d0f913c-ccf0-413b-a452-075c40a67913 req-7e1adcf4-9da9-4006-992b-dd891a4da5bc service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:53.267834 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-1d0f913c-ccf0-413b-a452-075c40a67913 req-7e1adcf4-9da9-4006-992b-dd891a4da5bc service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:53.269006 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-1d0f913c-ccf0-413b-a452-075c40a67913 req-7e1adcf4-9da9-4006-992b-dd891a4da5bc service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:53.316979 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-1d0f913c-ccf0-413b-a452-075c40a67913 req-7e1adcf4-9da9-4006-992b-dd891a4da5bc service nova] Creating event network-vif-unplugged:2f9889d1-cb04-4ccc-8abc-1f54eb9f493f for instance 05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9 on n-h2-854823-8 Oct 04 21:07:53.324121 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-1d0f913c-ccf0-413b-a452-075c40a67913 req-7e1adcf4-9da9-4006-992b-dd891a4da5bc service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.106076 Oct 04 21:07:53.325943 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2750/5530] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:07:53 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:07:54.000573 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-eb52c240-bbb0-479a-8645-95b3602f7e7f tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:54.008461 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-eb52c240-bbb0-479a-8645-95b3602f7e7f tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] [instance: 05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:54.035836 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-eb52c240-bbb0-479a-8645-95b3602f7e7f tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:54.046046 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-eb52c240-bbb0-479a-8645-95b3602f7e7f tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:54.049567 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-eb52c240-bbb0-479a-8645-95b3602f7e7f tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:54.053964 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-eb52c240-bbb0-479a-8645-95b3602f7e7f tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:54.061340 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-eb52c240-bbb0-479a-8645-95b3602f7e7f tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:54.063170 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-eb52c240-bbb0-479a-8645-95b3602f7e7f tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:54.659640 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-eb52c240-bbb0-479a-8645-95b3602f7e7f tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:54.670668 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-eb52c240-bbb0-479a-8645-95b3602f7e7f tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:54.676211 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-eb52c240-bbb0-479a-8645-95b3602f7e7f tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:54.683065 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-eb52c240-bbb0-479a-8645-95b3602f7e7f tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] 10.222.0.33 "GET /compute/v2.1/servers/05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9" status: 200 len: 1720 microversion: 2.20 time: 0.694048 Oct 04 21:07:54.684042 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2781/5531] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 21:07:53 2022] GET /compute/v2.1/servers/05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9 => generated 1720 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:07:55.732275 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8ee1418a-7aa1-48af-b7c0-c4d37fcf1e88 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:55.732989 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-8ee1418a-7aa1-48af-b7c0-c4d37fcf1e88 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] [instance: 05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:55.763183 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8ee1418a-7aa1-48af-b7c0-c4d37fcf1e88 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:55.763836 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8ee1418a-7aa1-48af-b7c0-c4d37fcf1e88 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:55.764294 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8ee1418a-7aa1-48af-b7c0-c4d37fcf1e88 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:55.773404 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8ee1418a-7aa1-48af-b7c0-c4d37fcf1e88 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:55.773901 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8ee1418a-7aa1-48af-b7c0-c4d37fcf1e88 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:55.774366 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8ee1418a-7aa1-48af-b7c0-c4d37fcf1e88 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:56.732716 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-8ee1418a-7aa1-48af-b7c0-c4d37fcf1e88 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:56.758129 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-8ee1418a-7aa1-48af-b7c0-c4d37fcf1e88 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:56.759639 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-8ee1418a-7aa1-48af-b7c0-c4d37fcf1e88 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:56.774076 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-8ee1418a-7aa1-48af-b7c0-c4d37fcf1e88 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] 10.222.0.33 "GET /compute/v2.1/servers/05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9" status: 200 len: 1723 microversion: 2.20 time: 1.034724 Oct 04 21:07:56.774849 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2751/5532] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 21:07:55 2022] GET /compute/v2.1/servers/05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9 => generated 1723 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:07:56.808248 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-a79b9128-d5ca-48a8-97e7-6943dceab53d tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2f299588-ead9-4f5a-a6f2-ae87b6655d72"}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:07:56.810996 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-a79b9128-d5ca-48a8-97e7-6943dceab53d tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] [instance: 05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:56.817890 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_api:SELECT=25,nova_api:DELETE=1 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:07:56.835316 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a79b9128-d5ca-48a8-97e7-6943dceab53d tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:56.838377 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a79b9128-d5ca-48a8-97e7-6943dceab53d tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:56.839046 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a79b9128-d5ca-48a8-97e7-6943dceab53d tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:56.840008 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a79b9128-d5ca-48a8-97e7-6943dceab53d tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:56.841339 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a79b9128-d5ca-48a8-97e7-6943dceab53d tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:56.843309 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a79b9128-d5ca-48a8-97e7-6943dceab53d tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:57.576735 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-a79b9128-d5ca-48a8-97e7-6943dceab53d tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] 10.222.0.33 "POST /compute/v2.1/servers/05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.772731 Oct 04 21:07:57.578573 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2782/5533] 10.222.0.33 () {62 vars in 1364 bytes} [Tue Oct 4 21:07:56 2022] POST /compute/v2.1/servers/05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9/os-volume_attachments => generated 188 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 21:07:57.894140 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f73230c8-dee3-4928-b860-80e628231475 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-331761595", "imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63", "flavorRef": "452", "networks": [{"uuid": "1d0c056f-8c3f-463f-a1d5-b785fd57b543"}], "key_name": "tempest-TestNetworkAdvancedServerOps-2059665705", "security_groups": [{"name": "tempest-secgroup-smoke-835655533"}]}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:07:58.005038 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-10f33516-6be6-4c7d-b233-588286132300 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:58.006369 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-10f33516-6be6-4c7d-b233-588286132300 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] [instance: 05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:58.032557 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-10f33516-6be6-4c7d-b233-588286132300 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:58.032964 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-10f33516-6be6-4c7d-b233-588286132300 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:58.033432 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-10f33516-6be6-4c7d-b233-588286132300 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:58.034146 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-10f33516-6be6-4c7d-b233-588286132300 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:58.034622 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-10f33516-6be6-4c7d-b233-588286132300 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:58.035045 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-10f33516-6be6-4c7d-b233-588286132300 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:58.166864 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.network.neutron [None req-f73230c8-dee3-4928-b860-80e628231475 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] validate_networks() for [('1d0c056f-8c3f-463f-a1d5-b785fd57b543', None, None, None, None, None)] {{(pid=128801) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:07:58.764086 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-10f33516-6be6-4c7d-b233-588286132300 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] 10.222.0.33 "DELETE /compute/v2.1/servers/05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9/os-volume_attachments/2f299588-ead9-4f5a-a6f2-ae87b6655d72" status: 202 len: 0 microversion: 2.20 time: 0.767429 Oct 04 21:07:58.765829 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2783/5534] 10.222.0.33 () {60 vars in 1457 bytes} [Tue Oct 4 21:07:57 2022] DELETE /compute/v2.1/servers/05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9/os-volume_attachments/2f299588-ead9-4f5a-a6f2-ae87b6655d72 => generated 0 bytes in 770 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:07:58.923616 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-12e24332-a45b-4f82-a35b-041ebaf39d77 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:07:58.924927 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-12e24332-a45b-4f82-a35b-041ebaf39d77 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] [instance: 05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:58.941590 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-12e24332-a45b-4f82-a35b-041ebaf39d77 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:58.946177 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-12e24332-a45b-4f82-a35b-041ebaf39d77 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:58.946881 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-12e24332-a45b-4f82-a35b-041ebaf39d77 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:58.947986 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-12e24332-a45b-4f82-a35b-041ebaf39d77 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:58.954161 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-12e24332-a45b-4f82-a35b-041ebaf39d77 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:58.954753 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-12e24332-a45b-4f82-a35b-041ebaf39d77 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:59.059840 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-12e24332-a45b-4f82-a35b-041ebaf39d77 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] [instance: 05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=128802) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 04 21:07:59.271936 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-12e24332-a45b-4f82-a35b-041ebaf39d77 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] 10.222.0.33 "POST /compute/v2.1/servers/05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9/action" status: 202 len: 0 microversion: 2.20 time: 0.353931 Oct 04 21:07:59.277696 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2784/5535] 10.222.0.33 () {62 vars in 1319 bytes} [Tue Oct 4 21:07:58 2022] POST /compute/v2.1/servers/05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9/action => generated 0 bytes in 363 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:07:59.287612 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-60747b83-bea5-4c36-8aba-be7158f2c997 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:59.290284 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-60747b83-bea5-4c36-8aba-be7158f2c997 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] [instance: 05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:59.298852 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-f73230c8-dee3-4928-b860-80e628231475 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Flavor limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:07:59.299296 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-f73230c8-dee3-4928-b860-80e628231475 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Image limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:07:59.301969 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-f73230c8-dee3-4928-b860-80e628231475 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Flavor pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:07:59.302444 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-f73230c8-dee3-4928-b860-80e628231475 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Image pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:07:59.303971 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-f73230c8-dee3-4928-b860-80e628231475 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:07:59.307815 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-60747b83-bea5-4c36-8aba-be7158f2c997 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:59.311268 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-60747b83-bea5-4c36-8aba-be7158f2c997 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:59.311989 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-60747b83-bea5-4c36-8aba-be7158f2c997 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:59.313159 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-60747b83-bea5-4c36-8aba-be7158f2c997 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:59.316401 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-60747b83-bea5-4c36-8aba-be7158f2c997 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:59.317204 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-60747b83-bea5-4c36-8aba-be7158f2c997 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:59.342090 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f73230c8-dee3-4928-b860-80e628231475 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:59.342664 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f73230c8-dee3-4928-b860-80e628231475 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:59.344257 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f73230c8-dee3-4928-b860-80e628231475 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:59.345059 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f73230c8-dee3-4928-b860-80e628231475 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:07:59.348088 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f73230c8-dee3-4928-b860-80e628231475 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:07:59.348641 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f73230c8-dee3-4928-b860-80e628231475 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:07:59.399427 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-f73230c8-dee3-4928-b860-80e628231475 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Getting quotas for project b3aa23aee3c8435c8f1f409019c5fed2. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:07:59.411170 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-f73230c8-dee3-4928-b860-80e628231475 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Getting quotas for user 0be5dbe3da6a4af181ef7302fe605fb4 and project b3aa23aee3c8435c8f1f409019c5fed2. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:07:59.448987 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f73230c8-dee3-4928-b860-80e628231475 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Going to run 1 instances... {{(pid=128801) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:07:59.458094 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f73230c8-dee3-4928-b860-80e628231475 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] [instance: bf706904-01fc-408d-a24e-0efb6de3e74f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='15b24725-0c99-4bcf-b1fb-907cdf8e2d63',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128801) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:07:59.593104 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f73230c8-dee3-4928-b860-80e628231475 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.703162 Oct 04 21:07:59.601549 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2752/5536] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 21:07:57 2022] POST /compute/v2.1/servers => generated 405 bytes in 1712 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:07:59.607329 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9bbfc166-8f43-473f-b5dc-4efca862a7a5 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:07:59.609045 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-9bbfc166-8f43-473f-b5dc-4efca862a7a5 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] [instance: bf706904-01fc-408d-a24e-0efb6de3e74f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:07:59.659707 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-60747b83-bea5-4c36-8aba-be7158f2c997 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:59.675764 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-60747b83-bea5-4c36-8aba-be7158f2c997 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:59.683217 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-60747b83-bea5-4c36-8aba-be7158f2c997 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:59.718610 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-60747b83-bea5-4c36-8aba-be7158f2c997 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] 10.222.0.33 "GET /compute/v2.1/servers/05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9" status: 200 len: 1671 microversion: 2.20 time: 0.432879 Oct 04 21:07:59.740013 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2785/5537] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 21:07:59 2022] GET /compute/v2.1/servers/05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9 => generated 1671 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:07:59.793144 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-9bbfc166-8f43-473f-b5dc-4efca862a7a5 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5dbe3da6a4af181ef7302fe605fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3aa23aee3c8435c8f1f409019c5fed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:07:59.805492 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-9bbfc166-8f43-473f-b5dc-4efca862a7a5 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] 10.222.0.33 "GET /compute/v2.1/servers/bf706904-01fc-408d-a24e-0efb6de3e74f" status: 200 len: 1266 microversion: 2.1 time: 0.201430 Oct 04 21:07:59.808718 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2753/5538] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:07:59 2022] GET /compute/v2.1/servers/bf706904-01fc-408d-a24e-0efb6de3e74f => generated 1266 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:08:00.767793 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-38cf524a-fb74-413f-8cbe-9f32ce7bcc5c tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:00.769075 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-38cf524a-fb74-413f-8cbe-9f32ce7bcc5c tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] [instance: 05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:00.791094 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-38cf524a-fb74-413f-8cbe-9f32ce7bcc5c tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:00.794835 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-38cf524a-fb74-413f-8cbe-9f32ce7bcc5c tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:00.795546 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-38cf524a-fb74-413f-8cbe-9f32ce7bcc5c tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:00.798467 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-38cf524a-fb74-413f-8cbe-9f32ce7bcc5c tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:00.799399 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-38cf524a-fb74-413f-8cbe-9f32ce7bcc5c tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:00.800516 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-38cf524a-fb74-413f-8cbe-9f32ce7bcc5c tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:00.838886 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-66a1d3a5-470e-430b-97f1-b614544aa8d1 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:00.840133 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-66a1d3a5-470e-430b-97f1-b614544aa8d1 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] [instance: bf706904-01fc-408d-a24e-0efb6de3e74f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:00.850084 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-66a1d3a5-470e-430b-97f1-b614544aa8d1 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:00.851972 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-66a1d3a5-470e-430b-97f1-b614544aa8d1 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:00.853095 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-66a1d3a5-470e-430b-97f1-b614544aa8d1 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:00.854094 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-66a1d3a5-470e-430b-97f1-b614544aa8d1 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:00.854903 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-66a1d3a5-470e-430b-97f1-b614544aa8d1 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:00.855843 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-66a1d3a5-470e-430b-97f1-b614544aa8d1 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:01.183225 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-66a1d3a5-470e-430b-97f1-b614544aa8d1 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5dbe3da6a4af181ef7302fe605fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3aa23aee3c8435c8f1f409019c5fed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:01.206937 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-66a1d3a5-470e-430b-97f1-b614544aa8d1 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] 10.222.0.33 "GET /compute/v2.1/servers/bf706904-01fc-408d-a24e-0efb6de3e74f" status: 200 len: 1270 microversion: 2.1 time: 0.374034 Oct 04 21:08:01.212433 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2754/5539] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:08:00 2022] GET /compute/v2.1/servers/bf706904-01fc-408d-a24e-0efb6de3e74f => generated 1270 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:08:01.521904 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-38cf524a-fb74-413f-8cbe-9f32ce7bcc5c tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:01.547476 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-38cf524a-fb74-413f-8cbe-9f32ce7bcc5c tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:01.562625 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-38cf524a-fb74-413f-8cbe-9f32ce7bcc5c tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:01.566752 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-38cf524a-fb74-413f-8cbe-9f32ce7bcc5c tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] 10.222.0.33 "GET /compute/v2.1/servers/05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9" status: 200 len: 1671 microversion: 2.20 time: 0.812257 Oct 04 21:08:01.592680 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2786/5540] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 21:08:00 2022] GET /compute/v2.1/servers/05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9 => generated 1671 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:08:02.236852 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-94daf9ba-c068-4db4-9088-d318d6dcc0a8 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:02.237485 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-94daf9ba-c068-4db4-9088-d318d6dcc0a8 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] [instance: bf706904-01fc-408d-a24e-0efb6de3e74f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:02.309389 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-94daf9ba-c068-4db4-9088-d318d6dcc0a8 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:02.309927 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-94daf9ba-c068-4db4-9088-d318d6dcc0a8 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:02.310405 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-94daf9ba-c068-4db4-9088-d318d6dcc0a8 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:02.315564 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-94daf9ba-c068-4db4-9088-d318d6dcc0a8 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:02.316072 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-94daf9ba-c068-4db4-9088-d318d6dcc0a8 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:02.316519 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-94daf9ba-c068-4db4-9088-d318d6dcc0a8 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:02.598455 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-94daf9ba-c068-4db4-9088-d318d6dcc0a8 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5dbe3da6a4af181ef7302fe605fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3aa23aee3c8435c8f1f409019c5fed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:02.605610 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-3a885901-da86-498b-ac12-eabca1dc0fab tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:02.606228 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-3a885901-da86-498b-ac12-eabca1dc0fab tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] [instance: 05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:02.615972 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-94daf9ba-c068-4db4-9088-d318d6dcc0a8 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] 10.222.0.33 "GET /compute/v2.1/servers/bf706904-01fc-408d-a24e-0efb6de3e74f" status: 200 len: 1336 microversion: 2.1 time: 0.383672 Oct 04 21:08:02.629110 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2755/5541] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:08:02 2022] GET /compute/v2.1/servers/bf706904-01fc-408d-a24e-0efb6de3e74f => generated 1336 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:08:02.633025 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3a885901-da86-498b-ac12-eabca1dc0fab tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:02.635845 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3a885901-da86-498b-ac12-eabca1dc0fab tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:02.637660 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3a885901-da86-498b-ac12-eabca1dc0fab tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:02.639768 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3a885901-da86-498b-ac12-eabca1dc0fab tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:02.640464 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3a885901-da86-498b-ac12-eabca1dc0fab tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:02.645261 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3a885901-da86-498b-ac12-eabca1dc0fab tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:03.322323 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-3a885901-da86-498b-ac12-eabca1dc0fab tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:03.339387 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-3a885901-da86-498b-ac12-eabca1dc0fab tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:03.353164 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-3a885901-da86-498b-ac12-eabca1dc0fab tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:03.358951 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-3a885901-da86-498b-ac12-eabca1dc0fab tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] 10.222.0.33 "GET /compute/v2.1/servers/05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9" status: 200 len: 1671 microversion: 2.20 time: 0.757974 Oct 04 21:08:03.364977 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2787/5542] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 21:08:02 2022] GET /compute/v2.1/servers/05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9 => generated 1671 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:08:03.669136 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e7f9f2ea-8545-431d-88e2-e407d80bb66b tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:03.669775 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e7f9f2ea-8545-431d-88e2-e407d80bb66b tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] [instance: bf706904-01fc-408d-a24e-0efb6de3e74f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:03.697321 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e7f9f2ea-8545-431d-88e2-e407d80bb66b tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:03.701915 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e7f9f2ea-8545-431d-88e2-e407d80bb66b tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:03.703171 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e7f9f2ea-8545-431d-88e2-e407d80bb66b tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:03.706461 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e7f9f2ea-8545-431d-88e2-e407d80bb66b tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:03.711493 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e7f9f2ea-8545-431d-88e2-e407d80bb66b tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:03.713198 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e7f9f2ea-8545-431d-88e2-e407d80bb66b tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:04.406464 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-a0d20316-671f-4945-9e00-345b7a9e6e03 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:04.407183 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-a0d20316-671f-4945-9e00-345b7a9e6e03 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] [instance: 05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:04.435337 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a0d20316-671f-4945-9e00-345b7a9e6e03 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:04.435849 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a0d20316-671f-4945-9e00-345b7a9e6e03 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:04.447752 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a0d20316-671f-4945-9e00-345b7a9e6e03 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:04.448537 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a0d20316-671f-4945-9e00-345b7a9e6e03 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:04.449017 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a0d20316-671f-4945-9e00-345b7a9e6e03 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:04.449449 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a0d20316-671f-4945-9e00-345b7a9e6e03 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:04.702044 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e7f9f2ea-8545-431d-88e2-e407d80bb66b tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5dbe3da6a4af181ef7302fe605fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3aa23aee3c8435c8f1f409019c5fed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:04.745522 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e7f9f2ea-8545-431d-88e2-e407d80bb66b tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] 10.222.0.33 "GET /compute/v2.1/servers/bf706904-01fc-408d-a24e-0efb6de3e74f" status: 200 len: 1391 microversion: 2.1 time: 1.093859 Oct 04 21:08:04.746133 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2756/5543] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:08:03 2022] GET /compute/v2.1/servers/bf706904-01fc-408d-a24e-0efb6de3e74f => generated 1391 bytes in 1095 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:08:05.772480 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-12690bca-2ea3-4a42-b8df-de07a879152f tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:05.773840 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-12690bca-2ea3-4a42-b8df-de07a879152f tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] [instance: bf706904-01fc-408d-a24e-0efb6de3e74f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:05.783063 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-12690bca-2ea3-4a42-b8df-de07a879152f tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:05.783565 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-12690bca-2ea3-4a42-b8df-de07a879152f tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:05.784046 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-12690bca-2ea3-4a42-b8df-de07a879152f tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:05.784762 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-12690bca-2ea3-4a42-b8df-de07a879152f tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:05.785225 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-12690bca-2ea3-4a42-b8df-de07a879152f tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:05.785658 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-12690bca-2ea3-4a42-b8df-de07a879152f tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:05.982725 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-a0d20316-671f-4945-9e00-345b7a9e6e03 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:05.995124 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-a0d20316-671f-4945-9e00-345b7a9e6e03 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:06.002305 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-a0d20316-671f-4945-9e00-345b7a9e6e03 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:06.011556 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-a0d20316-671f-4945-9e00-345b7a9e6e03 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] 10.222.0.33 "GET /compute/v2.1/servers/05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9" status: 200 len: 1729 microversion: 2.20 time: 1.609876 Oct 04 21:08:06.017167 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2788/5544] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 21:08:04 2022] GET /compute/v2.1/servers/05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9 => generated 1729 bytes in 1616 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:08:06.812473 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-12690bca-2ea3-4a42-b8df-de07a879152f tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5dbe3da6a4af181ef7302fe605fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3aa23aee3c8435c8f1f409019c5fed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:06.829312 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-12690bca-2ea3-4a42-b8df-de07a879152f tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] 10.222.0.33 "GET /compute/v2.1/servers/bf706904-01fc-408d-a24e-0efb6de3e74f" status: 200 len: 1391 microversion: 2.1 time: 1.060739 Oct 04 21:08:06.829974 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2757/5545] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:08:05 2022] GET /compute/v2.1/servers/bf706904-01fc-408d-a24e-0efb6de3e74f => generated 1391 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:08:07.046055 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-bbda6f31-68e4-4343-a7fd-e0304223ac98 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:07.046901 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-bbda6f31-68e4-4343-a7fd-e0304223ac98 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] [instance: 05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:07.067086 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bbda6f31-68e4-4343-a7fd-e0304223ac98 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:07.070201 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bbda6f31-68e4-4343-a7fd-e0304223ac98 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:07.073251 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bbda6f31-68e4-4343-a7fd-e0304223ac98 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:07.074053 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bbda6f31-68e4-4343-a7fd-e0304223ac98 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:07.077658 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bbda6f31-68e4-4343-a7fd-e0304223ac98 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:07.078113 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bbda6f31-68e4-4343-a7fd-e0304223ac98 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:07.156919 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=85,nova_cell1:INSERT=6,nova_cell1:UPDATE=9 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:08:07.858589 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-458b5724-27ae-4f0a-9684-b91da8a0aa5c tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:07.859355 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-458b5724-27ae-4f0a-9684-b91da8a0aa5c tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] [instance: bf706904-01fc-408d-a24e-0efb6de3e74f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:07.879225 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-458b5724-27ae-4f0a-9684-b91da8a0aa5c tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:07.879740 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-458b5724-27ae-4f0a-9684-b91da8a0aa5c tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:07.880297 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-458b5724-27ae-4f0a-9684-b91da8a0aa5c tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:07.881039 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-458b5724-27ae-4f0a-9684-b91da8a0aa5c tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:07.881800 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-458b5724-27ae-4f0a-9684-b91da8a0aa5c tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:07.882504 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-458b5724-27ae-4f0a-9684-b91da8a0aa5c tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:08.010801 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-bbda6f31-68e4-4343-a7fd-e0304223ac98 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:08.017881 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-bbda6f31-68e4-4343-a7fd-e0304223ac98 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:08.027083 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-bbda6f31-68e4-4343-a7fd-e0304223ac98 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:08.029407 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-bbda6f31-68e4-4343-a7fd-e0304223ac98 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] 10.222.0.33 "GET /compute/v2.1/servers/05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9" status: 200 len: 1729 microversion: 2.20 time: 0.987439 Oct 04 21:08:08.035698 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2789/5546] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 21:08:07 2022] GET /compute/v2.1/servers/05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9 => generated 1729 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:08:08.787385 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-458b5724-27ae-4f0a-9684-b91da8a0aa5c tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5dbe3da6a4af181ef7302fe605fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3aa23aee3c8435c8f1f409019c5fed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:08.802189 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-458b5724-27ae-4f0a-9684-b91da8a0aa5c tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] 10.222.0.33 "GET /compute/v2.1/servers/bf706904-01fc-408d-a24e-0efb6de3e74f" status: 200 len: 1391 microversion: 2.1 time: 0.943873 Oct 04 21:08:08.807549 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2758/5547] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:08:07 2022] GET /compute/v2.1/servers/bf706904-01fc-408d-a24e-0efb6de3e74f => generated 1391 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:08:09.074690 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-005e874a-a39b-40fe-be0e-0908f47715bd tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:09.075517 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-005e874a-a39b-40fe-be0e-0908f47715bd tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] [instance: 05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:09.105969 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-005e874a-a39b-40fe-be0e-0908f47715bd tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:09.107189 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-005e874a-a39b-40fe-be0e-0908f47715bd tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:09.107758 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-005e874a-a39b-40fe-be0e-0908f47715bd tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:09.108615 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-005e874a-a39b-40fe-be0e-0908f47715bd tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:09.109306 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-005e874a-a39b-40fe-be0e-0908f47715bd tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:09.117374 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-005e874a-a39b-40fe-be0e-0908f47715bd tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:09.197897 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-fe997bf5-e723-4058-aa4e-ebdbbdd905fd req-76df06a9-13d4-473f-b1ce-cbd6b6f69f0b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf706904-01fc-408d-a24e-0efb6de3e74f", "tag": "3505d3a9-94c4-427f-bb78-acac62fbee83"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:08:09.212234 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-fe997bf5-e723-4058-aa4e-ebdbbdd905fd req-76df06a9-13d4-473f-b1ce-cbd6b6f69f0b service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:09.227213 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-fe997bf5-e723-4058-aa4e-ebdbbdd905fd req-76df06a9-13d4-473f-b1ce-cbd6b6f69f0b service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:09.228028 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-fe997bf5-e723-4058-aa4e-ebdbbdd905fd req-76df06a9-13d4-473f-b1ce-cbd6b6f69f0b service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:09.246114 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-fe997bf5-e723-4058-aa4e-ebdbbdd905fd req-76df06a9-13d4-473f-b1ce-cbd6b6f69f0b service nova] Creating event network-changed:3505d3a9-94c4-427f-bb78-acac62fbee83 for instance bf706904-01fc-408d-a24e-0efb6de3e74f on n-h2-854823-8 Oct 04 21:08:09.260419 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-fe997bf5-e723-4058-aa4e-ebdbbdd905fd req-76df06a9-13d4-473f-b1ce-cbd6b6f69f0b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078154 Oct 04 21:08:09.267509 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2759/5548] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:08:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:08:09.838235 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-865e2a5d-390e-4203-8889-49362c97d8e6 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:09.844737 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-865e2a5d-390e-4203-8889-49362c97d8e6 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] [instance: bf706904-01fc-408d-a24e-0efb6de3e74f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:09.895697 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:08:09.907372 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=8 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:08:09.923825 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-865e2a5d-390e-4203-8889-49362c97d8e6 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:09.924769 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-865e2a5d-390e-4203-8889-49362c97d8e6 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:09.931474 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-865e2a5d-390e-4203-8889-49362c97d8e6 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:09.936100 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-865e2a5d-390e-4203-8889-49362c97d8e6 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:09.936571 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-865e2a5d-390e-4203-8889-49362c97d8e6 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:09.941805 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-865e2a5d-390e-4203-8889-49362c97d8e6 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:10.391156 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-865e2a5d-390e-4203-8889-49362c97d8e6 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5dbe3da6a4af181ef7302fe605fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3aa23aee3c8435c8f1f409019c5fed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:10.408562 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-005e874a-a39b-40fe-be0e-0908f47715bd tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:10.410764 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-865e2a5d-390e-4203-8889-49362c97d8e6 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] 10.222.0.33 "GET /compute/v2.1/servers/bf706904-01fc-408d-a24e-0efb6de3e74f" status: 200 len: 1391 microversion: 2.1 time: 0.574262 Oct 04 21:08:10.412014 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2760/5549] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:08:09 2022] GET /compute/v2.1/servers/bf706904-01fc-408d-a24e-0efb6de3e74f => generated 1391 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:08:10.472530 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-005e874a-a39b-40fe-be0e-0908f47715bd tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:10.475108 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-005e874a-a39b-40fe-be0e-0908f47715bd tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:10.479712 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-005e874a-a39b-40fe-be0e-0908f47715bd tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] 10.222.0.33 "GET /compute/v2.1/servers/05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9" status: 200 len: 1729 microversion: 2.20 time: 1.409479 Oct 04 21:08:10.487575 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2790/5550] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 21:08:09 2022] GET /compute/v2.1/servers/05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9 => generated 1729 bytes in 1419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:08:11.404188 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-14fc1d61-edc2-4004-a3c1-15e6d9f30bde req-ac1db587-9cd6-479d-998e-48cd7f4594ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9", "tag": "2f9889d1-cb04-4ccc-8abc-1f54eb9f493f"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:08:11.441256 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-14fc1d61-edc2-4004-a3c1-15e6d9f30bde req-ac1db587-9cd6-479d-998e-48cd7f4594ee service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:11.442207 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-14fc1d61-edc2-4004-a3c1-15e6d9f30bde req-ac1db587-9cd6-479d-998e-48cd7f4594ee service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:11.442683 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-14fc1d61-edc2-4004-a3c1-15e6d9f30bde req-ac1db587-9cd6-479d-998e-48cd7f4594ee service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:11.455929 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-e6ae390b-e2d5-4f36-a200-2d7db70f98ac tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:11.457250 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-e6ae390b-e2d5-4f36-a200-2d7db70f98ac tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] [instance: bf706904-01fc-408d-a24e-0efb6de3e74f] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:11.472368 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e6ae390b-e2d5-4f36-a200-2d7db70f98ac tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:11.473292 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e6ae390b-e2d5-4f36-a200-2d7db70f98ac tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:11.476432 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e6ae390b-e2d5-4f36-a200-2d7db70f98ac tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:11.477597 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e6ae390b-e2d5-4f36-a200-2d7db70f98ac tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:11.480093 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e6ae390b-e2d5-4f36-a200-2d7db70f98ac tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:11.481454 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e6ae390b-e2d5-4f36-a200-2d7db70f98ac tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:11.512684 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-14fc1d61-edc2-4004-a3c1-15e6d9f30bde req-ac1db587-9cd6-479d-998e-48cd7f4594ee service nova] Creating event network-changed:2f9889d1-cb04-4ccc-8abc-1f54eb9f493f for instance 05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9 on n-h1-854823-8 Oct 04 21:08:11.530668 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-14fc1d61-edc2-4004-a3c1-15e6d9f30bde req-ac1db587-9cd6-479d-998e-48cd7f4594ee service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.128693 Oct 04 21:08:11.532251 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2761/5551] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:08:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:08:11.545127 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b76db45f-338a-4a52-b6b4-9afce9207444 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:11.548520 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b76db45f-338a-4a52-b6b4-9afce9207444 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] [instance: 05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:11.556861 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b76db45f-338a-4a52-b6b4-9afce9207444 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:11.558486 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b76db45f-338a-4a52-b6b4-9afce9207444 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:11.559234 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b76db45f-338a-4a52-b6b4-9afce9207444 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:11.560217 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b76db45f-338a-4a52-b6b4-9afce9207444 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:11.561314 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b76db45f-338a-4a52-b6b4-9afce9207444 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:11.561983 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b76db45f-338a-4a52-b6b4-9afce9207444 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:12.595052 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-b76db45f-338a-4a52-b6b4-9afce9207444 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:12.605311 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-b76db45f-338a-4a52-b6b4-9afce9207444 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:12.607161 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-b76db45f-338a-4a52-b6b4-9afce9207444 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:12.608577 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b76db45f-338a-4a52-b6b4-9afce9207444 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] 10.222.0.33 "GET /compute/v2.1/servers/05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9" status: 200 len: 1729 microversion: 2.20 time: 1.075048 Oct 04 21:08:12.609724 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2762/5552] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 21:08:11 2022] GET /compute/v2.1/servers/05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9 => generated 1729 bytes in 1077 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:08:12.633704 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-e6ae390b-e2d5-4f36-a200-2d7db70f98ac tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5dbe3da6a4af181ef7302fe605fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3aa23aee3c8435c8f1f409019c5fed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:12.660300 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-e6ae390b-e2d5-4f36-a200-2d7db70f98ac tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] 10.222.0.33 "GET /compute/v2.1/servers/bf706904-01fc-408d-a24e-0efb6de3e74f" status: 200 len: 1391 microversion: 2.1 time: 1.208276 Oct 04 21:08:12.662038 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2791/5553] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:08:11 2022] GET /compute/v2.1/servers/bf706904-01fc-408d-a24e-0efb6de3e74f => generated 1391 bytes in 1211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:08:13.640832 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-fa43b934-a37b-48ec-a84f-416ec9133c0d tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:13.642264 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-fa43b934-a37b-48ec-a84f-416ec9133c0d tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] [instance: 05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:13.661611 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fa43b934-a37b-48ec-a84f-416ec9133c0d tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:13.662316 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fa43b934-a37b-48ec-a84f-416ec9133c0d tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:13.664551 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fa43b934-a37b-48ec-a84f-416ec9133c0d tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:13.665528 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fa43b934-a37b-48ec-a84f-416ec9133c0d tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:13.668904 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fa43b934-a37b-48ec-a84f-416ec9133c0d tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:13.669557 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fa43b934-a37b-48ec-a84f-416ec9133c0d tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:13.711978 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-307a0177-d909-4c32-9cf8-3f5b760500c9 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:13.713343 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-307a0177-d909-4c32-9cf8-3f5b760500c9 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] [instance: bf706904-01fc-408d-a24e-0efb6de3e74f] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:13.726067 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-307a0177-d909-4c32-9cf8-3f5b760500c9 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:13.729774 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-307a0177-d909-4c32-9cf8-3f5b760500c9 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:13.730889 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-307a0177-d909-4c32-9cf8-3f5b760500c9 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:13.734019 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-307a0177-d909-4c32-9cf8-3f5b760500c9 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:13.736010 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-307a0177-d909-4c32-9cf8-3f5b760500c9 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:13.736699 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-307a0177-d909-4c32-9cf8-3f5b760500c9 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:15.004175 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-307a0177-d909-4c32-9cf8-3f5b760500c9 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5dbe3da6a4af181ef7302fe605fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3aa23aee3c8435c8f1f409019c5fed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:15.013895 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-307a0177-d909-4c32-9cf8-3f5b760500c9 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] 10.222.0.33 "GET /compute/v2.1/servers/bf706904-01fc-408d-a24e-0efb6de3e74f" status: 200 len: 1391 microversion: 2.1 time: 1.310124 Oct 04 21:08:15.023950 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2792/5554] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:08:13 2022] GET /compute/v2.1/servers/bf706904-01fc-408d-a24e-0efb6de3e74f => generated 1391 bytes in 1320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:08:15.025079 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-fa43b934-a37b-48ec-a84f-416ec9133c0d tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:15.042420 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-fa43b934-a37b-48ec-a84f-416ec9133c0d tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:15.048593 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-fa43b934-a37b-48ec-a84f-416ec9133c0d tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:15.049788 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-fa43b934-a37b-48ec-a84f-416ec9133c0d tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] 10.222.0.33 "GET /compute/v2.1/servers/05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9" status: 200 len: 1729 microversion: 2.20 time: 1.413625 Oct 04 21:08:15.071584 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2763/5555] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 21:08:13 2022] GET /compute/v2.1/servers/05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9 => generated 1729 bytes in 1436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:08:16.056117 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-55e1ca40-6a37-4bcb-8ac4-a11f5c84b69e tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:16.056747 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-55e1ca40-6a37-4bcb-8ac4-a11f5c84b69e tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] [instance: bf706904-01fc-408d-a24e-0efb6de3e74f] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:16.072930 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-55e1ca40-6a37-4bcb-8ac4-a11f5c84b69e tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:16.074521 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-55e1ca40-6a37-4bcb-8ac4-a11f5c84b69e tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:16.075190 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-55e1ca40-6a37-4bcb-8ac4-a11f5c84b69e tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:16.077816 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-55e1ca40-6a37-4bcb-8ac4-a11f5c84b69e tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:16.078519 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-55e1ca40-6a37-4bcb-8ac4-a11f5c84b69e tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:16.079929 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-55e1ca40-6a37-4bcb-8ac4-a11f5c84b69e tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:16.088232 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b1413c06-8242-40d9-9b49-1fe3a9d98075 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:16.089489 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b1413c06-8242-40d9-9b49-1fe3a9d98075 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] [instance: 05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:16.118476 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b1413c06-8242-40d9-9b49-1fe3a9d98075 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:16.119255 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b1413c06-8242-40d9-9b49-1fe3a9d98075 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:16.119894 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b1413c06-8242-40d9-9b49-1fe3a9d98075 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:16.120875 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b1413c06-8242-40d9-9b49-1fe3a9d98075 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:16.133516 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b1413c06-8242-40d9-9b49-1fe3a9d98075 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:16.137363 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b1413c06-8242-40d9-9b49-1fe3a9d98075 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:17.057426 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-55e1ca40-6a37-4bcb-8ac4-a11f5c84b69e tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5dbe3da6a4af181ef7302fe605fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3aa23aee3c8435c8f1f409019c5fed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:17.075062 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-55e1ca40-6a37-4bcb-8ac4-a11f5c84b69e tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] 10.222.0.33 "GET /compute/v2.1/servers/bf706904-01fc-408d-a24e-0efb6de3e74f" status: 200 len: 1391 microversion: 2.1 time: 1.024661 Oct 04 21:08:17.075640 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2793/5556] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:08:16 2022] GET /compute/v2.1/servers/bf706904-01fc-408d-a24e-0efb6de3e74f => generated 1391 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:08:17.352145 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-b1413c06-8242-40d9-9b49-1fe3a9d98075 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:17.360927 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-b1413c06-8242-40d9-9b49-1fe3a9d98075 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:17.371622 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-b1413c06-8242-40d9-9b49-1fe3a9d98075 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:17.372904 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b1413c06-8242-40d9-9b49-1fe3a9d98075 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] 10.222.0.33 "GET /compute/v2.1/servers/05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9" status: 200 len: 1729 microversion: 2.20 time: 1.289382 Oct 04 21:08:17.373498 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2764/5557] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 21:08:16 2022] GET /compute/v2.1/servers/05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9 => generated 1729 bytes in 1291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:08:18.117275 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-12344285-ea6a-4973-96a7-e06f274fd284 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:18.117899 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-12344285-ea6a-4973-96a7-e06f274fd284 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] [instance: bf706904-01fc-408d-a24e-0efb6de3e74f] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:18.139220 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-12344285-ea6a-4973-96a7-e06f274fd284 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:18.146807 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-12344285-ea6a-4973-96a7-e06f274fd284 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:18.149683 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-12344285-ea6a-4973-96a7-e06f274fd284 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:18.156243 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-12344285-ea6a-4973-96a7-e06f274fd284 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:18.159272 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-12344285-ea6a-4973-96a7-e06f274fd284 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:18.161986 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-12344285-ea6a-4973-96a7-e06f274fd284 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:18.403312 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7e635c7b-d7ba-48c4-9ffd-6cf253d68175 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:18.403947 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-7e635c7b-d7ba-48c4-9ffd-6cf253d68175 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] [instance: 05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:18.428874 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7e635c7b-d7ba-48c4-9ffd-6cf253d68175 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:18.430205 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7e635c7b-d7ba-48c4-9ffd-6cf253d68175 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:18.430764 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7e635c7b-d7ba-48c4-9ffd-6cf253d68175 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:18.431502 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7e635c7b-d7ba-48c4-9ffd-6cf253d68175 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:18.431978 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7e635c7b-d7ba-48c4-9ffd-6cf253d68175 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:18.432411 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7e635c7b-d7ba-48c4-9ffd-6cf253d68175 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:18.806942 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-12344285-ea6a-4973-96a7-e06f274fd284 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5dbe3da6a4af181ef7302fe605fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3aa23aee3c8435c8f1f409019c5fed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:18.823258 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-12344285-ea6a-4973-96a7-e06f274fd284 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] 10.222.0.33 "GET /compute/v2.1/servers/bf706904-01fc-408d-a24e-0efb6de3e74f" status: 200 len: 1391 microversion: 2.1 time: 0.710113 Oct 04 21:08:18.835603 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2794/5558] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:08:18 2022] GET /compute/v2.1/servers/bf706904-01fc-408d-a24e-0efb6de3e74f => generated 1391 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:08:19.003426 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-7e635c7b-d7ba-48c4-9ffd-6cf253d68175 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:19.011634 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=78 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:08:19.028070 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-7e635c7b-d7ba-48c4-9ffd-6cf253d68175 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:19.041384 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-7e635c7b-d7ba-48c4-9ffd-6cf253d68175 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:19.044872 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-7e635c7b-d7ba-48c4-9ffd-6cf253d68175 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] 10.222.0.33 "GET /compute/v2.1/servers/05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9" status: 200 len: 1729 microversion: 2.20 time: 0.647510 Oct 04 21:08:19.045489 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2765/5559] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 21:08:18 2022] GET /compute/v2.1/servers/05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9 => generated 1729 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:08:19.345320 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-e82ab464-bf4e-4625-aa36-e14fcc341e0b req-d6bc0198-5654-45a8-a829-8bdfe26527a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf706904-01fc-408d-a24e-0efb6de3e74f", "name": "network-vif-plugged", "status": "completed", "tag": "3505d3a9-94c4-427f-bb78-acac62fbee83"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:08:19.384647 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-e82ab464-bf4e-4625-aa36-e14fcc341e0b req-d6bc0198-5654-45a8-a829-8bdfe26527a4 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:19.384647 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-e82ab464-bf4e-4625-aa36-e14fcc341e0b req-d6bc0198-5654-45a8-a829-8bdfe26527a4 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:19.385053 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-e82ab464-bf4e-4625-aa36-e14fcc341e0b req-d6bc0198-5654-45a8-a829-8bdfe26527a4 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:19.453209 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-e82ab464-bf4e-4625-aa36-e14fcc341e0b req-d6bc0198-5654-45a8-a829-8bdfe26527a4 service nova] Creating event network-vif-plugged:3505d3a9-94c4-427f-bb78-acac62fbee83 for instance bf706904-01fc-408d-a24e-0efb6de3e74f on n-h2-854823-8 Oct 04 21:08:19.474693 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-e82ab464-bf4e-4625-aa36-e14fcc341e0b req-d6bc0198-5654-45a8-a829-8bdfe26527a4 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133611 Oct 04 21:08:19.476575 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2795/5560] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:08:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:08:19.858254 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e54ac02b-9391-4e6c-98f8-02ec7f29242a tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:19.859742 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e54ac02b-9391-4e6c-98f8-02ec7f29242a tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] [instance: bf706904-01fc-408d-a24e-0efb6de3e74f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:19.874868 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e54ac02b-9391-4e6c-98f8-02ec7f29242a tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:19.884607 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e54ac02b-9391-4e6c-98f8-02ec7f29242a tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:19.885755 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e54ac02b-9391-4e6c-98f8-02ec7f29242a tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:19.887278 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e54ac02b-9391-4e6c-98f8-02ec7f29242a tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:19.889882 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e54ac02b-9391-4e6c-98f8-02ec7f29242a tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:19.893772 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e54ac02b-9391-4e6c-98f8-02ec7f29242a tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:20.084565 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-f09aa426-d521-4b6b-92be-9f8063068672 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:20.086112 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-f09aa426-d521-4b6b-92be-9f8063068672 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] [instance: 05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:20.106908 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f09aa426-d521-4b6b-92be-9f8063068672 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:20.119375 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f09aa426-d521-4b6b-92be-9f8063068672 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:20.120036 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f09aa426-d521-4b6b-92be-9f8063068672 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:20.121004 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f09aa426-d521-4b6b-92be-9f8063068672 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:20.121488 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f09aa426-d521-4b6b-92be-9f8063068672 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:20.121920 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f09aa426-d521-4b6b-92be-9f8063068672 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:20.667019 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-f09aa426-d521-4b6b-92be-9f8063068672 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:20.684936 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-f09aa426-d521-4b6b-92be-9f8063068672 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:20.704514 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-f09aa426-d521-4b6b-92be-9f8063068672 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:20.711200 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-f09aa426-d521-4b6b-92be-9f8063068672 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] 10.222.0.33 "GET /compute/v2.1/servers/05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9" status: 200 len: 1729 microversion: 2.20 time: 0.631548 Oct 04 21:08:20.719996 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2796/5561] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 21:08:20 2022] GET /compute/v2.1/servers/05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9 => generated 1729 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:08:20.736758 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e54ac02b-9391-4e6c-98f8-02ec7f29242a tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5dbe3da6a4af181ef7302fe605fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3aa23aee3c8435c8f1f409019c5fed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:20.755251 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e54ac02b-9391-4e6c-98f8-02ec7f29242a tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] 10.222.0.33 "GET /compute/v2.1/servers/bf706904-01fc-408d-a24e-0efb6de3e74f" status: 200 len: 1391 microversion: 2.1 time: 0.900089 Oct 04 21:08:20.757903 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2766/5562] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:08:19 2022] GET /compute/v2.1/servers/bf706904-01fc-408d-a24e-0efb6de3e74f => generated 1391 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:08:21.742068 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-d169179d-aa0f-4b93-b0cf-0ce0a2eb1b72 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:21.743204 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-d169179d-aa0f-4b93-b0cf-0ce0a2eb1b72 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] [instance: 05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:21.765060 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d169179d-aa0f-4b93-b0cf-0ce0a2eb1b72 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:21.769143 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d169179d-aa0f-4b93-b0cf-0ce0a2eb1b72 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:21.770917 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d169179d-aa0f-4b93-b0cf-0ce0a2eb1b72 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:21.775920 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d169179d-aa0f-4b93-b0cf-0ce0a2eb1b72 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:21.780578 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d169179d-aa0f-4b93-b0cf-0ce0a2eb1b72 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:21.781042 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d169179d-aa0f-4b93-b0cf-0ce0a2eb1b72 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:21.808640 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-3ed4613e-7e1c-4708-b893-905d0efd58aa tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:21.809477 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-3ed4613e-7e1c-4708-b893-905d0efd58aa tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] [instance: bf706904-01fc-408d-a24e-0efb6de3e74f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:21.865572 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3ed4613e-7e1c-4708-b893-905d0efd58aa tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:21.866726 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3ed4613e-7e1c-4708-b893-905d0efd58aa tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:21.873287 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3ed4613e-7e1c-4708-b893-905d0efd58aa tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:21.885200 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3ed4613e-7e1c-4708-b893-905d0efd58aa tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:21.892592 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3ed4613e-7e1c-4708-b893-905d0efd58aa tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:21.893340 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3ed4613e-7e1c-4708-b893-905d0efd58aa tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:22.355510 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-d169179d-aa0f-4b93-b0cf-0ce0a2eb1b72 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:22.364988 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-d169179d-aa0f-4b93-b0cf-0ce0a2eb1b72 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:22.375906 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-d169179d-aa0f-4b93-b0cf-0ce0a2eb1b72 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:22.379438 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-d169179d-aa0f-4b93-b0cf-0ce0a2eb1b72 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] 10.222.0.33 "GET /compute/v2.1/servers/05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9" status: 200 len: 1729 microversion: 2.20 time: 0.642085 Oct 04 21:08:22.387971 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2797/5563] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 21:08:21 2022] GET /compute/v2.1/servers/05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9 => generated 1729 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:08:22.569544 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-3ed4613e-7e1c-4708-b893-905d0efd58aa tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5dbe3da6a4af181ef7302fe605fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3aa23aee3c8435c8f1f409019c5fed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:22.583549 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-3ed4613e-7e1c-4708-b893-905d0efd58aa tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] 10.222.0.33 "GET /compute/v2.1/servers/bf706904-01fc-408d-a24e-0efb6de3e74f" status: 200 len: 1564 microversion: 2.1 time: 0.779809 Oct 04 21:08:22.588679 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2767/5564] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:08:21 2022] GET /compute/v2.1/servers/bf706904-01fc-408d-a24e-0efb6de3e74f => generated 1564 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:08:22.622549 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-b124b710-741d-48ed-acc7-ccba764f984b tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:22.626915 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-b124b710-741d-48ed-acc7-ccba764f984b tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] [instance: bf706904-01fc-408d-a24e-0efb6de3e74f] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:22.660043 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b124b710-741d-48ed-acc7-ccba764f984b tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:22.675586 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b124b710-741d-48ed-acc7-ccba764f984b tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:22.676625 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b124b710-741d-48ed-acc7-ccba764f984b tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:22.677601 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b124b710-741d-48ed-acc7-ccba764f984b tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:22.679170 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b124b710-741d-48ed-acc7-ccba764f984b tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:22.679816 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b124b710-741d-48ed-acc7-ccba764f984b tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:23.073807 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-b124b710-741d-48ed-acc7-ccba764f984b tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5dbe3da6a4af181ef7302fe605fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3aa23aee3c8435c8f1f409019c5fed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:23.094209 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-b124b710-741d-48ed-acc7-ccba764f984b tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] 10.222.0.33 "GET /compute/v2.1/servers/bf706904-01fc-408d-a24e-0efb6de3e74f" status: 200 len: 1564 microversion: 2.1 time: 0.474348 Oct 04 21:08:23.095251 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2798/5565] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:08:22 2022] GET /compute/v2.1/servers/bf706904-01fc-408d-a24e-0efb6de3e74f => generated 1564 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:08:23.418801 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-38e5c96c-165b-409a-95ff-9c5795a97317 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:23.420118 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-38e5c96c-165b-409a-95ff-9c5795a97317 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] [instance: 05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:23.437387 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-38e5c96c-165b-409a-95ff-9c5795a97317 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:23.438059 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-38e5c96c-165b-409a-95ff-9c5795a97317 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:23.438675 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-38e5c96c-165b-409a-95ff-9c5795a97317 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:23.439841 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-38e5c96c-165b-409a-95ff-9c5795a97317 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:23.440542 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-38e5c96c-165b-409a-95ff-9c5795a97317 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:23.441789 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-38e5c96c-165b-409a-95ff-9c5795a97317 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:24.233162 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-38e5c96c-165b-409a-95ff-9c5795a97317 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:24.252252 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-38e5c96c-165b-409a-95ff-9c5795a97317 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:24.260717 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-38e5c96c-165b-409a-95ff-9c5795a97317 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:24.267821 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-38e5c96c-165b-409a-95ff-9c5795a97317 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] 10.222.0.33 "GET /compute/v2.1/servers/05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9" status: 200 len: 1729 microversion: 2.20 time: 0.852062 Oct 04 21:08:24.272413 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2768/5566] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 21:08:23 2022] GET /compute/v2.1/servers/05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9 => generated 1729 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:08:25.306192 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-90594aca-b680-40ec-b420-4a24cdef617c tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:25.306840 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-90594aca-b680-40ec-b420-4a24cdef617c tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] [instance: 05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:25.336041 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-90594aca-b680-40ec-b420-4a24cdef617c tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:25.336929 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-90594aca-b680-40ec-b420-4a24cdef617c tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:25.337546 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-90594aca-b680-40ec-b420-4a24cdef617c tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:25.339704 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-90594aca-b680-40ec-b420-4a24cdef617c tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:25.340902 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-90594aca-b680-40ec-b420-4a24cdef617c tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:25.345519 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-90594aca-b680-40ec-b420-4a24cdef617c tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:26.054723 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-90594aca-b680-40ec-b420-4a24cdef617c tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:26.054723 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-90594aca-b680-40ec-b420-4a24cdef617c tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:26.054723 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-90594aca-b680-40ec-b420-4a24cdef617c tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:26.076874 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-90594aca-b680-40ec-b420-4a24cdef617c tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] 10.222.0.33 "GET /compute/v2.1/servers/05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9" status: 200 len: 1729 microversion: 2.20 time: 0.772705 Oct 04 21:08:26.077511 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2799/5567] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 21:08:25 2022] GET /compute/v2.1/servers/05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9 => generated 1729 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:08:27.109130 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-59eaf2e3-8316-4230-a2db-7343777ec4d2 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:27.110327 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-59eaf2e3-8316-4230-a2db-7343777ec4d2 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] [instance: 05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:27.117890 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=3 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:08:27.141090 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-59eaf2e3-8316-4230-a2db-7343777ec4d2 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:27.157022 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-59eaf2e3-8316-4230-a2db-7343777ec4d2 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:27.157442 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-59eaf2e3-8316-4230-a2db-7343777ec4d2 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:27.158439 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-59eaf2e3-8316-4230-a2db-7343777ec4d2 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:27.158759 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-59eaf2e3-8316-4230-a2db-7343777ec4d2 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:27.171393 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-59eaf2e3-8316-4230-a2db-7343777ec4d2 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:27.585160 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-59eaf2e3-8316-4230-a2db-7343777ec4d2 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:27.597253 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-59eaf2e3-8316-4230-a2db-7343777ec4d2 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:27.601164 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-59eaf2e3-8316-4230-a2db-7343777ec4d2 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:27.604289 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-59eaf2e3-8316-4230-a2db-7343777ec4d2 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] 10.222.0.33 "GET /compute/v2.1/servers/05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9" status: 200 len: 1729 microversion: 2.20 time: 0.499831 Oct 04 21:08:27.623014 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2769/5568] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 21:08:27 2022] GET /compute/v2.1/servers/05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9 => generated 1729 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:08:28.637986 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-f3230b2e-90bc-44cc-99dd-ea19ffc5fc50 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:28.638817 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-f3230b2e-90bc-44cc-99dd-ea19ffc5fc50 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] [instance: 05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:28.661681 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:08:28.668431 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f3230b2e-90bc-44cc-99dd-ea19ffc5fc50 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:28.669142 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f3230b2e-90bc-44cc-99dd-ea19ffc5fc50 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:28.669753 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f3230b2e-90bc-44cc-99dd-ea19ffc5fc50 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:28.672689 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f3230b2e-90bc-44cc-99dd-ea19ffc5fc50 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:28.673336 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f3230b2e-90bc-44cc-99dd-ea19ffc5fc50 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:28.673929 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f3230b2e-90bc-44cc-99dd-ea19ffc5fc50 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:29.113583 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-f3230b2e-90bc-44cc-99dd-ea19ffc5fc50 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:29.153428 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-f3230b2e-90bc-44cc-99dd-ea19ffc5fc50 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:29.169858 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-f3230b2e-90bc-44cc-99dd-ea19ffc5fc50 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:29.171171 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-f3230b2e-90bc-44cc-99dd-ea19ffc5fc50 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] 10.222.0.33 "GET /compute/v2.1/servers/05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9" status: 200 len: 1729 microversion: 2.20 time: 0.539429 Oct 04 21:08:29.177939 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2800/5569] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 21:08:28 2022] GET /compute/v2.1/servers/05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9 => generated 1729 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:08:29.729451 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-536db966-d83e-4145-accf-b9a94811ecbe tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:29.730079 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-536db966-d83e-4145-accf-b9a94811ecbe tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] [instance: bf706904-01fc-408d-a24e-0efb6de3e74f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:29.761918 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-536db966-d83e-4145-accf-b9a94811ecbe tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:29.764731 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-536db966-d83e-4145-accf-b9a94811ecbe tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:29.773328 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-536db966-d83e-4145-accf-b9a94811ecbe tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:29.784678 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-536db966-d83e-4145-accf-b9a94811ecbe tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:29.785645 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-536db966-d83e-4145-accf-b9a94811ecbe tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:29.786853 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-536db966-d83e-4145-accf-b9a94811ecbe tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:29.789384 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-58e890c5-289b-4f38-a614-35f1c4b38ced req-18a9317a-9b3c-4c00-9847-56c2ab9894ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf706904-01fc-408d-a24e-0efb6de3e74f", "tag": "3505d3a9-94c4-427f-bb78-acac62fbee83"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:08:29.835373 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-58e890c5-289b-4f38-a614-35f1c4b38ced req-18a9317a-9b3c-4c00-9847-56c2ab9894ad service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:29.835883 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-58e890c5-289b-4f38-a614-35f1c4b38ced req-18a9317a-9b3c-4c00-9847-56c2ab9894ad service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:29.836329 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-58e890c5-289b-4f38-a614-35f1c4b38ced req-18a9317a-9b3c-4c00-9847-56c2ab9894ad service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:29.932003 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-58e890c5-289b-4f38-a614-35f1c4b38ced req-18a9317a-9b3c-4c00-9847-56c2ab9894ad service nova] Creating event network-changed:3505d3a9-94c4-427f-bb78-acac62fbee83 for instance bf706904-01fc-408d-a24e-0efb6de3e74f on n-h2-854823-8 Oct 04 21:08:29.962534 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-58e890c5-289b-4f38-a614-35f1c4b38ced req-18a9317a-9b3c-4c00-9847-56c2ab9894ad service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.177534 Oct 04 21:08:29.963156 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2801/5570] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:08:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:08:30.242637 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-1c41d663-2ea7-4b79-92da-07f1b255bf67 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:30.243360 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-1c41d663-2ea7-4b79-92da-07f1b255bf67 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] [instance: 05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:30.269503 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1c41d663-2ea7-4b79-92da-07f1b255bf67 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:30.273257 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1c41d663-2ea7-4b79-92da-07f1b255bf67 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:30.279704 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1c41d663-2ea7-4b79-92da-07f1b255bf67 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:30.288653 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1c41d663-2ea7-4b79-92da-07f1b255bf67 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:30.289767 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1c41d663-2ea7-4b79-92da-07f1b255bf67 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:30.290482 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1c41d663-2ea7-4b79-92da-07f1b255bf67 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:30.802929 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-536db966-d83e-4145-accf-b9a94811ecbe tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5dbe3da6a4af181ef7302fe605fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3aa23aee3c8435c8f1f409019c5fed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:30.817384 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-536db966-d83e-4145-accf-b9a94811ecbe tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] 10.222.0.33 "GET /compute/v2.1/servers/bf706904-01fc-408d-a24e-0efb6de3e74f" status: 200 len: 1564 microversion: 2.1 time: 1.092059 Oct 04 21:08:30.829947 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2770/5571] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:08:29 2022] GET /compute/v2.1/servers/bf706904-01fc-408d-a24e-0efb6de3e74f => generated 1564 bytes in 1109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:08:31.101586 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-1c41d663-2ea7-4b79-92da-07f1b255bf67 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:31.118227 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-1c41d663-2ea7-4b79-92da-07f1b255bf67 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:31.121016 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-1c41d663-2ea7-4b79-92da-07f1b255bf67 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:31.125488 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-1c41d663-2ea7-4b79-92da-07f1b255bf67 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] 10.222.0.33 "GET /compute/v2.1/servers/05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9" status: 200 len: 1729 microversion: 2.20 time: 0.890257 Oct 04 21:08:31.130719 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2802/5572] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 21:08:30 2022] GET /compute/v2.1/servers/05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9 => generated 1729 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:08:32.159360 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-49254e62-770f-4826-b5fb-706e6066ce7e tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:32.160638 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-49254e62-770f-4826-b5fb-706e6066ce7e tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] [instance: 05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:32.182491 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-49254e62-770f-4826-b5fb-706e6066ce7e tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:32.182962 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-49254e62-770f-4826-b5fb-706e6066ce7e tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:32.183491 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-49254e62-770f-4826-b5fb-706e6066ce7e tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:32.184223 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-49254e62-770f-4826-b5fb-706e6066ce7e tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:32.184690 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-49254e62-770f-4826-b5fb-706e6066ce7e tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:32.185235 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-49254e62-770f-4826-b5fb-706e6066ce7e tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:32.873263 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-49254e62-770f-4826-b5fb-706e6066ce7e tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:32.882398 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-49254e62-770f-4826-b5fb-706e6066ce7e tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:32.890474 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-49254e62-770f-4826-b5fb-706e6066ce7e tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:32.894006 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-49254e62-770f-4826-b5fb-706e6066ce7e tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] 10.222.0.33 "GET /compute/v2.1/servers/05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9" status: 200 len: 1729 microversion: 2.20 time: 0.738599 Oct 04 21:08:32.895060 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2771/5573] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 21:08:32 2022] GET /compute/v2.1/servers/05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9 => generated 1729 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:08:33.636071 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-8a7aa74f-63b0-4416-855b-d820e06239d0 tempest-VolumesNegativeTest-977149100 tempest-VolumesNegativeTest-977149100-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1952842180", "imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63", "flavorRef": "452"}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:08:33.762558 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.network.neutron [None req-8a7aa74f-63b0-4416-855b-d820e06239d0 tempest-VolumesNegativeTest-977149100 tempest-VolumesNegativeTest-977149100-project] validate_networks() for None {{(pid=128802) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:08:33.926763 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-bb8a6a8b-9b0f-4971-938d-3f29e1f5dca0 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:33.927366 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-bb8a6a8b-9b0f-4971-938d-3f29e1f5dca0 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] [instance: 05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:33.950491 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bb8a6a8b-9b0f-4971-938d-3f29e1f5dca0 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:33.962483 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bb8a6a8b-9b0f-4971-938d-3f29e1f5dca0 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:33.963103 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bb8a6a8b-9b0f-4971-938d-3f29e1f5dca0 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:33.963882 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bb8a6a8b-9b0f-4971-938d-3f29e1f5dca0 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:33.964375 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bb8a6a8b-9b0f-4971-938d-3f29e1f5dca0 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:33.964772 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bb8a6a8b-9b0f-4971-938d-3f29e1f5dca0 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:34.338277 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-bb8a6a8b-9b0f-4971-938d-3f29e1f5dca0 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:34.350817 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-bb8a6a8b-9b0f-4971-938d-3f29e1f5dca0 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:34.362797 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-bb8a6a8b-9b0f-4971-938d-3f29e1f5dca0 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:34.364327 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-bb8a6a8b-9b0f-4971-938d-3f29e1f5dca0 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] 10.222.0.33 "GET /compute/v2.1/servers/05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9" status: 200 len: 1729 microversion: 2.20 time: 0.444783 Oct 04 21:08:34.392892 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2772/5574] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 21:08:33 2022] GET /compute/v2.1/servers/05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9 => generated 1729 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:08:34.495800 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-8a7aa74f-63b0-4416-855b-d820e06239d0 tempest-VolumesNegativeTest-977149100 tempest-VolumesNegativeTest-977149100-project] Flavor limits 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:08:34.496416 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-8a7aa74f-63b0-4416-855b-d820e06239d0 tempest-VolumesNegativeTest-977149100 tempest-VolumesNegativeTest-977149100-project] Image limits 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:08:34.497353 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-8a7aa74f-63b0-4416-855b-d820e06239d0 tempest-VolumesNegativeTest-977149100 tempest-VolumesNegativeTest-977149100-project] Flavor pref 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:08:34.498135 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-8a7aa74f-63b0-4416-855b-d820e06239d0 tempest-VolumesNegativeTest-977149100 tempest-VolumesNegativeTest-977149100-project] Image pref 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:08:34.498765 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-8a7aa74f-63b0-4416-855b-d820e06239d0 tempest-VolumesNegativeTest-977149100 tempest-VolumesNegativeTest-977149100-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:08:34.529568 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8a7aa74f-63b0-4416-855b-d820e06239d0 tempest-VolumesNegativeTest-977149100 tempest-VolumesNegativeTest-977149100-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:34.531491 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8a7aa74f-63b0-4416-855b-d820e06239d0 tempest-VolumesNegativeTest-977149100 tempest-VolumesNegativeTest-977149100-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:34.533303 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8a7aa74f-63b0-4416-855b-d820e06239d0 tempest-VolumesNegativeTest-977149100 tempest-VolumesNegativeTest-977149100-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:34.535083 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8a7aa74f-63b0-4416-855b-d820e06239d0 tempest-VolumesNegativeTest-977149100 tempest-VolumesNegativeTest-977149100-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:34.537753 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8a7aa74f-63b0-4416-855b-d820e06239d0 tempest-VolumesNegativeTest-977149100 tempest-VolumesNegativeTest-977149100-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:34.538972 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8a7aa74f-63b0-4416-855b-d820e06239d0 tempest-VolumesNegativeTest-977149100 tempest-VolumesNegativeTest-977149100-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:34.595760 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-8a7aa74f-63b0-4416-855b-d820e06239d0 tempest-VolumesNegativeTest-977149100 tempest-VolumesNegativeTest-977149100-project] Getting quotas for project f259e7a121184313836a68277c2a08df. Resources: {'ram', 'instances', 'cores'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:08:34.606904 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-8a7aa74f-63b0-4416-855b-d820e06239d0 tempest-VolumesNegativeTest-977149100 tempest-VolumesNegativeTest-977149100-project] Getting quotas for user 37b3399a2b4345cdb88cf19b13c3a939 and project f259e7a121184313836a68277c2a08df. Resources: {'ram', 'instances', 'cores'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:08:34.649153 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-8a7aa74f-63b0-4416-855b-d820e06239d0 tempest-VolumesNegativeTest-977149100 tempest-VolumesNegativeTest-977149100-project] Going to run 1 instances... {{(pid=128802) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:08:34.656520 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-8a7aa74f-63b0-4416-855b-d820e06239d0 tempest-VolumesNegativeTest-977149100 tempest-VolumesNegativeTest-977149100-project] [instance: 3dfe17e2-88e8-49d3-b21a-f0f4cd97da75] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='15b24725-0c99-4bcf-b1fb-907cdf8e2d63',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128802) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:08:34.799458 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-8a7aa74f-63b0-4416-855b-d820e06239d0 tempest-VolumesNegativeTest-977149100 tempest-VolumesNegativeTest-977149100-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.168211 Oct 04 21:08:34.801619 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2803/5575] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 21:08:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 1171 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:08:34.813862 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-3f069198-55ef-4bd0-9263-ba47a28b7220 tempest-VolumesNegativeTest-977149100 tempest-VolumesNegativeTest-977149100-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:34.814528 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-3f069198-55ef-4bd0-9263-ba47a28b7220 tempest-VolumesNegativeTest-977149100 tempest-VolumesNegativeTest-977149100-project] [instance: 3dfe17e2-88e8-49d3-b21a-f0f4cd97da75] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:35.004199 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-3f069198-55ef-4bd0-9263-ba47a28b7220 tempest-VolumesNegativeTest-977149100 tempest-VolumesNegativeTest-977149100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b3399a2b4345cdb88cf19b13c3a939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f259e7a121184313836a68277c2a08df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:35.017440 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-3f069198-55ef-4bd0-9263-ba47a28b7220 tempest-VolumesNegativeTest-977149100 tempest-VolumesNegativeTest-977149100-project] 10.222.0.33 "GET /compute/v2.1/servers/3dfe17e2-88e8-49d3-b21a-f0f4cd97da75" status: 200 len: 1215 microversion: 2.1 time: 0.207574 Oct 04 21:08:35.018238 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2773/5576] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:08:34 2022] GET /compute/v2.1/servers/3dfe17e2-88e8-49d3-b21a-f0f4cd97da75 => generated 1215 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:08:35.394987 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-5c93e36d-7e28-4f5b-8d13-699b9ac93d0d tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:35.395627 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-5c93e36d-7e28-4f5b-8d13-699b9ac93d0d tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] [instance: 05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:35.417971 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5c93e36d-7e28-4f5b-8d13-699b9ac93d0d tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:35.418516 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5c93e36d-7e28-4f5b-8d13-699b9ac93d0d tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:35.419003 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5c93e36d-7e28-4f5b-8d13-699b9ac93d0d tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:35.424311 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5c93e36d-7e28-4f5b-8d13-699b9ac93d0d tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:35.425007 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5c93e36d-7e28-4f5b-8d13-699b9ac93d0d tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:35.425464 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5c93e36d-7e28-4f5b-8d13-699b9ac93d0d tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:36.049128 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ee1cd88c-cf4b-4219-af0c-198931c1dd6d tempest-VolumesNegativeTest-977149100 tempest-VolumesNegativeTest-977149100-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:36.049559 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ee1cd88c-cf4b-4219-af0c-198931c1dd6d tempest-VolumesNegativeTest-977149100 tempest-VolumesNegativeTest-977149100-project] [instance: 3dfe17e2-88e8-49d3-b21a-f0f4cd97da75] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:36.074269 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ee1cd88c-cf4b-4219-af0c-198931c1dd6d tempest-VolumesNegativeTest-977149100 tempest-VolumesNegativeTest-977149100-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:36.074934 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ee1cd88c-cf4b-4219-af0c-198931c1dd6d tempest-VolumesNegativeTest-977149100 tempest-VolumesNegativeTest-977149100-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:36.075388 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ee1cd88c-cf4b-4219-af0c-198931c1dd6d tempest-VolumesNegativeTest-977149100 tempest-VolumesNegativeTest-977149100-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:36.076114 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ee1cd88c-cf4b-4219-af0c-198931c1dd6d tempest-VolumesNegativeTest-977149100 tempest-VolumesNegativeTest-977149100-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:36.076578 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ee1cd88c-cf4b-4219-af0c-198931c1dd6d tempest-VolumesNegativeTest-977149100 tempest-VolumesNegativeTest-977149100-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:36.077008 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ee1cd88c-cf4b-4219-af0c-198931c1dd6d tempest-VolumesNegativeTest-977149100 tempest-VolumesNegativeTest-977149100-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:36.358580 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-ee1cd88c-cf4b-4219-af0c-198931c1dd6d tempest-VolumesNegativeTest-977149100 tempest-VolumesNegativeTest-977149100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b3399a2b4345cdb88cf19b13c3a939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f259e7a121184313836a68277c2a08df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:36.367614 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ee1cd88c-cf4b-4219-af0c-198931c1dd6d tempest-VolumesNegativeTest-977149100 tempest-VolumesNegativeTest-977149100-project] 10.222.0.33 "GET /compute/v2.1/servers/3dfe17e2-88e8-49d3-b21a-f0f4cd97da75" status: 200 len: 1219 microversion: 2.1 time: 0.322490 Oct 04 21:08:36.392069 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2774/5577] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:08:36 2022] GET /compute/v2.1/servers/3dfe17e2-88e8-49d3-b21a-f0f4cd97da75 => generated 1219 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:08:36.435260 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-5c93e36d-7e28-4f5b-8d13-699b9ac93d0d tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:36.448418 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-5c93e36d-7e28-4f5b-8d13-699b9ac93d0d tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:36.450294 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-5c93e36d-7e28-4f5b-8d13-699b9ac93d0d tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:36.452512 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-5c93e36d-7e28-4f5b-8d13-699b9ac93d0d tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] 10.222.0.33 "GET /compute/v2.1/servers/05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9" status: 200 len: 1729 microversion: 2.20 time: 1.062105 Oct 04 21:08:36.463525 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2804/5578] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 21:08:35 2022] GET /compute/v2.1/servers/05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9 => generated 1729 bytes in 1073 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:08:37.401705 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-630b8c2b-731c-43db-a1e6-130e1ff6c580 tempest-VolumesNegativeTest-977149100 tempest-VolumesNegativeTest-977149100-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:37.402363 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-630b8c2b-731c-43db-a1e6-130e1ff6c580 tempest-VolumesNegativeTest-977149100 tempest-VolumesNegativeTest-977149100-project] [instance: 3dfe17e2-88e8-49d3-b21a-f0f4cd97da75] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:37.418939 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-630b8c2b-731c-43db-a1e6-130e1ff6c580 tempest-VolumesNegativeTest-977149100 tempest-VolumesNegativeTest-977149100-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:37.419733 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-630b8c2b-731c-43db-a1e6-130e1ff6c580 tempest-VolumesNegativeTest-977149100 tempest-VolumesNegativeTest-977149100-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:37.420587 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-630b8c2b-731c-43db-a1e6-130e1ff6c580 tempest-VolumesNegativeTest-977149100 tempest-VolumesNegativeTest-977149100-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:37.422950 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-630b8c2b-731c-43db-a1e6-130e1ff6c580 tempest-VolumesNegativeTest-977149100 tempest-VolumesNegativeTest-977149100-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:37.424805 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-630b8c2b-731c-43db-a1e6-130e1ff6c580 tempest-VolumesNegativeTest-977149100 tempest-VolumesNegativeTest-977149100-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:37.425514 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-630b8c2b-731c-43db-a1e6-130e1ff6c580 tempest-VolumesNegativeTest-977149100 tempest-VolumesNegativeTest-977149100-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:37.482290 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-729d5c1d-719b-438b-993d-45096f31bede tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:37.483556 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-729d5c1d-719b-438b-993d-45096f31bede tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] [instance: 05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:37.496904 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-729d5c1d-719b-438b-993d-45096f31bede tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:37.499203 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-729d5c1d-719b-438b-993d-45096f31bede tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:37.500301 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-729d5c1d-719b-438b-993d-45096f31bede tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:37.502800 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-729d5c1d-719b-438b-993d-45096f31bede tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:37.504210 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-729d5c1d-719b-438b-993d-45096f31bede tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:37.506200 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-729d5c1d-719b-438b-993d-45096f31bede tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:37.551398 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=81 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:08:37.753900 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-630b8c2b-731c-43db-a1e6-130e1ff6c580 tempest-VolumesNegativeTest-977149100 tempest-VolumesNegativeTest-977149100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b3399a2b4345cdb88cf19b13c3a939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f259e7a121184313836a68277c2a08df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:37.772654 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-630b8c2b-731c-43db-a1e6-130e1ff6c580 tempest-VolumesNegativeTest-977149100 tempest-VolumesNegativeTest-977149100-project] 10.222.0.33 "GET /compute/v2.1/servers/3dfe17e2-88e8-49d3-b21a-f0f4cd97da75" status: 200 len: 1275 microversion: 2.1 time: 0.377042 Oct 04 21:08:37.773380 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2775/5579] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:08:37 2022] GET /compute/v2.1/servers/3dfe17e2-88e8-49d3-b21a-f0f4cd97da75 => generated 1275 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:08:37.908108 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-729d5c1d-719b-438b-993d-45096f31bede tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:37.921418 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-729d5c1d-719b-438b-993d-45096f31bede tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:37.923664 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-729d5c1d-719b-438b-993d-45096f31bede tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:37.931094 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-729d5c1d-719b-438b-993d-45096f31bede tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] 10.222.0.33 "GET /compute/v2.1/servers/05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9" status: 200 len: 1729 microversion: 2.20 time: 0.453207 Oct 04 21:08:37.932020 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2805/5580] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 21:08:37 2022] GET /compute/v2.1/servers/05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9 => generated 1729 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:08:38.810103 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-693820e0-54e6-4eff-b8c0-13a21f520d7b tempest-VolumesNegativeTest-977149100 tempest-VolumesNegativeTest-977149100-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:38.817780 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-693820e0-54e6-4eff-b8c0-13a21f520d7b tempest-VolumesNegativeTest-977149100 tempest-VolumesNegativeTest-977149100-project] [instance: 3dfe17e2-88e8-49d3-b21a-f0f4cd97da75] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:38.862099 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-693820e0-54e6-4eff-b8c0-13a21f520d7b tempest-VolumesNegativeTest-977149100 tempest-VolumesNegativeTest-977149100-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:38.870455 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-693820e0-54e6-4eff-b8c0-13a21f520d7b tempest-VolumesNegativeTest-977149100 tempest-VolumesNegativeTest-977149100-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:38.871396 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-693820e0-54e6-4eff-b8c0-13a21f520d7b tempest-VolumesNegativeTest-977149100 tempest-VolumesNegativeTest-977149100-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:38.872085 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-693820e0-54e6-4eff-b8c0-13a21f520d7b tempest-VolumesNegativeTest-977149100 tempest-VolumesNegativeTest-977149100-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:38.872713 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-693820e0-54e6-4eff-b8c0-13a21f520d7b tempest-VolumesNegativeTest-977149100 tempest-VolumesNegativeTest-977149100-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:38.873354 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-693820e0-54e6-4eff-b8c0-13a21f520d7b tempest-VolumesNegativeTest-977149100 tempest-VolumesNegativeTest-977149100-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:38.964598 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-cc61a26b-e53c-40ee-842d-708053c2c010 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:38.965215 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-cc61a26b-e53c-40ee-842d-708053c2c010 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] [instance: 05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:38.985551 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cc61a26b-e53c-40ee-842d-708053c2c010 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:38.987381 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cc61a26b-e53c-40ee-842d-708053c2c010 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:38.994078 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cc61a26b-e53c-40ee-842d-708053c2c010 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:39.004273 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cc61a26b-e53c-40ee-842d-708053c2c010 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:39.005738 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cc61a26b-e53c-40ee-842d-708053c2c010 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:39.007574 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cc61a26b-e53c-40ee-842d-708053c2c010 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:39.359958 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-693820e0-54e6-4eff-b8c0-13a21f520d7b tempest-VolumesNegativeTest-977149100 tempest-VolumesNegativeTest-977149100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b3399a2b4345cdb88cf19b13c3a939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f259e7a121184313836a68277c2a08df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:39.391463 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-693820e0-54e6-4eff-b8c0-13a21f520d7b tempest-VolumesNegativeTest-977149100 tempest-VolumesNegativeTest-977149100-project] 10.222.0.33 "GET /compute/v2.1/servers/3dfe17e2-88e8-49d3-b21a-f0f4cd97da75" status: 200 len: 1273 microversion: 2.1 time: 0.595830 Oct 04 21:08:39.392754 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2776/5581] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:08:38 2022] GET /compute/v2.1/servers/3dfe17e2-88e8-49d3-b21a-f0f4cd97da75 => generated 1273 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:08:39.416169 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-99efa445-1a6d-49c7-b6d3-c487a9ade386 req-9afad2b0-dc3d-4416-afcf-15f28da6615e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9", "name": "network-vif-plugged", "status": "completed", "tag": "2f9889d1-cb04-4ccc-8abc-1f54eb9f493f"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:08:39.441605 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-99efa445-1a6d-49c7-b6d3-c487a9ade386 req-9afad2b0-dc3d-4416-afcf-15f28da6615e service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:39.442312 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-99efa445-1a6d-49c7-b6d3-c487a9ade386 req-9afad2b0-dc3d-4416-afcf-15f28da6615e service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:39.443106 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-99efa445-1a6d-49c7-b6d3-c487a9ade386 req-9afad2b0-dc3d-4416-afcf-15f28da6615e service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:39.465020 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-99efa445-1a6d-49c7-b6d3-c487a9ade386 req-9afad2b0-dc3d-4416-afcf-15f28da6615e service nova] Creating event network-vif-plugged:2f9889d1-cb04-4ccc-8abc-1f54eb9f493f for instance 05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9 on n-h1-854823-8 Oct 04 21:08:39.470698 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-99efa445-1a6d-49c7-b6d3-c487a9ade386 req-9afad2b0-dc3d-4416-afcf-15f28da6615e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076401 Oct 04 21:08:39.476508 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2777/5582] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:08:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:08:39.566300 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-cc61a26b-e53c-40ee-842d-708053c2c010 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:39.577823 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-cc61a26b-e53c-40ee-842d-708053c2c010 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:39.584100 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-cc61a26b-e53c-40ee-842d-708053c2c010 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:39.586215 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-cc61a26b-e53c-40ee-842d-708053c2c010 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] 10.222.0.33 "GET /compute/v2.1/servers/05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9" status: 200 len: 1729 microversion: 2.20 time: 0.626370 Oct 04 21:08:39.587206 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2806/5583] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 21:08:38 2022] GET /compute/v2.1/servers/05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9 => generated 1729 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:08:40.421260 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0fe2f702-f14e-4de6-96e1-fa0cc7de7cae tempest-VolumesNegativeTest-977149100 tempest-VolumesNegativeTest-977149100-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:40.423878 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-0fe2f702-f14e-4de6-96e1-fa0cc7de7cae tempest-VolumesNegativeTest-977149100 tempest-VolumesNegativeTest-977149100-project] [instance: 3dfe17e2-88e8-49d3-b21a-f0f4cd97da75] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:40.456197 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0fe2f702-f14e-4de6-96e1-fa0cc7de7cae tempest-VolumesNegativeTest-977149100 tempest-VolumesNegativeTest-977149100-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:40.457772 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0fe2f702-f14e-4de6-96e1-fa0cc7de7cae tempest-VolumesNegativeTest-977149100 tempest-VolumesNegativeTest-977149100-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:40.459067 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0fe2f702-f14e-4de6-96e1-fa0cc7de7cae tempest-VolumesNegativeTest-977149100 tempest-VolumesNegativeTest-977149100-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:40.461452 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0fe2f702-f14e-4de6-96e1-fa0cc7de7cae tempest-VolumesNegativeTest-977149100 tempest-VolumesNegativeTest-977149100-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:40.463763 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0fe2f702-f14e-4de6-96e1-fa0cc7de7cae tempest-VolumesNegativeTest-977149100 tempest-VolumesNegativeTest-977149100-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:40.465106 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0fe2f702-f14e-4de6-96e1-fa0cc7de7cae tempest-VolumesNegativeTest-977149100 tempest-VolumesNegativeTest-977149100-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:40.637759 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-9d63eb27-f144-4ac5-8bbe-37c0a607c0ba tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:40.638784 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-9d63eb27-f144-4ac5-8bbe-37c0a607c0ba tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] [instance: 05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:40.667839 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9d63eb27-f144-4ac5-8bbe-37c0a607c0ba tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:40.671405 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9d63eb27-f144-4ac5-8bbe-37c0a607c0ba tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:40.672114 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9d63eb27-f144-4ac5-8bbe-37c0a607c0ba tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:40.673106 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9d63eb27-f144-4ac5-8bbe-37c0a607c0ba tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:40.677777 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9d63eb27-f144-4ac5-8bbe-37c0a607c0ba tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:40.683889 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9d63eb27-f144-4ac5-8bbe-37c0a607c0ba tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:40.805871 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-0fe2f702-f14e-4de6-96e1-fa0cc7de7cae tempest-VolumesNegativeTest-977149100 tempest-VolumesNegativeTest-977149100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b3399a2b4345cdb88cf19b13c3a939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f259e7a121184313836a68277c2a08df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:40.832490 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-0fe2f702-f14e-4de6-96e1-fa0cc7de7cae tempest-VolumesNegativeTest-977149100 tempest-VolumesNegativeTest-977149100-project] 10.222.0.33 "GET /compute/v2.1/servers/3dfe17e2-88e8-49d3-b21a-f0f4cd97da75" status: 200 len: 1315 microversion: 2.1 time: 0.416713 Oct 04 21:08:40.833078 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2778/5584] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:08:40 2022] GET /compute/v2.1/servers/3dfe17e2-88e8-49d3-b21a-f0f4cd97da75 => generated 1315 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:08:41.122395 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-9d63eb27-f144-4ac5-8bbe-37c0a607c0ba tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:41.133046 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-9d63eb27-f144-4ac5-8bbe-37c0a607c0ba tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:41.138477 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-9d63eb27-f144-4ac5-8bbe-37c0a607c0ba tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:41.140428 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-9d63eb27-f144-4ac5-8bbe-37c0a607c0ba tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] 10.222.0.33 "GET /compute/v2.1/servers/05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9" status: 200 len: 1729 microversion: 2.20 time: 0.521320 Oct 04 21:08:41.183065 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2807/5585] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 21:08:40 2022] GET /compute/v2.1/servers/05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9 => generated 1729 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:08:41.777720 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-3eb6dc26-1336-4417-933a-badaef37c71b req-a020b648-7f4e-4276-8db9-d1a283109e67 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3dfe17e2-88e8-49d3-b21a-f0f4cd97da75", "tag": "7c0d344d-4336-4520-8dfb-9449770b3b45"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:08:41.797632 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-3eb6dc26-1336-4417-933a-badaef37c71b req-a020b648-7f4e-4276-8db9-d1a283109e67 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:41.798416 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-3eb6dc26-1336-4417-933a-badaef37c71b req-a020b648-7f4e-4276-8db9-d1a283109e67 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:41.799008 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-3eb6dc26-1336-4417-933a-badaef37c71b req-a020b648-7f4e-4276-8db9-d1a283109e67 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:41.811712 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-3eb6dc26-1336-4417-933a-badaef37c71b req-a020b648-7f4e-4276-8db9-d1a283109e67 service nova] Creating event network-changed:7c0d344d-4336-4520-8dfb-9449770b3b45 for instance 3dfe17e2-88e8-49d3-b21a-f0f4cd97da75 on n-h1-854823-8 Oct 04 21:08:41.822033 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-3eb6dc26-1336-4417-933a-badaef37c71b req-a020b648-7f4e-4276-8db9-d1a283109e67 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048115 Oct 04 21:08:41.823699 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2779/5586] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:08:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:08:41.873024 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-60d92884-9411-4ff2-aefd-c173985f0118 tempest-VolumesNegativeTest-977149100 tempest-VolumesNegativeTest-977149100-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:41.874295 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-60d92884-9411-4ff2-aefd-c173985f0118 tempest-VolumesNegativeTest-977149100 tempest-VolumesNegativeTest-977149100-project] [instance: 3dfe17e2-88e8-49d3-b21a-f0f4cd97da75] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:41.896444 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-60d92884-9411-4ff2-aefd-c173985f0118 tempest-VolumesNegativeTest-977149100 tempest-VolumesNegativeTest-977149100-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:41.897440 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-60d92884-9411-4ff2-aefd-c173985f0118 tempest-VolumesNegativeTest-977149100 tempest-VolumesNegativeTest-977149100-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:41.914875 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-60d92884-9411-4ff2-aefd-c173985f0118 tempest-VolumesNegativeTest-977149100 tempest-VolumesNegativeTest-977149100-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:41.915722 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-60d92884-9411-4ff2-aefd-c173985f0118 tempest-VolumesNegativeTest-977149100 tempest-VolumesNegativeTest-977149100-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:41.916201 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-60d92884-9411-4ff2-aefd-c173985f0118 tempest-VolumesNegativeTest-977149100 tempest-VolumesNegativeTest-977149100-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:41.922430 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-60d92884-9411-4ff2-aefd-c173985f0118 tempest-VolumesNegativeTest-977149100 tempest-VolumesNegativeTest-977149100-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:42.181540 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b075a2fc-67d9-4f91-bfc9-eca5b2a4c76d tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:42.183158 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b075a2fc-67d9-4f91-bfc9-eca5b2a4c76d tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] [instance: 05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:42.206444 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b075a2fc-67d9-4f91-bfc9-eca5b2a4c76d tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:42.214560 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b075a2fc-67d9-4f91-bfc9-eca5b2a4c76d tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:42.218580 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b075a2fc-67d9-4f91-bfc9-eca5b2a4c76d tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:42.219896 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b075a2fc-67d9-4f91-bfc9-eca5b2a4c76d tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:42.226720 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b075a2fc-67d9-4f91-bfc9-eca5b2a4c76d tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:42.233238 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b075a2fc-67d9-4f91-bfc9-eca5b2a4c76d tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:42.564633 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-60d92884-9411-4ff2-aefd-c173985f0118 tempest-VolumesNegativeTest-977149100 tempest-VolumesNegativeTest-977149100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b3399a2b4345cdb88cf19b13c3a939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f259e7a121184313836a68277c2a08df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:42.574137 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-60d92884-9411-4ff2-aefd-c173985f0118 tempest-VolumesNegativeTest-977149100 tempest-VolumesNegativeTest-977149100-project] 10.222.0.33 "GET /compute/v2.1/servers/3dfe17e2-88e8-49d3-b21a-f0f4cd97da75" status: 200 len: 1315 microversion: 2.1 time: 0.706859 Oct 04 21:08:42.574787 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2808/5587] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:08:41 2022] GET /compute/v2.1/servers/3dfe17e2-88e8-49d3-b21a-f0f4cd97da75 => generated 1315 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:08:43.018519 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-b075a2fc-67d9-4f91-bfc9-eca5b2a4c76d tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:43.038907 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-b075a2fc-67d9-4f91-bfc9-eca5b2a4c76d tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:43.040839 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-b075a2fc-67d9-4f91-bfc9-eca5b2a4c76d tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:43.042566 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b075a2fc-67d9-4f91-bfc9-eca5b2a4c76d tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] 10.222.0.33 "GET /compute/v2.1/servers/05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9" status: 200 len: 1729 microversion: 2.20 time: 0.865729 Oct 04 21:08:43.044296 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2780/5588] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 21:08:42 2022] GET /compute/v2.1/servers/05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9 => generated 1729 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 21:08:43.597194 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-116adb41-705e-4f0b-8d1c-c18654f569f7 tempest-VolumesNegativeTest-977149100 tempest-VolumesNegativeTest-977149100-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:43.597748 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-116adb41-705e-4f0b-8d1c-c18654f569f7 tempest-VolumesNegativeTest-977149100 tempest-VolumesNegativeTest-977149100-project] [instance: 3dfe17e2-88e8-49d3-b21a-f0f4cd97da75] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:43.613420 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-116adb41-705e-4f0b-8d1c-c18654f569f7 tempest-VolumesNegativeTest-977149100 tempest-VolumesNegativeTest-977149100-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:43.614199 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-116adb41-705e-4f0b-8d1c-c18654f569f7 tempest-VolumesNegativeTest-977149100 tempest-VolumesNegativeTest-977149100-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:43.614838 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-116adb41-705e-4f0b-8d1c-c18654f569f7 tempest-VolumesNegativeTest-977149100 tempest-VolumesNegativeTest-977149100-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:43.616241 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-116adb41-705e-4f0b-8d1c-c18654f569f7 tempest-VolumesNegativeTest-977149100 tempest-VolumesNegativeTest-977149100-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:43.616861 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-116adb41-705e-4f0b-8d1c-c18654f569f7 tempest-VolumesNegativeTest-977149100 tempest-VolumesNegativeTest-977149100-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:43.618142 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-116adb41-705e-4f0b-8d1c-c18654f569f7 tempest-VolumesNegativeTest-977149100 tempest-VolumesNegativeTest-977149100-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:43.925271 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-116adb41-705e-4f0b-8d1c-c18654f569f7 tempest-VolumesNegativeTest-977149100 tempest-VolumesNegativeTest-977149100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b3399a2b4345cdb88cf19b13c3a939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f259e7a121184313836a68277c2a08df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:43.941033 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-116adb41-705e-4f0b-8d1c-c18654f569f7 tempest-VolumesNegativeTest-977149100 tempest-VolumesNegativeTest-977149100-project] 10.222.0.33 "GET /compute/v2.1/servers/3dfe17e2-88e8-49d3-b21a-f0f4cd97da75" status: 200 len: 1315 microversion: 2.1 time: 0.345967 Oct 04 21:08:43.944117 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2809/5589] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:08:43 2022] GET /compute/v2.1/servers/3dfe17e2-88e8-49d3-b21a-f0f4cd97da75 => generated 1315 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:08:44.114166 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-18ab9f9b-b4cc-4c8f-badd-732122849b73 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:44.114866 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-18ab9f9b-b4cc-4c8f-badd-732122849b73 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] [instance: 05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:44.129492 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-18ab9f9b-b4cc-4c8f-badd-732122849b73 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:44.130378 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-18ab9f9b-b4cc-4c8f-badd-732122849b73 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:44.134972 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-18ab9f9b-b4cc-4c8f-badd-732122849b73 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:44.135730 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-18ab9f9b-b4cc-4c8f-badd-732122849b73 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:44.136185 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-18ab9f9b-b4cc-4c8f-badd-732122849b73 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:44.136720 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-18ab9f9b-b4cc-4c8f-badd-732122849b73 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:44.521804 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-18ab9f9b-b4cc-4c8f-badd-732122849b73 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:44.532672 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-18ab9f9b-b4cc-4c8f-badd-732122849b73 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:44.541113 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-18ab9f9b-b4cc-4c8f-badd-732122849b73 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:44.542455 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-18ab9f9b-b4cc-4c8f-badd-732122849b73 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] 10.222.0.33 "GET /compute/v2.1/servers/05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9" status: 200 len: 1716 microversion: 2.20 time: 0.433070 Oct 04 21:08:44.543044 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2781/5590] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 21:08:44 2022] GET /compute/v2.1/servers/05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9 => generated 1716 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:08:44.968601 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-a644e64d-4081-4b96-9f98-cb1c040db73a tempest-VolumesNegativeTest-977149100 tempest-VolumesNegativeTest-977149100-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:44.969817 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-a644e64d-4081-4b96-9f98-cb1c040db73a tempest-VolumesNegativeTest-977149100 tempest-VolumesNegativeTest-977149100-project] [instance: 3dfe17e2-88e8-49d3-b21a-f0f4cd97da75] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:44.979486 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell0:SELECT=2 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:08:44.981618 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell0:SELECT=6 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:08:44.989479 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a644e64d-4081-4b96-9f98-cb1c040db73a tempest-VolumesNegativeTest-977149100 tempest-VolumesNegativeTest-977149100-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:44.990303 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a644e64d-4081-4b96-9f98-cb1c040db73a tempest-VolumesNegativeTest-977149100 tempest-VolumesNegativeTest-977149100-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:44.991677 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a644e64d-4081-4b96-9f98-cb1c040db73a tempest-VolumesNegativeTest-977149100 tempest-VolumesNegativeTest-977149100-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:44.992594 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a644e64d-4081-4b96-9f98-cb1c040db73a tempest-VolumesNegativeTest-977149100 tempest-VolumesNegativeTest-977149100-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:44.993891 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a644e64d-4081-4b96-9f98-cb1c040db73a tempest-VolumesNegativeTest-977149100 tempest-VolumesNegativeTest-977149100-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:44.994876 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a644e64d-4081-4b96-9f98-cb1c040db73a tempest-VolumesNegativeTest-977149100 tempest-VolumesNegativeTest-977149100-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:45.438527 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-a644e64d-4081-4b96-9f98-cb1c040db73a tempest-VolumesNegativeTest-977149100 tempest-VolumesNegativeTest-977149100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b3399a2b4345cdb88cf19b13c3a939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f259e7a121184313836a68277c2a08df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:45.453271 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-a644e64d-4081-4b96-9f98-cb1c040db73a tempest-VolumesNegativeTest-977149100 tempest-VolumesNegativeTest-977149100-project] 10.222.0.33 "GET /compute/v2.1/servers/3dfe17e2-88e8-49d3-b21a-f0f4cd97da75" status: 200 len: 1315 microversion: 2.1 time: 0.488672 Oct 04 21:08:45.453878 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2810/5591] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:08:44 2022] GET /compute/v2.1/servers/3dfe17e2-88e8-49d3-b21a-f0f4cd97da75 => generated 1315 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:08:46.478252 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8bd47d04-00c0-4db1-99b4-1db015e8a4df tempest-VolumesNegativeTest-977149100 tempest-VolumesNegativeTest-977149100-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:46.478925 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-8bd47d04-00c0-4db1-99b4-1db015e8a4df tempest-VolumesNegativeTest-977149100 tempest-VolumesNegativeTest-977149100-project] [instance: 3dfe17e2-88e8-49d3-b21a-f0f4cd97da75] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:46.487405 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:08:46.494660 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8bd47d04-00c0-4db1-99b4-1db015e8a4df tempest-VolumesNegativeTest-977149100 tempest-VolumesNegativeTest-977149100-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:46.495975 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8bd47d04-00c0-4db1-99b4-1db015e8a4df tempest-VolumesNegativeTest-977149100 tempest-VolumesNegativeTest-977149100-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:46.496853 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8bd47d04-00c0-4db1-99b4-1db015e8a4df tempest-VolumesNegativeTest-977149100 tempest-VolumesNegativeTest-977149100-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:46.499249 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8bd47d04-00c0-4db1-99b4-1db015e8a4df tempest-VolumesNegativeTest-977149100 tempest-VolumesNegativeTest-977149100-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:46.499680 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8bd47d04-00c0-4db1-99b4-1db015e8a4df tempest-VolumesNegativeTest-977149100 tempest-VolumesNegativeTest-977149100-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:46.522742 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8bd47d04-00c0-4db1-99b4-1db015e8a4df tempest-VolumesNegativeTest-977149100 tempest-VolumesNegativeTest-977149100-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:46.979785 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-2206786c-d0ff-4885-9e72-b6febb14b736 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:08:46.985514 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-2206786c-d0ff-4885-9e72-b6febb14b736 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] [instance: bf706904-01fc-408d-a24e-0efb6de3e74f] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:47.035188 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2206786c-d0ff-4885-9e72-b6febb14b736 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:47.035910 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2206786c-d0ff-4885-9e72-b6febb14b736 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:47.036533 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2206786c-d0ff-4885-9e72-b6febb14b736 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:47.037981 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2206786c-d0ff-4885-9e72-b6febb14b736 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:47.042489 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2206786c-d0ff-4885-9e72-b6febb14b736 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:47.043422 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2206786c-d0ff-4885-9e72-b6febb14b736 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:47.105650 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-8bd47d04-00c0-4db1-99b4-1db015e8a4df tempest-VolumesNegativeTest-977149100 tempest-VolumesNegativeTest-977149100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b3399a2b4345cdb88cf19b13c3a939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f259e7a121184313836a68277c2a08df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:47.127160 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-8bd47d04-00c0-4db1-99b4-1db015e8a4df tempest-VolumesNegativeTest-977149100 tempest-VolumesNegativeTest-977149100-project] 10.222.0.33 "GET /compute/v2.1/servers/3dfe17e2-88e8-49d3-b21a-f0f4cd97da75" status: 200 len: 1315 microversion: 2.1 time: 0.653243 Oct 04 21:08:47.136721 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2782/5592] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:08:46 2022] GET /compute/v2.1/servers/3dfe17e2-88e8-49d3-b21a-f0f4cd97da75 => generated 1315 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:08:47.229821 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-2206786c-d0ff-4885-9e72-b6febb14b736 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] 10.222.0.33 "POST /compute/v2.1/servers/bf706904-01fc-408d-a24e-0efb6de3e74f/action" status: 200 len: 24576 microversion: 2.1 time: 0.255879 Oct 04 21:08:47.231213 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2811/5593] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 21:08:46 2022] POST /compute/v2.1/servers/bf706904-01fc-408d-a24e-0efb6de3e74f/action => generated 24576 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 21:08:48.166790 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-aedd3d6c-a43d-4a56-a30d-eee07ae330ad tempest-VolumesNegativeTest-977149100 tempest-VolumesNegativeTest-977149100-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:48.167480 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-aedd3d6c-a43d-4a56-a30d-eee07ae330ad tempest-VolumesNegativeTest-977149100 tempest-VolumesNegativeTest-977149100-project] [instance: 3dfe17e2-88e8-49d3-b21a-f0f4cd97da75] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:48.181363 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-aedd3d6c-a43d-4a56-a30d-eee07ae330ad tempest-VolumesNegativeTest-977149100 tempest-VolumesNegativeTest-977149100-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:48.181883 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-aedd3d6c-a43d-4a56-a30d-eee07ae330ad tempest-VolumesNegativeTest-977149100 tempest-VolumesNegativeTest-977149100-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:48.182332 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-aedd3d6c-a43d-4a56-a30d-eee07ae330ad tempest-VolumesNegativeTest-977149100 tempest-VolumesNegativeTest-977149100-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:48.183241 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-aedd3d6c-a43d-4a56-a30d-eee07ae330ad tempest-VolumesNegativeTest-977149100 tempest-VolumesNegativeTest-977149100-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:48.183756 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-aedd3d6c-a43d-4a56-a30d-eee07ae330ad tempest-VolumesNegativeTest-977149100 tempest-VolumesNegativeTest-977149100-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:48.184224 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-aedd3d6c-a43d-4a56-a30d-eee07ae330ad tempest-VolumesNegativeTest-977149100 tempest-VolumesNegativeTest-977149100-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:48.500329 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-aedd3d6c-a43d-4a56-a30d-eee07ae330ad tempest-VolumesNegativeTest-977149100 tempest-VolumesNegativeTest-977149100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b3399a2b4345cdb88cf19b13c3a939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f259e7a121184313836a68277c2a08df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:48.508374 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-aedd3d6c-a43d-4a56-a30d-eee07ae330ad tempest-VolumesNegativeTest-977149100 tempest-VolumesNegativeTest-977149100-project] 10.222.0.33 "GET /compute/v2.1/servers/3dfe17e2-88e8-49d3-b21a-f0f4cd97da75" status: 200 len: 1315 microversion: 2.1 time: 0.346519 Oct 04 21:08:48.526904 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2783/5594] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:08:48 2022] GET /compute/v2.1/servers/3dfe17e2-88e8-49d3-b21a-f0f4cd97da75 => generated 1315 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:08:48.918681 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-0c5d3fa9-088f-45ec-806a-f0b16597dd61 req-9b0c22f6-1f7a-420b-bc88-3a44751aedc1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3dfe17e2-88e8-49d3-b21a-f0f4cd97da75", "name": "network-vif-plugged", "status": "completed", "tag": "7c0d344d-4336-4520-8dfb-9449770b3b45"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:08:48.944571 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-0c5d3fa9-088f-45ec-806a-f0b16597dd61 req-9b0c22f6-1f7a-420b-bc88-3a44751aedc1 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:48.945068 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-0c5d3fa9-088f-45ec-806a-f0b16597dd61 req-9b0c22f6-1f7a-420b-bc88-3a44751aedc1 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:48.945508 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-0c5d3fa9-088f-45ec-806a-f0b16597dd61 req-9b0c22f6-1f7a-420b-bc88-3a44751aedc1 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:48.972405 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-0c5d3fa9-088f-45ec-806a-f0b16597dd61 req-9b0c22f6-1f7a-420b-bc88-3a44751aedc1 service nova] Creating event network-vif-plugged:7c0d344d-4336-4520-8dfb-9449770b3b45 for instance 3dfe17e2-88e8-49d3-b21a-f0f4cd97da75 on n-h1-854823-8 Oct 04 21:08:48.979062 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-0c5d3fa9-088f-45ec-806a-f0b16597dd61 req-9b0c22f6-1f7a-420b-bc88-3a44751aedc1 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064931 Oct 04 21:08:48.981079 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2812/5595] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:08:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:08:49.537000 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d8866d04-1b27-4d83-833a-cb9025c1eae7 tempest-VolumesNegativeTest-977149100 tempest-VolumesNegativeTest-977149100-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:49.538281 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d8866d04-1b27-4d83-833a-cb9025c1eae7 tempest-VolumesNegativeTest-977149100 tempest-VolumesNegativeTest-977149100-project] [instance: 3dfe17e2-88e8-49d3-b21a-f0f4cd97da75] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:49.554254 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d8866d04-1b27-4d83-833a-cb9025c1eae7 tempest-VolumesNegativeTest-977149100 tempest-VolumesNegativeTest-977149100-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:49.555101 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d8866d04-1b27-4d83-833a-cb9025c1eae7 tempest-VolumesNegativeTest-977149100 tempest-VolumesNegativeTest-977149100-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:49.555731 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d8866d04-1b27-4d83-833a-cb9025c1eae7 tempest-VolumesNegativeTest-977149100 tempest-VolumesNegativeTest-977149100-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:49.556641 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d8866d04-1b27-4d83-833a-cb9025c1eae7 tempest-VolumesNegativeTest-977149100 tempest-VolumesNegativeTest-977149100-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:49.557290 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d8866d04-1b27-4d83-833a-cb9025c1eae7 tempest-VolumesNegativeTest-977149100 tempest-VolumesNegativeTest-977149100-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:49.557896 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d8866d04-1b27-4d83-833a-cb9025c1eae7 tempest-VolumesNegativeTest-977149100 tempest-VolumesNegativeTest-977149100-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:49.873808 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d8866d04-1b27-4d83-833a-cb9025c1eae7 tempest-VolumesNegativeTest-977149100 tempest-VolumesNegativeTest-977149100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b3399a2b4345cdb88cf19b13c3a939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f259e7a121184313836a68277c2a08df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:49.882110 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=100 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:08:49.885121 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d8866d04-1b27-4d83-833a-cb9025c1eae7 tempest-VolumesNegativeTest-977149100 tempest-VolumesNegativeTest-977149100-project] 10.222.0.33 "GET /compute/v2.1/servers/3dfe17e2-88e8-49d3-b21a-f0f4cd97da75" status: 200 len: 1315 microversion: 2.1 time: 0.351988 Oct 04 21:08:49.887622 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2784/5596] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:08:49 2022] GET /compute/v2.1/servers/3dfe17e2-88e8-49d3-b21a-f0f4cd97da75 => generated 1315 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:08:50.909636 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-b13881a2-07e9-4476-8e4e-1b284a7abae7 tempest-VolumesNegativeTest-977149100 tempest-VolumesNegativeTest-977149100-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:50.911005 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-b13881a2-07e9-4476-8e4e-1b284a7abae7 tempest-VolumesNegativeTest-977149100 tempest-VolumesNegativeTest-977149100-project] [instance: 3dfe17e2-88e8-49d3-b21a-f0f4cd97da75] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:50.925970 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b13881a2-07e9-4476-8e4e-1b284a7abae7 tempest-VolumesNegativeTest-977149100 tempest-VolumesNegativeTest-977149100-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:50.927910 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b13881a2-07e9-4476-8e4e-1b284a7abae7 tempest-VolumesNegativeTest-977149100 tempest-VolumesNegativeTest-977149100-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:50.928970 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b13881a2-07e9-4476-8e4e-1b284a7abae7 tempest-VolumesNegativeTest-977149100 tempest-VolumesNegativeTest-977149100-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:50.931699 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b13881a2-07e9-4476-8e4e-1b284a7abae7 tempest-VolumesNegativeTest-977149100 tempest-VolumesNegativeTest-977149100-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:50.932392 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b13881a2-07e9-4476-8e4e-1b284a7abae7 tempest-VolumesNegativeTest-977149100 tempest-VolumesNegativeTest-977149100-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:50.933514 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b13881a2-07e9-4476-8e4e-1b284a7abae7 tempest-VolumesNegativeTest-977149100 tempest-VolumesNegativeTest-977149100-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:51.204889 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-b13881a2-07e9-4476-8e4e-1b284a7abae7 tempest-VolumesNegativeTest-977149100 tempest-VolumesNegativeTest-977149100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b3399a2b4345cdb88cf19b13c3a939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f259e7a121184313836a68277c2a08df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:51.221911 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-b13881a2-07e9-4476-8e4e-1b284a7abae7 tempest-VolumesNegativeTest-977149100 tempest-VolumesNegativeTest-977149100-project] 10.222.0.33 "GET /compute/v2.1/servers/3dfe17e2-88e8-49d3-b21a-f0f4cd97da75" status: 200 len: 1464 microversion: 2.1 time: 0.316402 Oct 04 21:08:51.222681 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2813/5597] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:08:50 2022] GET /compute/v2.1/servers/3dfe17e2-88e8-49d3-b21a-f0f4cd97da75 => generated 1464 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:08:51.299967 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0c5a172b-6eb8-496d-9b83-157f7185b127 tempest-VolumesNegativeTest-977149100 tempest-VolumesNegativeTest-977149100-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:51.301357 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-0c5a172b-6eb8-496d-9b83-157f7185b127 tempest-VolumesNegativeTest-977149100 tempest-VolumesNegativeTest-977149100-project] [instance: 3dfe17e2-88e8-49d3-b21a-f0f4cd97da75] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:51.312176 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0c5a172b-6eb8-496d-9b83-157f7185b127 tempest-VolumesNegativeTest-977149100 tempest-VolumesNegativeTest-977149100-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:51.321144 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0c5a172b-6eb8-496d-9b83-157f7185b127 tempest-VolumesNegativeTest-977149100 tempest-VolumesNegativeTest-977149100-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:51.321869 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0c5a172b-6eb8-496d-9b83-157f7185b127 tempest-VolumesNegativeTest-977149100 tempest-VolumesNegativeTest-977149100-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:51.323289 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0c5a172b-6eb8-496d-9b83-157f7185b127 tempest-VolumesNegativeTest-977149100 tempest-VolumesNegativeTest-977149100-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:51.323942 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0c5a172b-6eb8-496d-9b83-157f7185b127 tempest-VolumesNegativeTest-977149100 tempest-VolumesNegativeTest-977149100-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:51.324549 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0c5a172b-6eb8-496d-9b83-157f7185b127 tempest-VolumesNegativeTest-977149100 tempest-VolumesNegativeTest-977149100-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:51.364826 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-0c5a172b-6eb8-496d-9b83-157f7185b127 tempest-VolumesNegativeTest-977149100 tempest-VolumesNegativeTest-977149100-project] [instance: 3dfe17e2-88e8-49d3-b21a-f0f4cd97da75] Going to try to terminate instance {{(pid=128801) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:08:51.485094 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-0c5a172b-6eb8-496d-9b83-157f7185b127 tempest-VolumesNegativeTest-977149100 tempest-VolumesNegativeTest-977149100-project] 10.222.0.33 "DELETE /compute/v2.1/servers/3dfe17e2-88e8-49d3-b21a-f0f4cd97da75" status: 204 len: 0 microversion: 2.1 time: 0.188728 Oct 04 21:08:51.485845 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2785/5598] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 21:08:51 2022] DELETE /compute/v2.1/servers/3dfe17e2-88e8-49d3-b21a-f0f4cd97da75 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:08:51.498490 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-5bfcfc85-cc76-467e-83c2-a7769048c2a4 tempest-VolumesNegativeTest-977149100 tempest-VolumesNegativeTest-977149100-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:51.500840 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-5bfcfc85-cc76-467e-83c2-a7769048c2a4 tempest-VolumesNegativeTest-977149100 tempest-VolumesNegativeTest-977149100-project] [instance: 3dfe17e2-88e8-49d3-b21a-f0f4cd97da75] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:51.510769 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5bfcfc85-cc76-467e-83c2-a7769048c2a4 tempest-VolumesNegativeTest-977149100 tempest-VolumesNegativeTest-977149100-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:51.512560 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5bfcfc85-cc76-467e-83c2-a7769048c2a4 tempest-VolumesNegativeTest-977149100 tempest-VolumesNegativeTest-977149100-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:51.515110 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5bfcfc85-cc76-467e-83c2-a7769048c2a4 tempest-VolumesNegativeTest-977149100 tempest-VolumesNegativeTest-977149100-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:51.517072 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5bfcfc85-cc76-467e-83c2-a7769048c2a4 tempest-VolumesNegativeTest-977149100 tempest-VolumesNegativeTest-977149100-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:51.519693 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5bfcfc85-cc76-467e-83c2-a7769048c2a4 tempest-VolumesNegativeTest-977149100 tempest-VolumesNegativeTest-977149100-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:51.520847 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5bfcfc85-cc76-467e-83c2-a7769048c2a4 tempest-VolumesNegativeTest-977149100 tempest-VolumesNegativeTest-977149100-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:51.746645 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-5bfcfc85-cc76-467e-83c2-a7769048c2a4 tempest-VolumesNegativeTest-977149100 tempest-VolumesNegativeTest-977149100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b3399a2b4345cdb88cf19b13c3a939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f259e7a121184313836a68277c2a08df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:51.756601 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-5bfcfc85-cc76-467e-83c2-a7769048c2a4 tempest-VolumesNegativeTest-977149100 tempest-VolumesNegativeTest-977149100-project] 10.222.0.33 "GET /compute/v2.1/servers/3dfe17e2-88e8-49d3-b21a-f0f4cd97da75" status: 200 len: 1470 microversion: 2.1 time: 0.266347 Oct 04 21:08:51.757944 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2814/5599] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:08:51 2022] GET /compute/v2.1/servers/3dfe17e2-88e8-49d3-b21a-f0f4cd97da75 => generated 1470 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:08:52.781884 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-517196ad-0e67-491b-9766-f7ed4f2f37ab tempest-VolumesNegativeTest-977149100 tempest-VolumesNegativeTest-977149100-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:52.783722 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-517196ad-0e67-491b-9766-f7ed4f2f37ab tempest-VolumesNegativeTest-977149100 tempest-VolumesNegativeTest-977149100-project] [instance: 3dfe17e2-88e8-49d3-b21a-f0f4cd97da75] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:52.798901 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-517196ad-0e67-491b-9766-f7ed4f2f37ab tempest-VolumesNegativeTest-977149100 tempest-VolumesNegativeTest-977149100-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:52.800401 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-517196ad-0e67-491b-9766-f7ed4f2f37ab tempest-VolumesNegativeTest-977149100 tempest-VolumesNegativeTest-977149100-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:52.801882 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-517196ad-0e67-491b-9766-f7ed4f2f37ab tempest-VolumesNegativeTest-977149100 tempest-VolumesNegativeTest-977149100-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:52.804622 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-517196ad-0e67-491b-9766-f7ed4f2f37ab tempest-VolumesNegativeTest-977149100 tempest-VolumesNegativeTest-977149100-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:52.806578 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-517196ad-0e67-491b-9766-f7ed4f2f37ab tempest-VolumesNegativeTest-977149100 tempest-VolumesNegativeTest-977149100-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:52.807770 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-517196ad-0e67-491b-9766-f7ed4f2f37ab tempest-VolumesNegativeTest-977149100 tempest-VolumesNegativeTest-977149100-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:53.233361 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-517196ad-0e67-491b-9766-f7ed4f2f37ab tempest-VolumesNegativeTest-977149100 tempest-VolumesNegativeTest-977149100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b3399a2b4345cdb88cf19b13c3a939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f259e7a121184313836a68277c2a08df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:53.244397 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-517196ad-0e67-491b-9766-f7ed4f2f37ab tempest-VolumesNegativeTest-977149100 tempest-VolumesNegativeTest-977149100-project] 10.222.0.33 "GET /compute/v2.1/servers/3dfe17e2-88e8-49d3-b21a-f0f4cd97da75" status: 200 len: 1470 microversion: 2.1 time: 0.467422 Oct 04 21:08:53.245558 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2786/5600] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:08:52 2022] GET /compute/v2.1/servers/3dfe17e2-88e8-49d3-b21a-f0f4cd97da75 => generated 1470 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:08:53.624722 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-57a3575f-c2f4-4a4d-9e8f-236a900a5b29 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63"}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:08:53.627597 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-57a3575f-c2f4-4a4d-9e8f-236a900a5b29 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] [instance: bf706904-01fc-408d-a24e-0efb6de3e74f] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:53.662291 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-57a3575f-c2f4-4a4d-9e8f-236a900a5b29 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:53.663624 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-57a3575f-c2f4-4a4d-9e8f-236a900a5b29 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:53.664167 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-57a3575f-c2f4-4a4d-9e8f-236a900a5b29 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:53.679899 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-57a3575f-c2f4-4a4d-9e8f-236a900a5b29 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:53.680399 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-57a3575f-c2f4-4a4d-9e8f-236a900a5b29 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:53.680853 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-57a3575f-c2f4-4a4d-9e8f-236a900a5b29 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:53.918001 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-57a3575f-c2f4-4a4d-9e8f-236a900a5b29 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Flavor limits 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:08:53.930245 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-57a3575f-c2f4-4a4d-9e8f-236a900a5b29 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Image limits 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:08:53.931429 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-57a3575f-c2f4-4a4d-9e8f-236a900a5b29 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Flavor pref 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:08:53.933053 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-57a3575f-c2f4-4a4d-9e8f-236a900a5b29 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Image pref 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:08:53.935668 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-57a3575f-c2f4-4a4d-9e8f-236a900a5b29 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:08:54.046236 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-8a872279-6704-4581-b93d-ac597f889189 req-f64172e5-6595-4123-884a-e5ca58cfb19f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3dfe17e2-88e8-49d3-b21a-f0f4cd97da75", "name": "network-vif-deleted", "tag": "7c0d344d-4336-4520-8dfb-9449770b3b45"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:08:54.094408 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-8a872279-6704-4581-b93d-ac597f889189 req-f64172e5-6595-4123-884a-e5ca58cfb19f service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:54.094934 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-8a872279-6704-4581-b93d-ac597f889189 req-f64172e5-6595-4123-884a-e5ca58cfb19f service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:54.107802 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-8a872279-6704-4581-b93d-ac597f889189 req-f64172e5-6595-4123-884a-e5ca58cfb19f service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:54.123920 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-57a3575f-c2f4-4a4d-9e8f-236a900a5b29 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] [instance: bf706904-01fc-408d-a24e-0efb6de3e74f] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:54.129501 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-8a872279-6704-4581-b93d-ac597f889189 req-f64172e5-6595-4123-884a-e5ca58cfb19f service nova] Creating event network-vif-deleted:7c0d344d-4336-4520-8dfb-9449770b3b45 for instance 3dfe17e2-88e8-49d3-b21a-f0f4cd97da75 on n-h1-854823-8 Oct 04 21:08:54.134972 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-57a3575f-c2f4-4a4d-9e8f-236a900a5b29 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:54.135478 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-57a3575f-c2f4-4a4d-9e8f-236a900a5b29 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:54.141805 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-57a3575f-c2f4-4a4d-9e8f-236a900a5b29 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:54.142654 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-57a3575f-c2f4-4a4d-9e8f-236a900a5b29 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:54.144638 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-57a3575f-c2f4-4a4d-9e8f-236a900a5b29 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:54.145200 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-57a3575f-c2f4-4a4d-9e8f-236a900a5b29 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:54.165488 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-8a872279-6704-4581-b93d-ac597f889189 req-f64172e5-6595-4123-884a-e5ca58cfb19f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124394 Oct 04 21:08:54.166984 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2787/5601] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:08:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:08:54.248717 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-57a3575f-c2f4-4a4d-9e8f-236a900a5b29 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] 10.222.0.33 "POST /compute/v2.1/servers/bf706904-01fc-408d-a24e-0efb6de3e74f/action" status: 202 len: 1137 microversion: 2.1 time: 0.625426 Oct 04 21:08:54.249815 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2815/5602] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 21:08:53 2022] POST /compute/v2.1/servers/bf706904-01fc-408d-a24e-0efb6de3e74f/action => generated 1137 bytes in 630 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 04 21:08:54.274729 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-931dcf45-6d65-4eb9-ada5-26f67f739064 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:54.275478 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-931dcf45-6d65-4eb9-ada5-26f67f739064 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] [instance: bf706904-01fc-408d-a24e-0efb6de3e74f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:54.277261 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-f7eb0497-c8f5-455c-9c33-1266e33b2982 tempest-VolumesNegativeTest-977149100 tempest-VolumesNegativeTest-977149100-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:54.282985 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-f7eb0497-c8f5-455c-9c33-1266e33b2982 tempest-VolumesNegativeTest-977149100 tempest-VolumesNegativeTest-977149100-project] [instance: 3dfe17e2-88e8-49d3-b21a-f0f4cd97da75] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:54.289277 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-931dcf45-6d65-4eb9-ada5-26f67f739064 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:54.291901 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f7eb0497-c8f5-455c-9c33-1266e33b2982 tempest-VolumesNegativeTest-977149100 tempest-VolumesNegativeTest-977149100-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:54.294964 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f7eb0497-c8f5-455c-9c33-1266e33b2982 tempest-VolumesNegativeTest-977149100 tempest-VolumesNegativeTest-977149100-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:54.295702 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f7eb0497-c8f5-455c-9c33-1266e33b2982 tempest-VolumesNegativeTest-977149100 tempest-VolumesNegativeTest-977149100-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:54.296538 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f7eb0497-c8f5-455c-9c33-1266e33b2982 tempest-VolumesNegativeTest-977149100 tempest-VolumesNegativeTest-977149100-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:54.299775 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f7eb0497-c8f5-455c-9c33-1266e33b2982 tempest-VolumesNegativeTest-977149100 tempest-VolumesNegativeTest-977149100-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:54.300494 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f7eb0497-c8f5-455c-9c33-1266e33b2982 tempest-VolumesNegativeTest-977149100 tempest-VolumesNegativeTest-977149100-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:54.300663 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-931dcf45-6d65-4eb9-ada5-26f67f739064 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:54.301139 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-931dcf45-6d65-4eb9-ada5-26f67f739064 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:54.301901 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-931dcf45-6d65-4eb9-ada5-26f67f739064 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:54.302401 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-931dcf45-6d65-4eb9-ada5-26f67f739064 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:54.302887 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-931dcf45-6d65-4eb9-ada5-26f67f739064 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:54.651771 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-f7eb0497-c8f5-455c-9c33-1266e33b2982 tempest-VolumesNegativeTest-977149100 tempest-VolumesNegativeTest-977149100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b3399a2b4345cdb88cf19b13c3a939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f259e7a121184313836a68277c2a08df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:54.699236 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-f7eb0497-c8f5-455c-9c33-1266e33b2982 tempest-VolumesNegativeTest-977149100 tempest-VolumesNegativeTest-977149100-project] 10.222.0.33 "GET /compute/v2.1/servers/3dfe17e2-88e8-49d3-b21a-f0f4cd97da75" status: 200 len: 1300 microversion: 2.1 time: 0.423356 Oct 04 21:08:54.702062 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2816/5603] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:08:54 2022] GET /compute/v2.1/servers/3dfe17e2-88e8-49d3-b21a-f0f4cd97da75 => generated 1300 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:08:54.952590 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-931dcf45-6d65-4eb9-ada5-26f67f739064 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5dbe3da6a4af181ef7302fe605fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3aa23aee3c8435c8f1f409019c5fed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:54.965758 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-931dcf45-6d65-4eb9-ada5-26f67f739064 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] 10.222.0.33 "GET /compute/v2.1/servers/bf706904-01fc-408d-a24e-0efb6de3e74f" status: 200 len: 1691 microversion: 2.1 time: 0.698303 Oct 04 21:08:54.969229 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2788/5604] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:08:54 2022] GET /compute/v2.1/servers/bf706904-01fc-408d-a24e-0efb6de3e74f => generated 1691 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:08:55.736001 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-b160ae5f-eb17-4f9d-a5f5-bb959667ddd7 tempest-VolumesNegativeTest-977149100 tempest-VolumesNegativeTest-977149100-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:55.737020 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-b160ae5f-eb17-4f9d-a5f5-bb959667ddd7 tempest-VolumesNegativeTest-977149100 tempest-VolumesNegativeTest-977149100-project] [instance: 3dfe17e2-88e8-49d3-b21a-f0f4cd97da75] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:55.751907 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b160ae5f-eb17-4f9d-a5f5-bb959667ddd7 tempest-VolumesNegativeTest-977149100 tempest-VolumesNegativeTest-977149100-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:55.754112 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b160ae5f-eb17-4f9d-a5f5-bb959667ddd7 tempest-VolumesNegativeTest-977149100 tempest-VolumesNegativeTest-977149100-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:55.755894 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b160ae5f-eb17-4f9d-a5f5-bb959667ddd7 tempest-VolumesNegativeTest-977149100 tempest-VolumesNegativeTest-977149100-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:55.786094 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b160ae5f-eb17-4f9d-a5f5-bb959667ddd7 tempest-VolumesNegativeTest-977149100 tempest-VolumesNegativeTest-977149100-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:55.787249 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b160ae5f-eb17-4f9d-a5f5-bb959667ddd7 tempest-VolumesNegativeTest-977149100 tempest-VolumesNegativeTest-977149100-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.032s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:55.789387 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b160ae5f-eb17-4f9d-a5f5-bb959667ddd7 tempest-VolumesNegativeTest-977149100 tempest-VolumesNegativeTest-977149100-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:55.856620 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.wsgi [None req-b160ae5f-eb17-4f9d-a5f5-bb959667ddd7 tempest-VolumesNegativeTest-977149100 tempest-VolumesNegativeTest-977149100-project] HTTP exception thrown: Instance 3dfe17e2-88e8-49d3-b21a-f0f4cd97da75 could not be found. Oct 04 21:08:55.869245 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-b160ae5f-eb17-4f9d-a5f5-bb959667ddd7 tempest-VolumesNegativeTest-977149100 tempest-VolumesNegativeTest-977149100-project] Request method failure captured: Oct 04 21:08:55.869245 n-d-854823-8 devstack@n-api.service[128802]: request: GET /compute/v2.1/servers/3dfe17e2-88e8-49d3-b21a-f0f4cd97da75 HTTP/1.1 Oct 04 21:08:55.869245 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 21:08:55.869245 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 21:08:55.869245 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 21:08:55.869245 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 0 Oct 04 21:08:55.869245 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 21:08:55.869245 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 21:08:55.869245 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 21:08:55.869245 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 21:08:55.869245 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPKDKAhQ71sS4MKVGiTnuy_XK8cKvz6z41lSF9FjK53fuYWWPW41JcoJT7I0ZB1i-hmA4omkIl8jSwfCcbk6ca_UoGEB0YN4Ui7h4W_3fV4k2Wd5gSZXvOfreOHcnc5a1Mocd0od1MTj77anSs59qLr_OPyBiWlXTnOPjTayeVYxFezg Oct 04 21:08:55.869245 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 21:08:55.869245 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 21:08:55.869245 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 21:08:55.869245 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 21:08:55.869245 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 21:08:55.869245 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 21:08:55.869245 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: f259e7a121184313836a68277c2a08df Oct 04 21:08:55.869245 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-VolumesNegativeTest-977149100 Oct 04 21:08:55.869245 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 21:08:55.869245 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 21:08:55.869245 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f259e7a121184313836a68277c2a08df", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f259e7a121184313836a68277c2a08df"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f259e7a121184313836a68277c2a08df"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f259e7a121184313836a68277c2a08df"}]}] Oct 04 21:08:55.869245 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-VolumesNegativeTest-977149100 Oct 04 21:08:55.869245 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: f259e7a121184313836a68277c2a08df Oct 04 21:08:55.869245 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-VolumesNegativeTest-977149100 Oct 04 21:08:55.869245 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-VolumesNegativeTest-977149100-project Oct 04 21:08:55.869245 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 21:08:55.869245 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 21:08:55.869245 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: 37b3399a2b4345cdb88cf19b13c3a939 Oct 04 21:08:55.869245 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-VolumesNegativeTest-977149100-project Oct 04 21:08:55.869245 n-d-854823-8 devstack@n-api.service[128802]: method: > Oct 04 21:08:55.869245 n-d-854823-8 devstack@n-api.service[128802]: exception: Instance 3dfe17e2-88e8-49d3-b21a-f0f4cd97da75 could not be found. Oct 04 21:08:55.869245 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'id': '3dfe17e2-88e8-49d3-b21a-f0f4cd97da75'} Oct 04 21:08:55.869245 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:08:55.869245 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:08:55.869245 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:08:55.869245 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:08:55.869245 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:08:55.869245 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:08:55.869245 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:08:55.869245 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:08:55.869245 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:08:55.869245 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:08:55.869245 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3dfe17e2-88e8-49d3-b21a-f0f4cd97da75 could not be found. Oct 04 21:08:55.869245 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:08:55.869245 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:08:55.869245 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:08:55.869245 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:08:55.869245 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:08:55.869245 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:08:55.869245 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:08:55.869245 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:08:55.869245 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:08:55.869245 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:08:55.869245 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:08:55.869245 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:08:55.869245 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:08:55.869245 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:08:55.869245 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:08:55.869245 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:08:55.869245 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3dfe17e2-88e8-49d3-b21a-f0f4cd97da75 could not be found. Oct 04 21:08:55.869245 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:08:55.869245 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:08:55.869245 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:08:55.875006 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:08:55.875006 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:08:55.875006 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:08:55.875006 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:08:55.875006 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:08:55.875006 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3dfe17e2-88e8-49d3-b21a-f0f4cd97da75 could not be found. Oct 04 21:08:55.875006 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:08:55.875006 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-b160ae5f-eb17-4f9d-a5f5-bb959667ddd7 tempest-VolumesNegativeTest-977149100 tempest-VolumesNegativeTest-977149100-project] Returning 404 to user: Instance 3dfe17e2-88e8-49d3-b21a-f0f4cd97da75 could not be found. {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:08:55.875006 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-b160ae5f-eb17-4f9d-a5f5-bb959667ddd7 tempest-VolumesNegativeTest-977149100 tempest-VolumesNegativeTest-977149100-project] 10.222.0.33 "GET /compute/v2.1/servers/3dfe17e2-88e8-49d3-b21a-f0f4cd97da75" status: 404 len: 111 microversion: 2.1 time: 0.142905 Oct 04 21:08:55.878549 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2817/5605] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:08:55 2022] GET /compute/v2.1/servers/3dfe17e2-88e8-49d3-b21a-f0f4cd97da75 => generated 111 bytes in 147 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:08:56.577273 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a2100ed4-2015-44b1-869f-c8e00654c32c tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:56.578559 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a2100ed4-2015-44b1-869f-c8e00654c32c tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] [instance: bf706904-01fc-408d-a24e-0efb6de3e74f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:56.591231 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a2100ed4-2015-44b1-869f-c8e00654c32c tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:56.594694 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a2100ed4-2015-44b1-869f-c8e00654c32c tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:56.595365 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a2100ed4-2015-44b1-869f-c8e00654c32c tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:56.596288 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a2100ed4-2015-44b1-869f-c8e00654c32c tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:56.607510 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a2100ed4-2015-44b1-869f-c8e00654c32c tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:56.608274 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a2100ed4-2015-44b1-869f-c8e00654c32c tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:57.030913 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-a2100ed4-2015-44b1-869f-c8e00654c32c tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5dbe3da6a4af181ef7302fe605fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3aa23aee3c8435c8f1f409019c5fed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:57.040996 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a2100ed4-2015-44b1-869f-c8e00654c32c tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] 10.222.0.33 "GET /compute/v2.1/servers/bf706904-01fc-408d-a24e-0efb6de3e74f" status: 200 len: 1691 microversion: 2.1 time: 1.050334 Oct 04 21:08:57.042423 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2789/5606] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:08:55 2022] GET /compute/v2.1/servers/bf706904-01fc-408d-a24e-0efb6de3e74f => generated 1691 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:08:58.076993 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-6e2085ed-a0a2-4e89-957a-f44c87cd740e tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:58.083499 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-6e2085ed-a0a2-4e89-957a-f44c87cd740e tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] [instance: bf706904-01fc-408d-a24e-0efb6de3e74f] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:58.105205 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6e2085ed-a0a2-4e89-957a-f44c87cd740e tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:58.106317 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6e2085ed-a0a2-4e89-957a-f44c87cd740e tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:58.111223 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6e2085ed-a0a2-4e89-957a-f44c87cd740e tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:58.114605 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6e2085ed-a0a2-4e89-957a-f44c87cd740e tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:58.115410 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6e2085ed-a0a2-4e89-957a-f44c87cd740e tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:58.118515 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6e2085ed-a0a2-4e89-957a-f44c87cd740e tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:58.366055 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-6e2085ed-a0a2-4e89-957a-f44c87cd740e tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5dbe3da6a4af181ef7302fe605fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3aa23aee3c8435c8f1f409019c5fed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:58.378199 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-6e2085ed-a0a2-4e89-957a-f44c87cd740e tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] 10.222.0.33 "GET /compute/v2.1/servers/bf706904-01fc-408d-a24e-0efb6de3e74f" status: 200 len: 1691 microversion: 2.1 time: 0.310929 Oct 04 21:08:58.378829 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2818/5607] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:08:58 2022] GET /compute/v2.1/servers/bf706904-01fc-408d-a24e-0efb6de3e74f => generated 1691 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:08:59.405960 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0eea63a1-a3e1-4272-b045-a61475288fc1 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:08:59.406675 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-0eea63a1-a3e1-4272-b045-a61475288fc1 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] [instance: bf706904-01fc-408d-a24e-0efb6de3e74f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:08:59.419012 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:08:59.426675 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0eea63a1-a3e1-4272-b045-a61475288fc1 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:59.427233 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0eea63a1-a3e1-4272-b045-a61475288fc1 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:59.427691 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0eea63a1-a3e1-4272-b045-a61475288fc1 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:59.428807 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0eea63a1-a3e1-4272-b045-a61475288fc1 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:08:59.429441 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0eea63a1-a3e1-4272-b045-a61475288fc1 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:08:59.430009 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0eea63a1-a3e1-4272-b045-a61475288fc1 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:08:59.826861 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-0eea63a1-a3e1-4272-b045-a61475288fc1 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5dbe3da6a4af181ef7302fe605fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3aa23aee3c8435c8f1f409019c5fed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:08:59.841912 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-0eea63a1-a3e1-4272-b045-a61475288fc1 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] 10.222.0.33 "GET /compute/v2.1/servers/bf706904-01fc-408d-a24e-0efb6de3e74f" status: 200 len: 1691 microversion: 2.1 time: 0.435463 Oct 04 21:08:59.852302 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2790/5608] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:08:59 2022] GET /compute/v2.1/servers/bf706904-01fc-408d-a24e-0efb6de3e74f => generated 1691 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:09:00.889373 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-4eed7144-75bf-4644-b877-c4b894e56838 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:00.890798 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-4eed7144-75bf-4644-b877-c4b894e56838 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] [instance: bf706904-01fc-408d-a24e-0efb6de3e74f] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:00.908193 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=3 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:09:00.916072 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4eed7144-75bf-4644-b877-c4b894e56838 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:00.916577 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4eed7144-75bf-4644-b877-c4b894e56838 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:00.917021 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4eed7144-75bf-4644-b877-c4b894e56838 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:00.917752 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4eed7144-75bf-4644-b877-c4b894e56838 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:00.918203 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4eed7144-75bf-4644-b877-c4b894e56838 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:00.918667 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4eed7144-75bf-4644-b877-c4b894e56838 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:01.203480 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-4eed7144-75bf-4644-b877-c4b894e56838 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5dbe3da6a4af181ef7302fe605fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3aa23aee3c8435c8f1f409019c5fed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:01.213896 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-4eed7144-75bf-4644-b877-c4b894e56838 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] 10.222.0.33 "GET /compute/v2.1/servers/bf706904-01fc-408d-a24e-0efb6de3e74f" status: 200 len: 1691 microversion: 2.1 time: 0.330233 Oct 04 21:09:01.227217 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2819/5609] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:00 2022] GET /compute/v2.1/servers/bf706904-01fc-408d-a24e-0efb6de3e74f => generated 1691 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:09:02.239250 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d234f650-9a34-43b7-923b-d876b933c75b tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:02.241017 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d234f650-9a34-43b7-923b-d876b933c75b tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] [instance: bf706904-01fc-408d-a24e-0efb6de3e74f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:02.252716 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d234f650-9a34-43b7-923b-d876b933c75b tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:02.257317 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d234f650-9a34-43b7-923b-d876b933c75b tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:02.258528 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d234f650-9a34-43b7-923b-d876b933c75b tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:02.261672 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d234f650-9a34-43b7-923b-d876b933c75b tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:02.262453 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d234f650-9a34-43b7-923b-d876b933c75b tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:02.263067 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d234f650-9a34-43b7-923b-d876b933c75b tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:02.609606 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d234f650-9a34-43b7-923b-d876b933c75b tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5dbe3da6a4af181ef7302fe605fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3aa23aee3c8435c8f1f409019c5fed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:02.618233 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d234f650-9a34-43b7-923b-d876b933c75b tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] 10.222.0.33 "GET /compute/v2.1/servers/bf706904-01fc-408d-a24e-0efb6de3e74f" status: 200 len: 1691 microversion: 2.1 time: 0.383197 Oct 04 21:09:02.635890 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2791/5610] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:02 2022] GET /compute/v2.1/servers/bf706904-01fc-408d-a24e-0efb6de3e74f => generated 1691 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:09:03.642937 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-5d5d79c5-0a52-471b-9e1a-e4cc80a3133a tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:03.644364 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-5d5d79c5-0a52-471b-9e1a-e4cc80a3133a tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] [instance: bf706904-01fc-408d-a24e-0efb6de3e74f] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:03.657245 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5d5d79c5-0a52-471b-9e1a-e4cc80a3133a tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:03.657815 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5d5d79c5-0a52-471b-9e1a-e4cc80a3133a tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:03.658328 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5d5d79c5-0a52-471b-9e1a-e4cc80a3133a tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:03.667297 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5d5d79c5-0a52-471b-9e1a-e4cc80a3133a tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:03.668343 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5d5d79c5-0a52-471b-9e1a-e4cc80a3133a tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:03.668997 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5d5d79c5-0a52-471b-9e1a-e4cc80a3133a tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:03.730230 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7ec59051-84a7-4df5-9e8f-be84082565f7 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1413379945", "imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63", "flavorRef": "452", "networks": [{"uuid": "1974c5bd-a4dc-4438-af13-f1fe0a2d00b4"}]}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:09:03.835975 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.network.neutron [None req-7ec59051-84a7-4df5-9e8f-be84082565f7 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] validate_networks() for [('1974c5bd-a4dc-4438-af13-f1fe0a2d00b4', None, None, None, None, None)] {{(pid=128801) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:09:04.166032 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-5d5d79c5-0a52-471b-9e1a-e4cc80a3133a tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5dbe3da6a4af181ef7302fe605fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3aa23aee3c8435c8f1f409019c5fed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:04.176710 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-5d5d79c5-0a52-471b-9e1a-e4cc80a3133a tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] 10.222.0.33 "GET /compute/v2.1/servers/bf706904-01fc-408d-a24e-0efb6de3e74f" status: 200 len: 1691 microversion: 2.1 time: 0.537526 Oct 04 21:09:04.177323 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2820/5611] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:03 2022] GET /compute/v2.1/servers/bf706904-01fc-408d-a24e-0efb6de3e74f => generated 1691 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:09:04.516318 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-7ec59051-84a7-4df5-9e8f-be84082565f7 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Flavor limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:09:04.517244 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-7ec59051-84a7-4df5-9e8f-be84082565f7 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Image limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:09:04.518002 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-7ec59051-84a7-4df5-9e8f-be84082565f7 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Flavor pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:09:04.518771 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-7ec59051-84a7-4df5-9e8f-be84082565f7 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Image pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:09:04.519485 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-7ec59051-84a7-4df5-9e8f-be84082565f7 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:09:04.541159 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7ec59051-84a7-4df5-9e8f-be84082565f7 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:04.542818 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7ec59051-84a7-4df5-9e8f-be84082565f7 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:04.544049 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7ec59051-84a7-4df5-9e8f-be84082565f7 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:04.545644 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7ec59051-84a7-4df5-9e8f-be84082565f7 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:04.547289 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7ec59051-84a7-4df5-9e8f-be84082565f7 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:04.548746 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7ec59051-84a7-4df5-9e8f-be84082565f7 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:04.604369 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-7ec59051-84a7-4df5-9e8f-be84082565f7 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Getting quotas for project d864e32279184978bd6f990dd83f8091. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:09:04.616690 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-7ec59051-84a7-4df5-9e8f-be84082565f7 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Getting quotas for user 5aa165b905a34b1a86aeea1e28232cad and project d864e32279184978bd6f990dd83f8091. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:09:04.650169 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-7ec59051-84a7-4df5-9e8f-be84082565f7 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Going to run 1 instances... {{(pid=128801) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:09:04.655574 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-7ec59051-84a7-4df5-9e8f-be84082565f7 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] [instance: 202ca1b3-71fc-440c-993a-3d05300d96a4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='15b24725-0c99-4bcf-b1fb-907cdf8e2d63',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128801) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:09:04.762316 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-7ec59051-84a7-4df5-9e8f-be84082565f7 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.036191 Oct 04 21:09:04.857757 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2792/5612] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 21:09:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 1132 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 21:09:04.869531 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-5dec8461-ecb1-41d0-b043-fbf4dbb80c07 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:04.870880 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-5dec8461-ecb1-41d0-b043-fbf4dbb80c07 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] [instance: 202ca1b3-71fc-440c-993a-3d05300d96a4] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:05.004598 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-5dec8461-ecb1-41d0-b043-fbf4dbb80c07 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa165b905a34b1a86aeea1e28232cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd864e32279184978bd6f990dd83f8091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:05.012337 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-5dec8461-ecb1-41d0-b043-fbf4dbb80c07 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] 10.222.0.33 "GET /compute/v2.1/servers/202ca1b3-71fc-440c-993a-3d05300d96a4" status: 200 len: 1214 microversion: 2.1 time: 0.147725 Oct 04 21:09:05.027637 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2821/5613] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:04 2022] GET /compute/v2.1/servers/202ca1b3-71fc-440c-993a-3d05300d96a4 => generated 1214 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:09:05.208832 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-56e9d085-e8f4-4d1c-88da-1e167167d4c9 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:05.210327 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-56e9d085-e8f4-4d1c-88da-1e167167d4c9 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] [instance: bf706904-01fc-408d-a24e-0efb6de3e74f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:05.230172 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-56e9d085-e8f4-4d1c-88da-1e167167d4c9 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:05.231774 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-56e9d085-e8f4-4d1c-88da-1e167167d4c9 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:05.234988 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-56e9d085-e8f4-4d1c-88da-1e167167d4c9 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:05.236211 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-56e9d085-e8f4-4d1c-88da-1e167167d4c9 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:05.237166 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-56e9d085-e8f4-4d1c-88da-1e167167d4c9 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:05.237861 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-56e9d085-e8f4-4d1c-88da-1e167167d4c9 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:05.548041 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-56e9d085-e8f4-4d1c-88da-1e167167d4c9 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5dbe3da6a4af181ef7302fe605fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3aa23aee3c8435c8f1f409019c5fed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:05.558604 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-56e9d085-e8f4-4d1c-88da-1e167167d4c9 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] 10.222.0.33 "GET /compute/v2.1/servers/bf706904-01fc-408d-a24e-0efb6de3e74f" status: 200 len: 1691 microversion: 2.1 time: 0.354882 Oct 04 21:09:05.564155 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2793/5614] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:05 2022] GET /compute/v2.1/servers/bf706904-01fc-408d-a24e-0efb6de3e74f => generated 1691 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:09:06.040729 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-fe3bad7f-3458-4ccf-8106-f78fcd237030 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:06.042002 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-fe3bad7f-3458-4ccf-8106-f78fcd237030 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] [instance: 202ca1b3-71fc-440c-993a-3d05300d96a4] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:06.061016 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fe3bad7f-3458-4ccf-8106-f78fcd237030 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:06.062148 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fe3bad7f-3458-4ccf-8106-f78fcd237030 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:06.062920 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fe3bad7f-3458-4ccf-8106-f78fcd237030 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:06.064363 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fe3bad7f-3458-4ccf-8106-f78fcd237030 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:06.065655 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fe3bad7f-3458-4ccf-8106-f78fcd237030 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:06.066413 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fe3bad7f-3458-4ccf-8106-f78fcd237030 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:06.126899 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:09:06.206862 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-fe3bad7f-3458-4ccf-8106-f78fcd237030 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa165b905a34b1a86aeea1e28232cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd864e32279184978bd6f990dd83f8091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:06.223608 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-fe3bad7f-3458-4ccf-8106-f78fcd237030 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] 10.222.0.33 "GET /compute/v2.1/servers/202ca1b3-71fc-440c-993a-3d05300d96a4" status: 200 len: 1210 microversion: 2.1 time: 0.188317 Oct 04 21:09:06.224577 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2822/5615] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:06 2022] GET /compute/v2.1/servers/202ca1b3-71fc-440c-993a-3d05300d96a4 => generated 1210 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:09:06.593669 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-cd323613-9ef1-4f03-9ad5-4f9f2174a983 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:06.594298 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-cd323613-9ef1-4f03-9ad5-4f9f2174a983 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] [instance: bf706904-01fc-408d-a24e-0efb6de3e74f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:06.623524 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cd323613-9ef1-4f03-9ad5-4f9f2174a983 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:06.624382 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cd323613-9ef1-4f03-9ad5-4f9f2174a983 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:06.625024 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cd323613-9ef1-4f03-9ad5-4f9f2174a983 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:06.625994 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cd323613-9ef1-4f03-9ad5-4f9f2174a983 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:06.626704 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cd323613-9ef1-4f03-9ad5-4f9f2174a983 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:06.628033 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cd323613-9ef1-4f03-9ad5-4f9f2174a983 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:07.254960 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-e92aebc6-5d4c-4e87-9882-4dfb844827db tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:07.256448 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-e92aebc6-5d4c-4e87-9882-4dfb844827db tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] [instance: 202ca1b3-71fc-440c-993a-3d05300d96a4] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:07.274485 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e92aebc6-5d4c-4e87-9882-4dfb844827db tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:07.278149 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e92aebc6-5d4c-4e87-9882-4dfb844827db tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:07.279947 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e92aebc6-5d4c-4e87-9882-4dfb844827db tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:07.281583 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e92aebc6-5d4c-4e87-9882-4dfb844827db tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:07.283312 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e92aebc6-5d4c-4e87-9882-4dfb844827db tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:07.284645 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e92aebc6-5d4c-4e87-9882-4dfb844827db tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:07.816896 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-e92aebc6-5d4c-4e87-9882-4dfb844827db tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa165b905a34b1a86aeea1e28232cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd864e32279184978bd6f990dd83f8091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:07.836052 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-e92aebc6-5d4c-4e87-9882-4dfb844827db tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] 10.222.0.33 "GET /compute/v2.1/servers/202ca1b3-71fc-440c-993a-3d05300d96a4" status: 200 len: 1272 microversion: 2.1 time: 0.585758 Oct 04 21:09:07.837036 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2823/5616] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:07 2022] GET /compute/v2.1/servers/202ca1b3-71fc-440c-993a-3d05300d96a4 => generated 1272 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:09:07.906449 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-cd323613-9ef1-4f03-9ad5-4f9f2174a983 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5dbe3da6a4af181ef7302fe605fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3aa23aee3c8435c8f1f409019c5fed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:07.931588 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-cd323613-9ef1-4f03-9ad5-4f9f2174a983 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] 10.222.0.33 "GET /compute/v2.1/servers/bf706904-01fc-408d-a24e-0efb6de3e74f" status: 200 len: 1697 microversion: 2.1 time: 1.347025 Oct 04 21:09:07.933824 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2794/5617] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:06 2022] GET /compute/v2.1/servers/bf706904-01fc-408d-a24e-0efb6de3e74f => generated 1697 bytes in 1352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:09:08.861358 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-31d13036-0740-4623-8960-b684908d1d55 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:08.862106 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-31d13036-0740-4623-8960-b684908d1d55 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] [instance: 202ca1b3-71fc-440c-993a-3d05300d96a4] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:08.879918 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-31d13036-0740-4623-8960-b684908d1d55 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:08.885519 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-31d13036-0740-4623-8960-b684908d1d55 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:08.886206 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-31d13036-0740-4623-8960-b684908d1d55 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:08.887144 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-31d13036-0740-4623-8960-b684908d1d55 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:08.887802 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-31d13036-0740-4623-8960-b684908d1d55 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:08.888400 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-31d13036-0740-4623-8960-b684908d1d55 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:08.967676 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7e0b0d97-5d70-4b14-ae30-77e6d965c1f1 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:08.970121 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-7e0b0d97-5d70-4b14-ae30-77e6d965c1f1 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] [instance: bf706904-01fc-408d-a24e-0efb6de3e74f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:08.978989 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7e0b0d97-5d70-4b14-ae30-77e6d965c1f1 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:08.979506 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7e0b0d97-5d70-4b14-ae30-77e6d965c1f1 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:08.979967 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7e0b0d97-5d70-4b14-ae30-77e6d965c1f1 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:08.980716 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7e0b0d97-5d70-4b14-ae30-77e6d965c1f1 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:08.981194 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7e0b0d97-5d70-4b14-ae30-77e6d965c1f1 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:08.981648 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7e0b0d97-5d70-4b14-ae30-77e6d965c1f1 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:09.609824 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-7e0b0d97-5d70-4b14-ae30-77e6d965c1f1 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5dbe3da6a4af181ef7302fe605fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3aa23aee3c8435c8f1f409019c5fed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:09.627643 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-31d13036-0740-4623-8960-b684908d1d55 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa165b905a34b1a86aeea1e28232cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd864e32279184978bd6f990dd83f8091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:09.628675 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-7e0b0d97-5d70-4b14-ae30-77e6d965c1f1 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] 10.222.0.33 "GET /compute/v2.1/servers/bf706904-01fc-408d-a24e-0efb6de3e74f" status: 200 len: 1697 microversion: 2.1 time: 0.666062 Oct 04 21:09:09.629411 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2795/5618] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:08 2022] GET /compute/v2.1/servers/bf706904-01fc-408d-a24e-0efb6de3e74f => generated 1697 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:09:09.653715 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-31d13036-0740-4623-8960-b684908d1d55 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] 10.222.0.33 "GET /compute/v2.1/servers/202ca1b3-71fc-440c-993a-3d05300d96a4" status: 200 len: 1314 microversion: 2.1 time: 0.796378 Oct 04 21:09:09.654395 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2824/5619] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:08 2022] GET /compute/v2.1/servers/202ca1b3-71fc-440c-993a-3d05300d96a4 => generated 1314 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:09:10.657876 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-82e2f757-7083-4224-94dd-20eb7d4002cd tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:10.659530 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-82e2f757-7083-4224-94dd-20eb7d4002cd tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] [instance: bf706904-01fc-408d-a24e-0efb6de3e74f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:10.669882 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-82e2f757-7083-4224-94dd-20eb7d4002cd tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:10.676704 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-82e2f757-7083-4224-94dd-20eb7d4002cd tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:10.678943 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-82e2f757-7083-4224-94dd-20eb7d4002cd tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:10.683501 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-82e2f757-7083-4224-94dd-20eb7d4002cd tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:10.684326 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-82e2f757-7083-4224-94dd-20eb7d4002cd tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:10.685256 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-82e2f757-7083-4224-94dd-20eb7d4002cd tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:10.687816 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-fb7760b8-b97f-4c97-8c4e-318468cbe16b tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:10.689619 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-fb7760b8-b97f-4c97-8c4e-318468cbe16b tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] [instance: 202ca1b3-71fc-440c-993a-3d05300d96a4] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:10.701919 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fb7760b8-b97f-4c97-8c4e-318468cbe16b tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:10.702720 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fb7760b8-b97f-4c97-8c4e-318468cbe16b tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:10.703507 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fb7760b8-b97f-4c97-8c4e-318468cbe16b tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:10.704407 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fb7760b8-b97f-4c97-8c4e-318468cbe16b tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:10.705084 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fb7760b8-b97f-4c97-8c4e-318468cbe16b tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:10.705714 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fb7760b8-b97f-4c97-8c4e-318468cbe16b tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:11.151920 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-82e2f757-7083-4224-94dd-20eb7d4002cd tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5dbe3da6a4af181ef7302fe605fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3aa23aee3c8435c8f1f409019c5fed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:11.175176 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-82e2f757-7083-4224-94dd-20eb7d4002cd tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] 10.222.0.33 "GET /compute/v2.1/servers/bf706904-01fc-408d-a24e-0efb6de3e74f" status: 200 len: 1682 microversion: 2.1 time: 0.507817 Oct 04 21:09:11.175176 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2796/5620] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:10 2022] GET /compute/v2.1/servers/bf706904-01fc-408d-a24e-0efb6de3e74f => generated 1682 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:09:11.314174 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-fb7760b8-b97f-4c97-8c4e-318468cbe16b tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa165b905a34b1a86aeea1e28232cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd864e32279184978bd6f990dd83f8091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:11.330335 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-fb7760b8-b97f-4c97-8c4e-318468cbe16b tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] 10.222.0.33 "GET /compute/v2.1/servers/202ca1b3-71fc-440c-993a-3d05300d96a4" status: 200 len: 1314 microversion: 2.1 time: 0.647690 Oct 04 21:09:11.335879 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2825/5621] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:10 2022] GET /compute/v2.1/servers/202ca1b3-71fc-440c-993a-3d05300d96a4 => generated 1314 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:09:11.735526 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-8699d17e-23ea-4ea6-aad0-a8db687f13ff req-ace91393-5363-4206-8aca-5bb7fe4219d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf706904-01fc-408d-a24e-0efb6de3e74f", "name": "network-vif-plugged", "status": "completed", "tag": "3505d3a9-94c4-427f-bb78-acac62fbee83"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:09:11.774050 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-8699d17e-23ea-4ea6-aad0-a8db687f13ff req-ace91393-5363-4206-8aca-5bb7fe4219d5 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:11.775803 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-8699d17e-23ea-4ea6-aad0-a8db687f13ff req-ace91393-5363-4206-8aca-5bb7fe4219d5 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:11.776444 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-8699d17e-23ea-4ea6-aad0-a8db687f13ff req-ace91393-5363-4206-8aca-5bb7fe4219d5 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:11.795365 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-8699d17e-23ea-4ea6-aad0-a8db687f13ff req-ace91393-5363-4206-8aca-5bb7fe4219d5 service nova] Creating event network-vif-plugged:3505d3a9-94c4-427f-bb78-acac62fbee83 for instance bf706904-01fc-408d-a24e-0efb6de3e74f on n-h2-854823-8 Oct 04 21:09:11.801001 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-8699d17e-23ea-4ea6-aad0-a8db687f13ff req-ace91393-5363-4206-8aca-5bb7fe4219d5 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070449 Oct 04 21:09:11.803383 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2797/5622] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:09:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:09:11.952172 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-b53b31fd-2310-4870-8470-7883d32fd81b req-87273201-e7cc-4cb1-844f-9c9dc1adda07 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "202ca1b3-71fc-440c-993a-3d05300d96a4", "tag": "3ed9c207-4015-490d-a798-d763455068aa"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:09:11.975711 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-b53b31fd-2310-4870-8470-7883d32fd81b req-87273201-e7cc-4cb1-844f-9c9dc1adda07 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:11.976776 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-b53b31fd-2310-4870-8470-7883d32fd81b req-87273201-e7cc-4cb1-844f-9c9dc1adda07 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:11.977454 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-b53b31fd-2310-4870-8470-7883d32fd81b req-87273201-e7cc-4cb1-844f-9c9dc1adda07 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:12.003281 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-b53b31fd-2310-4870-8470-7883d32fd81b req-87273201-e7cc-4cb1-844f-9c9dc1adda07 service nova] Creating event network-changed:3ed9c207-4015-490d-a798-d763455068aa for instance 202ca1b3-71fc-440c-993a-3d05300d96a4 on n-h1-854823-8 Oct 04 21:09:12.017174 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-b53b31fd-2310-4870-8470-7883d32fd81b req-87273201-e7cc-4cb1-844f-9c9dc1adda07 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070521 Oct 04 21:09:12.018523 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2826/5623] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:09:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:09:12.383186 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-196b4a20-7f92-4f00-878f-c4478482febc tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:12.394313 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-196b4a20-7f92-4f00-878f-c4478482febc tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] [instance: 202ca1b3-71fc-440c-993a-3d05300d96a4] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:12.408443 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-196b4a20-7f92-4f00-878f-c4478482febc tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:12.408940 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-196b4a20-7f92-4f00-878f-c4478482febc tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:12.409366 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-196b4a20-7f92-4f00-878f-c4478482febc tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:12.416370 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-196b4a20-7f92-4f00-878f-c4478482febc tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:12.416863 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-196b4a20-7f92-4f00-878f-c4478482febc tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:12.417305 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-196b4a20-7f92-4f00-878f-c4478482febc tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:12.829060 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-196b4a20-7f92-4f00-878f-c4478482febc tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa165b905a34b1a86aeea1e28232cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd864e32279184978bd6f990dd83f8091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:12.844806 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-196b4a20-7f92-4f00-878f-c4478482febc tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] 10.222.0.33 "GET /compute/v2.1/servers/202ca1b3-71fc-440c-993a-3d05300d96a4" status: 200 len: 1314 microversion: 2.1 time: 0.467166 Oct 04 21:09:12.845453 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2798/5624] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:12 2022] GET /compute/v2.1/servers/202ca1b3-71fc-440c-993a-3d05300d96a4 => generated 1314 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:09:13.874444 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-dcecf1db-2cb6-40af-b2d9-d201dcd95bda tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:13.875040 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-dcecf1db-2cb6-40af-b2d9-d201dcd95bda tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] [instance: 202ca1b3-71fc-440c-993a-3d05300d96a4] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:13.889941 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dcecf1db-2cb6-40af-b2d9-d201dcd95bda tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:13.890532 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dcecf1db-2cb6-40af-b2d9-d201dcd95bda tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:13.891308 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dcecf1db-2cb6-40af-b2d9-d201dcd95bda tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:13.892323 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dcecf1db-2cb6-40af-b2d9-d201dcd95bda tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:13.893131 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dcecf1db-2cb6-40af-b2d9-d201dcd95bda tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:13.893922 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dcecf1db-2cb6-40af-b2d9-d201dcd95bda tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:14.276279 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-dcecf1db-2cb6-40af-b2d9-d201dcd95bda tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa165b905a34b1a86aeea1e28232cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd864e32279184978bd6f990dd83f8091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:14.307161 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-dcecf1db-2cb6-40af-b2d9-d201dcd95bda tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] 10.222.0.33 "GET /compute/v2.1/servers/202ca1b3-71fc-440c-993a-3d05300d96a4" status: 200 len: 1314 microversion: 2.1 time: 0.424618 Oct 04 21:09:14.309053 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2827/5625] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:13 2022] GET /compute/v2.1/servers/202ca1b3-71fc-440c-993a-3d05300d96a4 => generated 1314 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:09:15.335638 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-860b2bcb-2ce5-473d-a0f7-b68ef6b2bc04 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:15.336286 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-860b2bcb-2ce5-473d-a0f7-b68ef6b2bc04 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] [instance: 202ca1b3-71fc-440c-993a-3d05300d96a4] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:15.340774 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:09:15.341529 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=6 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:09:15.363152 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-860b2bcb-2ce5-473d-a0f7-b68ef6b2bc04 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:15.363685 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-860b2bcb-2ce5-473d-a0f7-b68ef6b2bc04 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:15.366856 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-860b2bcb-2ce5-473d-a0f7-b68ef6b2bc04 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:15.368691 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-860b2bcb-2ce5-473d-a0f7-b68ef6b2bc04 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:15.370126 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-860b2bcb-2ce5-473d-a0f7-b68ef6b2bc04 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:15.370804 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-860b2bcb-2ce5-473d-a0f7-b68ef6b2bc04 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:15.628197 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-860b2bcb-2ce5-473d-a0f7-b68ef6b2bc04 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa165b905a34b1a86aeea1e28232cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd864e32279184978bd6f990dd83f8091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:15.638626 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-860b2bcb-2ce5-473d-a0f7-b68ef6b2bc04 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] 10.222.0.33 "GET /compute/v2.1/servers/202ca1b3-71fc-440c-993a-3d05300d96a4" status: 200 len: 1314 microversion: 2.1 time: 0.307644 Oct 04 21:09:15.639905 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2799/5626] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:15 2022] GET /compute/v2.1/servers/202ca1b3-71fc-440c-993a-3d05300d96a4 => generated 1314 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:09:16.670053 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-d5ec9b07-37d7-4c2c-a1ec-2fe68422fa97 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:16.670702 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-d5ec9b07-37d7-4c2c-a1ec-2fe68422fa97 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] [instance: 202ca1b3-71fc-440c-993a-3d05300d96a4] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:16.688267 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell0:SELECT=2 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:09:16.694395 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d5ec9b07-37d7-4c2c-a1ec-2fe68422fa97 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:16.694975 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d5ec9b07-37d7-4c2c-a1ec-2fe68422fa97 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:16.695490 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d5ec9b07-37d7-4c2c-a1ec-2fe68422fa97 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:16.696292 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d5ec9b07-37d7-4c2c-a1ec-2fe68422fa97 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:16.696819 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d5ec9b07-37d7-4c2c-a1ec-2fe68422fa97 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:16.697528 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d5ec9b07-37d7-4c2c-a1ec-2fe68422fa97 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:16.769757 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-4377c92e-7cc5-4815-a993-14682dd8aef6 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:16.772674 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-4377c92e-7cc5-4815-a993-14682dd8aef6 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] [instance: 05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:16.784268 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4377c92e-7cc5-4815-a993-14682dd8aef6 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:16.785057 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4377c92e-7cc5-4815-a993-14682dd8aef6 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:16.787668 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4377c92e-7cc5-4815-a993-14682dd8aef6 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:16.788597 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4377c92e-7cc5-4815-a993-14682dd8aef6 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:16.789242 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4377c92e-7cc5-4815-a993-14682dd8aef6 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:16.789868 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4377c92e-7cc5-4815-a993-14682dd8aef6 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:16.877141 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-4377c92e-7cc5-4815-a993-14682dd8aef6 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] 10.222.0.33 "GET /compute/v2.1/servers/05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.113229 Oct 04 21:09:16.890639 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2800/5627] 10.222.0.33 () {60 vars in 1343 bytes} [Tue Oct 4 21:09:16 2022] GET /compute/v2.1/servers/05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9/os-volume_attachments => generated 25 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:09:16.980688 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-68aba136-d4d0-4b5c-b9e4-fd69e9f4e902 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:16.981250 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-68aba136-d4d0-4b5c-b9e4-fd69e9f4e902 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] [instance: 05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:16.998866 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-68aba136-d4d0-4b5c-b9e4-fd69e9f4e902 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:16.999407 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-68aba136-d4d0-4b5c-b9e4-fd69e9f4e902 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:16.999878 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-68aba136-d4d0-4b5c-b9e4-fd69e9f4e902 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:17.000925 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-68aba136-d4d0-4b5c-b9e4-fd69e9f4e902 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:17.001412 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-68aba136-d4d0-4b5c-b9e4-fd69e9f4e902 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:17.001829 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-68aba136-d4d0-4b5c-b9e4-fd69e9f4e902 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:17.069478 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-68aba136-d4d0-4b5c-b9e4-fd69e9f4e902 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] [instance: 05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9] Going to try to terminate instance {{(pid=128801) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:09:17.071782 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:09:17.106272 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-d5ec9b07-37d7-4c2c-a1ec-2fe68422fa97 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa165b905a34b1a86aeea1e28232cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd864e32279184978bd6f990dd83f8091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:17.118875 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-d5ec9b07-37d7-4c2c-a1ec-2fe68422fa97 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] 10.222.0.33 "GET /compute/v2.1/servers/202ca1b3-71fc-440c-993a-3d05300d96a4" status: 200 len: 1314 microversion: 2.1 time: 0.452765 Oct 04 21:09:17.119780 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2828/5628] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:16 2022] GET /compute/v2.1/servers/202ca1b3-71fc-440c-993a-3d05300d96a4 => generated 1314 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:09:17.309267 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-68aba136-d4d0-4b5c-b9e4-fd69e9f4e902 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] 10.222.0.33 "DELETE /compute/v2.1/servers/05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9" status: 204 len: 0 microversion: 2.20 time: 0.333278 Oct 04 21:09:17.311242 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2801/5629] 10.222.0.33 () {60 vars in 1280 bytes} [Tue Oct 4 21:09:16 2022] DELETE /compute/v2.1/servers/05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 21:09:17.319837 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-ce5f1375-ea62-4d1a-93d1-ad8e2fd425a4 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:17.320535 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-ce5f1375-ea62-4d1a-93d1-ad8e2fd425a4 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] [instance: 05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:17.340296 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ce5f1375-ea62-4d1a-93d1-ad8e2fd425a4 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:17.340849 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ce5f1375-ea62-4d1a-93d1-ad8e2fd425a4 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:17.342211 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ce5f1375-ea62-4d1a-93d1-ad8e2fd425a4 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:17.343707 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ce5f1375-ea62-4d1a-93d1-ad8e2fd425a4 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:17.346271 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ce5f1375-ea62-4d1a-93d1-ad8e2fd425a4 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:17.347027 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ce5f1375-ea62-4d1a-93d1-ad8e2fd425a4 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:17.711720 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-ce5f1375-ea62-4d1a-93d1-ad8e2fd425a4 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:17.729195 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-ce5f1375-ea62-4d1a-93d1-ad8e2fd425a4 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:17.733720 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-ce5f1375-ea62-4d1a-93d1-ad8e2fd425a4 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:17.737808 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-ce5f1375-ea62-4d1a-93d1-ad8e2fd425a4 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] 10.222.0.33 "GET /compute/v2.1/servers/05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9" status: 200 len: 1722 microversion: 2.20 time: 0.419902 Oct 04 21:09:17.739009 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2829/5630] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 21:09:17 2022] GET /compute/v2.1/servers/05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9 => generated 1722 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:09:18.152870 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-3807db92-a24c-443b-a2e6-8bd7a32a64d6 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:18.155995 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-3807db92-a24c-443b-a2e6-8bd7a32a64d6 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] [instance: 202ca1b3-71fc-440c-993a-3d05300d96a4] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:18.177376 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3807db92-a24c-443b-a2e6-8bd7a32a64d6 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:18.183906 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3807db92-a24c-443b-a2e6-8bd7a32a64d6 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:18.184545 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3807db92-a24c-443b-a2e6-8bd7a32a64d6 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:18.185481 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3807db92-a24c-443b-a2e6-8bd7a32a64d6 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:18.186060 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3807db92-a24c-443b-a2e6-8bd7a32a64d6 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:18.186708 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3807db92-a24c-443b-a2e6-8bd7a32a64d6 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:18.537971 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-3807db92-a24c-443b-a2e6-8bd7a32a64d6 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa165b905a34b1a86aeea1e28232cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd864e32279184978bd6f990dd83f8091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:18.552275 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-3807db92-a24c-443b-a2e6-8bd7a32a64d6 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] 10.222.0.33 "GET /compute/v2.1/servers/202ca1b3-71fc-440c-993a-3d05300d96a4" status: 200 len: 1314 microversion: 2.1 time: 0.404522 Oct 04 21:09:18.553596 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2802/5631] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:18 2022] GET /compute/v2.1/servers/202ca1b3-71fc-440c-993a-3d05300d96a4 => generated 1314 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:09:18.769978 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-b7366d64-3c22-4248-9431-d5abcf1f1ce0 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:18.770701 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-b7366d64-3c22-4248-9431-d5abcf1f1ce0 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] [instance: 05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:18.793439 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b7366d64-3c22-4248-9431-d5abcf1f1ce0 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:18.793439 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b7366d64-3c22-4248-9431-d5abcf1f1ce0 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:18.793439 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b7366d64-3c22-4248-9431-d5abcf1f1ce0 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:18.793439 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b7366d64-3c22-4248-9431-d5abcf1f1ce0 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:18.794729 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b7366d64-3c22-4248-9431-d5abcf1f1ce0 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:18.795462 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b7366d64-3c22-4248-9431-d5abcf1f1ce0 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:19.613475 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-536acb6d-118f-4b0d-a181-9ed5171f6cf3 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:19.614636 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-536acb6d-118f-4b0d-a181-9ed5171f6cf3 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] [instance: 202ca1b3-71fc-440c-993a-3d05300d96a4] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:19.626414 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-536acb6d-118f-4b0d-a181-9ed5171f6cf3 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:19.628007 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-536acb6d-118f-4b0d-a181-9ed5171f6cf3 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:19.629264 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-536acb6d-118f-4b0d-a181-9ed5171f6cf3 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:19.630636 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-536acb6d-118f-4b0d-a181-9ed5171f6cf3 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:19.631989 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-536acb6d-118f-4b0d-a181-9ed5171f6cf3 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:19.632891 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-536acb6d-118f-4b0d-a181-9ed5171f6cf3 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:19.737434 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-b7366d64-3c22-4248-9431-d5abcf1f1ce0 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:19.750901 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-b7366d64-3c22-4248-9431-d5abcf1f1ce0 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:19.755358 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-b7366d64-3c22-4248-9431-d5abcf1f1ce0 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:19.757634 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-b7366d64-3c22-4248-9431-d5abcf1f1ce0 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] 10.222.0.33 "GET /compute/v2.1/servers/05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9" status: 200 len: 1722 microversion: 2.20 time: 0.991684 Oct 04 21:09:19.759785 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2830/5632] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 21:09:18 2022] GET /compute/v2.1/servers/05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9 => generated 1722 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:09:20.088970 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-536acb6d-118f-4b0d-a181-9ed5171f6cf3 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa165b905a34b1a86aeea1e28232cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd864e32279184978bd6f990dd83f8091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:20.108283 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-536acb6d-118f-4b0d-a181-9ed5171f6cf3 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] 10.222.0.33 "GET /compute/v2.1/servers/202ca1b3-71fc-440c-993a-3d05300d96a4" status: 200 len: 1314 microversion: 2.1 time: 0.503873 Oct 04 21:09:20.114510 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2803/5633] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:19 2022] GET /compute/v2.1/servers/202ca1b3-71fc-440c-993a-3d05300d96a4 => generated 1314 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:09:20.787814 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-23fb8a30-e8d4-4e17-bdcc-0b9fa6672fbe tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:20.788429 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-23fb8a30-e8d4-4e17-bdcc-0b9fa6672fbe tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] [instance: 05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:20.808797 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-23fb8a30-e8d4-4e17-bdcc-0b9fa6672fbe tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:20.812314 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-23fb8a30-e8d4-4e17-bdcc-0b9fa6672fbe tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:20.812809 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-23fb8a30-e8d4-4e17-bdcc-0b9fa6672fbe tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:20.813825 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-23fb8a30-e8d4-4e17-bdcc-0b9fa6672fbe tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:20.816116 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-23fb8a30-e8d4-4e17-bdcc-0b9fa6672fbe tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:20.817922 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-23fb8a30-e8d4-4e17-bdcc-0b9fa6672fbe tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:21.016807 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-23fb8a30-e8d4-4e17-bdcc-0b9fa6672fbe tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:21.030163 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-23fb8a30-e8d4-4e17-bdcc-0b9fa6672fbe tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:21.033115 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-23fb8a30-e8d4-4e17-bdcc-0b9fa6672fbe tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:21.042611 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-23fb8a30-e8d4-4e17-bdcc-0b9fa6672fbe tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] 10.222.0.33 "GET /compute/v2.1/servers/05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9" status: 200 len: 1654 microversion: 2.20 time: 0.254325 Oct 04 21:09:21.044115 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2831/5634] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 21:09:20 2022] GET /compute/v2.1/servers/05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9 => generated 1654 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:09:21.136505 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6d23ebbe-61b8-44a4-8d04-dc42bcaa3d50 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:21.137136 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-6d23ebbe-61b8-44a4-8d04-dc42bcaa3d50 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] [instance: 202ca1b3-71fc-440c-993a-3d05300d96a4] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:21.152758 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6d23ebbe-61b8-44a4-8d04-dc42bcaa3d50 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:21.160652 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6d23ebbe-61b8-44a4-8d04-dc42bcaa3d50 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:21.161105 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6d23ebbe-61b8-44a4-8d04-dc42bcaa3d50 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:21.166985 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6d23ebbe-61b8-44a4-8d04-dc42bcaa3d50 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:21.170894 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6d23ebbe-61b8-44a4-8d04-dc42bcaa3d50 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:21.171388 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6d23ebbe-61b8-44a4-8d04-dc42bcaa3d50 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:21.483443 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-fe68d1a0-72cb-4a58-b4b1-ef4e1ff4d5cc req-bec9348e-b063-45fb-b0da-9a7bb5726642 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "202ca1b3-71fc-440c-993a-3d05300d96a4", "name": "network-vif-plugged", "status": "completed", "tag": "3ed9c207-4015-490d-a798-d763455068aa"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:09:21.503568 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-fe68d1a0-72cb-4a58-b4b1-ef4e1ff4d5cc req-bec9348e-b063-45fb-b0da-9a7bb5726642 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:21.511414 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-fe68d1a0-72cb-4a58-b4b1-ef4e1ff4d5cc req-bec9348e-b063-45fb-b0da-9a7bb5726642 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:21.515917 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-fe68d1a0-72cb-4a58-b4b1-ef4e1ff4d5cc req-bec9348e-b063-45fb-b0da-9a7bb5726642 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:21.558447 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-fe68d1a0-72cb-4a58-b4b1-ef4e1ff4d5cc req-bec9348e-b063-45fb-b0da-9a7bb5726642 service nova] Creating event network-vif-plugged:3ed9c207-4015-490d-a798-d763455068aa for instance 202ca1b3-71fc-440c-993a-3d05300d96a4 on n-h1-854823-8 Oct 04 21:09:21.591821 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-fe68d1a0-72cb-4a58-b4b1-ef4e1ff4d5cc req-bec9348e-b063-45fb-b0da-9a7bb5726642 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112739 Oct 04 21:09:21.593211 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2832/5635] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:09:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:09:21.665922 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-6d23ebbe-61b8-44a4-8d04-dc42bcaa3d50 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa165b905a34b1a86aeea1e28232cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd864e32279184978bd6f990dd83f8091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:21.674773 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-6d23ebbe-61b8-44a4-8d04-dc42bcaa3d50 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] 10.222.0.33 "GET /compute/v2.1/servers/202ca1b3-71fc-440c-993a-3d05300d96a4" status: 200 len: 1314 microversion: 2.1 time: 0.544326 Oct 04 21:09:21.695581 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2804/5636] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:21 2022] GET /compute/v2.1/servers/202ca1b3-71fc-440c-993a-3d05300d96a4 => generated 1314 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:09:21.788831 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-8c5cf533-9e03-4c11-819b-11594ff63f4c req-644f40c5-254a-4d5d-998e-bd4716ca6e59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9", "name": "network-vif-deleted", "tag": "2f9889d1-cb04-4ccc-8abc-1f54eb9f493f"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:09:21.807310 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-8c5cf533-9e03-4c11-819b-11594ff63f4c req-644f40c5-254a-4d5d-998e-bd4716ca6e59 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:21.808671 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-8c5cf533-9e03-4c11-819b-11594ff63f4c req-644f40c5-254a-4d5d-998e-bd4716ca6e59 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:21.811652 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-8c5cf533-9e03-4c11-819b-11594ff63f4c req-644f40c5-254a-4d5d-998e-bd4716ca6e59 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:21.844605 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-8c5cf533-9e03-4c11-819b-11594ff63f4c req-644f40c5-254a-4d5d-998e-bd4716ca6e59 service nova] Creating event network-vif-deleted:2f9889d1-cb04-4ccc-8abc-1f54eb9f493f for instance 05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9 on n-h1-854823-8 Oct 04 21:09:21.854665 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-8c5cf533-9e03-4c11-819b-11594ff63f4c req-644f40c5-254a-4d5d-998e-bd4716ca6e59 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071076 Oct 04 21:09:21.856025 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2833/5637] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:09:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:09:22.069688 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-62b517b3-5ab2-414a-b025-d33d5412bb95 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:22.070376 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-62b517b3-5ab2-414a-b025-d33d5412bb95 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] [instance: 05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:22.090069 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-62b517b3-5ab2-414a-b025-d33d5412bb95 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:22.090600 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-62b517b3-5ab2-414a-b025-d33d5412bb95 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:22.091253 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-62b517b3-5ab2-414a-b025-d33d5412bb95 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:22.091986 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-62b517b3-5ab2-414a-b025-d33d5412bb95 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:22.092444 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-62b517b3-5ab2-414a-b025-d33d5412bb95 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:22.092868 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-62b517b3-5ab2-414a-b025-d33d5412bb95 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:22.160931 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-62b517b3-5ab2-414a-b025-d33d5412bb95 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:22.161620 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-62b517b3-5ab2-414a-b025-d33d5412bb95 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:22.161984 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-62b517b3-5ab2-414a-b025-d33d5412bb95 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:22.162556 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-62b517b3-5ab2-414a-b025-d33d5412bb95 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lazy-loading 'fault' on Instance uuid 05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9 {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:09:22.308621 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-62b517b3-5ab2-414a-b025-d33d5412bb95 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:22.323050 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-62b517b3-5ab2-414a-b025-d33d5412bb95 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:22.324876 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-62b517b3-5ab2-414a-b025-d33d5412bb95 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9169ee22a4c94b2ab8d092c890bbf3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625c9db98c2475db23d56a965eedb66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:22.326165 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-62b517b3-5ab2-414a-b025-d33d5412bb95 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] 10.222.0.33 "GET /compute/v2.1/servers/05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9" status: 200 len: 1370 microversion: 2.20 time: 0.260987 Oct 04 21:09:22.326789 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2805/5638] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 21:09:22 2022] GET /compute/v2.1/servers/05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9 => generated 1370 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 21:09:22.729153 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-ad41def6-50a5-4b94-bb98-968b1cc77e07 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:22.730017 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-ad41def6-50a5-4b94-bb98-968b1cc77e07 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] [instance: 202ca1b3-71fc-440c-993a-3d05300d96a4] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:22.751117 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ad41def6-50a5-4b94-bb98-968b1cc77e07 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:22.751658 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ad41def6-50a5-4b94-bb98-968b1cc77e07 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:22.752364 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ad41def6-50a5-4b94-bb98-968b1cc77e07 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:22.768748 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ad41def6-50a5-4b94-bb98-968b1cc77e07 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:22.782891 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ad41def6-50a5-4b94-bb98-968b1cc77e07 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:22.783877 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ad41def6-50a5-4b94-bb98-968b1cc77e07 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:23.175282 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-ad41def6-50a5-4b94-bb98-968b1cc77e07 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa165b905a34b1a86aeea1e28232cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd864e32279184978bd6f990dd83f8091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:23.187284 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-ad41def6-50a5-4b94-bb98-968b1cc77e07 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] 10.222.0.33 "GET /compute/v2.1/servers/202ca1b3-71fc-440c-993a-3d05300d96a4" status: 200 len: 1314 microversion: 2.1 time: 0.465739 Oct 04 21:09:23.209827 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2834/5639] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:22 2022] GET /compute/v2.1/servers/202ca1b3-71fc-440c-993a-3d05300d96a4 => generated 1314 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:09:23.354152 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6695d546-1cb3-4d34-a08f-ef2c7070fbf6 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:23.355613 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-6695d546-1cb3-4d34-a08f-ef2c7070fbf6 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] [instance: 05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:23.391420 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6695d546-1cb3-4d34-a08f-ef2c7070fbf6 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:23.394230 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6695d546-1cb3-4d34-a08f-ef2c7070fbf6 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:23.395041 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6695d546-1cb3-4d34-a08f-ef2c7070fbf6 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:23.397587 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6695d546-1cb3-4d34-a08f-ef2c7070fbf6 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:23.398430 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6695d546-1cb3-4d34-a08f-ef2c7070fbf6 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:23.399093 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6695d546-1cb3-4d34-a08f-ef2c7070fbf6 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:23.434737 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-6695d546-1cb3-4d34-a08f-ef2c7070fbf6 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] HTTP exception thrown: Instance 05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9 could not be found. Oct 04 21:09:23.444012 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6695d546-1cb3-4d34-a08f-ef2c7070fbf6 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Request method failure captured: Oct 04 21:09:23.444012 n-d-854823-8 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9 HTTP/1.1 Oct 04 21:09:23.444012 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 21:09:23.444012 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 21:09:23.444012 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 21:09:23.444012 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 0 Oct 04 21:09:23.444012 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 21:09:23.444012 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 21:09:23.444012 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 21:09:23.444012 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 21:09:23.444012 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJ8zlUsVfOsr3ZIKfOLJwOa8Eha_qKsP9ATaYd5T34l3LH31b1lhpj1nxyNL2Q9bu6RpjSnFJX3ysP1c_sr8KFFD7E52JZEP_cYQx-2U-LdHQiJW_im-7tRJevST1wxkasm0x9XKZ_y2eiGeaDi_E1b04PRtNmxzoKRAVhYpncES3cs Oct 04 21:09:23.444012 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 21:09:23.444012 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 21:09:23.444012 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 21:09:23.444012 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 21:09:23.444012 n-d-854823-8 devstack@n-api.service[128801]: X-Openstack-Nova-Api-Version: 2.20 Oct 04 21:09:23.444012 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 21:09:23.444012 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 21:09:23.444012 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: 8625c9db98c2475db23d56a965eedb66 Oct 04 21:09:23.444012 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1082323484 Oct 04 21:09:23.444012 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 21:09:23.444012 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 21:09:23.444012 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_8625c9db98c2475db23d56a965eedb66", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8625c9db98c2475db23d56a965eedb66"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8625c9db98c2475db23d56a965eedb66"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/8625c9db98c2475db23d56a965eedb66"}]}] Oct 04 21:09:23.444012 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1082323484 Oct 04 21:09:23.444012 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: 8625c9db98c2475db23d56a965eedb66 Oct 04 21:09:23.444012 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1082323484 Oct 04 21:09:23.444012 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-AttachVolumeShelveTestJSON-1082323484-project Oct 04 21:09:23.444012 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 21:09:23.444012 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 21:09:23.444012 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: 9169ee22a4c94b2ab8d092c890bbf3ed Oct 04 21:09:23.444012 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1082323484-project Oct 04 21:09:23.444012 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 21:09:23.444012 n-d-854823-8 devstack@n-api.service[128801]: exception: Instance 05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9 could not be found. Oct 04 21:09:23.444012 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': '05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9'} Oct 04 21:09:23.444012 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:09:23.444012 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:09:23.444012 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:09:23.444012 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:09:23.444012 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:09:23.444012 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:09:23.444012 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:09:23.444012 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:09:23.444012 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:09:23.444012 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:09:23.444012 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9 could not be found. Oct 04 21:09:23.444012 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:09:23.444012 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:09:23.444012 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:09:23.444012 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:09:23.444012 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:09:23.444012 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:09:23.444012 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:09:23.444012 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:09:23.444012 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:09:23.444012 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:09:23.444012 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:09:23.444012 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:09:23.444012 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:09:23.444012 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:09:23.444012 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:09:23.444012 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:09:23.444012 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9 could not be found. Oct 04 21:09:23.444012 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:09:23.444012 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:09:23.452529 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:09:23.452529 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:09:23.452529 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:09:23.452529 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:09:23.452529 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:09:23.452529 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:09:23.452529 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9 could not be found. Oct 04 21:09:23.452529 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:09:23.452529 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6695d546-1cb3-4d34-a08f-ef2c7070fbf6 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Returning 404 to user: Instance 05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:09:23.452529 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-6695d546-1cb3-4d34-a08f-ef2c7070fbf6 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] 10.222.0.33 "GET /compute/v2.1/servers/05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9" status: 404 len: 111 microversion: 2.20 time: 0.099899 Oct 04 21:09:23.452529 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2806/5640] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 21:09:23 2022] GET /compute/v2.1/servers/05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 21:09:23.465596 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-19bc1259-c255-4794-9a01-9c3ebf2bf127 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Calling method '.version_select at 0x7f3c6f7bc790>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:23.506292 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-19bc1259-c255-4794-9a01-9c3ebf2bf127 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-624317942" status: 204 len: 0 microversion: 2.20 time: 0.046633 Oct 04 21:09:23.510114 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2835/5641] 10.222.0.33 () {60 vars in 1259 bytes} [Tue Oct 4 21:09:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-624317942 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 21:09:24.216312 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-3ea5870e-21b2-47bb-8ec0-73521a954362 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:24.219012 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-3ea5870e-21b2-47bb-8ec0-73521a954362 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] [instance: 202ca1b3-71fc-440c-993a-3d05300d96a4] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:24.233360 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3ea5870e-21b2-47bb-8ec0-73521a954362 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:24.233894 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3ea5870e-21b2-47bb-8ec0-73521a954362 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:24.234334 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3ea5870e-21b2-47bb-8ec0-73521a954362 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:24.235262 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3ea5870e-21b2-47bb-8ec0-73521a954362 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:24.235693 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3ea5870e-21b2-47bb-8ec0-73521a954362 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:24.236203 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3ea5870e-21b2-47bb-8ec0-73521a954362 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:24.753475 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-3ea5870e-21b2-47bb-8ec0-73521a954362 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa165b905a34b1a86aeea1e28232cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd864e32279184978bd6f990dd83f8091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:24.773070 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-3ea5870e-21b2-47bb-8ec0-73521a954362 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] 10.222.0.33 "GET /compute/v2.1/servers/202ca1b3-71fc-440c-993a-3d05300d96a4" status: 200 len: 1498 microversion: 2.1 time: 0.557726 Oct 04 21:09:24.774441 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2807/5642] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:24 2022] GET /compute/v2.1/servers/202ca1b3-71fc-440c-993a-3d05300d96a4 => generated 1498 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:09:25.368933 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-c2dcbba1-41c0-460e-bebd-9f2d09cf0690 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:25.370195 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-c2dcbba1-41c0-460e-bebd-9f2d09cf0690 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] [instance: 202ca1b3-71fc-440c-993a-3d05300d96a4] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:25.377571 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c2dcbba1-41c0-460e-bebd-9f2d09cf0690 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:25.378427 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c2dcbba1-41c0-460e-bebd-9f2d09cf0690 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:25.379093 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c2dcbba1-41c0-460e-bebd-9f2d09cf0690 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:25.380020 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c2dcbba1-41c0-460e-bebd-9f2d09cf0690 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:25.381304 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c2dcbba1-41c0-460e-bebd-9f2d09cf0690 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:25.382327 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c2dcbba1-41c0-460e-bebd-9f2d09cf0690 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:25.437837 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-c2dcbba1-41c0-460e-bebd-9f2d09cf0690 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] [instance: 202ca1b3-71fc-440c-993a-3d05300d96a4] Going to try to terminate instance {{(pid=128802) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:09:25.581657 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-c2dcbba1-41c0-460e-bebd-9f2d09cf0690 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] 10.222.0.33 "DELETE /compute/v2.1/servers/202ca1b3-71fc-440c-993a-3d05300d96a4" status: 204 len: 0 microversion: 2.1 time: 0.218588 Oct 04 21:09:25.582516 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2836/5643] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 21:09:25 2022] DELETE /compute/v2.1/servers/202ca1b3-71fc-440c-993a-3d05300d96a4 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:09:25.591363 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1c55c20e-bb32-4e1f-84f1-8adbe9602bca tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:25.592002 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-1c55c20e-bb32-4e1f-84f1-8adbe9602bca tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] [instance: 202ca1b3-71fc-440c-993a-3d05300d96a4] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:25.607232 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1c55c20e-bb32-4e1f-84f1-8adbe9602bca tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:25.608917 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1c55c20e-bb32-4e1f-84f1-8adbe9602bca tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:25.611550 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1c55c20e-bb32-4e1f-84f1-8adbe9602bca tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:25.612543 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1c55c20e-bb32-4e1f-84f1-8adbe9602bca tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:25.613973 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1c55c20e-bb32-4e1f-84f1-8adbe9602bca tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:25.616886 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1c55c20e-bb32-4e1f-84f1-8adbe9602bca tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:26.118047 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-1c55c20e-bb32-4e1f-84f1-8adbe9602bca tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa165b905a34b1a86aeea1e28232cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd864e32279184978bd6f990dd83f8091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:26.133953 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-1c55c20e-bb32-4e1f-84f1-8adbe9602bca tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] 10.222.0.33 "GET /compute/v2.1/servers/202ca1b3-71fc-440c-993a-3d05300d96a4" status: 200 len: 1504 microversion: 2.1 time: 0.541813 Oct 04 21:09:26.136571 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2808/5644] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:25 2022] GET /compute/v2.1/servers/202ca1b3-71fc-440c-993a-3d05300d96a4 => generated 1504 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:09:27.163425 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-873ec987-6e16-4e1f-bb4e-f09b01a31399 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:27.164242 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-873ec987-6e16-4e1f-bb4e-f09b01a31399 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] [instance: 202ca1b3-71fc-440c-993a-3d05300d96a4] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:27.182532 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-873ec987-6e16-4e1f-bb4e-f09b01a31399 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:27.183261 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-873ec987-6e16-4e1f-bb4e-f09b01a31399 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:27.184416 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-873ec987-6e16-4e1f-bb4e-f09b01a31399 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:27.185159 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-873ec987-6e16-4e1f-bb4e-f09b01a31399 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:27.186034 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-873ec987-6e16-4e1f-bb4e-f09b01a31399 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:27.186196 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-873ec987-6e16-4e1f-bb4e-f09b01a31399 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:27.602131 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-873ec987-6e16-4e1f-bb4e-f09b01a31399 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa165b905a34b1a86aeea1e28232cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd864e32279184978bd6f990dd83f8091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:27.616862 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-873ec987-6e16-4e1f-bb4e-f09b01a31399 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] 10.222.0.33 "GET /compute/v2.1/servers/202ca1b3-71fc-440c-993a-3d05300d96a4" status: 200 len: 1504 microversion: 2.1 time: 0.455162 Oct 04 21:09:27.617662 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2837/5645] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:27 2022] GET /compute/v2.1/servers/202ca1b3-71fc-440c-993a-3d05300d96a4 => generated 1504 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:09:28.634199 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-b5ea5614-e273-421b-bdfa-9173c3ca4848 req-2f772631-f1d8-488e-a626-566accf8747f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "202ca1b3-71fc-440c-993a-3d05300d96a4", "name": "network-vif-deleted", "tag": "3ed9c207-4015-490d-a798-d763455068aa"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:09:28.646956 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-10ed87c7-fb22-43ea-82e3-ad5c3f02243f tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:28.646956 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-10ed87c7-fb22-43ea-82e3-ad5c3f02243f tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] [instance: 202ca1b3-71fc-440c-993a-3d05300d96a4] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:28.673365 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-10ed87c7-fb22-43ea-82e3-ad5c3f02243f tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:28.673881 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-10ed87c7-fb22-43ea-82e3-ad5c3f02243f tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:28.676179 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-10ed87c7-fb22-43ea-82e3-ad5c3f02243f tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:28.676938 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-10ed87c7-fb22-43ea-82e3-ad5c3f02243f tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:28.689029 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-10ed87c7-fb22-43ea-82e3-ad5c3f02243f tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:28.689630 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-10ed87c7-fb22-43ea-82e3-ad5c3f02243f tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:28.701921 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-b5ea5614-e273-421b-bdfa-9173c3ca4848 req-2f772631-f1d8-488e-a626-566accf8747f service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:28.704266 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-b5ea5614-e273-421b-bdfa-9173c3ca4848 req-2f772631-f1d8-488e-a626-566accf8747f service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:28.706228 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-b5ea5614-e273-421b-bdfa-9173c3ca4848 req-2f772631-f1d8-488e-a626-566accf8747f service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:28.767918 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-b5ea5614-e273-421b-bdfa-9173c3ca4848 req-2f772631-f1d8-488e-a626-566accf8747f service nova] Creating event network-vif-deleted:3ed9c207-4015-490d-a798-d763455068aa for instance 202ca1b3-71fc-440c-993a-3d05300d96a4 on n-h1-854823-8 Oct 04 21:09:28.785741 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-b5ea5614-e273-421b-bdfa-9173c3ca4848 req-2f772631-f1d8-488e-a626-566accf8747f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.157041 Oct 04 21:09:28.788250 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2809/5646] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:09:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:09:29.268530 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-10ed87c7-fb22-43ea-82e3-ad5c3f02243f tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa165b905a34b1a86aeea1e28232cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd864e32279184978bd6f990dd83f8091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:29.323078 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-10ed87c7-fb22-43ea-82e3-ad5c3f02243f tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] 10.222.0.33 "GET /compute/v2.1/servers/202ca1b3-71fc-440c-993a-3d05300d96a4" status: 200 len: 1299 microversion: 2.1 time: 0.684526 Oct 04 21:09:29.323708 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2838/5647] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:28 2022] GET /compute/v2.1/servers/202ca1b3-71fc-440c-993a-3d05300d96a4 => generated 1299 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:09:30.353138 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b67e07c2-e528-4e04-888f-2adfddf3e231 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:30.353861 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b67e07c2-e528-4e04-888f-2adfddf3e231 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] [instance: 202ca1b3-71fc-440c-993a-3d05300d96a4] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:30.369796 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:09:30.376918 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b67e07c2-e528-4e04-888f-2adfddf3e231 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:30.383032 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b67e07c2-e528-4e04-888f-2adfddf3e231 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:30.383570 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b67e07c2-e528-4e04-888f-2adfddf3e231 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:30.384383 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b67e07c2-e528-4e04-888f-2adfddf3e231 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:30.384871 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b67e07c2-e528-4e04-888f-2adfddf3e231 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:30.385313 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b67e07c2-e528-4e04-888f-2adfddf3e231 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:30.455664 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-b67e07c2-e528-4e04-888f-2adfddf3e231 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] HTTP exception thrown: Instance 202ca1b3-71fc-440c-993a-3d05300d96a4 could not be found. Oct 04 21:09:30.461943 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b67e07c2-e528-4e04-888f-2adfddf3e231 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Request method failure captured: Oct 04 21:09:30.461943 n-d-854823-8 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/202ca1b3-71fc-440c-993a-3d05300d96a4 HTTP/1.1 Oct 04 21:09:30.461943 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 21:09:30.461943 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 21:09:30.461943 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 21:09:30.461943 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 0 Oct 04 21:09:30.461943 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 21:09:30.461943 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 21:09:30.461943 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 21:09:30.461943 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 21:09:30.461943 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPKDs5fdnujP9dAOUbtFkZMltOiSmPECqAUtSsAWL2k8enUFGtE2h020RqSdJuVeOoqQUdP3tJp4RSIiLYunfbFMY4NFmwGdW_-oCbQWTXNdp1gIfyUG9GzCT5AHUa-EiktpPvN3lA4s1ebDuoiiftcmShWf7d9GXUBLqFBkCt_MsaE4 Oct 04 21:09:30.461943 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 21:09:30.461943 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 21:09:30.461943 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 21:09:30.461943 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 21:09:30.461943 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 21:09:30.461943 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 21:09:30.461943 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: d864e32279184978bd6f990dd83f8091 Oct 04 21:09:30.461943 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-VolumesActionsTest-2040191366 Oct 04 21:09:30.461943 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 21:09:30.461943 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 21:09:30.461943 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d864e32279184978bd6f990dd83f8091", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d864e32279184978bd6f990dd83f8091"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d864e32279184978bd6f990dd83f8091"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d864e32279184978bd6f990dd83f8091"}]}] Oct 04 21:09:30.461943 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-VolumesActionsTest-2040191366 Oct 04 21:09:30.461943 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: d864e32279184978bd6f990dd83f8091 Oct 04 21:09:30.461943 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-VolumesActionsTest-2040191366 Oct 04 21:09:30.461943 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-VolumesActionsTest-2040191366-project Oct 04 21:09:30.461943 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 21:09:30.461943 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 21:09:30.461943 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: 5aa165b905a34b1a86aeea1e28232cad Oct 04 21:09:30.461943 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-VolumesActionsTest-2040191366-project Oct 04 21:09:30.461943 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 21:09:30.461943 n-d-854823-8 devstack@n-api.service[128801]: exception: Instance 202ca1b3-71fc-440c-993a-3d05300d96a4 could not be found. Oct 04 21:09:30.461943 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': '202ca1b3-71fc-440c-993a-3d05300d96a4'} Oct 04 21:09:30.461943 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:09:30.461943 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:09:30.461943 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:09:30.461943 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:09:30.461943 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:09:30.461943 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:09:30.461943 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:09:30.461943 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:09:30.461943 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:09:30.461943 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:09:30.461943 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 202ca1b3-71fc-440c-993a-3d05300d96a4 could not be found. Oct 04 21:09:30.461943 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:09:30.461943 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:09:30.461943 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:09:30.461943 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:09:30.461943 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:09:30.461943 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:09:30.461943 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:09:30.461943 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:09:30.461943 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:09:30.461943 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:09:30.461943 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:09:30.461943 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:09:30.461943 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:09:30.461943 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:09:30.461943 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:09:30.461943 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:09:30.461943 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 202ca1b3-71fc-440c-993a-3d05300d96a4 could not be found. Oct 04 21:09:30.461943 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:09:30.461943 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:09:30.461943 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:09:30.467089 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:09:30.467089 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:09:30.467089 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:09:30.467089 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:09:30.467089 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:09:30.467089 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 202ca1b3-71fc-440c-993a-3d05300d96a4 could not be found. Oct 04 21:09:30.467089 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:09:30.470041 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b67e07c2-e528-4e04-888f-2adfddf3e231 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Returning 404 to user: Instance 202ca1b3-71fc-440c-993a-3d05300d96a4 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:09:30.471014 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b67e07c2-e528-4e04-888f-2adfddf3e231 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] 10.222.0.33 "GET /compute/v2.1/servers/202ca1b3-71fc-440c-993a-3d05300d96a4" status: 404 len: 111 microversion: 2.1 time: 0.122946 Oct 04 21:09:30.476974 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2810/5648] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:30 2022] GET /compute/v2.1/servers/202ca1b3-71fc-440c-993a-3d05300d96a4 => generated 111 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:09:30.817591 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-66163970-9c8b-4b7f-92dc-7c924a3afa88 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1834847394", "imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63", "flavorRef": "452", "networks": [{"uuid": "1974c5bd-a4dc-4438-af13-f1fe0a2d00b4"}]}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:09:30.954584 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.network.neutron [None req-66163970-9c8b-4b7f-92dc-7c924a3afa88 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] validate_networks() for [('1974c5bd-a4dc-4438-af13-f1fe0a2d00b4', None, None, None, None, None)] {{(pid=128802) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:09:31.445039 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-baeedffd-d789-48c7-93fe-70a4f7405def tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:31.445646 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-baeedffd-d789-48c7-93fe-70a4f7405def tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] [instance: 05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:31.472615 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-baeedffd-d789-48c7-93fe-70a4f7405def tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:31.473115 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-baeedffd-d789-48c7-93fe-70a4f7405def tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:31.473549 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-baeedffd-d789-48c7-93fe-70a4f7405def tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:31.481900 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-baeedffd-d789-48c7-93fe-70a4f7405def tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:31.486700 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-baeedffd-d789-48c7-93fe-70a4f7405def tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:31.488172 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-baeedffd-d789-48c7-93fe-70a4f7405def tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:31.515926 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-baeedffd-d789-48c7-93fe-70a4f7405def tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] HTTP exception thrown: Instance 05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9 could not be found. Oct 04 21:09:31.517538 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-baeedffd-d789-48c7-93fe-70a4f7405def tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Request method failure captured: Oct 04 21:09:31.517538 n-d-854823-8 devstack@n-api.service[128801]: request: DELETE /compute/v2.1/servers/05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9 HTTP/1.1 Oct 04 21:09:31.517538 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 21:09:31.517538 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 21:09:31.517538 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 21:09:31.517538 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 0 Oct 04 21:09:31.517538 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 21:09:31.517538 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 21:09:31.517538 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 21:09:31.517538 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 21:09:31.517538 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJ8zlUsVfOsr3ZIKfOLJwOa8Eha_qKsP9ATaYd5T34l3LH31b1lhpj1nxyNL2Q9bu6RpjSnFJX3ysP1c_sr8KFFD7E52JZEP_cYQx-2U-LdHQiJW_im-7tRJevST1wxkasm0x9XKZ_y2eiGeaDi_E1b04PRtNmxzoKRAVhYpncES3cs Oct 04 21:09:31.517538 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 21:09:31.517538 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 21:09:31.517538 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 21:09:31.517538 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 21:09:31.517538 n-d-854823-8 devstack@n-api.service[128801]: X-Openstack-Nova-Api-Version: 2.20 Oct 04 21:09:31.517538 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 21:09:31.517538 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 21:09:31.517538 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: 8625c9db98c2475db23d56a965eedb66 Oct 04 21:09:31.517538 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1082323484 Oct 04 21:09:31.517538 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 21:09:31.517538 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 21:09:31.517538 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_8625c9db98c2475db23d56a965eedb66", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8625c9db98c2475db23d56a965eedb66"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8625c9db98c2475db23d56a965eedb66"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/8625c9db98c2475db23d56a965eedb66"}]}] Oct 04 21:09:31.517538 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1082323484 Oct 04 21:09:31.517538 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: 8625c9db98c2475db23d56a965eedb66 Oct 04 21:09:31.517538 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1082323484 Oct 04 21:09:31.517538 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-AttachVolumeShelveTestJSON-1082323484-project Oct 04 21:09:31.517538 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 21:09:31.517538 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 21:09:31.517538 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: 9169ee22a4c94b2ab8d092c890bbf3ed Oct 04 21:09:31.517538 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1082323484-project Oct 04 21:09:31.517538 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 21:09:31.517538 n-d-854823-8 devstack@n-api.service[128801]: exception: Instance 05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9 could not be found. Oct 04 21:09:31.517538 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': '05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9'} Oct 04 21:09:31.517538 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:09:31.517538 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:09:31.517538 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:09:31.517538 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:09:31.517538 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:09:31.517538 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:09:31.517538 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:09:31.517538 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:09:31.517538 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:09:31.517538 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:09:31.517538 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9 could not be found. Oct 04 21:09:31.517538 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:09:31.517538 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:09:31.517538 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:09:31.517538 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:09:31.517538 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:09:31.517538 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:09:31.517538 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:09:31.517538 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:09:31.517538 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:09:31.517538 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:09:31.517538 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 21:09:31.517538 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 21:09:31.517538 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 21:09:31.517538 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 21:09:31.517538 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:09:31.517538 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:09:31.517538 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:09:31.517538 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:09:31.523054 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9 could not be found. Oct 04 21:09:31.523054 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:09:31.523054 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:09:31.523054 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:09:31.523054 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:09:31.523054 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:09:31.523054 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:09:31.523054 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:09:31.523054 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:09:31.523054 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9 could not be found. Oct 04 21:09:31.523054 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:09:31.523054 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-baeedffd-d789-48c7-93fe-70a4f7405def tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Returning 404 to user: Instance 05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:09:31.577363 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-baeedffd-d789-48c7-93fe-70a4f7405def tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] 10.222.0.33 "DELETE /compute/v2.1/servers/05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9" status: 404 len: 111 microversion: 2.20 time: 0.087179 Oct 04 21:09:31.577363 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2811/5649] 10.222.0.33 () {60 vars in 1280 bytes} [Tue Oct 4 21:09:31 2022] DELETE /compute/v2.1/servers/05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 21:09:31.577363 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-548bae3b-5b31-415d-bbc5-94e7ef3db7b6 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:31.577363 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-548bae3b-5b31-415d-bbc5-94e7ef3db7b6 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] [instance: 05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:31.577363 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-548bae3b-5b31-415d-bbc5-94e7ef3db7b6 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:31.577363 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-548bae3b-5b31-415d-bbc5-94e7ef3db7b6 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:31.577363 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-548bae3b-5b31-415d-bbc5-94e7ef3db7b6 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:31.582765 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-548bae3b-5b31-415d-bbc5-94e7ef3db7b6 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:31.584127 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-548bae3b-5b31-415d-bbc5-94e7ef3db7b6 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:31.584127 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-548bae3b-5b31-415d-bbc5-94e7ef3db7b6 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:31.640796 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-548bae3b-5b31-415d-bbc5-94e7ef3db7b6 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] HTTP exception thrown: Instance 05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9 could not be found. Oct 04 21:09:31.642705 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-548bae3b-5b31-415d-bbc5-94e7ef3db7b6 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Request method failure captured: Oct 04 21:09:31.642705 n-d-854823-8 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9 HTTP/1.1 Oct 04 21:09:31.642705 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 21:09:31.642705 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 21:09:31.642705 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 21:09:31.642705 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 0 Oct 04 21:09:31.642705 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 21:09:31.642705 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 21:09:31.642705 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 21:09:31.642705 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 21:09:31.642705 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJ8zlUsVfOsr3ZIKfOLJwOa8Eha_qKsP9ATaYd5T34l3LH31b1lhpj1nxyNL2Q9bu6RpjSnFJX3ysP1c_sr8KFFD7E52JZEP_cYQx-2U-LdHQiJW_im-7tRJevST1wxkasm0x9XKZ_y2eiGeaDi_E1b04PRtNmxzoKRAVhYpncES3cs Oct 04 21:09:31.642705 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 21:09:31.642705 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 21:09:31.642705 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 21:09:31.642705 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 21:09:31.642705 n-d-854823-8 devstack@n-api.service[128801]: X-Openstack-Nova-Api-Version: 2.20 Oct 04 21:09:31.642705 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 21:09:31.642705 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 21:09:31.642705 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: 8625c9db98c2475db23d56a965eedb66 Oct 04 21:09:31.642705 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1082323484 Oct 04 21:09:31.642705 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 21:09:31.642705 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 21:09:31.642705 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_8625c9db98c2475db23d56a965eedb66", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8625c9db98c2475db23d56a965eedb66"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8625c9db98c2475db23d56a965eedb66"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/8625c9db98c2475db23d56a965eedb66"}]}] Oct 04 21:09:31.642705 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1082323484 Oct 04 21:09:31.642705 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: 8625c9db98c2475db23d56a965eedb66 Oct 04 21:09:31.642705 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1082323484 Oct 04 21:09:31.642705 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-AttachVolumeShelveTestJSON-1082323484-project Oct 04 21:09:31.642705 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 21:09:31.642705 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 21:09:31.642705 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: 9169ee22a4c94b2ab8d092c890bbf3ed Oct 04 21:09:31.642705 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1082323484-project Oct 04 21:09:31.642705 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 21:09:31.642705 n-d-854823-8 devstack@n-api.service[128801]: exception: Instance 05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9 could not be found. Oct 04 21:09:31.642705 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': '05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9'} Oct 04 21:09:31.642705 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:09:31.642705 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:09:31.642705 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:09:31.642705 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:09:31.642705 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:09:31.642705 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:09:31.642705 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:09:31.642705 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:09:31.642705 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:09:31.642705 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:09:31.642705 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9 could not be found. Oct 04 21:09:31.642705 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:09:31.642705 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:09:31.642705 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:09:31.642705 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:09:31.642705 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:09:31.642705 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:09:31.642705 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:09:31.642705 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:09:31.642705 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:09:31.642705 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:09:31.642705 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:09:31.642705 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:09:31.642705 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:09:31.642705 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:09:31.642705 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:09:31.642705 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:09:31.642705 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9 could not be found. Oct 04 21:09:31.642705 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:09:31.642705 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:09:31.646519 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:09:31.646519 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:09:31.646519 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:09:31.646519 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:09:31.646519 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:09:31.646519 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:09:31.646519 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9 could not be found. Oct 04 21:09:31.646519 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:09:31.646519 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-548bae3b-5b31-415d-bbc5-94e7ef3db7b6 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Returning 404 to user: Instance 05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:09:31.646519 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-548bae3b-5b31-415d-bbc5-94e7ef3db7b6 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] 10.222.0.33 "GET /compute/v2.1/servers/05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9" status: 404 len: 111 microversion: 2.20 time: 0.112461 Oct 04 21:09:31.646519 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2812/5650] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 21:09:31 2022] GET /compute/v2.1/servers/05d82bd7-9ee7-41eb-a9e8-30d8de2f0eb9 => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 21:09:32.109465 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-66163970-9c8b-4b7f-92dc-7c924a3afa88 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Flavor limits 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:09:32.110954 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-66163970-9c8b-4b7f-92dc-7c924a3afa88 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Image limits 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:09:32.111655 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-66163970-9c8b-4b7f-92dc-7c924a3afa88 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Flavor pref 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:09:32.112301 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-66163970-9c8b-4b7f-92dc-7c924a3afa88 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Image pref 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:09:32.112926 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-66163970-9c8b-4b7f-92dc-7c924a3afa88 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:09:32.116087 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_api:SELECT=50,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:09:32.133637 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-66163970-9c8b-4b7f-92dc-7c924a3afa88 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:32.134829 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-66163970-9c8b-4b7f-92dc-7c924a3afa88 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:32.135793 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-66163970-9c8b-4b7f-92dc-7c924a3afa88 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:32.136892 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-66163970-9c8b-4b7f-92dc-7c924a3afa88 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:32.137579 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-66163970-9c8b-4b7f-92dc-7c924a3afa88 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:32.138271 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-66163970-9c8b-4b7f-92dc-7c924a3afa88 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:32.164358 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-66163970-9c8b-4b7f-92dc-7c924a3afa88 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Getting quotas for project d864e32279184978bd6f990dd83f8091. Resources: {'ram', 'instances', 'cores'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:09:32.172413 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-66163970-9c8b-4b7f-92dc-7c924a3afa88 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Getting quotas for user 5aa165b905a34b1a86aeea1e28232cad and project d864e32279184978bd6f990dd83f8091. Resources: {'ram', 'instances', 'cores'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:09:32.197806 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-66163970-9c8b-4b7f-92dc-7c924a3afa88 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Going to run 1 instances... {{(pid=128802) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:09:32.223297 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-66163970-9c8b-4b7f-92dc-7c924a3afa88 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] [instance: 2cc4a044-6fff-47a3-b1bd-0e0927e32f07] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='15b24725-0c99-4bcf-b1fb-907cdf8e2d63',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128802) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:09:32.409586 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-66163970-9c8b-4b7f-92dc-7c924a3afa88 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.596917 Oct 04 21:09:32.422798 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2839/5651] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 21:09:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 1611 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:09:32.424474 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-bef949ee-6638-41d3-b216-34ab9b753987 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:32.425305 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-bef949ee-6638-41d3-b216-34ab9b753987 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] [instance: 2cc4a044-6fff-47a3-b1bd-0e0927e32f07] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:32.569084 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-bef949ee-6638-41d3-b216-34ab9b753987 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa165b905a34b1a86aeea1e28232cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd864e32279184978bd6f990dd83f8091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:32.594690 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-bef949ee-6638-41d3-b216-34ab9b753987 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] 10.222.0.33 "GET /compute/v2.1/servers/2cc4a044-6fff-47a3-b1bd-0e0927e32f07" status: 200 len: 1214 microversion: 2.1 time: 0.175865 Oct 04 21:09:32.595321 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2813/5652] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:32 2022] GET /compute/v2.1/servers/2cc4a044-6fff-47a3-b1bd-0e0927e32f07 => generated 1214 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:09:33.512133 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-ce975e09-7d9e-4042-bd97-6615e9b15f46 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:09:33.520785 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-ce975e09-7d9e-4042-bd97-6615e9b15f46 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] [instance: bf706904-01fc-408d-a24e-0efb6de3e74f] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:33.570914 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ce975e09-7d9e-4042-bd97-6615e9b15f46 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:33.571496 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ce975e09-7d9e-4042-bd97-6615e9b15f46 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:33.571850 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ce975e09-7d9e-4042-bd97-6615e9b15f46 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:33.572830 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ce975e09-7d9e-4042-bd97-6615e9b15f46 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:33.573394 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ce975e09-7d9e-4042-bd97-6615e9b15f46 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:33.573834 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ce975e09-7d9e-4042-bd97-6615e9b15f46 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:33.636100 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9a3f8f04-1ba4-4e06-ba92-9e2796096a2f tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:33.636905 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-9a3f8f04-1ba4-4e06-ba92-9e2796096a2f tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] [instance: 2cc4a044-6fff-47a3-b1bd-0e0927e32f07] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:33.701738 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-ce975e09-7d9e-4042-bd97-6615e9b15f46 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] 10.222.0.33 "POST /compute/v2.1/servers/bf706904-01fc-408d-a24e-0efb6de3e74f/action" status: 200 len: 24571 microversion: 2.1 time: 0.210109 Oct 04 21:09:33.704866 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2840/5653] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 21:09:33 2022] POST /compute/v2.1/servers/bf706904-01fc-408d-a24e-0efb6de3e74f/action => generated 24571 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 21:09:33.908047 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-9a3f8f04-1ba4-4e06-ba92-9e2796096a2f tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa165b905a34b1a86aeea1e28232cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd864e32279184978bd6f990dd83f8091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:33.924391 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-9a3f8f04-1ba4-4e06-ba92-9e2796096a2f tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] 10.222.0.33 "GET /compute/v2.1/servers/2cc4a044-6fff-47a3-b1bd-0e0927e32f07" status: 200 len: 1214 microversion: 2.1 time: 0.298577 Oct 04 21:09:33.936557 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2814/5654] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:33 2022] GET /compute/v2.1/servers/2cc4a044-6fff-47a3-b1bd-0e0927e32f07 => generated 1214 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:09:34.983496 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-f2bb21eb-8dcd-48f3-82ca-b2ef579bf413 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:34.984299 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-f2bb21eb-8dcd-48f3-82ca-b2ef579bf413 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] [instance: 2cc4a044-6fff-47a3-b1bd-0e0927e32f07] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:35.004125 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f2bb21eb-8dcd-48f3-82ca-b2ef579bf413 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:35.009579 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f2bb21eb-8dcd-48f3-82ca-b2ef579bf413 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:35.010410 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f2bb21eb-8dcd-48f3-82ca-b2ef579bf413 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:35.011427 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f2bb21eb-8dcd-48f3-82ca-b2ef579bf413 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:35.012101 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f2bb21eb-8dcd-48f3-82ca-b2ef579bf413 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:35.016334 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f2bb21eb-8dcd-48f3-82ca-b2ef579bf413 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:35.071716 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:09:35.201620 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-f2bb21eb-8dcd-48f3-82ca-b2ef579bf413 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa165b905a34b1a86aeea1e28232cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd864e32279184978bd6f990dd83f8091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:35.217265 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-f2bb21eb-8dcd-48f3-82ca-b2ef579bf413 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] 10.222.0.33 "GET /compute/v2.1/servers/2cc4a044-6fff-47a3-b1bd-0e0927e32f07" status: 200 len: 1266 microversion: 2.1 time: 0.255715 Oct 04 21:09:35.217858 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2841/5655] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:34 2022] GET /compute/v2.1/servers/2cc4a044-6fff-47a3-b1bd-0e0927e32f07 => generated 1266 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:09:36.242565 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-51f48c2c-3d42-4eb4-8d9f-c59dc9bdbd5d tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:36.243191 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-51f48c2c-3d42-4eb4-8d9f-c59dc9bdbd5d tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] [instance: 2cc4a044-6fff-47a3-b1bd-0e0927e32f07] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:36.265077 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-51f48c2c-3d42-4eb4-8d9f-c59dc9bdbd5d tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:36.265846 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-51f48c2c-3d42-4eb4-8d9f-c59dc9bdbd5d tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:36.266552 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-51f48c2c-3d42-4eb4-8d9f-c59dc9bdbd5d tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:36.267505 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-51f48c2c-3d42-4eb4-8d9f-c59dc9bdbd5d tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:36.268385 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-51f48c2c-3d42-4eb4-8d9f-c59dc9bdbd5d tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:36.269040 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-51f48c2c-3d42-4eb4-8d9f-c59dc9bdbd5d tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:36.415467 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-51f48c2c-3d42-4eb4-8d9f-c59dc9bdbd5d tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa165b905a34b1a86aeea1e28232cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd864e32279184978bd6f990dd83f8091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:36.431922 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-51f48c2c-3d42-4eb4-8d9f-c59dc9bdbd5d tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] 10.222.0.33 "GET /compute/v2.1/servers/2cc4a044-6fff-47a3-b1bd-0e0927e32f07" status: 200 len: 1272 microversion: 2.1 time: 0.194504 Oct 04 21:09:36.433362 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2815/5656] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:36 2022] GET /compute/v2.1/servers/2cc4a044-6fff-47a3-b1bd-0e0927e32f07 => generated 1272 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:09:37.476780 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-6040de34-97fa-4fa1-b487-e5377a7bf950 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:37.478826 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-6040de34-97fa-4fa1-b487-e5377a7bf950 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] [instance: 2cc4a044-6fff-47a3-b1bd-0e0927e32f07] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:37.497641 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6040de34-97fa-4fa1-b487-e5377a7bf950 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:37.498547 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6040de34-97fa-4fa1-b487-e5377a7bf950 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:37.499198 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6040de34-97fa-4fa1-b487-e5377a7bf950 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:37.500066 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6040de34-97fa-4fa1-b487-e5377a7bf950 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:37.501021 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6040de34-97fa-4fa1-b487-e5377a7bf950 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:37.501626 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6040de34-97fa-4fa1-b487-e5377a7bf950 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:37.748961 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-6040de34-97fa-4fa1-b487-e5377a7bf950 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa165b905a34b1a86aeea1e28232cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd864e32279184978bd6f990dd83f8091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:37.773390 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-6040de34-97fa-4fa1-b487-e5377a7bf950 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] 10.222.0.33 "GET /compute/v2.1/servers/2cc4a044-6fff-47a3-b1bd-0e0927e32f07" status: 200 len: 1314 microversion: 2.1 time: 0.300981 Oct 04 21:09:37.787543 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2842/5657] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:37 2022] GET /compute/v2.1/servers/2cc4a044-6fff-47a3-b1bd-0e0927e32f07 => generated 1314 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:09:38.604020 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-6d48989f-1f1b-456a-ac06-b01d85bd1a80 req-907cf13a-fb16-4e8b-8bd0-00956adf210a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2cc4a044-6fff-47a3-b1bd-0e0927e32f07", "tag": "f22ce4d7-d626-467e-86e1-d00f1b2408f3"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:09:38.627939 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-6d48989f-1f1b-456a-ac06-b01d85bd1a80 req-907cf13a-fb16-4e8b-8bd0-00956adf210a service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:38.635345 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-6d48989f-1f1b-456a-ac06-b01d85bd1a80 req-907cf13a-fb16-4e8b-8bd0-00956adf210a service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:38.635978 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-6d48989f-1f1b-456a-ac06-b01d85bd1a80 req-907cf13a-fb16-4e8b-8bd0-00956adf210a service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:38.688543 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-6d48989f-1f1b-456a-ac06-b01d85bd1a80 req-907cf13a-fb16-4e8b-8bd0-00956adf210a service nova] Creating event network-changed:f22ce4d7-d626-467e-86e1-d00f1b2408f3 for instance 2cc4a044-6fff-47a3-b1bd-0e0927e32f07 on n-h1-854823-8 Oct 04 21:09:38.695686 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-5bd97ed6-6754-4b12-a045-05dbcf112fe1 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:38.696920 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-5bd97ed6-6754-4b12-a045-05dbcf112fe1 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] [instance: cc9ad5af-1587-4aa1-8323-a50c91bb1b84] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:38.702402 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-6d48989f-1f1b-456a-ac06-b01d85bd1a80 req-907cf13a-fb16-4e8b-8bd0-00956adf210a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102791 Oct 04 21:09:38.709003 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2816/5658] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:09:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:09:38.713907 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5bd97ed6-6754-4b12-a045-05dbcf112fe1 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:38.715003 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5bd97ed6-6754-4b12-a045-05dbcf112fe1 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:38.715767 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5bd97ed6-6754-4b12-a045-05dbcf112fe1 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:38.716803 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5bd97ed6-6754-4b12-a045-05dbcf112fe1 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:38.717787 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5bd97ed6-6754-4b12-a045-05dbcf112fe1 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:38.718973 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5bd97ed6-6754-4b12-a045-05dbcf112fe1 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:38.743898 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.wsgi [None req-5bd97ed6-6754-4b12-a045-05dbcf112fe1 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] HTTP exception thrown: Instance cc9ad5af-1587-4aa1-8323-a50c91bb1b84 could not be found. Oct 04 21:09:38.745952 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-5bd97ed6-6754-4b12-a045-05dbcf112fe1 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Request method failure captured: Oct 04 21:09:38.745952 n-d-854823-8 devstack@n-api.service[128802]: request: DELETE /compute/v2.1/servers/cc9ad5af-1587-4aa1-8323-a50c91bb1b84 HTTP/1.1 Oct 04 21:09:38.745952 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 21:09:38.745952 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 21:09:38.745952 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 21:09:38.745952 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 0 Oct 04 21:09:38.745952 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 21:09:38.745952 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 21:09:38.745952 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 21:09:38.745952 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 21:09:38.745952 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPJ8zlUsVfOsr3ZIKfOLJwOa8Eha_qKsP9ATaYd5T34l3LH31b1lhpj1nxyNL2Q9bu6RpjSnFJX3ysP1c_sr8KFFD7E52JZEP_cYQx-2U-LdHQiJW_im-7tRJevST1wxkasm0x9XKZ_y2eiGeaDi_E1b04PRtNmxzoKRAVhYpncES3cs Oct 04 21:09:38.745952 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 21:09:38.745952 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 21:09:38.745952 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 21:09:38.745952 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 21:09:38.745952 n-d-854823-8 devstack@n-api.service[128802]: X-Openstack-Nova-Api-Version: 2.20 Oct 04 21:09:38.745952 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 21:09:38.745952 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 21:09:38.745952 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: 8625c9db98c2475db23d56a965eedb66 Oct 04 21:09:38.745952 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1082323484 Oct 04 21:09:38.745952 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 21:09:38.745952 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 21:09:38.745952 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_8625c9db98c2475db23d56a965eedb66", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8625c9db98c2475db23d56a965eedb66"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8625c9db98c2475db23d56a965eedb66"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/8625c9db98c2475db23d56a965eedb66"}]}] Oct 04 21:09:38.745952 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1082323484 Oct 04 21:09:38.745952 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: 8625c9db98c2475db23d56a965eedb66 Oct 04 21:09:38.745952 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1082323484 Oct 04 21:09:38.745952 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-AttachVolumeShelveTestJSON-1082323484-project Oct 04 21:09:38.745952 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 21:09:38.745952 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 21:09:38.745952 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: 9169ee22a4c94b2ab8d092c890bbf3ed Oct 04 21:09:38.745952 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1082323484-project Oct 04 21:09:38.745952 n-d-854823-8 devstack@n-api.service[128802]: method: > Oct 04 21:09:38.745952 n-d-854823-8 devstack@n-api.service[128802]: exception: Instance cc9ad5af-1587-4aa1-8323-a50c91bb1b84 could not be found. Oct 04 21:09:38.745952 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'id': 'cc9ad5af-1587-4aa1-8323-a50c91bb1b84'} Oct 04 21:09:38.745952 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:09:38.745952 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:09:38.745952 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:09:38.745952 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:09:38.745952 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:09:38.745952 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:09:38.745952 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:09:38.745952 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:09:38.745952 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:09:38.745952 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:09:38.745952 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc9ad5af-1587-4aa1-8323-a50c91bb1b84 could not be found. Oct 04 21:09:38.745952 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:09:38.745952 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:09:38.745952 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:09:38.745952 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:09:38.745952 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:09:38.745952 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:09:38.745952 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:09:38.745952 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:09:38.745952 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:09:38.745952 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:09:38.745952 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 21:09:38.745952 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 21:09:38.745952 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 21:09:38.745952 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 21:09:38.745952 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:09:38.745952 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:09:38.745952 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:09:38.745952 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:09:38.749084 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc9ad5af-1587-4aa1-8323-a50c91bb1b84 could not be found. Oct 04 21:09:38.749084 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:09:38.749084 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:09:38.749084 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:09:38.749084 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:09:38.749084 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:09:38.749084 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:09:38.749084 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:09:38.749084 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:09:38.749084 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc9ad5af-1587-4aa1-8323-a50c91bb1b84 could not be found. Oct 04 21:09:38.749084 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:09:38.751323 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-5bd97ed6-6754-4b12-a045-05dbcf112fe1 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Returning 404 to user: Instance cc9ad5af-1587-4aa1-8323-a50c91bb1b84 could not be found. {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:09:38.752783 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-5bd97ed6-6754-4b12-a045-05dbcf112fe1 tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] 10.222.0.33 "DELETE /compute/v2.1/servers/cc9ad5af-1587-4aa1-8323-a50c91bb1b84" status: 404 len: 111 microversion: 2.20 time: 0.063249 Oct 04 21:09:38.757226 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2843/5659] 10.222.0.33 () {60 vars in 1280 bytes} [Tue Oct 4 21:09:38 2022] DELETE /compute/v2.1/servers/cc9ad5af-1587-4aa1-8323-a50c91bb1b84 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 04 21:09:38.765477 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6c5084a2-e26d-4d30-8ed4-4392d83a799e tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:38.766518 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-6c5084a2-e26d-4d30-8ed4-4392d83a799e tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] [instance: cc9ad5af-1587-4aa1-8323-a50c91bb1b84] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:38.775888 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6c5084a2-e26d-4d30-8ed4-4392d83a799e tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:38.776627 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6c5084a2-e26d-4d30-8ed4-4392d83a799e tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:38.777454 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6c5084a2-e26d-4d30-8ed4-4392d83a799e tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:38.778620 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6c5084a2-e26d-4d30-8ed4-4392d83a799e tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:38.780867 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6c5084a2-e26d-4d30-8ed4-4392d83a799e tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:38.781504 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6c5084a2-e26d-4d30-8ed4-4392d83a799e tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:38.805199 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-bbd12ff5-6ab0-43ca-bd37-8ec8e21f9555 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:38.806094 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-bbd12ff5-6ab0-43ca-bd37-8ec8e21f9555 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] [instance: 2cc4a044-6fff-47a3-b1bd-0e0927e32f07] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:38.819687 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-6c5084a2-e26d-4d30-8ed4-4392d83a799e tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] HTTP exception thrown: Instance cc9ad5af-1587-4aa1-8323-a50c91bb1b84 could not be found. Oct 04 21:09:38.822718 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bbd12ff5-6ab0-43ca-bd37-8ec8e21f9555 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:38.823651 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bbd12ff5-6ab0-43ca-bd37-8ec8e21f9555 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:38.824412 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bbd12ff5-6ab0-43ca-bd37-8ec8e21f9555 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:38.825531 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bbd12ff5-6ab0-43ca-bd37-8ec8e21f9555 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:38.826634 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6c5084a2-e26d-4d30-8ed4-4392d83a799e tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Request method failure captured: Oct 04 21:09:38.826634 n-d-854823-8 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/cc9ad5af-1587-4aa1-8323-a50c91bb1b84 HTTP/1.1 Oct 04 21:09:38.826634 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 21:09:38.826634 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 21:09:38.826634 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 21:09:38.826634 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 0 Oct 04 21:09:38.826634 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 21:09:38.826634 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 21:09:38.826634 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 21:09:38.826634 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 21:09:38.826634 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJ8zlUsVfOsr3ZIKfOLJwOa8Eha_qKsP9ATaYd5T34l3LH31b1lhpj1nxyNL2Q9bu6RpjSnFJX3ysP1c_sr8KFFD7E52JZEP_cYQx-2U-LdHQiJW_im-7tRJevST1wxkasm0x9XKZ_y2eiGeaDi_E1b04PRtNmxzoKRAVhYpncES3cs Oct 04 21:09:38.826634 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 21:09:38.826634 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 21:09:38.826634 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 21:09:38.826634 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 21:09:38.826634 n-d-854823-8 devstack@n-api.service[128801]: X-Openstack-Nova-Api-Version: 2.20 Oct 04 21:09:38.826634 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 21:09:38.826634 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 21:09:38.826634 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: 8625c9db98c2475db23d56a965eedb66 Oct 04 21:09:38.826634 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1082323484 Oct 04 21:09:38.826634 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 21:09:38.826634 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 21:09:38.826634 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_8625c9db98c2475db23d56a965eedb66", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8625c9db98c2475db23d56a965eedb66"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8625c9db98c2475db23d56a965eedb66"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/8625c9db98c2475db23d56a965eedb66"}]}] Oct 04 21:09:38.826634 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1082323484 Oct 04 21:09:38.826634 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: 8625c9db98c2475db23d56a965eedb66 Oct 04 21:09:38.826634 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1082323484 Oct 04 21:09:38.826634 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-AttachVolumeShelveTestJSON-1082323484-project Oct 04 21:09:38.826634 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 21:09:38.826634 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 21:09:38.826634 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: 9169ee22a4c94b2ab8d092c890bbf3ed Oct 04 21:09:38.826634 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1082323484-project Oct 04 21:09:38.826634 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 21:09:38.826634 n-d-854823-8 devstack@n-api.service[128801]: exception: Instance cc9ad5af-1587-4aa1-8323-a50c91bb1b84 could not be found. Oct 04 21:09:38.826634 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': 'cc9ad5af-1587-4aa1-8323-a50c91bb1b84'} Oct 04 21:09:38.826634 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:09:38.826634 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:09:38.826634 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:09:38.826634 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:09:38.826634 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:09:38.826634 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:09:38.826634 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:09:38.826634 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:09:38.826634 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:09:38.826634 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:09:38.826634 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc9ad5af-1587-4aa1-8323-a50c91bb1b84 could not be found. Oct 04 21:09:38.826634 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:09:38.826634 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:09:38.826634 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:09:38.826634 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:09:38.826634 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:09:38.826634 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:09:38.826634 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:09:38.826634 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:09:38.826634 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:09:38.826634 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:09:38.826634 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:09:38.826634 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:09:38.826634 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:09:38.826634 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:09:38.826634 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:09:38.826634 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:09:38.826634 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc9ad5af-1587-4aa1-8323-a50c91bb1b84 could not be found. Oct 04 21:09:38.826634 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:09:38.826634 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:09:38.830394 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:09:38.830394 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:09:38.830394 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:09:38.830394 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:09:38.830394 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:09:38.830394 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:09:38.830394 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc9ad5af-1587-4aa1-8323-a50c91bb1b84 could not be found. Oct 04 21:09:38.830394 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:09:38.831578 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6c5084a2-e26d-4d30-8ed4-4392d83a799e tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] Returning 404 to user: Instance cc9ad5af-1587-4aa1-8323-a50c91bb1b84 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:09:38.832494 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bbd12ff5-6ab0-43ca-bd37-8ec8e21f9555 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:38.834639 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bbd12ff5-6ab0-43ca-bd37-8ec8e21f9555 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:38.835808 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-6c5084a2-e26d-4d30-8ed4-4392d83a799e tempest-AttachVolumeShelveTestJSON-1082323484 tempest-AttachVolumeShelveTestJSON-1082323484-project] 10.222.0.33 "GET /compute/v2.1/servers/cc9ad5af-1587-4aa1-8323-a50c91bb1b84" status: 404 len: 111 microversion: 2.20 time: 0.076607 Oct 04 21:09:38.842572 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2817/5660] 10.222.0.33 () {60 vars in 1277 bytes} [Tue Oct 4 21:09:38 2022] GET /compute/v2.1/servers/cc9ad5af-1587-4aa1-8323-a50c91bb1b84 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 21:09:39.256874 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-bbd12ff5-6ab0-43ca-bd37-8ec8e21f9555 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa165b905a34b1a86aeea1e28232cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd864e32279184978bd6f990dd83f8091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:39.265561 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-bbd12ff5-6ab0-43ca-bd37-8ec8e21f9555 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] 10.222.0.33 "GET /compute/v2.1/servers/2cc4a044-6fff-47a3-b1bd-0e0927e32f07" status: 200 len: 1314 microversion: 2.1 time: 0.466841 Oct 04 21:09:39.283281 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2844/5661] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:38 2022] GET /compute/v2.1/servers/2cc4a044-6fff-47a3-b1bd-0e0927e32f07 => generated 1314 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:09:40.294870 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0ed37e72-afc0-40f7-9041-97929019cf97 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:40.296399 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-0ed37e72-afc0-40f7-9041-97929019cf97 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] [instance: 2cc4a044-6fff-47a3-b1bd-0e0927e32f07] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:40.305998 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0ed37e72-afc0-40f7-9041-97929019cf97 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:40.306794 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0ed37e72-afc0-40f7-9041-97929019cf97 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:40.307377 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0ed37e72-afc0-40f7-9041-97929019cf97 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:40.308310 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0ed37e72-afc0-40f7-9041-97929019cf97 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:40.308904 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0ed37e72-afc0-40f7-9041-97929019cf97 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:40.309478 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0ed37e72-afc0-40f7-9041-97929019cf97 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:40.558659 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-0ed37e72-afc0-40f7-9041-97929019cf97 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa165b905a34b1a86aeea1e28232cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd864e32279184978bd6f990dd83f8091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:40.570909 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-0ed37e72-afc0-40f7-9041-97929019cf97 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] 10.222.0.33 "GET /compute/v2.1/servers/2cc4a044-6fff-47a3-b1bd-0e0927e32f07" status: 200 len: 1314 microversion: 2.1 time: 0.282391 Oct 04 21:09:40.572729 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2818/5662] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:40 2022] GET /compute/v2.1/servers/2cc4a044-6fff-47a3-b1bd-0e0927e32f07 => generated 1314 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:09:41.601519 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-25a9fb12-ed44-461a-ba23-488aa5e5e774 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:41.610167 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-25a9fb12-ed44-461a-ba23-488aa5e5e774 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] [instance: 2cc4a044-6fff-47a3-b1bd-0e0927e32f07] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:41.628104 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-25a9fb12-ed44-461a-ba23-488aa5e5e774 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:41.628626 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-25a9fb12-ed44-461a-ba23-488aa5e5e774 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:41.629065 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-25a9fb12-ed44-461a-ba23-488aa5e5e774 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:41.629775 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-25a9fb12-ed44-461a-ba23-488aa5e5e774 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:41.633619 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-25a9fb12-ed44-461a-ba23-488aa5e5e774 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:41.634124 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-25a9fb12-ed44-461a-ba23-488aa5e5e774 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:41.992795 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-25a9fb12-ed44-461a-ba23-488aa5e5e774 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa165b905a34b1a86aeea1e28232cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd864e32279184978bd6f990dd83f8091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:42.019772 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-25a9fb12-ed44-461a-ba23-488aa5e5e774 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] 10.222.0.33 "GET /compute/v2.1/servers/2cc4a044-6fff-47a3-b1bd-0e0927e32f07" status: 200 len: 1314 microversion: 2.1 time: 0.425261 Oct 04 21:09:42.022286 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2845/5663] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:41 2022] GET /compute/v2.1/servers/2cc4a044-6fff-47a3-b1bd-0e0927e32f07 => generated 1314 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:09:43.045705 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5c2376df-e60b-47fd-b693-a1acfc7708c1 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:43.047023 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-5c2376df-e60b-47fd-b693-a1acfc7708c1 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] [instance: 2cc4a044-6fff-47a3-b1bd-0e0927e32f07] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:43.059894 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5c2376df-e60b-47fd-b693-a1acfc7708c1 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:43.060613 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5c2376df-e60b-47fd-b693-a1acfc7708c1 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:43.061237 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5c2376df-e60b-47fd-b693-a1acfc7708c1 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:43.062106 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5c2376df-e60b-47fd-b693-a1acfc7708c1 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:43.063325 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5c2376df-e60b-47fd-b693-a1acfc7708c1 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:43.064666 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5c2376df-e60b-47fd-b693-a1acfc7708c1 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:43.494535 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-5c2376df-e60b-47fd-b693-a1acfc7708c1 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa165b905a34b1a86aeea1e28232cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd864e32279184978bd6f990dd83f8091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:43.504525 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5c2376df-e60b-47fd-b693-a1acfc7708c1 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] 10.222.0.33 "GET /compute/v2.1/servers/2cc4a044-6fff-47a3-b1bd-0e0927e32f07" status: 200 len: 1314 microversion: 2.1 time: 0.462875 Oct 04 21:09:43.506369 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2819/5664] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:43 2022] GET /compute/v2.1/servers/2cc4a044-6fff-47a3-b1bd-0e0927e32f07 => generated 1314 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:09:44.546571 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-d8da8c70-e5ec-4af2-bb27-54c4fc0abbfd tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:44.554654 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-d8da8c70-e5ec-4af2-bb27-54c4fc0abbfd tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] [instance: 2cc4a044-6fff-47a3-b1bd-0e0927e32f07] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:44.557837 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell0:SELECT=2 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:09:44.559402 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell0:SELECT=6 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:09:44.589158 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d8da8c70-e5ec-4af2-bb27-54c4fc0abbfd tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:44.590850 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d8da8c70-e5ec-4af2-bb27-54c4fc0abbfd tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:44.591788 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d8da8c70-e5ec-4af2-bb27-54c4fc0abbfd tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:44.593163 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d8da8c70-e5ec-4af2-bb27-54c4fc0abbfd tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:44.594113 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d8da8c70-e5ec-4af2-bb27-54c4fc0abbfd tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:44.595367 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d8da8c70-e5ec-4af2-bb27-54c4fc0abbfd tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:44.973343 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-d8da8c70-e5ec-4af2-bb27-54c4fc0abbfd tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa165b905a34b1a86aeea1e28232cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd864e32279184978bd6f990dd83f8091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:44.990755 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-d8da8c70-e5ec-4af2-bb27-54c4fc0abbfd tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] 10.222.0.33 "GET /compute/v2.1/servers/2cc4a044-6fff-47a3-b1bd-0e0927e32f07" status: 200 len: 1314 microversion: 2.1 time: 0.450064 Oct 04 21:09:44.994805 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2846/5665] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:44 2022] GET /compute/v2.1/servers/2cc4a044-6fff-47a3-b1bd-0e0927e32f07 => generated 1314 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:09:45.556430 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-1f2cdfc9-5e44-4bc1-8110-b06ea25bc23b req-795857b6-dd14-46c1-acde-206c85f58a35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2cc4a044-6fff-47a3-b1bd-0e0927e32f07", "name": "network-vif-plugged", "status": "completed", "tag": "f22ce4d7-d626-467e-86e1-d00f1b2408f3"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:09:45.590096 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=4 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:09:45.648668 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-1f2cdfc9-5e44-4bc1-8110-b06ea25bc23b req-795857b6-dd14-46c1-acde-206c85f58a35 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:45.650459 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-1f2cdfc9-5e44-4bc1-8110-b06ea25bc23b req-795857b6-dd14-46c1-acde-206c85f58a35 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:45.651248 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-1f2cdfc9-5e44-4bc1-8110-b06ea25bc23b req-795857b6-dd14-46c1-acde-206c85f58a35 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:45.723307 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-1f2cdfc9-5e44-4bc1-8110-b06ea25bc23b req-795857b6-dd14-46c1-acde-206c85f58a35 service nova] Creating event network-vif-plugged:f22ce4d7-d626-467e-86e1-d00f1b2408f3 for instance 2cc4a044-6fff-47a3-b1bd-0e0927e32f07 on n-h1-854823-8 Oct 04 21:09:45.736918 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-1f2cdfc9-5e44-4bc1-8110-b06ea25bc23b req-795857b6-dd14-46c1-acde-206c85f58a35 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.188953 Oct 04 21:09:45.738079 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2820/5666] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:09:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:09:46.044244 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-598e2668-4b65-451d-829c-2fb1334b76b0 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:46.044926 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-598e2668-4b65-451d-829c-2fb1334b76b0 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] [instance: 2cc4a044-6fff-47a3-b1bd-0e0927e32f07] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:46.062505 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-598e2668-4b65-451d-829c-2fb1334b76b0 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:46.062505 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-598e2668-4b65-451d-829c-2fb1334b76b0 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:46.062505 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-598e2668-4b65-451d-829c-2fb1334b76b0 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:46.062505 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-598e2668-4b65-451d-829c-2fb1334b76b0 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:46.062505 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-598e2668-4b65-451d-829c-2fb1334b76b0 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:46.062505 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-598e2668-4b65-451d-829c-2fb1334b76b0 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:46.426247 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-598e2668-4b65-451d-829c-2fb1334b76b0 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa165b905a34b1a86aeea1e28232cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd864e32279184978bd6f990dd83f8091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:46.436243 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-598e2668-4b65-451d-829c-2fb1334b76b0 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] 10.222.0.33 "GET /compute/v2.1/servers/2cc4a044-6fff-47a3-b1bd-0e0927e32f07" status: 200 len: 1314 microversion: 2.1 time: 0.419433 Oct 04 21:09:46.436840 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2847/5667] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:46 2022] GET /compute/v2.1/servers/2cc4a044-6fff-47a3-b1bd-0e0927e32f07 => generated 1314 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:09:47.414120 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5939773c-c50c-4515-a4b3-c679c547f4c6 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:47.415326 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-5939773c-c50c-4515-a4b3-c679c547f4c6 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] [instance: bf706904-01fc-408d-a24e-0efb6de3e74f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:47.417943 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-32033ff9-cd5b-4484-8d0a-9adfe4d46f14 req-d28d6b73-5894-4590-a64e-7ab3a6e0813d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf706904-01fc-408d-a24e-0efb6de3e74f", "tag": "3505d3a9-94c4-427f-bb78-acac62fbee83"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:09:47.459729 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5939773c-c50c-4515-a4b3-c679c547f4c6 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:47.460601 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5939773c-c50c-4515-a4b3-c679c547f4c6 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:47.463779 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5939773c-c50c-4515-a4b3-c679c547f4c6 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:47.468393 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5939773c-c50c-4515-a4b3-c679c547f4c6 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:47.473077 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5939773c-c50c-4515-a4b3-c679c547f4c6 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:47.474914 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5939773c-c50c-4515-a4b3-c679c547f4c6 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:47.484083 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:09:47.504930 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-32033ff9-cd5b-4484-8d0a-9adfe4d46f14 req-d28d6b73-5894-4590-a64e-7ab3a6e0813d service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:47.505461 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-32033ff9-cd5b-4484-8d0a-9adfe4d46f14 req-d28d6b73-5894-4590-a64e-7ab3a6e0813d service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:47.505895 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-32033ff9-cd5b-4484-8d0a-9adfe4d46f14 req-d28d6b73-5894-4590-a64e-7ab3a6e0813d service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:47.532549 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-5939773c-c50c-4515-a4b3-c679c547f4c6 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] [instance: bf706904-01fc-408d-a24e-0efb6de3e74f] Going to try to terminate instance {{(pid=128801) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:09:47.539150 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-32033ff9-cd5b-4484-8d0a-9adfe4d46f14 req-d28d6b73-5894-4590-a64e-7ab3a6e0813d service nova] Creating event network-changed:3505d3a9-94c4-427f-bb78-acac62fbee83 for instance bf706904-01fc-408d-a24e-0efb6de3e74f on n-h2-854823-8 Oct 04 21:09:47.547940 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-32033ff9-cd5b-4484-8d0a-9adfe4d46f14 req-d28d6b73-5894-4590-a64e-7ab3a6e0813d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.142983 Oct 04 21:09:47.550979 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2848/5668] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:09:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:09:47.565922 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-7915a412-028a-4c1f-9f53-04c7ecb984a9 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:47.568817 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-7915a412-028a-4c1f-9f53-04c7ecb984a9 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] [instance: 2cc4a044-6fff-47a3-b1bd-0e0927e32f07] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:47.581344 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7915a412-028a-4c1f-9f53-04c7ecb984a9 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:47.581849 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7915a412-028a-4c1f-9f53-04c7ecb984a9 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:47.582303 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7915a412-028a-4c1f-9f53-04c7ecb984a9 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:47.587400 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7915a412-028a-4c1f-9f53-04c7ecb984a9 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:47.588143 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7915a412-028a-4c1f-9f53-04c7ecb984a9 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:47.589897 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7915a412-028a-4c1f-9f53-04c7ecb984a9 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:47.797513 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5939773c-c50c-4515-a4b3-c679c547f4c6 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] 10.222.0.33 "DELETE /compute/v2.1/servers/bf706904-01fc-408d-a24e-0efb6de3e74f" status: 204 len: 0 microversion: 2.1 time: 0.404959 Oct 04 21:09:47.809193 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2821/5669] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 21:09:47 2022] DELETE /compute/v2.1/servers/bf706904-01fc-408d-a24e-0efb6de3e74f => generated 0 bytes in 419 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:09:47.823827 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-cd0128d4-5bdb-4e36-bc70-fba94c09dd6b tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:47.829751 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-cd0128d4-5bdb-4e36-bc70-fba94c09dd6b tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] [instance: bf706904-01fc-408d-a24e-0efb6de3e74f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:47.845719 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cd0128d4-5bdb-4e36-bc70-fba94c09dd6b tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:47.846794 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cd0128d4-5bdb-4e36-bc70-fba94c09dd6b tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:47.847706 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cd0128d4-5bdb-4e36-bc70-fba94c09dd6b tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:47.849259 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cd0128d4-5bdb-4e36-bc70-fba94c09dd6b tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:47.850227 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cd0128d4-5bdb-4e36-bc70-fba94c09dd6b tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:47.851192 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cd0128d4-5bdb-4e36-bc70-fba94c09dd6b tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:48.085093 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-7915a412-028a-4c1f-9f53-04c7ecb984a9 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa165b905a34b1a86aeea1e28232cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd864e32279184978bd6f990dd83f8091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:48.102168 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-7915a412-028a-4c1f-9f53-04c7ecb984a9 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] 10.222.0.33 "GET /compute/v2.1/servers/2cc4a044-6fff-47a3-b1bd-0e0927e32f07" status: 200 len: 1314 microversion: 2.1 time: 0.548346 Oct 04 21:09:48.102812 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2849/5670] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:47 2022] GET /compute/v2.1/servers/2cc4a044-6fff-47a3-b1bd-0e0927e32f07 => generated 1314 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:09:48.261877 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-cd0128d4-5bdb-4e36-bc70-fba94c09dd6b tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5dbe3da6a4af181ef7302fe605fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3aa23aee3c8435c8f1f409019c5fed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:48.281250 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-cd0128d4-5bdb-4e36-bc70-fba94c09dd6b tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] 10.222.0.33 "GET /compute/v2.1/servers/bf706904-01fc-408d-a24e-0efb6de3e74f" status: 200 len: 1688 microversion: 2.1 time: 0.465105 Oct 04 21:09:48.291246 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2822/5671] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:47 2022] GET /compute/v2.1/servers/bf706904-01fc-408d-a24e-0efb6de3e74f => generated 1688 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:09:49.155111 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-eec9fad6-b6e9-4d24-bdac-475b42d91048 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:49.155918 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-eec9fad6-b6e9-4d24-bdac-475b42d91048 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] [instance: 2cc4a044-6fff-47a3-b1bd-0e0927e32f07] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:49.178776 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-eec9fad6-b6e9-4d24-bdac-475b42d91048 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:49.179342 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-eec9fad6-b6e9-4d24-bdac-475b42d91048 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:49.179821 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-eec9fad6-b6e9-4d24-bdac-475b42d91048 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:49.180642 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-eec9fad6-b6e9-4d24-bdac-475b42d91048 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:49.181144 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-eec9fad6-b6e9-4d24-bdac-475b42d91048 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:49.181812 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-eec9fad6-b6e9-4d24-bdac-475b42d91048 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:49.342043 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d2c81303-70af-4937-9747-cee16835d2ed tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:49.342732 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d2c81303-70af-4937-9747-cee16835d2ed tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] [instance: bf706904-01fc-408d-a24e-0efb6de3e74f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:49.350422 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d2c81303-70af-4937-9747-cee16835d2ed tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:49.356684 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d2c81303-70af-4937-9747-cee16835d2ed tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:49.358649 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d2c81303-70af-4937-9747-cee16835d2ed tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:49.359543 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d2c81303-70af-4937-9747-cee16835d2ed tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:49.360474 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d2c81303-70af-4937-9747-cee16835d2ed tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:49.361154 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d2c81303-70af-4937-9747-cee16835d2ed tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:49.951576 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-eec9fad6-b6e9-4d24-bdac-475b42d91048 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa165b905a34b1a86aeea1e28232cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd864e32279184978bd6f990dd83f8091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:49.983853 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-eec9fad6-b6e9-4d24-bdac-475b42d91048 tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] 10.222.0.33 "GET /compute/v2.1/servers/2cc4a044-6fff-47a3-b1bd-0e0927e32f07" status: 200 len: 1498 microversion: 2.1 time: 0.847251 Oct 04 21:09:49.986669 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2850/5672] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:49 2022] GET /compute/v2.1/servers/2cc4a044-6fff-47a3-b1bd-0e0927e32f07 => generated 1498 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:09:50.308475 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d2c81303-70af-4937-9747-cee16835d2ed tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5dbe3da6a4af181ef7302fe605fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3aa23aee3c8435c8f1f409019c5fed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:50.323041 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d2c81303-70af-4937-9747-cee16835d2ed tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] 10.222.0.33 "GET /compute/v2.1/servers/bf706904-01fc-408d-a24e-0efb6de3e74f" status: 200 len: 1688 microversion: 2.1 time: 0.986351 Oct 04 21:09:50.327197 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2823/5673] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:49 2022] GET /compute/v2.1/servers/bf706904-01fc-408d-a24e-0efb6de3e74f => generated 1688 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:09:51.100933 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-613b1804-0582-4b23-b7eb-d10d8df68b98 req-06c73913-b73e-4423-aa79-aa4cbf7ea9a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf706904-01fc-408d-a24e-0efb6de3e74f", "name": "network-vif-deleted", "tag": "3505d3a9-94c4-427f-bb78-acac62fbee83"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:09:51.106756 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-79cae9b1-dcb8-46ed-8eb9-37863bfe391b tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:51.107192 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-79cae9b1-dcb8-46ed-8eb9-37863bfe391b tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] [instance: 2cc4a044-6fff-47a3-b1bd-0e0927e32f07] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:51.137769 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-79cae9b1-dcb8-46ed-8eb9-37863bfe391b tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:51.157242 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-613b1804-0582-4b23-b7eb-d10d8df68b98 req-06c73913-b73e-4423-aa79-aa4cbf7ea9a2 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:51.157739 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-613b1804-0582-4b23-b7eb-d10d8df68b98 req-06c73913-b73e-4423-aa79-aa4cbf7ea9a2 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:51.158178 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-613b1804-0582-4b23-b7eb-d10d8df68b98 req-06c73913-b73e-4423-aa79-aa4cbf7ea9a2 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:51.160055 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-79cae9b1-dcb8-46ed-8eb9-37863bfe391b tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:51.160533 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-79cae9b1-dcb8-46ed-8eb9-37863bfe391b tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:51.161738 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-79cae9b1-dcb8-46ed-8eb9-37863bfe391b tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:51.162254 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-79cae9b1-dcb8-46ed-8eb9-37863bfe391b tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:51.164683 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-79cae9b1-dcb8-46ed-8eb9-37863bfe391b tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:51.240646 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-613b1804-0582-4b23-b7eb-d10d8df68b98 req-06c73913-b73e-4423-aa79-aa4cbf7ea9a2 service nova] Creating event network-vif-deleted:3505d3a9-94c4-427f-bb78-acac62fbee83 for instance bf706904-01fc-408d-a24e-0efb6de3e74f on n-h2-854823-8 Oct 04 21:09:51.276776 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-613b1804-0582-4b23-b7eb-d10d8df68b98 req-06c73913-b73e-4423-aa79-aa4cbf7ea9a2 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.190110 Oct 04 21:09:51.282501 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2851/5674] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:09:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:09:51.330262 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-79cae9b1-dcb8-46ed-8eb9-37863bfe391b tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] [instance: 2cc4a044-6fff-47a3-b1bd-0e0927e32f07] Going to try to terminate instance {{(pid=128801) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:09:51.348669 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-fca56b31-4017-4ef3-a328-88150980140f tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:51.350202 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-fca56b31-4017-4ef3-a328-88150980140f tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] [instance: bf706904-01fc-408d-a24e-0efb6de3e74f] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:51.374807 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fca56b31-4017-4ef3-a328-88150980140f tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:51.375311 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fca56b31-4017-4ef3-a328-88150980140f tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:51.387984 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fca56b31-4017-4ef3-a328-88150980140f tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:51.391630 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fca56b31-4017-4ef3-a328-88150980140f tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:51.392307 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fca56b31-4017-4ef3-a328-88150980140f tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:51.392763 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fca56b31-4017-4ef3-a328-88150980140f tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:51.558792 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fca56b31-4017-4ef3-a328-88150980140f tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:51.558792 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fca56b31-4017-4ef3-a328-88150980140f tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:51.561361 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fca56b31-4017-4ef3-a328-88150980140f tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:51.562183 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.objects.instance [None req-fca56b31-4017-4ef3-a328-88150980140f tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lazy-loading 'fault' on Instance uuid bf706904-01fc-408d-a24e-0efb6de3e74f {{(pid=128802) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:09:51.722315 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-fca56b31-4017-4ef3-a328-88150980140f tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be5dbe3da6a4af181ef7302fe605fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3aa23aee3c8435c8f1f409019c5fed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:51.740464 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-fca56b31-4017-4ef3-a328-88150980140f tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] 10.222.0.33 "GET /compute/v2.1/servers/bf706904-01fc-408d-a24e-0efb6de3e74f" status: 200 len: 1356 microversion: 2.1 time: 0.390981 Oct 04 21:09:51.756838 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2852/5675] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:51 2022] GET /compute/v2.1/servers/bf706904-01fc-408d-a24e-0efb6de3e74f => generated 1356 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:09:51.799942 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-79cae9b1-dcb8-46ed-8eb9-37863bfe391b tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] 10.222.0.33 "DELETE /compute/v2.1/servers/2cc4a044-6fff-47a3-b1bd-0e0927e32f07" status: 204 len: 0 microversion: 2.1 time: 0.693121 Oct 04 21:09:51.801181 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2824/5676] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 21:09:51 2022] DELETE /compute/v2.1/servers/2cc4a044-6fff-47a3-b1bd-0e0927e32f07 => generated 0 bytes in 705 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 21:09:51.816573 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-bb4e0cc7-502b-4816-8198-aef07998881f tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:51.823100 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-bb4e0cc7-502b-4816-8198-aef07998881f tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] [instance: 2cc4a044-6fff-47a3-b1bd-0e0927e32f07] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:51.846702 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bb4e0cc7-502b-4816-8198-aef07998881f tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:51.850474 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bb4e0cc7-502b-4816-8198-aef07998881f tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:51.853096 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bb4e0cc7-502b-4816-8198-aef07998881f tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:51.853960 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bb4e0cc7-502b-4816-8198-aef07998881f tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:51.857170 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bb4e0cc7-502b-4816-8198-aef07998881f tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:51.857950 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bb4e0cc7-502b-4816-8198-aef07998881f tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:52.249345 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-bb4e0cc7-502b-4816-8198-aef07998881f tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa165b905a34b1a86aeea1e28232cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd864e32279184978bd6f990dd83f8091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:52.261887 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-bb4e0cc7-502b-4816-8198-aef07998881f tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] 10.222.0.33 "GET /compute/v2.1/servers/2cc4a044-6fff-47a3-b1bd-0e0927e32f07" status: 200 len: 1504 microversion: 2.1 time: 0.455890 Oct 04 21:09:52.280529 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2853/5677] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:51 2022] GET /compute/v2.1/servers/2cc4a044-6fff-47a3-b1bd-0e0927e32f07 => generated 1504 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:09:52.785451 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a44dd7b8-5d3b-4559-baba-bc358974eec4 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:52.788193 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a44dd7b8-5d3b-4559-baba-bc358974eec4 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] [instance: bf706904-01fc-408d-a24e-0efb6de3e74f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:52.825445 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a44dd7b8-5d3b-4559-baba-bc358974eec4 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:52.828265 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a44dd7b8-5d3b-4559-baba-bc358974eec4 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:52.842831 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a44dd7b8-5d3b-4559-baba-bc358974eec4 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:52.856919 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a44dd7b8-5d3b-4559-baba-bc358974eec4 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:52.858037 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a44dd7b8-5d3b-4559-baba-bc358974eec4 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:52.860633 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a44dd7b8-5d3b-4559-baba-bc358974eec4 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:52.914058 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-a44dd7b8-5d3b-4559-baba-bc358974eec4 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] HTTP exception thrown: Instance bf706904-01fc-408d-a24e-0efb6de3e74f could not be found. Oct 04 21:09:52.915842 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a44dd7b8-5d3b-4559-baba-bc358974eec4 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Request method failure captured: Oct 04 21:09:52.915842 n-d-854823-8 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/bf706904-01fc-408d-a24e-0efb6de3e74f HTTP/1.1 Oct 04 21:09:52.915842 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 21:09:52.915842 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 21:09:52.915842 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 21:09:52.915842 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 0 Oct 04 21:09:52.915842 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 21:09:52.915842 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 21:09:52.915842 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 21:09:52.915842 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 21:09:52.915842 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPJ6ORv5f7ucUc1GgNtAvhRFv0MfXY90YwD2xgHLgYfsVRwUV5gV1Hx78rlUpKA1NRvwYKNJhb7yIJiTiGqKIsoz35JtnB2AAmUjVwzFJr8QnfB8bfTqI5gxOvM7f9zAR1w4iePiaw2CxUuNcF2SaDuAI205FbH1jwb6Vgw17rzPCl_Q Oct 04 21:09:52.915842 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 21:09:52.915842 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 21:09:52.915842 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 21:09:52.915842 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 21:09:52.915842 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 21:09:52.915842 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 21:09:52.915842 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: b3aa23aee3c8435c8f1f409019c5fed2 Oct 04 21:09:52.915842 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1628573817 Oct 04 21:09:52.915842 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 21:09:52.915842 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 21:09:52.915842 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b3aa23aee3c8435c8f1f409019c5fed2", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b3aa23aee3c8435c8f1f409019c5fed2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b3aa23aee3c8435c8f1f409019c5fed2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b3aa23aee3c8435c8f1f409019c5fed2"}]}] Oct 04 21:09:52.915842 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1628573817 Oct 04 21:09:52.915842 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: b3aa23aee3c8435c8f1f409019c5fed2 Oct 04 21:09:52.915842 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1628573817 Oct 04 21:09:52.915842 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-TestNetworkAdvancedServerOps-1628573817-project Oct 04 21:09:52.915842 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 21:09:52.915842 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 21:09:52.915842 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: 0be5dbe3da6a4af181ef7302fe605fb4 Oct 04 21:09:52.915842 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1628573817-project Oct 04 21:09:52.915842 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 21:09:52.915842 n-d-854823-8 devstack@n-api.service[128801]: exception: Instance bf706904-01fc-408d-a24e-0efb6de3e74f could not be found. Oct 04 21:09:52.915842 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': 'bf706904-01fc-408d-a24e-0efb6de3e74f'} Oct 04 21:09:52.915842 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:09:52.915842 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:09:52.915842 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:09:52.915842 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:09:52.915842 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:09:52.915842 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:09:52.915842 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:09:52.915842 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:09:52.915842 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:09:52.915842 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:09:52.915842 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf706904-01fc-408d-a24e-0efb6de3e74f could not be found. Oct 04 21:09:52.915842 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:09:52.915842 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:09:52.915842 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:09:52.915842 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:09:52.915842 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:09:52.915842 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:09:52.915842 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:09:52.915842 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:09:52.915842 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:09:52.915842 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:09:52.915842 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:09:52.915842 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:09:52.915842 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:09:52.915842 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:09:52.915842 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:09:52.915842 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:09:52.915842 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf706904-01fc-408d-a24e-0efb6de3e74f could not be found. Oct 04 21:09:52.915842 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:09:52.915842 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:09:52.919289 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:09:52.919289 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:09:52.919289 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:09:52.919289 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:09:52.919289 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:09:52.919289 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:09:52.919289 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf706904-01fc-408d-a24e-0efb6de3e74f could not be found. Oct 04 21:09:52.919289 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:09:52.919289 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a44dd7b8-5d3b-4559-baba-bc358974eec4 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Returning 404 to user: Instance bf706904-01fc-408d-a24e-0efb6de3e74f could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:09:52.919289 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a44dd7b8-5d3b-4559-baba-bc358974eec4 tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] 10.222.0.33 "GET /compute/v2.1/servers/bf706904-01fc-408d-a24e-0efb6de3e74f" status: 404 len: 111 microversion: 2.1 time: 0.152994 Oct 04 21:09:52.926622 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2825/5678] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:52 2022] GET /compute/v2.1/servers/bf706904-01fc-408d-a24e-0efb6de3e74f => generated 111 bytes in 163 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:09:53.297079 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-b0063544-6295-4a1c-b7df-51823605831e tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:53.298408 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-b0063544-6295-4a1c-b7df-51823605831e tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] [instance: 2cc4a044-6fff-47a3-b1bd-0e0927e32f07] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:53.318892 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b0063544-6295-4a1c-b7df-51823605831e tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:53.319713 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b0063544-6295-4a1c-b7df-51823605831e tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:53.320333 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b0063544-6295-4a1c-b7df-51823605831e tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:53.323591 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b0063544-6295-4a1c-b7df-51823605831e tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:53.324324 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b0063544-6295-4a1c-b7df-51823605831e tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:53.324950 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b0063544-6295-4a1c-b7df-51823605831e tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:53.976645 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-b0063544-6295-4a1c-b7df-51823605831e tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa165b905a34b1a86aeea1e28232cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd864e32279184978bd6f990dd83f8091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:53.984563 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-b0063544-6295-4a1c-b7df-51823605831e tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] 10.222.0.33 "GET /compute/v2.1/servers/2cc4a044-6fff-47a3-b1bd-0e0927e32f07" status: 200 len: 1504 microversion: 2.1 time: 0.701574 Oct 04 21:09:53.993080 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2854/5679] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:53 2022] GET /compute/v2.1/servers/2cc4a044-6fff-47a3-b1bd-0e0927e32f07 => generated 1504 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:09:54.678752 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-c2ec5813-e07d-4a13-bc24-5bcc0496f4e3 req-c5794cbb-92d6-4127-bb72-50f8ece7bc97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2cc4a044-6fff-47a3-b1bd-0e0927e32f07", "name": "network-vif-deleted", "tag": "f22ce4d7-d626-467e-86e1-d00f1b2408f3"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:09:54.762983 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-c2ec5813-e07d-4a13-bc24-5bcc0496f4e3 req-c5794cbb-92d6-4127-bb72-50f8ece7bc97 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:54.766750 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-c2ec5813-e07d-4a13-bc24-5bcc0496f4e3 req-c5794cbb-92d6-4127-bb72-50f8ece7bc97 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:54.769933 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-c2ec5813-e07d-4a13-bc24-5bcc0496f4e3 req-c5794cbb-92d6-4127-bb72-50f8ece7bc97 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:54.835383 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-c2ec5813-e07d-4a13-bc24-5bcc0496f4e3 req-c5794cbb-92d6-4127-bb72-50f8ece7bc97 service nova] Creating event network-vif-deleted:f22ce4d7-d626-467e-86e1-d00f1b2408f3 for instance 2cc4a044-6fff-47a3-b1bd-0e0927e32f07 on n-h1-854823-8 Oct 04 21:09:54.883951 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-c2ec5813-e07d-4a13-bc24-5bcc0496f4e3 req-c5794cbb-92d6-4127-bb72-50f8ece7bc97 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.197859 Oct 04 21:09:54.902571 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2826/5680] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:09:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:09:55.010512 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-e31c5236-0a14-457c-8979-ff2a62e4721a tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:55.011143 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-e31c5236-0a14-457c-8979-ff2a62e4721a tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] [instance: 2cc4a044-6fff-47a3-b1bd-0e0927e32f07] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:55.031523 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e31c5236-0a14-457c-8979-ff2a62e4721a tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:55.032026 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e31c5236-0a14-457c-8979-ff2a62e4721a tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:55.032462 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e31c5236-0a14-457c-8979-ff2a62e4721a tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:55.033177 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e31c5236-0a14-457c-8979-ff2a62e4721a tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:55.033638 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e31c5236-0a14-457c-8979-ff2a62e4721a tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:55.034067 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e31c5236-0a14-457c-8979-ff2a62e4721a tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:55.156728 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e31c5236-0a14-457c-8979-ff2a62e4721a tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:55.157237 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e31c5236-0a14-457c-8979-ff2a62e4721a tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:55.157694 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e31c5236-0a14-457c-8979-ff2a62e4721a tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:55.158155 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.objects.instance [None req-e31c5236-0a14-457c-8979-ff2a62e4721a tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Lazy-loading 'fault' on Instance uuid 2cc4a044-6fff-47a3-b1bd-0e0927e32f07 {{(pid=128802) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:09:56.271605 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-e31c5236-0a14-457c-8979-ff2a62e4721a tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa165b905a34b1a86aeea1e28232cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd864e32279184978bd6f990dd83f8091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:09:56.287174 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-e31c5236-0a14-457c-8979-ff2a62e4721a tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] 10.222.0.33 "GET /compute/v2.1/servers/2cc4a044-6fff-47a3-b1bd-0e0927e32f07" status: 200 len: 1304 microversion: 2.1 time: 1.280550 Oct 04 21:09:56.295124 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2855/5681] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:55 2022] GET /compute/v2.1/servers/2cc4a044-6fff-47a3-b1bd-0e0927e32f07 => generated 1304 bytes in 1290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:09:57.342565 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-834fa164-06d9-41ab-81f0-e3beaa04af8a tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:09:57.343334 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-834fa164-06d9-41ab-81f0-e3beaa04af8a tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] [instance: 2cc4a044-6fff-47a3-b1bd-0e0927e32f07] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:09:57.360246 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-834fa164-06d9-41ab-81f0-e3beaa04af8a tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:57.361073 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-834fa164-06d9-41ab-81f0-e3beaa04af8a tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:57.362926 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-834fa164-06d9-41ab-81f0-e3beaa04af8a tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:57.367660 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-834fa164-06d9-41ab-81f0-e3beaa04af8a tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:09:57.369143 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-834fa164-06d9-41ab-81f0-e3beaa04af8a tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:09:57.370388 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-834fa164-06d9-41ab-81f0-e3beaa04af8a tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:09:57.401824 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-834fa164-06d9-41ab-81f0-e3beaa04af8a tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] HTTP exception thrown: Instance 2cc4a044-6fff-47a3-b1bd-0e0927e32f07 could not be found. Oct 04 21:09:57.404378 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-834fa164-06d9-41ab-81f0-e3beaa04af8a tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Request method failure captured: Oct 04 21:09:57.404378 n-d-854823-8 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/2cc4a044-6fff-47a3-b1bd-0e0927e32f07 HTTP/1.1 Oct 04 21:09:57.404378 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 21:09:57.404378 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 21:09:57.404378 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 21:09:57.404378 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 0 Oct 04 21:09:57.404378 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 21:09:57.404378 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 21:09:57.404378 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 21:09:57.404378 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 21:09:57.404378 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPKDs5fdnujP9dAOUbtFkZMltOiSmPECqAUtSsAWL2k8enUFGtE2h020RqSdJuVeOoqQUdP3tJp4RSIiLYunfbFMY4NFmwGdW_-oCbQWTXNdp1gIfyUG9GzCT5AHUa-EiktpPvN3lA4s1ebDuoiiftcmShWf7d9GXUBLqFBkCt_MsaE4 Oct 04 21:09:57.404378 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 21:09:57.404378 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 21:09:57.404378 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 21:09:57.404378 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 21:09:57.404378 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 21:09:57.404378 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 21:09:57.404378 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: d864e32279184978bd6f990dd83f8091 Oct 04 21:09:57.404378 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-VolumesActionsTest-2040191366 Oct 04 21:09:57.404378 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 21:09:57.404378 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 21:09:57.404378 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d864e32279184978bd6f990dd83f8091", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d864e32279184978bd6f990dd83f8091"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d864e32279184978bd6f990dd83f8091"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d864e32279184978bd6f990dd83f8091"}]}] Oct 04 21:09:57.404378 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-VolumesActionsTest-2040191366 Oct 04 21:09:57.404378 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: d864e32279184978bd6f990dd83f8091 Oct 04 21:09:57.404378 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-VolumesActionsTest-2040191366 Oct 04 21:09:57.404378 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-VolumesActionsTest-2040191366-project Oct 04 21:09:57.404378 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 21:09:57.404378 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 21:09:57.404378 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: 5aa165b905a34b1a86aeea1e28232cad Oct 04 21:09:57.404378 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-VolumesActionsTest-2040191366-project Oct 04 21:09:57.404378 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 21:09:57.404378 n-d-854823-8 devstack@n-api.service[128801]: exception: Instance 2cc4a044-6fff-47a3-b1bd-0e0927e32f07 could not be found. Oct 04 21:09:57.404378 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': '2cc4a044-6fff-47a3-b1bd-0e0927e32f07'} Oct 04 21:09:57.404378 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:09:57.404378 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:09:57.404378 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:09:57.404378 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:09:57.404378 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:09:57.404378 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:09:57.404378 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:09:57.404378 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:09:57.404378 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:09:57.404378 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:09:57.404378 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2cc4a044-6fff-47a3-b1bd-0e0927e32f07 could not be found. Oct 04 21:09:57.404378 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:09:57.404378 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:09:57.404378 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:09:57.404378 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:09:57.404378 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:09:57.404378 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:09:57.404378 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:09:57.404378 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:09:57.404378 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:09:57.404378 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:09:57.404378 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:09:57.404378 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:09:57.404378 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:09:57.404378 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:09:57.404378 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:09:57.404378 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:09:57.404378 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2cc4a044-6fff-47a3-b1bd-0e0927e32f07 could not be found. Oct 04 21:09:57.404378 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:09:57.404378 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:09:57.404378 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:09:57.407999 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:09:57.407999 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:09:57.407999 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:09:57.407999 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:09:57.407999 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:09:57.407999 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2cc4a044-6fff-47a3-b1bd-0e0927e32f07 could not be found. Oct 04 21:09:57.407999 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:09:57.409682 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-834fa164-06d9-41ab-81f0-e3beaa04af8a tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] Returning 404 to user: Instance 2cc4a044-6fff-47a3-b1bd-0e0927e32f07 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:09:57.414898 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-834fa164-06d9-41ab-81f0-e3beaa04af8a tempest-VolumesActionsTest-2040191366 tempest-VolumesActionsTest-2040191366-project] 10.222.0.33 "GET /compute/v2.1/servers/2cc4a044-6fff-47a3-b1bd-0e0927e32f07" status: 404 len: 111 microversion: 2.1 time: 0.077850 Oct 04 21:09:57.416122 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2827/5682] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:09:57 2022] GET /compute/v2.1/servers/2cc4a044-6fff-47a3-b1bd-0e0927e32f07 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:10:03.534829 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-4229112f-2883-4d1f-941f-73003bb6d56d tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Action: 'create', calling method: .version_select at 0x7f3c6f652040>, body: {"keypair": {"name": "tempest-keypair-763380985", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD2h+fufdQ0fwclYHdYi+aanjfqc7UbcNjvRL20wCnCM0UNDse6omNhKwnWYEb45UGr3jWe0Zl/M557GGRIPLBhS787MXiv7wtPnhfkVAJKWtT0NfAJe710GUWa6yLPMTA=="}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:10:03.552273 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=3 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:10:03.603714 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-4229112f-2883-4d1f-941f-73003bb6d56d tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Getting quotas for project 40732638975044868e5a5eb5f4235244. Resources: {'key_pairs'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:10:03.635352 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-4229112f-2883-4d1f-941f-73003bb6d56d tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Getting quotas for user 7b627e66ccd94b8faabf8ce9f1d2d2a6 and project 40732638975044868e5a5eb5f4235244. Resources: {'key_pairs'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:10:03.710957 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-4229112f-2883-4d1f-941f-73003bb6d56d tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.694469 Oct 04 21:10:03.713329 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2856/5683] 10.222.0.33 () {60 vars in 1159 bytes} [Tue Oct 4 21:10:03 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:10:04.131026 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-3d553490-07c5-4b2f-b004-68e48c4d797a tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] Calling method '.version_select at 0x7f3c74223820>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:04.144025 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:10:04.216638 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-3d553490-07c5-4b2f-b004-68e48c4d797a tempest-TestNetworkAdvancedServerOps-1628573817 tempest-TestNetworkAdvancedServerOps-1628573817-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2059665705" status: 202 len: 0 microversion: 2.1 time: 0.090247 Oct 04 21:10:04.220804 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2828/5684] 10.222.0.33 () {58 vars in 1284 bytes} [Tue Oct 4 21:10:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2059665705 => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:10:07.920293 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-a14be037-0342-4b79-bd6c-aaf9b57c7d9f tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-31621881", "imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2472a779-ff3d-4762-a79e-b1fcabbed6fb"}], "security_groups": [{"name": "tempest-securitygroup--1881860002"}], "key_name": "tempest-keypair-763380985", "user_data": "}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:10:07.978151 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=79 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:10:08.318137 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.network.neutron [None req-a14be037-0342-4b79-bd6c-aaf9b57c7d9f tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] validate_networks() for [('2472a779-ff3d-4762-a79e-b1fcabbed6fb', None, None, None, None, None)] {{(pid=128802) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:10:09.536912 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-a14be037-0342-4b79-bd6c-aaf9b57c7d9f tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Flavor limits 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:10:09.537851 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-a14be037-0342-4b79-bd6c-aaf9b57c7d9f tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Image limits 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:10:09.538002 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-a14be037-0342-4b79-bd6c-aaf9b57c7d9f tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Flavor pref 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:10:09.538472 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-a14be037-0342-4b79-bd6c-aaf9b57c7d9f tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Image pref 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:10:09.538971 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-a14be037-0342-4b79-bd6c-aaf9b57c7d9f tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:10:09.558943 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a14be037-0342-4b79-bd6c-aaf9b57c7d9f tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:09.560118 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a14be037-0342-4b79-bd6c-aaf9b57c7d9f tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:09.562805 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a14be037-0342-4b79-bd6c-aaf9b57c7d9f tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:09.564550 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a14be037-0342-4b79-bd6c-aaf9b57c7d9f tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:09.566579 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a14be037-0342-4b79-bd6c-aaf9b57c7d9f tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:09.569906 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a14be037-0342-4b79-bd6c-aaf9b57c7d9f tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:09.626660 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-a14be037-0342-4b79-bd6c-aaf9b57c7d9f tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Getting quotas for project 40732638975044868e5a5eb5f4235244. Resources: {'ram', 'instances', 'cores'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:10:09.634512 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-a14be037-0342-4b79-bd6c-aaf9b57c7d9f tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Getting quotas for user 7b627e66ccd94b8faabf8ce9f1d2d2a6 and project 40732638975044868e5a5eb5f4235244. Resources: {'ram', 'instances', 'cores'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:10:09.656334 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-a14be037-0342-4b79-bd6c-aaf9b57c7d9f tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Going to run 1 instances... {{(pid=128802) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:10:09.659478 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-a14be037-0342-4b79-bd6c-aaf9b57c7d9f tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] [instance: c7262313-6b85-476f-a1ca-79d04fcf5740] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='15b24725-0c99-4bcf-b1fb-907cdf8e2d63',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128802) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:10:09.747582 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-a14be037-0342-4b79-bd6c-aaf9b57c7d9f tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.831808 Oct 04 21:10:09.755304 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2857/5685] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 21:10:07 2022] POST /compute/v2.1/servers => generated 402 bytes in 1836 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:10:09.763763 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-41856872-2d02-4dda-8522-ba825349057f tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:09.765199 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-41856872-2d02-4dda-8522-ba825349057f tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] [instance: c7262313-6b85-476f-a1ca-79d04fcf5740] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:09.775690 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=45,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:10:09.931686 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-41856872-2d02-4dda-8522-ba825349057f tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b627e66ccd94b8faabf8ce9f1d2d2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40732638975044868e5a5eb5f4235244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:09.941556 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-41856872-2d02-4dda-8522-ba825349057f tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] 10.222.0.33 "GET /compute/v2.1/servers/c7262313-6b85-476f-a1ca-79d04fcf5740" status: 200 len: 1235 microversion: 2.1 time: 0.184189 Oct 04 21:10:09.951738 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2829/5686] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:10:09 2022] GET /compute/v2.1/servers/c7262313-6b85-476f-a1ca-79d04fcf5740 => generated 1235 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:10:10.980248 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-8ed3e3c0-7a35-4151-bcb3-68a99d9d4765 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:10.981508 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-8ed3e3c0-7a35-4151-bcb3-68a99d9d4765 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] [instance: c7262313-6b85-476f-a1ca-79d04fcf5740] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:11.375564 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-8ed3e3c0-7a35-4151-bcb3-68a99d9d4765 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b627e66ccd94b8faabf8ce9f1d2d2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40732638975044868e5a5eb5f4235244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:11.420040 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-8ed3e3c0-7a35-4151-bcb3-68a99d9d4765 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] 10.222.0.33 "GET /compute/v2.1/servers/c7262313-6b85-476f-a1ca-79d04fcf5740" status: 200 len: 1235 microversion: 2.1 time: 0.445510 Oct 04 21:10:11.427063 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2858/5687] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:10:10 2022] GET /compute/v2.1/servers/c7262313-6b85-476f-a1ca-79d04fcf5740 => generated 1235 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:10:12.463836 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0b33a282-d598-4483-9b02-56135ddda77c tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:12.465326 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-0b33a282-d598-4483-9b02-56135ddda77c tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] [instance: c7262313-6b85-476f-a1ca-79d04fcf5740] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:12.477819 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0b33a282-d598-4483-9b02-56135ddda77c tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:12.482073 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0b33a282-d598-4483-9b02-56135ddda77c tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:12.482816 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0b33a282-d598-4483-9b02-56135ddda77c tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:12.484662 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0b33a282-d598-4483-9b02-56135ddda77c tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:12.487088 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0b33a282-d598-4483-9b02-56135ddda77c tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:12.487719 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0b33a282-d598-4483-9b02-56135ddda77c tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:12.649044 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-0b33a282-d598-4483-9b02-56135ddda77c tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b627e66ccd94b8faabf8ce9f1d2d2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40732638975044868e5a5eb5f4235244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:12.668871 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-0b33a282-d598-4483-9b02-56135ddda77c tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] 10.222.0.33 "GET /compute/v2.1/servers/c7262313-6b85-476f-a1ca-79d04fcf5740" status: 200 len: 1295 microversion: 2.1 time: 0.222144 Oct 04 21:10:12.673721 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2830/5688] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:10:12 2022] GET /compute/v2.1/servers/c7262313-6b85-476f-a1ca-79d04fcf5740 => generated 1295 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:10:13.705679 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-7b72108b-6cbd-44fe-a518-58417396424a tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:13.706511 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-7b72108b-6cbd-44fe-a518-58417396424a tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] [instance: c7262313-6b85-476f-a1ca-79d04fcf5740] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:13.736243 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7b72108b-6cbd-44fe-a518-58417396424a tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:13.746323 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7b72108b-6cbd-44fe-a518-58417396424a tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:13.754272 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7b72108b-6cbd-44fe-a518-58417396424a tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:13.755693 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7b72108b-6cbd-44fe-a518-58417396424a tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:13.756214 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7b72108b-6cbd-44fe-a518-58417396424a tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:13.756653 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7b72108b-6cbd-44fe-a518-58417396424a tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:14.320623 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-7b72108b-6cbd-44fe-a518-58417396424a tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b627e66ccd94b8faabf8ce9f1d2d2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40732638975044868e5a5eb5f4235244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:14.331634 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-7b72108b-6cbd-44fe-a518-58417396424a tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] 10.222.0.33 "GET /compute/v2.1/servers/c7262313-6b85-476f-a1ca-79d04fcf5740" status: 200 len: 1293 microversion: 2.1 time: 0.634302 Oct 04 21:10:14.353393 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2859/5689] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:10:13 2022] GET /compute/v2.1/servers/c7262313-6b85-476f-a1ca-79d04fcf5740 => generated 1293 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:10:15.362442 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1b556221-04c6-4fa1-99e8-a500343e6ab9 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:15.363184 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-1b556221-04c6-4fa1-99e8-a500343e6ab9 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] [instance: c7262313-6b85-476f-a1ca-79d04fcf5740] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:15.409460 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1b556221-04c6-4fa1-99e8-a500343e6ab9 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:15.409976 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1b556221-04c6-4fa1-99e8-a500343e6ab9 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:15.410455 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1b556221-04c6-4fa1-99e8-a500343e6ab9 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:15.411306 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1b556221-04c6-4fa1-99e8-a500343e6ab9 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:15.411775 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1b556221-04c6-4fa1-99e8-a500343e6ab9 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:15.412214 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1b556221-04c6-4fa1-99e8-a500343e6ab9 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:16.379774 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-1b556221-04c6-4fa1-99e8-a500343e6ab9 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b627e66ccd94b8faabf8ce9f1d2d2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40732638975044868e5a5eb5f4235244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:16.400234 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-1b556221-04c6-4fa1-99e8-a500343e6ab9 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] 10.222.0.33 "GET /compute/v2.1/servers/c7262313-6b85-476f-a1ca-79d04fcf5740" status: 200 len: 1361 microversion: 2.1 time: 1.036757 Oct 04 21:10:16.403822 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2831/5690] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:10:15 2022] GET /compute/v2.1/servers/c7262313-6b85-476f-a1ca-79d04fcf5740 => generated 1361 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:10:17.434056 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-4470db47-3b00-4aff-b9be-7245bbd3269b tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:17.436126 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-4470db47-3b00-4aff-b9be-7245bbd3269b tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] [instance: c7262313-6b85-476f-a1ca-79d04fcf5740] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:17.478710 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4470db47-3b00-4aff-b9be-7245bbd3269b tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:17.479406 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4470db47-3b00-4aff-b9be-7245bbd3269b tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:17.480387 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4470db47-3b00-4aff-b9be-7245bbd3269b tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:17.481351 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4470db47-3b00-4aff-b9be-7245bbd3269b tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:17.482289 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4470db47-3b00-4aff-b9be-7245bbd3269b tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:17.482843 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4470db47-3b00-4aff-b9be-7245bbd3269b tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:17.977770 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-a3fc694c-d7e8-4ab0-a429-19036ccd042c req-4140fdea-a118-412a-bfae-afed70e29593 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7262313-6b85-476f-a1ca-79d04fcf5740", "tag": "a3bf10f7-790c-43f8-9084-d92fd1c978f1"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:10:18.011407 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-a3fc694c-d7e8-4ab0-a429-19036ccd042c req-4140fdea-a118-412a-bfae-afed70e29593 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:18.012183 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-a3fc694c-d7e8-4ab0-a429-19036ccd042c req-4140fdea-a118-412a-bfae-afed70e29593 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:18.012815 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-a3fc694c-d7e8-4ab0-a429-19036ccd042c req-4140fdea-a118-412a-bfae-afed70e29593 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:18.048175 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-a3fc694c-d7e8-4ab0-a429-19036ccd042c req-4140fdea-a118-412a-bfae-afed70e29593 service nova] Creating event network-changed:a3bf10f7-790c-43f8-9084-d92fd1c978f1 for instance c7262313-6b85-476f-a1ca-79d04fcf5740 on n-h2-854823-8 Oct 04 21:10:18.085306 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-a3fc694c-d7e8-4ab0-a429-19036ccd042c req-4140fdea-a118-412a-bfae-afed70e29593 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111978 Oct 04 21:10:18.088330 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2832/5691] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:10:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:10:18.882861 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-4470db47-3b00-4aff-b9be-7245bbd3269b tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b627e66ccd94b8faabf8ce9f1d2d2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40732638975044868e5a5eb5f4235244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:18.912123 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-4470db47-3b00-4aff-b9be-7245bbd3269b tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] 10.222.0.33 "GET /compute/v2.1/servers/c7262313-6b85-476f-a1ca-79d04fcf5740" status: 200 len: 1361 microversion: 2.1 time: 1.465738 Oct 04 21:10:18.915076 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2860/5692] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:10:17 2022] GET /compute/v2.1/servers/c7262313-6b85-476f-a1ca-79d04fcf5740 => generated 1361 bytes in 1488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:10:19.953603 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:10:19.961487 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0fbab05a-3d95-4c20-b291-190b90042c51 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:19.963217 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-0fbab05a-3d95-4c20-b291-190b90042c51 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] [instance: c7262313-6b85-476f-a1ca-79d04fcf5740] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:19.982627 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0fbab05a-3d95-4c20-b291-190b90042c51 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:19.983036 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0fbab05a-3d95-4c20-b291-190b90042c51 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:19.983478 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0fbab05a-3d95-4c20-b291-190b90042c51 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:19.984218 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0fbab05a-3d95-4c20-b291-190b90042c51 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:19.991539 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0fbab05a-3d95-4c20-b291-190b90042c51 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:19.991991 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0fbab05a-3d95-4c20-b291-190b90042c51 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:20.372831 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-0fbab05a-3d95-4c20-b291-190b90042c51 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b627e66ccd94b8faabf8ce9f1d2d2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40732638975044868e5a5eb5f4235244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:20.383820 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-0fbab05a-3d95-4c20-b291-190b90042c51 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] 10.222.0.33 "GET /compute/v2.1/servers/c7262313-6b85-476f-a1ca-79d04fcf5740" status: 200 len: 1361 microversion: 2.1 time: 0.431828 Oct 04 21:10:20.390983 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2833/5693] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:10:19 2022] GET /compute/v2.1/servers/c7262313-6b85-476f-a1ca-79d04fcf5740 => generated 1361 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:10:21.415524 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-ecf25290-3ec5-4a1c-84e9-551d7f3c04d8 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:21.416147 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-ecf25290-3ec5-4a1c-84e9-551d7f3c04d8 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] [instance: c7262313-6b85-476f-a1ca-79d04fcf5740] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:21.429489 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell0:SELECT=2 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:10:21.439786 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell0:SELECT=12 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:10:21.452083 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ecf25290-3ec5-4a1c-84e9-551d7f3c04d8 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:21.452709 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ecf25290-3ec5-4a1c-84e9-551d7f3c04d8 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:21.453190 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ecf25290-3ec5-4a1c-84e9-551d7f3c04d8 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:21.460267 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ecf25290-3ec5-4a1c-84e9-551d7f3c04d8 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:21.460916 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ecf25290-3ec5-4a1c-84e9-551d7f3c04d8 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:21.461354 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ecf25290-3ec5-4a1c-84e9-551d7f3c04d8 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:22.245274 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-ecf25290-3ec5-4a1c-84e9-551d7f3c04d8 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b627e66ccd94b8faabf8ce9f1d2d2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40732638975044868e5a5eb5f4235244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:22.276315 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-ecf25290-3ec5-4a1c-84e9-551d7f3c04d8 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] 10.222.0.33 "GET /compute/v2.1/servers/c7262313-6b85-476f-a1ca-79d04fcf5740" status: 200 len: 1361 microversion: 2.1 time: 0.864875 Oct 04 21:10:22.288381 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2861/5694] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:10:21 2022] GET /compute/v2.1/servers/c7262313-6b85-476f-a1ca-79d04fcf5740 => generated 1361 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:10:23.310322 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-98b5da27-e071-4fc6-b55b-507cfd3cd885 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:23.310953 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-98b5da27-e071-4fc6-b55b-507cfd3cd885 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] [instance: c7262313-6b85-476f-a1ca-79d04fcf5740] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:23.329927 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-98b5da27-e071-4fc6-b55b-507cfd3cd885 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:23.330737 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-98b5da27-e071-4fc6-b55b-507cfd3cd885 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:23.335854 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-98b5da27-e071-4fc6-b55b-507cfd3cd885 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:23.336900 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-98b5da27-e071-4fc6-b55b-507cfd3cd885 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:23.340007 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-98b5da27-e071-4fc6-b55b-507cfd3cd885 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:23.343053 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-98b5da27-e071-4fc6-b55b-507cfd3cd885 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:23.886655 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-98b5da27-e071-4fc6-b55b-507cfd3cd885 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b627e66ccd94b8faabf8ce9f1d2d2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40732638975044868e5a5eb5f4235244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:23.897614 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-98b5da27-e071-4fc6-b55b-507cfd3cd885 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] 10.222.0.33 "GET /compute/v2.1/servers/c7262313-6b85-476f-a1ca-79d04fcf5740" status: 200 len: 1361 microversion: 2.1 time: 0.591116 Oct 04 21:10:23.901068 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2834/5695] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:10:23 2022] GET /compute/v2.1/servers/c7262313-6b85-476f-a1ca-79d04fcf5740 => generated 1361 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:10:24.257995 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-63fdd6b2-e37e-4b2a-97e5-5f6a74743cb8 req-5d813b0d-8a31-4aab-a56c-d87b5c305d48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7262313-6b85-476f-a1ca-79d04fcf5740", "name": "network-vif-plugged", "status": "completed", "tag": "a3bf10f7-790c-43f8-9084-d92fd1c978f1"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:10:24.280054 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-63fdd6b2-e37e-4b2a-97e5-5f6a74743cb8 req-5d813b0d-8a31-4aab-a56c-d87b5c305d48 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:24.280733 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-63fdd6b2-e37e-4b2a-97e5-5f6a74743cb8 req-5d813b0d-8a31-4aab-a56c-d87b5c305d48 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:24.282121 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-63fdd6b2-e37e-4b2a-97e5-5f6a74743cb8 req-5d813b0d-8a31-4aab-a56c-d87b5c305d48 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:24.318177 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-63fdd6b2-e37e-4b2a-97e5-5f6a74743cb8 req-5d813b0d-8a31-4aab-a56c-d87b5c305d48 service nova] Creating event network-vif-plugged:a3bf10f7-790c-43f8-9084-d92fd1c978f1 for instance c7262313-6b85-476f-a1ca-79d04fcf5740 on n-h2-854823-8 Oct 04 21:10:24.338758 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-63fdd6b2-e37e-4b2a-97e5-5f6a74743cb8 req-5d813b0d-8a31-4aab-a56c-d87b5c305d48 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085278 Oct 04 21:10:24.339903 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2862/5696] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:10:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:10:24.930320 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ba287900-ec90-4bfe-b89e-53c74ff6afe1 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:24.931039 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ba287900-ec90-4bfe-b89e-53c74ff6afe1 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] [instance: c7262313-6b85-476f-a1ca-79d04fcf5740] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:24.980066 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ba287900-ec90-4bfe-b89e-53c74ff6afe1 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:24.984537 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ba287900-ec90-4bfe-b89e-53c74ff6afe1 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:24.985002 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ba287900-ec90-4bfe-b89e-53c74ff6afe1 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:24.985766 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ba287900-ec90-4bfe-b89e-53c74ff6afe1 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:24.986236 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ba287900-ec90-4bfe-b89e-53c74ff6afe1 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:24.987888 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ba287900-ec90-4bfe-b89e-53c74ff6afe1 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:25.465866 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-ba287900-ec90-4bfe-b89e-53c74ff6afe1 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b627e66ccd94b8faabf8ce9f1d2d2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40732638975044868e5a5eb5f4235244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:25.480456 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ba287900-ec90-4bfe-b89e-53c74ff6afe1 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] 10.222.0.33 "GET /compute/v2.1/servers/c7262313-6b85-476f-a1ca-79d04fcf5740" status: 200 len: 1361 microversion: 2.1 time: 0.555336 Oct 04 21:10:25.491468 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2835/5697] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:10:24 2022] GET /compute/v2.1/servers/c7262313-6b85-476f-a1ca-79d04fcf5740 => generated 1361 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:10:26.513983 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-93442f59-b5bd-496c-8506-38352c69d79b tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:26.514816 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-93442f59-b5bd-496c-8506-38352c69d79b tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] [instance: c7262313-6b85-476f-a1ca-79d04fcf5740] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:26.530530 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-93442f59-b5bd-496c-8506-38352c69d79b tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:26.531061 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-93442f59-b5bd-496c-8506-38352c69d79b tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:26.531511 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-93442f59-b5bd-496c-8506-38352c69d79b tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:26.539197 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-93442f59-b5bd-496c-8506-38352c69d79b tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:26.539855 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-93442f59-b5bd-496c-8506-38352c69d79b tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:26.540318 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-93442f59-b5bd-496c-8506-38352c69d79b tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:27.070769 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-93442f59-b5bd-496c-8506-38352c69d79b tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b627e66ccd94b8faabf8ce9f1d2d2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40732638975044868e5a5eb5f4235244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:27.085071 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-93442f59-b5bd-496c-8506-38352c69d79b tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] 10.222.0.33 "GET /compute/v2.1/servers/c7262313-6b85-476f-a1ca-79d04fcf5740" status: 200 len: 1361 microversion: 2.1 time: 0.574891 Oct 04 21:10:27.087003 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2863/5698] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:10:26 2022] GET /compute/v2.1/servers/c7262313-6b85-476f-a1ca-79d04fcf5740 => generated 1361 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:10:28.112788 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a5d2cb7e-b2c9-492e-862e-64e0aea34556 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:28.116700 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a5d2cb7e-b2c9-492e-862e-64e0aea34556 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] [instance: c7262313-6b85-476f-a1ca-79d04fcf5740] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:28.144406 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a5d2cb7e-b2c9-492e-862e-64e0aea34556 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:28.146883 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a5d2cb7e-b2c9-492e-862e-64e0aea34556 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:28.147580 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a5d2cb7e-b2c9-492e-862e-64e0aea34556 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:28.148547 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a5d2cb7e-b2c9-492e-862e-64e0aea34556 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:28.151299 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a5d2cb7e-b2c9-492e-862e-64e0aea34556 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:28.152002 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a5d2cb7e-b2c9-492e-862e-64e0aea34556 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:28.601309 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-a5d2cb7e-b2c9-492e-862e-64e0aea34556 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b627e66ccd94b8faabf8ce9f1d2d2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40732638975044868e5a5eb5f4235244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:28.619714 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a5d2cb7e-b2c9-492e-862e-64e0aea34556 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] 10.222.0.33 "GET /compute/v2.1/servers/c7262313-6b85-476f-a1ca-79d04fcf5740" status: 200 len: 1547 microversion: 2.1 time: 0.510813 Oct 04 21:10:28.621000 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2836/5699] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:10:28 2022] GET /compute/v2.1/servers/c7262313-6b85-476f-a1ca-79d04fcf5740 => generated 1547 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:10:28.649053 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-d4e6272b-ea6a-482a-9242-70079db3e685 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:28.649645 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-d4e6272b-ea6a-482a-9242-70079db3e685 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] [instance: c7262313-6b85-476f-a1ca-79d04fcf5740] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:28.665917 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d4e6272b-ea6a-482a-9242-70079db3e685 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:28.667013 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d4e6272b-ea6a-482a-9242-70079db3e685 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:28.667852 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d4e6272b-ea6a-482a-9242-70079db3e685 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:28.669025 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d4e6272b-ea6a-482a-9242-70079db3e685 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:28.669943 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d4e6272b-ea6a-482a-9242-70079db3e685 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:28.670572 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d4e6272b-ea6a-482a-9242-70079db3e685 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:28.898713 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-d4e6272b-ea6a-482a-9242-70079db3e685 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] 10.222.0.33 "GET /compute/v2.1/servers/c7262313-6b85-476f-a1ca-79d04fcf5740/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.253856 Oct 04 21:10:28.899958 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2864/5700] 10.222.0.33 () {58 vars in 1275 bytes} [Tue Oct 4 21:10:28 2022] GET /compute/v2.1/servers/c7262313-6b85-476f-a1ca-79d04fcf5740/os-interface => generated 284 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:10:30.967632 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-bf8c660b-8a4a-4252-8187-3fe5fd3770c7 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Action: 'create', calling method: .version_select at 0x7f3c6eedcc10>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1311747638", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKEhdZbV1p38mebo+2cQF9fnepm9K5H0d6Zt95Hp9UQ36jPeXI9JRCNRrnBcKRsFl29BriEYIQvo1GvmR5m8GUb4wjyQXrdZ+8IhspnnYnYYuEeQudI11jf27zxQtvqzbA=="}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:10:31.026723 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-bf8c660b-8a4a-4252-8187-3fe5fd3770c7 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Getting quotas for project 65d1916937bd4cdfbe053d3c84ffa738. Resources: {'key_pairs'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:10:31.034641 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-bf8c660b-8a4a-4252-8187-3fe5fd3770c7 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Getting quotas for user 33868e2b8733415cb173ae2da3104e1d and project 65d1916937bd4cdfbe053d3c84ffa738. Resources: {'key_pairs'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:10:31.088717 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-bf8c660b-8a4a-4252-8187-3fe5fd3770c7 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.125894 Oct 04 21:10:31.090686 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2837/5701] 10.222.0.33 () {60 vars in 1159 bytes} [Tue Oct 4 21:10:30 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:10:32.396498 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-740d8c01-7e4a-47ea-b7e9-0f837744ef82 req-36afd3e1-784c-4ab0-80eb-46f05a700cdd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7262313-6b85-476f-a1ca-79d04fcf5740", "tag": "a3bf10f7-790c-43f8-9084-d92fd1c978f1"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:10:32.421954 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-740d8c01-7e4a-47ea-b7e9-0f837744ef82 req-36afd3e1-784c-4ab0-80eb-46f05a700cdd service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:32.422467 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-740d8c01-7e4a-47ea-b7e9-0f837744ef82 req-36afd3e1-784c-4ab0-80eb-46f05a700cdd service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:32.422889 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-740d8c01-7e4a-47ea-b7e9-0f837744ef82 req-36afd3e1-784c-4ab0-80eb-46f05a700cdd service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:32.500748 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-740d8c01-7e4a-47ea-b7e9-0f837744ef82 req-36afd3e1-784c-4ab0-80eb-46f05a700cdd service nova] Creating event network-changed:a3bf10f7-790c-43f8-9084-d92fd1c978f1 for instance c7262313-6b85-476f-a1ca-79d04fcf5740 on n-h2-854823-8 Oct 04 21:10:32.515111 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-740d8c01-7e4a-47ea-b7e9-0f837744ef82 req-36afd3e1-784c-4ab0-80eb-46f05a700cdd service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.559733 Oct 04 21:10:32.519014 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2865/5702] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:10:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:10:34.839277 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-27adab67-59cc-4ab3-8a32-1cb7afedbc75 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-447829831", "imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63", "flavorRef": "452", "networks": [{"uuid": "bd759174-d58d-4216-9e6f-e4823d33c087"}], "key_name": "tempest-TestNetworkBasicOps-1311747638", "security_groups": [{"name": "tempest-secgroup-smoke-1464318739"}]}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:10:34.903783 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=32,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:10:35.165072 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.network.neutron [None req-27adab67-59cc-4ab3-8a32-1cb7afedbc75 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] validate_networks() for [('bd759174-d58d-4216-9e6f-e4823d33c087', None, None, None, None, None)] {{(pid=128801) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:10:36.540062 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-27adab67-59cc-4ab3-8a32-1cb7afedbc75 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Flavor limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:10:36.540756 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-27adab67-59cc-4ab3-8a32-1cb7afedbc75 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Image limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:10:36.540944 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-27adab67-59cc-4ab3-8a32-1cb7afedbc75 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Flavor pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:10:36.541581 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-27adab67-59cc-4ab3-8a32-1cb7afedbc75 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Image pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:10:36.542584 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-27adab67-59cc-4ab3-8a32-1cb7afedbc75 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:10:36.583835 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-27adab67-59cc-4ab3-8a32-1cb7afedbc75 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:36.584394 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-27adab67-59cc-4ab3-8a32-1cb7afedbc75 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:36.584843 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-27adab67-59cc-4ab3-8a32-1cb7afedbc75 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:36.585627 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-27adab67-59cc-4ab3-8a32-1cb7afedbc75 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:36.586075 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-27adab67-59cc-4ab3-8a32-1cb7afedbc75 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:36.586536 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-27adab67-59cc-4ab3-8a32-1cb7afedbc75 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:36.639924 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-27adab67-59cc-4ab3-8a32-1cb7afedbc75 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Getting quotas for project 65d1916937bd4cdfbe053d3c84ffa738. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:10:36.655904 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-27adab67-59cc-4ab3-8a32-1cb7afedbc75 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Getting quotas for user 33868e2b8733415cb173ae2da3104e1d and project 65d1916937bd4cdfbe053d3c84ffa738. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:10:36.681516 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-27adab67-59cc-4ab3-8a32-1cb7afedbc75 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Going to run 1 instances... {{(pid=128801) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:10:36.684421 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-27adab67-59cc-4ab3-8a32-1cb7afedbc75 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] [instance: 307b14f3-2d72-4cb2-ab60-ccb5af659240] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='15b24725-0c99-4bcf-b1fb-907cdf8e2d63',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128801) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:10:36.845087 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-27adab67-59cc-4ab3-8a32-1cb7afedbc75 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.010963 Oct 04 21:10:36.878769 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-33473bb6-48f6-4ce3-a342-555bf30a494a tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:36.880381 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-33473bb6-48f6-4ce3-a342-555bf30a494a tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] [instance: 307b14f3-2d72-4cb2-ab60-ccb5af659240] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:36.882035 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2838/5703] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 21:10:34 2022] POST /compute/v2.1/servers => generated 406 bytes in 2044 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:10:36.929300 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=4 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:10:37.138933 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-33473bb6-48f6-4ce3-a342-555bf30a494a tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33868e2b8733415cb173ae2da3104e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d1916937bd4cdfbe053d3c84ffa738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:37.168599 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-33473bb6-48f6-4ce3-a342-555bf30a494a tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] 10.222.0.33 "GET /compute/v2.1/servers/307b14f3-2d72-4cb2-ab60-ccb5af659240" status: 200 len: 1248 microversion: 2.1 time: 0.293803 Oct 04 21:10:37.172229 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2866/5704] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:10:36 2022] GET /compute/v2.1/servers/307b14f3-2d72-4cb2-ab60-ccb5af659240 => generated 1248 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:10:38.196147 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e8b8c3e3-28ed-4bec-8755-6aa6ac3c8486 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:38.197446 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e8b8c3e3-28ed-4bec-8755-6aa6ac3c8486 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] [instance: 307b14f3-2d72-4cb2-ab60-ccb5af659240] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:38.242937 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e8b8c3e3-28ed-4bec-8755-6aa6ac3c8486 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:38.243626 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e8b8c3e3-28ed-4bec-8755-6aa6ac3c8486 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:38.245726 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e8b8c3e3-28ed-4bec-8755-6aa6ac3c8486 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:38.246569 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e8b8c3e3-28ed-4bec-8755-6aa6ac3c8486 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:38.247048 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e8b8c3e3-28ed-4bec-8755-6aa6ac3c8486 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:38.247490 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e8b8c3e3-28ed-4bec-8755-6aa6ac3c8486 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:38.518755 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e8b8c3e3-28ed-4bec-8755-6aa6ac3c8486 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33868e2b8733415cb173ae2da3104e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d1916937bd4cdfbe053d3c84ffa738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:38.535175 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e8b8c3e3-28ed-4bec-8755-6aa6ac3c8486 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] 10.222.0.33 "GET /compute/v2.1/servers/307b14f3-2d72-4cb2-ab60-ccb5af659240" status: 200 len: 1300 microversion: 2.1 time: 0.343186 Oct 04 21:10:38.537139 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2839/5705] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:10:38 2022] GET /compute/v2.1/servers/307b14f3-2d72-4cb2-ab60-ccb5af659240 => generated 1300 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:10:39.563729 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-1ce86a05-6786-4afe-b1a2-a19cfb85164d tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:39.564305 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-1ce86a05-6786-4afe-b1a2-a19cfb85164d tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] [instance: 307b14f3-2d72-4cb2-ab60-ccb5af659240] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:39.590412 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1ce86a05-6786-4afe-b1a2-a19cfb85164d tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:39.593945 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1ce86a05-6786-4afe-b1a2-a19cfb85164d tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:39.594622 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1ce86a05-6786-4afe-b1a2-a19cfb85164d tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:39.595590 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1ce86a05-6786-4afe-b1a2-a19cfb85164d tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:39.597383 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1ce86a05-6786-4afe-b1a2-a19cfb85164d tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:39.598064 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1ce86a05-6786-4afe-b1a2-a19cfb85164d tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:39.605339 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=35 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:10:39.761592 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-1ce86a05-6786-4afe-b1a2-a19cfb85164d tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33868e2b8733415cb173ae2da3104e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d1916937bd4cdfbe053d3c84ffa738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:39.777271 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-1ce86a05-6786-4afe-b1a2-a19cfb85164d tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] 10.222.0.33 "GET /compute/v2.1/servers/307b14f3-2d72-4cb2-ab60-ccb5af659240" status: 200 len: 1306 microversion: 2.1 time: 0.215550 Oct 04 21:10:39.780261 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2867/5706] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:10:39 2022] GET /compute/v2.1/servers/307b14f3-2d72-4cb2-ab60-ccb5af659240 => generated 1306 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:10:40.806601 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a56f08ac-0f0b-4751-b2d0-d9888b90f663 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:40.807240 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a56f08ac-0f0b-4751-b2d0-d9888b90f663 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] [instance: 307b14f3-2d72-4cb2-ab60-ccb5af659240] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:40.836583 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a56f08ac-0f0b-4751-b2d0-d9888b90f663 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:40.837087 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a56f08ac-0f0b-4751-b2d0-d9888b90f663 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:40.837535 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a56f08ac-0f0b-4751-b2d0-d9888b90f663 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:40.838264 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a56f08ac-0f0b-4751-b2d0-d9888b90f663 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:40.850968 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a56f08ac-0f0b-4751-b2d0-d9888b90f663 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:40.851446 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a56f08ac-0f0b-4751-b2d0-d9888b90f663 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:40.876840 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=47 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:10:41.307555 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-a56f08ac-0f0b-4751-b2d0-d9888b90f663 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33868e2b8733415cb173ae2da3104e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d1916937bd4cdfbe053d3c84ffa738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:41.323900 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a56f08ac-0f0b-4751-b2d0-d9888b90f663 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] 10.222.0.33 "GET /compute/v2.1/servers/307b14f3-2d72-4cb2-ab60-ccb5af659240" status: 200 len: 1374 microversion: 2.1 time: 0.521765 Oct 04 21:10:41.334716 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2840/5707] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:10:40 2022] GET /compute/v2.1/servers/307b14f3-2d72-4cb2-ab60-ccb5af659240 => generated 1374 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:10:42.349533 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-fc122e19-9950-4e84-8c67-b57aa72f91d8 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:42.350827 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-fc122e19-9950-4e84-8c67-b57aa72f91d8 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] [instance: 307b14f3-2d72-4cb2-ab60-ccb5af659240] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:42.360966 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fc122e19-9950-4e84-8c67-b57aa72f91d8 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:42.371096 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fc122e19-9950-4e84-8c67-b57aa72f91d8 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:42.371777 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fc122e19-9950-4e84-8c67-b57aa72f91d8 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:42.372711 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fc122e19-9950-4e84-8c67-b57aa72f91d8 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:42.373320 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fc122e19-9950-4e84-8c67-b57aa72f91d8 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:42.373899 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fc122e19-9950-4e84-8c67-b57aa72f91d8 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:42.444197 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-a1da81fb-cbf5-49c7-8207-a445a2c2d035 req-db6a90ee-7a46-4667-9cd5-768504e6fd86 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "307b14f3-2d72-4cb2-ab60-ccb5af659240", "tag": "a90bbb5c-2349-4a2c-ae3e-8af0436104d3"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:10:42.455816 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-a1da81fb-cbf5-49c7-8207-a445a2c2d035 req-db6a90ee-7a46-4667-9cd5-768504e6fd86 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:42.456254 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-a1da81fb-cbf5-49c7-8207-a445a2c2d035 req-db6a90ee-7a46-4667-9cd5-768504e6fd86 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:42.456698 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-a1da81fb-cbf5-49c7-8207-a445a2c2d035 req-db6a90ee-7a46-4667-9cd5-768504e6fd86 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:42.499750 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-a1da81fb-cbf5-49c7-8207-a445a2c2d035 req-db6a90ee-7a46-4667-9cd5-768504e6fd86 service nova] Creating event network-changed:a90bbb5c-2349-4a2c-ae3e-8af0436104d3 for instance 307b14f3-2d72-4cb2-ab60-ccb5af659240 on n-h1-854823-8 Oct 04 21:10:42.521223 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-a1da81fb-cbf5-49c7-8207-a445a2c2d035 req-db6a90ee-7a46-4667-9cd5-768504e6fd86 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080840 Oct 04 21:10:42.530722 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2841/5708] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:10:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:10:42.654363 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-fc122e19-9950-4e84-8c67-b57aa72f91d8 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33868e2b8733415cb173ae2da3104e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d1916937bd4cdfbe053d3c84ffa738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:42.672765 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-fc122e19-9950-4e84-8c67-b57aa72f91d8 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] 10.222.0.33 "GET /compute/v2.1/servers/307b14f3-2d72-4cb2-ab60-ccb5af659240" status: 200 len: 1374 microversion: 2.1 time: 0.327916 Oct 04 21:10:42.677080 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2868/5709] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:10:42 2022] GET /compute/v2.1/servers/307b14f3-2d72-4cb2-ab60-ccb5af659240 => generated 1374 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:10:43.703154 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-69d6b60c-3ee6-43a3-8131-3667a8313afe tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:43.704415 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-69d6b60c-3ee6-43a3-8131-3667a8313afe tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] [instance: 307b14f3-2d72-4cb2-ab60-ccb5af659240] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:43.717267 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-69d6b60c-3ee6-43a3-8131-3667a8313afe tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:43.718037 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-69d6b60c-3ee6-43a3-8131-3667a8313afe tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:43.721286 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-69d6b60c-3ee6-43a3-8131-3667a8313afe tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:43.722032 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-69d6b60c-3ee6-43a3-8131-3667a8313afe tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:43.723216 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-69d6b60c-3ee6-43a3-8131-3667a8313afe tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:43.725705 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-69d6b60c-3ee6-43a3-8131-3667a8313afe tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:43.978090 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-69d6b60c-3ee6-43a3-8131-3667a8313afe tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33868e2b8733415cb173ae2da3104e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d1916937bd4cdfbe053d3c84ffa738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:43.987925 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-69d6b60c-3ee6-43a3-8131-3667a8313afe tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] 10.222.0.33 "GET /compute/v2.1/servers/307b14f3-2d72-4cb2-ab60-ccb5af659240" status: 200 len: 1374 microversion: 2.1 time: 0.290831 Oct 04 21:10:43.989605 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2842/5710] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:10:43 2022] GET /compute/v2.1/servers/307b14f3-2d72-4cb2-ab60-ccb5af659240 => generated 1374 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:10:45.022043 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-ba68a1d6-5d6f-41a7-a384-2d08fcf253c9 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:45.023418 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-ba68a1d6-5d6f-41a7-a384-2d08fcf253c9 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] [instance: 307b14f3-2d72-4cb2-ab60-ccb5af659240] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:45.039638 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ba68a1d6-5d6f-41a7-a384-2d08fcf253c9 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:45.040669 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ba68a1d6-5d6f-41a7-a384-2d08fcf253c9 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:45.041671 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ba68a1d6-5d6f-41a7-a384-2d08fcf253c9 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:45.044691 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ba68a1d6-5d6f-41a7-a384-2d08fcf253c9 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:45.045390 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ba68a1d6-5d6f-41a7-a384-2d08fcf253c9 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:45.046087 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ba68a1d6-5d6f-41a7-a384-2d08fcf253c9 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:45.325085 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-ba68a1d6-5d6f-41a7-a384-2d08fcf253c9 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33868e2b8733415cb173ae2da3104e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d1916937bd4cdfbe053d3c84ffa738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:45.336740 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-ba68a1d6-5d6f-41a7-a384-2d08fcf253c9 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] 10.222.0.33 "GET /compute/v2.1/servers/307b14f3-2d72-4cb2-ab60-ccb5af659240" status: 200 len: 1374 microversion: 2.1 time: 0.318440 Oct 04 21:10:45.355477 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2869/5711] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:10:45 2022] GET /compute/v2.1/servers/307b14f3-2d72-4cb2-ab60-ccb5af659240 => generated 1374 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:10:46.365722 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-357f96d0-8be7-4aa5-9cbb-8ed45032b23e tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:46.367224 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-357f96d0-8be7-4aa5-9cbb-8ed45032b23e tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] [instance: 307b14f3-2d72-4cb2-ab60-ccb5af659240] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:46.378479 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-357f96d0-8be7-4aa5-9cbb-8ed45032b23e tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:46.380481 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-357f96d0-8be7-4aa5-9cbb-8ed45032b23e tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:46.381108 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-357f96d0-8be7-4aa5-9cbb-8ed45032b23e tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:46.382148 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-357f96d0-8be7-4aa5-9cbb-8ed45032b23e tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:46.384022 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-357f96d0-8be7-4aa5-9cbb-8ed45032b23e tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:46.385198 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-357f96d0-8be7-4aa5-9cbb-8ed45032b23e tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:46.613718 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:10:46.655840 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-357f96d0-8be7-4aa5-9cbb-8ed45032b23e tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33868e2b8733415cb173ae2da3104e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d1916937bd4cdfbe053d3c84ffa738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:46.673906 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=10 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:10:46.684424 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-357f96d0-8be7-4aa5-9cbb-8ed45032b23e tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] 10.222.0.33 "GET /compute/v2.1/servers/307b14f3-2d72-4cb2-ab60-ccb5af659240" status: 200 len: 1374 microversion: 2.1 time: 0.324720 Oct 04 21:10:46.685306 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2843/5712] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:10:46 2022] GET /compute/v2.1/servers/307b14f3-2d72-4cb2-ab60-ccb5af659240 => generated 1374 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:10:47.717610 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-8653979c-d604-4d72-ab3d-24fb8abbd3e9 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:47.720514 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-8653979c-d604-4d72-ab3d-24fb8abbd3e9 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] [instance: 307b14f3-2d72-4cb2-ab60-ccb5af659240] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:47.728457 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell0:SELECT=2 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:10:47.730677 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8653979c-d604-4d72-ab3d-24fb8abbd3e9 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:47.731406 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8653979c-d604-4d72-ab3d-24fb8abbd3e9 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:47.732057 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8653979c-d604-4d72-ab3d-24fb8abbd3e9 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:47.732948 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8653979c-d604-4d72-ab3d-24fb8abbd3e9 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:47.733651 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8653979c-d604-4d72-ab3d-24fb8abbd3e9 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:47.734304 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8653979c-d604-4d72-ab3d-24fb8abbd3e9 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:47.996535 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-8653979c-d604-4d72-ab3d-24fb8abbd3e9 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33868e2b8733415cb173ae2da3104e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d1916937bd4cdfbe053d3c84ffa738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:48.007142 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-8653979c-d604-4d72-ab3d-24fb8abbd3e9 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] 10.222.0.33 "GET /compute/v2.1/servers/307b14f3-2d72-4cb2-ab60-ccb5af659240" status: 200 len: 1374 microversion: 2.1 time: 0.293619 Oct 04 21:10:48.011850 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2870/5713] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:10:47 2022] GET /compute/v2.1/servers/307b14f3-2d72-4cb2-ab60-ccb5af659240 => generated 1374 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:10:49.036695 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6e6767ec-5b56-485a-b16c-f2c2bb282050 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:49.037885 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-6e6767ec-5b56-485a-b16c-f2c2bb282050 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] [instance: 307b14f3-2d72-4cb2-ab60-ccb5af659240] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:49.047679 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6e6767ec-5b56-485a-b16c-f2c2bb282050 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:49.048494 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6e6767ec-5b56-485a-b16c-f2c2bb282050 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:49.048878 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6e6767ec-5b56-485a-b16c-f2c2bb282050 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:49.049587 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6e6767ec-5b56-485a-b16c-f2c2bb282050 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:49.050041 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6e6767ec-5b56-485a-b16c-f2c2bb282050 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:49.050484 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6e6767ec-5b56-485a-b16c-f2c2bb282050 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:49.260792 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-6e6767ec-5b56-485a-b16c-f2c2bb282050 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33868e2b8733415cb173ae2da3104e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d1916937bd4cdfbe053d3c84ffa738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:49.273564 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-6e6767ec-5b56-485a-b16c-f2c2bb282050 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] 10.222.0.33 "GET /compute/v2.1/servers/307b14f3-2d72-4cb2-ab60-ccb5af659240" status: 200 len: 1374 microversion: 2.1 time: 0.240535 Oct 04 21:10:49.277671 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2844/5714] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:10:49 2022] GET /compute/v2.1/servers/307b14f3-2d72-4cb2-ab60-ccb5af659240 => generated 1374 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:10:49.466889 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-95eee27e-ffdc-4965-825d-4189e57e487e req-119aa9ba-79e5-47db-8605-7207e02cc981 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "307b14f3-2d72-4cb2-ab60-ccb5af659240", "name": "network-vif-plugged", "status": "completed", "tag": "a90bbb5c-2349-4a2c-ae3e-8af0436104d3"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:10:49.492658 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-95eee27e-ffdc-4965-825d-4189e57e487e req-119aa9ba-79e5-47db-8605-7207e02cc981 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:49.493406 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-95eee27e-ffdc-4965-825d-4189e57e487e req-119aa9ba-79e5-47db-8605-7207e02cc981 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:49.494060 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-95eee27e-ffdc-4965-825d-4189e57e487e req-119aa9ba-79e5-47db-8605-7207e02cc981 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:49.526083 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-95eee27e-ffdc-4965-825d-4189e57e487e req-119aa9ba-79e5-47db-8605-7207e02cc981 service nova] Creating event network-vif-plugged:a90bbb5c-2349-4a2c-ae3e-8af0436104d3 for instance 307b14f3-2d72-4cb2-ab60-ccb5af659240 on n-h1-854823-8 Oct 04 21:10:49.531815 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-95eee27e-ffdc-4965-825d-4189e57e487e req-119aa9ba-79e5-47db-8605-7207e02cc981 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069291 Oct 04 21:10:49.533043 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2871/5715] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:10:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:10:50.298735 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-dcafe174-025e-48a6-956f-e3d102bf6685 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:50.300118 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-dcafe174-025e-48a6-956f-e3d102bf6685 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] [instance: 307b14f3-2d72-4cb2-ab60-ccb5af659240] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:50.309292 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dcafe174-025e-48a6-956f-e3d102bf6685 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:50.309956 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dcafe174-025e-48a6-956f-e3d102bf6685 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:50.310601 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dcafe174-025e-48a6-956f-e3d102bf6685 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:50.311462 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dcafe174-025e-48a6-956f-e3d102bf6685 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:50.312084 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dcafe174-025e-48a6-956f-e3d102bf6685 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:50.312662 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dcafe174-025e-48a6-956f-e3d102bf6685 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:50.549268 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-dcafe174-025e-48a6-956f-e3d102bf6685 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33868e2b8733415cb173ae2da3104e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d1916937bd4cdfbe053d3c84ffa738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:50.565474 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-dcafe174-025e-48a6-956f-e3d102bf6685 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] 10.222.0.33 "GET /compute/v2.1/servers/307b14f3-2d72-4cb2-ab60-ccb5af659240" status: 200 len: 1374 microversion: 2.1 time: 0.268612 Oct 04 21:10:50.581398 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2845/5716] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:10:50 2022] GET /compute/v2.1/servers/307b14f3-2d72-4cb2-ab60-ccb5af659240 => generated 1374 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:10:51.594831 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-70b39e9e-5f00-4557-923c-ccb0d46b474d tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:51.598933 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-70b39e9e-5f00-4557-923c-ccb0d46b474d tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] [instance: 307b14f3-2d72-4cb2-ab60-ccb5af659240] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:51.607636 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-70b39e9e-5f00-4557-923c-ccb0d46b474d tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:51.608165 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-70b39e9e-5f00-4557-923c-ccb0d46b474d tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:51.608665 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-70b39e9e-5f00-4557-923c-ccb0d46b474d tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:51.609575 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-70b39e9e-5f00-4557-923c-ccb0d46b474d tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:51.610233 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-70b39e9e-5f00-4557-923c-ccb0d46b474d tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:51.610707 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-70b39e9e-5f00-4557-923c-ccb0d46b474d tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:51.861873 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-70b39e9e-5f00-4557-923c-ccb0d46b474d tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33868e2b8733415cb173ae2da3104e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d1916937bd4cdfbe053d3c84ffa738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:51.880628 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-70b39e9e-5f00-4557-923c-ccb0d46b474d tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] 10.222.0.33 "GET /compute/v2.1/servers/307b14f3-2d72-4cb2-ab60-ccb5af659240" status: 200 len: 1546 microversion: 2.1 time: 0.291021 Oct 04 21:10:51.898701 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2872/5717] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:10:51 2022] GET /compute/v2.1/servers/307b14f3-2d72-4cb2-ab60-ccb5af659240 => generated 1546 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:10:51.907157 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8abbc9c0-8f5e-4a89-ae3a-afe6fc9ff920 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:51.907823 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-8abbc9c0-8f5e-4a89-ae3a-afe6fc9ff920 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] [instance: 307b14f3-2d72-4cb2-ab60-ccb5af659240] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:51.915950 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8abbc9c0-8f5e-4a89-ae3a-afe6fc9ff920 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:51.916437 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8abbc9c0-8f5e-4a89-ae3a-afe6fc9ff920 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:51.921802 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8abbc9c0-8f5e-4a89-ae3a-afe6fc9ff920 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:51.922698 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8abbc9c0-8f5e-4a89-ae3a-afe6fc9ff920 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:51.923205 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8abbc9c0-8f5e-4a89-ae3a-afe6fc9ff920 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:51.923689 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8abbc9c0-8f5e-4a89-ae3a-afe6fc9ff920 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:52.100392 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-8abbc9c0-8f5e-4a89-ae3a-afe6fc9ff920 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33868e2b8733415cb173ae2da3104e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d1916937bd4cdfbe053d3c84ffa738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:52.112767 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-8abbc9c0-8f5e-4a89-ae3a-afe6fc9ff920 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] 10.222.0.33 "GET /compute/v2.1/servers/307b14f3-2d72-4cb2-ab60-ccb5af659240" status: 200 len: 1546 microversion: 2.1 time: 0.209382 Oct 04 21:10:52.113423 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2846/5718] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:10:51 2022] GET /compute/v2.1/servers/307b14f3-2d72-4cb2-ab60-ccb5af659240 => generated 1546 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:10:55.088565 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-03ac7786-3f7e-45bb-bb9e-5e8aa282d58a tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1646623508", "imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63", "flavorRef": "452", "networks": [{"uuid": "2a95a2c3-b769-41c0-9497-d0cb7e512ff6"}]}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:10:55.196962 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.network.neutron [None req-03ac7786-3f7e-45bb-bb9e-5e8aa282d58a tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] validate_networks() for [('2a95a2c3-b769-41c0-9497-d0cb7e512ff6', None, None, None, None, None)] {{(pid=128802) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:10:55.869517 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-1878009d-7d0f-4de7-b9ae-4e7db0ec703b req-61c97ada-beff-4d09-b1bd-2ba208324f6b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "307b14f3-2d72-4cb2-ab60-ccb5af659240", "tag": "a90bbb5c-2349-4a2c-ae3e-8af0436104d3"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:10:55.889460 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-1878009d-7d0f-4de7-b9ae-4e7db0ec703b req-61c97ada-beff-4d09-b1bd-2ba208324f6b service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:55.889957 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-1878009d-7d0f-4de7-b9ae-4e7db0ec703b req-61c97ada-beff-4d09-b1bd-2ba208324f6b service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:55.897586 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-1878009d-7d0f-4de7-b9ae-4e7db0ec703b req-61c97ada-beff-4d09-b1bd-2ba208324f6b service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:55.927980 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-1878009d-7d0f-4de7-b9ae-4e7db0ec703b req-61c97ada-beff-4d09-b1bd-2ba208324f6b service nova] Creating event network-changed:a90bbb5c-2349-4a2c-ae3e-8af0436104d3 for instance 307b14f3-2d72-4cb2-ab60-ccb5af659240 on n-h1-854823-8 Oct 04 21:10:55.940663 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-1878009d-7d0f-4de7-b9ae-4e7db0ec703b req-61c97ada-beff-4d09-b1bd-2ba208324f6b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076952 Oct 04 21:10:55.942616 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2847/5719] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:10:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:10:55.992092 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-03ac7786-3f7e-45bb-bb9e-5e8aa282d58a tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Flavor limits 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:10:55.992639 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-03ac7786-3f7e-45bb-bb9e-5e8aa282d58a tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Image limits 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:10:55.993873 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-03ac7786-3f7e-45bb-bb9e-5e8aa282d58a tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Flavor pref 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:10:55.994572 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-03ac7786-3f7e-45bb-bb9e-5e8aa282d58a tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Image pref 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:10:55.996271 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-03ac7786-3f7e-45bb-bb9e-5e8aa282d58a tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:10:56.013728 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-03ac7786-3f7e-45bb-bb9e-5e8aa282d58a tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:56.014658 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-03ac7786-3f7e-45bb-bb9e-5e8aa282d58a tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:56.015320 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-03ac7786-3f7e-45bb-bb9e-5e8aa282d58a tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:56.016942 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-03ac7786-3f7e-45bb-bb9e-5e8aa282d58a tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:56.017612 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-03ac7786-3f7e-45bb-bb9e-5e8aa282d58a tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:56.018432 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-03ac7786-3f7e-45bb-bb9e-5e8aa282d58a tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:56.047373 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-03ac7786-3f7e-45bb-bb9e-5e8aa282d58a tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Getting quotas for project ed76078f10cd470285d48d4542eba0d3. Resources: {'ram', 'instances', 'cores'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:10:56.060901 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-03ac7786-3f7e-45bb-bb9e-5e8aa282d58a tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Getting quotas for user 91c6bb3c59be4ec39f2ac6053ce86ff1 and project ed76078f10cd470285d48d4542eba0d3. Resources: {'ram', 'instances', 'cores'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:10:56.080362 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-03ac7786-3f7e-45bb-bb9e-5e8aa282d58a tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Going to run 1 instances... {{(pid=128802) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:10:56.083985 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-03ac7786-3f7e-45bb-bb9e-5e8aa282d58a tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] [instance: fb7bd92c-2a21-4c54-8c94-5573645e936e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='15b24725-0c99-4bcf-b1fb-907cdf8e2d63',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128802) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:10:56.158786 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-03ac7786-3f7e-45bb-bb9e-5e8aa282d58a tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.074964 Oct 04 21:10:56.168736 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2873/5720] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 21:10:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 1086 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 21:10:56.172757 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c63c1cb4-82a9-4817-8ac2-4952b5deaa14 tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:56.173475 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c63c1cb4-82a9-4817-8ac2-4952b5deaa14 tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] [instance: fb7bd92c-2a21-4c54-8c94-5573645e936e] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:56.260584 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c63c1cb4-82a9-4817-8ac2-4952b5deaa14 tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c6bb3c59be4ec39f2ac6053ce86ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed76078f10cd470285d48d4542eba0d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:56.268428 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c63c1cb4-82a9-4817-8ac2-4952b5deaa14 tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] 10.222.0.33 "GET /compute/v2.1/servers/fb7bd92c-2a21-4c54-8c94-5573645e936e" status: 200 len: 1219 microversion: 2.1 time: 0.099897 Oct 04 21:10:56.270071 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2848/5721] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:10:56 2022] GET /compute/v2.1/servers/fb7bd92c-2a21-4c54-8c94-5573645e936e => generated 1219 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:10:57.294870 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-6471f2fc-28c6-4858-a9fe-be5db6bbe009 tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:57.295938 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-6471f2fc-28c6-4858-a9fe-be5db6bbe009 tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] [instance: fb7bd92c-2a21-4c54-8c94-5573645e936e] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:57.319954 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6471f2fc-28c6-4858-a9fe-be5db6bbe009 tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:57.320467 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6471f2fc-28c6-4858-a9fe-be5db6bbe009 tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:57.320908 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6471f2fc-28c6-4858-a9fe-be5db6bbe009 tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:57.323884 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6471f2fc-28c6-4858-a9fe-be5db6bbe009 tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:57.330432 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6471f2fc-28c6-4858-a9fe-be5db6bbe009 tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:57.331236 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6471f2fc-28c6-4858-a9fe-be5db6bbe009 tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:57.449440 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-6471f2fc-28c6-4858-a9fe-be5db6bbe009 tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c6bb3c59be4ec39f2ac6053ce86ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed76078f10cd470285d48d4542eba0d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:57.464237 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-6471f2fc-28c6-4858-a9fe-be5db6bbe009 tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] 10.222.0.33 "GET /compute/v2.1/servers/fb7bd92c-2a21-4c54-8c94-5573645e936e" status: 200 len: 1223 microversion: 2.1 time: 0.174225 Oct 04 21:10:57.476138 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2874/5722] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:10:57 2022] GET /compute/v2.1/servers/fb7bd92c-2a21-4c54-8c94-5573645e936e => generated 1223 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:10:58.505519 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-668e2e2b-61f1-40cd-81c4-3460644f8ecd tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:58.507002 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-668e2e2b-61f1-40cd-81c4-3460644f8ecd tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] [instance: fb7bd92c-2a21-4c54-8c94-5573645e936e] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:58.520678 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-668e2e2b-61f1-40cd-81c4-3460644f8ecd tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:58.522047 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-668e2e2b-61f1-40cd-81c4-3460644f8ecd tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:58.523157 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-668e2e2b-61f1-40cd-81c4-3460644f8ecd tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:58.524781 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-668e2e2b-61f1-40cd-81c4-3460644f8ecd tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:58.525950 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-668e2e2b-61f1-40cd-81c4-3460644f8ecd tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:58.527061 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-668e2e2b-61f1-40cd-81c4-3460644f8ecd tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:58.672237 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-668e2e2b-61f1-40cd-81c4-3460644f8ecd tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c6bb3c59be4ec39f2ac6053ce86ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed76078f10cd470285d48d4542eba0d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:58.720906 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-668e2e2b-61f1-40cd-81c4-3460644f8ecd tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] 10.222.0.33 "GET /compute/v2.1/servers/fb7bd92c-2a21-4c54-8c94-5573645e936e" status: 200 len: 1271 microversion: 2.1 time: 0.235243 Oct 04 21:10:58.728431 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2849/5723] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:10:58 2022] GET /compute/v2.1/servers/fb7bd92c-2a21-4c54-8c94-5573645e936e => generated 1271 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:10:59.768860 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-5d97b155-cbf9-42ba-aec5-6873891eb432 tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:10:59.769508 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-5d97b155-cbf9-42ba-aec5-6873891eb432 tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] [instance: fb7bd92c-2a21-4c54-8c94-5573645e936e] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:10:59.779959 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5d97b155-cbf9-42ba-aec5-6873891eb432 tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:59.780487 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5d97b155-cbf9-42ba-aec5-6873891eb432 tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:59.780926 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5d97b155-cbf9-42ba-aec5-6873891eb432 tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:59.781649 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5d97b155-cbf9-42ba-aec5-6873891eb432 tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:10:59.782310 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5d97b155-cbf9-42ba-aec5-6873891eb432 tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:10:59.782771 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5d97b155-cbf9-42ba-aec5-6873891eb432 tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:10:59.928087 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-5d97b155-cbf9-42ba-aec5-6873891eb432 tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c6bb3c59be4ec39f2ac6053ce86ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed76078f10cd470285d48d4542eba0d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:10:59.936638 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-5d97b155-cbf9-42ba-aec5-6873891eb432 tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] 10.222.0.33 "GET /compute/v2.1/servers/fb7bd92c-2a21-4c54-8c94-5573645e936e" status: 200 len: 1319 microversion: 2.1 time: 0.171790 Oct 04 21:10:59.937226 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2875/5724] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:10:59 2022] GET /compute/v2.1/servers/fb7bd92c-2a21-4c54-8c94-5573645e936e => generated 1319 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:11:00.402035 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-38749456-41db-417d-ba16-b0fc7cee1868 req-ee20a32b-5eb7-4bbb-b9ba-5f72ae61e26a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb7bd92c-2a21-4c54-8c94-5573645e936e", "tag": "7e30d8d7-00dc-4961-a711-124f89b08ea0"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:11:00.416129 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-38749456-41db-417d-ba16-b0fc7cee1868 req-ee20a32b-5eb7-4bbb-b9ba-5f72ae61e26a service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:00.416688 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-38749456-41db-417d-ba16-b0fc7cee1868 req-ee20a32b-5eb7-4bbb-b9ba-5f72ae61e26a service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:00.417242 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-38749456-41db-417d-ba16-b0fc7cee1868 req-ee20a32b-5eb7-4bbb-b9ba-5f72ae61e26a service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:00.436115 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-38749456-41db-417d-ba16-b0fc7cee1868 req-ee20a32b-5eb7-4bbb-b9ba-5f72ae61e26a service nova] Creating event network-changed:7e30d8d7-00dc-4961-a711-124f89b08ea0 for instance fb7bd92c-2a21-4c54-8c94-5573645e936e on n-h2-854823-8 Oct 04 21:11:00.443997 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-38749456-41db-417d-ba16-b0fc7cee1868 req-ee20a32b-5eb7-4bbb-b9ba-5f72ae61e26a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046003 Oct 04 21:11:00.445505 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2850/5725] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:11:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:11:00.961125 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-5b7d2a36-18c5-4651-adc8-6105c14d1836 tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:00.961912 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-5b7d2a36-18c5-4651-adc8-6105c14d1836 tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] [instance: fb7bd92c-2a21-4c54-8c94-5573645e936e] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:00.968865 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5b7d2a36-18c5-4651-adc8-6105c14d1836 tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:00.969282 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5b7d2a36-18c5-4651-adc8-6105c14d1836 tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:00.969716 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5b7d2a36-18c5-4651-adc8-6105c14d1836 tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:00.970438 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5b7d2a36-18c5-4651-adc8-6105c14d1836 tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:00.970889 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5b7d2a36-18c5-4651-adc8-6105c14d1836 tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:00.971311 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5b7d2a36-18c5-4651-adc8-6105c14d1836 tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:01.127386 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-5b7d2a36-18c5-4651-adc8-6105c14d1836 tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c6bb3c59be4ec39f2ac6053ce86ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed76078f10cd470285d48d4542eba0d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:01.136409 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-5b7d2a36-18c5-4651-adc8-6105c14d1836 tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] 10.222.0.33 "GET /compute/v2.1/servers/fb7bd92c-2a21-4c54-8c94-5573645e936e" status: 200 len: 1319 microversion: 2.1 time: 0.179126 Oct 04 21:11:01.137017 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2876/5726] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:11:00 2022] GET /compute/v2.1/servers/fb7bd92c-2a21-4c54-8c94-5573645e936e => generated 1319 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:11:02.162409 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6559195e-16c2-448a-878b-e8af8010d337 tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:02.165133 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-6559195e-16c2-448a-878b-e8af8010d337 tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] [instance: fb7bd92c-2a21-4c54-8c94-5573645e936e] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:02.174805 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6559195e-16c2-448a-878b-e8af8010d337 tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:02.176712 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6559195e-16c2-448a-878b-e8af8010d337 tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:02.177643 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6559195e-16c2-448a-878b-e8af8010d337 tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:02.178848 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6559195e-16c2-448a-878b-e8af8010d337 tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:02.179836 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6559195e-16c2-448a-878b-e8af8010d337 tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:02.180802 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6559195e-16c2-448a-878b-e8af8010d337 tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:02.377332 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-6559195e-16c2-448a-878b-e8af8010d337 tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c6bb3c59be4ec39f2ac6053ce86ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed76078f10cd470285d48d4542eba0d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:02.385621 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-6559195e-16c2-448a-878b-e8af8010d337 tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] 10.222.0.33 "GET /compute/v2.1/servers/fb7bd92c-2a21-4c54-8c94-5573645e936e" status: 200 len: 1319 microversion: 2.1 time: 0.228734 Oct 04 21:11:02.386284 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2851/5727] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:11:02 2022] GET /compute/v2.1/servers/fb7bd92c-2a21-4c54-8c94-5573645e936e => generated 1319 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:11:03.410788 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-89b46be4-a030-4726-b814-7f8bfa3ec087 tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:03.411910 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-89b46be4-a030-4726-b814-7f8bfa3ec087 tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] [instance: fb7bd92c-2a21-4c54-8c94-5573645e936e] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:03.419059 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-89b46be4-a030-4726-b814-7f8bfa3ec087 tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:03.419601 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-89b46be4-a030-4726-b814-7f8bfa3ec087 tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:03.420046 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-89b46be4-a030-4726-b814-7f8bfa3ec087 tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:03.420785 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-89b46be4-a030-4726-b814-7f8bfa3ec087 tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:03.421237 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-89b46be4-a030-4726-b814-7f8bfa3ec087 tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:03.422557 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-89b46be4-a030-4726-b814-7f8bfa3ec087 tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:03.580976 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-89b46be4-a030-4726-b814-7f8bfa3ec087 tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c6bb3c59be4ec39f2ac6053ce86ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed76078f10cd470285d48d4542eba0d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:03.590027 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-89b46be4-a030-4726-b814-7f8bfa3ec087 tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] 10.222.0.33 "GET /compute/v2.1/servers/fb7bd92c-2a21-4c54-8c94-5573645e936e" status: 200 len: 1319 microversion: 2.1 time: 0.183902 Oct 04 21:11:03.595494 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2877/5728] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:11:03 2022] GET /compute/v2.1/servers/fb7bd92c-2a21-4c54-8c94-5573645e936e => generated 1319 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:11:04.615671 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-aeef9fce-7984-4808-80e4-6738bf0ec080 tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:04.616249 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-aeef9fce-7984-4808-80e4-6738bf0ec080 tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] [instance: fb7bd92c-2a21-4c54-8c94-5573645e936e] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:04.623317 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-aeef9fce-7984-4808-80e4-6738bf0ec080 tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:04.623807 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-aeef9fce-7984-4808-80e4-6738bf0ec080 tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:04.624257 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-aeef9fce-7984-4808-80e4-6738bf0ec080 tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:04.624960 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-aeef9fce-7984-4808-80e4-6738bf0ec080 tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:04.625416 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-aeef9fce-7984-4808-80e4-6738bf0ec080 tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:04.625842 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-aeef9fce-7984-4808-80e4-6738bf0ec080 tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:04.783077 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-aeef9fce-7984-4808-80e4-6738bf0ec080 tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c6bb3c59be4ec39f2ac6053ce86ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed76078f10cd470285d48d4542eba0d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:04.792420 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-aeef9fce-7984-4808-80e4-6738bf0ec080 tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] 10.222.0.33 "GET /compute/v2.1/servers/fb7bd92c-2a21-4c54-8c94-5573645e936e" status: 200 len: 1319 microversion: 2.1 time: 0.181834 Oct 04 21:11:04.793032 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2852/5729] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:11:04 2022] GET /compute/v2.1/servers/fb7bd92c-2a21-4c54-8c94-5573645e936e => generated 1319 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:11:05.010199 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-77f80695-ab7c-431d-bb7b-ab1b75c364dc tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:05.010850 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-77f80695-ab7c-431d-bb7b-ab1b75c364dc tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] [instance: c7262313-6b85-476f-a1ca-79d04fcf5740] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:05.017977 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-77f80695-ab7c-431d-bb7b-ab1b75c364dc tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:05.018511 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-77f80695-ab7c-431d-bb7b-ab1b75c364dc tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:05.018956 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-77f80695-ab7c-431d-bb7b-ab1b75c364dc tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:05.019672 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-77f80695-ab7c-431d-bb7b-ab1b75c364dc tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:05.020129 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-77f80695-ab7c-431d-bb7b-ab1b75c364dc tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:05.020569 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-77f80695-ab7c-431d-bb7b-ab1b75c364dc tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:05.045810 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-77f80695-ab7c-431d-bb7b-ab1b75c364dc tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] 10.222.0.33 "GET /compute/v2.1/servers/c7262313-6b85-476f-a1ca-79d04fcf5740/ips" status: 200 len: 146 microversion: 2.1 time: 0.039414 Oct 04 21:11:05.046505 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2878/5730] 10.222.0.33 () {58 vars in 1248 bytes} [Tue Oct 4 21:11:05 2022] GET /compute/v2.1/servers/c7262313-6b85-476f-a1ca-79d04fcf5740/ips => generated 146 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:11:05.820035 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e9e3d3f0-3c0e-4df6-9f35-e9f1221a1e46 tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:05.820801 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e9e3d3f0-3c0e-4df6-9f35-e9f1221a1e46 tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] [instance: fb7bd92c-2a21-4c54-8c94-5573645e936e] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:05.825474 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=3 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:11:05.842291 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e9e3d3f0-3c0e-4df6-9f35-e9f1221a1e46 tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:05.843482 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e9e3d3f0-3c0e-4df6-9f35-e9f1221a1e46 tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:05.844985 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e9e3d3f0-3c0e-4df6-9f35-e9f1221a1e46 tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:05.846537 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e9e3d3f0-3c0e-4df6-9f35-e9f1221a1e46 tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:05.848169 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e9e3d3f0-3c0e-4df6-9f35-e9f1221a1e46 tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:05.849188 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e9e3d3f0-3c0e-4df6-9f35-e9f1221a1e46 tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:05.991347 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-f4719046-2a67-4519-af23-2224286410e7 req-253966d9-66e4-4bc0-882c-9783a17815bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb7bd92c-2a21-4c54-8c94-5573645e936e", "name": "network-vif-plugged", "status": "completed", "tag": "7e30d8d7-00dc-4961-a711-124f89b08ea0"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:11:06.027862 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-f4719046-2a67-4519-af23-2224286410e7 req-253966d9-66e4-4bc0-882c-9783a17815bb service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:06.034723 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-f4719046-2a67-4519-af23-2224286410e7 req-253966d9-66e4-4bc0-882c-9783a17815bb service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:06.038757 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-f4719046-2a67-4519-af23-2224286410e7 req-253966d9-66e4-4bc0-882c-9783a17815bb service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:06.053472 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell0:SELECT=2 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:11:06.073081 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell0:SELECT=6 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:11:06.084148 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-f4719046-2a67-4519-af23-2224286410e7 req-253966d9-66e4-4bc0-882c-9783a17815bb service nova] Creating event network-vif-plugged:7e30d8d7-00dc-4961-a711-124f89b08ea0 for instance fb7bd92c-2a21-4c54-8c94-5573645e936e on n-h2-854823-8 Oct 04 21:11:06.094693 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-f4719046-2a67-4519-af23-2224286410e7 req-253966d9-66e4-4bc0-882c-9783a17815bb service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115530 Oct 04 21:11:06.103782 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2879/5731] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:11:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:11:06.151587 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e9e3d3f0-3c0e-4df6-9f35-e9f1221a1e46 tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c6bb3c59be4ec39f2ac6053ce86ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed76078f10cd470285d48d4542eba0d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:06.160968 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e9e3d3f0-3c0e-4df6-9f35-e9f1221a1e46 tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] 10.222.0.33 "GET /compute/v2.1/servers/fb7bd92c-2a21-4c54-8c94-5573645e936e" status: 200 len: 1319 microversion: 2.1 time: 0.347636 Oct 04 21:11:06.170820 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2853/5732] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:11:05 2022] GET /compute/v2.1/servers/fb7bd92c-2a21-4c54-8c94-5573645e936e => generated 1319 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:11:07.186038 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-217e3094-44cc-415b-abea-c1f6c5af7898 tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:07.187411 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-217e3094-44cc-415b-abea-c1f6c5af7898 tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] [instance: fb7bd92c-2a21-4c54-8c94-5573645e936e] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:07.192019 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:11:07.209363 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-217e3094-44cc-415b-abea-c1f6c5af7898 tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:07.209870 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-217e3094-44cc-415b-abea-c1f6c5af7898 tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:07.210510 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-217e3094-44cc-415b-abea-c1f6c5af7898 tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:07.211470 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-217e3094-44cc-415b-abea-c1f6c5af7898 tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:07.211877 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-217e3094-44cc-415b-abea-c1f6c5af7898 tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:07.215486 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-217e3094-44cc-415b-abea-c1f6c5af7898 tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:07.419415 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-217e3094-44cc-415b-abea-c1f6c5af7898 tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c6bb3c59be4ec39f2ac6053ce86ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed76078f10cd470285d48d4542eba0d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:07.429855 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-217e3094-44cc-415b-abea-c1f6c5af7898 tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] 10.222.0.33 "GET /compute/v2.1/servers/fb7bd92c-2a21-4c54-8c94-5573645e936e" status: 200 len: 1319 microversion: 2.1 time: 0.248304 Oct 04 21:11:07.431217 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2880/5733] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:11:07 2022] GET /compute/v2.1/servers/fb7bd92c-2a21-4c54-8c94-5573645e936e => generated 1319 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:11:07.515822 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6b8eeba7-ebb3-492a-bafb-7f0a946bce45 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6aa728e7-9285-43c6-92e0-8039524cd921"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:11:07.519274 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-6b8eeba7-ebb3-492a-bafb-7f0a946bce45 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] [instance: c7262313-6b85-476f-a1ca-79d04fcf5740] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:07.521637 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:11:07.528676 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6b8eeba7-ebb3-492a-bafb-7f0a946bce45 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:07.529306 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6b8eeba7-ebb3-492a-bafb-7f0a946bce45 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:07.529809 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6b8eeba7-ebb3-492a-bafb-7f0a946bce45 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:07.530645 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6b8eeba7-ebb3-492a-bafb-7f0a946bce45 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:07.531207 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6b8eeba7-ebb3-492a-bafb-7f0a946bce45 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:07.531734 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6b8eeba7-ebb3-492a-bafb-7f0a946bce45 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:07.871571 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-6b8eeba7-ebb3-492a-bafb-7f0a946bce45 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] 10.222.0.33 "POST /compute/v2.1/servers/c7262313-6b85-476f-a1ca-79d04fcf5740/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.360509 Oct 04 21:11:07.872442 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2854/5734] 10.222.0.33 () {60 vars in 1323 bytes} [Tue Oct 4 21:11:07 2022] POST /compute/v2.1/servers/c7262313-6b85-476f-a1ca-79d04fcf5740/os-volume_attachments => generated 194 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:11:08.458624 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-951dfcc0-6fcd-4a0c-bfaa-a340ed22bd2c tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:08.459249 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-951dfcc0-6fcd-4a0c-bfaa-a340ed22bd2c tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] [instance: fb7bd92c-2a21-4c54-8c94-5573645e936e] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:08.466445 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-951dfcc0-6fcd-4a0c-bfaa-a340ed22bd2c tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:08.467011 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-951dfcc0-6fcd-4a0c-bfaa-a340ed22bd2c tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:08.467518 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-951dfcc0-6fcd-4a0c-bfaa-a340ed22bd2c tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:08.468290 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-951dfcc0-6fcd-4a0c-bfaa-a340ed22bd2c tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:08.468819 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-951dfcc0-6fcd-4a0c-bfaa-a340ed22bd2c tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:08.469253 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-951dfcc0-6fcd-4a0c-bfaa-a340ed22bd2c tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:08.628919 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-951dfcc0-6fcd-4a0c-bfaa-a340ed22bd2c tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c6bb3c59be4ec39f2ac6053ce86ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed76078f10cd470285d48d4542eba0d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:08.637067 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-951dfcc0-6fcd-4a0c-bfaa-a340ed22bd2c tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] 10.222.0.33 "GET /compute/v2.1/servers/fb7bd92c-2a21-4c54-8c94-5573645e936e" status: 200 len: 1509 microversion: 2.1 time: 0.185917 Oct 04 21:11:08.637979 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2881/5735] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:11:08 2022] GET /compute/v2.1/servers/fb7bd92c-2a21-4c54-8c94-5573645e936e => generated 1509 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:11:18.311142 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=3 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:11:18.312774 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:11:18.319513 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-54f4dba0-f07a-48b4-8592-8736a318b437 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:11:18.322952 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-54f4dba0-f07a-48b4-8592-8736a318b437 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] [instance: 307b14f3-2d72-4cb2-ab60-ccb5af659240] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:18.333671 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-54f4dba0-f07a-48b4-8592-8736a318b437 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:18.334963 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-54f4dba0-f07a-48b4-8592-8736a318b437 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:18.335608 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-54f4dba0-f07a-48b4-8592-8736a318b437 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:18.337391 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-54f4dba0-f07a-48b4-8592-8736a318b437 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:18.338068 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-54f4dba0-f07a-48b4-8592-8736a318b437 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:18.338734 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-54f4dba0-f07a-48b4-8592-8736a318b437 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:18.405904 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-54f4dba0-f07a-48b4-8592-8736a318b437 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] 10.222.0.33 "POST /compute/v2.1/servers/307b14f3-2d72-4cb2-ab60-ccb5af659240/action" status: 200 len: 24572 microversion: 2.1 time: 0.096549 Oct 04 21:11:18.407296 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2855/5736] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 21:11:18 2022] POST /compute/v2.1/servers/307b14f3-2d72-4cb2-ab60-ccb5af659240/action => generated 24572 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 04 21:11:21.441488 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-469d00dd-730c-418e-b568-e5ebfd893b0c tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:11:21.449191 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_api:SELECT=3 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:11:21.450559 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=75 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:11:21.452545 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-469d00dd-730c-418e-b568-e5ebfd893b0c tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:21.453279 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-469d00dd-730c-418e-b568-e5ebfd893b0c tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:21.453885 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-469d00dd-730c-418e-b568-e5ebfd893b0c tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:21.498431 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-469d00dd-730c-418e-b568-e5ebfd893b0c tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] [instance: c7262313-6b85-476f-a1ca-79d04fcf5740] Going to try to stop instance {{(pid=128802) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 04 21:11:21.560542 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-469d00dd-730c-418e-b568-e5ebfd893b0c tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] 10.222.0.33 "POST /compute/v2.1/servers/c7262313-6b85-476f-a1ca-79d04fcf5740/action" status: 202 len: 0 microversion: 2.1 time: 0.124376 Oct 04 21:11:21.564466 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2882/5737] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 21:11:21 2022] POST /compute/v2.1/servers/c7262313-6b85-476f-a1ca-79d04fcf5740/action => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:11:21.572204 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9953ddb2-0b1c-40ee-b009-a47b09af76f5 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:21.573252 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-9953ddb2-0b1c-40ee-b009-a47b09af76f5 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] [instance: c7262313-6b85-476f-a1ca-79d04fcf5740] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:21.586310 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9953ddb2-0b1c-40ee-b009-a47b09af76f5 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:21.589277 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9953ddb2-0b1c-40ee-b009-a47b09af76f5 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:21.589796 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9953ddb2-0b1c-40ee-b009-a47b09af76f5 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:21.590613 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9953ddb2-0b1c-40ee-b009-a47b09af76f5 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:21.591168 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9953ddb2-0b1c-40ee-b009-a47b09af76f5 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:21.591656 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9953ddb2-0b1c-40ee-b009-a47b09af76f5 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:21.825006 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-9953ddb2-0b1c-40ee-b009-a47b09af76f5 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b627e66ccd94b8faabf8ce9f1d2d2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40732638975044868e5a5eb5f4235244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:21.838900 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-9953ddb2-0b1c-40ee-b009-a47b09af76f5 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] 10.222.0.33 "GET /compute/v2.1/servers/c7262313-6b85-476f-a1ca-79d04fcf5740" status: 200 len: 1722 microversion: 2.1 time: 0.272083 Oct 04 21:11:21.854990 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2856/5738] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:11:21 2022] GET /compute/v2.1/servers/c7262313-6b85-476f-a1ca-79d04fcf5740 => generated 1722 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:11:22.865825 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-08497f9c-10d4-4f95-b163-937cb0839137 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:22.867226 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-08497f9c-10d4-4f95-b163-937cb0839137 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] [instance: c7262313-6b85-476f-a1ca-79d04fcf5740] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:22.874925 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-08497f9c-10d4-4f95-b163-937cb0839137 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:22.875715 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-08497f9c-10d4-4f95-b163-937cb0839137 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:22.876368 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-08497f9c-10d4-4f95-b163-937cb0839137 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:22.877286 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-08497f9c-10d4-4f95-b163-937cb0839137 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:22.877934 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-08497f9c-10d4-4f95-b163-937cb0839137 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:22.879368 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-08497f9c-10d4-4f95-b163-937cb0839137 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:23.068542 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-08497f9c-10d4-4f95-b163-937cb0839137 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b627e66ccd94b8faabf8ce9f1d2d2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40732638975044868e5a5eb5f4235244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:23.077737 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-08497f9c-10d4-4f95-b163-937cb0839137 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] 10.222.0.33 "GET /compute/v2.1/servers/c7262313-6b85-476f-a1ca-79d04fcf5740" status: 200 len: 1722 microversion: 2.1 time: 0.216941 Oct 04 21:11:23.078334 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2883/5739] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:11:22 2022] GET /compute/v2.1/servers/c7262313-6b85-476f-a1ca-79d04fcf5740 => generated 1722 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:11:24.103145 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c8366812-f2bc-4345-a06b-444677d93302 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:24.105133 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c8366812-f2bc-4345-a06b-444677d93302 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] [instance: c7262313-6b85-476f-a1ca-79d04fcf5740] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:24.115704 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c8366812-f2bc-4345-a06b-444677d93302 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:24.116297 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c8366812-f2bc-4345-a06b-444677d93302 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:24.117495 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c8366812-f2bc-4345-a06b-444677d93302 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:24.117820 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c8366812-f2bc-4345-a06b-444677d93302 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:24.118431 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c8366812-f2bc-4345-a06b-444677d93302 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:24.119086 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c8366812-f2bc-4345-a06b-444677d93302 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:24.305599 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c8366812-f2bc-4345-a06b-444677d93302 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b627e66ccd94b8faabf8ce9f1d2d2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40732638975044868e5a5eb5f4235244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:24.315152 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c8366812-f2bc-4345-a06b-444677d93302 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] 10.222.0.33 "GET /compute/v2.1/servers/c7262313-6b85-476f-a1ca-79d04fcf5740" status: 200 len: 1722 microversion: 2.1 time: 0.217650 Oct 04 21:11:24.315807 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2857/5740] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:11:24 2022] GET /compute/v2.1/servers/c7262313-6b85-476f-a1ca-79d04fcf5740 => generated 1722 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:11:25.344380 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-7e2602b9-2002-4407-afaf-02becd596f5a tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:25.345132 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-7e2602b9-2002-4407-afaf-02becd596f5a tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] [instance: c7262313-6b85-476f-a1ca-79d04fcf5740] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:25.359024 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7e2602b9-2002-4407-afaf-02becd596f5a tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:25.359934 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7e2602b9-2002-4407-afaf-02becd596f5a tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:25.360613 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7e2602b9-2002-4407-afaf-02becd596f5a tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:25.361572 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7e2602b9-2002-4407-afaf-02becd596f5a tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:25.363765 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7e2602b9-2002-4407-afaf-02becd596f5a tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:25.364519 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7e2602b9-2002-4407-afaf-02becd596f5a tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:25.513249 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-7e2602b9-2002-4407-afaf-02becd596f5a tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b627e66ccd94b8faabf8ce9f1d2d2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40732638975044868e5a5eb5f4235244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:25.522120 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-7e2602b9-2002-4407-afaf-02becd596f5a tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] 10.222.0.33 "GET /compute/v2.1/servers/c7262313-6b85-476f-a1ca-79d04fcf5740" status: 200 len: 1722 microversion: 2.1 time: 0.182124 Oct 04 21:11:25.523308 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2884/5741] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:11:25 2022] GET /compute/v2.1/servers/c7262313-6b85-476f-a1ca-79d04fcf5740 => generated 1722 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:11:26.545176 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f67efc8b-54d3-4349-be03-aa21274bdb62 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:26.545707 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f67efc8b-54d3-4349-be03-aa21274bdb62 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] [instance: c7262313-6b85-476f-a1ca-79d04fcf5740] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:26.553740 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f67efc8b-54d3-4349-be03-aa21274bdb62 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:26.554323 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f67efc8b-54d3-4349-be03-aa21274bdb62 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:26.554976 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f67efc8b-54d3-4349-be03-aa21274bdb62 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:26.555698 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f67efc8b-54d3-4349-be03-aa21274bdb62 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:26.556172 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f67efc8b-54d3-4349-be03-aa21274bdb62 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:26.556601 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f67efc8b-54d3-4349-be03-aa21274bdb62 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:26.719729 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f67efc8b-54d3-4349-be03-aa21274bdb62 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b627e66ccd94b8faabf8ce9f1d2d2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40732638975044868e5a5eb5f4235244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:26.729713 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f67efc8b-54d3-4349-be03-aa21274bdb62 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] 10.222.0.33 "GET /compute/v2.1/servers/c7262313-6b85-476f-a1ca-79d04fcf5740" status: 200 len: 1722 microversion: 2.1 time: 0.188414 Oct 04 21:11:26.730315 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2858/5742] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:11:26 2022] GET /compute/v2.1/servers/c7262313-6b85-476f-a1ca-79d04fcf5740 => generated 1722 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:11:27.769490 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-6d64e9e2-a1db-4d6e-969f-5d2e183ebb24 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:27.770434 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-6d64e9e2-a1db-4d6e-969f-5d2e183ebb24 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] [instance: c7262313-6b85-476f-a1ca-79d04fcf5740] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:27.778528 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6d64e9e2-a1db-4d6e-969f-5d2e183ebb24 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:27.779024 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6d64e9e2-a1db-4d6e-969f-5d2e183ebb24 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:27.779465 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6d64e9e2-a1db-4d6e-969f-5d2e183ebb24 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:27.780186 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6d64e9e2-a1db-4d6e-969f-5d2e183ebb24 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:27.780886 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6d64e9e2-a1db-4d6e-969f-5d2e183ebb24 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:27.781335 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6d64e9e2-a1db-4d6e-969f-5d2e183ebb24 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:27.968418 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-6d64e9e2-a1db-4d6e-969f-5d2e183ebb24 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b627e66ccd94b8faabf8ce9f1d2d2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40732638975044868e5a5eb5f4235244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:27.983696 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-6d64e9e2-a1db-4d6e-969f-5d2e183ebb24 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] 10.222.0.33 "GET /compute/v2.1/servers/c7262313-6b85-476f-a1ca-79d04fcf5740" status: 200 len: 1722 microversion: 2.1 time: 0.218857 Oct 04 21:11:27.984854 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2885/5743] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:11:27 2022] GET /compute/v2.1/servers/c7262313-6b85-476f-a1ca-79d04fcf5740 => generated 1722 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:11:29.012312 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f386b1e9-d795-4106-8a6c-17de961a10ee tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:29.013908 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f386b1e9-d795-4106-8a6c-17de961a10ee tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] [instance: c7262313-6b85-476f-a1ca-79d04fcf5740] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:29.023848 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f386b1e9-d795-4106-8a6c-17de961a10ee tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:29.023848 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f386b1e9-d795-4106-8a6c-17de961a10ee tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:29.026708 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f386b1e9-d795-4106-8a6c-17de961a10ee tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:29.028267 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f386b1e9-d795-4106-8a6c-17de961a10ee tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:29.029073 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f386b1e9-d795-4106-8a6c-17de961a10ee tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:29.029994 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f386b1e9-d795-4106-8a6c-17de961a10ee tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:29.279433 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f386b1e9-d795-4106-8a6c-17de961a10ee tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b627e66ccd94b8faabf8ce9f1d2d2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40732638975044868e5a5eb5f4235244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:29.292807 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f386b1e9-d795-4106-8a6c-17de961a10ee tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] 10.222.0.33 "GET /compute/v2.1/servers/c7262313-6b85-476f-a1ca-79d04fcf5740" status: 200 len: 1722 microversion: 2.1 time: 0.286561 Oct 04 21:11:29.294086 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2859/5744] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:11:29 2022] GET /compute/v2.1/servers/c7262313-6b85-476f-a1ca-79d04fcf5740 => generated 1722 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:11:30.319028 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-23d4d7fb-253d-4982-a902-14135158d256 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:30.322322 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-23d4d7fb-253d-4982-a902-14135158d256 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] [instance: c7262313-6b85-476f-a1ca-79d04fcf5740] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:30.335925 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-23d4d7fb-253d-4982-a902-14135158d256 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:30.336388 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-23d4d7fb-253d-4982-a902-14135158d256 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:30.336828 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-23d4d7fb-253d-4982-a902-14135158d256 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:30.337546 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-23d4d7fb-253d-4982-a902-14135158d256 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:30.338002 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-23d4d7fb-253d-4982-a902-14135158d256 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:30.341549 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-23d4d7fb-253d-4982-a902-14135158d256 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:30.503762 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-23d4d7fb-253d-4982-a902-14135158d256 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b627e66ccd94b8faabf8ce9f1d2d2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40732638975044868e5a5eb5f4235244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:30.513248 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-23d4d7fb-253d-4982-a902-14135158d256 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] 10.222.0.33 "GET /compute/v2.1/servers/c7262313-6b85-476f-a1ca-79d04fcf5740" status: 200 len: 1722 microversion: 2.1 time: 0.198525 Oct 04 21:11:30.513827 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2886/5745] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:11:30 2022] GET /compute/v2.1/servers/c7262313-6b85-476f-a1ca-79d04fcf5740 => generated 1722 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:11:31.108340 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f1320d4f-30fe-4269-be57-2af64e380acb tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d72c084c-911f-47b8-9ad3-3df80d006e16", "device": "/dev/sdb"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:11:31.110975 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f1320d4f-30fe-4269-be57-2af64e380acb tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] [instance: fb7bd92c-2a21-4c54-8c94-5573645e936e] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:31.119160 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f1320d4f-30fe-4269-be57-2af64e380acb tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:31.120180 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f1320d4f-30fe-4269-be57-2af64e380acb tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:31.120788 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f1320d4f-30fe-4269-be57-2af64e380acb tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:31.121812 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f1320d4f-30fe-4269-be57-2af64e380acb tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:31.121947 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f1320d4f-30fe-4269-be57-2af64e380acb tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:31.122580 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f1320d4f-30fe-4269-be57-2af64e380acb tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:31.433436 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f1320d4f-30fe-4269-be57-2af64e380acb tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] 10.222.0.33 "POST /compute/v2.1/servers/fb7bd92c-2a21-4c54-8c94-5573645e936e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.329128 Oct 04 21:11:31.434113 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2860/5746] 10.222.0.33 () {60 vars in 1323 bytes} [Tue Oct 4 21:11:31 2022] POST /compute/v2.1/servers/fb7bd92c-2a21-4c54-8c94-5573645e936e/os-volume_attachments => generated 194 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:11:31.537737 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-fba95983-5dbd-49ab-813c-5467a7ef83d4 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:31.538427 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-fba95983-5dbd-49ab-813c-5467a7ef83d4 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] [instance: c7262313-6b85-476f-a1ca-79d04fcf5740] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:31.545686 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fba95983-5dbd-49ab-813c-5467a7ef83d4 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:31.546223 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fba95983-5dbd-49ab-813c-5467a7ef83d4 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:31.546736 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fba95983-5dbd-49ab-813c-5467a7ef83d4 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:31.547498 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fba95983-5dbd-49ab-813c-5467a7ef83d4 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:31.547985 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fba95983-5dbd-49ab-813c-5467a7ef83d4 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:31.548456 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fba95983-5dbd-49ab-813c-5467a7ef83d4 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:31.748121 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-fba95983-5dbd-49ab-813c-5467a7ef83d4 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b627e66ccd94b8faabf8ce9f1d2d2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40732638975044868e5a5eb5f4235244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:31.759952 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-fba95983-5dbd-49ab-813c-5467a7ef83d4 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] 10.222.0.33 "GET /compute/v2.1/servers/c7262313-6b85-476f-a1ca-79d04fcf5740" status: 200 len: 1722 microversion: 2.1 time: 0.226517 Oct 04 21:11:31.760937 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2887/5747] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:11:31 2022] GET /compute/v2.1/servers/c7262313-6b85-476f-a1ca-79d04fcf5740 => generated 1722 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:11:32.791604 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b438f97b-47e2-4d9a-b9a4-b12641dca51a tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:32.792924 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b438f97b-47e2-4d9a-b9a4-b12641dca51a tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] [instance: c7262313-6b85-476f-a1ca-79d04fcf5740] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:32.801109 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b438f97b-47e2-4d9a-b9a4-b12641dca51a tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:32.801816 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b438f97b-47e2-4d9a-b9a4-b12641dca51a tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:32.802687 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b438f97b-47e2-4d9a-b9a4-b12641dca51a tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:32.803543 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b438f97b-47e2-4d9a-b9a4-b12641dca51a tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:32.804143 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b438f97b-47e2-4d9a-b9a4-b12641dca51a tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:32.804713 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b438f97b-47e2-4d9a-b9a4-b12641dca51a tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:33.012590 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-b438f97b-47e2-4d9a-b9a4-b12641dca51a tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b627e66ccd94b8faabf8ce9f1d2d2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40732638975044868e5a5eb5f4235244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:33.032538 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b438f97b-47e2-4d9a-b9a4-b12641dca51a tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] 10.222.0.33 "GET /compute/v2.1/servers/c7262313-6b85-476f-a1ca-79d04fcf5740" status: 200 len: 1699 microversion: 2.1 time: 0.247283 Oct 04 21:11:33.043653 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2861/5748] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:11:32 2022] GET /compute/v2.1/servers/c7262313-6b85-476f-a1ca-79d04fcf5740 => generated 1699 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:11:33.056490 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-ce73f6d9-79dc-4b01-92af-53bab3adaa70 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:11:33.065627 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ce73f6d9-79dc-4b01-92af-53bab3adaa70 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:33.066830 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ce73f6d9-79dc-4b01-92af-53bab3adaa70 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:33.068139 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ce73f6d9-79dc-4b01-92af-53bab3adaa70 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:33.106750 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-ce73f6d9-79dc-4b01-92af-53bab3adaa70 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] [instance: c7262313-6b85-476f-a1ca-79d04fcf5740] Going to try to start instance {{(pid=128802) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 04 21:11:33.188187 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-ce73f6d9-79dc-4b01-92af-53bab3adaa70 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] 10.222.0.33 "POST /compute/v2.1/servers/c7262313-6b85-476f-a1ca-79d04fcf5740/action" status: 202 len: 0 microversion: 2.1 time: 0.135396 Oct 04 21:11:33.211221 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2888/5749] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 21:11:33 2022] POST /compute/v2.1/servers/c7262313-6b85-476f-a1ca-79d04fcf5740/action => generated 0 bytes in 159 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:11:33.220714 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-89bd0343-edee-46e2-bff6-df90ba9c5efb tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:33.221395 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-89bd0343-edee-46e2-bff6-df90ba9c5efb tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] [instance: c7262313-6b85-476f-a1ca-79d04fcf5740] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:33.243010 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-89bd0343-edee-46e2-bff6-df90ba9c5efb tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:33.243681 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-89bd0343-edee-46e2-bff6-df90ba9c5efb tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:33.244497 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-89bd0343-edee-46e2-bff6-df90ba9c5efb tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:33.245292 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-89bd0343-edee-46e2-bff6-df90ba9c5efb tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:33.245754 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-89bd0343-edee-46e2-bff6-df90ba9c5efb tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:33.246305 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-89bd0343-edee-46e2-bff6-df90ba9c5efb tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:33.527867 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-89bd0343-edee-46e2-bff6-df90ba9c5efb tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b627e66ccd94b8faabf8ce9f1d2d2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40732638975044868e5a5eb5f4235244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:33.552211 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-89bd0343-edee-46e2-bff6-df90ba9c5efb tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] 10.222.0.33 "GET /compute/v2.1/servers/c7262313-6b85-476f-a1ca-79d04fcf5740" status: 200 len: 1708 microversion: 2.1 time: 0.335807 Oct 04 21:11:33.570083 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2862/5750] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:11:33 2022] GET /compute/v2.1/servers/c7262313-6b85-476f-a1ca-79d04fcf5740 => generated 1708 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:11:33.617133 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-dd971aae-9d74-4283-a6e9-ee4c6c74c67e tempest-VolumesBackupsTest-519829000 tempest-VolumesBackupsTest-519829000-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesBackupsTest-instance-1855594382", "imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63", "flavorRef": "452"}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:11:33.693139 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.network.neutron [None req-dd971aae-9d74-4283-a6e9-ee4c6c74c67e tempest-VolumesBackupsTest-519829000 tempest-VolumesBackupsTest-519829000-project] validate_networks() for None {{(pid=128802) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:11:33.951208 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-dd971aae-9d74-4283-a6e9-ee4c6c74c67e tempest-VolumesBackupsTest-519829000 tempest-VolumesBackupsTest-519829000-project] Flavor limits 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:11:33.952091 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-dd971aae-9d74-4283-a6e9-ee4c6c74c67e tempest-VolumesBackupsTest-519829000 tempest-VolumesBackupsTest-519829000-project] Image limits 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:11:33.952537 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-dd971aae-9d74-4283-a6e9-ee4c6c74c67e tempest-VolumesBackupsTest-519829000 tempest-VolumesBackupsTest-519829000-project] Flavor pref 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:11:33.952955 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-dd971aae-9d74-4283-a6e9-ee4c6c74c67e tempest-VolumesBackupsTest-519829000 tempest-VolumesBackupsTest-519829000-project] Image pref 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:11:33.953468 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-dd971aae-9d74-4283-a6e9-ee4c6c74c67e tempest-VolumesBackupsTest-519829000 tempest-VolumesBackupsTest-519829000-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:11:33.964317 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dd971aae-9d74-4283-a6e9-ee4c6c74c67e tempest-VolumesBackupsTest-519829000 tempest-VolumesBackupsTest-519829000-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:33.965223 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dd971aae-9d74-4283-a6e9-ee4c6c74c67e tempest-VolumesBackupsTest-519829000 tempest-VolumesBackupsTest-519829000-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:33.965688 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dd971aae-9d74-4283-a6e9-ee4c6c74c67e tempest-VolumesBackupsTest-519829000 tempest-VolumesBackupsTest-519829000-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:33.966548 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dd971aae-9d74-4283-a6e9-ee4c6c74c67e tempest-VolumesBackupsTest-519829000 tempest-VolumesBackupsTest-519829000-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:33.967049 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dd971aae-9d74-4283-a6e9-ee4c6c74c67e tempest-VolumesBackupsTest-519829000 tempest-VolumesBackupsTest-519829000-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:33.967478 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dd971aae-9d74-4283-a6e9-ee4c6c74c67e tempest-VolumesBackupsTest-519829000 tempest-VolumesBackupsTest-519829000-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:33.993474 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-dd971aae-9d74-4283-a6e9-ee4c6c74c67e tempest-VolumesBackupsTest-519829000 tempest-VolumesBackupsTest-519829000-project] Getting quotas for project 8fa6be52c0a84cc6b33ddf35a2f1db27. Resources: {'ram', 'instances', 'cores'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:11:33.999557 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-dd971aae-9d74-4283-a6e9-ee4c6c74c67e tempest-VolumesBackupsTest-519829000 tempest-VolumesBackupsTest-519829000-project] Getting quotas for user db09f027cfa24260a35754889e8b2b07 and project 8fa6be52c0a84cc6b33ddf35a2f1db27. Resources: {'ram', 'instances', 'cores'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:11:34.014752 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-dd971aae-9d74-4283-a6e9-ee4c6c74c67e tempest-VolumesBackupsTest-519829000 tempest-VolumesBackupsTest-519829000-project] Going to run 1 instances... {{(pid=128802) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:11:34.017414 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-dd971aae-9d74-4283-a6e9-ee4c6c74c67e tempest-VolumesBackupsTest-519829000 tempest-VolumesBackupsTest-519829000-project] [instance: 59bd2491-4500-43bc-a516-cd3b49f32c32] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='15b24725-0c99-4bcf-b1fb-907cdf8e2d63',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128802) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:11:34.079117 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-dd971aae-9d74-4283-a6e9-ee4c6c74c67e tempest-VolumesBackupsTest-519829000 tempest-VolumesBackupsTest-519829000-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.467357 Oct 04 21:11:34.087094 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2889/5751] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 21:11:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 476 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:11:34.091837 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d5bb8361-c51f-40a4-8d2e-1662a0fb7755 tempest-VolumesBackupsTest-519829000 tempest-VolumesBackupsTest-519829000-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:34.092956 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d5bb8361-c51f-40a4-8d2e-1662a0fb7755 tempest-VolumesBackupsTest-519829000 tempest-VolumesBackupsTest-519829000-project] [instance: 59bd2491-4500-43bc-a516-cd3b49f32c32] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:34.250092 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d5bb8361-c51f-40a4-8d2e-1662a0fb7755 tempest-VolumesBackupsTest-519829000 tempest-VolumesBackupsTest-519829000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db09f027cfa24260a35754889e8b2b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa6be52c0a84cc6b33ddf35a2f1db27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:34.259102 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d5bb8361-c51f-40a4-8d2e-1662a0fb7755 tempest-VolumesBackupsTest-519829000 tempest-VolumesBackupsTest-519829000-project] 10.222.0.33 "GET /compute/v2.1/servers/59bd2491-4500-43bc-a516-cd3b49f32c32" status: 200 len: 1214 microversion: 2.1 time: 0.171027 Oct 04 21:11:34.260866 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2863/5752] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:11:34 2022] GET /compute/v2.1/servers/59bd2491-4500-43bc-a516-cd3b49f32c32 => generated 1214 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:11:34.589930 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-0264fba2-0b9d-4acf-b97b-8c0fcfa75c0c tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:34.591486 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-0264fba2-0b9d-4acf-b97b-8c0fcfa75c0c tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] [instance: c7262313-6b85-476f-a1ca-79d04fcf5740] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:34.619849 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0264fba2-0b9d-4acf-b97b-8c0fcfa75c0c tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:34.620360 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0264fba2-0b9d-4acf-b97b-8c0fcfa75c0c tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:34.620800 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0264fba2-0b9d-4acf-b97b-8c0fcfa75c0c tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:34.623459 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0264fba2-0b9d-4acf-b97b-8c0fcfa75c0c tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:34.625055 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0264fba2-0b9d-4acf-b97b-8c0fcfa75c0c tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:34.626376 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0264fba2-0b9d-4acf-b97b-8c0fcfa75c0c tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:35.050088 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-0264fba2-0b9d-4acf-b97b-8c0fcfa75c0c tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b627e66ccd94b8faabf8ce9f1d2d2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40732638975044868e5a5eb5f4235244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:35.075755 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-0264fba2-0b9d-4acf-b97b-8c0fcfa75c0c tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] 10.222.0.33 "GET /compute/v2.1/servers/c7262313-6b85-476f-a1ca-79d04fcf5740" status: 200 len: 1708 microversion: 2.1 time: 0.491431 Oct 04 21:11:35.076342 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2890/5753] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:11:34 2022] GET /compute/v2.1/servers/c7262313-6b85-476f-a1ca-79d04fcf5740 => generated 1708 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:11:35.290801 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-62f55864-ca90-4a1b-af8c-3c833c7fd0db tempest-VolumesBackupsTest-519829000 tempest-VolumesBackupsTest-519829000-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:35.291413 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-62f55864-ca90-4a1b-af8c-3c833c7fd0db tempest-VolumesBackupsTest-519829000 tempest-VolumesBackupsTest-519829000-project] [instance: 59bd2491-4500-43bc-a516-cd3b49f32c32] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:35.304974 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-62f55864-ca90-4a1b-af8c-3c833c7fd0db tempest-VolumesBackupsTest-519829000 tempest-VolumesBackupsTest-519829000-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:35.307270 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-62f55864-ca90-4a1b-af8c-3c833c7fd0db tempest-VolumesBackupsTest-519829000 tempest-VolumesBackupsTest-519829000-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:35.323507 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-62f55864-ca90-4a1b-af8c-3c833c7fd0db tempest-VolumesBackupsTest-519829000 tempest-VolumesBackupsTest-519829000-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:35.324732 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-62f55864-ca90-4a1b-af8c-3c833c7fd0db tempest-VolumesBackupsTest-519829000 tempest-VolumesBackupsTest-519829000-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:35.325455 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-62f55864-ca90-4a1b-af8c-3c833c7fd0db tempest-VolumesBackupsTest-519829000 tempest-VolumesBackupsTest-519829000-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:35.326721 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-62f55864-ca90-4a1b-af8c-3c833c7fd0db tempest-VolumesBackupsTest-519829000 tempest-VolumesBackupsTest-519829000-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:35.361646 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-4fdc5cf6-f219-494e-96e4-bba656f4ec43 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Action: 'create', calling method: .version_select at 0x7f3c740ef1f0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-212433675", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG4TaZ386OfwX2+1Bfc32GedWQFcq6lQnF+l4Eu0dT12LEpgUr9d29HFYVL38vZ64Y+G7JQcammgt/P9pynXOyMz5cPTUv7834R7OX6tPyLeqeZk0BpjoVPq0zYwpiWAww=="}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:11:35.392772 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-4fdc5cf6-f219-494e-96e4-bba656f4ec43 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Getting quotas for project 65d1916937bd4cdfbe053d3c84ffa738. Resources: {'key_pairs'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:11:35.411822 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-62f55864-ca90-4a1b-af8c-3c833c7fd0db tempest-VolumesBackupsTest-519829000 tempest-VolumesBackupsTest-519829000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db09f027cfa24260a35754889e8b2b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa6be52c0a84cc6b33ddf35a2f1db27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:35.413190 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-4fdc5cf6-f219-494e-96e4-bba656f4ec43 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Getting quotas for user 33868e2b8733415cb173ae2da3104e1d and project 65d1916937bd4cdfbe053d3c84ffa738. Resources: {'key_pairs'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:11:35.422243 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-62f55864-ca90-4a1b-af8c-3c833c7fd0db tempest-VolumesBackupsTest-519829000 tempest-VolumesBackupsTest-519829000-project] 10.222.0.33 "GET /compute/v2.1/servers/59bd2491-4500-43bc-a516-cd3b49f32c32" status: 200 len: 1266 microversion: 2.1 time: 0.139376 Oct 04 21:11:35.423517 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2864/5754] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:11:35 2022] GET /compute/v2.1/servers/59bd2491-4500-43bc-a516-cd3b49f32c32 => generated 1266 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:11:35.457072 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-4fdc5cf6-f219-494e-96e4-bba656f4ec43 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.098680 Oct 04 21:11:35.458797 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2891/5755] 10.222.0.33 () {60 vars in 1159 bytes} [Tue Oct 4 21:11:35 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:11:36.104629 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f9ae75f5-23a7-490d-bfe8-a277415fd3cd tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:36.105501 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f9ae75f5-23a7-490d-bfe8-a277415fd3cd tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] [instance: c7262313-6b85-476f-a1ca-79d04fcf5740] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:36.113414 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f9ae75f5-23a7-490d-bfe8-a277415fd3cd tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:36.114719 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f9ae75f5-23a7-490d-bfe8-a277415fd3cd tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:36.115528 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f9ae75f5-23a7-490d-bfe8-a277415fd3cd tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:36.116490 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f9ae75f5-23a7-490d-bfe8-a277415fd3cd tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:36.118318 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f9ae75f5-23a7-490d-bfe8-a277415fd3cd tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:36.119021 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f9ae75f5-23a7-490d-bfe8-a277415fd3cd tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:36.451806 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-2e39e929-3aa0-46ed-b8bc-cffd2ac42cf3 tempest-VolumesBackupsTest-519829000 tempest-VolumesBackupsTest-519829000-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:36.452559 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-2e39e929-3aa0-46ed-b8bc-cffd2ac42cf3 tempest-VolumesBackupsTest-519829000 tempest-VolumesBackupsTest-519829000-project] [instance: 59bd2491-4500-43bc-a516-cd3b49f32c32] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:36.466086 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f9ae75f5-23a7-490d-bfe8-a277415fd3cd tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b627e66ccd94b8faabf8ce9f1d2d2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40732638975044868e5a5eb5f4235244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:36.485465 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2e39e929-3aa0-46ed-b8bc-cffd2ac42cf3 tempest-VolumesBackupsTest-519829000 tempest-VolumesBackupsTest-519829000-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:36.486141 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2e39e929-3aa0-46ed-b8bc-cffd2ac42cf3 tempest-VolumesBackupsTest-519829000 tempest-VolumesBackupsTest-519829000-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:36.486895 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f9ae75f5-23a7-490d-bfe8-a277415fd3cd tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] 10.222.0.33 "GET /compute/v2.1/servers/c7262313-6b85-476f-a1ca-79d04fcf5740" status: 200 len: 1712 microversion: 2.1 time: 0.377474 Oct 04 21:11:36.487913 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2e39e929-3aa0-46ed-b8bc-cffd2ac42cf3 tempest-VolumesBackupsTest-519829000 tempest-VolumesBackupsTest-519829000-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:36.496887 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2e39e929-3aa0-46ed-b8bc-cffd2ac42cf3 tempest-VolumesBackupsTest-519829000 tempest-VolumesBackupsTest-519829000-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:36.497889 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2865/5756] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:11:36 2022] GET /compute/v2.1/servers/c7262313-6b85-476f-a1ca-79d04fcf5740 => generated 1712 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:11:36.500098 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2e39e929-3aa0-46ed-b8bc-cffd2ac42cf3 tempest-VolumesBackupsTest-519829000 tempest-VolumesBackupsTest-519829000-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:36.500657 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2e39e929-3aa0-46ed-b8bc-cffd2ac42cf3 tempest-VolumesBackupsTest-519829000 tempest-VolumesBackupsTest-519829000-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:36.718255 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-2e39e929-3aa0-46ed-b8bc-cffd2ac42cf3 tempest-VolumesBackupsTest-519829000 tempest-VolumesBackupsTest-519829000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db09f027cfa24260a35754889e8b2b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa6be52c0a84cc6b33ddf35a2f1db27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:36.731418 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-2e39e929-3aa0-46ed-b8bc-cffd2ac42cf3 tempest-VolumesBackupsTest-519829000 tempest-VolumesBackupsTest-519829000-project] 10.222.0.33 "GET /compute/v2.1/servers/59bd2491-4500-43bc-a516-cd3b49f32c32" status: 200 len: 1272 microversion: 2.1 time: 0.289027 Oct 04 21:11:36.734890 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2892/5757] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:11:36 2022] GET /compute/v2.1/servers/59bd2491-4500-43bc-a516-cd3b49f32c32 => generated 1272 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:11:37.334941 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-095a79a5-59be-494a-b649-e6f8653e5188 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-783479896", "imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63", "flavorRef": "452", "networks": [{"uuid": "cb9cc19c-b669-43d3-8935-9c0a3e3ca96f"}], "key_name": "tempest-TestNetworkBasicOps-212433675", "security_groups": [{"name": "tempest-secgroup-smoke-1610294273"}]}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:11:37.470797 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.network.neutron [None req-095a79a5-59be-494a-b649-e6f8653e5188 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] validate_networks() for [('cb9cc19c-b669-43d3-8935-9c0a3e3ca96f', None, None, None, None, None)] {{(pid=128801) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:11:37.757555 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-7cd8b042-b41b-4f48-bf09-d98dc04f6da0 tempest-VolumesBackupsTest-519829000 tempest-VolumesBackupsTest-519829000-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:37.758149 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-7cd8b042-b41b-4f48-bf09-d98dc04f6da0 tempest-VolumesBackupsTest-519829000 tempest-VolumesBackupsTest-519829000-project] [instance: 59bd2491-4500-43bc-a516-cd3b49f32c32] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:37.771136 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7cd8b042-b41b-4f48-bf09-d98dc04f6da0 tempest-VolumesBackupsTest-519829000 tempest-VolumesBackupsTest-519829000-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:37.771637 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7cd8b042-b41b-4f48-bf09-d98dc04f6da0 tempest-VolumesBackupsTest-519829000 tempest-VolumesBackupsTest-519829000-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:37.772073 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7cd8b042-b41b-4f48-bf09-d98dc04f6da0 tempest-VolumesBackupsTest-519829000 tempest-VolumesBackupsTest-519829000-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:37.772797 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7cd8b042-b41b-4f48-bf09-d98dc04f6da0 tempest-VolumesBackupsTest-519829000 tempest-VolumesBackupsTest-519829000-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:37.773262 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7cd8b042-b41b-4f48-bf09-d98dc04f6da0 tempest-VolumesBackupsTest-519829000 tempest-VolumesBackupsTest-519829000-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:37.773672 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7cd8b042-b41b-4f48-bf09-d98dc04f6da0 tempest-VolumesBackupsTest-519829000 tempest-VolumesBackupsTest-519829000-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:38.772190 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-7cd8b042-b41b-4f48-bf09-d98dc04f6da0 tempest-VolumesBackupsTest-519829000 tempest-VolumesBackupsTest-519829000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db09f027cfa24260a35754889e8b2b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa6be52c0a84cc6b33ddf35a2f1db27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:38.788698 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-7cd8b042-b41b-4f48-bf09-d98dc04f6da0 tempest-VolumesBackupsTest-519829000 tempest-VolumesBackupsTest-519829000-project] 10.222.0.33 "GET /compute/v2.1/servers/59bd2491-4500-43bc-a516-cd3b49f32c32" status: 200 len: 1314 microversion: 2.1 time: 1.035083 Oct 04 21:11:38.789850 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2893/5758] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:11:37 2022] GET /compute/v2.1/servers/59bd2491-4500-43bc-a516-cd3b49f32c32 => generated 1314 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:11:39.115509 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-095a79a5-59be-494a-b649-e6f8653e5188 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Flavor limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:11:39.115981 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-095a79a5-59be-494a-b649-e6f8653e5188 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Image limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:11:39.116412 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-095a79a5-59be-494a-b649-e6f8653e5188 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Flavor pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:11:39.116832 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-095a79a5-59be-494a-b649-e6f8653e5188 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Image pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:11:39.117254 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-095a79a5-59be-494a-b649-e6f8653e5188 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:11:39.143171 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-095a79a5-59be-494a-b649-e6f8653e5188 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:39.143758 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-095a79a5-59be-494a-b649-e6f8653e5188 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:39.145446 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-095a79a5-59be-494a-b649-e6f8653e5188 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:39.148476 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-095a79a5-59be-494a-b649-e6f8653e5188 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:39.149005 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-095a79a5-59be-494a-b649-e6f8653e5188 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:39.151058 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-095a79a5-59be-494a-b649-e6f8653e5188 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:39.154964 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-12747745-b274-4c23-bcba-f4efdda9aca5 req-a99a2de4-3894-4fc7-b1b4-52b7f4a21b48 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "59bd2491-4500-43bc-a516-cd3b49f32c32", "tag": "e5d7d0d6-d96a-4134-9637-ddb69f5e47f3"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:11:39.166498 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-12747745-b274-4c23-bcba-f4efdda9aca5 req-a99a2de4-3894-4fc7-b1b4-52b7f4a21b48 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:39.167432 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-12747745-b274-4c23-bcba-f4efdda9aca5 req-a99a2de4-3894-4fc7-b1b4-52b7f4a21b48 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:39.168091 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-12747745-b274-4c23-bcba-f4efdda9aca5 req-a99a2de4-3894-4fc7-b1b4-52b7f4a21b48 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:39.181790 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-12747745-b274-4c23-bcba-f4efdda9aca5 req-a99a2de4-3894-4fc7-b1b4-52b7f4a21b48 service nova] Creating event network-changed:e5d7d0d6-d96a-4134-9637-ddb69f5e47f3 for instance 59bd2491-4500-43bc-a516-cd3b49f32c32 on n-h1-854823-8 Oct 04 21:11:39.188545 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-12747745-b274-4c23-bcba-f4efdda9aca5 req-a99a2de4-3894-4fc7-b1b4-52b7f4a21b48 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.286382 Oct 04 21:11:39.189757 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2894/5759] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:11:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:11:39.211214 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-095a79a5-59be-494a-b649-e6f8653e5188 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Getting quotas for project 65d1916937bd4cdfbe053d3c84ffa738. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:11:39.219765 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-095a79a5-59be-494a-b649-e6f8653e5188 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Getting quotas for user 33868e2b8733415cb173ae2da3104e1d and project 65d1916937bd4cdfbe053d3c84ffa738. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:11:39.239325 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-095a79a5-59be-494a-b649-e6f8653e5188 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Going to run 1 instances... {{(pid=128801) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:11:39.242559 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-095a79a5-59be-494a-b649-e6f8653e5188 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] [instance: 75b8e26f-e8d2-4f9f-ac27-e140eea7b9ee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='15b24725-0c99-4bcf-b1fb-907cdf8e2d63',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128801) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:11:39.316236 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-095a79a5-59be-494a-b649-e6f8653e5188 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.985715 Oct 04 21:11:39.317557 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2866/5760] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 21:11:37 2022] POST /compute/v2.1/servers => generated 406 bytes in 1988 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:11:39.330086 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-cc87842a-e57d-4022-8020-e7536f2dce34 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:39.331105 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-cc87842a-e57d-4022-8020-e7536f2dce34 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] [instance: 75b8e26f-e8d2-4f9f-ac27-e140eea7b9ee] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:39.421882 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-cc87842a-e57d-4022-8020-e7536f2dce34 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33868e2b8733415cb173ae2da3104e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d1916937bd4cdfbe053d3c84ffa738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:39.431265 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-cc87842a-e57d-4022-8020-e7536f2dce34 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] 10.222.0.33 "GET /compute/v2.1/servers/75b8e26f-e8d2-4f9f-ac27-e140eea7b9ee" status: 200 len: 1247 microversion: 2.1 time: 0.105463 Oct 04 21:11:39.431871 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2895/5761] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:11:39 2022] GET /compute/v2.1/servers/75b8e26f-e8d2-4f9f-ac27-e140eea7b9ee => generated 1247 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:11:39.815643 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2b844e2e-c206-459f-9521-787c6d0060d0 tempest-VolumesBackupsTest-519829000 tempest-VolumesBackupsTest-519829000-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:39.816340 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-2b844e2e-c206-459f-9521-787c6d0060d0 tempest-VolumesBackupsTest-519829000 tempest-VolumesBackupsTest-519829000-project] [instance: 59bd2491-4500-43bc-a516-cd3b49f32c32] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:39.826315 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2b844e2e-c206-459f-9521-787c6d0060d0 tempest-VolumesBackupsTest-519829000 tempest-VolumesBackupsTest-519829000-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:39.826870 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2b844e2e-c206-459f-9521-787c6d0060d0 tempest-VolumesBackupsTest-519829000 tempest-VolumesBackupsTest-519829000-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:39.827318 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2b844e2e-c206-459f-9521-787c6d0060d0 tempest-VolumesBackupsTest-519829000 tempest-VolumesBackupsTest-519829000-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:39.828026 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2b844e2e-c206-459f-9521-787c6d0060d0 tempest-VolumesBackupsTest-519829000 tempest-VolumesBackupsTest-519829000-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:39.828503 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2b844e2e-c206-459f-9521-787c6d0060d0 tempest-VolumesBackupsTest-519829000 tempest-VolumesBackupsTest-519829000-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:39.828917 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2b844e2e-c206-459f-9521-787c6d0060d0 tempest-VolumesBackupsTest-519829000 tempest-VolumesBackupsTest-519829000-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:39.986056 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-2b844e2e-c206-459f-9521-787c6d0060d0 tempest-VolumesBackupsTest-519829000 tempest-VolumesBackupsTest-519829000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db09f027cfa24260a35754889e8b2b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa6be52c0a84cc6b33ddf35a2f1db27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:39.994260 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-2b844e2e-c206-459f-9521-787c6d0060d0 tempest-VolumesBackupsTest-519829000 tempest-VolumesBackupsTest-519829000-project] 10.222.0.33 "GET /compute/v2.1/servers/59bd2491-4500-43bc-a516-cd3b49f32c32" status: 200 len: 1314 microversion: 2.1 time: 0.183535 Oct 04 21:11:39.994955 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2867/5762] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:11:39 2022] GET /compute/v2.1/servers/59bd2491-4500-43bc-a516-cd3b49f32c32 => generated 1314 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:11:40.460645 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-03725860-cf53-4ae9-bf15-ba2406a8db19 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:40.461270 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-03725860-cf53-4ae9-bf15-ba2406a8db19 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] [instance: 75b8e26f-e8d2-4f9f-ac27-e140eea7b9ee] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:40.469729 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-03725860-cf53-4ae9-bf15-ba2406a8db19 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:40.470274 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-03725860-cf53-4ae9-bf15-ba2406a8db19 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:40.470678 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-03725860-cf53-4ae9-bf15-ba2406a8db19 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:40.471380 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-03725860-cf53-4ae9-bf15-ba2406a8db19 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:40.472929 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-03725860-cf53-4ae9-bf15-ba2406a8db19 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:40.473199 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-03725860-cf53-4ae9-bf15-ba2406a8db19 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:40.542377 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-03725860-cf53-4ae9-bf15-ba2406a8db19 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33868e2b8733415cb173ae2da3104e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d1916937bd4cdfbe053d3c84ffa738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:40.551923 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-03725860-cf53-4ae9-bf15-ba2406a8db19 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] 10.222.0.33 "GET /compute/v2.1/servers/75b8e26f-e8d2-4f9f-ac27-e140eea7b9ee" status: 200 len: 1299 microversion: 2.1 time: 0.096129 Oct 04 21:11:40.552865 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2896/5763] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:11:40 2022] GET /compute/v2.1/servers/75b8e26f-e8d2-4f9f-ac27-e140eea7b9ee => generated 1299 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:11:41.018481 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-cac9a8af-90b1-40fb-a3fe-b9aa40e098b4 tempest-VolumesBackupsTest-519829000 tempest-VolumesBackupsTest-519829000-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:41.021401 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-cac9a8af-90b1-40fb-a3fe-b9aa40e098b4 tempest-VolumesBackupsTest-519829000 tempest-VolumesBackupsTest-519829000-project] [instance: 59bd2491-4500-43bc-a516-cd3b49f32c32] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:41.028773 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cac9a8af-90b1-40fb-a3fe-b9aa40e098b4 tempest-VolumesBackupsTest-519829000 tempest-VolumesBackupsTest-519829000-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:41.029280 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cac9a8af-90b1-40fb-a3fe-b9aa40e098b4 tempest-VolumesBackupsTest-519829000 tempest-VolumesBackupsTest-519829000-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:41.029898 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cac9a8af-90b1-40fb-a3fe-b9aa40e098b4 tempest-VolumesBackupsTest-519829000 tempest-VolumesBackupsTest-519829000-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:41.030796 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cac9a8af-90b1-40fb-a3fe-b9aa40e098b4 tempest-VolumesBackupsTest-519829000 tempest-VolumesBackupsTest-519829000-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:41.031439 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cac9a8af-90b1-40fb-a3fe-b9aa40e098b4 tempest-VolumesBackupsTest-519829000 tempest-VolumesBackupsTest-519829000-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:41.031877 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cac9a8af-90b1-40fb-a3fe-b9aa40e098b4 tempest-VolumesBackupsTest-519829000 tempest-VolumesBackupsTest-519829000-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:41.187911 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-cac9a8af-90b1-40fb-a3fe-b9aa40e098b4 tempest-VolumesBackupsTest-519829000 tempest-VolumesBackupsTest-519829000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db09f027cfa24260a35754889e8b2b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa6be52c0a84cc6b33ddf35a2f1db27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:41.198246 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-cac9a8af-90b1-40fb-a3fe-b9aa40e098b4 tempest-VolumesBackupsTest-519829000 tempest-VolumesBackupsTest-519829000-project] 10.222.0.33 "GET /compute/v2.1/servers/59bd2491-4500-43bc-a516-cd3b49f32c32" status: 200 len: 1314 microversion: 2.1 time: 0.183697 Oct 04 21:11:41.206661 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2868/5764] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:11:41 2022] GET /compute/v2.1/servers/59bd2491-4500-43bc-a516-cd3b49f32c32 => generated 1314 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:11:41.578721 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-e0254850-b62d-4552-86e2-d9d5b0c972b0 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:41.579604 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-e0254850-b62d-4552-86e2-d9d5b0c972b0 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] [instance: 75b8e26f-e8d2-4f9f-ac27-e140eea7b9ee] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:41.590163 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e0254850-b62d-4552-86e2-d9d5b0c972b0 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:41.591204 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e0254850-b62d-4552-86e2-d9d5b0c972b0 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:41.591824 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e0254850-b62d-4552-86e2-d9d5b0c972b0 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:41.592600 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e0254850-b62d-4552-86e2-d9d5b0c972b0 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:41.593177 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e0254850-b62d-4552-86e2-d9d5b0c972b0 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:41.593730 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e0254850-b62d-4552-86e2-d9d5b0c972b0 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:41.674118 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-e0254850-b62d-4552-86e2-d9d5b0c972b0 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33868e2b8733415cb173ae2da3104e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d1916937bd4cdfbe053d3c84ffa738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:41.684098 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-e0254850-b62d-4552-86e2-d9d5b0c972b0 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] 10.222.0.33 "GET /compute/v2.1/servers/75b8e26f-e8d2-4f9f-ac27-e140eea7b9ee" status: 200 len: 1305 microversion: 2.1 time: 0.110239 Oct 04 21:11:41.703341 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2897/5765] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:11:41 2022] GET /compute/v2.1/servers/75b8e26f-e8d2-4f9f-ac27-e140eea7b9ee => generated 1305 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:11:42.227445 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6f7c4b0d-f4c2-4aef-9d38-38ce2489a4b5 tempest-VolumesBackupsTest-519829000 tempest-VolumesBackupsTest-519829000-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:42.229320 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-6f7c4b0d-f4c2-4aef-9d38-38ce2489a4b5 tempest-VolumesBackupsTest-519829000 tempest-VolumesBackupsTest-519829000-project] [instance: 59bd2491-4500-43bc-a516-cd3b49f32c32] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:42.239814 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6f7c4b0d-f4c2-4aef-9d38-38ce2489a4b5 tempest-VolumesBackupsTest-519829000 tempest-VolumesBackupsTest-519829000-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:42.240590 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6f7c4b0d-f4c2-4aef-9d38-38ce2489a4b5 tempest-VolumesBackupsTest-519829000 tempest-VolumesBackupsTest-519829000-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:42.241157 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6f7c4b0d-f4c2-4aef-9d38-38ce2489a4b5 tempest-VolumesBackupsTest-519829000 tempest-VolumesBackupsTest-519829000-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:42.241974 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6f7c4b0d-f4c2-4aef-9d38-38ce2489a4b5 tempest-VolumesBackupsTest-519829000 tempest-VolumesBackupsTest-519829000-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:42.242581 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6f7c4b0d-f4c2-4aef-9d38-38ce2489a4b5 tempest-VolumesBackupsTest-519829000 tempest-VolumesBackupsTest-519829000-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:42.243220 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6f7c4b0d-f4c2-4aef-9d38-38ce2489a4b5 tempest-VolumesBackupsTest-519829000 tempest-VolumesBackupsTest-519829000-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:42.402029 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-6f7c4b0d-f4c2-4aef-9d38-38ce2489a4b5 tempest-VolumesBackupsTest-519829000 tempest-VolumesBackupsTest-519829000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db09f027cfa24260a35754889e8b2b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa6be52c0a84cc6b33ddf35a2f1db27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:42.411743 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-6f7c4b0d-f4c2-4aef-9d38-38ce2489a4b5 tempest-VolumesBackupsTest-519829000 tempest-VolumesBackupsTest-519829000-project] 10.222.0.33 "GET /compute/v2.1/servers/59bd2491-4500-43bc-a516-cd3b49f32c32" status: 200 len: 1314 microversion: 2.1 time: 0.193583 Oct 04 21:11:42.426904 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2869/5766] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:11:42 2022] GET /compute/v2.1/servers/59bd2491-4500-43bc-a516-cd3b49f32c32 => generated 1314 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:11:42.711916 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-5b1968df-4451-4e7d-8dff-a568aae4b766 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:42.712637 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-5b1968df-4451-4e7d-8dff-a568aae4b766 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] [instance: 75b8e26f-e8d2-4f9f-ac27-e140eea7b9ee] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:42.720546 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5b1968df-4451-4e7d-8dff-a568aae4b766 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:42.721280 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5b1968df-4451-4e7d-8dff-a568aae4b766 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:42.722613 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5b1968df-4451-4e7d-8dff-a568aae4b766 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:42.723403 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5b1968df-4451-4e7d-8dff-a568aae4b766 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:42.723923 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5b1968df-4451-4e7d-8dff-a568aae4b766 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:42.724421 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5b1968df-4451-4e7d-8dff-a568aae4b766 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:42.881203 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-5b1968df-4451-4e7d-8dff-a568aae4b766 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33868e2b8733415cb173ae2da3104e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d1916937bd4cdfbe053d3c84ffa738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:42.889461 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-5b1968df-4451-4e7d-8dff-a568aae4b766 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] 10.222.0.33 "GET /compute/v2.1/servers/75b8e26f-e8d2-4f9f-ac27-e140eea7b9ee" status: 200 len: 1373 microversion: 2.1 time: 0.184454 Oct 04 21:11:42.890057 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2898/5767] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:11:42 2022] GET /compute/v2.1/servers/75b8e26f-e8d2-4f9f-ac27-e140eea7b9ee => generated 1373 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:11:42.942951 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-e6f228f3-6488-4e65-9ac9-2afd7f0ee4d0 req-c73dee03-c78b-4e73-b9f0-419bba0370c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75b8e26f-e8d2-4f9f-ac27-e140eea7b9ee", "tag": "a7bc0cf7-cc9e-4eef-a732-7768e1029a8b"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:11:42.959052 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-e6f228f3-6488-4e65-9ac9-2afd7f0ee4d0 req-c73dee03-c78b-4e73-b9f0-419bba0370c6 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:42.959651 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-e6f228f3-6488-4e65-9ac9-2afd7f0ee4d0 req-c73dee03-c78b-4e73-b9f0-419bba0370c6 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:42.960101 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-e6f228f3-6488-4e65-9ac9-2afd7f0ee4d0 req-c73dee03-c78b-4e73-b9f0-419bba0370c6 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:42.973186 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-e6f228f3-6488-4e65-9ac9-2afd7f0ee4d0 req-c73dee03-c78b-4e73-b9f0-419bba0370c6 service nova] Creating event network-changed:a7bc0cf7-cc9e-4eef-a732-7768e1029a8b for instance 75b8e26f-e8d2-4f9f-ac27-e140eea7b9ee on n-h2-854823-8 Oct 04 21:11:42.979025 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-e6f228f3-6488-4e65-9ac9-2afd7f0ee4d0 req-c73dee03-c78b-4e73-b9f0-419bba0370c6 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041373 Oct 04 21:11:42.979929 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2870/5768] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:11:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:11:43.444757 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-545bc134-ef4d-4197-a578-3f33e759d29a tempest-VolumesBackupsTest-519829000 tempest-VolumesBackupsTest-519829000-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:43.456389 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-545bc134-ef4d-4197-a578-3f33e759d29a tempest-VolumesBackupsTest-519829000 tempest-VolumesBackupsTest-519829000-project] [instance: 59bd2491-4500-43bc-a516-cd3b49f32c32] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:43.477736 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-545bc134-ef4d-4197-a578-3f33e759d29a tempest-VolumesBackupsTest-519829000 tempest-VolumesBackupsTest-519829000-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:43.478935 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-545bc134-ef4d-4197-a578-3f33e759d29a tempest-VolumesBackupsTest-519829000 tempest-VolumesBackupsTest-519829000-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:43.479879 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-545bc134-ef4d-4197-a578-3f33e759d29a tempest-VolumesBackupsTest-519829000 tempest-VolumesBackupsTest-519829000-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:43.481193 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-545bc134-ef4d-4197-a578-3f33e759d29a tempest-VolumesBackupsTest-519829000 tempest-VolumesBackupsTest-519829000-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:43.482124 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-545bc134-ef4d-4197-a578-3f33e759d29a tempest-VolumesBackupsTest-519829000 tempest-VolumesBackupsTest-519829000-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:43.483171 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-545bc134-ef4d-4197-a578-3f33e759d29a tempest-VolumesBackupsTest-519829000 tempest-VolumesBackupsTest-519829000-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:43.677715 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-545bc134-ef4d-4197-a578-3f33e759d29a tempest-VolumesBackupsTest-519829000 tempest-VolumesBackupsTest-519829000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db09f027cfa24260a35754889e8b2b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa6be52c0a84cc6b33ddf35a2f1db27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:43.681321 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:11:43.688371 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-545bc134-ef4d-4197-a578-3f33e759d29a tempest-VolumesBackupsTest-519829000 tempest-VolumesBackupsTest-519829000-project] 10.222.0.33 "GET /compute/v2.1/servers/59bd2491-4500-43bc-a516-cd3b49f32c32" status: 200 len: 1314 microversion: 2.1 time: 0.252723 Oct 04 21:11:43.689302 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2899/5769] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:11:43 2022] GET /compute/v2.1/servers/59bd2491-4500-43bc-a516-cd3b49f32c32 => generated 1314 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:11:43.915576 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b5862770-e70b-4c80-861d-d7259e294966 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:43.916813 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b5862770-e70b-4c80-861d-d7259e294966 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] [instance: 75b8e26f-e8d2-4f9f-ac27-e140eea7b9ee] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:43.927266 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b5862770-e70b-4c80-861d-d7259e294966 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:43.927749 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b5862770-e70b-4c80-861d-d7259e294966 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:43.928378 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b5862770-e70b-4c80-861d-d7259e294966 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:43.929079 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b5862770-e70b-4c80-861d-d7259e294966 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:43.929529 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b5862770-e70b-4c80-861d-d7259e294966 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:43.929949 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b5862770-e70b-4c80-861d-d7259e294966 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:44.112697 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-b5862770-e70b-4c80-861d-d7259e294966 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33868e2b8733415cb173ae2da3104e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d1916937bd4cdfbe053d3c84ffa738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:44.121944 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b5862770-e70b-4c80-861d-d7259e294966 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] 10.222.0.33 "GET /compute/v2.1/servers/75b8e26f-e8d2-4f9f-ac27-e140eea7b9ee" status: 200 len: 1373 microversion: 2.1 time: 0.211464 Oct 04 21:11:44.123186 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2871/5770] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:11:43 2022] GET /compute/v2.1/servers/75b8e26f-e8d2-4f9f-ac27-e140eea7b9ee => generated 1373 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:11:44.737858 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-cedc14eb-9d95-46ca-9cef-ca53e4d22dc2 tempest-VolumesBackupsTest-519829000 tempest-VolumesBackupsTest-519829000-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:44.740242 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-cedc14eb-9d95-46ca-9cef-ca53e4d22dc2 tempest-VolumesBackupsTest-519829000 tempest-VolumesBackupsTest-519829000-project] [instance: 59bd2491-4500-43bc-a516-cd3b49f32c32] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:44.743673 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell0:SELECT=2 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:11:44.751136 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cedc14eb-9d95-46ca-9cef-ca53e4d22dc2 tempest-VolumesBackupsTest-519829000 tempest-VolumesBackupsTest-519829000-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:44.751655 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cedc14eb-9d95-46ca-9cef-ca53e4d22dc2 tempest-VolumesBackupsTest-519829000 tempest-VolumesBackupsTest-519829000-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:44.752091 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cedc14eb-9d95-46ca-9cef-ca53e4d22dc2 tempest-VolumesBackupsTest-519829000 tempest-VolumesBackupsTest-519829000-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:44.753003 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cedc14eb-9d95-46ca-9cef-ca53e4d22dc2 tempest-VolumesBackupsTest-519829000 tempest-VolumesBackupsTest-519829000-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:44.753382 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cedc14eb-9d95-46ca-9cef-ca53e4d22dc2 tempest-VolumesBackupsTest-519829000 tempest-VolumesBackupsTest-519829000-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:44.753782 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cedc14eb-9d95-46ca-9cef-ca53e4d22dc2 tempest-VolumesBackupsTest-519829000 tempest-VolumesBackupsTest-519829000-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:44.940419 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-cedc14eb-9d95-46ca-9cef-ca53e4d22dc2 tempest-VolumesBackupsTest-519829000 tempest-VolumesBackupsTest-519829000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db09f027cfa24260a35754889e8b2b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa6be52c0a84cc6b33ddf35a2f1db27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:44.968836 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-cedc14eb-9d95-46ca-9cef-ca53e4d22dc2 tempest-VolumesBackupsTest-519829000 tempest-VolumesBackupsTest-519829000-project] 10.222.0.33 "GET /compute/v2.1/servers/59bd2491-4500-43bc-a516-cd3b49f32c32" status: 200 len: 1314 microversion: 2.1 time: 0.244827 Oct 04 21:11:44.972080 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2900/5771] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:11:44 2022] GET /compute/v2.1/servers/59bd2491-4500-43bc-a516-cd3b49f32c32 => generated 1314 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:11:45.146742 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-59c877a7-736a-4c1e-b422-86e575108444 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:45.147353 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-59c877a7-736a-4c1e-b422-86e575108444 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] [instance: 75b8e26f-e8d2-4f9f-ac27-e140eea7b9ee] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:45.155055 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-59c877a7-736a-4c1e-b422-86e575108444 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:45.155707 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-59c877a7-736a-4c1e-b422-86e575108444 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:45.156196 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-59c877a7-736a-4c1e-b422-86e575108444 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:45.157291 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-59c877a7-736a-4c1e-b422-86e575108444 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:45.157848 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-59c877a7-736a-4c1e-b422-86e575108444 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:45.158360 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-59c877a7-736a-4c1e-b422-86e575108444 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:45.312130 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-59c877a7-736a-4c1e-b422-86e575108444 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33868e2b8733415cb173ae2da3104e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d1916937bd4cdfbe053d3c84ffa738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:45.317611 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:11:45.326074 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-59c877a7-736a-4c1e-b422-86e575108444 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] 10.222.0.33 "GET /compute/v2.1/servers/75b8e26f-e8d2-4f9f-ac27-e140eea7b9ee" status: 200 len: 1373 microversion: 2.1 time: 0.183847 Oct 04 21:11:45.329630 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2872/5772] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:11:45 2022] GET /compute/v2.1/servers/75b8e26f-e8d2-4f9f-ac27-e140eea7b9ee => generated 1373 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:11:45.653199 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-dcfe93b5-cf26-408c-b0aa-6ad4ab8c8574 req-256610e2-f293-49a0-bbdc-3fdc6a0d544b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59bd2491-4500-43bc-a516-cd3b49f32c32", "name": "network-vif-plugged", "status": "completed", "tag": "e5d7d0d6-d96a-4134-9637-ddb69f5e47f3"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:11:45.688850 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-dcfe93b5-cf26-408c-b0aa-6ad4ab8c8574 req-256610e2-f293-49a0-bbdc-3fdc6a0d544b service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:45.690053 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-dcfe93b5-cf26-408c-b0aa-6ad4ab8c8574 req-256610e2-f293-49a0-bbdc-3fdc6a0d544b service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:45.691346 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-dcfe93b5-cf26-408c-b0aa-6ad4ab8c8574 req-256610e2-f293-49a0-bbdc-3fdc6a0d544b service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:45.710029 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-dcfe93b5-cf26-408c-b0aa-6ad4ab8c8574 req-256610e2-f293-49a0-bbdc-3fdc6a0d544b service nova] Creating event network-vif-plugged:e5d7d0d6-d96a-4134-9637-ddb69f5e47f3 for instance 59bd2491-4500-43bc-a516-cd3b49f32c32 on n-h1-854823-8 Oct 04 21:11:45.715514 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-dcfe93b5-cf26-408c-b0aa-6ad4ab8c8574 req-256610e2-f293-49a0-bbdc-3fdc6a0d544b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.144825 Oct 04 21:11:45.716394 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2901/5773] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:11:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:11:46.000813 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-872d366b-5ebb-4c50-8ab1-fb0c2d4787c4 tempest-VolumesBackupsTest-519829000 tempest-VolumesBackupsTest-519829000-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:46.006231 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-872d366b-5ebb-4c50-8ab1-fb0c2d4787c4 tempest-VolumesBackupsTest-519829000 tempest-VolumesBackupsTest-519829000-project] [instance: 59bd2491-4500-43bc-a516-cd3b49f32c32] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:46.036146 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-872d366b-5ebb-4c50-8ab1-fb0c2d4787c4 tempest-VolumesBackupsTest-519829000 tempest-VolumesBackupsTest-519829000-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:46.037748 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-872d366b-5ebb-4c50-8ab1-fb0c2d4787c4 tempest-VolumesBackupsTest-519829000 tempest-VolumesBackupsTest-519829000-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:46.039208 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-872d366b-5ebb-4c50-8ab1-fb0c2d4787c4 tempest-VolumesBackupsTest-519829000 tempest-VolumesBackupsTest-519829000-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:46.054911 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-872d366b-5ebb-4c50-8ab1-fb0c2d4787c4 tempest-VolumesBackupsTest-519829000 tempest-VolumesBackupsTest-519829000-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:46.055811 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-872d366b-5ebb-4c50-8ab1-fb0c2d4787c4 tempest-VolumesBackupsTest-519829000 tempest-VolumesBackupsTest-519829000-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:46.056489 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-872d366b-5ebb-4c50-8ab1-fb0c2d4787c4 tempest-VolumesBackupsTest-519829000 tempest-VolumesBackupsTest-519829000-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:46.301742 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-872d366b-5ebb-4c50-8ab1-fb0c2d4787c4 tempest-VolumesBackupsTest-519829000 tempest-VolumesBackupsTest-519829000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db09f027cfa24260a35754889e8b2b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa6be52c0a84cc6b33ddf35a2f1db27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:46.314638 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-872d366b-5ebb-4c50-8ab1-fb0c2d4787c4 tempest-VolumesBackupsTest-519829000 tempest-VolumesBackupsTest-519829000-project] 10.222.0.33 "GET /compute/v2.1/servers/59bd2491-4500-43bc-a516-cd3b49f32c32" status: 200 len: 1314 microversion: 2.1 time: 0.321381 Oct 04 21:11:46.315733 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2873/5774] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:11:45 2022] GET /compute/v2.1/servers/59bd2491-4500-43bc-a516-cd3b49f32c32 => generated 1314 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:11:46.357987 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-1d03b6f4-904f-4d36-84b8-5ab15d5b12f3 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:46.359440 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-1d03b6f4-904f-4d36-84b8-5ab15d5b12f3 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] [instance: 75b8e26f-e8d2-4f9f-ac27-e140eea7b9ee] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:46.368682 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1d03b6f4-904f-4d36-84b8-5ab15d5b12f3 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:46.369509 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1d03b6f4-904f-4d36-84b8-5ab15d5b12f3 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:46.370099 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1d03b6f4-904f-4d36-84b8-5ab15d5b12f3 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:46.371338 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1d03b6f4-904f-4d36-84b8-5ab15d5b12f3 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:46.372303 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1d03b6f4-904f-4d36-84b8-5ab15d5b12f3 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:46.372852 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1d03b6f4-904f-4d36-84b8-5ab15d5b12f3 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:46.561562 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-1d03b6f4-904f-4d36-84b8-5ab15d5b12f3 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33868e2b8733415cb173ae2da3104e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d1916937bd4cdfbe053d3c84ffa738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:46.573835 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-1d03b6f4-904f-4d36-84b8-5ab15d5b12f3 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] 10.222.0.33 "GET /compute/v2.1/servers/75b8e26f-e8d2-4f9f-ac27-e140eea7b9ee" status: 200 len: 1373 microversion: 2.1 time: 0.222614 Oct 04 21:11:46.575436 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2902/5775] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:11:46 2022] GET /compute/v2.1/servers/75b8e26f-e8d2-4f9f-ac27-e140eea7b9ee => generated 1373 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:11:47.339087 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-95becdae-efde-4c50-8f92-daf8134b5a5a tempest-VolumesBackupsTest-519829000 tempest-VolumesBackupsTest-519829000-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:47.339573 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-95becdae-efde-4c50-8f92-daf8134b5a5a tempest-VolumesBackupsTest-519829000 tempest-VolumesBackupsTest-519829000-project] [instance: 59bd2491-4500-43bc-a516-cd3b49f32c32] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:47.348249 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-95becdae-efde-4c50-8f92-daf8134b5a5a tempest-VolumesBackupsTest-519829000 tempest-VolumesBackupsTest-519829000-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:47.348767 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-95becdae-efde-4c50-8f92-daf8134b5a5a tempest-VolumesBackupsTest-519829000 tempest-VolumesBackupsTest-519829000-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:47.349221 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-95becdae-efde-4c50-8f92-daf8134b5a5a tempest-VolumesBackupsTest-519829000 tempest-VolumesBackupsTest-519829000-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:47.350079 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-95becdae-efde-4c50-8f92-daf8134b5a5a tempest-VolumesBackupsTest-519829000 tempest-VolumesBackupsTest-519829000-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:47.350825 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-95becdae-efde-4c50-8f92-daf8134b5a5a tempest-VolumesBackupsTest-519829000 tempest-VolumesBackupsTest-519829000-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:47.351444 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-95becdae-efde-4c50-8f92-daf8134b5a5a tempest-VolumesBackupsTest-519829000 tempest-VolumesBackupsTest-519829000-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:47.583432 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-95becdae-efde-4c50-8f92-daf8134b5a5a tempest-VolumesBackupsTest-519829000 tempest-VolumesBackupsTest-519829000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db09f027cfa24260a35754889e8b2b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa6be52c0a84cc6b33ddf35a2f1db27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:47.591468 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-95becdae-efde-4c50-8f92-daf8134b5a5a tempest-VolumesBackupsTest-519829000 tempest-VolumesBackupsTest-519829000-project] 10.222.0.33 "GET /compute/v2.1/servers/59bd2491-4500-43bc-a516-cd3b49f32c32" status: 200 len: 1463 microversion: 2.1 time: 0.256852 Oct 04 21:11:47.592328 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2874/5776] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:11:47 2022] GET /compute/v2.1/servers/59bd2491-4500-43bc-a516-cd3b49f32c32 => generated 1463 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:11:47.597782 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-414461c4-4b5c-44e9-972e-5a0a4c455895 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:47.598489 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-414461c4-4b5c-44e9-972e-5a0a4c455895 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] [instance: 75b8e26f-e8d2-4f9f-ac27-e140eea7b9ee] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:47.606424 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-414461c4-4b5c-44e9-972e-5a0a4c455895 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:47.607694 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-414461c4-4b5c-44e9-972e-5a0a4c455895 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:47.608297 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-414461c4-4b5c-44e9-972e-5a0a4c455895 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:47.609024 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-414461c4-4b5c-44e9-972e-5a0a4c455895 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:47.609483 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-414461c4-4b5c-44e9-972e-5a0a4c455895 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:47.610628 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-414461c4-4b5c-44e9-972e-5a0a4c455895 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:47.617238 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-10a3cff4-31bc-4edb-95a9-161f4f480b4d tempest-VolumesBackupsTest-519829000 tempest-VolumesBackupsTest-519829000-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a6166697-4cfd-48d8-89b9-b6a93fb11b67", "device": "/dev/sdb"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:11:47.620726 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-10a3cff4-31bc-4edb-95a9-161f4f480b4d tempest-VolumesBackupsTest-519829000 tempest-VolumesBackupsTest-519829000-project] [instance: 59bd2491-4500-43bc-a516-cd3b49f32c32] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:47.629559 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-10a3cff4-31bc-4edb-95a9-161f4f480b4d tempest-VolumesBackupsTest-519829000 tempest-VolumesBackupsTest-519829000-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:47.630334 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-10a3cff4-31bc-4edb-95a9-161f4f480b4d tempest-VolumesBackupsTest-519829000 tempest-VolumesBackupsTest-519829000-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:47.631003 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-10a3cff4-31bc-4edb-95a9-161f4f480b4d tempest-VolumesBackupsTest-519829000 tempest-VolumesBackupsTest-519829000-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:47.631870 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-10a3cff4-31bc-4edb-95a9-161f4f480b4d tempest-VolumesBackupsTest-519829000 tempest-VolumesBackupsTest-519829000-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:47.632571 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-10a3cff4-31bc-4edb-95a9-161f4f480b4d tempest-VolumesBackupsTest-519829000 tempest-VolumesBackupsTest-519829000-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:47.633215 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-10a3cff4-31bc-4edb-95a9-161f4f480b4d tempest-VolumesBackupsTest-519829000 tempest-VolumesBackupsTest-519829000-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:47.813681 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-414461c4-4b5c-44e9-972e-5a0a4c455895 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33868e2b8733415cb173ae2da3104e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d1916937bd4cdfbe053d3c84ffa738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:47.822026 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-414461c4-4b5c-44e9-972e-5a0a4c455895 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] 10.222.0.33 "GET /compute/v2.1/servers/75b8e26f-e8d2-4f9f-ac27-e140eea7b9ee" status: 200 len: 1373 microversion: 2.1 time: 0.228579 Oct 04 21:11:47.822651 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2903/5777] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:11:47 2022] GET /compute/v2.1/servers/75b8e26f-e8d2-4f9f-ac27-e140eea7b9ee => generated 1373 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:11:47.962594 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-10a3cff4-31bc-4edb-95a9-161f4f480b4d tempest-VolumesBackupsTest-519829000 tempest-VolumesBackupsTest-519829000-project] 10.222.0.33 "POST /compute/v2.1/servers/59bd2491-4500-43bc-a516-cd3b49f32c32/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.351071 Oct 04 21:11:47.966378 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2875/5778] 10.222.0.33 () {60 vars in 1323 bytes} [Tue Oct 4 21:11:47 2022] POST /compute/v2.1/servers/59bd2491-4500-43bc-a516-cd3b49f32c32/os-volume_attachments => generated 194 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:11:48.124479 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-eb83b32f-76e5-40f9-87e4-381d5243b99e req-8239b2be-a95d-42e6-a70e-402c8e04a5bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75b8e26f-e8d2-4f9f-ac27-e140eea7b9ee", "name": "network-vif-plugged", "status": "completed", "tag": "a7bc0cf7-cc9e-4eef-a732-7768e1029a8b"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:11:48.136735 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-eb83b32f-76e5-40f9-87e4-381d5243b99e req-8239b2be-a95d-42e6-a70e-402c8e04a5bc service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:48.137415 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-eb83b32f-76e5-40f9-87e4-381d5243b99e req-8239b2be-a95d-42e6-a70e-402c8e04a5bc service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:48.138276 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-eb83b32f-76e5-40f9-87e4-381d5243b99e req-8239b2be-a95d-42e6-a70e-402c8e04a5bc service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:48.156006 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-eb83b32f-76e5-40f9-87e4-381d5243b99e req-8239b2be-a95d-42e6-a70e-402c8e04a5bc service nova] Creating event network-vif-plugged:a7bc0cf7-cc9e-4eef-a732-7768e1029a8b for instance 75b8e26f-e8d2-4f9f-ac27-e140eea7b9ee on n-h2-854823-8 Oct 04 21:11:48.164682 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-eb83b32f-76e5-40f9-87e4-381d5243b99e req-8239b2be-a95d-42e6-a70e-402c8e04a5bc service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042612 Oct 04 21:11:48.166191 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2904/5779] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:11:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:11:48.848906 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-de9b9de2-1c73-46c0-88de-f53e435c49ba tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:48.859166 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-de9b9de2-1c73-46c0-88de-f53e435c49ba tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] [instance: 75b8e26f-e8d2-4f9f-ac27-e140eea7b9ee] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:48.871069 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=3 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:11:48.872704 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-de9b9de2-1c73-46c0-88de-f53e435c49ba tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:48.873934 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-de9b9de2-1c73-46c0-88de-f53e435c49ba tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:48.874924 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-de9b9de2-1c73-46c0-88de-f53e435c49ba tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:48.876470 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-de9b9de2-1c73-46c0-88de-f53e435c49ba tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:48.877180 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-de9b9de2-1c73-46c0-88de-f53e435c49ba tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:48.878305 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-de9b9de2-1c73-46c0-88de-f53e435c49ba tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:49.093736 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-de9b9de2-1c73-46c0-88de-f53e435c49ba tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33868e2b8733415cb173ae2da3104e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d1916937bd4cdfbe053d3c84ffa738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:49.103167 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-de9b9de2-1c73-46c0-88de-f53e435c49ba tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] 10.222.0.33 "GET /compute/v2.1/servers/75b8e26f-e8d2-4f9f-ac27-e140eea7b9ee" status: 200 len: 1373 microversion: 2.1 time: 0.260682 Oct 04 21:11:49.133848 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2876/5780] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:11:48 2022] GET /compute/v2.1/servers/75b8e26f-e8d2-4f9f-ac27-e140eea7b9ee => generated 1373 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:11:50.126109 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell0:SELECT=12 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:11:50.132785 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-2c4105c8-745c-49d7-be66-e4f07f1c484c tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:50.133859 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-2c4105c8-745c-49d7-be66-e4f07f1c484c tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] [instance: 75b8e26f-e8d2-4f9f-ac27-e140eea7b9ee] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:50.163074 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2c4105c8-745c-49d7-be66-e4f07f1c484c tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:50.163543 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2c4105c8-745c-49d7-be66-e4f07f1c484c tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:50.163976 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2c4105c8-745c-49d7-be66-e4f07f1c484c tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:50.164728 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2c4105c8-745c-49d7-be66-e4f07f1c484c tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:50.165185 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2c4105c8-745c-49d7-be66-e4f07f1c484c tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:50.168264 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2c4105c8-745c-49d7-be66-e4f07f1c484c tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:50.358211 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-2c4105c8-745c-49d7-be66-e4f07f1c484c tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33868e2b8733415cb173ae2da3104e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d1916937bd4cdfbe053d3c84ffa738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:50.368190 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-2c4105c8-745c-49d7-be66-e4f07f1c484c tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] 10.222.0.33 "GET /compute/v2.1/servers/75b8e26f-e8d2-4f9f-ac27-e140eea7b9ee" status: 200 len: 1546 microversion: 2.1 time: 0.243782 Oct 04 21:11:50.369205 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2905/5781] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:11:50 2022] GET /compute/v2.1/servers/75b8e26f-e8d2-4f9f-ac27-e140eea7b9ee => generated 1546 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:11:50.392461 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c4d0b300-2950-447c-81c6-b59e3cfd65bd tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:50.393076 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c4d0b300-2950-447c-81c6-b59e3cfd65bd tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] [instance: 75b8e26f-e8d2-4f9f-ac27-e140eea7b9ee] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:50.395627 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:11:50.396309 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=8 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:11:50.403687 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c4d0b300-2950-447c-81c6-b59e3cfd65bd tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:50.404187 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c4d0b300-2950-447c-81c6-b59e3cfd65bd tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:50.405465 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c4d0b300-2950-447c-81c6-b59e3cfd65bd tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:50.406820 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c4d0b300-2950-447c-81c6-b59e3cfd65bd tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:50.407638 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c4d0b300-2950-447c-81c6-b59e3cfd65bd tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:50.408881 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c4d0b300-2950-447c-81c6-b59e3cfd65bd tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:50.560855 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c4d0b300-2950-447c-81c6-b59e3cfd65bd tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33868e2b8733415cb173ae2da3104e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d1916937bd4cdfbe053d3c84ffa738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:11:50.571420 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c4d0b300-2950-447c-81c6-b59e3cfd65bd tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] 10.222.0.33 "GET /compute/v2.1/servers/75b8e26f-e8d2-4f9f-ac27-e140eea7b9ee" status: 200 len: 1546 microversion: 2.1 time: 0.183261 Oct 04 21:11:50.572966 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2877/5782] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:11:50 2022] GET /compute/v2.1/servers/75b8e26f-e8d2-4f9f-ac27-e140eea7b9ee => generated 1546 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:11:59.483339 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-80879c9d-6163-4a80-822b-51a7b2b0da88 tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:11:59.483854 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-80879c9d-6163-4a80-822b-51a7b2b0da88 tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] [instance: fb7bd92c-2a21-4c54-8c94-5573645e936e] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:11:59.487451 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=4 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:11:59.493201 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-80879c9d-6163-4a80-822b-51a7b2b0da88 tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:59.493688 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-80879c9d-6163-4a80-822b-51a7b2b0da88 tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:59.494125 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-80879c9d-6163-4a80-822b-51a7b2b0da88 tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:59.494861 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-80879c9d-6163-4a80-822b-51a7b2b0da88 tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:11:59.495316 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-80879c9d-6163-4a80-822b-51a7b2b0da88 tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:11:59.495764 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-80879c9d-6163-4a80-822b-51a7b2b0da88 tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:11:59.584725 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.objects.instance [None req-80879c9d-6163-4a80-822b-51a7b2b0da88 tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Lazy-loading 'services' on Instance uuid fb7bd92c-2a21-4c54-8c94-5573645e936e {{(pid=128802) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:11:59.666016 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-80879c9d-6163-4a80-822b-51a7b2b0da88 tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] 10.222.0.33 "DELETE /compute/v2.1/servers/fb7bd92c-2a21-4c54-8c94-5573645e936e/os-volume_attachments/d72c084c-911f-47b8-9ad3-3df80d006e16" status: 202 len: 0 microversion: 2.1 time: 0.186478 Oct 04 21:11:59.666754 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2906/5783] 10.222.0.33 () {58 vars in 1416 bytes} [Tue Oct 4 21:11:59 2022] DELETE /compute/v2.1/servers/fb7bd92c-2a21-4c54-8c94-5573645e936e/os-volume_attachments/d72c084c-911f-47b8-9ad3-3df80d006e16 => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:12:05.179574 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0a91a8d0-0785-4603-a25c-cb6c720f4033 tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:05.180226 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-0a91a8d0-0785-4603-a25c-cb6c720f4033 tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] [instance: fb7bd92c-2a21-4c54-8c94-5573645e936e] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:05.183373 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=3 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:12:05.184137 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=35,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:12:05.191224 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0a91a8d0-0785-4603-a25c-cb6c720f4033 tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:05.191707 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0a91a8d0-0785-4603-a25c-cb6c720f4033 tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:05.192316 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0a91a8d0-0785-4603-a25c-cb6c720f4033 tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:05.193016 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0a91a8d0-0785-4603-a25c-cb6c720f4033 tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:05.193617 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0a91a8d0-0785-4603-a25c-cb6c720f4033 tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:05.194187 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0a91a8d0-0785-4603-a25c-cb6c720f4033 tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:05.226027 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-0a91a8d0-0785-4603-a25c-cb6c720f4033 tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] [instance: fb7bd92c-2a21-4c54-8c94-5573645e936e] Going to try to terminate instance {{(pid=128801) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:12:05.314450 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-0a91a8d0-0785-4603-a25c-cb6c720f4033 tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] 10.222.0.33 "DELETE /compute/v2.1/servers/fb7bd92c-2a21-4c54-8c94-5573645e936e" status: 204 len: 0 microversion: 2.1 time: 0.138403 Oct 04 21:12:05.315902 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2878/5784] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 21:12:05 2022] DELETE /compute/v2.1/servers/fb7bd92c-2a21-4c54-8c94-5573645e936e => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:12:05.328783 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-dd3f40c1-adf8-43a4-a7b9-8c8c59f4620c tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:05.329792 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-dd3f40c1-adf8-43a4-a7b9-8c8c59f4620c tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] [instance: fb7bd92c-2a21-4c54-8c94-5573645e936e] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:05.338464 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dd3f40c1-adf8-43a4-a7b9-8c8c59f4620c tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:05.339066 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dd3f40c1-adf8-43a4-a7b9-8c8c59f4620c tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:05.339888 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dd3f40c1-adf8-43a4-a7b9-8c8c59f4620c tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:05.340958 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dd3f40c1-adf8-43a4-a7b9-8c8c59f4620c tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:05.341552 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dd3f40c1-adf8-43a4-a7b9-8c8c59f4620c tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:05.342387 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dd3f40c1-adf8-43a4-a7b9-8c8c59f4620c tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:05.506102 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-dd3f40c1-adf8-43a4-a7b9-8c8c59f4620c tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c6bb3c59be4ec39f2ac6053ce86ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed76078f10cd470285d48d4542eba0d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:05.516582 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-dd3f40c1-adf8-43a4-a7b9-8c8c59f4620c tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] 10.222.0.33 "GET /compute/v2.1/servers/fb7bd92c-2a21-4c54-8c94-5573645e936e" status: 200 len: 1515 microversion: 2.1 time: 0.194844 Oct 04 21:12:05.517624 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2907/5785] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:05 2022] GET /compute/v2.1/servers/fb7bd92c-2a21-4c54-8c94-5573645e936e => generated 1515 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:12:06.545489 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e9c63ff7-bc04-4b7c-9906-ec25e7f9b023 tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:06.546787 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e9c63ff7-bc04-4b7c-9906-ec25e7f9b023 tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] [instance: fb7bd92c-2a21-4c54-8c94-5573645e936e] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:06.555730 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e9c63ff7-bc04-4b7c-9906-ec25e7f9b023 tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:06.556404 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e9c63ff7-bc04-4b7c-9906-ec25e7f9b023 tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:06.557003 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e9c63ff7-bc04-4b7c-9906-ec25e7f9b023 tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:06.557866 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e9c63ff7-bc04-4b7c-9906-ec25e7f9b023 tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:06.558497 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e9c63ff7-bc04-4b7c-9906-ec25e7f9b023 tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:06.559065 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e9c63ff7-bc04-4b7c-9906-ec25e7f9b023 tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:06.726053 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e9c63ff7-bc04-4b7c-9906-ec25e7f9b023 tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c6bb3c59be4ec39f2ac6053ce86ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed76078f10cd470285d48d4542eba0d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:06.734909 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e9c63ff7-bc04-4b7c-9906-ec25e7f9b023 tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] 10.222.0.33 "GET /compute/v2.1/servers/fb7bd92c-2a21-4c54-8c94-5573645e936e" status: 200 len: 1515 microversion: 2.1 time: 0.194041 Oct 04 21:12:06.735528 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2879/5786] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:06 2022] GET /compute/v2.1/servers/fb7bd92c-2a21-4c54-8c94-5573645e936e => generated 1515 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:12:07.765851 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-f244bc9a-a83e-46b6-94eb-5101278e839a tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:07.767263 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-f244bc9a-a83e-46b6-94eb-5101278e839a tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] [instance: fb7bd92c-2a21-4c54-8c94-5573645e936e] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:07.778726 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f244bc9a-a83e-46b6-94eb-5101278e839a tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:07.779651 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f244bc9a-a83e-46b6-94eb-5101278e839a tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:07.780271 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f244bc9a-a83e-46b6-94eb-5101278e839a tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:07.781533 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f244bc9a-a83e-46b6-94eb-5101278e839a tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:07.782405 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f244bc9a-a83e-46b6-94eb-5101278e839a tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:07.783073 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f244bc9a-a83e-46b6-94eb-5101278e839a tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:07.831372 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-87c71d7f-8bec-4fa0-828c-703f4741a111 req-33b9f01d-8d1d-4be4-8cbc-d4bca2e58de2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb7bd92c-2a21-4c54-8c94-5573645e936e", "name": "network-vif-deleted", "tag": "7e30d8d7-00dc-4961-a711-124f89b08ea0"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:12:07.841885 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-87c71d7f-8bec-4fa0-828c-703f4741a111 req-33b9f01d-8d1d-4be4-8cbc-d4bca2e58de2 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:07.842386 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-87c71d7f-8bec-4fa0-828c-703f4741a111 req-33b9f01d-8d1d-4be4-8cbc-d4bca2e58de2 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:07.843168 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-87c71d7f-8bec-4fa0-828c-703f4741a111 req-33b9f01d-8d1d-4be4-8cbc-d4bca2e58de2 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:07.856776 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-87c71d7f-8bec-4fa0-828c-703f4741a111 req-33b9f01d-8d1d-4be4-8cbc-d4bca2e58de2 service nova] Creating event network-vif-deleted:7e30d8d7-00dc-4961-a711-124f89b08ea0 for instance fb7bd92c-2a21-4c54-8c94-5573645e936e on n-h2-854823-8 Oct 04 21:12:07.862183 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-87c71d7f-8bec-4fa0-828c-703f4741a111 req-33b9f01d-8d1d-4be4-8cbc-d4bca2e58de2 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036009 Oct 04 21:12:07.866073 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2880/5787] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:12:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:12:07.890358 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-f244bc9a-a83e-46b6-94eb-5101278e839a tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c6bb3c59be4ec39f2ac6053ce86ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed76078f10cd470285d48d4542eba0d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:07.904272 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-f244bc9a-a83e-46b6-94eb-5101278e839a tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] 10.222.0.33 "GET /compute/v2.1/servers/fb7bd92c-2a21-4c54-8c94-5573645e936e" status: 200 len: 1473 microversion: 2.1 time: 0.146762 Oct 04 21:12:07.905179 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2908/5788] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:07 2022] GET /compute/v2.1/servers/fb7bd92c-2a21-4c54-8c94-5573645e936e => generated 1473 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:12:08.932197 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-52277f6d-865b-4f8f-8544-1cc0c5b2878c tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:08.932916 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-52277f6d-865b-4f8f-8544-1cc0c5b2878c tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] [instance: fb7bd92c-2a21-4c54-8c94-5573645e936e] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:08.941013 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-52277f6d-865b-4f8f-8544-1cc0c5b2878c tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:08.941638 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-52277f6d-865b-4f8f-8544-1cc0c5b2878c tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:08.942082 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-52277f6d-865b-4f8f-8544-1cc0c5b2878c tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:08.942815 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-52277f6d-865b-4f8f-8544-1cc0c5b2878c tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:08.943439 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-52277f6d-865b-4f8f-8544-1cc0c5b2878c tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:08.943878 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-52277f6d-865b-4f8f-8544-1cc0c5b2878c tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:08.961321 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-52277f6d-865b-4f8f-8544-1cc0c5b2878c tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] HTTP exception thrown: Instance fb7bd92c-2a21-4c54-8c94-5573645e936e could not be found. Oct 04 21:12:08.963394 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-52277f6d-865b-4f8f-8544-1cc0c5b2878c tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Request method failure captured: Oct 04 21:12:08.963394 n-d-854823-8 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/fb7bd92c-2a21-4c54-8c94-5573645e936e HTTP/1.1 Oct 04 21:12:08.963394 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 21:12:08.963394 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 21:12:08.963394 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 21:12:08.963394 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 0 Oct 04 21:12:08.963394 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 21:12:08.963394 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 21:12:08.963394 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 21:12:08.963394 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 21:12:08.963394 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPKDlr7D9wAcait1TWvjOsPAd6esh640g4L5X19Gh5cC46ahO4lYVX_-jRpV36vT68dMNlB3olaBaK-SB9EpOWt3tAWV80p1HbiknJDowIow9LHlnMnIIBuEwcZX8oscMYGy2hSJjlgUid34rBJpO_tM7IxjaeUQrTBtxVRaqLT-o5O0 Oct 04 21:12:08.963394 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 21:12:08.963394 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 21:12:08.963394 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 21:12:08.963394 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 21:12:08.963394 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 21:12:08.963394 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 21:12:08.963394 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: ed76078f10cd470285d48d4542eba0d3 Oct 04 21:12:08.963394 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-VolumesSnapshotTestJSON-111474993 Oct 04 21:12:08.963394 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 21:12:08.963394 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 21:12:08.963394 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ed76078f10cd470285d48d4542eba0d3", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ed76078f10cd470285d48d4542eba0d3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ed76078f10cd470285d48d4542eba0d3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ed76078f10cd470285d48d4542eba0d3"}]}] Oct 04 21:12:08.963394 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-VolumesSnapshotTestJSON-111474993 Oct 04 21:12:08.963394 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: ed76078f10cd470285d48d4542eba0d3 Oct 04 21:12:08.963394 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-111474993 Oct 04 21:12:08.963394 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-VolumesSnapshotTestJSON-111474993-project Oct 04 21:12:08.963394 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 21:12:08.963394 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 21:12:08.963394 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: 91c6bb3c59be4ec39f2ac6053ce86ff1 Oct 04 21:12:08.963394 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-VolumesSnapshotTestJSON-111474993-project Oct 04 21:12:08.963394 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 21:12:08.963394 n-d-854823-8 devstack@n-api.service[128801]: exception: Instance fb7bd92c-2a21-4c54-8c94-5573645e936e could not be found. Oct 04 21:12:08.963394 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': 'fb7bd92c-2a21-4c54-8c94-5573645e936e'} Oct 04 21:12:08.963394 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:12:08.963394 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:12:08.963394 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:12:08.963394 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:12:08.963394 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:12:08.963394 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:12:08.963394 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:12:08.963394 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:12:08.963394 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:12:08.963394 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:12:08.963394 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb7bd92c-2a21-4c54-8c94-5573645e936e could not be found. Oct 04 21:12:08.963394 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:12:08.963394 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:12:08.963394 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:12:08.963394 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:12:08.963394 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:12:08.963394 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:12:08.963394 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:12:08.963394 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:12:08.963394 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:12:08.963394 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:12:08.963394 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:12:08.963394 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:12:08.963394 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:12:08.963394 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:12:08.963394 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:12:08.963394 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:12:08.963394 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb7bd92c-2a21-4c54-8c94-5573645e936e could not be found. Oct 04 21:12:08.963394 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:12:08.963394 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:12:08.963394 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:12:08.972115 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:12:08.972115 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:12:08.972115 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:12:08.972115 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:12:08.972115 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:12:08.972115 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb7bd92c-2a21-4c54-8c94-5573645e936e could not be found. Oct 04 21:12:08.972115 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:12:08.972115 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-52277f6d-865b-4f8f-8544-1cc0c5b2878c tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Returning 404 to user: Instance fb7bd92c-2a21-4c54-8c94-5573645e936e could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:12:08.972115 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-52277f6d-865b-4f8f-8544-1cc0c5b2878c tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] 10.222.0.33 "GET /compute/v2.1/servers/fb7bd92c-2a21-4c54-8c94-5573645e936e" status: 404 len: 111 microversion: 2.1 time: 0.037452 Oct 04 21:12:08.972115 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2881/5789] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:08 2022] GET /compute/v2.1/servers/fb7bd92c-2a21-4c54-8c94-5573645e936e => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:12:09.156247 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-ac6b87a3-ac1c-4b04-a3c5-a59d7e4999e8 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:09.157389 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-ac6b87a3-ac1c-4b04-a3c5-a59d7e4999e8 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] [instance: c7262313-6b85-476f-a1ca-79d04fcf5740] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:09.165617 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ac6b87a3-ac1c-4b04-a3c5-a59d7e4999e8 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:09.166144 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ac6b87a3-ac1c-4b04-a3c5-a59d7e4999e8 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:09.166606 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ac6b87a3-ac1c-4b04-a3c5-a59d7e4999e8 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:09.167308 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ac6b87a3-ac1c-4b04-a3c5-a59d7e4999e8 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:09.167766 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ac6b87a3-ac1c-4b04-a3c5-a59d7e4999e8 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:09.168188 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ac6b87a3-ac1c-4b04-a3c5-a59d7e4999e8 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:09.314498 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.objects.instance [None req-ac6b87a3-ac1c-4b04-a3c5-a59d7e4999e8 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lazy-loading 'services' on Instance uuid c7262313-6b85-476f-a1ca-79d04fcf5740 {{(pid=128802) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:12:09.421606 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-ac6b87a3-ac1c-4b04-a3c5-a59d7e4999e8 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] 10.222.0.33 "DELETE /compute/v2.1/servers/c7262313-6b85-476f-a1ca-79d04fcf5740/os-volume_attachments/6aa728e7-9285-43c6-92e0-8039524cd921" status: 202 len: 0 microversion: 2.1 time: 0.269015 Oct 04 21:12:09.422605 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2909/5790] 10.222.0.33 () {58 vars in 1416 bytes} [Tue Oct 4 21:12:09 2022] DELETE /compute/v2.1/servers/c7262313-6b85-476f-a1ca-79d04fcf5740/os-volume_attachments/6aa728e7-9285-43c6-92e0-8039524cd921 => generated 0 bytes in 271 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:12:16.210452 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-4cf0c24f-5064-4c54-83fd-ffa18d9b9bc8 tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1971722984", "imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63", "flavorRef": "452", "networks": [{"uuid": "2a95a2c3-b769-41c0-9497-d0cb7e512ff6"}]}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:12:16.313841 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.network.neutron [None req-4cf0c24f-5064-4c54-83fd-ffa18d9b9bc8 tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] validate_networks() for [('2a95a2c3-b769-41c0-9497-d0cb7e512ff6', None, None, None, None, None)] {{(pid=128801) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:12:16.343279 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-df86766b-dac3-4342-bc72-49b407989f1b tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:12:16.355746 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-df86766b-dac3-4342-bc72-49b407989f1b tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:16.356252 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-df86766b-dac3-4342-bc72-49b407989f1b tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:16.356717 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-df86766b-dac3-4342-bc72-49b407989f1b tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:16.377700 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=59,nova_cell1:INSERT=2 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:12:16.381652 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-df86766b-dac3-4342-bc72-49b407989f1b tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] [instance: c7262313-6b85-476f-a1ca-79d04fcf5740] Going to try to stop instance {{(pid=128802) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 04 21:12:16.435895 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-df86766b-dac3-4342-bc72-49b407989f1b tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] 10.222.0.33 "POST /compute/v2.1/servers/c7262313-6b85-476f-a1ca-79d04fcf5740/action" status: 202 len: 0 microversion: 2.1 time: 0.097717 Oct 04 21:12:16.436528 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2910/5791] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 21:12:16 2022] POST /compute/v2.1/servers/c7262313-6b85-476f-a1ca-79d04fcf5740/action => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 21:12:16.445243 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-9857fa36-4f0a-416f-b547-6d371ad13dda tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:16.445955 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-9857fa36-4f0a-416f-b547-6d371ad13dda tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] [instance: c7262313-6b85-476f-a1ca-79d04fcf5740] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:16.452583 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9857fa36-4f0a-416f-b547-6d371ad13dda tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:16.453081 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9857fa36-4f0a-416f-b547-6d371ad13dda tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:16.453520 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9857fa36-4f0a-416f-b547-6d371ad13dda tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:16.454406 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9857fa36-4f0a-416f-b547-6d371ad13dda tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:16.454879 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9857fa36-4f0a-416f-b547-6d371ad13dda tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:16.455850 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9857fa36-4f0a-416f-b547-6d371ad13dda tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:16.785609 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-9857fa36-4f0a-416f-b547-6d371ad13dda tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b627e66ccd94b8faabf8ce9f1d2d2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40732638975044868e5a5eb5f4235244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:16.796555 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-9857fa36-4f0a-416f-b547-6d371ad13dda tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] 10.222.0.33 "GET /compute/v2.1/servers/c7262313-6b85-476f-a1ca-79d04fcf5740" status: 200 len: 1676 microversion: 2.1 time: 0.355541 Oct 04 21:12:16.799507 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2911/5792] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:16 2022] GET /compute/v2.1/servers/c7262313-6b85-476f-a1ca-79d04fcf5740 => generated 1676 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:12:17.414567 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-4cf0c24f-5064-4c54-83fd-ffa18d9b9bc8 tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Flavor limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:12:17.415690 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-4cf0c24f-5064-4c54-83fd-ffa18d9b9bc8 tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Image limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:12:17.416575 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-4cf0c24f-5064-4c54-83fd-ffa18d9b9bc8 tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Flavor pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:12:17.417266 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-4cf0c24f-5064-4c54-83fd-ffa18d9b9bc8 tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Image pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:12:17.417861 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-4cf0c24f-5064-4c54-83fd-ffa18d9b9bc8 tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:12:17.432809 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4cf0c24f-5064-4c54-83fd-ffa18d9b9bc8 tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:17.433628 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4cf0c24f-5064-4c54-83fd-ffa18d9b9bc8 tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:17.434246 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4cf0c24f-5064-4c54-83fd-ffa18d9b9bc8 tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:17.435682 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4cf0c24f-5064-4c54-83fd-ffa18d9b9bc8 tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:17.436414 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4cf0c24f-5064-4c54-83fd-ffa18d9b9bc8 tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:17.437261 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4cf0c24f-5064-4c54-83fd-ffa18d9b9bc8 tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:17.469385 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-4cf0c24f-5064-4c54-83fd-ffa18d9b9bc8 tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Getting quotas for project ed76078f10cd470285d48d4542eba0d3. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:12:17.477420 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-4cf0c24f-5064-4c54-83fd-ffa18d9b9bc8 tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Getting quotas for user 91c6bb3c59be4ec39f2ac6053ce86ff1 and project ed76078f10cd470285d48d4542eba0d3. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:12:17.496121 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-4cf0c24f-5064-4c54-83fd-ffa18d9b9bc8 tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Going to run 1 instances... {{(pid=128801) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:12:17.499309 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-4cf0c24f-5064-4c54-83fd-ffa18d9b9bc8 tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] [instance: a1b4f7d9-d569-445d-b4a7-40b0d07c4a58] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='15b24725-0c99-4bcf-b1fb-907cdf8e2d63',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128801) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:12:17.567202 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-4cf0c24f-5064-4c54-83fd-ffa18d9b9bc8 tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.361948 Oct 04 21:12:17.575548 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2882/5793] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 21:12:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 1374 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:12:17.592348 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-21d2a8be-c204-4375-ae69-53f548ad43b1 tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:17.593170 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-21d2a8be-c204-4375-ae69-53f548ad43b1 tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] [instance: a1b4f7d9-d569-445d-b4a7-40b0d07c4a58] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:17.747463 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-21d2a8be-c204-4375-ae69-53f548ad43b1 tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c6bb3c59be4ec39f2ac6053ce86ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed76078f10cd470285d48d4542eba0d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:17.761342 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-21d2a8be-c204-4375-ae69-53f548ad43b1 tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] 10.222.0.33 "GET /compute/v2.1/servers/a1b4f7d9-d569-445d-b4a7-40b0d07c4a58" status: 200 len: 1219 microversion: 2.1 time: 0.183051 Oct 04 21:12:17.765404 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2912/5794] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:17 2022] GET /compute/v2.1/servers/a1b4f7d9-d569-445d-b4a7-40b0d07c4a58 => generated 1219 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:12:17.823569 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-35621255-d811-4fc0-9237-a74d25307036 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:17.824799 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-35621255-d811-4fc0-9237-a74d25307036 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] [instance: c7262313-6b85-476f-a1ca-79d04fcf5740] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:17.841761 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-35621255-d811-4fc0-9237-a74d25307036 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:17.842562 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-35621255-d811-4fc0-9237-a74d25307036 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:17.845371 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-35621255-d811-4fc0-9237-a74d25307036 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:17.850033 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-35621255-d811-4fc0-9237-a74d25307036 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:17.850806 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-35621255-d811-4fc0-9237-a74d25307036 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:17.851401 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-35621255-d811-4fc0-9237-a74d25307036 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:18.146876 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-35621255-d811-4fc0-9237-a74d25307036 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b627e66ccd94b8faabf8ce9f1d2d2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40732638975044868e5a5eb5f4235244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:18.156070 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-35621255-d811-4fc0-9237-a74d25307036 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] 10.222.0.33 "GET /compute/v2.1/servers/c7262313-6b85-476f-a1ca-79d04fcf5740" status: 200 len: 1676 microversion: 2.1 time: 0.336644 Oct 04 21:12:18.162843 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2883/5795] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:17 2022] GET /compute/v2.1/servers/c7262313-6b85-476f-a1ca-79d04fcf5740 => generated 1676 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:12:18.715491 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-e0881307-6680-423b-85a3-9b48ede79b11 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:18.716070 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-e0881307-6680-423b-85a3-9b48ede79b11 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] [instance: 75b8e26f-e8d2-4f9f-ac27-e140eea7b9ee] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:18.725536 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e0881307-6680-423b-85a3-9b48ede79b11 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:18.726389 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e0881307-6680-423b-85a3-9b48ede79b11 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:18.727033 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e0881307-6680-423b-85a3-9b48ede79b11 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:18.728178 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e0881307-6680-423b-85a3-9b48ede79b11 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:18.728862 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e0881307-6680-423b-85a3-9b48ede79b11 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:18.729514 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e0881307-6680-423b-85a3-9b48ede79b11 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:18.762823 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-e0881307-6680-423b-85a3-9b48ede79b11 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] [instance: 75b8e26f-e8d2-4f9f-ac27-e140eea7b9ee] Going to try to terminate instance {{(pid=128802) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:12:18.791455 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-160a208f-bc01-41b4-95af-b0f547e77f2a tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:18.796487 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-160a208f-bc01-41b4-95af-b0f547e77f2a tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] [instance: a1b4f7d9-d569-445d-b4a7-40b0d07c4a58] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:18.836404 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-160a208f-bc01-41b4-95af-b0f547e77f2a tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:18.839352 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-160a208f-bc01-41b4-95af-b0f547e77f2a tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:18.840011 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-160a208f-bc01-41b4-95af-b0f547e77f2a tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:18.848808 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-160a208f-bc01-41b4-95af-b0f547e77f2a tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:18.855152 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-160a208f-bc01-41b4-95af-b0f547e77f2a tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:18.855617 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-160a208f-bc01-41b4-95af-b0f547e77f2a tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:19.029457 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-e0881307-6680-423b-85a3-9b48ede79b11 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] 10.222.0.33 "DELETE /compute/v2.1/servers/75b8e26f-e8d2-4f9f-ac27-e140eea7b9ee" status: 204 len: 0 microversion: 2.1 time: 0.339880 Oct 04 21:12:19.032067 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2913/5796] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 21:12:18 2022] DELETE /compute/v2.1/servers/75b8e26f-e8d2-4f9f-ac27-e140eea7b9ee => generated 0 bytes in 342 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:12:19.041192 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-160a208f-bc01-41b4-95af-b0f547e77f2a tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c6bb3c59be4ec39f2ac6053ce86ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed76078f10cd470285d48d4542eba0d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:19.044289 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-55038c3e-2c86-4db5-a651-4e0e207b6572 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:19.045489 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-55038c3e-2c86-4db5-a651-4e0e207b6572 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] [instance: 75b8e26f-e8d2-4f9f-ac27-e140eea7b9ee] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:19.052060 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-55038c3e-2c86-4db5-a651-4e0e207b6572 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:19.052875 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-160a208f-bc01-41b4-95af-b0f547e77f2a tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] 10.222.0.33 "GET /compute/v2.1/servers/a1b4f7d9-d569-445d-b4a7-40b0d07c4a58" status: 200 len: 1271 microversion: 2.1 time: 0.270719 Oct 04 21:12:19.053123 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-55038c3e-2c86-4db5-a651-4e0e207b6572 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:19.054255 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-55038c3e-2c86-4db5-a651-4e0e207b6572 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:19.054651 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2884/5797] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:18 2022] GET /compute/v2.1/servers/a1b4f7d9-d569-445d-b4a7-40b0d07c4a58 => generated 1271 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:12:19.073126 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-55038c3e-2c86-4db5-a651-4e0e207b6572 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:19.074130 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-55038c3e-2c86-4db5-a651-4e0e207b6572 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:19.075605 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-55038c3e-2c86-4db5-a651-4e0e207b6572 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:19.189229 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-61982c16-ef32-453a-9464-b60a12d7b3e6 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:19.190268 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-61982c16-ef32-453a-9464-b60a12d7b3e6 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] [instance: c7262313-6b85-476f-a1ca-79d04fcf5740] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:19.197358 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-61982c16-ef32-453a-9464-b60a12d7b3e6 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:19.197857 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-61982c16-ef32-453a-9464-b60a12d7b3e6 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:19.198292 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-61982c16-ef32-453a-9464-b60a12d7b3e6 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:19.199193 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-61982c16-ef32-453a-9464-b60a12d7b3e6 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:19.199808 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-61982c16-ef32-453a-9464-b60a12d7b3e6 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:19.200430 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-61982c16-ef32-453a-9464-b60a12d7b3e6 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:19.265210 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-55038c3e-2c86-4db5-a651-4e0e207b6572 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33868e2b8733415cb173ae2da3104e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d1916937bd4cdfbe053d3c84ffa738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:19.275119 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-55038c3e-2c86-4db5-a651-4e0e207b6572 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] 10.222.0.33 "GET /compute/v2.1/servers/75b8e26f-e8d2-4f9f-ac27-e140eea7b9ee" status: 200 len: 1552 microversion: 2.1 time: 0.236003 Oct 04 21:12:19.276456 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2914/5798] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:19 2022] GET /compute/v2.1/servers/75b8e26f-e8d2-4f9f-ac27-e140eea7b9ee => generated 1552 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:12:19.361961 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-61982c16-ef32-453a-9464-b60a12d7b3e6 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b627e66ccd94b8faabf8ce9f1d2d2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40732638975044868e5a5eb5f4235244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:19.370903 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-61982c16-ef32-453a-9464-b60a12d7b3e6 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] 10.222.0.33 "GET /compute/v2.1/servers/c7262313-6b85-476f-a1ca-79d04fcf5740" status: 200 len: 1676 microversion: 2.1 time: 0.185476 Oct 04 21:12:19.381894 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2885/5799] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:19 2022] GET /compute/v2.1/servers/c7262313-6b85-476f-a1ca-79d04fcf5740 => generated 1676 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:12:20.077437 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-0fcb29eb-54e3-4ca2-8c87-7487fdb3c99e tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:20.077950 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-0fcb29eb-54e3-4ca2-8c87-7487fdb3c99e tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] [instance: a1b4f7d9-d569-445d-b4a7-40b0d07c4a58] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:20.085628 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0fcb29eb-54e3-4ca2-8c87-7487fdb3c99e tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:20.086110 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0fcb29eb-54e3-4ca2-8c87-7487fdb3c99e tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:20.086575 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0fcb29eb-54e3-4ca2-8c87-7487fdb3c99e tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:20.087265 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0fcb29eb-54e3-4ca2-8c87-7487fdb3c99e tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:20.087717 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0fcb29eb-54e3-4ca2-8c87-7487fdb3c99e tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:20.088132 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0fcb29eb-54e3-4ca2-8c87-7487fdb3c99e tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:20.162145 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-0fcb29eb-54e3-4ca2-8c87-7487fdb3c99e tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c6bb3c59be4ec39f2ac6053ce86ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed76078f10cd470285d48d4542eba0d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:20.170952 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-0fcb29eb-54e3-4ca2-8c87-7487fdb3c99e tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] 10.222.0.33 "GET /compute/v2.1/servers/a1b4f7d9-d569-445d-b4a7-40b0d07c4a58" status: 200 len: 1271 microversion: 2.1 time: 0.096741 Oct 04 21:12:20.185193 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2915/5800] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:20 2022] GET /compute/v2.1/servers/a1b4f7d9-d569-445d-b4a7-40b0d07c4a58 => generated 1271 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:12:20.300362 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f5cad363-1b7d-40e4-bd12-bf0cded920ea tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:20.301945 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f5cad363-1b7d-40e4-bd12-bf0cded920ea tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] [instance: 75b8e26f-e8d2-4f9f-ac27-e140eea7b9ee] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:20.309901 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f5cad363-1b7d-40e4-bd12-bf0cded920ea tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:20.310617 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f5cad363-1b7d-40e4-bd12-bf0cded920ea tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:20.310897 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f5cad363-1b7d-40e4-bd12-bf0cded920ea tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:20.311614 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f5cad363-1b7d-40e4-bd12-bf0cded920ea tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:20.312089 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f5cad363-1b7d-40e4-bd12-bf0cded920ea tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:20.312523 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f5cad363-1b7d-40e4-bd12-bf0cded920ea tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:20.394466 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-07a5367e-a871-4ec8-98f5-cda416c2a40b tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:20.395482 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-07a5367e-a871-4ec8-98f5-cda416c2a40b tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] [instance: c7262313-6b85-476f-a1ca-79d04fcf5740] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:20.409411 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-07a5367e-a871-4ec8-98f5-cda416c2a40b tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:20.409918 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-07a5367e-a871-4ec8-98f5-cda416c2a40b tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:20.412286 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-07a5367e-a871-4ec8-98f5-cda416c2a40b tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:20.413252 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-07a5367e-a871-4ec8-98f5-cda416c2a40b tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:20.422067 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-07a5367e-a871-4ec8-98f5-cda416c2a40b tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:20.422860 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-07a5367e-a871-4ec8-98f5-cda416c2a40b tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:20.591273 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f5cad363-1b7d-40e4-bd12-bf0cded920ea tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33868e2b8733415cb173ae2da3104e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d1916937bd4cdfbe053d3c84ffa738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:20.600203 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f5cad363-1b7d-40e4-bd12-bf0cded920ea tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] 10.222.0.33 "GET /compute/v2.1/servers/75b8e26f-e8d2-4f9f-ac27-e140eea7b9ee" status: 200 len: 1552 microversion: 2.1 time: 0.303838 Oct 04 21:12:20.600800 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2886/5801] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:20 2022] GET /compute/v2.1/servers/75b8e26f-e8d2-4f9f-ac27-e140eea7b9ee => generated 1552 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:12:20.621797 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-07a5367e-a871-4ec8-98f5-cda416c2a40b tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b627e66ccd94b8faabf8ce9f1d2d2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40732638975044868e5a5eb5f4235244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:20.631975 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-07a5367e-a871-4ec8-98f5-cda416c2a40b tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] 10.222.0.33 "GET /compute/v2.1/servers/c7262313-6b85-476f-a1ca-79d04fcf5740" status: 200 len: 1676 microversion: 2.1 time: 0.241707 Oct 04 21:12:20.632563 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2916/5802] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:20 2022] GET /compute/v2.1/servers/c7262313-6b85-476f-a1ca-79d04fcf5740 => generated 1676 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:12:21.200371 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-508ede5b-2ee3-467e-8f85-6fa1d2dea814 tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:21.201001 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-508ede5b-2ee3-467e-8f85-6fa1d2dea814 tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] [instance: a1b4f7d9-d569-445d-b4a7-40b0d07c4a58] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:21.219433 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-508ede5b-2ee3-467e-8f85-6fa1d2dea814 tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:21.219919 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-508ede5b-2ee3-467e-8f85-6fa1d2dea814 tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:21.220388 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-508ede5b-2ee3-467e-8f85-6fa1d2dea814 tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:21.221677 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-508ede5b-2ee3-467e-8f85-6fa1d2dea814 tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:21.222150 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-508ede5b-2ee3-467e-8f85-6fa1d2dea814 tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:21.222599 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-508ede5b-2ee3-467e-8f85-6fa1d2dea814 tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:21.250216 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-d8a768e8-633b-4405-bcc6-3dfe6bcebf97 req-1475f0eb-d779-440c-bd28-da15ed8ac621 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75b8e26f-e8d2-4f9f-ac27-e140eea7b9ee", "name": "network-vif-deleted", "tag": "a7bc0cf7-cc9e-4eef-a732-7768e1029a8b"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:12:21.262109 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-d8a768e8-633b-4405-bcc6-3dfe6bcebf97 req-1475f0eb-d779-440c-bd28-da15ed8ac621 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:21.262970 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-d8a768e8-633b-4405-bcc6-3dfe6bcebf97 req-1475f0eb-d779-440c-bd28-da15ed8ac621 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:21.263631 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-d8a768e8-633b-4405-bcc6-3dfe6bcebf97 req-1475f0eb-d779-440c-bd28-da15ed8ac621 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:21.278138 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-d8a768e8-633b-4405-bcc6-3dfe6bcebf97 req-1475f0eb-d779-440c-bd28-da15ed8ac621 service nova] Creating event network-vif-deleted:a7bc0cf7-cc9e-4eef-a732-7768e1029a8b for instance 75b8e26f-e8d2-4f9f-ac27-e140eea7b9ee on n-h2-854823-8 Oct 04 21:12:21.284348 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-d8a768e8-633b-4405-bcc6-3dfe6bcebf97 req-1475f0eb-d779-440c-bd28-da15ed8ac621 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037241 Oct 04 21:12:21.285572 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2917/5803] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:12:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:12:21.326432 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-508ede5b-2ee3-467e-8f85-6fa1d2dea814 tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c6bb3c59be4ec39f2ac6053ce86ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed76078f10cd470285d48d4542eba0d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:21.342570 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-508ede5b-2ee3-467e-8f85-6fa1d2dea814 tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] 10.222.0.33 "GET /compute/v2.1/servers/a1b4f7d9-d569-445d-b4a7-40b0d07c4a58" status: 200 len: 1277 microversion: 2.1 time: 0.146431 Oct 04 21:12:21.343779 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2887/5804] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:21 2022] GET /compute/v2.1/servers/a1b4f7d9-d569-445d-b4a7-40b0d07c4a58 => generated 1277 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:12:21.624847 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-350c1fbb-7309-4c24-b23d-813747b5606b tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:21.625937 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-350c1fbb-7309-4c24-b23d-813747b5606b tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] [instance: 75b8e26f-e8d2-4f9f-ac27-e140eea7b9ee] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:21.634679 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-350c1fbb-7309-4c24-b23d-813747b5606b tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:21.635392 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-350c1fbb-7309-4c24-b23d-813747b5606b tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:21.636088 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-350c1fbb-7309-4c24-b23d-813747b5606b tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:21.637252 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-350c1fbb-7309-4c24-b23d-813747b5606b tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:21.637719 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-350c1fbb-7309-4c24-b23d-813747b5606b tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:21.638148 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-350c1fbb-7309-4c24-b23d-813747b5606b tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:21.657419 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c3781d6e-4378-4412-a9d4-c052705f9e5a tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:21.658054 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c3781d6e-4378-4412-a9d4-c052705f9e5a tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] [instance: c7262313-6b85-476f-a1ca-79d04fcf5740] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:21.670271 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c3781d6e-4378-4412-a9d4-c052705f9e5a tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:21.673407 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c3781d6e-4378-4412-a9d4-c052705f9e5a tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:21.675658 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c3781d6e-4378-4412-a9d4-c052705f9e5a tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:21.707968 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c3781d6e-4378-4412-a9d4-c052705f9e5a tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:21.712448 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c3781d6e-4378-4412-a9d4-c052705f9e5a tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.032s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:21.712958 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c3781d6e-4378-4412-a9d4-c052705f9e5a tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:21.738265 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-350c1fbb-7309-4c24-b23d-813747b5606b tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:21.738849 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-350c1fbb-7309-4c24-b23d-813747b5606b tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:21.739702 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-350c1fbb-7309-4c24-b23d-813747b5606b tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:21.740365 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.objects.instance [None req-350c1fbb-7309-4c24-b23d-813747b5606b tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Lazy-loading 'fault' on Instance uuid 75b8e26f-e8d2-4f9f-ac27-e140eea7b9ee {{(pid=128802) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:12:21.834873 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-350c1fbb-7309-4c24-b23d-813747b5606b tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33868e2b8733415cb173ae2da3104e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d1916937bd4cdfbe053d3c84ffa738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:21.846731 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-350c1fbb-7309-4c24-b23d-813747b5606b tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] 10.222.0.33 "GET /compute/v2.1/servers/75b8e26f-e8d2-4f9f-ac27-e140eea7b9ee" status: 200 len: 1337 microversion: 2.1 time: 0.226156 Oct 04 21:12:21.847621 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2918/5805] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:21 2022] GET /compute/v2.1/servers/75b8e26f-e8d2-4f9f-ac27-e140eea7b9ee => generated 1337 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:12:22.005097 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c3781d6e-4378-4412-a9d4-c052705f9e5a tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b627e66ccd94b8faabf8ce9f1d2d2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40732638975044868e5a5eb5f4235244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:22.025930 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c3781d6e-4378-4412-a9d4-c052705f9e5a tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] 10.222.0.33 "GET /compute/v2.1/servers/c7262313-6b85-476f-a1ca-79d04fcf5740" status: 200 len: 1676 microversion: 2.1 time: 0.372983 Oct 04 21:12:22.026806 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2888/5806] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:21 2022] GET /compute/v2.1/servers/c7262313-6b85-476f-a1ca-79d04fcf5740 => generated 1676 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:12:22.367578 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-4b1d9359-2c9e-4616-a505-ecd6b89030ee tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:22.368200 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-4b1d9359-2c9e-4616-a505-ecd6b89030ee tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] [instance: a1b4f7d9-d569-445d-b4a7-40b0d07c4a58] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:22.375724 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4b1d9359-2c9e-4616-a505-ecd6b89030ee tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:22.376518 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4b1d9359-2c9e-4616-a505-ecd6b89030ee tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:22.377210 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4b1d9359-2c9e-4616-a505-ecd6b89030ee tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:22.377986 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4b1d9359-2c9e-4616-a505-ecd6b89030ee tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:22.378536 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4b1d9359-2c9e-4616-a505-ecd6b89030ee tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:22.379247 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4b1d9359-2c9e-4616-a505-ecd6b89030ee tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:22.697161 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-4b1d9359-2c9e-4616-a505-ecd6b89030ee tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c6bb3c59be4ec39f2ac6053ce86ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed76078f10cd470285d48d4542eba0d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:22.716202 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-4b1d9359-2c9e-4616-a505-ecd6b89030ee tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] 10.222.0.33 "GET /compute/v2.1/servers/a1b4f7d9-d569-445d-b4a7-40b0d07c4a58" status: 200 len: 1319 microversion: 2.1 time: 0.352517 Oct 04 21:12:22.716819 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2919/5807] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:22 2022] GET /compute/v2.1/servers/a1b4f7d9-d569-445d-b4a7-40b0d07c4a58 => generated 1319 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:12:22.877836 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-cd1a6445-f7a0-4643-ad90-3f84f3626cfc tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:22.878866 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-cd1a6445-f7a0-4643-ad90-3f84f3626cfc tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] [instance: 75b8e26f-e8d2-4f9f-ac27-e140eea7b9ee] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:22.889147 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cd1a6445-f7a0-4643-ad90-3f84f3626cfc tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:22.891271 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cd1a6445-f7a0-4643-ad90-3f84f3626cfc tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:22.892749 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cd1a6445-f7a0-4643-ad90-3f84f3626cfc tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:22.893858 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cd1a6445-f7a0-4643-ad90-3f84f3626cfc tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:22.894487 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cd1a6445-f7a0-4643-ad90-3f84f3626cfc tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:22.895020 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cd1a6445-f7a0-4643-ad90-3f84f3626cfc tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:22.909010 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-5a654f92-6735-40e7-bd0b-97ebb1c35d8c req-220c3d2d-4821-45e1-8de3-b8760c795b6c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1b4f7d9-d569-445d-b4a7-40b0d07c4a58", "tag": "19cfdf64-e909-4caa-b848-3ead8d97ae82"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:12:22.914718 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-cd1a6445-f7a0-4643-ad90-3f84f3626cfc tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] HTTP exception thrown: Instance 75b8e26f-e8d2-4f9f-ac27-e140eea7b9ee could not be found. Oct 04 21:12:22.917921 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-cd1a6445-f7a0-4643-ad90-3f84f3626cfc tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Request method failure captured: Oct 04 21:12:22.917921 n-d-854823-8 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/75b8e26f-e8d2-4f9f-ac27-e140eea7b9ee HTTP/1.1 Oct 04 21:12:22.917921 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 21:12:22.917921 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 21:12:22.917921 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 21:12:22.917921 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 0 Oct 04 21:12:22.917921 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 21:12:22.917921 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 21:12:22.917921 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 21:12:22.917921 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 21:12:22.917921 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPKEyEe-tRle88O1Iy6yebj-ff3WMBIUQU7rDd-NHIrBXkxuAo15igKF1S0jifBh-8nW5V9kVfH5g2_Cvo8KolxmuljORMqJTx994LZ5WqWB0w1h68CI6_P2MX3_wS-4QrEzETReflypEWMt2EgCYRAFeO8JX21iYoFt9ZtuJoDYtWUo Oct 04 21:12:22.917921 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 21:12:22.917921 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 21:12:22.917921 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 21:12:22.917921 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 21:12:22.917921 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 21:12:22.917921 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 21:12:22.917921 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: 65d1916937bd4cdfbe053d3c84ffa738 Oct 04 21:12:22.917921 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-TestNetworkBasicOps-860566722 Oct 04 21:12:22.917921 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 21:12:22.917921 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 21:12:22.917921 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_65d1916937bd4cdfbe053d3c84ffa738", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/65d1916937bd4cdfbe053d3c84ffa738"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/65d1916937bd4cdfbe053d3c84ffa738"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/65d1916937bd4cdfbe053d3c84ffa738"}]}] Oct 04 21:12:22.917921 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-TestNetworkBasicOps-860566722 Oct 04 21:12:22.917921 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: 65d1916937bd4cdfbe053d3c84ffa738 Oct 04 21:12:22.917921 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-TestNetworkBasicOps-860566722 Oct 04 21:12:22.917921 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-TestNetworkBasicOps-860566722-project Oct 04 21:12:22.917921 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 21:12:22.917921 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 21:12:22.917921 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: 33868e2b8733415cb173ae2da3104e1d Oct 04 21:12:22.917921 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-TestNetworkBasicOps-860566722-project Oct 04 21:12:22.917921 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 21:12:22.917921 n-d-854823-8 devstack@n-api.service[128801]: exception: Instance 75b8e26f-e8d2-4f9f-ac27-e140eea7b9ee could not be found. Oct 04 21:12:22.917921 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': '75b8e26f-e8d2-4f9f-ac27-e140eea7b9ee'} Oct 04 21:12:22.917921 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:12:22.917921 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:12:22.917921 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:12:22.917921 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:12:22.917921 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:12:22.917921 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:12:22.917921 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:12:22.917921 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:12:22.917921 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:12:22.917921 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:12:22.917921 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75b8e26f-e8d2-4f9f-ac27-e140eea7b9ee could not be found. Oct 04 21:12:22.917921 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:12:22.917921 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:12:22.917921 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:12:22.917921 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:12:22.917921 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:12:22.917921 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:12:22.917921 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:12:22.917921 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:12:22.917921 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:12:22.917921 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:12:22.917921 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:12:22.917921 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:12:22.917921 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:12:22.917921 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:12:22.917921 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:12:22.917921 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:12:22.917921 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75b8e26f-e8d2-4f9f-ac27-e140eea7b9ee could not be found. Oct 04 21:12:22.917921 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:12:22.917921 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:12:22.917921 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:12:22.922060 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:12:22.922060 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:12:22.922060 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:12:22.922060 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:12:22.922060 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:12:22.922060 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75b8e26f-e8d2-4f9f-ac27-e140eea7b9ee could not be found. Oct 04 21:12:22.922060 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:12:22.924803 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-cd1a6445-f7a0-4643-ad90-3f84f3626cfc tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Returning 404 to user: Instance 75b8e26f-e8d2-4f9f-ac27-e140eea7b9ee could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:12:22.927855 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-cd1a6445-f7a0-4643-ad90-3f84f3626cfc tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] 10.222.0.33 "GET /compute/v2.1/servers/75b8e26f-e8d2-4f9f-ac27-e140eea7b9ee" status: 404 len: 111 microversion: 2.1 time: 0.053656 Oct 04 21:12:22.929618 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2889/5808] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:22 2022] GET /compute/v2.1/servers/75b8e26f-e8d2-4f9f-ac27-e140eea7b9ee => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:12:22.936148 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-5a654f92-6735-40e7-bd0b-97ebb1c35d8c req-220c3d2d-4821-45e1-8de3-b8760c795b6c service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:22.936945 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-5a654f92-6735-40e7-bd0b-97ebb1c35d8c req-220c3d2d-4821-45e1-8de3-b8760c795b6c service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:22.938481 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-5a654f92-6735-40e7-bd0b-97ebb1c35d8c req-220c3d2d-4821-45e1-8de3-b8760c795b6c service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:22.951495 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-5a654f92-6735-40e7-bd0b-97ebb1c35d8c req-220c3d2d-4821-45e1-8de3-b8760c795b6c service nova] Creating event network-changed:19cfdf64-e909-4caa-b848-3ead8d97ae82 for instance a1b4f7d9-d569-445d-b4a7-40b0d07c4a58 on n-h2-854823-8 Oct 04 21:12:22.958622 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-5a654f92-6735-40e7-bd0b-97ebb1c35d8c req-220c3d2d-4821-45e1-8de3-b8760c795b6c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053520 Oct 04 21:12:22.959939 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2920/5809] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:12:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:12:23.052673 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8296b07d-87a5-475c-b097-aeed03b4428c tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:23.053432 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-8296b07d-87a5-475c-b097-aeed03b4428c tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] [instance: c7262313-6b85-476f-a1ca-79d04fcf5740] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:23.075711 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8296b07d-87a5-475c-b097-aeed03b4428c tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:23.076287 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8296b07d-87a5-475c-b097-aeed03b4428c tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:23.076637 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8296b07d-87a5-475c-b097-aeed03b4428c tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:23.077347 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8296b07d-87a5-475c-b097-aeed03b4428c tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:23.077803 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8296b07d-87a5-475c-b097-aeed03b4428c tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:23.078230 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8296b07d-87a5-475c-b097-aeed03b4428c tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:23.289939 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-c0249556-5826-4167-bcb3-783433b1ce08 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Calling method '.version_select at 0x7f3c6f575430>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:23.328950 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-c0249556-5826-4167-bcb3-783433b1ce08 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-212433675" status: 202 len: 0 microversion: 2.1 time: 0.050909 Oct 04 21:12:23.330035 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2921/5810] 10.222.0.33 () {58 vars in 1254 bytes} [Tue Oct 4 21:12:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-212433675 => generated 0 bytes in 53 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:12:23.433956 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-8296b07d-87a5-475c-b097-aeed03b4428c tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b627e66ccd94b8faabf8ce9f1d2d2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40732638975044868e5a5eb5f4235244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:23.448257 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-8296b07d-87a5-475c-b097-aeed03b4428c tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] 10.222.0.33 "GET /compute/v2.1/servers/c7262313-6b85-476f-a1ca-79d04fcf5740" status: 200 len: 1676 microversion: 2.1 time: 0.401349 Oct 04 21:12:23.450720 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2890/5811] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:23 2022] GET /compute/v2.1/servers/c7262313-6b85-476f-a1ca-79d04fcf5740 => generated 1676 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:12:23.744237 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-7062ff68-f017-4739-9cbc-9accb7670ac2 tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:23.745611 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-7062ff68-f017-4739-9cbc-9accb7670ac2 tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] [instance: a1b4f7d9-d569-445d-b4a7-40b0d07c4a58] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:23.766984 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7062ff68-f017-4739-9cbc-9accb7670ac2 tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:23.767480 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7062ff68-f017-4739-9cbc-9accb7670ac2 tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:23.767980 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7062ff68-f017-4739-9cbc-9accb7670ac2 tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:23.769314 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7062ff68-f017-4739-9cbc-9accb7670ac2 tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:23.769778 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7062ff68-f017-4739-9cbc-9accb7670ac2 tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:23.770204 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7062ff68-f017-4739-9cbc-9accb7670ac2 tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:24.067762 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-7062ff68-f017-4739-9cbc-9accb7670ac2 tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c6bb3c59be4ec39f2ac6053ce86ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed76078f10cd470285d48d4542eba0d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:24.078158 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-7062ff68-f017-4739-9cbc-9accb7670ac2 tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] 10.222.0.33 "GET /compute/v2.1/servers/a1b4f7d9-d569-445d-b4a7-40b0d07c4a58" status: 200 len: 1319 microversion: 2.1 time: 0.340109 Oct 04 21:12:24.082229 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2922/5812] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:23 2022] GET /compute/v2.1/servers/a1b4f7d9-d569-445d-b4a7-40b0d07c4a58 => generated 1319 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:12:24.474956 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-bd68ab3d-5c76-46c6-a713-951c6240d3a9 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:24.475587 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-bd68ab3d-5c76-46c6-a713-951c6240d3a9 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] [instance: c7262313-6b85-476f-a1ca-79d04fcf5740] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:24.494975 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bd68ab3d-5c76-46c6-a713-951c6240d3a9 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:24.495474 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bd68ab3d-5c76-46c6-a713-951c6240d3a9 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:24.495918 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bd68ab3d-5c76-46c6-a713-951c6240d3a9 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:24.496637 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bd68ab3d-5c76-46c6-a713-951c6240d3a9 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:24.497105 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bd68ab3d-5c76-46c6-a713-951c6240d3a9 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:24.500795 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bd68ab3d-5c76-46c6-a713-951c6240d3a9 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:24.801428 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-bd68ab3d-5c76-46c6-a713-951c6240d3a9 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b627e66ccd94b8faabf8ce9f1d2d2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40732638975044868e5a5eb5f4235244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:24.820119 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-bd68ab3d-5c76-46c6-a713-951c6240d3a9 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] 10.222.0.33 "GET /compute/v2.1/servers/c7262313-6b85-476f-a1ca-79d04fcf5740" status: 200 len: 1676 microversion: 2.1 time: 0.350777 Oct 04 21:12:24.834292 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2891/5813] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:24 2022] GET /compute/v2.1/servers/c7262313-6b85-476f-a1ca-79d04fcf5740 => generated 1676 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:12:25.107442 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-c0963a98-09e0-48bb-a2db-c2bdbfb5a47a tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:25.108803 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-c0963a98-09e0-48bb-a2db-c2bdbfb5a47a tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] [instance: a1b4f7d9-d569-445d-b4a7-40b0d07c4a58] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:25.116897 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c0963a98-09e0-48bb-a2db-c2bdbfb5a47a tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:25.117775 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c0963a98-09e0-48bb-a2db-c2bdbfb5a47a tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:25.118483 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c0963a98-09e0-48bb-a2db-c2bdbfb5a47a tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:25.119471 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c0963a98-09e0-48bb-a2db-c2bdbfb5a47a tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:25.120527 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c0963a98-09e0-48bb-a2db-c2bdbfb5a47a tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:25.124396 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c0963a98-09e0-48bb-a2db-c2bdbfb5a47a tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:25.337878 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-c0963a98-09e0-48bb-a2db-c2bdbfb5a47a tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c6bb3c59be4ec39f2ac6053ce86ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed76078f10cd470285d48d4542eba0d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:25.348299 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-c0963a98-09e0-48bb-a2db-c2bdbfb5a47a tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] 10.222.0.33 "GET /compute/v2.1/servers/a1b4f7d9-d569-445d-b4a7-40b0d07c4a58" status: 200 len: 1319 microversion: 2.1 time: 0.244642 Oct 04 21:12:25.362381 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2923/5814] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:25 2022] GET /compute/v2.1/servers/a1b4f7d9-d569-445d-b4a7-40b0d07c4a58 => generated 1319 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:12:25.859566 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5d597e23-7251-4be7-8f50-a34b46333ade tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:25.860789 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-5d597e23-7251-4be7-8f50-a34b46333ade tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] [instance: c7262313-6b85-476f-a1ca-79d04fcf5740] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:25.870595 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5d597e23-7251-4be7-8f50-a34b46333ade tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:25.871330 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5d597e23-7251-4be7-8f50-a34b46333ade tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:25.871947 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5d597e23-7251-4be7-8f50-a34b46333ade tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:25.873369 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5d597e23-7251-4be7-8f50-a34b46333ade tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:25.873994 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5d597e23-7251-4be7-8f50-a34b46333ade tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:25.875720 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5d597e23-7251-4be7-8f50-a34b46333ade tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:25.964155 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-2e37a363-cf9f-4669-973d-619e3583d13a tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:25.965023 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-2e37a363-cf9f-4669-973d-619e3583d13a tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] [instance: 307b14f3-2d72-4cb2-ab60-ccb5af659240] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:25.977125 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2e37a363-cf9f-4669-973d-619e3583d13a tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:25.983011 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2e37a363-cf9f-4669-973d-619e3583d13a tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:25.983658 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2e37a363-cf9f-4669-973d-619e3583d13a tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:25.984724 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2e37a363-cf9f-4669-973d-619e3583d13a tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:25.985344 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2e37a363-cf9f-4669-973d-619e3583d13a tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:25.985932 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2e37a363-cf9f-4669-973d-619e3583d13a tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:26.052680 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-2e37a363-cf9f-4669-973d-619e3583d13a tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] [instance: 307b14f3-2d72-4cb2-ab60-ccb5af659240] Going to try to terminate instance {{(pid=128802) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:12:26.158235 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-5d597e23-7251-4be7-8f50-a34b46333ade tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b627e66ccd94b8faabf8ce9f1d2d2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40732638975044868e5a5eb5f4235244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:26.168011 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5d597e23-7251-4be7-8f50-a34b46333ade tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] 10.222.0.33 "GET /compute/v2.1/servers/c7262313-6b85-476f-a1ca-79d04fcf5740" status: 200 len: 1676 microversion: 2.1 time: 0.312269 Oct 04 21:12:26.169600 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2892/5815] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:25 2022] GET /compute/v2.1/servers/c7262313-6b85-476f-a1ca-79d04fcf5740 => generated 1676 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:12:26.175435 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-a6cd8612-4347-4e85-9d0b-ef5fe3d6ca8c req-c98e2e71-8248-4c28-b26b-c4ed6668dc68 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "307b14f3-2d72-4cb2-ab60-ccb5af659240", "tag": "a90bbb5c-2349-4a2c-ae3e-8af0436104d3"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:12:26.202550 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-a6cd8612-4347-4e85-9d0b-ef5fe3d6ca8c req-c98e2e71-8248-4c28-b26b-c4ed6668dc68 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:26.203493 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-a6cd8612-4347-4e85-9d0b-ef5fe3d6ca8c req-c98e2e71-8248-4c28-b26b-c4ed6668dc68 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:26.204791 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-a6cd8612-4347-4e85-9d0b-ef5fe3d6ca8c req-c98e2e71-8248-4c28-b26b-c4ed6668dc68 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:26.228510 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-2e37a363-cf9f-4669-973d-619e3583d13a tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] 10.222.0.33 "DELETE /compute/v2.1/servers/307b14f3-2d72-4cb2-ab60-ccb5af659240" status: 204 len: 0 microversion: 2.1 time: 0.276526 Oct 04 21:12:26.233479 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-a6cd8612-4347-4e85-9d0b-ef5fe3d6ca8c req-c98e2e71-8248-4c28-b26b-c4ed6668dc68 service nova] Creating event network-changed:a90bbb5c-2349-4a2c-ae3e-8af0436104d3 for instance 307b14f3-2d72-4cb2-ab60-ccb5af659240 on n-h1-854823-8 Oct 04 21:12:26.233830 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2924/5816] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 21:12:25 2022] DELETE /compute/v2.1/servers/307b14f3-2d72-4cb2-ab60-ccb5af659240 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:12:26.241597 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-e442dbd4-4201-4f61-8051-c7caabef738e tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:26.243237 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-e442dbd4-4201-4f61-8051-c7caabef738e tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] [instance: 307b14f3-2d72-4cb2-ab60-ccb5af659240] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:26.247511 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-a6cd8612-4347-4e85-9d0b-ef5fe3d6ca8c req-c98e2e71-8248-4c28-b26b-c4ed6668dc68 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075535 Oct 04 21:12:26.248129 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2893/5817] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:12:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:12:26.252794 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e442dbd4-4201-4f61-8051-c7caabef738e tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:26.253511 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e442dbd4-4201-4f61-8051-c7caabef738e tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:26.254654 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e442dbd4-4201-4f61-8051-c7caabef738e tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:26.255857 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e442dbd4-4201-4f61-8051-c7caabef738e tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:26.256485 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e442dbd4-4201-4f61-8051-c7caabef738e tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:26.257215 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e442dbd4-4201-4f61-8051-c7caabef738e tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:26.276892 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:12:26.375126 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8dd7dfd8-1b43-4358-a0d6-780b246f1ebd tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:26.375847 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-8dd7dfd8-1b43-4358-a0d6-780b246f1ebd tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] [instance: a1b4f7d9-d569-445d-b4a7-40b0d07c4a58] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:26.392094 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8dd7dfd8-1b43-4358-a0d6-780b246f1ebd tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:26.396531 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8dd7dfd8-1b43-4358-a0d6-780b246f1ebd tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:26.397675 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8dd7dfd8-1b43-4358-a0d6-780b246f1ebd tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:26.400530 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8dd7dfd8-1b43-4358-a0d6-780b246f1ebd tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:26.402575 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8dd7dfd8-1b43-4358-a0d6-780b246f1ebd tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:26.413470 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8dd7dfd8-1b43-4358-a0d6-780b246f1ebd tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:26.615702 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-e442dbd4-4201-4f61-8051-c7caabef738e tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33868e2b8733415cb173ae2da3104e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d1916937bd4cdfbe053d3c84ffa738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:26.625956 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-e442dbd4-4201-4f61-8051-c7caabef738e tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] 10.222.0.33 "GET /compute/v2.1/servers/307b14f3-2d72-4cb2-ab60-ccb5af659240" status: 200 len: 1670 microversion: 2.1 time: 0.390326 Oct 04 21:12:26.628484 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2925/5818] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:26 2022] GET /compute/v2.1/servers/307b14f3-2d72-4cb2-ab60-ccb5af659240 => generated 1670 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:12:26.731178 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-8dd7dfd8-1b43-4358-a0d6-780b246f1ebd tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c6bb3c59be4ec39f2ac6053ce86ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed76078f10cd470285d48d4542eba0d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:26.740096 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-8dd7dfd8-1b43-4358-a0d6-780b246f1ebd tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] 10.222.0.33 "GET /compute/v2.1/servers/a1b4f7d9-d569-445d-b4a7-40b0d07c4a58" status: 200 len: 1319 microversion: 2.1 time: 0.370574 Oct 04 21:12:26.755562 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2894/5819] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:26 2022] GET /compute/v2.1/servers/a1b4f7d9-d569-445d-b4a7-40b0d07c4a58 => generated 1319 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:12:27.229724 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-ac06b558-4163-4ffc-9c88-7cd6c00ebcf4 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:27.233334 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-ac06b558-4163-4ffc-9c88-7cd6c00ebcf4 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] [instance: c7262313-6b85-476f-a1ca-79d04fcf5740] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:27.249446 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ac06b558-4163-4ffc-9c88-7cd6c00ebcf4 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:27.249933 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ac06b558-4163-4ffc-9c88-7cd6c00ebcf4 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:27.253919 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ac06b558-4163-4ffc-9c88-7cd6c00ebcf4 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:27.254736 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ac06b558-4163-4ffc-9c88-7cd6c00ebcf4 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:27.257438 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ac06b558-4163-4ffc-9c88-7cd6c00ebcf4 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:27.259058 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ac06b558-4163-4ffc-9c88-7cd6c00ebcf4 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:27.453969 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-ac06b558-4163-4ffc-9c88-7cd6c00ebcf4 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b627e66ccd94b8faabf8ce9f1d2d2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40732638975044868e5a5eb5f4235244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:27.468845 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-ac06b558-4163-4ffc-9c88-7cd6c00ebcf4 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] 10.222.0.33 "GET /compute/v2.1/servers/c7262313-6b85-476f-a1ca-79d04fcf5740" status: 200 len: 1653 microversion: 2.1 time: 0.277457 Oct 04 21:12:27.470126 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2926/5820] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:27 2022] GET /compute/v2.1/servers/c7262313-6b85-476f-a1ca-79d04fcf5740 => generated 1653 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:12:27.497065 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8d7567f0-de28-49f1-98ec-55985cb601df tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:12:27.504627 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:12:27.506282 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=6 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:12:27.510166 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8d7567f0-de28-49f1-98ec-55985cb601df tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:27.511126 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8d7567f0-de28-49f1-98ec-55985cb601df tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:27.511882 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8d7567f0-de28-49f1-98ec-55985cb601df tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:27.544880 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-8d7567f0-de28-49f1-98ec-55985cb601df tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] [instance: c7262313-6b85-476f-a1ca-79d04fcf5740] Going to try to start instance {{(pid=128801) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 04 21:12:27.566581 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:12:27.604338 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-8d7567f0-de28-49f1-98ec-55985cb601df tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] 10.222.0.33 "POST /compute/v2.1/servers/c7262313-6b85-476f-a1ca-79d04fcf5740/action" status: 202 len: 0 microversion: 2.1 time: 0.110986 Oct 04 21:12:27.607417 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2895/5821] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 21:12:27 2022] POST /compute/v2.1/servers/c7262313-6b85-476f-a1ca-79d04fcf5740/action => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:12:27.620907 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-80e60ddf-ad28-46a8-9237-2da96a59d18f tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:27.621765 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-80e60ddf-ad28-46a8-9237-2da96a59d18f tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] [instance: c7262313-6b85-476f-a1ca-79d04fcf5740] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:27.634166 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-80e60ddf-ad28-46a8-9237-2da96a59d18f tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:27.635988 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-80e60ddf-ad28-46a8-9237-2da96a59d18f tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:27.636606 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-80e60ddf-ad28-46a8-9237-2da96a59d18f tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:27.638957 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-80e60ddf-ad28-46a8-9237-2da96a59d18f tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:27.641211 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-80e60ddf-ad28-46a8-9237-2da96a59d18f tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:27.644587 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-80e60ddf-ad28-46a8-9237-2da96a59d18f tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:27.657583 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-37131f8c-4296-4252-852d-53001bac4636 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:27.658627 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-37131f8c-4296-4252-852d-53001bac4636 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] [instance: 307b14f3-2d72-4cb2-ab60-ccb5af659240] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:27.678402 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-37131f8c-4296-4252-852d-53001bac4636 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:27.679024 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-37131f8c-4296-4252-852d-53001bac4636 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:27.679485 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-37131f8c-4296-4252-852d-53001bac4636 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:27.682816 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-37131f8c-4296-4252-852d-53001bac4636 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:27.683775 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-37131f8c-4296-4252-852d-53001bac4636 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:27.684261 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-37131f8c-4296-4252-852d-53001bac4636 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:27.758321 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell0:SELECT=2 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:12:28.219152 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-37131f8c-4296-4252-852d-53001bac4636 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33868e2b8733415cb173ae2da3104e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d1916937bd4cdfbe053d3c84ffa738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:28.231301 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-37131f8c-4296-4252-852d-53001bac4636 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] 10.222.0.33 "GET /compute/v2.1/servers/307b14f3-2d72-4cb2-ab60-ccb5af659240" status: 200 len: 1670 microversion: 2.1 time: 0.581147 Oct 04 21:12:28.232009 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2896/5822] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:27 2022] GET /compute/v2.1/servers/307b14f3-2d72-4cb2-ab60-ccb5af659240 => generated 1670 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:12:28.237248 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6726ec4d-bc45-4e8f-96e3-205855495188 tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:28.237878 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-6726ec4d-bc45-4e8f-96e3-205855495188 tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] [instance: a1b4f7d9-d569-445d-b4a7-40b0d07c4a58] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:28.259666 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6726ec4d-bc45-4e8f-96e3-205855495188 tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:28.260203 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6726ec4d-bc45-4e8f-96e3-205855495188 tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:28.260706 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6726ec4d-bc45-4e8f-96e3-205855495188 tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:28.261472 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6726ec4d-bc45-4e8f-96e3-205855495188 tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:28.261937 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6726ec4d-bc45-4e8f-96e3-205855495188 tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:28.274463 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6726ec4d-bc45-4e8f-96e3-205855495188 tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:28.422978 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-80e60ddf-ad28-46a8-9237-2da96a59d18f tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b627e66ccd94b8faabf8ce9f1d2d2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40732638975044868e5a5eb5f4235244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:28.433592 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-80e60ddf-ad28-46a8-9237-2da96a59d18f tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] 10.222.0.33 "GET /compute/v2.1/servers/c7262313-6b85-476f-a1ca-79d04fcf5740" status: 200 len: 1662 microversion: 2.1 time: 0.820420 Oct 04 21:12:28.434793 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2927/5823] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:27 2022] GET /compute/v2.1/servers/c7262313-6b85-476f-a1ca-79d04fcf5740 => generated 1662 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:12:28.440549 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-6fb4fc5d-7137-4a7c-bf74-9604c8392c6b req-745afa47-c841-4c99-af8e-3147d62d032f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1b4f7d9-d569-445d-b4a7-40b0d07c4a58", "name": "network-vif-plugged", "status": "completed", "tag": "19cfdf64-e909-4caa-b848-3ead8d97ae82"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:12:28.454844 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-6fb4fc5d-7137-4a7c-bf74-9604c8392c6b req-745afa47-c841-4c99-af8e-3147d62d032f service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:28.456041 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-6fb4fc5d-7137-4a7c-bf74-9604c8392c6b req-745afa47-c841-4c99-af8e-3147d62d032f service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:28.456559 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-6fb4fc5d-7137-4a7c-bf74-9604c8392c6b req-745afa47-c841-4c99-af8e-3147d62d032f service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:28.472198 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-6fb4fc5d-7137-4a7c-bf74-9604c8392c6b req-745afa47-c841-4c99-af8e-3147d62d032f service nova] Creating event network-vif-plugged:19cfdf64-e909-4caa-b848-3ead8d97ae82 for instance a1b4f7d9-d569-445d-b4a7-40b0d07c4a58 on n-h2-854823-8 Oct 04 21:12:28.478903 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-6fb4fc5d-7137-4a7c-bf74-9604c8392c6b req-745afa47-c841-4c99-af8e-3147d62d032f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042479 Oct 04 21:12:28.479824 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2928/5824] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:12:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:12:29.084311 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-6726ec4d-bc45-4e8f-96e3-205855495188 tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c6bb3c59be4ec39f2ac6053ce86ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed76078f10cd470285d48d4542eba0d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:29.106558 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-6726ec4d-bc45-4e8f-96e3-205855495188 tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] 10.222.0.33 "GET /compute/v2.1/servers/a1b4f7d9-d569-445d-b4a7-40b0d07c4a58" status: 200 len: 1319 microversion: 2.1 time: 0.873380 Oct 04 21:12:29.108048 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2897/5825] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:28 2022] GET /compute/v2.1/servers/a1b4f7d9-d569-445d-b4a7-40b0d07c4a58 => generated 1319 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:12:29.257530 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-668cd856-55fe-4cd0-b6ae-de05fb0f915b tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:29.258244 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-668cd856-55fe-4cd0-b6ae-de05fb0f915b tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] [instance: 307b14f3-2d72-4cb2-ab60-ccb5af659240] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:29.266454 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-668cd856-55fe-4cd0-b6ae-de05fb0f915b tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:29.266959 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-668cd856-55fe-4cd0-b6ae-de05fb0f915b tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:29.267400 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-668cd856-55fe-4cd0-b6ae-de05fb0f915b tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:29.269265 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-668cd856-55fe-4cd0-b6ae-de05fb0f915b tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:29.269922 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-668cd856-55fe-4cd0-b6ae-de05fb0f915b tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:29.270383 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-668cd856-55fe-4cd0-b6ae-de05fb0f915b tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:29.314105 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-0ab735a7-13cc-4262-b592-1154c7bb7dfd req-3916904a-b311-480b-8516-85809c768a0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "307b14f3-2d72-4cb2-ab60-ccb5af659240", "name": "network-vif-deleted", "tag": "a90bbb5c-2349-4a2c-ae3e-8af0436104d3"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:12:29.329190 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-0ab735a7-13cc-4262-b592-1154c7bb7dfd req-3916904a-b311-480b-8516-85809c768a0e service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:29.329655 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-0ab735a7-13cc-4262-b592-1154c7bb7dfd req-3916904a-b311-480b-8516-85809c768a0e service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:29.331068 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-0ab735a7-13cc-4262-b592-1154c7bb7dfd req-3916904a-b311-480b-8516-85809c768a0e service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:29.344608 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-0ab735a7-13cc-4262-b592-1154c7bb7dfd req-3916904a-b311-480b-8516-85809c768a0e service nova] Creating event network-vif-deleted:a90bbb5c-2349-4a2c-ae3e-8af0436104d3 for instance 307b14f3-2d72-4cb2-ab60-ccb5af659240 on n-h1-854823-8 Oct 04 21:12:29.355461 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-0ab735a7-13cc-4262-b592-1154c7bb7dfd req-3916904a-b311-480b-8516-85809c768a0e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048957 Oct 04 21:12:29.356184 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2898/5826] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:12:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:12:29.402857 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-668cd856-55fe-4cd0-b6ae-de05fb0f915b tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33868e2b8733415cb173ae2da3104e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d1916937bd4cdfbe053d3c84ffa738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:29.414180 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-668cd856-55fe-4cd0-b6ae-de05fb0f915b tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] 10.222.0.33 "GET /compute/v2.1/servers/307b14f3-2d72-4cb2-ab60-ccb5af659240" status: 200 len: 1484 microversion: 2.1 time: 0.161777 Oct 04 21:12:29.415957 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2929/5827] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:29 2022] GET /compute/v2.1/servers/307b14f3-2d72-4cb2-ab60-ccb5af659240 => generated 1484 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:12:29.462464 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-946bb9f2-dd80-4136-867b-b3f060ccbc95 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:29.463565 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-946bb9f2-dd80-4136-867b-b3f060ccbc95 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] [instance: c7262313-6b85-476f-a1ca-79d04fcf5740] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:29.480516 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-946bb9f2-dd80-4136-867b-b3f060ccbc95 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:29.481024 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-946bb9f2-dd80-4136-867b-b3f060ccbc95 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:29.481500 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-946bb9f2-dd80-4136-867b-b3f060ccbc95 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:29.482221 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-946bb9f2-dd80-4136-867b-b3f060ccbc95 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:29.487597 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-946bb9f2-dd80-4136-867b-b3f060ccbc95 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:29.488085 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-946bb9f2-dd80-4136-867b-b3f060ccbc95 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:29.727391 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-946bb9f2-dd80-4136-867b-b3f060ccbc95 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b627e66ccd94b8faabf8ce9f1d2d2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40732638975044868e5a5eb5f4235244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:29.744875 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-946bb9f2-dd80-4136-867b-b3f060ccbc95 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] 10.222.0.33 "GET /compute/v2.1/servers/c7262313-6b85-476f-a1ca-79d04fcf5740" status: 200 len: 1662 microversion: 2.1 time: 0.287255 Oct 04 21:12:29.745477 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2899/5828] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:29 2022] GET /compute/v2.1/servers/c7262313-6b85-476f-a1ca-79d04fcf5740 => generated 1662 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:12:30.136012 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-3e7e083b-be12-4686-994e-3bcc85ebf754 tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:30.137253 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-3e7e083b-be12-4686-994e-3bcc85ebf754 tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] [instance: a1b4f7d9-d569-445d-b4a7-40b0d07c4a58] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:30.147782 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:12:30.152296 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3e7e083b-be12-4686-994e-3bcc85ebf754 tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:30.153453 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3e7e083b-be12-4686-994e-3bcc85ebf754 tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:30.154163 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3e7e083b-be12-4686-994e-3bcc85ebf754 tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:30.155235 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3e7e083b-be12-4686-994e-3bcc85ebf754 tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:30.155731 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3e7e083b-be12-4686-994e-3bcc85ebf754 tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:30.156317 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3e7e083b-be12-4686-994e-3bcc85ebf754 tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:30.307809 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-3e7e083b-be12-4686-994e-3bcc85ebf754 tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c6bb3c59be4ec39f2ac6053ce86ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed76078f10cd470285d48d4542eba0d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:30.316234 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-3e7e083b-be12-4686-994e-3bcc85ebf754 tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] 10.222.0.33 "GET /compute/v2.1/servers/a1b4f7d9-d569-445d-b4a7-40b0d07c4a58" status: 200 len: 1508 microversion: 2.1 time: 0.187356 Oct 04 21:12:30.316932 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2930/5829] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:30 2022] GET /compute/v2.1/servers/a1b4f7d9-d569-445d-b4a7-40b0d07c4a58 => generated 1508 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:12:30.351317 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-28b1618b-ed98-4a9e-90ce-ba50bfc373f7 tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "67cf0f07-0cd0-4d10-b5e3-259d42a83364", "device": "/dev/sdb"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:12:30.355517 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-28b1618b-ed98-4a9e-90ce-ba50bfc373f7 tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] [instance: a1b4f7d9-d569-445d-b4a7-40b0d07c4a58] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:30.363208 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-28b1618b-ed98-4a9e-90ce-ba50bfc373f7 tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:30.363747 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-28b1618b-ed98-4a9e-90ce-ba50bfc373f7 tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:30.364159 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-28b1618b-ed98-4a9e-90ce-ba50bfc373f7 tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:30.364876 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-28b1618b-ed98-4a9e-90ce-ba50bfc373f7 tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:30.366248 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-28b1618b-ed98-4a9e-90ce-ba50bfc373f7 tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:30.366248 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-28b1618b-ed98-4a9e-90ce-ba50bfc373f7 tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:30.474412 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-03f6ac89-e539-4398-aafd-fc07390bab3a tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:30.475231 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-03f6ac89-e539-4398-aafd-fc07390bab3a tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] [instance: 307b14f3-2d72-4cb2-ab60-ccb5af659240] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:30.481925 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-03f6ac89-e539-4398-aafd-fc07390bab3a tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:30.482565 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-03f6ac89-e539-4398-aafd-fc07390bab3a tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:30.483137 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-03f6ac89-e539-4398-aafd-fc07390bab3a tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:30.483937 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-03f6ac89-e539-4398-aafd-fc07390bab3a tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:30.484492 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-03f6ac89-e539-4398-aafd-fc07390bab3a tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:30.485016 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-03f6ac89-e539-4398-aafd-fc07390bab3a tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:30.500693 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.wsgi [None req-03f6ac89-e539-4398-aafd-fc07390bab3a tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] HTTP exception thrown: Instance 307b14f3-2d72-4cb2-ab60-ccb5af659240 could not be found. Oct 04 21:12:30.502776 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-03f6ac89-e539-4398-aafd-fc07390bab3a tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Request method failure captured: Oct 04 21:12:30.502776 n-d-854823-8 devstack@n-api.service[128802]: request: GET /compute/v2.1/servers/307b14f3-2d72-4cb2-ab60-ccb5af659240 HTTP/1.1 Oct 04 21:12:30.502776 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 21:12:30.502776 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 21:12:30.502776 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 21:12:30.502776 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 0 Oct 04 21:12:30.502776 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 21:12:30.502776 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 21:12:30.502776 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 21:12:30.502776 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 21:12:30.502776 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPKEyEe-tRle88O1Iy6yebj-ff3WMBIUQU7rDd-NHIrBXkxuAo15igKF1S0jifBh-8nW5V9kVfH5g2_Cvo8KolxmuljORMqJTx994LZ5WqWB0w1h68CI6_P2MX3_wS-4QrEzETReflypEWMt2EgCYRAFeO8JX21iYoFt9ZtuJoDYtWUo Oct 04 21:12:30.502776 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 21:12:30.502776 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 21:12:30.502776 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 21:12:30.502776 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 21:12:30.502776 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 21:12:30.502776 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 21:12:30.502776 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: 65d1916937bd4cdfbe053d3c84ffa738 Oct 04 21:12:30.502776 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-TestNetworkBasicOps-860566722 Oct 04 21:12:30.502776 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 21:12:30.502776 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 21:12:30.502776 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_65d1916937bd4cdfbe053d3c84ffa738", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/65d1916937bd4cdfbe053d3c84ffa738"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/65d1916937bd4cdfbe053d3c84ffa738"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/65d1916937bd4cdfbe053d3c84ffa738"}]}] Oct 04 21:12:30.502776 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-TestNetworkBasicOps-860566722 Oct 04 21:12:30.502776 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: 65d1916937bd4cdfbe053d3c84ffa738 Oct 04 21:12:30.502776 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-TestNetworkBasicOps-860566722 Oct 04 21:12:30.502776 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-TestNetworkBasicOps-860566722-project Oct 04 21:12:30.502776 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 21:12:30.502776 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 21:12:30.502776 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: 33868e2b8733415cb173ae2da3104e1d Oct 04 21:12:30.502776 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-TestNetworkBasicOps-860566722-project Oct 04 21:12:30.502776 n-d-854823-8 devstack@n-api.service[128802]: method: > Oct 04 21:12:30.502776 n-d-854823-8 devstack@n-api.service[128802]: exception: Instance 307b14f3-2d72-4cb2-ab60-ccb5af659240 could not be found. Oct 04 21:12:30.502776 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'id': '307b14f3-2d72-4cb2-ab60-ccb5af659240'} Oct 04 21:12:30.502776 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:12:30.502776 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:12:30.502776 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:12:30.502776 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:12:30.502776 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:12:30.502776 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:12:30.502776 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:12:30.502776 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:12:30.502776 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:12:30.502776 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:12:30.502776 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 307b14f3-2d72-4cb2-ab60-ccb5af659240 could not be found. Oct 04 21:12:30.502776 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:12:30.502776 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:12:30.502776 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:12:30.502776 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:12:30.502776 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:12:30.502776 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:12:30.502776 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:12:30.502776 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:12:30.502776 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:12:30.502776 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:12:30.502776 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:12:30.502776 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:12:30.502776 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:12:30.502776 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:12:30.502776 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:12:30.502776 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:12:30.502776 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 307b14f3-2d72-4cb2-ab60-ccb5af659240 could not be found. Oct 04 21:12:30.502776 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:12:30.502776 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:12:30.502776 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:12:30.507315 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:12:30.507315 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:12:30.507315 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:12:30.507315 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:12:30.507315 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:12:30.507315 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 307b14f3-2d72-4cb2-ab60-ccb5af659240 could not be found. Oct 04 21:12:30.507315 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:12:30.508692 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-03f6ac89-e539-4398-aafd-fc07390bab3a tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Returning 404 to user: Instance 307b14f3-2d72-4cb2-ab60-ccb5af659240 could not be found. {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:12:30.509757 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-03f6ac89-e539-4398-aafd-fc07390bab3a tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] 10.222.0.33 "GET /compute/v2.1/servers/307b14f3-2d72-4cb2-ab60-ccb5af659240" status: 404 len: 111 microversion: 2.1 time: 0.040473 Oct 04 21:12:30.510448 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2931/5830] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:30 2022] GET /compute/v2.1/servers/307b14f3-2d72-4cb2-ab60-ccb5af659240 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:12:30.749327 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-dcbec09f-0c7d-4fae-9d99-a2d4ca3e4caf tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Calling method '.version_select at 0x7f3c6f518550>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:30.798200 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-dcbec09f-0c7d-4fae-9d99-a2d4ca3e4caf tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1311747638" status: 202 len: 0 microversion: 2.1 time: 0.052569 Oct 04 21:12:30.802728 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2932/5831] 10.222.0.33 () {58 vars in 1257 bytes} [Tue Oct 4 21:12:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1311747638 => generated 0 bytes in 55 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:12:30.805728 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-8436f35e-5a3e-4982-9dff-e1e1266b403a tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:30.806533 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-8436f35e-5a3e-4982-9dff-e1e1266b403a tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] [instance: c7262313-6b85-476f-a1ca-79d04fcf5740] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:30.813880 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8436f35e-5a3e-4982-9dff-e1e1266b403a tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:30.815270 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8436f35e-5a3e-4982-9dff-e1e1266b403a tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:30.815734 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8436f35e-5a3e-4982-9dff-e1e1266b403a tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:30.816528 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8436f35e-5a3e-4982-9dff-e1e1266b403a tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:30.817161 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8436f35e-5a3e-4982-9dff-e1e1266b403a tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:30.817677 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8436f35e-5a3e-4982-9dff-e1e1266b403a tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:30.868857 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-28b1618b-ed98-4a9e-90ce-ba50bfc373f7 tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] 10.222.0.33 "POST /compute/v2.1/servers/a1b4f7d9-d569-445d-b4a7-40b0d07c4a58/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.521661 Oct 04 21:12:30.869861 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2900/5832] 10.222.0.33 () {60 vars in 1323 bytes} [Tue Oct 4 21:12:30 2022] POST /compute/v2.1/servers/a1b4f7d9-d569-445d-b4a7-40b0d07c4a58/os-volume_attachments => generated 194 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:12:31.064980 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-8436f35e-5a3e-4982-9dff-e1e1266b403a tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b627e66ccd94b8faabf8ce9f1d2d2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40732638975044868e5a5eb5f4235244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:31.073743 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-8436f35e-5a3e-4982-9dff-e1e1266b403a tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] 10.222.0.33 "GET /compute/v2.1/servers/c7262313-6b85-476f-a1ca-79d04fcf5740" status: 200 len: 1666 microversion: 2.1 time: 0.272395 Oct 04 21:12:31.074216 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2933/5833] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:30 2022] GET /compute/v2.1/servers/c7262313-6b85-476f-a1ca-79d04fcf5740 => generated 1666 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:12:43.141530 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0d2060d9-695a-49c7-8cd7-c896283ed488 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Action: 'create', calling method: .version_select at 0x7f3c74303b80>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1817751442", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBMXgMO1lwBqGpZZPYU4R4/rvZXQLLt8NmIF1FgNe2SPYiqvWDSkuqcMilvXaQlsBCJJPct58k4Sz2VqGe6GTj3NfwtAauESN6VZ4JzN363zbo+1OdzBmyg7F8wKwwVtZQ=="}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:12:43.160953 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:12:43.161720 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:UPDATE=3,nova_cell1:SELECT=33,nova_cell1:INSERT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:12:43.202189 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-0d2060d9-695a-49c7-8cd7-c896283ed488 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Getting quotas for project 65d1916937bd4cdfbe053d3c84ffa738. Resources: {'key_pairs'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:12:43.215216 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-0d2060d9-695a-49c7-8cd7-c896283ed488 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Getting quotas for user 33868e2b8733415cb173ae2da3104e1d and project 65d1916937bd4cdfbe053d3c84ffa738. Resources: {'key_pairs'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:12:43.254488 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-0d2060d9-695a-49c7-8cd7-c896283ed488 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.119386 Oct 04 21:12:43.255115 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2901/5834] 10.222.0.33 () {60 vars in 1159 bytes} [Tue Oct 4 21:12:43 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:12:45.316342 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-60c87933-86b3-444b-8a9f-8da5838ed99c tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1510618492", "imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63", "flavorRef": "452", "networks": [{"uuid": "cd11a5ab-a603-4264-9321-04c052613c2d"}], "key_name": "tempest-TestNetworkBasicOps-1817751442", "security_groups": [{"name": "tempest-secgroup-smoke-379484232"}]}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:12:45.384117 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_api:SELECT=8,nova_api:DELETE=1 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:12:45.384849 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=37 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:12:45.546985 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.network.neutron [None req-60c87933-86b3-444b-8a9f-8da5838ed99c tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] validate_networks() for [('cd11a5ab-a603-4264-9321-04c052613c2d', None, None, None, None, None)] {{(pid=128802) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:12:46.230248 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-60c87933-86b3-444b-8a9f-8da5838ed99c tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Flavor limits 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:12:46.230835 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-60c87933-86b3-444b-8a9f-8da5838ed99c tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Image limits 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:12:46.231569 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-60c87933-86b3-444b-8a9f-8da5838ed99c tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Flavor pref 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:12:46.231991 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-60c87933-86b3-444b-8a9f-8da5838ed99c tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Image pref 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:12:46.232413 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-60c87933-86b3-444b-8a9f-8da5838ed99c tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:12:46.252099 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-60c87933-86b3-444b-8a9f-8da5838ed99c tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:46.252930 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-60c87933-86b3-444b-8a9f-8da5838ed99c tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:46.254952 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-60c87933-86b3-444b-8a9f-8da5838ed99c tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:46.255749 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-60c87933-86b3-444b-8a9f-8da5838ed99c tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:46.258831 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-60c87933-86b3-444b-8a9f-8da5838ed99c tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:46.259279 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-60c87933-86b3-444b-8a9f-8da5838ed99c tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:46.289034 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-60c87933-86b3-444b-8a9f-8da5838ed99c tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Getting quotas for project 65d1916937bd4cdfbe053d3c84ffa738. Resources: {'ram', 'instances', 'cores'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:12:46.294982 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-60c87933-86b3-444b-8a9f-8da5838ed99c tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Getting quotas for user 33868e2b8733415cb173ae2da3104e1d and project 65d1916937bd4cdfbe053d3c84ffa738. Resources: {'ram', 'instances', 'cores'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:12:46.309874 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-60c87933-86b3-444b-8a9f-8da5838ed99c tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Going to run 1 instances... {{(pid=128802) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:12:46.312564 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-60c87933-86b3-444b-8a9f-8da5838ed99c tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] [instance: d5d53aea-3534-49f6-bb2c-b0f67bfd5abf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='15b24725-0c99-4bcf-b1fb-907cdf8e2d63',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128802) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:12:46.396508 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-60c87933-86b3-444b-8a9f-8da5838ed99c tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.084576 Oct 04 21:12:46.399403 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2934/5835] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 21:12:45 2022] POST /compute/v2.1/servers => generated 405 bytes in 1088 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:12:46.419222 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7a338922-090c-4586-93b6-6eeb3d786988 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:46.423242 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-7a338922-090c-4586-93b6-6eeb3d786988 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] [instance: d5d53aea-3534-49f6-bb2c-b0f67bfd5abf] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:46.538273 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-7a338922-090c-4586-93b6-6eeb3d786988 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33868e2b8733415cb173ae2da3104e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d1916937bd4cdfbe053d3c84ffa738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:46.548863 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-7a338922-090c-4586-93b6-6eeb3d786988 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] 10.222.0.33 "GET /compute/v2.1/servers/d5d53aea-3534-49f6-bb2c-b0f67bfd5abf" status: 200 len: 1249 microversion: 2.1 time: 0.142710 Oct 04 21:12:46.563775 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2902/5836] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:46 2022] GET /compute/v2.1/servers/d5d53aea-3534-49f6-bb2c-b0f67bfd5abf => generated 1249 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:12:47.581377 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-629bf515-949f-48a2-a8ec-b5626bb07904 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:47.583021 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-629bf515-949f-48a2-a8ec-b5626bb07904 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] [instance: d5d53aea-3534-49f6-bb2c-b0f67bfd5abf] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:47.593117 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-629bf515-949f-48a2-a8ec-b5626bb07904 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:47.593816 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-629bf515-949f-48a2-a8ec-b5626bb07904 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:47.594947 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-629bf515-949f-48a2-a8ec-b5626bb07904 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:47.595955 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-629bf515-949f-48a2-a8ec-b5626bb07904 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:47.596650 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-629bf515-949f-48a2-a8ec-b5626bb07904 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:47.597574 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-629bf515-949f-48a2-a8ec-b5626bb07904 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:47.699718 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-629bf515-949f-48a2-a8ec-b5626bb07904 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33868e2b8733415cb173ae2da3104e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d1916937bd4cdfbe053d3c84ffa738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:47.723783 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-629bf515-949f-48a2-a8ec-b5626bb07904 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] 10.222.0.33 "GET /compute/v2.1/servers/d5d53aea-3534-49f6-bb2c-b0f67bfd5abf" status: 200 len: 1301 microversion: 2.1 time: 0.149176 Oct 04 21:12:47.724298 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2935/5837] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:47 2022] GET /compute/v2.1/servers/d5d53aea-3534-49f6-bb2c-b0f67bfd5abf => generated 1301 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:12:48.749272 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a5e9fa8b-2975-43ea-ba36-adefaedaf2c1 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:48.749884 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a5e9fa8b-2975-43ea-ba36-adefaedaf2c1 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] [instance: d5d53aea-3534-49f6-bb2c-b0f67bfd5abf] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:48.759195 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a5e9fa8b-2975-43ea-ba36-adefaedaf2c1 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:48.759614 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a5e9fa8b-2975-43ea-ba36-adefaedaf2c1 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:48.760052 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a5e9fa8b-2975-43ea-ba36-adefaedaf2c1 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:48.760759 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a5e9fa8b-2975-43ea-ba36-adefaedaf2c1 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:48.761214 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a5e9fa8b-2975-43ea-ba36-adefaedaf2c1 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:48.761639 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a5e9fa8b-2975-43ea-ba36-adefaedaf2c1 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:48.876128 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-a5e9fa8b-2975-43ea-ba36-adefaedaf2c1 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33868e2b8733415cb173ae2da3104e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d1916937bd4cdfbe053d3c84ffa738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:48.885873 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a5e9fa8b-2975-43ea-ba36-adefaedaf2c1 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] 10.222.0.33 "GET /compute/v2.1/servers/d5d53aea-3534-49f6-bb2c-b0f67bfd5abf" status: 200 len: 1307 microversion: 2.1 time: 0.140602 Oct 04 21:12:48.895697 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2903/5838] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:48 2022] GET /compute/v2.1/servers/d5d53aea-3534-49f6-bb2c-b0f67bfd5abf => generated 1307 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:12:49.920750 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-94a76416-08ae-4d21-8e88-63b6641f3cec tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:49.921357 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-94a76416-08ae-4d21-8e88-63b6641f3cec tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] [instance: d5d53aea-3534-49f6-bb2c-b0f67bfd5abf] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:49.934248 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-94a76416-08ae-4d21-8e88-63b6641f3cec tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:49.934985 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-94a76416-08ae-4d21-8e88-63b6641f3cec tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:49.935568 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-94a76416-08ae-4d21-8e88-63b6641f3cec tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:49.936450 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-94a76416-08ae-4d21-8e88-63b6641f3cec tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:49.947180 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-94a76416-08ae-4d21-8e88-63b6641f3cec tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:49.947626 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-94a76416-08ae-4d21-8e88-63b6641f3cec tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:50.266157 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-94a76416-08ae-4d21-8e88-63b6641f3cec tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33868e2b8733415cb173ae2da3104e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d1916937bd4cdfbe053d3c84ffa738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:50.352877 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-94a76416-08ae-4d21-8e88-63b6641f3cec tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] 10.222.0.33 "GET /compute/v2.1/servers/d5d53aea-3534-49f6-bb2c-b0f67bfd5abf" status: 200 len: 1374 microversion: 2.1 time: 0.430162 Oct 04 21:12:50.373841 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2936/5839] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:49 2022] GET /compute/v2.1/servers/d5d53aea-3534-49f6-bb2c-b0f67bfd5abf => generated 1374 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:12:50.839542 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-5676892f-ccb5-44fb-8460-1971b9fee922 req-cb3ff615-957e-486d-874a-e9c65fac937a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5d53aea-3534-49f6-bb2c-b0f67bfd5abf", "tag": "d0209023-c5dd-4b1b-b5ec-f60a23eda3a0"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:12:50.873565 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-5676892f-ccb5-44fb-8460-1971b9fee922 req-cb3ff615-957e-486d-874a-e9c65fac937a service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:50.874491 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-5676892f-ccb5-44fb-8460-1971b9fee922 req-cb3ff615-957e-486d-874a-e9c65fac937a service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:50.874989 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-5676892f-ccb5-44fb-8460-1971b9fee922 req-cb3ff615-957e-486d-874a-e9c65fac937a service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:50.889623 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-5676892f-ccb5-44fb-8460-1971b9fee922 req-cb3ff615-957e-486d-874a-e9c65fac937a service nova] Creating event network-changed:d0209023-c5dd-4b1b-b5ec-f60a23eda3a0 for instance d5d53aea-3534-49f6-bb2c-b0f67bfd5abf on n-h1-854823-8 Oct 04 21:12:50.920212 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-5676892f-ccb5-44fb-8460-1971b9fee922 req-cb3ff615-957e-486d-874a-e9c65fac937a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097395 Oct 04 21:12:50.921170 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2904/5840] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:12:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:12:51.386987 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-32a13352-e2c7-4fc1-85e1-f3a477e54fcc tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:51.387729 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-32a13352-e2c7-4fc1-85e1-f3a477e54fcc tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] [instance: d5d53aea-3534-49f6-bb2c-b0f67bfd5abf] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:51.397851 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-32a13352-e2c7-4fc1-85e1-f3a477e54fcc tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:51.398444 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-32a13352-e2c7-4fc1-85e1-f3a477e54fcc tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:51.399143 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-32a13352-e2c7-4fc1-85e1-f3a477e54fcc tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:51.400171 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-32a13352-e2c7-4fc1-85e1-f3a477e54fcc tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:51.400767 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-32a13352-e2c7-4fc1-85e1-f3a477e54fcc tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:51.401293 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-32a13352-e2c7-4fc1-85e1-f3a477e54fcc tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:51.605914 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-32a13352-e2c7-4fc1-85e1-f3a477e54fcc tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33868e2b8733415cb173ae2da3104e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d1916937bd4cdfbe053d3c84ffa738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:51.615589 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-32a13352-e2c7-4fc1-85e1-f3a477e54fcc tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] 10.222.0.33 "GET /compute/v2.1/servers/d5d53aea-3534-49f6-bb2c-b0f67bfd5abf" status: 200 len: 1374 microversion: 2.1 time: 0.232385 Oct 04 21:12:51.621664 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2937/5841] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:51 2022] GET /compute/v2.1/servers/d5d53aea-3534-49f6-bb2c-b0f67bfd5abf => generated 1374 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:12:52.644252 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1001a618-d5e7-4634-a2f2-3d700393d02a tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:52.644975 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-1001a618-d5e7-4634-a2f2-3d700393d02a tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] [instance: d5d53aea-3534-49f6-bb2c-b0f67bfd5abf] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:52.659427 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1001a618-d5e7-4634-a2f2-3d700393d02a tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:52.660023 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1001a618-d5e7-4634-a2f2-3d700393d02a tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:52.660546 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1001a618-d5e7-4634-a2f2-3d700393d02a tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:52.661293 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1001a618-d5e7-4634-a2f2-3d700393d02a tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:52.662919 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1001a618-d5e7-4634-a2f2-3d700393d02a tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:52.663603 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1001a618-d5e7-4634-a2f2-3d700393d02a tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:53.557173 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-1001a618-d5e7-4634-a2f2-3d700393d02a tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33868e2b8733415cb173ae2da3104e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d1916937bd4cdfbe053d3c84ffa738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:53.567589 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-1001a618-d5e7-4634-a2f2-3d700393d02a tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] 10.222.0.33 "GET /compute/v2.1/servers/d5d53aea-3534-49f6-bb2c-b0f67bfd5abf" status: 200 len: 1374 microversion: 2.1 time: 0.930180 Oct 04 21:12:53.568662 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2905/5842] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:52 2022] GET /compute/v2.1/servers/d5d53aea-3534-49f6-bb2c-b0f67bfd5abf => generated 1374 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:12:54.591990 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-3292360d-49d1-42ac-ace7-fb5f519d80a0 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:54.592705 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-3292360d-49d1-42ac-ace7-fb5f519d80a0 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] [instance: d5d53aea-3534-49f6-bb2c-b0f67bfd5abf] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:54.600184 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3292360d-49d1-42ac-ace7-fb5f519d80a0 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:54.600745 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3292360d-49d1-42ac-ace7-fb5f519d80a0 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:54.601253 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3292360d-49d1-42ac-ace7-fb5f519d80a0 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:54.602023 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3292360d-49d1-42ac-ace7-fb5f519d80a0 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:54.602579 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3292360d-49d1-42ac-ace7-fb5f519d80a0 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:54.603075 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3292360d-49d1-42ac-ace7-fb5f519d80a0 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:54.758701 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-3292360d-49d1-42ac-ace7-fb5f519d80a0 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33868e2b8733415cb173ae2da3104e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d1916937bd4cdfbe053d3c84ffa738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:54.767893 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-3292360d-49d1-42ac-ace7-fb5f519d80a0 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] 10.222.0.33 "GET /compute/v2.1/servers/d5d53aea-3534-49f6-bb2c-b0f67bfd5abf" status: 200 len: 1374 microversion: 2.1 time: 0.179139 Oct 04 21:12:54.769035 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2938/5843] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:54 2022] GET /compute/v2.1/servers/d5d53aea-3534-49f6-bb2c-b0f67bfd5abf => generated 1374 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:12:55.793143 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6fa603c2-2e85-4c81-8b70-0f2a2718c703 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:55.793661 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-6fa603c2-2e85-4c81-8b70-0f2a2718c703 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] [instance: d5d53aea-3534-49f6-bb2c-b0f67bfd5abf] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:55.801371 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6fa603c2-2e85-4c81-8b70-0f2a2718c703 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:55.801928 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6fa603c2-2e85-4c81-8b70-0f2a2718c703 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:55.802292 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6fa603c2-2e85-4c81-8b70-0f2a2718c703 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:55.803272 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6fa603c2-2e85-4c81-8b70-0f2a2718c703 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:55.803727 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6fa603c2-2e85-4c81-8b70-0f2a2718c703 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:55.804284 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6fa603c2-2e85-4c81-8b70-0f2a2718c703 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:55.820263 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-0e51a3e1-7c17-400d-83c4-0ccc8adec93f req-ac01b3aa-4ef4-4423-b5e2-f7c23a09b360 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5d53aea-3534-49f6-bb2c-b0f67bfd5abf", "name": "network-vif-plugged", "status": "completed", "tag": "d0209023-c5dd-4b1b-b5ec-f60a23eda3a0"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:12:55.835924 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-0e51a3e1-7c17-400d-83c4-0ccc8adec93f req-ac01b3aa-4ef4-4423-b5e2-f7c23a09b360 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:55.836521 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-0e51a3e1-7c17-400d-83c4-0ccc8adec93f req-ac01b3aa-4ef4-4423-b5e2-f7c23a09b360 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:55.837224 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-0e51a3e1-7c17-400d-83c4-0ccc8adec93f req-ac01b3aa-4ef4-4423-b5e2-f7c23a09b360 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:55.850033 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-0e51a3e1-7c17-400d-83c4-0ccc8adec93f req-ac01b3aa-4ef4-4423-b5e2-f7c23a09b360 service nova] Creating event network-vif-plugged:d0209023-c5dd-4b1b-b5ec-f60a23eda3a0 for instance d5d53aea-3534-49f6-bb2c-b0f67bfd5abf on n-h1-854823-8 Oct 04 21:12:55.856400 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-0e51a3e1-7c17-400d-83c4-0ccc8adec93f req-ac01b3aa-4ef4-4423-b5e2-f7c23a09b360 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040736 Oct 04 21:12:55.857846 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2939/5844] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:12:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:12:56.050963 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-6fa603c2-2e85-4c81-8b70-0f2a2718c703 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33868e2b8733415cb173ae2da3104e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d1916937bd4cdfbe053d3c84ffa738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:56.062004 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-6fa603c2-2e85-4c81-8b70-0f2a2718c703 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] 10.222.0.33 "GET /compute/v2.1/servers/d5d53aea-3534-49f6-bb2c-b0f67bfd5abf" status: 200 len: 1374 microversion: 2.1 time: 0.271756 Oct 04 21:12:56.063115 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2906/5845] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:55 2022] GET /compute/v2.1/servers/d5d53aea-3534-49f6-bb2c-b0f67bfd5abf => generated 1374 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:12:57.087369 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-62f5779d-f84c-4c4b-8494-01323c58c0ea tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:57.088688 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-62f5779d-f84c-4c4b-8494-01323c58c0ea tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] [instance: d5d53aea-3534-49f6-bb2c-b0f67bfd5abf] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:57.090753 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell0:SELECT=2 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:12:57.091599 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell0:SELECT=6 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:12:57.099611 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-62f5779d-f84c-4c4b-8494-01323c58c0ea tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:57.100061 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-62f5779d-f84c-4c4b-8494-01323c58c0ea tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:57.100499 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-62f5779d-f84c-4c4b-8494-01323c58c0ea tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:57.101250 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-62f5779d-f84c-4c4b-8494-01323c58c0ea tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:57.101749 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-62f5779d-f84c-4c4b-8494-01323c58c0ea tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:57.102173 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-62f5779d-f84c-4c4b-8494-01323c58c0ea tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:57.251433 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-62f5779d-f84c-4c4b-8494-01323c58c0ea tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33868e2b8733415cb173ae2da3104e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d1916937bd4cdfbe053d3c84ffa738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:57.261365 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-62f5779d-f84c-4c4b-8494-01323c58c0ea tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] 10.222.0.33 "GET /compute/v2.1/servers/d5d53aea-3534-49f6-bb2c-b0f67bfd5abf" status: 200 len: 1374 microversion: 2.1 time: 0.178897 Oct 04 21:12:57.284986 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2940/5846] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:57 2022] GET /compute/v2.1/servers/d5d53aea-3534-49f6-bb2c-b0f67bfd5abf => generated 1374 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:12:58.184883 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5eda6038-db3e-4b81-9649-0e0a44041b4d tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:58.185420 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-5eda6038-db3e-4b81-9649-0e0a44041b4d tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] [instance: a1b4f7d9-d569-445d-b4a7-40b0d07c4a58] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:58.187395 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=6 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:12:58.193851 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5eda6038-db3e-4b81-9649-0e0a44041b4d tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:58.194394 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5eda6038-db3e-4b81-9649-0e0a44041b4d tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:58.194832 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5eda6038-db3e-4b81-9649-0e0a44041b4d tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:58.195534 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5eda6038-db3e-4b81-9649-0e0a44041b4d tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:58.195982 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5eda6038-db3e-4b81-9649-0e0a44041b4d tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:58.196659 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5eda6038-db3e-4b81-9649-0e0a44041b4d tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:58.285121 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-5eda6038-db3e-4b81-9649-0e0a44041b4d tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Lazy-loading 'services' on Instance uuid a1b4f7d9-d569-445d-b4a7-40b0d07c4a58 {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:12:58.288229 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-65a430d5-34b5-474b-ac04-34b51b5e6d16 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:58.288843 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-65a430d5-34b5-474b-ac04-34b51b5e6d16 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] [instance: d5d53aea-3534-49f6-bb2c-b0f67bfd5abf] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:58.295490 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-65a430d5-34b5-474b-ac04-34b51b5e6d16 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:58.296203 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-65a430d5-34b5-474b-ac04-34b51b5e6d16 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:58.296645 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-65a430d5-34b5-474b-ac04-34b51b5e6d16 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:58.297437 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-65a430d5-34b5-474b-ac04-34b51b5e6d16 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:58.297800 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-65a430d5-34b5-474b-ac04-34b51b5e6d16 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:58.298955 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-65a430d5-34b5-474b-ac04-34b51b5e6d16 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:58.369648 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5eda6038-db3e-4b81-9649-0e0a44041b4d tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] 10.222.0.33 "DELETE /compute/v2.1/servers/a1b4f7d9-d569-445d-b4a7-40b0d07c4a58/os-volume_attachments/67cf0f07-0cd0-4d10-b5e3-259d42a83364" status: 202 len: 0 microversion: 2.1 time: 0.188933 Oct 04 21:12:58.370541 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2907/5847] 10.222.0.33 () {58 vars in 1416 bytes} [Tue Oct 4 21:12:58 2022] DELETE /compute/v2.1/servers/a1b4f7d9-d569-445d-b4a7-40b0d07c4a58/os-volume_attachments/67cf0f07-0cd0-4d10-b5e3-259d42a83364 => generated 0 bytes in 191 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:12:58.471043 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-65a430d5-34b5-474b-ac04-34b51b5e6d16 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33868e2b8733415cb173ae2da3104e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d1916937bd4cdfbe053d3c84ffa738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:58.479384 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-65a430d5-34b5-474b-ac04-34b51b5e6d16 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] 10.222.0.33 "GET /compute/v2.1/servers/d5d53aea-3534-49f6-bb2c-b0f67bfd5abf" status: 200 len: 1546 microversion: 2.1 time: 0.196828 Oct 04 21:12:58.480137 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2941/5848] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:58 2022] GET /compute/v2.1/servers/d5d53aea-3534-49f6-bb2c-b0f67bfd5abf => generated 1546 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:12:58.504639 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-95c6f8a4-26a3-498f-a22b-a6bc27c011f5 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:12:58.505284 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-95c6f8a4-26a3-498f-a22b-a6bc27c011f5 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] [instance: d5d53aea-3534-49f6-bb2c-b0f67bfd5abf] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:12:58.511696 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-95c6f8a4-26a3-498f-a22b-a6bc27c011f5 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:58.512843 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-95c6f8a4-26a3-498f-a22b-a6bc27c011f5 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:58.513286 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-95c6f8a4-26a3-498f-a22b-a6bc27c011f5 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:58.514178 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-95c6f8a4-26a3-498f-a22b-a6bc27c011f5 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:12:58.514655 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-95c6f8a4-26a3-498f-a22b-a6bc27c011f5 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:12:58.515089 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-95c6f8a4-26a3-498f-a22b-a6bc27c011f5 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:12:58.675972 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-95c6f8a4-26a3-498f-a22b-a6bc27c011f5 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33868e2b8733415cb173ae2da3104e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d1916937bd4cdfbe053d3c84ffa738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:12:58.684224 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-95c6f8a4-26a3-498f-a22b-a6bc27c011f5 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] 10.222.0.33 "GET /compute/v2.1/servers/d5d53aea-3534-49f6-bb2c-b0f67bfd5abf" status: 200 len: 1546 microversion: 2.1 time: 0.185031 Oct 04 21:12:58.684811 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2908/5849] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:12:58 2022] GET /compute/v2.1/servers/d5d53aea-3534-49f6-bb2c-b0f67bfd5abf => generated 1546 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:13:01.040696 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-ab51d103-3aaa-45a9-9171-19cc5836262d req-54ad6877-2e7a-4134-a4c3-fba960a5bc15 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5d53aea-3534-49f6-bb2c-b0f67bfd5abf", "tag": "d0209023-c5dd-4b1b-b5ec-f60a23eda3a0"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:13:01.070296 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-ab51d103-3aaa-45a9-9171-19cc5836262d req-54ad6877-2e7a-4134-a4c3-fba960a5bc15 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:01.070929 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-ab51d103-3aaa-45a9-9171-19cc5836262d req-54ad6877-2e7a-4134-a4c3-fba960a5bc15 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:01.071689 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-ab51d103-3aaa-45a9-9171-19cc5836262d req-54ad6877-2e7a-4134-a4c3-fba960a5bc15 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:01.088485 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-ab51d103-3aaa-45a9-9171-19cc5836262d req-54ad6877-2e7a-4134-a4c3-fba960a5bc15 service nova] Creating event network-changed:d0209023-c5dd-4b1b-b5ec-f60a23eda3a0 for instance d5d53aea-3534-49f6-bb2c-b0f67bfd5abf on n-h1-854823-8 Oct 04 21:13:01.095707 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-ab51d103-3aaa-45a9-9171-19cc5836262d req-54ad6877-2e7a-4134-a4c3-fba960a5bc15 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060356 Oct 04 21:13:01.096930 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2942/5850] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:13:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:13:03.606467 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-46e01164-708e-4bd3-bfd5-29cb6d393460 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:03.608805 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-46e01164-708e-4bd3-bfd5-29cb6d393460 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] [instance: c7262313-6b85-476f-a1ca-79d04fcf5740] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:03.615871 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-46e01164-708e-4bd3-bfd5-29cb6d393460 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:03.616371 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-46e01164-708e-4bd3-bfd5-29cb6d393460 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:03.616808 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-46e01164-708e-4bd3-bfd5-29cb6d393460 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:03.617513 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-46e01164-708e-4bd3-bfd5-29cb6d393460 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:03.618007 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-46e01164-708e-4bd3-bfd5-29cb6d393460 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:03.618471 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-46e01164-708e-4bd3-bfd5-29cb6d393460 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:03.649377 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-46e01164-708e-4bd3-bfd5-29cb6d393460 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] 10.222.0.33 "GET /compute/v2.1/servers/c7262313-6b85-476f-a1ca-79d04fcf5740/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046856 Oct 04 21:13:03.649956 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2909/5851] 10.222.0.33 () {58 vars in 1302 bytes} [Tue Oct 4 21:13:03 2022] GET /compute/v2.1/servers/c7262313-6b85-476f-a1ca-79d04fcf5740/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 21:13:03.717644 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-7fb28ce3-5256-4011-b890-cfdc671945bb tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:03.718222 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-7fb28ce3-5256-4011-b890-cfdc671945bb tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] [instance: c7262313-6b85-476f-a1ca-79d04fcf5740] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:03.725150 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7fb28ce3-5256-4011-b890-cfdc671945bb tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:03.725633 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7fb28ce3-5256-4011-b890-cfdc671945bb tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:03.726127 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7fb28ce3-5256-4011-b890-cfdc671945bb tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:03.727095 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7fb28ce3-5256-4011-b890-cfdc671945bb tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:03.727546 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7fb28ce3-5256-4011-b890-cfdc671945bb tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:03.727968 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7fb28ce3-5256-4011-b890-cfdc671945bb tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:03.753820 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-7fb28ce3-5256-4011-b890-cfdc671945bb tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] [instance: c7262313-6b85-476f-a1ca-79d04fcf5740] Going to try to terminate instance {{(pid=128802) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:13:03.850651 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-236b97a4-54ad-4f81-8a09-49da3370a3cd tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:03.851197 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-236b97a4-54ad-4f81-8a09-49da3370a3cd tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] [instance: a1b4f7d9-d569-445d-b4a7-40b0d07c4a58] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:03.853591 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-7fb28ce3-5256-4011-b890-cfdc671945bb tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] 10.222.0.33 "DELETE /compute/v2.1/servers/c7262313-6b85-476f-a1ca-79d04fcf5740" status: 204 len: 0 microversion: 2.1 time: 0.140683 Oct 04 21:13:03.857447 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-236b97a4-54ad-4f81-8a09-49da3370a3cd tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:03.857950 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-236b97a4-54ad-4f81-8a09-49da3370a3cd tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:03.858089 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2943/5852] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 21:13:03 2022] DELETE /compute/v2.1/servers/c7262313-6b85-476f-a1ca-79d04fcf5740 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:13:03.858403 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-236b97a4-54ad-4f81-8a09-49da3370a3cd tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:03.859113 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-236b97a4-54ad-4f81-8a09-49da3370a3cd tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:03.859573 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-236b97a4-54ad-4f81-8a09-49da3370a3cd tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:03.859997 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-236b97a4-54ad-4f81-8a09-49da3370a3cd tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:03.864397 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-c31eb322-4d9f-4f3c-a2af-d05a2fda27b6 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:03.865119 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-c31eb322-4d9f-4f3c-a2af-d05a2fda27b6 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] [instance: c7262313-6b85-476f-a1ca-79d04fcf5740] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:03.871656 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c31eb322-4d9f-4f3c-a2af-d05a2fda27b6 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:03.872200 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c31eb322-4d9f-4f3c-a2af-d05a2fda27b6 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:03.872643 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c31eb322-4d9f-4f3c-a2af-d05a2fda27b6 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:03.873346 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c31eb322-4d9f-4f3c-a2af-d05a2fda27b6 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:03.873795 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c31eb322-4d9f-4f3c-a2af-d05a2fda27b6 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:03.874222 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c31eb322-4d9f-4f3c-a2af-d05a2fda27b6 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:03.888147 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-236b97a4-54ad-4f81-8a09-49da3370a3cd tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] [instance: a1b4f7d9-d569-445d-b4a7-40b0d07c4a58] Going to try to terminate instance {{(pid=128801) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:13:03.975542 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-236b97a4-54ad-4f81-8a09-49da3370a3cd tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] 10.222.0.33 "DELETE /compute/v2.1/servers/a1b4f7d9-d569-445d-b4a7-40b0d07c4a58" status: 204 len: 0 microversion: 2.1 time: 0.129899 Oct 04 21:13:03.976550 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2910/5853] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 21:13:03 2022] DELETE /compute/v2.1/servers/a1b4f7d9-d569-445d-b4a7-40b0d07c4a58 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 21:13:03.985137 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d43de690-1b0a-4bcc-b759-1c68748c4603 tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:03.986987 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d43de690-1b0a-4bcc-b759-1c68748c4603 tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] [instance: a1b4f7d9-d569-445d-b4a7-40b0d07c4a58] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:03.992980 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d43de690-1b0a-4bcc-b759-1c68748c4603 tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:03.993471 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d43de690-1b0a-4bcc-b759-1c68748c4603 tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:03.993909 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d43de690-1b0a-4bcc-b759-1c68748c4603 tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:03.994849 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d43de690-1b0a-4bcc-b759-1c68748c4603 tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:03.995112 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d43de690-1b0a-4bcc-b759-1c68748c4603 tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:03.995535 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d43de690-1b0a-4bcc-b759-1c68748c4603 tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:04.032274 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-c31eb322-4d9f-4f3c-a2af-d05a2fda27b6 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b627e66ccd94b8faabf8ce9f1d2d2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40732638975044868e5a5eb5f4235244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:04.040992 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-c31eb322-4d9f-4f3c-a2af-d05a2fda27b6 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] 10.222.0.33 "GET /compute/v2.1/servers/c7262313-6b85-476f-a1ca-79d04fcf5740" status: 200 len: 1672 microversion: 2.1 time: 0.181508 Oct 04 21:13:04.041780 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2944/5854] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:13:03 2022] GET /compute/v2.1/servers/c7262313-6b85-476f-a1ca-79d04fcf5740 => generated 1672 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:13:04.140602 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d43de690-1b0a-4bcc-b759-1c68748c4603 tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c6bb3c59be4ec39f2ac6053ce86ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed76078f10cd470285d48d4542eba0d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:04.150264 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d43de690-1b0a-4bcc-b759-1c68748c4603 tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] 10.222.0.33 "GET /compute/v2.1/servers/a1b4f7d9-d569-445d-b4a7-40b0d07c4a58" status: 200 len: 1514 microversion: 2.1 time: 0.169410 Oct 04 21:13:04.151018 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2911/5855] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:13:03 2022] GET /compute/v2.1/servers/a1b4f7d9-d569-445d-b4a7-40b0d07c4a58 => generated 1514 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:13:05.065849 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-3504df0a-aa2b-45c4-bd0b-c31c6e512ca4 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:05.066410 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-3504df0a-aa2b-45c4-bd0b-c31c6e512ca4 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] [instance: c7262313-6b85-476f-a1ca-79d04fcf5740] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:05.073651 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3504df0a-aa2b-45c4-bd0b-c31c6e512ca4 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:05.074131 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3504df0a-aa2b-45c4-bd0b-c31c6e512ca4 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:05.074619 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3504df0a-aa2b-45c4-bd0b-c31c6e512ca4 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:05.075315 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3504df0a-aa2b-45c4-bd0b-c31c6e512ca4 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:05.075761 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3504df0a-aa2b-45c4-bd0b-c31c6e512ca4 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:05.076180 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3504df0a-aa2b-45c4-bd0b-c31c6e512ca4 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:05.176169 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d26ec54a-5b39-4e53-a60a-36a5c72d332b tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:05.176889 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d26ec54a-5b39-4e53-a60a-36a5c72d332b tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] [instance: a1b4f7d9-d569-445d-b4a7-40b0d07c4a58] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:05.184855 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d26ec54a-5b39-4e53-a60a-36a5c72d332b tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:05.185435 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d26ec54a-5b39-4e53-a60a-36a5c72d332b tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:05.185948 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d26ec54a-5b39-4e53-a60a-36a5c72d332b tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:05.186759 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d26ec54a-5b39-4e53-a60a-36a5c72d332b tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:05.187287 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d26ec54a-5b39-4e53-a60a-36a5c72d332b tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:05.188224 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d26ec54a-5b39-4e53-a60a-36a5c72d332b tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:05.218630 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-3504df0a-aa2b-45c4-bd0b-c31c6e512ca4 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b627e66ccd94b8faabf8ce9f1d2d2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40732638975044868e5a5eb5f4235244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:05.227849 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-3504df0a-aa2b-45c4-bd0b-c31c6e512ca4 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] 10.222.0.33 "GET /compute/v2.1/servers/c7262313-6b85-476f-a1ca-79d04fcf5740" status: 200 len: 1672 microversion: 2.1 time: 0.166461 Oct 04 21:13:05.229258 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2945/5856] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:13:05 2022] GET /compute/v2.1/servers/c7262313-6b85-476f-a1ca-79d04fcf5740 => generated 1672 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:13:05.328038 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d26ec54a-5b39-4e53-a60a-36a5c72d332b tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c6bb3c59be4ec39f2ac6053ce86ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed76078f10cd470285d48d4542eba0d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:05.336022 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d26ec54a-5b39-4e53-a60a-36a5c72d332b tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] 10.222.0.33 "GET /compute/v2.1/servers/a1b4f7d9-d569-445d-b4a7-40b0d07c4a58" status: 200 len: 1514 microversion: 2.1 time: 0.164719 Oct 04 21:13:05.336602 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2912/5857] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:13:05 2022] GET /compute/v2.1/servers/a1b4f7d9-d569-445d-b4a7-40b0d07c4a58 => generated 1514 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:13:06.252472 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-e407c9d3-f00f-40bb-8ae2-80f5fe12f3ee tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:06.253068 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-e407c9d3-f00f-40bb-8ae2-80f5fe12f3ee tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] [instance: c7262313-6b85-476f-a1ca-79d04fcf5740] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:06.260288 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e407c9d3-f00f-40bb-8ae2-80f5fe12f3ee tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:06.260766 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e407c9d3-f00f-40bb-8ae2-80f5fe12f3ee tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:06.261199 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e407c9d3-f00f-40bb-8ae2-80f5fe12f3ee tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:06.261922 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e407c9d3-f00f-40bb-8ae2-80f5fe12f3ee tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:06.262391 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e407c9d3-f00f-40bb-8ae2-80f5fe12f3ee tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:06.262813 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e407c9d3-f00f-40bb-8ae2-80f5fe12f3ee tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:06.358942 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-37824cf1-a43f-40a8-af7b-382ceb92ea54 tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:06.359703 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-37824cf1-a43f-40a8-af7b-382ceb92ea54 tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] [instance: a1b4f7d9-d569-445d-b4a7-40b0d07c4a58] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:06.367007 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-37824cf1-a43f-40a8-af7b-382ceb92ea54 tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:06.367592 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-37824cf1-a43f-40a8-af7b-382ceb92ea54 tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:06.368106 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-37824cf1-a43f-40a8-af7b-382ceb92ea54 tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:06.368891 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-37824cf1-a43f-40a8-af7b-382ceb92ea54 tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:06.369358 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-37824cf1-a43f-40a8-af7b-382ceb92ea54 tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:06.369865 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-37824cf1-a43f-40a8-af7b-382ceb92ea54 tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:06.402833 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-e407c9d3-f00f-40bb-8ae2-80f5fe12f3ee tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b627e66ccd94b8faabf8ce9f1d2d2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40732638975044868e5a5eb5f4235244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:06.411491 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-e407c9d3-f00f-40bb-8ae2-80f5fe12f3ee tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] 10.222.0.33 "GET /compute/v2.1/servers/c7262313-6b85-476f-a1ca-79d04fcf5740" status: 200 len: 1672 microversion: 2.1 time: 0.163323 Oct 04 21:13:06.412266 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2946/5858] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:13:06 2022] GET /compute/v2.1/servers/c7262313-6b85-476f-a1ca-79d04fcf5740 => generated 1672 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:13:06.511491 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-37824cf1-a43f-40a8-af7b-382ceb92ea54 tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c6bb3c59be4ec39f2ac6053ce86ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed76078f10cd470285d48d4542eba0d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:06.520696 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-37824cf1-a43f-40a8-af7b-382ceb92ea54 tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] 10.222.0.33 "GET /compute/v2.1/servers/a1b4f7d9-d569-445d-b4a7-40b0d07c4a58" status: 200 len: 1514 microversion: 2.1 time: 0.165652 Oct 04 21:13:06.521297 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2913/5859] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:13:06 2022] GET /compute/v2.1/servers/a1b4f7d9-d569-445d-b4a7-40b0d07c4a58 => generated 1514 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:13:07.435801 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-a47b2080-ddea-4f69-a1b6-aad840298a6d tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:07.436443 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-a47b2080-ddea-4f69-a1b6-aad840298a6d tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] [instance: c7262313-6b85-476f-a1ca-79d04fcf5740] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:07.453989 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a47b2080-ddea-4f69-a1b6-aad840298a6d tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:07.455280 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a47b2080-ddea-4f69-a1b6-aad840298a6d tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:07.455853 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a47b2080-ddea-4f69-a1b6-aad840298a6d tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:07.456577 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a47b2080-ddea-4f69-a1b6-aad840298a6d tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:07.457047 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a47b2080-ddea-4f69-a1b6-aad840298a6d tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:07.457474 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a47b2080-ddea-4f69-a1b6-aad840298a6d tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:07.546143 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-80d42b37-d4f2-4447-9abd-18e5f698431b tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:07.547431 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-80d42b37-d4f2-4447-9abd-18e5f698431b tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] [instance: a1b4f7d9-d569-445d-b4a7-40b0d07c4a58] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:07.556534 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-80d42b37-d4f2-4447-9abd-18e5f698431b tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:07.557310 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-80d42b37-d4f2-4447-9abd-18e5f698431b tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:07.557943 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-80d42b37-d4f2-4447-9abd-18e5f698431b tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:07.559032 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-80d42b37-d4f2-4447-9abd-18e5f698431b tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:07.559690 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-80d42b37-d4f2-4447-9abd-18e5f698431b tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:07.561090 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-80d42b37-d4f2-4447-9abd-18e5f698431b tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:07.763353 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-a47b2080-ddea-4f69-a1b6-aad840298a6d tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b627e66ccd94b8faabf8ce9f1d2d2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40732638975044868e5a5eb5f4235244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:07.774095 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-a47b2080-ddea-4f69-a1b6-aad840298a6d tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] 10.222.0.33 "GET /compute/v2.1/servers/c7262313-6b85-476f-a1ca-79d04fcf5740" status: 200 len: 1672 microversion: 2.1 time: 0.342045 Oct 04 21:13:07.775029 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2947/5860] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:13:07 2022] GET /compute/v2.1/servers/c7262313-6b85-476f-a1ca-79d04fcf5740 => generated 1672 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:13:07.886378 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-31b6c174-de4c-4287-9a10-bc9497f6b487 req-6ab74bfb-6343-4c16-834b-22aa72cb77c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1b4f7d9-d569-445d-b4a7-40b0d07c4a58", "name": "network-vif-deleted", "tag": "19cfdf64-e909-4caa-b848-3ead8d97ae82"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:13:07.898180 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-31b6c174-de4c-4287-9a10-bc9497f6b487 req-6ab74bfb-6343-4c16-834b-22aa72cb77c7 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:07.898937 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-31b6c174-de4c-4287-9a10-bc9497f6b487 req-6ab74bfb-6343-4c16-834b-22aa72cb77c7 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:07.899553 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-31b6c174-de4c-4287-9a10-bc9497f6b487 req-6ab74bfb-6343-4c16-834b-22aa72cb77c7 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:07.915417 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-31b6c174-de4c-4287-9a10-bc9497f6b487 req-6ab74bfb-6343-4c16-834b-22aa72cb77c7 service nova] Creating event network-vif-deleted:19cfdf64-e909-4caa-b848-3ead8d97ae82 for instance a1b4f7d9-d569-445d-b4a7-40b0d07c4a58 on n-h2-854823-8 Oct 04 21:13:07.922844 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-80d42b37-d4f2-4447-9abd-18e5f698431b tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c6bb3c59be4ec39f2ac6053ce86ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed76078f10cd470285d48d4542eba0d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:07.927054 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-31b6c174-de4c-4287-9a10-bc9497f6b487 req-6ab74bfb-6343-4c16-834b-22aa72cb77c7 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044306 Oct 04 21:13:07.927703 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2948/5861] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:13:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:13:07.937166 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-80d42b37-d4f2-4447-9abd-18e5f698431b tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] 10.222.0.33 "GET /compute/v2.1/servers/a1b4f7d9-d569-445d-b4a7-40b0d07c4a58" status: 200 len: 1514 microversion: 2.1 time: 0.396739 Oct 04 21:13:07.950372 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2914/5862] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:13:07 2022] GET /compute/v2.1/servers/a1b4f7d9-d569-445d-b4a7-40b0d07c4a58 => generated 1514 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:13:08.543424 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-f957efdb-d5f4-4f2d-8922-fd8693aa1bb5 req-21a5b8fb-bd12-44c6-954d-5f47155c2131 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7262313-6b85-476f-a1ca-79d04fcf5740", "name": "network-vif-deleted", "tag": "a3bf10f7-790c-43f8-9084-d92fd1c978f1"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:13:08.574404 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-f957efdb-d5f4-4f2d-8922-fd8693aa1bb5 req-21a5b8fb-bd12-44c6-954d-5f47155c2131 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:08.574892 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-f957efdb-d5f4-4f2d-8922-fd8693aa1bb5 req-21a5b8fb-bd12-44c6-954d-5f47155c2131 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:08.575329 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-f957efdb-d5f4-4f2d-8922-fd8693aa1bb5 req-21a5b8fb-bd12-44c6-954d-5f47155c2131 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:08.608820 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-f957efdb-d5f4-4f2d-8922-fd8693aa1bb5 req-21a5b8fb-bd12-44c6-954d-5f47155c2131 service nova] Creating event network-vif-deleted:a3bf10f7-790c-43f8-9084-d92fd1c978f1 for instance c7262313-6b85-476f-a1ca-79d04fcf5740 on n-h2-854823-8 Oct 04 21:13:08.629290 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-f957efdb-d5f4-4f2d-8922-fd8693aa1bb5 req-21a5b8fb-bd12-44c6-954d-5f47155c2131 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090714 Oct 04 21:13:08.630528 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2949/5863] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:13:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:13:08.800867 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-364d18c8-ee09-408d-9be8-4259e1a33ae6 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:08.801496 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-364d18c8-ee09-408d-9be8-4259e1a33ae6 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] [instance: c7262313-6b85-476f-a1ca-79d04fcf5740] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:08.816433 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-364d18c8-ee09-408d-9be8-4259e1a33ae6 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:08.816970 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-364d18c8-ee09-408d-9be8-4259e1a33ae6 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:08.817417 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-364d18c8-ee09-408d-9be8-4259e1a33ae6 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:08.818325 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-364d18c8-ee09-408d-9be8-4259e1a33ae6 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:08.820464 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-364d18c8-ee09-408d-9be8-4259e1a33ae6 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:08.820917 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-364d18c8-ee09-408d-9be8-4259e1a33ae6 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:08.868509 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-364d18c8-ee09-408d-9be8-4259e1a33ae6 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:08.870072 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-364d18c8-ee09-408d-9be8-4259e1a33ae6 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:08.870717 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-364d18c8-ee09-408d-9be8-4259e1a33ae6 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:08.871524 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-364d18c8-ee09-408d-9be8-4259e1a33ae6 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lazy-loading 'fault' on Instance uuid c7262313-6b85-476f-a1ca-79d04fcf5740 {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:13:08.930671 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-364d18c8-ee09-408d-9be8-4259e1a33ae6 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b627e66ccd94b8faabf8ce9f1d2d2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40732638975044868e5a5eb5f4235244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:08.942217 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-364d18c8-ee09-408d-9be8-4259e1a33ae6 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] 10.222.0.33 "GET /compute/v2.1/servers/c7262313-6b85-476f-a1ca-79d04fcf5740" status: 200 len: 1325 microversion: 2.1 time: 0.145368 Oct 04 21:13:08.942845 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2915/5864] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:13:08 2022] GET /compute/v2.1/servers/c7262313-6b85-476f-a1ca-79d04fcf5740 => generated 1325 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:13:08.968415 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-06f305e4-519f-4e87-850f-4015b12a7f38 tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:08.969242 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-06f305e4-519f-4e87-850f-4015b12a7f38 tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] [instance: a1b4f7d9-d569-445d-b4a7-40b0d07c4a58] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:08.976536 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-06f305e4-519f-4e87-850f-4015b12a7f38 tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:08.977271 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-06f305e4-519f-4e87-850f-4015b12a7f38 tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:08.977918 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-06f305e4-519f-4e87-850f-4015b12a7f38 tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:08.979274 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-06f305e4-519f-4e87-850f-4015b12a7f38 tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:08.979939 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-06f305e4-519f-4e87-850f-4015b12a7f38 tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:08.980567 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-06f305e4-519f-4e87-850f-4015b12a7f38 tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:08.999648 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.wsgi [None req-06f305e4-519f-4e87-850f-4015b12a7f38 tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] HTTP exception thrown: Instance a1b4f7d9-d569-445d-b4a7-40b0d07c4a58 could not be found. Oct 04 21:13:09.004098 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-06f305e4-519f-4e87-850f-4015b12a7f38 tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Request method failure captured: Oct 04 21:13:09.004098 n-d-854823-8 devstack@n-api.service[128802]: request: GET /compute/v2.1/servers/a1b4f7d9-d569-445d-b4a7-40b0d07c4a58 HTTP/1.1 Oct 04 21:13:09.004098 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 21:13:09.004098 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 21:13:09.004098 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 21:13:09.004098 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 0 Oct 04 21:13:09.004098 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 21:13:09.004098 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 21:13:09.004098 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 21:13:09.004098 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 21:13:09.004098 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPKDlr7D9wAcait1TWvjOsPAd6esh640g4L5X19Gh5cC46ahO4lYVX_-jRpV36vT68dMNlB3olaBaK-SB9EpOWt3tAWV80p1HbiknJDowIow9LHlnMnIIBuEwcZX8oscMYGy2hSJjlgUid34rBJpO_tM7IxjaeUQrTBtxVRaqLT-o5O0 Oct 04 21:13:09.004098 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 21:13:09.004098 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 21:13:09.004098 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 21:13:09.004098 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 21:13:09.004098 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 21:13:09.004098 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 21:13:09.004098 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: ed76078f10cd470285d48d4542eba0d3 Oct 04 21:13:09.004098 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-VolumesSnapshotTestJSON-111474993 Oct 04 21:13:09.004098 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 21:13:09.004098 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 21:13:09.004098 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ed76078f10cd470285d48d4542eba0d3", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ed76078f10cd470285d48d4542eba0d3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ed76078f10cd470285d48d4542eba0d3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ed76078f10cd470285d48d4542eba0d3"}]}] Oct 04 21:13:09.004098 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-VolumesSnapshotTestJSON-111474993 Oct 04 21:13:09.004098 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: ed76078f10cd470285d48d4542eba0d3 Oct 04 21:13:09.004098 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-111474993 Oct 04 21:13:09.004098 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-VolumesSnapshotTestJSON-111474993-project Oct 04 21:13:09.004098 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 21:13:09.004098 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 21:13:09.004098 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: 91c6bb3c59be4ec39f2ac6053ce86ff1 Oct 04 21:13:09.004098 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-VolumesSnapshotTestJSON-111474993-project Oct 04 21:13:09.004098 n-d-854823-8 devstack@n-api.service[128802]: method: > Oct 04 21:13:09.004098 n-d-854823-8 devstack@n-api.service[128802]: exception: Instance a1b4f7d9-d569-445d-b4a7-40b0d07c4a58 could not be found. Oct 04 21:13:09.004098 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'id': 'a1b4f7d9-d569-445d-b4a7-40b0d07c4a58'} Oct 04 21:13:09.004098 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:13:09.004098 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:13:09.004098 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:13:09.004098 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:13:09.004098 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:13:09.004098 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:13:09.004098 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:13:09.004098 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:13:09.004098 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:13:09.004098 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:13:09.004098 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a1b4f7d9-d569-445d-b4a7-40b0d07c4a58 could not be found. Oct 04 21:13:09.004098 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:13:09.004098 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:13:09.004098 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:13:09.004098 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:13:09.004098 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:13:09.004098 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:13:09.004098 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:13:09.004098 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:13:09.004098 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:13:09.004098 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:13:09.004098 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:13:09.004098 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:13:09.004098 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:13:09.004098 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:13:09.004098 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:13:09.004098 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:13:09.004098 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1b4f7d9-d569-445d-b4a7-40b0d07c4a58 could not be found. Oct 04 21:13:09.004098 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:13:09.004098 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:13:09.004098 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:13:09.009187 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:13:09.009187 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:13:09.009187 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:13:09.009187 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:13:09.009187 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:13:09.009187 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1b4f7d9-d569-445d-b4a7-40b0d07c4a58 could not be found. Oct 04 21:13:09.009187 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:13:09.009187 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-06f305e4-519f-4e87-850f-4015b12a7f38 tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] Returning 404 to user: Instance a1b4f7d9-d569-445d-b4a7-40b0d07c4a58 could not be found. {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:13:09.009187 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-06f305e4-519f-4e87-850f-4015b12a7f38 tempest-VolumesSnapshotTestJSON-111474993 tempest-VolumesSnapshotTestJSON-111474993-project] 10.222.0.33 "GET /compute/v2.1/servers/a1b4f7d9-d569-445d-b4a7-40b0d07c4a58" status: 404 len: 111 microversion: 2.1 time: 0.043363 Oct 04 21:13:09.010468 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2950/5865] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:13:08 2022] GET /compute/v2.1/servers/a1b4f7d9-d569-445d-b4a7-40b0d07c4a58 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:13:09.966150 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-3727ecc3-f780-4721-8cc4-d687a7ea519b tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:09.966830 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-3727ecc3-f780-4721-8cc4-d687a7ea519b tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] [instance: c7262313-6b85-476f-a1ca-79d04fcf5740] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:09.975187 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3727ecc3-f780-4721-8cc4-d687a7ea519b tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:09.976412 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3727ecc3-f780-4721-8cc4-d687a7ea519b tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:09.976862 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3727ecc3-f780-4721-8cc4-d687a7ea519b tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:09.977647 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3727ecc3-f780-4721-8cc4-d687a7ea519b tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:09.978325 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3727ecc3-f780-4721-8cc4-d687a7ea519b tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:09.978789 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3727ecc3-f780-4721-8cc4-d687a7ea519b tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:10.006282 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-3727ecc3-f780-4721-8cc4-d687a7ea519b tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] HTTP exception thrown: Instance c7262313-6b85-476f-a1ca-79d04fcf5740 could not be found. Oct 04 21:13:10.008822 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-3727ecc3-f780-4721-8cc4-d687a7ea519b tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Request method failure captured: Oct 04 21:13:10.008822 n-d-854823-8 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/c7262313-6b85-476f-a1ca-79d04fcf5740 HTTP/1.1 Oct 04 21:13:10.008822 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 21:13:10.008822 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 21:13:10.008822 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 21:13:10.008822 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 0 Oct 04 21:13:10.008822 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 21:13:10.008822 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 21:13:10.008822 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 21:13:10.008822 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 21:13:10.008822 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPKEq_ZO0UAQ21txoHv_uGPr4ke4uY6LF0fMO4SRP2q-t3S-3tlSOkhKe5gbWdlihAvQbTOhJeKLX8E6zFQOAXT1eJ-d2hXfY576FRPNwsy1BzDc0tNXMiXSxH80lhL-v_X6mVFEWnfz55SHjIJki0VNPkanjCjiPduxjqYDOJkgYlL8 Oct 04 21:13:10.008822 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 21:13:10.008822 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 21:13:10.008822 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 21:13:10.008822 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 21:13:10.008822 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 21:13:10.008822 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 21:13:10.008822 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: 40732638975044868e5a5eb5f4235244 Oct 04 21:13:10.008822 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-AttachVolumeTestJSON-1258499709 Oct 04 21:13:10.008822 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 21:13:10.008822 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 21:13:10.008822 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_40732638975044868e5a5eb5f4235244", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/40732638975044868e5a5eb5f4235244"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/40732638975044868e5a5eb5f4235244"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/40732638975044868e5a5eb5f4235244"}]}] Oct 04 21:13:10.008822 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-AttachVolumeTestJSON-1258499709 Oct 04 21:13:10.008822 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: 40732638975044868e5a5eb5f4235244 Oct 04 21:13:10.008822 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1258499709 Oct 04 21:13:10.008822 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-AttachVolumeTestJSON-1258499709-project Oct 04 21:13:10.008822 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 21:13:10.008822 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 21:13:10.008822 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: 7b627e66ccd94b8faabf8ce9f1d2d2a6 Oct 04 21:13:10.008822 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-AttachVolumeTestJSON-1258499709-project Oct 04 21:13:10.008822 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 21:13:10.008822 n-d-854823-8 devstack@n-api.service[128801]: exception: Instance c7262313-6b85-476f-a1ca-79d04fcf5740 could not be found. Oct 04 21:13:10.008822 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': 'c7262313-6b85-476f-a1ca-79d04fcf5740'} Oct 04 21:13:10.008822 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:13:10.008822 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:13:10.008822 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:13:10.008822 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:13:10.008822 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:13:10.008822 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:13:10.008822 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:13:10.008822 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:13:10.008822 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:13:10.008822 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:13:10.008822 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c7262313-6b85-476f-a1ca-79d04fcf5740 could not be found. Oct 04 21:13:10.008822 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:13:10.008822 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:13:10.008822 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:13:10.008822 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:13:10.008822 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:13:10.008822 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:13:10.008822 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:13:10.008822 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:13:10.008822 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:13:10.008822 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:13:10.008822 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:13:10.008822 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:13:10.008822 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:13:10.008822 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:13:10.008822 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:13:10.008822 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:13:10.008822 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c7262313-6b85-476f-a1ca-79d04fcf5740 could not be found. Oct 04 21:13:10.008822 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:13:10.008822 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:13:10.008822 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:13:10.013244 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:13:10.013244 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:13:10.013244 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:13:10.013244 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:13:10.013244 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:13:10.013244 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c7262313-6b85-476f-a1ca-79d04fcf5740 could not be found. Oct 04 21:13:10.013244 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:13:10.015375 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-3727ecc3-f780-4721-8cc4-d687a7ea519b tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Returning 404 to user: Instance c7262313-6b85-476f-a1ca-79d04fcf5740 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:13:10.016822 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-3727ecc3-f780-4721-8cc4-d687a7ea519b tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] 10.222.0.33 "GET /compute/v2.1/servers/c7262313-6b85-476f-a1ca-79d04fcf5740" status: 404 len: 111 microversion: 2.1 time: 0.054577 Oct 04 21:13:10.017946 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2916/5866] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:13:09 2022] GET /compute/v2.1/servers/c7262313-6b85-476f-a1ca-79d04fcf5740 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:13:10.027417 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-0473a69b-3972-4469-8a12-12695d496cf0 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Calling method '.version_select at 0x7f3c6f513820>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:10.068176 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-0473a69b-3972-4469-8a12-12695d496cf0 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-763380985" status: 202 len: 0 microversion: 2.1 time: 0.044137 Oct 04 21:13:10.068798 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2951/5867] 10.222.0.33 () {58 vars in 1218 bytes} [Tue Oct 4 21:13:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-763380985 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:13:11.266004 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-84587b30-c212-4be7-9040-34fc1ac1f15d tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Action: 'create', calling method: .version_select at 0x7f3c6f9c4d30>, body: {"keypair": {"name": "tempest-keypair-269800684", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB7tat/XXofXb1l17mGBwsr3bP37ARub0vm4KHUjKkqVeUUSf0ct7YAHH0XNVCPZn4maLPW+A0WWykaSc9nSRh6pB5s5qriR1vzxDMctQrJlo0EcBc1CHxegeBUQ6nHn0A=="}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:13:11.285745 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-84587b30-c212-4be7-9040-34fc1ac1f15d tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Getting quotas for project 40732638975044868e5a5eb5f4235244. Resources: {'key_pairs'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:13:11.291233 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-84587b30-c212-4be7-9040-34fc1ac1f15d tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Getting quotas for user 7b627e66ccd94b8faabf8ce9f1d2d2a6 and project 40732638975044868e5a5eb5f4235244. Resources: {'key_pairs'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:13:11.317237 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-84587b30-c212-4be7-9040-34fc1ac1f15d tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.054887 Oct 04 21:13:11.317840 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2917/5868] 10.222.0.33 () {60 vars in 1159 bytes} [Tue Oct 4 21:13:11 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:13:12.767326 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-08c084cb-b8c1-4b70-8c61-50a9974ebbe7 tempest-VolumesBackupsTest-519829000 tempest-VolumesBackupsTest-519829000-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:12.768751 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-08c084cb-b8c1-4b70-8c61-50a9974ebbe7 tempest-VolumesBackupsTest-519829000 tempest-VolumesBackupsTest-519829000-project] [instance: 59bd2491-4500-43bc-a516-cd3b49f32c32] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:12.776271 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-08c084cb-b8c1-4b70-8c61-50a9974ebbe7 tempest-VolumesBackupsTest-519829000 tempest-VolumesBackupsTest-519829000-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:12.777027 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-08c084cb-b8c1-4b70-8c61-50a9974ebbe7 tempest-VolumesBackupsTest-519829000 tempest-VolumesBackupsTest-519829000-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:12.777665 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-08c084cb-b8c1-4b70-8c61-50a9974ebbe7 tempest-VolumesBackupsTest-519829000 tempest-VolumesBackupsTest-519829000-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:12.778647 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-08c084cb-b8c1-4b70-8c61-50a9974ebbe7 tempest-VolumesBackupsTest-519829000 tempest-VolumesBackupsTest-519829000-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:12.779305 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-08c084cb-b8c1-4b70-8c61-50a9974ebbe7 tempest-VolumesBackupsTest-519829000 tempest-VolumesBackupsTest-519829000-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:12.779943 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-08c084cb-b8c1-4b70-8c61-50a9974ebbe7 tempest-VolumesBackupsTest-519829000 tempest-VolumesBackupsTest-519829000-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:12.872276 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.objects.instance [None req-08c084cb-b8c1-4b70-8c61-50a9974ebbe7 tempest-VolumesBackupsTest-519829000 tempest-VolumesBackupsTest-519829000-project] Lazy-loading 'services' on Instance uuid 59bd2491-4500-43bc-a516-cd3b49f32c32 {{(pid=128802) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:13:12.908092 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b56920df-5b40-4767-8142-a5ae18f66fd5 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-907909053", "imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2472a779-ff3d-4762-a79e-b1fcabbed6fb"}], "security_groups": [{"name": "tempest-securitygroup--643277440"}], "key_name": "tempest-keypair-269800684", "user_data": "}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:13:12.964006 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-08c084cb-b8c1-4b70-8c61-50a9974ebbe7 tempest-VolumesBackupsTest-519829000 tempest-VolumesBackupsTest-519829000-project] 10.222.0.33 "DELETE /compute/v2.1/servers/59bd2491-4500-43bc-a516-cd3b49f32c32/os-volume_attachments/a6166697-4cfd-48d8-89b9-b6a93fb11b67" status: 202 len: 0 microversion: 2.1 time: 0.202127 Oct 04 21:13:12.964639 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2952/5869] 10.222.0.33 () {58 vars in 1416 bytes} [Tue Oct 4 21:13:12 2022] DELETE /compute/v2.1/servers/59bd2491-4500-43bc-a516-cd3b49f32c32/os-volume_attachments/a6166697-4cfd-48d8-89b9-b6a93fb11b67 => generated 0 bytes in 204 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:13:13.061533 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.network.neutron [None req-b56920df-5b40-4767-8142-a5ae18f66fd5 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] validate_networks() for [('2472a779-ff3d-4762-a79e-b1fcabbed6fb', None, None, None, None, None)] {{(pid=128801) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:13:13.328248 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=2,nova_api:UPDATE=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:13:13.530718 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-b56920df-5b40-4767-8142-a5ae18f66fd5 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Flavor limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:13:13.531227 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-b56920df-5b40-4767-8142-a5ae18f66fd5 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Image limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:13:13.533282 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-b56920df-5b40-4767-8142-a5ae18f66fd5 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Flavor pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:13:13.533707 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-b56920df-5b40-4767-8142-a5ae18f66fd5 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Image pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:13:13.534162 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-b56920df-5b40-4767-8142-a5ae18f66fd5 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:13:13.543248 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b56920df-5b40-4767-8142-a5ae18f66fd5 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:13.543737 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b56920df-5b40-4767-8142-a5ae18f66fd5 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:13.544179 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b56920df-5b40-4767-8142-a5ae18f66fd5 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:13.544917 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b56920df-5b40-4767-8142-a5ae18f66fd5 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:13.545379 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b56920df-5b40-4767-8142-a5ae18f66fd5 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:13.545811 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b56920df-5b40-4767-8142-a5ae18f66fd5 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:13.553744 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=90,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:13:13.566018 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-b56920df-5b40-4767-8142-a5ae18f66fd5 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Getting quotas for project 40732638975044868e5a5eb5f4235244. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:13:13.571938 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-b56920df-5b40-4767-8142-a5ae18f66fd5 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Getting quotas for user 7b627e66ccd94b8faabf8ce9f1d2d2a6 and project 40732638975044868e5a5eb5f4235244. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:13:13.584984 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b56920df-5b40-4767-8142-a5ae18f66fd5 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Going to run 1 instances... {{(pid=128801) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:13:13.587360 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b56920df-5b40-4767-8142-a5ae18f66fd5 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] [instance: ee498771-2772-4363-9f41-c400a7f73e43] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='15b24725-0c99-4bcf-b1fb-907cdf8e2d63',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128801) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:13:13.635408 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b56920df-5b40-4767-8142-a5ae18f66fd5 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.733186 Oct 04 21:13:13.642491 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2918/5870] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 21:13:12 2022] POST /compute/v2.1/servers => generated 401 bytes in 735 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 21:13:13.648668 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-2341dfdb-fd5d-4a6c-bc01-67017c942ea2 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:13.649366 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-2341dfdb-fd5d-4a6c-bc01-67017c942ea2 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] [instance: ee498771-2772-4363-9f41-c400a7f73e43] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:13.711977 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-2341dfdb-fd5d-4a6c-bc01-67017c942ea2 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b627e66ccd94b8faabf8ce9f1d2d2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40732638975044868e5a5eb5f4235244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:13.719193 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-2341dfdb-fd5d-4a6c-bc01-67017c942ea2 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] 10.222.0.33 "GET /compute/v2.1/servers/ee498771-2772-4363-9f41-c400a7f73e43" status: 200 len: 1236 microversion: 2.1 time: 0.074981 Oct 04 21:13:13.719896 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2953/5871] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:13:13 2022] GET /compute/v2.1/servers/ee498771-2772-4363-9f41-c400a7f73e43 => generated 1236 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:13:14.742205 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-83f28b8a-f3ac-4161-8785-b5da8fcefe8f tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:14.743786 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-83f28b8a-f3ac-4161-8785-b5da8fcefe8f tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] [instance: ee498771-2772-4363-9f41-c400a7f73e43] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:14.750067 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-83f28b8a-f3ac-4161-8785-b5da8fcefe8f tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:14.751441 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-83f28b8a-f3ac-4161-8785-b5da8fcefe8f tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:14.752130 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-83f28b8a-f3ac-4161-8785-b5da8fcefe8f tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:14.753356 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-83f28b8a-f3ac-4161-8785-b5da8fcefe8f tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:14.753872 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-83f28b8a-f3ac-4161-8785-b5da8fcefe8f tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:14.754418 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-83f28b8a-f3ac-4161-8785-b5da8fcefe8f tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:14.847474 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-83f28b8a-f3ac-4161-8785-b5da8fcefe8f tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b627e66ccd94b8faabf8ce9f1d2d2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40732638975044868e5a5eb5f4235244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:14.856941 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-83f28b8a-f3ac-4161-8785-b5da8fcefe8f tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] 10.222.0.33 "GET /compute/v2.1/servers/ee498771-2772-4363-9f41-c400a7f73e43" status: 200 len: 1288 microversion: 2.1 time: 0.119509 Oct 04 21:13:14.857801 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2919/5872] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:13:14 2022] GET /compute/v2.1/servers/ee498771-2772-4363-9f41-c400a7f73e43 => generated 1288 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:13:15.882269 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-33df334d-320a-4f93-8749-20d09885f009 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:15.883642 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-33df334d-320a-4f93-8749-20d09885f009 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] [instance: ee498771-2772-4363-9f41-c400a7f73e43] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:15.894295 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:13:15.902976 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-33df334d-320a-4f93-8749-20d09885f009 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:15.903505 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-33df334d-320a-4f93-8749-20d09885f009 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:15.903923 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-33df334d-320a-4f93-8749-20d09885f009 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:15.904871 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-33df334d-320a-4f93-8749-20d09885f009 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:15.905323 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-33df334d-320a-4f93-8749-20d09885f009 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:15.905741 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-33df334d-320a-4f93-8749-20d09885f009 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:15.919277 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:13:16.194644 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-33df334d-320a-4f93-8749-20d09885f009 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b627e66ccd94b8faabf8ce9f1d2d2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40732638975044868e5a5eb5f4235244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:16.209896 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-33df334d-320a-4f93-8749-20d09885f009 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] 10.222.0.33 "GET /compute/v2.1/servers/ee498771-2772-4363-9f41-c400a7f73e43" status: 200 len: 1361 microversion: 2.1 time: 0.332447 Oct 04 21:13:16.211205 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2954/5873] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:13:15 2022] GET /compute/v2.1/servers/ee498771-2772-4363-9f41-c400a7f73e43 => generated 1361 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:13:16.844824 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-f77bb261-8889-44be-90d7-a9f4248c881e req-64a3860a-c276-40c4-aa8f-51e7904d67eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee498771-2772-4363-9f41-c400a7f73e43", "tag": "777c1d9a-5cc6-4b05-b46e-940563ded193"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:13:16.867136 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-f77bb261-8889-44be-90d7-a9f4248c881e req-64a3860a-c276-40c4-aa8f-51e7904d67eb service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:16.875038 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-f77bb261-8889-44be-90d7-a9f4248c881e req-64a3860a-c276-40c4-aa8f-51e7904d67eb service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:16.875491 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-f77bb261-8889-44be-90d7-a9f4248c881e req-64a3860a-c276-40c4-aa8f-51e7904d67eb service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:16.902431 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-f77bb261-8889-44be-90d7-a9f4248c881e req-64a3860a-c276-40c4-aa8f-51e7904d67eb service nova] Creating event network-changed:777c1d9a-5cc6-4b05-b46e-940563ded193 for instance ee498771-2772-4363-9f41-c400a7f73e43 on n-h2-854823-8 Oct 04 21:13:16.918843 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-f77bb261-8889-44be-90d7-a9f4248c881e req-64a3860a-c276-40c4-aa8f-51e7904d67eb service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085485 Oct 04 21:13:16.920038 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2920/5874] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:13:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:13:17.237623 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-ba5d0d26-d9aa-4ab6-9fa8-94e3ab4ed1f0 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:17.238325 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-ba5d0d26-d9aa-4ab6-9fa8-94e3ab4ed1f0 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] [instance: ee498771-2772-4363-9f41-c400a7f73e43] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:17.248387 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ba5d0d26-d9aa-4ab6-9fa8-94e3ab4ed1f0 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:17.249099 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ba5d0d26-d9aa-4ab6-9fa8-94e3ab4ed1f0 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:17.249714 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ba5d0d26-d9aa-4ab6-9fa8-94e3ab4ed1f0 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:17.250627 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ba5d0d26-d9aa-4ab6-9fa8-94e3ab4ed1f0 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:17.251861 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ba5d0d26-d9aa-4ab6-9fa8-94e3ab4ed1f0 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:17.252305 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ba5d0d26-d9aa-4ab6-9fa8-94e3ab4ed1f0 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:17.522186 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-ba5d0d26-d9aa-4ab6-9fa8-94e3ab4ed1f0 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b627e66ccd94b8faabf8ce9f1d2d2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40732638975044868e5a5eb5f4235244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:17.533308 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-ba5d0d26-d9aa-4ab6-9fa8-94e3ab4ed1f0 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] 10.222.0.33 "GET /compute/v2.1/servers/ee498771-2772-4363-9f41-c400a7f73e43" status: 200 len: 1361 microversion: 2.1 time: 0.300518 Oct 04 21:13:17.534600 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2955/5875] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:13:17 2022] GET /compute/v2.1/servers/ee498771-2772-4363-9f41-c400a7f73e43 => generated 1361 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:13:18.561349 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a6918210-6593-4dc7-b585-82704ffede49 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:18.567658 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a6918210-6593-4dc7-b585-82704ffede49 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] [instance: ee498771-2772-4363-9f41-c400a7f73e43] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:18.590252 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a6918210-6593-4dc7-b585-82704ffede49 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:18.590776 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a6918210-6593-4dc7-b585-82704ffede49 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:18.597183 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a6918210-6593-4dc7-b585-82704ffede49 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:18.598137 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a6918210-6593-4dc7-b585-82704ffede49 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:18.598644 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a6918210-6593-4dc7-b585-82704ffede49 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:18.599075 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a6918210-6593-4dc7-b585-82704ffede49 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:18.650101 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-c1848944-c5dc-4474-bb15-e55ec744205c tempest-VolumesBackupsTest-519829000 tempest-VolumesBackupsTest-519829000-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:18.650670 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-c1848944-c5dc-4474-bb15-e55ec744205c tempest-VolumesBackupsTest-519829000 tempest-VolumesBackupsTest-519829000-project] [instance: 59bd2491-4500-43bc-a516-cd3b49f32c32] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:18.660265 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c1848944-c5dc-4474-bb15-e55ec744205c tempest-VolumesBackupsTest-519829000 tempest-VolumesBackupsTest-519829000-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:18.660762 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c1848944-c5dc-4474-bb15-e55ec744205c tempest-VolumesBackupsTest-519829000 tempest-VolumesBackupsTest-519829000-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:18.661206 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c1848944-c5dc-4474-bb15-e55ec744205c tempest-VolumesBackupsTest-519829000 tempest-VolumesBackupsTest-519829000-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:18.661924 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c1848944-c5dc-4474-bb15-e55ec744205c tempest-VolumesBackupsTest-519829000 tempest-VolumesBackupsTest-519829000-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:18.662410 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c1848944-c5dc-4474-bb15-e55ec744205c tempest-VolumesBackupsTest-519829000 tempest-VolumesBackupsTest-519829000-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:18.663250 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c1848944-c5dc-4474-bb15-e55ec744205c tempest-VolumesBackupsTest-519829000 tempest-VolumesBackupsTest-519829000-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:18.695588 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-c1848944-c5dc-4474-bb15-e55ec744205c tempest-VolumesBackupsTest-519829000 tempest-VolumesBackupsTest-519829000-project] [instance: 59bd2491-4500-43bc-a516-cd3b49f32c32] Going to try to terminate instance {{(pid=128802) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:13:18.808158 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-c1848944-c5dc-4474-bb15-e55ec744205c tempest-VolumesBackupsTest-519829000 tempest-VolumesBackupsTest-519829000-project] 10.222.0.33 "DELETE /compute/v2.1/servers/59bd2491-4500-43bc-a516-cd3b49f32c32" status: 204 len: 0 microversion: 2.1 time: 0.161615 Oct 04 21:13:18.808955 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2956/5876] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 21:13:18 2022] DELETE /compute/v2.1/servers/59bd2491-4500-43bc-a516-cd3b49f32c32 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:13:18.820010 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-baa9b36b-e6bc-4cef-b203-f9be69999e32 tempest-VolumesBackupsTest-519829000 tempest-VolumesBackupsTest-519829000-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:18.821079 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-baa9b36b-e6bc-4cef-b203-f9be69999e32 tempest-VolumesBackupsTest-519829000 tempest-VolumesBackupsTest-519829000-project] [instance: 59bd2491-4500-43bc-a516-cd3b49f32c32] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:18.829581 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-baa9b36b-e6bc-4cef-b203-f9be69999e32 tempest-VolumesBackupsTest-519829000 tempest-VolumesBackupsTest-519829000-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:18.830717 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-baa9b36b-e6bc-4cef-b203-f9be69999e32 tempest-VolumesBackupsTest-519829000 tempest-VolumesBackupsTest-519829000-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:18.831348 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-baa9b36b-e6bc-4cef-b203-f9be69999e32 tempest-VolumesBackupsTest-519829000 tempest-VolumesBackupsTest-519829000-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:18.832085 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-baa9b36b-e6bc-4cef-b203-f9be69999e32 tempest-VolumesBackupsTest-519829000 tempest-VolumesBackupsTest-519829000-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:18.832546 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-baa9b36b-e6bc-4cef-b203-f9be69999e32 tempest-VolumesBackupsTest-519829000 tempest-VolumesBackupsTest-519829000-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:18.833234 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-baa9b36b-e6bc-4cef-b203-f9be69999e32 tempest-VolumesBackupsTest-519829000 tempest-VolumesBackupsTest-519829000-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:18.861944 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-a6918210-6593-4dc7-b585-82704ffede49 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b627e66ccd94b8faabf8ce9f1d2d2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40732638975044868e5a5eb5f4235244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:18.872770 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a6918210-6593-4dc7-b585-82704ffede49 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] 10.222.0.33 "GET /compute/v2.1/servers/ee498771-2772-4363-9f41-c400a7f73e43" status: 200 len: 1361 microversion: 2.1 time: 0.316781 Oct 04 21:13:18.881663 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2921/5877] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:13:18 2022] GET /compute/v2.1/servers/ee498771-2772-4363-9f41-c400a7f73e43 => generated 1361 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:13:19.049444 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-baa9b36b-e6bc-4cef-b203-f9be69999e32 tempest-VolumesBackupsTest-519829000 tempest-VolumesBackupsTest-519829000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db09f027cfa24260a35754889e8b2b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa6be52c0a84cc6b33ddf35a2f1db27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:19.058254 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-baa9b36b-e6bc-4cef-b203-f9be69999e32 tempest-VolumesBackupsTest-519829000 tempest-VolumesBackupsTest-519829000-project] 10.222.0.33 "GET /compute/v2.1/servers/59bd2491-4500-43bc-a516-cd3b49f32c32" status: 200 len: 1469 microversion: 2.1 time: 0.244602 Oct 04 21:13:19.059232 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2957/5878] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:13:18 2022] GET /compute/v2.1/servers/59bd2491-4500-43bc-a516-cd3b49f32c32 => generated 1469 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:13:19.897572 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7ac1f8d5-902c-4adb-ad94-521cb67fcb4d tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:19.898228 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-7ac1f8d5-902c-4adb-ad94-521cb67fcb4d tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] [instance: ee498771-2772-4363-9f41-c400a7f73e43] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:19.905393 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7ac1f8d5-902c-4adb-ad94-521cb67fcb4d tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:19.905891 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7ac1f8d5-902c-4adb-ad94-521cb67fcb4d tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:19.906334 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7ac1f8d5-902c-4adb-ad94-521cb67fcb4d tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:19.907078 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7ac1f8d5-902c-4adb-ad94-521cb67fcb4d tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:19.907650 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7ac1f8d5-902c-4adb-ad94-521cb67fcb4d tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:19.908090 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7ac1f8d5-902c-4adb-ad94-521cb67fcb4d tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:20.043965 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-7ac1f8d5-902c-4adb-ad94-521cb67fcb4d tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b627e66ccd94b8faabf8ce9f1d2d2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40732638975044868e5a5eb5f4235244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:20.052990 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-7ac1f8d5-902c-4adb-ad94-521cb67fcb4d tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] 10.222.0.33 "GET /compute/v2.1/servers/ee498771-2772-4363-9f41-c400a7f73e43" status: 200 len: 1361 microversion: 2.1 time: 0.159390 Oct 04 21:13:20.053580 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2922/5879] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:13:19 2022] GET /compute/v2.1/servers/ee498771-2772-4363-9f41-c400a7f73e43 => generated 1361 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:13:20.083898 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-b98491e3-3a6b-4117-bd80-d0a4635b9c60 tempest-VolumesBackupsTest-519829000 tempest-VolumesBackupsTest-519829000-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:20.084521 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-b98491e3-3a6b-4117-bd80-d0a4635b9c60 tempest-VolumesBackupsTest-519829000 tempest-VolumesBackupsTest-519829000-project] [instance: 59bd2491-4500-43bc-a516-cd3b49f32c32] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:20.091671 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b98491e3-3a6b-4117-bd80-d0a4635b9c60 tempest-VolumesBackupsTest-519829000 tempest-VolumesBackupsTest-519829000-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:20.092095 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b98491e3-3a6b-4117-bd80-d0a4635b9c60 tempest-VolumesBackupsTest-519829000 tempest-VolumesBackupsTest-519829000-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:20.093093 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b98491e3-3a6b-4117-bd80-d0a4635b9c60 tempest-VolumesBackupsTest-519829000 tempest-VolumesBackupsTest-519829000-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:20.093894 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b98491e3-3a6b-4117-bd80-d0a4635b9c60 tempest-VolumesBackupsTest-519829000 tempest-VolumesBackupsTest-519829000-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:20.093894 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b98491e3-3a6b-4117-bd80-d0a4635b9c60 tempest-VolumesBackupsTest-519829000 tempest-VolumesBackupsTest-519829000-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:20.095253 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b98491e3-3a6b-4117-bd80-d0a4635b9c60 tempest-VolumesBackupsTest-519829000 tempest-VolumesBackupsTest-519829000-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:20.240812 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-b98491e3-3a6b-4117-bd80-d0a4635b9c60 tempest-VolumesBackupsTest-519829000 tempest-VolumesBackupsTest-519829000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db09f027cfa24260a35754889e8b2b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa6be52c0a84cc6b33ddf35a2f1db27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:20.249439 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-b98491e3-3a6b-4117-bd80-d0a4635b9c60 tempest-VolumesBackupsTest-519829000 tempest-VolumesBackupsTest-519829000-project] 10.222.0.33 "GET /compute/v2.1/servers/59bd2491-4500-43bc-a516-cd3b49f32c32" status: 200 len: 1469 microversion: 2.1 time: 0.170513 Oct 04 21:13:20.250414 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2958/5880] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:13:20 2022] GET /compute/v2.1/servers/59bd2491-4500-43bc-a516-cd3b49f32c32 => generated 1469 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:13:21.079805 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b6963668-e33a-45f4-be62-2beb34c13f6f tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:21.081330 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b6963668-e33a-45f4-be62-2beb34c13f6f tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] [instance: ee498771-2772-4363-9f41-c400a7f73e43] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:21.089896 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b6963668-e33a-45f4-be62-2beb34c13f6f tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:21.090768 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b6963668-e33a-45f4-be62-2beb34c13f6f tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:21.092146 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b6963668-e33a-45f4-be62-2beb34c13f6f tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:21.093153 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b6963668-e33a-45f4-be62-2beb34c13f6f tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:21.094107 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b6963668-e33a-45f4-be62-2beb34c13f6f tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:21.094806 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b6963668-e33a-45f4-be62-2beb34c13f6f tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:21.282901 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-acd9e39d-d381-488e-bc9b-352deb2c8910 tempest-VolumesBackupsTest-519829000 tempest-VolumesBackupsTest-519829000-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:21.286200 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-acd9e39d-d381-488e-bc9b-352deb2c8910 tempest-VolumesBackupsTest-519829000 tempest-VolumesBackupsTest-519829000-project] [instance: 59bd2491-4500-43bc-a516-cd3b49f32c32] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:21.297151 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-acd9e39d-d381-488e-bc9b-352deb2c8910 tempest-VolumesBackupsTest-519829000 tempest-VolumesBackupsTest-519829000-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:21.299918 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-acd9e39d-d381-488e-bc9b-352deb2c8910 tempest-VolumesBackupsTest-519829000 tempest-VolumesBackupsTest-519829000-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:21.300880 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-acd9e39d-d381-488e-bc9b-352deb2c8910 tempest-VolumesBackupsTest-519829000 tempest-VolumesBackupsTest-519829000-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:21.301413 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-acd9e39d-d381-488e-bc9b-352deb2c8910 tempest-VolumesBackupsTest-519829000 tempest-VolumesBackupsTest-519829000-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:21.302235 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-acd9e39d-d381-488e-bc9b-352deb2c8910 tempest-VolumesBackupsTest-519829000 tempest-VolumesBackupsTest-519829000-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:21.303657 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-acd9e39d-d381-488e-bc9b-352deb2c8910 tempest-VolumesBackupsTest-519829000 tempest-VolumesBackupsTest-519829000-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:21.366166 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-b6963668-e33a-45f4-be62-2beb34c13f6f tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b627e66ccd94b8faabf8ce9f1d2d2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40732638975044868e5a5eb5f4235244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:21.382612 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b6963668-e33a-45f4-be62-2beb34c13f6f tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] 10.222.0.33 "GET /compute/v2.1/servers/ee498771-2772-4363-9f41-c400a7f73e43" status: 200 len: 1361 microversion: 2.1 time: 0.309141 Oct 04 21:13:21.403641 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2923/5881] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:13:21 2022] GET /compute/v2.1/servers/ee498771-2772-4363-9f41-c400a7f73e43 => generated 1361 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:13:21.440839 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-acd9e39d-d381-488e-bc9b-352deb2c8910 tempest-VolumesBackupsTest-519829000 tempest-VolumesBackupsTest-519829000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db09f027cfa24260a35754889e8b2b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fa6be52c0a84cc6b33ddf35a2f1db27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:21.455363 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-acd9e39d-d381-488e-bc9b-352deb2c8910 tempest-VolumesBackupsTest-519829000 tempest-VolumesBackupsTest-519829000-project] 10.222.0.33 "GET /compute/v2.1/servers/59bd2491-4500-43bc-a516-cd3b49f32c32" status: 200 len: 1427 microversion: 2.1 time: 0.184200 Oct 04 21:13:21.456668 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2959/5882] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:13:21 2022] GET /compute/v2.1/servers/59bd2491-4500-43bc-a516-cd3b49f32c32 => generated 1427 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:13:21.528141 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-66a1f217-a6fe-4dfe-ba1a-210197fce326 req-4f23bd1a-b494-43f2-9d53-be77719906fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59bd2491-4500-43bc-a516-cd3b49f32c32", "name": "network-vif-deleted", "tag": "e5d7d0d6-d96a-4134-9637-ddb69f5e47f3"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:13:21.540178 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-66a1f217-a6fe-4dfe-ba1a-210197fce326 req-4f23bd1a-b494-43f2-9d53-be77719906fd service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:21.540661 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-66a1f217-a6fe-4dfe-ba1a-210197fce326 req-4f23bd1a-b494-43f2-9d53-be77719906fd service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:21.541213 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-66a1f217-a6fe-4dfe-ba1a-210197fce326 req-4f23bd1a-b494-43f2-9d53-be77719906fd service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:21.560741 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-66a1f217-a6fe-4dfe-ba1a-210197fce326 req-4f23bd1a-b494-43f2-9d53-be77719906fd service nova] Creating event network-vif-deleted:e5d7d0d6-d96a-4134-9637-ddb69f5e47f3 for instance 59bd2491-4500-43bc-a516-cd3b49f32c32 on n-h1-854823-8 Oct 04 21:13:21.568743 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-66a1f217-a6fe-4dfe-ba1a-210197fce326 req-4f23bd1a-b494-43f2-9d53-be77719906fd service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044451 Oct 04 21:13:21.569807 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2924/5883] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:13:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:13:22.412264 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-287fe9c9-eb6f-4e7a-9577-794fc0b1eb9b tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:22.412911 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-287fe9c9-eb6f-4e7a-9577-794fc0b1eb9b tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] [instance: ee498771-2772-4363-9f41-c400a7f73e43] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:22.420641 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-287fe9c9-eb6f-4e7a-9577-794fc0b1eb9b tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:22.421372 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-287fe9c9-eb6f-4e7a-9577-794fc0b1eb9b tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:22.421960 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-287fe9c9-eb6f-4e7a-9577-794fc0b1eb9b tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:22.423546 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-287fe9c9-eb6f-4e7a-9577-794fc0b1eb9b tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:22.424251 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-287fe9c9-eb6f-4e7a-9577-794fc0b1eb9b tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:22.424673 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-287fe9c9-eb6f-4e7a-9577-794fc0b1eb9b tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:22.496736 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1b4ee7d5-773b-4740-860a-75d671da1af2 tempest-VolumesBackupsTest-519829000 tempest-VolumesBackupsTest-519829000-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:22.501460 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-1b4ee7d5-773b-4740-860a-75d671da1af2 tempest-VolumesBackupsTest-519829000 tempest-VolumesBackupsTest-519829000-project] [instance: 59bd2491-4500-43bc-a516-cd3b49f32c32] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:22.520680 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1b4ee7d5-773b-4740-860a-75d671da1af2 tempest-VolumesBackupsTest-519829000 tempest-VolumesBackupsTest-519829000-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:22.522325 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1b4ee7d5-773b-4740-860a-75d671da1af2 tempest-VolumesBackupsTest-519829000 tempest-VolumesBackupsTest-519829000-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:22.523856 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1b4ee7d5-773b-4740-860a-75d671da1af2 tempest-VolumesBackupsTest-519829000 tempest-VolumesBackupsTest-519829000-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:22.527983 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1b4ee7d5-773b-4740-860a-75d671da1af2 tempest-VolumesBackupsTest-519829000 tempest-VolumesBackupsTest-519829000-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:22.530754 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1b4ee7d5-773b-4740-860a-75d671da1af2 tempest-VolumesBackupsTest-519829000 tempest-VolumesBackupsTest-519829000-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:22.532309 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1b4ee7d5-773b-4740-860a-75d671da1af2 tempest-VolumesBackupsTest-519829000 tempest-VolumesBackupsTest-519829000-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:22.573940 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-1b4ee7d5-773b-4740-860a-75d671da1af2 tempest-VolumesBackupsTest-519829000 tempest-VolumesBackupsTest-519829000-project] HTTP exception thrown: Instance 59bd2491-4500-43bc-a516-cd3b49f32c32 could not be found. Oct 04 21:13:22.578535 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1b4ee7d5-773b-4740-860a-75d671da1af2 tempest-VolumesBackupsTest-519829000 tempest-VolumesBackupsTest-519829000-project] Request method failure captured: Oct 04 21:13:22.578535 n-d-854823-8 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/59bd2491-4500-43bc-a516-cd3b49f32c32 HTTP/1.1 Oct 04 21:13:22.578535 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 21:13:22.578535 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 21:13:22.578535 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 21:13:22.578535 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 0 Oct 04 21:13:22.578535 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 21:13:22.578535 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 21:13:22.578535 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 21:13:22.578535 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 21:13:22.578535 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPKGDQpEdyYtLuV6KkeXY8iw4qUhhx0ghK0u96KEYn-mDJ8P0qdAqV7Aofo0gL-7EfaR2I-wOqA7hm0FYxZn6HYBSh7xryUkkiYEnXnL6OX8IOlifAG5MyfyF7t4lODaV__Fb1WkuTcT8aV0g0DQ1IL_RrAgdximCbvrXgsI2F97j2D0 Oct 04 21:13:22.578535 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 21:13:22.578535 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 21:13:22.578535 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 21:13:22.578535 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 21:13:22.578535 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 21:13:22.578535 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 21:13:22.578535 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: 8fa6be52c0a84cc6b33ddf35a2f1db27 Oct 04 21:13:22.578535 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-VolumesBackupsTest-519829000 Oct 04 21:13:22.578535 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 21:13:22.578535 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 21:13:22.578535 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_8fa6be52c0a84cc6b33ddf35a2f1db27", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8fa6be52c0a84cc6b33ddf35a2f1db27"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8fa6be52c0a84cc6b33ddf35a2f1db27"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/8fa6be52c0a84cc6b33ddf35a2f1db27"}]}] Oct 04 21:13:22.578535 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-VolumesBackupsTest-519829000 Oct 04 21:13:22.578535 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: 8fa6be52c0a84cc6b33ddf35a2f1db27 Oct 04 21:13:22.578535 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-VolumesBackupsTest-519829000 Oct 04 21:13:22.578535 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-VolumesBackupsTest-519829000-project Oct 04 21:13:22.578535 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 21:13:22.578535 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 21:13:22.578535 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: db09f027cfa24260a35754889e8b2b07 Oct 04 21:13:22.578535 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-VolumesBackupsTest-519829000-project Oct 04 21:13:22.578535 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 21:13:22.578535 n-d-854823-8 devstack@n-api.service[128801]: exception: Instance 59bd2491-4500-43bc-a516-cd3b49f32c32 could not be found. Oct 04 21:13:22.578535 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': '59bd2491-4500-43bc-a516-cd3b49f32c32'} Oct 04 21:13:22.578535 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:13:22.578535 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:13:22.578535 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:13:22.578535 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:13:22.578535 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:13:22.578535 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:13:22.578535 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:13:22.578535 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:13:22.578535 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:13:22.578535 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:13:22.578535 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 59bd2491-4500-43bc-a516-cd3b49f32c32 could not be found. Oct 04 21:13:22.578535 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:13:22.578535 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:13:22.578535 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:13:22.578535 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:13:22.578535 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:13:22.578535 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:13:22.578535 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:13:22.578535 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:13:22.578535 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:13:22.578535 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:13:22.578535 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:13:22.578535 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:13:22.578535 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:13:22.578535 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:13:22.578535 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:13:22.578535 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:13:22.578535 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 59bd2491-4500-43bc-a516-cd3b49f32c32 could not be found. Oct 04 21:13:22.578535 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:13:22.578535 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:13:22.578535 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:13:22.588704 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:13:22.588704 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:13:22.588704 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:13:22.588704 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:13:22.588704 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:13:22.588704 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 59bd2491-4500-43bc-a516-cd3b49f32c32 could not be found. Oct 04 21:13:22.588704 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:13:22.593762 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1b4ee7d5-773b-4740-860a-75d671da1af2 tempest-VolumesBackupsTest-519829000 tempest-VolumesBackupsTest-519829000-project] Returning 404 to user: Instance 59bd2491-4500-43bc-a516-cd3b49f32c32 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:13:22.593762 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-1b4ee7d5-773b-4740-860a-75d671da1af2 tempest-VolumesBackupsTest-519829000 tempest-VolumesBackupsTest-519829000-project] 10.222.0.33 "GET /compute/v2.1/servers/59bd2491-4500-43bc-a516-cd3b49f32c32" status: 404 len: 111 microversion: 2.1 time: 0.110976 Oct 04 21:13:22.596250 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2925/5884] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:13:22 2022] GET /compute/v2.1/servers/59bd2491-4500-43bc-a516-cd3b49f32c32 => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:13:22.602101 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-287fe9c9-eb6f-4e7a-9577-794fc0b1eb9b tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b627e66ccd94b8faabf8ce9f1d2d2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40732638975044868e5a5eb5f4235244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:22.609177 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-e3dbe079-4af1-4cdd-a981-531cfc93960f req-26b26641-7058-44af-a693-c9b36d01d7c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee498771-2772-4363-9f41-c400a7f73e43", "name": "network-vif-plugged", "status": "completed", "tag": "777c1d9a-5cc6-4b05-b46e-940563ded193"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:13:22.611912 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-287fe9c9-eb6f-4e7a-9577-794fc0b1eb9b tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] 10.222.0.33 "GET /compute/v2.1/servers/ee498771-2772-4363-9f41-c400a7f73e43" status: 200 len: 1361 microversion: 2.1 time: 0.203447 Oct 04 21:13:22.613041 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2960/5885] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:13:22 2022] GET /compute/v2.1/servers/ee498771-2772-4363-9f41-c400a7f73e43 => generated 1361 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:13:22.629767 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-e3dbe079-4af1-4cdd-a981-531cfc93960f req-26b26641-7058-44af-a693-c9b36d01d7c7 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:22.631967 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-e3dbe079-4af1-4cdd-a981-531cfc93960f req-26b26641-7058-44af-a693-c9b36d01d7c7 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:22.633745 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-e3dbe079-4af1-4cdd-a981-531cfc93960f req-26b26641-7058-44af-a693-c9b36d01d7c7 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:22.656601 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-e3dbe079-4af1-4cdd-a981-531cfc93960f req-26b26641-7058-44af-a693-c9b36d01d7c7 service nova] Creating event network-vif-plugged:777c1d9a-5cc6-4b05-b46e-940563ded193 for instance ee498771-2772-4363-9f41-c400a7f73e43 on n-h2-854823-8 Oct 04 21:13:22.665378 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-e3dbe079-4af1-4cdd-a981-531cfc93960f req-26b26641-7058-44af-a693-c9b36d01d7c7 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067168 Oct 04 21:13:22.666076 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2926/5886] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:13:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:13:23.635434 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-8e27243d-ca4a-485f-8dc9-6beb9d34dcfe tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:23.636377 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-8e27243d-ca4a-485f-8dc9-6beb9d34dcfe tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] [instance: ee498771-2772-4363-9f41-c400a7f73e43] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:23.644965 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8e27243d-ca4a-485f-8dc9-6beb9d34dcfe tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:23.645585 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8e27243d-ca4a-485f-8dc9-6beb9d34dcfe tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:23.646100 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8e27243d-ca4a-485f-8dc9-6beb9d34dcfe tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:23.646978 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8e27243d-ca4a-485f-8dc9-6beb9d34dcfe tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:23.647510 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8e27243d-ca4a-485f-8dc9-6beb9d34dcfe tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:23.648014 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8e27243d-ca4a-485f-8dc9-6beb9d34dcfe tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:23.719067 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell0:SELECT=2 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:13:23.816819 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-8e27243d-ca4a-485f-8dc9-6beb9d34dcfe tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b627e66ccd94b8faabf8ce9f1d2d2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40732638975044868e5a5eb5f4235244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:23.826136 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-8e27243d-ca4a-485f-8dc9-6beb9d34dcfe tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] 10.222.0.33 "GET /compute/v2.1/servers/ee498771-2772-4363-9f41-c400a7f73e43" status: 200 len: 1361 microversion: 2.1 time: 0.194918 Oct 04 21:13:23.827324 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2961/5887] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:13:23 2022] GET /compute/v2.1/servers/ee498771-2772-4363-9f41-c400a7f73e43 => generated 1361 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:13:24.411944 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:13:24.412733 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=10 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:13:24.417450 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9a63ec29-a207-47f4-b440-842c026245b8 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:13:24.419954 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-9a63ec29-a207-47f4-b440-842c026245b8 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] [instance: d5d53aea-3534-49f6-bb2c-b0f67bfd5abf] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:24.428463 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9a63ec29-a207-47f4-b440-842c026245b8 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:24.428971 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9a63ec29-a207-47f4-b440-842c026245b8 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:24.429419 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9a63ec29-a207-47f4-b440-842c026245b8 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:24.430143 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9a63ec29-a207-47f4-b440-842c026245b8 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:24.430636 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9a63ec29-a207-47f4-b440-842c026245b8 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:24.431068 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9a63ec29-a207-47f4-b440-842c026245b8 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:24.498826 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-9a63ec29-a207-47f4-b440-842c026245b8 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] 10.222.0.33 "POST /compute/v2.1/servers/d5d53aea-3534-49f6-bb2c-b0f67bfd5abf/action" status: 200 len: 24571 microversion: 2.1 time: 0.088463 Oct 04 21:13:24.499759 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2927/5888] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 21:13:24 2022] POST /compute/v2.1/servers/d5d53aea-3534-49f6-bb2c-b0f67bfd5abf/action => generated 24571 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 21:13:24.851665 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-fbd095f9-7cc2-4ad8-8701-3b13e4da1dc5 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:24.852571 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-fbd095f9-7cc2-4ad8-8701-3b13e4da1dc5 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] [instance: ee498771-2772-4363-9f41-c400a7f73e43] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:24.870806 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fbd095f9-7cc2-4ad8-8701-3b13e4da1dc5 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:24.872806 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fbd095f9-7cc2-4ad8-8701-3b13e4da1dc5 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:24.873508 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fbd095f9-7cc2-4ad8-8701-3b13e4da1dc5 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:24.881831 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fbd095f9-7cc2-4ad8-8701-3b13e4da1dc5 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:24.882685 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fbd095f9-7cc2-4ad8-8701-3b13e4da1dc5 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:24.883373 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fbd095f9-7cc2-4ad8-8701-3b13e4da1dc5 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:25.041224 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-fbd095f9-7cc2-4ad8-8701-3b13e4da1dc5 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b627e66ccd94b8faabf8ce9f1d2d2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40732638975044868e5a5eb5f4235244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:25.049875 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-fbd095f9-7cc2-4ad8-8701-3b13e4da1dc5 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] 10.222.0.33 "GET /compute/v2.1/servers/ee498771-2772-4363-9f41-c400a7f73e43" status: 200 len: 1548 microversion: 2.1 time: 0.202313 Oct 04 21:13:25.050504 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2962/5889] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:13:24 2022] GET /compute/v2.1/servers/ee498771-2772-4363-9f41-c400a7f73e43 => generated 1548 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:13:25.073949 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-baf648a8-34b3-42e9-8c11-3d10597f6981 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:25.074583 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-baf648a8-34b3-42e9-8c11-3d10597f6981 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] [instance: ee498771-2772-4363-9f41-c400a7f73e43] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:25.082675 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-baf648a8-34b3-42e9-8c11-3d10597f6981 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:25.083528 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-baf648a8-34b3-42e9-8c11-3d10597f6981 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:25.083967 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-baf648a8-34b3-42e9-8c11-3d10597f6981 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:25.084670 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-baf648a8-34b3-42e9-8c11-3d10597f6981 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:25.085151 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-baf648a8-34b3-42e9-8c11-3d10597f6981 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:25.085571 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-baf648a8-34b3-42e9-8c11-3d10597f6981 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:25.175357 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-baf648a8-34b3-42e9-8c11-3d10597f6981 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] 10.222.0.33 "GET /compute/v2.1/servers/ee498771-2772-4363-9f41-c400a7f73e43/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.105906 Oct 04 21:13:25.183801 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2928/5890] 10.222.0.33 () {58 vars in 1275 bytes} [Tue Oct 4 21:13:25 2022] GET /compute/v2.1/servers/ee498771-2772-4363-9f41-c400a7f73e43/os-interface => generated 285 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:13:26.743824 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-e4160f00-c843-40fd-a82d-926a21e9f13e req-f2dc8047-0c54-415c-b9e3-ca49e0313cf2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee498771-2772-4363-9f41-c400a7f73e43", "tag": "777c1d9a-5cc6-4b05-b46e-940563ded193"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:13:26.766798 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-e4160f00-c843-40fd-a82d-926a21e9f13e req-f2dc8047-0c54-415c-b9e3-ca49e0313cf2 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:26.768376 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-e4160f00-c843-40fd-a82d-926a21e9f13e req-f2dc8047-0c54-415c-b9e3-ca49e0313cf2 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:26.768895 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-e4160f00-c843-40fd-a82d-926a21e9f13e req-f2dc8047-0c54-415c-b9e3-ca49e0313cf2 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:26.801908 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-e4160f00-c843-40fd-a82d-926a21e9f13e req-f2dc8047-0c54-415c-b9e3-ca49e0313cf2 service nova] Creating event network-changed:777c1d9a-5cc6-4b05-b46e-940563ded193 for instance ee498771-2772-4363-9f41-c400a7f73e43 on n-h2-854823-8 Oct 04 21:13:26.812768 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-e4160f00-c843-40fd-a82d-926a21e9f13e req-f2dc8047-0c54-415c-b9e3-ca49e0313cf2 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069491 Oct 04 21:13:26.814684 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2963/5891] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:13:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:13:35.583856 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ebbd7138-9f76-4e1f-a396-45c6faab6911 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:13:35.587026 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ebbd7138-9f76-4e1f-a396-45c6faab6911 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] [instance: d5d53aea-3534-49f6-bb2c-b0f67bfd5abf] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:35.591300 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=3 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:13:35.591946 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=41 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:13:35.599310 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ebbd7138-9f76-4e1f-a396-45c6faab6911 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:35.600065 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ebbd7138-9f76-4e1f-a396-45c6faab6911 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:35.600763 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ebbd7138-9f76-4e1f-a396-45c6faab6911 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:35.601585 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ebbd7138-9f76-4e1f-a396-45c6faab6911 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:35.602163 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ebbd7138-9f76-4e1f-a396-45c6faab6911 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:35.602779 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ebbd7138-9f76-4e1f-a396-45c6faab6911 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:35.668857 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ebbd7138-9f76-4e1f-a396-45c6faab6911 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] 10.222.0.33 "POST /compute/v2.1/servers/d5d53aea-3534-49f6-bb2c-b0f67bfd5abf/action" status: 200 len: 32646 microversion: 2.1 time: 0.089512 Oct 04 21:13:35.670585 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2929/5892] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 21:13:35 2022] POST /compute/v2.1/servers/d5d53aea-3534-49f6-bb2c-b0f67bfd5abf/action => generated 32646 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 21:13:36.936990 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-e59d1525-36c6-40a9-b8a1-06ff97b46caa tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:36.937587 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-e59d1525-36c6-40a9-b8a1-06ff97b46caa tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] [instance: d5d53aea-3534-49f6-bb2c-b0f67bfd5abf] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:36.950664 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:13:36.951293 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=63,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:13:36.952850 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e59d1525-36c6-40a9-b8a1-06ff97b46caa tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:36.955591 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e59d1525-36c6-40a9-b8a1-06ff97b46caa tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:36.956281 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e59d1525-36c6-40a9-b8a1-06ff97b46caa tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:36.957250 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e59d1525-36c6-40a9-b8a1-06ff97b46caa tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:36.957700 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e59d1525-36c6-40a9-b8a1-06ff97b46caa tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:36.958132 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e59d1525-36c6-40a9-b8a1-06ff97b46caa tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:36.960247 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-8bf81e49-6749-491c-96f8-14e96344652f req-b8b20996-50eb-4f00-8b05-bd5c917da22d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5d53aea-3534-49f6-bb2c-b0f67bfd5abf", "tag": "d0209023-c5dd-4b1b-b5ec-f60a23eda3a0"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:13:36.991451 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-8bf81e49-6749-491c-96f8-14e96344652f req-b8b20996-50eb-4f00-8b05-bd5c917da22d service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:36.991934 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-e59d1525-36c6-40a9-b8a1-06ff97b46caa tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] [instance: d5d53aea-3534-49f6-bb2c-b0f67bfd5abf] Going to try to terminate instance {{(pid=128802) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:13:36.994080 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-8bf81e49-6749-491c-96f8-14e96344652f req-b8b20996-50eb-4f00-8b05-bd5c917da22d service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:36.995698 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-8bf81e49-6749-491c-96f8-14e96344652f req-b8b20996-50eb-4f00-8b05-bd5c917da22d service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:37.016364 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-8bf81e49-6749-491c-96f8-14e96344652f req-b8b20996-50eb-4f00-8b05-bd5c917da22d service nova] Creating event network-changed:d0209023-c5dd-4b1b-b5ec-f60a23eda3a0 for instance d5d53aea-3534-49f6-bb2c-b0f67bfd5abf on n-h1-854823-8 Oct 04 21:13:37.022013 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-8bf81e49-6749-491c-96f8-14e96344652f req-b8b20996-50eb-4f00-8b05-bd5c917da22d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066396 Oct 04 21:13:37.023254 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2930/5893] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:13:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:13:37.150465 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-e59d1525-36c6-40a9-b8a1-06ff97b46caa tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] 10.222.0.33 "DELETE /compute/v2.1/servers/d5d53aea-3534-49f6-bb2c-b0f67bfd5abf" status: 204 len: 0 microversion: 2.1 time: 0.217598 Oct 04 21:13:37.152523 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2964/5894] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 21:13:36 2022] DELETE /compute/v2.1/servers/d5d53aea-3534-49f6-bb2c-b0f67bfd5abf => generated 0 bytes in 221 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:13:37.162468 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c9b31d40-c843-4804-9eee-319564978e77 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:37.163549 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c9b31d40-c843-4804-9eee-319564978e77 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] [instance: d5d53aea-3534-49f6-bb2c-b0f67bfd5abf] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:37.176934 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c9b31d40-c843-4804-9eee-319564978e77 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:37.178064 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c9b31d40-c843-4804-9eee-319564978e77 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:37.178829 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c9b31d40-c843-4804-9eee-319564978e77 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:37.180038 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c9b31d40-c843-4804-9eee-319564978e77 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:37.180966 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c9b31d40-c843-4804-9eee-319564978e77 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:37.181458 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c9b31d40-c843-4804-9eee-319564978e77 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:37.700661 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c9b31d40-c843-4804-9eee-319564978e77 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33868e2b8733415cb173ae2da3104e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d1916937bd4cdfbe053d3c84ffa738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:37.717392 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c9b31d40-c843-4804-9eee-319564978e77 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] 10.222.0.33 "GET /compute/v2.1/servers/d5d53aea-3534-49f6-bb2c-b0f67bfd5abf" status: 200 len: 1670 microversion: 2.1 time: 0.560388 Oct 04 21:13:37.721657 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2931/5895] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:13:37 2022] GET /compute/v2.1/servers/d5d53aea-3534-49f6-bb2c-b0f67bfd5abf => generated 1670 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:13:38.748420 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-77bc4202-62d9-4ead-be22-88d1d4df4c2b tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:38.749429 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-77bc4202-62d9-4ead-be22-88d1d4df4c2b tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] [instance: d5d53aea-3534-49f6-bb2c-b0f67bfd5abf] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:38.761296 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-77bc4202-62d9-4ead-be22-88d1d4df4c2b tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:38.762174 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-77bc4202-62d9-4ead-be22-88d1d4df4c2b tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:38.770836 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-77bc4202-62d9-4ead-be22-88d1d4df4c2b tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:38.773137 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-77bc4202-62d9-4ead-be22-88d1d4df4c2b tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:38.773702 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-77bc4202-62d9-4ead-be22-88d1d4df4c2b tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:38.774151 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-77bc4202-62d9-4ead-be22-88d1d4df4c2b tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:39.111182 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-77bc4202-62d9-4ead-be22-88d1d4df4c2b tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33868e2b8733415cb173ae2da3104e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d1916937bd4cdfbe053d3c84ffa738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:13:39.120350 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-77bc4202-62d9-4ead-be22-88d1d4df4c2b tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] 10.222.0.33 "GET /compute/v2.1/servers/d5d53aea-3534-49f6-bb2c-b0f67bfd5abf" status: 200 len: 1670 microversion: 2.1 time: 0.376530 Oct 04 21:13:39.154842 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2965/5896] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:13:38 2022] GET /compute/v2.1/servers/d5d53aea-3534-49f6-bb2c-b0f67bfd5abf => generated 1670 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:13:39.239687 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-d9a5bdad-846c-4a86-92f8-8ca44d6ff8d9 req-7045064a-6a0c-4349-bba3-700b0245ab0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5d53aea-3534-49f6-bb2c-b0f67bfd5abf", "name": "network-vif-deleted", "tag": "d0209023-c5dd-4b1b-b5ec-f60a23eda3a0"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:13:39.253595 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-d9a5bdad-846c-4a86-92f8-8ca44d6ff8d9 req-7045064a-6a0c-4349-bba3-700b0245ab0a service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:39.254076 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-d9a5bdad-846c-4a86-92f8-8ca44d6ff8d9 req-7045064a-6a0c-4349-bba3-700b0245ab0a service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:39.254532 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-d9a5bdad-846c-4a86-92f8-8ca44d6ff8d9 req-7045064a-6a0c-4349-bba3-700b0245ab0a service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:39.267369 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-d9a5bdad-846c-4a86-92f8-8ca44d6ff8d9 req-7045064a-6a0c-4349-bba3-700b0245ab0a service nova] Creating event network-vif-deleted:d0209023-c5dd-4b1b-b5ec-f60a23eda3a0 for instance d5d53aea-3534-49f6-bb2c-b0f67bfd5abf on n-h1-854823-8 Oct 04 21:13:39.273023 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-d9a5bdad-846c-4a86-92f8-8ca44d6ff8d9 req-7045064a-6a0c-4349-bba3-700b0245ab0a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038836 Oct 04 21:13:39.273984 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2932/5897] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:13:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:13:40.147165 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-ab98b65f-d5b6-4747-af6c-be5974957123 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:40.147978 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-ab98b65f-d5b6-4747-af6c-be5974957123 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] [instance: d5d53aea-3534-49f6-bb2c-b0f67bfd5abf] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:40.156064 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ab98b65f-d5b6-4747-af6c-be5974957123 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:40.157332 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ab98b65f-d5b6-4747-af6c-be5974957123 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:40.157928 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ab98b65f-d5b6-4747-af6c-be5974957123 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:40.158914 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ab98b65f-d5b6-4747-af6c-be5974957123 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:40.159476 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ab98b65f-d5b6-4747-af6c-be5974957123 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:40.160013 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ab98b65f-d5b6-4747-af6c-be5974957123 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:40.175907 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.wsgi [None req-ab98b65f-d5b6-4747-af6c-be5974957123 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] HTTP exception thrown: Instance d5d53aea-3534-49f6-bb2c-b0f67bfd5abf could not be found. Oct 04 21:13:40.177766 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-ab98b65f-d5b6-4747-af6c-be5974957123 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Request method failure captured: Oct 04 21:13:40.177766 n-d-854823-8 devstack@n-api.service[128802]: request: GET /compute/v2.1/servers/d5d53aea-3534-49f6-bb2c-b0f67bfd5abf HTTP/1.1 Oct 04 21:13:40.177766 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 21:13:40.177766 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 21:13:40.177766 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 21:13:40.177766 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 0 Oct 04 21:13:40.177766 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 21:13:40.177766 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 21:13:40.177766 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 21:13:40.177766 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 21:13:40.177766 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPKEyEe-tRle88O1Iy6yebj-ff3WMBIUQU7rDd-NHIrBXkxuAo15igKF1S0jifBh-8nW5V9kVfH5g2_Cvo8KolxmuljORMqJTx994LZ5WqWB0w1h68CI6_P2MX3_wS-4QrEzETReflypEWMt2EgCYRAFeO8JX21iYoFt9ZtuJoDYtWUo Oct 04 21:13:40.177766 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 21:13:40.177766 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 21:13:40.177766 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 21:13:40.177766 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 21:13:40.177766 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 21:13:40.177766 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 21:13:40.177766 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: 65d1916937bd4cdfbe053d3c84ffa738 Oct 04 21:13:40.177766 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-TestNetworkBasicOps-860566722 Oct 04 21:13:40.177766 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 21:13:40.177766 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 21:13:40.177766 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_65d1916937bd4cdfbe053d3c84ffa738", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/65d1916937bd4cdfbe053d3c84ffa738"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/65d1916937bd4cdfbe053d3c84ffa738"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/65d1916937bd4cdfbe053d3c84ffa738"}]}] Oct 04 21:13:40.177766 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-TestNetworkBasicOps-860566722 Oct 04 21:13:40.177766 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: 65d1916937bd4cdfbe053d3c84ffa738 Oct 04 21:13:40.177766 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-TestNetworkBasicOps-860566722 Oct 04 21:13:40.177766 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-TestNetworkBasicOps-860566722-project Oct 04 21:13:40.177766 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 21:13:40.177766 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 21:13:40.177766 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: 33868e2b8733415cb173ae2da3104e1d Oct 04 21:13:40.177766 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-TestNetworkBasicOps-860566722-project Oct 04 21:13:40.177766 n-d-854823-8 devstack@n-api.service[128802]: method: > Oct 04 21:13:40.177766 n-d-854823-8 devstack@n-api.service[128802]: exception: Instance d5d53aea-3534-49f6-bb2c-b0f67bfd5abf could not be found. Oct 04 21:13:40.177766 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'id': 'd5d53aea-3534-49f6-bb2c-b0f67bfd5abf'} Oct 04 21:13:40.177766 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:13:40.177766 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:13:40.177766 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:13:40.177766 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:13:40.177766 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:13:40.177766 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:13:40.177766 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:13:40.177766 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:13:40.177766 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:13:40.177766 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:13:40.177766 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d5d53aea-3534-49f6-bb2c-b0f67bfd5abf could not be found. Oct 04 21:13:40.177766 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:13:40.177766 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:13:40.177766 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:13:40.177766 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:13:40.177766 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:13:40.177766 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:13:40.177766 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:13:40.177766 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:13:40.177766 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:13:40.177766 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:13:40.177766 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:13:40.177766 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:13:40.177766 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:13:40.177766 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:13:40.177766 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:13:40.177766 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:13:40.177766 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d5d53aea-3534-49f6-bb2c-b0f67bfd5abf could not be found. Oct 04 21:13:40.177766 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:13:40.177766 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:13:40.177766 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:13:40.182925 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:13:40.182925 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:13:40.182925 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:13:40.182925 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:13:40.182925 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:13:40.182925 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d5d53aea-3534-49f6-bb2c-b0f67bfd5abf could not be found. Oct 04 21:13:40.182925 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:13:40.182925 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-ab98b65f-d5b6-4747-af6c-be5974957123 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Returning 404 to user: Instance d5d53aea-3534-49f6-bb2c-b0f67bfd5abf could not be found. {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:13:40.184134 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-ab98b65f-d5b6-4747-af6c-be5974957123 tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] 10.222.0.33 "GET /compute/v2.1/servers/d5d53aea-3534-49f6-bb2c-b0f67bfd5abf" status: 404 len: 111 microversion: 2.1 time: 0.040816 Oct 04 21:13:40.187685 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2966/5898] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:13:40 2022] GET /compute/v2.1/servers/d5d53aea-3534-49f6-bb2c-b0f67bfd5abf => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 21:13:40.387073 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a968709f-86ea-4bed-8590-6f94af75465a tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] Calling method '.version_select at 0x7f3c6fa32040>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:40.411019 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a968709f-86ea-4bed-8590-6f94af75465a tempest-TestNetworkBasicOps-860566722 tempest-TestNetworkBasicOps-860566722-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1817751442" status: 202 len: 0 microversion: 2.1 time: 0.029235 Oct 04 21:13:40.411623 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2933/5899] 10.222.0.33 () {58 vars in 1257 bytes} [Tue Oct 4 21:13:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1817751442 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:13:55.867066 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-f12bf19c-7dd4-4f67-b1f3-b1a0ff8ab6ad tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:13:55.868205 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-f12bf19c-7dd4-4f67-b1f3-b1a0ff8ab6ad tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] [instance: ee498771-2772-4363-9f41-c400a7f73e43] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:55.871274 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:13:55.872095 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:13:55.878494 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f12bf19c-7dd4-4f67-b1f3-b1a0ff8ab6ad tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:55.879129 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f12bf19c-7dd4-4f67-b1f3-b1a0ff8ab6ad tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:55.879589 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f12bf19c-7dd4-4f67-b1f3-b1a0ff8ab6ad tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:55.880376 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f12bf19c-7dd4-4f67-b1f3-b1a0ff8ab6ad tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:55.880842 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f12bf19c-7dd4-4f67-b1f3-b1a0ff8ab6ad tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:55.881453 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f12bf19c-7dd4-4f67-b1f3-b1a0ff8ab6ad tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:55.912011 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-f12bf19c-7dd4-4f67-b1f3-b1a0ff8ab6ad tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] 10.222.0.33 "GET /compute/v2.1/servers/ee498771-2772-4363-9f41-c400a7f73e43/ips" status: 200 len: 147 microversion: 2.1 time: 0.049057 Oct 04 21:13:55.912606 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2967/5900] 10.222.0.33 () {58 vars in 1248 bytes} [Tue Oct 4 21:13:55 2022] GET /compute/v2.1/servers/ee498771-2772-4363-9f41-c400a7f73e43/ips => generated 147 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:13:57.340551 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f3daa220-e9f5-4a15-a21a-765a0ae11cb1 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "480ce291-12f6-4056-9f52-c03f5909155b"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:13:57.345254 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f3daa220-e9f5-4a15-a21a-765a0ae11cb1 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] [instance: ee498771-2772-4363-9f41-c400a7f73e43] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:13:57.351762 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=14 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:13:57.352642 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=11,nova_api:DELETE=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:13:57.358423 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f3daa220-e9f5-4a15-a21a-765a0ae11cb1 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:57.359049 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f3daa220-e9f5-4a15-a21a-765a0ae11cb1 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:57.360139 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f3daa220-e9f5-4a15-a21a-765a0ae11cb1 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:57.361195 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f3daa220-e9f5-4a15-a21a-765a0ae11cb1 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:13:57.361696 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f3daa220-e9f5-4a15-a21a-765a0ae11cb1 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:13:57.362133 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f3daa220-e9f5-4a15-a21a-765a0ae11cb1 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:13:57.706081 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f3daa220-e9f5-4a15-a21a-765a0ae11cb1 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] 10.222.0.33 "POST /compute/v2.1/servers/ee498771-2772-4363-9f41-c400a7f73e43/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.371057 Oct 04 21:13:57.710750 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2934/5901] 10.222.0.33 () {60 vars in 1323 bytes} [Tue Oct 4 21:13:57 2022] POST /compute/v2.1/servers/ee498771-2772-4363-9f41-c400a7f73e43/os-volume_attachments => generated 194 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:14:09.763341 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-3cd18bc5-1eff-4e03-a19f-6d35907b272e tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:14:09.766040 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-3cd18bc5-1eff-4e03-a19f-6d35907b272e tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] [instance: ee498771-2772-4363-9f41-c400a7f73e43] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:14:09.769305 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_api:SELECT=2 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:14:09.770157 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=4 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:14:09.776458 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3cd18bc5-1eff-4e03-a19f-6d35907b272e tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:09.776968 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3cd18bc5-1eff-4e03-a19f-6d35907b272e tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:09.777402 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3cd18bc5-1eff-4e03-a19f-6d35907b272e tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:09.778106 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3cd18bc5-1eff-4e03-a19f-6d35907b272e tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:09.778822 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3cd18bc5-1eff-4e03-a19f-6d35907b272e tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:09.779239 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3cd18bc5-1eff-4e03-a19f-6d35907b272e tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:09.810578 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-3cd18bc5-1eff-4e03-a19f-6d35907b272e tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] 10.222.0.33 "GET /compute/v2.1/servers/ee498771-2772-4363-9f41-c400a7f73e43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051183 Oct 04 21:14:09.811389 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2968/5902] 10.222.0.33 () {58 vars in 1302 bytes} [Tue Oct 4 21:14:09 2022] GET /compute/v2.1/servers/ee498771-2772-4363-9f41-c400a7f73e43/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:14:09.820267 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:14:09.821715 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:14:09.826682 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-39947408-36d6-4b88-bdfb-8d6ea4005488 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:14:09.827472 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-39947408-36d6-4b88-bdfb-8d6ea4005488 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] [instance: ee498771-2772-4363-9f41-c400a7f73e43] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:14:09.835803 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-39947408-36d6-4b88-bdfb-8d6ea4005488 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:09.836296 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-39947408-36d6-4b88-bdfb-8d6ea4005488 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:09.836876 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-39947408-36d6-4b88-bdfb-8d6ea4005488 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:09.837703 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-39947408-36d6-4b88-bdfb-8d6ea4005488 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:09.838164 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-39947408-36d6-4b88-bdfb-8d6ea4005488 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:09.838610 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-39947408-36d6-4b88-bdfb-8d6ea4005488 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:09.875996 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-39947408-36d6-4b88-bdfb-8d6ea4005488 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] 10.222.0.33 "GET /compute/v2.1/servers/ee498771-2772-4363-9f41-c400a7f73e43/os-volume_attachments/480ce291-12f6-4056-9f52-c03f5909155b" status: 200 len: 194 microversion: 2.1 time: 0.057548 Oct 04 21:14:09.881651 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2935/5903] 10.222.0.33 () {58 vars in 1413 bytes} [Tue Oct 4 21:14:09 2022] GET /compute/v2.1/servers/ee498771-2772-4363-9f41-c400a7f73e43/os-volume_attachments/480ce291-12f6-4056-9f52-c03f5909155b => generated 194 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:14:11.289997 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-95ea4d85-05bf-4c3c-b4f7-c88efd190a0a tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "387290ae-0ed1-4153-b50a-2c8d8e86b738"}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:14:11.299424 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-95ea4d85-05bf-4c3c-b4f7-c88efd190a0a tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] [instance: ee498771-2772-4363-9f41-c400a7f73e43] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:14:11.302244 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-95ea4d85-05bf-4c3c-b4f7-c88efd190a0a tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:11.302944 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-95ea4d85-05bf-4c3c-b4f7-c88efd190a0a tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:11.303397 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-95ea4d85-05bf-4c3c-b4f7-c88efd190a0a tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:11.304154 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-95ea4d85-05bf-4c3c-b4f7-c88efd190a0a tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:11.304618 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-95ea4d85-05bf-4c3c-b4f7-c88efd190a0a tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:11.305052 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-95ea4d85-05bf-4c3c-b4f7-c88efd190a0a tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:11.649045 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-95ea4d85-05bf-4c3c-b4f7-c88efd190a0a tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] 10.222.0.33 "POST /compute/v2.1/servers/ee498771-2772-4363-9f41-c400a7f73e43/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.362977 Oct 04 21:14:11.649919 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2969/5904] 10.222.0.33 () {60 vars in 1323 bytes} [Tue Oct 4 21:14:11 2022] POST /compute/v2.1/servers/ee498771-2772-4363-9f41-c400a7f73e43/os-volume_attachments => generated 194 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:14:23.580703 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ac0d9119-c527-4040-bfc6-7ab35a478922 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:14:23.583714 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ac0d9119-c527-4040-bfc6-7ab35a478922 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] [instance: ee498771-2772-4363-9f41-c400a7f73e43] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:14:23.594134 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:14:23.595659 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=6 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:14:23.597680 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ac0d9119-c527-4040-bfc6-7ab35a478922 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:23.598373 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ac0d9119-c527-4040-bfc6-7ab35a478922 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:23.599435 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ac0d9119-c527-4040-bfc6-7ab35a478922 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:23.600358 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ac0d9119-c527-4040-bfc6-7ab35a478922 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:23.600977 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ac0d9119-c527-4040-bfc6-7ab35a478922 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:23.601612 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ac0d9119-c527-4040-bfc6-7ab35a478922 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:23.642756 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ac0d9119-c527-4040-bfc6-7ab35a478922 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] 10.222.0.33 "GET /compute/v2.1/servers/ee498771-2772-4363-9f41-c400a7f73e43/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.066331 Oct 04 21:14:23.644155 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2936/5905] 10.222.0.33 () {58 vars in 1302 bytes} [Tue Oct 4 21:14:23 2022] GET /compute/v2.1/servers/ee498771-2772-4363-9f41-c400a7f73e43/os-volume_attachments => generated 371 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:14:23.784623 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_api:SELECT=4 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:14:23.785841 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:14:23.795681 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-06af130a-bf12-4708-b4d0-0d4e3e520e1e tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:14:23.797142 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-06af130a-bf12-4708-b4d0-0d4e3e520e1e tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] [instance: ee498771-2772-4363-9f41-c400a7f73e43] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:14:23.820232 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-06af130a-bf12-4708-b4d0-0d4e3e520e1e tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:23.821163 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-06af130a-bf12-4708-b4d0-0d4e3e520e1e tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:23.821776 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-06af130a-bf12-4708-b4d0-0d4e3e520e1e tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:23.822644 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-06af130a-bf12-4708-b4d0-0d4e3e520e1e tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:23.823313 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-06af130a-bf12-4708-b4d0-0d4e3e520e1e tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:23.823951 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-06af130a-bf12-4708-b4d0-0d4e3e520e1e tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:23.862949 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-06af130a-bf12-4708-b4d0-0d4e3e520e1e tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] 10.222.0.33 "GET /compute/v2.1/servers/ee498771-2772-4363-9f41-c400a7f73e43/os-volume_attachments/480ce291-12f6-4056-9f52-c03f5909155b" status: 200 len: 194 microversion: 2.1 time: 0.080201 Oct 04 21:14:23.864163 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2970/5906] 10.222.0.33 () {58 vars in 1413 bytes} [Tue Oct 4 21:14:23 2022] GET /compute/v2.1/servers/ee498771-2772-4363-9f41-c400a7f73e43/os-volume_attachments/480ce291-12f6-4056-9f52-c03f5909155b => generated 194 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:14:23.877655 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5805fce5-aefc-42b4-878b-01ea529fd1fc tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:14:23.878860 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-5805fce5-aefc-42b4-878b-01ea529fd1fc tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] [instance: ee498771-2772-4363-9f41-c400a7f73e43] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:14:23.889391 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5805fce5-aefc-42b4-878b-01ea529fd1fc tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:23.891052 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5805fce5-aefc-42b4-878b-01ea529fd1fc tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:23.891695 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5805fce5-aefc-42b4-878b-01ea529fd1fc tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:23.893280 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5805fce5-aefc-42b4-878b-01ea529fd1fc tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:23.894708 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5805fce5-aefc-42b4-878b-01ea529fd1fc tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:23.895336 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5805fce5-aefc-42b4-878b-01ea529fd1fc tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:24.024882 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-5805fce5-aefc-42b4-878b-01ea529fd1fc tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lazy-loading 'services' on Instance uuid ee498771-2772-4363-9f41-c400a7f73e43 {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:14:24.142095 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5805fce5-aefc-42b4-878b-01ea529fd1fc tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] 10.222.0.33 "DELETE /compute/v2.1/servers/ee498771-2772-4363-9f41-c400a7f73e43/os-volume_attachments/480ce291-12f6-4056-9f52-c03f5909155b" status: 202 len: 0 microversion: 2.1 time: 0.269377 Oct 04 21:14:24.144421 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2937/5907] 10.222.0.33 () {58 vars in 1416 bytes} [Tue Oct 4 21:14:23 2022] DELETE /compute/v2.1/servers/ee498771-2772-4363-9f41-c400a7f73e43/os-volume_attachments/480ce291-12f6-4056-9f52-c03f5909155b => generated 0 bytes in 273 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:14:30.996127 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-aa3f0215-229d-420e-b230-48f1d137ae80 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:14:30.996615 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-aa3f0215-229d-420e-b230-48f1d137ae80 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] [instance: ee498771-2772-4363-9f41-c400a7f73e43] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:14:31.014572 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-aa3f0215-229d-420e-b230-48f1d137ae80 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:31.016135 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-aa3f0215-229d-420e-b230-48f1d137ae80 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:31.018031 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-aa3f0215-229d-420e-b230-48f1d137ae80 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:31.019408 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-aa3f0215-229d-420e-b230-48f1d137ae80 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:31.020429 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-aa3f0215-229d-420e-b230-48f1d137ae80 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:31.021678 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-aa3f0215-229d-420e-b230-48f1d137ae80 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:31.082506 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-aa3f0215-229d-420e-b230-48f1d137ae80 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] 10.222.0.33 "GET /compute/v2.1/servers/ee498771-2772-4363-9f41-c400a7f73e43/os-volume_attachments/387290ae-0ed1-4153-b50a-2c8d8e86b738" status: 200 len: 194 microversion: 2.1 time: 0.089981 Oct 04 21:14:31.084263 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2971/5908] 10.222.0.33 () {58 vars in 1413 bytes} [Tue Oct 4 21:14:30 2022] GET /compute/v2.1/servers/ee498771-2772-4363-9f41-c400a7f73e43/os-volume_attachments/387290ae-0ed1-4153-b50a-2c8d8e86b738 => generated 194 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:14:31.101081 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-09f02967-df25-4c1f-ad54-2ca499756b74 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:14:31.103135 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-09f02967-df25-4c1f-ad54-2ca499756b74 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] [instance: ee498771-2772-4363-9f41-c400a7f73e43] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:14:31.120622 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-09f02967-df25-4c1f-ad54-2ca499756b74 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:31.121206 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-09f02967-df25-4c1f-ad54-2ca499756b74 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:31.121891 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-09f02967-df25-4c1f-ad54-2ca499756b74 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:31.122847 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-09f02967-df25-4c1f-ad54-2ca499756b74 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:31.123519 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-09f02967-df25-4c1f-ad54-2ca499756b74 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:31.124136 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-09f02967-df25-4c1f-ad54-2ca499756b74 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:31.262079 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-09f02967-df25-4c1f-ad54-2ca499756b74 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lazy-loading 'services' on Instance uuid ee498771-2772-4363-9f41-c400a7f73e43 {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:14:31.388290 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-09f02967-df25-4c1f-ad54-2ca499756b74 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] 10.222.0.33 "DELETE /compute/v2.1/servers/ee498771-2772-4363-9f41-c400a7f73e43/os-volume_attachments/387290ae-0ed1-4153-b50a-2c8d8e86b738" status: 202 len: 0 microversion: 2.1 time: 0.296656 Oct 04 21:14:31.388919 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2938/5909] 10.222.0.33 () {58 vars in 1416 bytes} [Tue Oct 4 21:14:31 2022] DELETE /compute/v2.1/servers/ee498771-2772-4363-9f41-c400a7f73e43/os-volume_attachments/387290ae-0ed1-4153-b50a-2c8d8e86b738 => generated 0 bytes in 299 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:14:35.897358 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-32bdc441-9b35-4ae3-937c-e878bc4236d7 tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] Action: 'create', calling method: .version_select at 0x7f3c6f54c3a0>, body: {"keypair": {"name": "tempest-TestServerBasicOps-1029091984", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM9kX4jV1/cANHgO80pGomvXz+Ypuj/5MruXCTf1tuYJJ4hqLUR7QnaNtfdHbXN6D9Xx68K8lRsRVU3RQJruardyV0NKcX/e830x86Hdj0pxoPIzlvRxghFQj7y8ccIPkQ=="}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:14:35.920379 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-32bdc441-9b35-4ae3-937c-e878bc4236d7 tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] Getting quotas for project a0f466d19559425083099ae2d772a6ce. Resources: {'key_pairs'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:14:35.931563 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-32bdc441-9b35-4ae3-937c-e878bc4236d7 tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] Getting quotas for user 4a438c7644414fa4be4f0333fb914e58 and project a0f466d19559425083099ae2d772a6ce. Resources: {'key_pairs'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:14:35.975313 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-32bdc441-9b35-4ae3-937c-e878bc4236d7 tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.414617 Oct 04 21:14:35.978829 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2972/5910] 10.222.0.33 () {60 vars in 1159 bytes} [Tue Oct 4 21:14:35 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:14:37.554841 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5ba22546-255c-404c-864f-468a224b5dfe tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerBasicOps-server-1673199520", "imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63", "flavorRef": "452", "key_name": "tempest-TestServerBasicOps-1029091984", "security_groups": [{"name": "tempest-secgroup-smoke-1006788302"}], "config_drive": true, "metadata": {"meta1": "data1", "meta2": "data2", "metaN": "dataN"}, "networks": [{"uuid": "8ca8cc2e-68c9-4b7b-9f5c-a3f96431ab2d"}]}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:14:37.680119 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.network.neutron [None req-5ba22546-255c-404c-864f-468a224b5dfe tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] validate_networks() for [('8ca8cc2e-68c9-4b7b-9f5c-a3f96431ab2d', None, None, None, None, None)] {{(pid=128801) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:14:38.263686 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-5ba22546-255c-404c-864f-468a224b5dfe tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] Getting quotas for project a0f466d19559425083099ae2d772a6ce. Resources: dict_keys(['metadata_items']) {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:14:38.270958 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-5ba22546-255c-404c-864f-468a224b5dfe tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] Getting quotas for user 4a438c7644414fa4be4f0333fb914e58 and project a0f466d19559425083099ae2d772a6ce. Resources: dict_keys(['metadata_items']) {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:14:38.286767 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-5ba22546-255c-404c-864f-468a224b5dfe tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] Flavor limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:14:38.287438 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-5ba22546-255c-404c-864f-468a224b5dfe tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] Image limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:14:38.288077 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-5ba22546-255c-404c-864f-468a224b5dfe tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] Flavor pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:14:38.288646 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-5ba22546-255c-404c-864f-468a224b5dfe tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] Image pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:14:38.289222 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-5ba22546-255c-404c-864f-468a224b5dfe tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:14:38.299166 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5ba22546-255c-404c-864f-468a224b5dfe tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:38.299906 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5ba22546-255c-404c-864f-468a224b5dfe tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:38.300503 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5ba22546-255c-404c-864f-468a224b5dfe tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:38.301527 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5ba22546-255c-404c-864f-468a224b5dfe tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:38.302140 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5ba22546-255c-404c-864f-468a224b5dfe tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:38.302794 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5ba22546-255c-404c-864f-468a224b5dfe tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:38.322171 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-5ba22546-255c-404c-864f-468a224b5dfe tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] Getting quotas for project a0f466d19559425083099ae2d772a6ce. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:14:38.328887 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-5ba22546-255c-404c-864f-468a224b5dfe tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] Getting quotas for user 4a438c7644414fa4be4f0333fb914e58 and project a0f466d19559425083099ae2d772a6ce. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:14:38.342945 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-5ba22546-255c-404c-864f-468a224b5dfe tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] Going to run 1 instances... {{(pid=128801) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:14:38.346463 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-5ba22546-255c-404c-864f-468a224b5dfe tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] [instance: a9f76c1f-d6c5-4bb5-b4e3-71dd08a7f92f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='15b24725-0c99-4bcf-b1fb-907cdf8e2d63',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128801) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:14:38.429091 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5ba22546-255c-404c-864f-468a224b5dfe tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.878338 Oct 04 21:14:38.430195 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2939/5911] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 21:14:37 2022] POST /compute/v2.1/servers => generated 406 bytes in 882 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:14:38.444721 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-0e302180-3b68-404b-aae6-d9610653c57b tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:14:38.445448 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-0e302180-3b68-404b-aae6-d9610653c57b tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] [instance: a9f76c1f-d6c5-4bb5-b4e3-71dd08a7f92f] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:14:38.551787 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-0e302180-3b68-404b-aae6-d9610653c57b tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a438c7644414fa4be4f0333fb914e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f466d19559425083099ae2d772a6ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:14:38.559932 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-0e302180-3b68-404b-aae6-d9610653c57b tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f76c1f-d6c5-4bb5-b4e3-71dd08a7f92f" status: 200 len: 1303 microversion: 2.1 time: 0.121180 Oct 04 21:14:38.560532 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2973/5912] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:14:38 2022] GET /compute/v2.1/servers/a9f76c1f-d6c5-4bb5-b4e3-71dd08a7f92f => generated 1303 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:14:39.458392 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6e3896a4-8494-4544-be0d-10c1df3ed081 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:14:39.462977 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-6e3896a4-8494-4544-be0d-10c1df3ed081 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] [instance: ee498771-2772-4363-9f41-c400a7f73e43] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:14:39.474087 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6e3896a4-8494-4544-be0d-10c1df3ed081 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:39.474642 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6e3896a4-8494-4544-be0d-10c1df3ed081 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:39.475085 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6e3896a4-8494-4544-be0d-10c1df3ed081 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:39.475797 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6e3896a4-8494-4544-be0d-10c1df3ed081 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:39.476252 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6e3896a4-8494-4544-be0d-10c1df3ed081 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:39.476675 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6e3896a4-8494-4544-be0d-10c1df3ed081 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:39.518240 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-6e3896a4-8494-4544-be0d-10c1df3ed081 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] 10.222.0.33 "GET /compute/v2.1/servers/ee498771-2772-4363-9f41-c400a7f73e43/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.064201 Oct 04 21:14:39.523346 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2940/5913] 10.222.0.33 () {58 vars in 1302 bytes} [Tue Oct 4 21:14:39 2022] GET /compute/v2.1/servers/ee498771-2772-4363-9f41-c400a7f73e43/os-volume_attachments => generated 25 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 21:14:39.591882 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-966dff1c-0652-4a41-a2c2-132d8793b301 tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:14:39.592910 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-966dff1c-0652-4a41-a2c2-132d8793b301 tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] [instance: a9f76c1f-d6c5-4bb5-b4e3-71dd08a7f92f] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:14:39.603623 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-966dff1c-0652-4a41-a2c2-132d8793b301 tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:39.604245 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-966dff1c-0652-4a41-a2c2-132d8793b301 tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:39.604767 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-966dff1c-0652-4a41-a2c2-132d8793b301 tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:39.605564 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-966dff1c-0652-4a41-a2c2-132d8793b301 tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:39.606104 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-966dff1c-0652-4a41-a2c2-132d8793b301 tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:39.606654 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-966dff1c-0652-4a41-a2c2-132d8793b301 tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:39.670317 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-51b73209-ae25-4617-825f-9c7db95ec498 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:14:39.672939 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-51b73209-ae25-4617-825f-9c7db95ec498 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] [instance: ee498771-2772-4363-9f41-c400a7f73e43] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:14:39.680354 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-51b73209-ae25-4617-825f-9c7db95ec498 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:39.681248 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-51b73209-ae25-4617-825f-9c7db95ec498 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:39.681868 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-51b73209-ae25-4617-825f-9c7db95ec498 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:39.682829 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-51b73209-ae25-4617-825f-9c7db95ec498 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:39.683499 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-51b73209-ae25-4617-825f-9c7db95ec498 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:39.684079 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-51b73209-ae25-4617-825f-9c7db95ec498 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:39.712105 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-966dff1c-0652-4a41-a2c2-132d8793b301 tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a438c7644414fa4be4f0333fb914e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f466d19559425083099ae2d772a6ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:14:39.722791 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-966dff1c-0652-4a41-a2c2-132d8793b301 tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f76c1f-d6c5-4bb5-b4e3-71dd08a7f92f" status: 200 len: 1355 microversion: 2.1 time: 0.134776 Oct 04 21:14:39.738757 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2974/5914] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:14:39 2022] GET /compute/v2.1/servers/a9f76c1f-d6c5-4bb5-b4e3-71dd08a7f92f => generated 1355 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:14:39.742131 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-51b73209-ae25-4617-825f-9c7db95ec498 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] 10.222.0.33 "GET /compute/v2.1/servers/ee498771-2772-4363-9f41-c400a7f73e43/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.076304 Oct 04 21:14:39.742884 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2941/5915] 10.222.0.33 () {58 vars in 1302 bytes} [Tue Oct 4 21:14:39 2022] GET /compute/v2.1/servers/ee498771-2772-4363-9f41-c400a7f73e43/os-volume_attachments => generated 25 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 21:14:39.836800 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-92bb83a0-2fe0-48cb-ae6d-2f75634a0e8b tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:14:39.837504 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-92bb83a0-2fe0-48cb-ae6d-2f75634a0e8b tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] [instance: ee498771-2772-4363-9f41-c400a7f73e43] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:14:39.845186 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-92bb83a0-2fe0-48cb-ae6d-2f75634a0e8b tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:39.846723 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-92bb83a0-2fe0-48cb-ae6d-2f75634a0e8b tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:39.847399 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-92bb83a0-2fe0-48cb-ae6d-2f75634a0e8b tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:39.848432 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-92bb83a0-2fe0-48cb-ae6d-2f75634a0e8b tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:39.848974 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-92bb83a0-2fe0-48cb-ae6d-2f75634a0e8b tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:39.849478 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-92bb83a0-2fe0-48cb-ae6d-2f75634a0e8b tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:39.910700 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-92bb83a0-2fe0-48cb-ae6d-2f75634a0e8b tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] [instance: ee498771-2772-4363-9f41-c400a7f73e43] Going to try to terminate instance {{(pid=128802) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:14:40.146452 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-92bb83a0-2fe0-48cb-ae6d-2f75634a0e8b tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] 10.222.0.33 "DELETE /compute/v2.1/servers/ee498771-2772-4363-9f41-c400a7f73e43" status: 204 len: 0 microversion: 2.1 time: 0.313322 Oct 04 21:14:40.147422 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2975/5916] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 21:14:39 2022] DELETE /compute/v2.1/servers/ee498771-2772-4363-9f41-c400a7f73e43 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:14:40.155332 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f6770c8d-9a24-4999-9479-8e2c405f708d tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:14:40.156665 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f6770c8d-9a24-4999-9479-8e2c405f708d tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] [instance: ee498771-2772-4363-9f41-c400a7f73e43] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:14:40.164498 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f6770c8d-9a24-4999-9479-8e2c405f708d tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:40.165006 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f6770c8d-9a24-4999-9479-8e2c405f708d tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:40.165444 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f6770c8d-9a24-4999-9479-8e2c405f708d tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:40.166154 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f6770c8d-9a24-4999-9479-8e2c405f708d tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:40.166688 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f6770c8d-9a24-4999-9479-8e2c405f708d tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:40.167115 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f6770c8d-9a24-4999-9479-8e2c405f708d tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:40.350473 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f6770c8d-9a24-4999-9479-8e2c405f708d tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b627e66ccd94b8faabf8ce9f1d2d2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40732638975044868e5a5eb5f4235244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:14:40.374432 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f6770c8d-9a24-4999-9479-8e2c405f708d tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] 10.222.0.33 "GET /compute/v2.1/servers/ee498771-2772-4363-9f41-c400a7f73e43" status: 200 len: 1673 microversion: 2.1 time: 0.222836 Oct 04 21:14:40.380671 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2942/5917] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:14:40 2022] GET /compute/v2.1/servers/ee498771-2772-4363-9f41-c400a7f73e43 => generated 1673 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:14:40.746657 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-ccc8cc75-7895-4d06-b376-0900540002e3 tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:14:40.747422 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-ccc8cc75-7895-4d06-b376-0900540002e3 tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] [instance: a9f76c1f-d6c5-4bb5-b4e3-71dd08a7f92f] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:14:40.755513 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ccc8cc75-7895-4d06-b376-0900540002e3 tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:40.755813 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ccc8cc75-7895-4d06-b376-0900540002e3 tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:40.756157 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ccc8cc75-7895-4d06-b376-0900540002e3 tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:40.757039 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ccc8cc75-7895-4d06-b376-0900540002e3 tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:40.757679 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ccc8cc75-7895-4d06-b376-0900540002e3 tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:40.758100 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ccc8cc75-7895-4d06-b376-0900540002e3 tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:40.945116 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-ccc8cc75-7895-4d06-b376-0900540002e3 tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a438c7644414fa4be4f0333fb914e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f466d19559425083099ae2d772a6ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:14:40.956817 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-ccc8cc75-7895-4d06-b376-0900540002e3 tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f76c1f-d6c5-4bb5-b4e3-71dd08a7f92f" status: 200 len: 1429 microversion: 2.1 time: 0.214534 Oct 04 21:14:40.971175 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2976/5918] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:14:40 2022] GET /compute/v2.1/servers/a9f76c1f-d6c5-4bb5-b4e3-71dd08a7f92f => generated 1429 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:14:41.509165 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ab88b553-5bcd-45e2-a3de-6d48f755fe09 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:14:41.511524 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ab88b553-5bcd-45e2-a3de-6d48f755fe09 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] [instance: ee498771-2772-4363-9f41-c400a7f73e43] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:14:41.523628 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ab88b553-5bcd-45e2-a3de-6d48f755fe09 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:41.524498 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ab88b553-5bcd-45e2-a3de-6d48f755fe09 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:41.525096 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ab88b553-5bcd-45e2-a3de-6d48f755fe09 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:41.526006 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ab88b553-5bcd-45e2-a3de-6d48f755fe09 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:41.526664 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ab88b553-5bcd-45e2-a3de-6d48f755fe09 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:41.527664 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ab88b553-5bcd-45e2-a3de-6d48f755fe09 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:41.687088 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-ab88b553-5bcd-45e2-a3de-6d48f755fe09 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b627e66ccd94b8faabf8ce9f1d2d2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40732638975044868e5a5eb5f4235244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:14:41.696982 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ab88b553-5bcd-45e2-a3de-6d48f755fe09 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] 10.222.0.33 "GET /compute/v2.1/servers/ee498771-2772-4363-9f41-c400a7f73e43" status: 200 len: 1673 microversion: 2.1 time: 0.193250 Oct 04 21:14:41.697794 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2943/5919] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:14:41 2022] GET /compute/v2.1/servers/ee498771-2772-4363-9f41-c400a7f73e43 => generated 1673 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:14:41.981767 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-b8ed55ef-b0f8-4005-9939-b7c2be20339b tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:14:41.982603 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-b8ed55ef-b0f8-4005-9939-b7c2be20339b tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] [instance: a9f76c1f-d6c5-4bb5-b4e3-71dd08a7f92f] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:14:41.992697 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b8ed55ef-b0f8-4005-9939-b7c2be20339b tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:41.993326 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b8ed55ef-b0f8-4005-9939-b7c2be20339b tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:41.994015 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b8ed55ef-b0f8-4005-9939-b7c2be20339b tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:41.994990 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b8ed55ef-b0f8-4005-9939-b7c2be20339b tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:41.995663 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b8ed55ef-b0f8-4005-9939-b7c2be20339b tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:41.996305 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b8ed55ef-b0f8-4005-9939-b7c2be20339b tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:42.001459 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-5e48ba4f-e847-4055-b399-bcbdba455dbd req-738139b2-3ba4-4ffb-ad2b-7991203b6c91 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a9f76c1f-d6c5-4bb5-b4e3-71dd08a7f92f", "tag": "9b162135-37b2-4e61-bee2-7e7767a4375f"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:14:42.058918 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-5e48ba4f-e847-4055-b399-bcbdba455dbd req-738139b2-3ba4-4ffb-ad2b-7991203b6c91 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:42.059404 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-5e48ba4f-e847-4055-b399-bcbdba455dbd req-738139b2-3ba4-4ffb-ad2b-7991203b6c91 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:42.063827 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-5e48ba4f-e847-4055-b399-bcbdba455dbd req-738139b2-3ba4-4ffb-ad2b-7991203b6c91 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:42.094906 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-5e48ba4f-e847-4055-b399-bcbdba455dbd req-738139b2-3ba4-4ffb-ad2b-7991203b6c91 service nova] Creating event network-changed:9b162135-37b2-4e61-bee2-7e7767a4375f for instance a9f76c1f-d6c5-4bb5-b4e3-71dd08a7f92f on n-h1-854823-8 Oct 04 21:14:42.101191 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-5e48ba4f-e847-4055-b399-bcbdba455dbd req-738139b2-3ba4-4ffb-ad2b-7991203b6c91 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117087 Oct 04 21:14:42.102600 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2944/5920] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:14:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:14:42.279243 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-b8ed55ef-b0f8-4005-9939-b7c2be20339b tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a438c7644414fa4be4f0333fb914e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f466d19559425083099ae2d772a6ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:14:42.289723 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-b8ed55ef-b0f8-4005-9939-b7c2be20339b tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f76c1f-d6c5-4bb5-b4e3-71dd08a7f92f" status: 200 len: 1429 microversion: 2.1 time: 0.311992 Oct 04 21:14:42.290750 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2977/5921] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:14:41 2022] GET /compute/v2.1/servers/a9f76c1f-d6c5-4bb5-b4e3-71dd08a7f92f => generated 1429 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:14:42.722838 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-82f68d1b-e3b5-4891-b15e-3570e3f62d61 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:14:42.723646 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-82f68d1b-e3b5-4891-b15e-3570e3f62d61 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] [instance: ee498771-2772-4363-9f41-c400a7f73e43] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:14:42.730149 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-82f68d1b-e3b5-4891-b15e-3570e3f62d61 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:42.730634 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-82f68d1b-e3b5-4891-b15e-3570e3f62d61 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:42.731075 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-82f68d1b-e3b5-4891-b15e-3570e3f62d61 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:42.731786 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-82f68d1b-e3b5-4891-b15e-3570e3f62d61 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:42.732248 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-82f68d1b-e3b5-4891-b15e-3570e3f62d61 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:42.732673 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-82f68d1b-e3b5-4891-b15e-3570e3f62d61 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:42.812467 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-82f68d1b-e3b5-4891-b15e-3570e3f62d61 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b627e66ccd94b8faabf8ce9f1d2d2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40732638975044868e5a5eb5f4235244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:14:42.820619 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-82f68d1b-e3b5-4891-b15e-3570e3f62d61 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] 10.222.0.33 "GET /compute/v2.1/servers/ee498771-2772-4363-9f41-c400a7f73e43" status: 200 len: 1606 microversion: 2.1 time: 0.103625 Oct 04 21:14:42.821717 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2945/5922] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:14:42 2022] GET /compute/v2.1/servers/ee498771-2772-4363-9f41-c400a7f73e43 => generated 1606 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:14:43.021309 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-c065ef29-45cd-4266-987f-13d5669a1780 req-a982d20d-076f-46de-8f2d-417beeb32393 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee498771-2772-4363-9f41-c400a7f73e43", "name": "network-vif-deleted", "tag": "777c1d9a-5cc6-4b05-b46e-940563ded193"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:14:43.039479 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-c065ef29-45cd-4266-987f-13d5669a1780 req-a982d20d-076f-46de-8f2d-417beeb32393 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:43.040241 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-c065ef29-45cd-4266-987f-13d5669a1780 req-a982d20d-076f-46de-8f2d-417beeb32393 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:43.040936 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-c065ef29-45cd-4266-987f-13d5669a1780 req-a982d20d-076f-46de-8f2d-417beeb32393 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:43.056106 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-c065ef29-45cd-4266-987f-13d5669a1780 req-a982d20d-076f-46de-8f2d-417beeb32393 service nova] Creating event network-vif-deleted:777c1d9a-5cc6-4b05-b46e-940563ded193 for instance ee498771-2772-4363-9f41-c400a7f73e43 on n-h2-854823-8 Oct 04 21:14:43.062489 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-c065ef29-45cd-4266-987f-13d5669a1780 req-a982d20d-076f-46de-8f2d-417beeb32393 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044216 Oct 04 21:14:43.067692 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2978/5923] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:14:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:14:43.315674 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-57be5d7a-09c8-49dc-8819-e5042a3b1572 tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:14:43.316966 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-57be5d7a-09c8-49dc-8819-e5042a3b1572 tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] [instance: a9f76c1f-d6c5-4bb5-b4e3-71dd08a7f92f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:14:43.325075 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-57be5d7a-09c8-49dc-8819-e5042a3b1572 tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:43.325572 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-57be5d7a-09c8-49dc-8819-e5042a3b1572 tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:43.326005 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-57be5d7a-09c8-49dc-8819-e5042a3b1572 tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:43.326771 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-57be5d7a-09c8-49dc-8819-e5042a3b1572 tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:43.327239 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-57be5d7a-09c8-49dc-8819-e5042a3b1572 tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:43.328531 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-57be5d7a-09c8-49dc-8819-e5042a3b1572 tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:43.518666 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-57be5d7a-09c8-49dc-8819-e5042a3b1572 tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a438c7644414fa4be4f0333fb914e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f466d19559425083099ae2d772a6ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:14:43.528613 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-57be5d7a-09c8-49dc-8819-e5042a3b1572 tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f76c1f-d6c5-4bb5-b4e3-71dd08a7f92f" status: 200 len: 1429 microversion: 2.1 time: 0.217806 Oct 04 21:14:43.529823 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2946/5924] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:14:43 2022] GET /compute/v2.1/servers/a9f76c1f-d6c5-4bb5-b4e3-71dd08a7f92f => generated 1429 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:14:43.847815 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-c42f44c0-4952-4dce-a470-9a8eca28472f tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:14:43.848854 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-c42f44c0-4952-4dce-a470-9a8eca28472f tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] [instance: ee498771-2772-4363-9f41-c400a7f73e43] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:14:43.855442 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c42f44c0-4952-4dce-a470-9a8eca28472f tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:43.856225 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c42f44c0-4952-4dce-a470-9a8eca28472f tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:43.856855 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c42f44c0-4952-4dce-a470-9a8eca28472f tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:43.857769 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c42f44c0-4952-4dce-a470-9a8eca28472f tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:43.858451 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c42f44c0-4952-4dce-a470-9a8eca28472f tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:43.859395 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c42f44c0-4952-4dce-a470-9a8eca28472f tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:43.878235 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.wsgi [None req-c42f44c0-4952-4dce-a470-9a8eca28472f tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] HTTP exception thrown: Instance ee498771-2772-4363-9f41-c400a7f73e43 could not be found. Oct 04 21:14:43.880267 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-c42f44c0-4952-4dce-a470-9a8eca28472f tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Request method failure captured: Oct 04 21:14:43.880267 n-d-854823-8 devstack@n-api.service[128802]: request: GET /compute/v2.1/servers/ee498771-2772-4363-9f41-c400a7f73e43 HTTP/1.1 Oct 04 21:14:43.880267 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 21:14:43.880267 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 21:14:43.880267 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 21:14:43.880267 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 0 Oct 04 21:14:43.880267 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 21:14:43.880267 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 21:14:43.880267 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 21:14:43.880267 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 21:14:43.880267 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPKEq_ZO0UAQ21txoHv_uGPr4ke4uY6LF0fMO4SRP2q-t3S-3tlSOkhKe5gbWdlihAvQbTOhJeKLX8E6zFQOAXT1eJ-d2hXfY576FRPNwsy1BzDc0tNXMiXSxH80lhL-v_X6mVFEWnfz55SHjIJki0VNPkanjCjiPduxjqYDOJkgYlL8 Oct 04 21:14:43.880267 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 21:14:43.880267 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 21:14:43.880267 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 21:14:43.880267 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 21:14:43.880267 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 21:14:43.880267 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 21:14:43.880267 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: 40732638975044868e5a5eb5f4235244 Oct 04 21:14:43.880267 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-AttachVolumeTestJSON-1258499709 Oct 04 21:14:43.880267 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 21:14:43.880267 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 21:14:43.880267 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_40732638975044868e5a5eb5f4235244", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/40732638975044868e5a5eb5f4235244"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/40732638975044868e5a5eb5f4235244"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/40732638975044868e5a5eb5f4235244"}]}] Oct 04 21:14:43.880267 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-AttachVolumeTestJSON-1258499709 Oct 04 21:14:43.880267 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: 40732638975044868e5a5eb5f4235244 Oct 04 21:14:43.880267 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1258499709 Oct 04 21:14:43.880267 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-AttachVolumeTestJSON-1258499709-project Oct 04 21:14:43.880267 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 21:14:43.880267 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 21:14:43.880267 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: 7b627e66ccd94b8faabf8ce9f1d2d2a6 Oct 04 21:14:43.880267 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-AttachVolumeTestJSON-1258499709-project Oct 04 21:14:43.880267 n-d-854823-8 devstack@n-api.service[128802]: method: > Oct 04 21:14:43.880267 n-d-854823-8 devstack@n-api.service[128802]: exception: Instance ee498771-2772-4363-9f41-c400a7f73e43 could not be found. Oct 04 21:14:43.880267 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'id': 'ee498771-2772-4363-9f41-c400a7f73e43'} Oct 04 21:14:43.880267 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:14:43.880267 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:14:43.880267 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:14:43.880267 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:14:43.880267 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:14:43.880267 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:14:43.880267 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:14:43.880267 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:14:43.880267 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:14:43.880267 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:14:43.880267 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee498771-2772-4363-9f41-c400a7f73e43 could not be found. Oct 04 21:14:43.880267 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:14:43.880267 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:14:43.880267 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:14:43.880267 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:14:43.880267 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:14:43.880267 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:14:43.880267 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:14:43.880267 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:14:43.880267 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:14:43.880267 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:14:43.880267 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:14:43.880267 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:14:43.880267 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:14:43.880267 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:14:43.880267 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:14:43.880267 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:14:43.880267 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee498771-2772-4363-9f41-c400a7f73e43 could not be found. Oct 04 21:14:43.880267 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:14:43.880267 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:14:43.880267 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:14:43.884819 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:14:43.884819 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:14:43.884819 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:14:43.884819 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:14:43.884819 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:14:43.884819 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee498771-2772-4363-9f41-c400a7f73e43 could not be found. Oct 04 21:14:43.884819 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:14:43.886204 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-c42f44c0-4952-4dce-a470-9a8eca28472f tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Returning 404 to user: Instance ee498771-2772-4363-9f41-c400a7f73e43 could not be found. {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:14:43.887282 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-c42f44c0-4952-4dce-a470-9a8eca28472f tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] 10.222.0.33 "GET /compute/v2.1/servers/ee498771-2772-4363-9f41-c400a7f73e43" status: 404 len: 111 microversion: 2.1 time: 0.044423 Oct 04 21:14:43.888370 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2979/5925] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:14:43 2022] GET /compute/v2.1/servers/ee498771-2772-4363-9f41-c400a7f73e43 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:14:43.897836 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c6e45214-c661-47b2-9d5f-ea0a0c6fdb07 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Calling method '.version_select at 0x7f3c74303b80>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:14:43.921066 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c6e45214-c661-47b2-9d5f-ea0a0c6fdb07 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-269800684" status: 202 len: 0 microversion: 2.1 time: 0.027218 Oct 04 21:14:43.925930 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2947/5926] 10.222.0.33 () {58 vars in 1218 bytes} [Tue Oct 4 21:14:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-269800684 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:14:44.553318 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-3ecc8681-eb5b-4260-a903-ee388623ff8e tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:14:44.554042 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-3ecc8681-eb5b-4260-a903-ee388623ff8e tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] [instance: a9f76c1f-d6c5-4bb5-b4e3-71dd08a7f92f] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:14:44.561397 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3ecc8681-eb5b-4260-a903-ee388623ff8e tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:44.563117 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3ecc8681-eb5b-4260-a903-ee388623ff8e tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:44.563730 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3ecc8681-eb5b-4260-a903-ee388623ff8e tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:44.564595 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3ecc8681-eb5b-4260-a903-ee388623ff8e tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:44.565192 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3ecc8681-eb5b-4260-a903-ee388623ff8e tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:44.565762 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3ecc8681-eb5b-4260-a903-ee388623ff8e tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:44.737295 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-3ecc8681-eb5b-4260-a903-ee388623ff8e tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a438c7644414fa4be4f0333fb914e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f466d19559425083099ae2d772a6ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:14:44.756750 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-3ecc8681-eb5b-4260-a903-ee388623ff8e tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f76c1f-d6c5-4bb5-b4e3-71dd08a7f92f" status: 200 len: 1429 microversion: 2.1 time: 0.200263 Oct 04 21:14:44.757825 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2980/5927] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:14:44 2022] GET /compute/v2.1/servers/a9f76c1f-d6c5-4bb5-b4e3-71dd08a7f92f => generated 1429 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:14:45.781863 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-88022cb0-0316-47f1-b459-ba79bc7a8437 tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:14:45.786490 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-88022cb0-0316-47f1-b459-ba79bc7a8437 tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] [instance: a9f76c1f-d6c5-4bb5-b4e3-71dd08a7f92f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:14:45.794739 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-88022cb0-0316-47f1-b459-ba79bc7a8437 tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:45.795450 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-88022cb0-0316-47f1-b459-ba79bc7a8437 tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:45.796528 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-88022cb0-0316-47f1-b459-ba79bc7a8437 tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:45.797411 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-88022cb0-0316-47f1-b459-ba79bc7a8437 tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:45.798036 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-88022cb0-0316-47f1-b459-ba79bc7a8437 tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:45.798656 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-88022cb0-0316-47f1-b459-ba79bc7a8437 tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:45.970359 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-88022cb0-0316-47f1-b459-ba79bc7a8437 tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a438c7644414fa4be4f0333fb914e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f466d19559425083099ae2d772a6ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:14:45.978402 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-88022cb0-0316-47f1-b459-ba79bc7a8437 tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f76c1f-d6c5-4bb5-b4e3-71dd08a7f92f" status: 200 len: 1429 microversion: 2.1 time: 0.201751 Oct 04 21:14:45.978982 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2948/5928] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:14:45 2022] GET /compute/v2.1/servers/a9f76c1f-d6c5-4bb5-b4e3-71dd08a7f92f => generated 1429 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:14:47.002480 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-6c14eb63-e742-4930-99c8-5eaf6a2af9ba tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:14:47.003649 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-6c14eb63-e742-4930-99c8-5eaf6a2af9ba tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] [instance: a9f76c1f-d6c5-4bb5-b4e3-71dd08a7f92f] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:14:47.013745 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6c14eb63-e742-4930-99c8-5eaf6a2af9ba tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:47.014628 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6c14eb63-e742-4930-99c8-5eaf6a2af9ba tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:47.015671 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6c14eb63-e742-4930-99c8-5eaf6a2af9ba tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:47.017195 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6c14eb63-e742-4930-99c8-5eaf6a2af9ba tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:47.017850 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6c14eb63-e742-4930-99c8-5eaf6a2af9ba tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:47.018315 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6c14eb63-e742-4930-99c8-5eaf6a2af9ba tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:47.175077 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-6c14eb63-e742-4930-99c8-5eaf6a2af9ba tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a438c7644414fa4be4f0333fb914e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f466d19559425083099ae2d772a6ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:14:47.184725 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-6c14eb63-e742-4930-99c8-5eaf6a2af9ba tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f76c1f-d6c5-4bb5-b4e3-71dd08a7f92f" status: 200 len: 1429 microversion: 2.1 time: 0.185962 Oct 04 21:14:47.185229 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2981/5929] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:14:46 2022] GET /compute/v2.1/servers/a9f76c1f-d6c5-4bb5-b4e3-71dd08a7f92f => generated 1429 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:14:48.209447 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9d4a02f0-b23c-40a4-a3a5-b893cef8fcd3 tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:14:48.210299 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-9d4a02f0-b23c-40a4-a3a5-b893cef8fcd3 tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] [instance: a9f76c1f-d6c5-4bb5-b4e3-71dd08a7f92f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:14:48.221193 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9d4a02f0-b23c-40a4-a3a5-b893cef8fcd3 tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:48.222712 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9d4a02f0-b23c-40a4-a3a5-b893cef8fcd3 tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:48.223402 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9d4a02f0-b23c-40a4-a3a5-b893cef8fcd3 tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:48.229269 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9d4a02f0-b23c-40a4-a3a5-b893cef8fcd3 tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:48.230152 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9d4a02f0-b23c-40a4-a3a5-b893cef8fcd3 tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:48.230890 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9d4a02f0-b23c-40a4-a3a5-b893cef8fcd3 tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:48.314598 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:14:48.321982 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-dc11e28c-7f9e-4361-b0cc-bab5ef5d3929 req-780c97e4-989b-4166-a0b3-69438a864b94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9f76c1f-d6c5-4bb5-b4e3-71dd08a7f92f", "name": "network-vif-plugged", "status": "completed", "tag": "9b162135-37b2-4e61-bee2-7e7767a4375f"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:14:48.338224 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=10 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:14:48.342694 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-dc11e28c-7f9e-4361-b0cc-bab5ef5d3929 req-780c97e4-989b-4166-a0b3-69438a864b94 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:48.343207 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-dc11e28c-7f9e-4361-b0cc-bab5ef5d3929 req-780c97e4-989b-4166-a0b3-69438a864b94 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:48.343639 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-dc11e28c-7f9e-4361-b0cc-bab5ef5d3929 req-780c97e4-989b-4166-a0b3-69438a864b94 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:48.375550 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-dc11e28c-7f9e-4361-b0cc-bab5ef5d3929 req-780c97e4-989b-4166-a0b3-69438a864b94 service nova] Creating event network-vif-plugged:9b162135-37b2-4e61-bee2-7e7767a4375f for instance a9f76c1f-d6c5-4bb5-b4e3-71dd08a7f92f on n-h1-854823-8 Oct 04 21:14:48.390924 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-dc11e28c-7f9e-4361-b0cc-bab5ef5d3929 req-780c97e4-989b-4166-a0b3-69438a864b94 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076206 Oct 04 21:14:48.391929 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2982/5930] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:14:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:14:48.414586 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-9d4a02f0-b23c-40a4-a3a5-b893cef8fcd3 tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a438c7644414fa4be4f0333fb914e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f466d19559425083099ae2d772a6ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:14:48.424436 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-9d4a02f0-b23c-40a4-a3a5-b893cef8fcd3 tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f76c1f-d6c5-4bb5-b4e3-71dd08a7f92f" status: 200 len: 1429 microversion: 2.1 time: 0.220628 Oct 04 21:14:48.425619 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2949/5931] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:14:48 2022] GET /compute/v2.1/servers/a9f76c1f-d6c5-4bb5-b4e3-71dd08a7f92f => generated 1429 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:14:49.449185 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell0:SELECT=6 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:14:49.455792 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-1b26cf2b-40fc-4589-b83b-10d3ee2925d9 tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:14:49.456602 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-1b26cf2b-40fc-4589-b83b-10d3ee2925d9 tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] [instance: a9f76c1f-d6c5-4bb5-b4e3-71dd08a7f92f] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:14:49.464384 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1b26cf2b-40fc-4589-b83b-10d3ee2925d9 tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:49.464969 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1b26cf2b-40fc-4589-b83b-10d3ee2925d9 tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:49.465493 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1b26cf2b-40fc-4589-b83b-10d3ee2925d9 tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:49.466611 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1b26cf2b-40fc-4589-b83b-10d3ee2925d9 tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:49.467196 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1b26cf2b-40fc-4589-b83b-10d3ee2925d9 tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:49.468408 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1b26cf2b-40fc-4589-b83b-10d3ee2925d9 tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:49.615773 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-1b26cf2b-40fc-4589-b83b-10d3ee2925d9 tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a438c7644414fa4be4f0333fb914e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f466d19559425083099ae2d772a6ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:14:49.625363 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-1b26cf2b-40fc-4589-b83b-10d3ee2925d9 tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f76c1f-d6c5-4bb5-b4e3-71dd08a7f92f" status: 200 len: 1429 microversion: 2.1 time: 0.177054 Oct 04 21:14:49.626636 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2983/5932] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:14:49 2022] GET /compute/v2.1/servers/a9f76c1f-d6c5-4bb5-b4e3-71dd08a7f92f => generated 1429 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:14:50.649729 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8dafb3ad-98af-42ea-a9cd-91eaa40636a2 tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:14:50.650439 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-8dafb3ad-98af-42ea-a9cd-91eaa40636a2 tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] [instance: a9f76c1f-d6c5-4bb5-b4e3-71dd08a7f92f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:14:50.658456 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8dafb3ad-98af-42ea-a9cd-91eaa40636a2 tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:50.659321 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8dafb3ad-98af-42ea-a9cd-91eaa40636a2 tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:50.659832 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8dafb3ad-98af-42ea-a9cd-91eaa40636a2 tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:50.660617 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8dafb3ad-98af-42ea-a9cd-91eaa40636a2 tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:50.661141 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8dafb3ad-98af-42ea-a9cd-91eaa40636a2 tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:50.661648 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8dafb3ad-98af-42ea-a9cd-91eaa40636a2 tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:50.825641 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-8dafb3ad-98af-42ea-a9cd-91eaa40636a2 tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a438c7644414fa4be4f0333fb914e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f466d19559425083099ae2d772a6ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:14:50.835366 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-8dafb3ad-98af-42ea-a9cd-91eaa40636a2 tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f76c1f-d6c5-4bb5-b4e3-71dd08a7f92f" status: 200 len: 1608 microversion: 2.1 time: 0.189713 Oct 04 21:14:50.854482 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2950/5933] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:14:50 2022] GET /compute/v2.1/servers/a9f76c1f-d6c5-4bb5-b4e3-71dd08a7f92f => generated 1608 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:14:50.860044 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-c67eb7ac-32e0-4256-8783-609817f6f044 tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:14:50.860658 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-c67eb7ac-32e0-4256-8783-609817f6f044 tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] [instance: a9f76c1f-d6c5-4bb5-b4e3-71dd08a7f92f] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:14:50.868160 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c67eb7ac-32e0-4256-8783-609817f6f044 tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:50.868649 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c67eb7ac-32e0-4256-8783-609817f6f044 tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:50.869084 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c67eb7ac-32e0-4256-8783-609817f6f044 tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:50.869777 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c67eb7ac-32e0-4256-8783-609817f6f044 tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:50.870231 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c67eb7ac-32e0-4256-8783-609817f6f044 tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:50.870726 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c67eb7ac-32e0-4256-8783-609817f6f044 tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:51.019876 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-c67eb7ac-32e0-4256-8783-609817f6f044 tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a438c7644414fa4be4f0333fb914e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f466d19559425083099ae2d772a6ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:14:51.028082 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-c67eb7ac-32e0-4256-8783-609817f6f044 tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f76c1f-d6c5-4bb5-b4e3-71dd08a7f92f" status: 200 len: 1608 microversion: 2.1 time: 0.171973 Oct 04 21:14:51.028662 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2984/5934] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:14:50 2022] GET /compute/v2.1/servers/a9f76c1f-d6c5-4bb5-b4e3-71dd08a7f92f => generated 1608 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:14:51.051563 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5ad30868-a8e3-43a5-82d4-1efdd307302d tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:14:51.052339 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-5ad30868-a8e3-43a5-82d4-1efdd307302d tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] [instance: a9f76c1f-d6c5-4bb5-b4e3-71dd08a7f92f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:14:51.059445 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5ad30868-a8e3-43a5-82d4-1efdd307302d tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:51.060044 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5ad30868-a8e3-43a5-82d4-1efdd307302d tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:51.060581 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5ad30868-a8e3-43a5-82d4-1efdd307302d tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:51.061398 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5ad30868-a8e3-43a5-82d4-1efdd307302d tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:51.062756 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5ad30868-a8e3-43a5-82d4-1efdd307302d tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:51.063412 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5ad30868-a8e3-43a5-82d4-1efdd307302d tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:51.222691 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-5ad30868-a8e3-43a5-82d4-1efdd307302d tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a438c7644414fa4be4f0333fb914e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f466d19559425083099ae2d772a6ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:14:51.230912 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5ad30868-a8e3-43a5-82d4-1efdd307302d tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f76c1f-d6c5-4bb5-b4e3-71dd08a7f92f" status: 200 len: 1608 microversion: 2.1 time: 0.183524 Oct 04 21:14:51.234530 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2951/5935] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:14:51 2022] GET /compute/v2.1/servers/a9f76c1f-d6c5-4bb5-b4e3-71dd08a7f92f => generated 1608 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:14:51.405036 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-1905ecec-1259-4c19-b97e-f5dfedf8d06e tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:14:51.407331 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-1905ecec-1259-4c19-b97e-f5dfedf8d06e tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] [instance: ee498771-2772-4363-9f41-c400a7f73e43] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:14:51.413501 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1905ecec-1259-4c19-b97e-f5dfedf8d06e tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:51.414189 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1905ecec-1259-4c19-b97e-f5dfedf8d06e tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:51.414814 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1905ecec-1259-4c19-b97e-f5dfedf8d06e tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:51.415690 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1905ecec-1259-4c19-b97e-f5dfedf8d06e tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:51.416292 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1905ecec-1259-4c19-b97e-f5dfedf8d06e tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:51.416955 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1905ecec-1259-4c19-b97e-f5dfedf8d06e tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:51.442089 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.wsgi [None req-1905ecec-1259-4c19-b97e-f5dfedf8d06e tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] HTTP exception thrown: Instance ee498771-2772-4363-9f41-c400a7f73e43 could not be found. Oct 04 21:14:51.444191 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-1905ecec-1259-4c19-b97e-f5dfedf8d06e tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Request method failure captured: Oct 04 21:14:51.444191 n-d-854823-8 devstack@n-api.service[128802]: request: DELETE /compute/v2.1/servers/ee498771-2772-4363-9f41-c400a7f73e43 HTTP/1.1 Oct 04 21:14:51.444191 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 21:14:51.444191 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 21:14:51.444191 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 21:14:51.444191 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 0 Oct 04 21:14:51.444191 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 21:14:51.444191 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 21:14:51.444191 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 21:14:51.444191 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 21:14:51.444191 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPKEq_ZO0UAQ21txoHv_uGPr4ke4uY6LF0fMO4SRP2q-t3S-3tlSOkhKe5gbWdlihAvQbTOhJeKLX8E6zFQOAXT1eJ-d2hXfY576FRPNwsy1BzDc0tNXMiXSxH80lhL-v_X6mVFEWnfz55SHjIJki0VNPkanjCjiPduxjqYDOJkgYlL8 Oct 04 21:14:51.444191 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 21:14:51.444191 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 21:14:51.444191 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 21:14:51.444191 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 21:14:51.444191 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 21:14:51.444191 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 21:14:51.444191 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: 40732638975044868e5a5eb5f4235244 Oct 04 21:14:51.444191 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-AttachVolumeTestJSON-1258499709 Oct 04 21:14:51.444191 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 21:14:51.444191 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 21:14:51.444191 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_40732638975044868e5a5eb5f4235244", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/40732638975044868e5a5eb5f4235244"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/40732638975044868e5a5eb5f4235244"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/40732638975044868e5a5eb5f4235244"}]}] Oct 04 21:14:51.444191 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-AttachVolumeTestJSON-1258499709 Oct 04 21:14:51.444191 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: 40732638975044868e5a5eb5f4235244 Oct 04 21:14:51.444191 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1258499709 Oct 04 21:14:51.444191 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-AttachVolumeTestJSON-1258499709-project Oct 04 21:14:51.444191 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 21:14:51.444191 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 21:14:51.444191 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: 7b627e66ccd94b8faabf8ce9f1d2d2a6 Oct 04 21:14:51.444191 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-AttachVolumeTestJSON-1258499709-project Oct 04 21:14:51.444191 n-d-854823-8 devstack@n-api.service[128802]: method: > Oct 04 21:14:51.444191 n-d-854823-8 devstack@n-api.service[128802]: exception: Instance ee498771-2772-4363-9f41-c400a7f73e43 could not be found. Oct 04 21:14:51.444191 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'id': 'ee498771-2772-4363-9f41-c400a7f73e43'} Oct 04 21:14:51.444191 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:14:51.444191 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:14:51.444191 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:14:51.444191 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:14:51.444191 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:14:51.444191 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:14:51.444191 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:14:51.444191 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:14:51.444191 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:14:51.444191 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:14:51.444191 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee498771-2772-4363-9f41-c400a7f73e43 could not be found. Oct 04 21:14:51.444191 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:14:51.444191 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:14:51.444191 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:14:51.444191 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:14:51.444191 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:14:51.444191 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:14:51.444191 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:14:51.444191 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:14:51.444191 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:14:51.444191 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:14:51.444191 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 21:14:51.444191 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 21:14:51.444191 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 21:14:51.444191 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 21:14:51.444191 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:14:51.444191 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:14:51.444191 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:14:51.444191 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:14:51.448717 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee498771-2772-4363-9f41-c400a7f73e43 could not be found. Oct 04 21:14:51.448717 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:14:51.448717 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:14:51.448717 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:14:51.448717 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:14:51.448717 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:14:51.448717 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:14:51.448717 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:14:51.448717 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:14:51.448717 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee498771-2772-4363-9f41-c400a7f73e43 could not be found. Oct 04 21:14:51.448717 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:14:51.452766 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-1905ecec-1259-4c19-b97e-f5dfedf8d06e tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Returning 404 to user: Instance ee498771-2772-4363-9f41-c400a7f73e43 could not be found. {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:14:51.454428 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-1905ecec-1259-4c19-b97e-f5dfedf8d06e tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] 10.222.0.33 "DELETE /compute/v2.1/servers/ee498771-2772-4363-9f41-c400a7f73e43" status: 404 len: 111 microversion: 2.1 time: 0.053082 Oct 04 21:14:51.457828 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2985/5936] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 21:14:51 2022] DELETE /compute/v2.1/servers/ee498771-2772-4363-9f41-c400a7f73e43 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:14:51.467206 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a0bcc4a3-06a0-4805-a82f-6ebcc9f3fab7 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:14:51.467852 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a0bcc4a3-06a0-4805-a82f-6ebcc9f3fab7 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] [instance: ee498771-2772-4363-9f41-c400a7f73e43] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:14:51.480902 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a0bcc4a3-06a0-4805-a82f-6ebcc9f3fab7 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:51.481398 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a0bcc4a3-06a0-4805-a82f-6ebcc9f3fab7 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:51.481840 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a0bcc4a3-06a0-4805-a82f-6ebcc9f3fab7 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:51.482971 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a0bcc4a3-06a0-4805-a82f-6ebcc9f3fab7 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:51.484466 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a0bcc4a3-06a0-4805-a82f-6ebcc9f3fab7 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:51.484909 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a0bcc4a3-06a0-4805-a82f-6ebcc9f3fab7 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:51.512235 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-a0bcc4a3-06a0-4805-a82f-6ebcc9f3fab7 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] HTTP exception thrown: Instance ee498771-2772-4363-9f41-c400a7f73e43 could not be found. Oct 04 21:14:51.513918 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a0bcc4a3-06a0-4805-a82f-6ebcc9f3fab7 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Request method failure captured: Oct 04 21:14:51.513918 n-d-854823-8 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/ee498771-2772-4363-9f41-c400a7f73e43 HTTP/1.1 Oct 04 21:14:51.513918 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 21:14:51.513918 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 21:14:51.513918 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 21:14:51.513918 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 0 Oct 04 21:14:51.513918 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 21:14:51.513918 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 21:14:51.513918 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 21:14:51.513918 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 21:14:51.513918 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPKEq_ZO0UAQ21txoHv_uGPr4ke4uY6LF0fMO4SRP2q-t3S-3tlSOkhKe5gbWdlihAvQbTOhJeKLX8E6zFQOAXT1eJ-d2hXfY576FRPNwsy1BzDc0tNXMiXSxH80lhL-v_X6mVFEWnfz55SHjIJki0VNPkanjCjiPduxjqYDOJkgYlL8 Oct 04 21:14:51.513918 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 21:14:51.513918 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 21:14:51.513918 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 21:14:51.513918 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 21:14:51.513918 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 21:14:51.513918 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 21:14:51.513918 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: 40732638975044868e5a5eb5f4235244 Oct 04 21:14:51.513918 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-AttachVolumeTestJSON-1258499709 Oct 04 21:14:51.513918 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 21:14:51.513918 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 21:14:51.513918 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_40732638975044868e5a5eb5f4235244", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/40732638975044868e5a5eb5f4235244"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/40732638975044868e5a5eb5f4235244"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/40732638975044868e5a5eb5f4235244"}]}] Oct 04 21:14:51.513918 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-AttachVolumeTestJSON-1258499709 Oct 04 21:14:51.513918 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: 40732638975044868e5a5eb5f4235244 Oct 04 21:14:51.513918 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1258499709 Oct 04 21:14:51.513918 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-AttachVolumeTestJSON-1258499709-project Oct 04 21:14:51.513918 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 21:14:51.513918 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 21:14:51.513918 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: 7b627e66ccd94b8faabf8ce9f1d2d2a6 Oct 04 21:14:51.513918 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-AttachVolumeTestJSON-1258499709-project Oct 04 21:14:51.513918 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 21:14:51.513918 n-d-854823-8 devstack@n-api.service[128801]: exception: Instance ee498771-2772-4363-9f41-c400a7f73e43 could not be found. Oct 04 21:14:51.513918 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': 'ee498771-2772-4363-9f41-c400a7f73e43'} Oct 04 21:14:51.513918 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:14:51.513918 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:14:51.513918 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:14:51.513918 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:14:51.513918 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:14:51.513918 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:14:51.513918 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:14:51.513918 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:14:51.513918 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:14:51.513918 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:14:51.513918 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee498771-2772-4363-9f41-c400a7f73e43 could not be found. Oct 04 21:14:51.513918 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:14:51.513918 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:14:51.513918 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:14:51.513918 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:14:51.513918 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:14:51.513918 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:14:51.513918 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:14:51.513918 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:14:51.513918 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:14:51.513918 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:14:51.513918 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:14:51.513918 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:14:51.513918 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:14:51.513918 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:14:51.513918 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:14:51.513918 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:14:51.513918 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee498771-2772-4363-9f41-c400a7f73e43 could not be found. Oct 04 21:14:51.513918 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:14:51.513918 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:14:51.513918 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:14:51.519341 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:14:51.519341 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:14:51.519341 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:14:51.519341 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:14:51.519341 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:14:51.519341 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee498771-2772-4363-9f41-c400a7f73e43 could not be found. Oct 04 21:14:51.519341 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:14:51.525301 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a0bcc4a3-06a0-4805-a82f-6ebcc9f3fab7 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Returning 404 to user: Instance ee498771-2772-4363-9f41-c400a7f73e43 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:14:51.526138 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a0bcc4a3-06a0-4805-a82f-6ebcc9f3fab7 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] 10.222.0.33 "GET /compute/v2.1/servers/ee498771-2772-4363-9f41-c400a7f73e43" status: 404 len: 111 microversion: 2.1 time: 0.062990 Oct 04 21:14:51.530238 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2952/5937] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:14:51 2022] GET /compute/v2.1/servers/ee498771-2772-4363-9f41-c400a7f73e43 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:14:53.761236 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-b81d5e7d-7c70-4628-9275-6c97ba89e17e req-47205394-d14c-4215-bfd3-4095eeff8e99 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a9f76c1f-d6c5-4bb5-b4e3-71dd08a7f92f", "tag": "9b162135-37b2-4e61-bee2-7e7767a4375f"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:14:53.792016 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-b81d5e7d-7c70-4628-9275-6c97ba89e17e req-47205394-d14c-4215-bfd3-4095eeff8e99 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:53.792535 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-b81d5e7d-7c70-4628-9275-6c97ba89e17e req-47205394-d14c-4215-bfd3-4095eeff8e99 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:53.793956 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-b81d5e7d-7c70-4628-9275-6c97ba89e17e req-47205394-d14c-4215-bfd3-4095eeff8e99 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:53.818759 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-b81d5e7d-7c70-4628-9275-6c97ba89e17e req-47205394-d14c-4215-bfd3-4095eeff8e99 service nova] Creating event network-changed:9b162135-37b2-4e61-bee2-7e7767a4375f for instance a9f76c1f-d6c5-4bb5-b4e3-71dd08a7f92f on n-h1-854823-8 Oct 04 21:14:53.835006 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-b81d5e7d-7c70-4628-9275-6c97ba89e17e req-47205394-d14c-4215-bfd3-4095eeff8e99 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085773 Oct 04 21:14:53.835617 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2986/5938] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:14:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:14:55.975021 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-039b7ee0-e1bf-4902-b4ae-7c7f877d2311 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:14:55.975524 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-039b7ee0-e1bf-4902-b4ae-7c7f877d2311 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] [instance: c7262313-6b85-476f-a1ca-79d04fcf5740] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:14:55.979541 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:14:55.983999 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-039b7ee0-e1bf-4902-b4ae-7c7f877d2311 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:55.984812 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-039b7ee0-e1bf-4902-b4ae-7c7f877d2311 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:55.985426 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-039b7ee0-e1bf-4902-b4ae-7c7f877d2311 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:55.986300 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-039b7ee0-e1bf-4902-b4ae-7c7f877d2311 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:55.987216 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-039b7ee0-e1bf-4902-b4ae-7c7f877d2311 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:55.987959 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-039b7ee0-e1bf-4902-b4ae-7c7f877d2311 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:55.997462 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:14:56.012954 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-039b7ee0-e1bf-4902-b4ae-7c7f877d2311 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] HTTP exception thrown: Instance c7262313-6b85-476f-a1ca-79d04fcf5740 could not be found. Oct 04 21:14:56.015482 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-039b7ee0-e1bf-4902-b4ae-7c7f877d2311 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Request method failure captured: Oct 04 21:14:56.015482 n-d-854823-8 devstack@n-api.service[128801]: request: DELETE /compute/v2.1/servers/c7262313-6b85-476f-a1ca-79d04fcf5740 HTTP/1.1 Oct 04 21:14:56.015482 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 21:14:56.015482 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 21:14:56.015482 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 21:14:56.015482 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 0 Oct 04 21:14:56.015482 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 21:14:56.015482 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 21:14:56.015482 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 21:14:56.015482 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 21:14:56.015482 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPKEq_ZO0UAQ21txoHv_uGPr4ke4uY6LF0fMO4SRP2q-t3S-3tlSOkhKe5gbWdlihAvQbTOhJeKLX8E6zFQOAXT1eJ-d2hXfY576FRPNwsy1BzDc0tNXMiXSxH80lhL-v_X6mVFEWnfz55SHjIJki0VNPkanjCjiPduxjqYDOJkgYlL8 Oct 04 21:14:56.015482 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 21:14:56.015482 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 21:14:56.015482 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 21:14:56.015482 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 21:14:56.015482 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 21:14:56.015482 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 21:14:56.015482 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: 40732638975044868e5a5eb5f4235244 Oct 04 21:14:56.015482 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-AttachVolumeTestJSON-1258499709 Oct 04 21:14:56.015482 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 21:14:56.015482 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 21:14:56.015482 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_40732638975044868e5a5eb5f4235244", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/40732638975044868e5a5eb5f4235244"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/40732638975044868e5a5eb5f4235244"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/40732638975044868e5a5eb5f4235244"}]}] Oct 04 21:14:56.015482 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-AttachVolumeTestJSON-1258499709 Oct 04 21:14:56.015482 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: 40732638975044868e5a5eb5f4235244 Oct 04 21:14:56.015482 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1258499709 Oct 04 21:14:56.015482 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-AttachVolumeTestJSON-1258499709-project Oct 04 21:14:56.015482 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 21:14:56.015482 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 21:14:56.015482 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: 7b627e66ccd94b8faabf8ce9f1d2d2a6 Oct 04 21:14:56.015482 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-AttachVolumeTestJSON-1258499709-project Oct 04 21:14:56.015482 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 21:14:56.015482 n-d-854823-8 devstack@n-api.service[128801]: exception: Instance c7262313-6b85-476f-a1ca-79d04fcf5740 could not be found. Oct 04 21:14:56.015482 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': 'c7262313-6b85-476f-a1ca-79d04fcf5740'} Oct 04 21:14:56.015482 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:14:56.015482 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:14:56.015482 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:14:56.015482 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:14:56.015482 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:14:56.015482 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:14:56.015482 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:14:56.015482 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:14:56.015482 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:14:56.015482 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:14:56.015482 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c7262313-6b85-476f-a1ca-79d04fcf5740 could not be found. Oct 04 21:14:56.015482 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:14:56.015482 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:14:56.015482 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:14:56.015482 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:14:56.015482 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:14:56.015482 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:14:56.015482 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:14:56.015482 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:14:56.015482 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:14:56.015482 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:14:56.015482 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 21:14:56.015482 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 21:14:56.015482 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 21:14:56.015482 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 21:14:56.015482 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:14:56.015482 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:14:56.015482 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:14:56.015482 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:14:56.020159 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c7262313-6b85-476f-a1ca-79d04fcf5740 could not be found. Oct 04 21:14:56.020159 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:14:56.020159 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:14:56.020159 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:14:56.020159 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:14:56.020159 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:14:56.020159 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:14:56.020159 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:14:56.020159 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:14:56.020159 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c7262313-6b85-476f-a1ca-79d04fcf5740 could not be found. Oct 04 21:14:56.020159 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:14:56.020159 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-039b7ee0-e1bf-4902-b4ae-7c7f877d2311 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Returning 404 to user: Instance c7262313-6b85-476f-a1ca-79d04fcf5740 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:14:56.020159 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-039b7ee0-e1bf-4902-b4ae-7c7f877d2311 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] 10.222.0.33 "DELETE /compute/v2.1/servers/c7262313-6b85-476f-a1ca-79d04fcf5740" status: 404 len: 111 microversion: 2.1 time: 0.046207 Oct 04 21:14:56.020159 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2953/5939] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 21:14:55 2022] DELETE /compute/v2.1/servers/c7262313-6b85-476f-a1ca-79d04fcf5740 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:14:56.026985 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-4cf36278-3bfa-4188-bffa-376ed45a1866 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:14:56.027720 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-4cf36278-3bfa-4188-bffa-376ed45a1866 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] [instance: c7262313-6b85-476f-a1ca-79d04fcf5740] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:14:56.032520 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:14:56.036422 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4cf36278-3bfa-4188-bffa-376ed45a1866 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:56.036922 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4cf36278-3bfa-4188-bffa-376ed45a1866 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:56.037378 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4cf36278-3bfa-4188-bffa-376ed45a1866 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:56.038166 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4cf36278-3bfa-4188-bffa-376ed45a1866 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:14:56.038649 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4cf36278-3bfa-4188-bffa-376ed45a1866 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:14:56.039078 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4cf36278-3bfa-4188-bffa-376ed45a1866 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:14:56.042746 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:14:56.059818 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.wsgi [None req-4cf36278-3bfa-4188-bffa-376ed45a1866 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] HTTP exception thrown: Instance c7262313-6b85-476f-a1ca-79d04fcf5740 could not be found. Oct 04 21:14:56.062681 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-4cf36278-3bfa-4188-bffa-376ed45a1866 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Request method failure captured: Oct 04 21:14:56.062681 n-d-854823-8 devstack@n-api.service[128802]: request: GET /compute/v2.1/servers/c7262313-6b85-476f-a1ca-79d04fcf5740 HTTP/1.1 Oct 04 21:14:56.062681 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 21:14:56.062681 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 21:14:56.062681 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 21:14:56.062681 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 0 Oct 04 21:14:56.062681 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 21:14:56.062681 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 21:14:56.062681 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 21:14:56.062681 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 21:14:56.062681 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPKEq_ZO0UAQ21txoHv_uGPr4ke4uY6LF0fMO4SRP2q-t3S-3tlSOkhKe5gbWdlihAvQbTOhJeKLX8E6zFQOAXT1eJ-d2hXfY576FRPNwsy1BzDc0tNXMiXSxH80lhL-v_X6mVFEWnfz55SHjIJki0VNPkanjCjiPduxjqYDOJkgYlL8 Oct 04 21:14:56.062681 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 21:14:56.062681 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 21:14:56.062681 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 21:14:56.062681 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 21:14:56.062681 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 21:14:56.062681 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 21:14:56.062681 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: 40732638975044868e5a5eb5f4235244 Oct 04 21:14:56.062681 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-AttachVolumeTestJSON-1258499709 Oct 04 21:14:56.062681 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 21:14:56.062681 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 21:14:56.062681 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_40732638975044868e5a5eb5f4235244", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/40732638975044868e5a5eb5f4235244"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/40732638975044868e5a5eb5f4235244"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/40732638975044868e5a5eb5f4235244"}]}] Oct 04 21:14:56.062681 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-AttachVolumeTestJSON-1258499709 Oct 04 21:14:56.062681 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: 40732638975044868e5a5eb5f4235244 Oct 04 21:14:56.062681 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1258499709 Oct 04 21:14:56.062681 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-AttachVolumeTestJSON-1258499709-project Oct 04 21:14:56.062681 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 21:14:56.062681 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 21:14:56.062681 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: 7b627e66ccd94b8faabf8ce9f1d2d2a6 Oct 04 21:14:56.062681 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-AttachVolumeTestJSON-1258499709-project Oct 04 21:14:56.062681 n-d-854823-8 devstack@n-api.service[128802]: method: > Oct 04 21:14:56.062681 n-d-854823-8 devstack@n-api.service[128802]: exception: Instance c7262313-6b85-476f-a1ca-79d04fcf5740 could not be found. Oct 04 21:14:56.062681 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'id': 'c7262313-6b85-476f-a1ca-79d04fcf5740'} Oct 04 21:14:56.062681 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:14:56.062681 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:14:56.062681 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:14:56.062681 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:14:56.062681 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:14:56.062681 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:14:56.062681 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:14:56.062681 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:14:56.062681 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:14:56.062681 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:14:56.062681 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c7262313-6b85-476f-a1ca-79d04fcf5740 could not be found. Oct 04 21:14:56.062681 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:14:56.062681 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:14:56.062681 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:14:56.062681 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:14:56.062681 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:14:56.062681 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:14:56.062681 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:14:56.062681 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:14:56.062681 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:14:56.062681 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:14:56.062681 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:14:56.062681 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:14:56.062681 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:14:56.062681 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:14:56.062681 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:14:56.062681 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:14:56.062681 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c7262313-6b85-476f-a1ca-79d04fcf5740 could not be found. Oct 04 21:14:56.062681 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:14:56.062681 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:14:56.062681 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:14:56.067530 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:14:56.067530 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:14:56.067530 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:14:56.067530 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:14:56.067530 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:14:56.067530 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c7262313-6b85-476f-a1ca-79d04fcf5740 could not be found. Oct 04 21:14:56.067530 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:14:56.069152 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-4cf36278-3bfa-4188-bffa-376ed45a1866 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] Returning 404 to user: Instance c7262313-6b85-476f-a1ca-79d04fcf5740 could not be found. {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:14:56.070241 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-4cf36278-3bfa-4188-bffa-376ed45a1866 tempest-AttachVolumeTestJSON-1258499709 tempest-AttachVolumeTestJSON-1258499709-project] 10.222.0.33 "GET /compute/v2.1/servers/c7262313-6b85-476f-a1ca-79d04fcf5740" status: 404 len: 111 microversion: 2.1 time: 0.048176 Oct 04 21:14:56.071257 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2987/5940] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:14:56 2022] GET /compute/v2.1/servers/c7262313-6b85-476f-a1ca-79d04fcf5740 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:15:00.770183 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8a1d00df-46e1-428c-b4da-d6d750fe530a tempest-VolumesGetTestJSON-234514570 tempest-VolumesGetTestJSON-234514570-project] Action: 'create', calling method: .version_select at 0x7f3c6f9c4430>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1384955424", "metadata": {"Type": "work"}}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:15:01.106658 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-8a1d00df-46e1-428c-b4da-d6d750fe530a tempest-VolumesGetTestJSON-234514570 tempest-VolumesGetTestJSON-234514570-project] 10.222.0.33 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.479610 Oct 04 21:15:01.107393 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2954/5941] 10.222.0.33 () {60 vars in 1156 bytes} [Tue Oct 4 21:15:00 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 481 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 04 21:15:01.121898 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-db20363b-f54b-44aa-823e-a139be7a1449 tempest-VolumesGetTestJSON-234514570 tempest-VolumesGetTestJSON-234514570-project] Calling method '.version_select at 0x7f3c6f489ee0>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:01.214871 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-db20363b-f54b-44aa-823e-a139be7a1449 tempest-VolumesGetTestJSON-234514570 tempest-VolumesGetTestJSON-234514570-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/38a50f81-9153-4cee-9413-bb20afafdb52" status: 200 len: 353 microversion: 2.1 time: 0.098314 Oct 04 21:15:01.215939 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2988/5942] 10.222.0.33 () {58 vars in 1245 bytes} [Tue Oct 4 21:15:01 2022] GET /compute/v2.1/os-volumes/38a50f81-9153-4cee-9413-bb20afafdb52 => generated 353 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:15:02.232015 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-68416e18-0147-48b1-8c1f-212d34954db0 tempest-VolumesGetTestJSON-234514570 tempest-VolumesGetTestJSON-234514570-project] Calling method '.version_select at 0x7f3c6fa4d0d0>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:02.281328 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-68416e18-0147-48b1-8c1f-212d34954db0 tempest-VolumesGetTestJSON-234514570 tempest-VolumesGetTestJSON-234514570-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/38a50f81-9153-4cee-9413-bb20afafdb52" status: 200 len: 354 microversion: 2.1 time: 0.053638 Oct 04 21:15:02.281939 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2955/5943] 10.222.0.33 () {58 vars in 1245 bytes} [Tue Oct 4 21:15:02 2022] GET /compute/v2.1/os-volumes/38a50f81-9153-4cee-9413-bb20afafdb52 => generated 354 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:15:02.295464 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-40a690ea-c1b5-444e-8bb3-5c3c7f7b4230 tempest-VolumesGetTestJSON-234514570 tempest-VolumesGetTestJSON-234514570-project] Calling method '.version_select at 0x7f3c6f48c1f0>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:02.347977 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-40a690ea-c1b5-444e-8bb3-5c3c7f7b4230 tempest-VolumesGetTestJSON-234514570 tempest-VolumesGetTestJSON-234514570-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/38a50f81-9153-4cee-9413-bb20afafdb52" status: 200 len: 354 microversion: 2.1 time: 0.057067 Oct 04 21:15:02.348568 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2989/5944] 10.222.0.33 () {58 vars in 1245 bytes} [Tue Oct 4 21:15:02 2022] GET /compute/v2.1/os-volumes/38a50f81-9153-4cee-9413-bb20afafdb52 => generated 354 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:15:02.363129 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e28fa8fc-406b-4290-9750-f1d5be3b6b3e tempest-VolumesGetTestJSON-234514570 tempest-VolumesGetTestJSON-234514570-project] Calling method '.version_select at 0x7f3c6f510af0>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:02.431794 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e28fa8fc-406b-4290-9750-f1d5be3b6b3e tempest-VolumesGetTestJSON-234514570 tempest-VolumesGetTestJSON-234514570-project] 10.222.0.33 "DELETE /compute/v2.1/os-volumes/38a50f81-9153-4cee-9413-bb20afafdb52" status: 202 len: 0 microversion: 2.1 time: 0.072932 Oct 04 21:15:02.435764 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2956/5945] 10.222.0.33 () {58 vars in 1248 bytes} [Tue Oct 4 21:15:02 2022] DELETE /compute/v2.1/os-volumes/38a50f81-9153-4cee-9413-bb20afafdb52 => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:15:02.444272 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-0a634c0a-b79d-4d72-9f43-a8f4b64a30a6 tempest-VolumesGetTestJSON-234514570 tempest-VolumesGetTestJSON-234514570-project] Calling method '.version_select at 0x7f3c789349d0>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:02.502980 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-0a634c0a-b79d-4d72-9f43-a8f4b64a30a6 tempest-VolumesGetTestJSON-234514570 tempest-VolumesGetTestJSON-234514570-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/38a50f81-9153-4cee-9413-bb20afafdb52" status: 200 len: 353 microversion: 2.1 time: 0.064318 Oct 04 21:15:02.503812 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2990/5946] 10.222.0.33 () {58 vars in 1245 bytes} [Tue Oct 4 21:15:02 2022] GET /compute/v2.1/os-volumes/38a50f81-9153-4cee-9413-bb20afafdb52 => generated 353 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:15:03.519013 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f3553cb8-050b-4c14-adf2-ed5c21a2dd56 tempest-VolumesGetTestJSON-234514570 tempest-VolumesGetTestJSON-234514570-project] Calling method '.version_select at 0x7f3c787f0b80>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:03.580755 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f3553cb8-050b-4c14-adf2-ed5c21a2dd56 tempest-VolumesGetTestJSON-234514570 tempest-VolumesGetTestJSON-234514570-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/38a50f81-9153-4cee-9413-bb20afafdb52" status: 200 len: 353 microversion: 2.1 time: 0.066826 Oct 04 21:15:03.581666 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2957/5947] 10.222.0.33 () {58 vars in 1245 bytes} [Tue Oct 4 21:15:03 2022] GET /compute/v2.1/os-volumes/38a50f81-9153-4cee-9413-bb20afafdb52 => generated 353 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:15:04.595875 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-3c83e600-868b-4e32-bf26-9a6c540b7008 tempest-VolumesGetTestJSON-234514570 tempest-VolumesGetTestJSON-234514570-project] Calling method '.version_select at 0x7f3c6f5e5e50>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:04.632414 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.wsgi [None req-3c83e600-868b-4e32-bf26-9a6c540b7008 tempest-VolumesGetTestJSON-234514570 tempest-VolumesGetTestJSON-234514570-project] HTTP exception thrown: Volume 38a50f81-9153-4cee-9413-bb20afafdb52 could not be found. Oct 04 21:15:04.634778 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-3c83e600-868b-4e32-bf26-9a6c540b7008 tempest-VolumesGetTestJSON-234514570 tempest-VolumesGetTestJSON-234514570-project] Request method failure captured: Oct 04 21:15:04.634778 n-d-854823-8 devstack@n-api.service[128802]: request: GET /compute/v2.1/os-volumes/38a50f81-9153-4cee-9413-bb20afafdb52 HTTP/1.1 Oct 04 21:15:04.634778 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 21:15:04.634778 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 21:15:04.634778 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 21:15:04.634778 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 0 Oct 04 21:15:04.634778 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 21:15:04.634778 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 21:15:04.634778 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 21:15:04.634778 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 21:15:04.634778 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPKJU7SvI25iyzdD2xEoxvw0yh0N9hFV_8gX0UQDG_2QKSeJ3Zu-Sfg6EmtMAt6ZEAcn5OgVUYC-1Youp-VX7RuIStblPtN2HnhVaGoIptyVqdOM74b8wnzDYE1j52Pc2_NfH7fbXFbKhLJt5rRkOILBw2liSip1ExTa_Mr-HMTWOXIw Oct 04 21:15:04.634778 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 21:15:04.634778 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 21:15:04.634778 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 21:15:04.634778 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 21:15:04.634778 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 21:15:04.634778 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 21:15:04.634778 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: 6530c6571d644166a95d7467593655a9 Oct 04 21:15:04.634778 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-VolumesGetTestJSON-234514570 Oct 04 21:15:04.634778 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 21:15:04.634778 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 21:15:04.634778 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_6530c6571d644166a95d7467593655a9", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/6530c6571d644166a95d7467593655a9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/6530c6571d644166a95d7467593655a9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/6530c6571d644166a95d7467593655a9"}]}] Oct 04 21:15:04.634778 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-VolumesGetTestJSON-234514570 Oct 04 21:15:04.634778 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: 6530c6571d644166a95d7467593655a9 Oct 04 21:15:04.634778 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-VolumesGetTestJSON-234514570 Oct 04 21:15:04.634778 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-VolumesGetTestJSON-234514570-project Oct 04 21:15:04.634778 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 21:15:04.634778 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 21:15:04.634778 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: e83c162d62a64c8e9ef415d774eb9934 Oct 04 21:15:04.634778 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-VolumesGetTestJSON-234514570-project Oct 04 21:15:04.634778 n-d-854823-8 devstack@n-api.service[128802]: method: Oct 04 21:15:04.634778 n-d-854823-8 devstack@n-api.service[128802]: exception: Volume 38a50f81-9153-4cee-9413-bb20afafdb52 could not be found. Oct 04 21:15:04.634778 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'id': '38a50f81-9153-4cee-9413-bb20afafdb52'} Oct 04 21:15:04.634778 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:15:04.634778 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:15:04.634778 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 21:15:04.634778 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 21:15:04.634778 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 04 21:15:04.634778 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 04 21:15:04.634778 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 04 21:15:04.634778 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 04 21:15:04.634778 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 21:15:04.634778 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 21:15:04.634778 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 21:15:04.634778 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 21:15:04.634778 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 21:15:04.634778 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 21:15:04.634778 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 21:15:04.634778 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 21:15:04.634778 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 38a50f81-9153-4cee-9413-bb20afafdb52 could not be found. (HTTP 404) (Request-ID: req-d8446668-b32f-4e3e-ba55-935d8eb8d71d) Oct 04 21:15:04.634778 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:15:04.634778 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:15:04.634778 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:15:04.634778 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:15:04.634778 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 04 21:15:04.634778 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 04 21:15:04.634778 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 04 21:15:04.634778 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 04 21:15:04.634778 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 04 21:15:04.634778 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 04 21:15:04.634778 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 04 21:15:04.634778 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 04 21:15:04.634778 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 21:15:04.639363 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 21:15:04.639363 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 04 21:15:04.639363 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 04 21:15:04.639363 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 04 21:15:04.639363 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 04 21:15:04.639363 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 21:15:04.639363 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 21:15:04.639363 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 21:15:04.639363 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 21:15:04.639363 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 21:15:04.639363 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 21:15:04.639363 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 21:15:04.639363 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 21:15:04.639363 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 38a50f81-9153-4cee-9413-bb20afafdb52 could not be found. Oct 04 21:15:04.639363 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:15:04.639363 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:15:04.639363 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:15:04.639363 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:15:04.639363 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:15:04.639363 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:15:04.639363 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:15:04.639363 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:15:04.639363 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 21:15:04.639363 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 21:15:04.639363 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:15:04.639363 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:15:04.639363 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 04 21:15:04.639363 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:15:04.639363 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 38a50f81-9153-4cee-9413-bb20afafdb52 could not be found. Oct 04 21:15:04.639363 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:15:04.639363 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:15:04.639363 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:15:04.639363 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:15:04.639363 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:15:04.639363 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:15:04.639363 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:15:04.639363 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:15:04.639363 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 38a50f81-9153-4cee-9413-bb20afafdb52 could not be found. Oct 04 21:15:04.639363 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:15:04.639363 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-3c83e600-868b-4e32-bf26-9a6c540b7008 tempest-VolumesGetTestJSON-234514570 tempest-VolumesGetTestJSON-234514570-project] Returning 404 to user: Volume 38a50f81-9153-4cee-9413-bb20afafdb52 could not be found. {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:15:04.639363 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-3c83e600-868b-4e32-bf26-9a6c540b7008 tempest-VolumesGetTestJSON-234514570 tempest-VolumesGetTestJSON-234514570-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/38a50f81-9153-4cee-9413-bb20afafdb52" status: 404 len: 109 microversion: 2.1 time: 0.045141 Oct 04 21:15:04.641940 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2991/5948] 10.222.0.33 () {58 vars in 1245 bytes} [Tue Oct 4 21:15:04 2022] GET /compute/v2.1/os-volumes/38a50f81-9153-4cee-9413-bb20afafdb52 => generated 109 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:15:32.068705 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:15:32.070400 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:15:32.077417 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e1013a52-a8bc-4b6c-b5b6-9d33f908fb0a tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:15:32.078133 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e1013a52-a8bc-4b6c-b5b6-9d33f908fb0a tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] [instance: a9f76c1f-d6c5-4bb5-b4e3-71dd08a7f92f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:15:32.085768 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e1013a52-a8bc-4b6c-b5b6-9d33f908fb0a tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:32.086652 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e1013a52-a8bc-4b6c-b5b6-9d33f908fb0a tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:32.087346 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e1013a52-a8bc-4b6c-b5b6-9d33f908fb0a tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:32.088946 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e1013a52-a8bc-4b6c-b5b6-9d33f908fb0a tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:15:32.089685 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e1013a52-a8bc-4b6c-b5b6-9d33f908fb0a tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:15:32.090367 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e1013a52-a8bc-4b6c-b5b6-9d33f908fb0a tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:15:32.118616 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e1013a52-a8bc-4b6c-b5b6-9d33f908fb0a tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f76c1f-d6c5-4bb5-b4e3-71dd08a7f92f/os-server-password" status: 200 len: 116 microversion: 2.1 time: 0.052186 Oct 04 21:15:32.119389 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2958/5949] 10.222.0.33 () {58 vars in 1293 bytes} [Tue Oct 4 21:15:32 2022] GET /compute/v2.1/servers/a9f76c1f-d6c5-4bb5-b4e3-71dd08a7f92f/os-server-password => generated 116 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:16:12.366838 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_api:SELECT=1 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:16:12.368181 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=1 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:16:12.369467 n-d-854823-8 devstack@n-api.service[128802]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 21:16:12.369783 n-d-854823-8 devstack@n-api.service[128802]: Tue Oct 4 21:16:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-aggregates (ip 10.222.0.33) !!! Oct 04 21:16:12.566865 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-38570fe3-7968-41d6-9761-88090eaf0722 tempest-TestAggregatesBasicOps-1552341163 tempest-TestAggregatesBasicOps-1552341163-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-aggregate-scenario-579511664", "availability_zone": "foo_zone"}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:16:12.598888 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.objects.aggregate [None req-38570fe3-7968-41d6-9761-88090eaf0722 tempest-TestAggregatesBasicOps-1552341163 tempest-TestAggregatesBasicOps-1552341163-project-admin] Generated uuid 2d2a5d44-0d6c-4118-9b2f-7d854d407482 for aggregate {{(pid=128802) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 21:16:12.641524 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-38570fe3-7968-41d6-9761-88090eaf0722 tempest-TestAggregatesBasicOps-1552341163 tempest-TestAggregatesBasicOps-1552341163-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates" status: 200 len: 208 microversion: 2.1 time: 0.278038 Oct 04 21:16:12.647901 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2992/5950] 10.222.0.33 () {60 vars in 1164 bytes} [Tue Oct 4 21:16:12 2022] POST /compute/v2.1/os-aggregates => generated 208 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:16:12.663596 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-37107f0c-ba8e-40a9-bf27-ca3932ec4c12 tempest-TestAggregatesBasicOps-1552341163 tempest-TestAggregatesBasicOps-1552341163-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"meta_key": "meta_value"}}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:16:12.676633 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:16:12.677501 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=4 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:16:12.728342 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-37107f0c-ba8e-40a9-bf27-ca3932ec4c12 tempest-TestAggregatesBasicOps-1552341163 tempest-TestAggregatesBasicOps-1552341163-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 318 microversion: 2.1 time: 0.071615 Oct 04 21:16:12.729303 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2959/5951] 10.222.0.33 () {60 vars in 1194 bytes} [Tue Oct 4 21:16:12 2022] POST /compute/v2.1/os-aggregates/19/action => generated 318 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:16:12.741485 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-d39abb47-c724-4828-8ba8-e046ee9df50c tempest-TestAggregatesBasicOps-1552341163 tempest-TestAggregatesBasicOps-1552341163-project-admin] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:12.745894 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d39abb47-c724-4828-8ba8-e046ee9df50c tempest-TestAggregatesBasicOps-1552341163 tempest-TestAggregatesBasicOps-1552341163-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:12.746519 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d39abb47-c724-4828-8ba8-e046ee9df50c tempest-TestAggregatesBasicOps-1552341163 tempest-TestAggregatesBasicOps-1552341163-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:12.747553 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d39abb47-c724-4828-8ba8-e046ee9df50c tempest-TestAggregatesBasicOps-1552341163 tempest-TestAggregatesBasicOps-1552341163-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:12.748957 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d39abb47-c724-4828-8ba8-e046ee9df50c tempest-TestAggregatesBasicOps-1552341163 tempest-TestAggregatesBasicOps-1552341163-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:12.749851 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d39abb47-c724-4828-8ba8-e046ee9df50c tempest-TestAggregatesBasicOps-1552341163 tempest-TestAggregatesBasicOps-1552341163-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:12.749851 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d39abb47-c724-4828-8ba8-e046ee9df50c tempest-TestAggregatesBasicOps-1552341163 tempest-TestAggregatesBasicOps-1552341163-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:12.777012 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-d39abb47-c724-4828-8ba8-e046ee9df50c tempest-TestAggregatesBasicOps-1552341163 tempest-TestAggregatesBasicOps-1552341163-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.039307 Oct 04 21:16:12.777627 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2993/5952] 10.222.0.33 () {58 vars in 1176 bytes} [Tue Oct 4 21:16:12 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:16:12.789785 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ab8c7e93-f400-4c00-bd34-03468f798b30 tempest-TestAggregatesBasicOps-1552341163 tempest-TestAggregatesBasicOps-1552341163-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:12.799023 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ab8c7e93-f400-4c00-bd34-03468f798b30 tempest-TestAggregatesBasicOps-1552341163 tempest-TestAggregatesBasicOps-1552341163-project-admin] 10.222.0.33 "GET /compute/v2.1/os-aggregates" status: 200 len: 297 microversion: 2.1 time: 0.013072 Oct 04 21:16:12.799840 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2960/5953] 10.222.0.33 () {58 vars in 1143 bytes} [Tue Oct 4 21:16:12 2022] GET /compute/v2.1/os-aggregates => generated 297 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:16:12.812040 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-f0aa607f-6bce-4731-a249-aa8823963043 tempest-TestAggregatesBasicOps-1552341163 tempest-TestAggregatesBasicOps-1552341163-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-854823-8"}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:16:12.823226 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f0aa607f-6bce-4731-a249-aa8823963043 tempest-TestAggregatesBasicOps-1552341163 tempest-TestAggregatesBasicOps-1552341163-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:12.823850 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f0aa607f-6bce-4731-a249-aa8823963043 tempest-TestAggregatesBasicOps-1552341163 tempest-TestAggregatesBasicOps-1552341163-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:12.824389 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f0aa607f-6bce-4731-a249-aa8823963043 tempest-TestAggregatesBasicOps-1552341163 tempest-TestAggregatesBasicOps-1552341163-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:13.268265 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-f0aa607f-6bce-4731-a249-aa8823963043 tempest-TestAggregatesBasicOps-1552341163 tempest-TestAggregatesBasicOps-1552341163-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 309 microversion: 2.1 time: 0.460160 Oct 04 21:16:13.270394 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2994/5954] 10.222.0.33 () {60 vars in 1194 bytes} [Tue Oct 4 21:16:12 2022] POST /compute/v2.1/os-aggregates/19/action => generated 309 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:16:13.286690 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f291feaa-3698-4e5e-9ef3-ba3e13804393 tempest-TestAggregatesBasicOps-1552341163 tempest-TestAggregatesBasicOps-1552341163-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:13.296779 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f291feaa-3698-4e5e-9ef3-ba3e13804393 tempest-TestAggregatesBasicOps-1552341163 tempest-TestAggregatesBasicOps-1552341163-project-admin] 10.222.0.33 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 309 microversion: 2.1 time: 0.014231 Oct 04 21:16:13.304862 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2961/5955] 10.222.0.33 () {58 vars in 1152 bytes} [Tue Oct 4 21:16:13 2022] GET /compute/v2.1/os-aggregates/19 => generated 309 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:16:13.309175 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-d8be4cbb-d40c-484b-8b0b-1b5a6339eb8b tempest-TestAggregatesBasicOps-1552341163 tempest-TestAggregatesBasicOps-1552341163-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-renamed-aggregate-scenario-1527016907", "availability_zone": "foo_zone"}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:16:13.465230 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-d8be4cbb-d40c-484b-8b0b-1b5a6339eb8b tempest-TestAggregatesBasicOps-1552341163 tempest-TestAggregatesBasicOps-1552341163-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-aggregates/19" status: 200 len: 342 microversion: 2.1 time: 0.158497 Oct 04 21:16:13.465230 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2995/5956] 10.222.0.33 () {60 vars in 1173 bytes} [Tue Oct 4 21:16:13 2022] PUT /compute/v2.1/os-aggregates/19 => generated 342 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:16:13.477235 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-eaf4aa43-5808-41dd-a32d-5aa864f8349d tempest-TestAggregatesBasicOps-1552341163 tempest-TestAggregatesBasicOps-1552341163-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"foo": "bar"}}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:16:13.536269 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-eaf4aa43-5808-41dd-a32d-5aa864f8349d tempest-TestAggregatesBasicOps-1552341163 tempest-TestAggregatesBasicOps-1552341163-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 356 microversion: 2.1 time: 0.063452 Oct 04 21:16:13.538891 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2962/5957] 10.222.0.33 () {60 vars in 1194 bytes} [Tue Oct 4 21:16:13 2022] POST /compute/v2.1/os-aggregates/19/action => generated 356 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:16:13.551026 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-39373789-cabe-41ae-b281-228d9e4e2f58 tempest-TestAggregatesBasicOps-1552341163 tempest-TestAggregatesBasicOps-1552341163-project-admin] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:13.574549 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-39373789-cabe-41ae-b281-228d9e4e2f58 tempest-TestAggregatesBasicOps-1552341163 tempest-TestAggregatesBasicOps-1552341163-project-admin] 10.222.0.33 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 356 microversion: 2.1 time: 0.027216 Oct 04 21:16:13.575911 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2996/5958] 10.222.0.33 () {58 vars in 1152 bytes} [Tue Oct 4 21:16:13 2022] GET /compute/v2.1/os-aggregates/19 => generated 356 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:16:13.588429 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a42df541-ad70-4bed-baf1-5708a0438e78 tempest-TestAggregatesBasicOps-1552341163 tempest-TestAggregatesBasicOps-1552341163-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-854823-8"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:16:13.606617 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a42df541-ad70-4bed-baf1-5708a0438e78 tempest-TestAggregatesBasicOps-1552341163 tempest-TestAggregatesBasicOps-1552341163-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:16:13.607335 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a42df541-ad70-4bed-baf1-5708a0438e78 tempest-TestAggregatesBasicOps-1552341163 tempest-TestAggregatesBasicOps-1552341163-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:16:13.607965 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a42df541-ad70-4bed-baf1-5708a0438e78 tempest-TestAggregatesBasicOps-1552341163 tempest-TestAggregatesBasicOps-1552341163-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:16:13.833298 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a42df541-ad70-4bed-baf1-5708a0438e78 tempest-TestAggregatesBasicOps-1552341163 tempest-TestAggregatesBasicOps-1552341163-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 341 microversion: 2.1 time: 0.249353 Oct 04 21:16:13.833962 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2963/5959] 10.222.0.33 () {60 vars in 1194 bytes} [Tue Oct 4 21:16:13 2022] POST /compute/v2.1/os-aggregates/19/action => generated 341 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:16:13.847348 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-3bfa7463-3ea8-4610-9a91-9d5348a00c9e tempest-TestAggregatesBasicOps-1552341163 tempest-TestAggregatesBasicOps-1552341163-project-admin] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:16:13.875851 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-3bfa7463-3ea8-4610-9a91-9d5348a00c9e tempest-TestAggregatesBasicOps-1552341163 tempest-TestAggregatesBasicOps-1552341163-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-aggregates/19" status: 200 len: 0 microversion: 2.1 time: 0.032026 Oct 04 21:16:13.876726 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2997/5960] 10.222.0.33 () {58 vars in 1155 bytes} [Tue Oct 4 21:16:13 2022] DELETE /compute/v2.1/os-aggregates/19 => generated 0 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 04 21:17:05.602528 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=4 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:17:05.603308 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=20,nova_api:INSERT=2,nova_api:DELETE=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:17:05.743448 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ef11ced2-6b83-4abd-84fd-79d6ba7ef1ca tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerAdvancedOps-server-808429004", "imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63", "flavorRef": "452", "networks": [{"uuid": "66dd86c9-d9ec-4b2b-89e5-0827a5f4ad05"}]}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:17:05.804363 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.network.neutron [None req-ef11ced2-6b83-4abd-84fd-79d6ba7ef1ca tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] validate_networks() for [('66dd86c9-d9ec-4b2b-89e5-0827a5f4ad05', None, None, None, None, None)] {{(pid=128801) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:17:06.286062 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-ef11ced2-6b83-4abd-84fd-79d6ba7ef1ca tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Flavor limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:17:06.286551 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-ef11ced2-6b83-4abd-84fd-79d6ba7ef1ca tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Image limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:17:06.287025 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-ef11ced2-6b83-4abd-84fd-79d6ba7ef1ca tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Flavor pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:17:06.287432 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-ef11ced2-6b83-4abd-84fd-79d6ba7ef1ca tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Image pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:17:06.287843 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-ef11ced2-6b83-4abd-84fd-79d6ba7ef1ca tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:17:06.297735 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ef11ced2-6b83-4abd-84fd-79d6ba7ef1ca tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:06.298217 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ef11ced2-6b83-4abd-84fd-79d6ba7ef1ca tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:06.298814 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ef11ced2-6b83-4abd-84fd-79d6ba7ef1ca tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:06.299548 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ef11ced2-6b83-4abd-84fd-79d6ba7ef1ca tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:06.300044 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ef11ced2-6b83-4abd-84fd-79d6ba7ef1ca tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:06.300472 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ef11ced2-6b83-4abd-84fd-79d6ba7ef1ca tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:06.319038 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-ef11ced2-6b83-4abd-84fd-79d6ba7ef1ca tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Getting quotas for project fb33d212f8094c878fba42eadd6feac7. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:17:06.324808 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-ef11ced2-6b83-4abd-84fd-79d6ba7ef1ca tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Getting quotas for user 12d4e382ab1e41e99bd22b4f7942dec5 and project fb33d212f8094c878fba42eadd6feac7. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:17:06.338381 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ef11ced2-6b83-4abd-84fd-79d6ba7ef1ca tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Going to run 1 instances... {{(pid=128801) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:17:06.341311 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ef11ced2-6b83-4abd-84fd-79d6ba7ef1ca tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] [instance: 063cdb4b-1fb5-492a-bb31-67ab89be826b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='15b24725-0c99-4bcf-b1fb-907cdf8e2d63',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128801) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:17:06.390708 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ef11ced2-6b83-4abd-84fd-79d6ba7ef1ca tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.789882 Oct 04 21:17:06.391379 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2964/5961] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 21:17:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 792 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:17:06.400642 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell0:SELECT=2 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:17:06.401422 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=6 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:17:06.403098 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:17:06.407158 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-e5d07254-5ecd-4f2a-acd4-cdab8b6d8fb2 tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:17:06.408294 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-e5d07254-5ecd-4f2a-acd4-cdab8b6d8fb2 tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] [instance: 063cdb4b-1fb5-492a-bb31-67ab89be826b] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:17:06.483300 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-e5d07254-5ecd-4f2a-acd4-cdab8b6d8fb2 tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d4e382ab1e41e99bd22b4f7942dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb33d212f8094c878fba42eadd6feac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:17:06.490870 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-e5d07254-5ecd-4f2a-acd4-cdab8b6d8fb2 tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] 10.222.0.33 "GET /compute/v2.1/servers/063cdb4b-1fb5-492a-bb31-67ab89be826b" status: 200 len: 1214 microversion: 2.1 time: 0.091893 Oct 04 21:17:06.491470 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2998/5962] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:17:06 2022] GET /compute/v2.1/servers/063cdb4b-1fb5-492a-bb31-67ab89be826b => generated 1214 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:17:07.515239 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-01bb83cf-e9c0-4473-b14d-37c9ef287358 tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:17:07.515882 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-01bb83cf-e9c0-4473-b14d-37c9ef287358 tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] [instance: 063cdb4b-1fb5-492a-bb31-67ab89be826b] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:17:07.523110 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-01bb83cf-e9c0-4473-b14d-37c9ef287358 tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:07.523601 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-01bb83cf-e9c0-4473-b14d-37c9ef287358 tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:07.524044 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-01bb83cf-e9c0-4473-b14d-37c9ef287358 tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:07.524794 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-01bb83cf-e9c0-4473-b14d-37c9ef287358 tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:07.525259 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-01bb83cf-e9c0-4473-b14d-37c9ef287358 tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:07.525688 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-01bb83cf-e9c0-4473-b14d-37c9ef287358 tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:07.592814 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-01bb83cf-e9c0-4473-b14d-37c9ef287358 tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d4e382ab1e41e99bd22b4f7942dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb33d212f8094c878fba42eadd6feac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:17:07.605325 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-01bb83cf-e9c0-4473-b14d-37c9ef287358 tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] 10.222.0.33 "GET /compute/v2.1/servers/063cdb4b-1fb5-492a-bb31-67ab89be826b" status: 200 len: 1266 microversion: 2.1 time: 0.095670 Oct 04 21:17:07.606026 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2965/5963] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:17:07 2022] GET /compute/v2.1/servers/063cdb4b-1fb5-492a-bb31-67ab89be826b => generated 1266 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:17:08.629404 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-651decc0-622b-480b-8f38-cb5e27711f65 tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:17:08.630020 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-651decc0-622b-480b-8f38-cb5e27711f65 tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] [instance: 063cdb4b-1fb5-492a-bb31-67ab89be826b] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:17:08.637535 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-651decc0-622b-480b-8f38-cb5e27711f65 tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:08.638178 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-651decc0-622b-480b-8f38-cb5e27711f65 tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:08.639405 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-651decc0-622b-480b-8f38-cb5e27711f65 tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:08.639545 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-651decc0-622b-480b-8f38-cb5e27711f65 tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:08.640090 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-651decc0-622b-480b-8f38-cb5e27711f65 tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:08.640632 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-651decc0-622b-480b-8f38-cb5e27711f65 tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:08.851412 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-651decc0-622b-480b-8f38-cb5e27711f65 tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d4e382ab1e41e99bd22b4f7942dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb33d212f8094c878fba42eadd6feac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:17:08.859494 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-651decc0-622b-480b-8f38-cb5e27711f65 tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] 10.222.0.33 "GET /compute/v2.1/servers/063cdb4b-1fb5-492a-bb31-67ab89be826b" status: 200 len: 1314 microversion: 2.1 time: 0.234039 Oct 04 21:17:08.860083 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 2999/5964] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:17:08 2022] GET /compute/v2.1/servers/063cdb4b-1fb5-492a-bb31-67ab89be826b => generated 1314 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:17:09.308541 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-7356fd3f-ced8-47f5-b9c5-c7e54b41a24f req-21597965-d4e3-4655-b84b-ce57e2ac7198 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "063cdb4b-1fb5-492a-bb31-67ab89be826b", "tag": "9ba0d712-21ad-468e-b06a-125a98c6fcf2"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:17:09.318882 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-7356fd3f-ced8-47f5-b9c5-c7e54b41a24f req-21597965-d4e3-4655-b84b-ce57e2ac7198 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:09.319374 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-7356fd3f-ced8-47f5-b9c5-c7e54b41a24f req-21597965-d4e3-4655-b84b-ce57e2ac7198 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:09.319815 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-7356fd3f-ced8-47f5-b9c5-c7e54b41a24f req-21597965-d4e3-4655-b84b-ce57e2ac7198 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:09.332003 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-7356fd3f-ced8-47f5-b9c5-c7e54b41a24f req-21597965-d4e3-4655-b84b-ce57e2ac7198 service nova] Creating event network-changed:9ba0d712-21ad-468e-b06a-125a98c6fcf2 for instance 063cdb4b-1fb5-492a-bb31-67ab89be826b on n-h2-854823-8 Oct 04 21:17:09.335474 n-d-854823-8 devstack@n-api.service[128801]: ERROR oslo.messaging._drivers.impl_rabbit [req-7356fd3f-ced8-47f5-b9c5-c7e54b41a24f req-21597965-d4e3-4655-b84b-ce57e2ac7198 service nova] [d5095b15-64e3-4ec9-a3b0-625b5a4d993e] AMQP server on 10.222.0.33:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 21:17:09.883682 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-93cec9a4-a0b7-413f-8e41-3a53aadc27d5 tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:17:09.884419 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-93cec9a4-a0b7-413f-8e41-3a53aadc27d5 tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] [instance: 063cdb4b-1fb5-492a-bb31-67ab89be826b] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:17:09.893009 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-93cec9a4-a0b7-413f-8e41-3a53aadc27d5 tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:09.893528 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-93cec9a4-a0b7-413f-8e41-3a53aadc27d5 tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:09.893968 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-93cec9a4-a0b7-413f-8e41-3a53aadc27d5 tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:09.894715 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-93cec9a4-a0b7-413f-8e41-3a53aadc27d5 tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:09.895171 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-93cec9a4-a0b7-413f-8e41-3a53aadc27d5 tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:09.895630 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-93cec9a4-a0b7-413f-8e41-3a53aadc27d5 tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:10.047777 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-93cec9a4-a0b7-413f-8e41-3a53aadc27d5 tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d4e382ab1e41e99bd22b4f7942dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb33d212f8094c878fba42eadd6feac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:17:10.055679 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-93cec9a4-a0b7-413f-8e41-3a53aadc27d5 tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] 10.222.0.33 "GET /compute/v2.1/servers/063cdb4b-1fb5-492a-bb31-67ab89be826b" status: 200 len: 1314 microversion: 2.1 time: 0.176990 Oct 04 21:17:10.056261 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3000/5965] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:17:09 2022] GET /compute/v2.1/servers/063cdb4b-1fb5-492a-bb31-67ab89be826b => generated 1314 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:17:10.343800 n-d-854823-8 devstack@n-api.service[128801]: INFO oslo.messaging._drivers.impl_rabbit [req-7356fd3f-ced8-47f5-b9c5-c7e54b41a24f req-21597965-d4e3-4655-b84b-ce57e2ac7198 service nova] [d5095b15-64e3-4ec9-a3b0-625b5a4d993e] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 47722. Oct 04 21:17:10.347683 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-7356fd3f-ced8-47f5-b9c5-c7e54b41a24f req-21597965-d4e3-4655-b84b-ce57e2ac7198 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.125740 Oct 04 21:17:10.348319 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2966/5966] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:17:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:17:11.080182 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-feacbf84-0786-4d1c-8d24-da7ca3a36d01 tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:17:11.080934 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-feacbf84-0786-4d1c-8d24-da7ca3a36d01 tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] [instance: 063cdb4b-1fb5-492a-bb31-67ab89be826b] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:17:11.088473 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-feacbf84-0786-4d1c-8d24-da7ca3a36d01 tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:11.088992 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-feacbf84-0786-4d1c-8d24-da7ca3a36d01 tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:11.090058 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-feacbf84-0786-4d1c-8d24-da7ca3a36d01 tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:11.091125 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-feacbf84-0786-4d1c-8d24-da7ca3a36d01 tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:11.091587 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-feacbf84-0786-4d1c-8d24-da7ca3a36d01 tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:11.092015 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-feacbf84-0786-4d1c-8d24-da7ca3a36d01 tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:11.234754 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-feacbf84-0786-4d1c-8d24-da7ca3a36d01 tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d4e382ab1e41e99bd22b4f7942dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb33d212f8094c878fba42eadd6feac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:17:11.242703 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-feacbf84-0786-4d1c-8d24-da7ca3a36d01 tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] 10.222.0.33 "GET /compute/v2.1/servers/063cdb4b-1fb5-492a-bb31-67ab89be826b" status: 200 len: 1314 microversion: 2.1 time: 0.166276 Oct 04 21:17:11.243208 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3001/5967] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:17:11 2022] GET /compute/v2.1/servers/063cdb4b-1fb5-492a-bb31-67ab89be826b => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:17:12.266737 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6758e100-5458-48d2-945c-02658fa65ac3 tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:17:12.267450 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-6758e100-5458-48d2-945c-02658fa65ac3 tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] [instance: 063cdb4b-1fb5-492a-bb31-67ab89be826b] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:17:12.274295 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6758e100-5458-48d2-945c-02658fa65ac3 tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:12.274837 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6758e100-5458-48d2-945c-02658fa65ac3 tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:12.275275 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6758e100-5458-48d2-945c-02658fa65ac3 tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:12.276018 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6758e100-5458-48d2-945c-02658fa65ac3 tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:12.276480 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6758e100-5458-48d2-945c-02658fa65ac3 tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:12.277584 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6758e100-5458-48d2-945c-02658fa65ac3 tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:12.416791 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-6758e100-5458-48d2-945c-02658fa65ac3 tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d4e382ab1e41e99bd22b4f7942dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb33d212f8094c878fba42eadd6feac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:17:12.425625 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-6758e100-5458-48d2-945c-02658fa65ac3 tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] 10.222.0.33 "GET /compute/v2.1/servers/063cdb4b-1fb5-492a-bb31-67ab89be826b" status: 200 len: 1314 microversion: 2.1 time: 0.164170 Oct 04 21:17:12.426209 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2967/5968] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:17:12 2022] GET /compute/v2.1/servers/063cdb4b-1fb5-492a-bb31-67ab89be826b => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:17:13.450410 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-4dbff4ce-9fd2-4863-a1e9-bba279a3bc54 tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:17:13.451140 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-4dbff4ce-9fd2-4863-a1e9-bba279a3bc54 tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] [instance: 063cdb4b-1fb5-492a-bb31-67ab89be826b] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:17:13.458276 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4dbff4ce-9fd2-4863-a1e9-bba279a3bc54 tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:13.458805 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4dbff4ce-9fd2-4863-a1e9-bba279a3bc54 tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:13.459266 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4dbff4ce-9fd2-4863-a1e9-bba279a3bc54 tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:13.460135 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4dbff4ce-9fd2-4863-a1e9-bba279a3bc54 tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:13.460597 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4dbff4ce-9fd2-4863-a1e9-bba279a3bc54 tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:13.461018 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4dbff4ce-9fd2-4863-a1e9-bba279a3bc54 tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:13.581010 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-789b66be-8925-4b92-8410-077698b8fa33 req-c3784137-4c07-47ac-9dc0-2b06719bf114 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "063cdb4b-1fb5-492a-bb31-67ab89be826b", "name": "network-vif-plugged", "status": "completed", "tag": "9ba0d712-21ad-468e-b06a-125a98c6fcf2"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:17:13.592465 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-789b66be-8925-4b92-8410-077698b8fa33 req-c3784137-4c07-47ac-9dc0-2b06719bf114 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:13.592956 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-789b66be-8925-4b92-8410-077698b8fa33 req-c3784137-4c07-47ac-9dc0-2b06719bf114 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:13.593805 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-789b66be-8925-4b92-8410-077698b8fa33 req-c3784137-4c07-47ac-9dc0-2b06719bf114 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:13.605842 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-789b66be-8925-4b92-8410-077698b8fa33 req-c3784137-4c07-47ac-9dc0-2b06719bf114 service nova] Creating event network-vif-plugged:9ba0d712-21ad-468e-b06a-125a98c6fcf2 for instance 063cdb4b-1fb5-492a-bb31-67ab89be826b on n-h2-854823-8 Oct 04 21:17:13.611120 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-789b66be-8925-4b92-8410-077698b8fa33 req-c3784137-4c07-47ac-9dc0-2b06719bf114 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116367 Oct 04 21:17:13.612198 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2968/5969] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:17:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:17:13.615506 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-4dbff4ce-9fd2-4863-a1e9-bba279a3bc54 tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d4e382ab1e41e99bd22b4f7942dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb33d212f8094c878fba42eadd6feac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:17:13.623659 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-4dbff4ce-9fd2-4863-a1e9-bba279a3bc54 tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] 10.222.0.33 "GET /compute/v2.1/servers/063cdb4b-1fb5-492a-bb31-67ab89be826b" status: 200 len: 1314 microversion: 2.1 time: 0.177869 Oct 04 21:17:13.624242 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3002/5970] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:17:13 2022] GET /compute/v2.1/servers/063cdb4b-1fb5-492a-bb31-67ab89be826b => generated 1314 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:17:14.649059 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-40cccde1-01aa-4d8d-9391-b811f59e2438 tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:17:14.649766 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-40cccde1-01aa-4d8d-9391-b811f59e2438 tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] [instance: 063cdb4b-1fb5-492a-bb31-67ab89be826b] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:17:14.656590 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-40cccde1-01aa-4d8d-9391-b811f59e2438 tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:14.657078 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-40cccde1-01aa-4d8d-9391-b811f59e2438 tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:14.657516 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-40cccde1-01aa-4d8d-9391-b811f59e2438 tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:14.658216 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-40cccde1-01aa-4d8d-9391-b811f59e2438 tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:14.658699 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-40cccde1-01aa-4d8d-9391-b811f59e2438 tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:14.659128 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-40cccde1-01aa-4d8d-9391-b811f59e2438 tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:14.796412 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-40cccde1-01aa-4d8d-9391-b811f59e2438 tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d4e382ab1e41e99bd22b4f7942dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb33d212f8094c878fba42eadd6feac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:17:14.807200 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-40cccde1-01aa-4d8d-9391-b811f59e2438 tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] 10.222.0.33 "GET /compute/v2.1/servers/063cdb4b-1fb5-492a-bb31-67ab89be826b" status: 200 len: 1314 microversion: 2.1 time: 0.163025 Oct 04 21:17:14.808698 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2969/5971] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:17:14 2022] GET /compute/v2.1/servers/063cdb4b-1fb5-492a-bb31-67ab89be826b => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:17:15.831102 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-56b5d0da-5408-4e30-ba89-d0ed2a0aa668 tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:17:15.831695 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-56b5d0da-5408-4e30-ba89-d0ed2a0aa668 tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] [instance: 063cdb4b-1fb5-492a-bb31-67ab89be826b] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:17:15.838659 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-56b5d0da-5408-4e30-ba89-d0ed2a0aa668 tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:15.839164 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-56b5d0da-5408-4e30-ba89-d0ed2a0aa668 tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:15.840188 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-56b5d0da-5408-4e30-ba89-d0ed2a0aa668 tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:15.840893 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-56b5d0da-5408-4e30-ba89-d0ed2a0aa668 tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:15.841340 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-56b5d0da-5408-4e30-ba89-d0ed2a0aa668 tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:15.841755 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-56b5d0da-5408-4e30-ba89-d0ed2a0aa668 tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:15.991326 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-56b5d0da-5408-4e30-ba89-d0ed2a0aa668 tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d4e382ab1e41e99bd22b4f7942dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb33d212f8094c878fba42eadd6feac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:17:15.999766 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-56b5d0da-5408-4e30-ba89-d0ed2a0aa668 tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] 10.222.0.33 "GET /compute/v2.1/servers/063cdb4b-1fb5-492a-bb31-67ab89be826b" status: 200 len: 1500 microversion: 2.1 time: 0.172485 Oct 04 21:17:16.000348 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3003/5972] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:17:15 2022] GET /compute/v2.1/servers/063cdb4b-1fb5-492a-bb31-67ab89be826b => generated 1500 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:17:16.026217 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-faa8bfd2-c259-4456-a299-514cecf78c3a tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:17:16.027055 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-faa8bfd2-c259-4456-a299-514cecf78c3a tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] [instance: 063cdb4b-1fb5-492a-bb31-67ab89be826b] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:17:16.034471 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-faa8bfd2-c259-4456-a299-514cecf78c3a tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:16.034966 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-faa8bfd2-c259-4456-a299-514cecf78c3a tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:16.035436 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-faa8bfd2-c259-4456-a299-514cecf78c3a tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:16.036193 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-faa8bfd2-c259-4456-a299-514cecf78c3a tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:16.036648 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-faa8bfd2-c259-4456-a299-514cecf78c3a tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:16.037073 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-faa8bfd2-c259-4456-a299-514cecf78c3a tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:16.172227 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-faa8bfd2-c259-4456-a299-514cecf78c3a tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d4e382ab1e41e99bd22b4f7942dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb33d212f8094c878fba42eadd6feac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:17:16.180635 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-faa8bfd2-c259-4456-a299-514cecf78c3a tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] 10.222.0.33 "GET /compute/v2.1/servers/063cdb4b-1fb5-492a-bb31-67ab89be826b" status: 200 len: 1500 microversion: 2.1 time: 0.158292 Oct 04 21:17:16.181228 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2970/5973] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:17:16 2022] GET /compute/v2.1/servers/063cdb4b-1fb5-492a-bb31-67ab89be826b => generated 1500 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:17:16.204810 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-953ed3f9-5f30-4679-9ead-d8e82ef250c3 tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:17:16.205348 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-953ed3f9-5f30-4679-9ead-d8e82ef250c3 tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] [instance: 063cdb4b-1fb5-492a-bb31-67ab89be826b] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:17:16.211564 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-953ed3f9-5f30-4679-9ead-d8e82ef250c3 tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:16.212082 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-953ed3f9-5f30-4679-9ead-d8e82ef250c3 tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:16.212525 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-953ed3f9-5f30-4679-9ead-d8e82ef250c3 tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:16.213229 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-953ed3f9-5f30-4679-9ead-d8e82ef250c3 tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:16.213690 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-953ed3f9-5f30-4679-9ead-d8e82ef250c3 tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:16.214125 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-953ed3f9-5f30-4679-9ead-d8e82ef250c3 tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:16.237439 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.objects.instance [None req-953ed3f9-5f30-4679-9ead-d8e82ef250c3 tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Lazy-loading 'flavor' on Instance uuid 063cdb4b-1fb5-492a-bb31-67ab89be826b {{(pid=128802) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:17:16.312132 n-d-854823-8 devstack@n-api.service[128802]: ERROR oslo.messaging._drivers.impl_rabbit [None req-953ed3f9-5f30-4679-9ead-d8e82ef250c3 tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] [c6c19f4c-750a-4c4a-9312-123925cab818] AMQP server on 10.222.0.33:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 21:17:16.487830 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell0:SELECT=2 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:17:17.324055 n-d-854823-8 devstack@n-api.service[128802]: INFO oslo.messaging._drivers.impl_rabbit [None req-953ed3f9-5f30-4679-9ead-d8e82ef250c3 tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] [c6c19f4c-750a-4c4a-9312-123925cab818] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 47742. Oct 04 21:17:17.327722 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-953ed3f9-5f30-4679-9ead-d8e82ef250c3 tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] 10.222.0.33 "POST /compute/v2.1/servers/063cdb4b-1fb5-492a-bb31-67ab89be826b/action" status: 202 len: 0 microversion: 2.1 time: 1.127098 Oct 04 21:17:17.328825 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3004/5974] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 21:17:16 2022] POST /compute/v2.1/servers/063cdb4b-1fb5-492a-bb31-67ab89be826b/action => generated 0 bytes in 1129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 21:17:17.337658 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-15ab5db1-e512-429e-bdee-349a3db4d3e5 tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:17:17.338313 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-15ab5db1-e512-429e-bdee-349a3db4d3e5 tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] [instance: 063cdb4b-1fb5-492a-bb31-67ab89be826b] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:17:17.340782 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:17:17.341622 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=6 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:17:17.355473 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-15ab5db1-e512-429e-bdee-349a3db4d3e5 tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:17.356317 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-15ab5db1-e512-429e-bdee-349a3db4d3e5 tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:17.356421 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-15ab5db1-e512-429e-bdee-349a3db4d3e5 tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:17.357124 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-15ab5db1-e512-429e-bdee-349a3db4d3e5 tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:17.357580 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-15ab5db1-e512-429e-bdee-349a3db4d3e5 tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:17.358006 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-15ab5db1-e512-429e-bdee-349a3db4d3e5 tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:17.511921 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-15ab5db1-e512-429e-bdee-349a3db4d3e5 tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d4e382ab1e41e99bd22b4f7942dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb33d212f8094c878fba42eadd6feac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:17:17.520467 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-15ab5db1-e512-429e-bdee-349a3db4d3e5 tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] 10.222.0.33 "GET /compute/v2.1/servers/063cdb4b-1fb5-492a-bb31-67ab89be826b" status: 200 len: 1508 microversion: 2.1 time: 0.186661 Oct 04 21:17:17.521079 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2971/5975] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:17:17 2022] GET /compute/v2.1/servers/063cdb4b-1fb5-492a-bb31-67ab89be826b => generated 1508 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:17:18.547374 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-8cf4b198-75a1-4fd7-b7d7-14b4dd197678 tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:17:18.548114 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-8cf4b198-75a1-4fd7-b7d7-14b4dd197678 tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] [instance: 063cdb4b-1fb5-492a-bb31-67ab89be826b] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:17:18.558331 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8cf4b198-75a1-4fd7-b7d7-14b4dd197678 tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:18.558863 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8cf4b198-75a1-4fd7-b7d7-14b4dd197678 tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:18.559301 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8cf4b198-75a1-4fd7-b7d7-14b4dd197678 tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:18.560025 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8cf4b198-75a1-4fd7-b7d7-14b4dd197678 tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:18.560481 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8cf4b198-75a1-4fd7-b7d7-14b4dd197678 tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:18.560915 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8cf4b198-75a1-4fd7-b7d7-14b4dd197678 tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:18.711414 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-8cf4b198-75a1-4fd7-b7d7-14b4dd197678 tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d4e382ab1e41e99bd22b4f7942dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb33d212f8094c878fba42eadd6feac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:17:18.720661 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-8cf4b198-75a1-4fd7-b7d7-14b4dd197678 tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] 10.222.0.33 "GET /compute/v2.1/servers/063cdb4b-1fb5-492a-bb31-67ab89be826b" status: 200 len: 1491 microversion: 2.1 time: 0.179756 Oct 04 21:17:18.721239 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3005/5976] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:17:18 2022] GET /compute/v2.1/servers/063cdb4b-1fb5-492a-bb31-67ab89be826b => generated 1491 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:17:18.743107 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-3269a118-7ad0-4818-b011-ed4ade57e029 tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:17:18.743722 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-3269a118-7ad0-4818-b011-ed4ade57e029 tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] [instance: 063cdb4b-1fb5-492a-bb31-67ab89be826b] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:17:18.751522 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3269a118-7ad0-4818-b011-ed4ade57e029 tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:18.752010 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3269a118-7ad0-4818-b011-ed4ade57e029 tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:18.752458 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3269a118-7ad0-4818-b011-ed4ade57e029 tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:18.753159 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3269a118-7ad0-4818-b011-ed4ade57e029 tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:18.753612 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3269a118-7ad0-4818-b011-ed4ade57e029 tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:18.754033 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3269a118-7ad0-4818-b011-ed4ade57e029 tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:18.826400 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-3269a118-7ad0-4818-b011-ed4ade57e029 tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] 10.222.0.33 "POST /compute/v2.1/servers/063cdb4b-1fb5-492a-bb31-67ab89be826b/action" status: 202 len: 0 microversion: 2.1 time: 0.087018 Oct 04 21:17:18.826985 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2972/5977] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 21:17:18 2022] POST /compute/v2.1/servers/063cdb4b-1fb5-492a-bb31-67ab89be826b/action => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:17:18.835562 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-a861b598-a1f1-43d1-9179-5d8dbcc1e16c tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:17:18.836182 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-a861b598-a1f1-43d1-9179-5d8dbcc1e16c tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] [instance: 063cdb4b-1fb5-492a-bb31-67ab89be826b] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:17:18.843585 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a861b598-a1f1-43d1-9179-5d8dbcc1e16c tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:18.844098 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a861b598-a1f1-43d1-9179-5d8dbcc1e16c tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:18.844534 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a861b598-a1f1-43d1-9179-5d8dbcc1e16c tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:18.845233 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a861b598-a1f1-43d1-9179-5d8dbcc1e16c tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:18.845690 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a861b598-a1f1-43d1-9179-5d8dbcc1e16c tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:18.846120 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a861b598-a1f1-43d1-9179-5d8dbcc1e16c tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:19.072380 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-a861b598-a1f1-43d1-9179-5d8dbcc1e16c tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d4e382ab1e41e99bd22b4f7942dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb33d212f8094c878fba42eadd6feac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:17:19.082111 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-a861b598-a1f1-43d1-9179-5d8dbcc1e16c tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] 10.222.0.33 "GET /compute/v2.1/servers/063cdb4b-1fb5-492a-bb31-67ab89be826b" status: 200 len: 1497 microversion: 2.1 time: 0.250326 Oct 04 21:17:19.082642 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3006/5978] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:17:18 2022] GET /compute/v2.1/servers/063cdb4b-1fb5-492a-bb31-67ab89be826b => generated 1497 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:17:20.108055 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-06ee02ab-e212-448f-968f-84f4b3d12894 tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:17:20.108659 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-06ee02ab-e212-448f-968f-84f4b3d12894 tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] [instance: 063cdb4b-1fb5-492a-bb31-67ab89be826b] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:17:20.115938 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-06ee02ab-e212-448f-968f-84f4b3d12894 tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:20.116423 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-06ee02ab-e212-448f-968f-84f4b3d12894 tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:20.116861 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-06ee02ab-e212-448f-968f-84f4b3d12894 tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:20.117557 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-06ee02ab-e212-448f-968f-84f4b3d12894 tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:20.118015 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-06ee02ab-e212-448f-968f-84f4b3d12894 tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:20.118460 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-06ee02ab-e212-448f-968f-84f4b3d12894 tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:20.273084 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-06ee02ab-e212-448f-968f-84f4b3d12894 tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d4e382ab1e41e99bd22b4f7942dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb33d212f8094c878fba42eadd6feac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:17:20.283930 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-06ee02ab-e212-448f-968f-84f4b3d12894 tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] 10.222.0.33 "GET /compute/v2.1/servers/063cdb4b-1fb5-492a-bb31-67ab89be826b" status: 200 len: 1497 microversion: 2.1 time: 0.181181 Oct 04 21:17:20.284521 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2973/5979] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:17:20 2022] GET /compute/v2.1/servers/063cdb4b-1fb5-492a-bb31-67ab89be826b => generated 1497 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:17:21.307217 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-727b4a0c-6e31-469b-9991-7247e2659d4c tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:17:21.308298 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-727b4a0c-6e31-469b-9991-7247e2659d4c tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] [instance: 063cdb4b-1fb5-492a-bb31-67ab89be826b] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:17:21.315461 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-727b4a0c-6e31-469b-9991-7247e2659d4c tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:21.315939 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-727b4a0c-6e31-469b-9991-7247e2659d4c tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:21.316368 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-727b4a0c-6e31-469b-9991-7247e2659d4c tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:21.317064 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-727b4a0c-6e31-469b-9991-7247e2659d4c tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:21.317507 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-727b4a0c-6e31-469b-9991-7247e2659d4c tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:21.317928 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-727b4a0c-6e31-469b-9991-7247e2659d4c tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:21.459859 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-727b4a0c-6e31-469b-9991-7247e2659d4c tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d4e382ab1e41e99bd22b4f7942dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb33d212f8094c878fba42eadd6feac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:17:21.468655 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-727b4a0c-6e31-469b-9991-7247e2659d4c tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] 10.222.0.33 "GET /compute/v2.1/servers/063cdb4b-1fb5-492a-bb31-67ab89be826b" status: 200 len: 1500 microversion: 2.1 time: 0.165535 Oct 04 21:17:21.470417 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3007/5980] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:17:21 2022] GET /compute/v2.1/servers/063cdb4b-1fb5-492a-bb31-67ab89be826b => generated 1500 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:17:21.491839 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c7d01532-d095-473a-8ad4-66559cda09f9 tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:17:21.492550 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c7d01532-d095-473a-8ad4-66559cda09f9 tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] [instance: 063cdb4b-1fb5-492a-bb31-67ab89be826b] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:17:21.499753 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c7d01532-d095-473a-8ad4-66559cda09f9 tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:21.500249 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c7d01532-d095-473a-8ad4-66559cda09f9 tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:21.500683 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c7d01532-d095-473a-8ad4-66559cda09f9 tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:21.501395 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c7d01532-d095-473a-8ad4-66559cda09f9 tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:21.501853 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c7d01532-d095-473a-8ad4-66559cda09f9 tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:21.502281 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c7d01532-d095-473a-8ad4-66559cda09f9 tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:21.527381 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-c7d01532-d095-473a-8ad4-66559cda09f9 tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Lazy-loading 'flavor' on Instance uuid 063cdb4b-1fb5-492a-bb31-67ab89be826b {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:17:21.604035 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c7d01532-d095-473a-8ad4-66559cda09f9 tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] 10.222.0.33 "POST /compute/v2.1/servers/063cdb4b-1fb5-492a-bb31-67ab89be826b/action" status: 202 len: 0 microversion: 2.1 time: 0.115849 Oct 04 21:17:21.604875 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2974/5981] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 21:17:21 2022] POST /compute/v2.1/servers/063cdb4b-1fb5-492a-bb31-67ab89be826b/action => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:17:21.613396 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-837afef9-a2f3-4fbe-9b27-827200b2fa62 tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:17:21.614034 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-837afef9-a2f3-4fbe-9b27-827200b2fa62 tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] [instance: 063cdb4b-1fb5-492a-bb31-67ab89be826b] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:17:21.620241 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-837afef9-a2f3-4fbe-9b27-827200b2fa62 tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:21.620993 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-837afef9-a2f3-4fbe-9b27-827200b2fa62 tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:21.621544 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-837afef9-a2f3-4fbe-9b27-827200b2fa62 tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:21.622255 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-837afef9-a2f3-4fbe-9b27-827200b2fa62 tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:21.622749 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-837afef9-a2f3-4fbe-9b27-827200b2fa62 tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:21.623179 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-837afef9-a2f3-4fbe-9b27-827200b2fa62 tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:21.758761 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-837afef9-a2f3-4fbe-9b27-827200b2fa62 tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d4e382ab1e41e99bd22b4f7942dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb33d212f8094c878fba42eadd6feac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:17:21.768002 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-837afef9-a2f3-4fbe-9b27-827200b2fa62 tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] 10.222.0.33 "GET /compute/v2.1/servers/063cdb4b-1fb5-492a-bb31-67ab89be826b" status: 200 len: 1508 microversion: 2.1 time: 0.158704 Oct 04 21:17:21.768592 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3008/5982] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:17:21 2022] GET /compute/v2.1/servers/063cdb4b-1fb5-492a-bb31-67ab89be826b => generated 1508 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:17:22.794027 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-764062e5-a97a-4719-b318-e14b600a8beb tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:17:22.794799 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-764062e5-a97a-4719-b318-e14b600a8beb tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] [instance: 063cdb4b-1fb5-492a-bb31-67ab89be826b] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:17:22.802262 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-764062e5-a97a-4719-b318-e14b600a8beb tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:22.802815 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-764062e5-a97a-4719-b318-e14b600a8beb tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:22.803247 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-764062e5-a97a-4719-b318-e14b600a8beb tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:22.803963 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-764062e5-a97a-4719-b318-e14b600a8beb tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:22.804422 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-764062e5-a97a-4719-b318-e14b600a8beb tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:22.804869 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-764062e5-a97a-4719-b318-e14b600a8beb tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:22.951223 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-764062e5-a97a-4719-b318-e14b600a8beb tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d4e382ab1e41e99bd22b4f7942dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb33d212f8094c878fba42eadd6feac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:17:22.959349 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-764062e5-a97a-4719-b318-e14b600a8beb tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] 10.222.0.33 "GET /compute/v2.1/servers/063cdb4b-1fb5-492a-bb31-67ab89be826b" status: 200 len: 1491 microversion: 2.1 time: 0.170919 Oct 04 21:17:22.959917 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2975/5983] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:17:22 2022] GET /compute/v2.1/servers/063cdb4b-1fb5-492a-bb31-67ab89be826b => generated 1491 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:17:22.983035 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-038ef510-3d0d-4eca-b4b2-6df259c1440d tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:17:22.983605 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-038ef510-3d0d-4eca-b4b2-6df259c1440d tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] [instance: 063cdb4b-1fb5-492a-bb31-67ab89be826b] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:17:22.990362 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-038ef510-3d0d-4eca-b4b2-6df259c1440d tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:22.990856 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-038ef510-3d0d-4eca-b4b2-6df259c1440d tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:22.991284 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-038ef510-3d0d-4eca-b4b2-6df259c1440d tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:22.991975 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-038ef510-3d0d-4eca-b4b2-6df259c1440d tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:22.992425 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-038ef510-3d0d-4eca-b4b2-6df259c1440d tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:22.992842 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-038ef510-3d0d-4eca-b4b2-6df259c1440d tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:23.066589 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-038ef510-3d0d-4eca-b4b2-6df259c1440d tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] 10.222.0.33 "POST /compute/v2.1/servers/063cdb4b-1fb5-492a-bb31-67ab89be826b/action" status: 202 len: 0 microversion: 2.1 time: 0.088036 Oct 04 21:17:23.067355 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3009/5984] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 21:17:22 2022] POST /compute/v2.1/servers/063cdb4b-1fb5-492a-bb31-67ab89be826b/action => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:17:23.076827 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-224ddfad-5c22-409d-9c6f-ea05549363fc tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:17:23.077453 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-224ddfad-5c22-409d-9c6f-ea05549363fc tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] [instance: 063cdb4b-1fb5-492a-bb31-67ab89be826b] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:17:23.083904 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-224ddfad-5c22-409d-9c6f-ea05549363fc tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:23.084676 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-224ddfad-5c22-409d-9c6f-ea05549363fc tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:23.085123 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-224ddfad-5c22-409d-9c6f-ea05549363fc tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:23.085836 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-224ddfad-5c22-409d-9c6f-ea05549363fc tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:23.086303 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-224ddfad-5c22-409d-9c6f-ea05549363fc tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:23.086763 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-224ddfad-5c22-409d-9c6f-ea05549363fc tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:23.289801 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-224ddfad-5c22-409d-9c6f-ea05549363fc tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d4e382ab1e41e99bd22b4f7942dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb33d212f8094c878fba42eadd6feac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:17:23.298482 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-224ddfad-5c22-409d-9c6f-ea05549363fc tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] 10.222.0.33 "GET /compute/v2.1/servers/063cdb4b-1fb5-492a-bb31-67ab89be826b" status: 200 len: 1497 microversion: 2.1 time: 0.226694 Oct 04 21:17:23.299084 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2976/5985] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:17:23 2022] GET /compute/v2.1/servers/063cdb4b-1fb5-492a-bb31-67ab89be826b => generated 1497 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:17:24.322231 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-c5ed5873-17a4-4d5e-8ffe-c4a7f5d07175 tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:17:24.322949 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-c5ed5873-17a4-4d5e-8ffe-c4a7f5d07175 tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] [instance: 063cdb4b-1fb5-492a-bb31-67ab89be826b] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:17:24.330741 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c5ed5873-17a4-4d5e-8ffe-c4a7f5d07175 tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:24.331572 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c5ed5873-17a4-4d5e-8ffe-c4a7f5d07175 tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:24.332005 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c5ed5873-17a4-4d5e-8ffe-c4a7f5d07175 tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:24.332704 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c5ed5873-17a4-4d5e-8ffe-c4a7f5d07175 tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:24.333152 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c5ed5873-17a4-4d5e-8ffe-c4a7f5d07175 tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:24.333568 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c5ed5873-17a4-4d5e-8ffe-c4a7f5d07175 tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:24.474999 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-c5ed5873-17a4-4d5e-8ffe-c4a7f5d07175 tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d4e382ab1e41e99bd22b4f7942dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb33d212f8094c878fba42eadd6feac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:17:24.483681 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-c5ed5873-17a4-4d5e-8ffe-c4a7f5d07175 tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] 10.222.0.33 "GET /compute/v2.1/servers/063cdb4b-1fb5-492a-bb31-67ab89be826b" status: 200 len: 1497 microversion: 2.1 time: 0.165979 Oct 04 21:17:24.484283 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3010/5986] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:17:24 2022] GET /compute/v2.1/servers/063cdb4b-1fb5-492a-bb31-67ab89be826b => generated 1497 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:17:25.507446 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-09ec4dd6-b2d4-4f1d-a834-9c349a9240c6 tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:17:25.508063 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-09ec4dd6-b2d4-4f1d-a834-9c349a9240c6 tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] [instance: 063cdb4b-1fb5-492a-bb31-67ab89be826b] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:17:25.516712 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-09ec4dd6-b2d4-4f1d-a834-9c349a9240c6 tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:25.517207 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-09ec4dd6-b2d4-4f1d-a834-9c349a9240c6 tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:25.518286 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-09ec4dd6-b2d4-4f1d-a834-9c349a9240c6 tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:25.519049 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-09ec4dd6-b2d4-4f1d-a834-9c349a9240c6 tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:25.519510 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-09ec4dd6-b2d4-4f1d-a834-9c349a9240c6 tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:25.519941 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-09ec4dd6-b2d4-4f1d-a834-9c349a9240c6 tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:25.670801 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-09ec4dd6-b2d4-4f1d-a834-9c349a9240c6 tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d4e382ab1e41e99bd22b4f7942dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb33d212f8094c878fba42eadd6feac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:17:25.681411 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-09ec4dd6-b2d4-4f1d-a834-9c349a9240c6 tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] 10.222.0.33 "GET /compute/v2.1/servers/063cdb4b-1fb5-492a-bb31-67ab89be826b" status: 200 len: 1500 microversion: 2.1 time: 0.177675 Oct 04 21:17:25.682943 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2977/5987] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:17:25 2022] GET /compute/v2.1/servers/063cdb4b-1fb5-492a-bb31-67ab89be826b => generated 1500 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:17:25.707336 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-73dc77b4-8842-466f-b42b-fcfa474bef0e tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:17:25.707886 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-73dc77b4-8842-466f-b42b-fcfa474bef0e tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] [instance: 063cdb4b-1fb5-492a-bb31-67ab89be826b] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:17:25.716242 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-73dc77b4-8842-466f-b42b-fcfa474bef0e tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:25.716748 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-73dc77b4-8842-466f-b42b-fcfa474bef0e tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:25.717210 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-73dc77b4-8842-466f-b42b-fcfa474bef0e tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:25.717922 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-73dc77b4-8842-466f-b42b-fcfa474bef0e tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:25.718401 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-73dc77b4-8842-466f-b42b-fcfa474bef0e tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:25.718834 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-73dc77b4-8842-466f-b42b-fcfa474bef0e tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:25.747806 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-73dc77b4-8842-466f-b42b-fcfa474bef0e tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] [instance: 063cdb4b-1fb5-492a-bb31-67ab89be826b] Going to try to terminate instance {{(pid=128802) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:17:25.784330 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:17:25.829773 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-73dc77b4-8842-466f-b42b-fcfa474bef0e tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] 10.222.0.33 "DELETE /compute/v2.1/servers/063cdb4b-1fb5-492a-bb31-67ab89be826b" status: 204 len: 0 microversion: 2.1 time: 0.126045 Oct 04 21:17:25.830538 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3011/5988] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 21:17:25 2022] DELETE /compute/v2.1/servers/063cdb4b-1fb5-492a-bb31-67ab89be826b => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:17:25.838932 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-69a66e8c-8e75-4f1c-a759-8aa87726351f tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:17:25.839579 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-69a66e8c-8e75-4f1c-a759-8aa87726351f tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] [instance: 063cdb4b-1fb5-492a-bb31-67ab89be826b] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:17:25.845686 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-69a66e8c-8e75-4f1c-a759-8aa87726351f tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:25.846179 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-69a66e8c-8e75-4f1c-a759-8aa87726351f tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:25.846639 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-69a66e8c-8e75-4f1c-a759-8aa87726351f tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:25.847345 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-69a66e8c-8e75-4f1c-a759-8aa87726351f tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:25.847798 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-69a66e8c-8e75-4f1c-a759-8aa87726351f tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:25.848222 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-69a66e8c-8e75-4f1c-a759-8aa87726351f tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:25.981290 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-69a66e8c-8e75-4f1c-a759-8aa87726351f tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d4e382ab1e41e99bd22b4f7942dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb33d212f8094c878fba42eadd6feac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:17:25.989265 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-69a66e8c-8e75-4f1c-a759-8aa87726351f tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] 10.222.0.33 "GET /compute/v2.1/servers/063cdb4b-1fb5-492a-bb31-67ab89be826b" status: 200 len: 1506 microversion: 2.1 time: 0.154370 Oct 04 21:17:25.989856 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2978/5989] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:17:25 2022] GET /compute/v2.1/servers/063cdb4b-1fb5-492a-bb31-67ab89be826b => generated 1506 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:17:27.013206 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-e2198fdc-0292-43f7-a128-c8b70f71a06e tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:17:27.013914 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-e2198fdc-0292-43f7-a128-c8b70f71a06e tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] [instance: 063cdb4b-1fb5-492a-bb31-67ab89be826b] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:17:27.020980 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e2198fdc-0292-43f7-a128-c8b70f71a06e tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:27.021466 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e2198fdc-0292-43f7-a128-c8b70f71a06e tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:27.021903 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e2198fdc-0292-43f7-a128-c8b70f71a06e tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:27.022650 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e2198fdc-0292-43f7-a128-c8b70f71a06e tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:27.023107 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e2198fdc-0292-43f7-a128-c8b70f71a06e tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:27.023551 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e2198fdc-0292-43f7-a128-c8b70f71a06e tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:27.157705 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-e2198fdc-0292-43f7-a128-c8b70f71a06e tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d4e382ab1e41e99bd22b4f7942dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb33d212f8094c878fba42eadd6feac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:17:27.165691 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-e2198fdc-0292-43f7-a128-c8b70f71a06e tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] 10.222.0.33 "GET /compute/v2.1/servers/063cdb4b-1fb5-492a-bb31-67ab89be826b" status: 200 len: 1506 microversion: 2.1 time: 0.156681 Oct 04 21:17:27.166593 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3012/5990] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:17:27 2022] GET /compute/v2.1/servers/063cdb4b-1fb5-492a-bb31-67ab89be826b => generated 1506 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:17:28.189297 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-01ecf55a-90bc-4036-babe-b5cbff8a703d tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:17:28.189892 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-01ecf55a-90bc-4036-babe-b5cbff8a703d tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] [instance: 063cdb4b-1fb5-492a-bb31-67ab89be826b] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:17:28.198963 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-01ecf55a-90bc-4036-babe-b5cbff8a703d tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:28.199455 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-01ecf55a-90bc-4036-babe-b5cbff8a703d tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:28.199911 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-01ecf55a-90bc-4036-babe-b5cbff8a703d tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:28.200626 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-01ecf55a-90bc-4036-babe-b5cbff8a703d tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:28.201066 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-01ecf55a-90bc-4036-babe-b5cbff8a703d tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:28.201489 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-01ecf55a-90bc-4036-babe-b5cbff8a703d tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:28.210901 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-1743cede-9750-438c-bfbc-ea4e42673e4f req-3280e578-4257-4912-92c8-35cd31b261b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "063cdb4b-1fb5-492a-bb31-67ab89be826b", "name": "network-vif-deleted", "tag": "9ba0d712-21ad-468e-b06a-125a98c6fcf2"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:17:28.222815 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-1743cede-9750-438c-bfbc-ea4e42673e4f req-3280e578-4257-4912-92c8-35cd31b261b4 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:28.223300 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-1743cede-9750-438c-bfbc-ea4e42673e4f req-3280e578-4257-4912-92c8-35cd31b261b4 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:28.223735 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-1743cede-9750-438c-bfbc-ea4e42673e4f req-3280e578-4257-4912-92c8-35cd31b261b4 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:28.237235 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-1743cede-9750-438c-bfbc-ea4e42673e4f req-3280e578-4257-4912-92c8-35cd31b261b4 service nova] Creating event network-vif-deleted:9ba0d712-21ad-468e-b06a-125a98c6fcf2 for instance 063cdb4b-1fb5-492a-bb31-67ab89be826b on n-h2-854823-8 Oct 04 21:17:28.242680 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-1743cede-9750-438c-bfbc-ea4e42673e4f req-3280e578-4257-4912-92c8-35cd31b261b4 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036080 Oct 04 21:17:28.243820 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3013/5991] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:17:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:17:28.280530 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-01ecf55a-90bc-4036-babe-b5cbff8a703d tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d4e382ab1e41e99bd22b4f7942dec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb33d212f8094c878fba42eadd6feac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:17:28.284304 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:17:28.289647 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-01ecf55a-90bc-4036-babe-b5cbff8a703d tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] 10.222.0.33 "GET /compute/v2.1/servers/063cdb4b-1fb5-492a-bb31-67ab89be826b" status: 200 len: 1464 microversion: 2.1 time: 0.104238 Oct 04 21:17:28.290927 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2979/5992] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:17:28 2022] GET /compute/v2.1/servers/063cdb4b-1fb5-492a-bb31-67ab89be826b => generated 1464 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:17:29.322282 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-80a2ac37-5808-43ec-b2cd-ace686e214f4 tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:17:29.323416 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-80a2ac37-5808-43ec-b2cd-ace686e214f4 tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] [instance: 063cdb4b-1fb5-492a-bb31-67ab89be826b] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:17:29.329748 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-80a2ac37-5808-43ec-b2cd-ace686e214f4 tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:29.330228 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-80a2ac37-5808-43ec-b2cd-ace686e214f4 tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:29.330691 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-80a2ac37-5808-43ec-b2cd-ace686e214f4 tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:29.331384 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-80a2ac37-5808-43ec-b2cd-ace686e214f4 tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:29.331832 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-80a2ac37-5808-43ec-b2cd-ace686e214f4 tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:29.332250 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-80a2ac37-5808-43ec-b2cd-ace686e214f4 tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:29.346752 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.wsgi [None req-80a2ac37-5808-43ec-b2cd-ace686e214f4 tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] HTTP exception thrown: Instance 063cdb4b-1fb5-492a-bb31-67ab89be826b could not be found. Oct 04 21:17:29.348527 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-80a2ac37-5808-43ec-b2cd-ace686e214f4 tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Request method failure captured: Oct 04 21:17:29.348527 n-d-854823-8 devstack@n-api.service[128802]: request: GET /compute/v2.1/servers/063cdb4b-1fb5-492a-bb31-67ab89be826b HTTP/1.1 Oct 04 21:17:29.348527 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 21:17:29.348527 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 21:17:29.348527 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 21:17:29.348527 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 0 Oct 04 21:17:29.348527 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 21:17:29.348527 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 21:17:29.348527 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 21:17:29.348527 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 21:17:29.348527 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPKLQsElqgon9VZ72ZOc0WrT-eDMnhH68SJiJiYa-823JS120isqpsBlHQ9aknKKnvlr9pM375wLsy8kCiAieAUsAIpekLP_byqPkTK2dCArnByByLc98uzmvFBI0GhTuZQIqP2SasUiQSGdgmgjfM6xwUgXlnisNbPSj7BYpKb1gtfM Oct 04 21:17:29.348527 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 21:17:29.348527 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 21:17:29.348527 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 21:17:29.348527 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 21:17:29.348527 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 21:17:29.348527 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 21:17:29.348527 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: fb33d212f8094c878fba42eadd6feac7 Oct 04 21:17:29.348527 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-TestServerAdvancedOps-1002339280 Oct 04 21:17:29.348527 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 21:17:29.348527 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 21:17:29.348527 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_fb33d212f8094c878fba42eadd6feac7", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fb33d212f8094c878fba42eadd6feac7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fb33d212f8094c878fba42eadd6feac7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/fb33d212f8094c878fba42eadd6feac7"}]}] Oct 04 21:17:29.348527 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-TestServerAdvancedOps-1002339280 Oct 04 21:17:29.348527 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: fb33d212f8094c878fba42eadd6feac7 Oct 04 21:17:29.348527 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-TestServerAdvancedOps-1002339280 Oct 04 21:17:29.348527 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-TestServerAdvancedOps-1002339280-project Oct 04 21:17:29.348527 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 21:17:29.348527 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 21:17:29.348527 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: 12d4e382ab1e41e99bd22b4f7942dec5 Oct 04 21:17:29.348527 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-TestServerAdvancedOps-1002339280-project Oct 04 21:17:29.348527 n-d-854823-8 devstack@n-api.service[128802]: method: > Oct 04 21:17:29.348527 n-d-854823-8 devstack@n-api.service[128802]: exception: Instance 063cdb4b-1fb5-492a-bb31-67ab89be826b could not be found. Oct 04 21:17:29.348527 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'id': '063cdb4b-1fb5-492a-bb31-67ab89be826b'} Oct 04 21:17:29.348527 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:17:29.348527 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:17:29.348527 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:17:29.348527 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:17:29.348527 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:17:29.348527 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:17:29.348527 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:17:29.348527 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:17:29.348527 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:17:29.348527 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:17:29.348527 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 063cdb4b-1fb5-492a-bb31-67ab89be826b could not be found. Oct 04 21:17:29.348527 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:17:29.348527 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:17:29.348527 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:17:29.348527 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:17:29.348527 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:17:29.348527 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:17:29.348527 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:17:29.348527 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:17:29.348527 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:17:29.348527 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:17:29.348527 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:17:29.348527 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:17:29.348527 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:17:29.348527 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:17:29.348527 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:17:29.348527 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:17:29.348527 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 063cdb4b-1fb5-492a-bb31-67ab89be826b could not be found. Oct 04 21:17:29.348527 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:17:29.348527 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:17:29.348527 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:17:29.352957 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:17:29.352957 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:17:29.352957 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:17:29.352957 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:17:29.352957 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:17:29.352957 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 063cdb4b-1fb5-492a-bb31-67ab89be826b could not be found. Oct 04 21:17:29.352957 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:17:29.352957 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-80a2ac37-5808-43ec-b2cd-ace686e214f4 tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] Returning 404 to user: Instance 063cdb4b-1fb5-492a-bb31-67ab89be826b could not be found. {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:17:29.352957 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-80a2ac37-5808-43ec-b2cd-ace686e214f4 tempest-TestServerAdvancedOps-1002339280 tempest-TestServerAdvancedOps-1002339280-project] 10.222.0.33 "GET /compute/v2.1/servers/063cdb4b-1fb5-492a-bb31-67ab89be826b" status: 404 len: 111 microversion: 2.1 time: 0.033476 Oct 04 21:17:29.352957 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3014/5993] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:17:29 2022] GET /compute/v2.1/servers/063cdb4b-1fb5-492a-bb31-67ab89be826b => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:17:41.299357 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:17:41.420837 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-fe957858-456f-4313-8311-55a4fb711e91 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:17:41.422750 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fe957858-456f-4313-8311-55a4fb711e91 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:41.423308 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fe957858-456f-4313-8311-55a4fb711e91 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:41.423965 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fe957858-456f-4313-8311-55a4fb711e91 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:41.424778 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fe957858-456f-4313-8311-55a4fb711e91 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:41.425442 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fe957858-456f-4313-8311-55a4fb711e91 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:41.425856 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fe957858-456f-4313-8311-55a4fb711e91 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:41.450054 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-fe957858-456f-4313-8311-55a4fb711e91 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] 10.222.0.33 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 612 microversion: 2.1 time: 0.156317 Oct 04 21:17:41.450703 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2980/5994] 10.222.0.33 () {58 vars in 1185 bytes} [Tue Oct 4 21:17:41 2022] GET /compute/v2.1/os-availability-zone/detail => generated 612 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:17:41.667570 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-2cf37765-a055-4804-bdf1-d1b382ed2760 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-337857416", "imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63", "flavorRef": "452", "availability_zone": "nova:n-h1-854823-8", "networks": [{"uuid": "279f85b7-b5ad-4344-9498-d8daed5b1683"}]}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:17:41.684315 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:17:41.685772 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=13,nova_cell1:INSERT=1 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:17:41.747257 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.network.neutron [None req-2cf37765-a055-4804-bdf1-d1b382ed2760 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] validate_networks() for [('279f85b7-b5ad-4344-9498-d8daed5b1683', None, None, None, None, None)] {{(pid=128802) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:17:42.314846 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-2cf37765-a055-4804-bdf1-d1b382ed2760 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Flavor limits 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:17:42.315267 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-2cf37765-a055-4804-bdf1-d1b382ed2760 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Image limits 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:17:42.315747 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-2cf37765-a055-4804-bdf1-d1b382ed2760 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Flavor pref 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:17:42.316153 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-2cf37765-a055-4804-bdf1-d1b382ed2760 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Image pref 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:17:42.316566 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-2cf37765-a055-4804-bdf1-d1b382ed2760 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:17:42.326746 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2cf37765-a055-4804-bdf1-d1b382ed2760 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:42.327223 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2cf37765-a055-4804-bdf1-d1b382ed2760 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:42.327658 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2cf37765-a055-4804-bdf1-d1b382ed2760 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:42.328381 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2cf37765-a055-4804-bdf1-d1b382ed2760 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:42.328833 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2cf37765-a055-4804-bdf1-d1b382ed2760 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:42.329263 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2cf37765-a055-4804-bdf1-d1b382ed2760 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:42.348869 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-2cf37765-a055-4804-bdf1-d1b382ed2760 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Getting quotas for project 16cb4d41219b4848a5ae82100236b872. Resources: {'ram', 'instances', 'cores'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:17:42.356374 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-2cf37765-a055-4804-bdf1-d1b382ed2760 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Getting quotas for user 50ac628802cc4fa88a9c4e87c65ae927 and project 16cb4d41219b4848a5ae82100236b872. Resources: {'ram', 'instances', 'cores'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:17:42.370712 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-2cf37765-a055-4804-bdf1-d1b382ed2760 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Going to run 1 instances... {{(pid=128802) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:17:42.373089 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-2cf37765-a055-4804-bdf1-d1b382ed2760 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] [instance: 95c3fb61-cdbd-495c-87c4-fb08a38c84e3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='15b24725-0c99-4bcf-b1fb-907cdf8e2d63',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128802) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:17:42.424149 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-2cf37765-a055-4804-bdf1-d1b382ed2760 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.761534 Oct 04 21:17:42.424795 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3015/5995] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 21:17:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 763 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 21:17:42.436351 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-77a260ad-870d-42c4-8307-b27e0a8066e7 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:17:42.436982 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-77a260ad-870d-42c4-8307-b27e0a8066e7 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] [instance: 95c3fb61-cdbd-495c-87c4-fb08a38c84e3] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:17:42.505493 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-77a260ad-870d-42c4-8307-b27e0a8066e7 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/95c3fb61-cdbd-495c-87c4-fb08a38c84e3" status: 200 len: 1328 microversion: 2.1 time: 0.073467 Oct 04 21:17:42.506079 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2981/5996] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:17:42 2022] GET /compute/v2.1/servers/95c3fb61-cdbd-495c-87c4-fb08a38c84e3 => generated 1328 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:17:43.530040 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-ab27ff9c-31b6-4a42-bb62-16028343f921 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:17:43.530641 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-ab27ff9c-31b6-4a42-bb62-16028343f921 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] [instance: 95c3fb61-cdbd-495c-87c4-fb08a38c84e3] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:17:43.537713 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ab27ff9c-31b6-4a42-bb62-16028343f921 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:43.538247 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ab27ff9c-31b6-4a42-bb62-16028343f921 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:43.538734 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ab27ff9c-31b6-4a42-bb62-16028343f921 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:43.539433 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ab27ff9c-31b6-4a42-bb62-16028343f921 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:43.539882 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ab27ff9c-31b6-4a42-bb62-16028343f921 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:43.540301 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ab27ff9c-31b6-4a42-bb62-16028343f921 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:43.611538 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-ab27ff9c-31b6-4a42-bb62-16028343f921 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/95c3fb61-cdbd-495c-87c4-fb08a38c84e3" status: 200 len: 1415 microversion: 2.1 time: 0.086881 Oct 04 21:17:43.612111 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3016/5997] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:17:43 2022] GET /compute/v2.1/servers/95c3fb61-cdbd-495c-87c4-fb08a38c84e3 => generated 1415 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:17:44.635610 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-11b01f57-bf2a-4b1a-bb8b-56fd79a29db9 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:17:44.637044 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-11b01f57-bf2a-4b1a-bb8b-56fd79a29db9 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] [instance: 95c3fb61-cdbd-495c-87c4-fb08a38c84e3] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:17:44.644397 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-11b01f57-bf2a-4b1a-bb8b-56fd79a29db9 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:44.645188 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-11b01f57-bf2a-4b1a-bb8b-56fd79a29db9 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:44.645811 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-11b01f57-bf2a-4b1a-bb8b-56fd79a29db9 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:44.646733 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-11b01f57-bf2a-4b1a-bb8b-56fd79a29db9 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:44.647357 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-11b01f57-bf2a-4b1a-bb8b-56fd79a29db9 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:44.647942 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-11b01f57-bf2a-4b1a-bb8b-56fd79a29db9 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:44.792660 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-11b01f57-bf2a-4b1a-bb8b-56fd79a29db9 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/95c3fb61-cdbd-495c-87c4-fb08a38c84e3" status: 200 len: 1463 microversion: 2.1 time: 0.161834 Oct 04 21:17:44.807333 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2982/5998] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:17:44 2022] GET /compute/v2.1/servers/95c3fb61-cdbd-495c-87c4-fb08a38c84e3 => generated 1463 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:17:45.237857 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-11d55b0a-78b3-413c-b491-e9aa0c5aa04c req-4a40cf4d-20fd-4970-96b0-7eb9ad66e686 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95c3fb61-cdbd-495c-87c4-fb08a38c84e3", "tag": "28ddadc8-079d-4ff6-bf0c-0a8c71643885"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:17:45.254627 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-11d55b0a-78b3-413c-b491-e9aa0c5aa04c req-4a40cf4d-20fd-4970-96b0-7eb9ad66e686 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:45.255453 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-11d55b0a-78b3-413c-b491-e9aa0c5aa04c req-4a40cf4d-20fd-4970-96b0-7eb9ad66e686 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:45.256127 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-11d55b0a-78b3-413c-b491-e9aa0c5aa04c req-4a40cf4d-20fd-4970-96b0-7eb9ad66e686 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:45.270772 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-11d55b0a-78b3-413c-b491-e9aa0c5aa04c req-4a40cf4d-20fd-4970-96b0-7eb9ad66e686 service nova] Creating event network-changed:28ddadc8-079d-4ff6-bf0c-0a8c71643885 for instance 95c3fb61-cdbd-495c-87c4-fb08a38c84e3 on n-h1-854823-8 Oct 04 21:17:45.280581 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-11d55b0a-78b3-413c-b491-e9aa0c5aa04c req-4a40cf4d-20fd-4970-96b0-7eb9ad66e686 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.162579 Oct 04 21:17:45.282451 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3017/5999] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:17:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:17:45.818202 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-212960e1-8975-4118-a9d7-b07c5a94be5f tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:17:45.819267 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-212960e1-8975-4118-a9d7-b07c5a94be5f tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] [instance: 95c3fb61-cdbd-495c-87c4-fb08a38c84e3] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:17:45.829546 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-212960e1-8975-4118-a9d7-b07c5a94be5f tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:45.830176 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-212960e1-8975-4118-a9d7-b07c5a94be5f tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:45.830648 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-212960e1-8975-4118-a9d7-b07c5a94be5f tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:45.831646 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-212960e1-8975-4118-a9d7-b07c5a94be5f tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:45.832106 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-212960e1-8975-4118-a9d7-b07c5a94be5f tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:45.832536 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-212960e1-8975-4118-a9d7-b07c5a94be5f tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:45.975601 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-212960e1-8975-4118-a9d7-b07c5a94be5f tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/95c3fb61-cdbd-495c-87c4-fb08a38c84e3" status: 200 len: 1463 microversion: 2.1 time: 0.161951 Oct 04 21:17:45.976636 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2983/6000] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:17:45 2022] GET /compute/v2.1/servers/95c3fb61-cdbd-495c-87c4-fb08a38c84e3 => generated 1463 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:17:47.001564 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-b40fa251-9201-4aed-b2a8-6016f5cc8648 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:17:47.002189 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-b40fa251-9201-4aed-b2a8-6016f5cc8648 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] [instance: 95c3fb61-cdbd-495c-87c4-fb08a38c84e3] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:17:47.008942 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b40fa251-9201-4aed-b2a8-6016f5cc8648 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:47.009472 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b40fa251-9201-4aed-b2a8-6016f5cc8648 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:47.009928 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b40fa251-9201-4aed-b2a8-6016f5cc8648 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:47.010657 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b40fa251-9201-4aed-b2a8-6016f5cc8648 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:47.011116 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b40fa251-9201-4aed-b2a8-6016f5cc8648 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:47.011545 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b40fa251-9201-4aed-b2a8-6016f5cc8648 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:47.155674 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-b40fa251-9201-4aed-b2a8-6016f5cc8648 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/95c3fb61-cdbd-495c-87c4-fb08a38c84e3" status: 200 len: 1463 microversion: 2.1 time: 0.158347 Oct 04 21:17:47.156284 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3018/6001] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:17:46 2022] GET /compute/v2.1/servers/95c3fb61-cdbd-495c-87c4-fb08a38c84e3 => generated 1463 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:17:48.179616 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-fb935aa0-a1fb-4b43-827b-27fa23e4be2a tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:17:48.180190 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-fb935aa0-a1fb-4b43-827b-27fa23e4be2a tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] [instance: 95c3fb61-cdbd-495c-87c4-fb08a38c84e3] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:17:48.187445 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fb935aa0-a1fb-4b43-827b-27fa23e4be2a tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:48.187930 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fb935aa0-a1fb-4b43-827b-27fa23e4be2a tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:48.188375 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fb935aa0-a1fb-4b43-827b-27fa23e4be2a tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:48.189069 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fb935aa0-a1fb-4b43-827b-27fa23e4be2a tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:48.189528 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fb935aa0-a1fb-4b43-827b-27fa23e4be2a tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:48.189956 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fb935aa0-a1fb-4b43-827b-27fa23e4be2a tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:48.314866 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-fb935aa0-a1fb-4b43-827b-27fa23e4be2a tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/95c3fb61-cdbd-495c-87c4-fb08a38c84e3" status: 200 len: 1463 microversion: 2.1 time: 0.138780 Oct 04 21:17:48.315447 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2984/6002] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:17:48 2022] GET /compute/v2.1/servers/95c3fb61-cdbd-495c-87c4-fb08a38c84e3 => generated 1463 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:17:49.339110 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-2ba64709-e2b0-4b40-9c15-28b21f420546 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:17:49.339698 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-2ba64709-e2b0-4b40-9c15-28b21f420546 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] [instance: 95c3fb61-cdbd-495c-87c4-fb08a38c84e3] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:17:49.346897 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2ba64709-e2b0-4b40-9c15-28b21f420546 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:49.347388 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2ba64709-e2b0-4b40-9c15-28b21f420546 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:49.347831 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2ba64709-e2b0-4b40-9c15-28b21f420546 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:49.348574 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2ba64709-e2b0-4b40-9c15-28b21f420546 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:49.349036 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2ba64709-e2b0-4b40-9c15-28b21f420546 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:49.349466 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2ba64709-e2b0-4b40-9c15-28b21f420546 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:49.480722 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-2ba64709-e2b0-4b40-9c15-28b21f420546 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/95c3fb61-cdbd-495c-87c4-fb08a38c84e3" status: 200 len: 1463 microversion: 2.1 time: 0.145927 Oct 04 21:17:49.481317 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3019/6003] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:17:49 2022] GET /compute/v2.1/servers/95c3fb61-cdbd-495c-87c4-fb08a38c84e3 => generated 1463 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:17:50.503685 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-05974833-4f61-4635-aef4-0729e1019861 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:17:50.504308 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-05974833-4f61-4635-aef4-0729e1019861 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] [instance: 95c3fb61-cdbd-495c-87c4-fb08a38c84e3] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:17:50.511960 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-05974833-4f61-4635-aef4-0729e1019861 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:50.512454 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-05974833-4f61-4635-aef4-0729e1019861 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:50.512898 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-05974833-4f61-4635-aef4-0729e1019861 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:50.513603 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-05974833-4f61-4635-aef4-0729e1019861 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:50.514065 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-05974833-4f61-4635-aef4-0729e1019861 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:50.514541 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-05974833-4f61-4635-aef4-0729e1019861 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:50.647838 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-05974833-4f61-4635-aef4-0729e1019861 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/95c3fb61-cdbd-495c-87c4-fb08a38c84e3" status: 200 len: 1463 microversion: 2.1 time: 0.147861 Oct 04 21:17:50.648421 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2985/6004] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:17:50 2022] GET /compute/v2.1/servers/95c3fb61-cdbd-495c-87c4-fb08a38c84e3 => generated 1463 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:17:51.088349 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-a257d1d1-0d96-4deb-99f1-6bb756cf1e44 req-ab851d80-7534-427d-8e1c-eae7cc521aa0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95c3fb61-cdbd-495c-87c4-fb08a38c84e3", "name": "network-vif-plugged", "status": "completed", "tag": "28ddadc8-079d-4ff6-bf0c-0a8c71643885"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:17:51.100520 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-a257d1d1-0d96-4deb-99f1-6bb756cf1e44 req-ab851d80-7534-427d-8e1c-eae7cc521aa0 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:51.101034 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-a257d1d1-0d96-4deb-99f1-6bb756cf1e44 req-ab851d80-7534-427d-8e1c-eae7cc521aa0 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:51.101530 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-a257d1d1-0d96-4deb-99f1-6bb756cf1e44 req-ab851d80-7534-427d-8e1c-eae7cc521aa0 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:51.113552 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-a257d1d1-0d96-4deb-99f1-6bb756cf1e44 req-ab851d80-7534-427d-8e1c-eae7cc521aa0 service nova] Creating event network-vif-plugged:28ddadc8-079d-4ff6-bf0c-0a8c71643885 for instance 95c3fb61-cdbd-495c-87c4-fb08a38c84e3 on n-h1-854823-8 Oct 04 21:17:51.118695 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-a257d1d1-0d96-4deb-99f1-6bb756cf1e44 req-ab851d80-7534-427d-8e1c-eae7cc521aa0 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034537 Oct 04 21:17:51.119874 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3020/6005] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:17:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:17:51.671388 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d56736c9-9f47-4fca-ab07-ae3bacf252c4 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:17:51.671987 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d56736c9-9f47-4fca-ab07-ae3bacf252c4 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] [instance: 95c3fb61-cdbd-495c-87c4-fb08a38c84e3] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:17:51.673850 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:17:51.680195 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d56736c9-9f47-4fca-ab07-ae3bacf252c4 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:51.680674 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d56736c9-9f47-4fca-ab07-ae3bacf252c4 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:51.681100 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d56736c9-9f47-4fca-ab07-ae3bacf252c4 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:51.682585 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d56736c9-9f47-4fca-ab07-ae3bacf252c4 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:51.683042 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d56736c9-9f47-4fca-ab07-ae3bacf252c4 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:51.683501 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d56736c9-9f47-4fca-ab07-ae3bacf252c4 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:52.118972 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d56736c9-9f47-4fca-ab07-ae3bacf252c4 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/95c3fb61-cdbd-495c-87c4-fb08a38c84e3" status: 200 len: 1463 microversion: 2.1 time: 0.451293 Oct 04 21:17:52.119755 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2986/6006] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:17:51 2022] GET /compute/v2.1/servers/95c3fb61-cdbd-495c-87c4-fb08a38c84e3 => generated 1463 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:17:53.142270 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-1109b940-9c37-40c7-a3ab-a681f0085564 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:17:53.143006 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-1109b940-9c37-40c7-a3ab-a681f0085564 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] [instance: 95c3fb61-cdbd-495c-87c4-fb08a38c84e3] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:17:53.145778 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell0:SELECT=2 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:17:53.146635 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell0:SELECT=6 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:17:53.154612 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1109b940-9c37-40c7-a3ab-a681f0085564 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:53.155099 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1109b940-9c37-40c7-a3ab-a681f0085564 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:53.155528 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1109b940-9c37-40c7-a3ab-a681f0085564 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:53.156224 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1109b940-9c37-40c7-a3ab-a681f0085564 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:53.156673 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1109b940-9c37-40c7-a3ab-a681f0085564 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:53.157409 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1109b940-9c37-40c7-a3ab-a681f0085564 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:53.286195 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-1109b940-9c37-40c7-a3ab-a681f0085564 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/95c3fb61-cdbd-495c-87c4-fb08a38c84e3" status: 200 len: 1647 microversion: 2.1 time: 0.147939 Oct 04 21:17:53.286805 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3021/6007] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:17:53 2022] GET /compute/v2.1/servers/95c3fb61-cdbd-495c-87c4-fb08a38c84e3 => generated 1647 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:17:53.308707 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-892808a9-67ff-403e-b56e-784b6d8baf4f tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:17:53.309325 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-892808a9-67ff-403e-b56e-784b6d8baf4f tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] [instance: 95c3fb61-cdbd-495c-87c4-fb08a38c84e3] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:17:53.311316 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:17:53.318811 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-892808a9-67ff-403e-b56e-784b6d8baf4f tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:53.319299 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-892808a9-67ff-403e-b56e-784b6d8baf4f tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:53.319739 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-892808a9-67ff-403e-b56e-784b6d8baf4f tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:53.320448 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-892808a9-67ff-403e-b56e-784b6d8baf4f tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:53.320909 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-892808a9-67ff-403e-b56e-784b6d8baf4f tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:53.321343 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-892808a9-67ff-403e-b56e-784b6d8baf4f tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:53.456393 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-892808a9-67ff-403e-b56e-784b6d8baf4f tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/95c3fb61-cdbd-495c-87c4-fb08a38c84e3" status: 200 len: 1647 microversion: 2.1 time: 0.151878 Oct 04 21:17:53.456980 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2987/6008] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:17:53 2022] GET /compute/v2.1/servers/95c3fb61-cdbd-495c-87c4-fb08a38c84e3 => generated 1647 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:17:53.479822 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-4edb7435-1e12-45a6-8f61-bb72f55e994e tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:17:53.480441 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-4edb7435-1e12-45a6-8f61-bb72f55e994e tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] [instance: 95c3fb61-cdbd-495c-87c4-fb08a38c84e3] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:17:53.486564 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4edb7435-1e12-45a6-8f61-bb72f55e994e tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:53.487051 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4edb7435-1e12-45a6-8f61-bb72f55e994e tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:53.487488 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4edb7435-1e12-45a6-8f61-bb72f55e994e tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:53.488186 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4edb7435-1e12-45a6-8f61-bb72f55e994e tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:53.488642 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4edb7435-1e12-45a6-8f61-bb72f55e994e tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:53.489068 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4edb7435-1e12-45a6-8f61-bb72f55e994e tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:53.615453 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-4edb7435-1e12-45a6-8f61-bb72f55e994e tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/95c3fb61-cdbd-495c-87c4-fb08a38c84e3" status: 200 len: 1647 microversion: 2.1 time: 0.140413 Oct 04 21:17:53.616025 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3022/6009] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:17:53 2022] GET /compute/v2.1/servers/95c3fb61-cdbd-495c-87c4-fb08a38c84e3 => generated 1647 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:17:53.678310 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8384afe9-71ea-460c-bbfd-8a3e67209492 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-548725319", "imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63", "flavorRef": "452", "availability_zone": "nova:n-h2-854823-8", "networks": [{"uuid": "279f85b7-b5ad-4344-9498-d8daed5b1683"}]}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:17:53.741231 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.network.neutron [None req-8384afe9-71ea-460c-bbfd-8a3e67209492 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] validate_networks() for [('279f85b7-b5ad-4344-9498-d8daed5b1683', None, None, None, None, None)] {{(pid=128801) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:17:54.107985 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-8384afe9-71ea-460c-bbfd-8a3e67209492 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Flavor limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:17:54.108420 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-8384afe9-71ea-460c-bbfd-8a3e67209492 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Image limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:17:54.108883 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-8384afe9-71ea-460c-bbfd-8a3e67209492 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Flavor pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:17:54.109291 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-8384afe9-71ea-460c-bbfd-8a3e67209492 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Image pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:17:54.109765 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-8384afe9-71ea-460c-bbfd-8a3e67209492 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:17:54.119262 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8384afe9-71ea-460c-bbfd-8a3e67209492 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:54.120076 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8384afe9-71ea-460c-bbfd-8a3e67209492 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:54.120282 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8384afe9-71ea-460c-bbfd-8a3e67209492 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:54.120922 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8384afe9-71ea-460c-bbfd-8a3e67209492 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:54.121374 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8384afe9-71ea-460c-bbfd-8a3e67209492 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:54.121795 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8384afe9-71ea-460c-bbfd-8a3e67209492 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:54.140666 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-8384afe9-71ea-460c-bbfd-8a3e67209492 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Getting quotas for project 16cb4d41219b4848a5ae82100236b872. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:17:54.146003 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-8384afe9-71ea-460c-bbfd-8a3e67209492 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Getting quotas for user 50ac628802cc4fa88a9c4e87c65ae927 and project 16cb4d41219b4848a5ae82100236b872. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:17:54.158619 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-8384afe9-71ea-460c-bbfd-8a3e67209492 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Going to run 1 instances... {{(pid=128801) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:17:54.160988 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-8384afe9-71ea-460c-bbfd-8a3e67209492 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] [instance: 7e91f6c0-4923-4a54-84a1-e1fe8415c960] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='15b24725-0c99-4bcf-b1fb-907cdf8e2d63',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128801) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:17:54.209758 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-8384afe9-71ea-460c-bbfd-8a3e67209492 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.535209 Oct 04 21:17:54.212034 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2988/6010] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 21:17:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 537 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:17:54.221667 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-7f0c8c06-332d-4121-8ef6-dbde832ec095 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:17:54.222276 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-7f0c8c06-332d-4121-8ef6-dbde832ec095 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] [instance: 7e91f6c0-4923-4a54-84a1-e1fe8415c960] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:17:54.283625 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-7f0c8c06-332d-4121-8ef6-dbde832ec095 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/7e91f6c0-4923-4a54-84a1-e1fe8415c960" status: 200 len: 1328 microversion: 2.1 time: 0.065738 Oct 04 21:17:54.285375 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3023/6011] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:17:54 2022] GET /compute/v2.1/servers/7e91f6c0-4923-4a54-84a1-e1fe8415c960 => generated 1328 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:17:55.308787 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-804a34c7-f591-44ae-9a51-3c643ed1a852 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:17:55.309576 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-804a34c7-f591-44ae-9a51-3c643ed1a852 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] [instance: 7e91f6c0-4923-4a54-84a1-e1fe8415c960] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:17:55.317949 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-804a34c7-f591-44ae-9a51-3c643ed1a852 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:55.318716 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-804a34c7-f591-44ae-9a51-3c643ed1a852 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:55.319438 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-804a34c7-f591-44ae-9a51-3c643ed1a852 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:55.320360 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-804a34c7-f591-44ae-9a51-3c643ed1a852 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:55.321515 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-804a34c7-f591-44ae-9a51-3c643ed1a852 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:55.322284 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-804a34c7-f591-44ae-9a51-3c643ed1a852 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:55.413370 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-804a34c7-f591-44ae-9a51-3c643ed1a852 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/7e91f6c0-4923-4a54-84a1-e1fe8415c960" status: 200 len: 1423 microversion: 2.1 time: 0.108853 Oct 04 21:17:55.413971 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2989/6012] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:17:55 2022] GET /compute/v2.1/servers/7e91f6c0-4923-4a54-84a1-e1fe8415c960 => generated 1423 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:17:56.437049 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-70013c4c-2885-439a-b398-0b27e18c14c5 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:17:56.437669 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-70013c4c-2885-439a-b398-0b27e18c14c5 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] [instance: 7e91f6c0-4923-4a54-84a1-e1fe8415c960] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:17:56.445865 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-70013c4c-2885-439a-b398-0b27e18c14c5 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:56.446464 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-70013c4c-2885-439a-b398-0b27e18c14c5 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:56.446939 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-70013c4c-2885-439a-b398-0b27e18c14c5 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:56.447703 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-70013c4c-2885-439a-b398-0b27e18c14c5 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:56.448172 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-70013c4c-2885-439a-b398-0b27e18c14c5 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:56.448673 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-70013c4c-2885-439a-b398-0b27e18c14c5 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:56.608454 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-1349199f-96dc-4fde-99e8-f10ce4619da5 req-4c6bad32-fb65-45e6-b74c-eb22064fe40a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e91f6c0-4923-4a54-84a1-e1fe8415c960", "tag": "ba3dddda-d8e6-4f29-b1e5-6b847c1ab3e9"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:17:56.621423 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-1349199f-96dc-4fde-99e8-f10ce4619da5 req-4c6bad32-fb65-45e6-b74c-eb22064fe40a service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:56.621913 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-1349199f-96dc-4fde-99e8-f10ce4619da5 req-4c6bad32-fb65-45e6-b74c-eb22064fe40a service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:56.622361 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-1349199f-96dc-4fde-99e8-f10ce4619da5 req-4c6bad32-fb65-45e6-b74c-eb22064fe40a service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:56.633784 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-1349199f-96dc-4fde-99e8-f10ce4619da5 req-4c6bad32-fb65-45e6-b74c-eb22064fe40a service nova] Creating event network-changed:ba3dddda-d8e6-4f29-b1e5-6b847c1ab3e9 for instance 7e91f6c0-4923-4a54-84a1-e1fe8415c960 on n-h2-854823-8 Oct 04 21:17:56.640537 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-1349199f-96dc-4fde-99e8-f10ce4619da5 req-4c6bad32-fb65-45e6-b74c-eb22064fe40a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035935 Oct 04 21:17:56.641479 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2990/6013] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:17:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:17:56.691844 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-70013c4c-2885-439a-b398-0b27e18c14c5 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/7e91f6c0-4923-4a54-84a1-e1fe8415c960" status: 200 len: 1463 microversion: 2.1 time: 0.258439 Oct 04 21:17:56.703945 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3024/6014] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:17:56 2022] GET /compute/v2.1/servers/7e91f6c0-4923-4a54-84a1-e1fe8415c960 => generated 1463 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:17:57.716133 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ed680f56-0eb4-48b8-b5f4-bb748cab7ce0 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:17:57.716836 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ed680f56-0eb4-48b8-b5f4-bb748cab7ce0 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] [instance: 7e91f6c0-4923-4a54-84a1-e1fe8415c960] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:17:57.724065 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ed680f56-0eb4-48b8-b5f4-bb748cab7ce0 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:57.724545 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ed680f56-0eb4-48b8-b5f4-bb748cab7ce0 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:57.724974 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ed680f56-0eb4-48b8-b5f4-bb748cab7ce0 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:57.725663 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ed680f56-0eb4-48b8-b5f4-bb748cab7ce0 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:57.726112 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ed680f56-0eb4-48b8-b5f4-bb748cab7ce0 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:57.726567 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ed680f56-0eb4-48b8-b5f4-bb748cab7ce0 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:57.858313 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ed680f56-0eb4-48b8-b5f4-bb748cab7ce0 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/7e91f6c0-4923-4a54-84a1-e1fe8415c960" status: 200 len: 1463 microversion: 2.1 time: 0.146167 Oct 04 21:17:57.858948 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2991/6015] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:17:57 2022] GET /compute/v2.1/servers/7e91f6c0-4923-4a54-84a1-e1fe8415c960 => generated 1463 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:17:58.881675 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-5deadd1c-781b-48d1-8268-34fbebb377d6 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:17:58.882220 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-5deadd1c-781b-48d1-8268-34fbebb377d6 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] [instance: 7e91f6c0-4923-4a54-84a1-e1fe8415c960] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:17:58.889542 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5deadd1c-781b-48d1-8268-34fbebb377d6 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:58.890031 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5deadd1c-781b-48d1-8268-34fbebb377d6 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:58.890505 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5deadd1c-781b-48d1-8268-34fbebb377d6 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:58.891219 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5deadd1c-781b-48d1-8268-34fbebb377d6 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:17:58.891677 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5deadd1c-781b-48d1-8268-34fbebb377d6 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:17:58.892186 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5deadd1c-781b-48d1-8268-34fbebb377d6 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:17:59.018298 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-5deadd1c-781b-48d1-8268-34fbebb377d6 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/7e91f6c0-4923-4a54-84a1-e1fe8415c960" status: 200 len: 1463 microversion: 2.1 time: 0.140556 Oct 04 21:17:59.018901 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3025/6016] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:17:58 2022] GET /compute/v2.1/servers/7e91f6c0-4923-4a54-84a1-e1fe8415c960 => generated 1463 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:18:00.045989 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-62a3fd78-a6d8-4fbd-9065-48d1d94aa34c tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:00.046568 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-62a3fd78-a6d8-4fbd-9065-48d1d94aa34c tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] [instance: 7e91f6c0-4923-4a54-84a1-e1fe8415c960] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:00.053363 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-62a3fd78-a6d8-4fbd-9065-48d1d94aa34c tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:00.053849 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-62a3fd78-a6d8-4fbd-9065-48d1d94aa34c tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:00.054282 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-62a3fd78-a6d8-4fbd-9065-48d1d94aa34c tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:00.055000 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-62a3fd78-a6d8-4fbd-9065-48d1d94aa34c tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:00.055452 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-62a3fd78-a6d8-4fbd-9065-48d1d94aa34c tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:00.055874 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-62a3fd78-a6d8-4fbd-9065-48d1d94aa34c tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:00.188638 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-62a3fd78-a6d8-4fbd-9065-48d1d94aa34c tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/7e91f6c0-4923-4a54-84a1-e1fe8415c960" status: 200 len: 1463 microversion: 2.1 time: 0.146539 Oct 04 21:18:00.189700 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2992/6017] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:18:00 2022] GET /compute/v2.1/servers/7e91f6c0-4923-4a54-84a1-e1fe8415c960 => generated 1463 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:18:01.211409 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-186c5f05-c65b-4dcf-9de4-ea3076811d9e tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:01.212025 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-186c5f05-c65b-4dcf-9de4-ea3076811d9e tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] [instance: 7e91f6c0-4923-4a54-84a1-e1fe8415c960] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:01.219067 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-186c5f05-c65b-4dcf-9de4-ea3076811d9e tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:01.219555 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-186c5f05-c65b-4dcf-9de4-ea3076811d9e tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:01.219995 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-186c5f05-c65b-4dcf-9de4-ea3076811d9e tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:01.220695 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-186c5f05-c65b-4dcf-9de4-ea3076811d9e tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:01.221165 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-186c5f05-c65b-4dcf-9de4-ea3076811d9e tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:01.221594 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-186c5f05-c65b-4dcf-9de4-ea3076811d9e tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:01.357302 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-186c5f05-c65b-4dcf-9de4-ea3076811d9e tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/7e91f6c0-4923-4a54-84a1-e1fe8415c960" status: 200 len: 1463 microversion: 2.1 time: 0.149554 Oct 04 21:18:01.358127 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3026/6018] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:18:01 2022] GET /compute/v2.1/servers/7e91f6c0-4923-4a54-84a1-e1fe8415c960 => generated 1463 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:18:02.380959 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9296f0cf-2b8d-4612-9988-12df48151f43 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:02.381660 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-9296f0cf-2b8d-4612-9988-12df48151f43 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] [instance: 7e91f6c0-4923-4a54-84a1-e1fe8415c960] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:02.388588 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9296f0cf-2b8d-4612-9988-12df48151f43 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:02.389069 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9296f0cf-2b8d-4612-9988-12df48151f43 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:02.389530 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9296f0cf-2b8d-4612-9988-12df48151f43 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:02.390217 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9296f0cf-2b8d-4612-9988-12df48151f43 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:02.390704 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9296f0cf-2b8d-4612-9988-12df48151f43 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:02.391126 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9296f0cf-2b8d-4612-9988-12df48151f43 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:02.524163 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-9296f0cf-2b8d-4612-9988-12df48151f43 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/7e91f6c0-4923-4a54-84a1-e1fe8415c960" status: 200 len: 1463 microversion: 2.1 time: 0.146859 Oct 04 21:18:02.525388 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2993/6019] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:18:02 2022] GET /compute/v2.1/servers/7e91f6c0-4923-4a54-84a1-e1fe8415c960 => generated 1463 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:18:03.551281 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-342a79b8-b780-414f-9fa3-d02d07268268 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:03.552289 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-342a79b8-b780-414f-9fa3-d02d07268268 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] [instance: 7e91f6c0-4923-4a54-84a1-e1fe8415c960] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:03.562930 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-342a79b8-b780-414f-9fa3-d02d07268268 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:03.563865 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-342a79b8-b780-414f-9fa3-d02d07268268 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:03.564342 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-342a79b8-b780-414f-9fa3-d02d07268268 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:03.565403 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-342a79b8-b780-414f-9fa3-d02d07268268 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:03.565967 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-342a79b8-b780-414f-9fa3-d02d07268268 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:03.566492 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-342a79b8-b780-414f-9fa3-d02d07268268 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:03.714020 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-342a79b8-b780-414f-9fa3-d02d07268268 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/7e91f6c0-4923-4a54-84a1-e1fe8415c960" status: 200 len: 1463 microversion: 2.1 time: 0.169176 Oct 04 21:18:03.714647 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3027/6020] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:18:03 2022] GET /compute/v2.1/servers/7e91f6c0-4923-4a54-84a1-e1fe8415c960 => generated 1463 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:18:03.720860 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-aa6d9713-281e-46ba-8d4f-b5d79677166d req-0d6ec5d5-17a5-4574-a130-f5b7eab03b76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e91f6c0-4923-4a54-84a1-e1fe8415c960", "name": "network-vif-plugged", "status": "completed", "tag": "ba3dddda-d8e6-4f29-b1e5-6b847c1ab3e9"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:18:03.733003 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-aa6d9713-281e-46ba-8d4f-b5d79677166d req-0d6ec5d5-17a5-4574-a130-f5b7eab03b76 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:03.733678 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-aa6d9713-281e-46ba-8d4f-b5d79677166d req-0d6ec5d5-17a5-4574-a130-f5b7eab03b76 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:03.734106 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-aa6d9713-281e-46ba-8d4f-b5d79677166d req-0d6ec5d5-17a5-4574-a130-f5b7eab03b76 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:03.747634 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-aa6d9713-281e-46ba-8d4f-b5d79677166d req-0d6ec5d5-17a5-4574-a130-f5b7eab03b76 service nova] Creating event network-vif-plugged:ba3dddda-d8e6-4f29-b1e5-6b847c1ab3e9 for instance 7e91f6c0-4923-4a54-84a1-e1fe8415c960 on n-h2-854823-8 Oct 04 21:18:03.752830 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-aa6d9713-281e-46ba-8d4f-b5d79677166d req-0d6ec5d5-17a5-4574-a130-f5b7eab03b76 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035724 Oct 04 21:18:03.753432 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2994/6021] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:18:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:18:04.739824 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-0a01e0ac-1c32-4f8b-81ab-c35f1bfca521 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:04.740428 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-0a01e0ac-1c32-4f8b-81ab-c35f1bfca521 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] [instance: 7e91f6c0-4923-4a54-84a1-e1fe8415c960] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:04.742317 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell0:SELECT=2 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:18:04.751700 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0a01e0ac-1c32-4f8b-81ab-c35f1bfca521 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:04.752196 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0a01e0ac-1c32-4f8b-81ab-c35f1bfca521 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:04.752629 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0a01e0ac-1c32-4f8b-81ab-c35f1bfca521 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:04.753325 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0a01e0ac-1c32-4f8b-81ab-c35f1bfca521 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:04.753781 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0a01e0ac-1c32-4f8b-81ab-c35f1bfca521 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:04.754201 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0a01e0ac-1c32-4f8b-81ab-c35f1bfca521 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:04.886279 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-0a01e0ac-1c32-4f8b-81ab-c35f1bfca521 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/7e91f6c0-4923-4a54-84a1-e1fe8415c960" status: 200 len: 1463 microversion: 2.1 time: 0.150141 Oct 04 21:18:04.886904 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3028/6022] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:18:04 2022] GET /compute/v2.1/servers/7e91f6c0-4923-4a54-84a1-e1fe8415c960 => generated 1463 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:18:05.909351 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a8c783d4-5b4e-4759-b170-87c3eeb39063 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:05.910045 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a8c783d4-5b4e-4759-b170-87c3eeb39063 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] [instance: 7e91f6c0-4923-4a54-84a1-e1fe8415c960] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:05.912008 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:18:05.912668 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=6 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:18:05.920541 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a8c783d4-5b4e-4759-b170-87c3eeb39063 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:05.921017 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a8c783d4-5b4e-4759-b170-87c3eeb39063 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:05.921447 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a8c783d4-5b4e-4759-b170-87c3eeb39063 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:05.922133 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a8c783d4-5b4e-4759-b170-87c3eeb39063 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:05.922607 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a8c783d4-5b4e-4759-b170-87c3eeb39063 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:05.923031 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a8c783d4-5b4e-4759-b170-87c3eeb39063 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:06.050137 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a8c783d4-5b4e-4759-b170-87c3eeb39063 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/7e91f6c0-4923-4a54-84a1-e1fe8415c960" status: 200 len: 1647 microversion: 2.1 time: 0.144819 Oct 04 21:18:06.050749 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2995/6023] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:18:05 2022] GET /compute/v2.1/servers/7e91f6c0-4923-4a54-84a1-e1fe8415c960 => generated 1647 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:18:06.073376 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-17a6d9ca-b262-4f05-a287-0ece26fea4bd tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:06.073976 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-17a6d9ca-b262-4f05-a287-0ece26fea4bd tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] [instance: 7e91f6c0-4923-4a54-84a1-e1fe8415c960] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:06.080792 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-17a6d9ca-b262-4f05-a287-0ece26fea4bd tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:06.081268 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-17a6d9ca-b262-4f05-a287-0ece26fea4bd tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:06.081699 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-17a6d9ca-b262-4f05-a287-0ece26fea4bd tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:06.082407 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-17a6d9ca-b262-4f05-a287-0ece26fea4bd tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:06.082859 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-17a6d9ca-b262-4f05-a287-0ece26fea4bd tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:06.083298 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-17a6d9ca-b262-4f05-a287-0ece26fea4bd tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:06.213224 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-17a6d9ca-b262-4f05-a287-0ece26fea4bd tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/7e91f6c0-4923-4a54-84a1-e1fe8415c960" status: 200 len: 1647 microversion: 2.1 time: 0.144065 Oct 04 21:18:06.213793 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3029/6024] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:18:06 2022] GET /compute/v2.1/servers/7e91f6c0-4923-4a54-84a1-e1fe8415c960 => generated 1647 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:18:06.235394 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b6629c15-5d69-4f02-a9ca-b8dc51ccab74 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:06.236000 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b6629c15-5d69-4f02-a9ca-b8dc51ccab74 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] [instance: 7e91f6c0-4923-4a54-84a1-e1fe8415c960] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:06.242157 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b6629c15-5d69-4f02-a9ca-b8dc51ccab74 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:06.242677 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b6629c15-5d69-4f02-a9ca-b8dc51ccab74 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:06.243164 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b6629c15-5d69-4f02-a9ca-b8dc51ccab74 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:06.244416 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b6629c15-5d69-4f02-a9ca-b8dc51ccab74 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:06.244870 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b6629c15-5d69-4f02-a9ca-b8dc51ccab74 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:06.245293 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b6629c15-5d69-4f02-a9ca-b8dc51ccab74 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:06.371359 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b6629c15-5d69-4f02-a9ca-b8dc51ccab74 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/7e91f6c0-4923-4a54-84a1-e1fe8415c960" status: 200 len: 1647 microversion: 2.1 time: 0.139680 Oct 04 21:18:06.371942 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2996/6025] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:18:06 2022] GET /compute/v2.1/servers/7e91f6c0-4923-4a54-84a1-e1fe8415c960 => generated 1647 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:18:06.393383 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-c16542ab-bf39-404e-a5ff-25686297b79c tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:06.393876 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-c16542ab-bf39-404e-a5ff-25686297b79c tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] [instance: 7e91f6c0-4923-4a54-84a1-e1fe8415c960] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:06.399914 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c16542ab-bf39-404e-a5ff-25686297b79c tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:06.400616 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c16542ab-bf39-404e-a5ff-25686297b79c tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:06.401057 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c16542ab-bf39-404e-a5ff-25686297b79c tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:06.401752 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c16542ab-bf39-404e-a5ff-25686297b79c tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:06.402206 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c16542ab-bf39-404e-a5ff-25686297b79c tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:06.402659 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c16542ab-bf39-404e-a5ff-25686297b79c tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:06.427973 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-c16542ab-bf39-404e-a5ff-25686297b79c tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] [instance: 7e91f6c0-4923-4a54-84a1-e1fe8415c960] Going to try to terminate instance {{(pid=128802) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:18:06.507496 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-c16542ab-bf39-404e-a5ff-25686297b79c tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] 10.222.0.33 "DELETE /compute/v2.1/servers/7e91f6c0-4923-4a54-84a1-e1fe8415c960" status: 204 len: 0 microversion: 2.1 time: 0.116916 Oct 04 21:18:06.508399 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3030/6026] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 21:18:06 2022] DELETE /compute/v2.1/servers/7e91f6c0-4923-4a54-84a1-e1fe8415c960 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:18:06.517822 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ebf6ec2a-68a6-4c23-a12b-7a9c1815899b tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:06.518481 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ebf6ec2a-68a6-4c23-a12b-7a9c1815899b tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] [instance: 7e91f6c0-4923-4a54-84a1-e1fe8415c960] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:06.524638 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ebf6ec2a-68a6-4c23-a12b-7a9c1815899b tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:06.525394 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ebf6ec2a-68a6-4c23-a12b-7a9c1815899b tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:06.525946 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ebf6ec2a-68a6-4c23-a12b-7a9c1815899b tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:06.526732 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ebf6ec2a-68a6-4c23-a12b-7a9c1815899b tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:06.527193 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ebf6ec2a-68a6-4c23-a12b-7a9c1815899b tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:06.527620 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ebf6ec2a-68a6-4c23-a12b-7a9c1815899b tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:06.660403 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ebf6ec2a-68a6-4c23-a12b-7a9c1815899b tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/7e91f6c0-4923-4a54-84a1-e1fe8415c960" status: 200 len: 1653 microversion: 2.1 time: 0.146272 Oct 04 21:18:06.660989 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2997/6027] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:18:06 2022] GET /compute/v2.1/servers/7e91f6c0-4923-4a54-84a1-e1fe8415c960 => generated 1653 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:18:07.685875 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-7f7cc836-a924-4f11-b341-40eda6a8fd90 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:07.686621 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-7f7cc836-a924-4f11-b341-40eda6a8fd90 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] [instance: 7e91f6c0-4923-4a54-84a1-e1fe8415c960] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:07.693926 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7f7cc836-a924-4f11-b341-40eda6a8fd90 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:07.694466 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7f7cc836-a924-4f11-b341-40eda6a8fd90 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:07.694904 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7f7cc836-a924-4f11-b341-40eda6a8fd90 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:07.695610 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7f7cc836-a924-4f11-b341-40eda6a8fd90 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:07.696068 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7f7cc836-a924-4f11-b341-40eda6a8fd90 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:07.696541 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7f7cc836-a924-4f11-b341-40eda6a8fd90 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:07.826606 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-7f7cc836-a924-4f11-b341-40eda6a8fd90 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/7e91f6c0-4923-4a54-84a1-e1fe8415c960" status: 200 len: 1653 microversion: 2.1 time: 0.144922 Oct 04 21:18:07.827191 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3031/6028] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:18:07 2022] GET /compute/v2.1/servers/7e91f6c0-4923-4a54-84a1-e1fe8415c960 => generated 1653 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:18:08.386523 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-db98274f-4d8f-4c2e-9fe5-bcb1c89bc1d4 req-ae4e179a-1b37-443a-897d-0c0bbebb47ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e91f6c0-4923-4a54-84a1-e1fe8415c960", "name": "network-vif-deleted", "tag": "ba3dddda-d8e6-4f29-b1e5-6b847c1ab3e9"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:18:08.404257 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-db98274f-4d8f-4c2e-9fe5-bcb1c89bc1d4 req-ae4e179a-1b37-443a-897d-0c0bbebb47ff service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:08.404837 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-db98274f-4d8f-4c2e-9fe5-bcb1c89bc1d4 req-ae4e179a-1b37-443a-897d-0c0bbebb47ff service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:08.405275 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-db98274f-4d8f-4c2e-9fe5-bcb1c89bc1d4 req-ae4e179a-1b37-443a-897d-0c0bbebb47ff service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:08.431582 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-db98274f-4d8f-4c2e-9fe5-bcb1c89bc1d4 req-ae4e179a-1b37-443a-897d-0c0bbebb47ff service nova] Creating event network-vif-deleted:ba3dddda-d8e6-4f29-b1e5-6b847c1ab3e9 for instance 7e91f6c0-4923-4a54-84a1-e1fe8415c960 on n-h2-854823-8 Oct 04 21:18:08.437281 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-db98274f-4d8f-4c2e-9fe5-bcb1c89bc1d4 req-ae4e179a-1b37-443a-897d-0c0bbebb47ff service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055273 Oct 04 21:18:08.437976 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2998/6029] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:18:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:18:08.850669 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-18416fcc-3e34-4589-ba60-4b7a5c87363e tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:08.851108 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-18416fcc-3e34-4589-ba60-4b7a5c87363e tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] [instance: 7e91f6c0-4923-4a54-84a1-e1fe8415c960] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:08.858239 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-18416fcc-3e34-4589-ba60-4b7a5c87363e tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:08.858758 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-18416fcc-3e34-4589-ba60-4b7a5c87363e tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:08.859189 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-18416fcc-3e34-4589-ba60-4b7a5c87363e tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:08.859894 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-18416fcc-3e34-4589-ba60-4b7a5c87363e tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:08.860342 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-18416fcc-3e34-4589-ba60-4b7a5c87363e tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:08.860763 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-18416fcc-3e34-4589-ba60-4b7a5c87363e tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:08.897902 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-18416fcc-3e34-4589-ba60-4b7a5c87363e tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:08.898837 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-18416fcc-3e34-4589-ba60-4b7a5c87363e tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:08.899279 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-18416fcc-3e34-4589-ba60-4b7a5c87363e tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:08.899761 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.objects.instance [None req-18416fcc-3e34-4589-ba60-4b7a5c87363e tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Lazy-loading 'fault' on Instance uuid 7e91f6c0-4923-4a54-84a1-e1fe8415c960 {{(pid=128802) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:18:08.903138 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:18:08.955111 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-18416fcc-3e34-4589-ba60-4b7a5c87363e tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/7e91f6c0-4923-4a54-84a1-e1fe8415c960" status: 200 len: 1453 microversion: 2.1 time: 0.108364 Oct 04 21:18:08.955790 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3032/6030] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:18:08 2022] GET /compute/v2.1/servers/7e91f6c0-4923-4a54-84a1-e1fe8415c960 => generated 1453 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:18:09.983237 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f4b9c170-2646-4c34-af16-abf314c53e1a tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:09.983975 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f4b9c170-2646-4c34-af16-abf314c53e1a tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] [instance: 7e91f6c0-4923-4a54-84a1-e1fe8415c960] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:09.990212 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f4b9c170-2646-4c34-af16-abf314c53e1a tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:09.990744 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f4b9c170-2646-4c34-af16-abf314c53e1a tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:09.991189 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f4b9c170-2646-4c34-af16-abf314c53e1a tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:09.991888 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f4b9c170-2646-4c34-af16-abf314c53e1a tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:09.992347 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f4b9c170-2646-4c34-af16-abf314c53e1a tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:09.992773 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f4b9c170-2646-4c34-af16-abf314c53e1a tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:10.006111 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-f4b9c170-2646-4c34-af16-abf314c53e1a tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] HTTP exception thrown: Instance 7e91f6c0-4923-4a54-84a1-e1fe8415c960 could not be found. Oct 04 21:18:10.007769 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f4b9c170-2646-4c34-af16-abf314c53e1a tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Request method failure captured: Oct 04 21:18:10.007769 n-d-854823-8 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/7e91f6c0-4923-4a54-84a1-e1fe8415c960 HTTP/1.1 Oct 04 21:18:10.007769 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 21:18:10.007769 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 21:18:10.007769 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 21:18:10.007769 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 0 Oct 04 21:18:10.007769 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 21:18:10.007769 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 21:18:10.007769 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 21:18:10.007769 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 21:18:10.007769 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPKL1BBNgqef4SLu8zsJDcWTaf9KrSoMc65abEsTmLwV0JNiU8Ximb3NmhzDztlRwDRI1XftG-6uaT_2FVLngKhYovd57hNnIlzv4Qd2q0VQlTsN6XcnpEMkVkb0prjkRHmsQFED93Wu7sVXfDZmFLu4QUzY8Ip7oCXHAUgNR36My8SE Oct 04 21:18:10.007769 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 21:18:10.007769 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 21:18:10.007769 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 21:18:10.007769 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 21:18:10.007769 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 21:18:10.007769 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 21:18:10.007769 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: 16cb4d41219b4848a5ae82100236b872 Oct 04 21:18:10.007769 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-TestServerMultinode-1743445401 Oct 04 21:18:10.007769 n-d-854823-8 devstack@n-api.service[128801]: X-Role: admin,reader,member Oct 04 21:18:10.007769 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: admin,reader,member Oct 04 21:18:10.007769 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_16cb4d41219b4848a5ae82100236b872", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/16cb4d41219b4848a5ae82100236b872"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/16cb4d41219b4848a5ae82100236b872"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/16cb4d41219b4848a5ae82100236b872"}]}] Oct 04 21:18:10.007769 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-TestServerMultinode-1743445401 Oct 04 21:18:10.007769 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: 16cb4d41219b4848a5ae82100236b872 Oct 04 21:18:10.007769 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-TestServerMultinode-1743445401 Oct 04 21:18:10.007769 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-TestServerMultinode-1743445401-project-admin Oct 04 21:18:10.007769 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 21:18:10.007769 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 21:18:10.007769 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: 50ac628802cc4fa88a9c4e87c65ae927 Oct 04 21:18:10.007769 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-TestServerMultinode-1743445401-project-admin Oct 04 21:18:10.007769 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 21:18:10.007769 n-d-854823-8 devstack@n-api.service[128801]: exception: Instance 7e91f6c0-4923-4a54-84a1-e1fe8415c960 could not be found. Oct 04 21:18:10.007769 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': '7e91f6c0-4923-4a54-84a1-e1fe8415c960'} Oct 04 21:18:10.007769 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:18:10.007769 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:18:10.007769 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:18:10.007769 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:18:10.007769 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:18:10.007769 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:18:10.007769 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:18:10.007769 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:18:10.007769 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:18:10.007769 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:18:10.007769 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e91f6c0-4923-4a54-84a1-e1fe8415c960 could not be found. Oct 04 21:18:10.007769 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:18:10.007769 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:18:10.007769 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:18:10.007769 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:18:10.007769 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:18:10.007769 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:18:10.007769 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:18:10.007769 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:18:10.007769 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:18:10.007769 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:18:10.007769 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:18:10.007769 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:18:10.007769 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:18:10.007769 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:18:10.007769 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:18:10.007769 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:18:10.007769 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e91f6c0-4923-4a54-84a1-e1fe8415c960 could not be found. Oct 04 21:18:10.007769 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:18:10.007769 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:18:10.007769 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:18:10.013976 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:18:10.013976 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:18:10.013976 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:18:10.013976 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:18:10.013976 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:18:10.013976 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e91f6c0-4923-4a54-84a1-e1fe8415c960 could not be found. Oct 04 21:18:10.013976 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:18:10.013976 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f4b9c170-2646-4c34-af16-abf314c53e1a tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Returning 404 to user: Instance 7e91f6c0-4923-4a54-84a1-e1fe8415c960 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:18:10.013976 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f4b9c170-2646-4c34-af16-abf314c53e1a tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/7e91f6c0-4923-4a54-84a1-e1fe8415c960" status: 404 len: 111 microversion: 2.1 time: 0.032700 Oct 04 21:18:10.013976 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 2999/6031] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:18:09 2022] GET /compute/v2.1/servers/7e91f6c0-4923-4a54-84a1-e1fe8415c960 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:18:10.019009 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-db15170b-fa1f-4b5b-8ad5-9ed260edc199 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:10.019512 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-db15170b-fa1f-4b5b-8ad5-9ed260edc199 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] [instance: 95c3fb61-cdbd-495c-87c4-fb08a38c84e3] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:10.027410 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-db15170b-fa1f-4b5b-8ad5-9ed260edc199 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:10.027898 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-db15170b-fa1f-4b5b-8ad5-9ed260edc199 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:10.028346 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-db15170b-fa1f-4b5b-8ad5-9ed260edc199 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:10.029043 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-db15170b-fa1f-4b5b-8ad5-9ed260edc199 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:10.029501 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-db15170b-fa1f-4b5b-8ad5-9ed260edc199 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:10.029931 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-db15170b-fa1f-4b5b-8ad5-9ed260edc199 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:10.056316 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-db15170b-fa1f-4b5b-8ad5-9ed260edc199 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] [instance: 95c3fb61-cdbd-495c-87c4-fb08a38c84e3] Going to try to terminate instance {{(pid=128802) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:18:10.131817 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-db15170b-fa1f-4b5b-8ad5-9ed260edc199 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] 10.222.0.33 "DELETE /compute/v2.1/servers/95c3fb61-cdbd-495c-87c4-fb08a38c84e3" status: 204 len: 0 microversion: 2.1 time: 0.116431 Oct 04 21:18:10.132419 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3033/6032] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 21:18:10 2022] DELETE /compute/v2.1/servers/95c3fb61-cdbd-495c-87c4-fb08a38c84e3 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:18:10.141703 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-23aadcc4-9277-42db-ae28-d28fb174f5d8 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:10.142302 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-23aadcc4-9277-42db-ae28-d28fb174f5d8 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] [instance: 95c3fb61-cdbd-495c-87c4-fb08a38c84e3] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:10.148317 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-23aadcc4-9277-42db-ae28-d28fb174f5d8 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:10.148799 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-23aadcc4-9277-42db-ae28-d28fb174f5d8 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:10.149234 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-23aadcc4-9277-42db-ae28-d28fb174f5d8 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:10.150861 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-23aadcc4-9277-42db-ae28-d28fb174f5d8 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:10.151411 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-23aadcc4-9277-42db-ae28-d28fb174f5d8 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:10.151838 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-23aadcc4-9277-42db-ae28-d28fb174f5d8 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:10.278242 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-23aadcc4-9277-42db-ae28-d28fb174f5d8 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/95c3fb61-cdbd-495c-87c4-fb08a38c84e3" status: 200 len: 1653 microversion: 2.1 time: 0.140404 Oct 04 21:18:10.278879 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3000/6033] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:18:10 2022] GET /compute/v2.1/servers/95c3fb61-cdbd-495c-87c4-fb08a38c84e3 => generated 1653 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:18:11.301534 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-03827274-80c8-4204-b62c-d5699693e0b4 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:11.302193 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-03827274-80c8-4204-b62c-d5699693e0b4 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] [instance: 95c3fb61-cdbd-495c-87c4-fb08a38c84e3] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:11.309393 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-03827274-80c8-4204-b62c-d5699693e0b4 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:11.309882 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-03827274-80c8-4204-b62c-d5699693e0b4 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:11.310322 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-03827274-80c8-4204-b62c-d5699693e0b4 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:11.311043 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-03827274-80c8-4204-b62c-d5699693e0b4 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:11.311502 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-03827274-80c8-4204-b62c-d5699693e0b4 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:11.311934 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-03827274-80c8-4204-b62c-d5699693e0b4 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:11.446165 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-03827274-80c8-4204-b62c-d5699693e0b4 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/95c3fb61-cdbd-495c-87c4-fb08a38c84e3" status: 200 len: 1653 microversion: 2.1 time: 0.148777 Oct 04 21:18:11.447174 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3034/6034] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:18:11 2022] GET /compute/v2.1/servers/95c3fb61-cdbd-495c-87c4-fb08a38c84e3 => generated 1653 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:18:12.131071 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-6f21812f-4eb5-4c29-aadb-51f94ca416f0 req-8aaff311-532c-48a4-8666-5419edd4288f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95c3fb61-cdbd-495c-87c4-fb08a38c84e3", "name": "network-vif-deleted", "tag": "28ddadc8-079d-4ff6-bf0c-0a8c71643885"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:18:12.138149 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=3 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:18:12.144768 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-6f21812f-4eb5-4c29-aadb-51f94ca416f0 req-8aaff311-532c-48a4-8666-5419edd4288f service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:12.145246 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-6f21812f-4eb5-4c29-aadb-51f94ca416f0 req-8aaff311-532c-48a4-8666-5419edd4288f service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:12.145678 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-6f21812f-4eb5-4c29-aadb-51f94ca416f0 req-8aaff311-532c-48a4-8666-5419edd4288f service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:12.150605 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=97 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:18:12.162372 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-6f21812f-4eb5-4c29-aadb-51f94ca416f0 req-8aaff311-532c-48a4-8666-5419edd4288f service nova] Creating event network-vif-deleted:28ddadc8-079d-4ff6-bf0c-0a8c71643885 for instance 95c3fb61-cdbd-495c-87c4-fb08a38c84e3 on n-h1-854823-8 Oct 04 21:18:12.168511 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-6f21812f-4eb5-4c29-aadb-51f94ca416f0 req-8aaff311-532c-48a4-8666-5419edd4288f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041281 Oct 04 21:18:12.169176 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3001/6035] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:18:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:18:12.470617 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-d16ac882-3236-487b-893f-373d17307320 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:12.471266 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-d16ac882-3236-487b-893f-373d17307320 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] [instance: 95c3fb61-cdbd-495c-87c4-fb08a38c84e3] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:12.474014 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:18:12.479807 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d16ac882-3236-487b-893f-373d17307320 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:12.480292 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d16ac882-3236-487b-893f-373d17307320 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:12.480728 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d16ac882-3236-487b-893f-373d17307320 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:12.481507 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d16ac882-3236-487b-893f-373d17307320 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:12.481963 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d16ac882-3236-487b-893f-373d17307320 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:12.482412 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d16ac882-3236-487b-893f-373d17307320 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:12.515693 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d16ac882-3236-487b-893f-373d17307320 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:12.516174 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d16ac882-3236-487b-893f-373d17307320 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:12.516608 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d16ac882-3236-487b-893f-373d17307320 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:12.517053 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.objects.instance [None req-d16ac882-3236-487b-893f-373d17307320 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Lazy-loading 'fault' on Instance uuid 95c3fb61-cdbd-495c-87c4-fb08a38c84e3 {{(pid=128802) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:18:12.564316 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-d16ac882-3236-487b-893f-373d17307320 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/95c3fb61-cdbd-495c-87c4-fb08a38c84e3" status: 200 len: 1453 microversion: 2.1 time: 0.097390 Oct 04 21:18:12.564896 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3035/6036] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:18:12 2022] GET /compute/v2.1/servers/95c3fb61-cdbd-495c-87c4-fb08a38c84e3 => generated 1453 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:18:13.590468 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-cb807823-93cd-4114-8ef7-80ed21200445 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:13.591173 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-cb807823-93cd-4114-8ef7-80ed21200445 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] [instance: 95c3fb61-cdbd-495c-87c4-fb08a38c84e3] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:13.597515 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cb807823-93cd-4114-8ef7-80ed21200445 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:13.597986 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cb807823-93cd-4114-8ef7-80ed21200445 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:13.598449 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cb807823-93cd-4114-8ef7-80ed21200445 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:13.599193 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cb807823-93cd-4114-8ef7-80ed21200445 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:13.599637 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cb807823-93cd-4114-8ef7-80ed21200445 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:13.600060 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cb807823-93cd-4114-8ef7-80ed21200445 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:13.614845 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-cb807823-93cd-4114-8ef7-80ed21200445 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] HTTP exception thrown: Instance 95c3fb61-cdbd-495c-87c4-fb08a38c84e3 could not be found. Oct 04 21:18:13.616491 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-cb807823-93cd-4114-8ef7-80ed21200445 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Request method failure captured: Oct 04 21:18:13.616491 n-d-854823-8 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/95c3fb61-cdbd-495c-87c4-fb08a38c84e3 HTTP/1.1 Oct 04 21:18:13.616491 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 21:18:13.616491 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 21:18:13.616491 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 21:18:13.616491 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 0 Oct 04 21:18:13.616491 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 21:18:13.616491 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 21:18:13.616491 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 21:18:13.616491 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 21:18:13.616491 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPKL1BBNgqef4SLu8zsJDcWTaf9KrSoMc65abEsTmLwV0JNiU8Ximb3NmhzDztlRwDRI1XftG-6uaT_2FVLngKhYovd57hNnIlzv4Qd2q0VQlTsN6XcnpEMkVkb0prjkRHmsQFED93Wu7sVXfDZmFLu4QUzY8Ip7oCXHAUgNR36My8SE Oct 04 21:18:13.616491 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 21:18:13.616491 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 21:18:13.616491 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 21:18:13.616491 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 21:18:13.616491 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 21:18:13.616491 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 21:18:13.616491 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: 16cb4d41219b4848a5ae82100236b872 Oct 04 21:18:13.616491 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-TestServerMultinode-1743445401 Oct 04 21:18:13.616491 n-d-854823-8 devstack@n-api.service[128801]: X-Role: admin,reader,member Oct 04 21:18:13.616491 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: admin,reader,member Oct 04 21:18:13.616491 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_16cb4d41219b4848a5ae82100236b872", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/16cb4d41219b4848a5ae82100236b872"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/16cb4d41219b4848a5ae82100236b872"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/16cb4d41219b4848a5ae82100236b872"}]}] Oct 04 21:18:13.616491 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-TestServerMultinode-1743445401 Oct 04 21:18:13.616491 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: 16cb4d41219b4848a5ae82100236b872 Oct 04 21:18:13.616491 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-TestServerMultinode-1743445401 Oct 04 21:18:13.616491 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-TestServerMultinode-1743445401-project-admin Oct 04 21:18:13.616491 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 21:18:13.616491 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 21:18:13.616491 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: 50ac628802cc4fa88a9c4e87c65ae927 Oct 04 21:18:13.616491 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-TestServerMultinode-1743445401-project-admin Oct 04 21:18:13.616491 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 21:18:13.616491 n-d-854823-8 devstack@n-api.service[128801]: exception: Instance 95c3fb61-cdbd-495c-87c4-fb08a38c84e3 could not be found. Oct 04 21:18:13.616491 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': '95c3fb61-cdbd-495c-87c4-fb08a38c84e3'} Oct 04 21:18:13.616491 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:18:13.616491 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:18:13.616491 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:18:13.616491 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:18:13.616491 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:18:13.616491 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:18:13.616491 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:18:13.616491 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:18:13.616491 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:18:13.616491 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:18:13.616491 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95c3fb61-cdbd-495c-87c4-fb08a38c84e3 could not be found. Oct 04 21:18:13.616491 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:18:13.616491 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:18:13.616491 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:18:13.616491 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:18:13.616491 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:18:13.616491 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:18:13.616491 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:18:13.616491 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:18:13.616491 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:18:13.616491 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:18:13.616491 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:18:13.616491 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:18:13.616491 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:18:13.616491 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:18:13.616491 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:18:13.616491 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:18:13.616491 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95c3fb61-cdbd-495c-87c4-fb08a38c84e3 could not be found. Oct 04 21:18:13.616491 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:18:13.616491 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:18:13.616491 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:18:13.620986 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:18:13.620986 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:18:13.620986 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:18:13.620986 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:18:13.620986 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:18:13.620986 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95c3fb61-cdbd-495c-87c4-fb08a38c84e3 could not be found. Oct 04 21:18:13.620986 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:18:13.620986 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-cb807823-93cd-4114-8ef7-80ed21200445 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] Returning 404 to user: Instance 95c3fb61-cdbd-495c-87c4-fb08a38c84e3 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:18:13.620986 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-cb807823-93cd-4114-8ef7-80ed21200445 tempest-TestServerMultinode-1743445401 tempest-TestServerMultinode-1743445401-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/95c3fb61-cdbd-495c-87c4-fb08a38c84e3" status: 404 len: 111 microversion: 2.1 time: 0.033611 Oct 04 21:18:13.620986 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3002/6037] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:18:13 2022] GET /compute/v2.1/servers/95c3fb61-cdbd-495c-87c4-fb08a38c84e3 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:18:33.446429 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-c59c7b02-f762-4565-8b8f-3f729ae8f811 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1802553499", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "9fedcf76-4b64-4438-95ba-3ef0a075233c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "975b1130-f216-463e-808d-0d3403b17918"}]}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:18:33.457620 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_api:SELECT=3 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:18:33.458421 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=30,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:18:33.517560 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.network.neutron [None req-c59c7b02-f762-4565-8b8f-3f729ae8f811 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] validate_networks() for [('975b1130-f216-463e-808d-0d3403b17918', None, None, None, None, None)] {{(pid=128802) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:18:33.922470 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-c59c7b02-f762-4565-8b8f-3f729ae8f811 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Flavor limits 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:18:33.922895 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-c59c7b02-f762-4565-8b8f-3f729ae8f811 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Image limits 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:18:33.923371 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-c59c7b02-f762-4565-8b8f-3f729ae8f811 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Flavor pref 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:18:33.923783 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-c59c7b02-f762-4565-8b8f-3f729ae8f811 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Image pref 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:18:33.924202 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-c59c7b02-f762-4565-8b8f-3f729ae8f811 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:18:33.933921 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c59c7b02-f762-4565-8b8f-3f729ae8f811 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:33.934474 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c59c7b02-f762-4565-8b8f-3f729ae8f811 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:33.935436 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c59c7b02-f762-4565-8b8f-3f729ae8f811 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:33.936085 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c59c7b02-f762-4565-8b8f-3f729ae8f811 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:33.936738 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c59c7b02-f762-4565-8b8f-3f729ae8f811 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:33.937292 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c59c7b02-f762-4565-8b8f-3f729ae8f811 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:33.958049 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-c59c7b02-f762-4565-8b8f-3f729ae8f811 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Getting quotas for project 0d78e06d720d438a9308ae138902f847. Resources: {'ram', 'instances', 'cores'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:18:33.964194 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-c59c7b02-f762-4565-8b8f-3f729ae8f811 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Getting quotas for user ad7b0b59fad1429e95591b21e33ccbaa and project 0d78e06d720d438a9308ae138902f847. Resources: {'ram', 'instances', 'cores'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:18:34.024210 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-c59c7b02-f762-4565-8b8f-3f729ae8f811 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Going to run 1 instances... {{(pid=128802) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:18:34.027078 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-c59c7b02-f762-4565-8b8f-3f729ae8f811 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: 8695f690-12a9-4df6-87d1-91ce614b00df] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='9fedcf76-4b64-4438-95ba-3ef0a075233c',volume_size=None,volume_type=None)] {{(pid=128802) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:18:34.171326 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-c59c7b02-f762-4565-8b8f-3f729ae8f811 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.728362 Oct 04 21:18:34.172083 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3036/6038] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 21:18:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 731 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:18:34.184074 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ebcc280c-af64-4c62-91f8-b18db2e78ba0 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:34.185522 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ebcc280c-af64-4c62-91f8-b18db2e78ba0 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: 8695f690-12a9-4df6-87d1-91ce614b00df] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:34.209862 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=3 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:18:34.210582 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=3 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:18:34.271061 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-ebcc280c-af64-4c62-91f8-b18db2e78ba0 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:34.280281 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ebcc280c-af64-4c62-91f8-b18db2e78ba0 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/8695f690-12a9-4df6-87d1-91ce614b00df" status: 200 len: 1057 microversion: 2.1 time: 0.101068 Oct 04 21:18:34.282437 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3003/6039] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:18:34 2022] GET /compute/v2.1/servers/8695f690-12a9-4df6-87d1-91ce614b00df => generated 1057 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:18:35.304132 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-c5a2233a-3372-48df-a8e7-f8f7692d6dce tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:35.304747 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-c5a2233a-3372-48df-a8e7-f8f7692d6dce tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: 8695f690-12a9-4df6-87d1-91ce614b00df] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:35.334577 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c5a2233a-3372-48df-a8e7-f8f7692d6dce tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:35.335542 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c5a2233a-3372-48df-a8e7-f8f7692d6dce tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:35.336170 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c5a2233a-3372-48df-a8e7-f8f7692d6dce tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:35.337803 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c5a2233a-3372-48df-a8e7-f8f7692d6dce tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:35.338616 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c5a2233a-3372-48df-a8e7-f8f7692d6dce tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:35.339157 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c5a2233a-3372-48df-a8e7-f8f7692d6dce tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:35.423945 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-c5a2233a-3372-48df-a8e7-f8f7692d6dce tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:35.436493 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-c5a2233a-3372-48df-a8e7-f8f7692d6dce tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/8695f690-12a9-4df6-87d1-91ce614b00df" status: 200 len: 1163 microversion: 2.1 time: 0.137075 Oct 04 21:18:35.437663 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3037/6040] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:18:35 2022] GET /compute/v2.1/servers/8695f690-12a9-4df6-87d1-91ce614b00df => generated 1163 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:18:36.461511 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e1c5f256-054b-44b9-9935-9a62ea5c3cbb tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:36.463046 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e1c5f256-054b-44b9-9935-9a62ea5c3cbb tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: 8695f690-12a9-4df6-87d1-91ce614b00df] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:36.471764 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e1c5f256-054b-44b9-9935-9a62ea5c3cbb tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:36.477783 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e1c5f256-054b-44b9-9935-9a62ea5c3cbb tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:36.479206 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e1c5f256-054b-44b9-9935-9a62ea5c3cbb tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:36.480426 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e1c5f256-054b-44b9-9935-9a62ea5c3cbb tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:36.481153 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e1c5f256-054b-44b9-9935-9a62ea5c3cbb tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:36.481987 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e1c5f256-054b-44b9-9935-9a62ea5c3cbb tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:36.711282 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e1c5f256-054b-44b9-9935-9a62ea5c3cbb tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:36.725873 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e1c5f256-054b-44b9-9935-9a62ea5c3cbb tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/8695f690-12a9-4df6-87d1-91ce614b00df" status: 200 len: 1215 microversion: 2.1 time: 0.267332 Oct 04 21:18:36.727283 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3004/6041] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:18:36 2022] GET /compute/v2.1/servers/8695f690-12a9-4df6-87d1-91ce614b00df => generated 1215 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:18:37.031248 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-6d333274-4416-42a6-9f2c-ad7a585437bf req-3b8b0d42-d037-4a18-a031-81ee2643f0a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8695f690-12a9-4df6-87d1-91ce614b00df", "tag": "b44a86ab-3dbe-4d97-a45a-8495270f6876"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:18:37.071072 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-6d333274-4416-42a6-9f2c-ad7a585437bf req-3b8b0d42-d037-4a18-a031-81ee2643f0a4 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:37.071887 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-6d333274-4416-42a6-9f2c-ad7a585437bf req-3b8b0d42-d037-4a18-a031-81ee2643f0a4 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:37.072495 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-6d333274-4416-42a6-9f2c-ad7a585437bf req-3b8b0d42-d037-4a18-a031-81ee2643f0a4 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:37.113916 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-6d333274-4416-42a6-9f2c-ad7a585437bf req-3b8b0d42-d037-4a18-a031-81ee2643f0a4 service nova] Creating event network-changed:b44a86ab-3dbe-4d97-a45a-8495270f6876 for instance 8695f690-12a9-4df6-87d1-91ce614b00df on n-h2-854823-8 Oct 04 21:18:37.124549 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-6d333274-4416-42a6-9f2c-ad7a585437bf req-3b8b0d42-d037-4a18-a031-81ee2643f0a4 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105717 Oct 04 21:18:37.125876 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3038/6042] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:18:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:18:37.751144 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b29abcf4-7b99-4bfc-8b95-3b3437784615 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:37.752429 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b29abcf4-7b99-4bfc-8b95-3b3437784615 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: 8695f690-12a9-4df6-87d1-91ce614b00df] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:37.761376 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b29abcf4-7b99-4bfc-8b95-3b3437784615 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:37.761876 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b29abcf4-7b99-4bfc-8b95-3b3437784615 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:37.762386 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b29abcf4-7b99-4bfc-8b95-3b3437784615 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:37.763059 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b29abcf4-7b99-4bfc-8b95-3b3437784615 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:37.763512 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b29abcf4-7b99-4bfc-8b95-3b3437784615 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:37.764218 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b29abcf4-7b99-4bfc-8b95-3b3437784615 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:38.189109 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-b29abcf4-7b99-4bfc-8b95-3b3437784615 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:38.199781 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b29abcf4-7b99-4bfc-8b95-3b3437784615 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/8695f690-12a9-4df6-87d1-91ce614b00df" status: 200 len: 1215 microversion: 2.1 time: 0.452793 Oct 04 21:18:38.200377 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3005/6043] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:18:37 2022] GET /compute/v2.1/servers/8695f690-12a9-4df6-87d1-91ce614b00df => generated 1215 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:18:39.224592 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-2ca3341e-2d90-4198-9e40-8f1517b19d2a tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:39.225450 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-2ca3341e-2d90-4198-9e40-8f1517b19d2a tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: 8695f690-12a9-4df6-87d1-91ce614b00df] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:39.233638 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2ca3341e-2d90-4198-9e40-8f1517b19d2a tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:39.234246 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2ca3341e-2d90-4198-9e40-8f1517b19d2a tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:39.234868 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2ca3341e-2d90-4198-9e40-8f1517b19d2a tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:39.235567 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2ca3341e-2d90-4198-9e40-8f1517b19d2a tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:39.236020 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2ca3341e-2d90-4198-9e40-8f1517b19d2a tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:39.236441 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2ca3341e-2d90-4198-9e40-8f1517b19d2a tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:39.711351 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-2ca3341e-2d90-4198-9e40-8f1517b19d2a tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:39.720002 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-2ca3341e-2d90-4198-9e40-8f1517b19d2a tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/8695f690-12a9-4df6-87d1-91ce614b00df" status: 200 len: 1215 microversion: 2.1 time: 0.500016 Oct 04 21:18:39.720583 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3039/6044] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:18:39 2022] GET /compute/v2.1/servers/8695f690-12a9-4df6-87d1-91ce614b00df => generated 1215 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:18:40.742882 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2496d4a4-910e-4520-b913-f85bf0ddd7b0 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:40.743491 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-2496d4a4-910e-4520-b913-f85bf0ddd7b0 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: 8695f690-12a9-4df6-87d1-91ce614b00df] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:40.750657 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2496d4a4-910e-4520-b913-f85bf0ddd7b0 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:40.751141 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2496d4a4-910e-4520-b913-f85bf0ddd7b0 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:40.751573 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2496d4a4-910e-4520-b913-f85bf0ddd7b0 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:40.752258 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2496d4a4-910e-4520-b913-f85bf0ddd7b0 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:40.752708 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2496d4a4-910e-4520-b913-f85bf0ddd7b0 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:40.753130 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2496d4a4-910e-4520-b913-f85bf0ddd7b0 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:40.880477 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-2496d4a4-910e-4520-b913-f85bf0ddd7b0 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:40.888344 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-2496d4a4-910e-4520-b913-f85bf0ddd7b0 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/8695f690-12a9-4df6-87d1-91ce614b00df" status: 200 len: 1203 microversion: 2.1 time: 0.149662 Oct 04 21:18:40.888918 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3006/6045] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:18:40 2022] GET /compute/v2.1/servers/8695f690-12a9-4df6-87d1-91ce614b00df => generated 1203 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:18:41.911363 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-10f67cc0-61a4-415a-b0f0-2c09886d2708 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:41.911989 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-10f67cc0-61a4-415a-b0f0-2c09886d2708 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: 8695f690-12a9-4df6-87d1-91ce614b00df] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:41.919583 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-10f67cc0-61a4-415a-b0f0-2c09886d2708 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:41.920077 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-10f67cc0-61a4-415a-b0f0-2c09886d2708 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:41.920519 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-10f67cc0-61a4-415a-b0f0-2c09886d2708 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:41.921229 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-10f67cc0-61a4-415a-b0f0-2c09886d2708 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:41.921691 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-10f67cc0-61a4-415a-b0f0-2c09886d2708 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:41.922123 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-10f67cc0-61a4-415a-b0f0-2c09886d2708 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:42.059915 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-10f67cc0-61a4-415a-b0f0-2c09886d2708 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:42.068001 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-10f67cc0-61a4-415a-b0f0-2c09886d2708 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/8695f690-12a9-4df6-87d1-91ce614b00df" status: 200 len: 1203 microversion: 2.1 time: 0.160523 Oct 04 21:18:42.068574 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3040/6046] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:18:41 2022] GET /compute/v2.1/servers/8695f690-12a9-4df6-87d1-91ce614b00df => generated 1203 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:18:43.090335 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e3ee048f-fb66-40dc-b5c4-f94efa0ce167 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:43.090992 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e3ee048f-fb66-40dc-b5c4-f94efa0ce167 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: 8695f690-12a9-4df6-87d1-91ce614b00df] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:43.097760 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e3ee048f-fb66-40dc-b5c4-f94efa0ce167 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:43.098237 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e3ee048f-fb66-40dc-b5c4-f94efa0ce167 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:43.098699 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e3ee048f-fb66-40dc-b5c4-f94efa0ce167 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:43.099416 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e3ee048f-fb66-40dc-b5c4-f94efa0ce167 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:43.099870 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e3ee048f-fb66-40dc-b5c4-f94efa0ce167 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:43.100292 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e3ee048f-fb66-40dc-b5c4-f94efa0ce167 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:43.231292 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e3ee048f-fb66-40dc-b5c4-f94efa0ce167 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:43.239650 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e3ee048f-fb66-40dc-b5c4-f94efa0ce167 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/8695f690-12a9-4df6-87d1-91ce614b00df" status: 200 len: 1203 microversion: 2.1 time: 0.153223 Oct 04 21:18:43.240243 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3007/6047] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:18:43 2022] GET /compute/v2.1/servers/8695f690-12a9-4df6-87d1-91ce614b00df => generated 1203 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:18:44.263878 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-8be458ff-d747-4bf2-ac9d-c3b4c8a49d05 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:44.264498 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-8be458ff-d747-4bf2-ac9d-c3b4c8a49d05 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: 8695f690-12a9-4df6-87d1-91ce614b00df] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:44.267312 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell0:SELECT=2 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:18:44.267984 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell0:SELECT=6 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:18:44.273925 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8be458ff-d747-4bf2-ac9d-c3b4c8a49d05 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:44.274444 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8be458ff-d747-4bf2-ac9d-c3b4c8a49d05 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:44.274902 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8be458ff-d747-4bf2-ac9d-c3b4c8a49d05 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:44.275599 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8be458ff-d747-4bf2-ac9d-c3b4c8a49d05 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:44.276056 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8be458ff-d747-4bf2-ac9d-c3b4c8a49d05 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:44.276485 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8be458ff-d747-4bf2-ac9d-c3b4c8a49d05 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:44.412104 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-8be458ff-d747-4bf2-ac9d-c3b4c8a49d05 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:44.422318 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-8be458ff-d747-4bf2-ac9d-c3b4c8a49d05 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/8695f690-12a9-4df6-87d1-91ce614b00df" status: 200 len: 1203 microversion: 2.1 time: 0.163016 Oct 04 21:18:44.422939 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3041/6048] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:18:44 2022] GET /compute/v2.1/servers/8695f690-12a9-4df6-87d1-91ce614b00df => generated 1203 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:18:45.447201 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b743b12b-ba08-4124-b480-c0a5402b77fe tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:45.447837 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b743b12b-ba08-4124-b480-c0a5402b77fe tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: 8695f690-12a9-4df6-87d1-91ce614b00df] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:45.450435 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:18:45.456013 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b743b12b-ba08-4124-b480-c0a5402b77fe tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:45.456495 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b743b12b-ba08-4124-b480-c0a5402b77fe tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:45.456960 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b743b12b-ba08-4124-b480-c0a5402b77fe tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:45.457650 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b743b12b-ba08-4124-b480-c0a5402b77fe tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:45.458100 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b743b12b-ba08-4124-b480-c0a5402b77fe tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:45.458552 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b743b12b-ba08-4124-b480-c0a5402b77fe tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:45.594252 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-b743b12b-ba08-4124-b480-c0a5402b77fe tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:45.602187 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b743b12b-ba08-4124-b480-c0a5402b77fe tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/8695f690-12a9-4df6-87d1-91ce614b00df" status: 200 len: 1203 microversion: 2.1 time: 0.159474 Oct 04 21:18:45.602800 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3008/6049] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:18:45 2022] GET /compute/v2.1/servers/8695f690-12a9-4df6-87d1-91ce614b00df => generated 1203 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:18:46.626181 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-592e92af-0bcd-4da3-b7cd-85ebed979e30 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:46.626742 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-592e92af-0bcd-4da3-b7cd-85ebed979e30 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: 8695f690-12a9-4df6-87d1-91ce614b00df] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:46.633480 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-592e92af-0bcd-4da3-b7cd-85ebed979e30 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:46.633992 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-592e92af-0bcd-4da3-b7cd-85ebed979e30 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:46.634472 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-592e92af-0bcd-4da3-b7cd-85ebed979e30 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:46.635241 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-592e92af-0bcd-4da3-b7cd-85ebed979e30 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:46.635711 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-592e92af-0bcd-4da3-b7cd-85ebed979e30 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:46.636149 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-592e92af-0bcd-4da3-b7cd-85ebed979e30 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:46.770267 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-592e92af-0bcd-4da3-b7cd-85ebed979e30 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:46.778904 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-592e92af-0bcd-4da3-b7cd-85ebed979e30 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/8695f690-12a9-4df6-87d1-91ce614b00df" status: 200 len: 1203 microversion: 2.1 time: 0.156833 Oct 04 21:18:46.779487 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3042/6050] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:18:46 2022] GET /compute/v2.1/servers/8695f690-12a9-4df6-87d1-91ce614b00df => generated 1203 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:18:47.801669 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-366a1bbf-c78b-4559-a82a-592980c089a6 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:47.802312 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-366a1bbf-c78b-4559-a82a-592980c089a6 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: 8695f690-12a9-4df6-87d1-91ce614b00df] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:47.810200 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-366a1bbf-c78b-4559-a82a-592980c089a6 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:47.810716 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-366a1bbf-c78b-4559-a82a-592980c089a6 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:47.811165 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-366a1bbf-c78b-4559-a82a-592980c089a6 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:47.811855 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-366a1bbf-c78b-4559-a82a-592980c089a6 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:47.812306 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-366a1bbf-c78b-4559-a82a-592980c089a6 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:47.812724 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-366a1bbf-c78b-4559-a82a-592980c089a6 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:47.952652 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-366a1bbf-c78b-4559-a82a-592980c089a6 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:47.960325 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-366a1bbf-c78b-4559-a82a-592980c089a6 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/8695f690-12a9-4df6-87d1-91ce614b00df" status: 200 len: 1203 microversion: 2.1 time: 0.162591 Oct 04 21:18:47.960892 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3009/6051] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:18:47 2022] GET /compute/v2.1/servers/8695f690-12a9-4df6-87d1-91ce614b00df => generated 1203 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:18:48.984559 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-80831f04-8f63-40ee-8b70-2a4907ba71db tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:48.985202 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-80831f04-8f63-40ee-8b70-2a4907ba71db tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: 8695f690-12a9-4df6-87d1-91ce614b00df] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:48.992043 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-80831f04-8f63-40ee-8b70-2a4907ba71db tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:48.992529 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-80831f04-8f63-40ee-8b70-2a4907ba71db tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:48.992964 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-80831f04-8f63-40ee-8b70-2a4907ba71db tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:48.994477 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-80831f04-8f63-40ee-8b70-2a4907ba71db tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:48.994935 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-80831f04-8f63-40ee-8b70-2a4907ba71db tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:48.995363 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-80831f04-8f63-40ee-8b70-2a4907ba71db tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:49.131721 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-80831f04-8f63-40ee-8b70-2a4907ba71db tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:49.139872 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-80831f04-8f63-40ee-8b70-2a4907ba71db tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/8695f690-12a9-4df6-87d1-91ce614b00df" status: 200 len: 1203 microversion: 2.1 time: 0.159317 Oct 04 21:18:49.140450 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3043/6052] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:18:48 2022] GET /compute/v2.1/servers/8695f690-12a9-4df6-87d1-91ce614b00df => generated 1203 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:18:50.162512 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6ef712ea-3347-4656-824b-34a442198702 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:50.163139 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-6ef712ea-3347-4656-824b-34a442198702 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: 8695f690-12a9-4df6-87d1-91ce614b00df] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:50.171567 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6ef712ea-3347-4656-824b-34a442198702 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:50.171972 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6ef712ea-3347-4656-824b-34a442198702 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:50.172406 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6ef712ea-3347-4656-824b-34a442198702 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:50.173123 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6ef712ea-3347-4656-824b-34a442198702 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:50.173582 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6ef712ea-3347-4656-824b-34a442198702 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:50.174013 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6ef712ea-3347-4656-824b-34a442198702 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:50.316691 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-6ef712ea-3347-4656-824b-34a442198702 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:50.325724 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-6ef712ea-3347-4656-824b-34a442198702 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/8695f690-12a9-4df6-87d1-91ce614b00df" status: 200 len: 1203 microversion: 2.1 time: 0.167046 Oct 04 21:18:50.326329 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3010/6053] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:18:50 2022] GET /compute/v2.1/servers/8695f690-12a9-4df6-87d1-91ce614b00df => generated 1203 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:18:51.349152 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-b2892684-3a4a-4312-b023-48171abbe050 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:51.349811 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-b2892684-3a4a-4312-b023-48171abbe050 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: 8695f690-12a9-4df6-87d1-91ce614b00df] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:51.357674 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b2892684-3a4a-4312-b023-48171abbe050 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:51.358164 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b2892684-3a4a-4312-b023-48171abbe050 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:51.358633 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b2892684-3a4a-4312-b023-48171abbe050 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:51.359345 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b2892684-3a4a-4312-b023-48171abbe050 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:51.359809 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b2892684-3a4a-4312-b023-48171abbe050 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:51.360240 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b2892684-3a4a-4312-b023-48171abbe050 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:51.498443 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-b2892684-3a4a-4312-b023-48171abbe050 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:51.506329 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-b2892684-3a4a-4312-b023-48171abbe050 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/8695f690-12a9-4df6-87d1-91ce614b00df" status: 200 len: 1203 microversion: 2.1 time: 0.161078 Oct 04 21:18:51.506927 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3044/6054] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:18:51 2022] GET /compute/v2.1/servers/8695f690-12a9-4df6-87d1-91ce614b00df => generated 1203 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:18:51.975971 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-65ab8521-5fc2-46d3-8046-d5938e530069 req-a77212e9-7196-4ff6-870f-4f68577026f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8695f690-12a9-4df6-87d1-91ce614b00df", "name": "network-vif-plugged", "status": "completed", "tag": "b44a86ab-3dbe-4d97-a45a-8495270f6876"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:18:51.987549 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-65ab8521-5fc2-46d3-8046-d5938e530069 req-a77212e9-7196-4ff6-870f-4f68577026f5 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:51.988034 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-65ab8521-5fc2-46d3-8046-d5938e530069 req-a77212e9-7196-4ff6-870f-4f68577026f5 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:51.988518 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-65ab8521-5fc2-46d3-8046-d5938e530069 req-a77212e9-7196-4ff6-870f-4f68577026f5 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:52.001084 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-65ab8521-5fc2-46d3-8046-d5938e530069 req-a77212e9-7196-4ff6-870f-4f68577026f5 service nova] Creating event network-vif-plugged:b44a86ab-3dbe-4d97-a45a-8495270f6876 for instance 8695f690-12a9-4df6-87d1-91ce614b00df on n-h2-854823-8 Oct 04 21:18:52.006147 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-65ab8521-5fc2-46d3-8046-d5938e530069 req-a77212e9-7196-4ff6-870f-4f68577026f5 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033997 Oct 04 21:18:52.006971 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3011/6055] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:18:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:18:52.529742 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-d97c3bb6-6c80-4fc3-94cd-15d5f744cd75 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:52.530376 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-d97c3bb6-6c80-4fc3-94cd-15d5f744cd75 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: 8695f690-12a9-4df6-87d1-91ce614b00df] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:52.537224 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d97c3bb6-6c80-4fc3-94cd-15d5f744cd75 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:52.537702 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d97c3bb6-6c80-4fc3-94cd-15d5f744cd75 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:52.538133 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d97c3bb6-6c80-4fc3-94cd-15d5f744cd75 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:52.538862 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d97c3bb6-6c80-4fc3-94cd-15d5f744cd75 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:52.539318 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d97c3bb6-6c80-4fc3-94cd-15d5f744cd75 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:52.539738 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d97c3bb6-6c80-4fc3-94cd-15d5f744cd75 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:52.986744 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-d97c3bb6-6c80-4fc3-94cd-15d5f744cd75 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:52.995217 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-d97c3bb6-6c80-4fc3-94cd-15d5f744cd75 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/8695f690-12a9-4df6-87d1-91ce614b00df" status: 200 len: 1203 microversion: 2.1 time: 0.469484 Oct 04 21:18:52.995799 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3045/6056] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:18:52 2022] GET /compute/v2.1/servers/8695f690-12a9-4df6-87d1-91ce614b00df => generated 1203 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:18:54.020251 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-08fa84de-5fe0-49da-b47b-a08cd6da99bd tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:54.020936 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-08fa84de-5fe0-49da-b47b-a08cd6da99bd tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: 8695f690-12a9-4df6-87d1-91ce614b00df] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:54.027819 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-08fa84de-5fe0-49da-b47b-a08cd6da99bd tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:54.028325 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-08fa84de-5fe0-49da-b47b-a08cd6da99bd tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:54.028770 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-08fa84de-5fe0-49da-b47b-a08cd6da99bd tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:54.029486 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-08fa84de-5fe0-49da-b47b-a08cd6da99bd tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:54.029947 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-08fa84de-5fe0-49da-b47b-a08cd6da99bd tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:54.030433 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-08fa84de-5fe0-49da-b47b-a08cd6da99bd tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:54.163950 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-08fa84de-5fe0-49da-b47b-a08cd6da99bd tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:54.172865 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-08fa84de-5fe0-49da-b47b-a08cd6da99bd tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/8695f690-12a9-4df6-87d1-91ce614b00df" status: 200 len: 1390 microversion: 2.1 time: 0.157873 Oct 04 21:18:54.173456 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3012/6057] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:18:54 2022] GET /compute/v2.1/servers/8695f690-12a9-4df6-87d1-91ce614b00df => generated 1390 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:18:54.195606 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-8977a7f5-7fe0-47fa-a840-37c1b7f36dff tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:54.196971 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-8977a7f5-7fe0-47fa-a840-37c1b7f36dff tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: 8695f690-12a9-4df6-87d1-91ce614b00df] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:54.203763 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8977a7f5-7fe0-47fa-a840-37c1b7f36dff tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:54.204246 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8977a7f5-7fe0-47fa-a840-37c1b7f36dff tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:54.204682 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8977a7f5-7fe0-47fa-a840-37c1b7f36dff tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:54.205376 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8977a7f5-7fe0-47fa-a840-37c1b7f36dff tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:54.205827 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8977a7f5-7fe0-47fa-a840-37c1b7f36dff tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:54.206250 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8977a7f5-7fe0-47fa-a840-37c1b7f36dff tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:54.340345 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-8977a7f5-7fe0-47fa-a840-37c1b7f36dff tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:54.348559 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-8977a7f5-7fe0-47fa-a840-37c1b7f36dff tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/8695f690-12a9-4df6-87d1-91ce614b00df" status: 200 len: 1390 microversion: 2.1 time: 0.156772 Oct 04 21:18:54.349210 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3046/6058] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:18:54 2022] GET /compute/v2.1/servers/8695f690-12a9-4df6-87d1-91ce614b00df => generated 1390 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:18:54.370217 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5341fc24-0f16-4ecc-8623-59c1a97e6d04 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:54.370871 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-5341fc24-0f16-4ecc-8623-59c1a97e6d04 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: 8695f690-12a9-4df6-87d1-91ce614b00df] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:54.377004 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5341fc24-0f16-4ecc-8623-59c1a97e6d04 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:54.377496 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5341fc24-0f16-4ecc-8623-59c1a97e6d04 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:54.377934 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5341fc24-0f16-4ecc-8623-59c1a97e6d04 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:54.378665 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5341fc24-0f16-4ecc-8623-59c1a97e6d04 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:54.379128 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5341fc24-0f16-4ecc-8623-59c1a97e6d04 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:54.379555 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5341fc24-0f16-4ecc-8623-59c1a97e6d04 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:54.511225 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-5341fc24-0f16-4ecc-8623-59c1a97e6d04 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:54.519323 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5341fc24-0f16-4ecc-8623-59c1a97e6d04 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/8695f690-12a9-4df6-87d1-91ce614b00df" status: 200 len: 1390 microversion: 2.1 time: 0.152996 Oct 04 21:18:54.519915 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3013/6059] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:18:54 2022] GET /compute/v2.1/servers/8695f690-12a9-4df6-87d1-91ce614b00df => generated 1390 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:18:54.542392 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-8f4db0a8-d86f-4082-ab5e-5ec547d33d64 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:54.542953 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-8f4db0a8-d86f-4082-ab5e-5ec547d33d64 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: 8695f690-12a9-4df6-87d1-91ce614b00df] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:54.549043 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8f4db0a8-d86f-4082-ab5e-5ec547d33d64 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:54.549526 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8f4db0a8-d86f-4082-ab5e-5ec547d33d64 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:54.549961 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8f4db0a8-d86f-4082-ab5e-5ec547d33d64 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:54.550695 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8f4db0a8-d86f-4082-ab5e-5ec547d33d64 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:54.551152 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8f4db0a8-d86f-4082-ab5e-5ec547d33d64 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:54.551574 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8f4db0a8-d86f-4082-ab5e-5ec547d33d64 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:54.577379 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-8f4db0a8-d86f-4082-ab5e-5ec547d33d64 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: 8695f690-12a9-4df6-87d1-91ce614b00df] Going to try to terminate instance {{(pid=128802) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:18:54.662996 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-8f4db0a8-d86f-4082-ab5e-5ec547d33d64 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "DELETE /compute/v2.1/servers/8695f690-12a9-4df6-87d1-91ce614b00df" status: 204 len: 0 microversion: 2.1 time: 0.124655 Oct 04 21:18:54.663620 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3047/6060] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 21:18:54 2022] DELETE /compute/v2.1/servers/8695f690-12a9-4df6-87d1-91ce614b00df => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:18:54.672493 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f0fc2c92-0f23-4021-9a28-6e5472707258 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:54.673107 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f0fc2c92-0f23-4021-9a28-6e5472707258 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: 8695f690-12a9-4df6-87d1-91ce614b00df] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:54.679103 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f0fc2c92-0f23-4021-9a28-6e5472707258 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:54.679584 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f0fc2c92-0f23-4021-9a28-6e5472707258 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:54.680017 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f0fc2c92-0f23-4021-9a28-6e5472707258 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:54.680951 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f0fc2c92-0f23-4021-9a28-6e5472707258 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:54.681406 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f0fc2c92-0f23-4021-9a28-6e5472707258 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:54.681829 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f0fc2c92-0f23-4021-9a28-6e5472707258 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:54.821378 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f0fc2c92-0f23-4021-9a28-6e5472707258 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:54.829679 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f0fc2c92-0f23-4021-9a28-6e5472707258 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/8695f690-12a9-4df6-87d1-91ce614b00df" status: 200 len: 1396 microversion: 2.1 time: 0.161005 Oct 04 21:18:54.830266 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3014/6061] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:18:54 2022] GET /compute/v2.1/servers/8695f690-12a9-4df6-87d1-91ce614b00df => generated 1396 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:18:55.854200 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-0534cee9-9e36-4210-aef4-6c89de3f7eaf tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:55.854936 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-0534cee9-9e36-4210-aef4-6c89de3f7eaf tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: 8695f690-12a9-4df6-87d1-91ce614b00df] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:55.862499 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0534cee9-9e36-4210-aef4-6c89de3f7eaf tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:55.862989 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0534cee9-9e36-4210-aef4-6c89de3f7eaf tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:55.863429 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0534cee9-9e36-4210-aef4-6c89de3f7eaf tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:55.864132 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0534cee9-9e36-4210-aef4-6c89de3f7eaf tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:55.864587 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0534cee9-9e36-4210-aef4-6c89de3f7eaf tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:55.865016 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0534cee9-9e36-4210-aef4-6c89de3f7eaf tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:55.995795 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-0534cee9-9e36-4210-aef4-6c89de3f7eaf tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:56.003639 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-0534cee9-9e36-4210-aef4-6c89de3f7eaf tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/8695f690-12a9-4df6-87d1-91ce614b00df" status: 200 len: 1396 microversion: 2.1 time: 0.154261 Oct 04 21:18:56.004215 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3048/6062] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:18:55 2022] GET /compute/v2.1/servers/8695f690-12a9-4df6-87d1-91ce614b00df => generated 1396 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:18:56.769701 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-b0569f46-d401-489b-8845-156f83f7a472 req-50a10246-98ad-43a3-a454-a63521d6fe88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8695f690-12a9-4df6-87d1-91ce614b00df", "name": "network-vif-deleted", "tag": "b44a86ab-3dbe-4d97-a45a-8495270f6876"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:18:56.783253 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-b0569f46-d401-489b-8845-156f83f7a472 req-50a10246-98ad-43a3-a454-a63521d6fe88 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:56.784122 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-b0569f46-d401-489b-8845-156f83f7a472 req-50a10246-98ad-43a3-a454-a63521d6fe88 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:56.784629 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-b0569f46-d401-489b-8845-156f83f7a472 req-50a10246-98ad-43a3-a454-a63521d6fe88 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:56.797711 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-b0569f46-d401-489b-8845-156f83f7a472 req-50a10246-98ad-43a3-a454-a63521d6fe88 service nova] Creating event network-vif-deleted:b44a86ab-3dbe-4d97-a45a-8495270f6876 for instance 8695f690-12a9-4df6-87d1-91ce614b00df on n-h2-854823-8 Oct 04 21:18:56.803905 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-b0569f46-d401-489b-8845-156f83f7a472 req-50a10246-98ad-43a3-a454-a63521d6fe88 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037454 Oct 04 21:18:56.805086 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3015/6063] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:18:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:18:57.026503 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-5511264f-361b-4294-b439-34f85b64fdc5 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:57.029415 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-5511264f-361b-4294-b439-34f85b64fdc5 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: 8695f690-12a9-4df6-87d1-91ce614b00df] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:57.034419 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5511264f-361b-4294-b439-34f85b64fdc5 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:57.034940 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5511264f-361b-4294-b439-34f85b64fdc5 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:57.035397 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5511264f-361b-4294-b439-34f85b64fdc5 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:57.036100 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5511264f-361b-4294-b439-34f85b64fdc5 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:57.036579 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5511264f-361b-4294-b439-34f85b64fdc5 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:57.037002 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5511264f-361b-4294-b439-34f85b64fdc5 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:57.101845 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-5511264f-361b-4294-b439-34f85b64fdc5 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:57.110248 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-5511264f-361b-4294-b439-34f85b64fdc5 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/8695f690-12a9-4df6-87d1-91ce614b00df" status: 200 len: 1188 microversion: 2.1 time: 0.087902 Oct 04 21:18:57.110857 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3049/6064] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:18:57 2022] GET /compute/v2.1/servers/8695f690-12a9-4df6-87d1-91ce614b00df => generated 1188 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:18:58.134917 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-60e462e2-45f3-4edf-a103-75f9e841047a tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:58.135617 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-60e462e2-45f3-4edf-a103-75f9e841047a tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: 8695f690-12a9-4df6-87d1-91ce614b00df] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:58.143294 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-60e462e2-45f3-4edf-a103-75f9e841047a tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:58.143778 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-60e462e2-45f3-4edf-a103-75f9e841047a tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:58.144213 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-60e462e2-45f3-4edf-a103-75f9e841047a tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:58.144915 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-60e462e2-45f3-4edf-a103-75f9e841047a tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:58.145365 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-60e462e2-45f3-4edf-a103-75f9e841047a tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:58.145784 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-60e462e2-45f3-4edf-a103-75f9e841047a tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:58.211151 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-60e462e2-45f3-4edf-a103-75f9e841047a tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:58.220083 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-60e462e2-45f3-4edf-a103-75f9e841047a tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/8695f690-12a9-4df6-87d1-91ce614b00df" status: 200 len: 1188 microversion: 2.1 time: 0.089924 Oct 04 21:18:58.220668 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3016/6065] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:18:58 2022] GET /compute/v2.1/servers/8695f690-12a9-4df6-87d1-91ce614b00df => generated 1188 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:18:59.243911 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-d94e3ac0-1255-4567-acfd-5e2af36c415a tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:18:59.244577 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-d94e3ac0-1255-4567-acfd-5e2af36c415a tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: 8695f690-12a9-4df6-87d1-91ce614b00df] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:18:59.251709 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d94e3ac0-1255-4567-acfd-5e2af36c415a tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:59.252208 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d94e3ac0-1255-4567-acfd-5e2af36c415a tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:59.252651 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d94e3ac0-1255-4567-acfd-5e2af36c415a tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:59.253374 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d94e3ac0-1255-4567-acfd-5e2af36c415a tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:18:59.253845 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d94e3ac0-1255-4567-acfd-5e2af36c415a tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:18:59.254277 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d94e3ac0-1255-4567-acfd-5e2af36c415a tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:18:59.330639 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-d94e3ac0-1255-4567-acfd-5e2af36c415a tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:18:59.336069 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-d94e3ac0-1255-4567-acfd-5e2af36c415a tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/8695f690-12a9-4df6-87d1-91ce614b00df" status: 200 len: 1188 microversion: 2.1 time: 0.096916 Oct 04 21:18:59.337294 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3050/6066] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:18:59 2022] GET /compute/v2.1/servers/8695f690-12a9-4df6-87d1-91ce614b00df => generated 1188 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:19:00.359913 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8af81c5b-8bfb-4425-a4aa-e40d042b4f04 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:00.360535 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-8af81c5b-8bfb-4425-a4aa-e40d042b4f04 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: 8695f690-12a9-4df6-87d1-91ce614b00df] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:19:00.367863 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8af81c5b-8bfb-4425-a4aa-e40d042b4f04 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:00.369127 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8af81c5b-8bfb-4425-a4aa-e40d042b4f04 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:00.369716 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8af81c5b-8bfb-4425-a4aa-e40d042b4f04 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:00.370484 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8af81c5b-8bfb-4425-a4aa-e40d042b4f04 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:00.370947 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8af81c5b-8bfb-4425-a4aa-e40d042b4f04 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:00.371377 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8af81c5b-8bfb-4425-a4aa-e40d042b4f04 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:00.439886 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-8af81c5b-8bfb-4425-a4aa-e40d042b4f04 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:19:00.448714 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-8af81c5b-8bfb-4425-a4aa-e40d042b4f04 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/8695f690-12a9-4df6-87d1-91ce614b00df" status: 200 len: 1188 microversion: 2.1 time: 0.092832 Oct 04 21:19:00.449306 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3017/6067] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:19:00 2022] GET /compute/v2.1/servers/8695f690-12a9-4df6-87d1-91ce614b00df => generated 1188 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:19:01.471823 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-8d060030-337c-479a-9258-6e09d18dab71 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:01.472434 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-8d060030-337c-479a-9258-6e09d18dab71 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: 8695f690-12a9-4df6-87d1-91ce614b00df] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:19:01.480985 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8d060030-337c-479a-9258-6e09d18dab71 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:01.481486 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8d060030-337c-479a-9258-6e09d18dab71 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:01.481929 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8d060030-337c-479a-9258-6e09d18dab71 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:01.482672 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8d060030-337c-479a-9258-6e09d18dab71 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:01.483136 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8d060030-337c-479a-9258-6e09d18dab71 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:01.484319 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8d060030-337c-479a-9258-6e09d18dab71 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:01.518364 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8d060030-337c-479a-9258-6e09d18dab71 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:01.518913 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8d060030-337c-479a-9258-6e09d18dab71 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:01.519553 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8d060030-337c-479a-9258-6e09d18dab71 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:01.520249 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.objects.instance [None req-8d060030-337c-479a-9258-6e09d18dab71 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lazy-loading 'fault' on Instance uuid 8695f690-12a9-4df6-87d1-91ce614b00df {{(pid=128802) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:19:01.567305 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-8d060030-337c-479a-9258-6e09d18dab71 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:19:01.571012 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:19:01.575990 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-8d060030-337c-479a-9258-6e09d18dab71 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/8695f690-12a9-4df6-87d1-91ce614b00df" status: 200 len: 1147 microversion: 2.1 time: 0.108038 Oct 04 21:19:01.576587 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3051/6068] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:19:01 2022] GET /compute/v2.1/servers/8695f690-12a9-4df6-87d1-91ce614b00df => generated 1147 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:19:02.600141 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9c6ec57a-1ee6-44be-a616-c5761330c066 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:02.600802 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-9c6ec57a-1ee6-44be-a616-c5761330c066 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: 8695f690-12a9-4df6-87d1-91ce614b00df] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:19:02.608667 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9c6ec57a-1ee6-44be-a616-c5761330c066 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:02.609151 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9c6ec57a-1ee6-44be-a616-c5761330c066 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:02.609585 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9c6ec57a-1ee6-44be-a616-c5761330c066 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:02.610277 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9c6ec57a-1ee6-44be-a616-c5761330c066 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:02.610815 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9c6ec57a-1ee6-44be-a616-c5761330c066 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:02.611249 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9c6ec57a-1ee6-44be-a616-c5761330c066 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:02.625440 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-9c6ec57a-1ee6-44be-a616-c5761330c066 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] HTTP exception thrown: Instance 8695f690-12a9-4df6-87d1-91ce614b00df could not be found. Oct 04 21:19:02.627146 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9c6ec57a-1ee6-44be-a616-c5761330c066 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Request method failure captured: Oct 04 21:19:02.627146 n-d-854823-8 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/8695f690-12a9-4df6-87d1-91ce614b00df HTTP/1.1 Oct 04 21:19:02.627146 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 21:19:02.627146 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 21:19:02.627146 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 21:19:02.627146 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 0 Oct 04 21:19:02.627146 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 21:19:02.627146 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 21:19:02.627146 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 21:19:02.627146 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 21:19:02.627146 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPKMhB36sxHtTwvN5cR_FDx6677Bk3r96uZe9x8RsKj2kP41h8elma4Sfp2Sil3wffnoaQT-coMFt-1I-ubK46x1CIQQbRLJJWc6ISWYT8YHNWLLnEGq51UhoqUKdKybGmNCaSC1unJV9CeCDYPI8cjjYW6_GmoH3684NnCEjfslKtuc Oct 04 21:19:02.627146 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 21:19:02.627146 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 21:19:02.627146 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 21:19:02.627146 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 21:19:02.627146 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 21:19:02.627146 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 21:19:02.627146 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: 0d78e06d720d438a9308ae138902f847 Oct 04 21:19:02.627146 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-TestVolumeBootPattern-1361369473 Oct 04 21:19:02.627146 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 21:19:02.627146 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 21:19:02.627146 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0d78e06d720d438a9308ae138902f847", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0d78e06d720d438a9308ae138902f847"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0d78e06d720d438a9308ae138902f847"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0d78e06d720d438a9308ae138902f847"}]}] Oct 04 21:19:02.627146 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-TestVolumeBootPattern-1361369473 Oct 04 21:19:02.627146 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: 0d78e06d720d438a9308ae138902f847 Oct 04 21:19:02.627146 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-TestVolumeBootPattern-1361369473 Oct 04 21:19:02.627146 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-TestVolumeBootPattern-1361369473-project Oct 04 21:19:02.627146 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 21:19:02.627146 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 21:19:02.627146 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: ad7b0b59fad1429e95591b21e33ccbaa Oct 04 21:19:02.627146 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-TestVolumeBootPattern-1361369473-project Oct 04 21:19:02.627146 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 21:19:02.627146 n-d-854823-8 devstack@n-api.service[128801]: exception: Instance 8695f690-12a9-4df6-87d1-91ce614b00df could not be found. Oct 04 21:19:02.627146 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': '8695f690-12a9-4df6-87d1-91ce614b00df'} Oct 04 21:19:02.627146 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:19:02.627146 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:19:02.627146 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:19:02.627146 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:19:02.627146 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:19:02.627146 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:19:02.627146 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:19:02.627146 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:19:02.627146 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:19:02.627146 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:19:02.627146 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8695f690-12a9-4df6-87d1-91ce614b00df could not be found. Oct 04 21:19:02.627146 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:19:02.627146 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:19:02.627146 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:19:02.627146 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:19:02.627146 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:19:02.627146 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:19:02.627146 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:19:02.627146 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:19:02.627146 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:19:02.627146 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:19:02.627146 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:19:02.627146 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:19:02.627146 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:19:02.627146 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:19:02.627146 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:19:02.627146 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:19:02.627146 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8695f690-12a9-4df6-87d1-91ce614b00df could not be found. Oct 04 21:19:02.627146 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:19:02.627146 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:19:02.627146 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:19:02.632369 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:19:02.632369 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:19:02.632369 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:19:02.632369 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:19:02.632369 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:19:02.632369 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8695f690-12a9-4df6-87d1-91ce614b00df could not be found. Oct 04 21:19:02.632369 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:19:02.632369 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9c6ec57a-1ee6-44be-a616-c5761330c066 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Returning 404 to user: Instance 8695f690-12a9-4df6-87d1-91ce614b00df could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:19:02.632369 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-9c6ec57a-1ee6-44be-a616-c5761330c066 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/8695f690-12a9-4df6-87d1-91ce614b00df" status: 404 len: 111 microversion: 2.1 time: 0.032435 Oct 04 21:19:02.632369 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3018/6069] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:19:02 2022] GET /compute/v2.1/servers/8695f690-12a9-4df6-87d1-91ce614b00df => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:19:07.603563 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-8410bbee-1493-4ccc-8eb4-71dac722b88d tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1088667083", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "e64400eb-dbb1-4d5b-b856-c03fd2351deb", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "975b1130-f216-463e-808d-0d3403b17918"}]}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:19:07.614547 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:19:07.667578 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.network.neutron [None req-8410bbee-1493-4ccc-8eb4-71dac722b88d tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] validate_networks() for [('975b1130-f216-463e-808d-0d3403b17918', None, None, None, None, None)] {{(pid=128802) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:19:08.049402 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-8410bbee-1493-4ccc-8eb4-71dac722b88d tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Flavor limits 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:19:08.049853 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-8410bbee-1493-4ccc-8eb4-71dac722b88d tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Image limits 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:19:08.050324 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-8410bbee-1493-4ccc-8eb4-71dac722b88d tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Flavor pref 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:19:08.050914 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-8410bbee-1493-4ccc-8eb4-71dac722b88d tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Image pref 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:19:08.051362 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-8410bbee-1493-4ccc-8eb4-71dac722b88d tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:19:08.060478 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8410bbee-1493-4ccc-8eb4-71dac722b88d tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:08.060986 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8410bbee-1493-4ccc-8eb4-71dac722b88d tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:08.061418 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8410bbee-1493-4ccc-8eb4-71dac722b88d tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:08.062136 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8410bbee-1493-4ccc-8eb4-71dac722b88d tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:08.062622 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8410bbee-1493-4ccc-8eb4-71dac722b88d tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:08.063038 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8410bbee-1493-4ccc-8eb4-71dac722b88d tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:08.081680 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-8410bbee-1493-4ccc-8eb4-71dac722b88d tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Getting quotas for project 0d78e06d720d438a9308ae138902f847. Resources: {'ram', 'instances', 'cores'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:19:08.087371 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-8410bbee-1493-4ccc-8eb4-71dac722b88d tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Getting quotas for user ad7b0b59fad1429e95591b21e33ccbaa and project 0d78e06d720d438a9308ae138902f847. Resources: {'ram', 'instances', 'cores'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:19:08.143950 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-8410bbee-1493-4ccc-8eb4-71dac722b88d tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Going to run 1 instances... {{(pid=128802) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:19:08.146023 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-8410bbee-1493-4ccc-8eb4-71dac722b88d tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: 4b75a0a6-37af-4f71-afcb-c38005dceb11] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e64400eb-dbb1-4d5b-b856-c03fd2351deb',volume_size=None,volume_type=None)] {{(pid=128802) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:19:08.280406 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-8410bbee-1493-4ccc-8eb4-71dac722b88d tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.681166 Oct 04 21:19:08.281137 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3052/6070] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 21:19:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 683 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:19:08.292533 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a7d2bd02-a99c-4c50-986c-7fa32fc49add tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:08.293150 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a7d2bd02-a99c-4c50-986c-7fa32fc49add tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: 4b75a0a6-37af-4f71-afcb-c38005dceb11] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:19:08.297024 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=35 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:19:08.351979 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-a7d2bd02-a99c-4c50-986c-7fa32fc49add tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:19:08.359879 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a7d2bd02-a99c-4c50-986c-7fa32fc49add tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/4b75a0a6-37af-4f71-afcb-c38005dceb11" status: 200 len: 1057 microversion: 2.1 time: 0.071155 Oct 04 21:19:08.360467 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3019/6071] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:19:08 2022] GET /compute/v2.1/servers/4b75a0a6-37af-4f71-afcb-c38005dceb11 => generated 1057 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:19:09.383567 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-cb46ec1b-ecd6-4355-a218-e3a97614d909 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:09.384310 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-cb46ec1b-ecd6-4355-a218-e3a97614d909 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: 4b75a0a6-37af-4f71-afcb-c38005dceb11] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:19:09.391864 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cb46ec1b-ecd6-4355-a218-e3a97614d909 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:09.392362 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cb46ec1b-ecd6-4355-a218-e3a97614d909 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:09.394137 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cb46ec1b-ecd6-4355-a218-e3a97614d909 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:09.394137 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cb46ec1b-ecd6-4355-a218-e3a97614d909 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:09.394137 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cb46ec1b-ecd6-4355-a218-e3a97614d909 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:09.394485 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cb46ec1b-ecd6-4355-a218-e3a97614d909 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:09.493852 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-cb46ec1b-ecd6-4355-a218-e3a97614d909 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:19:09.501985 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-cb46ec1b-ecd6-4355-a218-e3a97614d909 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/4b75a0a6-37af-4f71-afcb-c38005dceb11" status: 200 len: 1173 microversion: 2.1 time: 0.122429 Oct 04 21:19:09.502626 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3053/6072] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:19:09 2022] GET /compute/v2.1/servers/4b75a0a6-37af-4f71-afcb-c38005dceb11 => generated 1173 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:19:10.527638 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f9823080-7b66-4f8a-a72f-532801f29aee tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:10.529210 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f9823080-7b66-4f8a-a72f-532801f29aee tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: 4b75a0a6-37af-4f71-afcb-c38005dceb11] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:19:10.538402 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f9823080-7b66-4f8a-a72f-532801f29aee tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:10.538901 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f9823080-7b66-4f8a-a72f-532801f29aee tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:10.539339 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f9823080-7b66-4f8a-a72f-532801f29aee tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:10.541157 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f9823080-7b66-4f8a-a72f-532801f29aee tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:10.541809 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f9823080-7b66-4f8a-a72f-532801f29aee tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:10.542249 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f9823080-7b66-4f8a-a72f-532801f29aee tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:10.545168 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=79 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:19:10.766641 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f9823080-7b66-4f8a-a72f-532801f29aee tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:19:10.776390 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f9823080-7b66-4f8a-a72f-532801f29aee tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/4b75a0a6-37af-4f71-afcb-c38005dceb11" status: 200 len: 1215 microversion: 2.1 time: 0.254877 Oct 04 21:19:10.777370 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3020/6073] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:19:10 2022] GET /compute/v2.1/servers/4b75a0a6-37af-4f71-afcb-c38005dceb11 => generated 1215 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:19:10.918470 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-ce001275-3e06-452c-8297-7150f0a45caa req-286a5391-47c3-4c14-80b2-2164ed63ceb0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b75a0a6-37af-4f71-afcb-c38005dceb11", "tag": "b96b0c57-cc7a-4371-9283-3f2d3f0e0fcf"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:19:10.939221 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-ce001275-3e06-452c-8297-7150f0a45caa req-286a5391-47c3-4c14-80b2-2164ed63ceb0 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:10.940013 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-ce001275-3e06-452c-8297-7150f0a45caa req-286a5391-47c3-4c14-80b2-2164ed63ceb0 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:10.940874 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-ce001275-3e06-452c-8297-7150f0a45caa req-286a5391-47c3-4c14-80b2-2164ed63ceb0 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:10.956315 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-ce001275-3e06-452c-8297-7150f0a45caa req-286a5391-47c3-4c14-80b2-2164ed63ceb0 service nova] Creating event network-changed:b96b0c57-cc7a-4371-9283-3f2d3f0e0fcf for instance 4b75a0a6-37af-4f71-afcb-c38005dceb11 on n-h2-854823-8 Oct 04 21:19:10.963559 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-ce001275-3e06-452c-8297-7150f0a45caa req-286a5391-47c3-4c14-80b2-2164ed63ceb0 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054143 Oct 04 21:19:10.964404 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3054/6074] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:19:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:19:11.798887 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-eda335f2-91ef-4e39-962d-a348a8f9d6c9 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:11.799507 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-eda335f2-91ef-4e39-962d-a348a8f9d6c9 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: 4b75a0a6-37af-4f71-afcb-c38005dceb11] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:19:11.807759 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-eda335f2-91ef-4e39-962d-a348a8f9d6c9 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:11.808497 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-eda335f2-91ef-4e39-962d-a348a8f9d6c9 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:11.809499 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-eda335f2-91ef-4e39-962d-a348a8f9d6c9 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:11.810254 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-eda335f2-91ef-4e39-962d-a348a8f9d6c9 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:11.811046 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-eda335f2-91ef-4e39-962d-a348a8f9d6c9 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:11.811589 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-eda335f2-91ef-4e39-962d-a348a8f9d6c9 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:12.036852 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-eda335f2-91ef-4e39-962d-a348a8f9d6c9 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:19:12.057271 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-eda335f2-91ef-4e39-962d-a348a8f9d6c9 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/4b75a0a6-37af-4f71-afcb-c38005dceb11" status: 200 len: 1215 microversion: 2.1 time: 0.262461 Oct 04 21:19:12.057927 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3021/6075] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:19:11 2022] GET /compute/v2.1/servers/4b75a0a6-37af-4f71-afcb-c38005dceb11 => generated 1215 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:19:13.082658 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-98962747-5561-4c2d-b7ad-7ac6fbdbb6c7 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:13.083380 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-98962747-5561-4c2d-b7ad-7ac6fbdbb6c7 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: 4b75a0a6-37af-4f71-afcb-c38005dceb11] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:19:13.090527 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-98962747-5561-4c2d-b7ad-7ac6fbdbb6c7 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:13.091019 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-98962747-5561-4c2d-b7ad-7ac6fbdbb6c7 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:13.091465 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-98962747-5561-4c2d-b7ad-7ac6fbdbb6c7 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:13.092174 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-98962747-5561-4c2d-b7ad-7ac6fbdbb6c7 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:13.092637 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-98962747-5561-4c2d-b7ad-7ac6fbdbb6c7 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:13.093069 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-98962747-5561-4c2d-b7ad-7ac6fbdbb6c7 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:13.239689 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-98962747-5561-4c2d-b7ad-7ac6fbdbb6c7 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:19:13.249905 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-98962747-5561-4c2d-b7ad-7ac6fbdbb6c7 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/4b75a0a6-37af-4f71-afcb-c38005dceb11" status: 200 len: 1215 microversion: 2.1 time: 0.172512 Oct 04 21:19:13.262511 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3055/6076] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:19:13 2022] GET /compute/v2.1/servers/4b75a0a6-37af-4f71-afcb-c38005dceb11 => generated 1215 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:19:14.273533 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2b32f7c1-df79-4a03-83f3-78d086594dd4 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:14.274692 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-2b32f7c1-df79-4a03-83f3-78d086594dd4 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: 4b75a0a6-37af-4f71-afcb-c38005dceb11] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:19:14.282428 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2b32f7c1-df79-4a03-83f3-78d086594dd4 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:14.282992 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2b32f7c1-df79-4a03-83f3-78d086594dd4 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:14.283487 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2b32f7c1-df79-4a03-83f3-78d086594dd4 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:14.284293 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2b32f7c1-df79-4a03-83f3-78d086594dd4 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:14.284807 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2b32f7c1-df79-4a03-83f3-78d086594dd4 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:14.285290 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2b32f7c1-df79-4a03-83f3-78d086594dd4 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:14.432645 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-2b32f7c1-df79-4a03-83f3-78d086594dd4 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:19:14.442258 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-2b32f7c1-df79-4a03-83f3-78d086594dd4 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/4b75a0a6-37af-4f71-afcb-c38005dceb11" status: 200 len: 1215 microversion: 2.1 time: 0.172763 Oct 04 21:19:14.443517 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3022/6077] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:19:14 2022] GET /compute/v2.1/servers/4b75a0a6-37af-4f71-afcb-c38005dceb11 => generated 1215 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:19:15.467605 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-eefba8ee-796e-4312-96d8-afacc001df0c tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:15.468208 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-eefba8ee-796e-4312-96d8-afacc001df0c tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: 4b75a0a6-37af-4f71-afcb-c38005dceb11] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:19:15.475196 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-eefba8ee-796e-4312-96d8-afacc001df0c tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:15.475673 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-eefba8ee-796e-4312-96d8-afacc001df0c tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:15.476107 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-eefba8ee-796e-4312-96d8-afacc001df0c tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:15.476794 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-eefba8ee-796e-4312-96d8-afacc001df0c tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:15.477245 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-eefba8ee-796e-4312-96d8-afacc001df0c tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:15.477668 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-eefba8ee-796e-4312-96d8-afacc001df0c tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:15.605935 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-eefba8ee-796e-4312-96d8-afacc001df0c tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:19:15.613688 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-eefba8ee-796e-4312-96d8-afacc001df0c tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/4b75a0a6-37af-4f71-afcb-c38005dceb11" status: 200 len: 1203 microversion: 2.1 time: 0.150229 Oct 04 21:19:15.614275 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3056/6078] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:19:15 2022] GET /compute/v2.1/servers/4b75a0a6-37af-4f71-afcb-c38005dceb11 => generated 1203 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:19:16.641444 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e0f63173-36d6-42e5-b5d4-54b7b82e2d9c tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:16.642630 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e0f63173-36d6-42e5-b5d4-54b7b82e2d9c tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: 4b75a0a6-37af-4f71-afcb-c38005dceb11] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:19:16.651528 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e0f63173-36d6-42e5-b5d4-54b7b82e2d9c tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:16.652121 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e0f63173-36d6-42e5-b5d4-54b7b82e2d9c tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:16.652564 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e0f63173-36d6-42e5-b5d4-54b7b82e2d9c tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:16.653300 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e0f63173-36d6-42e5-b5d4-54b7b82e2d9c tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:16.653765 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e0f63173-36d6-42e5-b5d4-54b7b82e2d9c tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:16.654197 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e0f63173-36d6-42e5-b5d4-54b7b82e2d9c tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:16.801590 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e0f63173-36d6-42e5-b5d4-54b7b82e2d9c tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:19:16.810114 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e0f63173-36d6-42e5-b5d4-54b7b82e2d9c tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/4b75a0a6-37af-4f71-afcb-c38005dceb11" status: 200 len: 1203 microversion: 2.1 time: 0.176305 Oct 04 21:19:16.810749 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3023/6079] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:19:16 2022] GET /compute/v2.1/servers/4b75a0a6-37af-4f71-afcb-c38005dceb11 => generated 1203 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:19:17.834320 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-213ebe20-8047-4367-96d0-bbd54be576d4 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:17.834903 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-213ebe20-8047-4367-96d0-bbd54be576d4 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: 4b75a0a6-37af-4f71-afcb-c38005dceb11] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:19:17.842124 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-213ebe20-8047-4367-96d0-bbd54be576d4 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:17.842632 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-213ebe20-8047-4367-96d0-bbd54be576d4 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:17.843070 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-213ebe20-8047-4367-96d0-bbd54be576d4 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:17.843757 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-213ebe20-8047-4367-96d0-bbd54be576d4 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:17.844221 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-213ebe20-8047-4367-96d0-bbd54be576d4 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:17.844641 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-213ebe20-8047-4367-96d0-bbd54be576d4 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:17.975388 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-213ebe20-8047-4367-96d0-bbd54be576d4 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:19:17.984909 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-213ebe20-8047-4367-96d0-bbd54be576d4 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/4b75a0a6-37af-4f71-afcb-c38005dceb11" status: 200 len: 1203 microversion: 2.1 time: 0.154382 Oct 04 21:19:17.985515 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3057/6080] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:19:17 2022] GET /compute/v2.1/servers/4b75a0a6-37af-4f71-afcb-c38005dceb11 => generated 1203 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:19:19.009234 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-be3fd5af-05af-44fa-a9e8-01e2676a8655 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:19.010020 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-be3fd5af-05af-44fa-a9e8-01e2676a8655 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: 4b75a0a6-37af-4f71-afcb-c38005dceb11] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:19:19.012976 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:19:19.018898 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-be3fd5af-05af-44fa-a9e8-01e2676a8655 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:19.019394 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-be3fd5af-05af-44fa-a9e8-01e2676a8655 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:19.019827 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-be3fd5af-05af-44fa-a9e8-01e2676a8655 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:19.020547 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-be3fd5af-05af-44fa-a9e8-01e2676a8655 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:19.021004 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-be3fd5af-05af-44fa-a9e8-01e2676a8655 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:19.021433 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-be3fd5af-05af-44fa-a9e8-01e2676a8655 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:19.160706 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-be3fd5af-05af-44fa-a9e8-01e2676a8655 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:19:19.169599 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-be3fd5af-05af-44fa-a9e8-01e2676a8655 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/4b75a0a6-37af-4f71-afcb-c38005dceb11" status: 200 len: 1203 microversion: 2.1 time: 0.164336 Oct 04 21:19:19.170199 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3024/6081] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:19:19 2022] GET /compute/v2.1/servers/4b75a0a6-37af-4f71-afcb-c38005dceb11 => generated 1203 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:19:20.192827 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-f634482f-7fa7-48a1-8c63-38dea6956c2e tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:20.193441 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-f634482f-7fa7-48a1-8c63-38dea6956c2e tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: 4b75a0a6-37af-4f71-afcb-c38005dceb11] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:19:20.195405 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell0:SELECT=2 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:19:20.196207 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell0:SELECT=6 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:19:20.203723 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f634482f-7fa7-48a1-8c63-38dea6956c2e tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:20.204177 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f634482f-7fa7-48a1-8c63-38dea6956c2e tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:20.204613 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f634482f-7fa7-48a1-8c63-38dea6956c2e tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:20.205304 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f634482f-7fa7-48a1-8c63-38dea6956c2e tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:20.205754 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f634482f-7fa7-48a1-8c63-38dea6956c2e tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:20.206177 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f634482f-7fa7-48a1-8c63-38dea6956c2e tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:20.340757 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-f634482f-7fa7-48a1-8c63-38dea6956c2e tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:19:20.348541 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-f634482f-7fa7-48a1-8c63-38dea6956c2e tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/4b75a0a6-37af-4f71-afcb-c38005dceb11" status: 200 len: 1203 microversion: 2.1 time: 0.159919 Oct 04 21:19:20.349114 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3058/6082] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:19:20 2022] GET /compute/v2.1/servers/4b75a0a6-37af-4f71-afcb-c38005dceb11 => generated 1203 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:19:21.372134 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d737b950-fd12-4024-8d49-c5196ccf4fb3 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:21.372802 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d737b950-fd12-4024-8d49-c5196ccf4fb3 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: 4b75a0a6-37af-4f71-afcb-c38005dceb11] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:19:21.379679 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d737b950-fd12-4024-8d49-c5196ccf4fb3 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:21.380166 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d737b950-fd12-4024-8d49-c5196ccf4fb3 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:21.380601 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d737b950-fd12-4024-8d49-c5196ccf4fb3 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:21.381305 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d737b950-fd12-4024-8d49-c5196ccf4fb3 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:21.381764 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d737b950-fd12-4024-8d49-c5196ccf4fb3 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:21.382190 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d737b950-fd12-4024-8d49-c5196ccf4fb3 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:21.522889 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d737b950-fd12-4024-8d49-c5196ccf4fb3 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:19:21.531063 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d737b950-fd12-4024-8d49-c5196ccf4fb3 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/4b75a0a6-37af-4f71-afcb-c38005dceb11" status: 200 len: 1203 microversion: 2.1 time: 0.163538 Oct 04 21:19:21.531645 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3025/6083] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:19:21 2022] GET /compute/v2.1/servers/4b75a0a6-37af-4f71-afcb-c38005dceb11 => generated 1203 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:19:22.554739 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-8b5f6b51-0c89-4464-95ef-d60d73d369ab tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:22.555383 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-8b5f6b51-0c89-4464-95ef-d60d73d369ab tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: 4b75a0a6-37af-4f71-afcb-c38005dceb11] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:19:22.562527 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8b5f6b51-0c89-4464-95ef-d60d73d369ab tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:22.563020 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8b5f6b51-0c89-4464-95ef-d60d73d369ab tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:22.563464 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8b5f6b51-0c89-4464-95ef-d60d73d369ab tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:22.564167 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8b5f6b51-0c89-4464-95ef-d60d73d369ab tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:22.564629 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8b5f6b51-0c89-4464-95ef-d60d73d369ab tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:22.565059 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8b5f6b51-0c89-4464-95ef-d60d73d369ab tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:22.698898 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-8b5f6b51-0c89-4464-95ef-d60d73d369ab tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:19:22.707576 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-8b5f6b51-0c89-4464-95ef-d60d73d369ab tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/4b75a0a6-37af-4f71-afcb-c38005dceb11" status: 200 len: 1203 microversion: 2.1 time: 0.156806 Oct 04 21:19:22.708151 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3059/6084] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:19:22 2022] GET /compute/v2.1/servers/4b75a0a6-37af-4f71-afcb-c38005dceb11 => generated 1203 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:19:23.731325 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-4ea7cd8a-dd48-49a0-989a-38ccc8f8c631 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:23.732599 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-4ea7cd8a-dd48-49a0-989a-38ccc8f8c631 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: 4b75a0a6-37af-4f71-afcb-c38005dceb11] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:19:23.739440 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4ea7cd8a-dd48-49a0-989a-38ccc8f8c631 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:23.739922 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4ea7cd8a-dd48-49a0-989a-38ccc8f8c631 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:23.740354 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4ea7cd8a-dd48-49a0-989a-38ccc8f8c631 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:23.741050 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4ea7cd8a-dd48-49a0-989a-38ccc8f8c631 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:23.741499 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4ea7cd8a-dd48-49a0-989a-38ccc8f8c631 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:23.741919 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4ea7cd8a-dd48-49a0-989a-38ccc8f8c631 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:23.890812 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-4ea7cd8a-dd48-49a0-989a-38ccc8f8c631 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:19:23.898727 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-4ea7cd8a-dd48-49a0-989a-38ccc8f8c631 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/4b75a0a6-37af-4f71-afcb-c38005dceb11" status: 200 len: 1203 microversion: 2.1 time: 0.171409 Oct 04 21:19:23.899395 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3026/6085] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:19:23 2022] GET /compute/v2.1/servers/4b75a0a6-37af-4f71-afcb-c38005dceb11 => generated 1203 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:19:24.922360 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-e4b43d4a-3df5-4130-8530-00c9a59fc460 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:24.923113 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-e4b43d4a-3df5-4130-8530-00c9a59fc460 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: 4b75a0a6-37af-4f71-afcb-c38005dceb11] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:19:24.931423 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e4b43d4a-3df5-4130-8530-00c9a59fc460 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:24.931918 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e4b43d4a-3df5-4130-8530-00c9a59fc460 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:24.932354 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e4b43d4a-3df5-4130-8530-00c9a59fc460 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:24.933277 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e4b43d4a-3df5-4130-8530-00c9a59fc460 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:24.933910 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e4b43d4a-3df5-4130-8530-00c9a59fc460 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:24.934485 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e4b43d4a-3df5-4130-8530-00c9a59fc460 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:25.077431 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-e4b43d4a-3df5-4130-8530-00c9a59fc460 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:19:25.085599 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-e4b43d4a-3df5-4130-8530-00c9a59fc460 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/4b75a0a6-37af-4f71-afcb-c38005dceb11" status: 200 len: 1203 microversion: 2.1 time: 0.167801 Oct 04 21:19:25.086185 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3060/6086] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:19:24 2022] GET /compute/v2.1/servers/4b75a0a6-37af-4f71-afcb-c38005dceb11 => generated 1203 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:19:26.093523 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-8636dc26-ccbf-48a6-9f56-1d920cd37385 req-d9a42935-fcae-496e-bed0-4119dd730477 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b75a0a6-37af-4f71-afcb-c38005dceb11", "name": "network-vif-plugged", "status": "completed", "tag": "b96b0c57-cc7a-4371-9283-3f2d3f0e0fcf"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:19:26.104585 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-8636dc26-ccbf-48a6-9f56-1d920cd37385 req-d9a42935-fcae-496e-bed0-4119dd730477 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:26.105077 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-8636dc26-ccbf-48a6-9f56-1d920cd37385 req-d9a42935-fcae-496e-bed0-4119dd730477 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:26.105591 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-8636dc26-ccbf-48a6-9f56-1d920cd37385 req-d9a42935-fcae-496e-bed0-4119dd730477 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:26.110076 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-a65c5960-5dad-415d-9b6e-e312f2bf99be tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:26.110076 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-a65c5960-5dad-415d-9b6e-e312f2bf99be tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: 4b75a0a6-37af-4f71-afcb-c38005dceb11] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:19:26.117273 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-8636dc26-ccbf-48a6-9f56-1d920cd37385 req-d9a42935-fcae-496e-bed0-4119dd730477 service nova] Creating event network-vif-plugged:b96b0c57-cc7a-4371-9283-3f2d3f0e0fcf for instance 4b75a0a6-37af-4f71-afcb-c38005dceb11 on n-h2-854823-8 Oct 04 21:19:26.117502 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a65c5960-5dad-415d-9b6e-e312f2bf99be tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:26.118125 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a65c5960-5dad-415d-9b6e-e312f2bf99be tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:26.118662 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a65c5960-5dad-415d-9b6e-e312f2bf99be tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:26.119447 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a65c5960-5dad-415d-9b6e-e312f2bf99be tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:26.119993 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a65c5960-5dad-415d-9b6e-e312f2bf99be tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:26.121280 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a65c5960-5dad-415d-9b6e-e312f2bf99be tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:26.122445 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-8636dc26-ccbf-48a6-9f56-1d920cd37385 req-d9a42935-fcae-496e-bed0-4119dd730477 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032659 Oct 04 21:19:26.123318 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3027/6087] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:19:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:19:26.288526 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-a65c5960-5dad-415d-9b6e-e312f2bf99be tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:19:26.297098 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-a65c5960-5dad-415d-9b6e-e312f2bf99be tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/4b75a0a6-37af-4f71-afcb-c38005dceb11" status: 200 len: 1203 microversion: 2.1 time: 0.192754 Oct 04 21:19:26.297685 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3061/6088] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:19:26 2022] GET /compute/v2.1/servers/4b75a0a6-37af-4f71-afcb-c38005dceb11 => generated 1203 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:19:27.326564 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f4e9d724-e123-40a0-b9f1-58e35f61009b tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:27.327331 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f4e9d724-e123-40a0-b9f1-58e35f61009b tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: 4b75a0a6-37af-4f71-afcb-c38005dceb11] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:19:27.335852 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f4e9d724-e123-40a0-b9f1-58e35f61009b tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:27.336618 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f4e9d724-e123-40a0-b9f1-58e35f61009b tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:27.337112 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f4e9d724-e123-40a0-b9f1-58e35f61009b tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:27.337833 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f4e9d724-e123-40a0-b9f1-58e35f61009b tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:27.338293 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f4e9d724-e123-40a0-b9f1-58e35f61009b tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:27.338748 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f4e9d724-e123-40a0-b9f1-58e35f61009b tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:27.516747 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f4e9d724-e123-40a0-b9f1-58e35f61009b tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:19:27.536075 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f4e9d724-e123-40a0-b9f1-58e35f61009b tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/4b75a0a6-37af-4f71-afcb-c38005dceb11" status: 200 len: 1390 microversion: 2.1 time: 0.218598 Oct 04 21:19:27.537356 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3028/6089] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:19:27 2022] GET /compute/v2.1/servers/4b75a0a6-37af-4f71-afcb-c38005dceb11 => generated 1390 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:19:27.564198 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-76ef00f0-b083-4f43-a71d-82b54f8c9a08 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:27.565647 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-76ef00f0-b083-4f43-a71d-82b54f8c9a08 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: 4b75a0a6-37af-4f71-afcb-c38005dceb11] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:19:27.573448 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-76ef00f0-b083-4f43-a71d-82b54f8c9a08 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:27.574065 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-76ef00f0-b083-4f43-a71d-82b54f8c9a08 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:27.574626 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-76ef00f0-b083-4f43-a71d-82b54f8c9a08 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:27.575580 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-76ef00f0-b083-4f43-a71d-82b54f8c9a08 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:27.576436 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-76ef00f0-b083-4f43-a71d-82b54f8c9a08 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:27.577028 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-76ef00f0-b083-4f43-a71d-82b54f8c9a08 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:27.758023 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-76ef00f0-b083-4f43-a71d-82b54f8c9a08 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:19:27.767761 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-76ef00f0-b083-4f43-a71d-82b54f8c9a08 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/4b75a0a6-37af-4f71-afcb-c38005dceb11" status: 200 len: 1390 microversion: 2.1 time: 0.208764 Oct 04 21:19:27.768485 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3062/6090] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:19:27 2022] GET /compute/v2.1/servers/4b75a0a6-37af-4f71-afcb-c38005dceb11 => generated 1390 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:19:27.797911 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a577332e-5a7c-412c-9086-e2e5515632be tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:27.798804 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a577332e-5a7c-412c-9086-e2e5515632be tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: 4b75a0a6-37af-4f71-afcb-c38005dceb11] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:19:27.805350 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a577332e-5a7c-412c-9086-e2e5515632be tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:27.805839 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a577332e-5a7c-412c-9086-e2e5515632be tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:27.806278 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a577332e-5a7c-412c-9086-e2e5515632be tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:27.807085 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a577332e-5a7c-412c-9086-e2e5515632be tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:27.807544 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a577332e-5a7c-412c-9086-e2e5515632be tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:27.807973 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a577332e-5a7c-412c-9086-e2e5515632be tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:27.956912 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-a577332e-5a7c-412c-9086-e2e5515632be tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:19:27.965589 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a577332e-5a7c-412c-9086-e2e5515632be tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/4b75a0a6-37af-4f71-afcb-c38005dceb11" status: 200 len: 1390 microversion: 2.1 time: 0.172813 Oct 04 21:19:27.966168 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3029/6091] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:19:27 2022] GET /compute/v2.1/servers/4b75a0a6-37af-4f71-afcb-c38005dceb11 => generated 1390 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:19:27.989879 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-e7d1b7ca-31ad-434e-9d8d-50836a3c2551 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:27.990402 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-e7d1b7ca-31ad-434e-9d8d-50836a3c2551 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: 4b75a0a6-37af-4f71-afcb-c38005dceb11] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:19:27.997273 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e7d1b7ca-31ad-434e-9d8d-50836a3c2551 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:27.998118 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e7d1b7ca-31ad-434e-9d8d-50836a3c2551 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:27.998961 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e7d1b7ca-31ad-434e-9d8d-50836a3c2551 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:28.000833 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e7d1b7ca-31ad-434e-9d8d-50836a3c2551 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:28.001665 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e7d1b7ca-31ad-434e-9d8d-50836a3c2551 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:28.002527 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e7d1b7ca-31ad-434e-9d8d-50836a3c2551 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:28.045769 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-e7d1b7ca-31ad-434e-9d8d-50836a3c2551 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: 4b75a0a6-37af-4f71-afcb-c38005dceb11] Going to try to terminate instance {{(pid=128802) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:19:28.132990 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-e7d1b7ca-31ad-434e-9d8d-50836a3c2551 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "DELETE /compute/v2.1/servers/4b75a0a6-37af-4f71-afcb-c38005dceb11" status: 204 len: 0 microversion: 2.1 time: 0.146420 Oct 04 21:19:28.134818 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3063/6092] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 21:19:27 2022] DELETE /compute/v2.1/servers/4b75a0a6-37af-4f71-afcb-c38005dceb11 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:19:28.143684 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c661afd4-c513-4da5-86a8-dee2dc3894e6 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:28.144303 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c661afd4-c513-4da5-86a8-dee2dc3894e6 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: 4b75a0a6-37af-4f71-afcb-c38005dceb11] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:19:28.150486 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c661afd4-c513-4da5-86a8-dee2dc3894e6 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:28.150972 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c661afd4-c513-4da5-86a8-dee2dc3894e6 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:28.151408 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c661afd4-c513-4da5-86a8-dee2dc3894e6 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:28.152104 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c661afd4-c513-4da5-86a8-dee2dc3894e6 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:28.152587 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c661afd4-c513-4da5-86a8-dee2dc3894e6 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:28.153105 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c661afd4-c513-4da5-86a8-dee2dc3894e6 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:28.292160 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c661afd4-c513-4da5-86a8-dee2dc3894e6 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:19:28.301672 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c661afd4-c513-4da5-86a8-dee2dc3894e6 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/4b75a0a6-37af-4f71-afcb-c38005dceb11" status: 200 len: 1396 microversion: 2.1 time: 0.162213 Oct 04 21:19:28.302272 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3030/6093] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:19:28 2022] GET /compute/v2.1/servers/4b75a0a6-37af-4f71-afcb-c38005dceb11 => generated 1396 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:19:29.325737 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-62e39bce-39d8-4f70-9ed4-a5625a99b39a tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:29.326539 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-62e39bce-39d8-4f70-9ed4-a5625a99b39a tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: 4b75a0a6-37af-4f71-afcb-c38005dceb11] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:19:29.334379 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-62e39bce-39d8-4f70-9ed4-a5625a99b39a tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:29.334806 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-62e39bce-39d8-4f70-9ed4-a5625a99b39a tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:29.335248 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-62e39bce-39d8-4f70-9ed4-a5625a99b39a tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:29.335956 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-62e39bce-39d8-4f70-9ed4-a5625a99b39a tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:29.336416 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-62e39bce-39d8-4f70-9ed4-a5625a99b39a tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:29.336841 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-62e39bce-39d8-4f70-9ed4-a5625a99b39a tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:29.477145 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-62e39bce-39d8-4f70-9ed4-a5625a99b39a tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:19:29.485291 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-62e39bce-39d8-4f70-9ed4-a5625a99b39a tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/4b75a0a6-37af-4f71-afcb-c38005dceb11" status: 200 len: 1396 microversion: 2.1 time: 0.163816 Oct 04 21:19:29.485884 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3064/6094] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:19:29 2022] GET /compute/v2.1/servers/4b75a0a6-37af-4f71-afcb-c38005dceb11 => generated 1396 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:19:30.189388 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-cdf8c41c-a4aa-4033-bd90-fd7977823f7f req-3c23da44-4ed2-470e-a602-f5831adb6a29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b75a0a6-37af-4f71-afcb-c38005dceb11", "name": "network-vif-deleted", "tag": "b96b0c57-cc7a-4371-9283-3f2d3f0e0fcf"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:19:30.202198 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-cdf8c41c-a4aa-4033-bd90-fd7977823f7f req-3c23da44-4ed2-470e-a602-f5831adb6a29 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:30.202720 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-cdf8c41c-a4aa-4033-bd90-fd7977823f7f req-3c23da44-4ed2-470e-a602-f5831adb6a29 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:30.203360 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-cdf8c41c-a4aa-4033-bd90-fd7977823f7f req-3c23da44-4ed2-470e-a602-f5831adb6a29 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:30.215379 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-cdf8c41c-a4aa-4033-bd90-fd7977823f7f req-3c23da44-4ed2-470e-a602-f5831adb6a29 service nova] Creating event network-vif-deleted:b96b0c57-cc7a-4371-9283-3f2d3f0e0fcf for instance 4b75a0a6-37af-4f71-afcb-c38005dceb11 on n-h2-854823-8 Oct 04 21:19:30.222177 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-cdf8c41c-a4aa-4033-bd90-fd7977823f7f req-3c23da44-4ed2-470e-a602-f5831adb6a29 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038801 Oct 04 21:19:30.223363 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3031/6095] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:19:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:19:30.508927 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-a08dfa9f-e7f0-478c-855c-f06efc0a6c56 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:30.509670 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-a08dfa9f-e7f0-478c-855c-f06efc0a6c56 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: 4b75a0a6-37af-4f71-afcb-c38005dceb11] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:19:30.517560 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a08dfa9f-e7f0-478c-855c-f06efc0a6c56 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:30.518050 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a08dfa9f-e7f0-478c-855c-f06efc0a6c56 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:30.518524 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a08dfa9f-e7f0-478c-855c-f06efc0a6c56 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:30.519229 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a08dfa9f-e7f0-478c-855c-f06efc0a6c56 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:30.519687 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a08dfa9f-e7f0-478c-855c-f06efc0a6c56 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:30.520116 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a08dfa9f-e7f0-478c-855c-f06efc0a6c56 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:30.583583 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-a08dfa9f-e7f0-478c-855c-f06efc0a6c56 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:19:30.591383 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-a08dfa9f-e7f0-478c-855c-f06efc0a6c56 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/4b75a0a6-37af-4f71-afcb-c38005dceb11" status: 200 len: 1188 microversion: 2.1 time: 0.086659 Oct 04 21:19:30.591957 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3065/6096] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:19:30 2022] GET /compute/v2.1/servers/4b75a0a6-37af-4f71-afcb-c38005dceb11 => generated 1188 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:19:31.613950 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8751588c-490e-48bb-849d-2061cdc33b85 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:31.614685 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-8751588c-490e-48bb-849d-2061cdc33b85 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: 4b75a0a6-37af-4f71-afcb-c38005dceb11] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:19:31.622183 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8751588c-490e-48bb-849d-2061cdc33b85 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:31.622725 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8751588c-490e-48bb-849d-2061cdc33b85 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:31.623162 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8751588c-490e-48bb-849d-2061cdc33b85 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:31.623866 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8751588c-490e-48bb-849d-2061cdc33b85 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:31.624317 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8751588c-490e-48bb-849d-2061cdc33b85 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:31.624927 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8751588c-490e-48bb-849d-2061cdc33b85 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:31.695897 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-8751588c-490e-48bb-849d-2061cdc33b85 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:19:31.705699 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-8751588c-490e-48bb-849d-2061cdc33b85 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/4b75a0a6-37af-4f71-afcb-c38005dceb11" status: 200 len: 1188 microversion: 2.1 time: 0.096016 Oct 04 21:19:31.706566 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3032/6097] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:19:31 2022] GET /compute/v2.1/servers/4b75a0a6-37af-4f71-afcb-c38005dceb11 => generated 1188 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:19:32.729285 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-a90b121c-dc1d-4c28-a94d-9b0b70c18eaf tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:32.730044 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-a90b121c-dc1d-4c28-a94d-9b0b70c18eaf tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: 4b75a0a6-37af-4f71-afcb-c38005dceb11] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:19:32.737687 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a90b121c-dc1d-4c28-a94d-9b0b70c18eaf tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:32.738179 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a90b121c-dc1d-4c28-a94d-9b0b70c18eaf tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:32.738647 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a90b121c-dc1d-4c28-a94d-9b0b70c18eaf tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:32.739350 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a90b121c-dc1d-4c28-a94d-9b0b70c18eaf tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:32.739811 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a90b121c-dc1d-4c28-a94d-9b0b70c18eaf tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:32.740377 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a90b121c-dc1d-4c28-a94d-9b0b70c18eaf tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:32.807203 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-a90b121c-dc1d-4c28-a94d-9b0b70c18eaf tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:19:32.816104 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-a90b121c-dc1d-4c28-a94d-9b0b70c18eaf tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/4b75a0a6-37af-4f71-afcb-c38005dceb11" status: 200 len: 1188 microversion: 2.1 time: 0.090753 Oct 04 21:19:32.816689 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3066/6098] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:19:32 2022] GET /compute/v2.1/servers/4b75a0a6-37af-4f71-afcb-c38005dceb11 => generated 1188 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:19:33.840440 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5cf5b554-eb51-4dd7-89df-f977941387c0 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:33.841090 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-5cf5b554-eb51-4dd7-89df-f977941387c0 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: 4b75a0a6-37af-4f71-afcb-c38005dceb11] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:19:33.845450 n-d-854823-8 devstack@n-api.service[128801]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 21:19:33.845642 n-d-854823-8 devstack@n-api.service[128801]: Tue Oct 4 21:19:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4b75a0a6-37af-4f71-afcb-c38005dceb11 (ip 10.222.0.33) !!! Oct 04 21:19:33.857507 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5cf5b554-eb51-4dd7-89df-f977941387c0 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:33.858011 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5cf5b554-eb51-4dd7-89df-f977941387c0 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:33.858482 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5cf5b554-eb51-4dd7-89df-f977941387c0 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:33.859578 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5cf5b554-eb51-4dd7-89df-f977941387c0 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:33.860021 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5cf5b554-eb51-4dd7-89df-f977941387c0 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:33.860458 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5cf5b554-eb51-4dd7-89df-f977941387c0 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:33.925619 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-5cf5b554-eb51-4dd7-89df-f977941387c0 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:19:33.933871 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5cf5b554-eb51-4dd7-89df-f977941387c0 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/4b75a0a6-37af-4f71-afcb-c38005dceb11" status: 200 len: 1188 microversion: 2.1 time: 0.098619 Oct 04 21:19:33.934590 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3033/6099] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:19:33 2022] GET /compute/v2.1/servers/4b75a0a6-37af-4f71-afcb-c38005dceb11 => generated 1188 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:19:34.959097 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-63d3e39d-6c51-4682-b328-c51b9bc0e520 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:34.959729 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-63d3e39d-6c51-4682-b328-c51b9bc0e520 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: 4b75a0a6-37af-4f71-afcb-c38005dceb11] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:19:34.961934 n-d-854823-8 devstack@n-api.service[128802]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 21:19:34.962160 n-d-854823-8 devstack@n-api.service[128802]: Tue Oct 4 21:19:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4b75a0a6-37af-4f71-afcb-c38005dceb11 (ip 10.222.0.33) !!! Oct 04 21:19:34.971421 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-63d3e39d-6c51-4682-b328-c51b9bc0e520 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:34.972069 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-63d3e39d-6c51-4682-b328-c51b9bc0e520 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:34.972721 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-63d3e39d-6c51-4682-b328-c51b9bc0e520 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:34.973437 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-63d3e39d-6c51-4682-b328-c51b9bc0e520 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:34.973994 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-63d3e39d-6c51-4682-b328-c51b9bc0e520 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:34.974432 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-63d3e39d-6c51-4682-b328-c51b9bc0e520 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:34.990232 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.wsgi [None req-63d3e39d-6c51-4682-b328-c51b9bc0e520 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] HTTP exception thrown: Instance 4b75a0a6-37af-4f71-afcb-c38005dceb11 could not be found. Oct 04 21:19:34.991955 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-63d3e39d-6c51-4682-b328-c51b9bc0e520 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Request method failure captured: Oct 04 21:19:34.991955 n-d-854823-8 devstack@n-api.service[128802]: request: GET /compute/v2.1/servers/4b75a0a6-37af-4f71-afcb-c38005dceb11 HTTP/1.1 Oct 04 21:19:34.991955 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 21:19:34.991955 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 21:19:34.991955 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 21:19:34.991955 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 0 Oct 04 21:19:34.991955 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 21:19:34.991955 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 21:19:34.991955 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 21:19:34.991955 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 21:19:34.991955 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPKMhB36sxHtTwvN5cR_FDx6677Bk3r96uZe9x8RsKj2kP41h8elma4Sfp2Sil3wffnoaQT-coMFt-1I-ubK46x1CIQQbRLJJWc6ISWYT8YHNWLLnEGq51UhoqUKdKybGmNCaSC1unJV9CeCDYPI8cjjYW6_GmoH3684NnCEjfslKtuc Oct 04 21:19:34.991955 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 21:19:34.991955 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 21:19:34.991955 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 21:19:34.991955 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 21:19:34.991955 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 21:19:34.991955 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 21:19:34.991955 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: 0d78e06d720d438a9308ae138902f847 Oct 04 21:19:34.991955 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-TestVolumeBootPattern-1361369473 Oct 04 21:19:34.991955 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 21:19:34.991955 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 21:19:34.991955 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0d78e06d720d438a9308ae138902f847", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0d78e06d720d438a9308ae138902f847"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0d78e06d720d438a9308ae138902f847"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0d78e06d720d438a9308ae138902f847"}]}] Oct 04 21:19:34.991955 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-TestVolumeBootPattern-1361369473 Oct 04 21:19:34.991955 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: 0d78e06d720d438a9308ae138902f847 Oct 04 21:19:34.991955 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-TestVolumeBootPattern-1361369473 Oct 04 21:19:34.991955 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-TestVolumeBootPattern-1361369473-project Oct 04 21:19:34.991955 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 21:19:34.991955 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 21:19:34.991955 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: ad7b0b59fad1429e95591b21e33ccbaa Oct 04 21:19:34.991955 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-TestVolumeBootPattern-1361369473-project Oct 04 21:19:34.991955 n-d-854823-8 devstack@n-api.service[128802]: method: > Oct 04 21:19:34.991955 n-d-854823-8 devstack@n-api.service[128802]: exception: Instance 4b75a0a6-37af-4f71-afcb-c38005dceb11 could not be found. Oct 04 21:19:34.991955 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'id': '4b75a0a6-37af-4f71-afcb-c38005dceb11'} Oct 04 21:19:34.991955 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:19:34.991955 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:19:34.991955 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:19:34.991955 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:19:34.991955 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:19:34.991955 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:19:34.991955 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:19:34.991955 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:19:34.991955 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:19:34.991955 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:19:34.991955 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b75a0a6-37af-4f71-afcb-c38005dceb11 could not be found. Oct 04 21:19:34.991955 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:19:34.991955 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:19:34.991955 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:19:34.991955 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:19:34.991955 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:19:34.991955 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:19:34.991955 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:19:34.991955 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:19:34.991955 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:19:34.991955 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:19:34.991955 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:19:34.991955 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:19:34.991955 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:19:34.991955 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:19:34.991955 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:19:34.991955 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:19:34.991955 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b75a0a6-37af-4f71-afcb-c38005dceb11 could not be found. Oct 04 21:19:34.991955 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:19:34.991955 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:19:34.991955 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:19:34.996683 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:19:34.996683 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:19:34.996683 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:19:34.996683 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:19:34.996683 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:19:34.996683 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b75a0a6-37af-4f71-afcb-c38005dceb11 could not be found. Oct 04 21:19:34.996683 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:19:34.996683 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-63d3e39d-6c51-4682-b328-c51b9bc0e520 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Returning 404 to user: Instance 4b75a0a6-37af-4f71-afcb-c38005dceb11 could not be found. {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:19:34.996683 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-63d3e39d-6c51-4682-b328-c51b9bc0e520 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/4b75a0a6-37af-4f71-afcb-c38005dceb11" status: 404 len: 111 microversion: 2.1 time: 0.040194 Oct 04 21:19:34.996683 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3067/6100] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:19:34 2022] GET /compute/v2.1/servers/4b75a0a6-37af-4f71-afcb-c38005dceb11 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:19:35.991823 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-fa1ce74f-5249-4901-9449-88dc87987d54 tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:35.992636 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-fa1ce74f-5249-4901-9449-88dc87987d54 tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] [instance: a9f76c1f-d6c5-4bb5-b4e3-71dd08a7f92f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:19:35.999054 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fa1ce74f-5249-4901-9449-88dc87987d54 tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:36.000531 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fa1ce74f-5249-4901-9449-88dc87987d54 tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:36.000970 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fa1ce74f-5249-4901-9449-88dc87987d54 tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:36.001692 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fa1ce74f-5249-4901-9449-88dc87987d54 tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:36.002146 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fa1ce74f-5249-4901-9449-88dc87987d54 tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:36.002596 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fa1ce74f-5249-4901-9449-88dc87987d54 tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:36.032396 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-fa1ce74f-5249-4901-9449-88dc87987d54 tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] [instance: a9f76c1f-d6c5-4bb5-b4e3-71dd08a7f92f] Going to try to terminate instance {{(pid=128801) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:19:36.143129 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-fa1ce74f-5249-4901-9449-88dc87987d54 tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] 10.222.0.33 "DELETE /compute/v2.1/servers/a9f76c1f-d6c5-4bb5-b4e3-71dd08a7f92f" status: 204 len: 0 microversion: 2.1 time: 0.275296 Oct 04 21:19:36.147148 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3034/6101] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 21:19:35 2022] DELETE /compute/v2.1/servers/a9f76c1f-d6c5-4bb5-b4e3-71dd08a7f92f => generated 0 bytes in 277 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:19:36.152469 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-66e862c5-bc3f-4e5c-bd3b-5903f3cf3654 tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:36.153255 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-66e862c5-bc3f-4e5c-bd3b-5903f3cf3654 tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] [instance: a9f76c1f-d6c5-4bb5-b4e3-71dd08a7f92f] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:19:36.160905 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-66e862c5-bc3f-4e5c-bd3b-5903f3cf3654 tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:36.161385 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-66e862c5-bc3f-4e5c-bd3b-5903f3cf3654 tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:36.162123 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-66e862c5-bc3f-4e5c-bd3b-5903f3cf3654 tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:36.162871 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-66e862c5-bc3f-4e5c-bd3b-5903f3cf3654 tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:36.163584 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-66e862c5-bc3f-4e5c-bd3b-5903f3cf3654 tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:36.164249 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-66e862c5-bc3f-4e5c-bd3b-5903f3cf3654 tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:36.325214 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-66e862c5-bc3f-4e5c-bd3b-5903f3cf3654 tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a438c7644414fa4be4f0333fb914e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f466d19559425083099ae2d772a6ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:19:36.329311 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:19:36.334800 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-66e862c5-bc3f-4e5c-bd3b-5903f3cf3654 tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f76c1f-d6c5-4bb5-b4e3-71dd08a7f92f" status: 200 len: 1733 microversion: 2.1 time: 0.186293 Oct 04 21:19:36.335385 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3068/6102] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:19:36 2022] GET /compute/v2.1/servers/a9f76c1f-d6c5-4bb5-b4e3-71dd08a7f92f => generated 1733 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:19:37.364956 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5e8e911c-3edc-4b59-8846-2cf0d5b2f8a4 tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:37.365594 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-5e8e911c-3edc-4b59-8846-2cf0d5b2f8a4 tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] [instance: a9f76c1f-d6c5-4bb5-b4e3-71dd08a7f92f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:19:37.372757 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5e8e911c-3edc-4b59-8846-2cf0d5b2f8a4 tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:37.373229 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5e8e911c-3edc-4b59-8846-2cf0d5b2f8a4 tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:37.373670 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5e8e911c-3edc-4b59-8846-2cf0d5b2f8a4 tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:37.374968 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5e8e911c-3edc-4b59-8846-2cf0d5b2f8a4 tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:37.375419 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5e8e911c-3edc-4b59-8846-2cf0d5b2f8a4 tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:37.376027 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5e8e911c-3edc-4b59-8846-2cf0d5b2f8a4 tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:37.520447 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-5e8e911c-3edc-4b59-8846-2cf0d5b2f8a4 tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a438c7644414fa4be4f0333fb914e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f466d19559425083099ae2d772a6ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:19:37.528664 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5e8e911c-3edc-4b59-8846-2cf0d5b2f8a4 tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f76c1f-d6c5-4bb5-b4e3-71dd08a7f92f" status: 200 len: 1733 microversion: 2.1 time: 0.168216 Oct 04 21:19:37.529487 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3035/6103] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:19:37 2022] GET /compute/v2.1/servers/a9f76c1f-d6c5-4bb5-b4e3-71dd08a7f92f => generated 1733 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:19:38.552900 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-a3afe78c-c940-4be8-b819-a00904adbaca tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:38.554178 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-a3afe78c-c940-4be8-b819-a00904adbaca tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] [instance: a9f76c1f-d6c5-4bb5-b4e3-71dd08a7f92f] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:19:38.563277 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:19:38.564959 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a3afe78c-c940-4be8-b819-a00904adbaca tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:38.566632 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a3afe78c-c940-4be8-b819-a00904adbaca tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:38.567703 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a3afe78c-c940-4be8-b819-a00904adbaca tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:38.568697 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a3afe78c-c940-4be8-b819-a00904adbaca tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:38.569172 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a3afe78c-c940-4be8-b819-a00904adbaca tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:38.569616 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a3afe78c-c940-4be8-b819-a00904adbaca tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:38.662013 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-a3afe78c-c940-4be8-b819-a00904adbaca tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a438c7644414fa4be4f0333fb914e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f466d19559425083099ae2d772a6ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:19:38.672064 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-a3afe78c-c940-4be8-b819-a00904adbaca tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f76c1f-d6c5-4bb5-b4e3-71dd08a7f92f" status: 200 len: 1665 microversion: 2.1 time: 0.122681 Oct 04 21:19:38.673242 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3069/6104] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:19:38 2022] GET /compute/v2.1/servers/a9f76c1f-d6c5-4bb5-b4e3-71dd08a7f92f => generated 1665 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:19:38.728689 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-1062ea32-4b36-41d2-a370-bb026b783365 req-d8eb39a3-f46d-42c9-85c2-60a03632531a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9f76c1f-d6c5-4bb5-b4e3-71dd08a7f92f", "name": "network-vif-deleted", "tag": "9b162135-37b2-4e61-bee2-7e7767a4375f"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:19:38.743735 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:19:38.746273 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-1062ea32-4b36-41d2-a370-bb026b783365 req-d8eb39a3-f46d-42c9-85c2-60a03632531a service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:38.747128 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-1062ea32-4b36-41d2-a370-bb026b783365 req-d8eb39a3-f46d-42c9-85c2-60a03632531a service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:38.747686 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-1062ea32-4b36-41d2-a370-bb026b783365 req-d8eb39a3-f46d-42c9-85c2-60a03632531a service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:38.763181 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-1062ea32-4b36-41d2-a370-bb026b783365 req-d8eb39a3-f46d-42c9-85c2-60a03632531a service nova] Creating event network-vif-deleted:9b162135-37b2-4e61-bee2-7e7767a4375f for instance a9f76c1f-d6c5-4bb5-b4e3-71dd08a7f92f on n-h1-854823-8 Oct 04 21:19:38.772153 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-1062ea32-4b36-41d2-a370-bb026b783365 req-d8eb39a3-f46d-42c9-85c2-60a03632531a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047941 Oct 04 21:19:38.773583 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3036/6105] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:19:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:19:39.700266 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-dd42b6df-3b8a-45e2-ba69-e01be492a26d tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:39.701709 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-dd42b6df-3b8a-45e2-ba69-e01be492a26d tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] [instance: a9f76c1f-d6c5-4bb5-b4e3-71dd08a7f92f] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:19:39.711906 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dd42b6df-3b8a-45e2-ba69-e01be492a26d tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:39.712404 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dd42b6df-3b8a-45e2-ba69-e01be492a26d tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:39.713037 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dd42b6df-3b8a-45e2-ba69-e01be492a26d tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:39.713767 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dd42b6df-3b8a-45e2-ba69-e01be492a26d tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:39.714217 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dd42b6df-3b8a-45e2-ba69-e01be492a26d tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:39.714673 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dd42b6df-3b8a-45e2-ba69-e01be492a26d tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:39.732962 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.wsgi [None req-dd42b6df-3b8a-45e2-ba69-e01be492a26d tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] HTTP exception thrown: Instance a9f76c1f-d6c5-4bb5-b4e3-71dd08a7f92f could not be found. Oct 04 21:19:39.735175 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-dd42b6df-3b8a-45e2-ba69-e01be492a26d tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] Request method failure captured: Oct 04 21:19:39.735175 n-d-854823-8 devstack@n-api.service[128802]: request: GET /compute/v2.1/servers/a9f76c1f-d6c5-4bb5-b4e3-71dd08a7f92f HTTP/1.1 Oct 04 21:19:39.735175 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 21:19:39.735175 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 21:19:39.735175 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 21:19:39.735175 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 0 Oct 04 21:19:39.735175 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 21:19:39.735175 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 21:19:39.735175 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 21:19:39.735175 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 21:19:39.735175 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPKIzsfggACAxHaCliQjrYfnMxpj5WmeFE9q9nnRdtx8pR9FQVDQ7JAHr_x2dBP1CagSzBwL4_CYu_U_FuaNx8CHlhWstMkKnUJ_GsdSCMnWsn7AApbFE2sNJ5hm81hC0TLhVW1ObPYEur1FErTVcMQzrLSf16ptbHlXJjHcP9goik8g Oct 04 21:19:39.735175 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 21:19:39.735175 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 21:19:39.735175 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 21:19:39.735175 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 21:19:39.735175 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 21:19:39.735175 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 21:19:39.735175 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: a0f466d19559425083099ae2d772a6ce Oct 04 21:19:39.735175 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-TestServerBasicOps-1237064647 Oct 04 21:19:39.735175 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 21:19:39.735175 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 21:19:39.735175 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a0f466d19559425083099ae2d772a6ce", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a0f466d19559425083099ae2d772a6ce"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a0f466d19559425083099ae2d772a6ce"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a0f466d19559425083099ae2d772a6ce"}]}] Oct 04 21:19:39.735175 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-TestServerBasicOps-1237064647 Oct 04 21:19:39.735175 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: a0f466d19559425083099ae2d772a6ce Oct 04 21:19:39.735175 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-TestServerBasicOps-1237064647 Oct 04 21:19:39.735175 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-TestServerBasicOps-1237064647-project Oct 04 21:19:39.735175 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 21:19:39.735175 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 21:19:39.735175 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: 4a438c7644414fa4be4f0333fb914e58 Oct 04 21:19:39.735175 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-TestServerBasicOps-1237064647-project Oct 04 21:19:39.735175 n-d-854823-8 devstack@n-api.service[128802]: method: > Oct 04 21:19:39.735175 n-d-854823-8 devstack@n-api.service[128802]: exception: Instance a9f76c1f-d6c5-4bb5-b4e3-71dd08a7f92f could not be found. Oct 04 21:19:39.735175 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'id': 'a9f76c1f-d6c5-4bb5-b4e3-71dd08a7f92f'} Oct 04 21:19:39.735175 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:19:39.735175 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:19:39.735175 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:19:39.735175 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:19:39.735175 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:19:39.735175 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:19:39.735175 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:19:39.735175 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:19:39.735175 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:19:39.735175 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:19:39.735175 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a9f76c1f-d6c5-4bb5-b4e3-71dd08a7f92f could not be found. Oct 04 21:19:39.735175 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:19:39.735175 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:19:39.735175 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:19:39.735175 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:19:39.735175 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:19:39.735175 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:19:39.735175 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:19:39.735175 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:19:39.735175 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:19:39.735175 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:19:39.735175 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:19:39.735175 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:19:39.735175 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:19:39.735175 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:19:39.735175 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:19:39.735175 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:19:39.735175 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a9f76c1f-d6c5-4bb5-b4e3-71dd08a7f92f could not be found. Oct 04 21:19:39.735175 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:19:39.735175 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:19:39.735175 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:19:39.740271 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:19:39.740271 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:19:39.740271 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:19:39.740271 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:19:39.740271 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:19:39.740271 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a9f76c1f-d6c5-4bb5-b4e3-71dd08a7f92f could not be found. Oct 04 21:19:39.740271 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:19:39.740271 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-dd42b6df-3b8a-45e2-ba69-e01be492a26d tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] Returning 404 to user: Instance a9f76c1f-d6c5-4bb5-b4e3-71dd08a7f92f could not be found. {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:19:39.740271 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-dd42b6df-3b8a-45e2-ba69-e01be492a26d tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f76c1f-d6c5-4bb5-b4e3-71dd08a7f92f" status: 404 len: 111 microversion: 2.1 time: 0.041271 Oct 04 21:19:39.740954 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3070/6106] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:19:39 2022] GET /compute/v2.1/servers/a9f76c1f-d6c5-4bb5-b4e3-71dd08a7f92f => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:19:40.286020 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-597d4c40-1f8f-4572-8250-c6883b81d062 tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:40.286654 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-597d4c40-1f8f-4572-8250-c6883b81d062 tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] [instance: a9f76c1f-d6c5-4bb5-b4e3-71dd08a7f92f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:19:40.293320 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-597d4c40-1f8f-4572-8250-c6883b81d062 tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:40.293813 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-597d4c40-1f8f-4572-8250-c6883b81d062 tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:40.294251 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-597d4c40-1f8f-4572-8250-c6883b81d062 tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:40.294980 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-597d4c40-1f8f-4572-8250-c6883b81d062 tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:40.295478 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-597d4c40-1f8f-4572-8250-c6883b81d062 tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:40.295862 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-597d4c40-1f8f-4572-8250-c6883b81d062 tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:40.301376 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:19:40.315910 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-597d4c40-1f8f-4572-8250-c6883b81d062 tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] HTTP exception thrown: Instance a9f76c1f-d6c5-4bb5-b4e3-71dd08a7f92f could not be found. Oct 04 21:19:40.317664 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-597d4c40-1f8f-4572-8250-c6883b81d062 tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] Request method failure captured: Oct 04 21:19:40.317664 n-d-854823-8 devstack@n-api.service[128801]: request: DELETE /compute/v2.1/servers/a9f76c1f-d6c5-4bb5-b4e3-71dd08a7f92f HTTP/1.1 Oct 04 21:19:40.317664 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 21:19:40.317664 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 21:19:40.317664 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 21:19:40.317664 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 0 Oct 04 21:19:40.317664 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 21:19:40.317664 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 21:19:40.317664 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 21:19:40.317664 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 21:19:40.317664 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPKIzsfggACAxHaCliQjrYfnMxpj5WmeFE9q9nnRdtx8pR9FQVDQ7JAHr_x2dBP1CagSzBwL4_CYu_U_FuaNx8CHlhWstMkKnUJ_GsdSCMnWsn7AApbFE2sNJ5hm81hC0TLhVW1ObPYEur1FErTVcMQzrLSf16ptbHlXJjHcP9goik8g Oct 04 21:19:40.317664 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 21:19:40.317664 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 21:19:40.317664 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 21:19:40.317664 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 21:19:40.317664 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 21:19:40.317664 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 21:19:40.317664 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: a0f466d19559425083099ae2d772a6ce Oct 04 21:19:40.317664 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-TestServerBasicOps-1237064647 Oct 04 21:19:40.317664 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 21:19:40.317664 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 21:19:40.317664 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a0f466d19559425083099ae2d772a6ce", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a0f466d19559425083099ae2d772a6ce"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a0f466d19559425083099ae2d772a6ce"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a0f466d19559425083099ae2d772a6ce"}]}] Oct 04 21:19:40.317664 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-TestServerBasicOps-1237064647 Oct 04 21:19:40.317664 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: a0f466d19559425083099ae2d772a6ce Oct 04 21:19:40.317664 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-TestServerBasicOps-1237064647 Oct 04 21:19:40.317664 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-TestServerBasicOps-1237064647-project Oct 04 21:19:40.317664 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 21:19:40.317664 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 21:19:40.317664 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: 4a438c7644414fa4be4f0333fb914e58 Oct 04 21:19:40.317664 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-TestServerBasicOps-1237064647-project Oct 04 21:19:40.317664 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 21:19:40.317664 n-d-854823-8 devstack@n-api.service[128801]: exception: Instance a9f76c1f-d6c5-4bb5-b4e3-71dd08a7f92f could not be found. Oct 04 21:19:40.317664 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': 'a9f76c1f-d6c5-4bb5-b4e3-71dd08a7f92f'} Oct 04 21:19:40.317664 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:19:40.317664 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:19:40.317664 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:19:40.317664 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:19:40.317664 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:19:40.317664 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:19:40.317664 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:19:40.317664 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:19:40.317664 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:19:40.317664 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:19:40.317664 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a9f76c1f-d6c5-4bb5-b4e3-71dd08a7f92f could not be found. Oct 04 21:19:40.317664 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:19:40.317664 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:19:40.317664 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:19:40.317664 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:19:40.317664 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:19:40.317664 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:19:40.317664 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:19:40.317664 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:19:40.317664 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:19:40.317664 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:19:40.317664 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 21:19:40.317664 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 21:19:40.317664 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 21:19:40.317664 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 21:19:40.317664 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:19:40.317664 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:19:40.317664 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:19:40.317664 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:19:40.322039 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a9f76c1f-d6c5-4bb5-b4e3-71dd08a7f92f could not be found. Oct 04 21:19:40.322039 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:19:40.322039 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:19:40.322039 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:19:40.322039 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:19:40.322039 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:19:40.322039 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:19:40.322039 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:19:40.322039 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:19:40.322039 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a9f76c1f-d6c5-4bb5-b4e3-71dd08a7f92f could not be found. Oct 04 21:19:40.322039 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:19:40.322039 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-597d4c40-1f8f-4572-8250-c6883b81d062 tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] Returning 404 to user: Instance a9f76c1f-d6c5-4bb5-b4e3-71dd08a7f92f could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:19:40.322039 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-597d4c40-1f8f-4572-8250-c6883b81d062 tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] 10.222.0.33 "DELETE /compute/v2.1/servers/a9f76c1f-d6c5-4bb5-b4e3-71dd08a7f92f" status: 404 len: 111 microversion: 2.1 time: 0.040298 Oct 04 21:19:40.324124 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3037/6107] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 21:19:40 2022] DELETE /compute/v2.1/servers/a9f76c1f-d6c5-4bb5-b4e3-71dd08a7f92f => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:19:40.328244 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-898ee92d-2311-4fc1-9bf0-d6e3c8feb401 tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:40.328939 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-898ee92d-2311-4fc1-9bf0-d6e3c8feb401 tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] [instance: a9f76c1f-d6c5-4bb5-b4e3-71dd08a7f92f] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:19:40.335261 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-898ee92d-2311-4fc1-9bf0-d6e3c8feb401 tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:40.335747 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-898ee92d-2311-4fc1-9bf0-d6e3c8feb401 tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:40.336178 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-898ee92d-2311-4fc1-9bf0-d6e3c8feb401 tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:40.336875 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-898ee92d-2311-4fc1-9bf0-d6e3c8feb401 tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:19:40.337327 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-898ee92d-2311-4fc1-9bf0-d6e3c8feb401 tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:19:40.337756 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-898ee92d-2311-4fc1-9bf0-d6e3c8feb401 tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:19:40.352878 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.wsgi [None req-898ee92d-2311-4fc1-9bf0-d6e3c8feb401 tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] HTTP exception thrown: Instance a9f76c1f-d6c5-4bb5-b4e3-71dd08a7f92f could not be found. Oct 04 21:19:40.354476 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-898ee92d-2311-4fc1-9bf0-d6e3c8feb401 tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] Request method failure captured: Oct 04 21:19:40.354476 n-d-854823-8 devstack@n-api.service[128802]: request: GET /compute/v2.1/servers/a9f76c1f-d6c5-4bb5-b4e3-71dd08a7f92f HTTP/1.1 Oct 04 21:19:40.354476 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 21:19:40.354476 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 21:19:40.354476 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 21:19:40.354476 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 0 Oct 04 21:19:40.354476 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 21:19:40.354476 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 21:19:40.354476 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 21:19:40.354476 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 21:19:40.354476 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPKIzsfggACAxHaCliQjrYfnMxpj5WmeFE9q9nnRdtx8pR9FQVDQ7JAHr_x2dBP1CagSzBwL4_CYu_U_FuaNx8CHlhWstMkKnUJ_GsdSCMnWsn7AApbFE2sNJ5hm81hC0TLhVW1ObPYEur1FErTVcMQzrLSf16ptbHlXJjHcP9goik8g Oct 04 21:19:40.354476 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 21:19:40.354476 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 21:19:40.354476 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 21:19:40.354476 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 21:19:40.354476 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 21:19:40.354476 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 21:19:40.354476 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: a0f466d19559425083099ae2d772a6ce Oct 04 21:19:40.354476 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-TestServerBasicOps-1237064647 Oct 04 21:19:40.354476 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 21:19:40.354476 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 21:19:40.354476 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a0f466d19559425083099ae2d772a6ce", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a0f466d19559425083099ae2d772a6ce"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a0f466d19559425083099ae2d772a6ce"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a0f466d19559425083099ae2d772a6ce"}]}] Oct 04 21:19:40.354476 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-TestServerBasicOps-1237064647 Oct 04 21:19:40.354476 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: a0f466d19559425083099ae2d772a6ce Oct 04 21:19:40.354476 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-TestServerBasicOps-1237064647 Oct 04 21:19:40.354476 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-TestServerBasicOps-1237064647-project Oct 04 21:19:40.354476 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 21:19:40.354476 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 21:19:40.354476 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: 4a438c7644414fa4be4f0333fb914e58 Oct 04 21:19:40.354476 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-TestServerBasicOps-1237064647-project Oct 04 21:19:40.354476 n-d-854823-8 devstack@n-api.service[128802]: method: > Oct 04 21:19:40.354476 n-d-854823-8 devstack@n-api.service[128802]: exception: Instance a9f76c1f-d6c5-4bb5-b4e3-71dd08a7f92f could not be found. Oct 04 21:19:40.354476 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'id': 'a9f76c1f-d6c5-4bb5-b4e3-71dd08a7f92f'} Oct 04 21:19:40.354476 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:19:40.354476 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:19:40.354476 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:19:40.354476 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:19:40.354476 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:19:40.354476 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:19:40.354476 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:19:40.354476 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:19:40.354476 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:19:40.354476 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:19:40.354476 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a9f76c1f-d6c5-4bb5-b4e3-71dd08a7f92f could not be found. Oct 04 21:19:40.354476 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:19:40.354476 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:19:40.354476 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:19:40.354476 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:19:40.354476 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:19:40.354476 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:19:40.354476 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:19:40.354476 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:19:40.354476 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:19:40.354476 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:19:40.354476 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:19:40.354476 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:19:40.354476 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:19:40.354476 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:19:40.354476 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:19:40.354476 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:19:40.354476 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a9f76c1f-d6c5-4bb5-b4e3-71dd08a7f92f could not be found. Oct 04 21:19:40.354476 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:19:40.354476 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:19:40.354476 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:19:40.360319 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:19:40.360319 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:19:40.360319 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:19:40.360319 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:19:40.360319 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:19:40.360319 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a9f76c1f-d6c5-4bb5-b4e3-71dd08a7f92f could not be found. Oct 04 21:19:40.360319 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:19:40.360319 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-898ee92d-2311-4fc1-9bf0-d6e3c8feb401 tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] Returning 404 to user: Instance a9f76c1f-d6c5-4bb5-b4e3-71dd08a7f92f could not be found. {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:19:40.360319 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-898ee92d-2311-4fc1-9bf0-d6e3c8feb401 tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f76c1f-d6c5-4bb5-b4e3-71dd08a7f92f" status: 404 len: 111 microversion: 2.1 time: 0.031703 Oct 04 21:19:40.360319 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3071/6108] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:19:40 2022] GET /compute/v2.1/servers/a9f76c1f-d6c5-4bb5-b4e3-71dd08a7f92f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:19:40.533664 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-bfab3266-4659-41e8-a64f-4cb26e33b047 tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] Calling method '.version_select at 0x7f3c6f2eb1f0>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:19:40.567305 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-bfab3266-4659-41e8-a64f-4cb26e33b047 tempest-TestServerBasicOps-1237064647 tempest-TestServerBasicOps-1237064647-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-1029091984" status: 202 len: 0 microversion: 2.1 time: 0.037637 Oct 04 21:19:40.568179 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3038/6109] 10.222.0.33 () {58 vars in 1254 bytes} [Tue Oct 4 21:19:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-1029091984 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 21:19:59.924568 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-b6b67b77-bdb1-42ed-bccb-c74e415c3366 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1958761087", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "9a6a2693-def5-4cfa-91da-cbe136fb1f17", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "975b1130-f216-463e-808d-0d3403b17918"}]}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:19:59.952709 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_api:SELECT=5 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:19:59.954314 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=10 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:20:00.055165 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.network.neutron [None req-b6b67b77-bdb1-42ed-bccb-c74e415c3366 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] validate_networks() for [('975b1130-f216-463e-808d-0d3403b17918', None, None, None, None, None)] {{(pid=128802) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:20:00.572940 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-b6b67b77-bdb1-42ed-bccb-c74e415c3366 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Flavor limits 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:20:00.573364 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-b6b67b77-bdb1-42ed-bccb-c74e415c3366 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Image limits 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:20:00.573845 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-b6b67b77-bdb1-42ed-bccb-c74e415c3366 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Flavor pref 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:20:00.574259 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-b6b67b77-bdb1-42ed-bccb-c74e415c3366 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Image pref 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:20:00.575069 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-b6b67b77-bdb1-42ed-bccb-c74e415c3366 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:20:00.587202 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b6b67b77-bdb1-42ed-bccb-c74e415c3366 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:00.587700 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b6b67b77-bdb1-42ed-bccb-c74e415c3366 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:00.588468 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b6b67b77-bdb1-42ed-bccb-c74e415c3366 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:00.588875 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b6b67b77-bdb1-42ed-bccb-c74e415c3366 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:00.589504 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b6b67b77-bdb1-42ed-bccb-c74e415c3366 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:00.590099 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b6b67b77-bdb1-42ed-bccb-c74e415c3366 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:00.620266 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-b6b67b77-bdb1-42ed-bccb-c74e415c3366 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Getting quotas for project 0d78e06d720d438a9308ae138902f847. Resources: {'ram', 'instances', 'cores'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:20:00.627891 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-b6b67b77-bdb1-42ed-bccb-c74e415c3366 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Getting quotas for user ad7b0b59fad1429e95591b21e33ccbaa and project 0d78e06d720d438a9308ae138902f847. Resources: {'ram', 'instances', 'cores'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:20:00.644160 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-b6b67b77-bdb1-42ed-bccb-c74e415c3366 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Going to run 1 instances... {{(pid=128802) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:20:00.646760 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-b6b67b77-bdb1-42ed-bccb-c74e415c3366 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: f00182c9-26da-4727-94f7-516d38353510] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='9a6a2693-def5-4cfa-91da-cbe136fb1f17',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128802) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:20:00.753596 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-b6b67b77-bdb1-42ed-bccb-c74e415c3366 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.833380 Oct 04 21:20:00.754275 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3072/6110] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 21:19:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 835 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:20:00.770641 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:20:00.771928 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=6,nova_api:DELETE=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:20:00.776213 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-252180da-b61b-48b5-a4d9-d1551c472a25 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:20:00.782193 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-252180da-b61b-48b5-a4d9-d1551c472a25 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: f00182c9-26da-4727-94f7-516d38353510] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:20:00.869035 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-252180da-b61b-48b5-a4d9-d1551c472a25 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:00.879572 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-252180da-b61b-48b5-a4d9-d1551c472a25 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/f00182c9-26da-4727-94f7-516d38353510" status: 200 len: 1057 microversion: 2.1 time: 0.113563 Oct 04 21:20:00.880173 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3039/6111] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:20:00 2022] GET /compute/v2.1/servers/f00182c9-26da-4727-94f7-516d38353510 => generated 1057 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:20:01.935871 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-26ebe851-db34-4273-aecf-d6d8355ffe9c tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:20:01.936564 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-26ebe851-db34-4273-aecf-d6d8355ffe9c tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: f00182c9-26da-4727-94f7-516d38353510] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:20:01.965414 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-26ebe851-db34-4273-aecf-d6d8355ffe9c tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:01.965926 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-26ebe851-db34-4273-aecf-d6d8355ffe9c tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:01.966381 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-26ebe851-db34-4273-aecf-d6d8355ffe9c tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:01.967682 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-26ebe851-db34-4273-aecf-d6d8355ffe9c tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:01.968257 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-26ebe851-db34-4273-aecf-d6d8355ffe9c tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:01.969173 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-26ebe851-db34-4273-aecf-d6d8355ffe9c tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:02.067102 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-26ebe851-db34-4273-aecf-d6d8355ffe9c tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:02.078401 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-26ebe851-db34-4273-aecf-d6d8355ffe9c tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/f00182c9-26da-4727-94f7-516d38353510" status: 200 len: 1109 microversion: 2.1 time: 0.177038 Oct 04 21:20:02.087881 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3073/6112] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:20:01 2022] GET /compute/v2.1/servers/f00182c9-26da-4727-94f7-516d38353510 => generated 1109 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:20:03.101228 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d45cf0ac-de0f-4f33-ac2b-5df20327760f tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:20:03.101860 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d45cf0ac-de0f-4f33-ac2b-5df20327760f tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: f00182c9-26da-4727-94f7-516d38353510] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:20:03.111968 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d45cf0ac-de0f-4f33-ac2b-5df20327760f tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:03.112811 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d45cf0ac-de0f-4f33-ac2b-5df20327760f tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:03.113322 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d45cf0ac-de0f-4f33-ac2b-5df20327760f tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:03.114151 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d45cf0ac-de0f-4f33-ac2b-5df20327760f tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:03.114711 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d45cf0ac-de0f-4f33-ac2b-5df20327760f tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:03.115201 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d45cf0ac-de0f-4f33-ac2b-5df20327760f tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:03.421575 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d45cf0ac-de0f-4f33-ac2b-5df20327760f tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:03.429996 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d45cf0ac-de0f-4f33-ac2b-5df20327760f tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/f00182c9-26da-4727-94f7-516d38353510" status: 200 len: 1169 microversion: 2.1 time: 0.332566 Oct 04 21:20:03.430654 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3040/6113] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:20:03 2022] GET /compute/v2.1/servers/f00182c9-26da-4727-94f7-516d38353510 => generated 1169 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:20:04.216055 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-c468a461-6145-46ec-9a1b-ba5f24a6a51e req-27379b80-24db-4d37-8492-459fc25faefd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f00182c9-26da-4727-94f7-516d38353510", "tag": "d91dccaa-606f-476d-8819-1eb522e773bb"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:20:04.240636 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-c468a461-6145-46ec-9a1b-ba5f24a6a51e req-27379b80-24db-4d37-8492-459fc25faefd service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:04.242206 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-c468a461-6145-46ec-9a1b-ba5f24a6a51e req-27379b80-24db-4d37-8492-459fc25faefd service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:04.242961 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-c468a461-6145-46ec-9a1b-ba5f24a6a51e req-27379b80-24db-4d37-8492-459fc25faefd service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:04.260370 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-c468a461-6145-46ec-9a1b-ba5f24a6a51e req-27379b80-24db-4d37-8492-459fc25faefd service nova] Creating event network-changed:d91dccaa-606f-476d-8819-1eb522e773bb for instance f00182c9-26da-4727-94f7-516d38353510 on n-h2-854823-8 Oct 04 21:20:04.268433 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-c468a461-6145-46ec-9a1b-ba5f24a6a51e req-27379b80-24db-4d37-8492-459fc25faefd service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056082 Oct 04 21:20:04.270301 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3074/6114] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:20:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:20:04.457586 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d1deefb7-65f4-43c6-bd5a-36aa9d1d1972 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:20:04.459047 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d1deefb7-65f4-43c6-bd5a-36aa9d1d1972 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: f00182c9-26da-4727-94f7-516d38353510] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:20:04.474207 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d1deefb7-65f4-43c6-bd5a-36aa9d1d1972 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:04.475481 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d1deefb7-65f4-43c6-bd5a-36aa9d1d1972 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:04.476842 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d1deefb7-65f4-43c6-bd5a-36aa9d1d1972 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:04.478428 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d1deefb7-65f4-43c6-bd5a-36aa9d1d1972 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:04.479418 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d1deefb7-65f4-43c6-bd5a-36aa9d1d1972 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:04.480278 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d1deefb7-65f4-43c6-bd5a-36aa9d1d1972 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:04.762674 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d1deefb7-65f4-43c6-bd5a-36aa9d1d1972 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:04.774723 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d1deefb7-65f4-43c6-bd5a-36aa9d1d1972 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/f00182c9-26da-4727-94f7-516d38353510" status: 200 len: 1169 microversion: 2.1 time: 0.321170 Oct 04 21:20:04.777548 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3041/6115] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:20:04 2022] GET /compute/v2.1/servers/f00182c9-26da-4727-94f7-516d38353510 => generated 1169 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:20:05.800445 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-dcd5ab04-84d8-45ca-a80c-05abcf444098 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:20:05.801313 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-dcd5ab04-84d8-45ca-a80c-05abcf444098 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: f00182c9-26da-4727-94f7-516d38353510] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:20:05.808515 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dcd5ab04-84d8-45ca-a80c-05abcf444098 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:05.809004 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dcd5ab04-84d8-45ca-a80c-05abcf444098 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:05.809631 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dcd5ab04-84d8-45ca-a80c-05abcf444098 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:05.810572 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dcd5ab04-84d8-45ca-a80c-05abcf444098 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:05.813021 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dcd5ab04-84d8-45ca-a80c-05abcf444098 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:05.813750 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dcd5ab04-84d8-45ca-a80c-05abcf444098 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:06.029271 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-dcd5ab04-84d8-45ca-a80c-05abcf444098 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:06.041822 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-dcd5ab04-84d8-45ca-a80c-05abcf444098 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/f00182c9-26da-4727-94f7-516d38353510" status: 200 len: 1169 microversion: 2.1 time: 0.248326 Oct 04 21:20:06.054370 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3075/6116] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:20:05 2022] GET /compute/v2.1/servers/f00182c9-26da-4727-94f7-516d38353510 => generated 1169 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:20:07.069280 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1d177bea-3138-45c7-a037-acd834f1e617 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:20:07.071254 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-1d177bea-3138-45c7-a037-acd834f1e617 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: f00182c9-26da-4727-94f7-516d38353510] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:20:07.082758 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1d177bea-3138-45c7-a037-acd834f1e617 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:07.083694 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1d177bea-3138-45c7-a037-acd834f1e617 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:07.085126 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1d177bea-3138-45c7-a037-acd834f1e617 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:07.086026 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1d177bea-3138-45c7-a037-acd834f1e617 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:07.087003 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1d177bea-3138-45c7-a037-acd834f1e617 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:07.089290 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1d177bea-3138-45c7-a037-acd834f1e617 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:07.362695 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-1d177bea-3138-45c7-a037-acd834f1e617 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:07.375941 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-1d177bea-3138-45c7-a037-acd834f1e617 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/f00182c9-26da-4727-94f7-516d38353510" status: 200 len: 1169 microversion: 2.1 time: 0.312024 Oct 04 21:20:07.391761 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3042/6117] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:20:07 2022] GET /compute/v2.1/servers/f00182c9-26da-4727-94f7-516d38353510 => generated 1169 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:20:08.404081 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-cdf3d282-5002-48c9-beb0-f407c6f74e2d tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:20:08.404756 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-cdf3d282-5002-48c9-beb0-f407c6f74e2d tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: f00182c9-26da-4727-94f7-516d38353510] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:20:08.413422 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cdf3d282-5002-48c9-beb0-f407c6f74e2d tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:08.413917 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cdf3d282-5002-48c9-beb0-f407c6f74e2d tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:08.414378 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cdf3d282-5002-48c9-beb0-f407c6f74e2d tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:08.415100 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cdf3d282-5002-48c9-beb0-f407c6f74e2d tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:08.415562 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cdf3d282-5002-48c9-beb0-f407c6f74e2d tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:08.415993 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cdf3d282-5002-48c9-beb0-f407c6f74e2d tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:08.629398 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-cdf3d282-5002-48c9-beb0-f407c6f74e2d tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:08.640980 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-cdf3d282-5002-48c9-beb0-f407c6f74e2d tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/f00182c9-26da-4727-94f7-516d38353510" status: 200 len: 1169 microversion: 2.1 time: 0.241712 Oct 04 21:20:08.655612 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3076/6118] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:20:08 2022] GET /compute/v2.1/servers/f00182c9-26da-4727-94f7-516d38353510 => generated 1169 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:20:09.675717 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8bbc0872-91f7-495a-9d7b-9d09f0dc0f07 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:20:09.676959 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-8bbc0872-91f7-495a-9d7b-9d09f0dc0f07 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: f00182c9-26da-4727-94f7-516d38353510] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:20:09.687287 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8bbc0872-91f7-495a-9d7b-9d09f0dc0f07 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:09.687878 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8bbc0872-91f7-495a-9d7b-9d09f0dc0f07 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:09.688396 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8bbc0872-91f7-495a-9d7b-9d09f0dc0f07 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:09.689202 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8bbc0872-91f7-495a-9d7b-9d09f0dc0f07 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:09.690020 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8bbc0872-91f7-495a-9d7b-9d09f0dc0f07 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:09.690603 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8bbc0872-91f7-495a-9d7b-9d09f0dc0f07 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:09.882713 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-8bbc0872-91f7-495a-9d7b-9d09f0dc0f07 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:09.897775 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-8bbc0872-91f7-495a-9d7b-9d09f0dc0f07 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/f00182c9-26da-4727-94f7-516d38353510" status: 200 len: 1169 microversion: 2.1 time: 0.228284 Oct 04 21:20:09.898430 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3043/6119] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:20:09 2022] GET /compute/v2.1/servers/f00182c9-26da-4727-94f7-516d38353510 => generated 1169 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:20:10.928588 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-fdfc641a-a1a9-47f5-8e5f-1d90d000cafb tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:20:10.930094 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-fdfc641a-a1a9-47f5-8e5f-1d90d000cafb tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: f00182c9-26da-4727-94f7-516d38353510] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:20:10.937745 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell0:SELECT=2 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:20:10.938618 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell0:SELECT=6 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:20:10.940701 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fdfc641a-a1a9-47f5-8e5f-1d90d000cafb tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:10.941495 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fdfc641a-a1a9-47f5-8e5f-1d90d000cafb tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:10.942287 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fdfc641a-a1a9-47f5-8e5f-1d90d000cafb tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:10.943525 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fdfc641a-a1a9-47f5-8e5f-1d90d000cafb tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:10.944224 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fdfc641a-a1a9-47f5-8e5f-1d90d000cafb tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:10.945263 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fdfc641a-a1a9-47f5-8e5f-1d90d000cafb tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:11.158125 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-fdfc641a-a1a9-47f5-8e5f-1d90d000cafb tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:11.168418 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-fdfc641a-a1a9-47f5-8e5f-1d90d000cafb tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/f00182c9-26da-4727-94f7-516d38353510" status: 200 len: 1169 microversion: 2.1 time: 0.244652 Oct 04 21:20:11.169104 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3077/6120] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:20:10 2022] GET /compute/v2.1/servers/f00182c9-26da-4727-94f7-516d38353510 => generated 1169 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:20:12.193500 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-21c0ba41-a6e0-487f-8c01-3d43f817caa7 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:20:12.194126 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-21c0ba41-a6e0-487f-8c01-3d43f817caa7 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: f00182c9-26da-4727-94f7-516d38353510] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:20:12.197119 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:20:12.203421 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-21c0ba41-a6e0-487f-8c01-3d43f817caa7 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:12.203924 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-21c0ba41-a6e0-487f-8c01-3d43f817caa7 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:12.204358 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-21c0ba41-a6e0-487f-8c01-3d43f817caa7 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:12.205138 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-21c0ba41-a6e0-487f-8c01-3d43f817caa7 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:12.205594 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-21c0ba41-a6e0-487f-8c01-3d43f817caa7 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:12.206021 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-21c0ba41-a6e0-487f-8c01-3d43f817caa7 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:12.345580 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-21c0ba41-a6e0-487f-8c01-3d43f817caa7 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:12.353826 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-21c0ba41-a6e0-487f-8c01-3d43f817caa7 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/f00182c9-26da-4727-94f7-516d38353510" status: 200 len: 1169 microversion: 2.1 time: 0.164525 Oct 04 21:20:12.354532 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3044/6121] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:20:12 2022] GET /compute/v2.1/servers/f00182c9-26da-4727-94f7-516d38353510 => generated 1169 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:20:13.378947 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-2c262511-68a1-4b52-b46d-2e955b6a4ea3 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:20:13.379514 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-2c262511-68a1-4b52-b46d-2e955b6a4ea3 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: f00182c9-26da-4727-94f7-516d38353510] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:20:13.386522 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2c262511-68a1-4b52-b46d-2e955b6a4ea3 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:13.387092 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2c262511-68a1-4b52-b46d-2e955b6a4ea3 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:13.387615 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2c262511-68a1-4b52-b46d-2e955b6a4ea3 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:13.388384 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2c262511-68a1-4b52-b46d-2e955b6a4ea3 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:13.388910 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2c262511-68a1-4b52-b46d-2e955b6a4ea3 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:13.389505 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2c262511-68a1-4b52-b46d-2e955b6a4ea3 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:13.544475 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-2c262511-68a1-4b52-b46d-2e955b6a4ea3 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:13.552439 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-2c262511-68a1-4b52-b46d-2e955b6a4ea3 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/f00182c9-26da-4727-94f7-516d38353510" status: 200 len: 1169 microversion: 2.1 time: 0.177404 Oct 04 21:20:13.553024 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3078/6122] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:20:13 2022] GET /compute/v2.1/servers/f00182c9-26da-4727-94f7-516d38353510 => generated 1169 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:20:14.575482 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c6a71ff5-4065-42a8-9c4f-ab21bc8d39a3 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:20:14.576343 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c6a71ff5-4065-42a8-9c4f-ab21bc8d39a3 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: f00182c9-26da-4727-94f7-516d38353510] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:20:14.583149 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c6a71ff5-4065-42a8-9c4f-ab21bc8d39a3 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:14.583645 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c6a71ff5-4065-42a8-9c4f-ab21bc8d39a3 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:14.584082 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c6a71ff5-4065-42a8-9c4f-ab21bc8d39a3 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:14.584778 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c6a71ff5-4065-42a8-9c4f-ab21bc8d39a3 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:14.585240 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c6a71ff5-4065-42a8-9c4f-ab21bc8d39a3 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:14.585670 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c6a71ff5-4065-42a8-9c4f-ab21bc8d39a3 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:14.783647 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c6a71ff5-4065-42a8-9c4f-ab21bc8d39a3 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:14.792430 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c6a71ff5-4065-42a8-9c4f-ab21bc8d39a3 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/f00182c9-26da-4727-94f7-516d38353510" status: 200 len: 1169 microversion: 2.1 time: 0.220943 Oct 04 21:20:14.793027 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3045/6123] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:20:14 2022] GET /compute/v2.1/servers/f00182c9-26da-4727-94f7-516d38353510 => generated 1169 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:20:15.823541 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-60786d9d-0089-4782-b73e-4c052b5bc1fa tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:20:15.824258 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-60786d9d-0089-4782-b73e-4c052b5bc1fa tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: f00182c9-26da-4727-94f7-516d38353510] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:20:15.833223 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-60786d9d-0089-4782-b73e-4c052b5bc1fa tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:15.834105 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-60786d9d-0089-4782-b73e-4c052b5bc1fa tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:15.834707 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-60786d9d-0089-4782-b73e-4c052b5bc1fa tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:15.835636 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-60786d9d-0089-4782-b73e-4c052b5bc1fa tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:15.836915 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-60786d9d-0089-4782-b73e-4c052b5bc1fa tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:15.837455 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-60786d9d-0089-4782-b73e-4c052b5bc1fa tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:15.985759 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-60786d9d-0089-4782-b73e-4c052b5bc1fa tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:15.994667 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-60786d9d-0089-4782-b73e-4c052b5bc1fa tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/f00182c9-26da-4727-94f7-516d38353510" status: 200 len: 1169 microversion: 2.1 time: 0.175402 Oct 04 21:20:15.995277 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3079/6124] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:20:15 2022] GET /compute/v2.1/servers/f00182c9-26da-4727-94f7-516d38353510 => generated 1169 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:20:17.020650 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-fab18594-a205-4585-9595-b1b6af9a1441 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:20:17.022792 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-fab18594-a205-4585-9595-b1b6af9a1441 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: f00182c9-26da-4727-94f7-516d38353510] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:20:17.031763 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fab18594-a205-4585-9595-b1b6af9a1441 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:17.032799 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fab18594-a205-4585-9595-b1b6af9a1441 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:17.033409 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fab18594-a205-4585-9595-b1b6af9a1441 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:17.034279 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fab18594-a205-4585-9595-b1b6af9a1441 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:17.035027 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fab18594-a205-4585-9595-b1b6af9a1441 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:17.035641 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fab18594-a205-4585-9595-b1b6af9a1441 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:17.211353 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-fab18594-a205-4585-9595-b1b6af9a1441 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:17.221378 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-fab18594-a205-4585-9595-b1b6af9a1441 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/f00182c9-26da-4727-94f7-516d38353510" status: 200 len: 1169 microversion: 2.1 time: 0.206147 Oct 04 21:20:17.238817 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3046/6125] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:20:17 2022] GET /compute/v2.1/servers/f00182c9-26da-4727-94f7-516d38353510 => generated 1169 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:20:18.245520 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-9ae028d7-c4b8-45d7-abc2-f356cd1e6462 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:20:18.246109 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-9ae028d7-c4b8-45d7-abc2-f356cd1e6462 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: f00182c9-26da-4727-94f7-516d38353510] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:20:18.252802 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9ae028d7-c4b8-45d7-abc2-f356cd1e6462 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:18.253235 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9ae028d7-c4b8-45d7-abc2-f356cd1e6462 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:18.253674 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9ae028d7-c4b8-45d7-abc2-f356cd1e6462 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:18.254402 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9ae028d7-c4b8-45d7-abc2-f356cd1e6462 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:18.254865 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9ae028d7-c4b8-45d7-abc2-f356cd1e6462 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:18.255297 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9ae028d7-c4b8-45d7-abc2-f356cd1e6462 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:18.389844 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-9ae028d7-c4b8-45d7-abc2-f356cd1e6462 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:18.399386 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-9ae028d7-c4b8-45d7-abc2-f356cd1e6462 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/f00182c9-26da-4727-94f7-516d38353510" status: 200 len: 1169 microversion: 2.1 time: 0.158056 Oct 04 21:20:18.399983 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3080/6126] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:20:18 2022] GET /compute/v2.1/servers/f00182c9-26da-4727-94f7-516d38353510 => generated 1169 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:20:19.427245 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5da2e7c8-54b6-485c-9b2b-7e2adfaea639 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:20:19.427856 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-5da2e7c8-54b6-485c-9b2b-7e2adfaea639 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: f00182c9-26da-4727-94f7-516d38353510] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:20:19.436177 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5da2e7c8-54b6-485c-9b2b-7e2adfaea639 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:19.436782 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5da2e7c8-54b6-485c-9b2b-7e2adfaea639 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:19.440072 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5da2e7c8-54b6-485c-9b2b-7e2adfaea639 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:19.441371 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5da2e7c8-54b6-485c-9b2b-7e2adfaea639 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:19.442067 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5da2e7c8-54b6-485c-9b2b-7e2adfaea639 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:19.442803 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5da2e7c8-54b6-485c-9b2b-7e2adfaea639 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:19.604759 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-5da2e7c8-54b6-485c-9b2b-7e2adfaea639 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:19.612762 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5da2e7c8-54b6-485c-9b2b-7e2adfaea639 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/f00182c9-26da-4727-94f7-516d38353510" status: 200 len: 1169 microversion: 2.1 time: 0.189380 Oct 04 21:20:19.613350 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3047/6127] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:20:19 2022] GET /compute/v2.1/servers/f00182c9-26da-4727-94f7-516d38353510 => generated 1169 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:20:20.635572 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-2f8cbc2f-edcf-47b2-a866-d6cdbef6c170 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:20:20.636109 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-2f8cbc2f-edcf-47b2-a866-d6cdbef6c170 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: f00182c9-26da-4727-94f7-516d38353510] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:20:20.643636 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2f8cbc2f-edcf-47b2-a866-d6cdbef6c170 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:20.644118 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2f8cbc2f-edcf-47b2-a866-d6cdbef6c170 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:20.644556 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2f8cbc2f-edcf-47b2-a866-d6cdbef6c170 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:20.645246 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2f8cbc2f-edcf-47b2-a866-d6cdbef6c170 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:20.645697 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2f8cbc2f-edcf-47b2-a866-d6cdbef6c170 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:20.646118 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2f8cbc2f-edcf-47b2-a866-d6cdbef6c170 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:20.779080 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-2f8cbc2f-edcf-47b2-a866-d6cdbef6c170 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:20.786951 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-2f8cbc2f-edcf-47b2-a866-d6cdbef6c170 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/f00182c9-26da-4727-94f7-516d38353510" status: 200 len: 1203 microversion: 2.1 time: 0.155453 Oct 04 21:20:20.787528 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3081/6128] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:20:20 2022] GET /compute/v2.1/servers/f00182c9-26da-4727-94f7-516d38353510 => generated 1203 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:20:21.809390 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6d267fa1-78d1-4221-add1-74a47cf88155 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:20:21.809932 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-6d267fa1-78d1-4221-add1-74a47cf88155 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: f00182c9-26da-4727-94f7-516d38353510] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:20:21.817553 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6d267fa1-78d1-4221-add1-74a47cf88155 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:21.818049 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6d267fa1-78d1-4221-add1-74a47cf88155 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:21.818521 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6d267fa1-78d1-4221-add1-74a47cf88155 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:21.819231 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6d267fa1-78d1-4221-add1-74a47cf88155 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:21.819689 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6d267fa1-78d1-4221-add1-74a47cf88155 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:21.820121 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6d267fa1-78d1-4221-add1-74a47cf88155 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:21.957784 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-6d267fa1-78d1-4221-add1-74a47cf88155 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:21.966390 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-6d267fa1-78d1-4221-add1-74a47cf88155 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/f00182c9-26da-4727-94f7-516d38353510" status: 200 len: 1203 microversion: 2.1 time: 0.160897 Oct 04 21:20:21.967674 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3048/6129] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:20:21 2022] GET /compute/v2.1/servers/f00182c9-26da-4727-94f7-516d38353510 => generated 1203 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:20:22.992231 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-0175fa22-4d2f-4495-b15a-aa64e8564c57 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:20:22.992789 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-0175fa22-4d2f-4495-b15a-aa64e8564c57 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: f00182c9-26da-4727-94f7-516d38353510] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:20:22.999878 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0175fa22-4d2f-4495-b15a-aa64e8564c57 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:23.000358 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0175fa22-4d2f-4495-b15a-aa64e8564c57 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:23.000789 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0175fa22-4d2f-4495-b15a-aa64e8564c57 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:23.001479 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0175fa22-4d2f-4495-b15a-aa64e8564c57 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:23.001930 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0175fa22-4d2f-4495-b15a-aa64e8564c57 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:23.002376 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0175fa22-4d2f-4495-b15a-aa64e8564c57 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:23.142928 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-0175fa22-4d2f-4495-b15a-aa64e8564c57 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:23.150893 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-0175fa22-4d2f-4495-b15a-aa64e8564c57 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/f00182c9-26da-4727-94f7-516d38353510" status: 200 len: 1203 microversion: 2.1 time: 0.162622 Oct 04 21:20:23.151468 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3082/6130] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:20:22 2022] GET /compute/v2.1/servers/f00182c9-26da-4727-94f7-516d38353510 => generated 1203 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:20:24.174719 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-554dbc7d-5f6e-457e-bca9-45b92342bef8 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:20:24.175518 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-554dbc7d-5f6e-457e-bca9-45b92342bef8 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: f00182c9-26da-4727-94f7-516d38353510] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:20:24.182959 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-554dbc7d-5f6e-457e-bca9-45b92342bef8 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:24.183447 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-554dbc7d-5f6e-457e-bca9-45b92342bef8 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:24.183890 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-554dbc7d-5f6e-457e-bca9-45b92342bef8 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:24.184589 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-554dbc7d-5f6e-457e-bca9-45b92342bef8 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:24.185107 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-554dbc7d-5f6e-457e-bca9-45b92342bef8 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:24.185720 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-554dbc7d-5f6e-457e-bca9-45b92342bef8 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:24.317225 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-554dbc7d-5f6e-457e-bca9-45b92342bef8 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:24.325064 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-554dbc7d-5f6e-457e-bca9-45b92342bef8 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/f00182c9-26da-4727-94f7-516d38353510" status: 200 len: 1203 microversion: 2.1 time: 0.154365 Oct 04 21:20:24.325661 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3049/6131] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:20:24 2022] GET /compute/v2.1/servers/f00182c9-26da-4727-94f7-516d38353510 => generated 1203 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:20:25.349079 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-3559df00-29f6-4a8a-9b6a-250f4ddab7a5 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:20:25.349820 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-3559df00-29f6-4a8a-9b6a-250f4ddab7a5 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: f00182c9-26da-4727-94f7-516d38353510] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:20:25.357225 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3559df00-29f6-4a8a-9b6a-250f4ddab7a5 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:25.357889 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3559df00-29f6-4a8a-9b6a-250f4ddab7a5 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:25.358333 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3559df00-29f6-4a8a-9b6a-250f4ddab7a5 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:25.359078 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3559df00-29f6-4a8a-9b6a-250f4ddab7a5 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:25.359540 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3559df00-29f6-4a8a-9b6a-250f4ddab7a5 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:25.359974 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3559df00-29f6-4a8a-9b6a-250f4ddab7a5 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:25.502404 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-3559df00-29f6-4a8a-9b6a-250f4ddab7a5 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:25.510548 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-3559df00-29f6-4a8a-9b6a-250f4ddab7a5 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/f00182c9-26da-4727-94f7-516d38353510" status: 200 len: 1203 microversion: 2.1 time: 0.165860 Oct 04 21:20:25.511122 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3083/6132] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:20:25 2022] GET /compute/v2.1/servers/f00182c9-26da-4727-94f7-516d38353510 => generated 1203 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:20:26.533842 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-42dc6562-ca60-49a8-8f84-661b8f74293e tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:20:26.534478 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-42dc6562-ca60-49a8-8f84-661b8f74293e tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: f00182c9-26da-4727-94f7-516d38353510] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:20:26.541300 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-42dc6562-ca60-49a8-8f84-661b8f74293e tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:26.541777 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-42dc6562-ca60-49a8-8f84-661b8f74293e tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:26.542206 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-42dc6562-ca60-49a8-8f84-661b8f74293e tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:26.542951 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-42dc6562-ca60-49a8-8f84-661b8f74293e tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:26.543402 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-42dc6562-ca60-49a8-8f84-661b8f74293e tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:26.543822 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-42dc6562-ca60-49a8-8f84-661b8f74293e tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:26.677681 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-42dc6562-ca60-49a8-8f84-661b8f74293e tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:26.685990 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-42dc6562-ca60-49a8-8f84-661b8f74293e tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/f00182c9-26da-4727-94f7-516d38353510" status: 200 len: 1203 microversion: 2.1 time: 0.156891 Oct 04 21:20:26.686607 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3050/6133] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:20:26 2022] GET /compute/v2.1/servers/f00182c9-26da-4727-94f7-516d38353510 => generated 1203 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:20:27.709364 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-a9512766-b5c4-475b-94ef-c94a8f2c43b4 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:20:27.709981 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-a9512766-b5c4-475b-94ef-c94a8f2c43b4 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: f00182c9-26da-4727-94f7-516d38353510] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:20:27.718112 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a9512766-b5c4-475b-94ef-c94a8f2c43b4 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:27.718638 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a9512766-b5c4-475b-94ef-c94a8f2c43b4 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:27.719079 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a9512766-b5c4-475b-94ef-c94a8f2c43b4 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:27.719804 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a9512766-b5c4-475b-94ef-c94a8f2c43b4 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:27.720261 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a9512766-b5c4-475b-94ef-c94a8f2c43b4 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:27.720688 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a9512766-b5c4-475b-94ef-c94a8f2c43b4 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:27.861115 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-a9512766-b5c4-475b-94ef-c94a8f2c43b4 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:27.869147 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-a9512766-b5c4-475b-94ef-c94a8f2c43b4 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/f00182c9-26da-4727-94f7-516d38353510" status: 200 len: 1203 microversion: 2.1 time: 0.163828 Oct 04 21:20:27.870382 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3084/6134] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:20:27 2022] GET /compute/v2.1/servers/f00182c9-26da-4727-94f7-516d38353510 => generated 1203 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:20:28.893122 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-603607a5-df52-4009-907b-cb38f737d2a8 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:20:28.893873 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-603607a5-df52-4009-907b-cb38f737d2a8 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: f00182c9-26da-4727-94f7-516d38353510] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:20:28.901086 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-603607a5-df52-4009-907b-cb38f737d2a8 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:28.901579 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-603607a5-df52-4009-907b-cb38f737d2a8 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:28.902017 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-603607a5-df52-4009-907b-cb38f737d2a8 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:28.902752 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-603607a5-df52-4009-907b-cb38f737d2a8 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:28.903211 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-603607a5-df52-4009-907b-cb38f737d2a8 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:28.903640 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-603607a5-df52-4009-907b-cb38f737d2a8 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:29.046990 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-603607a5-df52-4009-907b-cb38f737d2a8 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:29.055743 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-603607a5-df52-4009-907b-cb38f737d2a8 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/f00182c9-26da-4727-94f7-516d38353510" status: 200 len: 1203 microversion: 2.1 time: 0.167015 Oct 04 21:20:29.056823 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3051/6135] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:20:28 2022] GET /compute/v2.1/servers/f00182c9-26da-4727-94f7-516d38353510 => generated 1203 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:20:30.080342 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-9b9d46d8-ee24-4180-a249-968c76d0b41c tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:20:30.081800 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-9b9d46d8-ee24-4180-a249-968c76d0b41c tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: f00182c9-26da-4727-94f7-516d38353510] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:20:30.083559 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=3 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:20:30.092377 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9b9d46d8-ee24-4180-a249-968c76d0b41c tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:30.092931 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9b9d46d8-ee24-4180-a249-968c76d0b41c tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:30.093362 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9b9d46d8-ee24-4180-a249-968c76d0b41c tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:30.094068 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9b9d46d8-ee24-4180-a249-968c76d0b41c tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:30.095236 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9b9d46d8-ee24-4180-a249-968c76d0b41c tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:30.096012 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9b9d46d8-ee24-4180-a249-968c76d0b41c tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:30.099764 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=71 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:20:30.254090 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-9b9d46d8-ee24-4180-a249-968c76d0b41c tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:30.262881 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-9b9d46d8-ee24-4180-a249-968c76d0b41c tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/f00182c9-26da-4727-94f7-516d38353510" status: 200 len: 1203 microversion: 2.1 time: 0.187058 Oct 04 21:20:30.265220 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3085/6136] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:20:30 2022] GET /compute/v2.1/servers/f00182c9-26da-4727-94f7-516d38353510 => generated 1203 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:20:31.288933 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a5913432-47eb-481d-8db9-eb25d011ac85 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:20:31.290190 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a5913432-47eb-481d-8db9-eb25d011ac85 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: f00182c9-26da-4727-94f7-516d38353510] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:20:31.292985 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=29 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:20:31.298796 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a5913432-47eb-481d-8db9-eb25d011ac85 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:31.299289 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a5913432-47eb-481d-8db9-eb25d011ac85 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:31.299733 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a5913432-47eb-481d-8db9-eb25d011ac85 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:31.300442 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a5913432-47eb-481d-8db9-eb25d011ac85 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:31.300903 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a5913432-47eb-481d-8db9-eb25d011ac85 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:31.301335 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a5913432-47eb-481d-8db9-eb25d011ac85 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:31.304230 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=73 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:20:31.442179 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-a5913432-47eb-481d-8db9-eb25d011ac85 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:31.450189 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a5913432-47eb-481d-8db9-eb25d011ac85 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/f00182c9-26da-4727-94f7-516d38353510" status: 200 len: 1203 microversion: 2.1 time: 0.165204 Oct 04 21:20:31.451524 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3052/6137] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:20:31 2022] GET /compute/v2.1/servers/f00182c9-26da-4727-94f7-516d38353510 => generated 1203 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:20:32.429262 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-64f3bdd4-935a-4427-afc0-e248a9eede7b req-c693dd2d-a6c2-4a54-8157-bf8c39cc72fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f00182c9-26da-4727-94f7-516d38353510", "name": "network-vif-plugged", "status": "completed", "tag": "d91dccaa-606f-476d-8819-1eb522e773bb"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:20:32.441156 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-64f3bdd4-935a-4427-afc0-e248a9eede7b req-c693dd2d-a6c2-4a54-8157-bf8c39cc72fa service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:32.442547 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-64f3bdd4-935a-4427-afc0-e248a9eede7b req-c693dd2d-a6c2-4a54-8157-bf8c39cc72fa service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:32.442983 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-64f3bdd4-935a-4427-afc0-e248a9eede7b req-c693dd2d-a6c2-4a54-8157-bf8c39cc72fa service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:32.455322 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-64f3bdd4-935a-4427-afc0-e248a9eede7b req-c693dd2d-a6c2-4a54-8157-bf8c39cc72fa service nova] Creating event network-vif-plugged:d91dccaa-606f-476d-8819-1eb522e773bb for instance f00182c9-26da-4727-94f7-516d38353510 on n-h2-854823-8 Oct 04 21:20:32.460421 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-64f3bdd4-935a-4427-afc0-e248a9eede7b req-c693dd2d-a6c2-4a54-8157-bf8c39cc72fa service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035239 Oct 04 21:20:32.461264 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3086/6138] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:20:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:20:32.478096 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c17fbb65-821c-4403-a2c3-4e8c280cb499 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:20:32.478839 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c17fbb65-821c-4403-a2c3-4e8c280cb499 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: f00182c9-26da-4727-94f7-516d38353510] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:20:32.486587 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c17fbb65-821c-4403-a2c3-4e8c280cb499 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:32.487081 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c17fbb65-821c-4403-a2c3-4e8c280cb499 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:32.487616 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c17fbb65-821c-4403-a2c3-4e8c280cb499 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:32.488513 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c17fbb65-821c-4403-a2c3-4e8c280cb499 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:32.488970 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c17fbb65-821c-4403-a2c3-4e8c280cb499 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:32.489393 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c17fbb65-821c-4403-a2c3-4e8c280cb499 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:32.695982 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c17fbb65-821c-4403-a2c3-4e8c280cb499 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:32.704835 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c17fbb65-821c-4403-a2c3-4e8c280cb499 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/f00182c9-26da-4727-94f7-516d38353510" status: 200 len: 1203 microversion: 2.1 time: 0.234981 Oct 04 21:20:32.714603 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3053/6139] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:20:32 2022] GET /compute/v2.1/servers/f00182c9-26da-4727-94f7-516d38353510 => generated 1203 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:20:33.728646 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-e4a5865f-9203-4a86-a0d2-95d883bdcff5 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:20:33.729365 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-e4a5865f-9203-4a86-a0d2-95d883bdcff5 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: f00182c9-26da-4727-94f7-516d38353510] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:20:33.737892 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e4a5865f-9203-4a86-a0d2-95d883bdcff5 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:33.738408 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e4a5865f-9203-4a86-a0d2-95d883bdcff5 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:33.738851 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e4a5865f-9203-4a86-a0d2-95d883bdcff5 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:33.739560 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e4a5865f-9203-4a86-a0d2-95d883bdcff5 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:33.740023 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e4a5865f-9203-4a86-a0d2-95d883bdcff5 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:33.740453 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e4a5865f-9203-4a86-a0d2-95d883bdcff5 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:33.895419 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-e4a5865f-9203-4a86-a0d2-95d883bdcff5 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:33.904874 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-e4a5865f-9203-4a86-a0d2-95d883bdcff5 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/f00182c9-26da-4727-94f7-516d38353510" status: 200 len: 1203 microversion: 2.1 time: 0.179972 Oct 04 21:20:33.906030 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3087/6140] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:20:33 2022] GET /compute/v2.1/servers/f00182c9-26da-4727-94f7-516d38353510 => generated 1203 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:20:34.927505 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-88aa6f0c-cca4-4c3c-872f-a70ed65935df tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:20:34.928119 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-88aa6f0c-cca4-4c3c-872f-a70ed65935df tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: f00182c9-26da-4727-94f7-516d38353510] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:20:34.935808 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-88aa6f0c-cca4-4c3c-872f-a70ed65935df tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:34.936446 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-88aa6f0c-cca4-4c3c-872f-a70ed65935df tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:34.936889 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-88aa6f0c-cca4-4c3c-872f-a70ed65935df tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:34.937592 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-88aa6f0c-cca4-4c3c-872f-a70ed65935df tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:34.938050 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-88aa6f0c-cca4-4c3c-872f-a70ed65935df tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:34.938595 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-88aa6f0c-cca4-4c3c-872f-a70ed65935df tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:35.069335 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-88aa6f0c-cca4-4c3c-872f-a70ed65935df tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:35.077801 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-88aa6f0c-cca4-4c3c-872f-a70ed65935df tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/f00182c9-26da-4727-94f7-516d38353510" status: 200 len: 1390 microversion: 2.1 time: 0.154213 Oct 04 21:20:35.078485 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3054/6141] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:20:34 2022] GET /compute/v2.1/servers/f00182c9-26da-4727-94f7-516d38353510 => generated 1390 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:20:35.101282 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-0160c6b2-1f56-40d0-b32d-ac734a9c39f5 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:20:35.101891 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-0160c6b2-1f56-40d0-b32d-ac734a9c39f5 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: f00182c9-26da-4727-94f7-516d38353510] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:20:35.108804 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0160c6b2-1f56-40d0-b32d-ac734a9c39f5 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:35.109289 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0160c6b2-1f56-40d0-b32d-ac734a9c39f5 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:35.109722 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0160c6b2-1f56-40d0-b32d-ac734a9c39f5 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:35.110428 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0160c6b2-1f56-40d0-b32d-ac734a9c39f5 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:35.110882 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0160c6b2-1f56-40d0-b32d-ac734a9c39f5 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:35.111305 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0160c6b2-1f56-40d0-b32d-ac734a9c39f5 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:35.247364 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-0160c6b2-1f56-40d0-b32d-ac734a9c39f5 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:35.255331 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-0160c6b2-1f56-40d0-b32d-ac734a9c39f5 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/f00182c9-26da-4727-94f7-516d38353510" status: 200 len: 1390 microversion: 2.1 time: 0.157820 Oct 04 21:20:35.255939 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3088/6142] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:20:35 2022] GET /compute/v2.1/servers/f00182c9-26da-4727-94f7-516d38353510 => generated 1390 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:20:35.277620 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7a448d16-9dd4-4a4c-9e51-0469f6bf981c tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:20:35.278233 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-7a448d16-9dd4-4a4c-9e51-0469f6bf981c tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: f00182c9-26da-4727-94f7-516d38353510] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:20:35.285129 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7a448d16-9dd4-4a4c-9e51-0469f6bf981c tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:35.285682 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7a448d16-9dd4-4a4c-9e51-0469f6bf981c tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:35.286181 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7a448d16-9dd4-4a4c-9e51-0469f6bf981c tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:35.286962 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7a448d16-9dd4-4a4c-9e51-0469f6bf981c tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:35.287490 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7a448d16-9dd4-4a4c-9e51-0469f6bf981c tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:35.287974 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7a448d16-9dd4-4a4c-9e51-0469f6bf981c tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:35.419975 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-7a448d16-9dd4-4a4c-9e51-0469f6bf981c tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:35.428470 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-7a448d16-9dd4-4a4c-9e51-0469f6bf981c tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/f00182c9-26da-4727-94f7-516d38353510" status: 200 len: 1390 microversion: 2.1 time: 0.154692 Oct 04 21:20:35.429062 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3055/6143] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:20:35 2022] GET /compute/v2.1/servers/f00182c9-26da-4727-94f7-516d38353510 => generated 1390 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:20:35.516066 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-2b0205df-bd52-4a5a-9e33-eeaef359000f tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:20:35.516539 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-2b0205df-bd52-4a5a-9e33-eeaef359000f tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: f00182c9-26da-4727-94f7-516d38353510] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:20:35.522840 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2b0205df-bd52-4a5a-9e33-eeaef359000f tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:35.523319 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2b0205df-bd52-4a5a-9e33-eeaef359000f tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:35.523754 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2b0205df-bd52-4a5a-9e33-eeaef359000f tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:35.524440 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2b0205df-bd52-4a5a-9e33-eeaef359000f tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:35.524891 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2b0205df-bd52-4a5a-9e33-eeaef359000f tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:35.525311 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2b0205df-bd52-4a5a-9e33-eeaef359000f tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:35.551434 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-2b0205df-bd52-4a5a-9e33-eeaef359000f tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: f00182c9-26da-4727-94f7-516d38353510] Going to try to terminate instance {{(pid=128802) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:20:35.631562 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-2b0205df-bd52-4a5a-9e33-eeaef359000f tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "DELETE /compute/v2.1/servers/f00182c9-26da-4727-94f7-516d38353510" status: 204 len: 0 microversion: 2.1 time: 0.119725 Oct 04 21:20:35.632242 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3089/6144] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 21:20:35 2022] DELETE /compute/v2.1/servers/f00182c9-26da-4727-94f7-516d38353510 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:20:35.641662 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f258502f-99a4-4f9a-ac5a-af62bf8d3b7d tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:20:35.642286 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f258502f-99a4-4f9a-ac5a-af62bf8d3b7d tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: f00182c9-26da-4727-94f7-516d38353510] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:20:35.648648 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f258502f-99a4-4f9a-ac5a-af62bf8d3b7d tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:35.649171 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f258502f-99a4-4f9a-ac5a-af62bf8d3b7d tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:35.649643 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f258502f-99a4-4f9a-ac5a-af62bf8d3b7d tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:35.650354 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f258502f-99a4-4f9a-ac5a-af62bf8d3b7d tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:35.650933 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f258502f-99a4-4f9a-ac5a-af62bf8d3b7d tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:35.651361 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f258502f-99a4-4f9a-ac5a-af62bf8d3b7d tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:35.791753 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f258502f-99a4-4f9a-ac5a-af62bf8d3b7d tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:35.800896 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f258502f-99a4-4f9a-ac5a-af62bf8d3b7d tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/f00182c9-26da-4727-94f7-516d38353510" status: 200 len: 1396 microversion: 2.1 time: 0.164364 Oct 04 21:20:35.801472 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3056/6145] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:20:35 2022] GET /compute/v2.1/servers/f00182c9-26da-4727-94f7-516d38353510 => generated 1396 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:20:36.825758 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-be582c4f-4938-4374-8d46-93912bed1bcd tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:20:36.827385 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-be582c4f-4938-4374-8d46-93912bed1bcd tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: f00182c9-26da-4727-94f7-516d38353510] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:20:36.835047 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-be582c4f-4938-4374-8d46-93912bed1bcd tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:36.835531 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-be582c4f-4938-4374-8d46-93912bed1bcd tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:36.836107 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-be582c4f-4938-4374-8d46-93912bed1bcd tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:36.836679 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-be582c4f-4938-4374-8d46-93912bed1bcd tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:36.837224 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-be582c4f-4938-4374-8d46-93912bed1bcd tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:36.837711 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-be582c4f-4938-4374-8d46-93912bed1bcd tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:36.980600 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-be582c4f-4938-4374-8d46-93912bed1bcd tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:36.990426 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-be582c4f-4938-4374-8d46-93912bed1bcd tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/f00182c9-26da-4727-94f7-516d38353510" status: 200 len: 1396 microversion: 2.1 time: 0.169024 Oct 04 21:20:36.991911 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3090/6146] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:20:36 2022] GET /compute/v2.1/servers/f00182c9-26da-4727-94f7-516d38353510 => generated 1396 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:20:37.750182 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-eb0021e3-cdc2-4a9b-b9ef-8c44339eddae req-63349ce9-8448-4cf2-961b-d20e0401f939 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f00182c9-26da-4727-94f7-516d38353510", "name": "network-vif-deleted", "tag": "d91dccaa-606f-476d-8819-1eb522e773bb"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:20:37.762442 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-eb0021e3-cdc2-4a9b-b9ef-8c44339eddae req-63349ce9-8448-4cf2-961b-d20e0401f939 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:37.772788 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-eb0021e3-cdc2-4a9b-b9ef-8c44339eddae req-63349ce9-8448-4cf2-961b-d20e0401f939 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:37.773672 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-eb0021e3-cdc2-4a9b-b9ef-8c44339eddae req-63349ce9-8448-4cf2-961b-d20e0401f939 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:37.788028 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-eb0021e3-cdc2-4a9b-b9ef-8c44339eddae req-63349ce9-8448-4cf2-961b-d20e0401f939 service nova] Creating event network-vif-deleted:d91dccaa-606f-476d-8819-1eb522e773bb for instance f00182c9-26da-4727-94f7-516d38353510 on n-h2-854823-8 Oct 04 21:20:37.793177 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-eb0021e3-cdc2-4a9b-b9ef-8c44339eddae req-63349ce9-8448-4cf2-961b-d20e0401f939 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048374 Oct 04 21:20:37.794135 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3057/6147] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:20:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:20:38.014488 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-87b10f90-a67c-44f4-b7fc-06f62fe35360 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:20:38.015754 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-87b10f90-a67c-44f4-b7fc-06f62fe35360 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: f00182c9-26da-4727-94f7-516d38353510] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:20:38.023018 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-87b10f90-a67c-44f4-b7fc-06f62fe35360 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:38.023629 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-87b10f90-a67c-44f4-b7fc-06f62fe35360 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:38.024272 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-87b10f90-a67c-44f4-b7fc-06f62fe35360 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:38.025009 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-87b10f90-a67c-44f4-b7fc-06f62fe35360 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:38.025466 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-87b10f90-a67c-44f4-b7fc-06f62fe35360 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:38.025888 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-87b10f90-a67c-44f4-b7fc-06f62fe35360 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:38.114301 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-87b10f90-a67c-44f4-b7fc-06f62fe35360 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:38.124016 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-87b10f90-a67c-44f4-b7fc-06f62fe35360 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/f00182c9-26da-4727-94f7-516d38353510" status: 200 len: 1188 microversion: 2.1 time: 0.114058 Oct 04 21:20:38.132898 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3091/6148] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:20:38 2022] GET /compute/v2.1/servers/f00182c9-26da-4727-94f7-516d38353510 => generated 1188 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:20:39.159968 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d845fc0c-3a42-45e3-9ebb-427ed0a22084 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:20:39.160998 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d845fc0c-3a42-45e3-9ebb-427ed0a22084 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: f00182c9-26da-4727-94f7-516d38353510] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:20:39.168598 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d845fc0c-3a42-45e3-9ebb-427ed0a22084 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:39.169678 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d845fc0c-3a42-45e3-9ebb-427ed0a22084 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:39.170116 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d845fc0c-3a42-45e3-9ebb-427ed0a22084 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:39.171021 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d845fc0c-3a42-45e3-9ebb-427ed0a22084 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:39.171475 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d845fc0c-3a42-45e3-9ebb-427ed0a22084 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:39.171922 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d845fc0c-3a42-45e3-9ebb-427ed0a22084 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:39.249397 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d845fc0c-3a42-45e3-9ebb-427ed0a22084 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:39.257812 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d845fc0c-3a42-45e3-9ebb-427ed0a22084 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/f00182c9-26da-4727-94f7-516d38353510" status: 200 len: 1188 microversion: 2.1 time: 0.102657 Oct 04 21:20:39.258412 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3058/6149] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:20:39 2022] GET /compute/v2.1/servers/f00182c9-26da-4727-94f7-516d38353510 => generated 1188 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:20:40.281475 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-97d51d8a-c6ee-40d1-8958-05d81779dc19 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:20:40.282264 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-97d51d8a-c6ee-40d1-8958-05d81779dc19 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: f00182c9-26da-4727-94f7-516d38353510] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:20:40.290085 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-97d51d8a-c6ee-40d1-8958-05d81779dc19 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:40.290725 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-97d51d8a-c6ee-40d1-8958-05d81779dc19 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:40.291230 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-97d51d8a-c6ee-40d1-8958-05d81779dc19 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:40.292023 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-97d51d8a-c6ee-40d1-8958-05d81779dc19 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:40.292558 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-97d51d8a-c6ee-40d1-8958-05d81779dc19 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:40.293056 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-97d51d8a-c6ee-40d1-8958-05d81779dc19 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:40.379055 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-97d51d8a-c6ee-40d1-8958-05d81779dc19 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:40.387443 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-97d51d8a-c6ee-40d1-8958-05d81779dc19 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/f00182c9-26da-4727-94f7-516d38353510" status: 200 len: 1188 microversion: 2.1 time: 0.110766 Oct 04 21:20:40.389538 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3092/6150] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:20:40 2022] GET /compute/v2.1/servers/f00182c9-26da-4727-94f7-516d38353510 => generated 1188 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:20:41.412114 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-82881941-9d09-4e46-8e3e-e2e6cd528417 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:20:41.412741 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-82881941-9d09-4e46-8e3e-e2e6cd528417 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: f00182c9-26da-4727-94f7-516d38353510] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:20:41.421091 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-82881941-9d09-4e46-8e3e-e2e6cd528417 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:41.421592 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-82881941-9d09-4e46-8e3e-e2e6cd528417 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:41.422035 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-82881941-9d09-4e46-8e3e-e2e6cd528417 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:41.422782 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-82881941-9d09-4e46-8e3e-e2e6cd528417 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:41.423526 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-82881941-9d09-4e46-8e3e-e2e6cd528417 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:41.423971 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-82881941-9d09-4e46-8e3e-e2e6cd528417 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:41.493514 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-82881941-9d09-4e46-8e3e-e2e6cd528417 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:41.503134 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-82881941-9d09-4e46-8e3e-e2e6cd528417 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/f00182c9-26da-4727-94f7-516d38353510" status: 200 len: 1188 microversion: 2.1 time: 0.094926 Oct 04 21:20:41.503646 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3059/6151] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:20:41 2022] GET /compute/v2.1/servers/f00182c9-26da-4727-94f7-516d38353510 => generated 1188 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:20:42.525344 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-8a304cf1-b3b9-4d3c-9fdc-bb5efefb8d55 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:20:42.526302 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-8a304cf1-b3b9-4d3c-9fdc-bb5efefb8d55 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: f00182c9-26da-4727-94f7-516d38353510] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:20:42.535233 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8a304cf1-b3b9-4d3c-9fdc-bb5efefb8d55 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:42.535887 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8a304cf1-b3b9-4d3c-9fdc-bb5efefb8d55 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:42.536626 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8a304cf1-b3b9-4d3c-9fdc-bb5efefb8d55 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:42.537434 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8a304cf1-b3b9-4d3c-9fdc-bb5efefb8d55 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:42.537989 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8a304cf1-b3b9-4d3c-9fdc-bb5efefb8d55 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:42.538649 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8a304cf1-b3b9-4d3c-9fdc-bb5efefb8d55 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:42.572039 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8a304cf1-b3b9-4d3c-9fdc-bb5efefb8d55 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:42.572683 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8a304cf1-b3b9-4d3c-9fdc-bb5efefb8d55 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:42.573216 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8a304cf1-b3b9-4d3c-9fdc-bb5efefb8d55 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:42.573779 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.objects.instance [None req-8a304cf1-b3b9-4d3c-9fdc-bb5efefb8d55 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lazy-loading 'fault' on Instance uuid f00182c9-26da-4727-94f7-516d38353510 {{(pid=128802) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:20:42.641122 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-8a304cf1-b3b9-4d3c-9fdc-bb5efefb8d55 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:20:42.653998 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-8a304cf1-b3b9-4d3c-9fdc-bb5efefb8d55 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/f00182c9-26da-4727-94f7-516d38353510" status: 200 len: 1193 microversion: 2.1 time: 0.131706 Oct 04 21:20:42.655406 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3093/6152] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:20:42 2022] GET /compute/v2.1/servers/f00182c9-26da-4727-94f7-516d38353510 => generated 1193 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:20:43.677386 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f907deaf-8aac-4ad8-9eaf-75c87af7e256 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:20:43.678223 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f907deaf-8aac-4ad8-9eaf-75c87af7e256 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: f00182c9-26da-4727-94f7-516d38353510] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:20:43.696530 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f907deaf-8aac-4ad8-9eaf-75c87af7e256 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:43.697026 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f907deaf-8aac-4ad8-9eaf-75c87af7e256 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:43.697720 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f907deaf-8aac-4ad8-9eaf-75c87af7e256 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:43.699683 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f907deaf-8aac-4ad8-9eaf-75c87af7e256 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:43.700856 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f907deaf-8aac-4ad8-9eaf-75c87af7e256 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:43.701451 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f907deaf-8aac-4ad8-9eaf-75c87af7e256 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:43.721429 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-f907deaf-8aac-4ad8-9eaf-75c87af7e256 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] HTTP exception thrown: Instance f00182c9-26da-4727-94f7-516d38353510 could not be found. Oct 04 21:20:43.723172 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f907deaf-8aac-4ad8-9eaf-75c87af7e256 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Request method failure captured: Oct 04 21:20:43.723172 n-d-854823-8 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/f00182c9-26da-4727-94f7-516d38353510 HTTP/1.1 Oct 04 21:20:43.723172 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 21:20:43.723172 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 21:20:43.723172 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 21:20:43.723172 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 0 Oct 04 21:20:43.723172 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 21:20:43.723172 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 21:20:43.723172 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 21:20:43.723172 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 21:20:43.723172 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPKMhB36sxHtTwvN5cR_FDx6677Bk3r96uZe9x8RsKj2kP41h8elma4Sfp2Sil3wffnoaQT-coMFt-1I-ubK46x1CIQQbRLJJWc6ISWYT8YHNWLLnEGq51UhoqUKdKybGmNCaSC1unJV9CeCDYPI8cjjYW6_GmoH3684NnCEjfslKtuc Oct 04 21:20:43.723172 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 21:20:43.723172 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 21:20:43.723172 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 21:20:43.723172 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 21:20:43.723172 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 21:20:43.723172 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 21:20:43.723172 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: 0d78e06d720d438a9308ae138902f847 Oct 04 21:20:43.723172 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-TestVolumeBootPattern-1361369473 Oct 04 21:20:43.723172 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 21:20:43.723172 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 21:20:43.723172 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0d78e06d720d438a9308ae138902f847", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0d78e06d720d438a9308ae138902f847"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0d78e06d720d438a9308ae138902f847"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0d78e06d720d438a9308ae138902f847"}]}] Oct 04 21:20:43.723172 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-TestVolumeBootPattern-1361369473 Oct 04 21:20:43.723172 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: 0d78e06d720d438a9308ae138902f847 Oct 04 21:20:43.723172 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-TestVolumeBootPattern-1361369473 Oct 04 21:20:43.723172 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-TestVolumeBootPattern-1361369473-project Oct 04 21:20:43.723172 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 21:20:43.723172 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 21:20:43.723172 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: ad7b0b59fad1429e95591b21e33ccbaa Oct 04 21:20:43.723172 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-TestVolumeBootPattern-1361369473-project Oct 04 21:20:43.723172 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 21:20:43.723172 n-d-854823-8 devstack@n-api.service[128801]: exception: Instance f00182c9-26da-4727-94f7-516d38353510 could not be found. Oct 04 21:20:43.723172 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': 'f00182c9-26da-4727-94f7-516d38353510'} Oct 04 21:20:43.723172 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:20:43.723172 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:20:43.723172 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:20:43.723172 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:20:43.723172 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:20:43.723172 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:20:43.723172 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:20:43.723172 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:20:43.723172 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:20:43.723172 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:20:43.723172 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f00182c9-26da-4727-94f7-516d38353510 could not be found. Oct 04 21:20:43.723172 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:20:43.723172 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:20:43.723172 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:20:43.723172 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:20:43.723172 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:20:43.723172 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:20:43.723172 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:20:43.723172 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:20:43.723172 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:20:43.723172 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:20:43.723172 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:20:43.723172 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:20:43.723172 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:20:43.723172 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:20:43.723172 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:20:43.723172 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:20:43.723172 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f00182c9-26da-4727-94f7-516d38353510 could not be found. Oct 04 21:20:43.723172 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:20:43.723172 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:20:43.723172 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:20:43.729028 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:20:43.729028 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:20:43.729028 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:20:43.729028 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:20:43.729028 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:20:43.729028 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f00182c9-26da-4727-94f7-516d38353510 could not be found. Oct 04 21:20:43.729028 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:20:43.729028 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f907deaf-8aac-4ad8-9eaf-75c87af7e256 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Returning 404 to user: Instance f00182c9-26da-4727-94f7-516d38353510 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:20:43.729028 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f907deaf-8aac-4ad8-9eaf-75c87af7e256 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/f00182c9-26da-4727-94f7-516d38353510" status: 404 len: 111 microversion: 2.1 time: 0.051359 Oct 04 21:20:43.729028 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3060/6153] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:20:43 2022] GET /compute/v2.1/servers/f00182c9-26da-4727-94f7-516d38353510 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:20:45.883552 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-f1684e90-b95e-4bbf-867d-b83cfa65e0c5 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:20:45.884116 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-f1684e90-b95e-4bbf-867d-b83cfa65e0c5 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: f00182c9-26da-4727-94f7-516d38353510] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:20:45.892387 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f1684e90-b95e-4bbf-867d-b83cfa65e0c5 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:45.892965 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f1684e90-b95e-4bbf-867d-b83cfa65e0c5 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:45.893478 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f1684e90-b95e-4bbf-867d-b83cfa65e0c5 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:45.894258 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f1684e90-b95e-4bbf-867d-b83cfa65e0c5 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:45.894844 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f1684e90-b95e-4bbf-867d-b83cfa65e0c5 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:45.895488 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f1684e90-b95e-4bbf-867d-b83cfa65e0c5 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:45.914031 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.wsgi [None req-f1684e90-b95e-4bbf-867d-b83cfa65e0c5 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] HTTP exception thrown: Instance f00182c9-26da-4727-94f7-516d38353510 could not be found. Oct 04 21:20:45.916054 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-f1684e90-b95e-4bbf-867d-b83cfa65e0c5 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Request method failure captured: Oct 04 21:20:45.916054 n-d-854823-8 devstack@n-api.service[128802]: request: DELETE /compute/v2.1/servers/f00182c9-26da-4727-94f7-516d38353510 HTTP/1.1 Oct 04 21:20:45.916054 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 21:20:45.916054 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 21:20:45.916054 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 21:20:45.916054 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 0 Oct 04 21:20:45.916054 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 21:20:45.916054 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 21:20:45.916054 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 21:20:45.916054 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 21:20:45.916054 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPKMhB36sxHtTwvN5cR_FDx6677Bk3r96uZe9x8RsKj2kP41h8elma4Sfp2Sil3wffnoaQT-coMFt-1I-ubK46x1CIQQbRLJJWc6ISWYT8YHNWLLnEGq51UhoqUKdKybGmNCaSC1unJV9CeCDYPI8cjjYW6_GmoH3684NnCEjfslKtuc Oct 04 21:20:45.916054 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 21:20:45.916054 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 21:20:45.916054 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 21:20:45.916054 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 21:20:45.916054 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 21:20:45.916054 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 21:20:45.916054 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: 0d78e06d720d438a9308ae138902f847 Oct 04 21:20:45.916054 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-TestVolumeBootPattern-1361369473 Oct 04 21:20:45.916054 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 21:20:45.916054 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 21:20:45.916054 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0d78e06d720d438a9308ae138902f847", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0d78e06d720d438a9308ae138902f847"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0d78e06d720d438a9308ae138902f847"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0d78e06d720d438a9308ae138902f847"}]}] Oct 04 21:20:45.916054 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-TestVolumeBootPattern-1361369473 Oct 04 21:20:45.916054 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: 0d78e06d720d438a9308ae138902f847 Oct 04 21:20:45.916054 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-TestVolumeBootPattern-1361369473 Oct 04 21:20:45.916054 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-TestVolumeBootPattern-1361369473-project Oct 04 21:20:45.916054 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 21:20:45.916054 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 21:20:45.916054 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: ad7b0b59fad1429e95591b21e33ccbaa Oct 04 21:20:45.916054 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-TestVolumeBootPattern-1361369473-project Oct 04 21:20:45.916054 n-d-854823-8 devstack@n-api.service[128802]: method: > Oct 04 21:20:45.916054 n-d-854823-8 devstack@n-api.service[128802]: exception: Instance f00182c9-26da-4727-94f7-516d38353510 could not be found. Oct 04 21:20:45.916054 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'id': 'f00182c9-26da-4727-94f7-516d38353510'} Oct 04 21:20:45.916054 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:20:45.916054 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:20:45.916054 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:20:45.916054 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:20:45.916054 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:20:45.916054 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:20:45.916054 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:20:45.916054 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:20:45.916054 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:20:45.916054 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:20:45.916054 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f00182c9-26da-4727-94f7-516d38353510 could not be found. Oct 04 21:20:45.916054 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:20:45.916054 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:20:45.916054 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:20:45.916054 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:20:45.916054 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:20:45.916054 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:20:45.916054 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:20:45.916054 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:20:45.916054 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:20:45.916054 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:20:45.916054 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 21:20:45.916054 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 21:20:45.916054 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 21:20:45.916054 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 21:20:45.916054 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:20:45.916054 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:20:45.916054 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:20:45.916054 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:20:45.924250 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f00182c9-26da-4727-94f7-516d38353510 could not be found. Oct 04 21:20:45.924250 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:20:45.924250 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:20:45.924250 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:20:45.924250 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:20:45.924250 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:20:45.924250 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:20:45.924250 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:20:45.924250 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:20:45.924250 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f00182c9-26da-4727-94f7-516d38353510 could not be found. Oct 04 21:20:45.924250 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:20:45.924250 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-f1684e90-b95e-4bbf-867d-b83cfa65e0c5 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Returning 404 to user: Instance f00182c9-26da-4727-94f7-516d38353510 could not be found. {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:20:45.924250 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-f1684e90-b95e-4bbf-867d-b83cfa65e0c5 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "DELETE /compute/v2.1/servers/f00182c9-26da-4727-94f7-516d38353510" status: 404 len: 111 microversion: 2.1 time: 0.038178 Oct 04 21:20:45.924250 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3094/6154] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 21:20:45 2022] DELETE /compute/v2.1/servers/f00182c9-26da-4727-94f7-516d38353510 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:20:45.929306 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0bb7e50b-29c0-4c44-9834-67a2de764aec tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:20:45.930066 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-0bb7e50b-29c0-4c44-9834-67a2de764aec tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: f00182c9-26da-4727-94f7-516d38353510] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:20:45.937927 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0bb7e50b-29c0-4c44-9834-67a2de764aec tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:45.938510 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0bb7e50b-29c0-4c44-9834-67a2de764aec tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:45.939321 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0bb7e50b-29c0-4c44-9834-67a2de764aec tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:45.940120 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0bb7e50b-29c0-4c44-9834-67a2de764aec tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:20:45.940685 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0bb7e50b-29c0-4c44-9834-67a2de764aec tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:20:45.941225 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0bb7e50b-29c0-4c44-9834-67a2de764aec tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:20:45.956342 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-0bb7e50b-29c0-4c44-9834-67a2de764aec tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] HTTP exception thrown: Instance f00182c9-26da-4727-94f7-516d38353510 could not be found. Oct 04 21:20:45.958072 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0bb7e50b-29c0-4c44-9834-67a2de764aec tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Request method failure captured: Oct 04 21:20:45.958072 n-d-854823-8 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/f00182c9-26da-4727-94f7-516d38353510 HTTP/1.1 Oct 04 21:20:45.958072 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 21:20:45.958072 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 21:20:45.958072 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 21:20:45.958072 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 0 Oct 04 21:20:45.958072 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 21:20:45.958072 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 21:20:45.958072 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 21:20:45.958072 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 21:20:45.958072 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPKMhB36sxHtTwvN5cR_FDx6677Bk3r96uZe9x8RsKj2kP41h8elma4Sfp2Sil3wffnoaQT-coMFt-1I-ubK46x1CIQQbRLJJWc6ISWYT8YHNWLLnEGq51UhoqUKdKybGmNCaSC1unJV9CeCDYPI8cjjYW6_GmoH3684NnCEjfslKtuc Oct 04 21:20:45.958072 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 21:20:45.958072 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 21:20:45.958072 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 21:20:45.958072 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 21:20:45.958072 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 21:20:45.958072 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 21:20:45.958072 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: 0d78e06d720d438a9308ae138902f847 Oct 04 21:20:45.958072 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-TestVolumeBootPattern-1361369473 Oct 04 21:20:45.958072 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 21:20:45.958072 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 21:20:45.958072 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0d78e06d720d438a9308ae138902f847", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0d78e06d720d438a9308ae138902f847"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0d78e06d720d438a9308ae138902f847"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0d78e06d720d438a9308ae138902f847"}]}] Oct 04 21:20:45.958072 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-TestVolumeBootPattern-1361369473 Oct 04 21:20:45.958072 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: 0d78e06d720d438a9308ae138902f847 Oct 04 21:20:45.958072 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-TestVolumeBootPattern-1361369473 Oct 04 21:20:45.958072 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-TestVolumeBootPattern-1361369473-project Oct 04 21:20:45.958072 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 21:20:45.958072 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 21:20:45.958072 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: ad7b0b59fad1429e95591b21e33ccbaa Oct 04 21:20:45.958072 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-TestVolumeBootPattern-1361369473-project Oct 04 21:20:45.958072 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 21:20:45.958072 n-d-854823-8 devstack@n-api.service[128801]: exception: Instance f00182c9-26da-4727-94f7-516d38353510 could not be found. Oct 04 21:20:45.958072 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': 'f00182c9-26da-4727-94f7-516d38353510'} Oct 04 21:20:45.958072 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:20:45.958072 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:20:45.958072 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:20:45.958072 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:20:45.958072 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:20:45.958072 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:20:45.958072 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:20:45.958072 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:20:45.958072 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:20:45.958072 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:20:45.958072 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f00182c9-26da-4727-94f7-516d38353510 could not be found. Oct 04 21:20:45.958072 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:20:45.958072 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:20:45.958072 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:20:45.958072 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:20:45.958072 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:20:45.958072 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:20:45.958072 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:20:45.958072 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:20:45.958072 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:20:45.958072 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:20:45.958072 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:20:45.958072 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:20:45.958072 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:20:45.958072 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:20:45.958072 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:20:45.958072 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:20:45.958072 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f00182c9-26da-4727-94f7-516d38353510 could not be found. Oct 04 21:20:45.958072 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:20:45.958072 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:20:45.958072 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:20:45.963381 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:20:45.963381 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:20:45.963381 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:20:45.963381 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:20:45.963381 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:20:45.963381 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f00182c9-26da-4727-94f7-516d38353510 could not be found. Oct 04 21:20:45.963381 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:20:45.963381 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0bb7e50b-29c0-4c44-9834-67a2de764aec tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Returning 404 to user: Instance f00182c9-26da-4727-94f7-516d38353510 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:20:45.964336 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-0bb7e50b-29c0-4c44-9834-67a2de764aec tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/f00182c9-26da-4727-94f7-516d38353510" status: 404 len: 111 microversion: 2.1 time: 0.040059 Oct 04 21:20:45.968422 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3061/6155] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:20:45 2022] GET /compute/v2.1/servers/f00182c9-26da-4727-94f7-516d38353510 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 21:21:06.858027 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-03521ad6-fbb2-4e52-9c34-6ff1e6b1f0d8 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-2106037346", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "d5130c65-7162-42cc-8928-8c48267df74d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "975b1130-f216-463e-808d-0d3403b17918"}]}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:21:06.868746 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:21:06.869476 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=61,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:21:06.926370 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.network.neutron [None req-03521ad6-fbb2-4e52-9c34-6ff1e6b1f0d8 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] validate_networks() for [('975b1130-f216-463e-808d-0d3403b17918', None, None, None, None, None)] {{(pid=128802) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:21:07.308063 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-03521ad6-fbb2-4e52-9c34-6ff1e6b1f0d8 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Flavor limits 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:21:07.308489 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-03521ad6-fbb2-4e52-9c34-6ff1e6b1f0d8 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Image limits 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:21:07.309607 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-03521ad6-fbb2-4e52-9c34-6ff1e6b1f0d8 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Flavor pref 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:21:07.310013 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-03521ad6-fbb2-4e52-9c34-6ff1e6b1f0d8 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Image pref 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:21:07.310447 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-03521ad6-fbb2-4e52-9c34-6ff1e6b1f0d8 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:21:07.319742 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-03521ad6-fbb2-4e52-9c34-6ff1e6b1f0d8 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:07.320222 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-03521ad6-fbb2-4e52-9c34-6ff1e6b1f0d8 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:07.320662 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-03521ad6-fbb2-4e52-9c34-6ff1e6b1f0d8 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:07.321391 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-03521ad6-fbb2-4e52-9c34-6ff1e6b1f0d8 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:07.321846 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-03521ad6-fbb2-4e52-9c34-6ff1e6b1f0d8 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:07.322274 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-03521ad6-fbb2-4e52-9c34-6ff1e6b1f0d8 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:07.339472 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-03521ad6-fbb2-4e52-9c34-6ff1e6b1f0d8 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Getting quotas for project 0d78e06d720d438a9308ae138902f847. Resources: {'ram', 'instances', 'cores'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:21:07.344947 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-03521ad6-fbb2-4e52-9c34-6ff1e6b1f0d8 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Getting quotas for user ad7b0b59fad1429e95591b21e33ccbaa and project 0d78e06d720d438a9308ae138902f847. Resources: {'ram', 'instances', 'cores'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:21:07.404724 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-03521ad6-fbb2-4e52-9c34-6ff1e6b1f0d8 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Going to run 1 instances... {{(pid=128802) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:21:07.406878 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-03521ad6-fbb2-4e52-9c34-6ff1e6b1f0d8 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: 5f1c57e2-0880-472c-81e0-da0981e3791c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d5130c65-7162-42cc-8928-8c48267df74d',volume_size=None,volume_type=None)] {{(pid=128802) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:21:07.543655 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-03521ad6-fbb2-4e52-9c34-6ff1e6b1f0d8 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.689727 Oct 04 21:21:07.544757 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3095/6156] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 21:21:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 692 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:21:07.556070 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6c659d04-baf9-446c-b620-65a7fbd5c0f6 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:07.556836 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-6c659d04-baf9-446c-b620-65a7fbd5c0f6 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: 5f1c57e2-0880-472c-81e0-da0981e3791c] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:07.562170 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=19 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:21:07.562951 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=47 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:21:07.616100 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-6c659d04-baf9-446c-b620-65a7fbd5c0f6 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:07.625909 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-6c659d04-baf9-446c-b620-65a7fbd5c0f6 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/5f1c57e2-0880-472c-81e0-da0981e3791c" status: 200 len: 1071 microversion: 2.1 time: 0.073864 Oct 04 21:21:07.626714 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3062/6157] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:21:07 2022] GET /compute/v2.1/servers/5f1c57e2-0880-472c-81e0-da0981e3791c => generated 1071 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:21:08.650815 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-f5109ae9-a3e3-46ae-b4ed-38f5dbb8533b tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:08.651444 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-f5109ae9-a3e3-46ae-b4ed-38f5dbb8533b tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: 5f1c57e2-0880-472c-81e0-da0981e3791c] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:08.662926 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f5109ae9-a3e3-46ae-b4ed-38f5dbb8533b tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:08.663926 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f5109ae9-a3e3-46ae-b4ed-38f5dbb8533b tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:08.664611 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f5109ae9-a3e3-46ae-b4ed-38f5dbb8533b tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:08.665831 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f5109ae9-a3e3-46ae-b4ed-38f5dbb8533b tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:08.666659 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f5109ae9-a3e3-46ae-b4ed-38f5dbb8533b tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:08.667317 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f5109ae9-a3e3-46ae-b4ed-38f5dbb8533b tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:09.079717 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-f5109ae9-a3e3-46ae-b4ed-38f5dbb8533b tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:09.094488 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-f5109ae9-a3e3-46ae-b4ed-38f5dbb8533b tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/5f1c57e2-0880-472c-81e0-da0981e3791c" status: 200 len: 1177 microversion: 2.1 time: 0.447405 Oct 04 21:21:09.095913 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3096/6158] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:21:08 2022] GET /compute/v2.1/servers/5f1c57e2-0880-472c-81e0-da0981e3791c => generated 1177 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:21:10.117555 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-bc683a8c-ca3c-4a37-8b20-12ea7e919d9d tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:10.118853 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-bc683a8c-ca3c-4a37-8b20-12ea7e919d9d tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: 5f1c57e2-0880-472c-81e0-da0981e3791c] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:10.130065 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bc683a8c-ca3c-4a37-8b20-12ea7e919d9d tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:10.130845 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bc683a8c-ca3c-4a37-8b20-12ea7e919d9d tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:10.131441 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bc683a8c-ca3c-4a37-8b20-12ea7e919d9d tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:10.132979 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bc683a8c-ca3c-4a37-8b20-12ea7e919d9d tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:10.134304 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bc683a8c-ca3c-4a37-8b20-12ea7e919d9d tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:10.134779 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bc683a8c-ca3c-4a37-8b20-12ea7e919d9d tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:10.419090 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-bc683a8c-ca3c-4a37-8b20-12ea7e919d9d tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:10.431015 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-bc683a8c-ca3c-4a37-8b20-12ea7e919d9d tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/5f1c57e2-0880-472c-81e0-da0981e3791c" status: 200 len: 1229 microversion: 2.1 time: 0.317711 Oct 04 21:21:10.433386 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3063/6159] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:21:10 2022] GET /compute/v2.1/servers/5f1c57e2-0880-472c-81e0-da0981e3791c => generated 1229 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:21:10.646862 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-0dc4dc5e-d14b-4b6e-8bc3-5a3c7840d6ed req-0daaf5df-98d9-4f1a-9ed9-0374a61d489b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f1c57e2-0880-472c-81e0-da0981e3791c", "tag": "a06b15f8-910c-41a5-8596-8d4e35c1f011"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:21:10.665355 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-0dc4dc5e-d14b-4b6e-8bc3-5a3c7840d6ed req-0daaf5df-98d9-4f1a-9ed9-0374a61d489b service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:10.666300 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-0dc4dc5e-d14b-4b6e-8bc3-5a3c7840d6ed req-0daaf5df-98d9-4f1a-9ed9-0374a61d489b service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:10.667739 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-0dc4dc5e-d14b-4b6e-8bc3-5a3c7840d6ed req-0daaf5df-98d9-4f1a-9ed9-0374a61d489b service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:10.687715 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-0dc4dc5e-d14b-4b6e-8bc3-5a3c7840d6ed req-0daaf5df-98d9-4f1a-9ed9-0374a61d489b service nova] Creating event network-changed:a06b15f8-910c-41a5-8596-8d4e35c1f011 for instance 5f1c57e2-0880-472c-81e0-da0981e3791c on n-h2-854823-8 Oct 04 21:21:10.696553 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-0dc4dc5e-d14b-4b6e-8bc3-5a3c7840d6ed req-0daaf5df-98d9-4f1a-9ed9-0374a61d489b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055410 Oct 04 21:21:10.699510 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3097/6160] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:21:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:21:11.471972 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6100b1a3-e28c-42d2-ab6a-5c8483e0bad1 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:11.474231 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-6100b1a3-e28c-42d2-ab6a-5c8483e0bad1 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: 5f1c57e2-0880-472c-81e0-da0981e3791c] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:11.491022 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6100b1a3-e28c-42d2-ab6a-5c8483e0bad1 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:11.492444 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6100b1a3-e28c-42d2-ab6a-5c8483e0bad1 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:11.493607 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6100b1a3-e28c-42d2-ab6a-5c8483e0bad1 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:11.495329 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6100b1a3-e28c-42d2-ab6a-5c8483e0bad1 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:11.497629 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6100b1a3-e28c-42d2-ab6a-5c8483e0bad1 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:11.499664 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6100b1a3-e28c-42d2-ab6a-5c8483e0bad1 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:11.736009 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-6100b1a3-e28c-42d2-ab6a-5c8483e0bad1 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:11.748056 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-6100b1a3-e28c-42d2-ab6a-5c8483e0bad1 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/5f1c57e2-0880-472c-81e0-da0981e3791c" status: 200 len: 1229 microversion: 2.1 time: 0.293555 Oct 04 21:21:11.750046 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3064/6161] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:21:11 2022] GET /compute/v2.1/servers/5f1c57e2-0880-472c-81e0-da0981e3791c => generated 1229 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:21:12.773295 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-ba8e05f9-f4cc-4f7b-a246-ba7141c833a7 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:12.773994 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-ba8e05f9-f4cc-4f7b-a246-ba7141c833a7 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: 5f1c57e2-0880-472c-81e0-da0981e3791c] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:12.781969 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ba8e05f9-f4cc-4f7b-a246-ba7141c833a7 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:12.782476 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ba8e05f9-f4cc-4f7b-a246-ba7141c833a7 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:12.782938 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ba8e05f9-f4cc-4f7b-a246-ba7141c833a7 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:12.783834 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ba8e05f9-f4cc-4f7b-a246-ba7141c833a7 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:12.784289 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ba8e05f9-f4cc-4f7b-a246-ba7141c833a7 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:12.784708 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ba8e05f9-f4cc-4f7b-a246-ba7141c833a7 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:12.923988 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-ba8e05f9-f4cc-4f7b-a246-ba7141c833a7 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:12.931997 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-ba8e05f9-f4cc-4f7b-a246-ba7141c833a7 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/5f1c57e2-0880-472c-81e0-da0981e3791c" status: 200 len: 1229 microversion: 2.1 time: 0.163056 Oct 04 21:21:12.939882 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3098/6162] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:21:12 2022] GET /compute/v2.1/servers/5f1c57e2-0880-472c-81e0-da0981e3791c => generated 1229 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:21:13.955519 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0a5d5e97-0661-4580-804f-71516ca53808 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:13.956137 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-0a5d5e97-0661-4580-804f-71516ca53808 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: 5f1c57e2-0880-472c-81e0-da0981e3791c] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:13.960514 n-d-854823-8 devstack@n-api.service[128801]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 21:21:13.960717 n-d-854823-8 devstack@n-api.service[128801]: Tue Oct 4 21:21:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5f1c57e2-0880-472c-81e0-da0981e3791c (ip 10.222.0.33) !!! Oct 04 21:21:13.985284 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0a5d5e97-0661-4580-804f-71516ca53808 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:13.986506 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0a5d5e97-0661-4580-804f-71516ca53808 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:13.987218 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0a5d5e97-0661-4580-804f-71516ca53808 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:13.988124 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0a5d5e97-0661-4580-804f-71516ca53808 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:13.988802 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0a5d5e97-0661-4580-804f-71516ca53808 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:13.989449 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0a5d5e97-0661-4580-804f-71516ca53808 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:14.177029 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-0a5d5e97-0661-4580-804f-71516ca53808 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:14.188992 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-0a5d5e97-0661-4580-804f-71516ca53808 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/5f1c57e2-0880-472c-81e0-da0981e3791c" status: 200 len: 1229 microversion: 2.1 time: 0.236705 Oct 04 21:21:14.190122 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3065/6163] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:21:13 2022] GET /compute/v2.1/servers/5f1c57e2-0880-472c-81e0-da0981e3791c => generated 1229 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:21:15.212800 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-d7918744-3e4c-4916-959f-8f938f5c292f tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:15.213356 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-d7918744-3e4c-4916-959f-8f938f5c292f tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: 5f1c57e2-0880-472c-81e0-da0981e3791c] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:15.221692 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d7918744-3e4c-4916-959f-8f938f5c292f tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:15.222203 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d7918744-3e4c-4916-959f-8f938f5c292f tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:15.222674 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d7918744-3e4c-4916-959f-8f938f5c292f tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:15.223372 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d7918744-3e4c-4916-959f-8f938f5c292f tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:15.223820 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d7918744-3e4c-4916-959f-8f938f5c292f tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:15.224240 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d7918744-3e4c-4916-959f-8f938f5c292f tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:15.360066 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-d7918744-3e4c-4916-959f-8f938f5c292f tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:15.367905 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-d7918744-3e4c-4916-959f-8f938f5c292f tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/5f1c57e2-0880-472c-81e0-da0981e3791c" status: 200 len: 1217 microversion: 2.1 time: 0.159256 Oct 04 21:21:15.368483 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3099/6164] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:21:15 2022] GET /compute/v2.1/servers/5f1c57e2-0880-472c-81e0-da0981e3791c => generated 1217 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:21:16.392045 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-960b033f-9e78-45d5-b112-255c9311413a tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:16.392637 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-960b033f-9e78-45d5-b112-255c9311413a tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: 5f1c57e2-0880-472c-81e0-da0981e3791c] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:16.399496 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-960b033f-9e78-45d5-b112-255c9311413a tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:16.399992 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-960b033f-9e78-45d5-b112-255c9311413a tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:16.400428 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-960b033f-9e78-45d5-b112-255c9311413a tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:16.401136 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-960b033f-9e78-45d5-b112-255c9311413a tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:16.401596 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-960b033f-9e78-45d5-b112-255c9311413a tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:16.402071 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-960b033f-9e78-45d5-b112-255c9311413a tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:16.533814 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-960b033f-9e78-45d5-b112-255c9311413a tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:16.541710 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-960b033f-9e78-45d5-b112-255c9311413a tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/5f1c57e2-0880-472c-81e0-da0981e3791c" status: 200 len: 1217 microversion: 2.1 time: 0.153697 Oct 04 21:21:16.542396 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3066/6165] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:21:16 2022] GET /compute/v2.1/servers/5f1c57e2-0880-472c-81e0-da0981e3791c => generated 1217 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:21:17.564226 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-58a92333-4932-4fbd-bfe8-b584d8063906 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:17.564996 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-58a92333-4932-4fbd-bfe8-b584d8063906 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: 5f1c57e2-0880-472c-81e0-da0981e3791c] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:17.568023 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell0:SELECT=2 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:21:17.568748 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell0:SELECT=6 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:21:17.576042 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-58a92333-4932-4fbd-bfe8-b584d8063906 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:17.576497 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-58a92333-4932-4fbd-bfe8-b584d8063906 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:17.576999 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-58a92333-4932-4fbd-bfe8-b584d8063906 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:17.577740 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-58a92333-4932-4fbd-bfe8-b584d8063906 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:17.578408 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-58a92333-4932-4fbd-bfe8-b584d8063906 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:17.578652 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-58a92333-4932-4fbd-bfe8-b584d8063906 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:17.721776 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-58a92333-4932-4fbd-bfe8-b584d8063906 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:17.730746 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-58a92333-4932-4fbd-bfe8-b584d8063906 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/5f1c57e2-0880-472c-81e0-da0981e3791c" status: 200 len: 1217 microversion: 2.1 time: 0.170654 Oct 04 21:21:17.731670 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3100/6166] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:21:17 2022] GET /compute/v2.1/servers/5f1c57e2-0880-472c-81e0-da0981e3791c => generated 1217 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:21:18.756496 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d1b9fa8d-b60e-403e-8392-f0b24a8801ff tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:18.757731 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d1b9fa8d-b60e-403e-8392-f0b24a8801ff tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: 5f1c57e2-0880-472c-81e0-da0981e3791c] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:18.761191 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:21:18.776542 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d1b9fa8d-b60e-403e-8392-f0b24a8801ff tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:18.777194 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d1b9fa8d-b60e-403e-8392-f0b24a8801ff tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:18.777642 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d1b9fa8d-b60e-403e-8392-f0b24a8801ff tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:18.778575 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d1b9fa8d-b60e-403e-8392-f0b24a8801ff tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:18.779042 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d1b9fa8d-b60e-403e-8392-f0b24a8801ff tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:18.779471 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d1b9fa8d-b60e-403e-8392-f0b24a8801ff tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:18.916852 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d1b9fa8d-b60e-403e-8392-f0b24a8801ff tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:18.925772 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d1b9fa8d-b60e-403e-8392-f0b24a8801ff tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/5f1c57e2-0880-472c-81e0-da0981e3791c" status: 200 len: 1217 microversion: 2.1 time: 0.174323 Oct 04 21:21:18.926417 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3067/6167] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:21:18 2022] GET /compute/v2.1/servers/5f1c57e2-0880-472c-81e0-da0981e3791c => generated 1217 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:21:19.949958 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-d944540d-e38d-420b-8725-659c587493a6 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:19.950659 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-d944540d-e38d-420b-8725-659c587493a6 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: 5f1c57e2-0880-472c-81e0-da0981e3791c] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:19.958082 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d944540d-e38d-420b-8725-659c587493a6 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:19.958609 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d944540d-e38d-420b-8725-659c587493a6 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:19.959050 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d944540d-e38d-420b-8725-659c587493a6 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:19.959755 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d944540d-e38d-420b-8725-659c587493a6 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:19.960210 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d944540d-e38d-420b-8725-659c587493a6 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:19.960637 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d944540d-e38d-420b-8725-659c587493a6 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:20.107573 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-d944540d-e38d-420b-8725-659c587493a6 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:20.115632 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-d944540d-e38d-420b-8725-659c587493a6 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/5f1c57e2-0880-472c-81e0-da0981e3791c" status: 200 len: 1217 microversion: 2.1 time: 0.170314 Oct 04 21:21:20.116321 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3101/6168] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:21:19 2022] GET /compute/v2.1/servers/5f1c57e2-0880-472c-81e0-da0981e3791c => generated 1217 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:21:21.139745 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-4f2e408b-45a4-45db-b54e-6326b93e107c tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:21.140397 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-4f2e408b-45a4-45db-b54e-6326b93e107c tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: 5f1c57e2-0880-472c-81e0-da0981e3791c] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:21.147290 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4f2e408b-45a4-45db-b54e-6326b93e107c tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:21.147778 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4f2e408b-45a4-45db-b54e-6326b93e107c tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:21.148210 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4f2e408b-45a4-45db-b54e-6326b93e107c tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:21.148907 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4f2e408b-45a4-45db-b54e-6326b93e107c tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:21.149362 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4f2e408b-45a4-45db-b54e-6326b93e107c tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:21.149786 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4f2e408b-45a4-45db-b54e-6326b93e107c tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:21.295514 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-4f2e408b-45a4-45db-b54e-6326b93e107c tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:21.304093 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-4f2e408b-45a4-45db-b54e-6326b93e107c tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/5f1c57e2-0880-472c-81e0-da0981e3791c" status: 200 len: 1217 microversion: 2.1 time: 0.168960 Oct 04 21:21:21.304694 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3068/6169] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:21:21 2022] GET /compute/v2.1/servers/5f1c57e2-0880-472c-81e0-da0981e3791c => generated 1217 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:21:22.329022 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-0be31b65-6ba5-4a96-ad31-1708565bc8a0 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:22.329662 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-0be31b65-6ba5-4a96-ad31-1708565bc8a0 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: 5f1c57e2-0880-472c-81e0-da0981e3791c] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:22.337001 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0be31b65-6ba5-4a96-ad31-1708565bc8a0 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:22.337489 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0be31b65-6ba5-4a96-ad31-1708565bc8a0 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:22.337925 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0be31b65-6ba5-4a96-ad31-1708565bc8a0 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:22.338685 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0be31b65-6ba5-4a96-ad31-1708565bc8a0 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:22.339141 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0be31b65-6ba5-4a96-ad31-1708565bc8a0 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:22.340075 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0be31b65-6ba5-4a96-ad31-1708565bc8a0 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:22.485451 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-0be31b65-6ba5-4a96-ad31-1708565bc8a0 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:22.493614 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-0be31b65-6ba5-4a96-ad31-1708565bc8a0 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/5f1c57e2-0880-472c-81e0-da0981e3791c" status: 200 len: 1217 microversion: 2.1 time: 0.168532 Oct 04 21:21:22.494548 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3102/6170] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:21:22 2022] GET /compute/v2.1/servers/5f1c57e2-0880-472c-81e0-da0981e3791c => generated 1217 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:21:23.517579 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7a3ee407-a673-4475-9522-7bd37f20a8a6 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:23.518178 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-7a3ee407-a673-4475-9522-7bd37f20a8a6 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: 5f1c57e2-0880-472c-81e0-da0981e3791c] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:23.525068 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7a3ee407-a673-4475-9522-7bd37f20a8a6 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:23.525549 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7a3ee407-a673-4475-9522-7bd37f20a8a6 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:23.525985 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7a3ee407-a673-4475-9522-7bd37f20a8a6 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:23.526715 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7a3ee407-a673-4475-9522-7bd37f20a8a6 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:23.527817 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7a3ee407-a673-4475-9522-7bd37f20a8a6 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:23.528238 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7a3ee407-a673-4475-9522-7bd37f20a8a6 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:23.666737 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-7a3ee407-a673-4475-9522-7bd37f20a8a6 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:23.675297 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-7a3ee407-a673-4475-9522-7bd37f20a8a6 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/5f1c57e2-0880-472c-81e0-da0981e3791c" status: 200 len: 1217 microversion: 2.1 time: 0.161688 Oct 04 21:21:23.675897 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3069/6171] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:21:23 2022] GET /compute/v2.1/servers/5f1c57e2-0880-472c-81e0-da0981e3791c => generated 1217 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:21:24.600662 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-1449d5bd-451e-4d79-995c-087637c36d2c req-1c7189c2-f297-4a7f-a4de-9614586b2386 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f1c57e2-0880-472c-81e0-da0981e3791c", "name": "network-vif-plugged", "status": "completed", "tag": "a06b15f8-910c-41a5-8596-8d4e35c1f011"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:21:24.613711 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-1449d5bd-451e-4d79-995c-087637c36d2c req-1c7189c2-f297-4a7f-a4de-9614586b2386 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:24.614590 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-1449d5bd-451e-4d79-995c-087637c36d2c req-1c7189c2-f297-4a7f-a4de-9614586b2386 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:24.615081 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-1449d5bd-451e-4d79-995c-087637c36d2c req-1c7189c2-f297-4a7f-a4de-9614586b2386 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:24.626969 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-1449d5bd-451e-4d79-995c-087637c36d2c req-1c7189c2-f297-4a7f-a4de-9614586b2386 service nova] Creating event network-vif-plugged:a06b15f8-910c-41a5-8596-8d4e35c1f011 for instance 5f1c57e2-0880-472c-81e0-da0981e3791c on n-h2-854823-8 Oct 04 21:21:24.632394 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-1449d5bd-451e-4d79-995c-087637c36d2c req-1c7189c2-f297-4a7f-a4de-9614586b2386 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035758 Oct 04 21:21:24.633075 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3103/6172] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:21:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:21:24.700362 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-25c71817-f7b4-4b01-8f40-1dc0ab73a465 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:24.700963 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-25c71817-f7b4-4b01-8f40-1dc0ab73a465 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: 5f1c57e2-0880-472c-81e0-da0981e3791c] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:24.710617 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-25c71817-f7b4-4b01-8f40-1dc0ab73a465 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:24.711409 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-25c71817-f7b4-4b01-8f40-1dc0ab73a465 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:24.712071 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-25c71817-f7b4-4b01-8f40-1dc0ab73a465 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:24.712954 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-25c71817-f7b4-4b01-8f40-1dc0ab73a465 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:24.713573 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-25c71817-f7b4-4b01-8f40-1dc0ab73a465 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:24.714158 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-25c71817-f7b4-4b01-8f40-1dc0ab73a465 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:24.911306 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-25c71817-f7b4-4b01-8f40-1dc0ab73a465 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:24.919923 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-25c71817-f7b4-4b01-8f40-1dc0ab73a465 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/5f1c57e2-0880-472c-81e0-da0981e3791c" status: 200 len: 1217 microversion: 2.1 time: 0.224977 Oct 04 21:21:24.920516 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3070/6173] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:21:24 2022] GET /compute/v2.1/servers/5f1c57e2-0880-472c-81e0-da0981e3791c => generated 1217 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:21:25.945159 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-1a1d4b6a-2e18-46f7-8040-54c981e531c6 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:25.945950 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-1a1d4b6a-2e18-46f7-8040-54c981e531c6 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: 5f1c57e2-0880-472c-81e0-da0981e3791c] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:25.955391 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1a1d4b6a-2e18-46f7-8040-54c981e531c6 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:25.955879 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1a1d4b6a-2e18-46f7-8040-54c981e531c6 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:25.956311 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1a1d4b6a-2e18-46f7-8040-54c981e531c6 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:25.957027 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1a1d4b6a-2e18-46f7-8040-54c981e531c6 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:25.957481 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1a1d4b6a-2e18-46f7-8040-54c981e531c6 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:25.958215 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1a1d4b6a-2e18-46f7-8040-54c981e531c6 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:26.100532 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-1a1d4b6a-2e18-46f7-8040-54c981e531c6 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:26.109074 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-1a1d4b6a-2e18-46f7-8040-54c981e531c6 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/5f1c57e2-0880-472c-81e0-da0981e3791c" status: 200 len: 1405 microversion: 2.1 time: 0.169772 Oct 04 21:21:26.109664 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3104/6174] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:21:25 2022] GET /compute/v2.1/servers/5f1c57e2-0880-472c-81e0-da0981e3791c => generated 1405 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:21:26.131794 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b95a0666-08da-4402-a0a8-c3e50731aca5 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:26.132362 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b95a0666-08da-4402-a0a8-c3e50731aca5 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: 5f1c57e2-0880-472c-81e0-da0981e3791c] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:26.140433 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b95a0666-08da-4402-a0a8-c3e50731aca5 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:26.140984 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b95a0666-08da-4402-a0a8-c3e50731aca5 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:26.141496 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b95a0666-08da-4402-a0a8-c3e50731aca5 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:26.142235 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b95a0666-08da-4402-a0a8-c3e50731aca5 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:26.142733 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b95a0666-08da-4402-a0a8-c3e50731aca5 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:26.143166 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b95a0666-08da-4402-a0a8-c3e50731aca5 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:26.277524 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-b95a0666-08da-4402-a0a8-c3e50731aca5 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:26.285477 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b95a0666-08da-4402-a0a8-c3e50731aca5 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/5f1c57e2-0880-472c-81e0-da0981e3791c" status: 200 len: 1405 microversion: 2.1 time: 0.157832 Oct 04 21:21:26.286058 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3071/6175] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:21:26 2022] GET /compute/v2.1/servers/5f1c57e2-0880-472c-81e0-da0981e3791c => generated 1405 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:21:26.309206 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-3898d03b-fba4-476a-a243-b04bac0e8362 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-1927419431"}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:21:26.311618 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-3898d03b-fba4-476a-a243-b04bac0e8362 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: 5f1c57e2-0880-472c-81e0-da0981e3791c] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:26.317944 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3898d03b-fba4-476a-a243-b04bac0e8362 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:26.318581 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3898d03b-fba4-476a-a243-b04bac0e8362 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:26.319081 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3898d03b-fba4-476a-a243-b04bac0e8362 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:26.319844 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3898d03b-fba4-476a-a243-b04bac0e8362 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:26.320369 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3898d03b-fba4-476a-a243-b04bac0e8362 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:26.320861 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3898d03b-fba4-476a-a243-b04bac0e8362 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:26.420227 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.compute.api [None req-3898d03b-fba4-476a-a243-b04bac0e8362 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: 5f1c57e2-0880-472c-81e0-da0981e3791c] Attempting to quiesce instance before volume snapshot. Oct 04 21:21:26.513385 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.compute.api [None req-3898d03b-fba4-476a-a243-b04bac0e8362 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: 5f1c57e2-0880-472c-81e0-da0981e3791c] Skipping quiescing instance because the operation is not supported by the underlying compute driver. Oct 04 21:21:26.585707 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-3898d03b-fba4-476a-a243-b04bac0e8362 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: 5f1c57e2-0880-472c-81e0-da0981e3791c] Creating snapshot from volume d5130c65-7162-42cc-8928-8c48267df74d. {{(pid=128802) snapshot_instance /opt/stack/nova/nova/compute/api.py:3509}} Oct 04 21:21:27.488474 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-3898d03b-fba4-476a-a243-b04bac0e8362 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "POST /compute/v2.1/servers/5f1c57e2-0880-472c-81e0-da0981e3791c/action" status: 202 len: 0 microversion: 2.1 time: 1.183779 Oct 04 21:21:27.490928 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3105/6176] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 21:21:26 2022] POST /compute/v2.1/servers/5f1c57e2-0880-472c-81e0-da0981e3791c/action => generated 0 bytes in 1187 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 04 21:21:28.662876 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-edc90304-e9ed-4655-b77c-2394d016dcb4 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-638037226", "imageRef": "f33f0f19-7819-474c-b159-1bc0dda9e298", "flavorRef": "452", "networks": [{"uuid": "975b1130-f216-463e-808d-0d3403b17918"}]}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:21:28.724063 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.network.neutron [None req-edc90304-e9ed-4655-b77c-2394d016dcb4 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] validate_networks() for [('975b1130-f216-463e-808d-0d3403b17918', None, None, None, None, None)] {{(pid=128801) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:21:29.107750 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-edc90304-e9ed-4655-b77c-2394d016dcb4 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Flavor limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:21:29.108457 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-edc90304-e9ed-4655-b77c-2394d016dcb4 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Image limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:21:29.109050 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-edc90304-e9ed-4655-b77c-2394d016dcb4 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Flavor pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:21:29.109550 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-edc90304-e9ed-4655-b77c-2394d016dcb4 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Image pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:21:29.110042 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-edc90304-e9ed-4655-b77c-2394d016dcb4 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:21:29.119408 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-edc90304-e9ed-4655-b77c-2394d016dcb4 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:29.119982 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-edc90304-e9ed-4655-b77c-2394d016dcb4 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:29.120549 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-edc90304-e9ed-4655-b77c-2394d016dcb4 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:29.121295 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-edc90304-e9ed-4655-b77c-2394d016dcb4 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:29.121757 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-edc90304-e9ed-4655-b77c-2394d016dcb4 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:29.122189 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-edc90304-e9ed-4655-b77c-2394d016dcb4 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:29.139672 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-edc90304-e9ed-4655-b77c-2394d016dcb4 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Getting quotas for project 0d78e06d720d438a9308ae138902f847. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:21:29.145077 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-edc90304-e9ed-4655-b77c-2394d016dcb4 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Getting quotas for user ad7b0b59fad1429e95591b21e33ccbaa and project 0d78e06d720d438a9308ae138902f847. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:21:29.158491 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-edc90304-e9ed-4655-b77c-2394d016dcb4 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Going to run 1 instances... {{(pid=128801) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:21:29.161095 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-edc90304-e9ed-4655-b77c-2394d016dcb4 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: f9913cee-0c42-4925-bf29-cc6b5397989c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/sda',device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='0c7756fd-2130-44b8-aa3f-ee7e5a4349b5',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=128801) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:21:29.243070 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-edc90304-e9ed-4655-b77c-2394d016dcb4 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.584093 Oct 04 21:21:29.243999 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3072/6177] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 21:21:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 586 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:21:29.257316 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-c668d2da-6617-4548-9d0c-e49b69254c92 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:29.258047 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-c668d2da-6617-4548-9d0c-e49b69254c92 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: f9913cee-0c42-4925-bf29-cc6b5397989c] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:29.316410 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-c668d2da-6617-4548-9d0c-e49b69254c92 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:29.327454 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-c668d2da-6617-4548-9d0c-e49b69254c92 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/f9913cee-0c42-4925-bf29-cc6b5397989c" status: 200 len: 1229 microversion: 2.1 time: 0.075286 Oct 04 21:21:29.328381 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3106/6178] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:21:29 2022] GET /compute/v2.1/servers/f9913cee-0c42-4925-bf29-cc6b5397989c => generated 1229 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:21:30.352213 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0a0fdc1e-e424-4d3f-b808-c8048b2be12f tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:30.353469 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-0a0fdc1e-e424-4d3f-b808-c8048b2be12f tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: f9913cee-0c42-4925-bf29-cc6b5397989c] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:30.360585 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0a0fdc1e-e424-4d3f-b808-c8048b2be12f tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:30.361077 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0a0fdc1e-e424-4d3f-b808-c8048b2be12f tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:30.361553 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0a0fdc1e-e424-4d3f-b808-c8048b2be12f tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:30.362260 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0a0fdc1e-e424-4d3f-b808-c8048b2be12f tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:30.362825 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0a0fdc1e-e424-4d3f-b808-c8048b2be12f tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:30.363244 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0a0fdc1e-e424-4d3f-b808-c8048b2be12f tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:30.443582 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-0a0fdc1e-e424-4d3f-b808-c8048b2be12f tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:30.453768 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-0a0fdc1e-e424-4d3f-b808-c8048b2be12f tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/f9913cee-0c42-4925-bf29-cc6b5397989c" status: 200 len: 1289 microversion: 2.1 time: 0.106865 Oct 04 21:21:30.455104 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3073/6179] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:21:30 2022] GET /compute/v2.1/servers/f9913cee-0c42-4925-bf29-cc6b5397989c => generated 1289 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:21:31.481935 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-f076e8c5-189f-4dfa-9fba-8b3e4bbdac18 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:31.485066 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-f076e8c5-189f-4dfa-9fba-8b3e4bbdac18 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: f9913cee-0c42-4925-bf29-cc6b5397989c] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:31.497675 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f076e8c5-189f-4dfa-9fba-8b3e4bbdac18 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:31.498750 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f076e8c5-189f-4dfa-9fba-8b3e4bbdac18 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:31.499598 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f076e8c5-189f-4dfa-9fba-8b3e4bbdac18 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:31.500522 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f076e8c5-189f-4dfa-9fba-8b3e4bbdac18 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:31.501160 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f076e8c5-189f-4dfa-9fba-8b3e4bbdac18 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:31.502574 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f076e8c5-189f-4dfa-9fba-8b3e4bbdac18 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:31.714801 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-f076e8c5-189f-4dfa-9fba-8b3e4bbdac18 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:31.723960 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-f076e8c5-189f-4dfa-9fba-8b3e4bbdac18 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/f9913cee-0c42-4925-bf29-cc6b5397989c" status: 200 len: 1341 microversion: 2.1 time: 0.246555 Oct 04 21:21:31.725295 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3107/6180] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:21:31 2022] GET /compute/v2.1/servers/f9913cee-0c42-4925-bf29-cc6b5397989c => generated 1341 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:21:32.358907 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-44828e0b-768a-4fc9-a95e-8c676426238b req-66013c5b-0b68-48ad-abc6-45b56cfe62c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f9913cee-0c42-4925-bf29-cc6b5397989c", "tag": "97d60cb9-8ce4-475c-9390-c8480ba841e5"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:21:32.380522 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-44828e0b-768a-4fc9-a95e-8c676426238b req-66013c5b-0b68-48ad-abc6-45b56cfe62c1 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:32.382073 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-44828e0b-768a-4fc9-a95e-8c676426238b req-66013c5b-0b68-48ad-abc6-45b56cfe62c1 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:32.383038 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-44828e0b-768a-4fc9-a95e-8c676426238b req-66013c5b-0b68-48ad-abc6-45b56cfe62c1 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:32.427771 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-44828e0b-768a-4fc9-a95e-8c676426238b req-66013c5b-0b68-48ad-abc6-45b56cfe62c1 service nova] Creating event network-changed:97d60cb9-8ce4-475c-9390-c8480ba841e5 for instance f9913cee-0c42-4925-bf29-cc6b5397989c on n-h1-854823-8 Oct 04 21:21:32.436728 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-44828e0b-768a-4fc9-a95e-8c676426238b req-66013c5b-0b68-48ad-abc6-45b56cfe62c1 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091223 Oct 04 21:21:32.438955 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3074/6181] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:21:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:21:32.759421 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-f73e360d-d8ef-4dd8-9e13-db346229e910 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:32.760083 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-f73e360d-d8ef-4dd8-9e13-db346229e910 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: f9913cee-0c42-4925-bf29-cc6b5397989c] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:32.774886 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f73e360d-d8ef-4dd8-9e13-db346229e910 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:32.775410 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f73e360d-d8ef-4dd8-9e13-db346229e910 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:32.775867 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f73e360d-d8ef-4dd8-9e13-db346229e910 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:32.776655 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f73e360d-d8ef-4dd8-9e13-db346229e910 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:32.777326 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f73e360d-d8ef-4dd8-9e13-db346229e910 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:32.777973 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f73e360d-d8ef-4dd8-9e13-db346229e910 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:33.011522 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-f73e360d-d8ef-4dd8-9e13-db346229e910 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:33.025279 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-f73e360d-d8ef-4dd8-9e13-db346229e910 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/f9913cee-0c42-4925-bf29-cc6b5397989c" status: 200 len: 1341 microversion: 2.1 time: 0.275722 Oct 04 21:21:33.026505 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3108/6182] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:21:32 2022] GET /compute/v2.1/servers/f9913cee-0c42-4925-bf29-cc6b5397989c => generated 1341 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:21:34.051706 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e301f98a-1dcb-4844-af69-b94e41c753d4 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:34.052521 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e301f98a-1dcb-4844-af69-b94e41c753d4 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: f9913cee-0c42-4925-bf29-cc6b5397989c] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:34.059395 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e301f98a-1dcb-4844-af69-b94e41c753d4 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:34.059955 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e301f98a-1dcb-4844-af69-b94e41c753d4 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:34.060455 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e301f98a-1dcb-4844-af69-b94e41c753d4 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:34.061185 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e301f98a-1dcb-4844-af69-b94e41c753d4 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:34.061711 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e301f98a-1dcb-4844-af69-b94e41c753d4 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:34.062083 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e301f98a-1dcb-4844-af69-b94e41c753d4 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:34.217731 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e301f98a-1dcb-4844-af69-b94e41c753d4 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:34.226539 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e301f98a-1dcb-4844-af69-b94e41c753d4 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/f9913cee-0c42-4925-bf29-cc6b5397989c" status: 200 len: 1341 microversion: 2.1 time: 0.179746 Oct 04 21:21:34.227216 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3075/6183] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:21:34 2022] GET /compute/v2.1/servers/f9913cee-0c42-4925-bf29-cc6b5397989c => generated 1341 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:21:35.251102 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-07cad9ba-9a00-4d41-80ef-50cce97f49ea tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:35.252526 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-07cad9ba-9a00-4d41-80ef-50cce97f49ea tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: f9913cee-0c42-4925-bf29-cc6b5397989c] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:35.263359 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-07cad9ba-9a00-4d41-80ef-50cce97f49ea tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:35.266228 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-07cad9ba-9a00-4d41-80ef-50cce97f49ea tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:35.266228 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-07cad9ba-9a00-4d41-80ef-50cce97f49ea tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:35.266228 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-07cad9ba-9a00-4d41-80ef-50cce97f49ea tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:35.266616 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-07cad9ba-9a00-4d41-80ef-50cce97f49ea tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:35.267017 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-07cad9ba-9a00-4d41-80ef-50cce97f49ea tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:35.447291 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-07cad9ba-9a00-4d41-80ef-50cce97f49ea tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:35.460990 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-07cad9ba-9a00-4d41-80ef-50cce97f49ea tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/f9913cee-0c42-4925-bf29-cc6b5397989c" status: 200 len: 1341 microversion: 2.1 time: 0.215053 Oct 04 21:21:35.461827 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3109/6184] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:21:35 2022] GET /compute/v2.1/servers/f9913cee-0c42-4925-bf29-cc6b5397989c => generated 1341 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:21:36.488549 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9dda9374-8d92-4bb3-9d49-ad0f659b494c tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:36.489815 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-9dda9374-8d92-4bb3-9d49-ad0f659b494c tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: f9913cee-0c42-4925-bf29-cc6b5397989c] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:36.499988 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9dda9374-8d92-4bb3-9d49-ad0f659b494c tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:36.500780 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9dda9374-8d92-4bb3-9d49-ad0f659b494c tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:36.501413 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9dda9374-8d92-4bb3-9d49-ad0f659b494c tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:36.502400 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9dda9374-8d92-4bb3-9d49-ad0f659b494c tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:36.503024 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9dda9374-8d92-4bb3-9d49-ad0f659b494c tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:36.503607 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9dda9374-8d92-4bb3-9d49-ad0f659b494c tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:36.722864 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-9dda9374-8d92-4bb3-9d49-ad0f659b494c tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:36.731790 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-9dda9374-8d92-4bb3-9d49-ad0f659b494c tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/f9913cee-0c42-4925-bf29-cc6b5397989c" status: 200 len: 1341 microversion: 2.1 time: 0.247733 Oct 04 21:21:36.732778 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3076/6185] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:21:36 2022] GET /compute/v2.1/servers/f9913cee-0c42-4925-bf29-cc6b5397989c => generated 1341 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:21:37.763540 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-d5f98d59-f060-471c-b4e2-10982afef500 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:37.765467 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-d5f98d59-f060-471c-b4e2-10982afef500 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: f9913cee-0c42-4925-bf29-cc6b5397989c] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:37.772772 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=3 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:21:37.778212 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d5f98d59-f060-471c-b4e2-10982afef500 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:37.778906 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d5f98d59-f060-471c-b4e2-10982afef500 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:37.780790 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d5f98d59-f060-471c-b4e2-10982afef500 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:37.780790 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d5f98d59-f060-471c-b4e2-10982afef500 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:37.780790 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d5f98d59-f060-471c-b4e2-10982afef500 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:37.782672 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d5f98d59-f060-471c-b4e2-10982afef500 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:37.785207 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=81,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:21:37.962061 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-d5f98d59-f060-471c-b4e2-10982afef500 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:37.971968 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-d5f98d59-f060-471c-b4e2-10982afef500 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/f9913cee-0c42-4925-bf29-cc6b5397989c" status: 200 len: 1341 microversion: 2.1 time: 0.214258 Oct 04 21:21:37.986843 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3110/6186] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:21:37 2022] GET /compute/v2.1/servers/f9913cee-0c42-4925-bf29-cc6b5397989c => generated 1341 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:21:38.997378 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5f53da27-bd17-4b8c-8880-aae93e7e3ad6 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:38.998519 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-5f53da27-bd17-4b8c-8880-aae93e7e3ad6 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: f9913cee-0c42-4925-bf29-cc6b5397989c] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:39.000774 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=3 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:21:39.005878 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5f53da27-bd17-4b8c-8880-aae93e7e3ad6 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:39.006250 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5f53da27-bd17-4b8c-8880-aae93e7e3ad6 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:39.006782 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5f53da27-bd17-4b8c-8880-aae93e7e3ad6 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:39.007488 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5f53da27-bd17-4b8c-8880-aae93e7e3ad6 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:39.007946 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5f53da27-bd17-4b8c-8880-aae93e7e3ad6 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:39.008368 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5f53da27-bd17-4b8c-8880-aae93e7e3ad6 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:39.017689 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=77 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:21:39.130482 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:21:39.153925 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=6 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:21:39.196869 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-5f53da27-bd17-4b8c-8880-aae93e7e3ad6 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:39.206283 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5f53da27-bd17-4b8c-8880-aae93e7e3ad6 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/f9913cee-0c42-4925-bf29-cc6b5397989c" status: 200 len: 1341 microversion: 2.1 time: 0.213489 Oct 04 21:21:39.207244 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3077/6187] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:21:38 2022] GET /compute/v2.1/servers/f9913cee-0c42-4925-bf29-cc6b5397989c => generated 1341 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:21:40.231410 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-aa0aeabb-f698-418b-a90f-08606d8606da tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:40.232043 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-aa0aeabb-f698-418b-a90f-08606d8606da tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: f9913cee-0c42-4925-bf29-cc6b5397989c] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:40.235355 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell0:SELECT=2 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:21:40.241277 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-aa0aeabb-f698-418b-a90f-08606d8606da tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:40.241788 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-aa0aeabb-f698-418b-a90f-08606d8606da tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:40.242238 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-aa0aeabb-f698-418b-a90f-08606d8606da tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:40.243154 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-aa0aeabb-f698-418b-a90f-08606d8606da tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:40.243630 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-aa0aeabb-f698-418b-a90f-08606d8606da tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:40.244074 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-aa0aeabb-f698-418b-a90f-08606d8606da tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:40.397128 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-aa0aeabb-f698-418b-a90f-08606d8606da tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:40.406601 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-aa0aeabb-f698-418b-a90f-08606d8606da tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/f9913cee-0c42-4925-bf29-cc6b5397989c" status: 200 len: 1341 microversion: 2.1 time: 0.180043 Oct 04 21:21:40.422288 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3111/6188] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:21:40 2022] GET /compute/v2.1/servers/f9913cee-0c42-4925-bf29-cc6b5397989c => generated 1341 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:21:41.432192 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-90fbf298-d8da-431e-b8af-b84d16a28c85 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:41.433751 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-90fbf298-d8da-431e-b8af-b84d16a28c85 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: f9913cee-0c42-4925-bf29-cc6b5397989c] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:41.441408 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-90fbf298-d8da-431e-b8af-b84d16a28c85 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:41.442001 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-90fbf298-d8da-431e-b8af-b84d16a28c85 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:41.442535 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-90fbf298-d8da-431e-b8af-b84d16a28c85 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:41.443390 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-90fbf298-d8da-431e-b8af-b84d16a28c85 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:41.443849 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-90fbf298-d8da-431e-b8af-b84d16a28c85 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:41.444273 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-90fbf298-d8da-431e-b8af-b84d16a28c85 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:41.613841 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-90fbf298-d8da-431e-b8af-b84d16a28c85 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:41.628202 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-90fbf298-d8da-431e-b8af-b84d16a28c85 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/f9913cee-0c42-4925-bf29-cc6b5397989c" status: 200 len: 1341 microversion: 2.1 time: 0.199908 Oct 04 21:21:41.628813 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3078/6189] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:21:41 2022] GET /compute/v2.1/servers/f9913cee-0c42-4925-bf29-cc6b5397989c => generated 1341 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:21:42.653921 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-923da4b4-fd1f-45b4-9f4f-e7cb5df9e6e3 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:42.655302 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-923da4b4-fd1f-45b4-9f4f-e7cb5df9e6e3 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: f9913cee-0c42-4925-bf29-cc6b5397989c] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:42.663136 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-923da4b4-fd1f-45b4-9f4f-e7cb5df9e6e3 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:42.663852 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-923da4b4-fd1f-45b4-9f4f-e7cb5df9e6e3 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:42.664308 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-923da4b4-fd1f-45b4-9f4f-e7cb5df9e6e3 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:42.665230 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-923da4b4-fd1f-45b4-9f4f-e7cb5df9e6e3 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:42.665697 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-923da4b4-fd1f-45b4-9f4f-e7cb5df9e6e3 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:42.666134 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-923da4b4-fd1f-45b4-9f4f-e7cb5df9e6e3 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:42.841272 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-923da4b4-fd1f-45b4-9f4f-e7cb5df9e6e3 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:42.850568 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-923da4b4-fd1f-45b4-9f4f-e7cb5df9e6e3 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/f9913cee-0c42-4925-bf29-cc6b5397989c" status: 200 len: 1341 microversion: 2.1 time: 0.201941 Oct 04 21:21:42.851788 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3112/6190] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:21:42 2022] GET /compute/v2.1/servers/f9913cee-0c42-4925-bf29-cc6b5397989c => generated 1341 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:21:43.878799 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-60b931d8-e3ef-4704-8ce2-fe6ebc797136 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:43.879413 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-60b931d8-e3ef-4704-8ce2-fe6ebc797136 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: f9913cee-0c42-4925-bf29-cc6b5397989c] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:43.889905 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-60b931d8-e3ef-4704-8ce2-fe6ebc797136 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:43.890955 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-60b931d8-e3ef-4704-8ce2-fe6ebc797136 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:43.891721 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-60b931d8-e3ef-4704-8ce2-fe6ebc797136 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:43.892581 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-60b931d8-e3ef-4704-8ce2-fe6ebc797136 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:43.893366 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-60b931d8-e3ef-4704-8ce2-fe6ebc797136 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:43.893907 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-60b931d8-e3ef-4704-8ce2-fe6ebc797136 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:44.068193 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-60b931d8-e3ef-4704-8ce2-fe6ebc797136 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:44.078935 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-60b931d8-e3ef-4704-8ce2-fe6ebc797136 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/f9913cee-0c42-4925-bf29-cc6b5397989c" status: 200 len: 1341 microversion: 2.1 time: 0.203897 Oct 04 21:21:44.080746 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3079/6191] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:21:43 2022] GET /compute/v2.1/servers/f9913cee-0c42-4925-bf29-cc6b5397989c => generated 1341 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:21:45.105942 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-5fda2da4-6aaf-4b47-942d-840aab7e9155 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:45.106763 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-5fda2da4-6aaf-4b47-942d-840aab7e9155 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: f9913cee-0c42-4925-bf29-cc6b5397989c] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:45.114514 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5fda2da4-6aaf-4b47-942d-840aab7e9155 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:45.115309 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5fda2da4-6aaf-4b47-942d-840aab7e9155 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:45.116092 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5fda2da4-6aaf-4b47-942d-840aab7e9155 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:45.117364 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5fda2da4-6aaf-4b47-942d-840aab7e9155 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:45.118026 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5fda2da4-6aaf-4b47-942d-840aab7e9155 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:45.118703 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5fda2da4-6aaf-4b47-942d-840aab7e9155 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:45.298404 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-5fda2da4-6aaf-4b47-942d-840aab7e9155 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:45.312342 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-5fda2da4-6aaf-4b47-942d-840aab7e9155 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/f9913cee-0c42-4925-bf29-cc6b5397989c" status: 200 len: 1341 microversion: 2.1 time: 0.211977 Oct 04 21:21:45.313386 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3113/6192] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:21:45 2022] GET /compute/v2.1/servers/f9913cee-0c42-4925-bf29-cc6b5397989c => generated 1341 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:21:46.335872 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-51a51871-c734-40e7-aab0-863d69cd84e5 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:46.337207 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-51a51871-c734-40e7-aab0-863d69cd84e5 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: f9913cee-0c42-4925-bf29-cc6b5397989c] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:46.345017 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-51a51871-c734-40e7-aab0-863d69cd84e5 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:46.345512 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-51a51871-c734-40e7-aab0-863d69cd84e5 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:46.345954 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-51a51871-c734-40e7-aab0-863d69cd84e5 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:46.346696 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-51a51871-c734-40e7-aab0-863d69cd84e5 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:46.347155 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-51a51871-c734-40e7-aab0-863d69cd84e5 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:46.347587 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-51a51871-c734-40e7-aab0-863d69cd84e5 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:46.502402 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-51a51871-c734-40e7-aab0-863d69cd84e5 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:46.513003 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-51a51871-c734-40e7-aab0-863d69cd84e5 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/f9913cee-0c42-4925-bf29-cc6b5397989c" status: 200 len: 1375 microversion: 2.1 time: 0.181210 Oct 04 21:21:46.513763 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3080/6193] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:21:46 2022] GET /compute/v2.1/servers/f9913cee-0c42-4925-bf29-cc6b5397989c => generated 1375 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:21:47.539179 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-2cf842e1-3628-49a1-8807-ce73a9547b06 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:47.539926 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-2cf842e1-3628-49a1-8807-ce73a9547b06 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: f9913cee-0c42-4925-bf29-cc6b5397989c] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:47.548517 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2cf842e1-3628-49a1-8807-ce73a9547b06 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:47.549146 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2cf842e1-3628-49a1-8807-ce73a9547b06 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:47.549752 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2cf842e1-3628-49a1-8807-ce73a9547b06 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:47.550695 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2cf842e1-3628-49a1-8807-ce73a9547b06 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:47.551459 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2cf842e1-3628-49a1-8807-ce73a9547b06 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:47.552014 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2cf842e1-3628-49a1-8807-ce73a9547b06 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:47.704124 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-2cf842e1-3628-49a1-8807-ce73a9547b06 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:47.714468 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-2cf842e1-3628-49a1-8807-ce73a9547b06 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/f9913cee-0c42-4925-bf29-cc6b5397989c" status: 200 len: 1375 microversion: 2.1 time: 0.178844 Oct 04 21:21:47.714995 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3114/6194] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:21:47 2022] GET /compute/v2.1/servers/f9913cee-0c42-4925-bf29-cc6b5397989c => generated 1375 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:21:48.737295 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c9cd651a-8d5d-48a3-b159-950b559ae9cf tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:48.737910 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c9cd651a-8d5d-48a3-b159-950b559ae9cf tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: f9913cee-0c42-4925-bf29-cc6b5397989c] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:48.746565 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c9cd651a-8d5d-48a3-b159-950b559ae9cf tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:48.746994 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c9cd651a-8d5d-48a3-b159-950b559ae9cf tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:48.747445 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c9cd651a-8d5d-48a3-b159-950b559ae9cf tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:48.748317 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c9cd651a-8d5d-48a3-b159-950b559ae9cf tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:48.748829 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c9cd651a-8d5d-48a3-b159-950b559ae9cf tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:48.749270 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c9cd651a-8d5d-48a3-b159-950b559ae9cf tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:48.895818 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c9cd651a-8d5d-48a3-b159-950b559ae9cf tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:48.903885 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c9cd651a-8d5d-48a3-b159-950b559ae9cf tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/f9913cee-0c42-4925-bf29-cc6b5397989c" status: 200 len: 1375 microversion: 2.1 time: 0.170512 Oct 04 21:21:48.904502 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3081/6195] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:21:48 2022] GET /compute/v2.1/servers/f9913cee-0c42-4925-bf29-cc6b5397989c => generated 1375 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:21:49.929200 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-40e55093-bf2d-48db-967d-ccb2acae66b7 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:49.929980 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-40e55093-bf2d-48db-967d-ccb2acae66b7 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: f9913cee-0c42-4925-bf29-cc6b5397989c] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:49.939928 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-40e55093-bf2d-48db-967d-ccb2acae66b7 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:49.940488 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-40e55093-bf2d-48db-967d-ccb2acae66b7 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:49.941037 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-40e55093-bf2d-48db-967d-ccb2acae66b7 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:49.942075 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-40e55093-bf2d-48db-967d-ccb2acae66b7 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:49.942583 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-40e55093-bf2d-48db-967d-ccb2acae66b7 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:49.943252 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-40e55093-bf2d-48db-967d-ccb2acae66b7 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:50.090540 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-40e55093-bf2d-48db-967d-ccb2acae66b7 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:50.099645 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-40e55093-bf2d-48db-967d-ccb2acae66b7 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/f9913cee-0c42-4925-bf29-cc6b5397989c" status: 200 len: 1375 microversion: 2.1 time: 0.176070 Oct 04 21:21:50.100258 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3115/6196] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:21:49 2022] GET /compute/v2.1/servers/f9913cee-0c42-4925-bf29-cc6b5397989c => generated 1375 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:21:51.126965 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-00ab9a74-0f70-4362-8d88-2aecab7d69ee tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:51.127571 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-00ab9a74-0f70-4362-8d88-2aecab7d69ee tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: f9913cee-0c42-4925-bf29-cc6b5397989c] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:51.137075 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-00ab9a74-0f70-4362-8d88-2aecab7d69ee tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:51.137771 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-00ab9a74-0f70-4362-8d88-2aecab7d69ee tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:51.138320 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-00ab9a74-0f70-4362-8d88-2aecab7d69ee tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:51.139246 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-00ab9a74-0f70-4362-8d88-2aecab7d69ee tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:51.139951 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-00ab9a74-0f70-4362-8d88-2aecab7d69ee tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:51.140457 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-00ab9a74-0f70-4362-8d88-2aecab7d69ee tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:51.313760 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-00ab9a74-0f70-4362-8d88-2aecab7d69ee tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:51.324126 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-00ab9a74-0f70-4362-8d88-2aecab7d69ee tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/f9913cee-0c42-4925-bf29-cc6b5397989c" status: 200 len: 1375 microversion: 2.1 time: 0.201470 Oct 04 21:21:51.324769 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3082/6197] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:21:51 2022] GET /compute/v2.1/servers/f9913cee-0c42-4925-bf29-cc6b5397989c => generated 1375 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:21:52.350516 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-9d8fd7dc-0062-4722-bbf5-824b9754613a tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:52.352026 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-9d8fd7dc-0062-4722-bbf5-824b9754613a tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: f9913cee-0c42-4925-bf29-cc6b5397989c] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:52.361303 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9d8fd7dc-0062-4722-bbf5-824b9754613a tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:52.361866 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9d8fd7dc-0062-4722-bbf5-824b9754613a tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:52.362263 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9d8fd7dc-0062-4722-bbf5-824b9754613a tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:52.363026 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9d8fd7dc-0062-4722-bbf5-824b9754613a tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:52.363500 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9d8fd7dc-0062-4722-bbf5-824b9754613a tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:52.363940 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9d8fd7dc-0062-4722-bbf5-824b9754613a tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:52.513918 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-9d8fd7dc-0062-4722-bbf5-824b9754613a tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:52.521996 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-9d8fd7dc-0062-4722-bbf5-824b9754613a tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/f9913cee-0c42-4925-bf29-cc6b5397989c" status: 200 len: 1375 microversion: 2.1 time: 0.175974 Oct 04 21:21:52.522617 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3116/6198] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:21:52 2022] GET /compute/v2.1/servers/f9913cee-0c42-4925-bf29-cc6b5397989c => generated 1375 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:21:53.546781 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-74e76a85-d732-4b4d-a998-d938a96f4264 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:53.547342 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-74e76a85-d732-4b4d-a998-d938a96f4264 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: f9913cee-0c42-4925-bf29-cc6b5397989c] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:53.554522 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-74e76a85-d732-4b4d-a998-d938a96f4264 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:53.555021 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-74e76a85-d732-4b4d-a998-d938a96f4264 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:53.555449 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-74e76a85-d732-4b4d-a998-d938a96f4264 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:53.556155 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-74e76a85-d732-4b4d-a998-d938a96f4264 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:53.556633 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-74e76a85-d732-4b4d-a998-d938a96f4264 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:53.557063 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-74e76a85-d732-4b4d-a998-d938a96f4264 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:53.720734 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-74e76a85-d732-4b4d-a998-d938a96f4264 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:53.731119 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-74e76a85-d732-4b4d-a998-d938a96f4264 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/f9913cee-0c42-4925-bf29-cc6b5397989c" status: 200 len: 1375 microversion: 2.1 time: 0.188431 Oct 04 21:21:53.731729 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3083/6199] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:21:53 2022] GET /compute/v2.1/servers/f9913cee-0c42-4925-bf29-cc6b5397989c => generated 1375 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:21:54.756045 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-78cf9171-af3a-4c7d-9d4b-ebfd6c5f324b tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:54.756737 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-78cf9171-af3a-4c7d-9d4b-ebfd6c5f324b tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: f9913cee-0c42-4925-bf29-cc6b5397989c] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:54.765993 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-78cf9171-af3a-4c7d-9d4b-ebfd6c5f324b tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:54.766667 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-78cf9171-af3a-4c7d-9d4b-ebfd6c5f324b tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:54.767126 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-78cf9171-af3a-4c7d-9d4b-ebfd6c5f324b tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:54.768155 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-78cf9171-af3a-4c7d-9d4b-ebfd6c5f324b tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:54.768694 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-78cf9171-af3a-4c7d-9d4b-ebfd6c5f324b tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:54.769270 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-78cf9171-af3a-4c7d-9d4b-ebfd6c5f324b tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:54.926684 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-78cf9171-af3a-4c7d-9d4b-ebfd6c5f324b tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:54.936850 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-78cf9171-af3a-4c7d-9d4b-ebfd6c5f324b tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/f9913cee-0c42-4925-bf29-cc6b5397989c" status: 200 len: 1375 microversion: 2.1 time: 0.185711 Oct 04 21:21:54.937874 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3117/6200] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:21:54 2022] GET /compute/v2.1/servers/f9913cee-0c42-4925-bf29-cc6b5397989c => generated 1375 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:21:55.961655 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d43675f1-71cd-4ba1-8bc3-71c91d65078e tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:55.962485 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d43675f1-71cd-4ba1-8bc3-71c91d65078e tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: f9913cee-0c42-4925-bf29-cc6b5397989c] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:55.969798 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d43675f1-71cd-4ba1-8bc3-71c91d65078e tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:55.970284 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d43675f1-71cd-4ba1-8bc3-71c91d65078e tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:55.970752 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d43675f1-71cd-4ba1-8bc3-71c91d65078e tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:55.971455 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d43675f1-71cd-4ba1-8bc3-71c91d65078e tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:55.971942 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d43675f1-71cd-4ba1-8bc3-71c91d65078e tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:55.972372 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d43675f1-71cd-4ba1-8bc3-71c91d65078e tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:56.134136 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d43675f1-71cd-4ba1-8bc3-71c91d65078e tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:56.144683 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d43675f1-71cd-4ba1-8bc3-71c91d65078e tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/f9913cee-0c42-4925-bf29-cc6b5397989c" status: 200 len: 1375 microversion: 2.1 time: 0.187110 Oct 04 21:21:56.159257 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3084/6201] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:21:55 2022] GET /compute/v2.1/servers/f9913cee-0c42-4925-bf29-cc6b5397989c => generated 1375 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:21:56.172549 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-4894d630-ed07-4d74-8766-5149b184f625 req-3f1d2157-7a16-4a69-b17c-9250625ae657 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9913cee-0c42-4925-bf29-cc6b5397989c", "name": "network-vif-plugged", "status": "completed", "tag": "97d60cb9-8ce4-475c-9390-c8480ba841e5"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:21:56.185646 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-4894d630-ed07-4d74-8766-5149b184f625 req-3f1d2157-7a16-4a69-b17c-9250625ae657 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:56.186255 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-4894d630-ed07-4d74-8766-5149b184f625 req-3f1d2157-7a16-4a69-b17c-9250625ae657 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:56.186869 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-4894d630-ed07-4d74-8766-5149b184f625 req-3f1d2157-7a16-4a69-b17c-9250625ae657 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:56.200461 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-4894d630-ed07-4d74-8766-5149b184f625 req-3f1d2157-7a16-4a69-b17c-9250625ae657 service nova] Creating event network-vif-plugged:97d60cb9-8ce4-475c-9390-c8480ba841e5 for instance f9913cee-0c42-4925-bf29-cc6b5397989c on n-h1-854823-8 Oct 04 21:21:56.206738 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-4894d630-ed07-4d74-8766-5149b184f625 req-3f1d2157-7a16-4a69-b17c-9250625ae657 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038377 Oct 04 21:21:56.207491 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3118/6202] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:21:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:21:57.169119 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-4c9cbb12-945b-4d24-a33c-9126f54259ce tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:57.169867 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-4c9cbb12-945b-4d24-a33c-9126f54259ce tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: f9913cee-0c42-4925-bf29-cc6b5397989c] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:57.176966 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4c9cbb12-945b-4d24-a33c-9126f54259ce tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:57.177566 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4c9cbb12-945b-4d24-a33c-9126f54259ce tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:57.178072 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4c9cbb12-945b-4d24-a33c-9126f54259ce tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:57.178883 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4c9cbb12-945b-4d24-a33c-9126f54259ce tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:57.179399 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4c9cbb12-945b-4d24-a33c-9126f54259ce tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:57.179893 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4c9cbb12-945b-4d24-a33c-9126f54259ce tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:57.331458 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-4c9cbb12-945b-4d24-a33c-9126f54259ce tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:57.342305 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-4c9cbb12-945b-4d24-a33c-9126f54259ce tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/f9913cee-0c42-4925-bf29-cc6b5397989c" status: 200 len: 1375 microversion: 2.1 time: 0.177120 Oct 04 21:21:57.343061 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3085/6203] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:21:57 2022] GET /compute/v2.1/servers/f9913cee-0c42-4925-bf29-cc6b5397989c => generated 1375 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:21:58.369392 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-a34c9585-4541-4a75-a28d-8d24ada5b9d4 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:58.370121 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-a34c9585-4541-4a75-a28d-8d24ada5b9d4 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: f9913cee-0c42-4925-bf29-cc6b5397989c] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:58.377357 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a34c9585-4541-4a75-a28d-8d24ada5b9d4 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:58.377976 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a34c9585-4541-4a75-a28d-8d24ada5b9d4 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:58.378669 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a34c9585-4541-4a75-a28d-8d24ada5b9d4 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:58.379412 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a34c9585-4541-4a75-a28d-8d24ada5b9d4 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:58.379853 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a34c9585-4541-4a75-a28d-8d24ada5b9d4 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:58.380346 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a34c9585-4541-4a75-a28d-8d24ada5b9d4 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:58.532676 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-a34c9585-4541-4a75-a28d-8d24ada5b9d4 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:58.541774 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-a34c9585-4541-4a75-a28d-8d24ada5b9d4 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/f9913cee-0c42-4925-bf29-cc6b5397989c" status: 200 len: 1562 microversion: 2.1 time: 0.177691 Oct 04 21:21:58.542451 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3119/6204] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:21:58 2022] GET /compute/v2.1/servers/f9913cee-0c42-4925-bf29-cc6b5397989c => generated 1562 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:21:58.565939 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-46550da8-11b6-4eae-a6ea-ac424de0bc5c tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:58.566608 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-46550da8-11b6-4eae-a6ea-ac424de0bc5c tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: f9913cee-0c42-4925-bf29-cc6b5397989c] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:58.575655 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-46550da8-11b6-4eae-a6ea-ac424de0bc5c tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:58.576145 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-46550da8-11b6-4eae-a6ea-ac424de0bc5c tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:58.576791 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-46550da8-11b6-4eae-a6ea-ac424de0bc5c tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:58.577613 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-46550da8-11b6-4eae-a6ea-ac424de0bc5c tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:58.578097 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-46550da8-11b6-4eae-a6ea-ac424de0bc5c tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:58.578614 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-46550da8-11b6-4eae-a6ea-ac424de0bc5c tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:58.754158 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-46550da8-11b6-4eae-a6ea-ac424de0bc5c tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:58.764172 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-46550da8-11b6-4eae-a6ea-ac424de0bc5c tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/f9913cee-0c42-4925-bf29-cc6b5397989c" status: 200 len: 1562 microversion: 2.1 time: 0.202435 Oct 04 21:21:58.767852 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3086/6205] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:21:58 2022] GET /compute/v2.1/servers/f9913cee-0c42-4925-bf29-cc6b5397989c => generated 1562 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:21:58.852653 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-b9c95552-94dc-4d92-b7f1-85a2f9257d24 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:58.853173 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-b9c95552-94dc-4d92-b7f1-85a2f9257d24 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: f9913cee-0c42-4925-bf29-cc6b5397989c] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:58.859769 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b9c95552-94dc-4d92-b7f1-85a2f9257d24 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:58.860275 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b9c95552-94dc-4d92-b7f1-85a2f9257d24 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:58.860726 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b9c95552-94dc-4d92-b7f1-85a2f9257d24 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:58.861442 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b9c95552-94dc-4d92-b7f1-85a2f9257d24 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:58.861915 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b9c95552-94dc-4d92-b7f1-85a2f9257d24 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:58.862363 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b9c95552-94dc-4d92-b7f1-85a2f9257d24 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:58.890100 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-b9c95552-94dc-4d92-b7f1-85a2f9257d24 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: f9913cee-0c42-4925-bf29-cc6b5397989c] Going to try to terminate instance {{(pid=128802) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:21:58.980193 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-b9c95552-94dc-4d92-b7f1-85a2f9257d24 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "DELETE /compute/v2.1/servers/f9913cee-0c42-4925-bf29-cc6b5397989c" status: 204 len: 0 microversion: 2.1 time: 0.130367 Oct 04 21:21:58.981856 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3120/6206] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 21:21:58 2022] DELETE /compute/v2.1/servers/f9913cee-0c42-4925-bf29-cc6b5397989c => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:21:58.992428 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5dd602ff-55f0-4a6b-8150-3046d9b56afb tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:21:58.992428 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-5dd602ff-55f0-4a6b-8150-3046d9b56afb tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: f9913cee-0c42-4925-bf29-cc6b5397989c] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:21:58.999783 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5dd602ff-55f0-4a6b-8150-3046d9b56afb tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:59.000278 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5dd602ff-55f0-4a6b-8150-3046d9b56afb tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:59.000709 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5dd602ff-55f0-4a6b-8150-3046d9b56afb tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:59.002026 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5dd602ff-55f0-4a6b-8150-3046d9b56afb tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:21:59.002515 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5dd602ff-55f0-4a6b-8150-3046d9b56afb tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:21:59.002939 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5dd602ff-55f0-4a6b-8150-3046d9b56afb tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:21:59.118492 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-1a250d4c-7878-4dfa-80af-535a1502c427 tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Action: 'create', calling method: .version_select at 0x7f3c7899de50>, body: {"keypair": {"name": "tempest-TestVolumeBackupRestore-596125049", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEmzT0ydM0NZ6iaP4hQvi5cUxfAcLSiAIQYYlZQe76DYa9hTo4s2F7yiQH5Yt6LssPlAfXjDHn5KBe+CJU5LY9eMWJl+xOy3qpYD+SvRHxIH6tryXOE164Py/Bxr8e5cUQ=="}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:21:59.136276 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-1a250d4c-7878-4dfa-80af-535a1502c427 tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Getting quotas for project 2b380f28820f4d9e85ba243f04427452. Resources: {'key_pairs'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:21:59.139544 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-5dd602ff-55f0-4a6b-8150-3046d9b56afb tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:21:59.142549 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-1a250d4c-7878-4dfa-80af-535a1502c427 tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Getting quotas for user 4200015ba7cc4d43a4328ceb6626521f and project 2b380f28820f4d9e85ba243f04427452. Resources: {'key_pairs'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:21:59.148464 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5dd602ff-55f0-4a6b-8150-3046d9b56afb tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/f9913cee-0c42-4925-bf29-cc6b5397989c" status: 200 len: 1568 microversion: 2.1 time: 0.160388 Oct 04 21:21:59.149139 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3087/6207] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:21:58 2022] GET /compute/v2.1/servers/f9913cee-0c42-4925-bf29-cc6b5397989c => generated 1568 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:21:59.177052 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-1a250d4c-7878-4dfa-80af-535a1502c427 tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 401 microversion: 2.1 time: 0.062696 Oct 04 21:21:59.177938 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3121/6208] 10.222.0.33 () {60 vars in 1159 bytes} [Tue Oct 4 21:21:59 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:22:00.172579 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1917e8d4-fe1f-4951-b167-0eee5d9ccc10 tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBackupRestore-server-2009520352", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "560644ee-a477-4a29-9e74-9910f2b2f6a7", "source_type": "volume", "destination_type": "volume", "boot_index": 0}], "key_name": "tempest-TestVolumeBackupRestore-596125049", "security_groups": [{"name": "tempest-secgroup-smoke-1136258100"}], "networks": [{"uuid": "b2a01bbc-e1fa-4079-94b3-9faafc715b0b"}]}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:22:00.173111 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-283b10f6-1153-454b-8d59-67e079fdc066 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:00.173604 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-283b10f6-1153-454b-8d59-67e079fdc066 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: f9913cee-0c42-4925-bf29-cc6b5397989c] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:00.181386 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-283b10f6-1153-454b-8d59-67e079fdc066 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:00.182483 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-283b10f6-1153-454b-8d59-67e079fdc066 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:00.183027 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-283b10f6-1153-454b-8d59-67e079fdc066 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:00.183742 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-283b10f6-1153-454b-8d59-67e079fdc066 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:00.184207 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-283b10f6-1153-454b-8d59-67e079fdc066 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:00.184929 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-283b10f6-1153-454b-8d59-67e079fdc066 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:00.330742 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.network.neutron [None req-1917e8d4-fe1f-4951-b167-0eee5d9ccc10 tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] validate_networks() for [('b2a01bbc-e1fa-4079-94b3-9faafc715b0b', None, None, None, None, None)] {{(pid=128801) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:22:00.406054 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-283b10f6-1153-454b-8d59-67e079fdc066 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:00.414049 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-283b10f6-1153-454b-8d59-67e079fdc066 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/f9913cee-0c42-4925-bf29-cc6b5397989c" status: 200 len: 1568 microversion: 2.1 time: 0.245003 Oct 04 21:22:00.414682 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3122/6209] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:22:00 2022] GET /compute/v2.1/servers/f9913cee-0c42-4925-bf29-cc6b5397989c => generated 1568 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:22:00.724999 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-1917e8d4-fe1f-4951-b167-0eee5d9ccc10 tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Flavor limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:22:00.725690 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-1917e8d4-fe1f-4951-b167-0eee5d9ccc10 tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Image limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:22:00.726558 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-1917e8d4-fe1f-4951-b167-0eee5d9ccc10 tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Flavor pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:22:00.726681 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-1917e8d4-fe1f-4951-b167-0eee5d9ccc10 tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Image pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:22:00.727062 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-1917e8d4-fe1f-4951-b167-0eee5d9ccc10 tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:22:00.737120 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1917e8d4-fe1f-4951-b167-0eee5d9ccc10 tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:00.737635 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1917e8d4-fe1f-4951-b167-0eee5d9ccc10 tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:00.738092 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1917e8d4-fe1f-4951-b167-0eee5d9ccc10 tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:00.738866 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1917e8d4-fe1f-4951-b167-0eee5d9ccc10 tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:00.739344 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1917e8d4-fe1f-4951-b167-0eee5d9ccc10 tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:00.739765 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1917e8d4-fe1f-4951-b167-0eee5d9ccc10 tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:00.757772 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-1917e8d4-fe1f-4951-b167-0eee5d9ccc10 tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Getting quotas for project 2b380f28820f4d9e85ba243f04427452. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:22:00.763677 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-1917e8d4-fe1f-4951-b167-0eee5d9ccc10 tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Getting quotas for user 4200015ba7cc4d43a4328ceb6626521f and project 2b380f28820f4d9e85ba243f04427452. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:22:00.833151 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-1917e8d4-fe1f-4951-b167-0eee5d9ccc10 tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Going to run 1 instances... {{(pid=128801) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:22:00.835483 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-1917e8d4-fe1f-4951-b167-0eee5d9ccc10 tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] [instance: b3a202bf-e6e0-4e0f-9006-e2b7ba4589e4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='560644ee-a477-4a29-9e74-9910f2b2f6a7',volume_size=None,volume_type=None)] {{(pid=128801) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:22:00.980328 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-1917e8d4-fe1f-4951-b167-0eee5d9ccc10 tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.811635 Oct 04 21:22:00.986914 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3088/6210] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 21:22:00 2022] POST /compute/v2.1/servers => generated 406 bytes in 813 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:22:00.992424 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-af1be082-c710-492e-81dd-a9ce2aa6d86e tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:00.993072 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-af1be082-c710-492e-81dd-a9ce2aa6d86e tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] [instance: b3a202bf-e6e0-4e0f-9006-e2b7ba4589e4] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:01.055586 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-af1be082-c710-492e-81dd-a9ce2aa6d86e tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4200015ba7cc4d43a4328ceb6626521f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b380f28820f4d9e85ba243f04427452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:01.065555 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-af1be082-c710-492e-81dd-a9ce2aa6d86e tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] 10.222.0.33 "GET /compute/v2.1/servers/b3a202bf-e6e0-4e0f-9006-e2b7ba4589e4" status: 200 len: 1098 microversion: 2.1 time: 0.077136 Oct 04 21:22:01.073385 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3123/6211] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:22:00 2022] GET /compute/v2.1/servers/b3a202bf-e6e0-4e0f-9006-e2b7ba4589e4 => generated 1098 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:22:01.336813 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-fca42412-23cf-4cfe-a99d-44f20e49dacb req-fff38060-e64c-4efe-b915-c8e357ff6bb4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9913cee-0c42-4925-bf29-cc6b5397989c", "name": "network-vif-deleted", "tag": "97d60cb9-8ce4-475c-9390-c8480ba841e5"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:22:01.348119 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-fca42412-23cf-4cfe-a99d-44f20e49dacb req-fff38060-e64c-4efe-b915-c8e357ff6bb4 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:01.349433 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-fca42412-23cf-4cfe-a99d-44f20e49dacb req-fff38060-e64c-4efe-b915-c8e357ff6bb4 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:01.350197 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-fca42412-23cf-4cfe-a99d-44f20e49dacb req-fff38060-e64c-4efe-b915-c8e357ff6bb4 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:01.369104 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-fca42412-23cf-4cfe-a99d-44f20e49dacb req-fff38060-e64c-4efe-b915-c8e357ff6bb4 service nova] Creating event network-vif-deleted:97d60cb9-8ce4-475c-9390-c8480ba841e5 for instance f9913cee-0c42-4925-bf29-cc6b5397989c on n-h1-854823-8 Oct 04 21:22:01.378886 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-fca42412-23cf-4cfe-a99d-44f20e49dacb req-fff38060-e64c-4efe-b915-c8e357ff6bb4 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048964 Oct 04 21:22:01.381265 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3089/6212] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:22:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:22:01.443980 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-38c984cc-1fe8-4dc6-a281-485a51430ddf tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:01.445565 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-38c984cc-1fe8-4dc6-a281-485a51430ddf tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: f9913cee-0c42-4925-bf29-cc6b5397989c] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:01.465843 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-38c984cc-1fe8-4dc6-a281-485a51430ddf tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:01.467320 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-38c984cc-1fe8-4dc6-a281-485a51430ddf tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:01.468769 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-38c984cc-1fe8-4dc6-a281-485a51430ddf tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:01.469757 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-38c984cc-1fe8-4dc6-a281-485a51430ddf tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:01.470560 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-38c984cc-1fe8-4dc6-a281-485a51430ddf tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:01.472133 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-38c984cc-1fe8-4dc6-a281-485a51430ddf tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:01.551450 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-38c984cc-1fe8-4dc6-a281-485a51430ddf tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:01.561388 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-38c984cc-1fe8-4dc6-a281-485a51430ddf tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/f9913cee-0c42-4925-bf29-cc6b5397989c" status: 200 len: 1360 microversion: 2.1 time: 0.124937 Oct 04 21:22:01.561982 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3124/6213] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:22:01 2022] GET /compute/v2.1/servers/f9913cee-0c42-4925-bf29-cc6b5397989c => generated 1360 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:22:02.090461 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6dd98961-ec6b-429f-977b-a6949aedb21b tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:02.091138 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-6dd98961-ec6b-429f-977b-a6949aedb21b tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] [instance: b3a202bf-e6e0-4e0f-9006-e2b7ba4589e4] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:02.097760 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6dd98961-ec6b-429f-977b-a6949aedb21b tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:02.098253 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6dd98961-ec6b-429f-977b-a6949aedb21b tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:02.098717 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6dd98961-ec6b-429f-977b-a6949aedb21b tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:02.099427 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6dd98961-ec6b-429f-977b-a6949aedb21b tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:02.099886 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6dd98961-ec6b-429f-977b-a6949aedb21b tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:02.100313 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6dd98961-ec6b-429f-977b-a6949aedb21b tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:02.173342 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-6dd98961-ec6b-429f-977b-a6949aedb21b tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4200015ba7cc4d43a4328ceb6626521f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b380f28820f4d9e85ba243f04427452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:02.181908 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-6dd98961-ec6b-429f-977b-a6949aedb21b tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] 10.222.0.33 "GET /compute/v2.1/servers/b3a202bf-e6e0-4e0f-9006-e2b7ba4589e4" status: 200 len: 1196 microversion: 2.1 time: 0.096373 Oct 04 21:22:02.182890 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3090/6214] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:22:02 2022] GET /compute/v2.1/servers/b3a202bf-e6e0-4e0f-9006-e2b7ba4589e4 => generated 1196 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:22:02.584775 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-07f445f4-d9b2-4436-9b79-2b20c2290ae1 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:02.586234 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-07f445f4-d9b2-4436-9b79-2b20c2290ae1 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: f9913cee-0c42-4925-bf29-cc6b5397989c] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:02.596115 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-07f445f4-d9b2-4436-9b79-2b20c2290ae1 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:02.597084 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-07f445f4-d9b2-4436-9b79-2b20c2290ae1 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:02.597916 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-07f445f4-d9b2-4436-9b79-2b20c2290ae1 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:02.598874 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-07f445f4-d9b2-4436-9b79-2b20c2290ae1 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:02.599655 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-07f445f4-d9b2-4436-9b79-2b20c2290ae1 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:02.600396 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-07f445f4-d9b2-4436-9b79-2b20c2290ae1 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:02.683935 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-07f445f4-d9b2-4436-9b79-2b20c2290ae1 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:02.713374 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-07f445f4-d9b2-4436-9b79-2b20c2290ae1 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/f9913cee-0c42-4925-bf29-cc6b5397989c" status: 200 len: 1360 microversion: 2.1 time: 0.131578 Oct 04 21:22:02.727243 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3125/6215] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:22:02 2022] GET /compute/v2.1/servers/f9913cee-0c42-4925-bf29-cc6b5397989c => generated 1360 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:22:03.206093 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e98dd6ea-0c2e-4ca1-8d10-ea2a7a70c5be tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:03.206767 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e98dd6ea-0c2e-4ca1-8d10-ea2a7a70c5be tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] [instance: b3a202bf-e6e0-4e0f-9006-e2b7ba4589e4] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:03.220207 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e98dd6ea-0c2e-4ca1-8d10-ea2a7a70c5be tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:03.221977 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e98dd6ea-0c2e-4ca1-8d10-ea2a7a70c5be tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:03.222394 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e98dd6ea-0c2e-4ca1-8d10-ea2a7a70c5be tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:03.223151 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e98dd6ea-0c2e-4ca1-8d10-ea2a7a70c5be tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:03.223616 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e98dd6ea-0c2e-4ca1-8d10-ea2a7a70c5be tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:03.224043 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e98dd6ea-0c2e-4ca1-8d10-ea2a7a70c5be tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:03.440233 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e98dd6ea-0c2e-4ca1-8d10-ea2a7a70c5be tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4200015ba7cc4d43a4328ceb6626521f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b380f28820f4d9e85ba243f04427452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:03.464435 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e98dd6ea-0c2e-4ca1-8d10-ea2a7a70c5be tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] 10.222.0.33 "GET /compute/v2.1/servers/b3a202bf-e6e0-4e0f-9006-e2b7ba4589e4" status: 200 len: 1282 microversion: 2.1 time: 0.262087 Oct 04 21:22:03.470293 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3091/6216] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:22:03 2022] GET /compute/v2.1/servers/b3a202bf-e6e0-4e0f-9006-e2b7ba4589e4 => generated 1282 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:22:03.741374 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-95fd8fda-bf6e-4155-9c79-141a194e3fd8 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:03.743439 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-95fd8fda-bf6e-4155-9c79-141a194e3fd8 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: f9913cee-0c42-4925-bf29-cc6b5397989c] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:03.752302 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-95fd8fda-bf6e-4155-9c79-141a194e3fd8 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:03.753539 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-95fd8fda-bf6e-4155-9c79-141a194e3fd8 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:03.754364 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-95fd8fda-bf6e-4155-9c79-141a194e3fd8 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:03.755379 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-95fd8fda-bf6e-4155-9c79-141a194e3fd8 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:03.756152 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-95fd8fda-bf6e-4155-9c79-141a194e3fd8 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:03.756864 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-95fd8fda-bf6e-4155-9c79-141a194e3fd8 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:03.833629 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-95fd8fda-bf6e-4155-9c79-141a194e3fd8 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:03.843539 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-95fd8fda-bf6e-4155-9c79-141a194e3fd8 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/f9913cee-0c42-4925-bf29-cc6b5397989c" status: 200 len: 1360 microversion: 2.1 time: 0.108310 Oct 04 21:22:03.846985 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3126/6217] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:22:03 2022] GET /compute/v2.1/servers/f9913cee-0c42-4925-bf29-cc6b5397989c => generated 1360 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:22:04.050174 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-f69c9bb7-796b-4d45-921c-2c0136223f1f req-4e00433b-a38e-4ca5-9843-1094b503684a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3a202bf-e6e0-4e0f-9006-e2b7ba4589e4", "tag": "2dfd43b6-a497-4bfd-baeb-811c56ed006c"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:22:04.063913 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-f69c9bb7-796b-4d45-921c-2c0136223f1f req-4e00433b-a38e-4ca5-9843-1094b503684a service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:04.064969 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-f69c9bb7-796b-4d45-921c-2c0136223f1f req-4e00433b-a38e-4ca5-9843-1094b503684a service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:04.065730 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-f69c9bb7-796b-4d45-921c-2c0136223f1f req-4e00433b-a38e-4ca5-9843-1094b503684a service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:04.083657 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-f69c9bb7-796b-4d45-921c-2c0136223f1f req-4e00433b-a38e-4ca5-9843-1094b503684a service nova] Creating event network-changed:2dfd43b6-a497-4bfd-baeb-811c56ed006c for instance b3a202bf-e6e0-4e0f-9006-e2b7ba4589e4 on n-h1-854823-8 Oct 04 21:22:04.089971 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-f69c9bb7-796b-4d45-921c-2c0136223f1f req-4e00433b-a38e-4ca5-9843-1094b503684a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043654 Oct 04 21:22:04.090885 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3092/6218] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:22:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:22:04.494674 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-a019ed2b-3831-4ba6-b976-9cb5b2133eaf tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:04.495231 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-a019ed2b-3831-4ba6-b976-9cb5b2133eaf tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] [instance: b3a202bf-e6e0-4e0f-9006-e2b7ba4589e4] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:04.501511 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a019ed2b-3831-4ba6-b976-9cb5b2133eaf tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:04.502023 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a019ed2b-3831-4ba6-b976-9cb5b2133eaf tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:04.502510 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a019ed2b-3831-4ba6-b976-9cb5b2133eaf tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:04.503234 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a019ed2b-3831-4ba6-b976-9cb5b2133eaf tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:04.503699 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a019ed2b-3831-4ba6-b976-9cb5b2133eaf tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:04.504127 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a019ed2b-3831-4ba6-b976-9cb5b2133eaf tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:04.657134 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-a019ed2b-3831-4ba6-b976-9cb5b2133eaf tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4200015ba7cc4d43a4328ceb6626521f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b380f28820f4d9e85ba243f04427452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:04.659791 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:22:04.668162 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-a019ed2b-3831-4ba6-b976-9cb5b2133eaf tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] 10.222.0.33 "GET /compute/v2.1/servers/b3a202bf-e6e0-4e0f-9006-e2b7ba4589e4" status: 200 len: 1282 microversion: 2.1 time: 0.177797 Oct 04 21:22:04.673463 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3127/6219] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:22:04 2022] GET /compute/v2.1/servers/b3a202bf-e6e0-4e0f-9006-e2b7ba4589e4 => generated 1282 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:22:04.868255 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1509010e-7a67-472e-bf56-e75f1870ef18 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:04.871097 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-1509010e-7a67-472e-bf56-e75f1870ef18 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: f9913cee-0c42-4925-bf29-cc6b5397989c] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:04.881063 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1509010e-7a67-472e-bf56-e75f1870ef18 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:04.881560 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1509010e-7a67-472e-bf56-e75f1870ef18 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:04.882238 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1509010e-7a67-472e-bf56-e75f1870ef18 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:04.883059 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1509010e-7a67-472e-bf56-e75f1870ef18 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:04.883531 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1509010e-7a67-472e-bf56-e75f1870ef18 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:04.883962 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1509010e-7a67-472e-bf56-e75f1870ef18 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:04.957658 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-1509010e-7a67-472e-bf56-e75f1870ef18 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:04.967218 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-1509010e-7a67-472e-bf56-e75f1870ef18 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/f9913cee-0c42-4925-bf29-cc6b5397989c" status: 200 len: 1360 microversion: 2.1 time: 0.104154 Oct 04 21:22:04.967817 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3093/6220] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:22:04 2022] GET /compute/v2.1/servers/f9913cee-0c42-4925-bf29-cc6b5397989c => generated 1360 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:22:05.705777 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-a6ad56ac-75a1-43dd-b2f0-d8c0b97a7342 tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:05.706648 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-a6ad56ac-75a1-43dd-b2f0-d8c0b97a7342 tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] [instance: b3a202bf-e6e0-4e0f-9006-e2b7ba4589e4] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:05.715914 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a6ad56ac-75a1-43dd-b2f0-d8c0b97a7342 tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:05.716379 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a6ad56ac-75a1-43dd-b2f0-d8c0b97a7342 tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:05.716939 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a6ad56ac-75a1-43dd-b2f0-d8c0b97a7342 tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:05.717545 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a6ad56ac-75a1-43dd-b2f0-d8c0b97a7342 tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:05.718018 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a6ad56ac-75a1-43dd-b2f0-d8c0b97a7342 tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:05.718548 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a6ad56ac-75a1-43dd-b2f0-d8c0b97a7342 tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:05.957415 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-a6ad56ac-75a1-43dd-b2f0-d8c0b97a7342 tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4200015ba7cc4d43a4328ceb6626521f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b380f28820f4d9e85ba243f04427452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:05.968756 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-a6ad56ac-75a1-43dd-b2f0-d8c0b97a7342 tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] 10.222.0.33 "GET /compute/v2.1/servers/b3a202bf-e6e0-4e0f-9006-e2b7ba4589e4" status: 200 len: 1282 microversion: 2.1 time: 0.274529 Oct 04 21:22:05.970302 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3128/6221] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:22:05 2022] GET /compute/v2.1/servers/b3a202bf-e6e0-4e0f-9006-e2b7ba4589e4 => generated 1282 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:22:06.000532 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-66b2754b-1dcd-45bd-a6fd-80b57920741d tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:06.001220 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-66b2754b-1dcd-45bd-a6fd-80b57920741d tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: f9913cee-0c42-4925-bf29-cc6b5397989c] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:06.011426 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-66b2754b-1dcd-45bd-a6fd-80b57920741d tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:06.012241 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-66b2754b-1dcd-45bd-a6fd-80b57920741d tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:06.012376 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-66b2754b-1dcd-45bd-a6fd-80b57920741d tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:06.013037 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-66b2754b-1dcd-45bd-a6fd-80b57920741d tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:06.013502 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-66b2754b-1dcd-45bd-a6fd-80b57920741d tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:06.013907 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-66b2754b-1dcd-45bd-a6fd-80b57920741d tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:06.098880 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-66b2754b-1dcd-45bd-a6fd-80b57920741d tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:06.110221 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-66b2754b-1dcd-45bd-a6fd-80b57920741d tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/f9913cee-0c42-4925-bf29-cc6b5397989c" status: 200 len: 1360 microversion: 2.1 time: 0.120055 Oct 04 21:22:06.111470 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3094/6222] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:22:05 2022] GET /compute/v2.1/servers/f9913cee-0c42-4925-bf29-cc6b5397989c => generated 1360 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:22:06.993194 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-86e498fa-8f68-42b6-b7ef-addbf37bf266 tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:06.993937 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-86e498fa-8f68-42b6-b7ef-addbf37bf266 tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] [instance: b3a202bf-e6e0-4e0f-9006-e2b7ba4589e4] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:07.001727 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-86e498fa-8f68-42b6-b7ef-addbf37bf266 tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:07.002222 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-86e498fa-8f68-42b6-b7ef-addbf37bf266 tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:07.002696 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-86e498fa-8f68-42b6-b7ef-addbf37bf266 tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:07.003408 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-86e498fa-8f68-42b6-b7ef-addbf37bf266 tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:07.003875 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-86e498fa-8f68-42b6-b7ef-addbf37bf266 tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:07.004430 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-86e498fa-8f68-42b6-b7ef-addbf37bf266 tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:07.136178 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-4081f350-58a9-4b03-813c-257b3d8ee652 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:07.136178 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-4081f350-58a9-4b03-813c-257b3d8ee652 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: f9913cee-0c42-4925-bf29-cc6b5397989c] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:07.143441 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4081f350-58a9-4b03-813c-257b3d8ee652 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:07.143930 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4081f350-58a9-4b03-813c-257b3d8ee652 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:07.144364 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4081f350-58a9-4b03-813c-257b3d8ee652 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:07.145282 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4081f350-58a9-4b03-813c-257b3d8ee652 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:07.145755 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4081f350-58a9-4b03-813c-257b3d8ee652 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:07.146372 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4081f350-58a9-4b03-813c-257b3d8ee652 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:07.161709 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-4081f350-58a9-4b03-813c-257b3d8ee652 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] HTTP exception thrown: Instance f9913cee-0c42-4925-bf29-cc6b5397989c could not be found. Oct 04 21:22:07.163553 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-4081f350-58a9-4b03-813c-257b3d8ee652 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Request method failure captured: Oct 04 21:22:07.163553 n-d-854823-8 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/f9913cee-0c42-4925-bf29-cc6b5397989c HTTP/1.1 Oct 04 21:22:07.163553 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 21:22:07.163553 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 21:22:07.163553 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 21:22:07.163553 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 0 Oct 04 21:22:07.163553 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 21:22:07.163553 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 21:22:07.163553 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 21:22:07.163553 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 21:22:07.163553 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPKMhB36sxHtTwvN5cR_FDx6677Bk3r96uZe9x8RsKj2kP41h8elma4Sfp2Sil3wffnoaQT-coMFt-1I-ubK46x1CIQQbRLJJWc6ISWYT8YHNWLLnEGq51UhoqUKdKybGmNCaSC1unJV9CeCDYPI8cjjYW6_GmoH3684NnCEjfslKtuc Oct 04 21:22:07.163553 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 21:22:07.163553 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 21:22:07.163553 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 21:22:07.163553 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 21:22:07.163553 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 21:22:07.163553 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 21:22:07.163553 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: 0d78e06d720d438a9308ae138902f847 Oct 04 21:22:07.163553 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-TestVolumeBootPattern-1361369473 Oct 04 21:22:07.163553 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 21:22:07.163553 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 21:22:07.163553 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0d78e06d720d438a9308ae138902f847", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0d78e06d720d438a9308ae138902f847"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0d78e06d720d438a9308ae138902f847"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0d78e06d720d438a9308ae138902f847"}]}] Oct 04 21:22:07.163553 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-TestVolumeBootPattern-1361369473 Oct 04 21:22:07.163553 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: 0d78e06d720d438a9308ae138902f847 Oct 04 21:22:07.163553 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-TestVolumeBootPattern-1361369473 Oct 04 21:22:07.163553 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-TestVolumeBootPattern-1361369473-project Oct 04 21:22:07.163553 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 21:22:07.163553 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 21:22:07.163553 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: ad7b0b59fad1429e95591b21e33ccbaa Oct 04 21:22:07.163553 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-TestVolumeBootPattern-1361369473-project Oct 04 21:22:07.163553 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 21:22:07.163553 n-d-854823-8 devstack@n-api.service[128801]: exception: Instance f9913cee-0c42-4925-bf29-cc6b5397989c could not be found. Oct 04 21:22:07.163553 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': 'f9913cee-0c42-4925-bf29-cc6b5397989c'} Oct 04 21:22:07.163553 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:22:07.163553 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:22:07.163553 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:22:07.163553 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:22:07.163553 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:22:07.163553 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:22:07.163553 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:22:07.163553 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:22:07.163553 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:22:07.163553 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:22:07.163553 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f9913cee-0c42-4925-bf29-cc6b5397989c could not be found. Oct 04 21:22:07.163553 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:22:07.163553 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:22:07.163553 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:22:07.163553 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:22:07.163553 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:22:07.163553 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:22:07.163553 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:22:07.163553 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:22:07.163553 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:22:07.163553 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:22:07.163553 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:22:07.163553 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:22:07.163553 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:22:07.163553 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:22:07.163553 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:22:07.163553 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:22:07.163553 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f9913cee-0c42-4925-bf29-cc6b5397989c could not be found. Oct 04 21:22:07.163553 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:22:07.163553 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:22:07.163553 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:22:07.169440 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:22:07.169440 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:22:07.169440 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:22:07.169440 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:22:07.169440 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:22:07.169440 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f9913cee-0c42-4925-bf29-cc6b5397989c could not be found. Oct 04 21:22:07.169440 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:22:07.171067 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-4081f350-58a9-4b03-813c-257b3d8ee652 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Returning 404 to user: Instance f9913cee-0c42-4925-bf29-cc6b5397989c could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:22:07.172573 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-4081f350-58a9-4b03-813c-257b3d8ee652 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/f9913cee-0c42-4925-bf29-cc6b5397989c" status: 404 len: 111 microversion: 2.1 time: 0.041848 Oct 04 21:22:07.173139 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3095/6223] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:22:07 2022] GET /compute/v2.1/servers/f9913cee-0c42-4925-bf29-cc6b5397989c => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:22:07.180870 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-86e498fa-8f68-42b6-b7ef-addbf37bf266 tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4200015ba7cc4d43a4328ceb6626521f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b380f28820f4d9e85ba243f04427452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:07.190633 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-86e498fa-8f68-42b6-b7ef-addbf37bf266 tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] 10.222.0.33 "GET /compute/v2.1/servers/b3a202bf-e6e0-4e0f-9006-e2b7ba4589e4" status: 200 len: 1282 microversion: 2.1 time: 0.201382 Oct 04 21:22:07.191424 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3129/6224] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:22:06 2022] GET /compute/v2.1/servers/b3a202bf-e6e0-4e0f-9006-e2b7ba4589e4 => generated 1282 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:22:08.219357 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-95aa38c8-4d89-473e-a0e5-59dfb7d33183 tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:08.220027 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-95aa38c8-4d89-473e-a0e5-59dfb7d33183 tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] [instance: b3a202bf-e6e0-4e0f-9006-e2b7ba4589e4] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:08.227941 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-95aa38c8-4d89-473e-a0e5-59dfb7d33183 tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:08.228511 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-95aa38c8-4d89-473e-a0e5-59dfb7d33183 tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:08.229681 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-95aa38c8-4d89-473e-a0e5-59dfb7d33183 tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:08.230641 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-95aa38c8-4d89-473e-a0e5-59dfb7d33183 tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:08.231248 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-95aa38c8-4d89-473e-a0e5-59dfb7d33183 tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:08.231766 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-95aa38c8-4d89-473e-a0e5-59dfb7d33183 tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:08.251467 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=100 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:22:08.421322 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-95aa38c8-4d89-473e-a0e5-59dfb7d33183 tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4200015ba7cc4d43a4328ceb6626521f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b380f28820f4d9e85ba243f04427452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:08.438113 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-95aa38c8-4d89-473e-a0e5-59dfb7d33183 tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] 10.222.0.33 "GET /compute/v2.1/servers/b3a202bf-e6e0-4e0f-9006-e2b7ba4589e4" status: 200 len: 1282 microversion: 2.1 time: 0.222251 Oct 04 21:22:08.439417 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3096/6225] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:22:08 2022] GET /compute/v2.1/servers/b3a202bf-e6e0-4e0f-9006-e2b7ba4589e4 => generated 1282 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:22:09.466014 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-5efd92b5-b945-4e10-ab4c-2d8261a08ee5 tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:09.466772 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-5efd92b5-b945-4e10-ab4c-2d8261a08ee5 tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] [instance: b3a202bf-e6e0-4e0f-9006-e2b7ba4589e4] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:09.474417 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:22:09.476246 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5efd92b5-b945-4e10-ab4c-2d8261a08ee5 tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:09.476884 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5efd92b5-b945-4e10-ab4c-2d8261a08ee5 tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:09.477524 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5efd92b5-b945-4e10-ab4c-2d8261a08ee5 tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:09.478272 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5efd92b5-b945-4e10-ab4c-2d8261a08ee5 tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:09.480348 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5efd92b5-b945-4e10-ab4c-2d8261a08ee5 tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:09.480907 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5efd92b5-b945-4e10-ab4c-2d8261a08ee5 tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:09.641053 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-5efd92b5-b945-4e10-ab4c-2d8261a08ee5 tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4200015ba7cc4d43a4328ceb6626521f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b380f28820f4d9e85ba243f04427452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:09.652036 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-5efd92b5-b945-4e10-ab4c-2d8261a08ee5 tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] 10.222.0.33 "GET /compute/v2.1/servers/b3a202bf-e6e0-4e0f-9006-e2b7ba4589e4" status: 200 len: 1282 microversion: 2.1 time: 0.191463 Oct 04 21:22:09.656421 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3130/6226] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:22:09 2022] GET /compute/v2.1/servers/b3a202bf-e6e0-4e0f-9006-e2b7ba4589e4 => generated 1282 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:22:10.676046 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b9853115-c5fd-4450-8e22-9235337a3326 tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:10.676772 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b9853115-c5fd-4450-8e22-9235337a3326 tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] [instance: b3a202bf-e6e0-4e0f-9006-e2b7ba4589e4] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:10.679285 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=3 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:22:10.686371 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b9853115-c5fd-4450-8e22-9235337a3326 tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:10.687388 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b9853115-c5fd-4450-8e22-9235337a3326 tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:10.687988 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b9853115-c5fd-4450-8e22-9235337a3326 tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:10.688882 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b9853115-c5fd-4450-8e22-9235337a3326 tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:10.689493 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b9853115-c5fd-4450-8e22-9235337a3326 tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:10.690076 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b9853115-c5fd-4450-8e22-9235337a3326 tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:10.748267 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:22:10.771654 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=6 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:22:10.843455 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-b9853115-c5fd-4450-8e22-9235337a3326 tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4200015ba7cc4d43a4328ceb6626521f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b380f28820f4d9e85ba243f04427452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:10.855956 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b9853115-c5fd-4450-8e22-9235337a3326 tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] 10.222.0.33 "GET /compute/v2.1/servers/b3a202bf-e6e0-4e0f-9006-e2b7ba4589e4" status: 200 len: 1282 microversion: 2.1 time: 0.183265 Oct 04 21:22:10.855956 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3097/6227] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:22:10 2022] GET /compute/v2.1/servers/b3a202bf-e6e0-4e0f-9006-e2b7ba4589e4 => generated 1282 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:22:11.885306 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-44a84112-ebbb-48b6-80e3-bf23ef7a1e6b tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:11.887577 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-44a84112-ebbb-48b6-80e3-bf23ef7a1e6b tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] [instance: b3a202bf-e6e0-4e0f-9006-e2b7ba4589e4] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:11.892487 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell0:SELECT=6 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:22:11.902956 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-44a84112-ebbb-48b6-80e3-bf23ef7a1e6b tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:11.903816 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-44a84112-ebbb-48b6-80e3-bf23ef7a1e6b tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:11.904613 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-44a84112-ebbb-48b6-80e3-bf23ef7a1e6b tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:11.906789 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-44a84112-ebbb-48b6-80e3-bf23ef7a1e6b tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:11.907642 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-44a84112-ebbb-48b6-80e3-bf23ef7a1e6b tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:11.908383 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-44a84112-ebbb-48b6-80e3-bf23ef7a1e6b tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:12.086726 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-44a84112-ebbb-48b6-80e3-bf23ef7a1e6b tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4200015ba7cc4d43a4328ceb6626521f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b380f28820f4d9e85ba243f04427452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:12.095385 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-44a84112-ebbb-48b6-80e3-bf23ef7a1e6b tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] 10.222.0.33 "GET /compute/v2.1/servers/b3a202bf-e6e0-4e0f-9006-e2b7ba4589e4" status: 200 len: 1270 microversion: 2.1 time: 0.218475 Oct 04 21:22:12.095980 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3131/6228] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:22:11 2022] GET /compute/v2.1/servers/b3a202bf-e6e0-4e0f-9006-e2b7ba4589e4 => generated 1270 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:22:13.119596 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9f5386cb-a651-4765-b763-3ec3843ef348 tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:13.120292 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-9f5386cb-a651-4765-b763-3ec3843ef348 tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] [instance: b3a202bf-e6e0-4e0f-9006-e2b7ba4589e4] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:13.127454 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9f5386cb-a651-4765-b763-3ec3843ef348 tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:13.127944 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9f5386cb-a651-4765-b763-3ec3843ef348 tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:13.128375 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9f5386cb-a651-4765-b763-3ec3843ef348 tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:13.129068 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9f5386cb-a651-4765-b763-3ec3843ef348 tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:13.129516 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9f5386cb-a651-4765-b763-3ec3843ef348 tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:13.129937 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9f5386cb-a651-4765-b763-3ec3843ef348 tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:13.271061 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-9f5386cb-a651-4765-b763-3ec3843ef348 tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4200015ba7cc4d43a4328ceb6626521f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b380f28820f4d9e85ba243f04427452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:13.279487 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-9f5386cb-a651-4765-b763-3ec3843ef348 tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] 10.222.0.33 "GET /compute/v2.1/servers/b3a202bf-e6e0-4e0f-9006-e2b7ba4589e4" status: 200 len: 1270 microversion: 2.1 time: 0.164463 Oct 04 21:22:13.280069 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3098/6229] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:22:13 2022] GET /compute/v2.1/servers/b3a202bf-e6e0-4e0f-9006-e2b7ba4589e4 => generated 1270 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:22:13.633787 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-4e763b73-70c5-43c9-bb71-886ddf3edfa2 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:13.634377 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-4e763b73-70c5-43c9-bb71-886ddf3edfa2 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: 5f1c57e2-0880-472c-81e0-da0981e3791c] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:13.642666 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4e763b73-70c5-43c9-bb71-886ddf3edfa2 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:13.643167 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4e763b73-70c5-43c9-bb71-886ddf3edfa2 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:13.643615 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4e763b73-70c5-43c9-bb71-886ddf3edfa2 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:13.644360 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4e763b73-70c5-43c9-bb71-886ddf3edfa2 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:13.644823 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4e763b73-70c5-43c9-bb71-886ddf3edfa2 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:13.645262 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4e763b73-70c5-43c9-bb71-886ddf3edfa2 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:13.673196 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-4e763b73-70c5-43c9-bb71-886ddf3edfa2 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: 5f1c57e2-0880-472c-81e0-da0981e3791c] Going to try to terminate instance {{(pid=128802) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:22:13.757765 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-4e763b73-70c5-43c9-bb71-886ddf3edfa2 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "DELETE /compute/v2.1/servers/5f1c57e2-0880-472c-81e0-da0981e3791c" status: 204 len: 0 microversion: 2.1 time: 0.127322 Oct 04 21:22:13.761997 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3132/6230] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 21:22:13 2022] DELETE /compute/v2.1/servers/5f1c57e2-0880-472c-81e0-da0981e3791c => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 21:22:13.768862 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-02b6a4db-1b80-42d5-9676-ac6b046e9fe3 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:13.769487 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-02b6a4db-1b80-42d5-9676-ac6b046e9fe3 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: 5f1c57e2-0880-472c-81e0-da0981e3791c] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:13.776549 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-02b6a4db-1b80-42d5-9676-ac6b046e9fe3 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:13.777252 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-02b6a4db-1b80-42d5-9676-ac6b046e9fe3 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:13.777696 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-02b6a4db-1b80-42d5-9676-ac6b046e9fe3 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:13.778445 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-02b6a4db-1b80-42d5-9676-ac6b046e9fe3 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:13.778905 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-02b6a4db-1b80-42d5-9676-ac6b046e9fe3 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:13.779338 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-02b6a4db-1b80-42d5-9676-ac6b046e9fe3 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:13.915482 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-02b6a4db-1b80-42d5-9676-ac6b046e9fe3 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:13.923687 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-02b6a4db-1b80-42d5-9676-ac6b046e9fe3 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/5f1c57e2-0880-472c-81e0-da0981e3791c" status: 200 len: 1411 microversion: 2.1 time: 0.159296 Oct 04 21:22:13.924264 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3099/6231] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:22:13 2022] GET /compute/v2.1/servers/5f1c57e2-0880-472c-81e0-da0981e3791c => generated 1411 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:22:14.304366 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-26a9cdb9-9fab-47ae-a398-a308711c45bd tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:14.305100 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-26a9cdb9-9fab-47ae-a398-a308711c45bd tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] [instance: b3a202bf-e6e0-4e0f-9006-e2b7ba4589e4] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:14.312474 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-26a9cdb9-9fab-47ae-a398-a308711c45bd tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:14.312982 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-26a9cdb9-9fab-47ae-a398-a308711c45bd tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:14.313437 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-26a9cdb9-9fab-47ae-a398-a308711c45bd tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:14.314159 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-26a9cdb9-9fab-47ae-a398-a308711c45bd tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:14.314666 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-26a9cdb9-9fab-47ae-a398-a308711c45bd tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:14.315107 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-26a9cdb9-9fab-47ae-a398-a308711c45bd tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:14.451489 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-26a9cdb9-9fab-47ae-a398-a308711c45bd tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4200015ba7cc4d43a4328ceb6626521f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b380f28820f4d9e85ba243f04427452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:14.459406 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-26a9cdb9-9fab-47ae-a398-a308711c45bd tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] 10.222.0.33 "GET /compute/v2.1/servers/b3a202bf-e6e0-4e0f-9006-e2b7ba4589e4" status: 200 len: 1270 microversion: 2.1 time: 0.159451 Oct 04 21:22:14.459980 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3133/6232] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:22:14 2022] GET /compute/v2.1/servers/b3a202bf-e6e0-4e0f-9006-e2b7ba4589e4 => generated 1270 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:22:14.948468 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0121d339-fcaf-4ff7-a44c-bca34579a20e tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:14.949021 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-0121d339-fcaf-4ff7-a44c-bca34579a20e tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: 5f1c57e2-0880-472c-81e0-da0981e3791c] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:14.956099 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0121d339-fcaf-4ff7-a44c-bca34579a20e tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:14.956651 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0121d339-fcaf-4ff7-a44c-bca34579a20e tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:14.957097 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0121d339-fcaf-4ff7-a44c-bca34579a20e tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:14.957884 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0121d339-fcaf-4ff7-a44c-bca34579a20e tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:14.958283 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0121d339-fcaf-4ff7-a44c-bca34579a20e tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:14.958757 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0121d339-fcaf-4ff7-a44c-bca34579a20e tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:15.099521 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-0121d339-fcaf-4ff7-a44c-bca34579a20e tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:15.107724 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-0121d339-fcaf-4ff7-a44c-bca34579a20e tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/5f1c57e2-0880-472c-81e0-da0981e3791c" status: 200 len: 1411 microversion: 2.1 time: 0.163325 Oct 04 21:22:15.108082 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3100/6233] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:22:14 2022] GET /compute/v2.1/servers/5f1c57e2-0880-472c-81e0-da0981e3791c => generated 1411 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:22:15.482292 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-a94d3742-8671-4757-ae98-e202c5291634 tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:15.482979 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-a94d3742-8671-4757-ae98-e202c5291634 tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] [instance: b3a202bf-e6e0-4e0f-9006-e2b7ba4589e4] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:15.489920 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a94d3742-8671-4757-ae98-e202c5291634 tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:15.490451 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a94d3742-8671-4757-ae98-e202c5291634 tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:15.490904 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a94d3742-8671-4757-ae98-e202c5291634 tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:15.491641 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a94d3742-8671-4757-ae98-e202c5291634 tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:15.492094 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a94d3742-8671-4757-ae98-e202c5291634 tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:15.492536 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a94d3742-8671-4757-ae98-e202c5291634 tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:15.728053 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-a94d3742-8671-4757-ae98-e202c5291634 tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4200015ba7cc4d43a4328ceb6626521f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b380f28820f4d9e85ba243f04427452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:15.736782 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-a94d3742-8671-4757-ae98-e202c5291634 tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] 10.222.0.33 "GET /compute/v2.1/servers/b3a202bf-e6e0-4e0f-9006-e2b7ba4589e4" status: 200 len: 1270 microversion: 2.1 time: 0.258444 Oct 04 21:22:15.737369 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3134/6234] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:22:15 2022] GET /compute/v2.1/servers/b3a202bf-e6e0-4e0f-9006-e2b7ba4589e4 => generated 1270 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:22:16.109996 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-6e26f3cd-7865-410f-9fb0-77fa8e5f97af req-17bc386f-c01e-4881-84b8-4209b03ce725 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f1c57e2-0880-472c-81e0-da0981e3791c", "name": "network-vif-deleted", "tag": "a06b15f8-910c-41a5-8596-8d4e35c1f011"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:22:16.120507 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-6e26f3cd-7865-410f-9fb0-77fa8e5f97af req-17bc386f-c01e-4881-84b8-4209b03ce725 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:16.120986 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-6e26f3cd-7865-410f-9fb0-77fa8e5f97af req-17bc386f-c01e-4881-84b8-4209b03ce725 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:16.121412 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-6e26f3cd-7865-410f-9fb0-77fa8e5f97af req-17bc386f-c01e-4881-84b8-4209b03ce725 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:16.129854 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-11aa16fd-aca6-4258-80a5-fa7fda06c4b7 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:16.130663 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-11aa16fd-aca6-4258-80a5-fa7fda06c4b7 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: 5f1c57e2-0880-472c-81e0-da0981e3791c] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:16.133159 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-6e26f3cd-7865-410f-9fb0-77fa8e5f97af req-17bc386f-c01e-4881-84b8-4209b03ce725 service nova] Creating event network-vif-deleted:a06b15f8-910c-41a5-8596-8d4e35c1f011 for instance 5f1c57e2-0880-472c-81e0-da0981e3791c on n-h2-854823-8 Oct 04 21:22:16.137384 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-11aa16fd-aca6-4258-80a5-fa7fda06c4b7 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:16.137893 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-11aa16fd-aca6-4258-80a5-fa7fda06c4b7 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:16.138430 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-11aa16fd-aca6-4258-80a5-fa7fda06c4b7 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:16.138554 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-6e26f3cd-7865-410f-9fb0-77fa8e5f97af req-17bc386f-c01e-4881-84b8-4209b03ce725 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.170399 Oct 04 21:22:16.139360 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3101/6235] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:22:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:22:16.139497 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-11aa16fd-aca6-4258-80a5-fa7fda06c4b7 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:16.139670 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-11aa16fd-aca6-4258-80a5-fa7fda06c4b7 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:16.140331 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-11aa16fd-aca6-4258-80a5-fa7fda06c4b7 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:16.207335 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-11aa16fd-aca6-4258-80a5-fa7fda06c4b7 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:16.216319 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-11aa16fd-aca6-4258-80a5-fa7fda06c4b7 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/5f1c57e2-0880-472c-81e0-da0981e3791c" status: 200 len: 1202 microversion: 2.1 time: 0.090385 Oct 04 21:22:16.216915 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3135/6236] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:22:16 2022] GET /compute/v2.1/servers/5f1c57e2-0880-472c-81e0-da0981e3791c => generated 1202 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:22:16.759682 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a25657db-2fb1-4f5d-bdf4-d19d91c5f042 tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:16.760408 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a25657db-2fb1-4f5d-bdf4-d19d91c5f042 tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] [instance: b3a202bf-e6e0-4e0f-9006-e2b7ba4589e4] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:16.767071 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a25657db-2fb1-4f5d-bdf4-d19d91c5f042 tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:16.767565 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a25657db-2fb1-4f5d-bdf4-d19d91c5f042 tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:16.768004 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a25657db-2fb1-4f5d-bdf4-d19d91c5f042 tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:16.768716 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a25657db-2fb1-4f5d-bdf4-d19d91c5f042 tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:16.769176 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a25657db-2fb1-4f5d-bdf4-d19d91c5f042 tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:16.769602 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a25657db-2fb1-4f5d-bdf4-d19d91c5f042 tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:16.915255 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-a25657db-2fb1-4f5d-bdf4-d19d91c5f042 tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4200015ba7cc4d43a4328ceb6626521f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b380f28820f4d9e85ba243f04427452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:16.924233 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a25657db-2fb1-4f5d-bdf4-d19d91c5f042 tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] 10.222.0.33 "GET /compute/v2.1/servers/b3a202bf-e6e0-4e0f-9006-e2b7ba4589e4" status: 200 len: 1270 microversion: 2.1 time: 0.168896 Oct 04 21:22:16.924829 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3102/6237] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:22:16 2022] GET /compute/v2.1/servers/b3a202bf-e6e0-4e0f-9006-e2b7ba4589e4 => generated 1270 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:22:17.240144 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-c658a8db-e20d-45e4-ba76-214fe0a284d9 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:17.240899 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-c658a8db-e20d-45e4-ba76-214fe0a284d9 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: 5f1c57e2-0880-472c-81e0-da0981e3791c] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:17.249218 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c658a8db-e20d-45e4-ba76-214fe0a284d9 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:17.249811 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c658a8db-e20d-45e4-ba76-214fe0a284d9 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:17.250324 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c658a8db-e20d-45e4-ba76-214fe0a284d9 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:17.251156 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c658a8db-e20d-45e4-ba76-214fe0a284d9 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:17.251693 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c658a8db-e20d-45e4-ba76-214fe0a284d9 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:17.252205 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c658a8db-e20d-45e4-ba76-214fe0a284d9 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:17.318456 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-c658a8db-e20d-45e4-ba76-214fe0a284d9 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:17.326745 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-c658a8db-e20d-45e4-ba76-214fe0a284d9 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/5f1c57e2-0880-472c-81e0-da0981e3791c" status: 200 len: 1202 microversion: 2.1 time: 0.090538 Oct 04 21:22:17.327321 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3136/6238] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:22:17 2022] GET /compute/v2.1/servers/5f1c57e2-0880-472c-81e0-da0981e3791c => generated 1202 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:22:17.947908 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-73f88e62-e5f1-4567-ac3e-0fac358434fb tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:17.948440 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-73f88e62-e5f1-4567-ac3e-0fac358434fb tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] [instance: b3a202bf-e6e0-4e0f-9006-e2b7ba4589e4] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:17.955910 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-73f88e62-e5f1-4567-ac3e-0fac358434fb tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:17.956397 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-73f88e62-e5f1-4567-ac3e-0fac358434fb tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:17.956830 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-73f88e62-e5f1-4567-ac3e-0fac358434fb tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:17.957803 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-73f88e62-e5f1-4567-ac3e-0fac358434fb tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:17.958256 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-73f88e62-e5f1-4567-ac3e-0fac358434fb tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:17.958702 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-73f88e62-e5f1-4567-ac3e-0fac358434fb tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:18.097512 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-73f88e62-e5f1-4567-ac3e-0fac358434fb tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4200015ba7cc4d43a4328ceb6626521f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b380f28820f4d9e85ba243f04427452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:18.106561 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-73f88e62-e5f1-4567-ac3e-0fac358434fb tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] 10.222.0.33 "GET /compute/v2.1/servers/b3a202bf-e6e0-4e0f-9006-e2b7ba4589e4" status: 200 len: 1270 microversion: 2.1 time: 0.162453 Oct 04 21:22:18.107170 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3103/6239] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:22:17 2022] GET /compute/v2.1/servers/b3a202bf-e6e0-4e0f-9006-e2b7ba4589e4 => generated 1270 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:22:18.350291 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-8288c588-bb0e-465e-b7d2-588751e94d34 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:18.351394 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-8288c588-bb0e-465e-b7d2-588751e94d34 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: 5f1c57e2-0880-472c-81e0-da0981e3791c] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:18.360040 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8288c588-bb0e-465e-b7d2-588751e94d34 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:18.360936 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8288c588-bb0e-465e-b7d2-588751e94d34 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:18.361645 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8288c588-bb0e-465e-b7d2-588751e94d34 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:18.362721 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8288c588-bb0e-465e-b7d2-588751e94d34 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:18.363497 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8288c588-bb0e-465e-b7d2-588751e94d34 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:18.364298 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8288c588-bb0e-465e-b7d2-588751e94d34 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:18.450409 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-8288c588-bb0e-465e-b7d2-588751e94d34 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:18.458913 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-8288c588-bb0e-465e-b7d2-588751e94d34 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/5f1c57e2-0880-472c-81e0-da0981e3791c" status: 200 len: 1202 microversion: 2.1 time: 0.113395 Oct 04 21:22:18.459509 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3137/6240] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:22:18 2022] GET /compute/v2.1/servers/5f1c57e2-0880-472c-81e0-da0981e3791c => generated 1202 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:22:19.129132 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-562a49fe-2276-4f51-87c6-5876b1fade1b tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:19.129732 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-562a49fe-2276-4f51-87c6-5876b1fade1b tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] [instance: b3a202bf-e6e0-4e0f-9006-e2b7ba4589e4] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:19.137360 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-562a49fe-2276-4f51-87c6-5876b1fade1b tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:19.137839 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-562a49fe-2276-4f51-87c6-5876b1fade1b tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:19.138276 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-562a49fe-2276-4f51-87c6-5876b1fade1b tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:19.139016 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-562a49fe-2276-4f51-87c6-5876b1fade1b tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:19.139466 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-562a49fe-2276-4f51-87c6-5876b1fade1b tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:19.139886 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-562a49fe-2276-4f51-87c6-5876b1fade1b tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:19.279636 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-562a49fe-2276-4f51-87c6-5876b1fade1b tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4200015ba7cc4d43a4328ceb6626521f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b380f28820f4d9e85ba243f04427452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:19.287854 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-562a49fe-2276-4f51-87c6-5876b1fade1b tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] 10.222.0.33 "GET /compute/v2.1/servers/b3a202bf-e6e0-4e0f-9006-e2b7ba4589e4" status: 200 len: 1270 microversion: 2.1 time: 0.162480 Oct 04 21:22:19.288640 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3104/6241] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:22:19 2022] GET /compute/v2.1/servers/b3a202bf-e6e0-4e0f-9006-e2b7ba4589e4 => generated 1270 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:22:19.482405 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-766eddea-e532-49ec-9358-2a6dc88fab1b tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:19.483036 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-766eddea-e532-49ec-9358-2a6dc88fab1b tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: 5f1c57e2-0880-472c-81e0-da0981e3791c] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:19.490005 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-766eddea-e532-49ec-9358-2a6dc88fab1b tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:19.490546 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-766eddea-e532-49ec-9358-2a6dc88fab1b tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:19.491004 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-766eddea-e532-49ec-9358-2a6dc88fab1b tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:19.491721 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-766eddea-e532-49ec-9358-2a6dc88fab1b tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:19.492191 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-766eddea-e532-49ec-9358-2a6dc88fab1b tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:19.492635 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-766eddea-e532-49ec-9358-2a6dc88fab1b tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:19.555513 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-766eddea-e532-49ec-9358-2a6dc88fab1b tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:19.564455 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-766eddea-e532-49ec-9358-2a6dc88fab1b tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/5f1c57e2-0880-472c-81e0-da0981e3791c" status: 200 len: 1202 microversion: 2.1 time: 0.086207 Oct 04 21:22:19.565038 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3138/6242] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:22:19 2022] GET /compute/v2.1/servers/5f1c57e2-0880-472c-81e0-da0981e3791c => generated 1202 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:22:20.314688 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-37624f9e-3a0c-4b60-b9e5-0beec8462202 tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:20.316063 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-37624f9e-3a0c-4b60-b9e5-0beec8462202 tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] [instance: b3a202bf-e6e0-4e0f-9006-e2b7ba4589e4] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:20.343189 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-37624f9e-3a0c-4b60-b9e5-0beec8462202 tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:20.343947 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-37624f9e-3a0c-4b60-b9e5-0beec8462202 tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:20.344556 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-37624f9e-3a0c-4b60-b9e5-0beec8462202 tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:20.345697 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-37624f9e-3a0c-4b60-b9e5-0beec8462202 tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:20.346822 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-37624f9e-3a0c-4b60-b9e5-0beec8462202 tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:20.347353 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-37624f9e-3a0c-4b60-b9e5-0beec8462202 tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:20.424365 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-f2e656e3-7951-4adf-9c8b-1f9d032180cf req-7a91a70c-b6cd-4b87-bd59-1dc3a9affea2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3a202bf-e6e0-4e0f-9006-e2b7ba4589e4", "name": "network-vif-plugged", "status": "completed", "tag": "2dfd43b6-a497-4bfd-baeb-811c56ed006c"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:22:20.436432 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-f2e656e3-7951-4adf-9c8b-1f9d032180cf req-7a91a70c-b6cd-4b87-bd59-1dc3a9affea2 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:20.437250 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-f2e656e3-7951-4adf-9c8b-1f9d032180cf req-7a91a70c-b6cd-4b87-bd59-1dc3a9affea2 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:20.437769 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-f2e656e3-7951-4adf-9c8b-1f9d032180cf req-7a91a70c-b6cd-4b87-bd59-1dc3a9affea2 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:20.450043 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-f2e656e3-7951-4adf-9c8b-1f9d032180cf req-7a91a70c-b6cd-4b87-bd59-1dc3a9affea2 service nova] Creating event network-vif-plugged:2dfd43b6-a497-4bfd-baeb-811c56ed006c for instance b3a202bf-e6e0-4e0f-9006-e2b7ba4589e4 on n-h1-854823-8 Oct 04 21:22:20.455592 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-f2e656e3-7951-4adf-9c8b-1f9d032180cf req-7a91a70c-b6cd-4b87-bd59-1dc3a9affea2 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128575 Oct 04 21:22:20.461083 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3139/6243] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:22:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:22:20.542214 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-37624f9e-3a0c-4b60-b9e5-0beec8462202 tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4200015ba7cc4d43a4328ceb6626521f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b380f28820f4d9e85ba243f04427452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:20.550551 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-37624f9e-3a0c-4b60-b9e5-0beec8462202 tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] 10.222.0.33 "GET /compute/v2.1/servers/b3a202bf-e6e0-4e0f-9006-e2b7ba4589e4" status: 200 len: 1270 microversion: 2.1 time: 0.242615 Oct 04 21:22:20.559365 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3105/6244] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:22:20 2022] GET /compute/v2.1/servers/b3a202bf-e6e0-4e0f-9006-e2b7ba4589e4 => generated 1270 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:22:20.589543 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-af9aa13e-0e1b-46d6-ba1b-dad1b028f762 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:20.590258 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-af9aa13e-0e1b-46d6-ba1b-dad1b028f762 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: 5f1c57e2-0880-472c-81e0-da0981e3791c] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:20.596600 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-af9aa13e-0e1b-46d6-ba1b-dad1b028f762 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:20.597097 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-af9aa13e-0e1b-46d6-ba1b-dad1b028f762 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:20.597546 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-af9aa13e-0e1b-46d6-ba1b-dad1b028f762 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:20.598267 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-af9aa13e-0e1b-46d6-ba1b-dad1b028f762 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:20.598773 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-af9aa13e-0e1b-46d6-ba1b-dad1b028f762 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:20.599216 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-af9aa13e-0e1b-46d6-ba1b-dad1b028f762 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:20.633665 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-af9aa13e-0e1b-46d6-ba1b-dad1b028f762 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:20.634102 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-af9aa13e-0e1b-46d6-ba1b-dad1b028f762 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:20.634621 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-af9aa13e-0e1b-46d6-ba1b-dad1b028f762 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:20.635254 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.objects.instance [None req-af9aa13e-0e1b-46d6-ba1b-dad1b028f762 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lazy-loading 'fault' on Instance uuid 5f1c57e2-0880-472c-81e0-da0981e3791c {{(pid=128802) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:22:20.685143 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-af9aa13e-0e1b-46d6-ba1b-dad1b028f762 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:20.705292 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-af9aa13e-0e1b-46d6-ba1b-dad1b028f762 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/5f1c57e2-0880-472c-81e0-da0981e3791c" status: 200 len: 1207 microversion: 2.1 time: 0.115091 Oct 04 21:22:20.706503 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3140/6245] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:22:20 2022] GET /compute/v2.1/servers/5f1c57e2-0880-472c-81e0-da0981e3791c => generated 1207 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:22:21.574929 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f8477898-8ca5-4b19-8224-bf1a748f0c26 tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:21.575503 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f8477898-8ca5-4b19-8224-bf1a748f0c26 tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] [instance: b3a202bf-e6e0-4e0f-9006-e2b7ba4589e4] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:21.582762 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f8477898-8ca5-4b19-8224-bf1a748f0c26 tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:21.583252 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f8477898-8ca5-4b19-8224-bf1a748f0c26 tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:21.583690 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f8477898-8ca5-4b19-8224-bf1a748f0c26 tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:21.584388 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f8477898-8ca5-4b19-8224-bf1a748f0c26 tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:21.584846 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f8477898-8ca5-4b19-8224-bf1a748f0c26 tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:21.585275 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f8477898-8ca5-4b19-8224-bf1a748f0c26 tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:21.729859 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-7cdb12df-6a86-4cbd-b335-f57a3a4e7260 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:21.731485 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f8477898-8ca5-4b19-8224-bf1a748f0c26 tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4200015ba7cc4d43a4328ceb6626521f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b380f28820f4d9e85ba243f04427452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:21.732150 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-7cdb12df-6a86-4cbd-b335-f57a3a4e7260 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: 5f1c57e2-0880-472c-81e0-da0981e3791c] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:21.739297 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7cdb12df-6a86-4cbd-b335-f57a3a4e7260 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:21.739660 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f8477898-8ca5-4b19-8224-bf1a748f0c26 tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] 10.222.0.33 "GET /compute/v2.1/servers/b3a202bf-e6e0-4e0f-9006-e2b7ba4589e4" status: 200 len: 1270 microversion: 2.1 time: 0.168759 Oct 04 21:22:21.740152 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7cdb12df-6a86-4cbd-b335-f57a3a4e7260 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:21.740617 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7cdb12df-6a86-4cbd-b335-f57a3a4e7260 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:21.741386 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7cdb12df-6a86-4cbd-b335-f57a3a4e7260 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:21.741989 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7cdb12df-6a86-4cbd-b335-f57a3a4e7260 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:21.742452 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7cdb12df-6a86-4cbd-b335-f57a3a4e7260 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:21.748200 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3106/6246] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:22:21 2022] GET /compute/v2.1/servers/b3a202bf-e6e0-4e0f-9006-e2b7ba4589e4 => generated 1270 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:22:21.759856 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.wsgi [None req-7cdb12df-6a86-4cbd-b335-f57a3a4e7260 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] HTTP exception thrown: Instance 5f1c57e2-0880-472c-81e0-da0981e3791c could not be found. Oct 04 21:22:21.761737 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-7cdb12df-6a86-4cbd-b335-f57a3a4e7260 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Request method failure captured: Oct 04 21:22:21.761737 n-d-854823-8 devstack@n-api.service[128802]: request: GET /compute/v2.1/servers/5f1c57e2-0880-472c-81e0-da0981e3791c HTTP/1.1 Oct 04 21:22:21.761737 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 21:22:21.761737 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 21:22:21.761737 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 21:22:21.761737 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 0 Oct 04 21:22:21.761737 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 21:22:21.761737 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 21:22:21.761737 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 21:22:21.761737 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 21:22:21.761737 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPKMhB36sxHtTwvN5cR_FDx6677Bk3r96uZe9x8RsKj2kP41h8elma4Sfp2Sil3wffnoaQT-coMFt-1I-ubK46x1CIQQbRLJJWc6ISWYT8YHNWLLnEGq51UhoqUKdKybGmNCaSC1unJV9CeCDYPI8cjjYW6_GmoH3684NnCEjfslKtuc Oct 04 21:22:21.761737 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 21:22:21.761737 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 21:22:21.761737 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 21:22:21.761737 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 21:22:21.761737 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 21:22:21.761737 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 21:22:21.761737 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: 0d78e06d720d438a9308ae138902f847 Oct 04 21:22:21.761737 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-TestVolumeBootPattern-1361369473 Oct 04 21:22:21.761737 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 21:22:21.761737 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 21:22:21.761737 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0d78e06d720d438a9308ae138902f847", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0d78e06d720d438a9308ae138902f847"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0d78e06d720d438a9308ae138902f847"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0d78e06d720d438a9308ae138902f847"}]}] Oct 04 21:22:21.761737 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-TestVolumeBootPattern-1361369473 Oct 04 21:22:21.761737 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: 0d78e06d720d438a9308ae138902f847 Oct 04 21:22:21.761737 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-TestVolumeBootPattern-1361369473 Oct 04 21:22:21.761737 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-TestVolumeBootPattern-1361369473-project Oct 04 21:22:21.761737 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 21:22:21.761737 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 21:22:21.761737 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: ad7b0b59fad1429e95591b21e33ccbaa Oct 04 21:22:21.761737 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-TestVolumeBootPattern-1361369473-project Oct 04 21:22:21.761737 n-d-854823-8 devstack@n-api.service[128802]: method: > Oct 04 21:22:21.761737 n-d-854823-8 devstack@n-api.service[128802]: exception: Instance 5f1c57e2-0880-472c-81e0-da0981e3791c could not be found. Oct 04 21:22:21.761737 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'id': '5f1c57e2-0880-472c-81e0-da0981e3791c'} Oct 04 21:22:21.761737 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:22:21.761737 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:22:21.761737 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:22:21.761737 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:22:21.761737 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:22:21.761737 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:22:21.761737 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:22:21.761737 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:22:21.761737 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:22:21.761737 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:22:21.761737 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f1c57e2-0880-472c-81e0-da0981e3791c could not be found. Oct 04 21:22:21.761737 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:22:21.761737 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:22:21.761737 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:22:21.761737 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:22:21.761737 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:22:21.761737 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:22:21.761737 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:22:21.761737 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:22:21.761737 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:22:21.761737 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:22:21.761737 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:22:21.761737 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:22:21.761737 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:22:21.761737 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:22:21.761737 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:22:21.761737 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:22:21.761737 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f1c57e2-0880-472c-81e0-da0981e3791c could not be found. Oct 04 21:22:21.761737 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:22:21.761737 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:22:21.761737 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:22:21.766747 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:22:21.766747 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:22:21.766747 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:22:21.766747 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:22:21.766747 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:22:21.766747 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f1c57e2-0880-472c-81e0-da0981e3791c could not be found. Oct 04 21:22:21.766747 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:22:21.766747 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-7cdb12df-6a86-4cbd-b335-f57a3a4e7260 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Returning 404 to user: Instance 5f1c57e2-0880-472c-81e0-da0981e3791c could not be found. {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:22:21.766747 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-7cdb12df-6a86-4cbd-b335-f57a3a4e7260 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/5f1c57e2-0880-472c-81e0-da0981e3791c" status: 404 len: 111 microversion: 2.1 time: 0.038580 Oct 04 21:22:21.766747 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3141/6247] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:22:21 2022] GET /compute/v2.1/servers/5f1c57e2-0880-472c-81e0-da0981e3791c => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 21:22:22.764330 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6455bc89-c474-460f-bea4-f32d0c28f37b tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:22.764971 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-6455bc89-c474-460f-bea4-f32d0c28f37b tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] [instance: b3a202bf-e6e0-4e0f-9006-e2b7ba4589e4] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:22.771882 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6455bc89-c474-460f-bea4-f32d0c28f37b tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:22.773059 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6455bc89-c474-460f-bea4-f32d0c28f37b tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:22.773499 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6455bc89-c474-460f-bea4-f32d0c28f37b tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:22.774191 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6455bc89-c474-460f-bea4-f32d0c28f37b tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:22.774901 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6455bc89-c474-460f-bea4-f32d0c28f37b tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:22.775827 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6455bc89-c474-460f-bea4-f32d0c28f37b tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:22.925456 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-6455bc89-c474-460f-bea4-f32d0c28f37b tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4200015ba7cc4d43a4328ceb6626521f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b380f28820f4d9e85ba243f04427452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:22.934742 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-6455bc89-c474-460f-bea4-f32d0c28f37b tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] 10.222.0.33 "GET /compute/v2.1/servers/b3a202bf-e6e0-4e0f-9006-e2b7ba4589e4" status: 200 len: 1457 microversion: 2.1 time: 0.174241 Oct 04 21:22:22.935328 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3107/6248] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:22:22 2022] GET /compute/v2.1/servers/b3a202bf-e6e0-4e0f-9006-e2b7ba4589e4 => generated 1457 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:22:22.959897 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-4daa1584-afb9-47b9-8e19-e0bdba6636c4 tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:22.960470 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-4daa1584-afb9-47b9-8e19-e0bdba6636c4 tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] [instance: b3a202bf-e6e0-4e0f-9006-e2b7ba4589e4] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:22.967617 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4daa1584-afb9-47b9-8e19-e0bdba6636c4 tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:22.968124 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4daa1584-afb9-47b9-8e19-e0bdba6636c4 tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:22.968575 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4daa1584-afb9-47b9-8e19-e0bdba6636c4 tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:22.969648 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4daa1584-afb9-47b9-8e19-e0bdba6636c4 tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:22.970243 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4daa1584-afb9-47b9-8e19-e0bdba6636c4 tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:22.970754 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4daa1584-afb9-47b9-8e19-e0bdba6636c4 tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:23.113313 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-4daa1584-afb9-47b9-8e19-e0bdba6636c4 tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4200015ba7cc4d43a4328ceb6626521f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b380f28820f4d9e85ba243f04427452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:23.122544 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-4daa1584-afb9-47b9-8e19-e0bdba6636c4 tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] 10.222.0.33 "GET /compute/v2.1/servers/b3a202bf-e6e0-4e0f-9006-e2b7ba4589e4" status: 200 len: 1457 microversion: 2.1 time: 0.167011 Oct 04 21:22:23.123141 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3142/6249] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:22:22 2022] GET /compute/v2.1/servers/b3a202bf-e6e0-4e0f-9006-e2b7ba4589e4 => generated 1457 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:22:23.912806 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9b844014-8df8-453e-a7be-66bb7d7905b1 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:23.913350 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-9b844014-8df8-453e-a7be-66bb7d7905b1 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: f9913cee-0c42-4925-bf29-cc6b5397989c] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:23.920627 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9b844014-8df8-453e-a7be-66bb7d7905b1 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:23.921132 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9b844014-8df8-453e-a7be-66bb7d7905b1 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:23.921555 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9b844014-8df8-453e-a7be-66bb7d7905b1 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:23.922256 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9b844014-8df8-453e-a7be-66bb7d7905b1 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:23.922870 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9b844014-8df8-453e-a7be-66bb7d7905b1 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:23.923307 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9b844014-8df8-453e-a7be-66bb7d7905b1 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:23.938503 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-9b844014-8df8-453e-a7be-66bb7d7905b1 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] HTTP exception thrown: Instance f9913cee-0c42-4925-bf29-cc6b5397989c could not be found. Oct 04 21:22:23.940455 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9b844014-8df8-453e-a7be-66bb7d7905b1 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Request method failure captured: Oct 04 21:22:23.940455 n-d-854823-8 devstack@n-api.service[128801]: request: DELETE /compute/v2.1/servers/f9913cee-0c42-4925-bf29-cc6b5397989c HTTP/1.1 Oct 04 21:22:23.940455 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 21:22:23.940455 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 21:22:23.940455 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 21:22:23.940455 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 0 Oct 04 21:22:23.940455 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 21:22:23.940455 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 21:22:23.940455 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 21:22:23.940455 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 21:22:23.940455 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPKMhB36sxHtTwvN5cR_FDx6677Bk3r96uZe9x8RsKj2kP41h8elma4Sfp2Sil3wffnoaQT-coMFt-1I-ubK46x1CIQQbRLJJWc6ISWYT8YHNWLLnEGq51UhoqUKdKybGmNCaSC1unJV9CeCDYPI8cjjYW6_GmoH3684NnCEjfslKtuc Oct 04 21:22:23.940455 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 21:22:23.940455 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 21:22:23.940455 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 21:22:23.940455 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 21:22:23.940455 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 21:22:23.940455 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 21:22:23.940455 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: 0d78e06d720d438a9308ae138902f847 Oct 04 21:22:23.940455 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-TestVolumeBootPattern-1361369473 Oct 04 21:22:23.940455 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 21:22:23.940455 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 21:22:23.940455 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0d78e06d720d438a9308ae138902f847", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0d78e06d720d438a9308ae138902f847"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0d78e06d720d438a9308ae138902f847"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0d78e06d720d438a9308ae138902f847"}]}] Oct 04 21:22:23.940455 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-TestVolumeBootPattern-1361369473 Oct 04 21:22:23.940455 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: 0d78e06d720d438a9308ae138902f847 Oct 04 21:22:23.940455 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-TestVolumeBootPattern-1361369473 Oct 04 21:22:23.940455 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-TestVolumeBootPattern-1361369473-project Oct 04 21:22:23.940455 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 21:22:23.940455 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 21:22:23.940455 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: ad7b0b59fad1429e95591b21e33ccbaa Oct 04 21:22:23.940455 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-TestVolumeBootPattern-1361369473-project Oct 04 21:22:23.940455 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 21:22:23.940455 n-d-854823-8 devstack@n-api.service[128801]: exception: Instance f9913cee-0c42-4925-bf29-cc6b5397989c could not be found. Oct 04 21:22:23.940455 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': 'f9913cee-0c42-4925-bf29-cc6b5397989c'} Oct 04 21:22:23.940455 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:22:23.940455 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:22:23.940455 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:22:23.940455 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:22:23.940455 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:22:23.940455 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:22:23.940455 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:22:23.940455 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:22:23.940455 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:22:23.940455 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:22:23.940455 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f9913cee-0c42-4925-bf29-cc6b5397989c could not be found. Oct 04 21:22:23.940455 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:22:23.940455 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:22:23.940455 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:22:23.940455 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:22:23.940455 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:22:23.940455 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:22:23.940455 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:22:23.940455 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:22:23.940455 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:22:23.940455 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:22:23.940455 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 21:22:23.940455 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 21:22:23.940455 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 21:22:23.940455 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 21:22:23.940455 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:22:23.940455 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:22:23.940455 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:22:23.940455 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:22:23.945735 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f9913cee-0c42-4925-bf29-cc6b5397989c could not be found. Oct 04 21:22:23.945735 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:22:23.945735 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:22:23.945735 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:22:23.945735 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:22:23.945735 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:22:23.945735 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:22:23.945735 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:22:23.945735 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:22:23.945735 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f9913cee-0c42-4925-bf29-cc6b5397989c could not be found. Oct 04 21:22:23.945735 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:22:23.945735 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9b844014-8df8-453e-a7be-66bb7d7905b1 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Returning 404 to user: Instance f9913cee-0c42-4925-bf29-cc6b5397989c could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:22:23.945735 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-9b844014-8df8-453e-a7be-66bb7d7905b1 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "DELETE /compute/v2.1/servers/f9913cee-0c42-4925-bf29-cc6b5397989c" status: 404 len: 111 microversion: 2.1 time: 0.032977 Oct 04 21:22:23.945735 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3108/6250] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 21:22:23 2022] DELETE /compute/v2.1/servers/f9913cee-0c42-4925-bf29-cc6b5397989c => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:22:23.952109 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-fbb61549-d860-4a76-8699-9be87a897ecc tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:23.952940 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-fbb61549-d860-4a76-8699-9be87a897ecc tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: f9913cee-0c42-4925-bf29-cc6b5397989c] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:23.959315 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fbb61549-d860-4a76-8699-9be87a897ecc tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:23.960042 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fbb61549-d860-4a76-8699-9be87a897ecc tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:23.960793 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fbb61549-d860-4a76-8699-9be87a897ecc tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:23.961671 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fbb61549-d860-4a76-8699-9be87a897ecc tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:23.962146 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fbb61549-d860-4a76-8699-9be87a897ecc tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:23.962756 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fbb61549-d860-4a76-8699-9be87a897ecc tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:23.978840 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.wsgi [None req-fbb61549-d860-4a76-8699-9be87a897ecc tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] HTTP exception thrown: Instance f9913cee-0c42-4925-bf29-cc6b5397989c could not be found. Oct 04 21:22:23.980548 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-fbb61549-d860-4a76-8699-9be87a897ecc tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Request method failure captured: Oct 04 21:22:23.980548 n-d-854823-8 devstack@n-api.service[128802]: request: GET /compute/v2.1/servers/f9913cee-0c42-4925-bf29-cc6b5397989c HTTP/1.1 Oct 04 21:22:23.980548 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 21:22:23.980548 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 21:22:23.980548 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 21:22:23.980548 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 0 Oct 04 21:22:23.980548 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 21:22:23.980548 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 21:22:23.980548 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 21:22:23.980548 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 21:22:23.980548 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPKMhB36sxHtTwvN5cR_FDx6677Bk3r96uZe9x8RsKj2kP41h8elma4Sfp2Sil3wffnoaQT-coMFt-1I-ubK46x1CIQQbRLJJWc6ISWYT8YHNWLLnEGq51UhoqUKdKybGmNCaSC1unJV9CeCDYPI8cjjYW6_GmoH3684NnCEjfslKtuc Oct 04 21:22:23.980548 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 21:22:23.980548 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 21:22:23.980548 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 21:22:23.980548 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 21:22:23.980548 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 21:22:23.980548 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 21:22:23.980548 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: 0d78e06d720d438a9308ae138902f847 Oct 04 21:22:23.980548 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-TestVolumeBootPattern-1361369473 Oct 04 21:22:23.980548 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 21:22:23.980548 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 21:22:23.980548 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0d78e06d720d438a9308ae138902f847", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0d78e06d720d438a9308ae138902f847"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0d78e06d720d438a9308ae138902f847"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0d78e06d720d438a9308ae138902f847"}]}] Oct 04 21:22:23.980548 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-TestVolumeBootPattern-1361369473 Oct 04 21:22:23.980548 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: 0d78e06d720d438a9308ae138902f847 Oct 04 21:22:23.980548 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-TestVolumeBootPattern-1361369473 Oct 04 21:22:23.980548 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-TestVolumeBootPattern-1361369473-project Oct 04 21:22:23.980548 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 21:22:23.980548 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 21:22:23.980548 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: ad7b0b59fad1429e95591b21e33ccbaa Oct 04 21:22:23.980548 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-TestVolumeBootPattern-1361369473-project Oct 04 21:22:23.980548 n-d-854823-8 devstack@n-api.service[128802]: method: > Oct 04 21:22:23.980548 n-d-854823-8 devstack@n-api.service[128802]: exception: Instance f9913cee-0c42-4925-bf29-cc6b5397989c could not be found. Oct 04 21:22:23.980548 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'id': 'f9913cee-0c42-4925-bf29-cc6b5397989c'} Oct 04 21:22:23.980548 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:22:23.980548 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:22:23.980548 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:22:23.980548 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:22:23.980548 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:22:23.980548 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:22:23.980548 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:22:23.980548 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:22:23.980548 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:22:23.980548 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:22:23.980548 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f9913cee-0c42-4925-bf29-cc6b5397989c could not be found. Oct 04 21:22:23.980548 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:22:23.980548 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:22:23.980548 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:22:23.980548 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:22:23.980548 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:22:23.980548 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:22:23.980548 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:22:23.980548 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:22:23.980548 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:22:23.980548 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:22:23.980548 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:22:23.980548 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:22:23.980548 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:22:23.980548 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:22:23.980548 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:22:23.980548 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:22:23.980548 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f9913cee-0c42-4925-bf29-cc6b5397989c could not be found. Oct 04 21:22:23.980548 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:22:23.980548 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:22:23.980548 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:22:23.985689 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:22:23.985689 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:22:23.985689 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:22:23.985689 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:22:23.985689 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:22:23.985689 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f9913cee-0c42-4925-bf29-cc6b5397989c could not be found. Oct 04 21:22:23.985689 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:22:23.985689 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-fbb61549-d860-4a76-8699-9be87a897ecc tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Returning 404 to user: Instance f9913cee-0c42-4925-bf29-cc6b5397989c could not be found. {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:22:23.985689 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-fbb61549-d860-4a76-8699-9be87a897ecc tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/f9913cee-0c42-4925-bf29-cc6b5397989c" status: 404 len: 111 microversion: 2.1 time: 0.035712 Oct 04 21:22:23.985689 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3143/6251] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:22:23 2022] GET /compute/v2.1/servers/f9913cee-0c42-4925-bf29-cc6b5397989c => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:22:24.378089 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-36f9fbf5-5d27-4513-b397-a2f8dc5e3d3b tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:24.378652 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-36f9fbf5-5d27-4513-b397-a2f8dc5e3d3b tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: 5f1c57e2-0880-472c-81e0-da0981e3791c] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:24.385600 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-36f9fbf5-5d27-4513-b397-a2f8dc5e3d3b tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:24.386114 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-36f9fbf5-5d27-4513-b397-a2f8dc5e3d3b tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:24.386576 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-36f9fbf5-5d27-4513-b397-a2f8dc5e3d3b tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:24.387309 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-36f9fbf5-5d27-4513-b397-a2f8dc5e3d3b tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:24.387753 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-36f9fbf5-5d27-4513-b397-a2f8dc5e3d3b tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:24.388216 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-36f9fbf5-5d27-4513-b397-a2f8dc5e3d3b tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:24.402634 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-36f9fbf5-5d27-4513-b397-a2f8dc5e3d3b tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] HTTP exception thrown: Instance 5f1c57e2-0880-472c-81e0-da0981e3791c could not be found. Oct 04 21:22:24.404280 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-36f9fbf5-5d27-4513-b397-a2f8dc5e3d3b tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Request method failure captured: Oct 04 21:22:24.404280 n-d-854823-8 devstack@n-api.service[128801]: request: DELETE /compute/v2.1/servers/5f1c57e2-0880-472c-81e0-da0981e3791c HTTP/1.1 Oct 04 21:22:24.404280 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 21:22:24.404280 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 21:22:24.404280 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 21:22:24.404280 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 0 Oct 04 21:22:24.404280 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 21:22:24.404280 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 21:22:24.404280 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 21:22:24.404280 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 21:22:24.404280 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPKMhB36sxHtTwvN5cR_FDx6677Bk3r96uZe9x8RsKj2kP41h8elma4Sfp2Sil3wffnoaQT-coMFt-1I-ubK46x1CIQQbRLJJWc6ISWYT8YHNWLLnEGq51UhoqUKdKybGmNCaSC1unJV9CeCDYPI8cjjYW6_GmoH3684NnCEjfslKtuc Oct 04 21:22:24.404280 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 21:22:24.404280 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 21:22:24.404280 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 21:22:24.404280 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 21:22:24.404280 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 21:22:24.404280 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 21:22:24.404280 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: 0d78e06d720d438a9308ae138902f847 Oct 04 21:22:24.404280 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-TestVolumeBootPattern-1361369473 Oct 04 21:22:24.404280 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 21:22:24.404280 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 21:22:24.404280 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0d78e06d720d438a9308ae138902f847", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0d78e06d720d438a9308ae138902f847"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0d78e06d720d438a9308ae138902f847"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0d78e06d720d438a9308ae138902f847"}]}] Oct 04 21:22:24.404280 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-TestVolumeBootPattern-1361369473 Oct 04 21:22:24.404280 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: 0d78e06d720d438a9308ae138902f847 Oct 04 21:22:24.404280 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-TestVolumeBootPattern-1361369473 Oct 04 21:22:24.404280 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-TestVolumeBootPattern-1361369473-project Oct 04 21:22:24.404280 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 21:22:24.404280 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 21:22:24.404280 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: ad7b0b59fad1429e95591b21e33ccbaa Oct 04 21:22:24.404280 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-TestVolumeBootPattern-1361369473-project Oct 04 21:22:24.404280 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 21:22:24.404280 n-d-854823-8 devstack@n-api.service[128801]: exception: Instance 5f1c57e2-0880-472c-81e0-da0981e3791c could not be found. Oct 04 21:22:24.404280 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': '5f1c57e2-0880-472c-81e0-da0981e3791c'} Oct 04 21:22:24.404280 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:22:24.404280 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:22:24.404280 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:22:24.404280 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:22:24.404280 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:22:24.404280 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:22:24.404280 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:22:24.404280 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:22:24.404280 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:22:24.404280 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:22:24.404280 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f1c57e2-0880-472c-81e0-da0981e3791c could not be found. Oct 04 21:22:24.404280 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:22:24.404280 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:22:24.404280 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:22:24.404280 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:22:24.404280 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:22:24.404280 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:22:24.404280 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:22:24.404280 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:22:24.404280 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:22:24.404280 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:22:24.404280 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 21:22:24.404280 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 21:22:24.404280 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 21:22:24.404280 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 21:22:24.404280 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:22:24.404280 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:22:24.404280 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:22:24.404280 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:22:24.408626 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f1c57e2-0880-472c-81e0-da0981e3791c could not be found. Oct 04 21:22:24.408626 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:22:24.408626 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:22:24.408626 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:22:24.408626 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:22:24.408626 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:22:24.408626 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:22:24.408626 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:22:24.408626 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:22:24.408626 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f1c57e2-0880-472c-81e0-da0981e3791c could not be found. Oct 04 21:22:24.408626 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:22:24.408626 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-36f9fbf5-5d27-4513-b397-a2f8dc5e3d3b tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Returning 404 to user: Instance 5f1c57e2-0880-472c-81e0-da0981e3791c could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:22:24.408626 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-36f9fbf5-5d27-4513-b397-a2f8dc5e3d3b tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "DELETE /compute/v2.1/servers/5f1c57e2-0880-472c-81e0-da0981e3791c" status: 404 len: 111 microversion: 2.1 time: 0.031572 Oct 04 21:22:24.408626 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3109/6252] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 21:22:24 2022] DELETE /compute/v2.1/servers/5f1c57e2-0880-472c-81e0-da0981e3791c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:22:24.414330 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-7c6bffe3-652b-4fc5-9ca0-e458db7e60bc tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:24.414976 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-7c6bffe3-652b-4fc5-9ca0-e458db7e60bc tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: 5f1c57e2-0880-472c-81e0-da0981e3791c] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:24.421412 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7c6bffe3-652b-4fc5-9ca0-e458db7e60bc tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:24.421915 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7c6bffe3-652b-4fc5-9ca0-e458db7e60bc tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:24.422388 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7c6bffe3-652b-4fc5-9ca0-e458db7e60bc tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:24.423092 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7c6bffe3-652b-4fc5-9ca0-e458db7e60bc tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:24.423558 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7c6bffe3-652b-4fc5-9ca0-e458db7e60bc tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:24.423992 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7c6bffe3-652b-4fc5-9ca0-e458db7e60bc tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:24.438871 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.wsgi [None req-7c6bffe3-652b-4fc5-9ca0-e458db7e60bc tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] HTTP exception thrown: Instance 5f1c57e2-0880-472c-81e0-da0981e3791c could not be found. Oct 04 21:22:24.440357 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-7c6bffe3-652b-4fc5-9ca0-e458db7e60bc tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Request method failure captured: Oct 04 21:22:24.440357 n-d-854823-8 devstack@n-api.service[128802]: request: GET /compute/v2.1/servers/5f1c57e2-0880-472c-81e0-da0981e3791c HTTP/1.1 Oct 04 21:22:24.440357 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 21:22:24.440357 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 21:22:24.440357 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 21:22:24.440357 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 0 Oct 04 21:22:24.440357 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 21:22:24.440357 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 21:22:24.440357 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 21:22:24.440357 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 21:22:24.440357 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPKMhB36sxHtTwvN5cR_FDx6677Bk3r96uZe9x8RsKj2kP41h8elma4Sfp2Sil3wffnoaQT-coMFt-1I-ubK46x1CIQQbRLJJWc6ISWYT8YHNWLLnEGq51UhoqUKdKybGmNCaSC1unJV9CeCDYPI8cjjYW6_GmoH3684NnCEjfslKtuc Oct 04 21:22:24.440357 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 21:22:24.440357 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 21:22:24.440357 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 21:22:24.440357 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 21:22:24.440357 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 21:22:24.440357 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 21:22:24.440357 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: 0d78e06d720d438a9308ae138902f847 Oct 04 21:22:24.440357 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-TestVolumeBootPattern-1361369473 Oct 04 21:22:24.440357 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 21:22:24.440357 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 21:22:24.440357 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0d78e06d720d438a9308ae138902f847", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0d78e06d720d438a9308ae138902f847"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0d78e06d720d438a9308ae138902f847"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0d78e06d720d438a9308ae138902f847"}]}] Oct 04 21:22:24.440357 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-TestVolumeBootPattern-1361369473 Oct 04 21:22:24.440357 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: 0d78e06d720d438a9308ae138902f847 Oct 04 21:22:24.440357 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-TestVolumeBootPattern-1361369473 Oct 04 21:22:24.440357 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-TestVolumeBootPattern-1361369473-project Oct 04 21:22:24.440357 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 21:22:24.440357 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 21:22:24.440357 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: ad7b0b59fad1429e95591b21e33ccbaa Oct 04 21:22:24.440357 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-TestVolumeBootPattern-1361369473-project Oct 04 21:22:24.440357 n-d-854823-8 devstack@n-api.service[128802]: method: > Oct 04 21:22:24.440357 n-d-854823-8 devstack@n-api.service[128802]: exception: Instance 5f1c57e2-0880-472c-81e0-da0981e3791c could not be found. Oct 04 21:22:24.440357 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'id': '5f1c57e2-0880-472c-81e0-da0981e3791c'} Oct 04 21:22:24.440357 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:22:24.440357 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:22:24.440357 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:22:24.440357 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:22:24.440357 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:22:24.440357 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:22:24.440357 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:22:24.440357 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:22:24.440357 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:22:24.440357 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:22:24.440357 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f1c57e2-0880-472c-81e0-da0981e3791c could not be found. Oct 04 21:22:24.440357 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:22:24.440357 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:22:24.440357 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:22:24.440357 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:22:24.440357 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:22:24.440357 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:22:24.440357 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:22:24.440357 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:22:24.440357 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:22:24.440357 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:22:24.440357 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:22:24.440357 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:22:24.440357 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:22:24.440357 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:22:24.440357 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:22:24.440357 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:22:24.440357 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f1c57e2-0880-472c-81e0-da0981e3791c could not be found. Oct 04 21:22:24.440357 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:22:24.440357 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:22:24.440357 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:22:24.445718 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:22:24.445718 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:22:24.445718 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:22:24.445718 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:22:24.445718 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:22:24.445718 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f1c57e2-0880-472c-81e0-da0981e3791c could not be found. Oct 04 21:22:24.445718 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:22:24.445718 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-7c6bffe3-652b-4fc5-9ca0-e458db7e60bc tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Returning 404 to user: Instance 5f1c57e2-0880-472c-81e0-da0981e3791c could not be found. {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:22:24.445718 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-7c6bffe3-652b-4fc5-9ca0-e458db7e60bc tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/5f1c57e2-0880-472c-81e0-da0981e3791c" status: 404 len: 111 microversion: 2.1 time: 0.031353 Oct 04 21:22:24.445718 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3144/6253] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:22:24 2022] GET /compute/v2.1/servers/5f1c57e2-0880-472c-81e0-da0981e3791c => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:22:24.512532 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a0392c29-3fea-4fe0-bcd3-9419fc1a2cc3 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Action: 'create', calling method: .version_select at 0x7f3c740ce430>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1556253219", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCXprKF5/O7J5hWI/FoTqjIWcP7bC2KlGvYoOwYfS7NM6axFgLKbK5ngoCpjlwtp93uGTUnTBj2yZR0k9L8VAQj5OwbrHSwrQtrT4Xef8Ztly1xjMNU6xPn1Eiy4VGfxQQ=="}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:22:24.528928 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-a0392c29-3fea-4fe0-bcd3-9419fc1a2cc3 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Getting quotas for project 0d78e06d720d438a9308ae138902f847. Resources: {'key_pairs'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:22:24.534189 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-a0392c29-3fea-4fe0-bcd3-9419fc1a2cc3 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Getting quotas for user ad7b0b59fad1429e95591b21e33ccbaa and project 0d78e06d720d438a9308ae138902f847. Resources: {'key_pairs'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:22:24.559313 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a0392c29-3fea-4fe0-bcd3-9419fc1a2cc3 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.051069 Oct 04 21:22:24.559938 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3110/6254] 10.222.0.33 () {60 vars in 1159 bytes} [Tue Oct 4 21:22:24 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:22:25.279741 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-f382d3f6-961a-4ce2-ab2f-e648ff057a97 req-28d513bc-6086-473a-865d-dbff357791f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3a202bf-e6e0-4e0f-9006-e2b7ba4589e4", "tag": "2dfd43b6-a497-4bfd-baeb-811c56ed006c"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:22:25.298716 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-f382d3f6-961a-4ce2-ab2f-e648ff057a97 req-28d513bc-6086-473a-865d-dbff357791f7 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:25.301326 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-f382d3f6-961a-4ce2-ab2f-e648ff057a97 req-28d513bc-6086-473a-865d-dbff357791f7 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:25.301829 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-f382d3f6-961a-4ce2-ab2f-e648ff057a97 req-28d513bc-6086-473a-865d-dbff357791f7 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:25.308203 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:22:25.318566 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-f382d3f6-961a-4ce2-ab2f-e648ff057a97 req-28d513bc-6086-473a-865d-dbff357791f7 service nova] Creating event network-changed:2dfd43b6-a497-4bfd-baeb-811c56ed006c for instance b3a202bf-e6e0-4e0f-9006-e2b7ba4589e4 on n-h1-854823-8 Oct 04 21:22:25.324584 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-f382d3f6-961a-4ce2-ab2f-e648ff057a97 req-28d513bc-6086-473a-865d-dbff357791f7 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050711 Oct 04 21:22:25.329057 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3145/6255] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:22:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:22:26.408281 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-78f2ed5f-81ff-46c6-884f-6209d2644c42 req-8f12b327-9ec6-4acf-b0d6-9c6e2823dc1d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3a202bf-e6e0-4e0f-9006-e2b7ba4589e4", "tag": "2dfd43b6-a497-4bfd-baeb-811c56ed006c"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:22:26.420470 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-78f2ed5f-81ff-46c6-884f-6209d2644c42 req-8f12b327-9ec6-4acf-b0d6-9c6e2823dc1d service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:26.421274 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-78f2ed5f-81ff-46c6-884f-6209d2644c42 req-8f12b327-9ec6-4acf-b0d6-9c6e2823dc1d service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:26.421934 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-78f2ed5f-81ff-46c6-884f-6209d2644c42 req-8f12b327-9ec6-4acf-b0d6-9c6e2823dc1d service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:26.435136 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-78f2ed5f-81ff-46c6-884f-6209d2644c42 req-8f12b327-9ec6-4acf-b0d6-9c6e2823dc1d service nova] Creating event network-changed:2dfd43b6-a497-4bfd-baeb-811c56ed006c for instance b3a202bf-e6e0-4e0f-9006-e2b7ba4589e4 on n-h1-854823-8 Oct 04 21:22:26.441310 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-78f2ed5f-81ff-46c6-884f-6209d2644c42 req-8f12b327-9ec6-4acf-b0d6-9c6e2823dc1d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037724 Oct 04 21:22:26.442479 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3111/6256] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:22:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:22:28.461349 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-484b3ad7-39e2-4191-a036-e44ff825ecf1 req-0d5a7ab6-f844-46f1-9882-b17c211ddf28 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3a202bf-e6e0-4e0f-9006-e2b7ba4589e4", "tag": "2dfd43b6-a497-4bfd-baeb-811c56ed006c"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:22:28.475700 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-484b3ad7-39e2-4191-a036-e44ff825ecf1 req-0d5a7ab6-f844-46f1-9882-b17c211ddf28 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:28.476196 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-484b3ad7-39e2-4191-a036-e44ff825ecf1 req-0d5a7ab6-f844-46f1-9882-b17c211ddf28 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:28.476644 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-484b3ad7-39e2-4191-a036-e44ff825ecf1 req-0d5a7ab6-f844-46f1-9882-b17c211ddf28 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:28.489555 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-484b3ad7-39e2-4191-a036-e44ff825ecf1 req-0d5a7ab6-f844-46f1-9882-b17c211ddf28 service nova] Creating event network-changed:2dfd43b6-a497-4bfd-baeb-811c56ed006c for instance b3a202bf-e6e0-4e0f-9006-e2b7ba4589e4 on n-h1-854823-8 Oct 04 21:22:28.495312 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-484b3ad7-39e2-4191-a036-e44ff825ecf1 req-0d5a7ab6-f844-46f1-9882-b17c211ddf28 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038682 Oct 04 21:22:28.495913 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3146/6257] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:22:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:22:41.227769 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=4 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:22:41.228535 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:22:41.229153 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=71 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:22:41.233323 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e899d51b-12a0-44d1-9b54-dec3f6b0356c tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-915102378", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1556253219", "security_groups": [{"name": "tempest-secgroup-smoke-405656399"}], "block_device_mapping_v2": [{"uuid": "e8788df9-09d2-4079-9125-cc3b1ef8c12d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "975b1130-f216-463e-808d-0d3403b17918"}]}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:22:41.355945 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.network.neutron [None req-e899d51b-12a0-44d1-9b54-dec3f6b0356c tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] validate_networks() for [('975b1130-f216-463e-808d-0d3403b17918', None, None, None, None, None)] {{(pid=128801) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:22:41.814744 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-e899d51b-12a0-44d1-9b54-dec3f6b0356c tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Flavor limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:22:41.815164 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-e899d51b-12a0-44d1-9b54-dec3f6b0356c tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Image limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:22:41.815635 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-e899d51b-12a0-44d1-9b54-dec3f6b0356c tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Flavor pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:22:41.816043 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-e899d51b-12a0-44d1-9b54-dec3f6b0356c tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Image pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:22:41.816598 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-e899d51b-12a0-44d1-9b54-dec3f6b0356c tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:22:41.825491 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e899d51b-12a0-44d1-9b54-dec3f6b0356c tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:41.825974 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e899d51b-12a0-44d1-9b54-dec3f6b0356c tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:41.826504 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e899d51b-12a0-44d1-9b54-dec3f6b0356c tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:41.827234 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e899d51b-12a0-44d1-9b54-dec3f6b0356c tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:41.827687 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e899d51b-12a0-44d1-9b54-dec3f6b0356c tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:41.828115 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e899d51b-12a0-44d1-9b54-dec3f6b0356c tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:41.845383 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-e899d51b-12a0-44d1-9b54-dec3f6b0356c tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Getting quotas for project 0d78e06d720d438a9308ae138902f847. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:22:41.850839 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-e899d51b-12a0-44d1-9b54-dec3f6b0356c tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Getting quotas for user ad7b0b59fad1429e95591b21e33ccbaa and project 0d78e06d720d438a9308ae138902f847. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:22:41.911378 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e899d51b-12a0-44d1-9b54-dec3f6b0356c tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Going to run 1 instances... {{(pid=128801) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:22:41.913646 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e899d51b-12a0-44d1-9b54-dec3f6b0356c tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: 7f4b4cbe-49ef-4490-9b41-3d9802916b8a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e8788df9-09d2-4079-9125-cc3b1ef8c12d',volume_size=None,volume_type=None)] {{(pid=128801) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:22:42.042092 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e899d51b-12a0-44d1-9b54-dec3f6b0356c tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.816306 Oct 04 21:22:42.043002 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3112/6258] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 21:22:41 2022] POST /compute/v2.1/servers => generated 405 bytes in 818 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:22:42.054727 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:22:42.058872 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=3 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:22:42.066529 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-307658e7-5698-48a3-b357-378b5f6021d7 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:42.067556 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-307658e7-5698-48a3-b357-378b5f6021d7 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: 7f4b4cbe-49ef-4490-9b41-3d9802916b8a] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:42.126919 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-307658e7-5698-48a3-b357-378b5f6021d7 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:42.135353 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-307658e7-5698-48a3-b357-378b5f6021d7 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/7f4b4cbe-49ef-4490-9b41-3d9802916b8a" status: 200 len: 1094 microversion: 2.1 time: 0.083490 Oct 04 21:22:42.136187 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3147/6259] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:22:42 2022] GET /compute/v2.1/servers/7f4b4cbe-49ef-4490-9b41-3d9802916b8a => generated 1094 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:22:43.160940 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-39504c59-6a56-49ae-9fcc-5946603701a6 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:43.161641 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-39504c59-6a56-49ae-9fcc-5946603701a6 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: 7f4b4cbe-49ef-4490-9b41-3d9802916b8a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:43.171030 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-39504c59-6a56-49ae-9fcc-5946603701a6 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:43.171520 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-39504c59-6a56-49ae-9fcc-5946603701a6 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:43.171954 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-39504c59-6a56-49ae-9fcc-5946603701a6 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:43.172675 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-39504c59-6a56-49ae-9fcc-5946603701a6 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:43.173131 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-39504c59-6a56-49ae-9fcc-5946603701a6 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:43.173554 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-39504c59-6a56-49ae-9fcc-5946603701a6 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:43.271953 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-39504c59-6a56-49ae-9fcc-5946603701a6 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:43.281947 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-39504c59-6a56-49ae-9fcc-5946603701a6 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/7f4b4cbe-49ef-4490-9b41-3d9802916b8a" status: 200 len: 1200 microversion: 2.1 time: 0.126818 Oct 04 21:22:43.282575 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3113/6260] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:22:43 2022] GET /compute/v2.1/servers/7f4b4cbe-49ef-4490-9b41-3d9802916b8a => generated 1200 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:22:44.308899 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-3a8c8602-9494-424a-8f48-4086918e90c5 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:44.309958 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-3a8c8602-9494-424a-8f48-4086918e90c5 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: 7f4b4cbe-49ef-4490-9b41-3d9802916b8a] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:44.323161 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3a8c8602-9494-424a-8f48-4086918e90c5 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:44.323944 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3a8c8602-9494-424a-8f48-4086918e90c5 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:44.325457 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3a8c8602-9494-424a-8f48-4086918e90c5 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:44.326481 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3a8c8602-9494-424a-8f48-4086918e90c5 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:44.327135 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3a8c8602-9494-424a-8f48-4086918e90c5 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:44.327870 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3a8c8602-9494-424a-8f48-4086918e90c5 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:44.568255 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-3a8c8602-9494-424a-8f48-4086918e90c5 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:44.577372 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-3a8c8602-9494-424a-8f48-4086918e90c5 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/7f4b4cbe-49ef-4490-9b41-3d9802916b8a" status: 200 len: 1277 microversion: 2.1 time: 0.273961 Oct 04 21:22:44.578110 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3148/6261] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:22:44 2022] GET /compute/v2.1/servers/7f4b4cbe-49ef-4490-9b41-3d9802916b8a => generated 1277 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:22:45.136740 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-1f6dfb43-8e09-4d6f-ac36-9ad7c0c702fc req-4c17300f-6bd3-43a4-9d37-221624690c38 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f4b4cbe-49ef-4490-9b41-3d9802916b8a", "tag": "7b284047-3a79-4d53-bcab-61d81e187578"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:22:45.153564 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-1f6dfb43-8e09-4d6f-ac36-9ad7c0c702fc req-4c17300f-6bd3-43a4-9d37-221624690c38 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:45.154693 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-1f6dfb43-8e09-4d6f-ac36-9ad7c0c702fc req-4c17300f-6bd3-43a4-9d37-221624690c38 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:45.155417 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-1f6dfb43-8e09-4d6f-ac36-9ad7c0c702fc req-4c17300f-6bd3-43a4-9d37-221624690c38 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:45.173312 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-1f6dfb43-8e09-4d6f-ac36-9ad7c0c702fc req-4c17300f-6bd3-43a4-9d37-221624690c38 service nova] Creating event network-changed:7b284047-3a79-4d53-bcab-61d81e187578 for instance 7f4b4cbe-49ef-4490-9b41-3d9802916b8a on n-h2-854823-8 Oct 04 21:22:45.180047 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-1f6dfb43-8e09-4d6f-ac36-9ad7c0c702fc req-4c17300f-6bd3-43a4-9d37-221624690c38 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049531 Oct 04 21:22:45.181517 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3114/6262] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:22:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:22:45.601303 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-24c683e7-0cdd-42a5-b1d1-bf56cdbb06ca tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:45.602044 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-24c683e7-0cdd-42a5-b1d1-bf56cdbb06ca tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: 7f4b4cbe-49ef-4490-9b41-3d9802916b8a] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:45.610648 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-24c683e7-0cdd-42a5-b1d1-bf56cdbb06ca tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:45.611179 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-24c683e7-0cdd-42a5-b1d1-bf56cdbb06ca tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:45.611775 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-24c683e7-0cdd-42a5-b1d1-bf56cdbb06ca tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:45.612626 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-24c683e7-0cdd-42a5-b1d1-bf56cdbb06ca tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:45.613093 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-24c683e7-0cdd-42a5-b1d1-bf56cdbb06ca tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:45.613533 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-24c683e7-0cdd-42a5-b1d1-bf56cdbb06ca tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:45.850127 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-24c683e7-0cdd-42a5-b1d1-bf56cdbb06ca tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:45.858657 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-24c683e7-0cdd-42a5-b1d1-bf56cdbb06ca tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/7f4b4cbe-49ef-4490-9b41-3d9802916b8a" status: 200 len: 1277 microversion: 2.1 time: 0.261299 Oct 04 21:22:45.859236 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3149/6263] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:22:45 2022] GET /compute/v2.1/servers/7f4b4cbe-49ef-4490-9b41-3d9802916b8a => generated 1277 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:22:46.884393 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f0d26592-2ae8-4ecb-a523-afaa32f68513 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:46.885015 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f0d26592-2ae8-4ecb-a523-afaa32f68513 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: 7f4b4cbe-49ef-4490-9b41-3d9802916b8a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:46.891227 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f0d26592-2ae8-4ecb-a523-afaa32f68513 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:46.891740 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f0d26592-2ae8-4ecb-a523-afaa32f68513 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:46.892176 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f0d26592-2ae8-4ecb-a523-afaa32f68513 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:46.892859 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f0d26592-2ae8-4ecb-a523-afaa32f68513 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:46.893306 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f0d26592-2ae8-4ecb-a523-afaa32f68513 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:46.893725 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f0d26592-2ae8-4ecb-a523-afaa32f68513 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:47.041205 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f0d26592-2ae8-4ecb-a523-afaa32f68513 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:47.050098 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f0d26592-2ae8-4ecb-a523-afaa32f68513 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/7f4b4cbe-49ef-4490-9b41-3d9802916b8a" status: 200 len: 1277 microversion: 2.1 time: 0.171005 Oct 04 21:22:47.050777 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3115/6264] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:22:46 2022] GET /compute/v2.1/servers/7f4b4cbe-49ef-4490-9b41-3d9802916b8a => generated 1277 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:22:48.074935 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-a7aade04-2291-4447-9244-cd2e87bd1c97 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:48.075680 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-a7aade04-2291-4447-9244-cd2e87bd1c97 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: 7f4b4cbe-49ef-4490-9b41-3d9802916b8a] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:48.083009 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a7aade04-2291-4447-9244-cd2e87bd1c97 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:48.083556 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a7aade04-2291-4447-9244-cd2e87bd1c97 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:48.084013 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a7aade04-2291-4447-9244-cd2e87bd1c97 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:48.084835 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a7aade04-2291-4447-9244-cd2e87bd1c97 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:48.085379 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a7aade04-2291-4447-9244-cd2e87bd1c97 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:48.085953 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a7aade04-2291-4447-9244-cd2e87bd1c97 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:48.237839 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-a7aade04-2291-4447-9244-cd2e87bd1c97 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:48.247609 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-a7aade04-2291-4447-9244-cd2e87bd1c97 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/7f4b4cbe-49ef-4490-9b41-3d9802916b8a" status: 200 len: 1277 microversion: 2.1 time: 0.177221 Oct 04 21:22:48.248287 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3150/6265] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:22:48 2022] GET /compute/v2.1/servers/7f4b4cbe-49ef-4490-9b41-3d9802916b8a => generated 1277 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:22:49.273878 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-028b67f1-801b-412e-b1d3-b67156eb1f3a tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:49.275154 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-028b67f1-801b-412e-b1d3-b67156eb1f3a tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: 7f4b4cbe-49ef-4490-9b41-3d9802916b8a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:49.282161 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-028b67f1-801b-412e-b1d3-b67156eb1f3a tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:49.282680 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-028b67f1-801b-412e-b1d3-b67156eb1f3a tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:49.283110 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-028b67f1-801b-412e-b1d3-b67156eb1f3a tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:49.283796 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-028b67f1-801b-412e-b1d3-b67156eb1f3a tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:49.284254 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-028b67f1-801b-412e-b1d3-b67156eb1f3a tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:49.284717 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-028b67f1-801b-412e-b1d3-b67156eb1f3a tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:49.432671 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-028b67f1-801b-412e-b1d3-b67156eb1f3a tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:49.441897 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-028b67f1-801b-412e-b1d3-b67156eb1f3a tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/7f4b4cbe-49ef-4490-9b41-3d9802916b8a" status: 200 len: 1265 microversion: 2.1 time: 0.171350 Oct 04 21:22:49.441897 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3116/6266] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:22:49 2022] GET /compute/v2.1/servers/7f4b4cbe-49ef-4490-9b41-3d9802916b8a => generated 1265 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:22:50.464486 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-ceae25b1-862c-4095-81fe-dbbb00dd9ab1 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:50.465113 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-ceae25b1-862c-4095-81fe-dbbb00dd9ab1 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: 7f4b4cbe-49ef-4490-9b41-3d9802916b8a] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:50.472166 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ceae25b1-862c-4095-81fe-dbbb00dd9ab1 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:50.472667 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ceae25b1-862c-4095-81fe-dbbb00dd9ab1 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:50.473119 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ceae25b1-862c-4095-81fe-dbbb00dd9ab1 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:50.473830 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ceae25b1-862c-4095-81fe-dbbb00dd9ab1 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:50.474301 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ceae25b1-862c-4095-81fe-dbbb00dd9ab1 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:50.474769 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ceae25b1-862c-4095-81fe-dbbb00dd9ab1 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:50.614980 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-ceae25b1-862c-4095-81fe-dbbb00dd9ab1 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:50.623897 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-ceae25b1-862c-4095-81fe-dbbb00dd9ab1 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/7f4b4cbe-49ef-4490-9b41-3d9802916b8a" status: 200 len: 1265 microversion: 2.1 time: 0.163989 Oct 04 21:22:50.624480 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3151/6267] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:22:50 2022] GET /compute/v2.1/servers/7f4b4cbe-49ef-4490-9b41-3d9802916b8a => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:22:51.647929 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b4d25ca3-d91b-4642-a8b3-f9071512a338 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:51.648589 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b4d25ca3-d91b-4642-a8b3-f9071512a338 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: 7f4b4cbe-49ef-4490-9b41-3d9802916b8a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:51.656175 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b4d25ca3-d91b-4642-a8b3-f9071512a338 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:51.656655 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b4d25ca3-d91b-4642-a8b3-f9071512a338 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:51.657082 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b4d25ca3-d91b-4642-a8b3-f9071512a338 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:51.657773 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b4d25ca3-d91b-4642-a8b3-f9071512a338 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:51.658221 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b4d25ca3-d91b-4642-a8b3-f9071512a338 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:51.658671 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b4d25ca3-d91b-4642-a8b3-f9071512a338 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:51.806407 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-b4d25ca3-d91b-4642-a8b3-f9071512a338 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:51.814707 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b4d25ca3-d91b-4642-a8b3-f9071512a338 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/7f4b4cbe-49ef-4490-9b41-3d9802916b8a" status: 200 len: 1265 microversion: 2.1 time: 0.171146 Oct 04 21:22:51.815277 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3117/6268] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:22:51 2022] GET /compute/v2.1/servers/7f4b4cbe-49ef-4490-9b41-3d9802916b8a => generated 1265 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:22:52.840228 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-d769bff0-e474-4be8-aca0-8179ad83dd5e tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:52.840856 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-d769bff0-e474-4be8-aca0-8179ad83dd5e tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: 7f4b4cbe-49ef-4490-9b41-3d9802916b8a] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:52.843619 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell0:SELECT=2 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:22:52.848783 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d769bff0-e474-4be8-aca0-8179ad83dd5e tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:52.849284 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d769bff0-e474-4be8-aca0-8179ad83dd5e tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:52.849739 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d769bff0-e474-4be8-aca0-8179ad83dd5e tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:52.850498 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d769bff0-e474-4be8-aca0-8179ad83dd5e tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:52.850973 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d769bff0-e474-4be8-aca0-8179ad83dd5e tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:52.851418 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d769bff0-e474-4be8-aca0-8179ad83dd5e tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:52.982203 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-d769bff0-e474-4be8-aca0-8179ad83dd5e tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:52.990039 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-d769bff0-e474-4be8-aca0-8179ad83dd5e tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/7f4b4cbe-49ef-4490-9b41-3d9802916b8a" status: 200 len: 1265 microversion: 2.1 time: 0.154776 Oct 04 21:22:52.990644 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3152/6269] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:22:52 2022] GET /compute/v2.1/servers/7f4b4cbe-49ef-4490-9b41-3d9802916b8a => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:22:54.014061 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-82654c5a-6a7b-49db-89c0-bbe066e87f69 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:54.014647 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-82654c5a-6a7b-49db-89c0-bbe066e87f69 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: 7f4b4cbe-49ef-4490-9b41-3d9802916b8a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:54.016565 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:22:54.017234 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=6 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:22:54.025372 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-82654c5a-6a7b-49db-89c0-bbe066e87f69 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:54.025853 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-82654c5a-6a7b-49db-89c0-bbe066e87f69 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:54.026288 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-82654c5a-6a7b-49db-89c0-bbe066e87f69 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:54.027307 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-82654c5a-6a7b-49db-89c0-bbe066e87f69 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:54.027769 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-82654c5a-6a7b-49db-89c0-bbe066e87f69 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:54.028230 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-82654c5a-6a7b-49db-89c0-bbe066e87f69 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:54.167380 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-82654c5a-6a7b-49db-89c0-bbe066e87f69 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:54.175250 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-82654c5a-6a7b-49db-89c0-bbe066e87f69 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/7f4b4cbe-49ef-4490-9b41-3d9802916b8a" status: 200 len: 1265 microversion: 2.1 time: 0.165246 Oct 04 21:22:54.175827 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3118/6270] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:22:54 2022] GET /compute/v2.1/servers/7f4b4cbe-49ef-4490-9b41-3d9802916b8a => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:22:55.199907 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-0ee51cf7-e725-444c-9dab-97b2341ea9af tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:55.200525 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-0ee51cf7-e725-444c-9dab-97b2341ea9af tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: 7f4b4cbe-49ef-4490-9b41-3d9802916b8a] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:55.207650 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0ee51cf7-e725-444c-9dab-97b2341ea9af tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:55.208141 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0ee51cf7-e725-444c-9dab-97b2341ea9af tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:55.208593 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0ee51cf7-e725-444c-9dab-97b2341ea9af tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:55.209300 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0ee51cf7-e725-444c-9dab-97b2341ea9af tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:55.209764 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0ee51cf7-e725-444c-9dab-97b2341ea9af tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:55.210201 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0ee51cf7-e725-444c-9dab-97b2341ea9af tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:55.345375 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-0ee51cf7-e725-444c-9dab-97b2341ea9af tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:55.353690 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-0ee51cf7-e725-444c-9dab-97b2341ea9af tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/7f4b4cbe-49ef-4490-9b41-3d9802916b8a" status: 200 len: 1265 microversion: 2.1 time: 0.158478 Oct 04 21:22:55.354259 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3153/6271] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:22:55 2022] GET /compute/v2.1/servers/7f4b4cbe-49ef-4490-9b41-3d9802916b8a => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:22:56.376559 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-563718f8-d9bf-40ba-a00b-bff91d396d4b tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:56.377173 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-563718f8-d9bf-40ba-a00b-bff91d396d4b tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: 7f4b4cbe-49ef-4490-9b41-3d9802916b8a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:56.384787 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-563718f8-d9bf-40ba-a00b-bff91d396d4b tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:56.385340 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-563718f8-d9bf-40ba-a00b-bff91d396d4b tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:56.385781 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-563718f8-d9bf-40ba-a00b-bff91d396d4b tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:56.386519 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-563718f8-d9bf-40ba-a00b-bff91d396d4b tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:56.386973 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-563718f8-d9bf-40ba-a00b-bff91d396d4b tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:56.387482 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-563718f8-d9bf-40ba-a00b-bff91d396d4b tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:56.519821 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-563718f8-d9bf-40ba-a00b-bff91d396d4b tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:56.528369 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-563718f8-d9bf-40ba-a00b-bff91d396d4b tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/7f4b4cbe-49ef-4490-9b41-3d9802916b8a" status: 200 len: 1265 microversion: 2.1 time: 0.155704 Oct 04 21:22:56.528953 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3119/6272] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:22:56 2022] GET /compute/v2.1/servers/7f4b4cbe-49ef-4490-9b41-3d9802916b8a => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:22:57.550543 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-cafa8228-ce02-4fb4-abd3-737eb435dd33 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:57.551097 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-cafa8228-ce02-4fb4-abd3-737eb435dd33 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: 7f4b4cbe-49ef-4490-9b41-3d9802916b8a] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:57.558712 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cafa8228-ce02-4fb4-abd3-737eb435dd33 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:57.559214 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cafa8228-ce02-4fb4-abd3-737eb435dd33 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:57.559665 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cafa8228-ce02-4fb4-abd3-737eb435dd33 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:57.560371 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cafa8228-ce02-4fb4-abd3-737eb435dd33 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:57.560834 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cafa8228-ce02-4fb4-abd3-737eb435dd33 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:57.561266 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cafa8228-ce02-4fb4-abd3-737eb435dd33 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:57.698001 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-cafa8228-ce02-4fb4-abd3-737eb435dd33 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:57.706098 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-cafa8228-ce02-4fb4-abd3-737eb435dd33 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/7f4b4cbe-49ef-4490-9b41-3d9802916b8a" status: 200 len: 1265 microversion: 2.1 time: 0.159549 Oct 04 21:22:57.706717 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3154/6273] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:22:57 2022] GET /compute/v2.1/servers/7f4b4cbe-49ef-4490-9b41-3d9802916b8a => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:22:58.729255 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b003eb17-b6de-435d-8a5c-9ddf425efe94 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:58.729874 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b003eb17-b6de-435d-8a5c-9ddf425efe94 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: 7f4b4cbe-49ef-4490-9b41-3d9802916b8a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:58.736899 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b003eb17-b6de-435d-8a5c-9ddf425efe94 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:58.737381 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b003eb17-b6de-435d-8a5c-9ddf425efe94 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:58.737816 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b003eb17-b6de-435d-8a5c-9ddf425efe94 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:58.738555 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b003eb17-b6de-435d-8a5c-9ddf425efe94 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:58.739013 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b003eb17-b6de-435d-8a5c-9ddf425efe94 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:58.739438 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b003eb17-b6de-435d-8a5c-9ddf425efe94 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:58.876483 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-b003eb17-b6de-435d-8a5c-9ddf425efe94 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:22:58.885107 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b003eb17-b6de-435d-8a5c-9ddf425efe94 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/7f4b4cbe-49ef-4490-9b41-3d9802916b8a" status: 200 len: 1265 microversion: 2.1 time: 0.160225 Oct 04 21:22:58.885362 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3120/6274] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:22:58 2022] GET /compute/v2.1/servers/7f4b4cbe-49ef-4490-9b41-3d9802916b8a => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:22:59.041642 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-3c8ca66a-86b8-4c10-85e9-30d0f3ace77e req-3e133ea5-4369-4e07-a831-e979687f1257 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f4b4cbe-49ef-4490-9b41-3d9802916b8a", "name": "network-vif-plugged", "status": "completed", "tag": "7b284047-3a79-4d53-bcab-61d81e187578"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:22:59.052704 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-3c8ca66a-86b8-4c10-85e9-30d0f3ace77e req-3e133ea5-4369-4e07-a831-e979687f1257 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:59.053203 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-3c8ca66a-86b8-4c10-85e9-30d0f3ace77e req-3e133ea5-4369-4e07-a831-e979687f1257 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:59.053650 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-3c8ca66a-86b8-4c10-85e9-30d0f3ace77e req-3e133ea5-4369-4e07-a831-e979687f1257 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:59.065460 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-3c8ca66a-86b8-4c10-85e9-30d0f3ace77e req-3e133ea5-4369-4e07-a831-e979687f1257 service nova] Creating event network-vif-plugged:7b284047-3a79-4d53-bcab-61d81e187578 for instance 7f4b4cbe-49ef-4490-9b41-3d9802916b8a on n-h2-854823-8 Oct 04 21:22:59.071518 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-3c8ca66a-86b8-4c10-85e9-30d0f3ace77e req-3e133ea5-4369-4e07-a831-e979687f1257 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034046 Oct 04 21:22:59.072222 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3155/6275] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:22:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:22:59.908708 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-39662dc6-9d17-4053-a794-653e49f482c8 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:22:59.909318 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-39662dc6-9d17-4053-a794-653e49f482c8 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: 7f4b4cbe-49ef-4490-9b41-3d9802916b8a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:22:59.917174 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-39662dc6-9d17-4053-a794-653e49f482c8 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:59.917657 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-39662dc6-9d17-4053-a794-653e49f482c8 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:59.918088 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-39662dc6-9d17-4053-a794-653e49f482c8 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:22:59.918816 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-39662dc6-9d17-4053-a794-653e49f482c8 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:22:59.919272 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-39662dc6-9d17-4053-a794-653e49f482c8 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:22:59.919692 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-39662dc6-9d17-4053-a794-653e49f482c8 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:00.058549 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-39662dc6-9d17-4053-a794-653e49f482c8 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:23:00.067062 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-39662dc6-9d17-4053-a794-653e49f482c8 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/7f4b4cbe-49ef-4490-9b41-3d9802916b8a" status: 200 len: 1265 microversion: 2.1 time: 0.162275 Oct 04 21:23:00.067812 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3121/6276] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:22:59 2022] GET /compute/v2.1/servers/7f4b4cbe-49ef-4490-9b41-3d9802916b8a => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:23:01.092522 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-36d2c784-28b5-4a21-9a30-25ca63c97ed3 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:23:01.093236 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-36d2c784-28b5-4a21-9a30-25ca63c97ed3 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: 7f4b4cbe-49ef-4490-9b41-3d9802916b8a] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:23:01.099471 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-36d2c784-28b5-4a21-9a30-25ca63c97ed3 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:01.099973 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-36d2c784-28b5-4a21-9a30-25ca63c97ed3 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:01.100421 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-36d2c784-28b5-4a21-9a30-25ca63c97ed3 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:01.101134 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-36d2c784-28b5-4a21-9a30-25ca63c97ed3 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:01.101604 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-36d2c784-28b5-4a21-9a30-25ca63c97ed3 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:01.102624 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-36d2c784-28b5-4a21-9a30-25ca63c97ed3 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:01.238314 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-36d2c784-28b5-4a21-9a30-25ca63c97ed3 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:23:01.246814 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-36d2c784-28b5-4a21-9a30-25ca63c97ed3 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/7f4b4cbe-49ef-4490-9b41-3d9802916b8a" status: 200 len: 1452 microversion: 2.1 time: 0.159390 Oct 04 21:23:01.247378 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3156/6277] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:23:01 2022] GET /compute/v2.1/servers/7f4b4cbe-49ef-4490-9b41-3d9802916b8a => generated 1452 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:23:01.270192 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1c861638-0ef9-400a-826a-70d538a495a0 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:23:01.271072 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-1c861638-0ef9-400a-826a-70d538a495a0 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: 7f4b4cbe-49ef-4490-9b41-3d9802916b8a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:23:01.279527 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1c861638-0ef9-400a-826a-70d538a495a0 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:01.280088 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1c861638-0ef9-400a-826a-70d538a495a0 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:01.280557 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1c861638-0ef9-400a-826a-70d538a495a0 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:01.281444 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1c861638-0ef9-400a-826a-70d538a495a0 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:01.281934 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1c861638-0ef9-400a-826a-70d538a495a0 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:01.282546 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1c861638-0ef9-400a-826a-70d538a495a0 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:01.429149 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-1c861638-0ef9-400a-826a-70d538a495a0 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:23:01.438249 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-1c861638-0ef9-400a-826a-70d538a495a0 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/7f4b4cbe-49ef-4490-9b41-3d9802916b8a" status: 200 len: 1452 microversion: 2.1 time: 0.172532 Oct 04 21:23:01.438895 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3122/6278] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:23:01 2022] GET /compute/v2.1/servers/7f4b4cbe-49ef-4490-9b41-3d9802916b8a => generated 1452 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:23:02.347631 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-e852bd61-1f82-4e20-a73a-b0ae3957ea23 tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:23:02.348753 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-e852bd61-1f82-4e20-a73a-b0ae3957ea23 tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] [instance: b3a202bf-e6e0-4e0f-9006-e2b7ba4589e4] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:23:02.360363 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e852bd61-1f82-4e20-a73a-b0ae3957ea23 tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:02.361487 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e852bd61-1f82-4e20-a73a-b0ae3957ea23 tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:02.362154 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e852bd61-1f82-4e20-a73a-b0ae3957ea23 tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:02.365618 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e852bd61-1f82-4e20-a73a-b0ae3957ea23 tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:02.366307 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e852bd61-1f82-4e20-a73a-b0ae3957ea23 tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:02.367096 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e852bd61-1f82-4e20-a73a-b0ae3957ea23 tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:02.409477 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-e852bd61-1f82-4e20-a73a-b0ae3957ea23 tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] [instance: b3a202bf-e6e0-4e0f-9006-e2b7ba4589e4] Going to try to terminate instance {{(pid=128802) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:23:02.433215 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-b2e200e4-af9b-469b-8278-f52d52f8332a req-663082e0-a3d7-41b5-a2f6-2e93d92b8126 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3a202bf-e6e0-4e0f-9006-e2b7ba4589e4", "tag": "2dfd43b6-a497-4bfd-baeb-811c56ed006c"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:23:02.444673 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-b2e200e4-af9b-469b-8278-f52d52f8332a req-663082e0-a3d7-41b5-a2f6-2e93d92b8126 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:02.445668 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-b2e200e4-af9b-469b-8278-f52d52f8332a req-663082e0-a3d7-41b5-a2f6-2e93d92b8126 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:02.446329 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-b2e200e4-af9b-469b-8278-f52d52f8332a req-663082e0-a3d7-41b5-a2f6-2e93d92b8126 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:02.459302 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-b2e200e4-af9b-469b-8278-f52d52f8332a req-663082e0-a3d7-41b5-a2f6-2e93d92b8126 service nova] Creating event network-changed:2dfd43b6-a497-4bfd-baeb-811c56ed006c for instance b3a202bf-e6e0-4e0f-9006-e2b7ba4589e4 on n-h1-854823-8 Oct 04 21:23:02.467198 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-b2e200e4-af9b-469b-8278-f52d52f8332a req-663082e0-a3d7-41b5-a2f6-2e93d92b8126 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.128258 Oct 04 21:23:02.468338 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3123/6279] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:23:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:23:02.543291 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-e852bd61-1f82-4e20-a73a-b0ae3957ea23 tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] 10.222.0.33 "DELETE /compute/v2.1/servers/b3a202bf-e6e0-4e0f-9006-e2b7ba4589e4" status: 204 len: 0 microversion: 2.1 time: 0.205869 Oct 04 21:23:02.555961 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3157/6280] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 21:23:02 2022] DELETE /compute/v2.1/servers/b3a202bf-e6e0-4e0f-9006-e2b7ba4589e4 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:23:02.562988 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-95829f72-35e1-40a8-89f3-c474ec12ba67 tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:23:02.563785 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-95829f72-35e1-40a8-89f3-c474ec12ba67 tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] [instance: b3a202bf-e6e0-4e0f-9006-e2b7ba4589e4] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:23:02.572775 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-95829f72-35e1-40a8-89f3-c474ec12ba67 tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:02.573276 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-95829f72-35e1-40a8-89f3-c474ec12ba67 tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:02.573719 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-95829f72-35e1-40a8-89f3-c474ec12ba67 tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:02.574592 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-95829f72-35e1-40a8-89f3-c474ec12ba67 tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:02.575051 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-95829f72-35e1-40a8-89f3-c474ec12ba67 tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:02.575594 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-95829f72-35e1-40a8-89f3-c474ec12ba67 tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:02.857647 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-95829f72-35e1-40a8-89f3-c474ec12ba67 tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4200015ba7cc4d43a4328ceb6626521f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b380f28820f4d9e85ba243f04427452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:23:02.866973 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-95829f72-35e1-40a8-89f3-c474ec12ba67 tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] 10.222.0.33 "GET /compute/v2.1/servers/b3a202bf-e6e0-4e0f-9006-e2b7ba4589e4" status: 200 len: 1581 microversion: 2.1 time: 0.313468 Oct 04 21:23:02.868597 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3124/6281] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:23:02 2022] GET /compute/v2.1/servers/b3a202bf-e6e0-4e0f-9006-e2b7ba4589e4 => generated 1581 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:23:03.352346 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-e12f1cef-03b0-4e75-af5c-1ced60d18b39 req-1f0903f3-796b-4115-ae48-1014973cd761 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f4b4cbe-49ef-4490-9b41-3d9802916b8a", "tag": "7b284047-3a79-4d53-bcab-61d81e187578"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:23:03.366463 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-e12f1cef-03b0-4e75-af5c-1ced60d18b39 req-1f0903f3-796b-4115-ae48-1014973cd761 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:03.368153 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-e12f1cef-03b0-4e75-af5c-1ced60d18b39 req-1f0903f3-796b-4115-ae48-1014973cd761 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:03.368683 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-e12f1cef-03b0-4e75-af5c-1ced60d18b39 req-1f0903f3-796b-4115-ae48-1014973cd761 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:03.381664 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-e12f1cef-03b0-4e75-af5c-1ced60d18b39 req-1f0903f3-796b-4115-ae48-1014973cd761 service nova] Creating event network-changed:7b284047-3a79-4d53-bcab-61d81e187578 for instance 7f4b4cbe-49ef-4490-9b41-3d9802916b8a on n-h2-854823-8 Oct 04 21:23:03.388089 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-e12f1cef-03b0-4e75-af5c-1ced60d18b39 req-1f0903f3-796b-4115-ae48-1014973cd761 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041203 Oct 04 21:23:03.389207 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3158/6282] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:23:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:23:03.893670 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-92a0a0c7-7c62-40f8-ac90-169801d7b3e3 tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:23:03.895000 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-92a0a0c7-7c62-40f8-ac90-169801d7b3e3 tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] [instance: b3a202bf-e6e0-4e0f-9006-e2b7ba4589e4] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:23:03.909667 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-92a0a0c7-7c62-40f8-ac90-169801d7b3e3 tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:03.910382 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-92a0a0c7-7c62-40f8-ac90-169801d7b3e3 tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:03.910810 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-92a0a0c7-7c62-40f8-ac90-169801d7b3e3 tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:03.911520 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-92a0a0c7-7c62-40f8-ac90-169801d7b3e3 tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:03.911970 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-92a0a0c7-7c62-40f8-ac90-169801d7b3e3 tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:03.913927 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-92a0a0c7-7c62-40f8-ac90-169801d7b3e3 tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:04.104849 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-92a0a0c7-7c62-40f8-ac90-169801d7b3e3 tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4200015ba7cc4d43a4328ceb6626521f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b380f28820f4d9e85ba243f04427452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:23:04.114696 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-92a0a0c7-7c62-40f8-ac90-169801d7b3e3 tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] 10.222.0.33 "GET /compute/v2.1/servers/b3a202bf-e6e0-4e0f-9006-e2b7ba4589e4" status: 200 len: 1581 microversion: 2.1 time: 0.225189 Oct 04 21:23:04.115296 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3125/6283] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:23:03 2022] GET /compute/v2.1/servers/b3a202bf-e6e0-4e0f-9006-e2b7ba4589e4 => generated 1581 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:23:05.143539 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-7dbc3b2c-7d4e-436d-8b35-337184d2d482 tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:23:05.144990 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-7dbc3b2c-7d4e-436d-8b35-337184d2d482 tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] [instance: b3a202bf-e6e0-4e0f-9006-e2b7ba4589e4] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:23:05.156354 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7dbc3b2c-7d4e-436d-8b35-337184d2d482 tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:05.157022 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7dbc3b2c-7d4e-436d-8b35-337184d2d482 tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:05.157583 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7dbc3b2c-7d4e-436d-8b35-337184d2d482 tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:05.158476 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7dbc3b2c-7d4e-436d-8b35-337184d2d482 tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:05.159112 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7dbc3b2c-7d4e-436d-8b35-337184d2d482 tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:05.159688 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7dbc3b2c-7d4e-436d-8b35-337184d2d482 tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:05.232285 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-7dbc3b2c-7d4e-436d-8b35-337184d2d482 tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4200015ba7cc4d43a4328ceb6626521f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b380f28820f4d9e85ba243f04427452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:23:05.241247 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-7dbc3b2c-7d4e-436d-8b35-337184d2d482 tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] 10.222.0.33 "GET /compute/v2.1/servers/b3a202bf-e6e0-4e0f-9006-e2b7ba4589e4" status: 200 len: 1229 microversion: 2.1 time: 0.102950 Oct 04 21:23:05.242106 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3159/6284] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:23:05 2022] GET /compute/v2.1/servers/b3a202bf-e6e0-4e0f-9006-e2b7ba4589e4 => generated 1229 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:23:05.408907 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-a8f531ff-0dc2-4be1-a766-9166429c1de9 req-e0e70a60-0873-406a-adc7-96910f467b9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3a202bf-e6e0-4e0f-9006-e2b7ba4589e4", "name": "network-vif-deleted", "tag": "2dfd43b6-a497-4bfd-baeb-811c56ed006c"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:23:05.419838 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-a8f531ff-0dc2-4be1-a766-9166429c1de9 req-e0e70a60-0873-406a-adc7-96910f467b9c service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:05.420305 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-a8f531ff-0dc2-4be1-a766-9166429c1de9 req-e0e70a60-0873-406a-adc7-96910f467b9c service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:05.420740 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-a8f531ff-0dc2-4be1-a766-9166429c1de9 req-e0e70a60-0873-406a-adc7-96910f467b9c service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:05.431732 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-a8f531ff-0dc2-4be1-a766-9166429c1de9 req-e0e70a60-0873-406a-adc7-96910f467b9c service nova] Creating event network-vif-deleted:2dfd43b6-a497-4bfd-baeb-811c56ed006c for instance b3a202bf-e6e0-4e0f-9006-e2b7ba4589e4 on n-h1-854823-8 Oct 04 21:23:05.437020 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-a8f531ff-0dc2-4be1-a766-9166429c1de9 req-e0e70a60-0873-406a-adc7-96910f467b9c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031627 Oct 04 21:23:05.437721 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3126/6285] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:23:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:23:06.265178 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-d5fcd03b-03ce-4729-8152-76b61ee5afa4 tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:23:06.265867 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-d5fcd03b-03ce-4729-8152-76b61ee5afa4 tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] [instance: b3a202bf-e6e0-4e0f-9006-e2b7ba4589e4] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:23:06.272870 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d5fcd03b-03ce-4729-8152-76b61ee5afa4 tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:06.273487 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d5fcd03b-03ce-4729-8152-76b61ee5afa4 tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:06.274735 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d5fcd03b-03ce-4729-8152-76b61ee5afa4 tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:06.275647 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d5fcd03b-03ce-4729-8152-76b61ee5afa4 tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:06.276149 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d5fcd03b-03ce-4729-8152-76b61ee5afa4 tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:06.276594 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d5fcd03b-03ce-4729-8152-76b61ee5afa4 tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:06.658979 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-d5fcd03b-03ce-4729-8152-76b61ee5afa4 tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4200015ba7cc4d43a4328ceb6626521f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b380f28820f4d9e85ba243f04427452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:23:06.667943 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-d5fcd03b-03ce-4729-8152-76b61ee5afa4 tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] 10.222.0.33 "GET /compute/v2.1/servers/b3a202bf-e6e0-4e0f-9006-e2b7ba4589e4" status: 200 len: 1229 microversion: 2.1 time: 0.406664 Oct 04 21:23:06.668529 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3160/6286] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:23:06 2022] GET /compute/v2.1/servers/b3a202bf-e6e0-4e0f-9006-e2b7ba4589e4 => generated 1229 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:23:07.692282 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c65ff236-4a63-4b64-817b-b4a739dfa90e tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:23:07.693827 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c65ff236-4a63-4b64-817b-b4a739dfa90e tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] [instance: b3a202bf-e6e0-4e0f-9006-e2b7ba4589e4] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:23:07.706146 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c65ff236-4a63-4b64-817b-b4a739dfa90e tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:07.707503 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c65ff236-4a63-4b64-817b-b4a739dfa90e tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:07.708629 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c65ff236-4a63-4b64-817b-b4a739dfa90e tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:07.709990 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c65ff236-4a63-4b64-817b-b4a739dfa90e tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:07.710739 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c65ff236-4a63-4b64-817b-b4a739dfa90e tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:07.711936 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c65ff236-4a63-4b64-817b-b4a739dfa90e tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:07.778642 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c65ff236-4a63-4b64-817b-b4a739dfa90e tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4200015ba7cc4d43a4328ceb6626521f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b380f28820f4d9e85ba243f04427452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:23:07.787624 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c65ff236-4a63-4b64-817b-b4a739dfa90e tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] 10.222.0.33 "GET /compute/v2.1/servers/b3a202bf-e6e0-4e0f-9006-e2b7ba4589e4" status: 200 len: 1229 microversion: 2.1 time: 0.099411 Oct 04 21:23:07.788282 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3127/6287] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:23:07 2022] GET /compute/v2.1/servers/b3a202bf-e6e0-4e0f-9006-e2b7ba4589e4 => generated 1229 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:23:08.811593 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-ee4ae008-8313-4520-806b-de94222c51ed tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:23:08.812200 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-ee4ae008-8313-4520-806b-de94222c51ed tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] [instance: b3a202bf-e6e0-4e0f-9006-e2b7ba4589e4] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:23:08.819169 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ee4ae008-8313-4520-806b-de94222c51ed tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:08.819667 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ee4ae008-8313-4520-806b-de94222c51ed tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:08.820115 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ee4ae008-8313-4520-806b-de94222c51ed tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:08.821013 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ee4ae008-8313-4520-806b-de94222c51ed tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:08.821483 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ee4ae008-8313-4520-806b-de94222c51ed tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:08.821922 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ee4ae008-8313-4520-806b-de94222c51ed tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:08.892619 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-ee4ae008-8313-4520-806b-de94222c51ed tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4200015ba7cc4d43a4328ceb6626521f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b380f28820f4d9e85ba243f04427452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:23:08.901876 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-ee4ae008-8313-4520-806b-de94222c51ed tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] 10.222.0.33 "GET /compute/v2.1/servers/b3a202bf-e6e0-4e0f-9006-e2b7ba4589e4" status: 200 len: 1229 microversion: 2.1 time: 0.094305 Oct 04 21:23:08.902720 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3161/6288] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:23:08 2022] GET /compute/v2.1/servers/b3a202bf-e6e0-4e0f-9006-e2b7ba4589e4 => generated 1229 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:23:09.925328 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1c5081c6-dc36-473e-8134-35115df0bc36 tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:23:09.926042 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-1c5081c6-dc36-473e-8134-35115df0bc36 tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] [instance: b3a202bf-e6e0-4e0f-9006-e2b7ba4589e4] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:23:09.933138 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1c5081c6-dc36-473e-8134-35115df0bc36 tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:09.933630 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1c5081c6-dc36-473e-8134-35115df0bc36 tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:09.934071 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1c5081c6-dc36-473e-8134-35115df0bc36 tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:09.934800 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1c5081c6-dc36-473e-8134-35115df0bc36 tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:23:09.935260 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1c5081c6-dc36-473e-8134-35115df0bc36 tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:23:09.935692 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1c5081c6-dc36-473e-8134-35115df0bc36 tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:23:09.950240 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-1c5081c6-dc36-473e-8134-35115df0bc36 tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] HTTP exception thrown: Instance b3a202bf-e6e0-4e0f-9006-e2b7ba4589e4 could not be found. Oct 04 21:23:09.951897 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1c5081c6-dc36-473e-8134-35115df0bc36 tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Request method failure captured: Oct 04 21:23:09.951897 n-d-854823-8 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/b3a202bf-e6e0-4e0f-9006-e2b7ba4589e4 HTTP/1.1 Oct 04 21:23:09.951897 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 21:23:09.951897 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 21:23:09.951897 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 21:23:09.951897 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 0 Oct 04 21:23:09.951897 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 21:23:09.951897 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 21:23:09.951897 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 21:23:09.951897 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 21:23:09.951897 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPKN6Edk4hir0dl9vLcMVZUXexBDXYa_cX0erO7fXSrfoIBUfG7RfDXaosoEbRO8byEcfJszDewnHgjj4sWyxDt0v1THC60Ldw-kSFiGRtOWSK7WdAUjVPzRcsd4JhnAGziOi84aLAG5M-n37gETsZeoJR2muo0AtQNR2Ylnr3nT67Us Oct 04 21:23:09.951897 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 21:23:09.951897 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 21:23:09.951897 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 21:23:09.951897 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 21:23:09.951897 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 21:23:09.951897 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 21:23:09.951897 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: 2b380f28820f4d9e85ba243f04427452 Oct 04 21:23:09.951897 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-TestVolumeBackupRestore-1049034008 Oct 04 21:23:09.951897 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 21:23:09.951897 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 21:23:09.951897 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_2b380f28820f4d9e85ba243f04427452", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2b380f28820f4d9e85ba243f04427452"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2b380f28820f4d9e85ba243f04427452"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/2b380f28820f4d9e85ba243f04427452"}]}] Oct 04 21:23:09.951897 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-TestVolumeBackupRestore-1049034008 Oct 04 21:23:09.951897 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: 2b380f28820f4d9e85ba243f04427452 Oct 04 21:23:09.951897 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-TestVolumeBackupRestore-1049034008 Oct 04 21:23:09.951897 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-TestVolumeBackupRestore-1049034008-project Oct 04 21:23:09.951897 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 21:23:09.951897 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 21:23:09.951897 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: 4200015ba7cc4d43a4328ceb6626521f Oct 04 21:23:09.951897 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-TestVolumeBackupRestore-1049034008-project Oct 04 21:23:09.951897 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 21:23:09.951897 n-d-854823-8 devstack@n-api.service[128801]: exception: Instance b3a202bf-e6e0-4e0f-9006-e2b7ba4589e4 could not be found. Oct 04 21:23:09.951897 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': 'b3a202bf-e6e0-4e0f-9006-e2b7ba4589e4'} Oct 04 21:23:09.951897 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:23:09.951897 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:23:09.951897 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:23:09.951897 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:23:09.951897 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:23:09.951897 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:23:09.951897 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:23:09.951897 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:23:09.951897 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:23:09.951897 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:23:09.951897 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b3a202bf-e6e0-4e0f-9006-e2b7ba4589e4 could not be found. Oct 04 21:23:09.951897 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:23:09.951897 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:23:09.951897 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:23:09.951897 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:23:09.951897 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:23:09.951897 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:23:09.951897 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:23:09.951897 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:23:09.951897 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:23:09.951897 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:23:09.951897 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:23:09.951897 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:23:09.951897 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:23:09.951897 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:23:09.951897 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:23:09.951897 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:23:09.951897 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b3a202bf-e6e0-4e0f-9006-e2b7ba4589e4 could not be found. Oct 04 21:23:09.951897 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:23:09.951897 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:23:09.951897 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:23:09.957369 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:23:09.957369 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:23:09.957369 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:23:09.957369 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:23:09.957369 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:23:09.957369 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b3a202bf-e6e0-4e0f-9006-e2b7ba4589e4 could not be found. Oct 04 21:23:09.957369 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:23:09.957369 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1c5081c6-dc36-473e-8134-35115df0bc36 tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Returning 404 to user: Instance b3a202bf-e6e0-4e0f-9006-e2b7ba4589e4 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:23:09.957369 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-1c5081c6-dc36-473e-8134-35115df0bc36 tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] 10.222.0.33 "GET /compute/v2.1/servers/b3a202bf-e6e0-4e0f-9006-e2b7ba4589e4" status: 404 len: 111 microversion: 2.1 time: 0.032119 Oct 04 21:23:09.957369 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3128/6289] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:23:09 2022] GET /compute/v2.1/servers/b3a202bf-e6e0-4e0f-9006-e2b7ba4589e4 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:23:10.129473 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-2100bbd3-087b-40f0-a5da-4e014d416efb tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] Calling method '.version_select at 0x7f3c745cd430>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:23:10.155232 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-2100bbd3-087b-40f0-a5da-4e014d416efb tempest-TestVolumeBackupRestore-1049034008 tempest-TestVolumeBackupRestore-1049034008-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-596125049" status: 202 len: 0 microversion: 2.1 time: 0.029556 Oct 04 21:23:10.159127 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3162/6290] 10.222.0.33 () {58 vars in 1266 bytes} [Tue Oct 4 21:23:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-596125049 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:25:00.757586 n-d-854823-8 devstack@n-api.service[128801]: ERROR oslo.messaging._drivers.impl_rabbit [-] [0dedeb6d-3fde-4c4e-9f8b-01c561e37600] AMQP server on 10.222.0.33:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 04 21:25:00.758179 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=3 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:25:00.758946 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=82 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:25:00.760036 n-d-854823-8 devstack@n-api.service[128801]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 21:25:00.760179 n-d-854823-8 devstack@n-api.service[128801]: Tue Oct 4 21:25:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7f4b4cbe-49ef-4490-9b41-3d9802916b8a (ip 10.222.0.33) !!! Oct 04 21:25:00.761489 n-d-854823-8 devstack@n-api.service[128801]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Oct 04 21:25:01.026762 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-4f147b4a-5c5d-42d2-9e9c-8b5c8d6fde72 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:25:01.027262 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-4f147b4a-5c5d-42d2-9e9c-8b5c8d6fde72 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: 7f4b4cbe-49ef-4490-9b41-3d9802916b8a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:25:01.034401 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4f147b4a-5c5d-42d2-9e9c-8b5c8d6fde72 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:01.034886 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4f147b4a-5c5d-42d2-9e9c-8b5c8d6fde72 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:01.035318 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4f147b4a-5c5d-42d2-9e9c-8b5c8d6fde72 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:01.036003 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4f147b4a-5c5d-42d2-9e9c-8b5c8d6fde72 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:01.036452 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4f147b4a-5c5d-42d2-9e9c-8b5c8d6fde72 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:01.036874 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4f147b4a-5c5d-42d2-9e9c-8b5c8d6fde72 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:01.061922 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-4f147b4a-5c5d-42d2-9e9c-8b5c8d6fde72 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: 7f4b4cbe-49ef-4490-9b41-3d9802916b8a] Going to try to terminate instance {{(pid=128801) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:25:01.140624 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-4f147b4a-5c5d-42d2-9e9c-8b5c8d6fde72 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "DELETE /compute/v2.1/servers/7f4b4cbe-49ef-4490-9b41-3d9802916b8a" status: 204 len: 0 microversion: 2.1 time: 0.384359 Oct 04 21:25:01.141467 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3129/6291] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 21:25:00 2022] DELETE /compute/v2.1/servers/7f4b4cbe-49ef-4490-9b41-3d9802916b8a => generated 0 bytes in 387 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:25:01.147548 n-d-854823-8 devstack@n-api.service[128802]: ERROR oslo.messaging._drivers.impl_rabbit [-] [399f3af7-d281-4213-9ef7-61e2871c9a11] AMQP server on 10.222.0.33:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 21:25:01.149915 n-d-854823-8 devstack@n-api.service[128802]: ERROR oslo.messaging._drivers.impl_rabbit [-] [3ed749fe-ba58-4081-afad-8a961afd7471] AMQP server on 10.222.0.33:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Oct 04 21:25:01.150820 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:25:01.151592 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:25:01.157177 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-8cd303af-3fec-4491-898e-4e1f84c60321 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:25:01.158597 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-8cd303af-3fec-4491-898e-4e1f84c60321 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: 7f4b4cbe-49ef-4490-9b41-3d9802916b8a] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:25:01.166860 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8cd303af-3fec-4491-898e-4e1f84c60321 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:01.167359 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8cd303af-3fec-4491-898e-4e1f84c60321 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:01.167811 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8cd303af-3fec-4491-898e-4e1f84c60321 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:01.168528 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8cd303af-3fec-4491-898e-4e1f84c60321 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:01.168998 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8cd303af-3fec-4491-898e-4e1f84c60321 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:01.169441 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8cd303af-3fec-4491-898e-4e1f84c60321 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:01.438080 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-8cd303af-3fec-4491-898e-4e1f84c60321 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:25:01.445957 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-8cd303af-3fec-4491-898e-4e1f84c60321 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/7f4b4cbe-49ef-4490-9b41-3d9802916b8a" status: 200 len: 1577 microversion: 2.1 time: 0.300268 Oct 04 21:25:01.446561 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3163/6292] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:25:01 2022] GET /compute/v2.1/servers/7f4b4cbe-49ef-4490-9b41-3d9802916b8a => generated 1577 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:25:02.470778 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-986ce798-5cf5-407a-8d49-325ef827dcb7 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:25:02.471476 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-986ce798-5cf5-407a-8d49-325ef827dcb7 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: 7f4b4cbe-49ef-4490-9b41-3d9802916b8a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:25:02.481462 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-986ce798-5cf5-407a-8d49-325ef827dcb7 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:02.481954 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-986ce798-5cf5-407a-8d49-325ef827dcb7 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:02.482426 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-986ce798-5cf5-407a-8d49-325ef827dcb7 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:02.483761 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-986ce798-5cf5-407a-8d49-325ef827dcb7 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:02.484236 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-986ce798-5cf5-407a-8d49-325ef827dcb7 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:02.484790 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-986ce798-5cf5-407a-8d49-325ef827dcb7 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:02.490521 n-d-854823-8 devstack@n-api.service[128801]: INFO oslo.messaging._drivers.impl_rabbit [-] [0dedeb6d-3fde-4c4e-9f8b-01c561e37600] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 51120. Oct 04 21:25:02.675790 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-986ce798-5cf5-407a-8d49-325ef827dcb7 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:25:02.683907 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-986ce798-5cf5-407a-8d49-325ef827dcb7 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/7f4b4cbe-49ef-4490-9b41-3d9802916b8a" status: 200 len: 1577 microversion: 2.1 time: 0.218094 Oct 04 21:25:02.684487 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3130/6293] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:25:02 2022] GET /compute/v2.1/servers/7f4b4cbe-49ef-4490-9b41-3d9802916b8a => generated 1577 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:25:03.664421 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-856c29ae-73e9-4655-ae68-e952a9bc8496 req-31929a4f-f747-4c25-a63b-59f323d7f15b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f4b4cbe-49ef-4490-9b41-3d9802916b8a", "name": "network-vif-deleted", "tag": "7b284047-3a79-4d53-bcab-61d81e187578"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:25:03.678074 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-856c29ae-73e9-4655-ae68-e952a9bc8496 req-31929a4f-f747-4c25-a63b-59f323d7f15b service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:03.678617 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-856c29ae-73e9-4655-ae68-e952a9bc8496 req-31929a4f-f747-4c25-a63b-59f323d7f15b service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:03.679074 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-856c29ae-73e9-4655-ae68-e952a9bc8496 req-31929a4f-f747-4c25-a63b-59f323d7f15b service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:03.693408 n-d-854823-8 devstack@n-api.service[128802]: INFO oslo.messaging._drivers.impl_rabbit [-] [3ed749fe-ba58-4081-afad-8a961afd7471] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 51128. Oct 04 21:25:03.695809 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-856c29ae-73e9-4655-ae68-e952a9bc8496 req-31929a4f-f747-4c25-a63b-59f323d7f15b service nova] Creating event network-vif-deleted:7b284047-3a79-4d53-bcab-61d81e187578 for instance 7f4b4cbe-49ef-4490-9b41-3d9802916b8a on n-h2-854823-8 Oct 04 21:25:03.700180 n-d-854823-8 devstack@n-api.service[128802]: INFO oslo.messaging._drivers.impl_rabbit [-] [399f3af7-d281-4213-9ef7-61e2871c9a11] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 51126. Oct 04 21:25:03.707542 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b5efc8e3-da1e-4cf8-8411-02ce0f143795 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:25:03.708746 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b5efc8e3-da1e-4cf8-8411-02ce0f143795 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: 7f4b4cbe-49ef-4490-9b41-3d9802916b8a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:25:03.713272 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-856c29ae-73e9-4655-ae68-e952a9bc8496 req-31929a4f-f747-4c25-a63b-59f323d7f15b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042418 Oct 04 21:25:03.714181 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3164/6294] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:25:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:25:03.717456 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b5efc8e3-da1e-4cf8-8411-02ce0f143795 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:03.718243 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b5efc8e3-da1e-4cf8-8411-02ce0f143795 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:03.718830 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b5efc8e3-da1e-4cf8-8411-02ce0f143795 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:03.719787 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b5efc8e3-da1e-4cf8-8411-02ce0f143795 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:03.720254 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b5efc8e3-da1e-4cf8-8411-02ce0f143795 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:03.720694 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b5efc8e3-da1e-4cf8-8411-02ce0f143795 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:03.817995 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-b5efc8e3-da1e-4cf8-8411-02ce0f143795 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:25:03.849695 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b5efc8e3-da1e-4cf8-8411-02ce0f143795 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/7f4b4cbe-49ef-4490-9b41-3d9802916b8a" status: 200 len: 1225 microversion: 2.1 time: 0.144205 Oct 04 21:25:03.850022 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3131/6295] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:25:03 2022] GET /compute/v2.1/servers/7f4b4cbe-49ef-4490-9b41-3d9802916b8a => generated 1225 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:25:04.880102 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-39659615-078a-4223-ac9c-8526c6d31ff8 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:25:04.882089 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-39659615-078a-4223-ac9c-8526c6d31ff8 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: 7f4b4cbe-49ef-4490-9b41-3d9802916b8a] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:25:04.890120 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-39659615-078a-4223-ac9c-8526c6d31ff8 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:04.890684 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-39659615-078a-4223-ac9c-8526c6d31ff8 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:04.891134 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-39659615-078a-4223-ac9c-8526c6d31ff8 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:04.891872 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-39659615-078a-4223-ac9c-8526c6d31ff8 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:04.892413 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-39659615-078a-4223-ac9c-8526c6d31ff8 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:04.892859 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-39659615-078a-4223-ac9c-8526c6d31ff8 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:04.966213 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-39659615-078a-4223-ac9c-8526c6d31ff8 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:25:04.976788 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-39659615-078a-4223-ac9c-8526c6d31ff8 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/7f4b4cbe-49ef-4490-9b41-3d9802916b8a" status: 200 len: 1225 microversion: 2.1 time: 0.103267 Oct 04 21:25:04.977392 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3165/6296] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:25:04 2022] GET /compute/v2.1/servers/7f4b4cbe-49ef-4490-9b41-3d9802916b8a => generated 1225 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:25:06.004901 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8a3e6245-0e93-48d8-b7a7-de3c33b306be tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:25:06.005894 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-8a3e6245-0e93-48d8-b7a7-de3c33b306be tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: 7f4b4cbe-49ef-4490-9b41-3d9802916b8a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:25:06.016262 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8a3e6245-0e93-48d8-b7a7-de3c33b306be tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:06.016766 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8a3e6245-0e93-48d8-b7a7-de3c33b306be tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:06.017206 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8a3e6245-0e93-48d8-b7a7-de3c33b306be tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:06.017931 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8a3e6245-0e93-48d8-b7a7-de3c33b306be tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:06.018415 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8a3e6245-0e93-48d8-b7a7-de3c33b306be tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:06.018845 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8a3e6245-0e93-48d8-b7a7-de3c33b306be tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:06.092064 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-8a3e6245-0e93-48d8-b7a7-de3c33b306be tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:25:06.100683 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-8a3e6245-0e93-48d8-b7a7-de3c33b306be tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/7f4b4cbe-49ef-4490-9b41-3d9802916b8a" status: 200 len: 1225 microversion: 2.1 time: 0.103895 Oct 04 21:25:06.101275 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3132/6297] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:25:05 2022] GET /compute/v2.1/servers/7f4b4cbe-49ef-4490-9b41-3d9802916b8a => generated 1225 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:25:07.124903 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-6cadbe70-2d0d-4fff-ad06-93e80b5ddd09 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:25:07.125604 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-6cadbe70-2d0d-4fff-ad06-93e80b5ddd09 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: 7f4b4cbe-49ef-4490-9b41-3d9802916b8a] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:25:07.133565 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6cadbe70-2d0d-4fff-ad06-93e80b5ddd09 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:07.134081 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6cadbe70-2d0d-4fff-ad06-93e80b5ddd09 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:07.134582 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6cadbe70-2d0d-4fff-ad06-93e80b5ddd09 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:07.135338 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6cadbe70-2d0d-4fff-ad06-93e80b5ddd09 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:07.135811 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6cadbe70-2d0d-4fff-ad06-93e80b5ddd09 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:07.136254 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6cadbe70-2d0d-4fff-ad06-93e80b5ddd09 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:07.203890 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-6cadbe70-2d0d-4fff-ad06-93e80b5ddd09 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:25:07.212792 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-6cadbe70-2d0d-4fff-ad06-93e80b5ddd09 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/7f4b4cbe-49ef-4490-9b41-3d9802916b8a" status: 200 len: 1225 microversion: 2.1 time: 0.092103 Oct 04 21:25:07.213413 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3166/6298] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:25:07 2022] GET /compute/v2.1/servers/7f4b4cbe-49ef-4490-9b41-3d9802916b8a => generated 1225 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:25:08.237243 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f6e2f476-f485-4709-add8-9313c7cb0ceb tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:25:08.237764 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f6e2f476-f485-4709-add8-9313c7cb0ceb tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: 7f4b4cbe-49ef-4490-9b41-3d9802916b8a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:25:08.244706 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f6e2f476-f485-4709-add8-9313c7cb0ceb tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:08.245189 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f6e2f476-f485-4709-add8-9313c7cb0ceb tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:08.245626 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f6e2f476-f485-4709-add8-9313c7cb0ceb tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:08.246315 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f6e2f476-f485-4709-add8-9313c7cb0ceb tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:08.246787 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f6e2f476-f485-4709-add8-9313c7cb0ceb tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:08.247208 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f6e2f476-f485-4709-add8-9313c7cb0ceb tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:08.280878 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f6e2f476-f485-4709-add8-9313c7cb0ceb tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:08.281525 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f6e2f476-f485-4709-add8-9313c7cb0ceb tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:08.281961 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f6e2f476-f485-4709-add8-9313c7cb0ceb tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:08.282501 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-f6e2f476-f485-4709-add8-9313c7cb0ceb tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lazy-loading 'fault' on Instance uuid 7f4b4cbe-49ef-4490-9b41-3d9802916b8a {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:25:08.328647 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f6e2f476-f485-4709-add8-9313c7cb0ceb tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:25:08.337144 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f6e2f476-f485-4709-add8-9313c7cb0ceb tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/7f4b4cbe-49ef-4490-9b41-3d9802916b8a" status: 200 len: 1230 microversion: 2.1 time: 0.103832 Oct 04 21:25:08.337759 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3133/6299] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:25:08 2022] GET /compute/v2.1/servers/7f4b4cbe-49ef-4490-9b41-3d9802916b8a => generated 1230 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:25:09.361588 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-06f6dee5-47d1-465a-b5fe-226e556a8aac tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:25:09.362217 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-06f6dee5-47d1-465a-b5fe-226e556a8aac tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: 7f4b4cbe-49ef-4490-9b41-3d9802916b8a] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:25:09.369200 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-06f6dee5-47d1-465a-b5fe-226e556a8aac tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:09.369720 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-06f6dee5-47d1-465a-b5fe-226e556a8aac tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:09.370173 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-06f6dee5-47d1-465a-b5fe-226e556a8aac tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:09.370919 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-06f6dee5-47d1-465a-b5fe-226e556a8aac tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:09.371399 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-06f6dee5-47d1-465a-b5fe-226e556a8aac tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:09.371845 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-06f6dee5-47d1-465a-b5fe-226e556a8aac tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:09.386161 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.wsgi [None req-06f6dee5-47d1-465a-b5fe-226e556a8aac tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] HTTP exception thrown: Instance 7f4b4cbe-49ef-4490-9b41-3d9802916b8a could not be found. Oct 04 21:25:09.387902 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-06f6dee5-47d1-465a-b5fe-226e556a8aac tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Request method failure captured: Oct 04 21:25:09.387902 n-d-854823-8 devstack@n-api.service[128802]: request: GET /compute/v2.1/servers/7f4b4cbe-49ef-4490-9b41-3d9802916b8a HTTP/1.1 Oct 04 21:25:09.387902 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 21:25:09.387902 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 21:25:09.387902 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 21:25:09.387902 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 0 Oct 04 21:25:09.387902 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 21:25:09.387902 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 21:25:09.387902 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 21:25:09.387902 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 21:25:09.387902 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPKMhB36sxHtTwvN5cR_FDx6677Bk3r96uZe9x8RsKj2kP41h8elma4Sfp2Sil3wffnoaQT-coMFt-1I-ubK46x1CIQQbRLJJWc6ISWYT8YHNWLLnEGq51UhoqUKdKybGmNCaSC1unJV9CeCDYPI8cjjYW6_GmoH3684NnCEjfslKtuc Oct 04 21:25:09.387902 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 21:25:09.387902 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 21:25:09.387902 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 21:25:09.387902 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 21:25:09.387902 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 21:25:09.387902 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 21:25:09.387902 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: 0d78e06d720d438a9308ae138902f847 Oct 04 21:25:09.387902 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-TestVolumeBootPattern-1361369473 Oct 04 21:25:09.387902 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 21:25:09.387902 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 21:25:09.387902 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0d78e06d720d438a9308ae138902f847", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0d78e06d720d438a9308ae138902f847"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0d78e06d720d438a9308ae138902f847"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0d78e06d720d438a9308ae138902f847"}]}] Oct 04 21:25:09.387902 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-TestVolumeBootPattern-1361369473 Oct 04 21:25:09.387902 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: 0d78e06d720d438a9308ae138902f847 Oct 04 21:25:09.387902 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-TestVolumeBootPattern-1361369473 Oct 04 21:25:09.387902 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-TestVolumeBootPattern-1361369473-project Oct 04 21:25:09.387902 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 21:25:09.387902 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 21:25:09.387902 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: ad7b0b59fad1429e95591b21e33ccbaa Oct 04 21:25:09.387902 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-TestVolumeBootPattern-1361369473-project Oct 04 21:25:09.387902 n-d-854823-8 devstack@n-api.service[128802]: method: > Oct 04 21:25:09.387902 n-d-854823-8 devstack@n-api.service[128802]: exception: Instance 7f4b4cbe-49ef-4490-9b41-3d9802916b8a could not be found. Oct 04 21:25:09.387902 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'id': '7f4b4cbe-49ef-4490-9b41-3d9802916b8a'} Oct 04 21:25:09.387902 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:25:09.387902 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:25:09.387902 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:25:09.387902 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:25:09.387902 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:25:09.387902 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:25:09.387902 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:25:09.387902 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:25:09.387902 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:25:09.387902 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:25:09.387902 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f4b4cbe-49ef-4490-9b41-3d9802916b8a could not be found. Oct 04 21:25:09.387902 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:25:09.387902 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:25:09.387902 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:25:09.387902 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:25:09.387902 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:25:09.387902 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:25:09.387902 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:25:09.387902 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:25:09.387902 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:25:09.387902 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:25:09.387902 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:25:09.387902 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:25:09.387902 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:25:09.387902 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:25:09.387902 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:25:09.387902 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:25:09.387902 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f4b4cbe-49ef-4490-9b41-3d9802916b8a could not be found. Oct 04 21:25:09.387902 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:25:09.387902 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:25:09.387902 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:25:09.392130 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:25:09.392130 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:25:09.392130 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:25:09.392130 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:25:09.392130 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:25:09.392130 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f4b4cbe-49ef-4490-9b41-3d9802916b8a could not be found. Oct 04 21:25:09.392130 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:25:09.392130 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-06f6dee5-47d1-465a-b5fe-226e556a8aac tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Returning 404 to user: Instance 7f4b4cbe-49ef-4490-9b41-3d9802916b8a could not be found. {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:25:09.392130 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-06f6dee5-47d1-465a-b5fe-226e556a8aac tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/7f4b4cbe-49ef-4490-9b41-3d9802916b8a" status: 404 len: 111 microversion: 2.1 time: 0.031933 Oct 04 21:25:09.392130 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3167/6300] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:25:09 2022] GET /compute/v2.1/servers/7f4b4cbe-49ef-4490-9b41-3d9802916b8a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:25:09.438766 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-50832281-84aa-4371-8588-cc045fe276d1 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-774488278", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1556253219", "security_groups": [{"name": "tempest-secgroup-smoke-405656399"}], "block_device_mapping_v2": [{"uuid": "e8788df9-09d2-4079-9125-cc3b1ef8c12d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "975b1130-f216-463e-808d-0d3403b17918"}]}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:25:09.556351 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.network.neutron [None req-50832281-84aa-4371-8588-cc045fe276d1 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] validate_networks() for [('975b1130-f216-463e-808d-0d3403b17918', None, None, None, None, None)] {{(pid=128801) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:25:09.941587 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-50832281-84aa-4371-8588-cc045fe276d1 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Flavor limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:25:09.941949 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-50832281-84aa-4371-8588-cc045fe276d1 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Image limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:25:09.942474 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-50832281-84aa-4371-8588-cc045fe276d1 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Flavor pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:25:09.942861 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-50832281-84aa-4371-8588-cc045fe276d1 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Image pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:25:09.943271 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-50832281-84aa-4371-8588-cc045fe276d1 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:25:09.952487 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-50832281-84aa-4371-8588-cc045fe276d1 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:09.952936 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-50832281-84aa-4371-8588-cc045fe276d1 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:09.953372 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-50832281-84aa-4371-8588-cc045fe276d1 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:09.954098 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-50832281-84aa-4371-8588-cc045fe276d1 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:09.954579 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-50832281-84aa-4371-8588-cc045fe276d1 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:09.955005 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-50832281-84aa-4371-8588-cc045fe276d1 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:09.972954 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-50832281-84aa-4371-8588-cc045fe276d1 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Getting quotas for project 0d78e06d720d438a9308ae138902f847. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:25:09.978395 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-50832281-84aa-4371-8588-cc045fe276d1 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Getting quotas for user ad7b0b59fad1429e95591b21e33ccbaa and project 0d78e06d720d438a9308ae138902f847. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:25:10.039345 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-50832281-84aa-4371-8588-cc045fe276d1 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Going to run 1 instances... {{(pid=128801) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:25:10.041758 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-50832281-84aa-4371-8588-cc045fe276d1 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: 3f748c89-825a-404e-b257-686f43253bfa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e8788df9-09d2-4079-9125-cc3b1ef8c12d',volume_size=None,volume_type=None)] {{(pid=128801) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:25:10.172339 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-50832281-84aa-4371-8588-cc045fe276d1 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.738686 Oct 04 21:25:10.173000 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3134/6301] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 21:25:09 2022] POST /compute/v2.1/servers => generated 405 bytes in 740 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:25:10.183912 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-ce7aaa80-f2db-4340-a3f4-55db10a6cc97 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:25:10.184796 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-ce7aaa80-f2db-4340-a3f4-55db10a6cc97 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: 3f748c89-825a-404e-b257-686f43253bfa] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:25:10.237242 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-ce7aaa80-f2db-4340-a3f4-55db10a6cc97 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:25:10.244175 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-ce7aaa80-f2db-4340-a3f4-55db10a6cc97 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/3f748c89-825a-404e-b257-686f43253bfa" status: 200 len: 1094 microversion: 2.1 time: 0.064099 Oct 04 21:25:10.244738 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3168/6302] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:25:10 2022] GET /compute/v2.1/servers/3f748c89-825a-404e-b257-686f43253bfa => generated 1094 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:25:11.268235 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-3b2b7348-66c7-42c8-8e4f-4eaed292ecd6 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:25:11.268940 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-3b2b7348-66c7-42c8-8e4f-4eaed292ecd6 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: 3f748c89-825a-404e-b257-686f43253bfa] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:25:11.327798 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-3b2b7348-66c7-42c8-8e4f-4eaed292ecd6 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:25:11.335172 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-3b2b7348-66c7-42c8-8e4f-4eaed292ecd6 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/3f748c89-825a-404e-b257-686f43253bfa" status: 200 len: 1094 microversion: 2.1 time: 0.071781 Oct 04 21:25:11.335748 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3135/6303] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:25:11 2022] GET /compute/v2.1/servers/3f748c89-825a-404e-b257-686f43253bfa => generated 1094 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:25:12.358482 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-4ead4deb-e8f7-45c6-8ef5-4bab262981d3 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:25:12.359028 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-4ead4deb-e8f7-45c6-8ef5-4bab262981d3 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: 3f748c89-825a-404e-b257-686f43253bfa] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:25:12.415812 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-4ead4deb-e8f7-45c6-8ef5-4bab262981d3 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:25:12.423035 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-4ead4deb-e8f7-45c6-8ef5-4bab262981d3 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/3f748c89-825a-404e-b257-686f43253bfa" status: 200 len: 1094 microversion: 2.1 time: 0.068535 Oct 04 21:25:12.423614 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3169/6304] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:25:12 2022] GET /compute/v2.1/servers/3f748c89-825a-404e-b257-686f43253bfa => generated 1094 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:25:13.447586 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a186b044-d23b-46b3-8a9d-c64f3c3f0514 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:25:13.448191 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a186b044-d23b-46b3-8a9d-c64f3c3f0514 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: 3f748c89-825a-404e-b257-686f43253bfa] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:25:13.504957 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-a186b044-d23b-46b3-8a9d-c64f3c3f0514 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:25:13.512077 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a186b044-d23b-46b3-8a9d-c64f3c3f0514 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/3f748c89-825a-404e-b257-686f43253bfa" status: 200 len: 1094 microversion: 2.1 time: 0.068364 Oct 04 21:25:13.512655 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3136/6305] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:25:13 2022] GET /compute/v2.1/servers/3f748c89-825a-404e-b257-686f43253bfa => generated 1094 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:25:14.535076 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-35639d6b-7e16-4f73-ad27-f6b35cb85581 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:25:14.535704 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-35639d6b-7e16-4f73-ad27-f6b35cb85581 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: 3f748c89-825a-404e-b257-686f43253bfa] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:25:14.542915 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-35639d6b-7e16-4f73-ad27-f6b35cb85581 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:14.543440 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-35639d6b-7e16-4f73-ad27-f6b35cb85581 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:14.543960 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-35639d6b-7e16-4f73-ad27-f6b35cb85581 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:14.544692 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-35639d6b-7e16-4f73-ad27-f6b35cb85581 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:14.546145 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-35639d6b-7e16-4f73-ad27-f6b35cb85581 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:14.546925 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-35639d6b-7e16-4f73-ad27-f6b35cb85581 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:14.622654 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-35639d6b-7e16-4f73-ad27-f6b35cb85581 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:25:14.633184 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-35639d6b-7e16-4f73-ad27-f6b35cb85581 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/3f748c89-825a-404e-b257-686f43253bfa" status: 200 len: 1210 microversion: 2.1 time: 0.102332 Oct 04 21:25:14.634092 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3170/6306] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:25:14 2022] GET /compute/v2.1/servers/3f748c89-825a-404e-b257-686f43253bfa => generated 1210 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:25:15.659189 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-4281ad49-eee5-4a6a-91a6-7e8f9dd9ad2d tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:25:15.660056 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-4281ad49-eee5-4a6a-91a6-7e8f9dd9ad2d tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: 3f748c89-825a-404e-b257-686f43253bfa] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:25:15.669474 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4281ad49-eee5-4a6a-91a6-7e8f9dd9ad2d tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:15.670218 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4281ad49-eee5-4a6a-91a6-7e8f9dd9ad2d tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:15.670864 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4281ad49-eee5-4a6a-91a6-7e8f9dd9ad2d tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:15.672000 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4281ad49-eee5-4a6a-91a6-7e8f9dd9ad2d tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:15.672623 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4281ad49-eee5-4a6a-91a6-7e8f9dd9ad2d tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:15.673479 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4281ad49-eee5-4a6a-91a6-7e8f9dd9ad2d tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:15.891244 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-4281ad49-eee5-4a6a-91a6-7e8f9dd9ad2d tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:25:15.901989 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-4281ad49-eee5-4a6a-91a6-7e8f9dd9ad2d tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/3f748c89-825a-404e-b257-686f43253bfa" status: 200 len: 1277 microversion: 2.1 time: 0.248219 Oct 04 21:25:15.902824 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3137/6307] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:25:15 2022] GET /compute/v2.1/servers/3f748c89-825a-404e-b257-686f43253bfa => generated 1277 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:25:16.028079 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-79bde01f-c740-48af-b894-ac3d985ae7f6 req-e8f58669-6179-4e8a-a57c-f270b4f14f9f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f748c89-825a-404e-b257-686f43253bfa", "tag": "cdddd896-2598-4cd4-8c83-3c32827b680f"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:25:16.042428 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-79bde01f-c740-48af-b894-ac3d985ae7f6 req-e8f58669-6179-4e8a-a57c-f270b4f14f9f service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:16.042925 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-79bde01f-c740-48af-b894-ac3d985ae7f6 req-e8f58669-6179-4e8a-a57c-f270b4f14f9f service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:16.043367 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-79bde01f-c740-48af-b894-ac3d985ae7f6 req-e8f58669-6179-4e8a-a57c-f270b4f14f9f service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:16.056845 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-79bde01f-c740-48af-b894-ac3d985ae7f6 req-e8f58669-6179-4e8a-a57c-f270b4f14f9f service nova] Creating event network-changed:cdddd896-2598-4cd4-8c83-3c32827b680f for instance 3f748c89-825a-404e-b257-686f43253bfa on n-h2-854823-8 Oct 04 21:25:16.063565 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-79bde01f-c740-48af-b894-ac3d985ae7f6 req-e8f58669-6179-4e8a-a57c-f270b4f14f9f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039489 Oct 04 21:25:16.064770 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3171/6308] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:25:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:25:16.927523 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-91fabdd2-4b5d-4064-b948-bb430d5308f8 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:25:16.929157 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-91fabdd2-4b5d-4064-b948-bb430d5308f8 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: 3f748c89-825a-404e-b257-686f43253bfa] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:25:16.940032 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-91fabdd2-4b5d-4064-b948-bb430d5308f8 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:16.940771 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-91fabdd2-4b5d-4064-b948-bb430d5308f8 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:16.941431 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-91fabdd2-4b5d-4064-b948-bb430d5308f8 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:16.942559 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-91fabdd2-4b5d-4064-b948-bb430d5308f8 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:16.943275 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-91fabdd2-4b5d-4064-b948-bb430d5308f8 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:16.943945 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-91fabdd2-4b5d-4064-b948-bb430d5308f8 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:17.196020 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-91fabdd2-4b5d-4064-b948-bb430d5308f8 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:25:17.205046 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-91fabdd2-4b5d-4064-b948-bb430d5308f8 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/3f748c89-825a-404e-b257-686f43253bfa" status: 200 len: 1277 microversion: 2.1 time: 0.283046 Oct 04 21:25:17.205850 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3138/6309] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:25:16 2022] GET /compute/v2.1/servers/3f748c89-825a-404e-b257-686f43253bfa => generated 1277 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:25:18.229799 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-fb788188-17e6-4e68-9379-c8f489e29b6b tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:25:18.230695 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-fb788188-17e6-4e68-9379-c8f489e29b6b tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: 3f748c89-825a-404e-b257-686f43253bfa] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:25:18.239932 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fb788188-17e6-4e68-9379-c8f489e29b6b tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:18.240803 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fb788188-17e6-4e68-9379-c8f489e29b6b tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:18.241584 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fb788188-17e6-4e68-9379-c8f489e29b6b tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:18.242746 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fb788188-17e6-4e68-9379-c8f489e29b6b tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:18.243313 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fb788188-17e6-4e68-9379-c8f489e29b6b tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:18.243916 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fb788188-17e6-4e68-9379-c8f489e29b6b tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:18.398942 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-fb788188-17e6-4e68-9379-c8f489e29b6b tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:25:18.409627 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-fb788188-17e6-4e68-9379-c8f489e29b6b tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/3f748c89-825a-404e-b257-686f43253bfa" status: 200 len: 1277 microversion: 2.1 time: 0.183868 Oct 04 21:25:18.410441 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3172/6310] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:25:18 2022] GET /compute/v2.1/servers/3f748c89-825a-404e-b257-686f43253bfa => generated 1277 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:25:19.437987 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a352ee6e-0baf-4cba-b85a-41951ad47b9f tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:25:19.439220 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a352ee6e-0baf-4cba-b85a-41951ad47b9f tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: 3f748c89-825a-404e-b257-686f43253bfa] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:25:19.457181 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a352ee6e-0baf-4cba-b85a-41951ad47b9f tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:19.457912 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a352ee6e-0baf-4cba-b85a-41951ad47b9f tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:19.458529 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a352ee6e-0baf-4cba-b85a-41951ad47b9f tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:19.459430 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a352ee6e-0baf-4cba-b85a-41951ad47b9f tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:19.460038 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a352ee6e-0baf-4cba-b85a-41951ad47b9f tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:19.460636 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a352ee6e-0baf-4cba-b85a-41951ad47b9f tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:19.669348 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-a352ee6e-0baf-4cba-b85a-41951ad47b9f tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:25:19.683444 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a352ee6e-0baf-4cba-b85a-41951ad47b9f tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/3f748c89-825a-404e-b257-686f43253bfa" status: 200 len: 1277 microversion: 2.1 time: 0.252819 Oct 04 21:25:19.684548 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3139/6311] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:25:19 2022] GET /compute/v2.1/servers/3f748c89-825a-404e-b257-686f43253bfa => generated 1277 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:25:20.715321 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-c358ea9f-ce55-45f8-8f1e-32f3b2857aae tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:25:20.715956 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-c358ea9f-ce55-45f8-8f1e-32f3b2857aae tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: 3f748c89-825a-404e-b257-686f43253bfa] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:25:20.723874 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c358ea9f-ce55-45f8-8f1e-32f3b2857aae tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:20.724386 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c358ea9f-ce55-45f8-8f1e-32f3b2857aae tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:20.724844 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c358ea9f-ce55-45f8-8f1e-32f3b2857aae tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:20.725580 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c358ea9f-ce55-45f8-8f1e-32f3b2857aae tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:20.726060 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c358ea9f-ce55-45f8-8f1e-32f3b2857aae tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:20.726536 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c358ea9f-ce55-45f8-8f1e-32f3b2857aae tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:20.872914 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-c358ea9f-ce55-45f8-8f1e-32f3b2857aae tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:25:20.881927 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-c358ea9f-ce55-45f8-8f1e-32f3b2857aae tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/3f748c89-825a-404e-b257-686f43253bfa" status: 200 len: 1265 microversion: 2.1 time: 0.170512 Oct 04 21:25:20.882573 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3173/6312] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:25:20 2022] GET /compute/v2.1/servers/3f748c89-825a-404e-b257-686f43253bfa => generated 1265 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:25:21.906530 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5deb3da1-a2f4-4180-85a2-ee899ec9d974 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:25:21.907329 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-5deb3da1-a2f4-4180-85a2-ee899ec9d974 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: 3f748c89-825a-404e-b257-686f43253bfa] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:25:21.909540 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:25:21.916763 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5deb3da1-a2f4-4180-85a2-ee899ec9d974 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:21.917383 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5deb3da1-a2f4-4180-85a2-ee899ec9d974 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:21.917955 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5deb3da1-a2f4-4180-85a2-ee899ec9d974 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:21.918745 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5deb3da1-a2f4-4180-85a2-ee899ec9d974 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:21.919256 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5deb3da1-a2f4-4180-85a2-ee899ec9d974 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:21.919721 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5deb3da1-a2f4-4180-85a2-ee899ec9d974 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:22.092590 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-5deb3da1-a2f4-4180-85a2-ee899ec9d974 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:25:22.106447 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5deb3da1-a2f4-4180-85a2-ee899ec9d974 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/3f748c89-825a-404e-b257-686f43253bfa" status: 200 len: 1265 microversion: 2.1 time: 0.203987 Oct 04 21:25:22.107443 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3140/6313] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:25:21 2022] GET /compute/v2.1/servers/3f748c89-825a-404e-b257-686f43253bfa => generated 1265 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:25:23.143995 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-fa5a3d18-748f-42a8-9707-25c4641f606c tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:25:23.144625 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-fa5a3d18-748f-42a8-9707-25c4641f606c tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: 3f748c89-825a-404e-b257-686f43253bfa] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:25:23.147584 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell0:SELECT=4 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:25:23.153374 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fa5a3d18-748f-42a8-9707-25c4641f606c tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:23.153887 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fa5a3d18-748f-42a8-9707-25c4641f606c tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:23.154414 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fa5a3d18-748f-42a8-9707-25c4641f606c tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:23.155170 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fa5a3d18-748f-42a8-9707-25c4641f606c tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:23.155643 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fa5a3d18-748f-42a8-9707-25c4641f606c tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:23.156092 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fa5a3d18-748f-42a8-9707-25c4641f606c tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:23.296118 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-fa5a3d18-748f-42a8-9707-25c4641f606c tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:25:23.304113 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-fa5a3d18-748f-42a8-9707-25c4641f606c tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/3f748c89-825a-404e-b257-686f43253bfa" status: 200 len: 1265 microversion: 2.1 time: 0.164047 Oct 04 21:25:23.304708 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3174/6314] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:25:23 2022] GET /compute/v2.1/servers/3f748c89-825a-404e-b257-686f43253bfa => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:25:24.328628 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6ee24fb0-cd18-4439-9a3b-b08c0305956e tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:25:24.329150 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-6ee24fb0-cd18-4439-9a3b-b08c0305956e tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: 3f748c89-825a-404e-b257-686f43253bfa] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:25:24.331923 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=10 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:25:24.337499 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6ee24fb0-cd18-4439-9a3b-b08c0305956e tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:24.337988 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6ee24fb0-cd18-4439-9a3b-b08c0305956e tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:24.338456 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6ee24fb0-cd18-4439-9a3b-b08c0305956e tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:24.339161 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6ee24fb0-cd18-4439-9a3b-b08c0305956e tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:24.339619 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6ee24fb0-cd18-4439-9a3b-b08c0305956e tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:24.340047 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6ee24fb0-cd18-4439-9a3b-b08c0305956e tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:24.478786 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-6ee24fb0-cd18-4439-9a3b-b08c0305956e tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:25:24.487321 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-6ee24fb0-cd18-4439-9a3b-b08c0305956e tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/3f748c89-825a-404e-b257-686f43253bfa" status: 200 len: 1265 microversion: 2.1 time: 0.163592 Oct 04 21:25:24.487916 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3141/6315] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:25:24 2022] GET /compute/v2.1/servers/3f748c89-825a-404e-b257-686f43253bfa => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:25:25.510293 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-06c5ad83-f404-4f60-9fbc-0cdd466873ad tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:25:25.510948 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-06c5ad83-f404-4f60-9fbc-0cdd466873ad tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: 3f748c89-825a-404e-b257-686f43253bfa] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:25:25.518360 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-06c5ad83-f404-4f60-9fbc-0cdd466873ad tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:25.518861 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-06c5ad83-f404-4f60-9fbc-0cdd466873ad tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:25.519306 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-06c5ad83-f404-4f60-9fbc-0cdd466873ad tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:25.520016 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-06c5ad83-f404-4f60-9fbc-0cdd466873ad tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:25.520476 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-06c5ad83-f404-4f60-9fbc-0cdd466873ad tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:25.520915 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-06c5ad83-f404-4f60-9fbc-0cdd466873ad tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:25.652621 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-06c5ad83-f404-4f60-9fbc-0cdd466873ad tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:25:25.660582 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-06c5ad83-f404-4f60-9fbc-0cdd466873ad tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/3f748c89-825a-404e-b257-686f43253bfa" status: 200 len: 1265 microversion: 2.1 time: 0.154220 Oct 04 21:25:25.661170 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3175/6316] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:25:25 2022] GET /compute/v2.1/servers/3f748c89-825a-404e-b257-686f43253bfa => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:25:26.683707 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-be3c909e-cd74-4293-b107-1b1b58fad81f tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:25:26.684569 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-be3c909e-cd74-4293-b107-1b1b58fad81f tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: 3f748c89-825a-404e-b257-686f43253bfa] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:25:26.691839 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-be3c909e-cd74-4293-b107-1b1b58fad81f tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:26.692685 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-be3c909e-cd74-4293-b107-1b1b58fad81f tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:26.692797 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-be3c909e-cd74-4293-b107-1b1b58fad81f tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:26.693423 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-be3c909e-cd74-4293-b107-1b1b58fad81f tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:26.693870 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-be3c909e-cd74-4293-b107-1b1b58fad81f tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:26.694290 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-be3c909e-cd74-4293-b107-1b1b58fad81f tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:26.832432 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-be3c909e-cd74-4293-b107-1b1b58fad81f tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:25:26.840248 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-be3c909e-cd74-4293-b107-1b1b58fad81f tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/3f748c89-825a-404e-b257-686f43253bfa" status: 200 len: 1265 microversion: 2.1 time: 0.160442 Oct 04 21:25:26.840829 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3142/6317] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:25:26 2022] GET /compute/v2.1/servers/3f748c89-825a-404e-b257-686f43253bfa => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:25:27.864269 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-061768de-10d5-4eaa-b988-ffe987f39e50 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:25:27.865145 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-061768de-10d5-4eaa-b988-ffe987f39e50 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: 3f748c89-825a-404e-b257-686f43253bfa] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:25:27.872680 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-061768de-10d5-4eaa-b988-ffe987f39e50 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:27.873691 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-061768de-10d5-4eaa-b988-ffe987f39e50 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:27.874143 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-061768de-10d5-4eaa-b988-ffe987f39e50 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:27.874901 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-061768de-10d5-4eaa-b988-ffe987f39e50 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:27.875386 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-061768de-10d5-4eaa-b988-ffe987f39e50 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:27.875828 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-061768de-10d5-4eaa-b988-ffe987f39e50 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:28.017506 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-061768de-10d5-4eaa-b988-ffe987f39e50 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:25:28.025770 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-061768de-10d5-4eaa-b988-ffe987f39e50 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/3f748c89-825a-404e-b257-686f43253bfa" status: 200 len: 1265 microversion: 2.1 time: 0.165524 Oct 04 21:25:28.026903 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3176/6318] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:25:27 2022] GET /compute/v2.1/servers/3f748c89-825a-404e-b257-686f43253bfa => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:25:29.048360 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-45d9aa40-6d34-4225-8d49-ce2506c1b399 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:25:29.048880 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-45d9aa40-6d34-4225-8d49-ce2506c1b399 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: 3f748c89-825a-404e-b257-686f43253bfa] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:25:29.056202 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-45d9aa40-6d34-4225-8d49-ce2506c1b399 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:29.056696 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-45d9aa40-6d34-4225-8d49-ce2506c1b399 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:29.057134 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-45d9aa40-6d34-4225-8d49-ce2506c1b399 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:29.057844 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-45d9aa40-6d34-4225-8d49-ce2506c1b399 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:29.058302 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-45d9aa40-6d34-4225-8d49-ce2506c1b399 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:29.058765 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-45d9aa40-6d34-4225-8d49-ce2506c1b399 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:29.200026 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-45d9aa40-6d34-4225-8d49-ce2506c1b399 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:25:29.209315 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-45d9aa40-6d34-4225-8d49-ce2506c1b399 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/3f748c89-825a-404e-b257-686f43253bfa" status: 200 len: 1265 microversion: 2.1 time: 0.165351 Oct 04 21:25:29.209937 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3143/6319] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:25:29 2022] GET /compute/v2.1/servers/3f748c89-825a-404e-b257-686f43253bfa => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:25:29.766085 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-937916b6-91f5-41f0-b4e7-bb7696368d4a req-a0440a10-35a4-48a3-bcae-2bddd37aca30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f748c89-825a-404e-b257-686f43253bfa", "name": "network-vif-plugged", "status": "completed", "tag": "cdddd896-2598-4cd4-8c83-3c32827b680f"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:25:29.780891 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-937916b6-91f5-41f0-b4e7-bb7696368d4a req-a0440a10-35a4-48a3-bcae-2bddd37aca30 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:29.781742 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-937916b6-91f5-41f0-b4e7-bb7696368d4a req-a0440a10-35a4-48a3-bcae-2bddd37aca30 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:29.782327 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-937916b6-91f5-41f0-b4e7-bb7696368d4a req-a0440a10-35a4-48a3-bcae-2bddd37aca30 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:29.796516 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-937916b6-91f5-41f0-b4e7-bb7696368d4a req-a0440a10-35a4-48a3-bcae-2bddd37aca30 service nova] Creating event network-vif-plugged:cdddd896-2598-4cd4-8c83-3c32827b680f for instance 3f748c89-825a-404e-b257-686f43253bfa on n-h2-854823-8 Oct 04 21:25:29.801947 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-937916b6-91f5-41f0-b4e7-bb7696368d4a req-a0440a10-35a4-48a3-bcae-2bddd37aca30 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041301 Oct 04 21:25:29.802614 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3177/6320] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:25:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:25:30.234600 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e2b5ae20-93e2-4552-be13-fa98dc709d24 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:25:30.235234 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e2b5ae20-93e2-4552-be13-fa98dc709d24 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: 3f748c89-825a-404e-b257-686f43253bfa] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:25:30.242681 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e2b5ae20-93e2-4552-be13-fa98dc709d24 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:30.243181 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e2b5ae20-93e2-4552-be13-fa98dc709d24 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:30.243618 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e2b5ae20-93e2-4552-be13-fa98dc709d24 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:30.244360 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e2b5ae20-93e2-4552-be13-fa98dc709d24 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:30.244817 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e2b5ae20-93e2-4552-be13-fa98dc709d24 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:30.245247 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e2b5ae20-93e2-4552-be13-fa98dc709d24 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:30.384635 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e2b5ae20-93e2-4552-be13-fa98dc709d24 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:25:30.393211 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e2b5ae20-93e2-4552-be13-fa98dc709d24 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/3f748c89-825a-404e-b257-686f43253bfa" status: 200 len: 1265 microversion: 2.1 time: 0.163625 Oct 04 21:25:30.393819 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3144/6321] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:25:30 2022] GET /compute/v2.1/servers/3f748c89-825a-404e-b257-686f43253bfa => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:25:31.417091 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-00e4f69f-f36d-4d4e-b33f-e2843b78e5f6 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:25:31.417866 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-00e4f69f-f36d-4d4e-b33f-e2843b78e5f6 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: 3f748c89-825a-404e-b257-686f43253bfa] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:25:31.421104 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_api:SELECT=35 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:25:31.427137 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-00e4f69f-f36d-4d4e-b33f-e2843b78e5f6 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:31.427639 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-00e4f69f-f36d-4d4e-b33f-e2843b78e5f6 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:31.428137 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-00e4f69f-f36d-4d4e-b33f-e2843b78e5f6 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:31.428871 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-00e4f69f-f36d-4d4e-b33f-e2843b78e5f6 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:31.429347 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-00e4f69f-f36d-4d4e-b33f-e2843b78e5f6 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:31.429794 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-00e4f69f-f36d-4d4e-b33f-e2843b78e5f6 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:31.432931 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=63 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:25:31.571410 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-00e4f69f-f36d-4d4e-b33f-e2843b78e5f6 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:25:31.581104 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-00e4f69f-f36d-4d4e-b33f-e2843b78e5f6 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/3f748c89-825a-404e-b257-686f43253bfa" status: 200 len: 1452 microversion: 2.1 time: 0.168539 Oct 04 21:25:31.581849 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3178/6322] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:25:31 2022] GET /compute/v2.1/servers/3f748c89-825a-404e-b257-686f43253bfa => generated 1452 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:25:31.605445 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-24e0bddd-030f-4e6d-9ac8-4cd99f0a8fab tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:25:31.606157 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-24e0bddd-030f-4e6d-9ac8-4cd99f0a8fab tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: 3f748c89-825a-404e-b257-686f43253bfa] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:25:31.609185 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:25:31.615471 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-24e0bddd-030f-4e6d-9ac8-4cd99f0a8fab tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:31.616001 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-24e0bddd-030f-4e6d-9ac8-4cd99f0a8fab tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:31.616419 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-24e0bddd-030f-4e6d-9ac8-4cd99f0a8fab tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:31.617141 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-24e0bddd-030f-4e6d-9ac8-4cd99f0a8fab tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:31.617599 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-24e0bddd-030f-4e6d-9ac8-4cd99f0a8fab tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:31.618030 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-24e0bddd-030f-4e6d-9ac8-4cd99f0a8fab tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:31.621450 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:25:31.767940 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-24e0bddd-030f-4e6d-9ac8-4cd99f0a8fab tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:25:31.776308 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-24e0bddd-030f-4e6d-9ac8-4cd99f0a8fab tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/3f748c89-825a-404e-b257-686f43253bfa" status: 200 len: 1452 microversion: 2.1 time: 0.175079 Oct 04 21:25:31.776907 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3145/6323] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:25:31 2022] GET /compute/v2.1/servers/3f748c89-825a-404e-b257-686f43253bfa => generated 1452 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:25:33.640728 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-2dae3e99-4631-4904-ac02-a9257540a73b req-9f9fdf88-e8c0-44bd-9110-f0a1b08de850 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f748c89-825a-404e-b257-686f43253bfa", "tag": "cdddd896-2598-4cd4-8c83-3c32827b680f"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:25:33.658132 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-2dae3e99-4631-4904-ac02-a9257540a73b req-9f9fdf88-e8c0-44bd-9110-f0a1b08de850 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:25:33.658809 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-2dae3e99-4631-4904-ac02-a9257540a73b req-9f9fdf88-e8c0-44bd-9110-f0a1b08de850 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:25:33.659377 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-2dae3e99-4631-4904-ac02-a9257540a73b req-9f9fdf88-e8c0-44bd-9110-f0a1b08de850 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:25:33.673241 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-2dae3e99-4631-4904-ac02-a9257540a73b req-9f9fdf88-e8c0-44bd-9110-f0a1b08de850 service nova] Creating event network-changed:cdddd896-2598-4cd4-8c83-3c32827b680f for instance 3f748c89-825a-404e-b257-686f43253bfa on n-h2-854823-8 Oct 04 21:25:33.679258 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-2dae3e99-4631-4904-ac02-a9257540a73b req-9f9fdf88-e8c0-44bd-9110-f0a1b08de850 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045132 Oct 04 21:25:33.679940 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3179/6324] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:25:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:27:14.283136 n-d-854823-8 devstack@n-api.service[128801]: ERROR oslo.messaging._drivers.impl_rabbit [-] [0572b6b5-6fec-4a5a-bfd2-8f7d3f0cb615] AMQP server on 10.222.0.33:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 04 21:27:14.284294 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:27:14.285090 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=5 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:27:14.286554 n-d-854823-8 devstack@n-api.service[128801]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 04 21:27:14.286745 n-d-854823-8 devstack@n-api.service[128801]: Tue Oct 4 21:27:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.33) !!! Oct 04 21:27:14.289293 n-d-854823-8 devstack@n-api.service[128801]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 04 21:27:14.289498 n-d-854823-8 devstack@n-api.service[128801]: Tue Oct 4 21:27:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.33) !!! Oct 04 21:27:14.297799 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5c7e8ad6-9592-4672-b45f-f931c2ea906b tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1931852359", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1556253219", "security_groups": [{"name": "tempest-secgroup-smoke-405656399"}], "block_device_mapping_v2": [{"uuid": "e48cd30a-40c2-49a0-9cf2-7c67743df52c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "975b1130-f216-463e-808d-0d3403b17918"}]}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:27:14.435985 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.network.neutron [None req-5c7e8ad6-9592-4672-b45f-f931c2ea906b tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] validate_networks() for [('975b1130-f216-463e-808d-0d3403b17918', None, None, None, None, None)] {{(pid=128801) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:27:14.908191 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-5c7e8ad6-9592-4672-b45f-f931c2ea906b tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Flavor limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:27:14.908701 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-5c7e8ad6-9592-4672-b45f-f931c2ea906b tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Image limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:27:14.909248 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-5c7e8ad6-9592-4672-b45f-f931c2ea906b tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Flavor pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:27:14.909744 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-5c7e8ad6-9592-4672-b45f-f931c2ea906b tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Image pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:27:14.910232 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-5c7e8ad6-9592-4672-b45f-f931c2ea906b tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:27:14.920054 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5c7e8ad6-9592-4672-b45f-f931c2ea906b tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:14.920549 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5c7e8ad6-9592-4672-b45f-f931c2ea906b tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:14.920981 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5c7e8ad6-9592-4672-b45f-f931c2ea906b tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:14.921703 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5c7e8ad6-9592-4672-b45f-f931c2ea906b tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:14.922212 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5c7e8ad6-9592-4672-b45f-f931c2ea906b tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:14.922615 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5c7e8ad6-9592-4672-b45f-f931c2ea906b tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:14.941321 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-5c7e8ad6-9592-4672-b45f-f931c2ea906b tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Getting quotas for project 0d78e06d720d438a9308ae138902f847. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:27:14.947056 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-5c7e8ad6-9592-4672-b45f-f931c2ea906b tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Getting quotas for user ad7b0b59fad1429e95591b21e33ccbaa and project 0d78e06d720d438a9308ae138902f847. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:27:15.011538 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-5c7e8ad6-9592-4672-b45f-f931c2ea906b tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Going to run 1 instances... {{(pid=128801) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:27:15.013264 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-5c7e8ad6-9592-4672-b45f-f931c2ea906b tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: 7305c4e9-ae2a-45a8-b175-cd5fcd8324a5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e48cd30a-40c2-49a0-9cf2-7c67743df52c',volume_size=None,volume_type=None)] {{(pid=128801) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:27:15.165443 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5c7e8ad6-9592-4672-b45f-f931c2ea906b tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.884273 Oct 04 21:27:15.166128 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3146/6325] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 21:27:14 2022] POST /compute/v2.1/servers => generated 405 bytes in 886 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 21:27:15.181917 n-d-854823-8 devstack@n-api.service[128802]: ERROR oslo.messaging._drivers.impl_rabbit [-] [3ed749fe-ba58-4081-afad-8a961afd7471] AMQP server on 10.222.0.33:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Oct 04 21:27:15.186322 n-d-854823-8 devstack@n-api.service[128802]: ERROR oslo.messaging._drivers.impl_rabbit [-] [399f3af7-d281-4213-9ef7-61e2871c9a11] AMQP server on 10.222.0.33:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Oct 04 21:27:15.188112 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_api:SELECT=3 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:27:15.190008 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=7 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:27:15.196233 n-d-854823-8 devstack@n-api.service[128802]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 21:27:15.196595 n-d-854823-8 devstack@n-api.service[128802]: Tue Oct 4 21:27:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7305c4e9-ae2a-45a8-b175-cd5fcd8324a5 (ip 10.222.0.33) !!! Oct 04 21:27:15.199715 n-d-854823-8 devstack@n-api.service[128802]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 21:27:15.200023 n-d-854823-8 devstack@n-api.service[128802]: Tue Oct 4 21:27:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7305c4e9-ae2a-45a8-b175-cd5fcd8324a5 (ip 10.222.0.33) !!! Oct 04 21:27:15.211608 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-dc89320d-cf59-48eb-ac4e-be2bce34a3bc tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:15.212858 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-dc89320d-cf59-48eb-ac4e-be2bce34a3bc tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: 7305c4e9-ae2a-45a8-b175-cd5fcd8324a5] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:15.301788 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-dc89320d-cf59-48eb-ac4e-be2bce34a3bc tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:15.310769 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-dc89320d-cf59-48eb-ac4e-be2bce34a3bc tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/7305c4e9-ae2a-45a8-b175-cd5fcd8324a5" status: 200 len: 1095 microversion: 2.1 time: 0.135891 Oct 04 21:27:15.311385 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3180/6326] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:27:15 2022] GET /compute/v2.1/servers/7305c4e9-ae2a-45a8-b175-cd5fcd8324a5 => generated 1095 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:27:16.340399 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-3d7de80c-4bae-4469-85c0-be41ed75a1bd tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:16.341512 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-3d7de80c-4bae-4469-85c0-be41ed75a1bd tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: 7305c4e9-ae2a-45a8-b175-cd5fcd8324a5] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:16.354233 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3d7de80c-4bae-4469-85c0-be41ed75a1bd tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:16.355097 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3d7de80c-4bae-4469-85c0-be41ed75a1bd tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:16.355899 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3d7de80c-4bae-4469-85c0-be41ed75a1bd tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:16.356747 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3d7de80c-4bae-4469-85c0-be41ed75a1bd tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:16.357556 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3d7de80c-4bae-4469-85c0-be41ed75a1bd tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:16.358380 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3d7de80c-4bae-4469-85c0-be41ed75a1bd tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:16.365220 n-d-854823-8 devstack@n-api.service[128801]: INFO oslo.messaging._drivers.impl_rabbit [-] [0572b6b5-6fec-4a5a-bfd2-8f7d3f0cb615] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 51336. Oct 04 21:27:16.501798 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-3d7de80c-4bae-4469-85c0-be41ed75a1bd tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:16.514100 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-3d7de80c-4bae-4469-85c0-be41ed75a1bd tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/7305c4e9-ae2a-45a8-b175-cd5fcd8324a5" status: 200 len: 1193 microversion: 2.1 time: 0.183919 Oct 04 21:27:16.514773 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3147/6327] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:27:16 2022] GET /compute/v2.1/servers/7305c4e9-ae2a-45a8-b175-cd5fcd8324a5 => generated 1193 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:27:17.548440 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-b4da7da6-323c-46be-a0fc-927c88ba3391 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:17.549214 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-b4da7da6-323c-46be-a0fc-927c88ba3391 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: 7305c4e9-ae2a-45a8-b175-cd5fcd8324a5] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:17.571543 n-d-854823-8 devstack@n-api.service[128802]: INFO oslo.messaging._drivers.impl_rabbit [-] [399f3af7-d281-4213-9ef7-61e2871c9a11] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 51344. Oct 04 21:27:17.582633 n-d-854823-8 devstack@n-api.service[128802]: INFO oslo.messaging._drivers.impl_rabbit [-] [3ed749fe-ba58-4081-afad-8a961afd7471] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 51340. Oct 04 21:27:17.592165 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b4da7da6-323c-46be-a0fc-927c88ba3391 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:17.593029 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b4da7da6-323c-46be-a0fc-927c88ba3391 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:17.593660 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b4da7da6-323c-46be-a0fc-927c88ba3391 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:17.597064 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b4da7da6-323c-46be-a0fc-927c88ba3391 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:17.597574 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b4da7da6-323c-46be-a0fc-927c88ba3391 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:17.598044 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b4da7da6-323c-46be-a0fc-927c88ba3391 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:18.209577 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-b4da7da6-323c-46be-a0fc-927c88ba3391 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:18.220321 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-b4da7da6-323c-46be-a0fc-927c88ba3391 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/7305c4e9-ae2a-45a8-b175-cd5fcd8324a5" status: 200 len: 1278 microversion: 2.1 time: 0.675767 Oct 04 21:27:18.221526 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3181/6328] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:27:17 2022] GET /compute/v2.1/servers/7305c4e9-ae2a-45a8-b175-cd5fcd8324a5 => generated 1278 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:27:18.904963 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-9d929217-c288-45a8-bae5-163a29fd5797 req-cf8dbbef-ba8e-4718-b4f6-236578767a89 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7305c4e9-ae2a-45a8-b175-cd5fcd8324a5", "tag": "9f5863eb-eb09-4f71-b836-8e802d2a7d78"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:27:18.923257 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-9d929217-c288-45a8-bae5-163a29fd5797 req-cf8dbbef-ba8e-4718-b4f6-236578767a89 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:18.924201 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-9d929217-c288-45a8-bae5-163a29fd5797 req-cf8dbbef-ba8e-4718-b4f6-236578767a89 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:18.924990 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-9d929217-c288-45a8-bae5-163a29fd5797 req-cf8dbbef-ba8e-4718-b4f6-236578767a89 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:18.958198 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-9d929217-c288-45a8-bae5-163a29fd5797 req-cf8dbbef-ba8e-4718-b4f6-236578767a89 service nova] Creating event network-changed:9f5863eb-eb09-4f71-b836-8e802d2a7d78 for instance 7305c4e9-ae2a-45a8-b175-cd5fcd8324a5 on n-h1-854823-8 Oct 04 21:27:18.969478 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-9d929217-c288-45a8-bae5-163a29fd5797 req-cf8dbbef-ba8e-4718-b4f6-236578767a89 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.174935 Oct 04 21:27:18.970665 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3148/6329] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:27:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:27:19.269768 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-3006511c-3291-4925-85c3-d5b21a28aac6 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:19.271061 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-3006511c-3291-4925-85c3-d5b21a28aac6 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: 7305c4e9-ae2a-45a8-b175-cd5fcd8324a5] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:19.284085 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3006511c-3291-4925-85c3-d5b21a28aac6 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:19.285181 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3006511c-3291-4925-85c3-d5b21a28aac6 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:19.285984 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3006511c-3291-4925-85c3-d5b21a28aac6 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:19.287423 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3006511c-3291-4925-85c3-d5b21a28aac6 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:19.288550 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3006511c-3291-4925-85c3-d5b21a28aac6 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:19.289504 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3006511c-3291-4925-85c3-d5b21a28aac6 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:19.526749 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-3006511c-3291-4925-85c3-d5b21a28aac6 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:19.542454 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-3006511c-3291-4925-85c3-d5b21a28aac6 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/7305c4e9-ae2a-45a8-b175-cd5fcd8324a5" status: 200 len: 1278 microversion: 2.1 time: 0.278770 Oct 04 21:27:19.544131 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3182/6330] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:27:19 2022] GET /compute/v2.1/servers/7305c4e9-ae2a-45a8-b175-cd5fcd8324a5 => generated 1278 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:27:20.581048 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2ceb61c4-e6b9-4f4a-9687-c28892a88c57 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:20.581849 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-2ceb61c4-e6b9-4f4a-9687-c28892a88c57 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: 7305c4e9-ae2a-45a8-b175-cd5fcd8324a5] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:20.589773 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2ceb61c4-e6b9-4f4a-9687-c28892a88c57 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:20.590548 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2ceb61c4-e6b9-4f4a-9687-c28892a88c57 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:20.590994 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2ceb61c4-e6b9-4f4a-9687-c28892a88c57 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:20.591714 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2ceb61c4-e6b9-4f4a-9687-c28892a88c57 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:20.592172 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2ceb61c4-e6b9-4f4a-9687-c28892a88c57 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:20.592599 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2ceb61c4-e6b9-4f4a-9687-c28892a88c57 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:20.797821 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-2ceb61c4-e6b9-4f4a-9687-c28892a88c57 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:20.806731 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-2ceb61c4-e6b9-4f4a-9687-c28892a88c57 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/7305c4e9-ae2a-45a8-b175-cd5fcd8324a5" status: 200 len: 1278 microversion: 2.1 time: 0.231075 Oct 04 21:27:20.808052 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3149/6331] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:27:20 2022] GET /compute/v2.1/servers/7305c4e9-ae2a-45a8-b175-cd5fcd8324a5 => generated 1278 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:27:21.848604 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-33e8d00e-1add-4894-8f65-705f1eb7d53c tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:21.849346 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-33e8d00e-1add-4894-8f65-705f1eb7d53c tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: 7305c4e9-ae2a-45a8-b175-cd5fcd8324a5] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:21.857675 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-33e8d00e-1add-4894-8f65-705f1eb7d53c tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:21.858265 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-33e8d00e-1add-4894-8f65-705f1eb7d53c tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:21.858884 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-33e8d00e-1add-4894-8f65-705f1eb7d53c tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:21.859688 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-33e8d00e-1add-4894-8f65-705f1eb7d53c tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:21.860265 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-33e8d00e-1add-4894-8f65-705f1eb7d53c tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:21.860777 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-33e8d00e-1add-4894-8f65-705f1eb7d53c tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:22.068400 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-33e8d00e-1add-4894-8f65-705f1eb7d53c tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:22.077844 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-33e8d00e-1add-4894-8f65-705f1eb7d53c tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/7305c4e9-ae2a-45a8-b175-cd5fcd8324a5" status: 200 len: 1278 microversion: 2.1 time: 0.233096 Oct 04 21:27:22.078628 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3183/6332] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:27:21 2022] GET /compute/v2.1/servers/7305c4e9-ae2a-45a8-b175-cd5fcd8324a5 => generated 1278 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:27:23.122757 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c0b583b3-00c4-41c2-b297-b1f43ff20e6d tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:23.123997 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c0b583b3-00c4-41c2-b297-b1f43ff20e6d tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: 7305c4e9-ae2a-45a8-b175-cd5fcd8324a5] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:23.138609 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c0b583b3-00c4-41c2-b297-b1f43ff20e6d tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:23.139203 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c0b583b3-00c4-41c2-b297-b1f43ff20e6d tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:23.139735 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c0b583b3-00c4-41c2-b297-b1f43ff20e6d tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:23.140703 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c0b583b3-00c4-41c2-b297-b1f43ff20e6d tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:23.141230 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c0b583b3-00c4-41c2-b297-b1f43ff20e6d tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:23.141912 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c0b583b3-00c4-41c2-b297-b1f43ff20e6d tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:23.314616 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c0b583b3-00c4-41c2-b297-b1f43ff20e6d tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:23.322879 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c0b583b3-00c4-41c2-b297-b1f43ff20e6d tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/7305c4e9-ae2a-45a8-b175-cd5fcd8324a5" status: 200 len: 1266 microversion: 2.1 time: 0.209766 Oct 04 21:27:23.323492 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3150/6333] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:27:23 2022] GET /compute/v2.1/servers/7305c4e9-ae2a-45a8-b175-cd5fcd8324a5 => generated 1266 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:27:24.348441 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-e29bad7c-c479-4303-9554-b2e4bdb5d0b7 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:24.349214 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-e29bad7c-c479-4303-9554-b2e4bdb5d0b7 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: 7305c4e9-ae2a-45a8-b175-cd5fcd8324a5] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:24.357723 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e29bad7c-c479-4303-9554-b2e4bdb5d0b7 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:24.358242 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e29bad7c-c479-4303-9554-b2e4bdb5d0b7 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:24.358735 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e29bad7c-c479-4303-9554-b2e4bdb5d0b7 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:24.359500 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e29bad7c-c479-4303-9554-b2e4bdb5d0b7 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:24.359993 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e29bad7c-c479-4303-9554-b2e4bdb5d0b7 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:24.360436 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e29bad7c-c479-4303-9554-b2e4bdb5d0b7 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:24.516401 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-e29bad7c-c479-4303-9554-b2e4bdb5d0b7 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:24.532099 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-e29bad7c-c479-4303-9554-b2e4bdb5d0b7 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/7305c4e9-ae2a-45a8-b175-cd5fcd8324a5" status: 200 len: 1266 microversion: 2.1 time: 0.188169 Oct 04 21:27:24.533182 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3184/6334] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:27:24 2022] GET /compute/v2.1/servers/7305c4e9-ae2a-45a8-b175-cd5fcd8324a5 => generated 1266 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:27:25.568988 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e252cf16-a8e9-49d8-83c4-50691dc4d20c tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:25.569609 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e252cf16-a8e9-49d8-83c4-50691dc4d20c tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: 7305c4e9-ae2a-45a8-b175-cd5fcd8324a5] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:25.572772 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:27:25.573918 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=6 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:27:25.580655 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e252cf16-a8e9-49d8-83c4-50691dc4d20c tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:25.581155 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e252cf16-a8e9-49d8-83c4-50691dc4d20c tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:25.581595 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e252cf16-a8e9-49d8-83c4-50691dc4d20c tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:25.582374 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e252cf16-a8e9-49d8-83c4-50691dc4d20c tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:25.582832 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e252cf16-a8e9-49d8-83c4-50691dc4d20c tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:25.583264 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e252cf16-a8e9-49d8-83c4-50691dc4d20c tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:25.741238 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e252cf16-a8e9-49d8-83c4-50691dc4d20c tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:25.750302 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e252cf16-a8e9-49d8-83c4-50691dc4d20c tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/7305c4e9-ae2a-45a8-b175-cd5fcd8324a5" status: 200 len: 1266 microversion: 2.1 time: 0.185436 Oct 04 21:27:25.751134 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3151/6335] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:27:25 2022] GET /compute/v2.1/servers/7305c4e9-ae2a-45a8-b175-cd5fcd8324a5 => generated 1266 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:27:26.774943 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-58201253-7ebb-4a86-8c08-9cb099aa05ef tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:26.775580 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-58201253-7ebb-4a86-8c08-9cb099aa05ef tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: 7305c4e9-ae2a-45a8-b175-cd5fcd8324a5] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:26.777988 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell0:SELECT=2 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:27:26.785056 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-58201253-7ebb-4a86-8c08-9cb099aa05ef tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:26.785572 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-58201253-7ebb-4a86-8c08-9cb099aa05ef tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:26.786031 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-58201253-7ebb-4a86-8c08-9cb099aa05ef tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:26.786813 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-58201253-7ebb-4a86-8c08-9cb099aa05ef tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:26.787297 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-58201253-7ebb-4a86-8c08-9cb099aa05ef tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:26.787750 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-58201253-7ebb-4a86-8c08-9cb099aa05ef tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:26.937557 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-58201253-7ebb-4a86-8c08-9cb099aa05ef tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:26.946153 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-58201253-7ebb-4a86-8c08-9cb099aa05ef tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/7305c4e9-ae2a-45a8-b175-cd5fcd8324a5" status: 200 len: 1266 microversion: 2.1 time: 0.174952 Oct 04 21:27:26.946686 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3185/6336] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:27:26 2022] GET /compute/v2.1/servers/7305c4e9-ae2a-45a8-b175-cd5fcd8324a5 => generated 1266 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:27:27.973600 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d39bc1e6-1cf5-4cb3-9a35-19d882c72b0f tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:27.974655 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d39bc1e6-1cf5-4cb3-9a35-19d882c72b0f tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: 7305c4e9-ae2a-45a8-b175-cd5fcd8324a5] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:27.987675 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d39bc1e6-1cf5-4cb3-9a35-19d882c72b0f tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:27.988545 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d39bc1e6-1cf5-4cb3-9a35-19d882c72b0f tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:27.989319 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d39bc1e6-1cf5-4cb3-9a35-19d882c72b0f tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:27.990910 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d39bc1e6-1cf5-4cb3-9a35-19d882c72b0f tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:27.991721 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d39bc1e6-1cf5-4cb3-9a35-19d882c72b0f tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:27.992500 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d39bc1e6-1cf5-4cb3-9a35-19d882c72b0f tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:28.161127 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d39bc1e6-1cf5-4cb3-9a35-19d882c72b0f tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:28.170496 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d39bc1e6-1cf5-4cb3-9a35-19d882c72b0f tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/7305c4e9-ae2a-45a8-b175-cd5fcd8324a5" status: 200 len: 1266 microversion: 2.1 time: 0.203751 Oct 04 21:27:28.171376 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3152/6337] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:27:27 2022] GET /compute/v2.1/servers/7305c4e9-ae2a-45a8-b175-cd5fcd8324a5 => generated 1266 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:27:29.195044 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-dcd5a3ac-92ad-49fe-ae05-7695f4b11f77 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:29.195680 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-dcd5a3ac-92ad-49fe-ae05-7695f4b11f77 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: 7305c4e9-ae2a-45a8-b175-cd5fcd8324a5] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:29.203652 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dcd5a3ac-92ad-49fe-ae05-7695f4b11f77 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:29.204171 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dcd5a3ac-92ad-49fe-ae05-7695f4b11f77 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:29.204623 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dcd5a3ac-92ad-49fe-ae05-7695f4b11f77 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:29.205359 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dcd5a3ac-92ad-49fe-ae05-7695f4b11f77 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:29.205840 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dcd5a3ac-92ad-49fe-ae05-7695f4b11f77 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:29.206284 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dcd5a3ac-92ad-49fe-ae05-7695f4b11f77 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:29.365212 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-dcd5a3ac-92ad-49fe-ae05-7695f4b11f77 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:29.374048 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-dcd5a3ac-92ad-49fe-ae05-7695f4b11f77 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/7305c4e9-ae2a-45a8-b175-cd5fcd8324a5" status: 200 len: 1266 microversion: 2.1 time: 0.183136 Oct 04 21:27:29.374688 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3186/6338] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:27:29 2022] GET /compute/v2.1/servers/7305c4e9-ae2a-45a8-b175-cd5fcd8324a5 => generated 1266 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:27:30.397324 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-bcdd999c-a41f-4b3c-a88c-cdf337e248a6 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:30.397929 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-bcdd999c-a41f-4b3c-a88c-cdf337e248a6 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: 7305c4e9-ae2a-45a8-b175-cd5fcd8324a5] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:30.409115 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bcdd999c-a41f-4b3c-a88c-cdf337e248a6 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:30.410002 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bcdd999c-a41f-4b3c-a88c-cdf337e248a6 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:30.410825 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bcdd999c-a41f-4b3c-a88c-cdf337e248a6 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:30.412096 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bcdd999c-a41f-4b3c-a88c-cdf337e248a6 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:30.412927 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bcdd999c-a41f-4b3c-a88c-cdf337e248a6 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:30.413705 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bcdd999c-a41f-4b3c-a88c-cdf337e248a6 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:30.582488 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-bcdd999c-a41f-4b3c-a88c-cdf337e248a6 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:30.592229 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-bcdd999c-a41f-4b3c-a88c-cdf337e248a6 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/7305c4e9-ae2a-45a8-b175-cd5fcd8324a5" status: 200 len: 1266 microversion: 2.1 time: 0.198754 Oct 04 21:27:30.592828 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3153/6339] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:27:30 2022] GET /compute/v2.1/servers/7305c4e9-ae2a-45a8-b175-cd5fcd8324a5 => generated 1266 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:27:31.629994 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-9169ef0a-f8c7-4568-bae5-5011c0ef1a52 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:31.631088 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-9169ef0a-f8c7-4568-bae5-5011c0ef1a52 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: 7305c4e9-ae2a-45a8-b175-cd5fcd8324a5] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:31.639367 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9169ef0a-f8c7-4568-bae5-5011c0ef1a52 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:31.640017 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9169ef0a-f8c7-4568-bae5-5011c0ef1a52 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:31.640594 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9169ef0a-f8c7-4568-bae5-5011c0ef1a52 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:31.641445 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9169ef0a-f8c7-4568-bae5-5011c0ef1a52 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:31.642120 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9169ef0a-f8c7-4568-bae5-5011c0ef1a52 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:31.642708 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9169ef0a-f8c7-4568-bae5-5011c0ef1a52 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:31.871286 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-9169ef0a-f8c7-4568-bae5-5011c0ef1a52 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:31.883975 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-9169ef0a-f8c7-4568-bae5-5011c0ef1a52 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/7305c4e9-ae2a-45a8-b175-cd5fcd8324a5" status: 200 len: 1266 microversion: 2.1 time: 0.258981 Oct 04 21:27:31.884619 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3187/6340] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:27:31 2022] GET /compute/v2.1/servers/7305c4e9-ae2a-45a8-b175-cd5fcd8324a5 => generated 1266 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:27:32.908225 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2a5999f0-57ae-49ff-b018-0fe4b2561d74 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:32.908884 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-2a5999f0-57ae-49ff-b018-0fe4b2561d74 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: 7305c4e9-ae2a-45a8-b175-cd5fcd8324a5] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:32.916234 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2a5999f0-57ae-49ff-b018-0fe4b2561d74 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:32.917563 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2a5999f0-57ae-49ff-b018-0fe4b2561d74 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:32.918069 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2a5999f0-57ae-49ff-b018-0fe4b2561d74 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:32.919210 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2a5999f0-57ae-49ff-b018-0fe4b2561d74 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:32.919738 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2a5999f0-57ae-49ff-b018-0fe4b2561d74 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:32.920212 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2a5999f0-57ae-49ff-b018-0fe4b2561d74 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:33.086191 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-2a5999f0-57ae-49ff-b018-0fe4b2561d74 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:33.096055 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-2a5999f0-57ae-49ff-b018-0fe4b2561d74 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/7305c4e9-ae2a-45a8-b175-cd5fcd8324a5" status: 200 len: 1266 microversion: 2.1 time: 0.191665 Oct 04 21:27:33.096863 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3154/6341] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:27:32 2022] GET /compute/v2.1/servers/7305c4e9-ae2a-45a8-b175-cd5fcd8324a5 => generated 1266 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:27:33.776111 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-4eb56f19-e202-4258-bbdd-994263050b08 req-3032da5e-af87-4cd8-95c9-71dce9e529f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7305c4e9-ae2a-45a8-b175-cd5fcd8324a5", "name": "network-vif-plugged", "status": "completed", "tag": "9f5863eb-eb09-4f71-b836-8e802d2a7d78"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:27:33.787299 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-4eb56f19-e202-4258-bbdd-994263050b08 req-3032da5e-af87-4cd8-95c9-71dce9e529f0 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:33.787794 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-4eb56f19-e202-4258-bbdd-994263050b08 req-3032da5e-af87-4cd8-95c9-71dce9e529f0 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:33.788233 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-4eb56f19-e202-4258-bbdd-994263050b08 req-3032da5e-af87-4cd8-95c9-71dce9e529f0 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:33.809478 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-4eb56f19-e202-4258-bbdd-994263050b08 req-3032da5e-af87-4cd8-95c9-71dce9e529f0 service nova] Creating event network-vif-plugged:9f5863eb-eb09-4f71-b836-8e802d2a7d78 for instance 7305c4e9-ae2a-45a8-b175-cd5fcd8324a5 on n-h1-854823-8 Oct 04 21:27:33.829456 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-4eb56f19-e202-4258-bbdd-994263050b08 req-3032da5e-af87-4cd8-95c9-71dce9e529f0 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.139230 Oct 04 21:27:33.830218 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3188/6342] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:27:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:27:34.120376 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-be37298c-2dde-4180-92f3-7711db37057e tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:34.121323 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-be37298c-2dde-4180-92f3-7711db37057e tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: 7305c4e9-ae2a-45a8-b175-cd5fcd8324a5] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:34.129411 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-be37298c-2dde-4180-92f3-7711db37057e tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:34.130022 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-be37298c-2dde-4180-92f3-7711db37057e tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:34.130603 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-be37298c-2dde-4180-92f3-7711db37057e tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:34.131521 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-be37298c-2dde-4180-92f3-7711db37057e tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:34.132073 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-be37298c-2dde-4180-92f3-7711db37057e tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:34.132614 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-be37298c-2dde-4180-92f3-7711db37057e tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:34.286435 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-be37298c-2dde-4180-92f3-7711db37057e tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:34.295499 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-be37298c-2dde-4180-92f3-7711db37057e tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/7305c4e9-ae2a-45a8-b175-cd5fcd8324a5" status: 200 len: 1266 microversion: 2.1 time: 0.179570 Oct 04 21:27:34.296191 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3155/6343] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:27:34 2022] GET /compute/v2.1/servers/7305c4e9-ae2a-45a8-b175-cd5fcd8324a5 => generated 1266 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:27:35.321233 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-46565185-77fe-4859-8a30-85ae808e3b8c tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:35.321961 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-46565185-77fe-4859-8a30-85ae808e3b8c tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: 7305c4e9-ae2a-45a8-b175-cd5fcd8324a5] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:35.329795 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-46565185-77fe-4859-8a30-85ae808e3b8c tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:35.330302 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-46565185-77fe-4859-8a30-85ae808e3b8c tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:35.330784 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-46565185-77fe-4859-8a30-85ae808e3b8c tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:35.331510 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-46565185-77fe-4859-8a30-85ae808e3b8c tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:35.331985 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-46565185-77fe-4859-8a30-85ae808e3b8c tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:35.332427 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-46565185-77fe-4859-8a30-85ae808e3b8c tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:35.478118 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-46565185-77fe-4859-8a30-85ae808e3b8c tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:35.486575 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-46565185-77fe-4859-8a30-85ae808e3b8c tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/7305c4e9-ae2a-45a8-b175-cd5fcd8324a5" status: 200 len: 1454 microversion: 2.1 time: 0.170571 Oct 04 21:27:35.487164 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3189/6344] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:27:35 2022] GET /compute/v2.1/servers/7305c4e9-ae2a-45a8-b175-cd5fcd8324a5 => generated 1454 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:27:35.509496 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b1d8d889-e48b-493e-8522-d76fc3b721a0 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:27:35.511229 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b1d8d889-e48b-493e-8522-d76fc3b721a0 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: 7305c4e9-ae2a-45a8-b175-cd5fcd8324a5] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:27:35.518665 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b1d8d889-e48b-493e-8522-d76fc3b721a0 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:35.519164 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b1d8d889-e48b-493e-8522-d76fc3b721a0 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:35.519608 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b1d8d889-e48b-493e-8522-d76fc3b721a0 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:35.520322 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b1d8d889-e48b-493e-8522-d76fc3b721a0 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:35.520789 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b1d8d889-e48b-493e-8522-d76fc3b721a0 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:35.521235 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b1d8d889-e48b-493e-8522-d76fc3b721a0 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:35.670710 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-b1d8d889-e48b-493e-8522-d76fc3b721a0 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:27:35.678968 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b1d8d889-e48b-493e-8522-d76fc3b721a0 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/7305c4e9-ae2a-45a8-b175-cd5fcd8324a5" status: 200 len: 1454 microversion: 2.1 time: 0.173465 Oct 04 21:27:35.679558 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3156/6345] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:27:35 2022] GET /compute/v2.1/servers/7305c4e9-ae2a-45a8-b175-cd5fcd8324a5 => generated 1454 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:27:37.878837 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-dd47a6d9-d8fa-485f-8242-6833f729f666 req-22b2eccf-fa11-4f7c-88eb-02c0bb66761f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7305c4e9-ae2a-45a8-b175-cd5fcd8324a5", "tag": "9f5863eb-eb09-4f71-b836-8e802d2a7d78"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:27:37.889757 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-dd47a6d9-d8fa-485f-8242-6833f729f666 req-22b2eccf-fa11-4f7c-88eb-02c0bb66761f service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:27:37.890264 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-dd47a6d9-d8fa-485f-8242-6833f729f666 req-22b2eccf-fa11-4f7c-88eb-02c0bb66761f service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:27:37.890743 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-dd47a6d9-d8fa-485f-8242-6833f729f666 req-22b2eccf-fa11-4f7c-88eb-02c0bb66761f service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:27:37.903413 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-dd47a6d9-d8fa-485f-8242-6833f729f666 req-22b2eccf-fa11-4f7c-88eb-02c0bb66761f service nova] Creating event network-changed:9f5863eb-eb09-4f71-b836-8e802d2a7d78 for instance 7305c4e9-ae2a-45a8-b175-cd5fcd8324a5 on n-h1-854823-8 Oct 04 21:27:37.909018 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-dd47a6d9-d8fa-485f-8242-6833f729f666 req-22b2eccf-fa11-4f7c-88eb-02c0bb66761f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034407 Oct 04 21:27:37.909912 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3190/6346] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:27:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:29:17.095819 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:29:17.096883 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=58 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:29:17.099083 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_api:SELECT=24 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:29:17.100313 n-d-854823-8 devstack@n-api.service[128801]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 21:29:17.101839 n-d-854823-8 devstack@n-api.service[128801]: Tue Oct 4 21:29:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7305c4e9-ae2a-45a8-b175-cd5fcd8324a5 (ip 10.222.0.33) !!! Oct 04 21:29:17.102526 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=52 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:29:17.108949 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-3334ff02-b12d-440a-80ef-f0da6f8ad20e tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:17.109447 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-3334ff02-b12d-440a-80ef-f0da6f8ad20e tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: 7305c4e9-ae2a-45a8-b175-cd5fcd8324a5] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:17.126188 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3334ff02-b12d-440a-80ef-f0da6f8ad20e tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:17.126719 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3334ff02-b12d-440a-80ef-f0da6f8ad20e tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:17.127162 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3334ff02-b12d-440a-80ef-f0da6f8ad20e tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:17.127886 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3334ff02-b12d-440a-80ef-f0da6f8ad20e tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:17.128345 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3334ff02-b12d-440a-80ef-f0da6f8ad20e tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:17.128955 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3334ff02-b12d-440a-80ef-f0da6f8ad20e tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:17.159999 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-3334ff02-b12d-440a-80ef-f0da6f8ad20e tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: 7305c4e9-ae2a-45a8-b175-cd5fcd8324a5] Going to try to terminate instance {{(pid=128801) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:29:17.216619 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-b29505d5-0cbc-4d8d-87cd-7100f8f346b8 req-1387ccf7-f958-4d71-b002-42136d0ff31d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7305c4e9-ae2a-45a8-b175-cd5fcd8324a5", "tag": "9f5863eb-eb09-4f71-b836-8e802d2a7d78"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:29:17.229477 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-b29505d5-0cbc-4d8d-87cd-7100f8f346b8 req-1387ccf7-f958-4d71-b002-42136d0ff31d service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:17.230424 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-b29505d5-0cbc-4d8d-87cd-7100f8f346b8 req-1387ccf7-f958-4d71-b002-42136d0ff31d service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:17.231064 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-b29505d5-0cbc-4d8d-87cd-7100f8f346b8 req-1387ccf7-f958-4d71-b002-42136d0ff31d service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:17.246327 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-b29505d5-0cbc-4d8d-87cd-7100f8f346b8 req-1387ccf7-f958-4d71-b002-42136d0ff31d service nova] Creating event network-changed:9f5863eb-eb09-4f71-b836-8e802d2a7d78 for instance 7305c4e9-ae2a-45a8-b175-cd5fcd8324a5 on n-h1-854823-8 Oct 04 21:29:17.253021 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-b29505d5-0cbc-4d8d-87cd-7100f8f346b8 req-1387ccf7-f958-4d71-b002-42136d0ff31d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.160010 Oct 04 21:29:17.254196 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3191/6347] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:29:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:29:17.283031 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-3334ff02-b12d-440a-80ef-f0da6f8ad20e tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "DELETE /compute/v2.1/servers/7305c4e9-ae2a-45a8-b175-cd5fcd8324a5" status: 204 len: 0 microversion: 2.1 time: 0.192474 Oct 04 21:29:17.284039 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3157/6348] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 21:29:17 2022] DELETE /compute/v2.1/servers/7305c4e9-ae2a-45a8-b175-cd5fcd8324a5 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:29:17.293921 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-41c87735-e7a7-41f2-9975-8237c202d94e tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:17.294676 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-41c87735-e7a7-41f2-9975-8237c202d94e tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: 7305c4e9-ae2a-45a8-b175-cd5fcd8324a5] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:17.301856 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-41c87735-e7a7-41f2-9975-8237c202d94e tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:17.302360 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-41c87735-e7a7-41f2-9975-8237c202d94e tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:17.302810 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-41c87735-e7a7-41f2-9975-8237c202d94e tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:17.303615 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-41c87735-e7a7-41f2-9975-8237c202d94e tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:17.304150 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-41c87735-e7a7-41f2-9975-8237c202d94e tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:17.305535 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-41c87735-e7a7-41f2-9975-8237c202d94e tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:17.450476 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-41c87735-e7a7-41f2-9975-8237c202d94e tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:17.459283 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-41c87735-e7a7-41f2-9975-8237c202d94e tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/7305c4e9-ae2a-45a8-b175-cd5fcd8324a5" status: 200 len: 1579 microversion: 2.1 time: 0.170796 Oct 04 21:29:17.460096 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3192/6349] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:29:17 2022] GET /compute/v2.1/servers/7305c4e9-ae2a-45a8-b175-cd5fcd8324a5 => generated 1579 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:29:18.485207 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-bec25904-98d6-4245-9c9e-af5b211fa0b8 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:18.485822 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-bec25904-98d6-4245-9c9e-af5b211fa0b8 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: 7305c4e9-ae2a-45a8-b175-cd5fcd8324a5] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:18.493765 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bec25904-98d6-4245-9c9e-af5b211fa0b8 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:18.494244 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bec25904-98d6-4245-9c9e-af5b211fa0b8 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:18.494702 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bec25904-98d6-4245-9c9e-af5b211fa0b8 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:18.495397 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bec25904-98d6-4245-9c9e-af5b211fa0b8 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:18.495848 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bec25904-98d6-4245-9c9e-af5b211fa0b8 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:18.496268 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bec25904-98d6-4245-9c9e-af5b211fa0b8 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:18.719171 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-bec25904-98d6-4245-9c9e-af5b211fa0b8 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:18.729079 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-bec25904-98d6-4245-9c9e-af5b211fa0b8 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/7305c4e9-ae2a-45a8-b175-cd5fcd8324a5" status: 200 len: 1579 microversion: 2.1 time: 0.248141 Oct 04 21:29:18.729764 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3158/6350] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:29:18 2022] GET /compute/v2.1/servers/7305c4e9-ae2a-45a8-b175-cd5fcd8324a5 => generated 1579 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:29:19.622684 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-d7ab8f34-bba8-4b81-afc0-ad1a6174a47c req-24e5f272-4931-4514-8b65-d28ddadb5299 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7305c4e9-ae2a-45a8-b175-cd5fcd8324a5", "name": "network-vif-deleted", "tag": "9f5863eb-eb09-4f71-b836-8e802d2a7d78"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:29:19.633373 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-d7ab8f34-bba8-4b81-afc0-ad1a6174a47c req-24e5f272-4931-4514-8b65-d28ddadb5299 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:19.633864 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-d7ab8f34-bba8-4b81-afc0-ad1a6174a47c req-24e5f272-4931-4514-8b65-d28ddadb5299 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:19.634314 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-d7ab8f34-bba8-4b81-afc0-ad1a6174a47c req-24e5f272-4931-4514-8b65-d28ddadb5299 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:19.646491 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-d7ab8f34-bba8-4b81-afc0-ad1a6174a47c req-24e5f272-4931-4514-8b65-d28ddadb5299 service nova] Creating event network-vif-deleted:9f5863eb-eb09-4f71-b836-8e802d2a7d78 for instance 7305c4e9-ae2a-45a8-b175-cd5fcd8324a5 on n-h1-854823-8 Oct 04 21:29:19.653101 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-d7ab8f34-bba8-4b81-afc0-ad1a6174a47c req-24e5f272-4931-4514-8b65-d28ddadb5299 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034089 Oct 04 21:29:19.653756 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3193/6351] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:29:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:29:19.752793 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a91cca62-e7a6-4566-8ddb-a2d015247d97 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:19.753414 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a91cca62-e7a6-4566-8ddb-a2d015247d97 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: 7305c4e9-ae2a-45a8-b175-cd5fcd8324a5] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:19.760721 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a91cca62-e7a6-4566-8ddb-a2d015247d97 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:19.761216 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a91cca62-e7a6-4566-8ddb-a2d015247d97 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:19.761661 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a91cca62-e7a6-4566-8ddb-a2d015247d97 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:19.762398 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a91cca62-e7a6-4566-8ddb-a2d015247d97 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:19.762871 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a91cca62-e7a6-4566-8ddb-a2d015247d97 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:19.763303 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a91cca62-e7a6-4566-8ddb-a2d015247d97 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:19.832054 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-a91cca62-e7a6-4566-8ddb-a2d015247d97 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:19.840935 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a91cca62-e7a6-4566-8ddb-a2d015247d97 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/7305c4e9-ae2a-45a8-b175-cd5fcd8324a5" status: 200 len: 1226 microversion: 2.1 time: 0.092145 Oct 04 21:29:19.841530 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3159/6352] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:29:19 2022] GET /compute/v2.1/servers/7305c4e9-ae2a-45a8-b175-cd5fcd8324a5 => generated 1226 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:29:20.865952 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-acd64805-801b-47c7-a891-c8667980f2f6 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:20.866739 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-acd64805-801b-47c7-a891-c8667980f2f6 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: 7305c4e9-ae2a-45a8-b175-cd5fcd8324a5] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:20.873133 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-acd64805-801b-47c7-a891-c8667980f2f6 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:20.873633 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-acd64805-801b-47c7-a891-c8667980f2f6 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:20.874086 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-acd64805-801b-47c7-a891-c8667980f2f6 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:20.874832 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-acd64805-801b-47c7-a891-c8667980f2f6 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:20.875309 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-acd64805-801b-47c7-a891-c8667980f2f6 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:20.875751 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-acd64805-801b-47c7-a891-c8667980f2f6 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:20.939352 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-acd64805-801b-47c7-a891-c8667980f2f6 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:20.948234 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-acd64805-801b-47c7-a891-c8667980f2f6 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/7305c4e9-ae2a-45a8-b175-cd5fcd8324a5" status: 200 len: 1226 microversion: 2.1 time: 0.087437 Oct 04 21:29:20.948820 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3194/6353] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:29:20 2022] GET /compute/v2.1/servers/7305c4e9-ae2a-45a8-b175-cd5fcd8324a5 => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:29:21.971263 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-976a5000-4471-448a-a01e-d8495f02318b tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:21.971876 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-976a5000-4471-448a-a01e-d8495f02318b tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: 7305c4e9-ae2a-45a8-b175-cd5fcd8324a5] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:21.979788 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-976a5000-4471-448a-a01e-d8495f02318b tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:21.980280 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-976a5000-4471-448a-a01e-d8495f02318b tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:21.980721 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-976a5000-4471-448a-a01e-d8495f02318b tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:21.981429 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-976a5000-4471-448a-a01e-d8495f02318b tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:21.981889 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-976a5000-4471-448a-a01e-d8495f02318b tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:21.982327 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-976a5000-4471-448a-a01e-d8495f02318b tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:22.051981 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-976a5000-4471-448a-a01e-d8495f02318b tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:22.066592 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-976a5000-4471-448a-a01e-d8495f02318b tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/7305c4e9-ae2a-45a8-b175-cd5fcd8324a5" status: 200 len: 1226 microversion: 2.1 time: 0.098793 Oct 04 21:29:22.067683 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3160/6354] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:29:21 2022] GET /compute/v2.1/servers/7305c4e9-ae2a-45a8-b175-cd5fcd8324a5 => generated 1226 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:29:23.091295 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-76c2dd84-dca4-4963-937a-46c99dff6db7 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:23.091921 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-76c2dd84-dca4-4963-937a-46c99dff6db7 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: 7305c4e9-ae2a-45a8-b175-cd5fcd8324a5] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:23.099170 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-76c2dd84-dca4-4963-937a-46c99dff6db7 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:23.099673 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-76c2dd84-dca4-4963-937a-46c99dff6db7 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:23.100129 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-76c2dd84-dca4-4963-937a-46c99dff6db7 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:23.100987 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-76c2dd84-dca4-4963-937a-46c99dff6db7 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:23.101748 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-76c2dd84-dca4-4963-937a-46c99dff6db7 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:23.102460 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-76c2dd84-dca4-4963-937a-46c99dff6db7 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:23.173289 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-76c2dd84-dca4-4963-937a-46c99dff6db7 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:23.182907 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-76c2dd84-dca4-4963-937a-46c99dff6db7 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/7305c4e9-ae2a-45a8-b175-cd5fcd8324a5" status: 200 len: 1226 microversion: 2.1 time: 0.095465 Oct 04 21:29:23.183509 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3195/6355] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:29:23 2022] GET /compute/v2.1/servers/7305c4e9-ae2a-45a8-b175-cd5fcd8324a5 => generated 1226 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:29:24.206943 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-63ad5b52-8ba3-408d-8258-d39bd4c8da58 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:24.207560 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-63ad5b52-8ba3-408d-8258-d39bd4c8da58 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: 7305c4e9-ae2a-45a8-b175-cd5fcd8324a5] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:24.215243 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-63ad5b52-8ba3-408d-8258-d39bd4c8da58 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:24.215655 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-63ad5b52-8ba3-408d-8258-d39bd4c8da58 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:24.216097 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-63ad5b52-8ba3-408d-8258-d39bd4c8da58 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:24.216801 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-63ad5b52-8ba3-408d-8258-d39bd4c8da58 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:24.217263 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-63ad5b52-8ba3-408d-8258-d39bd4c8da58 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:24.217694 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-63ad5b52-8ba3-408d-8258-d39bd4c8da58 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:24.255279 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-63ad5b52-8ba3-408d-8258-d39bd4c8da58 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:24.255776 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-63ad5b52-8ba3-408d-8258-d39bd4c8da58 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:24.256216 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-63ad5b52-8ba3-408d-8258-d39bd4c8da58 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:24.256671 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-63ad5b52-8ba3-408d-8258-d39bd4c8da58 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lazy-loading 'fault' on Instance uuid 7305c4e9-ae2a-45a8-b175-cd5fcd8324a5 {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:29:24.300781 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-63ad5b52-8ba3-408d-8258-d39bd4c8da58 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:24.308989 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-63ad5b52-8ba3-408d-8258-d39bd4c8da58 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/7305c4e9-ae2a-45a8-b175-cd5fcd8324a5" status: 200 len: 1231 microversion: 2.1 time: 0.106000 Oct 04 21:29:24.309580 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3161/6356] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:29:24 2022] GET /compute/v2.1/servers/7305c4e9-ae2a-45a8-b175-cd5fcd8324a5 => generated 1231 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:29:25.332422 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-01cc7488-4f53-43b7-8431-d625dea0c68e tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:25.333043 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-01cc7488-4f53-43b7-8431-d625dea0c68e tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: 7305c4e9-ae2a-45a8-b175-cd5fcd8324a5] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:25.340438 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-01cc7488-4f53-43b7-8431-d625dea0c68e tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:25.340938 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-01cc7488-4f53-43b7-8431-d625dea0c68e tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:25.341391 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-01cc7488-4f53-43b7-8431-d625dea0c68e tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:25.342117 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-01cc7488-4f53-43b7-8431-d625dea0c68e tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:25.342635 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-01cc7488-4f53-43b7-8431-d625dea0c68e tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:25.343080 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-01cc7488-4f53-43b7-8431-d625dea0c68e tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:25.357783 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.wsgi [None req-01cc7488-4f53-43b7-8431-d625dea0c68e tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] HTTP exception thrown: Instance 7305c4e9-ae2a-45a8-b175-cd5fcd8324a5 could not be found. Oct 04 21:29:25.359512 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-01cc7488-4f53-43b7-8431-d625dea0c68e tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Request method failure captured: Oct 04 21:29:25.359512 n-d-854823-8 devstack@n-api.service[128802]: request: GET /compute/v2.1/servers/7305c4e9-ae2a-45a8-b175-cd5fcd8324a5 HTTP/1.1 Oct 04 21:29:25.359512 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 21:29:25.359512 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 21:29:25.359512 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 21:29:25.359512 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 0 Oct 04 21:29:25.359512 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 21:29:25.359512 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 21:29:25.359512 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 21:29:25.359512 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 21:29:25.359512 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPKMhB36sxHtTwvN5cR_FDx6677Bk3r96uZe9x8RsKj2kP41h8elma4Sfp2Sil3wffnoaQT-coMFt-1I-ubK46x1CIQQbRLJJWc6ISWYT8YHNWLLnEGq51UhoqUKdKybGmNCaSC1unJV9CeCDYPI8cjjYW6_GmoH3684NnCEjfslKtuc Oct 04 21:29:25.359512 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 21:29:25.359512 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 21:29:25.359512 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 21:29:25.359512 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 21:29:25.359512 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 21:29:25.359512 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 21:29:25.359512 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: 0d78e06d720d438a9308ae138902f847 Oct 04 21:29:25.359512 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-TestVolumeBootPattern-1361369473 Oct 04 21:29:25.359512 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 21:29:25.359512 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 21:29:25.359512 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0d78e06d720d438a9308ae138902f847", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0d78e06d720d438a9308ae138902f847"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0d78e06d720d438a9308ae138902f847"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0d78e06d720d438a9308ae138902f847"}]}] Oct 04 21:29:25.359512 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-TestVolumeBootPattern-1361369473 Oct 04 21:29:25.359512 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: 0d78e06d720d438a9308ae138902f847 Oct 04 21:29:25.359512 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-TestVolumeBootPattern-1361369473 Oct 04 21:29:25.359512 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-TestVolumeBootPattern-1361369473-project Oct 04 21:29:25.359512 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 21:29:25.359512 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 21:29:25.359512 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: ad7b0b59fad1429e95591b21e33ccbaa Oct 04 21:29:25.359512 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-TestVolumeBootPattern-1361369473-project Oct 04 21:29:25.359512 n-d-854823-8 devstack@n-api.service[128802]: method: > Oct 04 21:29:25.359512 n-d-854823-8 devstack@n-api.service[128802]: exception: Instance 7305c4e9-ae2a-45a8-b175-cd5fcd8324a5 could not be found. Oct 04 21:29:25.359512 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'id': '7305c4e9-ae2a-45a8-b175-cd5fcd8324a5'} Oct 04 21:29:25.359512 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:29:25.359512 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:29:25.359512 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:29:25.359512 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:29:25.359512 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:29:25.359512 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:29:25.359512 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:29:25.359512 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:29:25.359512 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:29:25.359512 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:29:25.359512 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7305c4e9-ae2a-45a8-b175-cd5fcd8324a5 could not be found. Oct 04 21:29:25.359512 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:29:25.359512 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:29:25.359512 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:29:25.359512 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:29:25.359512 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:29:25.359512 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:29:25.359512 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:29:25.359512 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:29:25.359512 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:29:25.359512 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:29:25.359512 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:29:25.359512 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:29:25.359512 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:29:25.359512 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:29:25.359512 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:29:25.359512 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:29:25.359512 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7305c4e9-ae2a-45a8-b175-cd5fcd8324a5 could not be found. Oct 04 21:29:25.359512 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:29:25.359512 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:29:25.359512 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:29:25.363792 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:29:25.363792 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:29:25.363792 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:29:25.363792 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:29:25.363792 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:29:25.363792 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7305c4e9-ae2a-45a8-b175-cd5fcd8324a5 could not be found. Oct 04 21:29:25.363792 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:29:25.363792 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-01cc7488-4f53-43b7-8431-d625dea0c68e tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Returning 404 to user: Instance 7305c4e9-ae2a-45a8-b175-cd5fcd8324a5 could not be found. {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:29:25.363792 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-01cc7488-4f53-43b7-8431-d625dea0c68e tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/7305c4e9-ae2a-45a8-b175-cd5fcd8324a5" status: 404 len: 111 microversion: 2.1 time: 0.032465 Oct 04 21:29:25.363792 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3196/6357] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:29:25 2022] GET /compute/v2.1/servers/7305c4e9-ae2a-45a8-b175-cd5fcd8324a5 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:29:31.631154 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b9843483-7599-4a5d-8b1b-773905cfa76f tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:31.631644 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b9843483-7599-4a5d-8b1b-773905cfa76f tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: 3f748c89-825a-404e-b257-686f43253bfa] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:31.633751 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-69097a83-6b63-434f-a18f-b7e7acc76ee7 req-ea56f49c-8bce-42e3-81d2-de2eb09ccee3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f748c89-825a-404e-b257-686f43253bfa", "tag": "cdddd896-2598-4cd4-8c83-3c32827b680f"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:29:31.639342 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b9843483-7599-4a5d-8b1b-773905cfa76f tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:31.640533 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b9843483-7599-4a5d-8b1b-773905cfa76f tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:31.641220 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b9843483-7599-4a5d-8b1b-773905cfa76f tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:31.642007 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b9843483-7599-4a5d-8b1b-773905cfa76f tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:31.642573 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b9843483-7599-4a5d-8b1b-773905cfa76f tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:31.643087 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b9843483-7599-4a5d-8b1b-773905cfa76f tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:31.644919 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-69097a83-6b63-434f-a18f-b7e7acc76ee7 req-ea56f49c-8bce-42e3-81d2-de2eb09ccee3 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:31.645418 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-69097a83-6b63-434f-a18f-b7e7acc76ee7 req-ea56f49c-8bce-42e3-81d2-de2eb09ccee3 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:31.645866 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-69097a83-6b63-434f-a18f-b7e7acc76ee7 req-ea56f49c-8bce-42e3-81d2-de2eb09ccee3 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:31.658992 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-69097a83-6b63-434f-a18f-b7e7acc76ee7 req-ea56f49c-8bce-42e3-81d2-de2eb09ccee3 service nova] Creating event network-changed:cdddd896-2598-4cd4-8c83-3c32827b680f for instance 3f748c89-825a-404e-b257-686f43253bfa on n-h2-854823-8 Oct 04 21:29:31.665357 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-69097a83-6b63-434f-a18f-b7e7acc76ee7 req-ea56f49c-8bce-42e3-81d2-de2eb09ccee3 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035445 Oct 04 21:29:31.666061 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3197/6358] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:29:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:29:31.671947 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b9843483-7599-4a5d-8b1b-773905cfa76f tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: 3f748c89-825a-404e-b257-686f43253bfa] Going to try to terminate instance {{(pid=128801) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:29:31.767161 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b9843483-7599-4a5d-8b1b-773905cfa76f tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "DELETE /compute/v2.1/servers/3f748c89-825a-404e-b257-686f43253bfa" status: 204 len: 0 microversion: 2.1 time: 0.139850 Oct 04 21:29:31.768011 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3162/6359] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 21:29:31 2022] DELETE /compute/v2.1/servers/3f748c89-825a-404e-b257-686f43253bfa => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:29:31.777685 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-59c86f6c-c118-4548-a6b5-a5c6e35059b5 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:31.778332 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-59c86f6c-c118-4548-a6b5-a5c6e35059b5 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: 3f748c89-825a-404e-b257-686f43253bfa] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:31.785053 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-59c86f6c-c118-4548-a6b5-a5c6e35059b5 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:31.785596 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-59c86f6c-c118-4548-a6b5-a5c6e35059b5 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:31.786080 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-59c86f6c-c118-4548-a6b5-a5c6e35059b5 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:31.786896 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-59c86f6c-c118-4548-a6b5-a5c6e35059b5 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:31.787428 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-59c86f6c-c118-4548-a6b5-a5c6e35059b5 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:31.787951 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-59c86f6c-c118-4548-a6b5-a5c6e35059b5 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:31.963695 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-59c86f6c-c118-4548-a6b5-a5c6e35059b5 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:31.971904 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-59c86f6c-c118-4548-a6b5-a5c6e35059b5 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/3f748c89-825a-404e-b257-686f43253bfa" status: 200 len: 1576 microversion: 2.1 time: 0.199274 Oct 04 21:29:31.972490 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3198/6360] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:29:31 2022] GET /compute/v2.1/servers/3f748c89-825a-404e-b257-686f43253bfa => generated 1576 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:29:32.997315 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-db174146-6165-4bb3-b856-fda5e6844389 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:32.998022 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-db174146-6165-4bb3-b856-fda5e6844389 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: 3f748c89-825a-404e-b257-686f43253bfa] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:33.005115 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-db174146-6165-4bb3-b856-fda5e6844389 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:33.005604 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-db174146-6165-4bb3-b856-fda5e6844389 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:33.006037 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-db174146-6165-4bb3-b856-fda5e6844389 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:33.006820 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-db174146-6165-4bb3-b856-fda5e6844389 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:33.007302 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-db174146-6165-4bb3-b856-fda5e6844389 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:33.007847 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-db174146-6165-4bb3-b856-fda5e6844389 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:33.185686 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-db174146-6165-4bb3-b856-fda5e6844389 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:33.193619 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-db174146-6165-4bb3-b856-fda5e6844389 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/3f748c89-825a-404e-b257-686f43253bfa" status: 200 len: 1576 microversion: 2.1 time: 0.200705 Oct 04 21:29:33.194229 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3163/6361] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:29:32 2022] GET /compute/v2.1/servers/3f748c89-825a-404e-b257-686f43253bfa => generated 1576 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:29:34.217756 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-c3e4a590-fd0d-40f6-85b3-ce7abca80a36 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:34.218462 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-c3e4a590-fd0d-40f6-85b3-ce7abca80a36 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: 3f748c89-825a-404e-b257-686f43253bfa] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:34.225756 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c3e4a590-fd0d-40f6-85b3-ce7abca80a36 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:34.226268 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c3e4a590-fd0d-40f6-85b3-ce7abca80a36 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:34.226813 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c3e4a590-fd0d-40f6-85b3-ce7abca80a36 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:34.227552 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c3e4a590-fd0d-40f6-85b3-ce7abca80a36 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:34.228027 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c3e4a590-fd0d-40f6-85b3-ce7abca80a36 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:34.228479 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c3e4a590-fd0d-40f6-85b3-ce7abca80a36 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:34.386568 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-c3e4a590-fd0d-40f6-85b3-ce7abca80a36 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:34.403404 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-716133bb-7a1e-480d-ac6f-fed10bd1bc6c req-9c33a814-bd09-4ef5-b6bb-13f1b17390c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f748c89-825a-404e-b257-686f43253bfa", "name": "network-vif-deleted", "tag": "cdddd896-2598-4cd4-8c83-3c32827b680f"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:29:34.411580 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-c3e4a590-fd0d-40f6-85b3-ce7abca80a36 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/3f748c89-825a-404e-b257-686f43253bfa" status: 200 len: 1391 microversion: 2.1 time: 0.197767 Oct 04 21:29:34.414872 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-716133bb-7a1e-480d-ac6f-fed10bd1bc6c req-9c33a814-bd09-4ef5-b6bb-13f1b17390c7 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:34.415352 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-716133bb-7a1e-480d-ac6f-fed10bd1bc6c req-9c33a814-bd09-4ef5-b6bb-13f1b17390c7 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:34.415827 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-716133bb-7a1e-480d-ac6f-fed10bd1bc6c req-9c33a814-bd09-4ef5-b6bb-13f1b17390c7 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:34.426595 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3199/6362] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:29:34 2022] GET /compute/v2.1/servers/3f748c89-825a-404e-b257-686f43253bfa => generated 1391 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:29:34.429909 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-716133bb-7a1e-480d-ac6f-fed10bd1bc6c req-9c33a814-bd09-4ef5-b6bb-13f1b17390c7 service nova] Creating event network-vif-deleted:cdddd896-2598-4cd4-8c83-3c32827b680f for instance 3f748c89-825a-404e-b257-686f43253bfa on n-h2-854823-8 Oct 04 21:29:34.435362 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-716133bb-7a1e-480d-ac6f-fed10bd1bc6c req-9c33a814-bd09-4ef5-b6bb-13f1b17390c7 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035596 Oct 04 21:29:34.436379 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3164/6363] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:29:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:29:35.436962 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-61c45998-3cdb-493b-b1a9-d104cb91f856 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:35.437592 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-61c45998-3cdb-493b-b1a9-d104cb91f856 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: 3f748c89-825a-404e-b257-686f43253bfa] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:35.445437 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-61c45998-3cdb-493b-b1a9-d104cb91f856 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:35.446150 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-61c45998-3cdb-493b-b1a9-d104cb91f856 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:35.446645 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-61c45998-3cdb-493b-b1a9-d104cb91f856 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:35.447374 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-61c45998-3cdb-493b-b1a9-d104cb91f856 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:35.447849 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-61c45998-3cdb-493b-b1a9-d104cb91f856 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:35.448296 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-61c45998-3cdb-493b-b1a9-d104cb91f856 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:35.512031 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-61c45998-3cdb-493b-b1a9-d104cb91f856 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:35.520630 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-61c45998-3cdb-493b-b1a9-d104cb91f856 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/3f748c89-825a-404e-b257-686f43253bfa" status: 200 len: 1225 microversion: 2.1 time: 0.087559 Oct 04 21:29:35.521462 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3200/6364] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:29:35 2022] GET /compute/v2.1/servers/3f748c89-825a-404e-b257-686f43253bfa => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:29:36.545194 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-612911df-8b8e-4ac0-8518-c3c3b4e4c0a8 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:36.545927 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-612911df-8b8e-4ac0-8518-c3c3b4e4c0a8 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: 3f748c89-825a-404e-b257-686f43253bfa] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:36.552354 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-612911df-8b8e-4ac0-8518-c3c3b4e4c0a8 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:36.552840 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-612911df-8b8e-4ac0-8518-c3c3b4e4c0a8 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:36.553283 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-612911df-8b8e-4ac0-8518-c3c3b4e4c0a8 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:36.554165 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-612911df-8b8e-4ac0-8518-c3c3b4e4c0a8 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:36.554777 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-612911df-8b8e-4ac0-8518-c3c3b4e4c0a8 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:36.555270 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-612911df-8b8e-4ac0-8518-c3c3b4e4c0a8 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:36.623121 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-612911df-8b8e-4ac0-8518-c3c3b4e4c0a8 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:36.631150 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-612911df-8b8e-4ac0-8518-c3c3b4e4c0a8 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/3f748c89-825a-404e-b257-686f43253bfa" status: 200 len: 1225 microversion: 2.1 time: 0.091124 Oct 04 21:29:36.632280 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3165/6365] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:29:36 2022] GET /compute/v2.1/servers/3f748c89-825a-404e-b257-686f43253bfa => generated 1225 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:29:37.655521 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-afd0e12e-0ca8-4f36-b384-0c6b23fd71db tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:37.656172 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-afd0e12e-0ca8-4f36-b384-0c6b23fd71db tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: 3f748c89-825a-404e-b257-686f43253bfa] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:37.664806 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-afd0e12e-0ca8-4f36-b384-0c6b23fd71db tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:37.665327 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-afd0e12e-0ca8-4f36-b384-0c6b23fd71db tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:37.665779 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-afd0e12e-0ca8-4f36-b384-0c6b23fd71db tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:37.666589 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-afd0e12e-0ca8-4f36-b384-0c6b23fd71db tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:37.667065 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-afd0e12e-0ca8-4f36-b384-0c6b23fd71db tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:37.667509 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-afd0e12e-0ca8-4f36-b384-0c6b23fd71db tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:37.735544 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-afd0e12e-0ca8-4f36-b384-0c6b23fd71db tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:37.744016 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-afd0e12e-0ca8-4f36-b384-0c6b23fd71db tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/3f748c89-825a-404e-b257-686f43253bfa" status: 200 len: 1225 microversion: 2.1 time: 0.092690 Oct 04 21:29:37.744602 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3201/6366] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:29:37 2022] GET /compute/v2.1/servers/3f748c89-825a-404e-b257-686f43253bfa => generated 1225 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:29:38.766593 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6436bd7b-c617-447d-9aa8-559871dc1400 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:38.767775 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-6436bd7b-c617-447d-9aa8-559871dc1400 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: 3f748c89-825a-404e-b257-686f43253bfa] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:38.775237 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6436bd7b-c617-447d-9aa8-559871dc1400 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:38.775720 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6436bd7b-c617-447d-9aa8-559871dc1400 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:38.776146 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6436bd7b-c617-447d-9aa8-559871dc1400 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:38.776846 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6436bd7b-c617-447d-9aa8-559871dc1400 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:38.777291 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6436bd7b-c617-447d-9aa8-559871dc1400 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:38.777719 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6436bd7b-c617-447d-9aa8-559871dc1400 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:38.810369 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6436bd7b-c617-447d-9aa8-559871dc1400 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:38.810856 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6436bd7b-c617-447d-9aa8-559871dc1400 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:38.811585 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6436bd7b-c617-447d-9aa8-559871dc1400 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:38.812042 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-6436bd7b-c617-447d-9aa8-559871dc1400 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lazy-loading 'fault' on Instance uuid 3f748c89-825a-404e-b257-686f43253bfa {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:29:38.855570 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-6436bd7b-c617-447d-9aa8-559871dc1400 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7b0b59fad1429e95591b21e33ccbaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d78e06d720d438a9308ae138902f847', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:29:38.863712 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-6436bd7b-c617-447d-9aa8-559871dc1400 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/3f748c89-825a-404e-b257-686f43253bfa" status: 200 len: 1230 microversion: 2.1 time: 0.100985 Oct 04 21:29:38.864292 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3166/6367] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:29:38 2022] GET /compute/v2.1/servers/3f748c89-825a-404e-b257-686f43253bfa => generated 1230 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:29:39.889235 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-4c1b6c82-1571-463f-9e64-0b5e9754367a tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:39.889804 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-4c1b6c82-1571-463f-9e64-0b5e9754367a tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: 3f748c89-825a-404e-b257-686f43253bfa] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:39.896679 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4c1b6c82-1571-463f-9e64-0b5e9754367a tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:39.897199 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4c1b6c82-1571-463f-9e64-0b5e9754367a tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:39.897994 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4c1b6c82-1571-463f-9e64-0b5e9754367a tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:39.898809 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4c1b6c82-1571-463f-9e64-0b5e9754367a tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:39.899286 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4c1b6c82-1571-463f-9e64-0b5e9754367a tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:39.899733 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4c1b6c82-1571-463f-9e64-0b5e9754367a tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:39.913428 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.wsgi [None req-4c1b6c82-1571-463f-9e64-0b5e9754367a tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] HTTP exception thrown: Instance 3f748c89-825a-404e-b257-686f43253bfa could not be found. Oct 04 21:29:39.915238 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-4c1b6c82-1571-463f-9e64-0b5e9754367a tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Request method failure captured: Oct 04 21:29:39.915238 n-d-854823-8 devstack@n-api.service[128802]: request: GET /compute/v2.1/servers/3f748c89-825a-404e-b257-686f43253bfa HTTP/1.1 Oct 04 21:29:39.915238 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 21:29:39.915238 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 21:29:39.915238 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 21:29:39.915238 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 0 Oct 04 21:29:39.915238 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 21:29:39.915238 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 21:29:39.915238 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 21:29:39.915238 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 21:29:39.915238 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPKMhB36sxHtTwvN5cR_FDx6677Bk3r96uZe9x8RsKj2kP41h8elma4Sfp2Sil3wffnoaQT-coMFt-1I-ubK46x1CIQQbRLJJWc6ISWYT8YHNWLLnEGq51UhoqUKdKybGmNCaSC1unJV9CeCDYPI8cjjYW6_GmoH3684NnCEjfslKtuc Oct 04 21:29:39.915238 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 21:29:39.915238 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 21:29:39.915238 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 21:29:39.915238 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 21:29:39.915238 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 21:29:39.915238 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 21:29:39.915238 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: 0d78e06d720d438a9308ae138902f847 Oct 04 21:29:39.915238 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-TestVolumeBootPattern-1361369473 Oct 04 21:29:39.915238 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 21:29:39.915238 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 21:29:39.915238 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0d78e06d720d438a9308ae138902f847", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0d78e06d720d438a9308ae138902f847"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0d78e06d720d438a9308ae138902f847"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0d78e06d720d438a9308ae138902f847"}]}] Oct 04 21:29:39.915238 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-TestVolumeBootPattern-1361369473 Oct 04 21:29:39.915238 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: 0d78e06d720d438a9308ae138902f847 Oct 04 21:29:39.915238 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-TestVolumeBootPattern-1361369473 Oct 04 21:29:39.915238 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-TestVolumeBootPattern-1361369473-project Oct 04 21:29:39.915238 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 21:29:39.915238 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 21:29:39.915238 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: ad7b0b59fad1429e95591b21e33ccbaa Oct 04 21:29:39.915238 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-TestVolumeBootPattern-1361369473-project Oct 04 21:29:39.915238 n-d-854823-8 devstack@n-api.service[128802]: method: > Oct 04 21:29:39.915238 n-d-854823-8 devstack@n-api.service[128802]: exception: Instance 3f748c89-825a-404e-b257-686f43253bfa could not be found. Oct 04 21:29:39.915238 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'id': '3f748c89-825a-404e-b257-686f43253bfa'} Oct 04 21:29:39.915238 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:29:39.915238 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:29:39.915238 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:29:39.915238 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:29:39.915238 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:29:39.915238 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:29:39.915238 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:29:39.915238 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:29:39.915238 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:29:39.915238 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:29:39.915238 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f748c89-825a-404e-b257-686f43253bfa could not be found. Oct 04 21:29:39.915238 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:29:39.915238 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:29:39.915238 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:29:39.915238 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:29:39.915238 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:29:39.915238 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:29:39.915238 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:29:39.915238 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:29:39.915238 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:29:39.915238 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:29:39.915238 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:29:39.915238 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:29:39.915238 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:29:39.915238 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:29:39.915238 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:29:39.915238 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:29:39.915238 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f748c89-825a-404e-b257-686f43253bfa could not be found. Oct 04 21:29:39.915238 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:29:39.915238 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:29:39.915238 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:29:39.920479 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:29:39.920479 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:29:39.920479 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:29:39.920479 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:29:39.920479 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:29:39.920479 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f748c89-825a-404e-b257-686f43253bfa could not be found. Oct 04 21:29:39.920479 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:29:39.920479 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-4c1b6c82-1571-463f-9e64-0b5e9754367a tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Returning 404 to user: Instance 3f748c89-825a-404e-b257-686f43253bfa could not be found. {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:29:39.920479 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-4c1b6c82-1571-463f-9e64-0b5e9754367a tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/3f748c89-825a-404e-b257-686f43253bfa" status: 404 len: 111 microversion: 2.1 time: 0.031650 Oct 04 21:29:39.920479 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3202/6368] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:29:39 2022] GET /compute/v2.1/servers/3f748c89-825a-404e-b257-686f43253bfa => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:29:40.422643 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-18621492-3cbd-4413-8cd7-f90f44ba4103 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:40.423489 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-18621492-3cbd-4413-8cd7-f90f44ba4103 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: 7f4b4cbe-49ef-4490-9b41-3d9802916b8a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:40.433525 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-18621492-3cbd-4413-8cd7-f90f44ba4103 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:40.434358 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-18621492-3cbd-4413-8cd7-f90f44ba4103 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:40.434938 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-18621492-3cbd-4413-8cd7-f90f44ba4103 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:40.435639 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-18621492-3cbd-4413-8cd7-f90f44ba4103 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:40.436334 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-18621492-3cbd-4413-8cd7-f90f44ba4103 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:40.437121 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-18621492-3cbd-4413-8cd7-f90f44ba4103 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:40.458555 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-18621492-3cbd-4413-8cd7-f90f44ba4103 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] HTTP exception thrown: Instance 7f4b4cbe-49ef-4490-9b41-3d9802916b8a could not be found. Oct 04 21:29:40.460371 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-18621492-3cbd-4413-8cd7-f90f44ba4103 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Request method failure captured: Oct 04 21:29:40.460371 n-d-854823-8 devstack@n-api.service[128801]: request: DELETE /compute/v2.1/servers/7f4b4cbe-49ef-4490-9b41-3d9802916b8a HTTP/1.1 Oct 04 21:29:40.460371 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 21:29:40.460371 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 21:29:40.460371 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 21:29:40.460371 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 0 Oct 04 21:29:40.460371 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 21:29:40.460371 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 21:29:40.460371 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 21:29:40.460371 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 21:29:40.460371 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPKMhB36sxHtTwvN5cR_FDx6677Bk3r96uZe9x8RsKj2kP41h8elma4Sfp2Sil3wffnoaQT-coMFt-1I-ubK46x1CIQQbRLJJWc6ISWYT8YHNWLLnEGq51UhoqUKdKybGmNCaSC1unJV9CeCDYPI8cjjYW6_GmoH3684NnCEjfslKtuc Oct 04 21:29:40.460371 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 21:29:40.460371 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 21:29:40.460371 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 21:29:40.460371 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 21:29:40.460371 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 21:29:40.460371 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 21:29:40.460371 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: 0d78e06d720d438a9308ae138902f847 Oct 04 21:29:40.460371 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-TestVolumeBootPattern-1361369473 Oct 04 21:29:40.460371 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 21:29:40.460371 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 21:29:40.460371 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0d78e06d720d438a9308ae138902f847", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0d78e06d720d438a9308ae138902f847"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0d78e06d720d438a9308ae138902f847"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0d78e06d720d438a9308ae138902f847"}]}] Oct 04 21:29:40.460371 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-TestVolumeBootPattern-1361369473 Oct 04 21:29:40.460371 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: 0d78e06d720d438a9308ae138902f847 Oct 04 21:29:40.460371 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-TestVolumeBootPattern-1361369473 Oct 04 21:29:40.460371 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-TestVolumeBootPattern-1361369473-project Oct 04 21:29:40.460371 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 21:29:40.460371 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 21:29:40.460371 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: ad7b0b59fad1429e95591b21e33ccbaa Oct 04 21:29:40.460371 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-TestVolumeBootPattern-1361369473-project Oct 04 21:29:40.460371 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 21:29:40.460371 n-d-854823-8 devstack@n-api.service[128801]: exception: Instance 7f4b4cbe-49ef-4490-9b41-3d9802916b8a could not be found. Oct 04 21:29:40.460371 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': '7f4b4cbe-49ef-4490-9b41-3d9802916b8a'} Oct 04 21:29:40.460371 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:29:40.460371 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:29:40.460371 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:29:40.460371 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:29:40.460371 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:29:40.460371 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:29:40.460371 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:29:40.460371 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:29:40.460371 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:29:40.460371 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:29:40.460371 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f4b4cbe-49ef-4490-9b41-3d9802916b8a could not be found. Oct 04 21:29:40.460371 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:29:40.460371 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:29:40.460371 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:29:40.460371 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:29:40.460371 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:29:40.460371 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:29:40.460371 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:29:40.460371 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:29:40.460371 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:29:40.460371 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:29:40.460371 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 21:29:40.460371 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 21:29:40.460371 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 21:29:40.460371 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 21:29:40.460371 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:29:40.460371 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:29:40.460371 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:29:40.460371 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:29:40.464444 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f4b4cbe-49ef-4490-9b41-3d9802916b8a could not be found. Oct 04 21:29:40.464444 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:29:40.464444 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:29:40.464444 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:29:40.464444 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:29:40.464444 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:29:40.464444 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:29:40.464444 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:29:40.464444 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:29:40.464444 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f4b4cbe-49ef-4490-9b41-3d9802916b8a could not be found. Oct 04 21:29:40.464444 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:29:40.464444 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-18621492-3cbd-4413-8cd7-f90f44ba4103 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Returning 404 to user: Instance 7f4b4cbe-49ef-4490-9b41-3d9802916b8a could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:29:40.464444 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-18621492-3cbd-4413-8cd7-f90f44ba4103 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "DELETE /compute/v2.1/servers/7f4b4cbe-49ef-4490-9b41-3d9802916b8a" status: 404 len: 111 microversion: 2.1 time: 0.045397 Oct 04 21:29:40.464444 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3167/6369] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 21:29:40 2022] DELETE /compute/v2.1/servers/7f4b4cbe-49ef-4490-9b41-3d9802916b8a => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:29:40.470809 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-00881b80-3a82-4074-a8b0-85109e2d948d tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:40.471452 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-00881b80-3a82-4074-a8b0-85109e2d948d tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] [instance: 7f4b4cbe-49ef-4490-9b41-3d9802916b8a] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:29:40.478002 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-00881b80-3a82-4074-a8b0-85109e2d948d tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:40.478539 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-00881b80-3a82-4074-a8b0-85109e2d948d tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:40.478999 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-00881b80-3a82-4074-a8b0-85109e2d948d tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:40.479722 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-00881b80-3a82-4074-a8b0-85109e2d948d tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:29:40.480196 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-00881b80-3a82-4074-a8b0-85109e2d948d tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:29:40.480640 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-00881b80-3a82-4074-a8b0-85109e2d948d tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:29:40.499030 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.wsgi [None req-00881b80-3a82-4074-a8b0-85109e2d948d tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] HTTP exception thrown: Instance 7f4b4cbe-49ef-4490-9b41-3d9802916b8a could not be found. Oct 04 21:29:40.500603 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-00881b80-3a82-4074-a8b0-85109e2d948d tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Request method failure captured: Oct 04 21:29:40.500603 n-d-854823-8 devstack@n-api.service[128802]: request: GET /compute/v2.1/servers/7f4b4cbe-49ef-4490-9b41-3d9802916b8a HTTP/1.1 Oct 04 21:29:40.500603 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 21:29:40.500603 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 21:29:40.500603 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 21:29:40.500603 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 0 Oct 04 21:29:40.500603 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 21:29:40.500603 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 21:29:40.500603 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 21:29:40.500603 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 21:29:40.500603 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPKMhB36sxHtTwvN5cR_FDx6677Bk3r96uZe9x8RsKj2kP41h8elma4Sfp2Sil3wffnoaQT-coMFt-1I-ubK46x1CIQQbRLJJWc6ISWYT8YHNWLLnEGq51UhoqUKdKybGmNCaSC1unJV9CeCDYPI8cjjYW6_GmoH3684NnCEjfslKtuc Oct 04 21:29:40.500603 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 21:29:40.500603 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 21:29:40.500603 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 21:29:40.500603 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 21:29:40.500603 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 21:29:40.500603 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 21:29:40.500603 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: 0d78e06d720d438a9308ae138902f847 Oct 04 21:29:40.500603 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-TestVolumeBootPattern-1361369473 Oct 04 21:29:40.500603 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 21:29:40.500603 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 21:29:40.500603 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0d78e06d720d438a9308ae138902f847", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0d78e06d720d438a9308ae138902f847"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0d78e06d720d438a9308ae138902f847"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0d78e06d720d438a9308ae138902f847"}]}] Oct 04 21:29:40.500603 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-TestVolumeBootPattern-1361369473 Oct 04 21:29:40.500603 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: 0d78e06d720d438a9308ae138902f847 Oct 04 21:29:40.500603 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-TestVolumeBootPattern-1361369473 Oct 04 21:29:40.500603 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-TestVolumeBootPattern-1361369473-project Oct 04 21:29:40.500603 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 21:29:40.500603 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 21:29:40.500603 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: ad7b0b59fad1429e95591b21e33ccbaa Oct 04 21:29:40.500603 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-TestVolumeBootPattern-1361369473-project Oct 04 21:29:40.500603 n-d-854823-8 devstack@n-api.service[128802]: method: > Oct 04 21:29:40.500603 n-d-854823-8 devstack@n-api.service[128802]: exception: Instance 7f4b4cbe-49ef-4490-9b41-3d9802916b8a could not be found. Oct 04 21:29:40.500603 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'id': '7f4b4cbe-49ef-4490-9b41-3d9802916b8a'} Oct 04 21:29:40.500603 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:29:40.500603 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:29:40.500603 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:29:40.500603 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:29:40.500603 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:29:40.500603 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:29:40.500603 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:29:40.500603 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:29:40.500603 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:29:40.500603 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:29:40.500603 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f4b4cbe-49ef-4490-9b41-3d9802916b8a could not be found. Oct 04 21:29:40.500603 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:29:40.500603 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:29:40.500603 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:29:40.500603 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:29:40.500603 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:29:40.500603 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:29:40.500603 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:29:40.500603 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:29:40.500603 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:29:40.500603 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:29:40.500603 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:29:40.500603 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:29:40.500603 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:29:40.500603 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:29:40.500603 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:29:40.500603 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:29:40.500603 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f4b4cbe-49ef-4490-9b41-3d9802916b8a could not be found. Oct 04 21:29:40.500603 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:29:40.500603 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:29:40.500603 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:29:40.504934 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:29:40.504934 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:29:40.504934 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:29:40.504934 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:29:40.504934 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:29:40.504934 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f4b4cbe-49ef-4490-9b41-3d9802916b8a could not be found. Oct 04 21:29:40.504934 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:29:40.504934 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-00881b80-3a82-4074-a8b0-85109e2d948d tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Returning 404 to user: Instance 7f4b4cbe-49ef-4490-9b41-3d9802916b8a could not be found. {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:29:40.504934 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-00881b80-3a82-4074-a8b0-85109e2d948d tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "GET /compute/v2.1/servers/7f4b4cbe-49ef-4490-9b41-3d9802916b8a" status: 404 len: 111 microversion: 2.1 time: 0.035305 Oct 04 21:29:40.504934 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3203/6370] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:29:40 2022] GET /compute/v2.1/servers/7f4b4cbe-49ef-4490-9b41-3d9802916b8a => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:29:43.946071 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-618b10ca-8b88-4d30-94f8-f6c2f8612a54 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] Calling method '.version_select at 0x7f3c6ee8dc10>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:29:43.977917 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-618b10ca-8b88-4d30-94f8-f6c2f8612a54 tempest-TestVolumeBootPattern-1361369473 tempest-TestVolumeBootPattern-1361369473-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1556253219" status: 202 len: 0 microversion: 2.1 time: 0.036414 Oct 04 21:29:43.982731 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3168/6371] 10.222.0.33 () {58 vars in 1263 bytes} [Tue Oct 4 21:29:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1556253219 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:30:02.601325 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_api:SELECT=26 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:30:02.602227 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=54 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:30:02.718086 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-ee876868-e7e7-4a36-99f1-bfec89cd9256 tempest-ServersAdminNegativeTestJSON-1469067030 tempest-ServersAdminNegativeTestJSON-1469067030-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1179776324", "imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63", "flavorRef": "452"}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:30:02.955574 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.network.neutron [None req-ee876868-e7e7-4a36-99f1-bfec89cd9256 tempest-ServersAdminNegativeTestJSON-1469067030 tempest-ServersAdminNegativeTestJSON-1469067030-project] validate_networks() for None {{(pid=128802) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:30:03.168254 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-ee876868-e7e7-4a36-99f1-bfec89cd9256 tempest-ServersAdminNegativeTestJSON-1469067030 tempest-ServersAdminNegativeTestJSON-1469067030-project] Flavor limits 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:30:03.168682 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-ee876868-e7e7-4a36-99f1-bfec89cd9256 tempest-ServersAdminNegativeTestJSON-1469067030 tempest-ServersAdminNegativeTestJSON-1469067030-project] Image limits 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:30:03.169165 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-ee876868-e7e7-4a36-99f1-bfec89cd9256 tempest-ServersAdminNegativeTestJSON-1469067030 tempest-ServersAdminNegativeTestJSON-1469067030-project] Flavor pref 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:30:03.169591 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-ee876868-e7e7-4a36-99f1-bfec89cd9256 tempest-ServersAdminNegativeTestJSON-1469067030 tempest-ServersAdminNegativeTestJSON-1469067030-project] Image pref 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:30:03.170024 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-ee876868-e7e7-4a36-99f1-bfec89cd9256 tempest-ServersAdminNegativeTestJSON-1469067030 tempest-ServersAdminNegativeTestJSON-1469067030-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:30:03.182571 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ee876868-e7e7-4a36-99f1-bfec89cd9256 tempest-ServersAdminNegativeTestJSON-1469067030 tempest-ServersAdminNegativeTestJSON-1469067030-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:03.183070 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ee876868-e7e7-4a36-99f1-bfec89cd9256 tempest-ServersAdminNegativeTestJSON-1469067030 tempest-ServersAdminNegativeTestJSON-1469067030-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:03.183519 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ee876868-e7e7-4a36-99f1-bfec89cd9256 tempest-ServersAdminNegativeTestJSON-1469067030 tempest-ServersAdminNegativeTestJSON-1469067030-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:03.184282 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ee876868-e7e7-4a36-99f1-bfec89cd9256 tempest-ServersAdminNegativeTestJSON-1469067030 tempest-ServersAdminNegativeTestJSON-1469067030-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:03.184753 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ee876868-e7e7-4a36-99f1-bfec89cd9256 tempest-ServersAdminNegativeTestJSON-1469067030 tempest-ServersAdminNegativeTestJSON-1469067030-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:03.185194 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ee876868-e7e7-4a36-99f1-bfec89cd9256 tempest-ServersAdminNegativeTestJSON-1469067030 tempest-ServersAdminNegativeTestJSON-1469067030-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:03.205185 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-ee876868-e7e7-4a36-99f1-bfec89cd9256 tempest-ServersAdminNegativeTestJSON-1469067030 tempest-ServersAdminNegativeTestJSON-1469067030-project] Getting quotas for project ada14314366d4e548e8ab945840e7cd1. Resources: {'ram', 'instances', 'cores'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:30:03.211759 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-ee876868-e7e7-4a36-99f1-bfec89cd9256 tempest-ServersAdminNegativeTestJSON-1469067030 tempest-ServersAdminNegativeTestJSON-1469067030-project] Getting quotas for user bcdcbe3585524e77b1893c97b3b6a364 and project ada14314366d4e548e8ab945840e7cd1. Resources: {'ram', 'instances', 'cores'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:30:03.226249 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-ee876868-e7e7-4a36-99f1-bfec89cd9256 tempest-ServersAdminNegativeTestJSON-1469067030 tempest-ServersAdminNegativeTestJSON-1469067030-project] Going to run 1 instances... {{(pid=128802) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:30:03.228622 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-ee876868-e7e7-4a36-99f1-bfec89cd9256 tempest-ServersAdminNegativeTestJSON-1469067030 tempest-ServersAdminNegativeTestJSON-1469067030-project] [instance: 93050da6-597e-4924-93bf-35295c1ba9e4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='15b24725-0c99-4bcf-b1fb-907cdf8e2d63',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128802) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:30:03.277511 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-ee876868-e7e7-4a36-99f1-bfec89cd9256 tempest-ServersAdminNegativeTestJSON-1469067030 tempest-ServersAdminNegativeTestJSON-1469067030-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.681282 Oct 04 21:30:03.278212 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3204/6372] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 21:30:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 683 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:30:03.291736 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-3f9a26f9-1b3b-4ecd-9237-30b0dbb71929 tempest-ServersAdminNegativeTestJSON-1469067030 tempest-ServersAdminNegativeTestJSON-1469067030-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:03.292460 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-3f9a26f9-1b3b-4ecd-9237-30b0dbb71929 tempest-ServersAdminNegativeTestJSON-1469067030 tempest-ServersAdminNegativeTestJSON-1469067030-project] [instance: 93050da6-597e-4924-93bf-35295c1ba9e4] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:03.294664 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:30:03.295416 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:30:03.472503 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-3f9a26f9-1b3b-4ecd-9237-30b0dbb71929 tempest-ServersAdminNegativeTestJSON-1469067030 tempest-ServersAdminNegativeTestJSON-1469067030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcdcbe3585524e77b1893c97b3b6a364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada14314366d4e548e8ab945840e7cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:03.480420 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-3f9a26f9-1b3b-4ecd-9237-30b0dbb71929 tempest-ServersAdminNegativeTestJSON-1469067030 tempest-ServersAdminNegativeTestJSON-1469067030-project] 10.222.0.33 "GET /compute/v2.1/servers/93050da6-597e-4924-93bf-35295c1ba9e4" status: 200 len: 1222 microversion: 2.1 time: 0.193523 Oct 04 21:30:03.480989 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3169/6373] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:30:03 2022] GET /compute/v2.1/servers/93050da6-597e-4924-93bf-35295c1ba9e4 => generated 1222 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:30:04.506468 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-f71d0303-753c-49ea-8789-694fbcc6295b tempest-ServersAdminNegativeTestJSON-1469067030 tempest-ServersAdminNegativeTestJSON-1469067030-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:04.507497 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-f71d0303-753c-49ea-8789-694fbcc6295b tempest-ServersAdminNegativeTestJSON-1469067030 tempest-ServersAdminNegativeTestJSON-1469067030-project] [instance: 93050da6-597e-4924-93bf-35295c1ba9e4] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:04.579757 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-f71d0303-753c-49ea-8789-694fbcc6295b tempest-ServersAdminNegativeTestJSON-1469067030 tempest-ServersAdminNegativeTestJSON-1469067030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcdcbe3585524e77b1893c97b3b6a364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada14314366d4e548e8ab945840e7cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:04.590147 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-f71d0303-753c-49ea-8789-694fbcc6295b tempest-ServersAdminNegativeTestJSON-1469067030 tempest-ServersAdminNegativeTestJSON-1469067030-project] 10.222.0.33 "GET /compute/v2.1/servers/93050da6-597e-4924-93bf-35295c1ba9e4" status: 200 len: 1222 microversion: 2.1 time: 0.089172 Oct 04 21:30:04.590774 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3205/6374] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:30:04 2022] GET /compute/v2.1/servers/93050da6-597e-4924-93bf-35295c1ba9e4 => generated 1222 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:30:05.617437 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d7225bce-09ae-405b-82d8-6b5acdf0380e tempest-ServersAdminNegativeTestJSON-1469067030 tempest-ServersAdminNegativeTestJSON-1469067030-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:05.617437 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d7225bce-09ae-405b-82d8-6b5acdf0380e tempest-ServersAdminNegativeTestJSON-1469067030 tempest-ServersAdminNegativeTestJSON-1469067030-project] [instance: 93050da6-597e-4924-93bf-35295c1ba9e4] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:05.676215 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d7225bce-09ae-405b-82d8-6b5acdf0380e tempest-ServersAdminNegativeTestJSON-1469067030 tempest-ServersAdminNegativeTestJSON-1469067030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcdcbe3585524e77b1893c97b3b6a364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada14314366d4e548e8ab945840e7cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:05.686579 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d7225bce-09ae-405b-82d8-6b5acdf0380e tempest-ServersAdminNegativeTestJSON-1469067030 tempest-ServersAdminNegativeTestJSON-1469067030-project] 10.222.0.33 "GET /compute/v2.1/servers/93050da6-597e-4924-93bf-35295c1ba9e4" status: 200 len: 1222 microversion: 2.1 time: 0.075844 Oct 04 21:30:05.687719 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3170/6375] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:30:05 2022] GET /compute/v2.1/servers/93050da6-597e-4924-93bf-35295c1ba9e4 => generated 1222 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:30:06.712495 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-0fbae053-46f2-4edf-8f53-2aab9938023f tempest-ServersAdminNegativeTestJSON-1469067030 tempest-ServersAdminNegativeTestJSON-1469067030-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:06.713156 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-0fbae053-46f2-4edf-8f53-2aab9938023f tempest-ServersAdminNegativeTestJSON-1469067030 tempest-ServersAdminNegativeTestJSON-1469067030-project] [instance: 93050da6-597e-4924-93bf-35295c1ba9e4] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:06.721039 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0fbae053-46f2-4edf-8f53-2aab9938023f tempest-ServersAdminNegativeTestJSON-1469067030 tempest-ServersAdminNegativeTestJSON-1469067030-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:06.721619 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0fbae053-46f2-4edf-8f53-2aab9938023f tempest-ServersAdminNegativeTestJSON-1469067030 tempest-ServersAdminNegativeTestJSON-1469067030-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:06.722059 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0fbae053-46f2-4edf-8f53-2aab9938023f tempest-ServersAdminNegativeTestJSON-1469067030 tempest-ServersAdminNegativeTestJSON-1469067030-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:06.722819 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0fbae053-46f2-4edf-8f53-2aab9938023f tempest-ServersAdminNegativeTestJSON-1469067030 tempest-ServersAdminNegativeTestJSON-1469067030-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:06.723300 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0fbae053-46f2-4edf-8f53-2aab9938023f tempest-ServersAdminNegativeTestJSON-1469067030 tempest-ServersAdminNegativeTestJSON-1469067030-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:06.723749 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0fbae053-46f2-4edf-8f53-2aab9938023f tempest-ServersAdminNegativeTestJSON-1469067030 tempest-ServersAdminNegativeTestJSON-1469067030-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:06.794542 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-0fbae053-46f2-4edf-8f53-2aab9938023f tempest-ServersAdminNegativeTestJSON-1469067030 tempest-ServersAdminNegativeTestJSON-1469067030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcdcbe3585524e77b1893c97b3b6a364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada14314366d4e548e8ab945840e7cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:06.802485 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-0fbae053-46f2-4edf-8f53-2aab9938023f tempest-ServersAdminNegativeTestJSON-1469067030 tempest-ServersAdminNegativeTestJSON-1469067030-project] 10.222.0.33 "GET /compute/v2.1/servers/93050da6-597e-4924-93bf-35295c1ba9e4" status: 200 len: 1280 microversion: 2.1 time: 0.094264 Oct 04 21:30:06.803930 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3206/6376] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:30:06 2022] GET /compute/v2.1/servers/93050da6-597e-4924-93bf-35295c1ba9e4 => generated 1280 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:30:07.827089 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ba5ecdbf-9663-4422-8ed1-efdcafe4327d tempest-ServersAdminNegativeTestJSON-1469067030 tempest-ServersAdminNegativeTestJSON-1469067030-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:07.827702 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ba5ecdbf-9663-4422-8ed1-efdcafe4327d tempest-ServersAdminNegativeTestJSON-1469067030 tempest-ServersAdminNegativeTestJSON-1469067030-project] [instance: 93050da6-597e-4924-93bf-35295c1ba9e4] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:07.835622 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ba5ecdbf-9663-4422-8ed1-efdcafe4327d tempest-ServersAdminNegativeTestJSON-1469067030 tempest-ServersAdminNegativeTestJSON-1469067030-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:07.836159 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ba5ecdbf-9663-4422-8ed1-efdcafe4327d tempest-ServersAdminNegativeTestJSON-1469067030 tempest-ServersAdminNegativeTestJSON-1469067030-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:07.836647 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ba5ecdbf-9663-4422-8ed1-efdcafe4327d tempest-ServersAdminNegativeTestJSON-1469067030 tempest-ServersAdminNegativeTestJSON-1469067030-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:07.837423 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ba5ecdbf-9663-4422-8ed1-efdcafe4327d tempest-ServersAdminNegativeTestJSON-1469067030 tempest-ServersAdminNegativeTestJSON-1469067030-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:07.837880 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ba5ecdbf-9663-4422-8ed1-efdcafe4327d tempest-ServersAdminNegativeTestJSON-1469067030 tempest-ServersAdminNegativeTestJSON-1469067030-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:07.838311 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ba5ecdbf-9663-4422-8ed1-efdcafe4327d tempest-ServersAdminNegativeTestJSON-1469067030 tempest-ServersAdminNegativeTestJSON-1469067030-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:08.377391 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-ba5ecdbf-9663-4422-8ed1-efdcafe4327d tempest-ServersAdminNegativeTestJSON-1469067030 tempest-ServersAdminNegativeTestJSON-1469067030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcdcbe3585524e77b1893c97b3b6a364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada14314366d4e548e8ab945840e7cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:08.385501 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ba5ecdbf-9663-4422-8ed1-efdcafe4327d tempest-ServersAdminNegativeTestJSON-1469067030 tempest-ServersAdminNegativeTestJSON-1469067030-project] 10.222.0.33 "GET /compute/v2.1/servers/93050da6-597e-4924-93bf-35295c1ba9e4" status: 200 len: 1322 microversion: 2.1 time: 0.562212 Oct 04 21:30:08.386091 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3171/6377] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:30:07 2022] GET /compute/v2.1/servers/93050da6-597e-4924-93bf-35295c1ba9e4 => generated 1322 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:30:08.543612 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-1f1e6b14-954a-4047-bbc8-b35c6c8093d4 req-b31bcc2d-a078-465a-b010-10aa8d6dbcbe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93050da6-597e-4924-93bf-35295c1ba9e4", "tag": "2cf6b969-4206-4b9c-aceb-1bc803ae0c6f"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:30:08.555219 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-1f1e6b14-954a-4047-bbc8-b35c6c8093d4 req-b31bcc2d-a078-465a-b010-10aa8d6dbcbe service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:08.555721 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-1f1e6b14-954a-4047-bbc8-b35c6c8093d4 req-b31bcc2d-a078-465a-b010-10aa8d6dbcbe service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:08.556431 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-1f1e6b14-954a-4047-bbc8-b35c6c8093d4 req-b31bcc2d-a078-465a-b010-10aa8d6dbcbe service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:08.568866 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-1f1e6b14-954a-4047-bbc8-b35c6c8093d4 req-b31bcc2d-a078-465a-b010-10aa8d6dbcbe service nova] Creating event network-changed:2cf6b969-4206-4b9c-aceb-1bc803ae0c6f for instance 93050da6-597e-4924-93bf-35295c1ba9e4 on n-h2-854823-8 Oct 04 21:30:08.576207 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-1f1e6b14-954a-4047-bbc8-b35c6c8093d4 req-b31bcc2d-a078-465a-b010-10aa8d6dbcbe service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037078 Oct 04 21:30:08.576830 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3207/6378] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:30:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:30:09.410828 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1f28d0ed-7055-443f-baf6-562ee9f38446 tempest-ServersAdminNegativeTestJSON-1469067030 tempest-ServersAdminNegativeTestJSON-1469067030-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:09.411450 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-1f28d0ed-7055-443f-baf6-562ee9f38446 tempest-ServersAdminNegativeTestJSON-1469067030 tempest-ServersAdminNegativeTestJSON-1469067030-project] [instance: 93050da6-597e-4924-93bf-35295c1ba9e4] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:09.419382 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1f28d0ed-7055-443f-baf6-562ee9f38446 tempest-ServersAdminNegativeTestJSON-1469067030 tempest-ServersAdminNegativeTestJSON-1469067030-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:09.419898 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1f28d0ed-7055-443f-baf6-562ee9f38446 tempest-ServersAdminNegativeTestJSON-1469067030 tempest-ServersAdminNegativeTestJSON-1469067030-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:09.420344 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1f28d0ed-7055-443f-baf6-562ee9f38446 tempest-ServersAdminNegativeTestJSON-1469067030 tempest-ServersAdminNegativeTestJSON-1469067030-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:09.421043 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1f28d0ed-7055-443f-baf6-562ee9f38446 tempest-ServersAdminNegativeTestJSON-1469067030 tempest-ServersAdminNegativeTestJSON-1469067030-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:09.421502 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1f28d0ed-7055-443f-baf6-562ee9f38446 tempest-ServersAdminNegativeTestJSON-1469067030 tempest-ServersAdminNegativeTestJSON-1469067030-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:09.421955 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1f28d0ed-7055-443f-baf6-562ee9f38446 tempest-ServersAdminNegativeTestJSON-1469067030 tempest-ServersAdminNegativeTestJSON-1469067030-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:09.551539 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-1f28d0ed-7055-443f-baf6-562ee9f38446 tempest-ServersAdminNegativeTestJSON-1469067030 tempest-ServersAdminNegativeTestJSON-1469067030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcdcbe3585524e77b1893c97b3b6a364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada14314366d4e548e8ab945840e7cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:09.560216 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-1f28d0ed-7055-443f-baf6-562ee9f38446 tempest-ServersAdminNegativeTestJSON-1469067030 tempest-ServersAdminNegativeTestJSON-1469067030-project] 10.222.0.33 "GET /compute/v2.1/servers/93050da6-597e-4924-93bf-35295c1ba9e4" status: 200 len: 1322 microversion: 2.1 time: 0.153774 Oct 04 21:30:09.560839 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3172/6379] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:30:09 2022] GET /compute/v2.1/servers/93050da6-597e-4924-93bf-35295c1ba9e4 => generated 1322 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:30:10.584592 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-f3bcf4d4-2e21-4b42-931a-1121d4e53f7b tempest-ServersAdminNegativeTestJSON-1469067030 tempest-ServersAdminNegativeTestJSON-1469067030-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:10.585259 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-f3bcf4d4-2e21-4b42-931a-1121d4e53f7b tempest-ServersAdminNegativeTestJSON-1469067030 tempest-ServersAdminNegativeTestJSON-1469067030-project] [instance: 93050da6-597e-4924-93bf-35295c1ba9e4] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:10.592373 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f3bcf4d4-2e21-4b42-931a-1121d4e53f7b tempest-ServersAdminNegativeTestJSON-1469067030 tempest-ServersAdminNegativeTestJSON-1469067030-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:10.592880 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f3bcf4d4-2e21-4b42-931a-1121d4e53f7b tempest-ServersAdminNegativeTestJSON-1469067030 tempest-ServersAdminNegativeTestJSON-1469067030-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:10.593335 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f3bcf4d4-2e21-4b42-931a-1121d4e53f7b tempest-ServersAdminNegativeTestJSON-1469067030 tempest-ServersAdminNegativeTestJSON-1469067030-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:10.594091 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f3bcf4d4-2e21-4b42-931a-1121d4e53f7b tempest-ServersAdminNegativeTestJSON-1469067030 tempest-ServersAdminNegativeTestJSON-1469067030-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:10.594599 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f3bcf4d4-2e21-4b42-931a-1121d4e53f7b tempest-ServersAdminNegativeTestJSON-1469067030 tempest-ServersAdminNegativeTestJSON-1469067030-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:10.595043 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f3bcf4d4-2e21-4b42-931a-1121d4e53f7b tempest-ServersAdminNegativeTestJSON-1469067030 tempest-ServersAdminNegativeTestJSON-1469067030-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:10.733757 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-f3bcf4d4-2e21-4b42-931a-1121d4e53f7b tempest-ServersAdminNegativeTestJSON-1469067030 tempest-ServersAdminNegativeTestJSON-1469067030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcdcbe3585524e77b1893c97b3b6a364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada14314366d4e548e8ab945840e7cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:10.741532 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-f3bcf4d4-2e21-4b42-931a-1121d4e53f7b tempest-ServersAdminNegativeTestJSON-1469067030 tempest-ServersAdminNegativeTestJSON-1469067030-project] 10.222.0.33 "GET /compute/v2.1/servers/93050da6-597e-4924-93bf-35295c1ba9e4" status: 200 len: 1322 microversion: 2.1 time: 0.161900 Oct 04 21:30:10.742102 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3208/6380] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:30:10 2022] GET /compute/v2.1/servers/93050da6-597e-4924-93bf-35295c1ba9e4 => generated 1322 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:30:11.764506 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b742184f-a742-4b86-b2df-b51f8c9d04c2 tempest-ServersAdminNegativeTestJSON-1469067030 tempest-ServersAdminNegativeTestJSON-1469067030-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:11.765027 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b742184f-a742-4b86-b2df-b51f8c9d04c2 tempest-ServersAdminNegativeTestJSON-1469067030 tempest-ServersAdminNegativeTestJSON-1469067030-project] [instance: 93050da6-597e-4924-93bf-35295c1ba9e4] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:11.772724 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b742184f-a742-4b86-b2df-b51f8c9d04c2 tempest-ServersAdminNegativeTestJSON-1469067030 tempest-ServersAdminNegativeTestJSON-1469067030-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:11.773205 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b742184f-a742-4b86-b2df-b51f8c9d04c2 tempest-ServersAdminNegativeTestJSON-1469067030 tempest-ServersAdminNegativeTestJSON-1469067030-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:11.773639 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b742184f-a742-4b86-b2df-b51f8c9d04c2 tempest-ServersAdminNegativeTestJSON-1469067030 tempest-ServersAdminNegativeTestJSON-1469067030-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:11.774329 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b742184f-a742-4b86-b2df-b51f8c9d04c2 tempest-ServersAdminNegativeTestJSON-1469067030 tempest-ServersAdminNegativeTestJSON-1469067030-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:11.774811 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b742184f-a742-4b86-b2df-b51f8c9d04c2 tempest-ServersAdminNegativeTestJSON-1469067030 tempest-ServersAdminNegativeTestJSON-1469067030-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:11.775233 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b742184f-a742-4b86-b2df-b51f8c9d04c2 tempest-ServersAdminNegativeTestJSON-1469067030 tempest-ServersAdminNegativeTestJSON-1469067030-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:11.916830 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-b742184f-a742-4b86-b2df-b51f8c9d04c2 tempest-ServersAdminNegativeTestJSON-1469067030 tempest-ServersAdminNegativeTestJSON-1469067030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcdcbe3585524e77b1893c97b3b6a364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada14314366d4e548e8ab945840e7cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:11.924483 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b742184f-a742-4b86-b2df-b51f8c9d04c2 tempest-ServersAdminNegativeTestJSON-1469067030 tempest-ServersAdminNegativeTestJSON-1469067030-project] 10.222.0.33 "GET /compute/v2.1/servers/93050da6-597e-4924-93bf-35295c1ba9e4" status: 200 len: 1322 microversion: 2.1 time: 0.163957 Oct 04 21:30:11.925121 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3173/6381] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:30:11 2022] GET /compute/v2.1/servers/93050da6-597e-4924-93bf-35295c1ba9e4 => generated 1322 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:30:12.948679 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-f5ef6874-41c5-47b9-8534-2cdff86bcd32 tempest-ServersAdminNegativeTestJSON-1469067030 tempest-ServersAdminNegativeTestJSON-1469067030-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:12.949221 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-f5ef6874-41c5-47b9-8534-2cdff86bcd32 tempest-ServersAdminNegativeTestJSON-1469067030 tempest-ServersAdminNegativeTestJSON-1469067030-project] [instance: 93050da6-597e-4924-93bf-35295c1ba9e4] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:12.956280 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f5ef6874-41c5-47b9-8534-2cdff86bcd32 tempest-ServersAdminNegativeTestJSON-1469067030 tempest-ServersAdminNegativeTestJSON-1469067030-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:12.956783 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f5ef6874-41c5-47b9-8534-2cdff86bcd32 tempest-ServersAdminNegativeTestJSON-1469067030 tempest-ServersAdminNegativeTestJSON-1469067030-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:12.957227 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f5ef6874-41c5-47b9-8534-2cdff86bcd32 tempest-ServersAdminNegativeTestJSON-1469067030 tempest-ServersAdminNegativeTestJSON-1469067030-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:12.957951 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f5ef6874-41c5-47b9-8534-2cdff86bcd32 tempest-ServersAdminNegativeTestJSON-1469067030 tempest-ServersAdminNegativeTestJSON-1469067030-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:12.958473 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f5ef6874-41c5-47b9-8534-2cdff86bcd32 tempest-ServersAdminNegativeTestJSON-1469067030 tempest-ServersAdminNegativeTestJSON-1469067030-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:12.959582 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f5ef6874-41c5-47b9-8534-2cdff86bcd32 tempest-ServersAdminNegativeTestJSON-1469067030 tempest-ServersAdminNegativeTestJSON-1469067030-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:13.100105 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-f5ef6874-41c5-47b9-8534-2cdff86bcd32 tempest-ServersAdminNegativeTestJSON-1469067030 tempest-ServersAdminNegativeTestJSON-1469067030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcdcbe3585524e77b1893c97b3b6a364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada14314366d4e548e8ab945840e7cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:13.108508 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-f5ef6874-41c5-47b9-8534-2cdff86bcd32 tempest-ServersAdminNegativeTestJSON-1469067030 tempest-ServersAdminNegativeTestJSON-1469067030-project] 10.222.0.33 "GET /compute/v2.1/servers/93050da6-597e-4924-93bf-35295c1ba9e4" status: 200 len: 1322 microversion: 2.1 time: 0.163802 Oct 04 21:30:13.109227 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3209/6382] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:30:12 2022] GET /compute/v2.1/servers/93050da6-597e-4924-93bf-35295c1ba9e4 => generated 1322 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:30:13.152193 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-a8ac0cee-5a87-4f57-a1d2-49d4394ae337 req-ec6633be-a404-4d1c-8661-bc3c360f929a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93050da6-597e-4924-93bf-35295c1ba9e4", "name": "network-vif-plugged", "status": "completed", "tag": "2cf6b969-4206-4b9c-aceb-1bc803ae0c6f"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:30:13.163322 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-a8ac0cee-5a87-4f57-a1d2-49d4394ae337 req-ec6633be-a404-4d1c-8661-bc3c360f929a service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:13.163807 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-a8ac0cee-5a87-4f57-a1d2-49d4394ae337 req-ec6633be-a404-4d1c-8661-bc3c360f929a service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:13.164240 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-a8ac0cee-5a87-4f57-a1d2-49d4394ae337 req-ec6633be-a404-4d1c-8661-bc3c360f929a service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:13.175655 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-a8ac0cee-5a87-4f57-a1d2-49d4394ae337 req-ec6633be-a404-4d1c-8661-bc3c360f929a service nova] Creating event network-vif-plugged:2cf6b969-4206-4b9c-aceb-1bc803ae0c6f for instance 93050da6-597e-4924-93bf-35295c1ba9e4 on n-h2-854823-8 Oct 04 21:30:13.181768 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-a8ac0cee-5a87-4f57-a1d2-49d4394ae337 req-ec6633be-a404-4d1c-8661-bc3c360f929a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033384 Oct 04 21:30:13.182405 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3174/6383] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:30:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:30:14.133094 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-76e606f5-e1cc-4ed8-92bc-8b4d1d9c5ac9 tempest-ServersAdminNegativeTestJSON-1469067030 tempest-ServersAdminNegativeTestJSON-1469067030-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:14.133740 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-76e606f5-e1cc-4ed8-92bc-8b4d1d9c5ac9 tempest-ServersAdminNegativeTestJSON-1469067030 tempest-ServersAdminNegativeTestJSON-1469067030-project] [instance: 93050da6-597e-4924-93bf-35295c1ba9e4] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:14.135799 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell0:SELECT=2 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:30:14.142077 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-76e606f5-e1cc-4ed8-92bc-8b4d1d9c5ac9 tempest-ServersAdminNegativeTestJSON-1469067030 tempest-ServersAdminNegativeTestJSON-1469067030-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:14.142600 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-76e606f5-e1cc-4ed8-92bc-8b4d1d9c5ac9 tempest-ServersAdminNegativeTestJSON-1469067030 tempest-ServersAdminNegativeTestJSON-1469067030-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:14.143046 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-76e606f5-e1cc-4ed8-92bc-8b4d1d9c5ac9 tempest-ServersAdminNegativeTestJSON-1469067030 tempest-ServersAdminNegativeTestJSON-1469067030-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:14.143764 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-76e606f5-e1cc-4ed8-92bc-8b4d1d9c5ac9 tempest-ServersAdminNegativeTestJSON-1469067030 tempest-ServersAdminNegativeTestJSON-1469067030-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:14.144235 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-76e606f5-e1cc-4ed8-92bc-8b4d1d9c5ac9 tempest-ServersAdminNegativeTestJSON-1469067030 tempest-ServersAdminNegativeTestJSON-1469067030-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:14.144664 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-76e606f5-e1cc-4ed8-92bc-8b4d1d9c5ac9 tempest-ServersAdminNegativeTestJSON-1469067030 tempest-ServersAdminNegativeTestJSON-1469067030-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:14.277453 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-76e606f5-e1cc-4ed8-92bc-8b4d1d9c5ac9 tempest-ServersAdminNegativeTestJSON-1469067030 tempest-ServersAdminNegativeTestJSON-1469067030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcdcbe3585524e77b1893c97b3b6a364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada14314366d4e548e8ab945840e7cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:14.285266 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-76e606f5-e1cc-4ed8-92bc-8b4d1d9c5ac9 tempest-ServersAdminNegativeTestJSON-1469067030 tempest-ServersAdminNegativeTestJSON-1469067030-project] 10.222.0.33 "GET /compute/v2.1/servers/93050da6-597e-4924-93bf-35295c1ba9e4" status: 200 len: 1322 microversion: 2.1 time: 0.156902 Oct 04 21:30:14.285848 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3210/6384] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:30:14 2022] GET /compute/v2.1/servers/93050da6-597e-4924-93bf-35295c1ba9e4 => generated 1322 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:30:15.311059 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0e85a13a-0d03-4693-941e-a2cd03e16e99 tempest-ServersAdminNegativeTestJSON-1469067030 tempest-ServersAdminNegativeTestJSON-1469067030-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:15.311815 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-0e85a13a-0d03-4693-941e-a2cd03e16e99 tempest-ServersAdminNegativeTestJSON-1469067030 tempest-ServersAdminNegativeTestJSON-1469067030-project] [instance: 93050da6-597e-4924-93bf-35295c1ba9e4] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:15.318584 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0e85a13a-0d03-4693-941e-a2cd03e16e99 tempest-ServersAdminNegativeTestJSON-1469067030 tempest-ServersAdminNegativeTestJSON-1469067030-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:15.319072 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0e85a13a-0d03-4693-941e-a2cd03e16e99 tempest-ServersAdminNegativeTestJSON-1469067030 tempest-ServersAdminNegativeTestJSON-1469067030-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:15.319510 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0e85a13a-0d03-4693-941e-a2cd03e16e99 tempest-ServersAdminNegativeTestJSON-1469067030 tempest-ServersAdminNegativeTestJSON-1469067030-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:15.320212 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0e85a13a-0d03-4693-941e-a2cd03e16e99 tempest-ServersAdminNegativeTestJSON-1469067030 tempest-ServersAdminNegativeTestJSON-1469067030-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:15.320674 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0e85a13a-0d03-4693-941e-a2cd03e16e99 tempest-ServersAdminNegativeTestJSON-1469067030 tempest-ServersAdminNegativeTestJSON-1469067030-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:15.321100 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0e85a13a-0d03-4693-941e-a2cd03e16e99 tempest-ServersAdminNegativeTestJSON-1469067030 tempest-ServersAdminNegativeTestJSON-1469067030-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:15.464150 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-0e85a13a-0d03-4693-941e-a2cd03e16e99 tempest-ServersAdminNegativeTestJSON-1469067030 tempest-ServersAdminNegativeTestJSON-1469067030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcdcbe3585524e77b1893c97b3b6a364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada14314366d4e548e8ab945840e7cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:15.471945 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-0e85a13a-0d03-4693-941e-a2cd03e16e99 tempest-ServersAdminNegativeTestJSON-1469067030 tempest-ServersAdminNegativeTestJSON-1469067030-project] 10.222.0.33 "GET /compute/v2.1/servers/93050da6-597e-4924-93bf-35295c1ba9e4" status: 200 len: 1472 microversion: 2.1 time: 0.166872 Oct 04 21:30:15.472479 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3175/6385] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:30:15 2022] GET /compute/v2.1/servers/93050da6-597e-4924-93bf-35295c1ba9e4 => generated 1472 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:30:15.497908 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell0:SELECT=8 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:30:15.548143 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-ef2a3bfc-2b86-4683-82a3-d5270ff055d1 tempest-ServersAdminNegativeTestJSON-1268767184 tempest-ServersAdminNegativeTestJSON-1268767184-project-admin] Calling method '.version_select at 0x7f3c74332940>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:15.617017 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-ef2a3bfc-2b86-4683-82a3-d5270ff055d1 tempest-ServersAdminNegativeTestJSON-1268767184 tempest-ServersAdminNegativeTestJSON-1268767184-project-admin] 10.222.0.33 "GET /compute/v2.1/os-quota-sets/4a2ec2959ab04ed488e2c3d89779d0b5" status: 200 len: 371 microversion: 2.1 time: 0.123516 Oct 04 21:30:15.617597 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3211/6386] 10.222.0.33 () {58 vars in 1242 bytes} [Tue Oct 4 21:30:15 2022] GET /compute/v2.1/os-quota-sets/4a2ec2959ab04ed488e2c3d89779d0b5 => generated 371 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:30:15.629478 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-45a011b9-8e77-4fd1-8e9f-b062b9972edd tempest-ServersAdminNegativeTestJSON-1268767184 tempest-ServersAdminNegativeTestJSON-1268767184-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 51201, "vcpus": 1, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-2021662806", "id": 1242653344, "os-flavor-access:is_public": "True"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:30:15.648913 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-45a011b9-8e77-4fd1-8e9f-b062b9972edd tempest-ServersAdminNegativeTestJSON-1268767184 tempest-ServersAdminNegativeTestJSON-1268767184-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.023061 Oct 04 21:30:15.649436 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3176/6387] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 21:30:15 2022] POST /compute/v2.1/flavors => generated 438 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:30:15.662233 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-96dea356-8e91-4c02-a5cf-ed8a9ccd94bb tempest-ServersAdminNegativeTestJSON-1268767184 tempest-ServersAdminNegativeTestJSON-1268767184-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "1242653344"}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:30:15.664705 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-96dea356-8e91-4c02-a5cf-ed8a9ccd94bb tempest-ServersAdminNegativeTestJSON-1268767184 tempest-ServersAdminNegativeTestJSON-1268767184-project-admin] [instance: 93050da6-597e-4924-93bf-35295c1ba9e4] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:15.670969 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-96dea356-8e91-4c02-a5cf-ed8a9ccd94bb tempest-ServersAdminNegativeTestJSON-1268767184 tempest-ServersAdminNegativeTestJSON-1268767184-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:15.671469 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-96dea356-8e91-4c02-a5cf-ed8a9ccd94bb tempest-ServersAdminNegativeTestJSON-1268767184 tempest-ServersAdminNegativeTestJSON-1268767184-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:15.671923 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-96dea356-8e91-4c02-a5cf-ed8a9ccd94bb tempest-ServersAdminNegativeTestJSON-1268767184 tempest-ServersAdminNegativeTestJSON-1268767184-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:15.672643 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-96dea356-8e91-4c02-a5cf-ed8a9ccd94bb tempest-ServersAdminNegativeTestJSON-1268767184 tempest-ServersAdminNegativeTestJSON-1268767184-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:15.673118 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-96dea356-8e91-4c02-a5cf-ed8a9ccd94bb tempest-ServersAdminNegativeTestJSON-1268767184 tempest-ServersAdminNegativeTestJSON-1268767184-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:15.673563 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-96dea356-8e91-4c02-a5cf-ed8a9ccd94bb tempest-ServersAdminNegativeTestJSON-1268767184 tempest-ServersAdminNegativeTestJSON-1268767184-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:15.815439 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-96dea356-8e91-4c02-a5cf-ed8a9ccd94bb tempest-ServersAdminNegativeTestJSON-1268767184 tempest-ServersAdminNegativeTestJSON-1268767184-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '83d56005eb294287922e3818076dc94f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2ec2959ab04ed488e2c3d89779d0b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:15.822554 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-96dea356-8e91-4c02-a5cf-ed8a9ccd94bb tempest-ServersAdminNegativeTestJSON-1268767184 tempest-ServersAdminNegativeTestJSON-1268767184-project-admin] [instance: 93050da6-597e-4924-93bf-35295c1ba9e4] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-2021662806 {{(pid=128802) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 04 21:30:15.829280 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-96dea356-8e91-4c02-a5cf-ed8a9ccd94bb tempest-ServersAdminNegativeTestJSON-1268767184 tempest-ServersAdminNegativeTestJSON-1268767184-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:15.829772 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-96dea356-8e91-4c02-a5cf-ed8a9ccd94bb tempest-ServersAdminNegativeTestJSON-1268767184 tempest-ServersAdminNegativeTestJSON-1268767184-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:15.830221 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-96dea356-8e91-4c02-a5cf-ed8a9ccd94bb tempest-ServersAdminNegativeTestJSON-1268767184 tempest-ServersAdminNegativeTestJSON-1268767184-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:15.830994 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-96dea356-8e91-4c02-a5cf-ed8a9ccd94bb tempest-ServersAdminNegativeTestJSON-1268767184 tempest-ServersAdminNegativeTestJSON-1268767184-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:15.831464 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-96dea356-8e91-4c02-a5cf-ed8a9ccd94bb tempest-ServersAdminNegativeTestJSON-1268767184 tempest-ServersAdminNegativeTestJSON-1268767184-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:15.831899 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-96dea356-8e91-4c02-a5cf-ed8a9ccd94bb tempest-ServersAdminNegativeTestJSON-1268767184 tempest-ServersAdminNegativeTestJSON-1268767184-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:15.853242 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-96dea356-8e91-4c02-a5cf-ed8a9ccd94bb tempest-ServersAdminNegativeTestJSON-1268767184 tempest-ServersAdminNegativeTestJSON-1268767184-project-admin] Getting quotas for project ada14314366d4e548e8ab945840e7cd1. Resources: {'ram', 'cores'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:30:15.858387 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-96dea356-8e91-4c02-a5cf-ed8a9ccd94bb tempest-ServersAdminNegativeTestJSON-1268767184 tempest-ServersAdminNegativeTestJSON-1268767184-project-admin] Getting quotas for user bcdcbe3585524e77b1893c97b3b6a364 and project ada14314366d4e548e8ab945840e7cd1. Resources: {'ram', 'cores'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:30:15.871395 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.compute.api [None req-96dea356-8e91-4c02-a5cf-ed8a9ccd94bb tempest-ServersAdminNegativeTestJSON-1268767184 tempest-ServersAdminNegativeTestJSON-1268767184-project-admin] ram quota exceeded for 4a2ec2959ab04ed488e2c3d89779d0b5, tried to resize instance. Oct 04 21:30:15.871948 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.wsgi [None req-96dea356-8e91-4c02-a5cf-ed8a9ccd94bb tempest-ServersAdminNegativeTestJSON-1268767184 tempest-ServersAdminNegativeTestJSON-1268767184-project-admin] HTTP exception thrown: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 04 21:30:15.878452 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-96dea356-8e91-4c02-a5cf-ed8a9ccd94bb tempest-ServersAdminNegativeTestJSON-1268767184 tempest-ServersAdminNegativeTestJSON-1268767184-project-admin] Request method failure captured: Oct 04 21:30:15.878452 n-d-854823-8 devstack@n-api.service[128802]: request: POST /compute/v2.1/servers/93050da6-597e-4924-93bf-35295c1ba9e4/action HTTP/1.1 Oct 04 21:30:15.878452 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 21:30:15.878452 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 21:30:15.878452 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 21:30:15.878452 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 39 Oct 04 21:30:15.878452 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 21:30:15.878452 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 21:30:15.878452 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 21:30:15.878452 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 21:30:15.878452 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPKXaALWwoaE9MIEd-41axuxZX4rTh9gHBNry1YBnfF-rpDReD-bG2h6FqiU42e7QDYpWYQy2MuWFFhaQLOQ6SCK4xWghuU9jbW9U8-LpoW2iUcmcRiBsFF74VAzkZtbeJAKej6uWZSxb6w1qi3g24Y8ax6obhNvQYuKyQ8eOEKV-4Hw Oct 04 21:30:15.878452 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 21:30:15.878452 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 21:30:15.878452 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 21:30:15.878452 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 21:30:15.878452 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 21:30:15.878452 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 21:30:15.878452 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: 4a2ec2959ab04ed488e2c3d89779d0b5 Oct 04 21:30:15.878452 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1268767184 Oct 04 21:30:15.878452 n-d-854823-8 devstack@n-api.service[128802]: X-Role: admin,reader,member Oct 04 21:30:15.878452 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: admin,reader,member Oct 04 21:30:15.878452 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_4a2ec2959ab04ed488e2c3d89779d0b5", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4a2ec2959ab04ed488e2c3d89779d0b5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4a2ec2959ab04ed488e2c3d89779d0b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/4a2ec2959ab04ed488e2c3d89779d0b5"}]}] Oct 04 21:30:15.878452 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1268767184 Oct 04 21:30:15.878452 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: 4a2ec2959ab04ed488e2c3d89779d0b5 Oct 04 21:30:15.878452 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1268767184 Oct 04 21:30:15.878452 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-ServersAdminNegativeTestJSON-1268767184-project-admin Oct 04 21:30:15.878452 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 21:30:15.878452 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 21:30:15.878452 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: 83d56005eb294287922e3818076dc94f Oct 04 21:30:15.878452 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1268767184-project-admin Oct 04 21:30:15.878452 n-d-854823-8 devstack@n-api.service[128802]: Oct 04 21:30:15.878452 n-d-854823-8 devstack@n-api.service[128802]: {"resize": {"flavorRef": "1242653344"}} Oct 04 21:30:15.878452 n-d-854823-8 devstack@n-api.service[128802]: method: > Oct 04 21:30:15.878452 n-d-854823-8 devstack@n-api.service[128802]: exception: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 04 21:30:15.878452 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'id': '93050da6-597e-4924-93bf-35295c1ba9e4', 'body': {'resize': {'flavorRef': '1242653344'}}} Oct 04 21:30:15.878452 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:30:15.878452 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:30:15.878452 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3878, in _check_quota_for_upsize Oct 04 21:30:15.878452 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Oct 04 21:30:15.878452 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 21:30:15.878452 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 21:30:15.878452 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 04 21:30:15.878452 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exc Oct 04 21:30:15.878452 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 04 21:30:15.878452 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 04 21:30:15.878452 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 21:30:15.878452 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 21:30:15.878452 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 04 21:30:15.878452 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 04 21:30:15.878452 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 04 21:30:15.878452 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 04 21:30:15.878452 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Oct 04 21:30:15.878452 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 04 21:30:15.878452 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Oct 04 21:30:15.878452 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:30:15.878452 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:30:15.878452 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:30:15.878452 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:30:15.878452 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Oct 04 21:30:15.878452 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Oct 04 21:30:15.878452 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 04 21:30:15.878452 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 21:30:15.878452 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 04 21:30:15.883355 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 04 21:30:15.883355 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 04 21:30:15.883355 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 04 21:30:15.883355 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 21:30:15.883355 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 21:30:15.883355 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 04 21:30:15.883355 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 04 21:30:15.883355 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Oct 04 21:30:15.883355 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 21:30:15.883355 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4244, in resize Oct 04 21:30:15.883355 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Oct 04 21:30:15.883355 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3896, in _check_quota_for_upsize Oct 04 21:30:15.883355 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 04 21:30:15.883355 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 04 21:30:15.883355 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:30:15.883355 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:30:15.883355 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:30:15.883355 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:30:15.883355 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:30:15.883355 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:30:15.883355 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:30:15.883355 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:30:15.883355 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:30:15.883355 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:30:15.883355 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:30:15.883355 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:30:15.883355 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 04 21:30:15.883355 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 04 21:30:15.883355 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Oct 04 21:30:15.883355 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 04 21:30:15.883355 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 04 21:30:15.883355 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:30:15.883355 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:30:15.883355 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:30:15.883355 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:30:15.883355 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:30:15.883355 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:30:15.883355 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:30:15.883355 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:30:15.883355 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 04 21:30:15.883355 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:30:15.883355 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-96dea356-8e91-4c02-a5cf-ed8a9ccd94bb tempest-ServersAdminNegativeTestJSON-1268767184 tempest-ServersAdminNegativeTestJSON-1268767184-project-admin] Returning 403 to user: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:30:15.883355 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-96dea356-8e91-4c02-a5cf-ed8a9ccd94bb tempest-ServersAdminNegativeTestJSON-1268767184 tempest-ServersAdminNegativeTestJSON-1268767184-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/93050da6-597e-4924-93bf-35295c1ba9e4/action" status: 403 len: 118 microversion: 2.1 time: 0.221711 Oct 04 21:30:15.883355 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3212/6388] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 21:30:15 2022] POST /compute/v2.1/servers/93050da6-597e-4924-93bf-35295c1ba9e4/action => generated 118 bytes in 223 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:30:15.891121 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-96104ca6-5406-48c9-8073-d1465b477bb1 tempest-ServersAdminNegativeTestJSON-1268767184 tempest-ServersAdminNegativeTestJSON-1268767184-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:15.893927 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=4 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:30:15.910170 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-96104ca6-5406-48c9-8073-d1465b477bb1 tempest-ServersAdminNegativeTestJSON-1268767184 tempest-ServersAdminNegativeTestJSON-1268767184-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/1242653344" status: 202 len: 0 microversion: 2.1 time: 0.022680 Oct 04 21:30:15.910821 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3177/6389] 10.222.0.33 () {58 vars in 1161 bytes} [Tue Oct 4 21:30:15 2022] DELETE /compute/v2.1/flavors/1242653344 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 21:30:15.919648 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-632e3779-acaa-4770-b1d4-016975fc0cdf tempest-ServersAdminNegativeTestJSON-1268767184 tempest-ServersAdminNegativeTestJSON-1268767184-project-admin] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:15.942381 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-632e3779-acaa-4770-b1d4-016975fc0cdf tempest-ServersAdminNegativeTestJSON-1268767184 tempest-ServersAdminNegativeTestJSON-1268767184-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.026388 Oct 04 21:30:15.943110 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3213/6390] 10.222.0.33 () {58 vars in 1146 bytes} [Tue Oct 4 21:30:15 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:30:15.964967 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-32498af3-aae4-441f-a03c-d421210f226f tempest-ServersAdminNegativeTestJSON-1268767184 tempest-ServersAdminNegativeTestJSON-1268767184-project-admin] Calling method '.version_select at 0x7f3c6ee7f940>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:16.046374 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-32498af3-aae4-441f-a03c-d421210f226f tempest-ServersAdminNegativeTestJSON-1268767184 tempest-ServersAdminNegativeTestJSON-1268767184-project-admin] 10.222.0.33 "GET /compute/v2.1/os-quota-sets/4a2ec2959ab04ed488e2c3d89779d0b5" status: 200 len: 371 microversion: 2.1 time: 0.085088 Oct 04 21:30:16.047001 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3178/6391] 10.222.0.33 () {58 vars in 1242 bytes} [Tue Oct 4 21:30:15 2022] GET /compute/v2.1/os-quota-sets/4a2ec2959ab04ed488e2c3d89779d0b5 => generated 371 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:30:16.060217 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-61da3f06-464f-414e-9e9f-d1c4e762eebd tempest-ServersAdminNegativeTestJSON-1268767184 tempest-ServersAdminNegativeTestJSON-1268767184-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 21, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-1830025448", "id": 1077005054, "os-flavor-access:is_public": "True"}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:30:16.079833 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-61da3f06-464f-414e-9e9f-d1c4e762eebd tempest-ServersAdminNegativeTestJSON-1268767184 tempest-ServersAdminNegativeTestJSON-1268767184-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 437 microversion: 2.1 time: 0.023649 Oct 04 21:30:16.080576 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3214/6392] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 21:30:16 2022] POST /compute/v2.1/flavors => generated 437 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:30:16.093924 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9dd60633-85ff-4258-9db8-1065fb58059c tempest-ServersAdminNegativeTestJSON-1268767184 tempest-ServersAdminNegativeTestJSON-1268767184-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "1077005054"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:30:16.096355 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-9dd60633-85ff-4258-9db8-1065fb58059c tempest-ServersAdminNegativeTestJSON-1268767184 tempest-ServersAdminNegativeTestJSON-1268767184-project-admin] [instance: 93050da6-597e-4924-93bf-35295c1ba9e4] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:16.103398 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9dd60633-85ff-4258-9db8-1065fb58059c tempest-ServersAdminNegativeTestJSON-1268767184 tempest-ServersAdminNegativeTestJSON-1268767184-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:16.103916 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9dd60633-85ff-4258-9db8-1065fb58059c tempest-ServersAdminNegativeTestJSON-1268767184 tempest-ServersAdminNegativeTestJSON-1268767184-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:16.104349 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9dd60633-85ff-4258-9db8-1065fb58059c tempest-ServersAdminNegativeTestJSON-1268767184 tempest-ServersAdminNegativeTestJSON-1268767184-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:16.105056 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9dd60633-85ff-4258-9db8-1065fb58059c tempest-ServersAdminNegativeTestJSON-1268767184 tempest-ServersAdminNegativeTestJSON-1268767184-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:16.105513 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9dd60633-85ff-4258-9db8-1065fb58059c tempest-ServersAdminNegativeTestJSON-1268767184 tempest-ServersAdminNegativeTestJSON-1268767184-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:16.105995 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9dd60633-85ff-4258-9db8-1065fb58059c tempest-ServersAdminNegativeTestJSON-1268767184 tempest-ServersAdminNegativeTestJSON-1268767184-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:16.249162 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-9dd60633-85ff-4258-9db8-1065fb58059c tempest-ServersAdminNegativeTestJSON-1268767184 tempest-ServersAdminNegativeTestJSON-1268767184-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '83d56005eb294287922e3818076dc94f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2ec2959ab04ed488e2c3d89779d0b5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:16.255370 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-9dd60633-85ff-4258-9db8-1065fb58059c tempest-ServersAdminNegativeTestJSON-1268767184 tempest-ServersAdminNegativeTestJSON-1268767184-project-admin] [instance: 93050da6-597e-4924-93bf-35295c1ba9e4] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-1830025448 {{(pid=128801) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 04 21:30:16.263108 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9dd60633-85ff-4258-9db8-1065fb58059c tempest-ServersAdminNegativeTestJSON-1268767184 tempest-ServersAdminNegativeTestJSON-1268767184-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:16.263587 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9dd60633-85ff-4258-9db8-1065fb58059c tempest-ServersAdminNegativeTestJSON-1268767184 tempest-ServersAdminNegativeTestJSON-1268767184-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:16.264015 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9dd60633-85ff-4258-9db8-1065fb58059c tempest-ServersAdminNegativeTestJSON-1268767184 tempest-ServersAdminNegativeTestJSON-1268767184-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:16.264735 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9dd60633-85ff-4258-9db8-1065fb58059c tempest-ServersAdminNegativeTestJSON-1268767184 tempest-ServersAdminNegativeTestJSON-1268767184-project-admin] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:16.265181 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9dd60633-85ff-4258-9db8-1065fb58059c tempest-ServersAdminNegativeTestJSON-1268767184 tempest-ServersAdminNegativeTestJSON-1268767184-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:16.265601 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9dd60633-85ff-4258-9db8-1065fb58059c tempest-ServersAdminNegativeTestJSON-1268767184 tempest-ServersAdminNegativeTestJSON-1268767184-project-admin] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:16.288323 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-9dd60633-85ff-4258-9db8-1065fb58059c tempest-ServersAdminNegativeTestJSON-1268767184 tempest-ServersAdminNegativeTestJSON-1268767184-project-admin] Getting quotas for project ada14314366d4e548e8ab945840e7cd1. Resources: {'ram', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:30:16.293407 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-9dd60633-85ff-4258-9db8-1065fb58059c tempest-ServersAdminNegativeTestJSON-1268767184 tempest-ServersAdminNegativeTestJSON-1268767184-project-admin] Getting quotas for user bcdcbe3585524e77b1893c97b3b6a364 and project ada14314366d4e548e8ab945840e7cd1. Resources: {'ram', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:30:16.309342 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.compute.api [None req-9dd60633-85ff-4258-9db8-1065fb58059c tempest-ServersAdminNegativeTestJSON-1268767184 tempest-ServersAdminNegativeTestJSON-1268767184-project-admin] cores quota exceeded for 4a2ec2959ab04ed488e2c3d89779d0b5, tried to resize instance. Oct 04 21:30:16.309872 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-9dd60633-85ff-4258-9db8-1065fb58059c tempest-ServersAdminNegativeTestJSON-1268767184 tempest-ServersAdminNegativeTestJSON-1268767184-project-admin] HTTP exception thrown: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 04 21:30:16.311953 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9dd60633-85ff-4258-9db8-1065fb58059c tempest-ServersAdminNegativeTestJSON-1268767184 tempest-ServersAdminNegativeTestJSON-1268767184-project-admin] Request method failure captured: Oct 04 21:30:16.311953 n-d-854823-8 devstack@n-api.service[128801]: request: POST /compute/v2.1/servers/93050da6-597e-4924-93bf-35295c1ba9e4/action HTTP/1.1 Oct 04 21:30:16.311953 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 21:30:16.311953 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 21:30:16.311953 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 21:30:16.311953 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 39 Oct 04 21:30:16.311953 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 21:30:16.311953 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 21:30:16.311953 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 21:30:16.311953 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 21:30:16.311953 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPKXaALWwoaE9MIEd-41axuxZX4rTh9gHBNry1YBnfF-rpDReD-bG2h6FqiU42e7QDYpWYQy2MuWFFhaQLOQ6SCK4xWghuU9jbW9U8-LpoW2iUcmcRiBsFF74VAzkZtbeJAKej6uWZSxb6w1qi3g24Y8ax6obhNvQYuKyQ8eOEKV-4Hw Oct 04 21:30:16.311953 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 21:30:16.311953 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 21:30:16.311953 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 21:30:16.311953 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 21:30:16.311953 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 21:30:16.311953 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 21:30:16.311953 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: 4a2ec2959ab04ed488e2c3d89779d0b5 Oct 04 21:30:16.311953 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1268767184 Oct 04 21:30:16.311953 n-d-854823-8 devstack@n-api.service[128801]: X-Role: admin,reader,member Oct 04 21:30:16.311953 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: admin,reader,member Oct 04 21:30:16.311953 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_4a2ec2959ab04ed488e2c3d89779d0b5", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4a2ec2959ab04ed488e2c3d89779d0b5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4a2ec2959ab04ed488e2c3d89779d0b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/4a2ec2959ab04ed488e2c3d89779d0b5"}]}] Oct 04 21:30:16.311953 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1268767184 Oct 04 21:30:16.311953 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: 4a2ec2959ab04ed488e2c3d89779d0b5 Oct 04 21:30:16.311953 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1268767184 Oct 04 21:30:16.311953 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-ServersAdminNegativeTestJSON-1268767184-project-admin Oct 04 21:30:16.311953 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 21:30:16.311953 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 21:30:16.311953 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: 83d56005eb294287922e3818076dc94f Oct 04 21:30:16.311953 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1268767184-project-admin Oct 04 21:30:16.311953 n-d-854823-8 devstack@n-api.service[128801]: Oct 04 21:30:16.311953 n-d-854823-8 devstack@n-api.service[128801]: {"resize": {"flavorRef": "1077005054"}} Oct 04 21:30:16.311953 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 21:30:16.311953 n-d-854823-8 devstack@n-api.service[128801]: exception: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 04 21:30:16.311953 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': '93050da6-597e-4924-93bf-35295c1ba9e4', 'body': {'resize': {'flavorRef': '1077005054'}}} Oct 04 21:30:16.311953 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:30:16.311953 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:30:16.311953 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3878, in _check_quota_for_upsize Oct 04 21:30:16.311953 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Oct 04 21:30:16.311953 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 21:30:16.311953 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 21:30:16.311953 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 04 21:30:16.311953 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc Oct 04 21:30:16.311953 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 04 21:30:16.311953 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 04 21:30:16.311953 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 21:30:16.311953 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 21:30:16.311953 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 04 21:30:16.311953 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 04 21:30:16.311953 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 04 21:30:16.311953 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 04 21:30:16.311953 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Oct 04 21:30:16.311953 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 04 21:30:16.311953 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Oct 04 21:30:16.311953 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:30:16.311953 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:30:16.311953 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:30:16.311953 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:30:16.311953 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Oct 04 21:30:16.311953 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Oct 04 21:30:16.311953 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 04 21:30:16.311953 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 21:30:16.311953 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 04 21:30:16.315819 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 04 21:30:16.315819 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 04 21:30:16.315819 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 04 21:30:16.315819 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 21:30:16.315819 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 21:30:16.315819 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 04 21:30:16.315819 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 04 21:30:16.315819 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Oct 04 21:30:16.315819 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 21:30:16.315819 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4244, in resize Oct 04 21:30:16.315819 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Oct 04 21:30:16.315819 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3896, in _check_quota_for_upsize Oct 04 21:30:16.315819 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 04 21:30:16.315819 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 04 21:30:16.315819 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:30:16.315819 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:30:16.315819 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:30:16.315819 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:30:16.315819 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:30:16.315819 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:30:16.315819 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:30:16.315819 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:30:16.315819 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:30:16.315819 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:30:16.315819 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:30:16.315819 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:30:16.315819 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 04 21:30:16.315819 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 04 21:30:16.315819 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Oct 04 21:30:16.315819 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 04 21:30:16.315819 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 04 21:30:16.315819 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:30:16.315819 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:30:16.315819 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:30:16.315819 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:30:16.315819 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:30:16.315819 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:30:16.315819 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:30:16.315819 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:30:16.315819 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 04 21:30:16.315819 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:30:16.315819 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9dd60633-85ff-4258-9db8-1065fb58059c tempest-ServersAdminNegativeTestJSON-1268767184 tempest-ServersAdminNegativeTestJSON-1268767184-project-admin] Returning 403 to user: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:30:16.315819 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-9dd60633-85ff-4258-9db8-1065fb58059c tempest-ServersAdminNegativeTestJSON-1268767184 tempest-ServersAdminNegativeTestJSON-1268767184-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/93050da6-597e-4924-93bf-35295c1ba9e4/action" status: 403 len: 113 microversion: 2.1 time: 0.223411 Oct 04 21:30:16.315819 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3179/6393] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 21:30:16 2022] POST /compute/v2.1/servers/93050da6-597e-4924-93bf-35295c1ba9e4/action => generated 113 bytes in 225 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 04 21:30:16.322382 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-d8076a49-e4de-49f4-a826-cc0c52bba0fc tempest-ServersAdminNegativeTestJSON-1268767184 tempest-ServersAdminNegativeTestJSON-1268767184-project-admin] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:16.339211 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-d8076a49-e4de-49f4-a826-cc0c52bba0fc tempest-ServersAdminNegativeTestJSON-1268767184 tempest-ServersAdminNegativeTestJSON-1268767184-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/1077005054" status: 202 len: 0 microversion: 2.1 time: 0.020808 Oct 04 21:30:16.339788 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3215/6394] 10.222.0.33 () {58 vars in 1161 bytes} [Tue Oct 4 21:30:16 2022] DELETE /compute/v2.1/flavors/1077005054 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 21:30:16.347776 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-3a4149d3-86b3-47d1-a5fd-393945afcfbe tempest-ServersAdminNegativeTestJSON-1268767184 tempest-ServersAdminNegativeTestJSON-1268767184-project-admin] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:16.368737 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-3a4149d3-86b3-47d1-a5fd-393945afcfbe tempest-ServersAdminNegativeTestJSON-1268767184 tempest-ServersAdminNegativeTestJSON-1268767184-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.024570 Oct 04 21:30:16.369323 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3180/6395] 10.222.0.33 () {58 vars in 1146 bytes} [Tue Oct 4 21:30:16 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:30:16.390161 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-b50b2350-7762-4fee-be2a-f822722ba68a tempest-ServersAdminNegativeTestJSON-1469067030 tempest-ServersAdminNegativeTestJSON-1469067030-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:16.390714 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-b50b2350-7762-4fee-be2a-f822722ba68a tempest-ServersAdminNegativeTestJSON-1469067030 tempest-ServersAdminNegativeTestJSON-1469067030-project] [instance: 93050da6-597e-4924-93bf-35295c1ba9e4] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:16.397302 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b50b2350-7762-4fee-be2a-f822722ba68a tempest-ServersAdminNegativeTestJSON-1469067030 tempest-ServersAdminNegativeTestJSON-1469067030-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:16.397796 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b50b2350-7762-4fee-be2a-f822722ba68a tempest-ServersAdminNegativeTestJSON-1469067030 tempest-ServersAdminNegativeTestJSON-1469067030-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:16.398237 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b50b2350-7762-4fee-be2a-f822722ba68a tempest-ServersAdminNegativeTestJSON-1469067030 tempest-ServersAdminNegativeTestJSON-1469067030-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:16.398963 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b50b2350-7762-4fee-be2a-f822722ba68a tempest-ServersAdminNegativeTestJSON-1469067030 tempest-ServersAdminNegativeTestJSON-1469067030-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:16.399421 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b50b2350-7762-4fee-be2a-f822722ba68a tempest-ServersAdminNegativeTestJSON-1469067030 tempest-ServersAdminNegativeTestJSON-1469067030-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:16.399860 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b50b2350-7762-4fee-be2a-f822722ba68a tempest-ServersAdminNegativeTestJSON-1469067030 tempest-ServersAdminNegativeTestJSON-1469067030-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:16.425353 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-b50b2350-7762-4fee-be2a-f822722ba68a tempest-ServersAdminNegativeTestJSON-1469067030 tempest-ServersAdminNegativeTestJSON-1469067030-project] [instance: 93050da6-597e-4924-93bf-35295c1ba9e4] Going to try to terminate instance {{(pid=128802) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:30:16.502681 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-b50b2350-7762-4fee-be2a-f822722ba68a tempest-ServersAdminNegativeTestJSON-1469067030 tempest-ServersAdminNegativeTestJSON-1469067030-project] 10.222.0.33 "DELETE /compute/v2.1/servers/93050da6-597e-4924-93bf-35295c1ba9e4" status: 204 len: 0 microversion: 2.1 time: 0.116007 Oct 04 21:30:16.503487 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3216/6396] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 21:30:16 2022] DELETE /compute/v2.1/servers/93050da6-597e-4924-93bf-35295c1ba9e4 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:30:16.511716 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-af8c16f8-9061-4e7c-891e-5cdeac9d3fea tempest-ServersAdminNegativeTestJSON-1469067030 tempest-ServersAdminNegativeTestJSON-1469067030-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:16.512333 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-af8c16f8-9061-4e7c-891e-5cdeac9d3fea tempest-ServersAdminNegativeTestJSON-1469067030 tempest-ServersAdminNegativeTestJSON-1469067030-project] [instance: 93050da6-597e-4924-93bf-35295c1ba9e4] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:16.518400 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-af8c16f8-9061-4e7c-891e-5cdeac9d3fea tempest-ServersAdminNegativeTestJSON-1469067030 tempest-ServersAdminNegativeTestJSON-1469067030-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:16.518883 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-af8c16f8-9061-4e7c-891e-5cdeac9d3fea tempest-ServersAdminNegativeTestJSON-1469067030 tempest-ServersAdminNegativeTestJSON-1469067030-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:16.519315 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-af8c16f8-9061-4e7c-891e-5cdeac9d3fea tempest-ServersAdminNegativeTestJSON-1469067030 tempest-ServersAdminNegativeTestJSON-1469067030-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:16.520004 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-af8c16f8-9061-4e7c-891e-5cdeac9d3fea tempest-ServersAdminNegativeTestJSON-1469067030 tempest-ServersAdminNegativeTestJSON-1469067030-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:16.520454 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-af8c16f8-9061-4e7c-891e-5cdeac9d3fea tempest-ServersAdminNegativeTestJSON-1469067030 tempest-ServersAdminNegativeTestJSON-1469067030-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:16.520874 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-af8c16f8-9061-4e7c-891e-5cdeac9d3fea tempest-ServersAdminNegativeTestJSON-1469067030 tempest-ServersAdminNegativeTestJSON-1469067030-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:16.653575 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-af8c16f8-9061-4e7c-891e-5cdeac9d3fea tempest-ServersAdminNegativeTestJSON-1469067030 tempest-ServersAdminNegativeTestJSON-1469067030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcdcbe3585524e77b1893c97b3b6a364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada14314366d4e548e8ab945840e7cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:16.662678 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-af8c16f8-9061-4e7c-891e-5cdeac9d3fea tempest-ServersAdminNegativeTestJSON-1469067030 tempest-ServersAdminNegativeTestJSON-1469067030-project] 10.222.0.33 "GET /compute/v2.1/servers/93050da6-597e-4924-93bf-35295c1ba9e4" status: 200 len: 1478 microversion: 2.1 time: 0.154003 Oct 04 21:30:16.663050 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3181/6397] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:30:16 2022] GET /compute/v2.1/servers/93050da6-597e-4924-93bf-35295c1ba9e4 => generated 1478 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:30:17.686693 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-13587cb4-433c-4d26-9982-684dbdfa2cec tempest-ServersAdminNegativeTestJSON-1469067030 tempest-ServersAdminNegativeTestJSON-1469067030-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:17.687434 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-13587cb4-433c-4d26-9982-684dbdfa2cec tempest-ServersAdminNegativeTestJSON-1469067030 tempest-ServersAdminNegativeTestJSON-1469067030-project] [instance: 93050da6-597e-4924-93bf-35295c1ba9e4] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:17.695628 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-13587cb4-433c-4d26-9982-684dbdfa2cec tempest-ServersAdminNegativeTestJSON-1469067030 tempest-ServersAdminNegativeTestJSON-1469067030-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:17.696149 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-13587cb4-433c-4d26-9982-684dbdfa2cec tempest-ServersAdminNegativeTestJSON-1469067030 tempest-ServersAdminNegativeTestJSON-1469067030-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:17.696615 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-13587cb4-433c-4d26-9982-684dbdfa2cec tempest-ServersAdminNegativeTestJSON-1469067030 tempest-ServersAdminNegativeTestJSON-1469067030-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:17.697357 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-13587cb4-433c-4d26-9982-684dbdfa2cec tempest-ServersAdminNegativeTestJSON-1469067030 tempest-ServersAdminNegativeTestJSON-1469067030-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:17.697831 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-13587cb4-433c-4d26-9982-684dbdfa2cec tempest-ServersAdminNegativeTestJSON-1469067030 tempest-ServersAdminNegativeTestJSON-1469067030-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:17.698276 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-13587cb4-433c-4d26-9982-684dbdfa2cec tempest-ServersAdminNegativeTestJSON-1469067030 tempest-ServersAdminNegativeTestJSON-1469067030-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:17.834359 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-13587cb4-433c-4d26-9982-684dbdfa2cec tempest-ServersAdminNegativeTestJSON-1469067030 tempest-ServersAdminNegativeTestJSON-1469067030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcdcbe3585524e77b1893c97b3b6a364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada14314366d4e548e8ab945840e7cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:17.842245 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-13587cb4-433c-4d26-9982-684dbdfa2cec tempest-ServersAdminNegativeTestJSON-1469067030 tempest-ServersAdminNegativeTestJSON-1469067030-project] 10.222.0.33 "GET /compute/v2.1/servers/93050da6-597e-4924-93bf-35295c1ba9e4" status: 200 len: 1478 microversion: 2.1 time: 0.160052 Oct 04 21:30:17.842843 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3217/6398] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:30:17 2022] GET /compute/v2.1/servers/93050da6-597e-4924-93bf-35295c1ba9e4 => generated 1478 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:30:18.393987 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-4387a83b-132c-43ee-a207-993a1e38f6ab req-47c731cf-f5af-4764-b736-21f56b4152dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93050da6-597e-4924-93bf-35295c1ba9e4", "name": "network-vif-deleted", "tag": "2cf6b969-4206-4b9c-aceb-1bc803ae0c6f"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:30:18.406708 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-4387a83b-132c-43ee-a207-993a1e38f6ab req-47c731cf-f5af-4764-b736-21f56b4152dc service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:18.407457 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-4387a83b-132c-43ee-a207-993a1e38f6ab req-47c731cf-f5af-4764-b736-21f56b4152dc service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:18.408088 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-4387a83b-132c-43ee-a207-993a1e38f6ab req-47c731cf-f5af-4764-b736-21f56b4152dc service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:18.422611 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-4387a83b-132c-43ee-a207-993a1e38f6ab req-47c731cf-f5af-4764-b736-21f56b4152dc service nova] Creating event network-vif-deleted:2cf6b969-4206-4b9c-aceb-1bc803ae0c6f for instance 93050da6-597e-4924-93bf-35295c1ba9e4 on n-h2-854823-8 Oct 04 21:30:18.430090 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-4387a83b-132c-43ee-a207-993a1e38f6ab req-47c731cf-f5af-4764-b736-21f56b4152dc service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039976 Oct 04 21:30:18.431528 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3182/6399] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:30:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:30:18.865260 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-8310d885-8606-46ae-976a-27f6793abfdc tempest-ServersAdminNegativeTestJSON-1469067030 tempest-ServersAdminNegativeTestJSON-1469067030-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:18.866136 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-8310d885-8606-46ae-976a-27f6793abfdc tempest-ServersAdminNegativeTestJSON-1469067030 tempest-ServersAdminNegativeTestJSON-1469067030-project] [instance: 93050da6-597e-4924-93bf-35295c1ba9e4] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:18.874522 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8310d885-8606-46ae-976a-27f6793abfdc tempest-ServersAdminNegativeTestJSON-1469067030 tempest-ServersAdminNegativeTestJSON-1469067030-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:18.875612 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8310d885-8606-46ae-976a-27f6793abfdc tempest-ServersAdminNegativeTestJSON-1469067030 tempest-ServersAdminNegativeTestJSON-1469067030-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:18.876193 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8310d885-8606-46ae-976a-27f6793abfdc tempest-ServersAdminNegativeTestJSON-1469067030 tempest-ServersAdminNegativeTestJSON-1469067030-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:18.877051 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8310d885-8606-46ae-976a-27f6793abfdc tempest-ServersAdminNegativeTestJSON-1469067030 tempest-ServersAdminNegativeTestJSON-1469067030-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:18.877519 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8310d885-8606-46ae-976a-27f6793abfdc tempest-ServersAdminNegativeTestJSON-1469067030 tempest-ServersAdminNegativeTestJSON-1469067030-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:18.878025 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8310d885-8606-46ae-976a-27f6793abfdc tempest-ServersAdminNegativeTestJSON-1469067030 tempest-ServersAdminNegativeTestJSON-1469067030-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:18.912975 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8310d885-8606-46ae-976a-27f6793abfdc tempest-ServersAdminNegativeTestJSON-1469067030 tempest-ServersAdminNegativeTestJSON-1469067030-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:18.913490 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8310d885-8606-46ae-976a-27f6793abfdc tempest-ServersAdminNegativeTestJSON-1469067030 tempest-ServersAdminNegativeTestJSON-1469067030-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:18.913946 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8310d885-8606-46ae-976a-27f6793abfdc tempest-ServersAdminNegativeTestJSON-1469067030 tempest-ServersAdminNegativeTestJSON-1469067030-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:18.914440 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.objects.instance [None req-8310d885-8606-46ae-976a-27f6793abfdc tempest-ServersAdminNegativeTestJSON-1469067030 tempest-ServersAdminNegativeTestJSON-1469067030-project] Lazy-loading 'fault' on Instance uuid 93050da6-597e-4924-93bf-35295c1ba9e4 {{(pid=128802) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:30:18.958355 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-8310d885-8606-46ae-976a-27f6793abfdc tempest-ServersAdminNegativeTestJSON-1469067030 tempest-ServersAdminNegativeTestJSON-1469067030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcdcbe3585524e77b1893c97b3b6a364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada14314366d4e548e8ab945840e7cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:18.968515 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-8310d885-8606-46ae-976a-27f6793abfdc tempest-ServersAdminNegativeTestJSON-1469067030 tempest-ServersAdminNegativeTestJSON-1469067030-project] 10.222.0.33 "GET /compute/v2.1/servers/93050da6-597e-4924-93bf-35295c1ba9e4" status: 200 len: 1312 microversion: 2.1 time: 0.106662 Oct 04 21:30:18.969141 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3218/6400] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:30:18 2022] GET /compute/v2.1/servers/93050da6-597e-4924-93bf-35295c1ba9e4 => generated 1312 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:30:19.993660 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e5c78308-d3fe-4143-ac81-6862fb7356d3 tempest-ServersAdminNegativeTestJSON-1469067030 tempest-ServersAdminNegativeTestJSON-1469067030-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:19.994387 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e5c78308-d3fe-4143-ac81-6862fb7356d3 tempest-ServersAdminNegativeTestJSON-1469067030 tempest-ServersAdminNegativeTestJSON-1469067030-project] [instance: 93050da6-597e-4924-93bf-35295c1ba9e4] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:20.000598 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e5c78308-d3fe-4143-ac81-6862fb7356d3 tempest-ServersAdminNegativeTestJSON-1469067030 tempest-ServersAdminNegativeTestJSON-1469067030-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:20.001084 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e5c78308-d3fe-4143-ac81-6862fb7356d3 tempest-ServersAdminNegativeTestJSON-1469067030 tempest-ServersAdminNegativeTestJSON-1469067030-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:20.001522 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e5c78308-d3fe-4143-ac81-6862fb7356d3 tempest-ServersAdminNegativeTestJSON-1469067030 tempest-ServersAdminNegativeTestJSON-1469067030-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:20.002213 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e5c78308-d3fe-4143-ac81-6862fb7356d3 tempest-ServersAdminNegativeTestJSON-1469067030 tempest-ServersAdminNegativeTestJSON-1469067030-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:20.002706 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e5c78308-d3fe-4143-ac81-6862fb7356d3 tempest-ServersAdminNegativeTestJSON-1469067030 tempest-ServersAdminNegativeTestJSON-1469067030-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:20.003132 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e5c78308-d3fe-4143-ac81-6862fb7356d3 tempest-ServersAdminNegativeTestJSON-1469067030 tempest-ServersAdminNegativeTestJSON-1469067030-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:20.017231 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-e5c78308-d3fe-4143-ac81-6862fb7356d3 tempest-ServersAdminNegativeTestJSON-1469067030 tempest-ServersAdminNegativeTestJSON-1469067030-project] HTTP exception thrown: Instance 93050da6-597e-4924-93bf-35295c1ba9e4 could not be found. Oct 04 21:30:20.018950 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e5c78308-d3fe-4143-ac81-6862fb7356d3 tempest-ServersAdminNegativeTestJSON-1469067030 tempest-ServersAdminNegativeTestJSON-1469067030-project] Request method failure captured: Oct 04 21:30:20.018950 n-d-854823-8 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/93050da6-597e-4924-93bf-35295c1ba9e4 HTTP/1.1 Oct 04 21:30:20.018950 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 21:30:20.018950 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 21:30:20.018950 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 21:30:20.018950 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 0 Oct 04 21:30:20.018950 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 21:30:20.018950 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 21:30:20.018950 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 21:30:20.018950 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 21:30:20.018950 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPKXZvD14PbOhhv9l8sDu_VgMTOu3m90fR_ymYOs_Ey9vabtXpD2IPh_NUfTSEKEC1Iodw2Z9uvjBZVpVItlwh5dAH0GECQ5ERAfBs21Nxqg79QRxzrlkuW8NSsnoSiXEehsZEiNnlDe1LTyTk7KjC7tuDTwVKuqN5Z_-U3WEdG6dA-M Oct 04 21:30:20.018950 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 21:30:20.018950 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 21:30:20.018950 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 21:30:20.018950 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 21:30:20.018950 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 21:30:20.018950 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 21:30:20.018950 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: ada14314366d4e548e8ab945840e7cd1 Oct 04 21:30:20.018950 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1469067030 Oct 04 21:30:20.018950 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 21:30:20.018950 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 21:30:20.018950 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ada14314366d4e548e8ab945840e7cd1", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ada14314366d4e548e8ab945840e7cd1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ada14314366d4e548e8ab945840e7cd1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ada14314366d4e548e8ab945840e7cd1"}]}] Oct 04 21:30:20.018950 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1469067030 Oct 04 21:30:20.018950 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: ada14314366d4e548e8ab945840e7cd1 Oct 04 21:30:20.018950 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1469067030 Oct 04 21:30:20.018950 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-ServersAdminNegativeTestJSON-1469067030-project Oct 04 21:30:20.018950 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 21:30:20.018950 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 21:30:20.018950 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: bcdcbe3585524e77b1893c97b3b6a364 Oct 04 21:30:20.018950 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1469067030-project Oct 04 21:30:20.018950 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 21:30:20.018950 n-d-854823-8 devstack@n-api.service[128801]: exception: Instance 93050da6-597e-4924-93bf-35295c1ba9e4 could not be found. Oct 04 21:30:20.018950 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': '93050da6-597e-4924-93bf-35295c1ba9e4'} Oct 04 21:30:20.018950 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:30:20.018950 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:30:20.018950 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:30:20.018950 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:30:20.018950 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:30:20.018950 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:30:20.018950 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:30:20.018950 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:30:20.018950 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:30:20.018950 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:30:20.018950 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 93050da6-597e-4924-93bf-35295c1ba9e4 could not be found. Oct 04 21:30:20.018950 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:30:20.018950 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:30:20.018950 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:30:20.018950 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:30:20.018950 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:30:20.018950 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:30:20.018950 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:30:20.018950 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:30:20.018950 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:30:20.018950 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:30:20.018950 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:30:20.018950 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:30:20.018950 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:30:20.018950 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:30:20.018950 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:30:20.018950 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:30:20.018950 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 93050da6-597e-4924-93bf-35295c1ba9e4 could not be found. Oct 04 21:30:20.018950 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:30:20.018950 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:30:20.023697 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:30:20.023697 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:30:20.023697 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:30:20.023697 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:30:20.023697 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:30:20.023697 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:30:20.023697 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 93050da6-597e-4924-93bf-35295c1ba9e4 could not be found. Oct 04 21:30:20.023697 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:30:20.023697 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e5c78308-d3fe-4143-ac81-6862fb7356d3 tempest-ServersAdminNegativeTestJSON-1469067030 tempest-ServersAdminNegativeTestJSON-1469067030-project] Returning 404 to user: Instance 93050da6-597e-4924-93bf-35295c1ba9e4 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:30:20.023697 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e5c78308-d3fe-4143-ac81-6862fb7356d3 tempest-ServersAdminNegativeTestJSON-1469067030 tempest-ServersAdminNegativeTestJSON-1469067030-project] 10.222.0.33 "GET /compute/v2.1/servers/93050da6-597e-4924-93bf-35295c1ba9e4" status: 404 len: 111 microversion: 2.1 time: 0.032074 Oct 04 21:30:20.023697 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3183/6401] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:30:19 2022] GET /compute/v2.1/servers/93050da6-597e-4924-93bf-35295c1ba9e4 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:30:26.351432 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell0:SELECT=2 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:30:26.352369 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell0:SELECT=3 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:30:26.469569 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-c5754c03-8f66-4426-a637-94883ba34bc5 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-2016032963", "imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63", "flavorRef": "452", "networks": [{"uuid": "1ae4e0f5-0175-48ee-85e8-dd821aacfc4b"}]}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:30:26.530052 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.network.neutron [None req-c5754c03-8f66-4426-a637-94883ba34bc5 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] validate_networks() for [('1ae4e0f5-0175-48ee-85e8-dd821aacfc4b', None, None, None, None, None)] {{(pid=128802) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:30:26.940707 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-c5754c03-8f66-4426-a637-94883ba34bc5 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Flavor limits 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:30:26.941141 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-c5754c03-8f66-4426-a637-94883ba34bc5 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Image limits 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:30:26.941634 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-c5754c03-8f66-4426-a637-94883ba34bc5 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Flavor pref 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:30:26.942059 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-c5754c03-8f66-4426-a637-94883ba34bc5 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Image pref 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:30:26.942524 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-c5754c03-8f66-4426-a637-94883ba34bc5 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:30:26.952643 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c5754c03-8f66-4426-a637-94883ba34bc5 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:26.953142 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c5754c03-8f66-4426-a637-94883ba34bc5 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:26.953618 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c5754c03-8f66-4426-a637-94883ba34bc5 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:26.954363 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c5754c03-8f66-4426-a637-94883ba34bc5 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:26.954848 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c5754c03-8f66-4426-a637-94883ba34bc5 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:26.955286 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c5754c03-8f66-4426-a637-94883ba34bc5 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:26.974663 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-c5754c03-8f66-4426-a637-94883ba34bc5 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Getting quotas for project 4c959eba3eb5483488c59e29b7186e86. Resources: {'ram', 'instances', 'cores'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:30:26.983792 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-c5754c03-8f66-4426-a637-94883ba34bc5 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Getting quotas for user cdcf08f79dcd48048dd51caa5acff372 and project 4c959eba3eb5483488c59e29b7186e86. Resources: {'ram', 'instances', 'cores'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:30:26.998396 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-c5754c03-8f66-4426-a637-94883ba34bc5 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Going to run 1 instances... {{(pid=128802) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:30:27.000728 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-c5754c03-8f66-4426-a637-94883ba34bc5 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] [instance: 37a6fa27-bb74-4db5-8a75-06e2d78cda98] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='15b24725-0c99-4bcf-b1fb-907cdf8e2d63',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128802) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:30:27.046824 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-c5754c03-8f66-4426-a637-94883ba34bc5 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.701556 Oct 04 21:30:27.047474 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3219/6402] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 21:30:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 703 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:30:27.059699 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c50e8379-336e-4316-8b40-eba5addf715a tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:27.060113 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c50e8379-336e-4316-8b40-eba5addf715a tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] [instance: 37a6fa27-bb74-4db5-8a75-06e2d78cda98] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:27.064314 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:30:27.065008 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=3 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:30:27.121415 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c50e8379-336e-4316-8b40-eba5addf715a tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcf08f79dcd48048dd51caa5acff372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c959eba3eb5483488c59e29b7186e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:27.128555 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c50e8379-336e-4316-8b40-eba5addf715a tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] 10.222.0.33 "GET /compute/v2.1/servers/37a6fa27-bb74-4db5-8a75-06e2d78cda98" status: 200 len: 1215 microversion: 2.1 time: 0.073264 Oct 04 21:30:27.129147 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3184/6403] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:30:27 2022] GET /compute/v2.1/servers/37a6fa27-bb74-4db5-8a75-06e2d78cda98 => generated 1215 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:30:28.153747 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-a4a08a56-7e6d-4eeb-ac5f-df714da34e43 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:28.154322 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-a4a08a56-7e6d-4eeb-ac5f-df714da34e43 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] [instance: 37a6fa27-bb74-4db5-8a75-06e2d78cda98] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:28.161717 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a4a08a56-7e6d-4eeb-ac5f-df714da34e43 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:28.162525 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a4a08a56-7e6d-4eeb-ac5f-df714da34e43 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:28.162667 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a4a08a56-7e6d-4eeb-ac5f-df714da34e43 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:28.163378 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a4a08a56-7e6d-4eeb-ac5f-df714da34e43 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:28.163841 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a4a08a56-7e6d-4eeb-ac5f-df714da34e43 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:28.164279 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a4a08a56-7e6d-4eeb-ac5f-df714da34e43 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:28.239764 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-a4a08a56-7e6d-4eeb-ac5f-df714da34e43 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcf08f79dcd48048dd51caa5acff372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c959eba3eb5483488c59e29b7186e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:28.254238 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-a4a08a56-7e6d-4eeb-ac5f-df714da34e43 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] 10.222.0.33 "GET /compute/v2.1/servers/37a6fa27-bb74-4db5-8a75-06e2d78cda98" status: 200 len: 1267 microversion: 2.1 time: 0.105484 Oct 04 21:30:28.254870 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3220/6404] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:30:28 2022] GET /compute/v2.1/servers/37a6fa27-bb74-4db5-8a75-06e2d78cda98 => generated 1267 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:30:29.277871 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-3b293424-c16d-4c47-9e2d-66676c94c0e2 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:29.278516 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-3b293424-c16d-4c47-9e2d-66676c94c0e2 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] [instance: 37a6fa27-bb74-4db5-8a75-06e2d78cda98] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:29.288062 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3b293424-c16d-4c47-9e2d-66676c94c0e2 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:29.288553 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3b293424-c16d-4c47-9e2d-66676c94c0e2 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:29.288985 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3b293424-c16d-4c47-9e2d-66676c94c0e2 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:29.289688 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3b293424-c16d-4c47-9e2d-66676c94c0e2 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:29.290141 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3b293424-c16d-4c47-9e2d-66676c94c0e2 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:29.290595 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3b293424-c16d-4c47-9e2d-66676c94c0e2 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:29.548139 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-3b293424-c16d-4c47-9e2d-66676c94c0e2 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcf08f79dcd48048dd51caa5acff372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c959eba3eb5483488c59e29b7186e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:29.560143 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-3b293424-c16d-4c47-9e2d-66676c94c0e2 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] 10.222.0.33 "GET /compute/v2.1/servers/37a6fa27-bb74-4db5-8a75-06e2d78cda98" status: 200 len: 1315 microversion: 2.1 time: 0.286129 Oct 04 21:30:29.576502 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3185/6405] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:30:29 2022] GET /compute/v2.1/servers/37a6fa27-bb74-4db5-8a75-06e2d78cda98 => generated 1315 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:30:30.301629 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-ec46ddf7-cc13-4089-8351-24de01138db7 req-a6721afd-c326-4a71-997d-2e67906c9fd4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37a6fa27-bb74-4db5-8a75-06e2d78cda98", "tag": "2381c867-5e4e-4c86-9926-90e1333c4a0d"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:30:30.315894 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-ec46ddf7-cc13-4089-8351-24de01138db7 req-a6721afd-c326-4a71-997d-2e67906c9fd4 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:30.316391 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-ec46ddf7-cc13-4089-8351-24de01138db7 req-a6721afd-c326-4a71-997d-2e67906c9fd4 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:30.316838 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-ec46ddf7-cc13-4089-8351-24de01138db7 req-a6721afd-c326-4a71-997d-2e67906c9fd4 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:30.328319 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-ec46ddf7-cc13-4089-8351-24de01138db7 req-a6721afd-c326-4a71-997d-2e67906c9fd4 service nova] Creating event network-changed:2381c867-5e4e-4c86-9926-90e1333c4a0d for instance 37a6fa27-bb74-4db5-8a75-06e2d78cda98 on n-h2-854823-8 Oct 04 21:30:30.333950 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-ec46ddf7-cc13-4089-8351-24de01138db7 req-a6721afd-c326-4a71-997d-2e67906c9fd4 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037018 Oct 04 21:30:30.334913 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3221/6406] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:30:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:30:30.583999 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-dd25a609-5a6a-436a-b674-ae0da38cb7b0 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:30.584621 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-dd25a609-5a6a-436a-b674-ae0da38cb7b0 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] [instance: 37a6fa27-bb74-4db5-8a75-06e2d78cda98] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:30.591860 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dd25a609-5a6a-436a-b674-ae0da38cb7b0 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:30.592427 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dd25a609-5a6a-436a-b674-ae0da38cb7b0 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:30.592950 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dd25a609-5a6a-436a-b674-ae0da38cb7b0 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:30.593664 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dd25a609-5a6a-436a-b674-ae0da38cb7b0 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:30.594127 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dd25a609-5a6a-436a-b674-ae0da38cb7b0 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:30.594577 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dd25a609-5a6a-436a-b674-ae0da38cb7b0 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:30.828527 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-dd25a609-5a6a-436a-b674-ae0da38cb7b0 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcf08f79dcd48048dd51caa5acff372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c959eba3eb5483488c59e29b7186e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:30.836414 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-dd25a609-5a6a-436a-b674-ae0da38cb7b0 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] 10.222.0.33 "GET /compute/v2.1/servers/37a6fa27-bb74-4db5-8a75-06e2d78cda98" status: 200 len: 1315 microversion: 2.1 time: 0.256529 Oct 04 21:30:30.837151 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3186/6407] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:30:30 2022] GET /compute/v2.1/servers/37a6fa27-bb74-4db5-8a75-06e2d78cda98 => generated 1315 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:30:31.861391 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-0bb95f26-055d-45ce-9c11-aca3e4ab3704 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:31.862115 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-0bb95f26-055d-45ce-9c11-aca3e4ab3704 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] [instance: 37a6fa27-bb74-4db5-8a75-06e2d78cda98] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:31.869377 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0bb95f26-055d-45ce-9c11-aca3e4ab3704 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:31.869894 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0bb95f26-055d-45ce-9c11-aca3e4ab3704 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:31.870371 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0bb95f26-055d-45ce-9c11-aca3e4ab3704 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:31.871138 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0bb95f26-055d-45ce-9c11-aca3e4ab3704 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:31.871613 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0bb95f26-055d-45ce-9c11-aca3e4ab3704 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:31.872059 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0bb95f26-055d-45ce-9c11-aca3e4ab3704 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:32.118401 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-0bb95f26-055d-45ce-9c11-aca3e4ab3704 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcf08f79dcd48048dd51caa5acff372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c959eba3eb5483488c59e29b7186e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:32.126850 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-0bb95f26-055d-45ce-9c11-aca3e4ab3704 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] 10.222.0.33 "GET /compute/v2.1/servers/37a6fa27-bb74-4db5-8a75-06e2d78cda98" status: 200 len: 1315 microversion: 2.1 time: 0.271014 Oct 04 21:30:32.127835 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3222/6408] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:30:31 2022] GET /compute/v2.1/servers/37a6fa27-bb74-4db5-8a75-06e2d78cda98 => generated 1315 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:30:33.150977 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-00556410-b6a4-4f14-8929-b06ac3787d1b tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:33.151791 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-00556410-b6a4-4f14-8929-b06ac3787d1b tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] [instance: 37a6fa27-bb74-4db5-8a75-06e2d78cda98] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:33.158840 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-00556410-b6a4-4f14-8929-b06ac3787d1b tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:33.159336 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-00556410-b6a4-4f14-8929-b06ac3787d1b tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:33.159773 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-00556410-b6a4-4f14-8929-b06ac3787d1b tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:33.160479 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-00556410-b6a4-4f14-8929-b06ac3787d1b tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:33.160940 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-00556410-b6a4-4f14-8929-b06ac3787d1b tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:33.161399 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-00556410-b6a4-4f14-8929-b06ac3787d1b tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:33.314180 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-00556410-b6a4-4f14-8929-b06ac3787d1b tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcf08f79dcd48048dd51caa5acff372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c959eba3eb5483488c59e29b7186e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:33.323698 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-00556410-b6a4-4f14-8929-b06ac3787d1b tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] 10.222.0.33 "GET /compute/v2.1/servers/37a6fa27-bb74-4db5-8a75-06e2d78cda98" status: 200 len: 1315 microversion: 2.1 time: 0.176628 Oct 04 21:30:33.324340 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3187/6409] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:30:33 2022] GET /compute/v2.1/servers/37a6fa27-bb74-4db5-8a75-06e2d78cda98 => generated 1315 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:30:34.347382 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-ede5842a-1c97-4257-bf5e-2a60ada612ab tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:34.347964 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-ede5842a-1c97-4257-bf5e-2a60ada612ab tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] [instance: 37a6fa27-bb74-4db5-8a75-06e2d78cda98] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:34.351771 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=7,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:30:34.357801 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ede5842a-1c97-4257-bf5e-2a60ada612ab tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:34.357801 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ede5842a-1c97-4257-bf5e-2a60ada612ab tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:34.358145 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ede5842a-1c97-4257-bf5e-2a60ada612ab tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:34.358941 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ede5842a-1c97-4257-bf5e-2a60ada612ab tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:34.359407 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ede5842a-1c97-4257-bf5e-2a60ada612ab tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:34.359844 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ede5842a-1c97-4257-bf5e-2a60ada612ab tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:34.363466 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:30:34.503216 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-ede5842a-1c97-4257-bf5e-2a60ada612ab tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcf08f79dcd48048dd51caa5acff372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c959eba3eb5483488c59e29b7186e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:34.511515 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-ede5842a-1c97-4257-bf5e-2a60ada612ab tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] 10.222.0.33 "GET /compute/v2.1/servers/37a6fa27-bb74-4db5-8a75-06e2d78cda98" status: 200 len: 1315 microversion: 2.1 time: 0.168131 Oct 04 21:30:34.512097 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3223/6410] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:30:34 2022] GET /compute/v2.1/servers/37a6fa27-bb74-4db5-8a75-06e2d78cda98 => generated 1315 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:30:35.277284 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-a6a82d97-85e1-477c-9a70-f6f55743aaf5 req-187c8f95-41b8-4b3a-8d2c-afced4dbba54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37a6fa27-bb74-4db5-8a75-06e2d78cda98", "name": "network-vif-plugged", "status": "completed", "tag": "2381c867-5e4e-4c86-9926-90e1333c4a0d"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:30:35.282949 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=1,nova_api:DELETE=3 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:30:35.289802 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-a6a82d97-85e1-477c-9a70-f6f55743aaf5 req-187c8f95-41b8-4b3a-8d2c-afced4dbba54 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:35.290281 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-a6a82d97-85e1-477c-9a70-f6f55743aaf5 req-187c8f95-41b8-4b3a-8d2c-afced4dbba54 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:35.290728 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-a6a82d97-85e1-477c-9a70-f6f55743aaf5 req-187c8f95-41b8-4b3a-8d2c-afced4dbba54 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:35.295094 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=68 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:30:35.303763 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-a6a82d97-85e1-477c-9a70-f6f55743aaf5 req-187c8f95-41b8-4b3a-8d2c-afced4dbba54 service nova] Creating event network-vif-plugged:2381c867-5e4e-4c86-9926-90e1333c4a0d for instance 37a6fa27-bb74-4db5-8a75-06e2d78cda98 on n-h2-854823-8 Oct 04 21:30:35.309369 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-a6a82d97-85e1-477c-9a70-f6f55743aaf5 req-187c8f95-41b8-4b3a-8d2c-afced4dbba54 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035820 Oct 04 21:30:35.309940 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3188/6411] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:30:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:30:35.535374 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-885e3548-cc22-41b2-8e49-8cd340051292 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:35.536003 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-885e3548-cc22-41b2-8e49-8cd340051292 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] [instance: 37a6fa27-bb74-4db5-8a75-06e2d78cda98] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:35.543924 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-885e3548-cc22-41b2-8e49-8cd340051292 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:35.544413 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-885e3548-cc22-41b2-8e49-8cd340051292 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:35.544856 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-885e3548-cc22-41b2-8e49-8cd340051292 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:35.545567 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-885e3548-cc22-41b2-8e49-8cd340051292 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:35.546076 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-885e3548-cc22-41b2-8e49-8cd340051292 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:35.546550 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-885e3548-cc22-41b2-8e49-8cd340051292 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:35.680938 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-885e3548-cc22-41b2-8e49-8cd340051292 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcf08f79dcd48048dd51caa5acff372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c959eba3eb5483488c59e29b7186e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:35.688846 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-885e3548-cc22-41b2-8e49-8cd340051292 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] 10.222.0.33 "GET /compute/v2.1/servers/37a6fa27-bb74-4db5-8a75-06e2d78cda98" status: 200 len: 1315 microversion: 2.1 time: 0.157338 Oct 04 21:30:35.689436 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3224/6412] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:30:35 2022] GET /compute/v2.1/servers/37a6fa27-bb74-4db5-8a75-06e2d78cda98 => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:30:36.715628 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2cbdb39a-f5a1-4769-a02f-e2a4d92a33c0 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:36.716243 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-2cbdb39a-f5a1-4769-a02f-e2a4d92a33c0 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] [instance: 37a6fa27-bb74-4db5-8a75-06e2d78cda98] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:36.722812 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2cbdb39a-f5a1-4769-a02f-e2a4d92a33c0 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:36.723292 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2cbdb39a-f5a1-4769-a02f-e2a4d92a33c0 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:36.723822 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2cbdb39a-f5a1-4769-a02f-e2a4d92a33c0 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:36.725397 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2cbdb39a-f5a1-4769-a02f-e2a4d92a33c0 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:36.725872 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2cbdb39a-f5a1-4769-a02f-e2a4d92a33c0 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:36.726333 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2cbdb39a-f5a1-4769-a02f-e2a4d92a33c0 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:36.863961 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-2cbdb39a-f5a1-4769-a02f-e2a4d92a33c0 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcf08f79dcd48048dd51caa5acff372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c959eba3eb5483488c59e29b7186e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:36.872480 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-2cbdb39a-f5a1-4769-a02f-e2a4d92a33c0 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] 10.222.0.33 "GET /compute/v2.1/servers/37a6fa27-bb74-4db5-8a75-06e2d78cda98" status: 200 len: 1502 microversion: 2.1 time: 0.162432 Oct 04 21:30:36.873057 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3189/6413] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:30:36 2022] GET /compute/v2.1/servers/37a6fa27-bb74-4db5-8a75-06e2d78cda98 => generated 1502 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:30:36.895137 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-702d0fa0-eb00-41b6-a588-5fb9736dcd24 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:30:36.898511 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-702d0fa0-eb00-41b6-a588-5fb9736dcd24 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] [instance: 37a6fa27-bb74-4db5-8a75-06e2d78cda98] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:36.905315 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-702d0fa0-eb00-41b6-a588-5fb9736dcd24 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:36.905844 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-702d0fa0-eb00-41b6-a588-5fb9736dcd24 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:36.906306 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-702d0fa0-eb00-41b6-a588-5fb9736dcd24 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:36.907041 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-702d0fa0-eb00-41b6-a588-5fb9736dcd24 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:36.907512 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-702d0fa0-eb00-41b6-a588-5fb9736dcd24 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:36.907952 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-702d0fa0-eb00-41b6-a588-5fb9736dcd24 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:36.937167 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-702d0fa0-eb00-41b6-a588-5fb9736dcd24 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'cdcf08f79dcd48048dd51caa5acff372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c959eba3eb5483488c59e29b7186e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:36.943096 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-702d0fa0-eb00-41b6-a588-5fb9736dcd24 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] [instance: 37a6fa27-bb74-4db5-8a75-06e2d78cda98] Old instance type m1.heat2, new instance type m1.heat {{(pid=128802) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 04 21:30:36.949632 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-702d0fa0-eb00-41b6-a588-5fb9736dcd24 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Flavor limits 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:30:36.950070 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-702d0fa0-eb00-41b6-a588-5fb9736dcd24 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Image limits 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:30:36.950606 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-702d0fa0-eb00-41b6-a588-5fb9736dcd24 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Flavor pref 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:30:36.951019 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-702d0fa0-eb00-41b6-a588-5fb9736dcd24 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Image pref 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:30:36.951445 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-702d0fa0-eb00-41b6-a588-5fb9736dcd24 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:30:36.967519 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell0:SELECT=2 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:30:36.992901 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell0:SELECT=6 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:30:37.022511 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-702d0fa0-eb00-41b6-a588-5fb9736dcd24 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] 10.222.0.33 "POST /compute/v2.1/servers/37a6fa27-bb74-4db5-8a75-06e2d78cda98/action" status: 202 len: 0 microversion: 2.1 time: 0.130858 Oct 04 21:30:37.023524 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3225/6414] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 21:30:36 2022] POST /compute/v2.1/servers/37a6fa27-bb74-4db5-8a75-06e2d78cda98/action => generated 0 bytes in 133 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:30:37.031659 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-3b5a50fe-86ae-4970-8bcd-3fd77dc7fe38 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:37.032280 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-3b5a50fe-86ae-4970-8bcd-3fd77dc7fe38 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] [instance: 37a6fa27-bb74-4db5-8a75-06e2d78cda98] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:37.045281 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3b5a50fe-86ae-4970-8bcd-3fd77dc7fe38 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:37.045853 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3b5a50fe-86ae-4970-8bcd-3fd77dc7fe38 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:37.046565 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3b5a50fe-86ae-4970-8bcd-3fd77dc7fe38 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:37.047517 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3b5a50fe-86ae-4970-8bcd-3fd77dc7fe38 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:37.047759 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3b5a50fe-86ae-4970-8bcd-3fd77dc7fe38 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:37.048195 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3b5a50fe-86ae-4970-8bcd-3fd77dc7fe38 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:37.125526 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:30:37.210269 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-3b5a50fe-86ae-4970-8bcd-3fd77dc7fe38 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcf08f79dcd48048dd51caa5acff372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c959eba3eb5483488c59e29b7186e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:37.219180 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-3b5a50fe-86ae-4970-8bcd-3fd77dc7fe38 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] 10.222.0.33 "GET /compute/v2.1/servers/37a6fa27-bb74-4db5-8a75-06e2d78cda98" status: 200 len: 1511 microversion: 2.1 time: 0.191252 Oct 04 21:30:37.219782 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3190/6415] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:30:37 2022] GET /compute/v2.1/servers/37a6fa27-bb74-4db5-8a75-06e2d78cda98 => generated 1511 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:30:38.244418 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-6127e10c-5b2f-42fd-9bae-d4f744e106f2 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:38.245078 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-6127e10c-5b2f-42fd-9bae-d4f744e106f2 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] [instance: 37a6fa27-bb74-4db5-8a75-06e2d78cda98] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:38.251206 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6127e10c-5b2f-42fd-9bae-d4f744e106f2 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:38.251708 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6127e10c-5b2f-42fd-9bae-d4f744e106f2 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:38.252162 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6127e10c-5b2f-42fd-9bae-d4f744e106f2 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:38.252878 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6127e10c-5b2f-42fd-9bae-d4f744e106f2 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:38.253349 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6127e10c-5b2f-42fd-9bae-d4f744e106f2 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:38.253789 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6127e10c-5b2f-42fd-9bae-d4f744e106f2 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:38.384799 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-6127e10c-5b2f-42fd-9bae-d4f744e106f2 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcf08f79dcd48048dd51caa5acff372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c959eba3eb5483488c59e29b7186e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:38.392972 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-6127e10c-5b2f-42fd-9bae-d4f744e106f2 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] 10.222.0.33 "GET /compute/v2.1/servers/37a6fa27-bb74-4db5-8a75-06e2d78cda98" status: 200 len: 1511 microversion: 2.1 time: 0.153679 Oct 04 21:30:38.393554 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3226/6416] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:30:38 2022] GET /compute/v2.1/servers/37a6fa27-bb74-4db5-8a75-06e2d78cda98 => generated 1511 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:30:39.417116 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5c2c1b70-1831-432e-9e6d-c7c86bbc3e6b tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:39.417729 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-5c2c1b70-1831-432e-9e6d-c7c86bbc3e6b tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] [instance: 37a6fa27-bb74-4db5-8a75-06e2d78cda98] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:39.424803 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5c2c1b70-1831-432e-9e6d-c7c86bbc3e6b tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:39.425289 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5c2c1b70-1831-432e-9e6d-c7c86bbc3e6b tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:39.427700 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5c2c1b70-1831-432e-9e6d-c7c86bbc3e6b tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:39.427700 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5c2c1b70-1831-432e-9e6d-c7c86bbc3e6b tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:39.427700 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5c2c1b70-1831-432e-9e6d-c7c86bbc3e6b tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:39.427700 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5c2c1b70-1831-432e-9e6d-c7c86bbc3e6b tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:39.572359 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-5c2c1b70-1831-432e-9e6d-c7c86bbc3e6b tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcf08f79dcd48048dd51caa5acff372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c959eba3eb5483488c59e29b7186e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:39.580942 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5c2c1b70-1831-432e-9e6d-c7c86bbc3e6b tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] 10.222.0.33 "GET /compute/v2.1/servers/37a6fa27-bb74-4db5-8a75-06e2d78cda98" status: 200 len: 1516 microversion: 2.1 time: 0.167557 Oct 04 21:30:39.581550 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3191/6417] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:30:39 2022] GET /compute/v2.1/servers/37a6fa27-bb74-4db5-8a75-06e2d78cda98 => generated 1516 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:30:40.606304 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-b649bd10-718c-4c2b-bef0-da35a22161f7 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:40.606958 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-b649bd10-718c-4c2b-bef0-da35a22161f7 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] [instance: 37a6fa27-bb74-4db5-8a75-06e2d78cda98] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:40.614718 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b649bd10-718c-4c2b-bef0-da35a22161f7 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:40.615263 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b649bd10-718c-4c2b-bef0-da35a22161f7 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:40.615712 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b649bd10-718c-4c2b-bef0-da35a22161f7 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:40.616445 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b649bd10-718c-4c2b-bef0-da35a22161f7 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:40.616916 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b649bd10-718c-4c2b-bef0-da35a22161f7 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:40.617363 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b649bd10-718c-4c2b-bef0-da35a22161f7 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:40.764279 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-b649bd10-718c-4c2b-bef0-da35a22161f7 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcf08f79dcd48048dd51caa5acff372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c959eba3eb5483488c59e29b7186e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:40.772959 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-b649bd10-718c-4c2b-bef0-da35a22161f7 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] 10.222.0.33 "GET /compute/v2.1/servers/37a6fa27-bb74-4db5-8a75-06e2d78cda98" status: 200 len: 1516 microversion: 2.1 time: 0.170801 Oct 04 21:30:40.773563 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3227/6418] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:30:40 2022] GET /compute/v2.1/servers/37a6fa27-bb74-4db5-8a75-06e2d78cda98 => generated 1516 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:30:41.796327 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1f749817-3aa2-4147-b743-19f9f834d055 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:41.796940 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-1f749817-3aa2-4147-b743-19f9f834d055 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] [instance: 37a6fa27-bb74-4db5-8a75-06e2d78cda98] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:41.804120 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1f749817-3aa2-4147-b743-19f9f834d055 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:41.804544 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1f749817-3aa2-4147-b743-19f9f834d055 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:41.804983 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1f749817-3aa2-4147-b743-19f9f834d055 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:41.805944 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1f749817-3aa2-4147-b743-19f9f834d055 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:41.806444 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1f749817-3aa2-4147-b743-19f9f834d055 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:41.806875 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1f749817-3aa2-4147-b743-19f9f834d055 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:41.945196 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-1f749817-3aa2-4147-b743-19f9f834d055 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcf08f79dcd48048dd51caa5acff372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c959eba3eb5483488c59e29b7186e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:41.953100 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-1f749817-3aa2-4147-b743-19f9f834d055 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] 10.222.0.33 "GET /compute/v2.1/servers/37a6fa27-bb74-4db5-8a75-06e2d78cda98" status: 200 len: 1516 microversion: 2.1 time: 0.160711 Oct 04 21:30:41.953685 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3192/6419] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:30:41 2022] GET /compute/v2.1/servers/37a6fa27-bb74-4db5-8a75-06e2d78cda98 => generated 1516 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:30:42.975675 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-e106eb7e-5aa0-4227-982c-67e82c624c04 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:42.976296 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-e106eb7e-5aa0-4227-982c-67e82c624c04 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] [instance: 37a6fa27-bb74-4db5-8a75-06e2d78cda98] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:42.983321 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e106eb7e-5aa0-4227-982c-67e82c624c04 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:42.983817 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e106eb7e-5aa0-4227-982c-67e82c624c04 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:42.984264 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e106eb7e-5aa0-4227-982c-67e82c624c04 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:42.984974 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e106eb7e-5aa0-4227-982c-67e82c624c04 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:42.985435 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e106eb7e-5aa0-4227-982c-67e82c624c04 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:42.985869 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e106eb7e-5aa0-4227-982c-67e82c624c04 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:43.121281 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-e106eb7e-5aa0-4227-982c-67e82c624c04 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcf08f79dcd48048dd51caa5acff372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c959eba3eb5483488c59e29b7186e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:43.130899 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-e106eb7e-5aa0-4227-982c-67e82c624c04 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] 10.222.0.33 "GET /compute/v2.1/servers/37a6fa27-bb74-4db5-8a75-06e2d78cda98" status: 200 len: 1516 microversion: 2.1 time: 0.157664 Oct 04 21:30:43.130899 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3228/6420] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:30:42 2022] GET /compute/v2.1/servers/37a6fa27-bb74-4db5-8a75-06e2d78cda98 => generated 1516 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:30:44.153270 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2513a088-a10b-40e5-bec4-c941a87e845d tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:44.153885 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-2513a088-a10b-40e5-bec4-c941a87e845d tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] [instance: 37a6fa27-bb74-4db5-8a75-06e2d78cda98] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:44.160933 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2513a088-a10b-40e5-bec4-c941a87e845d tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:44.161471 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2513a088-a10b-40e5-bec4-c941a87e845d tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:44.161908 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2513a088-a10b-40e5-bec4-c941a87e845d tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:44.163241 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2513a088-a10b-40e5-bec4-c941a87e845d tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:44.163241 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2513a088-a10b-40e5-bec4-c941a87e845d tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:44.163898 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2513a088-a10b-40e5-bec4-c941a87e845d tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:44.302543 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-2513a088-a10b-40e5-bec4-c941a87e845d tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcf08f79dcd48048dd51caa5acff372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c959eba3eb5483488c59e29b7186e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:44.312779 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-2513a088-a10b-40e5-bec4-c941a87e845d tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] 10.222.0.33 "GET /compute/v2.1/servers/37a6fa27-bb74-4db5-8a75-06e2d78cda98" status: 200 len: 1516 microversion: 2.1 time: 0.163249 Oct 04 21:30:44.313404 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3193/6421] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:30:44 2022] GET /compute/v2.1/servers/37a6fa27-bb74-4db5-8a75-06e2d78cda98 => generated 1516 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:30:45.336691 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-518f2989-80ac-4717-8039-d7c95a246e98 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:45.337335 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-518f2989-80ac-4717-8039-d7c95a246e98 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] [instance: 37a6fa27-bb74-4db5-8a75-06e2d78cda98] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:45.344112 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-518f2989-80ac-4717-8039-d7c95a246e98 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:45.344610 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-518f2989-80ac-4717-8039-d7c95a246e98 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:45.345058 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-518f2989-80ac-4717-8039-d7c95a246e98 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:45.345760 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-518f2989-80ac-4717-8039-d7c95a246e98 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:45.346220 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-518f2989-80ac-4717-8039-d7c95a246e98 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:45.346686 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-518f2989-80ac-4717-8039-d7c95a246e98 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:45.483028 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-518f2989-80ac-4717-8039-d7c95a246e98 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcf08f79dcd48048dd51caa5acff372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c959eba3eb5483488c59e29b7186e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:45.491053 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-518f2989-80ac-4717-8039-d7c95a246e98 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] 10.222.0.33 "GET /compute/v2.1/servers/37a6fa27-bb74-4db5-8a75-06e2d78cda98" status: 200 len: 1516 microversion: 2.1 time: 0.159040 Oct 04 21:30:45.491627 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3229/6422] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:30:45 2022] GET /compute/v2.1/servers/37a6fa27-bb74-4db5-8a75-06e2d78cda98 => generated 1516 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:30:46.515968 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2a458dc0-ede2-4595-ae94-654cf4638c6d tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:46.516580 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-2a458dc0-ede2-4595-ae94-654cf4638c6d tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] [instance: 37a6fa27-bb74-4db5-8a75-06e2d78cda98] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:46.524578 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2a458dc0-ede2-4595-ae94-654cf4638c6d tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:46.525070 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2a458dc0-ede2-4595-ae94-654cf4638c6d tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:46.525512 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2a458dc0-ede2-4595-ae94-654cf4638c6d tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:46.526222 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2a458dc0-ede2-4595-ae94-654cf4638c6d tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:46.526709 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2a458dc0-ede2-4595-ae94-654cf4638c6d tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:46.527141 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2a458dc0-ede2-4595-ae94-654cf4638c6d tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:46.659534 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-2a458dc0-ede2-4595-ae94-654cf4638c6d tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcf08f79dcd48048dd51caa5acff372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c959eba3eb5483488c59e29b7186e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:46.668438 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-2a458dc0-ede2-4595-ae94-654cf4638c6d tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] 10.222.0.33 "GET /compute/v2.1/servers/37a6fa27-bb74-4db5-8a75-06e2d78cda98" status: 200 len: 1516 microversion: 2.1 time: 0.156543 Oct 04 21:30:46.669028 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3194/6423] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:30:46 2022] GET /compute/v2.1/servers/37a6fa27-bb74-4db5-8a75-06e2d78cda98 => generated 1516 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:30:47.695016 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-5c455092-5167-49f7-ad7e-813bbb7d52eb tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:47.695816 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-5c455092-5167-49f7-ad7e-813bbb7d52eb tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] [instance: 37a6fa27-bb74-4db5-8a75-06e2d78cda98] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:47.703393 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5c455092-5167-49f7-ad7e-813bbb7d52eb tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:47.704082 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5c455092-5167-49f7-ad7e-813bbb7d52eb tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:47.704711 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5c455092-5167-49f7-ad7e-813bbb7d52eb tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:47.705625 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5c455092-5167-49f7-ad7e-813bbb7d52eb tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:47.706175 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5c455092-5167-49f7-ad7e-813bbb7d52eb tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:47.706714 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5c455092-5167-49f7-ad7e-813bbb7d52eb tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:47.858937 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-5c455092-5167-49f7-ad7e-813bbb7d52eb tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcf08f79dcd48048dd51caa5acff372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c959eba3eb5483488c59e29b7186e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:47.867872 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-5c455092-5167-49f7-ad7e-813bbb7d52eb tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] 10.222.0.33 "GET /compute/v2.1/servers/37a6fa27-bb74-4db5-8a75-06e2d78cda98" status: 200 len: 1516 microversion: 2.1 time: 0.179246 Oct 04 21:30:47.868531 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3230/6424] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:30:47 2022] GET /compute/v2.1/servers/37a6fa27-bb74-4db5-8a75-06e2d78cda98 => generated 1516 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:30:48.892411 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b3328d56-d7f3-4de6-b8b8-673f24b8dd2c tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:48.893244 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b3328d56-d7f3-4de6-b8b8-673f24b8dd2c tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] [instance: 37a6fa27-bb74-4db5-8a75-06e2d78cda98] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:48.901051 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b3328d56-d7f3-4de6-b8b8-673f24b8dd2c tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:48.901590 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b3328d56-d7f3-4de6-b8b8-673f24b8dd2c tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:48.902087 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b3328d56-d7f3-4de6-b8b8-673f24b8dd2c tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:48.902879 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b3328d56-d7f3-4de6-b8b8-673f24b8dd2c tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:48.903399 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b3328d56-d7f3-4de6-b8b8-673f24b8dd2c tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:48.903859 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b3328d56-d7f3-4de6-b8b8-673f24b8dd2c tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:49.050911 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-b3328d56-d7f3-4de6-b8b8-673f24b8dd2c tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcf08f79dcd48048dd51caa5acff372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c959eba3eb5483488c59e29b7186e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:49.060163 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b3328d56-d7f3-4de6-b8b8-673f24b8dd2c tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] 10.222.0.33 "GET /compute/v2.1/servers/37a6fa27-bb74-4db5-8a75-06e2d78cda98" status: 200 len: 1516 microversion: 2.1 time: 0.171633 Oct 04 21:30:49.060758 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3195/6425] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:30:48 2022] GET /compute/v2.1/servers/37a6fa27-bb74-4db5-8a75-06e2d78cda98 => generated 1516 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:30:50.099155 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-df27f9b3-c178-431d-ba74-086653890969 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:50.099929 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-df27f9b3-c178-431d-ba74-086653890969 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] [instance: 37a6fa27-bb74-4db5-8a75-06e2d78cda98] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:50.107317 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-df27f9b3-c178-431d-ba74-086653890969 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:50.107943 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-df27f9b3-c178-431d-ba74-086653890969 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:50.108474 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-df27f9b3-c178-431d-ba74-086653890969 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:50.109372 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-df27f9b3-c178-431d-ba74-086653890969 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:50.110090 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-df27f9b3-c178-431d-ba74-086653890969 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:50.110654 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-df27f9b3-c178-431d-ba74-086653890969 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:50.259455 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-df27f9b3-c178-431d-ba74-086653890969 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcf08f79dcd48048dd51caa5acff372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c959eba3eb5483488c59e29b7186e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:50.267596 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-df27f9b3-c178-431d-ba74-086653890969 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] 10.222.0.33 "GET /compute/v2.1/servers/37a6fa27-bb74-4db5-8a75-06e2d78cda98" status: 200 len: 1516 microversion: 2.1 time: 0.172721 Oct 04 21:30:50.268174 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3231/6426] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:30:50 2022] GET /compute/v2.1/servers/37a6fa27-bb74-4db5-8a75-06e2d78cda98 => generated 1516 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:30:51.294597 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d49b0df5-f341-4951-b830-8d012cfc2cf8 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:51.295787 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d49b0df5-f341-4951-b830-8d012cfc2cf8 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] [instance: 37a6fa27-bb74-4db5-8a75-06e2d78cda98] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:51.310051 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d49b0df5-f341-4951-b830-8d012cfc2cf8 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:51.310982 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d49b0df5-f341-4951-b830-8d012cfc2cf8 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:51.311690 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d49b0df5-f341-4951-b830-8d012cfc2cf8 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:51.312941 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d49b0df5-f341-4951-b830-8d012cfc2cf8 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:51.313737 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d49b0df5-f341-4951-b830-8d012cfc2cf8 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:51.314533 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d49b0df5-f341-4951-b830-8d012cfc2cf8 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:51.500621 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d49b0df5-f341-4951-b830-8d012cfc2cf8 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcf08f79dcd48048dd51caa5acff372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c959eba3eb5483488c59e29b7186e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:51.515400 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d49b0df5-f341-4951-b830-8d012cfc2cf8 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] 10.222.0.33 "GET /compute/v2.1/servers/37a6fa27-bb74-4db5-8a75-06e2d78cda98" status: 200 len: 1516 microversion: 2.1 time: 0.225318 Oct 04 21:30:51.516407 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3196/6427] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:30:51 2022] GET /compute/v2.1/servers/37a6fa27-bb74-4db5-8a75-06e2d78cda98 => generated 1516 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:30:52.542159 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-2ab0a2b1-6f7e-4aae-a568-242c7693ec87 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:52.542888 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-2ab0a2b1-6f7e-4aae-a568-242c7693ec87 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] [instance: 37a6fa27-bb74-4db5-8a75-06e2d78cda98] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:52.550000 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2ab0a2b1-6f7e-4aae-a568-242c7693ec87 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:52.550552 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2ab0a2b1-6f7e-4aae-a568-242c7693ec87 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:52.551005 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2ab0a2b1-6f7e-4aae-a568-242c7693ec87 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:52.551767 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2ab0a2b1-6f7e-4aae-a568-242c7693ec87 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:52.552249 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2ab0a2b1-6f7e-4aae-a568-242c7693ec87 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:52.552791 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2ab0a2b1-6f7e-4aae-a568-242c7693ec87 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:52.697323 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-2ab0a2b1-6f7e-4aae-a568-242c7693ec87 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcf08f79dcd48048dd51caa5acff372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c959eba3eb5483488c59e29b7186e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:52.706334 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-2ab0a2b1-6f7e-4aae-a568-242c7693ec87 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] 10.222.0.33 "GET /compute/v2.1/servers/37a6fa27-bb74-4db5-8a75-06e2d78cda98" status: 200 len: 1516 microversion: 2.1 time: 0.168102 Oct 04 21:30:52.707018 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3232/6428] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:30:52 2022] GET /compute/v2.1/servers/37a6fa27-bb74-4db5-8a75-06e2d78cda98 => generated 1516 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:30:53.730967 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ecd2fe02-e18b-44f9-b15a-0a9bc747a68e tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:53.731581 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ecd2fe02-e18b-44f9-b15a-0a9bc747a68e tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] [instance: 37a6fa27-bb74-4db5-8a75-06e2d78cda98] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:53.738921 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ecd2fe02-e18b-44f9-b15a-0a9bc747a68e tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:53.739956 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ecd2fe02-e18b-44f9-b15a-0a9bc747a68e tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:53.740388 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ecd2fe02-e18b-44f9-b15a-0a9bc747a68e tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:53.741208 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ecd2fe02-e18b-44f9-b15a-0a9bc747a68e tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:53.741708 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ecd2fe02-e18b-44f9-b15a-0a9bc747a68e tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:53.742131 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ecd2fe02-e18b-44f9-b15a-0a9bc747a68e tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:53.893821 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-ecd2fe02-e18b-44f9-b15a-0a9bc747a68e tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcf08f79dcd48048dd51caa5acff372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c959eba3eb5483488c59e29b7186e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:53.903197 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ecd2fe02-e18b-44f9-b15a-0a9bc747a68e tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] 10.222.0.33 "GET /compute/v2.1/servers/37a6fa27-bb74-4db5-8a75-06e2d78cda98" status: 200 len: 1516 microversion: 2.1 time: 0.175939 Oct 04 21:30:53.903838 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3197/6429] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:30:53 2022] GET /compute/v2.1/servers/37a6fa27-bb74-4db5-8a75-06e2d78cda98 => generated 1516 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:30:54.929352 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-82724d2f-b80d-4735-a8f6-150229facf0d tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:54.930077 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-82724d2f-b80d-4735-a8f6-150229facf0d tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] [instance: 37a6fa27-bb74-4db5-8a75-06e2d78cda98] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:54.943468 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-82724d2f-b80d-4735-a8f6-150229facf0d tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:54.943935 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-82724d2f-b80d-4735-a8f6-150229facf0d tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:54.944768 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-82724d2f-b80d-4735-a8f6-150229facf0d tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:54.946171 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-82724d2f-b80d-4735-a8f6-150229facf0d tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:54.947098 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-82724d2f-b80d-4735-a8f6-150229facf0d tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:54.947651 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-82724d2f-b80d-4735-a8f6-150229facf0d tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:55.106517 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-82724d2f-b80d-4735-a8f6-150229facf0d tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcf08f79dcd48048dd51caa5acff372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c959eba3eb5483488c59e29b7186e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:55.118172 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-82724d2f-b80d-4735-a8f6-150229facf0d tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] 10.222.0.33 "GET /compute/v2.1/servers/37a6fa27-bb74-4db5-8a75-06e2d78cda98" status: 200 len: 1516 microversion: 2.1 time: 0.194070 Oct 04 21:30:55.118914 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3233/6430] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:30:54 2022] GET /compute/v2.1/servers/37a6fa27-bb74-4db5-8a75-06e2d78cda98 => generated 1516 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:30:56.143106 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c79d20e1-3a86-4e38-b23c-a0d29d7d16cf tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:56.144098 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c79d20e1-3a86-4e38-b23c-a0d29d7d16cf tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] [instance: 37a6fa27-bb74-4db5-8a75-06e2d78cda98] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:56.152407 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c79d20e1-3a86-4e38-b23c-a0d29d7d16cf tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:56.152958 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c79d20e1-3a86-4e38-b23c-a0d29d7d16cf tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:56.153393 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c79d20e1-3a86-4e38-b23c-a0d29d7d16cf tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:56.154137 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c79d20e1-3a86-4e38-b23c-a0d29d7d16cf tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:56.154684 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c79d20e1-3a86-4e38-b23c-a0d29d7d16cf tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:56.155119 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c79d20e1-3a86-4e38-b23c-a0d29d7d16cf tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:56.350509 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c79d20e1-3a86-4e38-b23c-a0d29d7d16cf tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcf08f79dcd48048dd51caa5acff372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c959eba3eb5483488c59e29b7186e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:56.359609 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c79d20e1-3a86-4e38-b23c-a0d29d7d16cf tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] 10.222.0.33 "GET /compute/v2.1/servers/37a6fa27-bb74-4db5-8a75-06e2d78cda98" status: 200 len: 1516 microversion: 2.1 time: 0.220662 Oct 04 21:30:56.360218 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3198/6431] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:30:56 2022] GET /compute/v2.1/servers/37a6fa27-bb74-4db5-8a75-06e2d78cda98 => generated 1516 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:30:57.385422 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-82ce0ef3-25a2-4d47-bce8-49b2e906e862 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:57.386051 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-82ce0ef3-25a2-4d47-bce8-49b2e906e862 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] [instance: 37a6fa27-bb74-4db5-8a75-06e2d78cda98] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:57.389159 n-d-854823-8 devstack@n-api.service[128802]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 21:30:57.389317 n-d-854823-8 devstack@n-api.service[128802]: Tue Oct 4 21:30:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/37a6fa27-bb74-4db5-8a75-06e2d78cda98 (ip 10.222.0.33) !!! Oct 04 21:30:57.397401 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-82ce0ef3-25a2-4d47-bce8-49b2e906e862 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:57.397892 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-82ce0ef3-25a2-4d47-bce8-49b2e906e862 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:57.398390 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-82ce0ef3-25a2-4d47-bce8-49b2e906e862 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:57.399116 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-82ce0ef3-25a2-4d47-bce8-49b2e906e862 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:57.399588 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-82ce0ef3-25a2-4d47-bce8-49b2e906e862 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:57.400034 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-82ce0ef3-25a2-4d47-bce8-49b2e906e862 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:57.556983 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-82ce0ef3-25a2-4d47-bce8-49b2e906e862 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcf08f79dcd48048dd51caa5acff372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c959eba3eb5483488c59e29b7186e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:57.565682 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-82ce0ef3-25a2-4d47-bce8-49b2e906e862 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] 10.222.0.33 "GET /compute/v2.1/servers/37a6fa27-bb74-4db5-8a75-06e2d78cda98" status: 200 len: 1516 microversion: 2.1 time: 0.184914 Oct 04 21:30:57.566378 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3234/6432] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:30:57 2022] GET /compute/v2.1/servers/37a6fa27-bb74-4db5-8a75-06e2d78cda98 => generated 1516 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:30:58.591597 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-4e4426e1-9cbe-468d-8555-491b6eeb980a tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:58.592221 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-4e4426e1-9cbe-468d-8555-491b6eeb980a tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] [instance: 37a6fa27-bb74-4db5-8a75-06e2d78cda98] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:58.594584 n-d-854823-8 devstack@n-api.service[128801]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 21:30:58.594734 n-d-854823-8 devstack@n-api.service[128801]: Tue Oct 4 21:30:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/37a6fa27-bb74-4db5-8a75-06e2d78cda98 (ip 10.222.0.33) !!! Oct 04 21:30:58.604534 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4e4426e1-9cbe-468d-8555-491b6eeb980a tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:58.605032 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4e4426e1-9cbe-468d-8555-491b6eeb980a tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:58.605507 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4e4426e1-9cbe-468d-8555-491b6eeb980a tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:58.606315 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4e4426e1-9cbe-468d-8555-491b6eeb980a tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:58.606816 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4e4426e1-9cbe-468d-8555-491b6eeb980a tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:58.607249 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4e4426e1-9cbe-468d-8555-491b6eeb980a tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:58.763571 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-4e4426e1-9cbe-468d-8555-491b6eeb980a tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcf08f79dcd48048dd51caa5acff372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c959eba3eb5483488c59e29b7186e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:58.772199 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-4e4426e1-9cbe-468d-8555-491b6eeb980a tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] 10.222.0.33 "GET /compute/v2.1/servers/37a6fa27-bb74-4db5-8a75-06e2d78cda98" status: 200 len: 1516 microversion: 2.1 time: 0.184832 Oct 04 21:30:58.772788 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3199/6433] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:30:58 2022] GET /compute/v2.1/servers/37a6fa27-bb74-4db5-8a75-06e2d78cda98 => generated 1516 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:30:59.797293 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-13c49f0e-9d9b-41df-85a6-9b71dc0d054a tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:30:59.797975 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-13c49f0e-9d9b-41df-85a6-9b71dc0d054a tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] [instance: 37a6fa27-bb74-4db5-8a75-06e2d78cda98] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:30:59.806595 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-13c49f0e-9d9b-41df-85a6-9b71dc0d054a tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:59.807178 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-13c49f0e-9d9b-41df-85a6-9b71dc0d054a tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:59.807635 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-13c49f0e-9d9b-41df-85a6-9b71dc0d054a tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:59.808458 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-13c49f0e-9d9b-41df-85a6-9b71dc0d054a tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:30:59.808979 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-13c49f0e-9d9b-41df-85a6-9b71dc0d054a tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:30:59.809468 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-13c49f0e-9d9b-41df-85a6-9b71dc0d054a tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:30:59.965091 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-13c49f0e-9d9b-41df-85a6-9b71dc0d054a tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcf08f79dcd48048dd51caa5acff372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c959eba3eb5483488c59e29b7186e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:30:59.974806 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-13c49f0e-9d9b-41df-85a6-9b71dc0d054a tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] 10.222.0.33 "GET /compute/v2.1/servers/37a6fa27-bb74-4db5-8a75-06e2d78cda98" status: 200 len: 1516 microversion: 2.1 time: 0.181278 Oct 04 21:30:59.975579 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3235/6434] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:30:59 2022] GET /compute/v2.1/servers/37a6fa27-bb74-4db5-8a75-06e2d78cda98 => generated 1516 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:31:01.001193 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-140a4281-d2ca-44fd-9128-ed64652198e6 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:31:01.001770 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-140a4281-d2ca-44fd-9128-ed64652198e6 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] [instance: 37a6fa27-bb74-4db5-8a75-06e2d78cda98] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:01.009467 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-140a4281-d2ca-44fd-9128-ed64652198e6 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:01.009959 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-140a4281-d2ca-44fd-9128-ed64652198e6 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:01.010420 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-140a4281-d2ca-44fd-9128-ed64652198e6 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:01.011149 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-140a4281-d2ca-44fd-9128-ed64652198e6 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:01.011604 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-140a4281-d2ca-44fd-9128-ed64652198e6 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:01.012027 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-140a4281-d2ca-44fd-9128-ed64652198e6 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:01.179598 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-140a4281-d2ca-44fd-9128-ed64652198e6 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcf08f79dcd48048dd51caa5acff372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c959eba3eb5483488c59e29b7186e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:31:01.188305 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-140a4281-d2ca-44fd-9128-ed64652198e6 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] 10.222.0.33 "GET /compute/v2.1/servers/37a6fa27-bb74-4db5-8a75-06e2d78cda98" status: 200 len: 1516 microversion: 2.1 time: 0.192116 Oct 04 21:31:01.188944 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3200/6435] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:31:00 2022] GET /compute/v2.1/servers/37a6fa27-bb74-4db5-8a75-06e2d78cda98 => generated 1516 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:31:02.215023 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-f123c533-704c-4b14-ac9b-115714109da8 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:31:02.215733 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-f123c533-704c-4b14-ac9b-115714109da8 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] [instance: 37a6fa27-bb74-4db5-8a75-06e2d78cda98] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:02.224969 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f123c533-704c-4b14-ac9b-115714109da8 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:02.225663 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f123c533-704c-4b14-ac9b-115714109da8 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:02.226272 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f123c533-704c-4b14-ac9b-115714109da8 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:02.227340 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f123c533-704c-4b14-ac9b-115714109da8 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:02.228004 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f123c533-704c-4b14-ac9b-115714109da8 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:02.228492 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f123c533-704c-4b14-ac9b-115714109da8 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:02.397916 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-f123c533-704c-4b14-ac9b-115714109da8 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcf08f79dcd48048dd51caa5acff372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c959eba3eb5483488c59e29b7186e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:31:02.406179 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-f123c533-704c-4b14-ac9b-115714109da8 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] 10.222.0.33 "GET /compute/v2.1/servers/37a6fa27-bb74-4db5-8a75-06e2d78cda98" status: 200 len: 1516 microversion: 2.1 time: 0.196577 Oct 04 21:31:02.406956 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3236/6436] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:31:02 2022] GET /compute/v2.1/servers/37a6fa27-bb74-4db5-8a75-06e2d78cda98 => generated 1516 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:31:03.431759 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ba41b4c0-f823-49c9-ac8c-eb2c2b564ef7 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:31:03.432378 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ba41b4c0-f823-49c9-ac8c-eb2c2b564ef7 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] [instance: 37a6fa27-bb74-4db5-8a75-06e2d78cda98] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:03.439003 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ba41b4c0-f823-49c9-ac8c-eb2c2b564ef7 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:03.439494 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ba41b4c0-f823-49c9-ac8c-eb2c2b564ef7 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:03.439935 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ba41b4c0-f823-49c9-ac8c-eb2c2b564ef7 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:03.440634 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ba41b4c0-f823-49c9-ac8c-eb2c2b564ef7 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:03.441098 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ba41b4c0-f823-49c9-ac8c-eb2c2b564ef7 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:03.441533 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ba41b4c0-f823-49c9-ac8c-eb2c2b564ef7 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:03.606285 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-ba41b4c0-f823-49c9-ac8c-eb2c2b564ef7 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcf08f79dcd48048dd51caa5acff372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c959eba3eb5483488c59e29b7186e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:31:03.614916 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ba41b4c0-f823-49c9-ac8c-eb2c2b564ef7 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] 10.222.0.33 "GET /compute/v2.1/servers/37a6fa27-bb74-4db5-8a75-06e2d78cda98" status: 200 len: 1516 microversion: 2.1 time: 0.186871 Oct 04 21:31:03.615531 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3201/6437] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:31:03 2022] GET /compute/v2.1/servers/37a6fa27-bb74-4db5-8a75-06e2d78cda98 => generated 1516 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:31:04.639790 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-d8d8c0d9-cced-4258-99fc-669b69590551 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:31:04.640451 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-d8d8c0d9-cced-4258-99fc-669b69590551 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] [instance: 37a6fa27-bb74-4db5-8a75-06e2d78cda98] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:04.643397 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_api:SELECT=32 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:31:04.650272 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d8d8c0d9-cced-4258-99fc-669b69590551 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:04.650785 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d8d8c0d9-cced-4258-99fc-669b69590551 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:04.651238 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d8d8c0d9-cced-4258-99fc-669b69590551 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:04.651963 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d8d8c0d9-cced-4258-99fc-669b69590551 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:04.652443 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d8d8c0d9-cced-4258-99fc-669b69590551 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:04.652884 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d8d8c0d9-cced-4258-99fc-669b69590551 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:04.655986 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:31:04.798460 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-d8d8c0d9-cced-4258-99fc-669b69590551 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcf08f79dcd48048dd51caa5acff372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c959eba3eb5483488c59e29b7186e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:31:04.810785 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-d8d8c0d9-cced-4258-99fc-669b69590551 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] 10.222.0.33 "GET /compute/v2.1/servers/37a6fa27-bb74-4db5-8a75-06e2d78cda98" status: 200 len: 1516 microversion: 2.1 time: 0.174541 Oct 04 21:31:04.811821 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3237/6438] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:31:04 2022] GET /compute/v2.1/servers/37a6fa27-bb74-4db5-8a75-06e2d78cda98 => generated 1516 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:31:05.840038 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-4de29dea-5167-4dae-8e4f-193b203b6743 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:31:05.840791 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-4de29dea-5167-4dae-8e4f-193b203b6743 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] [instance: 37a6fa27-bb74-4db5-8a75-06e2d78cda98] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:05.849171 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4de29dea-5167-4dae-8e4f-193b203b6743 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:05.849661 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4de29dea-5167-4dae-8e4f-193b203b6743 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:05.850095 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4de29dea-5167-4dae-8e4f-193b203b6743 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:05.850915 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4de29dea-5167-4dae-8e4f-193b203b6743 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:05.851379 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4de29dea-5167-4dae-8e4f-193b203b6743 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:05.852003 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4de29dea-5167-4dae-8e4f-193b203b6743 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:05.857101 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=80 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:31:06.006409 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-4de29dea-5167-4dae-8e4f-193b203b6743 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcf08f79dcd48048dd51caa5acff372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c959eba3eb5483488c59e29b7186e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:31:06.014297 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-4de29dea-5167-4dae-8e4f-193b203b6743 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] 10.222.0.33 "GET /compute/v2.1/servers/37a6fa27-bb74-4db5-8a75-06e2d78cda98" status: 200 len: 1516 microversion: 2.1 time: 0.179343 Oct 04 21:31:06.014911 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3202/6439] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:31:05 2022] GET /compute/v2.1/servers/37a6fa27-bb74-4db5-8a75-06e2d78cda98 => generated 1516 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:31:06.942681 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-b3e08b59-0c2b-48c0-b34a-6d134ab9e5c4 req-e8eba8c5-5766-4679-9c0c-761a622d19ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37a6fa27-bb74-4db5-8a75-06e2d78cda98", "name": "network-vif-unplugged", "status": "completed", "tag": "2381c867-5e4e-4c86-9926-90e1333c4a0d"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:31:06.955489 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-b3e08b59-0c2b-48c0-b34a-6d134ab9e5c4 req-e8eba8c5-5766-4679-9c0c-761a622d19ba service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:06.955980 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-b3e08b59-0c2b-48c0-b34a-6d134ab9e5c4 req-e8eba8c5-5766-4679-9c0c-761a622d19ba service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:06.956424 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-b3e08b59-0c2b-48c0-b34a-6d134ab9e5c4 req-e8eba8c5-5766-4679-9c0c-761a622d19ba service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:06.976912 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-b3e08b59-0c2b-48c0-b34a-6d134ab9e5c4 req-e8eba8c5-5766-4679-9c0c-761a622d19ba service nova] Creating event network-vif-unplugged:2381c867-5e4e-4c86-9926-90e1333c4a0d for instance 37a6fa27-bb74-4db5-8a75-06e2d78cda98 on n-h1-854823-8 Oct 04 21:31:06.985913 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [req-b3e08b59-0c2b-48c0-b34a-6d134ab9e5c4 req-e8eba8c5-5766-4679-9c0c-761a622d19ba service nova] Instance 37a6fa27-bb74-4db5-8a75-06e2d78cda98 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854823-8', 'n-h2-854823-8'} {{(pid=128802) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 21:31:06.998859 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-b3e08b59-0c2b-48c0-b34a-6d134ab9e5c4 req-e8eba8c5-5766-4679-9c0c-761a622d19ba service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.060542 Oct 04 21:31:06.999501 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3238/6440] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:31:06 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:31:07.041161 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8bc112b3-e95c-4c3a-a0f8-a19543c97b94 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:31:07.042462 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-8bc112b3-e95c-4c3a-a0f8-a19543c97b94 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] [instance: 37a6fa27-bb74-4db5-8a75-06e2d78cda98] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:07.045354 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=30 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:31:07.051127 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8bc112b3-e95c-4c3a-a0f8-a19543c97b94 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:07.051655 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8bc112b3-e95c-4c3a-a0f8-a19543c97b94 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:07.052069 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8bc112b3-e95c-4c3a-a0f8-a19543c97b94 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:07.052785 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8bc112b3-e95c-4c3a-a0f8-a19543c97b94 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:07.053247 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8bc112b3-e95c-4c3a-a0f8-a19543c97b94 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:07.053666 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8bc112b3-e95c-4c3a-a0f8-a19543c97b94 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:07.210545 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-8bc112b3-e95c-4c3a-a0f8-a19543c97b94 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcf08f79dcd48048dd51caa5acff372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c959eba3eb5483488c59e29b7186e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:31:07.218757 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-8bc112b3-e95c-4c3a-a0f8-a19543c97b94 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] 10.222.0.33 "GET /compute/v2.1/servers/37a6fa27-bb74-4db5-8a75-06e2d78cda98" status: 200 len: 1515 microversion: 2.1 time: 0.183171 Oct 04 21:31:07.219365 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3203/6441] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:31:07 2022] GET /compute/v2.1/servers/37a6fa27-bb74-4db5-8a75-06e2d78cda98 => generated 1515 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:31:08.249297 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-fb1e427a-a5b5-472c-9bb8-8cff0241a7f2 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:31:08.250557 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-fb1e427a-a5b5-472c-9bb8-8cff0241a7f2 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] [instance: 37a6fa27-bb74-4db5-8a75-06e2d78cda98] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:08.262360 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fb1e427a-a5b5-472c-9bb8-8cff0241a7f2 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:08.263264 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fb1e427a-a5b5-472c-9bb8-8cff0241a7f2 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:08.264078 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fb1e427a-a5b5-472c-9bb8-8cff0241a7f2 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:08.265350 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fb1e427a-a5b5-472c-9bb8-8cff0241a7f2 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:08.266210 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fb1e427a-a5b5-472c-9bb8-8cff0241a7f2 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:08.267036 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fb1e427a-a5b5-472c-9bb8-8cff0241a7f2 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:08.448980 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-fb1e427a-a5b5-472c-9bb8-8cff0241a7f2 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcf08f79dcd48048dd51caa5acff372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c959eba3eb5483488c59e29b7186e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:31:08.461606 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-fb1e427a-a5b5-472c-9bb8-8cff0241a7f2 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] 10.222.0.33 "GET /compute/v2.1/servers/37a6fa27-bb74-4db5-8a75-06e2d78cda98" status: 200 len: 1515 microversion: 2.1 time: 0.221226 Oct 04 21:31:08.462818 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3239/6442] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:31:08 2022] GET /compute/v2.1/servers/37a6fa27-bb74-4db5-8a75-06e2d78cda98 => generated 1515 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:31:09.024723 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-64bce2aa-e15f-41c8-a7e8-b43cf2df359c req-738913e2-a8f1-4d49-82a1-2921a3c78069 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37a6fa27-bb74-4db5-8a75-06e2d78cda98", "tag": "2381c867-5e4e-4c86-9926-90e1333c4a0d"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:31:09.036686 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-64bce2aa-e15f-41c8-a7e8-b43cf2df359c req-738913e2-a8f1-4d49-82a1-2921a3c78069 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:09.037173 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-64bce2aa-e15f-41c8-a7e8-b43cf2df359c req-738913e2-a8f1-4d49-82a1-2921a3c78069 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:09.037608 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-64bce2aa-e15f-41c8-a7e8-b43cf2df359c req-738913e2-a8f1-4d49-82a1-2921a3c78069 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:09.050329 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-64bce2aa-e15f-41c8-a7e8-b43cf2df359c req-738913e2-a8f1-4d49-82a1-2921a3c78069 service nova] Creating event network-changed:2381c867-5e4e-4c86-9926-90e1333c4a0d for instance 37a6fa27-bb74-4db5-8a75-06e2d78cda98 on n-h1-854823-8 Oct 04 21:31:09.068405 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [req-64bce2aa-e15f-41c8-a7e8-b43cf2df359c req-738913e2-a8f1-4d49-82a1-2921a3c78069 service nova] Instance 37a6fa27-bb74-4db5-8a75-06e2d78cda98 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854823-8', 'n-h2-854823-8'} {{(pid=128801) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 21:31:09.080315 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-64bce2aa-e15f-41c8-a7e8-b43cf2df359c req-738913e2-a8f1-4d49-82a1-2921a3c78069 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059354 Oct 04 21:31:09.080951 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3204/6443] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:31:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:31:09.491243 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-aa65a3db-35db-472f-aa72-d122c2a615b6 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:31:09.492386 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-aa65a3db-35db-472f-aa72-d122c2a615b6 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] [instance: 37a6fa27-bb74-4db5-8a75-06e2d78cda98] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:09.505227 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-aa65a3db-35db-472f-aa72-d122c2a615b6 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:09.506146 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-aa65a3db-35db-472f-aa72-d122c2a615b6 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:09.506994 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-aa65a3db-35db-472f-aa72-d122c2a615b6 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:09.508182 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-aa65a3db-35db-472f-aa72-d122c2a615b6 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:09.509044 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-aa65a3db-35db-472f-aa72-d122c2a615b6 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:09.509851 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-aa65a3db-35db-472f-aa72-d122c2a615b6 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:09.779509 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-aa65a3db-35db-472f-aa72-d122c2a615b6 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcf08f79dcd48048dd51caa5acff372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c959eba3eb5483488c59e29b7186e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:31:09.794334 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-aa65a3db-35db-472f-aa72-d122c2a615b6 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] 10.222.0.33 "GET /compute/v2.1/servers/37a6fa27-bb74-4db5-8a75-06e2d78cda98" status: 200 len: 1513 microversion: 2.1 time: 0.310805 Oct 04 21:31:09.795316 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3240/6444] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:31:09 2022] GET /compute/v2.1/servers/37a6fa27-bb74-4db5-8a75-06e2d78cda98 => generated 1513 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:31:10.828027 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d2750054-2d30-41a5-992c-93ed7be0fd88 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:31:10.828865 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d2750054-2d30-41a5-992c-93ed7be0fd88 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] [instance: 37a6fa27-bb74-4db5-8a75-06e2d78cda98] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:10.836839 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d2750054-2d30-41a5-992c-93ed7be0fd88 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:10.837330 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d2750054-2d30-41a5-992c-93ed7be0fd88 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:10.837822 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d2750054-2d30-41a5-992c-93ed7be0fd88 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:10.838668 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d2750054-2d30-41a5-992c-93ed7be0fd88 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:10.839678 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d2750054-2d30-41a5-992c-93ed7be0fd88 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:10.839678 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d2750054-2d30-41a5-992c-93ed7be0fd88 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:11.011561 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d2750054-2d30-41a5-992c-93ed7be0fd88 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcf08f79dcd48048dd51caa5acff372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c959eba3eb5483488c59e29b7186e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:31:11.023503 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d2750054-2d30-41a5-992c-93ed7be0fd88 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] 10.222.0.33 "GET /compute/v2.1/servers/37a6fa27-bb74-4db5-8a75-06e2d78cda98" status: 200 len: 1510 microversion: 2.1 time: 0.201657 Oct 04 21:31:11.024196 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3205/6445] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:31:10 2022] GET /compute/v2.1/servers/37a6fa27-bb74-4db5-8a75-06e2d78cda98 => generated 1510 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:31:11.047892 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-e79663d1-0c40-48f0-8f91-a185ef63aae2 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:31:11.048491 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-e79663d1-0c40-48f0-8f91-a185ef63aae2 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] [instance: 37a6fa27-bb74-4db5-8a75-06e2d78cda98] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:11.057218 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e79663d1-0c40-48f0-8f91-a185ef63aae2 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:11.057785 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e79663d1-0c40-48f0-8f91-a185ef63aae2 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:11.058233 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e79663d1-0c40-48f0-8f91-a185ef63aae2 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:11.058996 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e79663d1-0c40-48f0-8f91-a185ef63aae2 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:11.059468 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e79663d1-0c40-48f0-8f91-a185ef63aae2 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:11.059911 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e79663d1-0c40-48f0-8f91-a185ef63aae2 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:11.093508 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-e79663d1-0c40-48f0-8f91-a185ef63aae2 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] [instance: 37a6fa27-bb74-4db5-8a75-06e2d78cda98] Going to try to terminate instance {{(pid=128802) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:31:11.158520 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.compute.api [None req-e79663d1-0c40-48f0-8f91-a185ef63aae2 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] [instance: 37a6fa27-bb74-4db5-8a75-06e2d78cda98] Found an unconfirmed migration during delete, id: 16, status: finished Oct 04 21:31:12.799719 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-2c53e966-7310-4acb-9b4e-907bdb228ea5 req-04bc7fbe-9910-44b4-a7b0-1b1f8b729f65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37a6fa27-bb74-4db5-8a75-06e2d78cda98", "name": "network-vif-plugged", "status": "completed", "tag": "2381c867-5e4e-4c86-9926-90e1333c4a0d"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:31:12.816401 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-2c53e966-7310-4acb-9b4e-907bdb228ea5 req-04bc7fbe-9910-44b4-a7b0-1b1f8b729f65 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:12.817503 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-2c53e966-7310-4acb-9b4e-907bdb228ea5 req-04bc7fbe-9910-44b4-a7b0-1b1f8b729f65 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:12.817947 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-2c53e966-7310-4acb-9b4e-907bdb228ea5 req-04bc7fbe-9910-44b4-a7b0-1b1f8b729f65 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:12.833529 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-2c53e966-7310-4acb-9b4e-907bdb228ea5 req-04bc7fbe-9910-44b4-a7b0-1b1f8b729f65 service nova] Creating event network-vif-plugged:2381c867-5e4e-4c86-9926-90e1333c4a0d for instance 37a6fa27-bb74-4db5-8a75-06e2d78cda98 on n-h1-854823-8 Oct 04 21:31:12.841031 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [req-2c53e966-7310-4acb-9b4e-907bdb228ea5 req-04bc7fbe-9910-44b4-a7b0-1b1f8b729f65 service nova] Instance 37a6fa27-bb74-4db5-8a75-06e2d78cda98 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854823-8', 'n-h2-854823-8'} {{(pid=128801) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 21:31:12.854993 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-2c53e966-7310-4acb-9b4e-907bdb228ea5 req-04bc7fbe-9910-44b4-a7b0-1b1f8b729f65 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058985 Oct 04 21:31:12.856098 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3206/6446] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:31:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:31:13.288676 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-e79663d1-0c40-48f0-8f91-a185ef63aae2 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] 10.222.0.33 "DELETE /compute/v2.1/servers/37a6fa27-bb74-4db5-8a75-06e2d78cda98" status: 204 len: 0 microversion: 2.1 time: 2.244828 Oct 04 21:31:13.289449 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3241/6447] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 21:31:11 2022] DELETE /compute/v2.1/servers/37a6fa27-bb74-4db5-8a75-06e2d78cda98 => generated 0 bytes in 2247 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:31:13.298304 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-4ab4b4d3-ef58-48a6-80ff-3ae394889166 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:31:13.299036 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-4ab4b4d3-ef58-48a6-80ff-3ae394889166 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] [instance: 37a6fa27-bb74-4db5-8a75-06e2d78cda98] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:13.306247 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4ab4b4d3-ef58-48a6-80ff-3ae394889166 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:13.306772 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4ab4b4d3-ef58-48a6-80ff-3ae394889166 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:13.307207 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4ab4b4d3-ef58-48a6-80ff-3ae394889166 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:13.307911 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4ab4b4d3-ef58-48a6-80ff-3ae394889166 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:13.308363 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4ab4b4d3-ef58-48a6-80ff-3ae394889166 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:13.308787 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4ab4b4d3-ef58-48a6-80ff-3ae394889166 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:13.463516 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-4ab4b4d3-ef58-48a6-80ff-3ae394889166 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcf08f79dcd48048dd51caa5acff372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c959eba3eb5483488c59e29b7186e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:31:13.472461 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-4ab4b4d3-ef58-48a6-80ff-3ae394889166 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] 10.222.0.33 "GET /compute/v2.1/servers/37a6fa27-bb74-4db5-8a75-06e2d78cda98" status: 200 len: 1502 microversion: 2.1 time: 0.178393 Oct 04 21:31:13.473861 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3207/6448] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:31:13 2022] GET /compute/v2.1/servers/37a6fa27-bb74-4db5-8a75-06e2d78cda98 => generated 1502 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:31:14.506585 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-d8f0b34f-6660-4b60-910d-3f156679f735 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:31:14.507307 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-d8f0b34f-6660-4b60-910d-3f156679f735 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] [instance: 37a6fa27-bb74-4db5-8a75-06e2d78cda98] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:14.515142 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d8f0b34f-6660-4b60-910d-3f156679f735 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:14.515650 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d8f0b34f-6660-4b60-910d-3f156679f735 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:14.516103 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d8f0b34f-6660-4b60-910d-3f156679f735 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:14.516821 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d8f0b34f-6660-4b60-910d-3f156679f735 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:14.517289 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d8f0b34f-6660-4b60-910d-3f156679f735 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:14.517727 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d8f0b34f-6660-4b60-910d-3f156679f735 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:14.658737 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-d8f0b34f-6660-4b60-910d-3f156679f735 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcf08f79dcd48048dd51caa5acff372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c959eba3eb5483488c59e29b7186e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:31:14.668808 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-d8f0b34f-6660-4b60-910d-3f156679f735 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] 10.222.0.33 "GET /compute/v2.1/servers/37a6fa27-bb74-4db5-8a75-06e2d78cda98" status: 200 len: 1502 microversion: 2.1 time: 0.167055 Oct 04 21:31:14.669553 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3242/6449] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:31:14 2022] GET /compute/v2.1/servers/37a6fa27-bb74-4db5-8a75-06e2d78cda98 => generated 1502 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:31:15.324003 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-886ac7cb-92c0-4a2a-9a4f-9ca4a4ecb95d req-27c41ca8-87d8-48dc-ac39-c51923242d2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37a6fa27-bb74-4db5-8a75-06e2d78cda98", "name": "network-vif-deleted", "tag": "2381c867-5e4e-4c86-9926-90e1333c4a0d"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:31:15.343774 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-886ac7cb-92c0-4a2a-9a4f-9ca4a4ecb95d req-27c41ca8-87d8-48dc-ac39-c51923242d2f service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:15.344874 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-886ac7cb-92c0-4a2a-9a4f-9ca4a4ecb95d req-27c41ca8-87d8-48dc-ac39-c51923242d2f service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:15.345760 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-886ac7cb-92c0-4a2a-9a4f-9ca4a4ecb95d req-27c41ca8-87d8-48dc-ac39-c51923242d2f service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:15.371261 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-886ac7cb-92c0-4a2a-9a4f-9ca4a4ecb95d req-27c41ca8-87d8-48dc-ac39-c51923242d2f service nova] Creating event network-vif-deleted:2381c867-5e4e-4c86-9926-90e1333c4a0d for instance 37a6fa27-bb74-4db5-8a75-06e2d78cda98 on n-h1-854823-8 Oct 04 21:31:15.380419 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-886ac7cb-92c0-4a2a-9a4f-9ca4a4ecb95d req-27c41ca8-87d8-48dc-ac39-c51923242d2f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067057 Oct 04 21:31:15.381396 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3208/6450] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:31:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:31:15.698301 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-dcfa58c9-d3a0-4bb9-8f1f-18321df96669 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:31:15.699524 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-dcfa58c9-d3a0-4bb9-8f1f-18321df96669 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] [instance: 37a6fa27-bb74-4db5-8a75-06e2d78cda98] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:15.712603 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dcfa58c9-d3a0-4bb9-8f1f-18321df96669 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:15.713520 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dcfa58c9-d3a0-4bb9-8f1f-18321df96669 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:15.714379 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dcfa58c9-d3a0-4bb9-8f1f-18321df96669 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:15.715620 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dcfa58c9-d3a0-4bb9-8f1f-18321df96669 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:15.716506 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dcfa58c9-d3a0-4bb9-8f1f-18321df96669 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:15.717330 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dcfa58c9-d3a0-4bb9-8f1f-18321df96669 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:15.759661 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dcfa58c9-d3a0-4bb9-8f1f-18321df96669 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:15.760168 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dcfa58c9-d3a0-4bb9-8f1f-18321df96669 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:15.760682 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dcfa58c9-d3a0-4bb9-8f1f-18321df96669 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:15.761155 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.objects.instance [None req-dcfa58c9-d3a0-4bb9-8f1f-18321df96669 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Lazy-loading 'fault' on Instance uuid 37a6fa27-bb74-4db5-8a75-06e2d78cda98 {{(pid=128802) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:31:15.807764 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-dcfa58c9-d3a0-4bb9-8f1f-18321df96669 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcf08f79dcd48048dd51caa5acff372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c959eba3eb5483488c59e29b7186e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:31:15.823443 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-dcfa58c9-d3a0-4bb9-8f1f-18321df96669 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] 10.222.0.33 "GET /compute/v2.1/servers/37a6fa27-bb74-4db5-8a75-06e2d78cda98" status: 200 len: 1305 microversion: 2.1 time: 0.132923 Oct 04 21:31:15.824611 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3243/6451] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:31:15 2022] GET /compute/v2.1/servers/37a6fa27-bb74-4db5-8a75-06e2d78cda98 => generated 1305 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:31:16.862310 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-3d3736d2-419c-4652-88f7-9939c6879d47 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:31:16.863148 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-3d3736d2-419c-4652-88f7-9939c6879d47 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] [instance: 37a6fa27-bb74-4db5-8a75-06e2d78cda98] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:16.870916 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3d3736d2-419c-4652-88f7-9939c6879d47 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:16.871534 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3d3736d2-419c-4652-88f7-9939c6879d47 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:16.871844 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3d3736d2-419c-4652-88f7-9939c6879d47 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:16.872559 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3d3736d2-419c-4652-88f7-9939c6879d47 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:16.873016 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3d3736d2-419c-4652-88f7-9939c6879d47 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:16.873437 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3d3736d2-419c-4652-88f7-9939c6879d47 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:16.888797 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-3d3736d2-419c-4652-88f7-9939c6879d47 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] HTTP exception thrown: Instance 37a6fa27-bb74-4db5-8a75-06e2d78cda98 could not be found. Oct 04 21:31:16.890528 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-3d3736d2-419c-4652-88f7-9939c6879d47 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Request method failure captured: Oct 04 21:31:16.890528 n-d-854823-8 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/37a6fa27-bb74-4db5-8a75-06e2d78cda98 HTTP/1.1 Oct 04 21:31:16.890528 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 21:31:16.890528 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 21:31:16.890528 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 21:31:16.890528 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 0 Oct 04 21:31:16.890528 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 21:31:16.890528 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 21:31:16.890528 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 21:31:16.890528 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 21:31:16.890528 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPKXyV8gBotXpODOrRU3eUPCBLBgH7WjebrYyyFNIwYUx0D0ocM8S9uzbbZLymTr45iHAdgPR2t2jjIPvUp5fG12pjnrZCvVftaE8D1jGJpcbn8Ih9Cnr8GrmaT9eynW2RArI0NibAW7cYhPr7a3OJ9-5YVu3WApwc_LfbX-xFdXYHMY Oct 04 21:31:16.890528 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 21:31:16.890528 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 21:31:16.890528 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 21:31:16.890528 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 21:31:16.890528 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 21:31:16.890528 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 21:31:16.890528 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: 4c959eba3eb5483488c59e29b7186e86 Oct 04 21:31:16.890528 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-DeleteServersTestJSON-1721943021 Oct 04 21:31:16.890528 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 21:31:16.890528 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 21:31:16.890528 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_4c959eba3eb5483488c59e29b7186e86", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4c959eba3eb5483488c59e29b7186e86"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4c959eba3eb5483488c59e29b7186e86"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/4c959eba3eb5483488c59e29b7186e86"}]}] Oct 04 21:31:16.890528 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-DeleteServersTestJSON-1721943021 Oct 04 21:31:16.890528 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: 4c959eba3eb5483488c59e29b7186e86 Oct 04 21:31:16.890528 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-DeleteServersTestJSON-1721943021 Oct 04 21:31:16.890528 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-DeleteServersTestJSON-1721943021-project Oct 04 21:31:16.890528 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 21:31:16.890528 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 21:31:16.890528 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: cdcf08f79dcd48048dd51caa5acff372 Oct 04 21:31:16.890528 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-DeleteServersTestJSON-1721943021-project Oct 04 21:31:16.890528 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 21:31:16.890528 n-d-854823-8 devstack@n-api.service[128801]: exception: Instance 37a6fa27-bb74-4db5-8a75-06e2d78cda98 could not be found. Oct 04 21:31:16.890528 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': '37a6fa27-bb74-4db5-8a75-06e2d78cda98'} Oct 04 21:31:16.890528 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:31:16.890528 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:31:16.890528 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:31:16.890528 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:31:16.890528 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:31:16.890528 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:31:16.890528 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:31:16.890528 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:31:16.890528 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:31:16.890528 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:31:16.890528 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37a6fa27-bb74-4db5-8a75-06e2d78cda98 could not be found. Oct 04 21:31:16.890528 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:31:16.890528 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:31:16.890528 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:31:16.890528 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:31:16.890528 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:31:16.890528 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:31:16.890528 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:31:16.890528 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:31:16.890528 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:31:16.890528 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:31:16.890528 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:31:16.890528 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:31:16.890528 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:31:16.890528 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:31:16.890528 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:31:16.890528 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:31:16.890528 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37a6fa27-bb74-4db5-8a75-06e2d78cda98 could not be found. Oct 04 21:31:16.890528 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:31:16.890528 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:31:16.890528 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:31:16.894398 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:31:16.894398 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:31:16.894398 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:31:16.894398 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:31:16.894398 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:31:16.894398 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37a6fa27-bb74-4db5-8a75-06e2d78cda98 could not be found. Oct 04 21:31:16.894398 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:31:16.894398 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-3d3736d2-419c-4652-88f7-9939c6879d47 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Returning 404 to user: Instance 37a6fa27-bb74-4db5-8a75-06e2d78cda98 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:31:16.894398 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-3d3736d2-419c-4652-88f7-9939c6879d47 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] 10.222.0.33 "GET /compute/v2.1/servers/37a6fa27-bb74-4db5-8a75-06e2d78cda98" status: 404 len: 111 microversion: 2.1 time: 0.034758 Oct 04 21:31:16.894398 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3209/6452] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:31:16 2022] GET /compute/v2.1/servers/37a6fa27-bb74-4db5-8a75-06e2d78cda98 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:31:16.911942 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-71234304-194b-4ce8-9ebd-64a6bbdae412 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:31:16.912881 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-71234304-194b-4ce8-9ebd-64a6bbdae412 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] [instance: 37a6fa27-bb74-4db5-8a75-06e2d78cda98] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:16.925000 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-71234304-194b-4ce8-9ebd-64a6bbdae412 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:16.926123 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-71234304-194b-4ce8-9ebd-64a6bbdae412 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:16.927359 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-71234304-194b-4ce8-9ebd-64a6bbdae412 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:16.928407 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-71234304-194b-4ce8-9ebd-64a6bbdae412 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:16.929238 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-71234304-194b-4ce8-9ebd-64a6bbdae412 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:16.930044 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-71234304-194b-4ce8-9ebd-64a6bbdae412 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:16.961321 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.wsgi [None req-71234304-194b-4ce8-9ebd-64a6bbdae412 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] HTTP exception thrown: Instance 37a6fa27-bb74-4db5-8a75-06e2d78cda98 could not be found. Oct 04 21:31:16.964914 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-71234304-194b-4ce8-9ebd-64a6bbdae412 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Request method failure captured: Oct 04 21:31:16.964914 n-d-854823-8 devstack@n-api.service[128802]: request: DELETE /compute/v2.1/servers/37a6fa27-bb74-4db5-8a75-06e2d78cda98 HTTP/1.1 Oct 04 21:31:16.964914 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 21:31:16.964914 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 21:31:16.964914 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 21:31:16.964914 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 0 Oct 04 21:31:16.964914 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 21:31:16.964914 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 21:31:16.964914 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 21:31:16.964914 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 21:31:16.964914 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPKXyV8gBotXpODOrRU3eUPCBLBgH7WjebrYyyFNIwYUx0D0ocM8S9uzbbZLymTr45iHAdgPR2t2jjIPvUp5fG12pjnrZCvVftaE8D1jGJpcbn8Ih9Cnr8GrmaT9eynW2RArI0NibAW7cYhPr7a3OJ9-5YVu3WApwc_LfbX-xFdXYHMY Oct 04 21:31:16.964914 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 21:31:16.964914 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 21:31:16.964914 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 21:31:16.964914 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 21:31:16.964914 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 21:31:16.964914 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 21:31:16.964914 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: 4c959eba3eb5483488c59e29b7186e86 Oct 04 21:31:16.964914 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-DeleteServersTestJSON-1721943021 Oct 04 21:31:16.964914 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 21:31:16.964914 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 21:31:16.964914 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_4c959eba3eb5483488c59e29b7186e86", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4c959eba3eb5483488c59e29b7186e86"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4c959eba3eb5483488c59e29b7186e86"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/4c959eba3eb5483488c59e29b7186e86"}]}] Oct 04 21:31:16.964914 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-DeleteServersTestJSON-1721943021 Oct 04 21:31:16.964914 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: 4c959eba3eb5483488c59e29b7186e86 Oct 04 21:31:16.964914 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-DeleteServersTestJSON-1721943021 Oct 04 21:31:16.964914 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-DeleteServersTestJSON-1721943021-project Oct 04 21:31:16.964914 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 21:31:16.964914 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 21:31:16.964914 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: cdcf08f79dcd48048dd51caa5acff372 Oct 04 21:31:16.964914 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-DeleteServersTestJSON-1721943021-project Oct 04 21:31:16.964914 n-d-854823-8 devstack@n-api.service[128802]: method: > Oct 04 21:31:16.964914 n-d-854823-8 devstack@n-api.service[128802]: exception: Instance 37a6fa27-bb74-4db5-8a75-06e2d78cda98 could not be found. Oct 04 21:31:16.964914 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'id': '37a6fa27-bb74-4db5-8a75-06e2d78cda98'} Oct 04 21:31:16.964914 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:31:16.964914 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:31:16.964914 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:31:16.964914 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:31:16.964914 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:31:16.964914 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:31:16.964914 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:31:16.964914 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:31:16.964914 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:31:16.964914 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:31:16.964914 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37a6fa27-bb74-4db5-8a75-06e2d78cda98 could not be found. Oct 04 21:31:16.964914 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:31:16.964914 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:31:16.964914 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:31:16.964914 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:31:16.964914 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:31:16.964914 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:31:16.964914 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:31:16.964914 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:31:16.964914 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:31:16.964914 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:31:16.964914 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 21:31:16.964914 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 21:31:16.964914 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 21:31:16.964914 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 21:31:16.964914 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:31:16.964914 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:31:16.964914 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:31:16.964914 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:31:16.968374 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37a6fa27-bb74-4db5-8a75-06e2d78cda98 could not be found. Oct 04 21:31:16.968374 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:31:16.968374 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:31:16.968374 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:31:16.968374 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:31:16.968374 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:31:16.968374 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:31:16.968374 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:31:16.968374 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:31:16.968374 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37a6fa27-bb74-4db5-8a75-06e2d78cda98 could not be found. Oct 04 21:31:16.968374 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:31:16.968374 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-71234304-194b-4ce8-9ebd-64a6bbdae412 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Returning 404 to user: Instance 37a6fa27-bb74-4db5-8a75-06e2d78cda98 could not be found. {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:31:16.969134 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-71234304-194b-4ce8-9ebd-64a6bbdae412 tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] 10.222.0.33 "DELETE /compute/v2.1/servers/37a6fa27-bb74-4db5-8a75-06e2d78cda98" status: 404 len: 111 microversion: 2.1 time: 0.065220 Oct 04 21:31:16.973625 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3244/6453] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 21:31:16 2022] DELETE /compute/v2.1/servers/37a6fa27-bb74-4db5-8a75-06e2d78cda98 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 21:31:16.980301 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2cf59deb-6901-48a1-878c-843f513fa86a tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:31:16.981009 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-2cf59deb-6901-48a1-878c-843f513fa86a tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] [instance: 37a6fa27-bb74-4db5-8a75-06e2d78cda98] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:16.987496 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2cf59deb-6901-48a1-878c-843f513fa86a tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:16.988072 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2cf59deb-6901-48a1-878c-843f513fa86a tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:16.988978 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2cf59deb-6901-48a1-878c-843f513fa86a tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:16.989802 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2cf59deb-6901-48a1-878c-843f513fa86a tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:16.990311 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2cf59deb-6901-48a1-878c-843f513fa86a tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:16.990831 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2cf59deb-6901-48a1-878c-843f513fa86a tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:17.006940 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-2cf59deb-6901-48a1-878c-843f513fa86a tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] HTTP exception thrown: Instance 37a6fa27-bb74-4db5-8a75-06e2d78cda98 could not be found. Oct 04 21:31:17.008593 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2cf59deb-6901-48a1-878c-843f513fa86a tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Request method failure captured: Oct 04 21:31:17.008593 n-d-854823-8 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/37a6fa27-bb74-4db5-8a75-06e2d78cda98 HTTP/1.1 Oct 04 21:31:17.008593 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 21:31:17.008593 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 21:31:17.008593 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 21:31:17.008593 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 0 Oct 04 21:31:17.008593 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 21:31:17.008593 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 21:31:17.008593 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 21:31:17.008593 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 21:31:17.008593 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPKXyV8gBotXpODOrRU3eUPCBLBgH7WjebrYyyFNIwYUx0D0ocM8S9uzbbZLymTr45iHAdgPR2t2jjIPvUp5fG12pjnrZCvVftaE8D1jGJpcbn8Ih9Cnr8GrmaT9eynW2RArI0NibAW7cYhPr7a3OJ9-5YVu3WApwc_LfbX-xFdXYHMY Oct 04 21:31:17.008593 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 21:31:17.008593 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 21:31:17.008593 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 21:31:17.008593 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 21:31:17.008593 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 21:31:17.008593 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 21:31:17.008593 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: 4c959eba3eb5483488c59e29b7186e86 Oct 04 21:31:17.008593 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-DeleteServersTestJSON-1721943021 Oct 04 21:31:17.008593 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 21:31:17.008593 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 21:31:17.008593 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_4c959eba3eb5483488c59e29b7186e86", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4c959eba3eb5483488c59e29b7186e86"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4c959eba3eb5483488c59e29b7186e86"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/4c959eba3eb5483488c59e29b7186e86"}]}] Oct 04 21:31:17.008593 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-DeleteServersTestJSON-1721943021 Oct 04 21:31:17.008593 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: 4c959eba3eb5483488c59e29b7186e86 Oct 04 21:31:17.008593 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-DeleteServersTestJSON-1721943021 Oct 04 21:31:17.008593 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-DeleteServersTestJSON-1721943021-project Oct 04 21:31:17.008593 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 21:31:17.008593 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 21:31:17.008593 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: cdcf08f79dcd48048dd51caa5acff372 Oct 04 21:31:17.008593 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-DeleteServersTestJSON-1721943021-project Oct 04 21:31:17.008593 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 21:31:17.008593 n-d-854823-8 devstack@n-api.service[128801]: exception: Instance 37a6fa27-bb74-4db5-8a75-06e2d78cda98 could not be found. Oct 04 21:31:17.008593 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': '37a6fa27-bb74-4db5-8a75-06e2d78cda98'} Oct 04 21:31:17.008593 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:31:17.008593 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:31:17.008593 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:31:17.008593 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:31:17.008593 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:31:17.008593 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:31:17.008593 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:31:17.008593 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:31:17.008593 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:31:17.008593 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:31:17.008593 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37a6fa27-bb74-4db5-8a75-06e2d78cda98 could not be found. Oct 04 21:31:17.008593 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:31:17.008593 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:31:17.008593 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:31:17.008593 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:31:17.008593 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:31:17.008593 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:31:17.008593 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:31:17.008593 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:31:17.008593 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:31:17.008593 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:31:17.008593 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:31:17.008593 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:31:17.008593 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:31:17.008593 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:31:17.008593 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:31:17.008593 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:31:17.008593 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37a6fa27-bb74-4db5-8a75-06e2d78cda98 could not be found. Oct 04 21:31:17.008593 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:31:17.008593 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:31:17.008593 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:31:17.012223 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:31:17.012223 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:31:17.012223 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:31:17.012223 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:31:17.012223 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:31:17.012223 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37a6fa27-bb74-4db5-8a75-06e2d78cda98 could not be found. Oct 04 21:31:17.012223 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:31:17.012223 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2cf59deb-6901-48a1-878c-843f513fa86a tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] Returning 404 to user: Instance 37a6fa27-bb74-4db5-8a75-06e2d78cda98 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:31:17.012223 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-2cf59deb-6901-48a1-878c-843f513fa86a tempest-DeleteServersTestJSON-1721943021 tempest-DeleteServersTestJSON-1721943021-project] 10.222.0.33 "GET /compute/v2.1/servers/37a6fa27-bb74-4db5-8a75-06e2d78cda98" status: 404 len: 111 microversion: 2.1 time: 0.033698 Oct 04 21:31:17.012223 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3210/6454] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:31:16 2022] GET /compute/v2.1/servers/37a6fa27-bb74-4db5-8a75-06e2d78cda98 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 21:31:26.109413 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-2e714846-0fb4-41df-bcbb-4eedd11ea7a5 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-64599396", "imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63", "flavorRef": "452", "networks": [{"uuid": "2899c36d-2ad5-49c0-b0fc-aeee21433ba2"}]}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:31:26.166333 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.network.neutron [None req-2e714846-0fb4-41df-bcbb-4eedd11ea7a5 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] validate_networks() for [('2899c36d-2ad5-49c0-b0fc-aeee21433ba2', None, None, None, None, None)] {{(pid=128802) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:31:26.588558 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-2e714846-0fb4-41df-bcbb-4eedd11ea7a5 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Flavor limits 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:31:26.589000 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-2e714846-0fb4-41df-bcbb-4eedd11ea7a5 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Image limits 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:31:26.589488 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-2e714846-0fb4-41df-bcbb-4eedd11ea7a5 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Flavor pref 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:31:26.589915 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-2e714846-0fb4-41df-bcbb-4eedd11ea7a5 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Image pref 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:31:26.590363 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-2e714846-0fb4-41df-bcbb-4eedd11ea7a5 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:31:26.601023 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2e714846-0fb4-41df-bcbb-4eedd11ea7a5 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:26.601528 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2e714846-0fb4-41df-bcbb-4eedd11ea7a5 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:26.601981 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2e714846-0fb4-41df-bcbb-4eedd11ea7a5 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:26.603156 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2e714846-0fb4-41df-bcbb-4eedd11ea7a5 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:26.603630 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2e714846-0fb4-41df-bcbb-4eedd11ea7a5 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:26.604340 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2e714846-0fb4-41df-bcbb-4eedd11ea7a5 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:26.623835 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-2e714846-0fb4-41df-bcbb-4eedd11ea7a5 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Getting quotas for project dd7ffd8787fc4fffbee4ac6d72d833ea. Resources: {'ram', 'instances', 'cores'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:31:26.630500 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-2e714846-0fb4-41df-bcbb-4eedd11ea7a5 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Getting quotas for user 38d6858e6c5941adbcebf5706357a272 and project dd7ffd8787fc4fffbee4ac6d72d833ea. Resources: {'ram', 'instances', 'cores'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:31:26.644060 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-2e714846-0fb4-41df-bcbb-4eedd11ea7a5 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Going to run 1 instances... {{(pid=128802) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:31:26.646969 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-2e714846-0fb4-41df-bcbb-4eedd11ea7a5 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] [instance: ba8db62f-8120-4469-9974-819d9316d71b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='15b24725-0c99-4bcf-b1fb-907cdf8e2d63',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128802) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:31:26.700834 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-2e714846-0fb4-41df-bcbb-4eedd11ea7a5 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.796435 Oct 04 21:31:26.701491 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3245/6455] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 21:31:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 798 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:31:26.713585 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9159d458-e99c-4aa0-9418-c84a9055d67a tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:31:26.714197 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-9159d458-e99c-4aa0-9418-c84a9055d67a tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] [instance: ba8db62f-8120-4469-9974-819d9316d71b] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:26.772831 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-9159d458-e99c-4aa0-9418-c84a9055d67a tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d6858e6c5941adbcebf5706357a272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ffd8787fc4fffbee4ac6d72d833ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:31:26.781981 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-9159d458-e99c-4aa0-9418-c84a9055d67a tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] 10.222.0.33 "GET /compute/v2.1/servers/ba8db62f-8120-4469-9974-819d9316d71b" status: 200 len: 1216 microversion: 2.1 time: 0.072155 Oct 04 21:31:26.782524 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3211/6456] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:31:26 2022] GET /compute/v2.1/servers/ba8db62f-8120-4469-9974-819d9316d71b => generated 1216 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:31:27.806876 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-7f0929e2-e33b-4983-8b55-25ac5613b3b5 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:31:27.807523 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-7f0929e2-e33b-4983-8b55-25ac5613b3b5 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] [instance: ba8db62f-8120-4469-9974-819d9316d71b] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:27.819965 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7f0929e2-e33b-4983-8b55-25ac5613b3b5 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:27.820479 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7f0929e2-e33b-4983-8b55-25ac5613b3b5 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:27.820936 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7f0929e2-e33b-4983-8b55-25ac5613b3b5 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:27.821707 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7f0929e2-e33b-4983-8b55-25ac5613b3b5 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:27.822225 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7f0929e2-e33b-4983-8b55-25ac5613b3b5 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:27.822909 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7f0929e2-e33b-4983-8b55-25ac5613b3b5 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:27.944628 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-7f0929e2-e33b-4983-8b55-25ac5613b3b5 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d6858e6c5941adbcebf5706357a272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ffd8787fc4fffbee4ac6d72d833ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:31:27.955028 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-7f0929e2-e33b-4983-8b55-25ac5613b3b5 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] 10.222.0.33 "GET /compute/v2.1/servers/ba8db62f-8120-4469-9974-819d9316d71b" status: 200 len: 1276 microversion: 2.1 time: 0.152714 Oct 04 21:31:27.956351 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3246/6457] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:31:27 2022] GET /compute/v2.1/servers/ba8db62f-8120-4469-9974-819d9316d71b => generated 1276 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:31:28.981464 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-45ede14d-cc88-44cc-9ba5-99d07cdd4c61 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:31:28.983595 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-45ede14d-cc88-44cc-9ba5-99d07cdd4c61 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] [instance: ba8db62f-8120-4469-9974-819d9316d71b] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:28.988093 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=37 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:31:28.997221 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-45ede14d-cc88-44cc-9ba5-99d07cdd4c61 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:28.997719 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-45ede14d-cc88-44cc-9ba5-99d07cdd4c61 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:28.998160 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-45ede14d-cc88-44cc-9ba5-99d07cdd4c61 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:28.998943 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-45ede14d-cc88-44cc-9ba5-99d07cdd4c61 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:28.999403 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-45ede14d-cc88-44cc-9ba5-99d07cdd4c61 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:28.999830 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-45ede14d-cc88-44cc-9ba5-99d07cdd4c61 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:29.355047 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-45ede14d-cc88-44cc-9ba5-99d07cdd4c61 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d6858e6c5941adbcebf5706357a272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ffd8787fc4fffbee4ac6d72d833ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:31:29.366301 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-45ede14d-cc88-44cc-9ba5-99d07cdd4c61 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] 10.222.0.33 "GET /compute/v2.1/servers/ba8db62f-8120-4469-9974-819d9316d71b" status: 200 len: 1316 microversion: 2.1 time: 0.389549 Oct 04 21:31:29.367586 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3212/6458] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:31:28 2022] GET /compute/v2.1/servers/ba8db62f-8120-4469-9974-819d9316d71b => generated 1316 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:31:29.560487 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-03b6a6da-ee6b-420d-9e66-33eef18146ac req-fe54b1b9-5bfa-497f-99c4-516c1ba17f60 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba8db62f-8120-4469-9974-819d9316d71b", "tag": "676bff1c-5c80-4041-ab2e-2e448a8a3a67"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:31:29.576097 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-03b6a6da-ee6b-420d-9e66-33eef18146ac req-fe54b1b9-5bfa-497f-99c4-516c1ba17f60 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:29.577133 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-03b6a6da-ee6b-420d-9e66-33eef18146ac req-fe54b1b9-5bfa-497f-99c4-516c1ba17f60 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:29.578112 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-03b6a6da-ee6b-420d-9e66-33eef18146ac req-fe54b1b9-5bfa-497f-99c4-516c1ba17f60 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:29.600338 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-03b6a6da-ee6b-420d-9e66-33eef18146ac req-fe54b1b9-5bfa-497f-99c4-516c1ba17f60 service nova] Creating event network-changed:676bff1c-5c80-4041-ab2e-2e448a8a3a67 for instance ba8db62f-8120-4469-9974-819d9316d71b on n-h2-854823-8 Oct 04 21:31:29.613146 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-03b6a6da-ee6b-420d-9e66-33eef18146ac req-fe54b1b9-5bfa-497f-99c4-516c1ba17f60 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054608 Oct 04 21:31:29.613855 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3247/6459] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:31:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:31:30.390473 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a48590a1-2570-45bd-b40f-b411ede511e4 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:31:30.391083 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a48590a1-2570-45bd-b40f-b411ede511e4 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] [instance: ba8db62f-8120-4469-9974-819d9316d71b] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:30.397963 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a48590a1-2570-45bd-b40f-b411ede511e4 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:30.398480 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a48590a1-2570-45bd-b40f-b411ede511e4 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:30.398913 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a48590a1-2570-45bd-b40f-b411ede511e4 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:30.399627 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a48590a1-2570-45bd-b40f-b411ede511e4 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:30.400075 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a48590a1-2570-45bd-b40f-b411ede511e4 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:30.400495 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a48590a1-2570-45bd-b40f-b411ede511e4 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:30.538076 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-a48590a1-2570-45bd-b40f-b411ede511e4 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d6858e6c5941adbcebf5706357a272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ffd8787fc4fffbee4ac6d72d833ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:31:30.545788 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a48590a1-2570-45bd-b40f-b411ede511e4 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] 10.222.0.33 "GET /compute/v2.1/servers/ba8db62f-8120-4469-9974-819d9316d71b" status: 200 len: 1316 microversion: 2.1 time: 0.159544 Oct 04 21:31:30.546381 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3213/6460] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:31:30 2022] GET /compute/v2.1/servers/ba8db62f-8120-4469-9974-819d9316d71b => generated 1316 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:31:31.570637 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-a3555ec6-ed9a-4578-ab3e-cddc184b11c8 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:31:31.571368 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-a3555ec6-ed9a-4578-ab3e-cddc184b11c8 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] [instance: ba8db62f-8120-4469-9974-819d9316d71b] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:31.579241 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a3555ec6-ed9a-4578-ab3e-cddc184b11c8 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:31.579752 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a3555ec6-ed9a-4578-ab3e-cddc184b11c8 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:31.580206 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a3555ec6-ed9a-4578-ab3e-cddc184b11c8 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:31.580939 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a3555ec6-ed9a-4578-ab3e-cddc184b11c8 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:31.581413 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a3555ec6-ed9a-4578-ab3e-cddc184b11c8 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:31.581974 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a3555ec6-ed9a-4578-ab3e-cddc184b11c8 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:31.917211 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-a3555ec6-ed9a-4578-ab3e-cddc184b11c8 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d6858e6c5941adbcebf5706357a272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ffd8787fc4fffbee4ac6d72d833ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:31:31.925020 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-a3555ec6-ed9a-4578-ab3e-cddc184b11c8 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] 10.222.0.33 "GET /compute/v2.1/servers/ba8db62f-8120-4469-9974-819d9316d71b" status: 200 len: 1316 microversion: 2.1 time: 0.359546 Oct 04 21:31:31.926134 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3248/6461] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:31:31 2022] GET /compute/v2.1/servers/ba8db62f-8120-4469-9974-819d9316d71b => generated 1316 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:31:32.949240 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-99aba249-d199-464c-ad5f-9835e39c40c1 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:31:32.949899 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-99aba249-d199-464c-ad5f-9835e39c40c1 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] [instance: ba8db62f-8120-4469-9974-819d9316d71b] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:32.957428 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-99aba249-d199-464c-ad5f-9835e39c40c1 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:32.958271 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-99aba249-d199-464c-ad5f-9835e39c40c1 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:32.958863 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-99aba249-d199-464c-ad5f-9835e39c40c1 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:32.959590 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-99aba249-d199-464c-ad5f-9835e39c40c1 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:32.960052 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-99aba249-d199-464c-ad5f-9835e39c40c1 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:32.960485 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-99aba249-d199-464c-ad5f-9835e39c40c1 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:33.197337 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-99aba249-d199-464c-ad5f-9835e39c40c1 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d6858e6c5941adbcebf5706357a272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ffd8787fc4fffbee4ac6d72d833ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:31:33.205180 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-99aba249-d199-464c-ad5f-9835e39c40c1 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] 10.222.0.33 "GET /compute/v2.1/servers/ba8db62f-8120-4469-9974-819d9316d71b" status: 200 len: 1316 microversion: 2.1 time: 0.260048 Oct 04 21:31:33.205693 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3214/6462] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:31:32 2022] GET /compute/v2.1/servers/ba8db62f-8120-4469-9974-819d9316d71b => generated 1316 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:31:34.228500 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-35327105-4b20-4945-8f86-3bfd4efebd61 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:31:34.229126 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-35327105-4b20-4945-8f86-3bfd4efebd61 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] [instance: ba8db62f-8120-4469-9974-819d9316d71b] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:34.236121 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-35327105-4b20-4945-8f86-3bfd4efebd61 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:34.236625 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-35327105-4b20-4945-8f86-3bfd4efebd61 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:34.237080 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-35327105-4b20-4945-8f86-3bfd4efebd61 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:34.237809 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-35327105-4b20-4945-8f86-3bfd4efebd61 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:34.238326 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-35327105-4b20-4945-8f86-3bfd4efebd61 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:34.238919 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-35327105-4b20-4945-8f86-3bfd4efebd61 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:34.368871 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-35327105-4b20-4945-8f86-3bfd4efebd61 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d6858e6c5941adbcebf5706357a272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ffd8787fc4fffbee4ac6d72d833ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:31:34.376708 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-35327105-4b20-4945-8f86-3bfd4efebd61 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] 10.222.0.33 "GET /compute/v2.1/servers/ba8db62f-8120-4469-9974-819d9316d71b" status: 200 len: 1316 microversion: 2.1 time: 0.152214 Oct 04 21:31:34.377477 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3249/6463] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:31:34 2022] GET /compute/v2.1/servers/ba8db62f-8120-4469-9974-819d9316d71b => generated 1316 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:31:35.400336 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f223ed54-4b93-40f7-8703-513524dd2126 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:31:35.400944 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f223ed54-4b93-40f7-8703-513524dd2126 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] [instance: ba8db62f-8120-4469-9974-819d9316d71b] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:35.407793 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f223ed54-4b93-40f7-8703-513524dd2126 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:35.408274 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f223ed54-4b93-40f7-8703-513524dd2126 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:35.408715 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f223ed54-4b93-40f7-8703-513524dd2126 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:35.409443 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f223ed54-4b93-40f7-8703-513524dd2126 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:35.410477 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f223ed54-4b93-40f7-8703-513524dd2126 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:35.410872 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f223ed54-4b93-40f7-8703-513524dd2126 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:35.548360 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f223ed54-4b93-40f7-8703-513524dd2126 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d6858e6c5941adbcebf5706357a272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ffd8787fc4fffbee4ac6d72d833ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:31:35.557080 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f223ed54-4b93-40f7-8703-513524dd2126 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] 10.222.0.33 "GET /compute/v2.1/servers/ba8db62f-8120-4469-9974-819d9316d71b" status: 200 len: 1316 microversion: 2.1 time: 0.160644 Oct 04 21:31:35.557812 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3215/6464] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:31:35 2022] GET /compute/v2.1/servers/ba8db62f-8120-4469-9974-819d9316d71b => generated 1316 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:31:35.586500 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-09241901-fb7b-48f7-a279-75eb4b2676a1 req-69bb568e-92fb-4e23-b2e2-62a060f4978c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba8db62f-8120-4469-9974-819d9316d71b", "name": "network-vif-plugged", "status": "completed", "tag": "676bff1c-5c80-4041-ab2e-2e448a8a3a67"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:31:35.591814 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:31:35.597984 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-09241901-fb7b-48f7-a279-75eb4b2676a1 req-69bb568e-92fb-4e23-b2e2-62a060f4978c service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:35.598598 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-09241901-fb7b-48f7-a279-75eb4b2676a1 req-69bb568e-92fb-4e23-b2e2-62a060f4978c service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:35.599104 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-09241901-fb7b-48f7-a279-75eb4b2676a1 req-69bb568e-92fb-4e23-b2e2-62a060f4978c service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:35.604202 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:31:35.612395 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-09241901-fb7b-48f7-a279-75eb4b2676a1 req-69bb568e-92fb-4e23-b2e2-62a060f4978c service nova] Creating event network-vif-plugged:676bff1c-5c80-4041-ab2e-2e448a8a3a67 for instance ba8db62f-8120-4469-9974-819d9316d71b on n-h2-854823-8 Oct 04 21:31:35.618554 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-09241901-fb7b-48f7-a279-75eb4b2676a1 req-69bb568e-92fb-4e23-b2e2-62a060f4978c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038317 Oct 04 21:31:35.619174 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3250/6465] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:31:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:31:36.581121 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-3bd8c98f-2510-4fad-b31b-95007d5a4010 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:31:36.581834 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-3bd8c98f-2510-4fad-b31b-95007d5a4010 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] [instance: ba8db62f-8120-4469-9974-819d9316d71b] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:36.588780 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3bd8c98f-2510-4fad-b31b-95007d5a4010 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:36.589248 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3bd8c98f-2510-4fad-b31b-95007d5a4010 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:36.589678 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3bd8c98f-2510-4fad-b31b-95007d5a4010 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:36.590389 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3bd8c98f-2510-4fad-b31b-95007d5a4010 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:36.590936 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3bd8c98f-2510-4fad-b31b-95007d5a4010 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:36.591361 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3bd8c98f-2510-4fad-b31b-95007d5a4010 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:36.724583 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-3bd8c98f-2510-4fad-b31b-95007d5a4010 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d6858e6c5941adbcebf5706357a272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ffd8787fc4fffbee4ac6d72d833ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:31:36.732466 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-3bd8c98f-2510-4fad-b31b-95007d5a4010 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] 10.222.0.33 "GET /compute/v2.1/servers/ba8db62f-8120-4469-9974-819d9316d71b" status: 200 len: 1316 microversion: 2.1 time: 0.155205 Oct 04 21:31:36.733052 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3216/6466] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:31:36 2022] GET /compute/v2.1/servers/ba8db62f-8120-4469-9974-819d9316d71b => generated 1316 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:31:37.754660 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell0:SELECT=2 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:31:37.755411 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell0:SELECT=6 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:31:37.760051 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-78935751-f8f8-4fe8-97cd-f39b5f85acfe tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:31:37.760764 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-78935751-f8f8-4fe8-97cd-f39b5f85acfe tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] [instance: ba8db62f-8120-4469-9974-819d9316d71b] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:37.768702 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-78935751-f8f8-4fe8-97cd-f39b5f85acfe tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:37.769813 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-78935751-f8f8-4fe8-97cd-f39b5f85acfe tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:37.770584 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-78935751-f8f8-4fe8-97cd-f39b5f85acfe tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:37.771312 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-78935751-f8f8-4fe8-97cd-f39b5f85acfe tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:37.771788 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-78935751-f8f8-4fe8-97cd-f39b5f85acfe tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:37.772236 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-78935751-f8f8-4fe8-97cd-f39b5f85acfe tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:37.910571 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-78935751-f8f8-4fe8-97cd-f39b5f85acfe tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d6858e6c5941adbcebf5706357a272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ffd8787fc4fffbee4ac6d72d833ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:31:37.918502 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-78935751-f8f8-4fe8-97cd-f39b5f85acfe tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] 10.222.0.33 "GET /compute/v2.1/servers/ba8db62f-8120-4469-9974-819d9316d71b" status: 200 len: 1505 microversion: 2.1 time: 0.166162 Oct 04 21:31:37.919091 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3251/6467] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:31:37 2022] GET /compute/v2.1/servers/ba8db62f-8120-4469-9974-819d9316d71b => generated 1505 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:31:37.941829 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a7fba403-0f0a-4e3a-905d-4d15efd3294c tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:31:37.942468 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a7fba403-0f0a-4e3a-905d-4d15efd3294c tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] [instance: ba8db62f-8120-4469-9974-819d9316d71b] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:37.944347 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:31:37.945827 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=30 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:31:37.951578 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a7fba403-0f0a-4e3a-905d-4d15efd3294c tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:37.952057 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a7fba403-0f0a-4e3a-905d-4d15efd3294c tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:37.952488 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a7fba403-0f0a-4e3a-905d-4d15efd3294c tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:37.953182 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a7fba403-0f0a-4e3a-905d-4d15efd3294c tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:37.953631 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a7fba403-0f0a-4e3a-905d-4d15efd3294c tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:37.954051 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a7fba403-0f0a-4e3a-905d-4d15efd3294c tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:38.085537 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-a7fba403-0f0a-4e3a-905d-4d15efd3294c tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d6858e6c5941adbcebf5706357a272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ffd8787fc4fffbee4ac6d72d833ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:31:38.093967 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a7fba403-0f0a-4e3a-905d-4d15efd3294c tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] 10.222.0.33 "GET /compute/v2.1/servers/ba8db62f-8120-4469-9974-819d9316d71b" status: 200 len: 1505 microversion: 2.1 time: 0.155967 Oct 04 21:31:38.094610 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3217/6468] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:31:37 2022] GET /compute/v2.1/servers/ba8db62f-8120-4469-9974-819d9316d71b => generated 1505 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:31:38.118055 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-94ace9ad-e5d7-4195-a82f-90a645ffbb9e tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:31:38.120515 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-94ace9ad-e5d7-4195-a82f-90a645ffbb9e tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] [instance: ba8db62f-8120-4469-9974-819d9316d71b] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:38.126614 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-94ace9ad-e5d7-4195-a82f-90a645ffbb9e tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:38.127110 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-94ace9ad-e5d7-4195-a82f-90a645ffbb9e tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:38.127556 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-94ace9ad-e5d7-4195-a82f-90a645ffbb9e tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:38.128270 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-94ace9ad-e5d7-4195-a82f-90a645ffbb9e tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:38.128972 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-94ace9ad-e5d7-4195-a82f-90a645ffbb9e tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:38.129481 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-94ace9ad-e5d7-4195-a82f-90a645ffbb9e tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:38.194828 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-94ace9ad-e5d7-4195-a82f-90a645ffbb9e tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] 10.222.0.33 "PUT /compute/v2.1/servers/ba8db62f-8120-4469-9974-819d9316d71b" status: 200 len: 1077 microversion: 2.1 time: 0.081510 Oct 04 21:31:38.195631 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3252/6469] 10.222.0.33 () {60 vars in 1256 bytes} [Tue Oct 4 21:31:38 2022] PUT /compute/v2.1/servers/ba8db62f-8120-4469-9974-819d9316d71b => generated 1077 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:31:38.214893 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9fd1bd86-db06-4f7c-a5bd-a93347d5514b tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:31:38.215505 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-9fd1bd86-db06-4f7c-a5bd-a93347d5514b tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] [instance: ba8db62f-8120-4469-9974-819d9316d71b] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:38.221638 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9fd1bd86-db06-4f7c-a5bd-a93347d5514b tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:38.222123 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9fd1bd86-db06-4f7c-a5bd-a93347d5514b tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:38.222589 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9fd1bd86-db06-4f7c-a5bd-a93347d5514b tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:38.223288 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9fd1bd86-db06-4f7c-a5bd-a93347d5514b tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:38.223740 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9fd1bd86-db06-4f7c-a5bd-a93347d5514b tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:38.224162 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9fd1bd86-db06-4f7c-a5bd-a93347d5514b tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:38.361409 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-9fd1bd86-db06-4f7c-a5bd-a93347d5514b tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d6858e6c5941adbcebf5706357a272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ffd8787fc4fffbee4ac6d72d833ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:31:38.369742 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-9fd1bd86-db06-4f7c-a5bd-a93347d5514b tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] 10.222.0.33 "GET /compute/v2.1/servers/ba8db62f-8120-4469-9974-819d9316d71b" status: 200 len: 1503 microversion: 2.1 time: 0.158711 Oct 04 21:31:38.370326 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3218/6470] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:31:38 2022] GET /compute/v2.1/servers/ba8db62f-8120-4469-9974-819d9316d71b => generated 1503 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:31:38.392217 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-0be0282b-fc6b-4764-943f-f1d1a39d4e3c tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:31:38.392856 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-0be0282b-fc6b-4764-943f-f1d1a39d4e3c tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] [instance: ba8db62f-8120-4469-9974-819d9316d71b] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:38.399092 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0be0282b-fc6b-4764-943f-f1d1a39d4e3c tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:38.399598 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0be0282b-fc6b-4764-943f-f1d1a39d4e3c tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:38.400051 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0be0282b-fc6b-4764-943f-f1d1a39d4e3c tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:38.400769 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0be0282b-fc6b-4764-943f-f1d1a39d4e3c tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:38.401234 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0be0282b-fc6b-4764-943f-f1d1a39d4e3c tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:38.401681 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0be0282b-fc6b-4764-943f-f1d1a39d4e3c tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:38.533600 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-0be0282b-fc6b-4764-943f-f1d1a39d4e3c tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d6858e6c5941adbcebf5706357a272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ffd8787fc4fffbee4ac6d72d833ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:31:38.541971 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-0be0282b-fc6b-4764-943f-f1d1a39d4e3c tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] 10.222.0.33 "GET /compute/v2.1/servers/ba8db62f-8120-4469-9974-819d9316d71b" status: 200 len: 1503 microversion: 2.1 time: 0.153688 Oct 04 21:31:38.542583 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3253/6471] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:31:38 2022] GET /compute/v2.1/servers/ba8db62f-8120-4469-9974-819d9316d71b => generated 1503 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:31:38.565042 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-73a0ab32-ce28-4353-98ae-bf82174478fc tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:31:38.567511 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-73a0ab32-ce28-4353-98ae-bf82174478fc tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] [instance: ba8db62f-8120-4469-9974-819d9316d71b] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:38.573429 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-73a0ab32-ce28-4353-98ae-bf82174478fc tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:38.573906 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-73a0ab32-ce28-4353-98ae-bf82174478fc tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:38.574332 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-73a0ab32-ce28-4353-98ae-bf82174478fc tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:38.575036 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-73a0ab32-ce28-4353-98ae-bf82174478fc tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:38.575482 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-73a0ab32-ce28-4353-98ae-bf82174478fc tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:38.575897 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-73a0ab32-ce28-4353-98ae-bf82174478fc tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:38.605258 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-73a0ab32-ce28-4353-98ae-bf82174478fc tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '38d6858e6c5941adbcebf5706357a272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ffd8787fc4fffbee4ac6d72d833ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:31:38.611280 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-73a0ab32-ce28-4353-98ae-bf82174478fc tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] [instance: ba8db62f-8120-4469-9974-819d9316d71b] Old instance type m1.heat2, new instance type m1.heat {{(pid=128801) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 04 21:31:38.618805 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-73a0ab32-ce28-4353-98ae-bf82174478fc tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Flavor limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:31:38.619222 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-73a0ab32-ce28-4353-98ae-bf82174478fc tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Image limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:31:38.619689 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-73a0ab32-ce28-4353-98ae-bf82174478fc tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Flavor pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:31:38.620093 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-73a0ab32-ce28-4353-98ae-bf82174478fc tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Image pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:31:38.620499 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-73a0ab32-ce28-4353-98ae-bf82174478fc tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:31:38.689583 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-73a0ab32-ce28-4353-98ae-bf82174478fc tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] 10.222.0.33 "POST /compute/v2.1/servers/ba8db62f-8120-4469-9974-819d9316d71b/action" status: 202 len: 0 microversion: 2.1 time: 0.128412 Oct 04 21:31:38.690404 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3219/6472] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 21:31:38 2022] POST /compute/v2.1/servers/ba8db62f-8120-4469-9974-819d9316d71b/action => generated 0 bytes in 130 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:31:38.700775 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-4869bbcf-e2ef-4eaf-86b7-990f5730cc47 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:31:38.701712 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-4869bbcf-e2ef-4eaf-86b7-990f5730cc47 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] [instance: ba8db62f-8120-4469-9974-819d9316d71b] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:38.711205 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4869bbcf-e2ef-4eaf-86b7-990f5730cc47 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:38.711714 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4869bbcf-e2ef-4eaf-86b7-990f5730cc47 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:38.712169 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4869bbcf-e2ef-4eaf-86b7-990f5730cc47 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:38.712903 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4869bbcf-e2ef-4eaf-86b7-990f5730cc47 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:38.713371 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4869bbcf-e2ef-4eaf-86b7-990f5730cc47 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:38.713814 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4869bbcf-e2ef-4eaf-86b7-990f5730cc47 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:38.855218 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-4869bbcf-e2ef-4eaf-86b7-990f5730cc47 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d6858e6c5941adbcebf5706357a272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ffd8787fc4fffbee4ac6d72d833ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:31:38.864437 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-4869bbcf-e2ef-4eaf-86b7-990f5730cc47 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] 10.222.0.33 "GET /compute/v2.1/servers/ba8db62f-8120-4469-9974-819d9316d71b" status: 200 len: 1514 microversion: 2.1 time: 0.169544 Oct 04 21:31:38.865039 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3254/6473] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:31:38 2022] GET /compute/v2.1/servers/ba8db62f-8120-4469-9974-819d9316d71b => generated 1514 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:31:39.888872 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-37bfd9bd-daae-49e8-9f76-f7d82be0b102 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:31:39.889383 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-37bfd9bd-daae-49e8-9f76-f7d82be0b102 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] [instance: ba8db62f-8120-4469-9974-819d9316d71b] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:39.896967 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-37bfd9bd-daae-49e8-9f76-f7d82be0b102 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:39.897471 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-37bfd9bd-daae-49e8-9f76-f7d82be0b102 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:39.897913 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-37bfd9bd-daae-49e8-9f76-f7d82be0b102 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:39.898659 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-37bfd9bd-daae-49e8-9f76-f7d82be0b102 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:39.899116 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-37bfd9bd-daae-49e8-9f76-f7d82be0b102 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:39.899542 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-37bfd9bd-daae-49e8-9f76-f7d82be0b102 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:40.092132 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-37bfd9bd-daae-49e8-9f76-f7d82be0b102 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d6858e6c5941adbcebf5706357a272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ffd8787fc4fffbee4ac6d72d833ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:31:40.101248 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-37bfd9bd-daae-49e8-9f76-f7d82be0b102 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] 10.222.0.33 "GET /compute/v2.1/servers/ba8db62f-8120-4469-9974-819d9316d71b" status: 200 len: 1514 microversion: 2.1 time: 0.217220 Oct 04 21:31:40.101848 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3220/6474] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:31:39 2022] GET /compute/v2.1/servers/ba8db62f-8120-4469-9974-819d9316d71b => generated 1514 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:31:41.131492 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-5c81008c-27ce-4226-918f-c45e48716ddd tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:31:41.132214 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-5c81008c-27ce-4226-918f-c45e48716ddd tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] [instance: ba8db62f-8120-4469-9974-819d9316d71b] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:41.139539 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5c81008c-27ce-4226-918f-c45e48716ddd tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:41.140050 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5c81008c-27ce-4226-918f-c45e48716ddd tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:41.140504 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5c81008c-27ce-4226-918f-c45e48716ddd tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:41.141244 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5c81008c-27ce-4226-918f-c45e48716ddd tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:41.141722 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5c81008c-27ce-4226-918f-c45e48716ddd tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:41.142168 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5c81008c-27ce-4226-918f-c45e48716ddd tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:41.307175 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-5c81008c-27ce-4226-918f-c45e48716ddd tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d6858e6c5941adbcebf5706357a272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ffd8787fc4fffbee4ac6d72d833ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:31:41.318275 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-5c81008c-27ce-4226-918f-c45e48716ddd tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] 10.222.0.33 "GET /compute/v2.1/servers/ba8db62f-8120-4469-9974-819d9316d71b" status: 200 len: 1519 microversion: 2.1 time: 0.194771 Oct 04 21:31:41.320375 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3255/6475] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:31:41 2022] GET /compute/v2.1/servers/ba8db62f-8120-4469-9974-819d9316d71b => generated 1519 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:31:42.347010 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-3307c32d-751b-442c-a409-a6a7ea7d87ba tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:31:42.348355 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-3307c32d-751b-442c-a409-a6a7ea7d87ba tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] [instance: ba8db62f-8120-4469-9974-819d9316d71b] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:42.355877 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3307c32d-751b-442c-a409-a6a7ea7d87ba tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:42.356371 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3307c32d-751b-442c-a409-a6a7ea7d87ba tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:42.356808 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3307c32d-751b-442c-a409-a6a7ea7d87ba tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:42.357517 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3307c32d-751b-442c-a409-a6a7ea7d87ba tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:42.357973 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3307c32d-751b-442c-a409-a6a7ea7d87ba tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:42.358428 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3307c32d-751b-442c-a409-a6a7ea7d87ba tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:42.494745 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-3307c32d-751b-442c-a409-a6a7ea7d87ba tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d6858e6c5941adbcebf5706357a272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ffd8787fc4fffbee4ac6d72d833ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:31:42.502662 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-3307c32d-751b-442c-a409-a6a7ea7d87ba tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] 10.222.0.33 "GET /compute/v2.1/servers/ba8db62f-8120-4469-9974-819d9316d71b" status: 200 len: 1519 microversion: 2.1 time: 0.159572 Oct 04 21:31:42.503620 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3221/6476] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:31:42 2022] GET /compute/v2.1/servers/ba8db62f-8120-4469-9974-819d9316d71b => generated 1519 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:31:43.526423 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-06a44d42-b5f2-42ad-83e8-9b85ff73d262 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:31:43.527108 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-06a44d42-b5f2-42ad-83e8-9b85ff73d262 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] [instance: ba8db62f-8120-4469-9974-819d9316d71b] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:43.534070 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-06a44d42-b5f2-42ad-83e8-9b85ff73d262 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:43.535323 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-06a44d42-b5f2-42ad-83e8-9b85ff73d262 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:43.535823 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-06a44d42-b5f2-42ad-83e8-9b85ff73d262 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:43.536547 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-06a44d42-b5f2-42ad-83e8-9b85ff73d262 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:43.537009 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-06a44d42-b5f2-42ad-83e8-9b85ff73d262 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:43.537444 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-06a44d42-b5f2-42ad-83e8-9b85ff73d262 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:43.681930 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-06a44d42-b5f2-42ad-83e8-9b85ff73d262 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d6858e6c5941adbcebf5706357a272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ffd8787fc4fffbee4ac6d72d833ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:31:43.690827 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-06a44d42-b5f2-42ad-83e8-9b85ff73d262 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] 10.222.0.33 "GET /compute/v2.1/servers/ba8db62f-8120-4469-9974-819d9316d71b" status: 200 len: 1519 microversion: 2.1 time: 0.168273 Oct 04 21:31:43.691557 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3256/6477] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:31:43 2022] GET /compute/v2.1/servers/ba8db62f-8120-4469-9974-819d9316d71b => generated 1519 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:31:44.717550 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f6db5dd9-47e9-4379-b162-b9468eb36901 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:31:44.718375 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f6db5dd9-47e9-4379-b162-b9468eb36901 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] [instance: ba8db62f-8120-4469-9974-819d9316d71b] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:44.726563 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f6db5dd9-47e9-4379-b162-b9468eb36901 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:44.727141 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f6db5dd9-47e9-4379-b162-b9468eb36901 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:44.727586 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f6db5dd9-47e9-4379-b162-b9468eb36901 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:44.728392 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f6db5dd9-47e9-4379-b162-b9468eb36901 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:44.728848 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f6db5dd9-47e9-4379-b162-b9468eb36901 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:44.729343 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f6db5dd9-47e9-4379-b162-b9468eb36901 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:44.885133 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f6db5dd9-47e9-4379-b162-b9468eb36901 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d6858e6c5941adbcebf5706357a272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ffd8787fc4fffbee4ac6d72d833ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:31:44.895127 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f6db5dd9-47e9-4379-b162-b9468eb36901 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] 10.222.0.33 "GET /compute/v2.1/servers/ba8db62f-8120-4469-9974-819d9316d71b" status: 200 len: 1519 microversion: 2.1 time: 0.182098 Oct 04 21:31:44.895713 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3222/6478] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:31:44 2022] GET /compute/v2.1/servers/ba8db62f-8120-4469-9974-819d9316d71b => generated 1519 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:31:45.921682 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-7732484e-5a62-41f9-a614-b701e7e24411 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:31:45.922306 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-7732484e-5a62-41f9-a614-b701e7e24411 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] [instance: ba8db62f-8120-4469-9974-819d9316d71b] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:45.929659 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7732484e-5a62-41f9-a614-b701e7e24411 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:45.930435 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7732484e-5a62-41f9-a614-b701e7e24411 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:45.930920 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7732484e-5a62-41f9-a614-b701e7e24411 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:45.931639 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7732484e-5a62-41f9-a614-b701e7e24411 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:45.932101 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7732484e-5a62-41f9-a614-b701e7e24411 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:45.932531 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7732484e-5a62-41f9-a614-b701e7e24411 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:46.098310 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-7732484e-5a62-41f9-a614-b701e7e24411 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d6858e6c5941adbcebf5706357a272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ffd8787fc4fffbee4ac6d72d833ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:31:46.112626 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-7732484e-5a62-41f9-a614-b701e7e24411 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] 10.222.0.33 "GET /compute/v2.1/servers/ba8db62f-8120-4469-9974-819d9316d71b" status: 200 len: 1519 microversion: 2.1 time: 0.194937 Oct 04 21:31:46.113220 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3257/6479] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:31:45 2022] GET /compute/v2.1/servers/ba8db62f-8120-4469-9974-819d9316d71b => generated 1519 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:31:47.137327 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-683d6fe9-b8e8-4777-8cdc-0ed42e8cd3ec tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:31:47.137867 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-683d6fe9-b8e8-4777-8cdc-0ed42e8cd3ec tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] [instance: ba8db62f-8120-4469-9974-819d9316d71b] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:47.146330 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-683d6fe9-b8e8-4777-8cdc-0ed42e8cd3ec tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:47.146836 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-683d6fe9-b8e8-4777-8cdc-0ed42e8cd3ec tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:47.147305 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-683d6fe9-b8e8-4777-8cdc-0ed42e8cd3ec tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:47.148047 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-683d6fe9-b8e8-4777-8cdc-0ed42e8cd3ec tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:47.148584 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-683d6fe9-b8e8-4777-8cdc-0ed42e8cd3ec tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:47.149035 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-683d6fe9-b8e8-4777-8cdc-0ed42e8cd3ec tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:47.301278 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-683d6fe9-b8e8-4777-8cdc-0ed42e8cd3ec tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d6858e6c5941adbcebf5706357a272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ffd8787fc4fffbee4ac6d72d833ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:31:47.310019 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-683d6fe9-b8e8-4777-8cdc-0ed42e8cd3ec tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] 10.222.0.33 "GET /compute/v2.1/servers/ba8db62f-8120-4469-9974-819d9316d71b" status: 200 len: 1519 microversion: 2.1 time: 0.176638 Oct 04 21:31:47.310696 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3223/6480] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:31:47 2022] GET /compute/v2.1/servers/ba8db62f-8120-4469-9974-819d9316d71b => generated 1519 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:31:48.333619 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-75aec535-82f3-48c9-82d9-e4f5bad948bc tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:31:48.334433 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-75aec535-82f3-48c9-82d9-e4f5bad948bc tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] [instance: ba8db62f-8120-4469-9974-819d9316d71b] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:48.341786 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-75aec535-82f3-48c9-82d9-e4f5bad948bc tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:48.342281 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-75aec535-82f3-48c9-82d9-e4f5bad948bc tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:48.342768 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-75aec535-82f3-48c9-82d9-e4f5bad948bc tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:48.343467 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-75aec535-82f3-48c9-82d9-e4f5bad948bc tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:48.344019 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-75aec535-82f3-48c9-82d9-e4f5bad948bc tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:48.344365 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-75aec535-82f3-48c9-82d9-e4f5bad948bc tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:48.505045 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-75aec535-82f3-48c9-82d9-e4f5bad948bc tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d6858e6c5941adbcebf5706357a272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ffd8787fc4fffbee4ac6d72d833ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:31:48.520085 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-75aec535-82f3-48c9-82d9-e4f5bad948bc tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] 10.222.0.33 "GET /compute/v2.1/servers/ba8db62f-8120-4469-9974-819d9316d71b" status: 200 len: 1519 microversion: 2.1 time: 0.190160 Oct 04 21:31:48.521141 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3258/6481] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:31:48 2022] GET /compute/v2.1/servers/ba8db62f-8120-4469-9974-819d9316d71b => generated 1519 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:31:49.545182 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f3769861-d8cb-4171-91b5-2aa2acf7c701 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:31:49.545898 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f3769861-d8cb-4171-91b5-2aa2acf7c701 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] [instance: ba8db62f-8120-4469-9974-819d9316d71b] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:49.554758 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f3769861-d8cb-4171-91b5-2aa2acf7c701 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:49.555508 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f3769861-d8cb-4171-91b5-2aa2acf7c701 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:49.555944 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f3769861-d8cb-4171-91b5-2aa2acf7c701 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:49.556689 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f3769861-d8cb-4171-91b5-2aa2acf7c701 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:49.557163 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f3769861-d8cb-4171-91b5-2aa2acf7c701 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:49.557583 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f3769861-d8cb-4171-91b5-2aa2acf7c701 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:49.721079 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f3769861-d8cb-4171-91b5-2aa2acf7c701 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d6858e6c5941adbcebf5706357a272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ffd8787fc4fffbee4ac6d72d833ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:31:49.735380 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f3769861-d8cb-4171-91b5-2aa2acf7c701 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] 10.222.0.33 "GET /compute/v2.1/servers/ba8db62f-8120-4469-9974-819d9316d71b" status: 200 len: 1519 microversion: 2.1 time: 0.193928 Oct 04 21:31:49.736221 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3224/6482] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:31:49 2022] GET /compute/v2.1/servers/ba8db62f-8120-4469-9974-819d9316d71b => generated 1519 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:31:50.760911 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-151f4900-5a3c-47d7-a5d8-b5b1f444059f tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:31:50.761534 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-151f4900-5a3c-47d7-a5d8-b5b1f444059f tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] [instance: ba8db62f-8120-4469-9974-819d9316d71b] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:50.768574 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-151f4900-5a3c-47d7-a5d8-b5b1f444059f tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:50.772625 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-151f4900-5a3c-47d7-a5d8-b5b1f444059f tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:50.772625 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-151f4900-5a3c-47d7-a5d8-b5b1f444059f tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:50.772625 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-151f4900-5a3c-47d7-a5d8-b5b1f444059f tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:50.772625 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-151f4900-5a3c-47d7-a5d8-b5b1f444059f tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:50.772625 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-151f4900-5a3c-47d7-a5d8-b5b1f444059f tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:50.921259 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-151f4900-5a3c-47d7-a5d8-b5b1f444059f tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d6858e6c5941adbcebf5706357a272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ffd8787fc4fffbee4ac6d72d833ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:31:50.933695 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-151f4900-5a3c-47d7-a5d8-b5b1f444059f tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] 10.222.0.33 "GET /compute/v2.1/servers/ba8db62f-8120-4469-9974-819d9316d71b" status: 200 len: 1519 microversion: 2.1 time: 0.176791 Oct 04 21:31:50.934397 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3259/6483] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:31:50 2022] GET /compute/v2.1/servers/ba8db62f-8120-4469-9974-819d9316d71b => generated 1519 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:31:51.960935 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d8456753-ded8-45f6-8921-19a2fe3678d1 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:31:51.961750 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d8456753-ded8-45f6-8921-19a2fe3678d1 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] [instance: ba8db62f-8120-4469-9974-819d9316d71b] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:51.970468 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d8456753-ded8-45f6-8921-19a2fe3678d1 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:51.970958 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d8456753-ded8-45f6-8921-19a2fe3678d1 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:51.971389 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d8456753-ded8-45f6-8921-19a2fe3678d1 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:51.972789 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d8456753-ded8-45f6-8921-19a2fe3678d1 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:51.973245 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d8456753-ded8-45f6-8921-19a2fe3678d1 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:51.973710 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d8456753-ded8-45f6-8921-19a2fe3678d1 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:52.130999 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d8456753-ded8-45f6-8921-19a2fe3678d1 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d6858e6c5941adbcebf5706357a272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ffd8787fc4fffbee4ac6d72d833ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:31:52.139155 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d8456753-ded8-45f6-8921-19a2fe3678d1 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] 10.222.0.33 "GET /compute/v2.1/servers/ba8db62f-8120-4469-9974-819d9316d71b" status: 200 len: 1519 microversion: 2.1 time: 0.184405 Oct 04 21:31:52.139905 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3225/6484] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:31:51 2022] GET /compute/v2.1/servers/ba8db62f-8120-4469-9974-819d9316d71b => generated 1519 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:31:53.165539 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-b0239ee4-ff09-4f33-82a1-3f67ef58e0c6 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:31:53.166272 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-b0239ee4-ff09-4f33-82a1-3f67ef58e0c6 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] [instance: ba8db62f-8120-4469-9974-819d9316d71b] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:53.174302 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b0239ee4-ff09-4f33-82a1-3f67ef58e0c6 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:53.175605 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b0239ee4-ff09-4f33-82a1-3f67ef58e0c6 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:53.175980 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b0239ee4-ff09-4f33-82a1-3f67ef58e0c6 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:53.176731 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b0239ee4-ff09-4f33-82a1-3f67ef58e0c6 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:53.177205 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b0239ee4-ff09-4f33-82a1-3f67ef58e0c6 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:53.177651 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b0239ee4-ff09-4f33-82a1-3f67ef58e0c6 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:53.328070 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-b0239ee4-ff09-4f33-82a1-3f67ef58e0c6 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d6858e6c5941adbcebf5706357a272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ffd8787fc4fffbee4ac6d72d833ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:31:53.336569 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-b0239ee4-ff09-4f33-82a1-3f67ef58e0c6 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] 10.222.0.33 "GET /compute/v2.1/servers/ba8db62f-8120-4469-9974-819d9316d71b" status: 200 len: 1519 microversion: 2.1 time: 0.175744 Oct 04 21:31:53.337166 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3260/6485] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:31:53 2022] GET /compute/v2.1/servers/ba8db62f-8120-4469-9974-819d9316d71b => generated 1519 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:31:54.365090 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-baf72671-084d-4c3c-bed9-2ffa3013823d tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:31:54.365634 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-baf72671-084d-4c3c-bed9-2ffa3013823d tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] [instance: ba8db62f-8120-4469-9974-819d9316d71b] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:54.372802 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-baf72671-084d-4c3c-bed9-2ffa3013823d tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:54.373363 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-baf72671-084d-4c3c-bed9-2ffa3013823d tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:54.373802 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-baf72671-084d-4c3c-bed9-2ffa3013823d tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:54.374551 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-baf72671-084d-4c3c-bed9-2ffa3013823d tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:54.375010 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-baf72671-084d-4c3c-bed9-2ffa3013823d tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:54.375434 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-baf72671-084d-4c3c-bed9-2ffa3013823d tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:54.789348 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-baf72671-084d-4c3c-bed9-2ffa3013823d tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d6858e6c5941adbcebf5706357a272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ffd8787fc4fffbee4ac6d72d833ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:31:54.797097 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-baf72671-084d-4c3c-bed9-2ffa3013823d tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] 10.222.0.33 "GET /compute/v2.1/servers/ba8db62f-8120-4469-9974-819d9316d71b" status: 200 len: 1519 microversion: 2.1 time: 0.436155 Oct 04 21:31:54.797698 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3226/6486] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:31:54 2022] GET /compute/v2.1/servers/ba8db62f-8120-4469-9974-819d9316d71b => generated 1519 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:31:55.821933 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-8fc2bd07-acbf-41a2-ad20-30607b2cf2da tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:31:55.822741 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-8fc2bd07-acbf-41a2-ad20-30607b2cf2da tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] [instance: ba8db62f-8120-4469-9974-819d9316d71b] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:55.829642 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8fc2bd07-acbf-41a2-ad20-30607b2cf2da tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:55.830136 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8fc2bd07-acbf-41a2-ad20-30607b2cf2da tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:55.830620 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8fc2bd07-acbf-41a2-ad20-30607b2cf2da tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:55.831497 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8fc2bd07-acbf-41a2-ad20-30607b2cf2da tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:55.831973 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8fc2bd07-acbf-41a2-ad20-30607b2cf2da tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:55.832533 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8fc2bd07-acbf-41a2-ad20-30607b2cf2da tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:55.974453 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-8fc2bd07-acbf-41a2-ad20-30607b2cf2da tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d6858e6c5941adbcebf5706357a272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ffd8787fc4fffbee4ac6d72d833ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:31:55.983357 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-8fc2bd07-acbf-41a2-ad20-30607b2cf2da tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] 10.222.0.33 "GET /compute/v2.1/servers/ba8db62f-8120-4469-9974-819d9316d71b" status: 200 len: 1519 microversion: 2.1 time: 0.165518 Oct 04 21:31:55.983944 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3261/6487] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:31:55 2022] GET /compute/v2.1/servers/ba8db62f-8120-4469-9974-819d9316d71b => generated 1519 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:31:57.007927 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-eea65244-e6c3-4a70-a704-9a2dbbf4659d tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:31:57.008545 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-eea65244-e6c3-4a70-a704-9a2dbbf4659d tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] [instance: ba8db62f-8120-4469-9974-819d9316d71b] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:57.015503 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-eea65244-e6c3-4a70-a704-9a2dbbf4659d tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:57.015987 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-eea65244-e6c3-4a70-a704-9a2dbbf4659d tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:57.016419 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-eea65244-e6c3-4a70-a704-9a2dbbf4659d tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:57.017111 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-eea65244-e6c3-4a70-a704-9a2dbbf4659d tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:57.017562 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-eea65244-e6c3-4a70-a704-9a2dbbf4659d tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:57.017979 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-eea65244-e6c3-4a70-a704-9a2dbbf4659d tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:57.022671 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:31:57.157059 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-eea65244-e6c3-4a70-a704-9a2dbbf4659d tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d6858e6c5941adbcebf5706357a272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ffd8787fc4fffbee4ac6d72d833ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:31:57.165383 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-eea65244-e6c3-4a70-a704-9a2dbbf4659d tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] 10.222.0.33 "GET /compute/v2.1/servers/ba8db62f-8120-4469-9974-819d9316d71b" status: 200 len: 1519 microversion: 2.1 time: 0.161551 Oct 04 21:31:57.165946 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3227/6488] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:31:57 2022] GET /compute/v2.1/servers/ba8db62f-8120-4469-9974-819d9316d71b => generated 1519 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:31:58.189301 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-539fe373-3c6a-4d58-b5d0-b86607db7723 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:31:58.189927 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-539fe373-3c6a-4d58-b5d0-b86607db7723 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] [instance: ba8db62f-8120-4469-9974-819d9316d71b] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:58.197857 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-539fe373-3c6a-4d58-b5d0-b86607db7723 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:58.198361 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-539fe373-3c6a-4d58-b5d0-b86607db7723 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:58.198820 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-539fe373-3c6a-4d58-b5d0-b86607db7723 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:58.199549 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-539fe373-3c6a-4d58-b5d0-b86607db7723 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:58.200017 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-539fe373-3c6a-4d58-b5d0-b86607db7723 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:58.200460 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-539fe373-3c6a-4d58-b5d0-b86607db7723 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:58.345602 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-539fe373-3c6a-4d58-b5d0-b86607db7723 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d6858e6c5941adbcebf5706357a272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ffd8787fc4fffbee4ac6d72d833ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:31:58.353932 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-539fe373-3c6a-4d58-b5d0-b86607db7723 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] 10.222.0.33 "GET /compute/v2.1/servers/ba8db62f-8120-4469-9974-819d9316d71b" status: 200 len: 1519 microversion: 2.1 time: 0.168473 Oct 04 21:31:58.354653 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3262/6489] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:31:58 2022] GET /compute/v2.1/servers/ba8db62f-8120-4469-9974-819d9316d71b => generated 1519 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:31:59.377439 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7318e895-5a6e-4989-945a-8e64f6b58718 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:31:59.378028 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-7318e895-5a6e-4989-945a-8e64f6b58718 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] [instance: ba8db62f-8120-4469-9974-819d9316d71b] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:31:59.385327 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7318e895-5a6e-4989-945a-8e64f6b58718 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:59.386158 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7318e895-5a6e-4989-945a-8e64f6b58718 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:59.386959 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7318e895-5a6e-4989-945a-8e64f6b58718 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:59.388207 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7318e895-5a6e-4989-945a-8e64f6b58718 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:31:59.389035 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7318e895-5a6e-4989-945a-8e64f6b58718 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:31:59.389819 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7318e895-5a6e-4989-945a-8e64f6b58718 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:31:59.526580 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-7318e895-5a6e-4989-945a-8e64f6b58718 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d6858e6c5941adbcebf5706357a272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ffd8787fc4fffbee4ac6d72d833ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:31:59.534403 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-7318e895-5a6e-4989-945a-8e64f6b58718 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] 10.222.0.33 "GET /compute/v2.1/servers/ba8db62f-8120-4469-9974-819d9316d71b" status: 200 len: 1519 microversion: 2.1 time: 0.160834 Oct 04 21:31:59.534981 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3228/6490] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:31:59 2022] GET /compute/v2.1/servers/ba8db62f-8120-4469-9974-819d9316d71b => generated 1519 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:32:00.558108 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-a7efa3c8-5a6d-491e-b4af-cb2b81812bec tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:32:00.558706 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-a7efa3c8-5a6d-491e-b4af-cb2b81812bec tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] [instance: ba8db62f-8120-4469-9974-819d9316d71b] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:32:00.565520 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a7efa3c8-5a6d-491e-b4af-cb2b81812bec tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:00.566018 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a7efa3c8-5a6d-491e-b4af-cb2b81812bec tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:00.566815 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a7efa3c8-5a6d-491e-b4af-cb2b81812bec tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:00.567537 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a7efa3c8-5a6d-491e-b4af-cb2b81812bec tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:00.567998 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a7efa3c8-5a6d-491e-b4af-cb2b81812bec tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:00.568434 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a7efa3c8-5a6d-491e-b4af-cb2b81812bec tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:00.703791 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-a7efa3c8-5a6d-491e-b4af-cb2b81812bec tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d6858e6c5941adbcebf5706357a272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ffd8787fc4fffbee4ac6d72d833ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:00.712543 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-a7efa3c8-5a6d-491e-b4af-cb2b81812bec tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] 10.222.0.33 "GET /compute/v2.1/servers/ba8db62f-8120-4469-9974-819d9316d71b" status: 200 len: 1519 microversion: 2.1 time: 0.158684 Oct 04 21:32:00.713132 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3263/6491] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:32:00 2022] GET /compute/v2.1/servers/ba8db62f-8120-4469-9974-819d9316d71b => generated 1519 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:32:01.735370 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5be4bdff-a913-494d-91d4-778a21ffff45 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:32:01.735983 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-5be4bdff-a913-494d-91d4-778a21ffff45 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] [instance: ba8db62f-8120-4469-9974-819d9316d71b] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:32:01.743548 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5be4bdff-a913-494d-91d4-778a21ffff45 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:01.744340 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5be4bdff-a913-494d-91d4-778a21ffff45 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:01.744783 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5be4bdff-a913-494d-91d4-778a21ffff45 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:01.745478 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5be4bdff-a913-494d-91d4-778a21ffff45 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:01.745935 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5be4bdff-a913-494d-91d4-778a21ffff45 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:01.746379 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5be4bdff-a913-494d-91d4-778a21ffff45 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:01.887349 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-5be4bdff-a913-494d-91d4-778a21ffff45 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d6858e6c5941adbcebf5706357a272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ffd8787fc4fffbee4ac6d72d833ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:01.896733 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5be4bdff-a913-494d-91d4-778a21ffff45 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] 10.222.0.33 "GET /compute/v2.1/servers/ba8db62f-8120-4469-9974-819d9316d71b" status: 200 len: 1519 microversion: 2.1 time: 0.165177 Oct 04 21:32:01.897340 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3229/6492] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:32:01 2022] GET /compute/v2.1/servers/ba8db62f-8120-4469-9974-819d9316d71b => generated 1519 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:32:02.924938 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-7ee2e0f2-d868-45e8-adcf-062f1c70be42 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:32:02.926052 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-7ee2e0f2-d868-45e8-adcf-062f1c70be42 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] [instance: ba8db62f-8120-4469-9974-819d9316d71b] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:32:02.933903 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7ee2e0f2-d868-45e8-adcf-062f1c70be42 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:02.934457 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7ee2e0f2-d868-45e8-adcf-062f1c70be42 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:02.934907 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7ee2e0f2-d868-45e8-adcf-062f1c70be42 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:02.935629 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7ee2e0f2-d868-45e8-adcf-062f1c70be42 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:02.936093 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7ee2e0f2-d868-45e8-adcf-062f1c70be42 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:02.936530 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7ee2e0f2-d868-45e8-adcf-062f1c70be42 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:03.076594 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-7ee2e0f2-d868-45e8-adcf-062f1c70be42 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d6858e6c5941adbcebf5706357a272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ffd8787fc4fffbee4ac6d72d833ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:03.085174 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-7ee2e0f2-d868-45e8-adcf-062f1c70be42 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] 10.222.0.33 "GET /compute/v2.1/servers/ba8db62f-8120-4469-9974-819d9316d71b" status: 200 len: 1519 microversion: 2.1 time: 0.164020 Oct 04 21:32:03.085784 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3264/6493] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:32:02 2022] GET /compute/v2.1/servers/ba8db62f-8120-4469-9974-819d9316d71b => generated 1519 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:32:04.109524 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-4d89437c-2d35-4d55-9850-2b211b97f137 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:32:04.110151 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-4d89437c-2d35-4d55-9850-2b211b97f137 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] [instance: ba8db62f-8120-4469-9974-819d9316d71b] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:32:04.117644 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4d89437c-2d35-4d55-9850-2b211b97f137 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:04.118408 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4d89437c-2d35-4d55-9850-2b211b97f137 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:04.118939 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4d89437c-2d35-4d55-9850-2b211b97f137 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:04.119745 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4d89437c-2d35-4d55-9850-2b211b97f137 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:04.120199 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4d89437c-2d35-4d55-9850-2b211b97f137 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:04.120621 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4d89437c-2d35-4d55-9850-2b211b97f137 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:04.263440 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-4d89437c-2d35-4d55-9850-2b211b97f137 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d6858e6c5941adbcebf5706357a272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ffd8787fc4fffbee4ac6d72d833ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:04.271648 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-4d89437c-2d35-4d55-9850-2b211b97f137 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] 10.222.0.33 "GET /compute/v2.1/servers/ba8db62f-8120-4469-9974-819d9316d71b" status: 200 len: 1519 microversion: 2.1 time: 0.166513 Oct 04 21:32:04.272227 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3230/6494] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:32:04 2022] GET /compute/v2.1/servers/ba8db62f-8120-4469-9974-819d9316d71b => generated 1519 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:32:05.295509 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-93871a4a-bf38-4757-b830-18d533015510 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:32:05.296044 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-93871a4a-bf38-4757-b830-18d533015510 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] [instance: ba8db62f-8120-4469-9974-819d9316d71b] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:32:05.303963 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-93871a4a-bf38-4757-b830-18d533015510 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:05.304462 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-93871a4a-bf38-4757-b830-18d533015510 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:05.305186 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-93871a4a-bf38-4757-b830-18d533015510 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:05.305893 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-93871a4a-bf38-4757-b830-18d533015510 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:05.306509 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-93871a4a-bf38-4757-b830-18d533015510 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:05.306956 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-93871a4a-bf38-4757-b830-18d533015510 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:05.444887 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-93871a4a-bf38-4757-b830-18d533015510 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d6858e6c5941adbcebf5706357a272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ffd8787fc4fffbee4ac6d72d833ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:05.452638 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-93871a4a-bf38-4757-b830-18d533015510 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] 10.222.0.33 "GET /compute/v2.1/servers/ba8db62f-8120-4469-9974-819d9316d71b" status: 200 len: 1519 microversion: 2.1 time: 0.161258 Oct 04 21:32:05.453212 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3265/6495] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:32:05 2022] GET /compute/v2.1/servers/ba8db62f-8120-4469-9974-819d9316d71b => generated 1519 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:32:06.482701 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-36a78fac-0674-4fb7-b705-e31d5fcb18f1 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:32:06.483306 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-36a78fac-0674-4fb7-b705-e31d5fcb18f1 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] [instance: ba8db62f-8120-4469-9974-819d9316d71b] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:32:06.490770 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-36a78fac-0674-4fb7-b705-e31d5fcb18f1 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:06.491259 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-36a78fac-0674-4fb7-b705-e31d5fcb18f1 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:06.491695 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-36a78fac-0674-4fb7-b705-e31d5fcb18f1 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:06.492412 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-36a78fac-0674-4fb7-b705-e31d5fcb18f1 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:06.492861 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-36a78fac-0674-4fb7-b705-e31d5fcb18f1 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:06.493283 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-36a78fac-0674-4fb7-b705-e31d5fcb18f1 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:06.640837 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-36a78fac-0674-4fb7-b705-e31d5fcb18f1 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d6858e6c5941adbcebf5706357a272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ffd8787fc4fffbee4ac6d72d833ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:06.649712 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-36a78fac-0674-4fb7-b705-e31d5fcb18f1 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] 10.222.0.33 "GET /compute/v2.1/servers/ba8db62f-8120-4469-9974-819d9316d71b" status: 200 len: 1519 microversion: 2.1 time: 0.171011 Oct 04 21:32:06.650295 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3231/6496] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:32:06 2022] GET /compute/v2.1/servers/ba8db62f-8120-4469-9974-819d9316d71b => generated 1519 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:32:07.678030 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-f4add990-90d9-483b-9334-8f8b8aacd67b tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:32:07.679243 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-f4add990-90d9-483b-9334-8f8b8aacd67b tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] [instance: ba8db62f-8120-4469-9974-819d9316d71b] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:32:07.690112 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f4add990-90d9-483b-9334-8f8b8aacd67b tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:07.690954 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f4add990-90d9-483b-9334-8f8b8aacd67b tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:07.692363 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f4add990-90d9-483b-9334-8f8b8aacd67b tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:07.692724 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f4add990-90d9-483b-9334-8f8b8aacd67b tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:07.693696 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f4add990-90d9-483b-9334-8f8b8aacd67b tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:07.693696 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f4add990-90d9-483b-9334-8f8b8aacd67b tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:07.847536 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-f4add990-90d9-483b-9334-8f8b8aacd67b tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d6858e6c5941adbcebf5706357a272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ffd8787fc4fffbee4ac6d72d833ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:07.850237 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:32:07.859354 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-f4add990-90d9-483b-9334-8f8b8aacd67b tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] 10.222.0.33 "GET /compute/v2.1/servers/ba8db62f-8120-4469-9974-819d9316d71b" status: 200 len: 1518 microversion: 2.1 time: 0.188873 Oct 04 21:32:07.859947 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3266/6497] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:32:07 2022] GET /compute/v2.1/servers/ba8db62f-8120-4469-9974-819d9316d71b => generated 1518 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:32:08.621276 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-94da7485-a134-49b8-b9e9-684d7220319f req-601d7591-5e28-4238-90e0-f49027ed9ed9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba8db62f-8120-4469-9974-819d9316d71b", "name": "network-vif-unplugged", "status": "completed", "tag": "676bff1c-5c80-4041-ab2e-2e448a8a3a67"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:32:08.626528 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=34 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:32:08.634405 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-94da7485-a134-49b8-b9e9-684d7220319f req-601d7591-5e28-4238-90e0-f49027ed9ed9 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:08.634405 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-94da7485-a134-49b8-b9e9-684d7220319f req-601d7591-5e28-4238-90e0-f49027ed9ed9 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:08.634405 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-94da7485-a134-49b8-b9e9-684d7220319f req-601d7591-5e28-4238-90e0-f49027ed9ed9 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:08.645577 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-94da7485-a134-49b8-b9e9-684d7220319f req-601d7591-5e28-4238-90e0-f49027ed9ed9 service nova] Creating event network-vif-unplugged:676bff1c-5c80-4041-ab2e-2e448a8a3a67 for instance ba8db62f-8120-4469-9974-819d9316d71b on n-h1-854823-8 Oct 04 21:32:08.651218 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [req-94da7485-a134-49b8-b9e9-684d7220319f req-601d7591-5e28-4238-90e0-f49027ed9ed9 service nova] Instance ba8db62f-8120-4469-9974-819d9316d71b is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854823-8', 'n-h2-854823-8'} {{(pid=128801) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 21:32:08.663755 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-94da7485-a134-49b8-b9e9-684d7220319f req-601d7591-5e28-4238-90e0-f49027ed9ed9 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.101771 Oct 04 21:32:08.664369 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3232/6498] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:32:08 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:32:08.895824 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-10168e45-2088-4e21-a2b5-335b42c6517c tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:32:08.897122 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-10168e45-2088-4e21-a2b5-335b42c6517c tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] [instance: ba8db62f-8120-4469-9974-819d9316d71b] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:32:08.901794 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_api:SELECT=34 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:32:08.913500 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-10168e45-2088-4e21-a2b5-335b42c6517c tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:08.914152 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-10168e45-2088-4e21-a2b5-335b42c6517c tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:08.914766 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-10168e45-2088-4e21-a2b5-335b42c6517c tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:08.915779 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-10168e45-2088-4e21-a2b5-335b42c6517c tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:08.916542 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-10168e45-2088-4e21-a2b5-335b42c6517c tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:08.917127 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-10168e45-2088-4e21-a2b5-335b42c6517c tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:09.089408 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-10168e45-2088-4e21-a2b5-335b42c6517c tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d6858e6c5941adbcebf5706357a272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ffd8787fc4fffbee4ac6d72d833ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:09.097676 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-10168e45-2088-4e21-a2b5-335b42c6517c tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] 10.222.0.33 "GET /compute/v2.1/servers/ba8db62f-8120-4469-9974-819d9316d71b" status: 200 len: 1518 microversion: 2.1 time: 0.212230 Oct 04 21:32:09.099470 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3267/6499] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:32:08 2022] GET /compute/v2.1/servers/ba8db62f-8120-4469-9974-819d9316d71b => generated 1518 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:32:10.123787 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1d885c5d-bd30-4c62-a760-32bfbab9e313 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:32:10.124601 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-1d885c5d-bd30-4c62-a760-32bfbab9e313 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] [instance: ba8db62f-8120-4469-9974-819d9316d71b] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:32:10.132795 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1d885c5d-bd30-4c62-a760-32bfbab9e313 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:10.133303 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1d885c5d-bd30-4c62-a760-32bfbab9e313 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:10.133745 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1d885c5d-bd30-4c62-a760-32bfbab9e313 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:10.134506 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1d885c5d-bd30-4c62-a760-32bfbab9e313 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:10.134980 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1d885c5d-bd30-4c62-a760-32bfbab9e313 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:10.135407 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1d885c5d-bd30-4c62-a760-32bfbab9e313 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:10.272392 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-1d885c5d-bd30-4c62-a760-32bfbab9e313 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d6858e6c5941adbcebf5706357a272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ffd8787fc4fffbee4ac6d72d833ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:10.280544 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-1d885c5d-bd30-4c62-a760-32bfbab9e313 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] 10.222.0.33 "GET /compute/v2.1/servers/ba8db62f-8120-4469-9974-819d9316d71b" status: 200 len: 1516 microversion: 2.1 time: 0.162124 Oct 04 21:32:10.281141 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3233/6500] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:32:10 2022] GET /compute/v2.1/servers/ba8db62f-8120-4469-9974-819d9316d71b => generated 1516 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:32:10.680859 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-d1ce3145-bd5f-47a7-9208-e4a7aeaad0c0 req-ffd51d9e-49d9-40cb-8c12-d12debde8ba1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba8db62f-8120-4469-9974-819d9316d71b", "tag": "676bff1c-5c80-4041-ab2e-2e448a8a3a67"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:32:10.692020 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-d1ce3145-bd5f-47a7-9208-e4a7aeaad0c0 req-ffd51d9e-49d9-40cb-8c12-d12debde8ba1 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:10.692614 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-d1ce3145-bd5f-47a7-9208-e4a7aeaad0c0 req-ffd51d9e-49d9-40cb-8c12-d12debde8ba1 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:10.698917 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-d1ce3145-bd5f-47a7-9208-e4a7aeaad0c0 req-ffd51d9e-49d9-40cb-8c12-d12debde8ba1 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:10.705409 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-d1ce3145-bd5f-47a7-9208-e4a7aeaad0c0 req-ffd51d9e-49d9-40cb-8c12-d12debde8ba1 service nova] Creating event network-changed:676bff1c-5c80-4041-ab2e-2e448a8a3a67 for instance ba8db62f-8120-4469-9974-819d9316d71b on n-h1-854823-8 Oct 04 21:32:10.711047 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [req-d1ce3145-bd5f-47a7-9208-e4a7aeaad0c0 req-ffd51d9e-49d9-40cb-8c12-d12debde8ba1 service nova] Instance ba8db62f-8120-4469-9974-819d9316d71b is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854823-8', 'n-h2-854823-8'} {{(pid=128802) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 21:32:10.721859 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-d1ce3145-bd5f-47a7-9208-e4a7aeaad0c0 req-ffd51d9e-49d9-40cb-8c12-d12debde8ba1 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045166 Oct 04 21:32:10.722532 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3268/6501] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:32:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:32:11.309215 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1097b99e-7d40-4028-842c-f96ce079c70a tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:32:11.311491 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-1097b99e-7d40-4028-842c-f96ce079c70a tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] [instance: ba8db62f-8120-4469-9974-819d9316d71b] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:32:11.322213 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1097b99e-7d40-4028-842c-f96ce079c70a tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:11.322893 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1097b99e-7d40-4028-842c-f96ce079c70a tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:11.323335 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1097b99e-7d40-4028-842c-f96ce079c70a tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:11.324145 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1097b99e-7d40-4028-842c-f96ce079c70a tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:11.325291 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1097b99e-7d40-4028-842c-f96ce079c70a tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:11.325291 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1097b99e-7d40-4028-842c-f96ce079c70a tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:11.486051 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-1097b99e-7d40-4028-842c-f96ce079c70a tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d6858e6c5941adbcebf5706357a272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ffd8787fc4fffbee4ac6d72d833ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:11.495881 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-1097b99e-7d40-4028-842c-f96ce079c70a tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] 10.222.0.33 "GET /compute/v2.1/servers/ba8db62f-8120-4469-9974-819d9316d71b" status: 200 len: 1513 microversion: 2.1 time: 0.195024 Oct 04 21:32:11.496495 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3234/6502] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:32:11 2022] GET /compute/v2.1/servers/ba8db62f-8120-4469-9974-819d9316d71b => generated 1513 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:32:11.521545 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-6daee01d-f4dd-4e23-83a5-3481334ef9e8 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:32:11.522469 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-6daee01d-f4dd-4e23-83a5-3481334ef9e8 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] [instance: ba8db62f-8120-4469-9974-819d9316d71b] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:32:11.529186 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6daee01d-f4dd-4e23-83a5-3481334ef9e8 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:11.529789 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6daee01d-f4dd-4e23-83a5-3481334ef9e8 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:11.530322 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6daee01d-f4dd-4e23-83a5-3481334ef9e8 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:11.531162 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6daee01d-f4dd-4e23-83a5-3481334ef9e8 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:11.531705 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6daee01d-f4dd-4e23-83a5-3481334ef9e8 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:11.532256 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6daee01d-f4dd-4e23-83a5-3481334ef9e8 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:11.599894 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-6daee01d-f4dd-4e23-83a5-3481334ef9e8 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] 10.222.0.33 "POST /compute/v2.1/servers/ba8db62f-8120-4469-9974-819d9316d71b/action" status: 204 len: 0 microversion: 2.1 time: 0.083099 Oct 04 21:32:11.600747 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3269/6503] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 21:32:11 2022] POST /compute/v2.1/servers/ba8db62f-8120-4469-9974-819d9316d71b/action => generated 0 bytes in 85 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:32:11.609401 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-69ca26b3-8b1c-4c49-a6ce-32dabce2fcc3 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:32:11.610500 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-69ca26b3-8b1c-4c49-a6ce-32dabce2fcc3 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] [instance: ba8db62f-8120-4469-9974-819d9316d71b] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:32:11.618523 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-69ca26b3-8b1c-4c49-a6ce-32dabce2fcc3 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:11.619125 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-69ca26b3-8b1c-4c49-a6ce-32dabce2fcc3 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:11.619782 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-69ca26b3-8b1c-4c49-a6ce-32dabce2fcc3 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:11.620897 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-69ca26b3-8b1c-4c49-a6ce-32dabce2fcc3 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:11.621629 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-69ca26b3-8b1c-4c49-a6ce-32dabce2fcc3 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:11.621984 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-69ca26b3-8b1c-4c49-a6ce-32dabce2fcc3 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:11.916548 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-69ca26b3-8b1c-4c49-a6ce-32dabce2fcc3 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d6858e6c5941adbcebf5706357a272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ffd8787fc4fffbee4ac6d72d833ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:11.924867 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-69ca26b3-8b1c-4c49-a6ce-32dabce2fcc3 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] 10.222.0.33 "GET /compute/v2.1/servers/ba8db62f-8120-4469-9974-819d9316d71b" status: 200 len: 1513 microversion: 2.1 time: 0.319428 Oct 04 21:32:11.926973 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3235/6504] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:32:11 2022] GET /compute/v2.1/servers/ba8db62f-8120-4469-9974-819d9316d71b => generated 1513 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:32:12.952454 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-dc7fc072-8c4b-479f-bc79-0afa84ad38a3 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:32:12.953311 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-dc7fc072-8c4b-479f-bc79-0afa84ad38a3 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] [instance: ba8db62f-8120-4469-9974-819d9316d71b] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:32:12.960570 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dc7fc072-8c4b-479f-bc79-0afa84ad38a3 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:12.961295 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dc7fc072-8c4b-479f-bc79-0afa84ad38a3 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:12.961680 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dc7fc072-8c4b-479f-bc79-0afa84ad38a3 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:12.962429 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dc7fc072-8c4b-479f-bc79-0afa84ad38a3 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:12.963032 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dc7fc072-8c4b-479f-bc79-0afa84ad38a3 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:12.963480 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dc7fc072-8c4b-479f-bc79-0afa84ad38a3 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:13.130712 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-dc7fc072-8c4b-479f-bc79-0afa84ad38a3 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d6858e6c5941adbcebf5706357a272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ffd8787fc4fffbee4ac6d72d833ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:13.139296 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-dc7fc072-8c4b-479f-bc79-0afa84ad38a3 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] 10.222.0.33 "GET /compute/v2.1/servers/ba8db62f-8120-4469-9974-819d9316d71b" status: 200 len: 1513 microversion: 2.1 time: 0.192091 Oct 04 21:32:13.140470 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3270/6505] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:32:12 2022] GET /compute/v2.1/servers/ba8db62f-8120-4469-9974-819d9316d71b => generated 1513 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:32:14.163757 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2dfd5ef4-6ea0-4b8b-8cc0-2bce6b8c81b0 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:32:14.164357 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-2dfd5ef4-6ea0-4b8b-8cc0-2bce6b8c81b0 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] [instance: ba8db62f-8120-4469-9974-819d9316d71b] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:32:14.171194 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2dfd5ef4-6ea0-4b8b-8cc0-2bce6b8c81b0 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:14.171677 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2dfd5ef4-6ea0-4b8b-8cc0-2bce6b8c81b0 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:14.172113 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2dfd5ef4-6ea0-4b8b-8cc0-2bce6b8c81b0 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:14.172806 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2dfd5ef4-6ea0-4b8b-8cc0-2bce6b8c81b0 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:14.173258 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2dfd5ef4-6ea0-4b8b-8cc0-2bce6b8c81b0 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:14.173674 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2dfd5ef4-6ea0-4b8b-8cc0-2bce6b8c81b0 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:14.302698 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-2dfd5ef4-6ea0-4b8b-8cc0-2bce6b8c81b0 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d6858e6c5941adbcebf5706357a272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ffd8787fc4fffbee4ac6d72d833ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:14.311006 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-2dfd5ef4-6ea0-4b8b-8cc0-2bce6b8c81b0 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] 10.222.0.33 "GET /compute/v2.1/servers/ba8db62f-8120-4469-9974-819d9316d71b" status: 200 len: 1505 microversion: 2.1 time: 0.151778 Oct 04 21:32:14.311571 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3236/6506] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:32:14 2022] GET /compute/v2.1/servers/ba8db62f-8120-4469-9974-819d9316d71b => generated 1505 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:32:14.334273 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-065358c5-61da-4894-963a-5054375eb9a4 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:32:14.334929 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-065358c5-61da-4894-963a-5054375eb9a4 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] [instance: ba8db62f-8120-4469-9974-819d9316d71b] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:32:14.342081 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-065358c5-61da-4894-963a-5054375eb9a4 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:14.342621 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-065358c5-61da-4894-963a-5054375eb9a4 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:14.343067 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-065358c5-61da-4894-963a-5054375eb9a4 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:14.343774 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-065358c5-61da-4894-963a-5054375eb9a4 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:14.344238 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-065358c5-61da-4894-963a-5054375eb9a4 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:14.344668 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-065358c5-61da-4894-963a-5054375eb9a4 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:14.481125 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-065358c5-61da-4894-963a-5054375eb9a4 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d6858e6c5941adbcebf5706357a272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ffd8787fc4fffbee4ac6d72d833ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:14.489754 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-065358c5-61da-4894-963a-5054375eb9a4 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] 10.222.0.33 "GET /compute/v2.1/servers/ba8db62f-8120-4469-9974-819d9316d71b" status: 200 len: 1505 microversion: 2.1 time: 0.159591 Oct 04 21:32:14.490334 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3271/6507] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:32:14 2022] GET /compute/v2.1/servers/ba8db62f-8120-4469-9974-819d9316d71b => generated 1505 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:32:14.515956 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7511c273-be30-4f28-9fa5-923006ab1889 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Action: 'create', calling method: .version_select at 0x7f3c6ee0e5e0>, body: {"keypair": {"name": "tempest-keypair-38589764", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKTGGN6EtnE9WhPcnn0mVIyJWbtkFDEPSvETvh+jfWClj0OOxQqMsldfUQapKpsIDChDzo4kZ2El+I67v+HpR1agwxIBqjqu7eP2zisJZ1paoU3iWI0r3xV0CD9DEK8cWw=="}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:32:14.531878 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-7511c273-be30-4f28-9fa5-923006ab1889 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Getting quotas for project dd7ffd8787fc4fffbee4ac6d72d833ea. Resources: {'key_pairs'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:32:14.538527 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-7511c273-be30-4f28-9fa5-923006ab1889 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Getting quotas for user 38d6858e6c5941adbcebf5706357a272 and project dd7ffd8787fc4fffbee4ac6d72d833ea. Resources: {'key_pairs'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:32:14.566833 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-7511c273-be30-4f28-9fa5-923006ab1889 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.054776 Oct 04 21:32:14.567446 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3237/6508] 10.222.0.33 () {60 vars in 1159 bytes} [Tue Oct 4 21:32:14 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:32:15.144529 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-2541b51b-1c75-4a59-be29-77dcac2e45a8 req-b5375c57-294e-4e85-a26f-215620fa8309 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba8db62f-8120-4469-9974-819d9316d71b", "name": "network-vif-plugged", "status": "completed", "tag": "676bff1c-5c80-4041-ab2e-2e448a8a3a67"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:32:15.154644 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-2541b51b-1c75-4a59-be29-77dcac2e45a8 req-b5375c57-294e-4e85-a26f-215620fa8309 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:15.155144 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-2541b51b-1c75-4a59-be29-77dcac2e45a8 req-b5375c57-294e-4e85-a26f-215620fa8309 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:15.155590 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-2541b51b-1c75-4a59-be29-77dcac2e45a8 req-b5375c57-294e-4e85-a26f-215620fa8309 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:15.168534 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-2541b51b-1c75-4a59-be29-77dcac2e45a8 req-b5375c57-294e-4e85-a26f-215620fa8309 service nova] Creating event network-vif-plugged:676bff1c-5c80-4041-ab2e-2e448a8a3a67 for instance ba8db62f-8120-4469-9974-819d9316d71b on n-h1-854823-8 Oct 04 21:32:15.174262 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-2541b51b-1c75-4a59-be29-77dcac2e45a8 req-b5375c57-294e-4e85-a26f-215620fa8309 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087508 Oct 04 21:32:15.175802 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3272/6509] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:32:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:32:16.194030 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b2a18a82-9cdf-431e-8d41-5996d50ab4a7 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:32:16.195640 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b2a18a82-9cdf-431e-8d41-5996d50ab4a7 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] [instance: ba8db62f-8120-4469-9974-819d9316d71b] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:32:16.201875 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b2a18a82-9cdf-431e-8d41-5996d50ab4a7 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:16.202417 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b2a18a82-9cdf-431e-8d41-5996d50ab4a7 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:16.202849 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b2a18a82-9cdf-431e-8d41-5996d50ab4a7 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:16.203561 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b2a18a82-9cdf-431e-8d41-5996d50ab4a7 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:16.204024 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b2a18a82-9cdf-431e-8d41-5996d50ab4a7 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:16.204452 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b2a18a82-9cdf-431e-8d41-5996d50ab4a7 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:16.344553 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-b2a18a82-9cdf-431e-8d41-5996d50ab4a7 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d6858e6c5941adbcebf5706357a272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ffd8787fc4fffbee4ac6d72d833ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:16.352596 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b2a18a82-9cdf-431e-8d41-5996d50ab4a7 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] 10.222.0.33 "GET /compute/v2.1/servers/ba8db62f-8120-4469-9974-819d9316d71b" status: 200 len: 1505 microversion: 2.1 time: 0.164783 Oct 04 21:32:16.353524 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3238/6510] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:32:16 2022] GET /compute/v2.1/servers/ba8db62f-8120-4469-9974-819d9316d71b => generated 1505 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:32:16.377647 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-a68da60b-00c6-4ad1-8292-f249a4234584 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:32:16.378239 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-a68da60b-00c6-4ad1-8292-f249a4234584 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] [instance: ba8db62f-8120-4469-9974-819d9316d71b] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:32:16.385399 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a68da60b-00c6-4ad1-8292-f249a4234584 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:16.385895 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a68da60b-00c6-4ad1-8292-f249a4234584 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:16.386356 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a68da60b-00c6-4ad1-8292-f249a4234584 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:16.387083 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a68da60b-00c6-4ad1-8292-f249a4234584 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:16.387547 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a68da60b-00c6-4ad1-8292-f249a4234584 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:16.387987 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a68da60b-00c6-4ad1-8292-f249a4234584 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:16.415331 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-a68da60b-00c6-4ad1-8292-f249a4234584 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] [instance: ba8db62f-8120-4469-9974-819d9316d71b] Going to try to terminate instance {{(pid=128802) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:32:16.512049 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-a68da60b-00c6-4ad1-8292-f249a4234584 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] 10.222.0.33 "DELETE /compute/v2.1/servers/ba8db62f-8120-4469-9974-819d9316d71b" status: 204 len: 0 microversion: 2.1 time: 0.138689 Oct 04 21:32:16.512759 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3273/6511] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 21:32:16 2022] DELETE /compute/v2.1/servers/ba8db62f-8120-4469-9974-819d9316d71b => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:32:16.582392 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7f7fa525-824c-44b9-bd8d-c9df9a2ae13c tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1841775096", "imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63", "flavorRef": "452", "networks": [{"uuid": "2899c36d-2ad5-49c0-b0fc-aeee21433ba2"}]}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:32:16.642210 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.network.neutron [None req-7f7fa525-824c-44b9-bd8d-c9df9a2ae13c tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] validate_networks() for [('2899c36d-2ad5-49c0-b0fc-aeee21433ba2', None, None, None, None, None)] {{(pid=128801) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:32:17.128765 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-7f7fa525-824c-44b9-bd8d-c9df9a2ae13c tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Flavor limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:32:17.129554 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-7f7fa525-824c-44b9-bd8d-c9df9a2ae13c tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Image limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:32:17.130078 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-7f7fa525-824c-44b9-bd8d-c9df9a2ae13c tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Flavor pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:32:17.130553 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-7f7fa525-824c-44b9-bd8d-c9df9a2ae13c tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Image pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:32:17.130972 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-7f7fa525-824c-44b9-bd8d-c9df9a2ae13c tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:32:17.139958 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7f7fa525-824c-44b9-bd8d-c9df9a2ae13c tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:17.140440 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7f7fa525-824c-44b9-bd8d-c9df9a2ae13c tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:17.140877 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7f7fa525-824c-44b9-bd8d-c9df9a2ae13c tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:17.141606 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7f7fa525-824c-44b9-bd8d-c9df9a2ae13c tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:17.142059 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7f7fa525-824c-44b9-bd8d-c9df9a2ae13c tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:17.142515 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7f7fa525-824c-44b9-bd8d-c9df9a2ae13c tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:17.161463 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-7f7fa525-824c-44b9-bd8d-c9df9a2ae13c tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Getting quotas for project dd7ffd8787fc4fffbee4ac6d72d833ea. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:32:17.166828 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-7f7fa525-824c-44b9-bd8d-c9df9a2ae13c tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Getting quotas for user 38d6858e6c5941adbcebf5706357a272 and project dd7ffd8787fc4fffbee4ac6d72d833ea. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:32:17.179374 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-7f7fa525-824c-44b9-bd8d-c9df9a2ae13c tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Going to run 1 instances... {{(pid=128801) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:32:17.182021 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-7f7fa525-824c-44b9-bd8d-c9df9a2ae13c tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] [instance: 354c136d-e30f-4efd-9a8d-db7aed7b3b5e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='15b24725-0c99-4bcf-b1fb-907cdf8e2d63',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128801) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:32:17.232610 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-7f7fa525-824c-44b9-bd8d-c9df9a2ae13c tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.654305 Oct 04 21:32:17.234249 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3239/6512] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 21:32:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 657 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:32:17.246191 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-8255dc12-6cc0-4ae2-b09f-0cb10cfa6496 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:32:17.247176 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-8255dc12-6cc0-4ae2-b09f-0cb10cfa6496 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] [instance: 354c136d-e30f-4efd-9a8d-db7aed7b3b5e] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:32:17.306157 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-8255dc12-6cc0-4ae2-b09f-0cb10cfa6496 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d6858e6c5941adbcebf5706357a272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ffd8787fc4fffbee4ac6d72d833ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:17.313810 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-8255dc12-6cc0-4ae2-b09f-0cb10cfa6496 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] 10.222.0.33 "GET /compute/v2.1/servers/354c136d-e30f-4efd-9a8d-db7aed7b3b5e" status: 200 len: 1218 microversion: 2.1 time: 0.072100 Oct 04 21:32:17.314553 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3274/6513] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:32:17 2022] GET /compute/v2.1/servers/354c136d-e30f-4efd-9a8d-db7aed7b3b5e => generated 1218 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:32:18.338814 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6e6d7f69-9b62-4a9d-8f4b-47f72b122087 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:32:18.339385 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-6e6d7f69-9b62-4a9d-8f4b-47f72b122087 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] [instance: 354c136d-e30f-4efd-9a8d-db7aed7b3b5e] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:32:18.346691 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6e6d7f69-9b62-4a9d-8f4b-47f72b122087 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:18.347711 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6e6d7f69-9b62-4a9d-8f4b-47f72b122087 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:18.348372 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6e6d7f69-9b62-4a9d-8f4b-47f72b122087 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:18.349194 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6e6d7f69-9b62-4a9d-8f4b-47f72b122087 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:18.349674 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6e6d7f69-9b62-4a9d-8f4b-47f72b122087 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:18.350280 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6e6d7f69-9b62-4a9d-8f4b-47f72b122087 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:18.421349 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-6e6d7f69-9b62-4a9d-8f4b-47f72b122087 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d6858e6c5941adbcebf5706357a272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ffd8787fc4fffbee4ac6d72d833ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:18.433249 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-6e6d7f69-9b62-4a9d-8f4b-47f72b122087 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] 10.222.0.33 "GET /compute/v2.1/servers/354c136d-e30f-4efd-9a8d-db7aed7b3b5e" status: 200 len: 1270 microversion: 2.1 time: 0.099706 Oct 04 21:32:18.433869 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3240/6514] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:32:18 2022] GET /compute/v2.1/servers/354c136d-e30f-4efd-9a8d-db7aed7b3b5e => generated 1270 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:32:18.519583 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-30ff5cce-cdcd-469f-a9a8-3e3ac2ad7616 req-5b48402c-5608-4a1b-8faa-717ba4da29b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba8db62f-8120-4469-9974-819d9316d71b", "name": "network-vif-deleted", "tag": "676bff1c-5c80-4041-ab2e-2e448a8a3a67"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:32:18.530849 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-30ff5cce-cdcd-469f-a9a8-3e3ac2ad7616 req-5b48402c-5608-4a1b-8faa-717ba4da29b5 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:18.531587 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-30ff5cce-cdcd-469f-a9a8-3e3ac2ad7616 req-5b48402c-5608-4a1b-8faa-717ba4da29b5 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:18.532212 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-30ff5cce-cdcd-469f-a9a8-3e3ac2ad7616 req-5b48402c-5608-4a1b-8faa-717ba4da29b5 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:18.545937 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-30ff5cce-cdcd-469f-a9a8-3e3ac2ad7616 req-5b48402c-5608-4a1b-8faa-717ba4da29b5 service nova] Creating event network-vif-deleted:676bff1c-5c80-4041-ab2e-2e448a8a3a67 for instance ba8db62f-8120-4469-9974-819d9316d71b on n-h1-854823-8 Oct 04 21:32:18.554517 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-30ff5cce-cdcd-469f-a9a8-3e3ac2ad7616 req-5b48402c-5608-4a1b-8faa-717ba4da29b5 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038802 Oct 04 21:32:18.555379 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3275/6515] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:32:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:32:19.457051 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d5375ca1-beee-4ea8-9e11-1581b7097efa tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:32:19.458710 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d5375ca1-beee-4ea8-9e11-1581b7097efa tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] [instance: 354c136d-e30f-4efd-9a8d-db7aed7b3b5e] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:32:19.465638 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d5375ca1-beee-4ea8-9e11-1581b7097efa tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:19.466518 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d5375ca1-beee-4ea8-9e11-1581b7097efa tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:19.467080 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d5375ca1-beee-4ea8-9e11-1581b7097efa tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:19.468052 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d5375ca1-beee-4ea8-9e11-1581b7097efa tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:19.468759 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d5375ca1-beee-4ea8-9e11-1581b7097efa tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:19.469658 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d5375ca1-beee-4ea8-9e11-1581b7097efa tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:19.683872 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d5375ca1-beee-4ea8-9e11-1581b7097efa tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d6858e6c5941adbcebf5706357a272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ffd8787fc4fffbee4ac6d72d833ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:19.693972 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d5375ca1-beee-4ea8-9e11-1581b7097efa tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] 10.222.0.33 "GET /compute/v2.1/servers/354c136d-e30f-4efd-9a8d-db7aed7b3b5e" status: 200 len: 1318 microversion: 2.1 time: 0.240826 Oct 04 21:32:19.694215 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3241/6516] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:32:19 2022] GET /compute/v2.1/servers/354c136d-e30f-4efd-9a8d-db7aed7b3b5e => generated 1318 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:32:20.104766 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-007663b0-0a4d-4d21-89a6-6e3c1dfeb50c req-fa95202e-966e-4eeb-9cba-16acda613202 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "354c136d-e30f-4efd-9a8d-db7aed7b3b5e", "tag": "8191150b-e501-42d5-94b9-1ed623f6a0fc"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:32:20.116214 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-007663b0-0a4d-4d21-89a6-6e3c1dfeb50c req-fa95202e-966e-4eeb-9cba-16acda613202 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:20.116718 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-007663b0-0a4d-4d21-89a6-6e3c1dfeb50c req-fa95202e-966e-4eeb-9cba-16acda613202 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:20.117160 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-007663b0-0a4d-4d21-89a6-6e3c1dfeb50c req-fa95202e-966e-4eeb-9cba-16acda613202 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:20.129546 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-007663b0-0a4d-4d21-89a6-6e3c1dfeb50c req-fa95202e-966e-4eeb-9cba-16acda613202 service nova] Creating event network-changed:8191150b-e501-42d5-94b9-1ed623f6a0fc for instance 354c136d-e30f-4efd-9a8d-db7aed7b3b5e on n-h2-854823-8 Oct 04 21:32:20.134585 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-007663b0-0a4d-4d21-89a6-6e3c1dfeb50c req-fa95202e-966e-4eeb-9cba-16acda613202 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090269 Oct 04 21:32:20.135197 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3276/6517] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:32:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:32:20.717190 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-96ed35b0-6aca-4a78-96c8-bf23b9963948 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:32:20.717832 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-96ed35b0-6aca-4a78-96c8-bf23b9963948 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] [instance: 354c136d-e30f-4efd-9a8d-db7aed7b3b5e] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:32:20.725221 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-96ed35b0-6aca-4a78-96c8-bf23b9963948 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:20.725705 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-96ed35b0-6aca-4a78-96c8-bf23b9963948 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:20.726141 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-96ed35b0-6aca-4a78-96c8-bf23b9963948 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:20.726900 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-96ed35b0-6aca-4a78-96c8-bf23b9963948 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:20.727321 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-96ed35b0-6aca-4a78-96c8-bf23b9963948 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:20.728333 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-96ed35b0-6aca-4a78-96c8-bf23b9963948 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:20.866458 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-96ed35b0-6aca-4a78-96c8-bf23b9963948 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d6858e6c5941adbcebf5706357a272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ffd8787fc4fffbee4ac6d72d833ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:20.875783 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-96ed35b0-6aca-4a78-96c8-bf23b9963948 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] 10.222.0.33 "GET /compute/v2.1/servers/354c136d-e30f-4efd-9a8d-db7aed7b3b5e" status: 200 len: 1318 microversion: 2.1 time: 0.162385 Oct 04 21:32:20.876426 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3242/6518] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:32:20 2022] GET /compute/v2.1/servers/354c136d-e30f-4efd-9a8d-db7aed7b3b5e => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:32:21.902913 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-5eb91a1f-1033-482b-82d5-f1c408a1c363 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:32:21.903596 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-5eb91a1f-1033-482b-82d5-f1c408a1c363 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] [instance: 354c136d-e30f-4efd-9a8d-db7aed7b3b5e] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:32:21.910117 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5eb91a1f-1033-482b-82d5-f1c408a1c363 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:21.910728 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5eb91a1f-1033-482b-82d5-f1c408a1c363 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:21.911233 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5eb91a1f-1033-482b-82d5-f1c408a1c363 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:21.912137 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5eb91a1f-1033-482b-82d5-f1c408a1c363 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:21.912825 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5eb91a1f-1033-482b-82d5-f1c408a1c363 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:21.913277 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5eb91a1f-1033-482b-82d5-f1c408a1c363 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:22.135771 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-5eb91a1f-1033-482b-82d5-f1c408a1c363 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d6858e6c5941adbcebf5706357a272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ffd8787fc4fffbee4ac6d72d833ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:22.144093 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-5eb91a1f-1033-482b-82d5-f1c408a1c363 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] 10.222.0.33 "GET /compute/v2.1/servers/354c136d-e30f-4efd-9a8d-db7aed7b3b5e" status: 200 len: 1318 microversion: 2.1 time: 0.246372 Oct 04 21:32:22.144696 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3277/6519] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:32:21 2022] GET /compute/v2.1/servers/354c136d-e30f-4efd-9a8d-db7aed7b3b5e => generated 1318 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:32:23.166485 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d8d4bf6b-cb6d-4e85-9905-39564751a5c5 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:32:23.167105 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d8d4bf6b-cb6d-4e85-9905-39564751a5c5 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] [instance: 354c136d-e30f-4efd-9a8d-db7aed7b3b5e] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:32:23.174083 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d8d4bf6b-cb6d-4e85-9905-39564751a5c5 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:23.174598 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d8d4bf6b-cb6d-4e85-9905-39564751a5c5 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:23.175624 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d8d4bf6b-cb6d-4e85-9905-39564751a5c5 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:23.176436 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d8d4bf6b-cb6d-4e85-9905-39564751a5c5 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:23.176896 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d8d4bf6b-cb6d-4e85-9905-39564751a5c5 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:23.177323 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d8d4bf6b-cb6d-4e85-9905-39564751a5c5 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:23.308572 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d8d4bf6b-cb6d-4e85-9905-39564751a5c5 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d6858e6c5941adbcebf5706357a272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ffd8787fc4fffbee4ac6d72d833ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:23.317016 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d8d4bf6b-cb6d-4e85-9905-39564751a5c5 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] 10.222.0.33 "GET /compute/v2.1/servers/354c136d-e30f-4efd-9a8d-db7aed7b3b5e" status: 200 len: 1318 microversion: 2.1 time: 0.154285 Oct 04 21:32:23.317637 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3243/6520] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:32:23 2022] GET /compute/v2.1/servers/354c136d-e30f-4efd-9a8d-db7aed7b3b5e => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:32:24.340561 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-868d9052-761f-490f-b78b-8b099e78d9f3 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:32:24.341316 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-868d9052-761f-490f-b78b-8b099e78d9f3 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] [instance: 354c136d-e30f-4efd-9a8d-db7aed7b3b5e] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:32:24.348701 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-868d9052-761f-490f-b78b-8b099e78d9f3 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:24.349204 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-868d9052-761f-490f-b78b-8b099e78d9f3 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:24.349674 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-868d9052-761f-490f-b78b-8b099e78d9f3 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:24.350399 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-868d9052-761f-490f-b78b-8b099e78d9f3 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:24.350881 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-868d9052-761f-490f-b78b-8b099e78d9f3 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:24.351327 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-868d9052-761f-490f-b78b-8b099e78d9f3 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:24.492103 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-868d9052-761f-490f-b78b-8b099e78d9f3 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d6858e6c5941adbcebf5706357a272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ffd8787fc4fffbee4ac6d72d833ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:24.500097 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-868d9052-761f-490f-b78b-8b099e78d9f3 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] 10.222.0.33 "GET /compute/v2.1/servers/354c136d-e30f-4efd-9a8d-db7aed7b3b5e" status: 200 len: 1318 microversion: 2.1 time: 0.163491 Oct 04 21:32:24.500678 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3278/6521] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:32:24 2022] GET /compute/v2.1/servers/354c136d-e30f-4efd-9a8d-db7aed7b3b5e => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:32:25.525212 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-cd4d3444-c7a1-496f-b6ef-aa72a7263dba tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:32:25.525835 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-cd4d3444-c7a1-496f-b6ef-aa72a7263dba tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] [instance: 354c136d-e30f-4efd-9a8d-db7aed7b3b5e] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:32:25.533009 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cd4d3444-c7a1-496f-b6ef-aa72a7263dba tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:25.533507 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cd4d3444-c7a1-496f-b6ef-aa72a7263dba tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:25.533948 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cd4d3444-c7a1-496f-b6ef-aa72a7263dba tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:25.535416 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cd4d3444-c7a1-496f-b6ef-aa72a7263dba tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:25.536149 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cd4d3444-c7a1-496f-b6ef-aa72a7263dba tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:25.536591 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cd4d3444-c7a1-496f-b6ef-aa72a7263dba tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:25.680816 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-cd4d3444-c7a1-496f-b6ef-aa72a7263dba tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d6858e6c5941adbcebf5706357a272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ffd8787fc4fffbee4ac6d72d833ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:25.688744 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-cd4d3444-c7a1-496f-b6ef-aa72a7263dba tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] 10.222.0.33 "GET /compute/v2.1/servers/354c136d-e30f-4efd-9a8d-db7aed7b3b5e" status: 200 len: 1318 microversion: 2.1 time: 0.167462 Oct 04 21:32:25.689344 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3244/6522] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:32:25 2022] GET /compute/v2.1/servers/354c136d-e30f-4efd-9a8d-db7aed7b3b5e => generated 1318 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:32:25.770464 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-bf3a3bd7-2b5b-40f8-99b4-23b5c0bfd92b req-1017f9cb-6a71-4f11-ab04-dc435fc34dd1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "354c136d-e30f-4efd-9a8d-db7aed7b3b5e", "name": "network-vif-plugged", "status": "completed", "tag": "8191150b-e501-42d5-94b9-1ed623f6a0fc"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:32:25.781737 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-bf3a3bd7-2b5b-40f8-99b4-23b5c0bfd92b req-1017f9cb-6a71-4f11-ab04-dc435fc34dd1 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:25.782224 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-bf3a3bd7-2b5b-40f8-99b4-23b5c0bfd92b req-1017f9cb-6a71-4f11-ab04-dc435fc34dd1 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:25.782704 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-bf3a3bd7-2b5b-40f8-99b4-23b5c0bfd92b req-1017f9cb-6a71-4f11-ab04-dc435fc34dd1 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:25.795049 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-bf3a3bd7-2b5b-40f8-99b4-23b5c0bfd92b req-1017f9cb-6a71-4f11-ab04-dc435fc34dd1 service nova] Creating event network-vif-plugged:8191150b-e501-42d5-94b9-1ed623f6a0fc for instance 354c136d-e30f-4efd-9a8d-db7aed7b3b5e on n-h2-854823-8 Oct 04 21:32:25.800076 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-bf3a3bd7-2b5b-40f8-99b4-23b5c0bfd92b req-1017f9cb-6a71-4f11-ab04-dc435fc34dd1 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034194 Oct 04 21:32:25.800691 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3279/6523] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:32:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:32:26.712956 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-3316c095-0c5c-4c5f-a131-baa6e6cceba5 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:32:26.713568 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-3316c095-0c5c-4c5f-a131-baa6e6cceba5 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] [instance: 354c136d-e30f-4efd-9a8d-db7aed7b3b5e] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:32:26.720618 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3316c095-0c5c-4c5f-a131-baa6e6cceba5 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:26.721100 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3316c095-0c5c-4c5f-a131-baa6e6cceba5 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:26.721535 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3316c095-0c5c-4c5f-a131-baa6e6cceba5 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:26.722233 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3316c095-0c5c-4c5f-a131-baa6e6cceba5 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:26.722718 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3316c095-0c5c-4c5f-a131-baa6e6cceba5 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:26.723143 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3316c095-0c5c-4c5f-a131-baa6e6cceba5 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:26.860023 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-3316c095-0c5c-4c5f-a131-baa6e6cceba5 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d6858e6c5941adbcebf5706357a272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ffd8787fc4fffbee4ac6d72d833ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:26.863758 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=100 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:32:26.868947 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-3316c095-0c5c-4c5f-a131-baa6e6cceba5 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] 10.222.0.33 "GET /compute/v2.1/servers/354c136d-e30f-4efd-9a8d-db7aed7b3b5e" status: 200 len: 1318 microversion: 2.1 time: 0.159905 Oct 04 21:32:26.869485 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3245/6524] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:32:26 2022] GET /compute/v2.1/servers/354c136d-e30f-4efd-9a8d-db7aed7b3b5e => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:32:27.890861 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell0:SELECT=2 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:32:27.895849 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-3d05134d-9902-4836-9185-e85c29d0539d tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:32:27.896700 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-3d05134d-9902-4836-9185-e85c29d0539d tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] [instance: 354c136d-e30f-4efd-9a8d-db7aed7b3b5e] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:32:27.903399 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3d05134d-9902-4836-9185-e85c29d0539d tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:27.903899 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3d05134d-9902-4836-9185-e85c29d0539d tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:27.904340 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3d05134d-9902-4836-9185-e85c29d0539d tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:27.905036 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3d05134d-9902-4836-9185-e85c29d0539d tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:27.905494 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3d05134d-9902-4836-9185-e85c29d0539d tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:27.906004 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3d05134d-9902-4836-9185-e85c29d0539d tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:28.041890 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-3d05134d-9902-4836-9185-e85c29d0539d tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d6858e6c5941adbcebf5706357a272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ffd8787fc4fffbee4ac6d72d833ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:28.049631 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-3d05134d-9902-4836-9185-e85c29d0539d tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] 10.222.0.33 "GET /compute/v2.1/servers/354c136d-e30f-4efd-9a8d-db7aed7b3b5e" status: 200 len: 1507 microversion: 2.1 time: 0.160680 Oct 04 21:32:28.050409 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3280/6525] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:32:27 2022] GET /compute/v2.1/servers/354c136d-e30f-4efd-9a8d-db7aed7b3b5e => generated 1507 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:32:28.073627 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5c7f638f-1a56-48ad-8eaa-b73d3b7fba66 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:32:28.074241 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-5c7f638f-1a56-48ad-8eaa-b73d3b7fba66 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] [instance: 354c136d-e30f-4efd-9a8d-db7aed7b3b5e] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:32:28.076326 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:32:28.076988 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=10 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:32:28.085042 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5c7f638f-1a56-48ad-8eaa-b73d3b7fba66 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:28.085537 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5c7f638f-1a56-48ad-8eaa-b73d3b7fba66 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:28.086008 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5c7f638f-1a56-48ad-8eaa-b73d3b7fba66 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:28.086744 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5c7f638f-1a56-48ad-8eaa-b73d3b7fba66 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:28.087236 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5c7f638f-1a56-48ad-8eaa-b73d3b7fba66 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:28.087664 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5c7f638f-1a56-48ad-8eaa-b73d3b7fba66 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:28.220940 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-5c7f638f-1a56-48ad-8eaa-b73d3b7fba66 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d6858e6c5941adbcebf5706357a272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ffd8787fc4fffbee4ac6d72d833ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:28.228921 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5c7f638f-1a56-48ad-8eaa-b73d3b7fba66 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] 10.222.0.33 "GET /compute/v2.1/servers/354c136d-e30f-4efd-9a8d-db7aed7b3b5e" status: 200 len: 1507 microversion: 2.1 time: 0.159290 Oct 04 21:32:28.229506 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3246/6526] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:32:28 2022] GET /compute/v2.1/servers/354c136d-e30f-4efd-9a8d-db7aed7b3b5e => generated 1507 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:32:28.251520 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-e2432ae9-d6bf-45e4-9816-d206b2882f51 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "AUTO"}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:32:28.254249 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-e2432ae9-d6bf-45e4-9816-d206b2882f51 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] [instance: 354c136d-e30f-4efd-9a8d-db7aed7b3b5e] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:32:28.260322 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e2432ae9-d6bf-45e4-9816-d206b2882f51 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:28.260847 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e2432ae9-d6bf-45e4-9816-d206b2882f51 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:28.261262 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e2432ae9-d6bf-45e4-9816-d206b2882f51 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:28.261975 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e2432ae9-d6bf-45e4-9816-d206b2882f51 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:28.262509 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e2432ae9-d6bf-45e4-9816-d206b2882f51 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:28.262922 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e2432ae9-d6bf-45e4-9816-d206b2882f51 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:28.293671 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-e2432ae9-d6bf-45e4-9816-d206b2882f51 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '38d6858e6c5941adbcebf5706357a272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ffd8787fc4fffbee4ac6d72d833ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:28.299401 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-e2432ae9-d6bf-45e4-9816-d206b2882f51 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] [instance: 354c136d-e30f-4efd-9a8d-db7aed7b3b5e] Old instance type m1.heat2, new instance type m1.heat {{(pid=128802) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 04 21:32:28.306281 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-e2432ae9-d6bf-45e4-9816-d206b2882f51 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Flavor limits 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:32:28.306740 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-e2432ae9-d6bf-45e4-9816-d206b2882f51 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Image limits 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:32:28.307219 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-e2432ae9-d6bf-45e4-9816-d206b2882f51 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Flavor pref 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:32:28.307637 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-e2432ae9-d6bf-45e4-9816-d206b2882f51 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Image pref 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:32:28.308054 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-e2432ae9-d6bf-45e4-9816-d206b2882f51 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:32:28.374920 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-e2432ae9-d6bf-45e4-9816-d206b2882f51 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] 10.222.0.33 "POST /compute/v2.1/servers/354c136d-e30f-4efd-9a8d-db7aed7b3b5e/action" status: 202 len: 0 microversion: 2.1 time: 0.127390 Oct 04 21:32:28.375550 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3281/6527] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 21:32:28 2022] POST /compute/v2.1/servers/354c136d-e30f-4efd-9a8d-db7aed7b3b5e/action => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 21:32:28.384307 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c2de2ffe-e832-46be-b111-f4d57f6b3546 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:32:28.384990 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c2de2ffe-e832-46be-b111-f4d57f6b3546 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] [instance: 354c136d-e30f-4efd-9a8d-db7aed7b3b5e] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:32:28.391502 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c2de2ffe-e832-46be-b111-f4d57f6b3546 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:28.392086 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c2de2ffe-e832-46be-b111-f4d57f6b3546 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:28.392586 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c2de2ffe-e832-46be-b111-f4d57f6b3546 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:28.393671 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c2de2ffe-e832-46be-b111-f4d57f6b3546 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:28.395270 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c2de2ffe-e832-46be-b111-f4d57f6b3546 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:28.395792 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c2de2ffe-e832-46be-b111-f4d57f6b3546 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:28.537520 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c2de2ffe-e832-46be-b111-f4d57f6b3546 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d6858e6c5941adbcebf5706357a272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ffd8787fc4fffbee4ac6d72d833ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:28.545733 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c2de2ffe-e832-46be-b111-f4d57f6b3546 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] 10.222.0.33 "GET /compute/v2.1/servers/354c136d-e30f-4efd-9a8d-db7aed7b3b5e" status: 200 len: 1514 microversion: 2.1 time: 0.165198 Oct 04 21:32:28.546322 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3247/6528] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:32:28 2022] GET /compute/v2.1/servers/354c136d-e30f-4efd-9a8d-db7aed7b3b5e => generated 1514 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:32:29.570233 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-609bf504-1567-4970-9969-419f3606dfe8 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:32:29.570902 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-609bf504-1567-4970-9969-419f3606dfe8 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] [instance: 354c136d-e30f-4efd-9a8d-db7aed7b3b5e] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:32:29.578017 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-609bf504-1567-4970-9969-419f3606dfe8 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:29.578547 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-609bf504-1567-4970-9969-419f3606dfe8 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:29.579005 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-609bf504-1567-4970-9969-419f3606dfe8 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:29.579723 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-609bf504-1567-4970-9969-419f3606dfe8 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:29.580194 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-609bf504-1567-4970-9969-419f3606dfe8 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:29.580633 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-609bf504-1567-4970-9969-419f3606dfe8 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:29.721243 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-609bf504-1567-4970-9969-419f3606dfe8 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d6858e6c5941adbcebf5706357a272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ffd8787fc4fffbee4ac6d72d833ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:29.731947 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-609bf504-1567-4970-9969-419f3606dfe8 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] 10.222.0.33 "GET /compute/v2.1/servers/354c136d-e30f-4efd-9a8d-db7aed7b3b5e" status: 200 len: 1514 microversion: 2.1 time: 0.166612 Oct 04 21:32:29.732574 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3282/6529] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:32:29 2022] GET /compute/v2.1/servers/354c136d-e30f-4efd-9a8d-db7aed7b3b5e => generated 1514 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:32:30.756071 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ca2150d6-dcc7-4e1f-9341-12318ab14333 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:32:30.756677 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ca2150d6-dcc7-4e1f-9341-12318ab14333 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] [instance: 354c136d-e30f-4efd-9a8d-db7aed7b3b5e] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:32:30.764427 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ca2150d6-dcc7-4e1f-9341-12318ab14333 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:30.764908 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ca2150d6-dcc7-4e1f-9341-12318ab14333 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:30.765336 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ca2150d6-dcc7-4e1f-9341-12318ab14333 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:30.766033 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ca2150d6-dcc7-4e1f-9341-12318ab14333 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:30.766512 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ca2150d6-dcc7-4e1f-9341-12318ab14333 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:30.766931 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ca2150d6-dcc7-4e1f-9341-12318ab14333 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:30.901504 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-ca2150d6-dcc7-4e1f-9341-12318ab14333 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d6858e6c5941adbcebf5706357a272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ffd8787fc4fffbee4ac6d72d833ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:30.910221 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ca2150d6-dcc7-4e1f-9341-12318ab14333 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] 10.222.0.33 "GET /compute/v2.1/servers/354c136d-e30f-4efd-9a8d-db7aed7b3b5e" status: 200 len: 1519 microversion: 2.1 time: 0.157532 Oct 04 21:32:30.910845 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3248/6530] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:32:30 2022] GET /compute/v2.1/servers/354c136d-e30f-4efd-9a8d-db7aed7b3b5e => generated 1519 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:32:31.936865 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-3009f676-0fa9-4dd0-9933-efa739a9b407 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:32:31.937494 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-3009f676-0fa9-4dd0-9933-efa739a9b407 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] [instance: 354c136d-e30f-4efd-9a8d-db7aed7b3b5e] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:32:31.944854 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3009f676-0fa9-4dd0-9933-efa739a9b407 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:31.945351 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3009f676-0fa9-4dd0-9933-efa739a9b407 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:31.945825 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3009f676-0fa9-4dd0-9933-efa739a9b407 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:31.946559 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3009f676-0fa9-4dd0-9933-efa739a9b407 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:31.947025 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3009f676-0fa9-4dd0-9933-efa739a9b407 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:31.947466 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3009f676-0fa9-4dd0-9933-efa739a9b407 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:31.951762 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:32:32.086957 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-3009f676-0fa9-4dd0-9933-efa739a9b407 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d6858e6c5941adbcebf5706357a272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ffd8787fc4fffbee4ac6d72d833ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:32.099231 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-3009f676-0fa9-4dd0-9933-efa739a9b407 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] 10.222.0.33 "GET /compute/v2.1/servers/354c136d-e30f-4efd-9a8d-db7aed7b3b5e" status: 200 len: 1519 microversion: 2.1 time: 0.166254 Oct 04 21:32:32.099921 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3283/6531] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:32:31 2022] GET /compute/v2.1/servers/354c136d-e30f-4efd-9a8d-db7aed7b3b5e => generated 1519 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:32:33.123455 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-4a722c83-4d40-49ce-98a5-58bc7e658cac tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:32:33.123980 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-4a722c83-4d40-49ce-98a5-58bc7e658cac tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] [instance: 354c136d-e30f-4efd-9a8d-db7aed7b3b5e] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:32:33.132146 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4a722c83-4d40-49ce-98a5-58bc7e658cac tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:33.132635 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4a722c83-4d40-49ce-98a5-58bc7e658cac tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:33.133080 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4a722c83-4d40-49ce-98a5-58bc7e658cac tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:33.133787 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4a722c83-4d40-49ce-98a5-58bc7e658cac tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:33.134248 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4a722c83-4d40-49ce-98a5-58bc7e658cac tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:33.134706 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4a722c83-4d40-49ce-98a5-58bc7e658cac tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:33.274785 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-4a722c83-4d40-49ce-98a5-58bc7e658cac tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d6858e6c5941adbcebf5706357a272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ffd8787fc4fffbee4ac6d72d833ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:33.283246 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-4a722c83-4d40-49ce-98a5-58bc7e658cac tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] 10.222.0.33 "GET /compute/v2.1/servers/354c136d-e30f-4efd-9a8d-db7aed7b3b5e" status: 200 len: 1519 microversion: 2.1 time: 0.164419 Oct 04 21:32:33.283838 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3249/6532] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:32:33 2022] GET /compute/v2.1/servers/354c136d-e30f-4efd-9a8d-db7aed7b3b5e => generated 1519 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:32:34.307616 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-1e04a1b0-06b5-4e7e-aa9c-7cc5556e86a2 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:32:34.308268 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-1e04a1b0-06b5-4e7e-aa9c-7cc5556e86a2 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] [instance: 354c136d-e30f-4efd-9a8d-db7aed7b3b5e] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:32:34.315269 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1e04a1b0-06b5-4e7e-aa9c-7cc5556e86a2 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:34.316036 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1e04a1b0-06b5-4e7e-aa9c-7cc5556e86a2 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:34.316775 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1e04a1b0-06b5-4e7e-aa9c-7cc5556e86a2 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:34.317504 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1e04a1b0-06b5-4e7e-aa9c-7cc5556e86a2 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:34.317968 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1e04a1b0-06b5-4e7e-aa9c-7cc5556e86a2 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:34.318444 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1e04a1b0-06b5-4e7e-aa9c-7cc5556e86a2 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:34.458145 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-1e04a1b0-06b5-4e7e-aa9c-7cc5556e86a2 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d6858e6c5941adbcebf5706357a272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ffd8787fc4fffbee4ac6d72d833ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:34.466045 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-1e04a1b0-06b5-4e7e-aa9c-7cc5556e86a2 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] 10.222.0.33 "GET /compute/v2.1/servers/354c136d-e30f-4efd-9a8d-db7aed7b3b5e" status: 200 len: 1519 microversion: 2.1 time: 0.162551 Oct 04 21:32:34.466672 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3284/6533] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:32:34 2022] GET /compute/v2.1/servers/354c136d-e30f-4efd-9a8d-db7aed7b3b5e => generated 1519 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:32:35.490230 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d4db0ed5-40fc-4243-b552-e3bb92a94fd7 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:32:35.490903 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d4db0ed5-40fc-4243-b552-e3bb92a94fd7 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] [instance: 354c136d-e30f-4efd-9a8d-db7aed7b3b5e] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:32:35.498316 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d4db0ed5-40fc-4243-b552-e3bb92a94fd7 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:35.498832 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d4db0ed5-40fc-4243-b552-e3bb92a94fd7 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:35.499279 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d4db0ed5-40fc-4243-b552-e3bb92a94fd7 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:35.499984 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d4db0ed5-40fc-4243-b552-e3bb92a94fd7 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:35.500453 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d4db0ed5-40fc-4243-b552-e3bb92a94fd7 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:35.500889 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d4db0ed5-40fc-4243-b552-e3bb92a94fd7 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:35.640380 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d4db0ed5-40fc-4243-b552-e3bb92a94fd7 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d6858e6c5941adbcebf5706357a272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ffd8787fc4fffbee4ac6d72d833ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:35.648982 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d4db0ed5-40fc-4243-b552-e3bb92a94fd7 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] 10.222.0.33 "GET /compute/v2.1/servers/354c136d-e30f-4efd-9a8d-db7aed7b3b5e" status: 200 len: 1519 microversion: 2.1 time: 0.162721 Oct 04 21:32:35.657110 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3250/6534] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:32:35 2022] GET /compute/v2.1/servers/354c136d-e30f-4efd-9a8d-db7aed7b3b5e => generated 1519 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:32:36.673017 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-c856cbe4-be14-4b13-8bc6-40844bf7156c tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:32:36.673619 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-c856cbe4-be14-4b13-8bc6-40844bf7156c tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] [instance: 354c136d-e30f-4efd-9a8d-db7aed7b3b5e] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:32:36.680849 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c856cbe4-be14-4b13-8bc6-40844bf7156c tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:36.681338 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c856cbe4-be14-4b13-8bc6-40844bf7156c tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:36.681778 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c856cbe4-be14-4b13-8bc6-40844bf7156c tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:36.682517 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c856cbe4-be14-4b13-8bc6-40844bf7156c tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:36.682976 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c856cbe4-be14-4b13-8bc6-40844bf7156c tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:36.683406 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c856cbe4-be14-4b13-8bc6-40844bf7156c tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:36.815929 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-c856cbe4-be14-4b13-8bc6-40844bf7156c tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d6858e6c5941adbcebf5706357a272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ffd8787fc4fffbee4ac6d72d833ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:36.823881 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-c856cbe4-be14-4b13-8bc6-40844bf7156c tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] 10.222.0.33 "GET /compute/v2.1/servers/354c136d-e30f-4efd-9a8d-db7aed7b3b5e" status: 200 len: 1519 microversion: 2.1 time: 0.154763 Oct 04 21:32:36.824454 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3285/6535] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:32:36 2022] GET /compute/v2.1/servers/354c136d-e30f-4efd-9a8d-db7aed7b3b5e => generated 1519 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:32:37.848823 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-18d7120e-bbc0-4ba7-931d-bdd7c1104a76 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:32:37.849530 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-18d7120e-bbc0-4ba7-931d-bdd7c1104a76 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] [instance: 354c136d-e30f-4efd-9a8d-db7aed7b3b5e] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:32:37.856692 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-18d7120e-bbc0-4ba7-931d-bdd7c1104a76 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:37.857181 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-18d7120e-bbc0-4ba7-931d-bdd7c1104a76 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:37.857621 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-18d7120e-bbc0-4ba7-931d-bdd7c1104a76 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:37.858332 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-18d7120e-bbc0-4ba7-931d-bdd7c1104a76 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:37.858837 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-18d7120e-bbc0-4ba7-931d-bdd7c1104a76 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:37.859238 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-18d7120e-bbc0-4ba7-931d-bdd7c1104a76 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:38.002026 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-18d7120e-bbc0-4ba7-931d-bdd7c1104a76 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d6858e6c5941adbcebf5706357a272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ffd8787fc4fffbee4ac6d72d833ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:38.009946 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-18d7120e-bbc0-4ba7-931d-bdd7c1104a76 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] 10.222.0.33 "GET /compute/v2.1/servers/354c136d-e30f-4efd-9a8d-db7aed7b3b5e" status: 200 len: 1519 microversion: 2.1 time: 0.165823 Oct 04 21:32:38.010552 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3251/6536] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:32:37 2022] GET /compute/v2.1/servers/354c136d-e30f-4efd-9a8d-db7aed7b3b5e => generated 1519 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:32:39.033210 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-1a914df4-0016-4d71-b092-b52f7a3883f2 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:32:39.033832 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-1a914df4-0016-4d71-b092-b52f7a3883f2 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] [instance: 354c136d-e30f-4efd-9a8d-db7aed7b3b5e] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:32:39.038015 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:32:39.043677 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1a914df4-0016-4d71-b092-b52f7a3883f2 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:39.044172 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1a914df4-0016-4d71-b092-b52f7a3883f2 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:39.044618 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1a914df4-0016-4d71-b092-b52f7a3883f2 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:39.045337 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1a914df4-0016-4d71-b092-b52f7a3883f2 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:39.045799 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1a914df4-0016-4d71-b092-b52f7a3883f2 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:39.046233 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1a914df4-0016-4d71-b092-b52f7a3883f2 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:39.195872 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-1a914df4-0016-4d71-b092-b52f7a3883f2 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d6858e6c5941adbcebf5706357a272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ffd8787fc4fffbee4ac6d72d833ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:39.204092 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-1a914df4-0016-4d71-b092-b52f7a3883f2 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] 10.222.0.33 "GET /compute/v2.1/servers/354c136d-e30f-4efd-9a8d-db7aed7b3b5e" status: 200 len: 1519 microversion: 2.1 time: 0.174689 Oct 04 21:32:39.204675 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3286/6537] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:32:39 2022] GET /compute/v2.1/servers/354c136d-e30f-4efd-9a8d-db7aed7b3b5e => generated 1519 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:32:40.228556 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-bb626a82-56f5-4f06-9b31-e5b69e33582c tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:32:40.229174 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-bb626a82-56f5-4f06-9b31-e5b69e33582c tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] [instance: 354c136d-e30f-4efd-9a8d-db7aed7b3b5e] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:32:40.232671 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=4 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:32:40.239328 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bb626a82-56f5-4f06-9b31-e5b69e33582c tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:40.239848 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bb626a82-56f5-4f06-9b31-e5b69e33582c tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:40.240398 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bb626a82-56f5-4f06-9b31-e5b69e33582c tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:40.240999 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bb626a82-56f5-4f06-9b31-e5b69e33582c tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:40.241457 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bb626a82-56f5-4f06-9b31-e5b69e33582c tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:40.241881 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bb626a82-56f5-4f06-9b31-e5b69e33582c tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:40.395457 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-bb626a82-56f5-4f06-9b31-e5b69e33582c tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d6858e6c5941adbcebf5706357a272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ffd8787fc4fffbee4ac6d72d833ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:40.403711 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-bb626a82-56f5-4f06-9b31-e5b69e33582c tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] 10.222.0.33 "GET /compute/v2.1/servers/354c136d-e30f-4efd-9a8d-db7aed7b3b5e" status: 200 len: 1519 microversion: 2.1 time: 0.179078 Oct 04 21:32:40.404308 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3252/6538] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:32:40 2022] GET /compute/v2.1/servers/354c136d-e30f-4efd-9a8d-db7aed7b3b5e => generated 1519 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:32:41.428820 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-81db06f2-c9b6-476b-883e-832665cbc059 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:32:41.429713 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-81db06f2-c9b6-476b-883e-832665cbc059 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] [instance: 354c136d-e30f-4efd-9a8d-db7aed7b3b5e] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:32:41.437012 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-81db06f2-c9b6-476b-883e-832665cbc059 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:41.437628 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-81db06f2-c9b6-476b-883e-832665cbc059 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:41.438164 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-81db06f2-c9b6-476b-883e-832665cbc059 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:41.438998 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-81db06f2-c9b6-476b-883e-832665cbc059 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:41.439562 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-81db06f2-c9b6-476b-883e-832665cbc059 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:41.440092 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-81db06f2-c9b6-476b-883e-832665cbc059 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:41.619394 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-81db06f2-c9b6-476b-883e-832665cbc059 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d6858e6c5941adbcebf5706357a272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ffd8787fc4fffbee4ac6d72d833ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:41.629015 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-81db06f2-c9b6-476b-883e-832665cbc059 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] 10.222.0.33 "GET /compute/v2.1/servers/354c136d-e30f-4efd-9a8d-db7aed7b3b5e" status: 200 len: 1519 microversion: 2.1 time: 0.204503 Oct 04 21:32:41.629736 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3287/6539] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:32:41 2022] GET /compute/v2.1/servers/354c136d-e30f-4efd-9a8d-db7aed7b3b5e => generated 1519 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:32:42.653622 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d758e40b-4056-4e25-a979-da29a69401b3 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:32:42.654219 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d758e40b-4056-4e25-a979-da29a69401b3 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] [instance: 354c136d-e30f-4efd-9a8d-db7aed7b3b5e] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:32:42.661637 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d758e40b-4056-4e25-a979-da29a69401b3 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:42.662130 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d758e40b-4056-4e25-a979-da29a69401b3 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:42.662594 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d758e40b-4056-4e25-a979-da29a69401b3 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:42.663309 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d758e40b-4056-4e25-a979-da29a69401b3 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:42.663764 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d758e40b-4056-4e25-a979-da29a69401b3 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:42.664185 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d758e40b-4056-4e25-a979-da29a69401b3 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:42.811437 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d758e40b-4056-4e25-a979-da29a69401b3 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d6858e6c5941adbcebf5706357a272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ffd8787fc4fffbee4ac6d72d833ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:42.821782 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d758e40b-4056-4e25-a979-da29a69401b3 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] 10.222.0.33 "GET /compute/v2.1/servers/354c136d-e30f-4efd-9a8d-db7aed7b3b5e" status: 200 len: 1519 microversion: 2.1 time: 0.171755 Oct 04 21:32:42.822868 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3253/6540] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:32:42 2022] GET /compute/v2.1/servers/354c136d-e30f-4efd-9a8d-db7aed7b3b5e => generated 1519 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:32:43.852765 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-9b2b267e-e513-46fb-b812-75bdfc37b6b5 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:32:43.853419 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-9b2b267e-e513-46fb-b812-75bdfc37b6b5 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] [instance: 354c136d-e30f-4efd-9a8d-db7aed7b3b5e] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:32:43.863091 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9b2b267e-e513-46fb-b812-75bdfc37b6b5 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:43.863944 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9b2b267e-e513-46fb-b812-75bdfc37b6b5 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:43.865209 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9b2b267e-e513-46fb-b812-75bdfc37b6b5 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:43.866512 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9b2b267e-e513-46fb-b812-75bdfc37b6b5 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:43.867389 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9b2b267e-e513-46fb-b812-75bdfc37b6b5 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:43.868205 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9b2b267e-e513-46fb-b812-75bdfc37b6b5 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:44.032897 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-9b2b267e-e513-46fb-b812-75bdfc37b6b5 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d6858e6c5941adbcebf5706357a272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ffd8787fc4fffbee4ac6d72d833ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:44.042026 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-9b2b267e-e513-46fb-b812-75bdfc37b6b5 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] 10.222.0.33 "GET /compute/v2.1/servers/354c136d-e30f-4efd-9a8d-db7aed7b3b5e" status: 200 len: 1519 microversion: 2.1 time: 0.194139 Oct 04 21:32:44.042762 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3288/6541] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:32:43 2022] GET /compute/v2.1/servers/354c136d-e30f-4efd-9a8d-db7aed7b3b5e => generated 1519 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:32:45.068923 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1f06cda7-75e8-4d8b-8fe8-3fd19e9b468f tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:32:45.069824 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-1f06cda7-75e8-4d8b-8fe8-3fd19e9b468f tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] [instance: 354c136d-e30f-4efd-9a8d-db7aed7b3b5e] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:32:45.079970 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1f06cda7-75e8-4d8b-8fe8-3fd19e9b468f tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:45.080851 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1f06cda7-75e8-4d8b-8fe8-3fd19e9b468f tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:45.081749 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1f06cda7-75e8-4d8b-8fe8-3fd19e9b468f tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:45.082881 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1f06cda7-75e8-4d8b-8fe8-3fd19e9b468f tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:45.083695 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1f06cda7-75e8-4d8b-8fe8-3fd19e9b468f tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:45.084459 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1f06cda7-75e8-4d8b-8fe8-3fd19e9b468f tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:45.266205 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-1f06cda7-75e8-4d8b-8fe8-3fd19e9b468f tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d6858e6c5941adbcebf5706357a272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ffd8787fc4fffbee4ac6d72d833ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:45.275624 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-1f06cda7-75e8-4d8b-8fe8-3fd19e9b468f tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] 10.222.0.33 "GET /compute/v2.1/servers/354c136d-e30f-4efd-9a8d-db7aed7b3b5e" status: 200 len: 1519 microversion: 2.1 time: 0.212224 Oct 04 21:32:45.276341 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3254/6542] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:32:45 2022] GET /compute/v2.1/servers/354c136d-e30f-4efd-9a8d-db7aed7b3b5e => generated 1519 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:32:46.300346 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-828e37ae-109d-4d04-9eaf-598c6e205bc5 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:32:46.301518 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-828e37ae-109d-4d04-9eaf-598c6e205bc5 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] [instance: 354c136d-e30f-4efd-9a8d-db7aed7b3b5e] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:32:46.309592 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-828e37ae-109d-4d04-9eaf-598c6e205bc5 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:46.310099 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-828e37ae-109d-4d04-9eaf-598c6e205bc5 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:46.310581 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-828e37ae-109d-4d04-9eaf-598c6e205bc5 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:46.311312 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-828e37ae-109d-4d04-9eaf-598c6e205bc5 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:46.311773 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-828e37ae-109d-4d04-9eaf-598c6e205bc5 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:46.312210 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-828e37ae-109d-4d04-9eaf-598c6e205bc5 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:46.473299 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-828e37ae-109d-4d04-9eaf-598c6e205bc5 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d6858e6c5941adbcebf5706357a272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ffd8787fc4fffbee4ac6d72d833ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:46.481673 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-828e37ae-109d-4d04-9eaf-598c6e205bc5 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] 10.222.0.33 "GET /compute/v2.1/servers/354c136d-e30f-4efd-9a8d-db7aed7b3b5e" status: 200 len: 1519 microversion: 2.1 time: 0.185299 Oct 04 21:32:46.482268 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3289/6543] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:32:46 2022] GET /compute/v2.1/servers/354c136d-e30f-4efd-9a8d-db7aed7b3b5e => generated 1519 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:32:47.517699 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5c65055c-493c-4715-9b20-be6a598d162c tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:32:47.518522 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-5c65055c-493c-4715-9b20-be6a598d162c tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] [instance: 354c136d-e30f-4efd-9a8d-db7aed7b3b5e] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:32:47.525613 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5c65055c-493c-4715-9b20-be6a598d162c tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:47.526155 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5c65055c-493c-4715-9b20-be6a598d162c tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:47.526678 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5c65055c-493c-4715-9b20-be6a598d162c tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:47.527518 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5c65055c-493c-4715-9b20-be6a598d162c tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:47.528023 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5c65055c-493c-4715-9b20-be6a598d162c tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:47.528491 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5c65055c-493c-4715-9b20-be6a598d162c tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:47.694336 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-5c65055c-493c-4715-9b20-be6a598d162c tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d6858e6c5941adbcebf5706357a272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ffd8787fc4fffbee4ac6d72d833ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:47.708967 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5c65055c-493c-4715-9b20-be6a598d162c tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] 10.222.0.33 "GET /compute/v2.1/servers/354c136d-e30f-4efd-9a8d-db7aed7b3b5e" status: 200 len: 1519 microversion: 2.1 time: 0.194818 Oct 04 21:32:47.710051 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3255/6544] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:32:47 2022] GET /compute/v2.1/servers/354c136d-e30f-4efd-9a8d-db7aed7b3b5e => generated 1519 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:32:48.733609 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-9d47d5d0-a4a6-49a7-acad-ee07f91a6a81 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:32:48.734262 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-9d47d5d0-a4a6-49a7-acad-ee07f91a6a81 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] [instance: 354c136d-e30f-4efd-9a8d-db7aed7b3b5e] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:32:48.744635 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9d47d5d0-a4a6-49a7-acad-ee07f91a6a81 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:48.745191 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9d47d5d0-a4a6-49a7-acad-ee07f91a6a81 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:48.745751 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9d47d5d0-a4a6-49a7-acad-ee07f91a6a81 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:48.746680 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9d47d5d0-a4a6-49a7-acad-ee07f91a6a81 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:48.747247 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9d47d5d0-a4a6-49a7-acad-ee07f91a6a81 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:48.747778 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9d47d5d0-a4a6-49a7-acad-ee07f91a6a81 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:48.907053 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-9d47d5d0-a4a6-49a7-acad-ee07f91a6a81 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d6858e6c5941adbcebf5706357a272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ffd8787fc4fffbee4ac6d72d833ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:48.917359 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-9d47d5d0-a4a6-49a7-acad-ee07f91a6a81 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] 10.222.0.33 "GET /compute/v2.1/servers/354c136d-e30f-4efd-9a8d-db7aed7b3b5e" status: 200 len: 1519 microversion: 2.1 time: 0.187723 Oct 04 21:32:48.918005 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3290/6545] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:32:48 2022] GET /compute/v2.1/servers/354c136d-e30f-4efd-9a8d-db7aed7b3b5e => generated 1519 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:32:49.942867 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-94b0f406-2e2f-4408-8096-88eadcb76852 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:32:49.943495 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-94b0f406-2e2f-4408-8096-88eadcb76852 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] [instance: 354c136d-e30f-4efd-9a8d-db7aed7b3b5e] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:32:49.951068 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-94b0f406-2e2f-4408-8096-88eadcb76852 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:49.951576 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-94b0f406-2e2f-4408-8096-88eadcb76852 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:49.952024 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-94b0f406-2e2f-4408-8096-88eadcb76852 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:49.955405 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-94b0f406-2e2f-4408-8096-88eadcb76852 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:49.955405 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-94b0f406-2e2f-4408-8096-88eadcb76852 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:49.955405 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-94b0f406-2e2f-4408-8096-88eadcb76852 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:50.103373 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-94b0f406-2e2f-4408-8096-88eadcb76852 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d6858e6c5941adbcebf5706357a272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ffd8787fc4fffbee4ac6d72d833ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:50.112587 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-94b0f406-2e2f-4408-8096-88eadcb76852 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] 10.222.0.33 "GET /compute/v2.1/servers/354c136d-e30f-4efd-9a8d-db7aed7b3b5e" status: 200 len: 1519 microversion: 2.1 time: 0.173316 Oct 04 21:32:50.113242 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3256/6546] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:32:49 2022] GET /compute/v2.1/servers/354c136d-e30f-4efd-9a8d-db7aed7b3b5e => generated 1519 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:32:51.135531 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-cce1e753-c9f6-402a-8435-5bbe9bc44782 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:32:51.136156 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-cce1e753-c9f6-402a-8435-5bbe9bc44782 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] [instance: 354c136d-e30f-4efd-9a8d-db7aed7b3b5e] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:32:51.144302 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cce1e753-c9f6-402a-8435-5bbe9bc44782 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:51.144808 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cce1e753-c9f6-402a-8435-5bbe9bc44782 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:51.145346 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cce1e753-c9f6-402a-8435-5bbe9bc44782 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:51.146113 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cce1e753-c9f6-402a-8435-5bbe9bc44782 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:51.146668 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cce1e753-c9f6-402a-8435-5bbe9bc44782 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:51.147111 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cce1e753-c9f6-402a-8435-5bbe9bc44782 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:51.289786 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-cce1e753-c9f6-402a-8435-5bbe9bc44782 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d6858e6c5941adbcebf5706357a272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ffd8787fc4fffbee4ac6d72d833ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:51.298012 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-cce1e753-c9f6-402a-8435-5bbe9bc44782 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] 10.222.0.33 "GET /compute/v2.1/servers/354c136d-e30f-4efd-9a8d-db7aed7b3b5e" status: 200 len: 1519 microversion: 2.1 time: 0.166306 Oct 04 21:32:51.298640 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3291/6547] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:32:51 2022] GET /compute/v2.1/servers/354c136d-e30f-4efd-9a8d-db7aed7b3b5e => generated 1519 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:32:52.322111 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b4c44b32-e518-4e3b-8df5-56d00acbee6c tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:32:52.322704 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b4c44b32-e518-4e3b-8df5-56d00acbee6c tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] [instance: 354c136d-e30f-4efd-9a8d-db7aed7b3b5e] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:32:52.332585 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b4c44b32-e518-4e3b-8df5-56d00acbee6c tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:52.333080 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b4c44b32-e518-4e3b-8df5-56d00acbee6c tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:52.333524 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b4c44b32-e518-4e3b-8df5-56d00acbee6c tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:52.334241 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b4c44b32-e518-4e3b-8df5-56d00acbee6c tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:52.334774 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b4c44b32-e518-4e3b-8df5-56d00acbee6c tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:52.335200 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b4c44b32-e518-4e3b-8df5-56d00acbee6c tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:52.476925 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-b4c44b32-e518-4e3b-8df5-56d00acbee6c tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d6858e6c5941adbcebf5706357a272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ffd8787fc4fffbee4ac6d72d833ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:52.484285 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b4c44b32-e518-4e3b-8df5-56d00acbee6c tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] 10.222.0.33 "GET /compute/v2.1/servers/354c136d-e30f-4efd-9a8d-db7aed7b3b5e" status: 200 len: 1519 microversion: 2.1 time: 0.166137 Oct 04 21:32:52.484908 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3257/6548] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:32:52 2022] GET /compute/v2.1/servers/354c136d-e30f-4efd-9a8d-db7aed7b3b5e => generated 1519 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:32:53.508622 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-6fdecf92-eff1-44c4-be0b-902943144906 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:32:53.509302 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-6fdecf92-eff1-44c4-be0b-902943144906 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] [instance: 354c136d-e30f-4efd-9a8d-db7aed7b3b5e] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:32:53.516622 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6fdecf92-eff1-44c4-be0b-902943144906 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:53.517060 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6fdecf92-eff1-44c4-be0b-902943144906 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:53.517507 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6fdecf92-eff1-44c4-be0b-902943144906 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:53.518265 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6fdecf92-eff1-44c4-be0b-902943144906 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:53.518852 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6fdecf92-eff1-44c4-be0b-902943144906 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:53.519353 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6fdecf92-eff1-44c4-be0b-902943144906 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:53.659508 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-6fdecf92-eff1-44c4-be0b-902943144906 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d6858e6c5941adbcebf5706357a272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ffd8787fc4fffbee4ac6d72d833ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:53.667808 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-6fdecf92-eff1-44c4-be0b-902943144906 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] 10.222.0.33 "GET /compute/v2.1/servers/354c136d-e30f-4efd-9a8d-db7aed7b3b5e" status: 200 len: 1519 microversion: 2.1 time: 0.163219 Oct 04 21:32:53.668393 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3292/6549] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:32:53 2022] GET /compute/v2.1/servers/354c136d-e30f-4efd-9a8d-db7aed7b3b5e => generated 1519 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:32:54.693579 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-774fa8b2-0790-431d-8a6c-cdf62f766d0a tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:32:54.693960 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-774fa8b2-0790-431d-8a6c-cdf62f766d0a tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] [instance: 354c136d-e30f-4efd-9a8d-db7aed7b3b5e] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:32:54.701061 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-774fa8b2-0790-431d-8a6c-cdf62f766d0a tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:54.701552 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-774fa8b2-0790-431d-8a6c-cdf62f766d0a tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:54.702003 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-774fa8b2-0790-431d-8a6c-cdf62f766d0a tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:54.703064 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-774fa8b2-0790-431d-8a6c-cdf62f766d0a tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:54.703526 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-774fa8b2-0790-431d-8a6c-cdf62f766d0a tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:54.703951 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-774fa8b2-0790-431d-8a6c-cdf62f766d0a tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:54.869020 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-774fa8b2-0790-431d-8a6c-cdf62f766d0a tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d6858e6c5941adbcebf5706357a272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ffd8787fc4fffbee4ac6d72d833ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:54.879477 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-774fa8b2-0790-431d-8a6c-cdf62f766d0a tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] 10.222.0.33 "GET /compute/v2.1/servers/354c136d-e30f-4efd-9a8d-db7aed7b3b5e" status: 200 len: 1519 microversion: 2.1 time: 0.191213 Oct 04 21:32:54.880069 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3258/6550] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:32:54 2022] GET /compute/v2.1/servers/354c136d-e30f-4efd-9a8d-db7aed7b3b5e => generated 1519 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:32:55.903418 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-74785fb4-f5f4-4516-be36-f11b031e7ff7 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:32:55.903985 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-74785fb4-f5f4-4516-be36-f11b031e7ff7 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] [instance: 354c136d-e30f-4efd-9a8d-db7aed7b3b5e] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:32:55.911609 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-74785fb4-f5f4-4516-be36-f11b031e7ff7 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:55.912100 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-74785fb4-f5f4-4516-be36-f11b031e7ff7 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:55.912546 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-74785fb4-f5f4-4516-be36-f11b031e7ff7 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:55.913249 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-74785fb4-f5f4-4516-be36-f11b031e7ff7 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:55.913708 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-74785fb4-f5f4-4516-be36-f11b031e7ff7 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:55.914169 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-74785fb4-f5f4-4516-be36-f11b031e7ff7 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:56.048327 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-74785fb4-f5f4-4516-be36-f11b031e7ff7 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d6858e6c5941adbcebf5706357a272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ffd8787fc4fffbee4ac6d72d833ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:56.057771 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-74785fb4-f5f4-4516-be36-f11b031e7ff7 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] 10.222.0.33 "GET /compute/v2.1/servers/354c136d-e30f-4efd-9a8d-db7aed7b3b5e" status: 200 len: 1519 microversion: 2.1 time: 0.158288 Oct 04 21:32:56.058362 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3293/6551] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:32:55 2022] GET /compute/v2.1/servers/354c136d-e30f-4efd-9a8d-db7aed7b3b5e => generated 1519 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:32:57.081316 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c634aea9-7689-4319-b9ad-4da1ad92df82 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:32:57.081943 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c634aea9-7689-4319-b9ad-4da1ad92df82 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] [instance: 354c136d-e30f-4efd-9a8d-db7aed7b3b5e] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:32:57.088872 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c634aea9-7689-4319-b9ad-4da1ad92df82 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:57.089362 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c634aea9-7689-4319-b9ad-4da1ad92df82 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:57.089801 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c634aea9-7689-4319-b9ad-4da1ad92df82 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:57.090531 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c634aea9-7689-4319-b9ad-4da1ad92df82 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:57.090990 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c634aea9-7689-4319-b9ad-4da1ad92df82 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:57.091415 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c634aea9-7689-4319-b9ad-4da1ad92df82 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:57.226247 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c634aea9-7689-4319-b9ad-4da1ad92df82 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d6858e6c5941adbcebf5706357a272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ffd8787fc4fffbee4ac6d72d833ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:57.234037 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c634aea9-7689-4319-b9ad-4da1ad92df82 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] 10.222.0.33 "GET /compute/v2.1/servers/354c136d-e30f-4efd-9a8d-db7aed7b3b5e" status: 200 len: 1519 microversion: 2.1 time: 0.156888 Oct 04 21:32:57.234651 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3259/6552] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:32:57 2022] GET /compute/v2.1/servers/354c136d-e30f-4efd-9a8d-db7aed7b3b5e => generated 1519 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:32:57.900232 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-90de3317-8f4a-400f-9b68-d467e37ace02 req-14f80874-17d8-450f-8fbd-0af3f5f4c3f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "354c136d-e30f-4efd-9a8d-db7aed7b3b5e", "name": "network-vif-unplugged", "status": "completed", "tag": "8191150b-e501-42d5-94b9-1ed623f6a0fc"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:32:57.911013 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-90de3317-8f4a-400f-9b68-d467e37ace02 req-14f80874-17d8-450f-8fbd-0af3f5f4c3f5 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:57.911514 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-90de3317-8f4a-400f-9b68-d467e37ace02 req-14f80874-17d8-450f-8fbd-0af3f5f4c3f5 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:57.911958 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-90de3317-8f4a-400f-9b68-d467e37ace02 req-14f80874-17d8-450f-8fbd-0af3f5f4c3f5 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:57.925622 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-90de3317-8f4a-400f-9b68-d467e37ace02 req-14f80874-17d8-450f-8fbd-0af3f5f4c3f5 service nova] Creating event network-vif-unplugged:8191150b-e501-42d5-94b9-1ed623f6a0fc for instance 354c136d-e30f-4efd-9a8d-db7aed7b3b5e on n-h1-854823-8 Oct 04 21:32:57.931700 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [req-90de3317-8f4a-400f-9b68-d467e37ace02 req-14f80874-17d8-450f-8fbd-0af3f5f4c3f5 service nova] Instance 354c136d-e30f-4efd-9a8d-db7aed7b3b5e is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854823-8', 'n-h2-854823-8'} {{(pid=128802) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 21:32:57.942929 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-90de3317-8f4a-400f-9b68-d467e37ace02 req-14f80874-17d8-450f-8fbd-0af3f5f4c3f5 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046329 Oct 04 21:32:57.943564 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3294/6553] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:32:57 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:32:58.257352 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-972f6e21-8f65-49e5-aeac-c7bd4dd29881 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:32:58.258192 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-972f6e21-8f65-49e5-aeac-c7bd4dd29881 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] [instance: 354c136d-e30f-4efd-9a8d-db7aed7b3b5e] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:32:58.265709 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-972f6e21-8f65-49e5-aeac-c7bd4dd29881 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:58.266107 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-972f6e21-8f65-49e5-aeac-c7bd4dd29881 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:58.266676 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-972f6e21-8f65-49e5-aeac-c7bd4dd29881 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:58.267444 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-972f6e21-8f65-49e5-aeac-c7bd4dd29881 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:58.267920 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-972f6e21-8f65-49e5-aeac-c7bd4dd29881 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:58.268371 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-972f6e21-8f65-49e5-aeac-c7bd4dd29881 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:58.272672 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=85 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:32:58.419207 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-972f6e21-8f65-49e5-aeac-c7bd4dd29881 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d6858e6c5941adbcebf5706357a272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ffd8787fc4fffbee4ac6d72d833ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:58.433380 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-972f6e21-8f65-49e5-aeac-c7bd4dd29881 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] 10.222.0.33 "GET /compute/v2.1/servers/354c136d-e30f-4efd-9a8d-db7aed7b3b5e" status: 200 len: 1518 microversion: 2.1 time: 0.179529 Oct 04 21:32:58.434459 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3260/6554] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:32:58 2022] GET /compute/v2.1/servers/354c136d-e30f-4efd-9a8d-db7aed7b3b5e => generated 1518 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:32:59.475331 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-5377de9d-13aa-4b66-9aaf-50031fa8b67e tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:32:59.476051 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-5377de9d-13aa-4b66-9aaf-50031fa8b67e tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] [instance: 354c136d-e30f-4efd-9a8d-db7aed7b3b5e] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:32:59.482527 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5377de9d-13aa-4b66-9aaf-50031fa8b67e tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:59.483028 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5377de9d-13aa-4b66-9aaf-50031fa8b67e tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:59.483479 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5377de9d-13aa-4b66-9aaf-50031fa8b67e tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:59.484189 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5377de9d-13aa-4b66-9aaf-50031fa8b67e tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:59.484657 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5377de9d-13aa-4b66-9aaf-50031fa8b67e tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:59.485093 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5377de9d-13aa-4b66-9aaf-50031fa8b67e tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:59.624114 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-5377de9d-13aa-4b66-9aaf-50031fa8b67e tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d6858e6c5941adbcebf5706357a272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ffd8787fc4fffbee4ac6d72d833ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:32:59.633683 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-5377de9d-13aa-4b66-9aaf-50031fa8b67e tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] 10.222.0.33 "GET /compute/v2.1/servers/354c136d-e30f-4efd-9a8d-db7aed7b3b5e" status: 200 len: 1516 microversion: 2.1 time: 0.164169 Oct 04 21:32:59.634304 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3295/6555] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:32:59 2022] GET /compute/v2.1/servers/354c136d-e30f-4efd-9a8d-db7aed7b3b5e => generated 1516 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:32:59.959248 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-4567887f-647f-43c8-8af9-7918feb6270b req-0bd09aa5-d009-43d3-b235-7a8b6a211935 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "354c136d-e30f-4efd-9a8d-db7aed7b3b5e", "tag": "8191150b-e501-42d5-94b9-1ed623f6a0fc"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:32:59.970184 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-4567887f-647f-43c8-8af9-7918feb6270b req-0bd09aa5-d009-43d3-b235-7a8b6a211935 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:32:59.970707 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-4567887f-647f-43c8-8af9-7918feb6270b req-0bd09aa5-d009-43d3-b235-7a8b6a211935 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:32:59.971292 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-4567887f-647f-43c8-8af9-7918feb6270b req-0bd09aa5-d009-43d3-b235-7a8b6a211935 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:32:59.984527 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-4567887f-647f-43c8-8af9-7918feb6270b req-0bd09aa5-d009-43d3-b235-7a8b6a211935 service nova] Creating event network-changed:8191150b-e501-42d5-94b9-1ed623f6a0fc for instance 354c136d-e30f-4efd-9a8d-db7aed7b3b5e on n-h1-854823-8 Oct 04 21:32:59.990744 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [req-4567887f-647f-43c8-8af9-7918feb6270b req-0bd09aa5-d009-43d3-b235-7a8b6a211935 service nova] Instance 354c136d-e30f-4efd-9a8d-db7aed7b3b5e is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854823-8', 'n-h2-854823-8'} {{(pid=128801) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 21:33:00.002858 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-4567887f-647f-43c8-8af9-7918feb6270b req-0bd09aa5-d009-43d3-b235-7a8b6a211935 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048171 Oct 04 21:33:00.003485 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3261/6556] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:32:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:33:00.663160 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-97bd0bea-d4c4-4261-8610-af136d76776e tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:33:00.664337 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-97bd0bea-d4c4-4261-8610-af136d76776e tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] [instance: 354c136d-e30f-4efd-9a8d-db7aed7b3b5e] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:33:00.677594 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-97bd0bea-d4c4-4261-8610-af136d76776e tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:00.678553 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-97bd0bea-d4c4-4261-8610-af136d76776e tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:00.679608 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-97bd0bea-d4c4-4261-8610-af136d76776e tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:00.680880 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-97bd0bea-d4c4-4261-8610-af136d76776e tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:00.681716 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-97bd0bea-d4c4-4261-8610-af136d76776e tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:00.682552 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-97bd0bea-d4c4-4261-8610-af136d76776e tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:00.830617 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-97bd0bea-d4c4-4261-8610-af136d76776e tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d6858e6c5941adbcebf5706357a272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ffd8787fc4fffbee4ac6d72d833ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:00.839837 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-97bd0bea-d4c4-4261-8610-af136d76776e tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] 10.222.0.33 "GET /compute/v2.1/servers/354c136d-e30f-4efd-9a8d-db7aed7b3b5e" status: 200 len: 1513 microversion: 2.1 time: 0.185451 Oct 04 21:33:00.840438 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3296/6557] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:33:00 2022] GET /compute/v2.1/servers/354c136d-e30f-4efd-9a8d-db7aed7b3b5e => generated 1513 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:33:00.864441 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-11556e35-99ea-4b05-af5b-efd8b8f44fcd tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:33:00.865066 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-11556e35-99ea-4b05-af5b-efd8b8f44fcd tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] [instance: 354c136d-e30f-4efd-9a8d-db7aed7b3b5e] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:33:00.871461 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-11556e35-99ea-4b05-af5b-efd8b8f44fcd tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:00.871958 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-11556e35-99ea-4b05-af5b-efd8b8f44fcd tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:00.872403 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-11556e35-99ea-4b05-af5b-efd8b8f44fcd tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:00.873112 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-11556e35-99ea-4b05-af5b-efd8b8f44fcd tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:00.873573 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-11556e35-99ea-4b05-af5b-efd8b8f44fcd tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:00.874005 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-11556e35-99ea-4b05-af5b-efd8b8f44fcd tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:00.936616 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-11556e35-99ea-4b05-af5b-efd8b8f44fcd tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] 10.222.0.33 "POST /compute/v2.1/servers/354c136d-e30f-4efd-9a8d-db7aed7b3b5e/action" status: 204 len: 0 microversion: 2.1 time: 0.076828 Oct 04 21:33:00.937268 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3262/6558] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 21:33:00 2022] POST /compute/v2.1/servers/354c136d-e30f-4efd-9a8d-db7aed7b3b5e/action => generated 0 bytes in 79 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:33:00.946769 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-767f0545-3ab3-430a-95c5-3a6355d1acf1 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:33:00.947747 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-767f0545-3ab3-430a-95c5-3a6355d1acf1 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] [instance: 354c136d-e30f-4efd-9a8d-db7aed7b3b5e] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:33:00.953998 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-767f0545-3ab3-430a-95c5-3a6355d1acf1 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:00.957263 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-767f0545-3ab3-430a-95c5-3a6355d1acf1 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:00.957739 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-767f0545-3ab3-430a-95c5-3a6355d1acf1 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:00.958570 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-767f0545-3ab3-430a-95c5-3a6355d1acf1 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:00.959064 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-767f0545-3ab3-430a-95c5-3a6355d1acf1 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:00.959504 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-767f0545-3ab3-430a-95c5-3a6355d1acf1 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:01.223894 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-767f0545-3ab3-430a-95c5-3a6355d1acf1 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d6858e6c5941adbcebf5706357a272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ffd8787fc4fffbee4ac6d72d833ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:01.232018 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-767f0545-3ab3-430a-95c5-3a6355d1acf1 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] 10.222.0.33 "GET /compute/v2.1/servers/354c136d-e30f-4efd-9a8d-db7aed7b3b5e" status: 200 len: 1513 microversion: 2.1 time: 0.289460 Oct 04 21:33:01.232622 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3297/6559] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:33:00 2022] GET /compute/v2.1/servers/354c136d-e30f-4efd-9a8d-db7aed7b3b5e => generated 1513 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:33:02.259678 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9759956c-95a5-4a9c-ae66-91f5a5e573e2 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:33:02.260349 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-9759956c-95a5-4a9c-ae66-91f5a5e573e2 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] [instance: 354c136d-e30f-4efd-9a8d-db7aed7b3b5e] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:33:02.267133 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9759956c-95a5-4a9c-ae66-91f5a5e573e2 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:02.267663 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9759956c-95a5-4a9c-ae66-91f5a5e573e2 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:02.268137 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9759956c-95a5-4a9c-ae66-91f5a5e573e2 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:02.268867 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9759956c-95a5-4a9c-ae66-91f5a5e573e2 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:02.269329 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9759956c-95a5-4a9c-ae66-91f5a5e573e2 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:02.269948 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9759956c-95a5-4a9c-ae66-91f5a5e573e2 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:02.431145 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-9759956c-95a5-4a9c-ae66-91f5a5e573e2 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d6858e6c5941adbcebf5706357a272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ffd8787fc4fffbee4ac6d72d833ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:02.440253 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-9759956c-95a5-4a9c-ae66-91f5a5e573e2 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] 10.222.0.33 "GET /compute/v2.1/servers/354c136d-e30f-4efd-9a8d-db7aed7b3b5e" status: 200 len: 1513 microversion: 2.1 time: 0.187551 Oct 04 21:33:02.440874 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3263/6560] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:33:02 2022] GET /compute/v2.1/servers/354c136d-e30f-4efd-9a8d-db7aed7b3b5e => generated 1513 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:33:03.136993 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-8f0ce630-dbe9-48de-b029-ea5fbcc845e6 req-6ca904c6-c6f5-4d92-beb1-abb08b2c7084 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "354c136d-e30f-4efd-9a8d-db7aed7b3b5e", "name": "network-vif-plugged", "status": "completed", "tag": "8191150b-e501-42d5-94b9-1ed623f6a0fc"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:33:03.153279 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-8f0ce630-dbe9-48de-b029-ea5fbcc845e6 req-6ca904c6-c6f5-4d92-beb1-abb08b2c7084 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:03.154371 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-8f0ce630-dbe9-48de-b029-ea5fbcc845e6 req-6ca904c6-c6f5-4d92-beb1-abb08b2c7084 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:03.154847 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-8f0ce630-dbe9-48de-b029-ea5fbcc845e6 req-6ca904c6-c6f5-4d92-beb1-abb08b2c7084 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:03.163107 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=87 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:33:03.180849 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-8f0ce630-dbe9-48de-b029-ea5fbcc845e6 req-6ca904c6-c6f5-4d92-beb1-abb08b2c7084 service nova] Creating event network-vif-plugged:8191150b-e501-42d5-94b9-1ed623f6a0fc for instance 354c136d-e30f-4efd-9a8d-db7aed7b3b5e on n-h1-854823-8 Oct 04 21:33:03.190358 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-8f0ce630-dbe9-48de-b029-ea5fbcc845e6 req-6ca904c6-c6f5-4d92-beb1-abb08b2c7084 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056646 Oct 04 21:33:03.191476 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3298/6561] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:33:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:33:03.464510 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b49a842e-8536-4b84-b2d1-aa2afc8c3e4c tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:33:03.465126 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b49a842e-8536-4b84-b2d1-aa2afc8c3e4c tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] [instance: 354c136d-e30f-4efd-9a8d-db7aed7b3b5e] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:33:03.472188 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b49a842e-8536-4b84-b2d1-aa2afc8c3e4c tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:03.472609 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b49a842e-8536-4b84-b2d1-aa2afc8c3e4c tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:03.473054 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b49a842e-8536-4b84-b2d1-aa2afc8c3e4c tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:03.473754 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b49a842e-8536-4b84-b2d1-aa2afc8c3e4c tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:03.474207 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b49a842e-8536-4b84-b2d1-aa2afc8c3e4c tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:03.474665 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b49a842e-8536-4b84-b2d1-aa2afc8c3e4c tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:03.611979 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-b49a842e-8536-4b84-b2d1-aa2afc8c3e4c tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d6858e6c5941adbcebf5706357a272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ffd8787fc4fffbee4ac6d72d833ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:03.620081 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b49a842e-8536-4b84-b2d1-aa2afc8c3e4c tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] 10.222.0.33 "GET /compute/v2.1/servers/354c136d-e30f-4efd-9a8d-db7aed7b3b5e" status: 200 len: 1505 microversion: 2.1 time: 0.159600 Oct 04 21:33:03.620669 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3264/6562] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:33:03 2022] GET /compute/v2.1/servers/354c136d-e30f-4efd-9a8d-db7aed7b3b5e => generated 1505 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:33:03.644796 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-3fabf018-8078-40f6-a2da-3d528054ebe0 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:33:03.645509 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-3fabf018-8078-40f6-a2da-3d528054ebe0 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] [instance: 354c136d-e30f-4efd-9a8d-db7aed7b3b5e] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:33:03.651873 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3fabf018-8078-40f6-a2da-3d528054ebe0 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:03.652365 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3fabf018-8078-40f6-a2da-3d528054ebe0 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:03.652813 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3fabf018-8078-40f6-a2da-3d528054ebe0 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:03.653520 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3fabf018-8078-40f6-a2da-3d528054ebe0 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:03.653995 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3fabf018-8078-40f6-a2da-3d528054ebe0 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:03.654447 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3fabf018-8078-40f6-a2da-3d528054ebe0 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:03.797019 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-3fabf018-8078-40f6-a2da-3d528054ebe0 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d6858e6c5941adbcebf5706357a272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ffd8787fc4fffbee4ac6d72d833ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:03.806143 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-3fabf018-8078-40f6-a2da-3d528054ebe0 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] 10.222.0.33 "GET /compute/v2.1/servers/354c136d-e30f-4efd-9a8d-db7aed7b3b5e" status: 200 len: 1505 microversion: 2.1 time: 0.166502 Oct 04 21:33:03.806766 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3299/6563] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:33:03 2022] GET /compute/v2.1/servers/354c136d-e30f-4efd-9a8d-db7aed7b3b5e => generated 1505 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:33:03.831690 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0ebec7cd-8324-4933-8ab4-7d87af4d7702 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:33:03.832314 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-0ebec7cd-8324-4933-8ab4-7d87af4d7702 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] [instance: 354c136d-e30f-4efd-9a8d-db7aed7b3b5e] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:33:03.838832 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0ebec7cd-8324-4933-8ab4-7d87af4d7702 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:03.839333 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0ebec7cd-8324-4933-8ab4-7d87af4d7702 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:03.839776 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0ebec7cd-8324-4933-8ab4-7d87af4d7702 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:03.840501 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0ebec7cd-8324-4933-8ab4-7d87af4d7702 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:03.840962 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0ebec7cd-8324-4933-8ab4-7d87af4d7702 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:03.841400 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0ebec7cd-8324-4933-8ab4-7d87af4d7702 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:03.980650 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-0ebec7cd-8324-4933-8ab4-7d87af4d7702 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d6858e6c5941adbcebf5706357a272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ffd8787fc4fffbee4ac6d72d833ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:03.989216 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-0ebec7cd-8324-4933-8ab4-7d87af4d7702 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] 10.222.0.33 "GET /compute/v2.1/servers/354c136d-e30f-4efd-9a8d-db7aed7b3b5e" status: 200 len: 1505 microversion: 2.1 time: 0.161954 Oct 04 21:33:03.989722 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3265/6564] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:33:03 2022] GET /compute/v2.1/servers/354c136d-e30f-4efd-9a8d-db7aed7b3b5e => generated 1505 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:33:04.012158 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-38a3f3c5-e69f-4840-a50b-6565d516d5c5 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:33:04.012661 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-38a3f3c5-e69f-4840-a50b-6565d516d5c5 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] [instance: 354c136d-e30f-4efd-9a8d-db7aed7b3b5e] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:33:04.018900 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-38a3f3c5-e69f-4840-a50b-6565d516d5c5 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:04.019397 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-38a3f3c5-e69f-4840-a50b-6565d516d5c5 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:04.019836 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-38a3f3c5-e69f-4840-a50b-6565d516d5c5 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:04.020573 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-38a3f3c5-e69f-4840-a50b-6565d516d5c5 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:04.021036 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-38a3f3c5-e69f-4840-a50b-6565d516d5c5 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:04.021466 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-38a3f3c5-e69f-4840-a50b-6565d516d5c5 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:04.047743 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-38a3f3c5-e69f-4840-a50b-6565d516d5c5 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] [instance: 354c136d-e30f-4efd-9a8d-db7aed7b3b5e] Going to try to terminate instance {{(pid=128802) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:33:04.126984 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-38a3f3c5-e69f-4840-a50b-6565d516d5c5 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] 10.222.0.33 "DELETE /compute/v2.1/servers/354c136d-e30f-4efd-9a8d-db7aed7b3b5e" status: 204 len: 0 microversion: 2.1 time: 0.118297 Oct 04 21:33:04.128031 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3300/6565] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 21:33:04 2022] DELETE /compute/v2.1/servers/354c136d-e30f-4efd-9a8d-db7aed7b3b5e => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:33:04.147210 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-45acaf71-878e-4a15-b653-829a3e555cd9 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:33:04.147717 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-45acaf71-878e-4a15-b653-829a3e555cd9 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] [instance: 354c136d-e30f-4efd-9a8d-db7aed7b3b5e] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:33:04.153817 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-45acaf71-878e-4a15-b653-829a3e555cd9 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:04.154306 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-45acaf71-878e-4a15-b653-829a3e555cd9 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:04.154773 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-45acaf71-878e-4a15-b653-829a3e555cd9 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:04.155474 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-45acaf71-878e-4a15-b653-829a3e555cd9 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:04.155928 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-45acaf71-878e-4a15-b653-829a3e555cd9 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:04.156380 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-45acaf71-878e-4a15-b653-829a3e555cd9 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:04.185506 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-45acaf71-878e-4a15-b653-829a3e555cd9 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] [instance: 354c136d-e30f-4efd-9a8d-db7aed7b3b5e] Going to try to terminate instance {{(pid=128801) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:33:04.231700 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.compute.api [None req-45acaf71-878e-4a15-b653-829a3e555cd9 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] [instance: 354c136d-e30f-4efd-9a8d-db7aed7b3b5e] Instance is already in deleting state, ignoring this request Oct 04 21:33:04.232538 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-45acaf71-878e-4a15-b653-829a3e555cd9 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] 10.222.0.33 "DELETE /compute/v2.1/servers/354c136d-e30f-4efd-9a8d-db7aed7b3b5e" status: 204 len: 0 microversion: 2.1 time: 0.089723 Oct 04 21:33:04.233123 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3266/6566] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 21:33:04 2022] DELETE /compute/v2.1/servers/354c136d-e30f-4efd-9a8d-db7aed7b3b5e => generated 0 bytes in 91 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:33:04.243179 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-66651aa8-2e68-45e6-b931-aeb3d014a2cd tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:33:04.244448 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-66651aa8-2e68-45e6-b931-aeb3d014a2cd tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] [instance: 354c136d-e30f-4efd-9a8d-db7aed7b3b5e] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:33:04.251013 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-66651aa8-2e68-45e6-b931-aeb3d014a2cd tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:04.251513 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-66651aa8-2e68-45e6-b931-aeb3d014a2cd tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:04.251981 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-66651aa8-2e68-45e6-b931-aeb3d014a2cd tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:04.252993 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-66651aa8-2e68-45e6-b931-aeb3d014a2cd tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:04.253619 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-66651aa8-2e68-45e6-b931-aeb3d014a2cd tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:04.254063 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-66651aa8-2e68-45e6-b931-aeb3d014a2cd tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:04.393462 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-66651aa8-2e68-45e6-b931-aeb3d014a2cd tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d6858e6c5941adbcebf5706357a272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ffd8787fc4fffbee4ac6d72d833ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:04.401442 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-66651aa8-2e68-45e6-b931-aeb3d014a2cd tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] 10.222.0.33 "GET /compute/v2.1/servers/354c136d-e30f-4efd-9a8d-db7aed7b3b5e" status: 200 len: 1511 microversion: 2.1 time: 0.162687 Oct 04 21:33:04.402039 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3301/6567] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:33:04 2022] GET /compute/v2.1/servers/354c136d-e30f-4efd-9a8d-db7aed7b3b5e => generated 1511 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:33:05.425943 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d6835984-efd1-4028-9e41-6f6a33eadd3a tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:33:05.426902 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d6835984-efd1-4028-9e41-6f6a33eadd3a tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] [instance: 354c136d-e30f-4efd-9a8d-db7aed7b3b5e] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:33:05.434913 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d6835984-efd1-4028-9e41-6f6a33eadd3a tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:05.435412 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d6835984-efd1-4028-9e41-6f6a33eadd3a tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:05.435849 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d6835984-efd1-4028-9e41-6f6a33eadd3a tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:05.436578 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d6835984-efd1-4028-9e41-6f6a33eadd3a tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:05.437067 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d6835984-efd1-4028-9e41-6f6a33eadd3a tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:05.437502 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d6835984-efd1-4028-9e41-6f6a33eadd3a tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:05.584678 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d6835984-efd1-4028-9e41-6f6a33eadd3a tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d6858e6c5941adbcebf5706357a272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd7ffd8787fc4fffbee4ac6d72d833ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:05.592986 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d6835984-efd1-4028-9e41-6f6a33eadd3a tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] 10.222.0.33 "GET /compute/v2.1/servers/354c136d-e30f-4efd-9a8d-db7aed7b3b5e" status: 200 len: 1511 microversion: 2.1 time: 0.171618 Oct 04 21:33:05.593558 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3267/6568] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:33:05 2022] GET /compute/v2.1/servers/354c136d-e30f-4efd-9a8d-db7aed7b3b5e => generated 1511 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:33:06.046842 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-c25b4007-0223-445f-92a8-28130763a52b req-d2a57ed3-83ac-4463-a23d-79eeeabe52e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "354c136d-e30f-4efd-9a8d-db7aed7b3b5e", "name": "network-vif-deleted", "tag": "8191150b-e501-42d5-94b9-1ed623f6a0fc"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:33:06.058066 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-c25b4007-0223-445f-92a8-28130763a52b req-d2a57ed3-83ac-4463-a23d-79eeeabe52e9 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:06.058589 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-c25b4007-0223-445f-92a8-28130763a52b req-d2a57ed3-83ac-4463-a23d-79eeeabe52e9 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:06.059090 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-c25b4007-0223-445f-92a8-28130763a52b req-d2a57ed3-83ac-4463-a23d-79eeeabe52e9 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:06.072265 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-c25b4007-0223-445f-92a8-28130763a52b req-d2a57ed3-83ac-4463-a23d-79eeeabe52e9 service nova] Creating event network-vif-deleted:8191150b-e501-42d5-94b9-1ed623f6a0fc for instance 354c136d-e30f-4efd-9a8d-db7aed7b3b5e on n-h1-854823-8 Oct 04 21:33:06.078195 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-c25b4007-0223-445f-92a8-28130763a52b req-d2a57ed3-83ac-4463-a23d-79eeeabe52e9 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034799 Oct 04 21:33:06.078712 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3302/6569] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:33:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:33:06.616452 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-fd1bea9c-4799-473b-a7f7-00523a297f57 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:33:06.616998 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-fd1bea9c-4799-473b-a7f7-00523a297f57 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] [instance: 354c136d-e30f-4efd-9a8d-db7aed7b3b5e] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:33:06.624228 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fd1bea9c-4799-473b-a7f7-00523a297f57 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:06.624720 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fd1bea9c-4799-473b-a7f7-00523a297f57 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:06.625156 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fd1bea9c-4799-473b-a7f7-00523a297f57 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:06.625917 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fd1bea9c-4799-473b-a7f7-00523a297f57 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:06.626404 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fd1bea9c-4799-473b-a7f7-00523a297f57 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:06.626860 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fd1bea9c-4799-473b-a7f7-00523a297f57 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:06.641358 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-fd1bea9c-4799-473b-a7f7-00523a297f57 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] HTTP exception thrown: Instance 354c136d-e30f-4efd-9a8d-db7aed7b3b5e could not be found. Oct 04 21:33:06.643927 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-fd1bea9c-4799-473b-a7f7-00523a297f57 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Request method failure captured: Oct 04 21:33:06.643927 n-d-854823-8 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/354c136d-e30f-4efd-9a8d-db7aed7b3b5e HTTP/1.1 Oct 04 21:33:06.643927 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 21:33:06.643927 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 21:33:06.643927 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 21:33:06.643927 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 0 Oct 04 21:33:06.643927 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 21:33:06.643927 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 21:33:06.643927 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 21:33:06.643927 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 21:33:06.643927 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPKYttG07rJGtQf1pL1S8yYNAw24RJAiJtMpg7jM4LLe3rahkBktbc9SwwVUrwyg0hKxWgbZuXgYf7VrVhRGN5bevznZ0NUuMBX5LRmKS08V6nUpRd0tzzktMP7bCmvKpgsAl3psCp14JGHki9yjDrepOFw56lpYmiSfN3p39rdMi388 Oct 04 21:33:06.643927 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 21:33:06.643927 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 21:33:06.643927 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 21:33:06.643927 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 21:33:06.643927 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 21:33:06.643927 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 21:33:06.643927 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: dd7ffd8787fc4fffbee4ac6d72d833ea Oct 04 21:33:06.643927 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-ServerDiskConfigTestJSON-952635069 Oct 04 21:33:06.643927 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 21:33:06.643927 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 21:33:06.643927 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_dd7ffd8787fc4fffbee4ac6d72d833ea", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/dd7ffd8787fc4fffbee4ac6d72d833ea"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/dd7ffd8787fc4fffbee4ac6d72d833ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/dd7ffd8787fc4fffbee4ac6d72d833ea"}]}] Oct 04 21:33:06.643927 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-ServerDiskConfigTestJSON-952635069 Oct 04 21:33:06.643927 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: dd7ffd8787fc4fffbee4ac6d72d833ea Oct 04 21:33:06.643927 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-952635069 Oct 04 21:33:06.643927 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-ServerDiskConfigTestJSON-952635069-project Oct 04 21:33:06.643927 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 21:33:06.643927 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 21:33:06.643927 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: 38d6858e6c5941adbcebf5706357a272 Oct 04 21:33:06.643927 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-ServerDiskConfigTestJSON-952635069-project Oct 04 21:33:06.643927 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 21:33:06.643927 n-d-854823-8 devstack@n-api.service[128801]: exception: Instance 354c136d-e30f-4efd-9a8d-db7aed7b3b5e could not be found. Oct 04 21:33:06.643927 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': '354c136d-e30f-4efd-9a8d-db7aed7b3b5e'} Oct 04 21:33:06.643927 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:33:06.643927 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:33:06.643927 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:33:06.643927 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:33:06.643927 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:33:06.643927 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:33:06.643927 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:33:06.643927 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:33:06.643927 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:33:06.643927 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:33:06.643927 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 354c136d-e30f-4efd-9a8d-db7aed7b3b5e could not be found. Oct 04 21:33:06.643927 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:33:06.643927 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:33:06.643927 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:33:06.643927 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:33:06.643927 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:33:06.643927 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:33:06.643927 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:33:06.643927 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:33:06.643927 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:33:06.643927 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:33:06.643927 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:33:06.643927 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:33:06.643927 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:33:06.643927 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:33:06.643927 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:33:06.643927 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:33:06.643927 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 354c136d-e30f-4efd-9a8d-db7aed7b3b5e could not be found. Oct 04 21:33:06.643927 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:33:06.643927 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:33:06.643927 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:33:06.647968 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:33:06.647968 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:33:06.647968 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:33:06.647968 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:33:06.647968 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:33:06.647968 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 354c136d-e30f-4efd-9a8d-db7aed7b3b5e could not be found. Oct 04 21:33:06.647968 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:33:06.647968 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-fd1bea9c-4799-473b-a7f7-00523a297f57 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Returning 404 to user: Instance 354c136d-e30f-4efd-9a8d-db7aed7b3b5e could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:33:06.647968 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-fd1bea9c-4799-473b-a7f7-00523a297f57 tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] 10.222.0.33 "GET /compute/v2.1/servers/354c136d-e30f-4efd-9a8d-db7aed7b3b5e" status: 404 len: 111 microversion: 2.1 time: 0.033044 Oct 04 21:33:06.647968 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3268/6570] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:33:06 2022] GET /compute/v2.1/servers/354c136d-e30f-4efd-9a8d-db7aed7b3b5e => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:33:06.654992 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-9f7376ba-db46-4fc2-aa73-32c29b8a0f1c tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Calling method '.version_select at 0x7f3c744280d0>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:33:06.678999 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-9f7376ba-db46-4fc2-aa73-32c29b8a0f1c tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-38589764" status: 202 len: 0 microversion: 2.1 time: 0.028418 Oct 04 21:33:06.679847 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3303/6571] 10.222.0.33 () {58 vars in 1215 bytes} [Tue Oct 4 21:33:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-38589764 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:33:07.329834 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8e1424c7-c6da-4a9d-b568-54880eade3af tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:33:07.330456 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-8e1424c7-c6da-4a9d-b568-54880eade3af tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] [instance: ba8db62f-8120-4469-9974-819d9316d71b] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:33:07.337023 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8e1424c7-c6da-4a9d-b568-54880eade3af tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:07.337516 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8e1424c7-c6da-4a9d-b568-54880eade3af tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:07.337979 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8e1424c7-c6da-4a9d-b568-54880eade3af tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:07.338747 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8e1424c7-c6da-4a9d-b568-54880eade3af tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:07.339214 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8e1424c7-c6da-4a9d-b568-54880eade3af tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:07.339640 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8e1424c7-c6da-4a9d-b568-54880eade3af tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:07.355982 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-8e1424c7-c6da-4a9d-b568-54880eade3af tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] HTTP exception thrown: Instance ba8db62f-8120-4469-9974-819d9316d71b could not be found. Oct 04 21:33:07.357578 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8e1424c7-c6da-4a9d-b568-54880eade3af tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Request method failure captured: Oct 04 21:33:07.357578 n-d-854823-8 devstack@n-api.service[128801]: request: DELETE /compute/v2.1/servers/ba8db62f-8120-4469-9974-819d9316d71b HTTP/1.1 Oct 04 21:33:07.357578 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 21:33:07.357578 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 21:33:07.357578 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 21:33:07.357578 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 0 Oct 04 21:33:07.357578 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 21:33:07.357578 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 21:33:07.357578 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 21:33:07.357578 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 21:33:07.357578 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPKYttG07rJGtQf1pL1S8yYNAw24RJAiJtMpg7jM4LLe3rahkBktbc9SwwVUrwyg0hKxWgbZuXgYf7VrVhRGN5bevznZ0NUuMBX5LRmKS08V6nUpRd0tzzktMP7bCmvKpgsAl3psCp14JGHki9yjDrepOFw56lpYmiSfN3p39rdMi388 Oct 04 21:33:07.357578 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 21:33:07.357578 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 21:33:07.357578 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 21:33:07.357578 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 21:33:07.357578 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 21:33:07.357578 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 21:33:07.357578 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: dd7ffd8787fc4fffbee4ac6d72d833ea Oct 04 21:33:07.357578 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-ServerDiskConfigTestJSON-952635069 Oct 04 21:33:07.357578 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 21:33:07.357578 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 21:33:07.357578 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_dd7ffd8787fc4fffbee4ac6d72d833ea", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/dd7ffd8787fc4fffbee4ac6d72d833ea"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/dd7ffd8787fc4fffbee4ac6d72d833ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/dd7ffd8787fc4fffbee4ac6d72d833ea"}]}] Oct 04 21:33:07.357578 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-ServerDiskConfigTestJSON-952635069 Oct 04 21:33:07.357578 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: dd7ffd8787fc4fffbee4ac6d72d833ea Oct 04 21:33:07.357578 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-952635069 Oct 04 21:33:07.357578 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-ServerDiskConfigTestJSON-952635069-project Oct 04 21:33:07.357578 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 21:33:07.357578 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 21:33:07.357578 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: 38d6858e6c5941adbcebf5706357a272 Oct 04 21:33:07.357578 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-ServerDiskConfigTestJSON-952635069-project Oct 04 21:33:07.357578 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 21:33:07.357578 n-d-854823-8 devstack@n-api.service[128801]: exception: Instance ba8db62f-8120-4469-9974-819d9316d71b could not be found. Oct 04 21:33:07.357578 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': 'ba8db62f-8120-4469-9974-819d9316d71b'} Oct 04 21:33:07.357578 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:33:07.357578 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:33:07.357578 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:33:07.357578 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:33:07.357578 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:33:07.357578 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:33:07.357578 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:33:07.357578 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:33:07.357578 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:33:07.357578 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:33:07.357578 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ba8db62f-8120-4469-9974-819d9316d71b could not be found. Oct 04 21:33:07.357578 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:33:07.357578 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:33:07.357578 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:33:07.357578 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:33:07.357578 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:33:07.357578 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:33:07.357578 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:33:07.357578 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:33:07.357578 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:33:07.357578 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:33:07.357578 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 21:33:07.357578 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 21:33:07.357578 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 21:33:07.357578 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 21:33:07.357578 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:33:07.357578 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:33:07.357578 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:33:07.357578 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:33:07.360992 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba8db62f-8120-4469-9974-819d9316d71b could not be found. Oct 04 21:33:07.360992 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:33:07.360992 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:33:07.360992 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:33:07.360992 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:33:07.360992 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:33:07.360992 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:33:07.360992 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:33:07.360992 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:33:07.360992 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba8db62f-8120-4469-9974-819d9316d71b could not be found. Oct 04 21:33:07.360992 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:33:07.360992 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8e1424c7-c6da-4a9d-b568-54880eade3af tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Returning 404 to user: Instance ba8db62f-8120-4469-9974-819d9316d71b could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:33:07.360992 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-8e1424c7-c6da-4a9d-b568-54880eade3af tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] 10.222.0.33 "DELETE /compute/v2.1/servers/ba8db62f-8120-4469-9974-819d9316d71b" status: 404 len: 111 microversion: 2.1 time: 0.033191 Oct 04 21:33:07.360992 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3269/6572] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 21:33:07 2022] DELETE /compute/v2.1/servers/ba8db62f-8120-4469-9974-819d9316d71b => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:33:07.369597 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-d8d24db9-5a3b-43c4-b62a-0131fbc076ea tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:33:07.370360 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-d8d24db9-5a3b-43c4-b62a-0131fbc076ea tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] [instance: ba8db62f-8120-4469-9974-819d9316d71b] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:33:07.378054 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d8d24db9-5a3b-43c4-b62a-0131fbc076ea tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:07.378593 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d8d24db9-5a3b-43c4-b62a-0131fbc076ea tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:07.379046 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d8d24db9-5a3b-43c4-b62a-0131fbc076ea tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:07.379763 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d8d24db9-5a3b-43c4-b62a-0131fbc076ea tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:07.380234 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d8d24db9-5a3b-43c4-b62a-0131fbc076ea tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:07.380664 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d8d24db9-5a3b-43c4-b62a-0131fbc076ea tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:07.395554 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.wsgi [None req-d8d24db9-5a3b-43c4-b62a-0131fbc076ea tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] HTTP exception thrown: Instance ba8db62f-8120-4469-9974-819d9316d71b could not be found. Oct 04 21:33:07.397236 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-d8d24db9-5a3b-43c4-b62a-0131fbc076ea tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Request method failure captured: Oct 04 21:33:07.397236 n-d-854823-8 devstack@n-api.service[128802]: request: GET /compute/v2.1/servers/ba8db62f-8120-4469-9974-819d9316d71b HTTP/1.1 Oct 04 21:33:07.397236 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 21:33:07.397236 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 21:33:07.397236 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 21:33:07.397236 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 0 Oct 04 21:33:07.397236 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 21:33:07.397236 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 21:33:07.397236 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 21:33:07.397236 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 21:33:07.397236 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPKYttG07rJGtQf1pL1S8yYNAw24RJAiJtMpg7jM4LLe3rahkBktbc9SwwVUrwyg0hKxWgbZuXgYf7VrVhRGN5bevznZ0NUuMBX5LRmKS08V6nUpRd0tzzktMP7bCmvKpgsAl3psCp14JGHki9yjDrepOFw56lpYmiSfN3p39rdMi388 Oct 04 21:33:07.397236 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 21:33:07.397236 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 21:33:07.397236 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 21:33:07.397236 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 21:33:07.397236 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 21:33:07.397236 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 21:33:07.397236 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: dd7ffd8787fc4fffbee4ac6d72d833ea Oct 04 21:33:07.397236 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-ServerDiskConfigTestJSON-952635069 Oct 04 21:33:07.397236 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 21:33:07.397236 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 21:33:07.397236 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_dd7ffd8787fc4fffbee4ac6d72d833ea", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/dd7ffd8787fc4fffbee4ac6d72d833ea"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/dd7ffd8787fc4fffbee4ac6d72d833ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/dd7ffd8787fc4fffbee4ac6d72d833ea"}]}] Oct 04 21:33:07.397236 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-ServerDiskConfigTestJSON-952635069 Oct 04 21:33:07.397236 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: dd7ffd8787fc4fffbee4ac6d72d833ea Oct 04 21:33:07.397236 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-952635069 Oct 04 21:33:07.397236 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-ServerDiskConfigTestJSON-952635069-project Oct 04 21:33:07.397236 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 21:33:07.397236 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 21:33:07.397236 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: 38d6858e6c5941adbcebf5706357a272 Oct 04 21:33:07.397236 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-ServerDiskConfigTestJSON-952635069-project Oct 04 21:33:07.397236 n-d-854823-8 devstack@n-api.service[128802]: method: > Oct 04 21:33:07.397236 n-d-854823-8 devstack@n-api.service[128802]: exception: Instance ba8db62f-8120-4469-9974-819d9316d71b could not be found. Oct 04 21:33:07.397236 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'id': 'ba8db62f-8120-4469-9974-819d9316d71b'} Oct 04 21:33:07.397236 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:33:07.397236 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:33:07.397236 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:33:07.397236 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:33:07.397236 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:33:07.397236 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:33:07.397236 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:33:07.397236 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:33:07.397236 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:33:07.397236 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:33:07.397236 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ba8db62f-8120-4469-9974-819d9316d71b could not be found. Oct 04 21:33:07.397236 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:33:07.397236 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:33:07.397236 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:33:07.397236 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:33:07.397236 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:33:07.397236 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:33:07.397236 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:33:07.397236 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:33:07.397236 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:33:07.397236 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:33:07.397236 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:33:07.397236 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:33:07.397236 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:33:07.397236 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:33:07.397236 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:33:07.397236 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:33:07.397236 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba8db62f-8120-4469-9974-819d9316d71b could not be found. Oct 04 21:33:07.397236 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:33:07.397236 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:33:07.397236 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:33:07.401264 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:33:07.401264 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:33:07.401264 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:33:07.401264 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:33:07.401264 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:33:07.401264 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba8db62f-8120-4469-9974-819d9316d71b could not be found. Oct 04 21:33:07.401264 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:33:07.401264 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-d8d24db9-5a3b-43c4-b62a-0131fbc076ea tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] Returning 404 to user: Instance ba8db62f-8120-4469-9974-819d9316d71b could not be found. {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:33:07.401264 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-d8d24db9-5a3b-43c4-b62a-0131fbc076ea tempest-ServerDiskConfigTestJSON-952635069 tempest-ServerDiskConfigTestJSON-952635069-project] 10.222.0.33 "GET /compute/v2.1/servers/ba8db62f-8120-4469-9974-819d9316d71b" status: 404 len: 111 microversion: 2.1 time: 0.033901 Oct 04 21:33:07.401264 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3304/6573] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:33:07 2022] GET /compute/v2.1/servers/ba8db62f-8120-4469-9974-819d9316d71b => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:33:16.711932 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e6cf488d-68ef-409b-ae55-3c94587737ab tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Action: 'create', calling method: .version_select at 0x7f3c6ef0bf70>, body: {"keypair": {"name": "tempest-keypair-1781922112", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJasjzjXUhMXBtWccNB10IijjgV4oBBsPMzN8G6yESv9Gsc0QAiSyAhqMQT6VAdLpXPojOe4nYXdtrE17ZMZrEc4dCd9gtDXVjStqdn2FBZXXzreGUBBUuj6GEwbonyiWw=="}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:33:16.719899 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=36 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:33:16.734221 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-e6cf488d-68ef-409b-ae55-3c94587737ab tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Getting quotas for project a146d50c0a544fe49bb604199bb67f02. Resources: {'key_pairs'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:33:16.740661 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-e6cf488d-68ef-409b-ae55-3c94587737ab tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Getting quotas for user a2b2b2b461354b8aa87cb19b0fb4fd28 and project a146d50c0a544fe49bb604199bb67f02. Resources: {'key_pairs'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:33:16.772540 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e6cf488d-68ef-409b-ae55-3c94587737ab tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.211389 Oct 04 21:33:16.773472 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3270/6574] 10.222.0.33 () {60 vars in 1159 bytes} [Tue Oct 4 21:33:16 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:33:18.443939 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-86228c95-05d8-4aab-89cb-7930cf00cd6c tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-536642167", "imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "be02f5cd-2d7d-418b-9089-057dd1d5b96e"}], "security_groups": [{"name": "tempest-securitygroup--1075800401"}], "key_name": "tempest-keypair-1781922112", "user_data": "}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:33:18.453351 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:33:18.454182 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=31,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:33:18.560921 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.network.neutron [None req-86228c95-05d8-4aab-89cb-7930cf00cd6c tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] validate_networks() for [('be02f5cd-2d7d-418b-9089-057dd1d5b96e', None, None, None, None, None)] {{(pid=128802) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:33:19.079495 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-86228c95-05d8-4aab-89cb-7930cf00cd6c tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Flavor limits 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:33:19.079914 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-86228c95-05d8-4aab-89cb-7930cf00cd6c tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Image limits 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:33:19.080679 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-86228c95-05d8-4aab-89cb-7930cf00cd6c tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Flavor pref 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:33:19.081109 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-86228c95-05d8-4aab-89cb-7930cf00cd6c tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Image pref 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:33:19.081533 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-86228c95-05d8-4aab-89cb-7930cf00cd6c tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:33:19.093412 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-86228c95-05d8-4aab-89cb-7930cf00cd6c tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:19.093903 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-86228c95-05d8-4aab-89cb-7930cf00cd6c tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:19.094367 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-86228c95-05d8-4aab-89cb-7930cf00cd6c tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:19.095116 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-86228c95-05d8-4aab-89cb-7930cf00cd6c tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:19.096125 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-86228c95-05d8-4aab-89cb-7930cf00cd6c tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:19.096561 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-86228c95-05d8-4aab-89cb-7930cf00cd6c tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:19.118288 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-86228c95-05d8-4aab-89cb-7930cf00cd6c tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Getting quotas for project a146d50c0a544fe49bb604199bb67f02. Resources: {'ram', 'instances', 'cores'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:33:19.124461 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-86228c95-05d8-4aab-89cb-7930cf00cd6c tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Getting quotas for user a2b2b2b461354b8aa87cb19b0fb4fd28 and project a146d50c0a544fe49bb604199bb67f02. Resources: {'ram', 'instances', 'cores'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:33:19.140567 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-86228c95-05d8-4aab-89cb-7930cf00cd6c tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Going to run 1 instances... {{(pid=128802) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:33:19.143297 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-86228c95-05d8-4aab-89cb-7930cf00cd6c tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: e09f71fe-7c54-4c43-810e-e0d79f515431] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='15b24725-0c99-4bcf-b1fb-907cdf8e2d63',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128802) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:33:19.199616 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-86228c95-05d8-4aab-89cb-7930cf00cd6c tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.760207 Oct 04 21:33:19.200709 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3305/6575] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 21:33:18 2022] POST /compute/v2.1/servers => generated 409 bytes in 762 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:33:19.211971 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b27127e6-e72e-471a-856a-ec964786dadf tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:33:19.212545 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b27127e6-e72e-471a-856a-ec964786dadf tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: e09f71fe-7c54-4c43-810e-e0d79f515431] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:33:19.214514 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=61,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:33:19.287250 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-b27127e6-e72e-471a-856a-ec964786dadf tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b2b2b461354b8aa87cb19b0fb4fd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a146d50c0a544fe49bb604199bb67f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:19.294760 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b27127e6-e72e-471a-856a-ec964786dadf tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "GET /compute/v2.1/servers/e09f71fe-7c54-4c43-810e-e0d79f515431" status: 200 len: 1238 microversion: 2.1 time: 0.086799 Oct 04 21:33:19.295580 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3271/6576] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:33:19 2022] GET /compute/v2.1/servers/e09f71fe-7c54-4c43-810e-e0d79f515431 => generated 1238 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:33:20.322569 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-30ddab0c-94ca-461c-80dd-60c1c6556c9a tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:33:20.327385 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-30ddab0c-94ca-461c-80dd-60c1c6556c9a tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: e09f71fe-7c54-4c43-810e-e0d79f515431] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:33:20.334637 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-30ddab0c-94ca-461c-80dd-60c1c6556c9a tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:20.335141 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-30ddab0c-94ca-461c-80dd-60c1c6556c9a tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:20.335798 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-30ddab0c-94ca-461c-80dd-60c1c6556c9a tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:20.336527 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-30ddab0c-94ca-461c-80dd-60c1c6556c9a tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:20.337161 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-30ddab0c-94ca-461c-80dd-60c1c6556c9a tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:20.337600 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-30ddab0c-94ca-461c-80dd-60c1c6556c9a tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:20.415784 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-30ddab0c-94ca-461c-80dd-60c1c6556c9a tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b2b2b461354b8aa87cb19b0fb4fd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a146d50c0a544fe49bb604199bb67f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:20.432906 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-30ddab0c-94ca-461c-80dd-60c1c6556c9a tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "GET /compute/v2.1/servers/e09f71fe-7c54-4c43-810e-e0d79f515431" status: 200 len: 1290 microversion: 2.1 time: 0.115437 Oct 04 21:33:20.443509 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3306/6577] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:33:20 2022] GET /compute/v2.1/servers/e09f71fe-7c54-4c43-810e-e0d79f515431 => generated 1290 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:33:21.457845 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d0702b0d-b8c3-4756-b00f-77b04d828fac tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:33:21.458510 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d0702b0d-b8c3-4756-b00f-77b04d828fac tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: e09f71fe-7c54-4c43-810e-e0d79f515431] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:33:21.465334 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d0702b0d-b8c3-4756-b00f-77b04d828fac tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:21.465847 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d0702b0d-b8c3-4756-b00f-77b04d828fac tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:21.466278 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d0702b0d-b8c3-4756-b00f-77b04d828fac tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:21.467202 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d0702b0d-b8c3-4756-b00f-77b04d828fac tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:21.467677 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d0702b0d-b8c3-4756-b00f-77b04d828fac tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:21.468111 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d0702b0d-b8c3-4756-b00f-77b04d828fac tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:21.719682 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d0702b0d-b8c3-4756-b00f-77b04d828fac tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b2b2b461354b8aa87cb19b0fb4fd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a146d50c0a544fe49bb604199bb67f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:21.730408 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d0702b0d-b8c3-4756-b00f-77b04d828fac tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "GET /compute/v2.1/servers/e09f71fe-7c54-4c43-810e-e0d79f515431" status: 200 len: 1364 microversion: 2.1 time: 0.277045 Oct 04 21:33:21.741872 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3272/6578] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:33:21 2022] GET /compute/v2.1/servers/e09f71fe-7c54-4c43-810e-e0d79f515431 => generated 1364 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:33:22.143096 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-ca091433-317d-4b3a-a820-e535821bb4a3 req-7d0ca564-d24e-4f0b-981a-1314fb179299 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e09f71fe-7c54-4c43-810e-e0d79f515431", "tag": "15207f9a-b9ae-41c5-a11a-02199281af2a"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:33:22.157152 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-ca091433-317d-4b3a-a820-e535821bb4a3 req-7d0ca564-d24e-4f0b-981a-1314fb179299 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:22.159010 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-ca091433-317d-4b3a-a820-e535821bb4a3 req-7d0ca564-d24e-4f0b-981a-1314fb179299 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:22.161292 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-ca091433-317d-4b3a-a820-e535821bb4a3 req-7d0ca564-d24e-4f0b-981a-1314fb179299 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:22.173314 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-ca091433-317d-4b3a-a820-e535821bb4a3 req-7d0ca564-d24e-4f0b-981a-1314fb179299 service nova] Creating event network-changed:15207f9a-b9ae-41c5-a11a-02199281af2a for instance e09f71fe-7c54-4c43-810e-e0d79f515431 on n-h2-854823-8 Oct 04 21:33:22.179706 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-ca091433-317d-4b3a-a820-e535821bb4a3 req-7d0ca564-d24e-4f0b-981a-1314fb179299 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040821 Oct 04 21:33:22.180491 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3307/6579] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:33:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:33:22.757009 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-da8dc545-a3b1-444a-95d6-ba8ca2858497 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:33:22.757534 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-da8dc545-a3b1-444a-95d6-ba8ca2858497 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: e09f71fe-7c54-4c43-810e-e0d79f515431] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:33:22.764810 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-da8dc545-a3b1-444a-95d6-ba8ca2858497 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:22.765315 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-da8dc545-a3b1-444a-95d6-ba8ca2858497 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:22.765761 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-da8dc545-a3b1-444a-95d6-ba8ca2858497 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:22.766527 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-da8dc545-a3b1-444a-95d6-ba8ca2858497 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:22.766996 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-da8dc545-a3b1-444a-95d6-ba8ca2858497 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:22.768547 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-da8dc545-a3b1-444a-95d6-ba8ca2858497 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:22.920760 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-da8dc545-a3b1-444a-95d6-ba8ca2858497 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b2b2b461354b8aa87cb19b0fb4fd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a146d50c0a544fe49bb604199bb67f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:22.928951 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-da8dc545-a3b1-444a-95d6-ba8ca2858497 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "GET /compute/v2.1/servers/e09f71fe-7c54-4c43-810e-e0d79f515431" status: 200 len: 1364 microversion: 2.1 time: 0.176150 Oct 04 21:33:22.929813 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3273/6580] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:33:22 2022] GET /compute/v2.1/servers/e09f71fe-7c54-4c43-810e-e0d79f515431 => generated 1364 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:33:23.953885 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-dc5e2ad4-751e-4df7-abec-6231f229f5f3 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:33:23.954670 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-dc5e2ad4-751e-4df7-abec-6231f229f5f3 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: e09f71fe-7c54-4c43-810e-e0d79f515431] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:33:23.963320 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dc5e2ad4-751e-4df7-abec-6231f229f5f3 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:23.963823 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dc5e2ad4-751e-4df7-abec-6231f229f5f3 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:23.964274 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dc5e2ad4-751e-4df7-abec-6231f229f5f3 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:23.965005 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dc5e2ad4-751e-4df7-abec-6231f229f5f3 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:23.965472 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dc5e2ad4-751e-4df7-abec-6231f229f5f3 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:23.965919 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dc5e2ad4-751e-4df7-abec-6231f229f5f3 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:24.110816 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-dc5e2ad4-751e-4df7-abec-6231f229f5f3 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b2b2b461354b8aa87cb19b0fb4fd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a146d50c0a544fe49bb604199bb67f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:24.119472 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-dc5e2ad4-751e-4df7-abec-6231f229f5f3 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "GET /compute/v2.1/servers/e09f71fe-7c54-4c43-810e-e0d79f515431" status: 200 len: 1364 microversion: 2.1 time: 0.169931 Oct 04 21:33:24.120077 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3308/6581] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:33:23 2022] GET /compute/v2.1/servers/e09f71fe-7c54-4c43-810e-e0d79f515431 => generated 1364 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:33:25.145028 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e5eed953-e07f-4abd-b7fb-90505dbfcbf0 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:33:25.145565 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e5eed953-e07f-4abd-b7fb-90505dbfcbf0 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: e09f71fe-7c54-4c43-810e-e0d79f515431] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:33:25.152879 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e5eed953-e07f-4abd-b7fb-90505dbfcbf0 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:25.153369 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e5eed953-e07f-4abd-b7fb-90505dbfcbf0 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:25.153808 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e5eed953-e07f-4abd-b7fb-90505dbfcbf0 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:25.154553 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e5eed953-e07f-4abd-b7fb-90505dbfcbf0 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:25.155013 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e5eed953-e07f-4abd-b7fb-90505dbfcbf0 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:25.155443 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e5eed953-e07f-4abd-b7fb-90505dbfcbf0 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:25.294882 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e5eed953-e07f-4abd-b7fb-90505dbfcbf0 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b2b2b461354b8aa87cb19b0fb4fd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a146d50c0a544fe49bb604199bb67f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:25.302878 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e5eed953-e07f-4abd-b7fb-90505dbfcbf0 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "GET /compute/v2.1/servers/e09f71fe-7c54-4c43-810e-e0d79f515431" status: 200 len: 1364 microversion: 2.1 time: 0.163501 Oct 04 21:33:25.303478 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3274/6582] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:33:25 2022] GET /compute/v2.1/servers/e09f71fe-7c54-4c43-810e-e0d79f515431 => generated 1364 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:33:26.326655 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-20e837b8-80d3-4b9b-8908-e321602f1aa6 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:33:26.327283 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-20e837b8-80d3-4b9b-8908-e321602f1aa6 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: e09f71fe-7c54-4c43-810e-e0d79f515431] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:33:26.334904 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-20e837b8-80d3-4b9b-8908-e321602f1aa6 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:26.335404 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-20e837b8-80d3-4b9b-8908-e321602f1aa6 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:26.335869 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-20e837b8-80d3-4b9b-8908-e321602f1aa6 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:26.336574 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-20e837b8-80d3-4b9b-8908-e321602f1aa6 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:26.337035 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-20e837b8-80d3-4b9b-8908-e321602f1aa6 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:26.337472 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-20e837b8-80d3-4b9b-8908-e321602f1aa6 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:26.473236 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-20e837b8-80d3-4b9b-8908-e321602f1aa6 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b2b2b461354b8aa87cb19b0fb4fd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a146d50c0a544fe49bb604199bb67f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:26.481562 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-20e837b8-80d3-4b9b-8908-e321602f1aa6 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "GET /compute/v2.1/servers/e09f71fe-7c54-4c43-810e-e0d79f515431" status: 200 len: 1364 microversion: 2.1 time: 0.158761 Oct 04 21:33:26.482163 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3309/6583] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:33:26 2022] GET /compute/v2.1/servers/e09f71fe-7c54-4c43-810e-e0d79f515431 => generated 1364 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:33:27.504762 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f6f5f10a-a66d-40dd-9106-8977fcee5ec9 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:33:27.505477 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f6f5f10a-a66d-40dd-9106-8977fcee5ec9 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: e09f71fe-7c54-4c43-810e-e0d79f515431] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:33:27.512826 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f6f5f10a-a66d-40dd-9106-8977fcee5ec9 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:27.513541 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f6f5f10a-a66d-40dd-9106-8977fcee5ec9 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:27.513990 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f6f5f10a-a66d-40dd-9106-8977fcee5ec9 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:27.514868 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f6f5f10a-a66d-40dd-9106-8977fcee5ec9 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:27.515236 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f6f5f10a-a66d-40dd-9106-8977fcee5ec9 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:27.515668 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f6f5f10a-a66d-40dd-9106-8977fcee5ec9 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:27.665841 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f6f5f10a-a66d-40dd-9106-8977fcee5ec9 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b2b2b461354b8aa87cb19b0fb4fd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a146d50c0a544fe49bb604199bb67f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:27.674572 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f6f5f10a-a66d-40dd-9106-8977fcee5ec9 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "GET /compute/v2.1/servers/e09f71fe-7c54-4c43-810e-e0d79f515431" status: 200 len: 1364 microversion: 2.1 time: 0.174253 Oct 04 21:33:27.675381 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3275/6584] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:33:27 2022] GET /compute/v2.1/servers/e09f71fe-7c54-4c43-810e-e0d79f515431 => generated 1364 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:33:28.064852 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-ed87cb9b-e485-47ba-8bec-0560245cc80c req-2610ade5-3258-4b5f-a5cf-f59666c8cdcc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e09f71fe-7c54-4c43-810e-e0d79f515431", "name": "network-vif-plugged", "status": "completed", "tag": "15207f9a-b9ae-41c5-a11a-02199281af2a"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:33:28.076752 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-ed87cb9b-e485-47ba-8bec-0560245cc80c req-2610ade5-3258-4b5f-a5cf-f59666c8cdcc service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:28.077256 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-ed87cb9b-e485-47ba-8bec-0560245cc80c req-2610ade5-3258-4b5f-a5cf-f59666c8cdcc service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:28.077705 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-ed87cb9b-e485-47ba-8bec-0560245cc80c req-2610ade5-3258-4b5f-a5cf-f59666c8cdcc service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:28.091769 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-ed87cb9b-e485-47ba-8bec-0560245cc80c req-2610ade5-3258-4b5f-a5cf-f59666c8cdcc service nova] Creating event network-vif-plugged:15207f9a-b9ae-41c5-a11a-02199281af2a for instance e09f71fe-7c54-4c43-810e-e0d79f515431 on n-h2-854823-8 Oct 04 21:33:28.097890 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-ed87cb9b-e485-47ba-8bec-0560245cc80c req-2610ade5-3258-4b5f-a5cf-f59666c8cdcc service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038205 Oct 04 21:33:28.098556 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3310/6585] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:33:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:33:28.699006 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a2005e94-8f22-448b-bcba-9a768054a582 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:33:28.699642 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a2005e94-8f22-448b-bcba-9a768054a582 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: e09f71fe-7c54-4c43-810e-e0d79f515431] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:33:28.708838 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a2005e94-8f22-448b-bcba-9a768054a582 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:28.709405 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a2005e94-8f22-448b-bcba-9a768054a582 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:28.710684 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a2005e94-8f22-448b-bcba-9a768054a582 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:28.711602 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a2005e94-8f22-448b-bcba-9a768054a582 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:28.712114 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a2005e94-8f22-448b-bcba-9a768054a582 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:28.712548 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a2005e94-8f22-448b-bcba-9a768054a582 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:28.857692 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-a2005e94-8f22-448b-bcba-9a768054a582 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b2b2b461354b8aa87cb19b0fb4fd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a146d50c0a544fe49bb604199bb67f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:28.865728 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a2005e94-8f22-448b-bcba-9a768054a582 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "GET /compute/v2.1/servers/e09f71fe-7c54-4c43-810e-e0d79f515431" status: 200 len: 1364 microversion: 2.1 time: 0.170840 Oct 04 21:33:28.866310 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3276/6586] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:33:28 2022] GET /compute/v2.1/servers/e09f71fe-7c54-4c43-810e-e0d79f515431 => generated 1364 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:33:29.887399 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell0:SELECT=2 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:33:29.888360 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell0:SELECT=6 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:33:29.894015 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-2d7a83bf-3916-4617-93a4-299df3b34506 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:33:29.894801 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-2d7a83bf-3916-4617-93a4-299df3b34506 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: e09f71fe-7c54-4c43-810e-e0d79f515431] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:33:29.902600 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2d7a83bf-3916-4617-93a4-299df3b34506 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:29.903112 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2d7a83bf-3916-4617-93a4-299df3b34506 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:29.903568 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2d7a83bf-3916-4617-93a4-299df3b34506 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:29.904335 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2d7a83bf-3916-4617-93a4-299df3b34506 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:29.904857 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2d7a83bf-3916-4617-93a4-299df3b34506 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:29.905343 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2d7a83bf-3916-4617-93a4-299df3b34506 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:30.066688 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-2d7a83bf-3916-4617-93a4-299df3b34506 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b2b2b461354b8aa87cb19b0fb4fd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a146d50c0a544fe49bb604199bb67f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:33:30.075329 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-2d7a83bf-3916-4617-93a4-299df3b34506 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "GET /compute/v2.1/servers/e09f71fe-7c54-4c43-810e-e0d79f515431" status: 200 len: 1550 microversion: 2.1 time: 0.189743 Oct 04 21:33:30.075928 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3311/6587] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:33:29 2022] GET /compute/v2.1/servers/e09f71fe-7c54-4c43-810e-e0d79f515431 => generated 1550 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:33:30.099383 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-099faf26-044e-461f-9e0f-06e04e56323d tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:33:30.099960 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-099faf26-044e-461f-9e0f-06e04e56323d tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: e09f71fe-7c54-4c43-810e-e0d79f515431] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:33:30.101795 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=6 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:33:30.108421 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-099faf26-044e-461f-9e0f-06e04e56323d tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:30.108943 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-099faf26-044e-461f-9e0f-06e04e56323d tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:30.109385 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-099faf26-044e-461f-9e0f-06e04e56323d tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:30.110095 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-099faf26-044e-461f-9e0f-06e04e56323d tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:30.110583 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-099faf26-044e-461f-9e0f-06e04e56323d tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:30.111012 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-099faf26-044e-461f-9e0f-06e04e56323d tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:30.200585 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-099faf26-044e-461f-9e0f-06e04e56323d tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "GET /compute/v2.1/servers/e09f71fe-7c54-4c43-810e-e0d79f515431/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.106032 Oct 04 21:33:30.201195 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3277/6588] 10.222.0.33 () {58 vars in 1275 bytes} [Tue Oct 4 21:33:30 2022] GET /compute/v2.1/servers/e09f71fe-7c54-4c43-810e-e0d79f515431/os-interface => generated 285 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:33:31.242331 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-1d622495-052d-4d6d-a6e9-ced525b5efb8 req-92285bf0-04ba-466b-8c58-ae60647ab46f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e09f71fe-7c54-4c43-810e-e0d79f515431", "tag": "15207f9a-b9ae-41c5-a11a-02199281af2a"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:33:31.254077 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-1d622495-052d-4d6d-a6e9-ced525b5efb8 req-92285bf0-04ba-466b-8c58-ae60647ab46f service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:33:31.254722 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-1d622495-052d-4d6d-a6e9-ced525b5efb8 req-92285bf0-04ba-466b-8c58-ae60647ab46f service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:33:31.255245 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-1d622495-052d-4d6d-a6e9-ced525b5efb8 req-92285bf0-04ba-466b-8c58-ae60647ab46f service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:33:31.267972 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-1d622495-052d-4d6d-a6e9-ced525b5efb8 req-92285bf0-04ba-466b-8c58-ae60647ab46f service nova] Creating event network-changed:15207f9a-b9ae-41c5-a11a-02199281af2a for instance e09f71fe-7c54-4c43-810e-e0d79f515431 on n-h2-854823-8 Oct 04 21:33:31.273899 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-1d622495-052d-4d6d-a6e9-ced525b5efb8 req-92285bf0-04ba-466b-8c58-ae60647ab46f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035385 Oct 04 21:33:31.274622 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3312/6589] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:33:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:34:06.607229 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:34:06.608506 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=34 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:34:06.615371 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9809842c-dc1f-4f9d-a464-d85d13ea050d tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:34:06.616195 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-9809842c-dc1f-4f9d-a464-d85d13ea050d tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: e09f71fe-7c54-4c43-810e-e0d79f515431] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:34:06.633178 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9809842c-dc1f-4f9d-a464-d85d13ea050d tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:06.633925 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9809842c-dc1f-4f9d-a464-d85d13ea050d tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:06.634639 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9809842c-dc1f-4f9d-a464-d85d13ea050d tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:06.635773 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9809842c-dc1f-4f9d-a464-d85d13ea050d tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:06.636485 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9809842c-dc1f-4f9d-a464-d85d13ea050d tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:06.637188 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9809842c-dc1f-4f9d-a464-d85d13ea050d tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:06.812245 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-9809842c-dc1f-4f9d-a464-d85d13ea050d tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b2b2b461354b8aa87cb19b0fb4fd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a146d50c0a544fe49bb604199bb67f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:06.827396 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-9809842c-dc1f-4f9d-a464-d85d13ea050d tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "GET /compute/v2.1/servers/e09f71fe-7c54-4c43-810e-e0d79f515431" status: 200 len: 1669 microversion: 2.1 time: 0.222627 Oct 04 21:34:06.828452 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3278/6590] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:34:06 2022] GET /compute/v2.1/servers/e09f71fe-7c54-4c43-810e-e0d79f515431 => generated 1669 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:34:06.850157 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:34:06.851065 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=32 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:34:06.855573 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-f09d204b-9010-45e1-8980-90fd88197e0f tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:34:06.856337 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-f09d204b-9010-45e1-8980-90fd88197e0f tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: e09f71fe-7c54-4c43-810e-e0d79f515431] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:34:06.867624 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f09d204b-9010-45e1-8980-90fd88197e0f tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:06.868052 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f09d204b-9010-45e1-8980-90fd88197e0f tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:06.868514 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f09d204b-9010-45e1-8980-90fd88197e0f tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:06.869244 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f09d204b-9010-45e1-8980-90fd88197e0f tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:06.869717 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f09d204b-9010-45e1-8980-90fd88197e0f tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:06.870157 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f09d204b-9010-45e1-8980-90fd88197e0f tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:07.023831 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-f09d204b-9010-45e1-8980-90fd88197e0f tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b2b2b461354b8aa87cb19b0fb4fd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a146d50c0a544fe49bb604199bb67f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:07.032650 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-f09d204b-9010-45e1-8980-90fd88197e0f tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "GET /compute/v2.1/servers/e09f71fe-7c54-4c43-810e-e0d79f515431" status: 200 len: 1669 microversion: 2.1 time: 0.184224 Oct 04 21:34:07.033264 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3313/6591] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:34:06 2022] GET /compute/v2.1/servers/e09f71fe-7c54-4c43-810e-e0d79f515431 => generated 1669 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:34:07.072101 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-31e0814c-d11e-46a4-b89f-c066a0bace13 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:34:07.072723 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-31e0814c-d11e-46a4-b89f-c066a0bace13 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: e09f71fe-7c54-4c43-810e-e0d79f515431] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:34:07.079549 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-31e0814c-d11e-46a4-b89f-c066a0bace13 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:07.080048 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-31e0814c-d11e-46a4-b89f-c066a0bace13 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:07.080491 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-31e0814c-d11e-46a4-b89f-c066a0bace13 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:07.081210 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-31e0814c-d11e-46a4-b89f-c066a0bace13 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:07.081672 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-31e0814c-d11e-46a4-b89f-c066a0bace13 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:07.082149 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-31e0814c-d11e-46a4-b89f-c066a0bace13 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:07.246731 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-31e0814c-d11e-46a4-b89f-c066a0bace13 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b2b2b461354b8aa87cb19b0fb4fd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a146d50c0a544fe49bb604199bb67f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:07.255222 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-31e0814c-d11e-46a4-b89f-c066a0bace13 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "GET /compute/v2.1/servers/e09f71fe-7c54-4c43-810e-e0d79f515431" status: 200 len: 1669 microversion: 2.1 time: 0.187150 Oct 04 21:34:07.255812 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3279/6592] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:34:07 2022] GET /compute/v2.1/servers/e09f71fe-7c54-4c43-810e-e0d79f515431 => generated 1669 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:34:07.283036 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-299c149a-fdce-4457-a4a4-bccf4c0f8b5a tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:34:07.286704 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-299c149a-fdce-4457-a4a4-bccf4c0f8b5a tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: e09f71fe-7c54-4c43-810e-e0d79f515431] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:34:07.296509 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-299c149a-fdce-4457-a4a4-bccf4c0f8b5a tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:07.297310 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-299c149a-fdce-4457-a4a4-bccf4c0f8b5a tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:07.298633 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-299c149a-fdce-4457-a4a4-bccf4c0f8b5a tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:07.299863 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-299c149a-fdce-4457-a4a4-bccf4c0f8b5a tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:07.300684 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-299c149a-fdce-4457-a4a4-bccf4c0f8b5a tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:07.301408 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-299c149a-fdce-4457-a4a4-bccf4c0f8b5a tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:07.349380 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-299c149a-fdce-4457-a4a4-bccf4c0f8b5a tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'a2b2b2b461354b8aa87cb19b0fb4fd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a146d50c0a544fe49bb604199bb67f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:07.359127 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-299c149a-fdce-4457-a4a4-bccf4c0f8b5a tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: e09f71fe-7c54-4c43-810e-e0d79f515431] Old instance type m1.heat2, new instance type m1.heat {{(pid=128802) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 04 21:34:07.367901 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-299c149a-fdce-4457-a4a4-bccf4c0f8b5a tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Flavor limits 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:34:07.368482 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-299c149a-fdce-4457-a4a4-bccf4c0f8b5a tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Image limits 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:34:07.369092 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-299c149a-fdce-4457-a4a4-bccf4c0f8b5a tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Flavor pref 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:34:07.369612 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-299c149a-fdce-4457-a4a4-bccf4c0f8b5a tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Image pref 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:34:07.370166 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-299c149a-fdce-4457-a4a4-bccf4c0f8b5a tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:34:07.447596 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-299c149a-fdce-4457-a4a4-bccf4c0f8b5a tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "POST /compute/v2.1/servers/e09f71fe-7c54-4c43-810e-e0d79f515431/action" status: 202 len: 0 microversion: 2.1 time: 0.171873 Oct 04 21:34:07.448421 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3314/6593] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 21:34:07 2022] POST /compute/v2.1/servers/e09f71fe-7c54-4c43-810e-e0d79f515431/action => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:34:07.462800 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-629c0094-67c3-4c77-bf62-9fcf365c095c tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:34:07.463981 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-629c0094-67c3-4c77-bf62-9fcf365c095c tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: e09f71fe-7c54-4c43-810e-e0d79f515431] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:34:07.479235 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-629c0094-67c3-4c77-bf62-9fcf365c095c tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:07.480109 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-629c0094-67c3-4c77-bf62-9fcf365c095c tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:07.480916 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-629c0094-67c3-4c77-bf62-9fcf365c095c tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:07.482229 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-629c0094-67c3-4c77-bf62-9fcf365c095c tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:07.483683 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-629c0094-67c3-4c77-bf62-9fcf365c095c tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:07.483924 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-629c0094-67c3-4c77-bf62-9fcf365c095c tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:07.699086 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-629c0094-67c3-4c77-bf62-9fcf365c095c tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b2b2b461354b8aa87cb19b0fb4fd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a146d50c0a544fe49bb604199bb67f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:07.710721 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-629c0094-67c3-4c77-bf62-9fcf365c095c tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "GET /compute/v2.1/servers/e09f71fe-7c54-4c43-810e-e0d79f515431" status: 200 len: 1678 microversion: 2.1 time: 0.255702 Oct 04 21:34:07.711268 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3280/6594] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:34:07 2022] GET /compute/v2.1/servers/e09f71fe-7c54-4c43-810e-e0d79f515431 => generated 1678 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:34:08.750233 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-cf576c72-1d93-4eac-8863-e3b11756a40c tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:34:08.751364 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-cf576c72-1d93-4eac-8863-e3b11756a40c tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: e09f71fe-7c54-4c43-810e-e0d79f515431] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:34:08.759628 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cf576c72-1d93-4eac-8863-e3b11756a40c tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:08.760135 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cf576c72-1d93-4eac-8863-e3b11756a40c tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:08.760598 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cf576c72-1d93-4eac-8863-e3b11756a40c tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:08.761341 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cf576c72-1d93-4eac-8863-e3b11756a40c tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:08.761814 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cf576c72-1d93-4eac-8863-e3b11756a40c tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:08.762254 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cf576c72-1d93-4eac-8863-e3b11756a40c tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:08.912893 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-cf576c72-1d93-4eac-8863-e3b11756a40c tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b2b2b461354b8aa87cb19b0fb4fd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a146d50c0a544fe49bb604199bb67f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:08.921881 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-cf576c72-1d93-4eac-8863-e3b11756a40c tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "GET /compute/v2.1/servers/e09f71fe-7c54-4c43-810e-e0d79f515431" status: 200 len: 1678 microversion: 2.1 time: 0.176371 Oct 04 21:34:08.922532 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3315/6595] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:34:08 2022] GET /compute/v2.1/servers/e09f71fe-7c54-4c43-810e-e0d79f515431 => generated 1678 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:34:09.946764 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b62cab5b-fda8-46d0-9ef4-ca3a61f8c4cf tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:34:09.947512 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b62cab5b-fda8-46d0-9ef4-ca3a61f8c4cf tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: e09f71fe-7c54-4c43-810e-e0d79f515431] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:34:09.958845 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b62cab5b-fda8-46d0-9ef4-ca3a61f8c4cf tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:09.959345 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b62cab5b-fda8-46d0-9ef4-ca3a61f8c4cf tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:09.959785 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b62cab5b-fda8-46d0-9ef4-ca3a61f8c4cf tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:09.960506 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b62cab5b-fda8-46d0-9ef4-ca3a61f8c4cf tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:09.960967 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b62cab5b-fda8-46d0-9ef4-ca3a61f8c4cf tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:09.961391 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b62cab5b-fda8-46d0-9ef4-ca3a61f8c4cf tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:10.104292 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-b62cab5b-fda8-46d0-9ef4-ca3a61f8c4cf tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b2b2b461354b8aa87cb19b0fb4fd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a146d50c0a544fe49bb604199bb67f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:10.112707 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b62cab5b-fda8-46d0-9ef4-ca3a61f8c4cf tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "GET /compute/v2.1/servers/e09f71fe-7c54-4c43-810e-e0d79f515431" status: 200 len: 1683 microversion: 2.1 time: 0.171135 Oct 04 21:34:10.113316 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3281/6596] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:34:09 2022] GET /compute/v2.1/servers/e09f71fe-7c54-4c43-810e-e0d79f515431 => generated 1683 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:34:11.138408 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-4e38897b-7a8f-415b-989e-41df9ec38691 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:34:11.139066 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-4e38897b-7a8f-415b-989e-41df9ec38691 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: e09f71fe-7c54-4c43-810e-e0d79f515431] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:34:11.147098 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4e38897b-7a8f-415b-989e-41df9ec38691 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:11.147663 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4e38897b-7a8f-415b-989e-41df9ec38691 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:11.148112 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4e38897b-7a8f-415b-989e-41df9ec38691 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:11.148855 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4e38897b-7a8f-415b-989e-41df9ec38691 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:11.149318 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4e38897b-7a8f-415b-989e-41df9ec38691 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:11.149749 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4e38897b-7a8f-415b-989e-41df9ec38691 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:11.297236 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-4e38897b-7a8f-415b-989e-41df9ec38691 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b2b2b461354b8aa87cb19b0fb4fd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a146d50c0a544fe49bb604199bb67f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:11.306903 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-4e38897b-7a8f-415b-989e-41df9ec38691 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "GET /compute/v2.1/servers/e09f71fe-7c54-4c43-810e-e0d79f515431" status: 200 len: 1683 microversion: 2.1 time: 0.172908 Oct 04 21:34:11.307561 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3316/6597] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:34:11 2022] GET /compute/v2.1/servers/e09f71fe-7c54-4c43-810e-e0d79f515431 => generated 1683 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:34:12.331551 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5f92ad0a-6dce-446f-97dc-c5c45e9ecebd tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:34:12.332266 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-5f92ad0a-6dce-446f-97dc-c5c45e9ecebd tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: e09f71fe-7c54-4c43-810e-e0d79f515431] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:34:12.340307 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5f92ad0a-6dce-446f-97dc-c5c45e9ecebd tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:12.340857 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5f92ad0a-6dce-446f-97dc-c5c45e9ecebd tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:12.341399 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5f92ad0a-6dce-446f-97dc-c5c45e9ecebd tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:12.342205 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5f92ad0a-6dce-446f-97dc-c5c45e9ecebd tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:12.342770 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5f92ad0a-6dce-446f-97dc-c5c45e9ecebd tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:12.343313 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5f92ad0a-6dce-446f-97dc-c5c45e9ecebd tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:12.521885 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-5f92ad0a-6dce-446f-97dc-c5c45e9ecebd tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b2b2b461354b8aa87cb19b0fb4fd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a146d50c0a544fe49bb604199bb67f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:12.530322 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5f92ad0a-6dce-446f-97dc-c5c45e9ecebd tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "GET /compute/v2.1/servers/e09f71fe-7c54-4c43-810e-e0d79f515431" status: 200 len: 1683 microversion: 2.1 time: 0.203506 Oct 04 21:34:12.531065 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3282/6598] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:34:12 2022] GET /compute/v2.1/servers/e09f71fe-7c54-4c43-810e-e0d79f515431 => generated 1683 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:34:13.556706 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-ebb7f6a7-2dd3-474c-9044-7f0207737fad tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:34:13.557548 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-ebb7f6a7-2dd3-474c-9044-7f0207737fad tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: e09f71fe-7c54-4c43-810e-e0d79f515431] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:34:13.567832 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ebb7f6a7-2dd3-474c-9044-7f0207737fad tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:13.568443 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ebb7f6a7-2dd3-474c-9044-7f0207737fad tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:13.568962 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ebb7f6a7-2dd3-474c-9044-7f0207737fad tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:13.569813 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ebb7f6a7-2dd3-474c-9044-7f0207737fad tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:13.570432 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ebb7f6a7-2dd3-474c-9044-7f0207737fad tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:13.570943 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ebb7f6a7-2dd3-474c-9044-7f0207737fad tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:13.718333 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-ebb7f6a7-2dd3-474c-9044-7f0207737fad tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b2b2b461354b8aa87cb19b0fb4fd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a146d50c0a544fe49bb604199bb67f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:13.727555 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-ebb7f6a7-2dd3-474c-9044-7f0207737fad tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "GET /compute/v2.1/servers/e09f71fe-7c54-4c43-810e-e0d79f515431" status: 200 len: 1683 microversion: 2.1 time: 0.176046 Oct 04 21:34:13.728151 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3317/6599] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:34:13 2022] GET /compute/v2.1/servers/e09f71fe-7c54-4c43-810e-e0d79f515431 => generated 1683 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:34:14.752883 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-130007fc-035b-4bf2-9ede-cccfa7cef0a2 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:34:14.753756 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-130007fc-035b-4bf2-9ede-cccfa7cef0a2 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: e09f71fe-7c54-4c43-810e-e0d79f515431] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:34:14.761686 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-130007fc-035b-4bf2-9ede-cccfa7cef0a2 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:14.762280 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-130007fc-035b-4bf2-9ede-cccfa7cef0a2 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:14.762828 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-130007fc-035b-4bf2-9ede-cccfa7cef0a2 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:14.763645 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-130007fc-035b-4bf2-9ede-cccfa7cef0a2 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:14.764197 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-130007fc-035b-4bf2-9ede-cccfa7cef0a2 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:14.764682 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-130007fc-035b-4bf2-9ede-cccfa7cef0a2 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:14.906135 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-130007fc-035b-4bf2-9ede-cccfa7cef0a2 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b2b2b461354b8aa87cb19b0fb4fd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a146d50c0a544fe49bb604199bb67f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:14.915172 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-130007fc-035b-4bf2-9ede-cccfa7cef0a2 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "GET /compute/v2.1/servers/e09f71fe-7c54-4c43-810e-e0d79f515431" status: 200 len: 1683 microversion: 2.1 time: 0.167211 Oct 04 21:34:14.915768 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3283/6600] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:34:14 2022] GET /compute/v2.1/servers/e09f71fe-7c54-4c43-810e-e0d79f515431 => generated 1683 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:34:15.939085 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-33f255b1-d00e-4d85-8e9b-2eb4ebbaad0f tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:34:15.939651 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-33f255b1-d00e-4d85-8e9b-2eb4ebbaad0f tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: e09f71fe-7c54-4c43-810e-e0d79f515431] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:34:15.946818 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-33f255b1-d00e-4d85-8e9b-2eb4ebbaad0f tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:15.947322 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-33f255b1-d00e-4d85-8e9b-2eb4ebbaad0f tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:15.947782 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-33f255b1-d00e-4d85-8e9b-2eb4ebbaad0f tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:15.948504 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-33f255b1-d00e-4d85-8e9b-2eb4ebbaad0f tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:15.948978 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-33f255b1-d00e-4d85-8e9b-2eb4ebbaad0f tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:15.949420 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-33f255b1-d00e-4d85-8e9b-2eb4ebbaad0f tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:16.097017 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-33f255b1-d00e-4d85-8e9b-2eb4ebbaad0f tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b2b2b461354b8aa87cb19b0fb4fd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a146d50c0a544fe49bb604199bb67f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:16.104990 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-33f255b1-d00e-4d85-8e9b-2eb4ebbaad0f tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "GET /compute/v2.1/servers/e09f71fe-7c54-4c43-810e-e0d79f515431" status: 200 len: 1683 microversion: 2.1 time: 0.169905 Oct 04 21:34:16.105580 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3318/6601] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:34:15 2022] GET /compute/v2.1/servers/e09f71fe-7c54-4c43-810e-e0d79f515431 => generated 1683 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:34:17.130132 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-4b747593-cf0d-42ee-9341-b9980a2c1b06 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:34:17.131107 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-4b747593-cf0d-42ee-9341-b9980a2c1b06 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: e09f71fe-7c54-4c43-810e-e0d79f515431] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:34:17.139952 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4b747593-cf0d-42ee-9341-b9980a2c1b06 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:17.140486 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4b747593-cf0d-42ee-9341-b9980a2c1b06 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:17.140973 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4b747593-cf0d-42ee-9341-b9980a2c1b06 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:17.141761 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4b747593-cf0d-42ee-9341-b9980a2c1b06 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:17.142240 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4b747593-cf0d-42ee-9341-b9980a2c1b06 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:17.143577 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4b747593-cf0d-42ee-9341-b9980a2c1b06 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:17.381397 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-4b747593-cf0d-42ee-9341-b9980a2c1b06 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b2b2b461354b8aa87cb19b0fb4fd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a146d50c0a544fe49bb604199bb67f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:17.391258 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-4b747593-cf0d-42ee-9341-b9980a2c1b06 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "GET /compute/v2.1/servers/e09f71fe-7c54-4c43-810e-e0d79f515431" status: 200 len: 1683 microversion: 2.1 time: 0.267110 Oct 04 21:34:17.402687 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3284/6602] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:34:17 2022] GET /compute/v2.1/servers/e09f71fe-7c54-4c43-810e-e0d79f515431 => generated 1683 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:34:18.432425 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-c0983c56-a9de-4878-8705-ffe593037f46 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:34:18.432425 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-c0983c56-a9de-4878-8705-ffe593037f46 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: e09f71fe-7c54-4c43-810e-e0d79f515431] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:34:18.438696 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c0983c56-a9de-4878-8705-ffe593037f46 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:18.439315 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c0983c56-a9de-4878-8705-ffe593037f46 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:18.439723 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c0983c56-a9de-4878-8705-ffe593037f46 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:18.441070 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c0983c56-a9de-4878-8705-ffe593037f46 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:18.441540 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c0983c56-a9de-4878-8705-ffe593037f46 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:18.441982 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c0983c56-a9de-4878-8705-ffe593037f46 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:18.592797 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-c0983c56-a9de-4878-8705-ffe593037f46 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b2b2b461354b8aa87cb19b0fb4fd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a146d50c0a544fe49bb604199bb67f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:18.601476 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-c0983c56-a9de-4878-8705-ffe593037f46 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "GET /compute/v2.1/servers/e09f71fe-7c54-4c43-810e-e0d79f515431" status: 200 len: 1683 microversion: 2.1 time: 0.174399 Oct 04 21:34:18.602086 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3319/6603] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:34:18 2022] GET /compute/v2.1/servers/e09f71fe-7c54-4c43-810e-e0d79f515431 => generated 1683 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:34:19.641860 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c73f7352-bfe8-47d5-9773-bde9fafec4d1 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:34:19.642566 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c73f7352-bfe8-47d5-9773-bde9fafec4d1 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: e09f71fe-7c54-4c43-810e-e0d79f515431] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:34:19.651079 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c73f7352-bfe8-47d5-9773-bde9fafec4d1 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:19.651577 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c73f7352-bfe8-47d5-9773-bde9fafec4d1 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:19.652020 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c73f7352-bfe8-47d5-9773-bde9fafec4d1 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:19.652754 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c73f7352-bfe8-47d5-9773-bde9fafec4d1 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:19.653218 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c73f7352-bfe8-47d5-9773-bde9fafec4d1 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:19.653661 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c73f7352-bfe8-47d5-9773-bde9fafec4d1 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:19.803911 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c73f7352-bfe8-47d5-9773-bde9fafec4d1 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b2b2b461354b8aa87cb19b0fb4fd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a146d50c0a544fe49bb604199bb67f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:19.818425 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c73f7352-bfe8-47d5-9773-bde9fafec4d1 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "GET /compute/v2.1/servers/e09f71fe-7c54-4c43-810e-e0d79f515431" status: 200 len: 1683 microversion: 2.1 time: 0.180602 Oct 04 21:34:19.819315 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3285/6604] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:34:19 2022] GET /compute/v2.1/servers/e09f71fe-7c54-4c43-810e-e0d79f515431 => generated 1683 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:34:20.842806 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-15057ada-301a-4868-aff0-79b96792cd86 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:34:20.843450 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-15057ada-301a-4868-aff0-79b96792cd86 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: e09f71fe-7c54-4c43-810e-e0d79f515431] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:34:20.854143 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-15057ada-301a-4868-aff0-79b96792cd86 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:20.854694 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-15057ada-301a-4868-aff0-79b96792cd86 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:20.855155 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-15057ada-301a-4868-aff0-79b96792cd86 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:20.855921 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-15057ada-301a-4868-aff0-79b96792cd86 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:20.856820 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-15057ada-301a-4868-aff0-79b96792cd86 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:20.856981 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-15057ada-301a-4868-aff0-79b96792cd86 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:21.004509 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-15057ada-301a-4868-aff0-79b96792cd86 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b2b2b461354b8aa87cb19b0fb4fd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a146d50c0a544fe49bb604199bb67f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:21.012899 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-15057ada-301a-4868-aff0-79b96792cd86 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "GET /compute/v2.1/servers/e09f71fe-7c54-4c43-810e-e0d79f515431" status: 200 len: 1683 microversion: 2.1 time: 0.174139 Oct 04 21:34:21.013501 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3320/6605] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:34:20 2022] GET /compute/v2.1/servers/e09f71fe-7c54-4c43-810e-e0d79f515431 => generated 1683 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:34:22.037692 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9126c3b7-c7da-4b98-a1f9-e1efe019750f tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:34:22.038416 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-9126c3b7-c7da-4b98-a1f9-e1efe019750f tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: e09f71fe-7c54-4c43-810e-e0d79f515431] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:34:22.046903 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9126c3b7-c7da-4b98-a1f9-e1efe019750f tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:22.047518 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9126c3b7-c7da-4b98-a1f9-e1efe019750f tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:22.047970 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9126c3b7-c7da-4b98-a1f9-e1efe019750f tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:22.048721 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9126c3b7-c7da-4b98-a1f9-e1efe019750f tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:22.049172 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9126c3b7-c7da-4b98-a1f9-e1efe019750f tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:22.049612 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9126c3b7-c7da-4b98-a1f9-e1efe019750f tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:22.243215 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-9126c3b7-c7da-4b98-a1f9-e1efe019750f tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b2b2b461354b8aa87cb19b0fb4fd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a146d50c0a544fe49bb604199bb67f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:22.258135 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-9126c3b7-c7da-4b98-a1f9-e1efe019750f tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "GET /compute/v2.1/servers/e09f71fe-7c54-4c43-810e-e0d79f515431" status: 200 len: 1682 microversion: 2.1 time: 0.224544 Oct 04 21:34:22.259261 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3286/6606] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:34:22 2022] GET /compute/v2.1/servers/e09f71fe-7c54-4c43-810e-e0d79f515431 => generated 1682 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:34:22.312963 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-1a26f085-c4dc-4d61-bd32-82082701a7e5 req-e61c8d73-3af8-4f30-b138-55c430c83763 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e09f71fe-7c54-4c43-810e-e0d79f515431", "name": "network-vif-unplugged", "status": "completed", "tag": "15207f9a-b9ae-41c5-a11a-02199281af2a"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:34:22.332138 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-1a26f085-c4dc-4d61-bd32-82082701a7e5 req-e61c8d73-3af8-4f30-b138-55c430c83763 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:22.332769 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-1a26f085-c4dc-4d61-bd32-82082701a7e5 req-e61c8d73-3af8-4f30-b138-55c430c83763 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:22.333418 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-1a26f085-c4dc-4d61-bd32-82082701a7e5 req-e61c8d73-3af8-4f30-b138-55c430c83763 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:22.346634 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-1a26f085-c4dc-4d61-bd32-82082701a7e5 req-e61c8d73-3af8-4f30-b138-55c430c83763 service nova] Creating event network-vif-unplugged:15207f9a-b9ae-41c5-a11a-02199281af2a for instance e09f71fe-7c54-4c43-810e-e0d79f515431 on n-h1-854823-8 Oct 04 21:34:22.353174 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [req-1a26f085-c4dc-4d61-bd32-82082701a7e5 req-e61c8d73-3af8-4f30-b138-55c430c83763 service nova] Instance e09f71fe-7c54-4c43-810e-e0d79f515431 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854823-8', 'n-h2-854823-8'} {{(pid=128802) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 21:34:22.367638 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-1a26f085-c4dc-4d61-bd32-82082701a7e5 req-e61c8d73-3af8-4f30-b138-55c430c83763 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.061776 Oct 04 21:34:22.368303 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3321/6607] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:34:22 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:34:23.287125 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-18654674-744a-41e4-81c3-10fd7d9940a9 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:34:23.288010 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-18654674-744a-41e4-81c3-10fd7d9940a9 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: e09f71fe-7c54-4c43-810e-e0d79f515431] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:34:23.295287 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-18654674-744a-41e4-81c3-10fd7d9940a9 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:23.295784 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-18654674-744a-41e4-81c3-10fd7d9940a9 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:23.296223 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-18654674-744a-41e4-81c3-10fd7d9940a9 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:23.296940 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-18654674-744a-41e4-81c3-10fd7d9940a9 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:23.297401 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-18654674-744a-41e4-81c3-10fd7d9940a9 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:23.297830 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-18654674-744a-41e4-81c3-10fd7d9940a9 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:23.465625 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-18654674-744a-41e4-81c3-10fd7d9940a9 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b2b2b461354b8aa87cb19b0fb4fd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a146d50c0a544fe49bb604199bb67f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:23.474738 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-18654674-744a-41e4-81c3-10fd7d9940a9 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "GET /compute/v2.1/servers/e09f71fe-7c54-4c43-810e-e0d79f515431" status: 200 len: 1682 microversion: 2.1 time: 0.192027 Oct 04 21:34:23.475359 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3287/6608] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:34:23 2022] GET /compute/v2.1/servers/e09f71fe-7c54-4c43-810e-e0d79f515431 => generated 1682 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:34:24.386419 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-19442dc5-3076-4a79-9211-fdefd8459535 req-f9fe51d0-d561-4710-819c-b16aba889aea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e09f71fe-7c54-4c43-810e-e0d79f515431", "tag": "15207f9a-b9ae-41c5-a11a-02199281af2a"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:34:24.396630 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-19442dc5-3076-4a79-9211-fdefd8459535 req-f9fe51d0-d561-4710-819c-b16aba889aea service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:24.397117 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-19442dc5-3076-4a79-9211-fdefd8459535 req-f9fe51d0-d561-4710-819c-b16aba889aea service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:24.397553 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-19442dc5-3076-4a79-9211-fdefd8459535 req-f9fe51d0-d561-4710-819c-b16aba889aea service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:24.409999 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-19442dc5-3076-4a79-9211-fdefd8459535 req-f9fe51d0-d561-4710-819c-b16aba889aea service nova] Creating event network-changed:15207f9a-b9ae-41c5-a11a-02199281af2a for instance e09f71fe-7c54-4c43-810e-e0d79f515431 on n-h1-854823-8 Oct 04 21:34:24.415752 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [req-19442dc5-3076-4a79-9211-fdefd8459535 req-f9fe51d0-d561-4710-819c-b16aba889aea service nova] Instance e09f71fe-7c54-4c43-810e-e0d79f515431 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854823-8', 'n-h2-854823-8'} {{(pid=128802) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 21:34:24.428018 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-19442dc5-3076-4a79-9211-fdefd8459535 req-f9fe51d0-d561-4710-819c-b16aba889aea service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046457 Oct 04 21:34:24.428937 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3322/6609] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:34:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:34:24.513165 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d3c829de-9b00-4220-babc-de128bf1d593 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:34:24.514205 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d3c829de-9b00-4220-babc-de128bf1d593 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: e09f71fe-7c54-4c43-810e-e0d79f515431] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:34:24.523163 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d3c829de-9b00-4220-babc-de128bf1d593 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:24.523334 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d3c829de-9b00-4220-babc-de128bf1d593 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:24.523993 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d3c829de-9b00-4220-babc-de128bf1d593 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:24.524954 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d3c829de-9b00-4220-babc-de128bf1d593 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:24.525491 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d3c829de-9b00-4220-babc-de128bf1d593 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:24.525992 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d3c829de-9b00-4220-babc-de128bf1d593 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:24.795847 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d3c829de-9b00-4220-babc-de128bf1d593 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b2b2b461354b8aa87cb19b0fb4fd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a146d50c0a544fe49bb604199bb67f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:24.807548 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d3c829de-9b00-4220-babc-de128bf1d593 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "GET /compute/v2.1/servers/e09f71fe-7c54-4c43-810e-e0d79f515431" status: 200 len: 1680 microversion: 2.1 time: 0.298797 Oct 04 21:34:24.808268 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3288/6610] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:34:24 2022] GET /compute/v2.1/servers/e09f71fe-7c54-4c43-810e-e0d79f515431 => generated 1680 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:34:25.838162 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-5fa1c7c0-bb79-4023-8f0e-3a4189a4123f tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:34:25.839562 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-5fa1c7c0-bb79-4023-8f0e-3a4189a4123f tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: e09f71fe-7c54-4c43-810e-e0d79f515431] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:34:25.853162 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5fa1c7c0-bb79-4023-8f0e-3a4189a4123f tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:25.854131 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5fa1c7c0-bb79-4023-8f0e-3a4189a4123f tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:25.855037 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5fa1c7c0-bb79-4023-8f0e-3a4189a4123f tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:25.856578 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5fa1c7c0-bb79-4023-8f0e-3a4189a4123f tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:25.857310 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5fa1c7c0-bb79-4023-8f0e-3a4189a4123f tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:25.858118 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5fa1c7c0-bb79-4023-8f0e-3a4189a4123f tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:26.047968 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-5fa1c7c0-bb79-4023-8f0e-3a4189a4123f tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b2b2b461354b8aa87cb19b0fb4fd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a146d50c0a544fe49bb604199bb67f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:26.063003 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-5fa1c7c0-bb79-4023-8f0e-3a4189a4123f tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "GET /compute/v2.1/servers/e09f71fe-7c54-4c43-810e-e0d79f515431" status: 200 len: 1677 microversion: 2.1 time: 0.233428 Oct 04 21:34:26.064092 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3323/6611] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:34:25 2022] GET /compute/v2.1/servers/e09f71fe-7c54-4c43-810e-e0d79f515431 => generated 1677 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:34:26.108052 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-04634ed5-a7ee-4043-9cf7-58bd3839b55e tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:34:26.108925 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-04634ed5-a7ee-4043-9cf7-58bd3839b55e tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: e09f71fe-7c54-4c43-810e-e0d79f515431] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:34:26.120471 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-04634ed5-a7ee-4043-9cf7-58bd3839b55e tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:26.120980 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-04634ed5-a7ee-4043-9cf7-58bd3839b55e tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:26.121416 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-04634ed5-a7ee-4043-9cf7-58bd3839b55e tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:26.122160 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-04634ed5-a7ee-4043-9cf7-58bd3839b55e tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:26.122647 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-04634ed5-a7ee-4043-9cf7-58bd3839b55e tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:26.123084 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-04634ed5-a7ee-4043-9cf7-58bd3839b55e tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:26.192446 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-04634ed5-a7ee-4043-9cf7-58bd3839b55e tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "POST /compute/v2.1/servers/e09f71fe-7c54-4c43-810e-e0d79f515431/action" status: 204 len: 0 microversion: 2.1 time: 0.092404 Oct 04 21:34:26.193344 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3289/6612] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 21:34:26 2022] POST /compute/v2.1/servers/e09f71fe-7c54-4c43-810e-e0d79f515431/action => generated 0 bytes in 94 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:34:26.202141 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-4d5545e8-b1a0-43af-ab78-c1e3cc6da250 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:34:26.203248 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-4d5545e8-b1a0-43af-ab78-c1e3cc6da250 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: e09f71fe-7c54-4c43-810e-e0d79f515431] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:34:26.213886 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4d5545e8-b1a0-43af-ab78-c1e3cc6da250 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:26.215315 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4d5545e8-b1a0-43af-ab78-c1e3cc6da250 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:26.216321 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4d5545e8-b1a0-43af-ab78-c1e3cc6da250 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:26.217825 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4d5545e8-b1a0-43af-ab78-c1e3cc6da250 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:26.218832 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4d5545e8-b1a0-43af-ab78-c1e3cc6da250 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:26.219751 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4d5545e8-b1a0-43af-ab78-c1e3cc6da250 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:26.501646 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-4d5545e8-b1a0-43af-ab78-c1e3cc6da250 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b2b2b461354b8aa87cb19b0fb4fd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a146d50c0a544fe49bb604199bb67f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:26.510620 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-4d5545e8-b1a0-43af-ab78-c1e3cc6da250 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "GET /compute/v2.1/servers/e09f71fe-7c54-4c43-810e-e0d79f515431" status: 200 len: 1677 microversion: 2.1 time: 0.312482 Oct 04 21:34:26.511472 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3324/6613] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:34:26 2022] GET /compute/v2.1/servers/e09f71fe-7c54-4c43-810e-e0d79f515431 => generated 1677 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:34:27.508527 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-fed1e2ed-6e3e-40e3-833f-ffb34c8059f4 req-37f8e4f6-2907-487a-a6f8-468cc3ba16f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e09f71fe-7c54-4c43-810e-e0d79f515431", "name": "network-vif-plugged", "status": "completed", "tag": "15207f9a-b9ae-41c5-a11a-02199281af2a"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:34:27.519678 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-fed1e2ed-6e3e-40e3-833f-ffb34c8059f4 req-37f8e4f6-2907-487a-a6f8-468cc3ba16f9 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:27.520213 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-fed1e2ed-6e3e-40e3-833f-ffb34c8059f4 req-37f8e4f6-2907-487a-a6f8-468cc3ba16f9 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:27.520629 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-fed1e2ed-6e3e-40e3-833f-ffb34c8059f4 req-37f8e4f6-2907-487a-a6f8-468cc3ba16f9 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:27.538741 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-fed1e2ed-6e3e-40e3-833f-ffb34c8059f4 req-37f8e4f6-2907-487a-a6f8-468cc3ba16f9 service nova] Creating event network-vif-plugged:15207f9a-b9ae-41c5-a11a-02199281af2a for instance e09f71fe-7c54-4c43-810e-e0d79f515431 on n-h1-854823-8 Oct 04 21:34:27.542710 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-d2711629-2510-405e-a58a-f6b57efa151d tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:34:27.545124 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-d2711629-2510-405e-a58a-f6b57efa151d tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: e09f71fe-7c54-4c43-810e-e0d79f515431] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:34:27.546100 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [req-fed1e2ed-6e3e-40e3-833f-ffb34c8059f4 req-37f8e4f6-2907-487a-a6f8-468cc3ba16f9 service nova] Instance e09f71fe-7c54-4c43-810e-e0d79f515431 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854823-8', 'n-h2-854823-8'} {{(pid=128801) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 21:34:27.565487 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d2711629-2510-405e-a58a-f6b57efa151d tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:27.565814 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-fed1e2ed-6e3e-40e3-833f-ffb34c8059f4 req-37f8e4f6-2907-487a-a6f8-468cc3ba16f9 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062300 Oct 04 21:34:27.567526 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3290/6614] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:34:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:34:27.567905 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d2711629-2510-405e-a58a-f6b57efa151d tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:27.571263 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d2711629-2510-405e-a58a-f6b57efa151d tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:27.573540 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d2711629-2510-405e-a58a-f6b57efa151d tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:27.575032 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d2711629-2510-405e-a58a-f6b57efa151d tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:27.576330 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d2711629-2510-405e-a58a-f6b57efa151d tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:27.763219 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-d2711629-2510-405e-a58a-f6b57efa151d tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b2b2b461354b8aa87cb19b0fb4fd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a146d50c0a544fe49bb604199bb67f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:27.772910 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-d2711629-2510-405e-a58a-f6b57efa151d tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "GET /compute/v2.1/servers/e09f71fe-7c54-4c43-810e-e0d79f515431" status: 200 len: 1677 microversion: 2.1 time: 0.240260 Oct 04 21:34:27.773689 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3325/6615] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:34:27 2022] GET /compute/v2.1/servers/e09f71fe-7c54-4c43-810e-e0d79f515431 => generated 1677 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:34:28.799173 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1c7c2dc4-1e73-4146-9da5-0017e1f1c2a1 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:34:28.800140 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-1c7c2dc4-1e73-4146-9da5-0017e1f1c2a1 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: e09f71fe-7c54-4c43-810e-e0d79f515431] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:34:28.807061 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1c7c2dc4-1e73-4146-9da5-0017e1f1c2a1 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:28.807559 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1c7c2dc4-1e73-4146-9da5-0017e1f1c2a1 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:28.808001 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1c7c2dc4-1e73-4146-9da5-0017e1f1c2a1 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:28.808715 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1c7c2dc4-1e73-4146-9da5-0017e1f1c2a1 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:28.809181 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1c7c2dc4-1e73-4146-9da5-0017e1f1c2a1 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:28.809609 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1c7c2dc4-1e73-4146-9da5-0017e1f1c2a1 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:28.964515 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-1c7c2dc4-1e73-4146-9da5-0017e1f1c2a1 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b2b2b461354b8aa87cb19b0fb4fd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a146d50c0a544fe49bb604199bb67f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:28.973305 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-1c7c2dc4-1e73-4146-9da5-0017e1f1c2a1 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "GET /compute/v2.1/servers/e09f71fe-7c54-4c43-810e-e0d79f515431" status: 200 len: 1669 microversion: 2.1 time: 0.179829 Oct 04 21:34:28.973893 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3291/6616] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:34:28 2022] GET /compute/v2.1/servers/e09f71fe-7c54-4c43-810e-e0d79f515431 => generated 1669 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:34:28.998755 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-c70a6aee-7124-4f4f-8cdb-a258a1050d8b tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:34:28.999393 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-c70a6aee-7124-4f4f-8cdb-a258a1050d8b tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: e09f71fe-7c54-4c43-810e-e0d79f515431] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:34:29.005666 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c70a6aee-7124-4f4f-8cdb-a258a1050d8b tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:29.006171 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c70a6aee-7124-4f4f-8cdb-a258a1050d8b tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:29.006679 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c70a6aee-7124-4f4f-8cdb-a258a1050d8b tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:29.007394 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c70a6aee-7124-4f4f-8cdb-a258a1050d8b tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:29.007859 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c70a6aee-7124-4f4f-8cdb-a258a1050d8b tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:29.008290 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c70a6aee-7124-4f4f-8cdb-a258a1050d8b tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:29.146496 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-c70a6aee-7124-4f4f-8cdb-a258a1050d8b tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b2b2b461354b8aa87cb19b0fb4fd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a146d50c0a544fe49bb604199bb67f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:29.154564 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-c70a6aee-7124-4f4f-8cdb-a258a1050d8b tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "GET /compute/v2.1/servers/e09f71fe-7c54-4c43-810e-e0d79f515431" status: 200 len: 1669 microversion: 2.1 time: 0.160726 Oct 04 21:34:29.155178 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3326/6617] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:34:28 2022] GET /compute/v2.1/servers/e09f71fe-7c54-4c43-810e-e0d79f515431 => generated 1669 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:34:29.178132 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f2df51a4-462a-4a76-9a07-45d51fab06c1 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:34:29.179037 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f2df51a4-462a-4a76-9a07-45d51fab06c1 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: e09f71fe-7c54-4c43-810e-e0d79f515431] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:34:29.185068 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f2df51a4-462a-4a76-9a07-45d51fab06c1 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:29.185556 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f2df51a4-462a-4a76-9a07-45d51fab06c1 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:29.185991 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f2df51a4-462a-4a76-9a07-45d51fab06c1 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:29.186723 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f2df51a4-462a-4a76-9a07-45d51fab06c1 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:29.187184 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f2df51a4-462a-4a76-9a07-45d51fab06c1 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:29.187613 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f2df51a4-462a-4a76-9a07-45d51fab06c1 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:29.330852 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f2df51a4-462a-4a76-9a07-45d51fab06c1 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b2b2b461354b8aa87cb19b0fb4fd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a146d50c0a544fe49bb604199bb67f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:29.339022 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f2df51a4-462a-4a76-9a07-45d51fab06c1 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "GET /compute/v2.1/servers/e09f71fe-7c54-4c43-810e-e0d79f515431" status: 200 len: 1669 microversion: 2.1 time: 0.165539 Oct 04 21:34:29.339607 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3292/6618] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:34:29 2022] GET /compute/v2.1/servers/e09f71fe-7c54-4c43-810e-e0d79f515431 => generated 1669 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:34:29.362712 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-768477fa-c3bf-443d-9187-5d0d74f1a9e1 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:34:29.363229 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-768477fa-c3bf-443d-9187-5d0d74f1a9e1 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: e09f71fe-7c54-4c43-810e-e0d79f515431] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:34:29.369363 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-768477fa-c3bf-443d-9187-5d0d74f1a9e1 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:29.369864 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-768477fa-c3bf-443d-9187-5d0d74f1a9e1 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:29.370320 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-768477fa-c3bf-443d-9187-5d0d74f1a9e1 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:29.371066 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-768477fa-c3bf-443d-9187-5d0d74f1a9e1 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:29.371536 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-768477fa-c3bf-443d-9187-5d0d74f1a9e1 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:29.371987 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-768477fa-c3bf-443d-9187-5d0d74f1a9e1 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:29.399322 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-768477fa-c3bf-443d-9187-5d0d74f1a9e1 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: e09f71fe-7c54-4c43-810e-e0d79f515431] Going to try to terminate instance {{(pid=128802) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:34:29.435892 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:34:29.485401 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-768477fa-c3bf-443d-9187-5d0d74f1a9e1 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "DELETE /compute/v2.1/servers/e09f71fe-7c54-4c43-810e-e0d79f515431" status: 204 len: 0 microversion: 2.1 time: 0.127202 Oct 04 21:34:29.486022 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3327/6619] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 21:34:29 2022] DELETE /compute/v2.1/servers/e09f71fe-7c54-4c43-810e-e0d79f515431 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:34:29.495303 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2eef0673-1b3d-45b5-8139-8330e995b29b tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:34:29.495929 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-2eef0673-1b3d-45b5-8139-8330e995b29b tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: e09f71fe-7c54-4c43-810e-e0d79f515431] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:34:29.502667 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2eef0673-1b3d-45b5-8139-8330e995b29b tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:29.503170 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2eef0673-1b3d-45b5-8139-8330e995b29b tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:29.503737 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2eef0673-1b3d-45b5-8139-8330e995b29b tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:29.504499 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2eef0673-1b3d-45b5-8139-8330e995b29b tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:29.504961 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2eef0673-1b3d-45b5-8139-8330e995b29b tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:29.505397 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2eef0673-1b3d-45b5-8139-8330e995b29b tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:29.646979 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-2eef0673-1b3d-45b5-8139-8330e995b29b tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b2b2b461354b8aa87cb19b0fb4fd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a146d50c0a544fe49bb604199bb67f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:29.649376 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:34:29.657061 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-2eef0673-1b3d-45b5-8139-8330e995b29b tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "GET /compute/v2.1/servers/e09f71fe-7c54-4c43-810e-e0d79f515431" status: 200 len: 1675 microversion: 2.1 time: 0.165679 Oct 04 21:34:29.657645 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3293/6620] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:34:29 2022] GET /compute/v2.1/servers/e09f71fe-7c54-4c43-810e-e0d79f515431 => generated 1675 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:34:30.693526 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-f32b6546-29aa-439f-bac6-e031bed6ce31 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:34:30.694185 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-f32b6546-29aa-439f-bac6-e031bed6ce31 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: e09f71fe-7c54-4c43-810e-e0d79f515431] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:34:30.701132 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f32b6546-29aa-439f-bac6-e031bed6ce31 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:30.701632 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f32b6546-29aa-439f-bac6-e031bed6ce31 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:30.702081 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f32b6546-29aa-439f-bac6-e031bed6ce31 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:30.702833 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f32b6546-29aa-439f-bac6-e031bed6ce31 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:30.703299 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f32b6546-29aa-439f-bac6-e031bed6ce31 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:30.703734 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f32b6546-29aa-439f-bac6-e031bed6ce31 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:30.848476 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-f32b6546-29aa-439f-bac6-e031bed6ce31 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b2b2b461354b8aa87cb19b0fb4fd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a146d50c0a544fe49bb604199bb67f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:30.856484 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-f32b6546-29aa-439f-bac6-e031bed6ce31 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "GET /compute/v2.1/servers/e09f71fe-7c54-4c43-810e-e0d79f515431" status: 200 len: 1675 microversion: 2.1 time: 0.168159 Oct 04 21:34:30.857084 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3328/6621] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:34:30 2022] GET /compute/v2.1/servers/e09f71fe-7c54-4c43-810e-e0d79f515431 => generated 1675 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:34:31.880742 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-548f7ebb-153a-4967-81a3-a3d834a8be7e tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:34:31.881510 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-548f7ebb-153a-4967-81a3-a3d834a8be7e tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: e09f71fe-7c54-4c43-810e-e0d79f515431] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:34:31.889455 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-548f7ebb-153a-4967-81a3-a3d834a8be7e tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:31.889960 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-548f7ebb-153a-4967-81a3-a3d834a8be7e tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:31.890441 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-548f7ebb-153a-4967-81a3-a3d834a8be7e tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:31.891180 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-548f7ebb-153a-4967-81a3-a3d834a8be7e tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:31.892494 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-548f7ebb-153a-4967-81a3-a3d834a8be7e tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:31.892494 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-548f7ebb-153a-4967-81a3-a3d834a8be7e tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:31.952720 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-92f37ab1-bbfe-44d6-bffc-504aa7ef6d99 req-dbf03dcb-2c87-4427-9b73-ff6aebec206a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e09f71fe-7c54-4c43-810e-e0d79f515431", "name": "network-vif-deleted", "tag": "15207f9a-b9ae-41c5-a11a-02199281af2a"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:34:31.967322 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-92f37ab1-bbfe-44d6-bffc-504aa7ef6d99 req-dbf03dcb-2c87-4427-9b73-ff6aebec206a service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:31.968140 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-92f37ab1-bbfe-44d6-bffc-504aa7ef6d99 req-dbf03dcb-2c87-4427-9b73-ff6aebec206a service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:31.968797 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-92f37ab1-bbfe-44d6-bffc-504aa7ef6d99 req-dbf03dcb-2c87-4427-9b73-ff6aebec206a service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:31.983358 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-92f37ab1-bbfe-44d6-bffc-504aa7ef6d99 req-dbf03dcb-2c87-4427-9b73-ff6aebec206a service nova] Creating event network-vif-deleted:15207f9a-b9ae-41c5-a11a-02199281af2a for instance e09f71fe-7c54-4c43-810e-e0d79f515431 on n-h1-854823-8 Oct 04 21:34:31.990206 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-92f37ab1-bbfe-44d6-bffc-504aa7ef6d99 req-dbf03dcb-2c87-4427-9b73-ff6aebec206a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041302 Oct 04 21:34:31.991376 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3329/6622] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:34:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:34:32.002145 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-548f7ebb-153a-4967-81a3-a3d834a8be7e tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b2b2b461354b8aa87cb19b0fb4fd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a146d50c0a544fe49bb604199bb67f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:32.011146 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-548f7ebb-153a-4967-81a3-a3d834a8be7e tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "GET /compute/v2.1/servers/e09f71fe-7c54-4c43-810e-e0d79f515431" status: 200 len: 1607 microversion: 2.1 time: 0.134741 Oct 04 21:34:32.012311 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3294/6623] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:34:31 2022] GET /compute/v2.1/servers/e09f71fe-7c54-4c43-810e-e0d79f515431 => generated 1607 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:34:33.037591 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-bc45f299-0b88-49a7-90b8-43edfd35cf68 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:34:33.039127 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-bc45f299-0b88-49a7-90b8-43edfd35cf68 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: e09f71fe-7c54-4c43-810e-e0d79f515431] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:34:33.050196 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bc45f299-0b88-49a7-90b8-43edfd35cf68 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:33.050748 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bc45f299-0b88-49a7-90b8-43edfd35cf68 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:33.051476 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bc45f299-0b88-49a7-90b8-43edfd35cf68 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:33.052655 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bc45f299-0b88-49a7-90b8-43edfd35cf68 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:33.053140 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bc45f299-0b88-49a7-90b8-43edfd35cf68 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:33.053843 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bc45f299-0b88-49a7-90b8-43edfd35cf68 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:33.079359 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.wsgi [None req-bc45f299-0b88-49a7-90b8-43edfd35cf68 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] HTTP exception thrown: Instance e09f71fe-7c54-4c43-810e-e0d79f515431 could not be found. Oct 04 21:34:33.082450 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-bc45f299-0b88-49a7-90b8-43edfd35cf68 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Request method failure captured: Oct 04 21:34:33.082450 n-d-854823-8 devstack@n-api.service[128802]: request: GET /compute/v2.1/servers/e09f71fe-7c54-4c43-810e-e0d79f515431 HTTP/1.1 Oct 04 21:34:33.082450 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 21:34:33.082450 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 21:34:33.082450 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 21:34:33.082450 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 0 Oct 04 21:34:33.082450 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 21:34:33.082450 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 21:34:33.082450 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 21:34:33.082450 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 21:34:33.082450 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPKacG3zmlzrE0P03sqhhW8OxTX_N5d4FutccVYa--DxtxvF117E3y03wDG1eWqGIT6xlYZQeTInymX9iqEa1Cn-51caF2pJGBCFnPr7M2Ci1V2diBL1LhxAMFh-0O2THqSMgkeX7lBKNpS2ImrBtoud6Asim3w37JGPDnCp2IjwWzIw Oct 04 21:34:33.082450 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 21:34:33.082450 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 21:34:33.082450 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 21:34:33.082450 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 21:34:33.082450 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 21:34:33.082450 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 21:34:33.082450 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: a146d50c0a544fe49bb604199bb67f02 Oct 04 21:34:33.082450 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-ServerActionsTestJSON-1365673639 Oct 04 21:34:33.082450 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 21:34:33.082450 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 21:34:33.082450 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a146d50c0a544fe49bb604199bb67f02", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a146d50c0a544fe49bb604199bb67f02"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a146d50c0a544fe49bb604199bb67f02"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a146d50c0a544fe49bb604199bb67f02"}]}] Oct 04 21:34:33.082450 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-ServerActionsTestJSON-1365673639 Oct 04 21:34:33.082450 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: a146d50c0a544fe49bb604199bb67f02 Oct 04 21:34:33.082450 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-ServerActionsTestJSON-1365673639 Oct 04 21:34:33.082450 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-ServerActionsTestJSON-1365673639-project Oct 04 21:34:33.082450 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 21:34:33.082450 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 21:34:33.082450 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: a2b2b2b461354b8aa87cb19b0fb4fd28 Oct 04 21:34:33.082450 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-ServerActionsTestJSON-1365673639-project Oct 04 21:34:33.082450 n-d-854823-8 devstack@n-api.service[128802]: method: > Oct 04 21:34:33.082450 n-d-854823-8 devstack@n-api.service[128802]: exception: Instance e09f71fe-7c54-4c43-810e-e0d79f515431 could not be found. Oct 04 21:34:33.082450 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'id': 'e09f71fe-7c54-4c43-810e-e0d79f515431'} Oct 04 21:34:33.082450 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:34:33.082450 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:34:33.082450 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:34:33.082450 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:34:33.082450 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:34:33.082450 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:34:33.082450 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:34:33.082450 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:34:33.082450 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:34:33.082450 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:34:33.082450 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e09f71fe-7c54-4c43-810e-e0d79f515431 could not be found. Oct 04 21:34:33.082450 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:34:33.082450 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:34:33.082450 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:34:33.082450 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:34:33.082450 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:34:33.082450 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:34:33.082450 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:34:33.082450 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:34:33.082450 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:34:33.082450 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:34:33.082450 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:34:33.082450 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:34:33.082450 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:34:33.082450 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:34:33.082450 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:34:33.082450 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:34:33.082450 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e09f71fe-7c54-4c43-810e-e0d79f515431 could not be found. Oct 04 21:34:33.082450 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:34:33.082450 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:34:33.082450 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:34:33.089615 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:34:33.089615 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:34:33.089615 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:34:33.089615 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:34:33.089615 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:34:33.089615 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e09f71fe-7c54-4c43-810e-e0d79f515431 could not be found. Oct 04 21:34:33.089615 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:34:33.089615 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-bc45f299-0b88-49a7-90b8-43edfd35cf68 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Returning 404 to user: Instance e09f71fe-7c54-4c43-810e-e0d79f515431 could not be found. {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:34:33.089615 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-bc45f299-0b88-49a7-90b8-43edfd35cf68 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "GET /compute/v2.1/servers/e09f71fe-7c54-4c43-810e-e0d79f515431" status: 404 len: 111 microversion: 2.1 time: 0.053219 Oct 04 21:34:33.089615 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3330/6624] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:34:33 2022] GET /compute/v2.1/servers/e09f71fe-7c54-4c43-810e-e0d79f515431 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:34:33.101646 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0880105e-df17-4602-aec3-437789b8d4ae tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:34:33.102316 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-0880105e-df17-4602-aec3-437789b8d4ae tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: e09f71fe-7c54-4c43-810e-e0d79f515431] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:34:33.109676 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0880105e-df17-4602-aec3-437789b8d4ae tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:33.110177 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0880105e-df17-4602-aec3-437789b8d4ae tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:33.110733 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0880105e-df17-4602-aec3-437789b8d4ae tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:33.112029 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0880105e-df17-4602-aec3-437789b8d4ae tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:33.113201 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0880105e-df17-4602-aec3-437789b8d4ae tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:33.113715 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0880105e-df17-4602-aec3-437789b8d4ae tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:33.134298 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-0880105e-df17-4602-aec3-437789b8d4ae tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] HTTP exception thrown: Instance e09f71fe-7c54-4c43-810e-e0d79f515431 could not be found. Oct 04 21:34:33.138726 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0880105e-df17-4602-aec3-437789b8d4ae tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Request method failure captured: Oct 04 21:34:33.138726 n-d-854823-8 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/e09f71fe-7c54-4c43-810e-e0d79f515431 HTTP/1.1 Oct 04 21:34:33.138726 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 21:34:33.138726 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 21:34:33.138726 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 21:34:33.138726 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 0 Oct 04 21:34:33.138726 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 21:34:33.138726 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 21:34:33.138726 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 21:34:33.138726 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 21:34:33.138726 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPKacG3zmlzrE0P03sqhhW8OxTX_N5d4FutccVYa--DxtxvF117E3y03wDG1eWqGIT6xlYZQeTInymX9iqEa1Cn-51caF2pJGBCFnPr7M2Ci1V2diBL1LhxAMFh-0O2THqSMgkeX7lBKNpS2ImrBtoud6Asim3w37JGPDnCp2IjwWzIw Oct 04 21:34:33.138726 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 21:34:33.138726 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 21:34:33.138726 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 21:34:33.138726 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 21:34:33.138726 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 21:34:33.138726 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 21:34:33.138726 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: a146d50c0a544fe49bb604199bb67f02 Oct 04 21:34:33.138726 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-ServerActionsTestJSON-1365673639 Oct 04 21:34:33.138726 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 21:34:33.138726 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 21:34:33.138726 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a146d50c0a544fe49bb604199bb67f02", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a146d50c0a544fe49bb604199bb67f02"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a146d50c0a544fe49bb604199bb67f02"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a146d50c0a544fe49bb604199bb67f02"}]}] Oct 04 21:34:33.138726 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-ServerActionsTestJSON-1365673639 Oct 04 21:34:33.138726 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: a146d50c0a544fe49bb604199bb67f02 Oct 04 21:34:33.138726 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ServerActionsTestJSON-1365673639 Oct 04 21:34:33.138726 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-ServerActionsTestJSON-1365673639-project Oct 04 21:34:33.138726 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 21:34:33.138726 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 21:34:33.138726 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: a2b2b2b461354b8aa87cb19b0fb4fd28 Oct 04 21:34:33.138726 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-ServerActionsTestJSON-1365673639-project Oct 04 21:34:33.138726 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 21:34:33.138726 n-d-854823-8 devstack@n-api.service[128801]: exception: Instance e09f71fe-7c54-4c43-810e-e0d79f515431 could not be found. Oct 04 21:34:33.138726 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': 'e09f71fe-7c54-4c43-810e-e0d79f515431'} Oct 04 21:34:33.138726 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:34:33.138726 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:34:33.138726 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:34:33.138726 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:34:33.138726 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:34:33.138726 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:34:33.138726 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:34:33.138726 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:34:33.138726 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:34:33.138726 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:34:33.138726 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e09f71fe-7c54-4c43-810e-e0d79f515431 could not be found. Oct 04 21:34:33.138726 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:34:33.138726 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:34:33.138726 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:34:33.138726 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:34:33.138726 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:34:33.138726 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:34:33.138726 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:34:33.138726 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:34:33.138726 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:34:33.138726 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:34:33.138726 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:34:33.138726 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:34:33.138726 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:34:33.138726 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:34:33.138726 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:34:33.138726 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:34:33.138726 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e09f71fe-7c54-4c43-810e-e0d79f515431 could not be found. Oct 04 21:34:33.138726 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:34:33.138726 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:34:33.138726 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:34:33.151959 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:34:33.151959 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:34:33.151959 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:34:33.151959 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:34:33.151959 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:34:33.151959 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e09f71fe-7c54-4c43-810e-e0d79f515431 could not be found. Oct 04 21:34:33.151959 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:34:33.151959 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0880105e-df17-4602-aec3-437789b8d4ae tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Returning 404 to user: Instance e09f71fe-7c54-4c43-810e-e0d79f515431 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:34:33.151959 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-0880105e-df17-4602-aec3-437789b8d4ae tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "GET /compute/v2.1/servers/e09f71fe-7c54-4c43-810e-e0d79f515431" status: 404 len: 111 microversion: 2.1 time: 0.044662 Oct 04 21:34:33.151959 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3295/6625] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:34:33 2022] GET /compute/v2.1/servers/e09f71fe-7c54-4c43-810e-e0d79f515431 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 21:34:33.204660 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-1f37e75d-b59f-4943-8f77-67e4d8fb016a tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-83512877", "imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63", "flavorRef": "452", "networks": [{"uuid": "be02f5cd-2d7d-418b-9089-057dd1d5b96e"}], "security_groups": [{"name": "tempest-securitygroup--1075800401"}], "key_name": "tempest-keypair-1781922112", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:34:33.347335 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.network.neutron [None req-1f37e75d-b59f-4943-8f77-67e4d8fb016a tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] validate_networks() for [('be02f5cd-2d7d-418b-9089-057dd1d5b96e', None, None, None, None, None)] {{(pid=128802) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:34:33.774823 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-1f37e75d-b59f-4943-8f77-67e4d8fb016a tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Flavor limits 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:34:33.775373 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-1f37e75d-b59f-4943-8f77-67e4d8fb016a tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Image limits 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:34:33.775887 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-1f37e75d-b59f-4943-8f77-67e4d8fb016a tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Flavor pref 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:34:33.776311 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-1f37e75d-b59f-4943-8f77-67e4d8fb016a tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Image pref 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:34:33.776732 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-1f37e75d-b59f-4943-8f77-67e4d8fb016a tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:34:33.786363 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1f37e75d-b59f-4943-8f77-67e4d8fb016a tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:33.786862 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1f37e75d-b59f-4943-8f77-67e4d8fb016a tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:33.787316 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1f37e75d-b59f-4943-8f77-67e4d8fb016a tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:33.788038 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1f37e75d-b59f-4943-8f77-67e4d8fb016a tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:33.788501 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1f37e75d-b59f-4943-8f77-67e4d8fb016a tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:33.788932 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1f37e75d-b59f-4943-8f77-67e4d8fb016a tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:33.808970 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-1f37e75d-b59f-4943-8f77-67e4d8fb016a tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Getting quotas for project a146d50c0a544fe49bb604199bb67f02. Resources: {'ram', 'instances', 'cores'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:34:33.815465 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-1f37e75d-b59f-4943-8f77-67e4d8fb016a tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Getting quotas for user a2b2b2b461354b8aa87cb19b0fb4fd28 and project a146d50c0a544fe49bb604199bb67f02. Resources: {'ram', 'instances', 'cores'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:34:33.828744 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-1f37e75d-b59f-4943-8f77-67e4d8fb016a tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Going to run 1 instances... {{(pid=128802) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:34:33.831734 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-1f37e75d-b59f-4943-8f77-67e4d8fb016a tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: 614f1ce2-fde0-40a8-b311-934ab2d51862] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='15b24725-0c99-4bcf-b1fb-907cdf8e2d63',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128802) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:34:33.883735 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-1f37e75d-b59f-4943-8f77-67e4d8fb016a tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.683183 Oct 04 21:34:33.884622 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3331/6626] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 21:34:33 2022] POST /compute/v2.1/servers => generated 406 bytes in 685 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:34:33.896878 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c9ad43c1-859d-464a-ae4a-8822a9500971 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:34:33.897512 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c9ad43c1-859d-464a-ae4a-8822a9500971 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: 614f1ce2-fde0-40a8-b311-934ab2d51862] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:34:33.957279 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c9ad43c1-859d-464a-ae4a-8822a9500971 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b2b2b461354b8aa87cb19b0fb4fd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a146d50c0a544fe49bb604199bb67f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:33.965631 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c9ad43c1-859d-464a-ae4a-8822a9500971 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "GET /compute/v2.1/servers/614f1ce2-fde0-40a8-b311-934ab2d51862" status: 200 len: 1237 microversion: 2.1 time: 0.073507 Oct 04 21:34:33.966216 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3296/6627] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:34:33 2022] GET /compute/v2.1/servers/614f1ce2-fde0-40a8-b311-934ab2d51862 => generated 1237 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:34:34.992820 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-9afbe65b-3380-4cb5-96cf-226cc56aac96 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:34:34.994071 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-9afbe65b-3380-4cb5-96cf-226cc56aac96 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: 614f1ce2-fde0-40a8-b311-934ab2d51862] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:34:35.002289 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9afbe65b-3380-4cb5-96cf-226cc56aac96 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:35.003037 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9afbe65b-3380-4cb5-96cf-226cc56aac96 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:35.003492 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9afbe65b-3380-4cb5-96cf-226cc56aac96 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:35.004258 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9afbe65b-3380-4cb5-96cf-226cc56aac96 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:35.004719 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9afbe65b-3380-4cb5-96cf-226cc56aac96 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:35.005163 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9afbe65b-3380-4cb5-96cf-226cc56aac96 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:35.074612 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-9afbe65b-3380-4cb5-96cf-226cc56aac96 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b2b2b461354b8aa87cb19b0fb4fd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a146d50c0a544fe49bb604199bb67f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:35.084403 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-9afbe65b-3380-4cb5-96cf-226cc56aac96 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "GET /compute/v2.1/servers/614f1ce2-fde0-40a8-b311-934ab2d51862" status: 200 len: 1289 microversion: 2.1 time: 0.096715 Oct 04 21:34:35.085093 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3332/6628] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:34:34 2022] GET /compute/v2.1/servers/614f1ce2-fde0-40a8-b311-934ab2d51862 => generated 1289 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:34:36.109283 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b99d3758-6fd5-4d54-b965-536a91d8ecb2 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:34:36.110005 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b99d3758-6fd5-4d54-b965-536a91d8ecb2 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: 614f1ce2-fde0-40a8-b311-934ab2d51862] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:34:36.119683 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b99d3758-6fd5-4d54-b965-536a91d8ecb2 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:36.120188 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b99d3758-6fd5-4d54-b965-536a91d8ecb2 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:36.120632 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b99d3758-6fd5-4d54-b965-536a91d8ecb2 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:36.122038 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b99d3758-6fd5-4d54-b965-536a91d8ecb2 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:36.122038 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b99d3758-6fd5-4d54-b965-536a91d8ecb2 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:36.122194 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b99d3758-6fd5-4d54-b965-536a91d8ecb2 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:36.292366 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-b99d3758-6fd5-4d54-b965-536a91d8ecb2 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b2b2b461354b8aa87cb19b0fb4fd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a146d50c0a544fe49bb604199bb67f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:36.302478 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b99d3758-6fd5-4d54-b965-536a91d8ecb2 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "GET /compute/v2.1/servers/614f1ce2-fde0-40a8-b311-934ab2d51862" status: 200 len: 1363 microversion: 2.1 time: 0.197101 Oct 04 21:34:36.303085 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3297/6629] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:34:36 2022] GET /compute/v2.1/servers/614f1ce2-fde0-40a8-b311-934ab2d51862 => generated 1363 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:34:36.662765 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-1fdc2a90-23cb-480f-a4a7-883d51cdfaef req-1ceae510-b33c-48cf-af49-5e2e0c298906 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "614f1ce2-fde0-40a8-b311-934ab2d51862", "tag": "70aaa3a1-80c1-452c-b4db-169f61383a1b"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:34:36.674961 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-1fdc2a90-23cb-480f-a4a7-883d51cdfaef req-1ceae510-b33c-48cf-af49-5e2e0c298906 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:36.675515 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-1fdc2a90-23cb-480f-a4a7-883d51cdfaef req-1ceae510-b33c-48cf-af49-5e2e0c298906 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:36.675949 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-1fdc2a90-23cb-480f-a4a7-883d51cdfaef req-1ceae510-b33c-48cf-af49-5e2e0c298906 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:36.688361 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-1fdc2a90-23cb-480f-a4a7-883d51cdfaef req-1ceae510-b33c-48cf-af49-5e2e0c298906 service nova] Creating event network-changed:70aaa3a1-80c1-452c-b4db-169f61383a1b for instance 614f1ce2-fde0-40a8-b311-934ab2d51862 on n-h1-854823-8 Oct 04 21:34:36.693802 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-1fdc2a90-23cb-480f-a4a7-883d51cdfaef req-1ceae510-b33c-48cf-af49-5e2e0c298906 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035503 Oct 04 21:34:36.694443 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3333/6630] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:34:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:34:37.328137 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6e21d3dd-33d5-469c-8059-316b1b0c29e4 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:34:37.328684 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-6e21d3dd-33d5-469c-8059-316b1b0c29e4 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: 614f1ce2-fde0-40a8-b311-934ab2d51862] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:34:37.331430 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=43 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:34:37.336868 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6e21d3dd-33d5-469c-8059-316b1b0c29e4 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:37.337359 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6e21d3dd-33d5-469c-8059-316b1b0c29e4 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:37.337798 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6e21d3dd-33d5-469c-8059-316b1b0c29e4 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:37.338539 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6e21d3dd-33d5-469c-8059-316b1b0c29e4 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:37.339000 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6e21d3dd-33d5-469c-8059-316b1b0c29e4 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:37.339429 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6e21d3dd-33d5-469c-8059-316b1b0c29e4 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:37.474103 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-6e21d3dd-33d5-469c-8059-316b1b0c29e4 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b2b2b461354b8aa87cb19b0fb4fd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a146d50c0a544fe49bb604199bb67f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:37.482049 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-6e21d3dd-33d5-469c-8059-316b1b0c29e4 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "GET /compute/v2.1/servers/614f1ce2-fde0-40a8-b311-934ab2d51862" status: 200 len: 1363 microversion: 2.1 time: 0.158029 Oct 04 21:34:37.482667 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3298/6631] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:34:37 2022] GET /compute/v2.1/servers/614f1ce2-fde0-40a8-b311-934ab2d51862 => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:34:38.507257 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-9dddd022-10cb-4d97-8667-9415a6b1f4d2 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:34:38.507977 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-9dddd022-10cb-4d97-8667-9415a6b1f4d2 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: 614f1ce2-fde0-40a8-b311-934ab2d51862] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:34:38.510002 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:34:38.515980 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9dddd022-10cb-4d97-8667-9415a6b1f4d2 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:38.516478 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9dddd022-10cb-4d97-8667-9415a6b1f4d2 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:38.516928 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9dddd022-10cb-4d97-8667-9415a6b1f4d2 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:38.517644 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9dddd022-10cb-4d97-8667-9415a6b1f4d2 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:38.518250 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9dddd022-10cb-4d97-8667-9415a6b1f4d2 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:38.518719 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9dddd022-10cb-4d97-8667-9415a6b1f4d2 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:38.666272 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-9dddd022-10cb-4d97-8667-9415a6b1f4d2 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b2b2b461354b8aa87cb19b0fb4fd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a146d50c0a544fe49bb604199bb67f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:38.674496 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-9dddd022-10cb-4d97-8667-9415a6b1f4d2 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "GET /compute/v2.1/servers/614f1ce2-fde0-40a8-b311-934ab2d51862" status: 200 len: 1363 microversion: 2.1 time: 0.172872 Oct 04 21:34:38.675822 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3334/6632] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:34:38 2022] GET /compute/v2.1/servers/614f1ce2-fde0-40a8-b311-934ab2d51862 => generated 1363 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:34:39.698769 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-91f47e28-2f7f-47e0-a8ee-bad74374d495 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:34:39.699388 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-91f47e28-2f7f-47e0-a8ee-bad74374d495 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: 614f1ce2-fde0-40a8-b311-934ab2d51862] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:34:39.706898 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-91f47e28-2f7f-47e0-a8ee-bad74374d495 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:39.707411 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-91f47e28-2f7f-47e0-a8ee-bad74374d495 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:39.708036 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-91f47e28-2f7f-47e0-a8ee-bad74374d495 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:39.708748 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-91f47e28-2f7f-47e0-a8ee-bad74374d495 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:39.709200 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-91f47e28-2f7f-47e0-a8ee-bad74374d495 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:39.709623 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-91f47e28-2f7f-47e0-a8ee-bad74374d495 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:39.855108 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-91f47e28-2f7f-47e0-a8ee-bad74374d495 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b2b2b461354b8aa87cb19b0fb4fd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a146d50c0a544fe49bb604199bb67f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:39.863777 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-91f47e28-2f7f-47e0-a8ee-bad74374d495 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "GET /compute/v2.1/servers/614f1ce2-fde0-40a8-b311-934ab2d51862" status: 200 len: 1363 microversion: 2.1 time: 0.169113 Oct 04 21:34:39.864377 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3299/6633] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:34:39 2022] GET /compute/v2.1/servers/614f1ce2-fde0-40a8-b311-934ab2d51862 => generated 1363 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:34:40.888519 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-6cec5afc-2baa-4710-8972-a4baa262706d tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:34:40.889173 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-6cec5afc-2baa-4710-8972-a4baa262706d tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: 614f1ce2-fde0-40a8-b311-934ab2d51862] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:34:40.896518 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6cec5afc-2baa-4710-8972-a4baa262706d tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:40.897026 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6cec5afc-2baa-4710-8972-a4baa262706d tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:40.897484 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6cec5afc-2baa-4710-8972-a4baa262706d tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:40.898206 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6cec5afc-2baa-4710-8972-a4baa262706d tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:40.898706 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6cec5afc-2baa-4710-8972-a4baa262706d tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:40.899145 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6cec5afc-2baa-4710-8972-a4baa262706d tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:41.038893 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-6cec5afc-2baa-4710-8972-a4baa262706d tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b2b2b461354b8aa87cb19b0fb4fd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a146d50c0a544fe49bb604199bb67f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:41.047290 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-6cec5afc-2baa-4710-8972-a4baa262706d tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "GET /compute/v2.1/servers/614f1ce2-fde0-40a8-b311-934ab2d51862" status: 200 len: 1363 microversion: 2.1 time: 0.162697 Oct 04 21:34:41.047875 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3335/6634] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:34:40 2022] GET /compute/v2.1/servers/614f1ce2-fde0-40a8-b311-934ab2d51862 => generated 1363 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:34:41.765778 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-b8c9f9bf-8ebd-4cdc-9104-917179fde79c req-6fa5882e-410f-4864-a1d7-46ee4d0118f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "614f1ce2-fde0-40a8-b311-934ab2d51862", "name": "network-vif-plugged", "status": "completed", "tag": "70aaa3a1-80c1-452c-b4db-169f61383a1b"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:34:41.777871 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-b8c9f9bf-8ebd-4cdc-9104-917179fde79c req-6fa5882e-410f-4864-a1d7-46ee4d0118f0 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:41.778636 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-b8c9f9bf-8ebd-4cdc-9104-917179fde79c req-6fa5882e-410f-4864-a1d7-46ee4d0118f0 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:41.779073 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-b8c9f9bf-8ebd-4cdc-9104-917179fde79c req-6fa5882e-410f-4864-a1d7-46ee4d0118f0 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:41.792441 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-b8c9f9bf-8ebd-4cdc-9104-917179fde79c req-6fa5882e-410f-4864-a1d7-46ee4d0118f0 service nova] Creating event network-vif-plugged:70aaa3a1-80c1-452c-b4db-169f61383a1b for instance 614f1ce2-fde0-40a8-b311-934ab2d51862 on n-h1-854823-8 Oct 04 21:34:41.797511 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-b8c9f9bf-8ebd-4cdc-9104-917179fde79c req-6fa5882e-410f-4864-a1d7-46ee4d0118f0 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035542 Oct 04 21:34:41.798129 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3300/6635] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:34:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:34:42.071777 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-178b7d59-06a6-4404-9438-c2cd58d427db tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:34:42.072308 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-178b7d59-06a6-4404-9438-c2cd58d427db tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: 614f1ce2-fde0-40a8-b311-934ab2d51862] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:34:42.079519 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-178b7d59-06a6-4404-9438-c2cd58d427db tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:42.080029 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-178b7d59-06a6-4404-9438-c2cd58d427db tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:42.081112 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-178b7d59-06a6-4404-9438-c2cd58d427db tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:42.081905 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-178b7d59-06a6-4404-9438-c2cd58d427db tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:42.082372 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-178b7d59-06a6-4404-9438-c2cd58d427db tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:42.082825 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-178b7d59-06a6-4404-9438-c2cd58d427db tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:42.221531 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-178b7d59-06a6-4404-9438-c2cd58d427db tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b2b2b461354b8aa87cb19b0fb4fd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a146d50c0a544fe49bb604199bb67f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:42.229565 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-178b7d59-06a6-4404-9438-c2cd58d427db tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "GET /compute/v2.1/servers/614f1ce2-fde0-40a8-b311-934ab2d51862" status: 200 len: 1363 microversion: 2.1 time: 0.161820 Oct 04 21:34:42.230156 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3336/6636] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:34:42 2022] GET /compute/v2.1/servers/614f1ce2-fde0-40a8-b311-934ab2d51862 => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:34:43.255868 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-31d5956d-ef08-48ac-8134-9edecefbca55 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:34:43.256592 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-31d5956d-ef08-48ac-8134-9edecefbca55 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: 614f1ce2-fde0-40a8-b311-934ab2d51862] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:34:43.263739 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-31d5956d-ef08-48ac-8134-9edecefbca55 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:43.264209 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-31d5956d-ef08-48ac-8134-9edecefbca55 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:43.264671 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-31d5956d-ef08-48ac-8134-9edecefbca55 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:43.265407 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-31d5956d-ef08-48ac-8134-9edecefbca55 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:43.265867 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-31d5956d-ef08-48ac-8134-9edecefbca55 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:43.266457 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-31d5956d-ef08-48ac-8134-9edecefbca55 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:43.409568 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-31d5956d-ef08-48ac-8134-9edecefbca55 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b2b2b461354b8aa87cb19b0fb4fd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a146d50c0a544fe49bb604199bb67f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:43.417716 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-31d5956d-ef08-48ac-8134-9edecefbca55 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "GET /compute/v2.1/servers/614f1ce2-fde0-40a8-b311-934ab2d51862" status: 200 len: 1363 microversion: 2.1 time: 0.167791 Oct 04 21:34:43.418329 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3301/6637] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:34:43 2022] GET /compute/v2.1/servers/614f1ce2-fde0-40a8-b311-934ab2d51862 => generated 1363 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:34:44.442811 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-6162485f-24e6-4a13-b075-6a53a890a4cf tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:34:44.443432 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-6162485f-24e6-4a13-b075-6a53a890a4cf tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: 614f1ce2-fde0-40a8-b311-934ab2d51862] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:34:44.446225 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell0:SELECT=2 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:34:44.447086 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell0:SELECT=6 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:34:44.452446 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6162485f-24e6-4a13-b075-6a53a890a4cf tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:44.452938 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6162485f-24e6-4a13-b075-6a53a890a4cf tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:44.453384 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6162485f-24e6-4a13-b075-6a53a890a4cf tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:44.454092 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6162485f-24e6-4a13-b075-6a53a890a4cf tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:44.454593 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6162485f-24e6-4a13-b075-6a53a890a4cf tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:44.455030 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6162485f-24e6-4a13-b075-6a53a890a4cf tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:44.601798 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-6162485f-24e6-4a13-b075-6a53a890a4cf tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b2b2b461354b8aa87cb19b0fb4fd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a146d50c0a544fe49bb604199bb67f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:34:44.609913 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-6162485f-24e6-4a13-b075-6a53a890a4cf tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "GET /compute/v2.1/servers/614f1ce2-fde0-40a8-b311-934ab2d51862" status: 200 len: 1548 microversion: 2.1 time: 0.171125 Oct 04 21:34:44.610524 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3337/6638] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:34:44 2022] GET /compute/v2.1/servers/614f1ce2-fde0-40a8-b311-934ab2d51862 => generated 1548 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:34:44.633798 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-15eee459-041c-41d3-960f-7602fb8b06ce tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:34:44.634447 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-15eee459-041c-41d3-960f-7602fb8b06ce tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: 614f1ce2-fde0-40a8-b311-934ab2d51862] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:34:44.636792 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:34:44.643746 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-15eee459-041c-41d3-960f-7602fb8b06ce tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:44.644252 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-15eee459-041c-41d3-960f-7602fb8b06ce tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:44.644693 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-15eee459-041c-41d3-960f-7602fb8b06ce tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:44.645406 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-15eee459-041c-41d3-960f-7602fb8b06ce tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:44.645863 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-15eee459-041c-41d3-960f-7602fb8b06ce tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:44.646302 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-15eee459-041c-41d3-960f-7602fb8b06ce tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:44.728236 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-15eee459-041c-41d3-960f-7602fb8b06ce tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "GET /compute/v2.1/servers/614f1ce2-fde0-40a8-b311-934ab2d51862/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.098334 Oct 04 21:34:44.728844 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3302/6639] 10.222.0.33 () {58 vars in 1275 bytes} [Tue Oct 4 21:34:44 2022] GET /compute/v2.1/servers/614f1ce2-fde0-40a8-b311-934ab2d51862/os-interface => generated 284 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:34:46.041812 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-9e5f6aed-dac7-4ba1-85ac-b27b56e0e1eb req-197dce37-5f62-43cc-976d-80a6e0ce98df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "614f1ce2-fde0-40a8-b311-934ab2d51862", "tag": "70aaa3a1-80c1-452c-b4db-169f61383a1b"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:34:46.054066 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-9e5f6aed-dac7-4ba1-85ac-b27b56e0e1eb req-197dce37-5f62-43cc-976d-80a6e0ce98df service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:34:46.054852 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-9e5f6aed-dac7-4ba1-85ac-b27b56e0e1eb req-197dce37-5f62-43cc-976d-80a6e0ce98df service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:34:46.055291 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-9e5f6aed-dac7-4ba1-85ac-b27b56e0e1eb req-197dce37-5f62-43cc-976d-80a6e0ce98df service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:34:46.067717 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-9e5f6aed-dac7-4ba1-85ac-b27b56e0e1eb req-197dce37-5f62-43cc-976d-80a6e0ce98df service nova] Creating event network-changed:70aaa3a1-80c1-452c-b4db-169f61383a1b for instance 614f1ce2-fde0-40a8-b311-934ab2d51862 on n-h1-854823-8 Oct 04 21:34:46.072979 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-9e5f6aed-dac7-4ba1-85ac-b27b56e0e1eb req-197dce37-5f62-43cc-976d-80a6e0ce98df service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034897 Oct 04 21:34:46.073623 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3338/6640] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:34:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:35:19.275564 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8ca5e532-6fa4-4550-8d5e-9f7ebcdd8594 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:35:19.279331 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=9 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:35:19.280222 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=39 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:35:19.286732 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8ca5e532-6fa4-4550-8d5e-9f7ebcdd8594 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:19.287230 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8ca5e532-6fa4-4550-8d5e-9f7ebcdd8594 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:19.287671 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8ca5e532-6fa4-4550-8d5e-9f7ebcdd8594 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:19.313229 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-8ca5e532-6fa4-4550-8d5e-9f7ebcdd8594 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: 614f1ce2-fde0-40a8-b311-934ab2d51862] Going to try to stop instance {{(pid=128801) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 04 21:35:19.360348 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-8ca5e532-6fa4-4550-8d5e-9f7ebcdd8594 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "POST /compute/v2.1/servers/614f1ce2-fde0-40a8-b311-934ab2d51862/action" status: 202 len: 0 microversion: 2.1 time: 0.088522 Oct 04 21:35:19.360991 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3303/6641] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 21:35:19 2022] POST /compute/v2.1/servers/614f1ce2-fde0-40a8-b311-934ab2d51862/action => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:35:19.367990 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_api:SELECT=9 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:35:19.368755 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=49,nova_cell1:INSERT=1 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:35:19.373319 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-3ea8f4c2-083d-49ed-a49f-31eda53197e9 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:35:19.374052 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-3ea8f4c2-083d-49ed-a49f-31eda53197e9 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: 614f1ce2-fde0-40a8-b311-934ab2d51862] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:35:19.383581 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3ea8f4c2-083d-49ed-a49f-31eda53197e9 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:19.384099 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3ea8f4c2-083d-49ed-a49f-31eda53197e9 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:19.384550 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3ea8f4c2-083d-49ed-a49f-31eda53197e9 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:19.385279 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3ea8f4c2-083d-49ed-a49f-31eda53197e9 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:19.385748 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3ea8f4c2-083d-49ed-a49f-31eda53197e9 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:19.386185 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3ea8f4c2-083d-49ed-a49f-31eda53197e9 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:19.529264 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-3ea8f4c2-083d-49ed-a49f-31eda53197e9 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b2b2b461354b8aa87cb19b0fb4fd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a146d50c0a544fe49bb604199bb67f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:35:19.540918 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-3ea8f4c2-083d-49ed-a49f-31eda53197e9 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "GET /compute/v2.1/servers/614f1ce2-fde0-40a8-b311-934ab2d51862" status: 200 len: 1677 microversion: 2.1 time: 0.175150 Oct 04 21:35:19.541513 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3339/6642] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:35:19 2022] GET /compute/v2.1/servers/614f1ce2-fde0-40a8-b311-934ab2d51862 => generated 1677 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:35:20.568130 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-bfe38b82-26d7-4a0a-8b48-421376545ade tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:35:20.568862 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-bfe38b82-26d7-4a0a-8b48-421376545ade tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: 614f1ce2-fde0-40a8-b311-934ab2d51862] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:35:20.575096 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bfe38b82-26d7-4a0a-8b48-421376545ade tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:20.575586 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bfe38b82-26d7-4a0a-8b48-421376545ade tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:20.576025 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bfe38b82-26d7-4a0a-8b48-421376545ade tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:20.576726 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bfe38b82-26d7-4a0a-8b48-421376545ade tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:20.577183 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bfe38b82-26d7-4a0a-8b48-421376545ade tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:20.577612 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bfe38b82-26d7-4a0a-8b48-421376545ade tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:20.711747 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-bfe38b82-26d7-4a0a-8b48-421376545ade tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b2b2b461354b8aa87cb19b0fb4fd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a146d50c0a544fe49bb604199bb67f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:35:20.719837 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-bfe38b82-26d7-4a0a-8b48-421376545ade tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "GET /compute/v2.1/servers/614f1ce2-fde0-40a8-b311-934ab2d51862" status: 200 len: 1677 microversion: 2.1 time: 0.157734 Oct 04 21:35:20.720431 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3304/6643] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:35:20 2022] GET /compute/v2.1/servers/614f1ce2-fde0-40a8-b311-934ab2d51862 => generated 1677 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:35:21.743928 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-4a089025-32e9-4085-a64e-182f28a93d86 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:35:21.744553 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-4a089025-32e9-4085-a64e-182f28a93d86 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: 614f1ce2-fde0-40a8-b311-934ab2d51862] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:35:21.751763 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4a089025-32e9-4085-a64e-182f28a93d86 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:21.752282 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4a089025-32e9-4085-a64e-182f28a93d86 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:21.753549 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4a089025-32e9-4085-a64e-182f28a93d86 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:21.754430 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4a089025-32e9-4085-a64e-182f28a93d86 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:21.754936 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4a089025-32e9-4085-a64e-182f28a93d86 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:21.755411 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4a089025-32e9-4085-a64e-182f28a93d86 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:21.891455 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-4a089025-32e9-4085-a64e-182f28a93d86 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b2b2b461354b8aa87cb19b0fb4fd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a146d50c0a544fe49bb604199bb67f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:35:21.899906 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-4a089025-32e9-4085-a64e-182f28a93d86 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "GET /compute/v2.1/servers/614f1ce2-fde0-40a8-b311-934ab2d51862" status: 200 len: 1677 microversion: 2.1 time: 0.159806 Oct 04 21:35:21.900490 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3340/6644] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:35:21 2022] GET /compute/v2.1/servers/614f1ce2-fde0-40a8-b311-934ab2d51862 => generated 1677 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:35:22.925580 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-692cbac1-9826-4bac-abf9-44a52a1e1a1d tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:35:22.926205 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-692cbac1-9826-4bac-abf9-44a52a1e1a1d tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: 614f1ce2-fde0-40a8-b311-934ab2d51862] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:35:22.933345 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-692cbac1-9826-4bac-abf9-44a52a1e1a1d tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:22.933822 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-692cbac1-9826-4bac-abf9-44a52a1e1a1d tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:22.934253 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-692cbac1-9826-4bac-abf9-44a52a1e1a1d tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:22.934970 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-692cbac1-9826-4bac-abf9-44a52a1e1a1d tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:22.935424 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-692cbac1-9826-4bac-abf9-44a52a1e1a1d tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:22.935848 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-692cbac1-9826-4bac-abf9-44a52a1e1a1d tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:23.072254 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-692cbac1-9826-4bac-abf9-44a52a1e1a1d tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b2b2b461354b8aa87cb19b0fb4fd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a146d50c0a544fe49bb604199bb67f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:35:23.080268 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-692cbac1-9826-4bac-abf9-44a52a1e1a1d tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "GET /compute/v2.1/servers/614f1ce2-fde0-40a8-b311-934ab2d51862" status: 200 len: 1677 microversion: 2.1 time: 0.159477 Oct 04 21:35:23.082180 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3305/6645] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:35:22 2022] GET /compute/v2.1/servers/614f1ce2-fde0-40a8-b311-934ab2d51862 => generated 1677 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:35:24.104358 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-60d582cc-9b68-4fc9-8aba-64438530b04a tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:35:24.105015 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-60d582cc-9b68-4fc9-8aba-64438530b04a tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: 614f1ce2-fde0-40a8-b311-934ab2d51862] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:35:24.112367 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-60d582cc-9b68-4fc9-8aba-64438530b04a tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:24.112974 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-60d582cc-9b68-4fc9-8aba-64438530b04a tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:24.113687 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-60d582cc-9b68-4fc9-8aba-64438530b04a tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:24.114659 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-60d582cc-9b68-4fc9-8aba-64438530b04a tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:24.114659 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-60d582cc-9b68-4fc9-8aba-64438530b04a tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:24.115132 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-60d582cc-9b68-4fc9-8aba-64438530b04a tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:24.259225 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-60d582cc-9b68-4fc9-8aba-64438530b04a tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b2b2b461354b8aa87cb19b0fb4fd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a146d50c0a544fe49bb604199bb67f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:35:24.267139 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-60d582cc-9b68-4fc9-8aba-64438530b04a tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "GET /compute/v2.1/servers/614f1ce2-fde0-40a8-b311-934ab2d51862" status: 200 len: 1677 microversion: 2.1 time: 0.166773 Oct 04 21:35:24.267729 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3341/6646] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:35:24 2022] GET /compute/v2.1/servers/614f1ce2-fde0-40a8-b311-934ab2d51862 => generated 1677 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:35:25.291179 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-56da7d2b-2968-439f-b6ce-898d4115e00d tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:35:25.291820 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-56da7d2b-2968-439f-b6ce-898d4115e00d tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: 614f1ce2-fde0-40a8-b311-934ab2d51862] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:35:25.299326 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-56da7d2b-2968-439f-b6ce-898d4115e00d tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:25.299950 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-56da7d2b-2968-439f-b6ce-898d4115e00d tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:25.300397 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-56da7d2b-2968-439f-b6ce-898d4115e00d tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:25.301127 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-56da7d2b-2968-439f-b6ce-898d4115e00d tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:25.301589 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-56da7d2b-2968-439f-b6ce-898d4115e00d tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:25.302026 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-56da7d2b-2968-439f-b6ce-898d4115e00d tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:25.447647 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-56da7d2b-2968-439f-b6ce-898d4115e00d tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b2b2b461354b8aa87cb19b0fb4fd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a146d50c0a544fe49bb604199bb67f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:35:25.455899 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-56da7d2b-2968-439f-b6ce-898d4115e00d tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "GET /compute/v2.1/servers/614f1ce2-fde0-40a8-b311-934ab2d51862" status: 200 len: 1677 microversion: 2.1 time: 0.168961 Oct 04 21:35:25.456525 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3306/6647] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:35:25 2022] GET /compute/v2.1/servers/614f1ce2-fde0-40a8-b311-934ab2d51862 => generated 1677 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:35:26.479204 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-205e73d4-00f4-40ba-9dfe-554f861c8168 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:35:26.479829 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-205e73d4-00f4-40ba-9dfe-554f861c8168 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: 614f1ce2-fde0-40a8-b311-934ab2d51862] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:35:26.486917 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-205e73d4-00f4-40ba-9dfe-554f861c8168 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:26.487486 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-205e73d4-00f4-40ba-9dfe-554f861c8168 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:26.487980 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-205e73d4-00f4-40ba-9dfe-554f861c8168 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:26.488702 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-205e73d4-00f4-40ba-9dfe-554f861c8168 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:26.489172 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-205e73d4-00f4-40ba-9dfe-554f861c8168 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:26.489619 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-205e73d4-00f4-40ba-9dfe-554f861c8168 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:26.621553 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-205e73d4-00f4-40ba-9dfe-554f861c8168 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b2b2b461354b8aa87cb19b0fb4fd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a146d50c0a544fe49bb604199bb67f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:35:26.630984 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-205e73d4-00f4-40ba-9dfe-554f861c8168 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "GET /compute/v2.1/servers/614f1ce2-fde0-40a8-b311-934ab2d51862" status: 200 len: 1677 microversion: 2.1 time: 0.155707 Oct 04 21:35:26.631559 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3342/6648] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:35:26 2022] GET /compute/v2.1/servers/614f1ce2-fde0-40a8-b311-934ab2d51862 => generated 1677 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:35:27.655444 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7d506a57-7dfb-4838-aea3-5d98f8c029e0 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:35:27.656087 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-7d506a57-7dfb-4838-aea3-5d98f8c029e0 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: 614f1ce2-fde0-40a8-b311-934ab2d51862] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:35:27.663079 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7d506a57-7dfb-4838-aea3-5d98f8c029e0 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:27.663565 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7d506a57-7dfb-4838-aea3-5d98f8c029e0 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:27.664009 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7d506a57-7dfb-4838-aea3-5d98f8c029e0 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:27.664707 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7d506a57-7dfb-4838-aea3-5d98f8c029e0 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:27.665167 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7d506a57-7dfb-4838-aea3-5d98f8c029e0 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:27.665594 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7d506a57-7dfb-4838-aea3-5d98f8c029e0 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:27.801472 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-7d506a57-7dfb-4838-aea3-5d98f8c029e0 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b2b2b461354b8aa87cb19b0fb4fd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a146d50c0a544fe49bb604199bb67f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:35:27.809562 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-7d506a57-7dfb-4838-aea3-5d98f8c029e0 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "GET /compute/v2.1/servers/614f1ce2-fde0-40a8-b311-934ab2d51862" status: 200 len: 1677 microversion: 2.1 time: 0.158042 Oct 04 21:35:27.810141 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3307/6649] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:35:27 2022] GET /compute/v2.1/servers/614f1ce2-fde0-40a8-b311-934ab2d51862 => generated 1677 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:35:28.833614 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-35e10b16-6083-4005-8aef-addcfd0530a0 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:35:28.834254 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-35e10b16-6083-4005-8aef-addcfd0530a0 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: 614f1ce2-fde0-40a8-b311-934ab2d51862] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:35:28.841112 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-35e10b16-6083-4005-8aef-addcfd0530a0 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:28.841604 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-35e10b16-6083-4005-8aef-addcfd0530a0 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:28.842068 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-35e10b16-6083-4005-8aef-addcfd0530a0 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:28.842944 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-35e10b16-6083-4005-8aef-addcfd0530a0 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:28.843491 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-35e10b16-6083-4005-8aef-addcfd0530a0 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:28.843966 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-35e10b16-6083-4005-8aef-addcfd0530a0 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:28.978735 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-35e10b16-6083-4005-8aef-addcfd0530a0 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b2b2b461354b8aa87cb19b0fb4fd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a146d50c0a544fe49bb604199bb67f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:35:28.987361 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-35e10b16-6083-4005-8aef-addcfd0530a0 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "GET /compute/v2.1/servers/614f1ce2-fde0-40a8-b311-934ab2d51862" status: 200 len: 1677 microversion: 2.1 time: 0.156828 Oct 04 21:35:28.987976 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3343/6650] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:35:28 2022] GET /compute/v2.1/servers/614f1ce2-fde0-40a8-b311-934ab2d51862 => generated 1677 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:35:30.010542 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d518745b-614e-4585-8d90-8e02e28c8091 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:35:30.011077 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d518745b-614e-4585-8d90-8e02e28c8091 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: 614f1ce2-fde0-40a8-b311-934ab2d51862] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:35:30.018104 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d518745b-614e-4585-8d90-8e02e28c8091 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:30.018620 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d518745b-614e-4585-8d90-8e02e28c8091 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:30.019057 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d518745b-614e-4585-8d90-8e02e28c8091 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:30.019790 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d518745b-614e-4585-8d90-8e02e28c8091 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:30.020247 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d518745b-614e-4585-8d90-8e02e28c8091 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:30.020674 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d518745b-614e-4585-8d90-8e02e28c8091 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:30.169065 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d518745b-614e-4585-8d90-8e02e28c8091 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b2b2b461354b8aa87cb19b0fb4fd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a146d50c0a544fe49bb604199bb67f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:35:30.177755 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d518745b-614e-4585-8d90-8e02e28c8091 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "GET /compute/v2.1/servers/614f1ce2-fde0-40a8-b311-934ab2d51862" status: 200 len: 1654 microversion: 2.1 time: 0.171312 Oct 04 21:35:30.178651 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3308/6651] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:35:30 2022] GET /compute/v2.1/servers/614f1ce2-fde0-40a8-b311-934ab2d51862 => generated 1654 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:35:30.202133 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-2c8de7f6-f89e-4731-9c48-778b48a363b4 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:35:30.204509 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-2c8de7f6-f89e-4731-9c48-778b48a363b4 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: 614f1ce2-fde0-40a8-b311-934ab2d51862] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:35:30.212291 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2c8de7f6-f89e-4731-9c48-778b48a363b4 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:30.212809 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2c8de7f6-f89e-4731-9c48-778b48a363b4 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:30.213269 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2c8de7f6-f89e-4731-9c48-778b48a363b4 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:30.213994 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2c8de7f6-f89e-4731-9c48-778b48a363b4 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:30.214497 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2c8de7f6-f89e-4731-9c48-778b48a363b4 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:30.214943 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2c8de7f6-f89e-4731-9c48-778b48a363b4 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:30.244729 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-2c8de7f6-f89e-4731-9c48-778b48a363b4 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'a2b2b2b461354b8aa87cb19b0fb4fd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a146d50c0a544fe49bb604199bb67f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:35:30.250625 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-2c8de7f6-f89e-4731-9c48-778b48a363b4 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: 614f1ce2-fde0-40a8-b311-934ab2d51862] Old instance type m1.heat2, new instance type m1.heat {{(pid=128802) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 04 21:35:30.258093 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-2c8de7f6-f89e-4731-9c48-778b48a363b4 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Flavor limits 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:35:30.258564 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-2c8de7f6-f89e-4731-9c48-778b48a363b4 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Image limits 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:35:30.259064 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-2c8de7f6-f89e-4731-9c48-778b48a363b4 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Flavor pref 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:35:30.259489 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-2c8de7f6-f89e-4731-9c48-778b48a363b4 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Image pref 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:35:30.259916 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-2c8de7f6-f89e-4731-9c48-778b48a363b4 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:35:30.330910 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-2c8de7f6-f89e-4731-9c48-778b48a363b4 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "POST /compute/v2.1/servers/614f1ce2-fde0-40a8-b311-934ab2d51862/action" status: 202 len: 0 microversion: 2.1 time: 0.132499 Oct 04 21:35:30.331733 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3344/6652] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 21:35:30 2022] POST /compute/v2.1/servers/614f1ce2-fde0-40a8-b311-934ab2d51862/action => generated 0 bytes in 134 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:35:30.339994 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c7bf0053-2687-4710-93c3-6cd3ad986253 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:35:30.340855 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c7bf0053-2687-4710-93c3-6cd3ad986253 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: 614f1ce2-fde0-40a8-b311-934ab2d51862] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:35:30.347787 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c7bf0053-2687-4710-93c3-6cd3ad986253 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:30.348278 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c7bf0053-2687-4710-93c3-6cd3ad986253 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:30.348713 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c7bf0053-2687-4710-93c3-6cd3ad986253 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:30.349423 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c7bf0053-2687-4710-93c3-6cd3ad986253 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:30.349877 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c7bf0053-2687-4710-93c3-6cd3ad986253 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:30.350304 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c7bf0053-2687-4710-93c3-6cd3ad986253 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:30.498822 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c7bf0053-2687-4710-93c3-6cd3ad986253 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b2b2b461354b8aa87cb19b0fb4fd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a146d50c0a544fe49bb604199bb67f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:35:30.507019 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c7bf0053-2687-4710-93c3-6cd3ad986253 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "GET /compute/v2.1/servers/614f1ce2-fde0-40a8-b311-934ab2d51862" status: 200 len: 1677 microversion: 2.1 time: 0.171036 Oct 04 21:35:30.507601 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3309/6653] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:35:30 2022] GET /compute/v2.1/servers/614f1ce2-fde0-40a8-b311-934ab2d51862 => generated 1677 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:35:31.533204 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-a9165260-d072-4fb8-8cf0-d81c4163e241 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:35:31.534587 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-a9165260-d072-4fb8-8cf0-d81c4163e241 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: 614f1ce2-fde0-40a8-b311-934ab2d51862] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:35:31.541656 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a9165260-d072-4fb8-8cf0-d81c4163e241 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:31.542163 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a9165260-d072-4fb8-8cf0-d81c4163e241 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:31.542646 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a9165260-d072-4fb8-8cf0-d81c4163e241 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:31.543365 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a9165260-d072-4fb8-8cf0-d81c4163e241 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:31.543837 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a9165260-d072-4fb8-8cf0-d81c4163e241 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:31.544281 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a9165260-d072-4fb8-8cf0-d81c4163e241 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:31.694309 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-a9165260-d072-4fb8-8cf0-d81c4163e241 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b2b2b461354b8aa87cb19b0fb4fd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a146d50c0a544fe49bb604199bb67f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:35:31.702609 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-a9165260-d072-4fb8-8cf0-d81c4163e241 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "GET /compute/v2.1/servers/614f1ce2-fde0-40a8-b311-934ab2d51862" status: 200 len: 1677 microversion: 2.1 time: 0.174153 Oct 04 21:35:31.703426 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3345/6654] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:35:31 2022] GET /compute/v2.1/servers/614f1ce2-fde0-40a8-b311-934ab2d51862 => generated 1677 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:35:32.727700 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-4370414d-2cff-4616-88ea-855104fd08ba tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:35:32.728315 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-4370414d-2cff-4616-88ea-855104fd08ba tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: 614f1ce2-fde0-40a8-b311-934ab2d51862] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:35:32.735201 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4370414d-2cff-4616-88ea-855104fd08ba tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:32.735688 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4370414d-2cff-4616-88ea-855104fd08ba tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:32.736128 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4370414d-2cff-4616-88ea-855104fd08ba tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:32.736828 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4370414d-2cff-4616-88ea-855104fd08ba tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:32.737289 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4370414d-2cff-4616-88ea-855104fd08ba tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:32.737725 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4370414d-2cff-4616-88ea-855104fd08ba tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:32.873549 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-4370414d-2cff-4616-88ea-855104fd08ba tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b2b2b461354b8aa87cb19b0fb4fd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a146d50c0a544fe49bb604199bb67f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:35:32.882124 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-4370414d-2cff-4616-88ea-855104fd08ba tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "GET /compute/v2.1/servers/614f1ce2-fde0-40a8-b311-934ab2d51862" status: 200 len: 1682 microversion: 2.1 time: 0.158360 Oct 04 21:35:32.882740 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3310/6655] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:35:32 2022] GET /compute/v2.1/servers/614f1ce2-fde0-40a8-b311-934ab2d51862 => generated 1682 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:35:33.906962 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-0421da59-4b4b-4cca-9773-caa09005393b tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:35:33.907677 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-0421da59-4b4b-4cca-9773-caa09005393b tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: 614f1ce2-fde0-40a8-b311-934ab2d51862] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:35:33.915780 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0421da59-4b4b-4cca-9773-caa09005393b tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:33.916274 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0421da59-4b4b-4cca-9773-caa09005393b tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:33.916717 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0421da59-4b4b-4cca-9773-caa09005393b tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:33.917427 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0421da59-4b4b-4cca-9773-caa09005393b tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:33.917891 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0421da59-4b4b-4cca-9773-caa09005393b tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:33.918326 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0421da59-4b4b-4cca-9773-caa09005393b tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:34.057892 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-0421da59-4b4b-4cca-9773-caa09005393b tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b2b2b461354b8aa87cb19b0fb4fd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a146d50c0a544fe49bb604199bb67f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:35:34.066607 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-0421da59-4b4b-4cca-9773-caa09005393b tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "GET /compute/v2.1/servers/614f1ce2-fde0-40a8-b311-934ab2d51862" status: 200 len: 1682 microversion: 2.1 time: 0.163575 Oct 04 21:35:34.067220 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3346/6656] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:35:33 2022] GET /compute/v2.1/servers/614f1ce2-fde0-40a8-b311-934ab2d51862 => generated 1682 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:35:35.065441 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-880e5523-993f-41cf-bb85-7ee35a96494b req-a52abdde-b718-42e9-86d0-51afbcd430ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "614f1ce2-fde0-40a8-b311-934ab2d51862", "name": "network-vif-unplugged", "status": "completed", "tag": "70aaa3a1-80c1-452c-b4db-169f61383a1b"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:35:35.076636 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-880e5523-993f-41cf-bb85-7ee35a96494b req-a52abdde-b718-42e9-86d0-51afbcd430ce service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:35.077121 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-880e5523-993f-41cf-bb85-7ee35a96494b req-a52abdde-b718-42e9-86d0-51afbcd430ce service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:35.078152 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-880e5523-993f-41cf-bb85-7ee35a96494b req-a52abdde-b718-42e9-86d0-51afbcd430ce service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:35.092083 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-880e5523-993f-41cf-bb85-7ee35a96494b req-a52abdde-b718-42e9-86d0-51afbcd430ce service nova] Creating event network-vif-unplugged:70aaa3a1-80c1-452c-b4db-169f61383a1b for instance 614f1ce2-fde0-40a8-b311-934ab2d51862 on n-h2-854823-8 Oct 04 21:35:35.092427 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-23587a46-cb62-4951-9ed9-63c0317e53bc tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:35:35.093014 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-23587a46-cb62-4951-9ed9-63c0317e53bc tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: 614f1ce2-fde0-40a8-b311-934ab2d51862] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:35:35.098280 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [req-880e5523-993f-41cf-bb85-7ee35a96494b req-a52abdde-b718-42e9-86d0-51afbcd430ce service nova] Instance 614f1ce2-fde0-40a8-b311-934ab2d51862 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854823-8', 'n-h2-854823-8'} {{(pid=128801) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 21:35:35.099767 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-23587a46-cb62-4951-9ed9-63c0317e53bc tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:35.100921 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-23587a46-cb62-4951-9ed9-63c0317e53bc tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:35.101366 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-23587a46-cb62-4951-9ed9-63c0317e53bc tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:35.102777 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-23587a46-cb62-4951-9ed9-63c0317e53bc tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:35.103250 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-23587a46-cb62-4951-9ed9-63c0317e53bc tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:35.103684 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-23587a46-cb62-4951-9ed9-63c0317e53bc tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:35.110476 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-880e5523-993f-41cf-bb85-7ee35a96494b req-a52abdde-b718-42e9-86d0-51afbcd430ce service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049489 Oct 04 21:35:35.111263 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3311/6657] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:35:35 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:35:35.436382 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-23587a46-cb62-4951-9ed9-63c0317e53bc tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b2b2b461354b8aa87cb19b0fb4fd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a146d50c0a544fe49bb604199bb67f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:35:35.445204 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-23587a46-cb62-4951-9ed9-63c0317e53bc tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "GET /compute/v2.1/servers/614f1ce2-fde0-40a8-b311-934ab2d51862" status: 200 len: 1681 microversion: 2.1 time: 0.356592 Oct 04 21:35:35.445786 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3347/6658] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:35:35 2022] GET /compute/v2.1/servers/614f1ce2-fde0-40a8-b311-934ab2d51862 => generated 1681 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:35:36.470678 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-311b0006-6f7d-4887-b8db-ac527a71c7b1 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:35:36.471824 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-311b0006-6f7d-4887-b8db-ac527a71c7b1 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: 614f1ce2-fde0-40a8-b311-934ab2d51862] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:35:36.479827 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-311b0006-6f7d-4887-b8db-ac527a71c7b1 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:36.480317 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-311b0006-6f7d-4887-b8db-ac527a71c7b1 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:36.480755 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-311b0006-6f7d-4887-b8db-ac527a71c7b1 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:36.481462 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-311b0006-6f7d-4887-b8db-ac527a71c7b1 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:36.481918 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-311b0006-6f7d-4887-b8db-ac527a71c7b1 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:36.482367 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-311b0006-6f7d-4887-b8db-ac527a71c7b1 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:36.614970 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-311b0006-6f7d-4887-b8db-ac527a71c7b1 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b2b2b461354b8aa87cb19b0fb4fd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a146d50c0a544fe49bb604199bb67f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:35:36.622891 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-311b0006-6f7d-4887-b8db-ac527a71c7b1 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "GET /compute/v2.1/servers/614f1ce2-fde0-40a8-b311-934ab2d51862" status: 200 len: 1679 microversion: 2.1 time: 0.156835 Oct 04 21:35:36.623477 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3312/6659] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:35:36 2022] GET /compute/v2.1/servers/614f1ce2-fde0-40a8-b311-934ab2d51862 => generated 1679 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:35:37.134125 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-18d94f8b-035d-4554-9716-5eaf8812aaae req-06e36a0e-7e11-4698-a08c-9e39ef8c26e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "614f1ce2-fde0-40a8-b311-934ab2d51862", "tag": "70aaa3a1-80c1-452c-b4db-169f61383a1b"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:35:37.146495 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-18d94f8b-035d-4554-9716-5eaf8812aaae req-06e36a0e-7e11-4698-a08c-9e39ef8c26e1 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:37.146987 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-18d94f8b-035d-4554-9716-5eaf8812aaae req-06e36a0e-7e11-4698-a08c-9e39ef8c26e1 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:37.147428 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-18d94f8b-035d-4554-9716-5eaf8812aaae req-06e36a0e-7e11-4698-a08c-9e39ef8c26e1 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:37.159720 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-18d94f8b-035d-4554-9716-5eaf8812aaae req-06e36a0e-7e11-4698-a08c-9e39ef8c26e1 service nova] Creating event network-changed:70aaa3a1-80c1-452c-b4db-169f61383a1b for instance 614f1ce2-fde0-40a8-b311-934ab2d51862 on n-h2-854823-8 Oct 04 21:35:37.165241 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [req-18d94f8b-035d-4554-9716-5eaf8812aaae req-06e36a0e-7e11-4698-a08c-9e39ef8c26e1 service nova] Instance 614f1ce2-fde0-40a8-b311-934ab2d51862 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854823-8', 'n-h2-854823-8'} {{(pid=128802) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 21:35:37.176501 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-18d94f8b-035d-4554-9716-5eaf8812aaae req-06e36a0e-7e11-4698-a08c-9e39ef8c26e1 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046207 Oct 04 21:35:37.177110 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3348/6660] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:35:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:35:37.647579 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b6e735e0-83ee-4067-b5d3-96fb362ee11d tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:35:37.648205 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b6e735e0-83ee-4067-b5d3-96fb362ee11d tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: 614f1ce2-fde0-40a8-b311-934ab2d51862] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:35:37.656171 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b6e735e0-83ee-4067-b5d3-96fb362ee11d tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:37.656674 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b6e735e0-83ee-4067-b5d3-96fb362ee11d tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:37.657114 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b6e735e0-83ee-4067-b5d3-96fb362ee11d tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:37.657836 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b6e735e0-83ee-4067-b5d3-96fb362ee11d tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:37.658408 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b6e735e0-83ee-4067-b5d3-96fb362ee11d tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:37.658848 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b6e735e0-83ee-4067-b5d3-96fb362ee11d tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:37.906480 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-b6e735e0-83ee-4067-b5d3-96fb362ee11d tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b2b2b461354b8aa87cb19b0fb4fd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a146d50c0a544fe49bb604199bb67f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:35:37.914909 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b6e735e0-83ee-4067-b5d3-96fb362ee11d tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "GET /compute/v2.1/servers/614f1ce2-fde0-40a8-b311-934ab2d51862" status: 200 len: 1675 microversion: 2.1 time: 0.271339 Oct 04 21:35:37.915490 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3313/6661] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:35:37 2022] GET /compute/v2.1/servers/614f1ce2-fde0-40a8-b311-934ab2d51862 => generated 1675 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:35:37.939170 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-4e7c9597-b246-4154-8501-e8c52ea17021 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:35:37.939751 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-4e7c9597-b246-4154-8501-e8c52ea17021 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: 614f1ce2-fde0-40a8-b311-934ab2d51862] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:35:37.946181 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4e7c9597-b246-4154-8501-e8c52ea17021 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:37.946790 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4e7c9597-b246-4154-8501-e8c52ea17021 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:37.947245 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4e7c9597-b246-4154-8501-e8c52ea17021 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:37.947955 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4e7c9597-b246-4154-8501-e8c52ea17021 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:37.948624 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4e7c9597-b246-4154-8501-e8c52ea17021 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:37.949068 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4e7c9597-b246-4154-8501-e8c52ea17021 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:38.015905 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-4e7c9597-b246-4154-8501-e8c52ea17021 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "POST /compute/v2.1/servers/614f1ce2-fde0-40a8-b311-934ab2d51862/action" status: 204 len: 0 microversion: 2.1 time: 0.080967 Oct 04 21:35:38.016980 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3349/6662] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 21:35:37 2022] POST /compute/v2.1/servers/614f1ce2-fde0-40a8-b311-934ab2d51862/action => generated 0 bytes in 83 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:35:38.026552 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c75b19bb-eb5f-4b49-8583-273dd18cffe4 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:35:38.034459 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c75b19bb-eb5f-4b49-8583-273dd18cffe4 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: 614f1ce2-fde0-40a8-b311-934ab2d51862] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:35:38.043863 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c75b19bb-eb5f-4b49-8583-273dd18cffe4 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:38.045175 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c75b19bb-eb5f-4b49-8583-273dd18cffe4 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:38.045845 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c75b19bb-eb5f-4b49-8583-273dd18cffe4 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:38.046613 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c75b19bb-eb5f-4b49-8583-273dd18cffe4 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:38.047167 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c75b19bb-eb5f-4b49-8583-273dd18cffe4 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:38.047604 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c75b19bb-eb5f-4b49-8583-273dd18cffe4 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:38.212623 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c75b19bb-eb5f-4b49-8583-273dd18cffe4 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b2b2b461354b8aa87cb19b0fb4fd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a146d50c0a544fe49bb604199bb67f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:35:38.221603 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c75b19bb-eb5f-4b49-8583-273dd18cffe4 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "GET /compute/v2.1/servers/614f1ce2-fde0-40a8-b311-934ab2d51862" status: 200 len: 1675 microversion: 2.1 time: 0.198524 Oct 04 21:35:38.222209 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3314/6663] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:35:38 2022] GET /compute/v2.1/servers/614f1ce2-fde0-40a8-b311-934ab2d51862 => generated 1675 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:35:39.245766 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-633eb089-6033-4ff3-8d39-ab263c29d8c5 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:35:39.246495 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-633eb089-6033-4ff3-8d39-ab263c29d8c5 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: 614f1ce2-fde0-40a8-b311-934ab2d51862] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:35:39.254211 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-633eb089-6033-4ff3-8d39-ab263c29d8c5 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:39.255410 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-633eb089-6033-4ff3-8d39-ab263c29d8c5 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:39.255874 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-633eb089-6033-4ff3-8d39-ab263c29d8c5 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:39.256590 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-633eb089-6033-4ff3-8d39-ab263c29d8c5 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:39.257055 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-633eb089-6033-4ff3-8d39-ab263c29d8c5 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:39.257489 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-633eb089-6033-4ff3-8d39-ab263c29d8c5 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:39.402893 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-633eb089-6033-4ff3-8d39-ab263c29d8c5 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b2b2b461354b8aa87cb19b0fb4fd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a146d50c0a544fe49bb604199bb67f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:35:39.411737 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-633eb089-6033-4ff3-8d39-ab263c29d8c5 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "GET /compute/v2.1/servers/614f1ce2-fde0-40a8-b311-934ab2d51862" status: 200 len: 1675 microversion: 2.1 time: 0.170204 Oct 04 21:35:39.412338 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3350/6664] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:35:39 2022] GET /compute/v2.1/servers/614f1ce2-fde0-40a8-b311-934ab2d51862 => generated 1675 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:35:40.437718 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c2a5af67-ed9e-47ce-89f1-3f831d09e909 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:35:40.438503 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c2a5af67-ed9e-47ce-89f1-3f831d09e909 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: 614f1ce2-fde0-40a8-b311-934ab2d51862] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:35:40.446625 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c2a5af67-ed9e-47ce-89f1-3f831d09e909 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:40.447123 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c2a5af67-ed9e-47ce-89f1-3f831d09e909 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:40.447560 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c2a5af67-ed9e-47ce-89f1-3f831d09e909 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:40.448295 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c2a5af67-ed9e-47ce-89f1-3f831d09e909 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:40.448756 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c2a5af67-ed9e-47ce-89f1-3f831d09e909 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:40.449185 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c2a5af67-ed9e-47ce-89f1-3f831d09e909 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:40.588732 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c2a5af67-ed9e-47ce-89f1-3f831d09e909 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b2b2b461354b8aa87cb19b0fb4fd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a146d50c0a544fe49bb604199bb67f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:35:40.597875 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c2a5af67-ed9e-47ce-89f1-3f831d09e909 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "GET /compute/v2.1/servers/614f1ce2-fde0-40a8-b311-934ab2d51862" status: 200 len: 1654 microversion: 2.1 time: 0.164335 Oct 04 21:35:40.598498 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3315/6665] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:35:40 2022] GET /compute/v2.1/servers/614f1ce2-fde0-40a8-b311-934ab2d51862 => generated 1654 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:35:40.598649 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-e619309c-ea4f-4aaa-9f77-ae51143b8910 req-a1820739-ea64-4df2-9382-0cbe6314387b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "614f1ce2-fde0-40a8-b311-934ab2d51862", "name": "network-vif-plugged", "status": "completed", "tag": "70aaa3a1-80c1-452c-b4db-169f61383a1b"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:35:40.609364 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-e619309c-ea4f-4aaa-9f77-ae51143b8910 req-a1820739-ea64-4df2-9382-0cbe6314387b service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:40.610253 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-e619309c-ea4f-4aaa-9f77-ae51143b8910 req-a1820739-ea64-4df2-9382-0cbe6314387b service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:40.610881 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-e619309c-ea4f-4aaa-9f77-ae51143b8910 req-a1820739-ea64-4df2-9382-0cbe6314387b service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:40.622762 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8c809ec2-a113-41d5-a183-3c41194abf23 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:35:40.623618 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-8c809ec2-a113-41d5-a183-3c41194abf23 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: 614f1ce2-fde0-40a8-b311-934ab2d51862] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:35:40.624840 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-e619309c-ea4f-4aaa-9f77-ae51143b8910 req-a1820739-ea64-4df2-9382-0cbe6314387b service nova] Creating event network-vif-plugged:70aaa3a1-80c1-452c-b4db-169f61383a1b for instance 614f1ce2-fde0-40a8-b311-934ab2d51862 on n-h2-854823-8 Oct 04 21:35:40.630456 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-e619309c-ea4f-4aaa-9f77-ae51143b8910 req-a1820739-ea64-4df2-9382-0cbe6314387b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036145 Oct 04 21:35:40.631055 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3351/6666] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:35:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:35:40.631534 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8c809ec2-a113-41d5-a183-3c41194abf23 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:40.632033 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8c809ec2-a113-41d5-a183-3c41194abf23 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:40.632694 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8c809ec2-a113-41d5-a183-3c41194abf23 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:40.633872 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8c809ec2-a113-41d5-a183-3c41194abf23 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:40.634366 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8c809ec2-a113-41d5-a183-3c41194abf23 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:40.634953 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8c809ec2-a113-41d5-a183-3c41194abf23 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:40.775570 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-8c809ec2-a113-41d5-a183-3c41194abf23 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b2b2b461354b8aa87cb19b0fb4fd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a146d50c0a544fe49bb604199bb67f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:35:40.784050 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-8c809ec2-a113-41d5-a183-3c41194abf23 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "GET /compute/v2.1/servers/614f1ce2-fde0-40a8-b311-934ab2d51862" status: 200 len: 1654 microversion: 2.1 time: 0.164974 Oct 04 21:35:40.784623 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3316/6667] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:35:40 2022] GET /compute/v2.1/servers/614f1ce2-fde0-40a8-b311-934ab2d51862 => generated 1654 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:35:40.808018 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-37d74e80-3cbd-44c0-aee3-642a6d27c98c tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:35:40.814307 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-37d74e80-3cbd-44c0-aee3-642a6d27c98c tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:40.814847 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-37d74e80-3cbd-44c0-aee3-642a6d27c98c tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:40.815300 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-37d74e80-3cbd-44c0-aee3-642a6d27c98c tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:40.837619 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-37d74e80-3cbd-44c0-aee3-642a6d27c98c tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: 614f1ce2-fde0-40a8-b311-934ab2d51862] Going to try to start instance {{(pid=128802) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 04 21:35:40.881182 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-37d74e80-3cbd-44c0-aee3-642a6d27c98c tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "POST /compute/v2.1/servers/614f1ce2-fde0-40a8-b311-934ab2d51862/action" status: 202 len: 0 microversion: 2.1 time: 0.077657 Oct 04 21:35:40.881813 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3352/6668] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 21:35:40 2022] POST /compute/v2.1/servers/614f1ce2-fde0-40a8-b311-934ab2d51862/action => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:35:40.890927 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-53ebd52c-c55d-44e4-b563-aa2bed1ba215 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:35:40.891587 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-53ebd52c-c55d-44e4-b563-aa2bed1ba215 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: 614f1ce2-fde0-40a8-b311-934ab2d51862] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:35:40.899027 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-53ebd52c-c55d-44e4-b563-aa2bed1ba215 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:40.899506 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-53ebd52c-c55d-44e4-b563-aa2bed1ba215 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:40.899957 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-53ebd52c-c55d-44e4-b563-aa2bed1ba215 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:40.900672 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-53ebd52c-c55d-44e4-b563-aa2bed1ba215 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:40.901276 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-53ebd52c-c55d-44e4-b563-aa2bed1ba215 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:40.901707 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-53ebd52c-c55d-44e4-b563-aa2bed1ba215 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:41.072233 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-53ebd52c-c55d-44e4-b563-aa2bed1ba215 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b2b2b461354b8aa87cb19b0fb4fd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a146d50c0a544fe49bb604199bb67f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:35:41.080664 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-53ebd52c-c55d-44e4-b563-aa2bed1ba215 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "GET /compute/v2.1/servers/614f1ce2-fde0-40a8-b311-934ab2d51862" status: 200 len: 1663 microversion: 2.1 time: 0.193857 Oct 04 21:35:41.081276 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3317/6669] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:35:40 2022] GET /compute/v2.1/servers/614f1ce2-fde0-40a8-b311-934ab2d51862 => generated 1663 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:35:42.107825 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-56c83615-0383-41ae-a7f8-f7a14590b778 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:35:42.108741 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-56c83615-0383-41ae-a7f8-f7a14590b778 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: 614f1ce2-fde0-40a8-b311-934ab2d51862] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:35:42.119594 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-56c83615-0383-41ae-a7f8-f7a14590b778 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:42.121314 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-56c83615-0383-41ae-a7f8-f7a14590b778 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:42.122096 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-56c83615-0383-41ae-a7f8-f7a14590b778 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:42.123398 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-56c83615-0383-41ae-a7f8-f7a14590b778 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:42.124144 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-56c83615-0383-41ae-a7f8-f7a14590b778 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:42.125401 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-56c83615-0383-41ae-a7f8-f7a14590b778 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:42.132342 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:35:42.277652 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-56c83615-0383-41ae-a7f8-f7a14590b778 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b2b2b461354b8aa87cb19b0fb4fd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a146d50c0a544fe49bb604199bb67f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:35:42.286945 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-56c83615-0383-41ae-a7f8-f7a14590b778 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "GET /compute/v2.1/servers/614f1ce2-fde0-40a8-b311-934ab2d51862" status: 200 len: 1667 microversion: 2.1 time: 0.185582 Oct 04 21:35:42.287785 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3353/6670] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:35:42 2022] GET /compute/v2.1/servers/614f1ce2-fde0-40a8-b311-934ab2d51862 => generated 1667 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:35:42.311148 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b82e5331-7f63-43d4-bdd1-1fd878e20549 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:35:42.311681 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b82e5331-7f63-43d4-bdd1-1fd878e20549 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: 614f1ce2-fde0-40a8-b311-934ab2d51862] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:35:42.319227 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b82e5331-7f63-43d4-bdd1-1fd878e20549 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:42.319721 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b82e5331-7f63-43d4-bdd1-1fd878e20549 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:42.320163 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b82e5331-7f63-43d4-bdd1-1fd878e20549 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:42.320867 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b82e5331-7f63-43d4-bdd1-1fd878e20549 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:42.321325 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b82e5331-7f63-43d4-bdd1-1fd878e20549 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:42.321752 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b82e5331-7f63-43d4-bdd1-1fd878e20549 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:42.349229 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b82e5331-7f63-43d4-bdd1-1fd878e20549 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: 614f1ce2-fde0-40a8-b311-934ab2d51862] Going to try to terminate instance {{(pid=128801) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:35:42.352499 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:35:42.433195 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b82e5331-7f63-43d4-bdd1-1fd878e20549 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "DELETE /compute/v2.1/servers/614f1ce2-fde0-40a8-b311-934ab2d51862" status: 204 len: 0 microversion: 2.1 time: 0.125462 Oct 04 21:35:42.433875 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3318/6671] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 21:35:42 2022] DELETE /compute/v2.1/servers/614f1ce2-fde0-40a8-b311-934ab2d51862 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:35:42.442559 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-0edd1b3b-6914-46cf-b35e-942756041cce tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:35:42.443190 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-0edd1b3b-6914-46cf-b35e-942756041cce tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: 614f1ce2-fde0-40a8-b311-934ab2d51862] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:35:42.449299 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0edd1b3b-6914-46cf-b35e-942756041cce tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:42.449779 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0edd1b3b-6914-46cf-b35e-942756041cce tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:42.450219 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0edd1b3b-6914-46cf-b35e-942756041cce tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:42.450994 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0edd1b3b-6914-46cf-b35e-942756041cce tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:42.451604 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0edd1b3b-6914-46cf-b35e-942756041cce tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:42.452064 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0edd1b3b-6914-46cf-b35e-942756041cce tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:42.587326 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-0edd1b3b-6914-46cf-b35e-942756041cce tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b2b2b461354b8aa87cb19b0fb4fd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a146d50c0a544fe49bb604199bb67f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:35:42.595127 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-0edd1b3b-6914-46cf-b35e-942756041cce tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "GET /compute/v2.1/servers/614f1ce2-fde0-40a8-b311-934ab2d51862" status: 200 len: 1673 microversion: 2.1 time: 0.156770 Oct 04 21:35:42.596244 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3354/6672] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:35:42 2022] GET /compute/v2.1/servers/614f1ce2-fde0-40a8-b311-934ab2d51862 => generated 1673 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:35:43.620828 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d5929b09-e219-411c-b32a-1c6168b72a57 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:35:43.621536 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d5929b09-e219-411c-b32a-1c6168b72a57 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: 614f1ce2-fde0-40a8-b311-934ab2d51862] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:35:43.628976 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d5929b09-e219-411c-b32a-1c6168b72a57 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:43.629453 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d5929b09-e219-411c-b32a-1c6168b72a57 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:43.629896 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d5929b09-e219-411c-b32a-1c6168b72a57 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:43.630623 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d5929b09-e219-411c-b32a-1c6168b72a57 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:43.631073 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d5929b09-e219-411c-b32a-1c6168b72a57 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:43.631493 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d5929b09-e219-411c-b32a-1c6168b72a57 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:43.768808 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d5929b09-e219-411c-b32a-1c6168b72a57 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b2b2b461354b8aa87cb19b0fb4fd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a146d50c0a544fe49bb604199bb67f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:35:43.778031 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d5929b09-e219-411c-b32a-1c6168b72a57 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "GET /compute/v2.1/servers/614f1ce2-fde0-40a8-b311-934ab2d51862" status: 200 len: 1673 microversion: 2.1 time: 0.161658 Oct 04 21:35:43.778653 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3319/6673] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:35:43 2022] GET /compute/v2.1/servers/614f1ce2-fde0-40a8-b311-934ab2d51862 => generated 1673 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:35:44.802331 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-ee0300f1-5cdf-43e7-b7ef-7f656db0a217 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:35:44.803247 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-ee0300f1-5cdf-43e7-b7ef-7f656db0a217 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: 614f1ce2-fde0-40a8-b311-934ab2d51862] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:35:44.810103 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ee0300f1-5cdf-43e7-b7ef-7f656db0a217 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:44.810622 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ee0300f1-5cdf-43e7-b7ef-7f656db0a217 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:44.811073 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ee0300f1-5cdf-43e7-b7ef-7f656db0a217 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:44.811796 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ee0300f1-5cdf-43e7-b7ef-7f656db0a217 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:44.812256 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ee0300f1-5cdf-43e7-b7ef-7f656db0a217 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:44.812691 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ee0300f1-5cdf-43e7-b7ef-7f656db0a217 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:44.912834 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-ee0300f1-5cdf-43e7-b7ef-7f656db0a217 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b2b2b461354b8aa87cb19b0fb4fd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a146d50c0a544fe49bb604199bb67f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:35:44.921469 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-ee0300f1-5cdf-43e7-b7ef-7f656db0a217 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "GET /compute/v2.1/servers/614f1ce2-fde0-40a8-b311-934ab2d51862" status: 200 len: 1605 microversion: 2.1 time: 0.122895 Oct 04 21:35:44.922270 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3355/6674] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:35:44 2022] GET /compute/v2.1/servers/614f1ce2-fde0-40a8-b311-934ab2d51862 => generated 1605 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:35:45.118721 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-071760e8-0093-4507-8fad-eeb82b2b385b req-0e90dcfe-ba4f-4053-9856-aa7a3fd55b94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "614f1ce2-fde0-40a8-b311-934ab2d51862", "name": "network-vif-deleted", "tag": "70aaa3a1-80c1-452c-b4db-169f61383a1b"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:35:45.132067 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-071760e8-0093-4507-8fad-eeb82b2b385b req-0e90dcfe-ba4f-4053-9856-aa7a3fd55b94 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:45.132635 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-071760e8-0093-4507-8fad-eeb82b2b385b req-0e90dcfe-ba4f-4053-9856-aa7a3fd55b94 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:45.133139 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-071760e8-0093-4507-8fad-eeb82b2b385b req-0e90dcfe-ba4f-4053-9856-aa7a3fd55b94 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:45.165389 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-071760e8-0093-4507-8fad-eeb82b2b385b req-0e90dcfe-ba4f-4053-9856-aa7a3fd55b94 service nova] Creating event network-vif-deleted:70aaa3a1-80c1-452c-b4db-169f61383a1b for instance 614f1ce2-fde0-40a8-b311-934ab2d51862 on n-h2-854823-8 Oct 04 21:35:45.176596 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-071760e8-0093-4507-8fad-eeb82b2b385b req-0e90dcfe-ba4f-4053-9856-aa7a3fd55b94 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061022 Oct 04 21:35:45.178291 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3320/6675] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:35:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:35:45.945880 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-ff284442-cc4f-4d3b-a5e8-207137e80957 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:35:45.946554 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-ff284442-cc4f-4d3b-a5e8-207137e80957 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: 614f1ce2-fde0-40a8-b311-934ab2d51862] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:35:45.953708 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ff284442-cc4f-4d3b-a5e8-207137e80957 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:45.954215 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ff284442-cc4f-4d3b-a5e8-207137e80957 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:45.954695 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ff284442-cc4f-4d3b-a5e8-207137e80957 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:45.956173 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ff284442-cc4f-4d3b-a5e8-207137e80957 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:45.956667 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ff284442-cc4f-4d3b-a5e8-207137e80957 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:45.957105 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ff284442-cc4f-4d3b-a5e8-207137e80957 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:45.971519 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.wsgi [None req-ff284442-cc4f-4d3b-a5e8-207137e80957 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] HTTP exception thrown: Instance 614f1ce2-fde0-40a8-b311-934ab2d51862 could not be found. Oct 04 21:35:45.973201 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-ff284442-cc4f-4d3b-a5e8-207137e80957 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Request method failure captured: Oct 04 21:35:45.973201 n-d-854823-8 devstack@n-api.service[128802]: request: GET /compute/v2.1/servers/614f1ce2-fde0-40a8-b311-934ab2d51862 HTTP/1.1 Oct 04 21:35:45.973201 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 21:35:45.973201 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 21:35:45.973201 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 21:35:45.973201 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 0 Oct 04 21:35:45.973201 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 21:35:45.973201 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 21:35:45.973201 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 21:35:45.973201 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 21:35:45.973201 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPKacG3zmlzrE0P03sqhhW8OxTX_N5d4FutccVYa--DxtxvF117E3y03wDG1eWqGIT6xlYZQeTInymX9iqEa1Cn-51caF2pJGBCFnPr7M2Ci1V2diBL1LhxAMFh-0O2THqSMgkeX7lBKNpS2ImrBtoud6Asim3w37JGPDnCp2IjwWzIw Oct 04 21:35:45.973201 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 21:35:45.973201 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 21:35:45.973201 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 21:35:45.973201 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 21:35:45.973201 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 21:35:45.973201 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 21:35:45.973201 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: a146d50c0a544fe49bb604199bb67f02 Oct 04 21:35:45.973201 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-ServerActionsTestJSON-1365673639 Oct 04 21:35:45.973201 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 21:35:45.973201 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 21:35:45.973201 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a146d50c0a544fe49bb604199bb67f02", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a146d50c0a544fe49bb604199bb67f02"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a146d50c0a544fe49bb604199bb67f02"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a146d50c0a544fe49bb604199bb67f02"}]}] Oct 04 21:35:45.973201 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-ServerActionsTestJSON-1365673639 Oct 04 21:35:45.973201 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: a146d50c0a544fe49bb604199bb67f02 Oct 04 21:35:45.973201 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-ServerActionsTestJSON-1365673639 Oct 04 21:35:45.973201 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-ServerActionsTestJSON-1365673639-project Oct 04 21:35:45.973201 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 21:35:45.973201 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 21:35:45.973201 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: a2b2b2b461354b8aa87cb19b0fb4fd28 Oct 04 21:35:45.973201 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-ServerActionsTestJSON-1365673639-project Oct 04 21:35:45.973201 n-d-854823-8 devstack@n-api.service[128802]: method: > Oct 04 21:35:45.973201 n-d-854823-8 devstack@n-api.service[128802]: exception: Instance 614f1ce2-fde0-40a8-b311-934ab2d51862 could not be found. Oct 04 21:35:45.973201 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'id': '614f1ce2-fde0-40a8-b311-934ab2d51862'} Oct 04 21:35:45.973201 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:35:45.973201 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:35:45.973201 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:35:45.973201 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:35:45.973201 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:35:45.973201 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:35:45.973201 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:35:45.973201 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:35:45.973201 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:35:45.973201 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:35:45.973201 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 614f1ce2-fde0-40a8-b311-934ab2d51862 could not be found. Oct 04 21:35:45.973201 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:35:45.973201 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:35:45.973201 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:35:45.973201 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:35:45.973201 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:35:45.973201 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:35:45.973201 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:35:45.973201 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:35:45.973201 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:35:45.973201 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:35:45.973201 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:35:45.973201 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:35:45.973201 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:35:45.973201 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:35:45.973201 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:35:45.973201 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:35:45.973201 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 614f1ce2-fde0-40a8-b311-934ab2d51862 could not be found. Oct 04 21:35:45.973201 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:35:45.973201 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:35:45.973201 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:35:45.977562 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:35:45.977562 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:35:45.977562 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:35:45.977562 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:35:45.977562 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:35:45.977562 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 614f1ce2-fde0-40a8-b311-934ab2d51862 could not be found. Oct 04 21:35:45.977562 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:35:45.977562 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-ff284442-cc4f-4d3b-a5e8-207137e80957 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Returning 404 to user: Instance 614f1ce2-fde0-40a8-b311-934ab2d51862 could not be found. {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:35:45.977562 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-ff284442-cc4f-4d3b-a5e8-207137e80957 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "GET /compute/v2.1/servers/614f1ce2-fde0-40a8-b311-934ab2d51862" status: 404 len: 111 microversion: 2.1 time: 0.032818 Oct 04 21:35:45.977562 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3356/6676] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:35:45 2022] GET /compute/v2.1/servers/614f1ce2-fde0-40a8-b311-934ab2d51862 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:35:45.988997 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-62dbf644-fb70-4693-9953-c4ef6d03a981 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:35:45.989707 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-62dbf644-fb70-4693-9953-c4ef6d03a981 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: 614f1ce2-fde0-40a8-b311-934ab2d51862] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:35:45.996689 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-62dbf644-fb70-4693-9953-c4ef6d03a981 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:45.997214 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-62dbf644-fb70-4693-9953-c4ef6d03a981 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:45.997633 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-62dbf644-fb70-4693-9953-c4ef6d03a981 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:45.998332 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-62dbf644-fb70-4693-9953-c4ef6d03a981 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:45.998809 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-62dbf644-fb70-4693-9953-c4ef6d03a981 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:45.999232 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-62dbf644-fb70-4693-9953-c4ef6d03a981 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:46.013948 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-62dbf644-fb70-4693-9953-c4ef6d03a981 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] HTTP exception thrown: Instance 614f1ce2-fde0-40a8-b311-934ab2d51862 could not be found. Oct 04 21:35:46.015666 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-62dbf644-fb70-4693-9953-c4ef6d03a981 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Request method failure captured: Oct 04 21:35:46.015666 n-d-854823-8 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/614f1ce2-fde0-40a8-b311-934ab2d51862 HTTP/1.1 Oct 04 21:35:46.015666 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 21:35:46.015666 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 21:35:46.015666 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 21:35:46.015666 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 0 Oct 04 21:35:46.015666 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 21:35:46.015666 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 21:35:46.015666 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 21:35:46.015666 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 21:35:46.015666 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPKacG3zmlzrE0P03sqhhW8OxTX_N5d4FutccVYa--DxtxvF117E3y03wDG1eWqGIT6xlYZQeTInymX9iqEa1Cn-51caF2pJGBCFnPr7M2Ci1V2diBL1LhxAMFh-0O2THqSMgkeX7lBKNpS2ImrBtoud6Asim3w37JGPDnCp2IjwWzIw Oct 04 21:35:46.015666 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 21:35:46.015666 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 21:35:46.015666 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 21:35:46.015666 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 21:35:46.015666 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 21:35:46.015666 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 21:35:46.015666 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: a146d50c0a544fe49bb604199bb67f02 Oct 04 21:35:46.015666 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-ServerActionsTestJSON-1365673639 Oct 04 21:35:46.015666 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 21:35:46.015666 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 21:35:46.015666 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a146d50c0a544fe49bb604199bb67f02", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a146d50c0a544fe49bb604199bb67f02"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a146d50c0a544fe49bb604199bb67f02"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a146d50c0a544fe49bb604199bb67f02"}]}] Oct 04 21:35:46.015666 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-ServerActionsTestJSON-1365673639 Oct 04 21:35:46.015666 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: a146d50c0a544fe49bb604199bb67f02 Oct 04 21:35:46.015666 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ServerActionsTestJSON-1365673639 Oct 04 21:35:46.015666 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-ServerActionsTestJSON-1365673639-project Oct 04 21:35:46.015666 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 21:35:46.015666 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 21:35:46.015666 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: a2b2b2b461354b8aa87cb19b0fb4fd28 Oct 04 21:35:46.015666 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-ServerActionsTestJSON-1365673639-project Oct 04 21:35:46.015666 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 21:35:46.015666 n-d-854823-8 devstack@n-api.service[128801]: exception: Instance 614f1ce2-fde0-40a8-b311-934ab2d51862 could not be found. Oct 04 21:35:46.015666 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': '614f1ce2-fde0-40a8-b311-934ab2d51862'} Oct 04 21:35:46.015666 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:35:46.015666 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:35:46.015666 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:35:46.015666 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:35:46.015666 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:35:46.015666 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:35:46.015666 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:35:46.015666 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:35:46.015666 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:35:46.015666 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:35:46.015666 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 614f1ce2-fde0-40a8-b311-934ab2d51862 could not be found. Oct 04 21:35:46.015666 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:35:46.015666 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:35:46.015666 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:35:46.015666 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:35:46.015666 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:35:46.015666 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:35:46.015666 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:35:46.015666 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:35:46.015666 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:35:46.015666 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:35:46.015666 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:35:46.015666 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:35:46.015666 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:35:46.015666 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:35:46.015666 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:35:46.015666 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:35:46.015666 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 614f1ce2-fde0-40a8-b311-934ab2d51862 could not be found. Oct 04 21:35:46.015666 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:35:46.015666 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:35:46.015666 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:35:46.021033 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:35:46.021033 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:35:46.021033 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:35:46.021033 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:35:46.021033 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:35:46.021033 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 614f1ce2-fde0-40a8-b311-934ab2d51862 could not be found. Oct 04 21:35:46.021033 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:35:46.021033 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-62dbf644-fb70-4693-9953-c4ef6d03a981 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Returning 404 to user: Instance 614f1ce2-fde0-40a8-b311-934ab2d51862 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:35:46.021033 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-62dbf644-fb70-4693-9953-c4ef6d03a981 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "GET /compute/v2.1/servers/614f1ce2-fde0-40a8-b311-934ab2d51862" status: 404 len: 111 microversion: 2.1 time: 0.032430 Oct 04 21:35:46.021033 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3321/6677] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:35:45 2022] GET /compute/v2.1/servers/614f1ce2-fde0-40a8-b311-934ab2d51862 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:35:46.070805 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-5ae2d29a-b355-435e-a83a-70dcc7fd106b tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1056782557", "imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63", "flavorRef": "452", "networks": [{"uuid": "be02f5cd-2d7d-418b-9089-057dd1d5b96e"}], "security_groups": [{"name": "tempest-securitygroup--1075800401"}], "key_name": "tempest-keypair-1781922112", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:35:46.185050 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.network.neutron [None req-5ae2d29a-b355-435e-a83a-70dcc7fd106b tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] validate_networks() for [('be02f5cd-2d7d-418b-9089-057dd1d5b96e', None, None, None, None, None)] {{(pid=128802) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:35:46.565581 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-5ae2d29a-b355-435e-a83a-70dcc7fd106b tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Flavor limits 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:35:46.566020 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-5ae2d29a-b355-435e-a83a-70dcc7fd106b tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Image limits 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:35:46.566560 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-5ae2d29a-b355-435e-a83a-70dcc7fd106b tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Flavor pref 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:35:46.566985 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-5ae2d29a-b355-435e-a83a-70dcc7fd106b tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Image pref 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:35:46.567410 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-5ae2d29a-b355-435e-a83a-70dcc7fd106b tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:35:46.576582 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5ae2d29a-b355-435e-a83a-70dcc7fd106b tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:46.577080 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5ae2d29a-b355-435e-a83a-70dcc7fd106b tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:46.577532 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5ae2d29a-b355-435e-a83a-70dcc7fd106b tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:46.578276 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5ae2d29a-b355-435e-a83a-70dcc7fd106b tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:46.578780 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5ae2d29a-b355-435e-a83a-70dcc7fd106b tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:46.579221 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5ae2d29a-b355-435e-a83a-70dcc7fd106b tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:46.596654 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-5ae2d29a-b355-435e-a83a-70dcc7fd106b tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Getting quotas for project a146d50c0a544fe49bb604199bb67f02. Resources: {'ram', 'instances', 'cores'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:35:46.602316 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-5ae2d29a-b355-435e-a83a-70dcc7fd106b tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Getting quotas for user a2b2b2b461354b8aa87cb19b0fb4fd28 and project a146d50c0a544fe49bb604199bb67f02. Resources: {'ram', 'instances', 'cores'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:35:46.615524 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-5ae2d29a-b355-435e-a83a-70dcc7fd106b tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Going to run 1 instances... {{(pid=128802) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:35:46.617890 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-5ae2d29a-b355-435e-a83a-70dcc7fd106b tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: c11732ff-0b88-4136-8e45-3f8d52ff4a9f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='15b24725-0c99-4bcf-b1fb-907cdf8e2d63',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128802) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:35:46.667910 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-5ae2d29a-b355-435e-a83a-70dcc7fd106b tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.601044 Oct 04 21:35:46.668829 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3357/6678] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 21:35:46 2022] POST /compute/v2.1/servers => generated 406 bytes in 603 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:35:46.681289 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-02a8980a-f45a-4676-8c52-5e37343c8e59 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:35:46.682002 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-02a8980a-f45a-4676-8c52-5e37343c8e59 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: c11732ff-0b88-4136-8e45-3f8d52ff4a9f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:35:46.751673 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-02a8980a-f45a-4676-8c52-5e37343c8e59 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b2b2b461354b8aa87cb19b0fb4fd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a146d50c0a544fe49bb604199bb67f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:35:46.758963 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-02a8980a-f45a-4676-8c52-5e37343c8e59 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "GET /compute/v2.1/servers/c11732ff-0b88-4136-8e45-3f8d52ff4a9f" status: 200 len: 1239 microversion: 2.1 time: 0.082149 Oct 04 21:35:46.759538 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3322/6679] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:35:46 2022] GET /compute/v2.1/servers/c11732ff-0b88-4136-8e45-3f8d52ff4a9f => generated 1239 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:35:47.783233 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-ddaab027-e872-4fa4-abcb-d7ba81ef0673 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:35:47.784193 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-ddaab027-e872-4fa4-abcb-d7ba81ef0673 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: c11732ff-0b88-4136-8e45-3f8d52ff4a9f] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:35:47.791592 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ddaab027-e872-4fa4-abcb-d7ba81ef0673 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:47.792224 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ddaab027-e872-4fa4-abcb-d7ba81ef0673 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:47.792710 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ddaab027-e872-4fa4-abcb-d7ba81ef0673 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:47.793684 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ddaab027-e872-4fa4-abcb-d7ba81ef0673 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:47.794152 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ddaab027-e872-4fa4-abcb-d7ba81ef0673 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:47.794622 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ddaab027-e872-4fa4-abcb-d7ba81ef0673 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:47.900433 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-ddaab027-e872-4fa4-abcb-d7ba81ef0673 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b2b2b461354b8aa87cb19b0fb4fd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a146d50c0a544fe49bb604199bb67f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:35:47.910725 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-ddaab027-e872-4fa4-abcb-d7ba81ef0673 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "GET /compute/v2.1/servers/c11732ff-0b88-4136-8e45-3f8d52ff4a9f" status: 200 len: 1299 microversion: 2.1 time: 0.132326 Oct 04 21:35:47.911478 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3358/6680] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:35:47 2022] GET /compute/v2.1/servers/c11732ff-0b88-4136-8e45-3f8d52ff4a9f => generated 1299 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:35:48.934867 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8b9a451a-5228-40e6-be3f-f876a242bd3d tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:35:48.935428 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-8b9a451a-5228-40e6-be3f-f876a242bd3d tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: c11732ff-0b88-4136-8e45-3f8d52ff4a9f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:35:48.944279 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8b9a451a-5228-40e6-be3f-f876a242bd3d tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:48.944773 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8b9a451a-5228-40e6-be3f-f876a242bd3d tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:48.945207 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8b9a451a-5228-40e6-be3f-f876a242bd3d tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:48.945911 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8b9a451a-5228-40e6-be3f-f876a242bd3d tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:48.946383 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8b9a451a-5228-40e6-be3f-f876a242bd3d tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:48.946812 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8b9a451a-5228-40e6-be3f-f876a242bd3d tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:49.175584 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-8b9a451a-5228-40e6-be3f-f876a242bd3d tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b2b2b461354b8aa87cb19b0fb4fd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a146d50c0a544fe49bb604199bb67f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:35:49.184213 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-8b9a451a-5228-40e6-be3f-f876a242bd3d tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "GET /compute/v2.1/servers/c11732ff-0b88-4136-8e45-3f8d52ff4a9f" status: 200 len: 1365 microversion: 2.1 time: 0.253404 Oct 04 21:35:49.184806 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3323/6681] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:35:48 2022] GET /compute/v2.1/servers/c11732ff-0b88-4136-8e45-3f8d52ff4a9f => generated 1365 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:35:49.538250 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-ec25571c-1ee1-439e-8747-e27bd0760a9c req-7678ec00-98fa-4ef7-ae6b-dadfda5d9022 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c11732ff-0b88-4136-8e45-3f8d52ff4a9f", "tag": "4af92995-1850-4fb3-89d8-10c727a24d6e"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:35:49.545474 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=3 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:35:49.552287 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-ec25571c-1ee1-439e-8747-e27bd0760a9c req-7678ec00-98fa-4ef7-ae6b-dadfda5d9022 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:49.553390 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-ec25571c-1ee1-439e-8747-e27bd0760a9c req-7678ec00-98fa-4ef7-ae6b-dadfda5d9022 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:49.553917 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-ec25571c-1ee1-439e-8747-e27bd0760a9c req-7678ec00-98fa-4ef7-ae6b-dadfda5d9022 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:49.567845 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-ec25571c-1ee1-439e-8747-e27bd0760a9c req-7678ec00-98fa-4ef7-ae6b-dadfda5d9022 service nova] Creating event network-changed:4af92995-1850-4fb3-89d8-10c727a24d6e for instance c11732ff-0b88-4136-8e45-3f8d52ff4a9f on n-h2-854823-8 Oct 04 21:35:49.572857 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-ec25571c-1ee1-439e-8747-e27bd0760a9c req-7678ec00-98fa-4ef7-ae6b-dadfda5d9022 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038423 Oct 04 21:35:49.573484 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3359/6682] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:35:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:35:50.217259 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-11651f6d-25d6-4fa6-9c8e-d5746429ee01 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:35:50.217879 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-11651f6d-25d6-4fa6-9c8e-d5746429ee01 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: c11732ff-0b88-4136-8e45-3f8d52ff4a9f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:35:50.220730 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:35:50.226966 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-11651f6d-25d6-4fa6-9c8e-d5746429ee01 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:50.227581 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-11651f6d-25d6-4fa6-9c8e-d5746429ee01 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:50.228145 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-11651f6d-25d6-4fa6-9c8e-d5746429ee01 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:50.228933 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-11651f6d-25d6-4fa6-9c8e-d5746429ee01 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:50.229426 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-11651f6d-25d6-4fa6-9c8e-d5746429ee01 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:50.229886 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-11651f6d-25d6-4fa6-9c8e-d5746429ee01 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:50.363637 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-11651f6d-25d6-4fa6-9c8e-d5746429ee01 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b2b2b461354b8aa87cb19b0fb4fd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a146d50c0a544fe49bb604199bb67f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:35:50.371508 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-11651f6d-25d6-4fa6-9c8e-d5746429ee01 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "GET /compute/v2.1/servers/c11732ff-0b88-4136-8e45-3f8d52ff4a9f" status: 200 len: 1365 microversion: 2.1 time: 0.158230 Oct 04 21:35:50.372086 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3324/6683] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:35:50 2022] GET /compute/v2.1/servers/c11732ff-0b88-4136-8e45-3f8d52ff4a9f => generated 1365 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:35:51.396910 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-c7879a78-fc15-4418-8dd8-f08c5a5f3791 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:35:51.397625 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-c7879a78-fc15-4418-8dd8-f08c5a5f3791 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: c11732ff-0b88-4136-8e45-3f8d52ff4a9f] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:35:51.403958 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c7879a78-fc15-4418-8dd8-f08c5a5f3791 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:51.404456 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c7879a78-fc15-4418-8dd8-f08c5a5f3791 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:51.404909 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c7879a78-fc15-4418-8dd8-f08c5a5f3791 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:51.405621 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c7879a78-fc15-4418-8dd8-f08c5a5f3791 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:51.406094 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c7879a78-fc15-4418-8dd8-f08c5a5f3791 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:51.406574 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c7879a78-fc15-4418-8dd8-f08c5a5f3791 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:51.542601 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-c7879a78-fc15-4418-8dd8-f08c5a5f3791 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b2b2b461354b8aa87cb19b0fb4fd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a146d50c0a544fe49bb604199bb67f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:35:51.551251 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-c7879a78-fc15-4418-8dd8-f08c5a5f3791 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "GET /compute/v2.1/servers/c11732ff-0b88-4136-8e45-3f8d52ff4a9f" status: 200 len: 1365 microversion: 2.1 time: 0.159556 Oct 04 21:35:51.551837 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3360/6684] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:35:51 2022] GET /compute/v2.1/servers/c11732ff-0b88-4136-8e45-3f8d52ff4a9f => generated 1365 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:35:52.575507 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b6c977fe-53d6-4b85-8ad1-c78472e7dfa7 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:35:52.576122 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b6c977fe-53d6-4b85-8ad1-c78472e7dfa7 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: c11732ff-0b88-4136-8e45-3f8d52ff4a9f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:35:52.584724 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b6c977fe-53d6-4b85-8ad1-c78472e7dfa7 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:52.585221 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b6c977fe-53d6-4b85-8ad1-c78472e7dfa7 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:52.585664 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b6c977fe-53d6-4b85-8ad1-c78472e7dfa7 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:52.586427 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b6c977fe-53d6-4b85-8ad1-c78472e7dfa7 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:52.586898 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b6c977fe-53d6-4b85-8ad1-c78472e7dfa7 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:52.587340 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b6c977fe-53d6-4b85-8ad1-c78472e7dfa7 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:52.731444 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-b6c977fe-53d6-4b85-8ad1-c78472e7dfa7 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b2b2b461354b8aa87cb19b0fb4fd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a146d50c0a544fe49bb604199bb67f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:35:52.740145 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b6c977fe-53d6-4b85-8ad1-c78472e7dfa7 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "GET /compute/v2.1/servers/c11732ff-0b88-4136-8e45-3f8d52ff4a9f" status: 200 len: 1365 microversion: 2.1 time: 0.168718 Oct 04 21:35:52.740772 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3325/6685] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:35:52 2022] GET /compute/v2.1/servers/c11732ff-0b88-4136-8e45-3f8d52ff4a9f => generated 1365 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:35:53.764183 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-4f5e078e-9059-4154-accb-03cfb0e535d8 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:35:53.764796 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-4f5e078e-9059-4154-accb-03cfb0e535d8 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: c11732ff-0b88-4136-8e45-3f8d52ff4a9f] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:35:53.772504 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4f5e078e-9059-4154-accb-03cfb0e535d8 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:53.772997 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4f5e078e-9059-4154-accb-03cfb0e535d8 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:53.773444 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4f5e078e-9059-4154-accb-03cfb0e535d8 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:53.774156 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4f5e078e-9059-4154-accb-03cfb0e535d8 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:53.774651 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4f5e078e-9059-4154-accb-03cfb0e535d8 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:53.775084 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4f5e078e-9059-4154-accb-03cfb0e535d8 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:53.916528 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-4f5e078e-9059-4154-accb-03cfb0e535d8 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b2b2b461354b8aa87cb19b0fb4fd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a146d50c0a544fe49bb604199bb67f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:35:53.925547 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-4f5e078e-9059-4154-accb-03cfb0e535d8 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "GET /compute/v2.1/servers/c11732ff-0b88-4136-8e45-3f8d52ff4a9f" status: 200 len: 1365 microversion: 2.1 time: 0.165269 Oct 04 21:35:53.926148 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3361/6686] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:35:53 2022] GET /compute/v2.1/servers/c11732ff-0b88-4136-8e45-3f8d52ff4a9f => generated 1365 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:35:54.647072 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-6f987b5c-c695-48a2-8443-58645f34ad1a req-a0e3b428-2e92-46a4-9336-bc6e57449d32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c11732ff-0b88-4136-8e45-3f8d52ff4a9f", "name": "network-vif-plugged", "status": "completed", "tag": "4af92995-1850-4fb3-89d8-10c727a24d6e"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:35:54.659042 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-6f987b5c-c695-48a2-8443-58645f34ad1a req-a0e3b428-2e92-46a4-9336-bc6e57449d32 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:54.659538 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-6f987b5c-c695-48a2-8443-58645f34ad1a req-a0e3b428-2e92-46a4-9336-bc6e57449d32 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:54.659977 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-6f987b5c-c695-48a2-8443-58645f34ad1a req-a0e3b428-2e92-46a4-9336-bc6e57449d32 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:54.672013 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-6f987b5c-c695-48a2-8443-58645f34ad1a req-a0e3b428-2e92-46a4-9336-bc6e57449d32 service nova] Creating event network-vif-plugged:4af92995-1850-4fb3-89d8-10c727a24d6e for instance c11732ff-0b88-4136-8e45-3f8d52ff4a9f on n-h2-854823-8 Oct 04 21:35:54.678632 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-6f987b5c-c695-48a2-8443-58645f34ad1a req-a0e3b428-2e92-46a4-9336-bc6e57449d32 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034806 Oct 04 21:35:54.678818 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3326/6687] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:35:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:35:54.950428 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-af50acd3-1e10-4062-8073-e0b5d72f4ae0 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:35:54.951065 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-af50acd3-1e10-4062-8073-e0b5d72f4ae0 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: c11732ff-0b88-4136-8e45-3f8d52ff4a9f] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:35:54.958687 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-af50acd3-1e10-4062-8073-e0b5d72f4ae0 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:54.959191 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-af50acd3-1e10-4062-8073-e0b5d72f4ae0 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:54.959638 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-af50acd3-1e10-4062-8073-e0b5d72f4ae0 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:54.960378 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-af50acd3-1e10-4062-8073-e0b5d72f4ae0 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:54.960847 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-af50acd3-1e10-4062-8073-e0b5d72f4ae0 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:54.961285 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-af50acd3-1e10-4062-8073-e0b5d72f4ae0 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:55.098370 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-af50acd3-1e10-4062-8073-e0b5d72f4ae0 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b2b2b461354b8aa87cb19b0fb4fd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a146d50c0a544fe49bb604199bb67f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:35:55.106306 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-af50acd3-1e10-4062-8073-e0b5d72f4ae0 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "GET /compute/v2.1/servers/c11732ff-0b88-4136-8e45-3f8d52ff4a9f" status: 200 len: 1365 microversion: 2.1 time: 0.159837 Oct 04 21:35:55.106926 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3362/6688] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:35:54 2022] GET /compute/v2.1/servers/c11732ff-0b88-4136-8e45-3f8d52ff4a9f => generated 1365 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:35:56.131932 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7cd1bf09-5ad4-4dd3-aee0-e2ae1b944ed1 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:35:56.132644 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-7cd1bf09-5ad4-4dd3-aee0-e2ae1b944ed1 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: c11732ff-0b88-4136-8e45-3f8d52ff4a9f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:35:56.141263 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7cd1bf09-5ad4-4dd3-aee0-e2ae1b944ed1 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:56.141849 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7cd1bf09-5ad4-4dd3-aee0-e2ae1b944ed1 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:56.142602 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7cd1bf09-5ad4-4dd3-aee0-e2ae1b944ed1 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:56.143665 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7cd1bf09-5ad4-4dd3-aee0-e2ae1b944ed1 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:56.144209 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7cd1bf09-5ad4-4dd3-aee0-e2ae1b944ed1 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:56.144618 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7cd1bf09-5ad4-4dd3-aee0-e2ae1b944ed1 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:56.290366 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-7cd1bf09-5ad4-4dd3-aee0-e2ae1b944ed1 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b2b2b461354b8aa87cb19b0fb4fd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a146d50c0a544fe49bb604199bb67f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:35:56.299235 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-7cd1bf09-5ad4-4dd3-aee0-e2ae1b944ed1 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "GET /compute/v2.1/servers/c11732ff-0b88-4136-8e45-3f8d52ff4a9f" status: 200 len: 1551 microversion: 2.1 time: 0.172276 Oct 04 21:35:56.299774 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3327/6689] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:35:56 2022] GET /compute/v2.1/servers/c11732ff-0b88-4136-8e45-3f8d52ff4a9f => generated 1551 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:35:56.322929 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-b4fcc9c8-6b5d-4931-b962-d3f2e24d044e tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:35:56.323455 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-b4fcc9c8-6b5d-4931-b962-d3f2e24d044e tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: c11732ff-0b88-4136-8e45-3f8d52ff4a9f] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:35:56.330483 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b4fcc9c8-6b5d-4931-b962-d3f2e24d044e tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:56.330900 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b4fcc9c8-6b5d-4931-b962-d3f2e24d044e tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:56.331347 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b4fcc9c8-6b5d-4931-b962-d3f2e24d044e tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:56.332061 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b4fcc9c8-6b5d-4931-b962-d3f2e24d044e tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:56.332531 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b4fcc9c8-6b5d-4931-b962-d3f2e24d044e tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:56.332964 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b4fcc9c8-6b5d-4931-b962-d3f2e24d044e tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:56.414009 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-b4fcc9c8-6b5d-4931-b962-d3f2e24d044e tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "GET /compute/v2.1/servers/c11732ff-0b88-4136-8e45-3f8d52ff4a9f/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.094946 Oct 04 21:35:56.414666 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3363/6690] 10.222.0.33 () {58 vars in 1275 bytes} [Tue Oct 4 21:35:56 2022] GET /compute/v2.1/servers/c11732ff-0b88-4136-8e45-3f8d52ff4a9f/os-interface => generated 285 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:35:57.385150 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-ab3e5d24-c520-46ec-a4bd-11d0eb595623 req-1c56a044-232a-4ec0-834d-e20d3f774a4a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c11732ff-0b88-4136-8e45-3f8d52ff4a9f", "tag": "4af92995-1850-4fb3-89d8-10c727a24d6e"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:35:57.390250 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:35:57.397859 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-ab3e5d24-c520-46ec-a4bd-11d0eb595623 req-1c56a044-232a-4ec0-834d-e20d3f774a4a service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:35:57.398481 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-ab3e5d24-c520-46ec-a4bd-11d0eb595623 req-1c56a044-232a-4ec0-834d-e20d3f774a4a service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:35:57.398924 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-ab3e5d24-c520-46ec-a4bd-11d0eb595623 req-1c56a044-232a-4ec0-834d-e20d3f774a4a service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:35:57.412593 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-ab3e5d24-c520-46ec-a4bd-11d0eb595623 req-1c56a044-232a-4ec0-834d-e20d3f774a4a service nova] Creating event network-changed:4af92995-1850-4fb3-89d8-10c727a24d6e for instance c11732ff-0b88-4136-8e45-3f8d52ff4a9f on n-h2-854823-8 Oct 04 21:35:57.417640 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-ab3e5d24-c520-46ec-a4bd-11d0eb595623 req-1c56a044-232a-4ec0-834d-e20d3f774a4a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036274 Oct 04 21:35:57.418254 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3328/6691] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:35:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:36:32.303814 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell0:SELECT=2 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:36:32.304599 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell0:SELECT=6 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:36:32.307736 n-d-854823-8 devstack@n-api.service[128802]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 21:36:32.307922 n-d-854823-8 devstack@n-api.service[128802]: Tue Oct 4 21:36:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c11732ff-0b88-4136-8e45-3f8d52ff4a9f/action (ip 10.222.0.33) !!! Oct 04 21:36:32.309760 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_api:SELECT=9 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:36:32.310466 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=51 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:36:32.321583 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-c8a09f83-7089-4ce2-85dc-f70683fbb627 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:36:32.323920 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-c8a09f83-7089-4ce2-85dc-f70683fbb627 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: c11732ff-0b88-4136-8e45-3f8d52ff4a9f] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:36:32.333140 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c8a09f83-7089-4ce2-85dc-f70683fbb627 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:32.333634 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c8a09f83-7089-4ce2-85dc-f70683fbb627 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:32.334078 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c8a09f83-7089-4ce2-85dc-f70683fbb627 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:32.334812 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c8a09f83-7089-4ce2-85dc-f70683fbb627 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:32.335275 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c8a09f83-7089-4ce2-85dc-f70683fbb627 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:32.335708 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c8a09f83-7089-4ce2-85dc-f70683fbb627 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:32.364596 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-c8a09f83-7089-4ce2-85dc-f70683fbb627 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'a2b2b2b461354b8aa87cb19b0fb4fd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a146d50c0a544fe49bb604199bb67f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:36:32.370728 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-c8a09f83-7089-4ce2-85dc-f70683fbb627 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: c11732ff-0b88-4136-8e45-3f8d52ff4a9f] Old instance type m1.heat2, new instance type m1.heat {{(pid=128802) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 04 21:36:32.376937 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-c8a09f83-7089-4ce2-85dc-f70683fbb627 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Flavor limits 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:36:32.377362 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-c8a09f83-7089-4ce2-85dc-f70683fbb627 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Image limits 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:36:32.378427 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-c8a09f83-7089-4ce2-85dc-f70683fbb627 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Flavor pref 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:36:32.379125 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-c8a09f83-7089-4ce2-85dc-f70683fbb627 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Image pref 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:36:32.379550 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-c8a09f83-7089-4ce2-85dc-f70683fbb627 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:36:32.448142 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-c8a09f83-7089-4ce2-85dc-f70683fbb627 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "POST /compute/v2.1/servers/c11732ff-0b88-4136-8e45-3f8d52ff4a9f/action" status: 202 len: 0 microversion: 2.1 time: 0.145095 Oct 04 21:36:32.448773 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3364/6692] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 21:36:32 2022] POST /compute/v2.1/servers/c11732ff-0b88-4136-8e45-3f8d52ff4a9f/action => generated 0 bytes in 147 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:36:32.455484 n-d-854823-8 devstack@n-api.service[128801]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 21:36:32.456518 n-d-854823-8 devstack@n-api.service[128801]: Tue Oct 4 21:36:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c11732ff-0b88-4136-8e45-3f8d52ff4a9f (ip 10.222.0.33) !!! Oct 04 21:36:32.457787 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=9 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:36:32.458673 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=46,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:36:32.462999 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-44136068-bd9c-4da1-8dfc-5bfe52421a91 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:36:32.463710 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-44136068-bd9c-4da1-8dfc-5bfe52421a91 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: c11732ff-0b88-4136-8e45-3f8d52ff4a9f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:36:32.473734 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-44136068-bd9c-4da1-8dfc-5bfe52421a91 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:32.474269 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-44136068-bd9c-4da1-8dfc-5bfe52421a91 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:32.474738 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-44136068-bd9c-4da1-8dfc-5bfe52421a91 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:32.475519 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-44136068-bd9c-4da1-8dfc-5bfe52421a91 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:32.475924 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-44136068-bd9c-4da1-8dfc-5bfe52421a91 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:32.476342 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-44136068-bd9c-4da1-8dfc-5bfe52421a91 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:32.715861 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-44136068-bd9c-4da1-8dfc-5bfe52421a91 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b2b2b461354b8aa87cb19b0fb4fd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a146d50c0a544fe49bb604199bb67f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:36:32.724414 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-44136068-bd9c-4da1-8dfc-5bfe52421a91 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "GET /compute/v2.1/servers/c11732ff-0b88-4136-8e45-3f8d52ff4a9f" status: 200 len: 1679 microversion: 2.1 time: 0.271226 Oct 04 21:36:32.725038 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3329/6693] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:36:32 2022] GET /compute/v2.1/servers/c11732ff-0b88-4136-8e45-3f8d52ff4a9f => generated 1679 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:36:33.751118 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-95c82d9f-7eeb-407d-bfbe-306586629e4f tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:36:33.752054 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-95c82d9f-7eeb-407d-bfbe-306586629e4f tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: c11732ff-0b88-4136-8e45-3f8d52ff4a9f] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:36:33.761140 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-95c82d9f-7eeb-407d-bfbe-306586629e4f tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:33.761868 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-95c82d9f-7eeb-407d-bfbe-306586629e4f tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:33.762591 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-95c82d9f-7eeb-407d-bfbe-306586629e4f tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:33.763458 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-95c82d9f-7eeb-407d-bfbe-306586629e4f tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:33.763933 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-95c82d9f-7eeb-407d-bfbe-306586629e4f tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:33.764374 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-95c82d9f-7eeb-407d-bfbe-306586629e4f tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:34.060025 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-95c82d9f-7eeb-407d-bfbe-306586629e4f tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b2b2b461354b8aa87cb19b0fb4fd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a146d50c0a544fe49bb604199bb67f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:36:34.068877 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-95c82d9f-7eeb-407d-bfbe-306586629e4f tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "GET /compute/v2.1/servers/c11732ff-0b88-4136-8e45-3f8d52ff4a9f" status: 200 len: 1679 microversion: 2.1 time: 0.323968 Oct 04 21:36:34.069501 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3365/6694] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:36:33 2022] GET /compute/v2.1/servers/c11732ff-0b88-4136-8e45-3f8d52ff4a9f => generated 1679 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:36:35.093521 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-af7eec4d-96f2-4837-bd4a-5714e8551ca7 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:36:35.094055 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-af7eec4d-96f2-4837-bd4a-5714e8551ca7 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: c11732ff-0b88-4136-8e45-3f8d52ff4a9f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:36:35.101527 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-af7eec4d-96f2-4837-bd4a-5714e8551ca7 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:35.102018 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-af7eec4d-96f2-4837-bd4a-5714e8551ca7 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:35.102493 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-af7eec4d-96f2-4837-bd4a-5714e8551ca7 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:35.103202 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-af7eec4d-96f2-4837-bd4a-5714e8551ca7 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:35.103664 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-af7eec4d-96f2-4837-bd4a-5714e8551ca7 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:35.104091 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-af7eec4d-96f2-4837-bd4a-5714e8551ca7 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:35.246489 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-af7eec4d-96f2-4837-bd4a-5714e8551ca7 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b2b2b461354b8aa87cb19b0fb4fd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a146d50c0a544fe49bb604199bb67f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:36:35.255392 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-af7eec4d-96f2-4837-bd4a-5714e8551ca7 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "GET /compute/v2.1/servers/c11732ff-0b88-4136-8e45-3f8d52ff4a9f" status: 200 len: 1684 microversion: 2.1 time: 0.165864 Oct 04 21:36:35.256009 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3330/6695] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:36:35 2022] GET /compute/v2.1/servers/c11732ff-0b88-4136-8e45-3f8d52ff4a9f => generated 1684 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:36:36.278703 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-140e10b0-cd20-490c-95b8-cf96ff36fc33 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:36:36.279341 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-140e10b0-cd20-490c-95b8-cf96ff36fc33 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: c11732ff-0b88-4136-8e45-3f8d52ff4a9f] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:36:36.287012 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-140e10b0-cd20-490c-95b8-cf96ff36fc33 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:36.287514 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-140e10b0-cd20-490c-95b8-cf96ff36fc33 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:36.287965 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-140e10b0-cd20-490c-95b8-cf96ff36fc33 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:36.288677 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-140e10b0-cd20-490c-95b8-cf96ff36fc33 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:36.289144 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-140e10b0-cd20-490c-95b8-cf96ff36fc33 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:36.289585 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-140e10b0-cd20-490c-95b8-cf96ff36fc33 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:36.426303 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-140e10b0-cd20-490c-95b8-cf96ff36fc33 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b2b2b461354b8aa87cb19b0fb4fd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a146d50c0a544fe49bb604199bb67f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:36:36.434816 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-140e10b0-cd20-490c-95b8-cf96ff36fc33 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "GET /compute/v2.1/servers/c11732ff-0b88-4136-8e45-3f8d52ff4a9f" status: 200 len: 1684 microversion: 2.1 time: 0.159996 Oct 04 21:36:36.435398 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3366/6696] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:36:36 2022] GET /compute/v2.1/servers/c11732ff-0b88-4136-8e45-3f8d52ff4a9f => generated 1684 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:36:37.460219 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e1170df3-fd4a-4a46-9e73-6f27f3649edc tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:36:37.461638 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e1170df3-fd4a-4a46-9e73-6f27f3649edc tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: c11732ff-0b88-4136-8e45-3f8d52ff4a9f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:36:37.467899 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e1170df3-fd4a-4a46-9e73-6f27f3649edc tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:37.468381 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e1170df3-fd4a-4a46-9e73-6f27f3649edc tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:37.468812 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e1170df3-fd4a-4a46-9e73-6f27f3649edc tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:37.469503 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e1170df3-fd4a-4a46-9e73-6f27f3649edc tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:37.469958 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e1170df3-fd4a-4a46-9e73-6f27f3649edc tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:37.470400 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e1170df3-fd4a-4a46-9e73-6f27f3649edc tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:37.607373 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e1170df3-fd4a-4a46-9e73-6f27f3649edc tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b2b2b461354b8aa87cb19b0fb4fd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a146d50c0a544fe49bb604199bb67f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:36:37.615612 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e1170df3-fd4a-4a46-9e73-6f27f3649edc tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "GET /compute/v2.1/servers/c11732ff-0b88-4136-8e45-3f8d52ff4a9f" status: 200 len: 1684 microversion: 2.1 time: 0.159774 Oct 04 21:36:37.616310 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3331/6697] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:36:37 2022] GET /compute/v2.1/servers/c11732ff-0b88-4136-8e45-3f8d52ff4a9f => generated 1684 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:36:38.639031 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-8e299800-2bad-4cba-b2a6-f313d0032700 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:36:38.639674 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-8e299800-2bad-4cba-b2a6-f313d0032700 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: c11732ff-0b88-4136-8e45-3f8d52ff4a9f] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:36:38.647816 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8e299800-2bad-4cba-b2a6-f313d0032700 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:38.648346 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8e299800-2bad-4cba-b2a6-f313d0032700 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:38.648781 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8e299800-2bad-4cba-b2a6-f313d0032700 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:38.649517 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8e299800-2bad-4cba-b2a6-f313d0032700 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:38.650021 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8e299800-2bad-4cba-b2a6-f313d0032700 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:38.650495 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8e299800-2bad-4cba-b2a6-f313d0032700 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:38.803890 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-8e299800-2bad-4cba-b2a6-f313d0032700 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b2b2b461354b8aa87cb19b0fb4fd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a146d50c0a544fe49bb604199bb67f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:36:38.812624 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-8e299800-2bad-4cba-b2a6-f313d0032700 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "GET /compute/v2.1/servers/c11732ff-0b88-4136-8e45-3f8d52ff4a9f" status: 200 len: 1684 microversion: 2.1 time: 0.177513 Oct 04 21:36:38.813248 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3367/6698] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:36:38 2022] GET /compute/v2.1/servers/c11732ff-0b88-4136-8e45-3f8d52ff4a9f => generated 1684 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:36:39.837638 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b7038a71-db7e-4844-9627-0979f168691f tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:36:39.838247 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b7038a71-db7e-4844-9627-0979f168691f tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: c11732ff-0b88-4136-8e45-3f8d52ff4a9f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:36:39.845786 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b7038a71-db7e-4844-9627-0979f168691f tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:39.846287 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b7038a71-db7e-4844-9627-0979f168691f tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:39.847337 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b7038a71-db7e-4844-9627-0979f168691f tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:39.848139 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b7038a71-db7e-4844-9627-0979f168691f tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:39.848595 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b7038a71-db7e-4844-9627-0979f168691f tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:39.849020 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b7038a71-db7e-4844-9627-0979f168691f tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:39.985194 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-b7038a71-db7e-4844-9627-0979f168691f tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b2b2b461354b8aa87cb19b0fb4fd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a146d50c0a544fe49bb604199bb67f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:36:39.993216 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b7038a71-db7e-4844-9627-0979f168691f tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "GET /compute/v2.1/servers/c11732ff-0b88-4136-8e45-3f8d52ff4a9f" status: 200 len: 1684 microversion: 2.1 time: 0.159503 Oct 04 21:36:39.993800 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3332/6699] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:36:39 2022] GET /compute/v2.1/servers/c11732ff-0b88-4136-8e45-3f8d52ff4a9f => generated 1684 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:36:41.017139 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-c68defee-a908-4acc-b897-08fdb77784d2 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:36:41.017763 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-c68defee-a908-4acc-b897-08fdb77784d2 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: c11732ff-0b88-4136-8e45-3f8d52ff4a9f] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:36:41.025206 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c68defee-a908-4acc-b897-08fdb77784d2 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:41.025701 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c68defee-a908-4acc-b897-08fdb77784d2 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:41.026150 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c68defee-a908-4acc-b897-08fdb77784d2 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:41.026886 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c68defee-a908-4acc-b897-08fdb77784d2 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:41.027356 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c68defee-a908-4acc-b897-08fdb77784d2 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:41.027794 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c68defee-a908-4acc-b897-08fdb77784d2 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:41.163661 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-c68defee-a908-4acc-b897-08fdb77784d2 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b2b2b461354b8aa87cb19b0fb4fd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a146d50c0a544fe49bb604199bb67f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:36:41.171546 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-c68defee-a908-4acc-b897-08fdb77784d2 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "GET /compute/v2.1/servers/c11732ff-0b88-4136-8e45-3f8d52ff4a9f" status: 200 len: 1684 microversion: 2.1 time: 0.158349 Oct 04 21:36:41.172137 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3368/6700] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:36:41 2022] GET /compute/v2.1/servers/c11732ff-0b88-4136-8e45-3f8d52ff4a9f => generated 1684 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:36:42.196657 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-3baba8ea-f9c9-4b5c-b262-a656e63d986b tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:36:42.197275 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-3baba8ea-f9c9-4b5c-b262-a656e63d986b tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: c11732ff-0b88-4136-8e45-3f8d52ff4a9f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:36:42.204392 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3baba8ea-f9c9-4b5c-b262-a656e63d986b tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:42.204877 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3baba8ea-f9c9-4b5c-b262-a656e63d986b tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:42.205316 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3baba8ea-f9c9-4b5c-b262-a656e63d986b tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:42.206204 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3baba8ea-f9c9-4b5c-b262-a656e63d986b tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:42.206947 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3baba8ea-f9c9-4b5c-b262-a656e63d986b tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:42.207613 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3baba8ea-f9c9-4b5c-b262-a656e63d986b tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:42.347296 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-3baba8ea-f9c9-4b5c-b262-a656e63d986b tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b2b2b461354b8aa87cb19b0fb4fd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a146d50c0a544fe49bb604199bb67f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:36:42.355242 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-3baba8ea-f9c9-4b5c-b262-a656e63d986b tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "GET /compute/v2.1/servers/c11732ff-0b88-4136-8e45-3f8d52ff4a9f" status: 200 len: 1684 microversion: 2.1 time: 0.162464 Oct 04 21:36:42.355756 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3333/6701] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:36:42 2022] GET /compute/v2.1/servers/c11732ff-0b88-4136-8e45-3f8d52ff4a9f => generated 1684 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:36:43.380285 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-3966beed-6b33-4695-947a-123a5f46616d tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:36:43.380831 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-3966beed-6b33-4695-947a-123a5f46616d tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: c11732ff-0b88-4136-8e45-3f8d52ff4a9f] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:36:43.387983 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3966beed-6b33-4695-947a-123a5f46616d tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:43.388508 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3966beed-6b33-4695-947a-123a5f46616d tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:43.388959 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3966beed-6b33-4695-947a-123a5f46616d tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:43.389677 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3966beed-6b33-4695-947a-123a5f46616d tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:43.390146 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3966beed-6b33-4695-947a-123a5f46616d tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:43.390608 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3966beed-6b33-4695-947a-123a5f46616d tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:43.536323 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-3966beed-6b33-4695-947a-123a5f46616d tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b2b2b461354b8aa87cb19b0fb4fd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a146d50c0a544fe49bb604199bb67f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:36:43.545158 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-3966beed-6b33-4695-947a-123a5f46616d tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "GET /compute/v2.1/servers/c11732ff-0b88-4136-8e45-3f8d52ff4a9f" status: 200 len: 1684 microversion: 2.1 time: 0.169937 Oct 04 21:36:43.545776 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3369/6702] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:36:43 2022] GET /compute/v2.1/servers/c11732ff-0b88-4136-8e45-3f8d52ff4a9f => generated 1684 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:36:44.570943 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f72fabf6-7121-4357-acfd-c16db74f05a2 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:36:44.571558 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f72fabf6-7121-4357-acfd-c16db74f05a2 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: c11732ff-0b88-4136-8e45-3f8d52ff4a9f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:36:44.578673 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f72fabf6-7121-4357-acfd-c16db74f05a2 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:44.579166 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f72fabf6-7121-4357-acfd-c16db74f05a2 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:44.579609 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f72fabf6-7121-4357-acfd-c16db74f05a2 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:44.580323 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f72fabf6-7121-4357-acfd-c16db74f05a2 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:44.581383 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f72fabf6-7121-4357-acfd-c16db74f05a2 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:44.581817 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f72fabf6-7121-4357-acfd-c16db74f05a2 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:44.723705 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f72fabf6-7121-4357-acfd-c16db74f05a2 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b2b2b461354b8aa87cb19b0fb4fd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a146d50c0a544fe49bb604199bb67f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:36:44.732689 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f72fabf6-7121-4357-acfd-c16db74f05a2 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "GET /compute/v2.1/servers/c11732ff-0b88-4136-8e45-3f8d52ff4a9f" status: 200 len: 1684 microversion: 2.1 time: 0.164842 Oct 04 21:36:44.733283 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3334/6703] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:36:44 2022] GET /compute/v2.1/servers/c11732ff-0b88-4136-8e45-3f8d52ff4a9f => generated 1684 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:36:45.759808 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-eec2a6d9-1840-4ed6-b1fa-1fdbe8ff9e28 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:36:45.760506 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-eec2a6d9-1840-4ed6-b1fa-1fdbe8ff9e28 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: c11732ff-0b88-4136-8e45-3f8d52ff4a9f] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:36:45.767687 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-eec2a6d9-1840-4ed6-b1fa-1fdbe8ff9e28 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:45.768690 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-eec2a6d9-1840-4ed6-b1fa-1fdbe8ff9e28 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:45.769825 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-eec2a6d9-1840-4ed6-b1fa-1fdbe8ff9e28 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:45.770582 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-eec2a6d9-1840-4ed6-b1fa-1fdbe8ff9e28 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:45.771056 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-eec2a6d9-1840-4ed6-b1fa-1fdbe8ff9e28 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:45.771498 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-eec2a6d9-1840-4ed6-b1fa-1fdbe8ff9e28 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:45.905873 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-eec2a6d9-1840-4ed6-b1fa-1fdbe8ff9e28 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b2b2b461354b8aa87cb19b0fb4fd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a146d50c0a544fe49bb604199bb67f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:36:45.914995 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-eec2a6d9-1840-4ed6-b1fa-1fdbe8ff9e28 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "GET /compute/v2.1/servers/c11732ff-0b88-4136-8e45-3f8d52ff4a9f" status: 200 len: 1684 microversion: 2.1 time: 0.162606 Oct 04 21:36:45.915577 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3370/6704] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:36:45 2022] GET /compute/v2.1/servers/c11732ff-0b88-4136-8e45-3f8d52ff4a9f => generated 1684 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:36:46.941554 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b23e0aba-ef62-4d41-91f3-3f61f0dfebc1 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:36:46.942263 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b23e0aba-ef62-4d41-91f3-3f61f0dfebc1 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: c11732ff-0b88-4136-8e45-3f8d52ff4a9f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:36:46.949521 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b23e0aba-ef62-4d41-91f3-3f61f0dfebc1 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:46.950181 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b23e0aba-ef62-4d41-91f3-3f61f0dfebc1 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:46.950679 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b23e0aba-ef62-4d41-91f3-3f61f0dfebc1 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:46.951397 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b23e0aba-ef62-4d41-91f3-3f61f0dfebc1 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:46.951856 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b23e0aba-ef62-4d41-91f3-3f61f0dfebc1 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:46.952282 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b23e0aba-ef62-4d41-91f3-3f61f0dfebc1 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:47.090946 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-b23e0aba-ef62-4d41-91f3-3f61f0dfebc1 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b2b2b461354b8aa87cb19b0fb4fd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a146d50c0a544fe49bb604199bb67f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:36:47.098980 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b23e0aba-ef62-4d41-91f3-3f61f0dfebc1 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "GET /compute/v2.1/servers/c11732ff-0b88-4136-8e45-3f8d52ff4a9f" status: 200 len: 1684 microversion: 2.1 time: 0.162824 Oct 04 21:36:47.099561 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3335/6705] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:36:46 2022] GET /compute/v2.1/servers/c11732ff-0b88-4136-8e45-3f8d52ff4a9f => generated 1684 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:36:48.122669 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-a4284661-65eb-4178-9732-e871617bb19d tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:36:48.123201 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-a4284661-65eb-4178-9732-e871617bb19d tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: c11732ff-0b88-4136-8e45-3f8d52ff4a9f] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:36:48.130304 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a4284661-65eb-4178-9732-e871617bb19d tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:48.130929 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a4284661-65eb-4178-9732-e871617bb19d tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:48.131557 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a4284661-65eb-4178-9732-e871617bb19d tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:48.132543 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a4284661-65eb-4178-9732-e871617bb19d tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:48.133073 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a4284661-65eb-4178-9732-e871617bb19d tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:48.133636 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a4284661-65eb-4178-9732-e871617bb19d tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:48.268523 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-a4284661-65eb-4178-9732-e871617bb19d tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b2b2b461354b8aa87cb19b0fb4fd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a146d50c0a544fe49bb604199bb67f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:36:48.276875 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-a4284661-65eb-4178-9732-e871617bb19d tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "GET /compute/v2.1/servers/c11732ff-0b88-4136-8e45-3f8d52ff4a9f" status: 200 len: 1684 microversion: 2.1 time: 0.158343 Oct 04 21:36:48.277448 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3371/6706] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:36:48 2022] GET /compute/v2.1/servers/c11732ff-0b88-4136-8e45-3f8d52ff4a9f => generated 1684 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:36:49.301726 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6c1c8987-9bc0-4016-98c8-b2c05c1c60e7 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:36:49.302628 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-6c1c8987-9bc0-4016-98c8-b2c05c1c60e7 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: c11732ff-0b88-4136-8e45-3f8d52ff4a9f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:36:49.309688 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6c1c8987-9bc0-4016-98c8-b2c05c1c60e7 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:49.310176 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6c1c8987-9bc0-4016-98c8-b2c05c1c60e7 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:49.310636 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6c1c8987-9bc0-4016-98c8-b2c05c1c60e7 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:49.311378 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6c1c8987-9bc0-4016-98c8-b2c05c1c60e7 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:49.311831 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6c1c8987-9bc0-4016-98c8-b2c05c1c60e7 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:49.312255 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6c1c8987-9bc0-4016-98c8-b2c05c1c60e7 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:49.460198 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-6c1c8987-9bc0-4016-98c8-b2c05c1c60e7 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b2b2b461354b8aa87cb19b0fb4fd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a146d50c0a544fe49bb604199bb67f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:36:49.468115 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-6c1c8987-9bc0-4016-98c8-b2c05c1c60e7 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "GET /compute/v2.1/servers/c11732ff-0b88-4136-8e45-3f8d52ff4a9f" status: 200 len: 1684 microversion: 2.1 time: 0.170876 Oct 04 21:36:49.468712 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3336/6707] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:36:49 2022] GET /compute/v2.1/servers/c11732ff-0b88-4136-8e45-3f8d52ff4a9f => generated 1684 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:36:50.492606 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-db793b37-18c6-4450-9aa6-eb7032bf2db2 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:36:50.493280 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-db793b37-18c6-4450-9aa6-eb7032bf2db2 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: c11732ff-0b88-4136-8e45-3f8d52ff4a9f] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:36:50.501016 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-db793b37-18c6-4450-9aa6-eb7032bf2db2 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:50.501513 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-db793b37-18c6-4450-9aa6-eb7032bf2db2 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:50.501954 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-db793b37-18c6-4450-9aa6-eb7032bf2db2 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:50.502701 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-db793b37-18c6-4450-9aa6-eb7032bf2db2 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:50.503168 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-db793b37-18c6-4450-9aa6-eb7032bf2db2 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:50.503772 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-db793b37-18c6-4450-9aa6-eb7032bf2db2 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:50.659688 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-db793b37-18c6-4450-9aa6-eb7032bf2db2 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b2b2b461354b8aa87cb19b0fb4fd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a146d50c0a544fe49bb604199bb67f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:36:50.667916 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-db793b37-18c6-4450-9aa6-eb7032bf2db2 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "GET /compute/v2.1/servers/c11732ff-0b88-4136-8e45-3f8d52ff4a9f" status: 200 len: 1684 microversion: 2.1 time: 0.179226 Oct 04 21:36:50.668492 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3372/6708] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:36:50 2022] GET /compute/v2.1/servers/c11732ff-0b88-4136-8e45-3f8d52ff4a9f => generated 1684 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:36:51.691778 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0f56ad5a-ac40-4c55-aad5-b6f104b669ea tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:36:51.692452 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-0f56ad5a-ac40-4c55-aad5-b6f104b669ea tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: c11732ff-0b88-4136-8e45-3f8d52ff4a9f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:36:51.699344 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0f56ad5a-ac40-4c55-aad5-b6f104b669ea tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:51.699837 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0f56ad5a-ac40-4c55-aad5-b6f104b669ea tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:51.700278 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0f56ad5a-ac40-4c55-aad5-b6f104b669ea tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:51.700983 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0f56ad5a-ac40-4c55-aad5-b6f104b669ea tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:51.701438 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0f56ad5a-ac40-4c55-aad5-b6f104b669ea tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:51.702277 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0f56ad5a-ac40-4c55-aad5-b6f104b669ea tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:51.853038 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-0f56ad5a-ac40-4c55-aad5-b6f104b669ea tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b2b2b461354b8aa87cb19b0fb4fd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a146d50c0a544fe49bb604199bb67f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:36:51.861281 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-0f56ad5a-ac40-4c55-aad5-b6f104b669ea tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "GET /compute/v2.1/servers/c11732ff-0b88-4136-8e45-3f8d52ff4a9f" status: 200 len: 1683 microversion: 2.1 time: 0.173415 Oct 04 21:36:51.862639 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3337/6709] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:36:51 2022] GET /compute/v2.1/servers/c11732ff-0b88-4136-8e45-3f8d52ff4a9f => generated 1683 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:36:51.976224 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-8b996afc-b204-47f2-97d7-e3f5532a8a6f req-2f7a72a0-8365-4db8-ada3-4718fedb27a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c11732ff-0b88-4136-8e45-3f8d52ff4a9f", "name": "network-vif-unplugged", "status": "completed", "tag": "4af92995-1850-4fb3-89d8-10c727a24d6e"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:36:51.987372 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-8b996afc-b204-47f2-97d7-e3f5532a8a6f req-2f7a72a0-8365-4db8-ada3-4718fedb27a7 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:51.987985 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-8b996afc-b204-47f2-97d7-e3f5532a8a6f req-2f7a72a0-8365-4db8-ada3-4718fedb27a7 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:51.988503 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-8b996afc-b204-47f2-97d7-e3f5532a8a6f req-2f7a72a0-8365-4db8-ada3-4718fedb27a7 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:52.004764 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-8b996afc-b204-47f2-97d7-e3f5532a8a6f req-2f7a72a0-8365-4db8-ada3-4718fedb27a7 service nova] Creating event network-vif-unplugged:4af92995-1850-4fb3-89d8-10c727a24d6e for instance c11732ff-0b88-4136-8e45-3f8d52ff4a9f on n-h1-854823-8 Oct 04 21:36:52.010908 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [req-8b996afc-b204-47f2-97d7-e3f5532a8a6f req-2f7a72a0-8365-4db8-ada3-4718fedb27a7 service nova] Instance c11732ff-0b88-4136-8e45-3f8d52ff4a9f is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854823-8', 'n-h2-854823-8'} {{(pid=128802) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 21:36:52.022582 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-8b996afc-b204-47f2-97d7-e3f5532a8a6f req-2f7a72a0-8365-4db8-ada3-4718fedb27a7 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.050227 Oct 04 21:36:52.023421 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3373/6710] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:36:51 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:36:52.892664 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-31b07ef6-7436-494e-b1fd-92a5ac8525cb tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:36:52.893440 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-31b07ef6-7436-494e-b1fd-92a5ac8525cb tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: c11732ff-0b88-4136-8e45-3f8d52ff4a9f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:36:52.901078 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-31b07ef6-7436-494e-b1fd-92a5ac8525cb tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:52.901562 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-31b07ef6-7436-494e-b1fd-92a5ac8525cb tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:52.901998 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-31b07ef6-7436-494e-b1fd-92a5ac8525cb tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:52.902924 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-31b07ef6-7436-494e-b1fd-92a5ac8525cb tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:52.903378 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-31b07ef6-7436-494e-b1fd-92a5ac8525cb tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:52.903801 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-31b07ef6-7436-494e-b1fd-92a5ac8525cb tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:53.043868 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-31b07ef6-7436-494e-b1fd-92a5ac8525cb tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b2b2b461354b8aa87cb19b0fb4fd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a146d50c0a544fe49bb604199bb67f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:36:53.052571 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-31b07ef6-7436-494e-b1fd-92a5ac8525cb tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "GET /compute/v2.1/servers/c11732ff-0b88-4136-8e45-3f8d52ff4a9f" status: 200 len: 1683 microversion: 2.1 time: 0.163628 Oct 04 21:36:53.053442 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3338/6711] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:36:52 2022] GET /compute/v2.1/servers/c11732ff-0b88-4136-8e45-3f8d52ff4a9f => generated 1683 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:36:54.039823 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-670cc121-31f5-4851-b5bb-acb776b4a570 req-d0c8d704-5b82-4860-93ec-26e493963f26 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c11732ff-0b88-4136-8e45-3f8d52ff4a9f", "tag": "4af92995-1850-4fb3-89d8-10c727a24d6e"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:36:54.051125 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-670cc121-31f5-4851-b5bb-acb776b4a570 req-d0c8d704-5b82-4860-93ec-26e493963f26 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:54.051610 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-670cc121-31f5-4851-b5bb-acb776b4a570 req-d0c8d704-5b82-4860-93ec-26e493963f26 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:54.052051 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-670cc121-31f5-4851-b5bb-acb776b4a570 req-d0c8d704-5b82-4860-93ec-26e493963f26 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:54.064237 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-670cc121-31f5-4851-b5bb-acb776b4a570 req-d0c8d704-5b82-4860-93ec-26e493963f26 service nova] Creating event network-changed:4af92995-1850-4fb3-89d8-10c727a24d6e for instance c11732ff-0b88-4136-8e45-3f8d52ff4a9f on n-h1-854823-8 Oct 04 21:36:54.070989 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [req-670cc121-31f5-4851-b5bb-acb776b4a570 req-d0c8d704-5b82-4860-93ec-26e493963f26 service nova] Instance c11732ff-0b88-4136-8e45-3f8d52ff4a9f is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854823-8', 'n-h2-854823-8'} {{(pid=128802) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 21:36:54.076978 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-98335ea4-898c-4c3b-a5cf-89a02caffc69 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:36:54.077593 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-98335ea4-898c-4c3b-a5cf-89a02caffc69 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: c11732ff-0b88-4136-8e45-3f8d52ff4a9f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:36:54.082328 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-670cc121-31f5-4851-b5bb-acb776b4a570 req-d0c8d704-5b82-4860-93ec-26e493963f26 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046443 Oct 04 21:36:54.082974 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3374/6712] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:36:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:36:54.087044 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-98335ea4-898c-4c3b-a5cf-89a02caffc69 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:54.087663 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-98335ea4-898c-4c3b-a5cf-89a02caffc69 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:54.088121 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-98335ea4-898c-4c3b-a5cf-89a02caffc69 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:54.089060 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-98335ea4-898c-4c3b-a5cf-89a02caffc69 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:54.089768 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-98335ea4-898c-4c3b-a5cf-89a02caffc69 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:54.090474 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-98335ea4-898c-4c3b-a5cf-89a02caffc69 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:54.341065 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-98335ea4-898c-4c3b-a5cf-89a02caffc69 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b2b2b461354b8aa87cb19b0fb4fd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a146d50c0a544fe49bb604199bb67f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:36:54.349746 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-98335ea4-898c-4c3b-a5cf-89a02caffc69 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "GET /compute/v2.1/servers/c11732ff-0b88-4136-8e45-3f8d52ff4a9f" status: 200 len: 1681 microversion: 2.1 time: 0.276681 Oct 04 21:36:54.350373 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3339/6713] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:36:54 2022] GET /compute/v2.1/servers/c11732ff-0b88-4136-8e45-3f8d52ff4a9f => generated 1681 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:36:55.373646 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-682e19dd-8875-46e9-a55f-35a61121ff3f tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:36:55.374271 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-682e19dd-8875-46e9-a55f-35a61121ff3f tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: c11732ff-0b88-4136-8e45-3f8d52ff4a9f] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:36:55.381459 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-682e19dd-8875-46e9-a55f-35a61121ff3f tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:55.381963 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-682e19dd-8875-46e9-a55f-35a61121ff3f tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:55.382436 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-682e19dd-8875-46e9-a55f-35a61121ff3f tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:55.383146 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-682e19dd-8875-46e9-a55f-35a61121ff3f tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:55.383622 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-682e19dd-8875-46e9-a55f-35a61121ff3f tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:55.384053 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-682e19dd-8875-46e9-a55f-35a61121ff3f tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:55.521162 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-682e19dd-8875-46e9-a55f-35a61121ff3f tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b2b2b461354b8aa87cb19b0fb4fd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a146d50c0a544fe49bb604199bb67f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:36:55.529213 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-682e19dd-8875-46e9-a55f-35a61121ff3f tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "GET /compute/v2.1/servers/c11732ff-0b88-4136-8e45-3f8d52ff4a9f" status: 200 len: 1678 microversion: 2.1 time: 0.159859 Oct 04 21:36:55.529795 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3375/6714] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:36:55 2022] GET /compute/v2.1/servers/c11732ff-0b88-4136-8e45-3f8d52ff4a9f => generated 1678 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:36:55.553303 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-995cfe96-ced7-43cb-824c-4b274954b1f0 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:36:55.553831 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-995cfe96-ced7-43cb-824c-4b274954b1f0 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: c11732ff-0b88-4136-8e45-3f8d52ff4a9f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:36:55.560883 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-995cfe96-ced7-43cb-824c-4b274954b1f0 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:55.561363 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-995cfe96-ced7-43cb-824c-4b274954b1f0 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:55.561796 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-995cfe96-ced7-43cb-824c-4b274954b1f0 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:55.562529 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-995cfe96-ced7-43cb-824c-4b274954b1f0 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:55.562983 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-995cfe96-ced7-43cb-824c-4b274954b1f0 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:55.563403 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-995cfe96-ced7-43cb-824c-4b274954b1f0 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:55.602053 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-995cfe96-ced7-43cb-824c-4b274954b1f0 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:55.602557 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-995cfe96-ced7-43cb-824c-4b274954b1f0 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:55.602993 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-995cfe96-ced7-43cb-824c-4b274954b1f0 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:55.603710 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-995cfe96-ced7-43cb-824c-4b274954b1f0 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:55.604161 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-995cfe96-ced7-43cb-824c-4b274954b1f0 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:55.604581 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-995cfe96-ced7-43cb-824c-4b274954b1f0 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:55.628889 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-995cfe96-ced7-43cb-824c-4b274954b1f0 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Getting quotas for project a146d50c0a544fe49bb604199bb67f02. Resources: {'ram', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:36:55.634145 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-995cfe96-ced7-43cb-824c-4b274954b1f0 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Getting quotas for user a2b2b2b461354b8aa87cb19b0fb4fd28 and project a146d50c0a544fe49bb604199bb67f02. Resources: {'ram', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:36:55.739796 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-995cfe96-ced7-43cb-824c-4b274954b1f0 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "POST /compute/v2.1/servers/c11732ff-0b88-4136-8e45-3f8d52ff4a9f/action" status: 202 len: 0 microversion: 2.1 time: 0.190524 Oct 04 21:36:55.740477 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3340/6715] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 21:36:55 2022] POST /compute/v2.1/servers/c11732ff-0b88-4136-8e45-3f8d52ff4a9f/action => generated 0 bytes in 192 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:36:55.748841 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-7549a442-419a-4da6-b7a4-5934ddf56ec7 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:36:55.749462 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-7549a442-419a-4da6-b7a4-5934ddf56ec7 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: c11732ff-0b88-4136-8e45-3f8d52ff4a9f] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:36:55.755575 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7549a442-419a-4da6-b7a4-5934ddf56ec7 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:55.756123 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7549a442-419a-4da6-b7a4-5934ddf56ec7 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:55.756504 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7549a442-419a-4da6-b7a4-5934ddf56ec7 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:55.757214 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7549a442-419a-4da6-b7a4-5934ddf56ec7 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:55.757678 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7549a442-419a-4da6-b7a4-5934ddf56ec7 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:55.758110 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7549a442-419a-4da6-b7a4-5934ddf56ec7 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:55.895978 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-7549a442-419a-4da6-b7a4-5934ddf56ec7 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b2b2b461354b8aa87cb19b0fb4fd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a146d50c0a544fe49bb604199bb67f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:36:55.904199 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-7549a442-419a-4da6-b7a4-5934ddf56ec7 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "GET /compute/v2.1/servers/c11732ff-0b88-4136-8e45-3f8d52ff4a9f" status: 200 len: 1677 microversion: 2.1 time: 0.159310 Oct 04 21:36:55.904945 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3376/6716] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:36:55 2022] GET /compute/v2.1/servers/c11732ff-0b88-4136-8e45-3f8d52ff4a9f => generated 1677 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:36:56.929736 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9c75769c-91fd-4450-a8e7-ec1e6170ec78 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:36:56.930462 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-9c75769c-91fd-4450-a8e7-ec1e6170ec78 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: c11732ff-0b88-4136-8e45-3f8d52ff4a9f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:36:56.937575 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9c75769c-91fd-4450-a8e7-ec1e6170ec78 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:56.938062 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9c75769c-91fd-4450-a8e7-ec1e6170ec78 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:56.938558 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9c75769c-91fd-4450-a8e7-ec1e6170ec78 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:56.939248 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9c75769c-91fd-4450-a8e7-ec1e6170ec78 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:56.939735 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9c75769c-91fd-4450-a8e7-ec1e6170ec78 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:56.940684 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9c75769c-91fd-4450-a8e7-ec1e6170ec78 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:57.075282 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-9c75769c-91fd-4450-a8e7-ec1e6170ec78 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b2b2b461354b8aa87cb19b0fb4fd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a146d50c0a544fe49bb604199bb67f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:36:57.083301 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-9c75769c-91fd-4450-a8e7-ec1e6170ec78 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "GET /compute/v2.1/servers/c11732ff-0b88-4136-8e45-3f8d52ff4a9f" status: 200 len: 1677 microversion: 2.1 time: 0.159440 Oct 04 21:36:57.083884 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3341/6717] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:36:56 2022] GET /compute/v2.1/servers/c11732ff-0b88-4136-8e45-3f8d52ff4a9f => generated 1677 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:36:58.106507 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-6c6fc8d7-ad47-44c8-bbf1-40064623d857 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:36:58.107120 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-6c6fc8d7-ad47-44c8-bbf1-40064623d857 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: c11732ff-0b88-4136-8e45-3f8d52ff4a9f] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:36:58.114021 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6c6fc8d7-ad47-44c8-bbf1-40064623d857 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:58.114545 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6c6fc8d7-ad47-44c8-bbf1-40064623d857 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:58.114998 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6c6fc8d7-ad47-44c8-bbf1-40064623d857 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:58.115723 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6c6fc8d7-ad47-44c8-bbf1-40064623d857 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:58.116189 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6c6fc8d7-ad47-44c8-bbf1-40064623d857 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:58.116619 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6c6fc8d7-ad47-44c8-bbf1-40064623d857 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:58.257210 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-6c6fc8d7-ad47-44c8-bbf1-40064623d857 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b2b2b461354b8aa87cb19b0fb4fd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a146d50c0a544fe49bb604199bb67f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:36:58.265315 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-6c6fc8d7-ad47-44c8-bbf1-40064623d857 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "GET /compute/v2.1/servers/c11732ff-0b88-4136-8e45-3f8d52ff4a9f" status: 200 len: 1677 microversion: 2.1 time: 0.162592 Oct 04 21:36:58.265978 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3377/6718] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:36:58 2022] GET /compute/v2.1/servers/c11732ff-0b88-4136-8e45-3f8d52ff4a9f => generated 1677 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:36:58.318745 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-58db4946-ee3f-4c1d-83bc-dc56bdb71db1 req-f6f46372-f8dd-4281-bc37-495096774796 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c11732ff-0b88-4136-8e45-3f8d52ff4a9f", "name": "network-vif-plugged", "status": "completed", "tag": "4af92995-1850-4fb3-89d8-10c727a24d6e"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:36:58.330786 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-58db4946-ee3f-4c1d-83bc-dc56bdb71db1 req-f6f46372-f8dd-4281-bc37-495096774796 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:58.331424 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-58db4946-ee3f-4c1d-83bc-dc56bdb71db1 req-f6f46372-f8dd-4281-bc37-495096774796 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:58.332066 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-58db4946-ee3f-4c1d-83bc-dc56bdb71db1 req-f6f46372-f8dd-4281-bc37-495096774796 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:58.349924 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-58db4946-ee3f-4c1d-83bc-dc56bdb71db1 req-f6f46372-f8dd-4281-bc37-495096774796 service nova] Creating event network-vif-plugged:4af92995-1850-4fb3-89d8-10c727a24d6e for instance c11732ff-0b88-4136-8e45-3f8d52ff4a9f on n-h1-854823-8 Oct 04 21:36:58.353035 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:36:58.357392 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [req-58db4946-ee3f-4c1d-83bc-dc56bdb71db1 req-f6f46372-f8dd-4281-bc37-495096774796 service nova] Instance c11732ff-0b88-4136-8e45-3f8d52ff4a9f is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854823-8', 'n-h2-854823-8'} {{(pid=128801) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 21:36:58.373534 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-58db4946-ee3f-4c1d-83bc-dc56bdb71db1 req-f6f46372-f8dd-4281-bc37-495096774796 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058715 Oct 04 21:36:58.374611 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3342/6719] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:36:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:36:59.091899 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-fa6121cb-d7da-43a4-a590-c797bb8f7596 req-b05b2b68-02d3-454c-9219-3ce6417482af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c11732ff-0b88-4136-8e45-3f8d52ff4a9f", "name": "network-vif-unplugged", "status": "completed", "tag": "4af92995-1850-4fb3-89d8-10c727a24d6e"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:36:59.102563 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-fa6121cb-d7da-43a4-a590-c797bb8f7596 req-b05b2b68-02d3-454c-9219-3ce6417482af service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:59.103099 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-fa6121cb-d7da-43a4-a590-c797bb8f7596 req-b05b2b68-02d3-454c-9219-3ce6417482af service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:59.103551 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-fa6121cb-d7da-43a4-a590-c797bb8f7596 req-b05b2b68-02d3-454c-9219-3ce6417482af service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:59.120412 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-fa6121cb-d7da-43a4-a590-c797bb8f7596 req-b05b2b68-02d3-454c-9219-3ce6417482af service nova] Creating event network-vif-unplugged:4af92995-1850-4fb3-89d8-10c727a24d6e for instance c11732ff-0b88-4136-8e45-3f8d52ff4a9f on n-h2-854823-8 Oct 04 21:36:59.126370 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [req-fa6121cb-d7da-43a4-a590-c797bb8f7596 req-b05b2b68-02d3-454c-9219-3ce6417482af service nova] Instance c11732ff-0b88-4136-8e45-3f8d52ff4a9f is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854823-8', 'n-h2-854823-8'} {{(pid=128802) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 21:36:59.138043 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-fa6121cb-d7da-43a4-a590-c797bb8f7596 req-b05b2b68-02d3-454c-9219-3ce6417482af service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049800 Oct 04 21:36:59.138697 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3378/6720] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:36:59 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:36:59.291114 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-826b44c2-9f3c-4475-a445-451edbfde0b8 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:36:59.291723 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-826b44c2-9f3c-4475-a445-451edbfde0b8 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: c11732ff-0b88-4136-8e45-3f8d52ff4a9f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:36:59.298054 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-826b44c2-9f3c-4475-a445-451edbfde0b8 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:59.298570 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-826b44c2-9f3c-4475-a445-451edbfde0b8 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:59.299048 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-826b44c2-9f3c-4475-a445-451edbfde0b8 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:59.299737 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-826b44c2-9f3c-4475-a445-451edbfde0b8 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:36:59.300194 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-826b44c2-9f3c-4475-a445-451edbfde0b8 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:36:59.300614 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-826b44c2-9f3c-4475-a445-451edbfde0b8 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:36:59.534386 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-826b44c2-9f3c-4475-a445-451edbfde0b8 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b2b2b461354b8aa87cb19b0fb4fd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a146d50c0a544fe49bb604199bb67f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:36:59.542865 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-826b44c2-9f3c-4475-a445-451edbfde0b8 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "GET /compute/v2.1/servers/c11732ff-0b88-4136-8e45-3f8d52ff4a9f" status: 200 len: 1677 microversion: 2.1 time: 0.256280 Oct 04 21:36:59.543367 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3343/6721] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:36:59 2022] GET /compute/v2.1/servers/c11732ff-0b88-4136-8e45-3f8d52ff4a9f => generated 1677 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:37:00.568801 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-695d4d37-ae84-46b2-b97f-4a61c0c72813 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:37:00.569520 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-695d4d37-ae84-46b2-b97f-4a61c0c72813 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: c11732ff-0b88-4136-8e45-3f8d52ff4a9f] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:37:00.576963 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-695d4d37-ae84-46b2-b97f-4a61c0c72813 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:00.578302 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-695d4d37-ae84-46b2-b97f-4a61c0c72813 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:00.578784 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-695d4d37-ae84-46b2-b97f-4a61c0c72813 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:00.579494 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-695d4d37-ae84-46b2-b97f-4a61c0c72813 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:00.579965 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-695d4d37-ae84-46b2-b97f-4a61c0c72813 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:00.581528 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-695d4d37-ae84-46b2-b97f-4a61c0c72813 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:00.718454 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-695d4d37-ae84-46b2-b97f-4a61c0c72813 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b2b2b461354b8aa87cb19b0fb4fd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a146d50c0a544fe49bb604199bb67f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:37:00.726589 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-695d4d37-ae84-46b2-b97f-4a61c0c72813 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "GET /compute/v2.1/servers/c11732ff-0b88-4136-8e45-3f8d52ff4a9f" status: 200 len: 1677 microversion: 2.1 time: 0.163579 Oct 04 21:37:00.727173 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3379/6722] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:37:00 2022] GET /compute/v2.1/servers/c11732ff-0b88-4136-8e45-3f8d52ff4a9f => generated 1677 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:37:01.156535 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-6d3a4159-71da-4aed-b184-29c06789434b req-008c9dbd-33da-4030-8790-6da108d80e27 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c11732ff-0b88-4136-8e45-3f8d52ff4a9f", "tag": "4af92995-1850-4fb3-89d8-10c727a24d6e"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:37:01.167376 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-6d3a4159-71da-4aed-b184-29c06789434b req-008c9dbd-33da-4030-8790-6da108d80e27 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:01.167848 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-6d3a4159-71da-4aed-b184-29c06789434b req-008c9dbd-33da-4030-8790-6da108d80e27 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:01.168278 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-6d3a4159-71da-4aed-b184-29c06789434b req-008c9dbd-33da-4030-8790-6da108d80e27 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:01.181338 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-6d3a4159-71da-4aed-b184-29c06789434b req-008c9dbd-33da-4030-8790-6da108d80e27 service nova] Creating event network-changed:4af92995-1850-4fb3-89d8-10c727a24d6e for instance c11732ff-0b88-4136-8e45-3f8d52ff4a9f on n-h2-854823-8 Oct 04 21:37:01.186693 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [req-6d3a4159-71da-4aed-b184-29c06789434b req-008c9dbd-33da-4030-8790-6da108d80e27 service nova] Instance c11732ff-0b88-4136-8e45-3f8d52ff4a9f is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854823-8', 'n-h2-854823-8'} {{(pid=128801) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 21:37:01.197819 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-6d3a4159-71da-4aed-b184-29c06789434b req-008c9dbd-33da-4030-8790-6da108d80e27 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044925 Oct 04 21:37:01.198474 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3344/6723] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:37:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:37:01.751319 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-e4a8a13f-ae4f-4a2a-9b3b-2f4df4a4e769 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:37:01.751967 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-e4a8a13f-ae4f-4a2a-9b3b-2f4df4a4e769 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: c11732ff-0b88-4136-8e45-3f8d52ff4a9f] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:37:01.760060 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e4a8a13f-ae4f-4a2a-9b3b-2f4df4a4e769 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:01.760855 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e4a8a13f-ae4f-4a2a-9b3b-2f4df4a4e769 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:01.761465 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e4a8a13f-ae4f-4a2a-9b3b-2f4df4a4e769 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:01.763404 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e4a8a13f-ae4f-4a2a-9b3b-2f4df4a4e769 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:01.764050 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e4a8a13f-ae4f-4a2a-9b3b-2f4df4a4e769 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:01.764960 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e4a8a13f-ae4f-4a2a-9b3b-2f4df4a4e769 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:01.770968 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:37:02.022666 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-e4a8a13f-ae4f-4a2a-9b3b-2f4df4a4e769 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b2b2b461354b8aa87cb19b0fb4fd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a146d50c0a544fe49bb604199bb67f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:37:02.030614 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-e4a8a13f-ae4f-4a2a-9b3b-2f4df4a4e769 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "GET /compute/v2.1/servers/c11732ff-0b88-4136-8e45-3f8d52ff4a9f" status: 200 len: 1670 microversion: 2.1 time: 0.283107 Oct 04 21:37:02.031631 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3380/6724] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:37:01 2022] GET /compute/v2.1/servers/c11732ff-0b88-4136-8e45-3f8d52ff4a9f => generated 1670 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:37:02.055012 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7b78ebd2-1bff-41f2-b4a6-2b0077297d3a tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:37:02.055711 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-7b78ebd2-1bff-41f2-b4a6-2b0077297d3a tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: c11732ff-0b88-4136-8e45-3f8d52ff4a9f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:37:02.062079 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7b78ebd2-1bff-41f2-b4a6-2b0077297d3a tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:02.062608 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7b78ebd2-1bff-41f2-b4a6-2b0077297d3a tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:02.063355 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7b78ebd2-1bff-41f2-b4a6-2b0077297d3a tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:02.064301 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7b78ebd2-1bff-41f2-b4a6-2b0077297d3a tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:02.065382 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7b78ebd2-1bff-41f2-b4a6-2b0077297d3a tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:02.065876 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7b78ebd2-1bff-41f2-b4a6-2b0077297d3a tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:02.210844 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-7b78ebd2-1bff-41f2-b4a6-2b0077297d3a tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b2b2b461354b8aa87cb19b0fb4fd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a146d50c0a544fe49bb604199bb67f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:37:02.218961 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-7b78ebd2-1bff-41f2-b4a6-2b0077297d3a tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "GET /compute/v2.1/servers/c11732ff-0b88-4136-8e45-3f8d52ff4a9f" status: 200 len: 1670 microversion: 2.1 time: 0.168557 Oct 04 21:37:02.219836 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3345/6725] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:37:02 2022] GET /compute/v2.1/servers/c11732ff-0b88-4136-8e45-3f8d52ff4a9f => generated 1670 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:37:02.242027 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-0f7bc4db-0e24-4460-b028-b0b13c705359 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:37:02.242665 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-0f7bc4db-0e24-4460-b028-b0b13c705359 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: c11732ff-0b88-4136-8e45-3f8d52ff4a9f] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:37:02.248644 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0f7bc4db-0e24-4460-b028-b0b13c705359 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:02.249142 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0f7bc4db-0e24-4460-b028-b0b13c705359 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:02.249585 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0f7bc4db-0e24-4460-b028-b0b13c705359 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:02.250285 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0f7bc4db-0e24-4460-b028-b0b13c705359 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:02.250776 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0f7bc4db-0e24-4460-b028-b0b13c705359 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:02.251209 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0f7bc4db-0e24-4460-b028-b0b13c705359 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:02.386426 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-0f7bc4db-0e24-4460-b028-b0b13c705359 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b2b2b461354b8aa87cb19b0fb4fd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a146d50c0a544fe49bb604199bb67f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:37:02.394619 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-0f7bc4db-0e24-4460-b028-b0b13c705359 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "GET /compute/v2.1/servers/c11732ff-0b88-4136-8e45-3f8d52ff4a9f" status: 200 len: 1670 microversion: 2.1 time: 0.156251 Oct 04 21:37:02.395274 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3381/6726] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:37:02 2022] GET /compute/v2.1/servers/c11732ff-0b88-4136-8e45-3f8d52ff4a9f => generated 1670 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:37:02.418139 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-92a92dc3-76ca-40dd-96ba-5b8cbd734dea tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:37:02.418664 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-92a92dc3-76ca-40dd-96ba-5b8cbd734dea tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: c11732ff-0b88-4136-8e45-3f8d52ff4a9f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:37:02.425860 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-92a92dc3-76ca-40dd-96ba-5b8cbd734dea tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:02.426364 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-92a92dc3-76ca-40dd-96ba-5b8cbd734dea tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:02.426885 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-92a92dc3-76ca-40dd-96ba-5b8cbd734dea tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:02.427846 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-92a92dc3-76ca-40dd-96ba-5b8cbd734dea tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:02.428303 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-92a92dc3-76ca-40dd-96ba-5b8cbd734dea tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:02.428735 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-92a92dc3-76ca-40dd-96ba-5b8cbd734dea tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:02.455767 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-92a92dc3-76ca-40dd-96ba-5b8cbd734dea tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: c11732ff-0b88-4136-8e45-3f8d52ff4a9f] Going to try to terminate instance {{(pid=128801) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:37:02.519667 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:37:02.537206 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-92a92dc3-76ca-40dd-96ba-5b8cbd734dea tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "DELETE /compute/v2.1/servers/c11732ff-0b88-4136-8e45-3f8d52ff4a9f" status: 204 len: 0 microversion: 2.1 time: 0.122593 Oct 04 21:37:02.537932 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3346/6727] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 21:37:02 2022] DELETE /compute/v2.1/servers/c11732ff-0b88-4136-8e45-3f8d52ff4a9f => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 21:37:02.546598 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-e3f54547-f039-4d45-9c95-851c8907a36f tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:37:02.547218 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-e3f54547-f039-4d45-9c95-851c8907a36f tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: c11732ff-0b88-4136-8e45-3f8d52ff4a9f] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:37:02.549834 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_api:SELECT=41 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:37:02.555371 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e3f54547-f039-4d45-9c95-851c8907a36f tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:02.555866 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e3f54547-f039-4d45-9c95-851c8907a36f tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:02.556314 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e3f54547-f039-4d45-9c95-851c8907a36f tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:02.557027 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e3f54547-f039-4d45-9c95-851c8907a36f tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:02.557521 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e3f54547-f039-4d45-9c95-851c8907a36f tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:02.557957 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e3f54547-f039-4d45-9c95-851c8907a36f tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:02.687879 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-e3f54547-f039-4d45-9c95-851c8907a36f tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b2b2b461354b8aa87cb19b0fb4fd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a146d50c0a544fe49bb604199bb67f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:37:02.696001 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-e3f54547-f039-4d45-9c95-851c8907a36f tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "GET /compute/v2.1/servers/c11732ff-0b88-4136-8e45-3f8d52ff4a9f" status: 200 len: 1676 microversion: 2.1 time: 0.153888 Oct 04 21:37:02.696584 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3382/6728] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:37:02 2022] GET /compute/v2.1/servers/c11732ff-0b88-4136-8e45-3f8d52ff4a9f => generated 1676 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:37:03.719206 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5240c7a2-8011-4df5-9238-611c3ee568a9 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:37:03.719915 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-5240c7a2-8011-4df5-9238-611c3ee568a9 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: c11732ff-0b88-4136-8e45-3f8d52ff4a9f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:37:03.727809 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5240c7a2-8011-4df5-9238-611c3ee568a9 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:03.728297 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5240c7a2-8011-4df5-9238-611c3ee568a9 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:03.728740 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5240c7a2-8011-4df5-9238-611c3ee568a9 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:03.729439 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5240c7a2-8011-4df5-9238-611c3ee568a9 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:03.729897 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5240c7a2-8011-4df5-9238-611c3ee568a9 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:03.730327 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5240c7a2-8011-4df5-9238-611c3ee568a9 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:03.865154 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-5240c7a2-8011-4df5-9238-611c3ee568a9 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b2b2b461354b8aa87cb19b0fb4fd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a146d50c0a544fe49bb604199bb67f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:37:03.872977 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5240c7a2-8011-4df5-9238-611c3ee568a9 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "GET /compute/v2.1/servers/c11732ff-0b88-4136-8e45-3f8d52ff4a9f" status: 200 len: 1676 microversion: 2.1 time: 0.158118 Oct 04 21:37:03.873550 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3347/6729] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:37:03 2022] GET /compute/v2.1/servers/c11732ff-0b88-4136-8e45-3f8d52ff4a9f => generated 1676 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:37:04.756527 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-827f0983-af0a-423a-aa01-cb7f89840044 req-de9ad814-2b5c-428b-9224-4324b738187a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c11732ff-0b88-4136-8e45-3f8d52ff4a9f", "name": "network-vif-deleted", "tag": "4af92995-1850-4fb3-89d8-10c727a24d6e"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:37:04.770410 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-827f0983-af0a-423a-aa01-cb7f89840044 req-de9ad814-2b5c-428b-9224-4324b738187a service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:04.770943 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-827f0983-af0a-423a-aa01-cb7f89840044 req-de9ad814-2b5c-428b-9224-4324b738187a service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:04.771399 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-827f0983-af0a-423a-aa01-cb7f89840044 req-de9ad814-2b5c-428b-9224-4324b738187a service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:04.786991 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-827f0983-af0a-423a-aa01-cb7f89840044 req-de9ad814-2b5c-428b-9224-4324b738187a service nova] Creating event network-vif-deleted:4af92995-1850-4fb3-89d8-10c727a24d6e for instance c11732ff-0b88-4136-8e45-3f8d52ff4a9f on n-h2-854823-8 Oct 04 21:37:04.792537 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-827f0983-af0a-423a-aa01-cb7f89840044 req-de9ad814-2b5c-428b-9224-4324b738187a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039845 Oct 04 21:37:04.797506 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3383/6730] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:37:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:37:04.898414 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0cd068da-223d-4b68-bf78-3861812fa570 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:37:04.899609 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-0cd068da-223d-4b68-bf78-3861812fa570 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: c11732ff-0b88-4136-8e45-3f8d52ff4a9f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:37:04.906504 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0cd068da-223d-4b68-bf78-3861812fa570 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:04.907087 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0cd068da-223d-4b68-bf78-3861812fa570 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:04.907524 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0cd068da-223d-4b68-bf78-3861812fa570 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:04.908260 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0cd068da-223d-4b68-bf78-3861812fa570 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:04.908790 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0cd068da-223d-4b68-bf78-3861812fa570 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:04.909155 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0cd068da-223d-4b68-bf78-3861812fa570 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:04.946675 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0cd068da-223d-4b68-bf78-3861812fa570 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:04.947158 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0cd068da-223d-4b68-bf78-3861812fa570 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:04.947591 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0cd068da-223d-4b68-bf78-3861812fa570 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:04.948042 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-0cd068da-223d-4b68-bf78-3861812fa570 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lazy-loading 'fault' on Instance uuid c11732ff-0b88-4136-8e45-3f8d52ff4a9f {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:37:04.994118 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-0cd068da-223d-4b68-bf78-3861812fa570 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b2b2b461354b8aa87cb19b0fb4fd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a146d50c0a544fe49bb604199bb67f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:37:05.002823 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-0cd068da-223d-4b68-bf78-3861812fa570 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "GET /compute/v2.1/servers/c11732ff-0b88-4136-8e45-3f8d52ff4a9f" status: 200 len: 1329 microversion: 2.1 time: 0.109581 Oct 04 21:37:05.003487 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3348/6731] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:37:04 2022] GET /compute/v2.1/servers/c11732ff-0b88-4136-8e45-3f8d52ff4a9f => generated 1329 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:37:06.028505 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-2154f239-5419-4d62-852b-ae91b2acdd1f tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:37:06.029142 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-2154f239-5419-4d62-852b-ae91b2acdd1f tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: c11732ff-0b88-4136-8e45-3f8d52ff4a9f] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:37:06.037609 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2154f239-5419-4d62-852b-ae91b2acdd1f tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:06.038112 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2154f239-5419-4d62-852b-ae91b2acdd1f tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:06.038588 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2154f239-5419-4d62-852b-ae91b2acdd1f tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:06.039327 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2154f239-5419-4d62-852b-ae91b2acdd1f tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:06.039794 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2154f239-5419-4d62-852b-ae91b2acdd1f tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:06.040232 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2154f239-5419-4d62-852b-ae91b2acdd1f tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:06.054866 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.wsgi [None req-2154f239-5419-4d62-852b-ae91b2acdd1f tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] HTTP exception thrown: Instance c11732ff-0b88-4136-8e45-3f8d52ff4a9f could not be found. Oct 04 21:37:06.056536 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-2154f239-5419-4d62-852b-ae91b2acdd1f tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Request method failure captured: Oct 04 21:37:06.056536 n-d-854823-8 devstack@n-api.service[128802]: request: GET /compute/v2.1/servers/c11732ff-0b88-4136-8e45-3f8d52ff4a9f HTTP/1.1 Oct 04 21:37:06.056536 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 21:37:06.056536 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 21:37:06.056536 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 21:37:06.056536 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 0 Oct 04 21:37:06.056536 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 21:37:06.056536 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 21:37:06.056536 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 21:37:06.056536 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 21:37:06.056536 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPKacG3zmlzrE0P03sqhhW8OxTX_N5d4FutccVYa--DxtxvF117E3y03wDG1eWqGIT6xlYZQeTInymX9iqEa1Cn-51caF2pJGBCFnPr7M2Ci1V2diBL1LhxAMFh-0O2THqSMgkeX7lBKNpS2ImrBtoud6Asim3w37JGPDnCp2IjwWzIw Oct 04 21:37:06.056536 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 21:37:06.056536 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 21:37:06.056536 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 21:37:06.056536 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 21:37:06.056536 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 21:37:06.056536 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 21:37:06.056536 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: a146d50c0a544fe49bb604199bb67f02 Oct 04 21:37:06.056536 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-ServerActionsTestJSON-1365673639 Oct 04 21:37:06.056536 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 21:37:06.056536 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 21:37:06.056536 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a146d50c0a544fe49bb604199bb67f02", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a146d50c0a544fe49bb604199bb67f02"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a146d50c0a544fe49bb604199bb67f02"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a146d50c0a544fe49bb604199bb67f02"}]}] Oct 04 21:37:06.056536 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-ServerActionsTestJSON-1365673639 Oct 04 21:37:06.056536 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: a146d50c0a544fe49bb604199bb67f02 Oct 04 21:37:06.056536 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-ServerActionsTestJSON-1365673639 Oct 04 21:37:06.056536 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-ServerActionsTestJSON-1365673639-project Oct 04 21:37:06.056536 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 21:37:06.056536 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 21:37:06.056536 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: a2b2b2b461354b8aa87cb19b0fb4fd28 Oct 04 21:37:06.056536 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-ServerActionsTestJSON-1365673639-project Oct 04 21:37:06.056536 n-d-854823-8 devstack@n-api.service[128802]: method: > Oct 04 21:37:06.056536 n-d-854823-8 devstack@n-api.service[128802]: exception: Instance c11732ff-0b88-4136-8e45-3f8d52ff4a9f could not be found. Oct 04 21:37:06.056536 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'id': 'c11732ff-0b88-4136-8e45-3f8d52ff4a9f'} Oct 04 21:37:06.056536 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:37:06.056536 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:37:06.056536 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:37:06.056536 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:37:06.056536 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:37:06.056536 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:37:06.056536 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:37:06.056536 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:37:06.056536 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:37:06.056536 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:37:06.056536 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c11732ff-0b88-4136-8e45-3f8d52ff4a9f could not be found. Oct 04 21:37:06.056536 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:37:06.056536 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:37:06.056536 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:37:06.056536 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:37:06.056536 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:37:06.056536 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:37:06.056536 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:37:06.056536 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:37:06.056536 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:37:06.056536 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:37:06.056536 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:37:06.056536 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:37:06.056536 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:37:06.056536 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:37:06.056536 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:37:06.056536 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:37:06.056536 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c11732ff-0b88-4136-8e45-3f8d52ff4a9f could not be found. Oct 04 21:37:06.056536 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:37:06.056536 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:37:06.056536 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:37:06.061873 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:37:06.061873 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:37:06.061873 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:37:06.061873 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:37:06.061873 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:37:06.061873 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c11732ff-0b88-4136-8e45-3f8d52ff4a9f could not be found. Oct 04 21:37:06.061873 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:37:06.061873 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-2154f239-5419-4d62-852b-ae91b2acdd1f tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Returning 404 to user: Instance c11732ff-0b88-4136-8e45-3f8d52ff4a9f could not be found. {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:37:06.061873 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-2154f239-5419-4d62-852b-ae91b2acdd1f tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "GET /compute/v2.1/servers/c11732ff-0b88-4136-8e45-3f8d52ff4a9f" status: 404 len: 111 microversion: 2.1 time: 0.034077 Oct 04 21:37:06.061873 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3384/6732] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:37:06 2022] GET /compute/v2.1/servers/c11732ff-0b88-4136-8e45-3f8d52ff4a9f => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:37:06.075094 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-cb17e47c-42b1-4518-9031-aceb6273d6f4 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:37:06.075717 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-cb17e47c-42b1-4518-9031-aceb6273d6f4 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: c11732ff-0b88-4136-8e45-3f8d52ff4a9f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:37:06.077692 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=3 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:37:06.084771 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cb17e47c-42b1-4518-9031-aceb6273d6f4 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:06.085264 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cb17e47c-42b1-4518-9031-aceb6273d6f4 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:06.085726 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cb17e47c-42b1-4518-9031-aceb6273d6f4 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:06.086456 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cb17e47c-42b1-4518-9031-aceb6273d6f4 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:06.086951 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cb17e47c-42b1-4518-9031-aceb6273d6f4 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:06.087384 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cb17e47c-42b1-4518-9031-aceb6273d6f4 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:06.104729 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-cb17e47c-42b1-4518-9031-aceb6273d6f4 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] HTTP exception thrown: Instance c11732ff-0b88-4136-8e45-3f8d52ff4a9f could not be found. Oct 04 21:37:06.106425 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-cb17e47c-42b1-4518-9031-aceb6273d6f4 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Request method failure captured: Oct 04 21:37:06.106425 n-d-854823-8 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/c11732ff-0b88-4136-8e45-3f8d52ff4a9f HTTP/1.1 Oct 04 21:37:06.106425 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 21:37:06.106425 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 21:37:06.106425 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 21:37:06.106425 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 0 Oct 04 21:37:06.106425 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 21:37:06.106425 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 21:37:06.106425 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 21:37:06.106425 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 21:37:06.106425 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPKacG3zmlzrE0P03sqhhW8OxTX_N5d4FutccVYa--DxtxvF117E3y03wDG1eWqGIT6xlYZQeTInymX9iqEa1Cn-51caF2pJGBCFnPr7M2Ci1V2diBL1LhxAMFh-0O2THqSMgkeX7lBKNpS2ImrBtoud6Asim3w37JGPDnCp2IjwWzIw Oct 04 21:37:06.106425 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 21:37:06.106425 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 21:37:06.106425 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 21:37:06.106425 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 21:37:06.106425 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 21:37:06.106425 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 21:37:06.106425 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: a146d50c0a544fe49bb604199bb67f02 Oct 04 21:37:06.106425 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-ServerActionsTestJSON-1365673639 Oct 04 21:37:06.106425 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 21:37:06.106425 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 21:37:06.106425 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a146d50c0a544fe49bb604199bb67f02", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a146d50c0a544fe49bb604199bb67f02"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a146d50c0a544fe49bb604199bb67f02"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a146d50c0a544fe49bb604199bb67f02"}]}] Oct 04 21:37:06.106425 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-ServerActionsTestJSON-1365673639 Oct 04 21:37:06.106425 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: a146d50c0a544fe49bb604199bb67f02 Oct 04 21:37:06.106425 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ServerActionsTestJSON-1365673639 Oct 04 21:37:06.106425 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-ServerActionsTestJSON-1365673639-project Oct 04 21:37:06.106425 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 21:37:06.106425 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 21:37:06.106425 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: a2b2b2b461354b8aa87cb19b0fb4fd28 Oct 04 21:37:06.106425 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-ServerActionsTestJSON-1365673639-project Oct 04 21:37:06.106425 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 21:37:06.106425 n-d-854823-8 devstack@n-api.service[128801]: exception: Instance c11732ff-0b88-4136-8e45-3f8d52ff4a9f could not be found. Oct 04 21:37:06.106425 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': 'c11732ff-0b88-4136-8e45-3f8d52ff4a9f'} Oct 04 21:37:06.106425 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:37:06.106425 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:37:06.106425 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:37:06.106425 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:37:06.106425 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:37:06.106425 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:37:06.106425 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:37:06.106425 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:37:06.106425 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:37:06.106425 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:37:06.106425 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c11732ff-0b88-4136-8e45-3f8d52ff4a9f could not be found. Oct 04 21:37:06.106425 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:37:06.106425 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:37:06.106425 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:37:06.106425 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:37:06.106425 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:37:06.106425 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:37:06.106425 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:37:06.106425 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:37:06.106425 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:37:06.106425 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:37:06.106425 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:37:06.106425 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:37:06.106425 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:37:06.106425 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:37:06.106425 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:37:06.106425 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:37:06.106425 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c11732ff-0b88-4136-8e45-3f8d52ff4a9f could not be found. Oct 04 21:37:06.106425 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:37:06.106425 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:37:06.106425 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:37:06.111565 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:37:06.111565 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:37:06.111565 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:37:06.111565 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:37:06.111565 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:37:06.111565 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c11732ff-0b88-4136-8e45-3f8d52ff4a9f could not be found. Oct 04 21:37:06.111565 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:37:06.111565 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-cb17e47c-42b1-4518-9031-aceb6273d6f4 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Returning 404 to user: Instance c11732ff-0b88-4136-8e45-3f8d52ff4a9f could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:37:06.111565 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-cb17e47c-42b1-4518-9031-aceb6273d6f4 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "GET /compute/v2.1/servers/c11732ff-0b88-4136-8e45-3f8d52ff4a9f" status: 404 len: 111 microversion: 2.1 time: 0.036685 Oct 04 21:37:06.111565 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3349/6733] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:37:06 2022] GET /compute/v2.1/servers/c11732ff-0b88-4136-8e45-3f8d52ff4a9f => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:37:06.159608 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-6b9d768f-3ca1-476f-9eb9-2a623abb80ac tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-242842790", "imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63", "flavorRef": "452", "networks": [{"uuid": "be02f5cd-2d7d-418b-9089-057dd1d5b96e"}], "security_groups": [{"name": "tempest-securitygroup--1075800401"}], "key_name": "tempest-keypair-1781922112", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:37:06.270243 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.network.neutron [None req-6b9d768f-3ca1-476f-9eb9-2a623abb80ac tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] validate_networks() for [('be02f5cd-2d7d-418b-9089-057dd1d5b96e', None, None, None, None, None)] {{(pid=128802) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:37:06.961291 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-6b9d768f-3ca1-476f-9eb9-2a623abb80ac tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Flavor limits 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:37:06.961784 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-6b9d768f-3ca1-476f-9eb9-2a623abb80ac tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Image limits 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:37:06.962209 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-6b9d768f-3ca1-476f-9eb9-2a623abb80ac tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Flavor pref 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:37:06.962673 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-6b9d768f-3ca1-476f-9eb9-2a623abb80ac tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Image pref 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:37:06.963100 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-6b9d768f-3ca1-476f-9eb9-2a623abb80ac tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:37:06.972419 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6b9d768f-3ca1-476f-9eb9-2a623abb80ac tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:06.972907 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6b9d768f-3ca1-476f-9eb9-2a623abb80ac tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:06.973355 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6b9d768f-3ca1-476f-9eb9-2a623abb80ac tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:06.974096 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6b9d768f-3ca1-476f-9eb9-2a623abb80ac tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:06.974591 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6b9d768f-3ca1-476f-9eb9-2a623abb80ac tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:06.975032 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6b9d768f-3ca1-476f-9eb9-2a623abb80ac tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:06.992297 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-6b9d768f-3ca1-476f-9eb9-2a623abb80ac tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Getting quotas for project a146d50c0a544fe49bb604199bb67f02. Resources: {'ram', 'instances', 'cores'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:37:06.997469 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-6b9d768f-3ca1-476f-9eb9-2a623abb80ac tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Getting quotas for user a2b2b2b461354b8aa87cb19b0fb4fd28 and project a146d50c0a544fe49bb604199bb67f02. Resources: {'ram', 'instances', 'cores'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:37:07.010352 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-6b9d768f-3ca1-476f-9eb9-2a623abb80ac tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Going to run 1 instances... {{(pid=128802) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:37:07.012691 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-6b9d768f-3ca1-476f-9eb9-2a623abb80ac tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: f98544c7-34bc-4d9d-a2f0-105e84864ee5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='15b24725-0c99-4bcf-b1fb-907cdf8e2d63',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128802) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:37:07.061419 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-6b9d768f-3ca1-476f-9eb9-2a623abb80ac tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.906619 Oct 04 21:37:07.062418 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3385/6734] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 21:37:06 2022] POST /compute/v2.1/servers => generated 406 bytes in 908 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:37:07.073435 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5d413d78-d5a2-4f5f-acd7-74c1d4dd7a24 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:37:07.074134 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-5d413d78-d5a2-4f5f-acd7-74c1d4dd7a24 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: f98544c7-34bc-4d9d-a2f0-105e84864ee5] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:37:07.130104 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-5d413d78-d5a2-4f5f-acd7-74c1d4dd7a24 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b2b2b461354b8aa87cb19b0fb4fd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a146d50c0a544fe49bb604199bb67f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:37:07.137616 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5d413d78-d5a2-4f5f-acd7-74c1d4dd7a24 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "GET /compute/v2.1/servers/f98544c7-34bc-4d9d-a2f0-105e84864ee5" status: 200 len: 1238 microversion: 2.1 time: 0.067556 Oct 04 21:37:07.137770 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3350/6735] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:37:07 2022] GET /compute/v2.1/servers/f98544c7-34bc-4d9d-a2f0-105e84864ee5 => generated 1238 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:37:08.162540 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-8b8ab892-111e-4601-a915-0fd9644bb6fa tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:37:08.163170 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-8b8ab892-111e-4601-a915-0fd9644bb6fa tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: f98544c7-34bc-4d9d-a2f0-105e84864ee5] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:37:08.170234 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8b8ab892-111e-4601-a915-0fd9644bb6fa tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:08.170758 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8b8ab892-111e-4601-a915-0fd9644bb6fa tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:08.171216 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8b8ab892-111e-4601-a915-0fd9644bb6fa tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:08.171930 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8b8ab892-111e-4601-a915-0fd9644bb6fa tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:08.172394 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8b8ab892-111e-4601-a915-0fd9644bb6fa tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:08.172829 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8b8ab892-111e-4601-a915-0fd9644bb6fa tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:08.251264 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-8b8ab892-111e-4601-a915-0fd9644bb6fa tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b2b2b461354b8aa87cb19b0fb4fd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a146d50c0a544fe49bb604199bb67f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:37:08.261017 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-8b8ab892-111e-4601-a915-0fd9644bb6fa tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "GET /compute/v2.1/servers/f98544c7-34bc-4d9d-a2f0-105e84864ee5" status: 200 len: 1298 microversion: 2.1 time: 0.103305 Oct 04 21:37:08.262321 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3386/6736] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:37:08 2022] GET /compute/v2.1/servers/f98544c7-34bc-4d9d-a2f0-105e84864ee5 => generated 1298 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:37:09.286790 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-4f35f949-7c56-4bfc-b8a0-d258c4b37343 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:37:09.287319 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-4f35f949-7c56-4bfc-b8a0-d258c4b37343 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: f98544c7-34bc-4d9d-a2f0-105e84864ee5] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:37:09.295469 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4f35f949-7c56-4bfc-b8a0-d258c4b37343 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:09.295989 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4f35f949-7c56-4bfc-b8a0-d258c4b37343 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:09.296433 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4f35f949-7c56-4bfc-b8a0-d258c4b37343 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:09.297144 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4f35f949-7c56-4bfc-b8a0-d258c4b37343 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:09.297607 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4f35f949-7c56-4bfc-b8a0-d258c4b37343 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:09.298040 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4f35f949-7c56-4bfc-b8a0-d258c4b37343 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:09.504624 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-4f35f949-7c56-4bfc-b8a0-d258c4b37343 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b2b2b461354b8aa87cb19b0fb4fd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a146d50c0a544fe49bb604199bb67f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:37:09.513201 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-4f35f949-7c56-4bfc-b8a0-d258c4b37343 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "GET /compute/v2.1/servers/f98544c7-34bc-4d9d-a2f0-105e84864ee5" status: 200 len: 1364 microversion: 2.1 time: 0.231210 Oct 04 21:37:09.513987 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3351/6737] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:37:09 2022] GET /compute/v2.1/servers/f98544c7-34bc-4d9d-a2f0-105e84864ee5 => generated 1364 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:37:09.812510 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-40b375a5-ac5b-4619-80f0-c886cabff98a req-c4bff1da-2b94-49fe-adc5-f4d4291a4f6c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f98544c7-34bc-4d9d-a2f0-105e84864ee5", "tag": "917e9508-4f38-46c4-b711-a22daf6d7bb1"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:37:09.825542 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-40b375a5-ac5b-4619-80f0-c886cabff98a req-c4bff1da-2b94-49fe-adc5-f4d4291a4f6c service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:09.825994 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-40b375a5-ac5b-4619-80f0-c886cabff98a req-c4bff1da-2b94-49fe-adc5-f4d4291a4f6c service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:09.827001 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-40b375a5-ac5b-4619-80f0-c886cabff98a req-c4bff1da-2b94-49fe-adc5-f4d4291a4f6c service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:09.839264 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-40b375a5-ac5b-4619-80f0-c886cabff98a req-c4bff1da-2b94-49fe-adc5-f4d4291a4f6c service nova] Creating event network-changed:917e9508-4f38-46c4-b711-a22daf6d7bb1 for instance f98544c7-34bc-4d9d-a2f0-105e84864ee5 on n-h2-854823-8 Oct 04 21:37:09.844496 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-40b375a5-ac5b-4619-80f0-c886cabff98a req-c4bff1da-2b94-49fe-adc5-f4d4291a4f6c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036448 Oct 04 21:37:09.845380 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3387/6738] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:37:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:37:10.537631 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b2b82367-7e91-4d96-8632-12f4659284f6 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:37:10.538273 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b2b82367-7e91-4d96-8632-12f4659284f6 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: f98544c7-34bc-4d9d-a2f0-105e84864ee5] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:37:10.545620 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b2b82367-7e91-4d96-8632-12f4659284f6 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:10.546236 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b2b82367-7e91-4d96-8632-12f4659284f6 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:10.546709 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b2b82367-7e91-4d96-8632-12f4659284f6 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:10.547438 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b2b82367-7e91-4d96-8632-12f4659284f6 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:10.547898 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b2b82367-7e91-4d96-8632-12f4659284f6 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:10.548326 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b2b82367-7e91-4d96-8632-12f4659284f6 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:10.685266 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-b2b82367-7e91-4d96-8632-12f4659284f6 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b2b2b461354b8aa87cb19b0fb4fd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a146d50c0a544fe49bb604199bb67f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:37:10.693216 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b2b82367-7e91-4d96-8632-12f4659284f6 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "GET /compute/v2.1/servers/f98544c7-34bc-4d9d-a2f0-105e84864ee5" status: 200 len: 1364 microversion: 2.1 time: 0.160090 Oct 04 21:37:10.693806 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3352/6739] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:37:10 2022] GET /compute/v2.1/servers/f98544c7-34bc-4d9d-a2f0-105e84864ee5 => generated 1364 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:37:11.717974 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-e3a119fb-972e-4ddc-833b-1760b533d819 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:37:11.718716 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-e3a119fb-972e-4ddc-833b-1760b533d819 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: f98544c7-34bc-4d9d-a2f0-105e84864ee5] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:37:11.726475 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e3a119fb-972e-4ddc-833b-1760b533d819 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:11.726970 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e3a119fb-972e-4ddc-833b-1760b533d819 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:11.727418 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e3a119fb-972e-4ddc-833b-1760b533d819 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:11.728115 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e3a119fb-972e-4ddc-833b-1760b533d819 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:11.728571 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e3a119fb-972e-4ddc-833b-1760b533d819 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:11.729003 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e3a119fb-972e-4ddc-833b-1760b533d819 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:11.859522 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-e3a119fb-972e-4ddc-833b-1760b533d819 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b2b2b461354b8aa87cb19b0fb4fd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a146d50c0a544fe49bb604199bb67f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:37:11.867789 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-e3a119fb-972e-4ddc-833b-1760b533d819 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "GET /compute/v2.1/servers/f98544c7-34bc-4d9d-a2f0-105e84864ee5" status: 200 len: 1364 microversion: 2.1 time: 0.154413 Oct 04 21:37:11.868360 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3388/6740] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:37:11 2022] GET /compute/v2.1/servers/f98544c7-34bc-4d9d-a2f0-105e84864ee5 => generated 1364 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:37:12.893968 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b868c54d-92f7-481f-84b2-431a97fc3c0b tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:37:12.895218 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b868c54d-92f7-481f-84b2-431a97fc3c0b tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: f98544c7-34bc-4d9d-a2f0-105e84864ee5] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:37:12.901543 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b868c54d-92f7-481f-84b2-431a97fc3c0b tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:12.902037 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b868c54d-92f7-481f-84b2-431a97fc3c0b tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:12.902510 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b868c54d-92f7-481f-84b2-431a97fc3c0b tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:12.903223 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b868c54d-92f7-481f-84b2-431a97fc3c0b tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:12.903675 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b868c54d-92f7-481f-84b2-431a97fc3c0b tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:12.904094 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b868c54d-92f7-481f-84b2-431a97fc3c0b tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:13.055154 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-b868c54d-92f7-481f-84b2-431a97fc3c0b tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b2b2b461354b8aa87cb19b0fb4fd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a146d50c0a544fe49bb604199bb67f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:37:13.065319 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b868c54d-92f7-481f-84b2-431a97fc3c0b tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "GET /compute/v2.1/servers/f98544c7-34bc-4d9d-a2f0-105e84864ee5" status: 200 len: 1364 microversion: 2.1 time: 0.176347 Oct 04 21:37:13.065931 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3353/6741] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:37:12 2022] GET /compute/v2.1/servers/f98544c7-34bc-4d9d-a2f0-105e84864ee5 => generated 1364 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:37:14.089618 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-d08f86d8-d81e-47ca-b3ee-888f5445cf96 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:37:14.090251 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-d08f86d8-d81e-47ca-b3ee-888f5445cf96 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: f98544c7-34bc-4d9d-a2f0-105e84864ee5] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:37:14.098647 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d08f86d8-d81e-47ca-b3ee-888f5445cf96 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:14.099268 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d08f86d8-d81e-47ca-b3ee-888f5445cf96 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:14.099635 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d08f86d8-d81e-47ca-b3ee-888f5445cf96 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:14.100517 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d08f86d8-d81e-47ca-b3ee-888f5445cf96 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:14.101025 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d08f86d8-d81e-47ca-b3ee-888f5445cf96 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:14.101483 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d08f86d8-d81e-47ca-b3ee-888f5445cf96 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:14.236605 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-d08f86d8-d81e-47ca-b3ee-888f5445cf96 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b2b2b461354b8aa87cb19b0fb4fd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a146d50c0a544fe49bb604199bb67f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:37:14.244620 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-d08f86d8-d81e-47ca-b3ee-888f5445cf96 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "GET /compute/v2.1/servers/f98544c7-34bc-4d9d-a2f0-105e84864ee5" status: 200 len: 1364 microversion: 2.1 time: 0.158849 Oct 04 21:37:14.245212 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3389/6742] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:37:14 2022] GET /compute/v2.1/servers/f98544c7-34bc-4d9d-a2f0-105e84864ee5 => generated 1364 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:37:15.115701 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-12ec183d-7bfb-444c-b3c6-b775061f075d req-90cbb5d8-c891-4a64-831c-9af22abec368 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f98544c7-34bc-4d9d-a2f0-105e84864ee5", "name": "network-vif-plugged", "status": "completed", "tag": "917e9508-4f38-46c4-b711-a22daf6d7bb1"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:37:15.125610 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-12ec183d-7bfb-444c-b3c6-b775061f075d req-90cbb5d8-c891-4a64-831c-9af22abec368 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:15.126091 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-12ec183d-7bfb-444c-b3c6-b775061f075d req-90cbb5d8-c891-4a64-831c-9af22abec368 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:15.126552 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-12ec183d-7bfb-444c-b3c6-b775061f075d req-90cbb5d8-c891-4a64-831c-9af22abec368 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:15.138525 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-12ec183d-7bfb-444c-b3c6-b775061f075d req-90cbb5d8-c891-4a64-831c-9af22abec368 service nova] Creating event network-vif-plugged:917e9508-4f38-46c4-b711-a22daf6d7bb1 for instance f98544c7-34bc-4d9d-a2f0-105e84864ee5 on n-h2-854823-8 Oct 04 21:37:15.144590 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-12ec183d-7bfb-444c-b3c6-b775061f075d req-90cbb5d8-c891-4a64-831c-9af22abec368 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102793 Oct 04 21:37:15.145335 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3354/6743] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:37:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:37:15.269585 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-a064b3f8-094c-4380-9755-a423423fd928 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:37:15.270269 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-a064b3f8-094c-4380-9755-a423423fd928 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: f98544c7-34bc-4d9d-a2f0-105e84864ee5] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:37:15.277350 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a064b3f8-094c-4380-9755-a423423fd928 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:15.277844 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a064b3f8-094c-4380-9755-a423423fd928 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:15.278295 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a064b3f8-094c-4380-9755-a423423fd928 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:15.279023 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a064b3f8-094c-4380-9755-a423423fd928 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:15.279494 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a064b3f8-094c-4380-9755-a423423fd928 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:15.279924 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a064b3f8-094c-4380-9755-a423423fd928 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:15.436143 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-a064b3f8-094c-4380-9755-a423423fd928 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b2b2b461354b8aa87cb19b0fb4fd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a146d50c0a544fe49bb604199bb67f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:37:15.444537 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-a064b3f8-094c-4380-9755-a423423fd928 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "GET /compute/v2.1/servers/f98544c7-34bc-4d9d-a2f0-105e84864ee5" status: 200 len: 1364 microversion: 2.1 time: 0.179700 Oct 04 21:37:15.445151 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3390/6744] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:37:15 2022] GET /compute/v2.1/servers/f98544c7-34bc-4d9d-a2f0-105e84864ee5 => generated 1364 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:37:16.472364 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8f4d5d8c-3230-4ece-8734-01f54c16ec73 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:37:16.472953 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-8f4d5d8c-3230-4ece-8734-01f54c16ec73 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: f98544c7-34bc-4d9d-a2f0-105e84864ee5] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:37:16.479566 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8f4d5d8c-3230-4ece-8734-01f54c16ec73 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:16.480057 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8f4d5d8c-3230-4ece-8734-01f54c16ec73 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:16.480498 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8f4d5d8c-3230-4ece-8734-01f54c16ec73 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:16.481202 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8f4d5d8c-3230-4ece-8734-01f54c16ec73 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:16.481652 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8f4d5d8c-3230-4ece-8734-01f54c16ec73 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:16.482095 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8f4d5d8c-3230-4ece-8734-01f54c16ec73 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:16.626239 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-8f4d5d8c-3230-4ece-8734-01f54c16ec73 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b2b2b461354b8aa87cb19b0fb4fd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a146d50c0a544fe49bb604199bb67f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:37:16.634532 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-8f4d5d8c-3230-4ece-8734-01f54c16ec73 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "GET /compute/v2.1/servers/f98544c7-34bc-4d9d-a2f0-105e84864ee5" status: 200 len: 1549 microversion: 2.1 time: 0.168762 Oct 04 21:37:16.635127 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3355/6745] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:37:16 2022] GET /compute/v2.1/servers/f98544c7-34bc-4d9d-a2f0-105e84864ee5 => generated 1549 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:37:16.659678 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-8b1683d9-5771-42ec-ab1f-f0e480ef0c59 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:37:16.660746 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-8b1683d9-5771-42ec-ab1f-f0e480ef0c59 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: f98544c7-34bc-4d9d-a2f0-105e84864ee5] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:37:16.667859 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8b1683d9-5771-42ec-ab1f-f0e480ef0c59 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:16.668352 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8b1683d9-5771-42ec-ab1f-f0e480ef0c59 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:16.668803 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8b1683d9-5771-42ec-ab1f-f0e480ef0c59 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:16.669527 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8b1683d9-5771-42ec-ab1f-f0e480ef0c59 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:16.670017 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8b1683d9-5771-42ec-ab1f-f0e480ef0c59 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:16.670446 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8b1683d9-5771-42ec-ab1f-f0e480ef0c59 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:16.755820 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-8b1683d9-5771-42ec-ab1f-f0e480ef0c59 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "GET /compute/v2.1/servers/f98544c7-34bc-4d9d-a2f0-105e84864ee5/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.100600 Oct 04 21:37:16.756446 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3391/6746] 10.222.0.33 () {58 vars in 1275 bytes} [Tue Oct 4 21:37:16 2022] GET /compute/v2.1/servers/f98544c7-34bc-4d9d-a2f0-105e84864ee5/os-interface => generated 284 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:37:17.758903 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-0ab5ce12-780e-4f0f-ac71-d9b7195ca81a req-3539fd54-1595-45c5-9ea1-77e202187f89 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f98544c7-34bc-4d9d-a2f0-105e84864ee5", "tag": "917e9508-4f38-46c4-b711-a22daf6d7bb1"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:37:17.766593 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:37:17.778256 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-0ab5ce12-780e-4f0f-ac71-d9b7195ca81a req-3539fd54-1595-45c5-9ea1-77e202187f89 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:17.778902 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-0ab5ce12-780e-4f0f-ac71-d9b7195ca81a req-3539fd54-1595-45c5-9ea1-77e202187f89 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:17.779441 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-0ab5ce12-780e-4f0f-ac71-d9b7195ca81a req-3539fd54-1595-45c5-9ea1-77e202187f89 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:17.792011 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-0ab5ce12-780e-4f0f-ac71-d9b7195ca81a req-3539fd54-1595-45c5-9ea1-77e202187f89 service nova] Creating event network-changed:917e9508-4f38-46c4-b711-a22daf6d7bb1 for instance f98544c7-34bc-4d9d-a2f0-105e84864ee5 on n-h2-854823-8 Oct 04 21:37:17.797302 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-0ab5ce12-780e-4f0f-ac71-d9b7195ca81a req-3539fd54-1595-45c5-9ea1-77e202187f89 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047141 Oct 04 21:37:17.797930 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3356/6747] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:37:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:37:53.998420 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell0:SELECT=2 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:37:53.999208 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell0:SELECT=6 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:37:54.001127 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=3 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:37:54.001765 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=52 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:37:54.006544 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-47de0418-3f8c-4a06-81b4-5522b9d6aee5 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:37:54.007174 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-47de0418-3f8c-4a06-81b4-5522b9d6aee5 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: f98544c7-34bc-4d9d-a2f0-105e84864ee5] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:37:54.014972 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-47de0418-3f8c-4a06-81b4-5522b9d6aee5 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:54.015467 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-47de0418-3f8c-4a06-81b4-5522b9d6aee5 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:54.015915 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-47de0418-3f8c-4a06-81b4-5522b9d6aee5 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:54.016621 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-47de0418-3f8c-4a06-81b4-5522b9d6aee5 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:54.017089 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-47de0418-3f8c-4a06-81b4-5522b9d6aee5 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:54.017525 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-47de0418-3f8c-4a06-81b4-5522b9d6aee5 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:54.476563 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-47de0418-3f8c-4a06-81b4-5522b9d6aee5 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b2b2b461354b8aa87cb19b0fb4fd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a146d50c0a544fe49bb604199bb67f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:37:54.485121 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-47de0418-3f8c-4a06-81b4-5522b9d6aee5 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "GET /compute/v2.1/servers/f98544c7-34bc-4d9d-a2f0-105e84864ee5" status: 200 len: 1668 microversion: 2.1 time: 0.487508 Oct 04 21:37:54.485714 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3392/6748] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:37:53 2022] GET /compute/v2.1/servers/f98544c7-34bc-4d9d-a2f0-105e84864ee5 => generated 1668 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:37:54.506926 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:37:54.507854 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:37:54.512866 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-627ca556-f6e4-416c-a2a9-123fc9e67a9a tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a0380847-046f-47ce-87be-9a8e9e43587e"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:37:54.515428 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-627ca556-f6e4-416c-a2a9-123fc9e67a9a tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: f98544c7-34bc-4d9d-a2f0-105e84864ee5] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:37:54.523723 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-627ca556-f6e4-416c-a2a9-123fc9e67a9a tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:54.524345 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-627ca556-f6e4-416c-a2a9-123fc9e67a9a tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:54.524782 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-627ca556-f6e4-416c-a2a9-123fc9e67a9a tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:54.525488 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-627ca556-f6e4-416c-a2a9-123fc9e67a9a tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:37:54.525939 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-627ca556-f6e4-416c-a2a9-123fc9e67a9a tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:37:54.526378 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-627ca556-f6e4-416c-a2a9-123fc9e67a9a tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:37:54.796431 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-627ca556-f6e4-416c-a2a9-123fc9e67a9a tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "POST /compute/v2.1/servers/f98544c7-34bc-4d9d-a2f0-105e84864ee5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.291531 Oct 04 21:37:54.797091 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3357/6749] 10.222.0.33 () {60 vars in 1323 bytes} [Tue Oct 4 21:37:54 2022] POST /compute/v2.1/servers/f98544c7-34bc-4d9d-a2f0-105e84864ee5/os-volume_attachments => generated 194 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:38:05.539440 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-a735f974-4925-4836-b97c-1337256c5307 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:38:05.541795 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-a735f974-4925-4836-b97c-1337256c5307 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: f98544c7-34bc-4d9d-a2f0-105e84864ee5] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:38:05.544631 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_api:SELECT=2 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:38:05.545491 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=6 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:38:05.551142 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a735f974-4925-4836-b97c-1337256c5307 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:05.552064 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a735f974-4925-4836-b97c-1337256c5307 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:05.552668 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a735f974-4925-4836-b97c-1337256c5307 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:05.553384 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a735f974-4925-4836-b97c-1337256c5307 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:05.553854 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a735f974-4925-4836-b97c-1337256c5307 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:05.554295 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a735f974-4925-4836-b97c-1337256c5307 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:05.584225 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-a735f974-4925-4836-b97c-1337256c5307 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'a2b2b2b461354b8aa87cb19b0fb4fd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a146d50c0a544fe49bb604199bb67f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:38:05.589947 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-a735f974-4925-4836-b97c-1337256c5307 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: f98544c7-34bc-4d9d-a2f0-105e84864ee5] Old instance type m1.heat2, new instance type m1.heat {{(pid=128802) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 04 21:38:05.597122 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-a735f974-4925-4836-b97c-1337256c5307 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Flavor limits 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:38:05.597556 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-a735f974-4925-4836-b97c-1337256c5307 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Image limits 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:38:05.598039 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-a735f974-4925-4836-b97c-1337256c5307 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Flavor pref 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:38:05.598739 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-a735f974-4925-4836-b97c-1337256c5307 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Image pref 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:38:05.599276 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-a735f974-4925-4836-b97c-1337256c5307 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:38:05.662964 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-a735f974-4925-4836-b97c-1337256c5307 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "POST /compute/v2.1/servers/f98544c7-34bc-4d9d-a2f0-105e84864ee5/action" status: 202 len: 0 microversion: 2.1 time: 0.127659 Oct 04 21:38:05.663655 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3393/6750] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 21:38:05 2022] POST /compute/v2.1/servers/f98544c7-34bc-4d9d-a2f0-105e84864ee5/action => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:38:05.670066 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:38:05.670800 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:38:05.674945 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d2e26a88-34f8-4e49-9d96-19a8c68c3c56 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:38:05.675645 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d2e26a88-34f8-4e49-9d96-19a8c68c3c56 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: f98544c7-34bc-4d9d-a2f0-105e84864ee5] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:38:05.683901 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d2e26a88-34f8-4e49-9d96-19a8c68c3c56 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:05.684190 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d2e26a88-34f8-4e49-9d96-19a8c68c3c56 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:05.684633 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d2e26a88-34f8-4e49-9d96-19a8c68c3c56 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:05.685340 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d2e26a88-34f8-4e49-9d96-19a8c68c3c56 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:05.685859 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d2e26a88-34f8-4e49-9d96-19a8c68c3c56 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:05.686222 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d2e26a88-34f8-4e49-9d96-19a8c68c3c56 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:05.826946 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d2e26a88-34f8-4e49-9d96-19a8c68c3c56 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b2b2b461354b8aa87cb19b0fb4fd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a146d50c0a544fe49bb604199bb67f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:38:05.836026 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d2e26a88-34f8-4e49-9d96-19a8c68c3c56 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "GET /compute/v2.1/servers/f98544c7-34bc-4d9d-a2f0-105e84864ee5" status: 200 len: 1723 microversion: 2.1 time: 0.167880 Oct 04 21:38:05.836619 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3358/6751] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:38:05 2022] GET /compute/v2.1/servers/f98544c7-34bc-4d9d-a2f0-105e84864ee5 => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:38:06.861909 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-1b465e3d-e063-4e83-8e29-6cb8baa30aaf tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:38:06.862477 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-1b465e3d-e063-4e83-8e29-6cb8baa30aaf tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: f98544c7-34bc-4d9d-a2f0-105e84864ee5] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:38:06.870210 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1b465e3d-e063-4e83-8e29-6cb8baa30aaf tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:06.870731 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1b465e3d-e063-4e83-8e29-6cb8baa30aaf tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:06.871183 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1b465e3d-e063-4e83-8e29-6cb8baa30aaf tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:06.871889 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1b465e3d-e063-4e83-8e29-6cb8baa30aaf tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:06.872358 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1b465e3d-e063-4e83-8e29-6cb8baa30aaf tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:06.872796 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1b465e3d-e063-4e83-8e29-6cb8baa30aaf tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:07.038019 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-1b465e3d-e063-4e83-8e29-6cb8baa30aaf tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b2b2b461354b8aa87cb19b0fb4fd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a146d50c0a544fe49bb604199bb67f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:38:07.046478 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-1b465e3d-e063-4e83-8e29-6cb8baa30aaf tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "GET /compute/v2.1/servers/f98544c7-34bc-4d9d-a2f0-105e84864ee5" status: 200 len: 1723 microversion: 2.1 time: 0.189405 Oct 04 21:38:07.047059 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3394/6752] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:38:06 2022] GET /compute/v2.1/servers/f98544c7-34bc-4d9d-a2f0-105e84864ee5 => generated 1723 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:38:08.071873 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8ed35648-2300-48ea-9c06-608c98969a88 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:38:08.072408 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-8ed35648-2300-48ea-9c06-608c98969a88 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: f98544c7-34bc-4d9d-a2f0-105e84864ee5] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:38:08.079282 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8ed35648-2300-48ea-9c06-608c98969a88 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:08.079764 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8ed35648-2300-48ea-9c06-608c98969a88 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:08.080198 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8ed35648-2300-48ea-9c06-608c98969a88 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:08.080893 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8ed35648-2300-48ea-9c06-608c98969a88 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:08.081346 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8ed35648-2300-48ea-9c06-608c98969a88 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:08.081767 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8ed35648-2300-48ea-9c06-608c98969a88 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:08.218140 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-8ed35648-2300-48ea-9c06-608c98969a88 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b2b2b461354b8aa87cb19b0fb4fd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a146d50c0a544fe49bb604199bb67f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:38:08.227146 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-8ed35648-2300-48ea-9c06-608c98969a88 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "GET /compute/v2.1/servers/f98544c7-34bc-4d9d-a2f0-105e84864ee5" status: 200 len: 1728 microversion: 2.1 time: 0.159464 Oct 04 21:38:08.227730 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3359/6753] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:38:08 2022] GET /compute/v2.1/servers/f98544c7-34bc-4d9d-a2f0-105e84864ee5 => generated 1728 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:38:09.250747 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-5375c83e-8f08-4da7-8346-9a9eddec78d3 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:38:09.251379 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-5375c83e-8f08-4da7-8346-9a9eddec78d3 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: f98544c7-34bc-4d9d-a2f0-105e84864ee5] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:38:09.258572 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5375c83e-8f08-4da7-8346-9a9eddec78d3 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:09.259079 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5375c83e-8f08-4da7-8346-9a9eddec78d3 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:09.259530 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5375c83e-8f08-4da7-8346-9a9eddec78d3 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:09.260244 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5375c83e-8f08-4da7-8346-9a9eddec78d3 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:09.260716 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5375c83e-8f08-4da7-8346-9a9eddec78d3 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:09.261155 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5375c83e-8f08-4da7-8346-9a9eddec78d3 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:09.394829 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-5375c83e-8f08-4da7-8346-9a9eddec78d3 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b2b2b461354b8aa87cb19b0fb4fd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a146d50c0a544fe49bb604199bb67f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:38:09.403647 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-5375c83e-8f08-4da7-8346-9a9eddec78d3 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "GET /compute/v2.1/servers/f98544c7-34bc-4d9d-a2f0-105e84864ee5" status: 200 len: 1728 microversion: 2.1 time: 0.156945 Oct 04 21:38:09.404514 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3395/6754] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:38:09 2022] GET /compute/v2.1/servers/f98544c7-34bc-4d9d-a2f0-105e84864ee5 => generated 1728 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:38:10.428263 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-200caf03-d9b4-4717-aa7a-7f59bc4fa57b tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:38:10.428873 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-200caf03-d9b4-4717-aa7a-7f59bc4fa57b tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: f98544c7-34bc-4d9d-a2f0-105e84864ee5] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:38:10.435748 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-200caf03-d9b4-4717-aa7a-7f59bc4fa57b tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:10.436225 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-200caf03-d9b4-4717-aa7a-7f59bc4fa57b tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:10.436658 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-200caf03-d9b4-4717-aa7a-7f59bc4fa57b tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:10.437345 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-200caf03-d9b4-4717-aa7a-7f59bc4fa57b tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:10.437800 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-200caf03-d9b4-4717-aa7a-7f59bc4fa57b tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:10.438229 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-200caf03-d9b4-4717-aa7a-7f59bc4fa57b tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:10.575357 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-200caf03-d9b4-4717-aa7a-7f59bc4fa57b tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b2b2b461354b8aa87cb19b0fb4fd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a146d50c0a544fe49bb604199bb67f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:38:10.584272 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-200caf03-d9b4-4717-aa7a-7f59bc4fa57b tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "GET /compute/v2.1/servers/f98544c7-34bc-4d9d-a2f0-105e84864ee5" status: 200 len: 1728 microversion: 2.1 time: 0.160209 Oct 04 21:38:10.584963 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3360/6755] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:38:10 2022] GET /compute/v2.1/servers/f98544c7-34bc-4d9d-a2f0-105e84864ee5 => generated 1728 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:38:11.609441 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-0b38f111-2950-4091-8499-df2209a577c7 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:38:11.610071 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-0b38f111-2950-4091-8499-df2209a577c7 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: f98544c7-34bc-4d9d-a2f0-105e84864ee5] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:38:11.618210 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0b38f111-2950-4091-8499-df2209a577c7 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:11.618736 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0b38f111-2950-4091-8499-df2209a577c7 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:11.619187 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0b38f111-2950-4091-8499-df2209a577c7 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:11.619935 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0b38f111-2950-4091-8499-df2209a577c7 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:11.620418 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0b38f111-2950-4091-8499-df2209a577c7 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:11.620855 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0b38f111-2950-4091-8499-df2209a577c7 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:11.760650 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-0b38f111-2950-4091-8499-df2209a577c7 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b2b2b461354b8aa87cb19b0fb4fd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a146d50c0a544fe49bb604199bb67f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:38:11.769004 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-0b38f111-2950-4091-8499-df2209a577c7 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "GET /compute/v2.1/servers/f98544c7-34bc-4d9d-a2f0-105e84864ee5" status: 200 len: 1728 microversion: 2.1 time: 0.163553 Oct 04 21:38:11.769592 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3396/6756] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:38:11 2022] GET /compute/v2.1/servers/f98544c7-34bc-4d9d-a2f0-105e84864ee5 => generated 1728 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:38:12.795973 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f474e353-a574-43c3-8f65-adf06595f1dd tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:38:12.796590 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f474e353-a574-43c3-8f65-adf06595f1dd tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: f98544c7-34bc-4d9d-a2f0-105e84864ee5] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:38:12.799596 n-d-854823-8 devstack@n-api.service[128801]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 21:38:12.799746 n-d-854823-8 devstack@n-api.service[128801]: Tue Oct 4 21:38:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f98544c7-34bc-4d9d-a2f0-105e84864ee5 (ip 10.222.0.33) !!! Oct 04 21:38:12.807471 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f474e353-a574-43c3-8f65-adf06595f1dd tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:12.807962 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f474e353-a574-43c3-8f65-adf06595f1dd tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:12.808398 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f474e353-a574-43c3-8f65-adf06595f1dd tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:12.809101 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f474e353-a574-43c3-8f65-adf06595f1dd tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:12.809562 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f474e353-a574-43c3-8f65-adf06595f1dd tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:12.809991 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f474e353-a574-43c3-8f65-adf06595f1dd tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:12.948199 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f474e353-a574-43c3-8f65-adf06595f1dd tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b2b2b461354b8aa87cb19b0fb4fd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a146d50c0a544fe49bb604199bb67f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:38:12.956532 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f474e353-a574-43c3-8f65-adf06595f1dd tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "GET /compute/v2.1/servers/f98544c7-34bc-4d9d-a2f0-105e84864ee5" status: 200 len: 1728 microversion: 2.1 time: 0.167414 Oct 04 21:38:12.957116 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3361/6757] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:38:12 2022] GET /compute/v2.1/servers/f98544c7-34bc-4d9d-a2f0-105e84864ee5 => generated 1728 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:38:13.980979 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-d9aef06c-72c7-442c-a21b-8a20c3d5c8fe tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:38:13.981523 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-d9aef06c-72c7-442c-a21b-8a20c3d5c8fe tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: f98544c7-34bc-4d9d-a2f0-105e84864ee5] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:38:13.990241 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d9aef06c-72c7-442c-a21b-8a20c3d5c8fe tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:13.990878 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d9aef06c-72c7-442c-a21b-8a20c3d5c8fe tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:13.991305 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d9aef06c-72c7-442c-a21b-8a20c3d5c8fe tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:13.992011 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d9aef06c-72c7-442c-a21b-8a20c3d5c8fe tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:13.992474 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d9aef06c-72c7-442c-a21b-8a20c3d5c8fe tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:13.992988 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d9aef06c-72c7-442c-a21b-8a20c3d5c8fe tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:14.132587 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-d9aef06c-72c7-442c-a21b-8a20c3d5c8fe tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b2b2b461354b8aa87cb19b0fb4fd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a146d50c0a544fe49bb604199bb67f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:38:14.141003 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-d9aef06c-72c7-442c-a21b-8a20c3d5c8fe tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "GET /compute/v2.1/servers/f98544c7-34bc-4d9d-a2f0-105e84864ee5" status: 200 len: 1728 microversion: 2.1 time: 0.164277 Oct 04 21:38:14.141537 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3397/6758] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:38:13 2022] GET /compute/v2.1/servers/f98544c7-34bc-4d9d-a2f0-105e84864ee5 => generated 1728 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:38:15.165738 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-82532787-1186-408d-b86c-0f09f600d1e6 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:38:15.166364 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-82532787-1186-408d-b86c-0f09f600d1e6 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: f98544c7-34bc-4d9d-a2f0-105e84864ee5] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:38:15.174542 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-82532787-1186-408d-b86c-0f09f600d1e6 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:15.175032 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-82532787-1186-408d-b86c-0f09f600d1e6 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:15.175467 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-82532787-1186-408d-b86c-0f09f600d1e6 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:15.176178 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-82532787-1186-408d-b86c-0f09f600d1e6 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:15.176884 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-82532787-1186-408d-b86c-0f09f600d1e6 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:15.177311 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-82532787-1186-408d-b86c-0f09f600d1e6 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:15.315510 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-82532787-1186-408d-b86c-0f09f600d1e6 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b2b2b461354b8aa87cb19b0fb4fd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a146d50c0a544fe49bb604199bb67f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:38:15.325593 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-82532787-1186-408d-b86c-0f09f600d1e6 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "GET /compute/v2.1/servers/f98544c7-34bc-4d9d-a2f0-105e84864ee5" status: 200 len: 1728 microversion: 2.1 time: 0.164006 Oct 04 21:38:15.326155 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3362/6759] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:38:15 2022] GET /compute/v2.1/servers/f98544c7-34bc-4d9d-a2f0-105e84864ee5 => generated 1728 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:38:16.400210 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-8f4f1dfe-d1df-45e9-9501-f68103152d04 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:38:16.400934 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-8f4f1dfe-d1df-45e9-9501-f68103152d04 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: f98544c7-34bc-4d9d-a2f0-105e84864ee5] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:38:16.406982 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8f4f1dfe-d1df-45e9-9501-f68103152d04 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:16.407482 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8f4f1dfe-d1df-45e9-9501-f68103152d04 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:16.407933 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8f4f1dfe-d1df-45e9-9501-f68103152d04 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:16.408645 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8f4f1dfe-d1df-45e9-9501-f68103152d04 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:16.409117 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8f4f1dfe-d1df-45e9-9501-f68103152d04 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:16.409558 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8f4f1dfe-d1df-45e9-9501-f68103152d04 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:16.541215 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-8f4f1dfe-d1df-45e9-9501-f68103152d04 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b2b2b461354b8aa87cb19b0fb4fd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a146d50c0a544fe49bb604199bb67f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:38:16.549545 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-8f4f1dfe-d1df-45e9-9501-f68103152d04 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "GET /compute/v2.1/servers/f98544c7-34bc-4d9d-a2f0-105e84864ee5" status: 200 len: 1728 microversion: 2.1 time: 0.204392 Oct 04 21:38:16.550138 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3398/6760] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:38:16 2022] GET /compute/v2.1/servers/f98544c7-34bc-4d9d-a2f0-105e84864ee5 => generated 1728 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:38:17.573937 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c616710a-d2cf-418d-ba16-49e83798df9f tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:38:17.574503 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c616710a-d2cf-418d-ba16-49e83798df9f tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: f98544c7-34bc-4d9d-a2f0-105e84864ee5] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:38:17.581679 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c616710a-d2cf-418d-ba16-49e83798df9f tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:17.582252 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c616710a-d2cf-418d-ba16-49e83798df9f tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:17.582689 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c616710a-d2cf-418d-ba16-49e83798df9f tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:17.583428 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c616710a-d2cf-418d-ba16-49e83798df9f tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:17.583876 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c616710a-d2cf-418d-ba16-49e83798df9f tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:17.584961 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c616710a-d2cf-418d-ba16-49e83798df9f tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:17.728765 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c616710a-d2cf-418d-ba16-49e83798df9f tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b2b2b461354b8aa87cb19b0fb4fd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a146d50c0a544fe49bb604199bb67f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:38:17.737308 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c616710a-d2cf-418d-ba16-49e83798df9f tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "GET /compute/v2.1/servers/f98544c7-34bc-4d9d-a2f0-105e84864ee5" status: 200 len: 1728 microversion: 2.1 time: 0.167449 Oct 04 21:38:17.737914 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3363/6761] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:38:17 2022] GET /compute/v2.1/servers/f98544c7-34bc-4d9d-a2f0-105e84864ee5 => generated 1728 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:38:18.765959 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-b46a7088-1780-47aa-a1fd-0629c8134365 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:38:18.766689 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-b46a7088-1780-47aa-a1fd-0629c8134365 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: f98544c7-34bc-4d9d-a2f0-105e84864ee5] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:38:18.774173 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b46a7088-1780-47aa-a1fd-0629c8134365 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:18.774839 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b46a7088-1780-47aa-a1fd-0629c8134365 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:18.775531 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b46a7088-1780-47aa-a1fd-0629c8134365 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:18.776471 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b46a7088-1780-47aa-a1fd-0629c8134365 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:18.776918 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b46a7088-1780-47aa-a1fd-0629c8134365 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:18.777577 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b46a7088-1780-47aa-a1fd-0629c8134365 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:18.920385 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-b46a7088-1780-47aa-a1fd-0629c8134365 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b2b2b461354b8aa87cb19b0fb4fd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a146d50c0a544fe49bb604199bb67f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:38:18.929330 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-b46a7088-1780-47aa-a1fd-0629c8134365 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "GET /compute/v2.1/servers/f98544c7-34bc-4d9d-a2f0-105e84864ee5" status: 200 len: 1728 microversion: 2.1 time: 0.170770 Oct 04 21:38:18.929931 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3399/6762] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:38:18 2022] GET /compute/v2.1/servers/f98544c7-34bc-4d9d-a2f0-105e84864ee5 => generated 1728 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:38:19.953415 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d3d0964f-dffb-407d-b916-fb11acdafa2a tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:38:19.954092 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d3d0964f-dffb-407d-b916-fb11acdafa2a tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: f98544c7-34bc-4d9d-a2f0-105e84864ee5] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:38:19.962068 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d3d0964f-dffb-407d-b916-fb11acdafa2a tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:19.962674 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d3d0964f-dffb-407d-b916-fb11acdafa2a tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:19.963244 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d3d0964f-dffb-407d-b916-fb11acdafa2a tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:19.964068 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d3d0964f-dffb-407d-b916-fb11acdafa2a tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:19.964533 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d3d0964f-dffb-407d-b916-fb11acdafa2a tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:19.964963 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d3d0964f-dffb-407d-b916-fb11acdafa2a tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:20.104541 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d3d0964f-dffb-407d-b916-fb11acdafa2a tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b2b2b461354b8aa87cb19b0fb4fd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a146d50c0a544fe49bb604199bb67f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:38:20.113521 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d3d0964f-dffb-407d-b916-fb11acdafa2a tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "GET /compute/v2.1/servers/f98544c7-34bc-4d9d-a2f0-105e84864ee5" status: 200 len: 1728 microversion: 2.1 time: 0.164075 Oct 04 21:38:20.114138 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3364/6763] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:38:19 2022] GET /compute/v2.1/servers/f98544c7-34bc-4d9d-a2f0-105e84864ee5 => generated 1728 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:38:21.137259 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-b8af068f-129e-4c53-9735-bd2ca525f9ee tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:38:21.137820 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-b8af068f-129e-4c53-9735-bd2ca525f9ee tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: f98544c7-34bc-4d9d-a2f0-105e84864ee5] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:38:21.144635 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b8af068f-129e-4c53-9735-bd2ca525f9ee tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:21.145123 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b8af068f-129e-4c53-9735-bd2ca525f9ee tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:21.145567 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b8af068f-129e-4c53-9735-bd2ca525f9ee tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:21.146265 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b8af068f-129e-4c53-9735-bd2ca525f9ee tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:21.147444 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b8af068f-129e-4c53-9735-bd2ca525f9ee tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:21.148445 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b8af068f-129e-4c53-9735-bd2ca525f9ee tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:21.293488 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-b8af068f-129e-4c53-9735-bd2ca525f9ee tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b2b2b461354b8aa87cb19b0fb4fd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a146d50c0a544fe49bb604199bb67f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:38:21.303278 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-b8af068f-129e-4c53-9735-bd2ca525f9ee tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "GET /compute/v2.1/servers/f98544c7-34bc-4d9d-a2f0-105e84864ee5" status: 200 len: 1728 microversion: 2.1 time: 0.169931 Oct 04 21:38:21.303875 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3400/6764] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:38:21 2022] GET /compute/v2.1/servers/f98544c7-34bc-4d9d-a2f0-105e84864ee5 => generated 1728 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:38:22.327762 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-39bb3826-d5b7-4326-8212-9d3da67b582e tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:38:22.328427 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-39bb3826-d5b7-4326-8212-9d3da67b582e tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: f98544c7-34bc-4d9d-a2f0-105e84864ee5] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:38:22.336478 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-39bb3826-d5b7-4326-8212-9d3da67b582e tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:22.336956 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-39bb3826-d5b7-4326-8212-9d3da67b582e tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:22.337415 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-39bb3826-d5b7-4326-8212-9d3da67b582e tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:22.338136 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-39bb3826-d5b7-4326-8212-9d3da67b582e tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:22.338622 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-39bb3826-d5b7-4326-8212-9d3da67b582e tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:22.339045 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-39bb3826-d5b7-4326-8212-9d3da67b582e tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:22.472102 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-39bb3826-d5b7-4326-8212-9d3da67b582e tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b2b2b461354b8aa87cb19b0fb4fd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a146d50c0a544fe49bb604199bb67f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:38:22.481060 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-39bb3826-d5b7-4326-8212-9d3da67b582e tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "GET /compute/v2.1/servers/f98544c7-34bc-4d9d-a2f0-105e84864ee5" status: 200 len: 1728 microversion: 2.1 time: 0.157196 Oct 04 21:38:22.481639 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3365/6765] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:38:22 2022] GET /compute/v2.1/servers/f98544c7-34bc-4d9d-a2f0-105e84864ee5 => generated 1728 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:38:23.504659 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-d6b152b0-cc12-415f-9dd5-b41227393c75 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:38:23.505373 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-d6b152b0-cc12-415f-9dd5-b41227393c75 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: f98544c7-34bc-4d9d-a2f0-105e84864ee5] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:38:23.513119 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d6b152b0-cc12-415f-9dd5-b41227393c75 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:23.513614 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d6b152b0-cc12-415f-9dd5-b41227393c75 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:23.514121 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d6b152b0-cc12-415f-9dd5-b41227393c75 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:23.514803 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d6b152b0-cc12-415f-9dd5-b41227393c75 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:23.515270 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d6b152b0-cc12-415f-9dd5-b41227393c75 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:23.516698 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d6b152b0-cc12-415f-9dd5-b41227393c75 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:23.656446 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-d6b152b0-cc12-415f-9dd5-b41227393c75 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b2b2b461354b8aa87cb19b0fb4fd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a146d50c0a544fe49bb604199bb67f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:38:23.665360 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-d6b152b0-cc12-415f-9dd5-b41227393c75 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "GET /compute/v2.1/servers/f98544c7-34bc-4d9d-a2f0-105e84864ee5" status: 200 len: 1728 microversion: 2.1 time: 0.164615 Oct 04 21:38:23.665929 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3401/6766] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:38:23 2022] GET /compute/v2.1/servers/f98544c7-34bc-4d9d-a2f0-105e84864ee5 => generated 1728 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:38:24.689208 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-66a80e1a-f025-4de5-b8fb-3b93ca942411 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:38:24.689809 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-66a80e1a-f025-4de5-b8fb-3b93ca942411 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: f98544c7-34bc-4d9d-a2f0-105e84864ee5] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:38:24.698130 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-66a80e1a-f025-4de5-b8fb-3b93ca942411 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:24.698654 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-66a80e1a-f025-4de5-b8fb-3b93ca942411 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:24.699092 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-66a80e1a-f025-4de5-b8fb-3b93ca942411 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:24.699786 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-66a80e1a-f025-4de5-b8fb-3b93ca942411 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:24.700248 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-66a80e1a-f025-4de5-b8fb-3b93ca942411 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:24.700669 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-66a80e1a-f025-4de5-b8fb-3b93ca942411 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:24.898798 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-66a80e1a-f025-4de5-b8fb-3b93ca942411 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b2b2b461354b8aa87cb19b0fb4fd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a146d50c0a544fe49bb604199bb67f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:38:24.907550 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-66a80e1a-f025-4de5-b8fb-3b93ca942411 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "GET /compute/v2.1/servers/f98544c7-34bc-4d9d-a2f0-105e84864ee5" status: 200 len: 1728 microversion: 2.1 time: 0.222178 Oct 04 21:38:24.908152 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3366/6767] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:38:24 2022] GET /compute/v2.1/servers/f98544c7-34bc-4d9d-a2f0-105e84864ee5 => generated 1728 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:38:25.933508 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-da15a331-5b05-4188-b907-c38146b5d53a tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:38:25.934145 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-da15a331-5b05-4188-b907-c38146b5d53a tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: f98544c7-34bc-4d9d-a2f0-105e84864ee5] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:38:25.942094 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-da15a331-5b05-4188-b907-c38146b5d53a tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:25.942681 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-da15a331-5b05-4188-b907-c38146b5d53a tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:25.943080 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-da15a331-5b05-4188-b907-c38146b5d53a tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:25.944154 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-da15a331-5b05-4188-b907-c38146b5d53a tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:25.944855 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-da15a331-5b05-4188-b907-c38146b5d53a tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:25.945312 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-da15a331-5b05-4188-b907-c38146b5d53a tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:26.086544 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-da15a331-5b05-4188-b907-c38146b5d53a tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b2b2b461354b8aa87cb19b0fb4fd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a146d50c0a544fe49bb604199bb67f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:38:26.095004 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-da15a331-5b05-4188-b907-c38146b5d53a tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "GET /compute/v2.1/servers/f98544c7-34bc-4d9d-a2f0-105e84864ee5" status: 200 len: 1728 microversion: 2.1 time: 0.165591 Oct 04 21:38:26.095595 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3402/6768] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:38:25 2022] GET /compute/v2.1/servers/f98544c7-34bc-4d9d-a2f0-105e84864ee5 => generated 1728 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:38:27.121414 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d7f9bcbf-6a21-4842-8188-5011b138be12 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:38:27.122024 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d7f9bcbf-6a21-4842-8188-5011b138be12 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: f98544c7-34bc-4d9d-a2f0-105e84864ee5] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:38:27.129039 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d7f9bcbf-6a21-4842-8188-5011b138be12 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:27.129531 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d7f9bcbf-6a21-4842-8188-5011b138be12 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:27.129966 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d7f9bcbf-6a21-4842-8188-5011b138be12 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:27.130712 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d7f9bcbf-6a21-4842-8188-5011b138be12 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:27.131441 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d7f9bcbf-6a21-4842-8188-5011b138be12 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:27.132009 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d7f9bcbf-6a21-4842-8188-5011b138be12 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:27.269149 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d7f9bcbf-6a21-4842-8188-5011b138be12 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b2b2b461354b8aa87cb19b0fb4fd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a146d50c0a544fe49bb604199bb67f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:38:27.278372 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d7f9bcbf-6a21-4842-8188-5011b138be12 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "GET /compute/v2.1/servers/f98544c7-34bc-4d9d-a2f0-105e84864ee5" status: 200 len: 1727 microversion: 2.1 time: 0.160849 Oct 04 21:38:27.279003 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3367/6769] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:38:27 2022] GET /compute/v2.1/servers/f98544c7-34bc-4d9d-a2f0-105e84864ee5 => generated 1727 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:38:27.437534 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-20c86c7a-ccd0-4e4b-8546-f52e276ed1b8 req-899278ef-0b25-41db-9c36-692b77396df2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f98544c7-34bc-4d9d-a2f0-105e84864ee5", "name": "network-vif-unplugged", "status": "completed", "tag": "917e9508-4f38-46c4-b711-a22daf6d7bb1"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:38:27.448734 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-20c86c7a-ccd0-4e4b-8546-f52e276ed1b8 req-899278ef-0b25-41db-9c36-692b77396df2 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:27.449225 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-20c86c7a-ccd0-4e4b-8546-f52e276ed1b8 req-899278ef-0b25-41db-9c36-692b77396df2 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:27.449671 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-20c86c7a-ccd0-4e4b-8546-f52e276ed1b8 req-899278ef-0b25-41db-9c36-692b77396df2 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:27.462596 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-20c86c7a-ccd0-4e4b-8546-f52e276ed1b8 req-899278ef-0b25-41db-9c36-692b77396df2 service nova] Creating event network-vif-unplugged:917e9508-4f38-46c4-b711-a22daf6d7bb1 for instance f98544c7-34bc-4d9d-a2f0-105e84864ee5 on n-h1-854823-8 Oct 04 21:38:27.468262 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [req-20c86c7a-ccd0-4e4b-8546-f52e276ed1b8 req-899278ef-0b25-41db-9c36-692b77396df2 service nova] Instance f98544c7-34bc-4d9d-a2f0-105e84864ee5 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854823-8', 'n-h2-854823-8'} {{(pid=128802) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 21:38:27.479739 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-20c86c7a-ccd0-4e4b-8546-f52e276ed1b8 req-899278ef-0b25-41db-9c36-692b77396df2 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.105662 Oct 04 21:38:27.480361 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3403/6770] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:38:27 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:38:28.304310 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-28fa6e28-27c2-451c-a648-d6d59dfe0906 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:38:28.304936 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-28fa6e28-27c2-451c-a648-d6d59dfe0906 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: f98544c7-34bc-4d9d-a2f0-105e84864ee5] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:38:28.311960 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-28fa6e28-27c2-451c-a648-d6d59dfe0906 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:28.312450 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-28fa6e28-27c2-451c-a648-d6d59dfe0906 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:28.312893 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-28fa6e28-27c2-451c-a648-d6d59dfe0906 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:28.313602 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-28fa6e28-27c2-451c-a648-d6d59dfe0906 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:28.314065 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-28fa6e28-27c2-451c-a648-d6d59dfe0906 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:28.314518 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-28fa6e28-27c2-451c-a648-d6d59dfe0906 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:28.455117 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-28fa6e28-27c2-451c-a648-d6d59dfe0906 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b2b2b461354b8aa87cb19b0fb4fd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a146d50c0a544fe49bb604199bb67f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:38:28.464266 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-28fa6e28-27c2-451c-a648-d6d59dfe0906 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "GET /compute/v2.1/servers/f98544c7-34bc-4d9d-a2f0-105e84864ee5" status: 200 len: 1727 microversion: 2.1 time: 0.165305 Oct 04 21:38:28.464861 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3368/6771] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:38:28 2022] GET /compute/v2.1/servers/f98544c7-34bc-4d9d-a2f0-105e84864ee5 => generated 1727 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:38:29.488844 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-2f9b4eb6-dfb7-4c76-a75a-ce22aa113e66 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:38:29.489578 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-2f9b4eb6-dfb7-4c76-a75a-ce22aa113e66 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: f98544c7-34bc-4d9d-a2f0-105e84864ee5] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:38:29.498237 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2f9b4eb6-dfb7-4c76-a75a-ce22aa113e66 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:29.498765 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2f9b4eb6-dfb7-4c76-a75a-ce22aa113e66 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:29.498928 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-564e778e-39be-447b-956a-00dff6eff834 req-41ab7895-77f7-4700-add4-b799aa96f535 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f98544c7-34bc-4d9d-a2f0-105e84864ee5", "tag": "917e9508-4f38-46c4-b711-a22daf6d7bb1"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:38:29.499415 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2f9b4eb6-dfb7-4c76-a75a-ce22aa113e66 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:29.499921 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2f9b4eb6-dfb7-4c76-a75a-ce22aa113e66 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:29.500392 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2f9b4eb6-dfb7-4c76-a75a-ce22aa113e66 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:29.500831 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2f9b4eb6-dfb7-4c76-a75a-ce22aa113e66 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:29.510383 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-564e778e-39be-447b-956a-00dff6eff834 req-41ab7895-77f7-4700-add4-b799aa96f535 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:29.511455 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-564e778e-39be-447b-956a-00dff6eff834 req-41ab7895-77f7-4700-add4-b799aa96f535 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:29.511455 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-564e778e-39be-447b-956a-00dff6eff834 req-41ab7895-77f7-4700-add4-b799aa96f535 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:29.527342 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-564e778e-39be-447b-956a-00dff6eff834 req-41ab7895-77f7-4700-add4-b799aa96f535 service nova] Creating event network-changed:917e9508-4f38-46c4-b711-a22daf6d7bb1 for instance f98544c7-34bc-4d9d-a2f0-105e84864ee5 on n-h1-854823-8 Oct 04 21:38:29.533312 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [req-564e778e-39be-447b-956a-00dff6eff834 req-41ab7895-77f7-4700-add4-b799aa96f535 service nova] Instance f98544c7-34bc-4d9d-a2f0-105e84864ee5 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854823-8', 'n-h2-854823-8'} {{(pid=128801) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 21:38:29.545221 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-564e778e-39be-447b-956a-00dff6eff834 req-41ab7895-77f7-4700-add4-b799aa96f535 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050583 Oct 04 21:38:29.546072 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3369/6772] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:38:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:38:29.683408 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-2f9b4eb6-dfb7-4c76-a75a-ce22aa113e66 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b2b2b461354b8aa87cb19b0fb4fd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a146d50c0a544fe49bb604199bb67f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:38:29.707824 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-2f9b4eb6-dfb7-4c76-a75a-ce22aa113e66 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "GET /compute/v2.1/servers/f98544c7-34bc-4d9d-a2f0-105e84864ee5" status: 200 len: 1725 microversion: 2.1 time: 0.223411 Oct 04 21:38:29.709132 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3404/6773] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:38:29 2022] GET /compute/v2.1/servers/f98544c7-34bc-4d9d-a2f0-105e84864ee5 => generated 1725 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:38:30.734745 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-55b7c8da-670a-4efc-8706-af7f74d96225 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:38:30.735461 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-55b7c8da-670a-4efc-8706-af7f74d96225 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: f98544c7-34bc-4d9d-a2f0-105e84864ee5] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:38:30.742151 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-55b7c8da-670a-4efc-8706-af7f74d96225 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:30.742673 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-55b7c8da-670a-4efc-8706-af7f74d96225 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:30.743110 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-55b7c8da-670a-4efc-8706-af7f74d96225 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:30.743812 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-55b7c8da-670a-4efc-8706-af7f74d96225 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:30.744271 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-55b7c8da-670a-4efc-8706-af7f74d96225 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:30.744692 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-55b7c8da-670a-4efc-8706-af7f74d96225 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:30.884439 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-55b7c8da-670a-4efc-8706-af7f74d96225 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b2b2b461354b8aa87cb19b0fb4fd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a146d50c0a544fe49bb604199bb67f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:38:30.893053 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-55b7c8da-670a-4efc-8706-af7f74d96225 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "GET /compute/v2.1/servers/f98544c7-34bc-4d9d-a2f0-105e84864ee5" status: 200 len: 1725 microversion: 2.1 time: 0.163549 Oct 04 21:38:30.893641 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3370/6774] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:38:30 2022] GET /compute/v2.1/servers/f98544c7-34bc-4d9d-a2f0-105e84864ee5 => generated 1725 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:38:31.918107 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-25367568-f0e1-4db8-8a68-396ca083afba tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:38:31.918897 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-25367568-f0e1-4db8-8a68-396ca083afba tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: f98544c7-34bc-4d9d-a2f0-105e84864ee5] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:38:31.925806 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-25367568-f0e1-4db8-8a68-396ca083afba tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:31.926302 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-25367568-f0e1-4db8-8a68-396ca083afba tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:31.927037 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-25367568-f0e1-4db8-8a68-396ca083afba tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:31.928424 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-25367568-f0e1-4db8-8a68-396ca083afba tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:31.929043 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-25367568-f0e1-4db8-8a68-396ca083afba tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:31.929547 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-25367568-f0e1-4db8-8a68-396ca083afba tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:32.062063 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-25367568-f0e1-4db8-8a68-396ca083afba tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b2b2b461354b8aa87cb19b0fb4fd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a146d50c0a544fe49bb604199bb67f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:38:32.071977 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-25367568-f0e1-4db8-8a68-396ca083afba tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "GET /compute/v2.1/servers/f98544c7-34bc-4d9d-a2f0-105e84864ee5" status: 200 len: 1725 microversion: 2.1 time: 0.157868 Oct 04 21:38:32.072592 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3405/6775] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:38:31 2022] GET /compute/v2.1/servers/f98544c7-34bc-4d9d-a2f0-105e84864ee5 => generated 1725 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:38:33.096252 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ba986e77-c062-469d-acfc-0f96e8b5cdc4 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:38:33.096859 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ba986e77-c062-469d-acfc-0f96e8b5cdc4 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: f98544c7-34bc-4d9d-a2f0-105e84864ee5] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:38:33.103973 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ba986e77-c062-469d-acfc-0f96e8b5cdc4 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:33.104459 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ba986e77-c062-469d-acfc-0f96e8b5cdc4 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:33.104899 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ba986e77-c062-469d-acfc-0f96e8b5cdc4 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:33.105598 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ba986e77-c062-469d-acfc-0f96e8b5cdc4 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:33.106050 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ba986e77-c062-469d-acfc-0f96e8b5cdc4 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:33.106504 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ba986e77-c062-469d-acfc-0f96e8b5cdc4 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:33.249251 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-ba986e77-c062-469d-acfc-0f96e8b5cdc4 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b2b2b461354b8aa87cb19b0fb4fd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a146d50c0a544fe49bb604199bb67f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:38:33.262599 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ba986e77-c062-469d-acfc-0f96e8b5cdc4 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "GET /compute/v2.1/servers/f98544c7-34bc-4d9d-a2f0-105e84864ee5" status: 200 len: 1725 microversion: 2.1 time: 0.169784 Oct 04 21:38:33.262769 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3371/6776] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:38:33 2022] GET /compute/v2.1/servers/f98544c7-34bc-4d9d-a2f0-105e84864ee5 => generated 1725 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:38:34.286074 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-e9b5b3ef-f4bf-4388-b69a-86eed355c8b5 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:38:34.286718 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-e9b5b3ef-f4bf-4388-b69a-86eed355c8b5 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: f98544c7-34bc-4d9d-a2f0-105e84864ee5] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:38:34.294050 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e9b5b3ef-f4bf-4388-b69a-86eed355c8b5 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:34.294592 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e9b5b3ef-f4bf-4388-b69a-86eed355c8b5 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:34.295050 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e9b5b3ef-f4bf-4388-b69a-86eed355c8b5 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:34.295756 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e9b5b3ef-f4bf-4388-b69a-86eed355c8b5 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:34.296225 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e9b5b3ef-f4bf-4388-b69a-86eed355c8b5 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:34.296662 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e9b5b3ef-f4bf-4388-b69a-86eed355c8b5 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:34.430624 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-e9b5b3ef-f4bf-4388-b69a-86eed355c8b5 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b2b2b461354b8aa87cb19b0fb4fd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a146d50c0a544fe49bb604199bb67f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:38:34.438987 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-e9b5b3ef-f4bf-4388-b69a-86eed355c8b5 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "GET /compute/v2.1/servers/f98544c7-34bc-4d9d-a2f0-105e84864ee5" status: 200 len: 1725 microversion: 2.1 time: 0.156823 Oct 04 21:38:34.439614 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3406/6777] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:38:34 2022] GET /compute/v2.1/servers/f98544c7-34bc-4d9d-a2f0-105e84864ee5 => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:38:35.463584 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b0b28528-9bd5-4aba-8c16-8bf1d83ca457 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:38:35.464207 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b0b28528-9bd5-4aba-8c16-8bf1d83ca457 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: f98544c7-34bc-4d9d-a2f0-105e84864ee5] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:38:35.471111 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b0b28528-9bd5-4aba-8c16-8bf1d83ca457 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:35.471594 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b0b28528-9bd5-4aba-8c16-8bf1d83ca457 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:35.472025 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b0b28528-9bd5-4aba-8c16-8bf1d83ca457 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:35.472707 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b0b28528-9bd5-4aba-8c16-8bf1d83ca457 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:35.473159 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b0b28528-9bd5-4aba-8c16-8bf1d83ca457 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:35.473582 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b0b28528-9bd5-4aba-8c16-8bf1d83ca457 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:35.607418 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-b0b28528-9bd5-4aba-8c16-8bf1d83ca457 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b2b2b461354b8aa87cb19b0fb4fd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a146d50c0a544fe49bb604199bb67f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:38:35.616890 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b0b28528-9bd5-4aba-8c16-8bf1d83ca457 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "GET /compute/v2.1/servers/f98544c7-34bc-4d9d-a2f0-105e84864ee5" status: 200 len: 1725 microversion: 2.1 time: 0.158211 Oct 04 21:38:35.617477 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3372/6778] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:38:35 2022] GET /compute/v2.1/servers/f98544c7-34bc-4d9d-a2f0-105e84864ee5 => generated 1725 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:38:36.640852 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-0e250e5d-146a-4d64-9057-ea3e54a9b09a tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:38:36.641473 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-0e250e5d-146a-4d64-9057-ea3e54a9b09a tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: f98544c7-34bc-4d9d-a2f0-105e84864ee5] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:38:36.644325 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_api:SELECT=33 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:38:36.650324 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0e250e5d-146a-4d64-9057-ea3e54a9b09a tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:36.650840 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0e250e5d-146a-4d64-9057-ea3e54a9b09a tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:36.651295 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0e250e5d-146a-4d64-9057-ea3e54a9b09a tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:36.652031 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0e250e5d-146a-4d64-9057-ea3e54a9b09a tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:36.652499 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0e250e5d-146a-4d64-9057-ea3e54a9b09a tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:36.652937 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0e250e5d-146a-4d64-9057-ea3e54a9b09a tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:36.655863 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:38:36.791019 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-0e250e5d-146a-4d64-9057-ea3e54a9b09a tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b2b2b461354b8aa87cb19b0fb4fd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a146d50c0a544fe49bb604199bb67f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:38:36.799333 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-0e250e5d-146a-4d64-9057-ea3e54a9b09a tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "GET /compute/v2.1/servers/f98544c7-34bc-4d9d-a2f0-105e84864ee5" status: 200 len: 1725 microversion: 2.1 time: 0.162405 Oct 04 21:38:36.799906 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3407/6779] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:38:36 2022] GET /compute/v2.1/servers/f98544c7-34bc-4d9d-a2f0-105e84864ee5 => generated 1725 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:38:37.823201 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-4615dc93-4187-4462-9e48-ceb922d7fe72 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:38:37.823816 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-4615dc93-4187-4462-9e48-ceb922d7fe72 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: f98544c7-34bc-4d9d-a2f0-105e84864ee5] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:38:37.826838 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=31 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:38:37.832091 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4615dc93-4187-4462-9e48-ceb922d7fe72 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:37.832577 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4615dc93-4187-4462-9e48-ceb922d7fe72 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:37.833048 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4615dc93-4187-4462-9e48-ceb922d7fe72 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:37.833799 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4615dc93-4187-4462-9e48-ceb922d7fe72 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:37.834582 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4615dc93-4187-4462-9e48-ceb922d7fe72 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:37.835018 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4615dc93-4187-4462-9e48-ceb922d7fe72 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:37.837832 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=89 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:38:37.966052 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-4615dc93-4187-4462-9e48-ceb922d7fe72 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b2b2b461354b8aa87cb19b0fb4fd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a146d50c0a544fe49bb604199bb67f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:38:37.975038 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-4615dc93-4187-4462-9e48-ceb922d7fe72 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "GET /compute/v2.1/servers/f98544c7-34bc-4d9d-a2f0-105e84864ee5" status: 200 len: 1725 microversion: 2.1 time: 0.155220 Oct 04 21:38:37.975651 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3373/6780] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:38:37 2022] GET /compute/v2.1/servers/f98544c7-34bc-4d9d-a2f0-105e84864ee5 => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:38:38.998830 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-3b7ebc3d-955b-4dd0-82fb-527681740d6b tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:38:38.999413 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-3b7ebc3d-955b-4dd0-82fb-527681740d6b tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: f98544c7-34bc-4d9d-a2f0-105e84864ee5] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:38:39.006982 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3b7ebc3d-955b-4dd0-82fb-527681740d6b tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:39.007471 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3b7ebc3d-955b-4dd0-82fb-527681740d6b tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:39.007911 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3b7ebc3d-955b-4dd0-82fb-527681740d6b tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:39.008616 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3b7ebc3d-955b-4dd0-82fb-527681740d6b tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:39.009075 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3b7ebc3d-955b-4dd0-82fb-527681740d6b tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:39.009507 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3b7ebc3d-955b-4dd0-82fb-527681740d6b tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:39.148017 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-3b7ebc3d-955b-4dd0-82fb-527681740d6b tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b2b2b461354b8aa87cb19b0fb4fd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a146d50c0a544fe49bb604199bb67f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:38:39.156910 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-3b7ebc3d-955b-4dd0-82fb-527681740d6b tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "GET /compute/v2.1/servers/f98544c7-34bc-4d9d-a2f0-105e84864ee5" status: 200 len: 1725 microversion: 2.1 time: 0.161922 Oct 04 21:38:39.157498 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3408/6781] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:38:38 2022] GET /compute/v2.1/servers/f98544c7-34bc-4d9d-a2f0-105e84864ee5 => generated 1725 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:38:40.181172 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-3ea6e398-755a-48c8-8f99-b92ca9e3366f tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:38:40.181789 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-3ea6e398-755a-48c8-8f99-b92ca9e3366f tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: f98544c7-34bc-4d9d-a2f0-105e84864ee5] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:38:40.188857 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3ea6e398-755a-48c8-8f99-b92ca9e3366f tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:40.189347 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3ea6e398-755a-48c8-8f99-b92ca9e3366f tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:40.189784 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3ea6e398-755a-48c8-8f99-b92ca9e3366f tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:40.190506 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3ea6e398-755a-48c8-8f99-b92ca9e3366f tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:40.190967 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3ea6e398-755a-48c8-8f99-b92ca9e3366f tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:40.191395 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3ea6e398-755a-48c8-8f99-b92ca9e3366f tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:40.324111 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-3ea6e398-755a-48c8-8f99-b92ca9e3366f tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b2b2b461354b8aa87cb19b0fb4fd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a146d50c0a544fe49bb604199bb67f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:38:40.332382 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-3ea6e398-755a-48c8-8f99-b92ca9e3366f tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "GET /compute/v2.1/servers/f98544c7-34bc-4d9d-a2f0-105e84864ee5" status: 200 len: 1725 microversion: 2.1 time: 0.155834 Oct 04 21:38:40.332977 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3374/6782] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:38:40 2022] GET /compute/v2.1/servers/f98544c7-34bc-4d9d-a2f0-105e84864ee5 => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:38:41.356853 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-b13b2d92-8e15-419b-a2c6-8318d0c432e1 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:38:41.357505 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-b13b2d92-8e15-419b-a2c6-8318d0c432e1 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: f98544c7-34bc-4d9d-a2f0-105e84864ee5] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:38:41.364412 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b13b2d92-8e15-419b-a2c6-8318d0c432e1 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:41.364937 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b13b2d92-8e15-419b-a2c6-8318d0c432e1 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:41.365417 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b13b2d92-8e15-419b-a2c6-8318d0c432e1 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:41.366124 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b13b2d92-8e15-419b-a2c6-8318d0c432e1 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:41.366632 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b13b2d92-8e15-419b-a2c6-8318d0c432e1 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:41.367079 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b13b2d92-8e15-419b-a2c6-8318d0c432e1 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:41.497431 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-b13b2d92-8e15-419b-a2c6-8318d0c432e1 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b2b2b461354b8aa87cb19b0fb4fd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a146d50c0a544fe49bb604199bb67f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:38:41.506555 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-b13b2d92-8e15-419b-a2c6-8318d0c432e1 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "GET /compute/v2.1/servers/f98544c7-34bc-4d9d-a2f0-105e84864ee5" status: 200 len: 1722 microversion: 2.1 time: 0.152922 Oct 04 21:38:41.507127 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3409/6783] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:38:41 2022] GET /compute/v2.1/servers/f98544c7-34bc-4d9d-a2f0-105e84864ee5 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:38:41.530456 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-04d8a6f4-8048-46cc-b72c-54195bfa4d05 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:38:41.530985 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-04d8a6f4-8048-46cc-b72c-54195bfa4d05 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: f98544c7-34bc-4d9d-a2f0-105e84864ee5] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:38:41.537966 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-04d8a6f4-8048-46cc-b72c-54195bfa4d05 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:41.538479 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-04d8a6f4-8048-46cc-b72c-54195bfa4d05 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:41.538919 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-04d8a6f4-8048-46cc-b72c-54195bfa4d05 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:41.539604 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-04d8a6f4-8048-46cc-b72c-54195bfa4d05 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:41.540056 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-04d8a6f4-8048-46cc-b72c-54195bfa4d05 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:41.540476 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-04d8a6f4-8048-46cc-b72c-54195bfa4d05 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:41.581025 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-04d8a6f4-8048-46cc-b72c-54195bfa4d05 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:41.581496 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-04d8a6f4-8048-46cc-b72c-54195bfa4d05 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:41.581924 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-04d8a6f4-8048-46cc-b72c-54195bfa4d05 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:41.582663 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-04d8a6f4-8048-46cc-b72c-54195bfa4d05 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:41.583117 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-04d8a6f4-8048-46cc-b72c-54195bfa4d05 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:41.583532 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-04d8a6f4-8048-46cc-b72c-54195bfa4d05 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:41.604432 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-04d8a6f4-8048-46cc-b72c-54195bfa4d05 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Getting quotas for project a146d50c0a544fe49bb604199bb67f02. Resources: {'ram', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:38:41.609537 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-04d8a6f4-8048-46cc-b72c-54195bfa4d05 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Getting quotas for user a2b2b2b461354b8aa87cb19b0fb4fd28 and project a146d50c0a544fe49bb604199bb67f02. Resources: {'ram', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:38:41.713432 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-04d8a6f4-8048-46cc-b72c-54195bfa4d05 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "POST /compute/v2.1/servers/f98544c7-34bc-4d9d-a2f0-105e84864ee5/action" status: 202 len: 0 microversion: 2.1 time: 0.186785 Oct 04 21:38:41.714440 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3375/6784] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 21:38:41 2022] POST /compute/v2.1/servers/f98544c7-34bc-4d9d-a2f0-105e84864ee5/action => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:38:41.722932 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-332ebdc0-0d3e-4b91-9864-496f469cda47 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:38:41.723658 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-332ebdc0-0d3e-4b91-9864-496f469cda47 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: f98544c7-34bc-4d9d-a2f0-105e84864ee5] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:38:41.730469 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-332ebdc0-0d3e-4b91-9864-496f469cda47 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:41.731065 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-332ebdc0-0d3e-4b91-9864-496f469cda47 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:41.731589 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-332ebdc0-0d3e-4b91-9864-496f469cda47 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:41.732410 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-332ebdc0-0d3e-4b91-9864-496f469cda47 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:41.733043 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-332ebdc0-0d3e-4b91-9864-496f469cda47 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:41.733627 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-332ebdc0-0d3e-4b91-9864-496f469cda47 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:41.871657 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-332ebdc0-0d3e-4b91-9864-496f469cda47 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b2b2b461354b8aa87cb19b0fb4fd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a146d50c0a544fe49bb604199bb67f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:38:41.881128 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-332ebdc0-0d3e-4b91-9864-496f469cda47 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "GET /compute/v2.1/servers/f98544c7-34bc-4d9d-a2f0-105e84864ee5" status: 200 len: 1721 microversion: 2.1 time: 0.162313 Oct 04 21:38:41.881715 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3410/6785] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:38:41 2022] GET /compute/v2.1/servers/f98544c7-34bc-4d9d-a2f0-105e84864ee5 => generated 1721 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:38:42.905732 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e309b2fc-a819-4a4d-8610-902d10431ee3 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:38:42.906456 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e309b2fc-a819-4a4d-8610-902d10431ee3 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: f98544c7-34bc-4d9d-a2f0-105e84864ee5] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:38:42.913591 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e309b2fc-a819-4a4d-8610-902d10431ee3 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:42.914065 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e309b2fc-a819-4a4d-8610-902d10431ee3 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:42.914541 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e309b2fc-a819-4a4d-8610-902d10431ee3 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:42.915231 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e309b2fc-a819-4a4d-8610-902d10431ee3 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:42.915682 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e309b2fc-a819-4a4d-8610-902d10431ee3 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:42.916101 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e309b2fc-a819-4a4d-8610-902d10431ee3 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:43.049825 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e309b2fc-a819-4a4d-8610-902d10431ee3 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b2b2b461354b8aa87cb19b0fb4fd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a146d50c0a544fe49bb604199bb67f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:38:43.059203 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e309b2fc-a819-4a4d-8610-902d10431ee3 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "GET /compute/v2.1/servers/f98544c7-34bc-4d9d-a2f0-105e84864ee5" status: 200 len: 1721 microversion: 2.1 time: 0.157742 Oct 04 21:38:43.059802 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3376/6786] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:38:42 2022] GET /compute/v2.1/servers/f98544c7-34bc-4d9d-a2f0-105e84864ee5 => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:38:44.084092 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-39637c3c-8175-4921-a3fe-2bb25d874f47 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:38:44.084924 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-39637c3c-8175-4921-a3fe-2bb25d874f47 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: f98544c7-34bc-4d9d-a2f0-105e84864ee5] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:38:44.091794 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-39637c3c-8175-4921-a3fe-2bb25d874f47 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:44.092293 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-39637c3c-8175-4921-a3fe-2bb25d874f47 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:44.092840 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-39637c3c-8175-4921-a3fe-2bb25d874f47 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:44.096091 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-39637c3c-8175-4921-a3fe-2bb25d874f47 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:44.096091 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-39637c3c-8175-4921-a3fe-2bb25d874f47 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:44.096091 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-39637c3c-8175-4921-a3fe-2bb25d874f47 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:44.236784 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-39637c3c-8175-4921-a3fe-2bb25d874f47 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b2b2b461354b8aa87cb19b0fb4fd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a146d50c0a544fe49bb604199bb67f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:38:44.245466 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-39637c3c-8175-4921-a3fe-2bb25d874f47 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "GET /compute/v2.1/servers/f98544c7-34bc-4d9d-a2f0-105e84864ee5" status: 200 len: 1721 microversion: 2.1 time: 0.165834 Oct 04 21:38:44.246053 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3411/6787] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:38:44 2022] GET /compute/v2.1/servers/f98544c7-34bc-4d9d-a2f0-105e84864ee5 => generated 1721 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:38:44.827672 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-654ba5e2-67d9-4f51-8ebd-cea4326c53ea req-d5449dd4-a257-4db8-a3a9-14a56ae01b21 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f98544c7-34bc-4d9d-a2f0-105e84864ee5", "name": "network-vif-plugged", "status": "completed", "tag": "917e9508-4f38-46c4-b711-a22daf6d7bb1"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:38:44.839465 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-654ba5e2-67d9-4f51-8ebd-cea4326c53ea req-d5449dd4-a257-4db8-a3a9-14a56ae01b21 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:44.839956 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-654ba5e2-67d9-4f51-8ebd-cea4326c53ea req-d5449dd4-a257-4db8-a3a9-14a56ae01b21 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:44.840396 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-654ba5e2-67d9-4f51-8ebd-cea4326c53ea req-d5449dd4-a257-4db8-a3a9-14a56ae01b21 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:44.854762 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-654ba5e2-67d9-4f51-8ebd-cea4326c53ea req-d5449dd4-a257-4db8-a3a9-14a56ae01b21 service nova] Creating event network-vif-plugged:917e9508-4f38-46c4-b711-a22daf6d7bb1 for instance f98544c7-34bc-4d9d-a2f0-105e84864ee5 on n-h1-854823-8 Oct 04 21:38:44.860642 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [req-654ba5e2-67d9-4f51-8ebd-cea4326c53ea req-d5449dd4-a257-4db8-a3a9-14a56ae01b21 service nova] Instance f98544c7-34bc-4d9d-a2f0-105e84864ee5 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854823-8', 'n-h2-854823-8'} {{(pid=128801) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 21:38:44.872504 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-654ba5e2-67d9-4f51-8ebd-cea4326c53ea req-d5449dd4-a257-4db8-a3a9-14a56ae01b21 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048539 Oct 04 21:38:44.873635 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3377/6788] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:38:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:38:45.269231 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-72e76394-b0a8-43fd-9088-4c4392b6e5a2 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:38:45.269854 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-72e76394-b0a8-43fd-9088-4c4392b6e5a2 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: f98544c7-34bc-4d9d-a2f0-105e84864ee5] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:38:45.276951 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-72e76394-b0a8-43fd-9088-4c4392b6e5a2 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:45.277448 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-72e76394-b0a8-43fd-9088-4c4392b6e5a2 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:45.277895 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-72e76394-b0a8-43fd-9088-4c4392b6e5a2 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:45.278637 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-72e76394-b0a8-43fd-9088-4c4392b6e5a2 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:45.279109 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-72e76394-b0a8-43fd-9088-4c4392b6e5a2 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:45.279549 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-72e76394-b0a8-43fd-9088-4c4392b6e5a2 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:45.412409 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-72e76394-b0a8-43fd-9088-4c4392b6e5a2 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b2b2b461354b8aa87cb19b0fb4fd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a146d50c0a544fe49bb604199bb67f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:38:45.420762 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-72e76394-b0a8-43fd-9088-4c4392b6e5a2 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "GET /compute/v2.1/servers/f98544c7-34bc-4d9d-a2f0-105e84864ee5" status: 200 len: 1721 microversion: 2.1 time: 0.155520 Oct 04 21:38:45.421337 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3412/6789] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:38:45 2022] GET /compute/v2.1/servers/f98544c7-34bc-4d9d-a2f0-105e84864ee5 => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:38:46.447826 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8b79c98d-b79d-4c90-b052-5ca32ed975c7 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:38:46.448528 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-8b79c98d-b79d-4c90-b052-5ca32ed975c7 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: f98544c7-34bc-4d9d-a2f0-105e84864ee5] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:38:46.455208 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8b79c98d-b79d-4c90-b052-5ca32ed975c7 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:46.455701 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8b79c98d-b79d-4c90-b052-5ca32ed975c7 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:46.456135 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8b79c98d-b79d-4c90-b052-5ca32ed975c7 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:46.456878 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8b79c98d-b79d-4c90-b052-5ca32ed975c7 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:46.457522 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8b79c98d-b79d-4c90-b052-5ca32ed975c7 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:46.457948 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8b79c98d-b79d-4c90-b052-5ca32ed975c7 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:46.598689 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-8b79c98d-b79d-4c90-b052-5ca32ed975c7 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b2b2b461354b8aa87cb19b0fb4fd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a146d50c0a544fe49bb604199bb67f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:38:46.607155 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-8b79c98d-b79d-4c90-b052-5ca32ed975c7 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "GET /compute/v2.1/servers/f98544c7-34bc-4d9d-a2f0-105e84864ee5" status: 200 len: 1721 microversion: 2.1 time: 0.165429 Oct 04 21:38:46.607797 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3378/6790] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:38:46 2022] GET /compute/v2.1/servers/f98544c7-34bc-4d9d-a2f0-105e84864ee5 => generated 1721 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:38:47.257386 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-b71bf4c2-c07b-4858-9d42-373d0a7f4803 req-341f70d8-c8c7-4f08-a09f-cef197c5e610 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f98544c7-34bc-4d9d-a2f0-105e84864ee5", "name": "network-vif-unplugged", "status": "completed", "tag": "917e9508-4f38-46c4-b711-a22daf6d7bb1"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:38:47.267429 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-b71bf4c2-c07b-4858-9d42-373d0a7f4803 req-341f70d8-c8c7-4f08-a09f-cef197c5e610 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:47.268197 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-b71bf4c2-c07b-4858-9d42-373d0a7f4803 req-341f70d8-c8c7-4f08-a09f-cef197c5e610 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:47.268638 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-b71bf4c2-c07b-4858-9d42-373d0a7f4803 req-341f70d8-c8c7-4f08-a09f-cef197c5e610 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:47.281076 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-b71bf4c2-c07b-4858-9d42-373d0a7f4803 req-341f70d8-c8c7-4f08-a09f-cef197c5e610 service nova] Creating event network-vif-unplugged:917e9508-4f38-46c4-b711-a22daf6d7bb1 for instance f98544c7-34bc-4d9d-a2f0-105e84864ee5 on n-h2-854823-8 Oct 04 21:38:47.286677 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [req-b71bf4c2-c07b-4858-9d42-373d0a7f4803 req-341f70d8-c8c7-4f08-a09f-cef197c5e610 service nova] Instance f98544c7-34bc-4d9d-a2f0-105e84864ee5 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854823-8', 'n-h2-854823-8'} {{(pid=128802) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 21:38:47.298695 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-b71bf4c2-c07b-4858-9d42-373d0a7f4803 req-341f70d8-c8c7-4f08-a09f-cef197c5e610 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.106280 Oct 04 21:38:47.299483 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3413/6791] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:38:47 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:38:47.632847 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b04ee41c-8c86-4a13-a095-9d5ed5088742 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:38:47.633571 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b04ee41c-8c86-4a13-a095-9d5ed5088742 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: f98544c7-34bc-4d9d-a2f0-105e84864ee5] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:38:47.642105 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b04ee41c-8c86-4a13-a095-9d5ed5088742 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:47.642624 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b04ee41c-8c86-4a13-a095-9d5ed5088742 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:47.643190 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b04ee41c-8c86-4a13-a095-9d5ed5088742 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:47.643961 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b04ee41c-8c86-4a13-a095-9d5ed5088742 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:47.644413 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b04ee41c-8c86-4a13-a095-9d5ed5088742 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:47.644833 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b04ee41c-8c86-4a13-a095-9d5ed5088742 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:47.884128 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-b04ee41c-8c86-4a13-a095-9d5ed5088742 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b2b2b461354b8aa87cb19b0fb4fd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a146d50c0a544fe49bb604199bb67f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:38:47.892446 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b04ee41c-8c86-4a13-a095-9d5ed5088742 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "GET /compute/v2.1/servers/f98544c7-34bc-4d9d-a2f0-105e84864ee5" status: 200 len: 1721 microversion: 2.1 time: 0.264344 Oct 04 21:38:47.893037 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3379/6792] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:38:47 2022] GET /compute/v2.1/servers/f98544c7-34bc-4d9d-a2f0-105e84864ee5 => generated 1721 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:38:48.918669 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-58b50f3b-8bdf-455d-89b7-d323b6e22ae3 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:38:48.919286 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-58b50f3b-8bdf-455d-89b7-d323b6e22ae3 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: f98544c7-34bc-4d9d-a2f0-105e84864ee5] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:38:48.925451 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-58b50f3b-8bdf-455d-89b7-d323b6e22ae3 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:48.925946 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-58b50f3b-8bdf-455d-89b7-d323b6e22ae3 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:48.926725 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-58b50f3b-8bdf-455d-89b7-d323b6e22ae3 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:48.928131 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-58b50f3b-8bdf-455d-89b7-d323b6e22ae3 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:48.928607 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-58b50f3b-8bdf-455d-89b7-d323b6e22ae3 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:48.929038 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-58b50f3b-8bdf-455d-89b7-d323b6e22ae3 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:49.072587 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-58b50f3b-8bdf-455d-89b7-d323b6e22ae3 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b2b2b461354b8aa87cb19b0fb4fd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a146d50c0a544fe49bb604199bb67f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:38:49.081135 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-58b50f3b-8bdf-455d-89b7-d323b6e22ae3 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "GET /compute/v2.1/servers/f98544c7-34bc-4d9d-a2f0-105e84864ee5" status: 200 len: 1721 microversion: 2.1 time: 0.167770 Oct 04 21:38:49.081813 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3414/6793] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:38:48 2022] GET /compute/v2.1/servers/f98544c7-34bc-4d9d-a2f0-105e84864ee5 => generated 1721 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:38:49.314019 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-c09bcdca-d1f2-42dd-8464-657689ba8cff req-b9c09a6d-c5c7-4185-af87-e33bbb6c03cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f98544c7-34bc-4d9d-a2f0-105e84864ee5", "tag": "917e9508-4f38-46c4-b711-a22daf6d7bb1"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:38:49.324875 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-c09bcdca-d1f2-42dd-8464-657689ba8cff req-b9c09a6d-c5c7-4185-af87-e33bbb6c03cb service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:49.325345 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-c09bcdca-d1f2-42dd-8464-657689ba8cff req-b9c09a6d-c5c7-4185-af87-e33bbb6c03cb service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:49.325777 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-c09bcdca-d1f2-42dd-8464-657689ba8cff req-b9c09a6d-c5c7-4185-af87-e33bbb6c03cb service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:49.338856 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-c09bcdca-d1f2-42dd-8464-657689ba8cff req-b9c09a6d-c5c7-4185-af87-e33bbb6c03cb service nova] Creating event network-changed:917e9508-4f38-46c4-b711-a22daf6d7bb1 for instance f98544c7-34bc-4d9d-a2f0-105e84864ee5 on n-h2-854823-8 Oct 04 21:38:49.344726 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [req-c09bcdca-d1f2-42dd-8464-657689ba8cff req-b9c09a6d-c5c7-4185-af87-e33bbb6c03cb service nova] Instance f98544c7-34bc-4d9d-a2f0-105e84864ee5 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854823-8', 'n-h2-854823-8'} {{(pid=128801) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 21:38:49.357205 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-c09bcdca-d1f2-42dd-8464-657689ba8cff req-b9c09a6d-c5c7-4185-af87-e33bbb6c03cb service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046933 Oct 04 21:38:49.357821 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3380/6794] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:38:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:38:50.108877 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-531a26a1-4ddf-400e-a033-989310ab438e tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:38:50.109485 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-531a26a1-4ddf-400e-a033-989310ab438e tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: f98544c7-34bc-4d9d-a2f0-105e84864ee5] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:38:50.118037 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-531a26a1-4ddf-400e-a033-989310ab438e tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:50.118623 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-531a26a1-4ddf-400e-a033-989310ab438e tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:50.119317 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-531a26a1-4ddf-400e-a033-989310ab438e tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:50.120630 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-531a26a1-4ddf-400e-a033-989310ab438e tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:50.121477 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-531a26a1-4ddf-400e-a033-989310ab438e tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:50.122232 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-531a26a1-4ddf-400e-a033-989310ab438e tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:50.330182 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-531a26a1-4ddf-400e-a033-989310ab438e tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b2b2b461354b8aa87cb19b0fb4fd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a146d50c0a544fe49bb604199bb67f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:38:50.339211 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-531a26a1-4ddf-400e-a033-989310ab438e tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "GET /compute/v2.1/servers/f98544c7-34bc-4d9d-a2f0-105e84864ee5" status: 200 len: 1721 microversion: 2.1 time: 0.235016 Oct 04 21:38:50.339800 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3415/6795] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:38:50 2022] GET /compute/v2.1/servers/f98544c7-34bc-4d9d-a2f0-105e84864ee5 => generated 1721 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:38:51.365448 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-3665eee7-0ddc-4bda-b46d-71af1e464478 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:38:51.366671 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-3665eee7-0ddc-4bda-b46d-71af1e464478 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: f98544c7-34bc-4d9d-a2f0-105e84864ee5] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:38:51.373559 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3665eee7-0ddc-4bda-b46d-71af1e464478 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:51.374026 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3665eee7-0ddc-4bda-b46d-71af1e464478 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:51.374546 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3665eee7-0ddc-4bda-b46d-71af1e464478 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:51.375437 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3665eee7-0ddc-4bda-b46d-71af1e464478 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:51.375937 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3665eee7-0ddc-4bda-b46d-71af1e464478 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:51.376358 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3665eee7-0ddc-4bda-b46d-71af1e464478 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:51.533565 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-3665eee7-0ddc-4bda-b46d-71af1e464478 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b2b2b461354b8aa87cb19b0fb4fd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a146d50c0a544fe49bb604199bb67f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:38:51.543227 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-3665eee7-0ddc-4bda-b46d-71af1e464478 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "GET /compute/v2.1/servers/f98544c7-34bc-4d9d-a2f0-105e84864ee5" status: 200 len: 1721 microversion: 2.1 time: 0.183050 Oct 04 21:38:51.543705 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3381/6796] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:38:51 2022] GET /compute/v2.1/servers/f98544c7-34bc-4d9d-a2f0-105e84864ee5 => generated 1721 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:38:52.570007 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-2510256c-817f-44a1-a273-74383124a665 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:38:52.570611 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-2510256c-817f-44a1-a273-74383124a665 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: f98544c7-34bc-4d9d-a2f0-105e84864ee5] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:38:52.577544 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2510256c-817f-44a1-a273-74383124a665 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:52.577988 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2510256c-817f-44a1-a273-74383124a665 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:52.578566 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2510256c-817f-44a1-a273-74383124a665 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:52.579288 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2510256c-817f-44a1-a273-74383124a665 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:52.579757 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2510256c-817f-44a1-a273-74383124a665 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:52.580195 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2510256c-817f-44a1-a273-74383124a665 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:52.716121 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-2510256c-817f-44a1-a273-74383124a665 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b2b2b461354b8aa87cb19b0fb4fd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a146d50c0a544fe49bb604199bb67f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:38:52.725224 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-2510256c-817f-44a1-a273-74383124a665 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "GET /compute/v2.1/servers/f98544c7-34bc-4d9d-a2f0-105e84864ee5" status: 200 len: 1721 microversion: 2.1 time: 0.160618 Oct 04 21:38:52.725806 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3416/6797] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:38:52 2022] GET /compute/v2.1/servers/f98544c7-34bc-4d9d-a2f0-105e84864ee5 => generated 1721 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:38:53.751438 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-629ff1a8-575b-45fd-984b-0e941f659397 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:38:53.752043 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-629ff1a8-575b-45fd-984b-0e941f659397 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: f98544c7-34bc-4d9d-a2f0-105e84864ee5] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:38:53.754155 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=3 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:38:53.762907 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-629ff1a8-575b-45fd-984b-0e941f659397 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:53.763393 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-629ff1a8-575b-45fd-984b-0e941f659397 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:53.763835 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-629ff1a8-575b-45fd-984b-0e941f659397 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:53.764537 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-629ff1a8-575b-45fd-984b-0e941f659397 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:53.765003 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-629ff1a8-575b-45fd-984b-0e941f659397 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:53.765428 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-629ff1a8-575b-45fd-984b-0e941f659397 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:53.916646 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-629ff1a8-575b-45fd-984b-0e941f659397 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b2b2b461354b8aa87cb19b0fb4fd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a146d50c0a544fe49bb604199bb67f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:38:53.924996 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-629ff1a8-575b-45fd-984b-0e941f659397 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "GET /compute/v2.1/servers/f98544c7-34bc-4d9d-a2f0-105e84864ee5" status: 200 len: 1721 microversion: 2.1 time: 0.179149 Oct 04 21:38:53.925584 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3382/6798] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:38:53 2022] GET /compute/v2.1/servers/f98544c7-34bc-4d9d-a2f0-105e84864ee5 => generated 1721 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:38:54.950496 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-a65267d7-8a85-429f-b334-95ca5624acbf tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:38:54.951077 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-a65267d7-8a85-429f-b334-95ca5624acbf tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: f98544c7-34bc-4d9d-a2f0-105e84864ee5] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:38:54.957917 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a65267d7-8a85-429f-b334-95ca5624acbf tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:54.958499 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a65267d7-8a85-429f-b334-95ca5624acbf tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:54.959777 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a65267d7-8a85-429f-b334-95ca5624acbf tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:54.960532 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a65267d7-8a85-429f-b334-95ca5624acbf tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:54.961000 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a65267d7-8a85-429f-b334-95ca5624acbf tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:54.961546 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a65267d7-8a85-429f-b334-95ca5624acbf tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:55.103718 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-a65267d7-8a85-429f-b334-95ca5624acbf tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b2b2b461354b8aa87cb19b0fb4fd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a146d50c0a544fe49bb604199bb67f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:38:55.112405 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-a65267d7-8a85-429f-b334-95ca5624acbf tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "GET /compute/v2.1/servers/f98544c7-34bc-4d9d-a2f0-105e84864ee5" status: 200 len: 1721 microversion: 2.1 time: 0.165920 Oct 04 21:38:55.112991 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3417/6799] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:38:54 2022] GET /compute/v2.1/servers/f98544c7-34bc-4d9d-a2f0-105e84864ee5 => generated 1721 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:38:56.138975 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0fbdf962-5fed-4b86-bf18-e60711820027 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:38:56.139547 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-0fbdf962-5fed-4b86-bf18-e60711820027 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: f98544c7-34bc-4d9d-a2f0-105e84864ee5] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:38:56.147566 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0fbdf962-5fed-4b86-bf18-e60711820027 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:56.148049 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0fbdf962-5fed-4b86-bf18-e60711820027 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:56.148491 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0fbdf962-5fed-4b86-bf18-e60711820027 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:56.149189 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0fbdf962-5fed-4b86-bf18-e60711820027 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:56.149898 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0fbdf962-5fed-4b86-bf18-e60711820027 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:56.150333 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0fbdf962-5fed-4b86-bf18-e60711820027 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:56.302474 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-0fbdf962-5fed-4b86-bf18-e60711820027 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b2b2b461354b8aa87cb19b0fb4fd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a146d50c0a544fe49bb604199bb67f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:38:56.312617 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-0fbdf962-5fed-4b86-bf18-e60711820027 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "GET /compute/v2.1/servers/f98544c7-34bc-4d9d-a2f0-105e84864ee5" status: 200 len: 1721 microversion: 2.1 time: 0.177898 Oct 04 21:38:56.313523 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3383/6800] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:38:56 2022] GET /compute/v2.1/servers/f98544c7-34bc-4d9d-a2f0-105e84864ee5 => generated 1721 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:38:57.339648 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-9e08682c-b7c4-43aa-b9cd-8015884f9232 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:38:57.340906 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-9e08682c-b7c4-43aa-b9cd-8015884f9232 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: f98544c7-34bc-4d9d-a2f0-105e84864ee5] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:38:57.348092 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9e08682c-b7c4-43aa-b9cd-8015884f9232 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:57.348591 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9e08682c-b7c4-43aa-b9cd-8015884f9232 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:57.349044 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9e08682c-b7c4-43aa-b9cd-8015884f9232 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:57.349848 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9e08682c-b7c4-43aa-b9cd-8015884f9232 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:57.350238 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9e08682c-b7c4-43aa-b9cd-8015884f9232 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:57.351457 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9e08682c-b7c4-43aa-b9cd-8015884f9232 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:57.505148 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-9e08682c-b7c4-43aa-b9cd-8015884f9232 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b2b2b461354b8aa87cb19b0fb4fd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a146d50c0a544fe49bb604199bb67f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:38:57.513939 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-9e08682c-b7c4-43aa-b9cd-8015884f9232 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "GET /compute/v2.1/servers/f98544c7-34bc-4d9d-a2f0-105e84864ee5" status: 200 len: 1721 microversion: 2.1 time: 0.179650 Oct 04 21:38:57.514579 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3418/6801] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:38:57 2022] GET /compute/v2.1/servers/f98544c7-34bc-4d9d-a2f0-105e84864ee5 => generated 1721 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:38:58.539676 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-51b8e9bb-1f3c-4c02-8555-03c254f0043e tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:38:58.540498 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-51b8e9bb-1f3c-4c02-8555-03c254f0043e tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: f98544c7-34bc-4d9d-a2f0-105e84864ee5] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:38:58.547784 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-51b8e9bb-1f3c-4c02-8555-03c254f0043e tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:58.548602 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-51b8e9bb-1f3c-4c02-8555-03c254f0043e tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:58.549040 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-51b8e9bb-1f3c-4c02-8555-03c254f0043e tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:58.549754 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-51b8e9bb-1f3c-4c02-8555-03c254f0043e tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:58.550251 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-51b8e9bb-1f3c-4c02-8555-03c254f0043e tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:58.550767 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-51b8e9bb-1f3c-4c02-8555-03c254f0043e tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:58.685184 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-51b8e9bb-1f3c-4c02-8555-03c254f0043e tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b2b2b461354b8aa87cb19b0fb4fd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a146d50c0a544fe49bb604199bb67f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:38:58.693713 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-51b8e9bb-1f3c-4c02-8555-03c254f0043e tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "GET /compute/v2.1/servers/f98544c7-34bc-4d9d-a2f0-105e84864ee5" status: 200 len: 1721 microversion: 2.1 time: 0.159177 Oct 04 21:38:58.695026 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3384/6802] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:38:58 2022] GET /compute/v2.1/servers/f98544c7-34bc-4d9d-a2f0-105e84864ee5 => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:38:59.719371 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-4f873241-f8ff-455b-a37a-b270ee6c11eb tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:38:59.719985 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-4f873241-f8ff-455b-a37a-b270ee6c11eb tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: f98544c7-34bc-4d9d-a2f0-105e84864ee5] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:38:59.727588 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4f873241-f8ff-455b-a37a-b270ee6c11eb tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:59.728075 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4f873241-f8ff-455b-a37a-b270ee6c11eb tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:59.728514 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4f873241-f8ff-455b-a37a-b270ee6c11eb tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:59.729215 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4f873241-f8ff-455b-a37a-b270ee6c11eb tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:38:59.729673 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4f873241-f8ff-455b-a37a-b270ee6c11eb tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:38:59.730106 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4f873241-f8ff-455b-a37a-b270ee6c11eb tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:38:59.866744 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-4f873241-f8ff-455b-a37a-b270ee6c11eb tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b2b2b461354b8aa87cb19b0fb4fd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a146d50c0a544fe49bb604199bb67f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:38:59.875043 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-4f873241-f8ff-455b-a37a-b270ee6c11eb tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "GET /compute/v2.1/servers/f98544c7-34bc-4d9d-a2f0-105e84864ee5" status: 200 len: 1721 microversion: 2.1 time: 0.159728 Oct 04 21:38:59.875663 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3419/6803] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:38:59 2022] GET /compute/v2.1/servers/f98544c7-34bc-4d9d-a2f0-105e84864ee5 => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:39:00.899145 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-053b5cb5-bd7d-45d2-a00b-af34355b4c1b tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:39:00.899739 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-053b5cb5-bd7d-45d2-a00b-af34355b4c1b tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: f98544c7-34bc-4d9d-a2f0-105e84864ee5] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:39:00.906810 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-053b5cb5-bd7d-45d2-a00b-af34355b4c1b tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:00.907299 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-053b5cb5-bd7d-45d2-a00b-af34355b4c1b tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:00.907734 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-053b5cb5-bd7d-45d2-a00b-af34355b4c1b tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:00.909617 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-053b5cb5-bd7d-45d2-a00b-af34355b4c1b tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:00.909617 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-053b5cb5-bd7d-45d2-a00b-af34355b4c1b tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:00.909617 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-053b5cb5-bd7d-45d2-a00b-af34355b4c1b tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:01.045567 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-053b5cb5-bd7d-45d2-a00b-af34355b4c1b tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b2b2b461354b8aa87cb19b0fb4fd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a146d50c0a544fe49bb604199bb67f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:39:01.055008 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-053b5cb5-bd7d-45d2-a00b-af34355b4c1b tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "GET /compute/v2.1/servers/f98544c7-34bc-4d9d-a2f0-105e84864ee5" status: 200 len: 1714 microversion: 2.1 time: 0.160423 Oct 04 21:39:01.055591 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3385/6804] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:39:00 2022] GET /compute/v2.1/servers/f98544c7-34bc-4d9d-a2f0-105e84864ee5 => generated 1714 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:39:01.078880 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-f8d5683a-041f-42f6-8054-7e3a3b2b77eb tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:39:01.079517 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-f8d5683a-041f-42f6-8054-7e3a3b2b77eb tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: f98544c7-34bc-4d9d-a2f0-105e84864ee5] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:39:01.087759 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f8d5683a-041f-42f6-8054-7e3a3b2b77eb tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:01.088269 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f8d5683a-041f-42f6-8054-7e3a3b2b77eb tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:01.088721 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f8d5683a-041f-42f6-8054-7e3a3b2b77eb tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:01.089442 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f8d5683a-041f-42f6-8054-7e3a3b2b77eb tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:01.089913 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f8d5683a-041f-42f6-8054-7e3a3b2b77eb tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:01.090372 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f8d5683a-041f-42f6-8054-7e3a3b2b77eb tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:01.229305 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-f8d5683a-041f-42f6-8054-7e3a3b2b77eb tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b2b2b461354b8aa87cb19b0fb4fd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a146d50c0a544fe49bb604199bb67f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:39:01.237566 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-f8d5683a-041f-42f6-8054-7e3a3b2b77eb tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "GET /compute/v2.1/servers/f98544c7-34bc-4d9d-a2f0-105e84864ee5" status: 200 len: 1714 microversion: 2.1 time: 0.162650 Oct 04 21:39:01.238149 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3420/6805] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:39:01 2022] GET /compute/v2.1/servers/f98544c7-34bc-4d9d-a2f0-105e84864ee5 => generated 1714 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:39:01.260559 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-fb6d081c-1b1d-443c-be0c-a7cb88ce9a29 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:39:01.261103 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-fb6d081c-1b1d-443c-be0c-a7cb88ce9a29 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: f98544c7-34bc-4d9d-a2f0-105e84864ee5] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:39:01.267191 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fb6d081c-1b1d-443c-be0c-a7cb88ce9a29 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:01.267672 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fb6d081c-1b1d-443c-be0c-a7cb88ce9a29 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:01.268104 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fb6d081c-1b1d-443c-be0c-a7cb88ce9a29 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:01.268806 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fb6d081c-1b1d-443c-be0c-a7cb88ce9a29 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:01.269257 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fb6d081c-1b1d-443c-be0c-a7cb88ce9a29 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:01.269679 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fb6d081c-1b1d-443c-be0c-a7cb88ce9a29 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:01.402509 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-fb6d081c-1b1d-443c-be0c-a7cb88ce9a29 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b2b2b461354b8aa87cb19b0fb4fd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a146d50c0a544fe49bb604199bb67f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:39:01.410845 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-fb6d081c-1b1d-443c-be0c-a7cb88ce9a29 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "GET /compute/v2.1/servers/f98544c7-34bc-4d9d-a2f0-105e84864ee5" status: 200 len: 1714 microversion: 2.1 time: 0.154849 Oct 04 21:39:01.411478 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3386/6806] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:39:01 2022] GET /compute/v2.1/servers/f98544c7-34bc-4d9d-a2f0-105e84864ee5 => generated 1714 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:39:01.435338 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-1a4faca5-74b2-4bfc-876c-a4dba80ce9a4 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:39:01.435847 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-1a4faca5-74b2-4bfc-876c-a4dba80ce9a4 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: f98544c7-34bc-4d9d-a2f0-105e84864ee5] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:39:01.441792 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1a4faca5-74b2-4bfc-876c-a4dba80ce9a4 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:01.442289 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1a4faca5-74b2-4bfc-876c-a4dba80ce9a4 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:01.442788 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1a4faca5-74b2-4bfc-876c-a4dba80ce9a4 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:01.443494 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1a4faca5-74b2-4bfc-876c-a4dba80ce9a4 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:01.443965 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1a4faca5-74b2-4bfc-876c-a4dba80ce9a4 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:01.445322 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1a4faca5-74b2-4bfc-876c-a4dba80ce9a4 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:01.473628 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-1a4faca5-74b2-4bfc-876c-a4dba80ce9a4 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: f98544c7-34bc-4d9d-a2f0-105e84864ee5] Going to try to terminate instance {{(pid=128802) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:39:01.554677 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-1a4faca5-74b2-4bfc-876c-a4dba80ce9a4 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "DELETE /compute/v2.1/servers/f98544c7-34bc-4d9d-a2f0-105e84864ee5" status: 204 len: 0 microversion: 2.1 time: 0.122309 Oct 04 21:39:01.555985 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3421/6807] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 21:39:01 2022] DELETE /compute/v2.1/servers/f98544c7-34bc-4d9d-a2f0-105e84864ee5 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:39:01.564329 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5f53f734-e4ae-45b1-8cad-26779af43734 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:39:01.565092 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-5f53f734-e4ae-45b1-8cad-26779af43734 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: f98544c7-34bc-4d9d-a2f0-105e84864ee5] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:39:01.572185 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5f53f734-e4ae-45b1-8cad-26779af43734 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:01.572777 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5f53f734-e4ae-45b1-8cad-26779af43734 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:01.573290 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5f53f734-e4ae-45b1-8cad-26779af43734 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:01.574089 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5f53f734-e4ae-45b1-8cad-26779af43734 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:01.574954 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5f53f734-e4ae-45b1-8cad-26779af43734 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:01.576027 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5f53f734-e4ae-45b1-8cad-26779af43734 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:01.592152 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:39:01.715791 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-5f53f734-e4ae-45b1-8cad-26779af43734 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b2b2b461354b8aa87cb19b0fb4fd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a146d50c0a544fe49bb604199bb67f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:39:01.724604 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5f53f734-e4ae-45b1-8cad-26779af43734 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "GET /compute/v2.1/servers/f98544c7-34bc-4d9d-a2f0-105e84864ee5" status: 200 len: 1720 microversion: 2.1 time: 0.164329 Oct 04 21:39:01.725704 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3387/6808] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:39:01 2022] GET /compute/v2.1/servers/f98544c7-34bc-4d9d-a2f0-105e84864ee5 => generated 1720 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:39:02.749469 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-6d65f63f-9c21-40a8-b6e2-854a660cb539 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:39:02.750179 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-6d65f63f-9c21-40a8-b6e2-854a660cb539 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: f98544c7-34bc-4d9d-a2f0-105e84864ee5] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:39:02.757617 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6d65f63f-9c21-40a8-b6e2-854a660cb539 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:02.758104 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6d65f63f-9c21-40a8-b6e2-854a660cb539 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:02.758581 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6d65f63f-9c21-40a8-b6e2-854a660cb539 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:02.759284 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6d65f63f-9c21-40a8-b6e2-854a660cb539 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:02.759751 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6d65f63f-9c21-40a8-b6e2-854a660cb539 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:02.760186 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6d65f63f-9c21-40a8-b6e2-854a660cb539 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:02.776157 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:39:02.898529 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-6d65f63f-9c21-40a8-b6e2-854a660cb539 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b2b2b461354b8aa87cb19b0fb4fd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a146d50c0a544fe49bb604199bb67f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:39:02.906809 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-6d65f63f-9c21-40a8-b6e2-854a660cb539 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "GET /compute/v2.1/servers/f98544c7-34bc-4d9d-a2f0-105e84864ee5" status: 200 len: 1720 microversion: 2.1 time: 0.161654 Oct 04 21:39:02.907386 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3422/6809] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:39:02 2022] GET /compute/v2.1/servers/f98544c7-34bc-4d9d-a2f0-105e84864ee5 => generated 1720 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:39:03.567243 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-f44e4023-2fea-4a4e-9065-e0f6ef525955 req-92e5b4aa-12dc-473c-bbed-d0d8b1a8fd93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f98544c7-34bc-4d9d-a2f0-105e84864ee5", "name": "network-vif-plugged", "status": "completed", "tag": "917e9508-4f38-46c4-b711-a22daf6d7bb1"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:39:03.578369 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-f44e4023-2fea-4a4e-9065-e0f6ef525955 req-92e5b4aa-12dc-473c-bbed-d0d8b1a8fd93 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:03.579059 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-f44e4023-2fea-4a4e-9065-e0f6ef525955 req-92e5b4aa-12dc-473c-bbed-d0d8b1a8fd93 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:03.579300 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-f44e4023-2fea-4a4e-9065-e0f6ef525955 req-92e5b4aa-12dc-473c-bbed-d0d8b1a8fd93 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:03.594771 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-f44e4023-2fea-4a4e-9065-e0f6ef525955 req-92e5b4aa-12dc-473c-bbed-d0d8b1a8fd93 service nova] Creating event network-vif-plugged:917e9508-4f38-46c4-b711-a22daf6d7bb1 for instance f98544c7-34bc-4d9d-a2f0-105e84864ee5 on n-h2-854823-8 Oct 04 21:39:03.600498 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-f44e4023-2fea-4a4e-9065-e0f6ef525955 req-92e5b4aa-12dc-473c-bbed-d0d8b1a8fd93 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036801 Oct 04 21:39:03.601695 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3388/6810] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:39:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:39:03.931572 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-8669abac-8378-4489-a933-54f379a857dd tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:39:03.932864 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-8669abac-8378-4489-a933-54f379a857dd tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: f98544c7-34bc-4d9d-a2f0-105e84864ee5] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:39:03.939872 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8669abac-8378-4489-a933-54f379a857dd tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:03.940541 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8669abac-8378-4489-a933-54f379a857dd tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:03.941120 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8669abac-8378-4489-a933-54f379a857dd tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:03.942037 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8669abac-8378-4489-a933-54f379a857dd tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:03.942686 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8669abac-8378-4489-a933-54f379a857dd tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:03.943490 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8669abac-8378-4489-a933-54f379a857dd tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:04.019296 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-8669abac-8378-4489-a933-54f379a857dd tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b2b2b461354b8aa87cb19b0fb4fd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a146d50c0a544fe49bb604199bb67f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:39:04.027969 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-8669abac-8378-4489-a933-54f379a857dd tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "GET /compute/v2.1/servers/f98544c7-34bc-4d9d-a2f0-105e84864ee5" status: 200 len: 1652 microversion: 2.1 time: 0.101459 Oct 04 21:39:04.028560 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3423/6811] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:39:03 2022] GET /compute/v2.1/servers/f98544c7-34bc-4d9d-a2f0-105e84864ee5 => generated 1652 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:39:04.193830 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-ab98067b-e251-4ba4-8134-b173a471978b req-dfe495e9-7464-4ab9-a0ce-68c5c32889ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f98544c7-34bc-4d9d-a2f0-105e84864ee5", "name": "network-vif-deleted", "tag": "917e9508-4f38-46c4-b711-a22daf6d7bb1"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:39:04.205862 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-ab98067b-e251-4ba4-8134-b173a471978b req-dfe495e9-7464-4ab9-a0ce-68c5c32889ae service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:04.206366 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-ab98067b-e251-4ba4-8134-b173a471978b req-dfe495e9-7464-4ab9-a0ce-68c5c32889ae service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:04.206820 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-ab98067b-e251-4ba4-8134-b173a471978b req-dfe495e9-7464-4ab9-a0ce-68c5c32889ae service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:04.219511 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-ab98067b-e251-4ba4-8134-b173a471978b req-dfe495e9-7464-4ab9-a0ce-68c5c32889ae service nova] Creating event network-vif-deleted:917e9508-4f38-46c4-b711-a22daf6d7bb1 for instance f98544c7-34bc-4d9d-a2f0-105e84864ee5 on n-h2-854823-8 Oct 04 21:39:04.226074 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-ab98067b-e251-4ba4-8134-b173a471978b req-dfe495e9-7464-4ab9-a0ce-68c5c32889ae service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035418 Oct 04 21:39:04.226832 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3389/6812] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:39:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:39:05.053847 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-5ad0827c-1105-4675-b8f1-0ea7ed3689a7 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:39:05.054673 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-5ad0827c-1105-4675-b8f1-0ea7ed3689a7 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: f98544c7-34bc-4d9d-a2f0-105e84864ee5] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:39:05.061972 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5ad0827c-1105-4675-b8f1-0ea7ed3689a7 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:05.065741 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5ad0827c-1105-4675-b8f1-0ea7ed3689a7 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:05.074815 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5ad0827c-1105-4675-b8f1-0ea7ed3689a7 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:05.074815 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5ad0827c-1105-4675-b8f1-0ea7ed3689a7 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:05.075093 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5ad0827c-1105-4675-b8f1-0ea7ed3689a7 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:05.075485 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5ad0827c-1105-4675-b8f1-0ea7ed3689a7 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:05.148031 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-5ad0827c-1105-4675-b8f1-0ea7ed3689a7 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b2b2b461354b8aa87cb19b0fb4fd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a146d50c0a544fe49bb604199bb67f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:39:05.157687 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-5ad0827c-1105-4675-b8f1-0ea7ed3689a7 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "GET /compute/v2.1/servers/f98544c7-34bc-4d9d-a2f0-105e84864ee5" status: 200 len: 1369 microversion: 2.1 time: 0.108987 Oct 04 21:39:05.158389 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3424/6813] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:39:05 2022] GET /compute/v2.1/servers/f98544c7-34bc-4d9d-a2f0-105e84864ee5 => generated 1369 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:39:06.183898 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-344ebf97-8565-43b9-a2b1-660338defc2d tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:39:06.184636 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-344ebf97-8565-43b9-a2b1-660338defc2d tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: f98544c7-34bc-4d9d-a2f0-105e84864ee5] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:39:06.191006 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-344ebf97-8565-43b9-a2b1-660338defc2d tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:06.191497 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-344ebf97-8565-43b9-a2b1-660338defc2d tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:06.191935 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-344ebf97-8565-43b9-a2b1-660338defc2d tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:06.192634 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-344ebf97-8565-43b9-a2b1-660338defc2d tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:06.193092 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-344ebf97-8565-43b9-a2b1-660338defc2d tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:06.193519 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-344ebf97-8565-43b9-a2b1-660338defc2d tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:06.262407 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-344ebf97-8565-43b9-a2b1-660338defc2d tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b2b2b461354b8aa87cb19b0fb4fd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a146d50c0a544fe49bb604199bb67f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:39:06.270888 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-344ebf97-8565-43b9-a2b1-660338defc2d tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "GET /compute/v2.1/servers/f98544c7-34bc-4d9d-a2f0-105e84864ee5" status: 200 len: 1369 microversion: 2.1 time: 0.092960 Oct 04 21:39:06.271495 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3390/6814] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:39:06 2022] GET /compute/v2.1/servers/f98544c7-34bc-4d9d-a2f0-105e84864ee5 => generated 1369 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:39:07.295148 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-7f037a89-0715-4ab8-b414-fea88c1d9996 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:39:07.295915 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-7f037a89-0715-4ab8-b414-fea88c1d9996 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: f98544c7-34bc-4d9d-a2f0-105e84864ee5] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:39:07.298825 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:39:07.305355 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7f037a89-0715-4ab8-b414-fea88c1d9996 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:07.305851 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7f037a89-0715-4ab8-b414-fea88c1d9996 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:07.306296 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7f037a89-0715-4ab8-b414-fea88c1d9996 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:07.307070 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7f037a89-0715-4ab8-b414-fea88c1d9996 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:07.307530 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7f037a89-0715-4ab8-b414-fea88c1d9996 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:07.307966 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7f037a89-0715-4ab8-b414-fea88c1d9996 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:07.371409 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-7f037a89-0715-4ab8-b414-fea88c1d9996 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b2b2b461354b8aa87cb19b0fb4fd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a146d50c0a544fe49bb604199bb67f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:39:07.379768 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-7f037a89-0715-4ab8-b414-fea88c1d9996 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "GET /compute/v2.1/servers/f98544c7-34bc-4d9d-a2f0-105e84864ee5" status: 200 len: 1369 microversion: 2.1 time: 0.088607 Oct 04 21:39:07.380337 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3425/6815] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:39:07 2022] GET /compute/v2.1/servers/f98544c7-34bc-4d9d-a2f0-105e84864ee5 => generated 1369 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:39:08.403764 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2781c567-4d50-47b3-9c32-e3568c74d388 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:39:08.404577 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-2781c567-4d50-47b3-9c32-e3568c74d388 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: f98544c7-34bc-4d9d-a2f0-105e84864ee5] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:39:08.407757 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:39:08.415104 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2781c567-4d50-47b3-9c32-e3568c74d388 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:08.415605 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2781c567-4d50-47b3-9c32-e3568c74d388 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:08.416048 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2781c567-4d50-47b3-9c32-e3568c74d388 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:08.416773 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2781c567-4d50-47b3-9c32-e3568c74d388 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:08.417229 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2781c567-4d50-47b3-9c32-e3568c74d388 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:08.417657 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2781c567-4d50-47b3-9c32-e3568c74d388 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:08.453378 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2781c567-4d50-47b3-9c32-e3568c74d388 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:08.453867 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2781c567-4d50-47b3-9c32-e3568c74d388 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:08.454301 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2781c567-4d50-47b3-9c32-e3568c74d388 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:08.454781 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-2781c567-4d50-47b3-9c32-e3568c74d388 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lazy-loading 'fault' on Instance uuid f98544c7-34bc-4d9d-a2f0-105e84864ee5 {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:39:08.500980 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-2781c567-4d50-47b3-9c32-e3568c74d388 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2b2b2b461354b8aa87cb19b0fb4fd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a146d50c0a544fe49bb604199bb67f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:39:08.510271 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-2781c567-4d50-47b3-9c32-e3568c74d388 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "GET /compute/v2.1/servers/f98544c7-34bc-4d9d-a2f0-105e84864ee5" status: 200 len: 1374 microversion: 2.1 time: 0.110490 Oct 04 21:39:08.510911 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3391/6816] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:39:08 2022] GET /compute/v2.1/servers/f98544c7-34bc-4d9d-a2f0-105e84864ee5 => generated 1374 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:39:09.535049 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-4a8b16b9-d712-49ee-92fd-c990e0867476 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:39:09.535664 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-4a8b16b9-d712-49ee-92fd-c990e0867476 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: f98544c7-34bc-4d9d-a2f0-105e84864ee5] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:39:09.542473 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4a8b16b9-d712-49ee-92fd-c990e0867476 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:09.542971 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4a8b16b9-d712-49ee-92fd-c990e0867476 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:09.543411 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4a8b16b9-d712-49ee-92fd-c990e0867476 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:09.544108 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4a8b16b9-d712-49ee-92fd-c990e0867476 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:09.544571 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4a8b16b9-d712-49ee-92fd-c990e0867476 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:09.545003 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4a8b16b9-d712-49ee-92fd-c990e0867476 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:09.559145 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.wsgi [None req-4a8b16b9-d712-49ee-92fd-c990e0867476 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] HTTP exception thrown: Instance f98544c7-34bc-4d9d-a2f0-105e84864ee5 could not be found. Oct 04 21:39:09.560788 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-4a8b16b9-d712-49ee-92fd-c990e0867476 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Request method failure captured: Oct 04 21:39:09.560788 n-d-854823-8 devstack@n-api.service[128802]: request: GET /compute/v2.1/servers/f98544c7-34bc-4d9d-a2f0-105e84864ee5 HTTP/1.1 Oct 04 21:39:09.560788 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 21:39:09.560788 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 21:39:09.560788 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 21:39:09.560788 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 0 Oct 04 21:39:09.560788 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 21:39:09.560788 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 21:39:09.560788 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 21:39:09.560788 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 21:39:09.560788 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPKacG3zmlzrE0P03sqhhW8OxTX_N5d4FutccVYa--DxtxvF117E3y03wDG1eWqGIT6xlYZQeTInymX9iqEa1Cn-51caF2pJGBCFnPr7M2Ci1V2diBL1LhxAMFh-0O2THqSMgkeX7lBKNpS2ImrBtoud6Asim3w37JGPDnCp2IjwWzIw Oct 04 21:39:09.560788 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 21:39:09.560788 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 21:39:09.560788 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 21:39:09.560788 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 21:39:09.560788 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 21:39:09.560788 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 21:39:09.560788 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: a146d50c0a544fe49bb604199bb67f02 Oct 04 21:39:09.560788 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-ServerActionsTestJSON-1365673639 Oct 04 21:39:09.560788 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 21:39:09.560788 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 21:39:09.560788 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a146d50c0a544fe49bb604199bb67f02", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a146d50c0a544fe49bb604199bb67f02"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a146d50c0a544fe49bb604199bb67f02"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a146d50c0a544fe49bb604199bb67f02"}]}] Oct 04 21:39:09.560788 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-ServerActionsTestJSON-1365673639 Oct 04 21:39:09.560788 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: a146d50c0a544fe49bb604199bb67f02 Oct 04 21:39:09.560788 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-ServerActionsTestJSON-1365673639 Oct 04 21:39:09.560788 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-ServerActionsTestJSON-1365673639-project Oct 04 21:39:09.560788 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 21:39:09.560788 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 21:39:09.560788 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: a2b2b2b461354b8aa87cb19b0fb4fd28 Oct 04 21:39:09.560788 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-ServerActionsTestJSON-1365673639-project Oct 04 21:39:09.560788 n-d-854823-8 devstack@n-api.service[128802]: method: > Oct 04 21:39:09.560788 n-d-854823-8 devstack@n-api.service[128802]: exception: Instance f98544c7-34bc-4d9d-a2f0-105e84864ee5 could not be found. Oct 04 21:39:09.560788 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'id': 'f98544c7-34bc-4d9d-a2f0-105e84864ee5'} Oct 04 21:39:09.560788 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:39:09.560788 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:39:09.560788 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:39:09.560788 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:39:09.560788 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:39:09.560788 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:39:09.560788 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:39:09.560788 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:39:09.560788 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:39:09.560788 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:39:09.560788 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f98544c7-34bc-4d9d-a2f0-105e84864ee5 could not be found. Oct 04 21:39:09.560788 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:39:09.560788 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:39:09.560788 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:39:09.560788 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:39:09.560788 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:39:09.560788 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:39:09.560788 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:39:09.560788 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:39:09.560788 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:39:09.560788 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:39:09.560788 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:39:09.560788 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:39:09.560788 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:39:09.560788 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:39:09.560788 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:39:09.560788 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:39:09.560788 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f98544c7-34bc-4d9d-a2f0-105e84864ee5 could not be found. Oct 04 21:39:09.560788 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:39:09.560788 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:39:09.560788 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:39:09.565325 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:39:09.565325 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:39:09.565325 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:39:09.565325 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:39:09.565325 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:39:09.565325 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f98544c7-34bc-4d9d-a2f0-105e84864ee5 could not be found. Oct 04 21:39:09.565325 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:39:09.565325 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-4a8b16b9-d712-49ee-92fd-c990e0867476 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Returning 404 to user: Instance f98544c7-34bc-4d9d-a2f0-105e84864ee5 could not be found. {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:39:09.565325 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-4a8b16b9-d712-49ee-92fd-c990e0867476 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "GET /compute/v2.1/servers/f98544c7-34bc-4d9d-a2f0-105e84864ee5" status: 404 len: 111 microversion: 2.1 time: 0.031030 Oct 04 21:39:09.565325 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3426/6817] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:39:09 2022] GET /compute/v2.1/servers/f98544c7-34bc-4d9d-a2f0-105e84864ee5 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:39:09.626086 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-97447011-2135-4b4b-a127-a457849f8c77 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:39:09.628320 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-97447011-2135-4b4b-a127-a457849f8c77 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: f98544c7-34bc-4d9d-a2f0-105e84864ee5] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:39:09.636231 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-97447011-2135-4b4b-a127-a457849f8c77 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:09.636722 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-97447011-2135-4b4b-a127-a457849f8c77 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:09.637160 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-97447011-2135-4b4b-a127-a457849f8c77 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:09.637859 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-97447011-2135-4b4b-a127-a457849f8c77 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:09.638318 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-97447011-2135-4b4b-a127-a457849f8c77 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:09.638781 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-97447011-2135-4b4b-a127-a457849f8c77 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:09.652066 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-97447011-2135-4b4b-a127-a457849f8c77 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] HTTP exception thrown: Instance f98544c7-34bc-4d9d-a2f0-105e84864ee5 could not be found. Oct 04 21:39:09.653755 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-97447011-2135-4b4b-a127-a457849f8c77 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Request method failure captured: Oct 04 21:39:09.653755 n-d-854823-8 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/f98544c7-34bc-4d9d-a2f0-105e84864ee5/os-volume_attachments HTTP/1.1 Oct 04 21:39:09.653755 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 21:39:09.653755 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 21:39:09.653755 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 21:39:09.653755 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 0 Oct 04 21:39:09.653755 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 21:39:09.653755 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 21:39:09.653755 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 21:39:09.653755 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 21:39:09.653755 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPKacG3zmlzrE0P03sqhhW8OxTX_N5d4FutccVYa--DxtxvF117E3y03wDG1eWqGIT6xlYZQeTInymX9iqEa1Cn-51caF2pJGBCFnPr7M2Ci1V2diBL1LhxAMFh-0O2THqSMgkeX7lBKNpS2ImrBtoud6Asim3w37JGPDnCp2IjwWzIw Oct 04 21:39:09.653755 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 21:39:09.653755 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 21:39:09.653755 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 21:39:09.653755 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 21:39:09.653755 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 21:39:09.653755 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 21:39:09.653755 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: a146d50c0a544fe49bb604199bb67f02 Oct 04 21:39:09.653755 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-ServerActionsTestJSON-1365673639 Oct 04 21:39:09.653755 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 21:39:09.653755 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 21:39:09.653755 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a146d50c0a544fe49bb604199bb67f02", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a146d50c0a544fe49bb604199bb67f02"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a146d50c0a544fe49bb604199bb67f02"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a146d50c0a544fe49bb604199bb67f02"}]}] Oct 04 21:39:09.653755 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-ServerActionsTestJSON-1365673639 Oct 04 21:39:09.653755 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: a146d50c0a544fe49bb604199bb67f02 Oct 04 21:39:09.653755 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ServerActionsTestJSON-1365673639 Oct 04 21:39:09.653755 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-ServerActionsTestJSON-1365673639-project Oct 04 21:39:09.653755 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 21:39:09.653755 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 21:39:09.653755 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: a2b2b2b461354b8aa87cb19b0fb4fd28 Oct 04 21:39:09.653755 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-ServerActionsTestJSON-1365673639-project Oct 04 21:39:09.653755 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 21:39:09.653755 n-d-854823-8 devstack@n-api.service[128801]: exception: Instance f98544c7-34bc-4d9d-a2f0-105e84864ee5 could not be found. Oct 04 21:39:09.653755 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'server_id': 'f98544c7-34bc-4d9d-a2f0-105e84864ee5'} Oct 04 21:39:09.653755 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:39:09.653755 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:39:09.653755 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:39:09.653755 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:39:09.653755 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:39:09.653755 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:39:09.653755 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:39:09.653755 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:39:09.653755 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:39:09.653755 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:39:09.653755 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f98544c7-34bc-4d9d-a2f0-105e84864ee5 could not be found. Oct 04 21:39:09.653755 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:39:09.653755 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:39:09.653755 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:39:09.653755 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:39:09.653755 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:39:09.653755 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:39:09.653755 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:39:09.653755 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:39:09.653755 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:39:09.653755 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:39:09.653755 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 21:39:09.653755 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:39:09.653755 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 21:39:09.653755 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:39:09.653755 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Oct 04 21:39:09.653755 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Oct 04 21:39:09.653755 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:39:09.653755 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:39:09.657734 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f98544c7-34bc-4d9d-a2f0-105e84864ee5 could not be found. Oct 04 21:39:09.657734 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:39:09.657734 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:39:09.657734 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:39:09.657734 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:39:09.657734 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:39:09.657734 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:39:09.657734 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:39:09.657734 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:39:09.657734 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f98544c7-34bc-4d9d-a2f0-105e84864ee5 could not be found. Oct 04 21:39:09.657734 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:39:09.657734 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-97447011-2135-4b4b-a127-a457849f8c77 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Returning 404 to user: Instance f98544c7-34bc-4d9d-a2f0-105e84864ee5 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:39:09.657734 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-97447011-2135-4b4b-a127-a457849f8c77 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "GET /compute/v2.1/servers/f98544c7-34bc-4d9d-a2f0-105e84864ee5/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.033269 Oct 04 21:39:09.657734 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3392/6818] 10.222.0.33 () {58 vars in 1302 bytes} [Tue Oct 4 21:39:09 2022] GET /compute/v2.1/servers/f98544c7-34bc-4d9d-a2f0-105e84864ee5/os-volume_attachments => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:39:12.984199 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-6e18a109-dc84-4cfa-8027-9641fa560062 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:39:12.984738 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-6e18a109-dc84-4cfa-8027-9641fa560062 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: f98544c7-34bc-4d9d-a2f0-105e84864ee5] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:39:12.992253 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6e18a109-dc84-4cfa-8027-9641fa560062 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:12.992757 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6e18a109-dc84-4cfa-8027-9641fa560062 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:12.993211 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6e18a109-dc84-4cfa-8027-9641fa560062 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:12.993938 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6e18a109-dc84-4cfa-8027-9641fa560062 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:12.994435 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6e18a109-dc84-4cfa-8027-9641fa560062 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:12.994887 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6e18a109-dc84-4cfa-8027-9641fa560062 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:13.011142 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.wsgi [None req-6e18a109-dc84-4cfa-8027-9641fa560062 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] HTTP exception thrown: Instance f98544c7-34bc-4d9d-a2f0-105e84864ee5 could not be found. Oct 04 21:39:13.012801 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-6e18a109-dc84-4cfa-8027-9641fa560062 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Request method failure captured: Oct 04 21:39:13.012801 n-d-854823-8 devstack@n-api.service[128802]: request: DELETE /compute/v2.1/servers/f98544c7-34bc-4d9d-a2f0-105e84864ee5 HTTP/1.1 Oct 04 21:39:13.012801 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 21:39:13.012801 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 21:39:13.012801 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 21:39:13.012801 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 0 Oct 04 21:39:13.012801 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 21:39:13.012801 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 21:39:13.012801 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 21:39:13.012801 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 21:39:13.012801 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPKacG3zmlzrE0P03sqhhW8OxTX_N5d4FutccVYa--DxtxvF117E3y03wDG1eWqGIT6xlYZQeTInymX9iqEa1Cn-51caF2pJGBCFnPr7M2Ci1V2diBL1LhxAMFh-0O2THqSMgkeX7lBKNpS2ImrBtoud6Asim3w37JGPDnCp2IjwWzIw Oct 04 21:39:13.012801 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 21:39:13.012801 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 21:39:13.012801 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 21:39:13.012801 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 21:39:13.012801 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 21:39:13.012801 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 21:39:13.012801 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: a146d50c0a544fe49bb604199bb67f02 Oct 04 21:39:13.012801 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-ServerActionsTestJSON-1365673639 Oct 04 21:39:13.012801 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 21:39:13.012801 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 21:39:13.012801 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a146d50c0a544fe49bb604199bb67f02", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a146d50c0a544fe49bb604199bb67f02"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a146d50c0a544fe49bb604199bb67f02"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a146d50c0a544fe49bb604199bb67f02"}]}] Oct 04 21:39:13.012801 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-ServerActionsTestJSON-1365673639 Oct 04 21:39:13.012801 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: a146d50c0a544fe49bb604199bb67f02 Oct 04 21:39:13.012801 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-ServerActionsTestJSON-1365673639 Oct 04 21:39:13.012801 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-ServerActionsTestJSON-1365673639-project Oct 04 21:39:13.012801 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 21:39:13.012801 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 21:39:13.012801 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: a2b2b2b461354b8aa87cb19b0fb4fd28 Oct 04 21:39:13.012801 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-ServerActionsTestJSON-1365673639-project Oct 04 21:39:13.012801 n-d-854823-8 devstack@n-api.service[128802]: method: > Oct 04 21:39:13.012801 n-d-854823-8 devstack@n-api.service[128802]: exception: Instance f98544c7-34bc-4d9d-a2f0-105e84864ee5 could not be found. Oct 04 21:39:13.012801 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'id': 'f98544c7-34bc-4d9d-a2f0-105e84864ee5'} Oct 04 21:39:13.012801 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:39:13.012801 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:39:13.012801 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:39:13.012801 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:39:13.012801 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:39:13.012801 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:39:13.012801 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:39:13.012801 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:39:13.012801 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:39:13.012801 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:39:13.012801 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f98544c7-34bc-4d9d-a2f0-105e84864ee5 could not be found. Oct 04 21:39:13.012801 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:39:13.012801 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:39:13.012801 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:39:13.012801 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:39:13.012801 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:39:13.012801 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:39:13.012801 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:39:13.012801 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:39:13.012801 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:39:13.012801 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:39:13.012801 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 21:39:13.012801 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 21:39:13.012801 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 21:39:13.012801 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 21:39:13.012801 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:39:13.012801 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:39:13.012801 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:39:13.012801 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:39:13.016183 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f98544c7-34bc-4d9d-a2f0-105e84864ee5 could not be found. Oct 04 21:39:13.016183 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:39:13.016183 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:39:13.016183 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:39:13.016183 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:39:13.016183 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:39:13.016183 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:39:13.016183 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:39:13.016183 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:39:13.016183 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f98544c7-34bc-4d9d-a2f0-105e84864ee5 could not be found. Oct 04 21:39:13.016183 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:39:13.016183 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-6e18a109-dc84-4cfa-8027-9641fa560062 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Returning 404 to user: Instance f98544c7-34bc-4d9d-a2f0-105e84864ee5 could not be found. {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:39:13.016183 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-6e18a109-dc84-4cfa-8027-9641fa560062 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "DELETE /compute/v2.1/servers/f98544c7-34bc-4d9d-a2f0-105e84864ee5" status: 404 len: 111 microversion: 2.1 time: 0.034063 Oct 04 21:39:13.016183 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3427/6819] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 21:39:12 2022] DELETE /compute/v2.1/servers/f98544c7-34bc-4d9d-a2f0-105e84864ee5 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:39:13.023530 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-4e6d9ac3-2c16-4559-a0d9-627c06bccbf8 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:39:13.024170 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-4e6d9ac3-2c16-4559-a0d9-627c06bccbf8 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: f98544c7-34bc-4d9d-a2f0-105e84864ee5] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:39:13.031432 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4e6d9ac3-2c16-4559-a0d9-627c06bccbf8 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:13.031930 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4e6d9ac3-2c16-4559-a0d9-627c06bccbf8 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:13.032373 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4e6d9ac3-2c16-4559-a0d9-627c06bccbf8 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:13.033087 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4e6d9ac3-2c16-4559-a0d9-627c06bccbf8 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:13.033546 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4e6d9ac3-2c16-4559-a0d9-627c06bccbf8 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:13.033971 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4e6d9ac3-2c16-4559-a0d9-627c06bccbf8 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:13.049029 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-4e6d9ac3-2c16-4559-a0d9-627c06bccbf8 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] HTTP exception thrown: Instance f98544c7-34bc-4d9d-a2f0-105e84864ee5 could not be found. Oct 04 21:39:13.050640 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-4e6d9ac3-2c16-4559-a0d9-627c06bccbf8 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Request method failure captured: Oct 04 21:39:13.050640 n-d-854823-8 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/f98544c7-34bc-4d9d-a2f0-105e84864ee5 HTTP/1.1 Oct 04 21:39:13.050640 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 21:39:13.050640 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 21:39:13.050640 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 21:39:13.050640 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 0 Oct 04 21:39:13.050640 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 21:39:13.050640 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 21:39:13.050640 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 21:39:13.050640 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 21:39:13.050640 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPKacG3zmlzrE0P03sqhhW8OxTX_N5d4FutccVYa--DxtxvF117E3y03wDG1eWqGIT6xlYZQeTInymX9iqEa1Cn-51caF2pJGBCFnPr7M2Ci1V2diBL1LhxAMFh-0O2THqSMgkeX7lBKNpS2ImrBtoud6Asim3w37JGPDnCp2IjwWzIw Oct 04 21:39:13.050640 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 21:39:13.050640 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 21:39:13.050640 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 21:39:13.050640 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 21:39:13.050640 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 21:39:13.050640 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 21:39:13.050640 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: a146d50c0a544fe49bb604199bb67f02 Oct 04 21:39:13.050640 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-ServerActionsTestJSON-1365673639 Oct 04 21:39:13.050640 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 21:39:13.050640 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 21:39:13.050640 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a146d50c0a544fe49bb604199bb67f02", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a146d50c0a544fe49bb604199bb67f02"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a146d50c0a544fe49bb604199bb67f02"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a146d50c0a544fe49bb604199bb67f02"}]}] Oct 04 21:39:13.050640 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-ServerActionsTestJSON-1365673639 Oct 04 21:39:13.050640 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: a146d50c0a544fe49bb604199bb67f02 Oct 04 21:39:13.050640 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ServerActionsTestJSON-1365673639 Oct 04 21:39:13.050640 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-ServerActionsTestJSON-1365673639-project Oct 04 21:39:13.050640 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 21:39:13.050640 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 21:39:13.050640 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: a2b2b2b461354b8aa87cb19b0fb4fd28 Oct 04 21:39:13.050640 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-ServerActionsTestJSON-1365673639-project Oct 04 21:39:13.050640 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 21:39:13.050640 n-d-854823-8 devstack@n-api.service[128801]: exception: Instance f98544c7-34bc-4d9d-a2f0-105e84864ee5 could not be found. Oct 04 21:39:13.050640 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': 'f98544c7-34bc-4d9d-a2f0-105e84864ee5'} Oct 04 21:39:13.050640 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:39:13.050640 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:39:13.050640 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:39:13.050640 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:39:13.050640 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:39:13.050640 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:39:13.050640 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:39:13.050640 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:39:13.050640 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:39:13.050640 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:39:13.050640 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f98544c7-34bc-4d9d-a2f0-105e84864ee5 could not be found. Oct 04 21:39:13.050640 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:39:13.050640 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:39:13.050640 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:39:13.050640 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:39:13.050640 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:39:13.050640 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:39:13.050640 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:39:13.050640 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:39:13.050640 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:39:13.050640 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:39:13.050640 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:39:13.050640 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:39:13.050640 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:39:13.050640 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:39:13.050640 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:39:13.050640 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:39:13.050640 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f98544c7-34bc-4d9d-a2f0-105e84864ee5 could not be found. Oct 04 21:39:13.050640 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:39:13.050640 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:39:13.050640 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:39:13.055173 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:39:13.055173 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:39:13.055173 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:39:13.055173 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:39:13.055173 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:39:13.055173 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f98544c7-34bc-4d9d-a2f0-105e84864ee5 could not be found. Oct 04 21:39:13.055173 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:39:13.055173 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-4e6d9ac3-2c16-4559-a0d9-627c06bccbf8 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Returning 404 to user: Instance f98544c7-34bc-4d9d-a2f0-105e84864ee5 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:39:13.055173 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-4e6d9ac3-2c16-4559-a0d9-627c06bccbf8 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "GET /compute/v2.1/servers/f98544c7-34bc-4d9d-a2f0-105e84864ee5" status: 404 len: 111 microversion: 2.1 time: 0.033331 Oct 04 21:39:13.055173 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3393/6820] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:39:13 2022] GET /compute/v2.1/servers/f98544c7-34bc-4d9d-a2f0-105e84864ee5 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:39:13.061069 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-fa40f724-febf-4b7f-8d02-8f55184e9f40 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:39:13.061491 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-fa40f724-febf-4b7f-8d02-8f55184e9f40 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: c11732ff-0b88-4136-8e45-3f8d52ff4a9f] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:39:13.067689 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fa40f724-febf-4b7f-8d02-8f55184e9f40 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:13.068184 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fa40f724-febf-4b7f-8d02-8f55184e9f40 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:13.068627 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fa40f724-febf-4b7f-8d02-8f55184e9f40 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:13.069901 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fa40f724-febf-4b7f-8d02-8f55184e9f40 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:13.070742 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fa40f724-febf-4b7f-8d02-8f55184e9f40 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:13.071195 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fa40f724-febf-4b7f-8d02-8f55184e9f40 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:13.089000 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.wsgi [None req-fa40f724-febf-4b7f-8d02-8f55184e9f40 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] HTTP exception thrown: Instance c11732ff-0b88-4136-8e45-3f8d52ff4a9f could not be found. Oct 04 21:39:13.090656 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-fa40f724-febf-4b7f-8d02-8f55184e9f40 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Request method failure captured: Oct 04 21:39:13.090656 n-d-854823-8 devstack@n-api.service[128802]: request: DELETE /compute/v2.1/servers/c11732ff-0b88-4136-8e45-3f8d52ff4a9f HTTP/1.1 Oct 04 21:39:13.090656 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 21:39:13.090656 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 21:39:13.090656 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 21:39:13.090656 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 0 Oct 04 21:39:13.090656 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 21:39:13.090656 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 21:39:13.090656 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 21:39:13.090656 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 21:39:13.090656 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPKacG3zmlzrE0P03sqhhW8OxTX_N5d4FutccVYa--DxtxvF117E3y03wDG1eWqGIT6xlYZQeTInymX9iqEa1Cn-51caF2pJGBCFnPr7M2Ci1V2diBL1LhxAMFh-0O2THqSMgkeX7lBKNpS2ImrBtoud6Asim3w37JGPDnCp2IjwWzIw Oct 04 21:39:13.090656 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 21:39:13.090656 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 21:39:13.090656 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 21:39:13.090656 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 21:39:13.090656 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 21:39:13.090656 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 21:39:13.090656 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: a146d50c0a544fe49bb604199bb67f02 Oct 04 21:39:13.090656 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-ServerActionsTestJSON-1365673639 Oct 04 21:39:13.090656 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 21:39:13.090656 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 21:39:13.090656 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a146d50c0a544fe49bb604199bb67f02", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a146d50c0a544fe49bb604199bb67f02"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a146d50c0a544fe49bb604199bb67f02"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a146d50c0a544fe49bb604199bb67f02"}]}] Oct 04 21:39:13.090656 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-ServerActionsTestJSON-1365673639 Oct 04 21:39:13.090656 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: a146d50c0a544fe49bb604199bb67f02 Oct 04 21:39:13.090656 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-ServerActionsTestJSON-1365673639 Oct 04 21:39:13.090656 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-ServerActionsTestJSON-1365673639-project Oct 04 21:39:13.090656 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 21:39:13.090656 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 21:39:13.090656 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: a2b2b2b461354b8aa87cb19b0fb4fd28 Oct 04 21:39:13.090656 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-ServerActionsTestJSON-1365673639-project Oct 04 21:39:13.090656 n-d-854823-8 devstack@n-api.service[128802]: method: > Oct 04 21:39:13.090656 n-d-854823-8 devstack@n-api.service[128802]: exception: Instance c11732ff-0b88-4136-8e45-3f8d52ff4a9f could not be found. Oct 04 21:39:13.090656 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'id': 'c11732ff-0b88-4136-8e45-3f8d52ff4a9f'} Oct 04 21:39:13.090656 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:39:13.090656 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:39:13.090656 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:39:13.090656 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:39:13.090656 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:39:13.090656 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:39:13.090656 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:39:13.090656 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:39:13.090656 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:39:13.090656 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:39:13.090656 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c11732ff-0b88-4136-8e45-3f8d52ff4a9f could not be found. Oct 04 21:39:13.090656 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:39:13.090656 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:39:13.090656 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:39:13.090656 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:39:13.090656 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:39:13.090656 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:39:13.090656 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:39:13.090656 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:39:13.090656 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:39:13.090656 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:39:13.090656 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 21:39:13.090656 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 21:39:13.090656 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 21:39:13.090656 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 21:39:13.090656 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:39:13.090656 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:39:13.090656 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:39:13.090656 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:39:13.094680 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c11732ff-0b88-4136-8e45-3f8d52ff4a9f could not be found. Oct 04 21:39:13.094680 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:39:13.094680 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:39:13.094680 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:39:13.094680 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:39:13.094680 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:39:13.094680 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:39:13.094680 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:39:13.094680 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:39:13.094680 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c11732ff-0b88-4136-8e45-3f8d52ff4a9f could not be found. Oct 04 21:39:13.094680 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:39:13.094680 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-fa40f724-febf-4b7f-8d02-8f55184e9f40 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Returning 404 to user: Instance c11732ff-0b88-4136-8e45-3f8d52ff4a9f could not be found. {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:39:13.094680 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-fa40f724-febf-4b7f-8d02-8f55184e9f40 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "DELETE /compute/v2.1/servers/c11732ff-0b88-4136-8e45-3f8d52ff4a9f" status: 404 len: 111 microversion: 2.1 time: 0.035026 Oct 04 21:39:13.094680 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3428/6821] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 21:39:13 2022] DELETE /compute/v2.1/servers/c11732ff-0b88-4136-8e45-3f8d52ff4a9f => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:39:13.100680 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e9ceab31-429d-474f-aaa9-51595899b1d2 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:39:13.101277 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e9ceab31-429d-474f-aaa9-51595899b1d2 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: c11732ff-0b88-4136-8e45-3f8d52ff4a9f] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:39:13.107341 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e9ceab31-429d-474f-aaa9-51595899b1d2 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:13.107825 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e9ceab31-429d-474f-aaa9-51595899b1d2 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:13.108260 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e9ceab31-429d-474f-aaa9-51595899b1d2 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:13.108952 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e9ceab31-429d-474f-aaa9-51595899b1d2 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:13.109408 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e9ceab31-429d-474f-aaa9-51595899b1d2 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:13.109831 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e9ceab31-429d-474f-aaa9-51595899b1d2 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:13.124371 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-e9ceab31-429d-474f-aaa9-51595899b1d2 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] HTTP exception thrown: Instance c11732ff-0b88-4136-8e45-3f8d52ff4a9f could not be found. Oct 04 21:39:13.125931 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e9ceab31-429d-474f-aaa9-51595899b1d2 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Request method failure captured: Oct 04 21:39:13.125931 n-d-854823-8 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/c11732ff-0b88-4136-8e45-3f8d52ff4a9f HTTP/1.1 Oct 04 21:39:13.125931 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 21:39:13.125931 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 21:39:13.125931 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 21:39:13.125931 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 0 Oct 04 21:39:13.125931 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 21:39:13.125931 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 21:39:13.125931 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 21:39:13.125931 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 21:39:13.125931 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPKacG3zmlzrE0P03sqhhW8OxTX_N5d4FutccVYa--DxtxvF117E3y03wDG1eWqGIT6xlYZQeTInymX9iqEa1Cn-51caF2pJGBCFnPr7M2Ci1V2diBL1LhxAMFh-0O2THqSMgkeX7lBKNpS2ImrBtoud6Asim3w37JGPDnCp2IjwWzIw Oct 04 21:39:13.125931 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 21:39:13.125931 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 21:39:13.125931 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 21:39:13.125931 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 21:39:13.125931 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 21:39:13.125931 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 21:39:13.125931 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: a146d50c0a544fe49bb604199bb67f02 Oct 04 21:39:13.125931 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-ServerActionsTestJSON-1365673639 Oct 04 21:39:13.125931 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 21:39:13.125931 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 21:39:13.125931 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a146d50c0a544fe49bb604199bb67f02", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a146d50c0a544fe49bb604199bb67f02"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a146d50c0a544fe49bb604199bb67f02"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a146d50c0a544fe49bb604199bb67f02"}]}] Oct 04 21:39:13.125931 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-ServerActionsTestJSON-1365673639 Oct 04 21:39:13.125931 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: a146d50c0a544fe49bb604199bb67f02 Oct 04 21:39:13.125931 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ServerActionsTestJSON-1365673639 Oct 04 21:39:13.125931 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-ServerActionsTestJSON-1365673639-project Oct 04 21:39:13.125931 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 21:39:13.125931 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 21:39:13.125931 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: a2b2b2b461354b8aa87cb19b0fb4fd28 Oct 04 21:39:13.125931 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-ServerActionsTestJSON-1365673639-project Oct 04 21:39:13.125931 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 21:39:13.125931 n-d-854823-8 devstack@n-api.service[128801]: exception: Instance c11732ff-0b88-4136-8e45-3f8d52ff4a9f could not be found. Oct 04 21:39:13.125931 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': 'c11732ff-0b88-4136-8e45-3f8d52ff4a9f'} Oct 04 21:39:13.125931 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:39:13.125931 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:39:13.125931 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:39:13.125931 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:39:13.125931 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:39:13.125931 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:39:13.125931 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:39:13.125931 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:39:13.125931 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:39:13.125931 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:39:13.125931 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c11732ff-0b88-4136-8e45-3f8d52ff4a9f could not be found. Oct 04 21:39:13.125931 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:39:13.125931 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:39:13.125931 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:39:13.125931 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:39:13.125931 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:39:13.125931 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:39:13.125931 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:39:13.125931 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:39:13.125931 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:39:13.125931 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:39:13.125931 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:39:13.125931 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:39:13.125931 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:39:13.125931 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:39:13.125931 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:39:13.125931 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:39:13.125931 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c11732ff-0b88-4136-8e45-3f8d52ff4a9f could not be found. Oct 04 21:39:13.125931 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:39:13.125931 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:39:13.125931 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:39:13.130201 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:39:13.130201 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:39:13.130201 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:39:13.130201 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:39:13.130201 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:39:13.130201 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c11732ff-0b88-4136-8e45-3f8d52ff4a9f could not be found. Oct 04 21:39:13.130201 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:39:13.130201 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e9ceab31-429d-474f-aaa9-51595899b1d2 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Returning 404 to user: Instance c11732ff-0b88-4136-8e45-3f8d52ff4a9f could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:39:13.130201 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e9ceab31-429d-474f-aaa9-51595899b1d2 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "GET /compute/v2.1/servers/c11732ff-0b88-4136-8e45-3f8d52ff4a9f" status: 404 len: 111 microversion: 2.1 time: 0.030622 Oct 04 21:39:13.130201 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3394/6822] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:39:13 2022] GET /compute/v2.1/servers/c11732ff-0b88-4136-8e45-3f8d52ff4a9f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 21:39:13.136728 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-373cb9d5-2381-4179-846b-85b7f82051a4 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:39:13.137236 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-373cb9d5-2381-4179-846b-85b7f82051a4 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: 614f1ce2-fde0-40a8-b311-934ab2d51862] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:39:13.143269 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-373cb9d5-2381-4179-846b-85b7f82051a4 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:13.143766 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-373cb9d5-2381-4179-846b-85b7f82051a4 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:13.144212 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-373cb9d5-2381-4179-846b-85b7f82051a4 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:13.144925 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-373cb9d5-2381-4179-846b-85b7f82051a4 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:13.145391 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-373cb9d5-2381-4179-846b-85b7f82051a4 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:13.145833 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-373cb9d5-2381-4179-846b-85b7f82051a4 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:13.160369 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.wsgi [None req-373cb9d5-2381-4179-846b-85b7f82051a4 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] HTTP exception thrown: Instance 614f1ce2-fde0-40a8-b311-934ab2d51862 could not be found. Oct 04 21:39:13.161960 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-373cb9d5-2381-4179-846b-85b7f82051a4 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Request method failure captured: Oct 04 21:39:13.161960 n-d-854823-8 devstack@n-api.service[128802]: request: DELETE /compute/v2.1/servers/614f1ce2-fde0-40a8-b311-934ab2d51862 HTTP/1.1 Oct 04 21:39:13.161960 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 21:39:13.161960 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 21:39:13.161960 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 21:39:13.161960 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 0 Oct 04 21:39:13.161960 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 21:39:13.161960 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 21:39:13.161960 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 21:39:13.161960 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 21:39:13.161960 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPKacG3zmlzrE0P03sqhhW8OxTX_N5d4FutccVYa--DxtxvF117E3y03wDG1eWqGIT6xlYZQeTInymX9iqEa1Cn-51caF2pJGBCFnPr7M2Ci1V2diBL1LhxAMFh-0O2THqSMgkeX7lBKNpS2ImrBtoud6Asim3w37JGPDnCp2IjwWzIw Oct 04 21:39:13.161960 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 21:39:13.161960 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 21:39:13.161960 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 21:39:13.161960 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 21:39:13.161960 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 21:39:13.161960 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 21:39:13.161960 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: a146d50c0a544fe49bb604199bb67f02 Oct 04 21:39:13.161960 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-ServerActionsTestJSON-1365673639 Oct 04 21:39:13.161960 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 21:39:13.161960 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 21:39:13.161960 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a146d50c0a544fe49bb604199bb67f02", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a146d50c0a544fe49bb604199bb67f02"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a146d50c0a544fe49bb604199bb67f02"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a146d50c0a544fe49bb604199bb67f02"}]}] Oct 04 21:39:13.161960 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-ServerActionsTestJSON-1365673639 Oct 04 21:39:13.161960 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: a146d50c0a544fe49bb604199bb67f02 Oct 04 21:39:13.161960 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-ServerActionsTestJSON-1365673639 Oct 04 21:39:13.161960 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-ServerActionsTestJSON-1365673639-project Oct 04 21:39:13.161960 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 21:39:13.161960 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 21:39:13.161960 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: a2b2b2b461354b8aa87cb19b0fb4fd28 Oct 04 21:39:13.161960 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-ServerActionsTestJSON-1365673639-project Oct 04 21:39:13.161960 n-d-854823-8 devstack@n-api.service[128802]: method: > Oct 04 21:39:13.161960 n-d-854823-8 devstack@n-api.service[128802]: exception: Instance 614f1ce2-fde0-40a8-b311-934ab2d51862 could not be found. Oct 04 21:39:13.161960 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'id': '614f1ce2-fde0-40a8-b311-934ab2d51862'} Oct 04 21:39:13.161960 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:39:13.161960 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:39:13.161960 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:39:13.161960 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:39:13.161960 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:39:13.161960 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:39:13.161960 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:39:13.161960 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:39:13.161960 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:39:13.161960 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:39:13.161960 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 614f1ce2-fde0-40a8-b311-934ab2d51862 could not be found. Oct 04 21:39:13.161960 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:39:13.161960 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:39:13.161960 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:39:13.161960 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:39:13.161960 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:39:13.161960 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:39:13.161960 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:39:13.161960 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:39:13.161960 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:39:13.161960 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:39:13.161960 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 21:39:13.161960 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 21:39:13.161960 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 21:39:13.161960 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 21:39:13.161960 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:39:13.161960 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:39:13.161960 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:39:13.161960 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:39:13.167229 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 614f1ce2-fde0-40a8-b311-934ab2d51862 could not be found. Oct 04 21:39:13.167229 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:39:13.167229 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:39:13.167229 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:39:13.167229 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:39:13.167229 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:39:13.167229 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:39:13.167229 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:39:13.167229 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:39:13.167229 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 614f1ce2-fde0-40a8-b311-934ab2d51862 could not be found. Oct 04 21:39:13.167229 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:39:13.167229 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-373cb9d5-2381-4179-846b-85b7f82051a4 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Returning 404 to user: Instance 614f1ce2-fde0-40a8-b311-934ab2d51862 could not be found. {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:39:13.167229 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-373cb9d5-2381-4179-846b-85b7f82051a4 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "DELETE /compute/v2.1/servers/614f1ce2-fde0-40a8-b311-934ab2d51862" status: 404 len: 111 microversion: 2.1 time: 0.031972 Oct 04 21:39:13.167229 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3429/6823] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 21:39:13 2022] DELETE /compute/v2.1/servers/614f1ce2-fde0-40a8-b311-934ab2d51862 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:39:13.173355 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a7b8d1b3-ab13-4355-adc9-d71854d56cf1 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:39:13.173995 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a7b8d1b3-ab13-4355-adc9-d71854d56cf1 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: 614f1ce2-fde0-40a8-b311-934ab2d51862] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:39:13.182562 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a7b8d1b3-ab13-4355-adc9-d71854d56cf1 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:13.183046 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a7b8d1b3-ab13-4355-adc9-d71854d56cf1 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:13.183509 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a7b8d1b3-ab13-4355-adc9-d71854d56cf1 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:13.184216 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a7b8d1b3-ab13-4355-adc9-d71854d56cf1 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:13.184677 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a7b8d1b3-ab13-4355-adc9-d71854d56cf1 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:13.185113 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a7b8d1b3-ab13-4355-adc9-d71854d56cf1 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:13.202328 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-a7b8d1b3-ab13-4355-adc9-d71854d56cf1 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] HTTP exception thrown: Instance 614f1ce2-fde0-40a8-b311-934ab2d51862 could not be found. Oct 04 21:39:13.204011 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a7b8d1b3-ab13-4355-adc9-d71854d56cf1 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Request method failure captured: Oct 04 21:39:13.204011 n-d-854823-8 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/614f1ce2-fde0-40a8-b311-934ab2d51862 HTTP/1.1 Oct 04 21:39:13.204011 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 21:39:13.204011 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 21:39:13.204011 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 21:39:13.204011 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 0 Oct 04 21:39:13.204011 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 21:39:13.204011 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 21:39:13.204011 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 21:39:13.204011 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 21:39:13.204011 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPKacG3zmlzrE0P03sqhhW8OxTX_N5d4FutccVYa--DxtxvF117E3y03wDG1eWqGIT6xlYZQeTInymX9iqEa1Cn-51caF2pJGBCFnPr7M2Ci1V2diBL1LhxAMFh-0O2THqSMgkeX7lBKNpS2ImrBtoud6Asim3w37JGPDnCp2IjwWzIw Oct 04 21:39:13.204011 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 21:39:13.204011 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 21:39:13.204011 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 21:39:13.204011 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 21:39:13.204011 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 21:39:13.204011 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 21:39:13.204011 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: a146d50c0a544fe49bb604199bb67f02 Oct 04 21:39:13.204011 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-ServerActionsTestJSON-1365673639 Oct 04 21:39:13.204011 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 21:39:13.204011 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 21:39:13.204011 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a146d50c0a544fe49bb604199bb67f02", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a146d50c0a544fe49bb604199bb67f02"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a146d50c0a544fe49bb604199bb67f02"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a146d50c0a544fe49bb604199bb67f02"}]}] Oct 04 21:39:13.204011 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-ServerActionsTestJSON-1365673639 Oct 04 21:39:13.204011 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: a146d50c0a544fe49bb604199bb67f02 Oct 04 21:39:13.204011 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ServerActionsTestJSON-1365673639 Oct 04 21:39:13.204011 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-ServerActionsTestJSON-1365673639-project Oct 04 21:39:13.204011 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 21:39:13.204011 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 21:39:13.204011 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: a2b2b2b461354b8aa87cb19b0fb4fd28 Oct 04 21:39:13.204011 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-ServerActionsTestJSON-1365673639-project Oct 04 21:39:13.204011 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 21:39:13.204011 n-d-854823-8 devstack@n-api.service[128801]: exception: Instance 614f1ce2-fde0-40a8-b311-934ab2d51862 could not be found. Oct 04 21:39:13.204011 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': '614f1ce2-fde0-40a8-b311-934ab2d51862'} Oct 04 21:39:13.204011 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:39:13.204011 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:39:13.204011 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:39:13.204011 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:39:13.204011 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:39:13.204011 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:39:13.204011 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:39:13.204011 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:39:13.204011 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:39:13.204011 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:39:13.204011 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 614f1ce2-fde0-40a8-b311-934ab2d51862 could not be found. Oct 04 21:39:13.204011 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:39:13.204011 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:39:13.204011 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:39:13.204011 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:39:13.204011 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:39:13.204011 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:39:13.204011 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:39:13.204011 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:39:13.204011 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:39:13.204011 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:39:13.204011 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:39:13.204011 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:39:13.204011 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:39:13.204011 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:39:13.204011 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:39:13.204011 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:39:13.204011 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 614f1ce2-fde0-40a8-b311-934ab2d51862 could not be found. Oct 04 21:39:13.204011 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:39:13.204011 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:39:13.204011 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:39:13.208697 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:39:13.208697 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:39:13.208697 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:39:13.208697 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:39:13.208697 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:39:13.208697 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 614f1ce2-fde0-40a8-b311-934ab2d51862 could not be found. Oct 04 21:39:13.208697 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:39:13.208697 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a7b8d1b3-ab13-4355-adc9-d71854d56cf1 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Returning 404 to user: Instance 614f1ce2-fde0-40a8-b311-934ab2d51862 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:39:13.208697 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a7b8d1b3-ab13-4355-adc9-d71854d56cf1 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "GET /compute/v2.1/servers/614f1ce2-fde0-40a8-b311-934ab2d51862" status: 404 len: 111 microversion: 2.1 time: 0.036411 Oct 04 21:39:13.208697 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3395/6824] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:39:13 2022] GET /compute/v2.1/servers/614f1ce2-fde0-40a8-b311-934ab2d51862 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:39:13.214703 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-f256e961-92eb-4cab-935c-cb3bd5907e91 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:39:13.215234 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-f256e961-92eb-4cab-935c-cb3bd5907e91 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: e09f71fe-7c54-4c43-810e-e0d79f515431] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:39:13.221810 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f256e961-92eb-4cab-935c-cb3bd5907e91 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:13.222320 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f256e961-92eb-4cab-935c-cb3bd5907e91 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:13.222824 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f256e961-92eb-4cab-935c-cb3bd5907e91 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:13.223569 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f256e961-92eb-4cab-935c-cb3bd5907e91 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:13.224020 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f256e961-92eb-4cab-935c-cb3bd5907e91 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:13.224456 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f256e961-92eb-4cab-935c-cb3bd5907e91 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:13.240545 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.wsgi [None req-f256e961-92eb-4cab-935c-cb3bd5907e91 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] HTTP exception thrown: Instance e09f71fe-7c54-4c43-810e-e0d79f515431 could not be found. Oct 04 21:39:13.243347 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-f256e961-92eb-4cab-935c-cb3bd5907e91 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Request method failure captured: Oct 04 21:39:13.243347 n-d-854823-8 devstack@n-api.service[128802]: request: DELETE /compute/v2.1/servers/e09f71fe-7c54-4c43-810e-e0d79f515431 HTTP/1.1 Oct 04 21:39:13.243347 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 21:39:13.243347 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 21:39:13.243347 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 21:39:13.243347 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 0 Oct 04 21:39:13.243347 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 21:39:13.243347 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 21:39:13.243347 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 21:39:13.243347 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 21:39:13.243347 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPKacG3zmlzrE0P03sqhhW8OxTX_N5d4FutccVYa--DxtxvF117E3y03wDG1eWqGIT6xlYZQeTInymX9iqEa1Cn-51caF2pJGBCFnPr7M2Ci1V2diBL1LhxAMFh-0O2THqSMgkeX7lBKNpS2ImrBtoud6Asim3w37JGPDnCp2IjwWzIw Oct 04 21:39:13.243347 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 21:39:13.243347 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 21:39:13.243347 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 21:39:13.243347 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 21:39:13.243347 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 21:39:13.243347 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 21:39:13.243347 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: a146d50c0a544fe49bb604199bb67f02 Oct 04 21:39:13.243347 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-ServerActionsTestJSON-1365673639 Oct 04 21:39:13.243347 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 21:39:13.243347 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 21:39:13.243347 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a146d50c0a544fe49bb604199bb67f02", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a146d50c0a544fe49bb604199bb67f02"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a146d50c0a544fe49bb604199bb67f02"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a146d50c0a544fe49bb604199bb67f02"}]}] Oct 04 21:39:13.243347 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-ServerActionsTestJSON-1365673639 Oct 04 21:39:13.243347 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: a146d50c0a544fe49bb604199bb67f02 Oct 04 21:39:13.243347 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-ServerActionsTestJSON-1365673639 Oct 04 21:39:13.243347 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-ServerActionsTestJSON-1365673639-project Oct 04 21:39:13.243347 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 21:39:13.243347 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 21:39:13.243347 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: a2b2b2b461354b8aa87cb19b0fb4fd28 Oct 04 21:39:13.243347 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-ServerActionsTestJSON-1365673639-project Oct 04 21:39:13.243347 n-d-854823-8 devstack@n-api.service[128802]: method: > Oct 04 21:39:13.243347 n-d-854823-8 devstack@n-api.service[128802]: exception: Instance e09f71fe-7c54-4c43-810e-e0d79f515431 could not be found. Oct 04 21:39:13.243347 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'id': 'e09f71fe-7c54-4c43-810e-e0d79f515431'} Oct 04 21:39:13.243347 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:39:13.243347 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:39:13.243347 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:39:13.243347 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:39:13.243347 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:39:13.243347 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:39:13.243347 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:39:13.243347 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:39:13.243347 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:39:13.243347 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:39:13.243347 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e09f71fe-7c54-4c43-810e-e0d79f515431 could not be found. Oct 04 21:39:13.243347 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:39:13.243347 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:39:13.243347 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:39:13.243347 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:39:13.243347 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:39:13.243347 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:39:13.243347 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:39:13.243347 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:39:13.243347 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:39:13.243347 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:39:13.243347 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 21:39:13.243347 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 21:39:13.243347 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 21:39:13.243347 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 21:39:13.243347 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:39:13.243347 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:39:13.243347 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:39:13.243347 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:39:13.250439 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e09f71fe-7c54-4c43-810e-e0d79f515431 could not be found. Oct 04 21:39:13.250439 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:39:13.250439 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:39:13.250439 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:39:13.250439 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:39:13.250439 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:39:13.250439 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:39:13.250439 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:39:13.250439 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:39:13.250439 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e09f71fe-7c54-4c43-810e-e0d79f515431 could not be found. Oct 04 21:39:13.250439 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:39:13.250439 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-f256e961-92eb-4cab-935c-cb3bd5907e91 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Returning 404 to user: Instance e09f71fe-7c54-4c43-810e-e0d79f515431 could not be found. {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:39:13.250439 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-f256e961-92eb-4cab-935c-cb3bd5907e91 tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "DELETE /compute/v2.1/servers/e09f71fe-7c54-4c43-810e-e0d79f515431" status: 404 len: 111 microversion: 2.1 time: 0.034506 Oct 04 21:39:13.250439 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3430/6825] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 21:39:13 2022] DELETE /compute/v2.1/servers/e09f71fe-7c54-4c43-810e-e0d79f515431 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 21:39:13.253462 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-86f3c9cd-fa54-449f-bde9-01c0bda62cdb tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:39:13.254079 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-86f3c9cd-fa54-449f-bde9-01c0bda62cdb tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] [instance: e09f71fe-7c54-4c43-810e-e0d79f515431] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:39:13.260696 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-86f3c9cd-fa54-449f-bde9-01c0bda62cdb tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:13.261188 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-86f3c9cd-fa54-449f-bde9-01c0bda62cdb tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:13.261623 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-86f3c9cd-fa54-449f-bde9-01c0bda62cdb tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:13.262328 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-86f3c9cd-fa54-449f-bde9-01c0bda62cdb tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:13.262804 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-86f3c9cd-fa54-449f-bde9-01c0bda62cdb tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:13.263226 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-86f3c9cd-fa54-449f-bde9-01c0bda62cdb tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:13.278644 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-86f3c9cd-fa54-449f-bde9-01c0bda62cdb tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] HTTP exception thrown: Instance e09f71fe-7c54-4c43-810e-e0d79f515431 could not be found. Oct 04 21:39:13.280414 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-86f3c9cd-fa54-449f-bde9-01c0bda62cdb tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Request method failure captured: Oct 04 21:39:13.280414 n-d-854823-8 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/e09f71fe-7c54-4c43-810e-e0d79f515431 HTTP/1.1 Oct 04 21:39:13.280414 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 21:39:13.280414 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 21:39:13.280414 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 21:39:13.280414 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 0 Oct 04 21:39:13.280414 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 21:39:13.280414 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 21:39:13.280414 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 21:39:13.280414 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 21:39:13.280414 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPKacG3zmlzrE0P03sqhhW8OxTX_N5d4FutccVYa--DxtxvF117E3y03wDG1eWqGIT6xlYZQeTInymX9iqEa1Cn-51caF2pJGBCFnPr7M2Ci1V2diBL1LhxAMFh-0O2THqSMgkeX7lBKNpS2ImrBtoud6Asim3w37JGPDnCp2IjwWzIw Oct 04 21:39:13.280414 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 21:39:13.280414 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 21:39:13.280414 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 21:39:13.280414 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 21:39:13.280414 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 21:39:13.280414 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 21:39:13.280414 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: a146d50c0a544fe49bb604199bb67f02 Oct 04 21:39:13.280414 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-ServerActionsTestJSON-1365673639 Oct 04 21:39:13.280414 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 21:39:13.280414 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 21:39:13.280414 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a146d50c0a544fe49bb604199bb67f02", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a146d50c0a544fe49bb604199bb67f02"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a146d50c0a544fe49bb604199bb67f02"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a146d50c0a544fe49bb604199bb67f02"}]}] Oct 04 21:39:13.280414 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-ServerActionsTestJSON-1365673639 Oct 04 21:39:13.280414 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: a146d50c0a544fe49bb604199bb67f02 Oct 04 21:39:13.280414 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ServerActionsTestJSON-1365673639 Oct 04 21:39:13.280414 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-ServerActionsTestJSON-1365673639-project Oct 04 21:39:13.280414 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 21:39:13.280414 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 21:39:13.280414 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: a2b2b2b461354b8aa87cb19b0fb4fd28 Oct 04 21:39:13.280414 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-ServerActionsTestJSON-1365673639-project Oct 04 21:39:13.280414 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 21:39:13.280414 n-d-854823-8 devstack@n-api.service[128801]: exception: Instance e09f71fe-7c54-4c43-810e-e0d79f515431 could not be found. Oct 04 21:39:13.280414 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': 'e09f71fe-7c54-4c43-810e-e0d79f515431'} Oct 04 21:39:13.280414 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:39:13.280414 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:39:13.280414 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:39:13.280414 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:39:13.280414 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:39:13.280414 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:39:13.280414 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:39:13.280414 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:39:13.280414 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:39:13.280414 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:39:13.280414 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e09f71fe-7c54-4c43-810e-e0d79f515431 could not be found. Oct 04 21:39:13.280414 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:39:13.280414 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:39:13.280414 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:39:13.280414 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:39:13.280414 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:39:13.280414 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:39:13.280414 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:39:13.280414 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:39:13.280414 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:39:13.280414 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:39:13.280414 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:39:13.280414 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:39:13.280414 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:39:13.280414 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:39:13.280414 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:39:13.280414 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:39:13.280414 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e09f71fe-7c54-4c43-810e-e0d79f515431 could not be found. Oct 04 21:39:13.280414 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:39:13.280414 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:39:13.280414 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:39:13.285679 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:39:13.285679 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:39:13.285679 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:39:13.285679 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:39:13.285679 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:39:13.285679 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e09f71fe-7c54-4c43-810e-e0d79f515431 could not be found. Oct 04 21:39:13.285679 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:39:13.285679 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-86f3c9cd-fa54-449f-bde9-01c0bda62cdb tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Returning 404 to user: Instance e09f71fe-7c54-4c43-810e-e0d79f515431 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:39:13.285679 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-86f3c9cd-fa54-449f-bde9-01c0bda62cdb tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "GET /compute/v2.1/servers/e09f71fe-7c54-4c43-810e-e0d79f515431" status: 404 len: 111 microversion: 2.1 time: 0.032278 Oct 04 21:39:13.285679 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3396/6826] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:39:13 2022] GET /compute/v2.1/servers/e09f71fe-7c54-4c43-810e-e0d79f515431 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:39:13.291493 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-93d02bac-ad8f-45c4-924b-cca02bd18f4c tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] Calling method '.version_select at 0x7f3c6c3badc0>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:39:13.315530 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-93d02bac-ad8f-45c4-924b-cca02bd18f4c tempest-ServerActionsTestJSON-1365673639 tempest-ServerActionsTestJSON-1365673639-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1781922112" status: 202 len: 0 microversion: 2.1 time: 0.028373 Oct 04 21:39:13.319336 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3431/6827] 10.222.0.33 () {58 vars in 1221 bytes} [Tue Oct 4 21:39:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1781922112 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:39:22.735799 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ce89776f-93b2-4830-ad1a-7b078983b47e tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-794042156", "imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63", "flavorRef": "452", "networks": [{"uuid": "96a80b87-7971-4336-a423-0c81c09e247f"}]}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:39:22.800875 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.network.neutron [None req-ce89776f-93b2-4830-ad1a-7b078983b47e tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] validate_networks() for [('96a80b87-7971-4336-a423-0c81c09e247f', None, None, None, None, None)] {{(pid=128801) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:39:23.280627 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=31 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:39:23.292930 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-ce89776f-93b2-4830-ad1a-7b078983b47e tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Flavor limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:39:23.293619 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-ce89776f-93b2-4830-ad1a-7b078983b47e tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Image limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:39:23.294278 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-ce89776f-93b2-4830-ad1a-7b078983b47e tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Flavor pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:39:23.294874 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-ce89776f-93b2-4830-ad1a-7b078983b47e tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Image pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:39:23.295646 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-ce89776f-93b2-4830-ad1a-7b078983b47e tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:39:23.307303 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ce89776f-93b2-4830-ad1a-7b078983b47e tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:23.307796 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ce89776f-93b2-4830-ad1a-7b078983b47e tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:23.308240 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ce89776f-93b2-4830-ad1a-7b078983b47e tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:23.308981 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ce89776f-93b2-4830-ad1a-7b078983b47e tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:23.309476 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ce89776f-93b2-4830-ad1a-7b078983b47e tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:23.309911 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ce89776f-93b2-4830-ad1a-7b078983b47e tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:23.336156 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-ce89776f-93b2-4830-ad1a-7b078983b47e tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Getting quotas for project d432854df7394754a4a244b010a3efca. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:39:23.345118 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-ce89776f-93b2-4830-ad1a-7b078983b47e tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Getting quotas for user 708e56110f59467784738c60b7649a00 and project d432854df7394754a4a244b010a3efca. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:39:23.361478 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ce89776f-93b2-4830-ad1a-7b078983b47e tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Going to run 1 instances... {{(pid=128801) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:39:23.364010 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ce89776f-93b2-4830-ad1a-7b078983b47e tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] [instance: e93ba587-53a0-4a0d-a505-5e5b722169b8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='15b24725-0c99-4bcf-b1fb-907cdf8e2d63',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128801) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:39:23.417113 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ce89776f-93b2-4830-ad1a-7b078983b47e tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.817797 Oct 04 21:39:23.423908 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3397/6828] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 21:39:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 824 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:39:23.427614 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=31 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:39:23.429142 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_api:SELECT=14,nova_api:DELETE=1 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:39:23.433516 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-b3511a88-c3eb-4116-a081-4de46ab1898f tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:39:23.434260 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-b3511a88-c3eb-4116-a081-4de46ab1898f tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] [instance: e93ba587-53a0-4a0d-a505-5e5b722169b8] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:39:23.492877 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-b3511a88-c3eb-4116-a081-4de46ab1898f tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708e56110f59467784738c60b7649a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd432854df7394754a4a244b010a3efca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:39:23.502788 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-b3511a88-c3eb-4116-a081-4de46ab1898f tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] 10.222.0.33 "GET /compute/v2.1/servers/e93ba587-53a0-4a0d-a505-5e5b722169b8" status: 200 len: 1216 microversion: 2.1 time: 0.076444 Oct 04 21:39:23.503952 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3432/6829] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:39:23 2022] GET /compute/v2.1/servers/e93ba587-53a0-4a0d-a505-5e5b722169b8 => generated 1216 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:39:24.527823 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-67d3ffac-afc9-4c70-aaf2-978c38c38005 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:39:24.528475 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-67d3ffac-afc9-4c70-aaf2-978c38c38005 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] [instance: e93ba587-53a0-4a0d-a505-5e5b722169b8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:39:24.539465 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-67d3ffac-afc9-4c70-aaf2-978c38c38005 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:24.540239 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-67d3ffac-afc9-4c70-aaf2-978c38c38005 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:24.540679 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-67d3ffac-afc9-4c70-aaf2-978c38c38005 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:24.541392 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-67d3ffac-afc9-4c70-aaf2-978c38c38005 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:24.541846 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-67d3ffac-afc9-4c70-aaf2-978c38c38005 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:24.542278 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-67d3ffac-afc9-4c70-aaf2-978c38c38005 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:24.629055 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-67d3ffac-afc9-4c70-aaf2-978c38c38005 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708e56110f59467784738c60b7649a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd432854df7394754a4a244b010a3efca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:39:24.638653 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-67d3ffac-afc9-4c70-aaf2-978c38c38005 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] 10.222.0.33 "GET /compute/v2.1/servers/e93ba587-53a0-4a0d-a505-5e5b722169b8" status: 200 len: 1268 microversion: 2.1 time: 0.116227 Oct 04 21:39:24.640114 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3398/6830] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:39:24 2022] GET /compute/v2.1/servers/e93ba587-53a0-4a0d-a505-5e5b722169b8 => generated 1268 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:39:25.668129 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-f320d8c4-1051-4eeb-a786-cc1b6ab628bf tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:39:25.669883 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-f320d8c4-1051-4eeb-a786-cc1b6ab628bf tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] [instance: e93ba587-53a0-4a0d-a505-5e5b722169b8] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:39:25.676927 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f320d8c4-1051-4eeb-a786-cc1b6ab628bf tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:25.677703 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f320d8c4-1051-4eeb-a786-cc1b6ab628bf tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:25.678240 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f320d8c4-1051-4eeb-a786-cc1b6ab628bf tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:25.679961 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f320d8c4-1051-4eeb-a786-cc1b6ab628bf tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:25.680670 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f320d8c4-1051-4eeb-a786-cc1b6ab628bf tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:25.681495 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f320d8c4-1051-4eeb-a786-cc1b6ab628bf tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:25.921451 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-f320d8c4-1051-4eeb-a786-cc1b6ab628bf tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708e56110f59467784738c60b7649a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd432854df7394754a4a244b010a3efca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:39:25.930379 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-f320d8c4-1051-4eeb-a786-cc1b6ab628bf tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] 10.222.0.33 "GET /compute/v2.1/servers/e93ba587-53a0-4a0d-a505-5e5b722169b8" status: 200 len: 1316 microversion: 2.1 time: 0.267871 Oct 04 21:39:25.931884 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3433/6831] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:39:25 2022] GET /compute/v2.1/servers/e93ba587-53a0-4a0d-a505-5e5b722169b8 => generated 1316 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:39:26.259312 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-a132a4ff-bcce-48d3-828a-79db5abd5476 req-bc634d2c-37c6-4580-89b2-bbfc80630163 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e93ba587-53a0-4a0d-a505-5e5b722169b8", "tag": "2b5a97e9-d55c-4e43-89d9-04c1a4eb745b"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:39:26.269814 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-a132a4ff-bcce-48d3-828a-79db5abd5476 req-bc634d2c-37c6-4580-89b2-bbfc80630163 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:26.270293 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-a132a4ff-bcce-48d3-828a-79db5abd5476 req-bc634d2c-37c6-4580-89b2-bbfc80630163 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:26.271348 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-a132a4ff-bcce-48d3-828a-79db5abd5476 req-bc634d2c-37c6-4580-89b2-bbfc80630163 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:26.284662 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-a132a4ff-bcce-48d3-828a-79db5abd5476 req-bc634d2c-37c6-4580-89b2-bbfc80630163 service nova] Creating event network-changed:2b5a97e9-d55c-4e43-89d9-04c1a4eb745b for instance e93ba587-53a0-4a0d-a505-5e5b722169b8 on n-h2-854823-8 Oct 04 21:39:26.291028 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-a132a4ff-bcce-48d3-828a-79db5abd5476 req-bc634d2c-37c6-4580-89b2-bbfc80630163 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035600 Oct 04 21:39:26.292218 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3399/6832] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:39:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:39:26.955688 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-bc50cc00-23a6-4cc7-8946-1c73573955d2 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:39:26.956331 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-bc50cc00-23a6-4cc7-8946-1c73573955d2 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] [instance: e93ba587-53a0-4a0d-a505-5e5b722169b8] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:39:26.963827 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bc50cc00-23a6-4cc7-8946-1c73573955d2 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:26.964322 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bc50cc00-23a6-4cc7-8946-1c73573955d2 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:26.964768 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bc50cc00-23a6-4cc7-8946-1c73573955d2 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:26.965477 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bc50cc00-23a6-4cc7-8946-1c73573955d2 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:26.965941 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bc50cc00-23a6-4cc7-8946-1c73573955d2 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:26.966402 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bc50cc00-23a6-4cc7-8946-1c73573955d2 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:27.129985 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-bc50cc00-23a6-4cc7-8946-1c73573955d2 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708e56110f59467784738c60b7649a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd432854df7394754a4a244b010a3efca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:39:27.140409 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-bc50cc00-23a6-4cc7-8946-1c73573955d2 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] 10.222.0.33 "GET /compute/v2.1/servers/e93ba587-53a0-4a0d-a505-5e5b722169b8" status: 200 len: 1316 microversion: 2.1 time: 0.188556 Oct 04 21:39:27.140998 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3434/6833] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:39:26 2022] GET /compute/v2.1/servers/e93ba587-53a0-4a0d-a505-5e5b722169b8 => generated 1316 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:39:28.167788 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-06e91f44-caeb-402f-8e17-2c507d0b7f3d tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:39:28.168541 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-06e91f44-caeb-402f-8e17-2c507d0b7f3d tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] [instance: e93ba587-53a0-4a0d-a505-5e5b722169b8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:39:28.174970 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-06e91f44-caeb-402f-8e17-2c507d0b7f3d tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:28.175467 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-06e91f44-caeb-402f-8e17-2c507d0b7f3d tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:28.175908 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-06e91f44-caeb-402f-8e17-2c507d0b7f3d tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:28.176878 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-06e91f44-caeb-402f-8e17-2c507d0b7f3d tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:28.177333 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-06e91f44-caeb-402f-8e17-2c507d0b7f3d tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:28.177763 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-06e91f44-caeb-402f-8e17-2c507d0b7f3d tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:28.432800 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-06e91f44-caeb-402f-8e17-2c507d0b7f3d tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708e56110f59467784738c60b7649a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd432854df7394754a4a244b010a3efca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:39:28.440674 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-06e91f44-caeb-402f-8e17-2c507d0b7f3d tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] 10.222.0.33 "GET /compute/v2.1/servers/e93ba587-53a0-4a0d-a505-5e5b722169b8" status: 200 len: 1316 microversion: 2.1 time: 0.279149 Oct 04 21:39:28.441251 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3400/6834] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:39:28 2022] GET /compute/v2.1/servers/e93ba587-53a0-4a0d-a505-5e5b722169b8 => generated 1316 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:39:29.463760 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-641766f1-b89a-4e87-ac51-0cbd91122926 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:39:29.464355 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-641766f1-b89a-4e87-ac51-0cbd91122926 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] [instance: e93ba587-53a0-4a0d-a505-5e5b722169b8] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:39:29.471203 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-641766f1-b89a-4e87-ac51-0cbd91122926 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:29.471693 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-641766f1-b89a-4e87-ac51-0cbd91122926 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:29.472136 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-641766f1-b89a-4e87-ac51-0cbd91122926 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:29.472836 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-641766f1-b89a-4e87-ac51-0cbd91122926 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:29.473296 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-641766f1-b89a-4e87-ac51-0cbd91122926 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:29.473726 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-641766f1-b89a-4e87-ac51-0cbd91122926 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:29.613054 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-641766f1-b89a-4e87-ac51-0cbd91122926 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708e56110f59467784738c60b7649a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd432854df7394754a4a244b010a3efca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:39:29.620916 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-641766f1-b89a-4e87-ac51-0cbd91122926 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] 10.222.0.33 "GET /compute/v2.1/servers/e93ba587-53a0-4a0d-a505-5e5b722169b8" status: 200 len: 1316 microversion: 2.1 time: 0.161702 Oct 04 21:39:29.621505 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3435/6835] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:39:29 2022] GET /compute/v2.1/servers/e93ba587-53a0-4a0d-a505-5e5b722169b8 => generated 1316 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:39:30.645054 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-235b5a8b-46f5-4448-9e33-105c4429e6a0 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:39:30.645662 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-235b5a8b-46f5-4448-9e33-105c4429e6a0 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] [instance: e93ba587-53a0-4a0d-a505-5e5b722169b8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:39:30.653082 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-235b5a8b-46f5-4448-9e33-105c4429e6a0 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:30.653596 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-235b5a8b-46f5-4448-9e33-105c4429e6a0 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:30.654052 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-235b5a8b-46f5-4448-9e33-105c4429e6a0 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:30.654741 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-235b5a8b-46f5-4448-9e33-105c4429e6a0 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:30.655193 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-235b5a8b-46f5-4448-9e33-105c4429e6a0 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:30.655638 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-235b5a8b-46f5-4448-9e33-105c4429e6a0 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:30.794182 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-235b5a8b-46f5-4448-9e33-105c4429e6a0 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708e56110f59467784738c60b7649a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd432854df7394754a4a244b010a3efca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:39:30.802557 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-235b5a8b-46f5-4448-9e33-105c4429e6a0 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] 10.222.0.33 "GET /compute/v2.1/servers/e93ba587-53a0-4a0d-a505-5e5b722169b8" status: 200 len: 1316 microversion: 2.1 time: 0.161377 Oct 04 21:39:30.803138 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3401/6836] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:39:30 2022] GET /compute/v2.1/servers/e93ba587-53a0-4a0d-a505-5e5b722169b8 => generated 1316 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:39:31.696497 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-17ece26d-33a1-49f3-b536-b902490dcd88 req-ac96876b-ad63-4ad5-9ca4-4d1d05fc1f34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e93ba587-53a0-4a0d-a505-5e5b722169b8", "name": "network-vif-plugged", "status": "completed", "tag": "2b5a97e9-d55c-4e43-89d9-04c1a4eb745b"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:39:31.708161 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-17ece26d-33a1-49f3-b536-b902490dcd88 req-ac96876b-ad63-4ad5-9ca4-4d1d05fc1f34 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:31.708665 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-17ece26d-33a1-49f3-b536-b902490dcd88 req-ac96876b-ad63-4ad5-9ca4-4d1d05fc1f34 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:31.709102 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-17ece26d-33a1-49f3-b536-b902490dcd88 req-ac96876b-ad63-4ad5-9ca4-4d1d05fc1f34 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:31.721837 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-17ece26d-33a1-49f3-b536-b902490dcd88 req-ac96876b-ad63-4ad5-9ca4-4d1d05fc1f34 service nova] Creating event network-vif-plugged:2b5a97e9-d55c-4e43-89d9-04c1a4eb745b for instance e93ba587-53a0-4a0d-a505-5e5b722169b8 on n-h2-854823-8 Oct 04 21:39:31.727732 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-17ece26d-33a1-49f3-b536-b902490dcd88 req-ac96876b-ad63-4ad5-9ca4-4d1d05fc1f34 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034941 Oct 04 21:39:31.728387 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3436/6837] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:39:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:39:31.826488 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-4d4ea9d8-38a0-4d11-b8f7-ed1304f4c813 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:39:31.827030 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-4d4ea9d8-38a0-4d11-b8f7-ed1304f4c813 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] [instance: e93ba587-53a0-4a0d-a505-5e5b722169b8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:39:31.834226 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4d4ea9d8-38a0-4d11-b8f7-ed1304f4c813 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:31.834761 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4d4ea9d8-38a0-4d11-b8f7-ed1304f4c813 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:31.835199 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4d4ea9d8-38a0-4d11-b8f7-ed1304f4c813 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:31.835912 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4d4ea9d8-38a0-4d11-b8f7-ed1304f4c813 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:31.836369 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4d4ea9d8-38a0-4d11-b8f7-ed1304f4c813 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:31.836802 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4d4ea9d8-38a0-4d11-b8f7-ed1304f4c813 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:32.002094 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-4d4ea9d8-38a0-4d11-b8f7-ed1304f4c813 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708e56110f59467784738c60b7649a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd432854df7394754a4a244b010a3efca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:39:32.009854 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-4d4ea9d8-38a0-4d11-b8f7-ed1304f4c813 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] 10.222.0.33 "GET /compute/v2.1/servers/e93ba587-53a0-4a0d-a505-5e5b722169b8" status: 200 len: 1316 microversion: 2.1 time: 0.187504 Oct 04 21:39:32.010460 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3402/6838] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:39:31 2022] GET /compute/v2.1/servers/e93ba587-53a0-4a0d-a505-5e5b722169b8 => generated 1316 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:39:33.034159 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-349d8a40-3a04-401b-8596-5b4758c6cb71 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:39:33.035177 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-349d8a40-3a04-401b-8596-5b4758c6cb71 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] [instance: e93ba587-53a0-4a0d-a505-5e5b722169b8] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:39:33.042410 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-349d8a40-3a04-401b-8596-5b4758c6cb71 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:33.042900 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-349d8a40-3a04-401b-8596-5b4758c6cb71 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:33.043342 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-349d8a40-3a04-401b-8596-5b4758c6cb71 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:33.044041 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-349d8a40-3a04-401b-8596-5b4758c6cb71 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:33.044594 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-349d8a40-3a04-401b-8596-5b4758c6cb71 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:33.044942 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-349d8a40-3a04-401b-8596-5b4758c6cb71 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:33.186920 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-349d8a40-3a04-401b-8596-5b4758c6cb71 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708e56110f59467784738c60b7649a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd432854df7394754a4a244b010a3efca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:39:33.195145 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-349d8a40-3a04-401b-8596-5b4758c6cb71 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] 10.222.0.33 "GET /compute/v2.1/servers/e93ba587-53a0-4a0d-a505-5e5b722169b8" status: 200 len: 1505 microversion: 2.1 time: 0.165647 Oct 04 21:39:33.195756 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3437/6839] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:39:33 2022] GET /compute/v2.1/servers/e93ba587-53a0-4a0d-a505-5e5b722169b8 => generated 1505 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:39:33.259405 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0488d839-e583-4fe4-bbd9-b9d281462fb2 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1690824961", "imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63", "flavorRef": "452", "networks": [{"uuid": "96a80b87-7971-4336-a423-0c81c09e247f"}]}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:39:33.318501 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.network.neutron [None req-0488d839-e583-4fe4-bbd9-b9d281462fb2 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] validate_networks() for [('96a80b87-7971-4336-a423-0c81c09e247f', None, None, None, None, None)] {{(pid=128801) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:39:33.322531 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:39:33.355597 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=6 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:39:33.693261 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-0488d839-e583-4fe4-bbd9-b9d281462fb2 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Flavor limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:39:33.693692 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-0488d839-e583-4fe4-bbd9-b9d281462fb2 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Image limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:39:33.694220 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-0488d839-e583-4fe4-bbd9-b9d281462fb2 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Flavor pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:39:33.694707 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-0488d839-e583-4fe4-bbd9-b9d281462fb2 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Image pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:39:33.695120 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-0488d839-e583-4fe4-bbd9-b9d281462fb2 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:39:33.704098 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0488d839-e583-4fe4-bbd9-b9d281462fb2 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:33.704692 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0488d839-e583-4fe4-bbd9-b9d281462fb2 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:33.705011 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0488d839-e583-4fe4-bbd9-b9d281462fb2 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:33.705734 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0488d839-e583-4fe4-bbd9-b9d281462fb2 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:33.706185 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0488d839-e583-4fe4-bbd9-b9d281462fb2 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:33.706628 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0488d839-e583-4fe4-bbd9-b9d281462fb2 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:33.724163 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-0488d839-e583-4fe4-bbd9-b9d281462fb2 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Getting quotas for project d432854df7394754a4a244b010a3efca. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:39:33.730231 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-0488d839-e583-4fe4-bbd9-b9d281462fb2 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Getting quotas for user 708e56110f59467784738c60b7649a00 and project d432854df7394754a4a244b010a3efca. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:39:33.743121 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-0488d839-e583-4fe4-bbd9-b9d281462fb2 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Going to run 1 instances... {{(pid=128801) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:39:33.745436 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-0488d839-e583-4fe4-bbd9-b9d281462fb2 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] [instance: 5f039dd4-0a7b-4be3-b281-3e615e5656e9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='15b24725-0c99-4bcf-b1fb-907cdf8e2d63',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128801) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:39:33.792675 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-0488d839-e583-4fe4-bbd9-b9d281462fb2 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.537579 Oct 04 21:39:33.793505 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3403/6840] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 21:39:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 539 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:39:33.805108 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-96190d8e-8878-4fae-bbd1-f2c891fa6620 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:39:33.805730 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-96190d8e-8878-4fae-bbd1-f2c891fa6620 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] [instance: 5f039dd4-0a7b-4be3-b281-3e615e5656e9] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:39:33.807856 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell0:SELECT=2 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:39:33.866234 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-96190d8e-8878-4fae-bbd1-f2c891fa6620 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708e56110f59467784738c60b7649a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd432854df7394754a4a244b010a3efca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:39:33.876828 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-96190d8e-8878-4fae-bbd1-f2c891fa6620 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] 10.222.0.33 "GET /compute/v2.1/servers/5f039dd4-0a7b-4be3-b281-3e615e5656e9" status: 200 len: 1217 microversion: 2.1 time: 0.076101 Oct 04 21:39:33.877687 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3438/6841] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:39:33 2022] GET /compute/v2.1/servers/5f039dd4-0a7b-4be3-b281-3e615e5656e9 => generated 1217 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:39:34.902287 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-cc2b8f04-9d4b-42dc-81e9-2fd0b6541ebd tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:39:34.902863 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-cc2b8f04-9d4b-42dc-81e9-2fd0b6541ebd tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] [instance: 5f039dd4-0a7b-4be3-b281-3e615e5656e9] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:39:34.911045 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cc2b8f04-9d4b-42dc-81e9-2fd0b6541ebd tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:34.911538 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cc2b8f04-9d4b-42dc-81e9-2fd0b6541ebd tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:34.911968 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cc2b8f04-9d4b-42dc-81e9-2fd0b6541ebd tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:34.913236 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cc2b8f04-9d4b-42dc-81e9-2fd0b6541ebd tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:34.913723 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cc2b8f04-9d4b-42dc-81e9-2fd0b6541ebd tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:34.914149 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cc2b8f04-9d4b-42dc-81e9-2fd0b6541ebd tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:34.980858 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-cc2b8f04-9d4b-42dc-81e9-2fd0b6541ebd tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708e56110f59467784738c60b7649a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd432854df7394754a4a244b010a3efca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:39:34.988899 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-cc2b8f04-9d4b-42dc-81e9-2fd0b6541ebd tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] 10.222.0.33 "GET /compute/v2.1/servers/5f039dd4-0a7b-4be3-b281-3e615e5656e9" status: 200 len: 1269 microversion: 2.1 time: 0.090835 Oct 04 21:39:34.989483 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3404/6842] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:39:34 2022] GET /compute/v2.1/servers/5f039dd4-0a7b-4be3-b281-3e615e5656e9 => generated 1269 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:39:36.018572 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-b69da21f-3ef2-457c-a293-4f5fb785ed5b tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:39:36.019045 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-b69da21f-3ef2-457c-a293-4f5fb785ed5b tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] [instance: 5f039dd4-0a7b-4be3-b281-3e615e5656e9] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:39:36.026307 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b69da21f-3ef2-457c-a293-4f5fb785ed5b tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:36.026825 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b69da21f-3ef2-457c-a293-4f5fb785ed5b tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:36.027275 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b69da21f-3ef2-457c-a293-4f5fb785ed5b tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:36.027997 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b69da21f-3ef2-457c-a293-4f5fb785ed5b tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:36.028469 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b69da21f-3ef2-457c-a293-4f5fb785ed5b tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:36.029126 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b69da21f-3ef2-457c-a293-4f5fb785ed5b tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:36.165903 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-b69da21f-3ef2-457c-a293-4f5fb785ed5b tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708e56110f59467784738c60b7649a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd432854df7394754a4a244b010a3efca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:39:36.174983 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-b69da21f-3ef2-457c-a293-4f5fb785ed5b tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] 10.222.0.33 "GET /compute/v2.1/servers/5f039dd4-0a7b-4be3-b281-3e615e5656e9" status: 200 len: 1317 microversion: 2.1 time: 0.161249 Oct 04 21:39:36.175710 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3439/6843] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:39:36 2022] GET /compute/v2.1/servers/5f039dd4-0a7b-4be3-b281-3e615e5656e9 => generated 1317 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:39:36.713498 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-6aad34fd-35ae-4f12-9416-0a00dcf386eb req-cea6b5bb-aab5-4e09-a593-2d2bda72fd44 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f039dd4-0a7b-4be3-b281-3e615e5656e9", "tag": "78cc2ee6-8356-4a4d-80ce-f341939aef68"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:39:36.727093 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-6aad34fd-35ae-4f12-9416-0a00dcf386eb req-cea6b5bb-aab5-4e09-a593-2d2bda72fd44 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:36.727664 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-6aad34fd-35ae-4f12-9416-0a00dcf386eb req-cea6b5bb-aab5-4e09-a593-2d2bda72fd44 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:36.728163 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-6aad34fd-35ae-4f12-9416-0a00dcf386eb req-cea6b5bb-aab5-4e09-a593-2d2bda72fd44 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:36.744380 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-6aad34fd-35ae-4f12-9416-0a00dcf386eb req-cea6b5bb-aab5-4e09-a593-2d2bda72fd44 service nova] Creating event network-changed:78cc2ee6-8356-4a4d-80ce-f341939aef68 for instance 5f039dd4-0a7b-4be3-b281-3e615e5656e9 on n-h1-854823-8 Oct 04 21:39:36.749614 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-6aad34fd-35ae-4f12-9416-0a00dcf386eb req-cea6b5bb-aab5-4e09-a593-2d2bda72fd44 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041677 Oct 04 21:39:36.750574 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3405/6844] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:39:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:39:37.200259 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-2fb3c6fd-384a-4d4b-99c4-1ef1b094834c tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:39:37.200798 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-2fb3c6fd-384a-4d4b-99c4-1ef1b094834c tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] [instance: 5f039dd4-0a7b-4be3-b281-3e615e5656e9] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:39:37.207684 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2fb3c6fd-384a-4d4b-99c4-1ef1b094834c tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:37.208185 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2fb3c6fd-384a-4d4b-99c4-1ef1b094834c tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:37.208635 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2fb3c6fd-384a-4d4b-99c4-1ef1b094834c tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:37.209342 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2fb3c6fd-384a-4d4b-99c4-1ef1b094834c tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:37.210661 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2fb3c6fd-384a-4d4b-99c4-1ef1b094834c tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:37.211212 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2fb3c6fd-384a-4d4b-99c4-1ef1b094834c tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:37.344972 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-2fb3c6fd-384a-4d4b-99c4-1ef1b094834c tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708e56110f59467784738c60b7649a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd432854df7394754a4a244b010a3efca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:39:37.353071 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-2fb3c6fd-384a-4d4b-99c4-1ef1b094834c tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] 10.222.0.33 "GET /compute/v2.1/servers/5f039dd4-0a7b-4be3-b281-3e615e5656e9" status: 200 len: 1317 microversion: 2.1 time: 0.156908 Oct 04 21:39:37.353652 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3440/6845] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:39:37 2022] GET /compute/v2.1/servers/5f039dd4-0a7b-4be3-b281-3e615e5656e9 => generated 1317 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:39:38.377774 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1bdfa691-d6c9-4de9-a16a-2d10c523519d tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:39:38.378500 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-1bdfa691-d6c9-4de9-a16a-2d10c523519d tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] [instance: 5f039dd4-0a7b-4be3-b281-3e615e5656e9] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:39:38.385213 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1bdfa691-d6c9-4de9-a16a-2d10c523519d tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:38.385705 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1bdfa691-d6c9-4de9-a16a-2d10c523519d tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:38.386127 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1bdfa691-d6c9-4de9-a16a-2d10c523519d tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:38.386852 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1bdfa691-d6c9-4de9-a16a-2d10c523519d tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:38.387305 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1bdfa691-d6c9-4de9-a16a-2d10c523519d tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:38.387725 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1bdfa691-d6c9-4de9-a16a-2d10c523519d tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:38.518885 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-1bdfa691-d6c9-4de9-a16a-2d10c523519d tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708e56110f59467784738c60b7649a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd432854df7394754a4a244b010a3efca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:39:38.527805 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-1bdfa691-d6c9-4de9-a16a-2d10c523519d tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] 10.222.0.33 "GET /compute/v2.1/servers/5f039dd4-0a7b-4be3-b281-3e615e5656e9" status: 200 len: 1317 microversion: 2.1 time: 0.154997 Oct 04 21:39:38.528441 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3406/6846] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:39:38 2022] GET /compute/v2.1/servers/5f039dd4-0a7b-4be3-b281-3e615e5656e9 => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:39:39.552318 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-79ecd5f9-6885-44b5-8596-b5bdceb76374 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:39:39.552969 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-79ecd5f9-6885-44b5-8596-b5bdceb76374 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] [instance: 5f039dd4-0a7b-4be3-b281-3e615e5656e9] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:39:39.560974 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-79ecd5f9-6885-44b5-8596-b5bdceb76374 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:39.561498 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-79ecd5f9-6885-44b5-8596-b5bdceb76374 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:39.561953 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-79ecd5f9-6885-44b5-8596-b5bdceb76374 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:39.562677 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-79ecd5f9-6885-44b5-8596-b5bdceb76374 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:39.563145 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-79ecd5f9-6885-44b5-8596-b5bdceb76374 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:39.563583 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-79ecd5f9-6885-44b5-8596-b5bdceb76374 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:39.693990 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-79ecd5f9-6885-44b5-8596-b5bdceb76374 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708e56110f59467784738c60b7649a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd432854df7394754a4a244b010a3efca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:39:39.701795 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-79ecd5f9-6885-44b5-8596-b5bdceb76374 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] 10.222.0.33 "GET /compute/v2.1/servers/5f039dd4-0a7b-4be3-b281-3e615e5656e9" status: 200 len: 1317 microversion: 2.1 time: 0.153650 Oct 04 21:39:39.702633 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3441/6847] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:39:39 2022] GET /compute/v2.1/servers/5f039dd4-0a7b-4be3-b281-3e615e5656e9 => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:39:40.725174 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-41a720a3-3999-4ae2-a9b9-8b0cc8b2b029 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:39:40.725983 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-41a720a3-3999-4ae2-a9b9-8b0cc8b2b029 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] [instance: 5f039dd4-0a7b-4be3-b281-3e615e5656e9] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:39:40.728862 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=6 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:39:40.734272 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-41a720a3-3999-4ae2-a9b9-8b0cc8b2b029 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:40.734789 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-41a720a3-3999-4ae2-a9b9-8b0cc8b2b029 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:40.735228 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-41a720a3-3999-4ae2-a9b9-8b0cc8b2b029 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:40.735928 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-41a720a3-3999-4ae2-a9b9-8b0cc8b2b029 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:40.736384 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-41a720a3-3999-4ae2-a9b9-8b0cc8b2b029 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:40.736811 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-41a720a3-3999-4ae2-a9b9-8b0cc8b2b029 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:40.872040 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-41a720a3-3999-4ae2-a9b9-8b0cc8b2b029 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708e56110f59467784738c60b7649a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd432854df7394754a4a244b010a3efca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:39:40.879774 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-41a720a3-3999-4ae2-a9b9-8b0cc8b2b029 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] 10.222.0.33 "GET /compute/v2.1/servers/5f039dd4-0a7b-4be3-b281-3e615e5656e9" status: 200 len: 1317 microversion: 2.1 time: 0.158870 Oct 04 21:39:40.880344 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3407/6848] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:39:40 2022] GET /compute/v2.1/servers/5f039dd4-0a7b-4be3-b281-3e615e5656e9 => generated 1317 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:39:41.904049 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-effdac34-39a2-4860-b455-6ce91bb3db66 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:39:41.904670 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-effdac34-39a2-4860-b455-6ce91bb3db66 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] [instance: 5f039dd4-0a7b-4be3-b281-3e615e5656e9] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:39:41.911530 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-effdac34-39a2-4860-b455-6ce91bb3db66 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:41.912025 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-effdac34-39a2-4860-b455-6ce91bb3db66 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:41.912505 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-effdac34-39a2-4860-b455-6ce91bb3db66 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:41.913309 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-effdac34-39a2-4860-b455-6ce91bb3db66 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:41.913780 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-effdac34-39a2-4860-b455-6ce91bb3db66 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:41.914219 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-effdac34-39a2-4860-b455-6ce91bb3db66 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:42.045887 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-effdac34-39a2-4860-b455-6ce91bb3db66 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708e56110f59467784738c60b7649a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd432854df7394754a4a244b010a3efca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:39:42.054174 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-effdac34-39a2-4860-b455-6ce91bb3db66 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] 10.222.0.33 "GET /compute/v2.1/servers/5f039dd4-0a7b-4be3-b281-3e615e5656e9" status: 200 len: 1317 microversion: 2.1 time: 0.154047 Oct 04 21:39:42.054786 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3442/6849] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:39:41 2022] GET /compute/v2.1/servers/5f039dd4-0a7b-4be3-b281-3e615e5656e9 => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:39:43.077181 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-09011ef4-c329-44c9-9626-f564a0bab488 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:39:43.077803 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-09011ef4-c329-44c9-9626-f564a0bab488 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] [instance: 5f039dd4-0a7b-4be3-b281-3e615e5656e9] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:39:43.085398 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-09011ef4-c329-44c9-9626-f564a0bab488 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:43.085907 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-09011ef4-c329-44c9-9626-f564a0bab488 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:43.086366 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-09011ef4-c329-44c9-9626-f564a0bab488 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:43.087096 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-09011ef4-c329-44c9-9626-f564a0bab488 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:43.087563 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-09011ef4-c329-44c9-9626-f564a0bab488 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:43.088014 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-09011ef4-c329-44c9-9626-f564a0bab488 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:43.123249 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-4492b290-6dfa-41b1-88b7-aa0a6123e77f req-8da94a0a-0a8a-465a-b755-5b61c83c9f29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f039dd4-0a7b-4be3-b281-3e615e5656e9", "name": "network-vif-plugged", "status": "completed", "tag": "78cc2ee6-8356-4a4d-80ce-f341939aef68"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:39:43.134647 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-4492b290-6dfa-41b1-88b7-aa0a6123e77f req-8da94a0a-0a8a-465a-b755-5b61c83c9f29 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:43.135471 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-4492b290-6dfa-41b1-88b7-aa0a6123e77f req-8da94a0a-0a8a-465a-b755-5b61c83c9f29 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:43.136238 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-4492b290-6dfa-41b1-88b7-aa0a6123e77f req-8da94a0a-0a8a-465a-b755-5b61c83c9f29 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:43.148969 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-4492b290-6dfa-41b1-88b7-aa0a6123e77f req-8da94a0a-0a8a-465a-b755-5b61c83c9f29 service nova] Creating event network-vif-plugged:78cc2ee6-8356-4a4d-80ce-f341939aef68 for instance 5f039dd4-0a7b-4be3-b281-3e615e5656e9 on n-h1-854823-8 Oct 04 21:39:43.154530 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-4492b290-6dfa-41b1-88b7-aa0a6123e77f req-8da94a0a-0a8a-465a-b755-5b61c83c9f29 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034828 Oct 04 21:39:43.155559 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3443/6850] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:39:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:39:43.263940 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-09011ef4-c329-44c9-9626-f564a0bab488 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708e56110f59467784738c60b7649a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd432854df7394754a4a244b010a3efca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:39:43.273253 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-09011ef4-c329-44c9-9626-f564a0bab488 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] 10.222.0.33 "GET /compute/v2.1/servers/5f039dd4-0a7b-4be3-b281-3e615e5656e9" status: 200 len: 1317 microversion: 2.1 time: 0.199825 Oct 04 21:39:43.273863 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3408/6851] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:39:43 2022] GET /compute/v2.1/servers/5f039dd4-0a7b-4be3-b281-3e615e5656e9 => generated 1317 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:39:44.294921 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell0:SELECT=2 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:39:44.299942 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-4e440d46-8bd5-4f97-8760-53b0bdea6532 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:39:44.300650 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-4e440d46-8bd5-4f97-8760-53b0bdea6532 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] [instance: 5f039dd4-0a7b-4be3-b281-3e615e5656e9] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:39:44.308656 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4e440d46-8bd5-4f97-8760-53b0bdea6532 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:44.309152 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4e440d46-8bd5-4f97-8760-53b0bdea6532 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:44.309593 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4e440d46-8bd5-4f97-8760-53b0bdea6532 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:44.310304 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4e440d46-8bd5-4f97-8760-53b0bdea6532 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:44.310790 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4e440d46-8bd5-4f97-8760-53b0bdea6532 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:44.311228 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4e440d46-8bd5-4f97-8760-53b0bdea6532 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:44.443114 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-4e440d46-8bd5-4f97-8760-53b0bdea6532 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708e56110f59467784738c60b7649a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd432854df7394754a4a244b010a3efca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:39:44.451428 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-4e440d46-8bd5-4f97-8760-53b0bdea6532 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] 10.222.0.33 "GET /compute/v2.1/servers/5f039dd4-0a7b-4be3-b281-3e615e5656e9" status: 200 len: 1317 microversion: 2.1 time: 0.157549 Oct 04 21:39:44.452015 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3444/6852] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:39:44 2022] GET /compute/v2.1/servers/5f039dd4-0a7b-4be3-b281-3e615e5656e9 => generated 1317 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:39:45.474786 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-4c3ed8aa-7018-451f-a54a-f0212c033d14 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:39:45.475484 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-4c3ed8aa-7018-451f-a54a-f0212c033d14 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] [instance: 5f039dd4-0a7b-4be3-b281-3e615e5656e9] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:39:45.477368 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:39:45.478026 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=6 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:39:45.484651 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4c3ed8aa-7018-451f-a54a-f0212c033d14 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:45.485130 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4c3ed8aa-7018-451f-a54a-f0212c033d14 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:45.485561 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4c3ed8aa-7018-451f-a54a-f0212c033d14 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:45.486278 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4c3ed8aa-7018-451f-a54a-f0212c033d14 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:45.486759 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4c3ed8aa-7018-451f-a54a-f0212c033d14 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:45.487194 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4c3ed8aa-7018-451f-a54a-f0212c033d14 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:45.622106 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-4c3ed8aa-7018-451f-a54a-f0212c033d14 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708e56110f59467784738c60b7649a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd432854df7394754a4a244b010a3efca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:39:45.629901 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-4c3ed8aa-7018-451f-a54a-f0212c033d14 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] 10.222.0.33 "GET /compute/v2.1/servers/5f039dd4-0a7b-4be3-b281-3e615e5656e9" status: 200 len: 1507 microversion: 2.1 time: 0.159178 Oct 04 21:39:45.630520 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3409/6853] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:39:45 2022] GET /compute/v2.1/servers/5f039dd4-0a7b-4be3-b281-3e615e5656e9 => generated 1507 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:39:45.652086 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-e3596154-cbfe-4066-8ecf-238b9abcb972 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:39:45.652689 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-e3596154-cbfe-4066-8ecf-238b9abcb972 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] [instance: 5f039dd4-0a7b-4be3-b281-3e615e5656e9] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:39:45.659674 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e3596154-cbfe-4066-8ecf-238b9abcb972 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:45.660161 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e3596154-cbfe-4066-8ecf-238b9abcb972 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:45.660604 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e3596154-cbfe-4066-8ecf-238b9abcb972 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:45.661300 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e3596154-cbfe-4066-8ecf-238b9abcb972 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:45.661761 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e3596154-cbfe-4066-8ecf-238b9abcb972 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:45.662191 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e3596154-cbfe-4066-8ecf-238b9abcb972 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:45.690849 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-e3596154-cbfe-4066-8ecf-238b9abcb972 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] [instance: 5f039dd4-0a7b-4be3-b281-3e615e5656e9] Going to try to terminate instance {{(pid=128802) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:39:45.768923 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-e3596154-cbfe-4066-8ecf-238b9abcb972 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] 10.222.0.33 "DELETE /compute/v2.1/servers/5f039dd4-0a7b-4be3-b281-3e615e5656e9" status: 204 len: 0 microversion: 2.1 time: 0.120197 Oct 04 21:39:45.769528 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3445/6854] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 21:39:45 2022] DELETE /compute/v2.1/servers/5f039dd4-0a7b-4be3-b281-3e615e5656e9 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:39:45.779012 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ec8bb087-3bb5-412c-affd-94af4fb35c00 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:39:45.779621 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ec8bb087-3bb5-412c-affd-94af4fb35c00 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] [instance: 5f039dd4-0a7b-4be3-b281-3e615e5656e9] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:39:45.785596 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ec8bb087-3bb5-412c-affd-94af4fb35c00 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:45.786084 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ec8bb087-3bb5-412c-affd-94af4fb35c00 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:45.786555 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ec8bb087-3bb5-412c-affd-94af4fb35c00 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:45.787757 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ec8bb087-3bb5-412c-affd-94af4fb35c00 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:45.788470 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ec8bb087-3bb5-412c-affd-94af4fb35c00 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:45.788652 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ec8bb087-3bb5-412c-affd-94af4fb35c00 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:45.919367 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-ec8bb087-3bb5-412c-affd-94af4fb35c00 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708e56110f59467784738c60b7649a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd432854df7394754a4a244b010a3efca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:39:45.927790 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ec8bb087-3bb5-412c-affd-94af4fb35c00 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] 10.222.0.33 "GET /compute/v2.1/servers/5f039dd4-0a7b-4be3-b281-3e615e5656e9" status: 200 len: 1513 microversion: 2.1 time: 0.153099 Oct 04 21:39:45.928377 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3410/6855] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:39:45 2022] GET /compute/v2.1/servers/5f039dd4-0a7b-4be3-b281-3e615e5656e9 => generated 1513 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:39:46.951625 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-e54dd54a-facd-449c-946d-6588c46cc6bf tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:39:46.952270 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-e54dd54a-facd-449c-946d-6588c46cc6bf tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] [instance: 5f039dd4-0a7b-4be3-b281-3e615e5656e9] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:39:46.959253 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e54dd54a-facd-449c-946d-6588c46cc6bf tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:46.959896 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e54dd54a-facd-449c-946d-6588c46cc6bf tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:46.960350 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e54dd54a-facd-449c-946d-6588c46cc6bf tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:46.961061 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e54dd54a-facd-449c-946d-6588c46cc6bf tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:46.961529 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e54dd54a-facd-449c-946d-6588c46cc6bf tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:46.961968 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e54dd54a-facd-449c-946d-6588c46cc6bf tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:47.092798 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-e54dd54a-facd-449c-946d-6588c46cc6bf tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708e56110f59467784738c60b7649a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd432854df7394754a4a244b010a3efca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:39:47.101213 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-e54dd54a-facd-449c-946d-6588c46cc6bf tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] 10.222.0.33 "GET /compute/v2.1/servers/5f039dd4-0a7b-4be3-b281-3e615e5656e9" status: 200 len: 1513 microversion: 2.1 time: 0.153836 Oct 04 21:39:47.101795 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3446/6856] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:39:46 2022] GET /compute/v2.1/servers/5f039dd4-0a7b-4be3-b281-3e615e5656e9 => generated 1513 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:39:47.757292 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-e5ffd742-c6eb-4f87-93b9-d3293cef2a5a req-e9cfcb15-b1c8-4265-b5d5-2dc6f3288ddf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f039dd4-0a7b-4be3-b281-3e615e5656e9", "name": "network-vif-deleted", "tag": "78cc2ee6-8356-4a4d-80ce-f341939aef68"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:39:47.767249 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-e5ffd742-c6eb-4f87-93b9-d3293cef2a5a req-e9cfcb15-b1c8-4265-b5d5-2dc6f3288ddf service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:47.767714 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-e5ffd742-c6eb-4f87-93b9-d3293cef2a5a req-e9cfcb15-b1c8-4265-b5d5-2dc6f3288ddf service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:47.768344 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-e5ffd742-c6eb-4f87-93b9-d3293cef2a5a req-e9cfcb15-b1c8-4265-b5d5-2dc6f3288ddf service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:47.781863 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-e5ffd742-c6eb-4f87-93b9-d3293cef2a5a req-e9cfcb15-b1c8-4265-b5d5-2dc6f3288ddf service nova] Creating event network-vif-deleted:78cc2ee6-8356-4a4d-80ce-f341939aef68 for instance 5f039dd4-0a7b-4be3-b281-3e615e5656e9 on n-h1-854823-8 Oct 04 21:39:47.787009 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-e5ffd742-c6eb-4f87-93b9-d3293cef2a5a req-e9cfcb15-b1c8-4265-b5d5-2dc6f3288ddf service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033600 Oct 04 21:39:47.788315 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3411/6857] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:39:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:39:48.126676 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-80717ec4-f12c-462a-93f4-391731640ab8 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:39:48.127263 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-80717ec4-f12c-462a-93f4-391731640ab8 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] [instance: 5f039dd4-0a7b-4be3-b281-3e615e5656e9] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:39:48.134485 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-80717ec4-f12c-462a-93f4-391731640ab8 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:48.134987 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-80717ec4-f12c-462a-93f4-391731640ab8 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:48.135429 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-80717ec4-f12c-462a-93f4-391731640ab8 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:48.136132 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-80717ec4-f12c-462a-93f4-391731640ab8 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:48.136596 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-80717ec4-f12c-462a-93f4-391731640ab8 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:48.137023 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-80717ec4-f12c-462a-93f4-391731640ab8 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:48.172281 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-80717ec4-f12c-462a-93f4-391731640ab8 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:48.172767 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-80717ec4-f12c-462a-93f4-391731640ab8 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:48.173212 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-80717ec4-f12c-462a-93f4-391731640ab8 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:48.173673 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.objects.instance [None req-80717ec4-f12c-462a-93f4-391731640ab8 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Lazy-loading 'fault' on Instance uuid 5f039dd4-0a7b-4be3-b281-3e615e5656e9 {{(pid=128802) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:39:48.220102 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-80717ec4-f12c-462a-93f4-391731640ab8 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708e56110f59467784738c60b7649a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd432854df7394754a4a244b010a3efca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:39:48.228609 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-80717ec4-f12c-462a-93f4-391731640ab8 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] 10.222.0.33 "GET /compute/v2.1/servers/5f039dd4-0a7b-4be3-b281-3e615e5656e9" status: 200 len: 1307 microversion: 2.1 time: 0.105991 Oct 04 21:39:48.229194 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3447/6858] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:39:48 2022] GET /compute/v2.1/servers/5f039dd4-0a7b-4be3-b281-3e615e5656e9 => generated 1307 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:39:49.254248 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1c7153e7-ba93-4a44-96af-760f788b9cf9 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:39:49.255014 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-1c7153e7-ba93-4a44-96af-760f788b9cf9 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] [instance: 5f039dd4-0a7b-4be3-b281-3e615e5656e9] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:39:49.261855 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1c7153e7-ba93-4a44-96af-760f788b9cf9 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:49.262362 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1c7153e7-ba93-4a44-96af-760f788b9cf9 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:49.262808 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1c7153e7-ba93-4a44-96af-760f788b9cf9 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:49.263509 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1c7153e7-ba93-4a44-96af-760f788b9cf9 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:49.263970 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1c7153e7-ba93-4a44-96af-760f788b9cf9 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:49.264397 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1c7153e7-ba93-4a44-96af-760f788b9cf9 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:49.278008 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-1c7153e7-ba93-4a44-96af-760f788b9cf9 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] HTTP exception thrown: Instance 5f039dd4-0a7b-4be3-b281-3e615e5656e9 could not be found. Oct 04 21:39:49.279613 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1c7153e7-ba93-4a44-96af-760f788b9cf9 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Request method failure captured: Oct 04 21:39:49.279613 n-d-854823-8 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/5f039dd4-0a7b-4be3-b281-3e615e5656e9 HTTP/1.1 Oct 04 21:39:49.279613 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 21:39:49.279613 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 21:39:49.279613 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 21:39:49.279613 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 0 Oct 04 21:39:49.279613 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 21:39:49.279613 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 21:39:49.279613 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 21:39:49.279613 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 21:39:49.279613 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPKgKiF_mM6-uBl15arYYxKDR4D70llOkTUI8S4dCJFs7UC6xhSTZHAUc-ubC2J1bTQsmXmKqhAo4oONDMu8c4m277vjBgVsMldLFg28Jy3IrQSRzqDc6jWiiVqZ3QmjH219m4cZjNcMPb9iGTWYQMhS3PYL1IevY5COjFv89jy1Jkcw Oct 04 21:39:49.279613 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 21:39:49.279613 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 21:39:49.279613 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 21:39:49.279613 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 21:39:49.279613 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 21:39:49.279613 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 21:39:49.279613 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: d432854df7394754a4a244b010a3efca Oct 04 21:39:49.279613 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-ServersNegativeTestJSON-888477082 Oct 04 21:39:49.279613 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 21:39:49.279613 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 21:39:49.279613 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d432854df7394754a4a244b010a3efca", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d432854df7394754a4a244b010a3efca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d432854df7394754a4a244b010a3efca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d432854df7394754a4a244b010a3efca"}]}] Oct 04 21:39:49.279613 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-ServersNegativeTestJSON-888477082 Oct 04 21:39:49.279613 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: d432854df7394754a4a244b010a3efca Oct 04 21:39:49.279613 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ServersNegativeTestJSON-888477082 Oct 04 21:39:49.279613 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-ServersNegativeTestJSON-888477082-project Oct 04 21:39:49.279613 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 21:39:49.279613 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 21:39:49.279613 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: 708e56110f59467784738c60b7649a00 Oct 04 21:39:49.279613 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-ServersNegativeTestJSON-888477082-project Oct 04 21:39:49.279613 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 21:39:49.279613 n-d-854823-8 devstack@n-api.service[128801]: exception: Instance 5f039dd4-0a7b-4be3-b281-3e615e5656e9 could not be found. Oct 04 21:39:49.279613 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': '5f039dd4-0a7b-4be3-b281-3e615e5656e9'} Oct 04 21:39:49.279613 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:39:49.279613 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:39:49.279613 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:39:49.279613 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:39:49.279613 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:39:49.279613 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:39:49.279613 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:39:49.279613 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:39:49.279613 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:39:49.279613 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:39:49.279613 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f039dd4-0a7b-4be3-b281-3e615e5656e9 could not be found. Oct 04 21:39:49.279613 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:39:49.279613 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:39:49.279613 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:39:49.279613 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:39:49.279613 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:39:49.279613 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:39:49.279613 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:39:49.279613 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:39:49.279613 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:39:49.279613 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:39:49.279613 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:39:49.279613 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:39:49.279613 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:39:49.279613 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:39:49.279613 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:39:49.279613 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:39:49.279613 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f039dd4-0a7b-4be3-b281-3e615e5656e9 could not be found. Oct 04 21:39:49.279613 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:39:49.279613 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:39:49.279613 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:39:49.286159 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:39:49.286159 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:39:49.286159 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:39:49.286159 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:39:49.286159 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:39:49.286159 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f039dd4-0a7b-4be3-b281-3e615e5656e9 could not be found. Oct 04 21:39:49.286159 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:39:49.286159 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1c7153e7-ba93-4a44-96af-760f788b9cf9 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Returning 404 to user: Instance 5f039dd4-0a7b-4be3-b281-3e615e5656e9 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:39:49.286159 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-1c7153e7-ba93-4a44-96af-760f788b9cf9 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] 10.222.0.33 "GET /compute/v2.1/servers/5f039dd4-0a7b-4be3-b281-3e615e5656e9" status: 404 len: 111 microversion: 2.1 time: 0.031999 Oct 04 21:39:49.286159 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3412/6859] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:39:49 2022] GET /compute/v2.1/servers/5f039dd4-0a7b-4be3-b281-3e615e5656e9 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:39:49.290899 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-b00bc299-70f6-4e20-bb9d-c0dd93c51da1 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:39:49.291521 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-b00bc299-70f6-4e20-bb9d-c0dd93c51da1 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] [instance: e93ba587-53a0-4a0d-a505-5e5b722169b8] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:39:49.298120 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b00bc299-70f6-4e20-bb9d-c0dd93c51da1 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:49.298635 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b00bc299-70f6-4e20-bb9d-c0dd93c51da1 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:49.299080 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b00bc299-70f6-4e20-bb9d-c0dd93c51da1 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:49.299776 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b00bc299-70f6-4e20-bb9d-c0dd93c51da1 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:49.300238 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b00bc299-70f6-4e20-bb9d-c0dd93c51da1 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:49.300670 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b00bc299-70f6-4e20-bb9d-c0dd93c51da1 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:49.435475 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-b00bc299-70f6-4e20-bb9d-c0dd93c51da1 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708e56110f59467784738c60b7649a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd432854df7394754a4a244b010a3efca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:39:49.443222 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-b00bc299-70f6-4e20-bb9d-c0dd93c51da1 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] 10.222.0.33 "GET /compute/v2.1/servers/e93ba587-53a0-4a0d-a505-5e5b722169b8" status: 200 len: 1505 microversion: 2.1 time: 0.156700 Oct 04 21:39:49.443971 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3448/6860] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:39:49 2022] GET /compute/v2.1/servers/e93ba587-53a0-4a0d-a505-5e5b722169b8 => generated 1505 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:39:49.465899 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0a8f8ad1-12c1-4450-9394-a6afcf060c5c tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "452"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:39:49.468217 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-0a8f8ad1-12c1-4450-9394-a6afcf060c5c tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] [instance: e6f848c1-f96c-4e7a-a86f-d233442890b2] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:39:49.473871 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-0a8f8ad1-12c1-4450-9394-a6afcf060c5c tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] HTTP exception thrown: Instance e6f848c1-f96c-4e7a-a86f-d233442890b2 could not be found. Oct 04 21:39:49.476084 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0a8f8ad1-12c1-4450-9394-a6afcf060c5c tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Request method failure captured: Oct 04 21:39:49.476084 n-d-854823-8 devstack@n-api.service[128801]: request: POST /compute/v2.1/servers/e6f848c1-f96c-4e7a-a86f-d233442890b2/action HTTP/1.1 Oct 04 21:39:49.476084 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 21:39:49.476084 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 21:39:49.476084 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 21:39:49.476084 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 32 Oct 04 21:39:49.476084 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 21:39:49.476084 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 21:39:49.476084 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 21:39:49.476084 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 21:39:49.476084 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPKgKiF_mM6-uBl15arYYxKDR4D70llOkTUI8S4dCJFs7UC6xhSTZHAUc-ubC2J1bTQsmXmKqhAo4oONDMu8c4m277vjBgVsMldLFg28Jy3IrQSRzqDc6jWiiVqZ3QmjH219m4cZjNcMPb9iGTWYQMhS3PYL1IevY5COjFv89jy1Jkcw Oct 04 21:39:49.476084 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 21:39:49.476084 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 21:39:49.476084 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 21:39:49.476084 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 21:39:49.476084 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 21:39:49.476084 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 21:39:49.476084 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: d432854df7394754a4a244b010a3efca Oct 04 21:39:49.476084 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-ServersNegativeTestJSON-888477082 Oct 04 21:39:49.476084 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 21:39:49.476084 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 21:39:49.476084 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d432854df7394754a4a244b010a3efca", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d432854df7394754a4a244b010a3efca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d432854df7394754a4a244b010a3efca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d432854df7394754a4a244b010a3efca"}]}] Oct 04 21:39:49.476084 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-ServersNegativeTestJSON-888477082 Oct 04 21:39:49.476084 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: d432854df7394754a4a244b010a3efca Oct 04 21:39:49.476084 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ServersNegativeTestJSON-888477082 Oct 04 21:39:49.476084 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-ServersNegativeTestJSON-888477082-project Oct 04 21:39:49.476084 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 21:39:49.476084 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 21:39:49.476084 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: 708e56110f59467784738c60b7649a00 Oct 04 21:39:49.476084 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-ServersNegativeTestJSON-888477082-project Oct 04 21:39:49.476084 n-d-854823-8 devstack@n-api.service[128801]: Oct 04 21:39:49.476084 n-d-854823-8 devstack@n-api.service[128801]: {"resize": {"flavorRef": "452"}} Oct 04 21:39:49.476084 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 21:39:49.476084 n-d-854823-8 devstack@n-api.service[128801]: exception: Instance e6f848c1-f96c-4e7a-a86f-d233442890b2 could not be found. Oct 04 21:39:49.476084 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': 'e6f848c1-f96c-4e7a-a86f-d233442890b2', 'body': {'resize': {'flavorRef': '452'}}} Oct 04 21:39:49.476084 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:39:49.476084 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:39:49.476084 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:39:49.476084 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:39:49.476084 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:39:49.476084 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:39:49.476084 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 21:39:49.476084 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 21:39:49.476084 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e6f848c1-f96c-4e7a-a86f-d233442890b2 could not be found. Oct 04 21:39:49.476084 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:39:49.476084 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:39:49.476084 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:39:49.476084 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:39:49.476084 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:39:49.476084 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:39:49.476084 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:39:49.476084 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:39:49.476084 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:39:49.476084 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:39:49.476084 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:39:49.476084 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:39:49.476084 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 04 21:39:49.476084 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 04 21:39:49.476084 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1046, in _resize Oct 04 21:39:49.476084 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_id, Oct 04 21:39:49.476084 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:39:49.476084 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:39:49.476084 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:39:49.476084 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:39:49.480561 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e6f848c1-f96c-4e7a-a86f-d233442890b2 could not be found. Oct 04 21:39:49.480561 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:39:49.480561 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:39:49.480561 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:39:49.480561 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:39:49.480561 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:39:49.480561 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:39:49.480561 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:39:49.480561 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:39:49.480561 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e6f848c1-f96c-4e7a-a86f-d233442890b2 could not be found. Oct 04 21:39:49.480561 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:39:49.480561 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0a8f8ad1-12c1-4450-9394-a6afcf060c5c tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Returning 404 to user: Instance e6f848c1-f96c-4e7a-a86f-d233442890b2 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:39:49.480561 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-0a8f8ad1-12c1-4450-9394-a6afcf060c5c tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] 10.222.0.33 "POST /compute/v2.1/servers/e6f848c1-f96c-4e7a-a86f-d233442890b2/action" status: 404 len: 111 microversion: 2.1 time: 0.015738 Oct 04 21:39:49.480561 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3413/6861] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 21:39:49 2022] POST /compute/v2.1/servers/e6f848c1-f96c-4e7a-a86f-d233442890b2/action => generated 111 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:39:49.486087 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-b71cbebb-81e7-42d4-9a34-52da57f4d258 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:39:49.486761 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-b71cbebb-81e7-42d4-9a34-52da57f4d258 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] [instance: e93ba587-53a0-4a0d-a505-5e5b722169b8] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:39:49.493624 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b71cbebb-81e7-42d4-9a34-52da57f4d258 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:49.494122 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b71cbebb-81e7-42d4-9a34-52da57f4d258 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:49.494594 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b71cbebb-81e7-42d4-9a34-52da57f4d258 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:49.495292 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b71cbebb-81e7-42d4-9a34-52da57f4d258 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:49.495782 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b71cbebb-81e7-42d4-9a34-52da57f4d258 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:49.496212 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b71cbebb-81e7-42d4-9a34-52da57f4d258 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:49.624771 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-b71cbebb-81e7-42d4-9a34-52da57f4d258 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708e56110f59467784738c60b7649a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd432854df7394754a4a244b010a3efca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:39:49.628307 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:39:49.633246 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-b71cbebb-81e7-42d4-9a34-52da57f4d258 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] 10.222.0.33 "GET /compute/v2.1/servers/e93ba587-53a0-4a0d-a505-5e5b722169b8" status: 200 len: 1505 microversion: 2.1 time: 0.150990 Oct 04 21:39:49.633823 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3449/6862] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:39:49 2022] GET /compute/v2.1/servers/e93ba587-53a0-4a0d-a505-5e5b722169b8 => generated 1505 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:39:49.657219 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0a105e6d-d69f-4525-b2bb-65b5c467fbd6 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:39:49.657856 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-0a105e6d-d69f-4525-b2bb-65b5c467fbd6 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] [instance: e93ba587-53a0-4a0d-a505-5e5b722169b8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:39:49.668730 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0a105e6d-d69f-4525-b2bb-65b5c467fbd6 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:49.669213 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0a105e6d-d69f-4525-b2bb-65b5c467fbd6 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:49.669684 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0a105e6d-d69f-4525-b2bb-65b5c467fbd6 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:49.670409 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0a105e6d-d69f-4525-b2bb-65b5c467fbd6 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:49.670873 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0a105e6d-d69f-4525-b2bb-65b5c467fbd6 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:49.671301 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0a105e6d-d69f-4525-b2bb-65b5c467fbd6 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:49.811026 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-0a105e6d-d69f-4525-b2bb-65b5c467fbd6 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708e56110f59467784738c60b7649a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd432854df7394754a4a244b010a3efca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:39:49.820792 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-0a105e6d-d69f-4525-b2bb-65b5c467fbd6 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] 10.222.0.33 "GET /compute/v2.1/servers/e93ba587-53a0-4a0d-a505-5e5b722169b8" status: 200 len: 1505 microversion: 2.1 time: 0.167568 Oct 04 21:39:49.821376 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3414/6863] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:39:49 2022] GET /compute/v2.1/servers/e93ba587-53a0-4a0d-a505-5e5b722169b8 => generated 1505 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:39:49.845002 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-8fa09a96-2dc1-4c23-9ae7-5ffe14fecdbd tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "867de7a1-b35b-4877-a006-f77c1e4422c1"}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:39:49.847228 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-8fa09a96-2dc1-4c23-9ae7-5ffe14fecdbd tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] [instance: e93ba587-53a0-4a0d-a505-5e5b722169b8] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:39:49.855111 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8fa09a96-2dc1-4c23-9ae7-5ffe14fecdbd tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:49.855617 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8fa09a96-2dc1-4c23-9ae7-5ffe14fecdbd tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:49.856069 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8fa09a96-2dc1-4c23-9ae7-5ffe14fecdbd tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:49.857102 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8fa09a96-2dc1-4c23-9ae7-5ffe14fecdbd tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:49.857526 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8fa09a96-2dc1-4c23-9ae7-5ffe14fecdbd tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:49.857785 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8fa09a96-2dc1-4c23-9ae7-5ffe14fecdbd tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:49.886597 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-8fa09a96-2dc1-4c23-9ae7-5ffe14fecdbd tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '708e56110f59467784738c60b7649a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd432854df7394754a4a244b010a3efca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:39:49.891333 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.wsgi [None req-8fa09a96-2dc1-4c23-9ae7-5ffe14fecdbd tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] HTTP exception thrown: Flavor 867de7a1-b35b-4877-a006-f77c1e4422c1 could not be found. Oct 04 21:39:49.893223 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-8fa09a96-2dc1-4c23-9ae7-5ffe14fecdbd tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Request method failure captured: Oct 04 21:39:49.893223 n-d-854823-8 devstack@n-api.service[128802]: request: POST /compute/v2.1/servers/e93ba587-53a0-4a0d-a505-5e5b722169b8/action HTTP/1.1 Oct 04 21:39:49.893223 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 21:39:49.893223 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 21:39:49.893223 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 21:39:49.893223 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 65 Oct 04 21:39:49.893223 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 21:39:49.893223 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 21:39:49.893223 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 21:39:49.893223 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 21:39:49.893223 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPKgKiF_mM6-uBl15arYYxKDR4D70llOkTUI8S4dCJFs7UC6xhSTZHAUc-ubC2J1bTQsmXmKqhAo4oONDMu8c4m277vjBgVsMldLFg28Jy3IrQSRzqDc6jWiiVqZ3QmjH219m4cZjNcMPb9iGTWYQMhS3PYL1IevY5COjFv89jy1Jkcw Oct 04 21:39:49.893223 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 21:39:49.893223 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 21:39:49.893223 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 21:39:49.893223 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 21:39:49.893223 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 21:39:49.893223 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 21:39:49.893223 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: d432854df7394754a4a244b010a3efca Oct 04 21:39:49.893223 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-ServersNegativeTestJSON-888477082 Oct 04 21:39:49.893223 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 21:39:49.893223 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 21:39:49.893223 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d432854df7394754a4a244b010a3efca", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d432854df7394754a4a244b010a3efca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d432854df7394754a4a244b010a3efca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d432854df7394754a4a244b010a3efca"}]}] Oct 04 21:39:49.893223 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-ServersNegativeTestJSON-888477082 Oct 04 21:39:49.893223 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: d432854df7394754a4a244b010a3efca Oct 04 21:39:49.893223 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-ServersNegativeTestJSON-888477082 Oct 04 21:39:49.893223 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-ServersNegativeTestJSON-888477082-project Oct 04 21:39:49.893223 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 21:39:49.893223 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 21:39:49.893223 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: 708e56110f59467784738c60b7649a00 Oct 04 21:39:49.893223 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-ServersNegativeTestJSON-888477082-project Oct 04 21:39:49.893223 n-d-854823-8 devstack@n-api.service[128802]: Oct 04 21:39:49.893223 n-d-854823-8 devstack@n-api.service[128802]: {"resize": {"flavorRef": "867de7a1-b35b-4877-a006-f77c1e4422c1"}} Oct 04 21:39:49.893223 n-d-854823-8 devstack@n-api.service[128802]: method: > Oct 04 21:39:49.893223 n-d-854823-8 devstack@n-api.service[128802]: exception: Flavor 867de7a1-b35b-4877-a006-f77c1e4422c1 could not be found. Oct 04 21:39:49.893223 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'id': 'e93ba587-53a0-4a0d-a505-5e5b722169b8', 'body': {'resize': {'flavorRef': '867de7a1-b35b-4877-a006-f77c1e4422c1'}}} Oct 04 21:39:49.893223 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:39:49.893223 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:39:49.893223 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Oct 04 21:39:49.893223 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Oct 04 21:39:49.893223 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 04 21:39:49.893223 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 21:39:49.893223 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 04 21:39:49.893223 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 04 21:39:49.893223 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 04 21:39:49.893223 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 04 21:39:49.893223 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 21:39:49.893223 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 21:39:49.893223 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 04 21:39:49.893223 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 04 21:39:49.893223 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Oct 04 21:39:49.893223 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 21:39:49.893223 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4200, in resize Oct 04 21:39:49.893223 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi new_flavor = flavors.get_flavor_by_flavor_id( Oct 04 21:39:49.893223 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 04 21:39:49.893223 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 04 21:39:49.893223 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 21:39:49.893223 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 21:39:49.893223 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 04 21:39:49.893223 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 04 21:39:49.893223 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 04 21:39:49.893223 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:39:49.893223 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 04 21:39:49.898886 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 04 21:39:49.898886 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 867de7a1-b35b-4877-a006-f77c1e4422c1 could not be found. Oct 04 21:39:49.898886 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:39:49.898886 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:39:49.898886 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:39:49.898886 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:39:49.898886 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:39:49.898886 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:39:49.898886 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:39:49.898886 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:39:49.898886 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:39:49.898886 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:39:49.898886 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 21:39:49.898886 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 21:39:49.898886 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 04 21:39:49.898886 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 04 21:39:49.898886 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1083, in _resize Oct 04 21:39:49.898886 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 04 21:39:49.898886 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 867de7a1-b35b-4877-a006-f77c1e4422c1 could not be found. Oct 04 21:39:49.898886 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:39:49.898886 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:39:49.898886 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:39:49.898886 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:39:49.898886 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:39:49.898886 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:39:49.898886 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:39:49.898886 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:39:49.898886 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 867de7a1-b35b-4877-a006-f77c1e4422c1 could not be found. Oct 04 21:39:49.898886 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:39:49.898886 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-8fa09a96-2dc1-4c23-9ae7-5ffe14fecdbd tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Returning 400 to user: Flavor 867de7a1-b35b-4877-a006-f77c1e4422c1 could not be found. {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:39:49.898886 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-8fa09a96-2dc1-4c23-9ae7-5ffe14fecdbd tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] 10.222.0.33 "POST /compute/v2.1/servers/e93ba587-53a0-4a0d-a505-5e5b722169b8/action" status: 400 len: 107 microversion: 2.1 time: 0.054053 Oct 04 21:39:49.898886 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3450/6864] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 21:39:49 2022] POST /compute/v2.1/servers/e93ba587-53a0-4a0d-a505-5e5b722169b8/action => generated 107 bytes in 55 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 21:39:49.904229 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-4e2660b9-66b8-49e1-a5d1-952ff9fb8755 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:39:49.904838 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-4e2660b9-66b8-49e1-a5d1-952ff9fb8755 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] [instance: e93ba587-53a0-4a0d-a505-5e5b722169b8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:39:49.910800 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4e2660b9-66b8-49e1-a5d1-952ff9fb8755 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:49.911302 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4e2660b9-66b8-49e1-a5d1-952ff9fb8755 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:49.911714 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4e2660b9-66b8-49e1-a5d1-952ff9fb8755 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:49.913023 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4e2660b9-66b8-49e1-a5d1-952ff9fb8755 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:49.913482 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4e2660b9-66b8-49e1-a5d1-952ff9fb8755 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:49.913899 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4e2660b9-66b8-49e1-a5d1-952ff9fb8755 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:50.048154 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-4e2660b9-66b8-49e1-a5d1-952ff9fb8755 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708e56110f59467784738c60b7649a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd432854df7394754a4a244b010a3efca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:39:50.056461 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-4e2660b9-66b8-49e1-a5d1-952ff9fb8755 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] 10.222.0.33 "GET /compute/v2.1/servers/e93ba587-53a0-4a0d-a505-5e5b722169b8" status: 200 len: 1505 microversion: 2.1 time: 0.156105 Oct 04 21:39:50.057036 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3415/6865] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:39:49 2022] GET /compute/v2.1/servers/e93ba587-53a0-4a0d-a505-5e5b722169b8 => generated 1505 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:39:50.080108 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-a0939b1f-19bb-46d3-980a-ecd2e220f37a tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:39:50.080727 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-a0939b1f-19bb-46d3-980a-ecd2e220f37a tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] [instance: e93ba587-53a0-4a0d-a505-5e5b722169b8] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:39:50.087410 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a0939b1f-19bb-46d3-980a-ecd2e220f37a tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:50.087914 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a0939b1f-19bb-46d3-980a-ecd2e220f37a tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:50.088363 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a0939b1f-19bb-46d3-980a-ecd2e220f37a tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:50.089076 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a0939b1f-19bb-46d3-980a-ecd2e220f37a tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:50.089551 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a0939b1f-19bb-46d3-980a-ecd2e220f37a tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:50.090019 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a0939b1f-19bb-46d3-980a-ecd2e220f37a tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:50.235848 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-a0939b1f-19bb-46d3-980a-ecd2e220f37a tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708e56110f59467784738c60b7649a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd432854df7394754a4a244b010a3efca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:39:50.243582 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-a0939b1f-19bb-46d3-980a-ecd2e220f37a tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] 10.222.0.33 "GET /compute/v2.1/servers/e93ba587-53a0-4a0d-a505-5e5b722169b8" status: 200 len: 1505 microversion: 2.1 time: 0.167317 Oct 04 21:39:50.244142 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3451/6866] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:39:50 2022] GET /compute/v2.1/servers/e93ba587-53a0-4a0d-a505-5e5b722169b8 => generated 1505 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:39:50.266397 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-4682463e-ff81-4d34-b92a-70caaba20214 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": ""}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:39:50.270040 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-4682463e-ff81-4d34-b92a-70caaba20214 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Request method failure captured: Oct 04 21:39:50.270040 n-d-854823-8 devstack@n-api.service[128801]: request: POST /compute/v2.1/servers/e93ba587-53a0-4a0d-a505-5e5b722169b8/action HTTP/1.1 Oct 04 21:39:50.270040 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 21:39:50.270040 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 21:39:50.270040 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 21:39:50.270040 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 29 Oct 04 21:39:50.270040 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 21:39:50.270040 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 21:39:50.270040 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 21:39:50.270040 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 21:39:50.270040 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPKgKiF_mM6-uBl15arYYxKDR4D70llOkTUI8S4dCJFs7UC6xhSTZHAUc-ubC2J1bTQsmXmKqhAo4oONDMu8c4m277vjBgVsMldLFg28Jy3IrQSRzqDc6jWiiVqZ3QmjH219m4cZjNcMPb9iGTWYQMhS3PYL1IevY5COjFv89jy1Jkcw Oct 04 21:39:50.270040 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 21:39:50.270040 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 21:39:50.270040 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 21:39:50.270040 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 21:39:50.270040 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 21:39:50.270040 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 21:39:50.270040 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: d432854df7394754a4a244b010a3efca Oct 04 21:39:50.270040 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-ServersNegativeTestJSON-888477082 Oct 04 21:39:50.270040 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 21:39:50.270040 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 21:39:50.270040 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d432854df7394754a4a244b010a3efca", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d432854df7394754a4a244b010a3efca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d432854df7394754a4a244b010a3efca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d432854df7394754a4a244b010a3efca"}]}] Oct 04 21:39:50.270040 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-ServersNegativeTestJSON-888477082 Oct 04 21:39:50.270040 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: d432854df7394754a4a244b010a3efca Oct 04 21:39:50.270040 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ServersNegativeTestJSON-888477082 Oct 04 21:39:50.270040 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-ServersNegativeTestJSON-888477082-project Oct 04 21:39:50.270040 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 21:39:50.270040 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 21:39:50.270040 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: 708e56110f59467784738c60b7649a00 Oct 04 21:39:50.270040 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-ServersNegativeTestJSON-888477082-project Oct 04 21:39:50.270040 n-d-854823-8 devstack@n-api.service[128801]: Oct 04 21:39:50.270040 n-d-854823-8 devstack@n-api.service[128801]: {"resize": {"flavorRef": ""}} Oct 04 21:39:50.270040 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 21:39:50.270040 n-d-854823-8 devstack@n-api.service[128801]: exception: Invalid input for field/attribute flavorRef. Value: . '' is too short Oct 04 21:39:50.270040 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': 'e93ba587-53a0-4a0d-a505-5e5b722169b8', 'body': {'resize': {'flavorRef': ''}}} Oct 04 21:39:50.270040 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:39:50.270040 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:39:50.270040 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 21:39:50.270040 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 21:39:50.270040 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 21:39:50.270040 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise error Oct 04 21:39:50.270040 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 04 21:39:50.270040 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:39:50.270040 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['resize']['properties']['flavorRef']: Oct 04 21:39:50.270040 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi {'minLength': 1, 'type': ['string', 'integer']} Oct 04 21:39:50.270040 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:39:50.270040 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi On instance['resize']: Oct 04 21:39:50.270040 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi '' Oct 04 21:39:50.270040 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:39:50.270040 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:39:50.270040 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:39:50.270040 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:39:50.270040 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:39:50.270040 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:39:50.270040 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:39:50.270040 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:39:50.270040 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:39:50.270040 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:39:50.270040 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 21:39:50.270040 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 21:39:50.270040 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 21:39:50.270040 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 21:39:50.270040 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 21:39:50.270040 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 21:39:50.270040 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute flavorRef. Value: . '' is too short Oct 04 21:39:50.270040 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:39:50.270040 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:39:50.275361 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:39:50.275361 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:39:50.275361 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:39:50.275361 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:39:50.275361 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 21:39:50.275361 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 21:39:50.275361 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute flavorRef. Value: . '' is too short Oct 04 21:39:50.275361 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:39:50.275361 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-4682463e-ff81-4d34-b92a-70caaba20214 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Returning 400 to user: Invalid input for field/attribute flavorRef. Value: . '' is too short {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:39:50.275361 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-4682463e-ff81-4d34-b92a-70caaba20214 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] 10.222.0.33 "POST /compute/v2.1/servers/e93ba587-53a0-4a0d-a505-5e5b722169b8/action" status: 400 len: 113 microversion: 2.1 time: 0.009097 Oct 04 21:39:50.275361 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3416/6867] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 21:39:50 2022] POST /compute/v2.1/servers/e93ba587-53a0-4a0d-a505-5e5b722169b8/action => generated 113 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 21:39:50.280970 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-0d8dd7ba-94dd-4f62-a0b9-af891767421f tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:39:50.281620 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-0d8dd7ba-94dd-4f62-a0b9-af891767421f tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] [instance: e93ba587-53a0-4a0d-a505-5e5b722169b8] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:39:50.287661 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0d8dd7ba-94dd-4f62-a0b9-af891767421f tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:50.288162 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0d8dd7ba-94dd-4f62-a0b9-af891767421f tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:50.288609 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0d8dd7ba-94dd-4f62-a0b9-af891767421f tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:50.289305 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0d8dd7ba-94dd-4f62-a0b9-af891767421f tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:50.289770 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0d8dd7ba-94dd-4f62-a0b9-af891767421f tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:50.290203 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0d8dd7ba-94dd-4f62-a0b9-af891767421f tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:50.421774 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-0d8dd7ba-94dd-4f62-a0b9-af891767421f tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708e56110f59467784738c60b7649a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd432854df7394754a4a244b010a3efca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:39:50.430716 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-0d8dd7ba-94dd-4f62-a0b9-af891767421f tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] 10.222.0.33 "GET /compute/v2.1/servers/e93ba587-53a0-4a0d-a505-5e5b722169b8" status: 200 len: 1505 microversion: 2.1 time: 0.153411 Oct 04 21:39:50.431228 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3452/6868] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:39:50 2022] GET /compute/v2.1/servers/e93ba587-53a0-4a0d-a505-5e5b722169b8 => generated 1505 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:39:50.459982 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9fa1eeb2-f31e-4fcd-ac9b-a299d3f8bf95 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:39:50.460502 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-9fa1eeb2-f31e-4fcd-ac9b-a299d3f8bf95 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] [instance: 5f039dd4-0a7b-4be3-b281-3e615e5656e9] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:39:50.468962 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9fa1eeb2-f31e-4fcd-ac9b-a299d3f8bf95 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:50.469671 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9fa1eeb2-f31e-4fcd-ac9b-a299d3f8bf95 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:50.470335 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9fa1eeb2-f31e-4fcd-ac9b-a299d3f8bf95 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:50.471291 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9fa1eeb2-f31e-4fcd-ac9b-a299d3f8bf95 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:50.471976 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9fa1eeb2-f31e-4fcd-ac9b-a299d3f8bf95 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:50.472425 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9fa1eeb2-f31e-4fcd-ac9b-a299d3f8bf95 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:50.488488 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-9fa1eeb2-f31e-4fcd-ac9b-a299d3f8bf95 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] HTTP exception thrown: Instance 5f039dd4-0a7b-4be3-b281-3e615e5656e9 could not be found. Oct 04 21:39:50.490049 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9fa1eeb2-f31e-4fcd-ac9b-a299d3f8bf95 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Request method failure captured: Oct 04 21:39:50.490049 n-d-854823-8 devstack@n-api.service[128801]: request: DELETE /compute/v2.1/servers/5f039dd4-0a7b-4be3-b281-3e615e5656e9 HTTP/1.1 Oct 04 21:39:50.490049 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 21:39:50.490049 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 21:39:50.490049 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 21:39:50.490049 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 0 Oct 04 21:39:50.490049 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 21:39:50.490049 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 21:39:50.490049 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 21:39:50.490049 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 21:39:50.490049 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPKgKiF_mM6-uBl15arYYxKDR4D70llOkTUI8S4dCJFs7UC6xhSTZHAUc-ubC2J1bTQsmXmKqhAo4oONDMu8c4m277vjBgVsMldLFg28Jy3IrQSRzqDc6jWiiVqZ3QmjH219m4cZjNcMPb9iGTWYQMhS3PYL1IevY5COjFv89jy1Jkcw Oct 04 21:39:50.490049 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 21:39:50.490049 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 21:39:50.490049 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 21:39:50.490049 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 21:39:50.490049 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 21:39:50.490049 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 21:39:50.490049 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: d432854df7394754a4a244b010a3efca Oct 04 21:39:50.490049 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-ServersNegativeTestJSON-888477082 Oct 04 21:39:50.490049 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 21:39:50.490049 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 21:39:50.490049 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d432854df7394754a4a244b010a3efca", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d432854df7394754a4a244b010a3efca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d432854df7394754a4a244b010a3efca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d432854df7394754a4a244b010a3efca"}]}] Oct 04 21:39:50.490049 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-ServersNegativeTestJSON-888477082 Oct 04 21:39:50.490049 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: d432854df7394754a4a244b010a3efca Oct 04 21:39:50.490049 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-ServersNegativeTestJSON-888477082 Oct 04 21:39:50.490049 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-ServersNegativeTestJSON-888477082-project Oct 04 21:39:50.490049 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 21:39:50.490049 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 21:39:50.490049 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: 708e56110f59467784738c60b7649a00 Oct 04 21:39:50.490049 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-ServersNegativeTestJSON-888477082-project Oct 04 21:39:50.490049 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 21:39:50.490049 n-d-854823-8 devstack@n-api.service[128801]: exception: Instance 5f039dd4-0a7b-4be3-b281-3e615e5656e9 could not be found. Oct 04 21:39:50.490049 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': '5f039dd4-0a7b-4be3-b281-3e615e5656e9'} Oct 04 21:39:50.490049 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:39:50.490049 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:39:50.490049 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:39:50.490049 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:39:50.490049 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:39:50.490049 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:39:50.490049 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:39:50.490049 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:39:50.490049 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:39:50.490049 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:39:50.490049 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f039dd4-0a7b-4be3-b281-3e615e5656e9 could not be found. Oct 04 21:39:50.490049 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:39:50.490049 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:39:50.490049 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:39:50.490049 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:39:50.490049 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:39:50.490049 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:39:50.490049 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:39:50.490049 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:39:50.490049 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:39:50.490049 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:39:50.490049 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 21:39:50.490049 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 21:39:50.490049 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 21:39:50.490049 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 21:39:50.490049 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:39:50.490049 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:39:50.490049 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:39:50.490049 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:39:50.497683 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f039dd4-0a7b-4be3-b281-3e615e5656e9 could not be found. Oct 04 21:39:50.497683 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:39:50.497683 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:39:50.497683 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:39:50.497683 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:39:50.497683 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:39:50.497683 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:39:50.497683 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:39:50.497683 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:39:50.497683 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f039dd4-0a7b-4be3-b281-3e615e5656e9 could not be found. Oct 04 21:39:50.497683 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:39:50.497683 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9fa1eeb2-f31e-4fcd-ac9b-a299d3f8bf95 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Returning 404 to user: Instance 5f039dd4-0a7b-4be3-b281-3e615e5656e9 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:39:50.497683 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-9fa1eeb2-f31e-4fcd-ac9b-a299d3f8bf95 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] 10.222.0.33 "DELETE /compute/v2.1/servers/5f039dd4-0a7b-4be3-b281-3e615e5656e9" status: 404 len: 111 microversion: 2.1 time: 0.038685 Oct 04 21:39:50.497683 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3417/6869] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 21:39:50 2022] DELETE /compute/v2.1/servers/5f039dd4-0a7b-4be3-b281-3e615e5656e9 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:39:50.502251 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-ad01025e-32aa-46aa-a72e-4ac8fbe4d613 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:39:50.502906 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-ad01025e-32aa-46aa-a72e-4ac8fbe4d613 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] [instance: 5f039dd4-0a7b-4be3-b281-3e615e5656e9] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:39:50.509600 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ad01025e-32aa-46aa-a72e-4ac8fbe4d613 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:50.510319 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ad01025e-32aa-46aa-a72e-4ac8fbe4d613 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:50.511540 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ad01025e-32aa-46aa-a72e-4ac8fbe4d613 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:50.511540 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ad01025e-32aa-46aa-a72e-4ac8fbe4d613 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:50.511971 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ad01025e-32aa-46aa-a72e-4ac8fbe4d613 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:50.512275 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ad01025e-32aa-46aa-a72e-4ac8fbe4d613 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:50.526676 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.wsgi [None req-ad01025e-32aa-46aa-a72e-4ac8fbe4d613 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] HTTP exception thrown: Instance 5f039dd4-0a7b-4be3-b281-3e615e5656e9 could not be found. Oct 04 21:39:50.528241 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-ad01025e-32aa-46aa-a72e-4ac8fbe4d613 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Request method failure captured: Oct 04 21:39:50.528241 n-d-854823-8 devstack@n-api.service[128802]: request: GET /compute/v2.1/servers/5f039dd4-0a7b-4be3-b281-3e615e5656e9 HTTP/1.1 Oct 04 21:39:50.528241 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 21:39:50.528241 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 21:39:50.528241 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 21:39:50.528241 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 0 Oct 04 21:39:50.528241 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 21:39:50.528241 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 21:39:50.528241 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 21:39:50.528241 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 21:39:50.528241 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPKgKiF_mM6-uBl15arYYxKDR4D70llOkTUI8S4dCJFs7UC6xhSTZHAUc-ubC2J1bTQsmXmKqhAo4oONDMu8c4m277vjBgVsMldLFg28Jy3IrQSRzqDc6jWiiVqZ3QmjH219m4cZjNcMPb9iGTWYQMhS3PYL1IevY5COjFv89jy1Jkcw Oct 04 21:39:50.528241 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 21:39:50.528241 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 21:39:50.528241 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 21:39:50.528241 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 21:39:50.528241 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 21:39:50.528241 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 21:39:50.528241 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: d432854df7394754a4a244b010a3efca Oct 04 21:39:50.528241 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-ServersNegativeTestJSON-888477082 Oct 04 21:39:50.528241 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 21:39:50.528241 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 21:39:50.528241 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d432854df7394754a4a244b010a3efca", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d432854df7394754a4a244b010a3efca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d432854df7394754a4a244b010a3efca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d432854df7394754a4a244b010a3efca"}]}] Oct 04 21:39:50.528241 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-ServersNegativeTestJSON-888477082 Oct 04 21:39:50.528241 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: d432854df7394754a4a244b010a3efca Oct 04 21:39:50.528241 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-ServersNegativeTestJSON-888477082 Oct 04 21:39:50.528241 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-ServersNegativeTestJSON-888477082-project Oct 04 21:39:50.528241 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 21:39:50.528241 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 21:39:50.528241 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: 708e56110f59467784738c60b7649a00 Oct 04 21:39:50.528241 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-ServersNegativeTestJSON-888477082-project Oct 04 21:39:50.528241 n-d-854823-8 devstack@n-api.service[128802]: method: > Oct 04 21:39:50.528241 n-d-854823-8 devstack@n-api.service[128802]: exception: Instance 5f039dd4-0a7b-4be3-b281-3e615e5656e9 could not be found. Oct 04 21:39:50.528241 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'id': '5f039dd4-0a7b-4be3-b281-3e615e5656e9'} Oct 04 21:39:50.528241 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:39:50.528241 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:39:50.528241 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:39:50.528241 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:39:50.528241 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:39:50.528241 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:39:50.528241 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:39:50.528241 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:39:50.528241 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:39:50.528241 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:39:50.528241 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f039dd4-0a7b-4be3-b281-3e615e5656e9 could not be found. Oct 04 21:39:50.528241 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:39:50.528241 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:39:50.528241 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:39:50.528241 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:39:50.528241 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:39:50.528241 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:39:50.528241 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:39:50.528241 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:39:50.528241 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:39:50.528241 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:39:50.528241 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:39:50.528241 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:39:50.528241 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:39:50.528241 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:39:50.528241 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:39:50.528241 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:39:50.528241 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f039dd4-0a7b-4be3-b281-3e615e5656e9 could not be found. Oct 04 21:39:50.528241 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:39:50.528241 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:39:50.528241 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:39:50.532789 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:39:50.532789 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:39:50.532789 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:39:50.532789 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:39:50.532789 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:39:50.532789 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f039dd4-0a7b-4be3-b281-3e615e5656e9 could not be found. Oct 04 21:39:50.532789 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:39:50.532789 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-ad01025e-32aa-46aa-a72e-4ac8fbe4d613 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Returning 404 to user: Instance 5f039dd4-0a7b-4be3-b281-3e615e5656e9 could not be found. {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:39:50.532789 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-ad01025e-32aa-46aa-a72e-4ac8fbe4d613 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] 10.222.0.33 "GET /compute/v2.1/servers/5f039dd4-0a7b-4be3-b281-3e615e5656e9" status: 404 len: 111 microversion: 2.1 time: 0.032452 Oct 04 21:39:50.532789 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3453/6870] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:39:50 2022] GET /compute/v2.1/servers/5f039dd4-0a7b-4be3-b281-3e615e5656e9 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:39:50.538939 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ff175b35-b4ca-4834-97a8-ca305a061880 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:39:50.539444 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ff175b35-b4ca-4834-97a8-ca305a061880 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] [instance: e93ba587-53a0-4a0d-a505-5e5b722169b8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:39:50.545770 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ff175b35-b4ca-4834-97a8-ca305a061880 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:50.546237 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ff175b35-b4ca-4834-97a8-ca305a061880 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:50.546733 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ff175b35-b4ca-4834-97a8-ca305a061880 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:50.547408 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ff175b35-b4ca-4834-97a8-ca305a061880 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:50.547862 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ff175b35-b4ca-4834-97a8-ca305a061880 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:50.548292 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ff175b35-b4ca-4834-97a8-ca305a061880 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:50.580692 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ff175b35-b4ca-4834-97a8-ca305a061880 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] [instance: e93ba587-53a0-4a0d-a505-5e5b722169b8] Going to try to terminate instance {{(pid=128801) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:39:50.637216 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:39:50.670683 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ff175b35-b4ca-4834-97a8-ca305a061880 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] 10.222.0.33 "DELETE /compute/v2.1/servers/e93ba587-53a0-4a0d-a505-5e5b722169b8" status: 204 len: 0 microversion: 2.1 time: 0.135583 Oct 04 21:39:50.671414 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3418/6871] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 21:39:50 2022] DELETE /compute/v2.1/servers/e93ba587-53a0-4a0d-a505-5e5b722169b8 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:39:50.681000 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-4bd8d368-ba1d-4ec6-8f75-8deb43b6ea2c tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:39:50.681551 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-4bd8d368-ba1d-4ec6-8f75-8deb43b6ea2c tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] [instance: e93ba587-53a0-4a0d-a505-5e5b722169b8] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:39:50.687581 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4bd8d368-ba1d-4ec6-8f75-8deb43b6ea2c tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:50.688129 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4bd8d368-ba1d-4ec6-8f75-8deb43b6ea2c tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:50.688582 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4bd8d368-ba1d-4ec6-8f75-8deb43b6ea2c tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:50.689281 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4bd8d368-ba1d-4ec6-8f75-8deb43b6ea2c tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:50.689753 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4bd8d368-ba1d-4ec6-8f75-8deb43b6ea2c tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:50.690177 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4bd8d368-ba1d-4ec6-8f75-8deb43b6ea2c tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:50.830688 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-4bd8d368-ba1d-4ec6-8f75-8deb43b6ea2c tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708e56110f59467784738c60b7649a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd432854df7394754a4a244b010a3efca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:39:50.838605 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-4bd8d368-ba1d-4ec6-8f75-8deb43b6ea2c tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] 10.222.0.33 "GET /compute/v2.1/servers/e93ba587-53a0-4a0d-a505-5e5b722169b8" status: 200 len: 1511 microversion: 2.1 time: 0.162415 Oct 04 21:39:50.839169 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3454/6872] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:39:50 2022] GET /compute/v2.1/servers/e93ba587-53a0-4a0d-a505-5e5b722169b8 => generated 1511 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:39:51.867576 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-38f9ddcd-b744-4e64-ace9-5a2c4701b888 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:39:51.868271 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-38f9ddcd-b744-4e64-ace9-5a2c4701b888 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] [instance: e93ba587-53a0-4a0d-a505-5e5b722169b8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:39:51.875101 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-38f9ddcd-b744-4e64-ace9-5a2c4701b888 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:51.875615 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-38f9ddcd-b744-4e64-ace9-5a2c4701b888 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:51.876044 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-38f9ddcd-b744-4e64-ace9-5a2c4701b888 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:51.876736 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-38f9ddcd-b744-4e64-ace9-5a2c4701b888 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:51.877185 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-38f9ddcd-b744-4e64-ace9-5a2c4701b888 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:51.877606 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-38f9ddcd-b744-4e64-ace9-5a2c4701b888 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:52.012782 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-38f9ddcd-b744-4e64-ace9-5a2c4701b888 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708e56110f59467784738c60b7649a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd432854df7394754a4a244b010a3efca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:39:52.020632 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-38f9ddcd-b744-4e64-ace9-5a2c4701b888 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] 10.222.0.33 "GET /compute/v2.1/servers/e93ba587-53a0-4a0d-a505-5e5b722169b8" status: 200 len: 1511 microversion: 2.1 time: 0.157979 Oct 04 21:39:52.021209 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3419/6873] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:39:51 2022] GET /compute/v2.1/servers/e93ba587-53a0-4a0d-a505-5e5b722169b8 => generated 1511 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:39:52.660091 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-63418900-cec1-4e29-9c17-0f4e42ef87df req-0cb0cadb-efb8-45a4-a597-f2f4afe90d74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e93ba587-53a0-4a0d-a505-5e5b722169b8", "name": "network-vif-deleted", "tag": "2b5a97e9-d55c-4e43-89d9-04c1a4eb745b"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:39:52.672165 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-63418900-cec1-4e29-9c17-0f4e42ef87df req-0cb0cadb-efb8-45a4-a597-f2f4afe90d74 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:52.672684 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-63418900-cec1-4e29-9c17-0f4e42ef87df req-0cb0cadb-efb8-45a4-a597-f2f4afe90d74 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:52.673119 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-63418900-cec1-4e29-9c17-0f4e42ef87df req-0cb0cadb-efb8-45a4-a597-f2f4afe90d74 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:52.687937 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-63418900-cec1-4e29-9c17-0f4e42ef87df req-0cb0cadb-efb8-45a4-a597-f2f4afe90d74 service nova] Creating event network-vif-deleted:2b5a97e9-d55c-4e43-89d9-04c1a4eb745b for instance e93ba587-53a0-4a0d-a505-5e5b722169b8 on n-h2-854823-8 Oct 04 21:39:52.694676 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-63418900-cec1-4e29-9c17-0f4e42ef87df req-0cb0cadb-efb8-45a4-a597-f2f4afe90d74 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037726 Oct 04 21:39:52.695369 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3455/6874] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:39:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:39:53.044309 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-19cf02ff-69c5-4796-b930-fc9f42c31f69 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:39:53.045157 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-19cf02ff-69c5-4796-b930-fc9f42c31f69 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] [instance: e93ba587-53a0-4a0d-a505-5e5b722169b8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:39:53.047330 n-d-854823-8 devstack@n-api.service[128801]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 21:39:53.047508 n-d-854823-8 devstack@n-api.service[128801]: Tue Oct 4 21:39:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e93ba587-53a0-4a0d-a505-5e5b722169b8 (ip 10.222.0.33) !!! Oct 04 21:39:53.057078 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-19cf02ff-69c5-4796-b930-fc9f42c31f69 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:53.057563 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-19cf02ff-69c5-4796-b930-fc9f42c31f69 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:53.057996 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-19cf02ff-69c5-4796-b930-fc9f42c31f69 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:53.058733 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-19cf02ff-69c5-4796-b930-fc9f42c31f69 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:53.059180 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-19cf02ff-69c5-4796-b930-fc9f42c31f69 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:53.059599 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-19cf02ff-69c5-4796-b930-fc9f42c31f69 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:53.096210 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-19cf02ff-69c5-4796-b930-fc9f42c31f69 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:53.096612 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-19cf02ff-69c5-4796-b930-fc9f42c31f69 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:53.097045 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-19cf02ff-69c5-4796-b930-fc9f42c31f69 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:53.097495 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-19cf02ff-69c5-4796-b930-fc9f42c31f69 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Lazy-loading 'fault' on Instance uuid e93ba587-53a0-4a0d-a505-5e5b722169b8 {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:39:53.144213 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-19cf02ff-69c5-4796-b930-fc9f42c31f69 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708e56110f59467784738c60b7649a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd432854df7394754a4a244b010a3efca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:39:53.154252 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-19cf02ff-69c5-4796-b930-fc9f42c31f69 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] 10.222.0.33 "GET /compute/v2.1/servers/e93ba587-53a0-4a0d-a505-5e5b722169b8" status: 200 len: 1306 microversion: 2.1 time: 0.113738 Oct 04 21:39:53.155072 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3420/6875] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:39:53 2022] GET /compute/v2.1/servers/e93ba587-53a0-4a0d-a505-5e5b722169b8 => generated 1306 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:39:54.182377 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-a2d30304-f4a6-4ecd-b680-5fb6130d7275 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:39:54.183099 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-a2d30304-f4a6-4ecd-b680-5fb6130d7275 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] [instance: e93ba587-53a0-4a0d-a505-5e5b722169b8] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:39:54.186618 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=1 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:39:54.192988 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a2d30304-f4a6-4ecd-b680-5fb6130d7275 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:54.194120 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a2d30304-f4a6-4ecd-b680-5fb6130d7275 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:54.194651 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a2d30304-f4a6-4ecd-b680-5fb6130d7275 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:54.195366 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a2d30304-f4a6-4ecd-b680-5fb6130d7275 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:39:54.195843 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a2d30304-f4a6-4ecd-b680-5fb6130d7275 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:39:54.196284 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a2d30304-f4a6-4ecd-b680-5fb6130d7275 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:39:54.210442 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.wsgi [None req-a2d30304-f4a6-4ecd-b680-5fb6130d7275 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] HTTP exception thrown: Instance e93ba587-53a0-4a0d-a505-5e5b722169b8 could not be found. Oct 04 21:39:54.212099 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-a2d30304-f4a6-4ecd-b680-5fb6130d7275 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Request method failure captured: Oct 04 21:39:54.212099 n-d-854823-8 devstack@n-api.service[128802]: request: GET /compute/v2.1/servers/e93ba587-53a0-4a0d-a505-5e5b722169b8 HTTP/1.1 Oct 04 21:39:54.212099 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 21:39:54.212099 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 21:39:54.212099 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 21:39:54.212099 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 0 Oct 04 21:39:54.212099 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 21:39:54.212099 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 21:39:54.212099 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 21:39:54.212099 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 21:39:54.212099 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPKgKiF_mM6-uBl15arYYxKDR4D70llOkTUI8S4dCJFs7UC6xhSTZHAUc-ubC2J1bTQsmXmKqhAo4oONDMu8c4m277vjBgVsMldLFg28Jy3IrQSRzqDc6jWiiVqZ3QmjH219m4cZjNcMPb9iGTWYQMhS3PYL1IevY5COjFv89jy1Jkcw Oct 04 21:39:54.212099 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 21:39:54.212099 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 21:39:54.212099 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 21:39:54.212099 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 21:39:54.212099 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 21:39:54.212099 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 21:39:54.212099 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: d432854df7394754a4a244b010a3efca Oct 04 21:39:54.212099 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-ServersNegativeTestJSON-888477082 Oct 04 21:39:54.212099 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 21:39:54.212099 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 21:39:54.212099 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d432854df7394754a4a244b010a3efca", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d432854df7394754a4a244b010a3efca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d432854df7394754a4a244b010a3efca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d432854df7394754a4a244b010a3efca"}]}] Oct 04 21:39:54.212099 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-ServersNegativeTestJSON-888477082 Oct 04 21:39:54.212099 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: d432854df7394754a4a244b010a3efca Oct 04 21:39:54.212099 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-ServersNegativeTestJSON-888477082 Oct 04 21:39:54.212099 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-ServersNegativeTestJSON-888477082-project Oct 04 21:39:54.212099 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 21:39:54.212099 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 21:39:54.212099 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: 708e56110f59467784738c60b7649a00 Oct 04 21:39:54.212099 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-ServersNegativeTestJSON-888477082-project Oct 04 21:39:54.212099 n-d-854823-8 devstack@n-api.service[128802]: method: > Oct 04 21:39:54.212099 n-d-854823-8 devstack@n-api.service[128802]: exception: Instance e93ba587-53a0-4a0d-a505-5e5b722169b8 could not be found. Oct 04 21:39:54.212099 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'id': 'e93ba587-53a0-4a0d-a505-5e5b722169b8'} Oct 04 21:39:54.212099 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:39:54.212099 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:39:54.212099 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:39:54.212099 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:39:54.212099 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:39:54.212099 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:39:54.212099 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:39:54.212099 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:39:54.212099 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:39:54.212099 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:39:54.212099 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e93ba587-53a0-4a0d-a505-5e5b722169b8 could not be found. Oct 04 21:39:54.212099 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:39:54.212099 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:39:54.212099 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:39:54.212099 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:39:54.212099 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:39:54.212099 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:39:54.212099 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:39:54.212099 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:39:54.212099 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:39:54.212099 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:39:54.212099 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:39:54.212099 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:39:54.212099 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:39:54.212099 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:39:54.212099 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:39:54.212099 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:39:54.212099 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e93ba587-53a0-4a0d-a505-5e5b722169b8 could not be found. Oct 04 21:39:54.212099 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:39:54.212099 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:39:54.212099 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:39:54.216615 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:39:54.216615 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:39:54.216615 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:39:54.216615 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:39:54.216615 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:39:54.216615 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e93ba587-53a0-4a0d-a505-5e5b722169b8 could not be found. Oct 04 21:39:54.216615 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:39:54.216615 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-a2d30304-f4a6-4ecd-b680-5fb6130d7275 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] Returning 404 to user: Instance e93ba587-53a0-4a0d-a505-5e5b722169b8 could not be found. {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:39:54.216615 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-a2d30304-f4a6-4ecd-b680-5fb6130d7275 tempest-ServersNegativeTestJSON-888477082 tempest-ServersNegativeTestJSON-888477082-project] 10.222.0.33 "GET /compute/v2.1/servers/e93ba587-53a0-4a0d-a505-5e5b722169b8" status: 404 len: 111 microversion: 2.1 time: 0.036047 Oct 04 21:39:54.216615 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3456/6876] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:39:54 2022] GET /compute/v2.1/servers/e93ba587-53a0-4a0d-a505-5e5b722169b8 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:40:26.252944 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:40:26.254188 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=15,nova_cell1:INSERT=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:40:26.502019 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c857aa69-b5e1-483b-9f2e-e4d9dba9a7d4 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Action: 'create', calling method: .version_select at 0x7f3c74987e50>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-654163765", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNfDuCIIvy/qRqDfhxUkzzK9jzg+X9Wo59k/TJrzVrJ4l3qE3LVvABCRx1K36479xeHgdRbLU4r5x0Wv60mwuKlbQJILQj3vAE5Ex9VmoSpASnYglGtJQk0SkbK51GS27w=="}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:40:26.526729 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-c857aa69-b5e1-483b-9f2e-e4d9dba9a7d4 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Getting quotas for project a525f5d98a42453897757db171c263c0. Resources: {'key_pairs'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:40:26.532762 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-c857aa69-b5e1-483b-9f2e-e4d9dba9a7d4 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Getting quotas for user 408632237e174b91939b442954fef918 and project a525f5d98a42453897757db171c263c0. Resources: {'key_pairs'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:40:26.568406 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c857aa69-b5e1-483b-9f2e-e4d9dba9a7d4 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.319820 Oct 04 21:40:26.570442 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3421/6877] 10.222.0.33 () {60 vars in 1159 bytes} [Tue Oct 4 21:40:26 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:40:26.623436 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-e2b9aa6c-46bb-46bc-9fb6-a5c85d72cd8f tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-616232255", "imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-654163765", "networks": [{"uuid": "e904ca70-ebac-4660-a6aa-4662f47bc90b"}]}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:40:26.632947 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_api:SELECT=1 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:40:26.633617 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=28 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:40:26.686098 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.network.neutron [None req-e2b9aa6c-46bb-46bc-9fb6-a5c85d72cd8f tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] validate_networks() for [('e904ca70-ebac-4660-a6aa-4662f47bc90b', None, None, None, None, None)] {{(pid=128802) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:40:27.198246 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-e2b9aa6c-46bb-46bc-9fb6-a5c85d72cd8f tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Flavor limits 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:40:27.198746 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-e2b9aa6c-46bb-46bc-9fb6-a5c85d72cd8f tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Image limits 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:40:27.199219 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-e2b9aa6c-46bb-46bc-9fb6-a5c85d72cd8f tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Flavor pref 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:40:27.199667 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-e2b9aa6c-46bb-46bc-9fb6-a5c85d72cd8f tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Image pref 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:40:27.200098 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-e2b9aa6c-46bb-46bc-9fb6-a5c85d72cd8f tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:40:27.209892 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e2b9aa6c-46bb-46bc-9fb6-a5c85d72cd8f tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:27.210449 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e2b9aa6c-46bb-46bc-9fb6-a5c85d72cd8f tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:27.210908 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e2b9aa6c-46bb-46bc-9fb6-a5c85d72cd8f tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:27.211693 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e2b9aa6c-46bb-46bc-9fb6-a5c85d72cd8f tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:27.213179 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e2b9aa6c-46bb-46bc-9fb6-a5c85d72cd8f tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:27.213179 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e2b9aa6c-46bb-46bc-9fb6-a5c85d72cd8f tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:27.231169 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-e2b9aa6c-46bb-46bc-9fb6-a5c85d72cd8f tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Getting quotas for project a525f5d98a42453897757db171c263c0. Resources: {'ram', 'instances', 'cores'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:40:27.237158 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-e2b9aa6c-46bb-46bc-9fb6-a5c85d72cd8f tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Getting quotas for user 408632237e174b91939b442954fef918 and project a525f5d98a42453897757db171c263c0. Resources: {'ram', 'instances', 'cores'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:40:27.251565 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-e2b9aa6c-46bb-46bc-9fb6-a5c85d72cd8f tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Going to run 1 instances... {{(pid=128802) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:40:27.253924 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-e2b9aa6c-46bb-46bc-9fb6-a5c85d72cd8f tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] [instance: 746dc58a-d4c1-4132-80d9-5ace67ce3b2c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='15b24725-0c99-4bcf-b1fb-907cdf8e2d63',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128802) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:40:27.305402 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-e2b9aa6c-46bb-46bc-9fb6-a5c85d72cd8f tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.685790 Oct 04 21:40:27.306264 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3457/6878] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 21:40:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 687 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:40:27.317066 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-fa6abb35-012d-4055-8fb1-1fef4f1c41e9 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:40:27.318624 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-fa6abb35-012d-4055-8fb1-1fef4f1c41e9 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] [instance: 746dc58a-d4c1-4132-80d9-5ace67ce3b2c] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:40:27.373220 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-fa6abb35-012d-4055-8fb1-1fef4f1c41e9 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '408632237e174b91939b442954fef918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a525f5d98a42453897757db171c263c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:40:27.382853 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-fa6abb35-012d-4055-8fb1-1fef4f1c41e9 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] 10.222.0.33 "GET /compute/v2.1/servers/746dc58a-d4c1-4132-80d9-5ace67ce3b2c" status: 200 len: 1261 microversion: 2.1 time: 0.069264 Oct 04 21:40:27.383598 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3422/6879] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:40:27 2022] GET /compute/v2.1/servers/746dc58a-d4c1-4132-80d9-5ace67ce3b2c => generated 1261 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:40:28.406963 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-b1b0262a-bdf8-485c-b283-468c69fb74dd tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:40:28.407622 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-b1b0262a-bdf8-485c-b283-468c69fb74dd tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] [instance: 746dc58a-d4c1-4132-80d9-5ace67ce3b2c] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:40:28.415200 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b1b0262a-bdf8-485c-b283-468c69fb74dd tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:28.415699 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b1b0262a-bdf8-485c-b283-468c69fb74dd tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:28.416145 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b1b0262a-bdf8-485c-b283-468c69fb74dd tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:28.416854 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b1b0262a-bdf8-485c-b283-468c69fb74dd tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:28.417316 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b1b0262a-bdf8-485c-b283-468c69fb74dd tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:28.417752 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b1b0262a-bdf8-485c-b283-468c69fb74dd tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:28.534689 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-b1b0262a-bdf8-485c-b283-468c69fb74dd tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '408632237e174b91939b442954fef918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a525f5d98a42453897757db171c263c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:40:28.544581 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-b1b0262a-bdf8-485c-b283-468c69fb74dd tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] 10.222.0.33 "GET /compute/v2.1/servers/746dc58a-d4c1-4132-80d9-5ace67ce3b2c" status: 200 len: 1321 microversion: 2.1 time: 0.142611 Oct 04 21:40:28.559333 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3458/6880] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:40:28 2022] GET /compute/v2.1/servers/746dc58a-d4c1-4132-80d9-5ace67ce3b2c => generated 1321 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:40:29.578663 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8aa2b1a5-50d6-4de1-a855-a89811a0c526 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:40:29.580196 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-8aa2b1a5-50d6-4de1-a855-a89811a0c526 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] [instance: 746dc58a-d4c1-4132-80d9-5ace67ce3b2c] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:40:29.592485 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8aa2b1a5-50d6-4de1-a855-a89811a0c526 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:29.593091 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8aa2b1a5-50d6-4de1-a855-a89811a0c526 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:29.593601 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8aa2b1a5-50d6-4de1-a855-a89811a0c526 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:29.594460 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8aa2b1a5-50d6-4de1-a855-a89811a0c526 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:29.594984 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8aa2b1a5-50d6-4de1-a855-a89811a0c526 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:29.595654 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8aa2b1a5-50d6-4de1-a855-a89811a0c526 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:29.835871 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-8aa2b1a5-50d6-4de1-a855-a89811a0c526 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '408632237e174b91939b442954fef918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a525f5d98a42453897757db171c263c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:40:29.843933 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-8aa2b1a5-50d6-4de1-a855-a89811a0c526 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] 10.222.0.33 "GET /compute/v2.1/servers/746dc58a-d4c1-4132-80d9-5ace67ce3b2c" status: 200 len: 1361 microversion: 2.1 time: 0.277320 Oct 04 21:40:29.844529 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3423/6881] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:40:29 2022] GET /compute/v2.1/servers/746dc58a-d4c1-4132-80d9-5ace67ce3b2c => generated 1361 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:40:30.514871 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-75d527cd-0e14-4d00-a7e6-271c8f4a87a3 req-274e5dc7-93a9-4342-9d5f-0d12e59b2083 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "746dc58a-d4c1-4132-80d9-5ace67ce3b2c", "tag": "fe7a6bf6-4dce-4635-94fb-22956a796e5e"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:40:30.528697 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-75d527cd-0e14-4d00-a7e6-271c8f4a87a3 req-274e5dc7-93a9-4342-9d5f-0d12e59b2083 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:30.529167 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-75d527cd-0e14-4d00-a7e6-271c8f4a87a3 req-274e5dc7-93a9-4342-9d5f-0d12e59b2083 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:30.529593 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-75d527cd-0e14-4d00-a7e6-271c8f4a87a3 req-274e5dc7-93a9-4342-9d5f-0d12e59b2083 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:30.544924 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-75d527cd-0e14-4d00-a7e6-271c8f4a87a3 req-274e5dc7-93a9-4342-9d5f-0d12e59b2083 service nova] Creating event network-changed:fe7a6bf6-4dce-4635-94fb-22956a796e5e for instance 746dc58a-d4c1-4132-80d9-5ace67ce3b2c on n-h2-854823-8 Oct 04 21:40:30.552505 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-75d527cd-0e14-4d00-a7e6-271c8f4a87a3 req-274e5dc7-93a9-4342-9d5f-0d12e59b2083 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042112 Oct 04 21:40:30.553820 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3459/6882] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:40:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:40:30.869500 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0bd6002a-fcc8-4a7b-a9b6-9934a1d538cf tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:40:30.870108 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-0bd6002a-fcc8-4a7b-a9b6-9934a1d538cf tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] [instance: 746dc58a-d4c1-4132-80d9-5ace67ce3b2c] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:40:30.877021 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0bd6002a-fcc8-4a7b-a9b6-9934a1d538cf tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:30.877508 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0bd6002a-fcc8-4a7b-a9b6-9934a1d538cf tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:30.877935 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0bd6002a-fcc8-4a7b-a9b6-9934a1d538cf tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:30.878667 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0bd6002a-fcc8-4a7b-a9b6-9934a1d538cf tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:30.879120 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0bd6002a-fcc8-4a7b-a9b6-9934a1d538cf tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:30.879538 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0bd6002a-fcc8-4a7b-a9b6-9934a1d538cf tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:31.039205 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-0bd6002a-fcc8-4a7b-a9b6-9934a1d538cf tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '408632237e174b91939b442954fef918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a525f5d98a42453897757db171c263c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:40:31.047056 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-0bd6002a-fcc8-4a7b-a9b6-9934a1d538cf tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] 10.222.0.33 "GET /compute/v2.1/servers/746dc58a-d4c1-4132-80d9-5ace67ce3b2c" status: 200 len: 1361 microversion: 2.1 time: 0.182374 Oct 04 21:40:31.047635 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3424/6883] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:40:30 2022] GET /compute/v2.1/servers/746dc58a-d4c1-4132-80d9-5ace67ce3b2c => generated 1361 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:40:32.072773 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-76378acb-bf04-41ca-b82d-632947b38c28 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:40:32.073510 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-76378acb-bf04-41ca-b82d-632947b38c28 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] [instance: 746dc58a-d4c1-4132-80d9-5ace67ce3b2c] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:40:32.080868 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-76378acb-bf04-41ca-b82d-632947b38c28 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:32.081375 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-76378acb-bf04-41ca-b82d-632947b38c28 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:32.081818 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-76378acb-bf04-41ca-b82d-632947b38c28 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:32.082914 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-76378acb-bf04-41ca-b82d-632947b38c28 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:32.083303 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-76378acb-bf04-41ca-b82d-632947b38c28 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:32.083780 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-76378acb-bf04-41ca-b82d-632947b38c28 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:32.323996 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-76378acb-bf04-41ca-b82d-632947b38c28 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '408632237e174b91939b442954fef918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a525f5d98a42453897757db171c263c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:40:32.334216 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-76378acb-bf04-41ca-b82d-632947b38c28 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] 10.222.0.33 "GET /compute/v2.1/servers/746dc58a-d4c1-4132-80d9-5ace67ce3b2c" status: 200 len: 1361 microversion: 2.1 time: 0.265994 Oct 04 21:40:32.334847 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3460/6884] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:40:32 2022] GET /compute/v2.1/servers/746dc58a-d4c1-4132-80d9-5ace67ce3b2c => generated 1361 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:40:33.357660 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-49257fa8-8574-4e2d-a548-0dcfea9fc6d1 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:40:33.358322 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-49257fa8-8574-4e2d-a548-0dcfea9fc6d1 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] [instance: 746dc58a-d4c1-4132-80d9-5ace67ce3b2c] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:40:33.365696 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-49257fa8-8574-4e2d-a548-0dcfea9fc6d1 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:33.366225 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-49257fa8-8574-4e2d-a548-0dcfea9fc6d1 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:33.366727 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-49257fa8-8574-4e2d-a548-0dcfea9fc6d1 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:33.367466 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-49257fa8-8574-4e2d-a548-0dcfea9fc6d1 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:33.367967 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-49257fa8-8574-4e2d-a548-0dcfea9fc6d1 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:33.368394 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-49257fa8-8574-4e2d-a548-0dcfea9fc6d1 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:33.506777 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-49257fa8-8574-4e2d-a548-0dcfea9fc6d1 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '408632237e174b91939b442954fef918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a525f5d98a42453897757db171c263c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:40:33.514569 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-49257fa8-8574-4e2d-a548-0dcfea9fc6d1 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] 10.222.0.33 "GET /compute/v2.1/servers/746dc58a-d4c1-4132-80d9-5ace67ce3b2c" status: 200 len: 1361 microversion: 2.1 time: 0.161229 Oct 04 21:40:33.515156 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3425/6885] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:40:33 2022] GET /compute/v2.1/servers/746dc58a-d4c1-4132-80d9-5ace67ce3b2c => generated 1361 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:40:34.537623 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-61a6526e-22c2-4331-b36c-4b1af87af791 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:40:34.538403 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-61a6526e-22c2-4331-b36c-4b1af87af791 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] [instance: 746dc58a-d4c1-4132-80d9-5ace67ce3b2c] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:40:34.545221 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-61a6526e-22c2-4331-b36c-4b1af87af791 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:34.545722 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-61a6526e-22c2-4331-b36c-4b1af87af791 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:34.546172 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-61a6526e-22c2-4331-b36c-4b1af87af791 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:34.546921 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-61a6526e-22c2-4331-b36c-4b1af87af791 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:34.547388 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-61a6526e-22c2-4331-b36c-4b1af87af791 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:34.547828 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-61a6526e-22c2-4331-b36c-4b1af87af791 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:34.681976 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-61a6526e-22c2-4331-b36c-4b1af87af791 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '408632237e174b91939b442954fef918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a525f5d98a42453897757db171c263c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:40:34.690109 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-61a6526e-22c2-4331-b36c-4b1af87af791 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] 10.222.0.33 "GET /compute/v2.1/servers/746dc58a-d4c1-4132-80d9-5ace67ce3b2c" status: 200 len: 1361 microversion: 2.1 time: 0.156796 Oct 04 21:40:34.690742 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3461/6886] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:40:34 2022] GET /compute/v2.1/servers/746dc58a-d4c1-4132-80d9-5ace67ce3b2c => generated 1361 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:40:35.713766 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9e614ab3-ed52-474d-b0c9-35ea7f0abd1b tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:40:35.714398 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-9e614ab3-ed52-474d-b0c9-35ea7f0abd1b tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] [instance: 746dc58a-d4c1-4132-80d9-5ace67ce3b2c] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:40:35.721306 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9e614ab3-ed52-474d-b0c9-35ea7f0abd1b tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:35.721787 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9e614ab3-ed52-474d-b0c9-35ea7f0abd1b tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:35.722215 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9e614ab3-ed52-474d-b0c9-35ea7f0abd1b tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:35.722935 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9e614ab3-ed52-474d-b0c9-35ea7f0abd1b tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:35.723383 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9e614ab3-ed52-474d-b0c9-35ea7f0abd1b tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:35.723852 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9e614ab3-ed52-474d-b0c9-35ea7f0abd1b tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:35.864670 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-9e614ab3-ed52-474d-b0c9-35ea7f0abd1b tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '408632237e174b91939b442954fef918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a525f5d98a42453897757db171c263c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:40:35.872830 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-9e614ab3-ed52-474d-b0c9-35ea7f0abd1b tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] 10.222.0.33 "GET /compute/v2.1/servers/746dc58a-d4c1-4132-80d9-5ace67ce3b2c" status: 200 len: 1361 microversion: 2.1 time: 0.162970 Oct 04 21:40:35.873451 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3426/6887] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:40:35 2022] GET /compute/v2.1/servers/746dc58a-d4c1-4132-80d9-5ace67ce3b2c => generated 1361 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:40:36.042902 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-1cbdf4b0-235c-4f19-94d9-c364162428da req-4d7a68a0-4063-4eb9-b034-e5f01bf1e452 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "746dc58a-d4c1-4132-80d9-5ace67ce3b2c", "name": "network-vif-plugged", "status": "completed", "tag": "fe7a6bf6-4dce-4635-94fb-22956a796e5e"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:40:36.055208 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-1cbdf4b0-235c-4f19-94d9-c364162428da req-4d7a68a0-4063-4eb9-b034-e5f01bf1e452 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:36.055651 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-1cbdf4b0-235c-4f19-94d9-c364162428da req-4d7a68a0-4063-4eb9-b034-e5f01bf1e452 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:36.056112 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-1cbdf4b0-235c-4f19-94d9-c364162428da req-4d7a68a0-4063-4eb9-b034-e5f01bf1e452 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:36.068299 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-1cbdf4b0-235c-4f19-94d9-c364162428da req-4d7a68a0-4063-4eb9-b034-e5f01bf1e452 service nova] Creating event network-vif-plugged:fe7a6bf6-4dce-4635-94fb-22956a796e5e for instance 746dc58a-d4c1-4132-80d9-5ace67ce3b2c on n-h2-854823-8 Oct 04 21:40:36.073836 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-1cbdf4b0-235c-4f19-94d9-c364162428da req-4d7a68a0-4063-4eb9-b034-e5f01bf1e452 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034701 Oct 04 21:40:36.074802 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3462/6888] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:40:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:40:36.898461 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5a9a9ae6-7aae-4fbb-b778-3a54ecd81ae0 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:40:36.899007 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-5a9a9ae6-7aae-4fbb-b778-3a54ecd81ae0 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] [instance: 746dc58a-d4c1-4132-80d9-5ace67ce3b2c] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:40:36.906182 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5a9a9ae6-7aae-4fbb-b778-3a54ecd81ae0 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:36.906621 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5a9a9ae6-7aae-4fbb-b778-3a54ecd81ae0 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:36.907145 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5a9a9ae6-7aae-4fbb-b778-3a54ecd81ae0 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:36.907936 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5a9a9ae6-7aae-4fbb-b778-3a54ecd81ae0 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:36.908392 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5a9a9ae6-7aae-4fbb-b778-3a54ecd81ae0 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:36.908880 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5a9a9ae6-7aae-4fbb-b778-3a54ecd81ae0 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:37.041049 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-5a9a9ae6-7aae-4fbb-b778-3a54ecd81ae0 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '408632237e174b91939b442954fef918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a525f5d98a42453897757db171c263c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:40:37.049095 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5a9a9ae6-7aae-4fbb-b778-3a54ecd81ae0 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] 10.222.0.33 "GET /compute/v2.1/servers/746dc58a-d4c1-4132-80d9-5ace67ce3b2c" status: 200 len: 1361 microversion: 2.1 time: 0.155513 Oct 04 21:40:37.049671 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3427/6889] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:40:36 2022] GET /compute/v2.1/servers/746dc58a-d4c1-4132-80d9-5ace67ce3b2c => generated 1361 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:40:38.072241 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell0:SELECT=2 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:40:38.073035 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell0:SELECT=6 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:40:38.077083 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-40c38807-96d3-4b31-be5c-3ecf8046ee52 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:40:38.077824 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-40c38807-96d3-4b31-be5c-3ecf8046ee52 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] [instance: 746dc58a-d4c1-4132-80d9-5ace67ce3b2c] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:40:38.085362 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-40c38807-96d3-4b31-be5c-3ecf8046ee52 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:38.085857 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-40c38807-96d3-4b31-be5c-3ecf8046ee52 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:38.086308 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-40c38807-96d3-4b31-be5c-3ecf8046ee52 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:38.087044 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-40c38807-96d3-4b31-be5c-3ecf8046ee52 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:38.087511 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-40c38807-96d3-4b31-be5c-3ecf8046ee52 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:38.088011 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-40c38807-96d3-4b31-be5c-3ecf8046ee52 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:38.226427 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-40c38807-96d3-4b31-be5c-3ecf8046ee52 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '408632237e174b91939b442954fef918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a525f5d98a42453897757db171c263c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:40:38.234274 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-40c38807-96d3-4b31-be5c-3ecf8046ee52 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] 10.222.0.33 "GET /compute/v2.1/servers/746dc58a-d4c1-4132-80d9-5ace67ce3b2c" status: 200 len: 1552 microversion: 2.1 time: 0.163875 Oct 04 21:40:38.234880 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3463/6890] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:40:38 2022] GET /compute/v2.1/servers/746dc58a-d4c1-4132-80d9-5ace67ce3b2c => generated 1552 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:40:38.257611 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ec66e4d1-f507-4a2e-a0ae-5ae7babfc7bb tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:40:38.258246 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ec66e4d1-f507-4a2e-a0ae-5ae7babfc7bb tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] [instance: 746dc58a-d4c1-4132-80d9-5ace67ce3b2c] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:40:38.260140 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=6 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:40:38.266133 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ec66e4d1-f507-4a2e-a0ae-5ae7babfc7bb tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:38.266634 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ec66e4d1-f507-4a2e-a0ae-5ae7babfc7bb tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:38.267068 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ec66e4d1-f507-4a2e-a0ae-5ae7babfc7bb tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:38.267754 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ec66e4d1-f507-4a2e-a0ae-5ae7babfc7bb tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:38.268203 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ec66e4d1-f507-4a2e-a0ae-5ae7babfc7bb tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:38.268622 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ec66e4d1-f507-4a2e-a0ae-5ae7babfc7bb tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:38.404942 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-ec66e4d1-f507-4a2e-a0ae-5ae7babfc7bb tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '408632237e174b91939b442954fef918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a525f5d98a42453897757db171c263c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:40:38.413999 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ec66e4d1-f507-4a2e-a0ae-5ae7babfc7bb tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] 10.222.0.33 "GET /compute/v2.1/servers/746dc58a-d4c1-4132-80d9-5ace67ce3b2c" status: 200 len: 1552 microversion: 2.1 time: 0.160611 Oct 04 21:40:38.414617 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3428/6891] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:40:38 2022] GET /compute/v2.1/servers/746dc58a-d4c1-4132-80d9-5ace67ce3b2c => generated 1552 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:40:40.109124 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-6480a2a7-7b1a-4558-8ad3-b0961bb1eb94 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e0782594-7769-4c9a-b115-6febf2680580"}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:40:40.111664 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-6480a2a7-7b1a-4558-8ad3-b0961bb1eb94 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] [instance: 746dc58a-d4c1-4132-80d9-5ace67ce3b2c] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:40:40.119532 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6480a2a7-7b1a-4558-8ad3-b0961bb1eb94 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:40.120132 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6480a2a7-7b1a-4558-8ad3-b0961bb1eb94 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:40.120581 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6480a2a7-7b1a-4558-8ad3-b0961bb1eb94 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:40.121290 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6480a2a7-7b1a-4558-8ad3-b0961bb1eb94 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:40.121753 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6480a2a7-7b1a-4558-8ad3-b0961bb1eb94 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:40.122190 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6480a2a7-7b1a-4558-8ad3-b0961bb1eb94 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:40.391924 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-6480a2a7-7b1a-4558-8ad3-b0961bb1eb94 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] 10.222.0.33 "POST /compute/v2.1/servers/746dc58a-d4c1-4132-80d9-5ace67ce3b2c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.286490 Oct 04 21:40:40.392548 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3464/6892] 10.222.0.33 () {60 vars in 1323 bytes} [Tue Oct 4 21:40:40 2022] POST /compute/v2.1/servers/746dc58a-d4c1-4132-80d9-5ace67ce3b2c/os-volume_attachments => generated 194 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:40:51.124177 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-142cf954-b552-4c8f-9d53-7b327150bfeb tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:40:51.124794 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-142cf954-b552-4c8f-9d53-7b327150bfeb tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] [instance: 746dc58a-d4c1-4132-80d9-5ace67ce3b2c] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:40:51.127712 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:40:51.128504 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=36 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:40:51.135649 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-142cf954-b552-4c8f-9d53-7b327150bfeb tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:51.136188 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-142cf954-b552-4c8f-9d53-7b327150bfeb tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:51.136695 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-142cf954-b552-4c8f-9d53-7b327150bfeb tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:51.137453 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-142cf954-b552-4c8f-9d53-7b327150bfeb tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:51.137966 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-142cf954-b552-4c8f-9d53-7b327150bfeb tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:51.138429 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-142cf954-b552-4c8f-9d53-7b327150bfeb tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:51.226478 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-142cf954-b552-4c8f-9d53-7b327150bfeb tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lazy-loading 'services' on Instance uuid 746dc58a-d4c1-4132-80d9-5ace67ce3b2c {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:40:51.298671 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-142cf954-b552-4c8f-9d53-7b327150bfeb tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] 10.222.0.33 "DELETE /compute/v2.1/servers/746dc58a-d4c1-4132-80d9-5ace67ce3b2c/os-volume_attachments/e0782594-7769-4c9a-b115-6febf2680580" status: 202 len: 0 microversion: 2.1 time: 0.179429 Oct 04 21:40:51.299279 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3429/6893] 10.222.0.33 () {58 vars in 1416 bytes} [Tue Oct 4 21:40:51 2022] DELETE /compute/v2.1/servers/746dc58a-d4c1-4132-80d9-5ace67ce3b2c/os-volume_attachments/e0782594-7769-4c9a-b115-6febf2680580 => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:40:51.310584 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-e4bd1bb1-00d7-4a62-9d55-280dca758ee6 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:40:51.313107 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-e4bd1bb1-00d7-4a62-9d55-280dca758ee6 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] [instance: 746dc58a-d4c1-4132-80d9-5ace67ce3b2c] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:40:51.315684 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:40:51.316380 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=41,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:40:51.324261 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e4bd1bb1-00d7-4a62-9d55-280dca758ee6 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:51.325129 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e4bd1bb1-00d7-4a62-9d55-280dca758ee6 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:51.325578 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e4bd1bb1-00d7-4a62-9d55-280dca758ee6 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:51.326306 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e4bd1bb1-00d7-4a62-9d55-280dca758ee6 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:51.326795 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e4bd1bb1-00d7-4a62-9d55-280dca758ee6 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:51.327227 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e4bd1bb1-00d7-4a62-9d55-280dca758ee6 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:51.362326 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-e4bd1bb1-00d7-4a62-9d55-280dca758ee6 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] 10.222.0.33 "GET /compute/v2.1/servers/746dc58a-d4c1-4132-80d9-5ace67ce3b2c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057681 Oct 04 21:40:51.362928 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3465/6894] 10.222.0.33 () {58 vars in 1302 bytes} [Tue Oct 4 21:40:51 2022] GET /compute/v2.1/servers/746dc58a-d4c1-4132-80d9-5ace67ce3b2c/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:40:52.376955 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-3eb12501-f429-484d-9d12-90f6f249ba6a tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:40:52.379327 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-3eb12501-f429-484d-9d12-90f6f249ba6a tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] [instance: 746dc58a-d4c1-4132-80d9-5ace67ce3b2c] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:40:52.386481 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3eb12501-f429-484d-9d12-90f6f249ba6a tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:52.386938 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3eb12501-f429-484d-9d12-90f6f249ba6a tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:52.387369 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3eb12501-f429-484d-9d12-90f6f249ba6a tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:52.388064 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3eb12501-f429-484d-9d12-90f6f249ba6a tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:52.388516 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3eb12501-f429-484d-9d12-90f6f249ba6a tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:52.388937 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3eb12501-f429-484d-9d12-90f6f249ba6a tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:52.421789 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-3eb12501-f429-484d-9d12-90f6f249ba6a tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] 10.222.0.33 "GET /compute/v2.1/servers/746dc58a-d4c1-4132-80d9-5ace67ce3b2c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050189 Oct 04 21:40:52.422395 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3430/6895] 10.222.0.33 () {58 vars in 1302 bytes} [Tue Oct 4 21:40:52 2022] GET /compute/v2.1/servers/746dc58a-d4c1-4132-80d9-5ace67ce3b2c/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:40:53.434843 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-98e88dd3-d476-43eb-8020-b9790ecb3a44 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:40:53.437088 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-98e88dd3-d476-43eb-8020-b9790ecb3a44 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] [instance: 746dc58a-d4c1-4132-80d9-5ace67ce3b2c] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:40:53.444327 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-98e88dd3-d476-43eb-8020-b9790ecb3a44 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:53.444830 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-98e88dd3-d476-43eb-8020-b9790ecb3a44 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:53.445276 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-98e88dd3-d476-43eb-8020-b9790ecb3a44 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:53.446002 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-98e88dd3-d476-43eb-8020-b9790ecb3a44 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:53.446509 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-98e88dd3-d476-43eb-8020-b9790ecb3a44 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:53.446953 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-98e88dd3-d476-43eb-8020-b9790ecb3a44 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:53.483392 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-98e88dd3-d476-43eb-8020-b9790ecb3a44 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] 10.222.0.33 "GET /compute/v2.1/servers/746dc58a-d4c1-4132-80d9-5ace67ce3b2c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052703 Oct 04 21:40:53.484024 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3466/6896] 10.222.0.33 () {58 vars in 1302 bytes} [Tue Oct 4 21:40:53 2022] GET /compute/v2.1/servers/746dc58a-d4c1-4132-80d9-5ace67ce3b2c/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:40:54.496781 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5d744115-eba7-4aee-8f89-fb816c19e306 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:40:54.499202 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-5d744115-eba7-4aee-8f89-fb816c19e306 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] [instance: 746dc58a-d4c1-4132-80d9-5ace67ce3b2c] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:40:54.507472 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5d744115-eba7-4aee-8f89-fb816c19e306 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:54.507963 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5d744115-eba7-4aee-8f89-fb816c19e306 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:54.508402 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5d744115-eba7-4aee-8f89-fb816c19e306 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:54.509105 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5d744115-eba7-4aee-8f89-fb816c19e306 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:54.509555 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5d744115-eba7-4aee-8f89-fb816c19e306 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:54.509976 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5d744115-eba7-4aee-8f89-fb816c19e306 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:54.542949 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5d744115-eba7-4aee-8f89-fb816c19e306 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] 10.222.0.33 "GET /compute/v2.1/servers/746dc58a-d4c1-4132-80d9-5ace67ce3b2c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050072 Oct 04 21:40:54.543441 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3431/6897] 10.222.0.33 () {58 vars in 1302 bytes} [Tue Oct 4 21:40:54 2022] GET /compute/v2.1/servers/746dc58a-d4c1-4132-80d9-5ace67ce3b2c/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:40:55.555896 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-fae5ac38-15d5-4907-8af0-bb4ba0da912d tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:40:55.557995 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-fae5ac38-15d5-4907-8af0-bb4ba0da912d tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] [instance: 746dc58a-d4c1-4132-80d9-5ace67ce3b2c] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:40:55.564958 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fae5ac38-15d5-4907-8af0-bb4ba0da912d tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:55.565374 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fae5ac38-15d5-4907-8af0-bb4ba0da912d tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:55.565823 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fae5ac38-15d5-4907-8af0-bb4ba0da912d tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:55.566571 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fae5ac38-15d5-4907-8af0-bb4ba0da912d tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:55.567613 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fae5ac38-15d5-4907-8af0-bb4ba0da912d tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:55.568112 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fae5ac38-15d5-4907-8af0-bb4ba0da912d tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:55.599033 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-fae5ac38-15d5-4907-8af0-bb4ba0da912d tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] 10.222.0.33 "GET /compute/v2.1/servers/746dc58a-d4c1-4132-80d9-5ace67ce3b2c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047260 Oct 04 21:40:55.599591 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3467/6898] 10.222.0.33 () {58 vars in 1302 bytes} [Tue Oct 4 21:40:55 2022] GET /compute/v2.1/servers/746dc58a-d4c1-4132-80d9-5ace67ce3b2c/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:40:56.611590 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-35d12b89-3732-487f-abb6-c7b86b3edc5b tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:40:56.614290 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-35d12b89-3732-487f-abb6-c7b86b3edc5b tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] [instance: 746dc58a-d4c1-4132-80d9-5ace67ce3b2c] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:40:56.621191 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-35d12b89-3732-487f-abb6-c7b86b3edc5b tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:56.621667 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-35d12b89-3732-487f-abb6-c7b86b3edc5b tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:56.622095 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-35d12b89-3732-487f-abb6-c7b86b3edc5b tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:56.622816 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-35d12b89-3732-487f-abb6-c7b86b3edc5b tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:56.623264 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-35d12b89-3732-487f-abb6-c7b86b3edc5b tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:56.623685 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-35d12b89-3732-487f-abb6-c7b86b3edc5b tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:56.653762 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-35d12b89-3732-487f-abb6-c7b86b3edc5b tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] 10.222.0.33 "GET /compute/v2.1/servers/746dc58a-d4c1-4132-80d9-5ace67ce3b2c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046154 Oct 04 21:40:56.654324 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3432/6899] 10.222.0.33 () {58 vars in 1302 bytes} [Tue Oct 4 21:40:56 2022] GET /compute/v2.1/servers/746dc58a-d4c1-4132-80d9-5ace67ce3b2c/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 21:40:56.665538 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-229a22cb-1267-410b-ae55-a3a1cb9ddeb9 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:40:56.666076 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-229a22cb-1267-410b-ae55-a3a1cb9ddeb9 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] [instance: 746dc58a-d4c1-4132-80d9-5ace67ce3b2c] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:40:56.672803 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-229a22cb-1267-410b-ae55-a3a1cb9ddeb9 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:56.673288 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-229a22cb-1267-410b-ae55-a3a1cb9ddeb9 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:56.673733 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-229a22cb-1267-410b-ae55-a3a1cb9ddeb9 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:56.674457 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-229a22cb-1267-410b-ae55-a3a1cb9ddeb9 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:40:56.674927 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-229a22cb-1267-410b-ae55-a3a1cb9ddeb9 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:40:56.675614 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-229a22cb-1267-410b-ae55-a3a1cb9ddeb9 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:40:56.756796 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.wsgi [None req-229a22cb-1267-410b-ae55-a3a1cb9ddeb9 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] HTTP exception thrown: Instance 746dc58a-d4c1-4132-80d9-5ace67ce3b2c is not attached to volume e0782594-7769-4c9a-b115-6febf2680580 Oct 04 21:40:56.766939 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-229a22cb-1267-410b-ae55-a3a1cb9ddeb9 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Request method failure captured: Oct 04 21:40:56.766939 n-d-854823-8 devstack@n-api.service[128802]: request: DELETE /compute/v2.1/servers/746dc58a-d4c1-4132-80d9-5ace67ce3b2c/os-volume_attachments/e0782594-7769-4c9a-b115-6febf2680580 HTTP/1.1 Oct 04 21:40:56.766939 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 21:40:56.766939 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 21:40:56.766939 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 21:40:56.766939 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 0 Oct 04 21:40:56.766939 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 21:40:56.766939 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 21:40:56.766939 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 21:40:56.766939 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 21:40:56.766939 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPKhFEFoRS-1U9WWYCOdhstTFgjzzWVo4Kdlla8ljNECBH0ZeAQZ07Hw27MPBSaBFlzV_4qi9Eu46DINt50cMxVm2DonnxZdSlqQJ8JHD_4uFsBbiJHxZKyrnkcBmgh9-dqq8BijGQJUaxIAwajaYfWsUSAKgBoTQIA664d_H8dw_x1w Oct 04 21:40:56.766939 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 21:40:56.766939 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 21:40:56.766939 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 21:40:56.766939 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 21:40:56.766939 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 21:40:56.766939 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 21:40:56.766939 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: a525f5d98a42453897757db171c263c0 Oct 04 21:40:56.766939 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-TestEncryptedCinderVolumes-340742639 Oct 04 21:40:56.766939 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 21:40:56.766939 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 21:40:56.766939 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a525f5d98a42453897757db171c263c0", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a525f5d98a42453897757db171c263c0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a525f5d98a42453897757db171c263c0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a525f5d98a42453897757db171c263c0"}]}] Oct 04 21:40:56.766939 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-TestEncryptedCinderVolumes-340742639 Oct 04 21:40:56.766939 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: a525f5d98a42453897757db171c263c0 Oct 04 21:40:56.766939 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-340742639 Oct 04 21:40:56.766939 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-TestEncryptedCinderVolumes-340742639-project Oct 04 21:40:56.766939 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 21:40:56.766939 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 21:40:56.766939 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: 408632237e174b91939b442954fef918 Oct 04 21:40:56.766939 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-TestEncryptedCinderVolumes-340742639-project Oct 04 21:40:56.766939 n-d-854823-8 devstack@n-api.service[128802]: method: > Oct 04 21:40:56.766939 n-d-854823-8 devstack@n-api.service[128802]: exception: Instance 746dc58a-d4c1-4132-80d9-5ace67ce3b2c is not attached to volume e0782594-7769-4c9a-b115-6febf2680580 Oct 04 21:40:56.766939 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'server_id': '746dc58a-d4c1-4132-80d9-5ace67ce3b2c', 'id': 'e0782594-7769-4c9a-b115-6febf2680580'} Oct 04 21:40:56.766939 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:40:56.766939 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:40:56.766939 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 04 21:40:56.766939 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 04 21:40:56.766939 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 21:40:56.766939 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 21:40:56.766939 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 04 21:40:56.766939 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 04 21:40:56.766939 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id e0782594-7769-4c9a-b115-6febf2680580. Oct 04 21:40:56.766939 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:40:56.766939 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:40:56.766939 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:40:56.766939 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:40:56.766939 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:40:56.766939 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:40:56.766939 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:40:56.766939 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:40:56.766939 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:40:56.766939 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:40:56.766939 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 04 21:40:56.766939 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 04 21:40:56.766939 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 746dc58a-d4c1-4132-80d9-5ace67ce3b2c is not attached to volume e0782594-7769-4c9a-b115-6febf2680580 Oct 04 21:40:56.766939 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:40:56.766939 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:40:56.766939 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:40:56.766939 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:40:56.766939 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:40:56.766939 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:40:56.771191 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:40:56.771191 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:40:56.771191 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 746dc58a-d4c1-4132-80d9-5ace67ce3b2c is not attached to volume e0782594-7769-4c9a-b115-6febf2680580 Oct 04 21:40:56.771191 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:40:56.771191 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-229a22cb-1267-410b-ae55-a3a1cb9ddeb9 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Returning 404 to user: Instance 746dc58a-d4c1-4132-80d9-5ace67ce3b2c is not attached to volume e0782594-7769-4c9a-b115-6febf2680580 {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:40:56.771191 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-229a22cb-1267-410b-ae55-a3a1cb9ddeb9 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] 10.222.0.33 "DELETE /compute/v2.1/servers/746dc58a-d4c1-4132-80d9-5ace67ce3b2c/os-volume_attachments/e0782594-7769-4c9a-b115-6febf2680580" status: 404 len: 154 microversion: 2.1 time: 0.107122 Oct 04 21:40:56.771191 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3468/6900] 10.222.0.33 () {58 vars in 1416 bytes} [Tue Oct 4 21:40:56 2022] DELETE /compute/v2.1/servers/746dc58a-d4c1-4132-80d9-5ace67ce3b2c/os-volume_attachments/e0782594-7769-4c9a-b115-6febf2680580 => generated 154 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:41:00.125324 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-4233dca7-122b-470e-9aa1-cb2b727c8590 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:41:00.125943 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-4233dca7-122b-470e-9aa1-cb2b727c8590 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] [instance: 746dc58a-d4c1-4132-80d9-5ace67ce3b2c] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:41:00.133975 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4233dca7-122b-470e-9aa1-cb2b727c8590 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:00.134624 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4233dca7-122b-470e-9aa1-cb2b727c8590 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:00.135072 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4233dca7-122b-470e-9aa1-cb2b727c8590 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:00.135786 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4233dca7-122b-470e-9aa1-cb2b727c8590 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:00.136243 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4233dca7-122b-470e-9aa1-cb2b727c8590 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:00.136670 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4233dca7-122b-470e-9aa1-cb2b727c8590 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:00.167623 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-4233dca7-122b-470e-9aa1-cb2b727c8590 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] [instance: 746dc58a-d4c1-4132-80d9-5ace67ce3b2c] Going to try to terminate instance {{(pid=128801) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:41:00.253467 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-4233dca7-122b-470e-9aa1-cb2b727c8590 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] 10.222.0.33 "DELETE /compute/v2.1/servers/746dc58a-d4c1-4132-80d9-5ace67ce3b2c" status: 204 len: 0 microversion: 2.1 time: 0.131774 Oct 04 21:41:00.258459 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3433/6901] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 21:41:00 2022] DELETE /compute/v2.1/servers/746dc58a-d4c1-4132-80d9-5ace67ce3b2c => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 21:41:00.263420 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-0da52a51-86a9-4dc9-b96f-006f6bf06c2c tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:41:00.264040 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-0da52a51-86a9-4dc9-b96f-006f6bf06c2c tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] [instance: 746dc58a-d4c1-4132-80d9-5ace67ce3b2c] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:41:00.272522 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0da52a51-86a9-4dc9-b96f-006f6bf06c2c tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:00.273030 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0da52a51-86a9-4dc9-b96f-006f6bf06c2c tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:00.273492 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0da52a51-86a9-4dc9-b96f-006f6bf06c2c tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:00.274328 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0da52a51-86a9-4dc9-b96f-006f6bf06c2c tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:00.274845 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0da52a51-86a9-4dc9-b96f-006f6bf06c2c tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:00.275354 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0da52a51-86a9-4dc9-b96f-006f6bf06c2c tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:00.424903 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-0da52a51-86a9-4dc9-b96f-006f6bf06c2c tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '408632237e174b91939b442954fef918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a525f5d98a42453897757db171c263c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:41:00.434482 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-0da52a51-86a9-4dc9-b96f-006f6bf06c2c tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] 10.222.0.33 "GET /compute/v2.1/servers/746dc58a-d4c1-4132-80d9-5ace67ce3b2c" status: 200 len: 1558 microversion: 2.1 time: 0.174688 Oct 04 21:41:00.436350 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3469/6902] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:41:00 2022] GET /compute/v2.1/servers/746dc58a-d4c1-4132-80d9-5ace67ce3b2c => generated 1558 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:41:01.464164 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f87061e0-d140-4327-aaf2-c98add8e08e0 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:41:01.464802 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f87061e0-d140-4327-aaf2-c98add8e08e0 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] [instance: 746dc58a-d4c1-4132-80d9-5ace67ce3b2c] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:41:01.471777 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f87061e0-d140-4327-aaf2-c98add8e08e0 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:01.472269 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f87061e0-d140-4327-aaf2-c98add8e08e0 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:01.472692 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f87061e0-d140-4327-aaf2-c98add8e08e0 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:01.473435 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f87061e0-d140-4327-aaf2-c98add8e08e0 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:01.473889 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f87061e0-d140-4327-aaf2-c98add8e08e0 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:01.474311 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f87061e0-d140-4327-aaf2-c98add8e08e0 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:01.605068 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f87061e0-d140-4327-aaf2-c98add8e08e0 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '408632237e174b91939b442954fef918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a525f5d98a42453897757db171c263c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:41:01.613019 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f87061e0-d140-4327-aaf2-c98add8e08e0 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] 10.222.0.33 "GET /compute/v2.1/servers/746dc58a-d4c1-4132-80d9-5ace67ce3b2c" status: 200 len: 1558 microversion: 2.1 time: 0.153242 Oct 04 21:41:01.613609 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3434/6903] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:41:01 2022] GET /compute/v2.1/servers/746dc58a-d4c1-4132-80d9-5ace67ce3b2c => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:41:02.422039 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-dcde2fc7-6fc5-486a-9401-459f42f8f63e req-60f15f3b-6941-49d3-b9f0-ea0e6025b18d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "746dc58a-d4c1-4132-80d9-5ace67ce3b2c", "name": "network-vif-deleted", "tag": "fe7a6bf6-4dce-4635-94fb-22956a796e5e"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:41:02.433322 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-dcde2fc7-6fc5-486a-9401-459f42f8f63e req-60f15f3b-6941-49d3-b9f0-ea0e6025b18d service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:02.433816 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-dcde2fc7-6fc5-486a-9401-459f42f8f63e req-60f15f3b-6941-49d3-b9f0-ea0e6025b18d service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:02.434261 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-dcde2fc7-6fc5-486a-9401-459f42f8f63e req-60f15f3b-6941-49d3-b9f0-ea0e6025b18d service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:02.446041 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-dcde2fc7-6fc5-486a-9401-459f42f8f63e req-60f15f3b-6941-49d3-b9f0-ea0e6025b18d service nova] Creating event network-vif-deleted:fe7a6bf6-4dce-4635-94fb-22956a796e5e for instance 746dc58a-d4c1-4132-80d9-5ace67ce3b2c on n-h2-854823-8 Oct 04 21:41:02.451649 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-dcde2fc7-6fc5-486a-9401-459f42f8f63e req-60f15f3b-6941-49d3-b9f0-ea0e6025b18d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033759 Oct 04 21:41:02.452728 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3470/6904] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:41:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:41:02.636927 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f924efe7-f6da-4f84-915b-413eca6e3e26 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:41:02.637474 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f924efe7-f6da-4f84-915b-413eca6e3e26 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] [instance: 746dc58a-d4c1-4132-80d9-5ace67ce3b2c] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:41:02.643756 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f924efe7-f6da-4f84-915b-413eca6e3e26 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:02.644246 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f924efe7-f6da-4f84-915b-413eca6e3e26 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:02.644685 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f924efe7-f6da-4f84-915b-413eca6e3e26 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:02.645448 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f924efe7-f6da-4f84-915b-413eca6e3e26 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:02.645910 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f924efe7-f6da-4f84-915b-413eca6e3e26 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:02.646368 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f924efe7-f6da-4f84-915b-413eca6e3e26 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:02.678780 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f924efe7-f6da-4f84-915b-413eca6e3e26 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:02.679196 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f924efe7-f6da-4f84-915b-413eca6e3e26 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:02.679645 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f924efe7-f6da-4f84-915b-413eca6e3e26 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:02.680098 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-f924efe7-f6da-4f84-915b-413eca6e3e26 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lazy-loading 'fault' on Instance uuid 746dc58a-d4c1-4132-80d9-5ace67ce3b2c {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:41:02.722855 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f924efe7-f6da-4f84-915b-413eca6e3e26 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '408632237e174b91939b442954fef918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a525f5d98a42453897757db171c263c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:41:02.731171 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f924efe7-f6da-4f84-915b-413eca6e3e26 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] 10.222.0.33 "GET /compute/v2.1/servers/746dc58a-d4c1-4132-80d9-5ace67ce3b2c" status: 200 len: 1351 microversion: 2.1 time: 0.098448 Oct 04 21:41:02.731766 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3435/6905] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:41:02 2022] GET /compute/v2.1/servers/746dc58a-d4c1-4132-80d9-5ace67ce3b2c => generated 1351 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:41:03.757245 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-7850f9de-51e2-4855-8bfd-71c437483771 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:41:03.757971 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-7850f9de-51e2-4855-8bfd-71c437483771 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] [instance: 746dc58a-d4c1-4132-80d9-5ace67ce3b2c] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:41:03.764152 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7850f9de-51e2-4855-8bfd-71c437483771 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:03.764642 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7850f9de-51e2-4855-8bfd-71c437483771 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:03.765087 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7850f9de-51e2-4855-8bfd-71c437483771 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:03.765793 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7850f9de-51e2-4855-8bfd-71c437483771 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:03.766258 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7850f9de-51e2-4855-8bfd-71c437483771 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:03.766714 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7850f9de-51e2-4855-8bfd-71c437483771 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:03.779938 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.wsgi [None req-7850f9de-51e2-4855-8bfd-71c437483771 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] HTTP exception thrown: Instance 746dc58a-d4c1-4132-80d9-5ace67ce3b2c could not be found. Oct 04 21:41:03.781550 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-7850f9de-51e2-4855-8bfd-71c437483771 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Request method failure captured: Oct 04 21:41:03.781550 n-d-854823-8 devstack@n-api.service[128802]: request: GET /compute/v2.1/servers/746dc58a-d4c1-4132-80d9-5ace67ce3b2c HTTP/1.1 Oct 04 21:41:03.781550 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 21:41:03.781550 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 21:41:03.781550 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 21:41:03.781550 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 0 Oct 04 21:41:03.781550 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 21:41:03.781550 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 21:41:03.781550 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 21:41:03.781550 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 21:41:03.781550 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPKhFEFoRS-1U9WWYCOdhstTFgjzzWVo4Kdlla8ljNECBH0ZeAQZ07Hw27MPBSaBFlzV_4qi9Eu46DINt50cMxVm2DonnxZdSlqQJ8JHD_4uFsBbiJHxZKyrnkcBmgh9-dqq8BijGQJUaxIAwajaYfWsUSAKgBoTQIA664d_H8dw_x1w Oct 04 21:41:03.781550 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 21:41:03.781550 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 21:41:03.781550 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 21:41:03.781550 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 21:41:03.781550 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 21:41:03.781550 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 21:41:03.781550 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: a525f5d98a42453897757db171c263c0 Oct 04 21:41:03.781550 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-TestEncryptedCinderVolumes-340742639 Oct 04 21:41:03.781550 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 21:41:03.781550 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 21:41:03.781550 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a525f5d98a42453897757db171c263c0", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a525f5d98a42453897757db171c263c0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a525f5d98a42453897757db171c263c0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a525f5d98a42453897757db171c263c0"}]}] Oct 04 21:41:03.781550 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-TestEncryptedCinderVolumes-340742639 Oct 04 21:41:03.781550 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: a525f5d98a42453897757db171c263c0 Oct 04 21:41:03.781550 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-340742639 Oct 04 21:41:03.781550 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-TestEncryptedCinderVolumes-340742639-project Oct 04 21:41:03.781550 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 21:41:03.781550 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 21:41:03.781550 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: 408632237e174b91939b442954fef918 Oct 04 21:41:03.781550 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-TestEncryptedCinderVolumes-340742639-project Oct 04 21:41:03.781550 n-d-854823-8 devstack@n-api.service[128802]: method: > Oct 04 21:41:03.781550 n-d-854823-8 devstack@n-api.service[128802]: exception: Instance 746dc58a-d4c1-4132-80d9-5ace67ce3b2c could not be found. Oct 04 21:41:03.781550 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'id': '746dc58a-d4c1-4132-80d9-5ace67ce3b2c'} Oct 04 21:41:03.781550 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:41:03.781550 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:41:03.781550 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:41:03.781550 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:41:03.781550 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:41:03.781550 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:41:03.781550 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:41:03.781550 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:41:03.781550 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:41:03.781550 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:41:03.781550 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 746dc58a-d4c1-4132-80d9-5ace67ce3b2c could not be found. Oct 04 21:41:03.781550 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:41:03.781550 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:41:03.781550 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:41:03.781550 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:41:03.781550 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:41:03.781550 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:41:03.781550 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:41:03.781550 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:41:03.781550 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:41:03.781550 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:41:03.781550 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:41:03.781550 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:41:03.781550 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:41:03.781550 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:41:03.781550 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:41:03.781550 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:41:03.781550 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 746dc58a-d4c1-4132-80d9-5ace67ce3b2c could not be found. Oct 04 21:41:03.781550 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:41:03.781550 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:41:03.781550 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:41:03.785958 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:41:03.785958 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:41:03.785958 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:41:03.785958 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:41:03.785958 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:41:03.785958 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 746dc58a-d4c1-4132-80d9-5ace67ce3b2c could not be found. Oct 04 21:41:03.785958 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:41:03.785958 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-7850f9de-51e2-4855-8bfd-71c437483771 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Returning 404 to user: Instance 746dc58a-d4c1-4132-80d9-5ace67ce3b2c could not be found. {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:41:03.785958 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-7850f9de-51e2-4855-8bfd-71c437483771 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] 10.222.0.33 "GET /compute/v2.1/servers/746dc58a-d4c1-4132-80d9-5ace67ce3b2c" status: 404 len: 111 microversion: 2.1 time: 0.030932 Oct 04 21:41:03.785958 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3471/6906] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:41:03 2022] GET /compute/v2.1/servers/746dc58a-d4c1-4132-80d9-5ace67ce3b2c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:41:03.792582 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-51a86d15-6206-4ff5-be22-021f0fbaa997 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Calling method '.version_select at 0x7f3c788569d0>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:41:03.814088 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-51a86d15-6206-4ff5-be22-021f0fbaa997 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-654163765" status: 202 len: 0 microversion: 2.1 time: 0.025419 Oct 04 21:41:03.814806 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3436/6907] 10.222.0.33 () {58 vars in 1275 bytes} [Tue Oct 4 21:41:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-654163765 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:41:03.832288 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-4a5f196b-1bb1-4772-863c-b7f4dfb260a1 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Action: 'create', calling method: .version_select at 0x7f3c741bdd30>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-1117858347", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJc+sIn+njApXBlGZS+pYp/u+L95xWAfK0uzFIaohDoxq4Hy1CuJj6LSXDYuqAddmOETg47PLGiW4mcR7z4ckhf+PGiUQCG/SlAaq7/+Sf4drnzz1w50iYyyVAnlxCGhQA=="}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:41:03.847910 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-4a5f196b-1bb1-4772-863c-b7f4dfb260a1 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Getting quotas for project a525f5d98a42453897757db171c263c0. Resources: {'key_pairs'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:41:03.854362 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-4a5f196b-1bb1-4772-863c-b7f4dfb260a1 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Getting quotas for user 408632237e174b91939b442954fef918 and project a525f5d98a42453897757db171c263c0. Resources: {'key_pairs'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:41:03.879172 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-4a5f196b-1bb1-4772-863c-b7f4dfb260a1 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.050772 Oct 04 21:41:03.879806 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3472/6908] 10.222.0.33 () {60 vars in 1159 bytes} [Tue Oct 4 21:41:03 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:41:03.930608 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f665971f-c122-462f-aeb2-a2ceb1fcc530 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1552304316", "imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-1117858347", "networks": [{"uuid": "e904ca70-ebac-4660-a6aa-4662f47bc90b"}]}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:41:03.986990 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.network.neutron [None req-f665971f-c122-462f-aeb2-a2ceb1fcc530 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] validate_networks() for [('e904ca70-ebac-4660-a6aa-4662f47bc90b', None, None, None, None, None)] {{(pid=128801) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:41:04.375603 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-f665971f-c122-462f-aeb2-a2ceb1fcc530 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Flavor limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:41:04.376029 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-f665971f-c122-462f-aeb2-a2ceb1fcc530 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Image limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:41:04.376508 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-f665971f-c122-462f-aeb2-a2ceb1fcc530 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Flavor pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:41:04.376920 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-f665971f-c122-462f-aeb2-a2ceb1fcc530 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Image pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:41:04.377338 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-f665971f-c122-462f-aeb2-a2ceb1fcc530 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:41:04.387214 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f665971f-c122-462f-aeb2-a2ceb1fcc530 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:04.387697 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f665971f-c122-462f-aeb2-a2ceb1fcc530 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:04.388135 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f665971f-c122-462f-aeb2-a2ceb1fcc530 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:04.388863 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f665971f-c122-462f-aeb2-a2ceb1fcc530 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:04.389317 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f665971f-c122-462f-aeb2-a2ceb1fcc530 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:04.389744 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f665971f-c122-462f-aeb2-a2ceb1fcc530 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:04.408295 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-f665971f-c122-462f-aeb2-a2ceb1fcc530 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Getting quotas for project a525f5d98a42453897757db171c263c0. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:41:04.413848 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-f665971f-c122-462f-aeb2-a2ceb1fcc530 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Getting quotas for user 408632237e174b91939b442954fef918 and project a525f5d98a42453897757db171c263c0. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:41:04.426492 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f665971f-c122-462f-aeb2-a2ceb1fcc530 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Going to run 1 instances... {{(pid=128801) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:41:04.429244 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f665971f-c122-462f-aeb2-a2ceb1fcc530 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] [instance: 97ffca59-93eb-4c08-8e86-b8642016b65a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='15b24725-0c99-4bcf-b1fb-907cdf8e2d63',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128801) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:41:04.476708 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f665971f-c122-462f-aeb2-a2ceb1fcc530 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.550339 Oct 04 21:41:04.477367 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3437/6909] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 21:41:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 552 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:41:04.488506 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-e6b7dee0-1443-4a44-87a1-2e466b98eefb tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:41:04.489132 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-e6b7dee0-1443-4a44-87a1-2e466b98eefb tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] [instance: 97ffca59-93eb-4c08-8e86-b8642016b65a] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:41:04.544182 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-e6b7dee0-1443-4a44-87a1-2e466b98eefb tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '408632237e174b91939b442954fef918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a525f5d98a42453897757db171c263c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:41:04.551642 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-e6b7dee0-1443-4a44-87a1-2e466b98eefb tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] 10.222.0.33 "GET /compute/v2.1/servers/97ffca59-93eb-4c08-8e86-b8642016b65a" status: 200 len: 1263 microversion: 2.1 time: 0.067014 Oct 04 21:41:04.552215 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3473/6910] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:41:04 2022] GET /compute/v2.1/servers/97ffca59-93eb-4c08-8e86-b8642016b65a => generated 1263 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:41:05.576643 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-fdbc9f78-b36d-4c94-b87f-bebe2339b31d tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:41:05.577241 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-fdbc9f78-b36d-4c94-b87f-bebe2339b31d tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] [instance: 97ffca59-93eb-4c08-8e86-b8642016b65a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:41:05.586280 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fdbc9f78-b36d-4c94-b87f-bebe2339b31d tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:05.586806 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fdbc9f78-b36d-4c94-b87f-bebe2339b31d tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:05.587282 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fdbc9f78-b36d-4c94-b87f-bebe2339b31d tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:05.588238 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fdbc9f78-b36d-4c94-b87f-bebe2339b31d tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:05.588706 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fdbc9f78-b36d-4c94-b87f-bebe2339b31d tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:05.589112 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fdbc9f78-b36d-4c94-b87f-bebe2339b31d tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:05.672299 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-fdbc9f78-b36d-4c94-b87f-bebe2339b31d tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '408632237e174b91939b442954fef918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a525f5d98a42453897757db171c263c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:41:05.683979 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-fdbc9f78-b36d-4c94-b87f-bebe2339b31d tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] 10.222.0.33 "GET /compute/v2.1/servers/97ffca59-93eb-4c08-8e86-b8642016b65a" status: 200 len: 1323 microversion: 2.1 time: 0.112614 Oct 04 21:41:05.690470 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3438/6911] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:41:05 2022] GET /compute/v2.1/servers/97ffca59-93eb-4c08-8e86-b8642016b65a => generated 1323 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:41:06.723670 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-fa1fb6db-2666-4ede-a583-6402208f263b tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:41:06.724793 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-fa1fb6db-2666-4ede-a583-6402208f263b tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] [instance: 97ffca59-93eb-4c08-8e86-b8642016b65a] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:41:06.732698 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fa1fb6db-2666-4ede-a583-6402208f263b tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:06.733228 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fa1fb6db-2666-4ede-a583-6402208f263b tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:06.733671 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fa1fb6db-2666-4ede-a583-6402208f263b tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:06.734629 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fa1fb6db-2666-4ede-a583-6402208f263b tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:06.734881 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fa1fb6db-2666-4ede-a583-6402208f263b tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:06.735289 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fa1fb6db-2666-4ede-a583-6402208f263b tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:06.946852 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-fa1fb6db-2666-4ede-a583-6402208f263b tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '408632237e174b91939b442954fef918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a525f5d98a42453897757db171c263c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:41:06.954568 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-fa1fb6db-2666-4ede-a583-6402208f263b tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] 10.222.0.33 "GET /compute/v2.1/servers/97ffca59-93eb-4c08-8e86-b8642016b65a" status: 200 len: 1363 microversion: 2.1 time: 0.234883 Oct 04 21:41:06.955346 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3474/6912] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:41:06 2022] GET /compute/v2.1/servers/97ffca59-93eb-4c08-8e86-b8642016b65a => generated 1363 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:41:07.049068 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-44b3e10b-6fd3-4ff9-9ce2-4c9b4e8beb18 req-bb768246-83f2-4a20-86c0-18ac63290bc9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97ffca59-93eb-4c08-8e86-b8642016b65a", "tag": "815905eb-4098-4ca9-a91c-afd864ca220d"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:41:07.060325 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-44b3e10b-6fd3-4ff9-9ce2-4c9b4e8beb18 req-bb768246-83f2-4a20-86c0-18ac63290bc9 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:07.060809 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-44b3e10b-6fd3-4ff9-9ce2-4c9b4e8beb18 req-bb768246-83f2-4a20-86c0-18ac63290bc9 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:07.061251 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-44b3e10b-6fd3-4ff9-9ce2-4c9b4e8beb18 req-bb768246-83f2-4a20-86c0-18ac63290bc9 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:07.072760 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-44b3e10b-6fd3-4ff9-9ce2-4c9b4e8beb18 req-bb768246-83f2-4a20-86c0-18ac63290bc9 service nova] Creating event network-changed:815905eb-4098-4ca9-a91c-afd864ca220d for instance 97ffca59-93eb-4c08-8e86-b8642016b65a on n-h2-854823-8 Oct 04 21:41:07.077991 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-44b3e10b-6fd3-4ff9-9ce2-4c9b4e8beb18 req-bb768246-83f2-4a20-86c0-18ac63290bc9 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032840 Oct 04 21:41:07.078821 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3439/6913] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:41:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:41:07.979259 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-2fe323a8-0dd3-49e7-8b11-a03423468f97 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:41:07.979881 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-2fe323a8-0dd3-49e7-8b11-a03423468f97 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] [instance: 97ffca59-93eb-4c08-8e86-b8642016b65a] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:41:07.986737 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2fe323a8-0dd3-49e7-8b11-a03423468f97 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:07.987227 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2fe323a8-0dd3-49e7-8b11-a03423468f97 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:07.987670 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2fe323a8-0dd3-49e7-8b11-a03423468f97 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:07.988373 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2fe323a8-0dd3-49e7-8b11-a03423468f97 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:07.988837 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2fe323a8-0dd3-49e7-8b11-a03423468f97 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:07.989267 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2fe323a8-0dd3-49e7-8b11-a03423468f97 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:08.383324 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-2fe323a8-0dd3-49e7-8b11-a03423468f97 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '408632237e174b91939b442954fef918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a525f5d98a42453897757db171c263c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:41:08.391735 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-2fe323a8-0dd3-49e7-8b11-a03423468f97 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] 10.222.0.33 "GET /compute/v2.1/servers/97ffca59-93eb-4c08-8e86-b8642016b65a" status: 200 len: 1363 microversion: 2.1 time: 0.416480 Oct 04 21:41:08.392552 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3475/6914] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:41:07 2022] GET /compute/v2.1/servers/97ffca59-93eb-4c08-8e86-b8642016b65a => generated 1363 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:41:09.417135 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-cfdd44f9-1936-468f-b71f-653d22f04fc3 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:41:09.417840 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-cfdd44f9-1936-468f-b71f-653d22f04fc3 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] [instance: 97ffca59-93eb-4c08-8e86-b8642016b65a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:41:09.424060 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cfdd44f9-1936-468f-b71f-653d22f04fc3 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:09.424542 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cfdd44f9-1936-468f-b71f-653d22f04fc3 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:09.424978 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cfdd44f9-1936-468f-b71f-653d22f04fc3 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:09.425933 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cfdd44f9-1936-468f-b71f-653d22f04fc3 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:09.426411 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cfdd44f9-1936-468f-b71f-653d22f04fc3 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:09.426839 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cfdd44f9-1936-468f-b71f-653d22f04fc3 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:09.563789 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-cfdd44f9-1936-468f-b71f-653d22f04fc3 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '408632237e174b91939b442954fef918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a525f5d98a42453897757db171c263c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:41:09.571967 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-cfdd44f9-1936-468f-b71f-653d22f04fc3 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] 10.222.0.33 "GET /compute/v2.1/servers/97ffca59-93eb-4c08-8e86-b8642016b65a" status: 200 len: 1363 microversion: 2.1 time: 0.160234 Oct 04 21:41:09.572548 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3440/6915] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:41:09 2022] GET /compute/v2.1/servers/97ffca59-93eb-4c08-8e86-b8642016b65a => generated 1363 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:41:10.595432 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-aaa0c7dc-e3dd-4197-9cb5-c5871cd511d4 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:41:10.596048 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-aaa0c7dc-e3dd-4197-9cb5-c5871cd511d4 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] [instance: 97ffca59-93eb-4c08-8e86-b8642016b65a] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:41:10.603262 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-aaa0c7dc-e3dd-4197-9cb5-c5871cd511d4 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:10.603761 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-aaa0c7dc-e3dd-4197-9cb5-c5871cd511d4 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:10.604211 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-aaa0c7dc-e3dd-4197-9cb5-c5871cd511d4 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:10.604922 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-aaa0c7dc-e3dd-4197-9cb5-c5871cd511d4 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:10.605386 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-aaa0c7dc-e3dd-4197-9cb5-c5871cd511d4 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:10.605822 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-aaa0c7dc-e3dd-4197-9cb5-c5871cd511d4 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:10.736460 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-aaa0c7dc-e3dd-4197-9cb5-c5871cd511d4 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '408632237e174b91939b442954fef918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a525f5d98a42453897757db171c263c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:41:10.744723 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-aaa0c7dc-e3dd-4197-9cb5-c5871cd511d4 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] 10.222.0.33 "GET /compute/v2.1/servers/97ffca59-93eb-4c08-8e86-b8642016b65a" status: 200 len: 1363 microversion: 2.1 time: 0.153364 Oct 04 21:41:10.745272 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3476/6916] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:41:10 2022] GET /compute/v2.1/servers/97ffca59-93eb-4c08-8e86-b8642016b65a => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:41:11.768655 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-30710341-73f3-4339-80ba-dd1b4c7b68df tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:41:11.769202 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-30710341-73f3-4339-80ba-dd1b4c7b68df tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] [instance: 97ffca59-93eb-4c08-8e86-b8642016b65a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:41:11.776190 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-30710341-73f3-4339-80ba-dd1b4c7b68df tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:11.776673 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-30710341-73f3-4339-80ba-dd1b4c7b68df tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:11.777110 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-30710341-73f3-4339-80ba-dd1b4c7b68df tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:11.777809 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-30710341-73f3-4339-80ba-dd1b4c7b68df tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:11.778260 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-30710341-73f3-4339-80ba-dd1b4c7b68df tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:11.778755 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-30710341-73f3-4339-80ba-dd1b4c7b68df tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:11.916132 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-30710341-73f3-4339-80ba-dd1b4c7b68df tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '408632237e174b91939b442954fef918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a525f5d98a42453897757db171c263c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:41:11.924041 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-30710341-73f3-4339-80ba-dd1b4c7b68df tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] 10.222.0.33 "GET /compute/v2.1/servers/97ffca59-93eb-4c08-8e86-b8642016b65a" status: 200 len: 1363 microversion: 2.1 time: 0.159426 Oct 04 21:41:11.924659 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3441/6917] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:41:11 2022] GET /compute/v2.1/servers/97ffca59-93eb-4c08-8e86-b8642016b65a => generated 1363 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:41:12.264059 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-4821d59a-7ba6-4a41-8e4d-56adf3f8dc4a req-25775652-004f-49fa-8be4-40ee36113ce8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97ffca59-93eb-4c08-8e86-b8642016b65a", "name": "network-vif-plugged", "status": "completed", "tag": "815905eb-4098-4ca9-a91c-afd864ca220d"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:41:12.274648 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-4821d59a-7ba6-4a41-8e4d-56adf3f8dc4a req-25775652-004f-49fa-8be4-40ee36113ce8 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:12.275120 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-4821d59a-7ba6-4a41-8e4d-56adf3f8dc4a req-25775652-004f-49fa-8be4-40ee36113ce8 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:12.275968 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-4821d59a-7ba6-4a41-8e4d-56adf3f8dc4a req-25775652-004f-49fa-8be4-40ee36113ce8 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:12.289419 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-4821d59a-7ba6-4a41-8e4d-56adf3f8dc4a req-25775652-004f-49fa-8be4-40ee36113ce8 service nova] Creating event network-vif-plugged:815905eb-4098-4ca9-a91c-afd864ca220d for instance 97ffca59-93eb-4c08-8e86-b8642016b65a on n-h2-854823-8 Oct 04 21:41:12.294727 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-4821d59a-7ba6-4a41-8e4d-56adf3f8dc4a req-25775652-004f-49fa-8be4-40ee36113ce8 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034322 Oct 04 21:41:12.295611 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3477/6918] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:41:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:41:12.948564 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-99d79541-2a6f-486f-b087-4330b30e440a tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:41:12.949092 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-99d79541-2a6f-486f-b087-4330b30e440a tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] [instance: 97ffca59-93eb-4c08-8e86-b8642016b65a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:41:12.956045 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-99d79541-2a6f-486f-b087-4330b30e440a tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:12.956540 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-99d79541-2a6f-486f-b087-4330b30e440a tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:12.956984 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-99d79541-2a6f-486f-b087-4330b30e440a tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:12.957691 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-99d79541-2a6f-486f-b087-4330b30e440a tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:12.958148 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-99d79541-2a6f-486f-b087-4330b30e440a tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:12.958672 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-99d79541-2a6f-486f-b087-4330b30e440a tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:13.093878 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-99d79541-2a6f-486f-b087-4330b30e440a tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '408632237e174b91939b442954fef918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a525f5d98a42453897757db171c263c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:41:13.102775 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-99d79541-2a6f-486f-b087-4330b30e440a tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] 10.222.0.33 "GET /compute/v2.1/servers/97ffca59-93eb-4c08-8e86-b8642016b65a" status: 200 len: 1363 microversion: 2.1 time: 0.158222 Oct 04 21:41:13.103669 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3442/6919] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:41:12 2022] GET /compute/v2.1/servers/97ffca59-93eb-4c08-8e86-b8642016b65a => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:41:14.128320 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-85398d8c-5219-4802-86c0-07506a05d572 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:41:14.129053 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-85398d8c-5219-4802-86c0-07506a05d572 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] [instance: 97ffca59-93eb-4c08-8e86-b8642016b65a] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:41:14.137237 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-85398d8c-5219-4802-86c0-07506a05d572 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:14.137741 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-85398d8c-5219-4802-86c0-07506a05d572 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:14.138189 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-85398d8c-5219-4802-86c0-07506a05d572 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:14.138939 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-85398d8c-5219-4802-86c0-07506a05d572 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:14.139402 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-85398d8c-5219-4802-86c0-07506a05d572 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:14.139837 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-85398d8c-5219-4802-86c0-07506a05d572 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:14.272612 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-85398d8c-5219-4802-86c0-07506a05d572 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '408632237e174b91939b442954fef918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a525f5d98a42453897757db171c263c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:41:14.280413 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-85398d8c-5219-4802-86c0-07506a05d572 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] 10.222.0.33 "GET /compute/v2.1/servers/97ffca59-93eb-4c08-8e86-b8642016b65a" status: 200 len: 1554 microversion: 2.1 time: 0.157807 Oct 04 21:41:14.280982 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3478/6920] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:41:14 2022] GET /compute/v2.1/servers/97ffca59-93eb-4c08-8e86-b8642016b65a => generated 1554 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:41:14.307183 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-cf07c236-c84e-4f28-99d0-1e15e96381e5 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:41:14.307769 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-cf07c236-c84e-4f28-99d0-1e15e96381e5 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] [instance: 97ffca59-93eb-4c08-8e86-b8642016b65a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:41:14.313901 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cf07c236-c84e-4f28-99d0-1e15e96381e5 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:14.314419 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cf07c236-c84e-4f28-99d0-1e15e96381e5 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:14.314937 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cf07c236-c84e-4f28-99d0-1e15e96381e5 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:14.315569 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cf07c236-c84e-4f28-99d0-1e15e96381e5 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:14.316026 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cf07c236-c84e-4f28-99d0-1e15e96381e5 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:14.316454 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cf07c236-c84e-4f28-99d0-1e15e96381e5 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:14.399127 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:41:14.420847 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=6 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:41:14.456708 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-cf07c236-c84e-4f28-99d0-1e15e96381e5 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '408632237e174b91939b442954fef918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a525f5d98a42453897757db171c263c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:41:14.466759 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-cf07c236-c84e-4f28-99d0-1e15e96381e5 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] 10.222.0.33 "GET /compute/v2.1/servers/97ffca59-93eb-4c08-8e86-b8642016b65a" status: 200 len: 1554 microversion: 2.1 time: 0.166019 Oct 04 21:41:14.467349 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3443/6921] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:41:14 2022] GET /compute/v2.1/servers/97ffca59-93eb-4c08-8e86-b8642016b65a => generated 1554 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:41:16.013843 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-0671f2b6-f53b-49a0-923e-ff7cf49c8765 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b9d1e357-bece-4aa8-a9e7-e058a786051f"}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:41:16.016210 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-0671f2b6-f53b-49a0-923e-ff7cf49c8765 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] [instance: 97ffca59-93eb-4c08-8e86-b8642016b65a] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:41:16.018165 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell0:SELECT=6 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:41:16.024512 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0671f2b6-f53b-49a0-923e-ff7cf49c8765 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:16.025005 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0671f2b6-f53b-49a0-923e-ff7cf49c8765 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:16.025452 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0671f2b6-f53b-49a0-923e-ff7cf49c8765 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:16.026161 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0671f2b6-f53b-49a0-923e-ff7cf49c8765 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:16.026661 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0671f2b6-f53b-49a0-923e-ff7cf49c8765 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:16.027093 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0671f2b6-f53b-49a0-923e-ff7cf49c8765 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:16.294780 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-0671f2b6-f53b-49a0-923e-ff7cf49c8765 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] 10.222.0.33 "POST /compute/v2.1/servers/97ffca59-93eb-4c08-8e86-b8642016b65a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.284497 Oct 04 21:41:16.295393 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3479/6922] 10.222.0.33 () {60 vars in 1323 bytes} [Tue Oct 4 21:41:16 2022] POST /compute/v2.1/servers/97ffca59-93eb-4c08-8e86-b8642016b65a/os-volume_attachments => generated 194 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:41:27.033285 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-79928a8e-0cb9-4e7e-a7e4-78e16900c6fa tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:41:27.033936 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-79928a8e-0cb9-4e7e-a7e4-78e16900c6fa tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] [instance: 97ffca59-93eb-4c08-8e86-b8642016b65a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:41:27.036173 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:41:27.036974 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=89,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:41:27.044915 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-79928a8e-0cb9-4e7e-a7e4-78e16900c6fa tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:27.045404 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-79928a8e-0cb9-4e7e-a7e4-78e16900c6fa tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:27.045839 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-79928a8e-0cb9-4e7e-a7e4-78e16900c6fa tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:27.046573 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-79928a8e-0cb9-4e7e-a7e4-78e16900c6fa tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:27.047032 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-79928a8e-0cb9-4e7e-a7e4-78e16900c6fa tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:27.047454 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-79928a8e-0cb9-4e7e-a7e4-78e16900c6fa tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:27.133425 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-79928a8e-0cb9-4e7e-a7e4-78e16900c6fa tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lazy-loading 'services' on Instance uuid 97ffca59-93eb-4c08-8e86-b8642016b65a {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:41:27.205256 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-79928a8e-0cb9-4e7e-a7e4-78e16900c6fa tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] 10.222.0.33 "DELETE /compute/v2.1/servers/97ffca59-93eb-4c08-8e86-b8642016b65a/os-volume_attachments/b9d1e357-bece-4aa8-a9e7-e058a786051f" status: 202 len: 0 microversion: 2.1 time: 0.176010 Oct 04 21:41:27.205891 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3444/6923] 10.222.0.33 () {58 vars in 1416 bytes} [Tue Oct 4 21:41:27 2022] DELETE /compute/v2.1/servers/97ffca59-93eb-4c08-8e86-b8642016b65a/os-volume_attachments/b9d1e357-bece-4aa8-a9e7-e058a786051f => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:41:27.215763 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-c5108a29-4e2f-47ea-b7ca-c362b194fa85 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:41:27.218154 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-c5108a29-4e2f-47ea-b7ca-c362b194fa85 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] [instance: 97ffca59-93eb-4c08-8e86-b8642016b65a] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:41:27.220879 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:41:27.221622 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:41:27.229306 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c5108a29-4e2f-47ea-b7ca-c362b194fa85 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:27.229808 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c5108a29-4e2f-47ea-b7ca-c362b194fa85 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:27.230263 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c5108a29-4e2f-47ea-b7ca-c362b194fa85 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:27.231009 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c5108a29-4e2f-47ea-b7ca-c362b194fa85 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:27.231486 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c5108a29-4e2f-47ea-b7ca-c362b194fa85 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:27.231928 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c5108a29-4e2f-47ea-b7ca-c362b194fa85 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:27.269343 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-c5108a29-4e2f-47ea-b7ca-c362b194fa85 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] 10.222.0.33 "GET /compute/v2.1/servers/97ffca59-93eb-4c08-8e86-b8642016b65a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057899 Oct 04 21:41:27.269927 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3480/6924] 10.222.0.33 () {58 vars in 1302 bytes} [Tue Oct 4 21:41:27 2022] GET /compute/v2.1/servers/97ffca59-93eb-4c08-8e86-b8642016b65a/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:41:28.284212 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ae9fc6aa-5197-4457-af04-6e634d38800a tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:41:28.286615 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ae9fc6aa-5197-4457-af04-6e634d38800a tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] [instance: 97ffca59-93eb-4c08-8e86-b8642016b65a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:41:28.293501 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ae9fc6aa-5197-4457-af04-6e634d38800a tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:28.293989 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ae9fc6aa-5197-4457-af04-6e634d38800a tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:28.294453 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ae9fc6aa-5197-4457-af04-6e634d38800a tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:28.295161 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ae9fc6aa-5197-4457-af04-6e634d38800a tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:28.295617 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ae9fc6aa-5197-4457-af04-6e634d38800a tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:28.296045 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ae9fc6aa-5197-4457-af04-6e634d38800a tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:28.328467 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ae9fc6aa-5197-4457-af04-6e634d38800a tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] 10.222.0.33 "GET /compute/v2.1/servers/97ffca59-93eb-4c08-8e86-b8642016b65a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049525 Oct 04 21:41:28.328968 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3445/6925] 10.222.0.33 () {58 vars in 1302 bytes} [Tue Oct 4 21:41:28 2022] GET /compute/v2.1/servers/97ffca59-93eb-4c08-8e86-b8642016b65a/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:41:29.341811 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-ad38a42c-23d3-40e0-bf3c-e7b9d33d2b0f tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:41:29.344080 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-ad38a42c-23d3-40e0-bf3c-e7b9d33d2b0f tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] [instance: 97ffca59-93eb-4c08-8e86-b8642016b65a] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:41:29.351282 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ad38a42c-23d3-40e0-bf3c-e7b9d33d2b0f tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:29.351786 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ad38a42c-23d3-40e0-bf3c-e7b9d33d2b0f tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:29.352261 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ad38a42c-23d3-40e0-bf3c-e7b9d33d2b0f tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:29.352967 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ad38a42c-23d3-40e0-bf3c-e7b9d33d2b0f tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:29.353440 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ad38a42c-23d3-40e0-bf3c-e7b9d33d2b0f tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:29.353883 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ad38a42c-23d3-40e0-bf3c-e7b9d33d2b0f tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:29.390297 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-ad38a42c-23d3-40e0-bf3c-e7b9d33d2b0f tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] 10.222.0.33 "GET /compute/v2.1/servers/97ffca59-93eb-4c08-8e86-b8642016b65a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052560 Oct 04 21:41:29.390933 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3481/6926] 10.222.0.33 () {58 vars in 1302 bytes} [Tue Oct 4 21:41:29 2022] GET /compute/v2.1/servers/97ffca59-93eb-4c08-8e86-b8642016b65a/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:41:30.403083 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f2c58d74-8fd6-4388-8659-9143fabff465 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:41:30.405441 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f2c58d74-8fd6-4388-8659-9143fabff465 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] [instance: 97ffca59-93eb-4c08-8e86-b8642016b65a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:41:30.413594 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f2c58d74-8fd6-4388-8659-9143fabff465 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:30.414083 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f2c58d74-8fd6-4388-8659-9143fabff465 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:30.414560 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f2c58d74-8fd6-4388-8659-9143fabff465 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:30.415275 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f2c58d74-8fd6-4388-8659-9143fabff465 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:30.415727 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f2c58d74-8fd6-4388-8659-9143fabff465 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:30.416158 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f2c58d74-8fd6-4388-8659-9143fabff465 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:30.447557 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f2c58d74-8fd6-4388-8659-9143fabff465 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] 10.222.0.33 "GET /compute/v2.1/servers/97ffca59-93eb-4c08-8e86-b8642016b65a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048458 Oct 04 21:41:30.448132 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3446/6927] 10.222.0.33 () {58 vars in 1302 bytes} [Tue Oct 4 21:41:30 2022] GET /compute/v2.1/servers/97ffca59-93eb-4c08-8e86-b8642016b65a/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:41:31.460106 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-a99bbebf-ac59-4ebd-a08a-5b3daa8bfda8 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:41:31.462184 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-a99bbebf-ac59-4ebd-a08a-5b3daa8bfda8 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] [instance: 97ffca59-93eb-4c08-8e86-b8642016b65a] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:41:31.469442 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a99bbebf-ac59-4ebd-a08a-5b3daa8bfda8 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:31.469937 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a99bbebf-ac59-4ebd-a08a-5b3daa8bfda8 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:31.470416 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a99bbebf-ac59-4ebd-a08a-5b3daa8bfda8 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:31.471132 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a99bbebf-ac59-4ebd-a08a-5b3daa8bfda8 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:31.471599 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a99bbebf-ac59-4ebd-a08a-5b3daa8bfda8 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:31.472033 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a99bbebf-ac59-4ebd-a08a-5b3daa8bfda8 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:31.502946 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-a99bbebf-ac59-4ebd-a08a-5b3daa8bfda8 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] 10.222.0.33 "GET /compute/v2.1/servers/97ffca59-93eb-4c08-8e86-b8642016b65a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046819 Oct 04 21:41:31.503517 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3482/6928] 10.222.0.33 () {58 vars in 1302 bytes} [Tue Oct 4 21:41:31 2022] GET /compute/v2.1/servers/97ffca59-93eb-4c08-8e86-b8642016b65a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:41:32.515859 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-4ce213de-0d0f-41b2-a222-d32be387c165 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:41:32.518102 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-4ce213de-0d0f-41b2-a222-d32be387c165 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] [instance: 97ffca59-93eb-4c08-8e86-b8642016b65a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:41:32.525823 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4ce213de-0d0f-41b2-a222-d32be387c165 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:32.526312 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4ce213de-0d0f-41b2-a222-d32be387c165 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:32.526777 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4ce213de-0d0f-41b2-a222-d32be387c165 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:32.527479 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4ce213de-0d0f-41b2-a222-d32be387c165 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:32.527943 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4ce213de-0d0f-41b2-a222-d32be387c165 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:32.528367 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4ce213de-0d0f-41b2-a222-d32be387c165 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:32.561388 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-4ce213de-0d0f-41b2-a222-d32be387c165 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] 10.222.0.33 "GET /compute/v2.1/servers/97ffca59-93eb-4c08-8e86-b8642016b65a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049678 Oct 04 21:41:32.562167 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3447/6929] 10.222.0.33 () {58 vars in 1302 bytes} [Tue Oct 4 21:41:32 2022] GET /compute/v2.1/servers/97ffca59-93eb-4c08-8e86-b8642016b65a/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 21:41:32.573038 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-101a78ba-2696-4b08-a035-2e6cfb18cfeb tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:41:32.573564 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-101a78ba-2696-4b08-a035-2e6cfb18cfeb tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] [instance: 97ffca59-93eb-4c08-8e86-b8642016b65a] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:41:32.580448 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-101a78ba-2696-4b08-a035-2e6cfb18cfeb tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:32.580968 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-101a78ba-2696-4b08-a035-2e6cfb18cfeb tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:32.581422 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-101a78ba-2696-4b08-a035-2e6cfb18cfeb tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:32.582148 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-101a78ba-2696-4b08-a035-2e6cfb18cfeb tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:32.582636 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-101a78ba-2696-4b08-a035-2e6cfb18cfeb tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:32.583078 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-101a78ba-2696-4b08-a035-2e6cfb18cfeb tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:32.658929 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.wsgi [None req-101a78ba-2696-4b08-a035-2e6cfb18cfeb tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] HTTP exception thrown: Instance 97ffca59-93eb-4c08-8e86-b8642016b65a is not attached to volume b9d1e357-bece-4aa8-a9e7-e058a786051f Oct 04 21:41:32.660544 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-101a78ba-2696-4b08-a035-2e6cfb18cfeb tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Request method failure captured: Oct 04 21:41:32.660544 n-d-854823-8 devstack@n-api.service[128802]: request: DELETE /compute/v2.1/servers/97ffca59-93eb-4c08-8e86-b8642016b65a/os-volume_attachments/b9d1e357-bece-4aa8-a9e7-e058a786051f HTTP/1.1 Oct 04 21:41:32.660544 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 21:41:32.660544 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 21:41:32.660544 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 21:41:32.660544 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 0 Oct 04 21:41:32.660544 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 21:41:32.660544 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 21:41:32.660544 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 21:41:32.660544 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 21:41:32.660544 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPKhFEFoRS-1U9WWYCOdhstTFgjzzWVo4Kdlla8ljNECBH0ZeAQZ07Hw27MPBSaBFlzV_4qi9Eu46DINt50cMxVm2DonnxZdSlqQJ8JHD_4uFsBbiJHxZKyrnkcBmgh9-dqq8BijGQJUaxIAwajaYfWsUSAKgBoTQIA664d_H8dw_x1w Oct 04 21:41:32.660544 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 21:41:32.660544 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 21:41:32.660544 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 21:41:32.660544 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 21:41:32.660544 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 21:41:32.660544 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 21:41:32.660544 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: a525f5d98a42453897757db171c263c0 Oct 04 21:41:32.660544 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-TestEncryptedCinderVolumes-340742639 Oct 04 21:41:32.660544 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 21:41:32.660544 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 21:41:32.660544 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a525f5d98a42453897757db171c263c0", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a525f5d98a42453897757db171c263c0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a525f5d98a42453897757db171c263c0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a525f5d98a42453897757db171c263c0"}]}] Oct 04 21:41:32.660544 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-TestEncryptedCinderVolumes-340742639 Oct 04 21:41:32.660544 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: a525f5d98a42453897757db171c263c0 Oct 04 21:41:32.660544 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-340742639 Oct 04 21:41:32.660544 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-TestEncryptedCinderVolumes-340742639-project Oct 04 21:41:32.660544 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 21:41:32.660544 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 21:41:32.660544 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: 408632237e174b91939b442954fef918 Oct 04 21:41:32.660544 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-TestEncryptedCinderVolumes-340742639-project Oct 04 21:41:32.660544 n-d-854823-8 devstack@n-api.service[128802]: method: > Oct 04 21:41:32.660544 n-d-854823-8 devstack@n-api.service[128802]: exception: Instance 97ffca59-93eb-4c08-8e86-b8642016b65a is not attached to volume b9d1e357-bece-4aa8-a9e7-e058a786051f Oct 04 21:41:32.660544 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'server_id': '97ffca59-93eb-4c08-8e86-b8642016b65a', 'id': 'b9d1e357-bece-4aa8-a9e7-e058a786051f'} Oct 04 21:41:32.660544 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:41:32.660544 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:41:32.660544 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 04 21:41:32.660544 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 04 21:41:32.660544 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 21:41:32.660544 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 21:41:32.660544 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 04 21:41:32.660544 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 04 21:41:32.660544 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id b9d1e357-bece-4aa8-a9e7-e058a786051f. Oct 04 21:41:32.660544 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:41:32.660544 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:41:32.660544 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:41:32.660544 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:41:32.660544 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:41:32.660544 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:41:32.660544 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:41:32.660544 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:41:32.660544 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:41:32.660544 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:41:32.660544 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 04 21:41:32.660544 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 04 21:41:32.660544 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97ffca59-93eb-4c08-8e86-b8642016b65a is not attached to volume b9d1e357-bece-4aa8-a9e7-e058a786051f Oct 04 21:41:32.660544 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:41:32.660544 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:41:32.660544 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:41:32.660544 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:41:32.660544 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:41:32.660544 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:41:32.665926 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:41:32.665926 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:41:32.665926 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97ffca59-93eb-4c08-8e86-b8642016b65a is not attached to volume b9d1e357-bece-4aa8-a9e7-e058a786051f Oct 04 21:41:32.665926 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:41:32.665926 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-101a78ba-2696-4b08-a035-2e6cfb18cfeb tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Returning 404 to user: Instance 97ffca59-93eb-4c08-8e86-b8642016b65a is not attached to volume b9d1e357-bece-4aa8-a9e7-e058a786051f {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:41:32.665926 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-101a78ba-2696-4b08-a035-2e6cfb18cfeb tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] 10.222.0.33 "DELETE /compute/v2.1/servers/97ffca59-93eb-4c08-8e86-b8642016b65a/os-volume_attachments/b9d1e357-bece-4aa8-a9e7-e058a786051f" status: 404 len: 154 microversion: 2.1 time: 0.093232 Oct 04 21:41:32.665926 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3483/6930] 10.222.0.33 () {58 vars in 1416 bytes} [Tue Oct 4 21:41:32 2022] DELETE /compute/v2.1/servers/97ffca59-93eb-4c08-8e86-b8642016b65a/os-volume_attachments/b9d1e357-bece-4aa8-a9e7-e058a786051f => generated 154 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:41:36.016712 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c43c3e3d-e3a6-4bc2-9773-e9585250cd07 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:41:36.017337 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c43c3e3d-e3a6-4bc2-9773-e9585250cd07 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] [instance: 97ffca59-93eb-4c08-8e86-b8642016b65a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:41:36.025933 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c43c3e3d-e3a6-4bc2-9773-e9585250cd07 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:36.026448 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c43c3e3d-e3a6-4bc2-9773-e9585250cd07 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:36.026884 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c43c3e3d-e3a6-4bc2-9773-e9585250cd07 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:36.027652 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c43c3e3d-e3a6-4bc2-9773-e9585250cd07 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:36.028008 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c43c3e3d-e3a6-4bc2-9773-e9585250cd07 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:36.028432 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c43c3e3d-e3a6-4bc2-9773-e9585250cd07 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:36.056078 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c43c3e3d-e3a6-4bc2-9773-e9585250cd07 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] [instance: 97ffca59-93eb-4c08-8e86-b8642016b65a] Going to try to terminate instance {{(pid=128801) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:41:36.145541 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c43c3e3d-e3a6-4bc2-9773-e9585250cd07 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] 10.222.0.33 "DELETE /compute/v2.1/servers/97ffca59-93eb-4c08-8e86-b8642016b65a" status: 204 len: 0 microversion: 2.1 time: 0.132579 Oct 04 21:41:36.146136 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3448/6931] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 21:41:36 2022] DELETE /compute/v2.1/servers/97ffca59-93eb-4c08-8e86-b8642016b65a => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:41:36.154291 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-e9949396-e085-4407-9a81-33b4270173c1 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:41:36.154951 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-e9949396-e085-4407-9a81-33b4270173c1 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] [instance: 97ffca59-93eb-4c08-8e86-b8642016b65a] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:41:36.163217 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e9949396-e085-4407-9a81-33b4270173c1 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:36.163952 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e9949396-e085-4407-9a81-33b4270173c1 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:36.164399 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e9949396-e085-4407-9a81-33b4270173c1 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:36.165123 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e9949396-e085-4407-9a81-33b4270173c1 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:36.165588 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e9949396-e085-4407-9a81-33b4270173c1 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:36.166026 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e9949396-e085-4407-9a81-33b4270173c1 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:36.387134 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-e9949396-e085-4407-9a81-33b4270173c1 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '408632237e174b91939b442954fef918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a525f5d98a42453897757db171c263c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:41:36.395206 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-e9949396-e085-4407-9a81-33b4270173c1 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] 10.222.0.33 "GET /compute/v2.1/servers/97ffca59-93eb-4c08-8e86-b8642016b65a" status: 200 len: 1560 microversion: 2.1 time: 0.244754 Oct 04 21:41:36.395788 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3484/6932] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:41:36 2022] GET /compute/v2.1/servers/97ffca59-93eb-4c08-8e86-b8642016b65a => generated 1560 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:41:37.420222 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e2d103d3-3cc1-44da-a27c-73dbbc2822dc tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:41:37.420913 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e2d103d3-3cc1-44da-a27c-73dbbc2822dc tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] [instance: 97ffca59-93eb-4c08-8e86-b8642016b65a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:41:37.428860 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e2d103d3-3cc1-44da-a27c-73dbbc2822dc tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:37.429539 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e2d103d3-3cc1-44da-a27c-73dbbc2822dc tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:37.429975 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e2d103d3-3cc1-44da-a27c-73dbbc2822dc tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:37.430699 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e2d103d3-3cc1-44da-a27c-73dbbc2822dc tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:37.431149 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e2d103d3-3cc1-44da-a27c-73dbbc2822dc tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:37.431566 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e2d103d3-3cc1-44da-a27c-73dbbc2822dc tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:37.629791 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e2d103d3-3cc1-44da-a27c-73dbbc2822dc tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '408632237e174b91939b442954fef918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a525f5d98a42453897757db171c263c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:41:37.637913 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e2d103d3-3cc1-44da-a27c-73dbbc2822dc tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] 10.222.0.33 "GET /compute/v2.1/servers/97ffca59-93eb-4c08-8e86-b8642016b65a" status: 200 len: 1560 microversion: 2.1 time: 0.221925 Oct 04 21:41:37.638522 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3449/6933] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:41:37 2022] GET /compute/v2.1/servers/97ffca59-93eb-4c08-8e86-b8642016b65a => generated 1560 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:41:38.325929 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-efebd67c-d0ed-46d6-ba8c-c7ec4e7e58ed req-27083a97-2f68-4376-87fb-ccf008a7bc62 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97ffca59-93eb-4c08-8e86-b8642016b65a", "name": "network-vif-deleted", "tag": "815905eb-4098-4ca9-a91c-afd864ca220d"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:41:38.337782 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-efebd67c-d0ed-46d6-ba8c-c7ec4e7e58ed req-27083a97-2f68-4376-87fb-ccf008a7bc62 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:38.338282 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-efebd67c-d0ed-46d6-ba8c-c7ec4e7e58ed req-27083a97-2f68-4376-87fb-ccf008a7bc62 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:38.338761 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-efebd67c-d0ed-46d6-ba8c-c7ec4e7e58ed req-27083a97-2f68-4376-87fb-ccf008a7bc62 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:38.350765 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-efebd67c-d0ed-46d6-ba8c-c7ec4e7e58ed req-27083a97-2f68-4376-87fb-ccf008a7bc62 service nova] Creating event network-vif-deleted:815905eb-4098-4ca9-a91c-afd864ca220d for instance 97ffca59-93eb-4c08-8e86-b8642016b65a on n-h2-854823-8 Oct 04 21:41:38.357583 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-efebd67c-d0ed-46d6-ba8c-c7ec4e7e58ed req-27083a97-2f68-4376-87fb-ccf008a7bc62 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035291 Oct 04 21:41:38.358390 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3485/6934] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:41:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:41:38.661471 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b5553930-c620-462c-809e-e572db7f4655 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:41:38.662242 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b5553930-c620-462c-809e-e572db7f4655 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] [instance: 97ffca59-93eb-4c08-8e86-b8642016b65a] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:41:38.670103 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b5553930-c620-462c-809e-e572db7f4655 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:38.670729 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b5553930-c620-462c-809e-e572db7f4655 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:38.671236 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b5553930-c620-462c-809e-e572db7f4655 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:38.672023 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b5553930-c620-462c-809e-e572db7f4655 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:38.672574 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b5553930-c620-462c-809e-e572db7f4655 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:38.673073 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b5553930-c620-462c-809e-e572db7f4655 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:38.711326 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b5553930-c620-462c-809e-e572db7f4655 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:38.711817 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b5553930-c620-462c-809e-e572db7f4655 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:38.712258 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b5553930-c620-462c-809e-e572db7f4655 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:38.712813 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-b5553930-c620-462c-809e-e572db7f4655 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lazy-loading 'fault' on Instance uuid 97ffca59-93eb-4c08-8e86-b8642016b65a {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:41:38.757461 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-b5553930-c620-462c-809e-e572db7f4655 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '408632237e174b91939b442954fef918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a525f5d98a42453897757db171c263c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:41:38.766787 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b5553930-c620-462c-809e-e572db7f4655 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] 10.222.0.33 "GET /compute/v2.1/servers/97ffca59-93eb-4c08-8e86-b8642016b65a" status: 200 len: 1353 microversion: 2.1 time: 0.108569 Oct 04 21:41:38.767411 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3450/6935] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:41:38 2022] GET /compute/v2.1/servers/97ffca59-93eb-4c08-8e86-b8642016b65a => generated 1353 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:41:39.792578 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-00ba8c4b-46a5-415f-a14d-fa61778db66c tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:41:39.793320 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-00ba8c4b-46a5-415f-a14d-fa61778db66c tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] [instance: 97ffca59-93eb-4c08-8e86-b8642016b65a] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:41:39.799570 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-00ba8c4b-46a5-415f-a14d-fa61778db66c tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:39.800324 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-00ba8c4b-46a5-415f-a14d-fa61778db66c tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:39.800779 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-00ba8c4b-46a5-415f-a14d-fa61778db66c tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:39.801488 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-00ba8c4b-46a5-415f-a14d-fa61778db66c tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:39.801959 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-00ba8c4b-46a5-415f-a14d-fa61778db66c tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:39.802433 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-00ba8c4b-46a5-415f-a14d-fa61778db66c tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:39.816292 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.wsgi [None req-00ba8c4b-46a5-415f-a14d-fa61778db66c tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] HTTP exception thrown: Instance 97ffca59-93eb-4c08-8e86-b8642016b65a could not be found. Oct 04 21:41:39.817987 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-00ba8c4b-46a5-415f-a14d-fa61778db66c tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Request method failure captured: Oct 04 21:41:39.817987 n-d-854823-8 devstack@n-api.service[128802]: request: GET /compute/v2.1/servers/97ffca59-93eb-4c08-8e86-b8642016b65a HTTP/1.1 Oct 04 21:41:39.817987 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 21:41:39.817987 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 21:41:39.817987 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 21:41:39.817987 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 0 Oct 04 21:41:39.817987 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 21:41:39.817987 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 21:41:39.817987 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 21:41:39.817987 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 21:41:39.817987 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPKhFEFoRS-1U9WWYCOdhstTFgjzzWVo4Kdlla8ljNECBH0ZeAQZ07Hw27MPBSaBFlzV_4qi9Eu46DINt50cMxVm2DonnxZdSlqQJ8JHD_4uFsBbiJHxZKyrnkcBmgh9-dqq8BijGQJUaxIAwajaYfWsUSAKgBoTQIA664d_H8dw_x1w Oct 04 21:41:39.817987 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 21:41:39.817987 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 21:41:39.817987 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 21:41:39.817987 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 21:41:39.817987 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 21:41:39.817987 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 21:41:39.817987 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: a525f5d98a42453897757db171c263c0 Oct 04 21:41:39.817987 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-TestEncryptedCinderVolumes-340742639 Oct 04 21:41:39.817987 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 21:41:39.817987 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 21:41:39.817987 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a525f5d98a42453897757db171c263c0", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a525f5d98a42453897757db171c263c0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a525f5d98a42453897757db171c263c0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a525f5d98a42453897757db171c263c0"}]}] Oct 04 21:41:39.817987 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-TestEncryptedCinderVolumes-340742639 Oct 04 21:41:39.817987 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: a525f5d98a42453897757db171c263c0 Oct 04 21:41:39.817987 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-340742639 Oct 04 21:41:39.817987 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-TestEncryptedCinderVolumes-340742639-project Oct 04 21:41:39.817987 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 21:41:39.817987 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 21:41:39.817987 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: 408632237e174b91939b442954fef918 Oct 04 21:41:39.817987 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-TestEncryptedCinderVolumes-340742639-project Oct 04 21:41:39.817987 n-d-854823-8 devstack@n-api.service[128802]: method: > Oct 04 21:41:39.817987 n-d-854823-8 devstack@n-api.service[128802]: exception: Instance 97ffca59-93eb-4c08-8e86-b8642016b65a could not be found. Oct 04 21:41:39.817987 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'id': '97ffca59-93eb-4c08-8e86-b8642016b65a'} Oct 04 21:41:39.817987 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:41:39.817987 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:41:39.817987 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:41:39.817987 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:41:39.817987 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:41:39.817987 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:41:39.817987 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:41:39.817987 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:41:39.817987 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:41:39.817987 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:41:39.817987 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97ffca59-93eb-4c08-8e86-b8642016b65a could not be found. Oct 04 21:41:39.817987 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:41:39.817987 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:41:39.817987 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:41:39.817987 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:41:39.817987 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:41:39.817987 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:41:39.817987 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:41:39.817987 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:41:39.817987 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:41:39.817987 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:41:39.817987 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:41:39.817987 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:41:39.817987 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:41:39.817987 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:41:39.817987 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:41:39.817987 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:41:39.817987 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97ffca59-93eb-4c08-8e86-b8642016b65a could not be found. Oct 04 21:41:39.817987 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:41:39.817987 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:41:39.817987 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:41:39.823093 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:41:39.823093 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:41:39.823093 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:41:39.823093 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:41:39.823093 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:41:39.823093 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97ffca59-93eb-4c08-8e86-b8642016b65a could not be found. Oct 04 21:41:39.823093 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:41:39.823093 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-00ba8c4b-46a5-415f-a14d-fa61778db66c tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Returning 404 to user: Instance 97ffca59-93eb-4c08-8e86-b8642016b65a could not be found. {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:41:39.823093 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-00ba8c4b-46a5-415f-a14d-fa61778db66c tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] 10.222.0.33 "GET /compute/v2.1/servers/97ffca59-93eb-4c08-8e86-b8642016b65a" status: 404 len: 111 microversion: 2.1 time: 0.032678 Oct 04 21:41:39.823093 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3486/6936] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:41:39 2022] GET /compute/v2.1/servers/97ffca59-93eb-4c08-8e86-b8642016b65a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:41:39.828187 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6d76a61a-0971-4f5d-9e9c-170f4dd93245 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Calling method '.version_select at 0x7f3c743fed30>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:41:39.848937 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-6d76a61a-0971-4f5d-9e9c-170f4dd93245 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1117858347" status: 202 len: 0 microversion: 2.1 time: 0.024357 Oct 04 21:41:39.849443 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3451/6937] 10.222.0.33 () {58 vars in 1278 bytes} [Tue Oct 4 21:41:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1117858347 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 21:41:39.867098 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-cb3fc292-00f7-48d3-8b52-0b04a80371af tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Action: 'create', calling method: .version_select at 0x7f3c6f6aaa60>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-1155527965", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDe0YPi1d2Ro8IHYErlKMoI07sAz6NmurHoX0CYhilb+XKZ+gLRMuOEcSXH8N9woav7CHyuew/jU2XIwgbG5FE2q8BHEgpT/eN+1f4JvB/cHcl9J82TJpsjepWaofaEzKQ=="}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:41:39.884187 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-cb3fc292-00f7-48d3-8b52-0b04a80371af tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Getting quotas for project a525f5d98a42453897757db171c263c0. Resources: {'key_pairs'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:41:39.890470 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-cb3fc292-00f7-48d3-8b52-0b04a80371af tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Getting quotas for user 408632237e174b91939b442954fef918 and project a525f5d98a42453897757db171c263c0. Resources: {'key_pairs'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:41:39.915367 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-cb3fc292-00f7-48d3-8b52-0b04a80371af tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.052302 Oct 04 21:41:39.915995 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3487/6938] 10.222.0.33 () {60 vars in 1159 bytes} [Tue Oct 4 21:41:39 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:41:39.973478 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ffbfb8a7-00a4-41a3-b469-79650806136a tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1338067141", "imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-1155527965", "networks": [{"uuid": "e904ca70-ebac-4660-a6aa-4662f47bc90b"}]}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:41:40.028814 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.network.neutron [None req-ffbfb8a7-00a4-41a3-b469-79650806136a tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] validate_networks() for [('e904ca70-ebac-4660-a6aa-4662f47bc90b', None, None, None, None, None)] {{(pid=128801) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:41:40.428462 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-ffbfb8a7-00a4-41a3-b469-79650806136a tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Flavor limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:41:40.428883 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-ffbfb8a7-00a4-41a3-b469-79650806136a tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Image limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:41:40.429368 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-ffbfb8a7-00a4-41a3-b469-79650806136a tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Flavor pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:41:40.429780 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-ffbfb8a7-00a4-41a3-b469-79650806136a tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Image pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:41:40.430200 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-ffbfb8a7-00a4-41a3-b469-79650806136a tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:41:40.439947 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ffbfb8a7-00a4-41a3-b469-79650806136a tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:40.440430 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ffbfb8a7-00a4-41a3-b469-79650806136a tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:40.440872 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ffbfb8a7-00a4-41a3-b469-79650806136a tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:40.441602 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ffbfb8a7-00a4-41a3-b469-79650806136a tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:40.442057 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ffbfb8a7-00a4-41a3-b469-79650806136a tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:40.442696 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ffbfb8a7-00a4-41a3-b469-79650806136a tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:40.462028 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-ffbfb8a7-00a4-41a3-b469-79650806136a tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Getting quotas for project a525f5d98a42453897757db171c263c0. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:41:40.467587 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-ffbfb8a7-00a4-41a3-b469-79650806136a tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Getting quotas for user 408632237e174b91939b442954fef918 and project a525f5d98a42453897757db171c263c0. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:41:40.480511 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ffbfb8a7-00a4-41a3-b469-79650806136a tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Going to run 1 instances... {{(pid=128801) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:41:40.482962 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ffbfb8a7-00a4-41a3-b469-79650806136a tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] [instance: 28fe0c71-b848-42d9-8920-7adda9d5bb96] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='15b24725-0c99-4bcf-b1fb-907cdf8e2d63',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128801) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:41:40.534658 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ffbfb8a7-00a4-41a3-b469-79650806136a tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.565012 Oct 04 21:41:40.535343 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3452/6939] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 21:41:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 567 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:41:40.548056 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-92c53882-7cd6-4979-8be9-d2ff298b7b04 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:41:40.549003 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-92c53882-7cd6-4979-8be9-d2ff298b7b04 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] [instance: 28fe0c71-b848-42d9-8920-7adda9d5bb96] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:41:40.618839 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-92c53882-7cd6-4979-8be9-d2ff298b7b04 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '408632237e174b91939b442954fef918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a525f5d98a42453897757db171c263c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:41:40.625899 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-92c53882-7cd6-4979-8be9-d2ff298b7b04 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] 10.222.0.33 "GET /compute/v2.1/servers/28fe0c71-b848-42d9-8920-7adda9d5bb96" status: 200 len: 1263 microversion: 2.1 time: 0.082367 Oct 04 21:41:40.626514 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3488/6940] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:41:40 2022] GET /compute/v2.1/servers/28fe0c71-b848-42d9-8920-7adda9d5bb96 => generated 1263 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:41:41.649528 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-727c586f-9e46-46ef-847b-432d679224cf tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:41:41.650151 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-727c586f-9e46-46ef-847b-432d679224cf tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] [instance: 28fe0c71-b848-42d9-8920-7adda9d5bb96] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:41:41.658747 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-727c586f-9e46-46ef-847b-432d679224cf tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:41.659216 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-727c586f-9e46-46ef-847b-432d679224cf tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:41.659648 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-727c586f-9e46-46ef-847b-432d679224cf tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:41.660337 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-727c586f-9e46-46ef-847b-432d679224cf tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:41.660784 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-727c586f-9e46-46ef-847b-432d679224cf tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:41.661220 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-727c586f-9e46-46ef-847b-432d679224cf tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:41.769063 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-727c586f-9e46-46ef-847b-432d679224cf tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '408632237e174b91939b442954fef918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a525f5d98a42453897757db171c263c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:41:41.777784 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-727c586f-9e46-46ef-847b-432d679224cf tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] 10.222.0.33 "GET /compute/v2.1/servers/28fe0c71-b848-42d9-8920-7adda9d5bb96" status: 200 len: 1323 microversion: 2.1 time: 0.132659 Oct 04 21:41:41.778393 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3453/6941] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:41:41 2022] GET /compute/v2.1/servers/28fe0c71-b848-42d9-8920-7adda9d5bb96 => generated 1323 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:41:42.801523 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-34d06aa3-c348-40b6-836d-3a1d04c9385d tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:41:42.802149 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-34d06aa3-c348-40b6-836d-3a1d04c9385d tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] [instance: 28fe0c71-b848-42d9-8920-7adda9d5bb96] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:41:42.809281 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-34d06aa3-c348-40b6-836d-3a1d04c9385d tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:42.809782 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-34d06aa3-c348-40b6-836d-3a1d04c9385d tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:42.810256 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-34d06aa3-c348-40b6-836d-3a1d04c9385d tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:42.811008 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-34d06aa3-c348-40b6-836d-3a1d04c9385d tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:42.811471 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-34d06aa3-c348-40b6-836d-3a1d04c9385d tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:42.811939 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-34d06aa3-c348-40b6-836d-3a1d04c9385d tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:43.055482 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-34d06aa3-c348-40b6-836d-3a1d04c9385d tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '408632237e174b91939b442954fef918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a525f5d98a42453897757db171c263c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:41:43.063640 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-34d06aa3-c348-40b6-836d-3a1d04c9385d tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] 10.222.0.33 "GET /compute/v2.1/servers/28fe0c71-b848-42d9-8920-7adda9d5bb96" status: 200 len: 1363 microversion: 2.1 time: 0.266204 Oct 04 21:41:43.064251 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3489/6942] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:41:42 2022] GET /compute/v2.1/servers/28fe0c71-b848-42d9-8920-7adda9d5bb96 => generated 1363 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:41:43.267887 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-1c516227-85c5-4e69-a4ca-d8b794fef35d req-6ef97295-8579-4d29-bbd9-349132e8b86c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "28fe0c71-b848-42d9-8920-7adda9d5bb96", "tag": "75de72b4-a53c-478c-9c48-f823b30f23cc"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:41:43.281036 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-1c516227-85c5-4e69-a4ca-d8b794fef35d req-6ef97295-8579-4d29-bbd9-349132e8b86c service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:43.281656 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-1c516227-85c5-4e69-a4ca-d8b794fef35d req-6ef97295-8579-4d29-bbd9-349132e8b86c service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:43.282145 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-1c516227-85c5-4e69-a4ca-d8b794fef35d req-6ef97295-8579-4d29-bbd9-349132e8b86c service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:43.295083 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-1c516227-85c5-4e69-a4ca-d8b794fef35d req-6ef97295-8579-4d29-bbd9-349132e8b86c service nova] Creating event network-changed:75de72b4-a53c-478c-9c48-f823b30f23cc for instance 28fe0c71-b848-42d9-8920-7adda9d5bb96 on n-h2-854823-8 Oct 04 21:41:43.300677 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-1c516227-85c5-4e69-a4ca-d8b794fef35d req-6ef97295-8579-4d29-bbd9-349132e8b86c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037088 Oct 04 21:41:43.301452 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3454/6943] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:41:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:41:44.088177 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-b04d361d-f4f8-437e-a454-642afbc8f96e tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:41:44.089411 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-b04d361d-f4f8-437e-a454-642afbc8f96e tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] [instance: 28fe0c71-b848-42d9-8920-7adda9d5bb96] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:41:44.096770 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b04d361d-f4f8-437e-a454-642afbc8f96e tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:44.097280 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b04d361d-f4f8-437e-a454-642afbc8f96e tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:44.097743 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b04d361d-f4f8-437e-a454-642afbc8f96e tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:44.098520 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b04d361d-f4f8-437e-a454-642afbc8f96e tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:44.099001 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b04d361d-f4f8-437e-a454-642afbc8f96e tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:44.099447 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b04d361d-f4f8-437e-a454-642afbc8f96e tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:44.236703 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-b04d361d-f4f8-437e-a454-642afbc8f96e tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '408632237e174b91939b442954fef918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a525f5d98a42453897757db171c263c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:41:44.245708 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-b04d361d-f4f8-437e-a454-642afbc8f96e tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] 10.222.0.33 "GET /compute/v2.1/servers/28fe0c71-b848-42d9-8920-7adda9d5bb96" status: 200 len: 1363 microversion: 2.1 time: 0.162054 Oct 04 21:41:44.246302 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3490/6944] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:41:44 2022] GET /compute/v2.1/servers/28fe0c71-b848-42d9-8920-7adda9d5bb96 => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:41:45.270618 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-bc1cb006-beef-4978-8d8e-a8583a44cc79 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:41:45.271226 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-bc1cb006-beef-4978-8d8e-a8583a44cc79 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] [instance: 28fe0c71-b848-42d9-8920-7adda9d5bb96] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:41:45.278738 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bc1cb006-beef-4978-8d8e-a8583a44cc79 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:45.279224 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bc1cb006-beef-4978-8d8e-a8583a44cc79 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:45.279660 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bc1cb006-beef-4978-8d8e-a8583a44cc79 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:45.280361 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bc1cb006-beef-4978-8d8e-a8583a44cc79 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:45.280812 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bc1cb006-beef-4978-8d8e-a8583a44cc79 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:45.281234 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bc1cb006-beef-4978-8d8e-a8583a44cc79 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:45.424181 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-bc1cb006-beef-4978-8d8e-a8583a44cc79 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '408632237e174b91939b442954fef918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a525f5d98a42453897757db171c263c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:41:45.433660 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-bc1cb006-beef-4978-8d8e-a8583a44cc79 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] 10.222.0.33 "GET /compute/v2.1/servers/28fe0c71-b848-42d9-8920-7adda9d5bb96" status: 200 len: 1363 microversion: 2.1 time: 0.168123 Oct 04 21:41:45.434278 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3455/6945] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:41:45 2022] GET /compute/v2.1/servers/28fe0c71-b848-42d9-8920-7adda9d5bb96 => generated 1363 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:41:46.458164 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-ecdf37cb-09db-4938-8007-049a6d5bbc15 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:41:46.458909 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-ecdf37cb-09db-4938-8007-049a6d5bbc15 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] [instance: 28fe0c71-b848-42d9-8920-7adda9d5bb96] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:41:46.466300 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ecdf37cb-09db-4938-8007-049a6d5bbc15 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:46.467040 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ecdf37cb-09db-4938-8007-049a6d5bbc15 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:46.467488 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ecdf37cb-09db-4938-8007-049a6d5bbc15 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:46.468414 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ecdf37cb-09db-4938-8007-049a6d5bbc15 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:46.468962 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ecdf37cb-09db-4938-8007-049a6d5bbc15 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:46.469405 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ecdf37cb-09db-4938-8007-049a6d5bbc15 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:46.608723 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-ecdf37cb-09db-4938-8007-049a6d5bbc15 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '408632237e174b91939b442954fef918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a525f5d98a42453897757db171c263c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:41:46.617070 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-ecdf37cb-09db-4938-8007-049a6d5bbc15 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] 10.222.0.33 "GET /compute/v2.1/servers/28fe0c71-b848-42d9-8920-7adda9d5bb96" status: 200 len: 1363 microversion: 2.1 time: 0.162823 Oct 04 21:41:46.617640 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3491/6946] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:41:46 2022] GET /compute/v2.1/servers/28fe0c71-b848-42d9-8920-7adda9d5bb96 => generated 1363 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:41:47.640637 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e5c24e9e-45d7-4908-8141-987284b229e5 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:41:47.641249 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e5c24e9e-45d7-4908-8141-987284b229e5 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] [instance: 28fe0c71-b848-42d9-8920-7adda9d5bb96] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:41:47.648921 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e5c24e9e-45d7-4908-8141-987284b229e5 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:47.649405 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e5c24e9e-45d7-4908-8141-987284b229e5 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:47.649843 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e5c24e9e-45d7-4908-8141-987284b229e5 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:47.650571 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e5c24e9e-45d7-4908-8141-987284b229e5 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:47.651033 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e5c24e9e-45d7-4908-8141-987284b229e5 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:47.651458 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e5c24e9e-45d7-4908-8141-987284b229e5 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:47.784418 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e5c24e9e-45d7-4908-8141-987284b229e5 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '408632237e174b91939b442954fef918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a525f5d98a42453897757db171c263c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:41:47.792957 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e5c24e9e-45d7-4908-8141-987284b229e5 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] 10.222.0.33 "GET /compute/v2.1/servers/28fe0c71-b848-42d9-8920-7adda9d5bb96" status: 200 len: 1363 microversion: 2.1 time: 0.156378 Oct 04 21:41:47.793792 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3456/6947] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:41:47 2022] GET /compute/v2.1/servers/28fe0c71-b848-42d9-8920-7adda9d5bb96 => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:41:48.454084 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-7bfb51c0-6e2d-45d0-8fe6-73109c2d672e req-2f65f8bb-009a-4460-9cf8-5c0129d23fa5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28fe0c71-b848-42d9-8920-7adda9d5bb96", "name": "network-vif-plugged", "status": "completed", "tag": "75de72b4-a53c-478c-9c48-f823b30f23cc"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:41:48.465194 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-7bfb51c0-6e2d-45d0-8fe6-73109c2d672e req-2f65f8bb-009a-4460-9cf8-5c0129d23fa5 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:48.465675 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-7bfb51c0-6e2d-45d0-8fe6-73109c2d672e req-2f65f8bb-009a-4460-9cf8-5c0129d23fa5 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:48.466126 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-7bfb51c0-6e2d-45d0-8fe6-73109c2d672e req-2f65f8bb-009a-4460-9cf8-5c0129d23fa5 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:48.478053 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-7bfb51c0-6e2d-45d0-8fe6-73109c2d672e req-2f65f8bb-009a-4460-9cf8-5c0129d23fa5 service nova] Creating event network-vif-plugged:75de72b4-a53c-478c-9c48-f823b30f23cc for instance 28fe0c71-b848-42d9-8920-7adda9d5bb96 on n-h2-854823-8 Oct 04 21:41:48.483260 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-7bfb51c0-6e2d-45d0-8fe6-73109c2d672e req-2f65f8bb-009a-4460-9cf8-5c0129d23fa5 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033313 Oct 04 21:41:48.483863 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3492/6948] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:41:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:41:48.815336 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-4acfe024-0f7b-46bf-9e72-cfe2d7159c6d tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:41:48.815944 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-4acfe024-0f7b-46bf-9e72-cfe2d7159c6d tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] [instance: 28fe0c71-b848-42d9-8920-7adda9d5bb96] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:41:48.823573 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4acfe024-0f7b-46bf-9e72-cfe2d7159c6d tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:48.824051 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4acfe024-0f7b-46bf-9e72-cfe2d7159c6d tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:48.824480 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4acfe024-0f7b-46bf-9e72-cfe2d7159c6d tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:48.825167 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4acfe024-0f7b-46bf-9e72-cfe2d7159c6d tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:48.825618 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4acfe024-0f7b-46bf-9e72-cfe2d7159c6d tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:48.826039 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4acfe024-0f7b-46bf-9e72-cfe2d7159c6d tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:48.957476 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-4acfe024-0f7b-46bf-9e72-cfe2d7159c6d tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '408632237e174b91939b442954fef918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a525f5d98a42453897757db171c263c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:41:48.965885 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-4acfe024-0f7b-46bf-9e72-cfe2d7159c6d tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] 10.222.0.33 "GET /compute/v2.1/servers/28fe0c71-b848-42d9-8920-7adda9d5bb96" status: 200 len: 1363 microversion: 2.1 time: 0.154403 Oct 04 21:41:48.966489 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3457/6949] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:41:48 2022] GET /compute/v2.1/servers/28fe0c71-b848-42d9-8920-7adda9d5bb96 => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:41:49.991616 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-96338e42-c15e-423f-a457-c9be704da51d tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:41:49.992330 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-96338e42-c15e-423f-a457-c9be704da51d tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] [instance: 28fe0c71-b848-42d9-8920-7adda9d5bb96] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:41:49.998710 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-96338e42-c15e-423f-a457-c9be704da51d tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:49.999196 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-96338e42-c15e-423f-a457-c9be704da51d tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:49.999640 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-96338e42-c15e-423f-a457-c9be704da51d tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:50.000353 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-96338e42-c15e-423f-a457-c9be704da51d tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:50.000816 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-96338e42-c15e-423f-a457-c9be704da51d tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:50.001261 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-96338e42-c15e-423f-a457-c9be704da51d tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:50.145218 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-96338e42-c15e-423f-a457-c9be704da51d tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '408632237e174b91939b442954fef918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a525f5d98a42453897757db171c263c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:41:50.153268 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-96338e42-c15e-423f-a457-c9be704da51d tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] 10.222.0.33 "GET /compute/v2.1/servers/28fe0c71-b848-42d9-8920-7adda9d5bb96" status: 200 len: 1553 microversion: 2.1 time: 0.167298 Oct 04 21:41:50.153841 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3493/6950] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:41:49 2022] GET /compute/v2.1/servers/28fe0c71-b848-42d9-8920-7adda9d5bb96 => generated 1553 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:41:50.179724 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-24e13549-107f-4f7f-896b-b05046e77c03 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:41:50.180350 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-24e13549-107f-4f7f-896b-b05046e77c03 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] [instance: 28fe0c71-b848-42d9-8920-7adda9d5bb96] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:41:50.188077 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-24e13549-107f-4f7f-896b-b05046e77c03 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:50.188627 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-24e13549-107f-4f7f-896b-b05046e77c03 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:50.189115 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-24e13549-107f-4f7f-896b-b05046e77c03 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:50.189840 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-24e13549-107f-4f7f-896b-b05046e77c03 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:50.190309 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-24e13549-107f-4f7f-896b-b05046e77c03 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:50.190766 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-24e13549-107f-4f7f-896b-b05046e77c03 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:50.322632 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-24e13549-107f-4f7f-896b-b05046e77c03 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '408632237e174b91939b442954fef918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a525f5d98a42453897757db171c263c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:41:50.330412 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-24e13549-107f-4f7f-896b-b05046e77c03 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] 10.222.0.33 "GET /compute/v2.1/servers/28fe0c71-b848-42d9-8920-7adda9d5bb96" status: 200 len: 1553 microversion: 2.1 time: 0.155671 Oct 04 21:41:50.330982 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3458/6951] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:41:50 2022] GET /compute/v2.1/servers/28fe0c71-b848-42d9-8920-7adda9d5bb96 => generated 1553 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:41:51.838806 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-2eea51b1-0f55-4b0b-833a-485aa5e3fcf6 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "45659fa9-a099-4483-8e14-8a7ce3d252d5"}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:41:51.841144 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-2eea51b1-0f55-4b0b-833a-485aa5e3fcf6 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] [instance: 28fe0c71-b848-42d9-8920-7adda9d5bb96] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:41:51.843140 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell0:SELECT=6 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:41:51.849292 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2eea51b1-0f55-4b0b-833a-485aa5e3fcf6 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:51.850010 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2eea51b1-0f55-4b0b-833a-485aa5e3fcf6 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:51.850834 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2eea51b1-0f55-4b0b-833a-485aa5e3fcf6 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:51.851533 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2eea51b1-0f55-4b0b-833a-485aa5e3fcf6 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:41:51.851998 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2eea51b1-0f55-4b0b-833a-485aa5e3fcf6 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:41:51.852434 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2eea51b1-0f55-4b0b-833a-485aa5e3fcf6 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:41:52.120591 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-2eea51b1-0f55-4b0b-833a-485aa5e3fcf6 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] 10.222.0.33 "POST /compute/v2.1/servers/28fe0c71-b848-42d9-8920-7adda9d5bb96/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.285974 Oct 04 21:41:52.121233 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3494/6952] 10.222.0.33 () {60 vars in 1323 bytes} [Tue Oct 4 21:41:51 2022] POST /compute/v2.1/servers/28fe0c71-b848-42d9-8920-7adda9d5bb96/os-volume_attachments => generated 194 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:42:02.873023 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7d36391f-b6d8-4769-8c4d-dd8daed9e8bc tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:42:02.873580 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-7d36391f-b6d8-4769-8c4d-dd8daed9e8bc tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] [instance: 28fe0c71-b848-42d9-8920-7adda9d5bb96] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:42:02.875739 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:42:02.876432 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=6 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:42:02.877702 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:42:02.878509 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=89,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:42:02.886175 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7d36391f-b6d8-4769-8c4d-dd8daed9e8bc tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:42:02.886690 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7d36391f-b6d8-4769-8c4d-dd8daed9e8bc tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:42:02.887134 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7d36391f-b6d8-4769-8c4d-dd8daed9e8bc tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:42:02.887838 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7d36391f-b6d8-4769-8c4d-dd8daed9e8bc tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:42:02.888299 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7d36391f-b6d8-4769-8c4d-dd8daed9e8bc tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:42:02.888736 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7d36391f-b6d8-4769-8c4d-dd8daed9e8bc tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:42:02.975219 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-7d36391f-b6d8-4769-8c4d-dd8daed9e8bc tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lazy-loading 'services' on Instance uuid 28fe0c71-b848-42d9-8920-7adda9d5bb96 {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:42:03.050448 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-7d36391f-b6d8-4769-8c4d-dd8daed9e8bc tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] 10.222.0.33 "DELETE /compute/v2.1/servers/28fe0c71-b848-42d9-8920-7adda9d5bb96/os-volume_attachments/45659fa9-a099-4483-8e14-8a7ce3d252d5" status: 202 len: 0 microversion: 2.1 time: 0.181042 Oct 04 21:42:03.051064 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3459/6953] 10.222.0.33 () {58 vars in 1416 bytes} [Tue Oct 4 21:42:02 2022] DELETE /compute/v2.1/servers/28fe0c71-b848-42d9-8920-7adda9d5bb96/os-volume_attachments/45659fa9-a099-4483-8e14-8a7ce3d252d5 => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:42:03.059378 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:42:03.060413 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:42:03.065155 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-71240c74-56a6-40b4-bfc9-7ce49dc18bd8 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:42:03.067617 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-71240c74-56a6-40b4-bfc9-7ce49dc18bd8 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] [instance: 28fe0c71-b848-42d9-8920-7adda9d5bb96] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:42:03.077254 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-71240c74-56a6-40b4-bfc9-7ce49dc18bd8 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:42:03.077770 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-71240c74-56a6-40b4-bfc9-7ce49dc18bd8 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:42:03.078242 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-71240c74-56a6-40b4-bfc9-7ce49dc18bd8 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:42:03.078997 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-71240c74-56a6-40b4-bfc9-7ce49dc18bd8 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:42:03.079476 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-71240c74-56a6-40b4-bfc9-7ce49dc18bd8 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:42:03.079931 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-71240c74-56a6-40b4-bfc9-7ce49dc18bd8 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:42:03.114319 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-71240c74-56a6-40b4-bfc9-7ce49dc18bd8 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] 10.222.0.33 "GET /compute/v2.1/servers/28fe0c71-b848-42d9-8920-7adda9d5bb96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057924 Oct 04 21:42:03.114939 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3495/6954] 10.222.0.33 () {58 vars in 1302 bytes} [Tue Oct 4 21:42:03 2022] GET /compute/v2.1/servers/28fe0c71-b848-42d9-8920-7adda9d5bb96/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:42:04.128812 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9be54007-7344-41a8-a225-72b1b5f40ad8 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:42:04.131501 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-9be54007-7344-41a8-a225-72b1b5f40ad8 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] [instance: 28fe0c71-b848-42d9-8920-7adda9d5bb96] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:42:04.140906 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9be54007-7344-41a8-a225-72b1b5f40ad8 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:42:04.141208 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9be54007-7344-41a8-a225-72b1b5f40ad8 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:42:04.141689 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9be54007-7344-41a8-a225-72b1b5f40ad8 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:42:04.142541 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9be54007-7344-41a8-a225-72b1b5f40ad8 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:42:04.143078 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9be54007-7344-41a8-a225-72b1b5f40ad8 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:42:04.143580 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9be54007-7344-41a8-a225-72b1b5f40ad8 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:42:04.178389 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-9be54007-7344-41a8-a225-72b1b5f40ad8 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] 10.222.0.33 "GET /compute/v2.1/servers/28fe0c71-b848-42d9-8920-7adda9d5bb96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054899 Oct 04 21:42:04.179112 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3460/6955] 10.222.0.33 () {58 vars in 1302 bytes} [Tue Oct 4 21:42:04 2022] GET /compute/v2.1/servers/28fe0c71-b848-42d9-8920-7adda9d5bb96/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:42:05.192174 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-7714fd57-641b-4af6-a151-2e8ce44e0242 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:42:05.194696 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-7714fd57-641b-4af6-a151-2e8ce44e0242 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] [instance: 28fe0c71-b848-42d9-8920-7adda9d5bb96] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:42:05.201904 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7714fd57-641b-4af6-a151-2e8ce44e0242 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:42:05.202441 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7714fd57-641b-4af6-a151-2e8ce44e0242 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:42:05.202892 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7714fd57-641b-4af6-a151-2e8ce44e0242 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:42:05.203666 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7714fd57-641b-4af6-a151-2e8ce44e0242 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:42:05.204157 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7714fd57-641b-4af6-a151-2e8ce44e0242 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:42:05.204576 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7714fd57-641b-4af6-a151-2e8ce44e0242 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:42:05.241558 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-7714fd57-641b-4af6-a151-2e8ce44e0242 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] 10.222.0.33 "GET /compute/v2.1/servers/28fe0c71-b848-42d9-8920-7adda9d5bb96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053505 Oct 04 21:42:05.242145 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3496/6956] 10.222.0.33 () {58 vars in 1302 bytes} [Tue Oct 4 21:42:05 2022] GET /compute/v2.1/servers/28fe0c71-b848-42d9-8920-7adda9d5bb96/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:42:06.254669 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a6ce17e4-b69f-4c69-85da-79b009c1e745 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:42:06.256797 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a6ce17e4-b69f-4c69-85da-79b009c1e745 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] [instance: 28fe0c71-b848-42d9-8920-7adda9d5bb96] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:42:06.264218 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a6ce17e4-b69f-4c69-85da-79b009c1e745 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:42:06.264696 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a6ce17e4-b69f-4c69-85da-79b009c1e745 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:42:06.265130 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a6ce17e4-b69f-4c69-85da-79b009c1e745 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:42:06.265819 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a6ce17e4-b69f-4c69-85da-79b009c1e745 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:42:06.266267 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a6ce17e4-b69f-4c69-85da-79b009c1e745 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:42:06.266717 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a6ce17e4-b69f-4c69-85da-79b009c1e745 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:42:06.306542 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a6ce17e4-b69f-4c69-85da-79b009c1e745 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] 10.222.0.33 "GET /compute/v2.1/servers/28fe0c71-b848-42d9-8920-7adda9d5bb96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055946 Oct 04 21:42:06.307115 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3461/6957] 10.222.0.33 () {58 vars in 1302 bytes} [Tue Oct 4 21:42:06 2022] GET /compute/v2.1/servers/28fe0c71-b848-42d9-8920-7adda9d5bb96/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:42:07.319183 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-b413b3d4-f577-4332-992d-17bf8bd45c5b tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:42:07.321405 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-b413b3d4-f577-4332-992d-17bf8bd45c5b tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] [instance: 28fe0c71-b848-42d9-8920-7adda9d5bb96] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:42:07.328272 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b413b3d4-f577-4332-992d-17bf8bd45c5b tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:42:07.328768 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b413b3d4-f577-4332-992d-17bf8bd45c5b tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:42:07.329210 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b413b3d4-f577-4332-992d-17bf8bd45c5b tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:42:07.329918 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b413b3d4-f577-4332-992d-17bf8bd45c5b tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:42:07.330396 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b413b3d4-f577-4332-992d-17bf8bd45c5b tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:42:07.330835 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b413b3d4-f577-4332-992d-17bf8bd45c5b tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:42:07.361803 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-b413b3d4-f577-4332-992d-17bf8bd45c5b tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] 10.222.0.33 "GET /compute/v2.1/servers/28fe0c71-b848-42d9-8920-7adda9d5bb96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046734 Oct 04 21:42:07.362388 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3497/6958] 10.222.0.33 () {58 vars in 1302 bytes} [Tue Oct 4 21:42:07 2022] GET /compute/v2.1/servers/28fe0c71-b848-42d9-8920-7adda9d5bb96/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:42:08.374795 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-74ee7673-0721-4f42-b303-edb529991ec4 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:42:08.376944 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-74ee7673-0721-4f42-b303-edb529991ec4 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] [instance: 28fe0c71-b848-42d9-8920-7adda9d5bb96] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:42:08.384021 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-74ee7673-0721-4f42-b303-edb529991ec4 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:42:08.384501 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-74ee7673-0721-4f42-b303-edb529991ec4 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:42:08.384933 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-74ee7673-0721-4f42-b303-edb529991ec4 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:42:08.385616 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-74ee7673-0721-4f42-b303-edb529991ec4 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:42:08.386064 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-74ee7673-0721-4f42-b303-edb529991ec4 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:42:08.386519 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-74ee7673-0721-4f42-b303-edb529991ec4 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:42:08.416140 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-74ee7673-0721-4f42-b303-edb529991ec4 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] 10.222.0.33 "GET /compute/v2.1/servers/28fe0c71-b848-42d9-8920-7adda9d5bb96/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045421 Oct 04 21:42:08.416703 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3462/6959] 10.222.0.33 () {58 vars in 1302 bytes} [Tue Oct 4 21:42:08 2022] GET /compute/v2.1/servers/28fe0c71-b848-42d9-8920-7adda9d5bb96/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 21:42:08.427699 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-8e1bc04c-fd0f-4635-b27b-04c9ee2f95dd tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:42:08.428189 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-8e1bc04c-fd0f-4635-b27b-04c9ee2f95dd tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] [instance: 28fe0c71-b848-42d9-8920-7adda9d5bb96] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:42:08.436654 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8e1bc04c-fd0f-4635-b27b-04c9ee2f95dd tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:42:08.437156 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8e1bc04c-fd0f-4635-b27b-04c9ee2f95dd tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:42:08.437608 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8e1bc04c-fd0f-4635-b27b-04c9ee2f95dd tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:42:08.438329 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8e1bc04c-fd0f-4635-b27b-04c9ee2f95dd tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:42:08.438827 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8e1bc04c-fd0f-4635-b27b-04c9ee2f95dd tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:42:08.439268 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8e1bc04c-fd0f-4635-b27b-04c9ee2f95dd tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:42:08.520119 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.wsgi [None req-8e1bc04c-fd0f-4635-b27b-04c9ee2f95dd tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] HTTP exception thrown: Instance 28fe0c71-b848-42d9-8920-7adda9d5bb96 is not attached to volume 45659fa9-a099-4483-8e14-8a7ce3d252d5 Oct 04 21:42:08.521765 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-8e1bc04c-fd0f-4635-b27b-04c9ee2f95dd tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Request method failure captured: Oct 04 21:42:08.521765 n-d-854823-8 devstack@n-api.service[128802]: request: DELETE /compute/v2.1/servers/28fe0c71-b848-42d9-8920-7adda9d5bb96/os-volume_attachments/45659fa9-a099-4483-8e14-8a7ce3d252d5 HTTP/1.1 Oct 04 21:42:08.521765 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 21:42:08.521765 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 21:42:08.521765 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 21:42:08.521765 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 0 Oct 04 21:42:08.521765 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 21:42:08.521765 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 21:42:08.521765 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 21:42:08.521765 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 21:42:08.521765 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPKhFEFoRS-1U9WWYCOdhstTFgjzzWVo4Kdlla8ljNECBH0ZeAQZ07Hw27MPBSaBFlzV_4qi9Eu46DINt50cMxVm2DonnxZdSlqQJ8JHD_4uFsBbiJHxZKyrnkcBmgh9-dqq8BijGQJUaxIAwajaYfWsUSAKgBoTQIA664d_H8dw_x1w Oct 04 21:42:08.521765 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 21:42:08.521765 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 21:42:08.521765 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 21:42:08.521765 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 21:42:08.521765 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 21:42:08.521765 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 21:42:08.521765 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: a525f5d98a42453897757db171c263c0 Oct 04 21:42:08.521765 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-TestEncryptedCinderVolumes-340742639 Oct 04 21:42:08.521765 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 21:42:08.521765 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 21:42:08.521765 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a525f5d98a42453897757db171c263c0", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a525f5d98a42453897757db171c263c0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a525f5d98a42453897757db171c263c0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a525f5d98a42453897757db171c263c0"}]}] Oct 04 21:42:08.521765 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-TestEncryptedCinderVolumes-340742639 Oct 04 21:42:08.521765 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: a525f5d98a42453897757db171c263c0 Oct 04 21:42:08.521765 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-340742639 Oct 04 21:42:08.521765 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-TestEncryptedCinderVolumes-340742639-project Oct 04 21:42:08.521765 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 21:42:08.521765 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 21:42:08.521765 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: 408632237e174b91939b442954fef918 Oct 04 21:42:08.521765 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-TestEncryptedCinderVolumes-340742639-project Oct 04 21:42:08.521765 n-d-854823-8 devstack@n-api.service[128802]: method: > Oct 04 21:42:08.521765 n-d-854823-8 devstack@n-api.service[128802]: exception: Instance 28fe0c71-b848-42d9-8920-7adda9d5bb96 is not attached to volume 45659fa9-a099-4483-8e14-8a7ce3d252d5 Oct 04 21:42:08.521765 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'server_id': '28fe0c71-b848-42d9-8920-7adda9d5bb96', 'id': '45659fa9-a099-4483-8e14-8a7ce3d252d5'} Oct 04 21:42:08.521765 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:42:08.521765 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:42:08.521765 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 04 21:42:08.521765 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 04 21:42:08.521765 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 21:42:08.521765 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 21:42:08.521765 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 04 21:42:08.521765 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 04 21:42:08.521765 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 45659fa9-a099-4483-8e14-8a7ce3d252d5. Oct 04 21:42:08.521765 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:42:08.521765 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:42:08.521765 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:42:08.521765 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:42:08.521765 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:42:08.521765 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:42:08.521765 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:42:08.521765 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:42:08.521765 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:42:08.521765 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:42:08.521765 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 04 21:42:08.521765 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 04 21:42:08.521765 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 28fe0c71-b848-42d9-8920-7adda9d5bb96 is not attached to volume 45659fa9-a099-4483-8e14-8a7ce3d252d5 Oct 04 21:42:08.521765 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:42:08.521765 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:42:08.521765 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:42:08.521765 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:42:08.521765 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:42:08.521765 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:42:08.529407 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:42:08.529407 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:42:08.529407 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 28fe0c71-b848-42d9-8920-7adda9d5bb96 is not attached to volume 45659fa9-a099-4483-8e14-8a7ce3d252d5 Oct 04 21:42:08.529407 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:42:08.529407 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-8e1bc04c-fd0f-4635-b27b-04c9ee2f95dd tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Returning 404 to user: Instance 28fe0c71-b848-42d9-8920-7adda9d5bb96 is not attached to volume 45659fa9-a099-4483-8e14-8a7ce3d252d5 {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:42:08.529407 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-8e1bc04c-fd0f-4635-b27b-04c9ee2f95dd tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] 10.222.0.33 "DELETE /compute/v2.1/servers/28fe0c71-b848-42d9-8920-7adda9d5bb96/os-volume_attachments/45659fa9-a099-4483-8e14-8a7ce3d252d5" status: 404 len: 154 microversion: 2.1 time: 0.099981 Oct 04 21:42:08.529407 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3498/6960] 10.222.0.33 () {58 vars in 1416 bytes} [Tue Oct 4 21:42:08 2022] DELETE /compute/v2.1/servers/28fe0c71-b848-42d9-8920-7adda9d5bb96/os-volume_attachments/45659fa9-a099-4483-8e14-8a7ce3d252d5 => generated 154 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:42:11.893495 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c9dcaa30-abbe-45b0-909f-f724ba4474b2 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:42:11.893995 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c9dcaa30-abbe-45b0-909f-f724ba4474b2 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] [instance: 28fe0c71-b848-42d9-8920-7adda9d5bb96] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:42:11.901720 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c9dcaa30-abbe-45b0-909f-f724ba4474b2 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:42:11.902205 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c9dcaa30-abbe-45b0-909f-f724ba4474b2 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:42:11.902678 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c9dcaa30-abbe-45b0-909f-f724ba4474b2 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:42:11.903387 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c9dcaa30-abbe-45b0-909f-f724ba4474b2 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:42:11.903839 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c9dcaa30-abbe-45b0-909f-f724ba4474b2 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:42:11.904393 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c9dcaa30-abbe-45b0-909f-f724ba4474b2 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:42:11.932605 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c9dcaa30-abbe-45b0-909f-f724ba4474b2 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] [instance: 28fe0c71-b848-42d9-8920-7adda9d5bb96] Going to try to terminate instance {{(pid=128801) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:42:12.014896 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c9dcaa30-abbe-45b0-909f-f724ba4474b2 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] 10.222.0.33 "DELETE /compute/v2.1/servers/28fe0c71-b848-42d9-8920-7adda9d5bb96" status: 204 len: 0 microversion: 2.1 time: 0.124890 Oct 04 21:42:12.015854 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3463/6961] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 21:42:11 2022] DELETE /compute/v2.1/servers/28fe0c71-b848-42d9-8920-7adda9d5bb96 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:42:12.025305 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-8461680c-4c96-4496-b9c5-89a86a13ca95 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:42:12.025954 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-8461680c-4c96-4496-b9c5-89a86a13ca95 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] [instance: 28fe0c71-b848-42d9-8920-7adda9d5bb96] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:42:12.033998 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8461680c-4c96-4496-b9c5-89a86a13ca95 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:42:12.034547 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8461680c-4c96-4496-b9c5-89a86a13ca95 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:42:12.035014 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8461680c-4c96-4496-b9c5-89a86a13ca95 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:42:12.036526 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8461680c-4c96-4496-b9c5-89a86a13ca95 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:42:12.036526 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8461680c-4c96-4496-b9c5-89a86a13ca95 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:42:12.036741 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8461680c-4c96-4496-b9c5-89a86a13ca95 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:42:12.184118 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-8461680c-4c96-4496-b9c5-89a86a13ca95 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '408632237e174b91939b442954fef918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a525f5d98a42453897757db171c263c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:42:12.192182 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-8461680c-4c96-4496-b9c5-89a86a13ca95 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] 10.222.0.33 "GET /compute/v2.1/servers/28fe0c71-b848-42d9-8920-7adda9d5bb96" status: 200 len: 1559 microversion: 2.1 time: 0.171991 Oct 04 21:42:12.192760 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3499/6962] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:42:12 2022] GET /compute/v2.1/servers/28fe0c71-b848-42d9-8920-7adda9d5bb96 => generated 1559 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:42:13.217503 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-71f00dc1-e318-4ea5-b2d0-9ba2c3ccc2ad tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:42:13.218197 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-71f00dc1-e318-4ea5-b2d0-9ba2c3ccc2ad tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] [instance: 28fe0c71-b848-42d9-8920-7adda9d5bb96] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:42:13.225106 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-71f00dc1-e318-4ea5-b2d0-9ba2c3ccc2ad tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:42:13.225586 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-71f00dc1-e318-4ea5-b2d0-9ba2c3ccc2ad tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:42:13.226023 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-71f00dc1-e318-4ea5-b2d0-9ba2c3ccc2ad tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:42:13.226920 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-71f00dc1-e318-4ea5-b2d0-9ba2c3ccc2ad tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:42:13.227378 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-71f00dc1-e318-4ea5-b2d0-9ba2c3ccc2ad tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:42:13.227802 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-71f00dc1-e318-4ea5-b2d0-9ba2c3ccc2ad tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:42:13.361136 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-71f00dc1-e318-4ea5-b2d0-9ba2c3ccc2ad tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '408632237e174b91939b442954fef918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a525f5d98a42453897757db171c263c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:42:13.369265 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-71f00dc1-e318-4ea5-b2d0-9ba2c3ccc2ad tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] 10.222.0.33 "GET /compute/v2.1/servers/28fe0c71-b848-42d9-8920-7adda9d5bb96" status: 200 len: 1559 microversion: 2.1 time: 0.155971 Oct 04 21:42:13.369851 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3464/6963] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:42:13 2022] GET /compute/v2.1/servers/28fe0c71-b848-42d9-8920-7adda9d5bb96 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:42:14.273279 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-e7f64071-dea6-49e5-b54c-93f000e41ff2 req-96c421b0-f939-4c9f-a329-a4d990218904 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28fe0c71-b848-42d9-8920-7adda9d5bb96", "name": "network-vif-deleted", "tag": "75de72b4-a53c-478c-9c48-f823b30f23cc"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:42:14.284714 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-e7f64071-dea6-49e5-b54c-93f000e41ff2 req-96c421b0-f939-4c9f-a329-a4d990218904 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:42:14.285208 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-e7f64071-dea6-49e5-b54c-93f000e41ff2 req-96c421b0-f939-4c9f-a329-a4d990218904 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:42:14.285657 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-e7f64071-dea6-49e5-b54c-93f000e41ff2 req-96c421b0-f939-4c9f-a329-a4d990218904 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:42:14.304084 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-e7f64071-dea6-49e5-b54c-93f000e41ff2 req-96c421b0-f939-4c9f-a329-a4d990218904 service nova] Creating event network-vif-deleted:75de72b4-a53c-478c-9c48-f823b30f23cc for instance 28fe0c71-b848-42d9-8920-7adda9d5bb96 on n-h2-854823-8 Oct 04 21:42:14.310788 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-e7f64071-dea6-49e5-b54c-93f000e41ff2 req-96c421b0-f939-4c9f-a329-a4d990218904 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041202 Oct 04 21:42:14.311951 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3500/6964] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:42:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:42:14.393697 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-be20e7d2-3e90-428a-893a-b9bbca701341 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:42:14.395008 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-be20e7d2-3e90-428a-893a-b9bbca701341 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] [instance: 28fe0c71-b848-42d9-8920-7adda9d5bb96] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:42:14.402860 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-be20e7d2-3e90-428a-893a-b9bbca701341 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:42:14.403353 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-be20e7d2-3e90-428a-893a-b9bbca701341 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:42:14.403804 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-be20e7d2-3e90-428a-893a-b9bbca701341 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:42:14.404493 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-be20e7d2-3e90-428a-893a-b9bbca701341 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:42:14.406068 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-be20e7d2-3e90-428a-893a-b9bbca701341 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:42:14.406533 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-be20e7d2-3e90-428a-893a-b9bbca701341 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:42:14.442815 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-be20e7d2-3e90-428a-893a-b9bbca701341 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:42:14.443304 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-be20e7d2-3e90-428a-893a-b9bbca701341 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:42:14.443738 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-be20e7d2-3e90-428a-893a-b9bbca701341 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:42:14.444212 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-be20e7d2-3e90-428a-893a-b9bbca701341 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lazy-loading 'fault' on Instance uuid 28fe0c71-b848-42d9-8920-7adda9d5bb96 {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:42:14.487831 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-be20e7d2-3e90-428a-893a-b9bbca701341 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '408632237e174b91939b442954fef918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a525f5d98a42453897757db171c263c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:42:14.495957 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-be20e7d2-3e90-428a-893a-b9bbca701341 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] 10.222.0.33 "GET /compute/v2.1/servers/28fe0c71-b848-42d9-8920-7adda9d5bb96" status: 200 len: 1353 microversion: 2.1 time: 0.106501 Oct 04 21:42:14.496579 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3465/6965] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:42:14 2022] GET /compute/v2.1/servers/28fe0c71-b848-42d9-8920-7adda9d5bb96 => generated 1353 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:42:15.521502 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-3ef00779-34f0-4c2c-a35c-4e34201cb544 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:42:15.522143 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-3ef00779-34f0-4c2c-a35c-4e34201cb544 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] [instance: 28fe0c71-b848-42d9-8920-7adda9d5bb96] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:42:15.528372 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3ef00779-34f0-4c2c-a35c-4e34201cb544 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:42:15.528874 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3ef00779-34f0-4c2c-a35c-4e34201cb544 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:42:15.529377 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3ef00779-34f0-4c2c-a35c-4e34201cb544 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:42:15.530079 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3ef00779-34f0-4c2c-a35c-4e34201cb544 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:42:15.530582 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3ef00779-34f0-4c2c-a35c-4e34201cb544 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:42:15.531031 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3ef00779-34f0-4c2c-a35c-4e34201cb544 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:42:15.544849 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.wsgi [None req-3ef00779-34f0-4c2c-a35c-4e34201cb544 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] HTTP exception thrown: Instance 28fe0c71-b848-42d9-8920-7adda9d5bb96 could not be found. Oct 04 21:42:15.546617 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-3ef00779-34f0-4c2c-a35c-4e34201cb544 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Request method failure captured: Oct 04 21:42:15.546617 n-d-854823-8 devstack@n-api.service[128802]: request: GET /compute/v2.1/servers/28fe0c71-b848-42d9-8920-7adda9d5bb96 HTTP/1.1 Oct 04 21:42:15.546617 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 21:42:15.546617 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 21:42:15.546617 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 21:42:15.546617 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 0 Oct 04 21:42:15.546617 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 21:42:15.546617 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 21:42:15.546617 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 21:42:15.546617 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 21:42:15.546617 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPKhFEFoRS-1U9WWYCOdhstTFgjzzWVo4Kdlla8ljNECBH0ZeAQZ07Hw27MPBSaBFlzV_4qi9Eu46DINt50cMxVm2DonnxZdSlqQJ8JHD_4uFsBbiJHxZKyrnkcBmgh9-dqq8BijGQJUaxIAwajaYfWsUSAKgBoTQIA664d_H8dw_x1w Oct 04 21:42:15.546617 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 21:42:15.546617 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 21:42:15.546617 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 21:42:15.546617 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 21:42:15.546617 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 21:42:15.546617 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 21:42:15.546617 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: a525f5d98a42453897757db171c263c0 Oct 04 21:42:15.546617 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-TestEncryptedCinderVolumes-340742639 Oct 04 21:42:15.546617 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 21:42:15.546617 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 21:42:15.546617 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a525f5d98a42453897757db171c263c0", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a525f5d98a42453897757db171c263c0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a525f5d98a42453897757db171c263c0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a525f5d98a42453897757db171c263c0"}]}] Oct 04 21:42:15.546617 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-TestEncryptedCinderVolumes-340742639 Oct 04 21:42:15.546617 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: a525f5d98a42453897757db171c263c0 Oct 04 21:42:15.546617 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-340742639 Oct 04 21:42:15.546617 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-TestEncryptedCinderVolumes-340742639-project Oct 04 21:42:15.546617 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 21:42:15.546617 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 21:42:15.546617 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: 408632237e174b91939b442954fef918 Oct 04 21:42:15.546617 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-TestEncryptedCinderVolumes-340742639-project Oct 04 21:42:15.546617 n-d-854823-8 devstack@n-api.service[128802]: method: > Oct 04 21:42:15.546617 n-d-854823-8 devstack@n-api.service[128802]: exception: Instance 28fe0c71-b848-42d9-8920-7adda9d5bb96 could not be found. Oct 04 21:42:15.546617 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'id': '28fe0c71-b848-42d9-8920-7adda9d5bb96'} Oct 04 21:42:15.546617 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:42:15.546617 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:42:15.546617 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:42:15.546617 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:42:15.546617 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:42:15.546617 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:42:15.546617 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:42:15.546617 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:42:15.546617 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:42:15.546617 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:42:15.546617 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 28fe0c71-b848-42d9-8920-7adda9d5bb96 could not be found. Oct 04 21:42:15.546617 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:42:15.546617 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:42:15.546617 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:42:15.546617 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:42:15.546617 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:42:15.546617 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:42:15.546617 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:42:15.546617 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:42:15.546617 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:42:15.546617 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:42:15.546617 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:42:15.546617 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:42:15.546617 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:42:15.546617 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:42:15.546617 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:42:15.546617 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:42:15.546617 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 28fe0c71-b848-42d9-8920-7adda9d5bb96 could not be found. Oct 04 21:42:15.546617 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:42:15.546617 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:42:15.546617 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:42:15.552038 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:42:15.552038 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:42:15.552038 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:42:15.552038 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:42:15.552038 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:42:15.552038 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 28fe0c71-b848-42d9-8920-7adda9d5bb96 could not be found. Oct 04 21:42:15.552038 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:42:15.552038 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-3ef00779-34f0-4c2c-a35c-4e34201cb544 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Returning 404 to user: Instance 28fe0c71-b848-42d9-8920-7adda9d5bb96 could not be found. {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:42:15.552038 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-3ef00779-34f0-4c2c-a35c-4e34201cb544 tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] 10.222.0.33 "GET /compute/v2.1/servers/28fe0c71-b848-42d9-8920-7adda9d5bb96" status: 404 len: 111 microversion: 2.1 time: 0.031831 Oct 04 21:42:15.552038 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3501/6966] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:42:15 2022] GET /compute/v2.1/servers/28fe0c71-b848-42d9-8920-7adda9d5bb96 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:42:15.557855 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9531ea58-4692-40be-b08a-cde19a1942ce tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] Calling method '.version_select at 0x7f3c745bf1f0>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:42:15.578002 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-9531ea58-4692-40be-b08a-cde19a1942ce tempest-TestEncryptedCinderVolumes-340742639 tempest-TestEncryptedCinderVolumes-340742639-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1155527965" status: 202 len: 0 microversion: 2.1 time: 0.024628 Oct 04 21:42:15.578606 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3466/6967] 10.222.0.33 () {58 vars in 1278 bytes} [Tue Oct 4 21:42:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1155527965 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 21:42:44.817263 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-ef2af7ef-b6b4-4af4-a169-e736032126ff tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Action: 'create', calling method: .version_select at 0x7f3c6f6aa5e0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-715830866", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMPgotPBkbgUlNmrVFvCFdrIfQ+3qYwGAtT3brwv35pfth5TELJdG93kO9SJHzJkzUvBPNQ6ErhXJj4wciRIvNVrJMf77hvbKeSv89EYmKgZ96+u7h541/yFxJhyqTIf1Q=="}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:42:44.823409 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_api:SELECT=14 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:42:44.824074 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=34 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:42:44.836435 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-ef2af7ef-b6b4-4af4-a169-e736032126ff tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Getting quotas for project de9b441849694e2399094a86c20fa9dc. Resources: {'key_pairs'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:42:44.842444 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-ef2af7ef-b6b4-4af4-a169-e736032126ff tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Getting quotas for user 8e90d254a9d942818ef85e0eb4f145e7 and project de9b441849694e2399094a86c20fa9dc. Resources: {'key_pairs'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:42:44.865864 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-ef2af7ef-b6b4-4af4-a169-e736032126ff tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.052492 Oct 04 21:42:44.867025 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3502/6968] 10.222.0.33 () {60 vars in 1159 bytes} [Tue Oct 4 21:42:44 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:42:44.917396 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=55,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:42:44.918153 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:42:44.922224 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6998ec41-81ca-4121-97bd-518c7bbd086f tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-325397994", "imageRef": "d3e9cf20-9ca6-4d4f-9bca-ad95a7afff47", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-715830866", "networks": [{"uuid": "5a1f5d25-b625-438a-8a98-23b61516dcf5"}]}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:42:44.979609 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.network.neutron [None req-6998ec41-81ca-4121-97bd-518c7bbd086f tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] validate_networks() for [('5a1f5d25-b625-438a-8a98-23b61516dcf5', None, None, None, None, None)] {{(pid=128801) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:42:45.369256 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-6998ec41-81ca-4121-97bd-518c7bbd086f tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Flavor limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:42:45.369713 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-6998ec41-81ca-4121-97bd-518c7bbd086f tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Image limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:42:45.370307 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-6998ec41-81ca-4121-97bd-518c7bbd086f tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Flavor pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:42:45.370904 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-6998ec41-81ca-4121-97bd-518c7bbd086f tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Image pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:42:45.371390 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-6998ec41-81ca-4121-97bd-518c7bbd086f tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:42:45.380372 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6998ec41-81ca-4121-97bd-518c7bbd086f tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:42:45.380852 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6998ec41-81ca-4121-97bd-518c7bbd086f tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:42:45.381287 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6998ec41-81ca-4121-97bd-518c7bbd086f tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:42:45.382765 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6998ec41-81ca-4121-97bd-518c7bbd086f tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:42:45.383091 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6998ec41-81ca-4121-97bd-518c7bbd086f tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:42:45.383519 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6998ec41-81ca-4121-97bd-518c7bbd086f tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:42:45.400471 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-6998ec41-81ca-4121-97bd-518c7bbd086f tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Getting quotas for project de9b441849694e2399094a86c20fa9dc. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:42:45.405860 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-6998ec41-81ca-4121-97bd-518c7bbd086f tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Getting quotas for user 8e90d254a9d942818ef85e0eb4f145e7 and project de9b441849694e2399094a86c20fa9dc. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:42:45.418410 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-6998ec41-81ca-4121-97bd-518c7bbd086f tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Going to run 1 instances... {{(pid=128801) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:42:45.420583 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-6998ec41-81ca-4121-97bd-518c7bbd086f tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] [instance: e43046ae-46e9-4845-af48-8a947fc761ab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d3e9cf20-9ca6-4d4f-9bca-ad95a7afff47',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128801) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:42:45.467320 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-6998ec41-81ca-4121-97bd-518c7bbd086f tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.552072 Oct 04 21:42:45.468002 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3467/6969] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 21:42:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 553 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 21:42:45.480018 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-ebf1da11-34ae-42bc-a25f-26dab31e4b1e tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:42:45.480843 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-ebf1da11-34ae-42bc-a25f-26dab31e4b1e tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] [instance: e43046ae-46e9-4845-af48-8a947fc761ab] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:42:45.539662 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-ebf1da11-34ae-42bc-a25f-26dab31e4b1e tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e90d254a9d942818ef85e0eb4f145e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de9b441849694e2399094a86c20fa9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:42:45.547631 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-ebf1da11-34ae-42bc-a25f-26dab31e4b1e tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] 10.222.0.33 "GET /compute/v2.1/servers/e43046ae-46e9-4845-af48-8a947fc761ab" status: 200 len: 1257 microversion: 2.1 time: 0.072413 Oct 04 21:42:45.548217 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3503/6970] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:42:45 2022] GET /compute/v2.1/servers/e43046ae-46e9-4845-af48-8a947fc761ab => generated 1257 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:42:46.572721 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ac953287-a792-4927-a26b-3d8154bd6632 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:42:46.573262 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ac953287-a792-4927-a26b-3d8154bd6632 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] [instance: e43046ae-46e9-4845-af48-8a947fc761ab] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:42:46.580406 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ac953287-a792-4927-a26b-3d8154bd6632 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:42:46.580930 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ac953287-a792-4927-a26b-3d8154bd6632 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:42:46.581372 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ac953287-a792-4927-a26b-3d8154bd6632 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:42:46.582076 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ac953287-a792-4927-a26b-3d8154bd6632 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:42:46.582581 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ac953287-a792-4927-a26b-3d8154bd6632 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:42:46.583016 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ac953287-a792-4927-a26b-3d8154bd6632 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:42:46.649791 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-ac953287-a792-4927-a26b-3d8154bd6632 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e90d254a9d942818ef85e0eb4f145e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de9b441849694e2399094a86c20fa9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:42:46.657731 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ac953287-a792-4927-a26b-3d8154bd6632 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] 10.222.0.33 "GET /compute/v2.1/servers/e43046ae-46e9-4845-af48-8a947fc761ab" status: 200 len: 1309 microversion: 2.1 time: 0.090631 Oct 04 21:42:46.658309 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3468/6971] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:42:46 2022] GET /compute/v2.1/servers/e43046ae-46e9-4845-af48-8a947fc761ab => generated 1309 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:42:47.684496 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-dc79b767-edea-44c8-a666-354de60595ca tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:42:47.686071 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-dc79b767-edea-44c8-a666-354de60595ca tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] [instance: e43046ae-46e9-4845-af48-8a947fc761ab] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:42:47.698447 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dc79b767-edea-44c8-a666-354de60595ca tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:42:47.702832 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dc79b767-edea-44c8-a666-354de60595ca tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:42:47.703120 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dc79b767-edea-44c8-a666-354de60595ca tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:42:47.703907 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dc79b767-edea-44c8-a666-354de60595ca tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:42:47.709900 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dc79b767-edea-44c8-a666-354de60595ca tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:42:47.711062 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dc79b767-edea-44c8-a666-354de60595ca tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:42:47.939399 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-dc79b767-edea-44c8-a666-354de60595ca tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e90d254a9d942818ef85e0eb4f145e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de9b441849694e2399094a86c20fa9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:42:47.948714 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-dc79b767-edea-44c8-a666-354de60595ca tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] 10.222.0.33 "GET /compute/v2.1/servers/e43046ae-46e9-4845-af48-8a947fc761ab" status: 200 len: 1357 microversion: 2.1 time: 0.268662 Oct 04 21:42:47.958943 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3504/6972] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:42:47 2022] GET /compute/v2.1/servers/e43046ae-46e9-4845-af48-8a947fc761ab => generated 1357 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:42:48.973785 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d9f50fdd-c325-4e7b-8cc2-dd3948356063 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:42:48.974325 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d9f50fdd-c325-4e7b-8cc2-dd3948356063 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] [instance: e43046ae-46e9-4845-af48-8a947fc761ab] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:42:48.983353 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d9f50fdd-c325-4e7b-8cc2-dd3948356063 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:42:48.984260 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d9f50fdd-c325-4e7b-8cc2-dd3948356063 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:42:48.984958 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d9f50fdd-c325-4e7b-8cc2-dd3948356063 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:42:48.985888 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d9f50fdd-c325-4e7b-8cc2-dd3948356063 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:42:48.986589 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d9f50fdd-c325-4e7b-8cc2-dd3948356063 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:42:48.987269 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d9f50fdd-c325-4e7b-8cc2-dd3948356063 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:42:49.139745 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d9f50fdd-c325-4e7b-8cc2-dd3948356063 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e90d254a9d942818ef85e0eb4f145e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de9b441849694e2399094a86c20fa9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:42:49.148146 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d9f50fdd-c325-4e7b-8cc2-dd3948356063 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] 10.222.0.33 "GET /compute/v2.1/servers/e43046ae-46e9-4845-af48-8a947fc761ab" status: 200 len: 1357 microversion: 2.1 time: 0.177879 Oct 04 21:42:49.148837 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3469/6973] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:42:48 2022] GET /compute/v2.1/servers/e43046ae-46e9-4845-af48-8a947fc761ab => generated 1357 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:42:50.177230 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-444bc5c6-d2ec-4f26-8d2b-0dfd2798ed57 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:42:50.179403 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-444bc5c6-d2ec-4f26-8d2b-0dfd2798ed57 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] [instance: e43046ae-46e9-4845-af48-8a947fc761ab] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:42:50.187051 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-444bc5c6-d2ec-4f26-8d2b-0dfd2798ed57 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:42:50.187557 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-444bc5c6-d2ec-4f26-8d2b-0dfd2798ed57 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:42:50.188011 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-444bc5c6-d2ec-4f26-8d2b-0dfd2798ed57 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:42:50.188739 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-444bc5c6-d2ec-4f26-8d2b-0dfd2798ed57 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:42:50.189211 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-444bc5c6-d2ec-4f26-8d2b-0dfd2798ed57 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:42:50.189655 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-444bc5c6-d2ec-4f26-8d2b-0dfd2798ed57 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:42:50.347385 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-444bc5c6-d2ec-4f26-8d2b-0dfd2798ed57 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e90d254a9d942818ef85e0eb4f145e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de9b441849694e2399094a86c20fa9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:42:50.357073 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-444bc5c6-d2ec-4f26-8d2b-0dfd2798ed57 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] 10.222.0.33 "GET /compute/v2.1/servers/e43046ae-46e9-4845-af48-8a947fc761ab" status: 200 len: 1357 microversion: 2.1 time: 0.187094 Oct 04 21:42:50.357990 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3505/6974] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:42:50 2022] GET /compute/v2.1/servers/e43046ae-46e9-4845-af48-8a947fc761ab => generated 1357 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:42:51.380428 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-61cdd5a7-8465-45c2-9612-b4134f6ba4ae tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:42:51.381183 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-61cdd5a7-8465-45c2-9612-b4134f6ba4ae tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] [instance: e43046ae-46e9-4845-af48-8a947fc761ab] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:42:51.389366 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-61cdd5a7-8465-45c2-9612-b4134f6ba4ae tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:42:51.390155 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-61cdd5a7-8465-45c2-9612-b4134f6ba4ae tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:42:51.390700 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-61cdd5a7-8465-45c2-9612-b4134f6ba4ae tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:42:51.391455 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-61cdd5a7-8465-45c2-9612-b4134f6ba4ae tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:42:51.391847 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-61cdd5a7-8465-45c2-9612-b4134f6ba4ae tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:42:51.392276 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-61cdd5a7-8465-45c2-9612-b4134f6ba4ae tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:42:51.528416 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-61cdd5a7-8465-45c2-9612-b4134f6ba4ae tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e90d254a9d942818ef85e0eb4f145e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de9b441849694e2399094a86c20fa9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:42:51.536564 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-61cdd5a7-8465-45c2-9612-b4134f6ba4ae tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] 10.222.0.33 "GET /compute/v2.1/servers/e43046ae-46e9-4845-af48-8a947fc761ab" status: 200 len: 1357 microversion: 2.1 time: 0.159993 Oct 04 21:42:51.537162 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3470/6975] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:42:51 2022] GET /compute/v2.1/servers/e43046ae-46e9-4845-af48-8a947fc761ab => generated 1357 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:42:52.561012 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-cea15fc8-b151-405e-b574-d0a07f72dd61 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:42:52.561642 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-cea15fc8-b151-405e-b574-d0a07f72dd61 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] [instance: e43046ae-46e9-4845-af48-8a947fc761ab] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:42:52.570949 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cea15fc8-b151-405e-b574-d0a07f72dd61 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:42:52.571478 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cea15fc8-b151-405e-b574-d0a07f72dd61 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:42:52.571942 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cea15fc8-b151-405e-b574-d0a07f72dd61 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:42:52.572691 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cea15fc8-b151-405e-b574-d0a07f72dd61 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:42:52.573168 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cea15fc8-b151-405e-b574-d0a07f72dd61 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:42:52.573614 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cea15fc8-b151-405e-b574-d0a07f72dd61 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:42:52.736009 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-cea15fc8-b151-405e-b574-d0a07f72dd61 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e90d254a9d942818ef85e0eb4f145e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de9b441849694e2399094a86c20fa9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:42:52.745156 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-cea15fc8-b151-405e-b574-d0a07f72dd61 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] 10.222.0.33 "GET /compute/v2.1/servers/e43046ae-46e9-4845-af48-8a947fc761ab" status: 200 len: 1357 microversion: 2.1 time: 0.188071 Oct 04 21:42:52.746222 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3506/6976] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:42:52 2022] GET /compute/v2.1/servers/e43046ae-46e9-4845-af48-8a947fc761ab => generated 1357 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:42:53.781191 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d9375c45-a83b-4efe-bcb0-d8936f6747c8 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:42:53.781878 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d9375c45-a83b-4efe-bcb0-d8936f6747c8 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] [instance: e43046ae-46e9-4845-af48-8a947fc761ab] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:42:53.787893 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d9375c45-a83b-4efe-bcb0-d8936f6747c8 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:42:53.788997 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d9375c45-a83b-4efe-bcb0-d8936f6747c8 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:42:53.789544 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d9375c45-a83b-4efe-bcb0-d8936f6747c8 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:42:53.790372 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d9375c45-a83b-4efe-bcb0-d8936f6747c8 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:42:53.790896 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d9375c45-a83b-4efe-bcb0-d8936f6747c8 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:42:53.791573 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d9375c45-a83b-4efe-bcb0-d8936f6747c8 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:42:53.959410 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d9375c45-a83b-4efe-bcb0-d8936f6747c8 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e90d254a9d942818ef85e0eb4f145e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de9b441849694e2399094a86c20fa9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:42:53.971253 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d9375c45-a83b-4efe-bcb0-d8936f6747c8 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] 10.222.0.33 "GET /compute/v2.1/servers/e43046ae-46e9-4845-af48-8a947fc761ab" status: 200 len: 1357 microversion: 2.1 time: 0.195118 Oct 04 21:42:53.972163 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3471/6977] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:42:53 2022] GET /compute/v2.1/servers/e43046ae-46e9-4845-af48-8a947fc761ab => generated 1357 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:42:54.996742 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-5159627c-feb6-47e3-a572-c7e0c55be703 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:42:54.997360 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-5159627c-feb6-47e3-a572-c7e0c55be703 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] [instance: e43046ae-46e9-4845-af48-8a947fc761ab] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:42:55.004643 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5159627c-feb6-47e3-a572-c7e0c55be703 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:42:55.005461 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5159627c-feb6-47e3-a572-c7e0c55be703 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:42:55.005913 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5159627c-feb6-47e3-a572-c7e0c55be703 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:42:55.006922 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5159627c-feb6-47e3-a572-c7e0c55be703 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:42:55.007898 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5159627c-feb6-47e3-a572-c7e0c55be703 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:42:55.014377 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5159627c-feb6-47e3-a572-c7e0c55be703 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:42:55.291904 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-5159627c-feb6-47e3-a572-c7e0c55be703 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e90d254a9d942818ef85e0eb4f145e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de9b441849694e2399094a86c20fa9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:42:55.300015 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-5159627c-feb6-47e3-a572-c7e0c55be703 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] 10.222.0.33 "GET /compute/v2.1/servers/e43046ae-46e9-4845-af48-8a947fc761ab" status: 200 len: 1357 microversion: 2.1 time: 0.307097 Oct 04 21:42:55.300618 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3507/6978] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:42:54 2022] GET /compute/v2.1/servers/e43046ae-46e9-4845-af48-8a947fc761ab => generated 1357 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:42:55.700365 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-c92f5464-0293-4580-9550-7b0aa9552d4a req-d5ad948a-86a2-4cfb-a753-5a6a1b0ad001 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e43046ae-46e9-4845-af48-8a947fc761ab", "tag": "42911696-79b4-4b32-b778-c04a2eb0e93b"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:42:55.711553 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:42:55.713103 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=6 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:42:55.724633 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-c92f5464-0293-4580-9550-7b0aa9552d4a req-d5ad948a-86a2-4cfb-a753-5a6a1b0ad001 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:42:55.725554 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-c92f5464-0293-4580-9550-7b0aa9552d4a req-d5ad948a-86a2-4cfb-a753-5a6a1b0ad001 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:42:55.726887 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-c92f5464-0293-4580-9550-7b0aa9552d4a req-d5ad948a-86a2-4cfb-a753-5a6a1b0ad001 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:42:55.749576 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-c92f5464-0293-4580-9550-7b0aa9552d4a req-d5ad948a-86a2-4cfb-a753-5a6a1b0ad001 service nova] Creating event network-changed:42911696-79b4-4b32-b778-c04a2eb0e93b for instance e43046ae-46e9-4845-af48-8a947fc761ab on n-h2-854823-8 Oct 04 21:42:55.758780 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-c92f5464-0293-4580-9550-7b0aa9552d4a req-d5ad948a-86a2-4cfb-a753-5a6a1b0ad001 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065740 Oct 04 21:42:55.759927 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3472/6979] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:42:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:42:56.328706 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-b1c8193a-6754-4481-92d9-e88fc4eda12f tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:42:56.329257 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-b1c8193a-6754-4481-92d9-e88fc4eda12f tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] [instance: e43046ae-46e9-4845-af48-8a947fc761ab] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:42:56.331181 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell0:SELECT=6 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:42:56.338713 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b1c8193a-6754-4481-92d9-e88fc4eda12f tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:42:56.339333 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b1c8193a-6754-4481-92d9-e88fc4eda12f tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:42:56.339793 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b1c8193a-6754-4481-92d9-e88fc4eda12f tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:42:56.340523 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b1c8193a-6754-4481-92d9-e88fc4eda12f tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:42:56.340995 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b1c8193a-6754-4481-92d9-e88fc4eda12f tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:42:56.341441 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b1c8193a-6754-4481-92d9-e88fc4eda12f tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:42:56.487980 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-b1c8193a-6754-4481-92d9-e88fc4eda12f tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e90d254a9d942818ef85e0eb4f145e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de9b441849694e2399094a86c20fa9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:42:56.497576 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-b1c8193a-6754-4481-92d9-e88fc4eda12f tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] 10.222.0.33 "GET /compute/v2.1/servers/e43046ae-46e9-4845-af48-8a947fc761ab" status: 200 len: 1357 microversion: 2.1 time: 0.172831 Oct 04 21:42:56.498173 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3508/6980] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:42:56 2022] GET /compute/v2.1/servers/e43046ae-46e9-4845-af48-8a947fc761ab => generated 1357 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:42:57.523679 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b8b5154f-9b5a-4e90-8fdd-2fe6eda46b1b tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:42:57.524417 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b8b5154f-9b5a-4e90-8fdd-2fe6eda46b1b tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] [instance: e43046ae-46e9-4845-af48-8a947fc761ab] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:42:57.531498 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b8b5154f-9b5a-4e90-8fdd-2fe6eda46b1b tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:42:57.531970 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b8b5154f-9b5a-4e90-8fdd-2fe6eda46b1b tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:42:57.532656 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b8b5154f-9b5a-4e90-8fdd-2fe6eda46b1b tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:42:57.533359 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b8b5154f-9b5a-4e90-8fdd-2fe6eda46b1b tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:42:57.533812 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b8b5154f-9b5a-4e90-8fdd-2fe6eda46b1b tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:42:57.534309 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b8b5154f-9b5a-4e90-8fdd-2fe6eda46b1b tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:42:57.683790 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-b8b5154f-9b5a-4e90-8fdd-2fe6eda46b1b tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e90d254a9d942818ef85e0eb4f145e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de9b441849694e2399094a86c20fa9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:42:57.692104 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b8b5154f-9b5a-4e90-8fdd-2fe6eda46b1b tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] 10.222.0.33 "GET /compute/v2.1/servers/e43046ae-46e9-4845-af48-8a947fc761ab" status: 200 len: 1357 microversion: 2.1 time: 0.174698 Oct 04 21:42:57.693665 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3473/6981] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:42:57 2022] GET /compute/v2.1/servers/e43046ae-46e9-4845-af48-8a947fc761ab => generated 1357 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:42:58.715679 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-521de0da-2f42-4cc5-90d7-95adae7b03cc tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:42:58.716453 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-521de0da-2f42-4cc5-90d7-95adae7b03cc tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] [instance: e43046ae-46e9-4845-af48-8a947fc761ab] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:42:58.723363 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-521de0da-2f42-4cc5-90d7-95adae7b03cc tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:42:58.723878 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-521de0da-2f42-4cc5-90d7-95adae7b03cc tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:42:58.724363 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-521de0da-2f42-4cc5-90d7-95adae7b03cc tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:42:58.725074 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-521de0da-2f42-4cc5-90d7-95adae7b03cc tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:42:58.725557 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-521de0da-2f42-4cc5-90d7-95adae7b03cc tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:42:58.726059 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-521de0da-2f42-4cc5-90d7-95adae7b03cc tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:42:58.870975 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-521de0da-2f42-4cc5-90d7-95adae7b03cc tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e90d254a9d942818ef85e0eb4f145e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de9b441849694e2399094a86c20fa9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:42:58.879334 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-521de0da-2f42-4cc5-90d7-95adae7b03cc tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] 10.222.0.33 "GET /compute/v2.1/servers/e43046ae-46e9-4845-af48-8a947fc761ab" status: 200 len: 1357 microversion: 2.1 time: 0.167528 Oct 04 21:42:58.879938 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3509/6982] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:42:58 2022] GET /compute/v2.1/servers/e43046ae-46e9-4845-af48-8a947fc761ab => generated 1357 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:42:59.902910 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a8ea52f2-be08-4043-bce4-9cf4a490e712 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:42:59.903523 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a8ea52f2-be08-4043-bce4-9cf4a490e712 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] [instance: e43046ae-46e9-4845-af48-8a947fc761ab] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:42:59.910689 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a8ea52f2-be08-4043-bce4-9cf4a490e712 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:42:59.911180 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a8ea52f2-be08-4043-bce4-9cf4a490e712 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:42:59.911613 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a8ea52f2-be08-4043-bce4-9cf4a490e712 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:42:59.912600 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a8ea52f2-be08-4043-bce4-9cf4a490e712 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:42:59.913625 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a8ea52f2-be08-4043-bce4-9cf4a490e712 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:42:59.914055 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a8ea52f2-be08-4043-bce4-9cf4a490e712 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:00.045663 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-a8ea52f2-be08-4043-bce4-9cf4a490e712 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e90d254a9d942818ef85e0eb4f145e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de9b441849694e2399094a86c20fa9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:43:00.054650 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a8ea52f2-be08-4043-bce4-9cf4a490e712 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] 10.222.0.33 "GET /compute/v2.1/servers/e43046ae-46e9-4845-af48-8a947fc761ab" status: 200 len: 1357 microversion: 2.1 time: 0.154953 Oct 04 21:43:00.055253 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3474/6983] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:42:59 2022] GET /compute/v2.1/servers/e43046ae-46e9-4845-af48-8a947fc761ab => generated 1357 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:43:00.989044 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-d01982fe-586e-4391-a0bc-6cecc221e56d req-a681ef6f-0a1f-463c-9c4f-1182d0fded53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e43046ae-46e9-4845-af48-8a947fc761ab", "name": "network-vif-plugged", "status": "completed", "tag": "42911696-79b4-4b32-b778-c04a2eb0e93b"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:43:00.999733 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-d01982fe-586e-4391-a0bc-6cecc221e56d req-a681ef6f-0a1f-463c-9c4f-1182d0fded53 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:01.000235 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-d01982fe-586e-4391-a0bc-6cecc221e56d req-a681ef6f-0a1f-463c-9c4f-1182d0fded53 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:01.000685 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-d01982fe-586e-4391-a0bc-6cecc221e56d req-a681ef6f-0a1f-463c-9c4f-1182d0fded53 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:01.013105 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-d01982fe-586e-4391-a0bc-6cecc221e56d req-a681ef6f-0a1f-463c-9c4f-1182d0fded53 service nova] Creating event network-vif-plugged:42911696-79b4-4b32-b778-c04a2eb0e93b for instance e43046ae-46e9-4845-af48-8a947fc761ab on n-h2-854823-8 Oct 04 21:43:01.018441 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-d01982fe-586e-4391-a0bc-6cecc221e56d req-a681ef6f-0a1f-463c-9c4f-1182d0fded53 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.169507 Oct 04 21:43:01.019052 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3510/6984] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:43:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:43:01.077297 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5322795a-68c5-4732-b53d-bdcb236b3411 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:01.077934 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-5322795a-68c5-4732-b53d-bdcb236b3411 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] [instance: e43046ae-46e9-4845-af48-8a947fc761ab] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:43:01.085916 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5322795a-68c5-4732-b53d-bdcb236b3411 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:01.086511 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5322795a-68c5-4732-b53d-bdcb236b3411 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:01.086961 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5322795a-68c5-4732-b53d-bdcb236b3411 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:01.087681 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5322795a-68c5-4732-b53d-bdcb236b3411 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:01.088144 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5322795a-68c5-4732-b53d-bdcb236b3411 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:01.088574 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5322795a-68c5-4732-b53d-bdcb236b3411 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:01.290893 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-5322795a-68c5-4732-b53d-bdcb236b3411 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e90d254a9d942818ef85e0eb4f145e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de9b441849694e2399094a86c20fa9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:43:01.298811 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5322795a-68c5-4732-b53d-bdcb236b3411 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] 10.222.0.33 "GET /compute/v2.1/servers/e43046ae-46e9-4845-af48-8a947fc761ab" status: 200 len: 1357 microversion: 2.1 time: 0.225298 Oct 04 21:43:01.299408 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3475/6985] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:43:01 2022] GET /compute/v2.1/servers/e43046ae-46e9-4845-af48-8a947fc761ab => generated 1357 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:43:02.324234 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-4939c31c-2c57-4bdf-9722-0477ab69226f tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:02.324925 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-4939c31c-2c57-4bdf-9722-0477ab69226f tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] [instance: e43046ae-46e9-4845-af48-8a947fc761ab] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:43:02.332256 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4939c31c-2c57-4bdf-9722-0477ab69226f tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:02.332762 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4939c31c-2c57-4bdf-9722-0477ab69226f tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:02.333221 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4939c31c-2c57-4bdf-9722-0477ab69226f tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:02.333939 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4939c31c-2c57-4bdf-9722-0477ab69226f tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:02.335340 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4939c31c-2c57-4bdf-9722-0477ab69226f tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:02.336359 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4939c31c-2c57-4bdf-9722-0477ab69226f tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:02.484870 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-4939c31c-2c57-4bdf-9722-0477ab69226f tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e90d254a9d942818ef85e0eb4f145e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de9b441849694e2399094a86c20fa9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:43:02.494722 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-4939c31c-2c57-4bdf-9722-0477ab69226f tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] 10.222.0.33 "GET /compute/v2.1/servers/e43046ae-46e9-4845-af48-8a947fc761ab" status: 200 len: 1357 microversion: 2.1 time: 0.175616 Oct 04 21:43:02.495319 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3511/6986] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:43:02 2022] GET /compute/v2.1/servers/e43046ae-46e9-4845-af48-8a947fc761ab => generated 1357 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:43:03.518771 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f8b251d0-34e4-4535-ab26-3023adea70e2 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:03.519292 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f8b251d0-34e4-4535-ab26-3023adea70e2 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] [instance: e43046ae-46e9-4845-af48-8a947fc761ab] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:43:03.526092 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f8b251d0-34e4-4535-ab26-3023adea70e2 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:03.526606 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f8b251d0-34e4-4535-ab26-3023adea70e2 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:03.527050 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f8b251d0-34e4-4535-ab26-3023adea70e2 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:03.527744 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f8b251d0-34e4-4535-ab26-3023adea70e2 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:03.528199 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f8b251d0-34e4-4535-ab26-3023adea70e2 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:03.528625 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f8b251d0-34e4-4535-ab26-3023adea70e2 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:03.663797 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f8b251d0-34e4-4535-ab26-3023adea70e2 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e90d254a9d942818ef85e0eb4f145e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de9b441849694e2399094a86c20fa9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:43:03.672049 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f8b251d0-34e4-4535-ab26-3023adea70e2 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] 10.222.0.33 "GET /compute/v2.1/servers/e43046ae-46e9-4845-af48-8a947fc761ab" status: 200 len: 1547 microversion: 2.1 time: 0.157354 Oct 04 21:43:03.672842 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3476/6987] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:43:03 2022] GET /compute/v2.1/servers/e43046ae-46e9-4845-af48-8a947fc761ab => generated 1547 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:43:03.695606 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-8ac10b7d-71ae-4db8-8f46-fbc7fc73271c tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:03.696262 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-8ac10b7d-71ae-4db8-8f46-fbc7fc73271c tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] [instance: e43046ae-46e9-4845-af48-8a947fc761ab] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:43:03.704033 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8ac10b7d-71ae-4db8-8f46-fbc7fc73271c tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:03.704537 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8ac10b7d-71ae-4db8-8f46-fbc7fc73271c tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:03.704992 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8ac10b7d-71ae-4db8-8f46-fbc7fc73271c tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:03.705719 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8ac10b7d-71ae-4db8-8f46-fbc7fc73271c tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:03.706191 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8ac10b7d-71ae-4db8-8f46-fbc7fc73271c tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:03.706657 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8ac10b7d-71ae-4db8-8f46-fbc7fc73271c tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:03.848284 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-8ac10b7d-71ae-4db8-8f46-fbc7fc73271c tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e90d254a9d942818ef85e0eb4f145e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de9b441849694e2399094a86c20fa9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:43:03.857091 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-8ac10b7d-71ae-4db8-8f46-fbc7fc73271c tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] 10.222.0.33 "GET /compute/v2.1/servers/e43046ae-46e9-4845-af48-8a947fc761ab" status: 200 len: 1547 microversion: 2.1 time: 0.165486 Oct 04 21:43:03.857689 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3512/6988] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:43:03 2022] GET /compute/v2.1/servers/e43046ae-46e9-4845-af48-8a947fc761ab => generated 1547 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:43:03.879544 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8f355ff0-2cb1-4d1d-a97b-bb29adfb6b27 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:03.884302 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-8f355ff0-2cb1-4d1d-a97b-bb29adfb6b27 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8e90d254a9d942818ef85e0eb4f145e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de9b441849694e2399094a86c20fa9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:43:03.885063 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-8f355ff0-2cb1-4d1d-a97b-bb29adfb6b27 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Searching by: {'deleted': False, 'project_id': 'de9b441849694e2399094a86c20fa9dc'} {{(pid=128801) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 21:43:03.890508 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8f355ff0-2cb1-4d1d-a97b-bb29adfb6b27 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:03.890985 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8f355ff0-2cb1-4d1d-a97b-bb29adfb6b27 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:03.891413 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8f355ff0-2cb1-4d1d-a97b-bb29adfb6b27 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:03.892131 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8f355ff0-2cb1-4d1d-a97b-bb29adfb6b27 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:03.892581 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8f355ff0-2cb1-4d1d-a97b-bb29adfb6b27 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:03.892999 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8f355ff0-2cb1-4d1d-a97b-bb29adfb6b27 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:03.917899 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.multi_cell_list [None req-8f355ff0-2cb1-4d1d-a97b-bb29adfb6b27 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128801) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 21:43:03.945485 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-8f355ff0-2cb1-4d1d-a97b-bb29adfb6b27 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] 10.222.0.33 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.069685 Oct 04 21:43:03.946068 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3477/6989] 10.222.0.33 () {58 vars in 1125 bytes} [Tue Oct 4 21:43:03 2022] GET /compute/v2.1/servers => generated 342 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:43:03.957804 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-7f5f8a93-a84f-458c-848d-28cc382c7e0d tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:03.958617 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-7f5f8a93-a84f-458c-848d-28cc382c7e0d tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] [instance: e43046ae-46e9-4845-af48-8a947fc761ab] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:43:03.965667 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7f5f8a93-a84f-458c-848d-28cc382c7e0d tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:03.966274 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7f5f8a93-a84f-458c-848d-28cc382c7e0d tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:03.966905 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7f5f8a93-a84f-458c-848d-28cc382c7e0d tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:03.967588 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7f5f8a93-a84f-458c-848d-28cc382c7e0d tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:03.968061 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7f5f8a93-a84f-458c-848d-28cc382c7e0d tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:03.968581 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7f5f8a93-a84f-458c-848d-28cc382c7e0d tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:04.110596 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-7f5f8a93-a84f-458c-848d-28cc382c7e0d tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e90d254a9d942818ef85e0eb4f145e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de9b441849694e2399094a86c20fa9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:43:04.119286 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-7f5f8a93-a84f-458c-848d-28cc382c7e0d tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] 10.222.0.33 "GET /compute/v2.1/servers/e43046ae-46e9-4845-af48-8a947fc761ab" status: 200 len: 1547 microversion: 2.1 time: 0.165229 Oct 04 21:43:04.119895 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3513/6990] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:43:03 2022] GET /compute/v2.1/servers/e43046ae-46e9-4845-af48-8a947fc761ab => generated 1547 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:43:05.692343 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7c6ba8fe-480a-4cef-958d-1fe4c3a02acc tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3ff26fad-8785-4327-a32c-c0bceacc895b"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:43:05.695408 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-7c6ba8fe-480a-4cef-958d-1fe4c3a02acc tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] [instance: e43046ae-46e9-4845-af48-8a947fc761ab] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:43:05.702518 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7c6ba8fe-480a-4cef-958d-1fe4c3a02acc tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:05.703017 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7c6ba8fe-480a-4cef-958d-1fe4c3a02acc tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:05.703463 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7c6ba8fe-480a-4cef-958d-1fe4c3a02acc tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:05.704172 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7c6ba8fe-480a-4cef-958d-1fe4c3a02acc tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:05.704670 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7c6ba8fe-480a-4cef-958d-1fe4c3a02acc tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:05.705098 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7c6ba8fe-480a-4cef-958d-1fe4c3a02acc tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:05.977184 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-7c6ba8fe-480a-4cef-958d-1fe4c3a02acc tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] 10.222.0.33 "POST /compute/v2.1/servers/e43046ae-46e9-4845-af48-8a947fc761ab/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.288809 Oct 04 21:43:05.977822 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3478/6991] 10.222.0.33 () {60 vars in 1323 bytes} [Tue Oct 4 21:43:05 2022] POST /compute/v2.1/servers/e43046ae-46e9-4845-af48-8a947fc761ab/os-volume_attachments => generated 194 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:43:19.201714 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-93d99beb-d5bb-4601-b04a-7eb98af8e304 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:19.202526 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-93d99beb-d5bb-4601-b04a-7eb98af8e304 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] [instance: e43046ae-46e9-4845-af48-8a947fc761ab] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:43:19.205078 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=1 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:43:19.205813 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=56 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:43:19.207601 n-d-854823-8 devstack@n-api.service[128802]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 21:43:19.207772 n-d-854823-8 devstack@n-api.service[128802]: Tue Oct 4 21:43:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e43046ae-46e9-4845-af48-8a947fc761ab (ip 10.222.0.33) !!! Oct 04 21:43:19.221991 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-93d99beb-d5bb-4601-b04a-7eb98af8e304 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:19.222580 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-93d99beb-d5bb-4601-b04a-7eb98af8e304 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:19.223038 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-93d99beb-d5bb-4601-b04a-7eb98af8e304 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:19.223817 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-93d99beb-d5bb-4601-b04a-7eb98af8e304 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:19.224285 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-93d99beb-d5bb-4601-b04a-7eb98af8e304 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:19.224725 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-93d99beb-d5bb-4601-b04a-7eb98af8e304 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:19.379187 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-93d99beb-d5bb-4601-b04a-7eb98af8e304 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e90d254a9d942818ef85e0eb4f145e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de9b441849694e2399094a86c20fa9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:43:19.388874 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-93d99beb-d5bb-4601-b04a-7eb98af8e304 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] 10.222.0.33 "GET /compute/v2.1/servers/e43046ae-46e9-4845-af48-8a947fc761ab" status: 200 len: 1593 microversion: 2.1 time: 0.191760 Oct 04 21:43:19.389546 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3514/6992] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:43:19 2022] GET /compute/v2.1/servers/e43046ae-46e9-4845-af48-8a947fc761ab => generated 1593 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:43:21.388406 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:43:21.389195 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:43:21.389919 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:43:21.394970 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-c9213d6a-6066-447d-aa59-aeac683f74df req-31d156b7-ffbe-4943-b665-5df2d1d2de20 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e43046ae-46e9-4845-af48-8a947fc761ab", "tag": "42911696-79b4-4b32-b778-c04a2eb0e93b"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:43:21.407912 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-c9213d6a-6066-447d-aa59-aeac683f74df req-31d156b7-ffbe-4943-b665-5df2d1d2de20 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:21.408668 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-c9213d6a-6066-447d-aa59-aeac683f74df req-31d156b7-ffbe-4943-b665-5df2d1d2de20 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:21.409296 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-c9213d6a-6066-447d-aa59-aeac683f74df req-31d156b7-ffbe-4943-b665-5df2d1d2de20 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:21.425132 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-c9213d6a-6066-447d-aa59-aeac683f74df req-31d156b7-ffbe-4943-b665-5df2d1d2de20 service nova] Creating event network-changed:42911696-79b4-4b32-b778-c04a2eb0e93b for instance e43046ae-46e9-4845-af48-8a947fc761ab on n-h2-854823-8 Oct 04 21:43:21.432057 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-c9213d6a-6066-447d-aa59-aeac683f74df req-31d156b7-ffbe-4943-b665-5df2d1d2de20 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045139 Oct 04 21:43:21.432695 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3479/6993] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:43:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:43:22.784747 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-54dae742-9f21-4e2e-84ac-2b5b7a582ac0 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1174084663"}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:43:22.785444 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-54dae742-9f21-4e2e-84ac-2b5b7a582ac0 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] [instance: e43046ae-46e9-4845-af48-8a947fc761ab] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:43:22.793252 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-54dae742-9f21-4e2e-84ac-2b5b7a582ac0 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:22.793769 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-54dae742-9f21-4e2e-84ac-2b5b7a582ac0 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:22.794228 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-54dae742-9f21-4e2e-84ac-2b5b7a582ac0 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:22.795007 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-54dae742-9f21-4e2e-84ac-2b5b7a582ac0 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:22.795480 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-54dae742-9f21-4e2e-84ac-2b5b7a582ac0 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:22.795926 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-54dae742-9f21-4e2e-84ac-2b5b7a582ac0 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:22.944722 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.network.security_group_api [None req-54dae742-9f21-4e2e-84ac-2b5b7a582ac0 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Adding security group 4fa4c742-c5bd-47a7-a015-ab50602da9ff to port 42911696-79b4-4b32-b778-c04a2eb0e93b Oct 04 21:43:23.320145 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-54dae742-9f21-4e2e-84ac-2b5b7a582ac0 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] 10.222.0.33 "POST /compute/v2.1/servers/e43046ae-46e9-4845-af48-8a947fc761ab/action" status: 202 len: 0 microversion: 2.1 time: 0.539598 Oct 04 21:43:23.325075 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3515/6994] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 21:43:22 2022] POST /compute/v2.1/servers/e43046ae-46e9-4845-af48-8a947fc761ab/action => generated 0 bytes in 542 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:43:23.332292 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-659cd57a-4a37-4232-9803-80150eac024d req-21c0dfdb-74be-4d09-90d6-5ffa111b740e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e43046ae-46e9-4845-af48-8a947fc761ab", "tag": "42911696-79b4-4b32-b778-c04a2eb0e93b"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:43:23.334993 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-3b550d3c-819a-4081-852f-91e5f3ff078a tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:43:23.336947 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-3b550d3c-819a-4081-852f-91e5f3ff078a tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] [instance: e43046ae-46e9-4845-af48-8a947fc761ab] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:43:23.348585 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3b550d3c-819a-4081-852f-91e5f3ff078a tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:23.349517 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3b550d3c-819a-4081-852f-91e5f3ff078a tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:23.350315 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3b550d3c-819a-4081-852f-91e5f3ff078a tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:23.351676 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3b550d3c-819a-4081-852f-91e5f3ff078a tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:23.353091 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3b550d3c-819a-4081-852f-91e5f3ff078a tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:23.354378 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3b550d3c-819a-4081-852f-91e5f3ff078a tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:23.373561 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-659cd57a-4a37-4232-9803-80150eac024d req-21c0dfdb-74be-4d09-90d6-5ffa111b740e service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:43:23.374220 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-659cd57a-4a37-4232-9803-80150eac024d req-21c0dfdb-74be-4d09-90d6-5ffa111b740e service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:43:23.374861 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-659cd57a-4a37-4232-9803-80150eac024d req-21c0dfdb-74be-4d09-90d6-5ffa111b740e service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:43:23.397429 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-659cd57a-4a37-4232-9803-80150eac024d req-21c0dfdb-74be-4d09-90d6-5ffa111b740e service nova] Creating event network-changed:42911696-79b4-4b32-b778-c04a2eb0e93b for instance e43046ae-46e9-4845-af48-8a947fc761ab on n-h2-854823-8 Oct 04 21:43:23.414092 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-659cd57a-4a37-4232-9803-80150eac024d req-21c0dfdb-74be-4d09-90d6-5ffa111b740e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085531 Oct 04 21:43:23.415748 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3480/6995] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:43:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:43:23.680956 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-3b550d3c-819a-4081-852f-91e5f3ff078a tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e90d254a9d942818ef85e0eb4f145e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de9b441849694e2399094a86c20fa9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:43:23.691501 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-3b550d3c-819a-4081-852f-91e5f3ff078a tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] 10.222.0.33 "GET /compute/v2.1/servers/e43046ae-46e9-4845-af48-8a947fc761ab" status: 200 len: 1759 microversion: 2.1 time: 0.364472 Oct 04 21:43:23.707430 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3516/6996] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:43:23 2022] GET /compute/v2.1/servers/e43046ae-46e9-4845-af48-8a947fc761ab => generated 1759 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:45:01.033552 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=4 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:45:01.035114 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=4 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:45:01.041340 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a82d80a7-12be-4822-b1c1-5aa45acf2ade tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:45:01.043825 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a82d80a7-12be-4822-b1c1-5aa45acf2ade tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] [instance: e43046ae-46e9-4845-af48-8a947fc761ab] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:01.052379 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a82d80a7-12be-4822-b1c1-5aa45acf2ade tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:01.052884 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a82d80a7-12be-4822-b1c1-5aa45acf2ade tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:01.053330 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a82d80a7-12be-4822-b1c1-5aa45acf2ade tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:01.054062 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a82d80a7-12be-4822-b1c1-5aa45acf2ade tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:01.054564 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a82d80a7-12be-4822-b1c1-5aa45acf2ade tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:01.055014 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a82d80a7-12be-4822-b1c1-5aa45acf2ade tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:01.144103 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a82d80a7-12be-4822-b1c1-5aa45acf2ade tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] 10.222.0.33 "POST /compute/v2.1/servers/e43046ae-46e9-4845-af48-8a947fc761ab/action" status: 202 len: 0 microversion: 2.1 time: 0.113786 Oct 04 21:45:01.144793 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3481/6997] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 21:45:01 2022] POST /compute/v2.1/servers/e43046ae-46e9-4845-af48-8a947fc761ab/action => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:45:01.152307 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_api:SELECT=6 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:45:01.153548 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=16 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:45:01.160434 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-257cf2f4-d34c-4ce5-8dbe-34d5f37e45ee tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:01.161819 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-257cf2f4-d34c-4ce5-8dbe-34d5f37e45ee tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] [instance: e43046ae-46e9-4845-af48-8a947fc761ab] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:01.169743 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-257cf2f4-d34c-4ce5-8dbe-34d5f37e45ee tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:01.170374 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-257cf2f4-d34c-4ce5-8dbe-34d5f37e45ee tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:01.170929 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-257cf2f4-d34c-4ce5-8dbe-34d5f37e45ee tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:01.171779 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-257cf2f4-d34c-4ce5-8dbe-34d5f37e45ee tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:01.172326 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-257cf2f4-d34c-4ce5-8dbe-34d5f37e45ee tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:01.172849 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-257cf2f4-d34c-4ce5-8dbe-34d5f37e45ee tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:01.453991 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-257cf2f4-d34c-4ce5-8dbe-34d5f37e45ee tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e90d254a9d942818ef85e0eb4f145e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de9b441849694e2399094a86c20fa9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:01.465460 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-257cf2f4-d34c-4ce5-8dbe-34d5f37e45ee tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] 10.222.0.33 "GET /compute/v2.1/servers/e43046ae-46e9-4845-af48-8a947fc761ab" status: 200 len: 1761 microversion: 2.1 time: 0.315366 Oct 04 21:45:01.466272 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3517/6998] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:45:01 2022] GET /compute/v2.1/servers/e43046ae-46e9-4845-af48-8a947fc761ab => generated 1761 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:45:02.501272 n-d-854823-8 devstack@n-api.service[128801]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 21:45:02.502852 n-d-854823-8 devstack@n-api.service[128801]: Tue Oct 4 21:45:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e43046ae-46e9-4845-af48-8a947fc761ab (ip 10.222.0.33) !!! Oct 04 21:45:02.518319 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-76aff2fc-74e2-4ed4-86c1-ac257e437740 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:45:02.519961 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-76aff2fc-74e2-4ed4-86c1-ac257e437740 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] [instance: e43046ae-46e9-4845-af48-8a947fc761ab] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:45:02.537356 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-76aff2fc-74e2-4ed4-86c1-ac257e437740 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:02.537924 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-76aff2fc-74e2-4ed4-86c1-ac257e437740 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:02.538587 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-76aff2fc-74e2-4ed4-86c1-ac257e437740 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:02.539392 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-76aff2fc-74e2-4ed4-86c1-ac257e437740 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:45:02.539910 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-76aff2fc-74e2-4ed4-86c1-ac257e437740 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:45:02.540387 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-76aff2fc-74e2-4ed4-86c1-ac257e437740 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:45:02.743679 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-76aff2fc-74e2-4ed4-86c1-ac257e437740 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e90d254a9d942818ef85e0eb4f145e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de9b441849694e2399094a86c20fa9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:45:02.753590 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-76aff2fc-74e2-4ed4-86c1-ac257e437740 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] 10.222.0.33 "GET /compute/v2.1/servers/e43046ae-46e9-4845-af48-8a947fc761ab" status: 200 len: 1759 microversion: 2.1 time: 0.255492 Oct 04 21:45:02.754162 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3482/6999] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:45:02 2022] GET /compute/v2.1/servers/e43046ae-46e9-4845-af48-8a947fc761ab => generated 1759 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:46:15.668148 n-d-854823-8 devstack@n-api.service[128802]: ERROR oslo.messaging._drivers.impl_rabbit [-] [3ed749fe-ba58-4081-afad-8a961afd7471] AMQP server on 10.222.0.33:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 04 21:46:15.669020 n-d-854823-8 devstack@n-api.service[128802]: ERROR oslo.messaging._drivers.impl_rabbit [-] [399f3af7-d281-4213-9ef7-61e2871c9a11] AMQP server on 10.222.0.33:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 04 21:46:15.669898 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_api:SELECT=2 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:46:15.670799 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=6 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:46:15.676358 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-8b421c27-7bf7-4497-b50d-2b0cdeb908bd tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1174084663"}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:46:15.676921 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-8b421c27-7bf7-4497-b50d-2b0cdeb908bd tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] [instance: e43046ae-46e9-4845-af48-8a947fc761ab] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:15.684481 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8b421c27-7bf7-4497-b50d-2b0cdeb908bd tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:15.684998 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8b421c27-7bf7-4497-b50d-2b0cdeb908bd tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:15.685493 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8b421c27-7bf7-4497-b50d-2b0cdeb908bd tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:15.686304 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8b421c27-7bf7-4497-b50d-2b0cdeb908bd tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:15.686862 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8b421c27-7bf7-4497-b50d-2b0cdeb908bd tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:15.687341 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8b421c27-7bf7-4497-b50d-2b0cdeb908bd tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:15.837871 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.network.security_group_api [None req-8b421c27-7bf7-4497-b50d-2b0cdeb908bd tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Removing security group 4fa4c742-c5bd-47a7-a015-ab50602da9ff from port 42911696-79b4-4b32-b778-c04a2eb0e93b Oct 04 21:46:16.219527 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-8b421c27-7bf7-4497-b50d-2b0cdeb908bd tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] 10.222.0.33 "POST /compute/v2.1/servers/e43046ae-46e9-4845-af48-8a947fc761ab/action" status: 202 len: 0 microversion: 2.1 time: 0.553121 Oct 04 21:46:16.220314 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3518/7000] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 21:46:15 2022] POST /compute/v2.1/servers/e43046ae-46e9-4845-af48-8a947fc761ab/action => generated 0 bytes in 555 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 21:46:16.228809 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=4 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:46:16.231380 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=16,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:46:16.373069 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-00588b7e-7fb2-4229-ab6a-6235a972d924 req-d8cca825-b011-46d6-82e7-8bc90a2cdfaf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e43046ae-46e9-4845-af48-8a947fc761ab", "tag": "42911696-79b4-4b32-b778-c04a2eb0e93b"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:46:16.402907 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-00588b7e-7fb2-4229-ab6a-6235a972d924 req-d8cca825-b011-46d6-82e7-8bc90a2cdfaf service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:16.403571 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-00588b7e-7fb2-4229-ab6a-6235a972d924 req-d8cca825-b011-46d6-82e7-8bc90a2cdfaf service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:16.404253 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-00588b7e-7fb2-4229-ab6a-6235a972d924 req-d8cca825-b011-46d6-82e7-8bc90a2cdfaf service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:16.429310 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-00588b7e-7fb2-4229-ab6a-6235a972d924 req-d8cca825-b011-46d6-82e7-8bc90a2cdfaf service nova] Creating event network-changed:42911696-79b4-4b32-b778-c04a2eb0e93b for instance e43046ae-46e9-4845-af48-8a947fc761ab on n-h2-854823-8 Oct 04 21:46:16.437562 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-00588b7e-7fb2-4229-ab6a-6235a972d924 req-d8cca825-b011-46d6-82e7-8bc90a2cdfaf service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.212078 Oct 04 21:46:16.438484 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3483/7001] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:46:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:46:18.170293 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-b4d8437c-af79-487d-8e57-2c2eff7e187a tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:18.171116 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-b4d8437c-af79-487d-8e57-2c2eff7e187a tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] [instance: e43046ae-46e9-4845-af48-8a947fc761ab] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:18.180224 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b4d8437c-af79-487d-8e57-2c2eff7e187a tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:18.180658 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b4d8437c-af79-487d-8e57-2c2eff7e187a tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:18.181337 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b4d8437c-af79-487d-8e57-2c2eff7e187a tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:18.182259 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b4d8437c-af79-487d-8e57-2c2eff7e187a tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:18.182775 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b4d8437c-af79-487d-8e57-2c2eff7e187a tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:18.183221 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b4d8437c-af79-487d-8e57-2c2eff7e187a tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:18.204311 n-d-854823-8 devstack@n-api.service[128802]: INFO oslo.messaging._drivers.impl_rabbit [-] [3ed749fe-ba58-4081-afad-8a961afd7471] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 54632. Oct 04 21:46:18.205139 n-d-854823-8 devstack@n-api.service[128802]: INFO oslo.messaging._drivers.impl_rabbit [-] [399f3af7-d281-4213-9ef7-61e2871c9a11] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 54634. Oct 04 21:46:18.289780 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.objects.instance [None req-b4d8437c-af79-487d-8e57-2c2eff7e187a tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lazy-loading 'services' on Instance uuid e43046ae-46e9-4845-af48-8a947fc761ab {{(pid=128802) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:46:18.384856 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-b4d8437c-af79-487d-8e57-2c2eff7e187a tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] 10.222.0.33 "DELETE /compute/v2.1/servers/e43046ae-46e9-4845-af48-8a947fc761ab/os-volume_attachments/3ff26fad-8785-4327-a32c-c0bceacc895b" status: 202 len: 0 microversion: 2.1 time: 0.219827 Oct 04 21:46:18.386102 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3519/7002] 10.222.0.33 () {58 vars in 1416 bytes} [Tue Oct 4 21:46:18 2022] DELETE /compute/v2.1/servers/e43046ae-46e9-4845-af48-8a947fc761ab/os-volume_attachments/3ff26fad-8785-4327-a32c-c0bceacc895b => generated 0 bytes in 222 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:46:18.404195 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9486afc8-5c7a-4678-a8e8-b290fe4a9f9a tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:18.408657 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-9486afc8-5c7a-4678-a8e8-b290fe4a9f9a tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] [instance: e43046ae-46e9-4845-af48-8a947fc761ab] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:18.421827 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9486afc8-5c7a-4678-a8e8-b290fe4a9f9a tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:18.422763 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9486afc8-5c7a-4678-a8e8-b290fe4a9f9a tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:18.423782 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9486afc8-5c7a-4678-a8e8-b290fe4a9f9a tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:18.425723 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9486afc8-5c7a-4678-a8e8-b290fe4a9f9a tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:18.426608 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9486afc8-5c7a-4678-a8e8-b290fe4a9f9a tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:18.427336 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9486afc8-5c7a-4678-a8e8-b290fe4a9f9a tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:18.464300 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-46ba11a9-89e0-4d5d-9dd1-9a9131627242 req-c9614530-a165-4387-9823-79c639088f9f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e43046ae-46e9-4845-af48-8a947fc761ab", "tag": "42911696-79b4-4b32-b778-c04a2eb0e93b"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:46:18.484241 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-9486afc8-5c7a-4678-a8e8-b290fe4a9f9a tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] 10.222.0.33 "GET /compute/v2.1/servers/e43046ae-46e9-4845-af48-8a947fc761ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.091635 Oct 04 21:46:18.486055 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-46ba11a9-89e0-4d5d-9dd1-9a9131627242 req-c9614530-a165-4387-9823-79c639088f9f service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:18.486901 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3484/7003] 10.222.0.33 () {58 vars in 1302 bytes} [Tue Oct 4 21:46:18 2022] GET /compute/v2.1/servers/e43046ae-46e9-4845-af48-8a947fc761ab/os-volume_attachments => generated 197 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:46:18.487944 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-46ba11a9-89e0-4d5d-9dd1-9a9131627242 req-c9614530-a165-4387-9823-79c639088f9f service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:18.489058 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-46ba11a9-89e0-4d5d-9dd1-9a9131627242 req-c9614530-a165-4387-9823-79c639088f9f service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:18.507920 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-46ba11a9-89e0-4d5d-9dd1-9a9131627242 req-c9614530-a165-4387-9823-79c639088f9f service nova] Creating event network-changed:42911696-79b4-4b32-b778-c04a2eb0e93b for instance e43046ae-46e9-4845-af48-8a947fc761ab on n-h2-854823-8 Oct 04 21:46:18.514940 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-46ba11a9-89e0-4d5d-9dd1-9a9131627242 req-c9614530-a165-4387-9823-79c639088f9f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058567 Oct 04 21:46:18.516296 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3520/7004] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:46:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:46:19.504153 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-4837d048-02c1-4815-85f4-f490a2222131 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:19.509823 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-4837d048-02c1-4815-85f4-f490a2222131 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] [instance: e43046ae-46e9-4845-af48-8a947fc761ab] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:19.526290 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4837d048-02c1-4815-85f4-f490a2222131 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:19.527583 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4837d048-02c1-4815-85f4-f490a2222131 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:19.528485 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4837d048-02c1-4815-85f4-f490a2222131 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:19.529716 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4837d048-02c1-4815-85f4-f490a2222131 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:19.530831 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4837d048-02c1-4815-85f4-f490a2222131 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:19.531627 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4837d048-02c1-4815-85f4-f490a2222131 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:19.631696 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-4837d048-02c1-4815-85f4-f490a2222131 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] 10.222.0.33 "GET /compute/v2.1/servers/e43046ae-46e9-4845-af48-8a947fc761ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.134881 Oct 04 21:46:19.633386 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3485/7005] 10.222.0.33 () {58 vars in 1302 bytes} [Tue Oct 4 21:46:19 2022] GET /compute/v2.1/servers/e43046ae-46e9-4845-af48-8a947fc761ab/os-volume_attachments => generated 197 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:46:20.652115 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-72b22162-45cc-48ae-ae44-9caa55336a7e tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:20.654995 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-72b22162-45cc-48ae-ae44-9caa55336a7e tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] [instance: e43046ae-46e9-4845-af48-8a947fc761ab] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:20.666873 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-72b22162-45cc-48ae-ae44-9caa55336a7e tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:20.668890 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-72b22162-45cc-48ae-ae44-9caa55336a7e tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:20.668890 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-72b22162-45cc-48ae-ae44-9caa55336a7e tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:20.670151 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-72b22162-45cc-48ae-ae44-9caa55336a7e tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:20.671083 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-72b22162-45cc-48ae-ae44-9caa55336a7e tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:20.671913 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-72b22162-45cc-48ae-ae44-9caa55336a7e tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:20.731858 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-72b22162-45cc-48ae-ae44-9caa55336a7e tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] 10.222.0.33 "GET /compute/v2.1/servers/e43046ae-46e9-4845-af48-8a947fc761ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.086748 Oct 04 21:46:20.732980 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3521/7006] 10.222.0.33 () {58 vars in 1302 bytes} [Tue Oct 4 21:46:20 2022] GET /compute/v2.1/servers/e43046ae-46e9-4845-af48-8a947fc761ab/os-volume_attachments => generated 197 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:46:21.750848 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-03ebebbc-b234-4b02-8f6d-9689a24497e9 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:21.754000 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-03ebebbc-b234-4b02-8f6d-9689a24497e9 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] [instance: e43046ae-46e9-4845-af48-8a947fc761ab] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:21.762438 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-03ebebbc-b234-4b02-8f6d-9689a24497e9 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:21.763013 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-03ebebbc-b234-4b02-8f6d-9689a24497e9 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:21.763517 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-03ebebbc-b234-4b02-8f6d-9689a24497e9 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:21.764287 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-03ebebbc-b234-4b02-8f6d-9689a24497e9 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:21.764834 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-03ebebbc-b234-4b02-8f6d-9689a24497e9 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:21.765316 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-03ebebbc-b234-4b02-8f6d-9689a24497e9 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:21.816401 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-03ebebbc-b234-4b02-8f6d-9689a24497e9 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] 10.222.0.33 "GET /compute/v2.1/servers/e43046ae-46e9-4845-af48-8a947fc761ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.068794 Oct 04 21:46:21.817499 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3486/7007] 10.222.0.33 () {58 vars in 1302 bytes} [Tue Oct 4 21:46:21 2022] GET /compute/v2.1/servers/e43046ae-46e9-4845-af48-8a947fc761ab/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:46:22.834619 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-5f4c5442-61ef-48bf-bd97-e2e9cd8b8d97 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:22.836906 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-5f4c5442-61ef-48bf-bd97-e2e9cd8b8d97 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] [instance: e43046ae-46e9-4845-af48-8a947fc761ab] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:22.844942 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5f4c5442-61ef-48bf-bd97-e2e9cd8b8d97 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:22.845493 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5f4c5442-61ef-48bf-bd97-e2e9cd8b8d97 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:22.845955 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5f4c5442-61ef-48bf-bd97-e2e9cd8b8d97 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:22.847411 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5f4c5442-61ef-48bf-bd97-e2e9cd8b8d97 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:22.848102 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5f4c5442-61ef-48bf-bd97-e2e9cd8b8d97 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:22.848567 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5f4c5442-61ef-48bf-bd97-e2e9cd8b8d97 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:22.884118 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-5f4c5442-61ef-48bf-bd97-e2e9cd8b8d97 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] 10.222.0.33 "GET /compute/v2.1/servers/e43046ae-46e9-4845-af48-8a947fc761ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054924 Oct 04 21:46:22.884934 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3522/7008] 10.222.0.33 () {58 vars in 1302 bytes} [Tue Oct 4 21:46:22 2022] GET /compute/v2.1/servers/e43046ae-46e9-4845-af48-8a947fc761ab/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:46:23.897588 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5ba2f187-5753-4530-bc8e-de3ef7c5a8fa tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:23.900139 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-5ba2f187-5753-4530-bc8e-de3ef7c5a8fa tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] [instance: e43046ae-46e9-4845-af48-8a947fc761ab] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:23.908914 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5ba2f187-5753-4530-bc8e-de3ef7c5a8fa tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:23.909555 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5ba2f187-5753-4530-bc8e-de3ef7c5a8fa tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:23.910275 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5ba2f187-5753-4530-bc8e-de3ef7c5a8fa tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:23.911441 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5ba2f187-5753-4530-bc8e-de3ef7c5a8fa tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:23.911980 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5ba2f187-5753-4530-bc8e-de3ef7c5a8fa tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:23.912420 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5ba2f187-5753-4530-bc8e-de3ef7c5a8fa tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:23.947921 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5ba2f187-5753-4530-bc8e-de3ef7c5a8fa tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] 10.222.0.33 "GET /compute/v2.1/servers/e43046ae-46e9-4845-af48-8a947fc761ab/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.054909 Oct 04 21:46:23.948431 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3487/7009] 10.222.0.33 () {58 vars in 1302 bytes} [Tue Oct 4 21:46:23 2022] GET /compute/v2.1/servers/e43046ae-46e9-4845-af48-8a947fc761ab/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 21:46:23.960842 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-4bb9916f-59d2-4ad3-b9ce-1793f1beb738 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:23.961691 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-4bb9916f-59d2-4ad3-b9ce-1793f1beb738 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] [instance: e43046ae-46e9-4845-af48-8a947fc761ab] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:23.969005 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4bb9916f-59d2-4ad3-b9ce-1793f1beb738 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:23.969512 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4bb9916f-59d2-4ad3-b9ce-1793f1beb738 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:23.969984 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4bb9916f-59d2-4ad3-b9ce-1793f1beb738 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:23.970753 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4bb9916f-59d2-4ad3-b9ce-1793f1beb738 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:23.972223 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4bb9916f-59d2-4ad3-b9ce-1793f1beb738 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:23.972778 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4bb9916f-59d2-4ad3-b9ce-1793f1beb738 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:24.068169 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.wsgi [None req-4bb9916f-59d2-4ad3-b9ce-1793f1beb738 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] HTTP exception thrown: Instance e43046ae-46e9-4845-af48-8a947fc761ab is not attached to volume 3ff26fad-8785-4327-a32c-c0bceacc895b Oct 04 21:46:24.070008 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-4bb9916f-59d2-4ad3-b9ce-1793f1beb738 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Request method failure captured: Oct 04 21:46:24.070008 n-d-854823-8 devstack@n-api.service[128802]: request: DELETE /compute/v2.1/servers/e43046ae-46e9-4845-af48-8a947fc761ab/os-volume_attachments/3ff26fad-8785-4327-a32c-c0bceacc895b HTTP/1.1 Oct 04 21:46:24.070008 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 21:46:24.070008 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 21:46:24.070008 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 21:46:24.070008 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 0 Oct 04 21:46:24.070008 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 21:46:24.070008 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 21:46:24.070008 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 21:46:24.070008 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 21:46:24.070008 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPKjEGDFAqr06wGYGiddF4oc0BRE102RCjTdUBtdwO-Ov7skQPAm1_If6NpGgMYaBpfFC3r1Zdw0lm9YgT0Rx_ggxXz3KLZ90VfdrAP_O35CwxbEd4AZafa20n5-f3CKFl9e_T2XPSWFAqd1tTJVvqDDcxur5iitKqhci7o6CgQooUDs Oct 04 21:46:24.070008 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 21:46:24.070008 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 21:46:24.070008 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 21:46:24.070008 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 21:46:24.070008 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 21:46:24.070008 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 21:46:24.070008 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: de9b441849694e2399094a86c20fa9dc Oct 04 21:46:24.070008 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-TestMinimumBasicScenario-1081630272 Oct 04 21:46:24.070008 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 21:46:24.070008 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 21:46:24.070008 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_de9b441849694e2399094a86c20fa9dc", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/de9b441849694e2399094a86c20fa9dc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/de9b441849694e2399094a86c20fa9dc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/de9b441849694e2399094a86c20fa9dc"}]}] Oct 04 21:46:24.070008 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-TestMinimumBasicScenario-1081630272 Oct 04 21:46:24.070008 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: de9b441849694e2399094a86c20fa9dc Oct 04 21:46:24.070008 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1081630272 Oct 04 21:46:24.070008 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-TestMinimumBasicScenario-1081630272-project Oct 04 21:46:24.070008 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 21:46:24.070008 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 21:46:24.070008 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: 8e90d254a9d942818ef85e0eb4f145e7 Oct 04 21:46:24.070008 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-TestMinimumBasicScenario-1081630272-project Oct 04 21:46:24.070008 n-d-854823-8 devstack@n-api.service[128802]: method: > Oct 04 21:46:24.070008 n-d-854823-8 devstack@n-api.service[128802]: exception: Instance e43046ae-46e9-4845-af48-8a947fc761ab is not attached to volume 3ff26fad-8785-4327-a32c-c0bceacc895b Oct 04 21:46:24.070008 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'server_id': 'e43046ae-46e9-4845-af48-8a947fc761ab', 'id': '3ff26fad-8785-4327-a32c-c0bceacc895b'} Oct 04 21:46:24.070008 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:46:24.070008 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:46:24.070008 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 04 21:46:24.070008 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 04 21:46:24.070008 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 21:46:24.070008 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 21:46:24.070008 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 04 21:46:24.070008 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 04 21:46:24.070008 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 3ff26fad-8785-4327-a32c-c0bceacc895b. Oct 04 21:46:24.070008 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:46:24.070008 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:46:24.070008 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:46:24.070008 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:46:24.070008 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:46:24.070008 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:46:24.070008 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:46:24.070008 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:46:24.070008 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:46:24.070008 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:46:24.070008 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 04 21:46:24.070008 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 04 21:46:24.070008 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e43046ae-46e9-4845-af48-8a947fc761ab is not attached to volume 3ff26fad-8785-4327-a32c-c0bceacc895b Oct 04 21:46:24.070008 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:46:24.070008 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:46:24.070008 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:46:24.070008 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:46:24.070008 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:46:24.070008 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:46:24.078286 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:46:24.078286 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:46:24.078286 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e43046ae-46e9-4845-af48-8a947fc761ab is not attached to volume 3ff26fad-8785-4327-a32c-c0bceacc895b Oct 04 21:46:24.078286 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:46:24.078286 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-4bb9916f-59d2-4ad3-b9ce-1793f1beb738 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Returning 404 to user: Instance e43046ae-46e9-4845-af48-8a947fc761ab is not attached to volume 3ff26fad-8785-4327-a32c-c0bceacc895b {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:46:24.078286 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-4bb9916f-59d2-4ad3-b9ce-1793f1beb738 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] 10.222.0.33 "DELETE /compute/v2.1/servers/e43046ae-46e9-4845-af48-8a947fc761ab/os-volume_attachments/3ff26fad-8785-4327-a32c-c0bceacc895b" status: 404 len: 154 microversion: 2.1 time: 0.116100 Oct 04 21:46:24.078286 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3523/7010] 10.222.0.33 () {58 vars in 1416 bytes} [Tue Oct 4 21:46:23 2022] DELETE /compute/v2.1/servers/e43046ae-46e9-4845-af48-8a947fc761ab/os-volume_attachments/3ff26fad-8785-4327-a32c-c0bceacc895b => generated 154 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:46:27.383249 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0d553458-34e9-4736-909a-5c1222d4cb2d tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:27.384198 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-0d553458-34e9-4736-909a-5c1222d4cb2d tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] [instance: e43046ae-46e9-4845-af48-8a947fc761ab] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:27.392622 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0d553458-34e9-4736-909a-5c1222d4cb2d tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:27.393328 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0d553458-34e9-4736-909a-5c1222d4cb2d tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:27.393825 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0d553458-34e9-4736-909a-5c1222d4cb2d tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:27.394846 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0d553458-34e9-4736-909a-5c1222d4cb2d tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:27.395468 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0d553458-34e9-4736-909a-5c1222d4cb2d tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:27.396088 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0d553458-34e9-4736-909a-5c1222d4cb2d tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:27.430758 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-0d553458-34e9-4736-909a-5c1222d4cb2d tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] [instance: e43046ae-46e9-4845-af48-8a947fc761ab] Going to try to terminate instance {{(pid=128801) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:46:27.547995 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-0d553458-34e9-4736-909a-5c1222d4cb2d tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] 10.222.0.33 "DELETE /compute/v2.1/servers/e43046ae-46e9-4845-af48-8a947fc761ab" status: 204 len: 0 microversion: 2.1 time: 0.168243 Oct 04 21:46:27.550212 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3488/7011] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 21:46:27 2022] DELETE /compute/v2.1/servers/e43046ae-46e9-4845-af48-8a947fc761ab => generated 0 bytes in 172 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:46:27.563740 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-b5aa1011-eebb-40e2-9ce2-b3ed51785462 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:27.565033 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-b5aa1011-eebb-40e2-9ce2-b3ed51785462 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] [instance: e43046ae-46e9-4845-af48-8a947fc761ab] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:27.579275 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b5aa1011-eebb-40e2-9ce2-b3ed51785462 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:27.580186 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b5aa1011-eebb-40e2-9ce2-b3ed51785462 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:27.581712 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b5aa1011-eebb-40e2-9ce2-b3ed51785462 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:27.583111 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b5aa1011-eebb-40e2-9ce2-b3ed51785462 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:27.584048 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b5aa1011-eebb-40e2-9ce2-b3ed51785462 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:27.584866 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b5aa1011-eebb-40e2-9ce2-b3ed51785462 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:27.796941 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-b5aa1011-eebb-40e2-9ce2-b3ed51785462 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e90d254a9d942818ef85e0eb4f145e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de9b441849694e2399094a86c20fa9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:27.809028 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-b5aa1011-eebb-40e2-9ce2-b3ed51785462 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] 10.222.0.33 "GET /compute/v2.1/servers/e43046ae-46e9-4845-af48-8a947fc761ab" status: 200 len: 1553 microversion: 2.1 time: 0.253235 Oct 04 21:46:27.809646 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3524/7012] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:27 2022] GET /compute/v2.1/servers/e43046ae-46e9-4845-af48-8a947fc761ab => generated 1553 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:28.836061 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f09ad847-1268-455d-b4ff-9fd574b89382 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:28.836656 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f09ad847-1268-455d-b4ff-9fd574b89382 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] [instance: e43046ae-46e9-4845-af48-8a947fc761ab] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:28.843966 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f09ad847-1268-455d-b4ff-9fd574b89382 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:28.844457 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f09ad847-1268-455d-b4ff-9fd574b89382 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:28.844895 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f09ad847-1268-455d-b4ff-9fd574b89382 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:28.845627 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f09ad847-1268-455d-b4ff-9fd574b89382 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:28.846100 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f09ad847-1268-455d-b4ff-9fd574b89382 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:28.847190 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f09ad847-1268-455d-b4ff-9fd574b89382 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:29.007572 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f09ad847-1268-455d-b4ff-9fd574b89382 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e90d254a9d942818ef85e0eb4f145e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de9b441849694e2399094a86c20fa9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:29.016094 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f09ad847-1268-455d-b4ff-9fd574b89382 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] 10.222.0.33 "GET /compute/v2.1/servers/e43046ae-46e9-4845-af48-8a947fc761ab" status: 200 len: 1553 microversion: 2.1 time: 0.185331 Oct 04 21:46:29.016680 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3489/7013] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:28 2022] GET /compute/v2.1/servers/e43046ae-46e9-4845-af48-8a947fc761ab => generated 1553 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:29.832674 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-93c0c1c5-51b3-42e3-b202-4e32dafe5d30 req-c55f855a-8db0-4fd3-b193-45eaaeb803ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e43046ae-46e9-4845-af48-8a947fc761ab", "name": "network-vif-deleted", "tag": "42911696-79b4-4b32-b778-c04a2eb0e93b"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:46:29.844234 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-93c0c1c5-51b3-42e3-b202-4e32dafe5d30 req-c55f855a-8db0-4fd3-b193-45eaaeb803ce service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:29.844729 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-93c0c1c5-51b3-42e3-b202-4e32dafe5d30 req-c55f855a-8db0-4fd3-b193-45eaaeb803ce service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:29.845179 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-93c0c1c5-51b3-42e3-b202-4e32dafe5d30 req-c55f855a-8db0-4fd3-b193-45eaaeb803ce service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:29.858414 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-93c0c1c5-51b3-42e3-b202-4e32dafe5d30 req-c55f855a-8db0-4fd3-b193-45eaaeb803ce service nova] Creating event network-vif-deleted:42911696-79b4-4b32-b778-c04a2eb0e93b for instance e43046ae-46e9-4845-af48-8a947fc761ab on n-h2-854823-8 Oct 04 21:46:29.864602 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-93c0c1c5-51b3-42e3-b202-4e32dafe5d30 req-c55f855a-8db0-4fd3-b193-45eaaeb803ce service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036283 Oct 04 21:46:29.865341 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3525/7014] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:46:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:46:30.039921 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-67b3d997-4723-4e92-83c2-d1bd61c7a409 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:30.040473 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-67b3d997-4723-4e92-83c2-d1bd61c7a409 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] [instance: e43046ae-46e9-4845-af48-8a947fc761ab] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:30.049801 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-67b3d997-4723-4e92-83c2-d1bd61c7a409 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:30.049801 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-67b3d997-4723-4e92-83c2-d1bd61c7a409 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:30.049801 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-67b3d997-4723-4e92-83c2-d1bd61c7a409 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:30.050805 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-67b3d997-4723-4e92-83c2-d1bd61c7a409 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:30.050805 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-67b3d997-4723-4e92-83c2-d1bd61c7a409 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:30.051178 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-67b3d997-4723-4e92-83c2-d1bd61c7a409 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:30.087659 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-67b3d997-4723-4e92-83c2-d1bd61c7a409 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:30.088159 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-67b3d997-4723-4e92-83c2-d1bd61c7a409 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:30.088714 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-67b3d997-4723-4e92-83c2-d1bd61c7a409 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:30.089047 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-67b3d997-4723-4e92-83c2-d1bd61c7a409 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lazy-loading 'fault' on Instance uuid e43046ae-46e9-4845-af48-8a947fc761ab {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:46:30.137776 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-67b3d997-4723-4e92-83c2-d1bd61c7a409 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e90d254a9d942818ef85e0eb4f145e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de9b441849694e2399094a86c20fa9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:30.147098 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-67b3d997-4723-4e92-83c2-d1bd61c7a409 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] 10.222.0.33 "GET /compute/v2.1/servers/e43046ae-46e9-4845-af48-8a947fc761ab" status: 200 len: 1347 microversion: 2.1 time: 0.111262 Oct 04 21:46:30.147712 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3490/7015] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:30 2022] GET /compute/v2.1/servers/e43046ae-46e9-4845-af48-8a947fc761ab => generated 1347 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:31.176742 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-02783507-affa-4089-8ee8-8463eade5dfd tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:31.177501 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-02783507-affa-4089-8ee8-8463eade5dfd tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] [instance: e43046ae-46e9-4845-af48-8a947fc761ab] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:31.184479 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-02783507-affa-4089-8ee8-8463eade5dfd tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:31.185006 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-02783507-affa-4089-8ee8-8463eade5dfd tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:31.185437 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-02783507-affa-4089-8ee8-8463eade5dfd tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:31.186171 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-02783507-affa-4089-8ee8-8463eade5dfd tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:31.186677 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-02783507-affa-4089-8ee8-8463eade5dfd tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:31.187123 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-02783507-affa-4089-8ee8-8463eade5dfd tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:31.202828 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.wsgi [None req-02783507-affa-4089-8ee8-8463eade5dfd tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] HTTP exception thrown: Instance e43046ae-46e9-4845-af48-8a947fc761ab could not be found. Oct 04 21:46:31.204558 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-02783507-affa-4089-8ee8-8463eade5dfd tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Request method failure captured: Oct 04 21:46:31.204558 n-d-854823-8 devstack@n-api.service[128802]: request: GET /compute/v2.1/servers/e43046ae-46e9-4845-af48-8a947fc761ab HTTP/1.1 Oct 04 21:46:31.204558 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 21:46:31.204558 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 21:46:31.204558 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 21:46:31.204558 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 0 Oct 04 21:46:31.204558 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 21:46:31.204558 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 21:46:31.204558 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 21:46:31.204558 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 21:46:31.204558 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPKjEGDFAqr06wGYGiddF4oc0BRE102RCjTdUBtdwO-Ov7skQPAm1_If6NpGgMYaBpfFC3r1Zdw0lm9YgT0Rx_ggxXz3KLZ90VfdrAP_O35CwxbEd4AZafa20n5-f3CKFl9e_T2XPSWFAqd1tTJVvqDDcxur5iitKqhci7o6CgQooUDs Oct 04 21:46:31.204558 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 21:46:31.204558 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 21:46:31.204558 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 21:46:31.204558 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 21:46:31.204558 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 21:46:31.204558 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 21:46:31.204558 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: de9b441849694e2399094a86c20fa9dc Oct 04 21:46:31.204558 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-TestMinimumBasicScenario-1081630272 Oct 04 21:46:31.204558 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 21:46:31.204558 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 21:46:31.204558 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_de9b441849694e2399094a86c20fa9dc", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/de9b441849694e2399094a86c20fa9dc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/de9b441849694e2399094a86c20fa9dc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/de9b441849694e2399094a86c20fa9dc"}]}] Oct 04 21:46:31.204558 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-TestMinimumBasicScenario-1081630272 Oct 04 21:46:31.204558 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: de9b441849694e2399094a86c20fa9dc Oct 04 21:46:31.204558 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1081630272 Oct 04 21:46:31.204558 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-TestMinimumBasicScenario-1081630272-project Oct 04 21:46:31.204558 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 21:46:31.204558 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 21:46:31.204558 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: 8e90d254a9d942818ef85e0eb4f145e7 Oct 04 21:46:31.204558 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-TestMinimumBasicScenario-1081630272-project Oct 04 21:46:31.204558 n-d-854823-8 devstack@n-api.service[128802]: method: > Oct 04 21:46:31.204558 n-d-854823-8 devstack@n-api.service[128802]: exception: Instance e43046ae-46e9-4845-af48-8a947fc761ab could not be found. Oct 04 21:46:31.204558 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'id': 'e43046ae-46e9-4845-af48-8a947fc761ab'} Oct 04 21:46:31.204558 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:46:31.204558 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:46:31.204558 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:46:31.204558 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:46:31.204558 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:46:31.204558 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:46:31.204558 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:46:31.204558 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:46:31.204558 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:46:31.204558 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:46:31.204558 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e43046ae-46e9-4845-af48-8a947fc761ab could not be found. Oct 04 21:46:31.204558 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:46:31.204558 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:46:31.204558 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:46:31.204558 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:46:31.204558 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:46:31.204558 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:46:31.204558 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:46:31.204558 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:46:31.204558 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:46:31.204558 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:46:31.204558 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:46:31.204558 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:46:31.204558 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:46:31.204558 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:46:31.204558 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:46:31.204558 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:46:31.204558 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e43046ae-46e9-4845-af48-8a947fc761ab could not be found. Oct 04 21:46:31.204558 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:46:31.204558 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:46:31.204558 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:46:31.213735 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:46:31.213735 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:46:31.213735 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:46:31.213735 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:46:31.213735 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:46:31.213735 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e43046ae-46e9-4845-af48-8a947fc761ab could not be found. Oct 04 21:46:31.213735 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:46:31.213735 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-02783507-affa-4089-8ee8-8463eade5dfd tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Returning 404 to user: Instance e43046ae-46e9-4845-af48-8a947fc761ab could not be found. {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:46:31.213735 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-02783507-affa-4089-8ee8-8463eade5dfd tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] 10.222.0.33 "GET /compute/v2.1/servers/e43046ae-46e9-4845-af48-8a947fc761ab" status: 404 len: 111 microversion: 2.1 time: 0.036623 Oct 04 21:46:31.213735 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3526/7016] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:31 2022] GET /compute/v2.1/servers/e43046ae-46e9-4845-af48-8a947fc761ab => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:46:31.220895 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-cae2e09b-2b1f-4190-a52b-e6e2566b1a4d tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Calling method '.version_select at 0x7f3c6fa4d8b0>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:31.254778 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-cae2e09b-2b1f-4190-a52b-e6e2566b1a4d tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-715830866" status: 202 len: 0 microversion: 2.1 time: 0.040566 Oct 04 21:46:31.255575 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3491/7017] 10.222.0.33 () {58 vars in 1269 bytes} [Tue Oct 4 21:46:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-715830866 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:46:41.288735 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-90317278-d643-4e95-909f-f9322c782638 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Action: 'create', calling method: .version_select at 0x7f3c6f599280>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1449842870", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE+TR/oP67n1MqLkA7KqN8PvOCKmiZFUwBhfs97ickJ8emn1BhOsmFjpIHl3uXqtRDVzeHCemcf8WdleNMB10PqOjx7x7ilW2YKrL87NMiy3CNs3SzBaZsQXveVMpgzwdw=="}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:46:41.296520 n-d-854823-8 devstack@n-api.service[128802]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 21:46:41.296792 n-d-854823-8 devstack@n-api.service[128802]: Tue Oct 4 21:46:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.33) !!! Oct 04 21:46:41.298493 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_api:SELECT=18 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:46:41.299463 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=43,nova_cell1:INSERT=1 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:46:41.317305 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-90317278-d643-4e95-909f-f9322c782638 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Getting quotas for project de9b441849694e2399094a86c20fa9dc. Resources: {'key_pairs'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:46:41.323296 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-90317278-d643-4e95-909f-f9322c782638 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Getting quotas for user 8e90d254a9d942818ef85e0eb4f145e7 and project de9b441849694e2399094a86c20fa9dc. Resources: {'key_pairs'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:46:41.356178 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-90317278-d643-4e95-909f-f9322c782638 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.072016 Oct 04 21:46:41.356802 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3527/7018] 10.222.0.33 () {60 vars in 1159 bytes} [Tue Oct 4 21:46:41 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:46:41.411533 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:46:41.412288 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:46:41.417493 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ec0b76b5-5c34-4184-9fe2-5beb24f91590 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1799543615", "imageRef": "06ab7e8f-704b-444f-a663-0f02870cc832", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1449842870", "networks": [{"uuid": "5a1f5d25-b625-438a-8a98-23b61516dcf5"}]}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:46:41.655795 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.network.neutron [None req-ec0b76b5-5c34-4184-9fe2-5beb24f91590 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] validate_networks() for [('5a1f5d25-b625-438a-8a98-23b61516dcf5', None, None, None, None, None)] {{(pid=128801) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:46:42.499653 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-ec0b76b5-5c34-4184-9fe2-5beb24f91590 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Flavor limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:46:42.500373 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-ec0b76b5-5c34-4184-9fe2-5beb24f91590 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Image limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:46:42.500552 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-ec0b76b5-5c34-4184-9fe2-5beb24f91590 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Flavor pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:46:42.500966 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-ec0b76b5-5c34-4184-9fe2-5beb24f91590 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Image pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:46:42.501379 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-ec0b76b5-5c34-4184-9fe2-5beb24f91590 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:46:42.512397 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ec0b76b5-5c34-4184-9fe2-5beb24f91590 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:42.512887 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ec0b76b5-5c34-4184-9fe2-5beb24f91590 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:42.513330 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ec0b76b5-5c34-4184-9fe2-5beb24f91590 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:42.514133 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ec0b76b5-5c34-4184-9fe2-5beb24f91590 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:42.514641 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ec0b76b5-5c34-4184-9fe2-5beb24f91590 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:42.515071 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ec0b76b5-5c34-4184-9fe2-5beb24f91590 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:42.539128 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-ec0b76b5-5c34-4184-9fe2-5beb24f91590 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Getting quotas for project de9b441849694e2399094a86c20fa9dc. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:46:42.546749 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-ec0b76b5-5c34-4184-9fe2-5beb24f91590 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Getting quotas for user 8e90d254a9d942818ef85e0eb4f145e7 and project de9b441849694e2399094a86c20fa9dc. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:46:42.562308 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ec0b76b5-5c34-4184-9fe2-5beb24f91590 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Going to run 1 instances... {{(pid=128801) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:46:42.564948 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ec0b76b5-5c34-4184-9fe2-5beb24f91590 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] [instance: ba44b84e-68dc-4120-8343-9dd611eb5af5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='06ab7e8f-704b-444f-a663-0f02870cc832',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128801) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:46:42.619420 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ec0b76b5-5c34-4184-9fe2-5beb24f91590 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.209300 Oct 04 21:46:42.620120 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3492/7019] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 21:46:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 1212 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:46:42.644185 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-9a6fde6d-0335-47ba-8ff6-0bead1e62653 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:42.645175 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-9a6fde6d-0335-47ba-8ff6-0bead1e62653 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] [instance: ba44b84e-68dc-4120-8343-9dd611eb5af5] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:42.791641 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-9a6fde6d-0335-47ba-8ff6-0bead1e62653 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e90d254a9d942818ef85e0eb4f145e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de9b441849694e2399094a86c20fa9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:42.799959 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-9a6fde6d-0335-47ba-8ff6-0bead1e62653 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] 10.222.0.33 "GET /compute/v2.1/servers/ba44b84e-68dc-4120-8343-9dd611eb5af5" status: 200 len: 1259 microversion: 2.1 time: 0.166336 Oct 04 21:46:42.800570 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3528/7020] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:42 2022] GET /compute/v2.1/servers/ba44b84e-68dc-4120-8343-9dd611eb5af5 => generated 1259 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:43.824309 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f7bfd3d2-acc6-4377-a100-46a431ddbfdf tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:43.824995 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f7bfd3d2-acc6-4377-a100-46a431ddbfdf tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] [instance: ba44b84e-68dc-4120-8343-9dd611eb5af5] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:43.894007 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f7bfd3d2-acc6-4377-a100-46a431ddbfdf tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e90d254a9d942818ef85e0eb4f145e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de9b441849694e2399094a86c20fa9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:43.902034 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f7bfd3d2-acc6-4377-a100-46a431ddbfdf tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] 10.222.0.33 "GET /compute/v2.1/servers/ba44b84e-68dc-4120-8343-9dd611eb5af5" status: 200 len: 1259 microversion: 2.1 time: 0.081482 Oct 04 21:46:43.902724 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3493/7021] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:43 2022] GET /compute/v2.1/servers/ba44b84e-68dc-4120-8343-9dd611eb5af5 => generated 1259 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:44.930553 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-ebe16cc6-c9c7-43ba-9f03-dbecc4989c25 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:44.931660 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-ebe16cc6-c9c7-43ba-9f03-dbecc4989c25 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] [instance: ba44b84e-68dc-4120-8343-9dd611eb5af5] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:45.017447 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-ebe16cc6-c9c7-43ba-9f03-dbecc4989c25 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e90d254a9d942818ef85e0eb4f145e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de9b441849694e2399094a86c20fa9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:45.028732 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-ebe16cc6-c9c7-43ba-9f03-dbecc4989c25 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] 10.222.0.33 "GET /compute/v2.1/servers/ba44b84e-68dc-4120-8343-9dd611eb5af5" status: 200 len: 1259 microversion: 2.1 time: 0.106562 Oct 04 21:46:45.029609 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3529/7022] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:44 2022] GET /compute/v2.1/servers/ba44b84e-68dc-4120-8343-9dd611eb5af5 => generated 1259 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:46.057584 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-765f306c-2507-4739-ab55-d99f1fc8f582 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:46.058422 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-765f306c-2507-4739-ab55-d99f1fc8f582 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] [instance: ba44b84e-68dc-4120-8343-9dd611eb5af5] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:46.120469 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-765f306c-2507-4739-ab55-d99f1fc8f582 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e90d254a9d942818ef85e0eb4f145e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de9b441849694e2399094a86c20fa9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:46.131737 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-765f306c-2507-4739-ab55-d99f1fc8f582 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] 10.222.0.33 "GET /compute/v2.1/servers/ba44b84e-68dc-4120-8343-9dd611eb5af5" status: 200 len: 1259 microversion: 2.1 time: 0.079361 Oct 04 21:46:46.132345 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3494/7023] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:46 2022] GET /compute/v2.1/servers/ba44b84e-68dc-4120-8343-9dd611eb5af5 => generated 1259 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:46:47.155806 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-14bffae8-4c80-47c0-afcb-4705e359774f tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:47.156438 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-14bffae8-4c80-47c0-afcb-4705e359774f tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] [instance: ba44b84e-68dc-4120-8343-9dd611eb5af5] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:47.164327 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-14bffae8-4c80-47c0-afcb-4705e359774f tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:47.164836 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-14bffae8-4c80-47c0-afcb-4705e359774f tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:47.165297 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-14bffae8-4c80-47c0-afcb-4705e359774f tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:47.166033 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-14bffae8-4c80-47c0-afcb-4705e359774f tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:47.166544 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-14bffae8-4c80-47c0-afcb-4705e359774f tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:47.166983 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-14bffae8-4c80-47c0-afcb-4705e359774f tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:47.235908 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-14bffae8-4c80-47c0-afcb-4705e359774f tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e90d254a9d942818ef85e0eb4f145e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de9b441849694e2399094a86c20fa9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:47.245129 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-14bffae8-4c80-47c0-afcb-4705e359774f tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] 10.222.0.33 "GET /compute/v2.1/servers/ba44b84e-68dc-4120-8343-9dd611eb5af5" status: 200 len: 1263 microversion: 2.1 time: 0.093441 Oct 04 21:46:47.245756 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3530/7024] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:47 2022] GET /compute/v2.1/servers/ba44b84e-68dc-4120-8343-9dd611eb5af5 => generated 1263 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:48.271091 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-bb0848d5-89f9-4a4b-8a31-27047ffcfb26 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:48.271744 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-bb0848d5-89f9-4a4b-8a31-27047ffcfb26 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] [instance: ba44b84e-68dc-4120-8343-9dd611eb5af5] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:48.284055 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bb0848d5-89f9-4a4b-8a31-27047ffcfb26 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:48.285414 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bb0848d5-89f9-4a4b-8a31-27047ffcfb26 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:48.285871 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bb0848d5-89f9-4a4b-8a31-27047ffcfb26 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:48.286666 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bb0848d5-89f9-4a4b-8a31-27047ffcfb26 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:48.287475 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bb0848d5-89f9-4a4b-8a31-27047ffcfb26 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:48.287603 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bb0848d5-89f9-4a4b-8a31-27047ffcfb26 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:48.368424 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-bb0848d5-89f9-4a4b-8a31-27047ffcfb26 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e90d254a9d942818ef85e0eb4f145e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de9b441849694e2399094a86c20fa9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:48.385492 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-bb0848d5-89f9-4a4b-8a31-27047ffcfb26 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] 10.222.0.33 "GET /compute/v2.1/servers/ba44b84e-68dc-4120-8343-9dd611eb5af5" status: 200 len: 1317 microversion: 2.1 time: 0.119596 Oct 04 21:46:48.399315 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3495/7025] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:48 2022] GET /compute/v2.1/servers/ba44b84e-68dc-4120-8343-9dd611eb5af5 => generated 1317 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:49.433339 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-c682c81a-d1f5-4e59-b969-906629995e13 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:49.434537 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-c682c81a-d1f5-4e59-b969-906629995e13 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] [instance: ba44b84e-68dc-4120-8343-9dd611eb5af5] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:49.447038 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c682c81a-d1f5-4e59-b969-906629995e13 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:49.447901 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c682c81a-d1f5-4e59-b969-906629995e13 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:49.448934 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c682c81a-d1f5-4e59-b969-906629995e13 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:49.450520 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c682c81a-d1f5-4e59-b969-906629995e13 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:49.451650 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c682c81a-d1f5-4e59-b969-906629995e13 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:49.452666 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c682c81a-d1f5-4e59-b969-906629995e13 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:49.677922 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-c682c81a-d1f5-4e59-b969-906629995e13 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e90d254a9d942818ef85e0eb4f145e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de9b441849694e2399094a86c20fa9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:49.694833 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-c682c81a-d1f5-4e59-b969-906629995e13 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] 10.222.0.33 "GET /compute/v2.1/servers/ba44b84e-68dc-4120-8343-9dd611eb5af5" status: 200 len: 1359 microversion: 2.1 time: 0.270480 Oct 04 21:46:49.720224 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3531/7026] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:49 2022] GET /compute/v2.1/servers/ba44b84e-68dc-4120-8343-9dd611eb5af5 => generated 1359 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:50.729303 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1dd311e6-6e3f-45db-9d79-5f3a0796bd08 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:50.729928 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-1dd311e6-6e3f-45db-9d79-5f3a0796bd08 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] [instance: ba44b84e-68dc-4120-8343-9dd611eb5af5] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:50.738296 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1dd311e6-6e3f-45db-9d79-5f3a0796bd08 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:50.738835 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1dd311e6-6e3f-45db-9d79-5f3a0796bd08 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:50.739293 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1dd311e6-6e3f-45db-9d79-5f3a0796bd08 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:50.740354 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1dd311e6-6e3f-45db-9d79-5f3a0796bd08 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:50.740825 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1dd311e6-6e3f-45db-9d79-5f3a0796bd08 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:50.741257 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1dd311e6-6e3f-45db-9d79-5f3a0796bd08 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:50.962830 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-1dd311e6-6e3f-45db-9d79-5f3a0796bd08 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e90d254a9d942818ef85e0eb4f145e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de9b441849694e2399094a86c20fa9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:50.978152 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-1dd311e6-6e3f-45db-9d79-5f3a0796bd08 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] 10.222.0.33 "GET /compute/v2.1/servers/ba44b84e-68dc-4120-8343-9dd611eb5af5" status: 200 len: 1359 microversion: 2.1 time: 0.252737 Oct 04 21:46:50.979269 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3496/7027] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:50 2022] GET /compute/v2.1/servers/ba44b84e-68dc-4120-8343-9dd611eb5af5 => generated 1359 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:52.007628 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-3c92707a-1142-47b3-9b7b-f6ae56dfcd56 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:52.008829 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-3c92707a-1142-47b3-9b7b-f6ae56dfcd56 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] [instance: ba44b84e-68dc-4120-8343-9dd611eb5af5] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:52.019337 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3c92707a-1142-47b3-9b7b-f6ae56dfcd56 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:52.019960 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3c92707a-1142-47b3-9b7b-f6ae56dfcd56 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:52.020411 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3c92707a-1142-47b3-9b7b-f6ae56dfcd56 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:52.021209 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3c92707a-1142-47b3-9b7b-f6ae56dfcd56 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:52.021794 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3c92707a-1142-47b3-9b7b-f6ae56dfcd56 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:52.022288 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3c92707a-1142-47b3-9b7b-f6ae56dfcd56 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:52.219895 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-3c92707a-1142-47b3-9b7b-f6ae56dfcd56 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e90d254a9d942818ef85e0eb4f145e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de9b441849694e2399094a86c20fa9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:52.234810 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-3c92707a-1142-47b3-9b7b-f6ae56dfcd56 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] 10.222.0.33 "GET /compute/v2.1/servers/ba44b84e-68dc-4120-8343-9dd611eb5af5" status: 200 len: 1359 microversion: 2.1 time: 0.234436 Oct 04 21:46:52.250446 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3532/7028] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:51 2022] GET /compute/v2.1/servers/ba44b84e-68dc-4120-8343-9dd611eb5af5 => generated 1359 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:53.265987 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-3aed80ff-27c7-4dad-b000-e9d021481825 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:53.266645 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-3aed80ff-27c7-4dad-b000-e9d021481825 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] [instance: ba44b84e-68dc-4120-8343-9dd611eb5af5] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:53.272038 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:46:53.277031 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3aed80ff-27c7-4dad-b000-e9d021481825 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:53.277456 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3aed80ff-27c7-4dad-b000-e9d021481825 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:53.277894 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3aed80ff-27c7-4dad-b000-e9d021481825 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:53.278662 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3aed80ff-27c7-4dad-b000-e9d021481825 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:53.279125 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3aed80ff-27c7-4dad-b000-e9d021481825 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:53.279554 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3aed80ff-27c7-4dad-b000-e9d021481825 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:53.468787 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-3aed80ff-27c7-4dad-b000-e9d021481825 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e90d254a9d942818ef85e0eb4f145e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de9b441849694e2399094a86c20fa9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:53.485243 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-3aed80ff-27c7-4dad-b000-e9d021481825 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] 10.222.0.33 "GET /compute/v2.1/servers/ba44b84e-68dc-4120-8343-9dd611eb5af5" status: 200 len: 1359 microversion: 2.1 time: 0.222967 Oct 04 21:46:53.487048 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3497/7029] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:53 2022] GET /compute/v2.1/servers/ba44b84e-68dc-4120-8343-9dd611eb5af5 => generated 1359 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:54.521749 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-91043127-75d5-4efa-ae16-c7f355e0ee8f tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:54.522870 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-91043127-75d5-4efa-ae16-c7f355e0ee8f tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] [instance: ba44b84e-68dc-4120-8343-9dd611eb5af5] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:54.538596 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-91043127-75d5-4efa-ae16-c7f355e0ee8f tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:54.539492 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-91043127-75d5-4efa-ae16-c7f355e0ee8f tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:54.540418 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-91043127-75d5-4efa-ae16-c7f355e0ee8f tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:54.541705 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-91043127-75d5-4efa-ae16-c7f355e0ee8f tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:54.542582 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-91043127-75d5-4efa-ae16-c7f355e0ee8f tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:54.543340 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-91043127-75d5-4efa-ae16-c7f355e0ee8f tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:54.716042 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-91043127-75d5-4efa-ae16-c7f355e0ee8f tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e90d254a9d942818ef85e0eb4f145e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de9b441849694e2399094a86c20fa9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:54.725463 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-91043127-75d5-4efa-ae16-c7f355e0ee8f tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] 10.222.0.33 "GET /compute/v2.1/servers/ba44b84e-68dc-4120-8343-9dd611eb5af5" status: 200 len: 1359 microversion: 2.1 time: 0.212308 Oct 04 21:46:54.726328 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3533/7030] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:54 2022] GET /compute/v2.1/servers/ba44b84e-68dc-4120-8343-9dd611eb5af5 => generated 1359 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:46:55.750387 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-99c8aa0f-9f37-4ae7-8dad-8cca3edb3061 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:55.751710 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-99c8aa0f-9f37-4ae7-8dad-8cca3edb3061 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] [instance: ba44b84e-68dc-4120-8343-9dd611eb5af5] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:55.759370 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-99c8aa0f-9f37-4ae7-8dad-8cca3edb3061 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:55.759866 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-99c8aa0f-9f37-4ae7-8dad-8cca3edb3061 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:55.760304 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-99c8aa0f-9f37-4ae7-8dad-8cca3edb3061 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:55.761034 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-99c8aa0f-9f37-4ae7-8dad-8cca3edb3061 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:55.761491 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-99c8aa0f-9f37-4ae7-8dad-8cca3edb3061 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:55.761919 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-99c8aa0f-9f37-4ae7-8dad-8cca3edb3061 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:55.930744 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-99c8aa0f-9f37-4ae7-8dad-8cca3edb3061 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e90d254a9d942818ef85e0eb4f145e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de9b441849694e2399094a86c20fa9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:55.938989 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-99c8aa0f-9f37-4ae7-8dad-8cca3edb3061 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] 10.222.0.33 "GET /compute/v2.1/servers/ba44b84e-68dc-4120-8343-9dd611eb5af5" status: 200 len: 1359 microversion: 2.1 time: 0.192540 Oct 04 21:46:55.940095 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3498/7031] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:55 2022] GET /compute/v2.1/servers/ba44b84e-68dc-4120-8343-9dd611eb5af5 => generated 1359 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:46:56.963064 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-e1cc5df3-89e0-4d8d-89a9-9426ee68b463 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:56.963851 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-e1cc5df3-89e0-4d8d-89a9-9426ee68b463 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] [instance: ba44b84e-68dc-4120-8343-9dd611eb5af5] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:56.965799 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell0:SELECT=8 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:46:56.972717 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e1cc5df3-89e0-4d8d-89a9-9426ee68b463 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:56.973232 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e1cc5df3-89e0-4d8d-89a9-9426ee68b463 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:56.973691 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e1cc5df3-89e0-4d8d-89a9-9426ee68b463 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:56.974625 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e1cc5df3-89e0-4d8d-89a9-9426ee68b463 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:56.975133 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e1cc5df3-89e0-4d8d-89a9-9426ee68b463 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:56.975566 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e1cc5df3-89e0-4d8d-89a9-9426ee68b463 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:57.198691 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-549a5f14-5eb5-47a5-bdbb-1201e4356860 req-c5460a20-7cb2-438d-8436-2d1e3f45eae0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba44b84e-68dc-4120-8343-9dd611eb5af5", "tag": "faf78765-2187-4e6d-be04-ac91f53b4595"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:46:57.201701 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-e1cc5df3-89e0-4d8d-89a9-9426ee68b463 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e90d254a9d942818ef85e0eb4f145e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de9b441849694e2399094a86c20fa9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:57.205863 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=10 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:46:57.212238 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-549a5f14-5eb5-47a5-bdbb-1201e4356860 req-c5460a20-7cb2-438d-8436-2d1e3f45eae0 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:57.216223 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-e1cc5df3-89e0-4d8d-89a9-9426ee68b463 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] 10.222.0.33 "GET /compute/v2.1/servers/ba44b84e-68dc-4120-8343-9dd611eb5af5" status: 200 len: 1359 microversion: 2.1 time: 0.256852 Oct 04 21:46:57.217273 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3534/7032] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:56 2022] GET /compute/v2.1/servers/ba44b84e-68dc-4120-8343-9dd611eb5af5 => generated 1359 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:46:57.226546 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-549a5f14-5eb5-47a5-bdbb-1201e4356860 req-c5460a20-7cb2-438d-8436-2d1e3f45eae0 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:57.226546 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-549a5f14-5eb5-47a5-bdbb-1201e4356860 req-c5460a20-7cb2-438d-8436-2d1e3f45eae0 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:57.240143 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-549a5f14-5eb5-47a5-bdbb-1201e4356860 req-c5460a20-7cb2-438d-8436-2d1e3f45eae0 service nova] Creating event network-changed:faf78765-2187-4e6d-be04-ac91f53b4595 for instance ba44b84e-68dc-4120-8343-9dd611eb5af5 on n-h2-854823-8 Oct 04 21:46:57.245143 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-549a5f14-5eb5-47a5-bdbb-1201e4356860 req-c5460a20-7cb2-438d-8436-2d1e3f45eae0 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051057 Oct 04 21:46:57.245731 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3499/7033] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:46:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:46:58.242384 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-42c7e725-fe0f-4b94-816c-cb4e399a571b tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:58.243035 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-42c7e725-fe0f-4b94-816c-cb4e399a571b tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] [instance: ba44b84e-68dc-4120-8343-9dd611eb5af5] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:58.250221 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-42c7e725-fe0f-4b94-816c-cb4e399a571b tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:58.250907 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-42c7e725-fe0f-4b94-816c-cb4e399a571b tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:58.251381 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-42c7e725-fe0f-4b94-816c-cb4e399a571b tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:58.252685 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-42c7e725-fe0f-4b94-816c-cb4e399a571b tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:58.253201 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-42c7e725-fe0f-4b94-816c-cb4e399a571b tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:58.253725 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-42c7e725-fe0f-4b94-816c-cb4e399a571b tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:58.400596 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-42c7e725-fe0f-4b94-816c-cb4e399a571b tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e90d254a9d942818ef85e0eb4f145e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de9b441849694e2399094a86c20fa9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:58.408432 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-42c7e725-fe0f-4b94-816c-cb4e399a571b tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] 10.222.0.33 "GET /compute/v2.1/servers/ba44b84e-68dc-4120-8343-9dd611eb5af5" status: 200 len: 1359 microversion: 2.1 time: 0.170206 Oct 04 21:46:58.409006 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3535/7034] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:58 2022] GET /compute/v2.1/servers/ba44b84e-68dc-4120-8343-9dd611eb5af5 => generated 1359 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:46:59.434759 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-46cde7d1-cfa2-474b-bb46-c28a16d394ba tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:46:59.435504 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-46cde7d1-cfa2-474b-bb46-c28a16d394ba tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] [instance: ba44b84e-68dc-4120-8343-9dd611eb5af5] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:46:59.443324 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-46cde7d1-cfa2-474b-bb46-c28a16d394ba tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:59.443827 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-46cde7d1-cfa2-474b-bb46-c28a16d394ba tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:59.444268 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-46cde7d1-cfa2-474b-bb46-c28a16d394ba tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:59.444987 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-46cde7d1-cfa2-474b-bb46-c28a16d394ba tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:46:59.445450 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-46cde7d1-cfa2-474b-bb46-c28a16d394ba tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:46:59.445883 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-46cde7d1-cfa2-474b-bb46-c28a16d394ba tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:46:59.602859 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-46cde7d1-cfa2-474b-bb46-c28a16d394ba tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e90d254a9d942818ef85e0eb4f145e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de9b441849694e2399094a86c20fa9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:46:59.612267 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-46cde7d1-cfa2-474b-bb46-c28a16d394ba tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] 10.222.0.33 "GET /compute/v2.1/servers/ba44b84e-68dc-4120-8343-9dd611eb5af5" status: 200 len: 1359 microversion: 2.1 time: 0.181753 Oct 04 21:46:59.612908 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3500/7035] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:46:59 2022] GET /compute/v2.1/servers/ba44b84e-68dc-4120-8343-9dd611eb5af5 => generated 1359 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:47:00.643488 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-93597d35-1567-4b12-b041-a0afca0b9fe3 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:00.643488 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-93597d35-1567-4b12-b041-a0afca0b9fe3 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] [instance: ba44b84e-68dc-4120-8343-9dd611eb5af5] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:00.652389 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-93597d35-1567-4b12-b041-a0afca0b9fe3 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:00.652905 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-93597d35-1567-4b12-b041-a0afca0b9fe3 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:00.653399 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-93597d35-1567-4b12-b041-a0afca0b9fe3 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:00.654900 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-93597d35-1567-4b12-b041-a0afca0b9fe3 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:00.654900 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-93597d35-1567-4b12-b041-a0afca0b9fe3 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:00.655202 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-93597d35-1567-4b12-b041-a0afca0b9fe3 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:00.837656 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-93597d35-1567-4b12-b041-a0afca0b9fe3 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e90d254a9d942818ef85e0eb4f145e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de9b441849694e2399094a86c20fa9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:00.846817 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-93597d35-1567-4b12-b041-a0afca0b9fe3 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] 10.222.0.33 "GET /compute/v2.1/servers/ba44b84e-68dc-4120-8343-9dd611eb5af5" status: 200 len: 1359 microversion: 2.1 time: 0.212177 Oct 04 21:47:00.847431 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3536/7036] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:00 2022] GET /compute/v2.1/servers/ba44b84e-68dc-4120-8343-9dd611eb5af5 => generated 1359 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:47:01.875034 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-fc072ccd-904c-4512-b7f3-b7eff4045f4b tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:01.875821 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-fc072ccd-904c-4512-b7f3-b7eff4045f4b tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] [instance: ba44b84e-68dc-4120-8343-9dd611eb5af5] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:01.884977 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fc072ccd-904c-4512-b7f3-b7eff4045f4b tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:01.885598 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fc072ccd-904c-4512-b7f3-b7eff4045f4b tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:01.886069 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fc072ccd-904c-4512-b7f3-b7eff4045f4b tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:01.886813 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fc072ccd-904c-4512-b7f3-b7eff4045f4b tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:01.887270 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fc072ccd-904c-4512-b7f3-b7eff4045f4b tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:01.887694 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fc072ccd-904c-4512-b7f3-b7eff4045f4b tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:02.078421 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-fc072ccd-904c-4512-b7f3-b7eff4045f4b tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e90d254a9d942818ef85e0eb4f145e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de9b441849694e2399094a86c20fa9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:02.093435 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-fc072ccd-904c-4512-b7f3-b7eff4045f4b tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] 10.222.0.33 "GET /compute/v2.1/servers/ba44b84e-68dc-4120-8343-9dd611eb5af5" status: 200 len: 1359 microversion: 2.1 time: 0.225028 Oct 04 21:47:02.094602 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3501/7037] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:01 2022] GET /compute/v2.1/servers/ba44b84e-68dc-4120-8343-9dd611eb5af5 => generated 1359 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:47:03.132790 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-63223f8b-a852-48de-b4d3-f5d93021fa57 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:03.133405 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-63223f8b-a852-48de-b4d3-f5d93021fa57 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] [instance: ba44b84e-68dc-4120-8343-9dd611eb5af5] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:03.140548 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-63223f8b-a852-48de-b4d3-f5d93021fa57 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:03.141054 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-63223f8b-a852-48de-b4d3-f5d93021fa57 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:03.141507 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-63223f8b-a852-48de-b4d3-f5d93021fa57 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:03.142808 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-63223f8b-a852-48de-b4d3-f5d93021fa57 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:03.143510 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-63223f8b-a852-48de-b4d3-f5d93021fa57 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:03.144017 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-63223f8b-a852-48de-b4d3-f5d93021fa57 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:03.305381 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-63223f8b-a852-48de-b4d3-f5d93021fa57 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e90d254a9d942818ef85e0eb4f145e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de9b441849694e2399094a86c20fa9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:03.313272 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-63223f8b-a852-48de-b4d3-f5d93021fa57 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] 10.222.0.33 "GET /compute/v2.1/servers/ba44b84e-68dc-4120-8343-9dd611eb5af5" status: 200 len: 1359 microversion: 2.1 time: 0.184553 Oct 04 21:47:03.313856 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3537/7038] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:03 2022] GET /compute/v2.1/servers/ba44b84e-68dc-4120-8343-9dd611eb5af5 => generated 1359 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:47:03.892088 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-ecbc509a-edad-4017-9381-e8a93c7b5b4f req-5125db6f-9dff-47bf-b41a-8ac012ed09b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba44b84e-68dc-4120-8343-9dd611eb5af5", "name": "network-vif-plugged", "status": "completed", "tag": "faf78765-2187-4e6d-be04-ac91f53b4595"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:47:03.904474 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-ecbc509a-edad-4017-9381-e8a93c7b5b4f req-5125db6f-9dff-47bf-b41a-8ac012ed09b7 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:03.904908 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-ecbc509a-edad-4017-9381-e8a93c7b5b4f req-5125db6f-9dff-47bf-b41a-8ac012ed09b7 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:03.905346 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-ecbc509a-edad-4017-9381-e8a93c7b5b4f req-5125db6f-9dff-47bf-b41a-8ac012ed09b7 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:03.918945 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-ecbc509a-edad-4017-9381-e8a93c7b5b4f req-5125db6f-9dff-47bf-b41a-8ac012ed09b7 service nova] Creating event network-vif-plugged:faf78765-2187-4e6d-be04-ac91f53b4595 for instance ba44b84e-68dc-4120-8343-9dd611eb5af5 on n-h2-854823-8 Oct 04 21:47:03.925422 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-ecbc509a-edad-4017-9381-e8a93c7b5b4f req-5125db6f-9dff-47bf-b41a-8ac012ed09b7 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036878 Oct 04 21:47:03.926060 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3502/7039] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:47:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:47:04.338583 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-b24f05e8-5f64-499e-817c-d83ddf8be5d3 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:04.339212 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-b24f05e8-5f64-499e-817c-d83ddf8be5d3 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] [instance: ba44b84e-68dc-4120-8343-9dd611eb5af5] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:04.346529 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b24f05e8-5f64-499e-817c-d83ddf8be5d3 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:04.347086 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b24f05e8-5f64-499e-817c-d83ddf8be5d3 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:04.347586 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b24f05e8-5f64-499e-817c-d83ddf8be5d3 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:04.348466 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b24f05e8-5f64-499e-817c-d83ddf8be5d3 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:04.349086 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b24f05e8-5f64-499e-817c-d83ddf8be5d3 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:04.349702 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b24f05e8-5f64-499e-817c-d83ddf8be5d3 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:04.485647 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-b24f05e8-5f64-499e-817c-d83ddf8be5d3 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e90d254a9d942818ef85e0eb4f145e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de9b441849694e2399094a86c20fa9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:04.494692 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-b24f05e8-5f64-499e-817c-d83ddf8be5d3 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] 10.222.0.33 "GET /compute/v2.1/servers/ba44b84e-68dc-4120-8343-9dd611eb5af5" status: 200 len: 1359 microversion: 2.1 time: 0.160272 Oct 04 21:47:04.495284 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3538/7040] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:04 2022] GET /compute/v2.1/servers/ba44b84e-68dc-4120-8343-9dd611eb5af5 => generated 1359 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:47:05.519964 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-18dc5db6-5388-4954-8769-4f9dee0d1e91 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:05.520580 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-18dc5db6-5388-4954-8769-4f9dee0d1e91 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] [instance: ba44b84e-68dc-4120-8343-9dd611eb5af5] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:05.526928 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-18dc5db6-5388-4954-8769-4f9dee0d1e91 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:05.527414 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-18dc5db6-5388-4954-8769-4f9dee0d1e91 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:05.527857 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-18dc5db6-5388-4954-8769-4f9dee0d1e91 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:05.528554 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-18dc5db6-5388-4954-8769-4f9dee0d1e91 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:05.529012 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-18dc5db6-5388-4954-8769-4f9dee0d1e91 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:05.529436 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-18dc5db6-5388-4954-8769-4f9dee0d1e91 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:05.665005 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-18dc5db6-5388-4954-8769-4f9dee0d1e91 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e90d254a9d942818ef85e0eb4f145e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de9b441849694e2399094a86c20fa9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:05.673384 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-18dc5db6-5388-4954-8769-4f9dee0d1e91 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] 10.222.0.33 "GET /compute/v2.1/servers/ba44b84e-68dc-4120-8343-9dd611eb5af5" status: 200 len: 1548 microversion: 2.1 time: 0.158797 Oct 04 21:47:05.674629 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3503/7041] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:05 2022] GET /compute/v2.1/servers/ba44b84e-68dc-4120-8343-9dd611eb5af5 => generated 1548 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:47:05.700895 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-b77c7bf8-1410-4688-82b6-e8843b795d4b tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:05.701598 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-b77c7bf8-1410-4688-82b6-e8843b795d4b tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] [instance: ba44b84e-68dc-4120-8343-9dd611eb5af5] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:05.709754 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b77c7bf8-1410-4688-82b6-e8843b795d4b tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:05.710257 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b77c7bf8-1410-4688-82b6-e8843b795d4b tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:05.711559 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b77c7bf8-1410-4688-82b6-e8843b795d4b tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:05.712307 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b77c7bf8-1410-4688-82b6-e8843b795d4b tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:05.712779 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b77c7bf8-1410-4688-82b6-e8843b795d4b tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:05.713224 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b77c7bf8-1410-4688-82b6-e8843b795d4b tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:05.863694 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-b77c7bf8-1410-4688-82b6-e8843b795d4b tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e90d254a9d942818ef85e0eb4f145e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de9b441849694e2399094a86c20fa9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:05.871796 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-b77c7bf8-1410-4688-82b6-e8843b795d4b tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] 10.222.0.33 "GET /compute/v2.1/servers/ba44b84e-68dc-4120-8343-9dd611eb5af5" status: 200 len: 1548 microversion: 2.1 time: 0.175058 Oct 04 21:47:05.872781 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3539/7042] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:05 2022] GET /compute/v2.1/servers/ba44b84e-68dc-4120-8343-9dd611eb5af5 => generated 1548 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:47:05.895991 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-cc2c2617-ed9a-44cb-a6e6-ea11e538360e tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:05.900827 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-cc2c2617-ed9a-44cb-a6e6-ea11e538360e tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8e90d254a9d942818ef85e0eb4f145e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de9b441849694e2399094a86c20fa9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:05.901617 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-cc2c2617-ed9a-44cb-a6e6-ea11e538360e tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Searching by: {'deleted': False, 'project_id': 'de9b441849694e2399094a86c20fa9dc'} {{(pid=128801) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 21:47:05.907387 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cc2c2617-ed9a-44cb-a6e6-ea11e538360e tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:05.909181 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cc2c2617-ed9a-44cb-a6e6-ea11e538360e tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:05.909638 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cc2c2617-ed9a-44cb-a6e6-ea11e538360e tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:05.910408 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cc2c2617-ed9a-44cb-a6e6-ea11e538360e tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:05.910873 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cc2c2617-ed9a-44cb-a6e6-ea11e538360e tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:05.911344 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cc2c2617-ed9a-44cb-a6e6-ea11e538360e tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:05.939365 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.multi_cell_list [None req-cc2c2617-ed9a-44cb-a6e6-ea11e538360e tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128801) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 21:47:05.968309 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-cc2c2617-ed9a-44cb-a6e6-ea11e538360e tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] 10.222.0.33 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.076850 Oct 04 21:47:05.968912 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3504/7043] 10.222.0.33 () {58 vars in 1125 bytes} [Tue Oct 4 21:47:05 2022] GET /compute/v2.1/servers => generated 343 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:47:05.981585 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-7d69b03a-6047-4143-9497-6155c6f9f22f tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:05.982220 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-7d69b03a-6047-4143-9497-6155c6f9f22f tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] [instance: ba44b84e-68dc-4120-8343-9dd611eb5af5] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:05.988885 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7d69b03a-6047-4143-9497-6155c6f9f22f tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:05.989401 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7d69b03a-6047-4143-9497-6155c6f9f22f tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:05.989860 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7d69b03a-6047-4143-9497-6155c6f9f22f tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:05.990627 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7d69b03a-6047-4143-9497-6155c6f9f22f tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:05.991152 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7d69b03a-6047-4143-9497-6155c6f9f22f tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:05.991603 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7d69b03a-6047-4143-9497-6155c6f9f22f tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:06.131356 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-7d69b03a-6047-4143-9497-6155c6f9f22f tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e90d254a9d942818ef85e0eb4f145e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de9b441849694e2399094a86c20fa9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:06.139583 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-7d69b03a-6047-4143-9497-6155c6f9f22f tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] 10.222.0.33 "GET /compute/v2.1/servers/ba44b84e-68dc-4120-8343-9dd611eb5af5" status: 200 len: 1548 microversion: 2.1 time: 0.161915 Oct 04 21:47:06.140174 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3540/7044] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:05 2022] GET /compute/v2.1/servers/ba44b84e-68dc-4120-8343-9dd611eb5af5 => generated 1548 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:47:07.759080 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-864b523a-d073-48f1-b7f6-61d1ee28bd82 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "094ee19a-d48b-4222-a76c-3f9700e40273"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:47:07.761465 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-864b523a-d073-48f1-b7f6-61d1ee28bd82 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] [instance: ba44b84e-68dc-4120-8343-9dd611eb5af5] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:07.768971 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-864b523a-d073-48f1-b7f6-61d1ee28bd82 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:07.769466 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-864b523a-d073-48f1-b7f6-61d1ee28bd82 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:07.769905 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-864b523a-d073-48f1-b7f6-61d1ee28bd82 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:07.770674 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-864b523a-d073-48f1-b7f6-61d1ee28bd82 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:07.772765 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-864b523a-d073-48f1-b7f6-61d1ee28bd82 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:07.772765 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-864b523a-d073-48f1-b7f6-61d1ee28bd82 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:08.061594 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-864b523a-d073-48f1-b7f6-61d1ee28bd82 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] 10.222.0.33 "POST /compute/v2.1/servers/ba44b84e-68dc-4120-8343-9dd611eb5af5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.306391 Oct 04 21:47:08.062761 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3505/7045] 10.222.0.33 () {60 vars in 1323 bytes} [Tue Oct 4 21:47:07 2022] POST /compute/v2.1/servers/ba44b84e-68dc-4120-8343-9dd611eb5af5/os-volume_attachments => generated 194 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:47:19.123130 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-ca66464f-ac08-4e94-ba32-4c70f1d0c511 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:19.124129 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-ca66464f-ac08-4e94-ba32-4c70f1d0c511 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] [instance: ba44b84e-68dc-4120-8343-9dd611eb5af5] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:19.128422 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:47:19.129418 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=66 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:47:19.136058 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ca66464f-ac08-4e94-ba32-4c70f1d0c511 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:19.136569 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ca66464f-ac08-4e94-ba32-4c70f1d0c511 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:19.137033 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ca66464f-ac08-4e94-ba32-4c70f1d0c511 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:19.137776 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ca66464f-ac08-4e94-ba32-4c70f1d0c511 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:19.138251 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ca66464f-ac08-4e94-ba32-4c70f1d0c511 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:19.138727 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ca66464f-ac08-4e94-ba32-4c70f1d0c511 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:19.318613 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-ca66464f-ac08-4e94-ba32-4c70f1d0c511 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e90d254a9d942818ef85e0eb4f145e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de9b441849694e2399094a86c20fa9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:19.336364 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-ca66464f-ac08-4e94-ba32-4c70f1d0c511 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] 10.222.0.33 "GET /compute/v2.1/servers/ba44b84e-68dc-4120-8343-9dd611eb5af5" status: 200 len: 1594 microversion: 2.1 time: 0.216671 Oct 04 21:47:19.338283 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3541/7046] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:19 2022] GET /compute/v2.1/servers/ba44b84e-68dc-4120-8343-9dd611eb5af5 => generated 1594 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:47:21.373128 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-32836fd0-ef7f-4bc0-8059-2901f4db825c req-35eedc73-7390-44b5-a0c8-0eea37213503 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba44b84e-68dc-4120-8343-9dd611eb5af5", "tag": "faf78765-2187-4e6d-be04-ac91f53b4595"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:47:21.381528 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:47:21.383359 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=3 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:47:21.384597 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:47:21.397290 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-32836fd0-ef7f-4bc0-8059-2901f4db825c req-35eedc73-7390-44b5-a0c8-0eea37213503 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:21.398182 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-32836fd0-ef7f-4bc0-8059-2901f4db825c req-35eedc73-7390-44b5-a0c8-0eea37213503 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:21.399207 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-32836fd0-ef7f-4bc0-8059-2901f4db825c req-35eedc73-7390-44b5-a0c8-0eea37213503 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:21.416827 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-32836fd0-ef7f-4bc0-8059-2901f4db825c req-35eedc73-7390-44b5-a0c8-0eea37213503 service nova] Creating event network-changed:faf78765-2187-4e6d-be04-ac91f53b4595 for instance ba44b84e-68dc-4120-8343-9dd611eb5af5 on n-h2-854823-8 Oct 04 21:47:21.424643 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-32836fd0-ef7f-4bc0-8059-2901f4db825c req-35eedc73-7390-44b5-a0c8-0eea37213503 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055007 Oct 04 21:47:21.425454 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3506/7047] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:47:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:47:22.825553 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-d970e43e-ba42-4699-ad8e-575895ef725e tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-2068176673"}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:47:22.826324 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-d970e43e-ba42-4699-ad8e-575895ef725e tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] [instance: ba44b84e-68dc-4120-8343-9dd611eb5af5] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:22.834861 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d970e43e-ba42-4699-ad8e-575895ef725e tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:22.835400 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d970e43e-ba42-4699-ad8e-575895ef725e tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:22.835838 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d970e43e-ba42-4699-ad8e-575895ef725e tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:22.836603 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d970e43e-ba42-4699-ad8e-575895ef725e tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:22.837087 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d970e43e-ba42-4699-ad8e-575895ef725e tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:22.837537 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d970e43e-ba42-4699-ad8e-575895ef725e tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:23.072445 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.network.security_group_api [None req-d970e43e-ba42-4699-ad8e-575895ef725e tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Adding security group 490b68bf-d4d3-4f78-ba4a-f24e91119547 to port faf78765-2187-4e6d-be04-ac91f53b4595 Oct 04 21:47:23.484517 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-d970e43e-ba42-4699-ad8e-575895ef725e tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] 10.222.0.33 "POST /compute/v2.1/servers/ba44b84e-68dc-4120-8343-9dd611eb5af5/action" status: 202 len: 0 microversion: 2.1 time: 0.663730 Oct 04 21:47:23.485308 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3542/7048] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 21:47:22 2022] POST /compute/v2.1/servers/ba44b84e-68dc-4120-8343-9dd611eb5af5/action => generated 0 bytes in 666 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:47:23.498397 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-14b45e44-9fb6-4687-b325-60d7f792161a req-a1b4ea36-ab9a-4f37-8e1c-328ba4b8530f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba44b84e-68dc-4120-8343-9dd611eb5af5", "tag": "faf78765-2187-4e6d-be04-ac91f53b4595"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:47:23.518760 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-0f2b4e7a-656a-4ebd-931d-60309208ea2d tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:23.520135 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-0f2b4e7a-656a-4ebd-931d-60309208ea2d tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] [instance: ba44b84e-68dc-4120-8343-9dd611eb5af5] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:23.523374 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-14b45e44-9fb6-4687-b325-60d7f792161a req-a1b4ea36-ab9a-4f37-8e1c-328ba4b8530f service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:23.524241 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-14b45e44-9fb6-4687-b325-60d7f792161a req-a1b4ea36-ab9a-4f37-8e1c-328ba4b8530f service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:23.524883 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-14b45e44-9fb6-4687-b325-60d7f792161a req-a1b4ea36-ab9a-4f37-8e1c-328ba4b8530f service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:23.539203 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0f2b4e7a-656a-4ebd-931d-60309208ea2d tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:23.547613 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-14b45e44-9fb6-4687-b325-60d7f792161a req-a1b4ea36-ab9a-4f37-8e1c-328ba4b8530f service nova] Creating event network-changed:faf78765-2187-4e6d-be04-ac91f53b4595 for instance ba44b84e-68dc-4120-8343-9dd611eb5af5 on n-h2-854823-8 Oct 04 21:47:23.566679 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0f2b4e7a-656a-4ebd-931d-60309208ea2d tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:23.567730 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0f2b4e7a-656a-4ebd-931d-60309208ea2d tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:23.567893 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-14b45e44-9fb6-4687-b325-60d7f792161a req-a1b4ea36-ab9a-4f37-8e1c-328ba4b8530f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075941 Oct 04 21:47:23.569423 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0f2b4e7a-656a-4ebd-931d-60309208ea2d tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:23.572678 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3507/7049] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:47:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:47:23.573367 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0f2b4e7a-656a-4ebd-931d-60309208ea2d tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:23.574945 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0f2b4e7a-656a-4ebd-931d-60309208ea2d tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:23.919716 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-0f2b4e7a-656a-4ebd-931d-60309208ea2d tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e90d254a9d942818ef85e0eb4f145e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de9b441849694e2399094a86c20fa9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:23.939721 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-0f2b4e7a-656a-4ebd-931d-60309208ea2d tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] 10.222.0.33 "GET /compute/v2.1/servers/ba44b84e-68dc-4120-8343-9dd611eb5af5" status: 200 len: 1759 microversion: 2.1 time: 0.443144 Oct 04 21:47:23.940876 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3543/7050] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:23 2022] GET /compute/v2.1/servers/ba44b84e-68dc-4120-8343-9dd611eb5af5 => generated 1759 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:47:37.906487 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=4 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:47:37.907863 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=4 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:47:37.965124 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c371ac7f-8662-4cf0-808c-82810625d2de tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:47:37.967522 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c371ac7f-8662-4cf0-808c-82810625d2de tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] [instance: ba44b84e-68dc-4120-8343-9dd611eb5af5] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:37.975167 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c371ac7f-8662-4cf0-808c-82810625d2de tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:37.975661 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c371ac7f-8662-4cf0-808c-82810625d2de tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:37.976109 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c371ac7f-8662-4cf0-808c-82810625d2de tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:37.976816 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c371ac7f-8662-4cf0-808c-82810625d2de tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:37.977275 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c371ac7f-8662-4cf0-808c-82810625d2de tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:37.977709 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c371ac7f-8662-4cf0-808c-82810625d2de tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:38.066813 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c371ac7f-8662-4cf0-808c-82810625d2de tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] 10.222.0.33 "POST /compute/v2.1/servers/ba44b84e-68dc-4120-8343-9dd611eb5af5/action" status: 202 len: 0 microversion: 2.1 time: 0.161857 Oct 04 21:47:38.067676 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3508/7051] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 21:47:37 2022] POST /compute/v2.1/servers/ba44b84e-68dc-4120-8343-9dd611eb5af5/action => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:47:38.076205 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-129deec4-11d0-4ccd-8c40-e89056624afe tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:38.076861 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-129deec4-11d0-4ccd-8c40-e89056624afe tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] [instance: ba44b84e-68dc-4120-8343-9dd611eb5af5] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:38.080763 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_api:SELECT=6 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:47:38.081497 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=16 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:47:38.087697 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-129deec4-11d0-4ccd-8c40-e89056624afe tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:38.088216 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-129deec4-11d0-4ccd-8c40-e89056624afe tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:38.088822 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-129deec4-11d0-4ccd-8c40-e89056624afe tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:38.089816 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-129deec4-11d0-4ccd-8c40-e89056624afe tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:38.090266 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-129deec4-11d0-4ccd-8c40-e89056624afe tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:38.090950 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-129deec4-11d0-4ccd-8c40-e89056624afe tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:38.350602 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-129deec4-11d0-4ccd-8c40-e89056624afe tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e90d254a9d942818ef85e0eb4f145e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de9b441849694e2399094a86c20fa9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:38.362777 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-129deec4-11d0-4ccd-8c40-e89056624afe tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] 10.222.0.33 "GET /compute/v2.1/servers/ba44b84e-68dc-4120-8343-9dd611eb5af5" status: 200 len: 1751 microversion: 2.1 time: 0.289670 Oct 04 21:47:38.363737 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3544/7052] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:38 2022] GET /compute/v2.1/servers/ba44b84e-68dc-4120-8343-9dd611eb5af5 => generated 1751 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:47:39.393339 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f61d0529-ead2-489b-8d1d-116a429da1d5 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:39.394072 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f61d0529-ead2-489b-8d1d-116a429da1d5 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] [instance: ba44b84e-68dc-4120-8343-9dd611eb5af5] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:39.400996 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f61d0529-ead2-489b-8d1d-116a429da1d5 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:39.401484 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f61d0529-ead2-489b-8d1d-116a429da1d5 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:39.401946 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f61d0529-ead2-489b-8d1d-116a429da1d5 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:39.402683 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f61d0529-ead2-489b-8d1d-116a429da1d5 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:39.403141 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f61d0529-ead2-489b-8d1d-116a429da1d5 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:39.403568 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f61d0529-ead2-489b-8d1d-116a429da1d5 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:39.580008 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f61d0529-ead2-489b-8d1d-116a429da1d5 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e90d254a9d942818ef85e0eb4f145e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de9b441849694e2399094a86c20fa9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:39.589096 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f61d0529-ead2-489b-8d1d-116a429da1d5 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] 10.222.0.33 "GET /compute/v2.1/servers/ba44b84e-68dc-4120-8343-9dd611eb5af5" status: 200 len: 1756 microversion: 2.1 time: 0.201591 Oct 04 21:47:39.589705 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3509/7053] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:39 2022] GET /compute/v2.1/servers/ba44b84e-68dc-4120-8343-9dd611eb5af5 => generated 1756 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:47:40.625634 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-5b3b578a-d6e5-438b-88ad-a7340f4c9958 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:40.626486 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-5b3b578a-d6e5-438b-88ad-a7340f4c9958 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] [instance: ba44b84e-68dc-4120-8343-9dd611eb5af5] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:40.633814 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5b3b578a-d6e5-438b-88ad-a7340f4c9958 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:40.634397 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5b3b578a-d6e5-438b-88ad-a7340f4c9958 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:40.634910 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5b3b578a-d6e5-438b-88ad-a7340f4c9958 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:40.635642 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5b3b578a-d6e5-438b-88ad-a7340f4c9958 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:40.636114 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5b3b578a-d6e5-438b-88ad-a7340f4c9958 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:40.636569 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5b3b578a-d6e5-438b-88ad-a7340f4c9958 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:40.812140 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-5b3b578a-d6e5-438b-88ad-a7340f4c9958 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e90d254a9d942818ef85e0eb4f145e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de9b441849694e2399094a86c20fa9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:40.822164 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-5b3b578a-d6e5-438b-88ad-a7340f4c9958 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] 10.222.0.33 "GET /compute/v2.1/servers/ba44b84e-68dc-4120-8343-9dd611eb5af5" status: 200 len: 1756 microversion: 2.1 time: 0.200841 Oct 04 21:47:40.823091 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3545/7054] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:40 2022] GET /compute/v2.1/servers/ba44b84e-68dc-4120-8343-9dd611eb5af5 => generated 1756 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:47:41.846862 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-de87a341-c455-493e-9116-dbf296527afb tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:41.847470 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-de87a341-c455-493e-9116-dbf296527afb tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] [instance: ba44b84e-68dc-4120-8343-9dd611eb5af5] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:41.854962 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-de87a341-c455-493e-9116-dbf296527afb tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:41.855445 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-de87a341-c455-493e-9116-dbf296527afb tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:41.855880 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-de87a341-c455-493e-9116-dbf296527afb tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:41.856577 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-de87a341-c455-493e-9116-dbf296527afb tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:41.857036 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-de87a341-c455-493e-9116-dbf296527afb tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:41.857454 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-de87a341-c455-493e-9116-dbf296527afb tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:42.028974 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-de87a341-c455-493e-9116-dbf296527afb tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e90d254a9d942818ef85e0eb4f145e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de9b441849694e2399094a86c20fa9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:42.038406 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-de87a341-c455-493e-9116-dbf296527afb tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] 10.222.0.33 "GET /compute/v2.1/servers/ba44b84e-68dc-4120-8343-9dd611eb5af5" status: 200 len: 1756 microversion: 2.1 time: 0.196416 Oct 04 21:47:42.039016 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3510/7055] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:41 2022] GET /compute/v2.1/servers/ba44b84e-68dc-4120-8343-9dd611eb5af5 => generated 1756 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:47:43.066218 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-41379a47-48de-46e3-96b3-32fb872c15f8 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:43.066922 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-41379a47-48de-46e3-96b3-32fb872c15f8 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] [instance: ba44b84e-68dc-4120-8343-9dd611eb5af5] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:43.074263 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-41379a47-48de-46e3-96b3-32fb872c15f8 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:43.074801 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-41379a47-48de-46e3-96b3-32fb872c15f8 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:43.075256 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-41379a47-48de-46e3-96b3-32fb872c15f8 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:43.075990 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-41379a47-48de-46e3-96b3-32fb872c15f8 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:43.076460 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-41379a47-48de-46e3-96b3-32fb872c15f8 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:43.076902 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-41379a47-48de-46e3-96b3-32fb872c15f8 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:43.237520 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-41379a47-48de-46e3-96b3-32fb872c15f8 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e90d254a9d942818ef85e0eb4f145e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de9b441849694e2399094a86c20fa9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:43.246813 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-41379a47-48de-46e3-96b3-32fb872c15f8 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] 10.222.0.33 "GET /compute/v2.1/servers/ba44b84e-68dc-4120-8343-9dd611eb5af5" status: 200 len: 1756 microversion: 2.1 time: 0.185488 Oct 04 21:47:43.247411 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3546/7056] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:43 2022] GET /compute/v2.1/servers/ba44b84e-68dc-4120-8343-9dd611eb5af5 => generated 1756 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:47:44.270928 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d3d69cf5-e6bc-491f-a04c-87379e352df7 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:44.271527 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d3d69cf5-e6bc-491f-a04c-87379e352df7 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] [instance: ba44b84e-68dc-4120-8343-9dd611eb5af5] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:44.278500 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d3d69cf5-e6bc-491f-a04c-87379e352df7 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:44.278981 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d3d69cf5-e6bc-491f-a04c-87379e352df7 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:44.279410 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d3d69cf5-e6bc-491f-a04c-87379e352df7 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:44.280105 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d3d69cf5-e6bc-491f-a04c-87379e352df7 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:44.280553 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d3d69cf5-e6bc-491f-a04c-87379e352df7 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:44.280972 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d3d69cf5-e6bc-491f-a04c-87379e352df7 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:44.437961 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d3d69cf5-e6bc-491f-a04c-87379e352df7 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e90d254a9d942818ef85e0eb4f145e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de9b441849694e2399094a86c20fa9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:44.446855 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d3d69cf5-e6bc-491f-a04c-87379e352df7 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] 10.222.0.33 "GET /compute/v2.1/servers/ba44b84e-68dc-4120-8343-9dd611eb5af5" status: 200 len: 1756 microversion: 2.1 time: 0.179743 Oct 04 21:47:44.447449 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3511/7057] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:44 2022] GET /compute/v2.1/servers/ba44b84e-68dc-4120-8343-9dd611eb5af5 => generated 1756 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:47:45.471307 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-e26bcd1c-f72e-4485-b859-bc8c3b9ebca8 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:45.471908 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-e26bcd1c-f72e-4485-b859-bc8c3b9ebca8 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] [instance: ba44b84e-68dc-4120-8343-9dd611eb5af5] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:45.479002 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e26bcd1c-f72e-4485-b859-bc8c3b9ebca8 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:45.479515 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e26bcd1c-f72e-4485-b859-bc8c3b9ebca8 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:45.480069 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e26bcd1c-f72e-4485-b859-bc8c3b9ebca8 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:45.480806 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e26bcd1c-f72e-4485-b859-bc8c3b9ebca8 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:45.481281 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e26bcd1c-f72e-4485-b859-bc8c3b9ebca8 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:45.481762 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e26bcd1c-f72e-4485-b859-bc8c3b9ebca8 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:45.636789 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-e26bcd1c-f72e-4485-b859-bc8c3b9ebca8 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e90d254a9d942818ef85e0eb4f145e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de9b441849694e2399094a86c20fa9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:45.647030 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-e26bcd1c-f72e-4485-b859-bc8c3b9ebca8 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] 10.222.0.33 "GET /compute/v2.1/servers/ba44b84e-68dc-4120-8343-9dd611eb5af5" status: 200 len: 1756 microversion: 2.1 time: 0.181056 Oct 04 21:47:45.647635 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3547/7058] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:45 2022] GET /compute/v2.1/servers/ba44b84e-68dc-4120-8343-9dd611eb5af5 => generated 1756 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:47:46.675129 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-03a1ba1f-7e0c-49e6-984e-0fa49e98cb4e tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:46.675758 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-03a1ba1f-7e0c-49e6-984e-0fa49e98cb4e tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] [instance: ba44b84e-68dc-4120-8343-9dd611eb5af5] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:46.682673 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-03a1ba1f-7e0c-49e6-984e-0fa49e98cb4e tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:46.683172 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-03a1ba1f-7e0c-49e6-984e-0fa49e98cb4e tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:46.683615 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-03a1ba1f-7e0c-49e6-984e-0fa49e98cb4e tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:46.684343 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-03a1ba1f-7e0c-49e6-984e-0fa49e98cb4e tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:46.684809 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-03a1ba1f-7e0c-49e6-984e-0fa49e98cb4e tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:46.685271 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-03a1ba1f-7e0c-49e6-984e-0fa49e98cb4e tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:46.840696 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-03a1ba1f-7e0c-49e6-984e-0fa49e98cb4e tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e90d254a9d942818ef85e0eb4f145e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de9b441849694e2399094a86c20fa9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:46.850645 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-03a1ba1f-7e0c-49e6-984e-0fa49e98cb4e tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] 10.222.0.33 "GET /compute/v2.1/servers/ba44b84e-68dc-4120-8343-9dd611eb5af5" status: 200 len: 1756 microversion: 2.1 time: 0.181480 Oct 04 21:47:46.851248 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3512/7059] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:46 2022] GET /compute/v2.1/servers/ba44b84e-68dc-4120-8343-9dd611eb5af5 => generated 1756 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:47:47.879157 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-8bc7e832-4880-4960-873d-95fdf7989459 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:47.879874 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-8bc7e832-4880-4960-873d-95fdf7989459 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] [instance: ba44b84e-68dc-4120-8343-9dd611eb5af5] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:47.887842 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8bc7e832-4880-4960-873d-95fdf7989459 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:47.888348 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8bc7e832-4880-4960-873d-95fdf7989459 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:47.888806 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8bc7e832-4880-4960-873d-95fdf7989459 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:47.889539 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8bc7e832-4880-4960-873d-95fdf7989459 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:47.890014 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8bc7e832-4880-4960-873d-95fdf7989459 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:47.890491 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8bc7e832-4880-4960-873d-95fdf7989459 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:48.053445 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-8bc7e832-4880-4960-873d-95fdf7989459 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e90d254a9d942818ef85e0eb4f145e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de9b441849694e2399094a86c20fa9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:48.062194 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-8bc7e832-4880-4960-873d-95fdf7989459 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] 10.222.0.33 "GET /compute/v2.1/servers/ba44b84e-68dc-4120-8343-9dd611eb5af5" status: 200 len: 1756 microversion: 2.1 time: 0.189092 Oct 04 21:47:48.062811 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3548/7060] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:47 2022] GET /compute/v2.1/servers/ba44b84e-68dc-4120-8343-9dd611eb5af5 => generated 1756 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:47:49.085775 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a8b26053-688f-459e-b888-f06e63063fa4 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:49.086569 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a8b26053-688f-459e-b888-f06e63063fa4 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] [instance: ba44b84e-68dc-4120-8343-9dd611eb5af5] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:49.093532 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a8b26053-688f-459e-b888-f06e63063fa4 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:49.094013 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a8b26053-688f-459e-b888-f06e63063fa4 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:49.094980 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a8b26053-688f-459e-b888-f06e63063fa4 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:49.096385 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a8b26053-688f-459e-b888-f06e63063fa4 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:49.096844 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a8b26053-688f-459e-b888-f06e63063fa4 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:49.097277 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a8b26053-688f-459e-b888-f06e63063fa4 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:49.255974 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-a8b26053-688f-459e-b888-f06e63063fa4 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e90d254a9d942818ef85e0eb4f145e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de9b441849694e2399094a86c20fa9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:49.264848 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a8b26053-688f-459e-b888-f06e63063fa4 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] 10.222.0.33 "GET /compute/v2.1/servers/ba44b84e-68dc-4120-8343-9dd611eb5af5" status: 200 len: 1756 microversion: 2.1 time: 0.183075 Oct 04 21:47:49.265431 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3513/7061] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:49 2022] GET /compute/v2.1/servers/ba44b84e-68dc-4120-8343-9dd611eb5af5 => generated 1756 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:47:50.290584 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-5f19463e-4ef0-4273-8bd5-66b7647ea19d tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:47:50.291377 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-5f19463e-4ef0-4273-8bd5-66b7647ea19d tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] [instance: ba44b84e-68dc-4120-8343-9dd611eb5af5] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:47:50.299243 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5f19463e-4ef0-4273-8bd5-66b7647ea19d tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:50.299716 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5f19463e-4ef0-4273-8bd5-66b7647ea19d tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:50.300172 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5f19463e-4ef0-4273-8bd5-66b7647ea19d tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:50.300905 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5f19463e-4ef0-4273-8bd5-66b7647ea19d tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:47:50.301374 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5f19463e-4ef0-4273-8bd5-66b7647ea19d tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:47:50.301807 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5f19463e-4ef0-4273-8bd5-66b7647ea19d tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:47:50.461906 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-5f19463e-4ef0-4273-8bd5-66b7647ea19d tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e90d254a9d942818ef85e0eb4f145e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de9b441849694e2399094a86c20fa9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:47:50.471144 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-5f19463e-4ef0-4273-8bd5-66b7647ea19d tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] 10.222.0.33 "GET /compute/v2.1/servers/ba44b84e-68dc-4120-8343-9dd611eb5af5" status: 200 len: 1759 microversion: 2.1 time: 0.184758 Oct 04 21:47:50.471726 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3549/7062] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:47:50 2022] GET /compute/v2.1/servers/ba44b84e-68dc-4120-8343-9dd611eb5af5 => generated 1759 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:48:22.983994 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ac190df6-b0da-42af-bc37-44a5282dad92 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-2068176673"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:48:22.987267 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ac190df6-b0da-42af-bc37-44a5282dad92 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] [instance: ba44b84e-68dc-4120-8343-9dd611eb5af5] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:48:22.988583 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=12 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:48:22.989266 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:48:22.995562 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ac190df6-b0da-42af-bc37-44a5282dad92 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:22.996081 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ac190df6-b0da-42af-bc37-44a5282dad92 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:22.996546 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ac190df6-b0da-42af-bc37-44a5282dad92 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:22.997261 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ac190df6-b0da-42af-bc37-44a5282dad92 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:22.997729 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ac190df6-b0da-42af-bc37-44a5282dad92 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:22.998169 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ac190df6-b0da-42af-bc37-44a5282dad92 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:23.152285 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.network.security_group_api [None req-ac190df6-b0da-42af-bc37-44a5282dad92 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Removing security group 490b68bf-d4d3-4f78-ba4a-f24e91119547 from port faf78765-2187-4e6d-be04-ac91f53b4595 Oct 04 21:48:23.531871 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ac190df6-b0da-42af-bc37-44a5282dad92 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] 10.222.0.33 "POST /compute/v2.1/servers/ba44b84e-68dc-4120-8343-9dd611eb5af5/action" status: 202 len: 0 microversion: 2.1 time: 0.551645 Oct 04 21:48:23.533233 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3514/7063] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 21:48:22 2022] POST /compute/v2.1/servers/ba44b84e-68dc-4120-8343-9dd611eb5af5/action => generated 0 bytes in 555 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:48:23.543362 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-ae0ce4de-260f-45a6-8c06-66753e628734 req-22f1bc91-0987-449c-a9e6-02ddfc73adb9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba44b84e-68dc-4120-8343-9dd611eb5af5", "tag": "faf78765-2187-4e6d-be04-ac91f53b4595"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:48:23.554719 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_api:SELECT=12 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:48:23.556418 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=36 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:48:23.559858 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-ae0ce4de-260f-45a6-8c06-66753e628734 req-22f1bc91-0987-449c-a9e6-02ddfc73adb9 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:23.560833 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-ae0ce4de-260f-45a6-8c06-66753e628734 req-22f1bc91-0987-449c-a9e6-02ddfc73adb9 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:23.561517 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-ae0ce4de-260f-45a6-8c06-66753e628734 req-22f1bc91-0987-449c-a9e6-02ddfc73adb9 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:23.581056 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-ae0ce4de-260f-45a6-8c06-66753e628734 req-22f1bc91-0987-449c-a9e6-02ddfc73adb9 service nova] Creating event network-changed:faf78765-2187-4e6d-be04-ac91f53b4595 for instance ba44b84e-68dc-4120-8343-9dd611eb5af5 on n-h2-854823-8 Oct 04 21:48:23.587509 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-ae0ce4de-260f-45a6-8c06-66753e628734 req-22f1bc91-0987-449c-a9e6-02ddfc73adb9 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050364 Oct 04 21:48:23.588862 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3550/7064] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:48:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:48:25.133312 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-918729d7-56a6-43a3-8299-a2e26c19fcd6 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:25.134196 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-918729d7-56a6-43a3-8299-a2e26c19fcd6 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] [instance: ba44b84e-68dc-4120-8343-9dd611eb5af5] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:48:25.141418 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-918729d7-56a6-43a3-8299-a2e26c19fcd6 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:25.141908 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-918729d7-56a6-43a3-8299-a2e26c19fcd6 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:25.142602 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-918729d7-56a6-43a3-8299-a2e26c19fcd6 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:25.143342 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-918729d7-56a6-43a3-8299-a2e26c19fcd6 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:25.143804 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-918729d7-56a6-43a3-8299-a2e26c19fcd6 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:25.144230 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-918729d7-56a6-43a3-8299-a2e26c19fcd6 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:25.236533 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-918729d7-56a6-43a3-8299-a2e26c19fcd6 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lazy-loading 'services' on Instance uuid ba44b84e-68dc-4120-8343-9dd611eb5af5 {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:48:25.321135 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-918729d7-56a6-43a3-8299-a2e26c19fcd6 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] 10.222.0.33 "DELETE /compute/v2.1/servers/ba44b84e-68dc-4120-8343-9dd611eb5af5/os-volume_attachments/094ee19a-d48b-4222-a76c-3f9700e40273" status: 202 len: 0 microversion: 2.1 time: 0.192801 Oct 04 21:48:25.321948 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3515/7065] 10.222.0.33 () {58 vars in 1416 bytes} [Tue Oct 4 21:48:25 2022] DELETE /compute/v2.1/servers/ba44b84e-68dc-4120-8343-9dd611eb5af5/os-volume_attachments/094ee19a-d48b-4222-a76c-3f9700e40273 => generated 0 bytes in 195 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 21:48:25.338538 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-f1737828-767c-4512-bcdf-55b169a111e3 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:25.342861 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-f1737828-767c-4512-bcdf-55b169a111e3 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] [instance: ba44b84e-68dc-4120-8343-9dd611eb5af5] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:48:25.355907 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f1737828-767c-4512-bcdf-55b169a111e3 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:25.357104 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f1737828-767c-4512-bcdf-55b169a111e3 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:25.357816 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f1737828-767c-4512-bcdf-55b169a111e3 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:25.358727 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f1737828-767c-4512-bcdf-55b169a111e3 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:25.359380 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f1737828-767c-4512-bcdf-55b169a111e3 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:25.360284 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f1737828-767c-4512-bcdf-55b169a111e3 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:25.408180 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-f1737828-767c-4512-bcdf-55b169a111e3 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] 10.222.0.33 "GET /compute/v2.1/servers/ba44b84e-68dc-4120-8343-9dd611eb5af5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.080711 Oct 04 21:48:25.408864 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3551/7066] 10.222.0.33 () {58 vars in 1302 bytes} [Tue Oct 4 21:48:25 2022] GET /compute/v2.1/servers/ba44b84e-68dc-4120-8343-9dd611eb5af5/os-volume_attachments => generated 197 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:48:25.612654 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-e22d9342-09be-4b14-893c-605cc9c453be req-c2a41e81-e37e-49c9-a217-5df4cfaf98ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba44b84e-68dc-4120-8343-9dd611eb5af5", "tag": "faf78765-2187-4e6d-be04-ac91f53b4595"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:48:25.624503 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-e22d9342-09be-4b14-893c-605cc9c453be req-c2a41e81-e37e-49c9-a217-5df4cfaf98ae service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:25.625241 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-e22d9342-09be-4b14-893c-605cc9c453be req-c2a41e81-e37e-49c9-a217-5df4cfaf98ae service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:25.625849 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-e22d9342-09be-4b14-893c-605cc9c453be req-c2a41e81-e37e-49c9-a217-5df4cfaf98ae service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:25.639297 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-e22d9342-09be-4b14-893c-605cc9c453be req-c2a41e81-e37e-49c9-a217-5df4cfaf98ae service nova] Creating event network-changed:faf78765-2187-4e6d-be04-ac91f53b4595 for instance ba44b84e-68dc-4120-8343-9dd611eb5af5 on n-h2-854823-8 Oct 04 21:48:25.645585 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-e22d9342-09be-4b14-893c-605cc9c453be req-c2a41e81-e37e-49c9-a217-5df4cfaf98ae service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037913 Oct 04 21:48:25.646522 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3516/7067] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:48:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:48:26.423846 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-82dbfdf9-de5d-4e6b-baf1-4d9c8e162bf7 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:26.427024 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-82dbfdf9-de5d-4e6b-baf1-4d9c8e162bf7 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] [instance: ba44b84e-68dc-4120-8343-9dd611eb5af5] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:48:26.434752 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-82dbfdf9-de5d-4e6b-baf1-4d9c8e162bf7 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:26.435557 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-82dbfdf9-de5d-4e6b-baf1-4d9c8e162bf7 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:26.436195 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-82dbfdf9-de5d-4e6b-baf1-4d9c8e162bf7 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:26.437787 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-82dbfdf9-de5d-4e6b-baf1-4d9c8e162bf7 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:26.438472 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-82dbfdf9-de5d-4e6b-baf1-4d9c8e162bf7 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:26.439274 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-82dbfdf9-de5d-4e6b-baf1-4d9c8e162bf7 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:26.494599 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-82dbfdf9-de5d-4e6b-baf1-4d9c8e162bf7 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] 10.222.0.33 "GET /compute/v2.1/servers/ba44b84e-68dc-4120-8343-9dd611eb5af5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.075914 Oct 04 21:48:26.496082 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3552/7068] 10.222.0.33 () {58 vars in 1302 bytes} [Tue Oct 4 21:48:26 2022] GET /compute/v2.1/servers/ba44b84e-68dc-4120-8343-9dd611eb5af5/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:48:27.520437 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ba869e65-3f24-47dc-9dc2-e340ee169583 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:27.524481 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ba869e65-3f24-47dc-9dc2-e340ee169583 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] [instance: ba44b84e-68dc-4120-8343-9dd611eb5af5] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:48:27.537459 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ba869e65-3f24-47dc-9dc2-e340ee169583 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:27.538489 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ba869e65-3f24-47dc-9dc2-e340ee169583 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:27.539368 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ba869e65-3f24-47dc-9dc2-e340ee169583 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:27.540892 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ba869e65-3f24-47dc-9dc2-e340ee169583 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:27.541751 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ba869e65-3f24-47dc-9dc2-e340ee169583 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:27.542576 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ba869e65-3f24-47dc-9dc2-e340ee169583 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:27.603488 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ba869e65-3f24-47dc-9dc2-e340ee169583 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] 10.222.0.33 "GET /compute/v2.1/servers/ba44b84e-68dc-4120-8343-9dd611eb5af5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.093589 Oct 04 21:48:27.604848 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3517/7069] 10.222.0.33 () {58 vars in 1302 bytes} [Tue Oct 4 21:48:27 2022] GET /compute/v2.1/servers/ba44b84e-68dc-4120-8343-9dd611eb5af5/os-volume_attachments => generated 197 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:48:28.623468 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-4743d9e3-3481-4674-a5b6-094b2ade2eb7 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:28.627822 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-4743d9e3-3481-4674-a5b6-094b2ade2eb7 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] [instance: ba44b84e-68dc-4120-8343-9dd611eb5af5] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:48:28.638519 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4743d9e3-3481-4674-a5b6-094b2ade2eb7 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:28.639095 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4743d9e3-3481-4674-a5b6-094b2ade2eb7 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:28.639614 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4743d9e3-3481-4674-a5b6-094b2ade2eb7 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:28.641198 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4743d9e3-3481-4674-a5b6-094b2ade2eb7 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:28.641899 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4743d9e3-3481-4674-a5b6-094b2ade2eb7 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:28.642537 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4743d9e3-3481-4674-a5b6-094b2ade2eb7 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:28.702893 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-4743d9e3-3481-4674-a5b6-094b2ade2eb7 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] 10.222.0.33 "GET /compute/v2.1/servers/ba44b84e-68dc-4120-8343-9dd611eb5af5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.085862 Oct 04 21:48:28.710904 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3553/7070] 10.222.0.33 () {58 vars in 1302 bytes} [Tue Oct 4 21:48:28 2022] GET /compute/v2.1/servers/ba44b84e-68dc-4120-8343-9dd611eb5af5/os-volume_attachments => generated 197 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:48:29.720377 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-31eb1dcc-de8c-4762-9709-1617d9adf270 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:29.723255 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-31eb1dcc-de8c-4762-9709-1617d9adf270 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] [instance: ba44b84e-68dc-4120-8343-9dd611eb5af5] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:48:29.731761 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-31eb1dcc-de8c-4762-9709-1617d9adf270 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:29.732271 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-31eb1dcc-de8c-4762-9709-1617d9adf270 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:29.732716 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-31eb1dcc-de8c-4762-9709-1617d9adf270 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:29.733451 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-31eb1dcc-de8c-4762-9709-1617d9adf270 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:29.733916 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-31eb1dcc-de8c-4762-9709-1617d9adf270 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:29.735044 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-31eb1dcc-de8c-4762-9709-1617d9adf270 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:29.770035 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-31eb1dcc-de8c-4762-9709-1617d9adf270 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] 10.222.0.33 "GET /compute/v2.1/servers/ba44b84e-68dc-4120-8343-9dd611eb5af5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054189 Oct 04 21:48:29.770995 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3518/7071] 10.222.0.33 () {58 vars in 1302 bytes} [Tue Oct 4 21:48:29 2022] GET /compute/v2.1/servers/ba44b84e-68dc-4120-8343-9dd611eb5af5/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:48:30.785606 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-a18af4b4-a5eb-4ffb-8269-0d79f2c5c891 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:30.789178 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-a18af4b4-a5eb-4ffb-8269-0d79f2c5c891 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] [instance: ba44b84e-68dc-4120-8343-9dd611eb5af5] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:48:30.798105 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a18af4b4-a5eb-4ffb-8269-0d79f2c5c891 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:30.798826 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a18af4b4-a5eb-4ffb-8269-0d79f2c5c891 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:30.799291 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a18af4b4-a5eb-4ffb-8269-0d79f2c5c891 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:30.800039 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a18af4b4-a5eb-4ffb-8269-0d79f2c5c891 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:30.800515 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a18af4b4-a5eb-4ffb-8269-0d79f2c5c891 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:30.800960 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a18af4b4-a5eb-4ffb-8269-0d79f2c5c891 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:30.836030 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-a18af4b4-a5eb-4ffb-8269-0d79f2c5c891 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] 10.222.0.33 "GET /compute/v2.1/servers/ba44b84e-68dc-4120-8343-9dd611eb5af5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.056450 Oct 04 21:48:30.837128 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3554/7072] 10.222.0.33 () {58 vars in 1302 bytes} [Tue Oct 4 21:48:30 2022] GET /compute/v2.1/servers/ba44b84e-68dc-4120-8343-9dd611eb5af5/os-volume_attachments => generated 25 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 21:48:30.849020 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-68b65e66-38c7-4019-b6bb-7e92ebef27f0 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:30.849642 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-68b65e66-38c7-4019-b6bb-7e92ebef27f0 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] [instance: ba44b84e-68dc-4120-8343-9dd611eb5af5] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:48:30.857394 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-68b65e66-38c7-4019-b6bb-7e92ebef27f0 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:30.858025 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-68b65e66-38c7-4019-b6bb-7e92ebef27f0 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:30.858635 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-68b65e66-38c7-4019-b6bb-7e92ebef27f0 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:30.860180 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-68b65e66-38c7-4019-b6bb-7e92ebef27f0 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:30.860768 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-68b65e66-38c7-4019-b6bb-7e92ebef27f0 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:30.861295 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-68b65e66-38c7-4019-b6bb-7e92ebef27f0 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:30.955284 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-68b65e66-38c7-4019-b6bb-7e92ebef27f0 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] HTTP exception thrown: Instance ba44b84e-68dc-4120-8343-9dd611eb5af5 is not attached to volume 094ee19a-d48b-4222-a76c-3f9700e40273 Oct 04 21:48:30.959256 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-68b65e66-38c7-4019-b6bb-7e92ebef27f0 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Request method failure captured: Oct 04 21:48:30.959256 n-d-854823-8 devstack@n-api.service[128801]: request: DELETE /compute/v2.1/servers/ba44b84e-68dc-4120-8343-9dd611eb5af5/os-volume_attachments/094ee19a-d48b-4222-a76c-3f9700e40273 HTTP/1.1 Oct 04 21:48:30.959256 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 21:48:30.959256 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 21:48:30.959256 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 21:48:30.959256 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 0 Oct 04 21:48:30.959256 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 21:48:30.959256 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 21:48:30.959256 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 21:48:30.959256 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 21:48:30.959256 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPKjEGDFAqr06wGYGiddF4oc0BRE102RCjTdUBtdwO-Ov7skQPAm1_If6NpGgMYaBpfFC3r1Zdw0lm9YgT0Rx_ggxXz3KLZ90VfdrAP_O35CwxbEd4AZafa20n5-f3CKFl9e_T2XPSWFAqd1tTJVvqDDcxur5iitKqhci7o6CgQooUDs Oct 04 21:48:30.959256 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 21:48:30.959256 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 21:48:30.959256 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 21:48:30.959256 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 21:48:30.959256 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 21:48:30.959256 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 21:48:30.959256 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: de9b441849694e2399094a86c20fa9dc Oct 04 21:48:30.959256 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-TestMinimumBasicScenario-1081630272 Oct 04 21:48:30.959256 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 21:48:30.959256 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 21:48:30.959256 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_de9b441849694e2399094a86c20fa9dc", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/de9b441849694e2399094a86c20fa9dc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/de9b441849694e2399094a86c20fa9dc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/de9b441849694e2399094a86c20fa9dc"}]}] Oct 04 21:48:30.959256 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-TestMinimumBasicScenario-1081630272 Oct 04 21:48:30.959256 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: de9b441849694e2399094a86c20fa9dc Oct 04 21:48:30.959256 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1081630272 Oct 04 21:48:30.959256 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-TestMinimumBasicScenario-1081630272-project Oct 04 21:48:30.959256 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 21:48:30.959256 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 21:48:30.959256 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: 8e90d254a9d942818ef85e0eb4f145e7 Oct 04 21:48:30.959256 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-TestMinimumBasicScenario-1081630272-project Oct 04 21:48:30.959256 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 21:48:30.959256 n-d-854823-8 devstack@n-api.service[128801]: exception: Instance ba44b84e-68dc-4120-8343-9dd611eb5af5 is not attached to volume 094ee19a-d48b-4222-a76c-3f9700e40273 Oct 04 21:48:30.959256 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'server_id': 'ba44b84e-68dc-4120-8343-9dd611eb5af5', 'id': '094ee19a-d48b-4222-a76c-3f9700e40273'} Oct 04 21:48:30.959256 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:48:30.959256 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:48:30.959256 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 04 21:48:30.959256 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 04 21:48:30.959256 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 21:48:30.959256 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 21:48:30.959256 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 04 21:48:30.959256 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 04 21:48:30.959256 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 094ee19a-d48b-4222-a76c-3f9700e40273. Oct 04 21:48:30.959256 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:48:30.959256 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:48:30.959256 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:48:30.959256 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:48:30.959256 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:48:30.959256 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:48:30.959256 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:48:30.959256 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:48:30.959256 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:48:30.959256 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:48:30.959256 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 04 21:48:30.959256 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 04 21:48:30.959256 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba44b84e-68dc-4120-8343-9dd611eb5af5 is not attached to volume 094ee19a-d48b-4222-a76c-3f9700e40273 Oct 04 21:48:30.959256 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:48:30.959256 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:48:30.959256 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:48:30.959256 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:48:30.959256 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:48:30.959256 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:48:30.967094 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:48:30.967094 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:48:30.967094 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba44b84e-68dc-4120-8343-9dd611eb5af5 is not attached to volume 094ee19a-d48b-4222-a76c-3f9700e40273 Oct 04 21:48:30.967094 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:48:30.967094 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-68b65e66-38c7-4019-b6bb-7e92ebef27f0 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Returning 404 to user: Instance ba44b84e-68dc-4120-8343-9dd611eb5af5 is not attached to volume 094ee19a-d48b-4222-a76c-3f9700e40273 {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:48:30.967094 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-68b65e66-38c7-4019-b6bb-7e92ebef27f0 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] 10.222.0.33 "DELETE /compute/v2.1/servers/ba44b84e-68dc-4120-8343-9dd611eb5af5/os-volume_attachments/094ee19a-d48b-4222-a76c-3f9700e40273" status: 404 len: 154 microversion: 2.1 time: 0.117376 Oct 04 21:48:30.967094 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3519/7073] 10.222.0.33 () {58 vars in 1416 bytes} [Tue Oct 4 21:48:30 2022] DELETE /compute/v2.1/servers/ba44b84e-68dc-4120-8343-9dd611eb5af5/os-volume_attachments/094ee19a-d48b-4222-a76c-3f9700e40273 => generated 154 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:48:34.313818 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-e1b1cc6f-f5a0-4f56-b284-cb4eaf1d169d tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:34.315904 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-e1b1cc6f-f5a0-4f56-b284-cb4eaf1d169d tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] [instance: ba44b84e-68dc-4120-8343-9dd611eb5af5] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:48:34.329798 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e1b1cc6f-f5a0-4f56-b284-cb4eaf1d169d tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:34.330698 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e1b1cc6f-f5a0-4f56-b284-cb4eaf1d169d tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:34.331512 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e1b1cc6f-f5a0-4f56-b284-cb4eaf1d169d tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:34.333106 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e1b1cc6f-f5a0-4f56-b284-cb4eaf1d169d tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:34.334255 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e1b1cc6f-f5a0-4f56-b284-cb4eaf1d169d tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:34.335109 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e1b1cc6f-f5a0-4f56-b284-cb4eaf1d169d tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:34.400310 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-e1b1cc6f-f5a0-4f56-b284-cb4eaf1d169d tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] [instance: ba44b84e-68dc-4120-8343-9dd611eb5af5] Going to try to terminate instance {{(pid=128802) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:48:34.557335 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-e1b1cc6f-f5a0-4f56-b284-cb4eaf1d169d tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] 10.222.0.33 "DELETE /compute/v2.1/servers/ba44b84e-68dc-4120-8343-9dd611eb5af5" status: 204 len: 0 microversion: 2.1 time: 0.251564 Oct 04 21:48:34.564786 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3555/7074] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 21:48:34 2022] DELETE /compute/v2.1/servers/ba44b84e-68dc-4120-8343-9dd611eb5af5 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:48:34.569295 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d4183d73-ecae-414f-8384-d52b386d3f1b tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:34.570106 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d4183d73-ecae-414f-8384-d52b386d3f1b tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] [instance: ba44b84e-68dc-4120-8343-9dd611eb5af5] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:48:34.581273 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d4183d73-ecae-414f-8384-d52b386d3f1b tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:34.582106 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d4183d73-ecae-414f-8384-d52b386d3f1b tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:34.582600 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d4183d73-ecae-414f-8384-d52b386d3f1b tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:34.583346 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d4183d73-ecae-414f-8384-d52b386d3f1b tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:34.583974 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d4183d73-ecae-414f-8384-d52b386d3f1b tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:34.584603 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d4183d73-ecae-414f-8384-d52b386d3f1b tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:34.747869 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d4183d73-ecae-414f-8384-d52b386d3f1b tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e90d254a9d942818ef85e0eb4f145e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de9b441849694e2399094a86c20fa9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:48:34.761368 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d4183d73-ecae-414f-8384-d52b386d3f1b tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] 10.222.0.33 "GET /compute/v2.1/servers/ba44b84e-68dc-4120-8343-9dd611eb5af5" status: 200 len: 1554 microversion: 2.1 time: 0.196143 Oct 04 21:48:34.762377 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3520/7075] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:48:34 2022] GET /compute/v2.1/servers/ba44b84e-68dc-4120-8343-9dd611eb5af5 => generated 1554 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:48:35.802256 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-962ddea1-681e-4543-b960-cdc4314397ea tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:35.803059 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-962ddea1-681e-4543-b960-cdc4314397ea tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] [instance: ba44b84e-68dc-4120-8343-9dd611eb5af5] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:48:35.811014 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-962ddea1-681e-4543-b960-cdc4314397ea tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:35.811529 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-962ddea1-681e-4543-b960-cdc4314397ea tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:35.812107 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-962ddea1-681e-4543-b960-cdc4314397ea tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:35.813368 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-962ddea1-681e-4543-b960-cdc4314397ea tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:35.813841 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-962ddea1-681e-4543-b960-cdc4314397ea tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:35.814284 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-962ddea1-681e-4543-b960-cdc4314397ea tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:35.965108 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-962ddea1-681e-4543-b960-cdc4314397ea tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e90d254a9d942818ef85e0eb4f145e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de9b441849694e2399094a86c20fa9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:48:35.973736 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-962ddea1-681e-4543-b960-cdc4314397ea tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] 10.222.0.33 "GET /compute/v2.1/servers/ba44b84e-68dc-4120-8343-9dd611eb5af5" status: 200 len: 1554 microversion: 2.1 time: 0.177064 Oct 04 21:48:35.974368 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3556/7076] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:48:35 2022] GET /compute/v2.1/servers/ba44b84e-68dc-4120-8343-9dd611eb5af5 => generated 1554 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:48:36.962387 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-10809003-ecbf-47ab-8faf-31fe7f288db6 req-c7ccc454-39ae-42b7-b332-a8869c81db73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba44b84e-68dc-4120-8343-9dd611eb5af5", "name": "network-vif-deleted", "tag": "faf78765-2187-4e6d-be04-ac91f53b4595"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:48:36.974634 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-10809003-ecbf-47ab-8faf-31fe7f288db6 req-c7ccc454-39ae-42b7-b332-a8869c81db73 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:36.975129 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-10809003-ecbf-47ab-8faf-31fe7f288db6 req-c7ccc454-39ae-42b7-b332-a8869c81db73 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:36.975565 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-10809003-ecbf-47ab-8faf-31fe7f288db6 req-c7ccc454-39ae-42b7-b332-a8869c81db73 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:36.989575 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-10809003-ecbf-47ab-8faf-31fe7f288db6 req-c7ccc454-39ae-42b7-b332-a8869c81db73 service nova] Creating event network-vif-deleted:faf78765-2187-4e6d-be04-ac91f53b4595 for instance ba44b84e-68dc-4120-8343-9dd611eb5af5 on n-h2-854823-8 Oct 04 21:48:36.995417 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-10809003-ecbf-47ab-8faf-31fe7f288db6 req-c7ccc454-39ae-42b7-b332-a8869c81db73 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037018 Oct 04 21:48:36.996053 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3521/7077] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:48:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:48:37.013408 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-f0a148a6-f155-4698-b821-f532cc0152d4 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:37.014573 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-f0a148a6-f155-4698-b821-f532cc0152d4 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] [instance: ba44b84e-68dc-4120-8343-9dd611eb5af5] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:48:37.029020 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f0a148a6-f155-4698-b821-f532cc0152d4 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:37.030208 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f0a148a6-f155-4698-b821-f532cc0152d4 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:37.032222 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f0a148a6-f155-4698-b821-f532cc0152d4 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:37.032463 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f0a148a6-f155-4698-b821-f532cc0152d4 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:37.032894 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f0a148a6-f155-4698-b821-f532cc0152d4 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:37.033404 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f0a148a6-f155-4698-b821-f532cc0152d4 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:37.122031 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-f0a148a6-f155-4698-b821-f532cc0152d4 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e90d254a9d942818ef85e0eb4f145e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de9b441849694e2399094a86c20fa9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:48:37.132001 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-f0a148a6-f155-4698-b821-f532cc0152d4 tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] 10.222.0.33 "GET /compute/v2.1/servers/ba44b84e-68dc-4120-8343-9dd611eb5af5" status: 200 len: 1344 microversion: 2.1 time: 0.124942 Oct 04 21:48:37.132610 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3557/7078] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:48:37 2022] GET /compute/v2.1/servers/ba44b84e-68dc-4120-8343-9dd611eb5af5 => generated 1344 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:48:38.178763 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7ab44315-c262-4f8e-a36a-acc873f3d6ac tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:38.180054 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-7ab44315-c262-4f8e-a36a-acc873f3d6ac tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] [instance: ba44b84e-68dc-4120-8343-9dd611eb5af5] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:48:38.190949 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7ab44315-c262-4f8e-a36a-acc873f3d6ac tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:38.191807 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7ab44315-c262-4f8e-a36a-acc873f3d6ac tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:38.192563 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7ab44315-c262-4f8e-a36a-acc873f3d6ac tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:38.193794 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7ab44315-c262-4f8e-a36a-acc873f3d6ac tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:38.194606 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7ab44315-c262-4f8e-a36a-acc873f3d6ac tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:38.195343 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7ab44315-c262-4f8e-a36a-acc873f3d6ac tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:38.222039 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-7ab44315-c262-4f8e-a36a-acc873f3d6ac tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] HTTP exception thrown: Instance ba44b84e-68dc-4120-8343-9dd611eb5af5 could not be found. Oct 04 21:48:38.225147 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7ab44315-c262-4f8e-a36a-acc873f3d6ac tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Request method failure captured: Oct 04 21:48:38.225147 n-d-854823-8 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/ba44b84e-68dc-4120-8343-9dd611eb5af5 HTTP/1.1 Oct 04 21:48:38.225147 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 21:48:38.225147 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 21:48:38.225147 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 21:48:38.225147 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 0 Oct 04 21:48:38.225147 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 21:48:38.225147 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 21:48:38.225147 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 21:48:38.225147 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 21:48:38.225147 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPKjEGDFAqr06wGYGiddF4oc0BRE102RCjTdUBtdwO-Ov7skQPAm1_If6NpGgMYaBpfFC3r1Zdw0lm9YgT0Rx_ggxXz3KLZ90VfdrAP_O35CwxbEd4AZafa20n5-f3CKFl9e_T2XPSWFAqd1tTJVvqDDcxur5iitKqhci7o6CgQooUDs Oct 04 21:48:38.225147 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 21:48:38.225147 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 21:48:38.225147 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 21:48:38.225147 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 21:48:38.225147 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 21:48:38.225147 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 21:48:38.225147 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: de9b441849694e2399094a86c20fa9dc Oct 04 21:48:38.225147 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-TestMinimumBasicScenario-1081630272 Oct 04 21:48:38.225147 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 21:48:38.225147 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 21:48:38.225147 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_de9b441849694e2399094a86c20fa9dc", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/de9b441849694e2399094a86c20fa9dc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/de9b441849694e2399094a86c20fa9dc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/de9b441849694e2399094a86c20fa9dc"}]}] Oct 04 21:48:38.225147 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-TestMinimumBasicScenario-1081630272 Oct 04 21:48:38.225147 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: de9b441849694e2399094a86c20fa9dc Oct 04 21:48:38.225147 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1081630272 Oct 04 21:48:38.225147 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-TestMinimumBasicScenario-1081630272-project Oct 04 21:48:38.225147 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 21:48:38.225147 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 21:48:38.225147 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: 8e90d254a9d942818ef85e0eb4f145e7 Oct 04 21:48:38.225147 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-TestMinimumBasicScenario-1081630272-project Oct 04 21:48:38.225147 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 21:48:38.225147 n-d-854823-8 devstack@n-api.service[128801]: exception: Instance ba44b84e-68dc-4120-8343-9dd611eb5af5 could not be found. Oct 04 21:48:38.225147 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': 'ba44b84e-68dc-4120-8343-9dd611eb5af5'} Oct 04 21:48:38.225147 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:48:38.225147 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:48:38.225147 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:48:38.225147 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:48:38.225147 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:48:38.225147 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:48:38.225147 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:48:38.225147 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:48:38.225147 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:48:38.225147 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:48:38.225147 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ba44b84e-68dc-4120-8343-9dd611eb5af5 could not be found. Oct 04 21:48:38.225147 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:48:38.225147 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:48:38.225147 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:48:38.225147 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:48:38.225147 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:48:38.225147 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:48:38.225147 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:48:38.225147 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:48:38.225147 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:48:38.225147 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:48:38.225147 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:48:38.225147 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:48:38.225147 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:48:38.225147 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:48:38.225147 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:48:38.225147 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:48:38.225147 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba44b84e-68dc-4120-8343-9dd611eb5af5 could not be found. Oct 04 21:48:38.225147 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:48:38.225147 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:48:38.225147 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:48:38.232714 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:48:38.232714 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:48:38.232714 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:48:38.232714 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:48:38.232714 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:48:38.232714 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba44b84e-68dc-4120-8343-9dd611eb5af5 could not be found. Oct 04 21:48:38.232714 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:48:38.232714 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7ab44315-c262-4f8e-a36a-acc873f3d6ac tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Returning 404 to user: Instance ba44b84e-68dc-4120-8343-9dd611eb5af5 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:48:38.232714 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-7ab44315-c262-4f8e-a36a-acc873f3d6ac tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] 10.222.0.33 "GET /compute/v2.1/servers/ba44b84e-68dc-4120-8343-9dd611eb5af5" status: 404 len: 111 microversion: 2.1 time: 0.058831 Oct 04 21:48:38.232714 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3522/7079] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:48:38 2022] GET /compute/v2.1/servers/ba44b84e-68dc-4120-8343-9dd611eb5af5 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:48:38.239849 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-b80f8082-6889-4a40-8519-88f1cd83f70d tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] Calling method '.version_select at 0x7f3c6f53c550>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:38.264762 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-b80f8082-6889-4a40-8519-88f1cd83f70d tempest-TestMinimumBasicScenario-1081630272 tempest-TestMinimumBasicScenario-1081630272-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1449842870" status: 202 len: 0 microversion: 2.1 time: 0.029238 Oct 04 21:48:38.265913 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3558/7080] 10.222.0.33 () {58 vars in 1272 bytes} [Tue Oct 4 21:48:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1449842870 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:48:50.120242 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=18 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:48:50.121159 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=43,nova_cell1:INSERT=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:48:50.335681 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f7fb020f-992e-41f1-b7af-d8a534570738 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Action: 'create', calling method: .version_select at 0x7f3c6f047af0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-188821053", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEadCg1PxKucYUtuI2p3/t4U1UCefGbSz/r544d1NpzbHpOtDxdvdyy3aViVTNkIDzsEnp1uHa7m4KwWXcr0l4zxKRzWcJNPNTqy3dqIA5y1qpkM+W0nY2H8Svhsph37LQ=="}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:48:50.353920 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-f7fb020f-992e-41f1-b7af-d8a534570738 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Getting quotas for project ab94b4108b3c46a6b527f647f6184d9f. Resources: {'key_pairs'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:48:50.364071 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-f7fb020f-992e-41f1-b7af-d8a534570738 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Getting quotas for user e3527811c42647d99491111361f6479d and project ab94b4108b3c46a6b527f647f6184d9f. Resources: {'key_pairs'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:48:50.408634 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f7fb020f-992e-41f1-b7af-d8a534570738 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.293836 Oct 04 21:48:50.409524 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3523/7081] 10.222.0.33 () {60 vars in 1159 bytes} [Tue Oct 4 21:48:50 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:48:58.052892 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:48:58.053704 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:48:58.058296 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-12f64a5c-aacc-43cc-a4be-ef5bcee079dd tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-2141291272", "imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63", "flavorRef": "452", "networks": [{"uuid": "51be47df-eaba-4ea8-98b0-9d014cc0f0f5"}], "key_name": "tempest-TestNetworkAdvancedServerOps-188821053", "security_groups": [{"name": "tempest-secgroup-smoke-1528798550"}]}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:48:58.195941 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.network.neutron [None req-12f64a5c-aacc-43cc-a4be-ef5bcee079dd tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] validate_networks() for [('51be47df-eaba-4ea8-98b0-9d014cc0f0f5', None, None, None, None, None)] {{(pid=128802) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:48:58.833043 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-12f64a5c-aacc-43cc-a4be-ef5bcee079dd tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Flavor limits 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:48:58.833934 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-12f64a5c-aacc-43cc-a4be-ef5bcee079dd tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Image limits 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:48:58.834986 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-12f64a5c-aacc-43cc-a4be-ef5bcee079dd tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Flavor pref 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:48:58.835826 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-12f64a5c-aacc-43cc-a4be-ef5bcee079dd tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Image pref 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:48:58.836857 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-12f64a5c-aacc-43cc-a4be-ef5bcee079dd tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:48:58.853535 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-12f64a5c-aacc-43cc-a4be-ef5bcee079dd tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:58.854427 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-12f64a5c-aacc-43cc-a4be-ef5bcee079dd tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:58.855268 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-12f64a5c-aacc-43cc-a4be-ef5bcee079dd tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:58.856680 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-12f64a5c-aacc-43cc-a4be-ef5bcee079dd tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:48:58.857535 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-12f64a5c-aacc-43cc-a4be-ef5bcee079dd tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:48:58.859366 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-12f64a5c-aacc-43cc-a4be-ef5bcee079dd tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:48:58.900043 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-12f64a5c-aacc-43cc-a4be-ef5bcee079dd tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Getting quotas for project ab94b4108b3c46a6b527f647f6184d9f. Resources: {'ram', 'instances', 'cores'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:48:58.912638 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-12f64a5c-aacc-43cc-a4be-ef5bcee079dd tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Getting quotas for user e3527811c42647d99491111361f6479d and project ab94b4108b3c46a6b527f647f6184d9f. Resources: {'ram', 'instances', 'cores'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:48:58.939692 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-12f64a5c-aacc-43cc-a4be-ef5bcee079dd tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Going to run 1 instances... {{(pid=128802) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:48:58.944174 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-12f64a5c-aacc-43cc-a4be-ef5bcee079dd tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] [instance: 33b0812b-36c3-4810-acd9-a731de893e59] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='15b24725-0c99-4bcf-b1fb-907cdf8e2d63',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128802) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:48:59.037614 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-12f64a5c-aacc-43cc-a4be-ef5bcee079dd tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.986239 Oct 04 21:48:59.039017 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3559/7082] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 21:48:58 2022] POST /compute/v2.1/servers => generated 406 bytes in 989 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:48:59.059644 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b1ce2b14-c1d1-4505-9ab9-c9a497a110ec tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:48:59.060696 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b1ce2b14-c1d1-4505-9ab9-c9a497a110ec tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] [instance: 33b0812b-36c3-4810-acd9-a731de893e59] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:48:59.174667 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-b1ce2b14-c1d1-4505-9ab9-c9a497a110ec tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3527811c42647d99491111361f6479d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab94b4108b3c46a6b527f647f6184d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:48:59.190447 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b1ce2b14-c1d1-4505-9ab9-c9a497a110ec tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] 10.222.0.33 "GET /compute/v2.1/servers/33b0812b-36c3-4810-acd9-a731de893e59" status: 200 len: 1266 microversion: 2.1 time: 0.138407 Oct 04 21:48:59.194525 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3524/7083] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:48:59 2022] GET /compute/v2.1/servers/33b0812b-36c3-4810-acd9-a731de893e59 => generated 1266 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:49:00.231677 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-a658775f-d5da-40a6-b193-7b09c64dc701 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:49:00.233369 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-a658775f-d5da-40a6-b193-7b09c64dc701 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] [instance: 33b0812b-36c3-4810-acd9-a731de893e59] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:49:00.256866 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a658775f-d5da-40a6-b193-7b09c64dc701 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:00.257669 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a658775f-d5da-40a6-b193-7b09c64dc701 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:00.258388 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a658775f-d5da-40a6-b193-7b09c64dc701 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:00.260679 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a658775f-d5da-40a6-b193-7b09c64dc701 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:00.261489 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a658775f-d5da-40a6-b193-7b09c64dc701 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:00.262018 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a658775f-d5da-40a6-b193-7b09c64dc701 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:00.353161 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-a658775f-d5da-40a6-b193-7b09c64dc701 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3527811c42647d99491111361f6479d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab94b4108b3c46a6b527f647f6184d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:49:00.364450 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-a658775f-d5da-40a6-b193-7b09c64dc701 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] 10.222.0.33 "GET /compute/v2.1/servers/33b0812b-36c3-4810-acd9-a731de893e59" status: 200 len: 1318 microversion: 2.1 time: 0.138332 Oct 04 21:49:00.365076 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3560/7084] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:49:00 2022] GET /compute/v2.1/servers/33b0812b-36c3-4810-acd9-a731de893e59 => generated 1318 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:49:01.394215 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-656039b2-f2f6-4d81-a08f-e8a03f5a8d58 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:49:01.395429 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-656039b2-f2f6-4d81-a08f-e8a03f5a8d58 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] [instance: 33b0812b-36c3-4810-acd9-a731de893e59] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:49:01.409735 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-656039b2-f2f6-4d81-a08f-e8a03f5a8d58 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:01.410658 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-656039b2-f2f6-4d81-a08f-e8a03f5a8d58 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:01.411756 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-656039b2-f2f6-4d81-a08f-e8a03f5a8d58 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:01.413685 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-656039b2-f2f6-4d81-a08f-e8a03f5a8d58 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:01.414815 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-656039b2-f2f6-4d81-a08f-e8a03f5a8d58 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:01.415814 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-656039b2-f2f6-4d81-a08f-e8a03f5a8d58 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:01.534819 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-656039b2-f2f6-4d81-a08f-e8a03f5a8d58 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3527811c42647d99491111361f6479d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab94b4108b3c46a6b527f647f6184d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:49:01.552673 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-656039b2-f2f6-4d81-a08f-e8a03f5a8d58 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] 10.222.0.33 "GET /compute/v2.1/servers/33b0812b-36c3-4810-acd9-a731de893e59" status: 200 len: 1324 microversion: 2.1 time: 0.165841 Oct 04 21:49:01.553785 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3525/7085] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:49:01 2022] GET /compute/v2.1/servers/33b0812b-36c3-4810-acd9-a731de893e59 => generated 1324 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:49:02.590662 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-f25c8cf9-986e-485a-a568-adebed330806 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:49:02.591855 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-f25c8cf9-986e-485a-a568-adebed330806 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] [instance: 33b0812b-36c3-4810-acd9-a731de893e59] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:49:02.602004 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f25c8cf9-986e-485a-a568-adebed330806 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:02.602551 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f25c8cf9-986e-485a-a568-adebed330806 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:02.603013 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f25c8cf9-986e-485a-a568-adebed330806 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:02.603769 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f25c8cf9-986e-485a-a568-adebed330806 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:02.604256 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f25c8cf9-986e-485a-a568-adebed330806 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:02.604737 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f25c8cf9-986e-485a-a568-adebed330806 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:02.775046 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-f25c8cf9-986e-485a-a568-adebed330806 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3527811c42647d99491111361f6479d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab94b4108b3c46a6b527f647f6184d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:49:02.785484 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-f25c8cf9-986e-485a-a568-adebed330806 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] 10.222.0.33 "GET /compute/v2.1/servers/33b0812b-36c3-4810-acd9-a731de893e59" status: 200 len: 1392 microversion: 2.1 time: 0.201474 Oct 04 21:49:02.786598 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3561/7086] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:49:02 2022] GET /compute/v2.1/servers/33b0812b-36c3-4810-acd9-a731de893e59 => generated 1392 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:49:03.151685 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-ce4491af-8506-421e-b7ab-3ef8c7276db0 req-4fa516a6-6624-4e40-a7a0-82317bff186c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33b0812b-36c3-4810-acd9-a731de893e59", "tag": "5e958b29-7ff3-4648-9185-3c5a4d95bd1f"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:49:03.163397 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-ce4491af-8506-421e-b7ab-3ef8c7276db0 req-4fa516a6-6624-4e40-a7a0-82317bff186c service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:03.163921 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-ce4491af-8506-421e-b7ab-3ef8c7276db0 req-4fa516a6-6624-4e40-a7a0-82317bff186c service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:03.164557 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-ce4491af-8506-421e-b7ab-3ef8c7276db0 req-4fa516a6-6624-4e40-a7a0-82317bff186c service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:03.177975 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-ce4491af-8506-421e-b7ab-3ef8c7276db0 req-4fa516a6-6624-4e40-a7a0-82317bff186c service nova] Creating event network-changed:5e958b29-7ff3-4648-9185-3c5a4d95bd1f for instance 33b0812b-36c3-4810-acd9-a731de893e59 on n-h1-854823-8 Oct 04 21:49:03.184766 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-ce4491af-8506-421e-b7ab-3ef8c7276db0 req-4fa516a6-6624-4e40-a7a0-82317bff186c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.141839 Oct 04 21:49:03.185856 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3526/7087] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:49:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:49:03.813524 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-498485b6-b07b-457d-ab3e-cd8a0eeb2c1e tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:49:03.814226 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-498485b6-b07b-457d-ab3e-cd8a0eeb2c1e tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] [instance: 33b0812b-36c3-4810-acd9-a731de893e59] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:49:03.821924 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-498485b6-b07b-457d-ab3e-cd8a0eeb2c1e tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:03.822468 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-498485b6-b07b-457d-ab3e-cd8a0eeb2c1e tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:03.822927 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-498485b6-b07b-457d-ab3e-cd8a0eeb2c1e tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:03.823676 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-498485b6-b07b-457d-ab3e-cd8a0eeb2c1e tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:03.824161 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-498485b6-b07b-457d-ab3e-cd8a0eeb2c1e tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:03.824618 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-498485b6-b07b-457d-ab3e-cd8a0eeb2c1e tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:03.983238 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-498485b6-b07b-457d-ab3e-cd8a0eeb2c1e tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3527811c42647d99491111361f6479d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab94b4108b3c46a6b527f647f6184d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:49:03.992462 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-498485b6-b07b-457d-ab3e-cd8a0eeb2c1e tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] 10.222.0.33 "GET /compute/v2.1/servers/33b0812b-36c3-4810-acd9-a731de893e59" status: 200 len: 1392 microversion: 2.1 time: 0.183947 Oct 04 21:49:03.993067 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3562/7088] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:49:03 2022] GET /compute/v2.1/servers/33b0812b-36c3-4810-acd9-a731de893e59 => generated 1392 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:49:05.019860 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-73cec4b8-bb5b-4532-90cc-5be3f01e2ed8 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:49:05.020579 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-73cec4b8-bb5b-4532-90cc-5be3f01e2ed8 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] [instance: 33b0812b-36c3-4810-acd9-a731de893e59] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:49:05.027379 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-73cec4b8-bb5b-4532-90cc-5be3f01e2ed8 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:05.028247 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-73cec4b8-bb5b-4532-90cc-5be3f01e2ed8 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:05.028707 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-73cec4b8-bb5b-4532-90cc-5be3f01e2ed8 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:05.029438 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-73cec4b8-bb5b-4532-90cc-5be3f01e2ed8 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:05.029902 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-73cec4b8-bb5b-4532-90cc-5be3f01e2ed8 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:05.030679 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-73cec4b8-bb5b-4532-90cc-5be3f01e2ed8 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:05.210015 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-73cec4b8-bb5b-4532-90cc-5be3f01e2ed8 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3527811c42647d99491111361f6479d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab94b4108b3c46a6b527f647f6184d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:49:05.221764 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-73cec4b8-bb5b-4532-90cc-5be3f01e2ed8 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] 10.222.0.33 "GET /compute/v2.1/servers/33b0812b-36c3-4810-acd9-a731de893e59" status: 200 len: 1392 microversion: 2.1 time: 0.207677 Oct 04 21:49:05.222406 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3527/7089] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:49:05 2022] GET /compute/v2.1/servers/33b0812b-36c3-4810-acd9-a731de893e59 => generated 1392 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:49:06.249963 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-37e72c12-9c4e-42f1-bd7a-28644709a128 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:49:06.251133 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-37e72c12-9c4e-42f1-bd7a-28644709a128 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] [instance: 33b0812b-36c3-4810-acd9-a731de893e59] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:49:06.258675 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-37e72c12-9c4e-42f1-bd7a-28644709a128 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:06.259189 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-37e72c12-9c4e-42f1-bd7a-28644709a128 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:06.259650 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-37e72c12-9c4e-42f1-bd7a-28644709a128 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:06.260403 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-37e72c12-9c4e-42f1-bd7a-28644709a128 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:06.260881 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-37e72c12-9c4e-42f1-bd7a-28644709a128 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:06.261330 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-37e72c12-9c4e-42f1-bd7a-28644709a128 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:06.426314 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-37e72c12-9c4e-42f1-bd7a-28644709a128 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3527811c42647d99491111361f6479d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab94b4108b3c46a6b527f647f6184d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:49:06.435407 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-37e72c12-9c4e-42f1-bd7a-28644709a128 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] 10.222.0.33 "GET /compute/v2.1/servers/33b0812b-36c3-4810-acd9-a731de893e59" status: 200 len: 1392 microversion: 2.1 time: 0.189813 Oct 04 21:49:06.436000 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3563/7090] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:49:06 2022] GET /compute/v2.1/servers/33b0812b-36c3-4810-acd9-a731de893e59 => generated 1392 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:49:07.461590 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c3b8edcf-fbb6-4077-8fc1-7d4aeefc0b03 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:49:07.462214 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c3b8edcf-fbb6-4077-8fc1-7d4aeefc0b03 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] [instance: 33b0812b-36c3-4810-acd9-a731de893e59] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:49:07.469900 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c3b8edcf-fbb6-4077-8fc1-7d4aeefc0b03 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:07.470572 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c3b8edcf-fbb6-4077-8fc1-7d4aeefc0b03 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:07.471056 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c3b8edcf-fbb6-4077-8fc1-7d4aeefc0b03 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:07.471814 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c3b8edcf-fbb6-4077-8fc1-7d4aeefc0b03 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:07.472333 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c3b8edcf-fbb6-4077-8fc1-7d4aeefc0b03 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:07.472815 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c3b8edcf-fbb6-4077-8fc1-7d4aeefc0b03 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:07.635596 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c3b8edcf-fbb6-4077-8fc1-7d4aeefc0b03 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3527811c42647d99491111361f6479d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab94b4108b3c46a6b527f647f6184d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:49:07.644692 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c3b8edcf-fbb6-4077-8fc1-7d4aeefc0b03 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] 10.222.0.33 "GET /compute/v2.1/servers/33b0812b-36c3-4810-acd9-a731de893e59" status: 200 len: 1392 microversion: 2.1 time: 0.187323 Oct 04 21:49:07.645293 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3528/7091] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:49:07 2022] GET /compute/v2.1/servers/33b0812b-36c3-4810-acd9-a731de893e59 => generated 1392 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:49:08.047907 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-ec7cbeb2-fd79-4a45-8393-b2be31349a52 req-42df08bc-38bc-4b54-b3d3-5e244de1f678 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33b0812b-36c3-4810-acd9-a731de893e59", "name": "network-vif-plugged", "status": "completed", "tag": "5e958b29-7ff3-4648-9185-3c5a4d95bd1f"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:49:08.058743 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-ec7cbeb2-fd79-4a45-8393-b2be31349a52 req-42df08bc-38bc-4b54-b3d3-5e244de1f678 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:08.059348 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-ec7cbeb2-fd79-4a45-8393-b2be31349a52 req-42df08bc-38bc-4b54-b3d3-5e244de1f678 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:08.059901 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-ec7cbeb2-fd79-4a45-8393-b2be31349a52 req-42df08bc-38bc-4b54-b3d3-5e244de1f678 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:08.079744 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-ec7cbeb2-fd79-4a45-8393-b2be31349a52 req-42df08bc-38bc-4b54-b3d3-5e244de1f678 service nova] Creating event network-vif-plugged:5e958b29-7ff3-4648-9185-3c5a4d95bd1f for instance 33b0812b-36c3-4810-acd9-a731de893e59 on n-h1-854823-8 Oct 04 21:49:08.086253 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-ec7cbeb2-fd79-4a45-8393-b2be31349a52 req-42df08bc-38bc-4b54-b3d3-5e244de1f678 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115155 Oct 04 21:49:08.087146 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3564/7092] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:49:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:49:08.668576 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f678bdf4-4bd7-47c8-a184-c3ad5459abdb tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:49:08.669196 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f678bdf4-4bd7-47c8-a184-c3ad5459abdb tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] [instance: 33b0812b-36c3-4810-acd9-a731de893e59] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:49:08.677047 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f678bdf4-4bd7-47c8-a184-c3ad5459abdb tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:08.677543 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f678bdf4-4bd7-47c8-a184-c3ad5459abdb tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:08.677981 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f678bdf4-4bd7-47c8-a184-c3ad5459abdb tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:08.678734 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f678bdf4-4bd7-47c8-a184-c3ad5459abdb tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:08.679192 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f678bdf4-4bd7-47c8-a184-c3ad5459abdb tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:08.679616 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f678bdf4-4bd7-47c8-a184-c3ad5459abdb tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:08.865336 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f678bdf4-4bd7-47c8-a184-c3ad5459abdb tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3527811c42647d99491111361f6479d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab94b4108b3c46a6b527f647f6184d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:49:08.877827 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f678bdf4-4bd7-47c8-a184-c3ad5459abdb tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] 10.222.0.33 "GET /compute/v2.1/servers/33b0812b-36c3-4810-acd9-a731de893e59" status: 200 len: 1392 microversion: 2.1 time: 0.213062 Oct 04 21:49:08.878502 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3529/7093] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:49:08 2022] GET /compute/v2.1/servers/33b0812b-36c3-4810-acd9-a731de893e59 => generated 1392 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:49:09.900572 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell0:SELECT=2 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:49:09.901391 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell0:SELECT=6 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:49:09.907646 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-6050eaaa-b9d1-4e1d-8eab-0e6292c5853e tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:49:09.908404 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-6050eaaa-b9d1-4e1d-8eab-0e6292c5853e tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] [instance: 33b0812b-36c3-4810-acd9-a731de893e59] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:49:09.916089 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6050eaaa-b9d1-4e1d-8eab-0e6292c5853e tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:09.916598 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6050eaaa-b9d1-4e1d-8eab-0e6292c5853e tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:09.917182 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6050eaaa-b9d1-4e1d-8eab-0e6292c5853e tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:09.917925 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6050eaaa-b9d1-4e1d-8eab-0e6292c5853e tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:09.918515 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6050eaaa-b9d1-4e1d-8eab-0e6292c5853e tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:09.918962 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-6050eaaa-b9d1-4e1d-8eab-0e6292c5853e tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:10.084586 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-6050eaaa-b9d1-4e1d-8eab-0e6292c5853e tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3527811c42647d99491111361f6479d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab94b4108b3c46a6b527f647f6184d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:49:10.094712 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-6050eaaa-b9d1-4e1d-8eab-0e6292c5853e tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] 10.222.0.33 "GET /compute/v2.1/servers/33b0812b-36c3-4810-acd9-a731de893e59" status: 200 len: 1564 microversion: 2.1 time: 0.195031 Oct 04 21:49:10.095631 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3565/7094] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:49:09 2022] GET /compute/v2.1/servers/33b0812b-36c3-4810-acd9-a731de893e59 => generated 1564 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:49:10.119832 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5250a5c9-8524-47e5-b6b3-4185482cc7e9 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:49:10.120510 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-5250a5c9-8524-47e5-b6b3-4185482cc7e9 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] [instance: 33b0812b-36c3-4810-acd9-a731de893e59] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:49:10.122638 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=6 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:49:10.130175 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5250a5c9-8524-47e5-b6b3-4185482cc7e9 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:10.130721 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5250a5c9-8524-47e5-b6b3-4185482cc7e9 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:10.131163 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5250a5c9-8524-47e5-b6b3-4185482cc7e9 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:10.131891 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5250a5c9-8524-47e5-b6b3-4185482cc7e9 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:10.132356 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5250a5c9-8524-47e5-b6b3-4185482cc7e9 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:10.133503 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5250a5c9-8524-47e5-b6b3-4185482cc7e9 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:10.296490 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-5250a5c9-8524-47e5-b6b3-4185482cc7e9 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3527811c42647d99491111361f6479d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab94b4108b3c46a6b527f647f6184d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:49:10.305798 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5250a5c9-8524-47e5-b6b3-4185482cc7e9 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] 10.222.0.33 "GET /compute/v2.1/servers/33b0812b-36c3-4810-acd9-a731de893e59" status: 200 len: 1564 microversion: 2.1 time: 0.190044 Oct 04 21:49:10.306479 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3530/7095] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:49:10 2022] GET /compute/v2.1/servers/33b0812b-36c3-4810-acd9-a731de893e59 => generated 1564 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:49:12.419135 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-b5b0832c-18f8-45bd-9d5b-103dfb8f692a req-79fb684e-323c-4372-bb13-b2ddafe4cb14 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33b0812b-36c3-4810-acd9-a731de893e59", "tag": "5e958b29-7ff3-4648-9185-3c5a4d95bd1f"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:49:12.420199 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-58e05853-4699-4f63-a8fd-7a5ad29cbcfd tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:49:12.422258 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-58e05853-4699-4f63-a8fd-7a5ad29cbcfd tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] [instance: 33b0812b-36c3-4810-acd9-a731de893e59] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:49:12.435780 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-58e05853-4699-4f63-a8fd-7a5ad29cbcfd tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:12.437274 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-58e05853-4699-4f63-a8fd-7a5ad29cbcfd tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:12.438126 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-58e05853-4699-4f63-a8fd-7a5ad29cbcfd tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:12.438547 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-b5b0832c-18f8-45bd-9d5b-103dfb8f692a req-79fb684e-323c-4372-bb13-b2ddafe4cb14 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:12.439057 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-b5b0832c-18f8-45bd-9d5b-103dfb8f692a req-79fb684e-323c-4372-bb13-b2ddafe4cb14 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:12.439500 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-b5b0832c-18f8-45bd-9d5b-103dfb8f692a req-79fb684e-323c-4372-bb13-b2ddafe4cb14 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:12.439800 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-58e05853-4699-4f63-a8fd-7a5ad29cbcfd tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:12.440923 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-58e05853-4699-4f63-a8fd-7a5ad29cbcfd tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:12.441722 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-58e05853-4699-4f63-a8fd-7a5ad29cbcfd tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:12.457557 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-b5b0832c-18f8-45bd-9d5b-103dfb8f692a req-79fb684e-323c-4372-bb13-b2ddafe4cb14 service nova] Creating event network-changed:5e958b29-7ff3-4648-9185-3c5a4d95bd1f for instance 33b0812b-36c3-4810-acd9-a731de893e59 on n-h1-854823-8 Oct 04 21:49:12.463795 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-b5b0832c-18f8-45bd-9d5b-103dfb8f692a req-79fb684e-323c-4372-bb13-b2ddafe4cb14 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049524 Oct 04 21:49:12.464772 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3531/7096] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:49:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:49:12.655401 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-58e05853-4699-4f63-a8fd-7a5ad29cbcfd tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3527811c42647d99491111361f6479d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab94b4108b3c46a6b527f647f6184d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:49:12.665008 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-58e05853-4699-4f63-a8fd-7a5ad29cbcfd tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] 10.222.0.33 "GET /compute/v2.1/servers/33b0812b-36c3-4810-acd9-a731de893e59" status: 200 len: 1564 microversion: 2.1 time: 0.253058 Oct 04 21:49:12.665718 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3566/7097] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:49:12 2022] GET /compute/v2.1/servers/33b0812b-36c3-4810-acd9-a731de893e59 => generated 1564 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:49:37.065786 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:49:37.067078 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=34 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:49:37.073057 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7afdb652-c1e6-4425-8a70-3eb5670f71bd tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:49:37.075592 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-7afdb652-c1e6-4425-8a70-3eb5670f71bd tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] [instance: 33b0812b-36c3-4810-acd9-a731de893e59] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:49:37.084697 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7afdb652-c1e6-4425-8a70-3eb5670f71bd tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:37.085197 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7afdb652-c1e6-4425-8a70-3eb5670f71bd tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:37.085645 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7afdb652-c1e6-4425-8a70-3eb5670f71bd tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:37.086443 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7afdb652-c1e6-4425-8a70-3eb5670f71bd tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:37.086916 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7afdb652-c1e6-4425-8a70-3eb5670f71bd tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:37.087348 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7afdb652-c1e6-4425-8a70-3eb5670f71bd tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:37.149727 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-7afdb652-c1e6-4425-8a70-3eb5670f71bd tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] 10.222.0.33 "POST /compute/v2.1/servers/33b0812b-36c3-4810-acd9-a731de893e59/action" status: 200 len: 24572 microversion: 2.1 time: 0.086105 Oct 04 21:49:37.150459 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3532/7098] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 21:49:37 2022] POST /compute/v2.1/servers/33b0812b-36c3-4810-acd9-a731de893e59/action => generated 24572 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 04 21:49:48.094816 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-ac370735-8018-4412-951b-7a9286afbbef tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:49:48.095463 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-ac370735-8018-4412-951b-7a9286afbbef tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] [instance: 33b0812b-36c3-4810-acd9-a731de893e59] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:49:48.097837 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:49:48.098630 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=40 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:49:48.106087 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ac370735-8018-4412-951b-7a9286afbbef tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:48.106734 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ac370735-8018-4412-951b-7a9286afbbef tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:48.107299 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ac370735-8018-4412-951b-7a9286afbbef tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:48.108873 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ac370735-8018-4412-951b-7a9286afbbef tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:48.109408 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ac370735-8018-4412-951b-7a9286afbbef tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:48.110127 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ac370735-8018-4412-951b-7a9286afbbef tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:48.190058 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-ac370735-8018-4412-951b-7a9286afbbef tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] 10.222.0.33 "POST /compute/v2.1/servers/33b0812b-36c3-4810-acd9-a731de893e59/action" status: 202 len: 0 microversion: 2.1 time: 0.100560 Oct 04 21:49:48.194054 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3567/7099] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 21:49:48 2022] POST /compute/v2.1/servers/33b0812b-36c3-4810-acd9-a731de893e59/action => generated 0 bytes in 102 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:49:48.201639 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0808e6a9-b93d-4a00-ae62-d08bb328a550 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:49:48.202660 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-0808e6a9-b93d-4a00-ae62-d08bb328a550 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] [instance: 33b0812b-36c3-4810-acd9-a731de893e59] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:49:48.206171 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:49:48.207266 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=4 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:49:48.218693 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0808e6a9-b93d-4a00-ae62-d08bb328a550 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:48.219772 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0808e6a9-b93d-4a00-ae62-d08bb328a550 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:48.220271 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0808e6a9-b93d-4a00-ae62-d08bb328a550 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:48.221038 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0808e6a9-b93d-4a00-ae62-d08bb328a550 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:48.221504 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0808e6a9-b93d-4a00-ae62-d08bb328a550 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:48.221935 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0808e6a9-b93d-4a00-ae62-d08bb328a550 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:48.449503 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-0808e6a9-b93d-4a00-ae62-d08bb328a550 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3527811c42647d99491111361f6479d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab94b4108b3c46a6b527f647f6184d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:49:48.460187 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-0808e6a9-b93d-4a00-ae62-d08bb328a550 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] 10.222.0.33 "GET /compute/v2.1/servers/33b0812b-36c3-4810-acd9-a731de893e59" status: 200 len: 1688 microversion: 2.1 time: 0.264046 Oct 04 21:49:48.460821 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3533/7100] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:49:48 2022] GET /compute/v2.1/servers/33b0812b-36c3-4810-acd9-a731de893e59 => generated 1688 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:49:49.507241 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-27b11ba2-1ba8-498b-8c52-62c10e8adb8c tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:49:49.508116 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-27b11ba2-1ba8-498b-8c52-62c10e8adb8c tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] [instance: 33b0812b-36c3-4810-acd9-a731de893e59] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:49:49.515798 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-27b11ba2-1ba8-498b-8c52-62c10e8adb8c tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:49.516325 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-27b11ba2-1ba8-498b-8c52-62c10e8adb8c tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:49.516785 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-27b11ba2-1ba8-498b-8c52-62c10e8adb8c tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:49.517535 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-27b11ba2-1ba8-498b-8c52-62c10e8adb8c tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:49.518014 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-27b11ba2-1ba8-498b-8c52-62c10e8adb8c tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:49.518500 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-27b11ba2-1ba8-498b-8c52-62c10e8adb8c tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:49.673463 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-27b11ba2-1ba8-498b-8c52-62c10e8adb8c tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3527811c42647d99491111361f6479d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab94b4108b3c46a6b527f647f6184d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:49:49.682043 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-27b11ba2-1ba8-498b-8c52-62c10e8adb8c tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] 10.222.0.33 "GET /compute/v2.1/servers/33b0812b-36c3-4810-acd9-a731de893e59" status: 200 len: 1668 microversion: 2.1 time: 0.181111 Oct 04 21:49:49.682707 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3568/7101] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:49:49 2022] GET /compute/v2.1/servers/33b0812b-36c3-4810-acd9-a731de893e59 => generated 1668 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:49:50.791779 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c7575ec8-7328-4ff2-9117-196effe958f7 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:49:50.794626 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c7575ec8-7328-4ff2-9117-196effe958f7 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] [instance: 33b0812b-36c3-4810-acd9-a731de893e59] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:49:50.804311 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c7575ec8-7328-4ff2-9117-196effe958f7 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:50.804822 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c7575ec8-7328-4ff2-9117-196effe958f7 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:50.805274 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c7575ec8-7328-4ff2-9117-196effe958f7 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:50.806041 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c7575ec8-7328-4ff2-9117-196effe958f7 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:50.806560 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c7575ec8-7328-4ff2-9117-196effe958f7 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:50.806996 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c7575ec8-7328-4ff2-9117-196effe958f7 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:50.871380 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c7575ec8-7328-4ff2-9117-196effe958f7 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] 10.222.0.33 "POST /compute/v2.1/servers/33b0812b-36c3-4810-acd9-a731de893e59/action" status: 200 len: 32643 microversion: 2.1 time: 0.083624 Oct 04 21:49:50.872090 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3534/7102] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 21:49:50 2022] POST /compute/v2.1/servers/33b0812b-36c3-4810-acd9-a731de893e59/action => generated 32643 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 21:49:50.885772 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-79e49be2-216b-49d4-b483-9a3cb9bdfaff tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:49:50.886435 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-79e49be2-216b-49d4-b483-9a3cb9bdfaff tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] [instance: 33b0812b-36c3-4810-acd9-a731de893e59] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:49:50.893899 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-79e49be2-216b-49d4-b483-9a3cb9bdfaff tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:50.894442 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-79e49be2-216b-49d4-b483-9a3cb9bdfaff tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:50.894906 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-79e49be2-216b-49d4-b483-9a3cb9bdfaff tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:50.895656 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-79e49be2-216b-49d4-b483-9a3cb9bdfaff tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:50.896158 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-79e49be2-216b-49d4-b483-9a3cb9bdfaff tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:50.896607 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-79e49be2-216b-49d4-b483-9a3cb9bdfaff tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:50.976635 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-79e49be2-216b-49d4-b483-9a3cb9bdfaff tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] 10.222.0.33 "POST /compute/v2.1/servers/33b0812b-36c3-4810-acd9-a731de893e59/action" status: 202 len: 0 microversion: 2.1 time: 0.094529 Oct 04 21:49:50.977909 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3569/7103] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 21:49:50 2022] POST /compute/v2.1/servers/33b0812b-36c3-4810-acd9-a731de893e59/action => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 21:49:50.989220 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-826b1a5f-fff6-4a2d-a1cc-1e38b70b1e4b tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:49:50.990561 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-826b1a5f-fff6-4a2d-a1cc-1e38b70b1e4b tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] [instance: 33b0812b-36c3-4810-acd9-a731de893e59] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:49:51.004934 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-826b1a5f-fff6-4a2d-a1cc-1e38b70b1e4b tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:51.005597 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-826b1a5f-fff6-4a2d-a1cc-1e38b70b1e4b tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:51.006415 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-826b1a5f-fff6-4a2d-a1cc-1e38b70b1e4b tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:51.007371 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-826b1a5f-fff6-4a2d-a1cc-1e38b70b1e4b tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:51.008040 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-826b1a5f-fff6-4a2d-a1cc-1e38b70b1e4b tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:51.008819 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-826b1a5f-fff6-4a2d-a1cc-1e38b70b1e4b tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:51.224127 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-826b1a5f-fff6-4a2d-a1cc-1e38b70b1e4b tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3527811c42647d99491111361f6479d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab94b4108b3c46a6b527f647f6184d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:49:51.235093 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-826b1a5f-fff6-4a2d-a1cc-1e38b70b1e4b tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] 10.222.0.33 "GET /compute/v2.1/servers/33b0812b-36c3-4810-acd9-a731de893e59" status: 200 len: 1675 microversion: 2.1 time: 0.251454 Oct 04 21:49:51.235680 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3535/7104] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:49:50 2022] GET /compute/v2.1/servers/33b0812b-36c3-4810-acd9-a731de893e59 => generated 1675 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:49:52.261619 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-72bda381-7cb4-4199-817f-2fa88a42a6cc tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:49:52.262512 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-72bda381-7cb4-4199-817f-2fa88a42a6cc tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] [instance: 33b0812b-36c3-4810-acd9-a731de893e59] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:49:52.269726 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-72bda381-7cb4-4199-817f-2fa88a42a6cc tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:52.270246 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-72bda381-7cb4-4199-817f-2fa88a42a6cc tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:52.270753 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-72bda381-7cb4-4199-817f-2fa88a42a6cc tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:52.271507 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-72bda381-7cb4-4199-817f-2fa88a42a6cc tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:52.271984 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-72bda381-7cb4-4199-817f-2fa88a42a6cc tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:52.272441 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-72bda381-7cb4-4199-817f-2fa88a42a6cc tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:52.424028 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-72bda381-7cb4-4199-817f-2fa88a42a6cc tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3527811c42647d99491111361f6479d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab94b4108b3c46a6b527f647f6184d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:49:52.432694 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-72bda381-7cb4-4199-817f-2fa88a42a6cc tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] 10.222.0.33 "GET /compute/v2.1/servers/33b0812b-36c3-4810-acd9-a731de893e59" status: 200 len: 1683 microversion: 2.1 time: 0.176399 Oct 04 21:49:52.433324 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3570/7105] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:49:52 2022] GET /compute/v2.1/servers/33b0812b-36c3-4810-acd9-a731de893e59 => generated 1683 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:49:52.574730 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-86d0371d-b4c0-4230-aa8d-33042aa275bf tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:49:52.578712 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-86d0371d-b4c0-4230-aa8d-33042aa275bf tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] [instance: 33b0812b-36c3-4810-acd9-a731de893e59] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:49:52.593753 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-86d0371d-b4c0-4230-aa8d-33042aa275bf tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:52.594653 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-86d0371d-b4c0-4230-aa8d-33042aa275bf tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:52.595426 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-86d0371d-b4c0-4230-aa8d-33042aa275bf tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:52.596699 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-86d0371d-b4c0-4230-aa8d-33042aa275bf tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:52.597553 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-86d0371d-b4c0-4230-aa8d-33042aa275bf tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:52.598310 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-86d0371d-b4c0-4230-aa8d-33042aa275bf tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:52.666617 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-86d0371d-b4c0-4230-aa8d-33042aa275bf tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] 10.222.0.33 "POST /compute/v2.1/servers/33b0812b-36c3-4810-acd9-a731de893e59/action" status: 200 len: 37969 microversion: 2.1 time: 0.098778 Oct 04 21:49:52.667575 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3536/7106] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 21:49:52 2022] POST /compute/v2.1/servers/33b0812b-36c3-4810-acd9-a731de893e59/action => generated 37969 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 21:49:53.799371 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-725f2b0f-b2a7-4af9-a722-86178f8a8745 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:49:53.800703 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-725f2b0f-b2a7-4af9-a722-86178f8a8745 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] [instance: 33b0812b-36c3-4810-acd9-a731de893e59] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:49:53.800860 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-9c68960b-ceb2-43ce-8737-c69a0237d45e req-e8b008c3-4e40-4854-b66d-155a26bd79c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33b0812b-36c3-4810-acd9-a731de893e59", "tag": "5e958b29-7ff3-4648-9185-3c5a4d95bd1f"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:49:53.811481 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-725f2b0f-b2a7-4af9-a722-86178f8a8745 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:53.812402 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-725f2b0f-b2a7-4af9-a722-86178f8a8745 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:53.813036 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-725f2b0f-b2a7-4af9-a722-86178f8a8745 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:53.814116 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-725f2b0f-b2a7-4af9-a722-86178f8a8745 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:53.814685 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-9c68960b-ceb2-43ce-8737-c69a0237d45e req-e8b008c3-4e40-4854-b66d-155a26bd79c0 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:53.815067 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-725f2b0f-b2a7-4af9-a722-86178f8a8745 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:53.815291 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-9c68960b-ceb2-43ce-8737-c69a0237d45e req-e8b008c3-4e40-4854-b66d-155a26bd79c0 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:53.815802 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-9c68960b-ceb2-43ce-8737-c69a0237d45e req-e8b008c3-4e40-4854-b66d-155a26bd79c0 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:53.816012 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-725f2b0f-b2a7-4af9-a722-86178f8a8745 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:53.830611 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-9c68960b-ceb2-43ce-8737-c69a0237d45e req-e8b008c3-4e40-4854-b66d-155a26bd79c0 service nova] Creating event network-changed:5e958b29-7ff3-4648-9185-3c5a4d95bd1f for instance 33b0812b-36c3-4810-acd9-a731de893e59 on n-h1-854823-8 Oct 04 21:49:53.836489 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-9c68960b-ceb2-43ce-8737-c69a0237d45e req-e8b008c3-4e40-4854-b66d-155a26bd79c0 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040034 Oct 04 21:49:53.837268 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3537/7107] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:49:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:49:53.862435 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-725f2b0f-b2a7-4af9-a722-86178f8a8745 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] [instance: 33b0812b-36c3-4810-acd9-a731de893e59] Going to try to terminate instance {{(pid=128802) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:49:54.007784 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-725f2b0f-b2a7-4af9-a722-86178f8a8745 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] 10.222.0.33 "DELETE /compute/v2.1/servers/33b0812b-36c3-4810-acd9-a731de893e59" status: 204 len: 0 microversion: 2.1 time: 0.213937 Oct 04 21:49:54.008877 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3571/7108] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 21:49:53 2022] DELETE /compute/v2.1/servers/33b0812b-36c3-4810-acd9-a731de893e59 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:49:54.027248 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7896951e-69a1-4769-9480-e7fc790e459f tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:49:54.028588 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-7896951e-69a1-4769-9480-e7fc790e459f tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] [instance: 33b0812b-36c3-4810-acd9-a731de893e59] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:49:54.040980 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7896951e-69a1-4769-9480-e7fc790e459f tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:54.042275 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7896951e-69a1-4769-9480-e7fc790e459f tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:54.043302 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7896951e-69a1-4769-9480-e7fc790e459f tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:54.045514 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7896951e-69a1-4769-9480-e7fc790e459f tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:54.046999 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7896951e-69a1-4769-9480-e7fc790e459f tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:54.048012 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7896951e-69a1-4769-9480-e7fc790e459f tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:54.237936 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-7896951e-69a1-4769-9480-e7fc790e459f tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3527811c42647d99491111361f6479d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab94b4108b3c46a6b527f647f6184d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:49:54.246985 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-7896951e-69a1-4769-9480-e7fc790e459f tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] 10.222.0.33 "GET /compute/v2.1/servers/33b0812b-36c3-4810-acd9-a731de893e59" status: 200 len: 1689 microversion: 2.1 time: 0.229575 Oct 04 21:49:54.248464 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3538/7109] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:49:54 2022] GET /compute/v2.1/servers/33b0812b-36c3-4810-acd9-a731de893e59 => generated 1689 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:49:55.272734 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-d7256651-2a1b-476e-8654-5fe4a8e414ad tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:49:55.273462 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-d7256651-2a1b-476e-8654-5fe4a8e414ad tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] [instance: 33b0812b-36c3-4810-acd9-a731de893e59] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:49:55.281966 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d7256651-2a1b-476e-8654-5fe4a8e414ad tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:55.282521 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d7256651-2a1b-476e-8654-5fe4a8e414ad tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:55.282982 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d7256651-2a1b-476e-8654-5fe4a8e414ad tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:55.283728 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d7256651-2a1b-476e-8654-5fe4a8e414ad tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:55.284209 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d7256651-2a1b-476e-8654-5fe4a8e414ad tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:55.284651 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d7256651-2a1b-476e-8654-5fe4a8e414ad tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:55.462662 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-d7256651-2a1b-476e-8654-5fe4a8e414ad tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3527811c42647d99491111361f6479d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab94b4108b3c46a6b527f647f6184d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:49:55.471834 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-d7256651-2a1b-476e-8654-5fe4a8e414ad tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] 10.222.0.33 "GET /compute/v2.1/servers/33b0812b-36c3-4810-acd9-a731de893e59" status: 200 len: 1689 microversion: 2.1 time: 0.203487 Oct 04 21:49:55.472456 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3572/7110] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:49:55 2022] GET /compute/v2.1/servers/33b0812b-36c3-4810-acd9-a731de893e59 => generated 1689 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:49:56.433946 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-c97de046-80be-4932-9f33-3865d0669eaa req-f28aea98-2a63-433a-80be-6661df482ee5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33b0812b-36c3-4810-acd9-a731de893e59", "name": "network-vif-deleted", "tag": "5e958b29-7ff3-4648-9185-3c5a4d95bd1f"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:49:56.450509 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-c97de046-80be-4932-9f33-3865d0669eaa req-f28aea98-2a63-433a-80be-6661df482ee5 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:56.451915 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-c97de046-80be-4932-9f33-3865d0669eaa req-f28aea98-2a63-433a-80be-6661df482ee5 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:56.452691 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-c97de046-80be-4932-9f33-3865d0669eaa req-f28aea98-2a63-433a-80be-6661df482ee5 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:56.470659 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-c97de046-80be-4932-9f33-3865d0669eaa req-f28aea98-2a63-433a-80be-6661df482ee5 service nova] Creating event network-vif-deleted:5e958b29-7ff3-4648-9185-3c5a4d95bd1f for instance 33b0812b-36c3-4810-acd9-a731de893e59 on n-h1-854823-8 Oct 04 21:49:56.477240 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-c97de046-80be-4932-9f33-3865d0669eaa req-f28aea98-2a63-433a-80be-6661df482ee5 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046739 Oct 04 21:49:56.478180 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3539/7111] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:49:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:49:56.498599 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-7d9caf60-105a-486f-b9be-e812e1c6bdaa tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:49:56.500162 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-7d9caf60-105a-486f-b9be-e812e1c6bdaa tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] [instance: 33b0812b-36c3-4810-acd9-a731de893e59] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:49:56.512334 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7d9caf60-105a-486f-b9be-e812e1c6bdaa tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:56.514182 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7d9caf60-105a-486f-b9be-e812e1c6bdaa tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:56.515388 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7d9caf60-105a-486f-b9be-e812e1c6bdaa tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:56.516873 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7d9caf60-105a-486f-b9be-e812e1c6bdaa tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:56.518056 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7d9caf60-105a-486f-b9be-e812e1c6bdaa tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:56.518730 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7d9caf60-105a-486f-b9be-e812e1c6bdaa tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:56.603386 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-7d9caf60-105a-486f-b9be-e812e1c6bdaa tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3527811c42647d99491111361f6479d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab94b4108b3c46a6b527f647f6184d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:49:56.613296 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-7d9caf60-105a-486f-b9be-e812e1c6bdaa tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] 10.222.0.33 "GET /compute/v2.1/servers/33b0812b-36c3-4810-acd9-a731de893e59" status: 200 len: 1351 microversion: 2.1 time: 0.119442 Oct 04 21:49:56.614061 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3573/7112] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:49:56 2022] GET /compute/v2.1/servers/33b0812b-36c3-4810-acd9-a731de893e59 => generated 1351 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:49:57.639804 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-01400323-e113-4b76-9285-be7ecbfc9fc7 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:49:57.640643 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-01400323-e113-4b76-9285-be7ecbfc9fc7 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] [instance: 33b0812b-36c3-4810-acd9-a731de893e59] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:49:57.648168 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-01400323-e113-4b76-9285-be7ecbfc9fc7 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:57.648660 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-01400323-e113-4b76-9285-be7ecbfc9fc7 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:57.649100 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-01400323-e113-4b76-9285-be7ecbfc9fc7 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:57.649819 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-01400323-e113-4b76-9285-be7ecbfc9fc7 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:49:57.650277 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-01400323-e113-4b76-9285-be7ecbfc9fc7 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:49:57.650771 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-01400323-e113-4b76-9285-be7ecbfc9fc7 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:49:57.666796 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-01400323-e113-4b76-9285-be7ecbfc9fc7 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] HTTP exception thrown: Instance 33b0812b-36c3-4810-acd9-a731de893e59 could not be found. Oct 04 21:49:57.668549 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-01400323-e113-4b76-9285-be7ecbfc9fc7 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Request method failure captured: Oct 04 21:49:57.668549 n-d-854823-8 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/33b0812b-36c3-4810-acd9-a731de893e59 HTTP/1.1 Oct 04 21:49:57.668549 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 21:49:57.668549 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 21:49:57.668549 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 21:49:57.668549 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 0 Oct 04 21:49:57.668549 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 21:49:57.668549 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 21:49:57.668549 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 21:49:57.668549 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 21:49:57.668549 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPKpBWf-ZdDHioKk7j1GCDpSV4CNRjR-HsBeRw5uM8vLVrE4RAbnqqIyB__lIo4YB-nPYiZgBfW-sd_MC5MrdTXH2d0mlcXhungwp23-mUfKzbPqcsQDk2EjQ-fmeT9DeObGTOq1tP4JZSLD8LNhyn4WTlxw8LmfuqpFt38X2o1fTW7c Oct 04 21:49:57.668549 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 21:49:57.668549 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 21:49:57.668549 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 21:49:57.668549 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 21:49:57.668549 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 21:49:57.668549 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 21:49:57.668549 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: ab94b4108b3c46a6b527f647f6184d9f Oct 04 21:49:57.668549 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-2019967856 Oct 04 21:49:57.668549 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 21:49:57.668549 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 21:49:57.668549 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ab94b4108b3c46a6b527f647f6184d9f", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ab94b4108b3c46a6b527f647f6184d9f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ab94b4108b3c46a6b527f647f6184d9f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ab94b4108b3c46a6b527f647f6184d9f"}]}] Oct 04 21:49:57.668549 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-TestNetworkAdvancedServerOps-2019967856 Oct 04 21:49:57.668549 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: ab94b4108b3c46a6b527f647f6184d9f Oct 04 21:49:57.668549 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-2019967856 Oct 04 21:49:57.668549 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-TestNetworkAdvancedServerOps-2019967856-project Oct 04 21:49:57.668549 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 21:49:57.668549 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 21:49:57.668549 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: e3527811c42647d99491111361f6479d Oct 04 21:49:57.668549 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-TestNetworkAdvancedServerOps-2019967856-project Oct 04 21:49:57.668549 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 21:49:57.668549 n-d-854823-8 devstack@n-api.service[128801]: exception: Instance 33b0812b-36c3-4810-acd9-a731de893e59 could not be found. Oct 04 21:49:57.668549 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': '33b0812b-36c3-4810-acd9-a731de893e59'} Oct 04 21:49:57.668549 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:49:57.668549 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:49:57.668549 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:49:57.668549 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:49:57.668549 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:49:57.668549 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:49:57.668549 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:49:57.668549 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:49:57.668549 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:49:57.668549 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:49:57.668549 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33b0812b-36c3-4810-acd9-a731de893e59 could not be found. Oct 04 21:49:57.668549 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:49:57.668549 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:49:57.668549 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:49:57.668549 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:49:57.668549 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:49:57.668549 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:49:57.668549 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:49:57.668549 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:49:57.668549 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:49:57.668549 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:49:57.668549 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:49:57.668549 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:49:57.668549 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:49:57.668549 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:49:57.668549 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:49:57.668549 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:49:57.668549 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33b0812b-36c3-4810-acd9-a731de893e59 could not be found. Oct 04 21:49:57.668549 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:49:57.668549 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:49:57.675275 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:49:57.675275 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:49:57.675275 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:49:57.675275 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:49:57.675275 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:49:57.675275 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:49:57.675275 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33b0812b-36c3-4810-acd9-a731de893e59 could not be found. Oct 04 21:49:57.675275 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:49:57.675275 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-01400323-e113-4b76-9285-be7ecbfc9fc7 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Returning 404 to user: Instance 33b0812b-36c3-4810-acd9-a731de893e59 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:49:57.675275 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-01400323-e113-4b76-9285-be7ecbfc9fc7 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] 10.222.0.33 "GET /compute/v2.1/servers/33b0812b-36c3-4810-acd9-a731de893e59" status: 404 len: 111 microversion: 2.1 time: 0.035683 Oct 04 21:49:57.675275 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3540/7113] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:49:57 2022] GET /compute/v2.1/servers/33b0812b-36c3-4810-acd9-a731de893e59 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:50:02.037374 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-b196d0e9-f04f-410d-a561-b6b4c7213029 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Calling method '.version_select at 0x7f3c7409d1f0>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:50:02.072820 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-b196d0e9-f04f-410d-a561-b6b4c7213029 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-188821053" status: 202 len: 0 microversion: 2.1 time: 0.038675 Oct 04 21:50:02.074011 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3574/7114] 10.222.0.33 () {58 vars in 1281 bytes} [Tue Oct 4 21:50:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-188821053 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:50:02.111285 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-770096d2-c521-4d7e-93b6-9fb834efe30c tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Action: 'create', calling method: .version_select at 0x7f3c742e1dc0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-2031474118", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGAvlco6aFCYdz6LipOhPzzUUeX1uZ4duf0sAk9v5snjqnHscLQE9sUK4v7lAxv4YlkdkYw/WhclwpMSv/YUt8DO0dqPkPfq7UMUhKhPQV3JB4t/lekHU+MDSKEWch8oqw=="}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:50:02.130612 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-770096d2-c521-4d7e-93b6-9fb834efe30c tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Getting quotas for project ab94b4108b3c46a6b527f647f6184d9f. Resources: {'key_pairs'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:50:02.136556 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-770096d2-c521-4d7e-93b6-9fb834efe30c tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Getting quotas for user e3527811c42647d99491111361f6479d and project ab94b4108b3c46a6b527f647f6184d9f. Resources: {'key_pairs'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:50:02.164054 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-770096d2-c521-4d7e-93b6-9fb834efe30c tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.057699 Oct 04 21:50:02.164683 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3541/7115] 10.222.0.33 () {60 vars in 1159 bytes} [Tue Oct 4 21:50:02 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:50:09.591917 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-a1803044-b439-4cd5-94ac-5362ebcde1b2 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-727057172", "imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63", "flavorRef": "452", "networks": [{"uuid": "fa4cf58f-27e6-4d0a-ba71-251d4792180d"}], "key_name": "tempest-TestNetworkAdvancedServerOps-2031474118", "security_groups": [{"name": "tempest-secgroup-smoke-727976306"}]}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:50:09.616884 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:50:09.783438 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.network.neutron [None req-a1803044-b439-4cd5-94ac-5362ebcde1b2 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] validate_networks() for [('fa4cf58f-27e6-4d0a-ba71-251d4792180d', None, None, None, None, None)] {{(pid=128802) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:50:10.349485 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-a1803044-b439-4cd5-94ac-5362ebcde1b2 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Flavor limits 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:50:10.349941 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-a1803044-b439-4cd5-94ac-5362ebcde1b2 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Image limits 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:50:10.350469 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-a1803044-b439-4cd5-94ac-5362ebcde1b2 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Flavor pref 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:50:10.350909 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-a1803044-b439-4cd5-94ac-5362ebcde1b2 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Image pref 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:50:10.351351 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-a1803044-b439-4cd5-94ac-5362ebcde1b2 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:50:10.361878 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a1803044-b439-4cd5-94ac-5362ebcde1b2 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:10.362403 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a1803044-b439-4cd5-94ac-5362ebcde1b2 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:10.363110 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a1803044-b439-4cd5-94ac-5362ebcde1b2 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:10.364683 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a1803044-b439-4cd5-94ac-5362ebcde1b2 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:10.365173 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a1803044-b439-4cd5-94ac-5362ebcde1b2 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:10.365623 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a1803044-b439-4cd5-94ac-5362ebcde1b2 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:10.386757 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-a1803044-b439-4cd5-94ac-5362ebcde1b2 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Getting quotas for project ab94b4108b3c46a6b527f647f6184d9f. Resources: {'ram', 'instances', 'cores'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:50:10.393686 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-a1803044-b439-4cd5-94ac-5362ebcde1b2 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Getting quotas for user e3527811c42647d99491111361f6479d and project ab94b4108b3c46a6b527f647f6184d9f. Resources: {'ram', 'instances', 'cores'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:50:10.410324 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-a1803044-b439-4cd5-94ac-5362ebcde1b2 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Going to run 1 instances... {{(pid=128802) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:50:10.413801 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-a1803044-b439-4cd5-94ac-5362ebcde1b2 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] [instance: 758db237-dbba-4741-81c4-a52b630f1de4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='15b24725-0c99-4bcf-b1fb-907cdf8e2d63',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128802) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:50:10.474946 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-a1803044-b439-4cd5-94ac-5362ebcde1b2 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.891068 Oct 04 21:50:10.476286 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3575/7116] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 21:50:09 2022] POST /compute/v2.1/servers => generated 405 bytes in 894 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:50:10.488620 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-dadbf583-845e-423b-a036-10a2d62aba70 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:50:10.489455 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-dadbf583-845e-423b-a036-10a2d62aba70 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] [instance: 758db237-dbba-4741-81c4-a52b630f1de4] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:50:10.492736 n-d-854823-8 devstack@n-api.service[128801]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 21:50:10.495905 n-d-854823-8 devstack@n-api.service[128801]: Tue Oct 4 21:50:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/758db237-dbba-4741-81c4-a52b630f1de4 (ip 10.222.0.33) !!! Oct 04 21:50:10.500307 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=32 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:50:10.639061 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-dadbf583-845e-423b-a036-10a2d62aba70 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3527811c42647d99491111361f6479d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab94b4108b3c46a6b527f647f6184d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:50:10.656083 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-dadbf583-845e-423b-a036-10a2d62aba70 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] 10.222.0.33 "GET /compute/v2.1/servers/758db237-dbba-4741-81c4-a52b630f1de4" status: 200 len: 1266 microversion: 2.1 time: 0.171682 Oct 04 21:50:10.658980 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3542/7117] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:50:10 2022] GET /compute/v2.1/servers/758db237-dbba-4741-81c4-a52b630f1de4 => generated 1266 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:50:11.689380 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-fd9125de-8ece-45b6-a8c7-06be5381b476 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:50:11.691457 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-fd9125de-8ece-45b6-a8c7-06be5381b476 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] [instance: 758db237-dbba-4741-81c4-a52b630f1de4] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:50:11.703659 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fd9125de-8ece-45b6-a8c7-06be5381b476 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:11.704391 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fd9125de-8ece-45b6-a8c7-06be5381b476 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:11.705063 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fd9125de-8ece-45b6-a8c7-06be5381b476 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:11.706670 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fd9125de-8ece-45b6-a8c7-06be5381b476 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:11.707720 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fd9125de-8ece-45b6-a8c7-06be5381b476 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:11.708555 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fd9125de-8ece-45b6-a8c7-06be5381b476 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:11.803666 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-fd9125de-8ece-45b6-a8c7-06be5381b476 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3527811c42647d99491111361f6479d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab94b4108b3c46a6b527f647f6184d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:50:11.813373 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-fd9125de-8ece-45b6-a8c7-06be5381b476 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] 10.222.0.33 "GET /compute/v2.1/servers/758db237-dbba-4741-81c4-a52b630f1de4" status: 200 len: 1318 microversion: 2.1 time: 0.133216 Oct 04 21:50:11.813994 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3576/7118] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:50:11 2022] GET /compute/v2.1/servers/758db237-dbba-4741-81c4-a52b630f1de4 => generated 1318 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:50:12.848712 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-817b91ce-f211-4cc6-b83b-37621dc89dcc tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:50:12.849916 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-817b91ce-f211-4cc6-b83b-37621dc89dcc tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] [instance: 758db237-dbba-4741-81c4-a52b630f1de4] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:50:12.860063 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-817b91ce-f211-4cc6-b83b-37621dc89dcc tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:12.860563 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-817b91ce-f211-4cc6-b83b-37621dc89dcc tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:12.861016 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-817b91ce-f211-4cc6-b83b-37621dc89dcc tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:12.861757 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-817b91ce-f211-4cc6-b83b-37621dc89dcc tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:12.862228 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-817b91ce-f211-4cc6-b83b-37621dc89dcc tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:12.862854 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-817b91ce-f211-4cc6-b83b-37621dc89dcc tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:12.944522 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-817b91ce-f211-4cc6-b83b-37621dc89dcc tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3527811c42647d99491111361f6479d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab94b4108b3c46a6b527f647f6184d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:50:12.957247 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-817b91ce-f211-4cc6-b83b-37621dc89dcc tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] 10.222.0.33 "GET /compute/v2.1/servers/758db237-dbba-4741-81c4-a52b630f1de4" status: 200 len: 1324 microversion: 2.1 time: 0.116721 Oct 04 21:50:12.958235 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3543/7119] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:50:12 2022] GET /compute/v2.1/servers/758db237-dbba-4741-81c4-a52b630f1de4 => generated 1324 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:50:13.986358 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-3a89cf27-9cb2-4eb8-b913-f9e0c8a4b837 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:50:13.987547 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-3a89cf27-9cb2-4eb8-b913-f9e0c8a4b837 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] [instance: 758db237-dbba-4741-81c4-a52b630f1de4] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:50:14.000505 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3a89cf27-9cb2-4eb8-b913-f9e0c8a4b837 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:14.001497 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3a89cf27-9cb2-4eb8-b913-f9e0c8a4b837 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:14.002335 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3a89cf27-9cb2-4eb8-b913-f9e0c8a4b837 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:14.003679 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3a89cf27-9cb2-4eb8-b913-f9e0c8a4b837 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:14.004541 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3a89cf27-9cb2-4eb8-b913-f9e0c8a4b837 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:14.005360 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3a89cf27-9cb2-4eb8-b913-f9e0c8a4b837 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:14.041041 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-349bf5b0-192c-41ed-bb9f-26763f0c4830 req-79cdbb21-6114-48e3-a306-d76f3d76ec85 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "758db237-dbba-4741-81c4-a52b630f1de4", "tag": "e6392f8c-ba9e-47dd-a9d8-d2af2a836335"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:50:14.054234 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-349bf5b0-192c-41ed-bb9f-26763f0c4830 req-79cdbb21-6114-48e3-a306-d76f3d76ec85 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:14.054710 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-349bf5b0-192c-41ed-bb9f-26763f0c4830 req-79cdbb21-6114-48e3-a306-d76f3d76ec85 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:14.055196 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-349bf5b0-192c-41ed-bb9f-26763f0c4830 req-79cdbb21-6114-48e3-a306-d76f3d76ec85 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:14.068716 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-349bf5b0-192c-41ed-bb9f-26763f0c4830 req-79cdbb21-6114-48e3-a306-d76f3d76ec85 service nova] Creating event network-changed:e6392f8c-ba9e-47dd-a9d8-d2af2a836335 for instance 758db237-dbba-4741-81c4-a52b630f1de4 on n-h2-854823-8 Oct 04 21:50:14.074493 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-349bf5b0-192c-41ed-bb9f-26763f0c4830 req-79cdbb21-6114-48e3-a306-d76f3d76ec85 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037143 Oct 04 21:50:14.075668 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3544/7120] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:50:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:50:14.334719 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-3a89cf27-9cb2-4eb8-b913-f9e0c8a4b837 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3527811c42647d99491111361f6479d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab94b4108b3c46a6b527f647f6184d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:50:14.348163 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-3a89cf27-9cb2-4eb8-b913-f9e0c8a4b837 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] 10.222.0.33 "GET /compute/v2.1/servers/758db237-dbba-4741-81c4-a52b630f1de4" status: 200 len: 1391 microversion: 2.1 time: 0.369366 Oct 04 21:50:14.349299 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3577/7121] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:50:13 2022] GET /compute/v2.1/servers/758db237-dbba-4741-81c4-a52b630f1de4 => generated 1391 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:50:15.373373 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a99ba7ca-05a9-4667-a584-f294bfc1e810 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:50:15.374082 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a99ba7ca-05a9-4667-a584-f294bfc1e810 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] [instance: 758db237-dbba-4741-81c4-a52b630f1de4] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:50:15.380877 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a99ba7ca-05a9-4667-a584-f294bfc1e810 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:15.381373 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a99ba7ca-05a9-4667-a584-f294bfc1e810 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:15.381813 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a99ba7ca-05a9-4667-a584-f294bfc1e810 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:15.382649 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a99ba7ca-05a9-4667-a584-f294bfc1e810 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:15.383110 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a99ba7ca-05a9-4667-a584-f294bfc1e810 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:15.383541 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a99ba7ca-05a9-4667-a584-f294bfc1e810 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:15.597914 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-a99ba7ca-05a9-4667-a584-f294bfc1e810 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3527811c42647d99491111361f6479d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab94b4108b3c46a6b527f647f6184d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:50:15.608825 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a99ba7ca-05a9-4667-a584-f294bfc1e810 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] 10.222.0.33 "GET /compute/v2.1/servers/758db237-dbba-4741-81c4-a52b630f1de4" status: 200 len: 1391 microversion: 2.1 time: 0.240861 Oct 04 21:50:15.609463 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3545/7122] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:50:15 2022] GET /compute/v2.1/servers/758db237-dbba-4741-81c4-a52b630f1de4 => generated 1391 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:50:16.632365 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-69ed5691-bc97-49b5-92e8-779fc9e95a8c tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:50:16.632991 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-69ed5691-bc97-49b5-92e8-779fc9e95a8c tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] [instance: 758db237-dbba-4741-81c4-a52b630f1de4] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:50:16.640424 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-69ed5691-bc97-49b5-92e8-779fc9e95a8c tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:16.640929 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-69ed5691-bc97-49b5-92e8-779fc9e95a8c tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:16.641383 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-69ed5691-bc97-49b5-92e8-779fc9e95a8c tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:16.642112 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-69ed5691-bc97-49b5-92e8-779fc9e95a8c tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:16.642644 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-69ed5691-bc97-49b5-92e8-779fc9e95a8c tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:16.643122 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-69ed5691-bc97-49b5-92e8-779fc9e95a8c tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:16.804541 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-69ed5691-bc97-49b5-92e8-779fc9e95a8c tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3527811c42647d99491111361f6479d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab94b4108b3c46a6b527f647f6184d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:50:16.813626 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-69ed5691-bc97-49b5-92e8-779fc9e95a8c tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] 10.222.0.33 "GET /compute/v2.1/servers/758db237-dbba-4741-81c4-a52b630f1de4" status: 200 len: 1391 microversion: 2.1 time: 0.185104 Oct 04 21:50:16.814271 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3578/7123] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:50:16 2022] GET /compute/v2.1/servers/758db237-dbba-4741-81c4-a52b630f1de4 => generated 1391 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:50:17.838957 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f8da12ce-443d-4c62-9bc1-14e565e68de0 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:50:17.839731 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f8da12ce-443d-4c62-9bc1-14e565e68de0 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] [instance: 758db237-dbba-4741-81c4-a52b630f1de4] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:50:17.848087 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f8da12ce-443d-4c62-9bc1-14e565e68de0 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:17.848604 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f8da12ce-443d-4c62-9bc1-14e565e68de0 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:17.849046 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f8da12ce-443d-4c62-9bc1-14e565e68de0 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:17.849772 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f8da12ce-443d-4c62-9bc1-14e565e68de0 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:17.850233 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f8da12ce-443d-4c62-9bc1-14e565e68de0 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:17.850720 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f8da12ce-443d-4c62-9bc1-14e565e68de0 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:18.028946 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f8da12ce-443d-4c62-9bc1-14e565e68de0 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3527811c42647d99491111361f6479d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab94b4108b3c46a6b527f647f6184d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:50:18.042567 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f8da12ce-443d-4c62-9bc1-14e565e68de0 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] 10.222.0.33 "GET /compute/v2.1/servers/758db237-dbba-4741-81c4-a52b630f1de4" status: 200 len: 1391 microversion: 2.1 time: 0.207088 Oct 04 21:50:18.044133 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3546/7124] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:50:17 2022] GET /compute/v2.1/servers/758db237-dbba-4741-81c4-a52b630f1de4 => generated 1391 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:50:19.069159 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-18248b11-77c2-49e6-961e-c71f417c7768 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:50:19.069861 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-18248b11-77c2-49e6-961e-c71f417c7768 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] [instance: 758db237-dbba-4741-81c4-a52b630f1de4] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:50:19.072466 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:50:19.079861 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-18248b11-77c2-49e6-961e-c71f417c7768 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:19.080381 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-18248b11-77c2-49e6-961e-c71f417c7768 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:19.080846 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-18248b11-77c2-49e6-961e-c71f417c7768 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:19.081596 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-18248b11-77c2-49e6-961e-c71f417c7768 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:19.082078 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-18248b11-77c2-49e6-961e-c71f417c7768 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:19.082558 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-18248b11-77c2-49e6-961e-c71f417c7768 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:19.292113 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-18248b11-77c2-49e6-961e-c71f417c7768 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3527811c42647d99491111361f6479d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab94b4108b3c46a6b527f647f6184d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:50:19.307171 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-18248b11-77c2-49e6-961e-c71f417c7768 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] 10.222.0.33 "GET /compute/v2.1/servers/758db237-dbba-4741-81c4-a52b630f1de4" status: 200 len: 1391 microversion: 2.1 time: 0.242266 Oct 04 21:50:19.308305 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3579/7125] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:50:19 2022] GET /compute/v2.1/servers/758db237-dbba-4741-81c4-a52b630f1de4 => generated 1391 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:50:20.334713 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7c4e0d97-c2c9-482c-8fc4-f7224c0c694d tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:50:20.335387 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-7c4e0d97-c2c9-482c-8fc4-f7224c0c694d tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] [instance: 758db237-dbba-4741-81c4-a52b630f1de4] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:50:20.338478 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:50:20.346587 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7c4e0d97-c2c9-482c-8fc4-f7224c0c694d tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:20.347152 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7c4e0d97-c2c9-482c-8fc4-f7224c0c694d tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:20.347643 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7c4e0d97-c2c9-482c-8fc4-f7224c0c694d tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:20.348428 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7c4e0d97-c2c9-482c-8fc4-f7224c0c694d tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:20.348954 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7c4e0d97-c2c9-482c-8fc4-f7224c0c694d tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:20.349400 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7c4e0d97-c2c9-482c-8fc4-f7224c0c694d tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:20.504280 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-7c4e0d97-c2c9-482c-8fc4-f7224c0c694d tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3527811c42647d99491111361f6479d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab94b4108b3c46a6b527f647f6184d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:50:20.520554 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-7c4e0d97-c2c9-482c-8fc4-f7224c0c694d tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] 10.222.0.33 "GET /compute/v2.1/servers/758db237-dbba-4741-81c4-a52b630f1de4" status: 200 len: 1391 microversion: 2.1 time: 0.189545 Oct 04 21:50:20.521669 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3547/7126] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:50:20 2022] GET /compute/v2.1/servers/758db237-dbba-4741-81c4-a52b630f1de4 => generated 1391 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:50:20.778036 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-29be0d20-7516-4220-9877-a9c82ded9755 req-1804da5a-016e-48c6-8931-106c3525141b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "758db237-dbba-4741-81c4-a52b630f1de4", "name": "network-vif-plugged", "status": "completed", "tag": "e6392f8c-ba9e-47dd-a9d8-d2af2a836335"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:50:20.785058 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell0:SELECT=2 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:50:20.786183 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell0:SELECT=6 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:50:20.798646 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-29be0d20-7516-4220-9877-a9c82ded9755 req-1804da5a-016e-48c6-8931-106c3525141b service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:20.799357 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-29be0d20-7516-4220-9877-a9c82ded9755 req-1804da5a-016e-48c6-8931-106c3525141b service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:20.800094 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-29be0d20-7516-4220-9877-a9c82ded9755 req-1804da5a-016e-48c6-8931-106c3525141b service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:20.817844 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-29be0d20-7516-4220-9877-a9c82ded9755 req-1804da5a-016e-48c6-8931-106c3525141b service nova] Creating event network-vif-plugged:e6392f8c-ba9e-47dd-a9d8-d2af2a836335 for instance 758db237-dbba-4741-81c4-a52b630f1de4 on n-h2-854823-8 Oct 04 21:50:20.824745 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-29be0d20-7516-4220-9877-a9c82ded9755 req-1804da5a-016e-48c6-8931-106c3525141b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050479 Oct 04 21:50:20.826718 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3580/7127] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:50:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:50:21.547465 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-27d768f3-7380-48aa-9724-037758688577 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:50:21.548084 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-27d768f3-7380-48aa-9724-037758688577 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] [instance: 758db237-dbba-4741-81c4-a52b630f1de4] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:50:21.550104 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=6 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:50:21.557564 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-27d768f3-7380-48aa-9724-037758688577 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:21.558195 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-27d768f3-7380-48aa-9724-037758688577 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:21.558851 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-27d768f3-7380-48aa-9724-037758688577 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:21.559724 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-27d768f3-7380-48aa-9724-037758688577 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:21.560290 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-27d768f3-7380-48aa-9724-037758688577 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:21.562385 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-27d768f3-7380-48aa-9724-037758688577 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:21.722926 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-27d768f3-7380-48aa-9724-037758688577 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3527811c42647d99491111361f6479d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab94b4108b3c46a6b527f647f6184d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:50:21.731217 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-27d768f3-7380-48aa-9724-037758688577 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] 10.222.0.33 "GET /compute/v2.1/servers/758db237-dbba-4741-81c4-a52b630f1de4" status: 200 len: 1391 microversion: 2.1 time: 0.188661 Oct 04 21:50:21.731802 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3548/7128] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:50:21 2022] GET /compute/v2.1/servers/758db237-dbba-4741-81c4-a52b630f1de4 => generated 1391 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:50:22.755963 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-44077f06-67b5-4ae9-ab59-3794aada68ff tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:50:22.756680 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-44077f06-67b5-4ae9-ab59-3794aada68ff tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] [instance: 758db237-dbba-4741-81c4-a52b630f1de4] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:50:22.764742 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-44077f06-67b5-4ae9-ab59-3794aada68ff tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:22.765247 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-44077f06-67b5-4ae9-ab59-3794aada68ff tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:22.765709 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-44077f06-67b5-4ae9-ab59-3794aada68ff tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:22.766535 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-44077f06-67b5-4ae9-ab59-3794aada68ff tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:22.766999 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-44077f06-67b5-4ae9-ab59-3794aada68ff tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:22.767439 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-44077f06-67b5-4ae9-ab59-3794aada68ff tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:22.924344 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-44077f06-67b5-4ae9-ab59-3794aada68ff tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3527811c42647d99491111361f6479d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab94b4108b3c46a6b527f647f6184d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:50:22.932912 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-44077f06-67b5-4ae9-ab59-3794aada68ff tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] 10.222.0.33 "GET /compute/v2.1/servers/758db237-dbba-4741-81c4-a52b630f1de4" status: 200 len: 1563 microversion: 2.1 time: 0.181167 Oct 04 21:50:22.933511 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3581/7129] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:50:22 2022] GET /compute/v2.1/servers/758db237-dbba-4741-81c4-a52b630f1de4 => generated 1563 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:50:22.960895 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-dd13c217-a80a-4fdc-9cb3-901901b4ccff tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:50:22.962036 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-dd13c217-a80a-4fdc-9cb3-901901b4ccff tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] [instance: 758db237-dbba-4741-81c4-a52b630f1de4] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:50:22.975921 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dd13c217-a80a-4fdc-9cb3-901901b4ccff tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:22.976774 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dd13c217-a80a-4fdc-9cb3-901901b4ccff tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:22.977538 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dd13c217-a80a-4fdc-9cb3-901901b4ccff tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:22.978807 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dd13c217-a80a-4fdc-9cb3-901901b4ccff tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:22.979623 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dd13c217-a80a-4fdc-9cb3-901901b4ccff tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:22.980390 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-dd13c217-a80a-4fdc-9cb3-901901b4ccff tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:23.148853 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-dd13c217-a80a-4fdc-9cb3-901901b4ccff tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3527811c42647d99491111361f6479d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab94b4108b3c46a6b527f647f6184d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:50:23.158159 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-dd13c217-a80a-4fdc-9cb3-901901b4ccff tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] 10.222.0.33 "GET /compute/v2.1/servers/758db237-dbba-4741-81c4-a52b630f1de4" status: 200 len: 1563 microversion: 2.1 time: 0.204746 Oct 04 21:50:23.158828 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3549/7130] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:50:22 2022] GET /compute/v2.1/servers/758db237-dbba-4741-81c4-a52b630f1de4 => generated 1563 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:50:25.192738 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-1c125e9e-4f63-4087-b7eb-bdc3838ae0ee req-825b19e6-7e14-4fb3-9b0e-e13a1dc0d1ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "758db237-dbba-4741-81c4-a52b630f1de4", "tag": "e6392f8c-ba9e-47dd-a9d8-d2af2a836335"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:50:25.197467 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-8619b791-cf74-4d91-a4ab-707ece27e236 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:50:25.198668 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-8619b791-cf74-4d91-a4ab-707ece27e236 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] [instance: 758db237-dbba-4741-81c4-a52b630f1de4] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:50:25.214219 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-1c125e9e-4f63-4087-b7eb-bdc3838ae0ee req-825b19e6-7e14-4fb3-9b0e-e13a1dc0d1ba service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:25.215548 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-1c125e9e-4f63-4087-b7eb-bdc3838ae0ee req-825b19e6-7e14-4fb3-9b0e-e13a1dc0d1ba service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:25.216430 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-1c125e9e-4f63-4087-b7eb-bdc3838ae0ee req-825b19e6-7e14-4fb3-9b0e-e13a1dc0d1ba service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:25.227614 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8619b791-cf74-4d91-a4ab-707ece27e236 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:25.228858 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8619b791-cf74-4d91-a4ab-707ece27e236 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:25.229681 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8619b791-cf74-4d91-a4ab-707ece27e236 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:25.232028 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8619b791-cf74-4d91-a4ab-707ece27e236 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:25.232973 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8619b791-cf74-4d91-a4ab-707ece27e236 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:25.233794 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8619b791-cf74-4d91-a4ab-707ece27e236 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:25.240314 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-1c125e9e-4f63-4087-b7eb-bdc3838ae0ee req-825b19e6-7e14-4fb3-9b0e-e13a1dc0d1ba service nova] Creating event network-changed:e6392f8c-ba9e-47dd-a9d8-d2af2a836335 for instance 758db237-dbba-4741-81c4-a52b630f1de4 on n-h2-854823-8 Oct 04 21:50:25.251946 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-1c125e9e-4f63-4087-b7eb-bdc3838ae0ee req-825b19e6-7e14-4fb3-9b0e-e13a1dc0d1ba service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066104 Oct 04 21:50:25.253077 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3550/7131] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:50:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:50:25.505400 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-8619b791-cf74-4d91-a4ab-707ece27e236 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3527811c42647d99491111361f6479d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab94b4108b3c46a6b527f647f6184d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:50:25.522399 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-8619b791-cf74-4d91-a4ab-707ece27e236 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] 10.222.0.33 "GET /compute/v2.1/servers/758db237-dbba-4741-81c4-a52b630f1de4" status: 200 len: 1563 microversion: 2.1 time: 0.338781 Oct 04 21:50:25.527494 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3582/7132] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:50:25 2022] GET /compute/v2.1/servers/758db237-dbba-4741-81c4-a52b630f1de4 => generated 1563 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:50:47.898886 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=7 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:50:47.900060 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=40 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:50:47.908285 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d295b8d4-6ea1-4b56-8733-f548d397dcec tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:50:47.912322 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d295b8d4-6ea1-4b56-8733-f548d397dcec tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] [instance: 758db237-dbba-4741-81c4-a52b630f1de4] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:50:47.924812 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d295b8d4-6ea1-4b56-8733-f548d397dcec tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:47.925656 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d295b8d4-6ea1-4b56-8733-f548d397dcec tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:47.926463 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d295b8d4-6ea1-4b56-8733-f548d397dcec tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:47.927770 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d295b8d4-6ea1-4b56-8733-f548d397dcec tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:47.928593 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d295b8d4-6ea1-4b56-8733-f548d397dcec tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:47.929358 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d295b8d4-6ea1-4b56-8733-f548d397dcec tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:48.009966 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d295b8d4-6ea1-4b56-8733-f548d397dcec tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] 10.222.0.33 "POST /compute/v2.1/servers/758db237-dbba-4741-81c4-a52b630f1de4/action" status: 200 len: 24567 microversion: 2.1 time: 0.114990 Oct 04 21:50:48.011666 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3551/7133] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 21:50:47 2022] POST /compute/v2.1/servers/758db237-dbba-4741-81c4-a52b630f1de4/action => generated 24567 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 21:50:59.135552 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-1a444d37-8d65-44e0-b523-df70fdd731ce tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:50:59.137987 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-1a444d37-8d65-44e0-b523-df70fdd731ce tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] [instance: 758db237-dbba-4741-81c4-a52b630f1de4] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:50:59.142590 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_api:SELECT=7 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:50:59.143777 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=40 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:50:59.155476 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1a444d37-8d65-44e0-b523-df70fdd731ce tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:59.156388 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1a444d37-8d65-44e0-b523-df70fdd731ce tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:59.157216 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1a444d37-8d65-44e0-b523-df70fdd731ce tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:59.158589 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1a444d37-8d65-44e0-b523-df70fdd731ce tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:59.159470 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1a444d37-8d65-44e0-b523-df70fdd731ce tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:59.160279 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1a444d37-8d65-44e0-b523-df70fdd731ce tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:59.274518 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-1a444d37-8d65-44e0-b523-df70fdd731ce tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] 10.222.0.33 "POST /compute/v2.1/servers/758db237-dbba-4741-81c4-a52b630f1de4/action" status: 202 len: 0 microversion: 2.1 time: 0.143111 Oct 04 21:50:59.278508 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3583/7134] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 21:50:59 2022] POST /compute/v2.1/servers/758db237-dbba-4741-81c4-a52b630f1de4/action => generated 0 bytes in 145 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:50:59.287197 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b94ae3c0-8a45-4347-8df1-4ab944bebe10 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:50:59.288094 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b94ae3c0-8a45-4347-8df1-4ab944bebe10 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] [instance: 758db237-dbba-4741-81c4-a52b630f1de4] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:50:59.292452 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:50:59.292766 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=4 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:50:59.299762 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b94ae3c0-8a45-4347-8df1-4ab944bebe10 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:59.300260 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b94ae3c0-8a45-4347-8df1-4ab944bebe10 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:59.300701 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b94ae3c0-8a45-4347-8df1-4ab944bebe10 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:59.301423 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b94ae3c0-8a45-4347-8df1-4ab944bebe10 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:50:59.301876 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b94ae3c0-8a45-4347-8df1-4ab944bebe10 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:50:59.302304 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b94ae3c0-8a45-4347-8df1-4ab944bebe10 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:50:59.565922 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-b94ae3c0-8a45-4347-8df1-4ab944bebe10 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3527811c42647d99491111361f6479d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab94b4108b3c46a6b527f647f6184d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:50:59.581319 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b94ae3c0-8a45-4347-8df1-4ab944bebe10 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] 10.222.0.33 "GET /compute/v2.1/servers/758db237-dbba-4741-81c4-a52b630f1de4" status: 200 len: 1674 microversion: 2.1 time: 0.298093 Oct 04 21:50:59.582401 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3552/7135] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:50:59 2022] GET /compute/v2.1/servers/758db237-dbba-4741-81c4-a52b630f1de4 => generated 1674 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:51:00.620126 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-e603127e-ee27-48a3-8c4a-9affd96397cc tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:51:00.620946 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-e603127e-ee27-48a3-8c4a-9affd96397cc tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] [instance: 758db237-dbba-4741-81c4-a52b630f1de4] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:51:00.628132 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e603127e-ee27-48a3-8c4a-9affd96397cc tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:00.628648 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e603127e-ee27-48a3-8c4a-9affd96397cc tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:00.629096 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e603127e-ee27-48a3-8c4a-9affd96397cc tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:00.629828 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e603127e-ee27-48a3-8c4a-9affd96397cc tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:00.630294 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e603127e-ee27-48a3-8c4a-9affd96397cc tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:00.630762 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e603127e-ee27-48a3-8c4a-9affd96397cc tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:00.805925 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-e603127e-ee27-48a3-8c4a-9affd96397cc tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3527811c42647d99491111361f6479d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab94b4108b3c46a6b527f647f6184d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:51:00.814873 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-e603127e-ee27-48a3-8c4a-9affd96397cc tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] 10.222.0.33 "GET /compute/v2.1/servers/758db237-dbba-4741-81c4-a52b630f1de4" status: 200 len: 1679 microversion: 2.1 time: 0.200769 Oct 04 21:51:00.815481 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3584/7136] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:51:00 2022] GET /compute/v2.1/servers/758db237-dbba-4741-81c4-a52b630f1de4 => generated 1679 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:51:01.844301 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f1f73ee9-0d83-474a-8519-2797216dce86 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:51:01.845429 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f1f73ee9-0d83-474a-8519-2797216dce86 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] [instance: 758db237-dbba-4741-81c4-a52b630f1de4] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:51:01.858924 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f1f73ee9-0d83-474a-8519-2797216dce86 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:01.859773 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f1f73ee9-0d83-474a-8519-2797216dce86 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:01.860545 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f1f73ee9-0d83-474a-8519-2797216dce86 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:01.861822 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f1f73ee9-0d83-474a-8519-2797216dce86 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:01.862692 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f1f73ee9-0d83-474a-8519-2797216dce86 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:01.863473 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f1f73ee9-0d83-474a-8519-2797216dce86 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:02.059527 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f1f73ee9-0d83-474a-8519-2797216dce86 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3527811c42647d99491111361f6479d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab94b4108b3c46a6b527f647f6184d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:51:02.068610 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f1f73ee9-0d83-474a-8519-2797216dce86 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] 10.222.0.33 "GET /compute/v2.1/servers/758db237-dbba-4741-81c4-a52b630f1de4" status: 200 len: 1679 microversion: 2.1 time: 0.232000 Oct 04 21:51:02.069573 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3553/7137] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:51:01 2022] GET /compute/v2.1/servers/758db237-dbba-4741-81c4-a52b630f1de4 => generated 1679 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:51:03.108078 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-24245823-63f8-4a91-bed4-035e8c74337c tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:51:03.108776 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-24245823-63f8-4a91-bed4-035e8c74337c tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] [instance: 758db237-dbba-4741-81c4-a52b630f1de4] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:51:03.116636 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-24245823-63f8-4a91-bed4-035e8c74337c tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:03.117150 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-24245823-63f8-4a91-bed4-035e8c74337c tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:03.117609 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-24245823-63f8-4a91-bed4-035e8c74337c tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:03.118383 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-24245823-63f8-4a91-bed4-035e8c74337c tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:03.118863 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-24245823-63f8-4a91-bed4-035e8c74337c tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:03.119462 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-24245823-63f8-4a91-bed4-035e8c74337c tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:03.281674 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-24245823-63f8-4a91-bed4-035e8c74337c tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3527811c42647d99491111361f6479d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab94b4108b3c46a6b527f647f6184d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:51:03.291731 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-24245823-63f8-4a91-bed4-035e8c74337c tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] 10.222.0.33 "GET /compute/v2.1/servers/758db237-dbba-4741-81c4-a52b630f1de4" status: 200 len: 1679 microversion: 2.1 time: 0.187783 Oct 04 21:51:03.292332 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3585/7138] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:51:03 2022] GET /compute/v2.1/servers/758db237-dbba-4741-81c4-a52b630f1de4 => generated 1679 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:51:04.320608 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-3ac9f66d-fc83-4cda-85a9-178293f0cdd1 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:51:04.321301 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-3ac9f66d-fc83-4cda-85a9-178293f0cdd1 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] [instance: 758db237-dbba-4741-81c4-a52b630f1de4] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:51:04.330379 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3ac9f66d-fc83-4cda-85a9-178293f0cdd1 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:04.331214 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3ac9f66d-fc83-4cda-85a9-178293f0cdd1 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:04.331715 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3ac9f66d-fc83-4cda-85a9-178293f0cdd1 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:04.332504 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3ac9f66d-fc83-4cda-85a9-178293f0cdd1 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:04.333013 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3ac9f66d-fc83-4cda-85a9-178293f0cdd1 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:04.333495 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3ac9f66d-fc83-4cda-85a9-178293f0cdd1 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:04.498206 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-3ac9f66d-fc83-4cda-85a9-178293f0cdd1 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3527811c42647d99491111361f6479d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab94b4108b3c46a6b527f647f6184d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:51:04.507168 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-3ac9f66d-fc83-4cda-85a9-178293f0cdd1 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] 10.222.0.33 "GET /compute/v2.1/servers/758db237-dbba-4741-81c4-a52b630f1de4" status: 200 len: 1679 microversion: 2.1 time: 0.190970 Oct 04 21:51:04.507791 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3554/7139] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:51:04 2022] GET /compute/v2.1/servers/758db237-dbba-4741-81c4-a52b630f1de4 => generated 1679 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:51:05.532583 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-300d2ef1-a177-47fe-ba79-4bd8ecca9206 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:51:05.533297 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-300d2ef1-a177-47fe-ba79-4bd8ecca9206 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] [instance: 758db237-dbba-4741-81c4-a52b630f1de4] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:51:05.543523 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-300d2ef1-a177-47fe-ba79-4bd8ecca9206 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:05.544123 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-300d2ef1-a177-47fe-ba79-4bd8ecca9206 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:05.544870 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-300d2ef1-a177-47fe-ba79-4bd8ecca9206 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:05.545654 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-300d2ef1-a177-47fe-ba79-4bd8ecca9206 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:05.546211 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-300d2ef1-a177-47fe-ba79-4bd8ecca9206 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:05.546812 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-300d2ef1-a177-47fe-ba79-4bd8ecca9206 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:05.713422 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-300d2ef1-a177-47fe-ba79-4bd8ecca9206 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3527811c42647d99491111361f6479d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab94b4108b3c46a6b527f647f6184d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:51:05.722837 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-300d2ef1-a177-47fe-ba79-4bd8ecca9206 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] 10.222.0.33 "GET /compute/v2.1/servers/758db237-dbba-4741-81c4-a52b630f1de4" status: 200 len: 1679 microversion: 2.1 time: 0.194440 Oct 04 21:51:05.723526 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3586/7140] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:51:05 2022] GET /compute/v2.1/servers/758db237-dbba-4741-81c4-a52b630f1de4 => generated 1679 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:51:06.748910 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9f99c67f-fbc8-4317-9f55-32de3469b3b2 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:51:06.749587 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-9f99c67f-fbc8-4317-9f55-32de3469b3b2 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] [instance: 758db237-dbba-4741-81c4-a52b630f1de4] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:51:06.757226 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9f99c67f-fbc8-4317-9f55-32de3469b3b2 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:06.757723 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9f99c67f-fbc8-4317-9f55-32de3469b3b2 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:06.758163 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9f99c67f-fbc8-4317-9f55-32de3469b3b2 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:06.758915 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9f99c67f-fbc8-4317-9f55-32de3469b3b2 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:06.759374 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9f99c67f-fbc8-4317-9f55-32de3469b3b2 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:06.759870 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9f99c67f-fbc8-4317-9f55-32de3469b3b2 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:06.921841 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-9f99c67f-fbc8-4317-9f55-32de3469b3b2 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3527811c42647d99491111361f6479d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab94b4108b3c46a6b527f647f6184d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:51:06.930369 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-9f99c67f-fbc8-4317-9f55-32de3469b3b2 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] 10.222.0.33 "GET /compute/v2.1/servers/758db237-dbba-4741-81c4-a52b630f1de4" status: 200 len: 1679 microversion: 2.1 time: 0.186880 Oct 04 21:51:06.930983 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3555/7141] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:51:06 2022] GET /compute/v2.1/servers/758db237-dbba-4741-81c4-a52b630f1de4 => generated 1679 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:51:07.956559 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-63fab7c7-b376-4452-b533-d7496f3051d7 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:51:07.957378 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-63fab7c7-b376-4452-b533-d7496f3051d7 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] [instance: 758db237-dbba-4741-81c4-a52b630f1de4] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:51:07.968144 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-63fab7c7-b376-4452-b533-d7496f3051d7 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:07.969018 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-63fab7c7-b376-4452-b533-d7496f3051d7 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:07.969812 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-63fab7c7-b376-4452-b533-d7496f3051d7 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:07.971279 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-63fab7c7-b376-4452-b533-d7496f3051d7 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:07.972173 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-63fab7c7-b376-4452-b533-d7496f3051d7 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:07.973044 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-63fab7c7-b376-4452-b533-d7496f3051d7 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:08.494402 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-63fab7c7-b376-4452-b533-d7496f3051d7 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3527811c42647d99491111361f6479d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab94b4108b3c46a6b527f647f6184d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:51:08.503246 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-63fab7c7-b376-4452-b533-d7496f3051d7 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] 10.222.0.33 "GET /compute/v2.1/servers/758db237-dbba-4741-81c4-a52b630f1de4" status: 200 len: 1679 microversion: 2.1 time: 0.551113 Oct 04 21:51:08.503854 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3587/7142] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:51:07 2022] GET /compute/v2.1/servers/758db237-dbba-4741-81c4-a52b630f1de4 => generated 1679 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:51:09.528864 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8bed3d1c-97c5-4d3e-9db2-f896dbe32f12 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:51:09.529624 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-8bed3d1c-97c5-4d3e-9db2-f896dbe32f12 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] [instance: 758db237-dbba-4741-81c4-a52b630f1de4] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:51:09.537215 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8bed3d1c-97c5-4d3e-9db2-f896dbe32f12 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:09.537707 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8bed3d1c-97c5-4d3e-9db2-f896dbe32f12 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:09.538141 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8bed3d1c-97c5-4d3e-9db2-f896dbe32f12 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:09.538886 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8bed3d1c-97c5-4d3e-9db2-f896dbe32f12 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:09.539400 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8bed3d1c-97c5-4d3e-9db2-f896dbe32f12 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:09.539763 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8bed3d1c-97c5-4d3e-9db2-f896dbe32f12 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:09.696779 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-8bed3d1c-97c5-4d3e-9db2-f896dbe32f12 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3527811c42647d99491111361f6479d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab94b4108b3c46a6b527f647f6184d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:51:09.710746 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-8bed3d1c-97c5-4d3e-9db2-f896dbe32f12 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] 10.222.0.33 "GET /compute/v2.1/servers/758db237-dbba-4741-81c4-a52b630f1de4" status: 200 len: 1679 microversion: 2.1 time: 0.186134 Oct 04 21:51:09.711786 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3556/7143] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:51:09 2022] GET /compute/v2.1/servers/758db237-dbba-4741-81c4-a52b630f1de4 => generated 1679 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:51:10.743005 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-a0271c78-ead5-4e9c-877e-2d790b3f28fc tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:51:10.743645 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-a0271c78-ead5-4e9c-877e-2d790b3f28fc tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] [instance: 758db237-dbba-4741-81c4-a52b630f1de4] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:51:10.751250 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a0271c78-ead5-4e9c-877e-2d790b3f28fc tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:10.751749 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a0271c78-ead5-4e9c-877e-2d790b3f28fc tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:10.752217 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a0271c78-ead5-4e9c-877e-2d790b3f28fc tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:10.752966 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a0271c78-ead5-4e9c-877e-2d790b3f28fc tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:10.753440 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a0271c78-ead5-4e9c-877e-2d790b3f28fc tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:10.753889 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a0271c78-ead5-4e9c-877e-2d790b3f28fc tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:10.935869 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-a0271c78-ead5-4e9c-877e-2d790b3f28fc tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3527811c42647d99491111361f6479d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab94b4108b3c46a6b527f647f6184d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:51:10.949344 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-a0271c78-ead5-4e9c-877e-2d790b3f28fc tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] 10.222.0.33 "GET /compute/v2.1/servers/758db237-dbba-4741-81c4-a52b630f1de4" status: 200 len: 1679 microversion: 2.1 time: 0.209940 Oct 04 21:51:10.950106 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3588/7144] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:51:10 2022] GET /compute/v2.1/servers/758db237-dbba-4741-81c4-a52b630f1de4 => generated 1679 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:51:11.976532 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7489bb69-d67f-4142-b886-8f30d2d3c4c3 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:51:11.977176 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-7489bb69-d67f-4142-b886-8f30d2d3c4c3 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] [instance: 758db237-dbba-4741-81c4-a52b630f1de4] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:51:11.985026 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7489bb69-d67f-4142-b886-8f30d2d3c4c3 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:11.985514 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7489bb69-d67f-4142-b886-8f30d2d3c4c3 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:11.985949 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7489bb69-d67f-4142-b886-8f30d2d3c4c3 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:11.986686 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7489bb69-d67f-4142-b886-8f30d2d3c4c3 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:11.987138 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7489bb69-d67f-4142-b886-8f30d2d3c4c3 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:11.987566 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7489bb69-d67f-4142-b886-8f30d2d3c4c3 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:12.132400 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-7489bb69-d67f-4142-b886-8f30d2d3c4c3 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3527811c42647d99491111361f6479d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab94b4108b3c46a6b527f647f6184d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:51:12.143011 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-7489bb69-d67f-4142-b886-8f30d2d3c4c3 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] 10.222.0.33 "GET /compute/v2.1/servers/758db237-dbba-4741-81c4-a52b630f1de4" status: 200 len: 1679 microversion: 2.1 time: 0.170306 Oct 04 21:51:12.143609 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3557/7145] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:51:11 2022] GET /compute/v2.1/servers/758db237-dbba-4741-81c4-a52b630f1de4 => generated 1679 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:51:13.172594 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-2bf8753d-f27c-4d16-a6d7-3820dd29dbb7 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:51:13.173275 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-2bf8753d-f27c-4d16-a6d7-3820dd29dbb7 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] [instance: 758db237-dbba-4741-81c4-a52b630f1de4] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:51:13.180907 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2bf8753d-f27c-4d16-a6d7-3820dd29dbb7 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:13.182196 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2bf8753d-f27c-4d16-a6d7-3820dd29dbb7 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:13.183172 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2bf8753d-f27c-4d16-a6d7-3820dd29dbb7 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:13.183918 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2bf8753d-f27c-4d16-a6d7-3820dd29dbb7 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:13.184399 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2bf8753d-f27c-4d16-a6d7-3820dd29dbb7 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:13.184847 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2bf8753d-f27c-4d16-a6d7-3820dd29dbb7 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:13.351328 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-2bf8753d-f27c-4d16-a6d7-3820dd29dbb7 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3527811c42647d99491111361f6479d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab94b4108b3c46a6b527f647f6184d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:51:13.360498 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-2bf8753d-f27c-4d16-a6d7-3820dd29dbb7 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] 10.222.0.33 "GET /compute/v2.1/servers/758db237-dbba-4741-81c4-a52b630f1de4" status: 200 len: 1679 microversion: 2.1 time: 0.192371 Oct 04 21:51:13.361115 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3589/7146] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:51:13 2022] GET /compute/v2.1/servers/758db237-dbba-4741-81c4-a52b630f1de4 => generated 1679 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:51:14.388053 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1a16eed3-5c6c-4ced-9541-67506491383c tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:51:14.388676 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-1a16eed3-5c6c-4ced-9541-67506491383c tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] [instance: 758db237-dbba-4741-81c4-a52b630f1de4] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:51:14.396227 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1a16eed3-5c6c-4ced-9541-67506491383c tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:14.396640 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1a16eed3-5c6c-4ced-9541-67506491383c tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:14.397060 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1a16eed3-5c6c-4ced-9541-67506491383c tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:14.397784 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1a16eed3-5c6c-4ced-9541-67506491383c tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:14.398248 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1a16eed3-5c6c-4ced-9541-67506491383c tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:14.398714 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1a16eed3-5c6c-4ced-9541-67506491383c tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:14.586071 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-1a16eed3-5c6c-4ced-9541-67506491383c tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3527811c42647d99491111361f6479d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab94b4108b3c46a6b527f647f6184d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:51:14.595967 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-1a16eed3-5c6c-4ced-9541-67506491383c tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] 10.222.0.33 "GET /compute/v2.1/servers/758db237-dbba-4741-81c4-a52b630f1de4" status: 200 len: 1679 microversion: 2.1 time: 0.212433 Oct 04 21:51:14.596587 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3558/7147] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:51:14 2022] GET /compute/v2.1/servers/758db237-dbba-4741-81c4-a52b630f1de4 => generated 1679 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:51:15.621706 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-f42fd7bf-51bf-4103-af15-b5a5cae660d4 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:51:15.622335 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-f42fd7bf-51bf-4103-af15-b5a5cae660d4 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] [instance: 758db237-dbba-4741-81c4-a52b630f1de4] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:51:15.630443 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f42fd7bf-51bf-4103-af15-b5a5cae660d4 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:15.630970 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f42fd7bf-51bf-4103-af15-b5a5cae660d4 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:15.631430 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f42fd7bf-51bf-4103-af15-b5a5cae660d4 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:15.632236 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f42fd7bf-51bf-4103-af15-b5a5cae660d4 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:15.632698 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f42fd7bf-51bf-4103-af15-b5a5cae660d4 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:15.633145 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f42fd7bf-51bf-4103-af15-b5a5cae660d4 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:15.792835 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-f42fd7bf-51bf-4103-af15-b5a5cae660d4 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3527811c42647d99491111361f6479d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab94b4108b3c46a6b527f647f6184d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:51:15.802441 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-f42fd7bf-51bf-4103-af15-b5a5cae660d4 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] 10.222.0.33 "GET /compute/v2.1/servers/758db237-dbba-4741-81c4-a52b630f1de4" status: 200 len: 1679 microversion: 2.1 time: 0.185190 Oct 04 21:51:15.805666 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3590/7148] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:51:15 2022] GET /compute/v2.1/servers/758db237-dbba-4741-81c4-a52b630f1de4 => generated 1679 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:51:16.832659 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1acb3ac8-61d9-488c-bb72-3355884e0f90 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:51:16.833849 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-1acb3ac8-61d9-488c-bb72-3355884e0f90 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] [instance: 758db237-dbba-4741-81c4-a52b630f1de4] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:51:16.847214 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1acb3ac8-61d9-488c-bb72-3355884e0f90 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:16.848076 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1acb3ac8-61d9-488c-bb72-3355884e0f90 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:16.848847 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1acb3ac8-61d9-488c-bb72-3355884e0f90 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:16.850163 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1acb3ac8-61d9-488c-bb72-3355884e0f90 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:16.851038 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1acb3ac8-61d9-488c-bb72-3355884e0f90 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:16.851808 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1acb3ac8-61d9-488c-bb72-3355884e0f90 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:17.057520 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-1acb3ac8-61d9-488c-bb72-3355884e0f90 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3527811c42647d99491111361f6479d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab94b4108b3c46a6b527f647f6184d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:51:17.073018 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-1acb3ac8-61d9-488c-bb72-3355884e0f90 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] 10.222.0.33 "GET /compute/v2.1/servers/758db237-dbba-4741-81c4-a52b630f1de4" status: 200 len: 1682 microversion: 2.1 time: 0.247243 Oct 04 21:51:17.074122 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3559/7149] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:51:16 2022] GET /compute/v2.1/servers/758db237-dbba-4741-81c4-a52b630f1de4 => generated 1682 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:51:41.312432 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-d2377b8e-ca59-42fe-9086-a1edf569b6f6 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:51:41.314874 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-d2377b8e-ca59-42fe-9086-a1edf569b6f6 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] [instance: 758db237-dbba-4741-81c4-a52b630f1de4] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:51:41.317357 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_api:SELECT=16 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:51:41.318161 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:51:41.325078 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d2377b8e-ca59-42fe-9086-a1edf569b6f6 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:41.325586 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d2377b8e-ca59-42fe-9086-a1edf569b6f6 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:41.326041 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d2377b8e-ca59-42fe-9086-a1edf569b6f6 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:41.326891 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d2377b8e-ca59-42fe-9086-a1edf569b6f6 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:41.327450 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d2377b8e-ca59-42fe-9086-a1edf569b6f6 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:41.328001 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d2377b8e-ca59-42fe-9086-a1edf569b6f6 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:41.409379 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-d2377b8e-ca59-42fe-9086-a1edf569b6f6 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] 10.222.0.33 "POST /compute/v2.1/servers/758db237-dbba-4741-81c4-a52b630f1de4/action" status: 200 len: 69003 microversion: 2.1 time: 0.101919 Oct 04 21:51:41.410714 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3591/7150] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 21:51:41 2022] POST /compute/v2.1/servers/758db237-dbba-4741-81c4-a52b630f1de4/action => generated 69003 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 21:51:48.973318 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-159d5f1f-845c-44cc-a593-544475e2c6c6 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:51:48.983141 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-1f8642ec-8409-4f0c-8c4c-0edd215e50d1 req-b73d4e21-39ac-40fb-9eee-be03d1c190c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "758db237-dbba-4741-81c4-a52b630f1de4", "tag": "e6392f8c-ba9e-47dd-a9d8-d2af2a836335"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:51:48.986630 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-159d5f1f-845c-44cc-a593-544475e2c6c6 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] [instance: 758db237-dbba-4741-81c4-a52b630f1de4] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:51:48.989146 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=16 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:51:48.989839 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=48 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:51:48.998462 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-159d5f1f-845c-44cc-a593-544475e2c6c6 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:48.999331 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-159d5f1f-845c-44cc-a593-544475e2c6c6 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:48.999785 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-159d5f1f-845c-44cc-a593-544475e2c6c6 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:49.000536 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-159d5f1f-845c-44cc-a593-544475e2c6c6 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:49.001058 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-159d5f1f-845c-44cc-a593-544475e2c6c6 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:49.001490 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-159d5f1f-845c-44cc-a593-544475e2c6c6 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:49.002776 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-1f8642ec-8409-4f0c-8c4c-0edd215e50d1 req-b73d4e21-39ac-40fb-9eee-be03d1c190c6 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:49.003696 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-1f8642ec-8409-4f0c-8c4c-0edd215e50d1 req-b73d4e21-39ac-40fb-9eee-be03d1c190c6 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:49.004521 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-1f8642ec-8409-4f0c-8c4c-0edd215e50d1 req-b73d4e21-39ac-40fb-9eee-be03d1c190c6 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:49.031331 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-1f8642ec-8409-4f0c-8c4c-0edd215e50d1 req-b73d4e21-39ac-40fb-9eee-be03d1c190c6 service nova] Creating event network-changed:e6392f8c-ba9e-47dd-a9d8-d2af2a836335 for instance 758db237-dbba-4741-81c4-a52b630f1de4 on n-h2-854823-8 Oct 04 21:51:49.043365 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-1f8642ec-8409-4f0c-8c4c-0edd215e50d1 req-b73d4e21-39ac-40fb-9eee-be03d1c190c6 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066107 Oct 04 21:51:49.044939 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3592/7151] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:51:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:51:49.053813 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-159d5f1f-845c-44cc-a593-544475e2c6c6 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] [instance: 758db237-dbba-4741-81c4-a52b630f1de4] Going to try to terminate instance {{(pid=128801) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:51:49.199412 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-159d5f1f-845c-44cc-a593-544475e2c6c6 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] 10.222.0.33 "DELETE /compute/v2.1/servers/758db237-dbba-4741-81c4-a52b630f1de4" status: 204 len: 0 microversion: 2.1 time: 0.232588 Oct 04 21:51:49.200811 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3560/7152] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 21:51:48 2022] DELETE /compute/v2.1/servers/758db237-dbba-4741-81c4-a52b630f1de4 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:51:49.219871 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-12469261-48a5-4548-bffe-f01d84df7f97 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:51:49.222502 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-12469261-48a5-4548-bffe-f01d84df7f97 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] [instance: 758db237-dbba-4741-81c4-a52b630f1de4] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:51:49.235078 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-12469261-48a5-4548-bffe-f01d84df7f97 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:49.236310 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-12469261-48a5-4548-bffe-f01d84df7f97 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:49.237134 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-12469261-48a5-4548-bffe-f01d84df7f97 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:49.238817 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-12469261-48a5-4548-bffe-f01d84df7f97 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:49.239839 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-12469261-48a5-4548-bffe-f01d84df7f97 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:49.241035 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-12469261-48a5-4548-bffe-f01d84df7f97 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:49.583422 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-12469261-48a5-4548-bffe-f01d84df7f97 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3527811c42647d99491111361f6479d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab94b4108b3c46a6b527f647f6184d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:51:49.600220 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-12469261-48a5-4548-bffe-f01d84df7f97 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] 10.222.0.33 "GET /compute/v2.1/servers/758db237-dbba-4741-81c4-a52b630f1de4" status: 200 len: 1688 microversion: 2.1 time: 0.391951 Oct 04 21:51:49.601323 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3593/7153] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:51:49 2022] GET /compute/v2.1/servers/758db237-dbba-4741-81c4-a52b630f1de4 => generated 1688 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:51:50.630212 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2bc1f05d-e7dc-49a8-a8ad-0a86ec5032e8 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:51:50.631418 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-2bc1f05d-e7dc-49a8-a8ad-0a86ec5032e8 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] [instance: 758db237-dbba-4741-81c4-a52b630f1de4] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:51:50.648030 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2bc1f05d-e7dc-49a8-a8ad-0a86ec5032e8 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:50.650254 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2bc1f05d-e7dc-49a8-a8ad-0a86ec5032e8 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:50.650254 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2bc1f05d-e7dc-49a8-a8ad-0a86ec5032e8 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:50.651582 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2bc1f05d-e7dc-49a8-a8ad-0a86ec5032e8 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:50.652415 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2bc1f05d-e7dc-49a8-a8ad-0a86ec5032e8 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:50.653208 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2bc1f05d-e7dc-49a8-a8ad-0a86ec5032e8 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:50.973018 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-2bc1f05d-e7dc-49a8-a8ad-0a86ec5032e8 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3527811c42647d99491111361f6479d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab94b4108b3c46a6b527f647f6184d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:51:50.989452 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-2bc1f05d-e7dc-49a8-a8ad-0a86ec5032e8 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] 10.222.0.33 "GET /compute/v2.1/servers/758db237-dbba-4741-81c4-a52b630f1de4" status: 200 len: 1688 microversion: 2.1 time: 0.366811 Oct 04 21:51:50.991066 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3561/7154] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:51:50 2022] GET /compute/v2.1/servers/758db237-dbba-4741-81c4-a52b630f1de4 => generated 1688 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:51:51.393094 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-91570c75-a0bc-45f7-8d05-bde088351a29 req-9ec57db5-2b8b-459e-b987-8aede21703b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "758db237-dbba-4741-81c4-a52b630f1de4", "name": "network-vif-deleted", "tag": "e6392f8c-ba9e-47dd-a9d8-d2af2a836335"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:51:51.412497 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-91570c75-a0bc-45f7-8d05-bde088351a29 req-9ec57db5-2b8b-459e-b987-8aede21703b9 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:51.413014 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-91570c75-a0bc-45f7-8d05-bde088351a29 req-9ec57db5-2b8b-459e-b987-8aede21703b9 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:51.413468 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-91570c75-a0bc-45f7-8d05-bde088351a29 req-9ec57db5-2b8b-459e-b987-8aede21703b9 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:51.427419 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-91570c75-a0bc-45f7-8d05-bde088351a29 req-9ec57db5-2b8b-459e-b987-8aede21703b9 service nova] Creating event network-vif-deleted:e6392f8c-ba9e-47dd-a9d8-d2af2a836335 for instance 758db237-dbba-4741-81c4-a52b630f1de4 on n-h2-854823-8 Oct 04 21:51:51.433522 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-91570c75-a0bc-45f7-8d05-bde088351a29 req-9ec57db5-2b8b-459e-b987-8aede21703b9 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045845 Oct 04 21:51:51.434161 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3594/7155] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:51:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:51:52.019141 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b158cc32-0107-4cf0-ad99-1dc7f1fca60d tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:51:52.019831 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-b158cc32-0107-4cf0-ad99-1dc7f1fca60d tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] [instance: 758db237-dbba-4741-81c4-a52b630f1de4] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:51:52.027992 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b158cc32-0107-4cf0-ad99-1dc7f1fca60d tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:52.028825 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b158cc32-0107-4cf0-ad99-1dc7f1fca60d tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:52.029549 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b158cc32-0107-4cf0-ad99-1dc7f1fca60d tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:52.030293 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b158cc32-0107-4cf0-ad99-1dc7f1fca60d tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:51:52.030793 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b158cc32-0107-4cf0-ad99-1dc7f1fca60d tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:51:52.031229 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-b158cc32-0107-4cf0-ad99-1dc7f1fca60d tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:51:52.048404 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-b158cc32-0107-4cf0-ad99-1dc7f1fca60d tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] HTTP exception thrown: Instance 758db237-dbba-4741-81c4-a52b630f1de4 could not be found. Oct 04 21:51:52.050103 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b158cc32-0107-4cf0-ad99-1dc7f1fca60d tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Request method failure captured: Oct 04 21:51:52.050103 n-d-854823-8 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/758db237-dbba-4741-81c4-a52b630f1de4 HTTP/1.1 Oct 04 21:51:52.050103 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 21:51:52.050103 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 21:51:52.050103 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 21:51:52.050103 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 0 Oct 04 21:51:52.050103 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 21:51:52.050103 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 21:51:52.050103 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 21:51:52.050103 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 21:51:52.050103 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPKpBWf-ZdDHioKk7j1GCDpSV4CNRjR-HsBeRw5uM8vLVrE4RAbnqqIyB__lIo4YB-nPYiZgBfW-sd_MC5MrdTXH2d0mlcXhungwp23-mUfKzbPqcsQDk2EjQ-fmeT9DeObGTOq1tP4JZSLD8LNhyn4WTlxw8LmfuqpFt38X2o1fTW7c Oct 04 21:51:52.050103 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 21:51:52.050103 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 21:51:52.050103 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 21:51:52.050103 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 21:51:52.050103 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 21:51:52.050103 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 21:51:52.050103 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: ab94b4108b3c46a6b527f647f6184d9f Oct 04 21:51:52.050103 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-2019967856 Oct 04 21:51:52.050103 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 21:51:52.050103 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 21:51:52.050103 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ab94b4108b3c46a6b527f647f6184d9f", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ab94b4108b3c46a6b527f647f6184d9f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ab94b4108b3c46a6b527f647f6184d9f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ab94b4108b3c46a6b527f647f6184d9f"}]}] Oct 04 21:51:52.050103 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-TestNetworkAdvancedServerOps-2019967856 Oct 04 21:51:52.050103 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: ab94b4108b3c46a6b527f647f6184d9f Oct 04 21:51:52.050103 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-2019967856 Oct 04 21:51:52.050103 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-TestNetworkAdvancedServerOps-2019967856-project Oct 04 21:51:52.050103 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 21:51:52.050103 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 21:51:52.050103 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: e3527811c42647d99491111361f6479d Oct 04 21:51:52.050103 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-TestNetworkAdvancedServerOps-2019967856-project Oct 04 21:51:52.050103 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 21:51:52.050103 n-d-854823-8 devstack@n-api.service[128801]: exception: Instance 758db237-dbba-4741-81c4-a52b630f1de4 could not be found. Oct 04 21:51:52.050103 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': '758db237-dbba-4741-81c4-a52b630f1de4'} Oct 04 21:51:52.050103 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:51:52.050103 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:51:52.050103 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:51:52.050103 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:51:52.050103 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:51:52.050103 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:51:52.050103 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:51:52.050103 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:51:52.050103 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:51:52.050103 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:51:52.050103 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 758db237-dbba-4741-81c4-a52b630f1de4 could not be found. Oct 04 21:51:52.050103 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:51:52.050103 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:51:52.050103 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:51:52.050103 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:51:52.050103 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:51:52.050103 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:51:52.050103 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:51:52.050103 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:51:52.050103 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:51:52.050103 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:51:52.050103 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:51:52.050103 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:51:52.050103 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:51:52.050103 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:51:52.050103 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:51:52.050103 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:51:52.050103 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 758db237-dbba-4741-81c4-a52b630f1de4 could not be found. Oct 04 21:51:52.050103 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:51:52.050103 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:51:52.055615 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:51:52.055615 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:51:52.055615 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:51:52.055615 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:51:52.055615 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:51:52.055615 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:51:52.055615 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 758db237-dbba-4741-81c4-a52b630f1de4 could not be found. Oct 04 21:51:52.055615 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:51:52.057101 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-b158cc32-0107-4cf0-ad99-1dc7f1fca60d tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Returning 404 to user: Instance 758db237-dbba-4741-81c4-a52b630f1de4 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:51:52.057989 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-b158cc32-0107-4cf0-ad99-1dc7f1fca60d tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] 10.222.0.33 "GET /compute/v2.1/servers/758db237-dbba-4741-81c4-a52b630f1de4" status: 404 len: 111 microversion: 2.1 time: 0.043325 Oct 04 21:51:52.058626 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3562/7156] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:51:52 2022] GET /compute/v2.1/servers/758db237-dbba-4741-81c4-a52b630f1de4 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 21:51:56.117370 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-55340af4-89cc-4d3b-9132-24e53a95c152 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Calling method '.version_select at 0x7f3c74332a60>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:51:56.147988 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-55340af4-89cc-4d3b-9132-24e53a95c152 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2031474118" status: 202 len: 0 microversion: 2.1 time: 0.037802 Oct 04 21:51:56.149425 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3595/7157] 10.222.0.33 () {58 vars in 1284 bytes} [Tue Oct 4 21:51:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2031474118 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:51:56.193264 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-111d4481-f00b-494f-a8ba-cc944e16f73a tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Action: 'create', calling method: .version_select at 0x7f3c74a65820>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-999860993", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF+2rGMlMUnqcwz+t8p58pOJVn+AX+TG+UIHGi2F5uDLmOC+bcLr5vkRuyUBM8Ozy8dpc8wXQfwHflyDr6UYIvT0nlXufjNM8JQVoM0T+cx63iB+XFt8z6NIa5Sw5Hm73w=="}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:51:56.217717 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-111d4481-f00b-494f-a8ba-cc944e16f73a tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Getting quotas for project ab94b4108b3c46a6b527f647f6184d9f. Resources: {'key_pairs'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:51:56.224038 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-111d4481-f00b-494f-a8ba-cc944e16f73a tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Getting quotas for user e3527811c42647d99491111361f6479d and project ab94b4108b3c46a6b527f647f6184d9f. Resources: {'key_pairs'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:51:56.253361 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-111d4481-f00b-494f-a8ba-cc944e16f73a tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.067822 Oct 04 21:51:56.254037 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3563/7158] 10.222.0.33 () {60 vars in 1159 bytes} [Tue Oct 4 21:51:56 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:52:03.748352 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=14 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:52:03.757619 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-c4ee74c7-afaf-43ac-a7a3-3dabe2c5c7db tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1004109786", "imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63", "flavorRef": "452", "networks": [{"uuid": "e35b3968-bc3e-4c1d-b3f8-17883396abe4"}], "key_name": "tempest-TestNetworkAdvancedServerOps-999860993", "security_groups": [{"name": "tempest-secgroup-smoke-1897818504"}]}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:52:03.957876 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.network.neutron [None req-c4ee74c7-afaf-43ac-a7a3-3dabe2c5c7db tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] validate_networks() for [('e35b3968-bc3e-4c1d-b3f8-17883396abe4', None, None, None, None, None)] {{(pid=128802) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:52:04.595676 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-c4ee74c7-afaf-43ac-a7a3-3dabe2c5c7db tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Flavor limits 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:52:04.596375 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-c4ee74c7-afaf-43ac-a7a3-3dabe2c5c7db tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Image limits 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:52:04.597485 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-c4ee74c7-afaf-43ac-a7a3-3dabe2c5c7db tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Flavor pref 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:52:04.598187 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-c4ee74c7-afaf-43ac-a7a3-3dabe2c5c7db tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Image pref 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:52:04.599021 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-c4ee74c7-afaf-43ac-a7a3-3dabe2c5c7db tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:52:04.611898 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c4ee74c7-afaf-43ac-a7a3-3dabe2c5c7db tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:04.612560 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c4ee74c7-afaf-43ac-a7a3-3dabe2c5c7db tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:04.613124 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c4ee74c7-afaf-43ac-a7a3-3dabe2c5c7db tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:04.614168 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c4ee74c7-afaf-43ac-a7a3-3dabe2c5c7db tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:04.614781 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c4ee74c7-afaf-43ac-a7a3-3dabe2c5c7db tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:04.615331 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c4ee74c7-afaf-43ac-a7a3-3dabe2c5c7db tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:04.639468 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-c4ee74c7-afaf-43ac-a7a3-3dabe2c5c7db tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Getting quotas for project ab94b4108b3c46a6b527f647f6184d9f. Resources: {'ram', 'instances', 'cores'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:52:04.647013 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-c4ee74c7-afaf-43ac-a7a3-3dabe2c5c7db tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Getting quotas for user e3527811c42647d99491111361f6479d and project ab94b4108b3c46a6b527f647f6184d9f. Resources: {'ram', 'instances', 'cores'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:52:04.667803 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-c4ee74c7-afaf-43ac-a7a3-3dabe2c5c7db tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Going to run 1 instances... {{(pid=128802) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:52:04.671428 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-c4ee74c7-afaf-43ac-a7a3-3dabe2c5c7db tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] [instance: 35c5d2d8-26c3-433f-9073-bc66f16458f2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='15b24725-0c99-4bcf-b1fb-907cdf8e2d63',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128802) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:52:04.741276 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-c4ee74c7-afaf-43ac-a7a3-3dabe2c5c7db tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.996719 Oct 04 21:52:04.742734 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3596/7159] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 21:52:03 2022] POST /compute/v2.1/servers => generated 406 bytes in 1001 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:52:04.755398 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:52:04.764420 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7b33b4c7-a09b-4428-8b0d-0b5c837aa760 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:52:04.766398 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-7b33b4c7-a09b-4428-8b0d-0b5c837aa760 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] [instance: 35c5d2d8-26c3-433f-9073-bc66f16458f2] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:52:05.211813 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-7b33b4c7-a09b-4428-8b0d-0b5c837aa760 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3527811c42647d99491111361f6479d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab94b4108b3c46a6b527f647f6184d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:52:05.221965 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-7b33b4c7-a09b-4428-8b0d-0b5c837aa760 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] 10.222.0.33 "GET /compute/v2.1/servers/35c5d2d8-26c3-433f-9073-bc66f16458f2" status: 200 len: 1266 microversion: 2.1 time: 0.469546 Oct 04 21:52:05.222615 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3564/7160] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:52:04 2022] GET /compute/v2.1/servers/35c5d2d8-26c3-433f-9073-bc66f16458f2 => generated 1266 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:52:06.266313 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-c62cd72c-0da9-49ab-90fa-6cf0d5a57a77 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:52:06.268691 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-c62cd72c-0da9-49ab-90fa-6cf0d5a57a77 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] [instance: 35c5d2d8-26c3-433f-9073-bc66f16458f2] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:52:06.288357 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c62cd72c-0da9-49ab-90fa-6cf0d5a57a77 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:06.290129 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c62cd72c-0da9-49ab-90fa-6cf0d5a57a77 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:06.291323 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c62cd72c-0da9-49ab-90fa-6cf0d5a57a77 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:06.293937 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c62cd72c-0da9-49ab-90fa-6cf0d5a57a77 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:06.295409 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c62cd72c-0da9-49ab-90fa-6cf0d5a57a77 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:06.296629 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c62cd72c-0da9-49ab-90fa-6cf0d5a57a77 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:06.447497 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-c62cd72c-0da9-49ab-90fa-6cf0d5a57a77 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3527811c42647d99491111361f6479d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab94b4108b3c46a6b527f647f6184d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:52:06.466431 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-c62cd72c-0da9-49ab-90fa-6cf0d5a57a77 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] 10.222.0.33 "GET /compute/v2.1/servers/35c5d2d8-26c3-433f-9073-bc66f16458f2" status: 200 len: 1326 microversion: 2.1 time: 0.207783 Oct 04 21:52:06.467516 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3597/7161] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:52:06 2022] GET /compute/v2.1/servers/35c5d2d8-26c3-433f-9073-bc66f16458f2 => generated 1326 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:52:07.511575 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-fe817df3-162f-49f8-a4a0-219573138ab4 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:52:07.512472 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-fe817df3-162f-49f8-a4a0-219573138ab4 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] [instance: 35c5d2d8-26c3-433f-9073-bc66f16458f2] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:52:07.526899 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fe817df3-162f-49f8-a4a0-219573138ab4 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:07.528142 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fe817df3-162f-49f8-a4a0-219573138ab4 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:07.529421 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fe817df3-162f-49f8-a4a0-219573138ab4 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:07.531033 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fe817df3-162f-49f8-a4a0-219573138ab4 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:07.532178 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fe817df3-162f-49f8-a4a0-219573138ab4 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:07.533201 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fe817df3-162f-49f8-a4a0-219573138ab4 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:07.919104 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-fe817df3-162f-49f8-a4a0-219573138ab4 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3527811c42647d99491111361f6479d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab94b4108b3c46a6b527f647f6184d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:52:07.942698 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-fe817df3-162f-49f8-a4a0-219573138ab4 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] 10.222.0.33 "GET /compute/v2.1/servers/35c5d2d8-26c3-433f-9073-bc66f16458f2" status: 200 len: 1392 microversion: 2.1 time: 0.438611 Oct 04 21:52:07.946941 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3565/7162] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:52:07 2022] GET /compute/v2.1/servers/35c5d2d8-26c3-433f-9073-bc66f16458f2 => generated 1392 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:52:08.828772 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-02ba7500-62c0-460a-9c9d-784a96c2c0c9 req-171b7256-78dc-4319-973b-336186c96ad6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "35c5d2d8-26c3-433f-9073-bc66f16458f2", "tag": "03c8be33-feb4-4691-8220-4d4404b67fd0"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:52:08.843471 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-02ba7500-62c0-460a-9c9d-784a96c2c0c9 req-171b7256-78dc-4319-973b-336186c96ad6 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:08.844344 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-02ba7500-62c0-460a-9c9d-784a96c2c0c9 req-171b7256-78dc-4319-973b-336186c96ad6 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:08.845148 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-02ba7500-62c0-460a-9c9d-784a96c2c0c9 req-171b7256-78dc-4319-973b-336186c96ad6 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:08.867505 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-02ba7500-62c0-460a-9c9d-784a96c2c0c9 req-171b7256-78dc-4319-973b-336186c96ad6 service nova] Creating event network-changed:03c8be33-feb4-4691-8220-4d4404b67fd0 for instance 35c5d2d8-26c3-433f-9073-bc66f16458f2 on n-h1-854823-8 Oct 04 21:52:08.874740 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-02ba7500-62c0-460a-9c9d-784a96c2c0c9 req-171b7256-78dc-4319-973b-336186c96ad6 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.172419 Oct 04 21:52:08.876012 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3598/7163] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:52:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:52:08.989835 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-34d83bef-f437-46bd-b701-b893d922d2d1 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:52:08.990746 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-34d83bef-f437-46bd-b701-b893d922d2d1 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] [instance: 35c5d2d8-26c3-433f-9073-bc66f16458f2] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:52:08.998501 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-34d83bef-f437-46bd-b701-b893d922d2d1 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:08.999246 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-34d83bef-f437-46bd-b701-b893d922d2d1 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:08.999488 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-34d83bef-f437-46bd-b701-b893d922d2d1 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:09.001415 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-34d83bef-f437-46bd-b701-b893d922d2d1 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:09.001415 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-34d83bef-f437-46bd-b701-b893d922d2d1 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:09.001415 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-34d83bef-f437-46bd-b701-b893d922d2d1 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:09.252549 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-34d83bef-f437-46bd-b701-b893d922d2d1 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3527811c42647d99491111361f6479d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab94b4108b3c46a6b527f647f6184d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:52:09.263337 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-34d83bef-f437-46bd-b701-b893d922d2d1 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] 10.222.0.33 "GET /compute/v2.1/servers/35c5d2d8-26c3-433f-9073-bc66f16458f2" status: 200 len: 1392 microversion: 2.1 time: 0.279800 Oct 04 21:52:09.264166 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3566/7164] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:52:08 2022] GET /compute/v2.1/servers/35c5d2d8-26c3-433f-9073-bc66f16458f2 => generated 1392 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:52:10.306703 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-940accaa-3e14-4f3b-92ad-51529597b6ef tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:52:10.308204 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-940accaa-3e14-4f3b-92ad-51529597b6ef tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] [instance: 35c5d2d8-26c3-433f-9073-bc66f16458f2] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:52:10.319043 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-940accaa-3e14-4f3b-92ad-51529597b6ef tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:10.320790 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-940accaa-3e14-4f3b-92ad-51529597b6ef tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:10.321453 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-940accaa-3e14-4f3b-92ad-51529597b6ef tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:10.322439 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-940accaa-3e14-4f3b-92ad-51529597b6ef tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:10.323003 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-940accaa-3e14-4f3b-92ad-51529597b6ef tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:10.323614 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-940accaa-3e14-4f3b-92ad-51529597b6ef tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:10.615952 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-940accaa-3e14-4f3b-92ad-51529597b6ef tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3527811c42647d99491111361f6479d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab94b4108b3c46a6b527f647f6184d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:52:10.630229 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-940accaa-3e14-4f3b-92ad-51529597b6ef tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] 10.222.0.33 "GET /compute/v2.1/servers/35c5d2d8-26c3-433f-9073-bc66f16458f2" status: 200 len: 1392 microversion: 2.1 time: 0.333113 Oct 04 21:52:10.631370 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3599/7165] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:52:10 2022] GET /compute/v2.1/servers/35c5d2d8-26c3-433f-9073-bc66f16458f2 => generated 1392 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:52:11.658611 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a79296a6-aa0e-43b7-bc82-1c71fd4f2121 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:52:11.660982 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a79296a6-aa0e-43b7-bc82-1c71fd4f2121 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] [instance: 35c5d2d8-26c3-433f-9073-bc66f16458f2] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:52:11.675436 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a79296a6-aa0e-43b7-bc82-1c71fd4f2121 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:11.676596 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a79296a6-aa0e-43b7-bc82-1c71fd4f2121 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:11.677334 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a79296a6-aa0e-43b7-bc82-1c71fd4f2121 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:11.678579 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a79296a6-aa0e-43b7-bc82-1c71fd4f2121 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:11.679442 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a79296a6-aa0e-43b7-bc82-1c71fd4f2121 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:11.680378 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a79296a6-aa0e-43b7-bc82-1c71fd4f2121 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:11.901322 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-a79296a6-aa0e-43b7-bc82-1c71fd4f2121 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3527811c42647d99491111361f6479d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab94b4108b3c46a6b527f647f6184d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:52:11.916127 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a79296a6-aa0e-43b7-bc82-1c71fd4f2121 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] 10.222.0.33 "GET /compute/v2.1/servers/35c5d2d8-26c3-433f-9073-bc66f16458f2" status: 200 len: 1392 microversion: 2.1 time: 0.263024 Oct 04 21:52:11.917091 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3567/7166] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:52:11 2022] GET /compute/v2.1/servers/35c5d2d8-26c3-433f-9073-bc66f16458f2 => generated 1392 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:52:12.946791 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-0d0e9c03-98b2-4d5b-8fec-ef22a5917009 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:52:12.947834 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-0d0e9c03-98b2-4d5b-8fec-ef22a5917009 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] [instance: 35c5d2d8-26c3-433f-9073-bc66f16458f2] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:52:12.951164 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_api:SELECT=33,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:52:12.956943 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0d0e9c03-98b2-4d5b-8fec-ef22a5917009 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:12.957461 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0d0e9c03-98b2-4d5b-8fec-ef22a5917009 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:12.957925 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0d0e9c03-98b2-4d5b-8fec-ef22a5917009 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:12.958726 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0d0e9c03-98b2-4d5b-8fec-ef22a5917009 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:12.959233 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0d0e9c03-98b2-4d5b-8fec-ef22a5917009 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:12.959680 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0d0e9c03-98b2-4d5b-8fec-ef22a5917009 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:13.158084 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-0d0e9c03-98b2-4d5b-8fec-ef22a5917009 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3527811c42647d99491111361f6479d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab94b4108b3c46a6b527f647f6184d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:52:13.171453 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-0d0e9c03-98b2-4d5b-8fec-ef22a5917009 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] 10.222.0.33 "GET /compute/v2.1/servers/35c5d2d8-26c3-433f-9073-bc66f16458f2" status: 200 len: 1392 microversion: 2.1 time: 0.228445 Oct 04 21:52:13.172336 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3600/7167] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:52:12 2022] GET /compute/v2.1/servers/35c5d2d8-26c3-433f-9073-bc66f16458f2 => generated 1392 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:52:14.203736 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d1d82744-a089-49e8-b5f3-e8188fb4e865 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:52:14.204400 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d1d82744-a089-49e8-b5f3-e8188fb4e865 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] [instance: 35c5d2d8-26c3-433f-9073-bc66f16458f2] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:52:14.213837 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d1d82744-a089-49e8-b5f3-e8188fb4e865 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:14.214255 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d1d82744-a089-49e8-b5f3-e8188fb4e865 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:14.214763 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d1d82744-a089-49e8-b5f3-e8188fb4e865 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:14.215501 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d1d82744-a089-49e8-b5f3-e8188fb4e865 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:14.215986 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d1d82744-a089-49e8-b5f3-e8188fb4e865 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:14.216421 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d1d82744-a089-49e8-b5f3-e8188fb4e865 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:14.371521 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d1d82744-a089-49e8-b5f3-e8188fb4e865 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3527811c42647d99491111361f6479d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab94b4108b3c46a6b527f647f6184d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:52:14.379935 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d1d82744-a089-49e8-b5f3-e8188fb4e865 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] 10.222.0.33 "GET /compute/v2.1/servers/35c5d2d8-26c3-433f-9073-bc66f16458f2" status: 200 len: 1392 microversion: 2.1 time: 0.180295 Oct 04 21:52:14.380531 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3568/7168] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:52:14 2022] GET /compute/v2.1/servers/35c5d2d8-26c3-433f-9073-bc66f16458f2 => generated 1392 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:52:14.765456 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-e55bd970-43f5-459a-9204-3ff3efff19fb req-ef3cfaf5-9f8b-4197-b696-de17202e59c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35c5d2d8-26c3-433f-9073-bc66f16458f2", "name": "network-vif-plugged", "status": "completed", "tag": "03c8be33-feb4-4691-8220-4d4404b67fd0"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:52:14.776184 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell0:SELECT=2 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:52:14.777427 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell0:SELECT=6 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:52:14.789364 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-e55bd970-43f5-459a-9204-3ff3efff19fb req-ef3cfaf5-9f8b-4197-b696-de17202e59c5 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:14.790134 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-e55bd970-43f5-459a-9204-3ff3efff19fb req-ef3cfaf5-9f8b-4197-b696-de17202e59c5 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:14.790850 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-e55bd970-43f5-459a-9204-3ff3efff19fb req-ef3cfaf5-9f8b-4197-b696-de17202e59c5 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:14.817952 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-e55bd970-43f5-459a-9204-3ff3efff19fb req-ef3cfaf5-9f8b-4197-b696-de17202e59c5 service nova] Creating event network-vif-plugged:03c8be33-feb4-4691-8220-4d4404b67fd0 for instance 35c5d2d8-26c3-433f-9073-bc66f16458f2 on n-h1-854823-8 Oct 04 21:52:14.827601 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-e55bd970-43f5-459a-9204-3ff3efff19fb req-ef3cfaf5-9f8b-4197-b696-de17202e59c5 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069106 Oct 04 21:52:14.828668 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3601/7169] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:52:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:52:15.405979 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a8126e7f-2d72-4f50-b5b2-442b07e99c8f tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:52:15.406823 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a8126e7f-2d72-4f50-b5b2-442b07e99c8f tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] [instance: 35c5d2d8-26c3-433f-9073-bc66f16458f2] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:52:15.409572 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=6 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:52:15.417817 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a8126e7f-2d72-4f50-b5b2-442b07e99c8f tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:15.418370 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a8126e7f-2d72-4f50-b5b2-442b07e99c8f tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:15.418931 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a8126e7f-2d72-4f50-b5b2-442b07e99c8f tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:15.419713 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a8126e7f-2d72-4f50-b5b2-442b07e99c8f tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:15.420233 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a8126e7f-2d72-4f50-b5b2-442b07e99c8f tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:15.420707 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a8126e7f-2d72-4f50-b5b2-442b07e99c8f tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:15.582705 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-a8126e7f-2d72-4f50-b5b2-442b07e99c8f tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3527811c42647d99491111361f6479d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab94b4108b3c46a6b527f647f6184d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:52:15.592605 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a8126e7f-2d72-4f50-b5b2-442b07e99c8f tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] 10.222.0.33 "GET /compute/v2.1/servers/35c5d2d8-26c3-433f-9073-bc66f16458f2" status: 200 len: 1392 microversion: 2.1 time: 0.190898 Oct 04 21:52:15.593234 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3569/7170] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:52:15 2022] GET /compute/v2.1/servers/35c5d2d8-26c3-433f-9073-bc66f16458f2 => generated 1392 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:52:16.621735 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-ec82d113-3337-4db0-b7a9-eacc43a8a825 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:52:16.622808 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-ec82d113-3337-4db0-b7a9-eacc43a8a825 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] [instance: 35c5d2d8-26c3-433f-9073-bc66f16458f2] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:52:16.629769 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ec82d113-3337-4db0-b7a9-eacc43a8a825 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:16.630540 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ec82d113-3337-4db0-b7a9-eacc43a8a825 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:16.631123 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ec82d113-3337-4db0-b7a9-eacc43a8a825 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:16.632016 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ec82d113-3337-4db0-b7a9-eacc43a8a825 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:16.632591 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ec82d113-3337-4db0-b7a9-eacc43a8a825 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:16.633127 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ec82d113-3337-4db0-b7a9-eacc43a8a825 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:16.852871 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-ec82d113-3337-4db0-b7a9-eacc43a8a825 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3527811c42647d99491111361f6479d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab94b4108b3c46a6b527f647f6184d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:52:16.863053 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-ec82d113-3337-4db0-b7a9-eacc43a8a825 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] 10.222.0.33 "GET /compute/v2.1/servers/35c5d2d8-26c3-433f-9073-bc66f16458f2" status: 200 len: 1564 microversion: 2.1 time: 0.247349 Oct 04 21:52:16.863852 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3602/7171] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:52:16 2022] GET /compute/v2.1/servers/35c5d2d8-26c3-433f-9073-bc66f16458f2 => generated 1564 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:52:16.887689 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-904e9ac8-1b09-4e14-8c6a-c36e564655ce tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:52:16.888507 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-904e9ac8-1b09-4e14-8c6a-c36e564655ce tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] [instance: 35c5d2d8-26c3-433f-9073-bc66f16458f2] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:52:16.895690 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-904e9ac8-1b09-4e14-8c6a-c36e564655ce tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:16.896181 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-904e9ac8-1b09-4e14-8c6a-c36e564655ce tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:16.896662 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-904e9ac8-1b09-4e14-8c6a-c36e564655ce tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:16.898074 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-904e9ac8-1b09-4e14-8c6a-c36e564655ce tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:16.898578 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-904e9ac8-1b09-4e14-8c6a-c36e564655ce tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:16.899077 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-904e9ac8-1b09-4e14-8c6a-c36e564655ce tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:17.072606 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-904e9ac8-1b09-4e14-8c6a-c36e564655ce tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3527811c42647d99491111361f6479d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab94b4108b3c46a6b527f647f6184d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:52:17.083084 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-904e9ac8-1b09-4e14-8c6a-c36e564655ce tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] 10.222.0.33 "GET /compute/v2.1/servers/35c5d2d8-26c3-433f-9073-bc66f16458f2" status: 200 len: 1564 microversion: 2.1 time: 0.199440 Oct 04 21:52:17.083924 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3570/7172] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:52:16 2022] GET /compute/v2.1/servers/35c5d2d8-26c3-433f-9073-bc66f16458f2 => generated 1564 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:52:19.442872 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-d8cc1420-d5ff-4430-b890-9b06a391f99b tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:52:19.449848 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-b3c00c8d-17ef-413b-ac8b-6348ef1a7dff req-aec20615-fde8-4258-80bb-c245867f8202 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "35c5d2d8-26c3-433f-9073-bc66f16458f2", "tag": "03c8be33-feb4-4691-8220-4d4404b67fd0"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:52:19.450890 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-d8cc1420-d5ff-4430-b890-9b06a391f99b tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] [instance: 35c5d2d8-26c3-433f-9073-bc66f16458f2] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:52:19.458325 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d8cc1420-d5ff-4430-b890-9b06a391f99b tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:19.459851 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d8cc1420-d5ff-4430-b890-9b06a391f99b tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:19.461687 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d8cc1420-d5ff-4430-b890-9b06a391f99b tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:19.462073 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:52:19.463514 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d8cc1420-d5ff-4430-b890-9b06a391f99b tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:19.464261 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d8cc1420-d5ff-4430-b890-9b06a391f99b tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:19.465254 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d8cc1420-d5ff-4430-b890-9b06a391f99b tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:19.467091 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-b3c00c8d-17ef-413b-ac8b-6348ef1a7dff req-aec20615-fde8-4258-80bb-c245867f8202 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:19.467897 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-b3c00c8d-17ef-413b-ac8b-6348ef1a7dff req-aec20615-fde8-4258-80bb-c245867f8202 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:19.468519 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-b3c00c8d-17ef-413b-ac8b-6348ef1a7dff req-aec20615-fde8-4258-80bb-c245867f8202 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:19.483858 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-b3c00c8d-17ef-413b-ac8b-6348ef1a7dff req-aec20615-fde8-4258-80bb-c245867f8202 service nova] Creating event network-changed:03c8be33-feb4-4691-8220-4d4404b67fd0 for instance 35c5d2d8-26c3-433f-9073-bc66f16458f2 on n-h1-854823-8 Oct 04 21:52:19.489589 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-b3c00c8d-17ef-413b-ac8b-6348ef1a7dff req-aec20615-fde8-4258-80bb-c245867f8202 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043424 Oct 04 21:52:19.491224 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3571/7173] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:52:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:52:19.767599 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-d8cc1420-d5ff-4430-b890-9b06a391f99b tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3527811c42647d99491111361f6479d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab94b4108b3c46a6b527f647f6184d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:52:19.785512 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-d8cc1420-d5ff-4430-b890-9b06a391f99b tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] 10.222.0.33 "GET /compute/v2.1/servers/35c5d2d8-26c3-433f-9073-bc66f16458f2" status: 200 len: 1564 microversion: 2.1 time: 0.347056 Oct 04 21:52:19.787382 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3603/7174] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:52:19 2022] GET /compute/v2.1/servers/35c5d2d8-26c3-433f-9073-bc66f16458f2 => generated 1564 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:52:43.129188 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=38 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:52:43.134968 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6ad3f492-8094-4159-8ac6-463d73979a65 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:52:43.137466 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-6ad3f492-8094-4159-8ac6-463d73979a65 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] [instance: 35c5d2d8-26c3-433f-9073-bc66f16458f2] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:52:43.147411 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6ad3f492-8094-4159-8ac6-463d73979a65 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:43.147917 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6ad3f492-8094-4159-8ac6-463d73979a65 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:43.148361 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6ad3f492-8094-4159-8ac6-463d73979a65 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:43.149102 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6ad3f492-8094-4159-8ac6-463d73979a65 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:43.149563 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6ad3f492-8094-4159-8ac6-463d73979a65 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:43.149997 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6ad3f492-8094-4159-8ac6-463d73979a65 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:43.210372 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-6ad3f492-8094-4159-8ac6-463d73979a65 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] 10.222.0.33 "POST /compute/v2.1/servers/35c5d2d8-26c3-433f-9073-bc66f16458f2/action" status: 200 len: 24570 microversion: 2.1 time: 0.083471 Oct 04 21:52:43.211085 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3572/7175] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 21:52:43 2022] POST /compute/v2.1/servers/35c5d2d8-26c3-433f-9073-bc66f16458f2/action => generated 24570 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 21:52:54.188340 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-0a6906f6-ab68-4e55-9e8e-c1fb9cc37bbc tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:52:54.191091 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-0a6906f6-ab68-4e55-9e8e-c1fb9cc37bbc tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] [instance: 35c5d2d8-26c3-433f-9073-bc66f16458f2] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:52:54.195406 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_api:SELECT=7 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:52:54.196178 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=36 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:52:54.202957 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0a6906f6-ab68-4e55-9e8e-c1fb9cc37bbc tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:54.203591 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0a6906f6-ab68-4e55-9e8e-c1fb9cc37bbc tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:54.204272 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0a6906f6-ab68-4e55-9e8e-c1fb9cc37bbc tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:54.205087 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0a6906f6-ab68-4e55-9e8e-c1fb9cc37bbc tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:54.205617 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0a6906f6-ab68-4e55-9e8e-c1fb9cc37bbc tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:54.206115 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0a6906f6-ab68-4e55-9e8e-c1fb9cc37bbc tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:54.260080 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-0a6906f6-ab68-4e55-9e8e-c1fb9cc37bbc tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'e3527811c42647d99491111361f6479d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab94b4108b3c46a6b527f647f6184d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:52:54.274163 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-0a6906f6-ab68-4e55-9e8e-c1fb9cc37bbc tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] [instance: 35c5d2d8-26c3-433f-9073-bc66f16458f2] Old instance type m1.heat2, new instance type m1.heat {{(pid=128802) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 04 21:52:54.287950 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-0a6906f6-ab68-4e55-9e8e-c1fb9cc37bbc tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Flavor limits 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:52:54.288725 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-0a6906f6-ab68-4e55-9e8e-c1fb9cc37bbc tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Image limits 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:52:54.289642 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-0a6906f6-ab68-4e55-9e8e-c1fb9cc37bbc tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Flavor pref 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:52:54.290418 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-0a6906f6-ab68-4e55-9e8e-c1fb9cc37bbc tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Image pref 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:52:54.291462 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-0a6906f6-ab68-4e55-9e8e-c1fb9cc37bbc tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:52:54.388873 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-0a6906f6-ab68-4e55-9e8e-c1fb9cc37bbc tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] 10.222.0.33 "POST /compute/v2.1/servers/35c5d2d8-26c3-433f-9073-bc66f16458f2/action" status: 202 len: 0 microversion: 2.1 time: 0.205205 Oct 04 21:52:54.389723 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3604/7176] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 21:52:54 2022] POST /compute/v2.1/servers/35c5d2d8-26c3-433f-9073-bc66f16458f2/action => generated 0 bytes in 207 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 21:52:54.400214 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-327af177-88a3-48ba-9b70-d48450f06bd7 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:52:54.401340 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-327af177-88a3-48ba-9b70-d48450f06bd7 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] [instance: 35c5d2d8-26c3-433f-9073-bc66f16458f2] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:52:54.404105 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=3 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:52:54.404807 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=4 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:52:54.411356 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-327af177-88a3-48ba-9b70-d48450f06bd7 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:54.412448 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-327af177-88a3-48ba-9b70-d48450f06bd7 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:54.412906 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-327af177-88a3-48ba-9b70-d48450f06bd7 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:54.413663 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-327af177-88a3-48ba-9b70-d48450f06bd7 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:54.414330 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-327af177-88a3-48ba-9b70-d48450f06bd7 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:54.414794 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-327af177-88a3-48ba-9b70-d48450f06bd7 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:54.617990 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-327af177-88a3-48ba-9b70-d48450f06bd7 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3527811c42647d99491111361f6479d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab94b4108b3c46a6b527f647f6184d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:52:54.631114 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-327af177-88a3-48ba-9b70-d48450f06bd7 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] 10.222.0.33 "GET /compute/v2.1/servers/35c5d2d8-26c3-433f-9073-bc66f16458f2" status: 200 len: 1692 microversion: 2.1 time: 0.236185 Oct 04 21:52:54.631852 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3573/7177] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:52:54 2022] GET /compute/v2.1/servers/35c5d2d8-26c3-433f-9073-bc66f16458f2 => generated 1692 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:52:55.659152 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-cdb03e84-fed8-4f46-917f-5a42f12d327c tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:52:55.659834 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-cdb03e84-fed8-4f46-917f-5a42f12d327c tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] [instance: 35c5d2d8-26c3-433f-9073-bc66f16458f2] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:52:55.668794 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cdb03e84-fed8-4f46-917f-5a42f12d327c tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:55.669318 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cdb03e84-fed8-4f46-917f-5a42f12d327c tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:55.669779 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cdb03e84-fed8-4f46-917f-5a42f12d327c tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:55.670563 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cdb03e84-fed8-4f46-917f-5a42f12d327c tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:55.671045 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cdb03e84-fed8-4f46-917f-5a42f12d327c tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:55.671494 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-cdb03e84-fed8-4f46-917f-5a42f12d327c tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:55.906048 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-cdb03e84-fed8-4f46-917f-5a42f12d327c tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3527811c42647d99491111361f6479d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab94b4108b3c46a6b527f647f6184d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:52:55.917106 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-cdb03e84-fed8-4f46-917f-5a42f12d327c tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] 10.222.0.33 "GET /compute/v2.1/servers/35c5d2d8-26c3-433f-9073-bc66f16458f2" status: 200 len: 1692 microversion: 2.1 time: 0.263503 Oct 04 21:52:55.917722 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3605/7178] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:52:55 2022] GET /compute/v2.1/servers/35c5d2d8-26c3-433f-9073-bc66f16458f2 => generated 1692 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:52:56.949291 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-03d1d009-ea19-463b-9f52-704b8a94a6b2 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:52:56.950613 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-03d1d009-ea19-463b-9f52-704b8a94a6b2 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] [instance: 35c5d2d8-26c3-433f-9073-bc66f16458f2] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:52:56.965773 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-03d1d009-ea19-463b-9f52-704b8a94a6b2 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:56.966731 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-03d1d009-ea19-463b-9f52-704b8a94a6b2 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:56.967546 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-03d1d009-ea19-463b-9f52-704b8a94a6b2 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:56.968870 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-03d1d009-ea19-463b-9f52-704b8a94a6b2 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:56.969719 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-03d1d009-ea19-463b-9f52-704b8a94a6b2 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:56.970564 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-03d1d009-ea19-463b-9f52-704b8a94a6b2 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:57.244412 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-03d1d009-ea19-463b-9f52-704b8a94a6b2 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3527811c42647d99491111361f6479d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab94b4108b3c46a6b527f647f6184d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:52:57.254103 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-03d1d009-ea19-463b-9f52-704b8a94a6b2 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] 10.222.0.33 "GET /compute/v2.1/servers/35c5d2d8-26c3-433f-9073-bc66f16458f2" status: 200 len: 1692 microversion: 2.1 time: 0.313365 Oct 04 21:52:57.254916 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3574/7179] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:52:56 2022] GET /compute/v2.1/servers/35c5d2d8-26c3-433f-9073-bc66f16458f2 => generated 1692 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:52:58.279589 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-e3516579-8b91-4add-9188-ee9e134ccda1 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:52:58.280246 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-e3516579-8b91-4add-9188-ee9e134ccda1 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] [instance: 35c5d2d8-26c3-433f-9073-bc66f16458f2] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:52:58.287763 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e3516579-8b91-4add-9188-ee9e134ccda1 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:58.288271 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e3516579-8b91-4add-9188-ee9e134ccda1 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:58.288726 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e3516579-8b91-4add-9188-ee9e134ccda1 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:58.289474 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e3516579-8b91-4add-9188-ee9e134ccda1 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:58.289942 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e3516579-8b91-4add-9188-ee9e134ccda1 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:58.290411 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e3516579-8b91-4add-9188-ee9e134ccda1 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:58.461682 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-e3516579-8b91-4add-9188-ee9e134ccda1 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3527811c42647d99491111361f6479d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab94b4108b3c46a6b527f647f6184d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:52:58.478480 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-e3516579-8b91-4add-9188-ee9e134ccda1 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] 10.222.0.33 "GET /compute/v2.1/servers/35c5d2d8-26c3-433f-9073-bc66f16458f2" status: 200 len: 1697 microversion: 2.1 time: 0.202609 Oct 04 21:52:58.479590 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3606/7180] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:52:58 2022] GET /compute/v2.1/servers/35c5d2d8-26c3-433f-9073-bc66f16458f2 => generated 1697 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:52:59.505165 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1e60b328-9837-486b-8bd1-0236e5f784b9 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:52:59.505889 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-1e60b328-9837-486b-8bd1-0236e5f784b9 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] [instance: 35c5d2d8-26c3-433f-9073-bc66f16458f2] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:52:59.513414 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1e60b328-9837-486b-8bd1-0236e5f784b9 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:59.514113 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1e60b328-9837-486b-8bd1-0236e5f784b9 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:59.514649 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1e60b328-9837-486b-8bd1-0236e5f784b9 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:59.515461 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1e60b328-9837-486b-8bd1-0236e5f784b9 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:52:59.516230 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1e60b328-9837-486b-8bd1-0236e5f784b9 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:52:59.516966 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1e60b328-9837-486b-8bd1-0236e5f784b9 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:52:59.684748 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-1e60b328-9837-486b-8bd1-0236e5f784b9 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3527811c42647d99491111361f6479d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab94b4108b3c46a6b527f647f6184d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:52:59.694427 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-1e60b328-9837-486b-8bd1-0236e5f784b9 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] 10.222.0.33 "GET /compute/v2.1/servers/35c5d2d8-26c3-433f-9073-bc66f16458f2" status: 200 len: 1697 microversion: 2.1 time: 0.193568 Oct 04 21:52:59.695147 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3575/7181] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:52:59 2022] GET /compute/v2.1/servers/35c5d2d8-26c3-433f-9073-bc66f16458f2 => generated 1697 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:53:00.722550 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-9415a43d-b34f-4e93-815c-9e6c26ea7efc tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:00.723913 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-9415a43d-b34f-4e93-815c-9e6c26ea7efc tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] [instance: 35c5d2d8-26c3-433f-9073-bc66f16458f2] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:53:00.732193 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9415a43d-b34f-4e93-815c-9e6c26ea7efc tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:00.732705 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9415a43d-b34f-4e93-815c-9e6c26ea7efc tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:00.733159 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9415a43d-b34f-4e93-815c-9e6c26ea7efc tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:00.733915 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9415a43d-b34f-4e93-815c-9e6c26ea7efc tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:00.734504 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9415a43d-b34f-4e93-815c-9e6c26ea7efc tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:00.734961 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9415a43d-b34f-4e93-815c-9e6c26ea7efc tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:00.894897 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-9415a43d-b34f-4e93-815c-9e6c26ea7efc tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3527811c42647d99491111361f6479d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab94b4108b3c46a6b527f647f6184d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:00.904442 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-9415a43d-b34f-4e93-815c-9e6c26ea7efc tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] 10.222.0.33 "GET /compute/v2.1/servers/35c5d2d8-26c3-433f-9073-bc66f16458f2" status: 200 len: 1697 microversion: 2.1 time: 0.186276 Oct 04 21:53:00.905064 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3607/7182] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:53:00 2022] GET /compute/v2.1/servers/35c5d2d8-26c3-433f-9073-bc66f16458f2 => generated 1697 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:53:01.931556 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-cb4a7d7a-7b03-4a2f-86a8-7aaf47ffeb5a tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:01.932355 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-cb4a7d7a-7b03-4a2f-86a8-7aaf47ffeb5a tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] [instance: 35c5d2d8-26c3-433f-9073-bc66f16458f2] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:53:01.940103 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cb4a7d7a-7b03-4a2f-86a8-7aaf47ffeb5a tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:01.940689 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cb4a7d7a-7b03-4a2f-86a8-7aaf47ffeb5a tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:01.941223 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cb4a7d7a-7b03-4a2f-86a8-7aaf47ffeb5a tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:01.943206 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cb4a7d7a-7b03-4a2f-86a8-7aaf47ffeb5a tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:01.943787 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cb4a7d7a-7b03-4a2f-86a8-7aaf47ffeb5a tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:01.944328 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cb4a7d7a-7b03-4a2f-86a8-7aaf47ffeb5a tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:02.112229 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-cb4a7d7a-7b03-4a2f-86a8-7aaf47ffeb5a tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3527811c42647d99491111361f6479d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab94b4108b3c46a6b527f647f6184d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:02.122247 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-cb4a7d7a-7b03-4a2f-86a8-7aaf47ffeb5a tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] 10.222.0.33 "GET /compute/v2.1/servers/35c5d2d8-26c3-433f-9073-bc66f16458f2" status: 200 len: 1697 microversion: 2.1 time: 0.194751 Oct 04 21:53:02.122908 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3576/7183] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:53:01 2022] GET /compute/v2.1/servers/35c5d2d8-26c3-433f-9073-bc66f16458f2 => generated 1697 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:53:03.148119 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-fcbbff3c-fa23-41dc-82fc-b383762082b3 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:03.148752 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-fcbbff3c-fa23-41dc-82fc-b383762082b3 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] [instance: 35c5d2d8-26c3-433f-9073-bc66f16458f2] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:53:03.156020 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fcbbff3c-fa23-41dc-82fc-b383762082b3 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:03.156533 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fcbbff3c-fa23-41dc-82fc-b383762082b3 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:03.156991 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fcbbff3c-fa23-41dc-82fc-b383762082b3 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:03.157728 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fcbbff3c-fa23-41dc-82fc-b383762082b3 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:03.158209 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fcbbff3c-fa23-41dc-82fc-b383762082b3 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:03.158687 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fcbbff3c-fa23-41dc-82fc-b383762082b3 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:03.321125 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-fcbbff3c-fa23-41dc-82fc-b383762082b3 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3527811c42647d99491111361f6479d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab94b4108b3c46a6b527f647f6184d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:03.337657 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-fcbbff3c-fa23-41dc-82fc-b383762082b3 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] 10.222.0.33 "GET /compute/v2.1/servers/35c5d2d8-26c3-433f-9073-bc66f16458f2" status: 200 len: 1697 microversion: 2.1 time: 0.193986 Oct 04 21:53:03.338934 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3608/7184] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:53:03 2022] GET /compute/v2.1/servers/35c5d2d8-26c3-433f-9073-bc66f16458f2 => generated 1697 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:53:04.384065 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8e13ca96-0ab2-4b3b-aba2-33bc6edd8fca tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:04.385717 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-8e13ca96-0ab2-4b3b-aba2-33bc6edd8fca tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] [instance: 35c5d2d8-26c3-433f-9073-bc66f16458f2] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:53:04.395837 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8e13ca96-0ab2-4b3b-aba2-33bc6edd8fca tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:04.396675 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8e13ca96-0ab2-4b3b-aba2-33bc6edd8fca tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:04.397130 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8e13ca96-0ab2-4b3b-aba2-33bc6edd8fca tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:04.397902 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8e13ca96-0ab2-4b3b-aba2-33bc6edd8fca tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:04.398405 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8e13ca96-0ab2-4b3b-aba2-33bc6edd8fca tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:04.398840 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8e13ca96-0ab2-4b3b-aba2-33bc6edd8fca tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:04.575662 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-8e13ca96-0ab2-4b3b-aba2-33bc6edd8fca tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3527811c42647d99491111361f6479d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab94b4108b3c46a6b527f647f6184d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:04.586561 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-8e13ca96-0ab2-4b3b-aba2-33bc6edd8fca tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] 10.222.0.33 "GET /compute/v2.1/servers/35c5d2d8-26c3-433f-9073-bc66f16458f2" status: 200 len: 1697 microversion: 2.1 time: 0.210638 Oct 04 21:53:04.587272 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3577/7185] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:53:04 2022] GET /compute/v2.1/servers/35c5d2d8-26c3-433f-9073-bc66f16458f2 => generated 1697 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:53:05.612390 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-c9ee8349-6b65-4b01-82a0-b194bd192162 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:05.613038 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-c9ee8349-6b65-4b01-82a0-b194bd192162 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] [instance: 35c5d2d8-26c3-433f-9073-bc66f16458f2] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:53:05.621319 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c9ee8349-6b65-4b01-82a0-b194bd192162 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:05.621835 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c9ee8349-6b65-4b01-82a0-b194bd192162 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:05.622294 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c9ee8349-6b65-4b01-82a0-b194bd192162 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:05.623079 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c9ee8349-6b65-4b01-82a0-b194bd192162 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:05.623561 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c9ee8349-6b65-4b01-82a0-b194bd192162 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:05.624007 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c9ee8349-6b65-4b01-82a0-b194bd192162 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:05.807982 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-c9ee8349-6b65-4b01-82a0-b194bd192162 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3527811c42647d99491111361f6479d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab94b4108b3c46a6b527f647f6184d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:05.822218 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-c9ee8349-6b65-4b01-82a0-b194bd192162 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] 10.222.0.33 "GET /compute/v2.1/servers/35c5d2d8-26c3-433f-9073-bc66f16458f2" status: 200 len: 1697 microversion: 2.1 time: 0.213587 Oct 04 21:53:05.823264 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3609/7186] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:53:05 2022] GET /compute/v2.1/servers/35c5d2d8-26c3-433f-9073-bc66f16458f2 => generated 1697 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:53:06.850814 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-bca96a09-ffb9-4fbd-ac6b-2d1458c9581a tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:06.851436 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-bca96a09-ffb9-4fbd-ac6b-2d1458c9581a tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] [instance: 35c5d2d8-26c3-433f-9073-bc66f16458f2] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:53:06.858980 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bca96a09-ffb9-4fbd-ac6b-2d1458c9581a tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:06.859540 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bca96a09-ffb9-4fbd-ac6b-2d1458c9581a tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:06.859998 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bca96a09-ffb9-4fbd-ac6b-2d1458c9581a tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:06.860733 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bca96a09-ffb9-4fbd-ac6b-2d1458c9581a tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:06.861202 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bca96a09-ffb9-4fbd-ac6b-2d1458c9581a tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:06.861639 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bca96a09-ffb9-4fbd-ac6b-2d1458c9581a tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:07.022613 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-bca96a09-ffb9-4fbd-ac6b-2d1458c9581a tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3527811c42647d99491111361f6479d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab94b4108b3c46a6b527f647f6184d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:07.031799 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-bca96a09-ffb9-4fbd-ac6b-2d1458c9581a tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] 10.222.0.33 "GET /compute/v2.1/servers/35c5d2d8-26c3-433f-9073-bc66f16458f2" status: 200 len: 1697 microversion: 2.1 time: 0.185631 Oct 04 21:53:07.032419 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3578/7187] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:53:06 2022] GET /compute/v2.1/servers/35c5d2d8-26c3-433f-9073-bc66f16458f2 => generated 1697 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:53:08.057162 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-a057b513-2c70-4aed-9ab4-da3d1e4b5c15 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:08.057731 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-a057b513-2c70-4aed-9ab4-da3d1e4b5c15 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] [instance: 35c5d2d8-26c3-433f-9073-bc66f16458f2] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:53:08.065726 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a057b513-2c70-4aed-9ab4-da3d1e4b5c15 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:08.066296 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a057b513-2c70-4aed-9ab4-da3d1e4b5c15 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:08.067570 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a057b513-2c70-4aed-9ab4-da3d1e4b5c15 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:08.068533 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a057b513-2c70-4aed-9ab4-da3d1e4b5c15 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:08.069111 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a057b513-2c70-4aed-9ab4-da3d1e4b5c15 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:08.069678 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a057b513-2c70-4aed-9ab4-da3d1e4b5c15 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:08.243248 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-a057b513-2c70-4aed-9ab4-da3d1e4b5c15 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3527811c42647d99491111361f6479d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab94b4108b3c46a6b527f647f6184d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:08.252210 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-a057b513-2c70-4aed-9ab4-da3d1e4b5c15 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] 10.222.0.33 "GET /compute/v2.1/servers/35c5d2d8-26c3-433f-9073-bc66f16458f2" status: 200 len: 1697 microversion: 2.1 time: 0.199017 Oct 04 21:53:08.252833 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3610/7188] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:53:08 2022] GET /compute/v2.1/servers/35c5d2d8-26c3-433f-9073-bc66f16458f2 => generated 1697 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:53:09.278787 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d6e93abc-d37e-454d-b9d5-8bff8ccec249 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:09.279600 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d6e93abc-d37e-454d-b9d5-8bff8ccec249 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] [instance: 35c5d2d8-26c3-433f-9073-bc66f16458f2] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:53:09.289318 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d6e93abc-d37e-454d-b9d5-8bff8ccec249 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:09.289861 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d6e93abc-d37e-454d-b9d5-8bff8ccec249 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:09.290367 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d6e93abc-d37e-454d-b9d5-8bff8ccec249 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:09.291570 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d6e93abc-d37e-454d-b9d5-8bff8ccec249 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:09.292081 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d6e93abc-d37e-454d-b9d5-8bff8ccec249 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:09.292590 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d6e93abc-d37e-454d-b9d5-8bff8ccec249 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:09.477317 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d6e93abc-d37e-454d-b9d5-8bff8ccec249 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3527811c42647d99491111361f6479d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab94b4108b3c46a6b527f647f6184d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:09.489178 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d6e93abc-d37e-454d-b9d5-8bff8ccec249 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] 10.222.0.33 "GET /compute/v2.1/servers/35c5d2d8-26c3-433f-9073-bc66f16458f2" status: 200 len: 1697 microversion: 2.1 time: 0.214333 Oct 04 21:53:09.489868 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3579/7189] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:53:09 2022] GET /compute/v2.1/servers/35c5d2d8-26c3-433f-9073-bc66f16458f2 => generated 1697 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:53:10.527778 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-55fc16bc-d88c-475d-8dd3-b953850ec234 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:10.528490 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-55fc16bc-d88c-475d-8dd3-b953850ec234 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] [instance: 35c5d2d8-26c3-433f-9073-bc66f16458f2] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:53:10.537180 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-55fc16bc-d88c-475d-8dd3-b953850ec234 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:10.538415 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-55fc16bc-d88c-475d-8dd3-b953850ec234 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:10.539248 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-55fc16bc-d88c-475d-8dd3-b953850ec234 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:10.540114 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-55fc16bc-d88c-475d-8dd3-b953850ec234 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:10.540949 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-55fc16bc-d88c-475d-8dd3-b953850ec234 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:10.541497 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-55fc16bc-d88c-475d-8dd3-b953850ec234 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:10.696750 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-55fc16bc-d88c-475d-8dd3-b953850ec234 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3527811c42647d99491111361f6479d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab94b4108b3c46a6b527f647f6184d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:10.708114 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-55fc16bc-d88c-475d-8dd3-b953850ec234 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] 10.222.0.33 "GET /compute/v2.1/servers/35c5d2d8-26c3-433f-9073-bc66f16458f2" status: 200 len: 1697 microversion: 2.1 time: 0.183815 Oct 04 21:53:10.708807 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3611/7190] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:53:10 2022] GET /compute/v2.1/servers/35c5d2d8-26c3-433f-9073-bc66f16458f2 => generated 1697 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:53:11.742257 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-bb3a389e-38ef-47a9-a75e-f6bcca0a6465 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:11.742914 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-bb3a389e-38ef-47a9-a75e-f6bcca0a6465 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] [instance: 35c5d2d8-26c3-433f-9073-bc66f16458f2] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:53:11.750151 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bb3a389e-38ef-47a9-a75e-f6bcca0a6465 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:11.750710 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bb3a389e-38ef-47a9-a75e-f6bcca0a6465 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:11.751152 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bb3a389e-38ef-47a9-a75e-f6bcca0a6465 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:11.751881 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bb3a389e-38ef-47a9-a75e-f6bcca0a6465 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:11.752342 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bb3a389e-38ef-47a9-a75e-f6bcca0a6465 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:11.752771 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bb3a389e-38ef-47a9-a75e-f6bcca0a6465 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:11.914571 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-bb3a389e-38ef-47a9-a75e-f6bcca0a6465 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3527811c42647d99491111361f6479d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab94b4108b3c46a6b527f647f6184d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:11.923861 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-bb3a389e-38ef-47a9-a75e-f6bcca0a6465 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] 10.222.0.33 "GET /compute/v2.1/servers/35c5d2d8-26c3-433f-9073-bc66f16458f2" status: 200 len: 1697 microversion: 2.1 time: 0.186840 Oct 04 21:53:11.924639 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3580/7191] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:53:11 2022] GET /compute/v2.1/servers/35c5d2d8-26c3-433f-9073-bc66f16458f2 => generated 1697 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:53:12.952693 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-e3c00a18-1988-4d00-8e92-a2f43b851fe2 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:12.953489 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-e3c00a18-1988-4d00-8e92-a2f43b851fe2 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] [instance: 35c5d2d8-26c3-433f-9073-bc66f16458f2] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:53:12.962302 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e3c00a18-1988-4d00-8e92-a2f43b851fe2 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:12.962871 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e3c00a18-1988-4d00-8e92-a2f43b851fe2 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:12.963322 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e3c00a18-1988-4d00-8e92-a2f43b851fe2 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:12.964098 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e3c00a18-1988-4d00-8e92-a2f43b851fe2 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:12.964598 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e3c00a18-1988-4d00-8e92-a2f43b851fe2 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:12.965051 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e3c00a18-1988-4d00-8e92-a2f43b851fe2 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:13.139917 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-e3c00a18-1988-4d00-8e92-a2f43b851fe2 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3527811c42647d99491111361f6479d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab94b4108b3c46a6b527f647f6184d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:13.155448 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-e3c00a18-1988-4d00-8e92-a2f43b851fe2 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] 10.222.0.33 "GET /compute/v2.1/servers/35c5d2d8-26c3-433f-9073-bc66f16458f2" status: 200 len: 1697 microversion: 2.1 time: 0.206424 Oct 04 21:53:13.156547 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3612/7192] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:53:12 2022] GET /compute/v2.1/servers/35c5d2d8-26c3-433f-9073-bc66f16458f2 => generated 1697 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:53:14.185619 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-bd4fca06-ddcf-45e1-a249-c2fba469fdb1 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:14.186802 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-bd4fca06-ddcf-45e1-a249-c2fba469fdb1 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] [instance: 35c5d2d8-26c3-433f-9073-bc66f16458f2] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:53:14.199781 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bd4fca06-ddcf-45e1-a249-c2fba469fdb1 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:14.200645 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bd4fca06-ddcf-45e1-a249-c2fba469fdb1 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:14.201418 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bd4fca06-ddcf-45e1-a249-c2fba469fdb1 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:14.202723 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bd4fca06-ddcf-45e1-a249-c2fba469fdb1 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:14.203505 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bd4fca06-ddcf-45e1-a249-c2fba469fdb1 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:14.204267 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bd4fca06-ddcf-45e1-a249-c2fba469fdb1 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:14.421169 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-bd4fca06-ddcf-45e1-a249-c2fba469fdb1 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3527811c42647d99491111361f6479d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab94b4108b3c46a6b527f647f6184d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:14.432130 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-bd4fca06-ddcf-45e1-a249-c2fba469fdb1 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] 10.222.0.33 "GET /compute/v2.1/servers/35c5d2d8-26c3-433f-9073-bc66f16458f2" status: 200 len: 1697 microversion: 2.1 time: 0.253798 Oct 04 21:53:14.432755 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3581/7193] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:53:14 2022] GET /compute/v2.1/servers/35c5d2d8-26c3-433f-9073-bc66f16458f2 => generated 1697 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:53:15.201836 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-a8ea5e11-ae17-4887-9e29-2f18a983ce44 req-2885f4e3-4cf7-468a-b9ec-94775f96cec4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35c5d2d8-26c3-433f-9073-bc66f16458f2", "name": "network-vif-unplugged", "status": "completed", "tag": "03c8be33-feb4-4691-8220-4d4404b67fd0"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:53:15.217029 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-a8ea5e11-ae17-4887-9e29-2f18a983ce44 req-2885f4e3-4cf7-468a-b9ec-94775f96cec4 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:15.217767 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-a8ea5e11-ae17-4887-9e29-2f18a983ce44 req-2885f4e3-4cf7-468a-b9ec-94775f96cec4 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:15.218567 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-a8ea5e11-ae17-4887-9e29-2f18a983ce44 req-2885f4e3-4cf7-468a-b9ec-94775f96cec4 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:15.240492 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-a8ea5e11-ae17-4887-9e29-2f18a983ce44 req-2885f4e3-4cf7-468a-b9ec-94775f96cec4 service nova] Creating event network-vif-unplugged:03c8be33-feb4-4691-8220-4d4404b67fd0 for instance 35c5d2d8-26c3-433f-9073-bc66f16458f2 on n-h2-854823-8 Oct 04 21:53:15.248562 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [req-a8ea5e11-ae17-4887-9e29-2f18a983ce44 req-2885f4e3-4cf7-468a-b9ec-94775f96cec4 service nova] Instance 35c5d2d8-26c3-433f-9073-bc66f16458f2 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854823-8', 'n-h2-854823-8'} {{(pid=128802) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 21:53:15.264307 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-a8ea5e11-ae17-4887-9e29-2f18a983ce44 req-2885f4e3-4cf7-468a-b9ec-94775f96cec4 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.067708 Oct 04 21:53:15.265503 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3613/7194] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:53:15 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:53:15.470252 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-161285c6-254c-4ff6-9e32-4f5864f5d7f8 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:15.471321 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-161285c6-254c-4ff6-9e32-4f5864f5d7f8 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] [instance: 35c5d2d8-26c3-433f-9073-bc66f16458f2] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:53:15.481072 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-161285c6-254c-4ff6-9e32-4f5864f5d7f8 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:15.481818 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-161285c6-254c-4ff6-9e32-4f5864f5d7f8 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:15.482676 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-161285c6-254c-4ff6-9e32-4f5864f5d7f8 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:15.483777 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-161285c6-254c-4ff6-9e32-4f5864f5d7f8 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:15.484318 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-161285c6-254c-4ff6-9e32-4f5864f5d7f8 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:15.484796 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-161285c6-254c-4ff6-9e32-4f5864f5d7f8 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:15.679185 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-161285c6-254c-4ff6-9e32-4f5864f5d7f8 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3527811c42647d99491111361f6479d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab94b4108b3c46a6b527f647f6184d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:15.689530 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-161285c6-254c-4ff6-9e32-4f5864f5d7f8 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] 10.222.0.33 "GET /compute/v2.1/servers/35c5d2d8-26c3-433f-9073-bc66f16458f2" status: 200 len: 1696 microversion: 2.1 time: 0.223616 Oct 04 21:53:15.690487 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3582/7195] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:53:15 2022] GET /compute/v2.1/servers/35c5d2d8-26c3-433f-9073-bc66f16458f2 => generated 1696 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:53:16.725077 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-28da80b1-4744-4001-987b-df4f29921c9b tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:16.726007 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-28da80b1-4744-4001-987b-df4f29921c9b tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] [instance: 35c5d2d8-26c3-433f-9073-bc66f16458f2] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:53:16.733212 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-28da80b1-4744-4001-987b-df4f29921c9b tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:16.733587 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-28da80b1-4744-4001-987b-df4f29921c9b tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:16.734051 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-28da80b1-4744-4001-987b-df4f29921c9b tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:16.734885 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-28da80b1-4744-4001-987b-df4f29921c9b tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:16.735374 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-28da80b1-4744-4001-987b-df4f29921c9b tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:16.735845 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-28da80b1-4744-4001-987b-df4f29921c9b tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:16.934750 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-28da80b1-4744-4001-987b-df4f29921c9b tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3527811c42647d99491111361f6479d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab94b4108b3c46a6b527f647f6184d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:16.944706 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-28da80b1-4744-4001-987b-df4f29921c9b tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] 10.222.0.33 "GET /compute/v2.1/servers/35c5d2d8-26c3-433f-9073-bc66f16458f2" status: 200 len: 1694 microversion: 2.1 time: 0.225685 Oct 04 21:53:16.945260 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3614/7196] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:53:16 2022] GET /compute/v2.1/servers/35c5d2d8-26c3-433f-9073-bc66f16458f2 => generated 1694 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:53:17.303111 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-18bc273e-8b84-461f-adc6-a894aeaab816 req-291fc56c-ec9b-4bdc-969c-6bf7f8dddc74 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "35c5d2d8-26c3-433f-9073-bc66f16458f2", "tag": "03c8be33-feb4-4691-8220-4d4404b67fd0"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:53:17.316223 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-18bc273e-8b84-461f-adc6-a894aeaab816 req-291fc56c-ec9b-4bdc-969c-6bf7f8dddc74 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:17.316720 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-18bc273e-8b84-461f-adc6-a894aeaab816 req-291fc56c-ec9b-4bdc-969c-6bf7f8dddc74 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:17.317302 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-18bc273e-8b84-461f-adc6-a894aeaab816 req-291fc56c-ec9b-4bdc-969c-6bf7f8dddc74 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:17.331679 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-18bc273e-8b84-461f-adc6-a894aeaab816 req-291fc56c-ec9b-4bdc-969c-6bf7f8dddc74 service nova] Creating event network-changed:03c8be33-feb4-4691-8220-4d4404b67fd0 for instance 35c5d2d8-26c3-433f-9073-bc66f16458f2 on n-h2-854823-8 Oct 04 21:53:17.338955 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [req-18bc273e-8b84-461f-adc6-a894aeaab816 req-291fc56c-ec9b-4bdc-969c-6bf7f8dddc74 service nova] Instance 35c5d2d8-26c3-433f-9073-bc66f16458f2 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854823-8', 'n-h2-854823-8'} {{(pid=128801) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 21:53:17.352527 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-18bc273e-8b84-461f-adc6-a894aeaab816 req-291fc56c-ec9b-4bdc-969c-6bf7f8dddc74 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053645 Oct 04 21:53:17.353484 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3583/7197] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:53:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:53:17.969435 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-8fb38931-62c7-4b6e-b051-cc1acecf4b04 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:17.970195 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-8fb38931-62c7-4b6e-b051-cc1acecf4b04 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] [instance: 35c5d2d8-26c3-433f-9073-bc66f16458f2] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:53:17.978752 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8fb38931-62c7-4b6e-b051-cc1acecf4b04 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:17.979298 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8fb38931-62c7-4b6e-b051-cc1acecf4b04 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:17.979763 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8fb38931-62c7-4b6e-b051-cc1acecf4b04 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:17.980511 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8fb38931-62c7-4b6e-b051-cc1acecf4b04 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:17.980991 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8fb38931-62c7-4b6e-b051-cc1acecf4b04 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:17.981673 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8fb38931-62c7-4b6e-b051-cc1acecf4b04 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:18.177969 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-8fb38931-62c7-4b6e-b051-cc1acecf4b04 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3527811c42647d99491111361f6479d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab94b4108b3c46a6b527f647f6184d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:18.201358 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-8fb38931-62c7-4b6e-b051-cc1acecf4b04 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] 10.222.0.33 "GET /compute/v2.1/servers/35c5d2d8-26c3-433f-9073-bc66f16458f2" status: 200 len: 1694 microversion: 2.1 time: 0.235906 Oct 04 21:53:18.202802 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3615/7198] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:53:17 2022] GET /compute/v2.1/servers/35c5d2d8-26c3-433f-9073-bc66f16458f2 => generated 1694 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:53:19.232451 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-67244b1c-4dbd-49db-b99d-507c8551490d tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:19.233954 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-67244b1c-4dbd-49db-b99d-507c8551490d tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] [instance: 35c5d2d8-26c3-433f-9073-bc66f16458f2] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:53:19.247408 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-67244b1c-4dbd-49db-b99d-507c8551490d tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:19.248314 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-67244b1c-4dbd-49db-b99d-507c8551490d tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:19.249115 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-67244b1c-4dbd-49db-b99d-507c8551490d tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:19.250448 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-67244b1c-4dbd-49db-b99d-507c8551490d tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:19.251549 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-67244b1c-4dbd-49db-b99d-507c8551490d tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:19.252329 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-67244b1c-4dbd-49db-b99d-507c8551490d tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:19.480345 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-67244b1c-4dbd-49db-b99d-507c8551490d tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3527811c42647d99491111361f6479d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab94b4108b3c46a6b527f647f6184d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:19.491345 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-67244b1c-4dbd-49db-b99d-507c8551490d tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] 10.222.0.33 "GET /compute/v2.1/servers/35c5d2d8-26c3-433f-9073-bc66f16458f2" status: 200 len: 1691 microversion: 2.1 time: 0.267261 Oct 04 21:53:19.492265 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3584/7199] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:53:19 2022] GET /compute/v2.1/servers/35c5d2d8-26c3-433f-9073-bc66f16458f2 => generated 1691 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:53:19.527525 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-4a3b36bd-fd1b-44a1-b6ed-6e0d28316dcd tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:53:19.528307 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-4a3b36bd-fd1b-44a1-b6ed-6e0d28316dcd tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] [instance: 35c5d2d8-26c3-433f-9073-bc66f16458f2] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:53:19.536981 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4a3b36bd-fd1b-44a1-b6ed-6e0d28316dcd tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:19.537806 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4a3b36bd-fd1b-44a1-b6ed-6e0d28316dcd tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:19.538528 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4a3b36bd-fd1b-44a1-b6ed-6e0d28316dcd tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:19.539571 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4a3b36bd-fd1b-44a1-b6ed-6e0d28316dcd tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:19.540545 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4a3b36bd-fd1b-44a1-b6ed-6e0d28316dcd tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:19.541011 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4a3b36bd-fd1b-44a1-b6ed-6e0d28316dcd tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:19.617526 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-4a3b36bd-fd1b-44a1-b6ed-6e0d28316dcd tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] 10.222.0.33 "POST /compute/v2.1/servers/35c5d2d8-26c3-433f-9073-bc66f16458f2/action" status: 204 len: 0 microversion: 2.1 time: 0.094177 Oct 04 21:53:19.618266 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3616/7200] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 21:53:19 2022] POST /compute/v2.1/servers/35c5d2d8-26c3-433f-9073-bc66f16458f2/action => generated 0 bytes in 96 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:53:19.629551 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-fd123d5e-c5f9-4b63-815a-0c6a8074ee46 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:19.630745 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-fd123d5e-c5f9-4b63-815a-0c6a8074ee46 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] [instance: 35c5d2d8-26c3-433f-9073-bc66f16458f2] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:53:19.638218 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fd123d5e-c5f9-4b63-815a-0c6a8074ee46 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:19.639132 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fd123d5e-c5f9-4b63-815a-0c6a8074ee46 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:19.639569 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fd123d5e-c5f9-4b63-815a-0c6a8074ee46 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:19.640515 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fd123d5e-c5f9-4b63-815a-0c6a8074ee46 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:19.640971 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fd123d5e-c5f9-4b63-815a-0c6a8074ee46 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:19.641723 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fd123d5e-c5f9-4b63-815a-0c6a8074ee46 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:19.978858 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-fd123d5e-c5f9-4b63-815a-0c6a8074ee46 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3527811c42647d99491111361f6479d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab94b4108b3c46a6b527f647f6184d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:19.991955 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-fd123d5e-c5f9-4b63-815a-0c6a8074ee46 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] 10.222.0.33 "GET /compute/v2.1/servers/35c5d2d8-26c3-433f-9073-bc66f16458f2" status: 200 len: 1691 microversion: 2.1 time: 0.368272 Oct 04 21:53:20.004294 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3585/7201] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:53:19 2022] GET /compute/v2.1/servers/35c5d2d8-26c3-433f-9073-bc66f16458f2 => generated 1691 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:53:20.028487 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-48e3071c-0a6c-4f2f-8d0c-da6bc4826927 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:20.029830 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-48e3071c-0a6c-4f2f-8d0c-da6bc4826927 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] [instance: 35c5d2d8-26c3-433f-9073-bc66f16458f2] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:53:20.039840 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-48e3071c-0a6c-4f2f-8d0c-da6bc4826927 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:20.040922 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-48e3071c-0a6c-4f2f-8d0c-da6bc4826927 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:20.041685 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-48e3071c-0a6c-4f2f-8d0c-da6bc4826927 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:20.042509 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-48e3071c-0a6c-4f2f-8d0c-da6bc4826927 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:20.043000 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-48e3071c-0a6c-4f2f-8d0c-da6bc4826927 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:20.043443 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-48e3071c-0a6c-4f2f-8d0c-da6bc4826927 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:20.345493 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-48e3071c-0a6c-4f2f-8d0c-da6bc4826927 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3527811c42647d99491111361f6479d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab94b4108b3c46a6b527f647f6184d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:20.359233 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-48e3071c-0a6c-4f2f-8d0c-da6bc4826927 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] 10.222.0.33 "GET /compute/v2.1/servers/35c5d2d8-26c3-433f-9073-bc66f16458f2" status: 200 len: 1691 microversion: 2.1 time: 0.336494 Oct 04 21:53:20.360608 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3617/7202] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:53:20 2022] GET /compute/v2.1/servers/35c5d2d8-26c3-433f-9073-bc66f16458f2 => generated 1691 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:53:21.402232 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7259f43f-14b2-462d-82f8-8e593da8d69c tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:21.403428 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-7259f43f-14b2-462d-82f8-8e593da8d69c tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] [instance: 35c5d2d8-26c3-433f-9073-bc66f16458f2] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:53:21.411637 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7259f43f-14b2-462d-82f8-8e593da8d69c tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:21.412429 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7259f43f-14b2-462d-82f8-8e593da8d69c tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:21.413172 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7259f43f-14b2-462d-82f8-8e593da8d69c tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:21.414124 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7259f43f-14b2-462d-82f8-8e593da8d69c tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:21.414797 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7259f43f-14b2-462d-82f8-8e593da8d69c tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:21.415693 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7259f43f-14b2-462d-82f8-8e593da8d69c tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:21.443760 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-ad8179bd-69b5-4e3e-ad54-6cc8716350d0 req-a4a8d12e-a963-47a2-8985-2bcc0a3c81f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35c5d2d8-26c3-433f-9073-bc66f16458f2", "name": "network-vif-plugged", "status": "completed", "tag": "03c8be33-feb4-4691-8220-4d4404b67fd0"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:53:21.481561 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-ad8179bd-69b5-4e3e-ad54-6cc8716350d0 req-a4a8d12e-a963-47a2-8985-2bcc0a3c81f5 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:21.481561 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-ad8179bd-69b5-4e3e-ad54-6cc8716350d0 req-a4a8d12e-a963-47a2-8985-2bcc0a3c81f5 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:21.481561 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-ad8179bd-69b5-4e3e-ad54-6cc8716350d0 req-a4a8d12e-a963-47a2-8985-2bcc0a3c81f5 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:21.498754 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-ad8179bd-69b5-4e3e-ad54-6cc8716350d0 req-a4a8d12e-a963-47a2-8985-2bcc0a3c81f5 service nova] Creating event network-vif-plugged:03c8be33-feb4-4691-8220-4d4404b67fd0 for instance 35c5d2d8-26c3-433f-9073-bc66f16458f2 on n-h2-854823-8 Oct 04 21:53:21.506400 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-ad8179bd-69b5-4e3e-ad54-6cc8716350d0 req-a4a8d12e-a963-47a2-8985-2bcc0a3c81f5 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077901 Oct 04 21:53:21.508296 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3618/7203] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:53:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:53:21.638110 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-7259f43f-14b2-462d-82f8-8e593da8d69c tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3527811c42647d99491111361f6479d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab94b4108b3c46a6b527f647f6184d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:21.650302 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-7259f43f-14b2-462d-82f8-8e593da8d69c tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] 10.222.0.33 "GET /compute/v2.1/servers/35c5d2d8-26c3-433f-9073-bc66f16458f2" status: 200 len: 1683 microversion: 2.1 time: 0.252344 Oct 04 21:53:21.651314 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3586/7204] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:53:21 2022] GET /compute/v2.1/servers/35c5d2d8-26c3-433f-9073-bc66f16458f2 => generated 1683 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:53:43.918966 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_api:SELECT=34 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:53:43.919916 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:53:43.926455 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-0180d9a9-3ca5-4d16-ae82-79321cf284d6 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:53:43.929221 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-0180d9a9-3ca5-4d16-ae82-79321cf284d6 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] [instance: 35c5d2d8-26c3-433f-9073-bc66f16458f2] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:53:43.939299 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0180d9a9-3ca5-4d16-ae82-79321cf284d6 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:43.939934 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0180d9a9-3ca5-4d16-ae82-79321cf284d6 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:43.941130 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0180d9a9-3ca5-4d16-ae82-79321cf284d6 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:43.941974 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0180d9a9-3ca5-4d16-ae82-79321cf284d6 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:43.942590 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0180d9a9-3ca5-4d16-ae82-79321cf284d6 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:43.943079 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0180d9a9-3ca5-4d16-ae82-79321cf284d6 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:44.022922 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-0180d9a9-3ca5-4d16-ae82-79321cf284d6 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] 10.222.0.33 "POST /compute/v2.1/servers/35c5d2d8-26c3-433f-9073-bc66f16458f2/action" status: 200 len: 24575 microversion: 2.1 time: 0.106284 Oct 04 21:53:44.023717 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3619/7205] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 21:53:43 2022] POST /compute/v2.1/servers/35c5d2d8-26c3-433f-9073-bc66f16458f2/action => generated 24575 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 04 21:53:52.031519 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2a8ce7b4-11a1-449f-8365-06f5cfc5267f tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:52.032396 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-2a8ce7b4-11a1-449f-8365-06f5cfc5267f tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] [instance: 35c5d2d8-26c3-433f-9073-bc66f16458f2] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:53:52.036352 n-d-854823-8 devstack@n-api.service[128801]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 21:53:52.036640 n-d-854823-8 devstack@n-api.service[128801]: Tue Oct 4 21:53:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/35c5d2d8-26c3-433f-9073-bc66f16458f2 (ip 10.222.0.33) !!! Oct 04 21:53:52.038145 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=28 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:53:52.039044 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=82 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:53:52.041017 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-43b795d6-9ed0-4709-95d1-c8d126b7ea05 req-3cb2d2c0-6b96-4e0c-9a53-bea1ff81b773 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "35c5d2d8-26c3-433f-9073-bc66f16458f2", "tag": "03c8be33-feb4-4691-8220-4d4404b67fd0"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:53:52.052853 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2a8ce7b4-11a1-449f-8365-06f5cfc5267f tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:52.053707 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2a8ce7b4-11a1-449f-8365-06f5cfc5267f tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:52.054508 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2a8ce7b4-11a1-449f-8365-06f5cfc5267f tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:52.056018 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2a8ce7b4-11a1-449f-8365-06f5cfc5267f tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:52.058068 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2a8ce7b4-11a1-449f-8365-06f5cfc5267f tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:52.058068 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2a8ce7b4-11a1-449f-8365-06f5cfc5267f tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:52.062545 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-43b795d6-9ed0-4709-95d1-c8d126b7ea05 req-3cb2d2c0-6b96-4e0c-9a53-bea1ff81b773 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:52.063485 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-43b795d6-9ed0-4709-95d1-c8d126b7ea05 req-3cb2d2c0-6b96-4e0c-9a53-bea1ff81b773 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:52.064502 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-43b795d6-9ed0-4709-95d1-c8d126b7ea05 req-3cb2d2c0-6b96-4e0c-9a53-bea1ff81b773 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:52.082541 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-43b795d6-9ed0-4709-95d1-c8d126b7ea05 req-3cb2d2c0-6b96-4e0c-9a53-bea1ff81b773 service nova] Creating event network-changed:03c8be33-feb4-4691-8220-4d4404b67fd0 for instance 35c5d2d8-26c3-433f-9073-bc66f16458f2 on n-h2-854823-8 Oct 04 21:53:52.088214 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-43b795d6-9ed0-4709-95d1-c8d126b7ea05 req-3cb2d2c0-6b96-4e0c-9a53-bea1ff81b773 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058177 Oct 04 21:53:52.089191 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3620/7206] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:53:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:53:52.102408 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-2a8ce7b4-11a1-449f-8365-06f5cfc5267f tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] [instance: 35c5d2d8-26c3-433f-9073-bc66f16458f2] Going to try to terminate instance {{(pid=128801) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:53:52.224721 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-2a8ce7b4-11a1-449f-8365-06f5cfc5267f tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] 10.222.0.33 "DELETE /compute/v2.1/servers/35c5d2d8-26c3-433f-9073-bc66f16458f2" status: 204 len: 0 microversion: 2.1 time: 0.198715 Oct 04 21:53:52.225768 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3587/7207] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 21:53:52 2022] DELETE /compute/v2.1/servers/35c5d2d8-26c3-433f-9073-bc66f16458f2 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 21:53:52.236060 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-44a37249-26c8-46f9-af13-bcc2c3982582 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:52.241626 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-44a37249-26c8-46f9-af13-bcc2c3982582 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] [instance: 35c5d2d8-26c3-433f-9073-bc66f16458f2] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:53:52.249330 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-44a37249-26c8-46f9-af13-bcc2c3982582 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:52.249844 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-44a37249-26c8-46f9-af13-bcc2c3982582 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:52.250315 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-44a37249-26c8-46f9-af13-bcc2c3982582 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:52.251063 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-44a37249-26c8-46f9-af13-bcc2c3982582 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:52.251540 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-44a37249-26c8-46f9-af13-bcc2c3982582 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:52.251979 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-44a37249-26c8-46f9-af13-bcc2c3982582 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:52.452915 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-44a37249-26c8-46f9-af13-bcc2c3982582 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3527811c42647d99491111361f6479d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab94b4108b3c46a6b527f647f6184d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:52.463122 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-44a37249-26c8-46f9-af13-bcc2c3982582 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] 10.222.0.33 "GET /compute/v2.1/servers/35c5d2d8-26c3-433f-9073-bc66f16458f2" status: 200 len: 1689 microversion: 2.1 time: 0.232175 Oct 04 21:53:52.463737 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3621/7208] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:53:52 2022] GET /compute/v2.1/servers/35c5d2d8-26c3-433f-9073-bc66f16458f2 => generated 1689 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:53:53.488934 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-353076a5-2cdd-4fa3-861c-d25c33b2871c tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:53.489768 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-353076a5-2cdd-4fa3-861c-d25c33b2871c tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] [instance: 35c5d2d8-26c3-433f-9073-bc66f16458f2] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:53:53.498591 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-353076a5-2cdd-4fa3-861c-d25c33b2871c tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:53.499098 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-353076a5-2cdd-4fa3-861c-d25c33b2871c tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:53.499544 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-353076a5-2cdd-4fa3-861c-d25c33b2871c tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:53.500285 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-353076a5-2cdd-4fa3-861c-d25c33b2871c tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:53.500748 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-353076a5-2cdd-4fa3-861c-d25c33b2871c tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:53.501184 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-353076a5-2cdd-4fa3-861c-d25c33b2871c tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:53.685294 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-353076a5-2cdd-4fa3-861c-d25c33b2871c tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3527811c42647d99491111361f6479d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab94b4108b3c46a6b527f647f6184d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:53.730479 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-353076a5-2cdd-4fa3-861c-d25c33b2871c tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] 10.222.0.33 "GET /compute/v2.1/servers/35c5d2d8-26c3-433f-9073-bc66f16458f2" status: 200 len: 1689 microversion: 2.1 time: 0.246363 Oct 04 21:53:53.731673 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3588/7209] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:53:53 2022] GET /compute/v2.1/servers/35c5d2d8-26c3-433f-9073-bc66f16458f2 => generated 1689 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:53:54.333339 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-c902a222-5f4e-4190-8705-13cc587062be req-6b12c183-1eca-4ce2-a3b3-683c21ce47e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35c5d2d8-26c3-433f-9073-bc66f16458f2", "name": "network-vif-deleted", "tag": "03c8be33-feb4-4691-8220-4d4404b67fd0"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:53:54.347514 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-c902a222-5f4e-4190-8705-13cc587062be req-6b12c183-1eca-4ce2-a3b3-683c21ce47e5 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:54.348178 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-c902a222-5f4e-4190-8705-13cc587062be req-6b12c183-1eca-4ce2-a3b3-683c21ce47e5 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:54.348809 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-c902a222-5f4e-4190-8705-13cc587062be req-6b12c183-1eca-4ce2-a3b3-683c21ce47e5 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:54.368029 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-c902a222-5f4e-4190-8705-13cc587062be req-6b12c183-1eca-4ce2-a3b3-683c21ce47e5 service nova] Creating event network-vif-deleted:03c8be33-feb4-4691-8220-4d4404b67fd0 for instance 35c5d2d8-26c3-433f-9073-bc66f16458f2 on n-h2-854823-8 Oct 04 21:53:54.376176 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-c902a222-5f4e-4190-8705-13cc587062be req-6b12c183-1eca-4ce2-a3b3-683c21ce47e5 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046539 Oct 04 21:53:54.377349 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3622/7210] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:53:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:53:54.774513 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6ddd4c25-cf7d-4e4d-92c3-6b726fcb9f23 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:54.775561 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-6ddd4c25-cf7d-4e4d-92c3-6b726fcb9f23 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] [instance: 35c5d2d8-26c3-433f-9073-bc66f16458f2] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:53:54.786809 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6ddd4c25-cf7d-4e4d-92c3-6b726fcb9f23 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:54.787417 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6ddd4c25-cf7d-4e4d-92c3-6b726fcb9f23 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:54.787913 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6ddd4c25-cf7d-4e4d-92c3-6b726fcb9f23 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:54.788779 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6ddd4c25-cf7d-4e4d-92c3-6b726fcb9f23 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:54.789558 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6ddd4c25-cf7d-4e4d-92c3-6b726fcb9f23 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:54.790065 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6ddd4c25-cf7d-4e4d-92c3-6b726fcb9f23 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:54.832122 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6ddd4c25-cf7d-4e4d-92c3-6b726fcb9f23 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:54.832360 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6ddd4c25-cf7d-4e4d-92c3-6b726fcb9f23 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:54.832803 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6ddd4c25-cf7d-4e4d-92c3-6b726fcb9f23 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:54.833257 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-6ddd4c25-cf7d-4e4d-92c3-6b726fcb9f23 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lazy-loading 'fault' on Instance uuid 35c5d2d8-26c3-433f-9073-bc66f16458f2 {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:53:54.885090 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-6ddd4c25-cf7d-4e4d-92c3-6b726fcb9f23 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3527811c42647d99491111361f6479d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab94b4108b3c46a6b527f647f6184d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:53:54.901453 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-6ddd4c25-cf7d-4e4d-92c3-6b726fcb9f23 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] 10.222.0.33 "GET /compute/v2.1/servers/35c5d2d8-26c3-433f-9073-bc66f16458f2" status: 200 len: 1356 microversion: 2.1 time: 0.131416 Oct 04 21:53:54.902450 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3589/7211] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:53:54 2022] GET /compute/v2.1/servers/35c5d2d8-26c3-433f-9073-bc66f16458f2 => generated 1356 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:53:55.944621 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-ecff91ae-cf3d-4429-b8df-f605aa7e5776 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:53:55.945323 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-ecff91ae-cf3d-4429-b8df-f605aa7e5776 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] [instance: 35c5d2d8-26c3-433f-9073-bc66f16458f2] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:53:55.952399 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ecff91ae-cf3d-4429-b8df-f605aa7e5776 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:55.952913 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ecff91ae-cf3d-4429-b8df-f605aa7e5776 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:55.953375 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ecff91ae-cf3d-4429-b8df-f605aa7e5776 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:55.954158 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ecff91ae-cf3d-4429-b8df-f605aa7e5776 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:53:55.954676 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ecff91ae-cf3d-4429-b8df-f605aa7e5776 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:53:55.955878 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ecff91ae-cf3d-4429-b8df-f605aa7e5776 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:53:55.972247 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.wsgi [None req-ecff91ae-cf3d-4429-b8df-f605aa7e5776 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] HTTP exception thrown: Instance 35c5d2d8-26c3-433f-9073-bc66f16458f2 could not be found. Oct 04 21:53:55.974221 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-ecff91ae-cf3d-4429-b8df-f605aa7e5776 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Request method failure captured: Oct 04 21:53:55.974221 n-d-854823-8 devstack@n-api.service[128802]: request: GET /compute/v2.1/servers/35c5d2d8-26c3-433f-9073-bc66f16458f2 HTTP/1.1 Oct 04 21:53:55.974221 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 21:53:55.974221 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 21:53:55.974221 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 21:53:55.974221 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 0 Oct 04 21:53:55.974221 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 21:53:55.974221 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 21:53:55.974221 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 21:53:55.974221 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 21:53:55.974221 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPKpBWf-ZdDHioKk7j1GCDpSV4CNRjR-HsBeRw5uM8vLVrE4RAbnqqIyB__lIo4YB-nPYiZgBfW-sd_MC5MrdTXH2d0mlcXhungwp23-mUfKzbPqcsQDk2EjQ-fmeT9DeObGTOq1tP4JZSLD8LNhyn4WTlxw8LmfuqpFt38X2o1fTW7c Oct 04 21:53:55.974221 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 21:53:55.974221 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 21:53:55.974221 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 21:53:55.974221 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 21:53:55.974221 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 21:53:55.974221 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 21:53:55.974221 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: ab94b4108b3c46a6b527f647f6184d9f Oct 04 21:53:55.974221 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-2019967856 Oct 04 21:53:55.974221 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 21:53:55.974221 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 21:53:55.974221 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ab94b4108b3c46a6b527f647f6184d9f", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ab94b4108b3c46a6b527f647f6184d9f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ab94b4108b3c46a6b527f647f6184d9f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ab94b4108b3c46a6b527f647f6184d9f"}]}] Oct 04 21:53:55.974221 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-TestNetworkAdvancedServerOps-2019967856 Oct 04 21:53:55.974221 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: ab94b4108b3c46a6b527f647f6184d9f Oct 04 21:53:55.974221 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-2019967856 Oct 04 21:53:55.974221 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-TestNetworkAdvancedServerOps-2019967856-project Oct 04 21:53:55.974221 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 21:53:55.974221 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 21:53:55.974221 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: e3527811c42647d99491111361f6479d Oct 04 21:53:55.974221 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-TestNetworkAdvancedServerOps-2019967856-project Oct 04 21:53:55.974221 n-d-854823-8 devstack@n-api.service[128802]: method: > Oct 04 21:53:55.974221 n-d-854823-8 devstack@n-api.service[128802]: exception: Instance 35c5d2d8-26c3-433f-9073-bc66f16458f2 could not be found. Oct 04 21:53:55.974221 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'id': '35c5d2d8-26c3-433f-9073-bc66f16458f2'} Oct 04 21:53:55.974221 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:53:55.974221 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:53:55.974221 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:53:55.974221 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:53:55.974221 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:53:55.974221 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:53:55.974221 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:53:55.974221 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:53:55.974221 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:53:55.974221 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:53:55.974221 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 35c5d2d8-26c3-433f-9073-bc66f16458f2 could not be found. Oct 04 21:53:55.974221 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:53:55.974221 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:53:55.974221 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:53:55.974221 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:53:55.974221 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:53:55.974221 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:53:55.974221 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:53:55.974221 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:53:55.974221 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:53:55.974221 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:53:55.974221 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:53:55.974221 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:53:55.974221 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:53:55.974221 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:53:55.974221 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:53:55.974221 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:53:55.974221 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 35c5d2d8-26c3-433f-9073-bc66f16458f2 could not be found. Oct 04 21:53:55.974221 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:53:55.974221 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:53:55.981959 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:53:55.981959 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:53:55.981959 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:53:55.981959 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:53:55.981959 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:53:55.981959 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:53:55.981959 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 35c5d2d8-26c3-433f-9073-bc66f16458f2 could not be found. Oct 04 21:53:55.981959 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 21:53:55.981959 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-ecff91ae-cf3d-4429-b8df-f605aa7e5776 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Returning 404 to user: Instance 35c5d2d8-26c3-433f-9073-bc66f16458f2 could not be found. {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:53:55.981959 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-ecff91ae-cf3d-4429-b8df-f605aa7e5776 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] 10.222.0.33 "GET /compute/v2.1/servers/35c5d2d8-26c3-433f-9073-bc66f16458f2" status: 404 len: 111 microversion: 2.1 time: 0.037645 Oct 04 21:53:55.981959 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3623/7212] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:53:55 2022] GET /compute/v2.1/servers/35c5d2d8-26c3-433f-9073-bc66f16458f2 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:54:00.100632 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-93143a15-fe3a-44e3-9e49-cd0c5a6f804f tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Calling method '.version_select at 0x7f3c742acee0>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:00.132084 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-93143a15-fe3a-44e3-9e49-cd0c5a6f804f tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-999860993" status: 202 len: 0 microversion: 2.1 time: 0.036922 Oct 04 21:54:00.132785 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3590/7213] 10.222.0.33 () {58 vars in 1281 bytes} [Tue Oct 4 21:54:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-999860993 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 21:54:00.177750 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-30a5978b-be0a-4de3-931a-30b11eb0e6e9 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Action: 'create', calling method: .version_select at 0x7f3c7456c940>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-694616208", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIxIa3S8GZg1JQui95uW0xe6WqrRcdzhAb9KPpnaJnjYYL3qL4mrDJtklotY7jgygv6L83XEcW6wFBHF4rDGE93+LFiw4BXK5JGxHeOeK5gicT/HU1t/j+qi4nQh+ly2FQ=="}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:54:00.200935 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-30a5978b-be0a-4de3-931a-30b11eb0e6e9 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Getting quotas for project ab94b4108b3c46a6b527f647f6184d9f. Resources: {'key_pairs'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:54:00.208451 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-30a5978b-be0a-4de3-931a-30b11eb0e6e9 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Getting quotas for user e3527811c42647d99491111361f6479d and project ab94b4108b3c46a6b527f647f6184d9f. Resources: {'key_pairs'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:54:00.240689 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-30a5978b-be0a-4de3-931a-30b11eb0e6e9 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.070044 Oct 04 21:54:00.241341 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3624/7214] 10.222.0.33 () {60 vars in 1159 bytes} [Tue Oct 4 21:54:00 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:54:08.385415 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9ee13d20-a104-4f5d-b3dd-f9084c900981 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-2108410237", "imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63", "flavorRef": "452", "networks": [{"uuid": "3f4f0ef6-90a3-4d2a-bfd0-30114518542f"}], "key_name": "tempest-TestNetworkAdvancedServerOps-694616208", "security_groups": [{"name": "tempest-secgroup-smoke-1226043978"}]}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:54:08.418314 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:54:08.632975 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.network.neutron [None req-9ee13d20-a104-4f5d-b3dd-f9084c900981 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] validate_networks() for [('3f4f0ef6-90a3-4d2a-bfd0-30114518542f', None, None, None, None, None)] {{(pid=128801) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:54:09.451746 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-9ee13d20-a104-4f5d-b3dd-f9084c900981 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Flavor limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:54:09.452537 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-9ee13d20-a104-4f5d-b3dd-f9084c900981 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Image limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:54:09.453489 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-9ee13d20-a104-4f5d-b3dd-f9084c900981 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Flavor pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:54:09.454589 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-9ee13d20-a104-4f5d-b3dd-f9084c900981 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Image pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:54:09.456877 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-9ee13d20-a104-4f5d-b3dd-f9084c900981 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:54:09.474463 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9ee13d20-a104-4f5d-b3dd-f9084c900981 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:09.475123 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9ee13d20-a104-4f5d-b3dd-f9084c900981 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:09.475875 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9ee13d20-a104-4f5d-b3dd-f9084c900981 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:09.477156 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9ee13d20-a104-4f5d-b3dd-f9084c900981 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:09.477674 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9ee13d20-a104-4f5d-b3dd-f9084c900981 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:09.478119 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9ee13d20-a104-4f5d-b3dd-f9084c900981 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:09.502577 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-9ee13d20-a104-4f5d-b3dd-f9084c900981 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Getting quotas for project ab94b4108b3c46a6b527f647f6184d9f. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:54:09.510826 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-9ee13d20-a104-4f5d-b3dd-f9084c900981 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Getting quotas for user e3527811c42647d99491111361f6479d and project ab94b4108b3c46a6b527f647f6184d9f. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:54:09.533631 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-9ee13d20-a104-4f5d-b3dd-f9084c900981 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Going to run 1 instances... {{(pid=128801) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:54:09.541930 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-9ee13d20-a104-4f5d-b3dd-f9084c900981 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] [instance: dc5902d3-e271-44c7-ad16-3ad4f2b9baeb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='15b24725-0c99-4bcf-b1fb-907cdf8e2d63',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128801) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:54:09.649828 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-9ee13d20-a104-4f5d-b3dd-f9084c900981 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.277227 Oct 04 21:54:09.657410 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3591/7215] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 21:54:08 2022] POST /compute/v2.1/servers => generated 406 bytes in 1280 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 21:54:09.663831 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-772c1779-12bc-48d5-b115-97f0a255a45f tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:09.664919 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-772c1779-12bc-48d5-b115-97f0a255a45f tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] [instance: dc5902d3-e271-44c7-ad16-3ad4f2b9baeb] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:54:09.678482 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=16 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:54:09.780145 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-772c1779-12bc-48d5-b115-97f0a255a45f tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3527811c42647d99491111361f6479d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab94b4108b3c46a6b527f647f6184d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:54:09.796507 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-772c1779-12bc-48d5-b115-97f0a255a45f tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] 10.222.0.33 "GET /compute/v2.1/servers/dc5902d3-e271-44c7-ad16-3ad4f2b9baeb" status: 200 len: 1266 microversion: 2.1 time: 0.136576 Oct 04 21:54:09.810425 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3625/7216] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:54:09 2022] GET /compute/v2.1/servers/dc5902d3-e271-44c7-ad16-3ad4f2b9baeb => generated 1266 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:54:10.836559 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2ec48be2-9b04-4643-8559-35801abc28ae tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:10.837618 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-2ec48be2-9b04-4643-8559-35801abc28ae tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] [instance: dc5902d3-e271-44c7-ad16-3ad4f2b9baeb] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:54:10.848260 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2ec48be2-9b04-4643-8559-35801abc28ae tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:10.849470 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2ec48be2-9b04-4643-8559-35801abc28ae tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:10.850602 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2ec48be2-9b04-4643-8559-35801abc28ae tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:10.851992 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2ec48be2-9b04-4643-8559-35801abc28ae tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:10.852834 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2ec48be2-9b04-4643-8559-35801abc28ae tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:10.853655 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2ec48be2-9b04-4643-8559-35801abc28ae tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:10.960301 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-2ec48be2-9b04-4643-8559-35801abc28ae tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3527811c42647d99491111361f6479d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab94b4108b3c46a6b527f647f6184d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:54:10.972986 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-2ec48be2-9b04-4643-8559-35801abc28ae tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] 10.222.0.33 "GET /compute/v2.1/servers/dc5902d3-e271-44c7-ad16-3ad4f2b9baeb" status: 200 len: 1318 microversion: 2.1 time: 0.145105 Oct 04 21:54:10.974193 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3592/7217] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:54:10 2022] GET /compute/v2.1/servers/dc5902d3-e271-44c7-ad16-3ad4f2b9baeb => generated 1318 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:54:11.998288 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-fd961956-3a64-482d-811c-ce49a2798e92 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:11.998997 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-fd961956-3a64-482d-811c-ce49a2798e92 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] [instance: dc5902d3-e271-44c7-ad16-3ad4f2b9baeb] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:54:12.007467 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fd961956-3a64-482d-811c-ce49a2798e92 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:12.007982 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fd961956-3a64-482d-811c-ce49a2798e92 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:12.008440 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fd961956-3a64-482d-811c-ce49a2798e92 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:12.009191 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fd961956-3a64-482d-811c-ce49a2798e92 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:12.009668 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fd961956-3a64-482d-811c-ce49a2798e92 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:12.010153 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fd961956-3a64-482d-811c-ce49a2798e92 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:12.120166 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-fd961956-3a64-482d-811c-ce49a2798e92 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3527811c42647d99491111361f6479d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab94b4108b3c46a6b527f647f6184d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:54:12.133125 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-fd961956-3a64-482d-811c-ce49a2798e92 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] 10.222.0.33 "GET /compute/v2.1/servers/dc5902d3-e271-44c7-ad16-3ad4f2b9baeb" status: 200 len: 1324 microversion: 2.1 time: 0.138830 Oct 04 21:54:12.133911 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3626/7218] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:54:11 2022] GET /compute/v2.1/servers/dc5902d3-e271-44c7-ad16-3ad4f2b9baeb => generated 1324 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:54:13.173525 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-520e7ad2-030d-465b-b83e-001d4b91272b tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:13.174378 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-520e7ad2-030d-465b-b83e-001d4b91272b tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] [instance: dc5902d3-e271-44c7-ad16-3ad4f2b9baeb] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:54:13.183758 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-520e7ad2-030d-465b-b83e-001d4b91272b tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:13.184549 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-520e7ad2-030d-465b-b83e-001d4b91272b tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:13.185056 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-520e7ad2-030d-465b-b83e-001d4b91272b tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:13.185943 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-520e7ad2-030d-465b-b83e-001d4b91272b tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:13.186726 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-520e7ad2-030d-465b-b83e-001d4b91272b tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:13.187336 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-520e7ad2-030d-465b-b83e-001d4b91272b tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:13.471160 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-36a09224-9288-401e-8aa6-c46cbc14e5ff req-fac7fd3e-f2e6-4a33-94d4-f6c1c80f8097 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc5902d3-e271-44c7-ad16-3ad4f2b9baeb", "tag": "4f684ec1-4be6-4b6c-8806-32ff499895af"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:54:13.484086 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-36a09224-9288-401e-8aa6-c46cbc14e5ff req-fac7fd3e-f2e6-4a33-94d4-f6c1c80f8097 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:13.484675 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-36a09224-9288-401e-8aa6-c46cbc14e5ff req-fac7fd3e-f2e6-4a33-94d4-f6c1c80f8097 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:13.485080 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-36a09224-9288-401e-8aa6-c46cbc14e5ff req-fac7fd3e-f2e6-4a33-94d4-f6c1c80f8097 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:13.500906 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-36a09224-9288-401e-8aa6-c46cbc14e5ff req-fac7fd3e-f2e6-4a33-94d4-f6c1c80f8097 service nova] Creating event network-changed:4f684ec1-4be6-4b6c-8806-32ff499895af for instance dc5902d3-e271-44c7-ad16-3ad4f2b9baeb on n-h2-854823-8 Oct 04 21:54:13.508083 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-36a09224-9288-401e-8aa6-c46cbc14e5ff req-fac7fd3e-f2e6-4a33-94d4-f6c1c80f8097 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041060 Oct 04 21:54:13.508843 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3627/7219] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:54:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:54:13.596196 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-520e7ad2-030d-465b-b83e-001d4b91272b tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3527811c42647d99491111361f6479d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab94b4108b3c46a6b527f647f6184d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:54:13.606361 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-520e7ad2-030d-465b-b83e-001d4b91272b tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] 10.222.0.33 "GET /compute/v2.1/servers/dc5902d3-e271-44c7-ad16-3ad4f2b9baeb" status: 200 len: 1392 microversion: 2.1 time: 0.437195 Oct 04 21:54:13.607391 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3593/7220] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:54:13 2022] GET /compute/v2.1/servers/dc5902d3-e271-44c7-ad16-3ad4f2b9baeb => generated 1392 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:54:14.640515 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-87c75aea-fc23-44c4-a048-b6efa4a3d587 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:14.642429 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-87c75aea-fc23-44c4-a048-b6efa4a3d587 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] [instance: dc5902d3-e271-44c7-ad16-3ad4f2b9baeb] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:54:14.646981 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=1 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:54:14.659471 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-87c75aea-fc23-44c4-a048-b6efa4a3d587 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:14.660402 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-87c75aea-fc23-44c4-a048-b6efa4a3d587 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:14.661221 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-87c75aea-fc23-44c4-a048-b6efa4a3d587 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:14.662561 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-87c75aea-fc23-44c4-a048-b6efa4a3d587 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:14.663417 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-87c75aea-fc23-44c4-a048-b6efa4a3d587 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:14.664468 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-87c75aea-fc23-44c4-a048-b6efa4a3d587 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:14.880422 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-87c75aea-fc23-44c4-a048-b6efa4a3d587 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3527811c42647d99491111361f6479d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab94b4108b3c46a6b527f647f6184d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:54:14.890457 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-87c75aea-fc23-44c4-a048-b6efa4a3d587 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] 10.222.0.33 "GET /compute/v2.1/servers/dc5902d3-e271-44c7-ad16-3ad4f2b9baeb" status: 200 len: 1392 microversion: 2.1 time: 0.259663 Oct 04 21:54:14.892679 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3628/7221] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:54:14 2022] GET /compute/v2.1/servers/dc5902d3-e271-44c7-ad16-3ad4f2b9baeb => generated 1392 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:54:15.915812 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-41adad3c-8345-4c09-8641-c9f0a302c1f4 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:15.916551 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-41adad3c-8345-4c09-8641-c9f0a302c1f4 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] [instance: dc5902d3-e271-44c7-ad16-3ad4f2b9baeb] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:54:15.925229 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-41adad3c-8345-4c09-8641-c9f0a302c1f4 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:15.925805 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-41adad3c-8345-4c09-8641-c9f0a302c1f4 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:15.926422 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-41adad3c-8345-4c09-8641-c9f0a302c1f4 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:15.927379 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-41adad3c-8345-4c09-8641-c9f0a302c1f4 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:15.927898 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-41adad3c-8345-4c09-8641-c9f0a302c1f4 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:15.928368 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-41adad3c-8345-4c09-8641-c9f0a302c1f4 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:16.108442 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-41adad3c-8345-4c09-8641-c9f0a302c1f4 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3527811c42647d99491111361f6479d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab94b4108b3c46a6b527f647f6184d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:54:16.117866 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-41adad3c-8345-4c09-8641-c9f0a302c1f4 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] 10.222.0.33 "GET /compute/v2.1/servers/dc5902d3-e271-44c7-ad16-3ad4f2b9baeb" status: 200 len: 1392 microversion: 2.1 time: 0.206546 Oct 04 21:54:16.118510 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3594/7222] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:54:15 2022] GET /compute/v2.1/servers/dc5902d3-e271-44c7-ad16-3ad4f2b9baeb => generated 1392 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:54:17.160849 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-7e9ace3a-2c65-4217-a667-8bc8418730fc tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:17.162117 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-7e9ace3a-2c65-4217-a667-8bc8418730fc tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] [instance: dc5902d3-e271-44c7-ad16-3ad4f2b9baeb] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:54:17.175791 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7e9ace3a-2c65-4217-a667-8bc8418730fc tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:17.176782 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7e9ace3a-2c65-4217-a667-8bc8418730fc tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:17.177563 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7e9ace3a-2c65-4217-a667-8bc8418730fc tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:17.179033 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7e9ace3a-2c65-4217-a667-8bc8418730fc tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:17.179905 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7e9ace3a-2c65-4217-a667-8bc8418730fc tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:17.180708 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7e9ace3a-2c65-4217-a667-8bc8418730fc tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:17.372715 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-7e9ace3a-2c65-4217-a667-8bc8418730fc tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3527811c42647d99491111361f6479d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab94b4108b3c46a6b527f647f6184d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:54:17.382674 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-7e9ace3a-2c65-4217-a667-8bc8418730fc tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] 10.222.0.33 "GET /compute/v2.1/servers/dc5902d3-e271-44c7-ad16-3ad4f2b9baeb" status: 200 len: 1392 microversion: 2.1 time: 0.228761 Oct 04 21:54:17.383400 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3629/7223] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:54:17 2022] GET /compute/v2.1/servers/dc5902d3-e271-44c7-ad16-3ad4f2b9baeb => generated 1392 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:54:18.414720 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-88c6fc9a-ec00-445a-82db-6b7033e3447d tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:18.415412 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-88c6fc9a-ec00-445a-82db-6b7033e3447d tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] [instance: dc5902d3-e271-44c7-ad16-3ad4f2b9baeb] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:54:18.426784 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-88c6fc9a-ec00-445a-82db-6b7033e3447d tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:18.427690 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-88c6fc9a-ec00-445a-82db-6b7033e3447d tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:18.428564 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-88c6fc9a-ec00-445a-82db-6b7033e3447d tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:18.429804 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-88c6fc9a-ec00-445a-82db-6b7033e3447d tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:18.430875 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-88c6fc9a-ec00-445a-82db-6b7033e3447d tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:18.431686 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-88c6fc9a-ec00-445a-82db-6b7033e3447d tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:18.587189 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-88c6fc9a-ec00-445a-82db-6b7033e3447d tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3527811c42647d99491111361f6479d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab94b4108b3c46a6b527f647f6184d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:54:18.595993 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-88c6fc9a-ec00-445a-82db-6b7033e3447d tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] 10.222.0.33 "GET /compute/v2.1/servers/dc5902d3-e271-44c7-ad16-3ad4f2b9baeb" status: 200 len: 1392 microversion: 2.1 time: 0.185784 Oct 04 21:54:18.596679 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3595/7224] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:54:18 2022] GET /compute/v2.1/servers/dc5902d3-e271-44c7-ad16-3ad4f2b9baeb => generated 1392 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:54:19.622678 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-e269eac8-7863-43a1-8a0e-4937b86122c2 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:19.623784 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-e269eac8-7863-43a1-8a0e-4937b86122c2 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] [instance: dc5902d3-e271-44c7-ad16-3ad4f2b9baeb] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:54:19.631964 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e269eac8-7863-43a1-8a0e-4937b86122c2 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:19.632804 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e269eac8-7863-43a1-8a0e-4937b86122c2 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:19.633551 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e269eac8-7863-43a1-8a0e-4937b86122c2 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:19.634836 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e269eac8-7863-43a1-8a0e-4937b86122c2 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:19.635491 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e269eac8-7863-43a1-8a0e-4937b86122c2 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:19.636103 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e269eac8-7863-43a1-8a0e-4937b86122c2 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:19.653321 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:54:19.654184 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=6 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:54:19.723072 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-5d9f9545-1725-47d9-834d-b7b8f1b9d8d5 req-613ad286-ce78-4ad3-ad67-cd1eabb924c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc5902d3-e271-44c7-ad16-3ad4f2b9baeb", "name": "network-vif-plugged", "status": "completed", "tag": "4f684ec1-4be6-4b6c-8806-32ff499895af"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:54:19.733760 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-5d9f9545-1725-47d9-834d-b7b8f1b9d8d5 req-613ad286-ce78-4ad3-ad67-cd1eabb924c7 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:19.734596 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-5d9f9545-1725-47d9-834d-b7b8f1b9d8d5 req-613ad286-ce78-4ad3-ad67-cd1eabb924c7 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:19.735031 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-5d9f9545-1725-47d9-834d-b7b8f1b9d8d5 req-613ad286-ce78-4ad3-ad67-cd1eabb924c7 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:19.748927 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-5d9f9545-1725-47d9-834d-b7b8f1b9d8d5 req-613ad286-ce78-4ad3-ad67-cd1eabb924c7 service nova] Creating event network-vif-plugged:4f684ec1-4be6-4b6c-8806-32ff499895af for instance dc5902d3-e271-44c7-ad16-3ad4f2b9baeb on n-h2-854823-8 Oct 04 21:54:19.754845 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-5d9f9545-1725-47d9-834d-b7b8f1b9d8d5 req-613ad286-ce78-4ad3-ad67-cd1eabb924c7 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107587 Oct 04 21:54:19.755540 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3596/7225] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:54:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:54:19.788377 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell0:SELECT=6 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:54:19.867764 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-e269eac8-7863-43a1-8a0e-4937b86122c2 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3527811c42647d99491111361f6479d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab94b4108b3c46a6b527f647f6184d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:54:19.876619 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-e269eac8-7863-43a1-8a0e-4937b86122c2 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] 10.222.0.33 "GET /compute/v2.1/servers/dc5902d3-e271-44c7-ad16-3ad4f2b9baeb" status: 200 len: 1392 microversion: 2.1 time: 0.259992 Oct 04 21:54:19.877239 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3630/7226] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:54:19 2022] GET /compute/v2.1/servers/dc5902d3-e271-44c7-ad16-3ad4f2b9baeb => generated 1392 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:54:20.919834 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-67c642c9-5738-43e8-8a28-21c29997f4ef tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:20.920989 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-67c642c9-5738-43e8-8a28-21c29997f4ef tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] [instance: dc5902d3-e271-44c7-ad16-3ad4f2b9baeb] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:54:20.933383 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-67c642c9-5738-43e8-8a28-21c29997f4ef tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:20.934252 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-67c642c9-5738-43e8-8a28-21c29997f4ef tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:20.935041 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-67c642c9-5738-43e8-8a28-21c29997f4ef tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:20.936270 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-67c642c9-5738-43e8-8a28-21c29997f4ef tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:20.937127 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-67c642c9-5738-43e8-8a28-21c29997f4ef tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:20.937885 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-67c642c9-5738-43e8-8a28-21c29997f4ef tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:21.149704 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-67c642c9-5738-43e8-8a28-21c29997f4ef tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3527811c42647d99491111361f6479d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab94b4108b3c46a6b527f647f6184d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:54:21.165515 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-67c642c9-5738-43e8-8a28-21c29997f4ef tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] 10.222.0.33 "GET /compute/v2.1/servers/dc5902d3-e271-44c7-ad16-3ad4f2b9baeb" status: 200 len: 1392 microversion: 2.1 time: 0.254333 Oct 04 21:54:21.166670 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3597/7227] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:54:20 2022] GET /compute/v2.1/servers/dc5902d3-e271-44c7-ad16-3ad4f2b9baeb => generated 1392 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:54:22.192044 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-fd562d7d-38aa-4ea6-99d7-5381f680b42a tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:22.192883 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-fd562d7d-38aa-4ea6-99d7-5381f680b42a tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] [instance: dc5902d3-e271-44c7-ad16-3ad4f2b9baeb] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:54:22.200291 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fd562d7d-38aa-4ea6-99d7-5381f680b42a tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:22.200806 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fd562d7d-38aa-4ea6-99d7-5381f680b42a tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:22.201284 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fd562d7d-38aa-4ea6-99d7-5381f680b42a tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:22.202006 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fd562d7d-38aa-4ea6-99d7-5381f680b42a tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:22.202527 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fd562d7d-38aa-4ea6-99d7-5381f680b42a tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:22.202979 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fd562d7d-38aa-4ea6-99d7-5381f680b42a tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:22.364742 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-fd562d7d-38aa-4ea6-99d7-5381f680b42a tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3527811c42647d99491111361f6479d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab94b4108b3c46a6b527f647f6184d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:54:22.373335 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-fd562d7d-38aa-4ea6-99d7-5381f680b42a tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] 10.222.0.33 "GET /compute/v2.1/servers/dc5902d3-e271-44c7-ad16-3ad4f2b9baeb" status: 200 len: 1564 microversion: 2.1 time: 0.185696 Oct 04 21:54:22.373947 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3631/7228] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:54:22 2022] GET /compute/v2.1/servers/dc5902d3-e271-44c7-ad16-3ad4f2b9baeb => generated 1564 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:54:22.397856 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8f535e58-bd37-46bc-9f07-d04bb9ad5fc5 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:22.398542 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-8f535e58-bd37-46bc-9f07-d04bb9ad5fc5 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] [instance: dc5902d3-e271-44c7-ad16-3ad4f2b9baeb] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:54:22.401945 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:54:22.409059 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8f535e58-bd37-46bc-9f07-d04bb9ad5fc5 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:22.409592 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8f535e58-bd37-46bc-9f07-d04bb9ad5fc5 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:22.410039 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8f535e58-bd37-46bc-9f07-d04bb9ad5fc5 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:22.410812 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8f535e58-bd37-46bc-9f07-d04bb9ad5fc5 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:22.411274 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8f535e58-bd37-46bc-9f07-d04bb9ad5fc5 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:22.411705 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8f535e58-bd37-46bc-9f07-d04bb9ad5fc5 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:22.577009 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-8f535e58-bd37-46bc-9f07-d04bb9ad5fc5 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3527811c42647d99491111361f6479d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab94b4108b3c46a6b527f647f6184d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:54:22.590225 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-8f535e58-bd37-46bc-9f07-d04bb9ad5fc5 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] 10.222.0.33 "GET /compute/v2.1/servers/dc5902d3-e271-44c7-ad16-3ad4f2b9baeb" status: 200 len: 1564 microversion: 2.1 time: 0.196175 Oct 04 21:54:22.590973 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3598/7229] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:54:22 2022] GET /compute/v2.1/servers/dc5902d3-e271-44c7-ad16-3ad4f2b9baeb => generated 1564 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:54:24.735321 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-a01bf54d-03b1-47bf-882b-fa8b33acf17b tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:24.736645 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-a01bf54d-03b1-47bf-882b-fa8b33acf17b tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] [instance: dc5902d3-e271-44c7-ad16-3ad4f2b9baeb] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:54:24.747427 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a01bf54d-03b1-47bf-882b-fa8b33acf17b tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:24.748317 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a01bf54d-03b1-47bf-882b-fa8b33acf17b tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:24.749110 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a01bf54d-03b1-47bf-882b-fa8b33acf17b tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:24.750311 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a01bf54d-03b1-47bf-882b-fa8b33acf17b tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:24.751725 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a01bf54d-03b1-47bf-882b-fa8b33acf17b tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:24.752808 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a01bf54d-03b1-47bf-882b-fa8b33acf17b tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:24.809868 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-31d250e5-2e0f-4dcb-966c-8b36559ac4ad req-26666c70-c913-4a4c-9891-de331e32a9f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc5902d3-e271-44c7-ad16-3ad4f2b9baeb", "tag": "4f684ec1-4be6-4b6c-8806-32ff499895af"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:54:24.820901 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-31d250e5-2e0f-4dcb-966c-8b36559ac4ad req-26666c70-c913-4a4c-9891-de331e32a9f6 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:24.821382 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-31d250e5-2e0f-4dcb-966c-8b36559ac4ad req-26666c70-c913-4a4c-9891-de331e32a9f6 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:24.821815 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-31d250e5-2e0f-4dcb-966c-8b36559ac4ad req-26666c70-c913-4a4c-9891-de331e32a9f6 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:24.839885 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-31d250e5-2e0f-4dcb-966c-8b36559ac4ad req-26666c70-c913-4a4c-9891-de331e32a9f6 service nova] Creating event network-changed:4f684ec1-4be6-4b6c-8806-32ff499895af for instance dc5902d3-e271-44c7-ad16-3ad4f2b9baeb on n-h2-854823-8 Oct 04 21:54:24.846610 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-31d250e5-2e0f-4dcb-966c-8b36559ac4ad req-26666c70-c913-4a4c-9891-de331e32a9f6 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113752 Oct 04 21:54:24.847614 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3599/7230] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:54:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:54:25.038290 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-a01bf54d-03b1-47bf-882b-fa8b33acf17b tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3527811c42647d99491111361f6479d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab94b4108b3c46a6b527f647f6184d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:54:25.050475 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-a01bf54d-03b1-47bf-882b-fa8b33acf17b tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] 10.222.0.33 "GET /compute/v2.1/servers/dc5902d3-e271-44c7-ad16-3ad4f2b9baeb" status: 200 len: 1564 microversion: 2.1 time: 0.319753 Oct 04 21:54:25.057378 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3632/7231] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:54:24 2022] GET /compute/v2.1/servers/dc5902d3-e271-44c7-ad16-3ad4f2b9baeb => generated 1564 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:54:46.364578 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=3 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:54:46.365874 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=42 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:54:46.374473 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-fce2abe2-b581-471c-a47f-0735d2335b6b tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:54:46.379990 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-fce2abe2-b581-471c-a47f-0735d2335b6b tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] [instance: dc5902d3-e271-44c7-ad16-3ad4f2b9baeb] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:54:46.393459 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fce2abe2-b581-471c-a47f-0735d2335b6b tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:46.394282 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fce2abe2-b581-471c-a47f-0735d2335b6b tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:46.395097 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fce2abe2-b581-471c-a47f-0735d2335b6b tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:46.396353 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fce2abe2-b581-471c-a47f-0735d2335b6b tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:46.397180 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fce2abe2-b581-471c-a47f-0735d2335b6b tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:46.397959 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fce2abe2-b581-471c-a47f-0735d2335b6b tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:46.499199 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-fce2abe2-b581-471c-a47f-0735d2335b6b tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] 10.222.0.33 "POST /compute/v2.1/servers/dc5902d3-e271-44c7-ad16-3ad4f2b9baeb/action" status: 200 len: 24568 microversion: 2.1 time: 0.138060 Oct 04 21:54:46.500111 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3600/7232] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 21:54:46 2022] POST /compute/v2.1/servers/dc5902d3-e271-44c7-ad16-3ad4f2b9baeb/action => generated 24568 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 21:54:52.924289 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-c97b80dc-5bc6-4ba6-9f3e-a0408724194b tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:54:52.926640 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_api:SELECT=9 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:54:52.927319 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=38 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:54:52.933579 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c97b80dc-5bc6-4ba6-9f3e-a0408724194b tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:52.934098 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c97b80dc-5bc6-4ba6-9f3e-a0408724194b tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:52.934593 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c97b80dc-5bc6-4ba6-9f3e-a0408724194b tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:52.961136 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-c97b80dc-5bc6-4ba6-9f3e-a0408724194b tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] [instance: dc5902d3-e271-44c7-ad16-3ad4f2b9baeb] Going to try to stop instance {{(pid=128802) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 04 21:54:53.011405 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-c97b80dc-5bc6-4ba6-9f3e-a0408724194b tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] 10.222.0.33 "POST /compute/v2.1/servers/dc5902d3-e271-44c7-ad16-3ad4f2b9baeb/action" status: 202 len: 0 microversion: 2.1 time: 0.092088 Oct 04 21:54:53.012355 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3633/7233] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 21:54:52 2022] POST /compute/v2.1/servers/dc5902d3-e271-44c7-ad16-3ad4f2b9baeb/action => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:54:53.023294 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-489061d1-af91-4443-82e0-6bfac52d7ec5 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:53.024221 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-489061d1-af91-4443-82e0-6bfac52d7ec5 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] [instance: dc5902d3-e271-44c7-ad16-3ad4f2b9baeb] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:54:53.043439 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-489061d1-af91-4443-82e0-6bfac52d7ec5 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:53.047378 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-489061d1-af91-4443-82e0-6bfac52d7ec5 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:53.047920 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-489061d1-af91-4443-82e0-6bfac52d7ec5 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:53.048675 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-489061d1-af91-4443-82e0-6bfac52d7ec5 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:53.049189 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-489061d1-af91-4443-82e0-6bfac52d7ec5 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:53.049621 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-489061d1-af91-4443-82e0-6bfac52d7ec5 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:53.223076 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-489061d1-af91-4443-82e0-6bfac52d7ec5 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3527811c42647d99491111361f6479d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab94b4108b3c46a6b527f647f6184d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:54:53.231685 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-489061d1-af91-4443-82e0-6bfac52d7ec5 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] 10.222.0.33 "GET /compute/v2.1/servers/dc5902d3-e271-44c7-ad16-3ad4f2b9baeb" status: 200 len: 1693 microversion: 2.1 time: 0.213295 Oct 04 21:54:53.232289 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3601/7234] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:54:53 2022] GET /compute/v2.1/servers/dc5902d3-e271-44c7-ad16-3ad4f2b9baeb => generated 1693 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:54:54.267306 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-18e527c0-9ad9-4f92-90e8-72d7d288a7f9 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:54.268597 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-18e527c0-9ad9-4f92-90e8-72d7d288a7f9 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] [instance: dc5902d3-e271-44c7-ad16-3ad4f2b9baeb] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:54:54.280159 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-18e527c0-9ad9-4f92-90e8-72d7d288a7f9 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:54.281649 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-18e527c0-9ad9-4f92-90e8-72d7d288a7f9 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:54.282519 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-18e527c0-9ad9-4f92-90e8-72d7d288a7f9 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:54.283810 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-18e527c0-9ad9-4f92-90e8-72d7d288a7f9 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:54.284623 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-18e527c0-9ad9-4f92-90e8-72d7d288a7f9 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:54.285434 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-18e527c0-9ad9-4f92-90e8-72d7d288a7f9 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:54.466510 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-18e527c0-9ad9-4f92-90e8-72d7d288a7f9 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3527811c42647d99491111361f6479d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab94b4108b3c46a6b527f647f6184d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:54:54.476520 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-18e527c0-9ad9-4f92-90e8-72d7d288a7f9 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] 10.222.0.33 "GET /compute/v2.1/servers/dc5902d3-e271-44c7-ad16-3ad4f2b9baeb" status: 200 len: 1693 microversion: 2.1 time: 0.219780 Oct 04 21:54:54.477150 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3634/7235] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:54:54 2022] GET /compute/v2.1/servers/dc5902d3-e271-44c7-ad16-3ad4f2b9baeb => generated 1693 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:54:55.504478 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-22cc0540-c094-4660-9cc7-c0d165114d87 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:55.505237 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-22cc0540-c094-4660-9cc7-c0d165114d87 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] [instance: dc5902d3-e271-44c7-ad16-3ad4f2b9baeb] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:54:55.513241 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-22cc0540-c094-4660-9cc7-c0d165114d87 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:55.513783 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-22cc0540-c094-4660-9cc7-c0d165114d87 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:55.514314 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-22cc0540-c094-4660-9cc7-c0d165114d87 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:55.515286 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-22cc0540-c094-4660-9cc7-c0d165114d87 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:55.516330 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-22cc0540-c094-4660-9cc7-c0d165114d87 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:55.516831 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-22cc0540-c094-4660-9cc7-c0d165114d87 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:55.676129 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-22cc0540-c094-4660-9cc7-c0d165114d87 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3527811c42647d99491111361f6479d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab94b4108b3c46a6b527f647f6184d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:54:55.684798 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-22cc0540-c094-4660-9cc7-c0d165114d87 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] 10.222.0.33 "GET /compute/v2.1/servers/dc5902d3-e271-44c7-ad16-3ad4f2b9baeb" status: 200 len: 1693 microversion: 2.1 time: 0.185498 Oct 04 21:54:55.685458 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3602/7236] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:54:55 2022] GET /compute/v2.1/servers/dc5902d3-e271-44c7-ad16-3ad4f2b9baeb => generated 1693 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:54:56.713476 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-f4fd55e6-32ad-46d0-ba2f-e4393f590863 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:56.714104 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-f4fd55e6-32ad-46d0-ba2f-e4393f590863 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] [instance: dc5902d3-e271-44c7-ad16-3ad4f2b9baeb] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:54:56.722071 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f4fd55e6-32ad-46d0-ba2f-e4393f590863 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:56.722613 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f4fd55e6-32ad-46d0-ba2f-e4393f590863 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:56.723068 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f4fd55e6-32ad-46d0-ba2f-e4393f590863 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:56.723818 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f4fd55e6-32ad-46d0-ba2f-e4393f590863 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:56.724327 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f4fd55e6-32ad-46d0-ba2f-e4393f590863 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:56.724776 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f4fd55e6-32ad-46d0-ba2f-e4393f590863 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:56.886009 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-f4fd55e6-32ad-46d0-ba2f-e4393f590863 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3527811c42647d99491111361f6479d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab94b4108b3c46a6b527f647f6184d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:54:56.894826 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-f4fd55e6-32ad-46d0-ba2f-e4393f590863 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] 10.222.0.33 "GET /compute/v2.1/servers/dc5902d3-e271-44c7-ad16-3ad4f2b9baeb" status: 200 len: 1693 microversion: 2.1 time: 0.185360 Oct 04 21:54:56.895434 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3635/7237] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:54:56 2022] GET /compute/v2.1/servers/dc5902d3-e271-44c7-ad16-3ad4f2b9baeb => generated 1693 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:54:57.923525 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-469cc105-0c58-4e40-8c0a-b8e6e96afa8b tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:57.924196 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-469cc105-0c58-4e40-8c0a-b8e6e96afa8b tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] [instance: dc5902d3-e271-44c7-ad16-3ad4f2b9baeb] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:54:57.932158 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-469cc105-0c58-4e40-8c0a-b8e6e96afa8b tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:57.932657 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-469cc105-0c58-4e40-8c0a-b8e6e96afa8b tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:57.933132 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-469cc105-0c58-4e40-8c0a-b8e6e96afa8b tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:57.933971 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-469cc105-0c58-4e40-8c0a-b8e6e96afa8b tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:57.934478 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-469cc105-0c58-4e40-8c0a-b8e6e96afa8b tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:57.934916 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-469cc105-0c58-4e40-8c0a-b8e6e96afa8b tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:58.087157 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-469cc105-0c58-4e40-8c0a-b8e6e96afa8b tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3527811c42647d99491111361f6479d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab94b4108b3c46a6b527f647f6184d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:54:58.097354 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-469cc105-0c58-4e40-8c0a-b8e6e96afa8b tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] 10.222.0.33 "GET /compute/v2.1/servers/dc5902d3-e271-44c7-ad16-3ad4f2b9baeb" status: 200 len: 1693 microversion: 2.1 time: 0.178943 Oct 04 21:54:58.097974 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3603/7238] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:54:57 2022] GET /compute/v2.1/servers/dc5902d3-e271-44c7-ad16-3ad4f2b9baeb => generated 1693 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:54:59.122220 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-f9a81c8a-e8cf-4dd3-b69c-220c6894a746 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:54:59.122819 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-f9a81c8a-e8cf-4dd3-b69c-220c6894a746 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] [instance: dc5902d3-e271-44c7-ad16-3ad4f2b9baeb] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:54:59.130952 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f9a81c8a-e8cf-4dd3-b69c-220c6894a746 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:59.131459 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f9a81c8a-e8cf-4dd3-b69c-220c6894a746 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:59.131909 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f9a81c8a-e8cf-4dd3-b69c-220c6894a746 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:59.132730 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f9a81c8a-e8cf-4dd3-b69c-220c6894a746 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:54:59.133199 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f9a81c8a-e8cf-4dd3-b69c-220c6894a746 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:54:59.133640 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f9a81c8a-e8cf-4dd3-b69c-220c6894a746 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:54:59.333075 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-f9a81c8a-e8cf-4dd3-b69c-220c6894a746 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3527811c42647d99491111361f6479d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab94b4108b3c46a6b527f647f6184d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:54:59.342435 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-f9a81c8a-e8cf-4dd3-b69c-220c6894a746 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] 10.222.0.33 "GET /compute/v2.1/servers/dc5902d3-e271-44c7-ad16-3ad4f2b9baeb" status: 200 len: 1693 microversion: 2.1 time: 0.224153 Oct 04 21:54:59.343404 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3636/7239] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:54:59 2022] GET /compute/v2.1/servers/dc5902d3-e271-44c7-ad16-3ad4f2b9baeb => generated 1693 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:55:00.370743 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-003f7c1f-59c4-4f67-bdba-a98cd6f9f315 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:55:00.371535 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-003f7c1f-59c4-4f67-bdba-a98cd6f9f315 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] [instance: dc5902d3-e271-44c7-ad16-3ad4f2b9baeb] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:55:00.379449 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-003f7c1f-59c4-4f67-bdba-a98cd6f9f315 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:00.379952 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-003f7c1f-59c4-4f67-bdba-a98cd6f9f315 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:00.380384 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-003f7c1f-59c4-4f67-bdba-a98cd6f9f315 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:00.381141 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-003f7c1f-59c4-4f67-bdba-a98cd6f9f315 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:00.381548 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-003f7c1f-59c4-4f67-bdba-a98cd6f9f315 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:00.381975 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-003f7c1f-59c4-4f67-bdba-a98cd6f9f315 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:00.530317 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-003f7c1f-59c4-4f67-bdba-a98cd6f9f315 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3527811c42647d99491111361f6479d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab94b4108b3c46a6b527f647f6184d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:55:00.539619 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-003f7c1f-59c4-4f67-bdba-a98cd6f9f315 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] 10.222.0.33 "GET /compute/v2.1/servers/dc5902d3-e271-44c7-ad16-3ad4f2b9baeb" status: 200 len: 1693 microversion: 2.1 time: 0.172902 Oct 04 21:55:00.540228 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3604/7240] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:55:00 2022] GET /compute/v2.1/servers/dc5902d3-e271-44c7-ad16-3ad4f2b9baeb => generated 1693 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:55:01.564705 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-bb389d64-9305-494c-99cf-c8fa2775886a tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:55:01.565393 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-bb389d64-9305-494c-99cf-c8fa2775886a tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] [instance: dc5902d3-e271-44c7-ad16-3ad4f2b9baeb] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:55:01.573553 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bb389d64-9305-494c-99cf-c8fa2775886a tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:01.574119 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bb389d64-9305-494c-99cf-c8fa2775886a tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:01.574681 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bb389d64-9305-494c-99cf-c8fa2775886a tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:01.575468 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bb389d64-9305-494c-99cf-c8fa2775886a tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:01.575977 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bb389d64-9305-494c-99cf-c8fa2775886a tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:01.576461 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bb389d64-9305-494c-99cf-c8fa2775886a tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:01.735976 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-bb389d64-9305-494c-99cf-c8fa2775886a tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3527811c42647d99491111361f6479d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab94b4108b3c46a6b527f647f6184d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:55:01.745185 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-bb389d64-9305-494c-99cf-c8fa2775886a tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] 10.222.0.33 "GET /compute/v2.1/servers/dc5902d3-e271-44c7-ad16-3ad4f2b9baeb" status: 200 len: 1693 microversion: 2.1 time: 0.185014 Oct 04 21:55:01.745828 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3637/7241] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:55:01 2022] GET /compute/v2.1/servers/dc5902d3-e271-44c7-ad16-3ad4f2b9baeb => generated 1693 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:55:02.772487 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-09d118f4-0ce9-4c26-bf46-e5c36cc28760 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:55:02.773360 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-09d118f4-0ce9-4c26-bf46-e5c36cc28760 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] [instance: dc5902d3-e271-44c7-ad16-3ad4f2b9baeb] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:55:02.781078 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-09d118f4-0ce9-4c26-bf46-e5c36cc28760 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:02.781692 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-09d118f4-0ce9-4c26-bf46-e5c36cc28760 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:02.782282 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-09d118f4-0ce9-4c26-bf46-e5c36cc28760 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:02.783214 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-09d118f4-0ce9-4c26-bf46-e5c36cc28760 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:02.783816 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-09d118f4-0ce9-4c26-bf46-e5c36cc28760 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:02.784291 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-09d118f4-0ce9-4c26-bf46-e5c36cc28760 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:02.945577 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-09d118f4-0ce9-4c26-bf46-e5c36cc28760 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3527811c42647d99491111361f6479d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab94b4108b3c46a6b527f647f6184d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:55:02.954380 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-09d118f4-0ce9-4c26-bf46-e5c36cc28760 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] 10.222.0.33 "GET /compute/v2.1/servers/dc5902d3-e271-44c7-ad16-3ad4f2b9baeb" status: 200 len: 1693 microversion: 2.1 time: 0.186275 Oct 04 21:55:02.955005 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3605/7242] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:55:02 2022] GET /compute/v2.1/servers/dc5902d3-e271-44c7-ad16-3ad4f2b9baeb => generated 1693 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:55:03.979648 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-84a5716d-f621-4879-8ec8-714434f14c19 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:55:03.980298 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-84a5716d-f621-4879-8ec8-714434f14c19 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] [instance: dc5902d3-e271-44c7-ad16-3ad4f2b9baeb] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:55:03.988477 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-84a5716d-f621-4879-8ec8-714434f14c19 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:03.989002 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-84a5716d-f621-4879-8ec8-714434f14c19 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:03.989464 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-84a5716d-f621-4879-8ec8-714434f14c19 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:03.990213 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-84a5716d-f621-4879-8ec8-714434f14c19 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:03.990724 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-84a5716d-f621-4879-8ec8-714434f14c19 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:03.991174 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-84a5716d-f621-4879-8ec8-714434f14c19 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:04.160217 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-84a5716d-f621-4879-8ec8-714434f14c19 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3527811c42647d99491111361f6479d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab94b4108b3c46a6b527f647f6184d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:55:04.169506 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-84a5716d-f621-4879-8ec8-714434f14c19 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] 10.222.0.33 "GET /compute/v2.1/servers/dc5902d3-e271-44c7-ad16-3ad4f2b9baeb" status: 200 len: 1670 microversion: 2.1 time: 0.193905 Oct 04 21:55:04.170160 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3638/7243] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:55:03 2022] GET /compute/v2.1/servers/dc5902d3-e271-44c7-ad16-3ad4f2b9baeb => generated 1670 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:55:05.284639 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6710a8a9-808b-4396-94ce-6b77178d252f tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:55:05.287257 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-6710a8a9-808b-4396-94ce-6b77178d252f tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] [instance: dc5902d3-e271-44c7-ad16-3ad4f2b9baeb] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:55:05.295510 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6710a8a9-808b-4396-94ce-6b77178d252f tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:05.296666 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6710a8a9-808b-4396-94ce-6b77178d252f tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:05.297407 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6710a8a9-808b-4396-94ce-6b77178d252f tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:05.298423 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6710a8a9-808b-4396-94ce-6b77178d252f tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:05.298930 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6710a8a9-808b-4396-94ce-6b77178d252f tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:05.299411 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6710a8a9-808b-4396-94ce-6b77178d252f tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:05.393389 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-6710a8a9-808b-4396-94ce-6b77178d252f tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] 10.222.0.33 "POST /compute/v2.1/servers/dc5902d3-e271-44c7-ad16-3ad4f2b9baeb/action" status: 200 len: 35585 microversion: 2.1 time: 0.112588 Oct 04 21:55:05.394816 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3606/7244] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 21:55:05 2022] POST /compute/v2.1/servers/dc5902d3-e271-44c7-ad16-3ad4f2b9baeb/action => generated 35585 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 21:55:05.409154 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-53b20a42-f7fd-4593-b6af-f80af86d71ef tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:55:05.422208 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-53b20a42-f7fd-4593-b6af-f80af86d71ef tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:05.422765 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-53b20a42-f7fd-4593-b6af-f80af86d71ef tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:05.423280 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-53b20a42-f7fd-4593-b6af-f80af86d71ef tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:05.449547 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-53b20a42-f7fd-4593-b6af-f80af86d71ef tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] [instance: dc5902d3-e271-44c7-ad16-3ad4f2b9baeb] Going to try to start instance {{(pid=128802) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 04 21:55:05.506383 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-53b20a42-f7fd-4593-b6af-f80af86d71ef tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] 10.222.0.33 "POST /compute/v2.1/servers/dc5902d3-e271-44c7-ad16-3ad4f2b9baeb/action" status: 202 len: 0 microversion: 2.1 time: 0.101834 Oct 04 21:55:05.507495 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3639/7245] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 21:55:05 2022] POST /compute/v2.1/servers/dc5902d3-e271-44c7-ad16-3ad4f2b9baeb/action => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:55:05.522202 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-192f536b-8b4c-4d5e-ad70-6b396b85d4be tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:55:05.523847 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-192f536b-8b4c-4d5e-ad70-6b396b85d4be tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] [instance: dc5902d3-e271-44c7-ad16-3ad4f2b9baeb] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:55:05.534891 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-192f536b-8b4c-4d5e-ad70-6b396b85d4be tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:05.535425 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-192f536b-8b4c-4d5e-ad70-6b396b85d4be tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:05.536087 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-192f536b-8b4c-4d5e-ad70-6b396b85d4be tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:05.536808 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-192f536b-8b4c-4d5e-ad70-6b396b85d4be tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:05.537373 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-192f536b-8b4c-4d5e-ad70-6b396b85d4be tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:05.538214 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-192f536b-8b4c-4d5e-ad70-6b396b85d4be tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:05.859320 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-192f536b-8b4c-4d5e-ad70-6b396b85d4be tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3527811c42647d99491111361f6479d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab94b4108b3c46a6b527f647f6184d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:55:05.872910 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-192f536b-8b4c-4d5e-ad70-6b396b85d4be tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] 10.222.0.33 "GET /compute/v2.1/servers/dc5902d3-e271-44c7-ad16-3ad4f2b9baeb" status: 200 len: 1679 microversion: 2.1 time: 0.359446 Oct 04 21:55:05.873655 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3607/7246] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:55:05 2022] GET /compute/v2.1/servers/dc5902d3-e271-44c7-ad16-3ad4f2b9baeb => generated 1679 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:55:06.908133 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-7d969077-5dbe-4335-a5c5-b35309fcdd67 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:55:06.909452 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-7d969077-5dbe-4335-a5c5-b35309fcdd67 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] [instance: dc5902d3-e271-44c7-ad16-3ad4f2b9baeb] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:55:06.921369 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7d969077-5dbe-4335-a5c5-b35309fcdd67 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:06.922287 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7d969077-5dbe-4335-a5c5-b35309fcdd67 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:06.923150 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7d969077-5dbe-4335-a5c5-b35309fcdd67 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:06.924436 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7d969077-5dbe-4335-a5c5-b35309fcdd67 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:06.925272 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7d969077-5dbe-4335-a5c5-b35309fcdd67 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:06.926041 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7d969077-5dbe-4335-a5c5-b35309fcdd67 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:07.094657 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-7d969077-5dbe-4335-a5c5-b35309fcdd67 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3527811c42647d99491111361f6479d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab94b4108b3c46a6b527f647f6184d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:55:07.103726 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-7d969077-5dbe-4335-a5c5-b35309fcdd67 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] 10.222.0.33 "GET /compute/v2.1/servers/dc5902d3-e271-44c7-ad16-3ad4f2b9baeb" status: 200 len: 1683 microversion: 2.1 time: 0.205411 Oct 04 21:55:07.104520 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3640/7247] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:55:06 2022] GET /compute/v2.1/servers/dc5902d3-e271-44c7-ad16-3ad4f2b9baeb => generated 1683 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:55:31.367406 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1a05b0cc-11cb-4aa2-9fcd-a3d8f7c7647b tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:55:31.370859 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-1a05b0cc-11cb-4aa2-9fcd-a3d8f7c7647b tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] [instance: dc5902d3-e271-44c7-ad16-3ad4f2b9baeb] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:55:31.376756 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=16 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:55:31.377963 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=44 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:55:31.393107 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1a05b0cc-11cb-4aa2-9fcd-a3d8f7c7647b tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:31.393993 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1a05b0cc-11cb-4aa2-9fcd-a3d8f7c7647b tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:31.394818 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1a05b0cc-11cb-4aa2-9fcd-a3d8f7c7647b tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:31.396120 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1a05b0cc-11cb-4aa2-9fcd-a3d8f7c7647b tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:31.396947 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1a05b0cc-11cb-4aa2-9fcd-a3d8f7c7647b tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:31.397742 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1a05b0cc-11cb-4aa2-9fcd-a3d8f7c7647b tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:31.494579 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-1a05b0cc-11cb-4aa2-9fcd-a3d8f7c7647b tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] 10.222.0.33 "POST /compute/v2.1/servers/dc5902d3-e271-44c7-ad16-3ad4f2b9baeb/action" status: 200 len: 60145 microversion: 2.1 time: 0.134564 Oct 04 21:55:31.495305 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3608/7248] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 21:55:31 2022] POST /compute/v2.1/servers/dc5902d3-e271-44c7-ad16-3ad4f2b9baeb/action => generated 60145 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 21:55:38.770877 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-efbab2ce-b7c0-4262-9fbf-495537b91c73 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:55:38.778230 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-0cd84186-f0f9-4580-aed2-bb94cfeb353a req-065b6242-ceb8-46b1-a4b2-1f648edf7646 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc5902d3-e271-44c7-ad16-3ad4f2b9baeb", "tag": "4f684ec1-4be6-4b6c-8806-32ff499895af"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:55:38.780010 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-efbab2ce-b7c0-4262-9fbf-495537b91c73 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] [instance: dc5902d3-e271-44c7-ad16-3ad4f2b9baeb] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:55:38.783127 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_api:SELECT=16 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:55:38.784385 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:55:38.804596 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-efbab2ce-b7c0-4262-9fbf-495537b91c73 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:38.805426 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-efbab2ce-b7c0-4262-9fbf-495537b91c73 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:38.806180 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-efbab2ce-b7c0-4262-9fbf-495537b91c73 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:38.807507 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-efbab2ce-b7c0-4262-9fbf-495537b91c73 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:38.808272 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-efbab2ce-b7c0-4262-9fbf-495537b91c73 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:38.809007 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-efbab2ce-b7c0-4262-9fbf-495537b91c73 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:38.812218 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-0cd84186-f0f9-4580-aed2-bb94cfeb353a req-065b6242-ceb8-46b1-a4b2-1f648edf7646 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:38.813156 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-0cd84186-f0f9-4580-aed2-bb94cfeb353a req-065b6242-ceb8-46b1-a4b2-1f648edf7646 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:38.814156 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-0cd84186-f0f9-4580-aed2-bb94cfeb353a req-065b6242-ceb8-46b1-a4b2-1f648edf7646 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:38.837854 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-0cd84186-f0f9-4580-aed2-bb94cfeb353a req-065b6242-ceb8-46b1-a4b2-1f648edf7646 service nova] Creating event network-changed:4f684ec1-4be6-4b6c-8806-32ff499895af for instance dc5902d3-e271-44c7-ad16-3ad4f2b9baeb on n-h2-854823-8 Oct 04 21:55:38.847636 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-0cd84186-f0f9-4580-aed2-bb94cfeb353a req-065b6242-ceb8-46b1-a4b2-1f648edf7646 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073988 Oct 04 21:55:38.848693 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3609/7249] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:55:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:55:38.858114 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-efbab2ce-b7c0-4262-9fbf-495537b91c73 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] [instance: dc5902d3-e271-44c7-ad16-3ad4f2b9baeb] Going to try to terminate instance {{(pid=128802) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:55:39.000909 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-efbab2ce-b7c0-4262-9fbf-495537b91c73 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] 10.222.0.33 "DELETE /compute/v2.1/servers/dc5902d3-e271-44c7-ad16-3ad4f2b9baeb" status: 204 len: 0 microversion: 2.1 time: 0.234248 Oct 04 21:55:39.008481 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3641/7250] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 21:55:38 2022] DELETE /compute/v2.1/servers/dc5902d3-e271-44c7-ad16-3ad4f2b9baeb => generated 0 bytes in 237 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 21:55:39.020226 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c4b39906-cda9-4e43-9345-b806f84281e3 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:55:39.021761 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c4b39906-cda9-4e43-9345-b806f84281e3 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] [instance: dc5902d3-e271-44c7-ad16-3ad4f2b9baeb] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:55:39.037254 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c4b39906-cda9-4e43-9345-b806f84281e3 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:39.038728 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c4b39906-cda9-4e43-9345-b806f84281e3 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:39.039658 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c4b39906-cda9-4e43-9345-b806f84281e3 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:39.041302 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c4b39906-cda9-4e43-9345-b806f84281e3 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:39.042300 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c4b39906-cda9-4e43-9345-b806f84281e3 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:39.043263 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c4b39906-cda9-4e43-9345-b806f84281e3 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:39.272100 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c4b39906-cda9-4e43-9345-b806f84281e3 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3527811c42647d99491111361f6479d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab94b4108b3c46a6b527f647f6184d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:55:39.282790 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c4b39906-cda9-4e43-9345-b806f84281e3 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] 10.222.0.33 "GET /compute/v2.1/servers/dc5902d3-e271-44c7-ad16-3ad4f2b9baeb" status: 200 len: 1689 microversion: 2.1 time: 0.272580 Oct 04 21:55:39.283690 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3610/7251] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:55:39 2022] GET /compute/v2.1/servers/dc5902d3-e271-44c7-ad16-3ad4f2b9baeb => generated 1689 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:55:40.311237 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-44ecb5d4-82c2-4829-991c-a696b5e268ee tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:55:40.312113 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-44ecb5d4-82c2-4829-991c-a696b5e268ee tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] [instance: dc5902d3-e271-44c7-ad16-3ad4f2b9baeb] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:55:40.320273 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-44ecb5d4-82c2-4829-991c-a696b5e268ee tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:40.320788 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-44ecb5d4-82c2-4829-991c-a696b5e268ee tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:40.321276 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-44ecb5d4-82c2-4829-991c-a696b5e268ee tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:40.322015 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-44ecb5d4-82c2-4829-991c-a696b5e268ee tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:40.322531 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-44ecb5d4-82c2-4829-991c-a696b5e268ee tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:40.322979 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-44ecb5d4-82c2-4829-991c-a696b5e268ee tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:40.537521 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-44ecb5d4-82c2-4829-991c-a696b5e268ee tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3527811c42647d99491111361f6479d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab94b4108b3c46a6b527f647f6184d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:55:40.553473 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-44ecb5d4-82c2-4829-991c-a696b5e268ee tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] 10.222.0.33 "GET /compute/v2.1/servers/dc5902d3-e271-44c7-ad16-3ad4f2b9baeb" status: 200 len: 1689 microversion: 2.1 time: 0.248095 Oct 04 21:55:40.554924 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3642/7252] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:55:40 2022] GET /compute/v2.1/servers/dc5902d3-e271-44c7-ad16-3ad4f2b9baeb => generated 1689 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:55:41.300580 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-342bcf83-401e-42da-8208-afc1db073e91 req-763e39bf-ff05-446e-af8d-6b3b8e2e476f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc5902d3-e271-44c7-ad16-3ad4f2b9baeb", "name": "network-vif-deleted", "tag": "4f684ec1-4be6-4b6c-8806-32ff499895af"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:55:41.319174 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-342bcf83-401e-42da-8208-afc1db073e91 req-763e39bf-ff05-446e-af8d-6b3b8e2e476f service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:41.320282 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-342bcf83-401e-42da-8208-afc1db073e91 req-763e39bf-ff05-446e-af8d-6b3b8e2e476f service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:41.322637 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-342bcf83-401e-42da-8208-afc1db073e91 req-763e39bf-ff05-446e-af8d-6b3b8e2e476f service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:41.348424 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-342bcf83-401e-42da-8208-afc1db073e91 req-763e39bf-ff05-446e-af8d-6b3b8e2e476f service nova] Creating event network-vif-deleted:4f684ec1-4be6-4b6c-8806-32ff499895af for instance dc5902d3-e271-44c7-ad16-3ad4f2b9baeb on n-h2-854823-8 Oct 04 21:55:41.357042 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-342bcf83-401e-42da-8208-afc1db073e91 req-763e39bf-ff05-446e-af8d-6b3b8e2e476f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065496 Oct 04 21:55:41.358023 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3611/7253] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:55:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:55:41.587459 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-8ccd9cb9-d0ee-4bcd-bbb8-a636179dc83c tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:55:41.588333 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-8ccd9cb9-d0ee-4bcd-bbb8-a636179dc83c tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] [instance: dc5902d3-e271-44c7-ad16-3ad4f2b9baeb] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:55:41.597257 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8ccd9cb9-d0ee-4bcd-bbb8-a636179dc83c tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:41.598117 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8ccd9cb9-d0ee-4bcd-bbb8-a636179dc83c tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:41.598621 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8ccd9cb9-d0ee-4bcd-bbb8-a636179dc83c tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:41.599389 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8ccd9cb9-d0ee-4bcd-bbb8-a636179dc83c tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:41.599873 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8ccd9cb9-d0ee-4bcd-bbb8-a636179dc83c tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:41.600324 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8ccd9cb9-d0ee-4bcd-bbb8-a636179dc83c tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:41.644294 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8ccd9cb9-d0ee-4bcd-bbb8-a636179dc83c tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:41.644806 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8ccd9cb9-d0ee-4bcd-bbb8-a636179dc83c tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:41.645270 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8ccd9cb9-d0ee-4bcd-bbb8-a636179dc83c tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:41.645749 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.objects.instance [None req-8ccd9cb9-d0ee-4bcd-bbb8-a636179dc83c tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lazy-loading 'fault' on Instance uuid dc5902d3-e271-44c7-ad16-3ad4f2b9baeb {{(pid=128802) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:55:41.697428 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-8ccd9cb9-d0ee-4bcd-bbb8-a636179dc83c tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3527811c42647d99491111361f6479d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab94b4108b3c46a6b527f647f6184d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:55:41.713209 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-8ccd9cb9-d0ee-4bcd-bbb8-a636179dc83c tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] 10.222.0.33 "GET /compute/v2.1/servers/dc5902d3-e271-44c7-ad16-3ad4f2b9baeb" status: 200 len: 1356 microversion: 2.1 time: 0.129098 Oct 04 21:55:41.730381 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3643/7254] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:55:41 2022] GET /compute/v2.1/servers/dc5902d3-e271-44c7-ad16-3ad4f2b9baeb => generated 1356 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:55:42.753184 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c3cc4d5c-a637-4dfc-a0ce-84992c0febf6 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:55:42.754161 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c3cc4d5c-a637-4dfc-a0ce-84992c0febf6 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] [instance: dc5902d3-e271-44c7-ad16-3ad4f2b9baeb] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:55:42.763106 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c3cc4d5c-a637-4dfc-a0ce-84992c0febf6 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:42.764374 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c3cc4d5c-a637-4dfc-a0ce-84992c0febf6 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:42.764997 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c3cc4d5c-a637-4dfc-a0ce-84992c0febf6 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:42.766827 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c3cc4d5c-a637-4dfc-a0ce-84992c0febf6 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:42.767675 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c3cc4d5c-a637-4dfc-a0ce-84992c0febf6 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:42.768235 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c3cc4d5c-a637-4dfc-a0ce-84992c0febf6 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:42.784215 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-c3cc4d5c-a637-4dfc-a0ce-84992c0febf6 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] HTTP exception thrown: Instance dc5902d3-e271-44c7-ad16-3ad4f2b9baeb could not be found. Oct 04 21:55:42.785910 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c3cc4d5c-a637-4dfc-a0ce-84992c0febf6 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Request method failure captured: Oct 04 21:55:42.785910 n-d-854823-8 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/dc5902d3-e271-44c7-ad16-3ad4f2b9baeb HTTP/1.1 Oct 04 21:55:42.785910 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 21:55:42.785910 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 21:55:42.785910 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 21:55:42.785910 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 0 Oct 04 21:55:42.785910 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 21:55:42.785910 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 21:55:42.785910 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 21:55:42.785910 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 21:55:42.785910 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPKpBWf-ZdDHioKk7j1GCDpSV4CNRjR-HsBeRw5uM8vLVrE4RAbnqqIyB__lIo4YB-nPYiZgBfW-sd_MC5MrdTXH2d0mlcXhungwp23-mUfKzbPqcsQDk2EjQ-fmeT9DeObGTOq1tP4JZSLD8LNhyn4WTlxw8LmfuqpFt38X2o1fTW7c Oct 04 21:55:42.785910 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 21:55:42.785910 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 21:55:42.785910 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 21:55:42.785910 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 21:55:42.785910 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 21:55:42.785910 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 21:55:42.785910 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: ab94b4108b3c46a6b527f647f6184d9f Oct 04 21:55:42.785910 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-2019967856 Oct 04 21:55:42.785910 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 21:55:42.785910 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 21:55:42.785910 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ab94b4108b3c46a6b527f647f6184d9f", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ab94b4108b3c46a6b527f647f6184d9f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ab94b4108b3c46a6b527f647f6184d9f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ab94b4108b3c46a6b527f647f6184d9f"}]}] Oct 04 21:55:42.785910 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-TestNetworkAdvancedServerOps-2019967856 Oct 04 21:55:42.785910 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: ab94b4108b3c46a6b527f647f6184d9f Oct 04 21:55:42.785910 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-2019967856 Oct 04 21:55:42.785910 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-TestNetworkAdvancedServerOps-2019967856-project Oct 04 21:55:42.785910 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 21:55:42.785910 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 21:55:42.785910 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: e3527811c42647d99491111361f6479d Oct 04 21:55:42.785910 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-TestNetworkAdvancedServerOps-2019967856-project Oct 04 21:55:42.785910 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 21:55:42.785910 n-d-854823-8 devstack@n-api.service[128801]: exception: Instance dc5902d3-e271-44c7-ad16-3ad4f2b9baeb could not be found. Oct 04 21:55:42.785910 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': 'dc5902d3-e271-44c7-ad16-3ad4f2b9baeb'} Oct 04 21:55:42.785910 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:55:42.785910 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:55:42.785910 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:55:42.785910 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:55:42.785910 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:55:42.785910 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:55:42.785910 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:55:42.785910 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:55:42.785910 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:55:42.785910 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:55:42.785910 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc5902d3-e271-44c7-ad16-3ad4f2b9baeb could not be found. Oct 04 21:55:42.785910 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:55:42.785910 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:55:42.785910 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:55:42.785910 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:55:42.785910 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:55:42.785910 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:55:42.785910 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:55:42.785910 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:55:42.785910 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:55:42.785910 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:55:42.785910 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:55:42.785910 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:55:42.785910 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:55:42.785910 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:55:42.785910 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:55:42.785910 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:55:42.785910 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc5902d3-e271-44c7-ad16-3ad4f2b9baeb could not be found. Oct 04 21:55:42.785910 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:55:42.785910 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:55:42.791173 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:55:42.791173 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:55:42.791173 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:55:42.791173 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:55:42.791173 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:55:42.791173 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:55:42.791173 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc5902d3-e271-44c7-ad16-3ad4f2b9baeb could not be found. Oct 04 21:55:42.791173 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:55:42.791173 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c3cc4d5c-a637-4dfc-a0ce-84992c0febf6 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Returning 404 to user: Instance dc5902d3-e271-44c7-ad16-3ad4f2b9baeb could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:55:42.791173 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c3cc4d5c-a637-4dfc-a0ce-84992c0febf6 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] 10.222.0.33 "GET /compute/v2.1/servers/dc5902d3-e271-44c7-ad16-3ad4f2b9baeb" status: 404 len: 111 microversion: 2.1 time: 0.040889 Oct 04 21:55:42.791173 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3612/7255] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:55:42 2022] GET /compute/v2.1/servers/dc5902d3-e271-44c7-ad16-3ad4f2b9baeb => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:55:47.025625 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-c6be96cf-3143-49d4-8b5f-e976ebb08b03 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Calling method '.version_select at 0x7f3c78905670>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:55:47.057171 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-c6be96cf-3143-49d4-8b5f-e976ebb08b03 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-694616208" status: 202 len: 0 microversion: 2.1 time: 0.035474 Oct 04 21:55:47.058258 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3644/7256] 10.222.0.33 () {58 vars in 1281 bytes} [Tue Oct 4 21:55:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-694616208 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:55:47.099435 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8f088d3a-b04f-455f-b690-615617cf184f tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Action: 'create', calling method: .version_select at 0x7f3c6efabc10>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-792810848", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKWOaBUjyXAoSatPRMiP0ysJ6hvecDeIIevMXjqs0J+XWsWn6UnWUgHUD9CEVqC2PvkcX/qVKBqC9WvHNO/Ex9P5ulJh4aaaaa73OBbRT1/msFMn08XQPGm6WTwCG2SGng=="}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:55:47.129809 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-8f088d3a-b04f-455f-b690-615617cf184f tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Getting quotas for project ab94b4108b3c46a6b527f647f6184d9f. Resources: {'key_pairs'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:55:47.140209 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-8f088d3a-b04f-455f-b690-615617cf184f tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Getting quotas for user e3527811c42647d99491111361f6479d and project ab94b4108b3c46a6b527f647f6184d9f. Resources: {'key_pairs'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:55:47.182461 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-8f088d3a-b04f-455f-b690-615617cf184f tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.090512 Oct 04 21:55:47.183547 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3613/7257] 10.222.0.33 () {60 vars in 1159 bytes} [Tue Oct 4 21:55:47 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:55:54.828346 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-75d74d25-95dd-4703-8373-51499a78b87e tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1518610908", "imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63", "flavorRef": "452", "networks": [{"uuid": "3475e828-ec65-4f61-bb58-0a0d948f537e"}], "key_name": "tempest-TestNetworkAdvancedServerOps-792810848", "security_groups": [{"name": "tempest-secgroup-smoke-1514385607"}]}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:55:54.860232 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:55:55.046376 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.network.neutron [None req-75d74d25-95dd-4703-8373-51499a78b87e tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] validate_networks() for [('3475e828-ec65-4f61-bb58-0a0d948f537e', None, None, None, None, None)] {{(pid=128802) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:55:55.590571 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-75d74d25-95dd-4703-8373-51499a78b87e tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Flavor limits 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:55:55.591637 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-75d74d25-95dd-4703-8373-51499a78b87e tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Image limits 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:55:55.592301 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-75d74d25-95dd-4703-8373-51499a78b87e tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Flavor pref 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:55:55.593039 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-75d74d25-95dd-4703-8373-51499a78b87e tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Image pref 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:55:55.593565 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-75d74d25-95dd-4703-8373-51499a78b87e tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:55:55.603884 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-75d74d25-95dd-4703-8373-51499a78b87e tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:55.605172 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-75d74d25-95dd-4703-8373-51499a78b87e tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:55.605645 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-75d74d25-95dd-4703-8373-51499a78b87e tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:55.606778 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-75d74d25-95dd-4703-8373-51499a78b87e tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:55.608251 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-75d74d25-95dd-4703-8373-51499a78b87e tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:55.609100 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-75d74d25-95dd-4703-8373-51499a78b87e tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:55.642797 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-75d74d25-95dd-4703-8373-51499a78b87e tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Getting quotas for project ab94b4108b3c46a6b527f647f6184d9f. Resources: {'ram', 'instances', 'cores'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:55:55.652446 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-75d74d25-95dd-4703-8373-51499a78b87e tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Getting quotas for user e3527811c42647d99491111361f6479d and project ab94b4108b3c46a6b527f647f6184d9f. Resources: {'ram', 'instances', 'cores'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:55:55.679119 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-75d74d25-95dd-4703-8373-51499a78b87e tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Going to run 1 instances... {{(pid=128802) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:55:55.683900 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-75d74d25-95dd-4703-8373-51499a78b87e tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] [instance: 0a0849d6-0d06-418d-9429-24e1d6de8d3b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='15b24725-0c99-4bcf-b1fb-907cdf8e2d63',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128802) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:55:55.750211 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-75d74d25-95dd-4703-8373-51499a78b87e tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.928897 Oct 04 21:55:55.751599 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3645/7258] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 21:55:54 2022] POST /compute/v2.1/servers => generated 406 bytes in 931 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:55:55.770897 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-72a5ed88-5e1c-4813-9257-d40073cbd880 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:55:55.771755 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-72a5ed88-5e1c-4813-9257-d40073cbd880 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] [instance: 0a0849d6-0d06-418d-9429-24e1d6de8d3b] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:55:55.779259 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=16 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:55:55.864239 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-72a5ed88-5e1c-4813-9257-d40073cbd880 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3527811c42647d99491111361f6479d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab94b4108b3c46a6b527f647f6184d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:55:55.879812 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-72a5ed88-5e1c-4813-9257-d40073cbd880 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] 10.222.0.33 "GET /compute/v2.1/servers/0a0849d6-0d06-418d-9429-24e1d6de8d3b" status: 200 len: 1266 microversion: 2.1 time: 0.113300 Oct 04 21:55:55.881003 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3614/7259] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:55:55 2022] GET /compute/v2.1/servers/0a0849d6-0d06-418d-9429-24e1d6de8d3b => generated 1266 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:55:56.918225 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-f9338664-acfc-4756-b3a6-9dab4ddae41b tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:55:56.919542 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-f9338664-acfc-4756-b3a6-9dab4ddae41b tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] [instance: 0a0849d6-0d06-418d-9429-24e1d6de8d3b] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:55:56.928610 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f9338664-acfc-4756-b3a6-9dab4ddae41b tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:56.929172 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f9338664-acfc-4756-b3a6-9dab4ddae41b tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:56.929642 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f9338664-acfc-4756-b3a6-9dab4ddae41b tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:56.930442 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f9338664-acfc-4756-b3a6-9dab4ddae41b tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:56.930941 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f9338664-acfc-4756-b3a6-9dab4ddae41b tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:56.931397 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f9338664-acfc-4756-b3a6-9dab4ddae41b tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:57.006851 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-f9338664-acfc-4756-b3a6-9dab4ddae41b tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3527811c42647d99491111361f6479d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab94b4108b3c46a6b527f647f6184d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:55:57.024048 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-f9338664-acfc-4756-b3a6-9dab4ddae41b tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] 10.222.0.33 "GET /compute/v2.1/servers/0a0849d6-0d06-418d-9429-24e1d6de8d3b" status: 200 len: 1318 microversion: 2.1 time: 0.109780 Oct 04 21:55:57.024859 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3646/7260] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:55:56 2022] GET /compute/v2.1/servers/0a0849d6-0d06-418d-9429-24e1d6de8d3b => generated 1318 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:55:58.056319 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-20d2a9b5-d018-4050-9107-3f637c84b6a1 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:55:58.059027 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-20d2a9b5-d018-4050-9107-3f637c84b6a1 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] [instance: 0a0849d6-0d06-418d-9429-24e1d6de8d3b] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:55:58.071457 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-20d2a9b5-d018-4050-9107-3f637c84b6a1 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:58.072239 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-20d2a9b5-d018-4050-9107-3f637c84b6a1 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:58.072928 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-20d2a9b5-d018-4050-9107-3f637c84b6a1 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:58.074519 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-20d2a9b5-d018-4050-9107-3f637c84b6a1 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:58.075245 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-20d2a9b5-d018-4050-9107-3f637c84b6a1 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:58.076893 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-20d2a9b5-d018-4050-9107-3f637c84b6a1 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:58.190293 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-20d2a9b5-d018-4050-9107-3f637c84b6a1 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3527811c42647d99491111361f6479d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab94b4108b3c46a6b527f647f6184d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:55:58.201253 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-20d2a9b5-d018-4050-9107-3f637c84b6a1 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] 10.222.0.33 "GET /compute/v2.1/servers/0a0849d6-0d06-418d-9429-24e1d6de8d3b" status: 200 len: 1324 microversion: 2.1 time: 0.152834 Oct 04 21:55:58.215555 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3615/7261] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:55:58 2022] GET /compute/v2.1/servers/0a0849d6-0d06-418d-9429-24e1d6de8d3b => generated 1324 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:55:59.229706 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-18951752-2d9d-4011-99e3-99f051a6d88b tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:55:59.230823 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-18951752-2d9d-4011-99e3-99f051a6d88b tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] [instance: 0a0849d6-0d06-418d-9429-24e1d6de8d3b] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:55:59.242898 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-18951752-2d9d-4011-99e3-99f051a6d88b tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:59.243581 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-18951752-2d9d-4011-99e3-99f051a6d88b tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:59.244389 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-18951752-2d9d-4011-99e3-99f051a6d88b tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:59.245595 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-18951752-2d9d-4011-99e3-99f051a6d88b tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:59.246544 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-18951752-2d9d-4011-99e3-99f051a6d88b tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:59.247445 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-18951752-2d9d-4011-99e3-99f051a6d88b tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:59.448512 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-18951752-2d9d-4011-99e3-99f051a6d88b tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3527811c42647d99491111361f6479d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab94b4108b3c46a6b527f647f6184d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:55:59.460076 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-18951752-2d9d-4011-99e3-99f051a6d88b tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] 10.222.0.33 "GET /compute/v2.1/servers/0a0849d6-0d06-418d-9429-24e1d6de8d3b" status: 200 len: 1392 microversion: 2.1 time: 0.235951 Oct 04 21:55:59.460861 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3647/7262] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:55:59 2022] GET /compute/v2.1/servers/0a0849d6-0d06-418d-9429-24e1d6de8d3b => generated 1392 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:55:59.877652 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-7c11c870-eeda-4960-8eb7-445ef8032721 req-6a0db460-0ab5-46e8-8cfa-dd14871be6e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a0849d6-0d06-418d-9429-24e1d6de8d3b", "tag": "ca878321-cf03-4551-bc8e-c33547ecc4ae"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:55:59.897109 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-7c11c870-eeda-4960-8eb7-445ef8032721 req-6a0db460-0ab5-46e8-8cfa-dd14871be6e1 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:55:59.897739 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-7c11c870-eeda-4960-8eb7-445ef8032721 req-6a0db460-0ab5-46e8-8cfa-dd14871be6e1 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:55:59.900803 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-7c11c870-eeda-4960-8eb7-445ef8032721 req-6a0db460-0ab5-46e8-8cfa-dd14871be6e1 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:55:59.937752 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-7c11c870-eeda-4960-8eb7-445ef8032721 req-6a0db460-0ab5-46e8-8cfa-dd14871be6e1 service nova] Creating event network-changed:ca878321-cf03-4551-bc8e-c33547ecc4ae for instance 0a0849d6-0d06-418d-9429-24e1d6de8d3b on n-h2-854823-8 Oct 04 21:55:59.947147 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-7c11c870-eeda-4960-8eb7-445ef8032721 req-6a0db460-0ab5-46e8-8cfa-dd14871be6e1 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076676 Oct 04 21:55:59.949110 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3616/7263] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:55:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:56:00.503790 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-3ae2305b-9b73-4039-8940-999c6f5831b2 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:56:00.505315 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-3ae2305b-9b73-4039-8940-999c6f5831b2 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] [instance: 0a0849d6-0d06-418d-9429-24e1d6de8d3b] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:56:00.514520 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3ae2305b-9b73-4039-8940-999c6f5831b2 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:00.515341 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3ae2305b-9b73-4039-8940-999c6f5831b2 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:00.515972 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3ae2305b-9b73-4039-8940-999c6f5831b2 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:00.516940 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3ae2305b-9b73-4039-8940-999c6f5831b2 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:00.517536 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3ae2305b-9b73-4039-8940-999c6f5831b2 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:00.518084 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3ae2305b-9b73-4039-8940-999c6f5831b2 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:00.732655 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-3ae2305b-9b73-4039-8940-999c6f5831b2 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3527811c42647d99491111361f6479d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab94b4108b3c46a6b527f647f6184d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:56:00.740926 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-3ae2305b-9b73-4039-8940-999c6f5831b2 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] 10.222.0.33 "GET /compute/v2.1/servers/0a0849d6-0d06-418d-9429-24e1d6de8d3b" status: 200 len: 1392 microversion: 2.1 time: 0.244236 Oct 04 21:56:00.741527 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3648/7264] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:56:00 2022] GET /compute/v2.1/servers/0a0849d6-0d06-418d-9429-24e1d6de8d3b => generated 1392 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:56:01.772658 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-640bd584-a2d9-453e-a9fc-b760c2d7b775 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:56:01.774011 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-640bd584-a2d9-453e-a9fc-b760c2d7b775 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] [instance: 0a0849d6-0d06-418d-9429-24e1d6de8d3b] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:56:01.777648 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:56:01.789967 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-640bd584-a2d9-453e-a9fc-b760c2d7b775 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:01.790904 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-640bd584-a2d9-453e-a9fc-b760c2d7b775 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:01.791705 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-640bd584-a2d9-453e-a9fc-b760c2d7b775 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:01.793037 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-640bd584-a2d9-453e-a9fc-b760c2d7b775 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:01.793996 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-640bd584-a2d9-453e-a9fc-b760c2d7b775 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:01.794893 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-640bd584-a2d9-453e-a9fc-b760c2d7b775 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:02.000968 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-640bd584-a2d9-453e-a9fc-b760c2d7b775 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3527811c42647d99491111361f6479d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab94b4108b3c46a6b527f647f6184d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:56:02.009793 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-640bd584-a2d9-453e-a9fc-b760c2d7b775 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] 10.222.0.33 "GET /compute/v2.1/servers/0a0849d6-0d06-418d-9429-24e1d6de8d3b" status: 200 len: 1392 microversion: 2.1 time: 0.247723 Oct 04 21:56:02.010556 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3617/7265] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:56:01 2022] GET /compute/v2.1/servers/0a0849d6-0d06-418d-9429-24e1d6de8d3b => generated 1392 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:56:03.034881 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-3f13cab8-bab3-4e71-b435-af9ab6e005e0 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:56:03.035517 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-3f13cab8-bab3-4e71-b435-af9ab6e005e0 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] [instance: 0a0849d6-0d06-418d-9429-24e1d6de8d3b] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:56:03.043311 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3f13cab8-bab3-4e71-b435-af9ab6e005e0 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:03.043876 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3f13cab8-bab3-4e71-b435-af9ab6e005e0 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:03.044444 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3f13cab8-bab3-4e71-b435-af9ab6e005e0 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:03.045188 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3f13cab8-bab3-4e71-b435-af9ab6e005e0 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:03.045668 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3f13cab8-bab3-4e71-b435-af9ab6e005e0 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:03.046113 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3f13cab8-bab3-4e71-b435-af9ab6e005e0 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:03.215111 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-3f13cab8-bab3-4e71-b435-af9ab6e005e0 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3527811c42647d99491111361f6479d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab94b4108b3c46a6b527f647f6184d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:56:03.225763 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-3f13cab8-bab3-4e71-b435-af9ab6e005e0 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] 10.222.0.33 "GET /compute/v2.1/servers/0a0849d6-0d06-418d-9429-24e1d6de8d3b" status: 200 len: 1392 microversion: 2.1 time: 0.195516 Oct 04 21:56:03.226451 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3649/7266] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:56:03 2022] GET /compute/v2.1/servers/0a0849d6-0d06-418d-9429-24e1d6de8d3b => generated 1392 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:56:04.170094 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-2bd973e8-469c-425a-82d1-db72b621868e req-18d55e82-062f-465d-95b0-d452ad7eab56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a0849d6-0d06-418d-9429-24e1d6de8d3b", "name": "network-vif-plugged", "status": "completed", "tag": "ca878321-cf03-4551-bc8e-c33547ecc4ae"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:56:04.182473 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-2bd973e8-469c-425a-82d1-db72b621868e req-18d55e82-062f-465d-95b0-d452ad7eab56 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:04.183335 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-2bd973e8-469c-425a-82d1-db72b621868e req-18d55e82-062f-465d-95b0-d452ad7eab56 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:04.183951 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-2bd973e8-469c-425a-82d1-db72b621868e req-18d55e82-062f-465d-95b0-d452ad7eab56 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:04.204684 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-2bd973e8-469c-425a-82d1-db72b621868e req-18d55e82-062f-465d-95b0-d452ad7eab56 service nova] Creating event network-vif-plugged:ca878321-cf03-4551-bc8e-c33547ecc4ae for instance 0a0849d6-0d06-418d-9429-24e1d6de8d3b on n-h2-854823-8 Oct 04 21:56:04.212489 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-2bd973e8-469c-425a-82d1-db72b621868e req-18d55e82-062f-465d-95b0-d452ad7eab56 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047431 Oct 04 21:56:04.213125 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3618/7267] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:56:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:56:04.252366 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-4f424b69-3aca-44f1-926b-f75ce76e1c65 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:56:04.253591 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-4f424b69-3aca-44f1-926b-f75ce76e1c65 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] [instance: 0a0849d6-0d06-418d-9429-24e1d6de8d3b] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:56:04.267578 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4f424b69-3aca-44f1-926b-f75ce76e1c65 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:04.268470 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4f424b69-3aca-44f1-926b-f75ce76e1c65 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:04.269536 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4f424b69-3aca-44f1-926b-f75ce76e1c65 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:04.271077 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4f424b69-3aca-44f1-926b-f75ce76e1c65 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:04.272195 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4f424b69-3aca-44f1-926b-f75ce76e1c65 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:04.273099 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4f424b69-3aca-44f1-926b-f75ce76e1c65 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:04.479806 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-4f424b69-3aca-44f1-926b-f75ce76e1c65 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3527811c42647d99491111361f6479d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab94b4108b3c46a6b527f647f6184d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:56:04.489306 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-4f424b69-3aca-44f1-926b-f75ce76e1c65 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] 10.222.0.33 "GET /compute/v2.1/servers/0a0849d6-0d06-418d-9429-24e1d6de8d3b" status: 200 len: 1392 microversion: 2.1 time: 0.242705 Oct 04 21:56:04.489908 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3650/7268] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:56:04 2022] GET /compute/v2.1/servers/0a0849d6-0d06-418d-9429-24e1d6de8d3b => generated 1392 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:56:05.516940 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-3247ac4c-611b-46e6-a73f-62578420a6f6 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:56:05.517839 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-3247ac4c-611b-46e6-a73f-62578420a6f6 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] [instance: 0a0849d6-0d06-418d-9429-24e1d6de8d3b] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:56:05.524954 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3247ac4c-611b-46e6-a73f-62578420a6f6 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:05.525752 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3247ac4c-611b-46e6-a73f-62578420a6f6 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:05.526187 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3247ac4c-611b-46e6-a73f-62578420a6f6 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:05.526999 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3247ac4c-611b-46e6-a73f-62578420a6f6 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:05.527535 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3247ac4c-611b-46e6-a73f-62578420a6f6 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:05.528632 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3247ac4c-611b-46e6-a73f-62578420a6f6 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:05.698165 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-3247ac4c-611b-46e6-a73f-62578420a6f6 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3527811c42647d99491111361f6479d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab94b4108b3c46a6b527f647f6184d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:56:05.709072 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-3247ac4c-611b-46e6-a73f-62578420a6f6 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] 10.222.0.33 "GET /compute/v2.1/servers/0a0849d6-0d06-418d-9429-24e1d6de8d3b" status: 200 len: 1563 microversion: 2.1 time: 0.198826 Oct 04 21:56:05.709915 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3619/7269] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:56:05 2022] GET /compute/v2.1/servers/0a0849d6-0d06-418d-9429-24e1d6de8d3b => generated 1563 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:56:05.734294 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-c1bee93c-a2a5-4a72-9989-e215ca257c7f tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:56:05.734963 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-c1bee93c-a2a5-4a72-9989-e215ca257c7f tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] [instance: 0a0849d6-0d06-418d-9429-24e1d6de8d3b] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:56:05.737779 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell0:SELECT=2 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:56:05.738512 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell0:SELECT=6 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:56:05.745295 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c1bee93c-a2a5-4a72-9989-e215ca257c7f tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:05.745813 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c1bee93c-a2a5-4a72-9989-e215ca257c7f tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:05.746280 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c1bee93c-a2a5-4a72-9989-e215ca257c7f tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:05.748083 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c1bee93c-a2a5-4a72-9989-e215ca257c7f tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:05.748533 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c1bee93c-a2a5-4a72-9989-e215ca257c7f tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:05.748989 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c1bee93c-a2a5-4a72-9989-e215ca257c7f tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:05.910878 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-c1bee93c-a2a5-4a72-9989-e215ca257c7f tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3527811c42647d99491111361f6479d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab94b4108b3c46a6b527f647f6184d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:56:05.922012 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-c1bee93c-a2a5-4a72-9989-e215ca257c7f tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] 10.222.0.33 "GET /compute/v2.1/servers/0a0849d6-0d06-418d-9429-24e1d6de8d3b" status: 200 len: 1563 microversion: 2.1 time: 0.192176 Oct 04 21:56:05.922745 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3651/7270] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:56:05 2022] GET /compute/v2.1/servers/0a0849d6-0d06-418d-9429-24e1d6de8d3b => generated 1563 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:56:08.317565 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ba770b83-92ef-4abc-b23d-91b9d1cd6139 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:56:08.318584 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-8044b7e6-0662-4c10-9932-269d30fc7ac8 req-4f70c8ed-6599-4932-ad86-c8acdde4bd60 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a0849d6-0d06-418d-9429-24e1d6de8d3b", "tag": "ca878321-cf03-4551-bc8e-c33547ecc4ae"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:56:08.319048 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ba770b83-92ef-4abc-b23d-91b9d1cd6139 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] [instance: 0a0849d6-0d06-418d-9429-24e1d6de8d3b] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:56:08.324114 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=6 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:56:08.330962 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ba770b83-92ef-4abc-b23d-91b9d1cd6139 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:08.331456 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ba770b83-92ef-4abc-b23d-91b9d1cd6139 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:08.332085 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ba770b83-92ef-4abc-b23d-91b9d1cd6139 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:08.332782 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ba770b83-92ef-4abc-b23d-91b9d1cd6139 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:08.333238 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ba770b83-92ef-4abc-b23d-91b9d1cd6139 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:08.333659 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ba770b83-92ef-4abc-b23d-91b9d1cd6139 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:08.338463 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-8044b7e6-0662-4c10-9932-269d30fc7ac8 req-4f70c8ed-6599-4932-ad86-c8acdde4bd60 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:08.339313 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-8044b7e6-0662-4c10-9932-269d30fc7ac8 req-4f70c8ed-6599-4932-ad86-c8acdde4bd60 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:08.340053 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-8044b7e6-0662-4c10-9932-269d30fc7ac8 req-4f70c8ed-6599-4932-ad86-c8acdde4bd60 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:08.354993 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-8044b7e6-0662-4c10-9932-269d30fc7ac8 req-4f70c8ed-6599-4932-ad86-c8acdde4bd60 service nova] Creating event network-changed:ca878321-cf03-4551-bc8e-c33547ecc4ae for instance 0a0849d6-0d06-418d-9429-24e1d6de8d3b on n-h2-854823-8 Oct 04 21:56:08.368274 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-8044b7e6-0662-4c10-9932-269d30fc7ac8 req-4f70c8ed-6599-4932-ad86-c8acdde4bd60 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055910 Oct 04 21:56:08.370112 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3652/7271] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:56:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:56:08.503259 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-ba770b83-92ef-4abc-b23d-91b9d1cd6139 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3527811c42647d99491111361f6479d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab94b4108b3c46a6b527f647f6184d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:56:08.511731 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ba770b83-92ef-4abc-b23d-91b9d1cd6139 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] 10.222.0.33 "GET /compute/v2.1/servers/0a0849d6-0d06-418d-9429-24e1d6de8d3b" status: 200 len: 1563 microversion: 2.1 time: 0.202583 Oct 04 21:56:08.512392 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3620/7272] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:56:08 2022] GET /compute/v2.1/servers/0a0849d6-0d06-418d-9429-24e1d6de8d3b => generated 1563 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:56:29.809440 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:56:29.810384 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=40 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:56:29.815185 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-e0572b28-8bb4-442f-baa0-beb9ac8d7790 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:56:29.817705 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-e0572b28-8bb4-442f-baa0-beb9ac8d7790 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] [instance: 0a0849d6-0d06-418d-9429-24e1d6de8d3b] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:56:29.827502 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e0572b28-8bb4-442f-baa0-beb9ac8d7790 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:29.828016 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e0572b28-8bb4-442f-baa0-beb9ac8d7790 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:29.828477 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e0572b28-8bb4-442f-baa0-beb9ac8d7790 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:29.829231 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e0572b28-8bb4-442f-baa0-beb9ac8d7790 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:29.829714 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e0572b28-8bb4-442f-baa0-beb9ac8d7790 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:29.830156 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e0572b28-8bb4-442f-baa0-beb9ac8d7790 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:29.909220 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-e0572b28-8bb4-442f-baa0-beb9ac8d7790 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] 10.222.0.33 "POST /compute/v2.1/servers/0a0849d6-0d06-418d-9429-24e1d6de8d3b/action" status: 200 len: 24564 microversion: 2.1 time: 0.101783 Oct 04 21:56:29.910711 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3653/7273] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 21:56:29 2022] POST /compute/v2.1/servers/0a0849d6-0d06-418d-9429-24e1d6de8d3b/action => generated 24564 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 21:56:41.003552 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-eba510e5-207b-4f56-b48a-4a098edba1e7 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:56:41.004173 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-eba510e5-207b-4f56-b48a-4a098edba1e7 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] [instance: 0a0849d6-0d06-418d-9429-24e1d6de8d3b] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:56:41.006585 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=7 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:56:41.007421 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=28 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:56:41.014686 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-eba510e5-207b-4f56-b48a-4a098edba1e7 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:41.015248 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-eba510e5-207b-4f56-b48a-4a098edba1e7 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:41.015775 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-eba510e5-207b-4f56-b48a-4a098edba1e7 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:41.016515 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-eba510e5-207b-4f56-b48a-4a098edba1e7 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:41.017072 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-eba510e5-207b-4f56-b48a-4a098edba1e7 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:41.017504 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-eba510e5-207b-4f56-b48a-4a098edba1e7 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:41.046218 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-eba510e5-207b-4f56-b48a-4a098edba1e7 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lazy-loading 'flavor' on Instance uuid 0a0849d6-0d06-418d-9429-24e1d6de8d3b {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:56:41.139627 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-eba510e5-207b-4f56-b48a-4a098edba1e7 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] 10.222.0.33 "POST /compute/v2.1/servers/0a0849d6-0d06-418d-9429-24e1d6de8d3b/action" status: 202 len: 0 microversion: 2.1 time: 0.141082 Oct 04 21:56:41.140283 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3621/7274] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 21:56:40 2022] POST /compute/v2.1/servers/0a0849d6-0d06-418d-9429-24e1d6de8d3b/action => generated 0 bytes in 143 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:56:41.150041 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-29f1a20f-676a-41b2-99c0-61c5da1fd6ea tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:56:41.151544 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-29f1a20f-676a-41b2-99c0-61c5da1fd6ea tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] [instance: 0a0849d6-0d06-418d-9429-24e1d6de8d3b] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:56:41.156309 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_api:SELECT=2 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:56:41.157413 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=4 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:56:41.169373 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-29f1a20f-676a-41b2-99c0-61c5da1fd6ea tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:41.169940 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-29f1a20f-676a-41b2-99c0-61c5da1fd6ea tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:41.170584 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-29f1a20f-676a-41b2-99c0-61c5da1fd6ea tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:41.171700 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-29f1a20f-676a-41b2-99c0-61c5da1fd6ea tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:41.172259 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-29f1a20f-676a-41b2-99c0-61c5da1fd6ea tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:41.172745 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-29f1a20f-676a-41b2-99c0-61c5da1fd6ea tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:41.343063 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-29f1a20f-676a-41b2-99c0-61c5da1fd6ea tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3527811c42647d99491111361f6479d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab94b4108b3c46a6b527f647f6184d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:56:41.352371 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-29f1a20f-676a-41b2-99c0-61c5da1fd6ea tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] 10.222.0.33 "GET /compute/v2.1/servers/0a0849d6-0d06-418d-9429-24e1d6de8d3b" status: 200 len: 1690 microversion: 2.1 time: 0.206749 Oct 04 21:56:41.352977 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3654/7275] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:56:41 2022] GET /compute/v2.1/servers/0a0849d6-0d06-418d-9429-24e1d6de8d3b => generated 1690 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:56:42.383906 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2b3fa8b5-8550-4e8e-9ead-b88dbea59cd9 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:56:42.385019 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-2b3fa8b5-8550-4e8e-9ead-b88dbea59cd9 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] [instance: 0a0849d6-0d06-418d-9429-24e1d6de8d3b] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:56:42.392589 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2b3fa8b5-8550-4e8e-9ead-b88dbea59cd9 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:42.393086 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2b3fa8b5-8550-4e8e-9ead-b88dbea59cd9 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:42.393534 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2b3fa8b5-8550-4e8e-9ead-b88dbea59cd9 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:42.394255 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2b3fa8b5-8550-4e8e-9ead-b88dbea59cd9 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:42.394822 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2b3fa8b5-8550-4e8e-9ead-b88dbea59cd9 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:42.395179 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-2b3fa8b5-8550-4e8e-9ead-b88dbea59cd9 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:42.562220 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-2b3fa8b5-8550-4e8e-9ead-b88dbea59cd9 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3527811c42647d99491111361f6479d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab94b4108b3c46a6b527f647f6184d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:56:42.577505 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-2b3fa8b5-8550-4e8e-9ead-b88dbea59cd9 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] 10.222.0.33 "GET /compute/v2.1/servers/0a0849d6-0d06-418d-9429-24e1d6de8d3b" status: 200 len: 1673 microversion: 2.1 time: 0.199701 Oct 04 21:56:42.578892 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3622/7276] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:56:42 2022] GET /compute/v2.1/servers/0a0849d6-0d06-418d-9429-24e1d6de8d3b => generated 1673 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:56:43.721849 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-e948b8d6-31e4-491c-855a-9cc591e278b7 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:56:43.724279 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-e948b8d6-31e4-491c-855a-9cc591e278b7 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] [instance: 0a0849d6-0d06-418d-9429-24e1d6de8d3b] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:56:43.733367 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e948b8d6-31e4-491c-855a-9cc591e278b7 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:43.733871 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e948b8d6-31e4-491c-855a-9cc591e278b7 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:43.734651 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e948b8d6-31e4-491c-855a-9cc591e278b7 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:43.735451 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e948b8d6-31e4-491c-855a-9cc591e278b7 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:43.735933 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e948b8d6-31e4-491c-855a-9cc591e278b7 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:43.736389 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-e948b8d6-31e4-491c-855a-9cc591e278b7 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:43.807050 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-e948b8d6-31e4-491c-855a-9cc591e278b7 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] 10.222.0.33 "POST /compute/v2.1/servers/0a0849d6-0d06-418d-9429-24e1d6de8d3b/action" status: 200 len: 38453 microversion: 2.1 time: 0.089068 Oct 04 21:56:43.807845 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3655/7277] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 21:56:43 2022] POST /compute/v2.1/servers/0a0849d6-0d06-418d-9429-24e1d6de8d3b/action => generated 38453 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 04 21:56:43.820373 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7d769d4e-f29b-4ac6-b5ea-42ed750e4f9e tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:56:43.820990 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-7d769d4e-f29b-4ac6-b5ea-42ed750e4f9e tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] [instance: 0a0849d6-0d06-418d-9429-24e1d6de8d3b] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:56:43.829615 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7d769d4e-f29b-4ac6-b5ea-42ed750e4f9e tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:43.830186 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7d769d4e-f29b-4ac6-b5ea-42ed750e4f9e tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:43.830798 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7d769d4e-f29b-4ac6-b5ea-42ed750e4f9e tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:43.831622 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7d769d4e-f29b-4ac6-b5ea-42ed750e4f9e tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:43.832124 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7d769d4e-f29b-4ac6-b5ea-42ed750e4f9e tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:43.832593 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7d769d4e-f29b-4ac6-b5ea-42ed750e4f9e tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:43.915131 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-7d769d4e-f29b-4ac6-b5ea-42ed750e4f9e tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] 10.222.0.33 "POST /compute/v2.1/servers/0a0849d6-0d06-418d-9429-24e1d6de8d3b/action" status: 202 len: 0 microversion: 2.1 time: 0.098457 Oct 04 21:56:43.916274 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3623/7278] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 21:56:43 2022] POST /compute/v2.1/servers/0a0849d6-0d06-418d-9429-24e1d6de8d3b/action => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:56:43.925921 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-15d27b31-9e9b-4351-8da7-34db5ab4fbfe tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:56:43.927492 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-15d27b31-9e9b-4351-8da7-34db5ab4fbfe tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] [instance: 0a0849d6-0d06-418d-9429-24e1d6de8d3b] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:56:43.935732 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-15d27b31-9e9b-4351-8da7-34db5ab4fbfe tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:43.936244 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-15d27b31-9e9b-4351-8da7-34db5ab4fbfe tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:43.937173 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-15d27b31-9e9b-4351-8da7-34db5ab4fbfe tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:43.938032 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-15d27b31-9e9b-4351-8da7-34db5ab4fbfe tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:43.938618 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-15d27b31-9e9b-4351-8da7-34db5ab4fbfe tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:43.939028 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-15d27b31-9e9b-4351-8da7-34db5ab4fbfe tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:44.100969 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-15d27b31-9e9b-4351-8da7-34db5ab4fbfe tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3527811c42647d99491111361f6479d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab94b4108b3c46a6b527f647f6184d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:56:44.110220 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-15d27b31-9e9b-4351-8da7-34db5ab4fbfe tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] 10.222.0.33 "GET /compute/v2.1/servers/0a0849d6-0d06-418d-9429-24e1d6de8d3b" status: 200 len: 1679 microversion: 2.1 time: 0.188942 Oct 04 21:56:44.110870 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3656/7279] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:56:43 2022] GET /compute/v2.1/servers/0a0849d6-0d06-418d-9429-24e1d6de8d3b => generated 1679 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:56:45.139012 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-27cbc2c0-9199-4590-be7e-b86f9eb19071 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:56:45.139726 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-27cbc2c0-9199-4590-be7e-b86f9eb19071 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] [instance: 0a0849d6-0d06-418d-9429-24e1d6de8d3b] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:56:45.147096 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-27cbc2c0-9199-4590-be7e-b86f9eb19071 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:45.147600 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-27cbc2c0-9199-4590-be7e-b86f9eb19071 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:45.148048 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-27cbc2c0-9199-4590-be7e-b86f9eb19071 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:45.148946 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-27cbc2c0-9199-4590-be7e-b86f9eb19071 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:45.149434 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-27cbc2c0-9199-4590-be7e-b86f9eb19071 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:45.149864 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-27cbc2c0-9199-4590-be7e-b86f9eb19071 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:45.333219 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-27cbc2c0-9199-4590-be7e-b86f9eb19071 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3527811c42647d99491111361f6479d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab94b4108b3c46a6b527f647f6184d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:56:45.348334 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-27cbc2c0-9199-4590-be7e-b86f9eb19071 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] 10.222.0.33 "GET /compute/v2.1/servers/0a0849d6-0d06-418d-9429-24e1d6de8d3b" status: 200 len: 1679 microversion: 2.1 time: 0.214356 Oct 04 21:56:45.349365 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3624/7280] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:56:45 2022] GET /compute/v2.1/servers/0a0849d6-0d06-418d-9429-24e1d6de8d3b => generated 1679 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:56:46.390299 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-530fdb31-c2b9-451f-ab23-2cb1c01fa7dc tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:56:46.391100 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-530fdb31-c2b9-451f-ab23-2cb1c01fa7dc tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] [instance: 0a0849d6-0d06-418d-9429-24e1d6de8d3b] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:56:46.400273 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-530fdb31-c2b9-451f-ab23-2cb1c01fa7dc tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:46.400962 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-530fdb31-c2b9-451f-ab23-2cb1c01fa7dc tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:46.401579 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-530fdb31-c2b9-451f-ab23-2cb1c01fa7dc tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:46.402540 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-530fdb31-c2b9-451f-ab23-2cb1c01fa7dc tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:46.403130 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-530fdb31-c2b9-451f-ab23-2cb1c01fa7dc tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:46.403851 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-530fdb31-c2b9-451f-ab23-2cb1c01fa7dc tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:46.566709 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-530fdb31-c2b9-451f-ab23-2cb1c01fa7dc tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3527811c42647d99491111361f6479d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab94b4108b3c46a6b527f647f6184d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:56:46.576283 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-530fdb31-c2b9-451f-ab23-2cb1c01fa7dc tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] 10.222.0.33 "GET /compute/v2.1/servers/0a0849d6-0d06-418d-9429-24e1d6de8d3b" status: 200 len: 1682 microversion: 2.1 time: 0.190616 Oct 04 21:56:46.577069 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3657/7281] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:56:46 2022] GET /compute/v2.1/servers/0a0849d6-0d06-418d-9429-24e1d6de8d3b => generated 1682 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:56:46.692928 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-89d2d0df-244f-4316-9ee6-3fa302e2ec5f tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:56:46.695831 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-89d2d0df-244f-4316-9ee6-3fa302e2ec5f tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] [instance: 0a0849d6-0d06-418d-9429-24e1d6de8d3b] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:56:46.704957 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-89d2d0df-244f-4316-9ee6-3fa302e2ec5f tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:46.705563 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-89d2d0df-244f-4316-9ee6-3fa302e2ec5f tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:46.706143 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-89d2d0df-244f-4316-9ee6-3fa302e2ec5f tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:46.707063 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-89d2d0df-244f-4316-9ee6-3fa302e2ec5f tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:46.707659 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-89d2d0df-244f-4316-9ee6-3fa302e2ec5f tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:46.708213 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-89d2d0df-244f-4316-9ee6-3fa302e2ec5f tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:46.780478 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-89d2d0df-244f-4316-9ee6-3fa302e2ec5f tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] 10.222.0.33 "POST /compute/v2.1/servers/0a0849d6-0d06-418d-9429-24e1d6de8d3b/action" status: 200 len: 38453 microversion: 2.1 time: 0.093041 Oct 04 21:56:46.781423 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3625/7282] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 21:56:46 2022] POST /compute/v2.1/servers/0a0849d6-0d06-418d-9429-24e1d6de8d3b/action => generated 38453 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 21:56:48.013449 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-1f3829a8-c71d-49b6-9ac4-1dcbdfef89f2 req-2f964de9-538e-4828-a0a7-176fa1ce72fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a0849d6-0d06-418d-9429-24e1d6de8d3b", "tag": "ca878321-cf03-4551-bc8e-c33547ecc4ae"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:56:48.014757 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-bec9dc52-541b-4d1a-ac23-e93ae3a788d7 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:56:48.015696 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-bec9dc52-541b-4d1a-ac23-e93ae3a788d7 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] [instance: 0a0849d6-0d06-418d-9429-24e1d6de8d3b] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:56:48.029553 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-1f3829a8-c71d-49b6-9ac4-1dcbdfef89f2 req-2f964de9-538e-4828-a0a7-176fa1ce72fb service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:48.029870 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bec9dc52-541b-4d1a-ac23-e93ae3a788d7 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:48.030478 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-1f3829a8-c71d-49b6-9ac4-1dcbdfef89f2 req-2f964de9-538e-4828-a0a7-176fa1ce72fb service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:48.030780 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bec9dc52-541b-4d1a-ac23-e93ae3a788d7 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:48.031548 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-1f3829a8-c71d-49b6-9ac4-1dcbdfef89f2 req-2f964de9-538e-4828-a0a7-176fa1ce72fb service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:48.031730 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bec9dc52-541b-4d1a-ac23-e93ae3a788d7 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:48.032938 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bec9dc52-541b-4d1a-ac23-e93ae3a788d7 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:48.033867 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bec9dc52-541b-4d1a-ac23-e93ae3a788d7 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:48.034714 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bec9dc52-541b-4d1a-ac23-e93ae3a788d7 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:48.049284 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-1f3829a8-c71d-49b6-9ac4-1dcbdfef89f2 req-2f964de9-538e-4828-a0a7-176fa1ce72fb service nova] Creating event network-changed:ca878321-cf03-4551-bc8e-c33547ecc4ae for instance 0a0849d6-0d06-418d-9429-24e1d6de8d3b on n-h2-854823-8 Oct 04 21:56:48.057707 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-1f3829a8-c71d-49b6-9ac4-1dcbdfef89f2 req-2f964de9-538e-4828-a0a7-176fa1ce72fb service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048732 Oct 04 21:56:48.059343 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3626/7283] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:56:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:56:48.090959 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-bec9dc52-541b-4d1a-ac23-e93ae3a788d7 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] [instance: 0a0849d6-0d06-418d-9429-24e1d6de8d3b] Going to try to terminate instance {{(pid=128802) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 21:56:48.236337 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-bec9dc52-541b-4d1a-ac23-e93ae3a788d7 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] 10.222.0.33 "DELETE /compute/v2.1/servers/0a0849d6-0d06-418d-9429-24e1d6de8d3b" status: 204 len: 0 microversion: 2.1 time: 0.230643 Oct 04 21:56:48.237165 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3658/7284] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 21:56:48 2022] DELETE /compute/v2.1/servers/0a0849d6-0d06-418d-9429-24e1d6de8d3b => generated 0 bytes in 233 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 21:56:48.254886 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f3448cce-f5fe-4e9b-a06a-4d2844ec3c4b tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:56:48.256253 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f3448cce-f5fe-4e9b-a06a-4d2844ec3c4b tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] [instance: 0a0849d6-0d06-418d-9429-24e1d6de8d3b] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:56:48.271322 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f3448cce-f5fe-4e9b-a06a-4d2844ec3c4b tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:48.272226 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f3448cce-f5fe-4e9b-a06a-4d2844ec3c4b tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:48.273035 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f3448cce-f5fe-4e9b-a06a-4d2844ec3c4b tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:48.274368 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f3448cce-f5fe-4e9b-a06a-4d2844ec3c4b tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:48.275252 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f3448cce-f5fe-4e9b-a06a-4d2844ec3c4b tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:48.276045 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f3448cce-f5fe-4e9b-a06a-4d2844ec3c4b tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:48.456168 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f3448cce-f5fe-4e9b-a06a-4d2844ec3c4b tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3527811c42647d99491111361f6479d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab94b4108b3c46a6b527f647f6184d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:56:48.466800 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f3448cce-f5fe-4e9b-a06a-4d2844ec3c4b tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] 10.222.0.33 "GET /compute/v2.1/servers/0a0849d6-0d06-418d-9429-24e1d6de8d3b" status: 200 len: 1688 microversion: 2.1 time: 0.222549 Oct 04 21:56:48.467521 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3627/7285] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:56:48 2022] GET /compute/v2.1/servers/0a0849d6-0d06-418d-9429-24e1d6de8d3b => generated 1688 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:56:49.511599 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-00bfec7f-322f-4bfe-9474-7f100b957b44 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:56:49.512321 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-00bfec7f-322f-4bfe-9474-7f100b957b44 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] [instance: 0a0849d6-0d06-418d-9429-24e1d6de8d3b] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:56:49.520446 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-00bfec7f-322f-4bfe-9474-7f100b957b44 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:49.520997 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-00bfec7f-322f-4bfe-9474-7f100b957b44 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:49.521452 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-00bfec7f-322f-4bfe-9474-7f100b957b44 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:49.522201 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-00bfec7f-322f-4bfe-9474-7f100b957b44 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:49.522732 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-00bfec7f-322f-4bfe-9474-7f100b957b44 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:49.523176 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-00bfec7f-322f-4bfe-9474-7f100b957b44 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:49.782613 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-00bfec7f-322f-4bfe-9474-7f100b957b44 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3527811c42647d99491111361f6479d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab94b4108b3c46a6b527f647f6184d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:56:49.799339 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-00bfec7f-322f-4bfe-9474-7f100b957b44 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] 10.222.0.33 "GET /compute/v2.1/servers/0a0849d6-0d06-418d-9429-24e1d6de8d3b" status: 200 len: 1688 microversion: 2.1 time: 0.292652 Oct 04 21:56:49.800338 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3659/7286] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:56:49 2022] GET /compute/v2.1/servers/0a0849d6-0d06-418d-9429-24e1d6de8d3b => generated 1688 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:56:50.477130 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-2377423c-835b-4bd5-9726-25aaeb023c2b req-635570e0-ffd9-4751-bdf0-d60226b8734c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a0849d6-0d06-418d-9429-24e1d6de8d3b", "name": "network-vif-deleted", "tag": "ca878321-cf03-4551-bc8e-c33547ecc4ae"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:56:50.492201 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-2377423c-835b-4bd5-9726-25aaeb023c2b req-635570e0-ffd9-4751-bdf0-d60226b8734c service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:50.492796 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-2377423c-835b-4bd5-9726-25aaeb023c2b req-635570e0-ffd9-4751-bdf0-d60226b8734c service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:50.493239 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-2377423c-835b-4bd5-9726-25aaeb023c2b req-635570e0-ffd9-4751-bdf0-d60226b8734c service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:50.506960 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-2377423c-835b-4bd5-9726-25aaeb023c2b req-635570e0-ffd9-4751-bdf0-d60226b8734c service nova] Creating event network-vif-deleted:ca878321-cf03-4551-bc8e-c33547ecc4ae for instance 0a0849d6-0d06-418d-9429-24e1d6de8d3b on n-h2-854823-8 Oct 04 21:56:50.513293 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-2377423c-835b-4bd5-9726-25aaeb023c2b req-635570e0-ffd9-4751-bdf0-d60226b8734c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041446 Oct 04 21:56:50.513924 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3628/7287] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:56:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:56:50.833846 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-a3883ce6-e6de-409a-bf8c-86d3cbac60ec tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:56:50.834680 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-a3883ce6-e6de-409a-bf8c-86d3cbac60ec tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] [instance: 0a0849d6-0d06-418d-9429-24e1d6de8d3b] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:56:50.843291 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a3883ce6-e6de-409a-bf8c-86d3cbac60ec tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:50.843808 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a3883ce6-e6de-409a-bf8c-86d3cbac60ec tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:50.844269 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a3883ce6-e6de-409a-bf8c-86d3cbac60ec tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:50.845022 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a3883ce6-e6de-409a-bf8c-86d3cbac60ec tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:50.845505 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a3883ce6-e6de-409a-bf8c-86d3cbac60ec tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:50.845956 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a3883ce6-e6de-409a-bf8c-86d3cbac60ec tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:50.883898 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a3883ce6-e6de-409a-bf8c-86d3cbac60ec tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:50.884452 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a3883ce6-e6de-409a-bf8c-86d3cbac60ec tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:50.884914 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a3883ce6-e6de-409a-bf8c-86d3cbac60ec tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:50.885395 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.objects.instance [None req-a3883ce6-e6de-409a-bf8c-86d3cbac60ec tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lazy-loading 'fault' on Instance uuid 0a0849d6-0d06-418d-9429-24e1d6de8d3b {{(pid=128802) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:56:50.936740 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-a3883ce6-e6de-409a-bf8c-86d3cbac60ec tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3527811c42647d99491111361f6479d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab94b4108b3c46a6b527f647f6184d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:56:50.945191 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-a3883ce6-e6de-409a-bf8c-86d3cbac60ec tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] 10.222.0.33 "GET /compute/v2.1/servers/0a0849d6-0d06-418d-9429-24e1d6de8d3b" status: 200 len: 1356 microversion: 2.1 time: 0.115665 Oct 04 21:56:50.945797 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3660/7288] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:56:50 2022] GET /compute/v2.1/servers/0a0849d6-0d06-418d-9429-24e1d6de8d3b => generated 1356 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:56:51.977139 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-034bb450-eb6c-4055-be13-019744cafe25 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:56:51.977880 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-034bb450-eb6c-4055-be13-019744cafe25 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] [instance: 0a0849d6-0d06-418d-9429-24e1d6de8d3b] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:56:51.985021 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-034bb450-eb6c-4055-be13-019744cafe25 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:51.985507 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-034bb450-eb6c-4055-be13-019744cafe25 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:51.985943 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-034bb450-eb6c-4055-be13-019744cafe25 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:51.986676 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-034bb450-eb6c-4055-be13-019744cafe25 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:56:51.987143 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-034bb450-eb6c-4055-be13-019744cafe25 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:56:51.987571 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-034bb450-eb6c-4055-be13-019744cafe25 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:56:52.003295 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-034bb450-eb6c-4055-be13-019744cafe25 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] HTTP exception thrown: Instance 0a0849d6-0d06-418d-9429-24e1d6de8d3b could not be found. Oct 04 21:56:52.004975 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-034bb450-eb6c-4055-be13-019744cafe25 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Request method failure captured: Oct 04 21:56:52.004975 n-d-854823-8 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/0a0849d6-0d06-418d-9429-24e1d6de8d3b HTTP/1.1 Oct 04 21:56:52.004975 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 21:56:52.004975 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 21:56:52.004975 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 21:56:52.004975 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 0 Oct 04 21:56:52.004975 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 21:56:52.004975 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 21:56:52.004975 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 21:56:52.004975 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 21:56:52.004975 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPKpBWf-ZdDHioKk7j1GCDpSV4CNRjR-HsBeRw5uM8vLVrE4RAbnqqIyB__lIo4YB-nPYiZgBfW-sd_MC5MrdTXH2d0mlcXhungwp23-mUfKzbPqcsQDk2EjQ-fmeT9DeObGTOq1tP4JZSLD8LNhyn4WTlxw8LmfuqpFt38X2o1fTW7c Oct 04 21:56:52.004975 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 21:56:52.004975 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 21:56:52.004975 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 21:56:52.004975 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 21:56:52.004975 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 21:56:52.004975 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 21:56:52.004975 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: ab94b4108b3c46a6b527f647f6184d9f Oct 04 21:56:52.004975 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-2019967856 Oct 04 21:56:52.004975 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 21:56:52.004975 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 21:56:52.004975 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ab94b4108b3c46a6b527f647f6184d9f", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ab94b4108b3c46a6b527f647f6184d9f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ab94b4108b3c46a6b527f647f6184d9f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ab94b4108b3c46a6b527f647f6184d9f"}]}] Oct 04 21:56:52.004975 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-TestNetworkAdvancedServerOps-2019967856 Oct 04 21:56:52.004975 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: ab94b4108b3c46a6b527f647f6184d9f Oct 04 21:56:52.004975 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-2019967856 Oct 04 21:56:52.004975 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-TestNetworkAdvancedServerOps-2019967856-project Oct 04 21:56:52.004975 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 21:56:52.004975 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 21:56:52.004975 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: e3527811c42647d99491111361f6479d Oct 04 21:56:52.004975 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-TestNetworkAdvancedServerOps-2019967856-project Oct 04 21:56:52.004975 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 21:56:52.004975 n-d-854823-8 devstack@n-api.service[128801]: exception: Instance 0a0849d6-0d06-418d-9429-24e1d6de8d3b could not be found. Oct 04 21:56:52.004975 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': '0a0849d6-0d06-418d-9429-24e1d6de8d3b'} Oct 04 21:56:52.004975 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 21:56:52.004975 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:56:52.004975 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 21:56:52.004975 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 21:56:52.004975 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 21:56:52.004975 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 21:56:52.004975 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 21:56:52.004975 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 21:56:52.004975 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 21:56:52.004975 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 21:56:52.004975 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a0849d6-0d06-418d-9429-24e1d6de8d3b could not be found. Oct 04 21:56:52.004975 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:56:52.004975 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:56:52.004975 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:56:52.004975 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:56:52.004975 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:56:52.004975 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:56:52.004975 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 21:56:52.004975 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 21:56:52.004975 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 21:56:52.004975 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 21:56:52.004975 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 21:56:52.004975 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 21:56:52.004975 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 21:56:52.004975 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 21:56:52.004975 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 21:56:52.004975 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 21:56:52.004975 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a0849d6-0d06-418d-9429-24e1d6de8d3b could not be found. Oct 04 21:56:52.004975 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:56:52.004975 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 21:56:52.009854 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:56:52.009854 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 21:56:52.009854 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 21:56:52.009854 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 21:56:52.009854 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 21:56:52.009854 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 21:56:52.009854 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a0849d6-0d06-418d-9429-24e1d6de8d3b could not be found. Oct 04 21:56:52.009854 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 21:56:52.009854 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-034bb450-eb6c-4055-be13-019744cafe25 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Returning 404 to user: Instance 0a0849d6-0d06-418d-9429-24e1d6de8d3b could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 21:56:52.009854 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-034bb450-eb6c-4055-be13-019744cafe25 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] 10.222.0.33 "GET /compute/v2.1/servers/0a0849d6-0d06-418d-9429-24e1d6de8d3b" status: 404 len: 111 microversion: 2.1 time: 0.034771 Oct 04 21:56:52.009854 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3629/7289] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:56:51 2022] GET /compute/v2.1/servers/0a0849d6-0d06-418d-9429-24e1d6de8d3b => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 21:56:56.147923 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-3caeae03-ccf6-4f76-8e90-6fe8be6f83a7 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] Calling method '.version_select at 0x7f3c789ee940>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:56:56.195209 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-3caeae03-ccf6-4f76-8e90-6fe8be6f83a7 tempest-TestNetworkAdvancedServerOps-2019967856 tempest-TestNetworkAdvancedServerOps-2019967856-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-792810848" status: 202 len: 0 microversion: 2.1 time: 0.058254 Oct 04 21:56:56.195959 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3661/7290] 10.222.0.33 () {58 vars in 1281 bytes} [Tue Oct 4 21:56:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-792810848 => generated 0 bytes in 60 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:57:11.368013 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=18 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:57:11.370114 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:57:11.658239 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2b6e842b-704e-4931-a0de-ff1f90822216 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Action: 'create', calling method: .version_select at 0x7f3c74f3d9d0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1554978053", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHTB3mn0suvaLXsMlL3I6T8gZ89PD2Tnx6PZ4LAY7zfJZ5DRPpyORxy3mXDFUwxsI1vu70iIip6dQaufGdZv0SH2FkoshDTtsYxF6ndC/4YbAWbnzEgxX0I6z3RCSYQUpQ=="}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:57:11.676758 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-2b6e842b-704e-4931-a0de-ff1f90822216 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Getting quotas for project 9368c1a74d4c4acc8fdcd2d62c422c4c. Resources: {'key_pairs'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:57:11.684495 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-2b6e842b-704e-4931-a0de-ff1f90822216 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Getting quotas for user 9974484d7a01444184df6535e11c34ab and project 9368c1a74d4c4acc8fdcd2d62c422c4c. Resources: {'key_pairs'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:57:11.720736 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-2b6e842b-704e-4931-a0de-ff1f90822216 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.358801 Oct 04 21:57:11.721389 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3630/7291] 10.222.0.33 () {60 vars in 1159 bytes} [Tue Oct 4 21:57:11 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:57:13.206043 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:57:13.206949 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:57:13.211208 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-a40225a4-07f6-46e5-bdfb-e8805afb3e64 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1570463134", "imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1554978053", "security_groups": [{"name": "tempest-secgroup-smoke-2012078473"}], "networks": [{"uuid": "442c1ff0-eab6-4738-8687-a1aabe144e60"}]}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:57:13.391088 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.network.neutron [None req-a40225a4-07f6-46e5-bdfb-e8805afb3e64 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] validate_networks() for [('442c1ff0-eab6-4738-8687-a1aabe144e60', None, None, None, None, None)] {{(pid=128802) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 21:57:14.085383 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-a40225a4-07f6-46e5-bdfb-e8805afb3e64 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Flavor limits 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 21:57:14.086979 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-a40225a4-07f6-46e5-bdfb-e8805afb3e64 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Image limits 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 21:57:14.088352 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-a40225a4-07f6-46e5-bdfb-e8805afb3e64 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Flavor pref 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 21:57:14.089865 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-a40225a4-07f6-46e5-bdfb-e8805afb3e64 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Image pref 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 21:57:14.090807 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-a40225a4-07f6-46e5-bdfb-e8805afb3e64 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 21:57:14.106745 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a40225a4-07f6-46e5-bdfb-e8805afb3e64 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:14.107382 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a40225a4-07f6-46e5-bdfb-e8805afb3e64 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:14.107935 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a40225a4-07f6-46e5-bdfb-e8805afb3e64 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:14.109243 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a40225a4-07f6-46e5-bdfb-e8805afb3e64 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:14.109958 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a40225a4-07f6-46e5-bdfb-e8805afb3e64 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:14.110690 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a40225a4-07f6-46e5-bdfb-e8805afb3e64 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:14.140075 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-a40225a4-07f6-46e5-bdfb-e8805afb3e64 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Getting quotas for project 9368c1a74d4c4acc8fdcd2d62c422c4c. Resources: {'ram', 'instances', 'cores'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 21:57:14.149687 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-a40225a4-07f6-46e5-bdfb-e8805afb3e64 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Getting quotas for user 9974484d7a01444184df6535e11c34ab and project 9368c1a74d4c4acc8fdcd2d62c422c4c. Resources: {'ram', 'instances', 'cores'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 21:57:14.172313 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-a40225a4-07f6-46e5-bdfb-e8805afb3e64 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Going to run 1 instances... {{(pid=128802) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 21:57:14.176341 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-a40225a4-07f6-46e5-bdfb-e8805afb3e64 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] [instance: 9b4e6a1f-04ba-4ac0-b9fc-0c1f2a27c518] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='15b24725-0c99-4bcf-b1fb-907cdf8e2d63',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128802) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 21:57:14.240680 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-a40225a4-07f6-46e5-bdfb-e8805afb3e64 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.035891 Oct 04 21:57:14.241727 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3662/7292] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 21:57:13 2022] POST /compute/v2.1/servers => generated 406 bytes in 1038 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 21:57:14.261495 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8701daf5-c9b1-4341-b571-09c218c0b6ae tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:57:14.264471 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-8701daf5-c9b1-4341-b571-09c218c0b6ae tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] [instance: 9b4e6a1f-04ba-4ac0-b9fc-0c1f2a27c518] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:57:14.539859 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-8701daf5-c9b1-4341-b571-09c218c0b6ae tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9974484d7a01444184df6535e11c34ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9368c1a74d4c4acc8fdcd2d62c422c4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:57:14.552207 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-8701daf5-c9b1-4341-b571-09c218c0b6ae tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] 10.222.0.33 "GET /compute/v2.1/servers/9b4e6a1f-04ba-4ac0-b9fc-0c1f2a27c518" status: 200 len: 1247 microversion: 2.1 time: 0.297782 Oct 04 21:57:14.553835 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3631/7293] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:57:14 2022] GET /compute/v2.1/servers/9b4e6a1f-04ba-4ac0-b9fc-0c1f2a27c518 => generated 1247 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:57:15.592099 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-7a6f2c2e-4c99-4bdb-88ee-936547cf64d4 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:57:15.594004 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-7a6f2c2e-4c99-4bdb-88ee-936547cf64d4 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] [instance: 9b4e6a1f-04ba-4ac0-b9fc-0c1f2a27c518] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:57:15.606912 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7a6f2c2e-4c99-4bdb-88ee-936547cf64d4 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:15.607551 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7a6f2c2e-4c99-4bdb-88ee-936547cf64d4 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:15.608250 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7a6f2c2e-4c99-4bdb-88ee-936547cf64d4 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:15.609317 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7a6f2c2e-4c99-4bdb-88ee-936547cf64d4 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:15.610054 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7a6f2c2e-4c99-4bdb-88ee-936547cf64d4 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:15.610760 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-7a6f2c2e-4c99-4bdb-88ee-936547cf64d4 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:15.706461 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-7a6f2c2e-4c99-4bdb-88ee-936547cf64d4 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9974484d7a01444184df6535e11c34ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9368c1a74d4c4acc8fdcd2d62c422c4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:57:15.716554 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-7a6f2c2e-4c99-4bdb-88ee-936547cf64d4 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] 10.222.0.33 "GET /compute/v2.1/servers/9b4e6a1f-04ba-4ac0-b9fc-0c1f2a27c518" status: 200 len: 1299 microversion: 2.1 time: 0.129384 Oct 04 21:57:15.717181 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3663/7294] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:57:15 2022] GET /compute/v2.1/servers/9b4e6a1f-04ba-4ac0-b9fc-0c1f2a27c518 => generated 1299 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:57:16.746960 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-cd95cdd3-622b-4d2e-af2d-7f578545bbff tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:57:16.748312 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-cd95cdd3-622b-4d2e-af2d-7f578545bbff tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] [instance: 9b4e6a1f-04ba-4ac0-b9fc-0c1f2a27c518] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:57:16.794492 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cd95cdd3-622b-4d2e-af2d-7f578545bbff tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:16.795927 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cd95cdd3-622b-4d2e-af2d-7f578545bbff tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:16.796870 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cd95cdd3-622b-4d2e-af2d-7f578545bbff tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:16.798666 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cd95cdd3-622b-4d2e-af2d-7f578545bbff tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:16.800275 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cd95cdd3-622b-4d2e-af2d-7f578545bbff tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:16.801418 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-cd95cdd3-622b-4d2e-af2d-7f578545bbff tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:17.175588 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-cd95cdd3-622b-4d2e-af2d-7f578545bbff tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9974484d7a01444184df6535e11c34ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9368c1a74d4c4acc8fdcd2d62c422c4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:57:17.199687 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-cd95cdd3-622b-4d2e-af2d-7f578545bbff tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] 10.222.0.33 "GET /compute/v2.1/servers/9b4e6a1f-04ba-4ac0-b9fc-0c1f2a27c518" status: 200 len: 1373 microversion: 2.1 time: 0.461047 Oct 04 21:57:17.204253 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3632/7295] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:57:16 2022] GET /compute/v2.1/servers/9b4e6a1f-04ba-4ac0-b9fc-0c1f2a27c518 => generated 1373 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:57:18.146832 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-1f55e276-bf74-482e-8784-04fcd95d9aed req-6a7cc83e-f04e-447f-84c7-faa3d4851b59 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b4e6a1f-04ba-4ac0-b9fc-0c1f2a27c518", "tag": "16ba2b23-25c7-4569-aa26-e10bda71d555"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:57:18.159716 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-1f55e276-bf74-482e-8784-04fcd95d9aed req-6a7cc83e-f04e-447f-84c7-faa3d4851b59 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:18.160212 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-1f55e276-bf74-482e-8784-04fcd95d9aed req-6a7cc83e-f04e-447f-84c7-faa3d4851b59 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:18.160660 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-1f55e276-bf74-482e-8784-04fcd95d9aed req-6a7cc83e-f04e-447f-84c7-faa3d4851b59 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:18.173702 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-1f55e276-bf74-482e-8784-04fcd95d9aed req-6a7cc83e-f04e-447f-84c7-faa3d4851b59 service nova] Creating event network-changed:16ba2b23-25c7-4569-aa26-e10bda71d555 for instance 9b4e6a1f-04ba-4ac0-b9fc-0c1f2a27c518 on n-h2-854823-8 Oct 04 21:57:18.179356 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-1f55e276-bf74-482e-8784-04fcd95d9aed req-6a7cc83e-f04e-447f-84c7-faa3d4851b59 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.161548 Oct 04 21:57:18.180109 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3664/7296] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:57:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:57:18.251647 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-35a11c19-16ba-484b-858b-c9dc2906fc67 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:57:18.253846 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-35a11c19-16ba-484b-858b-c9dc2906fc67 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] [instance: 9b4e6a1f-04ba-4ac0-b9fc-0c1f2a27c518] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:57:18.270225 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-35a11c19-16ba-484b-858b-c9dc2906fc67 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:18.271850 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-35a11c19-16ba-484b-858b-c9dc2906fc67 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:18.273070 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-35a11c19-16ba-484b-858b-c9dc2906fc67 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:18.274821 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-35a11c19-16ba-484b-858b-c9dc2906fc67 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:18.276108 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-35a11c19-16ba-484b-858b-c9dc2906fc67 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:18.277600 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-35a11c19-16ba-484b-858b-c9dc2906fc67 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:18.665366 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-35a11c19-16ba-484b-858b-c9dc2906fc67 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9974484d7a01444184df6535e11c34ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9368c1a74d4c4acc8fdcd2d62c422c4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:57:18.678310 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-35a11c19-16ba-484b-858b-c9dc2906fc67 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] 10.222.0.33 "GET /compute/v2.1/servers/9b4e6a1f-04ba-4ac0-b9fc-0c1f2a27c518" status: 200 len: 1373 microversion: 2.1 time: 0.435035 Oct 04 21:57:18.679301 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3633/7297] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:57:18 2022] GET /compute/v2.1/servers/9b4e6a1f-04ba-4ac0-b9fc-0c1f2a27c518 => generated 1373 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:57:19.709486 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-c3bd8c69-ed0e-427d-a9d5-881f25c4a99b tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:57:19.710602 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-c3bd8c69-ed0e-427d-a9d5-881f25c4a99b tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] [instance: 9b4e6a1f-04ba-4ac0-b9fc-0c1f2a27c518] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:57:19.720174 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c3bd8c69-ed0e-427d-a9d5-881f25c4a99b tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:19.721037 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c3bd8c69-ed0e-427d-a9d5-881f25c4a99b tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:19.721789 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c3bd8c69-ed0e-427d-a9d5-881f25c4a99b tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:19.723369 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c3bd8c69-ed0e-427d-a9d5-881f25c4a99b tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:19.724184 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c3bd8c69-ed0e-427d-a9d5-881f25c4a99b tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:19.724928 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c3bd8c69-ed0e-427d-a9d5-881f25c4a99b tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:20.002027 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-c3bd8c69-ed0e-427d-a9d5-881f25c4a99b tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9974484d7a01444184df6535e11c34ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9368c1a74d4c4acc8fdcd2d62c422c4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:57:20.012669 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-c3bd8c69-ed0e-427d-a9d5-881f25c4a99b tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] 10.222.0.33 "GET /compute/v2.1/servers/9b4e6a1f-04ba-4ac0-b9fc-0c1f2a27c518" status: 200 len: 1373 microversion: 2.1 time: 0.312111 Oct 04 21:57:20.013538 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3665/7298] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:57:19 2022] GET /compute/v2.1/servers/9b4e6a1f-04ba-4ac0-b9fc-0c1f2a27c518 => generated 1373 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:57:21.038148 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-62a391b9-5255-459b-b74c-bc80b30c1cc5 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:57:21.039561 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-62a391b9-5255-459b-b74c-bc80b30c1cc5 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] [instance: 9b4e6a1f-04ba-4ac0-b9fc-0c1f2a27c518] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:57:21.042703 n-d-854823-8 devstack@n-api.service[128801]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 21:57:21.042997 n-d-854823-8 devstack@n-api.service[128801]: Tue Oct 4 21:57:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9b4e6a1f-04ba-4ac0-b9fc-0c1f2a27c518 (ip 10.222.0.33) !!! Oct 04 21:57:21.056253 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-62a391b9-5255-459b-b74c-bc80b30c1cc5 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:21.057427 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-62a391b9-5255-459b-b74c-bc80b30c1cc5 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:21.058032 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-62a391b9-5255-459b-b74c-bc80b30c1cc5 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:21.059065 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-62a391b9-5255-459b-b74c-bc80b30c1cc5 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:21.059820 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-62a391b9-5255-459b-b74c-bc80b30c1cc5 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:21.060418 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-62a391b9-5255-459b-b74c-bc80b30c1cc5 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:21.309749 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-62a391b9-5255-459b-b74c-bc80b30c1cc5 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9974484d7a01444184df6535e11c34ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9368c1a74d4c4acc8fdcd2d62c422c4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:57:21.322052 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-62a391b9-5255-459b-b74c-bc80b30c1cc5 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] 10.222.0.33 "GET /compute/v2.1/servers/9b4e6a1f-04ba-4ac0-b9fc-0c1f2a27c518" status: 200 len: 1373 microversion: 2.1 time: 0.288359 Oct 04 21:57:21.323772 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3634/7299] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:57:21 2022] GET /compute/v2.1/servers/9b4e6a1f-04ba-4ac0-b9fc-0c1f2a27c518 => generated 1373 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:57:22.357614 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-d945d8b4-8305-49a5-b417-86262897a915 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:57:22.358248 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-d945d8b4-8305-49a5-b417-86262897a915 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] [instance: 9b4e6a1f-04ba-4ac0-b9fc-0c1f2a27c518] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:57:22.365692 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d945d8b4-8305-49a5-b417-86262897a915 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:22.366199 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d945d8b4-8305-49a5-b417-86262897a915 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:22.366698 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d945d8b4-8305-49a5-b417-86262897a915 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:22.367428 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d945d8b4-8305-49a5-b417-86262897a915 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:22.367897 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d945d8b4-8305-49a5-b417-86262897a915 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:22.368335 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d945d8b4-8305-49a5-b417-86262897a915 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:22.517466 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-d945d8b4-8305-49a5-b417-86262897a915 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9974484d7a01444184df6535e11c34ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9368c1a74d4c4acc8fdcd2d62c422c4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:57:22.526683 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-d945d8b4-8305-49a5-b417-86262897a915 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] 10.222.0.33 "GET /compute/v2.1/servers/9b4e6a1f-04ba-4ac0-b9fc-0c1f2a27c518" status: 200 len: 1373 microversion: 2.1 time: 0.173612 Oct 04 21:57:22.527288 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3666/7300] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:57:22 2022] GET /compute/v2.1/servers/9b4e6a1f-04ba-4ac0-b9fc-0c1f2a27c518 => generated 1373 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:57:22.748898 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-61664017-80a2-4361-8272-f4412569bbb2 req-e4873d61-8913-4a26-be64-28243333b53e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b4e6a1f-04ba-4ac0-b9fc-0c1f2a27c518", "name": "network-vif-plugged", "status": "completed", "tag": "16ba2b23-25c7-4569-aa26-e10bda71d555"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:57:22.766159 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-61664017-80a2-4361-8272-f4412569bbb2 req-e4873d61-8913-4a26-be64-28243333b53e service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:22.766830 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-61664017-80a2-4361-8272-f4412569bbb2 req-e4873d61-8913-4a26-be64-28243333b53e service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:22.767478 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-61664017-80a2-4361-8272-f4412569bbb2 req-e4873d61-8913-4a26-be64-28243333b53e service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:22.785315 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-61664017-80a2-4361-8272-f4412569bbb2 req-e4873d61-8913-4a26-be64-28243333b53e service nova] Creating event network-vif-plugged:16ba2b23-25c7-4569-aa26-e10bda71d555 for instance 9b4e6a1f-04ba-4ac0-b9fc-0c1f2a27c518 on n-h2-854823-8 Oct 04 21:57:22.795817 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-61664017-80a2-4361-8272-f4412569bbb2 req-e4873d61-8913-4a26-be64-28243333b53e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051842 Oct 04 21:57:22.796636 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3635/7301] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:57:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:57:23.551644 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-b2fc515c-3109-4bbd-999a-d3c501ed77f8 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:57:23.552665 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-b2fc515c-3109-4bbd-999a-d3c501ed77f8 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] [instance: 9b4e6a1f-04ba-4ac0-b9fc-0c1f2a27c518] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:57:23.560652 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b2fc515c-3109-4bbd-999a-d3c501ed77f8 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:23.561156 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b2fc515c-3109-4bbd-999a-d3c501ed77f8 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:23.561611 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b2fc515c-3109-4bbd-999a-d3c501ed77f8 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:23.562376 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b2fc515c-3109-4bbd-999a-d3c501ed77f8 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:23.562916 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b2fc515c-3109-4bbd-999a-d3c501ed77f8 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:23.563558 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b2fc515c-3109-4bbd-999a-d3c501ed77f8 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:23.738658 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-b2fc515c-3109-4bbd-999a-d3c501ed77f8 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9974484d7a01444184df6535e11c34ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9368c1a74d4c4acc8fdcd2d62c422c4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:57:23.747943 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-b2fc515c-3109-4bbd-999a-d3c501ed77f8 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] 10.222.0.33 "GET /compute/v2.1/servers/9b4e6a1f-04ba-4ac0-b9fc-0c1f2a27c518" status: 200 len: 1373 microversion: 2.1 time: 0.200849 Oct 04 21:57:23.748552 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3667/7302] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:57:23 2022] GET /compute/v2.1/servers/9b4e6a1f-04ba-4ac0-b9fc-0c1f2a27c518 => generated 1373 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:57:24.785553 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=6 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:57:24.791506 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d24aeb86-4563-4565-a135-c3bf4382afd2 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:57:24.792242 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d24aeb86-4563-4565-a135-c3bf4382afd2 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] [instance: 9b4e6a1f-04ba-4ac0-b9fc-0c1f2a27c518] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:57:24.799699 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d24aeb86-4563-4565-a135-c3bf4382afd2 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:24.800383 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d24aeb86-4563-4565-a135-c3bf4382afd2 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:24.800894 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d24aeb86-4563-4565-a135-c3bf4382afd2 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:24.801657 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d24aeb86-4563-4565-a135-c3bf4382afd2 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:24.802149 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d24aeb86-4563-4565-a135-c3bf4382afd2 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:24.802649 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d24aeb86-4563-4565-a135-c3bf4382afd2 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:24.965178 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d24aeb86-4563-4565-a135-c3bf4382afd2 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9974484d7a01444184df6535e11c34ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9368c1a74d4c4acc8fdcd2d62c422c4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:57:24.974292 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d24aeb86-4563-4565-a135-c3bf4382afd2 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] 10.222.0.33 "GET /compute/v2.1/servers/9b4e6a1f-04ba-4ac0-b9fc-0c1f2a27c518" status: 200 len: 1556 microversion: 2.1 time: 0.190838 Oct 04 21:57:24.975202 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3636/7303] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:57:24 2022] GET /compute/v2.1/servers/9b4e6a1f-04ba-4ac0-b9fc-0c1f2a27c518 => generated 1556 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:57:25.003283 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-2af4acde-846e-46ad-b719-055091b2f1d6 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:57:25.003988 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-2af4acde-846e-46ad-b719-055091b2f1d6 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] [instance: 9b4e6a1f-04ba-4ac0-b9fc-0c1f2a27c518] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:57:25.006122 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell0:SELECT=2 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:57:25.006855 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell0:SELECT=6 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:57:25.014649 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2af4acde-846e-46ad-b719-055091b2f1d6 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:25.015168 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2af4acde-846e-46ad-b719-055091b2f1d6 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:25.015625 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2af4acde-846e-46ad-b719-055091b2f1d6 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:25.016556 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2af4acde-846e-46ad-b719-055091b2f1d6 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:25.017071 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2af4acde-846e-46ad-b719-055091b2f1d6 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:25.017523 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2af4acde-846e-46ad-b719-055091b2f1d6 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:25.181799 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-2af4acde-846e-46ad-b719-055091b2f1d6 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9974484d7a01444184df6535e11c34ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9368c1a74d4c4acc8fdcd2d62c422c4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:57:25.196614 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-2af4acde-846e-46ad-b719-055091b2f1d6 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] 10.222.0.33 "GET /compute/v2.1/servers/9b4e6a1f-04ba-4ac0-b9fc-0c1f2a27c518" status: 200 len: 1556 microversion: 2.1 time: 0.196948 Oct 04 21:57:25.197740 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3668/7304] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:57:24 2022] GET /compute/v2.1/servers/9b4e6a1f-04ba-4ac0-b9fc-0c1f2a27c518 => generated 1556 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:57:27.583988 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-9280edcd-ef3d-4e41-a2cb-6002a01eef22 req-0ac7586c-7d2f-4686-a547-5b57bf7edd69 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b4e6a1f-04ba-4ac0-b9fc-0c1f2a27c518", "tag": "16ba2b23-25c7-4569-aa26-e10bda71d555"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:57:27.599581 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-9280edcd-ef3d-4e41-a2cb-6002a01eef22 req-0ac7586c-7d2f-4686-a547-5b57bf7edd69 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:57:27.600398 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-9280edcd-ef3d-4e41-a2cb-6002a01eef22 req-0ac7586c-7d2f-4686-a547-5b57bf7edd69 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:57:27.601476 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-9280edcd-ef3d-4e41-a2cb-6002a01eef22 req-0ac7586c-7d2f-4686-a547-5b57bf7edd69 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:57:27.616239 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-9280edcd-ef3d-4e41-a2cb-6002a01eef22 req-0ac7586c-7d2f-4686-a547-5b57bf7edd69 service nova] Creating event network-changed:16ba2b23-25c7-4569-aa26-e10bda71d555 for instance 9b4e6a1f-04ba-4ac0-b9fc-0c1f2a27c518 on n-h2-854823-8 Oct 04 21:57:27.622731 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-9280edcd-ef3d-4e41-a2cb-6002a01eef22 req-0ac7586c-7d2f-4686-a547-5b57bf7edd69 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044312 Oct 04 21:57:27.623359 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3637/7305] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:57:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 21:59:22.458626 n-d-854823-8 devstack@n-api.service[128802]: ERROR oslo.messaging._drivers.impl_rabbit [-] [3ed749fe-ba58-4081-afad-8a961afd7471] AMQP server on 10.222.0.33:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 04 21:59:22.460108 n-d-854823-8 devstack@n-api.service[128802]: ERROR oslo.messaging._drivers.impl_rabbit [-] [399f3af7-d281-4213-9ef7-61e2871c9a11] AMQP server on 10.222.0.33:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 04 21:59:22.461025 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:59:22.462028 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=34 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:59:22.463704 n-d-854823-8 devstack@n-api.service[128802]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Oct 04 21:59:22.464735 n-d-854823-8 devstack@n-api.service[128802]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Oct 04 21:59:22.465720 n-d-854823-8 devstack@n-api.service[128802]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Oct 04 21:59:22.470971 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-a31b80e3-6148-4450-821a-81dff957260b tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:59:22.471534 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-a31b80e3-6148-4450-821a-81dff957260b tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] [instance: 9b4e6a1f-04ba-4ac0-b9fc-0c1f2a27c518] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:59:22.482292 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a31b80e3-6148-4450-821a-81dff957260b tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:22.482881 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a31b80e3-6148-4450-821a-81dff957260b tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:22.483338 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a31b80e3-6148-4450-821a-81dff957260b tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:22.484091 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a31b80e3-6148-4450-821a-81dff957260b tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:22.484570 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a31b80e3-6148-4450-821a-81dff957260b tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:22.485020 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a31b80e3-6148-4450-821a-81dff957260b tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:22.514259 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.objects.instance [None req-a31b80e3-6148-4450-821a-81dff957260b tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lazy-loading 'flavor' on Instance uuid 9b4e6a1f-04ba-4ac0-b9fc-0c1f2a27c518 {{(pid=128802) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 21:59:22.793136 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-a31b80e3-6148-4450-821a-81dff957260b tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] 10.222.0.33 "POST /compute/v2.1/servers/9b4e6a1f-04ba-4ac0-b9fc-0c1f2a27c518/action" status: 202 len: 0 microversion: 2.1 time: 0.336335 Oct 04 21:59:22.793824 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3669/7306] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 21:59:22 2022] POST /compute/v2.1/servers/9b4e6a1f-04ba-4ac0-b9fc-0c1f2a27c518/action => generated 0 bytes in 338 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:59:22.804056 n-d-854823-8 devstack@n-api.service[128801]: ERROR oslo.messaging._drivers.impl_rabbit [-] [0dedeb6d-3fde-4c4e-9f8b-01c561e37600] AMQP server on 10.222.0.33:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 21:59:22.805419 n-d-854823-8 devstack@n-api.service[128801]: ERROR oslo.messaging._drivers.impl_rabbit [-] [0572b6b5-6fec-4a5a-bfd2-8f7d3f0cb615] AMQP server on 10.222.0.33:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 21:59:22.806232 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:59:22.807539 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=28 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:59:22.809229 n-d-854823-8 devstack@n-api.service[128801]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Oct 04 21:59:22.818555 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-36b124df-c676-4010-879e-26af9a8a69c9 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:59:22.819669 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-36b124df-c676-4010-879e-26af9a8a69c9 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] [instance: 9b4e6a1f-04ba-4ac0-b9fc-0c1f2a27c518] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:59:22.831005 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-36b124df-c676-4010-879e-26af9a8a69c9 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:22.831696 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-36b124df-c676-4010-879e-26af9a8a69c9 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:22.832265 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-36b124df-c676-4010-879e-26af9a8a69c9 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:22.833174 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-36b124df-c676-4010-879e-26af9a8a69c9 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:22.833883 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-36b124df-c676-4010-879e-26af9a8a69c9 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:22.834450 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-36b124df-c676-4010-879e-26af9a8a69c9 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:23.023489 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-36b124df-c676-4010-879e-26af9a8a69c9 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9974484d7a01444184df6535e11c34ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9368c1a74d4c4acc8fdcd2d62c422c4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:23.033367 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-36b124df-c676-4010-879e-26af9a8a69c9 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] 10.222.0.33 "GET /compute/v2.1/servers/9b4e6a1f-04ba-4ac0-b9fc-0c1f2a27c518" status: 200 len: 1681 microversion: 2.1 time: 0.233102 Oct 04 21:59:23.034064 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3638/7307] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:59:22 2022] GET /compute/v2.1/servers/9b4e6a1f-04ba-4ac0-b9fc-0c1f2a27c518 => generated 1681 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:59:24.062311 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-ebd00fd7-de03-4242-82f7-31d1b256631a tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:59:24.063078 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-ebd00fd7-de03-4242-82f7-31d1b256631a tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] [instance: 9b4e6a1f-04ba-4ac0-b9fc-0c1f2a27c518] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:59:24.075846 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ebd00fd7-de03-4242-82f7-31d1b256631a tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:24.076404 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ebd00fd7-de03-4242-82f7-31d1b256631a tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:24.076899 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ebd00fd7-de03-4242-82f7-31d1b256631a tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:24.077688 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ebd00fd7-de03-4242-82f7-31d1b256631a tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:24.078200 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ebd00fd7-de03-4242-82f7-31d1b256631a tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:24.078721 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ebd00fd7-de03-4242-82f7-31d1b256631a tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:24.084868 n-d-854823-8 devstack@n-api.service[128802]: INFO oslo.messaging._drivers.impl_rabbit [-] [3ed749fe-ba58-4081-afad-8a961afd7471] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 56384. Oct 04 21:59:24.087808 n-d-854823-8 devstack@n-api.service[128802]: INFO oslo.messaging._drivers.impl_rabbit [-] [399f3af7-d281-4213-9ef7-61e2871c9a11] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 56386. Oct 04 21:59:24.241676 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-ebd00fd7-de03-4242-82f7-31d1b256631a tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9974484d7a01444184df6535e11c34ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9368c1a74d4c4acc8fdcd2d62c422c4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:24.250653 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-ebd00fd7-de03-4242-82f7-31d1b256631a tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] 10.222.0.33 "GET /compute/v2.1/servers/9b4e6a1f-04ba-4ac0-b9fc-0c1f2a27c518" status: 200 len: 1681 microversion: 2.1 time: 0.194619 Oct 04 21:59:24.251404 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3670/7308] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:59:24 2022] GET /compute/v2.1/servers/9b4e6a1f-04ba-4ac0-b9fc-0c1f2a27c518 => generated 1681 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:59:25.277199 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-4f7235a1-b2c4-4e25-b403-f54ed3ed8cf1 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:59:25.277845 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-4f7235a1-b2c4-4e25-b403-f54ed3ed8cf1 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] [instance: 9b4e6a1f-04ba-4ac0-b9fc-0c1f2a27c518] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:59:25.287982 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4f7235a1-b2c4-4e25-b403-f54ed3ed8cf1 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:25.288474 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4f7235a1-b2c4-4e25-b403-f54ed3ed8cf1 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:25.288902 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4f7235a1-b2c4-4e25-b403-f54ed3ed8cf1 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:25.289613 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4f7235a1-b2c4-4e25-b403-f54ed3ed8cf1 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:25.290066 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4f7235a1-b2c4-4e25-b403-f54ed3ed8cf1 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:25.290531 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4f7235a1-b2c4-4e25-b403-f54ed3ed8cf1 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:25.295858 n-d-854823-8 devstack@n-api.service[128801]: INFO oslo.messaging._drivers.impl_rabbit [-] [0dedeb6d-3fde-4c4e-9f8b-01c561e37600] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 56390. Oct 04 21:59:25.302850 n-d-854823-8 devstack@n-api.service[128801]: INFO oslo.messaging._drivers.impl_rabbit [-] [0572b6b5-6fec-4a5a-bfd2-8f7d3f0cb615] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 56392. Oct 04 21:59:25.449110 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-4f7235a1-b2c4-4e25-b403-f54ed3ed8cf1 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9974484d7a01444184df6535e11c34ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9368c1a74d4c4acc8fdcd2d62c422c4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:25.457482 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-4f7235a1-b2c4-4e25-b403-f54ed3ed8cf1 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] 10.222.0.33 "GET /compute/v2.1/servers/9b4e6a1f-04ba-4ac0-b9fc-0c1f2a27c518" status: 200 len: 1681 microversion: 2.1 time: 0.184378 Oct 04 21:59:25.458657 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3639/7309] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:59:25 2022] GET /compute/v2.1/servers/9b4e6a1f-04ba-4ac0-b9fc-0c1f2a27c518 => generated 1681 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:59:26.482028 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-91a1ddd5-e959-44b0-8078-0bc0e510c882 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:59:26.482928 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-91a1ddd5-e959-44b0-8078-0bc0e510c882 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] [instance: 9b4e6a1f-04ba-4ac0-b9fc-0c1f2a27c518] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:59:26.490302 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-91a1ddd5-e959-44b0-8078-0bc0e510c882 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:26.490823 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-91a1ddd5-e959-44b0-8078-0bc0e510c882 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:26.491276 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-91a1ddd5-e959-44b0-8078-0bc0e510c882 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:26.492396 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-91a1ddd5-e959-44b0-8078-0bc0e510c882 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:26.492871 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-91a1ddd5-e959-44b0-8078-0bc0e510c882 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:26.493311 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-91a1ddd5-e959-44b0-8078-0bc0e510c882 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:26.661731 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-91a1ddd5-e959-44b0-8078-0bc0e510c882 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9974484d7a01444184df6535e11c34ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9368c1a74d4c4acc8fdcd2d62c422c4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:26.673227 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-91a1ddd5-e959-44b0-8078-0bc0e510c882 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] 10.222.0.33 "GET /compute/v2.1/servers/9b4e6a1f-04ba-4ac0-b9fc-0c1f2a27c518" status: 200 len: 1681 microversion: 2.1 time: 0.195281 Oct 04 21:59:26.673829 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3671/7310] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:59:26 2022] GET /compute/v2.1/servers/9b4e6a1f-04ba-4ac0-b9fc-0c1f2a27c518 => generated 1681 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:59:27.699111 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-432aafd2-59e6-4202-b80e-f3a3742c60af tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:59:27.699924 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-432aafd2-59e6-4202-b80e-f3a3742c60af tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] [instance: 9b4e6a1f-04ba-4ac0-b9fc-0c1f2a27c518] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:59:27.707545 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-432aafd2-59e6-4202-b80e-f3a3742c60af tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:27.708068 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-432aafd2-59e6-4202-b80e-f3a3742c60af tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:27.708966 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-432aafd2-59e6-4202-b80e-f3a3742c60af tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:27.709210 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-432aafd2-59e6-4202-b80e-f3a3742c60af tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:27.709667 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-432aafd2-59e6-4202-b80e-f3a3742c60af tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:27.710093 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-432aafd2-59e6-4202-b80e-f3a3742c60af tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:27.881447 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-432aafd2-59e6-4202-b80e-f3a3742c60af tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9974484d7a01444184df6535e11c34ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9368c1a74d4c4acc8fdcd2d62c422c4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:27.889975 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-432aafd2-59e6-4202-b80e-f3a3742c60af tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] 10.222.0.33 "GET /compute/v2.1/servers/9b4e6a1f-04ba-4ac0-b9fc-0c1f2a27c518" status: 200 len: 1681 microversion: 2.1 time: 0.194889 Oct 04 21:59:27.890661 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3640/7311] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:59:27 2022] GET /compute/v2.1/servers/9b4e6a1f-04ba-4ac0-b9fc-0c1f2a27c518 => generated 1681 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:59:28.918909 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-fbaf5c41-30a7-4f4b-8f7f-68c3de2a2765 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:59:28.919560 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-fbaf5c41-30a7-4f4b-8f7f-68c3de2a2765 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] [instance: 9b4e6a1f-04ba-4ac0-b9fc-0c1f2a27c518] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:59:28.927832 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fbaf5c41-30a7-4f4b-8f7f-68c3de2a2765 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:28.928412 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fbaf5c41-30a7-4f4b-8f7f-68c3de2a2765 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:28.928941 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fbaf5c41-30a7-4f4b-8f7f-68c3de2a2765 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:28.929822 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fbaf5c41-30a7-4f4b-8f7f-68c3de2a2765 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:28.931115 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fbaf5c41-30a7-4f4b-8f7f-68c3de2a2765 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:28.931878 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-fbaf5c41-30a7-4f4b-8f7f-68c3de2a2765 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:29.132502 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-fbaf5c41-30a7-4f4b-8f7f-68c3de2a2765 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9974484d7a01444184df6535e11c34ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9368c1a74d4c4acc8fdcd2d62c422c4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:29.141671 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-fbaf5c41-30a7-4f4b-8f7f-68c3de2a2765 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] 10.222.0.33 "GET /compute/v2.1/servers/9b4e6a1f-04ba-4ac0-b9fc-0c1f2a27c518" status: 200 len: 1681 microversion: 2.1 time: 0.226820 Oct 04 21:59:29.142299 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3672/7312] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:59:28 2022] GET /compute/v2.1/servers/9b4e6a1f-04ba-4ac0-b9fc-0c1f2a27c518 => generated 1681 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:59:30.167573 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-22f5857e-a57e-4d21-86d9-5b288419cb2a tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:59:30.168202 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-22f5857e-a57e-4d21-86d9-5b288419cb2a tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] [instance: 9b4e6a1f-04ba-4ac0-b9fc-0c1f2a27c518] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:59:30.176406 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-22f5857e-a57e-4d21-86d9-5b288419cb2a tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:30.177421 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-22f5857e-a57e-4d21-86d9-5b288419cb2a tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:30.177861 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-22f5857e-a57e-4d21-86d9-5b288419cb2a tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:30.178625 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-22f5857e-a57e-4d21-86d9-5b288419cb2a tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:30.179133 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-22f5857e-a57e-4d21-86d9-5b288419cb2a tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:30.179562 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-22f5857e-a57e-4d21-86d9-5b288419cb2a tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:30.338478 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-22f5857e-a57e-4d21-86d9-5b288419cb2a tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9974484d7a01444184df6535e11c34ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9368c1a74d4c4acc8fdcd2d62c422c4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:30.347289 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-22f5857e-a57e-4d21-86d9-5b288419cb2a tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] 10.222.0.33 "GET /compute/v2.1/servers/9b4e6a1f-04ba-4ac0-b9fc-0c1f2a27c518" status: 200 len: 1681 microversion: 2.1 time: 0.183662 Oct 04 21:59:30.347904 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3641/7313] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:59:30 2022] GET /compute/v2.1/servers/9b4e6a1f-04ba-4ac0-b9fc-0c1f2a27c518 => generated 1681 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:59:31.373267 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-91c73a91-db3b-4d9a-9ce1-b92fb41e84d7 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:59:31.373940 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-91c73a91-db3b-4d9a-9ce1-b92fb41e84d7 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] [instance: 9b4e6a1f-04ba-4ac0-b9fc-0c1f2a27c518] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:59:31.382467 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-91c73a91-db3b-4d9a-9ce1-b92fb41e84d7 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:31.382984 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-91c73a91-db3b-4d9a-9ce1-b92fb41e84d7 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:31.383440 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-91c73a91-db3b-4d9a-9ce1-b92fb41e84d7 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:31.384191 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-91c73a91-db3b-4d9a-9ce1-b92fb41e84d7 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:31.384671 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-91c73a91-db3b-4d9a-9ce1-b92fb41e84d7 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:31.385123 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-91c73a91-db3b-4d9a-9ce1-b92fb41e84d7 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:31.542767 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-91c73a91-db3b-4d9a-9ce1-b92fb41e84d7 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9974484d7a01444184df6535e11c34ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9368c1a74d4c4acc8fdcd2d62c422c4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:31.551646 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-91c73a91-db3b-4d9a-9ce1-b92fb41e84d7 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] 10.222.0.33 "GET /compute/v2.1/servers/9b4e6a1f-04ba-4ac0-b9fc-0c1f2a27c518" status: 200 len: 1681 microversion: 2.1 time: 0.182658 Oct 04 21:59:31.552572 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3673/7314] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:59:31 2022] GET /compute/v2.1/servers/9b4e6a1f-04ba-4ac0-b9fc-0c1f2a27c518 => generated 1681 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:59:32.577631 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-53370228-cd6c-48a1-abbe-b740f50cd2bc tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:59:32.578413 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-53370228-cd6c-48a1-abbe-b740f50cd2bc tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] [instance: 9b4e6a1f-04ba-4ac0-b9fc-0c1f2a27c518] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:59:32.586098 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-53370228-cd6c-48a1-abbe-b740f50cd2bc tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:32.586579 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-53370228-cd6c-48a1-abbe-b740f50cd2bc tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:32.587036 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-53370228-cd6c-48a1-abbe-b740f50cd2bc tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:32.587779 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-53370228-cd6c-48a1-abbe-b740f50cd2bc tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:32.588246 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-53370228-cd6c-48a1-abbe-b740f50cd2bc tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:32.588681 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-53370228-cd6c-48a1-abbe-b740f50cd2bc tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:32.752221 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-53370228-cd6c-48a1-abbe-b740f50cd2bc tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9974484d7a01444184df6535e11c34ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9368c1a74d4c4acc8fdcd2d62c422c4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:32.762754 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-53370228-cd6c-48a1-abbe-b740f50cd2bc tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] 10.222.0.33 "GET /compute/v2.1/servers/9b4e6a1f-04ba-4ac0-b9fc-0c1f2a27c518" status: 200 len: 1681 microversion: 2.1 time: 0.189180 Oct 04 21:59:32.763507 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3642/7315] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:59:32 2022] GET /compute/v2.1/servers/9b4e6a1f-04ba-4ac0-b9fc-0c1f2a27c518 => generated 1681 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:59:33.789428 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-876c00ce-1283-4d90-a672-3c85cfe2cc0c tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:59:33.790139 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-876c00ce-1283-4d90-a672-3c85cfe2cc0c tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] [instance: 9b4e6a1f-04ba-4ac0-b9fc-0c1f2a27c518] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:59:33.798055 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-876c00ce-1283-4d90-a672-3c85cfe2cc0c tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:33.798611 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-876c00ce-1283-4d90-a672-3c85cfe2cc0c tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:33.799069 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-876c00ce-1283-4d90-a672-3c85cfe2cc0c tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:33.799818 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-876c00ce-1283-4d90-a672-3c85cfe2cc0c tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:33.800320 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-876c00ce-1283-4d90-a672-3c85cfe2cc0c tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:33.800748 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-876c00ce-1283-4d90-a672-3c85cfe2cc0c tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:33.968837 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-876c00ce-1283-4d90-a672-3c85cfe2cc0c tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9974484d7a01444184df6535e11c34ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9368c1a74d4c4acc8fdcd2d62c422c4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:33.979004 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-876c00ce-1283-4d90-a672-3c85cfe2cc0c tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] 10.222.0.33 "GET /compute/v2.1/servers/9b4e6a1f-04ba-4ac0-b9fc-0c1f2a27c518" status: 200 len: 1702 microversion: 2.1 time: 0.194575 Oct 04 21:59:33.979836 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3674/7316] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:59:33 2022] GET /compute/v2.1/servers/9b4e6a1f-04ba-4ac0-b9fc-0c1f2a27c518 => generated 1702 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:59:35.004048 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d3481191-67e6-44ff-9866-c45b60352a61 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:59:35.004684 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d3481191-67e6-44ff-9866-c45b60352a61 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] [instance: 9b4e6a1f-04ba-4ac0-b9fc-0c1f2a27c518] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:59:35.013729 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d3481191-67e6-44ff-9866-c45b60352a61 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:35.014217 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d3481191-67e6-44ff-9866-c45b60352a61 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:35.014699 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d3481191-67e6-44ff-9866-c45b60352a61 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:35.015417 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d3481191-67e6-44ff-9866-c45b60352a61 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:35.015872 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d3481191-67e6-44ff-9866-c45b60352a61 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:35.016295 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d3481191-67e6-44ff-9866-c45b60352a61 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:35.206373 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d3481191-67e6-44ff-9866-c45b60352a61 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9974484d7a01444184df6535e11c34ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9368c1a74d4c4acc8fdcd2d62c422c4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:35.221712 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d3481191-67e6-44ff-9866-c45b60352a61 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] 10.222.0.33 "GET /compute/v2.1/servers/9b4e6a1f-04ba-4ac0-b9fc-0c1f2a27c518" status: 200 len: 1702 microversion: 2.1 time: 0.221118 Oct 04 21:59:35.223660 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3643/7317] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:59:34 2022] GET /compute/v2.1/servers/9b4e6a1f-04ba-4ac0-b9fc-0c1f2a27c518 => generated 1702 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:59:36.261189 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-26857727-0be4-49e5-b6f7-ce40768d1915 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:59:36.263406 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-26857727-0be4-49e5-b6f7-ce40768d1915 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] [instance: 9b4e6a1f-04ba-4ac0-b9fc-0c1f2a27c518] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:59:36.277925 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-26857727-0be4-49e5-b6f7-ce40768d1915 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:36.279262 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-26857727-0be4-49e5-b6f7-ce40768d1915 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:36.280828 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-26857727-0be4-49e5-b6f7-ce40768d1915 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:36.283576 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-26857727-0be4-49e5-b6f7-ce40768d1915 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:36.284942 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-26857727-0be4-49e5-b6f7-ce40768d1915 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:36.286182 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-26857727-0be4-49e5-b6f7-ce40768d1915 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:36.557643 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-26857727-0be4-49e5-b6f7-ce40768d1915 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9974484d7a01444184df6535e11c34ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9368c1a74d4c4acc8fdcd2d62c422c4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:36.575200 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-26857727-0be4-49e5-b6f7-ce40768d1915 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] 10.222.0.33 "GET /compute/v2.1/servers/9b4e6a1f-04ba-4ac0-b9fc-0c1f2a27c518" status: 200 len: 1697 microversion: 2.1 time: 0.322711 Oct 04 21:59:36.590608 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3675/7318] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:59:36 2022] GET /compute/v2.1/servers/9b4e6a1f-04ba-4ac0-b9fc-0c1f2a27c518 => generated 1697 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:59:37.636448 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-126ad86c-ecad-403a-b393-693ac8bbde3d tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:59:37.639912 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-126ad86c-ecad-403a-b393-693ac8bbde3d tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] [instance: 9b4e6a1f-04ba-4ac0-b9fc-0c1f2a27c518] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:59:37.654967 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-126ad86c-ecad-403a-b393-693ac8bbde3d tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:37.656232 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-126ad86c-ecad-403a-b393-693ac8bbde3d tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:37.657234 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-126ad86c-ecad-403a-b393-693ac8bbde3d tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:37.659418 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-126ad86c-ecad-403a-b393-693ac8bbde3d tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:37.661102 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-126ad86c-ecad-403a-b393-693ac8bbde3d tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:37.662408 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-126ad86c-ecad-403a-b393-693ac8bbde3d tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:37.781136 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-d5796d31-48e4-4811-b1c8-8b08eb30dec1 req-8616fb8e-27ac-433f-9e6b-ac506e543623 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b4e6a1f-04ba-4ac0-b9fc-0c1f2a27c518", "name": "network-vif-plugged", "status": "completed", "tag": "16ba2b23-25c7-4569-aa26-e10bda71d555"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:59:37.801754 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-d5796d31-48e4-4811-b1c8-8b08eb30dec1 req-8616fb8e-27ac-433f-9e6b-ac506e543623 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:37.803140 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-d5796d31-48e4-4811-b1c8-8b08eb30dec1 req-8616fb8e-27ac-433f-9e6b-ac506e543623 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:37.804351 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-d5796d31-48e4-4811-b1c8-8b08eb30dec1 req-8616fb8e-27ac-433f-9e6b-ac506e543623 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:37.831089 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-d5796d31-48e4-4811-b1c8-8b08eb30dec1 req-8616fb8e-27ac-433f-9e6b-ac506e543623 service nova] Creating event network-vif-plugged:16ba2b23-25c7-4569-aa26-e10bda71d555 for instance 9b4e6a1f-04ba-4ac0-b9fc-0c1f2a27c518 on n-h2-854823-8 Oct 04 21:59:37.839295 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-d5796d31-48e4-4811-b1c8-8b08eb30dec1 req-8616fb8e-27ac-433f-9e6b-ac506e543623 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.233642 Oct 04 21:59:37.842215 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3644/7319] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:59:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:59:37.935717 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-126ad86c-ecad-403a-b393-693ac8bbde3d tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9974484d7a01444184df6535e11c34ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9368c1a74d4c4acc8fdcd2d62c422c4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:37.950616 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-126ad86c-ecad-403a-b393-693ac8bbde3d tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] 10.222.0.33 "GET /compute/v2.1/servers/9b4e6a1f-04ba-4ac0-b9fc-0c1f2a27c518" status: 200 len: 1697 microversion: 2.1 time: 0.327955 Oct 04 21:59:37.951952 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3676/7320] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:59:37 2022] GET /compute/v2.1/servers/9b4e6a1f-04ba-4ac0-b9fc-0c1f2a27c518 => generated 1697 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:59:38.998414 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0d612449-84f3-4f13-bc1f-1d3406faf419 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:59:39.000683 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-0d612449-84f3-4f13-bc1f-1d3406faf419 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] [instance: 9b4e6a1f-04ba-4ac0-b9fc-0c1f2a27c518] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:59:39.011824 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0d612449-84f3-4f13-bc1f-1d3406faf419 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:39.013080 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0d612449-84f3-4f13-bc1f-1d3406faf419 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:39.014066 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0d612449-84f3-4f13-bc1f-1d3406faf419 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:39.015143 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0d612449-84f3-4f13-bc1f-1d3406faf419 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:39.015810 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0d612449-84f3-4f13-bc1f-1d3406faf419 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:39.016420 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0d612449-84f3-4f13-bc1f-1d3406faf419 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:39.296757 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-0d612449-84f3-4f13-bc1f-1d3406faf419 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9974484d7a01444184df6535e11c34ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9368c1a74d4c4acc8fdcd2d62c422c4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:39.311448 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-0d612449-84f3-4f13-bc1f-1d3406faf419 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] 10.222.0.33 "GET /compute/v2.1/servers/9b4e6a1f-04ba-4ac0-b9fc-0c1f2a27c518" status: 200 len: 1697 microversion: 2.1 time: 0.322946 Oct 04 21:59:39.317541 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3645/7321] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:59:38 2022] GET /compute/v2.1/servers/9b4e6a1f-04ba-4ac0-b9fc-0c1f2a27c518 => generated 1697 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:59:40.356245 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-2c3f45b5-523f-45a5-a8eb-a57fd29e1655 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:59:40.357266 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-2c3f45b5-523f-45a5-a8eb-a57fd29e1655 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] [instance: 9b4e6a1f-04ba-4ac0-b9fc-0c1f2a27c518] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:59:40.375340 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2c3f45b5-523f-45a5-a8eb-a57fd29e1655 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:40.380538 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2c3f45b5-523f-45a5-a8eb-a57fd29e1655 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:40.383186 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2c3f45b5-523f-45a5-a8eb-a57fd29e1655 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:40.385337 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2c3f45b5-523f-45a5-a8eb-a57fd29e1655 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:40.386651 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2c3f45b5-523f-45a5-a8eb-a57fd29e1655 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:40.387430 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2c3f45b5-523f-45a5-a8eb-a57fd29e1655 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:40.626089 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-2c3f45b5-523f-45a5-a8eb-a57fd29e1655 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9974484d7a01444184df6535e11c34ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9368c1a74d4c4acc8fdcd2d62c422c4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:40.644136 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-2c3f45b5-523f-45a5-a8eb-a57fd29e1655 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] 10.222.0.33 "GET /compute/v2.1/servers/9b4e6a1f-04ba-4ac0-b9fc-0c1f2a27c518" status: 200 len: 1697 microversion: 2.1 time: 0.296022 Oct 04 21:59:40.646047 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3677/7322] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:59:40 2022] GET /compute/v2.1/servers/9b4e6a1f-04ba-4ac0-b9fc-0c1f2a27c518 => generated 1697 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:59:41.697427 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5ab9a498-52c5-4ba2-8d21-cc49a3d3e863 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:59:41.699518 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-5ab9a498-52c5-4ba2-8d21-cc49a3d3e863 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] [instance: 9b4e6a1f-04ba-4ac0-b9fc-0c1f2a27c518] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:59:41.713511 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5ab9a498-52c5-4ba2-8d21-cc49a3d3e863 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:41.715084 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5ab9a498-52c5-4ba2-8d21-cc49a3d3e863 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:41.716254 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5ab9a498-52c5-4ba2-8d21-cc49a3d3e863 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:41.717810 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5ab9a498-52c5-4ba2-8d21-cc49a3d3e863 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:41.718998 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5ab9a498-52c5-4ba2-8d21-cc49a3d3e863 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:41.720454 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5ab9a498-52c5-4ba2-8d21-cc49a3d3e863 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:41.977552 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-5ab9a498-52c5-4ba2-8d21-cc49a3d3e863 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9974484d7a01444184df6535e11c34ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9368c1a74d4c4acc8fdcd2d62c422c4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:41.998858 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5ab9a498-52c5-4ba2-8d21-cc49a3d3e863 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] 10.222.0.33 "GET /compute/v2.1/servers/9b4e6a1f-04ba-4ac0-b9fc-0c1f2a27c518" status: 200 len: 1697 microversion: 2.1 time: 0.309407 Oct 04 21:59:42.000395 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3646/7323] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:59:41 2022] GET /compute/v2.1/servers/9b4e6a1f-04ba-4ac0-b9fc-0c1f2a27c518 => generated 1697 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:59:43.030381 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-081b86ec-17d3-4a91-aabc-9b166223dd91 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:59:43.031349 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-081b86ec-17d3-4a91-aabc-9b166223dd91 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] [instance: 9b4e6a1f-04ba-4ac0-b9fc-0c1f2a27c518] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:59:43.044733 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-081b86ec-17d3-4a91-aabc-9b166223dd91 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:43.045266 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-081b86ec-17d3-4a91-aabc-9b166223dd91 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:43.045738 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-081b86ec-17d3-4a91-aabc-9b166223dd91 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:43.046549 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-081b86ec-17d3-4a91-aabc-9b166223dd91 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:43.047039 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-081b86ec-17d3-4a91-aabc-9b166223dd91 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:43.047574 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-081b86ec-17d3-4a91-aabc-9b166223dd91 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:43.300391 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-081b86ec-17d3-4a91-aabc-9b166223dd91 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9974484d7a01444184df6535e11c34ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9368c1a74d4c4acc8fdcd2d62c422c4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:43.314119 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-081b86ec-17d3-4a91-aabc-9b166223dd91 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] 10.222.0.33 "GET /compute/v2.1/servers/9b4e6a1f-04ba-4ac0-b9fc-0c1f2a27c518" status: 200 len: 1697 microversion: 2.1 time: 0.288160 Oct 04 21:59:43.315222 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3678/7324] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:59:43 2022] GET /compute/v2.1/servers/9b4e6a1f-04ba-4ac0-b9fc-0c1f2a27c518 => generated 1697 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:59:44.361659 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-181c8b67-081f-4fb6-8457-96a80ca662ba tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:59:44.364988 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-181c8b67-081f-4fb6-8457-96a80ca662ba tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] [instance: 9b4e6a1f-04ba-4ac0-b9fc-0c1f2a27c518] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:59:44.386627 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-181c8b67-081f-4fb6-8457-96a80ca662ba tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:44.387212 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-181c8b67-081f-4fb6-8457-96a80ca662ba tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:44.387671 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-181c8b67-081f-4fb6-8457-96a80ca662ba tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:44.388421 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-181c8b67-081f-4fb6-8457-96a80ca662ba tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:44.388897 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-181c8b67-081f-4fb6-8457-96a80ca662ba tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:44.389612 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-181c8b67-081f-4fb6-8457-96a80ca662ba tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:44.768953 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-181c8b67-081f-4fb6-8457-96a80ca662ba tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9974484d7a01444184df6535e11c34ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9368c1a74d4c4acc8fdcd2d62c422c4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:44.787752 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-181c8b67-081f-4fb6-8457-96a80ca662ba tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] 10.222.0.33 "GET /compute/v2.1/servers/9b4e6a1f-04ba-4ac0-b9fc-0c1f2a27c518" status: 200 len: 1697 microversion: 2.1 time: 0.432785 Oct 04 21:59:44.798652 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3647/7325] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:59:44 2022] GET /compute/v2.1/servers/9b4e6a1f-04ba-4ac0-b9fc-0c1f2a27c518 => generated 1697 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:59:45.822386 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-d39491b7-e33d-4730-80c7-add4b32a4545 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:59:45.823423 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-d39491b7-e33d-4730-80c7-add4b32a4545 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] [instance: 9b4e6a1f-04ba-4ac0-b9fc-0c1f2a27c518] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:59:45.835395 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d39491b7-e33d-4730-80c7-add4b32a4545 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:45.836106 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d39491b7-e33d-4730-80c7-add4b32a4545 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:45.836804 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d39491b7-e33d-4730-80c7-add4b32a4545 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:45.837705 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d39491b7-e33d-4730-80c7-add4b32a4545 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:45.838310 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d39491b7-e33d-4730-80c7-add4b32a4545 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:45.838938 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-d39491b7-e33d-4730-80c7-add4b32a4545 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:46.128104 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-d39491b7-e33d-4730-80c7-add4b32a4545 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9974484d7a01444184df6535e11c34ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9368c1a74d4c4acc8fdcd2d62c422c4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:46.140292 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-d39491b7-e33d-4730-80c7-add4b32a4545 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] 10.222.0.33 "GET /compute/v2.1/servers/9b4e6a1f-04ba-4ac0-b9fc-0c1f2a27c518" status: 200 len: 1697 microversion: 2.1 time: 0.322922 Oct 04 21:59:46.155687 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3679/7326] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:59:45 2022] GET /compute/v2.1/servers/9b4e6a1f-04ba-4ac0-b9fc-0c1f2a27c518 => generated 1697 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:59:47.173434 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-6ce2b091-c844-4113-8593-a83c7356e390 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:59:47.174705 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-6ce2b091-c844-4113-8593-a83c7356e390 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] [instance: 9b4e6a1f-04ba-4ac0-b9fc-0c1f2a27c518] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:59:47.188366 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6ce2b091-c844-4113-8593-a83c7356e390 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:47.189241 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6ce2b091-c844-4113-8593-a83c7356e390 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:47.190012 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6ce2b091-c844-4113-8593-a83c7356e390 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:47.191356 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6ce2b091-c844-4113-8593-a83c7356e390 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:47.193110 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6ce2b091-c844-4113-8593-a83c7356e390 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:47.193879 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-6ce2b091-c844-4113-8593-a83c7356e390 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:47.353855 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-6ce2b091-c844-4113-8593-a83c7356e390 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9974484d7a01444184df6535e11c34ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9368c1a74d4c4acc8fdcd2d62c422c4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:47.362744 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-6ce2b091-c844-4113-8593-a83c7356e390 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] 10.222.0.33 "GET /compute/v2.1/servers/9b4e6a1f-04ba-4ac0-b9fc-0c1f2a27c518" status: 200 len: 1679 microversion: 2.1 time: 0.196869 Oct 04 21:59:47.363353 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3648/7327] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:59:47 2022] GET /compute/v2.1/servers/9b4e6a1f-04ba-4ac0-b9fc-0c1f2a27c518 => generated 1679 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:59:48.389930 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-86cbacea-1db0-4b23-9fb1-c67cba498b02 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:59:48.390658 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-86cbacea-1db0-4b23-9fb1-c67cba498b02 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] [instance: 9b4e6a1f-04ba-4ac0-b9fc-0c1f2a27c518] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:59:48.399132 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-86cbacea-1db0-4b23-9fb1-c67cba498b02 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:48.399654 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-86cbacea-1db0-4b23-9fb1-c67cba498b02 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:48.400120 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-86cbacea-1db0-4b23-9fb1-c67cba498b02 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:48.400888 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-86cbacea-1db0-4b23-9fb1-c67cba498b02 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:48.401384 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-86cbacea-1db0-4b23-9fb1-c67cba498b02 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:48.401834 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-86cbacea-1db0-4b23-9fb1-c67cba498b02 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:48.568734 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-86cbacea-1db0-4b23-9fb1-c67cba498b02 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9974484d7a01444184df6535e11c34ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9368c1a74d4c4acc8fdcd2d62c422c4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:48.578244 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-86cbacea-1db0-4b23-9fb1-c67cba498b02 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] 10.222.0.33 "GET /compute/v2.1/servers/9b4e6a1f-04ba-4ac0-b9fc-0c1f2a27c518" status: 200 len: 1679 microversion: 2.1 time: 0.192585 Oct 04 21:59:48.578954 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3680/7328] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:59:48 2022] GET /compute/v2.1/servers/9b4e6a1f-04ba-4ac0-b9fc-0c1f2a27c518 => generated 1679 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:59:49.491040 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-6891f1ce-59b7-4ffd-8026-39d7e630427f req-08c416d0-bdb6-41cc-9d96-3f1a67816a03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b4e6a1f-04ba-4ac0-b9fc-0c1f2a27c518", "name": "network-vif-unplugged", "status": "completed", "tag": "16ba2b23-25c7-4569-aa26-e10bda71d555"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:59:49.502240 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-6891f1ce-59b7-4ffd-8026-39d7e630427f req-08c416d0-bdb6-41cc-9d96-3f1a67816a03 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:49.502878 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-6891f1ce-59b7-4ffd-8026-39d7e630427f req-08c416d0-bdb6-41cc-9d96-3f1a67816a03 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:49.503350 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-6891f1ce-59b7-4ffd-8026-39d7e630427f req-08c416d0-bdb6-41cc-9d96-3f1a67816a03 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:49.517429 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-6891f1ce-59b7-4ffd-8026-39d7e630427f req-08c416d0-bdb6-41cc-9d96-3f1a67816a03 service nova] Creating event network-vif-unplugged:16ba2b23-25c7-4569-aa26-e10bda71d555 for instance 9b4e6a1f-04ba-4ac0-b9fc-0c1f2a27c518 on n-h2-854823-8 Oct 04 21:59:49.523917 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-6891f1ce-59b7-4ffd-8026-39d7e630427f req-08c416d0-bdb6-41cc-9d96-3f1a67816a03 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037831 Oct 04 21:59:49.524565 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3649/7329] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 21:59:49 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 21:59:49.604922 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-29c84fa0-2c2f-402e-9882-443b65800eff tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:59:49.605596 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-29c84fa0-2c2f-402e-9882-443b65800eff tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] [instance: 9b4e6a1f-04ba-4ac0-b9fc-0c1f2a27c518] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:59:49.613014 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-29c84fa0-2c2f-402e-9882-443b65800eff tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:49.613557 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-29c84fa0-2c2f-402e-9882-443b65800eff tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:49.614303 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-29c84fa0-2c2f-402e-9882-443b65800eff tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:49.615293 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-29c84fa0-2c2f-402e-9882-443b65800eff tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:49.615770 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-29c84fa0-2c2f-402e-9882-443b65800eff tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:49.616221 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-29c84fa0-2c2f-402e-9882-443b65800eff tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:49.786982 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-29c84fa0-2c2f-402e-9882-443b65800eff tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9974484d7a01444184df6535e11c34ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9368c1a74d4c4acc8fdcd2d62c422c4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:49.796688 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-29c84fa0-2c2f-402e-9882-443b65800eff tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] 10.222.0.33 "GET /compute/v2.1/servers/9b4e6a1f-04ba-4ac0-b9fc-0c1f2a27c518" status: 200 len: 1679 microversion: 2.1 time: 0.195740 Oct 04 21:59:49.797293 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3681/7330] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:59:49 2022] GET /compute/v2.1/servers/9b4e6a1f-04ba-4ac0-b9fc-0c1f2a27c518 => generated 1679 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:59:50.837606 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5b676e0c-14c4-43c3-a230-6aff125d4304 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:59:50.838319 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-5b676e0c-14c4-43c3-a230-6aff125d4304 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] [instance: 9b4e6a1f-04ba-4ac0-b9fc-0c1f2a27c518] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:59:50.845224 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5b676e0c-14c4-43c3-a230-6aff125d4304 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:50.845714 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5b676e0c-14c4-43c3-a230-6aff125d4304 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:50.846151 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5b676e0c-14c4-43c3-a230-6aff125d4304 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:50.846906 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5b676e0c-14c4-43c3-a230-6aff125d4304 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:50.847419 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5b676e0c-14c4-43c3-a230-6aff125d4304 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:50.848346 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5b676e0c-14c4-43c3-a230-6aff125d4304 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:51.033600 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-5b676e0c-14c4-43c3-a230-6aff125d4304 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9974484d7a01444184df6535e11c34ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9368c1a74d4c4acc8fdcd2d62c422c4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:51.049363 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5b676e0c-14c4-43c3-a230-6aff125d4304 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] 10.222.0.33 "GET /compute/v2.1/servers/9b4e6a1f-04ba-4ac0-b9fc-0c1f2a27c518" status: 200 len: 1622 microversion: 2.1 time: 0.216985 Oct 04 21:59:51.050544 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3650/7331] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:59:50 2022] GET /compute/v2.1/servers/9b4e6a1f-04ba-4ac0-b9fc-0c1f2a27c518 => generated 1622 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:59:51.077970 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-59079b21-6cbd-451e-9827-c4a35da83e31 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 21:59:51.078813 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-59079b21-6cbd-451e-9827-c4a35da83e31 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] [instance: 9b4e6a1f-04ba-4ac0-b9fc-0c1f2a27c518] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:59:51.087675 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-59079b21-6cbd-451e-9827-c4a35da83e31 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:51.088582 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-59079b21-6cbd-451e-9827-c4a35da83e31 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:51.089039 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-59079b21-6cbd-451e-9827-c4a35da83e31 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:51.089785 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-59079b21-6cbd-451e-9827-c4a35da83e31 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:51.090264 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-59079b21-6cbd-451e-9827-c4a35da83e31 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:51.090739 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-59079b21-6cbd-451e-9827-c4a35da83e31 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:51.148685 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-59079b21-6cbd-451e-9827-c4a35da83e31 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] [instance: 9b4e6a1f-04ba-4ac0-b9fc-0c1f2a27c518] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=128802) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 04 21:59:51.212533 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:59:51.245772 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-59079b21-6cbd-451e-9827-c4a35da83e31 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] 10.222.0.33 "POST /compute/v2.1/servers/9b4e6a1f-04ba-4ac0-b9fc-0c1f2a27c518/action" status: 202 len: 0 microversion: 2.1 time: 0.172867 Oct 04 21:59:51.246774 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3682/7332] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 21:59:51 2022] POST /compute/v2.1/servers/9b4e6a1f-04ba-4ac0-b9fc-0c1f2a27c518/action => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 21:59:51.255209 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-3dd24f92-8c9c-4bb0-94a1-f8cec9cd16b8 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:59:51.255857 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-3dd24f92-8c9c-4bb0-94a1-f8cec9cd16b8 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] [instance: 9b4e6a1f-04ba-4ac0-b9fc-0c1f2a27c518] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:59:51.262452 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3dd24f92-8c9c-4bb0-94a1-f8cec9cd16b8 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:51.262952 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3dd24f92-8c9c-4bb0-94a1-f8cec9cd16b8 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:51.263379 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3dd24f92-8c9c-4bb0-94a1-f8cec9cd16b8 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:51.264355 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3dd24f92-8c9c-4bb0-94a1-f8cec9cd16b8 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:51.264817 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3dd24f92-8c9c-4bb0-94a1-f8cec9cd16b8 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:51.265252 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3dd24f92-8c9c-4bb0-94a1-f8cec9cd16b8 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:51.447487 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-3dd24f92-8c9c-4bb0-94a1-f8cec9cd16b8 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9974484d7a01444184df6535e11c34ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9368c1a74d4c4acc8fdcd2d62c422c4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:51.460884 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-3dd24f92-8c9c-4bb0-94a1-f8cec9cd16b8 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] 10.222.0.33 "GET /compute/v2.1/servers/9b4e6a1f-04ba-4ac0-b9fc-0c1f2a27c518" status: 200 len: 1630 microversion: 2.1 time: 0.209413 Oct 04 21:59:51.461889 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3651/7333] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:59:51 2022] GET /compute/v2.1/servers/9b4e6a1f-04ba-4ac0-b9fc-0c1f2a27c518 => generated 1630 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:59:52.505468 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-764ad51d-efca-4cfc-bba6-6b8db4f9a3e8 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:59:52.506455 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-764ad51d-efca-4cfc-bba6-6b8db4f9a3e8 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] [instance: 9b4e6a1f-04ba-4ac0-b9fc-0c1f2a27c518] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:59:52.508728 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=1 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:59:52.517625 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-764ad51d-efca-4cfc-bba6-6b8db4f9a3e8 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:52.518438 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-764ad51d-efca-4cfc-bba6-6b8db4f9a3e8 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:52.519120 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-764ad51d-efca-4cfc-bba6-6b8db4f9a3e8 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:52.520632 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-764ad51d-efca-4cfc-bba6-6b8db4f9a3e8 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:52.521416 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-764ad51d-efca-4cfc-bba6-6b8db4f9a3e8 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:52.522091 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-764ad51d-efca-4cfc-bba6-6b8db4f9a3e8 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:52.743290 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-764ad51d-efca-4cfc-bba6-6b8db4f9a3e8 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9974484d7a01444184df6535e11c34ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9368c1a74d4c4acc8fdcd2d62c422c4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:52.755797 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-764ad51d-efca-4cfc-bba6-6b8db4f9a3e8 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] 10.222.0.33 "GET /compute/v2.1/servers/9b4e6a1f-04ba-4ac0-b9fc-0c1f2a27c518" status: 200 len: 1630 microversion: 2.1 time: 0.257315 Oct 04 21:59:52.756947 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3683/7334] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:59:52 2022] GET /compute/v2.1/servers/9b4e6a1f-04ba-4ac0-b9fc-0c1f2a27c518 => generated 1630 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:59:53.788372 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-32c9b5e0-5b19-4c9f-ab6a-ba90b58bf252 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:59:53.789098 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-32c9b5e0-5b19-4c9f-ab6a-ba90b58bf252 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] [instance: 9b4e6a1f-04ba-4ac0-b9fc-0c1f2a27c518] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:59:53.793197 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=29 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:59:53.797407 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-32c9b5e0-5b19-4c9f-ab6a-ba90b58bf252 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:53.797898 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-32c9b5e0-5b19-4c9f-ab6a-ba90b58bf252 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:53.798334 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-32c9b5e0-5b19-4c9f-ab6a-ba90b58bf252 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:53.799075 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-32c9b5e0-5b19-4c9f-ab6a-ba90b58bf252 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:53.799530 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-32c9b5e0-5b19-4c9f-ab6a-ba90b58bf252 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:53.799955 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-32c9b5e0-5b19-4c9f-ab6a-ba90b58bf252 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:53.803623 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=77 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 21:59:53.965221 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-32c9b5e0-5b19-4c9f-ab6a-ba90b58bf252 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9974484d7a01444184df6535e11c34ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9368c1a74d4c4acc8fdcd2d62c422c4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:53.976481 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-32c9b5e0-5b19-4c9f-ab6a-ba90b58bf252 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] 10.222.0.33 "GET /compute/v2.1/servers/9b4e6a1f-04ba-4ac0-b9fc-0c1f2a27c518" status: 200 len: 1688 microversion: 2.1 time: 0.192762 Oct 04 21:59:53.977257 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3652/7335] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:59:53 2022] GET /compute/v2.1/servers/9b4e6a1f-04ba-4ac0-b9fc-0c1f2a27c518 => generated 1688 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:59:55.008230 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-78cdd1ee-6684-49ea-8913-12e0102d54e3 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:59:55.011414 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-78cdd1ee-6684-49ea-8913-12e0102d54e3 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] [instance: 9b4e6a1f-04ba-4ac0-b9fc-0c1f2a27c518] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:59:55.024690 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-78cdd1ee-6684-49ea-8913-12e0102d54e3 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:55.025896 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-78cdd1ee-6684-49ea-8913-12e0102d54e3 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:55.026956 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-78cdd1ee-6684-49ea-8913-12e0102d54e3 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:55.028583 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-78cdd1ee-6684-49ea-8913-12e0102d54e3 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:55.029687 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-78cdd1ee-6684-49ea-8913-12e0102d54e3 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:55.030747 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-78cdd1ee-6684-49ea-8913-12e0102d54e3 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:55.298740 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-78cdd1ee-6684-49ea-8913-12e0102d54e3 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9974484d7a01444184df6535e11c34ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9368c1a74d4c4acc8fdcd2d62c422c4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:55.314496 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-78cdd1ee-6684-49ea-8913-12e0102d54e3 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] 10.222.0.33 "GET /compute/v2.1/servers/9b4e6a1f-04ba-4ac0-b9fc-0c1f2a27c518" status: 200 len: 1688 microversion: 2.1 time: 0.313703 Oct 04 21:59:55.315901 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3684/7336] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:59:54 2022] GET /compute/v2.1/servers/9b4e6a1f-04ba-4ac0-b9fc-0c1f2a27c518 => generated 1688 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 21:59:56.345508 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-30c2e352-68e6-46ef-9a6e-ff55caa415cf tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:59:56.348068 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-30c2e352-68e6-46ef-9a6e-ff55caa415cf tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] [instance: 9b4e6a1f-04ba-4ac0-b9fc-0c1f2a27c518] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:59:56.357454 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-30c2e352-68e6-46ef-9a6e-ff55caa415cf tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:56.358110 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-30c2e352-68e6-46ef-9a6e-ff55caa415cf tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:56.367052 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-30c2e352-68e6-46ef-9a6e-ff55caa415cf tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:56.369823 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-30c2e352-68e6-46ef-9a6e-ff55caa415cf tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:56.388409 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-30c2e352-68e6-46ef-9a6e-ff55caa415cf tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:56.389625 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-30c2e352-68e6-46ef-9a6e-ff55caa415cf tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:56.655933 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-30c2e352-68e6-46ef-9a6e-ff55caa415cf tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9974484d7a01444184df6535e11c34ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9368c1a74d4c4acc8fdcd2d62c422c4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:56.673667 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-30c2e352-68e6-46ef-9a6e-ff55caa415cf tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] 10.222.0.33 "GET /compute/v2.1/servers/9b4e6a1f-04ba-4ac0-b9fc-0c1f2a27c518" status: 200 len: 1688 microversion: 2.1 time: 0.336838 Oct 04 21:59:56.675790 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3653/7337] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:59:56 2022] GET /compute/v2.1/servers/9b4e6a1f-04ba-4ac0-b9fc-0c1f2a27c518 => generated 1688 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:59:57.703795 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-c9419c9a-5519-47ff-8b69-6cecc8897391 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:59:57.703795 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-c9419c9a-5519-47ff-8b69-6cecc8897391 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] [instance: 9b4e6a1f-04ba-4ac0-b9fc-0c1f2a27c518] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:59:57.711247 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c9419c9a-5519-47ff-8b69-6cecc8897391 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:57.711751 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c9419c9a-5519-47ff-8b69-6cecc8897391 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:57.712199 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c9419c9a-5519-47ff-8b69-6cecc8897391 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:57.712931 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c9419c9a-5519-47ff-8b69-6cecc8897391 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:57.713427 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c9419c9a-5519-47ff-8b69-6cecc8897391 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:57.713863 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c9419c9a-5519-47ff-8b69-6cecc8897391 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:57.938707 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-c9419c9a-5519-47ff-8b69-6cecc8897391 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9974484d7a01444184df6535e11c34ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9368c1a74d4c4acc8fdcd2d62c422c4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:57.958647 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-c9419c9a-5519-47ff-8b69-6cecc8897391 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] 10.222.0.33 "GET /compute/v2.1/servers/9b4e6a1f-04ba-4ac0-b9fc-0c1f2a27c518" status: 200 len: 1688 microversion: 2.1 time: 0.261237 Oct 04 21:59:57.976000 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3685/7338] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:59:57 2022] GET /compute/v2.1/servers/9b4e6a1f-04ba-4ac0-b9fc-0c1f2a27c518 => generated 1688 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 21:59:59.007646 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-903c85cf-2e77-49f4-9222-f4cf98c6ed27 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 21:59:59.008340 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-903c85cf-2e77-49f4-9222-f4cf98c6ed27 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] [instance: 9b4e6a1f-04ba-4ac0-b9fc-0c1f2a27c518] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 21:59:59.016539 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-903c85cf-2e77-49f4-9222-f4cf98c6ed27 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:59.017051 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-903c85cf-2e77-49f4-9222-f4cf98c6ed27 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:59.017497 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-903c85cf-2e77-49f4-9222-f4cf98c6ed27 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:59.018520 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-903c85cf-2e77-49f4-9222-f4cf98c6ed27 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 21:59:59.019388 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-903c85cf-2e77-49f4-9222-f4cf98c6ed27 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 21:59:59.020147 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-903c85cf-2e77-49f4-9222-f4cf98c6ed27 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 21:59:59.252344 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-903c85cf-2e77-49f4-9222-f4cf98c6ed27 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9974484d7a01444184df6535e11c34ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9368c1a74d4c4acc8fdcd2d62c422c4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 21:59:59.268596 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-903c85cf-2e77-49f4-9222-f4cf98c6ed27 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] 10.222.0.33 "GET /compute/v2.1/servers/9b4e6a1f-04ba-4ac0-b9fc-0c1f2a27c518" status: 200 len: 1688 microversion: 2.1 time: 0.265667 Oct 04 21:59:59.270046 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3654/7339] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 21:59:59 2022] GET /compute/v2.1/servers/9b4e6a1f-04ba-4ac0-b9fc-0c1f2a27c518 => generated 1688 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:00:00.303396 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-9a34182d-465d-4375-b45d-04b0f4401ca2 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:00.306400 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-9a34182d-465d-4375-b45d-04b0f4401ca2 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] [instance: 9b4e6a1f-04ba-4ac0-b9fc-0c1f2a27c518] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:00.323771 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9a34182d-465d-4375-b45d-04b0f4401ca2 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:00.324792 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9a34182d-465d-4375-b45d-04b0f4401ca2 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:00.325745 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9a34182d-465d-4375-b45d-04b0f4401ca2 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:00.327318 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9a34182d-465d-4375-b45d-04b0f4401ca2 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:00.328226 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9a34182d-465d-4375-b45d-04b0f4401ca2 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:00.330119 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9a34182d-465d-4375-b45d-04b0f4401ca2 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:00.635773 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-9a34182d-465d-4375-b45d-04b0f4401ca2 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9974484d7a01444184df6535e11c34ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9368c1a74d4c4acc8fdcd2d62c422c4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:00.655162 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-9a34182d-465d-4375-b45d-04b0f4401ca2 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] 10.222.0.33 "GET /compute/v2.1/servers/9b4e6a1f-04ba-4ac0-b9fc-0c1f2a27c518" status: 200 len: 1688 microversion: 2.1 time: 0.360433 Oct 04 22:00:00.656693 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3686/7340] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 22:00:00 2022] GET /compute/v2.1/servers/9b4e6a1f-04ba-4ac0-b9fc-0c1f2a27c518 => generated 1688 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:00:01.705823 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-f4c07c39-1c94-4cdd-b0a5-925254da9dc5 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:01.707130 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-f4c07c39-1c94-4cdd-b0a5-925254da9dc5 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] [instance: 9b4e6a1f-04ba-4ac0-b9fc-0c1f2a27c518] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:01.721225 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f4c07c39-1c94-4cdd-b0a5-925254da9dc5 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:01.722116 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f4c07c39-1c94-4cdd-b0a5-925254da9dc5 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:01.724394 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f4c07c39-1c94-4cdd-b0a5-925254da9dc5 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:01.725751 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f4c07c39-1c94-4cdd-b0a5-925254da9dc5 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:01.726919 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f4c07c39-1c94-4cdd-b0a5-925254da9dc5 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:01.727708 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-f4c07c39-1c94-4cdd-b0a5-925254da9dc5 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:01.905531 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-f4c07c39-1c94-4cdd-b0a5-925254da9dc5 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9974484d7a01444184df6535e11c34ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9368c1a74d4c4acc8fdcd2d62c422c4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:01.916431 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-f4c07c39-1c94-4cdd-b0a5-925254da9dc5 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] 10.222.0.33 "GET /compute/v2.1/servers/9b4e6a1f-04ba-4ac0-b9fc-0c1f2a27c518" status: 200 len: 1688 microversion: 2.1 time: 0.217568 Oct 04 22:00:01.917148 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3655/7341] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 22:00:01 2022] GET /compute/v2.1/servers/9b4e6a1f-04ba-4ac0-b9fc-0c1f2a27c518 => generated 1688 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:00:02.943397 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-abac65dc-4930-4e0b-bf0d-9fb70e41618e tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:02.944225 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-abac65dc-4930-4e0b-bf0d-9fb70e41618e tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] [instance: 9b4e6a1f-04ba-4ac0-b9fc-0c1f2a27c518] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:02.952438 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-abac65dc-4930-4e0b-bf0d-9fb70e41618e tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:02.952952 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-abac65dc-4930-4e0b-bf0d-9fb70e41618e tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:02.953407 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-abac65dc-4930-4e0b-bf0d-9fb70e41618e tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:02.954171 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-abac65dc-4930-4e0b-bf0d-9fb70e41618e tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:02.954690 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-abac65dc-4930-4e0b-bf0d-9fb70e41618e tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:02.955131 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-abac65dc-4930-4e0b-bf0d-9fb70e41618e tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:03.115615 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-abac65dc-4930-4e0b-bf0d-9fb70e41618e tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9974484d7a01444184df6535e11c34ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9368c1a74d4c4acc8fdcd2d62c422c4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:03.124443 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-abac65dc-4930-4e0b-bf0d-9fb70e41618e tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] 10.222.0.33 "GET /compute/v2.1/servers/9b4e6a1f-04ba-4ac0-b9fc-0c1f2a27c518" status: 200 len: 1688 microversion: 2.1 time: 0.185016 Oct 04 22:00:03.125035 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3687/7342] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 22:00:02 2022] GET /compute/v2.1/servers/9b4e6a1f-04ba-4ac0-b9fc-0c1f2a27c518 => generated 1688 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:00:04.150100 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8050a6c9-e6bc-4c8a-9f1e-0d300b190c90 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:04.150800 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-8050a6c9-e6bc-4c8a-9f1e-0d300b190c90 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] [instance: 9b4e6a1f-04ba-4ac0-b9fc-0c1f2a27c518] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:04.158577 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8050a6c9-e6bc-4c8a-9f1e-0d300b190c90 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:04.159090 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8050a6c9-e6bc-4c8a-9f1e-0d300b190c90 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:04.159526 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8050a6c9-e6bc-4c8a-9f1e-0d300b190c90 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:04.160805 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8050a6c9-e6bc-4c8a-9f1e-0d300b190c90 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:04.161257 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8050a6c9-e6bc-4c8a-9f1e-0d300b190c90 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:04.161724 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8050a6c9-e6bc-4c8a-9f1e-0d300b190c90 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:04.333799 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-8050a6c9-e6bc-4c8a-9f1e-0d300b190c90 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9974484d7a01444184df6535e11c34ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9368c1a74d4c4acc8fdcd2d62c422c4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:04.342930 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-8050a6c9-e6bc-4c8a-9f1e-0d300b190c90 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] 10.222.0.33 "GET /compute/v2.1/servers/9b4e6a1f-04ba-4ac0-b9fc-0c1f2a27c518" status: 200 len: 1688 microversion: 2.1 time: 0.196614 Oct 04 22:00:04.343666 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3656/7343] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 22:00:04 2022] GET /compute/v2.1/servers/9b4e6a1f-04ba-4ac0-b9fc-0c1f2a27c518 => generated 1688 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:00:05.371011 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-95d954e2-7295-4f78-80a1-284bdb49207b tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:05.371957 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-95d954e2-7295-4f78-80a1-284bdb49207b tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] [instance: 9b4e6a1f-04ba-4ac0-b9fc-0c1f2a27c518] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:05.384419 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-95d954e2-7295-4f78-80a1-284bdb49207b tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:05.385353 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-95d954e2-7295-4f78-80a1-284bdb49207b tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:05.385949 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-95d954e2-7295-4f78-80a1-284bdb49207b tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:05.387191 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-95d954e2-7295-4f78-80a1-284bdb49207b tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:05.387853 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-95d954e2-7295-4f78-80a1-284bdb49207b tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:05.388613 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-95d954e2-7295-4f78-80a1-284bdb49207b tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:05.556826 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-95d954e2-7295-4f78-80a1-284bdb49207b tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9974484d7a01444184df6535e11c34ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9368c1a74d4c4acc8fdcd2d62c422c4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:05.565548 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-95d954e2-7295-4f78-80a1-284bdb49207b tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] 10.222.0.33 "GET /compute/v2.1/servers/9b4e6a1f-04ba-4ac0-b9fc-0c1f2a27c518" status: 200 len: 1688 microversion: 2.1 time: 0.200545 Oct 04 22:00:05.567165 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3688/7344] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 22:00:05 2022] GET /compute/v2.1/servers/9b4e6a1f-04ba-4ac0-b9fc-0c1f2a27c518 => generated 1688 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:00:06.599190 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5ac68574-0da8-4a9f-a9ed-c299f377a1c5 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:06.600087 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-5ac68574-0da8-4a9f-a9ed-c299f377a1c5 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] [instance: 9b4e6a1f-04ba-4ac0-b9fc-0c1f2a27c518] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:06.607287 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5ac68574-0da8-4a9f-a9ed-c299f377a1c5 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:06.607790 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5ac68574-0da8-4a9f-a9ed-c299f377a1c5 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:06.608222 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5ac68574-0da8-4a9f-a9ed-c299f377a1c5 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:06.608934 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5ac68574-0da8-4a9f-a9ed-c299f377a1c5 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:06.609401 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5ac68574-0da8-4a9f-a9ed-c299f377a1c5 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:06.609827 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5ac68574-0da8-4a9f-a9ed-c299f377a1c5 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:06.776916 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-5ac68574-0da8-4a9f-a9ed-c299f377a1c5 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9974484d7a01444184df6535e11c34ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9368c1a74d4c4acc8fdcd2d62c422c4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:06.797310 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5ac68574-0da8-4a9f-a9ed-c299f377a1c5 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] 10.222.0.33 "GET /compute/v2.1/servers/9b4e6a1f-04ba-4ac0-b9fc-0c1f2a27c518" status: 200 len: 1688 microversion: 2.1 time: 0.202834 Oct 04 22:00:06.798213 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3657/7345] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 22:00:06 2022] GET /compute/v2.1/servers/9b4e6a1f-04ba-4ac0-b9fc-0c1f2a27c518 => generated 1688 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:00:07.740166 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-c6835f6c-a810-48ad-991f-82b814d8f68d req-15157762-84d0-4630-a361-a408b32efada service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b4e6a1f-04ba-4ac0-b9fc-0c1f2a27c518", "name": "network-vif-plugged", "status": "completed", "tag": "16ba2b23-25c7-4569-aa26-e10bda71d555"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:00:07.752817 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-c6835f6c-a810-48ad-991f-82b814d8f68d req-15157762-84d0-4630-a361-a408b32efada service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:07.753455 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-c6835f6c-a810-48ad-991f-82b814d8f68d req-15157762-84d0-4630-a361-a408b32efada service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:07.754399 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-c6835f6c-a810-48ad-991f-82b814d8f68d req-15157762-84d0-4630-a361-a408b32efada service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:07.768076 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-c6835f6c-a810-48ad-991f-82b814d8f68d req-15157762-84d0-4630-a361-a408b32efada service nova] Creating event network-vif-plugged:16ba2b23-25c7-4569-aa26-e10bda71d555 for instance 9b4e6a1f-04ba-4ac0-b9fc-0c1f2a27c518 on n-h2-854823-8 Oct 04 22:00:07.774142 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-c6835f6c-a810-48ad-991f-82b814d8f68d req-15157762-84d0-4630-a361-a408b32efada service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040062 Oct 04 22:00:07.774802 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3689/7346] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 22:00:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:00:07.837325 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8f6aa7c9-2155-4031-a8a6-fc353deeb3b2 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:07.838724 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-8f6aa7c9-2155-4031-a8a6-fc353deeb3b2 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] [instance: 9b4e6a1f-04ba-4ac0-b9fc-0c1f2a27c518] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:07.851204 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8f6aa7c9-2155-4031-a8a6-fc353deeb3b2 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:07.852475 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8f6aa7c9-2155-4031-a8a6-fc353deeb3b2 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:07.853723 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8f6aa7c9-2155-4031-a8a6-fc353deeb3b2 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:07.855091 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8f6aa7c9-2155-4031-a8a6-fc353deeb3b2 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:07.856114 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8f6aa7c9-2155-4031-a8a6-fc353deeb3b2 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:07.856893 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8f6aa7c9-2155-4031-a8a6-fc353deeb3b2 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:08.099134 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-8f6aa7c9-2155-4031-a8a6-fc353deeb3b2 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9974484d7a01444184df6535e11c34ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9368c1a74d4c4acc8fdcd2d62c422c4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:08.110882 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-8f6aa7c9-2155-4031-a8a6-fc353deeb3b2 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] 10.222.0.33 "GET /compute/v2.1/servers/9b4e6a1f-04ba-4ac0-b9fc-0c1f2a27c518" status: 200 len: 1688 microversion: 2.1 time: 0.280653 Oct 04 22:00:08.111717 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3658/7347] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 22:00:07 2022] GET /compute/v2.1/servers/9b4e6a1f-04ba-4ac0-b9fc-0c1f2a27c518 => generated 1688 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:00:09.145495 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-f6529d89-35f5-4359-84d8-ecc1e15f4c8c tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:09.146599 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-f6529d89-35f5-4359-84d8-ecc1e15f4c8c tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] [instance: 9b4e6a1f-04ba-4ac0-b9fc-0c1f2a27c518] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:09.156179 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f6529d89-35f5-4359-84d8-ecc1e15f4c8c tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:09.156696 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f6529d89-35f5-4359-84d8-ecc1e15f4c8c tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:09.157145 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f6529d89-35f5-4359-84d8-ecc1e15f4c8c tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:09.157878 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f6529d89-35f5-4359-84d8-ecc1e15f4c8c tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:09.158373 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f6529d89-35f5-4359-84d8-ecc1e15f4c8c tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:09.158805 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-f6529d89-35f5-4359-84d8-ecc1e15f4c8c tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:09.357798 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-f6529d89-35f5-4359-84d8-ecc1e15f4c8c tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9974484d7a01444184df6535e11c34ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9368c1a74d4c4acc8fdcd2d62c422c4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:09.367670 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-f6529d89-35f5-4359-84d8-ecc1e15f4c8c tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] 10.222.0.33 "GET /compute/v2.1/servers/9b4e6a1f-04ba-4ac0-b9fc-0c1f2a27c518" status: 200 len: 1688 microversion: 2.1 time: 0.231088 Oct 04 22:00:09.368280 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3690/7348] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 22:00:09 2022] GET /compute/v2.1/servers/9b4e6a1f-04ba-4ac0-b9fc-0c1f2a27c518 => generated 1688 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:00:10.392259 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a6a3d219-ae86-43d9-af1e-2c5e2888a386 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:00:10.392918 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a6a3d219-ae86-43d9-af1e-2c5e2888a386 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] [instance: 9b4e6a1f-04ba-4ac0-b9fc-0c1f2a27c518] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:00:10.401194 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a6a3d219-ae86-43d9-af1e-2c5e2888a386 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:10.401603 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a6a3d219-ae86-43d9-af1e-2c5e2888a386 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:10.402045 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a6a3d219-ae86-43d9-af1e-2c5e2888a386 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:10.402843 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a6a3d219-ae86-43d9-af1e-2c5e2888a386 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:00:10.403301 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a6a3d219-ae86-43d9-af1e-2c5e2888a386 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:00:10.403732 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a6a3d219-ae86-43d9-af1e-2c5e2888a386 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:00:10.550967 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-a6a3d219-ae86-43d9-af1e-2c5e2888a386 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9974484d7a01444184df6535e11c34ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9368c1a74d4c4acc8fdcd2d62c422c4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:00:10.559562 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a6a3d219-ae86-43d9-af1e-2c5e2888a386 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] 10.222.0.33 "GET /compute/v2.1/servers/9b4e6a1f-04ba-4ac0-b9fc-0c1f2a27c518" status: 200 len: 1675 microversion: 2.1 time: 0.171270 Oct 04 22:00:10.560167 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3659/7349] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 22:00:10 2022] GET /compute/v2.1/servers/9b4e6a1f-04ba-4ac0-b9fc-0c1f2a27c518 => generated 1675 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:01:20.731686 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=15 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:01:20.732755 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=47 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:01:20.733706 n-d-854823-8 devstack@n-api.service[128801]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 22:01:20.733896 n-d-854823-8 devstack@n-api.service[128801]: Tue Oct 4 22:01:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.33) !!! Oct 04 22:01:20.748611 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-98071fff-4000-4e5c-b48a-c43dedecce86 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:20.750878 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-98071fff-4000-4e5c-b48a-c43dedecce86 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] [instance: 9b4e6a1f-04ba-4ac0-b9fc-0c1f2a27c518] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:20.760192 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_api:SELECT=15 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:01:20.761383 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=45,nova_cell1:INSERT=1 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:01:20.764919 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-98071fff-4000-4e5c-b48a-c43dedecce86 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:20.765666 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-98071fff-4000-4e5c-b48a-c43dedecce86 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:20.766133 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-98071fff-4000-4e5c-b48a-c43dedecce86 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:20.767004 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-98071fff-4000-4e5c-b48a-c43dedecce86 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:20.767506 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-98071fff-4000-4e5c-b48a-c43dedecce86 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:20.768066 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-98071fff-4000-4e5c-b48a-c43dedecce86 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:20.822401 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-98071fff-4000-4e5c-b48a-c43dedecce86 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] [instance: 9b4e6a1f-04ba-4ac0-b9fc-0c1f2a27c518] Going to try to terminate instance {{(pid=128802) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 22:01:20.825370 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-f68b8a54-5e20-4fee-b2a0-982836375f87 req-118e4d2f-d137-419d-9c6f-aa83f6035b54 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b4e6a1f-04ba-4ac0-b9fc-0c1f2a27c518", "tag": "16ba2b23-25c7-4569-aa26-e10bda71d555"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:01:20.836747 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-f68b8a54-5e20-4fee-b2a0-982836375f87 req-118e4d2f-d137-419d-9c6f-aa83f6035b54 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:20.837230 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-f68b8a54-5e20-4fee-b2a0-982836375f87 req-118e4d2f-d137-419d-9c6f-aa83f6035b54 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:20.837660 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-f68b8a54-5e20-4fee-b2a0-982836375f87 req-118e4d2f-d137-419d-9c6f-aa83f6035b54 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:20.852920 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-f68b8a54-5e20-4fee-b2a0-982836375f87 req-118e4d2f-d137-419d-9c6f-aa83f6035b54 service nova] Creating event network-changed:16ba2b23-25c7-4569-aa26-e10bda71d555 for instance 9b4e6a1f-04ba-4ac0-b9fc-0c1f2a27c518 on n-h2-854823-8 Oct 04 22:01:20.859072 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-f68b8a54-5e20-4fee-b2a0-982836375f87 req-118e4d2f-d137-419d-9c6f-aa83f6035b54 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.129183 Oct 04 22:01:20.859852 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3660/7350] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 22:01:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 22:01:20.981008 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-98071fff-4000-4e5c-b48a-c43dedecce86 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] 10.222.0.33 "DELETE /compute/v2.1/servers/9b4e6a1f-04ba-4ac0-b9fc-0c1f2a27c518" status: 204 len: 0 microversion: 2.1 time: 0.250733 Oct 04 22:01:20.985245 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3691/7351] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 22:01:20 2022] DELETE /compute/v2.1/servers/9b4e6a1f-04ba-4ac0-b9fc-0c1f2a27c518 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 22:01:20.991885 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5720e480-6c79-4cec-83f7-5a1767370df6 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:20.992609 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-5720e480-6c79-4cec-83f7-5a1767370df6 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] [instance: 9b4e6a1f-04ba-4ac0-b9fc-0c1f2a27c518] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:20.999684 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5720e480-6c79-4cec-83f7-5a1767370df6 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:21.000178 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5720e480-6c79-4cec-83f7-5a1767370df6 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:21.001398 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5720e480-6c79-4cec-83f7-5a1767370df6 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:21.002595 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5720e480-6c79-4cec-83f7-5a1767370df6 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:21.003126 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5720e480-6c79-4cec-83f7-5a1767370df6 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:21.003563 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5720e480-6c79-4cec-83f7-5a1767370df6 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:21.670637 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-5720e480-6c79-4cec-83f7-5a1767370df6 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9974484d7a01444184df6535e11c34ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9368c1a74d4c4acc8fdcd2d62c422c4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:21.683637 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5720e480-6c79-4cec-83f7-5a1767370df6 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] 10.222.0.33 "GET /compute/v2.1/servers/9b4e6a1f-04ba-4ac0-b9fc-0c1f2a27c518" status: 200 len: 1681 microversion: 2.1 time: 0.695936 Oct 04 22:01:21.684433 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3661/7352] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 22:01:20 2022] GET /compute/v2.1/servers/9b4e6a1f-04ba-4ac0-b9fc-0c1f2a27c518 => generated 1681 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:01:22.718731 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-2e64eb27-9d97-4150-ba25-69db408dd3b8 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:22.720279 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-2e64eb27-9d97-4150-ba25-69db408dd3b8 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] [instance: 9b4e6a1f-04ba-4ac0-b9fc-0c1f2a27c518] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:22.730715 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2e64eb27-9d97-4150-ba25-69db408dd3b8 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:22.731664 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2e64eb27-9d97-4150-ba25-69db408dd3b8 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:22.732494 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2e64eb27-9d97-4150-ba25-69db408dd3b8 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:22.733757 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2e64eb27-9d97-4150-ba25-69db408dd3b8 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:22.734665 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2e64eb27-9d97-4150-ba25-69db408dd3b8 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:22.736001 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2e64eb27-9d97-4150-ba25-69db408dd3b8 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:22.976198 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-2e64eb27-9d97-4150-ba25-69db408dd3b8 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9974484d7a01444184df6535e11c34ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9368c1a74d4c4acc8fdcd2d62c422c4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:23.002289 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-2e64eb27-9d97-4150-ba25-69db408dd3b8 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] 10.222.0.33 "GET /compute/v2.1/servers/9b4e6a1f-04ba-4ac0-b9fc-0c1f2a27c518" status: 200 len: 1562 microversion: 2.1 time: 0.290270 Oct 04 22:01:23.003587 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3692/7353] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 22:01:22 2022] GET /compute/v2.1/servers/9b4e6a1f-04ba-4ac0-b9fc-0c1f2a27c518 => generated 1562 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:01:23.052405 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-82336f37-0417-43ef-8ff4-2259a2154fcc req-5a1ca743-e331-41de-afb6-4744a0777677 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b4e6a1f-04ba-4ac0-b9fc-0c1f2a27c518", "name": "network-vif-deleted", "tag": "16ba2b23-25c7-4569-aa26-e10bda71d555"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:01:23.068994 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-82336f37-0417-43ef-8ff4-2259a2154fcc req-5a1ca743-e331-41de-afb6-4744a0777677 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:23.069862 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-82336f37-0417-43ef-8ff4-2259a2154fcc req-5a1ca743-e331-41de-afb6-4744a0777677 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:23.070698 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-82336f37-0417-43ef-8ff4-2259a2154fcc req-5a1ca743-e331-41de-afb6-4744a0777677 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:23.090411 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-82336f37-0417-43ef-8ff4-2259a2154fcc req-5a1ca743-e331-41de-afb6-4744a0777677 service nova] Creating event network-vif-deleted:16ba2b23-25c7-4569-aa26-e10bda71d555 for instance 9b4e6a1f-04ba-4ac0-b9fc-0c1f2a27c518 on n-h2-854823-8 Oct 04 22:01:23.097154 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-82336f37-0417-43ef-8ff4-2259a2154fcc req-5a1ca743-e331-41de-afb6-4744a0777677 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052458 Oct 04 22:01:23.097800 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3662/7354] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 22:01:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 22:01:24.043764 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-172b520d-ff0d-4951-ba5a-efaa3b806adf tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:24.044514 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-172b520d-ff0d-4951-ba5a-efaa3b806adf tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] [instance: 9b4e6a1f-04ba-4ac0-b9fc-0c1f2a27c518] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:24.054136 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-172b520d-ff0d-4951-ba5a-efaa3b806adf tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:24.054682 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-172b520d-ff0d-4951-ba5a-efaa3b806adf tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:24.055147 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-172b520d-ff0d-4951-ba5a-efaa3b806adf tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:24.055887 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-172b520d-ff0d-4951-ba5a-efaa3b806adf tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:24.056364 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-172b520d-ff0d-4951-ba5a-efaa3b806adf tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:24.056810 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-172b520d-ff0d-4951-ba5a-efaa3b806adf tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:24.072332 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.wsgi [None req-172b520d-ff0d-4951-ba5a-efaa3b806adf tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] HTTP exception thrown: Instance 9b4e6a1f-04ba-4ac0-b9fc-0c1f2a27c518 could not be found. Oct 04 22:01:24.074167 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-172b520d-ff0d-4951-ba5a-efaa3b806adf tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Request method failure captured: Oct 04 22:01:24.074167 n-d-854823-8 devstack@n-api.service[128802]: request: GET /compute/v2.1/servers/9b4e6a1f-04ba-4ac0-b9fc-0c1f2a27c518 HTTP/1.1 Oct 04 22:01:24.074167 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 22:01:24.074167 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 22:01:24.074167 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 22:01:24.074167 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 0 Oct 04 22:01:24.074167 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 22:01:24.074167 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 22:01:24.074167 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 22:01:24.074167 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 22:01:24.074167 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPKwwLDyLmgv1EXrdoQxit3piS2b25wrCmZR0zkieSJCEG4YdegAU9CShZX8kNNAiRhfXLaFlFR_Flm3sYw-L45pmLFGNoO-Kuhos09_K1_Iw94FFp0rnB_2VHdCAlFaSLLlj6unrVCQNSriHe_aR8jQujLOxTaAOyIvZCvddfRrkLgY Oct 04 22:01:24.074167 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 22:01:24.074167 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 22:01:24.074167 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 22:01:24.074167 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 22:01:24.074167 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 22:01:24.074167 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 22:01:24.074167 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: 9368c1a74d4c4acc8fdcd2d62c422c4c Oct 04 22:01:24.074167 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-TestShelveInstance-707385966 Oct 04 22:01:24.074167 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 22:01:24.074167 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 22:01:24.074167 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_9368c1a74d4c4acc8fdcd2d62c422c4c", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9368c1a74d4c4acc8fdcd2d62c422c4c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9368c1a74d4c4acc8fdcd2d62c422c4c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/9368c1a74d4c4acc8fdcd2d62c422c4c"}]}] Oct 04 22:01:24.074167 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-TestShelveInstance-707385966 Oct 04 22:01:24.074167 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: 9368c1a74d4c4acc8fdcd2d62c422c4c Oct 04 22:01:24.074167 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-TestShelveInstance-707385966 Oct 04 22:01:24.074167 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-TestShelveInstance-707385966-project Oct 04 22:01:24.074167 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 22:01:24.074167 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 22:01:24.074167 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: 9974484d7a01444184df6535e11c34ab Oct 04 22:01:24.074167 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-TestShelveInstance-707385966-project Oct 04 22:01:24.074167 n-d-854823-8 devstack@n-api.service[128802]: method: > Oct 04 22:01:24.074167 n-d-854823-8 devstack@n-api.service[128802]: exception: Instance 9b4e6a1f-04ba-4ac0-b9fc-0c1f2a27c518 could not be found. Oct 04 22:01:24.074167 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'id': '9b4e6a1f-04ba-4ac0-b9fc-0c1f2a27c518'} Oct 04 22:01:24.074167 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:01:24.074167 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:01:24.074167 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:01:24.074167 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:01:24.074167 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:01:24.074167 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:01:24.074167 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:01:24.074167 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:01:24.074167 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:01:24.074167 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:01:24.074167 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b4e6a1f-04ba-4ac0-b9fc-0c1f2a27c518 could not be found. Oct 04 22:01:24.074167 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 22:01:24.074167 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:01:24.074167 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 22:01:24.074167 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:01:24.074167 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:01:24.074167 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:01:24.074167 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:01:24.074167 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:01:24.074167 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:01:24.074167 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:01:24.074167 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:01:24.074167 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:01:24.074167 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:01:24.074167 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:01:24.074167 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:01:24.074167 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:01:24.074167 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b4e6a1f-04ba-4ac0-b9fc-0c1f2a27c518 could not be found. Oct 04 22:01:24.074167 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 22:01:24.074167 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:01:24.074167 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 22:01:24.083152 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:01:24.083152 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:01:24.083152 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:01:24.083152 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:01:24.083152 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:01:24.083152 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b4e6a1f-04ba-4ac0-b9fc-0c1f2a27c518 could not be found. Oct 04 22:01:24.083152 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 22:01:24.083152 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-172b520d-ff0d-4951-ba5a-efaa3b806adf tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Returning 404 to user: Instance 9b4e6a1f-04ba-4ac0-b9fc-0c1f2a27c518 could not be found. {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:01:24.083152 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-172b520d-ff0d-4951-ba5a-efaa3b806adf tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] 10.222.0.33 "GET /compute/v2.1/servers/9b4e6a1f-04ba-4ac0-b9fc-0c1f2a27c518" status: 404 len: 111 microversion: 2.1 time: 0.036682 Oct 04 22:01:24.083152 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3693/7355] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 22:01:24 2022] GET /compute/v2.1/servers/9b4e6a1f-04ba-4ac0-b9fc-0c1f2a27c518 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 22:01:24.288867 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-272610ef-dde6-4c11-9fbe-ce246ad59b3e tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Calling method '.version_select at 0x7f3c6fa32280>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:24.332166 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-272610ef-dde6-4c11-9fbe-ce246ad59b3e tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1554978053" status: 202 len: 0 microversion: 2.1 time: 0.052164 Oct 04 22:01:24.333230 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3663/7356] 10.222.0.33 () {58 vars in 1254 bytes} [Tue Oct 4 22:01:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1554978053 => generated 0 bytes in 55 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 22:01:24.365416 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-752b9912-deaa-45c0-9dd6-820083607c6d tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Action: 'create', calling method: .version_select at 0x7f3c6f66d700>, body: {"keypair": {"name": "tempest-TestShelveInstance-855303231", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC7Jfn9Ahlqp411SPPPVbfMBl8kXUesSvFQr9lTg394U3p5+AeJRl4fYM5AuxDsm6ZArFQxQFHm2TcbRapmRGjkKUsJEPIniMp6kzX2DXQkk+44fk9Vf4I01l8EEf7l5kA=="}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:01:24.396534 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-752b9912-deaa-45c0-9dd6-820083607c6d tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Getting quotas for project 9368c1a74d4c4acc8fdcd2d62c422c4c. Resources: {'key_pairs'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:01:24.408061 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-752b9912-deaa-45c0-9dd6-820083607c6d tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Getting quotas for user 9974484d7a01444184df6535e11c34ab and project 9368c1a74d4c4acc8fdcd2d62c422c4c. Resources: {'key_pairs'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:01:24.454079 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-752b9912-deaa-45c0-9dd6-820083607c6d tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.097019 Oct 04 22:01:24.455558 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3694/7357] 10.222.0.33 () {60 vars in 1159 bytes} [Tue Oct 4 22:01:24 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:01:44.542186 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=10 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:01:44.543155 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=9,nova_api:DELETE=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:01:44.548013 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-ce82a5b5-4372-44d4-a3c2-50e9716a2d95 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-946284061", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-855303231", "security_groups": [{"name": "tempest-secgroup-smoke-1947447879"}], "networks": [{"uuid": "442c1ff0-eab6-4738-8687-a1aabe144e60"}], "block_device_mapping_v2": [{"uuid": "9dccec83-b223-4cbe-a7af-669717c63ff2", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:01:44.686327 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.network.neutron [None req-ce82a5b5-4372-44d4-a3c2-50e9716a2d95 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] validate_networks() for [('442c1ff0-eab6-4738-8687-a1aabe144e60', None, None, None, None, None)] {{(pid=128801) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 22:01:45.242910 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-ce82a5b5-4372-44d4-a3c2-50e9716a2d95 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Flavor limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 22:01:45.243699 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-ce82a5b5-4372-44d4-a3c2-50e9716a2d95 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Image limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 22:01:45.244586 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-ce82a5b5-4372-44d4-a3c2-50e9716a2d95 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Flavor pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 22:01:45.245341 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-ce82a5b5-4372-44d4-a3c2-50e9716a2d95 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Image pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 22:01:45.246086 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-ce82a5b5-4372-44d4-a3c2-50e9716a2d95 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 22:01:45.262786 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ce82a5b5-4372-44d4-a3c2-50e9716a2d95 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:45.263645 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ce82a5b5-4372-44d4-a3c2-50e9716a2d95 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:45.264482 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ce82a5b5-4372-44d4-a3c2-50e9716a2d95 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:45.267057 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ce82a5b5-4372-44d4-a3c2-50e9716a2d95 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:45.267875 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ce82a5b5-4372-44d4-a3c2-50e9716a2d95 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:45.268651 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-ce82a5b5-4372-44d4-a3c2-50e9716a2d95 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:45.305576 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-ce82a5b5-4372-44d4-a3c2-50e9716a2d95 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Getting quotas for project 9368c1a74d4c4acc8fdcd2d62c422c4c. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:01:45.316556 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-ce82a5b5-4372-44d4-a3c2-50e9716a2d95 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Getting quotas for user 9974484d7a01444184df6535e11c34ab and project 9368c1a74d4c4acc8fdcd2d62c422c4c. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:01:45.401695 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ce82a5b5-4372-44d4-a3c2-50e9716a2d95 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Going to run 1 instances... {{(pid=128801) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 22:01:45.404627 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-ce82a5b5-4372-44d4-a3c2-50e9716a2d95 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] [instance: dd99fc31-2ef1-4998-a149-c2dd0eb96dc8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='9dccec83-b223-4cbe-a7af-669717c63ff2',volume_size=None,volume_type=None)] {{(pid=128801) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 22:01:45.579951 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-ce82a5b5-4372-44d4-a3c2-50e9716a2d95 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.039570 Oct 04 22:01:45.580898 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3664/7358] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 22:01:44 2022] POST /compute/v2.1/servers => generated 406 bytes in 1041 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 22:01:45.590459 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:01:45.591380 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell0:SELECT=4 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:01:45.592084 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:01:45.597178 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-c462eeee-e3f0-46ca-99e5-566213db5040 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:45.597824 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-c462eeee-e3f0-46ca-99e5-566213db5040 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] [instance: dd99fc31-2ef1-4998-a149-c2dd0eb96dc8] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:45.684540 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-c462eeee-e3f0-46ca-99e5-566213db5040 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9974484d7a01444184df6535e11c34ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9368c1a74d4c4acc8fdcd2d62c422c4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:45.694706 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-c462eeee-e3f0-46ca-99e5-566213db5040 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] 10.222.0.33 "GET /compute/v2.1/servers/dd99fc31-2ef1-4998-a149-c2dd0eb96dc8" status: 200 len: 1087 microversion: 2.1 time: 0.105833 Oct 04 22:01:45.696035 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3695/7359] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 22:01:45 2022] GET /compute/v2.1/servers/dd99fc31-2ef1-4998-a149-c2dd0eb96dc8 => generated 1087 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:01:46.725142 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-88ea12b5-843d-4d5a-ac61-add166af62f0 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:46.725836 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-88ea12b5-843d-4d5a-ac61-add166af62f0 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] [instance: dd99fc31-2ef1-4998-a149-c2dd0eb96dc8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:46.733745 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-88ea12b5-843d-4d5a-ac61-add166af62f0 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:46.734249 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-88ea12b5-843d-4d5a-ac61-add166af62f0 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:46.734930 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-88ea12b5-843d-4d5a-ac61-add166af62f0 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:46.735673 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-88ea12b5-843d-4d5a-ac61-add166af62f0 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:46.736135 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-88ea12b5-843d-4d5a-ac61-add166af62f0 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:46.736562 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-88ea12b5-843d-4d5a-ac61-add166af62f0 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:46.819168 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-88ea12b5-843d-4d5a-ac61-add166af62f0 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9974484d7a01444184df6535e11c34ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9368c1a74d4c4acc8fdcd2d62c422c4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:46.830052 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-88ea12b5-843d-4d5a-ac61-add166af62f0 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] 10.222.0.33 "GET /compute/v2.1/servers/dd99fc31-2ef1-4998-a149-c2dd0eb96dc8" status: 200 len: 1185 microversion: 2.1 time: 0.109859 Oct 04 22:01:46.830984 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3665/7360] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 22:01:46 2022] GET /compute/v2.1/servers/dd99fc31-2ef1-4998-a149-c2dd0eb96dc8 => generated 1185 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:01:47.863713 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-8b441ae9-e2f0-4a14-a62a-068ed75cc799 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:47.864985 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-8b441ae9-e2f0-4a14-a62a-068ed75cc799 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] [instance: dd99fc31-2ef1-4998-a149-c2dd0eb96dc8] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:47.881214 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8b441ae9-e2f0-4a14-a62a-068ed75cc799 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:47.882785 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8b441ae9-e2f0-4a14-a62a-068ed75cc799 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:47.884165 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8b441ae9-e2f0-4a14-a62a-068ed75cc799 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:47.885732 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8b441ae9-e2f0-4a14-a62a-068ed75cc799 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:47.886650 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8b441ae9-e2f0-4a14-a62a-068ed75cc799 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:47.887408 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8b441ae9-e2f0-4a14-a62a-068ed75cc799 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:48.229951 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-8b441ae9-e2f0-4a14-a62a-068ed75cc799 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9974484d7a01444184df6535e11c34ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9368c1a74d4c4acc8fdcd2d62c422c4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:48.239723 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-8b441ae9-e2f0-4a14-a62a-068ed75cc799 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] 10.222.0.33 "GET /compute/v2.1/servers/dd99fc31-2ef1-4998-a149-c2dd0eb96dc8" status: 200 len: 1271 microversion: 2.1 time: 0.386884 Oct 04 22:01:48.240666 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3696/7361] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 22:01:47 2022] GET /compute/v2.1/servers/dd99fc31-2ef1-4998-a149-c2dd0eb96dc8 => generated 1271 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:01:48.933157 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-6a39fde8-b87e-4f69-9fc1-6d8ffe9f5499 req-ebf6b7d1-91bf-43f4-adfe-0327a63e9fb1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd99fc31-2ef1-4998-a149-c2dd0eb96dc8", "tag": "f0ab4cec-378f-4579-af92-46545a2b3c57"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:01:48.962438 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-6a39fde8-b87e-4f69-9fc1-6d8ffe9f5499 req-ebf6b7d1-91bf-43f4-adfe-0327a63e9fb1 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:48.964037 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-6a39fde8-b87e-4f69-9fc1-6d8ffe9f5499 req-ebf6b7d1-91bf-43f4-adfe-0327a63e9fb1 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:48.965102 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-6a39fde8-b87e-4f69-9fc1-6d8ffe9f5499 req-ebf6b7d1-91bf-43f4-adfe-0327a63e9fb1 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:49.003828 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-6a39fde8-b87e-4f69-9fc1-6d8ffe9f5499 req-ebf6b7d1-91bf-43f4-adfe-0327a63e9fb1 service nova] Creating event network-changed:f0ab4cec-378f-4579-af92-46545a2b3c57 for instance dd99fc31-2ef1-4998-a149-c2dd0eb96dc8 on n-h1-854823-8 Oct 04 22:01:49.009907 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-6a39fde8-b87e-4f69-9fc1-6d8ffe9f5499 req-ebf6b7d1-91bf-43f4-adfe-0327a63e9fb1 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081024 Oct 04 22:01:49.011286 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3666/7362] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 22:01:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 22:01:49.278043 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-89083cb0-fb25-4e7f-9f8a-d368ccfcc50b tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:49.279570 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-89083cb0-fb25-4e7f-9f8a-d368ccfcc50b tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] [instance: dd99fc31-2ef1-4998-a149-c2dd0eb96dc8] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:49.289113 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-89083cb0-fb25-4e7f-9f8a-d368ccfcc50b tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:49.289719 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-89083cb0-fb25-4e7f-9f8a-d368ccfcc50b tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:49.290668 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-89083cb0-fb25-4e7f-9f8a-d368ccfcc50b tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:49.291685 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-89083cb0-fb25-4e7f-9f8a-d368ccfcc50b tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:49.292144 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-89083cb0-fb25-4e7f-9f8a-d368ccfcc50b tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:49.292763 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-89083cb0-fb25-4e7f-9f8a-d368ccfcc50b tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:49.723569 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-89083cb0-fb25-4e7f-9f8a-d368ccfcc50b tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9974484d7a01444184df6535e11c34ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9368c1a74d4c4acc8fdcd2d62c422c4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:49.735737 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-89083cb0-fb25-4e7f-9f8a-d368ccfcc50b tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] 10.222.0.33 "GET /compute/v2.1/servers/dd99fc31-2ef1-4998-a149-c2dd0eb96dc8" status: 200 len: 1271 microversion: 2.1 time: 0.461081 Oct 04 22:01:49.736723 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3697/7363] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 22:01:49 2022] GET /compute/v2.1/servers/dd99fc31-2ef1-4998-a149-c2dd0eb96dc8 => generated 1271 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:01:50.761890 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5158875b-0d57-44f4-9058-4ea163d4309f tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:50.763025 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-5158875b-0d57-44f4-9058-4ea163d4309f tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] [instance: dd99fc31-2ef1-4998-a149-c2dd0eb96dc8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:50.771080 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5158875b-0d57-44f4-9058-4ea163d4309f tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:50.771668 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5158875b-0d57-44f4-9058-4ea163d4309f tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:50.772253 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5158875b-0d57-44f4-9058-4ea163d4309f tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:50.773160 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5158875b-0d57-44f4-9058-4ea163d4309f tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:50.773711 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5158875b-0d57-44f4-9058-4ea163d4309f tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:50.774410 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5158875b-0d57-44f4-9058-4ea163d4309f tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:50.968432 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-5158875b-0d57-44f4-9058-4ea163d4309f tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9974484d7a01444184df6535e11c34ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9368c1a74d4c4acc8fdcd2d62c422c4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:50.977816 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5158875b-0d57-44f4-9058-4ea163d4309f tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] 10.222.0.33 "GET /compute/v2.1/servers/dd99fc31-2ef1-4998-a149-c2dd0eb96dc8" status: 200 len: 1271 microversion: 2.1 time: 0.221310 Oct 04 22:01:50.978559 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3667/7364] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 22:01:50 2022] GET /compute/v2.1/servers/dd99fc31-2ef1-4998-a149-c2dd0eb96dc8 => generated 1271 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:01:52.001928 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-4b2c9b3a-a76c-43c5-9c51-19ce49fa897f tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:52.002641 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-4b2c9b3a-a76c-43c5-9c51-19ce49fa897f tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] [instance: dd99fc31-2ef1-4998-a149-c2dd0eb96dc8] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:52.009820 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4b2c9b3a-a76c-43c5-9c51-19ce49fa897f tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:52.010319 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4b2c9b3a-a76c-43c5-9c51-19ce49fa897f tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:52.010790 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4b2c9b3a-a76c-43c5-9c51-19ce49fa897f tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:52.011518 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4b2c9b3a-a76c-43c5-9c51-19ce49fa897f tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:52.011985 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4b2c9b3a-a76c-43c5-9c51-19ce49fa897f tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:52.012431 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4b2c9b3a-a76c-43c5-9c51-19ce49fa897f tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:52.217905 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-4b2c9b3a-a76c-43c5-9c51-19ce49fa897f tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9974484d7a01444184df6535e11c34ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9368c1a74d4c4acc8fdcd2d62c422c4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:52.232397 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-4b2c9b3a-a76c-43c5-9c51-19ce49fa897f tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] 10.222.0.33 "GET /compute/v2.1/servers/dd99fc31-2ef1-4998-a149-c2dd0eb96dc8" status: 200 len: 1271 microversion: 2.1 time: 0.234412 Oct 04 22:01:52.233478 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3698/7365] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 22:01:51 2022] GET /compute/v2.1/servers/dd99fc31-2ef1-4998-a149-c2dd0eb96dc8 => generated 1271 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:01:53.257962 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c4288fb3-dcb4-4b52-aad7-4376ce3f2480 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:53.258704 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c4288fb3-dcb4-4b52-aad7-4376ce3f2480 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] [instance: dd99fc31-2ef1-4998-a149-c2dd0eb96dc8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:53.266151 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c4288fb3-dcb4-4b52-aad7-4376ce3f2480 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:53.266761 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c4288fb3-dcb4-4b52-aad7-4376ce3f2480 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:53.267256 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c4288fb3-dcb4-4b52-aad7-4376ce3f2480 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:53.268036 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c4288fb3-dcb4-4b52-aad7-4376ce3f2480 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:53.268540 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c4288fb3-dcb4-4b52-aad7-4376ce3f2480 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:53.269062 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c4288fb3-dcb4-4b52-aad7-4376ce3f2480 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:53.419132 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c4288fb3-dcb4-4b52-aad7-4376ce3f2480 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9974484d7a01444184df6535e11c34ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9368c1a74d4c4acc8fdcd2d62c422c4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:53.427834 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c4288fb3-dcb4-4b52-aad7-4376ce3f2480 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] 10.222.0.33 "GET /compute/v2.1/servers/dd99fc31-2ef1-4998-a149-c2dd0eb96dc8" status: 200 len: 1259 microversion: 2.1 time: 0.174263 Oct 04 22:01:53.428440 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3668/7366] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 22:01:53 2022] GET /compute/v2.1/servers/dd99fc31-2ef1-4998-a149-c2dd0eb96dc8 => generated 1259 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:01:54.451293 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-1e4241d8-f674-4f88-9224-fb0641f2aa24 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:54.452249 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-1e4241d8-f674-4f88-9224-fb0641f2aa24 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] [instance: dd99fc31-2ef1-4998-a149-c2dd0eb96dc8] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:54.460498 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1e4241d8-f674-4f88-9224-fb0641f2aa24 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:54.461005 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1e4241d8-f674-4f88-9224-fb0641f2aa24 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:54.461466 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1e4241d8-f674-4f88-9224-fb0641f2aa24 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:54.462264 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1e4241d8-f674-4f88-9224-fb0641f2aa24 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:54.462815 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1e4241d8-f674-4f88-9224-fb0641f2aa24 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:54.463328 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1e4241d8-f674-4f88-9224-fb0641f2aa24 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:54.618635 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-1e4241d8-f674-4f88-9224-fb0641f2aa24 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9974484d7a01444184df6535e11c34ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9368c1a74d4c4acc8fdcd2d62c422c4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:54.629132 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-1e4241d8-f674-4f88-9224-fb0641f2aa24 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] 10.222.0.33 "GET /compute/v2.1/servers/dd99fc31-2ef1-4998-a149-c2dd0eb96dc8" status: 200 len: 1259 microversion: 2.1 time: 0.182422 Oct 04 22:01:54.629801 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3699/7367] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 22:01:54 2022] GET /compute/v2.1/servers/dd99fc31-2ef1-4998-a149-c2dd0eb96dc8 => generated 1259 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:01:55.653389 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0fbbc43a-0b57-4567-b9a8-7323d3924a6d tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:55.654390 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-0fbbc43a-0b57-4567-b9a8-7323d3924a6d tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] [instance: dd99fc31-2ef1-4998-a149-c2dd0eb96dc8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:55.657672 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:01:55.658392 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=6 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:01:55.665584 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0fbbc43a-0b57-4567-b9a8-7323d3924a6d tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:55.666304 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0fbbc43a-0b57-4567-b9a8-7323d3924a6d tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:55.666872 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0fbbc43a-0b57-4567-b9a8-7323d3924a6d tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:55.667698 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0fbbc43a-0b57-4567-b9a8-7323d3924a6d tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:55.668252 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0fbbc43a-0b57-4567-b9a8-7323d3924a6d tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:55.668790 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0fbbc43a-0b57-4567-b9a8-7323d3924a6d tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:55.830455 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-0fbbc43a-0b57-4567-b9a8-7323d3924a6d tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9974484d7a01444184df6535e11c34ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9368c1a74d4c4acc8fdcd2d62c422c4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:55.839716 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-0fbbc43a-0b57-4567-b9a8-7323d3924a6d tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] 10.222.0.33 "GET /compute/v2.1/servers/dd99fc31-2ef1-4998-a149-c2dd0eb96dc8" status: 200 len: 1259 microversion: 2.1 time: 0.190540 Oct 04 22:01:55.840493 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3669/7368] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 22:01:55 2022] GET /compute/v2.1/servers/dd99fc31-2ef1-4998-a149-c2dd0eb96dc8 => generated 1259 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:01:56.865002 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-bc4e93c2-2570-401a-8186-32a933306de2 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:56.865671 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-bc4e93c2-2570-401a-8186-32a933306de2 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] [instance: dd99fc31-2ef1-4998-a149-c2dd0eb96dc8] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:56.868582 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell0:SELECT=2 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:01:56.874804 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bc4e93c2-2570-401a-8186-32a933306de2 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:56.875521 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bc4e93c2-2570-401a-8186-32a933306de2 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:56.876011 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bc4e93c2-2570-401a-8186-32a933306de2 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:56.876843 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bc4e93c2-2570-401a-8186-32a933306de2 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:56.877444 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bc4e93c2-2570-401a-8186-32a933306de2 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:56.877992 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bc4e93c2-2570-401a-8186-32a933306de2 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:57.063557 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-bc4e93c2-2570-401a-8186-32a933306de2 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9974484d7a01444184df6535e11c34ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9368c1a74d4c4acc8fdcd2d62c422c4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:57.072344 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-bc4e93c2-2570-401a-8186-32a933306de2 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] 10.222.0.33 "GET /compute/v2.1/servers/dd99fc31-2ef1-4998-a149-c2dd0eb96dc8" status: 200 len: 1259 microversion: 2.1 time: 0.211176 Oct 04 22:01:57.072946 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3700/7369] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 22:01:56 2022] GET /compute/v2.1/servers/dd99fc31-2ef1-4998-a149-c2dd0eb96dc8 => generated 1259 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:01:58.097200 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-3659fd75-5451-402e-b244-26141dcd100c tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:58.097799 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-3659fd75-5451-402e-b244-26141dcd100c tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] [instance: dd99fc31-2ef1-4998-a149-c2dd0eb96dc8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:58.105578 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3659fd75-5451-402e-b244-26141dcd100c tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:58.106077 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3659fd75-5451-402e-b244-26141dcd100c tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:58.106561 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3659fd75-5451-402e-b244-26141dcd100c tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:58.107301 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3659fd75-5451-402e-b244-26141dcd100c tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:58.107765 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3659fd75-5451-402e-b244-26141dcd100c tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:58.108198 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3659fd75-5451-402e-b244-26141dcd100c tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:58.267984 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-3659fd75-5451-402e-b244-26141dcd100c tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9974484d7a01444184df6535e11c34ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9368c1a74d4c4acc8fdcd2d62c422c4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:58.276738 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-3659fd75-5451-402e-b244-26141dcd100c tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] 10.222.0.33 "GET /compute/v2.1/servers/dd99fc31-2ef1-4998-a149-c2dd0eb96dc8" status: 200 len: 1259 microversion: 2.1 time: 0.183919 Oct 04 22:01:58.277400 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3670/7370] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 22:01:58 2022] GET /compute/v2.1/servers/dd99fc31-2ef1-4998-a149-c2dd0eb96dc8 => generated 1259 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:01:59.305607 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-73806c75-f9c1-40a0-983d-41889fea455b tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:01:59.306252 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-73806c75-f9c1-40a0-983d-41889fea455b tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] [instance: dd99fc31-2ef1-4998-a149-c2dd0eb96dc8] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:01:59.314378 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-73806c75-f9c1-40a0-983d-41889fea455b tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:59.314905 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-73806c75-f9c1-40a0-983d-41889fea455b tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:59.315366 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-73806c75-f9c1-40a0-983d-41889fea455b tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:59.316115 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-73806c75-f9c1-40a0-983d-41889fea455b tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:01:59.316590 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-73806c75-f9c1-40a0-983d-41889fea455b tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:01:59.317197 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-73806c75-f9c1-40a0-983d-41889fea455b tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:01:59.467794 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-73806c75-f9c1-40a0-983d-41889fea455b tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9974484d7a01444184df6535e11c34ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9368c1a74d4c4acc8fdcd2d62c422c4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:01:59.479368 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-73806c75-f9c1-40a0-983d-41889fea455b tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] 10.222.0.33 "GET /compute/v2.1/servers/dd99fc31-2ef1-4998-a149-c2dd0eb96dc8" status: 200 len: 1259 microversion: 2.1 time: 0.177905 Oct 04 22:01:59.479980 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3701/7371] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 22:01:59 2022] GET /compute/v2.1/servers/dd99fc31-2ef1-4998-a149-c2dd0eb96dc8 => generated 1259 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:02:00.505040 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-65366b9b-ef18-49f9-b4ca-14b4792da282 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:02:00.505678 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-65366b9b-ef18-49f9-b4ca-14b4792da282 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] [instance: dd99fc31-2ef1-4998-a149-c2dd0eb96dc8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:02:00.513207 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-65366b9b-ef18-49f9-b4ca-14b4792da282 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:00.513706 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-65366b9b-ef18-49f9-b4ca-14b4792da282 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:00.514186 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-65366b9b-ef18-49f9-b4ca-14b4792da282 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:00.515837 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-65366b9b-ef18-49f9-b4ca-14b4792da282 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:00.516658 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-65366b9b-ef18-49f9-b4ca-14b4792da282 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:00.517117 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-65366b9b-ef18-49f9-b4ca-14b4792da282 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:00.682725 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-65366b9b-ef18-49f9-b4ca-14b4792da282 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9974484d7a01444184df6535e11c34ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9368c1a74d4c4acc8fdcd2d62c422c4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:02:00.692003 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-65366b9b-ef18-49f9-b4ca-14b4792da282 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] 10.222.0.33 "GET /compute/v2.1/servers/dd99fc31-2ef1-4998-a149-c2dd0eb96dc8" status: 200 len: 1259 microversion: 2.1 time: 0.191033 Oct 04 22:02:00.694262 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3671/7372] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 22:02:00 2022] GET /compute/v2.1/servers/dd99fc31-2ef1-4998-a149-c2dd0eb96dc8 => generated 1259 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:02:01.716348 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-153e4f43-103a-4f3b-85c7-867a2110126c tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:02:01.717011 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-153e4f43-103a-4f3b-85c7-867a2110126c tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] [instance: dd99fc31-2ef1-4998-a149-c2dd0eb96dc8] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:02:01.725759 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-153e4f43-103a-4f3b-85c7-867a2110126c tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:01.726318 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-153e4f43-103a-4f3b-85c7-867a2110126c tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:01.726863 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-153e4f43-103a-4f3b-85c7-867a2110126c tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:01.727662 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-153e4f43-103a-4f3b-85c7-867a2110126c tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:01.728239 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-153e4f43-103a-4f3b-85c7-867a2110126c tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:01.728778 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-153e4f43-103a-4f3b-85c7-867a2110126c tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:01.897347 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-153e4f43-103a-4f3b-85c7-867a2110126c tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9974484d7a01444184df6535e11c34ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9368c1a74d4c4acc8fdcd2d62c422c4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:02:01.906560 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-153e4f43-103a-4f3b-85c7-867a2110126c tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] 10.222.0.33 "GET /compute/v2.1/servers/dd99fc31-2ef1-4998-a149-c2dd0eb96dc8" status: 200 len: 1259 microversion: 2.1 time: 0.194103 Oct 04 22:02:01.907166 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3702/7373] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 22:02:01 2022] GET /compute/v2.1/servers/dd99fc31-2ef1-4998-a149-c2dd0eb96dc8 => generated 1259 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:02:02.930539 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-16a75022-412c-4d98-bede-3a7de135e599 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:02:02.931149 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-16a75022-412c-4d98-bede-3a7de135e599 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] [instance: dd99fc31-2ef1-4998-a149-c2dd0eb96dc8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:02:02.938499 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-16a75022-412c-4d98-bede-3a7de135e599 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:02.938987 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-16a75022-412c-4d98-bede-3a7de135e599 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:02.939427 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-16a75022-412c-4d98-bede-3a7de135e599 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:02.940148 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-16a75022-412c-4d98-bede-3a7de135e599 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:02.940596 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-16a75022-412c-4d98-bede-3a7de135e599 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:02.941017 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-16a75022-412c-4d98-bede-3a7de135e599 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:03.104626 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-16a75022-412c-4d98-bede-3a7de135e599 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9974484d7a01444184df6535e11c34ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9368c1a74d4c4acc8fdcd2d62c422c4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:02:03.113679 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-16a75022-412c-4d98-bede-3a7de135e599 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] 10.222.0.33 "GET /compute/v2.1/servers/dd99fc31-2ef1-4998-a149-c2dd0eb96dc8" status: 200 len: 1259 microversion: 2.1 time: 0.187232 Oct 04 22:02:03.114645 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3672/7374] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 22:02:02 2022] GET /compute/v2.1/servers/dd99fc31-2ef1-4998-a149-c2dd0eb96dc8 => generated 1259 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:02:04.141693 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-2977e278-7303-44e0-ae8a-6d917e88ca44 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:02:04.142613 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-2977e278-7303-44e0-ae8a-6d917e88ca44 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] [instance: dd99fc31-2ef1-4998-a149-c2dd0eb96dc8] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:02:04.150300 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2977e278-7303-44e0-ae8a-6d917e88ca44 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:04.150851 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2977e278-7303-44e0-ae8a-6d917e88ca44 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:04.151306 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2977e278-7303-44e0-ae8a-6d917e88ca44 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:04.152041 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2977e278-7303-44e0-ae8a-6d917e88ca44 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:04.152518 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2977e278-7303-44e0-ae8a-6d917e88ca44 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:04.152961 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2977e278-7303-44e0-ae8a-6d917e88ca44 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:04.324944 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-2977e278-7303-44e0-ae8a-6d917e88ca44 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9974484d7a01444184df6535e11c34ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9368c1a74d4c4acc8fdcd2d62c422c4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:02:04.334150 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-2977e278-7303-44e0-ae8a-6d917e88ca44 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] 10.222.0.33 "GET /compute/v2.1/servers/dd99fc31-2ef1-4998-a149-c2dd0eb96dc8" status: 200 len: 1259 microversion: 2.1 time: 0.197538 Oct 04 22:02:04.334865 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3703/7375] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 22:02:04 2022] GET /compute/v2.1/servers/dd99fc31-2ef1-4998-a149-c2dd0eb96dc8 => generated 1259 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:02:05.198892 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-91f6cada-6c6d-4960-ac2c-9a80c1b8d828 req-326234b5-348b-43b9-aff3-325afe78874a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd99fc31-2ef1-4998-a149-c2dd0eb96dc8", "name": "network-vif-plugged", "status": "completed", "tag": "f0ab4cec-378f-4579-af92-46545a2b3c57"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:02:05.212833 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-91f6cada-6c6d-4960-ac2c-9a80c1b8d828 req-326234b5-348b-43b9-aff3-325afe78874a service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:05.213509 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-91f6cada-6c6d-4960-ac2c-9a80c1b8d828 req-326234b5-348b-43b9-aff3-325afe78874a service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:05.214114 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-91f6cada-6c6d-4960-ac2c-9a80c1b8d828 req-326234b5-348b-43b9-aff3-325afe78874a service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:05.236249 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-91f6cada-6c6d-4960-ac2c-9a80c1b8d828 req-326234b5-348b-43b9-aff3-325afe78874a service nova] Creating event network-vif-plugged:f0ab4cec-378f-4579-af92-46545a2b3c57 for instance dd99fc31-2ef1-4998-a149-c2dd0eb96dc8 on n-h1-854823-8 Oct 04 22:02:05.245976 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-91f6cada-6c6d-4960-ac2c-9a80c1b8d828 req-326234b5-348b-43b9-aff3-325afe78874a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050781 Oct 04 22:02:05.247388 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3673/7376] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 22:02:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:02:05.363916 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-0e561c0a-053e-4926-a4e9-a55b456b46fc tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:02:05.365209 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-0e561c0a-053e-4926-a4e9-a55b456b46fc tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] [instance: dd99fc31-2ef1-4998-a149-c2dd0eb96dc8] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:02:05.379334 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0e561c0a-053e-4926-a4e9-a55b456b46fc tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:05.380180 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0e561c0a-053e-4926-a4e9-a55b456b46fc tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:05.381232 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0e561c0a-053e-4926-a4e9-a55b456b46fc tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:05.382168 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0e561c0a-053e-4926-a4e9-a55b456b46fc tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:05.383029 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0e561c0a-053e-4926-a4e9-a55b456b46fc tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:05.383767 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0e561c0a-053e-4926-a4e9-a55b456b46fc tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:05.559680 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-0e561c0a-053e-4926-a4e9-a55b456b46fc tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9974484d7a01444184df6535e11c34ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9368c1a74d4c4acc8fdcd2d62c422c4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:02:05.569842 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-0e561c0a-053e-4926-a4e9-a55b456b46fc tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] 10.222.0.33 "GET /compute/v2.1/servers/dd99fc31-2ef1-4998-a149-c2dd0eb96dc8" status: 200 len: 1259 microversion: 2.1 time: 0.213781 Oct 04 22:02:05.570509 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3704/7377] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 22:02:05 2022] GET /compute/v2.1/servers/dd99fc31-2ef1-4998-a149-c2dd0eb96dc8 => generated 1259 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:02:06.594969 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e2c11625-91d8-4d60-b5e1-b23f0f3360a2 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:02:06.595706 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e2c11625-91d8-4d60-b5e1-b23f0f3360a2 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] [instance: dd99fc31-2ef1-4998-a149-c2dd0eb96dc8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:02:06.604188 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e2c11625-91d8-4d60-b5e1-b23f0f3360a2 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:06.605057 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e2c11625-91d8-4d60-b5e1-b23f0f3360a2 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:06.605509 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e2c11625-91d8-4d60-b5e1-b23f0f3360a2 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:06.606236 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e2c11625-91d8-4d60-b5e1-b23f0f3360a2 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:06.606719 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e2c11625-91d8-4d60-b5e1-b23f0f3360a2 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:06.607153 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e2c11625-91d8-4d60-b5e1-b23f0f3360a2 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:06.809255 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e2c11625-91d8-4d60-b5e1-b23f0f3360a2 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9974484d7a01444184df6535e11c34ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9368c1a74d4c4acc8fdcd2d62c422c4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:02:06.819079 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e2c11625-91d8-4d60-b5e1-b23f0f3360a2 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] 10.222.0.33 "GET /compute/v2.1/servers/dd99fc31-2ef1-4998-a149-c2dd0eb96dc8" status: 200 len: 1259 microversion: 2.1 time: 0.228648 Oct 04 22:02:06.819690 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3674/7378] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 22:02:06 2022] GET /compute/v2.1/servers/dd99fc31-2ef1-4998-a149-c2dd0eb96dc8 => generated 1259 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:02:07.849145 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-1684654c-198f-400b-bafe-5ad2480282d2 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:02:07.850159 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-1684654c-198f-400b-bafe-5ad2480282d2 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] [instance: dd99fc31-2ef1-4998-a149-c2dd0eb96dc8] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:02:07.863955 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1684654c-198f-400b-bafe-5ad2480282d2 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:07.864826 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1684654c-198f-400b-bafe-5ad2480282d2 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:07.865618 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1684654c-198f-400b-bafe-5ad2480282d2 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:07.866953 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1684654c-198f-400b-bafe-5ad2480282d2 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:07.867776 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1684654c-198f-400b-bafe-5ad2480282d2 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:07.868545 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-1684654c-198f-400b-bafe-5ad2480282d2 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:08.053215 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-1684654c-198f-400b-bafe-5ad2480282d2 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9974484d7a01444184df6535e11c34ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9368c1a74d4c4acc8fdcd2d62c422c4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:02:08.062634 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-1684654c-198f-400b-bafe-5ad2480282d2 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] 10.222.0.33 "GET /compute/v2.1/servers/dd99fc31-2ef1-4998-a149-c2dd0eb96dc8" status: 200 len: 1443 microversion: 2.1 time: 0.221123 Oct 04 22:02:08.063472 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3705/7379] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 22:02:07 2022] GET /compute/v2.1/servers/dd99fc31-2ef1-4998-a149-c2dd0eb96dc8 => generated 1443 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:02:08.086548 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e1c3ee78-cc71-4ce3-b3be-c09582a5db97 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:02:08.087728 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e1c3ee78-cc71-4ce3-b3be-c09582a5db97 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] [instance: dd99fc31-2ef1-4998-a149-c2dd0eb96dc8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:02:08.096250 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e1c3ee78-cc71-4ce3-b3be-c09582a5db97 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:08.096742 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e1c3ee78-cc71-4ce3-b3be-c09582a5db97 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:08.097179 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e1c3ee78-cc71-4ce3-b3be-c09582a5db97 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:08.097897 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e1c3ee78-cc71-4ce3-b3be-c09582a5db97 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:08.098382 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e1c3ee78-cc71-4ce3-b3be-c09582a5db97 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:08.098820 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e1c3ee78-cc71-4ce3-b3be-c09582a5db97 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:08.257480 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e1c3ee78-cc71-4ce3-b3be-c09582a5db97 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9974484d7a01444184df6535e11c34ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9368c1a74d4c4acc8fdcd2d62c422c4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:02:08.267809 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e1c3ee78-cc71-4ce3-b3be-c09582a5db97 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] 10.222.0.33 "GET /compute/v2.1/servers/dd99fc31-2ef1-4998-a149-c2dd0eb96dc8" status: 200 len: 1443 microversion: 2.1 time: 0.185350 Oct 04 22:02:08.268430 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3675/7380] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 22:02:08 2022] GET /compute/v2.1/servers/dd99fc31-2ef1-4998-a149-c2dd0eb96dc8 => generated 1443 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:02:10.681112 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-67910aaa-c1e8-47b5-9319-465607a10a34 req-0acaa70d-2025-4cb2-98e0-b6b9b71ec18a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd99fc31-2ef1-4998-a149-c2dd0eb96dc8", "tag": "f0ab4cec-378f-4579-af92-46545a2b3c57"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:02:10.704144 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-67910aaa-c1e8-47b5-9319-465607a10a34 req-0acaa70d-2025-4cb2-98e0-b6b9b71ec18a service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:02:10.705257 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-67910aaa-c1e8-47b5-9319-465607a10a34 req-0acaa70d-2025-4cb2-98e0-b6b9b71ec18a service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:02:10.706273 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-67910aaa-c1e8-47b5-9319-465607a10a34 req-0acaa70d-2025-4cb2-98e0-b6b9b71ec18a service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:02:10.723437 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-67910aaa-c1e8-47b5-9319-465607a10a34 req-0acaa70d-2025-4cb2-98e0-b6b9b71ec18a service nova] Creating event network-changed:f0ab4cec-378f-4579-af92-46545a2b3c57 for instance dd99fc31-2ef1-4998-a149-c2dd0eb96dc8 on n-h1-854823-8 Oct 04 22:02:10.729191 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-67910aaa-c1e8-47b5-9319-465607a10a34 req-0acaa70d-2025-4cb2-98e0-b6b9b71ec18a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055344 Oct 04 22:02:10.730587 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3706/7381] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 22:02:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:04:08.622235 n-d-854823-8 devstack@n-api.service[128801]: ERROR oslo.messaging._drivers.impl_rabbit [-] [0572b6b5-6fec-4a5a-bfd2-8f7d3f0cb615] AMQP server on 10.222.0.33:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 04 22:04:08.623170 n-d-854823-8 devstack@n-api.service[128801]: ERROR oslo.messaging._drivers.impl_rabbit [-] [0dedeb6d-3fde-4c4e-9f8b-01c561e37600] AMQP server on 10.222.0.33:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 04 22:04:08.624038 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:04:08.624828 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=60 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:04:08.626182 n-d-854823-8 devstack@n-api.service[128801]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 04 22:04:08.626474 n-d-854823-8 devstack@n-api.service[128801]: Tue Oct 4 22:04:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/dd99fc31-2ef1-4998-a149-c2dd0eb96dc8/action (ip 10.222.0.33) !!! Oct 04 22:04:08.751230 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-4eee2e9a-5976-4742-90ea-b949a9689f3a tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:04:08.751895 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-4eee2e9a-5976-4742-90ea-b949a9689f3a tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] [instance: dd99fc31-2ef1-4998-a149-c2dd0eb96dc8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:04:08.759016 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4eee2e9a-5976-4742-90ea-b949a9689f3a tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:08.759649 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4eee2e9a-5976-4742-90ea-b949a9689f3a tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:08.760405 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4eee2e9a-5976-4742-90ea-b949a9689f3a tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:08.761352 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4eee2e9a-5976-4742-90ea-b949a9689f3a tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:08.761912 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4eee2e9a-5976-4742-90ea-b949a9689f3a tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:08.762481 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4eee2e9a-5976-4742-90ea-b949a9689f3a tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:08.789087 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-4eee2e9a-5976-4742-90ea-b949a9689f3a tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lazy-loading 'flavor' on Instance uuid dd99fc31-2ef1-4998-a149-c2dd0eb96dc8 {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 22:04:08.875009 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-4eee2e9a-5976-4742-90ea-b949a9689f3a tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] 10.222.0.33 "POST /compute/v2.1/servers/dd99fc31-2ef1-4998-a149-c2dd0eb96dc8/action" status: 202 len: 0 microversion: 2.1 time: 0.254407 Oct 04 22:04:08.875664 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3676/7382] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 22:04:08 2022] POST /compute/v2.1/servers/dd99fc31-2ef1-4998-a149-c2dd0eb96dc8/action => generated 0 bytes in 256 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 22:04:08.882537 n-d-854823-8 devstack@n-api.service[128802]: ERROR oslo.messaging._drivers.impl_rabbit [-] [3ed749fe-ba58-4081-afad-8a961afd7471] AMQP server on 10.222.0.33:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 22:04:08.883321 n-d-854823-8 devstack@n-api.service[128802]: ERROR oslo.messaging._drivers.impl_rabbit [-] [399f3af7-d281-4213-9ef7-61e2871c9a11] AMQP server on 10.222.0.33:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 22:04:08.883946 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_api:SELECT=26 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:04:08.884735 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=62 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:04:08.886680 n-d-854823-8 devstack@n-api.service[128802]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 04 22:04:08.886879 n-d-854823-8 devstack@n-api.service[128802]: Tue Oct 4 22:04:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/dd99fc31-2ef1-4998-a149-c2dd0eb96dc8 (ip 10.222.0.33) !!! Oct 04 22:04:08.887960 n-d-854823-8 devstack@n-api.service[128802]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 22:04:08.888135 n-d-854823-8 devstack@n-api.service[128802]: Tue Oct 4 22:04:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/dd99fc31-2ef1-4998-a149-c2dd0eb96dc8 (ip 10.222.0.33) !!! Oct 04 22:04:08.893590 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-4632658c-60b2-4d82-9fb5-1dbcc07d406b tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:04:08.894368 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-4632658c-60b2-4d82-9fb5-1dbcc07d406b tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] [instance: dd99fc31-2ef1-4998-a149-c2dd0eb96dc8] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:04:08.909440 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4632658c-60b2-4d82-9fb5-1dbcc07d406b tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:08.909942 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4632658c-60b2-4d82-9fb5-1dbcc07d406b tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:08.910424 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4632658c-60b2-4d82-9fb5-1dbcc07d406b tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:08.911180 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4632658c-60b2-4d82-9fb5-1dbcc07d406b tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:08.911647 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4632658c-60b2-4d82-9fb5-1dbcc07d406b tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:08.912092 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4632658c-60b2-4d82-9fb5-1dbcc07d406b tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:09.109869 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-4632658c-60b2-4d82-9fb5-1dbcc07d406b tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9974484d7a01444184df6535e11c34ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9368c1a74d4c4acc8fdcd2d62c422c4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:04:09.123372 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-4632658c-60b2-4d82-9fb5-1dbcc07d406b tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] 10.222.0.33 "GET /compute/v2.1/servers/dd99fc31-2ef1-4998-a149-c2dd0eb96dc8" status: 200 len: 1568 microversion: 2.1 time: 0.242281 Oct 04 22:04:09.124463 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3707/7383] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 22:04:08 2022] GET /compute/v2.1/servers/dd99fc31-2ef1-4998-a149-c2dd0eb96dc8 => generated 1568 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:04:10.157915 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-fe865581-0a88-4c12-9ae9-3a0ec620555b tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:04:10.158656 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-fe865581-0a88-4c12-9ae9-3a0ec620555b tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] [instance: dd99fc31-2ef1-4998-a149-c2dd0eb96dc8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:04:10.174152 n-d-854823-8 devstack@n-api.service[128801]: INFO oslo.messaging._drivers.impl_rabbit [-] [0572b6b5-6fec-4a5a-bfd2-8f7d3f0cb615] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 56938. Oct 04 22:04:10.176065 n-d-854823-8 devstack@n-api.service[128801]: INFO oslo.messaging._drivers.impl_rabbit [-] [0dedeb6d-3fde-4c4e-9f8b-01c561e37600] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 56940. Oct 04 22:04:10.178517 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fe865581-0a88-4c12-9ae9-3a0ec620555b tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:10.179021 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fe865581-0a88-4c12-9ae9-3a0ec620555b tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:10.179466 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fe865581-0a88-4c12-9ae9-3a0ec620555b tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:10.180247 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fe865581-0a88-4c12-9ae9-3a0ec620555b tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:10.180692 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fe865581-0a88-4c12-9ae9-3a0ec620555b tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:10.181117 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-fe865581-0a88-4c12-9ae9-3a0ec620555b tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:10.400843 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-fe865581-0a88-4c12-9ae9-3a0ec620555b tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9974484d7a01444184df6535e11c34ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9368c1a74d4c4acc8fdcd2d62c422c4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:04:10.411711 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-fe865581-0a88-4c12-9ae9-3a0ec620555b tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] 10.222.0.33 "GET /compute/v2.1/servers/dd99fc31-2ef1-4998-a149-c2dd0eb96dc8" status: 200 len: 1568 microversion: 2.1 time: 0.266892 Oct 04 22:04:10.412316 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3677/7384] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 22:04:10 2022] GET /compute/v2.1/servers/dd99fc31-2ef1-4998-a149-c2dd0eb96dc8 => generated 1568 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:04:11.436960 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-10163300-be6b-4ba4-a2a9-a2e180f96b53 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:04:11.437666 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-10163300-be6b-4ba4-a2a9-a2e180f96b53 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] [instance: dd99fc31-2ef1-4998-a149-c2dd0eb96dc8] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:04:11.447946 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-10163300-be6b-4ba4-a2a9-a2e180f96b53 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:11.449388 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-10163300-be6b-4ba4-a2a9-a2e180f96b53 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:11.449986 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-10163300-be6b-4ba4-a2a9-a2e180f96b53 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:11.450961 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-10163300-be6b-4ba4-a2a9-a2e180f96b53 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:11.451471 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-10163300-be6b-4ba4-a2a9-a2e180f96b53 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:11.451942 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-10163300-be6b-4ba4-a2a9-a2e180f96b53 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:11.456655 n-d-854823-8 devstack@n-api.service[128802]: INFO oslo.messaging._drivers.impl_rabbit [-] [399f3af7-d281-4213-9ef7-61e2871c9a11] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 56948. Oct 04 22:04:11.461044 n-d-854823-8 devstack@n-api.service[128802]: INFO oslo.messaging._drivers.impl_rabbit [-] [3ed749fe-ba58-4081-afad-8a961afd7471] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 56946. Oct 04 22:04:11.616267 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-10163300-be6b-4ba4-a2a9-a2e180f96b53 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9974484d7a01444184df6535e11c34ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9368c1a74d4c4acc8fdcd2d62c422c4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:04:11.629930 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-10163300-be6b-4ba4-a2a9-a2e180f96b53 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] 10.222.0.33 "GET /compute/v2.1/servers/dd99fc31-2ef1-4998-a149-c2dd0eb96dc8" status: 200 len: 1568 microversion: 2.1 time: 0.197400 Oct 04 22:04:11.631055 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3708/7385] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 22:04:11 2022] GET /compute/v2.1/servers/dd99fc31-2ef1-4998-a149-c2dd0eb96dc8 => generated 1568 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:04:12.658960 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c656abee-73ee-460a-bc33-02627b27c02f tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:04:12.659795 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c656abee-73ee-460a-bc33-02627b27c02f tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] [instance: dd99fc31-2ef1-4998-a149-c2dd0eb96dc8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:04:12.669646 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c656abee-73ee-460a-bc33-02627b27c02f tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:12.670274 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c656abee-73ee-460a-bc33-02627b27c02f tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:12.670824 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c656abee-73ee-460a-bc33-02627b27c02f tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:12.671692 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c656abee-73ee-460a-bc33-02627b27c02f tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:12.672298 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c656abee-73ee-460a-bc33-02627b27c02f tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:12.672860 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c656abee-73ee-460a-bc33-02627b27c02f tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:12.838218 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-c656abee-73ee-460a-bc33-02627b27c02f tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9974484d7a01444184df6535e11c34ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9368c1a74d4c4acc8fdcd2d62c422c4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:04:12.850287 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c656abee-73ee-460a-bc33-02627b27c02f tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] 10.222.0.33 "GET /compute/v2.1/servers/dd99fc31-2ef1-4998-a149-c2dd0eb96dc8" status: 200 len: 1568 microversion: 2.1 time: 0.196580 Oct 04 22:04:12.851381 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3678/7386] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 22:04:12 2022] GET /compute/v2.1/servers/dd99fc31-2ef1-4998-a149-c2dd0eb96dc8 => generated 1568 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:04:13.876336 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-5df60cd9-0384-475d-9e85-a5f6b08e3a63 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:04:13.877012 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-5df60cd9-0384-475d-9e85-a5f6b08e3a63 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] [instance: dd99fc31-2ef1-4998-a149-c2dd0eb96dc8] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:04:13.884850 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5df60cd9-0384-475d-9e85-a5f6b08e3a63 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:13.885350 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5df60cd9-0384-475d-9e85-a5f6b08e3a63 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:13.886299 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5df60cd9-0384-475d-9e85-a5f6b08e3a63 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:13.887063 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5df60cd9-0384-475d-9e85-a5f6b08e3a63 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:13.887576 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5df60cd9-0384-475d-9e85-a5f6b08e3a63 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:13.888015 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5df60cd9-0384-475d-9e85-a5f6b08e3a63 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:14.063975 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-5df60cd9-0384-475d-9e85-a5f6b08e3a63 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9974484d7a01444184df6535e11c34ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9368c1a74d4c4acc8fdcd2d62c422c4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:04:14.073043 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-5df60cd9-0384-475d-9e85-a5f6b08e3a63 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] 10.222.0.33 "GET /compute/v2.1/servers/dd99fc31-2ef1-4998-a149-c2dd0eb96dc8" status: 200 len: 1568 microversion: 2.1 time: 0.200816 Oct 04 22:04:14.074161 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3709/7387] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 22:04:13 2022] GET /compute/v2.1/servers/dd99fc31-2ef1-4998-a149-c2dd0eb96dc8 => generated 1568 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:04:15.098311 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a6b6a4d3-c547-476f-9a01-2fcc0f704121 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:04:15.099151 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a6b6a4d3-c547-476f-9a01-2fcc0f704121 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] [instance: dd99fc31-2ef1-4998-a149-c2dd0eb96dc8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:04:15.107633 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a6b6a4d3-c547-476f-9a01-2fcc0f704121 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:15.108121 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a6b6a4d3-c547-476f-9a01-2fcc0f704121 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:15.108552 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a6b6a4d3-c547-476f-9a01-2fcc0f704121 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:15.109266 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a6b6a4d3-c547-476f-9a01-2fcc0f704121 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:15.109722 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a6b6a4d3-c547-476f-9a01-2fcc0f704121 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:15.110137 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a6b6a4d3-c547-476f-9a01-2fcc0f704121 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:15.288028 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-a6b6a4d3-c547-476f-9a01-2fcc0f704121 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9974484d7a01444184df6535e11c34ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9368c1a74d4c4acc8fdcd2d62c422c4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:04:15.305455 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a6b6a4d3-c547-476f-9a01-2fcc0f704121 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] 10.222.0.33 "GET /compute/v2.1/servers/dd99fc31-2ef1-4998-a149-c2dd0eb96dc8" status: 200 len: 1568 microversion: 2.1 time: 0.209169 Oct 04 22:04:15.312217 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3679/7388] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 22:04:15 2022] GET /compute/v2.1/servers/dd99fc31-2ef1-4998-a149-c2dd0eb96dc8 => generated 1568 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:04:16.331083 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-9b14b1a8-1b89-4d24-bdf7-6a03aa58a728 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:04:16.331791 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-9b14b1a8-1b89-4d24-bdf7-6a03aa58a728 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] [instance: dd99fc31-2ef1-4998-a149-c2dd0eb96dc8] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:04:16.339764 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9b14b1a8-1b89-4d24-bdf7-6a03aa58a728 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:16.340274 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9b14b1a8-1b89-4d24-bdf7-6a03aa58a728 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:16.340730 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9b14b1a8-1b89-4d24-bdf7-6a03aa58a728 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:16.341465 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9b14b1a8-1b89-4d24-bdf7-6a03aa58a728 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:16.341931 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9b14b1a8-1b89-4d24-bdf7-6a03aa58a728 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:16.342389 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9b14b1a8-1b89-4d24-bdf7-6a03aa58a728 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:16.566309 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-9b14b1a8-1b89-4d24-bdf7-6a03aa58a728 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9974484d7a01444184df6535e11c34ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9368c1a74d4c4acc8fdcd2d62c422c4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:04:16.575793 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-9b14b1a8-1b89-4d24-bdf7-6a03aa58a728 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] 10.222.0.33 "GET /compute/v2.1/servers/dd99fc31-2ef1-4998-a149-c2dd0eb96dc8" status: 200 len: 1568 microversion: 2.1 time: 0.248593 Oct 04 22:04:16.576400 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3710/7389] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 22:04:16 2022] GET /compute/v2.1/servers/dd99fc31-2ef1-4998-a149-c2dd0eb96dc8 => generated 1568 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:04:17.601215 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-3e8f0ecb-5ae9-4ff0-8708-956cc0ce2f7a tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:04:17.602054 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-3e8f0ecb-5ae9-4ff0-8708-956cc0ce2f7a tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] [instance: dd99fc31-2ef1-4998-a149-c2dd0eb96dc8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:04:17.611379 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3e8f0ecb-5ae9-4ff0-8708-956cc0ce2f7a tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:17.611819 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3e8f0ecb-5ae9-4ff0-8708-956cc0ce2f7a tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:17.612352 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3e8f0ecb-5ae9-4ff0-8708-956cc0ce2f7a tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:17.613360 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3e8f0ecb-5ae9-4ff0-8708-956cc0ce2f7a tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:17.613929 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3e8f0ecb-5ae9-4ff0-8708-956cc0ce2f7a tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:17.614595 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3e8f0ecb-5ae9-4ff0-8708-956cc0ce2f7a tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:17.816996 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-3e8f0ecb-5ae9-4ff0-8708-956cc0ce2f7a tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9974484d7a01444184df6535e11c34ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9368c1a74d4c4acc8fdcd2d62c422c4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:04:17.833134 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-3e8f0ecb-5ae9-4ff0-8708-956cc0ce2f7a tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] 10.222.0.33 "GET /compute/v2.1/servers/dd99fc31-2ef1-4998-a149-c2dd0eb96dc8" status: 200 len: 1568 microversion: 2.1 time: 0.235716 Oct 04 22:04:17.834289 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3680/7390] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 22:04:17 2022] GET /compute/v2.1/servers/dd99fc31-2ef1-4998-a149-c2dd0eb96dc8 => generated 1568 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:04:18.863797 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-0003ad67-6b07-4e9c-aaf0-0f3a067de6e7 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:04:18.864557 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-0003ad67-6b07-4e9c-aaf0-0f3a067de6e7 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] [instance: dd99fc31-2ef1-4998-a149-c2dd0eb96dc8] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:04:18.873418 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0003ad67-6b07-4e9c-aaf0-0f3a067de6e7 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:18.874315 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0003ad67-6b07-4e9c-aaf0-0f3a067de6e7 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:18.874956 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0003ad67-6b07-4e9c-aaf0-0f3a067de6e7 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:18.875795 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0003ad67-6b07-4e9c-aaf0-0f3a067de6e7 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:18.876279 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0003ad67-6b07-4e9c-aaf0-0f3a067de6e7 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:18.876716 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-0003ad67-6b07-4e9c-aaf0-0f3a067de6e7 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:19.041022 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-0003ad67-6b07-4e9c-aaf0-0f3a067de6e7 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9974484d7a01444184df6535e11c34ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9368c1a74d4c4acc8fdcd2d62c422c4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:04:19.050086 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-0003ad67-6b07-4e9c-aaf0-0f3a067de6e7 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] 10.222.0.33 "GET /compute/v2.1/servers/dd99fc31-2ef1-4998-a149-c2dd0eb96dc8" status: 200 len: 1568 microversion: 2.1 time: 0.190279 Oct 04 22:04:19.051094 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3711/7391] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 22:04:18 2022] GET /compute/v2.1/servers/dd99fc31-2ef1-4998-a149-c2dd0eb96dc8 => generated 1568 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:04:20.077884 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d200f7e7-c80f-461a-a96f-660a782284fc tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:04:20.078796 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d200f7e7-c80f-461a-a96f-660a782284fc tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] [instance: dd99fc31-2ef1-4998-a149-c2dd0eb96dc8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:04:20.086916 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d200f7e7-c80f-461a-a96f-660a782284fc tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:20.087417 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d200f7e7-c80f-461a-a96f-660a782284fc tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:20.087864 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d200f7e7-c80f-461a-a96f-660a782284fc tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:20.088592 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d200f7e7-c80f-461a-a96f-660a782284fc tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:20.089680 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d200f7e7-c80f-461a-a96f-660a782284fc tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:20.090112 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d200f7e7-c80f-461a-a96f-660a782284fc tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:20.247061 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d200f7e7-c80f-461a-a96f-660a782284fc tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9974484d7a01444184df6535e11c34ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9368c1a74d4c4acc8fdcd2d62c422c4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:04:20.255876 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d200f7e7-c80f-461a-a96f-660a782284fc tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] 10.222.0.33 "GET /compute/v2.1/servers/dd99fc31-2ef1-4998-a149-c2dd0eb96dc8" status: 200 len: 1568 microversion: 2.1 time: 0.182558 Oct 04 22:04:20.256494 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3681/7392] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 22:04:20 2022] GET /compute/v2.1/servers/dd99fc31-2ef1-4998-a149-c2dd0eb96dc8 => generated 1568 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:04:21.279993 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-9d317c43-0736-41a4-b6fd-e889a8bc9ff2 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:04:21.280695 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-9d317c43-0736-41a4-b6fd-e889a8bc9ff2 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] [instance: dd99fc31-2ef1-4998-a149-c2dd0eb96dc8] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:04:21.288105 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9d317c43-0736-41a4-b6fd-e889a8bc9ff2 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:21.288614 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9d317c43-0736-41a4-b6fd-e889a8bc9ff2 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:21.289072 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9d317c43-0736-41a4-b6fd-e889a8bc9ff2 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:21.289900 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9d317c43-0736-41a4-b6fd-e889a8bc9ff2 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:21.290414 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9d317c43-0736-41a4-b6fd-e889a8bc9ff2 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:21.290861 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9d317c43-0736-41a4-b6fd-e889a8bc9ff2 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:21.459959 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-9d317c43-0736-41a4-b6fd-e889a8bc9ff2 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9974484d7a01444184df6535e11c34ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9368c1a74d4c4acc8fdcd2d62c422c4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:04:21.469406 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-9d317c43-0736-41a4-b6fd-e889a8bc9ff2 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] 10.222.0.33 "GET /compute/v2.1/servers/dd99fc31-2ef1-4998-a149-c2dd0eb96dc8" status: 200 len: 1568 microversion: 2.1 time: 0.193685 Oct 04 22:04:21.470018 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3712/7393] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 22:04:21 2022] GET /compute/v2.1/servers/dd99fc31-2ef1-4998-a149-c2dd0eb96dc8 => generated 1568 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:04:22.497566 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1234673f-c0b1-40e6-b75a-851e84368561 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:04:22.498626 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-1234673f-c0b1-40e6-b75a-851e84368561 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] [instance: dd99fc31-2ef1-4998-a149-c2dd0eb96dc8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:04:22.508503 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1234673f-c0b1-40e6-b75a-851e84368561 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:22.509114 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1234673f-c0b1-40e6-b75a-851e84368561 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:22.509641 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1234673f-c0b1-40e6-b75a-851e84368561 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:22.511498 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1234673f-c0b1-40e6-b75a-851e84368561 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:22.511987 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1234673f-c0b1-40e6-b75a-851e84368561 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:22.512727 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1234673f-c0b1-40e6-b75a-851e84368561 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:22.683386 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-1234673f-c0b1-40e6-b75a-851e84368561 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9974484d7a01444184df6535e11c34ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9368c1a74d4c4acc8fdcd2d62c422c4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:04:22.696287 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-1234673f-c0b1-40e6-b75a-851e84368561 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] 10.222.0.33 "GET /compute/v2.1/servers/dd99fc31-2ef1-4998-a149-c2dd0eb96dc8" status: 200 len: 1568 microversion: 2.1 time: 0.204295 Oct 04 22:04:22.696777 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3682/7394] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 22:04:22 2022] GET /compute/v2.1/servers/dd99fc31-2ef1-4998-a149-c2dd0eb96dc8 => generated 1568 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:04:23.725231 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-aece6d74-f88e-4f27-a85d-540e32090c30 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:04:23.726294 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-aece6d74-f88e-4f27-a85d-540e32090c30 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] [instance: dd99fc31-2ef1-4998-a149-c2dd0eb96dc8] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:04:23.735930 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-aece6d74-f88e-4f27-a85d-540e32090c30 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:23.736794 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-aece6d74-f88e-4f27-a85d-540e32090c30 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:23.737539 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-aece6d74-f88e-4f27-a85d-540e32090c30 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:23.738475 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-aece6d74-f88e-4f27-a85d-540e32090c30 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:23.739079 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-aece6d74-f88e-4f27-a85d-540e32090c30 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:23.739689 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-aece6d74-f88e-4f27-a85d-540e32090c30 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:23.967627 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-aece6d74-f88e-4f27-a85d-540e32090c30 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9974484d7a01444184df6535e11c34ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9368c1a74d4c4acc8fdcd2d62c422c4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:04:23.978237 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-aece6d74-f88e-4f27-a85d-540e32090c30 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] 10.222.0.33 "GET /compute/v2.1/servers/dd99fc31-2ef1-4998-a149-c2dd0eb96dc8" status: 200 len: 1568 microversion: 2.1 time: 0.257793 Oct 04 22:04:23.978891 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3713/7395] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 22:04:23 2022] GET /compute/v2.1/servers/dd99fc31-2ef1-4998-a149-c2dd0eb96dc8 => generated 1568 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:04:25.012764 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-3d5df28c-cbbb-4f4a-8543-6e17742d1a23 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:04:25.013362 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-3d5df28c-cbbb-4f4a-8543-6e17742d1a23 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] [instance: dd99fc31-2ef1-4998-a149-c2dd0eb96dc8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:04:25.021516 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3d5df28c-cbbb-4f4a-8543-6e17742d1a23 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:25.022020 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3d5df28c-cbbb-4f4a-8543-6e17742d1a23 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:25.022501 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3d5df28c-cbbb-4f4a-8543-6e17742d1a23 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:25.023235 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3d5df28c-cbbb-4f4a-8543-6e17742d1a23 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:25.023705 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3d5df28c-cbbb-4f4a-8543-6e17742d1a23 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:25.024138 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-3d5df28c-cbbb-4f4a-8543-6e17742d1a23 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:25.183677 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-3d5df28c-cbbb-4f4a-8543-6e17742d1a23 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9974484d7a01444184df6535e11c34ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9368c1a74d4c4acc8fdcd2d62c422c4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:04:25.192566 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-3d5df28c-cbbb-4f4a-8543-6e17742d1a23 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] 10.222.0.33 "GET /compute/v2.1/servers/dd99fc31-2ef1-4998-a149-c2dd0eb96dc8" status: 200 len: 1509 microversion: 2.1 time: 0.184553 Oct 04 22:04:25.193345 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3683/7396] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 22:04:25 2022] GET /compute/v2.1/servers/dd99fc31-2ef1-4998-a149-c2dd0eb96dc8 => generated 1509 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:04:25.218572 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-61babe07-13cb-4618-954c-0d7fc57f7e21 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:04:25.220007 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-61babe07-13cb-4618-954c-0d7fc57f7e21 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] [instance: dd99fc31-2ef1-4998-a149-c2dd0eb96dc8] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:04:25.227105 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-61babe07-13cb-4618-954c-0d7fc57f7e21 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:25.227620 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-61babe07-13cb-4618-954c-0d7fc57f7e21 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:25.228076 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-61babe07-13cb-4618-954c-0d7fc57f7e21 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:25.228816 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-61babe07-13cb-4618-954c-0d7fc57f7e21 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:25.229823 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-61babe07-13cb-4618-954c-0d7fc57f7e21 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:25.230406 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-61babe07-13cb-4618-954c-0d7fc57f7e21 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:25.264362 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-61babe07-13cb-4618-954c-0d7fc57f7e21 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] [instance: dd99fc31-2ef1-4998-a149-c2dd0eb96dc8] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=128802) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 04 22:04:25.346245 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-61babe07-13cb-4618-954c-0d7fc57f7e21 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] 10.222.0.33 "POST /compute/v2.1/servers/dd99fc31-2ef1-4998-a149-c2dd0eb96dc8/action" status: 202 len: 0 microversion: 2.1 time: 0.132688 Oct 04 22:04:25.350405 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3714/7397] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 22:04:25 2022] POST /compute/v2.1/servers/dd99fc31-2ef1-4998-a149-c2dd0eb96dc8/action => generated 0 bytes in 135 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 22:04:25.357088 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-08c5d4b4-040d-42ff-aafa-7e68060cd4fb tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:04:25.357594 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-08c5d4b4-040d-42ff-aafa-7e68060cd4fb tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] [instance: dd99fc31-2ef1-4998-a149-c2dd0eb96dc8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:04:25.368371 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-08c5d4b4-040d-42ff-aafa-7e68060cd4fb tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:25.369241 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-08c5d4b4-040d-42ff-aafa-7e68060cd4fb tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:25.370291 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-08c5d4b4-040d-42ff-aafa-7e68060cd4fb tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:25.371626 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-08c5d4b4-040d-42ff-aafa-7e68060cd4fb tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:25.372294 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-08c5d4b4-040d-42ff-aafa-7e68060cd4fb tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:25.372974 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-08c5d4b4-040d-42ff-aafa-7e68060cd4fb tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:25.592180 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-08c5d4b4-040d-42ff-aafa-7e68060cd4fb tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9974484d7a01444184df6535e11c34ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9368c1a74d4c4acc8fdcd2d62c422c4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:04:25.609699 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-08c5d4b4-040d-42ff-aafa-7e68060cd4fb tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] 10.222.0.33 "GET /compute/v2.1/servers/dd99fc31-2ef1-4998-a149-c2dd0eb96dc8" status: 200 len: 1517 microversion: 2.1 time: 0.257241 Oct 04 22:04:25.610306 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3684/7398] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 22:04:25 2022] GET /compute/v2.1/servers/dd99fc31-2ef1-4998-a149-c2dd0eb96dc8 => generated 1517 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:04:25.975670 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-35a0c980-4656-4a71-86de-d67a1b48558e req-a530a190-6356-47ac-a3d8-3d3d8c85bd73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd99fc31-2ef1-4998-a149-c2dd0eb96dc8", "name": "network-vif-unplugged", "status": "completed", "tag": "f0ab4cec-378f-4579-af92-46545a2b3c57"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:04:26.009132 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-35a0c980-4656-4a71-86de-d67a1b48558e req-a530a190-6356-47ac-a3d8-3d3d8c85bd73 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:26.010013 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-35a0c980-4656-4a71-86de-d67a1b48558e req-a530a190-6356-47ac-a3d8-3d3d8c85bd73 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:26.011823 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-35a0c980-4656-4a71-86de-d67a1b48558e req-a530a190-6356-47ac-a3d8-3d3d8c85bd73 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:26.033809 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.compute.server_external_events [req-35a0c980-4656-4a71-86de-d67a1b48558e req-a530a190-6356-47ac-a3d8-3d3d8c85bd73 service nova] Unable to find a host for instance dd99fc31-2ef1-4998-a149-c2dd0eb96dc8. Dropping event network-vif-unplugged {{(pid=128802) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 04 22:04:26.035520 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-35a0c980-4656-4a71-86de-d67a1b48558e req-a530a190-6356-47ac-a3d8-3d3d8c85bd73 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.066786 Oct 04 22:04:26.037097 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3715/7399] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 22:04:25 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 70 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 04 22:04:26.637220 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a208c2bd-d777-45a9-b282-fd4bde995d5e tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:04:26.637882 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a208c2bd-d777-45a9-b282-fd4bde995d5e tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] [instance: dd99fc31-2ef1-4998-a149-c2dd0eb96dc8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:04:26.645541 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a208c2bd-d777-45a9-b282-fd4bde995d5e tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:26.646038 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a208c2bd-d777-45a9-b282-fd4bde995d5e tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:26.646517 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a208c2bd-d777-45a9-b282-fd4bde995d5e tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:26.647256 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a208c2bd-d777-45a9-b282-fd4bde995d5e tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:26.647719 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a208c2bd-d777-45a9-b282-fd4bde995d5e tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:26.648182 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a208c2bd-d777-45a9-b282-fd4bde995d5e tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:26.814809 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-a208c2bd-d777-45a9-b282-fd4bde995d5e tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9974484d7a01444184df6535e11c34ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9368c1a74d4c4acc8fdcd2d62c422c4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:04:26.824194 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a208c2bd-d777-45a9-b282-fd4bde995d5e tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] 10.222.0.33 "GET /compute/v2.1/servers/dd99fc31-2ef1-4998-a149-c2dd0eb96dc8" status: 200 len: 1519 microversion: 2.1 time: 0.191960 Oct 04 22:04:26.824804 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3685/7400] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 22:04:26 2022] GET /compute/v2.1/servers/dd99fc31-2ef1-4998-a149-c2dd0eb96dc8 => generated 1519 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:04:27.851557 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-803f7304-3ed8-4b13-a178-169451f61095 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:04:27.852399 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-803f7304-3ed8-4b13-a178-169451f61095 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] [instance: dd99fc31-2ef1-4998-a149-c2dd0eb96dc8] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:04:27.861974 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-803f7304-3ed8-4b13-a178-169451f61095 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:27.862528 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-803f7304-3ed8-4b13-a178-169451f61095 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:27.863173 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-803f7304-3ed8-4b13-a178-169451f61095 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:27.864183 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-803f7304-3ed8-4b13-a178-169451f61095 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:27.864935 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-803f7304-3ed8-4b13-a178-169451f61095 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:27.865575 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-803f7304-3ed8-4b13-a178-169451f61095 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:28.086005 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-803f7304-3ed8-4b13-a178-169451f61095 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9974484d7a01444184df6535e11c34ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9368c1a74d4c4acc8fdcd2d62c422c4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:04:28.097729 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-803f7304-3ed8-4b13-a178-169451f61095 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] 10.222.0.33 "GET /compute/v2.1/servers/dd99fc31-2ef1-4998-a149-c2dd0eb96dc8" status: 200 len: 1519 microversion: 2.1 time: 0.250535 Oct 04 22:04:28.099793 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3716/7401] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 22:04:27 2022] GET /compute/v2.1/servers/dd99fc31-2ef1-4998-a149-c2dd0eb96dc8 => generated 1519 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:04:29.139793 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1ce516ea-e351-4972-9208-bb09cbbfe9c4 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:04:29.140841 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-1ce516ea-e351-4972-9208-bb09cbbfe9c4 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] [instance: dd99fc31-2ef1-4998-a149-c2dd0eb96dc8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:04:29.150648 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1ce516ea-e351-4972-9208-bb09cbbfe9c4 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:29.152135 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1ce516ea-e351-4972-9208-bb09cbbfe9c4 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:29.152766 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1ce516ea-e351-4972-9208-bb09cbbfe9c4 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:29.153718 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1ce516ea-e351-4972-9208-bb09cbbfe9c4 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:29.154434 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1ce516ea-e351-4972-9208-bb09cbbfe9c4 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:29.154943 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1ce516ea-e351-4972-9208-bb09cbbfe9c4 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:29.337177 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-1ce516ea-e351-4972-9208-bb09cbbfe9c4 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9974484d7a01444184df6535e11c34ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9368c1a74d4c4acc8fdcd2d62c422c4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:04:29.353626 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-1ce516ea-e351-4972-9208-bb09cbbfe9c4 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] 10.222.0.33 "GET /compute/v2.1/servers/dd99fc31-2ef1-4998-a149-c2dd0eb96dc8" status: 200 len: 1519 microversion: 2.1 time: 0.218381 Oct 04 22:04:29.355000 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3686/7402] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 22:04:29 2022] GET /compute/v2.1/servers/dd99fc31-2ef1-4998-a149-c2dd0eb96dc8 => generated 1519 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:04:30.398417 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-c03deea2-3ee4-4a54-980e-f36789587fe2 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:04:30.399609 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-c03deea2-3ee4-4a54-980e-f36789587fe2 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] [instance: dd99fc31-2ef1-4998-a149-c2dd0eb96dc8] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:04:30.413621 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c03deea2-3ee4-4a54-980e-f36789587fe2 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:30.414809 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c03deea2-3ee4-4a54-980e-f36789587fe2 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:30.422613 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c03deea2-3ee4-4a54-980e-f36789587fe2 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:30.423952 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c03deea2-3ee4-4a54-980e-f36789587fe2 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:30.424722 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c03deea2-3ee4-4a54-980e-f36789587fe2 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:30.425412 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c03deea2-3ee4-4a54-980e-f36789587fe2 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:30.587495 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-c03deea2-3ee4-4a54-980e-f36789587fe2 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9974484d7a01444184df6535e11c34ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9368c1a74d4c4acc8fdcd2d62c422c4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:04:30.596185 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-c03deea2-3ee4-4a54-980e-f36789587fe2 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] 10.222.0.33 "GET /compute/v2.1/servers/dd99fc31-2ef1-4998-a149-c2dd0eb96dc8" status: 200 len: 1519 microversion: 2.1 time: 0.205311 Oct 04 22:04:30.596814 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3717/7403] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 22:04:30 2022] GET /compute/v2.1/servers/dd99fc31-2ef1-4998-a149-c2dd0eb96dc8 => generated 1519 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:04:31.625293 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-07bc760c-6867-4845-9293-ae1998e8d52c tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:04:31.626308 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-07bc760c-6867-4845-9293-ae1998e8d52c tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] [instance: dd99fc31-2ef1-4998-a149-c2dd0eb96dc8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:04:31.637164 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-07bc760c-6867-4845-9293-ae1998e8d52c tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:31.638029 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-07bc760c-6867-4845-9293-ae1998e8d52c tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:31.638720 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-07bc760c-6867-4845-9293-ae1998e8d52c tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:31.639714 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-07bc760c-6867-4845-9293-ae1998e8d52c tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:31.640300 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-07bc760c-6867-4845-9293-ae1998e8d52c tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:31.640989 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-07bc760c-6867-4845-9293-ae1998e8d52c tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:31.820453 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-07bc760c-6867-4845-9293-ae1998e8d52c tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9974484d7a01444184df6535e11c34ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9368c1a74d4c4acc8fdcd2d62c422c4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:04:31.834903 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-07bc760c-6867-4845-9293-ae1998e8d52c tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] 10.222.0.33 "GET /compute/v2.1/servers/dd99fc31-2ef1-4998-a149-c2dd0eb96dc8" status: 200 len: 1519 microversion: 2.1 time: 0.216101 Oct 04 22:04:31.836217 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3687/7404] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 22:04:31 2022] GET /compute/v2.1/servers/dd99fc31-2ef1-4998-a149-c2dd0eb96dc8 => generated 1519 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:04:32.878781 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-bfee9645-97e8-46f9-8592-c81d36f48790 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:04:32.879679 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-bfee9645-97e8-46f9-8592-c81d36f48790 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] [instance: dd99fc31-2ef1-4998-a149-c2dd0eb96dc8] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:04:32.888952 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bfee9645-97e8-46f9-8592-c81d36f48790 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:32.889662 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bfee9645-97e8-46f9-8592-c81d36f48790 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:32.890479 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bfee9645-97e8-46f9-8592-c81d36f48790 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:32.891226 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bfee9645-97e8-46f9-8592-c81d36f48790 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:32.891756 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bfee9645-97e8-46f9-8592-c81d36f48790 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:32.892330 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-bfee9645-97e8-46f9-8592-c81d36f48790 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:33.077375 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-bfee9645-97e8-46f9-8592-c81d36f48790 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9974484d7a01444184df6535e11c34ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9368c1a74d4c4acc8fdcd2d62c422c4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:04:33.097120 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-bfee9645-97e8-46f9-8592-c81d36f48790 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] 10.222.0.33 "GET /compute/v2.1/servers/dd99fc31-2ef1-4998-a149-c2dd0eb96dc8" status: 200 len: 1575 microversion: 2.1 time: 0.223107 Oct 04 22:04:33.098436 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3718/7405] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 22:04:32 2022] GET /compute/v2.1/servers/dd99fc31-2ef1-4998-a149-c2dd0eb96dc8 => generated 1575 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:04:33.667261 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-466303fe-aa41-4296-950a-26a1ebe7c7ff req-4a5b175d-dd6d-45f1-a6ba-6159905829ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd99fc31-2ef1-4998-a149-c2dd0eb96dc8", "tag": "f0ab4cec-378f-4579-af92-46545a2b3c57"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:04:33.679846 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-466303fe-aa41-4296-950a-26a1ebe7c7ff req-4a5b175d-dd6d-45f1-a6ba-6159905829ba service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:33.680273 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-466303fe-aa41-4296-950a-26a1ebe7c7ff req-4a5b175d-dd6d-45f1-a6ba-6159905829ba service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:33.680782 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-466303fe-aa41-4296-950a-26a1ebe7c7ff req-4a5b175d-dd6d-45f1-a6ba-6159905829ba service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:33.694919 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-466303fe-aa41-4296-950a-26a1ebe7c7ff req-4a5b175d-dd6d-45f1-a6ba-6159905829ba service nova] Creating event network-changed:f0ab4cec-378f-4579-af92-46545a2b3c57 for instance dd99fc31-2ef1-4998-a149-c2dd0eb96dc8 on n-h2-854823-8 Oct 04 22:04:33.701645 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-466303fe-aa41-4296-950a-26a1ebe7c7ff req-4a5b175d-dd6d-45f1-a6ba-6159905829ba service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039691 Oct 04 22:04:33.702913 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3688/7406] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 22:04:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:04:34.143263 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-498cd964-ce63-447b-8a66-62f6f0a87b6b tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:04:34.144498 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-498cd964-ce63-447b-8a66-62f6f0a87b6b tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] [instance: dd99fc31-2ef1-4998-a149-c2dd0eb96dc8] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:04:34.158266 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-498cd964-ce63-447b-8a66-62f6f0a87b6b tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:34.158966 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-498cd964-ce63-447b-8a66-62f6f0a87b6b tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:34.159600 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-498cd964-ce63-447b-8a66-62f6f0a87b6b tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:34.160508 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-498cd964-ce63-447b-8a66-62f6f0a87b6b tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:34.161083 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-498cd964-ce63-447b-8a66-62f6f0a87b6b tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:34.161618 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-498cd964-ce63-447b-8a66-62f6f0a87b6b tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:34.356844 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-498cd964-ce63-447b-8a66-62f6f0a87b6b tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9974484d7a01444184df6535e11c34ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9368c1a74d4c4acc8fdcd2d62c422c4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:04:34.368527 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-498cd964-ce63-447b-8a66-62f6f0a87b6b tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] 10.222.0.33 "GET /compute/v2.1/servers/dd99fc31-2ef1-4998-a149-c2dd0eb96dc8" status: 200 len: 1575 microversion: 2.1 time: 0.233601 Oct 04 22:04:34.370165 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3719/7407] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 22:04:34 2022] GET /compute/v2.1/servers/dd99fc31-2ef1-4998-a149-c2dd0eb96dc8 => generated 1575 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:04:35.404846 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-bb961d08-52e0-4d86-8417-b16c55efe7d7 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:04:35.407223 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-bb961d08-52e0-4d86-8417-b16c55efe7d7 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] [instance: dd99fc31-2ef1-4998-a149-c2dd0eb96dc8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:04:35.418806 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bb961d08-52e0-4d86-8417-b16c55efe7d7 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:35.419705 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bb961d08-52e0-4d86-8417-b16c55efe7d7 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:35.420501 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bb961d08-52e0-4d86-8417-b16c55efe7d7 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:35.421841 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bb961d08-52e0-4d86-8417-b16c55efe7d7 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:35.422737 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bb961d08-52e0-4d86-8417-b16c55efe7d7 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:35.423538 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-bb961d08-52e0-4d86-8417-b16c55efe7d7 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:35.596018 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-bb961d08-52e0-4d86-8417-b16c55efe7d7 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9974484d7a01444184df6535e11c34ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9368c1a74d4c4acc8fdcd2d62c422c4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:04:35.604533 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-bb961d08-52e0-4d86-8417-b16c55efe7d7 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] 10.222.0.33 "GET /compute/v2.1/servers/dd99fc31-2ef1-4998-a149-c2dd0eb96dc8" status: 200 len: 1575 microversion: 2.1 time: 0.210678 Oct 04 22:04:35.605169 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3689/7408] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 22:04:35 2022] GET /compute/v2.1/servers/dd99fc31-2ef1-4998-a149-c2dd0eb96dc8 => generated 1575 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:04:36.629501 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-b0a0292d-8bbe-427a-8709-f61179e8a134 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:04:36.630147 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-b0a0292d-8bbe-427a-8709-f61179e8a134 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] [instance: dd99fc31-2ef1-4998-a149-c2dd0eb96dc8] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:04:36.639292 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b0a0292d-8bbe-427a-8709-f61179e8a134 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:36.639871 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b0a0292d-8bbe-427a-8709-f61179e8a134 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:36.640388 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b0a0292d-8bbe-427a-8709-f61179e8a134 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:36.641179 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b0a0292d-8bbe-427a-8709-f61179e8a134 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:36.641682 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b0a0292d-8bbe-427a-8709-f61179e8a134 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:36.642160 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-b0a0292d-8bbe-427a-8709-f61179e8a134 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:36.797959 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-b0a0292d-8bbe-427a-8709-f61179e8a134 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9974484d7a01444184df6535e11c34ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9368c1a74d4c4acc8fdcd2d62c422c4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:04:36.807374 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-b0a0292d-8bbe-427a-8709-f61179e8a134 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] 10.222.0.33 "GET /compute/v2.1/servers/dd99fc31-2ef1-4998-a149-c2dd0eb96dc8" status: 200 len: 1575 microversion: 2.1 time: 0.181611 Oct 04 22:04:36.808701 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3720/7409] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 22:04:36 2022] GET /compute/v2.1/servers/dd99fc31-2ef1-4998-a149-c2dd0eb96dc8 => generated 1575 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:04:37.836560 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-149c0346-94dd-4d71-a96e-98298e3f54f0 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:04:37.837475 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-149c0346-94dd-4d71-a96e-98298e3f54f0 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] [instance: dd99fc31-2ef1-4998-a149-c2dd0eb96dc8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:04:37.846667 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-149c0346-94dd-4d71-a96e-98298e3f54f0 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:37.847160 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-149c0346-94dd-4d71-a96e-98298e3f54f0 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:37.847591 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-149c0346-94dd-4d71-a96e-98298e3f54f0 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:37.848309 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-149c0346-94dd-4d71-a96e-98298e3f54f0 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:37.848759 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-149c0346-94dd-4d71-a96e-98298e3f54f0 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:37.849180 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-149c0346-94dd-4d71-a96e-98298e3f54f0 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:38.030726 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-149c0346-94dd-4d71-a96e-98298e3f54f0 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9974484d7a01444184df6535e11c34ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9368c1a74d4c4acc8fdcd2d62c422c4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:04:38.039465 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-149c0346-94dd-4d71-a96e-98298e3f54f0 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] 10.222.0.33 "GET /compute/v2.1/servers/dd99fc31-2ef1-4998-a149-c2dd0eb96dc8" status: 200 len: 1575 microversion: 2.1 time: 0.209136 Oct 04 22:04:38.040228 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3690/7410] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 22:04:37 2022] GET /compute/v2.1/servers/dd99fc31-2ef1-4998-a149-c2dd0eb96dc8 => generated 1575 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:04:39.065671 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-c7b81713-74cc-4543-a002-4de5713c84b9 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:04:39.066467 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-c7b81713-74cc-4543-a002-4de5713c84b9 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] [instance: dd99fc31-2ef1-4998-a149-c2dd0eb96dc8] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:04:39.069400 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=1 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:04:39.078697 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c7b81713-74cc-4543-a002-4de5713c84b9 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:39.079232 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c7b81713-74cc-4543-a002-4de5713c84b9 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:39.079695 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c7b81713-74cc-4543-a002-4de5713c84b9 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:39.080461 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c7b81713-74cc-4543-a002-4de5713c84b9 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:39.080945 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c7b81713-74cc-4543-a002-4de5713c84b9 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:39.081376 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-c7b81713-74cc-4543-a002-4de5713c84b9 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:39.085470 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:04:39.259615 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-c7b81713-74cc-4543-a002-4de5713c84b9 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9974484d7a01444184df6535e11c34ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9368c1a74d4c4acc8fdcd2d62c422c4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:04:39.269913 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-c7b81713-74cc-4543-a002-4de5713c84b9 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] 10.222.0.33 "GET /compute/v2.1/servers/dd99fc31-2ef1-4998-a149-c2dd0eb96dc8" status: 200 len: 1575 microversion: 2.1 time: 0.208486 Oct 04 22:04:39.270586 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3721/7411] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 22:04:39 2022] GET /compute/v2.1/servers/dd99fc31-2ef1-4998-a149-c2dd0eb96dc8 => generated 1575 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:04:40.296006 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9c296949-b568-444c-839f-0b17fccfbe0e tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:04:40.296647 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-9c296949-b568-444c-839f-0b17fccfbe0e tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] [instance: dd99fc31-2ef1-4998-a149-c2dd0eb96dc8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:04:40.299371 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=31 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:04:40.308616 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9c296949-b568-444c-839f-0b17fccfbe0e tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:40.309195 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9c296949-b568-444c-839f-0b17fccfbe0e tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:40.309851 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9c296949-b568-444c-839f-0b17fccfbe0e tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:40.310651 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9c296949-b568-444c-839f-0b17fccfbe0e tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:40.311134 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9c296949-b568-444c-839f-0b17fccfbe0e tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:40.311602 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9c296949-b568-444c-839f-0b17fccfbe0e tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:40.314777 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:04:40.482814 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-9c296949-b568-444c-839f-0b17fccfbe0e tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9974484d7a01444184df6535e11c34ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9368c1a74d4c4acc8fdcd2d62c422c4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:04:40.491671 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-9c296949-b568-444c-839f-0b17fccfbe0e tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] 10.222.0.33 "GET /compute/v2.1/servers/dd99fc31-2ef1-4998-a149-c2dd0eb96dc8" status: 200 len: 1575 microversion: 2.1 time: 0.200920 Oct 04 22:04:40.492542 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3691/7412] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 22:04:40 2022] GET /compute/v2.1/servers/dd99fc31-2ef1-4998-a149-c2dd0eb96dc8 => generated 1575 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:04:41.517790 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-4c3d349c-aa63-4be7-b534-118e65950305 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:04:41.518482 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-4c3d349c-aa63-4be7-b534-118e65950305 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] [instance: dd99fc31-2ef1-4998-a149-c2dd0eb96dc8] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:04:41.526787 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4c3d349c-aa63-4be7-b534-118e65950305 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:41.527307 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4c3d349c-aa63-4be7-b534-118e65950305 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:41.527871 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4c3d349c-aa63-4be7-b534-118e65950305 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:41.528662 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4c3d349c-aa63-4be7-b534-118e65950305 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:41.529153 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4c3d349c-aa63-4be7-b534-118e65950305 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:41.529599 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4c3d349c-aa63-4be7-b534-118e65950305 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:41.723707 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-4c3d349c-aa63-4be7-b534-118e65950305 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9974484d7a01444184df6535e11c34ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9368c1a74d4c4acc8fdcd2d62c422c4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:04:41.734815 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-4c3d349c-aa63-4be7-b534-118e65950305 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] 10.222.0.33 "GET /compute/v2.1/servers/dd99fc31-2ef1-4998-a149-c2dd0eb96dc8" status: 200 len: 1575 microversion: 2.1 time: 0.220947 Oct 04 22:04:41.735466 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3722/7413] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 22:04:41 2022] GET /compute/v2.1/servers/dd99fc31-2ef1-4998-a149-c2dd0eb96dc8 => generated 1575 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:04:42.759119 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-7e5e762f-f504-42d5-8352-8236ccb02502 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:04:42.759820 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-7e5e762f-f504-42d5-8352-8236ccb02502 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] [instance: dd99fc31-2ef1-4998-a149-c2dd0eb96dc8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:04:42.767927 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7e5e762f-f504-42d5-8352-8236ccb02502 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:42.768590 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7e5e762f-f504-42d5-8352-8236ccb02502 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:42.769068 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7e5e762f-f504-42d5-8352-8236ccb02502 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:42.769821 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7e5e762f-f504-42d5-8352-8236ccb02502 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:42.770322 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7e5e762f-f504-42d5-8352-8236ccb02502 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:42.770940 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-7e5e762f-f504-42d5-8352-8236ccb02502 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:42.927514 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-7e5e762f-f504-42d5-8352-8236ccb02502 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9974484d7a01444184df6535e11c34ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9368c1a74d4c4acc8fdcd2d62c422c4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:04:42.937722 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-7e5e762f-f504-42d5-8352-8236ccb02502 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] 10.222.0.33 "GET /compute/v2.1/servers/dd99fc31-2ef1-4998-a149-c2dd0eb96dc8" status: 200 len: 1575 microversion: 2.1 time: 0.182524 Oct 04 22:04:42.938326 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3692/7414] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 22:04:42 2022] GET /compute/v2.1/servers/dd99fc31-2ef1-4998-a149-c2dd0eb96dc8 => generated 1575 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:04:43.967430 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-44ab7223-cf8b-41d6-a2fe-daf1efd3bfbc tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:04:43.968166 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-44ab7223-cf8b-41d6-a2fe-daf1efd3bfbc tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] [instance: dd99fc31-2ef1-4998-a149-c2dd0eb96dc8] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:04:43.976139 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-44ab7223-cf8b-41d6-a2fe-daf1efd3bfbc tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:43.976724 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-44ab7223-cf8b-41d6-a2fe-daf1efd3bfbc tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:43.977313 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-44ab7223-cf8b-41d6-a2fe-daf1efd3bfbc tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:43.978127 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-44ab7223-cf8b-41d6-a2fe-daf1efd3bfbc tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:43.979303 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-44ab7223-cf8b-41d6-a2fe-daf1efd3bfbc tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:43.980118 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-44ab7223-cf8b-41d6-a2fe-daf1efd3bfbc tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:44.144439 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-44ab7223-cf8b-41d6-a2fe-daf1efd3bfbc tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9974484d7a01444184df6535e11c34ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9368c1a74d4c4acc8fdcd2d62c422c4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:04:44.155094 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-44ab7223-cf8b-41d6-a2fe-daf1efd3bfbc tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] 10.222.0.33 "GET /compute/v2.1/servers/dd99fc31-2ef1-4998-a149-c2dd0eb96dc8" status: 200 len: 1575 microversion: 2.1 time: 0.195709 Oct 04 22:04:44.155707 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3723/7415] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 22:04:43 2022] GET /compute/v2.1/servers/dd99fc31-2ef1-4998-a149-c2dd0eb96dc8 => generated 1575 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:04:45.198151 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-4924c5bc-a1c6-48c4-98cd-971271d3d407 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:04:45.199214 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-4924c5bc-a1c6-48c4-98cd-971271d3d407 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] [instance: dd99fc31-2ef1-4998-a149-c2dd0eb96dc8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:04:45.207221 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4924c5bc-a1c6-48c4-98cd-971271d3d407 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:45.207733 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4924c5bc-a1c6-48c4-98cd-971271d3d407 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:45.208172 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4924c5bc-a1c6-48c4-98cd-971271d3d407 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:45.208918 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4924c5bc-a1c6-48c4-98cd-971271d3d407 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:45.209383 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4924c5bc-a1c6-48c4-98cd-971271d3d407 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:45.209810 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-4924c5bc-a1c6-48c4-98cd-971271d3d407 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:45.419470 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-b15aa741-d60e-4bfd-b258-a74cda945e66 req-64b9821d-f096-42a1-a146-1a7ed4575b35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd99fc31-2ef1-4998-a149-c2dd0eb96dc8", "name": "network-vif-plugged", "status": "completed", "tag": "f0ab4cec-378f-4579-af92-46545a2b3c57"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:04:45.433417 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-b15aa741-d60e-4bfd-b258-a74cda945e66 req-64b9821d-f096-42a1-a146-1a7ed4575b35 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:45.434436 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-b15aa741-d60e-4bfd-b258-a74cda945e66 req-64b9821d-f096-42a1-a146-1a7ed4575b35 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:45.435133 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-b15aa741-d60e-4bfd-b258-a74cda945e66 req-64b9821d-f096-42a1-a146-1a7ed4575b35 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:45.449969 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-b15aa741-d60e-4bfd-b258-a74cda945e66 req-64b9821d-f096-42a1-a146-1a7ed4575b35 service nova] Creating event network-vif-plugged:f0ab4cec-378f-4579-af92-46545a2b3c57 for instance dd99fc31-2ef1-4998-a149-c2dd0eb96dc8 on n-h2-854823-8 Oct 04 22:04:45.454874 n-d-854823-8 devstack@n-api.service[128802]: ERROR oslo.messaging._drivers.impl_rabbit [req-b15aa741-d60e-4bfd-b258-a74cda945e66 req-64b9821d-f096-42a1-a146-1a7ed4575b35 service nova] [c6c19f4c-750a-4c4a-9312-123925cab818] AMQP server on 10.222.0.33:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 22:04:45.456771 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-4924c5bc-a1c6-48c4-98cd-971271d3d407 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9974484d7a01444184df6535e11c34ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9368c1a74d4c4acc8fdcd2d62c422c4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:04:45.467156 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-4924c5bc-a1c6-48c4-98cd-971271d3d407 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] 10.222.0.33 "GET /compute/v2.1/servers/dd99fc31-2ef1-4998-a149-c2dd0eb96dc8" status: 200 len: 1575 microversion: 2.1 time: 0.274363 Oct 04 22:04:45.467817 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3693/7416] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 22:04:45 2022] GET /compute/v2.1/servers/dd99fc31-2ef1-4998-a149-c2dd0eb96dc8 => generated 1575 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:04:46.464319 n-d-854823-8 devstack@n-api.service[128802]: INFO oslo.messaging._drivers.impl_rabbit [req-b15aa741-d60e-4bfd-b258-a74cda945e66 req-64b9821d-f096-42a1-a146-1a7ed4575b35 service nova] [c6c19f4c-750a-4c4a-9312-123925cab818] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 57030. Oct 04 22:04:46.468100 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-b15aa741-d60e-4bfd-b258-a74cda945e66 req-64b9821d-f096-42a1-a146-1a7ed4575b35 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 1.117596 Oct 04 22:04:46.468728 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3724/7417] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 22:04:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 22:04:46.498485 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5278e167-da53-4e0b-b67a-6b5cf70f9c40 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:04:46.499176 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-5278e167-da53-4e0b-b67a-6b5cf70f9c40 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] [instance: dd99fc31-2ef1-4998-a149-c2dd0eb96dc8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:04:46.506721 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5278e167-da53-4e0b-b67a-6b5cf70f9c40 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:46.507220 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5278e167-da53-4e0b-b67a-6b5cf70f9c40 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:46.507659 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5278e167-da53-4e0b-b67a-6b5cf70f9c40 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:46.508382 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5278e167-da53-4e0b-b67a-6b5cf70f9c40 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:46.508844 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5278e167-da53-4e0b-b67a-6b5cf70f9c40 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:46.509276 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5278e167-da53-4e0b-b67a-6b5cf70f9c40 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:46.713085 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-5278e167-da53-4e0b-b67a-6b5cf70f9c40 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9974484d7a01444184df6535e11c34ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9368c1a74d4c4acc8fdcd2d62c422c4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:04:46.722436 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5278e167-da53-4e0b-b67a-6b5cf70f9c40 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] 10.222.0.33 "GET /compute/v2.1/servers/dd99fc31-2ef1-4998-a149-c2dd0eb96dc8" status: 200 len: 1575 microversion: 2.1 time: 0.229280 Oct 04 22:04:46.722818 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3694/7418] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 22:04:46 2022] GET /compute/v2.1/servers/dd99fc31-2ef1-4998-a149-c2dd0eb96dc8 => generated 1575 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:04:47.750252 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-2ea2179a-1a7c-48d4-93cc-4d88ce5d3d82 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:04:47.751279 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-2ea2179a-1a7c-48d4-93cc-4d88ce5d3d82 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] [instance: dd99fc31-2ef1-4998-a149-c2dd0eb96dc8] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:04:47.759940 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2ea2179a-1a7c-48d4-93cc-4d88ce5d3d82 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:47.760650 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2ea2179a-1a7c-48d4-93cc-4d88ce5d3d82 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:47.761301 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2ea2179a-1a7c-48d4-93cc-4d88ce5d3d82 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:47.762196 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2ea2179a-1a7c-48d4-93cc-4d88ce5d3d82 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:47.762896 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2ea2179a-1a7c-48d4-93cc-4d88ce5d3d82 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:47.763493 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-2ea2179a-1a7c-48d4-93cc-4d88ce5d3d82 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:47.971622 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-2ea2179a-1a7c-48d4-93cc-4d88ce5d3d82 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9974484d7a01444184df6535e11c34ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9368c1a74d4c4acc8fdcd2d62c422c4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:04:47.988245 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-2ea2179a-1a7c-48d4-93cc-4d88ce5d3d82 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] 10.222.0.33 "GET /compute/v2.1/servers/dd99fc31-2ef1-4998-a149-c2dd0eb96dc8" status: 200 len: 1575 microversion: 2.1 time: 0.243502 Oct 04 22:04:47.989331 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3725/7419] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 22:04:47 2022] GET /compute/v2.1/servers/dd99fc31-2ef1-4998-a149-c2dd0eb96dc8 => generated 1575 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:04:49.022889 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-e31462c3-7052-425f-b6c1-7a523ab53e90 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:04:49.024020 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-e31462c3-7052-425f-b6c1-7a523ab53e90 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] [instance: dd99fc31-2ef1-4998-a149-c2dd0eb96dc8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:04:49.037300 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e31462c3-7052-425f-b6c1-7a523ab53e90 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:49.038195 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e31462c3-7052-425f-b6c1-7a523ab53e90 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:49.039094 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e31462c3-7052-425f-b6c1-7a523ab53e90 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:49.040372 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e31462c3-7052-425f-b6c1-7a523ab53e90 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:04:49.041226 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e31462c3-7052-425f-b6c1-7a523ab53e90 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:04:49.042032 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-e31462c3-7052-425f-b6c1-7a523ab53e90 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:04:49.232562 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-e31462c3-7052-425f-b6c1-7a523ab53e90 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9974484d7a01444184df6535e11c34ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9368c1a74d4c4acc8fdcd2d62c422c4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:04:49.241995 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-e31462c3-7052-425f-b6c1-7a523ab53e90 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] 10.222.0.33 "GET /compute/v2.1/servers/dd99fc31-2ef1-4998-a149-c2dd0eb96dc8" status: 200 len: 1562 microversion: 2.1 time: 0.226639 Oct 04 22:04:49.242807 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3695/7420] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 22:04:49 2022] GET /compute/v2.1/servers/dd99fc31-2ef1-4998-a149-c2dd0eb96dc8 => generated 1562 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:06:04.194679 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_api:SELECT=9 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:06:04.196390 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=25 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:06:04.201064 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=9 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:06:04.202173 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=29 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:06:04.203618 n-d-854823-8 devstack@n-api.service[128801]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 22:06:04.203783 n-d-854823-8 devstack@n-api.service[128801]: Tue Oct 4 22:06:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.33) !!! Oct 04 22:06:04.211589 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-639dbdd7-1ed8-4efe-b3e8-94724e8eac68 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:06:04.212540 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-639dbdd7-1ed8-4efe-b3e8-94724e8eac68 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] [instance: dd99fc31-2ef1-4998-a149-c2dd0eb96dc8] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:06:04.223380 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-639dbdd7-1ed8-4efe-b3e8-94724e8eac68 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:04.225138 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-639dbdd7-1ed8-4efe-b3e8-94724e8eac68 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:04.225680 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-639dbdd7-1ed8-4efe-b3e8-94724e8eac68 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:04.228766 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-639dbdd7-1ed8-4efe-b3e8-94724e8eac68 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:04.229454 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-639dbdd7-1ed8-4efe-b3e8-94724e8eac68 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:04.230065 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-639dbdd7-1ed8-4efe-b3e8-94724e8eac68 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:04.265148 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-639dbdd7-1ed8-4efe-b3e8-94724e8eac68 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] [instance: dd99fc31-2ef1-4998-a149-c2dd0eb96dc8] Going to try to terminate instance {{(pid=128802) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 22:06:04.295071 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-97665d5e-7a73-434e-8a14-e00c4786b043 req-04f62890-b7a0-434f-9ef7-a3c33973370e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd99fc31-2ef1-4998-a149-c2dd0eb96dc8", "tag": "f0ab4cec-378f-4579-af92-46545a2b3c57"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:06:04.306392 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-97665d5e-7a73-434e-8a14-e00c4786b043 req-04f62890-b7a0-434f-9ef7-a3c33973370e service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:04.306898 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-97665d5e-7a73-434e-8a14-e00c4786b043 req-04f62890-b7a0-434f-9ef7-a3c33973370e service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:04.307343 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-97665d5e-7a73-434e-8a14-e00c4786b043 req-04f62890-b7a0-434f-9ef7-a3c33973370e service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:04.321835 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-97665d5e-7a73-434e-8a14-e00c4786b043 req-04f62890-b7a0-434f-9ef7-a3c33973370e service nova] Creating event network-changed:f0ab4cec-378f-4579-af92-46545a2b3c57 for instance dd99fc31-2ef1-4998-a149-c2dd0eb96dc8 on n-h2-854823-8 Oct 04 22:06:04.327752 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-97665d5e-7a73-434e-8a14-e00c4786b043 req-04f62890-b7a0-434f-9ef7-a3c33973370e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.129009 Oct 04 22:06:04.328386 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3696/7421] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 22:06:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:06:04.380630 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-639dbdd7-1ed8-4efe-b3e8-94724e8eac68 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] 10.222.0.33 "DELETE /compute/v2.1/servers/dd99fc31-2ef1-4998-a149-c2dd0eb96dc8" status: 204 len: 0 microversion: 2.1 time: 0.188351 Oct 04 22:06:04.382236 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3726/7422] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 22:06:04 2022] DELETE /compute/v2.1/servers/dd99fc31-2ef1-4998-a149-c2dd0eb96dc8 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 22:06:04.395923 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-37f4b18e-fa46-4c4a-83d8-0c9d656aa1c5 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:06:04.397948 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-37f4b18e-fa46-4c4a-83d8-0c9d656aa1c5 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] [instance: dd99fc31-2ef1-4998-a149-c2dd0eb96dc8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:06:04.407435 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-37f4b18e-fa46-4c4a-83d8-0c9d656aa1c5 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:04.408176 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-37f4b18e-fa46-4c4a-83d8-0c9d656aa1c5 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:04.408762 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-37f4b18e-fa46-4c4a-83d8-0c9d656aa1c5 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:04.409859 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-37f4b18e-fa46-4c4a-83d8-0c9d656aa1c5 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:04.410823 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-37f4b18e-fa46-4c4a-83d8-0c9d656aa1c5 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:04.411504 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-37f4b18e-fa46-4c4a-83d8-0c9d656aa1c5 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:04.627584 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-37f4b18e-fa46-4c4a-83d8-0c9d656aa1c5 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9974484d7a01444184df6535e11c34ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9368c1a74d4c4acc8fdcd2d62c422c4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:06:04.638551 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-37f4b18e-fa46-4c4a-83d8-0c9d656aa1c5 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] 10.222.0.33 "GET /compute/v2.1/servers/dd99fc31-2ef1-4998-a149-c2dd0eb96dc8" status: 200 len: 1568 microversion: 2.1 time: 0.250494 Oct 04 22:06:04.639345 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3697/7423] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 22:06:04 2022] GET /compute/v2.1/servers/dd99fc31-2ef1-4998-a149-c2dd0eb96dc8 => generated 1568 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:06:05.669463 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-dd3849dc-5c78-4151-9e57-9325e5f15eee tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:06:05.670256 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-dd3849dc-5c78-4151-9e57-9325e5f15eee tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] [instance: dd99fc31-2ef1-4998-a149-c2dd0eb96dc8] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:06:05.678101 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dd3849dc-5c78-4151-9e57-9325e5f15eee tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:05.678630 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dd3849dc-5c78-4151-9e57-9325e5f15eee tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:05.679075 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dd3849dc-5c78-4151-9e57-9325e5f15eee tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:05.680553 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dd3849dc-5c78-4151-9e57-9325e5f15eee tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:05.681105 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dd3849dc-5c78-4151-9e57-9325e5f15eee tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:05.681547 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-dd3849dc-5c78-4151-9e57-9325e5f15eee tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:05.891821 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-dd3849dc-5c78-4151-9e57-9325e5f15eee tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9974484d7a01444184df6535e11c34ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9368c1a74d4c4acc8fdcd2d62c422c4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:06:05.902984 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-dd3849dc-5c78-4151-9e57-9325e5f15eee tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] 10.222.0.33 "GET /compute/v2.1/servers/dd99fc31-2ef1-4998-a149-c2dd0eb96dc8" status: 200 len: 1568 microversion: 2.1 time: 0.239099 Oct 04 22:06:05.903721 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3727/7424] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 22:06:05 2022] GET /compute/v2.1/servers/dd99fc31-2ef1-4998-a149-c2dd0eb96dc8 => generated 1568 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:06:06.640544 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-e85e3d1f-620d-4527-9f9d-9ae599bdd106 req-c43e9e4e-ced1-49c0-8459-d703fc1ab653 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd99fc31-2ef1-4998-a149-c2dd0eb96dc8", "name": "network-vif-deleted", "tag": "f0ab4cec-378f-4579-af92-46545a2b3c57"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:06:06.660728 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-e85e3d1f-620d-4527-9f9d-9ae599bdd106 req-c43e9e4e-ced1-49c0-8459-d703fc1ab653 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:06.661446 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-e85e3d1f-620d-4527-9f9d-9ae599bdd106 req-c43e9e4e-ced1-49c0-8459-d703fc1ab653 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:06.662215 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-e85e3d1f-620d-4527-9f9d-9ae599bdd106 req-c43e9e4e-ced1-49c0-8459-d703fc1ab653 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:06.684477 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-e85e3d1f-620d-4527-9f9d-9ae599bdd106 req-c43e9e4e-ced1-49c0-8459-d703fc1ab653 service nova] Creating event network-vif-deleted:f0ab4cec-378f-4579-af92-46545a2b3c57 for instance dd99fc31-2ef1-4998-a149-c2dd0eb96dc8 on n-h2-854823-8 Oct 04 22:06:06.692805 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-e85e3d1f-620d-4527-9f9d-9ae599bdd106 req-c43e9e4e-ced1-49c0-8459-d703fc1ab653 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060032 Oct 04 22:06:06.693449 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3698/7425] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 22:06:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:06:06.928982 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-22321152-eaf4-4718-ab26-cbbc13f0476f tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:06:06.930937 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-22321152-eaf4-4718-ab26-cbbc13f0476f tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] [instance: dd99fc31-2ef1-4998-a149-c2dd0eb96dc8] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:06:06.940659 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-22321152-eaf4-4718-ab26-cbbc13f0476f tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:06.941940 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-22321152-eaf4-4718-ab26-cbbc13f0476f tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:06.942779 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-22321152-eaf4-4718-ab26-cbbc13f0476f tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:06.944087 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-22321152-eaf4-4718-ab26-cbbc13f0476f tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:06.945589 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-22321152-eaf4-4718-ab26-cbbc13f0476f tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:06.946433 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-22321152-eaf4-4718-ab26-cbbc13f0476f tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:07.039223 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-22321152-eaf4-4718-ab26-cbbc13f0476f tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9974484d7a01444184df6535e11c34ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9368c1a74d4c4acc8fdcd2d62c422c4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:06:07.049437 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-22321152-eaf4-4718-ab26-cbbc13f0476f tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] 10.222.0.33 "GET /compute/v2.1/servers/dd99fc31-2ef1-4998-a149-c2dd0eb96dc8" status: 200 len: 1218 microversion: 2.1 time: 0.124434 Oct 04 22:06:07.050256 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3728/7426] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 22:06:06 2022] GET /compute/v2.1/servers/dd99fc31-2ef1-4998-a149-c2dd0eb96dc8 => generated 1218 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:06:08.082671 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-d0ce4492-8ef0-4780-b13f-9458605eb946 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:06:08.083993 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-d0ce4492-8ef0-4780-b13f-9458605eb946 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] [instance: dd99fc31-2ef1-4998-a149-c2dd0eb96dc8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:06:08.097539 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d0ce4492-8ef0-4780-b13f-9458605eb946 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:08.098206 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d0ce4492-8ef0-4780-b13f-9458605eb946 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:08.099037 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d0ce4492-8ef0-4780-b13f-9458605eb946 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:08.100433 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d0ce4492-8ef0-4780-b13f-9458605eb946 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:08.102583 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d0ce4492-8ef0-4780-b13f-9458605eb946 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:08.103442 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-d0ce4492-8ef0-4780-b13f-9458605eb946 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:08.206192 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-d0ce4492-8ef0-4780-b13f-9458605eb946 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9974484d7a01444184df6535e11c34ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9368c1a74d4c4acc8fdcd2d62c422c4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:06:08.223540 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-d0ce4492-8ef0-4780-b13f-9458605eb946 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] 10.222.0.33 "GET /compute/v2.1/servers/dd99fc31-2ef1-4998-a149-c2dd0eb96dc8" status: 200 len: 1218 microversion: 2.1 time: 0.150081 Oct 04 22:06:08.224900 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3699/7427] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 22:06:08 2022] GET /compute/v2.1/servers/dd99fc31-2ef1-4998-a149-c2dd0eb96dc8 => generated 1218 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:06:09.252691 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-4237133b-b6f9-4f25-b50a-19fb95918b80 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:06:09.253564 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-4237133b-b6f9-4f25-b50a-19fb95918b80 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] [instance: dd99fc31-2ef1-4998-a149-c2dd0eb96dc8] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:06:09.263275 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4237133b-b6f9-4f25-b50a-19fb95918b80 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:09.263970 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4237133b-b6f9-4f25-b50a-19fb95918b80 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:09.264492 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4237133b-b6f9-4f25-b50a-19fb95918b80 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:09.265436 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4237133b-b6f9-4f25-b50a-19fb95918b80 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:09.266030 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4237133b-b6f9-4f25-b50a-19fb95918b80 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:09.266751 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4237133b-b6f9-4f25-b50a-19fb95918b80 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:09.362234 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-4237133b-b6f9-4f25-b50a-19fb95918b80 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9974484d7a01444184df6535e11c34ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9368c1a74d4c4acc8fdcd2d62c422c4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:06:09.372383 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-4237133b-b6f9-4f25-b50a-19fb95918b80 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] 10.222.0.33 "GET /compute/v2.1/servers/dd99fc31-2ef1-4998-a149-c2dd0eb96dc8" status: 200 len: 1218 microversion: 2.1 time: 0.123948 Oct 04 22:06:09.373027 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3729/7428] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 22:06:09 2022] GET /compute/v2.1/servers/dd99fc31-2ef1-4998-a149-c2dd0eb96dc8 => generated 1218 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:06:10.397791 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-453fe14d-1c13-4edd-809f-ca09aca3d757 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:06:10.399460 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-453fe14d-1c13-4edd-809f-ca09aca3d757 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] [instance: dd99fc31-2ef1-4998-a149-c2dd0eb96dc8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:06:10.406281 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-453fe14d-1c13-4edd-809f-ca09aca3d757 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:10.406894 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-453fe14d-1c13-4edd-809f-ca09aca3d757 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:10.407347 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-453fe14d-1c13-4edd-809f-ca09aca3d757 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:10.408165 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-453fe14d-1c13-4edd-809f-ca09aca3d757 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:10.408961 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-453fe14d-1c13-4edd-809f-ca09aca3d757 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:10.409770 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-453fe14d-1c13-4edd-809f-ca09aca3d757 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:10.497005 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-453fe14d-1c13-4edd-809f-ca09aca3d757 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9974484d7a01444184df6535e11c34ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9368c1a74d4c4acc8fdcd2d62c422c4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:06:10.510513 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-453fe14d-1c13-4edd-809f-ca09aca3d757 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] 10.222.0.33 "GET /compute/v2.1/servers/dd99fc31-2ef1-4998-a149-c2dd0eb96dc8" status: 200 len: 1218 microversion: 2.1 time: 0.116841 Oct 04 22:06:10.511587 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3700/7429] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 22:06:10 2022] GET /compute/v2.1/servers/dd99fc31-2ef1-4998-a149-c2dd0eb96dc8 => generated 1218 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:06:11.546374 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-a5cb8763-2777-497d-b230-4ef11ac78629 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:06:11.547035 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-a5cb8763-2777-497d-b230-4ef11ac78629 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] [instance: dd99fc31-2ef1-4998-a149-c2dd0eb96dc8] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:06:11.555591 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a5cb8763-2777-497d-b230-4ef11ac78629 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:11.556160 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a5cb8763-2777-497d-b230-4ef11ac78629 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:11.556617 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a5cb8763-2777-497d-b230-4ef11ac78629 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:11.557366 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a5cb8763-2777-497d-b230-4ef11ac78629 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:11.557849 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a5cb8763-2777-497d-b230-4ef11ac78629 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:11.562198 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a5cb8763-2777-497d-b230-4ef11ac78629 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:11.593516 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a5cb8763-2777-497d-b230-4ef11ac78629 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:11.594021 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a5cb8763-2777-497d-b230-4ef11ac78629 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:11.594511 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-a5cb8763-2777-497d-b230-4ef11ac78629 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:11.594976 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.objects.instance [None req-a5cb8763-2777-497d-b230-4ef11ac78629 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lazy-loading 'fault' on Instance uuid dd99fc31-2ef1-4998-a149-c2dd0eb96dc8 {{(pid=128802) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 22:06:11.645684 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-a5cb8763-2777-497d-b230-4ef11ac78629 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9974484d7a01444184df6535e11c34ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9368c1a74d4c4acc8fdcd2d62c422c4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:06:11.656355 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-a5cb8763-2777-497d-b230-4ef11ac78629 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] 10.222.0.33 "GET /compute/v2.1/servers/dd99fc31-2ef1-4998-a149-c2dd0eb96dc8" status: 200 len: 1223 microversion: 2.1 time: 0.114114 Oct 04 22:06:11.657059 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3730/7430] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 22:06:11 2022] GET /compute/v2.1/servers/dd99fc31-2ef1-4998-a149-c2dd0eb96dc8 => generated 1223 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:06:12.682421 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0fa5e17e-e6ff-404e-8b70-3ec45f26b081 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:06:12.683466 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-0fa5e17e-e6ff-404e-8b70-3ec45f26b081 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] [instance: dd99fc31-2ef1-4998-a149-c2dd0eb96dc8] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:06:12.697533 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0fa5e17e-e6ff-404e-8b70-3ec45f26b081 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:12.698599 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0fa5e17e-e6ff-404e-8b70-3ec45f26b081 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:12.699856 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0fa5e17e-e6ff-404e-8b70-3ec45f26b081 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:12.701257 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0fa5e17e-e6ff-404e-8b70-3ec45f26b081 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:12.701933 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0fa5e17e-e6ff-404e-8b70-3ec45f26b081 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:12.704059 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-0fa5e17e-e6ff-404e-8b70-3ec45f26b081 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:12.722385 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.wsgi [None req-0fa5e17e-e6ff-404e-8b70-3ec45f26b081 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] HTTP exception thrown: Instance dd99fc31-2ef1-4998-a149-c2dd0eb96dc8 could not be found. Oct 04 22:06:12.724227 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0fa5e17e-e6ff-404e-8b70-3ec45f26b081 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Request method failure captured: Oct 04 22:06:12.724227 n-d-854823-8 devstack@n-api.service[128801]: request: GET /compute/v2.1/servers/dd99fc31-2ef1-4998-a149-c2dd0eb96dc8 HTTP/1.1 Oct 04 22:06:12.724227 n-d-854823-8 devstack@n-api.service[128801]: Accept: application/json Oct 04 22:06:12.724227 n-d-854823-8 devstack@n-api.service[128801]: Accept-Encoding: identity Oct 04 22:06:12.724227 n-d-854823-8 devstack@n-api.service[128801]: Connection: close Oct 04 22:06:12.724227 n-d-854823-8 devstack@n-api.service[128801]: Content-Length: 0 Oct 04 22:06:12.724227 n-d-854823-8 devstack@n-api.service[128801]: Content-Type: application/json Oct 04 22:06:12.724227 n-d-854823-8 devstack@n-api.service[128801]: Host: 10.222.0.33 Oct 04 22:06:12.724227 n-d-854823-8 devstack@n-api.service[128801]: Openstack-System-Scope: None Oct 04 22:06:12.724227 n-d-854823-8 devstack@n-api.service[128801]: User-Agent: python-urllib3/1.26.12 Oct 04 22:06:12.724227 n-d-854823-8 devstack@n-api.service[128801]: X-Auth-Token: gAAAAABjPKwwLDyLmgv1EXrdoQxit3piS2b25wrCmZR0zkieSJCEG4YdegAU9CShZX8kNNAiRhfXLaFlFR_Flm3sYw-L45pmLFGNoO-Kuhos09_K1_Iw94FFp0rnB_2VHdCAlFaSLLlj6unrVCQNSriHe_aR8jQujLOxTaAOyIvZCvddfRrkLgY Oct 04 22:06:12.724227 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Id: None Oct 04 22:06:12.724227 n-d-854823-8 devstack@n-api.service[128801]: X-Domain-Name: None Oct 04 22:06:12.724227 n-d-854823-8 devstack@n-api.service[128801]: X-Identity-Status: Confirmed Oct 04 22:06:12.724227 n-d-854823-8 devstack@n-api.service[128801]: X-Is-Admin-Project: True Oct 04 22:06:12.724227 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Id: default Oct 04 22:06:12.724227 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Domain-Name: Default Oct 04 22:06:12.724227 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Id: 9368c1a74d4c4acc8fdcd2d62c422c4c Oct 04 22:06:12.724227 n-d-854823-8 devstack@n-api.service[128801]: X-Project-Name: tempest-TestShelveInstance-707385966 Oct 04 22:06:12.724227 n-d-854823-8 devstack@n-api.service[128801]: X-Role: reader,member Oct 04 22:06:12.724227 n-d-854823-8 devstack@n-api.service[128801]: X-Roles: reader,member Oct 04 22:06:12.724227 n-d-854823-8 devstack@n-api.service[128801]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_9368c1a74d4c4acc8fdcd2d62c422c4c", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9368c1a74d4c4acc8fdcd2d62c422c4c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9368c1a74d4c4acc8fdcd2d62c422c4c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/9368c1a74d4c4acc8fdcd2d62c422c4c"}]}] Oct 04 22:06:12.724227 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant: tempest-TestShelveInstance-707385966 Oct 04 22:06:12.724227 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Id: 9368c1a74d4c4acc8fdcd2d62c422c4c Oct 04 22:06:12.724227 n-d-854823-8 devstack@n-api.service[128801]: X-Tenant-Name: tempest-TestShelveInstance-707385966 Oct 04 22:06:12.724227 n-d-854823-8 devstack@n-api.service[128801]: X-User: tempest-TestShelveInstance-707385966-project Oct 04 22:06:12.724227 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Id: default Oct 04 22:06:12.724227 n-d-854823-8 devstack@n-api.service[128801]: X-User-Domain-Name: Default Oct 04 22:06:12.724227 n-d-854823-8 devstack@n-api.service[128801]: X-User-Id: 9974484d7a01444184df6535e11c34ab Oct 04 22:06:12.724227 n-d-854823-8 devstack@n-api.service[128801]: X-User-Name: tempest-TestShelveInstance-707385966-project Oct 04 22:06:12.724227 n-d-854823-8 devstack@n-api.service[128801]: method: > Oct 04 22:06:12.724227 n-d-854823-8 devstack@n-api.service[128801]: exception: Instance dd99fc31-2ef1-4998-a149-c2dd0eb96dc8 could not be found. Oct 04 22:06:12.724227 n-d-854823-8 devstack@n-api.service[128801]: action_args: {'id': 'dd99fc31-2ef1-4998-a149-c2dd0eb96dc8'} Oct 04 22:06:12.724227 n-d-854823-8 devstack@n-api.service[128801]: {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:06:12.724227 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:06:12.724227 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:06:12.724227 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:06:12.724227 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:06:12.724227 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:06:12.724227 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:06:12.724227 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:06:12.724227 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:06:12.724227 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:06:12.724227 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd99fc31-2ef1-4998-a149-c2dd0eb96dc8 could not be found. Oct 04 22:06:12.724227 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 22:06:12.724227 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:06:12.724227 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 22:06:12.724227 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:06:12.724227 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:06:12.724227 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:06:12.724227 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:06:12.724227 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:06:12.724227 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:06:12.724227 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:06:12.724227 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:06:12.724227 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:06:12.724227 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:06:12.724227 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:06:12.724227 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:06:12.724227 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:06:12.724227 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd99fc31-2ef1-4998-a149-c2dd0eb96dc8 could not be found. Oct 04 22:06:12.724227 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 22:06:12.724227 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:06:12.724227 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 22:06:12.734460 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:06:12.734460 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:06:12.734460 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:06:12.734460 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:06:12.734460 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:06:12.734460 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd99fc31-2ef1-4998-a149-c2dd0eb96dc8 could not be found. Oct 04 22:06:12.734460 n-d-854823-8 devstack@n-api.service[128801]: ERROR nova.api.openstack.wsgi Oct 04 22:06:12.734460 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-0fa5e17e-e6ff-404e-8b70-3ec45f26b081 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Returning 404 to user: Instance dd99fc31-2ef1-4998-a149-c2dd0eb96dc8 could not be found. {{(pid=128801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:06:12.734460 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-0fa5e17e-e6ff-404e-8b70-3ec45f26b081 tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] 10.222.0.33 "GET /compute/v2.1/servers/dd99fc31-2ef1-4998-a149-c2dd0eb96dc8" status: 404 len: 111 microversion: 2.1 time: 0.049355 Oct 04 22:06:12.742059 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3701/7431] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 22:06:12 2022] GET /compute/v2.1/servers/dd99fc31-2ef1-4998-a149-c2dd0eb96dc8 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:06:13.009316 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-9b21ee5a-52a4-493a-aee8-4e33aeb0fc1d tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] Calling method '.version_select at 0x7f3c740efe50>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:06:13.047683 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-9b21ee5a-52a4-493a-aee8-4e33aeb0fc1d tempest-TestShelveInstance-707385966 tempest-TestShelveInstance-707385966-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-855303231" status: 202 len: 0 microversion: 2.1 time: 0.043641 Oct 04 22:06:13.048400 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3731/7432] 10.222.0.33 () {58 vars in 1251 bytes} [Tue Oct 4 22:06:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-855303231 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 22:06:37.197929 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=12 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:06:37.204031 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=24 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:06:37.516926 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-12cf5486-3b05-4a16-a871-d4feb861bb63 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Action: 'create', calling method: .version_select at 0x7f3c6eef2ca0>, body: {"keypair": {"name": "tempest-TestSnapshotPattern-856079975", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPjWiUpcqRrQRFsou8+ECf+dvEUgICsEweR+0eubwhaFQVMJXtKyFz+vkmwJwqNKV2aW/O0STSGf1H+8EgsK6cHpWdGAYBEAUZWsOrkxbj424wZOfqGpw+7YiFlSC1rsKA=="}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:06:37.543888 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-12cf5486-3b05-4a16-a871-d4feb861bb63 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Getting quotas for project 3907a615604f48f0be694a967ccceba7. Resources: {'key_pairs'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:06:37.553771 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-12cf5486-3b05-4a16-a871-d4feb861bb63 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Getting quotas for user 939c48dab59a463f86398ad27837be30 and project 3907a615604f48f0be694a967ccceba7. Resources: {'key_pairs'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:06:37.598491 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-12cf5486-3b05-4a16-a871-d4feb861bb63 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.417939 Oct 04 22:06:37.599180 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3702/7433] 10.222.0.33 () {60 vars in 1159 bytes} [Tue Oct 4 22:06:37 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:06:39.476040 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:06:39.477159 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:06:39.484330 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-594aba10-2ff2-406f-9db2-25ee5316a612 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-529390745", "imageRef": "15b24725-0c99-4bcf-b1fb-907cdf8e2d63", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-856079975", "security_groups": [{"name": "tempest-secgroup-smoke-817171295"}], "networks": [{"uuid": "a9f8760d-6c42-4152-8c51-267d63d614e7"}]}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:06:39.655888 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.network.neutron [None req-594aba10-2ff2-406f-9db2-25ee5316a612 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] validate_networks() for [('a9f8760d-6c42-4152-8c51-267d63d614e7', None, None, None, None, None)] {{(pid=128802) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 22:06:40.343581 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-594aba10-2ff2-406f-9db2-25ee5316a612 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Flavor limits 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 22:06:40.344409 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-594aba10-2ff2-406f-9db2-25ee5316a612 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Image limits 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 22:06:40.345309 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-594aba10-2ff2-406f-9db2-25ee5316a612 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Flavor pref 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 22:06:40.346034 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-594aba10-2ff2-406f-9db2-25ee5316a612 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Image pref 0:0:0 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 22:06:40.346986 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.virt.hardware [None req-594aba10-2ff2-406f-9db2-25ee5316a612 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128802) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 22:06:40.364402 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-594aba10-2ff2-406f-9db2-25ee5316a612 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:40.365237 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-594aba10-2ff2-406f-9db2-25ee5316a612 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:40.367347 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-594aba10-2ff2-406f-9db2-25ee5316a612 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:40.368816 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-594aba10-2ff2-406f-9db2-25ee5316a612 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:40.369692 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-594aba10-2ff2-406f-9db2-25ee5316a612 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:40.370528 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-594aba10-2ff2-406f-9db2-25ee5316a612 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:40.408397 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-594aba10-2ff2-406f-9db2-25ee5316a612 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Getting quotas for project 3907a615604f48f0be694a967ccceba7. Resources: {'ram', 'instances', 'cores'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:06:40.421389 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.quota [None req-594aba10-2ff2-406f-9db2-25ee5316a612 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Getting quotas for user 939c48dab59a463f86398ad27837be30 and project 3907a615604f48f0be694a967ccceba7. Resources: {'ram', 'instances', 'cores'} {{(pid=128802) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:06:40.448574 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-594aba10-2ff2-406f-9db2-25ee5316a612 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Going to run 1 instances... {{(pid=128802) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 22:06:40.453167 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-594aba10-2ff2-406f-9db2-25ee5316a612 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] [instance: 7b876156-2816-4a9e-b56a-3d750552a21c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='15b24725-0c99-4bcf-b1fb-907cdf8e2d63',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128802) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 22:06:40.549407 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-594aba10-2ff2-406f-9db2-25ee5316a612 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.075900 Oct 04 22:06:40.550701 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3732/7434] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 22:06:39 2022] POST /compute/v2.1/servers => generated 405 bytes in 1079 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 22:06:40.569598 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-2f5ffa14-d883-41dc-8532-1e6734c490c6 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:06:40.570901 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-2f5ffa14-d883-41dc-8532-1e6734c490c6 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] [instance: 7b876156-2816-4a9e-b56a-3d750552a21c] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:06:40.659626 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-2f5ffa14-d883-41dc-8532-1e6734c490c6 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '939c48dab59a463f86398ad27837be30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3907a615604f48f0be694a967ccceba7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:06:40.669572 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-2f5ffa14-d883-41dc-8532-1e6734c490c6 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] 10.222.0.33 "GET /compute/v2.1/servers/7b876156-2816-4a9e-b56a-3d750552a21c" status: 200 len: 1247 microversion: 2.1 time: 0.109989 Oct 04 22:06:40.670402 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3703/7435] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 22:06:40 2022] GET /compute/v2.1/servers/7b876156-2816-4a9e-b56a-3d750552a21c => generated 1247 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:06:41.707298 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-1bf516fa-bfe5-46c2-8043-e09e905aa3eb tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:06:41.708468 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-1bf516fa-bfe5-46c2-8043-e09e905aa3eb tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] [instance: 7b876156-2816-4a9e-b56a-3d750552a21c] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:06:41.854145 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-1bf516fa-bfe5-46c2-8043-e09e905aa3eb tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '939c48dab59a463f86398ad27837be30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3907a615604f48f0be694a967ccceba7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:06:41.868039 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-1bf516fa-bfe5-46c2-8043-e09e905aa3eb tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] 10.222.0.33 "GET /compute/v2.1/servers/7b876156-2816-4a9e-b56a-3d750552a21c" status: 200 len: 1247 microversion: 2.1 time: 0.170300 Oct 04 22:06:41.869076 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3733/7436] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 22:06:41 2022] GET /compute/v2.1/servers/7b876156-2816-4a9e-b56a-3d750552a21c => generated 1247 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:06:42.894012 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-146218b8-aa59-4a75-b299-c1fa544101a8 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:06:42.894956 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-146218b8-aa59-4a75-b299-c1fa544101a8 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] [instance: 7b876156-2816-4a9e-b56a-3d750552a21c] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:06:42.981577 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-146218b8-aa59-4a75-b299-c1fa544101a8 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '939c48dab59a463f86398ad27837be30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3907a615604f48f0be694a967ccceba7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:06:42.994176 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-146218b8-aa59-4a75-b299-c1fa544101a8 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] 10.222.0.33 "GET /compute/v2.1/servers/7b876156-2816-4a9e-b56a-3d750552a21c" status: 200 len: 1247 microversion: 2.1 time: 0.104313 Oct 04 22:06:42.995621 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3704/7437] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 22:06:42 2022] GET /compute/v2.1/servers/7b876156-2816-4a9e-b56a-3d750552a21c => generated 1247 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:06:44.032267 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-6411baa0-0914-49ca-a6a4-fcfd61ad9b58 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:06:44.033199 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-6411baa0-0914-49ca-a6a4-fcfd61ad9b58 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] [instance: 7b876156-2816-4a9e-b56a-3d750552a21c] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:06:44.109152 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-6411baa0-0914-49ca-a6a4-fcfd61ad9b58 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '939c48dab59a463f86398ad27837be30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3907a615604f48f0be694a967ccceba7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:06:44.118046 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-6411baa0-0914-49ca-a6a4-fcfd61ad9b58 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] 10.222.0.33 "GET /compute/v2.1/servers/7b876156-2816-4a9e-b56a-3d750552a21c" status: 200 len: 1247 microversion: 2.1 time: 0.089531 Oct 04 22:06:44.119064 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3734/7438] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 22:06:44 2022] GET /compute/v2.1/servers/7b876156-2816-4a9e-b56a-3d750552a21c => generated 1247 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:06:45.144197 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-de5f889f-fea8-4fe4-9dad-4bf87c1e8158 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:06:45.144925 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-de5f889f-fea8-4fe4-9dad-4bf87c1e8158 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] [instance: 7b876156-2816-4a9e-b56a-3d750552a21c] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:06:45.153849 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-de5f889f-fea8-4fe4-9dad-4bf87c1e8158 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:45.154371 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-de5f889f-fea8-4fe4-9dad-4bf87c1e8158 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:45.154804 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-de5f889f-fea8-4fe4-9dad-4bf87c1e8158 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:45.155525 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-de5f889f-fea8-4fe4-9dad-4bf87c1e8158 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:45.155983 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-de5f889f-fea8-4fe4-9dad-4bf87c1e8158 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:45.156408 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-de5f889f-fea8-4fe4-9dad-4bf87c1e8158 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:45.232054 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-de5f889f-fea8-4fe4-9dad-4bf87c1e8158 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '939c48dab59a463f86398ad27837be30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3907a615604f48f0be694a967ccceba7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:06:45.246287 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-de5f889f-fea8-4fe4-9dad-4bf87c1e8158 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] 10.222.0.33 "GET /compute/v2.1/servers/7b876156-2816-4a9e-b56a-3d750552a21c" status: 200 len: 1251 microversion: 2.1 time: 0.105801 Oct 04 22:06:45.247286 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3705/7439] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 22:06:45 2022] GET /compute/v2.1/servers/7b876156-2816-4a9e-b56a-3d750552a21c => generated 1251 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:06:46.272508 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-9d6c2ce1-178b-4441-bbe8-4680000c3a8c tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:06:46.273524 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-9d6c2ce1-178b-4441-bbe8-4680000c3a8c tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] [instance: 7b876156-2816-4a9e-b56a-3d750552a21c] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:06:46.283544 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9d6c2ce1-178b-4441-bbe8-4680000c3a8c tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:46.284230 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9d6c2ce1-178b-4441-bbe8-4680000c3a8c tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:46.284863 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9d6c2ce1-178b-4441-bbe8-4680000c3a8c tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:46.285825 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9d6c2ce1-178b-4441-bbe8-4680000c3a8c tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:46.286599 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9d6c2ce1-178b-4441-bbe8-4680000c3a8c tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:46.287224 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-9d6c2ce1-178b-4441-bbe8-4680000c3a8c tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:46.413371 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-9d6c2ce1-178b-4441-bbe8-4680000c3a8c tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '939c48dab59a463f86398ad27837be30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3907a615604f48f0be694a967ccceba7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:06:46.424862 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-9d6c2ce1-178b-4441-bbe8-4680000c3a8c tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] 10.222.0.33 "GET /compute/v2.1/servers/7b876156-2816-4a9e-b56a-3d750552a21c" status: 200 len: 1305 microversion: 2.1 time: 0.155967 Oct 04 22:06:46.424862 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3735/7440] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 22:06:46 2022] GET /compute/v2.1/servers/7b876156-2816-4a9e-b56a-3d750552a21c => generated 1305 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:06:47.457029 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5ae4037b-6ce2-4911-b57b-e48649dd7faa tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:06:47.459773 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-5ae4037b-6ce2-4911-b57b-e48649dd7faa tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] [instance: 7b876156-2816-4a9e-b56a-3d750552a21c] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:06:47.473082 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5ae4037b-6ce2-4911-b57b-e48649dd7faa tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:47.473886 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5ae4037b-6ce2-4911-b57b-e48649dd7faa tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:47.474710 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5ae4037b-6ce2-4911-b57b-e48649dd7faa tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:47.476810 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5ae4037b-6ce2-4911-b57b-e48649dd7faa tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:47.477457 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5ae4037b-6ce2-4911-b57b-e48649dd7faa tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:47.478253 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5ae4037b-6ce2-4911-b57b-e48649dd7faa tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:47.771654 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-5ae4037b-6ce2-4911-b57b-e48649dd7faa tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '939c48dab59a463f86398ad27837be30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3907a615604f48f0be694a967ccceba7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:06:47.782513 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5ae4037b-6ce2-4911-b57b-e48649dd7faa tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] 10.222.0.33 "GET /compute/v2.1/servers/7b876156-2816-4a9e-b56a-3d750552a21c" status: 200 len: 1372 microversion: 2.1 time: 0.332501 Oct 04 22:06:47.783088 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3706/7441] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 22:06:47 2022] GET /compute/v2.1/servers/7b876156-2816-4a9e-b56a-3d750552a21c => generated 1372 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:06:48.043853 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-0f246a13-97f0-4fb0-badc-bfd981c3a9a1 req-abc7a2b6-acee-4f4b-b9ca-138bb1797b3c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b876156-2816-4a9e-b56a-3d750552a21c", "tag": "7e4a7f5d-cdd0-4b32-9e40-cfee843ae8b6"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:06:48.065308 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-0f246a13-97f0-4fb0-badc-bfd981c3a9a1 req-abc7a2b6-acee-4f4b-b9ca-138bb1797b3c service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:48.065914 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-0f246a13-97f0-4fb0-badc-bfd981c3a9a1 req-abc7a2b6-acee-4f4b-b9ca-138bb1797b3c service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:48.066601 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-0f246a13-97f0-4fb0-badc-bfd981c3a9a1 req-abc7a2b6-acee-4f4b-b9ca-138bb1797b3c service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:48.081099 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-0f246a13-97f0-4fb0-badc-bfd981c3a9a1 req-abc7a2b6-acee-4f4b-b9ca-138bb1797b3c service nova] Creating event network-changed:7e4a7f5d-cdd0-4b32-9e40-cfee843ae8b6 for instance 7b876156-2816-4a9e-b56a-3d750552a21c on n-h1-854823-8 Oct 04 22:06:48.086959 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-0f246a13-97f0-4fb0-badc-bfd981c3a9a1 req-abc7a2b6-acee-4f4b-b9ca-138bb1797b3c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051521 Oct 04 22:06:48.087819 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3736/7442] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 22:06:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:06:48.807690 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8e3d6fb0-241c-421b-849a-40a85dc8180d tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:06:48.808572 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-8e3d6fb0-241c-421b-849a-40a85dc8180d tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] [instance: 7b876156-2816-4a9e-b56a-3d750552a21c] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:06:48.818010 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8e3d6fb0-241c-421b-849a-40a85dc8180d tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:48.818459 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8e3d6fb0-241c-421b-849a-40a85dc8180d tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:48.818945 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8e3d6fb0-241c-421b-849a-40a85dc8180d tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:48.819626 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8e3d6fb0-241c-421b-849a-40a85dc8180d tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:48.820083 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8e3d6fb0-241c-421b-849a-40a85dc8180d tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:48.820511 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8e3d6fb0-241c-421b-849a-40a85dc8180d tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:48.982780 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-8e3d6fb0-241c-421b-849a-40a85dc8180d tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '939c48dab59a463f86398ad27837be30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3907a615604f48f0be694a967ccceba7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:06:48.991333 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-8e3d6fb0-241c-421b-849a-40a85dc8180d tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] 10.222.0.33 "GET /compute/v2.1/servers/7b876156-2816-4a9e-b56a-3d750552a21c" status: 200 len: 1372 microversion: 2.1 time: 0.188012 Oct 04 22:06:48.992271 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3707/7443] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 22:06:48 2022] GET /compute/v2.1/servers/7b876156-2816-4a9e-b56a-3d750552a21c => generated 1372 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:06:50.018269 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-196f634b-3ab7-4847-a73c-b8b94e4fdd99 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:06:50.019552 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-196f634b-3ab7-4847-a73c-b8b94e4fdd99 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] [instance: 7b876156-2816-4a9e-b56a-3d750552a21c] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:06:50.031184 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-196f634b-3ab7-4847-a73c-b8b94e4fdd99 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:50.031777 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-196f634b-3ab7-4847-a73c-b8b94e4fdd99 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:50.032377 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-196f634b-3ab7-4847-a73c-b8b94e4fdd99 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:50.033311 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-196f634b-3ab7-4847-a73c-b8b94e4fdd99 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:50.033869 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-196f634b-3ab7-4847-a73c-b8b94e4fdd99 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:50.034409 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-196f634b-3ab7-4847-a73c-b8b94e4fdd99 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:50.332982 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-196f634b-3ab7-4847-a73c-b8b94e4fdd99 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '939c48dab59a463f86398ad27837be30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3907a615604f48f0be694a967ccceba7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:06:50.342823 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-196f634b-3ab7-4847-a73c-b8b94e4fdd99 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] 10.222.0.33 "GET /compute/v2.1/servers/7b876156-2816-4a9e-b56a-3d750552a21c" status: 200 len: 1372 microversion: 2.1 time: 0.330310 Oct 04 22:06:50.343444 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3737/7444] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 22:06:50 2022] GET /compute/v2.1/servers/7b876156-2816-4a9e-b56a-3d750552a21c => generated 1372 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:06:51.368832 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-efacd56b-224b-416d-8e2a-4c75ec8f29e2 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:06:51.369516 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-efacd56b-224b-416d-8e2a-4c75ec8f29e2 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] [instance: 7b876156-2816-4a9e-b56a-3d750552a21c] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:06:51.377645 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-efacd56b-224b-416d-8e2a-4c75ec8f29e2 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:51.378401 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-efacd56b-224b-416d-8e2a-4c75ec8f29e2 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:51.378906 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-efacd56b-224b-416d-8e2a-4c75ec8f29e2 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:51.379715 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-efacd56b-224b-416d-8e2a-4c75ec8f29e2 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:51.380189 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-efacd56b-224b-416d-8e2a-4c75ec8f29e2 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:51.380626 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-efacd56b-224b-416d-8e2a-4c75ec8f29e2 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:51.546178 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-efacd56b-224b-416d-8e2a-4c75ec8f29e2 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '939c48dab59a463f86398ad27837be30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3907a615604f48f0be694a967ccceba7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:06:51.557398 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-efacd56b-224b-416d-8e2a-4c75ec8f29e2 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] 10.222.0.33 "GET /compute/v2.1/servers/7b876156-2816-4a9e-b56a-3d750552a21c" status: 200 len: 1372 microversion: 2.1 time: 0.193598 Oct 04 22:06:51.558317 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3708/7445] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 22:06:51 2022] GET /compute/v2.1/servers/7b876156-2816-4a9e-b56a-3d750552a21c => generated 1372 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:06:52.584648 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-8b196502-66f7-42be-8505-3f59dc9187a5 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:06:52.585781 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-8b196502-66f7-42be-8505-3f59dc9187a5 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] [instance: 7b876156-2816-4a9e-b56a-3d750552a21c] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:06:52.588242 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell0:SELECT=2 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:06:52.597414 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8b196502-66f7-42be-8505-3f59dc9187a5 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:52.598068 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8b196502-66f7-42be-8505-3f59dc9187a5 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:52.598688 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8b196502-66f7-42be-8505-3f59dc9187a5 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:52.599554 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8b196502-66f7-42be-8505-3f59dc9187a5 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:52.600165 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8b196502-66f7-42be-8505-3f59dc9187a5 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:52.600708 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-8b196502-66f7-42be-8505-3f59dc9187a5 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:52.630697 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-a835ffa5-fbd5-486c-80cb-cbdb92e19cde req-70bb63ec-9053-49df-97f2-6fed0d23f8a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b876156-2816-4a9e-b56a-3d750552a21c", "name": "network-vif-plugged", "status": "completed", "tag": "7e4a7f5d-cdd0-4b32-9e40-cfee843ae8b6"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:06:52.650245 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-a835ffa5-fbd5-486c-80cb-cbdb92e19cde req-70bb63ec-9053-49df-97f2-6fed0d23f8a0 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:52.651010 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-a835ffa5-fbd5-486c-80cb-cbdb92e19cde req-70bb63ec-9053-49df-97f2-6fed0d23f8a0 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:52.651772 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-a835ffa5-fbd5-486c-80cb-cbdb92e19cde req-70bb63ec-9053-49df-97f2-6fed0d23f8a0 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:52.670708 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-a835ffa5-fbd5-486c-80cb-cbdb92e19cde req-70bb63ec-9053-49df-97f2-6fed0d23f8a0 service nova] Creating event network-vif-plugged:7e4a7f5d-cdd0-4b32-9e40-cfee843ae8b6 for instance 7b876156-2816-4a9e-b56a-3d750552a21c on n-h1-854823-8 Oct 04 22:06:52.682953 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-a835ffa5-fbd5-486c-80cb-cbdb92e19cde req-70bb63ec-9053-49df-97f2-6fed0d23f8a0 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061684 Oct 04 22:06:52.684510 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3709/7446] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 22:06:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 22:06:52.879654 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-8b196502-66f7-42be-8505-3f59dc9187a5 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '939c48dab59a463f86398ad27837be30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3907a615604f48f0be694a967ccceba7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:06:52.889881 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-8b196502-66f7-42be-8505-3f59dc9187a5 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] 10.222.0.33 "GET /compute/v2.1/servers/7b876156-2816-4a9e-b56a-3d750552a21c" status: 200 len: 1372 microversion: 2.1 time: 0.310803 Oct 04 22:06:52.890527 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3738/7447] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 22:06:52 2022] GET /compute/v2.1/servers/7b876156-2816-4a9e-b56a-3d750552a21c => generated 1372 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:06:53.913041 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=8 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:06:53.919313 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-8b85f9b4-2abd-48b3-b418-27100fb48dd0 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:06:53.920336 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-8b85f9b4-2abd-48b3-b418-27100fb48dd0 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] [instance: 7b876156-2816-4a9e-b56a-3d750552a21c] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:06:53.928657 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8b85f9b4-2abd-48b3-b418-27100fb48dd0 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:53.929324 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8b85f9b4-2abd-48b3-b418-27100fb48dd0 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:53.930010 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8b85f9b4-2abd-48b3-b418-27100fb48dd0 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:53.930993 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8b85f9b4-2abd-48b3-b418-27100fb48dd0 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:53.931535 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8b85f9b4-2abd-48b3-b418-27100fb48dd0 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:53.932009 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-8b85f9b4-2abd-48b3-b418-27100fb48dd0 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:54.103129 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-8b85f9b4-2abd-48b3-b418-27100fb48dd0 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '939c48dab59a463f86398ad27837be30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3907a615604f48f0be694a967ccceba7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:06:54.113101 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-8b85f9b4-2abd-48b3-b418-27100fb48dd0 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] 10.222.0.33 "GET /compute/v2.1/servers/7b876156-2816-4a9e-b56a-3d750552a21c" status: 200 len: 1372 microversion: 2.1 time: 0.200785 Oct 04 22:06:54.113938 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3710/7448] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 22:06:53 2022] GET /compute/v2.1/servers/7b876156-2816-4a9e-b56a-3d750552a21c => generated 1372 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:06:55.138164 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-11e6e9c6-fcbe-45ca-9738-82361dcc3e4f tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:06:55.138802 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-11e6e9c6-fcbe-45ca-9738-82361dcc3e4f tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] [instance: 7b876156-2816-4a9e-b56a-3d750552a21c] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:06:55.141889 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell0:SELECT=10 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:06:55.148490 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-11e6e9c6-fcbe-45ca-9738-82361dcc3e4f tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:55.149047 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-11e6e9c6-fcbe-45ca-9738-82361dcc3e4f tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:55.149806 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-11e6e9c6-fcbe-45ca-9738-82361dcc3e4f tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:55.150656 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-11e6e9c6-fcbe-45ca-9738-82361dcc3e4f tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:55.151394 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-11e6e9c6-fcbe-45ca-9738-82361dcc3e4f tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:55.152007 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-11e6e9c6-fcbe-45ca-9738-82361dcc3e4f tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:55.325716 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-11e6e9c6-fcbe-45ca-9738-82361dcc3e4f tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '939c48dab59a463f86398ad27837be30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3907a615604f48f0be694a967ccceba7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:06:55.335267 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-11e6e9c6-fcbe-45ca-9738-82361dcc3e4f tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] 10.222.0.33 "GET /compute/v2.1/servers/7b876156-2816-4a9e-b56a-3d750552a21c" status: 200 len: 1556 microversion: 2.1 time: 0.201348 Oct 04 22:06:55.335884 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3739/7449] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 22:06:55 2022] GET /compute/v2.1/servers/7b876156-2816-4a9e-b56a-3d750552a21c => generated 1556 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:06:55.359622 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9b0ea464-a6cd-4c6a-86d8-6b092e591042 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:06:55.360537 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-9b0ea464-a6cd-4c6a-86d8-6b092e591042 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] [instance: 7b876156-2816-4a9e-b56a-3d750552a21c] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:06:55.368867 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9b0ea464-a6cd-4c6a-86d8-6b092e591042 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:55.369343 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9b0ea464-a6cd-4c6a-86d8-6b092e591042 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:55.369780 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9b0ea464-a6cd-4c6a-86d8-6b092e591042 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:55.370540 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9b0ea464-a6cd-4c6a-86d8-6b092e591042 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:55.371003 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9b0ea464-a6cd-4c6a-86d8-6b092e591042 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:55.371429 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9b0ea464-a6cd-4c6a-86d8-6b092e591042 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:55.529599 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-9b0ea464-a6cd-4c6a-86d8-6b092e591042 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '939c48dab59a463f86398ad27837be30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3907a615604f48f0be694a967ccceba7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:06:55.541851 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-9b0ea464-a6cd-4c6a-86d8-6b092e591042 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] 10.222.0.33 "GET /compute/v2.1/servers/7b876156-2816-4a9e-b56a-3d750552a21c" status: 200 len: 1556 microversion: 2.1 time: 0.186178 Oct 04 22:06:55.542906 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3711/7450] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 22:06:55 2022] GET /compute/v2.1/servers/7b876156-2816-4a9e-b56a-3d750552a21c => generated 1556 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:06:57.799607 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-3fcac8e7-2474-40d0-bc41-228aaac9986f req-eb1acdce-95d1-46a1-ad48-eccab6266fc5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b876156-2816-4a9e-b56a-3d750552a21c", "tag": "7e4a7f5d-cdd0-4b32-9e40-cfee843ae8b6"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:06:57.811604 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-3fcac8e7-2474-40d0-bc41-228aaac9986f req-eb1acdce-95d1-46a1-ad48-eccab6266fc5 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:06:57.812125 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-3fcac8e7-2474-40d0-bc41-228aaac9986f req-eb1acdce-95d1-46a1-ad48-eccab6266fc5 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:06:57.812523 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-3fcac8e7-2474-40d0-bc41-228aaac9986f req-eb1acdce-95d1-46a1-ad48-eccab6266fc5 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:06:57.826610 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-3fcac8e7-2474-40d0-bc41-228aaac9986f req-eb1acdce-95d1-46a1-ad48-eccab6266fc5 service nova] Creating event network-changed:7e4a7f5d-cdd0-4b32-9e40-cfee843ae8b6 for instance 7b876156-2816-4a9e-b56a-3d750552a21c on n-h1-854823-8 Oct 04 22:06:57.833624 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-3fcac8e7-2474-40d0-bc41-228aaac9986f req-eb1acdce-95d1-46a1-ad48-eccab6266fc5 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.135381 Oct 04 22:06:57.835114 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3740/7451] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 22:06:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:08:54.617153 n-d-854823-8 devstack@n-api.service[128801]: ERROR oslo.messaging._drivers.impl_rabbit [-] [0dedeb6d-3fde-4c4e-9f8b-01c561e37600] AMQP server on 10.222.0.33:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 04 22:08:54.618209 n-d-854823-8 devstack@n-api.service[128801]: ERROR oslo.messaging._drivers.impl_rabbit [-] [0572b6b5-6fec-4a5a-bfd2-8f7d3f0cb615] AMQP server on 10.222.0.33:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 04 22:08:54.619191 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:08:54.620091 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=38 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:08:54.625530 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-357c262c-f0f4-4ade-becf-193da4772a4f tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-2121107126"}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:08:54.628589 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-357c262c-f0f4-4ade-becf-193da4772a4f tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] [instance: 7b876156-2816-4a9e-b56a-3d750552a21c] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:08:54.636725 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-357c262c-f0f4-4ade-becf-193da4772a4f tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:54.637224 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-357c262c-f0f4-4ade-becf-193da4772a4f tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:54.637665 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-357c262c-f0f4-4ade-becf-193da4772a4f tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:54.638446 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-357c262c-f0f4-4ade-becf-193da4772a4f tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:54.638913 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-357c262c-f0f4-4ade-becf-193da4772a4f tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:54.639341 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-357c262c-f0f4-4ade-becf-193da4772a4f tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:54.885521 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-357c262c-f0f4-4ade-becf-193da4772a4f tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] 10.222.0.33 "POST /compute/v2.1/servers/7b876156-2816-4a9e-b56a-3d750552a21c/action" status: 202 len: 0 microversion: 2.1 time: 0.270079 Oct 04 22:08:54.886226 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3712/7452] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 22:08:54 2022] POST /compute/v2.1/servers/7b876156-2816-4a9e-b56a-3d750552a21c/action => generated 0 bytes in 272 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 04 22:08:59.308703 n-d-854823-8 devstack@n-api.service[128802]: ERROR oslo.messaging._drivers.impl_rabbit [-] [399f3af7-d281-4213-9ef7-61e2871c9a11] AMQP server on 10.222.0.33:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 22:08:59.309545 n-d-854823-8 devstack@n-api.service[128802]: ERROR oslo.messaging._drivers.impl_rabbit [-] [3ed749fe-ba58-4081-afad-8a961afd7471] AMQP server on 10.222.0.33:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 22:08:59.310146 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:08:59.311644 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=30 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:08:59.319659 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-f31dd4a9-cf46-4d5a-a4fd-50ca4cbcfe06 req-1247bf21-03a3-42ea-b951-7b82d5eecad5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b876156-2816-4a9e-b56a-3d750552a21c", "name": "network-vif-plugged", "status": "completed", "tag": "7e4a7f5d-cdd0-4b32-9e40-cfee843ae8b6"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:08:59.337313 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-f31dd4a9-cf46-4d5a-a4fd-50ca4cbcfe06 req-1247bf21-03a3-42ea-b951-7b82d5eecad5 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:08:59.338856 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-f31dd4a9-cf46-4d5a-a4fd-50ca4cbcfe06 req-1247bf21-03a3-42ea-b951-7b82d5eecad5 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:08:59.339685 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-f31dd4a9-cf46-4d5a-a4fd-50ca4cbcfe06 req-1247bf21-03a3-42ea-b951-7b82d5eecad5 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:08:59.357220 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-f31dd4a9-cf46-4d5a-a4fd-50ca4cbcfe06 req-1247bf21-03a3-42ea-b951-7b82d5eecad5 service nova] Creating event network-vif-plugged:7e4a7f5d-cdd0-4b32-9e40-cfee843ae8b6 for instance 7b876156-2816-4a9e-b56a-3d750552a21c on n-h1-854823-8 Oct 04 22:08:59.365556 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-f31dd4a9-cf46-4d5a-a4fd-50ca4cbcfe06 req-1247bf21-03a3-42ea-b951-7b82d5eecad5 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058137 Oct 04 22:08:59.366918 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3741/7453] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 22:08:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 22:09:09.698461 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:09:09.699261 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:09:09.704162 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5b40add8-f2c9-4725-97b9-6a1c9a247b8a tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-568995553", "imageRef": "aeb469f2-2d8a-49f6-908e-8fc01c0b79ae", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-856079975", "security_groups": [{"name": "tempest-secgroup-smoke-817171295"}], "networks": [{"uuid": "a9f8760d-6c42-4152-8c51-267d63d614e7"}]}} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:09:09.733285 n-d-854823-8 devstack@n-api.service[128801]: INFO oslo.messaging._drivers.impl_rabbit [-] [0572b6b5-6fec-4a5a-bfd2-8f7d3f0cb615] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 57466. Oct 04 22:09:09.736840 n-d-854823-8 devstack@n-api.service[128801]: INFO oslo.messaging._drivers.impl_rabbit [-] [0dedeb6d-3fde-4c4e-9f8b-01c561e37600] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 57464. Oct 04 22:09:09.841761 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.network.neutron [None req-5b40add8-f2c9-4725-97b9-6a1c9a247b8a tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] validate_networks() for [('a9f8760d-6c42-4152-8c51-267d63d614e7', None, None, None, None, None)] {{(pid=128801) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 22:09:10.388670 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-5b40add8-f2c9-4725-97b9-6a1c9a247b8a tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Flavor limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 22:09:10.389222 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-5b40add8-f2c9-4725-97b9-6a1c9a247b8a tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Image limits 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 22:09:10.389819 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-5b40add8-f2c9-4725-97b9-6a1c9a247b8a tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Flavor pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 22:09:10.390370 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-5b40add8-f2c9-4725-97b9-6a1c9a247b8a tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Image pref 0:0:0 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 22:09:10.391109 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.virt.hardware [None req-5b40add8-f2c9-4725-97b9-6a1c9a247b8a tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128801) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 22:09:10.402661 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5b40add8-f2c9-4725-97b9-6a1c9a247b8a tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:10.403219 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5b40add8-f2c9-4725-97b9-6a1c9a247b8a tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:10.403750 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5b40add8-f2c9-4725-97b9-6a1c9a247b8a tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:10.404557 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5b40add8-f2c9-4725-97b9-6a1c9a247b8a tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:10.405064 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5b40add8-f2c9-4725-97b9-6a1c9a247b8a tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:10.405538 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5b40add8-f2c9-4725-97b9-6a1c9a247b8a tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:10.430741 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-5b40add8-f2c9-4725-97b9-6a1c9a247b8a tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Getting quotas for project 3907a615604f48f0be694a967ccceba7. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 22:09:10.436783 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.quota [None req-5b40add8-f2c9-4725-97b9-6a1c9a247b8a tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Getting quotas for user 939c48dab59a463f86398ad27837be30 and project 3907a615604f48f0be694a967ccceba7. Resources: {'ram', 'instances', 'cores'} {{(pid=128801) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 22:09:10.452005 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-5b40add8-f2c9-4725-97b9-6a1c9a247b8a tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Going to run 1 instances... {{(pid=128801) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 22:09:10.454689 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-5b40add8-f2c9-4725-97b9-6a1c9a247b8a tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] [instance: 5753d15c-2b51-4910-81ba-73cfb6a7b105] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aeb469f2-2d8a-49f6-908e-8fc01c0b79ae',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128801) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 22:09:10.506695 n-d-854823-8 devstack@n-api.service[128801]: ERROR oslo.messaging._drivers.impl_rabbit [None req-5b40add8-f2c9-4725-97b9-6a1c9a247b8a tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] [a482859a-0bd1-427d-a6a3-20495933cb57] AMQP server on 10.222.0.33:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 22:09:11.516139 n-d-854823-8 devstack@n-api.service[128801]: INFO oslo.messaging._drivers.impl_rabbit [None req-5b40add8-f2c9-4725-97b9-6a1c9a247b8a tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] [a482859a-0bd1-427d-a6a3-20495933cb57] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 57478. Oct 04 22:09:11.522266 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5b40add8-f2c9-4725-97b9-6a1c9a247b8a tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.825748 Oct 04 22:09:11.523373 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3713/7454] 10.222.0.33 () {60 vars in 1147 bytes} [Tue Oct 4 22:09:09 2022] POST /compute/v2.1/servers => generated 405 bytes in 1828 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 22:09:11.545086 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-8f1a9dab-fe5d-45cc-8973-a9200cb962e0 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:09:11.546566 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-8f1a9dab-fe5d-45cc-8973-a9200cb962e0 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] [instance: 5753d15c-2b51-4910-81ba-73cfb6a7b105] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:09:11.553040 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=2 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:09:11.554233 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_api:SELECT=2 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:09:11.601419 n-d-854823-8 devstack@n-api.service[128802]: INFO oslo.messaging._drivers.impl_rabbit [-] [399f3af7-d281-4213-9ef7-61e2871c9a11] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 57482. Oct 04 22:09:11.602632 n-d-854823-8 devstack@n-api.service[128802]: INFO oslo.messaging._drivers.impl_rabbit [-] [3ed749fe-ba58-4081-afad-8a961afd7471] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 57484. Oct 04 22:09:11.647179 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-8f1a9dab-fe5d-45cc-8973-a9200cb962e0 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '939c48dab59a463f86398ad27837be30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3907a615604f48f0be694a967ccceba7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:11.661599 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-8f1a9dab-fe5d-45cc-8973-a9200cb962e0 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] 10.222.0.33 "GET /compute/v2.1/servers/5753d15c-2b51-4910-81ba-73cfb6a7b105" status: 200 len: 1247 microversion: 2.1 time: 0.124584 Oct 04 22:09:11.662623 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3742/7455] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 22:09:11 2022] GET /compute/v2.1/servers/5753d15c-2b51-4910-81ba-73cfb6a7b105 => generated 1247 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:09:12.700940 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-76d39677-b283-45a5-956f-b14dd64abe77 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:09:12.702256 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-76d39677-b283-45a5-956f-b14dd64abe77 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] [instance: 5753d15c-2b51-4910-81ba-73cfb6a7b105] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:09:12.711619 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-76d39677-b283-45a5-956f-b14dd64abe77 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:12.712267 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-76d39677-b283-45a5-956f-b14dd64abe77 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:12.712853 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-76d39677-b283-45a5-956f-b14dd64abe77 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:12.713600 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-76d39677-b283-45a5-956f-b14dd64abe77 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:12.714099 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-76d39677-b283-45a5-956f-b14dd64abe77 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:12.714714 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-76d39677-b283-45a5-956f-b14dd64abe77 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:12.868134 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-76d39677-b283-45a5-956f-b14dd64abe77 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '939c48dab59a463f86398ad27837be30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3907a615604f48f0be694a967ccceba7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:12.881152 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-76d39677-b283-45a5-956f-b14dd64abe77 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] 10.222.0.33 "GET /compute/v2.1/servers/5753d15c-2b51-4910-81ba-73cfb6a7b105" status: 200 len: 1299 microversion: 2.1 time: 0.185232 Oct 04 22:09:12.881980 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3714/7456] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 22:09:12 2022] GET /compute/v2.1/servers/5753d15c-2b51-4910-81ba-73cfb6a7b105 => generated 1299 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:09:13.913400 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-4fc54272-a6f1-4ac1-bede-d69f8edcffb2 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:09:13.914373 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-4fc54272-a6f1-4ac1-bede-d69f8edcffb2 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] [instance: 5753d15c-2b51-4910-81ba-73cfb6a7b105] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:09:13.929452 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4fc54272-a6f1-4ac1-bede-d69f8edcffb2 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:13.930987 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4fc54272-a6f1-4ac1-bede-d69f8edcffb2 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:13.932245 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4fc54272-a6f1-4ac1-bede-d69f8edcffb2 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:13.934329 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4fc54272-a6f1-4ac1-bede-d69f8edcffb2 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:13.935501 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4fc54272-a6f1-4ac1-bede-d69f8edcffb2 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:13.936536 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-4fc54272-a6f1-4ac1-bede-d69f8edcffb2 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:14.823360 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-4fc54272-a6f1-4ac1-bede-d69f8edcffb2 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '939c48dab59a463f86398ad27837be30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3907a615604f48f0be694a967ccceba7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:14.838747 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-4fc54272-a6f1-4ac1-bede-d69f8edcffb2 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] 10.222.0.33 "GET /compute/v2.1/servers/5753d15c-2b51-4910-81ba-73cfb6a7b105" status: 200 len: 1372 microversion: 2.1 time: 0.928801 Oct 04 22:09:14.851860 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3743/7457] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 22:09:13 2022] GET /compute/v2.1/servers/5753d15c-2b51-4910-81ba-73cfb6a7b105 => generated 1372 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:09:15.382484 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-bae0461a-d292-4a87-812f-ed39286e4439 req-2c215761-7d91-41b2-8635-3da156f05bdd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b876156-2816-4a9e-b56a-3d750552a21c", "name": "network-vif-unplugged", "status": "completed", "tag": "7e4a7f5d-cdd0-4b32-9e40-cfee843ae8b6"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:09:15.426299 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-bae0461a-d292-4a87-812f-ed39286e4439 req-2c215761-7d91-41b2-8635-3da156f05bdd service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:15.427701 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-bae0461a-d292-4a87-812f-ed39286e4439 req-2c215761-7d91-41b2-8635-3da156f05bdd service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:15.428524 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-bae0461a-d292-4a87-812f-ed39286e4439 req-2c215761-7d91-41b2-8635-3da156f05bdd service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:15.467522 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-bae0461a-d292-4a87-812f-ed39286e4439 req-2c215761-7d91-41b2-8635-3da156f05bdd service nova] Creating event network-vif-unplugged:7e4a7f5d-cdd0-4b32-9e40-cfee843ae8b6 for instance 7b876156-2816-4a9e-b56a-3d750552a21c on n-h1-854823-8 Oct 04 22:09:15.481509 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-bae0461a-d292-4a87-812f-ed39286e4439 req-2c215761-7d91-41b2-8635-3da156f05bdd service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.111150 Oct 04 22:09:15.483957 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3715/7458] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 22:09:15 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:09:15.874171 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-3e68ab05-e82a-4ebe-8711-84932a2c5ee1 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:09:15.875445 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-3e68ab05-e82a-4ebe-8711-84932a2c5ee1 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] [instance: 5753d15c-2b51-4910-81ba-73cfb6a7b105] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:09:15.888778 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3e68ab05-e82a-4ebe-8711-84932a2c5ee1 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:15.890113 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3e68ab05-e82a-4ebe-8711-84932a2c5ee1 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:15.891303 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3e68ab05-e82a-4ebe-8711-84932a2c5ee1 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:15.894378 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3e68ab05-e82a-4ebe-8711-84932a2c5ee1 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:15.895570 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3e68ab05-e82a-4ebe-8711-84932a2c5ee1 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:15.896670 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-3e68ab05-e82a-4ebe-8711-84932a2c5ee1 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:16.142320 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-3e68ab05-e82a-4ebe-8711-84932a2c5ee1 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '939c48dab59a463f86398ad27837be30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3907a615604f48f0be694a967ccceba7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:16.158113 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-3e68ab05-e82a-4ebe-8711-84932a2c5ee1 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] 10.222.0.33 "GET /compute/v2.1/servers/5753d15c-2b51-4910-81ba-73cfb6a7b105" status: 200 len: 1372 microversion: 2.1 time: 0.290664 Oct 04 22:09:16.159136 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3744/7459] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 22:09:15 2022] GET /compute/v2.1/servers/5753d15c-2b51-4910-81ba-73cfb6a7b105 => generated 1372 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:09:17.215908 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9ce0a8c5-919f-4559-9ef9-d5b889a3d4b1 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:09:17.233109 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-9ce0a8c5-919f-4559-9ef9-d5b889a3d4b1 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] [instance: 5753d15c-2b51-4910-81ba-73cfb6a7b105] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:09:17.302075 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9ce0a8c5-919f-4559-9ef9-d5b889a3d4b1 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:17.302893 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9ce0a8c5-919f-4559-9ef9-d5b889a3d4b1 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:17.304068 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9ce0a8c5-919f-4559-9ef9-d5b889a3d4b1 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:17.305405 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9ce0a8c5-919f-4559-9ef9-d5b889a3d4b1 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:17.315701 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9ce0a8c5-919f-4559-9ef9-d5b889a3d4b1 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:17.317008 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9ce0a8c5-919f-4559-9ef9-d5b889a3d4b1 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:18.045990 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-9ce0a8c5-919f-4559-9ef9-d5b889a3d4b1 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '939c48dab59a463f86398ad27837be30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3907a615604f48f0be694a967ccceba7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:18.077660 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-9ce0a8c5-919f-4559-9ef9-d5b889a3d4b1 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] 10.222.0.33 "GET /compute/v2.1/servers/5753d15c-2b51-4910-81ba-73cfb6a7b105" status: 200 len: 1372 microversion: 2.1 time: 0.881362 Oct 04 22:09:18.089707 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3716/7460] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 22:09:17 2022] GET /compute/v2.1/servers/5753d15c-2b51-4910-81ba-73cfb6a7b105 => generated 1372 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:09:19.130071 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-ad833723-f259-45f4-b6e0-c09bf78ef9a3 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:09:19.131742 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-ad833723-f259-45f4-b6e0-c09bf78ef9a3 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] [instance: 5753d15c-2b51-4910-81ba-73cfb6a7b105] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:09:19.141666 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ad833723-f259-45f4-b6e0-c09bf78ef9a3 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:19.144569 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ad833723-f259-45f4-b6e0-c09bf78ef9a3 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:19.145427 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ad833723-f259-45f4-b6e0-c09bf78ef9a3 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:19.146846 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ad833723-f259-45f4-b6e0-c09bf78ef9a3 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:19.147843 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ad833723-f259-45f4-b6e0-c09bf78ef9a3 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:19.148555 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ad833723-f259-45f4-b6e0-c09bf78ef9a3 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:19.551230 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-ad833723-f259-45f4-b6e0-c09bf78ef9a3 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '939c48dab59a463f86398ad27837be30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3907a615604f48f0be694a967ccceba7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:19.561917 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-ad833723-f259-45f4-b6e0-c09bf78ef9a3 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] 10.222.0.33 "GET /compute/v2.1/servers/5753d15c-2b51-4910-81ba-73cfb6a7b105" status: 200 len: 1372 microversion: 2.1 time: 0.437571 Oct 04 22:09:19.574405 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3745/7461] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 22:09:19 2022] GET /compute/v2.1/servers/5753d15c-2b51-4910-81ba-73cfb6a7b105 => generated 1372 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:09:19.803727 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-e1dbf5ea-6814-43d8-8a57-57eecd4ccdd2 req-e6da5ad1-f45e-43e7-bc87-fdd206e2e932 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5753d15c-2b51-4910-81ba-73cfb6a7b105", "tag": "f962b8cc-8054-454e-ac13-584c9fe90a57"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:09:19.819007 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-e1dbf5ea-6814-43d8-8a57-57eecd4ccdd2 req-e6da5ad1-f45e-43e7-bc87-fdd206e2e932 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:19.819894 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-e1dbf5ea-6814-43d8-8a57-57eecd4ccdd2 req-e6da5ad1-f45e-43e7-bc87-fdd206e2e932 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:19.820560 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-e1dbf5ea-6814-43d8-8a57-57eecd4ccdd2 req-e6da5ad1-f45e-43e7-bc87-fdd206e2e932 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:19.844943 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-e1dbf5ea-6814-43d8-8a57-57eecd4ccdd2 req-e6da5ad1-f45e-43e7-bc87-fdd206e2e932 service nova] Creating event network-changed:f962b8cc-8054-454e-ac13-584c9fe90a57 for instance 5753d15c-2b51-4910-81ba-73cfb6a7b105 on n-h2-854823-8 Oct 04 22:09:19.853858 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-e1dbf5ea-6814-43d8-8a57-57eecd4ccdd2 req-e6da5ad1-f45e-43e7-bc87-fdd206e2e932 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063678 Oct 04 22:09:19.855885 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3717/7462] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 22:09:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 22:09:20.623315 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-06970826-3572-4b3c-8699-4049e6f3417c tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:09:20.624481 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-06970826-3572-4b3c-8699-4049e6f3417c tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] [instance: 5753d15c-2b51-4910-81ba-73cfb6a7b105] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:09:20.640892 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-06970826-3572-4b3c-8699-4049e6f3417c tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:20.643448 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-06970826-3572-4b3c-8699-4049e6f3417c tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:20.644829 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-06970826-3572-4b3c-8699-4049e6f3417c tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:20.646514 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-06970826-3572-4b3c-8699-4049e6f3417c tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:20.647977 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-06970826-3572-4b3c-8699-4049e6f3417c tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:20.649118 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-06970826-3572-4b3c-8699-4049e6f3417c tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:20.949430 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-06970826-3572-4b3c-8699-4049e6f3417c tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '939c48dab59a463f86398ad27837be30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3907a615604f48f0be694a967ccceba7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:20.961858 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-06970826-3572-4b3c-8699-4049e6f3417c tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] 10.222.0.33 "GET /compute/v2.1/servers/5753d15c-2b51-4910-81ba-73cfb6a7b105" status: 200 len: 1372 microversion: 2.1 time: 0.344424 Oct 04 22:09:20.962686 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3746/7463] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 22:09:20 2022] GET /compute/v2.1/servers/5753d15c-2b51-4910-81ba-73cfb6a7b105 => generated 1372 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:09:21.997924 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=2 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:09:21.999595 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell0:SELECT=6 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:09:22.010901 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5b9bae9e-7cf9-4ddc-8f8c-ce9103d71ac1 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:09:22.012403 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-5b9bae9e-7cf9-4ddc-8f8c-ce9103d71ac1 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] [instance: 5753d15c-2b51-4910-81ba-73cfb6a7b105] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:09:22.027401 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5b9bae9e-7cf9-4ddc-8f8c-ce9103d71ac1 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:22.028402 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5b9bae9e-7cf9-4ddc-8f8c-ce9103d71ac1 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:22.029330 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5b9bae9e-7cf9-4ddc-8f8c-ce9103d71ac1 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:22.030920 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5b9bae9e-7cf9-4ddc-8f8c-ce9103d71ac1 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:22.031786 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5b9bae9e-7cf9-4ddc-8f8c-ce9103d71ac1 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:22.032666 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5b9bae9e-7cf9-4ddc-8f8c-ce9103d71ac1 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:22.262561 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-5b9bae9e-7cf9-4ddc-8f8c-ce9103d71ac1 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '939c48dab59a463f86398ad27837be30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3907a615604f48f0be694a967ccceba7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:22.274630 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5b9bae9e-7cf9-4ddc-8f8c-ce9103d71ac1 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] 10.222.0.33 "GET /compute/v2.1/servers/5753d15c-2b51-4910-81ba-73cfb6a7b105" status: 200 len: 1372 microversion: 2.1 time: 0.277677 Oct 04 22:09:22.275859 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3718/7464] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 22:09:21 2022] GET /compute/v2.1/servers/5753d15c-2b51-4910-81ba-73cfb6a7b105 => generated 1372 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:09:23.304529 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-875ae55c-8bcc-461f-8622-f8d588811024 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:09:23.305722 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-875ae55c-8bcc-461f-8622-f8d588811024 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] [instance: 5753d15c-2b51-4910-81ba-73cfb6a7b105] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:09:23.310518 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell0:SELECT=2 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:09:23.320794 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-875ae55c-8bcc-461f-8622-f8d588811024 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:23.321679 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-875ae55c-8bcc-461f-8622-f8d588811024 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:23.322523 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-875ae55c-8bcc-461f-8622-f8d588811024 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:23.323827 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-875ae55c-8bcc-461f-8622-f8d588811024 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:23.324703 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-875ae55c-8bcc-461f-8622-f8d588811024 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:23.325555 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-875ae55c-8bcc-461f-8622-f8d588811024 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:23.486843 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-875ae55c-8bcc-461f-8622-f8d588811024 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '939c48dab59a463f86398ad27837be30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3907a615604f48f0be694a967ccceba7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:23.496165 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-875ae55c-8bcc-461f-8622-f8d588811024 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] 10.222.0.33 "GET /compute/v2.1/servers/5753d15c-2b51-4910-81ba-73cfb6a7b105" status: 200 len: 1372 microversion: 2.1 time: 0.199711 Oct 04 22:09:23.497133 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3747/7465] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 22:09:23 2022] GET /compute/v2.1/servers/5753d15c-2b51-4910-81ba-73cfb6a7b105 => generated 1372 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:09:24.523175 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-767c3686-c1d2-497f-b527-36112520a738 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:09:24.523819 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-767c3686-c1d2-497f-b527-36112520a738 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] [instance: 5753d15c-2b51-4910-81ba-73cfb6a7b105] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:09:24.531195 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-767c3686-c1d2-497f-b527-36112520a738 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:24.531683 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-767c3686-c1d2-497f-b527-36112520a738 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:24.532120 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-767c3686-c1d2-497f-b527-36112520a738 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:24.532921 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-767c3686-c1d2-497f-b527-36112520a738 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:24.533711 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-767c3686-c1d2-497f-b527-36112520a738 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:24.534150 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-767c3686-c1d2-497f-b527-36112520a738 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:24.711376 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-767c3686-c1d2-497f-b527-36112520a738 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '939c48dab59a463f86398ad27837be30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3907a615604f48f0be694a967ccceba7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:24.725185 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-767c3686-c1d2-497f-b527-36112520a738 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] 10.222.0.33 "GET /compute/v2.1/servers/5753d15c-2b51-4910-81ba-73cfb6a7b105" status: 200 len: 1372 microversion: 2.1 time: 0.205697 Oct 04 22:09:24.726277 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3719/7466] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 22:09:24 2022] GET /compute/v2.1/servers/5753d15c-2b51-4910-81ba-73cfb6a7b105 => generated 1372 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:09:25.756765 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-5f444546-c856-46d5-b9e2-a7fcf7d839a0 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:09:25.757397 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-5f444546-c856-46d5-b9e2-a7fcf7d839a0 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] [instance: 5753d15c-2b51-4910-81ba-73cfb6a7b105] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:09:25.765003 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5f444546-c856-46d5-b9e2-a7fcf7d839a0 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:25.765524 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5f444546-c856-46d5-b9e2-a7fcf7d839a0 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:25.765982 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5f444546-c856-46d5-b9e2-a7fcf7d839a0 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:25.766774 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5f444546-c856-46d5-b9e2-a7fcf7d839a0 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:25.767911 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5f444546-c856-46d5-b9e2-a7fcf7d839a0 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:25.768422 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-5f444546-c856-46d5-b9e2-a7fcf7d839a0 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:25.934958 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-5f444546-c856-46d5-b9e2-a7fcf7d839a0 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '939c48dab59a463f86398ad27837be30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3907a615604f48f0be694a967ccceba7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:25.944106 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-5f444546-c856-46d5-b9e2-a7fcf7d839a0 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] 10.222.0.33 "GET /compute/v2.1/servers/5753d15c-2b51-4910-81ba-73cfb6a7b105" status: 200 len: 1372 microversion: 2.1 time: 0.191414 Oct 04 22:09:25.944601 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3748/7467] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 22:09:25 2022] GET /compute/v2.1/servers/5753d15c-2b51-4910-81ba-73cfb6a7b105 => generated 1372 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:09:26.822525 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-f38c7c35-00ac-48a4-a8a3-2bfb431be271 req-16fd85c1-061a-46d1-8eee-342b6b8d080e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5753d15c-2b51-4910-81ba-73cfb6a7b105", "name": "network-vif-plugged", "status": "completed", "tag": "f962b8cc-8054-454e-ac13-584c9fe90a57"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:09:26.837979 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-f38c7c35-00ac-48a4-a8a3-2bfb431be271 req-16fd85c1-061a-46d1-8eee-342b6b8d080e service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:26.838878 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-f38c7c35-00ac-48a4-a8a3-2bfb431be271 req-16fd85c1-061a-46d1-8eee-342b6b8d080e service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:26.839667 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-f38c7c35-00ac-48a4-a8a3-2bfb431be271 req-16fd85c1-061a-46d1-8eee-342b6b8d080e service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:26.861496 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-f38c7c35-00ac-48a4-a8a3-2bfb431be271 req-16fd85c1-061a-46d1-8eee-342b6b8d080e service nova] Creating event network-vif-plugged:f962b8cc-8054-454e-ac13-584c9fe90a57 for instance 5753d15c-2b51-4910-81ba-73cfb6a7b105 on n-h2-854823-8 Oct 04 22:09:26.870863 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-f38c7c35-00ac-48a4-a8a3-2bfb431be271 req-16fd85c1-061a-46d1-8eee-342b6b8d080e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052645 Oct 04 22:09:26.871981 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3720/7468] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 22:09:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 22:09:26.969095 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-42ac029f-5300-4b01-aeef-1ef823a9fbfb tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:09:26.969760 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-42ac029f-5300-4b01-aeef-1ef823a9fbfb tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] [instance: 5753d15c-2b51-4910-81ba-73cfb6a7b105] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:09:26.978196 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-42ac029f-5300-4b01-aeef-1ef823a9fbfb tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:26.978734 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-42ac029f-5300-4b01-aeef-1ef823a9fbfb tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:26.979191 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-42ac029f-5300-4b01-aeef-1ef823a9fbfb tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:26.979975 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-42ac029f-5300-4b01-aeef-1ef823a9fbfb tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:26.980451 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-42ac029f-5300-4b01-aeef-1ef823a9fbfb tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:26.980896 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-42ac029f-5300-4b01-aeef-1ef823a9fbfb tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:27.276848 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-42ac029f-5300-4b01-aeef-1ef823a9fbfb tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '939c48dab59a463f86398ad27837be30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3907a615604f48f0be694a967ccceba7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:27.286503 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-42ac029f-5300-4b01-aeef-1ef823a9fbfb tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] 10.222.0.33 "GET /compute/v2.1/servers/5753d15c-2b51-4910-81ba-73cfb6a7b105" status: 200 len: 1372 microversion: 2.1 time: 0.321325 Oct 04 22:09:27.287244 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3749/7469] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 22:09:26 2022] GET /compute/v2.1/servers/5753d15c-2b51-4910-81ba-73cfb6a7b105 => generated 1372 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 22:09:28.325144 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-9ed9f6ad-fe0b-4777-966f-37639146c812 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:09:28.325844 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-9ed9f6ad-fe0b-4777-966f-37639146c812 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] [instance: 5753d15c-2b51-4910-81ba-73cfb6a7b105] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:09:28.333569 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9ed9f6ad-fe0b-4777-966f-37639146c812 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:28.334057 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9ed9f6ad-fe0b-4777-966f-37639146c812 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:28.334523 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9ed9f6ad-fe0b-4777-966f-37639146c812 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:28.335232 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9ed9f6ad-fe0b-4777-966f-37639146c812 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:28.335685 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9ed9f6ad-fe0b-4777-966f-37639146c812 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:28.336107 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-9ed9f6ad-fe0b-4777-966f-37639146c812 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:28.495156 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-9ed9f6ad-fe0b-4777-966f-37639146c812 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '939c48dab59a463f86398ad27837be30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3907a615604f48f0be694a967ccceba7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:28.506769 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-9ed9f6ad-fe0b-4777-966f-37639146c812 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] 10.222.0.33 "GET /compute/v2.1/servers/5753d15c-2b51-4910-81ba-73cfb6a7b105" status: 200 len: 1556 microversion: 2.1 time: 0.184334 Oct 04 22:09:28.510251 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3721/7470] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 22:09:28 2022] GET /compute/v2.1/servers/5753d15c-2b51-4910-81ba-73cfb6a7b105 => generated 1556 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:09:28.532964 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-57991007-9f8b-4b9b-9892-d5d13b2e8459 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:09:28.533707 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-57991007-9f8b-4b9b-9892-d5d13b2e8459 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] [instance: 5753d15c-2b51-4910-81ba-73cfb6a7b105] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:09:28.541159 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-57991007-9f8b-4b9b-9892-d5d13b2e8459 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:28.541666 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-57991007-9f8b-4b9b-9892-d5d13b2e8459 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:28.542116 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-57991007-9f8b-4b9b-9892-d5d13b2e8459 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:28.542880 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-57991007-9f8b-4b9b-9892-d5d13b2e8459 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:28.543353 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-57991007-9f8b-4b9b-9892-d5d13b2e8459 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:28.543794 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-57991007-9f8b-4b9b-9892-d5d13b2e8459 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:28.693130 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-57991007-9f8b-4b9b-9892-d5d13b2e8459 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '939c48dab59a463f86398ad27837be30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3907a615604f48f0be694a967ccceba7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:09:28.706592 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-57991007-9f8b-4b9b-9892-d5d13b2e8459 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] 10.222.0.33 "GET /compute/v2.1/servers/5753d15c-2b51-4910-81ba-73cfb6a7b105" status: 200 len: 1556 microversion: 2.1 time: 0.177457 Oct 04 22:09:28.707725 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3750/7471] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 22:09:28 2022] GET /compute/v2.1/servers/5753d15c-2b51-4910-81ba-73cfb6a7b105 => generated 1556 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:09:31.057747 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-eca452d8-d4b2-4daa-bff1-938b8a831f07 req-8a0fb879-5a1c-46f3-8859-7cd2fd0f55f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5753d15c-2b51-4910-81ba-73cfb6a7b105", "tag": "f962b8cc-8054-454e-ac13-584c9fe90a57"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:09:31.069628 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-eca452d8-d4b2-4daa-bff1-938b8a831f07 req-8a0fb879-5a1c-46f3-8859-7cd2fd0f55f6 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:09:31.070110 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-eca452d8-d4b2-4daa-bff1-938b8a831f07 req-8a0fb879-5a1c-46f3-8859-7cd2fd0f55f6 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:09:31.070576 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-eca452d8-d4b2-4daa-bff1-938b8a831f07 req-8a0fb879-5a1c-46f3-8859-7cd2fd0f55f6 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:09:31.083285 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-eca452d8-d4b2-4daa-bff1-938b8a831f07 req-8a0fb879-5a1c-46f3-8859-7cd2fd0f55f6 service nova] Creating event network-changed:f962b8cc-8054-454e-ac13-584c9fe90a57 for instance 5753d15c-2b51-4910-81ba-73cfb6a7b105 on n-h2-854823-8 Oct 04 22:09:31.089102 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-eca452d8-d4b2-4daa-bff1-938b8a831f07 req-8a0fb879-5a1c-46f3-8859-7cd2fd0f55f6 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035086 Oct 04 22:09:31.089733 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3722/7472] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 22:09:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:10:57.804659 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_api:SELECT=20 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:10:57.805705 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=48 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:10:57.807521 n-d-854823-8 devstack@n-api.service[128802]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 22:10:57.807741 n-d-854823-8 devstack@n-api.service[128802]: Tue Oct 4 22:10:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5753d15c-2b51-4910-81ba-73cfb6a7b105/action (ip 10.222.0.33) !!! Oct 04 22:10:57.809967 n-d-854823-8 devstack@n-api.service[128802]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 22:10:57.810210 n-d-854823-8 devstack@n-api.service[128802]: Tue Oct 4 22:10:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5753d15c-2b51-4910-81ba-73cfb6a7b105/action (ip 10.222.0.33) !!! Oct 04 22:10:57.816456 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-74a18077-0543-4715-b97d-6046aa261d81 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-1276547070"}} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:10:57.819200 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-74a18077-0543-4715-b97d-6046aa261d81 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] [instance: 5753d15c-2b51-4910-81ba-73cfb6a7b105] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:10:57.830084 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-74a18077-0543-4715-b97d-6046aa261d81 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:57.830622 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-74a18077-0543-4715-b97d-6046aa261d81 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:57.831078 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-74a18077-0543-4715-b97d-6046aa261d81 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:57.831822 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-74a18077-0543-4715-b97d-6046aa261d81 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:10:57.832298 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-74a18077-0543-4715-b97d-6046aa261d81 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:10:57.832739 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-74a18077-0543-4715-b97d-6046aa261d81 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:10:58.082532 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-74a18077-0543-4715-b97d-6046aa261d81 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] 10.222.0.33 "POST /compute/v2.1/servers/5753d15c-2b51-4910-81ba-73cfb6a7b105/action" status: 202 len: 0 microversion: 2.1 time: 0.280102 Oct 04 22:10:58.083494 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3751/7473] 10.222.0.33 () {60 vars in 1278 bytes} [Tue Oct 4 22:10:57 2022] POST /compute/v2.1/servers/5753d15c-2b51-4910-81ba-73cfb6a7b105/action => generated 0 bytes in 282 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 04 22:11:03.428345 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:11:03.430036 n-d-854823-8 devstack@n-api.service[128801]: DEBUG dbcounter [-] [128801] Writing DB stats nova_cell1:SELECT=40 {{(pid=128801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:11:03.431774 n-d-854823-8 devstack@n-api.service[128801]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 22:11:03.432016 n-d-854823-8 devstack@n-api.service[128801]: Tue Oct 4 22:11:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.33) !!! Oct 04 22:11:03.623375 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-9b4b3c75-866a-4856-b0c7-702949a0ad73 req-2f3e2636-361f-492a-ad56-f2f8896e1829 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5753d15c-2b51-4910-81ba-73cfb6a7b105", "name": "network-vif-plugged", "status": "completed", "tag": "f962b8cc-8054-454e-ac13-584c9fe90a57"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:11:03.651249 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-9b4b3c75-866a-4856-b0c7-702949a0ad73 req-2f3e2636-361f-492a-ad56-f2f8896e1829 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:03.652091 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-9b4b3c75-866a-4856-b0c7-702949a0ad73 req-2f3e2636-361f-492a-ad56-f2f8896e1829 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:03.652525 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-9b4b3c75-866a-4856-b0c7-702949a0ad73 req-2f3e2636-361f-492a-ad56-f2f8896e1829 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:03.667190 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-9b4b3c75-866a-4856-b0c7-702949a0ad73 req-2f3e2636-361f-492a-ad56-f2f8896e1829 service nova] Creating event network-vif-plugged:f962b8cc-8054-454e-ac13-584c9fe90a57 for instance 5753d15c-2b51-4910-81ba-73cfb6a7b105 on n-h2-854823-8 Oct 04 22:11:03.673655 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-9b4b3c75-866a-4856-b0c7-702949a0ad73 req-2f3e2636-361f-492a-ad56-f2f8896e1829 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.249583 Oct 04 22:11:03.675040 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3723/7474] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 22:11:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 22:11:13.222780 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_api:SELECT=2 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:11:13.224152 n-d-854823-8 devstack@n-api.service[128802]: DEBUG dbcounter [-] [128802] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128802) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 22:11:13.232301 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-36fa40d4-f43b-43a9-8e4a-0ceaf4b67b6a req-a809f6a0-170e-46f7-b86f-de5a5f0a1a02 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5753d15c-2b51-4910-81ba-73cfb6a7b105", "tag": "f962b8cc-8054-454e-ac13-584c9fe90a57"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:11:13.233411 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-22b59f31-a7be-409b-80a3-7be5389702ad tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:11:13.233810 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-22b59f31-a7be-409b-80a3-7be5389702ad tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] [instance: 5753d15c-2b51-4910-81ba-73cfb6a7b105] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:11:13.247817 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-22b59f31-a7be-409b-80a3-7be5389702ad tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:13.250000 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-22b59f31-a7be-409b-80a3-7be5389702ad tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:13.250749 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-22b59f31-a7be-409b-80a3-7be5389702ad tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:13.252304 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-22b59f31-a7be-409b-80a3-7be5389702ad tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:13.252970 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-36fa40d4-f43b-43a9-8e4a-0ceaf4b67b6a req-a809f6a0-170e-46f7-b86f-de5a5f0a1a02 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:13.253117 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-22b59f31-a7be-409b-80a3-7be5389702ad tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:13.253906 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-22b59f31-a7be-409b-80a3-7be5389702ad tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:13.254199 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-36fa40d4-f43b-43a9-8e4a-0ceaf4b67b6a req-a809f6a0-170e-46f7-b86f-de5a5f0a1a02 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:13.255328 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-36fa40d4-f43b-43a9-8e4a-0ceaf4b67b6a req-a809f6a0-170e-46f7-b86f-de5a5f0a1a02 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:13.277891 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-36fa40d4-f43b-43a9-8e4a-0ceaf4b67b6a req-a809f6a0-170e-46f7-b86f-de5a5f0a1a02 service nova] Creating event network-changed:f962b8cc-8054-454e-ac13-584c9fe90a57 for instance 5753d15c-2b51-4910-81ba-73cfb6a7b105 on n-h2-854823-8 Oct 04 22:11:13.288176 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-36fa40d4-f43b-43a9-8e4a-0ceaf4b67b6a req-a809f6a0-170e-46f7-b86f-de5a5f0a1a02 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065598 Oct 04 22:11:13.289540 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3724/7475] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 22:11:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:11:13.304190 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-22b59f31-a7be-409b-80a3-7be5389702ad tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] [instance: 5753d15c-2b51-4910-81ba-73cfb6a7b105] Going to try to terminate instance {{(pid=128802) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 22:11:13.463873 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-22b59f31-a7be-409b-80a3-7be5389702ad tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] 10.222.0.33 "DELETE /compute/v2.1/servers/5753d15c-2b51-4910-81ba-73cfb6a7b105" status: 204 len: 0 microversion: 2.1 time: 0.243451 Oct 04 22:11:13.465317 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3752/7476] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 22:11:13 2022] DELETE /compute/v2.1/servers/5753d15c-2b51-4910-81ba-73cfb6a7b105 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 22:11:13.484901 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-58f821ce-f22a-499e-bcc8-baab65178129 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:11:13.507517 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-58f821ce-f22a-499e-bcc8-baab65178129 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] [instance: 5753d15c-2b51-4910-81ba-73cfb6a7b105] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:11:13.530386 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-58f821ce-f22a-499e-bcc8-baab65178129 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:13.531685 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-58f821ce-f22a-499e-bcc8-baab65178129 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:13.532722 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-58f821ce-f22a-499e-bcc8-baab65178129 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:13.535360 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-58f821ce-f22a-499e-bcc8-baab65178129 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:13.536238 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-58f821ce-f22a-499e-bcc8-baab65178129 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:13.537046 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-58f821ce-f22a-499e-bcc8-baab65178129 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:13.744732 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-58f821ce-f22a-499e-bcc8-baab65178129 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '939c48dab59a463f86398ad27837be30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3907a615604f48f0be694a967ccceba7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:11:13.762798 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-58f821ce-f22a-499e-bcc8-baab65178129 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] 10.222.0.33 "GET /compute/v2.1/servers/5753d15c-2b51-4910-81ba-73cfb6a7b105" status: 200 len: 1680 microversion: 2.1 time: 0.291273 Oct 04 22:11:13.764312 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3725/7477] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 22:11:13 2022] GET /compute/v2.1/servers/5753d15c-2b51-4910-81ba-73cfb6a7b105 => generated 1680 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:11:14.793520 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-ba03b145-c108-4b4c-8cd5-71f99bb000d3 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:11:14.794248 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-ba03b145-c108-4b4c-8cd5-71f99bb000d3 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] [instance: 5753d15c-2b51-4910-81ba-73cfb6a7b105] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:11:14.803851 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ba03b145-c108-4b4c-8cd5-71f99bb000d3 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:14.804804 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ba03b145-c108-4b4c-8cd5-71f99bb000d3 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:14.805614 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ba03b145-c108-4b4c-8cd5-71f99bb000d3 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:14.806929 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ba03b145-c108-4b4c-8cd5-71f99bb000d3 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:14.807815 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ba03b145-c108-4b4c-8cd5-71f99bb000d3 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:14.808808 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-ba03b145-c108-4b4c-8cd5-71f99bb000d3 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:14.970726 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-ba03b145-c108-4b4c-8cd5-71f99bb000d3 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '939c48dab59a463f86398ad27837be30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3907a615604f48f0be694a967ccceba7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:11:14.979986 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-ba03b145-c108-4b4c-8cd5-71f99bb000d3 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] 10.222.0.33 "GET /compute/v2.1/servers/5753d15c-2b51-4910-81ba-73cfb6a7b105" status: 200 len: 1680 microversion: 2.1 time: 0.190748 Oct 04 22:11:14.981025 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3753/7478] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 22:11:14 2022] GET /compute/v2.1/servers/5753d15c-2b51-4910-81ba-73cfb6a7b105 => generated 1680 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:11:15.383516 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [req-33dfb083-bfdf-4de0-a269-a4f85810c65a req-1c5415b8-6cad-4b9b-8af1-a13395b058ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5753d15c-2b51-4910-81ba-73cfb6a7b105", "name": "network-vif-unplugged", "status": "completed", "tag": "f962b8cc-8054-454e-ac13-584c9fe90a57"}]} {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:11:15.409381 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-33dfb083-bfdf-4de0-a269-a4f85810c65a req-1c5415b8-6cad-4b9b-8af1-a13395b058ea service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:15.410983 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-33dfb083-bfdf-4de0-a269-a4f85810c65a req-1c5415b8-6cad-4b9b-8af1-a13395b058ea service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:15.412036 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [req-33dfb083-bfdf-4de0-a269-a4f85810c65a req-1c5415b8-6cad-4b9b-8af1-a13395b058ea service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:15.436836 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.compute.server_external_events [req-33dfb083-bfdf-4de0-a269-a4f85810c65a req-1c5415b8-6cad-4b9b-8af1-a13395b058ea service nova] Creating event network-vif-unplugged:f962b8cc-8054-454e-ac13-584c9fe90a57 for instance 5753d15c-2b51-4910-81ba-73cfb6a7b105 on n-h2-854823-8 Oct 04 22:11:15.446916 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [req-33dfb083-bfdf-4de0-a269-a4f85810c65a req-1c5415b8-6cad-4b9b-8af1-a13395b058ea service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.070133 Oct 04 22:11:15.449325 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3726/7479] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 22:11:15 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:11:15.758942 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-11e6ccf5-f9cb-4a6a-a4bf-2d66896ece8a req-f1ac6a6b-d9fb-42bf-9909-b1201e1b6083 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5753d15c-2b51-4910-81ba-73cfb6a7b105", "name": "network-vif-deleted", "tag": "f962b8cc-8054-454e-ac13-584c9fe90a57"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:11:15.772172 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-11e6ccf5-f9cb-4a6a-a4bf-2d66896ece8a req-f1ac6a6b-d9fb-42bf-9909-b1201e1b6083 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:15.772792 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-11e6ccf5-f9cb-4a6a-a4bf-2d66896ece8a req-f1ac6a6b-d9fb-42bf-9909-b1201e1b6083 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:15.774549 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-11e6ccf5-f9cb-4a6a-a4bf-2d66896ece8a req-f1ac6a6b-d9fb-42bf-9909-b1201e1b6083 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:15.793382 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-11e6ccf5-f9cb-4a6a-a4bf-2d66896ece8a req-f1ac6a6b-d9fb-42bf-9909-b1201e1b6083 service nova] Creating event network-vif-deleted:f962b8cc-8054-454e-ac13-584c9fe90a57 for instance 5753d15c-2b51-4910-81ba-73cfb6a7b105 on n-h2-854823-8 Oct 04 22:11:15.805449 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-11e6ccf5-f9cb-4a6a-a4bf-2d66896ece8a req-f1ac6a6b-d9fb-42bf-9909-b1201e1b6083 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050358 Oct 04 22:11:15.806643 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3754/7480] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 22:11:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:11:16.007218 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-1d27485c-9df9-4bab-9064-cf09aabc7854 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:11:16.008061 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-1d27485c-9df9-4bab-9064-cf09aabc7854 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] [instance: 5753d15c-2b51-4910-81ba-73cfb6a7b105] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:11:16.018964 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1d27485c-9df9-4bab-9064-cf09aabc7854 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:16.019866 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1d27485c-9df9-4bab-9064-cf09aabc7854 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:16.020342 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1d27485c-9df9-4bab-9064-cf09aabc7854 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:16.021496 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1d27485c-9df9-4bab-9064-cf09aabc7854 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:16.022177 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1d27485c-9df9-4bab-9064-cf09aabc7854 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:16.022977 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1d27485c-9df9-4bab-9064-cf09aabc7854 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:16.073162 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1d27485c-9df9-4bab-9064-cf09aabc7854 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:16.073664 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1d27485c-9df9-4bab-9064-cf09aabc7854 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:16.074105 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-1d27485c-9df9-4bab-9064-cf09aabc7854 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:16.074607 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.objects.instance [None req-1d27485c-9df9-4bab-9064-cf09aabc7854 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Lazy-loading 'fault' on Instance uuid 5753d15c-2b51-4910-81ba-73cfb6a7b105 {{(pid=128801) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 22:11:16.130107 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-1d27485c-9df9-4bab-9064-cf09aabc7854 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '939c48dab59a463f86398ad27837be30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3907a615604f48f0be694a967ccceba7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:11:16.140415 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-1d27485c-9df9-4bab-9064-cf09aabc7854 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] 10.222.0.33 "GET /compute/v2.1/servers/5753d15c-2b51-4910-81ba-73cfb6a7b105" status: 200 len: 1337 microversion: 2.1 time: 0.137670 Oct 04 22:11:16.146412 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3727/7481] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 22:11:16 2022] GET /compute/v2.1/servers/5753d15c-2b51-4910-81ba-73cfb6a7b105 => generated 1337 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:11:17.181776 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-15910616-1ac6-423e-91a4-54518c48a553 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:11:17.183792 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-15910616-1ac6-423e-91a4-54518c48a553 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] [instance: 5753d15c-2b51-4910-81ba-73cfb6a7b105] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:11:17.197756 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-15910616-1ac6-423e-91a4-54518c48a553 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:17.199520 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-15910616-1ac6-423e-91a4-54518c48a553 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:17.200715 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-15910616-1ac6-423e-91a4-54518c48a553 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:17.203131 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-15910616-1ac6-423e-91a4-54518c48a553 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:17.203987 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-15910616-1ac6-423e-91a4-54518c48a553 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:17.205052 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-15910616-1ac6-423e-91a4-54518c48a553 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:17.239032 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.wsgi [None req-15910616-1ac6-423e-91a4-54518c48a553 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] HTTP exception thrown: Instance 5753d15c-2b51-4910-81ba-73cfb6a7b105 could not be found. Oct 04 22:11:17.242311 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-15910616-1ac6-423e-91a4-54518c48a553 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Request method failure captured: Oct 04 22:11:17.242311 n-d-854823-8 devstack@n-api.service[128802]: request: GET /compute/v2.1/servers/5753d15c-2b51-4910-81ba-73cfb6a7b105 HTTP/1.1 Oct 04 22:11:17.242311 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 22:11:17.242311 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 22:11:17.242311 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 22:11:17.242311 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 0 Oct 04 22:11:17.242311 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 22:11:17.242311 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 22:11:17.242311 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 22:11:17.242311 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 22:11:17.242311 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPK5l8qx7l6Fsj-WDISIN14-0b29jrP_3TqwQX6CGPkBRSKmHXtSYsCgIrgnBqmevWihYvdFeTwiPK8JPIz67itv0ckH77oel7tKpGyzTwsWiUqdCl36uZbhqQzcnY-4dYpJbUw3MVnNIacAnGNOCm9brgfsb71e80GD_SyqytsWOMd4 Oct 04 22:11:17.242311 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 22:11:17.242311 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 22:11:17.242311 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 22:11:17.242311 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 22:11:17.242311 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 22:11:17.242311 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 22:11:17.242311 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: 3907a615604f48f0be694a967ccceba7 Oct 04 22:11:17.242311 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-TestSnapshotPattern-1780641120 Oct 04 22:11:17.242311 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 22:11:17.242311 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 22:11:17.242311 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_3907a615604f48f0be694a967ccceba7", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3907a615604f48f0be694a967ccceba7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3907a615604f48f0be694a967ccceba7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/3907a615604f48f0be694a967ccceba7"}]}] Oct 04 22:11:17.242311 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-TestSnapshotPattern-1780641120 Oct 04 22:11:17.242311 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: 3907a615604f48f0be694a967ccceba7 Oct 04 22:11:17.242311 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-TestSnapshotPattern-1780641120 Oct 04 22:11:17.242311 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-TestSnapshotPattern-1780641120-project Oct 04 22:11:17.242311 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 22:11:17.242311 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 22:11:17.242311 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: 939c48dab59a463f86398ad27837be30 Oct 04 22:11:17.242311 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-TestSnapshotPattern-1780641120-project Oct 04 22:11:17.242311 n-d-854823-8 devstack@n-api.service[128802]: method: > Oct 04 22:11:17.242311 n-d-854823-8 devstack@n-api.service[128802]: exception: Instance 5753d15c-2b51-4910-81ba-73cfb6a7b105 could not be found. Oct 04 22:11:17.242311 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'id': '5753d15c-2b51-4910-81ba-73cfb6a7b105'} Oct 04 22:11:17.242311 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:11:17.242311 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:11:17.242311 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:11:17.242311 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:11:17.242311 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:11:17.242311 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:11:17.242311 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:11:17.242311 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:11:17.242311 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:11:17.242311 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:11:17.242311 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5753d15c-2b51-4910-81ba-73cfb6a7b105 could not be found. Oct 04 22:11:17.242311 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 22:11:17.242311 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:11:17.242311 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 22:11:17.242311 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:11:17.242311 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:11:17.242311 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:11:17.242311 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:11:17.242311 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:11:17.242311 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:11:17.242311 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:11:17.242311 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:11:17.242311 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:11:17.242311 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:11:17.242311 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:11:17.242311 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:11:17.242311 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:11:17.242311 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5753d15c-2b51-4910-81ba-73cfb6a7b105 could not be found. Oct 04 22:11:17.242311 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 22:11:17.242311 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:11:17.242311 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 22:11:17.253464 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:11:17.253464 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:11:17.253464 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:11:17.253464 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:11:17.253464 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:11:17.253464 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5753d15c-2b51-4910-81ba-73cfb6a7b105 could not be found. Oct 04 22:11:17.253464 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 22:11:17.253464 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-15910616-1ac6-423e-91a4-54518c48a553 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Returning 404 to user: Instance 5753d15c-2b51-4910-81ba-73cfb6a7b105 could not be found. {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:11:17.253464 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-15910616-1ac6-423e-91a4-54518c48a553 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] 10.222.0.33 "GET /compute/v2.1/servers/5753d15c-2b51-4910-81ba-73cfb6a7b105" status: 404 len: 111 microversion: 2.1 time: 0.076435 Oct 04 22:11:17.255827 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3755/7482] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 22:11:17 2022] GET /compute/v2.1/servers/5753d15c-2b51-4910-81ba-73cfb6a7b105 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:11:19.012919 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-6bfce827-a072-4227-8587-af9e005365ac req-77a45e85-807a-43fa-b576-294770e0c7b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b876156-2816-4a9e-b56a-3d750552a21c", "tag": "7e4a7f5d-cdd0-4b32-9e40-cfee843ae8b6"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:11:19.016872 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-c04c28f4-baaf-4d86-bab5-41074e319e67 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:11:19.017758 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c04c28f4-baaf-4d86-bab5-41074e319e67 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] [instance: 7b876156-2816-4a9e-b56a-3d750552a21c] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:11:19.025022 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-6bfce827-a072-4227-8587-af9e005365ac req-77a45e85-807a-43fa-b576-294770e0c7b1 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:19.025524 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-6bfce827-a072-4227-8587-af9e005365ac req-77a45e85-807a-43fa-b576-294770e0c7b1 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:19.026197 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-6bfce827-a072-4227-8587-af9e005365ac req-77a45e85-807a-43fa-b576-294770e0c7b1 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:19.032434 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c04c28f4-baaf-4d86-bab5-41074e319e67 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:19.033326 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c04c28f4-baaf-4d86-bab5-41074e319e67 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:19.034099 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c04c28f4-baaf-4d86-bab5-41074e319e67 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:19.035492 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c04c28f4-baaf-4d86-bab5-41074e319e67 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:19.036363 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c04c28f4-baaf-4d86-bab5-41074e319e67 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:19.037151 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-c04c28f4-baaf-4d86-bab5-41074e319e67 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:19.042859 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-6bfce827-a072-4227-8587-af9e005365ac req-77a45e85-807a-43fa-b576-294770e0c7b1 service nova] Creating event network-changed:7e4a7f5d-cdd0-4b32-9e40-cfee843ae8b6 for instance 7b876156-2816-4a9e-b56a-3d750552a21c on n-h1-854823-8 Oct 04 22:11:19.049206 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-6bfce827-a072-4227-8587-af9e005365ac req-77a45e85-807a-43fa-b576-294770e0c7b1 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040359 Oct 04 22:11:19.049817 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3756/7483] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 22:11:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:11:19.091840 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-c04c28f4-baaf-4d86-bab5-41074e319e67 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] [instance: 7b876156-2816-4a9e-b56a-3d750552a21c] Going to try to terminate instance {{(pid=128801) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 22:11:19.255687 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-c04c28f4-baaf-4d86-bab5-41074e319e67 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] 10.222.0.33 "DELETE /compute/v2.1/servers/7b876156-2816-4a9e-b56a-3d750552a21c" status: 204 len: 0 microversion: 2.1 time: 0.247331 Oct 04 22:11:19.257241 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3728/7484] 10.222.0.33 () {58 vars in 1239 bytes} [Tue Oct 4 22:11:19 2022] DELETE /compute/v2.1/servers/7b876156-2816-4a9e-b56a-3d750552a21c => generated 0 bytes in 251 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 22:11:19.270186 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-642e1a42-41c3-4199-b69d-c48fd0474111 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:11:19.271542 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-642e1a42-41c3-4199-b69d-c48fd0474111 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] [instance: 7b876156-2816-4a9e-b56a-3d750552a21c] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:11:19.283366 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-642e1a42-41c3-4199-b69d-c48fd0474111 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:19.284279 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-642e1a42-41c3-4199-b69d-c48fd0474111 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:19.285142 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-642e1a42-41c3-4199-b69d-c48fd0474111 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:19.285969 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-642e1a42-41c3-4199-b69d-c48fd0474111 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:19.286712 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-642e1a42-41c3-4199-b69d-c48fd0474111 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:19.287391 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-642e1a42-41c3-4199-b69d-c48fd0474111 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:19.465960 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.policy [None req-642e1a42-41c3-4199-b69d-c48fd0474111 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '939c48dab59a463f86398ad27837be30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3907a615604f48f0be694a967ccceba7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128802) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:11:19.478777 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-642e1a42-41c3-4199-b69d-c48fd0474111 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] 10.222.0.33 "GET /compute/v2.1/servers/7b876156-2816-4a9e-b56a-3d750552a21c" status: 200 len: 1680 microversion: 2.1 time: 0.214808 Oct 04 22:11:19.479528 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3757/7485] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 22:11:19 2022] GET /compute/v2.1/servers/7b876156-2816-4a9e-b56a-3d750552a21c => generated 1680 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:11:20.514915 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-5a615e31-95a3-4061-a1b6-f4824ebdedcf tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:11:20.515716 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-5a615e31-95a3-4061-a1b6-f4824ebdedcf tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] [instance: 7b876156-2816-4a9e-b56a-3d750552a21c] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:11:20.523929 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5a615e31-95a3-4061-a1b6-f4824ebdedcf tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:20.524424 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5a615e31-95a3-4061-a1b6-f4824ebdedcf tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:20.524856 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5a615e31-95a3-4061-a1b6-f4824ebdedcf tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:20.525561 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5a615e31-95a3-4061-a1b6-f4824ebdedcf tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:20.526017 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5a615e31-95a3-4061-a1b6-f4824ebdedcf tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:20.526496 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-5a615e31-95a3-4061-a1b6-f4824ebdedcf tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:20.687469 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-5a615e31-95a3-4061-a1b6-f4824ebdedcf tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '939c48dab59a463f86398ad27837be30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3907a615604f48f0be694a967ccceba7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:11:20.698650 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-5a615e31-95a3-4061-a1b6-f4824ebdedcf tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] 10.222.0.33 "GET /compute/v2.1/servers/7b876156-2816-4a9e-b56a-3d750552a21c" status: 200 len: 1680 microversion: 2.1 time: 0.188366 Oct 04 22:11:20.700112 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3729/7486] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 22:11:20 2022] GET /compute/v2.1/servers/7b876156-2816-4a9e-b56a-3d750552a21c => generated 1680 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:11:21.704228 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [req-7c789b10-6828-4a65-a7cc-00bdd0d9903d req-d5c329bb-b267-4b65-a5a8-80ee880254d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b876156-2816-4a9e-b56a-3d750552a21c", "name": "network-vif-deleted", "tag": "7e4a7f5d-cdd0-4b32-9e40-cfee843ae8b6"}]} {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 22:11:21.715501 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-7c789b10-6828-4a65-a7cc-00bdd0d9903d req-d5c329bb-b267-4b65-a5a8-80ee880254d1 service nova] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:21.715990 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-7c789b10-6828-4a65-a7cc-00bdd0d9903d req-d5c329bb-b267-4b65-a5a8-80ee880254d1 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:21.717307 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [req-7c789b10-6828-4a65-a7cc-00bdd0d9903d req-d5c329bb-b267-4b65-a5a8-80ee880254d1 service nova] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:21.734092 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.compute.server_external_events [req-7c789b10-6828-4a65-a7cc-00bdd0d9903d req-d5c329bb-b267-4b65-a5a8-80ee880254d1 service nova] Creating event network-vif-deleted:7e4a7f5d-cdd0-4b32-9e40-cfee843ae8b6 for instance 7b876156-2816-4a9e-b56a-3d750552a21c on n-h1-854823-8 Oct 04 22:11:21.736493 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-a03a1940-1bcf-4a12-b778-629017acc8bb tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Calling method '>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:11:21.737712 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.compute.api [None req-a03a1940-1bcf-4a12-b778-629017acc8bb tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] [instance: 7b876156-2816-4a9e-b56a-3d750552a21c] Fetching instance by UUID {{(pid=128801) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:11:21.741075 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [req-7c789b10-6828-4a65-a7cc-00bdd0d9903d req-d5c329bb-b267-4b65-a5a8-80ee880254d1 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041744 Oct 04 22:11:21.741825 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3758/7487] 10.222.0.33 () {64 vars in 1317 bytes} [Tue Oct 4 22:11:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 22:11:21.753574 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a03a1940-1bcf-4a12-b778-629017acc8bb tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:21.754537 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a03a1940-1bcf-4a12-b778-629017acc8bb tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:21.755596 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a03a1940-1bcf-4a12-b778-629017acc8bb tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:21.756908 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a03a1940-1bcf-4a12-b778-629017acc8bb tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:21.759302 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a03a1940-1bcf-4a12-b778-629017acc8bb tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:21.760704 n-d-854823-8 devstack@n-api.service[128801]: DEBUG oslo_concurrency.lockutils [None req-a03a1940-1bcf-4a12-b778-629017acc8bb tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:21.865784 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.policy [None req-a03a1940-1bcf-4a12-b778-629017acc8bb tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '939c48dab59a463f86398ad27837be30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3907a615604f48f0be694a967ccceba7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128801) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 22:11:21.875989 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-a03a1940-1bcf-4a12-b778-629017acc8bb tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] 10.222.0.33 "GET /compute/v2.1/servers/7b876156-2816-4a9e-b56a-3d750552a21c" status: 200 len: 1332 microversion: 2.1 time: 0.147578 Oct 04 22:11:21.876604 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3730/7488] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 22:11:21 2022] GET /compute/v2.1/servers/7b876156-2816-4a9e-b56a-3d750552a21c => generated 1332 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 22:11:22.902442 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-87fa0d26-1f52-4625-803e-71804d7627d7 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Calling method '>' {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:11:22.903167 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.compute.api [None req-87fa0d26-1f52-4625-803e-71804d7627d7 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] [instance: 7b876156-2816-4a9e-b56a-3d750552a21c] Fetching instance by UUID {{(pid=128802) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 22:11:22.911602 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-87fa0d26-1f52-4625-803e-71804d7627d7 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:22.912109 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-87fa0d26-1f52-4625-803e-71804d7627d7 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:22.912562 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-87fa0d26-1f52-4625-803e-71804d7627d7 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:22.913294 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-87fa0d26-1f52-4625-803e-71804d7627d7 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Acquiring lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 22:11:22.913768 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-87fa0d26-1f52-4625-803e-71804d7627d7 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 22:11:22.914205 n-d-854823-8 devstack@n-api.service[128802]: DEBUG oslo_concurrency.lockutils [None req-87fa0d26-1f52-4625-803e-71804d7627d7 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Lock "189ff13b-7538-4a71-a71c-1e7f1d3e1b46" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 22:11:22.930163 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.wsgi [None req-87fa0d26-1f52-4625-803e-71804d7627d7 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] HTTP exception thrown: Instance 7b876156-2816-4a9e-b56a-3d750552a21c could not be found. Oct 04 22:11:22.931908 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-87fa0d26-1f52-4625-803e-71804d7627d7 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Request method failure captured: Oct 04 22:11:22.931908 n-d-854823-8 devstack@n-api.service[128802]: request: GET /compute/v2.1/servers/7b876156-2816-4a9e-b56a-3d750552a21c HTTP/1.1 Oct 04 22:11:22.931908 n-d-854823-8 devstack@n-api.service[128802]: Accept: application/json Oct 04 22:11:22.931908 n-d-854823-8 devstack@n-api.service[128802]: Accept-Encoding: identity Oct 04 22:11:22.931908 n-d-854823-8 devstack@n-api.service[128802]: Connection: close Oct 04 22:11:22.931908 n-d-854823-8 devstack@n-api.service[128802]: Content-Length: 0 Oct 04 22:11:22.931908 n-d-854823-8 devstack@n-api.service[128802]: Content-Type: application/json Oct 04 22:11:22.931908 n-d-854823-8 devstack@n-api.service[128802]: Host: 10.222.0.33 Oct 04 22:11:22.931908 n-d-854823-8 devstack@n-api.service[128802]: Openstack-System-Scope: None Oct 04 22:11:22.931908 n-d-854823-8 devstack@n-api.service[128802]: User-Agent: python-urllib3/1.26.12 Oct 04 22:11:22.931908 n-d-854823-8 devstack@n-api.service[128802]: X-Auth-Token: gAAAAABjPK5l8qx7l6Fsj-WDISIN14-0b29jrP_3TqwQX6CGPkBRSKmHXtSYsCgIrgnBqmevWihYvdFeTwiPK8JPIz67itv0ckH77oel7tKpGyzTwsWiUqdCl36uZbhqQzcnY-4dYpJbUw3MVnNIacAnGNOCm9brgfsb71e80GD_SyqytsWOMd4 Oct 04 22:11:22.931908 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Id: None Oct 04 22:11:22.931908 n-d-854823-8 devstack@n-api.service[128802]: X-Domain-Name: None Oct 04 22:11:22.931908 n-d-854823-8 devstack@n-api.service[128802]: X-Identity-Status: Confirmed Oct 04 22:11:22.931908 n-d-854823-8 devstack@n-api.service[128802]: X-Is-Admin-Project: True Oct 04 22:11:22.931908 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Id: default Oct 04 22:11:22.931908 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Domain-Name: Default Oct 04 22:11:22.931908 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Id: 3907a615604f48f0be694a967ccceba7 Oct 04 22:11:22.931908 n-d-854823-8 devstack@n-api.service[128802]: X-Project-Name: tempest-TestSnapshotPattern-1780641120 Oct 04 22:11:22.931908 n-d-854823-8 devstack@n-api.service[128802]: X-Role: reader,member Oct 04 22:11:22.931908 n-d-854823-8 devstack@n-api.service[128802]: X-Roles: reader,member Oct 04 22:11:22.931908 n-d-854823-8 devstack@n-api.service[128802]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_3907a615604f48f0be694a967ccceba7", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3907a615604f48f0be694a967ccceba7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3907a615604f48f0be694a967ccceba7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/3907a615604f48f0be694a967ccceba7"}]}] Oct 04 22:11:22.931908 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant: tempest-TestSnapshotPattern-1780641120 Oct 04 22:11:22.931908 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Id: 3907a615604f48f0be694a967ccceba7 Oct 04 22:11:22.931908 n-d-854823-8 devstack@n-api.service[128802]: X-Tenant-Name: tempest-TestSnapshotPattern-1780641120 Oct 04 22:11:22.931908 n-d-854823-8 devstack@n-api.service[128802]: X-User: tempest-TestSnapshotPattern-1780641120-project Oct 04 22:11:22.931908 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Id: default Oct 04 22:11:22.931908 n-d-854823-8 devstack@n-api.service[128802]: X-User-Domain-Name: Default Oct 04 22:11:22.931908 n-d-854823-8 devstack@n-api.service[128802]: X-User-Id: 939c48dab59a463f86398ad27837be30 Oct 04 22:11:22.931908 n-d-854823-8 devstack@n-api.service[128802]: X-User-Name: tempest-TestSnapshotPattern-1780641120-project Oct 04 22:11:22.931908 n-d-854823-8 devstack@n-api.service[128802]: method: > Oct 04 22:11:22.931908 n-d-854823-8 devstack@n-api.service[128802]: exception: Instance 7b876156-2816-4a9e-b56a-3d750552a21c could not be found. Oct 04 22:11:22.931908 n-d-854823-8 devstack@n-api.service[128802]: action_args: {'id': '7b876156-2816-4a9e-b56a-3d750552a21c'} Oct 04 22:11:22.931908 n-d-854823-8 devstack@n-api.service[128802]: {{(pid=128802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 22:11:22.931908 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:11:22.931908 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 22:11:22.931908 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 22:11:22.931908 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 22:11:22.931908 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 22:11:22.931908 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 22:11:22.931908 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 22:11:22.931908 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 22:11:22.931908 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 22:11:22.931908 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b876156-2816-4a9e-b56a-3d750552a21c could not be found. Oct 04 22:11:22.931908 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 22:11:22.931908 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:11:22.931908 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 22:11:22.931908 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:11:22.931908 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:11:22.931908 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:11:22.931908 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 22:11:22.931908 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 22:11:22.931908 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 22:11:22.931908 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 22:11:22.931908 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 22:11:22.931908 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 22:11:22.931908 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 22:11:22.931908 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 22:11:22.931908 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 22:11:22.931908 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 22:11:22.931908 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b876156-2816-4a9e-b56a-3d750552a21c could not be found. Oct 04 22:11:22.931908 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 22:11:22.931908 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 22:11:22.931908 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 22:11:22.940234 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 22:11:22.940234 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 22:11:22.940234 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 22:11:22.940234 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 22:11:22.940234 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 22:11:22.940234 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b876156-2816-4a9e-b56a-3d750552a21c could not be found. Oct 04 22:11:22.940234 n-d-854823-8 devstack@n-api.service[128802]: ERROR nova.api.openstack.wsgi Oct 04 22:11:22.940234 n-d-854823-8 devstack@n-api.service[128802]: DEBUG nova.api.openstack.wsgi [None req-87fa0d26-1f52-4625-803e-71804d7627d7 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Returning 404 to user: Instance 7b876156-2816-4a9e-b56a-3d750552a21c could not be found. {{(pid=128802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 22:11:22.940234 n-d-854823-8 devstack@n-api.service[128802]: INFO nova.api.openstack.requestlog [None req-87fa0d26-1f52-4625-803e-71804d7627d7 tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] 10.222.0.33 "GET /compute/v2.1/servers/7b876156-2816-4a9e-b56a-3d750552a21c" status: 404 len: 111 microversion: 2.1 time: 0.036268 Oct 04 22:11:22.940234 n-d-854823-8 devstack@n-api.service[128802]: [pid: 128802|app: 0|req: 3759/7489] 10.222.0.33 () {58 vars in 1236 bytes} [Tue Oct 4 22:11:22 2022] GET /compute/v2.1/servers/7b876156-2816-4a9e-b56a-3d750552a21c => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 22:11:23.131790 n-d-854823-8 devstack@n-api.service[128801]: DEBUG nova.api.openstack.wsgi [None req-20347851-308a-4fd1-9f3a-24e855aae3dd tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] Calling method '.version_select at 0x7f3c740a70d0>' {{(pid=128801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 22:11:23.163294 n-d-854823-8 devstack@n-api.service[128801]: INFO nova.api.openstack.requestlog [None req-20347851-308a-4fd1-9f3a-24e855aae3dd tempest-TestSnapshotPattern-1780641120 tempest-TestSnapshotPattern-1780641120-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-856079975" status: 202 len: 0 microversion: 2.1 time: 0.035997 Oct 04 22:11:23.164926 n-d-854823-8 devstack@n-api.service[128801]: [pid: 128801|app: 0|req: 3731/7490] 10.222.0.33 () {58 vars in 1254 bytes} [Tue Oct 4 22:11:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-856079975 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)